2022-04-05 07:29:58,451 INFO MainThread:1296302 [internal.py:wandb_internal():92] W&B internal server running at pid: 1296302, started at: 2022-04-05 07:29:58.451673 2022-04-05 07:29:58,454 INFO WriterThread:1296302 [datastore.py:open_for_write():77] open: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/run-2qz2hoci.wandb 2022-04-05 07:29:58,455 DEBUG SenderThread:1296302 [sender.py:send():235] send: header 2022-04-05 07:29:58,455 DEBUG SenderThread:1296302 [sender.py:send():235] send: run 2022-04-05 07:29:58,525 DEBUG HandlerThread:1296302 [handler.py:handle_request():141] handle_request: check_version 2022-04-05 07:29:58,526 INFO SenderThread:1296302 [dir_watcher.py:__init__():169] watching files in: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/files 2022-04-05 07:29:58,526 INFO SenderThread:1296302 [sender.py:_start_run_threads():812] run started: 2qz2hoci with start time 1649143797 2022-04-05 07:29:58,526 DEBUG SenderThread:1296302 [sender.py:send():235] send: summary 2022-04-05 07:29:58,526 INFO SenderThread:1296302 [sender.py:_save_file():947] saving file wandb-summary.json with policy end 2022-04-05 07:29:58,526 DEBUG SenderThread:1296302 [sender.py:send_request():249] send_request: check_version 2022-04-05 07:29:58,588 DEBUG HandlerThread:1296302 [handler.py:handle_request():141] handle_request: run_start 2022-04-05 07:29:59,528 INFO Thread-7 :1296302 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/files/wandb-summary.json 2022-04-05 07:30:00,973 DEBUG HandlerThread:1296302 [meta.py:__init__():37] meta init 2022-04-05 07:30:00,973 DEBUG HandlerThread:1296302 [meta.py:__init__():51] meta init done 2022-04-05 07:30:00,973 DEBUG HandlerThread:1296302 [meta.py:probe():211] probe 2022-04-05 07:30:00,974 DEBUG HandlerThread:1296302 [meta.py:_setup_git():201] setup git 2022-04-05 07:30:01,013 DEBUG HandlerThread:1296302 [meta.py:_setup_git():208] setup git done 2022-04-05 07:30:01,013 DEBUG HandlerThread:1296302 [meta.py:_save_pip():55] save pip 2022-04-05 07:30:01,014 DEBUG HandlerThread:1296302 [meta.py:_save_pip():69] save pip done 2022-04-05 07:30:01,014 DEBUG HandlerThread:1296302 [meta.py:probe():249] probe done 2022-04-05 07:30:01,017 DEBUG SenderThread:1296302 [sender.py:send():235] send: files 2022-04-05 07:30:01,017 INFO SenderThread:1296302 [sender.py:_save_file():947] saving file wandb-metadata.json with policy now 2022-04-05 07:30:01,023 DEBUG HandlerThread:1296302 [handler.py:handle_request():141] handle_request: stop_status 2022-04-05 07:30:01,024 DEBUG SenderThread:1296302 [sender.py:send_request():249] send_request: stop_status 2022-04-05 07:30:01,053 DEBUG SenderThread:1296302 [sender.py:send():235] send: telemetry 2022-04-05 07:30:01,270 INFO Thread-11 :1296302 [upload_job.py:push():137] Uploaded file /tmp/tmp9xm7tal5wandb/my0unqs2-wandb-metadata.json 2022-04-05 07:30:01,528 INFO Thread-7 :1296302 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/files/output.log 2022-04-05 07:30:01,528 INFO Thread-7 :1296302 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/files/requirements.txt 2022-04-05 07:30:01,528 INFO Thread-7 :1296302 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/files/wandb-metadata.json 2022-04-05 07:30:03,529 INFO Thread-7 :1296302 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/files/output.log 2022-04-05 07:30:05,329 WARNING MainThread:1296302 [internal.py:wandb_internal():155] Internal process interrupt: 1 2022-04-05 07:30:05,340 DEBUG HandlerThread:1296302 [handler.py:handle_request():141] handle_request: partial_history 2022-04-05 07:30:05,340 DEBUG SenderThread:1296302 [sender.py:send():235] send: telemetry 2022-04-05 07:30:05,530 INFO Thread-7 :1296302 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/files/output.log 2022-04-05 07:30:05,579 WARNING MainThread:1296302 [internal.py:wandb_internal():155] Internal process interrupt: 2 2022-04-05 07:30:05,579 ERROR MainThread:1296302 [internal.py:wandb_internal():158] Internal process interrupted. 2022-04-05 07:30:06,340 INFO WriterThread:1296302 [datastore.py:close():281] close: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/run-2qz2hoci.wandb 2022-04-05 07:30:06,341 INFO SenderThread:1296302 [sender.py:finish():1078] shutting down sender 2022-04-05 07:30:06,341 INFO SenderThread:1296302 [dir_watcher.py:finish():283] shutting down directory watcher 2022-04-05 07:30:06,341 INFO HandlerThread:1296302 [handler.py:finish():778] shutting down handler 2022-04-05 07:30:06,531 INFO SenderThread:1296302 [dir_watcher.py:finish():313] scan: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/files 2022-04-05 07:30:06,531 INFO SenderThread:1296302 [dir_watcher.py:finish():327] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/files/requirements.txt requirements.txt 2022-04-05 07:30:06,531 INFO SenderThread:1296302 [dir_watcher.py:finish():327] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/files/output.log output.log 2022-04-05 07:30:06,531 INFO SenderThread:1296302 [dir_watcher.py:finish():327] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/files/wandb-metadata.json wandb-metadata.json 2022-04-05 07:30:06,531 INFO SenderThread:1296302 [dir_watcher.py:finish():327] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/files/config.yaml config.yaml 2022-04-05 07:30:06,531 INFO SenderThread:1296302 [dir_watcher.py:finish():327] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/files/wandb-summary.json wandb-summary.json 2022-04-05 07:30:06,532 INFO SenderThread:1296302 [file_pusher.py:finish():145] shutting down file pusher 2022-04-05 07:30:06,532 INFO SenderThread:1296302 [file_pusher.py:join():150] waiting for file pusher 2022-04-05 07:30:06,774 INFO Thread-15 :1296302 [upload_job.py:push():137] Uploaded file /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/files/wandb-summary.json 2022-04-05 07:30:06,776 INFO Thread-14 :1296302 [upload_job.py:push():137] Uploaded file /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/files/config.yaml 2022-04-05 07:30:06,785 INFO Thread-12 :1296302 [upload_job.py:push():137] Uploaded file /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/files/requirements.txt 2022-04-05 07:30:06,811 INFO Thread-13 :1296302 [upload_job.py:push():137] Uploaded file /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220405_072957-2qz2hoci/files/output.log 2022-04-05 07:30:07,641 INFO MainThread:1296302 [internal.py:handle_exit():82] Internal process exited