Hugging Face's logo

sanchit-gandhi
/
flax-wav2vec2-2-bart-large-cnn-gradient-accumulation

Automatic Speech Recognition
Transformers
JAX
TensorBoard
speech-encoder-decoder
Inference Endpoints
Model card Files Metrics Community
flax-wav2vec2-2-bart-large-cnn-gradient-accumulation
File size: 23,597 Bytes 
4f730f1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
 
2022-03-23 17:54:23,640 INFO    MainThread:20766 [internal.py:wandb_internal():92] W&B internal server running at pid: 20766, started at: 2022-03-23 17:54:23.640435
2022-03-23 17:54:23,667 INFO    WriterThread:20766 [datastore.py:open_for_write():77] open: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/run-wdfvd4e9.wandb
2022-03-23 17:54:23,668 DEBUG   SenderThread:20766 [sender.py:send():235] send: header
2022-03-23 17:54:23,668 DEBUG   SenderThread:20766 [sender.py:send():235] send: run
2022-03-23 17:54:23,926 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: check_version
2022-03-23 17:54:23,927 INFO    SenderThread:20766 [dir_watcher.py:__init__():169] watching files in: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files
2022-03-23 17:54:23,927 INFO    SenderThread:20766 [sender.py:_start_run_threads():812] run started: wdfvd4e9 with start time 1648058062
2022-03-23 17:54:23,927 DEBUG   SenderThread:20766 [sender.py:send():235] send: summary
2022-03-23 17:54:23,927 INFO    SenderThread:20766 [sender.py:_save_file():947] saving file wandb-summary.json with policy end
2022-03-23 17:54:23,927 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: check_version
2022-03-23 17:54:23,987 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: run_start
2022-03-23 17:54:25,035 INFO    Thread-7  :20766 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/wandb-summary.json
2022-03-23 17:54:26,260 DEBUG   HandlerThread:20766 [meta.py:__init__():37] meta init
2022-03-23 17:54:26,261 DEBUG   HandlerThread:20766 [meta.py:__init__():51] meta init done
2022-03-23 17:54:26,261 DEBUG   HandlerThread:20766 [meta.py:probe():211] probe
2022-03-23 17:54:26,262 DEBUG   HandlerThread:20766 [meta.py:_setup_git():201] setup git
2022-03-23 17:54:26,294 DEBUG   HandlerThread:20766 [meta.py:_setup_git():208] setup git done
2022-03-23 17:54:26,294 DEBUG   HandlerThread:20766 [meta.py:_save_pip():55] save pip
2022-03-23 17:54:26,295 DEBUG   HandlerThread:20766 [meta.py:_save_pip():69] save pip done
2022-03-23 17:54:26,295 DEBUG   HandlerThread:20766 [meta.py:probe():249] probe done
2022-03-23 17:54:26,298 DEBUG   SenderThread:20766 [sender.py:send():235] send: files
2022-03-23 17:54:26,299 INFO    SenderThread:20766 [sender.py:_save_file():947] saving file wandb-metadata.json with policy now
2022-03-23 17:54:26,306 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: stop_status
2022-03-23 17:54:26,306 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: stop_status
2022-03-23 17:54:26,343 DEBUG   SenderThread:20766 [sender.py:send():235] send: telemetry
2022-03-23 17:54:26,584 INFO    Thread-11 :20766 [upload_job.py:push():137] Uploaded file /tmp/tmpcyy2gbubwandb/29rj97ln-wandb-metadata.json
2022-03-23 17:54:27,037 INFO    Thread-7  :20766 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/requirements.txt
2022-03-23 17:54:27,038 INFO    Thread-7  :20766 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/wandb-metadata.json
2022-03-23 17:54:27,038 INFO    Thread-7  :20766 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/output.log
2022-03-23 17:54:29,038 INFO    Thread-7  :20766 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/output.log
2022-03-23 17:54:41,345 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: stop_status
2022-03-23 17:54:41,345 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: stop_status
2022-03-23 17:54:45,045 INFO    Thread-7  :20766 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/output.log
2022-03-23 17:54:49,047 INFO    Thread-7  :20766 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/output.log
2022-03-23 17:54:51,048 INFO    Thread-7  :20766 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/output.log
2022-03-23 17:54:54,344 DEBUG   SenderThread:20766 [sender.py:send():235] send: stats
2022-03-23 17:54:55,050 INFO    Thread-7  :20766 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/config.yaml
2022-03-23 17:54:55,051 INFO    Thread-7  :20766 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/output.log
2022-03-23 17:54:56,426 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: stop_status
2022-03-23 17:54:56,426 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: stop_status
2022-03-23 17:54:59,052 INFO    Thread-7  :20766 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/output.log
2022-03-23 17:55:11,535 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: stop_status
2022-03-23 17:55:11,536 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: stop_status
2022-03-23 17:55:24,419 DEBUG   SenderThread:20766 [sender.py:send():235] send: stats
2022-03-23 17:55:26,708 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: stop_status
2022-03-23 17:55:26,709 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: stop_status
2022-03-23 17:55:41,811 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: stop_status
2022-03-23 17:55:41,812 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: stop_status
2022-03-23 17:55:54,500 DEBUG   SenderThread:20766 [sender.py:send():235] send: stats
2022-03-23 17:55:56,865 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: stop_status
2022-03-23 17:55:56,865 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: stop_status
2022-03-23 17:56:12,102 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: stop_status
2022-03-23 17:56:12,102 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: stop_status
2022-03-23 17:56:24,576 DEBUG   SenderThread:20766 [sender.py:send():235] send: stats
2022-03-23 17:56:27,141 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: stop_status
2022-03-23 17:56:27,141 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: stop_status
2022-03-23 17:56:42,178 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: stop_status
2022-03-23 17:56:42,179 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: stop_status
2022-03-23 17:56:54,654 DEBUG   SenderThread:20766 [sender.py:send():235] send: stats
2022-03-23 17:56:57,223 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: stop_status
2022-03-23 17:56:57,223 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: stop_status
2022-03-23 17:57:12,272 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: stop_status
2022-03-23 17:57:12,272 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: stop_status
2022-03-23 17:57:24,732 DEBUG   SenderThread:20766 [sender.py:send():235] send: stats
2022-03-23 17:57:27,312 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: stop_status
2022-03-23 17:57:27,312 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: stop_status
2022-03-23 17:57:42,355 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: stop_status
2022-03-23 17:57:42,356 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: stop_status
2022-03-23 17:57:54,809 DEBUG   SenderThread:20766 [sender.py:send():235] send: stats
2022-03-23 17:57:57,398 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: stop_status
2022-03-23 17:57:57,399 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: stop_status
2022-03-23 17:58:12,440 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: stop_status
2022-03-23 17:58:12,440 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: stop_status
2022-03-23 17:58:24,882 DEBUG   SenderThread:20766 [sender.py:send():235] send: stats
2022-03-23 17:58:27,758 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: stop_status
2022-03-23 17:58:27,759 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: stop_status
2022-03-23 17:58:34,718 DEBUG   SenderThread:20766 [sender.py:send():235] send: telemetry
2022-03-23 17:58:34,718 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: partial_history
2022-03-23 17:58:36,146 INFO    Thread-7  :20766 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/output.log
2022-03-23 17:58:37,009 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: poll_exit
2022-03-23 17:58:37,009 DEBUG   SenderThread:20766 [sender.py:send():235] send: exit
2022-03-23 17:58:37,010 INFO    SenderThread:20766 [sender.py:send_exit():371] handling exit code: 1
2022-03-23 17:58:37,010 INFO    SenderThread:20766 [sender.py:send_exit():373] handling runtime: 253
2022-03-23 17:58:37,010 INFO    SenderThread:20766 [sender.py:_save_file():947] saving file wandb-summary.json with policy end
2022-03-23 17:58:37,011 INFO    SenderThread:20766 [sender.py:send_exit():379] send defer
2022-03-23 17:58:37,011 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: poll_exit
2022-03-23 17:58:37,012 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: defer
2022-03-23 17:58:37,012 INFO    HandlerThread:20766 [handler.py:handle_request_defer():164] handle defer: 0
2022-03-23 17:58:37,012 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: defer
2022-03-23 17:58:37,012 INFO    SenderThread:20766 [sender.py:send_request_defer():388] handle sender defer: 0
2022-03-23 17:58:37,012 INFO    SenderThread:20766 [sender.py:transition_state():392] send defer: 1
2022-03-23 17:58:37,012 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: defer
2022-03-23 17:58:37,012 INFO    HandlerThread:20766 [handler.py:handle_request_defer():164] handle defer: 1
2022-03-23 17:58:37,112 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: defer
2022-03-23 17:58:37,112 INFO    SenderThread:20766 [sender.py:send_request_defer():388] handle sender defer: 1
2022-03-23 17:58:37,112 INFO    SenderThread:20766 [sender.py:transition_state():392] send defer: 2
2022-03-23 17:58:37,113 DEBUG   SenderThread:20766 [sender.py:send():235] send: stats
2022-03-23 17:58:37,113 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: defer
2022-03-23 17:58:37,113 INFO    HandlerThread:20766 [handler.py:handle_request_defer():164] handle defer: 2
2022-03-23 17:58:37,113 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: poll_exit
2022-03-23 17:58:37,113 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: defer
2022-03-23 17:58:37,114 INFO    SenderThread:20766 [sender.py:send_request_defer():388] handle sender defer: 2
2022-03-23 17:58:37,114 INFO    SenderThread:20766 [sender.py:transition_state():392] send defer: 3
2022-03-23 17:58:37,114 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: poll_exit
2022-03-23 17:58:37,114 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: defer
2022-03-23 17:58:37,114 INFO    HandlerThread:20766 [handler.py:handle_request_defer():164] handle defer: 3
2022-03-23 17:58:37,114 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: defer
2022-03-23 17:58:37,114 INFO    SenderThread:20766 [sender.py:send_request_defer():388] handle sender defer: 3
2022-03-23 17:58:37,114 INFO    SenderThread:20766 [sender.py:transition_state():392] send defer: 4
2022-03-23 17:58:37,115 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: defer
2022-03-23 17:58:37,115 INFO    HandlerThread:20766 [handler.py:handle_request_defer():164] handle defer: 4
2022-03-23 17:58:37,115 DEBUG   SenderThread:20766 [sender.py:send():235] send: summary
2022-03-23 17:58:37,115 INFO    SenderThread:20766 [sender.py:_save_file():947] saving file wandb-summary.json with policy end
2022-03-23 17:58:37,115 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: defer
2022-03-23 17:58:37,115 INFO    SenderThread:20766 [sender.py:send_request_defer():388] handle sender defer: 4
2022-03-23 17:58:37,115 INFO    SenderThread:20766 [sender.py:transition_state():392] send defer: 5
2022-03-23 17:58:37,116 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: defer
2022-03-23 17:58:37,116 INFO    HandlerThread:20766 [handler.py:handle_request_defer():164] handle defer: 5
2022-03-23 17:58:37,116 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: defer
2022-03-23 17:58:37,116 INFO    SenderThread:20766 [sender.py:send_request_defer():388] handle sender defer: 5
2022-03-23 17:58:37,146 INFO    Thread-7  :20766 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/wandb-summary.json
2022-03-23 17:58:37,146 INFO    Thread-7  :20766 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/output.log
2022-03-23 17:58:37,166 INFO    SenderThread:20766 [sender.py:transition_state():392] send defer: 6
2022-03-23 17:58:37,167 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: defer
2022-03-23 17:58:37,167 INFO    HandlerThread:20766 [handler.py:handle_request_defer():164] handle defer: 6
2022-03-23 17:58:37,167 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: defer
2022-03-23 17:58:37,167 INFO    SenderThread:20766 [sender.py:send_request_defer():388] handle sender defer: 6
2022-03-23 17:58:37,167 INFO    SenderThread:20766 [dir_watcher.py:finish():283] shutting down directory watcher
2022-03-23 17:58:37,215 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: poll_exit
2022-03-23 17:58:38,147 INFO    Thread-7  :20766 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/config.yaml
2022-03-23 17:58:38,147 INFO    SenderThread:20766 [dir_watcher.py:finish():313] scan: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files
2022-03-23 17:58:38,148 INFO    SenderThread:20766 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/requirements.txt requirements.txt
2022-03-23 17:58:38,148 INFO    SenderThread:20766 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/output.log output.log
2022-03-23 17:58:38,148 INFO    SenderThread:20766 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/wandb-metadata.json wandb-metadata.json
2022-03-23 17:58:38,148 INFO    SenderThread:20766 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/config.yaml config.yaml
2022-03-23 17:58:38,148 INFO    SenderThread:20766 [dir_watcher.py:finish():327] scan save: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/wandb-summary.json wandb-summary.json
2022-03-23 17:58:38,148 INFO    SenderThread:20766 [sender.py:transition_state():392] send defer: 7
2022-03-23 17:58:38,148 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: poll_exit
2022-03-23 17:58:38,149 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: defer
2022-03-23 17:58:38,149 INFO    HandlerThread:20766 [handler.py:handle_request_defer():164] handle defer: 7
2022-03-23 17:58:38,155 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: defer
2022-03-23 17:58:38,155 INFO    SenderThread:20766 [sender.py:send_request_defer():388] handle sender defer: 7
2022-03-23 17:58:38,155 INFO    SenderThread:20766 [file_pusher.py:finish():145] shutting down file pusher
2022-03-23 17:58:38,250 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: poll_exit
2022-03-23 17:58:38,250 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: poll_exit
2022-03-23 17:58:38,352 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: poll_exit
2022-03-23 17:58:38,352 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: poll_exit
2022-03-23 17:58:38,426 INFO    Thread-12 :20766 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/requirements.txt
2022-03-23 17:58:38,453 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: poll_exit
2022-03-23 17:58:38,454 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: poll_exit
2022-03-23 17:58:38,459 INFO    Thread-15 :20766 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/wandb-summary.json
2022-03-23 17:58:38,486 INFO    Thread-14 :20766 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/config.yaml
2022-03-23 17:58:38,549 INFO    Thread-13 :20766 [upload_job.py:push():137] Uploaded file /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/files/output.log
2022-03-23 17:58:38,556 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: poll_exit
2022-03-23 17:58:38,556 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: poll_exit
2022-03-23 17:58:38,657 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: poll_exit
2022-03-23 17:58:38,658 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: poll_exit
2022-03-23 17:58:38,750 INFO    Thread-6  :20766 [sender.py:transition_state():392] send defer: 8
2022-03-23 17:58:38,750 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: defer
2022-03-23 17:58:38,750 INFO    HandlerThread:20766 [handler.py:handle_request_defer():164] handle defer: 8
2022-03-23 17:58:38,751 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: defer
2022-03-23 17:58:38,751 INFO    SenderThread:20766 [sender.py:send_request_defer():388] handle sender defer: 8
2022-03-23 17:58:38,759 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: poll_exit
2022-03-23 17:58:38,900 INFO    SenderThread:20766 [sender.py:transition_state():392] send defer: 9
2022-03-23 17:58:38,900 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: poll_exit
2022-03-23 17:58:38,901 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: defer
2022-03-23 17:58:38,901 INFO    HandlerThread:20766 [handler.py:handle_request_defer():164] handle defer: 9
2022-03-23 17:58:38,901 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: defer
2022-03-23 17:58:38,901 INFO    SenderThread:20766 [sender.py:send_request_defer():388] handle sender defer: 9
2022-03-23 17:58:38,901 INFO    SenderThread:20766 [sender.py:transition_state():392] send defer: 10
2022-03-23 17:58:38,902 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: defer
2022-03-23 17:58:38,902 INFO    HandlerThread:20766 [handler.py:handle_request_defer():164] handle defer: 10
2022-03-23 17:58:38,902 DEBUG   SenderThread:20766 [sender.py:send():235] send: final
2022-03-23 17:58:38,902 DEBUG   SenderThread:20766 [sender.py:send():235] send: footer
2022-03-23 17:58:38,902 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: defer
2022-03-23 17:58:38,902 INFO    SenderThread:20766 [sender.py:send_request_defer():388] handle sender defer: 10
2022-03-23 17:58:39,002 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: poll_exit
2022-03-23 17:58:39,002 DEBUG   SenderThread:20766 [sender.py:send_request():249] send_request: poll_exit
2022-03-23 17:58:39,002 INFO    SenderThread:20766 [file_pusher.py:join():150] waiting for file pusher
2022-03-23 17:58:39,161 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: sampled_history
2022-03-23 17:58:39,162 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: get_summary
2022-03-23 17:58:39,163 DEBUG   HandlerThread:20766 [handler.py:handle_request():141] handle_request: shutdown
2022-03-23 17:58:39,163 INFO    HandlerThread:20766 [handler.py:finish():778] shutting down handler
2022-03-23 17:58:39,902 INFO    WriterThread:20766 [datastore.py:close():281] close: /home/sanchit_huggingface_co/flax-wav2vec2-2-bart-large-cnn-gradient-accumulation/wandb/run-20220323_175422-wdfvd4e9/run-wdfvd4e9.wandb
2022-03-23 17:58:40,060 INFO    SenderThread:20766 [sender.py:finish():1078] shutting down sender
2022-03-23 17:58:40,060 INFO    SenderThread:20766 [file_pusher.py:finish():145] shutting down file pusher
2022-03-23 17:58:40,060 INFO    SenderThread:20766 [file_pusher.py:join():150] waiting for file pusher
2022-03-23 17:58:40,063 INFO    MainThread:20766 [internal.py:handle_exit():82] Internal process exited