File size: 80,799 Bytes
a58bc5e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
2024-06-05 03:05:23.315324: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:9261] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2024-06-05 03:05:23.315399: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:607] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2024-06-05 03:05:23.317038: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1515] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2024-06-05 03:05:23.326431: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2024-06-05 03:05:26.483871: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
06/05/2024 03:05:35 - WARNING - __main__ - Process rank: 0, device: cuda:0, n_gpu: 6, distributed training: False, 16-bits training: False
06/05/2024 03:05:35 - INFO - __main__ - Training/evaluation parameters TrainingArguments(
_n_gpu=6,
accelerator_config={'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None},
adafactor=False,
adam_beta1=0.9,
adam_beta2=0.999,
adam_epsilon=1e-08,
auto_find_batch_size=False,
bf16=False,
bf16_full_eval=False,
data_seed=None,
dataloader_drop_last=False,
dataloader_num_workers=0,
dataloader_persistent_workers=False,
dataloader_pin_memory=True,
dataloader_prefetch_factor=None,
ddp_backend=None,
ddp_broadcast_buffers=None,
ddp_bucket_cap_mb=None,
ddp_find_unused_parameters=None,
ddp_timeout=1800,
debug=[],
deepspeed=None,
disable_tqdm=False,
dispatch_batches=None,
do_eval=True,
do_predict=False,
do_train=True,
eval_accumulation_steps=None,
eval_delay=0,
eval_do_concat_batches=True,
eval_steps=1000,
eval_strategy=steps,
evaluation_strategy=None,
fp16=False,
fp16_backend=auto,
fp16_full_eval=False,
fp16_opt_level=O1,
fsdp=[],
fsdp_config={'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False},
fsdp_min_num_params=0,
fsdp_transformer_layer_cls_to_wrap=None,
full_determinism=False,
gradient_accumulation_steps=1,
gradient_checkpointing=False,
gradient_checkpointing_kwargs=None,
greater_is_better=None,
group_by_length=False,
half_precision_backend=auto,
hub_always_push=False,
hub_model_id=DorinSht/ShareGPT_llama2_68M,
hub_private_repo=False,
hub_strategy=all_checkpoints,
hub_token=<HUB_TOKEN>,
ignore_data_skip=False,
include_inputs_for_metrics=False,
include_num_input_tokens_seen=False,
include_tokens_per_second=False,
jit_mode_eval=False,
label_names=None,
label_smoothing_factor=0.0,
learning_rate=0.0001,
length_column_name=length,
load_best_model_at_end=False,
local_rank=0,
log_level=passive,
log_level_replica=warning,
log_on_each_node=True,
logging_dir=./training_outputs_job_117568_1_05-06_03-05,
logging_first_step=False,
logging_nan_inf_filter=True,
logging_steps=500,
logging_strategy=steps,
lr_scheduler_kwargs={},
lr_scheduler_type=linear,
max_grad_norm=1.0,
max_steps=-1,
metric_for_best_model=None,
mp_parameters=,
neftune_noise_alpha=None,
no_cuda=False,
num_train_epochs=3.0,
optim=adamw_torch,
optim_args=None,
optim_target_modules=None,
output_dir=./training_outputs_job_117568_1_05-06_03-05,
overwrite_output_dir=True,
past_index=-1,
per_device_eval_batch_size=8,
per_device_train_batch_size=4,
prediction_loss_only=False,
push_to_hub=True,
push_to_hub_model_id=None,
push_to_hub_organization=None,
push_to_hub_token=<PUSH_TO_HUB_TOKEN>,
ray_scope=last,
remove_unused_columns=True,
report_to=['tensorboard'],
restore_callback_states_from_checkpoint=False,
resume_from_checkpoint=None,
run_name=/home/dshteyma/target_draft_coupling_code/target_draft_training/training_outputs,
save_on_each_node=False,
save_only_model=False,
save_safetensors=True,
save_steps=1000,
save_strategy=steps,
save_total_limit=None,
seed=42,
skip_memory_metrics=True,
split_batches=None,
tf32=None,
torch_compile=False,
torch_compile_backend=None,
torch_compile_mode=None,
torchdynamo=None,
tpu_metrics_debug=False,
tpu_num_cores=None,
use_cpu=False,
use_ipex=False,
use_legacy_prediction_loop=False,
use_mps_device=False,
warmup_ratio=0.05,
warmup_steps=0,
weight_decay=0.01,
)
Using custom data configuration default-afe4b27d28cbdcb1
06/05/2024 03:05:35 - INFO - datasets.builder - Using custom data configuration default-afe4b27d28cbdcb1
Loading Dataset Infos from /home/dshteyma/miniconda3/lib/python3.9/site-packages/datasets/packaged_modules/json
06/05/2024 03:05:35 - INFO - datasets.info - Loading Dataset Infos from /home/dshteyma/miniconda3/lib/python3.9/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
06/05/2024 03:05:36 - INFO - datasets.builder - Overwrite dataset info from restored data version if exists.
Loading Dataset info from /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7
06/05/2024 03:05:36 - INFO - datasets.info - Loading Dataset info from /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7
06/05/2024 03:05:36 - INFO - datasets.builder - Found cached dataset json (/home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7)
Found cached dataset json (/home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7)
Loading Dataset info from /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7
06/05/2024 03:05:36 - INFO - datasets.info - Loading Dataset info from /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7
Using custom data configuration default-afe4b27d28cbdcb1
06/05/2024 03:05:36 - INFO - datasets.builder - Using custom data configuration default-afe4b27d28cbdcb1
Loading Dataset Infos from /home/dshteyma/miniconda3/lib/python3.9/site-packages/datasets/packaged_modules/json
06/05/2024 03:05:36 - INFO - datasets.info - Loading Dataset Infos from /home/dshteyma/miniconda3/lib/python3.9/site-packages/datasets/packaged_modules/json
06/05/2024 03:05:36 - INFO - datasets.builder - Overwrite dataset info from restored data version if exists.
Overwrite dataset info from restored data version if exists.
Loading Dataset info from /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7
06/05/2024 03:05:36 - INFO - datasets.info - Loading Dataset info from /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7
Found cached dataset json (/home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7)
06/05/2024 03:05:36 - INFO - datasets.builder - Found cached dataset json (/home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7)
Loading Dataset info from /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7
06/05/2024 03:05:36 - INFO - datasets.info - Loading Dataset info from /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7
Using custom data configuration default-afe4b27d28cbdcb1
06/05/2024 03:05:37 - INFO - datasets.builder - Using custom data configuration default-afe4b27d28cbdcb1
Loading Dataset Infos from /home/dshteyma/miniconda3/lib/python3.9/site-packages/datasets/packaged_modules/json
06/05/2024 03:05:37 - INFO - datasets.info - Loading Dataset Infos from /home/dshteyma/miniconda3/lib/python3.9/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
06/05/2024 03:05:37 - INFO - datasets.builder - Overwrite dataset info from restored data version if exists.
Loading Dataset info from /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7
06/05/2024 03:05:37 - INFO - datasets.info - Loading Dataset info from /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7
06/05/2024 03:05:37 - INFO - datasets.builder - Found cached dataset json (/home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7)
Found cached dataset json (/home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7)
Loading Dataset info from /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7
06/05/2024 03:05:37 - INFO - datasets.info - Loading Dataset info from /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7
[INFO|configuration_utils.py:726] 2024-06-05 03:05:37,626 >> loading configuration file config.json from cache at /home/dshteyma/.cache/huggingface/hub/models--JackFram--llama-68m/snapshots/964a5d77df908b69f8d6476fb70e940425b04cb5/config.json
[INFO|configuration_utils.py:789] 2024-06-05 03:05:37,628 >> Model config LlamaConfig {
  "_name_or_path": "JackFram/llama-68m",
  "architectures": [
    "LlamaForCausalLM"
  ],
  "attention_bias": false,
  "attention_dropout": 0.0,
  "bos_token_id": 0,
  "eos_token_id": 2,
  "hidden_act": "silu",
  "hidden_size": 768,
  "initializer_range": 0.02,
  "intermediate_size": 3072,
  "max_position_embeddings": 2048,
  "model_type": "llama",
  "num_attention_heads": 12,
  "num_hidden_layers": 2,
  "num_key_value_heads": 12,
  "pad_token_id": 1,
  "pretraining_tp": 1,
  "rms_norm_eps": 1e-06,
  "rope_scaling": null,
  "rope_theta": 10000.0,
  "tie_word_embeddings": false,
  "torch_dtype": "float32",
  "transformers_version": "4.41.0.dev0",
  "use_cache": true,
  "vocab_size": 32000
}

[INFO|tokenization_utils_base.py:2102] 2024-06-05 03:05:37,771 >> loading file tokenizer.model from cache at /home/dshteyma/.cache/huggingface/hub/models--JackFram--llama-68m/snapshots/964a5d77df908b69f8d6476fb70e940425b04cb5/tokenizer.model
[INFO|tokenization_utils_base.py:2102] 2024-06-05 03:05:37,771 >> loading file tokenizer.json from cache at None
[INFO|tokenization_utils_base.py:2102] 2024-06-05 03:05:37,771 >> loading file added_tokens.json from cache at None
[INFO|tokenization_utils_base.py:2102] 2024-06-05 03:05:37,771 >> loading file special_tokens_map.json from cache at /home/dshteyma/.cache/huggingface/hub/models--JackFram--llama-68m/snapshots/964a5d77df908b69f8d6476fb70e940425b04cb5/special_tokens_map.json
[INFO|tokenization_utils_base.py:2102] 2024-06-05 03:05:37,771 >> loading file tokenizer_config.json from cache at /home/dshteyma/.cache/huggingface/hub/models--JackFram--llama-68m/snapshots/964a5d77df908b69f8d6476fb70e940425b04cb5/tokenizer_config.json
[WARNING|logging.py:329] 2024-06-05 03:05:37,772 >> You are using the default legacy behaviour of the <class 'transformers.models.llama.tokenization_llama.LlamaTokenizer'>. This is expected, and simply means that the `legacy` (previous) behavior will be used so nothing changes for you. If you want to use the new behaviour, set `legacy=False`. This should only be set if you understand what it means, and thoroughly read the reason why this was added as explained in https://github.com/huggingface/transformers/pull/24565
[WARNING|logging.py:329] 2024-06-05 03:05:37,868 >> You are using the default legacy behaviour of the <class 'transformers.models.llama.tokenization_llama_fast.LlamaTokenizerFast'>. This is expected, and simply means that the `legacy` (previous) behavior will be used so nothing changes for you. If you want to use the new behaviour, set `legacy=False`. This should only be set if you understand what it means, and thoroughly read the reason why this was added as explained in https://github.com/huggingface/transformers/pull/24565
[INFO|configuration_utils.py:936] 2024-06-05 03:05:38,449 >> Generate config GenerationConfig {
  "bos_token_id": 0,
  "eos_token_id": 2,
  "pad_token_id": 1
}

06/05/2024 03:05:39 - INFO - __main__ - Training new model from scratch - Total size=64.88M params
06/05/2024 03:05:39 - INFO - datasets.arrow_dataset - Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-988d048fea8d2473.arrow
Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-988d048fea8d2473.arrow
06/05/2024 03:05:39 - INFO - datasets.arrow_dataset - Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-4e281c930893bca9.arrow
Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-4e281c930893bca9.arrow
06/05/2024 03:05:39 - INFO - datasets.arrow_dataset - Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-3fe350bccdda6078.arrow
Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-3fe350bccdda6078.arrow
06/05/2024 03:05:39 - INFO - datasets.arrow_dataset - Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-35d09b588a0c62b9.arrow
Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-35d09b588a0c62b9.arrow
06/05/2024 03:05:39 - INFO - datasets.arrow_dataset - Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-4e5279ee31a5d8d3.arrow
Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-4e5279ee31a5d8d3.arrow
06/05/2024 03:05:39 - INFO - datasets.arrow_dataset - Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-63d56456928edd43.arrow
Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-63d56456928edd43.arrow
06/05/2024 03:05:39 - INFO - datasets.arrow_dataset - Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-6a784a78d9818240.arrow
Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-6a784a78d9818240.arrow
06/05/2024 03:05:39 - INFO - datasets.arrow_dataset - Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-46540f58a00a92bf.arrow
Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-46540f58a00a92bf.arrow
06/05/2024 03:05:39 - INFO - datasets.arrow_dataset - Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-73605724efaea9d2.arrow
Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-73605724efaea9d2.arrow
06/05/2024 03:05:39 - INFO - datasets.arrow_dataset - Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-83d3df87e1b82021.arrow
Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-83d3df87e1b82021.arrow
06/05/2024 03:05:39 - INFO - datasets.arrow_dataset - Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-efdbb02491aa6344.arrow
Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-efdbb02491aa6344.arrow
06/05/2024 03:05:39 - INFO - datasets.arrow_dataset - Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-0cf2ae38fef927f3.arrow
Loading cached processed dataset at /home/dshteyma/.cache/huggingface/datasets/json/default-afe4b27d28cbdcb1/0.0.0/c8d2d9508a2a2067ab02cd118834ecef34c3700d143b31835ec4235bf10109f7/cache-0cf2ae38fef927f3.arrow
06/05/2024 03:05:39 - WARNING - accelerate.utils.other - Detected kernel version 5.4.0, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
[INFO|trainer.py:2068] 2024-06-05 03:05:40,316 >> ***** Running training *****
[INFO|trainer.py:2069] 2024-06-05 03:05:40,316 >>   Num examples = 90,745
[INFO|trainer.py:2070] 2024-06-05 03:05:40,316 >>   Num Epochs = 3
[INFO|trainer.py:2071] 2024-06-05 03:05:40,316 >>   Instantaneous batch size per device = 4
[INFO|trainer.py:2073] 2024-06-05 03:05:40,316 >>   Training with DataParallel so batch size has been adjusted to: 24
[INFO|trainer.py:2074] 2024-06-05 03:05:40,316 >>   Total train batch size (w. parallel, distributed & accumulation) = 24
[INFO|trainer.py:2075] 2024-06-05 03:05:40,316 >>   Gradient Accumulation steps = 1
[INFO|trainer.py:2076] 2024-06-05 03:05:40,316 >>   Total optimization steps = 11,346
[INFO|trainer.py:2077] 2024-06-05 03:05:40,317 >>   Number of trainable parameters = 68,030,208

  0%|          | 0/11346 [00:00<?, ?it/s]/home/dshteyma/miniconda3/lib/python3.9/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
  warnings.warn('Was asked to gather along dimension 0, but all '

  0%|          | 1/11346 [00:04<15:15:06,  4.84s/it]
  0%|          | 2/11346 [00:05<8:04:02,  2.56s/it] 
  0%|          | 3/11346 [00:06<5:46:22,  1.83s/it]
  0%|          | 4/11346 [00:07<4:41:45,  1.49s/it]
  0%|          | 5/11346 [00:08<4:06:03,  1.30s/it]
  0%|          | 6/11346 [00:09<3:44:22,  1.19s/it]
  0%|          | 7/11346 [00:10<3:30:41,  1.11s/it]
  0%|          | 8/11346 [00:11<3:21:54,  1.07s/it]
  0%|          | 9/11346 [00:12<3:15:57,  1.04s/it]
  0%|          | 10/11346 [00:13<3:11:49,  1.02s/it]
  0%|          | 11/11346 [00:14<3:09:05,  1.00s/it]
  0%|          | 12/11346 [00:15<3:07:02,  1.01it/s]
  0%|          | 13/11346 [00:16<3:05:37,  1.02it/s]
  0%|          | 14/11346 [00:17<3:04:44,  1.02it/s]
  0%|          | 15/11346 [00:18<3:04:01,  1.03it/s]
  0%|          | 16/11346 [00:19<3:03:31,  1.03it/s]
  0%|          | 17/11346 [00:20<3:04:21,  1.02it/s]
  0%|          | 18/11346 [00:21<3:06:59,  1.01it/s]
  0%|          | 19/11346 [00:22<3:05:57,  1.02it/s]
  0%|          | 20/11346 [00:23<3:05:22,  1.02it/s]
  0%|          | 21/11346 [00:24<3:04:28,  1.02it/s]
  0%|          | 22/11346 [00:25<3:03:54,  1.03it/s]
  0%|          | 23/11346 [00:26<3:03:38,  1.03it/s]
  0%|          | 24/11346 [00:27<3:03:17,  1.03it/s]
  0%|          | 25/11346 [00:28<3:03:02,  1.03it/s]
  0%|          | 26/11346 [00:29<3:02:51,  1.03it/s]
  0%|          | 27/11346 [00:30<3:02:38,  1.03it/s]
  0%|          | 28/11346 [00:31<3:02:32,  1.03it/s]
  0%|          | 29/11346 [00:32<3:02:30,  1.03it/s]
  0%|          | 30/11346 [00:32<3:02:27,  1.03it/s]
  0%|          | 31/11346 [00:33<3:02:27,  1.03it/s]
  0%|          | 32/11346 [00:34<3:02:28,  1.03it/s]
  0%|          | 33/11346 [00:35<3:02:33,  1.03it/s]
  0%|          | 34/11346 [00:36<3:02:39,  1.03it/s]
  0%|          | 35/11346 [00:37<3:02:48,  1.03it/s]
  0%|          | 36/11346 [00:38<3:02:46,  1.03it/s]
  0%|          | 37/11346 [00:39<3:02:52,  1.03it/s]
  0%|          | 38/11346 [00:40<3:02:45,  1.03it/s]
  0%|          | 39/11346 [00:41<3:02:40,  1.03it/s]
  0%|          | 40/11346 [00:42<3:02:37,  1.03it/s]
  0%|          | 41/11346 [00:43<3:02:27,  1.03it/s]
  0%|          | 42/11346 [00:44<3:02:25,  1.03it/s]
  0%|          | 43/11346 [00:45<3:02:24,  1.03it/s]
  0%|          | 44/11346 [00:46<3:02:22,  1.03it/s]
  0%|          | 45/11346 [00:47<3:02:21,  1.03it/s]
  0%|          | 46/11346 [00:48<3:02:27,  1.03it/s]
  0%|          | 47/11346 [00:49<3:02:26,  1.03it/s]
  0%|          | 48/11346 [00:50<3:02:23,  1.03it/s]
  0%|          | 49/11346 [00:51<3:02:30,  1.03it/s]
  0%|          | 50/11346 [00:52<3:02:36,  1.03it/s]
  0%|          | 51/11346 [00:53<3:02:38,  1.03it/s]
  0%|          | 52/11346 [00:54<3:02:47,  1.03it/s]
  0%|          | 53/11346 [00:55<3:02:52,  1.03it/s]
  0%|          | 54/11346 [00:56<3:02:47,  1.03it/s]
  0%|          | 55/11346 [00:57<3:02:48,  1.03it/s]
  0%|          | 56/11346 [00:58<3:02:50,  1.03it/s]
  1%|          | 57/11346 [00:59<3:02:51,  1.03it/s]
  1%|          | 58/11346 [01:00<3:02:49,  1.03it/s]
  1%|          | 59/11346 [01:01<3:02:35,  1.03it/s]
  1%|          | 60/11346 [01:02<3:02:36,  1.03it/s]
  1%|          | 61/11346 [01:03<3:02:29,  1.03it/s]
  1%|          | 62/11346 [01:04<3:02:34,  1.03it/s]
  1%|          | 63/11346 [01:04<3:02:34,  1.03it/s]
  1%|          | 64/11346 [01:05<3:02:36,  1.03it/s]
  1%|          | 65/11346 [01:06<3:02:35,  1.03it/s]
  1%|          | 66/11346 [01:07<3:02:31,  1.03it/s]
  1%|          | 67/11346 [01:08<3:02:33,  1.03it/s]
  1%|          | 68/11346 [01:09<3:02:32,  1.03it/s]
  1%|          | 69/11346 [01:10<3:02:34,  1.03it/s]
  1%|          | 70/11346 [01:11<3:02:37,  1.03it/s]
  1%|          | 71/11346 [01:12<3:02:31,  1.03it/s]
  1%|          | 72/11346 [01:13<3:02:35,  1.03it/s]
  1%|          | 73/11346 [01:14<3:02:39,  1.03it/s]
  1%|          | 74/11346 [01:15<3:02:39,  1.03it/s]
  1%|          | 75/11346 [01:16<3:02:28,  1.03it/s]
  1%|          | 76/11346 [01:17<3:02:26,  1.03it/s]
  1%|          | 77/11346 [01:18<3:02:26,  1.03it/s]
  1%|          | 78/11346 [01:19<3:02:28,  1.03it/s]
  1%|          | 79/11346 [01:20<3:02:26,  1.03it/s]
  1%|          | 80/11346 [01:21<3:02:30,  1.03it/s]
  1%|          | 81/11346 [01:22<3:02:28,  1.03it/s]
  1%|          | 82/11346 [01:23<3:02:30,  1.03it/s]
  1%|          | 83/11346 [01:24<3:02:24,  1.03it/s]
  1%|          | 84/11346 [01:25<3:02:28,  1.03it/s]
  1%|          | 85/11346 [01:26<3:02:25,  1.03it/s]
  1%|          | 86/11346 [01:27<3:02:27,  1.03it/s]
  1%|          | 87/11346 [01:28<3:02:31,  1.03it/s]
  1%|          | 88/11346 [01:29<3:02:34,  1.03it/s]
  1%|          | 89/11346 [01:30<3:02:35,  1.03it/s]
  1%|          | 90/11346 [01:31<3:02:33,  1.03it/s]
  1%|          | 91/11346 [01:32<3:02:30,  1.03it/s]
  1%|          | 92/11346 [01:33<3:02:28,  1.03it/s]
  1%|          | 93/11346 [01:34<3:02:18,  1.03it/s]
  1%|          | 94/11346 [01:35<3:02:18,  1.03it/s]
  1%|          | 95/11346 [01:36<3:02:19,  1.03it/s]
  1%|          | 96/11346 [01:37<3:02:13,  1.03it/s]
  1%|          | 97/11346 [01:38<3:02:16,  1.03it/s]
  1%|          | 98/11346 [01:38<3:02:10,  1.03it/s]
  1%|          | 99/11346 [01:39<3:02:15,  1.03it/s]
  1%|          | 100/11346 [01:40<3:02:17,  1.03it/s]
  1%|          | 101/11346 [01:41<3:02:09,  1.03it/s]
  1%|          | 102/11346 [01:42<3:02:11,  1.03it/s]
  1%|          | 103/11346 [01:43<3:02:13,  1.03it/s]
  1%|          | 104/11346 [01:44<3:02:14,  1.03it/s]
  1%|          | 105/11346 [01:45<3:02:17,  1.03it/s]
  1%|          | 106/11346 [01:46<3:02:24,  1.03it/s]
  1%|          | 107/11346 [01:47<3:02:23,  1.03it/s]
  1%|          | 108/11346 [01:48<3:02:19,  1.03it/s]
  1%|          | 109/11346 [01:49<3:02:12,  1.03it/s]
  1%|          | 110/11346 [01:50<3:02:17,  1.03it/s]
  1%|          | 111/11346 [01:51<3:02:21,  1.03it/s]
  1%|          | 112/11346 [01:52<3:02:20,  1.03it/s]
  1%|          | 113/11346 [01:53<3:02:08,  1.03it/s]
  1%|          | 114/11346 [01:54<3:02:11,  1.03it/s]
  1%|          | 115/11346 [01:55<3:02:06,  1.03it/s]
  1%|          | 116/11346 [01:56<3:02:02,  1.03it/s]
  1%|          | 117/11346 [01:57<3:02:01,  1.03it/s]
  1%|          | 118/11346 [01:58<3:02:04,  1.03it/s]
  1%|          | 119/11346 [01:59<3:02:06,  1.03it/s]
  1%|          | 120/11346 [02:00<3:02:03,  1.03it/s]
  1%|          | 121/11346 [02:01<3:02:03,  1.03it/s]
  1%|          | 122/11346 [02:02<3:02:00,  1.03it/s]
  1%|          | 123/11346 [02:03<3:02:07,  1.03it/s]
  1%|          | 124/11346 [02:04<3:02:06,  1.03it/s]
  1%|          | 125/11346 [02:05<3:02:04,  1.03it/s]
  1%|          | 126/11346 [02:06<3:02:01,  1.03it/s]
  1%|          | 127/11346 [02:07<3:02:09,  1.03it/s]
  1%|          | 128/11346 [02:08<3:02:00,  1.03it/s]
  1%|          | 129/11346 [02:09<3:02:01,  1.03it/s]
  1%|          | 130/11346 [02:10<3:02:00,  1.03it/s]
  1%|          | 131/11346 [02:11<3:02:05,  1.03it/s]
  1%|          | 132/11346 [02:12<3:02:04,  1.03it/s]
  1%|          | 133/11346 [02:13<3:01:55,  1.03it/s]
  1%|          | 134/11346 [02:14<3:01:57,  1.03it/s]
  1%|          | 135/11346 [02:15<3:01:53,  1.03it/s]
  1%|          | 136/11346 [02:15<3:01:44,  1.03it/s]
  1%|          | 137/11346 [02:16<3:01:44,  1.03it/s]
  1%|          | 138/11346 [02:17<3:01:41,  1.03it/s]
  1%|          | 139/11346 [02:18<3:01:44,  1.03it/s]
  1%|          | 140/11346 [02:19<3:01:46,  1.03it/s]
  1%|          | 141/11346 [02:20<3:01:46,  1.03it/s]
  1%|▏         | 142/11346 [02:21<3:01:48,  1.03it/s]
  1%|▏         | 143/11346 [02:22<3:01:39,  1.03it/s]
  1%|▏         | 144/11346 [02:23<3:01:43,  1.03it/s]
  1%|▏         | 145/11346 [02:24<3:01:43,  1.03it/s]
  1%|▏         | 146/11346 [02:25<3:01:37,  1.03it/s]
  1%|▏         | 147/11346 [02:26<3:01:42,  1.03it/s]
  1%|▏         | 148/11346 [02:27<3:01:44,  1.03it/s]
  1%|▏         | 149/11346 [02:28<3:01:44,  1.03it/s]
  1%|▏         | 150/11346 [02:29<3:01:47,  1.03it/s]
  1%|▏         | 151/11346 [02:30<3:01:43,  1.03it/s]
  1%|▏         | 152/11346 [02:31<3:01:43,  1.03it/s]
  1%|▏         | 153/11346 [02:32<3:01:37,  1.03it/s]
  1%|▏         | 154/11346 [02:33<3:01:38,  1.03it/s]
  1%|▏         | 155/11346 [02:34<3:01:32,  1.03it/s]
  1%|▏         | 156/11346 [02:35<3:01:33,  1.03it/s]
  1%|▏         | 157/11346 [02:36<3:01:29,  1.03it/s]
  1%|▏         | 158/11346 [02:37<3:01:24,  1.03it/s]
  1%|▏         | 159/11346 [02:38<3:01:23,  1.03it/s]
  1%|▏         | 160/11346 [02:39<3:01:30,  1.03it/s]
  1%|▏         | 161/11346 [02:40<3:01:33,  1.03it/s]
  1%|▏         | 162/11346 [02:41<3:01:28,  1.03it/s]
  1%|▏         | 163/11346 [02:42<3:01:27,  1.03it/s]
  1%|▏         | 164/11346 [02:43<3:01:27,  1.03it/s]
  1%|▏         | 165/11346 [02:44<3:01:27,  1.03it/s]
  1%|▏         | 166/11346 [02:45<3:01:20,  1.03it/s]
  1%|▏         | 167/11346 [02:46<3:01:20,  1.03it/s]
  1%|▏         | 168/11346 [02:47<3:01:15,  1.03it/s]
  1%|▏         | 169/11346 [02:48<3:01:17,  1.03it/s]
  1%|▏         | 170/11346 [02:49<3:01:17,  1.03it/s]
  2%|▏         | 171/11346 [02:50<3:01:21,  1.03it/s]
  2%|▏         | 172/11346 [02:51<3:01:16,  1.03it/s]
  2%|▏         | 173/11346 [02:52<3:01:20,  1.03it/s]
  2%|▏         | 174/11346 [02:52<3:01:22,  1.03it/s]
  2%|▏         | 175/11346 [02:53<3:01:23,  1.03it/s]
  2%|▏         | 176/11346 [02:54<3:01:27,  1.03it/s]
  2%|▏         | 177/11346 [02:55<3:01:28,  1.03it/s]
  2%|▏         | 178/11346 [02:56<3:01:20,  1.03it/s]
  2%|▏         | 179/11346 [02:57<3:01:14,  1.03it/s]
  2%|▏         | 180/11346 [02:58<3:01:12,  1.03it/s]
  2%|▏         | 181/11346 [02:59<3:01:27,  1.03it/s]
  2%|▏         | 182/11346 [03:00<3:01:28,  1.03it/s]
  2%|▏         | 183/11346 [03:01<3:01:20,  1.03it/s]
  2%|▏         | 184/11346 [03:02<3:01:20,  1.03it/s]
  2%|▏         | 185/11346 [03:03<3:01:08,  1.03it/s]
  2%|▏         | 186/11346 [03:04<3:01:13,  1.03it/s]
  2%|▏         | 187/11346 [03:05<3:01:19,  1.03it/s]
  2%|▏         | 188/11346 [03:06<3:01:16,  1.03it/s]
  2%|▏         | 189/11346 [03:07<3:01:13,  1.03it/s]
  2%|▏         | 190/11346 [03:08<3:01:09,  1.03it/s]
  2%|▏         | 191/11346 [03:09<3:01:10,  1.03it/s]
  2%|▏         | 192/11346 [03:10<3:01:10,  1.03it/s]
  2%|▏         | 193/11346 [03:11<3:01:02,  1.03it/s]
  2%|▏         | 194/11346 [03:12<3:01:06,  1.03it/s]
  2%|▏         | 195/11346 [03:13<3:01:03,  1.03it/s]
  2%|▏         | 196/11346 [03:14<3:01:09,  1.03it/s]
  2%|▏         | 197/11346 [03:15<3:01:08,  1.03it/s]
  2%|▏         | 198/11346 [03:16<3:01:05,  1.03it/s]
  2%|▏         | 199/11346 [03:17<3:01:02,  1.03it/s]
  2%|▏         | 200/11346 [03:18<3:00:55,  1.03it/s]
  2%|▏         | 201/11346 [03:19<3:00:59,  1.03it/s]
  2%|▏         | 202/11346 [03:20<3:01:04,  1.03it/s]
  2%|▏         | 203/11346 [03:21<3:01:01,  1.03it/s]
  2%|▏         | 204/11346 [03:22<3:01:02,  1.03it/s]
  2%|▏         | 205/11346 [03:23<3:00:57,  1.03it/s]
  2%|▏         | 206/11346 [03:24<3:00:55,  1.03it/s]
  2%|▏         | 207/11346 [03:25<3:00:55,  1.03it/s]
  2%|▏         | 208/11346 [03:26<3:00:50,  1.03it/s]
  2%|▏         | 209/11346 [03:27<3:00:50,  1.03it/s]
  2%|▏         | 210/11346 [03:28<3:00:49,  1.03it/s]
  2%|▏         | 211/11346 [03:29<3:00:48,  1.03it/s]
  2%|▏         | 212/11346 [03:30<3:00:46,  1.03it/s]
  2%|▏         | 213/11346 [03:30<3:00:49,  1.03it/s]
  2%|▏         | 214/11346 [03:31<3:00:51,  1.03it/s]
  2%|▏         | 215/11346 [03:32<3:00:50,  1.03it/s]
  2%|▏         | 216/11346 [03:33<3:00:49,  1.03it/s]
  2%|▏         | 217/11346 [03:34<3:00:41,  1.03it/s]
  2%|▏         | 218/11346 [03:35<3:00:43,  1.03it/s]
  2%|▏         | 219/11346 [03:36<3:00:43,  1.03it/s]
  2%|▏         | 220/11346 [03:37<3:00:45,  1.03it/s]
  2%|▏         | 221/11346 [03:38<3:00:43,  1.03it/s]
  2%|▏         | 222/11346 [03:39<3:00:34,  1.03it/s]
  2%|▏         | 223/11346 [03:40<3:00:36,  1.03it/s]
  2%|▏         | 224/11346 [03:41<3:00:39,  1.03it/s]
  2%|▏         | 225/11346 [03:42<3:00:41,  1.03it/s]
  2%|▏         | 226/11346 [03:43<3:00:35,  1.03it/s]
  2%|▏         | 227/11346 [03:44<3:00:33,  1.03it/s]
  2%|▏         | 228/11346 [03:45<3:00:32,  1.03it/s]
  2%|▏         | 229/11346 [03:46<3:00:33,  1.03it/s]
  2%|▏         | 230/11346 [03:47<3:00:32,  1.03it/s]
  2%|▏         | 231/11346 [03:48<3:00:35,  1.03it/s]
  2%|▏         | 232/11346 [03:49<3:00:36,  1.03it/s]
  2%|▏         | 233/11346 [03:50<3:00:32,  1.03it/s]
  2%|▏         | 234/11346 [03:51<3:00:35,  1.03it/s]
  2%|▏         | 235/11346 [03:52<3:00:35,  1.03it/s]
  2%|▏         | 236/11346 [03:53<3:00:35,  1.03it/s]
  2%|▏         | 237/11346 [03:54<3:00:34,  1.03it/s]
  2%|▏         | 238/11346 [03:55<3:00:38,  1.02it/s]
  2%|▏         | 239/11346 [03:56<3:00:34,  1.03it/s]
  2%|▏         | 240/11346 [03:57<3:00:31,  1.03it/s]
  2%|▏         | 241/11346 [03:58<3:00:30,  1.03it/s]
  2%|▏         | 242/11346 [03:59<3:00:23,  1.03it/s]
  2%|▏         | 243/11346 [04:00<3:00:22,  1.03it/s]
  2%|▏         | 244/11346 [04:01<3:00:22,  1.03it/s]
  2%|▏         | 245/11346 [04:02<3:00:21,  1.03it/s]
  2%|▏         | 246/11346 [04:03<3:00:11,  1.03it/s]
  2%|▏         | 247/11346 [04:04<3:00:14,  1.03it/s]
  2%|▏         | 248/11346 [04:05<3:00:16,  1.03it/s]
  2%|▏         | 249/11346 [04:06<3:00:15,  1.03it/s]
  2%|▏         | 250/11346 [04:07<3:00:15,  1.03it/s]
  2%|▏         | 251/11346 [04:08<3:00:12,  1.03it/s]
  2%|▏         | 252/11346 [04:08<3:00:11,  1.03it/s]
  2%|▏         | 253/11346 [04:09<3:00:11,  1.03it/s]
  2%|▏         | 254/11346 [04:10<3:00:13,  1.03it/s]
  2%|▏         | 255/11346 [04:11<3:00:12,  1.03it/s]
  2%|▏         | 256/11346 [04:12<3:00:13,  1.03it/s]
  2%|▏         | 257/11346 [04:13<3:00:06,  1.03it/s]
  2%|▏         | 258/11346 [04:14<3:00:05,  1.03it/s]
  2%|▏         | 259/11346 [04:15<3:00:08,  1.03it/s]
  2%|▏         | 260/11346 [04:16<3:00:08,  1.03it/s]
  2%|▏         | 261/11346 [04:17<3:00:05,  1.03it/s]
  2%|▏         | 262/11346 [04:18<3:00:01,  1.03it/s]
  2%|▏         | 263/11346 [04:19<3:00:04,  1.03it/s]
  2%|▏         | 264/11346 [04:20<3:00:04,  1.03it/s]
  2%|▏         | 265/11346 [04:21<3:00:02,  1.03it/s]
  2%|▏         | 266/11346 [04:22<3:00:05,  1.03it/s]
  2%|▏         | 267/11346 [04:23<3:00:03,  1.03it/s]
  2%|▏         | 268/11346 [04:24<2:59:55,  1.03it/s]
  2%|▏         | 269/11346 [04:25<2:59:51,  1.03it/s]
  2%|▏         | 270/11346 [04:26<2:59:51,  1.03it/s]
  2%|▏         | 271/11346 [04:27<2:59:44,  1.03it/s]
  2%|▏         | 272/11346 [04:28<2:59:48,  1.03it/s]
  2%|▏         | 273/11346 [04:29<2:59:59,  1.03it/s]
  2%|▏         | 274/11346 [04:30<3:00:03,  1.02it/s]
  2%|▏         | 275/11346 [04:31<2:59:58,  1.03it/s]
  2%|▏         | 276/11346 [04:32<3:00:01,  1.02it/s]
  2%|▏         | 277/11346 [04:33<3:00:00,  1.02it/s]
  2%|▏         | 278/11346 [04:34<2:59:52,  1.03it/s]
  2%|▏         | 279/11346 [04:35<2:59:53,  1.03it/s]
  2%|▏         | 280/11346 [04:36<2:59:54,  1.03it/s]
  2%|▏         | 281/11346 [04:37<2:59:49,  1.03it/s]
  2%|▏         | 282/11346 [04:38<2:59:50,  1.03it/s]
  2%|▏         | 283/11346 [04:39<2:59:49,  1.03it/s]
  3%|β–Ž         | 284/11346 [04:40<2:59:42,  1.03it/s]
  3%|β–Ž         | 285/11346 [04:41<2:59:45,  1.03it/s]
  3%|β–Ž         | 286/11346 [04:42<2:59:45,  1.03it/s]
  3%|β–Ž         | 287/11346 [04:43<2:59:46,  1.03it/s]
  3%|β–Ž         | 288/11346 [04:44<2:59:38,  1.03it/s]
  3%|β–Ž         | 289/11346 [04:45<2:59:34,  1.03it/s]
  3%|β–Ž         | 290/11346 [04:46<2:59:25,  1.03it/s]
  3%|β–Ž         | 291/11346 [04:47<2:59:28,  1.03it/s]
  3%|β–Ž         | 292/11346 [04:47<2:59:31,  1.03it/s]
  3%|β–Ž         | 293/11346 [04:48<2:59:32,  1.03it/s]
  3%|β–Ž         | 294/11346 [04:49<2:59:30,  1.03it/s]
  3%|β–Ž         | 295/11346 [04:50<2:59:31,  1.03it/s]
  3%|β–Ž         | 296/11346 [04:51<2:59:32,  1.03it/s]
  3%|β–Ž         | 297/11346 [04:52<2:59:27,  1.03it/s]
  3%|β–Ž         | 298/11346 [04:53<2:59:26,  1.03it/s]
  3%|β–Ž         | 299/11346 [04:54<2:59:23,  1.03it/s]
  3%|β–Ž         | 300/11346 [04:55<2:59:19,  1.03it/s]
  3%|β–Ž         | 301/11346 [04:56<2:59:21,  1.03it/s]
  3%|β–Ž         | 302/11346 [04:57<2:59:26,  1.03it/s]
  3%|β–Ž         | 303/11346 [04:58<2:59:25,  1.03it/s]
  3%|β–Ž         | 304/11346 [04:59<2:59:23,  1.03it/s]
  3%|β–Ž         | 305/11346 [05:00<2:59:26,  1.03it/s]
  3%|β–Ž         | 306/11346 [05:01<2:59:22,  1.03it/s]
  3%|β–Ž         | 307/11346 [05:02<2:59:30,  1.02it/s]
  3%|β–Ž         | 308/11346 [05:03<2:59:20,  1.03it/s]
  3%|β–Ž         | 309/11346 [05:04<2:59:21,  1.03it/s]
  3%|β–Ž         | 310/11346 [05:05<2:59:16,  1.03it/s]
  3%|β–Ž         | 311/11346 [05:06<2:59:15,  1.03it/s]
  3%|β–Ž         | 312/11346 [05:07<2:59:11,  1.03it/s]
  3%|β–Ž         | 313/11346 [05:08<2:59:02,  1.03it/s]
  3%|β–Ž         | 314/11346 [05:09<2:59:00,  1.03it/s]
  3%|β–Ž         | 315/11346 [05:10<2:59:03,  1.03it/s]
  3%|β–Ž         | 316/11346 [05:11<2:59:04,  1.03it/s]
  3%|β–Ž         | 317/11346 [05:12<2:59:08,  1.03it/s]
  3%|β–Ž         | 318/11346 [05:13<2:59:07,  1.03it/s]
  3%|β–Ž         | 319/11346 [05:14<2:59:05,  1.03it/s]
  3%|β–Ž         | 320/11346 [05:15<2:59:01,  1.03it/s]
  3%|β–Ž         | 321/11346 [05:16<2:59:02,  1.03it/s]
  3%|β–Ž         | 322/11346 [05:17<2:59:08,  1.03it/s]
  3%|β–Ž         | 323/11346 [05:18<2:59:03,  1.03it/s]
  3%|β–Ž         | 324/11346 [05:19<2:58:55,  1.03it/s]
  3%|β–Ž         | 325/11346 [05:20<2:59:00,  1.03it/s]
  3%|β–Ž         | 326/11346 [05:21<2:58:53,  1.03it/s]
  3%|β–Ž         | 327/11346 [05:22<2:58:46,  1.03it/s]
  3%|β–Ž         | 328/11346 [05:23<2:58:50,  1.03it/s]
  3%|β–Ž         | 329/11346 [05:24<2:58:42,  1.03it/s]
  3%|β–Ž         | 330/11346 [05:25<2:58:39,  1.03it/s]
  3%|β–Ž         | 331/11346 [05:25<2:58:42,  1.03it/s]
  3%|β–Ž         | 332/11346 [05:26<2:58:47,  1.03it/s]
  3%|β–Ž         | 333/11346 [05:27<2:58:45,  1.03it/s]
  3%|β–Ž         | 334/11346 [05:28<2:58:46,  1.03it/s]
  3%|β–Ž         | 335/11346 [05:29<2:58:40,  1.03it/s]
  3%|β–Ž         | 336/11346 [05:30<2:58:34,  1.03it/s]
  3%|β–Ž         | 337/11346 [05:31<2:58:29,  1.03it/s]
  3%|β–Ž         | 338/11346 [05:32<2:58:31,  1.03it/s]
  3%|β–Ž         | 339/11346 [05:33<2:58:38,  1.03it/s]
  3%|β–Ž         | 340/11346 [05:34<2:58:38,  1.03it/s]
  3%|β–Ž         | 341/11346 [05:35<2:58:41,  1.03it/s]
  3%|β–Ž         | 342/11346 [05:36<2:58:42,  1.03it/s]
  3%|β–Ž         | 343/11346 [05:37<2:58:40,  1.03it/s]
  3%|β–Ž         | 344/11346 [05:38<2:58:33,  1.03it/s]
  3%|β–Ž         | 345/11346 [05:39<2:58:34,  1.03it/s]
  3%|β–Ž         | 346/11346 [05:40<2:58:37,  1.03it/s]
  3%|β–Ž         | 347/11346 [05:41<2:58:31,  1.03it/s]
  3%|β–Ž         | 348/11346 [05:42<2:58:31,  1.03it/s]
  3%|β–Ž         | 349/11346 [05:43<2:58:30,  1.03it/s]
  3%|β–Ž         | 350/11346 [05:44<2:58:27,  1.03it/s]
  3%|β–Ž         | 351/11346 [05:45<2:58:22,  1.03it/s]
  3%|β–Ž         | 352/11346 [05:46<2:58:23,  1.03it/s]
  3%|β–Ž         | 353/11346 [05:47<2:58:23,  1.03it/s]
  3%|β–Ž         | 354/11346 [05:48<2:58:23,  1.03it/s]
  3%|β–Ž         | 355/11346 [05:49<2:58:22,  1.03it/s]
  3%|β–Ž         | 356/11346 [05:50<2:58:22,  1.03it/s]
  3%|β–Ž         | 357/11346 [05:51<2:58:23,  1.03it/s]
  3%|β–Ž         | 358/11346 [05:52<2:58:22,  1.03it/s]
  3%|β–Ž         | 359/11346 [05:53<2:58:24,  1.03it/s]
  3%|β–Ž         | 360/11346 [05:54<2:58:23,  1.03it/s]
  3%|β–Ž         | 361/11346 [05:55<2:58:18,  1.03it/s]
  3%|β–Ž         | 362/11346 [05:56<2:58:22,  1.03it/s]
  3%|β–Ž         | 363/11346 [05:57<2:58:12,  1.03it/s]
  3%|β–Ž         | 364/11346 [05:58<2:58:13,  1.03it/s]
  3%|β–Ž         | 365/11346 [05:59<2:58:18,  1.03it/s]
  3%|β–Ž         | 366/11346 [06:00<2:58:18,  1.03it/s]
  3%|β–Ž         | 367/11346 [06:01<2:58:12,  1.03it/s]
  3%|β–Ž         | 368/11346 [06:02<2:58:16,  1.03it/s]
  3%|β–Ž         | 369/11346 [06:03<2:58:15,  1.03it/s]
  3%|β–Ž         | 370/11346 [06:03<2:58:11,  1.03it/s]
  3%|β–Ž         | 371/11346 [06:04<2:58:12,  1.03it/s]
  3%|β–Ž         | 372/11346 [06:05<2:58:20,  1.03it/s]
  3%|β–Ž         | 373/11346 [06:06<2:58:15,  1.03it/s]
  3%|β–Ž         | 374/11346 [06:07<2:58:06,  1.03it/s]
  3%|β–Ž         | 375/11346 [06:08<2:58:09,  1.03it/s]
  3%|β–Ž         | 376/11346 [06:09<2:58:10,  1.03it/s]
  3%|β–Ž         | 377/11346 [06:10<2:58:08,  1.03it/s]
  3%|β–Ž         | 378/11346 [06:11<2:57:58,  1.03it/s]
  3%|β–Ž         | 379/11346 [06:12<2:58:02,  1.03it/s]
  3%|β–Ž         | 380/11346 [06:13<2:58:02,  1.03it/s]
  3%|β–Ž         | 381/11346 [06:14<2:57:59,  1.03it/s]
  3%|β–Ž         | 382/11346 [06:15<2:57:58,  1.03it/s]
  3%|β–Ž         | 383/11346 [06:16<2:57:57,  1.03it/s]
  3%|β–Ž         | 384/11346 [06:17<2:57:59,  1.03it/s]
  3%|β–Ž         | 385/11346 [06:18<2:57:55,  1.03it/s]
  3%|β–Ž         | 386/11346 [06:19<2:57:57,  1.03it/s]
  3%|β–Ž         | 387/11346 [06:20<2:57:56,  1.03it/s]
  3%|β–Ž         | 388/11346 [06:21<2:57:53,  1.03it/s]
  3%|β–Ž         | 389/11346 [06:22<2:57:54,  1.03it/s]
  3%|β–Ž         | 390/11346 [06:23<2:57:56,  1.03it/s]
  3%|β–Ž         | 391/11346 [06:24<2:57:50,  1.03it/s]
  3%|β–Ž         | 392/11346 [06:25<2:57:51,  1.03it/s]
  3%|β–Ž         | 393/11346 [06:26<2:57:45,  1.03it/s]
  3%|β–Ž         | 394/11346 [06:27<2:57:41,  1.03it/s]
  3%|β–Ž         | 395/11346 [06:28<2:57:39,  1.03it/s]
  3%|β–Ž         | 396/11346 [06:29<2:57:34,  1.03it/s]
  3%|β–Ž         | 397/11346 [06:30<2:57:32,  1.03it/s]
  4%|β–Ž         | 398/11346 [06:31<2:57:25,  1.03it/s]
  4%|β–Ž         | 399/11346 [06:32<2:57:23,  1.03it/s]
  4%|β–Ž         | 400/11346 [06:33<2:57:23,  1.03it/s]
  4%|β–Ž         | 401/11346 [06:34<2:57:26,  1.03it/s]
  4%|β–Ž         | 402/11346 [06:35<2:57:28,  1.03it/s]
  4%|β–Ž         | 403/11346 [06:36<2:57:24,  1.03it/s]
  4%|β–Ž         | 404/11346 [06:37<2:57:26,  1.03it/s]
  4%|β–Ž         | 405/11346 [06:38<2:57:22,  1.03it/s]
  4%|β–Ž         | 406/11346 [06:39<2:57:16,  1.03it/s]
  4%|β–Ž         | 407/11346 [06:39<2:57:09,  1.03it/s]
  4%|β–Ž         | 408/11346 [06:40<2:57:09,  1.03it/s]
  4%|β–Ž         | 409/11346 [06:41<2:57:08,  1.03it/s]
  4%|β–Ž         | 410/11346 [06:42<2:57:07,  1.03it/s]
  4%|β–Ž         | 411/11346 [06:43<2:57:03,  1.03it/s]
  4%|β–Ž         | 412/11346 [06:44<2:57:04,  1.03it/s]
  4%|β–Ž         | 413/11346 [06:45<2:57:00,  1.03it/s]
  4%|β–Ž         | 414/11346 [06:46<2:56:59,  1.03it/s]
  4%|β–Ž         | 415/11346 [06:47<2:57:02,  1.03it/s]
  4%|β–Ž         | 416/11346 [06:48<2:57:00,  1.03it/s]
  4%|β–Ž         | 417/11346 [06:49<2:57:00,  1.03it/s]
  4%|β–Ž         | 418/11346 [06:50<2:57:03,  1.03it/s]
  4%|β–Ž         | 419/11346 [06:51<2:57:04,  1.03it/s]
  4%|β–Ž         | 420/11346 [06:52<2:57:04,  1.03it/s]
  4%|β–Ž         | 421/11346 [06:53<2:57:10,  1.03it/s]
  4%|β–Ž         | 422/11346 [06:54<2:57:09,  1.03it/s]
  4%|β–Ž         | 423/11346 [06:55<2:57:04,  1.03it/s]
  4%|β–Ž         | 424/11346 [06:56<2:57:00,  1.03it/s]
  4%|β–Ž         | 425/11346 [06:57<2:56:57,  1.03it/s]
  4%|▍         | 426/11346 [06:58<2:56:58,  1.03it/s]
  4%|▍         | 427/11346 [06:59<2:56:54,  1.03it/s]
  4%|▍         | 428/11346 [07:00<2:56:55,  1.03it/s]
  4%|▍         | 429/11346 [07:01<2:56:55,  1.03it/s]
  4%|▍         | 430/11346 [07:02<2:56:53,  1.03it/s]
  4%|▍         | 431/11346 [07:03<2:56:50,  1.03it/s]
  4%|▍         | 432/11346 [07:04<2:56:46,  1.03it/s]
  4%|▍         | 433/11346 [07:05<2:56:43,  1.03it/s]
  4%|▍         | 434/11346 [07:06<2:56:44,  1.03it/s]
  4%|▍         | 435/11346 [07:07<2:56:51,  1.03it/s]
  4%|▍         | 436/11346 [07:08<2:56:47,  1.03it/s]
  4%|▍         | 437/11346 [07:09<2:56:43,  1.03it/s]
  4%|▍         | 438/11346 [07:10<2:56:53,  1.03it/s]
  4%|▍         | 439/11346 [07:11<2:56:45,  1.03it/s]
  4%|▍         | 440/11346 [07:12<2:56:42,  1.03it/s]
  4%|▍         | 441/11346 [07:13<2:56:45,  1.03it/s]
  4%|▍         | 442/11346 [07:14<2:56:42,  1.03it/s]
  4%|▍         | 443/11346 [07:14<2:56:39,  1.03it/s]
  4%|▍         | 444/11346 [07:15<2:56:37,  1.03it/s]
  4%|▍         | 445/11346 [07:16<2:56:38,  1.03it/s]
  4%|▍         | 446/11346 [07:17<2:56:35,  1.03it/s]
  4%|▍         | 447/11346 [07:18<2:56:38,  1.03it/s]
  4%|▍         | 448/11346 [07:19<2:56:38,  1.03it/s]
  4%|▍         | 449/11346 [07:20<2:56:34,  1.03it/s]
  4%|▍         | 450/11346 [07:21<2:56:31,  1.03it/s]
  4%|▍         | 451/11346 [07:22<2:56:32,  1.03it/s]
  4%|▍         | 452/11346 [07:23<2:56:31,  1.03it/s]
  4%|▍         | 453/11346 [07:24<2:56:29,  1.03it/s]
  4%|▍         | 454/11346 [07:25<2:56:29,  1.03it/s]
  4%|▍         | 455/11346 [07:26<2:56:25,  1.03it/s]
  4%|▍         | 456/11346 [07:27<2:56:25,  1.03it/s]
  4%|▍         | 457/11346 [07:28<2:56:24,  1.03it/s]
  4%|▍         | 458/11346 [07:29<2:56:23,  1.03it/s]
  4%|▍         | 459/11346 [07:30<2:56:22,  1.03it/s]
  4%|▍         | 460/11346 [07:31<2:56:22,  1.03it/s]
  4%|▍         | 461/11346 [07:32<2:56:19,  1.03it/s]
  4%|▍         | 462/11346 [07:33<2:56:19,  1.03it/s]
  4%|▍         | 463/11346 [07:34<2:56:20,  1.03it/s]
  4%|▍         | 464/11346 [07:35<2:56:20,  1.03it/s]
  4%|▍         | 465/11346 [07:36<2:56:21,  1.03it/s]
  4%|▍         | 466/11346 [07:37<2:56:16,  1.03it/s]
  4%|▍         | 467/11346 [07:38<2:56:10,  1.03it/s]
  4%|▍         | 468/11346 [07:39<2:56:11,  1.03it/s]
  4%|▍         | 469/11346 [07:40<2:56:07,  1.03it/s]
  4%|▍         | 470/11346 [07:41<2:56:09,  1.03it/s]
  4%|▍         | 471/11346 [07:42<2:56:10,  1.03it/s]
  4%|▍         | 472/11346 [07:43<2:56:12,  1.03it/s]
  4%|▍         | 473/11346 [07:44<2:56:18,  1.03it/s]
  4%|▍         | 474/11346 [07:45<2:56:16,  1.03it/s]
  4%|▍         | 475/11346 [07:46<2:56:08,  1.03it/s]
  4%|▍         | 476/11346 [07:47<2:56:06,  1.03it/s]
  4%|▍         | 477/11346 [07:48<2:56:05,  1.03it/s]
  4%|▍         | 478/11346 [07:49<2:56:03,  1.03it/s]
  4%|▍         | 479/11346 [07:49<2:55:59,  1.03it/s]
  4%|▍         | 480/11346 [07:50<2:56:00,  1.03it/s]
  4%|▍         | 481/11346 [07:51<2:55:59,  1.03it/s]
  4%|▍         | 482/11346 [07:52<2:55:57,  1.03it/s]
  4%|▍         | 483/11346 [07:53<2:55:58,  1.03it/s]
  4%|▍         | 484/11346 [07:54<2:55:55,  1.03it/s]
  4%|▍         | 485/11346 [07:55<2:55:58,  1.03it/s]
  4%|▍         | 486/11346 [07:56<2:55:56,  1.03it/s]
  4%|▍         | 487/11346 [07:57<2:55:50,  1.03it/s]
  4%|▍         | 488/11346 [07:58<2:55:48,  1.03it/s]
  4%|▍         | 489/11346 [07:59<2:55:47,  1.03it/s]
  4%|▍         | 490/11346 [08:00<2:55:48,  1.03it/s]
  4%|▍         | 491/11346 [08:01<2:55:51,  1.03it/s]
  4%|▍         | 492/11346 [08:02<2:55:51,  1.03it/s]
  4%|▍         | 493/11346 [08:03<2:55:48,  1.03it/s]
  4%|▍         | 494/11346 [08:04<2:55:50,  1.03it/s]
  4%|▍         | 495/11346 [08:05<2:55:51,  1.03it/s]
  4%|▍         | 496/11346 [08:06<2:55:49,  1.03it/s]
  4%|▍         | 497/11346 [08:07<2:55:49,  1.03it/s]
  4%|▍         | 498/11346 [08:08<2:55:44,  1.03it/s]
  4%|▍         | 499/11346 [08:09<2:55:43,  1.03it/s]
  4%|▍         | 500/11346 [08:10<2:55:42,  1.03it/s]
                                                     

  4%|▍         | 500/11346 [08:10<2:55:42,  1.03it/s]
  4%|▍         | 501/11346 [08:11<2:55:54,  1.03it/s]
  4%|▍         | 502/11346 [08:12<2:55:53,  1.03it/s]
  4%|▍         | 503/11346 [08:13<2:55:51,  1.03it/s]
  4%|▍         | 504/11346 [08:14<2:55:43,  1.03it/s]
  4%|▍         | 505/11346 [08:15<2:55:43,  1.03it/s]
  4%|▍         | 506/11346 [08:16<2:55:40,  1.03it/s]
  4%|▍         | 507/11346 [08:17<2:55:35,  1.03it/s]
  4%|▍         | 508/11346 [08:18<2:55:34,  1.03it/s]
  4%|▍         | 509/11346 [08:19<2:55:35,  1.03it/s]
  4%|▍         | 510/11346 [08:20<2:55:32,  1.03it/s]
  5%|▍         | 511/11346 [08:21<2:55:29,  1.03it/s]
  5%|▍         | 512/11346 [08:22<2:55:32,  1.03it/s]
  5%|▍         | 513/11346 [08:23<2:55:28,  1.03it/s]
  5%|▍         | 514/11346 [08:24<2:55:27,  1.03it/s]
  5%|▍         | 515/11346 [08:24<2:55:28,  1.03it/s]
  5%|▍         | 516/11346 [08:25<2:55:36,  1.03it/s]
  5%|▍         | 517/11346 [08:26<2:55:34,  1.03it/s]
  5%|▍         | 518/11346 [08:27<2:55:29,  1.03it/s]
  5%|▍         | 519/11346 [08:28<2:55:30,  1.03it/s]
  5%|▍         | 520/11346 [08:29<2:55:30,  1.03it/s]
  5%|▍         | 521/11346 [08:30<2:55:31,  1.03it/s]
  5%|▍         | 522/11346 [08:31<2:55:30,  1.03it/s]
  5%|▍         | 523/11346 [08:32<2:55:32,  1.03it/s]
  5%|▍         | 524/11346 [08:33<2:55:27,  1.03it/s]
  5%|▍         | 525/11346 [08:34<2:55:25,  1.03it/s]
  5%|▍         | 526/11346 [08:35<2:55:29,  1.03it/s]
  5%|▍         | 527/11346 [08:36<2:55:25,  1.03it/s]
  5%|▍         | 528/11346 [08:37<2:55:19,  1.03it/s]
  5%|▍         | 529/11346 [08:38<2:55:22,  1.03it/s]
  5%|▍         | 530/11346 [08:39<2:55:23,  1.03it/s]
  5%|▍         | 531/11346 [08:40<2:55:20,  1.03it/s]
  5%|▍         | 532/11346 [08:41<2:55:13,  1.03it/s]
  5%|▍         | 533/11346 [08:42<2:55:13,  1.03it/s]
  5%|▍         | 534/11346 [08:43<2:55:10,  1.03it/s]
  5%|▍         | 535/11346 [08:44<2:55:10,  1.03it/s]
  5%|▍         | 536/11346 [08:45<2:55:09,  1.03it/s]
  5%|▍         | 537/11346 [08:46<2:55:11,  1.03it/s]
  5%|▍         | 538/11346 [08:47<2:55:07,  1.03it/s]
  5%|▍         | 539/11346 [08:48<2:55:08,  1.03it/s]
  5%|▍         | 540/11346 [08:49<2:55:08,  1.03it/s]
  5%|▍         | 541/11346 [08:50<2:55:11,  1.03it/s]
  5%|▍         | 542/11346 [08:51<2:55:07,  1.03it/s]
  5%|▍         | 543/11346 [08:52<2:55:04,  1.03it/s]
  5%|▍         | 544/11346 [08:53<2:55:06,  1.03it/s]
  5%|▍         | 545/11346 [08:54<2:55:03,  1.03it/s]
  5%|▍         | 546/11346 [08:55<2:55:00,  1.03it/s]
  5%|▍         | 547/11346 [08:56<2:54:58,  1.03it/s]
  5%|▍         | 548/11346 [08:57<2:54:57,  1.03it/s]
  5%|▍         | 549/11346 [08:58<2:54:57,  1.03it/s]
  5%|▍         | 550/11346 [08:59<2:54:58,  1.03it/s]
  5%|▍         | 551/11346 [08:59<2:54:53,  1.03it/s]
  5%|▍         | 552/11346 [09:00<2:54:50,  1.03it/s]
  5%|▍         | 553/11346 [09:01<2:54:48,  1.03it/s]
  5%|▍         | 554/11346 [09:02<2:54:51,  1.03it/s]
  5%|▍         | 555/11346 [09:03<2:54:53,  1.03it/s]
  5%|▍         | 556/11346 [09:04<2:54:48,  1.03it/s]
  5%|▍         | 557/11346 [09:05<2:54:44,  1.03it/s]
  5%|▍         | 558/11346 [09:06<2:54:55,  1.03it/s]
  5%|▍         | 559/11346 [09:07<2:54:51,  1.03it/s]
  5%|▍         | 560/11346 [09:08<2:54:48,  1.03it/s]
  5%|▍         | 561/11346 [09:09<2:54:47,  1.03it/s]
  5%|▍         | 562/11346 [09:10<2:54:45,  1.03it/s]
  5%|▍         | 563/11346 [09:11<2:54:42,  1.03it/s]
  5%|▍         | 564/11346 [09:12<2:54:41,  1.03it/s]
  5%|▍         | 565/11346 [09:13<2:54:45,  1.03it/s]
  5%|▍         | 566/11346 [09:14<2:54:41,  1.03it/s]
  5%|▍         | 567/11346 [09:15<2:54:43,  1.03it/s]
  5%|β–Œ         | 568/11346 [09:16<2:54:40,  1.03it/s]
  5%|β–Œ         | 569/11346 [09:17<2:54:35,  1.03it/s]
  5%|β–Œ         | 570/11346 [09:18<2:54:32,  1.03it/s]
  5%|β–Œ         | 571/11346 [09:19<2:54:34,  1.03it/s]
  5%|β–Œ         | 572/11346 [09:20<2:54:32,  1.03it/s]
  5%|β–Œ         | 573/11346 [09:21<2:54:33,  1.03it/s]
  5%|β–Œ         | 574/11346 [09:22<2:54:33,  1.03it/s]
  5%|β–Œ         | 575/11346 [09:23<2:54:29,  1.03it/s]
  5%|β–Œ         | 576/11346 [09:24<2:54:28,  1.03it/s]
  5%|β–Œ         | 577/11346 [09:25<2:54:25,  1.03it/s]
  5%|β–Œ         | 578/11346 [09:26<2:54:24,  1.03it/s]
  5%|β–Œ         | 579/11346 [09:27<2:54:27,  1.03it/s]
  5%|β–Œ         | 580/11346 [09:28<2:54:25,  1.03it/s]
  5%|β–Œ         | 581/11346 [09:29<2:54:21,  1.03it/s]
  5%|β–Œ         | 582/11346 [09:30<2:54:26,  1.03it/s]
  5%|β–Œ         | 583/11346 [09:31<2:54:24,  1.03it/s]
  5%|β–Œ         | 584/11346 [09:32<2:54:22,  1.03it/s]
  5%|β–Œ         | 585/11346 [09:33<2:54:21,  1.03it/s]
  5%|β–Œ         | 586/11346 [09:34<2:54:17,  1.03it/s]
  5%|β–Œ         | 587/11346 [09:34<2:54:17,  1.03it/s]
  5%|β–Œ         | 588/11346 [09:35<2:54:13,  1.03it/s]
  5%|β–Œ         | 589/11346 [09:36<2:54:18,  1.03it/s]
  5%|β–Œ         | 590/11346 [09:37<2:54:15,  1.03it/s]
  5%|β–Œ         | 591/11346 [09:38<2:54:09,  1.03it/s]
  5%|β–Œ         | 592/11346 [09:39<2:54:09,  1.03it/s]
  5%|β–Œ         | 593/11346 [09:40<2:54:13,  1.03it/s]
  5%|β–Œ         | 594/11346 [09:41<2:54:12,  1.03it/s]
  5%|β–Œ         | 595/11346 [09:42<2:54:13,  1.03it/s]
  5%|β–Œ         | 596/11346 [09:43<2:54:10,  1.03it/s]
  5%|β–Œ         | 597/11346 [09:44<2:54:09,  1.03it/s]
  5%|β–Œ         | 598/11346 [09:45<2:54:06,  1.03it/s]
  5%|β–Œ         | 599/11346 [09:46<2:54:12,  1.03it/s]
  5%|β–Œ         | 600/11346 [09:47<2:54:08,  1.03it/s]
  5%|β–Œ         | 601/11346 [09:48<2:54:08,  1.03it/s]
  5%|β–Œ         | 602/11346 [09:49<2:54:07,  1.03it/s]
  5%|β–Œ         | 603/11346 [09:50<2:54:12,  1.03it/s]
  5%|β–Œ         | 604/11346 [09:51<2:54:10,  1.03it/s]
  5%|β–Œ         | 605/11346 [09:52<2:54:10,  1.03it/s]
  5%|β–Œ         | 606/11346 [09:53<2:54:09,  1.03it/s]
  5%|β–Œ         | 607/11346 [09:54<2:54:06,  1.03it/s]
  5%|β–Œ         | 608/11346 [09:55<2:54:06,  1.03it/s]
  5%|β–Œ         | 609/11346 [09:56<2:54:06,  1.03it/s]
  5%|β–Œ         | 610/11346 [09:57<2:54:03,  1.03it/s]
  5%|β–Œ         | 611/11346 [09:58<2:54:02,  1.03it/s]
  5%|β–Œ         | 612/11346 [09:59<2:54:01,  1.03it/s]
  5%|β–Œ         | 613/11346 [10:00<2:53:56,  1.03it/s]
  5%|β–Œ         | 614/11346 [10:01<2:53:56,  1.03it/s]
  5%|β–Œ         | 615/11346 [10:02<2:53:53,  1.03it/s]
  5%|β–Œ         | 616/11346 [10:03<2:53:48,  1.03it/s]
  5%|β–Œ         | 617/11346 [10:04<2:53:48,  1.03it/s]
  5%|β–Œ         | 618/11346 [10:05<2:53:46,  1.03it/s]
  5%|β–Œ         | 619/11346 [10:06<2:53:50,  1.03it/s]
  5%|β–Œ         | 620/11346 [10:07<2:53:49,  1.03it/s]
  5%|β–Œ         | 621/11346 [10:08<2:53:50,  1.03it/s]
  5%|β–Œ         | 622/11346 [10:09<2:53:46,  1.03it/s]
  5%|β–Œ         | 623/11346 [10:09<2:53:45,  1.03it/s]
  5%|β–Œ         | 624/11346 [10:10<2:53:45,  1.03it/s]
  6%|β–Œ         | 625/11346 [10:11<2:53:48,  1.03it/s]
  6%|β–Œ         | 626/11346 [10:12<2:53:47,  1.03it/s]
  6%|β–Œ         | 627/11346 [10:13<2:53:42,  1.03it/s]
  6%|β–Œ         | 628/11346 [10:14<2:53:45,  1.03it/s]
  6%|β–Œ         | 629/11346 [10:15<2:53:41,  1.03it/s]
  6%|β–Œ         | 630/11346 [10:16<2:53:39,  1.03it/s]
  6%|β–Œ         | 631/11346 [10:17<2:53:36,  1.03it/s]
  6%|β–Œ         | 632/11346 [10:18<2:53:35,  1.03it/s]
  6%|β–Œ         | 633/11346 [10:19<2:53:36,  1.03it/s]
  6%|β–Œ         | 634/11346 [10:20<2:53:35,  1.03it/s]
  6%|β–Œ         | 635/11346 [10:21<2:53:34,  1.03it/s]
  6%|β–Œ         | 636/11346 [10:22<2:53:36,  1.03it/s]
  6%|β–Œ         | 637/11346 [10:23<2:53:29,  1.03it/s]
  6%|β–Œ         | 638/11346 [10:24<2:53:28,  1.03it/s]
  6%|β–Œ         | 639/11346 [10:25<2:53:30,  1.03it/s]
  6%|β–Œ         | 640/11346 [10:26<2:53:28,  1.03it/s]
  6%|β–Œ         | 641/11346 [10:27<2:53:28,  1.03it/s]
  6%|β–Œ         | 642/11346 [10:28<2:53:24,  1.03it/s]
  6%|β–Œ         | 643/11346 [10:29<2:53:26,  1.03it/s]
  6%|β–Œ         | 644/11346 [10:30<2:53:27,  1.03it/s]
  6%|β–Œ         | 645/11346 [10:31<2:53:27,  1.03it/s]
  6%|β–Œ         | 646/11346 [10:32<2:53:26,  1.03it/s]
  6%|β–Œ         | 647/11346 [10:33<2:53:26,  1.03it/s]
  6%|β–Œ         | 648/11346 [10:34<2:53:25,  1.03it/s]
  6%|β–Œ         | 649/11346 [10:35<2:53:23,  1.03it/s]
  6%|β–Œ         | 650/11346 [10:36<2:53:19,  1.03it/s]
  6%|β–Œ         | 651/11346 [10:37<2:53:19,  1.03it/s]
  6%|β–Œ         | 652/11346 [10:38<2:53:27,  1.03it/s]
  6%|β–Œ         | 653/11346 [10:39<2:53:24,  1.03it/s]
  6%|β–Œ         | 654/11346 [10:40<2:53:21,  1.03it/s]
  6%|β–Œ         | 655/11346 [10:41<2:53:29,  1.03it/s]
  6%|β–Œ         | 656/11346 [10:42<2:53:21,  1.03it/s]
  6%|β–Œ         | 657/11346 [10:43<2:53:16,  1.03it/s]
  6%|β–Œ         | 658/11346 [10:44<2:53:16,  1.03it/s]
  6%|β–Œ         | 659/11346 [10:45<2:53:17,  1.03it/s]
  6%|β–Œ         | 660/11346 [10:45<2:53:15,  1.03it/s]
  6%|β–Œ         | 661/11346 [10:46<2:53:14,  1.03it/s]
  6%|β–Œ         | 662/11346 [10:47<2:53:15,  1.03it/s]
  6%|β–Œ         | 663/11346 [10:48<2:53:12,  1.03it/s]
  6%|β–Œ         | 664/11346 [10:49<2:53:10,  1.03it/s]
  6%|β–Œ         | 665/11346 [10:50<2:53:03,  1.03it/s]
  6%|β–Œ         | 666/11346 [10:51<2:53:05,  1.03it/s]
  6%|β–Œ         | 667/11346 [10:52<2:53:08,  1.03it/s]
  6%|β–Œ         | 668/11346 [10:53<2:53:06,  1.03it/s]
  6%|β–Œ         | 669/11346 [10:54<2:53:03,  1.03it/s]
  6%|β–Œ         | 670/11346 [10:55<2:52:58,  1.03it/s]
  6%|β–Œ         | 671/11346 [10:56<2:53:01,  1.03it/s]
  6%|β–Œ         | 672/11346 [10:57<2:53:05,  1.03it/s]
  6%|β–Œ         | 673/11346 [10:58<2:53:06,  1.03it/s]
  6%|β–Œ         | 674/11346 [10:59<2:53:06,  1.03it/s]
  6%|β–Œ         | 675/11346 [11:00<2:52:57,  1.03it/s]
  6%|β–Œ         | 676/11346 [11:01<2:53:00,  1.03it/s]
  6%|β–Œ         | 677/11346 [11:02<2:52:58,  1.03it/s]
  6%|β–Œ         | 678/11346 [11:03<2:52:58,  1.03it/s]
  6%|β–Œ         | 679/11346 [11:04<2:52:51,  1.03it/s]
  6%|β–Œ         | 680/11346 [11:05<2:52:48,  1.03it/s]
  6%|β–Œ         | 681/11346 [11:06<2:52:44,  1.03it/s]
  6%|β–Œ         | 682/11346 [11:07<2:52:45,  1.03it/s]
  6%|β–Œ         | 683/11346 [11:08<2:52:45,  1.03it/s]
  6%|β–Œ         | 684/11346 [11:09<2:52:44,  1.03it/s]
  6%|β–Œ         | 685/11346 [11:10<2:52:48,  1.03it/s]
  6%|β–Œ         | 686/11346 [11:11<2:52:43,  1.03it/s]
  6%|β–Œ         | 687/11346 [11:12<2:52:38,  1.03it/s]
  6%|β–Œ         | 688/11346 [11:13<2:52:38,  1.03it/s]
  6%|β–Œ         | 689/11346 [11:14<2:52:39,  1.03it/s]
  6%|β–Œ         | 690/11346 [11:15<2:52:38,  1.03it/s]
  6%|β–Œ         | 691/11346 [11:16<2:52:46,  1.03it/s]
  6%|β–Œ         | 692/11346 [11:17<2:52:42,  1.03it/s]
  6%|β–Œ         | 693/11346 [11:18<2:52:41,  1.03it/s]
  6%|β–Œ         | 694/11346 [11:19<2:52:39,  1.03it/s]
  6%|β–Œ         | 695/11346 [11:20<2:52:39,  1.03it/s]
  6%|β–Œ         | 696/11346 [11:20<2:52:35,  1.03it/s]
  6%|β–Œ         | 697/11346 [11:21<2:52:37,  1.03it/s]
  6%|β–Œ         | 698/11346 [11:22<2:52:38,  1.03it/s]
  6%|β–Œ         | 699/11346 [11:23<2:52:33,  1.03it/s]
  6%|β–Œ         | 700/11346 [11:24<2:52:31,  1.03it/s]
  6%|β–Œ         | 701/11346 [11:25<2:52:29,  1.03it/s]
  6%|β–Œ         | 702/11346 [11:26<2:52:29,  1.03it/s]
  6%|β–Œ         | 703/11346 [11:27<2:52:29,  1.03it/s]
  6%|β–Œ         | 704/11346 [11:28<2:52:26,  1.03it/s]
  6%|β–Œ         | 705/11346 [11:29<2:52:21,  1.03it/s]
  6%|β–Œ         | 706/11346 [11:30<2:52:24,  1.03it/s]
  6%|β–Œ         | 707/11346 [11:31<2:52:20,  1.03it/s]
  6%|β–Œ         | 708/11346 [11:32<2:52:20,  1.03it/s]
  6%|β–Œ         | 709/11346 [11:33<2:52:20,  1.03it/s]
  6%|β–‹         | 710/11346 [11:34<2:52:20,  1.03it/s]
  6%|β–‹         | 711/11346 [11:35<2:52:18,  1.03it/s]
  6%|β–‹         | 712/11346 [11:36<2:52:15,  1.03it/s]
  6%|β–‹         | 713/11346 [11:37<2:52:13,  1.03it/s]
  6%|β–‹         | 714/11346 [11:38<2:52:13,  1.03it/s]
  6%|β–‹         | 715/11346 [11:39<2:52:13,  1.03it/s]
  6%|β–‹         | 716/11346 [11:40<2:52:14,  1.03it/s]
  6%|β–‹         | 717/11346 [11:41<2:52:14,  1.03it/s]
  6%|β–‹         | 718/11346 [11:42<2:52:13,  1.03it/s]
  6%|β–‹         | 719/11346 [11:43<2:52:08,  1.03it/s]
  6%|β–‹         | 720/11346 [11:44<2:52:05,  1.03it/s]
  6%|β–‹         | 721/11346 [11:45<2:52:00,  1.03it/s]
  6%|β–‹         | 722/11346 [11:46<2:52:01,  1.03it/s]
  6%|β–‹         | 723/11346 [11:47<2:52:05,  1.03it/s]
  6%|β–‹         | 724/11346 [11:48<2:52:05,  1.03it/s]
  6%|β–‹         | 725/11346 [11:49<2:52:02,  1.03it/s]
  6%|β–‹         | 726/11346 [11:50<2:52:06,  1.03it/s]
  6%|β–‹         | 727/11346 [11:51<2:52:06,  1.03it/s]
  6%|β–‹         | 728/11346 [11:52<2:52:02,  1.03it/s]
  6%|β–‹         | 729/11346 [11:53<2:52:02,  1.03it/s]
  6%|β–‹         | 730/11346 [11:54<2:52:03,  1.03it/s]
  6%|β–‹         | 731/11346 [11:55<2:52:02,  1.03it/s]
  6%|β–‹         | 732/11346 [11:55<2:52:00,  1.03it/s]
  6%|β–‹         | 733/11346 [11:56<2:52:01,  1.03it/s]
  6%|β–‹         | 734/11346 [11:57<2:51:58,  1.03it/s]
  6%|β–‹         | 735/11346 [11:58<2:52:00,  1.03it/s]
  6%|β–‹         | 736/11346 [11:59<2:51:54,  1.03it/s]
  6%|β–‹         | 737/11346 [12:00<2:51:58,  1.03it/s]
  7%|β–‹         | 738/11346 [12:01<2:51:58,  1.03it/s]
  7%|β–‹         | 739/11346 [12:02<2:51:56,  1.03it/s]
  7%|β–‹         | 740/11346 [12:03<2:51:52,  1.03it/s]
  7%|β–‹         | 741/11346 [12:04<2:52:01,  1.03it/s]
  7%|β–‹         | 742/11346 [12:05<2:51:56,  1.03it/s]
  7%|β–‹         | 743/11346 [12:06<2:51:52,  1.03it/s]
  7%|β–‹         | 744/11346 [12:07<2:51:49,  1.03it/s]
  7%|β–‹         | 745/11346 [12:08<2:51:51,  1.03it/s]
  7%|β–‹         | 746/11346 [12:09<2:51:55,  1.03it/s]
  7%|β–‹         | 747/11346 [12:10<2:51:54,  1.03it/s]
  7%|β–‹         | 748/11346 [12:11<3:04:33,  1.04s/it]
  7%|β–‹         | 749/11346 [12:12<3:00:39,  1.02s/it]
  7%|β–‹         | 750/11346 [12:13<2:57:52,  1.01s/it]
  7%|β–‹         | 751/11346 [12:14<2:56:02,  1.00it/s]
  7%|β–‹         | 752/11346 [12:15<2:54:40,  1.01it/s]
  7%|β–‹         | 753/11346 [12:16<2:53:46,  1.02it/s]
  7%|β–‹         | 754/11346 [12:17<2:53:09,  1.02it/s]
  7%|β–‹         | 755/11346 [12:18<2:52:43,  1.02it/s]
  7%|β–‹         | 756/11346 [12:19<2:52:19,  1.02it/s]
  7%|β–‹         | 757/11346 [12:20<2:52:06,  1.03it/s]
  7%|β–‹         | 758/11346 [12:21<2:51:53,  1.03it/s]
  7%|β–‹         | 759/11346 [12:22<2:51:44,  1.03it/s]
  7%|β–‹         | 760/11346 [12:23<2:51:40,  1.03it/s]
  7%|β–‹         | 761/11346 [12:24<2:51:34,  1.03it/s]
  7%|β–‹         | 762/11346 [12:25<2:51:31,  1.03it/s]
  7%|β–‹         | 763/11346 [12:26<2:51:28,  1.03it/s]
  7%|β–‹         | 764/11346 [12:27<2:51:28,  1.03it/s]
  7%|β–‹         | 765/11346 [12:28<2:51:27,  1.03it/s]
  7%|β–‹         | 766/11346 [12:29<2:51:20,  1.03it/s]
  7%|β–‹         | 767/11346 [12:30<2:51:18,  1.03it/s]
  7%|β–‹         | 768/11346 [12:31<2:51:19,  1.03it/s]
  7%|β–‹         | 769/11346 [12:32<2:51:21,  1.03it/s]
  7%|β–‹         | 770/11346 [12:33<2:51:22,  1.03it/s]
  7%|β–‹         | 771/11346 [12:34<2:51:17,  1.03it/s]
  7%|β–‹         | 772/11346 [12:35<2:51:17,  1.03it/s]
  7%|β–‹         | 773/11346 [12:36<2:51:16,  1.03it/s]
  7%|β–‹         | 774/11346 [12:37<2:51:12,  1.03it/s]
  7%|β–‹         | 775/11346 [12:38<2:51:12,  1.03it/s]
  7%|β–‹         | 776/11346 [12:39<2:51:08,  1.03it/s]
  7%|β–‹         | 777/11346 [12:39<2:51:11,  1.03it/s]
  7%|β–‹         | 778/11346 [12:40<2:51:10,  1.03it/s]
  7%|β–‹         | 779/11346 [12:41<2:51:10,  1.03it/s]
  7%|β–‹         | 780/11346 [12:42<2:51:08,  1.03it/s]
  7%|β–‹         | 781/11346 [12:43<2:51:05,  1.03it/s]
  7%|β–‹         | 782/11346 [12:44<2:51:02,  1.03it/s]
  7%|β–‹         | 783/11346 [12:45<2:51:01,  1.03it/s]
  7%|β–‹         | 784/11346 [12:46<2:51:02,  1.03it/s]
  7%|β–‹         | 785/11346 [12:47<2:51:05,  1.03it/s]
  7%|β–‹         | 786/11346 [12:48<2:51:04,  1.03it/s]
  7%|β–‹         | 787/11346 [12:49<2:51:02,  1.03it/s]
  7%|β–‹         | 788/11346 [12:50<2:51:02,  1.03it/s]
  7%|β–‹         | 789/11346 [12:51<2:51:01,  1.03it/s]
  7%|β–‹         | 790/11346 [12:52<2:50:58,  1.03it/s]
  7%|β–‹         | 791/11346 [12:53<2:51:00,  1.03it/s]
  7%|β–‹         | 792/11346 [12:54<2:50:56,  1.03it/s]
  7%|β–‹         | 793/11346 [12:55<2:50:56,  1.03it/s]
  7%|β–‹         | 794/11346 [12:56<2:50:57,  1.03it/s]
  7%|β–‹         | 795/11346 [12:57<2:50:53,  1.03it/s]
  7%|β–‹         | 796/11346 [12:58<2:50:54,  1.03it/s]
  7%|β–‹         | 797/11346 [12:59<2:50:55,  1.03it/s]
  7%|β–‹         | 798/11346 [13:00<2:50:59,  1.03it/s]
  7%|β–‹         | 799/11346 [13:01<2:50:54,  1.03it/s]
  7%|β–‹         | 800/11346 [13:02<2:50:47,  1.03it/s]
  7%|β–‹         | 801/11346 [13:03<2:50:48,  1.03it/s]
  7%|β–‹         | 802/11346 [13:04<2:50:51,  1.03it/s]
  7%|β–‹         | 803/11346 [13:05<2:50:51,  1.03it/s]
  7%|β–‹         | 804/11346 [13:06<2:50:50,  1.03it/s]
  7%|β–‹         | 805/11346 [13:07<2:50:49,  1.03it/s]
  7%|β–‹         | 806/11346 [13:08<2:50:47,  1.03it/s]
  7%|β–‹         | 807/11346 [13:09<2:50:44,  1.03it/s]
  7%|β–‹         | 808/11346 [13:10<2:50:40,  1.03it/s]
  7%|β–‹         | 809/11346 [13:11<2:50:35,  1.03it/s]
  7%|β–‹         | 810/11346 [13:12<2:50:41,  1.03it/s]
  7%|β–‹         | 811/11346 [13:13<2:50:39,  1.03it/s]
  7%|β–‹         | 812/11346 [13:13<2:50:37,  1.03it/s]
  7%|β–‹         | 813/11346 [13:14<2:50:35,  1.03it/s]
  7%|β–‹         | 814/11346 [13:15<2:50:35,  1.03it/s]
  7%|β–‹         | 815/11346 [13:16<2:50:42,  1.03it/s]
  7%|β–‹         | 816/11346 [13:17<2:50:37,  1.03it/s]
  7%|β–‹         | 817/11346 [13:18<2:50:36,  1.03it/s]
  7%|β–‹         | 818/11346 [13:19<2:50:35,  1.03it/s]
  7%|β–‹         | 819/11346 [13:20<2:50:33,  1.03it/s]
  7%|β–‹         | 820/11346 [13:21<2:50:35,  1.03it/s]
  7%|β–‹         | 821/11346 [13:22<2:50:38,  1.03it/s]
  7%|β–‹         | 822/11346 [13:23<2:50:32,  1.03it/s]
  7%|β–‹         | 823/11346 [13:24<2:50:27,  1.03it/s]
  7%|β–‹         | 824/11346 [13:25<2:50:24,  1.03it/s]
  7%|β–‹         | 825/11346 [13:26<2:50:27,  1.03it/s]
  7%|β–‹         | 826/11346 [13:27<2:50:27,  1.03it/s]
  7%|β–‹         | 827/11346 [13:28<2:50:26,  1.03it/s]
  7%|β–‹         | 828/11346 [13:29<2:50:33,  1.03it/s]
  7%|β–‹         | 829/11346 [13:30<2:50:29,  1.03it/s]
  7%|β–‹         | 830/11346 [13:31<2:50:24,  1.03it/s]
  7%|β–‹         | 831/11346 [13:32<2:50:23,  1.03it/s]
  7%|β–‹         | 832/11346 [13:33<2:50:24,  1.03it/s]
  7%|β–‹         | 833/11346 [13:34<2:50:20,  1.03it/s]
  7%|β–‹         | 834/11346 [13:35<2:50:16,  1.03it/s]
  7%|β–‹         | 835/11346 [13:36<2:50:12,  1.03it/s]
  7%|β–‹         | 836/11346 [13:37<2:50:16,  1.03it/s]
  7%|β–‹         | 837/11346 [13:38<2:50:17,  1.03it/s]
  7%|β–‹         | 838/11346 [13:39<2:50:15,  1.03it/s]
  7%|β–‹         | 839/11346 [13:40<2:50:13,  1.03it/s]
  7%|β–‹         | 840/11346 [13:41<2:50:10,  1.03it/s]
  7%|β–‹         | 841/11346 [13:42<2:50:10,  1.03it/s]
  7%|β–‹         | 842/11346 [13:43<2:50:10,  1.03it/s]
  7%|β–‹         | 843/11346 [13:44<2:50:07,  1.03it/s]
  7%|β–‹         | 844/11346 [13:45<2:50:02,  1.03it/s]
  7%|β–‹         | 845/11346 [13:46<2:49:58,  1.03it/s]
  7%|β–‹         | 846/11346 [13:47<2:50:00,  1.03it/s]
  7%|β–‹         | 847/11346 [13:48<2:50:03,  1.03it/s]
  7%|β–‹         | 848/11346 [13:48<2:50:03,  1.03it/s]
  7%|β–‹         | 849/11346 [13:49<2:50:05,  1.03it/s]
  7%|β–‹         | 850/11346 [13:50<2:50:01,  1.03it/s]
  8%|β–Š         | 851/11346 [13:51<2:50:09,  1.03it/s]
  8%|β–Š         | 852/11346 [13:52<2:50:04,  1.03it/s]
  8%|β–Š         | 853/11346 [13:53<2:50:03,  1.03it/s]
  8%|β–Š         | 854/11346 [13:54<2:50:04,  1.03it/s]
  8%|β–Š         | 855/11346 [13:55<2:50:01,  1.03it/s]
  8%|β–Š         | 856/11346 [13:56<2:49:57,  1.03it/s]
  8%|β–Š         | 857/11346 [13:57<2:49:57,  1.03it/s]
  8%|β–Š         | 858/11346 [13:58<2:49:55,  1.03it/s]
  8%|β–Š         | 859/11346 [13:59<2:49:52,  1.03it/s]
  8%|β–Š         | 860/11346 [14:00<2:49:51,  1.03it/s]
  8%|β–Š         | 861/11346 [14:01<2:49:48,  1.03it/s]
  8%|β–Š         | 862/11346 [14:02<2:49:46,  1.03it/s]
  8%|β–Š         | 863/11346 [14:03<2:49:45,  1.03it/s]
  8%|β–Š         | 864/11346 [14:04<2:49:47,  1.03it/s]
  8%|β–Š         | 865/11346 [14:05<2:49:48,  1.03it/s]
  8%|β–Š         | 866/11346 [14:06<2:49:48,  1.03it/s]
  8%|β–Š         | 867/11346 [14:07<2:49:48,  1.03it/s]
  8%|β–Š         | 868/11346 [14:08<2:49:51,  1.03it/s]
  8%|β–Š         | 869/11346 [14:09<2:49:48,  1.03it/s]
  8%|β–Š         | 870/11346 [14:10<2:49:48,  1.03it/s]
  8%|β–Š         | 871/11346 [14:11<2:49:43,  1.03it/s]
  8%|β–Š         | 872/11346 [14:12<2:49:38,  1.03it/s]
  8%|β–Š         | 873/11346 [14:13<2:49:38,  1.03it/s]
  8%|β–Š         | 874/11346 [14:14<2:49:41,  1.03it/s]
  8%|β–Š         | 875/11346 [14:15<2:49:38,  1.03it/s]
  8%|β–Š         | 876/11346 [14:16<2:49:35,  1.03it/s]
  8%|β–Š         | 877/11346 [14:17<2:49:34,  1.03it/s]
  8%|β–Š         | 878/11346 [14:18<2:49:31,  1.03it/s]
  8%|β–Š         | 879/11346 [14:19<2:49:34,  1.03it/s]
  8%|β–Š         | 880/11346 [14:20<2:49:32,  1.03it/s]
  8%|β–Š         | 881/11346 [14:21<2:49:32,  1.03it/s]
  8%|β–Š         | 882/11346 [14:22<2:49:39,  1.03it/s]
  8%|β–Š         | 883/11346 [14:23<2:49:32,  1.03it/s]
  8%|β–Š         | 884/11346 [14:23<2:49:25,  1.03it/s]
  8%|β–Š         | 885/11346 [14:24<2:49:24,  1.03it/s]
  8%|β–Š         | 886/11346 [14:25<2:49:23,  1.03it/s]
  8%|β–Š         | 887/11346 [14:26<2:49:24,  1.03it/s]
  8%|β–Š         | 888/11346 [14:27<2:49:25,  1.03it/s]
  8%|β–Š         | 889/11346 [14:28<2:49:21,  1.03it/s]
  8%|β–Š         | 890/11346 [14:29<2:49:17,  1.03it/s]
  8%|β–Š         | 891/11346 [14:30<2:49:20,  1.03it/s]
  8%|β–Š         | 892/11346 [14:31<2:49:22,  1.03it/s]
  8%|β–Š         | 893/11346 [14:32<2:49:17,  1.03it/s]
  8%|β–Š         | 894/11346 [14:33<2:49:19,  1.03it/s]
  8%|β–Š         | 895/11346 [14:34<2:49:22,  1.03it/s]
  8%|β–Š         | 896/11346 [14:35<2:49:19,  1.03it/s]
  8%|β–Š         | 897/11346 [14:36<2:49:17,  1.03it/s]
  8%|β–Š         | 898/11346 [14:37<2:49:24,  1.03it/s]
  8%|β–Š         | 899/11346 [14:38<2:49:20,  1.03it/s]
  8%|β–Š         | 900/11346 [14:39<2:49:14,  1.03it/s]
  8%|β–Š         | 901/11346 [14:40<2:49:16,  1.03it/s]
  8%|β–Š         | 902/11346 [14:41<2:49:12,  1.03it/s]
  8%|β–Š         | 903/11346 [14:42<2:49:08,  1.03it/s]
  8%|β–Š         | 904/11346 [14:43<2:49:13,  1.03it/s]
  8%|β–Š         | 905/11346 [14:44<2:49:17,  1.03it/s]
  8%|β–Š         | 906/11346 [14:45<2:49:15,  1.03it/s]
  8%|β–Š         | 907/11346 [14:46<2:49:08,  1.03it/s]
  8%|β–Š         | 908/11346 [14:47<2:49:09,  1.03it/s]
  8%|β–Š         | 909/11346 [14:48<2:49:06,  1.03it/s]
  8%|β–Š         | 910/11346 [14:49<2:49:07,  1.03it/s]
  8%|β–Š         | 911/11346 [14:50<2:49:04,  1.03it/s]
  8%|β–Š         | 912/11346 [14:51<2:49:13,  1.03it/s]
  8%|β–Š         | 913/11346 [14:52<2:49:08,  1.03it/s]
  8%|β–Š         | 914/11346 [14:53<2:49:06,  1.03it/s]
  8%|β–Š         | 915/11346 [14:54<2:49:03,  1.03it/s]
  8%|β–Š         | 916/11346 [14:55<2:49:04,  1.03it/s]
  8%|β–Š         | 917/11346 [14:56<2:49:02,  1.03it/s]
  8%|β–Š         | 918/11346 [14:57<2:49:00,  1.03it/s]
  8%|β–Š         | 919/11346 [14:58<2:48:58,  1.03it/s]
  8%|β–Š         | 920/11346 [14:58<2:49:00,  1.03it/s]
  8%|β–Š         | 921/11346 [14:59<2:48:58,  1.03it/s]
  8%|β–Š         | 922/11346 [15:00<2:49:00,  1.03it/s]
  8%|β–Š         | 923/11346 [15:01<2:49:00,  1.03it/s]
  8%|β–Š         | 924/11346 [15:02<2:48:57,  1.03it/s]
  8%|β–Š         | 925/11346 [15:03<2:48:52,  1.03it/s]
  8%|β–Š         | 926/11346 [15:04<2:48:47,  1.03it/s]
  8%|β–Š         | 927/11346 [15:05<2:48:45,  1.03it/s]
  8%|β–Š         | 928/11346 [15:06<2:48:44,  1.03it/s]
  8%|β–Š         | 929/11346 [15:07<2:48:45,  1.03it/s]
  8%|β–Š         | 930/11346 [15:08<2:48:47,  1.03it/s]
  8%|β–Š         | 931/11346 [15:09<2:48:46,  1.03it/s]
  8%|β–Š         | 932/11346 [15:10<2:48:43,  1.03it/s]
  8%|β–Š         | 933/11346 [15:11<2:48:43,  1.03it/s]
  8%|β–Š         | 934/11346 [15:12<2:48:42,  1.03it/s]
  8%|β–Š         | 935/11346 [15:13<2:48:41,  1.03it/s]
  8%|β–Š         | 936/11346 [15:14<2:48:37,  1.03it/s]
  8%|β–Š         | 937/11346 [15:15<2:48:32,  1.03it/s]
  8%|β–Š         | 938/11346 [15:16<2:48:42,  1.03it/s]
  8%|β–Š         | 939/11346 [15:17<2:48:41,  1.03it/s]
  8%|β–Š         | 940/11346 [15:18<2:48:38,  1.03it/s]
  8%|β–Š         | 941/11346 [15:19<2:48:35,  1.03it/s]
  8%|β–Š         | 942/11346 [15:20<2:48:35,  1.03it/s]
  8%|β–Š         | 943/11346 [15:21<2:48:30,  1.03it/s]
  8%|β–Š         | 944/11346 [15:22<2:48:26,  1.03it/s]
  8%|β–Š         | 945/11346 [15:23<2:48:24,  1.03it/s]
  8%|β–Š         | 946/11346 [15:24<2:48:26,  1.03it/s]
  8%|β–Š         | 947/11346 [15:25<2:48:34,  1.03it/s]
  8%|β–Š         | 948/11346 [15:26<2:48:28,  1.03it/s]
  8%|β–Š         | 949/11346 [15:27<2:48:28,  1.03it/s]
  8%|β–Š         | 950/11346 [15:28<2:48:30,  1.03it/s]
  8%|β–Š         | 951/11346 [15:29<2:48:30,  1.03it/s]
  8%|β–Š         | 952/11346 [15:30<2:48:31,  1.03it/s]
  8%|β–Š         | 953/11346 [15:31<2:48:28,  1.03it/s]
  8%|β–Š         | 954/11346 [15:32<2:48:31,  1.03it/s]
  8%|β–Š         | 955/11346 [15:33<2:48:25,  1.03it/s]
  8%|β–Š         | 956/11346 [15:33<2:48:19,  1.03it/s]
  8%|β–Š         | 957/11346 [15:34<2:48:20,  1.03it/s]
  8%|β–Š         | 958/11346 [15:35<2:48:17,  1.03it/s]
  8%|β–Š         | 959/11346 [15:36<2:48:16,  1.03it/s]
  8%|β–Š         | 960/11346 [15:37<2:48:15,  1.03it/s]
  8%|β–Š         | 961/11346 [15:38<2:48:15,  1.03it/s]
  8%|β–Š         | 962/11346 [15:39<2:48:13,  1.03it/s]
  8%|β–Š         | 963/11346 [15:40<2:48:11,  1.03it/s]
  8%|β–Š         | 964/11346 [15:41<2:48:13,  1.03it/s]
  9%|β–Š         | 965/11346 [15:42<2:48:12,  1.03it/s]
  9%|β–Š         | 966/11346 [15:43<2:48:09,  1.03it/s]
  9%|β–Š         | 967/11346 [15:44<2:48:09,  1.03it/s]
  9%|β–Š         | 968/11346 [15:45<2:48:11,  1.03it/s]
  9%|β–Š         | 969/11346 [15:46<2:48:09,  1.03it/s]
  9%|β–Š         | 970/11346 [15:47<2:48:04,  1.03it/s]
  9%|β–Š         | 971/11346 [15:48<2:48:03,  1.03it/s]
  9%|β–Š         | 972/11346 [15:49<2:48:06,  1.03it/s]
  9%|β–Š         | 973/11346 [15:50<2:48:06,  1.03it/s]
  9%|β–Š         | 974/11346 [15:51<2:48:00,  1.03it/s]
  9%|β–Š         | 975/11346 [15:52<2:48:02,  1.03it/s]
  9%|β–Š         | 976/11346 [15:53<2:48:03,  1.03it/s]
  9%|β–Š         | 977/11346 [15:54<2:48:03,  1.03it/s]
  9%|β–Š         | 978/11346 [15:55<2:47:59,  1.03it/s]
  9%|β–Š         | 979/11346 [15:56<2:47:59,  1.03it/s]
  9%|β–Š         | 980/11346 [15:57<2:47:57,  1.03it/s]
  9%|β–Š         | 981/11346 [15:58<2:47:51,  1.03it/s]
  9%|β–Š         | 982/11346 [15:59<2:47:47,  1.03it/s]
  9%|β–Š         | 983/11346 [16:00<2:47:45,  1.03it/s]
  9%|β–Š         | 984/11346 [16:01<2:47:51,  1.03it/s]
  9%|β–Š         | 985/11346 [16:02<2:47:50,  1.03it/s]
  9%|β–Š         | 986/11346 [16:03<2:47:49,  1.03it/s]
  9%|β–Š         | 987/11346 [16:04<2:47:50,  1.03it/s]
  9%|β–Š         | 988/11346 [16:05<2:47:47,  1.03it/s]
  9%|β–Š         | 989/11346 [16:06<2:47:46,  1.03it/s]
  9%|β–Š         | 990/11346 [16:07<2:47:42,  1.03it/s]
  9%|β–Š         | 991/11346 [16:08<2:47:49,  1.03it/s]
  9%|β–Š         | 992/11346 [16:08<2:47:49,  1.03it/s]
  9%|β–‰         | 993/11346 [16:09<2:47:48,  1.03it/s]
  9%|β–‰         | 994/11346 [16:10<2:47:55,  1.03it/s]
  9%|β–‰         | 995/11346 [16:11<2:47:53,  1.03it/s]
  9%|β–‰         | 996/11346 [16:12<2:47:48,  1.03it/s]
  9%|β–‰         | 997/11346 [16:13<2:47:48,  1.03it/s]
  9%|β–‰         | 998/11346 [16:14<2:47:47,  1.03it/s]
  9%|β–‰         | 999/11346 [16:15<2:47:44,  1.03it/s]
  9%|β–‰         | 1000/11346 [16:16<2:47:39,  1.03it/s]
                                                      

  9%|β–‰         | 1000/11346 [16:16<2:47:39,  1.03it/s][INFO|trainer.py:3662] 2024-06-05 03:21:57,117 >> ***** Running Evaluation *****
[INFO|trainer.py:3664] 2024-06-05 03:21:57,117 >>   Num examples = 1840
[INFO|trainer.py:3667] 2024-06-05 03:21:57,117 >>   Batch size = 48
{'loss': 5.1118, 'grad_norm': 0.8546391725540161, 'learning_rate': 8.816009873931059e-05, 'epoch': 0.13}
{'loss': 3.406, 'grad_norm': 0.8593688607215881, 'learning_rate': 9.59831475011252e-05, 'epoch': 0.26}


  0%|          | 0/39 [00:00<?, ?it/s]

  5%|β–Œ         | 2/39 [00:01<00:27,  1.34it/s]

  8%|β–Š         | 3/39 [00:02<00:37,  1.05s/it]

 10%|β–ˆ         | 4/39 [00:04<00:42,  1.22s/it]

 13%|β–ˆβ–Ž        | 5/39 [00:05<00:44,  1.31s/it]

 15%|β–ˆβ–Œ        | 6/39 [00:07<00:45,  1.37s/it]

 18%|β–ˆβ–Š        | 7/39 [00:08<00:44,  1.41s/it]

 21%|β–ˆβ–ˆ        | 8/39 [00:10<00:44,  1.43s/it]

 23%|β–ˆβ–ˆβ–Ž       | 9/39 [00:11<00:43,  1.45s/it]

 26%|β–ˆβ–ˆβ–Œ       | 10/39 [00:13<00:42,  1.46s/it]

 28%|β–ˆβ–ˆβ–Š       | 11/39 [00:14<00:41,  1.47s/it]

 31%|β–ˆβ–ˆβ–ˆ       | 12/39 [00:16<00:39,  1.47s/it]

 33%|β–ˆβ–ˆβ–ˆβ–Ž      | 13/39 [00:17<00:38,  1.48s/it]

 36%|β–ˆβ–ˆβ–ˆβ–Œ      | 14/39 [00:19<00:36,  1.48s/it]

 38%|β–ˆβ–ˆβ–ˆβ–Š      | 15/39 [00:20<00:35,  1.48s/it]

 41%|β–ˆβ–ˆβ–ˆβ–ˆ      | 16/39 [00:22<00:34,  1.48s/it]

 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž     | 17/39 [00:23<00:32,  1.48s/it]

 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ     | 18/39 [00:25<00:31,  1.48s/it]

 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š     | 19/39 [00:26<00:29,  1.48s/it]

 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 20/39 [00:28<00:28,  1.48s/it]

 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 21/39 [00:29<00:26,  1.48s/it]

 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹    | 22/39 [00:31<00:25,  1.48s/it]

 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰    | 23/39 [00:32<00:23,  1.48s/it]

 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 24/39 [00:34<00:22,  1.48s/it]

 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 25/39 [00:35<00:20,  1.48s/it]

 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹   | 26/39 [00:37<00:19,  1.48s/it]

 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰   | 27/39 [00:38<00:17,  1.48s/it]

 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 28/39 [00:40<00:16,  1.48s/it]

 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 29/39 [00:41<00:14,  1.48s/it]

 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹  | 30/39 [00:43<00:13,  1.48s/it]

 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰  | 31/39 [00:44<00:11,  1.48s/it]

 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 32/39 [00:46<00:10,  1.48s/it]

 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 33/39 [00:47<00:08,  1.48s/it]

 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 34/39 [00:48<00:07,  1.48s/it]

 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 35/39 [00:50<00:05,  1.48s/it]

 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 36/39 [00:51<00:04,  1.48s/it]

 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 37/39 [00:53<00:02,  1.48s/it]

 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 38/39 [00:54<00:01,  1.46s/it]

100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 39/39 [00:55<00:00,  1.16s/it]
                                                      

                                               

  9%|β–‰         | 1000/11346 [17:30<2:47:39,  1.03it/s]

100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 39/39 [01:12<00:00,  1.16s/it]

                                               [INFO|trainer.py:3353] 2024-06-05 03:23:11,169 >> Saving model checkpoint to ./training_outputs_job_117568_1_05-06_03-05/checkpoint-1000
[INFO|configuration_utils.py:471] 2024-06-05 03:23:11,183 >> Configuration saved in ./training_outputs_job_117568_1_05-06_03-05/checkpoint-1000/config.json
[INFO|configuration_utils.py:705] 2024-06-05 03:23:11,189 >> Configuration saved in ./training_outputs_job_117568_1_05-06_03-05/checkpoint-1000/generation_config.json
[INFO|modeling_utils.py:2592] 2024-06-05 03:23:12,091 >> Model weights saved in ./training_outputs_job_117568_1_05-06_03-05/checkpoint-1000/model.safetensors
[INFO|tokenization_utils_base.py:2503] 2024-06-05 03:23:12,105 >> tokenizer config file saved in ./training_outputs_job_117568_1_05-06_03-05/checkpoint-1000/tokenizer_config.json
[INFO|tokenization_utils_base.py:2512] 2024-06-05 03:23:12,110 >> Special tokens file saved in ./training_outputs_job_117568_1_05-06_03-05/checkpoint-1000/special_tokens_map.json
[INFO|tokenization_utils_base.py:2503] 2024-06-05 03:23:14,277 >> tokenizer config file saved in ./training_outputs_job_117568_1_05-06_03-05/tokenizer_config.json
[INFO|tokenization_utils_base.py:2512] 2024-06-05 03:23:14,282 >> Special tokens file saved in ./training_outputs_job_117568_1_05-06_03-05/special_tokens_map.json
/home/dshteyma/miniconda3/lib/python3.9/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
  warnings.warn('Was asked to gather along dimension 0, but all '