File size: 166,241 Bytes
54d154e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 |
08/27/2022 00:02:42 - WARNING - __main__ - Process rank: 0, device: cuda:0, n_gpu: 1 distributed training: True, 16-bits training: True
08/27/2022 00:02:42 - INFO - __main__ - Training/evaluation parameters OurTrainingArguments(output_dir='out/mabel-joint-cl-al1-mlm-bs-32-lr-5e-5-msl-128-ep-2', overwrite_output_dir=True, do_train=True, do_eval=True, do_predict=False, evaluation_strategy=<EvaluationStrategy.NO: 'no'>, prediction_loss_only=False, per_device_train_batch_size=32, per_device_eval_batch_size=8, per_gpu_train_batch_size=None, per_gpu_eval_batch_size=None, gradient_accumulation_steps=1, eval_accumulation_steps=None, learning_rate=5e-05, weight_decay=0.0, adam_beta1=0.9, adam_beta2=0.999, adam_epsilon=1e-08, max_grad_norm=1.0, num_train_epochs=2.0, max_steps=-1, lr_scheduler_type=<SchedulerType.LINEAR: 'linear'>, warmup_steps=0, logging_dir='runs/Aug27_00-02-42_a11-03.hpc.usc.edu', logging_first_step=False, logging_steps=500, save_steps=125, save_total_limit=None, no_cuda=False, seed=42, fp16=True, fp16_opt_level='O1', fp16_backend='auto', local_rank=0, tpu_num_cores=None, tpu_metrics_debug=False, debug=False, dataloader_drop_last=False, eval_steps=500, dataloader_num_workers=0, past_index=-1, run_name='out/mabel-joint-cl-al1-mlm-bs-32-lr-5e-5-msl-128-ep-2', disable_tqdm=False, remove_unused_columns=True, label_names=None, load_best_model_at_end=True, metric_for_best_model='loss', greater_is_better=False, ignore_data_skip=False, sharded_ddp=False, deepspeed=None, label_smoothing_factor=0.0, adafactor=False, eval_transfer=False, report_to='wandb')
08/27/2022 00:02:42 - WARNING - __main__ - Process rank: 1, device: cuda:1, n_gpu: 1 distributed training: True, 16-bits training: True
08/27/2022 00:02:42 - WARNING - __main__ - Process rank: 2, device: cuda:2, n_gpu: 1 distributed training: True, 16-bits training: True
08/27/2022 00:02:42 - WARNING - __main__ - Process rank: 3, device: cuda:3, n_gpu: 1 distributed training: True, 16-bits training: True
08/27/2022 00:02:42 - WARNING - datasets.builder - Using custom data configuration default-2f6794b69ce47e79
08/27/2022 00:02:42 - WARNING - datasets.builder - Using custom data configuration default-2f6794b69ce47e79
08/27/2022 00:02:42 - WARNING - datasets.builder - Using custom data configuration default-2f6794b69ce47e79
08/27/2022 00:02:43 - WARNING - datasets.builder - Using custom data configuration default-2f6794b69ce47e79
08/27/2022 00:02:44 - WARNING - datasets.builder - Reusing dataset csv (.cache/csv/default-2f6794b69ce47e79/0.0.0/652c3096f041ee27b04d2232d41f10547a8fecda3e284a79a0ec4053c916ef7a)
0%| | 0/1 [00:00<?, ?it/s]08/27/2022 00:02:44 - WARNING - datasets.builder - Reusing dataset csv (.cache/csv/default-2f6794b69ce47e79/0.0.0/652c3096f041ee27b04d2232d41f10547a8fecda3e284a79a0ec4053c916ef7a)
08/27/2022 00:02:44 - WARNING - datasets.builder - Reusing dataset csv (.cache/csv/default-2f6794b69ce47e79/0.0.0/652c3096f041ee27b04d2232d41f10547a8fecda3e284a79a0ec4053c916ef7a)
0%| | 0/1 [00:00<?, ?it/s]
0%| | 0/1 [00:00<?, ?it/s]08/27/2022 00:02:44 - WARNING - datasets.builder - Reusing dataset csv (.cache/csv/default-2f6794b69ce47e79/0.0.0/652c3096f041ee27b04d2232d41f10547a8fecda3e284a79a0ec4053c916ef7a)
0%| | 0/1 [00:00<?, ?it/s]
100%|██████████| 1/1 [00:00<00:00, 2.77it/s]
100%|██████████| 1/1 [00:00<00:00, 3.24it/s]
100%|██████████| 1/1 [00:00<00:00, 2.76it/s]
100%|██████████| 1/1 [00:00<00:00, 2.76it/s]
100%|██████████| 1/1 [00:00<00:00, 2.72it/s]
100%|██████████| 1/1 [00:00<00:00, 2.74it/s]
100%|██████████| 1/1 [00:00<00:00, 3.20it/s]
100%|██████████| 1/1 [00:00<00:00, 2.75it/s]
[INFO|configuration_utils.py:445] 2022-08-27 00:02:44,795 >> loading configuration file https://huggingface.co/bert-base-uncased/resolve/main/config.json from cache at .cache/3c61d016573b14f7f008c02c4e51a366c67ab274726fe2910691e2a761acf43e.37395cee442ab11005bcd270f3c34464dc1704b715b5d7d52b1a461abe3b9e4e
[INFO|configuration_utils.py:481] 2022-08-27 00:02:44,796 >> Model config BertConfig {
"architectures": [
"BertForMaskedLM"
],
"attention_probs_dropout_prob": 0.1,
"gradient_checkpointing": false,
"hidden_act": "gelu",
"hidden_dropout_prob": 0.1,
"hidden_size": 768,
"initializer_range": 0.02,
"intermediate_size": 3072,
"layer_norm_eps": 1e-12,
"max_position_embeddings": 512,
"model_type": "bert",
"num_attention_heads": 12,
"num_hidden_layers": 12,
"pad_token_id": 0,
"position_embedding_type": "absolute",
"transformers_version": "4.2.1",
"type_vocab_size": 2,
"use_cache": true,
"vocab_size": 30522
}
[INFO|configuration_utils.py:445] 2022-08-27 00:02:45,107 >> loading configuration file https://huggingface.co/bert-base-uncased/resolve/main/config.json from cache at .cache/3c61d016573b14f7f008c02c4e51a366c67ab274726fe2910691e2a761acf43e.37395cee442ab11005bcd270f3c34464dc1704b715b5d7d52b1a461abe3b9e4e
[INFO|configuration_utils.py:481] 2022-08-27 00:02:45,108 >> Model config BertConfig {
"architectures": [
"BertForMaskedLM"
],
"attention_probs_dropout_prob": 0.1,
"gradient_checkpointing": false,
"hidden_act": "gelu",
"hidden_dropout_prob": 0.1,
"hidden_size": 768,
"initializer_range": 0.02,
"intermediate_size": 3072,
"layer_norm_eps": 1e-12,
"max_position_embeddings": 512,
"model_type": "bert",
"num_attention_heads": 12,
"num_hidden_layers": 12,
"pad_token_id": 0,
"position_embedding_type": "absolute",
"transformers_version": "4.2.1",
"type_vocab_size": 2,
"use_cache": true,
"vocab_size": 30522
}
[INFO|tokenization_utils_base.py:1766] 2022-08-27 00:02:45,697 >> loading file https://huggingface.co/bert-base-uncased/resolve/main/vocab.txt from cache at .cache/45c3f7a79a80e1cf0a489e5c62b43f173c15db47864303a55d623bb3c96f72a5.d789d64ebfe299b0e416afc4a169632f903f693095b4629a7ea271d5a0cf2c99
[INFO|tokenization_utils_base.py:1766] 2022-08-27 00:02:45,697 >> loading file https://huggingface.co/bert-base-uncased/resolve/main/tokenizer.json from cache at .cache/534479488c54aeaf9c3406f647aa2ec13648c06771ffe269edabebd4c412da1d.7f2721073f19841be16f41b0a70b600ca6b880c8f3df6f3535cbc704371bdfa4
[INFO|modeling_utils.py:1027] 2022-08-27 00:02:46,093 >> loading weights file https://huggingface.co/bert-base-uncased/resolve/main/pytorch_model.bin from cache at .cache/a8041bf617d7f94ea26d15e218abd04afc2004805632abc0ed2066aa16d50d04.faf6ea826ae9c5867d12b22257f9877e6b8367890837bd60f7c54a29633f7f2f
Some weights of the model checkpoint at bert-base-uncased were not used when initializing BertForMabel: ['cls.predictions.bias', 'cls.predictions.transform.dense.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.decoder.weight', 'cls.seq_relationship.weight', 'cls.seq_relationship.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.LayerNorm.bias', 'bert.pooler.dense.weight', 'bert.pooler.dense.bias']
- This IS expected if you are initializing BertForMabel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
- This IS NOT expected if you are initializing BertForMabel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
Some weights of the model checkpoint at bert-base-uncased were not used when initializing BertForMabel: ['cls.predictions.bias', 'cls.predictions.transform.dense.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.decoder.weight', 'cls.seq_relationship.weight', 'cls.seq_relationship.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.LayerNorm.bias', 'bert.pooler.dense.weight', 'bert.pooler.dense.bias']
- This IS expected if you are initializing BertForMabel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
- This IS NOT expected if you are initializing BertForMabel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
Some weights of BertForMabel were not initialized from the model checkpoint at bert-base-uncased and are newly initialized: ['lm_head.bias', 'lm_head.transform.dense.weight', 'lm_head.transform.dense.bias', 'lm_head.transform.LayerNorm.weight', 'lm_head.transform.LayerNorm.bias', 'lm_head.decoder.weight', 'lm_head.decoder.bias', 'mlp.dense1.weight', 'mlp.dense1.bias', 'mlp.dense2.weight', 'mlp.dense2.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
Some weights of BertForMabel were not initialized from the model checkpoint at bert-base-uncased and are newly initialized: ['lm_head.bias', 'lm_head.transform.dense.weight', 'lm_head.transform.dense.bias', 'lm_head.transform.LayerNorm.weight', 'lm_head.transform.LayerNorm.bias', 'lm_head.decoder.weight', 'lm_head.decoder.bias', 'mlp.dense1.weight', 'mlp.dense1.bias', 'mlp.dense2.weight', 'mlp.dense2.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
[WARNING|modeling_utils.py:1135] 2022-08-27 00:02:55,669 >> Some weights of the model checkpoint at bert-base-uncased were not used when initializing BertForMabel: ['cls.predictions.bias', 'cls.predictions.transform.dense.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.decoder.weight', 'cls.seq_relationship.weight', 'cls.seq_relationship.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.LayerNorm.bias', 'bert.pooler.dense.weight', 'bert.pooler.dense.bias']
- This IS expected if you are initializing BertForMabel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
- This IS NOT expected if you are initializing BertForMabel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
[WARNING|modeling_utils.py:1146] 2022-08-27 00:02:55,669 >> Some weights of BertForMabel were not initialized from the model checkpoint at bert-base-uncased and are newly initialized: ['lm_head.bias', 'lm_head.transform.dense.weight', 'lm_head.transform.dense.bias', 'lm_head.transform.LayerNorm.weight', 'lm_head.transform.LayerNorm.bias', 'lm_head.decoder.weight', 'lm_head.decoder.bias', 'mlp.dense1.weight', 'mlp.dense1.bias', 'mlp.dense2.weight', 'mlp.dense2.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
Some weights of the model checkpoint at bert-base-uncased were not used when initializing BertForMabel: ['cls.predictions.bias', 'cls.predictions.transform.dense.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.decoder.weight', 'cls.seq_relationship.weight', 'cls.seq_relationship.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.LayerNorm.bias', 'bert.pooler.dense.weight', 'bert.pooler.dense.bias']
- This IS expected if you are initializing BertForMabel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
- This IS NOT expected if you are initializing BertForMabel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
Some weights of BertForMabel were not initialized from the model checkpoint at bert-base-uncased and are newly initialized: ['lm_head.bias', 'lm_head.transform.dense.weight', 'lm_head.transform.dense.bias', 'lm_head.transform.LayerNorm.weight', 'lm_head.transform.LayerNorm.bias', 'lm_head.decoder.weight', 'lm_head.decoder.bias', 'mlp.dense1.weight', 'mlp.dense1.bias', 'mlp.dense2.weight', 'mlp.dense2.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
[INFO|configuration_utils.py:445] 2022-08-27 00:02:55,967 >> loading configuration file https://huggingface.co/bert-base-uncased/resolve/main/config.json from cache at .cache/3c61d016573b14f7f008c02c4e51a366c67ab274726fe2910691e2a761acf43e.37395cee442ab11005bcd270f3c34464dc1704b715b5d7d52b1a461abe3b9e4e
[INFO|configuration_utils.py:481] 2022-08-27 00:02:55,968 >> Model config BertConfig {
"architectures": [
"BertForMaskedLM"
],
"attention_probs_dropout_prob": 0.1,
"gradient_checkpointing": false,
"hidden_act": "gelu",
"hidden_dropout_prob": 0.1,
"hidden_size": 768,
"initializer_range": 0.02,
"intermediate_size": 3072,
"layer_norm_eps": 1e-12,
"max_position_embeddings": 512,
"model_type": "bert",
"num_attention_heads": 12,
"num_hidden_layers": 12,
"pad_token_id": 0,
"position_embedding_type": "absolute",
"transformers_version": "4.2.1",
"type_vocab_size": 2,
"use_cache": true,
"vocab_size": 30522
}
[INFO|modeling_utils.py:1027] 2022-08-27 00:02:56,268 >> loading weights file https://huggingface.co/bert-base-uncased/resolve/main/pytorch_model.bin from cache at .cache/a8041bf617d7f94ea26d15e218abd04afc2004805632abc0ed2066aa16d50d04.faf6ea826ae9c5867d12b22257f9877e6b8367890837bd60f7c54a29633f7f2f
Some weights of BertForPreTraining were not initialized from the model checkpoint at bert-base-uncased and are newly initialized: ['cls.predictions.decoder.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
[INFO|modeling_utils.py:1143] 2022-08-27 00:03:05,402 >> All model checkpoint weights were used when initializing BertForPreTraining.
[WARNING|modeling_utils.py:1146] 2022-08-27 00:03:05,415 >> Some weights of BertForPreTraining were not initialized from the model checkpoint at bert-base-uncased and are newly initialized: ['cls.predictions.decoder.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
Some weights of BertForPreTraining were not initialized from the model checkpoint at bert-base-uncased and are newly initialized: ['cls.predictions.decoder.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
Some weights of BertForPreTraining were not initialized from the model checkpoint at bert-base-uncased and are newly initialized: ['cls.predictions.decoder.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
08/27/2022 00:03:05 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at .cache/csv/default-2f6794b69ce47e79/0.0.0/652c3096f041ee27b04d2232d41f10547a8fecda3e284a79a0ec4053c916ef7a/cache-51922e954a887dd0.arrow
08/27/2022 00:03:05 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at .cache/csv/default-2f6794b69ce47e79/0.0.0/652c3096f041ee27b04d2232d41f10547a8fecda3e284a79a0ec4053c916ef7a/cache-51922e954a887dd0.arrow
08/27/2022 00:03:05 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at .cache/csv/default-2f6794b69ce47e79/0.0.0/652c3096f041ee27b04d2232d41f10547a8fecda3e284a79a0ec4053c916ef7a/cache-51922e954a887dd0.arrow
08/27/2022 00:03:05 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at .cache/csv/default-2f6794b69ce47e79/0.0.0/652c3096f041ee27b04d2232d41f10547a8fecda3e284a79a0ec4053c916ef7a/cache-51922e954a887dd0.arrow
Dataset({
features: ['bin_mask', 'input_ids', 'token_type_ids', 'attention_mask'],
num_rows: 142158
})Dataset({
features: ['bin_mask', 'input_ids', 'token_type_ids', 'attention_mask'],
num_rows: 142158
})Dataset({
features: ['bin_mask', 'input_ids', 'token_type_ids', 'attention_mask'],
num_rows: 142158
})Dataset({
features: ['bin_mask', 'input_ids', 'token_type_ids', 'attention_mask'],
num_rows: 142158
})
[INFO|trainer.py:442] 2022-08-27 00:03:19,523 >> The following columns in the training set don't have a corresponding argument in `BertForMabel.forward` and have been ignored: .
[INFO|trainer.py:358] 2022-08-27 00:03:19,528 >> Using amp fp16 backend
08/27/2022 00:03:20 - INFO - trainer - ***** Running training *****
08/27/2022 00:03:20 - INFO - trainer - Num examples = 142158
08/27/2022 00:03:20 - INFO - trainer - Num Epochs = 2
08/27/2022 00:03:20 - INFO - trainer - Instantaneous batch size per device = 32
08/27/2022 00:03:20 - INFO - trainer - Total train batch size (w. parallel, distributed & accumulation) = 128
08/27/2022 00:03:20 - INFO - trainer - Gradient Accumulation steps = 1
08/27/2022 00:03:20 - INFO - trainer - Total optimization steps = 2222
0%| | 0/2222 [00:00<?, ?it/s][W reducer.cpp:1303] Warning: find_unused_parameters=True was specified in DDP constructor, but did not find any unused parameters in the forward pass. This flag results in an extra traversal of the autograd graph every iteration, which can adversely affect performance. If your model indeed never has any unused parameters in the forward pass, consider turning this flag off. Note that this warning may be a false positive if your model has flow control causing later iterations to have unused parameters. (function operator())
[W reducer.cpp:1303] Warning: find_unused_parameters=True was specified in DDP constructor, but did not find any unused parameters in the forward pass. This flag results in an extra traversal of the autograd graph every iteration, which can adversely affect performance. If your model indeed never has any unused parameters in the forward pass, consider turning this flag off. Note that this warning may be a false positive if your model has flow control causing later iterations to have unused parameters. (function operator())
[W reducer.cpp:1303] Warning: find_unused_parameters=True was specified in DDP constructor, but did not find any unused parameters in the forward pass. This flag results in an extra traversal of the autograd graph every iteration, which can adversely affect performance. If your model indeed never has any unused parameters in the forward pass, consider turning this flag off. Note that this warning may be a false positive if your model has flow control causing later iterations to have unused parameters. (function operator())
[W reducer.cpp:1303] Warning: find_unused_parameters=True was specified in DDP constructor, but did not find any unused parameters in the forward pass. This flag results in an extra traversal of the autograd graph every iteration, which can adversely affect performance. If your model indeed never has any unused parameters in the forward pass, consider turning this flag off. Note that this warning may be a false positive if your model has flow control causing later iterations to have unused parameters. (function operator())
/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/optim/lr_scheduler.py:134: UserWarning: Detected call of `lr_scheduler.step()` before `optimizer.step()`. In PyTorch 1.1.0 and later, you should call them in the opposite order: `optimizer.step()` before `lr_scheduler.step()`. Failure to do this will result in PyTorch skipping the first value of the learning rate schedule. See more details at https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate
"https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate", UserWarning)
/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/optim/lr_scheduler.py:134: UserWarning: Detected call of `lr_scheduler.step()` before `optimizer.step()`. In PyTorch 1.1.0 and later, you should call them in the opposite order: `optimizer.step()` before `lr_scheduler.step()`. Failure to do this will result in PyTorch skipping the first value of the learning rate schedule. See more details at https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate
"https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate", UserWarning)
/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/optim/lr_scheduler.py:134: UserWarning: Detected call of `lr_scheduler.step()` before `optimizer.step()`. In PyTorch 1.1.0 and later, you should call them in the opposite order: `optimizer.step()` before `lr_scheduler.step()`. Failure to do this will result in PyTorch skipping the first value of the learning rate schedule. See more details at https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate
"https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate", UserWarning)
/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/optim/lr_scheduler.py:134: UserWarning: Detected call of `lr_scheduler.step()` before `optimizer.step()`. In PyTorch 1.1.0 and later, you should call them in the opposite order: `optimizer.step()` before `lr_scheduler.step()`. Failure to do this will result in PyTorch skipping the first value of the learning rate schedule. See more details at https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate
"https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate", UserWarning)
0%| | 1/2222 [00:01<59:49, 1.62s/it]
0%| | 2/2222 [00:02<46:30, 1.26s/it]
0%| | 3/2222 [00:03<42:58, 1.16s/it]
0%| | 4/2222 [00:04<40:42, 1.10s/it]
0%| | 5/2222 [00:05<39:36, 1.07s/it]
0%| | 6/2222 [00:06<39:03, 1.06s/it]
0%| | 7/2222 [00:07<38:24, 1.04s/it]
0%| | 8/2222 [00:08<38:52, 1.05s/it]
0%| | 9/2222 [00:09<39:07, 1.06s/it]
0%| | 10/2222 [00:11<39:40, 1.08s/it]
0%| | 11/2222 [00:12<39:47, 1.08s/it]
1%| | 12/2222 [00:13<40:08, 1.09s/it]
1%| | 13/2222 [00:14<40:08, 1.09s/it]
1%| | 14/2222 [00:15<40:06, 1.09s/it]
1%| | 15/2222 [00:16<40:08, 1.09s/it]
1%| | 16/2222 [00:17<40:08, 1.09s/it]
1%| | 17/2222 [00:18<39:47, 1.08s/it]
1%| | 18/2222 [00:19<39:47, 1.08s/it]
1%| | 19/2222 [00:20<39:38, 1.08s/it]
1%| | 20/2222 [00:21<39:46, 1.08s/it]
1%| | 21/2222 [00:22<39:11, 1.07s/it]
1%| | 22/2222 [00:23<39:20, 1.07s/it]
1%| | 23/2222 [00:25<42:53, 1.17s/it]
1%| | 24/2222 [00:26<41:44, 1.14s/it]
1%| | 25/2222 [00:27<40:55, 1.12s/it]
1%| | 26/2222 [00:28<40:22, 1.10s/it]
1%| | 27/2222 [00:29<40:15, 1.10s/it]
1%|▏ | 28/2222 [00:30<40:07, 1.10s/it]
1%|▏ | 29/2222 [00:31<39:37, 1.08s/it]
1%|▏ | 30/2222 [00:32<39:38, 1.08s/it]
1%|▏ | 31/2222 [00:34<39:50, 1.09s/it]
1%|▏ | 32/2222 [00:35<39:15, 1.08s/it]
1%|▏ | 33/2222 [00:36<39:20, 1.08s/it]
2%|▏ | 34/2222 [00:37<39:33, 1.08s/it]
2%|▏ | 35/2222 [00:38<39:14, 1.08s/it]
2%|▏ | 36/2222 [00:39<39:13, 1.08s/it]
2%|▏ | 37/2222 [00:40<39:22, 1.08s/it]
2%|▏ | 38/2222 [00:41<39:21, 1.08s/it]
2%|▏ | 39/2222 [00:42<39:24, 1.08s/it]
2%|▏ | 40/2222 [00:43<39:42, 1.09s/it]
2%|▏ | 41/2222 [00:44<39:17, 1.08s/it]
2%|▏ | 42/2222 [00:45<39:26, 1.09s/it]
2%|▏ | 43/2222 [00:46<39:04, 1.08s/it]
2%|▏ | 44/2222 [00:48<39:02, 1.08s/it]
2%|▏ | 45/2222 [00:49<38:56, 1.07s/it]
2%|▏ | 46/2222 [00:50<39:01, 1.08s/it]
2%|▏ | 47/2222 [00:51<39:07, 1.08s/it]
2%|▏ | 48/2222 [00:52<39:24, 1.09s/it]
2%|▏ | 49/2222 [00:53<39:08, 1.08s/it]
2%|▏ | 50/2222 [00:54<38:46, 1.07s/it]
2%|▏ | 51/2222 [00:55<39:06, 1.08s/it]
2%|▏ | 52/2222 [00:56<38:54, 1.08s/it]
2%|▏ | 53/2222 [00:57<39:11, 1.08s/it]
2%|▏ | 54/2222 [00:58<39:10, 1.08s/it]
2%|▏ | 55/2222 [00:59<38:56, 1.08s/it]
3%|▎ | 56/2222 [01:00<38:49, 1.08s/it]
3%|▎ | 57/2222 [01:02<39:11, 1.09s/it]
3%|▎ | 58/2222 [01:03<39:11, 1.09s/it]
3%|▎ | 59/2222 [01:04<39:09, 1.09s/it]
3%|▎ | 60/2222 [01:05<38:54, 1.08s/it]
3%|▎ | 61/2222 [01:06<38:49, 1.08s/it]
3%|▎ | 62/2222 [01:07<38:33, 1.07s/it]
3%|▎ | 63/2222 [01:08<38:36, 1.07s/it]
3%|▎ | 64/2222 [01:09<38:42, 1.08s/it]
3%|▎ | 65/2222 [01:10<38:46, 1.08s/it]
3%|▎ | 66/2222 [01:11<38:59, 1.09s/it]
3%|▎ | 67/2222 [01:12<38:35, 1.07s/it]
3%|▎ | 68/2222 [01:13<38:21, 1.07s/it]
3%|▎ | 69/2222 [01:14<38:21, 1.07s/it]
3%|▎ | 70/2222 [01:16<38:23, 1.07s/it]
3%|▎ | 71/2222 [01:17<38:39, 1.08s/it]
3%|▎ | 72/2222 [01:18<38:32, 1.08s/it]
3%|▎ | 73/2222 [01:19<38:20, 1.07s/it]
3%|▎ | 74/2222 [01:20<38:17, 1.07s/it]
3%|▎ | 75/2222 [01:21<38:08, 1.07s/it]
3%|▎ | 76/2222 [01:22<38:10, 1.07s/it]
3%|▎ | 77/2222 [01:23<38:30, 1.08s/it]
4%|▎ | 78/2222 [01:24<38:17, 1.07s/it]
4%|▎ | 79/2222 [01:25<38:20, 1.07s/it]
4%|▎ | 80/2222 [01:26<38:27, 1.08s/it]
4%|▎ | 81/2222 [01:27<38:35, 1.08s/it]
4%|▎ | 82/2222 [01:28<38:17, 1.07s/it]
4%|▎ | 83/2222 [01:30<38:20, 1.08s/it]
4%|▍ | 84/2222 [01:31<38:58, 1.09s/it]
4%|▍ | 85/2222 [01:32<39:00, 1.10s/it]
4%|▍ | 86/2222 [01:33<38:32, 1.08s/it]
4%|▍ | 87/2222 [01:34<38:38, 1.09s/it]
4%|▍ | 88/2222 [01:35<38:17, 1.08s/it]
4%|▍ | 89/2222 [01:36<38:14, 1.08s/it]
4%|▍ | 90/2222 [01:37<38:30, 1.08s/it]
4%|▍ | 91/2222 [01:38<38:31, 1.08s/it]
4%|▍ | 92/2222 [01:39<38:28, 1.08s/it]
4%|▍ | 93/2222 [01:40<38:28, 1.08s/it]
4%|▍ | 94/2222 [01:41<37:56, 1.07s/it]
4%|▍ | 95/2222 [01:43<38:05, 1.07s/it]
4%|▍ | 96/2222 [01:44<37:35, 1.06s/it]
4%|▍ | 97/2222 [01:45<38:02, 1.07s/it]
4%|▍ | 98/2222 [01:46<37:46, 1.07s/it]
4%|▍ | 99/2222 [01:47<38:22, 1.08s/it]
5%|▍ | 100/2222 [01:48<38:31, 1.09s/it]
5%|▍ | 101/2222 [01:49<37:59, 1.07s/it]
5%|▍ | 102/2222 [01:50<37:55, 1.07s/it]
5%|▍ | 103/2222 [01:51<38:00, 1.08s/it]
5%|▍ | 104/2222 [01:52<37:54, 1.07s/it]
5%|▍ | 105/2222 [01:53<37:48, 1.07s/it]
5%|▍ | 106/2222 [01:54<37:56, 1.08s/it]
5%|▍ | 107/2222 [01:55<37:34, 1.07s/it]
5%|▍ | 108/2222 [01:56<38:02, 1.08s/it]
5%|▍ | 109/2222 [01:58<38:02, 1.08s/it]
5%|▍ | 110/2222 [01:59<37:53, 1.08s/it]
5%|▍ | 111/2222 [02:00<38:18, 1.09s/it]
5%|▌ | 112/2222 [02:01<37:48, 1.07s/it]
5%|▌ | 113/2222 [02:02<37:33, 1.07s/it]
5%|▌ | 114/2222 [02:03<37:25, 1.07s/it]
5%|▌ | 115/2222 [02:04<37:32, 1.07s/it]
5%|▌ | 116/2222 [02:05<37:44, 1.08s/it]
5%|▌ | 117/2222 [02:06<37:33, 1.07s/it]
5%|▌ | 118/2222 [02:07<37:24, 1.07s/it]
5%|▌ | 119/2222 [02:08<37:33, 1.07s/it]
5%|▌ | 120/2222 [02:09<37:03, 1.06s/it]
5%|▌ | 121/2222 [02:10<37:16, 1.06s/it]
5%|▌ | 122/2222 [02:11<37:18, 1.07s/it]
6%|▌ | 123/2222 [02:13<37:09, 1.06s/it]
6%|▌ | 124/2222 [02:14<37:24, 1.07s/it]
6%|▌ | 125/2222 [02:15<37:49, 1.08s/it]
6%|▌ | 126/2222 [02:16<37:55, 1.09s/it]
6%|▌ | 127/2222 [02:17<38:12, 1.09s/it]
6%|▌ | 128/2222 [02:18<38:03, 1.09s/it]
6%|▌ | 129/2222 [02:19<38:05, 1.09s/it]
6%|▌ | 130/2222 [02:20<38:08, 1.09s/it]
6%|▌ | 131/2222 [02:21<37:28, 1.08s/it]
6%|▌ | 132/2222 [02:22<37:35, 1.08s/it]
6%|▌ | 133/2222 [02:23<37:30, 1.08s/it]
6%|▌ | 134/2222 [02:24<37:43, 1.08s/it]
6%|▌ | 135/2222 [02:26<37:49, 1.09s/it]
6%|▌ | 136/2222 [02:27<37:59, 1.09s/it]
6%|▌ | 137/2222 [02:28<37:53, 1.09s/it]
6%|▌ | 138/2222 [02:29<37:45, 1.09s/it]
6%|▋ | 139/2222 [02:30<37:40, 1.09s/it]
6%|▋ | 140/2222 [02:31<37:25, 1.08s/it]
6%|▋ | 141/2222 [02:32<38:01, 1.10s/it]
6%|▋ | 142/2222 [02:33<37:55, 1.09s/it]
6%|▋ | 143/2222 [02:34<37:38, 1.09s/it]
6%|▋ | 144/2222 [02:35<37:44, 1.09s/it]
7%|▋ | 145/2222 [02:36<37:51, 1.09s/it]
7%|▋ | 146/2222 [02:38<37:43, 1.09s/it]
7%|▋ | 147/2222 [02:39<38:09, 1.10s/it]
7%|▋ | 148/2222 [02:40<37:39, 1.09s/it]
7%|▋ | 149/2222 [02:41<37:28, 1.08s/it]
7%|▋ | 150/2222 [02:42<37:16, 1.08s/it]
7%|▋ | 151/2222 [02:43<37:21, 1.08s/it]
7%|▋ | 152/2222 [02:44<37:09, 1.08s/it]
7%|▋ | 153/2222 [02:45<37:02, 1.07s/it]
7%|▋ | 154/2222 [02:46<37:27, 1.09s/it]
7%|▋ | 155/2222 [02:47<37:03, 1.08s/it]
7%|▋ | 156/2222 [02:48<37:13, 1.08s/it]
7%|▋ | 157/2222 [02:49<37:01, 1.08s/it]
7%|▋ | 158/2222 [02:51<37:16, 1.08s/it]
7%|▋ | 159/2222 [02:52<36:50, 1.07s/it]
7%|▋ | 160/2222 [02:53<37:02, 1.08s/it]
7%|▋ | 161/2222 [02:54<37:05, 1.08s/it]
7%|▋ | 162/2222 [02:55<37:15, 1.09s/it]
7%|▋ | 163/2222 [02:56<36:57, 1.08s/it]
7%|▋ | 164/2222 [02:57<36:48, 1.07s/it]
7%|▋ | 165/2222 [02:58<36:37, 1.07s/it]
7%|▋ | 166/2222 [02:59<36:30, 1.07s/it]
8%|▊ | 167/2222 [03:00<36:30, 1.07s/it]
8%|▊ | 168/2222 [03:01<36:23, 1.06s/it]
8%|▊ | 169/2222 [03:02<36:35, 1.07s/it]
8%|▊ | 170/2222 [03:03<36:19, 1.06s/it]
8%|▊ | 171/2222 [03:04<36:26, 1.07s/it]
8%|▊ | 172/2222 [03:06<36:37, 1.07s/it]
8%|▊ | 173/2222 [03:07<36:36, 1.07s/it]
8%|▊ | 174/2222 [03:08<36:47, 1.08s/it]
8%|▊ | 175/2222 [03:09<36:56, 1.08s/it]
8%|▊ | 176/2222 [03:10<36:27, 1.07s/it]
8%|▊ | 177/2222 [03:11<36:36, 1.07s/it]
8%|▊ | 178/2222 [03:12<36:45, 1.08s/it]
8%|▊ | 179/2222 [03:13<36:31, 1.07s/it]
8%|▊ | 180/2222 [03:14<36:08, 1.06s/it]
8%|▊ | 181/2222 [03:15<36:31, 1.07s/it]
8%|▊ | 182/2222 [03:16<36:36, 1.08s/it]
8%|▊ | 183/2222 [03:17<36:51, 1.08s/it]
8%|▊ | 184/2222 [03:18<36:44, 1.08s/it]
8%|▊ | 185/2222 [03:20<36:38, 1.08s/it]
8%|▊ | 186/2222 [03:21<36:29, 1.08s/it]
8%|▊ | 187/2222 [03:22<36:27, 1.07s/it]
8%|▊ | 188/2222 [03:23<36:29, 1.08s/it]
9%|▊ | 189/2222 [03:24<36:41, 1.08s/it]
9%|▊ | 190/2222 [03:25<36:23, 1.07s/it]
9%|▊ | 191/2222 [03:26<36:36, 1.08s/it]
9%|▊ | 192/2222 [03:27<36:09, 1.07s/it]
9%|▊ | 193/2222 [03:28<36:25, 1.08s/it]
9%|▊ | 194/2222 [03:29<36:30, 1.08s/it]
9%|▉ | 195/2222 [03:30<36:25, 1.08s/it]
9%|▉ | 196/2222 [03:31<36:18, 1.08s/it]
9%|▉ | 197/2222 [03:32<36:30, 1.08s/it]
9%|▉ | 198/2222 [03:34<36:21, 1.08s/it]
9%|▉ | 199/2222 [03:35<36:15, 1.08s/it]
9%|▉ | 200/2222 [03:36<36:21, 1.08s/it]
9%|▉ | 201/2222 [03:37<36:37, 1.09s/it]
9%|▉ | 202/2222 [03:38<36:17, 1.08s/it]
9%|▉ | 203/2222 [03:39<36:44, 1.09s/it]
9%|▉ | 204/2222 [03:40<36:37, 1.09s/it]
9%|▉ | 205/2222 [03:41<36:04, 1.07s/it]
9%|▉ | 206/2222 [03:42<35:47, 1.07s/it]
9%|▉ | 207/2222 [03:43<36:02, 1.07s/it]
9%|▉ | 208/2222 [03:44<36:11, 1.08s/it]
9%|▉ | 209/2222 [03:45<36:32, 1.09s/it]
9%|▉ | 210/2222 [03:46<36:11, 1.08s/it]
9%|▉ | 211/2222 [03:48<36:00, 1.07s/it]
10%|▉ | 212/2222 [03:49<35:35, 1.06s/it]
10%|▉ | 213/2222 [03:50<35:53, 1.07s/it]
10%|▉ | 214/2222 [03:51<35:59, 1.08s/it]
10%|▉ | 215/2222 [03:52<35:55, 1.07s/it]
10%|▉ | 216/2222 [03:53<35:44, 1.07s/it]
10%|▉ | 217/2222 [03:54<35:35, 1.07s/it]
10%|▉ | 218/2222 [03:55<35:48, 1.07s/it]
10%|▉ | 219/2222 [03:56<36:01, 1.08s/it]
10%|▉ | 220/2222 [03:57<35:56, 1.08s/it]
10%|▉ | 221/2222 [03:58<35:44, 1.07s/it]
10%|▉ | 222/2222 [03:59<35:31, 1.07s/it]
10%|█ | 223/2222 [04:00<35:48, 1.07s/it]
10%|█ | 224/2222 [04:01<35:39, 1.07s/it]
10%|█ | 225/2222 [04:03<35:55, 1.08s/it]
10%|█ | 226/2222 [04:04<35:58, 1.08s/it]
10%|█ | 227/2222 [04:05<36:04, 1.08s/it]
10%|█ | 228/2222 [04:06<35:51, 1.08s/it]
10%|█ | 229/2222 [04:07<35:38, 1.07s/it]
10%|█ | 230/2222 [04:08<35:36, 1.07s/it]
10%|█ | 231/2222 [04:09<35:32, 1.07s/it]
10%|█ | 232/2222 [04:10<35:36, 1.07s/it]
10%|█ | 233/2222 [04:11<35:24, 1.07s/it]
11%|█ | 234/2222 [04:12<35:25, 1.07s/it]
11%|█ | 235/2222 [04:13<35:56, 1.09s/it]
11%|█ | 236/2222 [04:14<35:48, 1.08s/it]
11%|█ | 237/2222 [04:16<36:01, 1.09s/it]
11%|█ | 238/2222 [04:17<35:45, 1.08s/it]
11%|█ | 239/2222 [04:18<35:48, 1.08s/it]
11%|█ | 240/2222 [04:19<35:44, 1.08s/it]
11%|█ | 241/2222 [04:20<35:49, 1.09s/it]
11%|█ | 242/2222 [04:21<35:46, 1.08s/it]
11%|█ | 243/2222 [04:22<36:00, 1.09s/it]
11%|█ | 244/2222 [04:23<35:42, 1.08s/it]
11%|█ | 245/2222 [04:24<35:40, 1.08s/it]
11%|█ | 246/2222 [04:25<35:32, 1.08s/it]
11%|█ | 247/2222 [04:26<35:17, 1.07s/it]
11%|█ | 248/2222 [04:27<35:33, 1.08s/it]
11%|█ | 249/2222 [04:28<35:07, 1.07s/it]
11%|█▏ | 250/2222 [04:30<35:06, 1.07s/it]
11%|█▏ | 251/2222 [04:31<35:13, 1.07s/it]
11%|█▏ | 252/2222 [04:32<35:27, 1.08s/it]
11%|█▏ | 253/2222 [04:33<35:29, 1.08s/it]
11%|█▏ | 254/2222 [04:34<35:27, 1.08s/it]
11%|█▏ | 255/2222 [04:35<35:55, 1.10s/it]
12%|█▏ | 256/2222 [04:36<35:43, 1.09s/it]
12%|█▏ | 257/2222 [04:37<35:35, 1.09s/it]
12%|█▏ | 258/2222 [04:38<35:22, 1.08s/it]
12%|█▏ | 259/2222 [04:39<35:13, 1.08s/it]
12%|█▏ | 260/2222 [04:40<35:19, 1.08s/it]
12%|█▏ | 261/2222 [04:41<35:11, 1.08s/it]
12%|█▏ | 262/2222 [04:42<35:01, 1.07s/it]
12%|█▏ | 263/2222 [04:44<34:58, 1.07s/it]
12%|█▏ | 264/2222 [04:45<35:13, 1.08s/it]
12%|█▏ | 265/2222 [04:46<35:25, 1.09s/it]
12%|█▏ | 266/2222 [04:47<35:21, 1.08s/it]
12%|█▏ | 267/2222 [04:48<35:16, 1.08s/it]
12%|█▏ | 268/2222 [04:49<35:02, 1.08s/it]
12%|█▏ | 269/2222 [04:50<35:01, 1.08s/it]
12%|█▏ | 270/2222 [04:51<35:12, 1.08s/it]
12%|█▏ | 271/2222 [04:52<35:03, 1.08s/it]
12%|█▏ | 272/2222 [04:53<35:09, 1.08s/it]
12%|█▏ | 273/2222 [04:54<35:05, 1.08s/it]
12%|█▏ | 274/2222 [04:55<34:56, 1.08s/it]
12%|█▏ | 275/2222 [04:57<34:55, 1.08s/it]
12%|█▏ | 276/2222 [04:58<34:47, 1.07s/it]
12%|█▏ | 277/2222 [04:59<34:46, 1.07s/it]
13%|█▎ | 278/2222 [05:00<34:52, 1.08s/it]
13%|█▎ | 279/2222 [05:01<34:36, 1.07s/it]
13%|█▎ | 280/2222 [05:02<34:32, 1.07s/it]
13%|█▎ | 281/2222 [05:03<34:49, 1.08s/it]
13%|█▎ | 282/2222 [05:04<34:52, 1.08s/it]
13%|█▎ | 283/2222 [05:05<34:55, 1.08s/it]
13%|█▎ | 284/2222 [05:06<35:07, 1.09s/it]
13%|█▎ | 285/2222 [05:07<35:14, 1.09s/it]
13%|█▎ | 286/2222 [05:08<35:10, 1.09s/it]
13%|█▎ | 287/2222 [05:10<35:04, 1.09s/it]
13%|█▎ | 288/2222 [05:11<34:45, 1.08s/it]
13%|█▎ | 289/2222 [05:12<34:42, 1.08s/it]
13%|█▎ | 290/2222 [05:13<34:29, 1.07s/it]
13%|█▎ | 291/2222 [05:14<34:30, 1.07s/it]
13%|█▎ | 292/2222 [05:15<34:40, 1.08s/it]
13%|█▎ | 293/2222 [05:16<34:39, 1.08s/it]
13%|█▎ | 294/2222 [05:17<34:49, 1.08s/it]
13%|█▎ | 295/2222 [05:18<34:52, 1.09s/it]
13%|█▎ | 296/2222 [05:19<34:36, 1.08s/it]
13%|█▎ | 297/2222 [05:20<34:25, 1.07s/it]
13%|█▎ | 298/2222 [05:21<33:46, 1.05s/it]
13%|█▎ | 299/2222 [05:22<34:05, 1.06s/it]
14%|█▎ | 300/2222 [05:23<34:14, 1.07s/it]
14%|█▎ | 301/2222 [05:25<34:21, 1.07s/it]
14%|█▎ | 302/2222 [05:26<34:11, 1.07s/it]
14%|█▎ | 303/2222 [05:27<34:23, 1.08s/it]
14%|█▎ | 304/2222 [05:28<34:13, 1.07s/it]
14%|█▎ | 305/2222 [05:29<34:25, 1.08s/it]
14%|█▍ | 306/2222 [05:30<34:40, 1.09s/it]
14%|█▍ | 307/2222 [05:31<34:30, 1.08s/it]
14%|█▍ | 308/2222 [05:32<34:41, 1.09s/it]
14%|█▍ | 309/2222 [05:33<34:33, 1.08s/it]
14%|█▍ | 310/2222 [05:34<34:24, 1.08s/it]
14%|█▍ | 311/2222 [05:35<34:16, 1.08s/it]
14%|█▍ | 312/2222 [05:36<34:19, 1.08s/it]
14%|█▍ | 313/2222 [05:37<34:28, 1.08s/it]
14%|█▍ | 314/2222 [05:39<34:27, 1.08s/it]
14%|█▍ | 315/2222 [05:40<34:18, 1.08s/it]
14%|█▍ | 316/2222 [05:41<34:10, 1.08s/it]
14%|█▍ | 317/2222 [05:42<33:45, 1.06s/it]
14%|█▍ | 318/2222 [05:43<34:04, 1.07s/it]
14%|█▍ | 319/2222 [05:44<33:51, 1.07s/it]
14%|█▍ | 320/2222 [05:45<34:21, 1.08s/it]
14%|█▍ | 321/2222 [05:46<34:14, 1.08s/it]
14%|█▍ | 322/2222 [05:47<34:12, 1.08s/it]
15%|█▍ | 323/2222 [05:48<33:58, 1.07s/it]
15%|█▍ | 324/2222 [05:49<34:00, 1.07s/it]
15%|█▍ | 325/2222 [05:50<33:47, 1.07s/it]
15%|█▍ | 326/2222 [05:51<33:33, 1.06s/it]
15%|█▍ | 327/2222 [05:52<33:42, 1.07s/it]
15%|█▍ | 328/2222 [05:54<33:31, 1.06s/it]
15%|█▍ | 329/2222 [05:55<34:00, 1.08s/it]
15%|█▍ | 330/2222 [05:56<34:00, 1.08s/it]
15%|█▍ | 331/2222 [05:57<33:55, 1.08s/it]
15%|█▍ | 332/2222 [05:58<33:39, 1.07s/it]
15%|█▍ | 333/2222 [05:59<33:44, 1.07s/it]
15%|█▌ | 334/2222 [06:00<33:33, 1.07s/it]
15%|█▌ | 335/2222 [06:01<33:41, 1.07s/it]
15%|█▌ | 336/2222 [06:02<33:35, 1.07s/it]
15%|█▌ | 337/2222 [06:03<33:40, 1.07s/it]
15%|█▌ | 338/2222 [06:04<33:42, 1.07s/it]
15%|█▌ | 339/2222 [06:05<33:48, 1.08s/it]
15%|█▌ | 340/2222 [06:06<33:48, 1.08s/it]
15%|█▌ | 341/2222 [06:08<33:54, 1.08s/it]
15%|█▌ | 342/2222 [06:09<33:57, 1.08s/it]
15%|█▌ | 343/2222 [06:10<33:54, 1.08s/it]
15%|█▌ | 344/2222 [06:11<33:48, 1.08s/it]
16%|█▌ | 345/2222 [06:12<33:46, 1.08s/it]
16%|█▌ | 346/2222 [06:13<33:51, 1.08s/it]
16%|█▌ | 347/2222 [06:14<33:59, 1.09s/it]
16%|█▌ | 348/2222 [06:15<33:55, 1.09s/it]
16%|█▌ | 349/2222 [06:16<33:40, 1.08s/it]
16%|█▌ | 350/2222 [06:17<33:36, 1.08s/it]
16%|█▌ | 351/2222 [06:18<33:40, 1.08s/it]
16%|█▌ | 352/2222 [06:19<33:39, 1.08s/it]
16%|█▌ | 353/2222 [06:20<33:24, 1.07s/it]
16%|█▌ | 354/2222 [06:22<33:10, 1.07s/it]
16%|█▌ | 355/2222 [06:23<33:24, 1.07s/it]
16%|█▌ | 356/2222 [06:24<33:24, 1.07s/it]
16%|█▌ | 357/2222 [06:25<33:20, 1.07s/it]
16%|█▌ | 358/2222 [06:26<33:20, 1.07s/it]
16%|█▌ | 359/2222 [06:27<33:02, 1.06s/it]
16%|█▌ | 360/2222 [06:28<32:58, 1.06s/it]
16%|█▌ | 361/2222 [06:29<33:00, 1.06s/it]
16%|█▋ | 362/2222 [06:30<33:15, 1.07s/it]
16%|█▋ | 363/2222 [06:31<33:26, 1.08s/it]
16%|█▋ | 364/2222 [06:32<33:02, 1.07s/it]
16%|█▋ | 365/2222 [06:33<33:07, 1.07s/it]
16%|█▋ | 366/2222 [06:34<33:07, 1.07s/it]
17%|█▋ | 367/2222 [06:36<33:25, 1.08s/it]
17%|█▋ | 368/2222 [06:37<33:38, 1.09s/it]
17%|█▋ | 369/2222 [06:38<33:29, 1.08s/it]
17%|█▋ | 370/2222 [06:39<33:16, 1.08s/it]
17%|█▋ | 371/2222 [06:40<33:07, 1.07s/it]
17%|█▋ | 372/2222 [06:41<33:15, 1.08s/it]
17%|█▋ | 373/2222 [06:42<33:31, 1.09s/it]
17%|█▋ | 374/2222 [06:43<33:27, 1.09s/it]
17%|█▋ | 375/2222 [06:44<33:16, 1.08s/it]
17%|█▋ | 376/2222 [06:45<33:07, 1.08s/it]
17%|█▋ | 377/2222 [06:46<33:02, 1.07s/it]
17%|█▋ | 378/2222 [06:47<33:09, 1.08s/it]
17%|█▋ | 379/2222 [06:48<33:18, 1.08s/it]
17%|█▋ | 380/2222 [06:50<33:14, 1.08s/it]
17%|█▋ | 381/2222 [06:51<33:14, 1.08s/it]
17%|█▋ | 382/2222 [06:52<33:16, 1.08s/it]
17%|█▋ | 383/2222 [06:53<33:32, 1.09s/it]
17%|█▋ | 384/2222 [06:54<33:15, 1.09s/it]
17%|█▋ | 385/2222 [06:55<33:03, 1.08s/it]
17%|█▋ | 386/2222 [06:56<33:04, 1.08s/it]
17%|█▋ | 387/2222 [06:57<33:15, 1.09s/it]
17%|█▋ | 388/2222 [06:58<33:02, 1.08s/it]
18%|█▊ | 389/2222 [06:59<32:57, 1.08s/it]
18%|█▊ | 390/2222 [07:00<32:51, 1.08s/it]
18%|█▊ | 391/2222 [07:01<33:01, 1.08s/it]
18%|█▊ | 392/2222 [07:03<33:12, 1.09s/it]
18%|█▊ | 393/2222 [07:04<33:13, 1.09s/it]
18%|█▊ | 394/2222 [07:05<33:04, 1.09s/it]
18%|█▊ | 395/2222 [07:06<33:07, 1.09s/it]
18%|█▊ | 396/2222 [07:07<32:54, 1.08s/it]
18%|█▊ | 397/2222 [07:08<32:59, 1.08s/it]
18%|█▊ | 398/2222 [07:09<32:43, 1.08s/it]
18%|█▊ | 399/2222 [07:10<32:37, 1.07s/it]
18%|█▊ | 400/2222 [07:11<32:30, 1.07s/it]
18%|█▊ | 401/2222 [07:12<32:31, 1.07s/it]
18%|█▊ | 402/2222 [07:13<32:46, 1.08s/it]
18%|█▊ | 403/2222 [07:14<32:51, 1.08s/it]
18%|█▊ | 404/2222 [07:15<32:28, 1.07s/it]
18%|█▊ | 405/2222 [07:17<32:24, 1.07s/it]
18%|█▊ | 406/2222 [07:18<32:22, 1.07s/it]
18%|█▊ | 407/2222 [07:19<32:23, 1.07s/it]
18%|█▊ | 408/2222 [07:20<32:28, 1.07s/it]
18%|█▊ | 409/2222 [07:21<32:23, 1.07s/it]
18%|█▊ | 410/2222 [07:22<32:15, 1.07s/it]
18%|█▊ | 411/2222 [07:23<32:12, 1.07s/it]
19%|█▊ | 412/2222 [07:24<32:13, 1.07s/it]
19%|█▊ | 413/2222 [07:25<32:10, 1.07s/it]
19%|█▊ | 414/2222 [07:26<32:26, 1.08s/it]
19%|█▊ | 415/2222 [07:27<32:13, 1.07s/it]
19%|█▊ | 416/2222 [07:28<32:29, 1.08s/it]
19%|█▉ | 417/2222 [07:29<32:30, 1.08s/it]
19%|█▉ | 418/2222 [07:31<32:32, 1.08s/it]
19%|█▉ | 419/2222 [07:32<32:31, 1.08s/it]
19%|█▉ | 420/2222 [07:33<32:27, 1.08s/it]
19%|█▉ | 421/2222 [07:34<32:29, 1.08s/it]
19%|█▉ | 422/2222 [07:35<32:50, 1.09s/it]
19%|█▉ | 423/2222 [07:36<32:21, 1.08s/it]
19%|█▉ | 424/2222 [07:37<32:30, 1.08s/it]
19%|█▉ | 425/2222 [07:38<32:27, 1.08s/it]
19%|█▉ | 426/2222 [07:39<32:30, 1.09s/it]
19%|█▉ | 427/2222 [07:40<32:15, 1.08s/it]
19%|█▉ | 428/2222 [07:41<31:56, 1.07s/it]
19%|█▉ | 429/2222 [07:42<32:09, 1.08s/it]
19%|█▉ | 430/2222 [07:44<32:10, 1.08s/it]
19%|█▉ | 431/2222 [07:45<31:59, 1.07s/it]
19%|█▉ | 432/2222 [07:46<31:51, 1.07s/it]
19%|█▉ | 433/2222 [07:47<31:49, 1.07s/it]
20%|█▉ | 434/2222 [07:48<32:09, 1.08s/it]
20%|█▉ | 435/2222 [07:49<32:14, 1.08s/it]
20%|█▉ | 436/2222 [07:50<31:48, 1.07s/it]
20%|█▉ | 437/2222 [07:51<31:42, 1.07s/it]
20%|█▉ | 438/2222 [07:52<31:45, 1.07s/it]
20%|█▉ | 439/2222 [07:53<31:49, 1.07s/it]
20%|█▉ | 440/2222 [07:54<31:36, 1.06s/it]
20%|█▉ | 441/2222 [07:55<31:49, 1.07s/it]
20%|█▉ | 442/2222 [07:56<31:53, 1.08s/it]
20%|█▉ | 443/2222 [07:57<31:44, 1.07s/it]
20%|█▉ | 444/2222 [07:58<31:53, 1.08s/it]
20%|██ | 445/2222 [08:00<31:48, 1.07s/it]
20%|██ | 446/2222 [08:01<32:01, 1.08s/it]
20%|██ | 447/2222 [08:02<31:57, 1.08s/it]
20%|██ | 448/2222 [08:03<31:36, 1.07s/it]
20%|██ | 449/2222 [08:04<31:51, 1.08s/it]
20%|██ | 450/2222 [08:05<31:45, 1.08s/it]
20%|██ | 451/2222 [08:06<31:37, 1.07s/it]
20%|██ | 452/2222 [08:07<31:52, 1.08s/it]
20%|██ | 453/2222 [08:08<31:39, 1.07s/it]
20%|██ | 454/2222 [08:09<31:33, 1.07s/it]
20%|██ | 455/2222 [08:10<31:24, 1.07s/it]
21%|██ | 456/2222 [08:11<31:30, 1.07s/it]
21%|██ | 457/2222 [08:12<31:38, 1.08s/it]
21%|██ | 458/2222 [08:14<31:32, 1.07s/it]
21%|██ | 459/2222 [08:15<31:23, 1.07s/it]
21%|██ | 460/2222 [08:16<31:24, 1.07s/it]
21%|██ | 461/2222 [08:17<31:10, 1.06s/it]
21%|██ | 462/2222 [08:18<31:27, 1.07s/it]
21%|██ | 463/2222 [08:19<31:17, 1.07s/it]
21%|██ | 464/2222 [08:20<31:08, 1.06s/it]
21%|██ | 465/2222 [08:21<31:02, 1.06s/it]
21%|██ | 466/2222 [08:22<31:12, 1.07s/it]
21%|██ | 467/2222 [08:23<31:31, 1.08s/it]
21%|██ | 468/2222 [08:24<31:26, 1.08s/it]
21%|██ | 469/2222 [08:25<31:17, 1.07s/it]
21%|██ | 470/2222 [08:26<31:04, 1.06s/it]
21%|██ | 471/2222 [08:27<31:30, 1.08s/it]
21%|██ | 472/2222 [08:29<31:29, 1.08s/it]
21%|██▏ | 473/2222 [08:30<31:02, 1.07s/it]
21%|██▏ | 474/2222 [08:31<31:19, 1.07s/it]
21%|██▏ | 475/2222 [08:32<31:19, 1.08s/it]
21%|██▏ | 476/2222 [08:33<31:25, 1.08s/it]
21%|██▏ | 477/2222 [08:34<31:14, 1.07s/it]
22%|██▏ | 478/2222 [08:35<30:53, 1.06s/it]
22%|██▏ | 479/2222 [08:36<30:54, 1.06s/it]
22%|██▏ | 480/2222 [08:37<31:09, 1.07s/it]
22%|██▏ | 481/2222 [08:38<31:06, 1.07s/it]
22%|██▏ | 482/2222 [08:39<31:18, 1.08s/it]
22%|██▏ | 483/2222 [08:40<31:24, 1.08s/it]
22%|██▏ | 484/2222 [08:41<31:27, 1.09s/it]
22%|██▏ | 485/2222 [08:42<31:07, 1.08s/it]
22%|██▏ | 486/2222 [08:44<31:22, 1.08s/it]
22%|██▏ | 487/2222 [08:45<31:11, 1.08s/it]
22%|██▏ | 488/2222 [08:46<31:15, 1.08s/it]
22%|██▏ | 489/2222 [08:47<30:56, 1.07s/it]
22%|██▏ | 490/2222 [08:48<31:08, 1.08s/it]
22%|██▏ | 491/2222 [08:49<31:06, 1.08s/it]
22%|██▏ | 492/2222 [08:50<31:10, 1.08s/it]
22%|██▏ | 493/2222 [08:51<30:58, 1.08s/it]
22%|██▏ | 494/2222 [08:52<30:59, 1.08s/it]
22%|██▏ | 495/2222 [08:53<30:59, 1.08s/it]
22%|██▏ | 496/2222 [08:54<31:15, 1.09s/it]
22%|██▏ | 497/2222 [08:55<30:52, 1.07s/it]
22%|██▏ | 498/2222 [08:56<30:53, 1.08s/it]
22%|██▏ | 499/2222 [08:58<31:05, 1.08s/it]
23%|██▎ | 500/2222 [08:59<30:59, 1.08s/it]
{'loss': 3.6766, 'learning_rate': 3.874887488748875e-05, 'epoch': 0.45}
23%|██▎ | 500/2222 [08:59<30:59, 1.08s/it]
23%|██▎ | 501/2222 [09:00<30:52, 1.08s/it]
23%|██▎ | 502/2222 [09:01<30:43, 1.07s/it]
23%|██▎ | 503/2222 [09:02<30:22, 1.06s/it]
23%|██▎ | 504/2222 [09:03<30:33, 1.07s/it]
23%|██▎ | 505/2222 [09:04<30:43, 1.07s/it]
23%|██▎ | 506/2222 [09:05<30:43, 1.07s/it]
23%|██▎ | 507/2222 [09:06<30:23, 1.06s/it]
23%|██▎ | 508/2222 [09:07<30:43, 1.08s/it]
23%|██▎ | 509/2222 [09:08<30:46, 1.08s/it]
23%|██▎ | 510/2222 [09:09<30:47, 1.08s/it]
23%|██▎ | 511/2222 [09:10<30:58, 1.09s/it]
23%|██▎ | 512/2222 [09:12<30:57, 1.09s/it]
23%|██▎ | 513/2222 [09:13<30:50, 1.08s/it]
23%|██▎ | 514/2222 [09:14<31:06, 1.09s/it]
23%|██▎ | 515/2222 [09:15<30:41, 1.08s/it]
23%|██▎ | 516/2222 [09:16<30:50, 1.08s/it]
23%|██▎ | 517/2222 [09:17<30:51, 1.09s/it]
23%|██▎ | 518/2222 [09:18<30:53, 1.09s/it]
23%|██▎ | 519/2222 [09:19<30:42, 1.08s/it]
23%|██▎ | 520/2222 [09:20<30:45, 1.08s/it]
23%|██▎ | 521/2222 [09:21<30:35, 1.08s/it]
23%|██▎ | 522/2222 [09:22<30:39, 1.08s/it]
24%|██▎ | 523/2222 [09:24<30:52, 1.09s/it]
24%|██▎ | 524/2222 [09:25<30:43, 1.09s/it]
24%|██▎ | 525/2222 [09:26<30:21, 1.07s/it]
24%|██▎ | 526/2222 [09:27<30:19, 1.07s/it]
24%|██▎ | 527/2222 [09:28<30:06, 1.07s/it]
24%|██▍ | 528/2222 [09:29<30:08, 1.07s/it]
24%|██▍ | 529/2222 [09:30<30:11, 1.07s/it]
24%|██▍ | 530/2222 [09:31<30:19, 1.08s/it]
24%|██▍ | 531/2222 [09:32<30:26, 1.08s/it]
24%|██▍ | 532/2222 [09:33<30:30, 1.08s/it]
24%|██▍ | 533/2222 [09:34<30:29, 1.08s/it]
24%|██▍ | 534/2222 [09:35<30:22, 1.08s/it]
24%|██▍ | 535/2222 [09:36<30:07, 1.07s/it]
24%|██▍ | 536/2222 [09:37<30:13, 1.08s/it]
24%|██▍ | 537/2222 [09:39<30:30, 1.09s/it]
24%|██▍ | 538/2222 [09:40<30:43, 1.09s/it]
24%|██▍ | 539/2222 [09:41<30:44, 1.10s/it]
24%|██▍ | 540/2222 [09:42<30:24, 1.08s/it]
24%|██▍ | 541/2222 [09:43<30:21, 1.08s/it]
24%|██▍ | 542/2222 [09:44<30:15, 1.08s/it]
24%|██▍ | 543/2222 [09:45<30:01, 1.07s/it]
24%|██▍ | 544/2222 [09:46<29:52, 1.07s/it]
25%|██▍ | 545/2222 [09:47<29:44, 1.06s/it]
25%|██▍ | 546/2222 [09:48<30:09, 1.08s/it]
25%|██▍ | 547/2222 [09:49<30:18, 1.09s/it]
25%|██▍ | 548/2222 [09:50<30:04, 1.08s/it]
25%|██▍ | 549/2222 [09:52<29:58, 1.08s/it]
25%|██▍ | 550/2222 [09:53<29:57, 1.08s/it]
25%|██▍ | 551/2222 [09:54<29:45, 1.07s/it]
25%|██▍ | 552/2222 [09:55<29:58, 1.08s/it]
25%|██▍ | 553/2222 [09:56<30:07, 1.08s/it]
25%|██▍ | 554/2222 [09:57<29:47, 1.07s/it]
25%|██▍ | 555/2222 [09:58<29:51, 1.07s/it]
25%|██▌ | 556/2222 [09:59<29:49, 1.07s/it]
25%|██▌ | 557/2222 [10:00<29:45, 1.07s/it]
25%|██▌ | 558/2222 [10:01<29:58, 1.08s/it]
25%|██▌ | 559/2222 [10:02<30:09, 1.09s/it]
25%|██▌ | 560/2222 [10:03<29:52, 1.08s/it]
25%|██▌ | 561/2222 [10:04<29:51, 1.08s/it]
25%|██▌ | 562/2222 [10:06<29:44, 1.08s/it]
25%|██▌ | 563/2222 [10:07<29:49, 1.08s/it]
25%|██▌ | 564/2222 [10:08<29:36, 1.07s/it]
25%|██▌ | 565/2222 [10:09<29:37, 1.07s/it]
25%|██▌ | 566/2222 [10:10<29:34, 1.07s/it]
26%|██▌ | 567/2222 [10:11<29:26, 1.07s/it]
26%|██▌ | 568/2222 [10:12<29:26, 1.07s/it]
26%|██▌ | 569/2222 [10:13<29:31, 1.07s/it]
26%|██▌ | 570/2222 [10:14<29:25, 1.07s/it]
26%|██▌ | 571/2222 [10:15<29:23, 1.07s/it]
26%|██▌ | 572/2222 [10:16<29:35, 1.08s/it]
26%|██▌ | 573/2222 [10:17<29:23, 1.07s/it]
26%|██▌ | 574/2222 [10:18<29:25, 1.07s/it]
26%|██▌ | 575/2222 [10:19<29:18, 1.07s/it]
26%|██▌ | 576/2222 [10:21<29:27, 1.07s/it]
26%|██▌ | 577/2222 [10:22<29:47, 1.09s/it]
26%|██▌ | 578/2222 [10:23<29:38, 1.08s/it]
26%|██▌ | 579/2222 [10:24<29:28, 1.08s/it]
26%|██▌ | 580/2222 [10:25<29:27, 1.08s/it]
26%|██▌ | 581/2222 [10:26<29:49, 1.09s/it]
26%|██▌ | 582/2222 [10:27<29:38, 1.08s/it]
26%|██▌ | 583/2222 [10:28<29:35, 1.08s/it]
26%|██▋ | 584/2222 [10:29<29:30, 1.08s/it]
26%|██▋ | 585/2222 [10:30<29:45, 1.09s/it]
26%|██▋ | 586/2222 [10:31<29:46, 1.09s/it]
26%|██▋ | 587/2222 [10:32<29:34, 1.09s/it]
26%|██▋ | 588/2222 [10:34<29:43, 1.09s/it]
27%|██▋ | 589/2222 [10:35<29:31, 1.08s/it]
27%|██▋ | 590/2222 [10:36<29:27, 1.08s/it]
27%|██▋ | 591/2222 [10:37<29:08, 1.07s/it]
27%|██▋ | 592/2222 [10:38<29:08, 1.07s/it]
27%|██▋ | 593/2222 [10:39<28:57, 1.07s/it]
27%|██▋ | 594/2222 [10:40<29:07, 1.07s/it]
27%|██▋ | 595/2222 [10:41<29:33, 1.09s/it]
27%|██▋ | 596/2222 [10:42<29:35, 1.09s/it]
27%|██▋ | 597/2222 [10:43<29:26, 1.09s/it]
27%|██▋ | 598/2222 [10:44<29:15, 1.08s/it]
27%|██▋ | 599/2222 [10:45<29:26, 1.09s/it]
27%|██▋ | 600/2222 [10:47<29:24, 1.09s/it]
27%|██▋ | 601/2222 [10:48<29:20, 1.09s/it]
27%|██▋ | 602/2222 [10:49<29:13, 1.08s/it]
27%|██▋ | 603/2222 [10:50<29:14, 1.08s/it]
27%|██▋ | 604/2222 [10:51<29:23, 1.09s/it]
27%|██▋ | 605/2222 [10:52<29:27, 1.09s/it]
27%|██▋ | 606/2222 [10:53<29:10, 1.08s/it]
27%|██▋ | 607/2222 [10:54<29:22, 1.09s/it]
27%|██▋ | 608/2222 [10:55<29:14, 1.09s/it]
27%|██▋ | 609/2222 [10:56<29:13, 1.09s/it]
27%|██▋ | 610/2222 [10:57<29:17, 1.09s/it]
27%|██▋ | 611/2222 [10:58<29:09, 1.09s/it]
28%|██▊ | 612/2222 [11:00<29:26, 1.10s/it]
28%|██▊ | 613/2222 [11:01<29:21, 1.09s/it]
28%|██▊ | 614/2222 [11:02<28:51, 1.08s/it]
28%|██▊ | 615/2222 [11:03<28:51, 1.08s/it]
28%|██▊ | 616/2222 [11:04<28:28, 1.06s/it]
28%|██▊ | 617/2222 [11:05<28:26, 1.06s/it]
28%|██▊ | 618/2222 [11:06<28:20, 1.06s/it]
28%|██▊ | 619/2222 [11:07<28:26, 1.06s/it]
28%|██▊ | 620/2222 [11:08<28:19, 1.06s/it]
28%|██▊ | 621/2222 [11:09<28:28, 1.07s/it]
28%|██▊ | 622/2222 [11:10<28:40, 1.08s/it]
28%|██▊ | 623/2222 [11:11<28:41, 1.08s/it]
28%|██▊ | 624/2222 [11:12<28:25, 1.07s/it]
28%|██▊ | 625/2222 [11:14<28:47, 1.08s/it]
28%|██▊ | 626/2222 [11:15<28:37, 1.08s/it]
28%|██▊ | 627/2222 [11:16<28:29, 1.07s/it]
28%|██▊ | 628/2222 [11:17<28:58, 1.09s/it]
28%|██▊ | 629/2222 [11:18<28:38, 1.08s/it]
28%|██▊ | 630/2222 [11:19<28:41, 1.08s/it]
28%|██▊ | 631/2222 [11:20<28:34, 1.08s/it]
28%|██▊ | 632/2222 [11:21<28:26, 1.07s/it]
28%|██▊ | 633/2222 [11:22<28:36, 1.08s/it]
29%|██▊ | 634/2222 [11:23<28:27, 1.08s/it]
29%|██▊ | 635/2222 [11:24<28:23, 1.07s/it]
29%|██▊ | 636/2222 [11:25<28:17, 1.07s/it]
29%|██▊ | 637/2222 [11:26<28:10, 1.07s/it]
29%|██▊ | 638/2222 [11:27<28:15, 1.07s/it]
29%|██▉ | 639/2222 [11:29<28:05, 1.06s/it]
29%|██▉ | 640/2222 [11:30<28:07, 1.07s/it]
29%|██▉ | 641/2222 [11:31<28:14, 1.07s/it]
29%|██▉ | 642/2222 [11:32<28:15, 1.07s/it]
29%|██▉ | 643/2222 [11:33<28:12, 1.07s/it]
29%|██▉ | 644/2222 [11:34<28:18, 1.08s/it]
29%|██▉ | 645/2222 [11:35<28:14, 1.07s/it]
29%|██▉ | 646/2222 [11:36<28:13, 1.07s/it]
29%|██▉ | 647/2222 [11:37<28:16, 1.08s/it]
29%|██▉ | 648/2222 [11:38<28:20, 1.08s/it]
29%|██▉ | 649/2222 [11:39<28:17, 1.08s/it]
29%|██▉ | 650/2222 [11:40<28:15, 1.08s/it]
29%|██▉ | 651/2222 [11:41<28:11, 1.08s/it]
29%|██▉ | 652/2222 [11:43<27:58, 1.07s/it]
29%|██▉ | 653/2222 [11:44<28:07, 1.08s/it]
29%|██▉ | 654/2222 [11:45<28:29, 1.09s/it]
29%|██▉ | 655/2222 [11:46<28:29, 1.09s/it]
30%|██▉ | 656/2222 [11:47<28:33, 1.09s/it]
30%|██▉ | 657/2222 [11:48<28:12, 1.08s/it]
30%|██▉ | 658/2222 [11:49<28:18, 1.09s/it]
30%|██▉ | 659/2222 [11:50<28:06, 1.08s/it]
30%|██▉ | 660/2222 [11:51<28:03, 1.08s/it]
30%|██▉ | 661/2222 [11:52<27:50, 1.07s/it]
30%|██▉ | 662/2222 [11:53<27:47, 1.07s/it]
30%|██▉ | 663/2222 [11:54<27:48, 1.07s/it]
30%|██▉ | 664/2222 [11:55<27:39, 1.07s/it]
30%|██▉ | 665/2222 [11:57<27:34, 1.06s/it]
30%|██▉ | 666/2222 [11:58<27:41, 1.07s/it]
30%|███ | 667/2222 [11:59<27:56, 1.08s/it]
30%|███ | 668/2222 [12:00<28:12, 1.09s/it]
30%|███ | 669/2222 [12:01<28:07, 1.09s/it]
30%|███ | 670/2222 [12:02<28:15, 1.09s/it]
30%|███ | 671/2222 [12:03<27:54, 1.08s/it]
30%|███ | 672/2222 [12:04<28:15, 1.09s/it]
30%|███ | 673/2222 [12:05<28:04, 1.09s/it]
30%|███ | 674/2222 [12:06<27:44, 1.08s/it]
30%|███ | 675/2222 [12:07<27:49, 1.08s/it]
30%|███ | 676/2222 [12:08<27:42, 1.08s/it]
30%|███ | 677/2222 [12:09<27:34, 1.07s/it]
31%|███ | 678/2222 [12:11<27:27, 1.07s/it]
31%|███ | 679/2222 [12:12<27:26, 1.07s/it]
31%|███ | 680/2222 [12:13<27:28, 1.07s/it]
31%|███ | 681/2222 [12:14<27:21, 1.07s/it]
31%|███ | 682/2222 [12:15<27:51, 1.09s/it]
31%|███ | 683/2222 [12:16<27:46, 1.08s/it]
31%|███ | 684/2222 [12:17<27:38, 1.08s/it]
31%|███ | 685/2222 [12:18<27:47, 1.09s/it]
31%|███ | 686/2222 [12:19<27:44, 1.08s/it]
31%|███ | 687/2222 [12:20<27:33, 1.08s/it]
31%|███ | 688/2222 [12:21<27:37, 1.08s/it]
31%|███ | 689/2222 [12:22<27:29, 1.08s/it]
31%|███ | 690/2222 [12:24<27:33, 1.08s/it]
31%|███ | 691/2222 [12:25<27:30, 1.08s/it]
31%|███ | 692/2222 [12:26<27:19, 1.07s/it]
31%|███ | 693/2222 [12:27<27:14, 1.07s/it]
31%|███ | 694/2222 [12:28<27:10, 1.07s/it]
31%|███▏ | 695/2222 [12:29<27:09, 1.07s/it]
31%|███▏ | 696/2222 [12:30<27:09, 1.07s/it]
31%|███▏ | 697/2222 [12:31<27:08, 1.07s/it]
31%|███▏ | 698/2222 [12:32<27:04, 1.07s/it]
31%|███▏ | 699/2222 [12:33<26:51, 1.06s/it]
32%|███▏ | 700/2222 [12:34<26:42, 1.05s/it]
32%|███▏ | 701/2222 [12:35<26:51, 1.06s/it]
32%|███▏ | 702/2222 [12:36<27:06, 1.07s/it]
32%|███▏ | 703/2222 [12:37<27:05, 1.07s/it]
32%|███▏ | 704/2222 [12:38<26:55, 1.06s/it]
32%|███▏ | 705/2222 [12:40<27:17, 1.08s/it]
32%|███▏ | 706/2222 [12:41<27:16, 1.08s/it]
32%|███▏ | 707/2222 [12:42<26:52, 1.06s/it]
32%|███▏ | 708/2222 [12:43<28:44, 1.14s/it]
32%|███▏ | 709/2222 [12:44<28:01, 1.11s/it]
32%|███▏ | 710/2222 [12:45<27:43, 1.10s/it]
32%|███▏ | 711/2222 [12:46<27:34, 1.09s/it]
32%|███▏ | 712/2222 [12:47<27:11, 1.08s/it]
32%|███▏ | 713/2222 [12:48<27:00, 1.07s/it]
32%|███▏ | 714/2222 [12:49<26:44, 1.06s/it]
32%|███▏ | 715/2222 [12:50<26:55, 1.07s/it]
32%|███▏ | 716/2222 [12:51<26:57, 1.07s/it]
32%|███▏ | 717/2222 [12:53<27:02, 1.08s/it]
32%|███▏ | 718/2222 [12:54<26:49, 1.07s/it]
32%|███▏ | 719/2222 [12:55<26:38, 1.06s/it]
32%|███▏ | 720/2222 [12:56<27:02, 1.08s/it]
32%|███▏ | 721/2222 [12:57<26:54, 1.08s/it]
32%|███▏ | 722/2222 [12:58<26:34, 1.06s/it]
33%|███▎ | 723/2222 [12:59<26:47, 1.07s/it]
33%|███▎ | 724/2222 [13:00<26:53, 1.08s/it]
33%|███▎ | 725/2222 [13:01<26:52, 1.08s/it]
33%|███▎ | 726/2222 [13:02<26:55, 1.08s/it]
33%|███▎ | 727/2222 [13:03<26:47, 1.07s/it]
33%|███▎ | 728/2222 [13:04<26:42, 1.07s/it]
33%|███▎ | 729/2222 [13:05<26:32, 1.07s/it]
33%|███▎ | 730/2222 [13:06<26:35, 1.07s/it]
33%|███▎ | 731/2222 [13:08<26:51, 1.08s/it]
33%|███▎ | 732/2222 [13:09<26:29, 1.07s/it]
33%|███▎ | 733/2222 [13:10<26:32, 1.07s/it]
33%|███▎ | 734/2222 [13:11<26:33, 1.07s/it]
33%|███▎ | 735/2222 [13:12<26:29, 1.07s/it]
33%|███▎ | 736/2222 [13:13<26:26, 1.07s/it]
33%|███▎ | 737/2222 [13:14<26:31, 1.07s/it]
33%|███▎ | 738/2222 [13:15<26:25, 1.07s/it]
33%|███▎ | 739/2222 [13:16<26:39, 1.08s/it]
33%|███▎ | 740/2222 [13:17<26:43, 1.08s/it]
33%|███▎ | 741/2222 [13:18<26:43, 1.08s/it]
33%|███▎ | 742/2222 [13:19<26:21, 1.07s/it]
33%|███▎ | 743/2222 [13:20<26:21, 1.07s/it]
33%|███▎ | 744/2222 [13:21<26:19, 1.07s/it]
34%|███▎ | 745/2222 [13:23<26:30, 1.08s/it]
34%|███▎ | 746/2222 [13:24<26:29, 1.08s/it]
34%|███▎ | 747/2222 [13:25<26:35, 1.08s/it]
34%|███▎ | 748/2222 [13:26<26:24, 1.08s/it]
34%|███▎ | 749/2222 [13:27<26:43, 1.09s/it]
34%|███▍ | 750/2222 [13:28<26:42, 1.09s/it]
34%|███▍ | 751/2222 [13:29<26:37, 1.09s/it]
34%|███▍ | 752/2222 [13:30<26:45, 1.09s/it]
34%|███▍ | 753/2222 [13:31<26:29, 1.08s/it]
34%|███▍ | 754/2222 [13:32<26:41, 1.09s/it]
34%|███▍ | 755/2222 [13:33<26:33, 1.09s/it]
34%|███▍ | 756/2222 [13:35<26:18, 1.08s/it]
34%|███▍ | 757/2222 [13:36<26:17, 1.08s/it]
34%|███▍ | 758/2222 [13:37<26:18, 1.08s/it]
34%|███▍ | 759/2222 [13:38<26:13, 1.08s/it]
34%|███▍ | 760/2222 [13:39<26:03, 1.07s/it]
34%|███▍ | 761/2222 [13:40<26:10, 1.07s/it]
34%|███▍ | 762/2222 [13:41<25:57, 1.07s/it]
34%|███▍ | 763/2222 [13:42<26:20, 1.08s/it]
34%|███▍ | 764/2222 [13:43<26:07, 1.08s/it]
34%|███▍ | 765/2222 [13:44<26:14, 1.08s/it]
34%|███▍ | 766/2222 [13:45<26:09, 1.08s/it]
35%|███▍ | 767/2222 [13:46<26:14, 1.08s/it]
35%|███▍ | 768/2222 [13:47<26:07, 1.08s/it]
35%|███▍ | 769/2222 [13:49<26:05, 1.08s/it]
35%|███▍ | 770/2222 [13:50<25:51, 1.07s/it]
35%|███▍ | 771/2222 [13:51<25:58, 1.07s/it]
35%|███▍ | 772/2222 [13:52<25:57, 1.07s/it]
35%|███▍ | 773/2222 [13:53<26:12, 1.09s/it]
35%|███▍ | 774/2222 [13:54<25:56, 1.07s/it]
35%|███▍ | 775/2222 [13:55<25:49, 1.07s/it]
35%|███▍ | 776/2222 [13:56<25:28, 1.06s/it]
35%|███▍ | 777/2222 [13:57<25:38, 1.06s/it]
35%|███▌ | 778/2222 [13:58<25:47, 1.07s/it]
35%|███▌ | 779/2222 [13:59<25:59, 1.08s/it]
35%|███▌ | 780/2222 [14:00<25:55, 1.08s/it]
35%|███▌ | 781/2222 [14:01<25:43, 1.07s/it]
35%|███▌ | 782/2222 [14:02<25:56, 1.08s/it]
35%|███▌ | 783/2222 [14:04<25:44, 1.07s/it]
35%|███▌ | 784/2222 [14:05<25:41, 1.07s/it]
35%|███▌ | 785/2222 [14:06<25:47, 1.08s/it]
35%|███▌ | 786/2222 [14:07<25:51, 1.08s/it]
35%|███▌ | 787/2222 [14:08<25:30, 1.07s/it]
35%|███▌ | 788/2222 [14:09<25:33, 1.07s/it]
36%|███▌ | 789/2222 [14:10<25:42, 1.08s/it]
36%|███▌ | 790/2222 [14:11<25:53, 1.09s/it]
36%|███▌ | 791/2222 [14:12<25:35, 1.07s/it]
36%|███▌ | 792/2222 [14:13<25:49, 1.08s/it]
36%|███▌ | 793/2222 [14:14<25:33, 1.07s/it]
36%|███▌ | 794/2222 [14:15<25:35, 1.08s/it]
36%|███▌ | 795/2222 [14:16<25:53, 1.09s/it]
36%|███▌ | 796/2222 [14:18<25:40, 1.08s/it]
36%|███▌ | 797/2222 [14:19<25:41, 1.08s/it]
36%|███▌ | 798/2222 [14:20<25:53, 1.09s/it]
36%|███▌ | 799/2222 [14:21<25:53, 1.09s/it]
36%|███▌ | 800/2222 [14:22<25:50, 1.09s/it]
36%|███▌ | 801/2222 [14:23<25:58, 1.10s/it]
36%|███▌ | 802/2222 [14:24<26:04, 1.10s/it]
36%|███▌ | 803/2222 [14:25<25:49, 1.09s/it]
36%|███▌ | 804/2222 [14:26<25:39, 1.09s/it]
36%|███▌ | 805/2222 [14:27<25:34, 1.08s/it]
36%|███▋ | 806/2222 [14:28<25:40, 1.09s/it]
36%|███▋ | 807/2222 [14:29<25:18, 1.07s/it]
36%|███▋ | 808/2222 [14:31<25:03, 1.06s/it]
36%|███▋ | 809/2222 [14:32<25:11, 1.07s/it]
36%|███▋ | 810/2222 [14:33<25:03, 1.06s/it]
36%|███▋ | 811/2222 [14:34<25:06, 1.07s/it]
37%|███▋ | 812/2222 [14:35<25:19, 1.08s/it]
37%|███▋ | 813/2222 [14:36<25:22, 1.08s/it]
37%|███▋ | 814/2222 [14:37<25:20, 1.08s/it]
37%|███▋ | 815/2222 [14:38<25:01, 1.07s/it]
37%|███▋ | 816/2222 [14:39<25:00, 1.07s/it]
37%|███▋ | 817/2222 [14:40<24:59, 1.07s/it]
37%|███▋ | 818/2222 [14:41<25:10, 1.08s/it]
37%|███▋ | 819/2222 [14:42<25:13, 1.08s/it]
37%|███▋ | 820/2222 [14:43<24:58, 1.07s/it]
37%|███▋ | 821/2222 [14:45<25:08, 1.08s/it]
37%|███▋ | 822/2222 [14:46<25:02, 1.07s/it]
37%|███▋ | 823/2222 [14:47<25:07, 1.08s/it]
37%|███▋ | 824/2222 [14:48<25:05, 1.08s/it]
37%|███▋ | 825/2222 [14:49<25:12, 1.08s/it]
37%|███▋ | 826/2222 [14:50<25:02, 1.08s/it]
37%|███▋ | 827/2222 [14:51<24:57, 1.07s/it]
37%|███▋ | 828/2222 [14:52<25:09, 1.08s/it]
37%|███▋ | 829/2222 [14:53<25:10, 1.08s/it]
37%|███▋ | 830/2222 [14:54<24:56, 1.08s/it]
37%|███▋ | 831/2222 [14:55<24:55, 1.08s/it]
37%|███▋ | 832/2222 [14:56<24:46, 1.07s/it]
37%|███▋ | 833/2222 [14:57<24:32, 1.06s/it]
38%|███▊ | 834/2222 [14:58<24:29, 1.06s/it]
38%|███▊ | 835/2222 [15:00<24:50, 1.07s/it]
38%|███▊ | 836/2222 [15:01<24:44, 1.07s/it]
38%|███▊ | 837/2222 [15:02<24:58, 1.08s/it]
38%|███▊ | 838/2222 [15:03<24:48, 1.08s/it]
38%|███▊ | 839/2222 [15:04<24:54, 1.08s/it]
38%|███▊ | 840/2222 [15:05<25:13, 1.10s/it]
38%|███▊ | 841/2222 [15:06<25:00, 1.09s/it]
38%|███▊ | 842/2222 [15:07<24:51, 1.08s/it]
38%|███▊ | 843/2222 [15:08<24:42, 1.08s/it]
38%|███▊ | 844/2222 [15:09<24:43, 1.08s/it]
38%|███▊ | 845/2222 [15:10<24:35, 1.07s/it]
38%|███▊ | 846/2222 [15:11<24:30, 1.07s/it]
38%|███▊ | 847/2222 [15:13<24:55, 1.09s/it]
38%|███▊ | 848/2222 [15:14<24:54, 1.09s/it]
38%|███▊ | 849/2222 [15:15<24:48, 1.08s/it]
38%|███▊ | 850/2222 [15:16<24:39, 1.08s/it]
38%|███▊ | 851/2222 [15:17<24:36, 1.08s/it]
38%|███▊ | 852/2222 [15:18<24:27, 1.07s/it]
38%|███▊ | 853/2222 [15:19<24:32, 1.08s/it]
38%|███▊ | 854/2222 [15:20<24:29, 1.07s/it]
38%|███▊ | 855/2222 [15:21<24:39, 1.08s/it]
39%|███▊ | 856/2222 [15:22<24:38, 1.08s/it]
39%|███▊ | 857/2222 [15:23<24:26, 1.07s/it]
39%|███▊ | 858/2222 [15:24<24:28, 1.08s/it]
39%|███▊ | 859/2222 [15:25<24:25, 1.08s/it]
39%|███▊ | 860/2222 [15:27<24:27, 1.08s/it]
39%|███▊ | 861/2222 [15:28<24:15, 1.07s/it]
39%|███▉ | 862/2222 [15:29<24:18, 1.07s/it]
39%|███▉ | 863/2222 [15:30<24:04, 1.06s/it]
39%|███▉ | 864/2222 [15:31<24:12, 1.07s/it]
39%|███▉ | 865/2222 [15:32<24:18, 1.07s/it]
39%|███▉ | 866/2222 [15:33<24:16, 1.07s/it]
39%|███▉ | 867/2222 [15:34<24:23, 1.08s/it]
39%|███▉ | 868/2222 [15:35<24:32, 1.09s/it]
39%|███▉ | 869/2222 [15:36<24:29, 1.09s/it]
39%|███▉ | 870/2222 [15:37<24:25, 1.08s/it]
39%|███▉ | 871/2222 [15:38<24:36, 1.09s/it]
39%|███▉ | 872/2222 [15:39<24:25, 1.09s/it]
39%|███▉ | 873/2222 [15:41<24:07, 1.07s/it]
39%|███▉ | 874/2222 [15:42<24:01, 1.07s/it]
39%|███▉ | 875/2222 [15:43<24:09, 1.08s/it]
39%|███▉ | 876/2222 [15:44<24:11, 1.08s/it]
39%|███▉ | 877/2222 [15:45<24:15, 1.08s/it]
40%|███▉ | 878/2222 [15:46<24:06, 1.08s/it]
40%|███▉ | 879/2222 [15:47<24:03, 1.07s/it]
40%|███▉ | 880/2222 [15:48<24:01, 1.07s/it]
40%|███▉ | 881/2222 [15:49<24:04, 1.08s/it]
40%|███▉ | 882/2222 [15:50<24:04, 1.08s/it]
40%|███▉ | 883/2222 [15:51<24:06, 1.08s/it]
40%|███▉ | 884/2222 [15:52<23:56, 1.07s/it]
40%|███▉ | 885/2222 [15:53<23:55, 1.07s/it]
40%|███▉ | 886/2222 [15:55<24:03, 1.08s/it]
40%|███▉ | 887/2222 [15:56<23:58, 1.08s/it]
40%|███▉ | 888/2222 [15:57<24:13, 1.09s/it]
40%|████ | 889/2222 [15:58<24:06, 1.09s/it]
40%|████ | 890/2222 [15:59<24:08, 1.09s/it]
40%|████ | 891/2222 [16:00<24:00, 1.08s/it]
40%|████ | 892/2222 [16:01<24:03, 1.09s/it]
40%|████ | 893/2222 [16:02<23:55, 1.08s/it]
40%|████ | 894/2222 [16:03<23:49, 1.08s/it]
40%|████ | 895/2222 [16:04<23:51, 1.08s/it]
40%|████ | 896/2222 [16:05<23:27, 1.06s/it]
40%|████ | 897/2222 [16:06<23:37, 1.07s/it]
40%|████ | 898/2222 [16:07<23:41, 1.07s/it]
40%|████ | 899/2222 [16:09<23:51, 1.08s/it]
41%|████ | 900/2222 [16:10<23:54, 1.09s/it]
41%|████ | 901/2222 [16:11<23:42, 1.08s/it]
41%|████ | 902/2222 [16:12<23:42, 1.08s/it]
41%|████ | 903/2222 [16:13<23:39, 1.08s/it]
41%|████ | 904/2222 [16:14<23:48, 1.08s/it]
41%|████ | 905/2222 [16:15<23:43, 1.08s/it]
41%|████ | 906/2222 [16:19<39:21, 1.79s/it]
41%|████ | 907/2222 [16:20<34:52, 1.59s/it]
41%|████ | 908/2222 [16:25<59:44, 2.73s/it]
41%|████ | 909/2222 [16:26<49:00, 2.24s/it]
41%|████ | 910/2222 [16:27<41:15, 1.89s/it]
41%|████ | 911/2222 [16:28<35:58, 1.65s/it]
41%|████ | 912/2222 [16:29<32:10, 1.47s/it]
41%|████ | 913/2222 [16:30<29:43, 1.36s/it]
41%|████ | 914/2222 [16:32<28:01, 1.29s/it]
41%|████ | 915/2222 [16:33<26:43, 1.23s/it]
41%|████ | 916/2222 [16:34<25:52, 1.19s/it]
41%|████▏ | 917/2222 [16:35<25:07, 1.16s/it]
41%|████▏ | 918/2222 [16:36<24:34, 1.13s/it]
41%|████▏ | 919/2222 [16:37<24:12, 1.11s/it]
41%|████▏ | 920/2222 [16:38<23:48, 1.10s/it]
41%|████▏ | 921/2222 [16:39<23:45, 1.10s/it]
41%|████▏ | 922/2222 [16:40<23:45, 1.10s/it]
42%|████▏ | 923/2222 [16:41<23:25, 1.08s/it]
42%|████▏ | 924/2222 [16:42<23:52, 1.10s/it]
42%|████▏ | 925/2222 [16:43<23:28, 1.09s/it]
42%|████▏ | 926/2222 [16:44<23:13, 1.08s/it]
42%|████▏ | 927/2222 [16:46<23:11, 1.07s/it]
42%|████▏ | 928/2222 [16:47<23:20, 1.08s/it]
42%|████▏ | 929/2222 [16:48<23:25, 1.09s/it]
42%|████▏ | 930/2222 [16:49<23:18, 1.08s/it]
42%|████▏ | 931/2222 [16:50<23:19, 1.08s/it]
42%|████▏ | 932/2222 [16:51<23:21, 1.09s/it]
42%|████▏ | 933/2222 [16:52<23:16, 1.08s/it]
42%|████▏ | 934/2222 [16:53<23:13, 1.08s/it]
42%|████▏ | 935/2222 [16:54<23:15, 1.08s/it]
42%|████▏ | 936/2222 [16:55<23:24, 1.09s/it]
42%|████▏ | 937/2222 [16:56<23:07, 1.08s/it]
42%|████▏ | 938/2222 [16:57<22:58, 1.07s/it]
42%|████▏ | 939/2222 [16:59<22:53, 1.07s/it]
42%|████▏ | 940/2222 [17:00<22:36, 1.06s/it]
42%|████▏ | 941/2222 [17:01<23:00, 1.08s/it]
42%|████▏ | 942/2222 [17:02<23:04, 1.08s/it]
42%|████▏ | 943/2222 [17:03<23:00, 1.08s/it]
42%|████▏ | 944/2222 [17:04<22:55, 1.08s/it]
43%|████▎ | 945/2222 [17:05<22:52, 1.07s/it]
43%|████▎ | 946/2222 [17:06<22:56, 1.08s/it]
43%|████▎ | 947/2222 [17:07<22:44, 1.07s/it]
43%|████▎ | 948/2222 [17:08<22:49, 1.07s/it]
43%|████▎ | 949/2222 [17:09<22:53, 1.08s/it]
43%|████▎ | 950/2222 [17:10<22:49, 1.08s/it]
43%|████▎ | 951/2222 [17:11<22:42, 1.07s/it]
43%|████▎ | 952/2222 [17:13<22:53, 1.08s/it]
43%|████▎ | 953/2222 [17:14<22:31, 1.06s/it]
43%|████▎ | 954/2222 [17:15<22:40, 1.07s/it]
43%|████▎ | 955/2222 [17:16<22:34, 1.07s/it]
43%|████▎ | 956/2222 [17:17<22:27, 1.06s/it]
43%|████▎ | 957/2222 [17:18<22:41, 1.08s/it]
43%|████▎ | 958/2222 [17:19<22:34, 1.07s/it]
43%|████▎ | 959/2222 [17:20<22:35, 1.07s/it]
43%|████▎ | 960/2222 [17:21<22:35, 1.07s/it]
43%|████▎ | 961/2222 [17:22<22:31, 1.07s/it]
43%|████▎ | 962/2222 [17:23<22:32, 1.07s/it]
43%|████▎ | 963/2222 [17:24<22:35, 1.08s/it]
43%|████▎ | 964/2222 [17:25<22:33, 1.08s/it]
43%|████▎ | 965/2222 [17:26<22:31, 1.08s/it]
43%|████▎ | 966/2222 [17:28<22:27, 1.07s/it]
44%|████▎ | 967/2222 [17:29<22:34, 1.08s/it]
44%|████▎ | 968/2222 [17:30<22:38, 1.08s/it]
44%|████▎ | 969/2222 [17:31<22:17, 1.07s/it]
44%|████▎ | 970/2222 [17:32<22:17, 1.07s/it]
44%|████▎ | 971/2222 [17:33<22:06, 1.06s/it]
44%|████▎ | 972/2222 [17:34<22:17, 1.07s/it]
44%|████▍ | 973/2222 [17:35<22:21, 1.07s/it]
44%|████▍ | 974/2222 [17:36<22:21, 1.07s/it]
44%|████▍ | 975/2222 [17:37<22:28, 1.08s/it]
44%|████▍ | 976/2222 [17:38<22:25, 1.08s/it]
44%|████▍ | 977/2222 [17:39<22:08, 1.07s/it]
44%|████▍ | 978/2222 [17:40<22:24, 1.08s/it]
44%|████▍ | 979/2222 [17:42<22:16, 1.08s/it]
44%|████▍ | 980/2222 [17:43<21:59, 1.06s/it]
44%|████▍ | 981/2222 [17:44<22:05, 1.07s/it]
44%|████▍ | 982/2222 [17:45<22:21, 1.08s/it]
44%|████▍ | 983/2222 [17:46<22:19, 1.08s/it]
44%|████▍ | 984/2222 [17:47<22:19, 1.08s/it]
44%|████▍ | 985/2222 [17:48<22:06, 1.07s/it]
44%|████▍ | 986/2222 [17:49<22:08, 1.08s/it]
44%|████▍ | 987/2222 [17:50<22:14, 1.08s/it]
44%|████▍ | 988/2222 [17:51<22:07, 1.08s/it]
45%|████▍ | 989/2222 [17:52<22:03, 1.07s/it]
45%|████▍ | 990/2222 [17:53<22:17, 1.09s/it]
45%|████▍ | 991/2222 [17:54<21:53, 1.07s/it]
45%|████▍ | 992/2222 [17:55<21:52, 1.07s/it]
45%|████▍ | 993/2222 [17:57<21:57, 1.07s/it]
45%|████▍ | 994/2222 [17:58<21:52, 1.07s/it]
45%|████▍ | 995/2222 [17:59<21:46, 1.06s/it]
45%|████▍ | 996/2222 [18:00<22:04, 1.08s/it]
45%|████▍ | 997/2222 [18:01<21:58, 1.08s/it]
45%|████▍ | 998/2222 [18:02<21:50, 1.07s/it]
45%|████▍ | 999/2222 [18:03<22:00, 1.08s/it]
45%|████▌ | 1000/2222 [18:04<22:00, 1.08s/it]
{'loss': 2.2606, 'learning_rate': 2.7497749774977498e-05, 'epoch': 0.9}
45%|████▌ | 1000/2222 [18:04<22:00, 1.08s/it]
45%|████▌ | 1001/2222 [18:05<21:57, 1.08s/it]
45%|████▌ | 1002/2222 [18:06<21:46, 1.07s/it]
45%|████▌ | 1003/2222 [18:07<21:44, 1.07s/it]
45%|████▌ | 1004/2222 [18:08<21:42, 1.07s/it]
45%|████▌ | 1005/2222 [18:09<21:35, 1.06s/it]
45%|████▌ | 1006/2222 [18:10<21:43, 1.07s/it]
45%|████▌ | 1007/2222 [18:12<21:45, 1.07s/it]
45%|████▌ | 1008/2222 [18:13<21:54, 1.08s/it]
45%|████▌ | 1009/2222 [18:14<21:52, 1.08s/it]
45%|████▌ | 1010/2222 [18:15<21:50, 1.08s/it]
45%|████▌ | 1011/2222 [18:16<21:53, 1.08s/it]
46%|████▌ | 1012/2222 [18:17<21:48, 1.08s/it]
46%|████▌ | 1013/2222 [18:18<21:54, 1.09s/it]
46%|████▌ | 1014/2222 [18:19<21:49, 1.08s/it]
46%|████▌ | 1015/2222 [18:20<21:51, 1.09s/it]
46%|████▌ | 1016/2222 [18:21<21:34, 1.07s/it]
46%|████▌ | 1017/2222 [18:22<21:44, 1.08s/it]
46%|████▌ | 1018/2222 [18:23<21:27, 1.07s/it]
46%|████▌ | 1019/2222 [18:25<21:34, 1.08s/it]
46%|████▌ | 1020/2222 [18:26<21:25, 1.07s/it]
46%|████▌ | 1021/2222 [18:27<21:23, 1.07s/it]
46%|████▌ | 1022/2222 [18:28<21:20, 1.07s/it]
46%|████▌ | 1023/2222 [18:29<21:10, 1.06s/it]
46%|████▌ | 1024/2222 [18:30<21:13, 1.06s/it]
46%|████▌ | 1025/2222 [18:31<21:08, 1.06s/it]
46%|████▌ | 1026/2222 [18:32<21:13, 1.07s/it]
46%|████▌ | 1027/2222 [18:33<21:10, 1.06s/it]
46%|████▋ | 1028/2222 [18:34<21:31, 1.08s/it]
46%|████▋ | 1029/2222 [18:35<21:30, 1.08s/it]
46%|████▋ | 1030/2222 [18:36<21:32, 1.08s/it]
46%|████▋ | 1031/2222 [18:37<21:33, 1.09s/it]
46%|████▋ | 1032/2222 [18:38<21:24, 1.08s/it]
46%|████▋ | 1033/2222 [18:40<21:16, 1.07s/it]
47%|████▋ | 1034/2222 [18:41<21:25, 1.08s/it]
47%|████▋ | 1035/2222 [18:42<21:37, 1.09s/it]
47%|████▋ | 1036/2222 [18:43<21:24, 1.08s/it]
47%|████▋ | 1037/2222 [18:44<21:21, 1.08s/it]
47%|████▋ | 1038/2222 [18:45<21:24, 1.09s/it]
47%|████▋ | 1039/2222 [18:46<21:19, 1.08s/it]
47%|████▋ | 1040/2222 [18:47<21:10, 1.07s/it]
47%|████▋ | 1041/2222 [18:48<21:02, 1.07s/it]
47%|████▋ | 1042/2222 [18:49<21:09, 1.08s/it]
47%|████▋ | 1043/2222 [18:50<21:00, 1.07s/it]
47%|████▋ | 1044/2222 [18:51<20:53, 1.06s/it]
47%|████▋ | 1045/2222 [18:53<21:11, 1.08s/it]
47%|████▋ | 1046/2222 [18:54<21:08, 1.08s/it]
47%|████▋ | 1047/2222 [18:55<21:01, 1.07s/it]
47%|████▋ | 1048/2222 [18:56<21:08, 1.08s/it]
47%|████▋ | 1049/2222 [18:57<20:59, 1.07s/it]
47%|████▋ | 1050/2222 [18:58<21:06, 1.08s/it]
47%|████▋ | 1051/2222 [18:59<20:58, 1.07s/it]
47%|████▋ | 1052/2222 [19:00<20:51, 1.07s/it]
47%|████▋ | 1053/2222 [19:01<20:57, 1.08s/it]
47%|████▋ | 1054/2222 [19:02<20:51, 1.07s/it]
47%|████▋ | 1055/2222 [19:03<20:44, 1.07s/it]
48%|████▊ | 1056/2222 [19:04<20:46, 1.07s/it]
48%|████▊ | 1057/2222 [19:05<20:35, 1.06s/it]
48%|████▊ | 1058/2222 [19:06<20:42, 1.07s/it]
48%|████▊ | 1059/2222 [19:07<20:37, 1.06s/it]
48%|████▊ | 1060/2222 [19:09<20:37, 1.07s/it]
48%|████▊ | 1061/2222 [19:10<20:38, 1.07s/it]
48%|████▊ | 1062/2222 [19:11<20:41, 1.07s/it]
48%|████▊ | 1063/2222 [19:12<20:37, 1.07s/it]
48%|████▊ | 1064/2222 [19:13<20:45, 1.08s/it]
48%|████▊ | 1065/2222 [19:14<20:32, 1.07s/it]
48%|████▊ | 1066/2222 [19:15<20:31, 1.07s/it]
48%|████▊ | 1067/2222 [19:16<20:32, 1.07s/it]
48%|████▊ | 1068/2222 [19:17<20:39, 1.07s/it]
48%|████▊ | 1069/2222 [19:18<20:36, 1.07s/it]
48%|████▊ | 1070/2222 [19:19<20:39, 1.08s/it]
48%|████▊ | 1071/2222 [19:20<20:31, 1.07s/it]
48%|████▊ | 1072/2222 [19:21<20:41, 1.08s/it]
48%|████▊ | 1073/2222 [19:23<20:46, 1.08s/it]
48%|████▊ | 1074/2222 [19:24<20:50, 1.09s/it]
48%|████▊ | 1075/2222 [19:25<20:41, 1.08s/it]
48%|████▊ | 1076/2222 [19:26<20:43, 1.08s/it]
48%|████▊ | 1077/2222 [19:27<20:43, 1.09s/it]
49%|████▊ | 1078/2222 [19:28<20:32, 1.08s/it]
49%|████▊ | 1079/2222 [19:29<20:22, 1.07s/it]
49%|████▊ | 1080/2222 [19:30<20:27, 1.07s/it]
49%|████▊ | 1081/2222 [19:31<20:33, 1.08s/it]
49%|████▊ | 1082/2222 [19:32<20:31, 1.08s/it]
49%|████▊ | 1083/2222 [19:33<20:34, 1.08s/it]
49%|████▉ | 1084/2222 [19:34<20:39, 1.09s/it]
49%|████▉ | 1085/2222 [19:35<20:29, 1.08s/it]
49%|████▉ | 1086/2222 [19:37<20:29, 1.08s/it]
49%|████▉ | 1087/2222 [19:38<20:24, 1.08s/it]
49%|████▉ | 1088/2222 [19:39<20:15, 1.07s/it]
49%|████▉ | 1089/2222 [19:40<20:18, 1.08s/it]
49%|████▉ | 1090/2222 [19:41<20:15, 1.07s/it]
49%|████▉ | 1091/2222 [19:42<20:22, 1.08s/it]
49%|████▉ | 1092/2222 [19:43<20:17, 1.08s/it]
49%|████▉ | 1093/2222 [19:44<20:07, 1.07s/it]
49%|████▉ | 1094/2222 [19:45<20:07, 1.07s/it]
49%|████▉ | 1095/2222 [19:46<20:05, 1.07s/it]
49%|████▉ | 1096/2222 [19:47<20:04, 1.07s/it]
49%|████▉ | 1097/2222 [19:48<20:07, 1.07s/it]
49%|████▉ | 1098/2222 [19:49<20:03, 1.07s/it]
49%|████▉ | 1099/2222 [19:50<20:01, 1.07s/it]
50%|████▉ | 1100/2222 [19:52<19:56, 1.07s/it]
50%|████▉ | 1101/2222 [19:53<19:57, 1.07s/it]
50%|████▉ | 1102/2222 [19:54<20:02, 1.07s/it]
50%|████▉ | 1103/2222 [19:55<19:54, 1.07s/it]
50%|████▉ | 1104/2222 [19:56<20:02, 1.08s/it]
50%|████▉ | 1105/2222 [19:57<20:06, 1.08s/it]
50%|████▉ | 1106/2222 [19:58<19:57, 1.07s/it]
50%|████▉ | 1107/2222 [19:59<19:49, 1.07s/it]
50%|████▉ | 1108/2222 [20:00<19:48, 1.07s/it]
50%|████▉ | 1109/2222 [20:01<19:50, 1.07s/it]
50%|████▉ | 1110/2222 [20:02<19:52, 1.07s/it]
50%|█████ | 1111/2222 [20:03<18:43, 1.01s/it]
50%|█████ | 1112/2222 [20:04<19:08, 1.03s/it]
50%|█████ | 1113/2222 [20:05<19:21, 1.05s/it]
50%|█████ | 1114/2222 [20:06<19:41, 1.07s/it]
50%|█████ | 1115/2222 [20:08<19:53, 1.08s/it]
50%|█████ | 1116/2222 [20:09<19:49, 1.08s/it]
50%|█████ | 1117/2222 [20:10<19:57, 1.08s/it]
50%|█████ | 1118/2222 [20:11<19:49, 1.08s/it]
50%|█████ | 1119/2222 [20:12<19:42, 1.07s/it]
50%|█████ | 1120/2222 [20:13<19:33, 1.06s/it]
50%|█████ | 1121/2222 [20:14<19:44, 1.08s/it]
50%|█████ | 1122/2222 [20:15<19:50, 1.08s/it]
51%|█████ | 1123/2222 [20:16<19:38, 1.07s/it]
51%|█████ | 1124/2222 [20:17<19:44, 1.08s/it]
51%|█████ | 1125/2222 [20:18<19:44, 1.08s/it]
51%|█████ | 1126/2222 [20:19<19:37, 1.07s/it]
51%|█████ | 1127/2222 [20:20<19:27, 1.07s/it]
51%|█████ | 1128/2222 [20:22<19:38, 1.08s/it]
51%|█████ | 1129/2222 [20:23<19:46, 1.09s/it]
51%|█████ | 1130/2222 [20:24<19:35, 1.08s/it]
51%|█████ | 1131/2222 [20:25<19:32, 1.07s/it]
51%|█████ | 1132/2222 [20:26<19:40, 1.08s/it]
51%|█████ | 1133/2222 [20:27<19:39, 1.08s/it]
51%|█████ | 1134/2222 [20:28<19:27, 1.07s/it]
51%|█████ | 1135/2222 [20:29<19:26, 1.07s/it]
51%|█████ | 1136/2222 [20:30<19:34, 1.08s/it]
51%|█████ | 1137/2222 [20:31<19:29, 1.08s/it]
51%|█████ | 1138/2222 [20:32<19:26, 1.08s/it]
51%|█████▏ | 1139/2222 [20:33<19:22, 1.07s/it]
51%|█████▏ | 1140/2222 [20:34<19:08, 1.06s/it]
51%|█████▏ | 1141/2222 [20:35<19:18, 1.07s/it]
51%|█████▏ | 1142/2222 [20:37<19:34, 1.09s/it]
51%|█████▏ | 1143/2222 [20:38<19:20, 1.08s/it]
51%|█████▏ | 1144/2222 [20:39<19:27, 1.08s/it]
52%|█████▏ | 1145/2222 [20:40<19:26, 1.08s/it]
52%|█████▏ | 1146/2222 [20:41<19:25, 1.08s/it]
52%|█████▏ | 1147/2222 [20:42<19:23, 1.08s/it]
52%|█████▏ | 1148/2222 [20:43<19:21, 1.08s/it]
52%|█████▏ | 1149/2222 [20:44<19:15, 1.08s/it]
52%|█████▏ | 1150/2222 [20:45<19:23, 1.08s/it]
52%|█████▏ | 1151/2222 [20:46<19:21, 1.08s/it]
52%|█████▏ | 1152/2222 [20:47<19:10, 1.08s/it]
52%|█████▏ | 1153/2222 [20:49<19:23, 1.09s/it]
52%|█████▏ | 1154/2222 [20:50<19:17, 1.08s/it]
52%|█████▏ | 1155/2222 [20:51<19:13, 1.08s/it]
52%|█████▏ | 1156/2222 [20:52<19:17, 1.09s/it]
52%|█████▏ | 1157/2222 [20:53<19:04, 1.07s/it]
52%|█████▏ | 1158/2222 [20:54<19:06, 1.08s/it]
52%|█████▏ | 1159/2222 [20:55<18:58, 1.07s/it]
52%|█████▏ | 1160/2222 [20:56<19:02, 1.08s/it]
52%|█████▏ | 1161/2222 [20:57<18:53, 1.07s/it]
52%|█████▏ | 1162/2222 [20:58<18:57, 1.07s/it]
52%|█████▏ | 1163/2222 [20:59<18:56, 1.07s/it]
52%|█████▏ | 1164/2222 [21:00<19:01, 1.08s/it]
52%|█████▏ | 1165/2222 [21:01<19:09, 1.09s/it]
52%|█████▏ | 1166/2222 [21:03<19:05, 1.08s/it]
53%|█████▎ | 1167/2222 [21:04<19:01, 1.08s/it]
53%|█████▎ | 1168/2222 [21:05<18:49, 1.07s/it]
53%|█████▎ | 1169/2222 [21:06<18:51, 1.07s/it]
53%|█████▎ | 1170/2222 [21:07<18:57, 1.08s/it]
53%|█████▎ | 1171/2222 [21:08<18:51, 1.08s/it]
53%|█████▎ | 1172/2222 [21:09<18:46, 1.07s/it]
53%|█████▎ | 1173/2222 [21:10<18:33, 1.06s/it]
53%|█████▎ | 1174/2222 [21:11<18:39, 1.07s/it]
53%|█████▎ | 1175/2222 [21:12<18:34, 1.06s/it]
53%|█████▎ | 1176/2222 [21:13<18:30, 1.06s/it]
53%|█████▎ | 1177/2222 [21:14<18:31, 1.06s/it]
53%|█████▎ | 1178/2222 [21:15<18:28, 1.06s/it]
53%|█████▎ | 1179/2222 [21:16<18:35, 1.07s/it]
53%|█████▎ | 1180/2222 [21:18<18:53, 1.09s/it]
53%|█████▎ | 1181/2222 [21:19<18:48, 1.08s/it]
53%|█████▎ | 1182/2222 [21:20<18:42, 1.08s/it]
53%|█████▎ | 1183/2222 [21:21<18:25, 1.06s/it]
53%|█████▎ | 1184/2222 [21:22<18:29, 1.07s/it]
53%|█████▎ | 1185/2222 [21:23<18:39, 1.08s/it]
53%|█████▎ | 1186/2222 [21:24<18:43, 1.08s/it]
53%|█████▎ | 1187/2222 [21:25<18:38, 1.08s/it]
53%|█████▎ | 1188/2222 [21:26<18:45, 1.09s/it]
54%|█████▎ | 1189/2222 [21:27<18:33, 1.08s/it]
54%|█████▎ | 1190/2222 [21:28<18:33, 1.08s/it]
54%|█████▎ | 1191/2222 [21:29<18:33, 1.08s/it]
54%|█████▎ | 1192/2222 [21:30<18:30, 1.08s/it]
54%|█████▎ | 1193/2222 [21:31<18:20, 1.07s/it]
54%|█████▎ | 1194/2222 [21:33<18:18, 1.07s/it]
54%|█████▍ | 1195/2222 [21:34<18:15, 1.07s/it]
54%|█████▍ | 1196/2222 [21:35<18:13, 1.07s/it]
54%|█████▍ | 1197/2222 [21:36<18:07, 1.06s/it]
54%|█████▍ | 1198/2222 [21:37<18:13, 1.07s/it]
54%|█████▍ | 1199/2222 [21:38<18:23, 1.08s/it]
54%|█████▍ | 1200/2222 [21:39<18:06, 1.06s/it]
54%|█████▍ | 1201/2222 [21:40<18:25, 1.08s/it]
54%|█████▍ | 1202/2222 [21:41<18:18, 1.08s/it]
54%|█████▍ | 1203/2222 [21:42<18:13, 1.07s/it]
54%|█████▍ | 1204/2222 [21:43<18:13, 1.07s/it]
54%|█████▍ | 1205/2222 [21:44<18:14, 1.08s/it]
54%|█████▍ | 1206/2222 [21:45<18:21, 1.08s/it]
54%|█████▍ | 1207/2222 [21:47<18:08, 1.07s/it]
54%|█████▍ | 1208/2222 [21:48<18:11, 1.08s/it]
54%|█████▍ | 1209/2222 [21:49<18:07, 1.07s/it]
54%|█████▍ | 1210/2222 [21:50<18:02, 1.07s/it]
55%|█████▍ | 1211/2222 [21:51<17:59, 1.07s/it]
55%|█████▍ | 1212/2222 [21:52<18:00, 1.07s/it]
55%|█████▍ | 1213/2222 [21:53<18:00, 1.07s/it]
55%|█████▍ | 1214/2222 [21:54<17:46, 1.06s/it]
55%|█████▍ | 1215/2222 [21:55<17:38, 1.05s/it]
55%|█████▍ | 1216/2222 [21:56<17:41, 1.05s/it]
55%|█████▍ | 1217/2222 [21:57<17:51, 1.07s/it]
55%|█████▍ | 1218/2222 [21:58<17:57, 1.07s/it]
55%|█████▍ | 1219/2222 [21:59<17:55, 1.07s/it]
55%|█████▍ | 1220/2222 [22:00<17:52, 1.07s/it]
55%|█████▍ | 1221/2222 [22:01<17:55, 1.07s/it]
55%|█████▍ | 1222/2222 [22:03<17:42, 1.06s/it]
55%|█████▌ | 1223/2222 [22:04<17:43, 1.06s/it]
55%|█████▌ | 1224/2222 [22:05<17:53, 1.08s/it]
55%|█████▌ | 1225/2222 [22:06<17:53, 1.08s/it]
55%|█████▌ | 1226/2222 [22:07<17:59, 1.08s/it]
55%|█████▌ | 1227/2222 [22:08<17:47, 1.07s/it]
55%|█████▌ | 1228/2222 [22:09<17:45, 1.07s/it]
55%|█████▌ | 1229/2222 [22:10<17:48, 1.08s/it]
55%|█████▌ | 1230/2222 [22:11<17:51, 1.08s/it]
55%|█████▌ | 1231/2222 [22:12<17:42, 1.07s/it]
55%|█████▌ | 1232/2222 [22:13<17:50, 1.08s/it]
55%|█████▌ | 1233/2222 [22:14<17:57, 1.09s/it]
56%|█████▌ | 1234/2222 [22:15<17:53, 1.09s/it]
56%|█████▌ | 1235/2222 [22:17<17:55, 1.09s/it]
56%|█████▌ | 1236/2222 [22:18<17:36, 1.07s/it]
56%|█████▌ | 1237/2222 [22:19<17:43, 1.08s/it]
56%|█████▌ | 1238/2222 [22:20<17:33, 1.07s/it]
56%|█████▌ | 1239/2222 [22:21<17:28, 1.07s/it]
56%|█████▌ | 1240/2222 [22:22<17:30, 1.07s/it]
56%|█████▌ | 1241/2222 [22:23<17:31, 1.07s/it]
56%|█████▌ | 1242/2222 [22:24<17:39, 1.08s/it]
56%|█████▌ | 1243/2222 [22:25<17:27, 1.07s/it]
56%|█████▌ | 1244/2222 [22:26<17:31, 1.07s/it]
56%|█████▌ | 1245/2222 [22:27<17:31, 1.08s/it]
56%|█████▌ | 1246/2222 [22:28<17:30, 1.08s/it]
56%|█████▌ | 1247/2222 [22:29<17:32, 1.08s/it]
56%|█████▌ | 1248/2222 [22:31<17:35, 1.08s/it]
56%|█████▌ | 1249/2222 [22:32<17:30, 1.08s/it]
56%|█████▋ | 1250/2222 [22:33<17:28, 1.08s/it]
56%|█████▋ | 1251/2222 [22:34<17:25, 1.08s/it]
56%|█████▋ | 1252/2222 [22:35<17:26, 1.08s/it]
56%|█████▋ | 1253/2222 [22:36<17:18, 1.07s/it]
56%|█████▋ | 1254/2222 [22:37<17:24, 1.08s/it]
56%|█████▋ | 1255/2222 [22:38<17:22, 1.08s/it]
57%|█████▋ | 1256/2222 [22:39<17:21, 1.08s/it]
57%|█████▋ | 1257/2222 [22:40<17:10, 1.07s/it]
57%|█████▋ | 1258/2222 [22:41<17:05, 1.06s/it]
57%|█████▋ | 1259/2222 [22:42<16:58, 1.06s/it]
57%|█████▋ | 1260/2222 [22:43<17:03, 1.06s/it]
57%|█████▋ | 1261/2222 [22:44<17:07, 1.07s/it]
57%|█████▋ | 1262/2222 [22:46<17:06, 1.07s/it]
57%|█████▋ | 1263/2222 [22:47<17:03, 1.07s/it]
57%|█████▋ | 1264/2222 [22:48<17:02, 1.07s/it]
57%|█████▋ | 1265/2222 [22:49<17:00, 1.07s/it]
57%|█████▋ | 1266/2222 [22:50<17:07, 1.07s/it]
57%|█████▋ | 1267/2222 [22:51<17:01, 1.07s/it]
57%|█████▋ | 1268/2222 [22:52<17:07, 1.08s/it]
57%|█████▋ | 1269/2222 [22:53<16:56, 1.07s/it]
57%|█████▋ | 1270/2222 [22:54<17:06, 1.08s/it]
57%|█████▋ | 1271/2222 [22:55<16:48, 1.06s/it]
57%|█████▋ | 1272/2222 [22:56<16:49, 1.06s/it]
57%|█████▋ | 1273/2222 [22:57<17:03, 1.08s/it]
57%|█████▋ | 1274/2222 [22:58<16:56, 1.07s/it]
57%|█████▋ | 1275/2222 [22:59<16:52, 1.07s/it]
57%|█████▋ | 1276/2222 [23:01<16:59, 1.08s/it]
57%|█████▋ | 1277/2222 [23:02<16:58, 1.08s/it]
58%|█████▊ | 1278/2222 [23:03<17:03, 1.08s/it]
58%|█████▊ | 1279/2222 [23:04<16:52, 1.07s/it]
58%|█████▊ | 1280/2222 [23:05<16:56, 1.08s/it]
58%|█████▊ | 1281/2222 [23:06<16:50, 1.07s/it]
58%|█████▊ | 1282/2222 [23:07<16:47, 1.07s/it]
58%|█████▊ | 1283/2222 [23:08<16:59, 1.09s/it]
58%|█████▊ | 1284/2222 [23:09<16:51, 1.08s/it]
58%|█████▊ | 1285/2222 [23:10<16:57, 1.09s/it]
58%|█████▊ | 1286/2222 [23:11<16:55, 1.09s/it]
58%|█████▊ | 1287/2222 [23:12<16:48, 1.08s/it]
58%|█████▊ | 1288/2222 [23:13<16:41, 1.07s/it]
58%|█████▊ | 1289/2222 [23:15<16:45, 1.08s/it]
58%|█████▊ | 1290/2222 [23:16<16:37, 1.07s/it]
58%|█████▊ | 1291/2222 [23:17<16:50, 1.09s/it]
58%|█████▊ | 1292/2222 [23:18<16:58, 1.10s/it]
58%|█████▊ | 1293/2222 [23:19<16:40, 1.08s/it]
58%|█████▊ | 1294/2222 [23:20<16:41, 1.08s/it]
58%|█████▊ | 1295/2222 [23:21<16:39, 1.08s/it]
58%|█████▊ | 1296/2222 [23:22<16:36, 1.08s/it]
58%|█████▊ | 1297/2222 [23:23<16:39, 1.08s/it]
58%|█████▊ | 1298/2222 [23:24<16:32, 1.07s/it]
58%|█████▊ | 1299/2222 [23:25<16:29, 1.07s/it]
59%|█████▊ | 1300/2222 [23:26<16:37, 1.08s/it]
59%|█████▊ | 1301/2222 [23:28<16:37, 1.08s/it]
59%|█████▊ | 1302/2222 [23:29<16:36, 1.08s/it]
59%|█████▊ | 1303/2222 [23:30<16:35, 1.08s/it]
59%|█████▊ | 1304/2222 [23:31<16:31, 1.08s/it]
59%|█████▊ | 1305/2222 [23:32<16:29, 1.08s/it]
59%|█████▉ | 1306/2222 [23:33<16:25, 1.08s/it]
59%|█████▉ | 1307/2222 [23:34<16:29, 1.08s/it]
59%|█████▉ | 1308/2222 [23:35<16:20, 1.07s/it]
59%|█████▉ | 1309/2222 [23:36<16:21, 1.07s/it]
59%|█████▉ | 1310/2222 [23:37<16:18, 1.07s/it]
59%|█████▉ | 1311/2222 [23:38<16:13, 1.07s/it]
59%|█████▉ | 1312/2222 [23:39<16:22, 1.08s/it]
59%|█████▉ | 1313/2222 [23:40<16:19, 1.08s/it]
59%|█████▉ | 1314/2222 [23:41<16:10, 1.07s/it]
59%|█████▉ | 1315/2222 [23:43<16:29, 1.09s/it]
59%|█████▉ | 1316/2222 [23:44<16:25, 1.09s/it]
59%|█████▉ | 1317/2222 [23:45<16:33, 1.10s/it]
59%|█████▉ | 1318/2222 [23:46<16:21, 1.09s/it]
59%|█████▉ | 1319/2222 [23:47<16:16, 1.08s/it]
59%|█████▉ | 1320/2222 [23:48<16:09, 1.07s/it]
59%|█████▉ | 1321/2222 [23:49<16:15, 1.08s/it]
59%|█████▉ | 1322/2222 [23:50<16:10, 1.08s/it]
60%|█████▉ | 1323/2222 [23:51<16:05, 1.07s/it]
60%|█████▉ | 1324/2222 [23:52<16:05, 1.08s/it]
60%|█████▉ | 1325/2222 [23:53<15:56, 1.07s/it]
60%|█████▉ | 1326/2222 [23:54<16:06, 1.08s/it]
60%|█████▉ | 1327/2222 [23:56<15:58, 1.07s/it]
60%|█████▉ | 1328/2222 [23:57<15:56, 1.07s/it]
60%|█████▉ | 1329/2222 [23:58<16:00, 1.08s/it]
60%|█████▉ | 1330/2222 [23:59<16:01, 1.08s/it]
60%|█████▉ | 1331/2222 [24:00<15:58, 1.08s/it]
60%|█████▉ | 1332/2222 [24:01<15:59, 1.08s/it]
60%|█████▉ | 1333/2222 [24:02<16:05, 1.09s/it]
60%|██████ | 1334/2222 [24:03<16:08, 1.09s/it]
60%|██████ | 1335/2222 [24:04<15:57, 1.08s/it]
60%|██████ | 1336/2222 [24:05<15:58, 1.08s/it]
60%|██████ | 1337/2222 [24:06<16:00, 1.09s/it]
60%|██████ | 1338/2222 [24:07<15:53, 1.08s/it]
60%|██████ | 1339/2222 [24:09<15:51, 1.08s/it]
60%|██████ | 1340/2222 [24:10<15:46, 1.07s/it]
60%|██████ | 1341/2222 [24:11<15:49, 1.08s/it]
60%|██████ | 1342/2222 [24:12<15:44, 1.07s/it]
60%|██████ | 1343/2222 [24:13<15:46, 1.08s/it]
60%|██████ | 1344/2222 [24:14<15:49, 1.08s/it]
61%|██████ | 1345/2222 [24:15<15:40, 1.07s/it]
61%|██████ | 1346/2222 [24:16<15:32, 1.06s/it]
61%|██████ | 1347/2222 [24:17<15:34, 1.07s/it]
61%|██████ | 1348/2222 [24:18<15:30, 1.06s/it]
61%|██████ | 1349/2222 [24:19<15:29, 1.07s/it]
61%|██████ | 1350/2222 [24:20<15:26, 1.06s/it]
61%|██████ | 1351/2222 [24:21<15:36, 1.08s/it]
61%|██████ | 1352/2222 [24:22<15:26, 1.06s/it]
61%|██████ | 1353/2222 [24:23<15:32, 1.07s/it]
61%|██████ | 1354/2222 [24:25<15:37, 1.08s/it]
61%|██████ | 1355/2222 [24:26<15:38, 1.08s/it]
61%|██████ | 1356/2222 [24:27<15:32, 1.08s/it]
61%|██████ | 1357/2222 [24:28<15:40, 1.09s/it]
61%|██████ | 1358/2222 [24:29<15:36, 1.08s/it]
61%|██████ | 1359/2222 [24:30<15:36, 1.08s/it]
61%|██████ | 1360/2222 [24:31<15:30, 1.08s/it]
61%|██████▏ | 1361/2222 [24:32<15:27, 1.08s/it]
61%|██████▏ | 1362/2222 [24:33<15:23, 1.07s/it]
61%|██████▏ | 1363/2222 [24:34<15:31, 1.08s/it]
61%|██████▏ | 1364/2222 [24:35<15:21, 1.07s/it]
61%|██████▏ | 1365/2222 [24:36<15:14, 1.07s/it]
61%|██████▏ | 1366/2222 [24:38<15:20, 1.07s/it]
62%|██████▏ | 1367/2222 [24:39<15:24, 1.08s/it]
62%|██████▏ | 1368/2222 [24:40<15:12, 1.07s/it]
62%|██████▏ | 1369/2222 [24:41<15:11, 1.07s/it]
62%|██████▏ | 1370/2222 [24:42<15:17, 1.08s/it]
62%|██████▏ | 1371/2222 [24:43<15:02, 1.06s/it]
62%|██████▏ | 1372/2222 [24:44<15:09, 1.07s/it]
62%|██████▏ | 1373/2222 [24:45<15:02, 1.06s/it]
62%|██████▏ | 1374/2222 [24:46<15:03, 1.07s/it]
62%|██████▏ | 1375/2222 [24:47<15:03, 1.07s/it]
62%|██████▏ | 1376/2222 [24:48<14:53, 1.06s/it]
62%|██████▏ | 1377/2222 [24:49<14:52, 1.06s/it]
62%|██████▏ | 1378/2222 [24:50<14:45, 1.05s/it]
62%|██████▏ | 1379/2222 [24:51<14:52, 1.06s/it]
62%|██████▏ | 1380/2222 [24:52<14:47, 1.05s/it]
62%|██████▏ | 1381/2222 [24:53<15:00, 1.07s/it]
62%|██████▏ | 1382/2222 [24:55<15:00, 1.07s/it]
62%|██████▏ | 1383/2222 [24:56<15:05, 1.08s/it]
62%|██████▏ | 1384/2222 [24:57<15:08, 1.08s/it]
62%|██████▏ | 1385/2222 [24:58<15:05, 1.08s/it]
62%|██████▏ | 1386/2222 [24:59<15:05, 1.08s/it]
62%|██████▏ | 1387/2222 [25:00<15:07, 1.09s/it]
62%|██████▏ | 1388/2222 [25:01<15:03, 1.08s/it]
63%|██████▎ | 1389/2222 [25:02<15:07, 1.09s/it]
63%|██████▎ | 1390/2222 [25:03<15:06, 1.09s/it]
63%|██████▎ | 1391/2222 [25:04<14:51, 1.07s/it]
63%|██████▎ | 1392/2222 [25:05<14:50, 1.07s/it]
63%|██████▎ | 1393/2222 [25:06<14:57, 1.08s/it]
63%|██████▎ | 1394/2222 [25:08<15:59, 1.16s/it]
63%|██████▎ | 1395/2222 [25:09<15:37, 1.13s/it]
63%|██████▎ | 1396/2222 [25:10<15:13, 1.11s/it]
63%|██████▎ | 1397/2222 [25:11<14:56, 1.09s/it]
63%|██████▎ | 1398/2222 [25:12<14:56, 1.09s/it]
63%|██████▎ | 1399/2222 [25:13<14:55, 1.09s/it]
63%|██████▎ | 1400/2222 [25:14<14:46, 1.08s/it]
63%|██████▎ | 1401/2222 [25:15<14:46, 1.08s/it]
63%|██████▎ | 1402/2222 [25:16<14:47, 1.08s/it]
63%|██████▎ | 1403/2222 [25:18<14:54, 1.09s/it]
63%|██████▎ | 1404/2222 [25:19<14:51, 1.09s/it]
63%|██████▎ | 1405/2222 [25:20<14:43, 1.08s/it]
63%|██████▎ | 1406/2222 [25:21<14:37, 1.08s/it]
63%|██████▎ | 1407/2222 [25:22<14:34, 1.07s/it]
63%|██████▎ | 1408/2222 [25:23<14:30, 1.07s/it]
63%|██████▎ | 1409/2222 [25:24<14:30, 1.07s/it]
63%|██████▎ | 1410/2222 [25:25<14:37, 1.08s/it]
64%|██████▎ | 1411/2222 [25:26<14:45, 1.09s/it]
64%|██████▎ | 1412/2222 [25:27<14:41, 1.09s/it]
64%|██████▎ | 1413/2222 [25:28<14:37, 1.09s/it]
64%|██████▎ | 1414/2222 [25:29<14:36, 1.09s/it]
64%|██████▎ | 1415/2222 [25:30<14:40, 1.09s/it]
64%|██████▎ | 1416/2222 [25:32<14:38, 1.09s/it]
64%|██████▍ | 1417/2222 [25:33<14:29, 1.08s/it]
64%|██████▍ | 1418/2222 [25:34<14:30, 1.08s/it]
64%|██████▍ | 1419/2222 [25:35<14:20, 1.07s/it]
64%|██████▍ | 1420/2222 [25:36<14:12, 1.06s/it]
64%|██████▍ | 1421/2222 [25:37<14:22, 1.08s/it]
64%|██████▍ | 1422/2222 [25:38<14:27, 1.08s/it]
64%|██████▍ | 1423/2222 [25:39<14:15, 1.07s/it]
64%|██████▍ | 1424/2222 [25:40<14:18, 1.08s/it]
64%|██████▍ | 1425/2222 [25:41<14:32, 1.09s/it]
64%|██████▍ | 1426/2222 [25:42<14:14, 1.07s/it]
64%|██████▍ | 1427/2222 [25:43<14:09, 1.07s/it]
64%|██████▍ | 1428/2222 [25:44<14:04, 1.06s/it]
64%|██████▍ | 1429/2222 [25:46<14:12, 1.08s/it]
64%|██████▍ | 1430/2222 [25:47<14:10, 1.07s/it]
64%|██████▍ | 1431/2222 [25:48<14:05, 1.07s/it]
64%|██████▍ | 1432/2222 [25:49<14:04, 1.07s/it]
64%|██████▍ | 1433/2222 [25:50<14:12, 1.08s/it]
65%|██████▍ | 1434/2222 [25:51<14:04, 1.07s/it]
65%|██████▍ | 1435/2222 [25:52<14:06, 1.08s/it]
65%|██████▍ | 1436/2222 [25:53<14:02, 1.07s/it]
65%|██████▍ | 1437/2222 [25:54<14:00, 1.07s/it]
65%|██████▍ | 1438/2222 [25:55<13:57, 1.07s/it]
65%|██████▍ | 1439/2222 [25:56<13:48, 1.06s/it]
65%|██████▍ | 1440/2222 [25:57<13:42, 1.05s/it]
65%|██████▍ | 1441/2222 [25:58<13:46, 1.06s/it]
65%|██████▍ | 1442/2222 [25:59<13:51, 1.07s/it]
65%|██████▍ | 1443/2222 [26:00<13:56, 1.07s/it]
65%|██████▍ | 1444/2222 [26:02<13:56, 1.08s/it]
65%|██████▌ | 1445/2222 [26:03<14:09, 1.09s/it]
65%|██████▌ | 1446/2222 [26:04<14:03, 1.09s/it]
65%|██████▌ | 1447/2222 [26:05<13:54, 1.08s/it]
65%|██████▌ | 1448/2222 [26:06<13:51, 1.07s/it]
65%|██████▌ | 1449/2222 [26:07<13:55, 1.08s/it]
65%|██████▌ | 1450/2222 [26:08<13:48, 1.07s/it]
65%|██████▌ | 1451/2222 [26:09<13:51, 1.08s/it]
65%|██████▌ | 1452/2222 [26:10<13:49, 1.08s/it]
65%|██████▌ | 1453/2222 [26:11<13:45, 1.07s/it]
65%|██████▌ | 1454/2222 [26:12<13:52, 1.08s/it]
65%|██████▌ | 1455/2222 [26:13<13:50, 1.08s/it]
66%|██████▌ | 1456/2222 [26:15<13:42, 1.07s/it]
66%|██████▌ | 1457/2222 [26:16<13:38, 1.07s/it]
66%|██████▌ | 1458/2222 [26:17<13:30, 1.06s/it]
66%|██████▌ | 1459/2222 [26:18<13:34, 1.07s/it]
66%|██████▌ | 1460/2222 [26:19<13:36, 1.07s/it]
66%|██████▌ | 1461/2222 [26:20<13:40, 1.08s/it]
66%|██████▌ | 1462/2222 [26:21<13:35, 1.07s/it]
66%|██████▌ | 1463/2222 [26:22<13:39, 1.08s/it]
66%|██████▌ | 1464/2222 [26:23<13:34, 1.07s/it]
66%|██████▌ | 1465/2222 [26:24<13:37, 1.08s/it]
66%|██████▌ | 1466/2222 [26:25<13:34, 1.08s/it]
66%|██████▌ | 1467/2222 [26:26<13:18, 1.06s/it]
66%|██████▌ | 1468/2222 [26:27<13:34, 1.08s/it]
66%|██████▌ | 1469/2222 [26:28<13:34, 1.08s/it]
66%|██████▌ | 1470/2222 [26:30<13:31, 1.08s/it]
66%|██████▌ | 1471/2222 [26:31<13:34, 1.08s/it]
66%|██████▌ | 1472/2222 [26:32<13:38, 1.09s/it]
66%|██████▋ | 1473/2222 [26:33<13:34, 1.09s/it]
66%|██████▋ | 1474/2222 [26:34<13:29, 1.08s/it]
66%|██████▋ | 1475/2222 [26:35<13:24, 1.08s/it]
66%|██████▋ | 1476/2222 [26:36<13:36, 1.09s/it]
66%|██████▋ | 1477/2222 [26:37<13:28, 1.09s/it]
67%|██████▋ | 1478/2222 [26:38<13:28, 1.09s/it]
67%|██████▋ | 1479/2222 [26:39<13:17, 1.07s/it]
67%|██████▋ | 1480/2222 [26:40<13:15, 1.07s/it]
67%|██████▋ | 1481/2222 [26:41<13:19, 1.08s/it]
67%|██████▋ | 1482/2222 [26:43<13:18, 1.08s/it]
67%|██████▋ | 1483/2222 [26:44<13:16, 1.08s/it]
67%|██████▋ | 1484/2222 [26:45<13:11, 1.07s/it]
67%|██████▋ | 1485/2222 [26:46<13:14, 1.08s/it]
67%|██████▋ | 1486/2222 [26:47<13:09, 1.07s/it]
67%|██████▋ | 1487/2222 [26:48<13:17, 1.08s/it]
67%|██████▋ | 1488/2222 [26:49<13:12, 1.08s/it]
67%|██████▋ | 1489/2222 [26:50<13:14, 1.08s/it]
67%|██████▋ | 1490/2222 [26:51<13:11, 1.08s/it]
67%|██████▋ | 1491/2222 [26:52<13:07, 1.08s/it]
67%|██████▋ | 1492/2222 [26:53<13:06, 1.08s/it]
67%|██████▋ | 1493/2222 [26:54<12:53, 1.06s/it]
67%|██████▋ | 1494/2222 [26:55<12:56, 1.07s/it]
67%|██████▋ | 1495/2222 [26:56<12:54, 1.07s/it]
67%|██████▋ | 1496/2222 [26:58<12:51, 1.06s/it]
67%|██████▋ | 1497/2222 [26:59<12:54, 1.07s/it]
67%|██████▋ | 1498/2222 [27:00<12:52, 1.07s/it]
67%|██████▋ | 1499/2222 [27:01<12:57, 1.07s/it]
68%|██████▊ | 1500/2222 [27:02<13:00, 1.08s/it]
{'loss': 2.0216, 'learning_rate': 1.6246624662466247e-05, 'epoch': 1.35}
68%|██████▊ | 1500/2222 [27:02<13:00, 1.08s/it]
68%|██████▊ | 1501/2222 [27:03<13:00, 1.08s/it]
68%|██████▊ | 1502/2222 [27:04<12:57, 1.08s/it]
68%|██████▊ | 1503/2222 [27:05<12:57, 1.08s/it]
68%|██████▊ | 1504/2222 [27:06<12:51, 1.07s/it]
68%|██████▊ | 1505/2222 [27:07<12:49, 1.07s/it]
68%|██████▊ | 1506/2222 [27:08<12:56, 1.08s/it]
68%|██████▊ | 1507/2222 [27:09<12:49, 1.08s/it]
68%|██████▊ | 1508/2222 [27:10<12:46, 1.07s/it]
68%|██████▊ | 1509/2222 [27:12<12:43, 1.07s/it]
68%|██████▊ | 1510/2222 [27:13<12:42, 1.07s/it]
68%|██████▊ | 1511/2222 [27:14<12:33, 1.06s/it]
68%|██████▊ | 1512/2222 [27:15<12:37, 1.07s/it]
68%|██████▊ | 1513/2222 [27:16<12:33, 1.06s/it]
68%|██████▊ | 1514/2222 [27:17<12:31, 1.06s/it]
68%|██████▊ | 1515/2222 [27:18<12:29, 1.06s/it]
68%|██████▊ | 1516/2222 [27:19<12:37, 1.07s/it]
68%|██████▊ | 1517/2222 [27:20<12:36, 1.07s/it]
68%|██████▊ | 1518/2222 [27:21<12:40, 1.08s/it]
68%|██████▊ | 1519/2222 [27:22<12:29, 1.07s/it]
68%|██████▊ | 1520/2222 [27:23<12:39, 1.08s/it]
68%|██████▊ | 1521/2222 [27:24<12:36, 1.08s/it]
68%|██████▊ | 1522/2222 [27:26<12:39, 1.09s/it]
69%|██████▊ | 1523/2222 [27:27<12:34, 1.08s/it]
69%|██████▊ | 1524/2222 [27:28<12:21, 1.06s/it]
69%|██████▊ | 1525/2222 [27:29<12:22, 1.07s/it]
69%|██████▊ | 1526/2222 [27:30<12:25, 1.07s/it]
69%|██████▊ | 1527/2222 [27:31<12:29, 1.08s/it]
69%|██████▉ | 1528/2222 [27:32<12:17, 1.06s/it]
69%|██████▉ | 1529/2222 [27:33<12:19, 1.07s/it]
69%|██████▉ | 1530/2222 [27:34<12:21, 1.07s/it]
69%|██████▉ | 1531/2222 [27:35<12:14, 1.06s/it]
69%|██████▉ | 1532/2222 [27:36<12:14, 1.06s/it]
69%|██████▉ | 1533/2222 [27:37<12:15, 1.07s/it]
69%|██████▉ | 1534/2222 [27:38<12:10, 1.06s/it]
69%|██████▉ | 1535/2222 [27:39<12:15, 1.07s/it]
69%|██████▉ | 1536/2222 [27:40<12:19, 1.08s/it]
69%|██████▉ | 1537/2222 [27:42<12:16, 1.07s/it]
69%|██████▉ | 1538/2222 [27:43<12:23, 1.09s/it]
69%|██████▉ | 1539/2222 [27:44<12:19, 1.08s/it]
69%|██████▉ | 1540/2222 [27:45<12:09, 1.07s/it]
69%|██████▉ | 1541/2222 [27:46<12:18, 1.08s/it]
69%|██████▉ | 1542/2222 [27:47<12:21, 1.09s/it]
69%|██████▉ | 1543/2222 [27:48<12:11, 1.08s/it]
69%|██████▉ | 1544/2222 [27:49<12:15, 1.08s/it]
70%|██████▉ | 1545/2222 [27:50<12:16, 1.09s/it]
70%|██████▉ | 1546/2222 [27:51<12:05, 1.07s/it]
70%|██████▉ | 1547/2222 [27:52<12:07, 1.08s/it]
70%|██████▉ | 1548/2222 [27:53<12:03, 1.07s/it]
70%|██████▉ | 1549/2222 [27:54<12:05, 1.08s/it]
70%|██████▉ | 1550/2222 [27:56<12:02, 1.08s/it]
70%|██████▉ | 1551/2222 [27:57<12:06, 1.08s/it]
70%|██████▉ | 1552/2222 [27:58<12:05, 1.08s/it]
70%|██████▉ | 1553/2222 [27:59<12:05, 1.08s/it]
70%|██████▉ | 1554/2222 [28:00<12:01, 1.08s/it]
70%|██████▉ | 1555/2222 [28:01<12:08, 1.09s/it]
70%|███████ | 1556/2222 [28:02<12:12, 1.10s/it]
70%|███████ | 1557/2222 [28:03<12:00, 1.08s/it]
70%|███████ | 1558/2222 [28:04<12:00, 1.09s/it]
70%|███████ | 1559/2222 [28:05<12:00, 1.09s/it]
70%|███████ | 1560/2222 [28:06<11:57, 1.08s/it]
70%|███████ | 1561/2222 [28:08<11:57, 1.09s/it]
70%|███████ | 1562/2222 [28:09<11:56, 1.09s/it]
70%|███████ | 1563/2222 [28:10<11:52, 1.08s/it]
70%|███████ | 1564/2222 [28:11<11:51, 1.08s/it]
70%|███████ | 1565/2222 [28:12<11:54, 1.09s/it]
70%|███████ | 1566/2222 [28:13<11:53, 1.09s/it]
71%|███████ | 1567/2222 [28:14<11:48, 1.08s/it]
71%|███████ | 1568/2222 [28:15<11:50, 1.09s/it]
71%|███████ | 1569/2222 [28:16<11:43, 1.08s/it]
71%|███████ | 1570/2222 [28:17<11:37, 1.07s/it]
71%|███████ | 1571/2222 [28:18<11:44, 1.08s/it]
71%|███████ | 1572/2222 [28:19<11:44, 1.08s/it]
71%|███████ | 1573/2222 [28:21<11:51, 1.10s/it]
71%|███████ | 1574/2222 [28:22<11:48, 1.09s/it]
71%|███████ | 1575/2222 [28:23<11:47, 1.09s/it]
71%|███████ | 1576/2222 [28:24<11:41, 1.09s/it]
71%|███████ | 1577/2222 [28:25<11:38, 1.08s/it]
71%|███████ | 1578/2222 [28:26<11:39, 1.09s/it]
71%|███████ | 1579/2222 [28:27<11:34, 1.08s/it]
71%|███████ | 1580/2222 [28:28<11:32, 1.08s/it]
71%|███████ | 1581/2222 [28:29<11:40, 1.09s/it]
71%|███████ | 1582/2222 [28:30<11:33, 1.08s/it]
71%|███████ | 1583/2222 [28:31<11:30, 1.08s/it]
71%|███████▏ | 1584/2222 [28:32<11:26, 1.08s/it]
71%|███████▏ | 1585/2222 [28:33<11:20, 1.07s/it]
71%|███████▏ | 1586/2222 [28:35<11:24, 1.08s/it]
71%|███████▏ | 1587/2222 [28:36<11:21, 1.07s/it]
71%|███████▏ | 1588/2222 [28:37<11:18, 1.07s/it]
72%|███████▏ | 1589/2222 [28:38<11:22, 1.08s/it]
72%|███████▏ | 1590/2222 [28:39<11:19, 1.07s/it]
72%|███████▏ | 1591/2222 [28:40<11:21, 1.08s/it]
72%|███████▏ | 1592/2222 [28:41<11:13, 1.07s/it]
72%|███████▏ | 1593/2222 [28:42<11:16, 1.08s/it]
72%|███████▏ | 1594/2222 [28:43<11:13, 1.07s/it]
72%|███████▏ | 1595/2222 [28:44<11:12, 1.07s/it]
72%|███████▏ | 1596/2222 [28:45<11:12, 1.07s/it]
72%|███████▏ | 1597/2222 [28:46<11:13, 1.08s/it]
72%|███████▏ | 1598/2222 [28:48<11:13, 1.08s/it]
72%|███████▏ | 1599/2222 [28:49<11:10, 1.08s/it]
72%|███████▏ | 1600/2222 [28:50<11:14, 1.08s/it]
72%|███████▏ | 1601/2222 [28:51<11:11, 1.08s/it]
72%|███████▏ | 1602/2222 [28:52<11:08, 1.08s/it]
72%|███████▏ | 1603/2222 [28:53<11:04, 1.07s/it]
72%|███████▏ | 1604/2222 [28:54<11:09, 1.08s/it]
72%|███████▏ | 1605/2222 [28:55<11:08, 1.08s/it]
72%|███████▏ | 1606/2222 [28:56<11:08, 1.08s/it]
72%|███████▏ | 1607/2222 [28:57<11:01, 1.08s/it]
72%|███████▏ | 1608/2222 [28:58<11:02, 1.08s/it]
72%|███████▏ | 1609/2222 [28:59<11:01, 1.08s/it]
72%|███████▏ | 1610/2222 [29:00<10:55, 1.07s/it]
73%|███████▎ | 1611/2222 [29:02<11:00, 1.08s/it]
73%|███████▎ | 1612/2222 [29:03<10:59, 1.08s/it]
73%|███████▎ | 1613/2222 [29:04<10:59, 1.08s/it]
73%|███████▎ | 1614/2222 [29:05<10:53, 1.07s/it]
73%|███████▎ | 1615/2222 [29:06<10:55, 1.08s/it]
73%|███████▎ | 1616/2222 [29:07<10:53, 1.08s/it]
73%|███████▎ | 1617/2222 [29:08<10:52, 1.08s/it]
73%|███████▎ | 1618/2222 [29:09<10:52, 1.08s/it]
73%|███████▎ | 1619/2222 [29:10<10:48, 1.08s/it]
73%|███████▎ | 1620/2222 [29:11<10:45, 1.07s/it]
73%|███████▎ | 1621/2222 [29:12<10:50, 1.08s/it]
73%|███████▎ | 1622/2222 [29:13<10:55, 1.09s/it]
73%|███████▎ | 1623/2222 [29:15<10:49, 1.08s/it]
73%|███████▎ | 1624/2222 [29:16<10:48, 1.08s/it]
73%|███████▎ | 1625/2222 [29:17<10:44, 1.08s/it]
73%|███████▎ | 1626/2222 [29:18<10:35, 1.07s/it]
73%|███████▎ | 1627/2222 [29:19<10:40, 1.08s/it]
73%|███████▎ | 1628/2222 [29:20<10:37, 1.07s/it]
73%|███████▎ | 1629/2222 [29:21<10:36, 1.07s/it]
73%|███████▎ | 1630/2222 [29:22<10:33, 1.07s/it]
73%|███████▎ | 1631/2222 [29:23<10:34, 1.07s/it]
73%|███████▎ | 1632/2222 [29:24<10:36, 1.08s/it]
73%|███████▎ | 1633/2222 [29:25<10:36, 1.08s/it]
74%|███████▎ | 1634/2222 [29:26<10:33, 1.08s/it]
74%|███████▎ | 1635/2222 [29:27<10:35, 1.08s/it]
74%|███████▎ | 1636/2222 [29:29<10:36, 1.09s/it]
74%|███████▎ | 1637/2222 [29:30<10:36, 1.09s/it]
74%|███████▎ | 1638/2222 [29:31<10:34, 1.09s/it]
74%|███████▍ | 1639/2222 [29:32<10:29, 1.08s/it]
74%|███████▍ | 1640/2222 [29:33<10:27, 1.08s/it]
74%|███████▍ | 1641/2222 [29:34<10:31, 1.09s/it]
74%|███████▍ | 1642/2222 [29:35<10:24, 1.08s/it]
74%|███████▍ | 1643/2222 [29:36<10:23, 1.08s/it]
74%|███████▍ | 1644/2222 [29:37<10:28, 1.09s/it]
74%|███████▍ | 1645/2222 [29:38<10:18, 1.07s/it]
74%|███████▍ | 1646/2222 [29:39<10:22, 1.08s/it]
74%|███████▍ | 1647/2222 [29:40<10:18, 1.08s/it]
74%|███████▍ | 1648/2222 [29:41<10:20, 1.08s/it]
74%|███████▍ | 1649/2222 [29:43<10:19, 1.08s/it]
74%|███████▍ | 1650/2222 [29:44<10:12, 1.07s/it]
74%|███████▍ | 1651/2222 [29:45<10:15, 1.08s/it]
74%|███████▍ | 1652/2222 [29:46<10:10, 1.07s/it]
74%|███████▍ | 1653/2222 [29:47<10:08, 1.07s/it]
74%|███████▍ | 1654/2222 [29:48<10:04, 1.06s/it]
74%|███████▍ | 1655/2222 [29:49<10:08, 1.07s/it]
75%|███████▍ | 1656/2222 [29:50<10:04, 1.07s/it]
75%|███████▍ | 1657/2222 [29:51<10:00, 1.06s/it]
75%|███████▍ | 1658/2222 [29:52<10:05, 1.07s/it]
75%|███████▍ | 1659/2222 [29:53<10:04, 1.07s/it]
75%|███████▍ | 1660/2222 [29:54<09:59, 1.07s/it]
75%|███████▍ | 1661/2222 [29:55<10:01, 1.07s/it]
75%|███████▍ | 1662/2222 [29:56<10:00, 1.07s/it]
75%|███████▍ | 1663/2222 [29:58<10:03, 1.08s/it]
75%|███████▍ | 1664/2222 [29:59<10:10, 1.09s/it]
75%|███████▍ | 1665/2222 [30:00<10:02, 1.08s/it]
75%|███████▍ | 1666/2222 [30:01<10:03, 1.09s/it]
75%|███████▌ | 1667/2222 [30:02<10:01, 1.08s/it]
75%|███████▌ | 1668/2222 [30:03<09:55, 1.07s/it]
75%|███████▌ | 1669/2222 [30:04<09:55, 1.08s/it]
75%|███████▌ | 1670/2222 [30:05<09:56, 1.08s/it]
75%|███████▌ | 1671/2222 [30:06<09:54, 1.08s/it]
75%|███████▌ | 1672/2222 [30:07<09:46, 1.07s/it]
75%|███████▌ | 1673/2222 [30:08<09:48, 1.07s/it]
75%|███████▌ | 1674/2222 [30:09<09:46, 1.07s/it]
75%|███████▌ | 1675/2222 [30:10<09:51, 1.08s/it]
75%|███████▌ | 1676/2222 [30:12<09:57, 1.09s/it]
75%|███████▌ | 1677/2222 [30:13<09:55, 1.09s/it]
76%|███████▌ | 1678/2222 [30:14<09:49, 1.08s/it]
76%|███████▌ | 1679/2222 [30:15<09:49, 1.08s/it]
76%|███████▌ | 1680/2222 [30:16<09:45, 1.08s/it]
76%|███████▌ | 1681/2222 [30:17<09:44, 1.08s/it]
76%|███████▌ | 1682/2222 [30:18<09:46, 1.09s/it]
76%|███████▌ | 1683/2222 [30:19<09:40, 1.08s/it]
76%|███████▌ | 1684/2222 [30:20<09:40, 1.08s/it]
76%|███████▌ | 1685/2222 [30:21<09:35, 1.07s/it]
76%|███████▌ | 1686/2222 [30:22<09:34, 1.07s/it]
76%|███████▌ | 1687/2222 [30:23<09:33, 1.07s/it]
76%|███████▌ | 1688/2222 [30:25<09:30, 1.07s/it]
76%|███████▌ | 1689/2222 [30:26<09:29, 1.07s/it]
76%|███████▌ | 1690/2222 [30:27<09:30, 1.07s/it]
76%|███████▌ | 1691/2222 [30:28<09:27, 1.07s/it]
76%|███████▌ | 1692/2222 [30:29<09:23, 1.06s/it]
76%|███████▌ | 1693/2222 [30:30<09:28, 1.07s/it]
76%|███████▌ | 1694/2222 [30:31<09:25, 1.07s/it]
76%|███████▋ | 1695/2222 [30:32<09:28, 1.08s/it]
76%|███████▋ | 1696/2222 [30:33<09:23, 1.07s/it]
76%|███████▋ | 1697/2222 [30:34<09:17, 1.06s/it]
76%|███████▋ | 1698/2222 [30:35<09:20, 1.07s/it]
76%|███████▋ | 1699/2222 [30:36<09:15, 1.06s/it]
77%|███████▋ | 1700/2222 [30:37<09:21, 1.08s/it]
77%|███████▋ | 1701/2222 [30:38<09:17, 1.07s/it]
77%|███████▋ | 1702/2222 [30:39<09:11, 1.06s/it]
77%|███████▋ | 1703/2222 [30:41<09:13, 1.07s/it]
77%|███████▋ | 1704/2222 [30:42<09:12, 1.07s/it]
77%|███████▋ | 1705/2222 [30:43<09:17, 1.08s/it]
77%|███████▋ | 1706/2222 [30:44<09:14, 1.08s/it]
77%|███████▋ | 1707/2222 [30:45<09:11, 1.07s/it]
77%|███████▋ | 1708/2222 [30:46<09:08, 1.07s/it]
77%|███████▋ | 1709/2222 [30:47<09:13, 1.08s/it]
77%|███████▋ | 1710/2222 [30:48<09:07, 1.07s/it]
77%|███████▋ | 1711/2222 [30:49<09:09, 1.07s/it]
77%|███████▋ | 1712/2222 [30:50<09:12, 1.08s/it]
77%|███████▋ | 1713/2222 [30:51<09:08, 1.08s/it]
77%|███████▋ | 1714/2222 [30:52<09:06, 1.07s/it]
77%|███████▋ | 1715/2222 [30:53<09:01, 1.07s/it]
77%|███████▋ | 1716/2222 [30:54<09:00, 1.07s/it]
77%|███████▋ | 1717/2222 [30:56<09:03, 1.08s/it]
77%|███████▋ | 1718/2222 [30:57<08:56, 1.06s/it]
77%|███████▋ | 1719/2222 [30:58<08:55, 1.06s/it]
77%|███████▋ | 1720/2222 [30:59<08:58, 1.07s/it]
77%|███████▋ | 1721/2222 [31:00<08:54, 1.07s/it]
77%|███████▋ | 1722/2222 [31:01<08:56, 1.07s/it]
78%|███████▊ | 1723/2222 [31:02<08:56, 1.08s/it]
78%|███████▊ | 1724/2222 [31:03<08:58, 1.08s/it]
78%|███████▊ | 1725/2222 [31:04<08:53, 1.07s/it]
78%|███████▊ | 1726/2222 [31:05<08:53, 1.08s/it]
78%|███████▊ | 1727/2222 [31:06<08:52, 1.08s/it]
78%|███████▊ | 1728/2222 [31:07<08:52, 1.08s/it]
78%|███████▊ | 1729/2222 [31:08<08:50, 1.08s/it]
78%|███████▊ | 1730/2222 [31:10<08:49, 1.08s/it]
78%|███████▊ | 1731/2222 [31:11<08:45, 1.07s/it]
78%|███████▊ | 1732/2222 [31:12<08:43, 1.07s/it]
78%|███████▊ | 1733/2222 [31:13<08:48, 1.08s/it]
78%|███████▊ | 1734/2222 [31:14<08:43, 1.07s/it]
78%|███████▊ | 1735/2222 [31:15<08:42, 1.07s/it]
78%|███████▊ | 1736/2222 [31:16<08:44, 1.08s/it]
78%|███████▊ | 1737/2222 [31:17<08:44, 1.08s/it]
78%|███████▊ | 1738/2222 [31:18<08:42, 1.08s/it]
78%|███████▊ | 1739/2222 [31:19<08:40, 1.08s/it]
78%|███████▊ | 1740/2222 [31:20<08:35, 1.07s/it]
78%|███████▊ | 1741/2222 [31:21<08:34, 1.07s/it]
78%|███████▊ | 1742/2222 [31:22<08:34, 1.07s/it]
78%|███████▊ | 1743/2222 [31:24<08:39, 1.08s/it]
78%|███████▊ | 1744/2222 [31:25<08:31, 1.07s/it]
79%|███████▊ | 1745/2222 [31:26<08:36, 1.08s/it]
79%|███████▊ | 1746/2222 [31:27<08:34, 1.08s/it]
79%|███████▊ | 1747/2222 [31:28<08:32, 1.08s/it]
79%|███████▊ | 1748/2222 [31:29<08:32, 1.08s/it]
79%|███████▊ | 1749/2222 [31:30<08:30, 1.08s/it]
79%|███████▉ | 1750/2222 [31:31<08:29, 1.08s/it]
79%|███████▉ | 1751/2222 [31:32<08:30, 1.08s/it]
79%|███████▉ | 1752/2222 [31:33<08:29, 1.08s/it]
79%|███████▉ | 1753/2222 [31:34<08:26, 1.08s/it]
79%|███████▉ | 1754/2222 [31:35<08:24, 1.08s/it]
79%|███████▉ | 1755/2222 [31:37<08:26, 1.08s/it]
79%|███████▉ | 1756/2222 [31:38<08:21, 1.08s/it]
79%|███████▉ | 1757/2222 [31:39<08:22, 1.08s/it]
79%|███████▉ | 1758/2222 [31:40<08:17, 1.07s/it]
79%|███████▉ | 1759/2222 [31:41<08:18, 1.08s/it]
79%|███████▉ | 1760/2222 [31:42<08:17, 1.08s/it]
79%|███████▉ | 1761/2222 [31:43<08:15, 1.07s/it]
79%|███████▉ | 1762/2222 [31:44<08:14, 1.08s/it]
79%|███████▉ | 1763/2222 [31:45<08:11, 1.07s/it]
79%|███████▉ | 1764/2222 [31:46<08:11, 1.07s/it]
79%|███████▉ | 1765/2222 [31:47<08:08, 1.07s/it]
79%|███████▉ | 1766/2222 [31:48<08:05, 1.07s/it]
80%|███████▉ | 1767/2222 [31:49<08:07, 1.07s/it]
80%|███████▉ | 1768/2222 [31:50<08:06, 1.07s/it]
80%|███████▉ | 1769/2222 [31:52<08:02, 1.07s/it]
80%|███████▉ | 1770/2222 [31:53<07:59, 1.06s/it]
80%|███████▉ | 1771/2222 [31:54<08:01, 1.07s/it]
80%|███████▉ | 1772/2222 [31:55<07:58, 1.06s/it]
80%|███████▉ | 1773/2222 [31:56<08:00, 1.07s/it]
80%|███████▉ | 1774/2222 [31:57<08:03, 1.08s/it]
80%|███████▉ | 1775/2222 [31:58<08:01, 1.08s/it]
80%|███████▉ | 1776/2222 [31:59<07:56, 1.07s/it]
80%|███████▉ | 1777/2222 [32:00<07:53, 1.06s/it]
80%|████████ | 1778/2222 [32:01<07:52, 1.07s/it]
80%|████████ | 1779/2222 [32:02<07:50, 1.06s/it]
80%|████████ | 1780/2222 [32:03<07:53, 1.07s/it]
80%|████████ | 1781/2222 [32:04<07:58, 1.08s/it]
80%|████████ | 1782/2222 [32:05<07:56, 1.08s/it]
80%|████████ | 1783/2222 [32:07<07:54, 1.08s/it]
80%|████████ | 1784/2222 [32:08<07:48, 1.07s/it]
80%|████████ | 1785/2222 [32:09<07:53, 1.08s/it]
80%|████████ | 1786/2222 [32:10<07:47, 1.07s/it]
80%|████████ | 1787/2222 [32:11<07:45, 1.07s/it]
80%|████████ | 1788/2222 [32:12<07:44, 1.07s/it]
81%|████████ | 1789/2222 [32:13<07:45, 1.07s/it]
81%|████████ | 1790/2222 [32:14<07:43, 1.07s/it]
81%|████████ | 1791/2222 [32:15<07:41, 1.07s/it]
81%|████████ | 1792/2222 [32:16<07:40, 1.07s/it]
81%|████████ | 1793/2222 [32:17<07:41, 1.08s/it]
81%|████████ | 1794/2222 [32:18<07:40, 1.08s/it]
81%|████████ | 1795/2222 [32:19<07:36, 1.07s/it]
81%|████████ | 1796/2222 [32:20<07:36, 1.07s/it]
81%|████████ | 1797/2222 [32:22<07:37, 1.08s/it]
81%|████████ | 1798/2222 [32:23<07:36, 1.08s/it]
81%|████████ | 1799/2222 [32:24<07:36, 1.08s/it]
81%|████████ | 1800/2222 [32:25<07:34, 1.08s/it]
81%|████████ | 1801/2222 [32:26<07:35, 1.08s/it]
81%|████████ | 1802/2222 [32:27<07:30, 1.07s/it]
81%|████████ | 1803/2222 [32:28<07:29, 1.07s/it]
81%|████████ | 1804/2222 [32:29<07:33, 1.08s/it]
81%|████████ | 1805/2222 [32:30<07:28, 1.08s/it]
81%|████████▏ | 1806/2222 [32:31<07:29, 1.08s/it]
81%|████████▏ | 1807/2222 [32:32<07:22, 1.07s/it]
81%|████████▏ | 1808/2222 [32:33<07:25, 1.08s/it]
81%|████████▏ | 1809/2222 [32:34<07:22, 1.07s/it]
81%|████████▏ | 1810/2222 [32:36<07:24, 1.08s/it]
82%|████████▏ | 1811/2222 [32:37<07:22, 1.08s/it]
82%|████████▏ | 1812/2222 [32:38<07:20, 1.07s/it]
82%|████████▏ | 1813/2222 [32:39<07:18, 1.07s/it]
82%|████████▏ | 1814/2222 [32:40<07:17, 1.07s/it]
82%|████████▏ | 1815/2222 [32:41<07:19, 1.08s/it]
82%|████████▏ | 1816/2222 [32:42<07:16, 1.08s/it]
82%|████████▏ | 1817/2222 [32:43<07:18, 1.08s/it]
82%|████████▏ | 1818/2222 [32:44<07:23, 1.10s/it]
82%|████████▏ | 1819/2222 [32:45<07:16, 1.08s/it]
82%|████████▏ | 1820/2222 [32:46<07:14, 1.08s/it]
82%|████████▏ | 1821/2222 [32:47<07:15, 1.08s/it]
82%|████████▏ | 1822/2222 [32:49<07:12, 1.08s/it]
82%|████████▏ | 1823/2222 [32:50<07:08, 1.08s/it]
82%|████████▏ | 1824/2222 [32:51<07:13, 1.09s/it]
82%|████████▏ | 1825/2222 [32:52<07:09, 1.08s/it]
82%|████████▏ | 1826/2222 [32:53<07:10, 1.09s/it]
82%|████████▏ | 1827/2222 [32:54<07:07, 1.08s/it]
82%|████████▏ | 1828/2222 [32:55<07:07, 1.08s/it]
82%|████████▏ | 1829/2222 [32:56<07:05, 1.08s/it]
82%|████████▏ | 1830/2222 [32:57<07:06, 1.09s/it]
82%|████████▏ | 1831/2222 [32:58<07:06, 1.09s/it]
82%|████████▏ | 1832/2222 [32:59<07:05, 1.09s/it]
82%|████████▏ | 1833/2222 [33:00<07:03, 1.09s/it]
83%|████████▎ | 1834/2222 [33:02<07:01, 1.09s/it]
83%|████████▎ | 1835/2222 [33:03<06:56, 1.08s/it]
83%|████████▎ | 1836/2222 [33:04<06:58, 1.08s/it]
83%|████████▎ | 1837/2222 [33:05<06:54, 1.08s/it]
83%|████████▎ | 1838/2222 [33:06<06:53, 1.08s/it]
83%|████████▎ | 1839/2222 [33:07<06:54, 1.08s/it]
83%|████████▎ | 1840/2222 [33:08<06:54, 1.08s/it]
83%|████████▎ | 1841/2222 [33:09<06:52, 1.08s/it]
83%|████████▎ | 1842/2222 [33:10<06:51, 1.08s/it]
83%|████████▎ | 1843/2222 [33:11<06:50, 1.08s/it]
83%|████████▎ | 1844/2222 [33:12<06:46, 1.08s/it]
83%|████████▎ | 1845/2222 [33:13<06:44, 1.07s/it]
83%|████████▎ | 1846/2222 [33:15<06:47, 1.08s/it]
83%|████████▎ | 1847/2222 [33:16<06:41, 1.07s/it]
83%|████████▎ | 1848/2222 [33:17<06:37, 1.06s/it]
83%|████████▎ | 1849/2222 [33:18<06:43, 1.08s/it]
83%|████████▎ | 1850/2222 [33:19<06:38, 1.07s/it]
83%|████████▎ | 1851/2222 [33:20<06:35, 1.07s/it]
83%|████████▎ | 1852/2222 [33:21<06:38, 1.08s/it]
83%|████████▎ | 1853/2222 [33:22<06:33, 1.07s/it]
83%|████████▎ | 1854/2222 [33:23<06:36, 1.08s/it]
83%|████████▎ | 1855/2222 [33:24<06:34, 1.07s/it]
84%|████████▎ | 1856/2222 [33:25<06:34, 1.08s/it]
84%|████████▎ | 1857/2222 [33:26<06:31, 1.07s/it]
84%|████████▎ | 1858/2222 [33:27<06:28, 1.07s/it]
84%|████████▎ | 1859/2222 [33:28<06:28, 1.07s/it]
84%|████████▎ | 1860/2222 [33:30<06:31, 1.08s/it]
84%|████████▍ | 1861/2222 [33:31<06:35, 1.10s/it]
84%|████████▍ | 1862/2222 [33:32<06:31, 1.09s/it]
84%|████████▍ | 1863/2222 [33:33<06:29, 1.09s/it]
84%|████████▍ | 1864/2222 [33:34<06:28, 1.08s/it]
84%|████████▍ | 1865/2222 [33:35<06:26, 1.08s/it]
84%|████████▍ | 1866/2222 [33:36<06:23, 1.08s/it]
84%|████████▍ | 1867/2222 [33:37<06:23, 1.08s/it]
84%|████████▍ | 1868/2222 [33:38<06:24, 1.09s/it]
84%|████████▍ | 1869/2222 [33:39<06:20, 1.08s/it]
84%|████████▍ | 1870/2222 [33:40<06:22, 1.09s/it]
84%|████████▍ | 1871/2222 [33:41<06:19, 1.08s/it]
84%|████████▍ | 1872/2222 [33:43<06:16, 1.08s/it]
84%|████████▍ | 1873/2222 [33:44<06:16, 1.08s/it]
84%|████████▍ | 1874/2222 [33:45<06:13, 1.07s/it]
84%|████████▍ | 1875/2222 [33:46<06:14, 1.08s/it]
84%|████████▍ | 1876/2222 [33:47<06:13, 1.08s/it]
84%|████████▍ | 1877/2222 [33:48<06:10, 1.07s/it]
85%|████████▍ | 1878/2222 [33:49<06:10, 1.08s/it]
85%|████████▍ | 1879/2222 [33:50<06:09, 1.08s/it]
85%|████████▍ | 1880/2222 [33:51<06:05, 1.07s/it]
85%|████████▍ | 1881/2222 [33:52<06:04, 1.07s/it]
85%|████████▍ | 1882/2222 [33:53<06:06, 1.08s/it]
85%|████████▍ | 1883/2222 [33:54<06:04, 1.07s/it]
85%|████████▍ | 1884/2222 [33:55<06:00, 1.07s/it]
85%|████████▍ | 1885/2222 [33:56<06:01, 1.07s/it]
85%|████████▍ | 1886/2222 [33:58<05:57, 1.06s/it]
85%|████████▍ | 1887/2222 [33:59<05:58, 1.07s/it]
85%|████████▍ | 1888/2222 [34:00<05:58, 1.07s/it]
85%|████████▌ | 1889/2222 [34:01<05:55, 1.07s/it]
85%|████████▌ | 1890/2222 [34:02<05:55, 1.07s/it]
85%|████████▌ | 1891/2222 [34:03<05:56, 1.08s/it]
85%|████████▌ | 1892/2222 [34:04<05:52, 1.07s/it]
85%|████████▌ | 1893/2222 [34:05<05:52, 1.07s/it]
85%|████████▌ | 1894/2222 [34:06<05:51, 1.07s/it]
85%|████████▌ | 1895/2222 [34:07<05:50, 1.07s/it]
85%|████████▌ | 1896/2222 [34:08<05:49, 1.07s/it]
85%|████████▌ | 1897/2222 [34:09<05:48, 1.07s/it]
85%|████████▌ | 1898/2222 [34:10<05:42, 1.06s/it]
85%|████████▌ | 1899/2222 [34:11<05:42, 1.06s/it]
86%|████████▌ | 1900/2222 [34:12<05:43, 1.07s/it]
86%|████████▌ | 1901/2222 [34:14<05:40, 1.06s/it]
86%|████████▌ | 1902/2222 [34:15<05:39, 1.06s/it]
86%|████████▌ | 1903/2222 [34:16<05:42, 1.07s/it]
86%|████████▌ | 1904/2222 [34:17<05:40, 1.07s/it]
86%|████████▌ | 1905/2222 [34:18<05:37, 1.07s/it]
86%|████████▌ | 1906/2222 [34:19<05:37, 1.07s/it]
86%|████████▌ | 1907/2222 [34:20<05:38, 1.08s/it]
86%|████████▌ | 1908/2222 [34:21<05:37, 1.07s/it]
86%|████████▌ | 1909/2222 [34:22<05:34, 1.07s/it]
86%|████████▌ | 1910/2222 [34:23<05:36, 1.08s/it]
86%|████████▌ | 1911/2222 [34:24<05:36, 1.08s/it]
86%|████████▌ | 1912/2222 [34:25<05:33, 1.08s/it]
86%|████████▌ | 1913/2222 [34:26<05:32, 1.08s/it]
86%|████████▌ | 1914/2222 [34:28<05:32, 1.08s/it]
86%|████████▌ | 1915/2222 [34:29<05:29, 1.07s/it]
86%|████████▌ | 1916/2222 [34:30<05:27, 1.07s/it]
86%|████████▋ | 1917/2222 [34:31<05:29, 1.08s/it]
86%|████████▋ | 1918/2222 [34:32<05:29, 1.09s/it]
86%|████████▋ | 1919/2222 [34:33<05:31, 1.10s/it]
86%|████████▋ | 1920/2222 [34:34<05:28, 1.09s/it]
86%|████████▋ | 1921/2222 [34:35<05:25, 1.08s/it]
86%|████████▋ | 1922/2222 [34:36<05:23, 1.08s/it]
87%|████████▋ | 1923/2222 [34:37<05:21, 1.08s/it]
87%|████████▋ | 1924/2222 [34:38<05:18, 1.07s/it]
87%|████████▋ | 1925/2222 [34:39<05:17, 1.07s/it]
87%|████████▋ | 1926/2222 [34:40<05:18, 1.07s/it]
87%|████████▋ | 1927/2222 [34:42<05:16, 1.07s/it]
87%|████████▋ | 1928/2222 [34:43<05:14, 1.07s/it]
87%|████████▋ | 1929/2222 [34:44<05:13, 1.07s/it]
87%|████████▋ | 1930/2222 [34:45<05:13, 1.07s/it]
87%|████████▋ | 1931/2222 [34:46<05:16, 1.09s/it]
87%|████████▋ | 1932/2222 [34:47<05:10, 1.07s/it]
87%|████████▋ | 1933/2222 [34:48<05:09, 1.07s/it]
87%|████████▋ | 1934/2222 [34:49<05:09, 1.07s/it]
87%|████████▋ | 1935/2222 [34:50<05:08, 1.07s/it]
87%|████████▋ | 1936/2222 [34:51<05:04, 1.07s/it]
87%|████████▋ | 1937/2222 [34:52<05:02, 1.06s/it]
87%|████████▋ | 1938/2222 [34:53<05:01, 1.06s/it]
87%|████████▋ | 1939/2222 [34:54<05:03, 1.07s/it]
87%|████████▋ | 1940/2222 [34:55<05:02, 1.07s/it]
87%|████████▋ | 1941/2222 [34:57<05:00, 1.07s/it]
87%|████████▋ | 1942/2222 [34:58<05:00, 1.07s/it]
87%|████████▋ | 1943/2222 [34:59<04:59, 1.07s/it]
87%|████████▋ | 1944/2222 [35:00<04:58, 1.07s/it]
88%|████████▊ | 1945/2222 [35:01<04:57, 1.08s/it]
88%|████████▊ | 1946/2222 [35:02<04:57, 1.08s/it]
88%|████████▊ | 1947/2222 [35:03<04:56, 1.08s/it]
88%|████████▊ | 1948/2222 [35:04<04:56, 1.08s/it]
88%|████████▊ | 1949/2222 [35:05<04:53, 1.07s/it]
88%|████████▊ | 1950/2222 [35:06<04:53, 1.08s/it]
88%|████████▊ | 1951/2222 [35:07<04:56, 1.09s/it]
88%|████████▊ | 1952/2222 [35:08<04:52, 1.08s/it]
88%|████████▊ | 1953/2222 [35:10<04:51, 1.09s/it]
88%|████████▊ | 1954/2222 [35:11<04:50, 1.09s/it]
88%|████████▊ | 1955/2222 [35:12<04:51, 1.09s/it]
88%|████████▊ | 1956/2222 [35:13<04:48, 1.08s/it]
88%|████████▊ | 1957/2222 [35:14<04:46, 1.08s/it]
88%|████████▊ | 1958/2222 [35:15<04:46, 1.08s/it]
88%|████████▊ | 1959/2222 [35:16<04:44, 1.08s/it]
88%|████████▊ | 1960/2222 [35:17<04:43, 1.08s/it]
88%|████████▊ | 1961/2222 [35:18<04:42, 1.08s/it]
88%|████████▊ | 1962/2222 [35:19<04:40, 1.08s/it]
88%|████████▊ | 1963/2222 [35:20<04:38, 1.07s/it]
88%|████████▊ | 1964/2222 [35:21<04:36, 1.07s/it]
88%|████████▊ | 1965/2222 [35:22<04:36, 1.08s/it]
88%|████████▊ | 1966/2222 [35:24<04:34, 1.07s/it]
89%|████████▊ | 1967/2222 [35:25<04:34, 1.07s/it]
89%|████████▊ | 1968/2222 [35:26<04:35, 1.08s/it]
89%|████████▊ | 1969/2222 [35:27<04:31, 1.07s/it]
89%|████████▊ | 1970/2222 [35:28<04:32, 1.08s/it]
89%|████████▊ | 1971/2222 [35:29<04:31, 1.08s/it]
89%|████████▊ | 1972/2222 [35:30<04:30, 1.08s/it]
89%|████████▉ | 1973/2222 [35:31<04:30, 1.09s/it]
89%|████████▉ | 1974/2222 [35:32<04:23, 1.06s/it]
89%|████████▉ | 1975/2222 [35:33<04:24, 1.07s/it]
89%|████████▉ | 1976/2222 [35:34<04:24, 1.07s/it]
89%|████████▉ | 1977/2222 [35:35<04:22, 1.07s/it]
89%|████████▉ | 1978/2222 [35:36<04:19, 1.06s/it]
89%|████████▉ | 1979/2222 [35:38<04:21, 1.07s/it]
89%|████████▉ | 1980/2222 [35:39<04:19, 1.07s/it]
89%|████████▉ | 1981/2222 [35:40<04:20, 1.08s/it]
89%|████████▉ | 1982/2222 [35:41<04:19, 1.08s/it]
89%|████████▉ | 1983/2222 [35:42<04:18, 1.08s/it]
89%|████████▉ | 1984/2222 [35:43<04:17, 1.08s/it]
89%|████████▉ | 1985/2222 [35:44<04:17, 1.09s/it]
89%|████████▉ | 1986/2222 [35:45<04:16, 1.09s/it]
89%|████████▉ | 1987/2222 [35:46<04:16, 1.09s/it]
89%|████████▉ | 1988/2222 [35:47<04:13, 1.08s/it]
90%|████████▉ | 1989/2222 [35:48<04:11, 1.08s/it]
90%|████████▉ | 1990/2222 [35:49<04:11, 1.08s/it]
90%|████████▉ | 1991/2222 [35:51<04:11, 1.09s/it]
90%|████████▉ | 1992/2222 [35:52<04:09, 1.09s/it]
90%|████████▉ | 1993/2222 [35:53<04:08, 1.09s/it]
90%|████████▉ | 1994/2222 [35:54<04:07, 1.08s/it]
90%|████████▉ | 1995/2222 [35:55<04:05, 1.08s/it]
90%|████████▉ | 1996/2222 [35:56<04:01, 1.07s/it]
90%|████████▉ | 1997/2222 [35:57<03:59, 1.06s/it]
90%|████████▉ | 1998/2222 [35:58<04:03, 1.09s/it]
90%|████████▉ | 1999/2222 [35:59<04:00, 1.08s/it]
90%|█████████ | 2000/2222 [36:00<03:58, 1.08s/it]
{'loss': 1.9092, 'learning_rate': 4.995499549954996e-06, 'epoch': 1.8}
90%|█████████ | 2000/2222 [36:00<03:58, 1.08s/it]
90%|█████████ | 2001/2222 [36:01<03:56, 1.07s/it]
90%|█████████ | 2002/2222 [36:02<03:52, 1.06s/it]
90%|█████████ | 2003/2222 [36:03<03:52, 1.06s/it]
90%|█████████ | 2004/2222 [36:04<03:52, 1.06s/it]
90%|█████████ | 2005/2222 [36:06<03:53, 1.07s/it]
90%|█████████ | 2006/2222 [36:07<03:53, 1.08s/it]
90%|█████████ | 2007/2222 [36:08<03:52, 1.08s/it]
90%|█████████ | 2008/2222 [36:09<03:50, 1.08s/it]
90%|█████████ | 2009/2222 [36:10<03:47, 1.07s/it]
90%|█████████ | 2010/2222 [36:11<03:47, 1.08s/it]
91%|█████████ | 2011/2222 [36:12<03:46, 1.07s/it]
91%|█████████ | 2012/2222 [36:13<03:43, 1.07s/it]
91%|█████████ | 2013/2222 [36:14<03:43, 1.07s/it]
91%|█████████ | 2014/2222 [36:15<03:41, 1.07s/it]
91%|█████████ | 2015/2222 [36:16<03:42, 1.07s/it]
91%|█████████ | 2016/2222 [36:17<03:41, 1.08s/it]
91%|█████████ | 2017/2222 [36:18<03:39, 1.07s/it]
91%|█████████ | 2018/2222 [36:19<03:37, 1.07s/it]
91%|█████████ | 2019/2222 [36:21<03:37, 1.07s/it]
91%|█████████ | 2020/2222 [36:22<03:36, 1.07s/it]
91%|█████████ | 2021/2222 [36:23<03:36, 1.07s/it]
91%|█████████ | 2022/2222 [36:24<03:35, 1.08s/it]
91%|█████████ | 2023/2222 [36:25<03:33, 1.07s/it]
91%|█████████ | 2024/2222 [36:26<03:31, 1.07s/it]
91%|█████████ | 2025/2222 [36:27<03:32, 1.08s/it]
91%|█████████ | 2026/2222 [36:28<03:29, 1.07s/it]
91%|█████████ | 2027/2222 [36:29<03:30, 1.08s/it]
91%|█████████▏| 2028/2222 [36:30<03:30, 1.08s/it]
91%|█████████▏| 2029/2222 [36:31<03:27, 1.08s/it]
91%|█████████▏| 2030/2222 [36:32<03:27, 1.08s/it]
91%|█████████▏| 2031/2222 [36:33<03:24, 1.07s/it]
91%|█████████▏| 2032/2222 [36:35<03:24, 1.08s/it]
91%|█████████▏| 2033/2222 [36:36<03:22, 1.07s/it]
92%|█████████▏| 2034/2222 [36:37<03:23, 1.08s/it]
92%|█████████▏| 2035/2222 [36:38<03:21, 1.08s/it]
92%|█████████▏| 2036/2222 [36:39<03:18, 1.07s/it]
92%|█████████▏| 2037/2222 [36:40<03:18, 1.07s/it]
92%|█████████▏| 2038/2222 [36:41<03:18, 1.08s/it]
92%|█████████▏| 2039/2222 [36:42<03:17, 1.08s/it]
92%|█████████▏| 2040/2222 [36:43<03:17, 1.08s/it]
92%|█████████▏| 2041/2222 [36:44<03:14, 1.07s/it]
92%|█████████▏| 2042/2222 [36:45<03:12, 1.07s/it]
92%|█████████▏| 2043/2222 [36:46<03:12, 1.08s/it]
92%|█████████▏| 2044/2222 [36:47<03:11, 1.08s/it]
92%|█████████▏| 2045/2222 [36:49<03:10, 1.08s/it]
92%|█████████▏| 2046/2222 [36:50<03:08, 1.07s/it]
92%|█████████▏| 2047/2222 [36:51<03:07, 1.07s/it]
92%|█████████▏| 2048/2222 [36:52<03:05, 1.06s/it]
92%|█████████▏| 2049/2222 [36:53<03:06, 1.08s/it]
92%|█████████▏| 2050/2222 [36:54<03:05, 1.08s/it]
92%|█████████▏| 2051/2222 [36:55<03:04, 1.08s/it]
92%|█████████▏| 2052/2222 [36:56<03:04, 1.09s/it]
92%|█████████▏| 2053/2222 [36:57<03:03, 1.09s/it]
92%|█████████▏| 2054/2222 [36:58<03:01, 1.08s/it]
92%|█████████▏| 2055/2222 [36:59<03:00, 1.08s/it]
93%|█████████▎| 2056/2222 [37:00<02:59, 1.08s/it]
93%|█████████▎| 2057/2222 [37:01<02:59, 1.09s/it]
93%|█████████▎| 2058/2222 [37:03<02:58, 1.09s/it]
93%|█████████▎| 2059/2222 [37:04<02:56, 1.08s/it]
93%|█████████▎| 2060/2222 [37:05<02:53, 1.07s/it]
93%|█████████▎| 2061/2222 [37:06<02:53, 1.08s/it]
93%|█████████▎| 2062/2222 [37:07<02:53, 1.08s/it]
93%|█████████▎| 2063/2222 [37:08<02:51, 1.08s/it]
93%|█████████▎| 2064/2222 [37:09<02:50, 1.08s/it]
93%|█████████▎| 2065/2222 [37:10<02:48, 1.08s/it]
93%|█████████▎| 2066/2222 [37:11<02:48, 1.08s/it]
93%|█████████▎| 2067/2222 [37:12<02:46, 1.08s/it]
93%|█████████▎| 2068/2222 [37:13<02:46, 1.08s/it]
93%|█████████▎| 2069/2222 [37:14<02:45, 1.08s/it]
93%|█████████▎| 2070/2222 [37:16<02:44, 1.08s/it]
93%|█████████▎| 2071/2222 [37:17<02:42, 1.08s/it]
93%|█████████▎| 2072/2222 [37:18<02:40, 1.07s/it]
93%|█████████▎| 2073/2222 [37:19<02:39, 1.07s/it]
93%|█████████▎| 2074/2222 [37:20<02:40, 1.09s/it]
93%|█████████▎| 2075/2222 [37:21<02:39, 1.08s/it]
93%|█████████▎| 2076/2222 [37:22<02:37, 1.08s/it]
93%|█████████▎| 2077/2222 [37:23<02:36, 1.08s/it]
94%|█████████▎| 2078/2222 [37:24<02:35, 1.08s/it]
94%|█████████▎| 2079/2222 [37:26<02:45, 1.16s/it]
94%|█████████▎| 2080/2222 [37:27<02:41, 1.14s/it]
94%|█████████▎| 2081/2222 [37:28<02:36, 1.11s/it]
94%|█████████▎| 2082/2222 [37:29<02:34, 1.10s/it]
94%|█████████▎| 2083/2222 [37:30<02:33, 1.11s/it]
94%|█████████▍| 2084/2222 [37:31<02:32, 1.10s/it]
94%|█████████▍| 2085/2222 [37:32<02:29, 1.09s/it]
94%|█████████▍| 2086/2222 [37:33<02:30, 1.10s/it]
94%|█████████▍| 2087/2222 [37:34<02:27, 1.10s/it]
94%|█████████▍| 2088/2222 [37:35<02:25, 1.09s/it]
94%|█████████▍| 2089/2222 [37:36<02:22, 1.07s/it]
94%|█████████▍| 2090/2222 [37:37<02:23, 1.09s/it]
94%|█████████▍| 2091/2222 [37:39<02:22, 1.09s/it]
94%|█████████▍| 2092/2222 [37:40<02:21, 1.09s/it]
94%|█████████▍| 2093/2222 [37:41<02:19, 1.08s/it]
94%|█████████▍| 2094/2222 [37:42<02:18, 1.08s/it]
94%|█████████▍| 2095/2222 [37:43<02:16, 1.08s/it]
94%|█████████▍| 2096/2222 [37:44<02:15, 1.08s/it]
94%|█████████▍| 2097/2222 [37:45<02:13, 1.07s/it]
94%|█████████▍| 2098/2222 [37:46<02:12, 1.07s/it]
94%|█████████▍| 2099/2222 [37:47<02:10, 1.06s/it]
95%|█████████▍| 2100/2222 [37:48<02:10, 1.07s/it]
95%|█████████▍| 2101/2222 [37:49<02:07, 1.06s/it]
95%|█████████▍| 2102/2222 [37:50<02:07, 1.07s/it]
95%|█████████▍| 2103/2222 [37:51<02:07, 1.07s/it]
95%|█████████▍| 2104/2222 [37:52<02:06, 1.07s/it]
95%|█████████▍| 2105/2222 [37:54<02:06, 1.08s/it]
95%|█████████▍| 2106/2222 [37:55<02:05, 1.08s/it]
95%|█████████▍| 2107/2222 [37:56<02:03, 1.08s/it]
95%|█████████▍| 2108/2222 [37:57<02:03, 1.08s/it]
95%|█████████▍| 2109/2222 [37:58<02:02, 1.09s/it]
95%|█████████▍| 2110/2222 [37:59<02:02, 1.09s/it]
95%|█████████▌| 2111/2222 [38:00<02:00, 1.08s/it]
95%|█████████▌| 2112/2222 [38:01<01:58, 1.08s/it]
95%|█████████▌| 2113/2222 [38:02<01:57, 1.08s/it]
95%|█████████▌| 2114/2222 [38:03<01:57, 1.09s/it]
95%|█████████▌| 2115/2222 [38:04<01:55, 1.08s/it]
95%|█████████▌| 2116/2222 [38:05<01:54, 1.08s/it]
95%|█████████▌| 2117/2222 [38:07<01:53, 1.08s/it]
95%|█████████▌| 2118/2222 [38:08<01:52, 1.08s/it]
95%|█████████▌| 2119/2222 [38:09<01:51, 1.08s/it]
95%|█████████▌| 2120/2222 [38:10<01:49, 1.08s/it]
95%|█████████▌| 2121/2222 [38:11<01:47, 1.07s/it]
95%|█████████▌| 2122/2222 [38:12<01:47, 1.07s/it]
96%|█████████▌| 2123/2222 [38:13<01:47, 1.09s/it]
96%|█████████▌| 2124/2222 [38:14<01:45, 1.08s/it]
96%|█████████▌| 2125/2222 [38:15<01:44, 1.07s/it]
96%|█████████▌| 2126/2222 [38:16<01:43, 1.08s/it]
96%|█████████▌| 2127/2222 [38:17<01:42, 1.08s/it]
96%|█████████▌| 2128/2222 [38:18<01:41, 1.08s/it]
96%|█████████▌| 2129/2222 [38:19<01:39, 1.07s/it]
96%|█████████▌| 2130/2222 [38:21<01:39, 1.08s/it]
96%|█████████▌| 2131/2222 [38:22<01:38, 1.08s/it]
96%|█████████▌| 2132/2222 [38:23<01:38, 1.09s/it]
96%|█████████▌| 2133/2222 [38:24<01:35, 1.07s/it]
96%|█████████▌| 2134/2222 [38:25<01:34, 1.07s/it]
96%|█████████▌| 2135/2222 [38:26<01:33, 1.07s/it]
96%|█████████▌| 2136/2222 [38:27<01:32, 1.08s/it]
96%|█████████▌| 2137/2222 [38:28<01:31, 1.07s/it]
96%|█████████▌| 2138/2222 [38:29<01:31, 1.09s/it]
96%|█████████▋| 2139/2222 [38:30<01:28, 1.07s/it]
96%|█████████▋| 2140/2222 [38:31<01:27, 1.07s/it]
96%|█████████▋| 2141/2222 [38:32<01:26, 1.07s/it]
96%|█████████▋| 2142/2222 [38:33<01:25, 1.07s/it]
96%|█████████▋| 2143/2222 [38:34<01:24, 1.07s/it]
96%|█████████▋| 2144/2222 [38:36<01:23, 1.07s/it]
97%|█████████▋| 2145/2222 [38:37<01:22, 1.07s/it]
97%|█████████▋| 2146/2222 [38:38<01:22, 1.08s/it]
97%|█████████▋| 2147/2222 [38:39<01:21, 1.08s/it]
97%|█████████▋| 2148/2222 [38:40<01:19, 1.08s/it]
97%|█████████▋| 2149/2222 [38:41<01:18, 1.08s/it]
97%|█████████▋| 2150/2222 [38:42<01:16, 1.07s/it]
97%|█████████▋| 2151/2222 [38:43<01:16, 1.08s/it]
97%|█████████▋| 2152/2222 [38:44<01:14, 1.06s/it]
97%|█████████▋| 2153/2222 [38:45<01:13, 1.07s/it]
97%|█████████▋| 2154/2222 [38:46<01:12, 1.07s/it]
97%|█████████▋| 2155/2222 [38:47<01:11, 1.06s/it]
97%|█████████▋| 2156/2222 [38:48<01:10, 1.07s/it]
97%|█████████▋| 2157/2222 [38:49<01:09, 1.07s/it]
97%|█████████▋| 2158/2222 [38:51<01:09, 1.08s/it]
97%|█████████▋| 2159/2222 [38:52<01:07, 1.07s/it]
97%|█████████▋| 2160/2222 [38:53<01:06, 1.07s/it]
97%|█████████▋| 2161/2222 [38:54<01:05, 1.07s/it]
97%|█████████▋| 2162/2222 [38:55<01:03, 1.06s/it]
97%|█████████▋| 2163/2222 [38:56<01:02, 1.06s/it]
97%|█████████▋| 2164/2222 [38:57<01:01, 1.07s/it]
97%|█████████▋| 2165/2222 [38:58<01:00, 1.07s/it]
97%|█████████▋| 2166/2222 [38:59<01:00, 1.08s/it]
98%|█████████▊| 2167/2222 [39:00<00:59, 1.08s/it]
98%|█████████▊| 2168/2222 [39:01<00:58, 1.09s/it]
98%|█████████▊| 2169/2222 [39:02<00:57, 1.08s/it]
98%|█████████▊| 2170/2222 [39:03<00:55, 1.07s/it]
98%|█████████▊| 2171/2222 [39:05<00:55, 1.09s/it]
98%|█████████▊| 2172/2222 [39:06<00:54, 1.09s/it]
98%|█████████▊| 2173/2222 [39:07<00:52, 1.08s/it]
98%|█████████▊| 2174/2222 [39:08<00:51, 1.08s/it]
98%|█████████▊| 2175/2222 [39:09<00:50, 1.08s/it]
98%|█████████▊| 2176/2222 [39:10<00:49, 1.08s/it]
98%|█████████▊| 2177/2222 [39:11<00:48, 1.08s/it]
98%|█████████▊| 2178/2222 [39:12<00:47, 1.08s/it]
98%|█████████▊| 2179/2222 [39:13<00:46, 1.08s/it]
98%|█████████▊| 2180/2222 [39:14<00:45, 1.08s/it]
98%|█████████▊| 2181/2222 [39:15<00:44, 1.08s/it]
98%|█████████▊| 2182/2222 [39:16<00:42, 1.07s/it]
98%|█████████▊| 2183/2222 [39:18<00:42, 1.08s/it]
98%|█████████▊| 2184/2222 [39:19<00:40, 1.07s/it]
98%|█████████▊| 2185/2222 [39:20<00:39, 1.08s/it]
98%|█████████▊| 2186/2222 [39:21<00:38, 1.08s/it]
98%|█████████▊| 2187/2222 [39:22<00:37, 1.07s/it]
98%|█████████▊| 2188/2222 [39:23<00:36, 1.08s/it]
99%|█████████▊| 2189/2222 [39:24<00:35, 1.08s/it]
99%|█████████▊| 2190/2222 [39:25<00:34, 1.08s/it]
99%|█████████▊| 2191/2222 [39:26<00:33, 1.07s/it]
99%|█████████▊| 2192/2222 [39:27<00:32, 1.09s/it]
99%|█████████▊| 2193/2222 [39:28<00:31, 1.08s/it]
99%|█████████▊| 2194/2222 [39:29<00:30, 1.08s/it]
99%|█████████▉| 2195/2222 [39:30<00:29, 1.08s/it]
99%|█████████▉| 2196/2222 [39:32<00:28, 1.08s/it]
99%|█████████▉| 2197/2222 [39:33<00:26, 1.07s/it]
99%|█████████▉| 2198/2222 [39:34<00:25, 1.08s/it]
99%|█████████▉| 2199/2222 [39:35<00:24, 1.08s/it]
99%|█████████▉| 2200/2222 [39:36<00:23, 1.08s/it]
99%|█████████▉| 2201/2222 [39:37<00:22, 1.07s/it]
99%|█████████▉| 2202/2222 [39:38<00:21, 1.07s/it]
99%|█████████▉| 2203/2222 [39:39<00:20, 1.07s/it]
99%|█████████▉| 2204/2222 [39:40<00:19, 1.07s/it]
99%|█████████▉| 2205/2222 [39:41<00:18, 1.07s/it]
99%|█████████▉| 2206/2222 [39:42<00:17, 1.07s/it]
99%|█████████▉| 2207/2222 [39:43<00:16, 1.07s/it]
99%|█████████▉| 2208/2222 [39:44<00:14, 1.07s/it]
99%|█████████▉| 2209/2222 [39:45<00:13, 1.05s/it]
99%|█████████▉| 2210/2222 [39:46<00:12, 1.06s/it]
100%|█████████▉| 2211/2222 [39:48<00:11, 1.06s/it]
100%|█████████▉| 2212/2222 [39:49<00:10, 1.07s/it]
100%|█████████▉| 2213/2222 [39:50<00:09, 1.08s/it]
100%|█████████▉| 2214/2222 [39:51<00:08, 1.09s/it]
100%|█████████▉| 2215/2222 [39:52<00:07, 1.08s/it]
100%|█████████▉| 2216/2222 [39:53<00:06, 1.07s/it]
100%|█████████▉| 2217/2222 [39:54<00:05, 1.06s/it]
100%|█████████▉| 2218/2222 [39:55<00:04, 1.06s/it]
100%|█████████▉| 2219/2222 [39:56<00:03, 1.07s/it]
100%|█████████▉| 2220/2222 [39:57<00:02, 1.07s/it]
100%|█████████▉| 2221/2222 [39:58<00:01, 1.08s/it]
100%|██████████| 2222/2222 [39:59<00:00, 1.01s/it]08/27/2022 00:43:20 - INFO - trainer -
Training completed. Do not forget to share your model on huggingface.co/models =)
Traceback (most recent call last):
File "train.py", line 629, in <module>
Traceback (most recent call last):
File "train.py", line 629, in <module>
Traceback (most recent call last):
File "train.py", line 629, in <module>
{'train_runtime': 2399.7982, 'train_samples_per_second': 0.926, 'epoch': 2.0}
100%|██████████| 2222/2222 [39:59<00:00, 1.01s/it]
100%|██████████| 2222/2222 [39:59<00:00, 1.08s/it]
main()
File "train.py", line 611, in main
[INFO|trainer.py:1344] 2022-08-27 00:43:20,039 >> Saving model checkpoint to out/mabel-joint-cl-al1-mlm-bs-32-lr-5e-5-msl-128-ep-2
main()
File "train.py", line 611, in main
[INFO|configuration_utils.py:300] 2022-08-27 00:43:20,042 >> Configuration saved in out/mabel-joint-cl-al1-mlm-bs-32-lr-5e-5-msl-128-ep-2/config.json
results = trainer.evaluate(eval_senteval_transfer=True)
TypeError: evaluate() got an unexpected keyword argument 'eval_senteval_transfer'
main()
File "train.py", line 611, in main
results = trainer.evaluate(eval_senteval_transfer=True)
TypeError: evaluate() got an unexpected keyword argument 'eval_senteval_transfer'
results = trainer.evaluate(eval_senteval_transfer=True)
TypeError: evaluate() got an unexpected keyword argument 'eval_senteval_transfer'
[INFO|modeling_utils.py:817] 2022-08-27 00:43:21,328 >> Model weights saved in out/mabel-joint-cl-al1-mlm-bs-32-lr-5e-5-msl-128-ep-2/pytorch_model.bin
08/27/2022 00:43:21 - INFO - __main__ - ***** Train results *****
08/27/2022 00:43:21 - INFO - __main__ - epoch = 2.0
08/27/2022 00:43:21 - INFO - __main__ - train_runtime = 2399.7982
08/27/2022 00:43:21 - INFO - __main__ - train_samples_per_second = 0.926
08/27/2022 00:43:21 - INFO - __main__ - *** Evaluate ***
Traceback (most recent call last):
File "train.py", line 629, in <module>
main()
File "train.py", line 611, in main
results = trainer.evaluate(eval_senteval_transfer=True)
TypeError: evaluate() got an unexpected keyword argument 'eval_senteval_transfer'
/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/distributed/launch.py:186: FutureWarning: The module torch.distributed.launch is deprecated
and will be removed in future. Use torchrun.
Note that --use_env is set by default in torchrun.
If your script expects `--local_rank` argument to be set, please
change it to read from `os.environ['LOCAL_RANK']` instead. See
https://pytorch.org/docs/stable/distributed.html#launch-utility for
further instructions
FutureWarning,
WARNING:torch.distributed.elastic.multiprocessing.api:Sending process 24668 closing signal SIGTERM
ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 1 (pid: 24669) of binary: /project/jonmay_231/jacqueline/miniconda3/envs/env/bin/python
Traceback (most recent call last):
File "/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/runpy.py", line 193, in _run_module_as_main
"__main__", mod_spec)
File "/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/distributed/launch.py", line 193, in <module>
main()
File "/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/distributed/launch.py", line 189, in main
launch(args)
File "/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/distributed/launch.py", line 174, in launch
run(args)
File "/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/distributed/run.py", line 713, in run
)(*cmd_args)
File "/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/distributed/launcher/api.py", line 131, in __call__
return launch_agent(self._config, self._entrypoint, list(args))
File "/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/distributed/launcher/api.py", line 261, in launch_agent
failures=result.failures,
torch.distributed.elastic.multiprocessing.errors.ChildFailedError:
============================================================
train.py FAILED
------------------------------------------------------------
Failures:
[1]:
time : 2022-08-27_00:43:23
host : a11-03.hpc.usc.edu
rank : 2 (local_rank: 2)
exitcode : 1 (pid: 24670)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
[2]:
time : 2022-08-27_00:43:23
host : a11-03.hpc.usc.edu
rank : 3 (local_rank: 3)
exitcode : 1 (pid: 24671)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
------------------------------------------------------------
Root Cause (first observed failure):
[0]:
time : 2022-08-27_00:43:23
host : a11-03.hpc.usc.edu
rank : 1 (local_rank: 1)
exitcode : 1 (pid: 24669)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
============================================================
|