log.txt

08/27/2022 00:02:42 - WARNING - __main__ -   Process rank: 0, device: cuda:0, n_gpu: 1 distributed training: True, 16-bits training: True
08/27/2022 00:02:42 - INFO - __main__ -   Training/evaluation parameters OurTrainingArguments(output_dir='out/mabel-joint-cl-al1-mlm-bs-32-lr-5e-5-msl-128-ep-2', overwrite_output_dir=True, do_train=True, do_eval=True, do_predict=False, evaluation_strategy=<EvaluationStrategy.NO: 'no'>, prediction_loss_only=False, per_device_train_batch_size=32, per_device_eval_batch_size=8, per_gpu_train_batch_size=None, per_gpu_eval_batch_size=None, gradient_accumulation_steps=1, eval_accumulation_steps=None, learning_rate=5e-05, weight_decay=0.0, adam_beta1=0.9, adam_beta2=0.999, adam_epsilon=1e-08, max_grad_norm=1.0, num_train_epochs=2.0, max_steps=-1, lr_scheduler_type=<SchedulerType.LINEAR: 'linear'>, warmup_steps=0, logging_dir='runs/Aug27_00-02-42_a11-03.hpc.usc.edu', logging_first_step=False, logging_steps=500, save_steps=125, save_total_limit=None, no_cuda=False, seed=42, fp16=True, fp16_opt_level='O1', fp16_backend='auto', local_rank=0, tpu_num_cores=None, tpu_metrics_debug=False, debug=False, dataloader_drop_last=False, eval_steps=500, dataloader_num_workers=0, past_index=-1, run_name='out/mabel-joint-cl-al1-mlm-bs-32-lr-5e-5-msl-128-ep-2', disable_tqdm=False, remove_unused_columns=True, label_names=None, load_best_model_at_end=True, metric_for_best_model='loss', greater_is_better=False, ignore_data_skip=False, sharded_ddp=False, deepspeed=None, label_smoothing_factor=0.0, adafactor=False, eval_transfer=False, report_to='wandb')
08/27/2022 00:02:42 - WARNING - __main__ -   Process rank: 1, device: cuda:1, n_gpu: 1 distributed training: True, 16-bits training: True
08/27/2022 00:02:42 - WARNING - __main__ -   Process rank: 2, device: cuda:2, n_gpu: 1 distributed training: True, 16-bits training: True
08/27/2022 00:02:42 - WARNING - __main__ -   Process rank: 3, device: cuda:3, n_gpu: 1 distributed training: True, 16-bits training: True
08/27/2022 00:02:42 - WARNING - datasets.builder -   Using custom data configuration default-2f6794b69ce47e79
08/27/2022 00:02:42 - WARNING - datasets.builder -   Using custom data configuration default-2f6794b69ce47e79
08/27/2022 00:02:42 - WARNING - datasets.builder -   Using custom data configuration default-2f6794b69ce47e79
08/27/2022 00:02:43 - WARNING - datasets.builder -   Using custom data configuration default-2f6794b69ce47e79
08/27/2022 00:02:44 - WARNING - datasets.builder -   Reusing dataset csv (.cache/csv/default-2f6794b69ce47e79/0.0.0/652c3096f041ee27b04d2232d41f10547a8fecda3e284a79a0ec4053c916ef7a)

  0%|          | 0/1 [00:00<?, ?it/s]08/27/2022 00:02:44 - WARNING - datasets.builder -   Reusing dataset csv (.cache/csv/default-2f6794b69ce47e79/0.0.0/652c3096f041ee27b04d2232d41f10547a8fecda3e284a79a0ec4053c916ef7a)
08/27/2022 00:02:44 - WARNING - datasets.builder -   Reusing dataset csv (.cache/csv/default-2f6794b69ce47e79/0.0.0/652c3096f041ee27b04d2232d41f10547a8fecda3e284a79a0ec4053c916ef7a)

  0%|          | 0/1 [00:00<?, ?it/s]
  0%|          | 0/1 [00:00<?, ?it/s]08/27/2022 00:02:44 - WARNING - datasets.builder -   Reusing dataset csv (.cache/csv/default-2f6794b69ce47e79/0.0.0/652c3096f041ee27b04d2232d41f10547a8fecda3e284a79a0ec4053c916ef7a)

  0%|          | 0/1 [00:00<?, ?it/s]
100%|██████████| 1/1 [00:00<00:00,  2.77it/s]
100%|██████████| 1/1 [00:00<00:00,  3.24it/s]
100%|██████████| 1/1 [00:00<00:00,  2.76it/s]
100%|██████████| 1/1 [00:00<00:00,  2.76it/s]
100%|██████████| 1/1 [00:00<00:00,  2.72it/s]
100%|██████████| 1/1 [00:00<00:00,  2.74it/s]


100%|██████████| 1/1 [00:00<00:00,  3.20it/s]

100%|██████████| 1/1 [00:00<00:00,  2.75it/s]
[INFO|configuration_utils.py:445] 2022-08-27 00:02:44,795 >> loading configuration file https://huggingface.co/bert-base-uncased/resolve/main/config.json from cache at .cache/3c61d016573b14f7f008c02c4e51a366c67ab274726fe2910691e2a761acf43e.37395cee442ab11005bcd270f3c34464dc1704b715b5d7d52b1a461abe3b9e4e
[INFO|configuration_utils.py:481] 2022-08-27 00:02:44,796 >> Model config BertConfig {
  "architectures": [
    "BertForMaskedLM"
  ],
  "attention_probs_dropout_prob": 0.1,
  "gradient_checkpointing": false,
  "hidden_act": "gelu",
  "hidden_dropout_prob": 0.1,
  "hidden_size": 768,
  "initializer_range": 0.02,
  "intermediate_size": 3072,
  "layer_norm_eps": 1e-12,
  "max_position_embeddings": 512,
  "model_type": "bert",
  "num_attention_heads": 12,
  "num_hidden_layers": 12,
  "pad_token_id": 0,
  "position_embedding_type": "absolute",
  "transformers_version": "4.2.1",
  "type_vocab_size": 2,
  "use_cache": true,
  "vocab_size": 30522
}

[INFO|configuration_utils.py:445] 2022-08-27 00:02:45,107 >> loading configuration file https://huggingface.co/bert-base-uncased/resolve/main/config.json from cache at .cache/3c61d016573b14f7f008c02c4e51a366c67ab274726fe2910691e2a761acf43e.37395cee442ab11005bcd270f3c34464dc1704b715b5d7d52b1a461abe3b9e4e
[INFO|configuration_utils.py:481] 2022-08-27 00:02:45,108 >> Model config BertConfig {
  "architectures": [
    "BertForMaskedLM"
  ],
  "attention_probs_dropout_prob": 0.1,
  "gradient_checkpointing": false,
  "hidden_act": "gelu",
  "hidden_dropout_prob": 0.1,
  "hidden_size": 768,
  "initializer_range": 0.02,
  "intermediate_size": 3072,
  "layer_norm_eps": 1e-12,
  "max_position_embeddings": 512,
  "model_type": "bert",
  "num_attention_heads": 12,
  "num_hidden_layers": 12,
  "pad_token_id": 0,
  "position_embedding_type": "absolute",
  "transformers_version": "4.2.1",
  "type_vocab_size": 2,
  "use_cache": true,
  "vocab_size": 30522
}

[INFO|tokenization_utils_base.py:1766] 2022-08-27 00:02:45,697 >> loading file https://huggingface.co/bert-base-uncased/resolve/main/vocab.txt from cache at .cache/45c3f7a79a80e1cf0a489e5c62b43f173c15db47864303a55d623bb3c96f72a5.d789d64ebfe299b0e416afc4a169632f903f693095b4629a7ea271d5a0cf2c99
[INFO|tokenization_utils_base.py:1766] 2022-08-27 00:02:45,697 >> loading file https://huggingface.co/bert-base-uncased/resolve/main/tokenizer.json from cache at .cache/534479488c54aeaf9c3406f647aa2ec13648c06771ffe269edabebd4c412da1d.7f2721073f19841be16f41b0a70b600ca6b880c8f3df6f3535cbc704371bdfa4
[INFO|modeling_utils.py:1027] 2022-08-27 00:02:46,093 >> loading weights file https://huggingface.co/bert-base-uncased/resolve/main/pytorch_model.bin from cache at .cache/a8041bf617d7f94ea26d15e218abd04afc2004805632abc0ed2066aa16d50d04.faf6ea826ae9c5867d12b22257f9877e6b8367890837bd60f7c54a29633f7f2f
Some weights of the model checkpoint at bert-base-uncased were not used when initializing BertForMabel: ['cls.predictions.bias', 'cls.predictions.transform.dense.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.decoder.weight', 'cls.seq_relationship.weight', 'cls.seq_relationship.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.LayerNorm.bias', 'bert.pooler.dense.weight', 'bert.pooler.dense.bias']
- This IS expected if you are initializing BertForMabel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
- This IS NOT expected if you are initializing BertForMabel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
Some weights of the model checkpoint at bert-base-uncased were not used when initializing BertForMabel: ['cls.predictions.bias', 'cls.predictions.transform.dense.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.decoder.weight', 'cls.seq_relationship.weight', 'cls.seq_relationship.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.LayerNorm.bias', 'bert.pooler.dense.weight', 'bert.pooler.dense.bias']
- This IS expected if you are initializing BertForMabel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
- This IS NOT expected if you are initializing BertForMabel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
Some weights of BertForMabel were not initialized from the model checkpoint at bert-base-uncased and are newly initialized: ['lm_head.bias', 'lm_head.transform.dense.weight', 'lm_head.transform.dense.bias', 'lm_head.transform.LayerNorm.weight', 'lm_head.transform.LayerNorm.bias', 'lm_head.decoder.weight', 'lm_head.decoder.bias', 'mlp.dense1.weight', 'mlp.dense1.bias', 'mlp.dense2.weight', 'mlp.dense2.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
Some weights of BertForMabel were not initialized from the model checkpoint at bert-base-uncased and are newly initialized: ['lm_head.bias', 'lm_head.transform.dense.weight', 'lm_head.transform.dense.bias', 'lm_head.transform.LayerNorm.weight', 'lm_head.transform.LayerNorm.bias', 'lm_head.decoder.weight', 'lm_head.decoder.bias', 'mlp.dense1.weight', 'mlp.dense1.bias', 'mlp.dense2.weight', 'mlp.dense2.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
[WARNING|modeling_utils.py:1135] 2022-08-27 00:02:55,669 >> Some weights of the model checkpoint at bert-base-uncased were not used when initializing BertForMabel: ['cls.predictions.bias', 'cls.predictions.transform.dense.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.decoder.weight', 'cls.seq_relationship.weight', 'cls.seq_relationship.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.LayerNorm.bias', 'bert.pooler.dense.weight', 'bert.pooler.dense.bias']
- This IS expected if you are initializing BertForMabel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
- This IS NOT expected if you are initializing BertForMabel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
[WARNING|modeling_utils.py:1146] 2022-08-27 00:02:55,669 >> Some weights of BertForMabel were not initialized from the model checkpoint at bert-base-uncased and are newly initialized: ['lm_head.bias', 'lm_head.transform.dense.weight', 'lm_head.transform.dense.bias', 'lm_head.transform.LayerNorm.weight', 'lm_head.transform.LayerNorm.bias', 'lm_head.decoder.weight', 'lm_head.decoder.bias', 'mlp.dense1.weight', 'mlp.dense1.bias', 'mlp.dense2.weight', 'mlp.dense2.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
Some weights of the model checkpoint at bert-base-uncased were not used when initializing BertForMabel: ['cls.predictions.bias', 'cls.predictions.transform.dense.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.decoder.weight', 'cls.seq_relationship.weight', 'cls.seq_relationship.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.LayerNorm.bias', 'bert.pooler.dense.weight', 'bert.pooler.dense.bias']
- This IS expected if you are initializing BertForMabel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
- This IS NOT expected if you are initializing BertForMabel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
Some weights of BertForMabel were not initialized from the model checkpoint at bert-base-uncased and are newly initialized: ['lm_head.bias', 'lm_head.transform.dense.weight', 'lm_head.transform.dense.bias', 'lm_head.transform.LayerNorm.weight', 'lm_head.transform.LayerNorm.bias', 'lm_head.decoder.weight', 'lm_head.decoder.bias', 'mlp.dense1.weight', 'mlp.dense1.bias', 'mlp.dense2.weight', 'mlp.dense2.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
[INFO|configuration_utils.py:445] 2022-08-27 00:02:55,967 >> loading configuration file https://huggingface.co/bert-base-uncased/resolve/main/config.json from cache at .cache/3c61d016573b14f7f008c02c4e51a366c67ab274726fe2910691e2a761acf43e.37395cee442ab11005bcd270f3c34464dc1704b715b5d7d52b1a461abe3b9e4e
[INFO|configuration_utils.py:481] 2022-08-27 00:02:55,968 >> Model config BertConfig {
  "architectures": [
    "BertForMaskedLM"
  ],
  "attention_probs_dropout_prob": 0.1,
  "gradient_checkpointing": false,
  "hidden_act": "gelu",
  "hidden_dropout_prob": 0.1,
  "hidden_size": 768,
  "initializer_range": 0.02,
  "intermediate_size": 3072,
  "layer_norm_eps": 1e-12,
  "max_position_embeddings": 512,
  "model_type": "bert",
  "num_attention_heads": 12,
  "num_hidden_layers": 12,
  "pad_token_id": 0,
  "position_embedding_type": "absolute",
  "transformers_version": "4.2.1",
  "type_vocab_size": 2,
  "use_cache": true,
  "vocab_size": 30522
}

[INFO|modeling_utils.py:1027] 2022-08-27 00:02:56,268 >> loading weights file https://huggingface.co/bert-base-uncased/resolve/main/pytorch_model.bin from cache at .cache/a8041bf617d7f94ea26d15e218abd04afc2004805632abc0ed2066aa16d50d04.faf6ea826ae9c5867d12b22257f9877e6b8367890837bd60f7c54a29633f7f2f
Some weights of BertForPreTraining were not initialized from the model checkpoint at bert-base-uncased and are newly initialized: ['cls.predictions.decoder.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
[INFO|modeling_utils.py:1143] 2022-08-27 00:03:05,402 >> All model checkpoint weights were used when initializing BertForPreTraining.

[WARNING|modeling_utils.py:1146] 2022-08-27 00:03:05,415 >> Some weights of BertForPreTraining were not initialized from the model checkpoint at bert-base-uncased and are newly initialized: ['cls.predictions.decoder.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
Some weights of BertForPreTraining were not initialized from the model checkpoint at bert-base-uncased and are newly initialized: ['cls.predictions.decoder.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
Some weights of BertForPreTraining were not initialized from the model checkpoint at bert-base-uncased and are newly initialized: ['cls.predictions.decoder.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
08/27/2022 00:03:05 - WARNING - datasets.arrow_dataset -   Loading cached processed dataset at .cache/csv/default-2f6794b69ce47e79/0.0.0/652c3096f041ee27b04d2232d41f10547a8fecda3e284a79a0ec4053c916ef7a/cache-51922e954a887dd0.arrow
08/27/2022 00:03:05 - WARNING - datasets.arrow_dataset -   Loading cached processed dataset at .cache/csv/default-2f6794b69ce47e79/0.0.0/652c3096f041ee27b04d2232d41f10547a8fecda3e284a79a0ec4053c916ef7a/cache-51922e954a887dd0.arrow
08/27/2022 00:03:05 - WARNING - datasets.arrow_dataset -   Loading cached processed dataset at .cache/csv/default-2f6794b69ce47e79/0.0.0/652c3096f041ee27b04d2232d41f10547a8fecda3e284a79a0ec4053c916ef7a/cache-51922e954a887dd0.arrow
08/27/2022 00:03:05 - WARNING - datasets.arrow_dataset -   Loading cached processed dataset at .cache/csv/default-2f6794b69ce47e79/0.0.0/652c3096f041ee27b04d2232d41f10547a8fecda3e284a79a0ec4053c916ef7a/cache-51922e954a887dd0.arrow
Dataset({
    features: ['bin_mask', 'input_ids', 'token_type_ids', 'attention_mask'],
    num_rows: 142158
})Dataset({
    features: ['bin_mask', 'input_ids', 'token_type_ids', 'attention_mask'],
    num_rows: 142158
})Dataset({
    features: ['bin_mask', 'input_ids', 'token_type_ids', 'attention_mask'],
    num_rows: 142158
})Dataset({
    features: ['bin_mask', 'input_ids', 'token_type_ids', 'attention_mask'],
    num_rows: 142158
})



[INFO|trainer.py:442] 2022-08-27 00:03:19,523 >> The following columns in the training set don't have a corresponding argument in `BertForMabel.forward` and have been ignored: .
[INFO|trainer.py:358] 2022-08-27 00:03:19,528 >> Using amp fp16 backend
08/27/2022 00:03:20 - INFO - trainer -   ***** Running training *****
08/27/2022 00:03:20 - INFO - trainer -     Num examples = 142158
08/27/2022 00:03:20 - INFO - trainer -     Num Epochs = 2
08/27/2022 00:03:20 - INFO - trainer -     Instantaneous batch size per device = 32
08/27/2022 00:03:20 - INFO - trainer -     Total train batch size (w. parallel, distributed & accumulation) = 128
08/27/2022 00:03:20 - INFO - trainer -     Gradient Accumulation steps = 1
08/27/2022 00:03:20 - INFO - trainer -     Total optimization steps = 2222

  0%|          | 0/2222 [00:00<?, ?it/s][W reducer.cpp:1303] Warning: find_unused_parameters=True was specified in DDP constructor, but did not find any unused parameters in the forward pass. This flag results in an extra traversal of the autograd graph every iteration,  which can adversely affect performance. If your model indeed never has any unused parameters in the forward pass, consider turning this flag off. Note that this warning may be a false positive if your model has flow control causing later iterations to have unused parameters. (function operator())
[W reducer.cpp:1303] Warning: find_unused_parameters=True was specified in DDP constructor, but did not find any unused parameters in the forward pass. This flag results in an extra traversal of the autograd graph every iteration,  which can adversely affect performance. If your model indeed never has any unused parameters in the forward pass, consider turning this flag off. Note that this warning may be a false positive if your model has flow control causing later iterations to have unused parameters. (function operator())
[W reducer.cpp:1303] Warning: find_unused_parameters=True was specified in DDP constructor, but did not find any unused parameters in the forward pass. This flag results in an extra traversal of the autograd graph every iteration,  which can adversely affect performance. If your model indeed never has any unused parameters in the forward pass, consider turning this flag off. Note that this warning may be a false positive if your model has flow control causing later iterations to have unused parameters. (function operator())
[W reducer.cpp:1303] Warning: find_unused_parameters=True was specified in DDP constructor, but did not find any unused parameters in the forward pass. This flag results in an extra traversal of the autograd graph every iteration,  which can adversely affect performance. If your model indeed never has any unused parameters in the forward pass, consider turning this flag off. Note that this warning may be a false positive if your model has flow control causing later iterations to have unused parameters. (function operator())
/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/optim/lr_scheduler.py:134: UserWarning: Detected call of `lr_scheduler.step()` before `optimizer.step()`. In PyTorch 1.1.0 and later, you should call them in the opposite order: `optimizer.step()` before `lr_scheduler.step()`.  Failure to do this will result in PyTorch skipping the first value of the learning rate schedule. See more details at https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate
  "https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate", UserWarning)
/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/optim/lr_scheduler.py:134: UserWarning: Detected call of `lr_scheduler.step()` before `optimizer.step()`. In PyTorch 1.1.0 and later, you should call them in the opposite order: `optimizer.step()` before `lr_scheduler.step()`.  Failure to do this will result in PyTorch skipping the first value of the learning rate schedule. See more details at https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate
  "https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate", UserWarning)
/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/optim/lr_scheduler.py:134: UserWarning: Detected call of `lr_scheduler.step()` before `optimizer.step()`. In PyTorch 1.1.0 and later, you should call them in the opposite order: `optimizer.step()` before `lr_scheduler.step()`.  Failure to do this will result in PyTorch skipping the first value of the learning rate schedule. See more details at https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate
  "https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate", UserWarning)
/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/optim/lr_scheduler.py:134: UserWarning: Detected call of `lr_scheduler.step()` before `optimizer.step()`. In PyTorch 1.1.0 and later, you should call them in the opposite order: `optimizer.step()` before `lr_scheduler.step()`.  Failure to do this will result in PyTorch skipping the first value of the learning rate schedule. See more details at https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate
  "https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate", UserWarning)

  0%|          | 1/2222 [00:01<59:49,  1.62s/it]
  0%|          | 2/2222 [00:02<46:30,  1.26s/it]
  0%|          | 3/2222 [00:03<42:58,  1.16s/it]
  0%|          | 4/2222 [00:04<40:42,  1.10s/it]
  0%|          | 5/2222 [00:05<39:36,  1.07s/it]
  0%|          | 6/2222 [00:06<39:03,  1.06s/it]
  0%|          | 7/2222 [00:07<38:24,  1.04s/it]
  0%|          | 8/2222 [00:08<38:52,  1.05s/it]
  0%|          | 9/2222 [00:09<39:07,  1.06s/it]
  0%|          | 10/2222 [00:11<39:40,  1.08s/it]
  0%|          | 11/2222 [00:12<39:47,  1.08s/it]
  1%|          | 12/2222 [00:13<40:08,  1.09s/it]
  1%|          | 13/2222 [00:14<40:08,  1.09s/it]
  1%|          | 14/2222 [00:15<40:06,  1.09s/it]
  1%|          | 15/2222 [00:16<40:08,  1.09s/it]
  1%|          | 16/2222 [00:17<40:08,  1.09s/it]
  1%|          | 17/2222 [00:18<39:47,  1.08s/it]
  1%|          | 18/2222 [00:19<39:47,  1.08s/it]
  1%|          | 19/2222 [00:20<39:38,  1.08s/it]
  1%|          | 20/2222 [00:21<39:46,  1.08s/it]
  1%|          | 21/2222 [00:22<39:11,  1.07s/it]
  1%|          | 22/2222 [00:23<39:20,  1.07s/it]
  1%|          | 23/2222 [00:25<42:53,  1.17s/it]
  1%|          | 24/2222 [00:26<41:44,  1.14s/it]
  1%|          | 25/2222 [00:27<40:55,  1.12s/it]
  1%|          | 26/2222 [00:28<40:22,  1.10s/it]
  1%|          | 27/2222 [00:29<40:15,  1.10s/it]
  1%|▏         | 28/2222 [00:30<40:07,  1.10s/it]
  1%|▏         | 29/2222 [00:31<39:37,  1.08s/it]
  1%|▏         | 30/2222 [00:32<39:38,  1.08s/it]
  1%|▏         | 31/2222 [00:34<39:50,  1.09s/it]
  1%|▏         | 32/2222 [00:35<39:15,  1.08s/it]
  1%|▏         | 33/2222 [00:36<39:20,  1.08s/it]
  2%|▏         | 34/2222 [00:37<39:33,  1.08s/it]
  2%|▏         | 35/2222 [00:38<39:14,  1.08s/it]
  2%|▏         | 36/2222 [00:39<39:13,  1.08s/it]
  2%|▏         | 37/2222 [00:40<39:22,  1.08s/it]
  2%|▏         | 38/2222 [00:41<39:21,  1.08s/it]
  2%|▏         | 39/2222 [00:42<39:24,  1.08s/it]
  2%|▏         | 40/2222 [00:43<39:42,  1.09s/it]
  2%|▏         | 41/2222 [00:44<39:17,  1.08s/it]
  2%|▏         | 42/2222 [00:45<39:26,  1.09s/it]
  2%|▏         | 43/2222 [00:46<39:04,  1.08s/it]
  2%|▏         | 44/2222 [00:48<39:02,  1.08s/it]
  2%|▏         | 45/2222 [00:49<38:56,  1.07s/it]
  2%|▏         | 46/2222 [00:50<39:01,  1.08s/it]
  2%|▏         | 47/2222 [00:51<39:07,  1.08s/it]
  2%|▏         | 48/2222 [00:52<39:24,  1.09s/it]
  2%|▏         | 49/2222 [00:53<39:08,  1.08s/it]
  2%|▏         | 50/2222 [00:54<38:46,  1.07s/it]
  2%|▏         | 51/2222 [00:55<39:06,  1.08s/it]
  2%|▏         | 52/2222 [00:56<38:54,  1.08s/it]
  2%|▏         | 53/2222 [00:57<39:11,  1.08s/it]
  2%|▏         | 54/2222 [00:58<39:10,  1.08s/it]
  2%|▏         | 55/2222 [00:59<38:56,  1.08s/it]
  3%|▎         | 56/2222 [01:00<38:49,  1.08s/it]
  3%|▎         | 57/2222 [01:02<39:11,  1.09s/it]
  3%|▎         | 58/2222 [01:03<39:11,  1.09s/it]
  3%|▎         | 59/2222 [01:04<39:09,  1.09s/it]
  3%|▎         | 60/2222 [01:05<38:54,  1.08s/it]
  3%|▎         | 61/2222 [01:06<38:49,  1.08s/it]
  3%|▎         | 62/2222 [01:07<38:33,  1.07s/it]
  3%|▎         | 63/2222 [01:08<38:36,  1.07s/it]
  3%|▎         | 64/2222 [01:09<38:42,  1.08s/it]
  3%|▎         | 65/2222 [01:10<38:46,  1.08s/it]
  3%|▎         | 66/2222 [01:11<38:59,  1.09s/it]
  3%|▎         | 67/2222 [01:12<38:35,  1.07s/it]
  3%|▎         | 68/2222 [01:13<38:21,  1.07s/it]
  3%|▎         | 69/2222 [01:14<38:21,  1.07s/it]
  3%|▎         | 70/2222 [01:16<38:23,  1.07s/it]
  3%|▎         | 71/2222 [01:17<38:39,  1.08s/it]
  3%|▎         | 72/2222 [01:18<38:32,  1.08s/it]
  3%|▎         | 73/2222 [01:19<38:20,  1.07s/it]
  3%|▎         | 74/2222 [01:20<38:17,  1.07s/it]
  3%|▎         | 75/2222 [01:21<38:08,  1.07s/it]
  3%|▎         | 76/2222 [01:22<38:10,  1.07s/it]
  3%|▎         | 77/2222 [01:23<38:30,  1.08s/it]
  4%|▎         | 78/2222 [01:24<38:17,  1.07s/it]
  4%|▎         | 79/2222 [01:25<38:20,  1.07s/it]
  4%|▎         | 80/2222 [01:26<38:27,  1.08s/it]
  4%|▎         | 81/2222 [01:27<38:35,  1.08s/it]
  4%|▎         | 82/2222 [01:28<38:17,  1.07s/it]
  4%|▎         | 83/2222 [01:30<38:20,  1.08s/it]
  4%|▍         | 84/2222 [01:31<38:58,  1.09s/it]
  4%|▍         | 85/2222 [01:32<39:00,  1.10s/it]
  4%|▍         | 86/2222 [01:33<38:32,  1.08s/it]
  4%|▍         | 87/2222 [01:34<38:38,  1.09s/it]
  4%|▍         | 88/2222 [01:35<38:17,  1.08s/it]
  4%|▍         | 89/2222 [01:36<38:14,  1.08s/it]
  4%|▍         | 90/2222 [01:37<38:30,  1.08s/it]
  4%|▍         | 91/2222 [01:38<38:31,  1.08s/it]
  4%|▍         | 92/2222 [01:39<38:28,  1.08s/it]
  4%|▍         | 93/2222 [01:40<38:28,  1.08s/it]
  4%|▍         | 94/2222 [01:41<37:56,  1.07s/it]
  4%|▍         | 95/2222 [01:43<38:05,  1.07s/it]
  4%|▍         | 96/2222 [01:44<37:35,  1.06s/it]
  4%|▍         | 97/2222 [01:45<38:02,  1.07s/it]
  4%|▍         | 98/2222 [01:46<37:46,  1.07s/it]
  4%|▍         | 99/2222 [01:47<38:22,  1.08s/it]
  5%|▍         | 100/2222 [01:48<38:31,  1.09s/it]
  5%|▍         | 101/2222 [01:49<37:59,  1.07s/it]
  5%|▍         | 102/2222 [01:50<37:55,  1.07s/it]
  5%|▍         | 103/2222 [01:51<38:00,  1.08s/it]
  5%|▍         | 104/2222 [01:52<37:54,  1.07s/it]
  5%|▍         | 105/2222 [01:53<37:48,  1.07s/it]
  5%|▍         | 106/2222 [01:54<37:56,  1.08s/it]
  5%|▍         | 107/2222 [01:55<37:34,  1.07s/it]
  5%|▍         | 108/2222 [01:56<38:02,  1.08s/it]
  5%|▍         | 109/2222 [01:58<38:02,  1.08s/it]
  5%|▍         | 110/2222 [01:59<37:53,  1.08s/it]
  5%|▍         | 111/2222 [02:00<38:18,  1.09s/it]
  5%|▌         | 112/2222 [02:01<37:48,  1.07s/it]
  5%|▌         | 113/2222 [02:02<37:33,  1.07s/it]
  5%|▌         | 114/2222 [02:03<37:25,  1.07s/it]
  5%|▌         | 115/2222 [02:04<37:32,  1.07s/it]
  5%|▌         | 116/2222 [02:05<37:44,  1.08s/it]
  5%|▌         | 117/2222 [02:06<37:33,  1.07s/it]
  5%|▌         | 118/2222 [02:07<37:24,  1.07s/it]
  5%|▌         | 119/2222 [02:08<37:33,  1.07s/it]
  5%|▌         | 120/2222 [02:09<37:03,  1.06s/it]
  5%|▌         | 121/2222 [02:10<37:16,  1.06s/it]
  5%|▌         | 122/2222 [02:11<37:18,  1.07s/it]
  6%|▌         | 123/2222 [02:13<37:09,  1.06s/it]
  6%|▌         | 124/2222 [02:14<37:24,  1.07s/it]
  6%|▌         | 125/2222 [02:15<37:49,  1.08s/it]
  6%|▌         | 126/2222 [02:16<37:55,  1.09s/it]
  6%|▌         | 127/2222 [02:17<38:12,  1.09s/it]
  6%|▌         | 128/2222 [02:18<38:03,  1.09s/it]
  6%|▌         | 129/2222 [02:19<38:05,  1.09s/it]
  6%|▌         | 130/2222 [02:20<38:08,  1.09s/it]
  6%|▌         | 131/2222 [02:21<37:28,  1.08s/it]
  6%|▌         | 132/2222 [02:22<37:35,  1.08s/it]
  6%|▌         | 133/2222 [02:23<37:30,  1.08s/it]
  6%|▌         | 134/2222 [02:24<37:43,  1.08s/it]
  6%|▌         | 135/2222 [02:26<37:49,  1.09s/it]
  6%|▌         | 136/2222 [02:27<37:59,  1.09s/it]
  6%|▌         | 137/2222 [02:28<37:53,  1.09s/it]
  6%|▌         | 138/2222 [02:29<37:45,  1.09s/it]
  6%|▋         | 139/2222 [02:30<37:40,  1.09s/it]
  6%|▋         | 140/2222 [02:31<37:25,  1.08s/it]
  6%|▋         | 141/2222 [02:32<38:01,  1.10s/it]
  6%|▋         | 142/2222 [02:33<37:55,  1.09s/it]
  6%|▋         | 143/2222 [02:34<37:38,  1.09s/it]
  6%|▋         | 144/2222 [02:35<37:44,  1.09s/it]
  7%|▋         | 145/2222 [02:36<37:51,  1.09s/it]
  7%|▋         | 146/2222 [02:38<37:43,  1.09s/it]
  7%|▋         | 147/2222 [02:39<38:09,  1.10s/it]
  7%|▋         | 148/2222 [02:40<37:39,  1.09s/it]
  7%|▋         | 149/2222 [02:41<37:28,  1.08s/it]
  7%|▋         | 150/2222 [02:42<37:16,  1.08s/it]
  7%|▋         | 151/2222 [02:43<37:21,  1.08s/it]
  7%|▋         | 152/2222 [02:44<37:09,  1.08s/it]
  7%|▋         | 153/2222 [02:45<37:02,  1.07s/it]
  7%|▋         | 154/2222 [02:46<37:27,  1.09s/it]
  7%|▋         | 155/2222 [02:47<37:03,  1.08s/it]
  7%|▋         | 156/2222 [02:48<37:13,  1.08s/it]
  7%|▋         | 157/2222 [02:49<37:01,  1.08s/it]
  7%|▋         | 158/2222 [02:51<37:16,  1.08s/it]
  7%|▋         | 159/2222 [02:52<36:50,  1.07s/it]
  7%|▋         | 160/2222 [02:53<37:02,  1.08s/it]
  7%|▋         | 161/2222 [02:54<37:05,  1.08s/it]
  7%|▋         | 162/2222 [02:55<37:15,  1.09s/it]
  7%|▋         | 163/2222 [02:56<36:57,  1.08s/it]
  7%|▋         | 164/2222 [02:57<36:48,  1.07s/it]
  7%|▋         | 165/2222 [02:58<36:37,  1.07s/it]
  7%|▋         | 166/2222 [02:59<36:30,  1.07s/it]
  8%|▊         | 167/2222 [03:00<36:30,  1.07s/it]
  8%|▊         | 168/2222 [03:01<36:23,  1.06s/it]
  8%|▊         | 169/2222 [03:02<36:35,  1.07s/it]
  8%|▊         | 170/2222 [03:03<36:19,  1.06s/it]
  8%|▊         | 171/2222 [03:04<36:26,  1.07s/it]
  8%|▊         | 172/2222 [03:06<36:37,  1.07s/it]
  8%|▊         | 173/2222 [03:07<36:36,  1.07s/it]
  8%|▊         | 174/2222 [03:08<36:47,  1.08s/it]
  8%|▊         | 175/2222 [03:09<36:56,  1.08s/it]
  8%|▊         | 176/2222 [03:10<36:27,  1.07s/it]
  8%|▊         | 177/2222 [03:11<36:36,  1.07s/it]
  8%|▊         | 178/2222 [03:12<36:45,  1.08s/it]
  8%|▊         | 179/2222 [03:13<36:31,  1.07s/it]
  8%|▊         | 180/2222 [03:14<36:08,  1.06s/it]
  8%|▊         | 181/2222 [03:15<36:31,  1.07s/it]
  8%|▊         | 182/2222 [03:16<36:36,  1.08s/it]
  8%|▊         | 183/2222 [03:17<36:51,  1.08s/it]
  8%|▊         | 184/2222 [03:18<36:44,  1.08s/it]
  8%|▊         | 185/2222 [03:20<36:38,  1.08s/it]
  8%|▊         | 186/2222 [03:21<36:29,  1.08s/it]
  8%|▊         | 187/2222 [03:22<36:27,  1.07s/it]
  8%|▊         | 188/2222 [03:23<36:29,  1.08s/it]
  9%|▊         | 189/2222 [03:24<36:41,  1.08s/it]
  9%|▊         | 190/2222 [03:25<36:23,  1.07s/it]
  9%|▊         | 191/2222 [03:26<36:36,  1.08s/it]
  9%|▊         | 192/2222 [03:27<36:09,  1.07s/it]
  9%|▊         | 193/2222 [03:28<36:25,  1.08s/it]
  9%|▊         | 194/2222 [03:29<36:30,  1.08s/it]
  9%|▉         | 195/2222 [03:30<36:25,  1.08s/it]
  9%|▉         | 196/2222 [03:31<36:18,  1.08s/it]
  9%|▉         | 197/2222 [03:32<36:30,  1.08s/it]
  9%|▉         | 198/2222 [03:34<36:21,  1.08s/it]
  9%|▉         | 199/2222 [03:35<36:15,  1.08s/it]
  9%|▉         | 200/2222 [03:36<36:21,  1.08s/it]
  9%|▉         | 201/2222 [03:37<36:37,  1.09s/it]
  9%|▉         | 202/2222 [03:38<36:17,  1.08s/it]
  9%|▉         | 203/2222 [03:39<36:44,  1.09s/it]
  9%|▉         | 204/2222 [03:40<36:37,  1.09s/it]
  9%|▉         | 205/2222 [03:41<36:04,  1.07s/it]
  9%|▉         | 206/2222 [03:42<35:47,  1.07s/it]
  9%|▉         | 207/2222 [03:43<36:02,  1.07s/it]
  9%|▉         | 208/2222 [03:44<36:11,  1.08s/it]
  9%|▉         | 209/2222 [03:45<36:32,  1.09s/it]
  9%|▉         | 210/2222 [03:46<36:11,  1.08s/it]
  9%|▉         | 211/2222 [03:48<36:00,  1.07s/it]
 10%|▉         | 212/2222 [03:49<35:35,  1.06s/it]
 10%|▉         | 213/2222 [03:50<35:53,  1.07s/it]
 10%|▉         | 214/2222 [03:51<35:59,  1.08s/it]
 10%|▉         | 215/2222 [03:52<35:55,  1.07s/it]
 10%|▉         | 216/2222 [03:53<35:44,  1.07s/it]
 10%|▉         | 217/2222 [03:54<35:35,  1.07s/it]
 10%|▉         | 218/2222 [03:55<35:48,  1.07s/it]
 10%|▉         | 219/2222 [03:56<36:01,  1.08s/it]
 10%|▉         | 220/2222 [03:57<35:56,  1.08s/it]
 10%|▉         | 221/2222 [03:58<35:44,  1.07s/it]
 10%|▉         | 222/2222 [03:59<35:31,  1.07s/it]
 10%|█         | 223/2222 [04:00<35:48,  1.07s/it]
 10%|█         | 224/2222 [04:01<35:39,  1.07s/it]
 10%|█         | 225/2222 [04:03<35:55,  1.08s/it]
 10%|█         | 226/2222 [04:04<35:58,  1.08s/it]
 10%|█         | 227/2222 [04:05<36:04,  1.08s/it]
 10%|█         | 228/2222 [04:06<35:51,  1.08s/it]
 10%|█         | 229/2222 [04:07<35:38,  1.07s/it]
 10%|█         | 230/2222 [04:08<35:36,  1.07s/it]
 10%|█         | 231/2222 [04:09<35:32,  1.07s/it]
 10%|█         | 232/2222 [04:10<35:36,  1.07s/it]
 10%|█         | 233/2222 [04:11<35:24,  1.07s/it]
 11%|█         | 234/2222 [04:12<35:25,  1.07s/it]
 11%|█         | 235/2222 [04:13<35:56,  1.09s/it]
 11%|█         | 236/2222 [04:14<35:48,  1.08s/it]
 11%|█         | 237/2222 [04:16<36:01,  1.09s/it]
 11%|█         | 238/2222 [04:17<35:45,  1.08s/it]
 11%|█         | 239/2222 [04:18<35:48,  1.08s/it]
 11%|█         | 240/2222 [04:19<35:44,  1.08s/it]
 11%|█         | 241/2222 [04:20<35:49,  1.09s/it]
 11%|█         | 242/2222 [04:21<35:46,  1.08s/it]
 11%|█         | 243/2222 [04:22<36:00,  1.09s/it]
 11%|█         | 244/2222 [04:23<35:42,  1.08s/it]
 11%|█         | 245/2222 [04:24<35:40,  1.08s/it]
 11%|█         | 246/2222 [04:25<35:32,  1.08s/it]
 11%|█         | 247/2222 [04:26<35:17,  1.07s/it]
 11%|█         | 248/2222 [04:27<35:33,  1.08s/it]
 11%|█         | 249/2222 [04:28<35:07,  1.07s/it]
 11%|█▏        | 250/2222 [04:30<35:06,  1.07s/it]
 11%|█▏        | 251/2222 [04:31<35:13,  1.07s/it]
 11%|█▏        | 252/2222 [04:32<35:27,  1.08s/it]
 11%|█▏        | 253/2222 [04:33<35:29,  1.08s/it]
 11%|█▏        | 254/2222 [04:34<35:27,  1.08s/it]
 11%|█▏        | 255/2222 [04:35<35:55,  1.10s/it]
 12%|█▏        | 256/2222 [04:36<35:43,  1.09s/it]
 12%|█▏        | 257/2222 [04:37<35:35,  1.09s/it]
 12%|█▏        | 258/2222 [04:38<35:22,  1.08s/it]
 12%|█▏        | 259/2222 [04:39<35:13,  1.08s/it]
 12%|█▏        | 260/2222 [04:40<35:19,  1.08s/it]
 12%|█▏        | 261/2222 [04:41<35:11,  1.08s/it]
 12%|█▏        | 262/2222 [04:42<35:01,  1.07s/it]
 12%|█▏        | 263/2222 [04:44<34:58,  1.07s/it]
 12%|█▏        | 264/2222 [04:45<35:13,  1.08s/it]
 12%|█▏        | 265/2222 [04:46<35:25,  1.09s/it]
 12%|█▏        | 266/2222 [04:47<35:21,  1.08s/it]
 12%|█▏        | 267/2222 [04:48<35:16,  1.08s/it]
 12%|█▏        | 268/2222 [04:49<35:02,  1.08s/it]
 12%|█▏        | 269/2222 [04:50<35:01,  1.08s/it]
 12%|█▏        | 270/2222 [04:51<35:12,  1.08s/it]
 12%|█▏        | 271/2222 [04:52<35:03,  1.08s/it]
 12%|█▏        | 272/2222 [04:53<35:09,  1.08s/it]
 12%|█▏        | 273/2222 [04:54<35:05,  1.08s/it]
 12%|█▏        | 274/2222 [04:55<34:56,  1.08s/it]
 12%|█▏        | 275/2222 [04:57<34:55,  1.08s/it]
 12%|█▏        | 276/2222 [04:58<34:47,  1.07s/it]
 12%|█▏        | 277/2222 [04:59<34:46,  1.07s/it]
 13%|█▎        | 278/2222 [05:00<34:52,  1.08s/it]
 13%|█▎        | 279/2222 [05:01<34:36,  1.07s/it]
 13%|█▎        | 280/2222 [05:02<34:32,  1.07s/it]
 13%|█▎        | 281/2222 [05:03<34:49,  1.08s/it]
 13%|█▎        | 282/2222 [05:04<34:52,  1.08s/it]
 13%|█▎        | 283/2222 [05:05<34:55,  1.08s/it]
 13%|█▎        | 284/2222 [05:06<35:07,  1.09s/it]
 13%|█▎        | 285/2222 [05:07<35:14,  1.09s/it]
 13%|█▎        | 286/2222 [05:08<35:10,  1.09s/it]
 13%|█▎        | 287/2222 [05:10<35:04,  1.09s/it]
 13%|█▎        | 288/2222 [05:11<34:45,  1.08s/it]
 13%|█▎        | 289/2222 [05:12<34:42,  1.08s/it]
 13%|█▎        | 290/2222 [05:13<34:29,  1.07s/it]
 13%|█▎        | 291/2222 [05:14<34:30,  1.07s/it]
 13%|█▎        | 292/2222 [05:15<34:40,  1.08s/it]
 13%|█▎        | 293/2222 [05:16<34:39,  1.08s/it]
 13%|█▎        | 294/2222 [05:17<34:49,  1.08s/it]
 13%|█▎        | 295/2222 [05:18<34:52,  1.09s/it]
 13%|█▎        | 296/2222 [05:19<34:36,  1.08s/it]
 13%|█▎        | 297/2222 [05:20<34:25,  1.07s/it]
 13%|█▎        | 298/2222 [05:21<33:46,  1.05s/it]
 13%|█▎        | 299/2222 [05:22<34:05,  1.06s/it]
 14%|█▎        | 300/2222 [05:23<34:14,  1.07s/it]
 14%|█▎        | 301/2222 [05:25<34:21,  1.07s/it]
 14%|█▎        | 302/2222 [05:26<34:11,  1.07s/it]
 14%|█▎        | 303/2222 [05:27<34:23,  1.08s/it]
 14%|█▎        | 304/2222 [05:28<34:13,  1.07s/it]
 14%|█▎        | 305/2222 [05:29<34:25,  1.08s/it]
 14%|█▍        | 306/2222 [05:30<34:40,  1.09s/it]
 14%|█▍        | 307/2222 [05:31<34:30,  1.08s/it]
 14%|█▍        | 308/2222 [05:32<34:41,  1.09s/it]
 14%|█▍        | 309/2222 [05:33<34:33,  1.08s/it]
 14%|█▍        | 310/2222 [05:34<34:24,  1.08s/it]
 14%|█▍        | 311/2222 [05:35<34:16,  1.08s/it]
 14%|█▍        | 312/2222 [05:36<34:19,  1.08s/it]
 14%|█▍        | 313/2222 [05:37<34:28,  1.08s/it]
 14%|█▍        | 314/2222 [05:39<34:27,  1.08s/it]
 14%|█▍        | 315/2222 [05:40<34:18,  1.08s/it]
 14%|█▍        | 316/2222 [05:41<34:10,  1.08s/it]
 14%|█▍        | 317/2222 [05:42<33:45,  1.06s/it]
 14%|█▍        | 318/2222 [05:43<34:04,  1.07s/it]
 14%|█▍        | 319/2222 [05:44<33:51,  1.07s/it]
 14%|█▍        | 320/2222 [05:45<34:21,  1.08s/it]
 14%|█▍        | 321/2222 [05:46<34:14,  1.08s/it]
 14%|█▍        | 322/2222 [05:47<34:12,  1.08s/it]
 15%|█▍        | 323/2222 [05:48<33:58,  1.07s/it]
 15%|█▍        | 324/2222 [05:49<34:00,  1.07s/it]
 15%|█▍        | 325/2222 [05:50<33:47,  1.07s/it]
 15%|█▍        | 326/2222 [05:51<33:33,  1.06s/it]
 15%|█▍        | 327/2222 [05:52<33:42,  1.07s/it]
 15%|█▍        | 328/2222 [05:54<33:31,  1.06s/it]
 15%|█▍        | 329/2222 [05:55<34:00,  1.08s/it]
 15%|█▍        | 330/2222 [05:56<34:00,  1.08s/it]
 15%|█▍        | 331/2222 [05:57<33:55,  1.08s/it]
 15%|█▍        | 332/2222 [05:58<33:39,  1.07s/it]
 15%|█▍        | 333/2222 [05:59<33:44,  1.07s/it]
 15%|█▌        | 334/2222 [06:00<33:33,  1.07s/it]
 15%|█▌        | 335/2222 [06:01<33:41,  1.07s/it]
 15%|█▌        | 336/2222 [06:02<33:35,  1.07s/it]
 15%|█▌        | 337/2222 [06:03<33:40,  1.07s/it]
 15%|█▌        | 338/2222 [06:04<33:42,  1.07s/it]
 15%|█▌        | 339/2222 [06:05<33:48,  1.08s/it]
 15%|█▌        | 340/2222 [06:06<33:48,  1.08s/it]
 15%|█▌        | 341/2222 [06:08<33:54,  1.08s/it]
 15%|█▌        | 342/2222 [06:09<33:57,  1.08s/it]
 15%|█▌        | 343/2222 [06:10<33:54,  1.08s/it]
 15%|█▌        | 344/2222 [06:11<33:48,  1.08s/it]
 16%|█▌        | 345/2222 [06:12<33:46,  1.08s/it]
 16%|█▌        | 346/2222 [06:13<33:51,  1.08s/it]
 16%|█▌        | 347/2222 [06:14<33:59,  1.09s/it]
 16%|█▌        | 348/2222 [06:15<33:55,  1.09s/it]
 16%|█▌        | 349/2222 [06:16<33:40,  1.08s/it]
 16%|█▌        | 350/2222 [06:17<33:36,  1.08s/it]
 16%|█▌        | 351/2222 [06:18<33:40,  1.08s/it]
 16%|█▌        | 352/2222 [06:19<33:39,  1.08s/it]
 16%|█▌        | 353/2222 [06:20<33:24,  1.07s/it]
 16%|█▌        | 354/2222 [06:22<33:10,  1.07s/it]
 16%|█▌        | 355/2222 [06:23<33:24,  1.07s/it]
 16%|█▌        | 356/2222 [06:24<33:24,  1.07s/it]
 16%|█▌        | 357/2222 [06:25<33:20,  1.07s/it]
 16%|█▌        | 358/2222 [06:26<33:20,  1.07s/it]
 16%|█▌        | 359/2222 [06:27<33:02,  1.06s/it]
 16%|█▌        | 360/2222 [06:28<32:58,  1.06s/it]
 16%|█▌        | 361/2222 [06:29<33:00,  1.06s/it]
 16%|█▋        | 362/2222 [06:30<33:15,  1.07s/it]
 16%|█▋        | 363/2222 [06:31<33:26,  1.08s/it]
 16%|█▋        | 364/2222 [06:32<33:02,  1.07s/it]
 16%|█▋        | 365/2222 [06:33<33:07,  1.07s/it]
 16%|█▋        | 366/2222 [06:34<33:07,  1.07s/it]
 17%|█▋        | 367/2222 [06:36<33:25,  1.08s/it]
 17%|█▋        | 368/2222 [06:37<33:38,  1.09s/it]
 17%|█▋        | 369/2222 [06:38<33:29,  1.08s/it]
 17%|█▋        | 370/2222 [06:39<33:16,  1.08s/it]
 17%|█▋        | 371/2222 [06:40<33:07,  1.07s/it]
 17%|█▋        | 372/2222 [06:41<33:15,  1.08s/it]
 17%|█▋        | 373/2222 [06:42<33:31,  1.09s/it]
 17%|█▋        | 374/2222 [06:43<33:27,  1.09s/it]
 17%|█▋        | 375/2222 [06:44<33:16,  1.08s/it]
 17%|█▋        | 376/2222 [06:45<33:07,  1.08s/it]
 17%|█▋        | 377/2222 [06:46<33:02,  1.07s/it]
 17%|█▋        | 378/2222 [06:47<33:09,  1.08s/it]
 17%|█▋        | 379/2222 [06:48<33:18,  1.08s/it]
 17%|█▋        | 380/2222 [06:50<33:14,  1.08s/it]
 17%|█▋        | 381/2222 [06:51<33:14,  1.08s/it]
 17%|█▋        | 382/2222 [06:52<33:16,  1.08s/it]
 17%|█▋        | 383/2222 [06:53<33:32,  1.09s/it]
 17%|█▋        | 384/2222 [06:54<33:15,  1.09s/it]
 17%|█▋        | 385/2222 [06:55<33:03,  1.08s/it]
 17%|█▋        | 386/2222 [06:56<33:04,  1.08s/it]
 17%|█▋        | 387/2222 [06:57<33:15,  1.09s/it]
 17%|█▋        | 388/2222 [06:58<33:02,  1.08s/it]
 18%|█▊        | 389/2222 [06:59<32:57,  1.08s/it]
 18%|█▊        | 390/2222 [07:00<32:51,  1.08s/it]
 18%|█▊        | 391/2222 [07:01<33:01,  1.08s/it]
 18%|█▊        | 392/2222 [07:03<33:12,  1.09s/it]
 18%|█▊        | 393/2222 [07:04<33:13,  1.09s/it]
 18%|█▊        | 394/2222 [07:05<33:04,  1.09s/it]
 18%|█▊        | 395/2222 [07:06<33:07,  1.09s/it]
 18%|█▊        | 396/2222 [07:07<32:54,  1.08s/it]
 18%|█▊        | 397/2222 [07:08<32:59,  1.08s/it]
 18%|█▊        | 398/2222 [07:09<32:43,  1.08s/it]
 18%|█▊        | 399/2222 [07:10<32:37,  1.07s/it]
 18%|█▊        | 400/2222 [07:11<32:30,  1.07s/it]
 18%|█▊        | 401/2222 [07:12<32:31,  1.07s/it]
 18%|█▊        | 402/2222 [07:13<32:46,  1.08s/it]
 18%|█▊        | 403/2222 [07:14<32:51,  1.08s/it]
 18%|█▊        | 404/2222 [07:15<32:28,  1.07s/it]
 18%|█▊        | 405/2222 [07:17<32:24,  1.07s/it]
 18%|█▊        | 406/2222 [07:18<32:22,  1.07s/it]
 18%|█▊        | 407/2222 [07:19<32:23,  1.07s/it]
 18%|█▊        | 408/2222 [07:20<32:28,  1.07s/it]
 18%|█▊        | 409/2222 [07:21<32:23,  1.07s/it]
 18%|█▊        | 410/2222 [07:22<32:15,  1.07s/it]
 18%|█▊        | 411/2222 [07:23<32:12,  1.07s/it]
 19%|█▊        | 412/2222 [07:24<32:13,  1.07s/it]
 19%|█▊        | 413/2222 [07:25<32:10,  1.07s/it]
 19%|█▊        | 414/2222 [07:26<32:26,  1.08s/it]
 19%|█▊        | 415/2222 [07:27<32:13,  1.07s/it]
 19%|█▊        | 416/2222 [07:28<32:29,  1.08s/it]
 19%|█▉        | 417/2222 [07:29<32:30,  1.08s/it]
 19%|█▉        | 418/2222 [07:31<32:32,  1.08s/it]
 19%|█▉        | 419/2222 [07:32<32:31,  1.08s/it]
 19%|█▉        | 420/2222 [07:33<32:27,  1.08s/it]
 19%|█▉        | 421/2222 [07:34<32:29,  1.08s/it]
 19%|█▉        | 422/2222 [07:35<32:50,  1.09s/it]
 19%|█▉        | 423/2222 [07:36<32:21,  1.08s/it]
 19%|█▉        | 424/2222 [07:37<32:30,  1.08s/it]
 19%|█▉        | 425/2222 [07:38<32:27,  1.08s/it]
 19%|█▉        | 426/2222 [07:39<32:30,  1.09s/it]
 19%|█▉        | 427/2222 [07:40<32:15,  1.08s/it]
 19%|█▉        | 428/2222 [07:41<31:56,  1.07s/it]
 19%|█▉        | 429/2222 [07:42<32:09,  1.08s/it]
 19%|█▉        | 430/2222 [07:44<32:10,  1.08s/it]
 19%|█▉        | 431/2222 [07:45<31:59,  1.07s/it]
 19%|█▉        | 432/2222 [07:46<31:51,  1.07s/it]
 19%|█▉        | 433/2222 [07:47<31:49,  1.07s/it]
 20%|█▉        | 434/2222 [07:48<32:09,  1.08s/it]
 20%|█▉        | 435/2222 [07:49<32:14,  1.08s/it]
 20%|█▉        | 436/2222 [07:50<31:48,  1.07s/it]
 20%|█▉        | 437/2222 [07:51<31:42,  1.07s/it]
 20%|█▉        | 438/2222 [07:52<31:45,  1.07s/it]
 20%|█▉        | 439/2222 [07:53<31:49,  1.07s/it]
 20%|█▉        | 440/2222 [07:54<31:36,  1.06s/it]
 20%|█▉        | 441/2222 [07:55<31:49,  1.07s/it]
 20%|█▉        | 442/2222 [07:56<31:53,  1.08s/it]
 20%|█▉        | 443/2222 [07:57<31:44,  1.07s/it]
 20%|█▉        | 444/2222 [07:58<31:53,  1.08s/it]
 20%|██        | 445/2222 [08:00<31:48,  1.07s/it]
 20%|██        | 446/2222 [08:01<32:01,  1.08s/it]
 20%|██        | 447/2222 [08:02<31:57,  1.08s/it]
 20%|██        | 448/2222 [08:03<31:36,  1.07s/it]
 20%|██        | 449/2222 [08:04<31:51,  1.08s/it]
 20%|██        | 450/2222 [08:05<31:45,  1.08s/it]
 20%|██        | 451/2222 [08:06<31:37,  1.07s/it]
 20%|██        | 452/2222 [08:07<31:52,  1.08s/it]
 20%|██        | 453/2222 [08:08<31:39,  1.07s/it]
 20%|██        | 454/2222 [08:09<31:33,  1.07s/it]
 20%|██        | 455/2222 [08:10<31:24,  1.07s/it]
 21%|██        | 456/2222 [08:11<31:30,  1.07s/it]
 21%|██        | 457/2222 [08:12<31:38,  1.08s/it]
 21%|██        | 458/2222 [08:14<31:32,  1.07s/it]
 21%|██        | 459/2222 [08:15<31:23,  1.07s/it]
 21%|██        | 460/2222 [08:16<31:24,  1.07s/it]
 21%|██        | 461/2222 [08:17<31:10,  1.06s/it]
 21%|██        | 462/2222 [08:18<31:27,  1.07s/it]
 21%|██        | 463/2222 [08:19<31:17,  1.07s/it]
 21%|██        | 464/2222 [08:20<31:08,  1.06s/it]
 21%|██        | 465/2222 [08:21<31:02,  1.06s/it]
 21%|██        | 466/2222 [08:22<31:12,  1.07s/it]
 21%|██        | 467/2222 [08:23<31:31,  1.08s/it]
 21%|██        | 468/2222 [08:24<31:26,  1.08s/it]
 21%|██        | 469/2222 [08:25<31:17,  1.07s/it]
 21%|██        | 470/2222 [08:26<31:04,  1.06s/it]
 21%|██        | 471/2222 [08:27<31:30,  1.08s/it]
 21%|██        | 472/2222 [08:29<31:29,  1.08s/it]
 21%|██▏       | 473/2222 [08:30<31:02,  1.07s/it]
 21%|██▏       | 474/2222 [08:31<31:19,  1.07s/it]
 21%|██▏       | 475/2222 [08:32<31:19,  1.08s/it]
 21%|██▏       | 476/2222 [08:33<31:25,  1.08s/it]
 21%|██▏       | 477/2222 [08:34<31:14,  1.07s/it]
 22%|██▏       | 478/2222 [08:35<30:53,  1.06s/it]
 22%|██▏       | 479/2222 [08:36<30:54,  1.06s/it]
 22%|██▏       | 480/2222 [08:37<31:09,  1.07s/it]
 22%|██▏       | 481/2222 [08:38<31:06,  1.07s/it]
 22%|██▏       | 482/2222 [08:39<31:18,  1.08s/it]
 22%|██▏       | 483/2222 [08:40<31:24,  1.08s/it]
 22%|██▏       | 484/2222 [08:41<31:27,  1.09s/it]
 22%|██▏       | 485/2222 [08:42<31:07,  1.08s/it]
 22%|██▏       | 486/2222 [08:44<31:22,  1.08s/it]
 22%|██▏       | 487/2222 [08:45<31:11,  1.08s/it]
 22%|██▏       | 488/2222 [08:46<31:15,  1.08s/it]
 22%|██▏       | 489/2222 [08:47<30:56,  1.07s/it]
 22%|██▏       | 490/2222 [08:48<31:08,  1.08s/it]
 22%|██▏       | 491/2222 [08:49<31:06,  1.08s/it]
 22%|██▏       | 492/2222 [08:50<31:10,  1.08s/it]
 22%|██▏       | 493/2222 [08:51<30:58,  1.08s/it]
 22%|██▏       | 494/2222 [08:52<30:59,  1.08s/it]
 22%|██▏       | 495/2222 [08:53<30:59,  1.08s/it]
 22%|██▏       | 496/2222 [08:54<31:15,  1.09s/it]
 22%|██▏       | 497/2222 [08:55<30:52,  1.07s/it]
 22%|██▏       | 498/2222 [08:56<30:53,  1.08s/it]
 22%|██▏       | 499/2222 [08:58<31:05,  1.08s/it]
 23%|██▎       | 500/2222 [08:59<30:59,  1.08s/it]
                                                  
{'loss': 3.6766, 'learning_rate': 3.874887488748875e-05, 'epoch': 0.45}

 23%|██▎       | 500/2222 [08:59<30:59,  1.08s/it]
 23%|██▎       | 501/2222 [09:00<30:52,  1.08s/it]
 23%|██▎       | 502/2222 [09:01<30:43,  1.07s/it]
 23%|██▎       | 503/2222 [09:02<30:22,  1.06s/it]
 23%|██▎       | 504/2222 [09:03<30:33,  1.07s/it]
 23%|██▎       | 505/2222 [09:04<30:43,  1.07s/it]
 23%|██▎       | 506/2222 [09:05<30:43,  1.07s/it]
 23%|██▎       | 507/2222 [09:06<30:23,  1.06s/it]
 23%|██▎       | 508/2222 [09:07<30:43,  1.08s/it]
 23%|██▎       | 509/2222 [09:08<30:46,  1.08s/it]
 23%|██▎       | 510/2222 [09:09<30:47,  1.08s/it]
 23%|██▎       | 511/2222 [09:10<30:58,  1.09s/it]
 23%|██▎       | 512/2222 [09:12<30:57,  1.09s/it]
 23%|██▎       | 513/2222 [09:13<30:50,  1.08s/it]
 23%|██▎       | 514/2222 [09:14<31:06,  1.09s/it]
 23%|██▎       | 515/2222 [09:15<30:41,  1.08s/it]
 23%|██▎       | 516/2222 [09:16<30:50,  1.08s/it]
 23%|██▎       | 517/2222 [09:17<30:51,  1.09s/it]
 23%|██▎       | 518/2222 [09:18<30:53,  1.09s/it]
 23%|██▎       | 519/2222 [09:19<30:42,  1.08s/it]
 23%|██▎       | 520/2222 [09:20<30:45,  1.08s/it]
 23%|██▎       | 521/2222 [09:21<30:35,  1.08s/it]
 23%|██▎       | 522/2222 [09:22<30:39,  1.08s/it]
 24%|██▎       | 523/2222 [09:24<30:52,  1.09s/it]
 24%|██▎       | 524/2222 [09:25<30:43,  1.09s/it]
 24%|██▎       | 525/2222 [09:26<30:21,  1.07s/it]
 24%|██▎       | 526/2222 [09:27<30:19,  1.07s/it]
 24%|██▎       | 527/2222 [09:28<30:06,  1.07s/it]
 24%|██▍       | 528/2222 [09:29<30:08,  1.07s/it]
 24%|██▍       | 529/2222 [09:30<30:11,  1.07s/it]
 24%|██▍       | 530/2222 [09:31<30:19,  1.08s/it]
 24%|██▍       | 531/2222 [09:32<30:26,  1.08s/it]
 24%|██▍       | 532/2222 [09:33<30:30,  1.08s/it]
 24%|██▍       | 533/2222 [09:34<30:29,  1.08s/it]
 24%|██▍       | 534/2222 [09:35<30:22,  1.08s/it]
 24%|██▍       | 535/2222 [09:36<30:07,  1.07s/it]
 24%|██▍       | 536/2222 [09:37<30:13,  1.08s/it]
 24%|██▍       | 537/2222 [09:39<30:30,  1.09s/it]
 24%|██▍       | 538/2222 [09:40<30:43,  1.09s/it]
 24%|██▍       | 539/2222 [09:41<30:44,  1.10s/it]
 24%|██▍       | 540/2222 [09:42<30:24,  1.08s/it]
 24%|██▍       | 541/2222 [09:43<30:21,  1.08s/it]
 24%|██▍       | 542/2222 [09:44<30:15,  1.08s/it]
 24%|██▍       | 543/2222 [09:45<30:01,  1.07s/it]
 24%|██▍       | 544/2222 [09:46<29:52,  1.07s/it]
 25%|██▍       | 545/2222 [09:47<29:44,  1.06s/it]
 25%|██▍       | 546/2222 [09:48<30:09,  1.08s/it]
 25%|██▍       | 547/2222 [09:49<30:18,  1.09s/it]
 25%|██▍       | 548/2222 [09:50<30:04,  1.08s/it]
 25%|██▍       | 549/2222 [09:52<29:58,  1.08s/it]
 25%|██▍       | 550/2222 [09:53<29:57,  1.08s/it]
 25%|██▍       | 551/2222 [09:54<29:45,  1.07s/it]
 25%|██▍       | 552/2222 [09:55<29:58,  1.08s/it]
 25%|██▍       | 553/2222 [09:56<30:07,  1.08s/it]
 25%|██▍       | 554/2222 [09:57<29:47,  1.07s/it]
 25%|██▍       | 555/2222 [09:58<29:51,  1.07s/it]
 25%|██▌       | 556/2222 [09:59<29:49,  1.07s/it]
 25%|██▌       | 557/2222 [10:00<29:45,  1.07s/it]
 25%|██▌       | 558/2222 [10:01<29:58,  1.08s/it]
 25%|██▌       | 559/2222 [10:02<30:09,  1.09s/it]
 25%|██▌       | 560/2222 [10:03<29:52,  1.08s/it]
 25%|██▌       | 561/2222 [10:04<29:51,  1.08s/it]
 25%|██▌       | 562/2222 [10:06<29:44,  1.08s/it]
 25%|██▌       | 563/2222 [10:07<29:49,  1.08s/it]
 25%|██▌       | 564/2222 [10:08<29:36,  1.07s/it]
 25%|██▌       | 565/2222 [10:09<29:37,  1.07s/it]
 25%|██▌       | 566/2222 [10:10<29:34,  1.07s/it]
 26%|██▌       | 567/2222 [10:11<29:26,  1.07s/it]
 26%|██▌       | 568/2222 [10:12<29:26,  1.07s/it]
 26%|██▌       | 569/2222 [10:13<29:31,  1.07s/it]
 26%|██▌       | 570/2222 [10:14<29:25,  1.07s/it]
 26%|██▌       | 571/2222 [10:15<29:23,  1.07s/it]
 26%|██▌       | 572/2222 [10:16<29:35,  1.08s/it]
 26%|██▌       | 573/2222 [10:17<29:23,  1.07s/it]
 26%|██▌       | 574/2222 [10:18<29:25,  1.07s/it]
 26%|██▌       | 575/2222 [10:19<29:18,  1.07s/it]
 26%|██▌       | 576/2222 [10:21<29:27,  1.07s/it]
 26%|██▌       | 577/2222 [10:22<29:47,  1.09s/it]
 26%|██▌       | 578/2222 [10:23<29:38,  1.08s/it]
 26%|██▌       | 579/2222 [10:24<29:28,  1.08s/it]
 26%|██▌       | 580/2222 [10:25<29:27,  1.08s/it]
 26%|██▌       | 581/2222 [10:26<29:49,  1.09s/it]
 26%|██▌       | 582/2222 [10:27<29:38,  1.08s/it]
 26%|██▌       | 583/2222 [10:28<29:35,  1.08s/it]
 26%|██▋       | 584/2222 [10:29<29:30,  1.08s/it]
 26%|██▋       | 585/2222 [10:30<29:45,  1.09s/it]
 26%|██▋       | 586/2222 [10:31<29:46,  1.09s/it]
 26%|██▋       | 587/2222 [10:32<29:34,  1.09s/it]
 26%|██▋       | 588/2222 [10:34<29:43,  1.09s/it]
 27%|██▋       | 589/2222 [10:35<29:31,  1.08s/it]
 27%|██▋       | 590/2222 [10:36<29:27,  1.08s/it]
 27%|██▋       | 591/2222 [10:37<29:08,  1.07s/it]
 27%|██▋       | 592/2222 [10:38<29:08,  1.07s/it]
 27%|██▋       | 593/2222 [10:39<28:57,  1.07s/it]
 27%|██▋       | 594/2222 [10:40<29:07,  1.07s/it]
 27%|██▋       | 595/2222 [10:41<29:33,  1.09s/it]
 27%|██▋       | 596/2222 [10:42<29:35,  1.09s/it]
 27%|██▋       | 597/2222 [10:43<29:26,  1.09s/it]
 27%|██▋       | 598/2222 [10:44<29:15,  1.08s/it]
 27%|██▋       | 599/2222 [10:45<29:26,  1.09s/it]
 27%|██▋       | 600/2222 [10:47<29:24,  1.09s/it]
 27%|██▋       | 601/2222 [10:48<29:20,  1.09s/it]
 27%|██▋       | 602/2222 [10:49<29:13,  1.08s/it]
 27%|██▋       | 603/2222 [10:50<29:14,  1.08s/it]
 27%|██▋       | 604/2222 [10:51<29:23,  1.09s/it]
 27%|██▋       | 605/2222 [10:52<29:27,  1.09s/it]
 27%|██▋       | 606/2222 [10:53<29:10,  1.08s/it]
 27%|██▋       | 607/2222 [10:54<29:22,  1.09s/it]
 27%|██▋       | 608/2222 [10:55<29:14,  1.09s/it]
 27%|██▋       | 609/2222 [10:56<29:13,  1.09s/it]
 27%|██▋       | 610/2222 [10:57<29:17,  1.09s/it]
 27%|██▋       | 611/2222 [10:58<29:09,  1.09s/it]
 28%|██▊       | 612/2222 [11:00<29:26,  1.10s/it]
 28%|██▊       | 613/2222 [11:01<29:21,  1.09s/it]
 28%|██▊       | 614/2222 [11:02<28:51,  1.08s/it]
 28%|██▊       | 615/2222 [11:03<28:51,  1.08s/it]
 28%|██▊       | 616/2222 [11:04<28:28,  1.06s/it]
 28%|██▊       | 617/2222 [11:05<28:26,  1.06s/it]
 28%|██▊       | 618/2222 [11:06<28:20,  1.06s/it]
 28%|██▊       | 619/2222 [11:07<28:26,  1.06s/it]
 28%|██▊       | 620/2222 [11:08<28:19,  1.06s/it]
 28%|██▊       | 621/2222 [11:09<28:28,  1.07s/it]
 28%|██▊       | 622/2222 [11:10<28:40,  1.08s/it]
 28%|██▊       | 623/2222 [11:11<28:41,  1.08s/it]
 28%|██▊       | 624/2222 [11:12<28:25,  1.07s/it]
 28%|██▊       | 625/2222 [11:14<28:47,  1.08s/it]
 28%|██▊       | 626/2222 [11:15<28:37,  1.08s/it]
 28%|██▊       | 627/2222 [11:16<28:29,  1.07s/it]
 28%|██▊       | 628/2222 [11:17<28:58,  1.09s/it]
 28%|██▊       | 629/2222 [11:18<28:38,  1.08s/it]
 28%|██▊       | 630/2222 [11:19<28:41,  1.08s/it]
 28%|██▊       | 631/2222 [11:20<28:34,  1.08s/it]
 28%|██▊       | 632/2222 [11:21<28:26,  1.07s/it]
 28%|██▊       | 633/2222 [11:22<28:36,  1.08s/it]
 29%|██▊       | 634/2222 [11:23<28:27,  1.08s/it]
 29%|██▊       | 635/2222 [11:24<28:23,  1.07s/it]
 29%|██▊       | 636/2222 [11:25<28:17,  1.07s/it]
 29%|██▊       | 637/2222 [11:26<28:10,  1.07s/it]
 29%|██▊       | 638/2222 [11:27<28:15,  1.07s/it]
 29%|██▉       | 639/2222 [11:29<28:05,  1.06s/it]
 29%|██▉       | 640/2222 [11:30<28:07,  1.07s/it]
 29%|██▉       | 641/2222 [11:31<28:14,  1.07s/it]
 29%|██▉       | 642/2222 [11:32<28:15,  1.07s/it]
 29%|██▉       | 643/2222 [11:33<28:12,  1.07s/it]
 29%|██▉       | 644/2222 [11:34<28:18,  1.08s/it]
 29%|██▉       | 645/2222 [11:35<28:14,  1.07s/it]
 29%|██▉       | 646/2222 [11:36<28:13,  1.07s/it]
 29%|██▉       | 647/2222 [11:37<28:16,  1.08s/it]
 29%|██▉       | 648/2222 [11:38<28:20,  1.08s/it]
 29%|██▉       | 649/2222 [11:39<28:17,  1.08s/it]
 29%|██▉       | 650/2222 [11:40<28:15,  1.08s/it]
 29%|██▉       | 651/2222 [11:41<28:11,  1.08s/it]
 29%|██▉       | 652/2222 [11:43<27:58,  1.07s/it]
 29%|██▉       | 653/2222 [11:44<28:07,  1.08s/it]
 29%|██▉       | 654/2222 [11:45<28:29,  1.09s/it]
 29%|██▉       | 655/2222 [11:46<28:29,  1.09s/it]
 30%|██▉       | 656/2222 [11:47<28:33,  1.09s/it]
 30%|██▉       | 657/2222 [11:48<28:12,  1.08s/it]
 30%|██▉       | 658/2222 [11:49<28:18,  1.09s/it]
 30%|██▉       | 659/2222 [11:50<28:06,  1.08s/it]
 30%|██▉       | 660/2222 [11:51<28:03,  1.08s/it]
 30%|██▉       | 661/2222 [11:52<27:50,  1.07s/it]
 30%|██▉       | 662/2222 [11:53<27:47,  1.07s/it]
 30%|██▉       | 663/2222 [11:54<27:48,  1.07s/it]
 30%|██▉       | 664/2222 [11:55<27:39,  1.07s/it]
 30%|██▉       | 665/2222 [11:57<27:34,  1.06s/it]
 30%|██▉       | 666/2222 [11:58<27:41,  1.07s/it]
 30%|███       | 667/2222 [11:59<27:56,  1.08s/it]
 30%|███       | 668/2222 [12:00<28:12,  1.09s/it]
 30%|███       | 669/2222 [12:01<28:07,  1.09s/it]
 30%|███       | 670/2222 [12:02<28:15,  1.09s/it]
 30%|███       | 671/2222 [12:03<27:54,  1.08s/it]
 30%|███       | 672/2222 [12:04<28:15,  1.09s/it]
 30%|███       | 673/2222 [12:05<28:04,  1.09s/it]
 30%|███       | 674/2222 [12:06<27:44,  1.08s/it]
 30%|███       | 675/2222 [12:07<27:49,  1.08s/it]
 30%|███       | 676/2222 [12:08<27:42,  1.08s/it]
 30%|███       | 677/2222 [12:09<27:34,  1.07s/it]
 31%|███       | 678/2222 [12:11<27:27,  1.07s/it]
 31%|███       | 679/2222 [12:12<27:26,  1.07s/it]
 31%|███       | 680/2222 [12:13<27:28,  1.07s/it]
 31%|███       | 681/2222 [12:14<27:21,  1.07s/it]
 31%|███       | 682/2222 [12:15<27:51,  1.09s/it]
 31%|███       | 683/2222 [12:16<27:46,  1.08s/it]
 31%|███       | 684/2222 [12:17<27:38,  1.08s/it]
 31%|███       | 685/2222 [12:18<27:47,  1.09s/it]
 31%|███       | 686/2222 [12:19<27:44,  1.08s/it]
 31%|███       | 687/2222 [12:20<27:33,  1.08s/it]
 31%|███       | 688/2222 [12:21<27:37,  1.08s/it]
 31%|███       | 689/2222 [12:22<27:29,  1.08s/it]
 31%|███       | 690/2222 [12:24<27:33,  1.08s/it]
 31%|███       | 691/2222 [12:25<27:30,  1.08s/it]
 31%|███       | 692/2222 [12:26<27:19,  1.07s/it]
 31%|███       | 693/2222 [12:27<27:14,  1.07s/it]
 31%|███       | 694/2222 [12:28<27:10,  1.07s/it]
 31%|███▏      | 695/2222 [12:29<27:09,  1.07s/it]
 31%|███▏      | 696/2222 [12:30<27:09,  1.07s/it]
 31%|███▏      | 697/2222 [12:31<27:08,  1.07s/it]
 31%|███▏      | 698/2222 [12:32<27:04,  1.07s/it]
 31%|███▏      | 699/2222 [12:33<26:51,  1.06s/it]
 32%|███▏      | 700/2222 [12:34<26:42,  1.05s/it]
 32%|███▏      | 701/2222 [12:35<26:51,  1.06s/it]
 32%|███▏      | 702/2222 [12:36<27:06,  1.07s/it]
 32%|███▏      | 703/2222 [12:37<27:05,  1.07s/it]
 32%|███▏      | 704/2222 [12:38<26:55,  1.06s/it]
 32%|███▏      | 705/2222 [12:40<27:17,  1.08s/it]
 32%|███▏      | 706/2222 [12:41<27:16,  1.08s/it]
 32%|███▏      | 707/2222 [12:42<26:52,  1.06s/it]
 32%|███▏      | 708/2222 [12:43<28:44,  1.14s/it]
 32%|███▏      | 709/2222 [12:44<28:01,  1.11s/it]
 32%|███▏      | 710/2222 [12:45<27:43,  1.10s/it]
 32%|███▏      | 711/2222 [12:46<27:34,  1.09s/it]
 32%|███▏      | 712/2222 [12:47<27:11,  1.08s/it]
 32%|███▏      | 713/2222 [12:48<27:00,  1.07s/it]
 32%|███▏      | 714/2222 [12:49<26:44,  1.06s/it]
 32%|███▏      | 715/2222 [12:50<26:55,  1.07s/it]
 32%|███▏      | 716/2222 [12:51<26:57,  1.07s/it]
 32%|███▏      | 717/2222 [12:53<27:02,  1.08s/it]
 32%|███▏      | 718/2222 [12:54<26:49,  1.07s/it]
 32%|███▏      | 719/2222 [12:55<26:38,  1.06s/it]
 32%|███▏      | 720/2222 [12:56<27:02,  1.08s/it]
 32%|███▏      | 721/2222 [12:57<26:54,  1.08s/it]
 32%|███▏      | 722/2222 [12:58<26:34,  1.06s/it]
 33%|███▎      | 723/2222 [12:59<26:47,  1.07s/it]
 33%|███▎      | 724/2222 [13:00<26:53,  1.08s/it]
 33%|███▎      | 725/2222 [13:01<26:52,  1.08s/it]
 33%|███▎      | 726/2222 [13:02<26:55,  1.08s/it]
 33%|███▎      | 727/2222 [13:03<26:47,  1.07s/it]
 33%|███▎      | 728/2222 [13:04<26:42,  1.07s/it]
 33%|███▎      | 729/2222 [13:05<26:32,  1.07s/it]
 33%|███▎      | 730/2222 [13:06<26:35,  1.07s/it]
 33%|███▎      | 731/2222 [13:08<26:51,  1.08s/it]
 33%|███▎      | 732/2222 [13:09<26:29,  1.07s/it]
 33%|███▎      | 733/2222 [13:10<26:32,  1.07s/it]
 33%|███▎      | 734/2222 [13:11<26:33,  1.07s/it]
 33%|███▎      | 735/2222 [13:12<26:29,  1.07s/it]
 33%|███▎      | 736/2222 [13:13<26:26,  1.07s/it]
 33%|███▎      | 737/2222 [13:14<26:31,  1.07s/it]
 33%|███▎      | 738/2222 [13:15<26:25,  1.07s/it]
 33%|███▎      | 739/2222 [13:16<26:39,  1.08s/it]
 33%|███▎      | 740/2222 [13:17<26:43,  1.08s/it]
 33%|███▎      | 741/2222 [13:18<26:43,  1.08s/it]
 33%|███▎      | 742/2222 [13:19<26:21,  1.07s/it]
 33%|███▎      | 743/2222 [13:20<26:21,  1.07s/it]
 33%|███▎      | 744/2222 [13:21<26:19,  1.07s/it]
 34%|███▎      | 745/2222 [13:23<26:30,  1.08s/it]
 34%|███▎      | 746/2222 [13:24<26:29,  1.08s/it]
 34%|███▎      | 747/2222 [13:25<26:35,  1.08s/it]
 34%|███▎      | 748/2222 [13:26<26:24,  1.08s/it]
 34%|███▎      | 749/2222 [13:27<26:43,  1.09s/it]
 34%|███▍      | 750/2222 [13:28<26:42,  1.09s/it]
 34%|███▍      | 751/2222 [13:29<26:37,  1.09s/it]
 34%|███▍      | 752/2222 [13:30<26:45,  1.09s/it]
 34%|███▍      | 753/2222 [13:31<26:29,  1.08s/it]
 34%|███▍      | 754/2222 [13:32<26:41,  1.09s/it]
 34%|███▍      | 755/2222 [13:33<26:33,  1.09s/it]
 34%|███▍      | 756/2222 [13:35<26:18,  1.08s/it]
 34%|███▍      | 757/2222 [13:36<26:17,  1.08s/it]
 34%|███▍      | 758/2222 [13:37<26:18,  1.08s/it]
 34%|███▍      | 759/2222 [13:38<26:13,  1.08s/it]
 34%|███▍      | 760/2222 [13:39<26:03,  1.07s/it]
 34%|███▍      | 761/2222 [13:40<26:10,  1.07s/it]
 34%|███▍      | 762/2222 [13:41<25:57,  1.07s/it]
 34%|███▍      | 763/2222 [13:42<26:20,  1.08s/it]
 34%|███▍      | 764/2222 [13:43<26:07,  1.08s/it]
 34%|███▍      | 765/2222 [13:44<26:14,  1.08s/it]
 34%|███▍      | 766/2222 [13:45<26:09,  1.08s/it]
 35%|███▍      | 767/2222 [13:46<26:14,  1.08s/it]
 35%|███▍      | 768/2222 [13:47<26:07,  1.08s/it]
 35%|███▍      | 769/2222 [13:49<26:05,  1.08s/it]
 35%|███▍      | 770/2222 [13:50<25:51,  1.07s/it]
 35%|███▍      | 771/2222 [13:51<25:58,  1.07s/it]
 35%|███▍      | 772/2222 [13:52<25:57,  1.07s/it]
 35%|███▍      | 773/2222 [13:53<26:12,  1.09s/it]
 35%|███▍      | 774/2222 [13:54<25:56,  1.07s/it]
 35%|███▍      | 775/2222 [13:55<25:49,  1.07s/it]
 35%|███▍      | 776/2222 [13:56<25:28,  1.06s/it]
 35%|███▍      | 777/2222 [13:57<25:38,  1.06s/it]
 35%|███▌      | 778/2222 [13:58<25:47,  1.07s/it]
 35%|███▌      | 779/2222 [13:59<25:59,  1.08s/it]
 35%|███▌      | 780/2222 [14:00<25:55,  1.08s/it]
 35%|███▌      | 781/2222 [14:01<25:43,  1.07s/it]
 35%|███▌      | 782/2222 [14:02<25:56,  1.08s/it]
 35%|███▌      | 783/2222 [14:04<25:44,  1.07s/it]
 35%|███▌      | 784/2222 [14:05<25:41,  1.07s/it]
 35%|███▌      | 785/2222 [14:06<25:47,  1.08s/it]
 35%|███▌      | 786/2222 [14:07<25:51,  1.08s/it]
 35%|███▌      | 787/2222 [14:08<25:30,  1.07s/it]
 35%|███▌      | 788/2222 [14:09<25:33,  1.07s/it]
 36%|███▌      | 789/2222 [14:10<25:42,  1.08s/it]
 36%|███▌      | 790/2222 [14:11<25:53,  1.09s/it]
 36%|███▌      | 791/2222 [14:12<25:35,  1.07s/it]
 36%|███▌      | 792/2222 [14:13<25:49,  1.08s/it]
 36%|███▌      | 793/2222 [14:14<25:33,  1.07s/it]
 36%|███▌      | 794/2222 [14:15<25:35,  1.08s/it]
 36%|███▌      | 795/2222 [14:16<25:53,  1.09s/it]
 36%|███▌      | 796/2222 [14:18<25:40,  1.08s/it]
 36%|███▌      | 797/2222 [14:19<25:41,  1.08s/it]
 36%|███▌      | 798/2222 [14:20<25:53,  1.09s/it]
 36%|███▌      | 799/2222 [14:21<25:53,  1.09s/it]
 36%|███▌      | 800/2222 [14:22<25:50,  1.09s/it]
 36%|███▌      | 801/2222 [14:23<25:58,  1.10s/it]
 36%|███▌      | 802/2222 [14:24<26:04,  1.10s/it]
 36%|███▌      | 803/2222 [14:25<25:49,  1.09s/it]
 36%|███▌      | 804/2222 [14:26<25:39,  1.09s/it]
 36%|███▌      | 805/2222 [14:27<25:34,  1.08s/it]
 36%|███▋      | 806/2222 [14:28<25:40,  1.09s/it]
 36%|███▋      | 807/2222 [14:29<25:18,  1.07s/it]
 36%|███▋      | 808/2222 [14:31<25:03,  1.06s/it]
 36%|███▋      | 809/2222 [14:32<25:11,  1.07s/it]
 36%|███▋      | 810/2222 [14:33<25:03,  1.06s/it]
 36%|███▋      | 811/2222 [14:34<25:06,  1.07s/it]
 37%|███▋      | 812/2222 [14:35<25:19,  1.08s/it]
 37%|███▋      | 813/2222 [14:36<25:22,  1.08s/it]
 37%|███▋      | 814/2222 [14:37<25:20,  1.08s/it]
 37%|███▋      | 815/2222 [14:38<25:01,  1.07s/it]
 37%|███▋      | 816/2222 [14:39<25:00,  1.07s/it]
 37%|███▋      | 817/2222 [14:40<24:59,  1.07s/it]
 37%|███▋      | 818/2222 [14:41<25:10,  1.08s/it]
 37%|███▋      | 819/2222 [14:42<25:13,  1.08s/it]
 37%|███▋      | 820/2222 [14:43<24:58,  1.07s/it]
 37%|███▋      | 821/2222 [14:45<25:08,  1.08s/it]
 37%|███▋      | 822/2222 [14:46<25:02,  1.07s/it]
 37%|███▋      | 823/2222 [14:47<25:07,  1.08s/it]
 37%|███▋      | 824/2222 [14:48<25:05,  1.08s/it]
 37%|███▋      | 825/2222 [14:49<25:12,  1.08s/it]
 37%|███▋      | 826/2222 [14:50<25:02,  1.08s/it]
 37%|███▋      | 827/2222 [14:51<24:57,  1.07s/it]
 37%|███▋      | 828/2222 [14:52<25:09,  1.08s/it]
 37%|███▋      | 829/2222 [14:53<25:10,  1.08s/it]
 37%|███▋      | 830/2222 [14:54<24:56,  1.08s/it]
 37%|███▋      | 831/2222 [14:55<24:55,  1.08s/it]
 37%|███▋      | 832/2222 [14:56<24:46,  1.07s/it]
 37%|███▋      | 833/2222 [14:57<24:32,  1.06s/it]
 38%|███▊      | 834/2222 [14:58<24:29,  1.06s/it]
 38%|███▊      | 835/2222 [15:00<24:50,  1.07s/it]
 38%|███▊      | 836/2222 [15:01<24:44,  1.07s/it]
 38%|███▊      | 837/2222 [15:02<24:58,  1.08s/it]
 38%|███▊      | 838/2222 [15:03<24:48,  1.08s/it]
 38%|███▊      | 839/2222 [15:04<24:54,  1.08s/it]
 38%|███▊      | 840/2222 [15:05<25:13,  1.10s/it]
 38%|███▊      | 841/2222 [15:06<25:00,  1.09s/it]
 38%|███▊      | 842/2222 [15:07<24:51,  1.08s/it]
 38%|███▊      | 843/2222 [15:08<24:42,  1.08s/it]
 38%|███▊      | 844/2222 [15:09<24:43,  1.08s/it]
 38%|███▊      | 845/2222 [15:10<24:35,  1.07s/it]
 38%|███▊      | 846/2222 [15:11<24:30,  1.07s/it]
 38%|███▊      | 847/2222 [15:13<24:55,  1.09s/it]
 38%|███▊      | 848/2222 [15:14<24:54,  1.09s/it]
 38%|███▊      | 849/2222 [15:15<24:48,  1.08s/it]
 38%|███▊      | 850/2222 [15:16<24:39,  1.08s/it]
 38%|███▊      | 851/2222 [15:17<24:36,  1.08s/it]
 38%|███▊      | 852/2222 [15:18<24:27,  1.07s/it]
 38%|███▊      | 853/2222 [15:19<24:32,  1.08s/it]
 38%|███▊      | 854/2222 [15:20<24:29,  1.07s/it]
 38%|███▊      | 855/2222 [15:21<24:39,  1.08s/it]
 39%|███▊      | 856/2222 [15:22<24:38,  1.08s/it]
 39%|███▊      | 857/2222 [15:23<24:26,  1.07s/it]
 39%|███▊      | 858/2222 [15:24<24:28,  1.08s/it]
 39%|███▊      | 859/2222 [15:25<24:25,  1.08s/it]
 39%|███▊      | 860/2222 [15:27<24:27,  1.08s/it]
 39%|███▊      | 861/2222 [15:28<24:15,  1.07s/it]
 39%|███▉      | 862/2222 [15:29<24:18,  1.07s/it]
 39%|███▉      | 863/2222 [15:30<24:04,  1.06s/it]
 39%|███▉      | 864/2222 [15:31<24:12,  1.07s/it]
 39%|███▉      | 865/2222 [15:32<24:18,  1.07s/it]
 39%|███▉      | 866/2222 [15:33<24:16,  1.07s/it]
 39%|███▉      | 867/2222 [15:34<24:23,  1.08s/it]
 39%|███▉      | 868/2222 [15:35<24:32,  1.09s/it]
 39%|███▉      | 869/2222 [15:36<24:29,  1.09s/it]
 39%|███▉      | 870/2222 [15:37<24:25,  1.08s/it]
 39%|███▉      | 871/2222 [15:38<24:36,  1.09s/it]
 39%|███▉      | 872/2222 [15:39<24:25,  1.09s/it]
 39%|███▉      | 873/2222 [15:41<24:07,  1.07s/it]
 39%|███▉      | 874/2222 [15:42<24:01,  1.07s/it]
 39%|███▉      | 875/2222 [15:43<24:09,  1.08s/it]
 39%|███▉      | 876/2222 [15:44<24:11,  1.08s/it]
 39%|███▉      | 877/2222 [15:45<24:15,  1.08s/it]
 40%|███▉      | 878/2222 [15:46<24:06,  1.08s/it]
 40%|███▉      | 879/2222 [15:47<24:03,  1.07s/it]
 40%|███▉      | 880/2222 [15:48<24:01,  1.07s/it]
 40%|███▉      | 881/2222 [15:49<24:04,  1.08s/it]
 40%|███▉      | 882/2222 [15:50<24:04,  1.08s/it]
 40%|███▉      | 883/2222 [15:51<24:06,  1.08s/it]
 40%|███▉      | 884/2222 [15:52<23:56,  1.07s/it]
 40%|███▉      | 885/2222 [15:53<23:55,  1.07s/it]
 40%|███▉      | 886/2222 [15:55<24:03,  1.08s/it]
 40%|███▉      | 887/2222 [15:56<23:58,  1.08s/it]
 40%|███▉      | 888/2222 [15:57<24:13,  1.09s/it]
 40%|████      | 889/2222 [15:58<24:06,  1.09s/it]
 40%|████      | 890/2222 [15:59<24:08,  1.09s/it]
 40%|████      | 891/2222 [16:00<24:00,  1.08s/it]
 40%|████      | 892/2222 [16:01<24:03,  1.09s/it]
 40%|████      | 893/2222 [16:02<23:55,  1.08s/it]
 40%|████      | 894/2222 [16:03<23:49,  1.08s/it]
 40%|████      | 895/2222 [16:04<23:51,  1.08s/it]
 40%|████      | 896/2222 [16:05<23:27,  1.06s/it]
 40%|████      | 897/2222 [16:06<23:37,  1.07s/it]
 40%|████      | 898/2222 [16:07<23:41,  1.07s/it]
 40%|████      | 899/2222 [16:09<23:51,  1.08s/it]
 41%|████      | 900/2222 [16:10<23:54,  1.09s/it]
 41%|████      | 901/2222 [16:11<23:42,  1.08s/it]
 41%|████      | 902/2222 [16:12<23:42,  1.08s/it]
 41%|████      | 903/2222 [16:13<23:39,  1.08s/it]
 41%|████      | 904/2222 [16:14<23:48,  1.08s/it]
 41%|████      | 905/2222 [16:15<23:43,  1.08s/it]
 41%|████      | 906/2222 [16:19<39:21,  1.79s/it]
 41%|████      | 907/2222 [16:20<34:52,  1.59s/it]
 41%|████      | 908/2222 [16:25<59:44,  2.73s/it]
 41%|████      | 909/2222 [16:26<49:00,  2.24s/it]
 41%|████      | 910/2222 [16:27<41:15,  1.89s/it]
 41%|████      | 911/2222 [16:28<35:58,  1.65s/it]
 41%|████      | 912/2222 [16:29<32:10,  1.47s/it]
 41%|████      | 913/2222 [16:30<29:43,  1.36s/it]
 41%|████      | 914/2222 [16:32<28:01,  1.29s/it]
 41%|████      | 915/2222 [16:33<26:43,  1.23s/it]
 41%|████      | 916/2222 [16:34<25:52,  1.19s/it]
 41%|████▏     | 917/2222 [16:35<25:07,  1.16s/it]
 41%|████▏     | 918/2222 [16:36<24:34,  1.13s/it]
 41%|████▏     | 919/2222 [16:37<24:12,  1.11s/it]
 41%|████▏     | 920/2222 [16:38<23:48,  1.10s/it]
 41%|████▏     | 921/2222 [16:39<23:45,  1.10s/it]
 41%|████▏     | 922/2222 [16:40<23:45,  1.10s/it]
 42%|████▏     | 923/2222 [16:41<23:25,  1.08s/it]
 42%|████▏     | 924/2222 [16:42<23:52,  1.10s/it]
 42%|████▏     | 925/2222 [16:43<23:28,  1.09s/it]
 42%|████▏     | 926/2222 [16:44<23:13,  1.08s/it]
 42%|████▏     | 927/2222 [16:46<23:11,  1.07s/it]
 42%|████▏     | 928/2222 [16:47<23:20,  1.08s/it]
 42%|████▏     | 929/2222 [16:48<23:25,  1.09s/it]
 42%|████▏     | 930/2222 [16:49<23:18,  1.08s/it]
 42%|████▏     | 931/2222 [16:50<23:19,  1.08s/it]
 42%|████▏     | 932/2222 [16:51<23:21,  1.09s/it]
 42%|████▏     | 933/2222 [16:52<23:16,  1.08s/it]
 42%|████▏     | 934/2222 [16:53<23:13,  1.08s/it]
 42%|████▏     | 935/2222 [16:54<23:15,  1.08s/it]
 42%|████▏     | 936/2222 [16:55<23:24,  1.09s/it]
 42%|████▏     | 937/2222 [16:56<23:07,  1.08s/it]
 42%|████▏     | 938/2222 [16:57<22:58,  1.07s/it]
 42%|████▏     | 939/2222 [16:59<22:53,  1.07s/it]
 42%|████▏     | 940/2222 [17:00<22:36,  1.06s/it]
 42%|████▏     | 941/2222 [17:01<23:00,  1.08s/it]
 42%|████▏     | 942/2222 [17:02<23:04,  1.08s/it]
 42%|████▏     | 943/2222 [17:03<23:00,  1.08s/it]
 42%|████▏     | 944/2222 [17:04<22:55,  1.08s/it]
 43%|████▎     | 945/2222 [17:05<22:52,  1.07s/it]
 43%|████▎     | 946/2222 [17:06<22:56,  1.08s/it]
 43%|████▎     | 947/2222 [17:07<22:44,  1.07s/it]
 43%|████▎     | 948/2222 [17:08<22:49,  1.07s/it]
 43%|████▎     | 949/2222 [17:09<22:53,  1.08s/it]
 43%|████▎     | 950/2222 [17:10<22:49,  1.08s/it]
 43%|████▎     | 951/2222 [17:11<22:42,  1.07s/it]
 43%|████▎     | 952/2222 [17:13<22:53,  1.08s/it]
 43%|████▎     | 953/2222 [17:14<22:31,  1.06s/it]
 43%|████▎     | 954/2222 [17:15<22:40,  1.07s/it]
 43%|████▎     | 955/2222 [17:16<22:34,  1.07s/it]
 43%|████▎     | 956/2222 [17:17<22:27,  1.06s/it]
 43%|████▎     | 957/2222 [17:18<22:41,  1.08s/it]
 43%|████▎     | 958/2222 [17:19<22:34,  1.07s/it]
 43%|████▎     | 959/2222 [17:20<22:35,  1.07s/it]
 43%|████▎     | 960/2222 [17:21<22:35,  1.07s/it]
 43%|████▎     | 961/2222 [17:22<22:31,  1.07s/it]
 43%|████▎     | 962/2222 [17:23<22:32,  1.07s/it]
 43%|████▎     | 963/2222 [17:24<22:35,  1.08s/it]
 43%|████▎     | 964/2222 [17:25<22:33,  1.08s/it]
 43%|████▎     | 965/2222 [17:26<22:31,  1.08s/it]
 43%|████▎     | 966/2222 [17:28<22:27,  1.07s/it]
 44%|████▎     | 967/2222 [17:29<22:34,  1.08s/it]
 44%|████▎     | 968/2222 [17:30<22:38,  1.08s/it]
 44%|████▎     | 969/2222 [17:31<22:17,  1.07s/it]
 44%|████▎     | 970/2222 [17:32<22:17,  1.07s/it]
 44%|████▎     | 971/2222 [17:33<22:06,  1.06s/it]
 44%|████▎     | 972/2222 [17:34<22:17,  1.07s/it]
 44%|████▍     | 973/2222 [17:35<22:21,  1.07s/it]
 44%|████▍     | 974/2222 [17:36<22:21,  1.07s/it]
 44%|████▍     | 975/2222 [17:37<22:28,  1.08s/it]
 44%|████▍     | 976/2222 [17:38<22:25,  1.08s/it]
 44%|████▍     | 977/2222 [17:39<22:08,  1.07s/it]
 44%|████▍     | 978/2222 [17:40<22:24,  1.08s/it]
 44%|████▍     | 979/2222 [17:42<22:16,  1.08s/it]
 44%|████▍     | 980/2222 [17:43<21:59,  1.06s/it]
 44%|████▍     | 981/2222 [17:44<22:05,  1.07s/it]
 44%|████▍     | 982/2222 [17:45<22:21,  1.08s/it]
 44%|████▍     | 983/2222 [17:46<22:19,  1.08s/it]
 44%|████▍     | 984/2222 [17:47<22:19,  1.08s/it]
 44%|████▍     | 985/2222 [17:48<22:06,  1.07s/it]
 44%|████▍     | 986/2222 [17:49<22:08,  1.08s/it]
 44%|████▍     | 987/2222 [17:50<22:14,  1.08s/it]
 44%|████▍     | 988/2222 [17:51<22:07,  1.08s/it]
 45%|████▍     | 989/2222 [17:52<22:03,  1.07s/it]
 45%|████▍     | 990/2222 [17:53<22:17,  1.09s/it]
 45%|████▍     | 991/2222 [17:54<21:53,  1.07s/it]
 45%|████▍     | 992/2222 [17:55<21:52,  1.07s/it]
 45%|████▍     | 993/2222 [17:57<21:57,  1.07s/it]
 45%|████▍     | 994/2222 [17:58<21:52,  1.07s/it]
 45%|████▍     | 995/2222 [17:59<21:46,  1.06s/it]
 45%|████▍     | 996/2222 [18:00<22:04,  1.08s/it]
 45%|████▍     | 997/2222 [18:01<21:58,  1.08s/it]
 45%|████▍     | 998/2222 [18:02<21:50,  1.07s/it]
 45%|████▍     | 999/2222 [18:03<22:00,  1.08s/it]
 45%|████▌     | 1000/2222 [18:04<22:00,  1.08s/it]
                                                   
{'loss': 2.2606, 'learning_rate': 2.7497749774977498e-05, 'epoch': 0.9}

 45%|████▌     | 1000/2222 [18:04<22:00,  1.08s/it]
 45%|████▌     | 1001/2222 [18:05<21:57,  1.08s/it]
 45%|████▌     | 1002/2222 [18:06<21:46,  1.07s/it]
 45%|████▌     | 1003/2222 [18:07<21:44,  1.07s/it]
 45%|████▌     | 1004/2222 [18:08<21:42,  1.07s/it]
 45%|████▌     | 1005/2222 [18:09<21:35,  1.06s/it]
 45%|████▌     | 1006/2222 [18:10<21:43,  1.07s/it]
 45%|████▌     | 1007/2222 [18:12<21:45,  1.07s/it]
 45%|████▌     | 1008/2222 [18:13<21:54,  1.08s/it]
 45%|████▌     | 1009/2222 [18:14<21:52,  1.08s/it]
 45%|████▌     | 1010/2222 [18:15<21:50,  1.08s/it]
 45%|████▌     | 1011/2222 [18:16<21:53,  1.08s/it]
 46%|████▌     | 1012/2222 [18:17<21:48,  1.08s/it]
 46%|████▌     | 1013/2222 [18:18<21:54,  1.09s/it]
 46%|████▌     | 1014/2222 [18:19<21:49,  1.08s/it]
 46%|████▌     | 1015/2222 [18:20<21:51,  1.09s/it]
 46%|████▌     | 1016/2222 [18:21<21:34,  1.07s/it]
 46%|████▌     | 1017/2222 [18:22<21:44,  1.08s/it]
 46%|████▌     | 1018/2222 [18:23<21:27,  1.07s/it]
 46%|████▌     | 1019/2222 [18:25<21:34,  1.08s/it]
 46%|████▌     | 1020/2222 [18:26<21:25,  1.07s/it]
 46%|████▌     | 1021/2222 [18:27<21:23,  1.07s/it]
 46%|████▌     | 1022/2222 [18:28<21:20,  1.07s/it]
 46%|████▌     | 1023/2222 [18:29<21:10,  1.06s/it]
 46%|████▌     | 1024/2222 [18:30<21:13,  1.06s/it]
 46%|████▌     | 1025/2222 [18:31<21:08,  1.06s/it]
 46%|████▌     | 1026/2222 [18:32<21:13,  1.07s/it]
 46%|████▌     | 1027/2222 [18:33<21:10,  1.06s/it]
 46%|████▋     | 1028/2222 [18:34<21:31,  1.08s/it]
 46%|████▋     | 1029/2222 [18:35<21:30,  1.08s/it]
 46%|████▋     | 1030/2222 [18:36<21:32,  1.08s/it]
 46%|████▋     | 1031/2222 [18:37<21:33,  1.09s/it]
 46%|████▋     | 1032/2222 [18:38<21:24,  1.08s/it]
 46%|████▋     | 1033/2222 [18:40<21:16,  1.07s/it]
 47%|████▋     | 1034/2222 [18:41<21:25,  1.08s/it]
 47%|████▋     | 1035/2222 [18:42<21:37,  1.09s/it]
 47%|████▋     | 1036/2222 [18:43<21:24,  1.08s/it]
 47%|████▋     | 1037/2222 [18:44<21:21,  1.08s/it]
 47%|████▋     | 1038/2222 [18:45<21:24,  1.09s/it]
 47%|████▋     | 1039/2222 [18:46<21:19,  1.08s/it]
 47%|████▋     | 1040/2222 [18:47<21:10,  1.07s/it]
 47%|████▋     | 1041/2222 [18:48<21:02,  1.07s/it]
 47%|████▋     | 1042/2222 [18:49<21:09,  1.08s/it]
 47%|████▋     | 1043/2222 [18:50<21:00,  1.07s/it]
 47%|████▋     | 1044/2222 [18:51<20:53,  1.06s/it]
 47%|████▋     | 1045/2222 [18:53<21:11,  1.08s/it]
 47%|████▋     | 1046/2222 [18:54<21:08,  1.08s/it]
 47%|████▋     | 1047/2222 [18:55<21:01,  1.07s/it]
 47%|████▋     | 1048/2222 [18:56<21:08,  1.08s/it]
 47%|████▋     | 1049/2222 [18:57<20:59,  1.07s/it]
 47%|████▋     | 1050/2222 [18:58<21:06,  1.08s/it]
 47%|████▋     | 1051/2222 [18:59<20:58,  1.07s/it]
 47%|████▋     | 1052/2222 [19:00<20:51,  1.07s/it]
 47%|████▋     | 1053/2222 [19:01<20:57,  1.08s/it]
 47%|████▋     | 1054/2222 [19:02<20:51,  1.07s/it]
 47%|████▋     | 1055/2222 [19:03<20:44,  1.07s/it]
 48%|████▊     | 1056/2222 [19:04<20:46,  1.07s/it]
 48%|████▊     | 1057/2222 [19:05<20:35,  1.06s/it]
 48%|████▊     | 1058/2222 [19:06<20:42,  1.07s/it]
 48%|████▊     | 1059/2222 [19:07<20:37,  1.06s/it]
 48%|████▊     | 1060/2222 [19:09<20:37,  1.07s/it]
 48%|████▊     | 1061/2222 [19:10<20:38,  1.07s/it]
 48%|████▊     | 1062/2222 [19:11<20:41,  1.07s/it]
 48%|████▊     | 1063/2222 [19:12<20:37,  1.07s/it]
 48%|████▊     | 1064/2222 [19:13<20:45,  1.08s/it]
 48%|████▊     | 1065/2222 [19:14<20:32,  1.07s/it]
 48%|████▊     | 1066/2222 [19:15<20:31,  1.07s/it]
 48%|████▊     | 1067/2222 [19:16<20:32,  1.07s/it]
 48%|████▊     | 1068/2222 [19:17<20:39,  1.07s/it]
 48%|████▊     | 1069/2222 [19:18<20:36,  1.07s/it]
 48%|████▊     | 1070/2222 [19:19<20:39,  1.08s/it]
 48%|████▊     | 1071/2222 [19:20<20:31,  1.07s/it]
 48%|████▊     | 1072/2222 [19:21<20:41,  1.08s/it]
 48%|████▊     | 1073/2222 [19:23<20:46,  1.08s/it]
 48%|████▊     | 1074/2222 [19:24<20:50,  1.09s/it]
 48%|████▊     | 1075/2222 [19:25<20:41,  1.08s/it]
 48%|████▊     | 1076/2222 [19:26<20:43,  1.08s/it]
 48%|████▊     | 1077/2222 [19:27<20:43,  1.09s/it]
 49%|████▊     | 1078/2222 [19:28<20:32,  1.08s/it]
 49%|████▊     | 1079/2222 [19:29<20:22,  1.07s/it]
 49%|████▊     | 1080/2222 [19:30<20:27,  1.07s/it]
 49%|████▊     | 1081/2222 [19:31<20:33,  1.08s/it]
 49%|████▊     | 1082/2222 [19:32<20:31,  1.08s/it]
 49%|████▊     | 1083/2222 [19:33<20:34,  1.08s/it]
 49%|████▉     | 1084/2222 [19:34<20:39,  1.09s/it]
 49%|████▉     | 1085/2222 [19:35<20:29,  1.08s/it]
 49%|████▉     | 1086/2222 [19:37<20:29,  1.08s/it]
 49%|████▉     | 1087/2222 [19:38<20:24,  1.08s/it]
 49%|████▉     | 1088/2222 [19:39<20:15,  1.07s/it]
 49%|████▉     | 1089/2222 [19:40<20:18,  1.08s/it]
 49%|████▉     | 1090/2222 [19:41<20:15,  1.07s/it]
 49%|████▉     | 1091/2222 [19:42<20:22,  1.08s/it]
 49%|████▉     | 1092/2222 [19:43<20:17,  1.08s/it]
 49%|████▉     | 1093/2222 [19:44<20:07,  1.07s/it]
 49%|████▉     | 1094/2222 [19:45<20:07,  1.07s/it]
 49%|████▉     | 1095/2222 [19:46<20:05,  1.07s/it]
 49%|████▉     | 1096/2222 [19:47<20:04,  1.07s/it]
 49%|████▉     | 1097/2222 [19:48<20:07,  1.07s/it]
 49%|████▉     | 1098/2222 [19:49<20:03,  1.07s/it]
 49%|████▉     | 1099/2222 [19:50<20:01,  1.07s/it]
 50%|████▉     | 1100/2222 [19:52<19:56,  1.07s/it]
 50%|████▉     | 1101/2222 [19:53<19:57,  1.07s/it]
 50%|████▉     | 1102/2222 [19:54<20:02,  1.07s/it]
 50%|████▉     | 1103/2222 [19:55<19:54,  1.07s/it]
 50%|████▉     | 1104/2222 [19:56<20:02,  1.08s/it]
 50%|████▉     | 1105/2222 [19:57<20:06,  1.08s/it]
 50%|████▉     | 1106/2222 [19:58<19:57,  1.07s/it]
 50%|████▉     | 1107/2222 [19:59<19:49,  1.07s/it]
 50%|████▉     | 1108/2222 [20:00<19:48,  1.07s/it]
 50%|████▉     | 1109/2222 [20:01<19:50,  1.07s/it]
 50%|████▉     | 1110/2222 [20:02<19:52,  1.07s/it]
 50%|█████     | 1111/2222 [20:03<18:43,  1.01s/it]
 50%|█████     | 1112/2222 [20:04<19:08,  1.03s/it]
 50%|█████     | 1113/2222 [20:05<19:21,  1.05s/it]
 50%|█████     | 1114/2222 [20:06<19:41,  1.07s/it]
 50%|█████     | 1115/2222 [20:08<19:53,  1.08s/it]
 50%|█████     | 1116/2222 [20:09<19:49,  1.08s/it]
 50%|█████     | 1117/2222 [20:10<19:57,  1.08s/it]
 50%|█████     | 1118/2222 [20:11<19:49,  1.08s/it]
 50%|█████     | 1119/2222 [20:12<19:42,  1.07s/it]
 50%|█████     | 1120/2222 [20:13<19:33,  1.06s/it]
 50%|█████     | 1121/2222 [20:14<19:44,  1.08s/it]
 50%|█████     | 1122/2222 [20:15<19:50,  1.08s/it]
 51%|█████     | 1123/2222 [20:16<19:38,  1.07s/it]
 51%|█████     | 1124/2222 [20:17<19:44,  1.08s/it]
 51%|█████     | 1125/2222 [20:18<19:44,  1.08s/it]
 51%|█████     | 1126/2222 [20:19<19:37,  1.07s/it]
 51%|█████     | 1127/2222 [20:20<19:27,  1.07s/it]
 51%|█████     | 1128/2222 [20:22<19:38,  1.08s/it]
 51%|█████     | 1129/2222 [20:23<19:46,  1.09s/it]
 51%|█████     | 1130/2222 [20:24<19:35,  1.08s/it]
 51%|█████     | 1131/2222 [20:25<19:32,  1.07s/it]
 51%|█████     | 1132/2222 [20:26<19:40,  1.08s/it]
 51%|█████     | 1133/2222 [20:27<19:39,  1.08s/it]
 51%|█████     | 1134/2222 [20:28<19:27,  1.07s/it]
 51%|█████     | 1135/2222 [20:29<19:26,  1.07s/it]
 51%|█████     | 1136/2222 [20:30<19:34,  1.08s/it]
 51%|█████     | 1137/2222 [20:31<19:29,  1.08s/it]
 51%|█████     | 1138/2222 [20:32<19:26,  1.08s/it]
 51%|█████▏    | 1139/2222 [20:33<19:22,  1.07s/it]
 51%|█████▏    | 1140/2222 [20:34<19:08,  1.06s/it]
 51%|█████▏    | 1141/2222 [20:35<19:18,  1.07s/it]
 51%|█████▏    | 1142/2222 [20:37<19:34,  1.09s/it]
 51%|█████▏    | 1143/2222 [20:38<19:20,  1.08s/it]
 51%|█████▏    | 1144/2222 [20:39<19:27,  1.08s/it]
 52%|█████▏    | 1145/2222 [20:40<19:26,  1.08s/it]
 52%|█████▏    | 1146/2222 [20:41<19:25,  1.08s/it]
 52%|█████▏    | 1147/2222 [20:42<19:23,  1.08s/it]
 52%|█████▏    | 1148/2222 [20:43<19:21,  1.08s/it]
 52%|█████▏    | 1149/2222 [20:44<19:15,  1.08s/it]
 52%|█████▏    | 1150/2222 [20:45<19:23,  1.08s/it]
 52%|█████▏    | 1151/2222 [20:46<19:21,  1.08s/it]
 52%|█████▏    | 1152/2222 [20:47<19:10,  1.08s/it]
 52%|█████▏    | 1153/2222 [20:49<19:23,  1.09s/it]
 52%|█████▏    | 1154/2222 [20:50<19:17,  1.08s/it]
 52%|█████▏    | 1155/2222 [20:51<19:13,  1.08s/it]
 52%|█████▏    | 1156/2222 [20:52<19:17,  1.09s/it]
 52%|█████▏    | 1157/2222 [20:53<19:04,  1.07s/it]
 52%|█████▏    | 1158/2222 [20:54<19:06,  1.08s/it]
 52%|█████▏    | 1159/2222 [20:55<18:58,  1.07s/it]
 52%|█████▏    | 1160/2222 [20:56<19:02,  1.08s/it]
 52%|█████▏    | 1161/2222 [20:57<18:53,  1.07s/it]
 52%|█████▏    | 1162/2222 [20:58<18:57,  1.07s/it]
 52%|█████▏    | 1163/2222 [20:59<18:56,  1.07s/it]
 52%|█████▏    | 1164/2222 [21:00<19:01,  1.08s/it]
 52%|█████▏    | 1165/2222 [21:01<19:09,  1.09s/it]
 52%|█████▏    | 1166/2222 [21:03<19:05,  1.08s/it]
 53%|█████▎    | 1167/2222 [21:04<19:01,  1.08s/it]
 53%|█████▎    | 1168/2222 [21:05<18:49,  1.07s/it]
 53%|█████▎    | 1169/2222 [21:06<18:51,  1.07s/it]
 53%|█████▎    | 1170/2222 [21:07<18:57,  1.08s/it]
 53%|█████▎    | 1171/2222 [21:08<18:51,  1.08s/it]
 53%|█████▎    | 1172/2222 [21:09<18:46,  1.07s/it]
 53%|█████▎    | 1173/2222 [21:10<18:33,  1.06s/it]
 53%|█████▎    | 1174/2222 [21:11<18:39,  1.07s/it]
 53%|█████▎    | 1175/2222 [21:12<18:34,  1.06s/it]
 53%|█████▎    | 1176/2222 [21:13<18:30,  1.06s/it]
 53%|█████▎    | 1177/2222 [21:14<18:31,  1.06s/it]
 53%|█████▎    | 1178/2222 [21:15<18:28,  1.06s/it]
 53%|█████▎    | 1179/2222 [21:16<18:35,  1.07s/it]
 53%|█████▎    | 1180/2222 [21:18<18:53,  1.09s/it]
 53%|█████▎    | 1181/2222 [21:19<18:48,  1.08s/it]
 53%|█████▎    | 1182/2222 [21:20<18:42,  1.08s/it]
 53%|█████▎    | 1183/2222 [21:21<18:25,  1.06s/it]
 53%|█████▎    | 1184/2222 [21:22<18:29,  1.07s/it]
 53%|█████▎    | 1185/2222 [21:23<18:39,  1.08s/it]
 53%|█████▎    | 1186/2222 [21:24<18:43,  1.08s/it]
 53%|█████▎    | 1187/2222 [21:25<18:38,  1.08s/it]
 53%|█████▎    | 1188/2222 [21:26<18:45,  1.09s/it]
 54%|█████▎    | 1189/2222 [21:27<18:33,  1.08s/it]
 54%|█████▎    | 1190/2222 [21:28<18:33,  1.08s/it]
 54%|█████▎    | 1191/2222 [21:29<18:33,  1.08s/it]
 54%|█████▎    | 1192/2222 [21:30<18:30,  1.08s/it]
 54%|█████▎    | 1193/2222 [21:31<18:20,  1.07s/it]
 54%|█████▎    | 1194/2222 [21:33<18:18,  1.07s/it]
 54%|█████▍    | 1195/2222 [21:34<18:15,  1.07s/it]
 54%|█████▍    | 1196/2222 [21:35<18:13,  1.07s/it]
 54%|█████▍    | 1197/2222 [21:36<18:07,  1.06s/it]
 54%|█████▍    | 1198/2222 [21:37<18:13,  1.07s/it]
 54%|█████▍    | 1199/2222 [21:38<18:23,  1.08s/it]
 54%|█████▍    | 1200/2222 [21:39<18:06,  1.06s/it]
 54%|█████▍    | 1201/2222 [21:40<18:25,  1.08s/it]
 54%|█████▍    | 1202/2222 [21:41<18:18,  1.08s/it]
 54%|█████▍    | 1203/2222 [21:42<18:13,  1.07s/it]
 54%|█████▍    | 1204/2222 [21:43<18:13,  1.07s/it]
 54%|█████▍    | 1205/2222 [21:44<18:14,  1.08s/it]
 54%|█████▍    | 1206/2222 [21:45<18:21,  1.08s/it]
 54%|█████▍    | 1207/2222 [21:47<18:08,  1.07s/it]
 54%|█████▍    | 1208/2222 [21:48<18:11,  1.08s/it]
 54%|█████▍    | 1209/2222 [21:49<18:07,  1.07s/it]
 54%|█████▍    | 1210/2222 [21:50<18:02,  1.07s/it]
 55%|█████▍    | 1211/2222 [21:51<17:59,  1.07s/it]
 55%|█████▍    | 1212/2222 [21:52<18:00,  1.07s/it]
 55%|█████▍    | 1213/2222 [21:53<18:00,  1.07s/it]
 55%|█████▍    | 1214/2222 [21:54<17:46,  1.06s/it]
 55%|█████▍    | 1215/2222 [21:55<17:38,  1.05s/it]
 55%|█████▍    | 1216/2222 [21:56<17:41,  1.05s/it]
 55%|█████▍    | 1217/2222 [21:57<17:51,  1.07s/it]
 55%|█████▍    | 1218/2222 [21:58<17:57,  1.07s/it]
 55%|█████▍    | 1219/2222 [21:59<17:55,  1.07s/it]
 55%|█████▍    | 1220/2222 [22:00<17:52,  1.07s/it]
 55%|█████▍    | 1221/2222 [22:01<17:55,  1.07s/it]
 55%|█████▍    | 1222/2222 [22:03<17:42,  1.06s/it]
 55%|█████▌    | 1223/2222 [22:04<17:43,  1.06s/it]
 55%|█████▌    | 1224/2222 [22:05<17:53,  1.08s/it]
 55%|█████▌    | 1225/2222 [22:06<17:53,  1.08s/it]
 55%|█████▌    | 1226/2222 [22:07<17:59,  1.08s/it]
 55%|█████▌    | 1227/2222 [22:08<17:47,  1.07s/it]
 55%|█████▌    | 1228/2222 [22:09<17:45,  1.07s/it]
 55%|█████▌    | 1229/2222 [22:10<17:48,  1.08s/it]
 55%|█████▌    | 1230/2222 [22:11<17:51,  1.08s/it]
 55%|█████▌    | 1231/2222 [22:12<17:42,  1.07s/it]
 55%|█████▌    | 1232/2222 [22:13<17:50,  1.08s/it]
 55%|█████▌    | 1233/2222 [22:14<17:57,  1.09s/it]
 56%|█████▌    | 1234/2222 [22:15<17:53,  1.09s/it]
 56%|█████▌    | 1235/2222 [22:17<17:55,  1.09s/it]
 56%|█████▌    | 1236/2222 [22:18<17:36,  1.07s/it]
 56%|█████▌    | 1237/2222 [22:19<17:43,  1.08s/it]
 56%|█████▌    | 1238/2222 [22:20<17:33,  1.07s/it]
 56%|█████▌    | 1239/2222 [22:21<17:28,  1.07s/it]
 56%|█████▌    | 1240/2222 [22:22<17:30,  1.07s/it]
 56%|█████▌    | 1241/2222 [22:23<17:31,  1.07s/it]
 56%|█████▌    | 1242/2222 [22:24<17:39,  1.08s/it]
 56%|█████▌    | 1243/2222 [22:25<17:27,  1.07s/it]
 56%|█████▌    | 1244/2222 [22:26<17:31,  1.07s/it]
 56%|█████▌    | 1245/2222 [22:27<17:31,  1.08s/it]
 56%|█████▌    | 1246/2222 [22:28<17:30,  1.08s/it]
 56%|█████▌    | 1247/2222 [22:29<17:32,  1.08s/it]
 56%|█████▌    | 1248/2222 [22:31<17:35,  1.08s/it]
 56%|█████▌    | 1249/2222 [22:32<17:30,  1.08s/it]
 56%|█████▋    | 1250/2222 [22:33<17:28,  1.08s/it]
 56%|█████▋    | 1251/2222 [22:34<17:25,  1.08s/it]
 56%|█████▋    | 1252/2222 [22:35<17:26,  1.08s/it]
 56%|█████▋    | 1253/2222 [22:36<17:18,  1.07s/it]
 56%|█████▋    | 1254/2222 [22:37<17:24,  1.08s/it]
 56%|█████▋    | 1255/2222 [22:38<17:22,  1.08s/it]
 57%|█████▋    | 1256/2222 [22:39<17:21,  1.08s/it]
 57%|█████▋    | 1257/2222 [22:40<17:10,  1.07s/it]
 57%|█████▋    | 1258/2222 [22:41<17:05,  1.06s/it]
 57%|█████▋    | 1259/2222 [22:42<16:58,  1.06s/it]
 57%|█████▋    | 1260/2222 [22:43<17:03,  1.06s/it]
 57%|█████▋    | 1261/2222 [22:44<17:07,  1.07s/it]
 57%|█████▋    | 1262/2222 [22:46<17:06,  1.07s/it]
 57%|█████▋    | 1263/2222 [22:47<17:03,  1.07s/it]
 57%|█████▋    | 1264/2222 [22:48<17:02,  1.07s/it]
 57%|█████▋    | 1265/2222 [22:49<17:00,  1.07s/it]
 57%|█████▋    | 1266/2222 [22:50<17:07,  1.07s/it]
 57%|█████▋    | 1267/2222 [22:51<17:01,  1.07s/it]
 57%|█████▋    | 1268/2222 [22:52<17:07,  1.08s/it]
 57%|█████▋    | 1269/2222 [22:53<16:56,  1.07s/it]
 57%|█████▋    | 1270/2222 [22:54<17:06,  1.08s/it]
 57%|█████▋    | 1271/2222 [22:55<16:48,  1.06s/it]
 57%|█████▋    | 1272/2222 [22:56<16:49,  1.06s/it]
 57%|█████▋    | 1273/2222 [22:57<17:03,  1.08s/it]
 57%|█████▋    | 1274/2222 [22:58<16:56,  1.07s/it]
 57%|█████▋    | 1275/2222 [22:59<16:52,  1.07s/it]
 57%|█████▋    | 1276/2222 [23:01<16:59,  1.08s/it]
 57%|█████▋    | 1277/2222 [23:02<16:58,  1.08s/it]
 58%|█████▊    | 1278/2222 [23:03<17:03,  1.08s/it]
 58%|█████▊    | 1279/2222 [23:04<16:52,  1.07s/it]
 58%|█████▊    | 1280/2222 [23:05<16:56,  1.08s/it]
 58%|█████▊    | 1281/2222 [23:06<16:50,  1.07s/it]
 58%|█████▊    | 1282/2222 [23:07<16:47,  1.07s/it]
 58%|█████▊    | 1283/2222 [23:08<16:59,  1.09s/it]
 58%|█████▊    | 1284/2222 [23:09<16:51,  1.08s/it]
 58%|█████▊    | 1285/2222 [23:10<16:57,  1.09s/it]
 58%|█████▊    | 1286/2222 [23:11<16:55,  1.09s/it]
 58%|█████▊    | 1287/2222 [23:12<16:48,  1.08s/it]
 58%|█████▊    | 1288/2222 [23:13<16:41,  1.07s/it]
 58%|█████▊    | 1289/2222 [23:15<16:45,  1.08s/it]
 58%|█████▊    | 1290/2222 [23:16<16:37,  1.07s/it]
 58%|█████▊    | 1291/2222 [23:17<16:50,  1.09s/it]
 58%|█████▊    | 1292/2222 [23:18<16:58,  1.10s/it]
 58%|█████▊    | 1293/2222 [23:19<16:40,  1.08s/it]
 58%|█████▊    | 1294/2222 [23:20<16:41,  1.08s/it]
 58%|█████▊    | 1295/2222 [23:21<16:39,  1.08s/it]
 58%|█████▊    | 1296/2222 [23:22<16:36,  1.08s/it]
 58%|█████▊    | 1297/2222 [23:23<16:39,  1.08s/it]
 58%|█████▊    | 1298/2222 [23:24<16:32,  1.07s/it]
 58%|█████▊    | 1299/2222 [23:25<16:29,  1.07s/it]
 59%|█████▊    | 1300/2222 [23:26<16:37,  1.08s/it]
 59%|█████▊    | 1301/2222 [23:28<16:37,  1.08s/it]
 59%|█████▊    | 1302/2222 [23:29<16:36,  1.08s/it]
 59%|█████▊    | 1303/2222 [23:30<16:35,  1.08s/it]
 59%|█████▊    | 1304/2222 [23:31<16:31,  1.08s/it]
 59%|█████▊    | 1305/2222 [23:32<16:29,  1.08s/it]
 59%|█████▉    | 1306/2222 [23:33<16:25,  1.08s/it]
 59%|█████▉    | 1307/2222 [23:34<16:29,  1.08s/it]
 59%|█████▉    | 1308/2222 [23:35<16:20,  1.07s/it]
 59%|█████▉    | 1309/2222 [23:36<16:21,  1.07s/it]
 59%|█████▉    | 1310/2222 [23:37<16:18,  1.07s/it]
 59%|█████▉    | 1311/2222 [23:38<16:13,  1.07s/it]
 59%|█████▉    | 1312/2222 [23:39<16:22,  1.08s/it]
 59%|█████▉    | 1313/2222 [23:40<16:19,  1.08s/it]
 59%|█████▉    | 1314/2222 [23:41<16:10,  1.07s/it]
 59%|█████▉    | 1315/2222 [23:43<16:29,  1.09s/it]
 59%|█████▉    | 1316/2222 [23:44<16:25,  1.09s/it]
 59%|█████▉    | 1317/2222 [23:45<16:33,  1.10s/it]
 59%|█████▉    | 1318/2222 [23:46<16:21,  1.09s/it]
 59%|█████▉    | 1319/2222 [23:47<16:16,  1.08s/it]
 59%|█████▉    | 1320/2222 [23:48<16:09,  1.07s/it]
 59%|█████▉    | 1321/2222 [23:49<16:15,  1.08s/it]
 59%|█████▉    | 1322/2222 [23:50<16:10,  1.08s/it]
 60%|█████▉    | 1323/2222 [23:51<16:05,  1.07s/it]
 60%|█████▉    | 1324/2222 [23:52<16:05,  1.08s/it]
 60%|█████▉    | 1325/2222 [23:53<15:56,  1.07s/it]
 60%|█████▉    | 1326/2222 [23:54<16:06,  1.08s/it]
 60%|█████▉    | 1327/2222 [23:56<15:58,  1.07s/it]
 60%|█████▉    | 1328/2222 [23:57<15:56,  1.07s/it]
 60%|█████▉    | 1329/2222 [23:58<16:00,  1.08s/it]
 60%|█████▉    | 1330/2222 [23:59<16:01,  1.08s/it]
 60%|█████▉    | 1331/2222 [24:00<15:58,  1.08s/it]
 60%|█████▉    | 1332/2222 [24:01<15:59,  1.08s/it]
 60%|█████▉    | 1333/2222 [24:02<16:05,  1.09s/it]
 60%|██████    | 1334/2222 [24:03<16:08,  1.09s/it]
 60%|██████    | 1335/2222 [24:04<15:57,  1.08s/it]
 60%|██████    | 1336/2222 [24:05<15:58,  1.08s/it]
 60%|██████    | 1337/2222 [24:06<16:00,  1.09s/it]
 60%|██████    | 1338/2222 [24:07<15:53,  1.08s/it]
 60%|██████    | 1339/2222 [24:09<15:51,  1.08s/it]
 60%|██████    | 1340/2222 [24:10<15:46,  1.07s/it]
 60%|██████    | 1341/2222 [24:11<15:49,  1.08s/it]
 60%|██████    | 1342/2222 [24:12<15:44,  1.07s/it]
 60%|██████    | 1343/2222 [24:13<15:46,  1.08s/it]
 60%|██████    | 1344/2222 [24:14<15:49,  1.08s/it]
 61%|██████    | 1345/2222 [24:15<15:40,  1.07s/it]
 61%|██████    | 1346/2222 [24:16<15:32,  1.06s/it]
 61%|██████    | 1347/2222 [24:17<15:34,  1.07s/it]
 61%|██████    | 1348/2222 [24:18<15:30,  1.06s/it]
 61%|██████    | 1349/2222 [24:19<15:29,  1.07s/it]
 61%|██████    | 1350/2222 [24:20<15:26,  1.06s/it]
 61%|██████    | 1351/2222 [24:21<15:36,  1.08s/it]
 61%|██████    | 1352/2222 [24:22<15:26,  1.06s/it]
 61%|██████    | 1353/2222 [24:23<15:32,  1.07s/it]
 61%|██████    | 1354/2222 [24:25<15:37,  1.08s/it]
 61%|██████    | 1355/2222 [24:26<15:38,  1.08s/it]
 61%|██████    | 1356/2222 [24:27<15:32,  1.08s/it]
 61%|██████    | 1357/2222 [24:28<15:40,  1.09s/it]
 61%|██████    | 1358/2222 [24:29<15:36,  1.08s/it]
 61%|██████    | 1359/2222 [24:30<15:36,  1.08s/it]
 61%|██████    | 1360/2222 [24:31<15:30,  1.08s/it]
 61%|██████▏   | 1361/2222 [24:32<15:27,  1.08s/it]
 61%|██████▏   | 1362/2222 [24:33<15:23,  1.07s/it]
 61%|██████▏   | 1363/2222 [24:34<15:31,  1.08s/it]
 61%|██████▏   | 1364/2222 [24:35<15:21,  1.07s/it]
 61%|██████▏   | 1365/2222 [24:36<15:14,  1.07s/it]
 61%|██████▏   | 1366/2222 [24:38<15:20,  1.07s/it]
 62%|██████▏   | 1367/2222 [24:39<15:24,  1.08s/it]
 62%|██████▏   | 1368/2222 [24:40<15:12,  1.07s/it]
 62%|██████▏   | 1369/2222 [24:41<15:11,  1.07s/it]
 62%|██████▏   | 1370/2222 [24:42<15:17,  1.08s/it]
 62%|██████▏   | 1371/2222 [24:43<15:02,  1.06s/it]
 62%|██████▏   | 1372/2222 [24:44<15:09,  1.07s/it]
 62%|██████▏   | 1373/2222 [24:45<15:02,  1.06s/it]
 62%|██████▏   | 1374/2222 [24:46<15:03,  1.07s/it]
 62%|██████▏   | 1375/2222 [24:47<15:03,  1.07s/it]
 62%|██████▏   | 1376/2222 [24:48<14:53,  1.06s/it]
 62%|██████▏   | 1377/2222 [24:49<14:52,  1.06s/it]
 62%|██████▏   | 1378/2222 [24:50<14:45,  1.05s/it]
 62%|██████▏   | 1379/2222 [24:51<14:52,  1.06s/it]
 62%|██████▏   | 1380/2222 [24:52<14:47,  1.05s/it]
 62%|██████▏   | 1381/2222 [24:53<15:00,  1.07s/it]
 62%|██████▏   | 1382/2222 [24:55<15:00,  1.07s/it]
 62%|██████▏   | 1383/2222 [24:56<15:05,  1.08s/it]
 62%|██████▏   | 1384/2222 [24:57<15:08,  1.08s/it]
 62%|██████▏   | 1385/2222 [24:58<15:05,  1.08s/it]
 62%|██████▏   | 1386/2222 [24:59<15:05,  1.08s/it]
 62%|██████▏   | 1387/2222 [25:00<15:07,  1.09s/it]
 62%|██████▏   | 1388/2222 [25:01<15:03,  1.08s/it]
 63%|██████▎   | 1389/2222 [25:02<15:07,  1.09s/it]
 63%|██████▎   | 1390/2222 [25:03<15:06,  1.09s/it]
 63%|██████▎   | 1391/2222 [25:04<14:51,  1.07s/it]
 63%|██████▎   | 1392/2222 [25:05<14:50,  1.07s/it]
 63%|██████▎   | 1393/2222 [25:06<14:57,  1.08s/it]
 63%|██████▎   | 1394/2222 [25:08<15:59,  1.16s/it]
 63%|██████▎   | 1395/2222 [25:09<15:37,  1.13s/it]
 63%|██████▎   | 1396/2222 [25:10<15:13,  1.11s/it]
 63%|██████▎   | 1397/2222 [25:11<14:56,  1.09s/it]
 63%|██████▎   | 1398/2222 [25:12<14:56,  1.09s/it]
 63%|██████▎   | 1399/2222 [25:13<14:55,  1.09s/it]
 63%|██████▎   | 1400/2222 [25:14<14:46,  1.08s/it]
 63%|██████▎   | 1401/2222 [25:15<14:46,  1.08s/it]
 63%|██████▎   | 1402/2222 [25:16<14:47,  1.08s/it]
 63%|██████▎   | 1403/2222 [25:18<14:54,  1.09s/it]
 63%|██████▎   | 1404/2222 [25:19<14:51,  1.09s/it]
 63%|██████▎   | 1405/2222 [25:20<14:43,  1.08s/it]
 63%|██████▎   | 1406/2222 [25:21<14:37,  1.08s/it]
 63%|██████▎   | 1407/2222 [25:22<14:34,  1.07s/it]
 63%|██████▎   | 1408/2222 [25:23<14:30,  1.07s/it]
 63%|██████▎   | 1409/2222 [25:24<14:30,  1.07s/it]
 63%|██████▎   | 1410/2222 [25:25<14:37,  1.08s/it]
 64%|██████▎   | 1411/2222 [25:26<14:45,  1.09s/it]
 64%|██████▎   | 1412/2222 [25:27<14:41,  1.09s/it]
 64%|██████▎   | 1413/2222 [25:28<14:37,  1.09s/it]
 64%|██████▎   | 1414/2222 [25:29<14:36,  1.09s/it]
 64%|██████▎   | 1415/2222 [25:30<14:40,  1.09s/it]
 64%|██████▎   | 1416/2222 [25:32<14:38,  1.09s/it]
 64%|██████▍   | 1417/2222 [25:33<14:29,  1.08s/it]
 64%|██████▍   | 1418/2222 [25:34<14:30,  1.08s/it]
 64%|██████▍   | 1419/2222 [25:35<14:20,  1.07s/it]
 64%|██████▍   | 1420/2222 [25:36<14:12,  1.06s/it]
 64%|██████▍   | 1421/2222 [25:37<14:22,  1.08s/it]
 64%|██████▍   | 1422/2222 [25:38<14:27,  1.08s/it]
 64%|██████▍   | 1423/2222 [25:39<14:15,  1.07s/it]
 64%|██████▍   | 1424/2222 [25:40<14:18,  1.08s/it]
 64%|██████▍   | 1425/2222 [25:41<14:32,  1.09s/it]
 64%|██████▍   | 1426/2222 [25:42<14:14,  1.07s/it]
 64%|██████▍   | 1427/2222 [25:43<14:09,  1.07s/it]
 64%|██████▍   | 1428/2222 [25:44<14:04,  1.06s/it]
 64%|██████▍   | 1429/2222 [25:46<14:12,  1.08s/it]
 64%|██████▍   | 1430/2222 [25:47<14:10,  1.07s/it]
 64%|██████▍   | 1431/2222 [25:48<14:05,  1.07s/it]
 64%|██████▍   | 1432/2222 [25:49<14:04,  1.07s/it]
 64%|██████▍   | 1433/2222 [25:50<14:12,  1.08s/it]
 65%|██████▍   | 1434/2222 [25:51<14:04,  1.07s/it]
 65%|██████▍   | 1435/2222 [25:52<14:06,  1.08s/it]
 65%|██████▍   | 1436/2222 [25:53<14:02,  1.07s/it]
 65%|██████▍   | 1437/2222 [25:54<14:00,  1.07s/it]
 65%|██████▍   | 1438/2222 [25:55<13:57,  1.07s/it]
 65%|██████▍   | 1439/2222 [25:56<13:48,  1.06s/it]
 65%|██████▍   | 1440/2222 [25:57<13:42,  1.05s/it]
 65%|██████▍   | 1441/2222 [25:58<13:46,  1.06s/it]
 65%|██████▍   | 1442/2222 [25:59<13:51,  1.07s/it]
 65%|██████▍   | 1443/2222 [26:00<13:56,  1.07s/it]
 65%|██████▍   | 1444/2222 [26:02<13:56,  1.08s/it]
 65%|██████▌   | 1445/2222 [26:03<14:09,  1.09s/it]
 65%|██████▌   | 1446/2222 [26:04<14:03,  1.09s/it]
 65%|██████▌   | 1447/2222 [26:05<13:54,  1.08s/it]
 65%|██████▌   | 1448/2222 [26:06<13:51,  1.07s/it]
 65%|██████▌   | 1449/2222 [26:07<13:55,  1.08s/it]
 65%|██████▌   | 1450/2222 [26:08<13:48,  1.07s/it]
 65%|██████▌   | 1451/2222 [26:09<13:51,  1.08s/it]
 65%|██████▌   | 1452/2222 [26:10<13:49,  1.08s/it]
 65%|██████▌   | 1453/2222 [26:11<13:45,  1.07s/it]
 65%|██████▌   | 1454/2222 [26:12<13:52,  1.08s/it]
 65%|██████▌   | 1455/2222 [26:13<13:50,  1.08s/it]
 66%|██████▌   | 1456/2222 [26:15<13:42,  1.07s/it]
 66%|██████▌   | 1457/2222 [26:16<13:38,  1.07s/it]
 66%|██████▌   | 1458/2222 [26:17<13:30,  1.06s/it]
 66%|██████▌   | 1459/2222 [26:18<13:34,  1.07s/it]
 66%|██████▌   | 1460/2222 [26:19<13:36,  1.07s/it]
 66%|██████▌   | 1461/2222 [26:20<13:40,  1.08s/it]
 66%|██████▌   | 1462/2222 [26:21<13:35,  1.07s/it]
 66%|██████▌   | 1463/2222 [26:22<13:39,  1.08s/it]
 66%|██████▌   | 1464/2222 [26:23<13:34,  1.07s/it]
 66%|██████▌   | 1465/2222 [26:24<13:37,  1.08s/it]
 66%|██████▌   | 1466/2222 [26:25<13:34,  1.08s/it]
 66%|██████▌   | 1467/2222 [26:26<13:18,  1.06s/it]
 66%|██████▌   | 1468/2222 [26:27<13:34,  1.08s/it]
 66%|██████▌   | 1469/2222 [26:28<13:34,  1.08s/it]
 66%|██████▌   | 1470/2222 [26:30<13:31,  1.08s/it]
 66%|██████▌   | 1471/2222 [26:31<13:34,  1.08s/it]
 66%|██████▌   | 1472/2222 [26:32<13:38,  1.09s/it]
 66%|██████▋   | 1473/2222 [26:33<13:34,  1.09s/it]
 66%|██████▋   | 1474/2222 [26:34<13:29,  1.08s/it]
 66%|██████▋   | 1475/2222 [26:35<13:24,  1.08s/it]
 66%|██████▋   | 1476/2222 [26:36<13:36,  1.09s/it]
 66%|██████▋   | 1477/2222 [26:37<13:28,  1.09s/it]
 67%|██████▋   | 1478/2222 [26:38<13:28,  1.09s/it]
 67%|██████▋   | 1479/2222 [26:39<13:17,  1.07s/it]
 67%|██████▋   | 1480/2222 [26:40<13:15,  1.07s/it]
 67%|██████▋   | 1481/2222 [26:41<13:19,  1.08s/it]
 67%|██████▋   | 1482/2222 [26:43<13:18,  1.08s/it]
 67%|██████▋   | 1483/2222 [26:44<13:16,  1.08s/it]
 67%|██████▋   | 1484/2222 [26:45<13:11,  1.07s/it]
 67%|██████▋   | 1485/2222 [26:46<13:14,  1.08s/it]
 67%|██████▋   | 1486/2222 [26:47<13:09,  1.07s/it]
 67%|██████▋   | 1487/2222 [26:48<13:17,  1.08s/it]
 67%|██████▋   | 1488/2222 [26:49<13:12,  1.08s/it]
 67%|██████▋   | 1489/2222 [26:50<13:14,  1.08s/it]
 67%|██████▋   | 1490/2222 [26:51<13:11,  1.08s/it]
 67%|██████▋   | 1491/2222 [26:52<13:07,  1.08s/it]
 67%|██████▋   | 1492/2222 [26:53<13:06,  1.08s/it]
 67%|██████▋   | 1493/2222 [26:54<12:53,  1.06s/it]
 67%|██████▋   | 1494/2222 [26:55<12:56,  1.07s/it]
 67%|██████▋   | 1495/2222 [26:56<12:54,  1.07s/it]
 67%|██████▋   | 1496/2222 [26:58<12:51,  1.06s/it]
 67%|██████▋   | 1497/2222 [26:59<12:54,  1.07s/it]
 67%|██████▋   | 1498/2222 [27:00<12:52,  1.07s/it]
 67%|██████▋   | 1499/2222 [27:01<12:57,  1.07s/it]
 68%|██████▊   | 1500/2222 [27:02<13:00,  1.08s/it]
                                                   
{'loss': 2.0216, 'learning_rate': 1.6246624662466247e-05, 'epoch': 1.35}

 68%|██████▊   | 1500/2222 [27:02<13:00,  1.08s/it]
 68%|██████▊   | 1501/2222 [27:03<13:00,  1.08s/it]
 68%|██████▊   | 1502/2222 [27:04<12:57,  1.08s/it]
 68%|██████▊   | 1503/2222 [27:05<12:57,  1.08s/it]
 68%|██████▊   | 1504/2222 [27:06<12:51,  1.07s/it]
 68%|██████▊   | 1505/2222 [27:07<12:49,  1.07s/it]
 68%|██████▊   | 1506/2222 [27:08<12:56,  1.08s/it]
 68%|██████▊   | 1507/2222 [27:09<12:49,  1.08s/it]
 68%|██████▊   | 1508/2222 [27:10<12:46,  1.07s/it]
 68%|██████▊   | 1509/2222 [27:12<12:43,  1.07s/it]
 68%|██████▊   | 1510/2222 [27:13<12:42,  1.07s/it]
 68%|██████▊   | 1511/2222 [27:14<12:33,  1.06s/it]
 68%|██████▊   | 1512/2222 [27:15<12:37,  1.07s/it]
 68%|██████▊   | 1513/2222 [27:16<12:33,  1.06s/it]
 68%|██████▊   | 1514/2222 [27:17<12:31,  1.06s/it]
 68%|██████▊   | 1515/2222 [27:18<12:29,  1.06s/it]
 68%|██████▊   | 1516/2222 [27:19<12:37,  1.07s/it]
 68%|██████▊   | 1517/2222 [27:20<12:36,  1.07s/it]
 68%|██████▊   | 1518/2222 [27:21<12:40,  1.08s/it]
 68%|██████▊   | 1519/2222 [27:22<12:29,  1.07s/it]
 68%|██████▊   | 1520/2222 [27:23<12:39,  1.08s/it]
 68%|██████▊   | 1521/2222 [27:24<12:36,  1.08s/it]
 68%|██████▊   | 1522/2222 [27:26<12:39,  1.09s/it]
 69%|██████▊   | 1523/2222 [27:27<12:34,  1.08s/it]
 69%|██████▊   | 1524/2222 [27:28<12:21,  1.06s/it]
 69%|██████▊   | 1525/2222 [27:29<12:22,  1.07s/it]
 69%|██████▊   | 1526/2222 [27:30<12:25,  1.07s/it]
 69%|██████▊   | 1527/2222 [27:31<12:29,  1.08s/it]
 69%|██████▉   | 1528/2222 [27:32<12:17,  1.06s/it]
 69%|██████▉   | 1529/2222 [27:33<12:19,  1.07s/it]
 69%|██████▉   | 1530/2222 [27:34<12:21,  1.07s/it]
 69%|██████▉   | 1531/2222 [27:35<12:14,  1.06s/it]
 69%|██████▉   | 1532/2222 [27:36<12:14,  1.06s/it]
 69%|██████▉   | 1533/2222 [27:37<12:15,  1.07s/it]
 69%|██████▉   | 1534/2222 [27:38<12:10,  1.06s/it]
 69%|██████▉   | 1535/2222 [27:39<12:15,  1.07s/it]
 69%|██████▉   | 1536/2222 [27:40<12:19,  1.08s/it]
 69%|██████▉   | 1537/2222 [27:42<12:16,  1.07s/it]
 69%|██████▉   | 1538/2222 [27:43<12:23,  1.09s/it]
 69%|██████▉   | 1539/2222 [27:44<12:19,  1.08s/it]
 69%|██████▉   | 1540/2222 [27:45<12:09,  1.07s/it]
 69%|██████▉   | 1541/2222 [27:46<12:18,  1.08s/it]
 69%|██████▉   | 1542/2222 [27:47<12:21,  1.09s/it]
 69%|██████▉   | 1543/2222 [27:48<12:11,  1.08s/it]
 69%|██████▉   | 1544/2222 [27:49<12:15,  1.08s/it]
 70%|██████▉   | 1545/2222 [27:50<12:16,  1.09s/it]
 70%|██████▉   | 1546/2222 [27:51<12:05,  1.07s/it]
 70%|██████▉   | 1547/2222 [27:52<12:07,  1.08s/it]
 70%|██████▉   | 1548/2222 [27:53<12:03,  1.07s/it]
 70%|██████▉   | 1549/2222 [27:54<12:05,  1.08s/it]
 70%|██████▉   | 1550/2222 [27:56<12:02,  1.08s/it]
 70%|██████▉   | 1551/2222 [27:57<12:06,  1.08s/it]
 70%|██████▉   | 1552/2222 [27:58<12:05,  1.08s/it]
 70%|██████▉   | 1553/2222 [27:59<12:05,  1.08s/it]
 70%|██████▉   | 1554/2222 [28:00<12:01,  1.08s/it]
 70%|██████▉   | 1555/2222 [28:01<12:08,  1.09s/it]
 70%|███████   | 1556/2222 [28:02<12:12,  1.10s/it]
 70%|███████   | 1557/2222 [28:03<12:00,  1.08s/it]
 70%|███████   | 1558/2222 [28:04<12:00,  1.09s/it]
 70%|███████   | 1559/2222 [28:05<12:00,  1.09s/it]
 70%|███████   | 1560/2222 [28:06<11:57,  1.08s/it]
 70%|███████   | 1561/2222 [28:08<11:57,  1.09s/it]
 70%|███████   | 1562/2222 [28:09<11:56,  1.09s/it]
 70%|███████   | 1563/2222 [28:10<11:52,  1.08s/it]
 70%|███████   | 1564/2222 [28:11<11:51,  1.08s/it]
 70%|███████   | 1565/2222 [28:12<11:54,  1.09s/it]
 70%|███████   | 1566/2222 [28:13<11:53,  1.09s/it]
 71%|███████   | 1567/2222 [28:14<11:48,  1.08s/it]
 71%|███████   | 1568/2222 [28:15<11:50,  1.09s/it]
 71%|███████   | 1569/2222 [28:16<11:43,  1.08s/it]
 71%|███████   | 1570/2222 [28:17<11:37,  1.07s/it]
 71%|███████   | 1571/2222 [28:18<11:44,  1.08s/it]
 71%|███████   | 1572/2222 [28:19<11:44,  1.08s/it]
 71%|███████   | 1573/2222 [28:21<11:51,  1.10s/it]
 71%|███████   | 1574/2222 [28:22<11:48,  1.09s/it]
 71%|███████   | 1575/2222 [28:23<11:47,  1.09s/it]
 71%|███████   | 1576/2222 [28:24<11:41,  1.09s/it]
 71%|███████   | 1577/2222 [28:25<11:38,  1.08s/it]
 71%|███████   | 1578/2222 [28:26<11:39,  1.09s/it]
 71%|███████   | 1579/2222 [28:27<11:34,  1.08s/it]
 71%|███████   | 1580/2222 [28:28<11:32,  1.08s/it]
 71%|███████   | 1581/2222 [28:29<11:40,  1.09s/it]
 71%|███████   | 1582/2222 [28:30<11:33,  1.08s/it]
 71%|███████   | 1583/2222 [28:31<11:30,  1.08s/it]
 71%|███████▏  | 1584/2222 [28:32<11:26,  1.08s/it]
 71%|███████▏  | 1585/2222 [28:33<11:20,  1.07s/it]
 71%|███████▏  | 1586/2222 [28:35<11:24,  1.08s/it]
 71%|███████▏  | 1587/2222 [28:36<11:21,  1.07s/it]
 71%|███████▏  | 1588/2222 [28:37<11:18,  1.07s/it]
 72%|███████▏  | 1589/2222 [28:38<11:22,  1.08s/it]
 72%|███████▏  | 1590/2222 [28:39<11:19,  1.07s/it]
 72%|███████▏  | 1591/2222 [28:40<11:21,  1.08s/it]
 72%|███████▏  | 1592/2222 [28:41<11:13,  1.07s/it]
 72%|███████▏  | 1593/2222 [28:42<11:16,  1.08s/it]
 72%|███████▏  | 1594/2222 [28:43<11:13,  1.07s/it]
 72%|███████▏  | 1595/2222 [28:44<11:12,  1.07s/it]
 72%|███████▏  | 1596/2222 [28:45<11:12,  1.07s/it]
 72%|███████▏  | 1597/2222 [28:46<11:13,  1.08s/it]
 72%|███████▏  | 1598/2222 [28:48<11:13,  1.08s/it]
 72%|███████▏  | 1599/2222 [28:49<11:10,  1.08s/it]
 72%|███████▏  | 1600/2222 [28:50<11:14,  1.08s/it]
 72%|███████▏  | 1601/2222 [28:51<11:11,  1.08s/it]
 72%|███████▏  | 1602/2222 [28:52<11:08,  1.08s/it]
 72%|███████▏  | 1603/2222 [28:53<11:04,  1.07s/it]
 72%|███████▏  | 1604/2222 [28:54<11:09,  1.08s/it]
 72%|███████▏  | 1605/2222 [28:55<11:08,  1.08s/it]
 72%|███████▏  | 1606/2222 [28:56<11:08,  1.08s/it]
 72%|███████▏  | 1607/2222 [28:57<11:01,  1.08s/it]
 72%|███████▏  | 1608/2222 [28:58<11:02,  1.08s/it]
 72%|███████▏  | 1609/2222 [28:59<11:01,  1.08s/it]
 72%|███████▏  | 1610/2222 [29:00<10:55,  1.07s/it]
 73%|███████▎  | 1611/2222 [29:02<11:00,  1.08s/it]
 73%|███████▎  | 1612/2222 [29:03<10:59,  1.08s/it]
 73%|███████▎  | 1613/2222 [29:04<10:59,  1.08s/it]
 73%|███████▎  | 1614/2222 [29:05<10:53,  1.07s/it]
 73%|███████▎  | 1615/2222 [29:06<10:55,  1.08s/it]
 73%|███████▎  | 1616/2222 [29:07<10:53,  1.08s/it]
 73%|███████▎  | 1617/2222 [29:08<10:52,  1.08s/it]
 73%|███████▎  | 1618/2222 [29:09<10:52,  1.08s/it]
 73%|███████▎  | 1619/2222 [29:10<10:48,  1.08s/it]
 73%|███████▎  | 1620/2222 [29:11<10:45,  1.07s/it]
 73%|███████▎  | 1621/2222 [29:12<10:50,  1.08s/it]
 73%|███████▎  | 1622/2222 [29:13<10:55,  1.09s/it]
 73%|███████▎  | 1623/2222 [29:15<10:49,  1.08s/it]
 73%|███████▎  | 1624/2222 [29:16<10:48,  1.08s/it]
 73%|███████▎  | 1625/2222 [29:17<10:44,  1.08s/it]
 73%|███████▎  | 1626/2222 [29:18<10:35,  1.07s/it]
 73%|███████▎  | 1627/2222 [29:19<10:40,  1.08s/it]
 73%|███████▎  | 1628/2222 [29:20<10:37,  1.07s/it]
 73%|███████▎  | 1629/2222 [29:21<10:36,  1.07s/it]
 73%|███████▎  | 1630/2222 [29:22<10:33,  1.07s/it]
 73%|███████▎  | 1631/2222 [29:23<10:34,  1.07s/it]
 73%|███████▎  | 1632/2222 [29:24<10:36,  1.08s/it]
 73%|███████▎  | 1633/2222 [29:25<10:36,  1.08s/it]
 74%|███████▎  | 1634/2222 [29:26<10:33,  1.08s/it]
 74%|███████▎  | 1635/2222 [29:27<10:35,  1.08s/it]
 74%|███████▎  | 1636/2222 [29:29<10:36,  1.09s/it]
 74%|███████▎  | 1637/2222 [29:30<10:36,  1.09s/it]
 74%|███████▎  | 1638/2222 [29:31<10:34,  1.09s/it]
 74%|███████▍  | 1639/2222 [29:32<10:29,  1.08s/it]
 74%|███████▍  | 1640/2222 [29:33<10:27,  1.08s/it]
 74%|███████▍  | 1641/2222 [29:34<10:31,  1.09s/it]
 74%|███████▍  | 1642/2222 [29:35<10:24,  1.08s/it]
 74%|███████▍  | 1643/2222 [29:36<10:23,  1.08s/it]
 74%|███████▍  | 1644/2222 [29:37<10:28,  1.09s/it]
 74%|███████▍  | 1645/2222 [29:38<10:18,  1.07s/it]
 74%|███████▍  | 1646/2222 [29:39<10:22,  1.08s/it]
 74%|███████▍  | 1647/2222 [29:40<10:18,  1.08s/it]
 74%|███████▍  | 1648/2222 [29:41<10:20,  1.08s/it]
 74%|███████▍  | 1649/2222 [29:43<10:19,  1.08s/it]
 74%|███████▍  | 1650/2222 [29:44<10:12,  1.07s/it]
 74%|███████▍  | 1651/2222 [29:45<10:15,  1.08s/it]
 74%|███████▍  | 1652/2222 [29:46<10:10,  1.07s/it]
 74%|███████▍  | 1653/2222 [29:47<10:08,  1.07s/it]
 74%|███████▍  | 1654/2222 [29:48<10:04,  1.06s/it]
 74%|███████▍  | 1655/2222 [29:49<10:08,  1.07s/it]
 75%|███████▍  | 1656/2222 [29:50<10:04,  1.07s/it]
 75%|███████▍  | 1657/2222 [29:51<10:00,  1.06s/it]
 75%|███████▍  | 1658/2222 [29:52<10:05,  1.07s/it]
 75%|███████▍  | 1659/2222 [29:53<10:04,  1.07s/it]
 75%|███████▍  | 1660/2222 [29:54<09:59,  1.07s/it]
 75%|███████▍  | 1661/2222 [29:55<10:01,  1.07s/it]
 75%|███████▍  | 1662/2222 [29:56<10:00,  1.07s/it]
 75%|███████▍  | 1663/2222 [29:58<10:03,  1.08s/it]
 75%|███████▍  | 1664/2222 [29:59<10:10,  1.09s/it]
 75%|███████▍  | 1665/2222 [30:00<10:02,  1.08s/it]
 75%|███████▍  | 1666/2222 [30:01<10:03,  1.09s/it]
 75%|███████▌  | 1667/2222 [30:02<10:01,  1.08s/it]
 75%|███████▌  | 1668/2222 [30:03<09:55,  1.07s/it]
 75%|███████▌  | 1669/2222 [30:04<09:55,  1.08s/it]
 75%|███████▌  | 1670/2222 [30:05<09:56,  1.08s/it]
 75%|███████▌  | 1671/2222 [30:06<09:54,  1.08s/it]
 75%|███████▌  | 1672/2222 [30:07<09:46,  1.07s/it]
 75%|███████▌  | 1673/2222 [30:08<09:48,  1.07s/it]
 75%|███████▌  | 1674/2222 [30:09<09:46,  1.07s/it]
 75%|███████▌  | 1675/2222 [30:10<09:51,  1.08s/it]
 75%|███████▌  | 1676/2222 [30:12<09:57,  1.09s/it]
 75%|███████▌  | 1677/2222 [30:13<09:55,  1.09s/it]
 76%|███████▌  | 1678/2222 [30:14<09:49,  1.08s/it]
 76%|███████▌  | 1679/2222 [30:15<09:49,  1.08s/it]
 76%|███████▌  | 1680/2222 [30:16<09:45,  1.08s/it]
 76%|███████▌  | 1681/2222 [30:17<09:44,  1.08s/it]
 76%|███████▌  | 1682/2222 [30:18<09:46,  1.09s/it]
 76%|███████▌  | 1683/2222 [30:19<09:40,  1.08s/it]
 76%|███████▌  | 1684/2222 [30:20<09:40,  1.08s/it]
 76%|███████▌  | 1685/2222 [30:21<09:35,  1.07s/it]
 76%|███████▌  | 1686/2222 [30:22<09:34,  1.07s/it]
 76%|███████▌  | 1687/2222 [30:23<09:33,  1.07s/it]
 76%|███████▌  | 1688/2222 [30:25<09:30,  1.07s/it]
 76%|███████▌  | 1689/2222 [30:26<09:29,  1.07s/it]
 76%|███████▌  | 1690/2222 [30:27<09:30,  1.07s/it]
 76%|███████▌  | 1691/2222 [30:28<09:27,  1.07s/it]
 76%|███████▌  | 1692/2222 [30:29<09:23,  1.06s/it]
 76%|███████▌  | 1693/2222 [30:30<09:28,  1.07s/it]
 76%|███████▌  | 1694/2222 [30:31<09:25,  1.07s/it]
 76%|███████▋  | 1695/2222 [30:32<09:28,  1.08s/it]
 76%|███████▋  | 1696/2222 [30:33<09:23,  1.07s/it]
 76%|███████▋  | 1697/2222 [30:34<09:17,  1.06s/it]
 76%|███████▋  | 1698/2222 [30:35<09:20,  1.07s/it]
 76%|███████▋  | 1699/2222 [30:36<09:15,  1.06s/it]
 77%|███████▋  | 1700/2222 [30:37<09:21,  1.08s/it]
 77%|███████▋  | 1701/2222 [30:38<09:17,  1.07s/it]
 77%|███████▋  | 1702/2222 [30:39<09:11,  1.06s/it]
 77%|███████▋  | 1703/2222 [30:41<09:13,  1.07s/it]
 77%|███████▋  | 1704/2222 [30:42<09:12,  1.07s/it]
 77%|███████▋  | 1705/2222 [30:43<09:17,  1.08s/it]
 77%|███████▋  | 1706/2222 [30:44<09:14,  1.08s/it]
 77%|███████▋  | 1707/2222 [30:45<09:11,  1.07s/it]
 77%|███████▋  | 1708/2222 [30:46<09:08,  1.07s/it]
 77%|███████▋  | 1709/2222 [30:47<09:13,  1.08s/it]
 77%|███████▋  | 1710/2222 [30:48<09:07,  1.07s/it]
 77%|███████▋  | 1711/2222 [30:49<09:09,  1.07s/it]
 77%|███████▋  | 1712/2222 [30:50<09:12,  1.08s/it]
 77%|███████▋  | 1713/2222 [30:51<09:08,  1.08s/it]
 77%|███████▋  | 1714/2222 [30:52<09:06,  1.07s/it]
 77%|███████▋  | 1715/2222 [30:53<09:01,  1.07s/it]
 77%|███████▋  | 1716/2222 [30:54<09:00,  1.07s/it]
 77%|███████▋  | 1717/2222 [30:56<09:03,  1.08s/it]
 77%|███████▋  | 1718/2222 [30:57<08:56,  1.06s/it]
 77%|███████▋  | 1719/2222 [30:58<08:55,  1.06s/it]
 77%|███████▋  | 1720/2222 [30:59<08:58,  1.07s/it]
 77%|███████▋  | 1721/2222 [31:00<08:54,  1.07s/it]
 77%|███████▋  | 1722/2222 [31:01<08:56,  1.07s/it]
 78%|███████▊  | 1723/2222 [31:02<08:56,  1.08s/it]
 78%|███████▊  | 1724/2222 [31:03<08:58,  1.08s/it]
 78%|███████▊  | 1725/2222 [31:04<08:53,  1.07s/it]
 78%|███████▊  | 1726/2222 [31:05<08:53,  1.08s/it]
 78%|███████▊  | 1727/2222 [31:06<08:52,  1.08s/it]
 78%|███████▊  | 1728/2222 [31:07<08:52,  1.08s/it]
 78%|███████▊  | 1729/2222 [31:08<08:50,  1.08s/it]
 78%|███████▊  | 1730/2222 [31:10<08:49,  1.08s/it]
 78%|███████▊  | 1731/2222 [31:11<08:45,  1.07s/it]
 78%|███████▊  | 1732/2222 [31:12<08:43,  1.07s/it]
 78%|███████▊  | 1733/2222 [31:13<08:48,  1.08s/it]
 78%|███████▊  | 1734/2222 [31:14<08:43,  1.07s/it]
 78%|███████▊  | 1735/2222 [31:15<08:42,  1.07s/it]
 78%|███████▊  | 1736/2222 [31:16<08:44,  1.08s/it]
 78%|███████▊  | 1737/2222 [31:17<08:44,  1.08s/it]
 78%|███████▊  | 1738/2222 [31:18<08:42,  1.08s/it]
 78%|███████▊  | 1739/2222 [31:19<08:40,  1.08s/it]
 78%|███████▊  | 1740/2222 [31:20<08:35,  1.07s/it]
 78%|███████▊  | 1741/2222 [31:21<08:34,  1.07s/it]
 78%|███████▊  | 1742/2222 [31:22<08:34,  1.07s/it]
 78%|███████▊  | 1743/2222 [31:24<08:39,  1.08s/it]
 78%|███████▊  | 1744/2222 [31:25<08:31,  1.07s/it]
 79%|███████▊  | 1745/2222 [31:26<08:36,  1.08s/it]
 79%|███████▊  | 1746/2222 [31:27<08:34,  1.08s/it]
 79%|███████▊  | 1747/2222 [31:28<08:32,  1.08s/it]
 79%|███████▊  | 1748/2222 [31:29<08:32,  1.08s/it]
 79%|███████▊  | 1749/2222 [31:30<08:30,  1.08s/it]
 79%|███████▉  | 1750/2222 [31:31<08:29,  1.08s/it]
 79%|███████▉  | 1751/2222 [31:32<08:30,  1.08s/it]
 79%|███████▉  | 1752/2222 [31:33<08:29,  1.08s/it]
 79%|███████▉  | 1753/2222 [31:34<08:26,  1.08s/it]
 79%|███████▉  | 1754/2222 [31:35<08:24,  1.08s/it]
 79%|███████▉  | 1755/2222 [31:37<08:26,  1.08s/it]
 79%|███████▉  | 1756/2222 [31:38<08:21,  1.08s/it]
 79%|███████▉  | 1757/2222 [31:39<08:22,  1.08s/it]
 79%|███████▉  | 1758/2222 [31:40<08:17,  1.07s/it]
 79%|███████▉  | 1759/2222 [31:41<08:18,  1.08s/it]
 79%|███████▉  | 1760/2222 [31:42<08:17,  1.08s/it]
 79%|███████▉  | 1761/2222 [31:43<08:15,  1.07s/it]
 79%|███████▉  | 1762/2222 [31:44<08:14,  1.08s/it]
 79%|███████▉  | 1763/2222 [31:45<08:11,  1.07s/it]
 79%|███████▉  | 1764/2222 [31:46<08:11,  1.07s/it]
 79%|███████▉  | 1765/2222 [31:47<08:08,  1.07s/it]
 79%|███████▉  | 1766/2222 [31:48<08:05,  1.07s/it]
 80%|███████▉  | 1767/2222 [31:49<08:07,  1.07s/it]
 80%|███████▉  | 1768/2222 [31:50<08:06,  1.07s/it]
 80%|███████▉  | 1769/2222 [31:52<08:02,  1.07s/it]
 80%|███████▉  | 1770/2222 [31:53<07:59,  1.06s/it]
 80%|███████▉  | 1771/2222 [31:54<08:01,  1.07s/it]
 80%|███████▉  | 1772/2222 [31:55<07:58,  1.06s/it]
 80%|███████▉  | 1773/2222 [31:56<08:00,  1.07s/it]
 80%|███████▉  | 1774/2222 [31:57<08:03,  1.08s/it]
 80%|███████▉  | 1775/2222 [31:58<08:01,  1.08s/it]
 80%|███████▉  | 1776/2222 [31:59<07:56,  1.07s/it]
 80%|███████▉  | 1777/2222 [32:00<07:53,  1.06s/it]
 80%|████████  | 1778/2222 [32:01<07:52,  1.07s/it]
 80%|████████  | 1779/2222 [32:02<07:50,  1.06s/it]
 80%|████████  | 1780/2222 [32:03<07:53,  1.07s/it]
 80%|████████  | 1781/2222 [32:04<07:58,  1.08s/it]
 80%|████████  | 1782/2222 [32:05<07:56,  1.08s/it]
 80%|████████  | 1783/2222 [32:07<07:54,  1.08s/it]
 80%|████████  | 1784/2222 [32:08<07:48,  1.07s/it]
 80%|████████  | 1785/2222 [32:09<07:53,  1.08s/it]
 80%|████████  | 1786/2222 [32:10<07:47,  1.07s/it]
 80%|████████  | 1787/2222 [32:11<07:45,  1.07s/it]
 80%|████████  | 1788/2222 [32:12<07:44,  1.07s/it]
 81%|████████  | 1789/2222 [32:13<07:45,  1.07s/it]
 81%|████████  | 1790/2222 [32:14<07:43,  1.07s/it]
 81%|████████  | 1791/2222 [32:15<07:41,  1.07s/it]
 81%|████████  | 1792/2222 [32:16<07:40,  1.07s/it]
 81%|████████  | 1793/2222 [32:17<07:41,  1.08s/it]
 81%|████████  | 1794/2222 [32:18<07:40,  1.08s/it]
 81%|████████  | 1795/2222 [32:19<07:36,  1.07s/it]
 81%|████████  | 1796/2222 [32:20<07:36,  1.07s/it]
 81%|████████  | 1797/2222 [32:22<07:37,  1.08s/it]
 81%|████████  | 1798/2222 [32:23<07:36,  1.08s/it]
 81%|████████  | 1799/2222 [32:24<07:36,  1.08s/it]
 81%|████████  | 1800/2222 [32:25<07:34,  1.08s/it]
 81%|████████  | 1801/2222 [32:26<07:35,  1.08s/it]
 81%|████████  | 1802/2222 [32:27<07:30,  1.07s/it]
 81%|████████  | 1803/2222 [32:28<07:29,  1.07s/it]
 81%|████████  | 1804/2222 [32:29<07:33,  1.08s/it]
 81%|████████  | 1805/2222 [32:30<07:28,  1.08s/it]
 81%|████████▏ | 1806/2222 [32:31<07:29,  1.08s/it]
 81%|████████▏ | 1807/2222 [32:32<07:22,  1.07s/it]
 81%|████████▏ | 1808/2222 [32:33<07:25,  1.08s/it]
 81%|████████▏ | 1809/2222 [32:34<07:22,  1.07s/it]
 81%|████████▏ | 1810/2222 [32:36<07:24,  1.08s/it]
 82%|████████▏ | 1811/2222 [32:37<07:22,  1.08s/it]
 82%|████████▏ | 1812/2222 [32:38<07:20,  1.07s/it]
 82%|████████▏ | 1813/2222 [32:39<07:18,  1.07s/it]
 82%|████████▏ | 1814/2222 [32:40<07:17,  1.07s/it]
 82%|████████▏ | 1815/2222 [32:41<07:19,  1.08s/it]
 82%|████████▏ | 1816/2222 [32:42<07:16,  1.08s/it]
 82%|████████▏ | 1817/2222 [32:43<07:18,  1.08s/it]
 82%|████████▏ | 1818/2222 [32:44<07:23,  1.10s/it]
 82%|████████▏ | 1819/2222 [32:45<07:16,  1.08s/it]
 82%|████████▏ | 1820/2222 [32:46<07:14,  1.08s/it]
 82%|████████▏ | 1821/2222 [32:47<07:15,  1.08s/it]
 82%|████████▏ | 1822/2222 [32:49<07:12,  1.08s/it]
 82%|████████▏ | 1823/2222 [32:50<07:08,  1.08s/it]
 82%|████████▏ | 1824/2222 [32:51<07:13,  1.09s/it]
 82%|████████▏ | 1825/2222 [32:52<07:09,  1.08s/it]
 82%|████████▏ | 1826/2222 [32:53<07:10,  1.09s/it]
 82%|████████▏ | 1827/2222 [32:54<07:07,  1.08s/it]
 82%|████████▏ | 1828/2222 [32:55<07:07,  1.08s/it]
 82%|████████▏ | 1829/2222 [32:56<07:05,  1.08s/it]
 82%|████████▏ | 1830/2222 [32:57<07:06,  1.09s/it]
 82%|████████▏ | 1831/2222 [32:58<07:06,  1.09s/it]
 82%|████████▏ | 1832/2222 [32:59<07:05,  1.09s/it]
 82%|████████▏ | 1833/2222 [33:00<07:03,  1.09s/it]
 83%|████████▎ | 1834/2222 [33:02<07:01,  1.09s/it]
 83%|████████▎ | 1835/2222 [33:03<06:56,  1.08s/it]
 83%|████████▎ | 1836/2222 [33:04<06:58,  1.08s/it]
 83%|████████▎ | 1837/2222 [33:05<06:54,  1.08s/it]
 83%|████████▎ | 1838/2222 [33:06<06:53,  1.08s/it]
 83%|████████▎ | 1839/2222 [33:07<06:54,  1.08s/it]
 83%|████████▎ | 1840/2222 [33:08<06:54,  1.08s/it]
 83%|████████▎ | 1841/2222 [33:09<06:52,  1.08s/it]
 83%|████████▎ | 1842/2222 [33:10<06:51,  1.08s/it]
 83%|████████▎ | 1843/2222 [33:11<06:50,  1.08s/it]
 83%|████████▎ | 1844/2222 [33:12<06:46,  1.08s/it]
 83%|████████▎ | 1845/2222 [33:13<06:44,  1.07s/it]
 83%|████████▎ | 1846/2222 [33:15<06:47,  1.08s/it]
 83%|████████▎ | 1847/2222 [33:16<06:41,  1.07s/it]
 83%|████████▎ | 1848/2222 [33:17<06:37,  1.06s/it]
 83%|████████▎ | 1849/2222 [33:18<06:43,  1.08s/it]
 83%|████████▎ | 1850/2222 [33:19<06:38,  1.07s/it]
 83%|████████▎ | 1851/2222 [33:20<06:35,  1.07s/it]
 83%|████████▎ | 1852/2222 [33:21<06:38,  1.08s/it]
 83%|████████▎ | 1853/2222 [33:22<06:33,  1.07s/it]
 83%|████████▎ | 1854/2222 [33:23<06:36,  1.08s/it]
 83%|████████▎ | 1855/2222 [33:24<06:34,  1.07s/it]
 84%|████████▎ | 1856/2222 [33:25<06:34,  1.08s/it]
 84%|████████▎ | 1857/2222 [33:26<06:31,  1.07s/it]
 84%|████████▎ | 1858/2222 [33:27<06:28,  1.07s/it]
 84%|████████▎ | 1859/2222 [33:28<06:28,  1.07s/it]
 84%|████████▎ | 1860/2222 [33:30<06:31,  1.08s/it]
 84%|████████▍ | 1861/2222 [33:31<06:35,  1.10s/it]
 84%|████████▍ | 1862/2222 [33:32<06:31,  1.09s/it]
 84%|████████▍ | 1863/2222 [33:33<06:29,  1.09s/it]
 84%|████████▍ | 1864/2222 [33:34<06:28,  1.08s/it]
 84%|████████▍ | 1865/2222 [33:35<06:26,  1.08s/it]
 84%|████████▍ | 1866/2222 [33:36<06:23,  1.08s/it]
 84%|████████▍ | 1867/2222 [33:37<06:23,  1.08s/it]
 84%|████████▍ | 1868/2222 [33:38<06:24,  1.09s/it]
 84%|████████▍ | 1869/2222 [33:39<06:20,  1.08s/it]
 84%|████████▍ | 1870/2222 [33:40<06:22,  1.09s/it]
 84%|████████▍ | 1871/2222 [33:41<06:19,  1.08s/it]
 84%|████████▍ | 1872/2222 [33:43<06:16,  1.08s/it]
 84%|████████▍ | 1873/2222 [33:44<06:16,  1.08s/it]
 84%|████████▍ | 1874/2222 [33:45<06:13,  1.07s/it]
 84%|████████▍ | 1875/2222 [33:46<06:14,  1.08s/it]
 84%|████████▍ | 1876/2222 [33:47<06:13,  1.08s/it]
 84%|████████▍ | 1877/2222 [33:48<06:10,  1.07s/it]
 85%|████████▍ | 1878/2222 [33:49<06:10,  1.08s/it]
 85%|████████▍ | 1879/2222 [33:50<06:09,  1.08s/it]
 85%|████████▍ | 1880/2222 [33:51<06:05,  1.07s/it]
 85%|████████▍ | 1881/2222 [33:52<06:04,  1.07s/it]
 85%|████████▍ | 1882/2222 [33:53<06:06,  1.08s/it]
 85%|████████▍ | 1883/2222 [33:54<06:04,  1.07s/it]
 85%|████████▍ | 1884/2222 [33:55<06:00,  1.07s/it]
 85%|████████▍ | 1885/2222 [33:56<06:01,  1.07s/it]
 85%|████████▍ | 1886/2222 [33:58<05:57,  1.06s/it]
 85%|████████▍ | 1887/2222 [33:59<05:58,  1.07s/it]
 85%|████████▍ | 1888/2222 [34:00<05:58,  1.07s/it]
 85%|████████▌ | 1889/2222 [34:01<05:55,  1.07s/it]
 85%|████████▌ | 1890/2222 [34:02<05:55,  1.07s/it]
 85%|████████▌ | 1891/2222 [34:03<05:56,  1.08s/it]
 85%|████████▌ | 1892/2222 [34:04<05:52,  1.07s/it]
 85%|████████▌ | 1893/2222 [34:05<05:52,  1.07s/it]
 85%|████████▌ | 1894/2222 [34:06<05:51,  1.07s/it]
 85%|████████▌ | 1895/2222 [34:07<05:50,  1.07s/it]
 85%|████████▌ | 1896/2222 [34:08<05:49,  1.07s/it]
 85%|████████▌ | 1897/2222 [34:09<05:48,  1.07s/it]
 85%|████████▌ | 1898/2222 [34:10<05:42,  1.06s/it]
 85%|████████▌ | 1899/2222 [34:11<05:42,  1.06s/it]
 86%|████████▌ | 1900/2222 [34:12<05:43,  1.07s/it]
 86%|████████▌ | 1901/2222 [34:14<05:40,  1.06s/it]
 86%|████████▌ | 1902/2222 [34:15<05:39,  1.06s/it]
 86%|████████▌ | 1903/2222 [34:16<05:42,  1.07s/it]
 86%|████████▌ | 1904/2222 [34:17<05:40,  1.07s/it]
 86%|████████▌ | 1905/2222 [34:18<05:37,  1.07s/it]
 86%|████████▌ | 1906/2222 [34:19<05:37,  1.07s/it]
 86%|████████▌ | 1907/2222 [34:20<05:38,  1.08s/it]
 86%|████████▌ | 1908/2222 [34:21<05:37,  1.07s/it]
 86%|████████▌ | 1909/2222 [34:22<05:34,  1.07s/it]
 86%|████████▌ | 1910/2222 [34:23<05:36,  1.08s/it]
 86%|████████▌ | 1911/2222 [34:24<05:36,  1.08s/it]
 86%|████████▌ | 1912/2222 [34:25<05:33,  1.08s/it]
 86%|████████▌ | 1913/2222 [34:26<05:32,  1.08s/it]
 86%|████████▌ | 1914/2222 [34:28<05:32,  1.08s/it]
 86%|████████▌ | 1915/2222 [34:29<05:29,  1.07s/it]
 86%|████████▌ | 1916/2222 [34:30<05:27,  1.07s/it]
 86%|████████▋ | 1917/2222 [34:31<05:29,  1.08s/it]
 86%|████████▋ | 1918/2222 [34:32<05:29,  1.09s/it]
 86%|████████▋ | 1919/2222 [34:33<05:31,  1.10s/it]
 86%|████████▋ | 1920/2222 [34:34<05:28,  1.09s/it]
 86%|████████▋ | 1921/2222 [34:35<05:25,  1.08s/it]
 86%|████████▋ | 1922/2222 [34:36<05:23,  1.08s/it]
 87%|████████▋ | 1923/2222 [34:37<05:21,  1.08s/it]
 87%|████████▋ | 1924/2222 [34:38<05:18,  1.07s/it]
 87%|████████▋ | 1925/2222 [34:39<05:17,  1.07s/it]
 87%|████████▋ | 1926/2222 [34:40<05:18,  1.07s/it]
 87%|████████▋ | 1927/2222 [34:42<05:16,  1.07s/it]
 87%|████████▋ | 1928/2222 [34:43<05:14,  1.07s/it]
 87%|████████▋ | 1929/2222 [34:44<05:13,  1.07s/it]
 87%|████████▋ | 1930/2222 [34:45<05:13,  1.07s/it]
 87%|████████▋ | 1931/2222 [34:46<05:16,  1.09s/it]
 87%|████████▋ | 1932/2222 [34:47<05:10,  1.07s/it]
 87%|████████▋ | 1933/2222 [34:48<05:09,  1.07s/it]
 87%|████████▋ | 1934/2222 [34:49<05:09,  1.07s/it]
 87%|████████▋ | 1935/2222 [34:50<05:08,  1.07s/it]
 87%|████████▋ | 1936/2222 [34:51<05:04,  1.07s/it]
 87%|████████▋ | 1937/2222 [34:52<05:02,  1.06s/it]
 87%|████████▋ | 1938/2222 [34:53<05:01,  1.06s/it]
 87%|████████▋ | 1939/2222 [34:54<05:03,  1.07s/it]
 87%|████████▋ | 1940/2222 [34:55<05:02,  1.07s/it]
 87%|████████▋ | 1941/2222 [34:57<05:00,  1.07s/it]
 87%|████████▋ | 1942/2222 [34:58<05:00,  1.07s/it]
 87%|████████▋ | 1943/2222 [34:59<04:59,  1.07s/it]
 87%|████████▋ | 1944/2222 [35:00<04:58,  1.07s/it]
 88%|████████▊ | 1945/2222 [35:01<04:57,  1.08s/it]
 88%|████████▊ | 1946/2222 [35:02<04:57,  1.08s/it]
 88%|████████▊ | 1947/2222 [35:03<04:56,  1.08s/it]
 88%|████████▊ | 1948/2222 [35:04<04:56,  1.08s/it]
 88%|████████▊ | 1949/2222 [35:05<04:53,  1.07s/it]
 88%|████████▊ | 1950/2222 [35:06<04:53,  1.08s/it]
 88%|████████▊ | 1951/2222 [35:07<04:56,  1.09s/it]
 88%|████████▊ | 1952/2222 [35:08<04:52,  1.08s/it]
 88%|████████▊ | 1953/2222 [35:10<04:51,  1.09s/it]
 88%|████████▊ | 1954/2222 [35:11<04:50,  1.09s/it]
 88%|████████▊ | 1955/2222 [35:12<04:51,  1.09s/it]
 88%|████████▊ | 1956/2222 [35:13<04:48,  1.08s/it]
 88%|████████▊ | 1957/2222 [35:14<04:46,  1.08s/it]
 88%|████████▊ | 1958/2222 [35:15<04:46,  1.08s/it]
 88%|████████▊ | 1959/2222 [35:16<04:44,  1.08s/it]
 88%|████████▊ | 1960/2222 [35:17<04:43,  1.08s/it]
 88%|████████▊ | 1961/2222 [35:18<04:42,  1.08s/it]
 88%|████████▊ | 1962/2222 [35:19<04:40,  1.08s/it]
 88%|████████▊ | 1963/2222 [35:20<04:38,  1.07s/it]
 88%|████████▊ | 1964/2222 [35:21<04:36,  1.07s/it]
 88%|████████▊ | 1965/2222 [35:22<04:36,  1.08s/it]
 88%|████████▊ | 1966/2222 [35:24<04:34,  1.07s/it]
 89%|████████▊ | 1967/2222 [35:25<04:34,  1.07s/it]
 89%|████████▊ | 1968/2222 [35:26<04:35,  1.08s/it]
 89%|████████▊ | 1969/2222 [35:27<04:31,  1.07s/it]
 89%|████████▊ | 1970/2222 [35:28<04:32,  1.08s/it]
 89%|████████▊ | 1971/2222 [35:29<04:31,  1.08s/it]
 89%|████████▊ | 1972/2222 [35:30<04:30,  1.08s/it]
 89%|████████▉ | 1973/2222 [35:31<04:30,  1.09s/it]
 89%|████████▉ | 1974/2222 [35:32<04:23,  1.06s/it]
 89%|████████▉ | 1975/2222 [35:33<04:24,  1.07s/it]
 89%|████████▉ | 1976/2222 [35:34<04:24,  1.07s/it]
 89%|████████▉ | 1977/2222 [35:35<04:22,  1.07s/it]
 89%|████████▉ | 1978/2222 [35:36<04:19,  1.06s/it]
 89%|████████▉ | 1979/2222 [35:38<04:21,  1.07s/it]
 89%|████████▉ | 1980/2222 [35:39<04:19,  1.07s/it]
 89%|████████▉ | 1981/2222 [35:40<04:20,  1.08s/it]
 89%|████████▉ | 1982/2222 [35:41<04:19,  1.08s/it]
 89%|████████▉ | 1983/2222 [35:42<04:18,  1.08s/it]
 89%|████████▉ | 1984/2222 [35:43<04:17,  1.08s/it]
 89%|████████▉ | 1985/2222 [35:44<04:17,  1.09s/it]
 89%|████████▉ | 1986/2222 [35:45<04:16,  1.09s/it]
 89%|████████▉ | 1987/2222 [35:46<04:16,  1.09s/it]
 89%|████████▉ | 1988/2222 [35:47<04:13,  1.08s/it]
 90%|████████▉ | 1989/2222 [35:48<04:11,  1.08s/it]
 90%|████████▉ | 1990/2222 [35:49<04:11,  1.08s/it]
 90%|████████▉ | 1991/2222 [35:51<04:11,  1.09s/it]
 90%|████████▉ | 1992/2222 [35:52<04:09,  1.09s/it]
 90%|████████▉ | 1993/2222 [35:53<04:08,  1.09s/it]
 90%|████████▉ | 1994/2222 [35:54<04:07,  1.08s/it]
 90%|████████▉ | 1995/2222 [35:55<04:05,  1.08s/it]
 90%|████████▉ | 1996/2222 [35:56<04:01,  1.07s/it]
 90%|████████▉ | 1997/2222 [35:57<03:59,  1.06s/it]
 90%|████████▉ | 1998/2222 [35:58<04:03,  1.09s/it]
 90%|████████▉ | 1999/2222 [35:59<04:00,  1.08s/it]
 90%|█████████ | 2000/2222 [36:00<03:58,  1.08s/it]
                                                   
{'loss': 1.9092, 'learning_rate': 4.995499549954996e-06, 'epoch': 1.8}

 90%|█████████ | 2000/2222 [36:00<03:58,  1.08s/it]
 90%|█████████ | 2001/2222 [36:01<03:56,  1.07s/it]
 90%|█████████ | 2002/2222 [36:02<03:52,  1.06s/it]
 90%|█████████ | 2003/2222 [36:03<03:52,  1.06s/it]
 90%|█████████ | 2004/2222 [36:04<03:52,  1.06s/it]
 90%|█████████ | 2005/2222 [36:06<03:53,  1.07s/it]
 90%|█████████ | 2006/2222 [36:07<03:53,  1.08s/it]
 90%|█████████ | 2007/2222 [36:08<03:52,  1.08s/it]
 90%|█████████ | 2008/2222 [36:09<03:50,  1.08s/it]
 90%|█████████ | 2009/2222 [36:10<03:47,  1.07s/it]
 90%|█████████ | 2010/2222 [36:11<03:47,  1.08s/it]
 91%|█████████ | 2011/2222 [36:12<03:46,  1.07s/it]
 91%|█████████ | 2012/2222 [36:13<03:43,  1.07s/it]
 91%|█████████ | 2013/2222 [36:14<03:43,  1.07s/it]
 91%|█████████ | 2014/2222 [36:15<03:41,  1.07s/it]
 91%|█████████ | 2015/2222 [36:16<03:42,  1.07s/it]
 91%|█████████ | 2016/2222 [36:17<03:41,  1.08s/it]
 91%|█████████ | 2017/2222 [36:18<03:39,  1.07s/it]
 91%|█████████ | 2018/2222 [36:19<03:37,  1.07s/it]
 91%|█████████ | 2019/2222 [36:21<03:37,  1.07s/it]
 91%|█████████ | 2020/2222 [36:22<03:36,  1.07s/it]
 91%|█████████ | 2021/2222 [36:23<03:36,  1.07s/it]
 91%|█████████ | 2022/2222 [36:24<03:35,  1.08s/it]
 91%|█████████ | 2023/2222 [36:25<03:33,  1.07s/it]
 91%|█████████ | 2024/2222 [36:26<03:31,  1.07s/it]
 91%|█████████ | 2025/2222 [36:27<03:32,  1.08s/it]
 91%|█████████ | 2026/2222 [36:28<03:29,  1.07s/it]
 91%|█████████ | 2027/2222 [36:29<03:30,  1.08s/it]
 91%|█████████▏| 2028/2222 [36:30<03:30,  1.08s/it]
 91%|█████████▏| 2029/2222 [36:31<03:27,  1.08s/it]
 91%|█████████▏| 2030/2222 [36:32<03:27,  1.08s/it]
 91%|█████████▏| 2031/2222 [36:33<03:24,  1.07s/it]
 91%|█████████▏| 2032/2222 [36:35<03:24,  1.08s/it]
 91%|█████████▏| 2033/2222 [36:36<03:22,  1.07s/it]
 92%|█████████▏| 2034/2222 [36:37<03:23,  1.08s/it]
 92%|█████████▏| 2035/2222 [36:38<03:21,  1.08s/it]
 92%|█████████▏| 2036/2222 [36:39<03:18,  1.07s/it]
 92%|█████████▏| 2037/2222 [36:40<03:18,  1.07s/it]
 92%|█████████▏| 2038/2222 [36:41<03:18,  1.08s/it]
 92%|█████████▏| 2039/2222 [36:42<03:17,  1.08s/it]
 92%|█████████▏| 2040/2222 [36:43<03:17,  1.08s/it]
 92%|█████████▏| 2041/2222 [36:44<03:14,  1.07s/it]
 92%|█████████▏| 2042/2222 [36:45<03:12,  1.07s/it]
 92%|█████████▏| 2043/2222 [36:46<03:12,  1.08s/it]
 92%|█████████▏| 2044/2222 [36:47<03:11,  1.08s/it]
 92%|█████████▏| 2045/2222 [36:49<03:10,  1.08s/it]
 92%|█████████▏| 2046/2222 [36:50<03:08,  1.07s/it]
 92%|█████████▏| 2047/2222 [36:51<03:07,  1.07s/it]
 92%|█████████▏| 2048/2222 [36:52<03:05,  1.06s/it]
 92%|█████████▏| 2049/2222 [36:53<03:06,  1.08s/it]
 92%|█████████▏| 2050/2222 [36:54<03:05,  1.08s/it]
 92%|█████████▏| 2051/2222 [36:55<03:04,  1.08s/it]
 92%|█████████▏| 2052/2222 [36:56<03:04,  1.09s/it]
 92%|█████████▏| 2053/2222 [36:57<03:03,  1.09s/it]
 92%|█████████▏| 2054/2222 [36:58<03:01,  1.08s/it]
 92%|█████████▏| 2055/2222 [36:59<03:00,  1.08s/it]
 93%|█████████▎| 2056/2222 [37:00<02:59,  1.08s/it]
 93%|█████████▎| 2057/2222 [37:01<02:59,  1.09s/it]
 93%|█████████▎| 2058/2222 [37:03<02:58,  1.09s/it]
 93%|█████████▎| 2059/2222 [37:04<02:56,  1.08s/it]
 93%|█████████▎| 2060/2222 [37:05<02:53,  1.07s/it]
 93%|█████████▎| 2061/2222 [37:06<02:53,  1.08s/it]
 93%|█████████▎| 2062/2222 [37:07<02:53,  1.08s/it]
 93%|█████████▎| 2063/2222 [37:08<02:51,  1.08s/it]
 93%|█████████▎| 2064/2222 [37:09<02:50,  1.08s/it]
 93%|█████████▎| 2065/2222 [37:10<02:48,  1.08s/it]
 93%|█████████▎| 2066/2222 [37:11<02:48,  1.08s/it]
 93%|█████████▎| 2067/2222 [37:12<02:46,  1.08s/it]
 93%|█████████▎| 2068/2222 [37:13<02:46,  1.08s/it]
 93%|█████████▎| 2069/2222 [37:14<02:45,  1.08s/it]
 93%|█████████▎| 2070/2222 [37:16<02:44,  1.08s/it]
 93%|█████████▎| 2071/2222 [37:17<02:42,  1.08s/it]
 93%|█████████▎| 2072/2222 [37:18<02:40,  1.07s/it]
 93%|█████████▎| 2073/2222 [37:19<02:39,  1.07s/it]
 93%|█████████▎| 2074/2222 [37:20<02:40,  1.09s/it]
 93%|█████████▎| 2075/2222 [37:21<02:39,  1.08s/it]
 93%|█████████▎| 2076/2222 [37:22<02:37,  1.08s/it]
 93%|█████████▎| 2077/2222 [37:23<02:36,  1.08s/it]
 94%|█████████▎| 2078/2222 [37:24<02:35,  1.08s/it]
 94%|█████████▎| 2079/2222 [37:26<02:45,  1.16s/it]
 94%|█████████▎| 2080/2222 [37:27<02:41,  1.14s/it]
 94%|█████████▎| 2081/2222 [37:28<02:36,  1.11s/it]
 94%|█████████▎| 2082/2222 [37:29<02:34,  1.10s/it]
 94%|█████████▎| 2083/2222 [37:30<02:33,  1.11s/it]
 94%|█████████▍| 2084/2222 [37:31<02:32,  1.10s/it]
 94%|█████████▍| 2085/2222 [37:32<02:29,  1.09s/it]
 94%|█████████▍| 2086/2222 [37:33<02:30,  1.10s/it]
 94%|█████████▍| 2087/2222 [37:34<02:27,  1.10s/it]
 94%|█████████▍| 2088/2222 [37:35<02:25,  1.09s/it]
 94%|█████████▍| 2089/2222 [37:36<02:22,  1.07s/it]
 94%|█████████▍| 2090/2222 [37:37<02:23,  1.09s/it]
 94%|█████████▍| 2091/2222 [37:39<02:22,  1.09s/it]
 94%|█████████▍| 2092/2222 [37:40<02:21,  1.09s/it]
 94%|█████████▍| 2093/2222 [37:41<02:19,  1.08s/it]
 94%|█████████▍| 2094/2222 [37:42<02:18,  1.08s/it]
 94%|█████████▍| 2095/2222 [37:43<02:16,  1.08s/it]
 94%|█████████▍| 2096/2222 [37:44<02:15,  1.08s/it]
 94%|█████████▍| 2097/2222 [37:45<02:13,  1.07s/it]
 94%|█████████▍| 2098/2222 [37:46<02:12,  1.07s/it]
 94%|█████████▍| 2099/2222 [37:47<02:10,  1.06s/it]
 95%|█████████▍| 2100/2222 [37:48<02:10,  1.07s/it]
 95%|█████████▍| 2101/2222 [37:49<02:07,  1.06s/it]
 95%|█████████▍| 2102/2222 [37:50<02:07,  1.07s/it]
 95%|█████████▍| 2103/2222 [37:51<02:07,  1.07s/it]
 95%|█████████▍| 2104/2222 [37:52<02:06,  1.07s/it]
 95%|█████████▍| 2105/2222 [37:54<02:06,  1.08s/it]
 95%|█████████▍| 2106/2222 [37:55<02:05,  1.08s/it]
 95%|█████████▍| 2107/2222 [37:56<02:03,  1.08s/it]
 95%|█████████▍| 2108/2222 [37:57<02:03,  1.08s/it]
 95%|█████████▍| 2109/2222 [37:58<02:02,  1.09s/it]
 95%|█████████▍| 2110/2222 [37:59<02:02,  1.09s/it]
 95%|█████████▌| 2111/2222 [38:00<02:00,  1.08s/it]
 95%|█████████▌| 2112/2222 [38:01<01:58,  1.08s/it]
 95%|█████████▌| 2113/2222 [38:02<01:57,  1.08s/it]
 95%|█████████▌| 2114/2222 [38:03<01:57,  1.09s/it]
 95%|█████████▌| 2115/2222 [38:04<01:55,  1.08s/it]
 95%|█████████▌| 2116/2222 [38:05<01:54,  1.08s/it]
 95%|█████████▌| 2117/2222 [38:07<01:53,  1.08s/it]
 95%|█████████▌| 2118/2222 [38:08<01:52,  1.08s/it]
 95%|█████████▌| 2119/2222 [38:09<01:51,  1.08s/it]
 95%|█████████▌| 2120/2222 [38:10<01:49,  1.08s/it]
 95%|█████████▌| 2121/2222 [38:11<01:47,  1.07s/it]
 95%|█████████▌| 2122/2222 [38:12<01:47,  1.07s/it]
 96%|█████████▌| 2123/2222 [38:13<01:47,  1.09s/it]
 96%|█████████▌| 2124/2222 [38:14<01:45,  1.08s/it]
 96%|█████████▌| 2125/2222 [38:15<01:44,  1.07s/it]
 96%|█████████▌| 2126/2222 [38:16<01:43,  1.08s/it]
 96%|█████████▌| 2127/2222 [38:17<01:42,  1.08s/it]
 96%|█████████▌| 2128/2222 [38:18<01:41,  1.08s/it]
 96%|█████████▌| 2129/2222 [38:19<01:39,  1.07s/it]
 96%|█████████▌| 2130/2222 [38:21<01:39,  1.08s/it]
 96%|█████████▌| 2131/2222 [38:22<01:38,  1.08s/it]
 96%|█████████▌| 2132/2222 [38:23<01:38,  1.09s/it]
 96%|█████████▌| 2133/2222 [38:24<01:35,  1.07s/it]
 96%|█████████▌| 2134/2222 [38:25<01:34,  1.07s/it]
 96%|█████████▌| 2135/2222 [38:26<01:33,  1.07s/it]
 96%|█████████▌| 2136/2222 [38:27<01:32,  1.08s/it]
 96%|█████████▌| 2137/2222 [38:28<01:31,  1.07s/it]
 96%|█████████▌| 2138/2222 [38:29<01:31,  1.09s/it]
 96%|█████████▋| 2139/2222 [38:30<01:28,  1.07s/it]
 96%|█████████▋| 2140/2222 [38:31<01:27,  1.07s/it]
 96%|█████████▋| 2141/2222 [38:32<01:26,  1.07s/it]
 96%|█████████▋| 2142/2222 [38:33<01:25,  1.07s/it]
 96%|█████████▋| 2143/2222 [38:34<01:24,  1.07s/it]
 96%|█████████▋| 2144/2222 [38:36<01:23,  1.07s/it]
 97%|█████████▋| 2145/2222 [38:37<01:22,  1.07s/it]
 97%|█████████▋| 2146/2222 [38:38<01:22,  1.08s/it]
 97%|█████████▋| 2147/2222 [38:39<01:21,  1.08s/it]
 97%|█████████▋| 2148/2222 [38:40<01:19,  1.08s/it]
 97%|█████████▋| 2149/2222 [38:41<01:18,  1.08s/it]
 97%|█████████▋| 2150/2222 [38:42<01:16,  1.07s/it]
 97%|█████████▋| 2151/2222 [38:43<01:16,  1.08s/it]
 97%|█████████▋| 2152/2222 [38:44<01:14,  1.06s/it]
 97%|█████████▋| 2153/2222 [38:45<01:13,  1.07s/it]
 97%|█████████▋| 2154/2222 [38:46<01:12,  1.07s/it]
 97%|█████████▋| 2155/2222 [38:47<01:11,  1.06s/it]
 97%|█████████▋| 2156/2222 [38:48<01:10,  1.07s/it]
 97%|█████████▋| 2157/2222 [38:49<01:09,  1.07s/it]
 97%|█████████▋| 2158/2222 [38:51<01:09,  1.08s/it]
 97%|█████████▋| 2159/2222 [38:52<01:07,  1.07s/it]
 97%|█████████▋| 2160/2222 [38:53<01:06,  1.07s/it]
 97%|█████████▋| 2161/2222 [38:54<01:05,  1.07s/it]
 97%|█████████▋| 2162/2222 [38:55<01:03,  1.06s/it]
 97%|█████████▋| 2163/2222 [38:56<01:02,  1.06s/it]
 97%|█████████▋| 2164/2222 [38:57<01:01,  1.07s/it]
 97%|█████████▋| 2165/2222 [38:58<01:00,  1.07s/it]
 97%|█████████▋| 2166/2222 [38:59<01:00,  1.08s/it]
 98%|█████████▊| 2167/2222 [39:00<00:59,  1.08s/it]
 98%|█████████▊| 2168/2222 [39:01<00:58,  1.09s/it]
 98%|█████████▊| 2169/2222 [39:02<00:57,  1.08s/it]
 98%|█████████▊| 2170/2222 [39:03<00:55,  1.07s/it]
 98%|█████████▊| 2171/2222 [39:05<00:55,  1.09s/it]
 98%|█████████▊| 2172/2222 [39:06<00:54,  1.09s/it]
 98%|█████████▊| 2173/2222 [39:07<00:52,  1.08s/it]
 98%|█████████▊| 2174/2222 [39:08<00:51,  1.08s/it]
 98%|█████████▊| 2175/2222 [39:09<00:50,  1.08s/it]
 98%|█████████▊| 2176/2222 [39:10<00:49,  1.08s/it]
 98%|█████████▊| 2177/2222 [39:11<00:48,  1.08s/it]
 98%|█████████▊| 2178/2222 [39:12<00:47,  1.08s/it]
 98%|█████████▊| 2179/2222 [39:13<00:46,  1.08s/it]
 98%|█████████▊| 2180/2222 [39:14<00:45,  1.08s/it]
 98%|█████████▊| 2181/2222 [39:15<00:44,  1.08s/it]
 98%|█████████▊| 2182/2222 [39:16<00:42,  1.07s/it]
 98%|█████████▊| 2183/2222 [39:18<00:42,  1.08s/it]
 98%|█████████▊| 2184/2222 [39:19<00:40,  1.07s/it]
 98%|█████████▊| 2185/2222 [39:20<00:39,  1.08s/it]
 98%|█████████▊| 2186/2222 [39:21<00:38,  1.08s/it]
 98%|█████████▊| 2187/2222 [39:22<00:37,  1.07s/it]
 98%|█████████▊| 2188/2222 [39:23<00:36,  1.08s/it]
 99%|█████████▊| 2189/2222 [39:24<00:35,  1.08s/it]
 99%|█████████▊| 2190/2222 [39:25<00:34,  1.08s/it]
 99%|█████████▊| 2191/2222 [39:26<00:33,  1.07s/it]
 99%|█████████▊| 2192/2222 [39:27<00:32,  1.09s/it]
 99%|█████████▊| 2193/2222 [39:28<00:31,  1.08s/it]
 99%|█████████▊| 2194/2222 [39:29<00:30,  1.08s/it]
 99%|█████████▉| 2195/2222 [39:30<00:29,  1.08s/it]
 99%|█████████▉| 2196/2222 [39:32<00:28,  1.08s/it]
 99%|█████████▉| 2197/2222 [39:33<00:26,  1.07s/it]
 99%|█████████▉| 2198/2222 [39:34<00:25,  1.08s/it]
 99%|█████████▉| 2199/2222 [39:35<00:24,  1.08s/it]
 99%|█████████▉| 2200/2222 [39:36<00:23,  1.08s/it]
 99%|█████████▉| 2201/2222 [39:37<00:22,  1.07s/it]
 99%|█████████▉| 2202/2222 [39:38<00:21,  1.07s/it]
 99%|█████████▉| 2203/2222 [39:39<00:20,  1.07s/it]
 99%|█████████▉| 2204/2222 [39:40<00:19,  1.07s/it]
 99%|█████████▉| 2205/2222 [39:41<00:18,  1.07s/it]
 99%|█████████▉| 2206/2222 [39:42<00:17,  1.07s/it]
 99%|█████████▉| 2207/2222 [39:43<00:16,  1.07s/it]
 99%|█████████▉| 2208/2222 [39:44<00:14,  1.07s/it]
 99%|█████████▉| 2209/2222 [39:45<00:13,  1.05s/it]
 99%|█████████▉| 2210/2222 [39:46<00:12,  1.06s/it]
100%|█████████▉| 2211/2222 [39:48<00:11,  1.06s/it]
100%|█████████▉| 2212/2222 [39:49<00:10,  1.07s/it]
100%|█████████▉| 2213/2222 [39:50<00:09,  1.08s/it]
100%|█████████▉| 2214/2222 [39:51<00:08,  1.09s/it]
100%|█████████▉| 2215/2222 [39:52<00:07,  1.08s/it]
100%|█████████▉| 2216/2222 [39:53<00:06,  1.07s/it]
100%|█████████▉| 2217/2222 [39:54<00:05,  1.06s/it]
100%|█████████▉| 2218/2222 [39:55<00:04,  1.06s/it]
100%|█████████▉| 2219/2222 [39:56<00:03,  1.07s/it]
100%|█████████▉| 2220/2222 [39:57<00:02,  1.07s/it]
100%|█████████▉| 2221/2222 [39:58<00:01,  1.08s/it]
100%|██████████| 2222/2222 [39:59<00:00,  1.01s/it]08/27/2022 00:43:20 - INFO - trainer -   

Training completed. Do not forget to share your model on huggingface.co/models =)


Traceback (most recent call last):
  File "train.py", line 629, in <module>
Traceback (most recent call last):
  File "train.py", line 629, in <module>
Traceback (most recent call last):
  File "train.py", line 629, in <module>

                                                   
{'train_runtime': 2399.7982, 'train_samples_per_second': 0.926, 'epoch': 2.0}

100%|██████████| 2222/2222 [39:59<00:00,  1.01s/it]
100%|██████████| 2222/2222 [39:59<00:00,  1.08s/it]
    main()
  File "train.py", line 611, in main
[INFO|trainer.py:1344] 2022-08-27 00:43:20,039 >> Saving model checkpoint to out/mabel-joint-cl-al1-mlm-bs-32-lr-5e-5-msl-128-ep-2
    main()
  File "train.py", line 611, in main
[INFO|configuration_utils.py:300] 2022-08-27 00:43:20,042 >> Configuration saved in out/mabel-joint-cl-al1-mlm-bs-32-lr-5e-5-msl-128-ep-2/config.json
    results = trainer.evaluate(eval_senteval_transfer=True)
TypeError: evaluate() got an unexpected keyword argument 'eval_senteval_transfer'
    main()
  File "train.py", line 611, in main
    results = trainer.evaluate(eval_senteval_transfer=True)
TypeError: evaluate() got an unexpected keyword argument 'eval_senteval_transfer'
    results = trainer.evaluate(eval_senteval_transfer=True)
TypeError: evaluate() got an unexpected keyword argument 'eval_senteval_transfer'
[INFO|modeling_utils.py:817] 2022-08-27 00:43:21,328 >> Model weights saved in out/mabel-joint-cl-al1-mlm-bs-32-lr-5e-5-msl-128-ep-2/pytorch_model.bin
08/27/2022 00:43:21 - INFO - __main__ -   ***** Train results *****
08/27/2022 00:43:21 - INFO - __main__ -     epoch = 2.0
08/27/2022 00:43:21 - INFO - __main__ -     train_runtime = 2399.7982
08/27/2022 00:43:21 - INFO - __main__ -     train_samples_per_second = 0.926
08/27/2022 00:43:21 - INFO - __main__ -   *** Evaluate ***
Traceback (most recent call last):
  File "train.py", line 629, in <module>
    main()
  File "train.py", line 611, in main
    results = trainer.evaluate(eval_senteval_transfer=True)
TypeError: evaluate() got an unexpected keyword argument 'eval_senteval_transfer'
/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/distributed/launch.py:186: FutureWarning: The module torch.distributed.launch is deprecated
and will be removed in future. Use torchrun.
Note that --use_env is set by default in torchrun.
If your script expects `--local_rank` argument to be set, please
change it to read from `os.environ['LOCAL_RANK']` instead. See 
https://pytorch.org/docs/stable/distributed.html#launch-utility for 
further instructions

  FutureWarning,
WARNING:torch.distributed.elastic.multiprocessing.api:Sending process 24668 closing signal SIGTERM
ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 1 (pid: 24669) of binary: /project/jonmay_231/jacqueline/miniconda3/envs/env/bin/python
Traceback (most recent call last):
  File "/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/distributed/launch.py", line 193, in <module>
    main()
  File "/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/distributed/launch.py", line 189, in main
    launch(args)
  File "/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/distributed/launch.py", line 174, in launch
    run(args)
  File "/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/distributed/run.py", line 713, in run
    )(*cmd_args)
  File "/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/distributed/launcher/api.py", line 131, in __call__
    return launch_agent(self._config, self._entrypoint, list(args))
  File "/project/jonmay_231/jacqueline/miniconda3/envs/env/lib/python3.7/site-packages/torch/distributed/launcher/api.py", line 261, in launch_agent
    failures=result.failures,
torch.distributed.elastic.multiprocessing.errors.ChildFailedError: 
============================================================
train.py FAILED
------------------------------------------------------------
Failures:
[1]:
  time      : 2022-08-27_00:43:23
  host      : a11-03.hpc.usc.edu
  rank      : 2 (local_rank: 2)
  exitcode  : 1 (pid: 24670)
  error_file: <N/A>
  traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
[2]:
  time      : 2022-08-27_00:43:23
  host      : a11-03.hpc.usc.edu
  rank      : 3 (local_rank: 3)
  exitcode  : 1 (pid: 24671)
  error_file: <N/A>
  traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
------------------------------------------------------------
Root Cause (first observed failure):
[0]:
  time      : 2022-08-27_00:43:23
  host      : a11-03.hpc.usc.edu
  rank      : 1 (local_rank: 1)
  exitcode  : 1 (pid: 24669)
  error_file: <N/A>
  traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
============================================================