The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by calling `transformers.utils.move_cache()`.

0it [00:00, ?it/s]
0it [00:00, ?it/s]
/opt/conda/lib/python3.10/site-packages/transformers/deepspeed.py:23: FutureWarning: transformers.deepspeed module is deprecated and will be removed in a future version. Please import deepspeed modules directly from transformers.integrations
  warnings.warn(
2024-07-20 09:26:20.762058: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:9261] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2024-07-20 09:26:20.762163: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:607] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2024-07-20 09:26:20.880295: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1515] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.

Generating train split: 0 examples [00:00, ? examples/s]
Generating train split: 1 examples [00:00,  4.22 examples/s]
Generating train split: 1324 examples [00:00, 4978.10 examples/s]
Generating train split: 3140 examples [00:00, 9582.48 examples/s]
Generating train split: 4972 examples [00:00, 12490.02 examples/s]
Generating train split: 6657 examples [00:00, 13893.41 examples/s]
Generating train split: 8380 examples [00:00, 14943.05 examples/s]
Generating train split: 10220 examples [00:00, 16012.81 examples/s]
Generating train split: 12016 examples [00:00, 16608.63 examples/s]
Generating train split: 13979 examples [00:01, 17325.20 examples/s]
Generating train split: 15798 examples [00:01, 17584.12 examples/s]
Generating train split: 17640 examples [00:01, 17831.88 examples/s]
Generating train split: 19475 examples [00:01, 17984.48 examples/s]
Generating train split: 21337 examples [00:01, 18172.46 examples/s]
Generating train split: 23184 examples [00:01, 18258.79 examples/s]
Generating train split: 25973 examples [00:01, 18362.27 examples/s]
Generating train split: 28694 examples [00:01, 18279.12 examples/s]
Generating train split: 31429 examples [00:01, 18261.90 examples/s]
Generating train split: 34127 examples [00:02, 18169.80 examples/s]
Generating train split: 36000 examples [00:02, 18142.12 examples/s]
Generating train split: 37873 examples [00:02, 18287.42 examples/s]
Generating train split: 40568 examples [00:02, 18173.52 examples/s]
Generating train split: 43258 examples [00:02, 18091.24 examples/s]
Generating train split: 46000 examples [00:02, 18023.71 examples/s]
Generating train split: 47882 examples [00:02, 18207.99 examples/s]
Generating train split: 50532 examples [00:03, 18023.31 examples/s]
Generating train split: 53111 examples [00:03, 17753.51 examples/s]
Generating train split: 54978 examples [00:03, 17953.97 examples/s]
Generating train split: 57593 examples [00:03, 17776.00 examples/s]
Generating train split: 60251 examples [00:03, 17753.64 examples/s]
Generating train split: 62033 examples [00:03, 17766.17 examples/s]
Generating train split: 64000 examples [00:03, 17939.48 examples/s]
Generating train split: 65913 examples [00:03, 18248.18 examples/s]
Generating train split: 68281 examples [00:04, 17360.52 examples/s]
Generating train split: 70706 examples [00:04, 16953.39 examples/s]
Generating train split: 72506 examples [00:04, 17204.80 examples/s]
Generating train split: 74290 examples [00:04, 17365.97 examples/s]
Generating train split: 76075 examples [00:04, 17495.32 examples/s]
Generating train split: 78681 examples [00:04, 17446.57 examples/s]
Generating train split: 81277 examples [00:04, 17397.45 examples/s]
Generating train split: 83044 examples [00:04, 17462.28 examples/s]
Generating train split: 84989 examples [00:05, 17815.21 examples/s]
Generating train split: 87646 examples [00:05, 17778.33 examples/s]
Generating train split: 90307 examples [00:05, 17762.51 examples/s]
Generating train split: 92867 examples [00:05, 17422.20 examples/s]
Generating train split: 92867 examples [00:05, 16981.50 examples/s]

Running tokenizer on train dataset:   0%|          | 0/92867 [00:00<?, ? examples/s]/opt/conda/lib/python3.10/site-packages/transformers/tokenization_utils_base.py:3946: UserWarning: `as_target_tokenizer` is deprecated and will be removed in v5 of Transformers. You can tokenize your labels by using the argument `text_target` of the regular `__call__` method (either in the same call as your input texts if you use the same keyword arguments, or in a separate call.
  warnings.warn(

Running tokenizer on train dataset:   1%|          | 1000/92867 [00:01<02:39, 576.90 examples/s]
Running tokenizer on train dataset:   2%|▏         | 2000/92867 [00:02<01:55, 784.81 examples/s]
Running tokenizer on train dataset:   3%|▎         | 3000/92867 [00:04<02:06, 707.87 examples/s]
Running tokenizer on train dataset:   4%|▍         | 4000/92867 [00:06<02:23, 618.06 examples/s]
Running tokenizer on train dataset:   5%|▌         | 5000/92867 [00:08<02:28, 592.71 examples/s]
Running tokenizer on train dataset:   6%|▋         | 6000/92867 [00:09<02:30, 577.64 examples/s]
Running tokenizer on train dataset:   8%|▊         | 7000/92867 [00:11<02:31, 566.72 examples/s]
Running tokenizer on train dataset:   9%|▊         | 8000/92867 [00:13<02:30, 563.23 examples/s]
Running tokenizer on train dataset:  10%|▉         | 9000/92867 [00:15<02:25, 576.60 examples/s]
Running tokenizer on train dataset:  11%|█         | 10000/92867 [00:16<02:08, 643.04 examples/s]
Running tokenizer on train dataset:  12%|█▏        | 11000/92867 [00:17<01:58, 693.32 examples/s]
Running tokenizer on train dataset:  13%|█▎        | 12000/92867 [00:18<01:54, 706.32 examples/s]
Running tokenizer on train dataset:  14%|█▍        | 13000/92867 [00:20<01:50, 721.17 examples/s]
Running tokenizer on train dataset:  15%|█▌        | 14000/92867 [00:21<01:42, 770.00 examples/s]
Running tokenizer on train dataset:  16%|█▌        | 15000/92867 [00:22<01:37, 796.49 examples/s]
Running tokenizer on train dataset:  17%|█▋        | 16000/92867 [00:23<01:33, 821.67 examples/s]
Running tokenizer on train dataset:  18%|█▊        | 17000/92867 [00:24<01:30, 836.09 examples/s]
Running tokenizer on train dataset:  19%|█▉        | 18000/92867 [00:26<01:35, 784.36 examples/s]
Running tokenizer on train dataset:  20%|██        | 19000/92867 [00:27<01:36, 768.48 examples/s]
Running tokenizer on train dataset:  22%|██▏       | 20000/92867 [00:28<01:32, 786.96 examples/s]
Running tokenizer on train dataset:  23%|██▎       | 21000/92867 [00:29<01:28, 811.78 examples/s]
Running tokenizer on train dataset:  24%|██▎       | 22000/92867 [00:30<01:26, 819.54 examples/s]
Running tokenizer on train dataset:  25%|██▍       | 23000/92867 [00:32<01:27, 794.07 examples/s]
Running tokenizer on train dataset:  26%|██▌       | 24000/92867 [00:33<01:28, 779.26 examples/s]
Running tokenizer on train dataset:  27%|██▋       | 25000/92867 [00:34<01:26, 784.13 examples/s]
Running tokenizer on train dataset:  28%|██▊       | 26000/92867 [00:36<01:25, 779.41 examples/s]
Running tokenizer on train dataset:  29%|██▉       | 27000/92867 [00:37<01:25, 773.25 examples/s]
Running tokenizer on train dataset:  30%|███       | 28000/92867 [00:39<01:27, 738.68 examples/s]
Running tokenizer on train dataset:  31%|███       | 29000/92867 [00:40<01:28, 722.95 examples/s]
Running tokenizer on train dataset:  32%|███▏      | 30000/92867 [00:41<01:27, 715.74 examples/s]
Running tokenizer on train dataset:  33%|███▎      | 31000/92867 [00:43<01:28, 698.76 examples/s]
Running tokenizer on train dataset:  34%|███▍      | 32000/92867 [00:45<01:31, 666.37 examples/s]
Running tokenizer on train dataset:  36%|███▌      | 33000/92867 [00:46<01:30, 661.29 examples/s]
Running tokenizer on train dataset:  37%|███▋      | 34000/92867 [00:48<01:31, 645.13 examples/s]
Running tokenizer on train dataset:  38%|███▊      | 35000/92867 [00:49<01:29, 643.22 examples/s]
Running tokenizer on train dataset:  39%|███▉      | 36000/92867 [00:51<01:29, 636.20 examples/s]
Running tokenizer on train dataset:  40%|███▉      | 37000/92867 [00:52<01:25, 650.71 examples/s]
Running tokenizer on train dataset:  41%|████      | 38000/92867 [00:54<01:22, 662.08 examples/s]
Running tokenizer on train dataset:  42%|████▏     | 39000/92867 [00:55<01:21, 661.91 examples/s]
Running tokenizer on train dataset:  43%|████▎     | 40000/92867 [00:57<01:23, 633.06 examples/s]
Running tokenizer on train dataset:  44%|████▍     | 41000/92867 [01:00<01:34, 546.88 examples/s]
Running tokenizer on train dataset:  45%|████▌     | 42000/92867 [01:01<01:31, 554.99 examples/s]
Running tokenizer on train dataset:  46%|████▋     | 43000/92867 [01:03<01:27, 570.24 examples/s]
Running tokenizer on train dataset:  47%|████▋     | 44000/92867 [01:04<01:22, 594.70 examples/s]
Running tokenizer on train dataset:  48%|████▊     | 45000/92867 [01:06<01:20, 595.57 examples/s]
Running tokenizer on train dataset:  50%|████▉     | 46000/92867 [01:08<01:19, 589.74 examples/s]
Running tokenizer on train dataset:  51%|█████     | 47000/92867 [01:09<01:15, 606.96 examples/s]
Running tokenizer on train dataset:  52%|█████▏    | 48000/92867 [01:11<01:16, 586.06 examples/s]
Running tokenizer on train dataset:  53%|█████▎    | 49000/92867 [01:13<01:11, 609.81 examples/s]
Running tokenizer on train dataset:  54%|█████▍    | 50000/92867 [01:15<01:14, 573.48 examples/s]
Running tokenizer on train dataset:  55%|█████▍    | 51000/92867 [01:17<01:17, 542.59 examples/s]
Running tokenizer on train dataset:  56%|█████▌    | 52000/92867 [01:19<01:15, 539.71 examples/s]
Running tokenizer on train dataset:  57%|█████▋    | 53000/92867 [01:21<01:15, 525.70 examples/s]
Running tokenizer on train dataset:  58%|█████▊    | 54000/92867 [01:22<01:11, 540.39 examples/s]
Running tokenizer on train dataset:  59%|█████▉    | 55000/92867 [01:24<01:08, 552.92 examples/s]
Running tokenizer on train dataset:  60%|██████    | 56000/92867 [01:26<01:10, 523.03 examples/s]
Running tokenizer on train dataset:  61%|██████▏   | 57000/92867 [01:28<01:11, 504.50 examples/s]
Running tokenizer on train dataset:  62%|██████▏   | 58000/92867 [01:30<01:10, 495.31 examples/s]
Running tokenizer on train dataset:  64%|██████▎   | 59000/92867 [01:33<01:08, 494.84 examples/s]
Running tokenizer on train dataset:  65%|██████▍   | 60000/92867 [01:34<00:59, 552.23 examples/s]
Running tokenizer on train dataset:  66%|██████▌   | 61000/92867 [01:35<00:53, 592.81 examples/s]
Running tokenizer on train dataset:  67%|██████▋   | 62000/92867 [01:37<00:50, 615.45 examples/s]
Running tokenizer on train dataset:  68%|██████▊   | 63000/92867 [01:38<00:45, 649.98 examples/s]
Running tokenizer on train dataset:  69%|██████▉   | 64000/92867 [01:39<00:41, 691.55 examples/s]
Running tokenizer on train dataset:  70%|██████▉   | 65000/92867 [01:41<00:39, 707.30 examples/s]
Running tokenizer on train dataset:  71%|███████   | 66000/92867 [01:42<00:37, 717.94 examples/s]
Running tokenizer on train dataset:  72%|███████▏  | 67000/92867 [01:43<00:36, 709.63 examples/s]
Running tokenizer on train dataset:  73%|███████▎  | 68000/92867 [01:45<00:34, 721.31 examples/s]
Running tokenizer on train dataset:  74%|███████▍  | 69000/92867 [01:46<00:32, 725.21 examples/s]
Running tokenizer on train dataset:  75%|███████▌  | 70000/92867 [01:48<00:32, 699.48 examples/s]
Running tokenizer on train dataset:  76%|███████▋  | 71000/92867 [01:49<00:31, 695.22 examples/s]
Running tokenizer on train dataset:  78%|███████▊  | 72000/92867 [01:51<00:30, 687.52 examples/s]
Running tokenizer on train dataset:  79%|███████▊  | 73000/92867 [01:52<00:29, 665.68 examples/s]
Running tokenizer on train dataset:  80%|███████▉  | 74000/92867 [01:54<00:29, 643.65 examples/s]
Running tokenizer on train dataset:  81%|████████  | 75000/92867 [01:56<00:28, 636.48 examples/s]
Running tokenizer on train dataset:  82%|████████▏ | 76000/92867 [01:57<00:28, 598.85 examples/s]
Running tokenizer on train dataset:  83%|████████▎ | 77000/92867 [01:59<00:26, 590.22 examples/s]
Running tokenizer on train dataset:  84%|████████▍ | 78000/92867 [02:01<00:25, 579.29 examples/s]
Running tokenizer on train dataset:  85%|████████▌ | 79000/92867 [02:03<00:24, 574.28 examples/s]
Running tokenizer on train dataset:  86%|████████▌ | 80000/92867 [02:04<00:22, 573.74 examples/s]
Running tokenizer on train dataset:  87%|████████▋ | 81000/92867 [02:06<00:20, 578.63 examples/s]
Running tokenizer on train dataset:  88%|████████▊ | 82000/92867 [02:08<00:18, 587.43 examples/s]
Running tokenizer on train dataset:  89%|████████▉ | 83000/92867 [02:10<00:19, 509.64 examples/s]
Running tokenizer on train dataset:  90%|█████████ | 84000/92867 [02:12<00:17, 505.06 examples/s]
Running tokenizer on train dataset:  92%|█████████▏| 85000/92867 [02:14<00:14, 526.54 examples/s]
Running tokenizer on train dataset:  93%|█████████▎| 86000/92867 [02:16<00:12, 547.01 examples/s]
Running tokenizer on train dataset:  94%|█████████▎| 87000/92867 [02:18<00:10, 540.10 examples/s]
Running tokenizer on train dataset:  95%|█████████▍| 88000/92867 [02:19<00:08, 550.38 examples/s]
Running tokenizer on train dataset:  96%|█████████▌| 89000/92867 [02:21<00:07, 542.61 examples/s]
Running tokenizer on train dataset:  97%|█████████▋| 90000/92867 [02:23<00:05, 554.08 examples/s]
Running tokenizer on train dataset:  98%|█████████▊| 91000/92867 [02:25<00:03, 513.08 examples/s]
Running tokenizer on train dataset:  99%|█████████▉| 92000/92867 [02:27<00:01, 505.22 examples/s]
Running tokenizer on train dataset: 100%|██████████| 92867/92867 [02:29<00:00, 496.78 examples/s]
Running tokenizer on train dataset: 100%|██████████| 92867/92867 [02:29<00:00, 620.32 examples/s]
Saving cached train data ...

Saving the dataset (0/1 shards):   0%|          | 0/92867 [00:00<?, ? examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 92867/92867 [00:00<00:00, 941453.90 examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 92867/92867 [00:00<00:00, 939310.72 examples/s]
There were missing keys in the checkpoint model loaded: ['model.encoder.embed_tokens.weight', 'model.decoder.embed_tokens.weight', 'lm_head.weight'].
/opt/conda/lib/python3.10/site-packages/transformers/optimization.py:588: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning
  warnings.warn(
All 371472 steps, warm_up steps: 200
wandb: WARNING The `run_name` is currently set to the same value as `TrainingArguments.output_dir`. If this was not intended, please specify a different run name by setting the `TrainingArguments.run_name` parameter.
wandb: Currently logged in as: abdiharyadi. Use `wandb login --relogin` to force relogin
wandb: wandb version 0.17.5 is available!  To upgrade, please run:
wandb:  $ pip install wandb --upgrade
wandb: Tracking run with wandb version 0.17.0
wandb: Run data is saved locally in /kaggle/working/amr-tst-indo/AMRBART-id/fine-tune/wandb/run-20240720_092913-s0c65klg
wandb: Run `wandb offline` to turn off syncing.
wandb: Syncing run /kaggle/working/amr-tst-indo/AMRBART-id/fine-tune/../outputs/mbart-en-id-smaller-fted
wandb: ⭐️ View project at https://wandb.ai/abdiharyadi/huggingface
wandb: 🚀 View run at https://wandb.ai/abdiharyadi/huggingface/runs/s0c65klg

  0%|          | 0/371472 [00:00<?, ?it/s]/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

 75%|███████▌  | 278605/371472 [00:01<00:00, 194242.65it/s]
                                                           
{'loss': 2.5815, 'learning_rate': 3.250824193583141e-07, 'epoch': 12.0}

 75%|███████▌  | 278620/371472 [00:05<00:00, 194242.65it/s]
                                                           
{'loss': 2.7044, 'learning_rate': 3.2503393738283526e-07, 'epoch': 12.0}

 75%|███████▌  | 278640/371472 [00:11<00:00, 194242.65it/s]
 75%|███████▌  | 278659/371472 [00:16<00:00, 194242.65it/s]
 75%|███████▌  | 278660/371472 [00:17<00:07, 11681.71it/s] 
                                                          
{'loss': 2.6956, 'learning_rate': 3.249854554073563e-07, 'epoch': 12.0}

 75%|███████▌  | 278660/371472 [00:17<00:07, 11681.71it/s]
 75%|███████▌  | 278661/371472 [00:17<00:08, 11431.21it/s]
                                                          
{'loss': 2.8126, 'learning_rate': 3.2493697343187746e-07, 'epoch': 12.0}

 75%|███████▌  | 278680/371472 [00:22<00:08, 11431.21it/s]
                                                          
{'loss': 2.6521, 'learning_rate': 3.2488849145639853e-07, 'epoch': 12.0}

 75%|███████▌  | 278700/371472 [00:28<00:08, 11431.21it/s]
                                                          
{'loss': 2.5069, 'learning_rate': 3.248400094809196e-07, 'epoch': 12.0}

 75%|███████▌  | 278720/371472 [00:33<00:08, 11431.21it/s]
 75%|███████▌  | 278730/371472 [00:36<00:08, 11431.21it/s]
 75%|███████▌  | 278731/371472 [00:37<00:27, 3412.93it/s] 
 75%|███████▌  | 278732/371472 [00:37<00:27, 3359.46it/s]
                                                         
{'loss': 2.5415, 'learning_rate': 3.247915275054408e-07, 'epoch': 12.01}

 75%|███████▌  | 278740/371472 [00:39<00:27, 3359.46it/s]
                                                         
{'loss': 2.641, 'learning_rate': 3.247430455299618e-07, 'epoch': 12.01}

 75%|███████▌  | 278760/371472 [00:45<00:27, 3359.46it/s]
                                                         
{'loss': 2.4992, 'learning_rate': 3.246945635544829e-07, 'epoch': 12.01}

 75%|███████▌  | 278780/371472 [00:51<00:27, 3359.46it/s]
 75%|███████▌  | 278799/371472 [00:56<00:27, 3359.46it/s]
 75%|███████▌  | 278800/371472 [00:56<01:06, 1398.48it/s]
                                                         
{'loss': 2.6855, 'learning_rate': 3.24646081579004e-07, 'epoch': 12.01}

 75%|███████▌  | 278800/371472 [00:56<01:06, 1398.48it/s]
 75%|███████▌  | 278801/371472 [00:57<01:07, 1380.46it/s]
                                                         
{'loss': 2.722, 'learning_rate': 3.2459759960352517e-07, 'epoch': 12.01}

 75%|███████▌  | 278820/371472 [01:02<01:07, 1380.46it/s]
                                                         
{'loss': 2.6642, 'learning_rate': 3.2454911762804624e-07, 'epoch': 12.01}

 75%|███████▌  | 278840/371472 [01:08<01:07, 1380.46it/s]
                                                         
{'loss': 2.5292, 'learning_rate': 3.245006356525674e-07, 'epoch': 12.01}

 75%|███████▌  | 278860/371472 [01:14<01:07, 1380.46it/s]
 75%|███████▌  | 278869/371472 [01:16<01:07, 1380.46it/s]
 75%|███████▌  | 278870/371472 [01:17<02:26, 633.74it/s] 
 75%|███████▌  | 278871/371472 [01:17<02:27, 627.34it/s]
                                                        
{'loss': 2.7679, 'learning_rate': 3.2445215367708844e-07, 'epoch': 12.01}

 75%|███████▌  | 278880/371472 [01:19<02:27, 627.34it/s]
                                                        
{'loss': 2.5001, 'learning_rate': 3.244036717016096e-07, 'epoch': 12.01}

 75%|███████▌  | 278900/371472 [01:25<02:27, 627.34it/s]
                                                        
{'loss': 2.6657, 'learning_rate': 3.2435518972613063e-07, 'epoch': 12.01}

 75%|███████▌  | 278920/371472 [01:31<02:27, 627.34it/s]
 75%|███████▌  | 278938/371472 [01:36<02:27, 627.34it/s]
 75%|███████▌  | 278939/371472 [01:36<05:06, 301.72it/s]
 75%|███████▌  | 278940/371472 [01:37<05:10, 297.54it/s]
                                                        
{'loss': 2.6545, 'learning_rate': 3.243067077506518e-07, 'epoch': 12.01}

 75%|███████▌  | 278940/371472 [01:37<05:10, 297.54it/s]
                                                        
{'loss': 2.8526, 'learning_rate': 3.242582257751729e-07, 'epoch': 12.02}

 75%|███████▌  | 278960/371472 [01:42<05:10, 297.54it/s]
                                                        
{'loss': 2.5763, 'learning_rate': 3.2420974379969406e-07, 'epoch': 12.02}

 75%|███████▌  | 278980/371472 [01:48<05:10, 297.54it/s]
                                                        
{'loss': 2.667, 'learning_rate': 3.241612618242151e-07, 'epoch': 12.02}

 75%|███████▌  | 279000/371472 [01:54<05:10, 297.54it/s]
 75%|███████▌  | 279008/371472 [01:56<05:10, 297.54it/s]
 75%|███████▌  | 279009/371472 [01:57<10:30, 146.74it/s]
 75%|███████▌  | 279010/371472 [01:57<10:36, 145.37it/s]
                                                        
{'loss': 2.6374, 'learning_rate': 3.2411277984873626e-07, 'epoch': 12.02}

 75%|███████▌  | 279020/371472 [02:00<10:35, 145.37it/s]
                                                        
{'loss': 2.7372, 'learning_rate': 3.240642978732573e-07, 'epoch': 12.02}

 75%|███████▌  | 279040/371472 [02:06<10:35, 145.37it/s]
                                                        
{'loss': 2.5283, 'learning_rate': 3.2401581589777845e-07, 'epoch': 12.02}

 75%|███████▌  | 279060/371472 [02:11<10:35, 145.37it/s]
 75%|███████▌  | 279076/371472 [02:16<10:35, 145.37it/s]
 75%|███████▌  | 279077/371472 [02:16<20:59, 73.37it/s] 
 75%|███████▌  | 279078/371472 [02:17<21:15, 72.45it/s]
                                                       
{'loss': 2.5684, 'learning_rate': 3.239673339222995e-07, 'epoch': 12.02}

 75%|███████▌  | 279080/371472 [02:17<21:15, 72.45it/s]
                                                       
{'loss': 2.5982, 'learning_rate': 3.239188519468207e-07, 'epoch': 12.02}

 75%|███████▌  | 279100/371472 [02:23<21:14, 72.45it/s]
                                                       
{'loss': 2.8493, 'learning_rate': 3.2387036997134177e-07, 'epoch': 12.02}

 75%|███████▌  | 279120/371472 [02:29<21:14, 72.45it/s]
                                                       
{'loss': 2.6987, 'learning_rate': 3.238218879958629e-07, 'epoch': 12.02}

 75%|███████▌  | 279140/371472 [02:35<21:14, 72.45it/s]
 75%|███████▌  | 279146/371472 [02:36<21:14, 72.45it/s]
 75%|███████▌  | 279147/371472 [02:37<41:10, 37.37it/s]
 75%|███████▌  | 279148/371472 [02:37<41:31, 37.06it/s]
                                                       
{'loss': 2.7163, 'learning_rate': 3.2377340602038397e-07, 'epoch': 12.02}

 75%|███████▌  | 279160/371472 [02:40<41:30, 37.06it/s]
                                                       
{'loss': 2.6763, 'learning_rate': 3.237249240449051e-07, 'epoch': 12.02}

 75%|███████▌  | 279180/371472 [02:46<41:30, 37.06it/s]
                                                       
{'loss': 2.5603, 'learning_rate': 3.2367644206942616e-07, 'epoch': 12.03}

 75%|███████▌  | 279200/371472 [02:52<41:29, 37.06it/s]
 75%|███████▌  | 279216/371472 [02:56<41:29, 37.06it/s]
 75%|███████▌  | 279217/371472 [02:57<1:16:38, 20.06it/s]
 75%|███████▌  | 279218/371472 [02:57<1:17:18, 19.89it/s]
                                                         
{'loss': 2.6138, 'learning_rate': 3.2362796009394734e-07, 'epoch': 12.03}

 75%|███████▌  | 279220/371472 [02:58<1:17:18, 19.89it/s]
                                                         
{'loss': 2.7566, 'learning_rate': 3.235794781184684e-07, 'epoch': 12.03}

 75%|███████▌  | 279240/371472 [03:03<1:17:17, 19.89it/s]
                                                         
{'loss': 2.6024, 'learning_rate': 3.2353099614298943e-07, 'epoch': 12.03}

 75%|███████▌  | 279260/371472 [03:09<1:17:16, 19.89it/s]
                                                         
{'loss': 2.7577, 'learning_rate': 3.234825141675106e-07, 'epoch': 12.03}

 75%|███████▌  | 279280/371472 [03:15<1:17:15, 19.89it/s]
 75%|███████▌  | 279285/371472 [03:16<1:17:14, 19.89it/s]
 75%|███████▌  | 279286/371472 [03:17<2:12:16, 11.61it/s]
 75%|███████▌  | 279287/371472 [03:17<2:13:22, 11.52it/s]
                                                         
{'loss': 2.8342, 'learning_rate': 3.2343403219203163e-07, 'epoch': 12.03}

 75%|███████▌  | 279300/371472 [03:21<2:13:21, 11.52it/s]
                                                         
{'loss': 2.722, 'learning_rate': 3.233855502165528e-07, 'epoch': 12.03}

 75%|███████▌  | 279320/371472 [03:26<2:13:19, 11.52it/s]
                                                         
{'loss': 2.6587, 'learning_rate': 3.233370682410739e-07, 'epoch': 12.03}

 75%|███████▌  | 279340/371472 [03:32<2:13:17, 11.52it/s]
 75%|███████▌  | 279354/371472 [03:36<2:13:16, 11.52it/s]
 75%|███████▌  | 279355/371472 [03:36<3:25:39,  7.47it/s]
 75%|███████▌  | 279356/371472 [03:37<3:26:26,  7.44it/s]
                                                         
{'loss': 2.5825, 'learning_rate': 3.2328858626559505e-07, 'epoch': 12.03}

 75%|███████▌  | 279360/371472 [03:38<3:26:25,  7.44it/s]
                                                         
{'loss': 2.5255, 'learning_rate': 3.232401042901161e-07, 'epoch': 12.03}

 75%|███████▌  | 279380/371472 [03:44<3:26:22,  7.44it/s]
                                                         
{'loss': 2.761, 'learning_rate': 3.2319162231463725e-07, 'epoch': 12.03}

 75%|███████▌  | 279400/371472 [03:50<3:26:20,  7.44it/s]
                                                         
{'loss': 2.7216, 'learning_rate': 3.2314314033915827e-07, 'epoch': 12.04}

 75%|███████▌  | 279420/371472 [03:56<3:26:17,  7.44it/s]
 75%|███████▌  | 279422/371472 [03:56<3:26:17,  7.44it/s]
 75%|███████▌  | 279423/371472 [03:56<4:44:46,  5.39it/s]
 75%|███████▌  | 279424/371472 [03:57<4:45:55,  5.37it/s]
                                                         
{'loss': 2.6263, 'learning_rate': 3.2309465836367944e-07, 'epoch': 12.04}

 75%|███████▌  | 279440/371472 [04:01<4:45:52,  5.37it/s]
                                                         
{'loss': 2.7164, 'learning_rate': 3.230461763882005e-07, 'epoch': 12.04}

 75%|███████▌  | 279460/371472 [04:07<4:45:48,  5.37it/s]
                                                         
{'loss': 2.7095, 'learning_rate': 3.229976944127217e-07, 'epoch': 12.04}

 75%|███████▌  | 279480/371472 [04:13<4:45:44,  5.37it/s]
 75%|███████▌  | 279491/371472 [04:16<4:45:42,  5.37it/s]
 75%|███████▌  | 279492/371472 [04:16<5:47:54,  4.41it/s]
 75%|███████▌  | 279493/371472 [04:17<5:48:44,  4.40it/s]
                                                         
{'loss': 2.7882, 'learning_rate': 3.2294921243724277e-07, 'epoch': 12.04}

 75%|███████▌  | 279500/371472 [04:19<5:48:42,  4.40it/s]
                                                         
{'loss': 2.6921, 'learning_rate': 3.229007304617639e-07, 'epoch': 12.04}

 75%|███████▌  | 279520/371472 [04:25<5:48:38,  4.40it/s]
                                                         
{'loss': 2.6628, 'learning_rate': 3.2285224848628496e-07, 'epoch': 12.04}

 75%|███████▌  | 279540/371472 [04:30<5:48:33,  4.40it/s]
 75%|███████▌  | 279551/371472 [04:34<6:28:17,  3.95it/s]
 75%|███████▌  | 279552/371472 [04:34<6:28:37,  3.94it/s]
                                                         
{'loss': 2.4556, 'learning_rate': 3.228037665108061e-07, 'epoch': 12.04}

 75%|███████▌  | 279560/371472 [04:36<6:28:35,  3.94it/s]
                                                         
{'loss': 2.6819, 'learning_rate': 3.2275528453532716e-07, 'epoch': 12.04}

 75%|███████▌  | 279580/371472 [04:42<6:28:29,  3.94it/s]
 75%|███████▌  | 279593/371472 [04:46<6:45:49,  3.77it/s]
 75%|███████▌  | 279594/371472 [04:46<6:46:02,  3.77it/s]
                                                         
{'loss': 2.6355, 'learning_rate': 3.2270680255984833e-07, 'epoch': 12.04}

 75%|███████▌  | 279600/371472 [04:48<6:46:00,  3.77it/s]
                                                         
{'loss': 2.6846, 'learning_rate': 3.226583205843694e-07, 'epoch': 12.04}

 75%|███████▌  | 279620/371472 [04:53<6:45:55,  3.77it/s]
 75%|███████▌  | 279623/371472 [04:54<6:53:06,  3.71it/s]
                                                         
{'loss': 2.7921, 'learning_rate': 3.2260983860889053e-07, 'epoch': 12.04}

 75%|███████▌  | 279640/371472 [04:59<6:53:02,  3.71it/s]
 75%|███████▌  | 279643/371472 [04:59<6:55:46,  3.68it/s]
 75%|███████▌  | 279657/371472 [05:03<6:59:20,  3.65it/s]
                                                         
{'loss': 2.641, 'learning_rate': 3.225613566334116e-07, 'epoch': 12.05}

 75%|███████▌  | 279660/371472 [05:04<6:59:19,  3.65it/s]
 75%|███████▌  | 279667/371472 [05:06<7:06:12,  3.59it/s]
 75%|███████▌  | 279674/371472 [05:08<7:09:11,  3.56it/s]
 75%|███████▌  | 279679/371472 [05:10<7:08:33,  3.57it/s]
                                                         
{'loss': 2.5433, 'learning_rate': 3.2251287465793267e-07, 'epoch': 12.05}

 75%|███████▌  | 279680/371472 [05:10<7:08:32,  3.57it/s]
 75%|███████▌  | 279683/371472 [05:11<7:09:24,  3.56it/s]
 75%|███████▌  | 279686/371472 [05:12<7:08:33,  3.57it/s]
 75%|███████▌  | 279688/371472 [05:12<7:12:49,  3.53it/s]
 75%|███████▌  | 279690/371472 [05:13<7:14:18,  3.52it/s]
 75%|███████▌  | 279692/371472 [05:14<7:13:37,  3.53it/s]
 75%|███████▌  | 279693/371472 [05:14<7:12:13,  3.54it/s]
 75%|███████▌  | 279694/371472 [05:14<7:21:31,  3.46it/s]
 75%|███████▌  | 279695/371472 [05:14<7:10:56,  3.55it/s]
 75%|███████▌  | 279696/371472 [05:15<7:03:50,  3.61it/s]
 75%|███████▌  | 279697/371472 [05:15<7:15:49,  3.51it/s]
 75%|███████▌  | 279698/371472 [05:15<7:15:50,  3.51it/s]
 75%|███████▌  | 279699/371472 [05:16<7:20:15,  3.47it/s]
 75%|███████▌  | 279700/371472 [05:16<7:24:31,  3.44it/s]
                                                         
{'loss': 2.6853, 'learning_rate': 3.224643926824538e-07, 'epoch': 12.05}

 75%|███████▌  | 279700/371472 [05:16<7:24:31,  3.44it/s]
 75%|███████▌  | 279701/371472 [05:16<7:45:17,  3.29it/s]
 75%|███████▌  | 279702/371472 [05:17<7:38:37,  3.34it/s]
 75%|███████▌  | 279703/371472 [05:17<7:30:37,  3.39it/s]
 75%|███████▌  | 279704/371472 [05:17<7:28:45,  3.41it/s]
 75%|███████▌  | 279705/371472 [05:17<7:12:39,  3.54it/s]
 75%|███████▌  | 279706/371472 [05:18<7:21:26,  3.46it/s]
 75%|███████▌  | 279707/371472 [05:18<7:36:56,  3.35it/s]
 75%|███████▌  | 279708/371472 [05:18<7:58:31,  3.20it/s]
 75%|███████▌  | 279709/371472 [05:19<7:30:03,  3.40it/s]
 75%|███████▌  | 279710/371472 [05:19<7:58:22,  3.20it/s]
 75%|███████▌  | 279711/371472 [05:19<7:57:26,  3.20it/s]
 75%|███████▌  | 279712/371472 [05:19<7:24:23,  3.44it/s]
 75%|███████▌  | 279713/371472 [05:20<7:17:26,  3.50it/s]
 75%|███████▌  | 279714/371472 [05:20<7:06:07,  3.59it/s]
 75%|███████▌  | 279715/371472 [05:20<7:05:36,  3.59it/s]
 75%|███████▌  | 279716/371472 [05:21<7:18:38,  3.49it/s]
 75%|███████▌  | 279717/371472 [05:21<7:17:36,  3.49it/s]
 75%|███████▌  | 279718/371472 [05:21<6:58:41,  3.65it/s]
 75%|███████▌  | 279719/371472 [05:21<6:43:49,  3.79it/s]
 75%|███████▌  | 279720/371472 [05:22<7:32:03,  3.38it/s]
                                                         
{'loss': 2.6396, 'learning_rate': 3.22415910706975e-07, 'epoch': 12.05}

 75%|███████▌  | 279720/371472 [05:22<7:32:03,  3.38it/s]
 75%|███████▌  | 279721/371472 [05:22<7:14:46,  3.52it/s]
 75%|███████▌  | 279722/371472 [05:22<7:17:13,  3.50it/s]
 75%|███████▌  | 279723/371472 [05:23<7:09:37,  3.56it/s]
 75%|███████▌  | 279724/371472 [05:23<6:51:49,  3.71it/s]
 75%|███████▌  | 279725/371472 [05:23<6:49:00,  3.74it/s]
 75%|███████▌  | 279726/371472 [05:23<6:49:17,  3.74it/s]
 75%|███████▌  | 279727/371472 [05:24<7:14:50,  3.52it/s]
 75%|███████▌  | 279728/371472 [05:24<7:15:05,  3.51it/s]
 75%|███████▌  | 279729/371472 [05:24<7:06:01,  3.59it/s]
 75%|███████▌  | 279730/371472 [05:24<7:04:13,  3.60it/s]
 75%|███████▌  | 279731/371472 [05:25<7:04:23,  3.60it/s]
 75%|███████▌  | 279732/371472 [05:25<7:06:42,  3.58it/s]
 75%|███████▌  | 279733/371472 [05:25<7:19:00,  3.48it/s]
 75%|███████▌  | 279734/371472 [05:26<7:28:08,  3.41it/s]
 75%|███████▌  | 279735/371472 [05:26<7:14:18,  3.52it/s]
 75%|███████▌  | 279736/371472 [05:26<7:17:17,  3.50it/s]
 75%|███████▌  | 279737/371472 [05:26<7:11:34,  3.54it/s]
 75%|███████▌  | 279738/371472 [05:27<7:41:18,  3.31it/s]
 75%|███████▌  | 279739/371472 [05:27<7:15:59,  3.51it/s]
 75%|███████▌  | 279740/371472 [05:27<7:20:56,  3.47it/s]
                                                         
{'loss': 2.6785, 'learning_rate': 3.2236742873149605e-07, 'epoch': 12.05}

 75%|███████▌  | 279740/371472 [05:27<7:20:56,  3.47it/s]
 75%|███████▌  | 279741/371472 [05:28<7:27:17,  3.42it/s]
 75%|███████▌  | 279742/371472 [05:28<7:09:29,  3.56it/s]
 75%|███████▌  | 279743/371472 [05:28<7:10:04,  3.55it/s]
 75%|███████▌  | 279744/371472 [05:28<7:03:31,  3.61it/s]
 75%|███████▌  | 279745/371472 [05:29<7:09:31,  3.56it/s]
 75%|███████▌  | 279746/371472 [05:29<7:06:46,  3.58it/s]
 75%|███████▌  | 279747/371472 [05:29<6:52:28,  3.71it/s]
 75%|███████▌  | 279748/371472 [05:30<6:44:10,  3.78it/s]
 75%|███████▌  | 279749/371472 [05:30<6:49:20,  3.73it/s]
 75%|███████▌  | 279750/371472 [05:30<7:22:54,  3.45it/s]
 75%|███████▌  | 279751/371472 [05:30<7:37:20,  3.34it/s]
 75%|███████▌  | 279752/371472 [05:31<7:28:16,  3.41it/s]
 75%|███████▌  | 279753/371472 [05:31<7:15:26,  3.51it/s]
 75%|███████▌  | 279754/371472 [05:31<7:12:22,  3.54it/s]
 75%|███████▌  | 279755/371472 [05:32<7:09:17,  3.56it/s]
 75%|███████▌  | 279756/371472 [05:32<7:34:07,  3.37it/s]
 75%|███████▌  | 279757/371472 [05:32<7:55:37,  3.21it/s]
 75%|███████▌  | 279758/371472 [05:33<8:05:10,  3.15it/s]
 75%|███████▌  | 279759/371472 [05:33<8:13:48,  3.10it/s]
 75%|███████▌  | 279760/371472 [05:33<7:46:36,  3.28it/s]
                                                         
{'loss': 2.6297, 'learning_rate': 3.223189467560172e-07, 'epoch': 12.05}

 75%|███████▌  | 279760/371472 [05:33<7:46:36,  3.28it/s]
 75%|███████▌  | 279761/371472 [05:33<7:26:18,  3.42it/s]
 75%|███████▌  | 279762/371472 [05:34<7:16:24,  3.50it/s]
 75%|███████▌  | 279763/371472 [05:34<7:06:05,  3.59it/s]
 75%|███████▌  | 279764/371472 [05:34<7:35:43,  3.35it/s]
 75%|███████▌  | 279765/371472 [05:35<7:28:19,  3.41it/s]
 75%|███████▌  | 279766/371472 [05:35<7:33:36,  3.37it/s]
 75%|███████▌  | 279767/371472 [05:35<7:13:40,  3.52it/s]
 75%|███████▌  | 279768/371472 [05:35<7:00:15,  3.64it/s]
 75%|███████▌  | 279769/371472 [05:36<7:07:20,  3.58it/s]
 75%|███████▌  | 279770/371472 [05:36<7:10:03,  3.55it/s]
 75%|███████▌  | 279771/371472 [05:36<7:20:04,  3.47it/s]
 75%|███████▌  | 279772/371472 [05:37<7:19:19,  3.48it/s]
 75%|███████▌  | 279773/371472 [05:37<7:08:02,  3.57it/s]
 75%|███████▌  | 279774/371472 [05:37<7:49:51,  3.25it/s]
 75%|███████▌  | 279775/371472 [05:38<8:10:47,  3.11it/s]
 75%|███████▌  | 279776/371472 [05:38<7:59:00,  3.19it/s]
 75%|███████▌  | 279777/371472 [05:38<7:37:26,  3.34it/s]
 75%|███████▌  | 279778/371472 [05:38<7:32:28,  3.38it/s]
 75%|███████▌  | 279779/371472 [05:39<7:31:42,  3.38it/s]
 75%|███████▌  | 279780/371472 [05:39<7:25:54,  3.43it/s]
                                                         
{'loss': 2.639, 'learning_rate': 3.2227046478053824e-07, 'epoch': 12.05}

 75%|███████▌  | 279780/371472 [05:39<7:25:54,  3.43it/s]
 75%|███████▌  | 279781/371472 [05:39<7:07:53,  3.57it/s]
 75%|███████▌  | 279782/371472 [05:40<7:05:38,  3.59it/s]
 75%|███████▌  | 279783/371472 [05:40<7:13:37,  3.52it/s]
 75%|███████▌  | 279784/371472 [05:40<7:19:26,  3.48it/s]
 75%|███████▌  | 279785/371472 [05:40<7:02:50,  3.61it/s]
 75%|███████▌  | 279786/371472 [05:41<7:03:20,  3.61it/s]
 75%|███████▌  | 279787/371472 [05:41<6:59:31,  3.64it/s]
 75%|███████▌  | 279788/371472 [05:41<6:51:11,  3.72it/s]
 75%|███████▌  | 279789/371472 [05:41<6:56:13,  3.67it/s]
 75%|███████▌  | 279790/371472 [05:42<6:59:55,  3.64it/s]
 75%|███████▌  | 279791/371472 [05:42<6:59:22,  3.64it/s]
 75%|███████▌  | 279792/371472 [05:42<7:03:45,  3.61it/s]
 75%|███████▌  | 279793/371472 [05:43<7:17:29,  3.49it/s]
 75%|███████▌  | 279794/371472 [05:43<7:06:19,  3.58it/s]
 75%|███████▌  | 279795/371472 [05:43<7:19:32,  3.48it/s]
 75%|███████▌  | 279796/371472 [05:43<7:33:51,  3.37it/s]
 75%|███████▌  | 279797/371472 [05:44<7:10:11,  3.55it/s]
 75%|███████▌  | 279798/371472 [05:44<6:58:18,  3.65it/s]
 75%|███████▌  | 279799/371472 [05:44<7:10:06,  3.55it/s]
 75%|███████▌  | 279800/371472 [05:45<6:59:20,  3.64it/s]
                                                         
{'loss': 2.6382, 'learning_rate': 3.2222198280505926e-07, 'epoch': 12.05}

 75%|███████▌  | 279800/371472 [05:45<6:59:20,  3.64it/s]
 75%|███████▌  | 279801/371472 [05:45<7:33:03,  3.37it/s]
 75%|███████▌  | 279802/371472 [05:45<7:28:05,  3.41it/s]
 75%|███████▌  | 279803/371472 [05:45<7:14:31,  3.52it/s]
 75%|███████▌  | 279804/371472 [05:46<7:29:29,  3.40it/s]
 75%|███████▌  | 279805/371472 [05:46<7:48:51,  3.26it/s]
 75%|███████▌  | 279806/371472 [05:46<7:20:02,  3.47it/s]
 75%|███████▌  | 279807/371472 [05:47<7:22:04,  3.46it/s]
 75%|███████▌  | 279808/371472 [05:47<7:40:07,  3.32it/s]
 75%|███████▌  | 279809/371472 [05:47<7:35:17,  3.36it/s]
 75%|███████▌  | 279810/371472 [05:48<7:24:08,  3.44it/s]
 75%|███████▌  | 279811/371472 [05:48<7:35:19,  3.36it/s]
 75%|███████▌  | 279812/371472 [05:48<7:52:13,  3.24it/s]
 75%|███████▌  | 279813/371472 [05:48<7:33:15,  3.37it/s]
 75%|███████▌  | 279814/371472 [05:49<7:29:35,  3.40it/s]
 75%|███████▌  | 279815/371472 [05:49<7:18:10,  3.49it/s]
 75%|███████▌  | 279816/371472 [05:49<7:07:40,  3.57it/s]
 75%|███████▌  | 279817/371472 [05:50<7:07:18,  3.57it/s]
 75%|███████▌  | 279818/371472 [05:50<7:22:50,  3.45it/s]
 75%|███████▌  | 279819/371472 [05:50<7:22:31,  3.45it/s]
 75%|███████▌  | 279820/371472 [05:50<7:20:43,  3.47it/s]
                                                         
{'loss': 2.4631, 'learning_rate': 3.2217350082958044e-07, 'epoch': 12.05}

 75%|███████▌  | 279820/371472 [05:50<7:20:43,  3.47it/s]
 75%|███████▌  | 279821/371472 [05:51<7:36:17,  3.35it/s]
 75%|███████▌  | 279822/371472 [05:51<7:40:46,  3.32it/s]
 75%|███████▌  | 279823/371472 [05:51<7:22:27,  3.45it/s]
 75%|███████▌  | 279824/371472 [05:52<7:16:47,  3.50it/s]
 75%|███████▌  | 279825/371472 [05:52<7:08:49,  3.56it/s]
 75%|███████▌  | 279826/371472 [05:52<8:06:21,  3.14it/s]
 75%|███████▌  | 279827/371472 [05:53<7:33:49,  3.37it/s]
 75%|███████▌  | 279828/371472 [05:53<7:51:55,  3.24it/s]
 75%|███████▌  | 279829/371472 [05:53<7:28:24,  3.41it/s]
 75%|███████▌  | 279830/371472 [05:53<7:18:01,  3.49it/s]
 75%|███████▌  | 279831/371472 [05:54<7:59:05,  3.19it/s]
 75%|███████▌  | 279832/371472 [05:54<7:28:23,  3.41it/s]
 75%|███████▌  | 279833/371472 [05:54<7:57:16,  3.20it/s]
 75%|███████▌  | 279834/371472 [05:55<7:38:32,  3.33it/s]
 75%|███████▌  | 279835/371472 [05:55<7:19:00,  3.48it/s]
 75%|███████▌  | 279836/371472 [05:55<7:04:45,  3.60it/s]
 75%|███████▌  | 279837/371472 [05:55<6:52:49,  3.70it/s]
 75%|███████▌  | 279838/371472 [05:56<7:24:32,  3.44it/s]
 75%|███████▌  | 279839/371472 [05:56<7:17:23,  3.49it/s]
 75%|███████▌  | 279840/371472 [05:56<7:08:13,  3.57it/s]
                                                         
{'loss': 2.7065, 'learning_rate': 3.2212501885410146e-07, 'epoch': 12.05}

 75%|███████▌  | 279840/371472 [05:56<7:08:13,  3.57it/s]
 75%|███████▌  | 279841/371472 [05:57<7:08:16,  3.57it/s]
 75%|███████▌  | 279842/371472 [05:57<7:13:41,  3.52it/s]
 75%|███████▌  | 279843/371472 [05:57<7:04:29,  3.60it/s]
 75%|███████▌  | 279844/371472 [05:57<7:51:03,  3.24it/s]
 75%|███████▌  | 279845/371472 [05:58<7:32:51,  3.37it/s]
 75%|███████▌  | 279846/371472 [05:58<7:19:48,  3.47it/s]
 75%|███████▌  | 279847/371472 [05:58<7:04:02,  3.60it/s]
 75%|███████▌  | 279848/371472 [05:59<7:07:18,  3.57it/s]
 75%|███████▌  | 279849/371472 [05:59<7:07:10,  3.57it/s]
 75%|███████▌  | 279850/371472 [05:59<7:00:27,  3.63it/s]
 75%|███████▌  | 279851/371472 [05:59<7:23:55,  3.44it/s]
 75%|███████▌  | 279852/371472 [06:00<7:41:37,  3.31it/s]
 75%|███████▌  | 279853/371472 [06:00<7:46:56,  3.27it/s]
 75%|███████▌  | 279854/371472 [06:00<8:05:42,  3.14it/s]
 75%|███████▌  | 279855/371472 [06:01<7:42:06,  3.30it/s]
 75%|███████▌  | 279856/371472 [06:01<7:17:45,  3.49it/s]
 75%|███████▌  | 279857/371472 [06:01<7:27:47,  3.41it/s]
 75%|███████▌  | 279858/371472 [06:02<7:26:36,  3.42it/s]
 75%|███████▌  | 279859/371472 [06:02<7:33:57,  3.36it/s]
 75%|███████▌  | 279860/371472 [06:02<7:18:39,  3.48it/s]
                                                         
{'loss': 2.6827, 'learning_rate': 3.220765368786227e-07, 'epoch': 12.05}

 75%|███████▌  | 279860/371472 [06:02<7:18:39,  3.48it/s]
 75%|███████▌  | 279861/371472 [06:02<7:16:29,  3.50it/s]
 75%|███████▌  | 279862/371472 [06:03<7:17:08,  3.49it/s]
 75%|███████▌  | 279863/371472 [06:03<7:12:20,  3.53it/s]
 75%|███████▌  | 279864/371472 [06:03<7:11:13,  3.54it/s]
 75%|███████▌  | 279865/371472 [06:04<7:32:32,  3.37it/s]
 75%|███████▌  | 279866/371472 [06:04<7:21:07,  3.46it/s]
 75%|███████▌  | 279867/371472 [06:04<7:13:02,  3.53it/s]
 75%|███████▌  | 279868/371472 [06:04<7:08:36,  3.56it/s]
 75%|███████▌  | 279869/371472 [06:05<7:35:14,  3.35it/s]
 75%|███████▌  | 279870/371472 [06:05<7:25:15,  3.43it/s]
 75%|███████▌  | 279871/371472 [06:05<7:16:33,  3.50it/s]
 75%|███████▌  | 279872/371472 [06:06<6:55:13,  3.68it/s]
 75%|███████▌  | 279873/371472 [06:06<7:17:23,  3.49it/s]
 75%|███████▌  | 279874/371472 [06:06<7:17:54,  3.49it/s]
 75%|███████▌  | 279875/371472 [06:06<7:36:02,  3.35it/s]
 75%|███████▌  | 279876/371472 [06:07<7:28:00,  3.41it/s]
 75%|███████▌  | 279877/371472 [06:07<7:44:34,  3.29it/s]
 75%|███████▌  | 279878/371472 [06:07<7:38:13,  3.33it/s]
 75%|███████▌  | 279879/371472 [06:08<7:30:33,  3.39it/s]
 75%|███████▌  | 279880/371472 [06:08<7:04:53,  3.59it/s]
                                                         
{'loss': 2.6372, 'learning_rate': 3.2202805490314376e-07, 'epoch': 12.05}

 75%|███████▌  | 279880/371472 [06:08<7:04:53,  3.59it/s]
 75%|███████▌  | 279881/371472 [06:08<6:51:04,  3.71it/s]
 75%|███████▌  | 279882/371472 [06:08<7:10:19,  3.55it/s]
 75%|███████▌  | 279883/371472 [06:09<7:21:15,  3.46it/s]
 75%|███████▌  | 279884/371472 [06:09<7:44:25,  3.29it/s]
 75%|███████▌  | 279885/371472 [06:09<7:28:22,  3.40it/s]
 75%|███████▌  | 279886/371472 [06:10<7:15:38,  3.50it/s]
 75%|███████▌  | 279887/371472 [06:10<8:04:42,  3.15it/s]
 75%|███████▌  | 279888/371472 [06:10<7:32:50,  3.37it/s]
 75%|███████▌  | 279889/371472 [06:11<7:16:53,  3.49it/s]
 75%|███████▌  | 279890/371472 [06:11<7:13:10,  3.52it/s]
 75%|███████▌  | 279891/371472 [06:11<7:08:26,  3.56it/s]
 75%|███████▌  | 279892/371472 [06:11<7:05:47,  3.58it/s]
 75%|███████▌  | 279893/371472 [06:12<7:04:20,  3.60it/s]
 75%|███████▌  | 279894/371472 [06:12<6:56:18,  3.67it/s]
 75%|███████▌  | 279895/371472 [06:12<7:22:52,  3.45it/s]
 75%|███████▌  | 279896/371472 [06:13<7:36:32,  3.34it/s]
 75%|███████▌  | 279897/371472 [06:13<7:20:03,  3.47it/s]
 75%|███████▌  | 279898/371472 [06:13<7:34:49,  3.36it/s]
 75%|███████▌  | 279899/371472 [06:13<7:15:36,  3.50it/s]
 75%|███████▌  | 279900/371472 [06:14<7:13:10,  3.52it/s]
                                                         
{'loss': 2.7196, 'learning_rate': 3.219795729276649e-07, 'epoch': 12.06}

 75%|███████▌  | 279900/371472 [06:14<7:13:10,  3.52it/s]
 75%|███████▌  | 279901/371472 [06:14<6:57:07,  3.66it/s]
 75%|███████▌  | 279902/371472 [06:14<6:51:17,  3.71it/s]
 75%|███████▌  | 279903/371472 [06:14<6:55:24,  3.67it/s]
 75%|███████▌  | 279904/371472 [06:15<6:51:44,  3.71it/s]
 75%|███████▌  | 279905/371472 [06:15<7:01:32,  3.62it/s]
 75%|███████▌  | 279906/371472 [06:15<6:53:59,  3.69it/s]
 75%|███████▌  | 279907/371472 [06:16<6:49:41,  3.72it/s]
 75%|███████▌  | 279908/371472 [06:16<6:54:00,  3.69it/s]
 75%|███████▌  | 279909/371472 [06:16<7:23:38,  3.44it/s]
 75%|███████▌  | 279910/371472 [06:16<7:43:08,  3.29it/s]
 75%|███████▌  | 279911/371472 [06:17<7:21:57,  3.45it/s]
 75%|███████▌  | 279912/371472 [06:17<7:10:25,  3.55it/s]
 75%|███████▌  | 279913/371472 [06:17<7:18:33,  3.48it/s]
 75%|███████▌  | 279914/371472 [06:18<7:01:58,  3.62it/s]
 75%|███████▌  | 279915/371472 [06:18<6:55:54,  3.67it/s]
 75%|███████▌  | 279916/371472 [06:18<7:15:42,  3.50it/s]
 75%|███████▌  | 279917/371472 [06:18<7:12:52,  3.53it/s]
 75%|███████▌  | 279918/371472 [06:19<7:16:56,  3.49it/s]
 75%|███████▌  | 279919/371472 [06:19<7:20:53,  3.46it/s]
 75%|███████▌  | 279920/371472 [06:19<7:26:01,  3.42it/s]
                                                         
{'loss': 2.6824, 'learning_rate': 3.2193109095218595e-07, 'epoch': 12.06}

 75%|███████▌  | 279920/371472 [06:19<7:26:01,  3.42it/s]
 75%|███████▌  | 279921/371472 [06:20<7:23:58,  3.44it/s]
 75%|███████▌  | 279922/371472 [06:20<7:06:32,  3.58it/s]
 75%|███████▌  | 279923/371472 [06:20<7:01:16,  3.62it/s]
 75%|███████▌  | 279924/371472 [06:20<7:09:00,  3.56it/s]
 75%|███████▌  | 279925/371472 [06:21<7:18:12,  3.48it/s]
 75%|███████▌  | 279926/371472 [06:21<7:05:48,  3.58it/s]
 75%|███████▌  | 279927/371472 [06:21<6:54:01,  3.69it/s]
 75%|███████▌  | 279928/371472 [06:21<6:44:24,  3.77it/s]
 75%|███████▌  | 279929/371472 [06:22<6:45:58,  3.76it/s]
 75%|███████▌  | 279930/371472 [06:22<6:40:59,  3.80it/s]
 75%|███████▌  | 279931/371472 [06:22<6:34:13,  3.87it/s]
 75%|███████▌  | 279932/371472 [06:23<6:58:00,  3.65it/s]
 75%|███████▌  | 279933/371472 [06:23<6:53:02,  3.69it/s]
 75%|███████▌  | 279934/371472 [06:23<6:46:39,  3.75it/s]
 75%|███████▌  | 279935/371472 [06:23<7:17:22,  3.49it/s]
 75%|███████▌  | 279936/371472 [06:24<7:09:14,  3.55it/s]
 75%|███████▌  | 279937/371472 [06:24<7:18:03,  3.48it/s]
 75%|███████▌  | 279938/371472 [06:24<7:09:53,  3.55it/s]
 75%|███████▌  | 279939/371472 [06:24<7:00:56,  3.62it/s]
 75%|███████▌  | 279940/371472 [06:25<6:48:38,  3.73it/s]
                                                         
{'loss': 2.6147, 'learning_rate': 3.218826089767071e-07, 'epoch': 12.06}

 75%|███████▌  | 279940/371472 [06:25<6:48:38,  3.73it/s]
 75%|███████▌  | 279941/371472 [06:25<7:02:47,  3.61it/s]
 75%|███████▌  | 279942/371472 [06:25<6:50:20,  3.72it/s]
 75%|███████▌  | 279943/371472 [06:26<6:48:09,  3.74it/s]
 75%|███████▌  | 279944/371472 [06:26<7:14:51,  3.51it/s]
 75%|███████▌  | 279945/371472 [06:26<7:22:50,  3.44it/s]
 75%|███████▌  | 279946/371472 [06:27<7:41:34,  3.30it/s]
 75%|███████▌  | 279947/371472 [06:27<7:29:28,  3.39it/s]
 75%|███████▌  | 279948/371472 [06:27<7:14:42,  3.51it/s]
 75%|███████▌  | 279949/371472 [06:27<7:02:52,  3.61it/s]
 75%|███████▌  | 279950/371472 [06:28<7:00:10,  3.63it/s]
 75%|███████▌  | 279951/371472 [06:28<7:15:52,  3.50it/s]
 75%|███████▌  | 279952/371472 [06:28<7:13:10,  3.52it/s]
 75%|███████▌  | 279953/371472 [06:28<7:11:21,  3.54it/s]
 75%|███████▌  | 279954/371472 [06:29<7:16:54,  3.49it/s]
 75%|███████▌  | 279955/371472 [06:29<7:16:15,  3.50it/s]
 75%|███████▌  | 279956/371472 [06:29<7:08:53,  3.56it/s]
 75%|███████▌  | 279957/371472 [06:30<7:02:41,  3.61it/s]
 75%|███████▌  | 279958/371472 [06:30<6:48:56,  3.73it/s]
 75%|███████▌  | 279959/371472 [06:30<6:44:58,  3.77it/s]
 75%|███████▌  | 279960/371472 [06:30<7:10:25,  3.54it/s]
                                                         
{'loss': 2.9152, 'learning_rate': 3.2183412700122815e-07, 'epoch': 12.06}

 75%|███████▌  | 279960/371472 [06:30<7:10:25,  3.54it/s]
 75%|███████▌  | 279961/371472 [06:31<7:05:10,  3.59it/s]
 75%|███████▌  | 279962/371472 [06:31<7:02:21,  3.61it/s]
 75%|███████▌  | 279963/371472 [06:31<7:02:31,  3.61it/s]
 75%|███████▌  | 279964/371472 [06:32<7:39:45,  3.32it/s]
 75%|███████▌  | 279965/371472 [06:32<7:25:26,  3.42it/s]
 75%|███████▌  | 279966/371472 [06:32<7:07:38,  3.57it/s]
 75%|███████▌  | 279967/371472 [06:32<7:05:17,  3.59it/s]
 75%|███████▌  | 279968/371472 [06:33<7:10:42,  3.54it/s]
 75%|███████▌  | 279969/371472 [06:33<7:16:25,  3.49it/s]
 75%|███████▌  | 279970/371472 [06:33<7:35:59,  3.34it/s]
 75%|███████▌  | 279971/371472 [06:34<7:22:18,  3.45it/s]
 75%|███████▌  | 279972/371472 [06:34<7:00:34,  3.63it/s]
 75%|███████▌  | 279973/371472 [06:34<7:18:03,  3.48it/s]
 75%|███████▌  | 279974/371472 [06:34<7:01:27,  3.62it/s]
 75%|███████▌  | 279975/371472 [06:35<6:46:21,  3.75it/s]
 75%|███████▌  | 279976/371472 [06:35<6:44:31,  3.77it/s]
 75%|███████▌  | 279977/371472 [06:35<6:45:30,  3.76it/s]
 75%|███████▌  | 279978/371472 [06:35<7:00:47,  3.62it/s]
 75%|███████▌  | 279979/371472 [06:36<7:02:39,  3.61it/s]
 75%|███████▌  | 279980/371472 [06:36<7:09:42,  3.55it/s]
                                                         
{'loss': 2.6484, 'learning_rate': 3.2178564502574933e-07, 'epoch': 12.06}

 75%|███████▌  | 279980/371472 [06:36<7:09:42,  3.55it/s]
 75%|███████▌  | 279981/371472 [06:36<7:09:41,  3.55it/s]
 75%|███████▌  | 279982/371472 [06:37<7:06:01,  3.58it/s]
 75%|███████▌  | 279983/371472 [06:37<7:44:40,  3.28it/s]
 75%|███████▌  | 279984/371472 [06:37<7:17:58,  3.48it/s]
 75%|███████▌  | 279985/371472 [06:37<6:58:18,  3.65it/s]
 75%|███████▌  | 279986/371472 [06:38<7:32:48,  3.37it/s]
 75%|███████▌  | 279987/371472 [06:38<7:17:09,  3.49it/s]
 75%|███████▌  | 279988/371472 [06:38<7:03:40,  3.60it/s]
 75%|███████▌  | 279989/371472 [06:39<7:08:04,  3.56it/s]
 75%|███████▌  | 279990/371472 [06:39<6:58:28,  3.64it/s]
 75%|███████▌  | 279991/371472 [06:39<7:18:05,  3.48it/s]
 75%|███████▌  | 279992/371472 [06:39<7:04:21,  3.59it/s]
 75%|███████▌  | 279993/371472 [06:40<7:04:08,  3.59it/s]
 75%|███████▌  | 279994/371472 [06:40<7:02:19,  3.61it/s]
 75%|███████▌  | 279995/371472 [06:40<7:26:14,  3.42it/s]
 75%|███████▌  | 279996/371472 [06:41<7:26:29,  3.41it/s]
 75%|███████▌  | 279997/371472 [06:41<7:20:37,  3.46it/s]
 75%|███████▌  | 279998/371472 [06:41<7:26:15,  3.42it/s]
 75%|███████▌  | 279999/371472 [06:41<7:09:20,  3.55it/s]
 75%|███████▌  | 280000/371472 [06:42<7:15:59,  3.50it/s]
                                                         
{'loss': 2.678, 'learning_rate': 3.217371630502704e-07, 'epoch': 12.06}

 75%|███████▌  | 280000/371472 [06:42<7:15:59,  3.50it/s]
 75%|███████▌  | 280001/371472 [06:42<7:01:04,  3.62it/s]
 75%|███████▌  | 280002/371472 [06:42<6:55:32,  3.67it/s]
 75%|███████▌  | 280003/371472 [06:43<6:52:23,  3.70it/s]
 75%|███████▌  | 280004/371472 [06:43<6:50:40,  3.71it/s]
 75%|███████▌  | 280005/371472 [06:43<7:06:57,  3.57it/s]
 75%|███████▌  | 280006/371472 [06:43<7:08:34,  3.56it/s]
 75%|███████▌  | 280007/371472 [06:44<6:48:22,  3.73it/s]
 75%|███████▌  | 280008/371472 [06:44<6:37:12,  3.84it/s]
 75%|███████▌  | 280009/371472 [06:44<7:00:45,  3.62it/s]
 75%|███████▌  | 280010/371472 [06:44<6:54:12,  3.68it/s]
 75%|███████▌  | 280011/371472 [06:45<7:01:42,  3.61it/s]
 75%|███████▌  | 280012/371472 [06:45<7:22:54,  3.44it/s]
 75%|███████▌  | 280013/371472 [06:45<7:12:16,  3.53it/s]
 75%|███████▌  | 280014/371472 [06:46<7:32:51,  3.37it/s]
 75%|███████▌  | 280015/371472 [06:46<7:31:39,  3.37it/s]
 75%|███████▌  | 280016/371472 [06:46<7:28:07,  3.40it/s]
 75%|███████▌  | 280017/371472 [06:47<7:44:10,  3.28it/s]
 75%|███████▌  | 280018/371472 [06:47<7:38:46,  3.32it/s]
 75%|███████▌  | 280019/371472 [06:47<7:17:57,  3.48it/s]
 75%|███████▌  | 280020/371472 [06:47<7:34:37,  3.35it/s]
                                                         
{'loss': 2.6279, 'learning_rate': 3.216886810747915e-07, 'epoch': 12.06}

 75%|███████▌  | 280020/371472 [06:47<7:34:37,  3.35it/s]
 75%|███████▌  | 280021/371472 [06:48<7:29:27,  3.39it/s]
 75%|███████▌  | 280022/371472 [06:48<7:56:34,  3.20it/s]
 75%|███████▌  | 280023/371472 [06:48<7:50:25,  3.24it/s]
 75%|███████▌  | 280024/371472 [06:49<8:00:57,  3.17it/s]
 75%|███████▌  | 280025/371472 [06:49<7:50:48,  3.24it/s]
 75%|███████▌  | 280026/371472 [06:49<7:19:27,  3.47it/s]
 75%|███████▌  | 280027/371472 [06:49<6:59:14,  3.64it/s]
 75%|███████▌  | 280028/371472 [06:50<7:05:46,  3.58it/s]
 75%|███████▌  | 280029/371472 [06:50<7:13:00,  3.52it/s]
 75%|███████▌  | 280030/371472 [06:50<6:59:06,  3.64it/s]
 75%|███████▌  | 280031/371472 [06:51<6:51:49,  3.70it/s]
 75%|███████▌  | 280032/371472 [06:51<6:52:25,  3.70it/s]
 75%|███████▌  | 280033/371472 [06:51<6:44:47,  3.76it/s]
 75%|███████▌  | 280034/371472 [06:51<6:48:57,  3.73it/s]
 75%|███████▌  | 280035/371472 [06:52<7:07:48,  3.56it/s]
 75%|███████▌  | 280036/371472 [06:52<6:55:14,  3.67it/s]
 75%|███████▌  | 280037/371472 [06:52<7:07:11,  3.57it/s]
 75%|███████▌  | 280038/371472 [06:53<7:15:56,  3.50it/s]
 75%|███████▌  | 280039/371472 [06:53<7:21:06,  3.45it/s]
 75%|███████▌  | 280040/371472 [06:53<7:15:07,  3.50it/s]
                                                         
{'loss': 2.7064, 'learning_rate': 3.216401990993126e-07, 'epoch': 12.06}

 75%|███████▌  | 280040/371472 [06:53<7:15:07,  3.50it/s]
 75%|███████▌  | 280041/371472 [06:53<6:55:40,  3.67it/s]
 75%|███████▌  | 280042/371472 [06:54<6:50:32,  3.71it/s]
 75%|███████▌  | 280043/371472 [06:54<6:40:45,  3.80it/s]
 75%|███████▌  | 280044/371472 [06:54<6:56:28,  3.66it/s]
 75%|███████▌  | 280045/371472 [06:54<6:44:23,  3.77it/s]
 75%|███████▌  | 280046/371472 [06:55<6:38:56,  3.82it/s]
 75%|███████▌  | 280047/371472 [06:55<6:45:35,  3.76it/s]
 75%|███████▌  | 280048/371472 [06:55<6:56:01,  3.66it/s]
 75%|███████▌  | 280049/371472 [06:55<6:49:24,  3.72it/s]
 75%|███████▌  | 280050/371472 [06:56<6:49:29,  3.72it/s]
 75%|███████▌  | 280051/371472 [06:56<7:21:02,  3.45it/s]
 75%|███████▌  | 280052/371472 [06:56<7:17:41,  3.48it/s]
 75%|███████▌  | 280053/371472 [06:57<7:20:44,  3.46it/s]
 75%|███████▌  | 280054/371472 [06:57<7:01:53,  3.61it/s]
 75%|███████▌  | 280055/371472 [06:57<6:52:30,  3.69it/s]
 75%|███████▌  | 280056/371472 [06:57<6:55:48,  3.66it/s]
 75%|███████▌  | 280057/371472 [06:58<6:56:23,  3.66it/s]
 75%|███████▌  | 280058/371472 [06:58<6:50:39,  3.71it/s]
 75%|███████▌  | 280059/371472 [06:58<6:39:21,  3.81it/s]
 75%|███████▌  | 280060/371472 [06:58<6:29:55,  3.91it/s]
                                                         
{'loss': 2.7526, 'learning_rate': 3.215917171238337e-07, 'epoch': 12.06}

 75%|███████▌  | 280060/371472 [06:58<6:29:55,  3.91it/s]
 75%|███████▌  | 280061/371472 [06:59<6:38:02,  3.83it/s]
 75%|███████▌  | 280062/371472 [06:59<7:04:32,  3.59it/s]
 75%|███████▌  | 280063/371472 [06:59<7:22:05,  3.45it/s]
 75%|███████▌  | 280064/371472 [07:00<7:14:16,  3.51it/s]
 75%|███████▌  | 280065/371472 [07:00<7:03:11,  3.60it/s]
 75%|███████▌  | 280066/371472 [07:00<6:55:00,  3.67it/s]
 75%|███████▌  | 280067/371472 [07:00<6:52:22,  3.69it/s]
 75%|███████▌  | 280068/371472 [07:01<7:19:32,  3.47it/s]
 75%|███████▌  | 280069/371472 [07:01<7:09:41,  3.55it/s]
 75%|███████▌  | 280070/371472 [07:01<7:04:56,  3.58it/s]
 75%|███████▌  | 280071/371472 [07:02<7:19:25,  3.47it/s]
 75%|███████▌  | 280072/371472 [07:02<7:09:01,  3.55it/s]
 75%|███████▌  | 280073/371472 [07:02<7:13:40,  3.51it/s]
 75%|███████▌  | 280074/371472 [07:02<7:05:29,  3.58it/s]
 75%|███████▌  | 280075/371472 [07:03<7:40:54,  3.30it/s]
 75%|███████▌  | 280076/371472 [07:03<7:42:49,  3.29it/s]
 75%|███████▌  | 280077/371472 [07:03<7:37:13,  3.33it/s]
 75%|███████▌  | 280078/371472 [07:04<7:18:53,  3.47it/s]
 75%|███████▌  | 280079/371472 [07:04<7:15:35,  3.50it/s]
 75%|███████▌  | 280080/371472 [07:04<7:06:42,  3.57it/s]
                                                         
{'loss': 2.6908, 'learning_rate': 3.215432351483548e-07, 'epoch': 12.06}

 75%|███████▌  | 280080/371472 [07:04<7:06:42,  3.57it/s]
 75%|███████▌  | 280081/371472 [07:05<7:34:09,  3.35it/s]
 75%|███████▌  | 280082/371472 [07:05<7:20:11,  3.46it/s]
 75%|███████▌  | 280083/371472 [07:05<7:11:08,  3.53it/s]
 75%|███████▌  | 280084/371472 [07:05<6:58:44,  3.64it/s]
 75%|███████▌  | 280085/371472 [07:06<6:58:06,  3.64it/s]
 75%|███████▌  | 280086/371472 [07:06<7:10:27,  3.54it/s]
 75%|███████▌  | 280087/371472 [07:06<7:28:49,  3.39it/s]
 75%|███████▌  | 280088/371472 [07:06<7:15:44,  3.50it/s]
 75%|███████▌  | 280089/371472 [07:07<7:19:11,  3.47it/s]
 75%|███████▌  | 280090/371472 [07:07<7:05:42,  3.58it/s]
 75%|███████▌  | 280091/371472 [07:07<7:19:04,  3.47it/s]
 75%|███████▌  | 280092/371472 [07:08<7:04:54,  3.58it/s]
 75%|███████▌  | 280093/371472 [07:08<7:16:20,  3.49it/s]
 75%|███████▌  | 280094/371472 [07:08<7:02:02,  3.61it/s]
 75%|███████▌  | 280095/371472 [07:08<6:53:18,  3.68it/s]
 75%|███████▌  | 280096/371472 [07:09<8:07:06,  3.13it/s]
 75%|███████▌  | 280097/371472 [07:09<7:37:55,  3.33it/s]
 75%|███████▌  | 280098/371472 [07:09<7:18:37,  3.47it/s]
 75%|███████▌  | 280099/371472 [07:10<7:02:44,  3.60it/s]
 75%|███████▌  | 280100/371472 [07:10<7:02:41,  3.60it/s]
                                                         
{'loss': 2.6723, 'learning_rate': 3.2149475317287597e-07, 'epoch': 12.06}

 75%|███████▌  | 280100/371472 [07:10<7:02:41,  3.60it/s]
 75%|███████▌  | 280101/371472 [07:10<7:02:50,  3.60it/s]
 75%|███████▌  | 280102/371472 [07:11<7:44:57,  3.28it/s]
 75%|███████▌  | 280103/371472 [07:11<7:36:30,  3.34it/s]
 75%|███████▌  | 280104/371472 [07:11<7:23:43,  3.43it/s]
 75%|███████▌  | 280105/371472 [07:11<7:11:49,  3.53it/s]
 75%|███████▌  | 280106/371472 [07:12<7:34:54,  3.35it/s]
 75%|███████▌  | 280107/371472 [07:12<7:07:49,  3.56it/s]
 75%|███████▌  | 280108/371472 [07:12<7:14:28,  3.50it/s]
 75%|███████▌  | 280109/371472 [07:13<7:13:59,  3.51it/s]
 75%|███████▌  | 280110/371472 [07:13<7:13:56,  3.51it/s]
 75%|███████▌  | 280111/371472 [07:13<7:18:45,  3.47it/s]
 75%|███████▌  | 280112/371472 [07:13<7:25:50,  3.42it/s]
 75%|███████▌  | 280113/371472 [07:14<7:24:19,  3.43it/s]
 75%|███████▌  | 280114/371472 [07:14<7:47:25,  3.26it/s]
 75%|███████▌  | 280115/371472 [07:14<7:22:39,  3.44it/s]
 75%|███████▌  | 280116/371472 [07:15<7:27:13,  3.40it/s]
 75%|███████▌  | 280117/371472 [07:15<7:33:16,  3.36it/s]
 75%|███████▌  | 280118/371472 [07:15<7:19:54,  3.46it/s]
 75%|███████▌  | 280119/371472 [07:15<7:21:27,  3.45it/s]
 75%|███████▌  | 280120/371472 [07:16<7:21:01,  3.45it/s]
                                                         
{'loss': 2.5986, 'learning_rate': 3.2144627119739704e-07, 'epoch': 12.07}

 75%|███████▌  | 280120/371472 [07:16<7:21:01,  3.45it/s]
 75%|███████▌  | 280121/371472 [07:16<7:37:22,  3.33it/s]
 75%|███████▌  | 280122/371472 [07:16<7:20:54,  3.45it/s]
 75%|███████▌  | 280123/371472 [07:17<7:29:24,  3.39it/s]
 75%|███████▌  | 280124/371472 [07:17<7:07:42,  3.56it/s]
 75%|███████▌  | 280125/371472 [07:17<7:02:38,  3.60it/s]
 75%|███████▌  | 280126/371472 [07:17<7:02:19,  3.60it/s]
 75%|███████▌  | 280127/371472 [07:18<7:08:40,  3.55it/s]
 75%|███████▌  | 280128/371472 [07:18<7:03:58,  3.59it/s]
 75%|███████▌  | 280129/371472 [07:18<7:00:56,  3.62it/s]
 75%|███████▌  | 280130/371472 [07:19<7:02:08,  3.61it/s]
 75%|███████▌  | 280131/371472 [07:19<7:08:42,  3.55it/s]
 75%|███████▌  | 280132/371472 [07:19<7:19:53,  3.46it/s]
 75%|███████▌  | 280133/371472 [07:19<7:26:46,  3.41it/s]
 75%|███████▌  | 280134/371472 [07:20<7:06:53,  3.57it/s]
 75%|███████▌  | 280135/371472 [07:20<7:13:01,  3.52it/s]
 75%|███████▌  | 280136/371472 [07:20<7:10:41,  3.53it/s]
 75%|███████▌  | 280137/371472 [07:21<6:59:02,  3.63it/s]
 75%|███████▌  | 280138/371472 [07:21<6:46:54,  3.74it/s]
 75%|███████▌  | 280139/371472 [07:21<6:49:39,  3.72it/s]
 75%|███████▌  | 280140/371472 [07:21<7:05:44,  3.58it/s]
                                                         
{'loss': 2.5637, 'learning_rate': 3.213977892219182e-07, 'epoch': 12.07}

 75%|███████▌  | 280140/371472 [07:21<7:05:44,  3.58it/s]
 75%|███████▌  | 280141/371472 [07:22<7:03:02,  3.60it/s]
 75%|███████▌  | 280142/371472 [07:22<6:59:07,  3.63it/s]
 75%|███████▌  | 280143/371472 [07:22<6:46:51,  3.74it/s]
 75%|███████▌  | 280144/371472 [07:22<7:18:22,  3.47it/s]
 75%|███████▌  | 280145/371472 [07:23<7:05:00,  3.58it/s]
 75%|███████▌  | 280146/371472 [07:23<7:08:00,  3.56it/s]
 75%|███████▌  | 280147/371472 [07:23<7:02:40,  3.60it/s]
 75%|███████▌  | 280148/371472 [07:24<6:55:05,  3.67it/s]
 75%|███████▌  | 280149/371472 [07:24<7:24:51,  3.42it/s]
 75%|███████▌  | 280150/371472 [07:24<7:02:58,  3.60it/s]
 75%|███████▌  | 280151/371472 [07:24<7:08:51,  3.55it/s]
 75%|███████▌  | 280152/371472 [07:25<6:56:57,  3.65it/s]
 75%|███████▌  | 280153/371472 [07:25<6:53:59,  3.68it/s]
 75%|███████▌  | 280154/371472 [07:25<7:14:19,  3.50it/s]
 75%|███████▌  | 280155/371472 [07:26<7:45:26,  3.27it/s]
 75%|███████▌  | 280156/371472 [07:26<7:31:11,  3.37it/s]
 75%|███████▌  | 280157/371472 [07:26<7:44:25,  3.28it/s]
 75%|███████▌  | 280158/371472 [07:27<7:30:39,  3.38it/s]
 75%|███████▌  | 280159/371472 [07:27<7:06:54,  3.56it/s]
 75%|███████▌  | 280160/371472 [07:27<7:18:45,  3.47it/s]
                                                         
{'loss': 2.6421, 'learning_rate': 3.2134930724643924e-07, 'epoch': 12.07}

 75%|███████▌  | 280160/371472 [07:27<7:18:45,  3.47it/s]
 75%|███████▌  | 280161/371472 [07:27<7:13:37,  3.51it/s]
 75%|███████▌  | 280162/371472 [07:28<6:56:57,  3.65it/s]
 75%|███████▌  | 280163/371472 [07:28<6:47:21,  3.74it/s]
 75%|███████▌  | 280164/371472 [07:28<6:49:59,  3.71it/s]
 75%|███████▌  | 280165/371472 [07:28<6:55:40,  3.66it/s]
 75%|███████▌  | 280166/371472 [07:29<6:51:35,  3.70it/s]
 75%|███████▌  | 280167/371472 [07:29<7:14:24,  3.50it/s]
 75%|███████▌  | 280168/371472 [07:29<7:11:32,  3.53it/s]
 75%|███████▌  | 280169/371472 [07:30<7:01:03,  3.61it/s]
 75%|███████▌  | 280170/371472 [07:30<8:16:58,  3.06it/s]
 75%|███████▌  | 280171/371472 [07:30<7:46:59,  3.26it/s]
 75%|███████▌  | 280172/371472 [07:31<7:46:23,  3.26it/s]
 75%|███████▌  | 280173/371472 [07:31<7:33:41,  3.35it/s]
 75%|███████▌  | 280174/371472 [07:31<7:27:46,  3.40it/s]
 75%|███████▌  | 280175/371472 [07:31<7:14:38,  3.50it/s]
 75%|███████▌  | 280176/371472 [07:32<7:47:36,  3.25it/s]
 75%|███████▌  | 280177/371472 [07:32<7:33:01,  3.36it/s]
 75%|███████▌  | 280178/371472 [07:32<7:25:08,  3.42it/s]
 75%|███████▌  | 280179/371472 [07:33<8:31:31,  2.97it/s]
 75%|███████▌  | 280180/371472 [07:33<7:51:36,  3.23it/s]
                                                         
{'loss': 2.8548, 'learning_rate': 3.2130082527096036e-07, 'epoch': 12.07}

 75%|███████▌  | 280180/371472 [07:33<7:51:36,  3.23it/s]
 75%|███████▌  | 280181/371472 [07:33<7:46:45,  3.26it/s]
 75%|███████▌  | 280182/371472 [07:34<7:26:53,  3.40it/s]
 75%|███████▌  | 280183/371472 [07:34<7:06:25,  3.57it/s]
 75%|███████▌  | 280184/371472 [07:34<7:12:54,  3.51it/s]
 75%|███████▌  | 280185/371472 [07:34<7:13:17,  3.51it/s]
 75%|███████▌  | 280186/371472 [07:35<6:59:35,  3.63it/s]
 75%|███████▌  | 280187/371472 [07:35<6:59:35,  3.63it/s]
 75%|███████▌  | 280188/371472 [07:35<8:05:04,  3.14it/s]
 75%|███████▌  | 280189/371472 [07:36<7:45:00,  3.27it/s]
 75%|███████▌  | 280190/371472 [07:36<7:27:27,  3.40it/s]
 75%|███████▌  | 280191/371472 [07:36<7:37:12,  3.33it/s]
 75%|███████▌  | 280192/371472 [07:36<7:35:36,  3.34it/s]
 75%|███████▌  | 280193/371472 [07:37<7:16:06,  3.49it/s]
 75%|███████▌  | 280194/371472 [07:37<7:20:43,  3.45it/s]
 75%|███████▌  | 280195/371472 [07:37<7:07:15,  3.56it/s]
 75%|███████▌  | 280196/371472 [07:38<7:11:31,  3.53it/s]
 75%|███████▌  | 280197/371472 [07:38<7:01:54,  3.61it/s]
 75%|███████▌  | 280198/371472 [07:38<7:54:41,  3.20it/s]
 75%|███████▌  | 280199/371472 [07:39<7:51:27,  3.23it/s]
 75%|███████▌  | 280200/371472 [07:39<8:10:31,  3.10it/s]
                                                         
{'loss': 2.718, 'learning_rate': 3.2125234329548143e-07, 'epoch': 12.07}

 75%|███████▌  | 280200/371472 [07:39<8:10:31,  3.10it/s]
 75%|███████▌  | 280201/371472 [07:39<7:48:58,  3.24it/s]
 75%|███████▌  | 280202/371472 [07:39<7:38:50,  3.32it/s]
 75%|███████▌  | 280203/371472 [07:40<7:16:36,  3.48it/s]
 75%|███████▌  | 280204/371472 [07:40<7:33:04,  3.36it/s]
 75%|███████▌  | 280205/371472 [07:40<7:26:35,  3.41it/s]
 75%|███████▌  | 280206/371472 [07:41<7:32:26,  3.36it/s]
 75%|███████▌  | 280207/371472 [07:41<7:24:09,  3.42it/s]
 75%|███████▌  | 280208/371472 [07:41<7:18:06,  3.47it/s]
 75%|███████▌  | 280209/371472 [07:41<7:29:25,  3.38it/s]
 75%|███████▌  | 280210/371472 [07:42<7:55:28,  3.20it/s]
 75%|███████▌  | 280211/371472 [07:42<7:59:24,  3.17it/s]
 75%|███████▌  | 280212/371472 [07:42<7:38:38,  3.32it/s]
 75%|███████▌  | 280213/371472 [07:43<8:09:11,  3.11it/s]
 75%|███████▌  | 280214/371472 [07:43<7:46:37,  3.26it/s]
 75%|███████▌  | 280215/371472 [07:43<7:48:16,  3.25it/s]
 75%|███████▌  | 280216/371472 [07:44<7:41:57,  3.29it/s]
 75%|███████▌  | 280217/371472 [07:44<7:40:16,  3.30it/s]
 75%|███████▌  | 280218/371472 [07:44<7:25:48,  3.41it/s]
 75%|███████▌  | 280219/371472 [07:44<7:08:08,  3.55it/s]
 75%|███████▌  | 280220/371472 [07:45<7:43:28,  3.28it/s]
                                                         
{'loss': 2.4913, 'learning_rate': 3.212038613200026e-07, 'epoch': 12.07}

 75%|███████▌  | 280220/371472 [07:45<7:43:28,  3.28it/s]
 75%|███████▌  | 280221/371472 [07:45<7:35:27,  3.34it/s]
 75%|███████▌  | 280222/371472 [07:45<7:19:06,  3.46it/s]
 75%|███████▌  | 280223/371472 [07:46<7:13:58,  3.50it/s]
 75%|███████▌  | 280224/371472 [07:46<7:17:23,  3.48it/s]
 75%|███████▌  | 280225/371472 [07:46<7:12:16,  3.52it/s]
 75%|███████▌  | 280226/371472 [07:47<7:09:36,  3.54it/s]
 75%|███████▌  | 280227/371472 [07:47<7:16:01,  3.49it/s]
 75%|███████▌  | 280228/371472 [07:47<7:02:19,  3.60it/s]
 75%|███████▌  | 280229/371472 [07:47<7:29:25,  3.38it/s]
 75%|███████▌  | 280230/371472 [07:48<7:12:11,  3.52it/s]
 75%|███████▌  | 280231/371472 [07:48<7:14:35,  3.50it/s]
 75%|███████▌  | 280232/371472 [07:48<7:04:53,  3.58it/s]
 75%|███████▌  | 280233/371472 [07:49<7:32:34,  3.36it/s]
 75%|███████▌  | 280234/371472 [07:49<7:18:40,  3.47it/s]
 75%|███████▌  | 280235/371472 [07:49<7:51:58,  3.22it/s]
 75%|███████▌  | 280236/371472 [07:49<7:35:28,  3.34it/s]
 75%|███████▌  | 280237/371472 [07:50<7:30:27,  3.38it/s]
 75%|███████▌  | 280238/371472 [07:50<7:05:28,  3.57it/s]
 75%|███████▌  | 280239/371472 [07:50<7:23:35,  3.43it/s]
 75%|███████▌  | 280240/371472 [07:51<7:21:33,  3.44it/s]
                                                         
{'loss': 2.7582, 'learning_rate': 3.211553793445237e-07, 'epoch': 12.07}

 75%|███████▌  | 280240/371472 [07:51<7:21:33,  3.44it/s]
 75%|███████▌  | 280241/371472 [07:51<7:20:03,  3.46it/s]
 75%|███████▌  | 280242/371472 [07:51<7:32:40,  3.36it/s]
 75%|███████▌  | 280243/371472 [07:52<7:38:57,  3.31it/s]
 75%|███████▌  | 280244/371472 [07:52<7:20:13,  3.45it/s]
 75%|███████▌  | 280245/371472 [07:52<6:56:08,  3.65it/s]
 75%|███████▌  | 280246/371472 [07:52<7:28:03,  3.39it/s]
 75%|███████▌  | 280247/371472 [07:53<7:38:52,  3.31it/s]
 75%|███████▌  | 280248/371472 [07:53<7:24:16,  3.42it/s]
 75%|███████▌  | 280249/371472 [07:53<7:16:28,  3.48it/s]
 75%|███████▌  | 280250/371472 [07:54<7:46:07,  3.26it/s]
 75%|███████▌  | 280251/371472 [07:54<7:25:57,  3.41it/s]
 75%|███████▌  | 280252/371472 [07:54<6:59:05,  3.63it/s]
 75%|███████▌  | 280253/371472 [07:54<6:55:21,  3.66it/s]
 75%|███████▌  | 280254/371472 [07:55<6:58:59,  3.63it/s]
 75%|███████▌  | 280255/371472 [07:55<6:53:26,  3.68it/s]
 75%|███████▌  | 280256/371472 [07:55<7:07:53,  3.55it/s]
 75%|███████▌  | 280257/371472 [07:55<7:02:07,  3.60it/s]
 75%|███████▌  | 280258/371472 [07:56<7:27:08,  3.40it/s]
 75%|███████▌  | 280259/371472 [07:56<7:16:28,  3.48it/s]
 75%|███████▌  | 280260/371472 [07:56<7:07:46,  3.55it/s]
                                                         
{'loss': 2.5788, 'learning_rate': 3.2110689736904486e-07, 'epoch': 12.07}

 75%|███████▌  | 280260/371472 [07:56<7:07:46,  3.55it/s]
 75%|███████▌  | 280261/371472 [07:57<7:08:26,  3.55it/s]
 75%|███████▌  | 280262/371472 [07:57<7:37:45,  3.32it/s]
 75%|███████▌  | 280263/371472 [07:57<7:34:19,  3.35it/s]
 75%|███████▌  | 280264/371472 [07:57<7:13:21,  3.51it/s]
 75%|███████▌  | 280265/371472 [07:58<7:17:15,  3.48it/s]
 75%|███████▌  | 280266/371472 [07:58<7:18:01,  3.47it/s]
 75%|███████▌  | 280267/371472 [07:58<7:04:58,  3.58it/s]
 75%|███████▌  | 280268/371472 [07:59<7:13:36,  3.51it/s]
 75%|███████▌  | 280269/371472 [07:59<7:01:26,  3.61it/s]
 75%|███████▌  | 280270/371472 [07:59<7:07:05,  3.56it/s]
 75%|███████▌  | 280271/371472 [07:59<7:21:09,  3.45it/s]
 75%|███████▌  | 280272/371472 [08:00<7:20:54,  3.45it/s]
 75%|███████▌  | 280273/371472 [08:00<7:01:35,  3.61it/s]
 75%|███████▌  | 280274/371472 [08:00<7:32:11,  3.36it/s]
 75%|███████▌  | 280275/371472 [08:01<7:29:24,  3.38it/s]
 75%|███████▌  | 280276/371472 [08:01<7:12:21,  3.52it/s]
 75%|███████▌  | 280277/371472 [08:01<7:09:38,  3.54it/s]
 75%|███████▌  | 280278/371472 [08:02<7:14:03,  3.50it/s]
 75%|███████▌  | 280279/371472 [08:02<7:21:06,  3.45it/s]
 75%|███████▌  | 280280/371472 [08:02<7:00:08,  3.62it/s]
                                                         
{'loss': 2.4607, 'learning_rate': 3.210584153935659e-07, 'epoch': 12.07}

 75%|███████▌  | 280280/371472 [08:02<7:00:08,  3.62it/s]
 75%|███████▌  | 280281/371472 [08:02<7:12:39,  3.51it/s]
 75%|███████▌  | 280282/371472 [08:03<7:01:56,  3.60it/s]
 75%|███████▌  | 280283/371472 [08:03<6:53:50,  3.67it/s]
 75%|███████▌  | 280284/371472 [08:03<6:59:42,  3.62it/s]
 75%|███████▌  | 280285/371472 [08:03<7:06:08,  3.57it/s]
 75%|███████▌  | 280286/371472 [08:04<7:14:45,  3.50it/s]
 75%|███████▌  | 280287/371472 [08:04<7:00:38,  3.61it/s]
 75%|███████▌  | 280288/371472 [08:04<6:50:04,  3.71it/s]
 75%|███████▌  | 280289/371472 [08:05<7:19:17,  3.46it/s]
 75%|███████▌  | 280290/371472 [08:05<7:06:14,  3.57it/s]
 75%|███████▌  | 280291/371472 [08:05<7:11:23,  3.52it/s]
 75%|███████▌  | 280292/371472 [08:05<6:58:21,  3.63it/s]
 75%|███████▌  | 280293/371472 [08:06<6:48:24,  3.72it/s]
 75%|███████▌  | 280294/371472 [08:06<6:36:31,  3.83it/s]
 75%|███████▌  | 280295/371472 [08:06<6:54:49,  3.66it/s]
 75%|███████▌  | 280296/371472 [08:06<6:59:58,  3.62it/s]
 75%|███████▌  | 280297/371472 [08:07<7:11:28,  3.52it/s]
 75%|███████▌  | 280298/371472 [08:07<7:21:45,  3.44it/s]
 75%|███████▌  | 280299/371472 [08:07<7:21:11,  3.44it/s]
 75%|███████▌  | 280300/371472 [08:08<7:17:10,  3.48it/s]
                                                         
{'loss': 2.6057, 'learning_rate': 3.2100993341808705e-07, 'epoch': 12.07}

 75%|███████▌  | 280300/371472 [08:08<7:17:10,  3.48it/s]
 75%|███████▌  | 280301/371472 [08:08<7:13:11,  3.51it/s]
 75%|███████▌  | 280302/371472 [08:08<7:11:48,  3.52it/s]
 75%|███████▌  | 280303/371472 [08:09<8:04:27,  3.14it/s]
 75%|███████▌  | 280304/371472 [08:09<7:46:23,  3.26it/s]
 75%|███████▌  | 280305/371472 [08:09<7:45:07,  3.27it/s]
 75%|███████▌  | 280306/371472 [08:09<7:19:37,  3.46it/s]
 75%|███████▌  | 280307/371472 [08:10<7:10:11,  3.53it/s]
 75%|███████▌  | 280308/371472 [08:10<8:11:48,  3.09it/s]
 75%|███████▌  | 280309/371472 [08:10<7:49:19,  3.24it/s]
 75%|███████▌  | 280310/371472 [08:11<7:52:26,  3.22it/s]
 75%|███████▌  | 280311/371472 [08:11<8:01:35,  3.15it/s]
 75%|███████▌  | 280312/371472 [08:11<7:37:04,  3.32it/s]
 75%|███████▌  | 280313/371472 [08:12<7:30:44,  3.37it/s]
 75%|███████▌  | 280314/371472 [08:12<7:11:06,  3.52it/s]
 75%|███████▌  | 280315/371472 [08:12<7:08:09,  3.55it/s]
 75%|███████▌  | 280316/371472 [08:12<7:03:48,  3.58it/s]
 75%|███████▌  | 280317/371472 [08:13<7:35:32,  3.34it/s]
 75%|███████▌  | 280318/371472 [08:13<7:33:01,  3.35it/s]
 75%|███████▌  | 280319/371472 [08:13<7:29:25,  3.38it/s]
 75%|███████▌  | 280320/371472 [08:14<7:19:54,  3.45it/s]
                                                         
{'loss': 2.7481, 'learning_rate': 3.2096145144260807e-07, 'epoch': 12.07}

 75%|███████▌  | 280320/371472 [08:14<7:19:54,  3.45it/s]
 75%|███████▌  | 280321/371472 [08:14<7:13:21,  3.51it/s]
 75%|███████▌  | 280322/371472 [08:14<7:31:13,  3.37it/s]
 75%|███████▌  | 280323/371472 [08:14<7:10:02,  3.53it/s]
 75%|███████▌  | 280324/371472 [08:15<7:01:42,  3.60it/s]
 75%|███████▌  | 280325/371472 [08:15<7:31:05,  3.37it/s]
 75%|███████▌  | 280326/371472 [08:15<7:20:49,  3.45it/s]
 75%|███████▌  | 280327/371472 [08:16<7:15:11,  3.49it/s]
 75%|███████▌  | 280328/371472 [08:16<7:23:18,  3.43it/s]
 75%|███████▌  | 280329/371472 [08:16<7:15:34,  3.49it/s]
 75%|███████▌  | 280330/371472 [08:16<6:53:17,  3.68it/s]
 75%|███████▌  | 280331/371472 [08:17<6:50:33,  3.70it/s]
 75%|███████▌  | 280332/371472 [08:17<6:55:09,  3.66it/s]
 75%|███████▌  | 280333/371472 [08:17<7:07:54,  3.55it/s]
 75%|███████▌  | 280334/371472 [08:18<7:32:51,  3.35it/s]
 75%|███████▌  | 280335/371472 [08:18<7:12:11,  3.51it/s]
 75%|███████▌  | 280336/371472 [08:18<7:29:03,  3.38it/s]
 75%|███████▌  | 280337/371472 [08:19<7:40:12,  3.30it/s]
 75%|███████▌  | 280338/371472 [08:19<7:17:35,  3.47it/s]
 75%|███████▌  | 280339/371472 [08:19<7:01:38,  3.60it/s]
 75%|███████▌  | 280340/371472 [08:19<7:07:37,  3.55it/s]
                                                         
{'loss': 2.5981, 'learning_rate': 3.2091296946712914e-07, 'epoch': 12.07}

 75%|███████▌  | 280340/371472 [08:19<7:07:37,  3.55it/s]
 75%|███████▌  | 280341/371472 [08:20<7:40:26,  3.30it/s]
 75%|███████▌  | 280342/371472 [08:20<10:15:15,  2.47it/s]
 75%|███████▌  | 280343/371472 [08:21<9:12:19,  2.75it/s] 
 75%|███████▌  | 280344/371472 [08:21<8:20:16,  3.04it/s]
 75%|███████▌  | 280345/371472 [08:21<7:53:48,  3.21it/s]
 75%|███████▌  | 280346/371472 [08:21<7:26:51,  3.40it/s]
 75%|███████▌  | 280347/371472 [08:22<7:22:11,  3.43it/s]
 75%|███████▌  | 280348/371472 [08:22<7:08:00,  3.55it/s]
 75%|███████▌  | 280349/371472 [08:22<7:04:18,  3.58it/s]
 75%|███████▌  | 280350/371472 [08:22<7:10:26,  3.53it/s]
 75%|███████▌  | 280351/371472 [08:23<7:02:04,  3.60it/s]
 75%|███████▌  | 280352/371472 [08:23<7:05:07,  3.57it/s]
 75%|███████▌  | 280353/371472 [08:23<6:54:19,  3.67it/s]
 75%|███████▌  | 280354/371472 [08:24<7:07:55,  3.55it/s]
 75%|███████▌  | 280355/371472 [08:24<7:45:44,  3.26it/s]
 75%|███████▌  | 280356/371472 [08:24<8:05:43,  3.13it/s]
 75%|███████▌  | 280357/371472 [08:25<7:40:59,  3.29it/s]
 75%|███████▌  | 280358/371472 [08:25<7:27:30,  3.39it/s]
 75%|███████▌  | 280359/371472 [08:25<7:26:51,  3.40it/s]
 75%|███████▌  | 280360/371472 [08:25<7:09:07,  3.54it/s]
                                                         
{'loss': 2.7732, 'learning_rate': 3.208644874916504e-07, 'epoch': 12.08}

 75%|███████▌  | 280360/371472 [08:25<7:09:07,  3.54it/s]
 75%|███████▌  | 280361/371472 [08:26<7:03:43,  3.58it/s]
 75%|███████▌  | 280362/371472 [08:26<7:03:31,  3.59it/s]
 75%|███████▌  | 280363/371472 [08:26<7:07:22,  3.55it/s]
 75%|███████▌  | 280364/371472 [08:26<6:49:59,  3.70it/s]
 75%|███████▌  | 280365/371472 [08:27<6:56:25,  3.65it/s]
 75%|███████▌  | 280366/371472 [08:27<7:27:59,  3.39it/s]
 75%|███████▌  | 280367/371472 [08:27<7:12:41,  3.51it/s]
 75%|███████▌  | 280368/371472 [08:28<6:58:13,  3.63it/s]
 75%|███████▌  | 280369/371472 [08:28<7:22:19,  3.43it/s]
 75%|███████▌  | 280370/371472 [08:28<7:14:14,  3.50it/s]
 75%|███████▌  | 280371/371472 [08:29<7:28:13,  3.39it/s]
 75%|███████▌  | 280372/371472 [08:29<7:12:50,  3.51it/s]
 75%|███████▌  | 280373/371472 [08:29<6:56:34,  3.64it/s]
 75%|███████▌  | 280374/371472 [08:29<6:58:04,  3.63it/s]
 75%|███████▌  | 280375/371472 [08:30<7:25:14,  3.41it/s]
 75%|███████▌  | 280376/371472 [08:30<8:11:08,  3.09it/s]
 75%|███████▌  | 280377/371472 [08:30<7:41:52,  3.29it/s]
 75%|███████▌  | 280378/371472 [08:31<7:24:02,  3.42it/s]
 75%|███████▌  | 280379/371472 [08:31<7:17:08,  3.47it/s]
 75%|███████▌  | 280380/371472 [08:31<7:18:06,  3.47it/s]
                                                         
{'loss': 2.5642, 'learning_rate': 3.208160055161714e-07, 'epoch': 12.08}

 75%|███████▌  | 280380/371472 [08:31<7:18:06,  3.47it/s]
 75%|███████▌  | 280381/371472 [08:31<7:32:55,  3.35it/s]
 75%|███████▌  | 280382/371472 [08:32<8:01:48,  3.15it/s]
 75%|███████▌  | 280383/371472 [08:32<7:46:01,  3.26it/s]
 75%|███████▌  | 280384/371472 [08:32<7:24:15,  3.42it/s]
 75%|███████▌  | 280385/371472 [08:33<7:55:32,  3.19it/s]
 75%|███████▌  | 280386/371472 [08:33<7:31:57,  3.36it/s]
 75%|███████▌  | 280387/371472 [08:33<7:28:27,  3.39it/s]
 75%|███████▌  | 280388/371472 [08:34<7:29:28,  3.38it/s]
 75%|███████▌  | 280389/371472 [08:34<7:10:06,  3.53it/s]
 75%|███████▌  | 280390/371472 [08:34<6:56:13,  3.65it/s]
 75%|███████▌  | 280391/371472 [08:34<7:10:24,  3.53it/s]
 75%|███████▌  | 280392/371472 [08:35<7:03:40,  3.58it/s]
 75%|███████▌  | 280393/371472 [08:35<7:02:44,  3.59it/s]
 75%|███████▌  | 280394/371472 [08:35<7:05:10,  3.57it/s]
 75%|███████▌  | 280395/371472 [08:35<7:09:10,  3.54it/s]
 75%|███████▌  | 280396/371472 [08:36<7:38:05,  3.31it/s]
 75%|███████▌  | 280397/371472 [08:36<7:41:15,  3.29it/s]
 75%|███████▌  | 280398/371472 [08:36<7:26:44,  3.40it/s]
 75%|███████▌  | 280399/371472 [08:37<7:24:41,  3.41it/s]
 75%|███████▌  | 280400/371472 [08:37<7:15:26,  3.49it/s]
                                                         
{'loss': 2.6959, 'learning_rate': 3.207675235406925e-07, 'epoch': 12.08}

 75%|███████▌  | 280400/371472 [08:37<7:15:26,  3.49it/s]
 75%|███████▌  | 280401/371472 [08:37<7:16:45,  3.48it/s]
 75%|███████▌  | 280402/371472 [08:38<7:58:42,  3.17it/s]
 75%|███████▌  | 280403/371472 [08:38<7:33:38,  3.35it/s]
 75%|███████▌  | 280404/371472 [08:38<7:42:41,  3.28it/s]
 75%|███████▌  | 280405/371472 [08:39<7:36:38,  3.32it/s]
 75%|███████▌  | 280406/371472 [08:39<8:13:30,  3.08it/s]
 75%|███████▌  | 280407/371472 [08:39<7:50:12,  3.23it/s]
 75%|███████▌  | 280408/371472 [08:39<7:27:25,  3.39it/s]
 75%|███████▌  | 280409/371472 [08:40<7:28:23,  3.38it/s]
 75%|███████▌  | 280410/371472 [08:40<7:10:40,  3.52it/s]
 75%|███████▌  | 280411/371472 [08:40<7:19:25,  3.45it/s]
 75%|███████▌  | 280412/371472 [08:41<7:05:28,  3.57it/s]
 75%|███████▌  | 280413/371472 [08:41<7:01:09,  3.60it/s]
 75%|███████▌  | 280414/371472 [08:41<7:20:55,  3.44it/s]
 75%|███████▌  | 280415/371472 [08:41<7:09:46,  3.53it/s]
 75%|███████▌  | 280416/371472 [08:42<6:50:49,  3.69it/s]
 75%|███████▌  | 280417/371472 [08:42<7:08:31,  3.54it/s]
 75%|███████▌  | 280418/371472 [08:42<6:58:05,  3.63it/s]
 75%|███████▌  | 280419/371472 [08:43<7:06:00,  3.56it/s]
 75%|███████▌  | 280420/371472 [08:43<7:18:55,  3.46it/s]
                                                         
{'loss': 2.709, 'learning_rate': 3.207190415652136e-07, 'epoch': 12.08}

 75%|███████▌  | 280420/371472 [08:43<7:18:55,  3.46it/s]
 75%|███████▌  | 280421/371472 [08:43<7:08:13,  3.54it/s]
 75%|███████▌  | 280422/371472 [08:43<7:14:35,  3.49it/s]
 75%|███████▌  | 280423/371472 [08:44<6:58:41,  3.62it/s]
 75%|███████▌  | 280424/371472 [08:44<7:09:43,  3.53it/s]
 75%|███████▌  | 280425/371472 [08:44<6:58:50,  3.62it/s]
 75%|███████▌  | 280426/371472 [08:44<6:55:57,  3.65it/s]
 75%|███████▌  | 280427/371472 [08:45<6:59:00,  3.62it/s]
 75%|███████▌  | 280428/371472 [08:45<6:47:02,  3.73it/s]
 75%|███████▌  | 280429/371472 [08:45<7:01:21,  3.60it/s]
 75%|███████▌  | 280430/371472 [08:46<7:02:09,  3.59it/s]
 75%|███████▌  | 280431/371472 [08:46<7:13:55,  3.50it/s]
 75%|███████▌  | 280432/371472 [08:46<7:38:48,  3.31it/s]
 75%|███████▌  | 280433/371472 [08:46<7:22:36,  3.43it/s]
 75%|███████▌  | 280434/371472 [08:47<7:09:58,  3.53it/s]
 75%|███████▌  | 280435/371472 [08:47<7:07:47,  3.55it/s]
 75%|███████▌  | 280436/371472 [08:47<7:11:56,  3.51it/s]
 75%|███████▌  | 280437/371472 [08:48<7:17:10,  3.47it/s]
 75%|███████▌  | 280438/371472 [08:48<7:15:38,  3.48it/s]
 75%|███████▌  | 280439/371472 [08:48<7:04:31,  3.57it/s]
 75%|███████▌  | 280440/371472 [08:48<7:08:17,  3.54it/s]
                                                         
{'loss': 2.6982, 'learning_rate': 3.206705595897347e-07, 'epoch': 12.08}

 75%|███████▌  | 280440/371472 [08:48<7:08:17,  3.54it/s]
 75%|███████▌  | 280441/371472 [08:49<7:03:48,  3.58it/s]
 75%|███████▌  | 280442/371472 [08:49<7:19:29,  3.45it/s]
 75%|███████▌  | 280443/371472 [08:49<7:48:08,  3.24it/s]
 75%|███████▌  | 280444/371472 [08:50<7:35:17,  3.33it/s]
 75%|███████▌  | 280445/371472 [08:50<7:18:01,  3.46it/s]
 75%|███████▌  | 280446/371472 [08:50<7:20:55,  3.44it/s]
 75%|███████▌  | 280447/371472 [08:51<7:58:41,  3.17it/s]
 75%|███████▌  | 280448/371472 [08:51<7:33:31,  3.35it/s]
 75%|███████▌  | 280449/371472 [08:51<7:36:21,  3.32it/s]
 75%|███████▌  | 280450/371472 [08:51<7:25:19,  3.41it/s]
 75%|███████▌  | 280451/371472 [08:52<7:30:33,  3.37it/s]
 75%|███████▌  | 280452/371472 [08:52<7:23:56,  3.42it/s]
 75%|███████▌  | 280453/371472 [08:52<7:20:01,  3.45it/s]
 75%|███████▌  | 280454/371472 [08:53<7:05:32,  3.56it/s]
 75%|███████▌  | 280455/371472 [08:53<7:05:30,  3.57it/s]
 75%|███████▌  | 280456/371472 [08:53<6:53:55,  3.66it/s]
 75%|███████▌  | 280457/371472 [08:53<7:35:16,  3.33it/s]
 75%|███████▌  | 280458/371472 [08:54<7:35:57,  3.33it/s]
 75%|███████▌  | 280459/371472 [08:54<7:51:21,  3.22it/s]
 75%|███████▌  | 280460/371472 [08:54<7:28:45,  3.38it/s]
                                                         
{'loss': 2.6734, 'learning_rate': 3.206220776142558e-07, 'epoch': 12.08}

 75%|███████▌  | 280460/371472 [08:54<7:28:45,  3.38it/s]
 75%|███████▌  | 280461/371472 [08:55<7:26:43,  3.40it/s]
 76%|███████▌  | 280462/371472 [08:55<7:13:45,  3.50it/s]
 76%|███████▌  | 280463/371472 [08:55<7:07:28,  3.55it/s]
 76%|███████▌  | 280464/371472 [08:55<7:06:29,  3.56it/s]
 76%|███████▌  | 280465/371472 [08:56<7:00:02,  3.61it/s]
 76%|███████▌  | 280466/371472 [08:56<7:37:55,  3.31it/s]
 76%|███████▌  | 280467/371472 [08:56<7:26:11,  3.40it/s]
 76%|███████▌  | 280468/371472 [08:57<8:10:51,  3.09it/s]
 76%|███████▌  | 280469/371472 [08:57<8:11:20,  3.09it/s]
 76%|███████▌  | 280470/371472 [08:57<7:40:39,  3.29it/s]
 76%|███████▌  | 280471/371472 [08:58<7:34:25,  3.34it/s]
 76%|███████▌  | 280472/371472 [08:58<7:26:25,  3.40it/s]
 76%|███████▌  | 280473/371472 [08:58<7:10:26,  3.52it/s]
 76%|███████▌  | 280474/371472 [08:59<7:48:43,  3.24it/s]
 76%|███████▌  | 280475/371472 [08:59<7:33:51,  3.34it/s]
 76%|███████▌  | 280476/371472 [08:59<7:17:10,  3.47it/s]
 76%|███████▌  | 280477/371472 [08:59<6:57:35,  3.63it/s]
 76%|███████▌  | 280478/371472 [09:00<6:46:53,  3.73it/s]
 76%|███████▌  | 280479/371472 [09:00<6:43:49,  3.76it/s]
 76%|███████▌  | 280480/371472 [09:00<6:34:00,  3.85it/s]
                                                         
{'loss': 2.6566, 'learning_rate': 3.2057359563877696e-07, 'epoch': 12.08}

 76%|███████▌  | 280480/371472 [09:00<6:34:00,  3.85it/s]
 76%|███████▌  | 280481/371472 [09:00<6:48:02,  3.72it/s]
 76%|███████▌  | 280482/371472 [09:01<6:55:07,  3.65it/s]
 76%|███████▌  | 280483/371472 [09:01<7:17:07,  3.47it/s]
 76%|███████▌  | 280484/371472 [09:01<7:05:15,  3.57it/s]
 76%|███████▌  | 280485/371472 [09:02<7:13:47,  3.50it/s]
 76%|███████▌  | 280486/371472 [09:02<7:30:12,  3.37it/s]
 76%|███████▌  | 280487/371472 [09:02<7:11:36,  3.51it/s]
 76%|███████▌  | 280488/371472 [09:02<7:05:16,  3.57it/s]
 76%|███████▌  | 280489/371472 [09:03<6:56:24,  3.64it/s]
 76%|███████▌  | 280490/371472 [09:03<7:01:16,  3.60it/s]
 76%|███████▌  | 280491/371472 [09:03<6:55:35,  3.65it/s]
 76%|███████▌  | 280492/371472 [09:04<7:41:02,  3.29it/s]
 76%|███████▌  | 280493/371472 [09:04<7:17:05,  3.47it/s]
 76%|███████▌  | 280494/371472 [09:04<7:19:15,  3.45it/s]
 76%|███████▌  | 280495/371472 [09:05<7:50:05,  3.23it/s]
 76%|███████▌  | 280496/371472 [09:05<7:27:16,  3.39it/s]
 76%|███████▌  | 280497/371472 [09:05<7:32:27,  3.35it/s]
 76%|███████▌  | 280498/371472 [09:05<7:32:07,  3.35it/s]
 76%|███████▌  | 280499/371472 [09:06<7:13:14,  3.50it/s]
 76%|███████▌  | 280500/371472 [09:06<7:04:27,  3.57it/s]
                                                         
{'loss': 2.8173, 'learning_rate': 3.2052511366329803e-07, 'epoch': 12.08}

 76%|███████▌  | 280500/371472 [09:06<7:04:27,  3.57it/s]
 76%|███████▌  | 280501/371472 [09:06<6:58:55,  3.62it/s]
 76%|███████▌  | 280502/371472 [09:06<7:18:11,  3.46it/s]
 76%|███████▌  | 280503/371472 [09:07<6:57:52,  3.63it/s]
 76%|███████▌  | 280504/371472 [09:07<6:53:08,  3.67it/s]
 76%|███████▌  | 280505/371472 [09:07<6:56:17,  3.64it/s]
 76%|███████▌  | 280506/371472 [09:08<7:27:59,  3.38it/s]
 76%|███████▌  | 280507/371472 [09:08<7:11:00,  3.52it/s]
 76%|███████▌  | 280508/371472 [09:08<7:17:14,  3.47it/s]
 76%|███████▌  | 280509/371472 [09:08<7:02:26,  3.59it/s]
 76%|███████▌  | 280510/371472 [09:09<6:50:34,  3.69it/s]
 76%|███████▌  | 280511/371472 [09:09<6:56:04,  3.64it/s]
 76%|███████▌  | 280512/371472 [09:09<6:50:43,  3.69it/s]
 76%|███████▌  | 280513/371472 [09:10<6:56:58,  3.64it/s]
 76%|███████▌  | 280514/371472 [09:10<6:51:43,  3.68it/s]
 76%|███████▌  | 280515/371472 [09:10<6:57:49,  3.63it/s]
 76%|███████▌  | 280516/371472 [09:10<6:53:49,  3.66it/s]
 76%|███████▌  | 280517/371472 [09:11<6:42:12,  3.77it/s]
 76%|███████▌  | 280518/371472 [09:11<6:48:38,  3.71it/s]
 76%|███████▌  | 280519/371472 [09:11<7:04:17,  3.57it/s]
 76%|███████▌  | 280520/371472 [09:11<7:04:05,  3.57it/s]
                                                         
{'loss': 2.6839, 'learning_rate': 3.204766316878192e-07, 'epoch': 12.08}

 76%|███████▌  | 280520/371472 [09:11<7:04:05,  3.57it/s]
 76%|███████▌  | 280521/371472 [09:12<6:59:57,  3.61it/s]
 76%|███████▌  | 280522/371472 [09:12<6:51:37,  3.68it/s]
 76%|███████▌  | 280523/371472 [09:12<7:06:07,  3.56it/s]
 76%|███████▌  | 280524/371472 [09:13<6:52:10,  3.68it/s]
 76%|███████▌  | 280525/371472 [09:13<6:55:56,  3.64it/s]
 76%|███████▌  | 280526/371472 [09:13<6:49:03,  3.71it/s]
 76%|███████▌  | 280527/371472 [09:13<6:38:28,  3.80it/s]
 76%|███████▌  | 280528/371472 [09:14<6:37:45,  3.81it/s]
 76%|███████▌  | 280529/371472 [09:14<7:06:25,  3.55it/s]
 76%|███████▌  | 280530/371472 [09:14<6:48:46,  3.71it/s]
 76%|███████▌  | 280531/371472 [09:14<6:39:16,  3.80it/s]
 76%|███████▌  | 280532/371472 [09:15<6:43:29,  3.76it/s]
 76%|███████▌  | 280533/371472 [09:15<7:08:24,  3.54it/s]
 76%|███████▌  | 280534/371472 [09:15<7:29:39,  3.37it/s]
 76%|███████▌  | 280535/371472 [09:16<7:16:34,  3.47it/s]
 76%|███████▌  | 280536/371472 [09:16<7:06:10,  3.56it/s]
 76%|███████▌  | 280537/371472 [09:16<6:50:22,  3.69it/s]
 76%|███████▌  | 280538/371472 [09:16<6:50:20,  3.69it/s]
 76%|███████▌  | 280539/371472 [09:17<6:53:29,  3.67it/s]
 76%|███████▌  | 280540/371472 [09:17<6:47:06,  3.72it/s]
                                                         
{'loss': 2.6462, 'learning_rate': 3.2042814971234023e-07, 'epoch': 12.08}

 76%|███████▌  | 280540/371472 [09:17<6:47:06,  3.72it/s]
 76%|███████▌  | 280541/371472 [09:17<6:40:22,  3.79it/s]
 76%|███████▌  | 280542/371472 [09:17<6:37:18,  3.81it/s]
 76%|███████▌  | 280543/371472 [09:18<7:01:26,  3.60it/s]
 76%|███████▌  | 280544/371472 [09:18<7:02:48,  3.58it/s]
 76%|███████▌  | 280545/371472 [09:18<7:44:40,  3.26it/s]
 76%|███████▌  | 280546/371472 [09:19<7:25:58,  3.40it/s]
 76%|███████▌  | 280547/371472 [09:19<7:28:24,  3.38it/s]
 76%|███████▌  | 280548/371472 [09:19<7:28:40,  3.38it/s]
 76%|███████▌  | 280549/371472 [09:20<7:25:34,  3.40it/s]
 76%|███████▌  | 280550/371472 [09:20<7:09:06,  3.53it/s]
 76%|███████▌  | 280551/371472 [09:20<7:09:47,  3.53it/s]
 76%|███████▌  | 280552/371472 [09:20<7:29:41,  3.37it/s]
 76%|███████▌  | 280553/371472 [09:21<7:13:07,  3.50it/s]
 76%|███████▌  | 280554/371472 [09:21<7:28:00,  3.38it/s]
 76%|███████▌  | 280555/371472 [09:21<7:24:08,  3.41it/s]
 76%|███████▌  | 280556/371472 [09:22<7:17:13,  3.47it/s]
 76%|███████▌  | 280557/371472 [09:22<7:12:59,  3.50it/s]
 76%|███████▌  | 280558/371472 [09:22<7:06:10,  3.56it/s]
 76%|███████▌  | 280559/371472 [09:22<7:33:16,  3.34it/s]
 76%|███████▌  | 280560/371472 [09:23<7:44:50,  3.26it/s]
                                                         
{'loss': 2.5682, 'learning_rate': 3.2037966773686135e-07, 'epoch': 12.08}

 76%|███████▌  | 280560/371472 [09:23<7:44:50,  3.26it/s]
 76%|███████▌  | 280561/371472 [09:23<7:22:26,  3.42it/s]
 76%|███████▌  | 280562/371472 [09:23<6:59:08,  3.61it/s]
 76%|███████▌  | 280563/371472 [09:23<6:46:50,  3.72it/s]
 76%|███████▌  | 280564/371472 [09:24<6:47:30,  3.72it/s]
 76%|███████▌  | 280565/371472 [09:24<6:39:42,  3.79it/s]
 76%|███████▌  | 280566/371472 [09:24<6:42:55,  3.76it/s]
 76%|███████▌  | 280567/371472 [09:25<6:48:27,  3.71it/s]
 76%|███████▌  | 280568/371472 [09:25<6:50:05,  3.69it/s]
 76%|███████▌  | 280569/371472 [09:25<7:55:49,  3.18it/s]
 76%|███████▌  | 280570/371472 [09:26<7:29:00,  3.37it/s]
 76%|███████▌  | 280571/371472 [09:26<7:20:25,  3.44it/s]
 76%|███████▌  | 280572/371472 [09:26<7:27:58,  3.38it/s]
 76%|███████▌  | 280573/371472 [09:26<7:21:46,  3.43it/s]
 76%|███████▌  | 280574/371472 [09:27<7:52:08,  3.21it/s]
 76%|███████▌  | 280575/371472 [09:27<7:51:32,  3.21it/s]
 76%|███████▌  | 280576/371472 [09:27<8:02:24,  3.14it/s]
 76%|███████▌  | 280577/371472 [09:28<7:49:47,  3.22it/s]
 76%|███████▌  | 280578/371472 [09:28<7:25:35,  3.40it/s]
 76%|███████▌  | 280579/371472 [09:28<7:09:53,  3.52it/s]
 76%|███████▌  | 280580/371472 [09:28<6:56:36,  3.64it/s]
                                                         
{'loss': 2.5912, 'learning_rate': 3.203311857613824e-07, 'epoch': 12.09}

 76%|███████▌  | 280580/371472 [09:28<6:56:36,  3.64it/s]
 76%|███████▌  | 280581/371472 [09:29<7:13:38,  3.49it/s]
 76%|███████▌  | 280582/371472 [09:29<7:06:01,  3.56it/s]
 76%|███████▌  | 280583/371472 [09:29<7:13:03,  3.50it/s]
 76%|███████▌  | 280584/371472 [09:30<7:20:32,  3.44it/s]
 76%|███████▌  | 280585/371472 [09:30<7:18:34,  3.45it/s]
 76%|███████▌  | 280586/371472 [09:30<7:37:39,  3.31it/s]
 76%|███████▌  | 280587/371472 [09:30<7:12:25,  3.50it/s]
 76%|███████▌  | 280588/371472 [09:31<7:38:09,  3.31it/s]
 76%|███████▌  | 280589/371472 [09:31<7:31:57,  3.35it/s]
 76%|███████▌  | 280590/371472 [09:31<7:21:06,  3.43it/s]
 76%|███████▌  | 280591/371472 [09:32<7:29:36,  3.37it/s]
 76%|███████▌  | 280592/371472 [09:32<7:16:08,  3.47it/s]
 76%|███████▌  | 280593/371472 [09:32<7:02:15,  3.59it/s]
 76%|███████▌  | 280594/371472 [09:32<6:56:18,  3.64it/s]
 76%|███████▌  | 280595/371472 [09:33<8:05:25,  3.12it/s]
 76%|███████▌  | 280596/371472 [09:33<7:41:12,  3.28it/s]
 76%|███████▌  | 280597/371472 [09:33<7:24:23,  3.41it/s]
 76%|███████▌  | 280598/371472 [09:34<7:38:46,  3.30it/s]
 76%|███████▌  | 280599/371472 [09:34<7:23:30,  3.41it/s]
 76%|███████▌  | 280600/371472 [09:34<7:07:00,  3.55it/s]
                                                         
{'loss': 2.7367, 'learning_rate': 3.202827037859036e-07, 'epoch': 12.09}

 76%|███████▌  | 280600/371472 [09:34<7:07:00,  3.55it/s]
 76%|███████▌  | 280601/371472 [09:35<7:06:43,  3.55it/s]
 76%|███████▌  | 280602/371472 [09:35<7:00:14,  3.60it/s]
 76%|███████▌  | 280603/371472 [09:35<6:50:19,  3.69it/s]
 76%|███████▌  | 280604/371472 [09:35<7:12:01,  3.51it/s]
 76%|███████▌  | 280605/371472 [09:36<7:04:17,  3.57it/s]
 76%|███████▌  | 280606/371472 [09:36<6:53:51,  3.66it/s]
 76%|███████▌  | 280607/371472 [09:36<7:05:12,  3.56it/s]
 76%|███████▌  | 280608/371472 [09:37<7:23:40,  3.41it/s]
 76%|███████▌  | 280609/371472 [09:37<7:24:33,  3.41it/s]
 76%|███████▌  | 280610/371472 [09:37<7:24:20,  3.41it/s]
 76%|███████▌  | 280611/371472 [09:37<7:08:19,  3.54it/s]
 76%|███████▌  | 280612/371472 [09:38<7:01:29,  3.59it/s]
 76%|███████▌  | 280613/371472 [09:38<7:30:04,  3.36it/s]
 76%|███████▌  | 280614/371472 [09:38<7:18:36,  3.45it/s]
 76%|███████▌  | 280615/371472 [09:39<7:01:28,  3.59it/s]
 76%|███████▌  | 280616/371472 [09:39<6:56:47,  3.63it/s]
 76%|███████▌  | 280617/371472 [09:39<6:55:39,  3.64it/s]
 76%|███████▌  | 280618/371472 [09:39<7:03:09,  3.58it/s]
 76%|███████▌  | 280619/371472 [09:40<7:05:31,  3.56it/s]
 76%|███████▌  | 280620/371472 [09:40<6:52:45,  3.67it/s]
                                                         
{'loss': 2.5062, 'learning_rate': 3.202342218104247e-07, 'epoch': 12.09}

 76%|███████▌  | 280620/371472 [09:40<6:52:45,  3.67it/s]
 76%|███████▌  | 280621/371472 [09:40<7:23:46,  3.41it/s]
 76%|███████▌  | 280622/371472 [09:41<7:06:24,  3.55it/s]
 76%|███████▌  | 280623/371472 [09:41<7:18:52,  3.45it/s]
 76%|███████▌  | 280624/371472 [09:41<7:30:51,  3.36it/s]
 76%|███████▌  | 280625/371472 [09:41<7:24:22,  3.41it/s]
 76%|███████▌  | 280626/371472 [09:42<7:11:26,  3.51it/s]
 76%|███████▌  | 280627/371472 [09:42<7:18:44,  3.45it/s]
 76%|███████▌  | 280628/371472 [09:42<7:04:01,  3.57it/s]
 76%|███████▌  | 280629/371472 [09:43<7:32:57,  3.34it/s]
 76%|███████▌  | 280630/371472 [09:43<7:37:28,  3.31it/s]
 76%|███████▌  | 280631/371472 [09:43<7:30:42,  3.36it/s]
 76%|███████▌  | 280632/371472 [09:43<7:14:12,  3.49it/s]
 76%|███████▌  | 280633/371472 [09:44<7:15:27,  3.48it/s]
 76%|███████▌  | 280634/371472 [09:44<7:12:10,  3.50it/s]
 76%|███████▌  | 280635/371472 [09:44<7:43:38,  3.27it/s]
 76%|███████▌  | 280636/371472 [09:45<7:27:29,  3.38it/s]
 76%|███████▌  | 280637/371472 [09:45<7:20:30,  3.44it/s]
 76%|███████▌  | 280638/371472 [09:45<6:59:06,  3.61it/s]
 76%|███████▌  | 280639/371472 [09:45<7:05:48,  3.56it/s]
 76%|███████▌  | 280640/371472 [09:46<7:04:28,  3.57it/s]
                                                         
{'loss': 2.9282, 'learning_rate': 3.2018573983494585e-07, 'epoch': 12.09}

 76%|███████▌  | 280640/371472 [09:46<7:04:28,  3.57it/s]
 76%|███████▌  | 280641/371472 [09:46<7:06:42,  3.55it/s]
 76%|███████▌  | 280642/371472 [09:46<7:09:54,  3.52it/s]
 76%|███████▌  | 280643/371472 [09:47<7:07:15,  3.54it/s]
 76%|███████▌  | 280644/371472 [09:47<6:54:19,  3.65it/s]
 76%|███████▌  | 280645/371472 [09:47<7:19:09,  3.45it/s]
 76%|███████▌  | 280646/371472 [09:47<7:07:53,  3.54it/s]
 76%|███████▌  | 280647/371472 [09:48<7:23:32,  3.41it/s]
 76%|███████▌  | 280648/371472 [09:48<7:17:09,  3.46it/s]
 76%|███████▌  | 280649/371472 [09:48<7:39:00,  3.30it/s]
 76%|███████▌  | 280650/371472 [09:49<7:12:42,  3.50it/s]
 76%|███████▌  | 280651/371472 [09:49<7:09:31,  3.52it/s]
 76%|███████▌  | 280652/371472 [09:49<7:23:47,  3.41it/s]
 76%|███████▌  | 280653/371472 [09:49<7:19:42,  3.44it/s]
 76%|███████▌  | 280654/371472 [09:50<7:33:20,  3.34it/s]
 76%|███████▌  | 280655/371472 [09:50<7:42:15,  3.27it/s]
 76%|███████▌  | 280656/371472 [09:50<7:31:39,  3.35it/s]
 76%|███████▌  | 280657/371472 [09:51<7:14:45,  3.48it/s]
 76%|███████▌  | 280658/371472 [09:51<6:57:51,  3.62it/s]
 76%|███████▌  | 280659/371472 [09:51<7:00:22,  3.60it/s]
 76%|███████▌  | 280660/371472 [09:51<6:59:20,  3.61it/s]
                                                         
{'loss': 2.5171, 'learning_rate': 3.2013725785946687e-07, 'epoch': 12.09}

 76%|███████▌  | 280660/371472 [09:51<6:59:20,  3.61it/s]
 76%|███████▌  | 280661/371472 [09:52<6:49:49,  3.69it/s]
 76%|███████▌  | 280662/371472 [09:52<6:51:48,  3.68it/s]
 76%|███████▌  | 280663/371472 [09:52<6:56:34,  3.63it/s]
 76%|███████▌  | 280664/371472 [09:53<7:04:00,  3.57it/s]
 76%|███████▌  | 280665/371472 [09:53<7:17:46,  3.46it/s]
 76%|███████▌  | 280666/371472 [09:53<7:09:28,  3.52it/s]
 76%|███████▌  | 280667/371472 [09:53<7:00:43,  3.60it/s]
 76%|███████▌  | 280668/371472 [09:54<6:56:03,  3.64it/s]
 76%|███████▌  | 280669/371472 [09:54<6:55:37,  3.64it/s]
 76%|███████▌  | 280670/371472 [09:54<7:05:37,  3.56it/s]
 76%|███████▌  | 280671/371472 [09:55<7:01:30,  3.59it/s]
 76%|███████▌  | 280672/371472 [09:55<6:55:18,  3.64it/s]
 76%|███████▌  | 280673/371472 [09:55<6:46:28,  3.72it/s]
 76%|███████▌  | 280674/371472 [09:55<7:34:56,  3.33it/s]
 76%|███████▌  | 280675/371472 [09:56<7:21:01,  3.43it/s]
 76%|███████▌  | 280676/371472 [09:56<7:18:09,  3.45it/s]
 76%|███████▌  | 280677/371472 [09:56<7:21:33,  3.43it/s]
 76%|███████▌  | 280678/371472 [09:57<7:21:32,  3.43it/s]
 76%|███████▌  | 280679/371472 [09:57<7:18:32,  3.45it/s]
 76%|███████▌  | 280680/371472 [09:57<7:08:42,  3.53it/s]
                                                         
{'loss': 2.6362, 'learning_rate': 3.2008877588398805e-07, 'epoch': 12.09}

 76%|███████▌  | 280680/371472 [09:57<7:08:42,  3.53it/s]
 76%|███████▌  | 280681/371472 [09:57<7:08:08,  3.53it/s]
 76%|███████▌  | 280682/371472 [09:58<7:16:29,  3.47it/s]
 76%|███████▌  | 280683/371472 [09:58<6:55:31,  3.64it/s]
 76%|███████▌  | 280684/371472 [09:58<7:15:44,  3.47it/s]
 76%|███████▌  | 280685/371472 [09:59<7:07:56,  3.54it/s]
 76%|███████▌  | 280686/371472 [09:59<7:40:25,  3.29it/s]
 76%|███████▌  | 280687/371472 [09:59<7:26:03,  3.39it/s]
 76%|███████▌  | 280688/371472 [09:59<7:23:48,  3.41it/s]
 76%|███████▌  | 280689/371472 [10:00<7:17:13,  3.46it/s]
 76%|███████▌  | 280690/371472 [10:00<7:09:46,  3.52it/s]
 76%|███████▌  | 280691/371472 [10:00<7:20:22,  3.44it/s]
 76%|███████▌  | 280692/371472 [10:01<7:07:22,  3.54it/s]
 76%|███████▌  | 280693/371472 [10:01<7:57:38,  3.17it/s]
 76%|███████▌  | 280694/371472 [10:01<8:11:52,  3.08it/s]
 76%|███████▌  | 280695/371472 [10:02<7:50:11,  3.22it/s]
 76%|███████▌  | 280696/371472 [10:02<7:33:24,  3.34it/s]
 76%|███████▌  | 280697/371472 [10:02<7:30:17,  3.36it/s]
 76%|███████▌  | 280698/371472 [10:02<7:12:42,  3.50it/s]
 76%|███████▌  | 280699/371472 [10:03<7:02:13,  3.58it/s]
 76%|███████▌  | 280700/371472 [10:03<7:13:03,  3.49it/s]
                                                         
{'loss': 2.5138, 'learning_rate': 3.2004029390850907e-07, 'epoch': 12.09}

 76%|███████▌  | 280700/371472 [10:03<7:13:03,  3.49it/s]
 76%|███████▌  | 280701/371472 [10:03<7:01:53,  3.59it/s]
 76%|███████▌  | 280702/371472 [10:04<7:29:25,  3.37it/s]
 76%|███████▌  | 280703/371472 [10:04<7:45:30,  3.25it/s]
 76%|███████▌  | 280704/371472 [10:04<7:30:08,  3.36it/s]
 76%|███████▌  | 280705/371472 [10:05<7:47:14,  3.24it/s]
 76%|███████▌  | 280706/371472 [10:05<7:28:10,  3.38it/s]
 76%|███████▌  | 280707/371472 [10:05<7:21:35,  3.43it/s]
 76%|███████▌  | 280708/371472 [10:05<7:03:09,  3.57it/s]
 76%|███████▌  | 280709/371472 [10:06<7:23:42,  3.41it/s]
 76%|███████▌  | 280710/371472 [10:06<6:59:26,  3.61it/s]
 76%|███████▌  | 280711/371472 [10:06<7:23:33,  3.41it/s]
 76%|███████▌  | 280712/371472 [10:07<8:04:18,  3.12it/s]
 76%|███████▌  | 280713/371472 [10:07<7:38:20,  3.30it/s]
 76%|███████▌  | 280714/371472 [10:07<7:33:02,  3.34it/s]
 76%|███████▌  | 280715/371472 [10:08<7:56:37,  3.17it/s]
 76%|███████▌  | 280716/371472 [10:08<7:36:28,  3.31it/s]
 76%|███████▌  | 280717/371472 [10:08<7:37:47,  3.30it/s]
 76%|███████▌  | 280718/371472 [10:08<7:20:34,  3.43it/s]
 76%|███████▌  | 280719/371472 [10:09<7:13:26,  3.49it/s]
 76%|███████▌  | 280720/371472 [10:09<7:17:36,  3.46it/s]
                                                         
{'loss': 2.3689, 'learning_rate': 3.1999181193303024e-07, 'epoch': 12.09}

 76%|███████▌  | 280720/371472 [10:09<7:17:36,  3.46it/s]
 76%|███████▌  | 280721/371472 [10:09<7:16:19,  3.47it/s]
 76%|███████▌  | 280722/371472 [10:09<7:00:42,  3.60it/s]
 76%|███████▌  | 280723/371472 [10:10<6:57:21,  3.62it/s]
 76%|███████▌  | 280724/371472 [10:10<6:51:51,  3.67it/s]
 76%|███████▌  | 280725/371472 [10:10<6:57:42,  3.62it/s]
 76%|███████▌  | 280726/371472 [10:11<7:02:00,  3.58it/s]
 76%|███████▌  | 280727/371472 [10:11<6:59:12,  3.61it/s]
 76%|███████▌  | 280728/371472 [10:11<6:57:01,  3.63it/s]
 76%|███████▌  | 280729/371472 [10:11<6:46:32,  3.72it/s]
 76%|███████▌  | 280730/371472 [10:12<7:07:18,  3.54it/s]
 76%|███████▌  | 280731/371472 [10:12<7:53:47,  3.19it/s]
 76%|███████▌  | 280732/371472 [10:12<7:49:40,  3.22it/s]
 76%|███████▌  | 280733/371472 [10:13<7:53:16,  3.20it/s]
 76%|███████▌  | 280734/371472 [10:13<7:47:58,  3.23it/s]
 76%|███████▌  | 280735/371472 [10:13<7:35:45,  3.32it/s]
 76%|███████▌  | 280736/371472 [10:14<7:21:32,  3.42it/s]
 76%|███████▌  | 280737/371472 [10:14<7:10:56,  3.51it/s]
 76%|███████▌  | 280738/371472 [10:14<6:56:35,  3.63it/s]
 76%|███████▌  | 280739/371472 [10:14<6:43:39,  3.75it/s]
 76%|███████▌  | 280740/371472 [10:15<6:56:03,  3.63it/s]
                                                         
{'loss': 2.673, 'learning_rate': 3.199433299575513e-07, 'epoch': 12.09}

 76%|███████▌  | 280740/371472 [10:15<6:56:03,  3.63it/s]
 76%|███████▌  | 280741/371472 [10:15<6:53:28,  3.66it/s]
 76%|███████▌  | 280742/371472 [10:15<6:52:07,  3.67it/s]
 76%|███████▌  | 280743/371472 [10:15<6:40:00,  3.78it/s]
 76%|███████▌  | 280744/371472 [10:16<6:48:59,  3.70it/s]
 76%|███████▌  | 280745/371472 [10:16<7:02:11,  3.58it/s]
 76%|███████▌  | 280746/371472 [10:16<7:15:38,  3.47it/s]
 76%|███████▌  | 280747/371472 [10:17<6:59:02,  3.61it/s]
 76%|███████▌  | 280748/371472 [10:17<7:00:56,  3.59it/s]
 76%|███████▌  | 280749/371472 [10:17<6:53:39,  3.66it/s]
 76%|███████▌  | 280750/371472 [10:17<6:55:10,  3.64it/s]
 76%|███████▌  | 280751/371472 [10:18<6:43:32,  3.75it/s]
 76%|███████▌  | 280752/371472 [10:18<7:06:57,  3.54it/s]
 76%|███████▌  | 280753/371472 [10:18<7:42:25,  3.27it/s]
 76%|███████▌  | 280754/371472 [10:19<7:19:07,  3.44it/s]
 76%|███████▌  | 280755/371472 [10:19<7:08:05,  3.53it/s]
 76%|███████▌  | 280756/371472 [10:19<6:59:36,  3.60it/s]
 76%|███████▌  | 280757/371472 [10:20<8:09:45,  3.09it/s]
 76%|███████▌  | 280758/371472 [10:20<8:01:45,  3.14it/s]
 76%|███████▌  | 280759/371472 [10:20<8:07:37,  3.10it/s]
 76%|███████▌  | 280760/371472 [10:20<7:39:12,  3.29it/s]
                                                         
{'loss': 2.7552, 'learning_rate': 3.198948479820725e-07, 'epoch': 12.09}

 76%|███████▌  | 280760/371472 [10:20<7:39:12,  3.29it/s]
 76%|███████▌  | 280761/371472 [10:21<7:30:53,  3.35it/s]
 76%|███████▌  | 280762/371472 [10:21<7:39:12,  3.29it/s]
 76%|███████▌  | 280763/371472 [10:21<7:30:05,  3.36it/s]
 76%|███████▌  | 280764/371472 [10:22<7:21:02,  3.43it/s]
 76%|███████▌  | 280765/371472 [10:22<7:04:07,  3.56it/s]
 76%|███████▌  | 280766/371472 [10:22<7:02:03,  3.58it/s]
 76%|███████▌  | 280767/371472 [10:22<6:45:16,  3.73it/s]
 76%|███████▌  | 280768/371472 [10:23<6:55:38,  3.64it/s]
 76%|███████▌  | 280769/371472 [10:23<7:06:00,  3.55it/s]
 76%|███████▌  | 280770/371472 [10:23<7:38:07,  3.30it/s]
 76%|███████▌  | 280771/371472 [10:24<7:33:37,  3.33it/s]
 76%|███████▌  | 280772/371472 [10:24<7:20:17,  3.43it/s]
 76%|███████▌  | 280773/371472 [10:24<7:30:58,  3.35it/s]
 76%|███████▌  | 280774/371472 [10:24<7:26:46,  3.38it/s]
 76%|███████▌  | 280775/371472 [10:25<7:09:29,  3.52it/s]
 76%|███████▌  | 280776/371472 [10:25<7:17:40,  3.45it/s]
 76%|███████▌  | 280777/371472 [10:25<7:10:02,  3.51it/s]
 76%|███████▌  | 280778/371472 [10:26<7:09:49,  3.52it/s]
 76%|███████▌  | 280779/371472 [10:26<7:24:25,  3.40it/s]
 76%|███████▌  | 280780/371472 [10:26<7:44:28,  3.25it/s]
                                                         
{'loss': 2.6517, 'learning_rate': 3.198463660065935e-07, 'epoch': 12.09}

 76%|███████▌  | 280780/371472 [10:26<7:44:28,  3.25it/s]
 76%|███████▌  | 280781/371472 [10:27<7:31:55,  3.34it/s]
 76%|███████▌  | 280782/371472 [10:27<7:24:15,  3.40it/s]
 76%|███████▌  | 280783/371472 [10:27<7:07:56,  3.53it/s]
 76%|███████▌  | 280784/371472 [10:27<7:01:14,  3.59it/s]
 76%|███████▌  | 280785/371472 [10:28<7:13:08,  3.49it/s]
 76%|███████▌  | 280786/371472 [10:28<7:14:55,  3.48it/s]
 76%|███████▌  | 280787/371472 [10:28<7:02:18,  3.58it/s]
 76%|███████▌  | 280788/371472 [10:28<6:48:03,  3.70it/s]
 76%|███████▌  | 280789/371472 [10:29<6:49:17,  3.69it/s]
 76%|███████▌  | 280790/371472 [10:29<6:46:47,  3.72it/s]
 76%|███████▌  | 280791/371472 [10:29<6:50:58,  3.68it/s]
 76%|███████▌  | 280792/371472 [10:30<6:48:54,  3.70it/s]
 76%|███████▌  | 280793/371472 [10:30<6:53:50,  3.65it/s]
 76%|███████▌  | 280794/371472 [10:30<7:00:04,  3.60it/s]
 76%|███████▌  | 280795/371472 [10:30<6:58:40,  3.61it/s]
 76%|███████▌  | 280796/371472 [10:31<7:46:31,  3.24it/s]
 76%|███████▌  | 280797/371472 [10:31<7:23:09,  3.41it/s]
 76%|███████▌  | 280798/371472 [10:31<7:20:54,  3.43it/s]
 76%|███████▌  | 280799/371472 [10:32<7:13:08,  3.49it/s]
 76%|███████▌  | 280800/371472 [10:32<7:12:07,  3.50it/s]
                                                         
{'loss': 2.6466, 'learning_rate': 3.197978840311147e-07, 'epoch': 12.09}

 76%|███████▌  | 280800/371472 [10:32<7:12:07,  3.50it/s]
 76%|███████▌  | 280801/371472 [10:32<7:22:03,  3.42it/s]
 76%|███████▌  | 280802/371472 [10:32<7:23:40,  3.41it/s]
 76%|███████▌  | 280803/371472 [10:33<7:42:07,  3.27it/s]
 76%|███████▌  | 280804/371472 [10:33<7:25:22,  3.39it/s]
 76%|███████▌  | 280805/371472 [10:33<7:32:33,  3.34it/s]
 76%|███████▌  | 280806/371472 [10:34<7:18:03,  3.45it/s]
 76%|███████▌  | 280807/371472 [10:34<7:11:46,  3.50it/s]
 76%|███████▌  | 280808/371472 [10:34<7:24:29,  3.40it/s]
 76%|███████▌  | 280809/371472 [10:35<7:49:58,  3.22it/s]
 76%|███████▌  | 280810/371472 [10:35<7:41:21,  3.28it/s]
 76%|███████▌  | 280811/371472 [10:35<7:33:15,  3.33it/s]
 76%|███████▌  | 280812/371472 [10:35<7:20:31,  3.43it/s]
 76%|███████▌  | 280813/371472 [10:36<7:51:33,  3.20it/s]
 76%|███████▌  | 280814/371472 [10:36<7:53:19,  3.19it/s]
 76%|███████▌  | 280815/371472 [10:36<7:33:49,  3.33it/s]
 76%|███████▌  | 280816/371472 [10:37<7:03:22,  3.57it/s]
 76%|███████▌  | 280817/371472 [10:37<6:59:50,  3.60it/s]
 76%|███████▌  | 280818/371472 [10:37<7:12:40,  3.49it/s]
 76%|███████▌  | 280819/371472 [10:37<7:21:48,  3.42it/s]
 76%|███████▌  | 280820/371472 [10:38<7:27:33,  3.38it/s]
                                                         
{'loss': 2.4338, 'learning_rate': 3.197494020556357e-07, 'epoch': 12.1}

 76%|███████▌  | 280820/371472 [10:38<7:27:33,  3.38it/s]
 76%|███████▌  | 280821/371472 [10:38<7:22:06,  3.42it/s]
 76%|███████▌  | 280822/371472 [10:38<7:26:34,  3.38it/s]
 76%|███████▌  | 280823/371472 [10:39<7:04:11,  3.56it/s]
 76%|███████▌  | 280824/371472 [10:39<7:11:27,  3.50it/s]
 76%|███████▌  | 280825/371472 [10:39<7:01:53,  3.58it/s]
 76%|███████▌  | 280826/371472 [10:40<7:32:58,  3.34it/s]
 76%|███████▌  | 280827/371472 [10:40<7:44:36,  3.25it/s]
 76%|███████▌  | 280828/371472 [10:40<7:28:08,  3.37it/s]
 76%|███████▌  | 280829/371472 [10:40<7:28:18,  3.37it/s]
 76%|███████▌  | 280830/371472 [10:41<7:16:20,  3.46it/s]
 76%|███████▌  | 280831/371472 [10:41<7:10:54,  3.51it/s]
 76%|███████▌  | 280832/371472 [10:41<6:52:50,  3.66it/s]
 76%|███████▌  | 280833/371472 [10:41<6:51:35,  3.67it/s]
 76%|███████▌  | 280834/371472 [10:42<7:00:02,  3.60it/s]
 76%|███████▌  | 280835/371472 [10:42<7:21:42,  3.42it/s]
 76%|███████▌  | 280836/371472 [10:42<7:11:40,  3.50it/s]
 76%|███████▌  | 280837/371472 [10:43<6:55:59,  3.63it/s]
 76%|███████▌  | 280838/371472 [10:43<7:00:43,  3.59it/s]
 76%|███████▌  | 280839/371472 [10:43<7:52:05,  3.20it/s]
 76%|███████▌  | 280840/371472 [10:44<7:40:02,  3.28it/s]
                                                         
{'loss': 2.7102, 'learning_rate': 3.197009200801569e-07, 'epoch': 12.1}

 76%|███████▌  | 280840/371472 [10:44<7:40:02,  3.28it/s]
 76%|███████▌  | 280841/371472 [10:44<7:27:42,  3.37it/s]
 76%|███████▌  | 280842/371472 [10:44<7:33:30,  3.33it/s]
 76%|███████▌  | 280843/371472 [10:44<7:20:58,  3.43it/s]
 76%|███████▌  | 280844/371472 [10:45<7:24:45,  3.40it/s]
 76%|███████▌  | 280845/371472 [10:45<7:20:18,  3.43it/s]
 76%|███████▌  | 280846/371472 [10:45<7:13:15,  3.49it/s]
 76%|███████▌  | 280847/371472 [10:46<7:11:15,  3.50it/s]
 76%|███████▌  | 280848/371472 [10:46<7:32:18,  3.34it/s]
 76%|███████▌  | 280849/371472 [10:46<7:26:02,  3.39it/s]
 76%|███████▌  | 280850/371472 [10:46<7:14:01,  3.48it/s]
 76%|███████▌  | 280851/371472 [10:47<7:47:10,  3.23it/s]
 76%|███████▌  | 280852/371472 [10:47<7:26:53,  3.38it/s]
 76%|███████▌  | 280853/371472 [10:47<7:20:34,  3.43it/s]
 76%|███████▌  | 280854/371472 [10:48<7:03:49,  3.56it/s]
 76%|███████▌  | 280855/371472 [10:48<7:10:26,  3.51it/s]
 76%|███████▌  | 280856/371472 [10:48<6:59:15,  3.60it/s]
 76%|███████▌  | 280857/371472 [10:49<7:16:36,  3.46it/s]
 76%|███████▌  | 280858/371472 [10:49<7:34:20,  3.32it/s]
 76%|███████▌  | 280859/371472 [10:49<7:17:23,  3.45it/s]
 76%|███████▌  | 280860/371472 [10:49<7:28:17,  3.37it/s]
                                                         
{'loss': 2.5105, 'learning_rate': 3.1965243810467796e-07, 'epoch': 12.1}

 76%|███████▌  | 280860/371472 [10:49<7:28:17,  3.37it/s]
 76%|███████▌  | 280861/371472 [10:50<8:12:29,  3.07it/s]
 76%|███████▌  | 280862/371472 [10:50<7:51:55,  3.20it/s]
 76%|███████▌  | 280863/371472 [10:50<7:37:06,  3.30it/s]
 76%|███████▌  | 280864/371472 [10:51<7:12:10,  3.49it/s]
 76%|███████▌  | 280865/371472 [10:51<6:55:49,  3.63it/s]
 76%|███████▌  | 280866/371472 [10:51<6:45:42,  3.72it/s]
 76%|███████▌  | 280867/371472 [10:51<6:57:19,  3.62it/s]
 76%|███████▌  | 280868/371472 [10:52<7:20:38,  3.43it/s]
 76%|███████▌  | 280869/371472 [10:52<7:29:25,  3.36it/s]
 76%|███████▌  | 280870/371472 [10:52<7:15:29,  3.47it/s]
 76%|███████▌  | 280871/371472 [10:53<7:15:52,  3.46it/s]
 76%|███████▌  | 280872/371472 [10:53<7:04:46,  3.55it/s]
 76%|███████▌  | 280873/371472 [10:53<6:52:40,  3.66it/s]
 76%|███████▌  | 280874/371472 [10:53<6:51:42,  3.67it/s]
 76%|███████▌  | 280875/371472 [10:54<6:59:06,  3.60it/s]
 76%|███████▌  | 280876/371472 [10:54<6:55:36,  3.63it/s]
 76%|███████▌  | 280877/371472 [10:54<7:58:07,  3.16it/s]
 76%|███████▌  | 280878/371472 [10:55<7:47:26,  3.23it/s]
 76%|███████▌  | 280879/371472 [10:55<7:29:34,  3.36it/s]
 76%|███████▌  | 280880/371472 [10:55<7:45:14,  3.25it/s]
                                                         
{'loss': 2.6428, 'learning_rate': 3.1960395612919903e-07, 'epoch': 12.1}

 76%|███████▌  | 280880/371472 [10:55<7:45:14,  3.25it/s]
 76%|███████▌  | 280881/371472 [10:56<8:02:37,  3.13it/s]
 76%|███████▌  | 280882/371472 [10:56<8:18:07,  3.03it/s]
 76%|███████▌  | 280883/371472 [10:56<8:10:55,  3.08it/s]
 76%|███████▌  | 280884/371472 [10:57<7:46:55,  3.23it/s]
 76%|███████▌  | 280885/371472 [10:57<7:45:23,  3.24it/s]
 76%|███████▌  | 280886/371472 [10:57<7:33:23,  3.33it/s]
 76%|███████▌  | 280887/371472 [10:57<7:29:10,  3.36it/s]
 76%|███████▌  | 280888/371472 [10:58<7:17:31,  3.45it/s]
 76%|███████▌  | 280889/371472 [10:58<7:40:50,  3.28it/s]
 76%|███████▌  | 280890/371472 [10:58<7:30:08,  3.35it/s]
 76%|███████▌  | 280891/371472 [10:59<7:12:42,  3.49it/s]
 76%|███████▌  | 280892/371472 [10:59<6:59:42,  3.60it/s]
 76%|███████▌  | 280893/371472 [10:59<7:20:02,  3.43it/s]
 76%|███████▌  | 280894/371472 [10:59<7:08:40,  3.52it/s]
 76%|███████▌  | 280895/371472 [11:00<7:03:27,  3.56it/s]
 76%|███████▌  | 280896/371472 [11:00<6:51:01,  3.67it/s]
 76%|███████▌  | 280897/371472 [11:00<6:45:50,  3.72it/s]
 76%|███████▌  | 280898/371472 [11:01<6:54:44,  3.64it/s]
 76%|███████▌  | 280899/371472 [11:01<7:32:33,  3.34it/s]
 76%|███████▌  | 280900/371472 [11:01<7:45:17,  3.24it/s]
                                                         
{'loss': 2.5714, 'learning_rate': 3.195554741537202e-07, 'epoch': 12.1}

 76%|███████▌  | 280900/371472 [11:01<7:45:17,  3.24it/s]
 76%|███████▌  | 280901/371472 [11:01<7:26:27,  3.38it/s]
 76%|███████▌  | 280902/371472 [11:02<7:01:19,  3.58it/s]
 76%|███████▌  | 280903/371472 [11:02<7:01:47,  3.58it/s]
 76%|███████▌  | 280904/371472 [11:02<7:01:15,  3.58it/s]
 76%|███████▌  | 280905/371472 [11:03<7:10:09,  3.51it/s]
 76%|███████▌  | 280906/371472 [11:03<7:13:08,  3.48it/s]
 76%|███████▌  | 280907/371472 [11:03<7:04:47,  3.55it/s]
 76%|███████▌  | 280908/371472 [11:03<7:08:32,  3.52it/s]
 76%|███████▌  | 280909/371472 [11:04<7:03:54,  3.56it/s]
 76%|███████▌  | 280910/371472 [11:04<6:51:16,  3.67it/s]
 76%|███████▌  | 280911/371472 [11:04<6:48:02,  3.70it/s]
 76%|███████▌  | 280912/371472 [11:05<7:10:17,  3.51it/s]
 76%|███████▌  | 280913/371472 [11:05<7:09:05,  3.52it/s]
 76%|███████▌  | 280914/371472 [11:05<7:14:19,  3.48it/s]
 76%|███████▌  | 280915/371472 [11:05<7:02:07,  3.58it/s]
 76%|███████▌  | 280916/371472 [11:06<6:59:34,  3.60it/s]
 76%|███████▌  | 280917/371472 [11:06<7:02:59,  3.57it/s]
 76%|███████▌  | 280918/371472 [11:06<7:59:03,  3.15it/s]
 76%|███████▌  | 280919/371472 [11:07<8:06:35,  3.10it/s]
 76%|███████▌  | 280920/371472 [11:07<7:33:15,  3.33it/s]
                                                         
{'loss': 2.7273, 'learning_rate': 3.195069921782412e-07, 'epoch': 12.1}

 76%|███████▌  | 280920/371472 [11:07<7:33:15,  3.33it/s]
 76%|███████▌  | 280921/371472 [11:07<7:25:46,  3.39it/s]
 76%|███████▌  | 280922/371472 [11:08<7:42:38,  3.26it/s]
 76%|███████▌  | 280923/371472 [11:08<7:55:07,  3.18it/s]
 76%|███████▌  | 280924/371472 [11:08<7:47:06,  3.23it/s]
 76%|███████▌  | 280925/371472 [11:08<7:24:24,  3.40it/s]
 76%|███████▌  | 280926/371472 [11:09<7:29:33,  3.36it/s]
 76%|███████▌  | 280927/371472 [11:09<7:12:18,  3.49it/s]
 76%|███████▌  | 280928/371472 [11:09<6:58:49,  3.60it/s]
 76%|███████▌  | 280929/371472 [11:10<7:45:51,  3.24it/s]
 76%|███████▌  | 280930/371472 [11:10<7:27:36,  3.37it/s]
 76%|███████▌  | 280931/371472 [11:10<7:26:14,  3.38it/s]
 76%|███████▌  | 280932/371472 [11:10<7:15:40,  3.46it/s]
 76%|███████▌  | 280933/371472 [11:11<7:10:22,  3.51it/s]
 76%|███████▌  | 280934/371472 [11:11<7:04:00,  3.56it/s]
 76%|███████▌  | 280935/371472 [11:11<7:45:50,  3.24it/s]
 76%|███████▌  | 280936/371472 [11:12<7:22:10,  3.41it/s]
 76%|███████▌  | 280937/371472 [11:12<10:25:30,  2.41it/s]
 76%|███████▌  | 280938/371472 [11:13<9:29:17,  2.65it/s] 
 76%|███████▌  | 280939/371472 [11:13<9:01:28,  2.79it/s]
 76%|███████▌  | 280940/371472 [11:13<8:18:38,  3.03it/s]
                                                         
{'loss': 2.731, 'learning_rate': 3.194585102027624e-07, 'epoch': 12.1}

 76%|███████▌  | 280940/371472 [11:13<8:18:38,  3.03it/s]
 76%|███████▌  | 280941/371472 [11:13<7:43:27,  3.26it/s]
 76%|███████▌  | 280942/371472 [11:14<7:27:25,  3.37it/s]
 76%|███████▌  | 280943/371472 [11:14<7:11:32,  3.50it/s]
 76%|███████▌  | 280944/371472 [11:14<7:24:35,  3.39it/s]
 76%|███████▌  | 280945/371472 [11:15<7:09:51,  3.51it/s]
 76%|███████▌  | 280946/371472 [11:15<7:25:09,  3.39it/s]
 76%|███████▌  | 280947/371472 [11:15<7:26:35,  3.38it/s]
 76%|███████▌  | 280948/371472 [11:15<7:19:19,  3.43it/s]
 76%|███████▌  | 280949/371472 [11:16<7:26:34,  3.38it/s]
 76%|███████▌  | 280950/371472 [11:16<7:39:07,  3.29it/s]
 76%|███████▌  | 280951/371472 [11:16<7:13:11,  3.48it/s]
 76%|███████▌  | 280952/371472 [11:17<6:59:42,  3.59it/s]
 76%|███████▌  | 280953/371472 [11:17<7:24:36,  3.39it/s]
 76%|███████▌  | 280954/371472 [11:17<7:44:56,  3.24it/s]
 76%|███████▌  | 280955/371472 [11:18<7:38:21,  3.29it/s]
 76%|███████▌  | 280956/371472 [11:18<7:15:50,  3.46it/s]
 76%|███████▌  | 280957/371472 [11:18<7:27:32,  3.37it/s]
 76%|███████▌  | 280958/371472 [11:18<7:18:00,  3.44it/s]
 76%|███████▌  | 280959/371472 [11:19<7:21:28,  3.42it/s]
 76%|███████▌  | 280960/371472 [11:19<7:34:38,  3.32it/s]
                                                         
{'loss': 2.7161, 'learning_rate': 3.194100282272834e-07, 'epoch': 12.1}

 76%|███████▌  | 280960/371472 [11:19<7:34:38,  3.32it/s]
 76%|███████▌  | 280961/371472 [11:19<7:32:37,  3.33it/s]
 76%|███████▌  | 280962/371472 [11:20<7:30:29,  3.35it/s]
 76%|███████▌  | 280963/371472 [11:20<7:21:21,  3.42it/s]
 76%|███████▌  | 280964/371472 [11:20<7:12:23,  3.49it/s]
 76%|███████▌  | 280965/371472 [11:20<7:18:18,  3.44it/s]
 76%|███████▌  | 280966/371472 [11:21<7:20:00,  3.43it/s]
 76%|███████▌  | 280967/371472 [11:21<6:57:18,  3.61it/s]
 76%|███████▌  | 280968/371472 [11:21<6:58:41,  3.60it/s]
 76%|███████▌  | 280969/371472 [11:22<7:03:54,  3.56it/s]
 76%|███████▌  | 280970/371472 [11:22<6:57:35,  3.61it/s]
 76%|███████▌  | 280971/371472 [11:22<7:00:49,  3.58it/s]
 76%|███████▌  | 280972/371472 [11:22<6:55:46,  3.63it/s]
 76%|███████▌  | 280973/371472 [11:23<6:44:58,  3.72it/s]
 76%|███████▌  | 280974/371472 [11:23<6:56:14,  3.62it/s]
 76%|███████▌  | 280975/371472 [11:23<7:01:51,  3.58it/s]
 76%|███████▌  | 280976/371472 [11:23<6:48:10,  3.70it/s]
 76%|███████▌  | 280977/371472 [11:24<7:02:01,  3.57it/s]
 76%|███████▌  | 280978/371472 [11:24<7:01:57,  3.57it/s]
 76%|███████▌  | 280979/371472 [11:24<7:00:46,  3.58it/s]
 76%|███████▌  | 280980/371472 [11:25<6:59:07,  3.60it/s]
                                                         
{'loss': 2.7277, 'learning_rate': 3.193615462518046e-07, 'epoch': 12.1}

 76%|███████▌  | 280980/371472 [11:25<6:59:07,  3.60it/s]
 76%|███████▌  | 280981/371472 [11:25<6:49:02,  3.69it/s]
 76%|███████▌  | 280982/371472 [11:25<6:37:07,  3.80it/s]
 76%|███████▌  | 280983/371472 [11:25<7:09:02,  3.52it/s]
 76%|███████▌  | 280984/371472 [11:26<7:11:34,  3.49it/s]
 76%|███████▌  | 280985/371472 [11:26<7:18:13,  3.44it/s]
 76%|███████▌  | 280986/371472 [11:26<7:16:28,  3.46it/s]
 76%|███████▌  | 280987/371472 [11:27<7:07:15,  3.53it/s]
 76%|███████▌  | 280988/371472 [11:27<6:55:28,  3.63it/s]
 76%|███████▌  | 280989/371472 [11:27<6:56:45,  3.62it/s]
 76%|███████▌  | 280990/371472 [11:27<6:55:33,  3.63it/s]
 76%|███████▌  | 280991/371472 [11:28<7:03:28,  3.56it/s]
 76%|███████▌  | 280992/371472 [11:28<7:03:22,  3.56it/s]
 76%|███████▌  | 280993/371472 [11:28<7:13:16,  3.48it/s]
 76%|███████▌  | 280994/371472 [11:29<7:24:59,  3.39it/s]
 76%|███████▌  | 280995/371472 [11:29<7:30:03,  3.35it/s]
 76%|███████▌  | 280996/371472 [11:29<7:09:04,  3.51it/s]
 76%|███████▌  | 280997/371472 [11:29<7:07:26,  3.53it/s]
 76%|███████▌  | 280998/371472 [11:30<7:05:56,  3.54it/s]
 76%|███████▌  | 280999/371472 [11:30<7:04:33,  3.55it/s]
 76%|███████▌  | 281000/371472 [11:30<6:48:17,  3.69it/s]
                                                         
{'loss': 2.7404, 'learning_rate': 3.1931306427632567e-07, 'epoch': 12.1}

 76%|███████▌  | 281000/371472 [11:30<6:48:17,  3.69it/s]
 76%|███████▌  | 281001/371472 [11:31<6:45:19,  3.72it/s]
 76%|███████▌  | 281002/371472 [11:31<6:34:07,  3.83it/s]
 76%|███████▌  | 281003/371472 [11:31<6:26:11,  3.90it/s]
 76%|███████▌  | 281004/371472 [11:31<6:29:53,  3.87it/s]
 76%|███████▌  | 281005/371472 [11:32<6:52:39,  3.65it/s]
 76%|███████▌  | 281006/371472 [11:32<7:10:19,  3.50it/s]
 76%|███████▌  | 281007/371472 [11:32<7:49:28,  3.21it/s]
 76%|███████▌  | 281008/371472 [11:33<7:35:38,  3.31it/s]
 76%|███████▌  | 281009/371472 [11:33<8:04:28,  3.11it/s]
 76%|███████▌  | 281010/371472 [11:33<7:34:54,  3.31it/s]
 76%|███████▌  | 281011/371472 [11:33<7:47:09,  3.23it/s]
 76%|███████▌  | 281012/371472 [11:34<7:37:22,  3.30it/s]
 76%|███████▌  | 281013/371472 [11:34<7:11:00,  3.50it/s]
 76%|███████▌  | 281014/371472 [11:34<7:21:12,  3.42it/s]
 76%|███████▌  | 281015/371472 [11:35<7:18:16,  3.44it/s]
 76%|███████▌  | 281016/371472 [11:35<7:05:12,  3.55it/s]
 76%|███████▌  | 281017/371472 [11:35<6:53:59,  3.64it/s]
 76%|███████▌  | 281018/371472 [11:35<7:06:58,  3.53it/s]
 76%|███████▌  | 281019/371472 [11:36<6:47:51,  3.70it/s]
 76%|███████▌  | 281020/371472 [11:36<6:41:53,  3.75it/s]
                                                         
{'loss': 2.7515, 'learning_rate': 3.1926458230084685e-07, 'epoch': 12.1}

 76%|███████▌  | 281020/371472 [11:36<6:41:53,  3.75it/s]
 76%|███████▌  | 281021/371472 [11:36<6:55:39,  3.63it/s]
 76%|███████▌  | 281022/371472 [11:37<7:25:56,  3.38it/s]
 76%|███████▌  | 281023/371472 [11:37<7:50:31,  3.20it/s]
 76%|███████▌  | 281024/371472 [11:37<7:53:33,  3.18it/s]
 76%|███████▌  | 281025/371472 [11:38<7:41:56,  3.26it/s]
 76%|███████▌  | 281026/371472 [11:38<7:13:34,  3.48it/s]
 76%|███████▌  | 281027/371472 [11:38<7:00:53,  3.58it/s]
 76%|███████▌  | 281028/371472 [11:38<7:06:13,  3.54it/s]
 76%|███████▌  | 281029/371472 [11:39<7:13:16,  3.48it/s]
 76%|███████▌  | 281030/371472 [11:39<7:07:57,  3.52it/s]
 76%|███████▌  | 281031/371472 [11:39<7:12:29,  3.49it/s]
 76%|███████▌  | 281032/371472 [11:39<6:59:23,  3.59it/s]
 76%|███████▌  | 281033/371472 [11:40<6:59:11,  3.60it/s]
 76%|███████▌  | 281034/371472 [11:40<6:56:23,  3.62it/s]
 76%|███████▌  | 281035/371472 [11:40<7:24:03,  3.39it/s]
 76%|███████▌  | 281036/371472 [11:41<8:46:54,  2.86it/s]
 76%|███████▌  | 281037/371472 [11:41<8:06:54,  3.10it/s]
 76%|███████▌  | 281038/371472 [11:41<7:55:19,  3.17it/s]
 76%|███████▌  | 281039/371472 [11:42<7:30:55,  3.34it/s]
 76%|███████▌  | 281040/371472 [11:42<7:59:37,  3.14it/s]
                                                         
{'loss': 2.4221, 'learning_rate': 3.1921610032536786e-07, 'epoch': 12.1}

 76%|███████▌  | 281040/371472 [11:42<7:59:37,  3.14it/s]
 76%|███████▌  | 281041/371472 [11:42<7:42:55,  3.26it/s]
 76%|███████▌  | 281042/371472 [11:43<7:26:45,  3.37it/s]
 76%|███████▌  | 281043/371472 [11:43<7:14:37,  3.47it/s]
 76%|███████▌  | 281044/371472 [11:43<7:20:13,  3.42it/s]
 76%|███████▌  | 281045/371472 [11:43<7:19:24,  3.43it/s]
 76%|███████▌  | 281046/371472 [11:44<6:58:51,  3.60it/s]
 76%|███████▌  | 281047/371472 [11:44<6:57:01,  3.61it/s]
 76%|███████▌  | 281048/371472 [11:44<7:21:44,  3.41it/s]
 76%|███████▌  | 281049/371472 [11:45<7:10:29,  3.50it/s]
 76%|███████▌  | 281050/371472 [11:45<7:10:45,  3.50it/s]
 76%|███████▌  | 281051/371472 [11:45<6:54:32,  3.64it/s]
 76%|███████▌  | 281052/371472 [11:45<6:56:52,  3.62it/s]
 76%|███████▌  | 281053/371472 [11:46<7:12:38,  3.48it/s]
 76%|███████▌  | 281054/371472 [11:46<7:52:29,  3.19it/s]
 76%|███████▌  | 281055/371472 [11:46<8:15:38,  3.04it/s]
 76%|███████▌  | 281056/371472 [11:47<7:58:51,  3.15it/s]
 76%|███████▌  | 281057/371472 [11:47<7:45:00,  3.24it/s]
 76%|███████▌  | 281058/371472 [11:47<7:42:20,  3.26it/s]
 76%|███████▌  | 281059/371472 [11:48<7:27:08,  3.37it/s]
 76%|███████▌  | 281060/371472 [11:48<7:12:48,  3.48it/s]
                                                         
{'loss': 2.7052, 'learning_rate': 3.1916761834988904e-07, 'epoch': 12.11}

 76%|███████▌  | 281060/371472 [11:48<7:12:48,  3.48it/s]
 76%|███████▌  | 281061/371472 [11:48<7:49:53,  3.21it/s]
 76%|███████▌  | 281062/371472 [11:48<7:35:55,  3.31it/s]
 76%|███████▌  | 281063/371472 [11:49<7:17:59,  3.44it/s]
 76%|███████▌  | 281064/371472 [11:49<7:04:30,  3.55it/s]
 76%|███████▌  | 281065/371472 [11:49<6:55:29,  3.63it/s]
 76%|███████▌  | 281066/371472 [11:50<7:09:43,  3.51it/s]
 76%|███████▌  | 281067/371472 [11:50<7:10:31,  3.50it/s]
 76%|███████▌  | 281068/371472 [11:50<7:01:08,  3.58it/s]
 76%|███████▌  | 281069/371472 [11:50<6:47:35,  3.70it/s]
 76%|███████▌  | 281070/371472 [11:51<7:27:46,  3.36it/s]
 76%|███████▌  | 281071/371472 [11:51<7:03:45,  3.56it/s]
 76%|███████▌  | 281072/371472 [11:51<7:00:40,  3.58it/s]
 76%|███████▌  | 281073/371472 [11:52<7:06:02,  3.54it/s]
 76%|███████▌  | 281074/371472 [11:52<6:52:21,  3.65it/s]
 76%|███████▌  | 281075/371472 [11:52<6:58:57,  3.60it/s]
 76%|███████▌  | 281076/371472 [11:52<6:59:33,  3.59it/s]
 76%|███████▌  | 281077/371472 [11:53<7:18:15,  3.44it/s]
 76%|███████▌  | 281078/371472 [11:53<7:16:59,  3.45it/s]
 76%|███████▌  | 281079/371472 [11:53<7:22:09,  3.41it/s]
 76%|███████▌  | 281080/371472 [11:54<7:12:35,  3.48it/s]
                                                         
{'loss': 2.7834, 'learning_rate': 3.1911913637441006e-07, 'epoch': 12.11}

 76%|███████▌  | 281080/371472 [11:54<7:12:35,  3.48it/s]
 76%|███████▌  | 281081/371472 [11:54<6:57:40,  3.61it/s]
 76%|███████▌  | 281082/371472 [11:54<6:51:40,  3.66it/s]
 76%|███████▌  | 281083/371472 [11:54<7:10:52,  3.50it/s]
 76%|███████▌  | 281084/371472 [11:55<6:55:09,  3.63it/s]
 76%|███████▌  | 281085/371472 [11:55<6:56:53,  3.61it/s]
 76%|███████▌  | 281086/371472 [11:55<6:55:48,  3.62it/s]
 76%|███████▌  | 281087/371472 [11:55<6:47:13,  3.70it/s]
 76%|███████▌  | 281088/371472 [11:56<7:10:10,  3.50it/s]
 76%|███████▌  | 281089/371472 [11:56<7:05:22,  3.54it/s]
 76%|███████▌  | 281090/371472 [11:56<7:10:08,  3.50it/s]
 76%|███████▌  | 281091/371472 [11:57<7:06:38,  3.53it/s]
 76%|███████▌  | 281092/371472 [11:57<7:00:12,  3.58it/s]
 76%|███████▌  | 281093/371472 [11:57<8:04:46,  3.11it/s]
 76%|███████▌  | 281094/371472 [11:58<7:33:05,  3.32it/s]
 76%|███████▌  | 281095/371472 [11:58<7:15:02,  3.46it/s]
 76%|███████▌  | 281096/371472 [11:58<6:58:22,  3.60it/s]
 76%|███████▌  | 281097/371472 [11:58<6:52:42,  3.65it/s]
 76%|███████▌  | 281098/371472 [11:59<6:52:10,  3.65it/s]
 76%|███████▌  | 281099/371472 [11:59<6:35:43,  3.81it/s]
 76%|███████▌  | 281100/371472 [11:59<6:43:08,  3.74it/s]
                                                         
{'loss': 2.8349, 'learning_rate': 3.1907065439893124e-07, 'epoch': 12.11}

 76%|███████▌  | 281100/371472 [11:59<6:43:08,  3.74it/s]
 76%|███████▌  | 281101/371472 [11:59<6:43:04,  3.74it/s]
 76%|███████▌  | 281102/371472 [12:00<6:49:53,  3.67it/s]
 76%|███████▌  | 281103/371472 [12:00<6:51:21,  3.66it/s]
 76%|███████▌  | 281104/371472 [12:00<6:51:16,  3.66it/s]
 76%|███████▌  | 281105/371472 [12:00<6:43:13,  3.74it/s]
 76%|███████▌  | 281106/371472 [12:01<6:42:15,  3.74it/s]
 76%|███████▌  | 281107/371472 [12:01<6:39:54,  3.77it/s]
 76%|███████▌  | 281108/371472 [12:01<6:43:07,  3.74it/s]
 76%|███████▌  | 281109/371472 [12:01<6:28:46,  3.87it/s]
 76%|███████▌  | 281110/371472 [12:02<6:25:14,  3.91it/s]
 76%|███████▌  | 281111/371472 [12:02<7:00:51,  3.58it/s]
 76%|███████▌  | 281112/371472 [12:02<8:04:00,  3.11it/s]
 76%|███████▌  | 281113/371472 [12:03<7:38:19,  3.29it/s]
 76%|███████▌  | 281114/371472 [12:03<7:41:51,  3.26it/s]
 76%|███████▌  | 281115/371472 [12:03<7:33:19,  3.32it/s]
 76%|███████▌  | 281116/371472 [12:04<7:26:54,  3.37it/s]
 76%|███████▌  | 281117/371472 [12:04<7:11:18,  3.49it/s]
 76%|███████▌  | 281118/371472 [12:04<7:19:43,  3.42it/s]
 76%|███████▌  | 281119/371472 [12:05<7:26:52,  3.37it/s]
 76%|███████▌  | 281120/371472 [12:05<7:37:14,  3.29it/s]
                                                         
{'loss': 2.7697, 'learning_rate': 3.190221724234523e-07, 'epoch': 12.11}

 76%|███████▌  | 281120/371472 [12:05<7:37:14,  3.29it/s]
 76%|███████▌  | 281121/371472 [12:05<7:15:10,  3.46it/s]
 76%|███████▌  | 281122/371472 [12:05<7:52:15,  3.19it/s]
 76%|███████▌  | 281123/371472 [12:06<8:06:24,  3.10it/s]
 76%|███████▌  | 281124/371472 [12:06<7:50:29,  3.20it/s]
 76%|███████▌  | 281125/371472 [12:06<7:26:36,  3.37it/s]
 76%|███████▌  | 281126/371472 [12:07<6:58:28,  3.60it/s]
 76%|███████▌  | 281127/371472 [12:07<8:01:55,  3.12it/s]
 76%|███████▌  | 281128/371472 [12:07<7:28:42,  3.36it/s]
 76%|███████▌  | 281129/371472 [12:08<7:33:10,  3.32it/s]
 76%|███████▌  | 281130/371472 [12:08<7:22:35,  3.40it/s]
 76%|███████▌  | 281131/371472 [12:08<7:09:30,  3.51it/s]
 76%|███████▌  | 281132/371472 [12:08<7:11:10,  3.49it/s]
 76%|███████▌  | 281133/371472 [12:09<7:05:41,  3.54it/s]
 76%|███████▌  | 281134/371472 [12:09<6:49:54,  3.67it/s]
 76%|███████▌  | 281135/371472 [12:09<7:05:10,  3.54it/s]
 76%|███████▌  | 281136/371472 [12:10<7:12:34,  3.48it/s]
 76%|███████▌  | 281137/371472 [12:10<7:13:02,  3.48it/s]
 76%|███████▌  | 281138/371472 [12:10<7:00:55,  3.58it/s]
 76%|███████▌  | 281139/371472 [12:10<6:54:42,  3.63it/s]
 76%|███████▌  | 281140/371472 [12:11<6:46:36,  3.70it/s]
                                                         
{'loss': 2.6377, 'learning_rate': 3.189736904479735e-07, 'epoch': 12.11}

 76%|███████▌  | 281140/371472 [12:11<6:46:36,  3.70it/s]
 76%|███████▌  | 281141/371472 [12:11<6:58:23,  3.60it/s]
 76%|███████▌  | 281142/371472 [12:11<6:42:10,  3.74it/s]
 76%|███████▌  | 281143/371472 [12:11<6:55:31,  3.62it/s]
 76%|███████▌  | 281144/371472 [12:12<7:08:05,  3.52it/s]
 76%|███████▌  | 281145/371472 [12:12<7:15:11,  3.46it/s]
 76%|███████▌  | 281146/371472 [12:12<7:19:35,  3.42it/s]
 76%|███████▌  | 281147/371472 [12:13<6:55:25,  3.62it/s]
 76%|███████▌  | 281148/371472 [12:13<6:47:38,  3.69it/s]
 76%|███████▌  | 281149/371472 [12:13<7:01:55,  3.57it/s]
 76%|███████▌  | 281150/371472 [12:13<7:00:20,  3.58it/s]
 76%|███████▌  | 281151/371472 [12:14<7:21:05,  3.41it/s]
 76%|███████▌  | 281152/371472 [12:14<7:18:26,  3.43it/s]
 76%|███████▌  | 281153/371472 [12:14<7:06:01,  3.53it/s]
 76%|███████▌  | 281154/371472 [12:15<6:50:56,  3.66it/s]
 76%|███████▌  | 281155/371472 [12:15<7:09:56,  3.50it/s]
 76%|███████▌  | 281156/371472 [12:15<7:08:42,  3.51it/s]
 76%|███████▌  | 281157/371472 [12:15<6:48:29,  3.68it/s]
 76%|███████▌  | 281158/371472 [12:16<6:45:39,  3.71it/s]
 76%|███████▌  | 281159/371472 [12:16<6:49:46,  3.67it/s]
 76%|███████▌  | 281160/371472 [12:16<7:05:52,  3.53it/s]
                                                         
{'loss': 2.5552, 'learning_rate': 3.1892520847249456e-07, 'epoch': 12.11}

 76%|███████▌  | 281160/371472 [12:16<7:05:52,  3.53it/s]
 76%|███████▌  | 281161/371472 [12:17<7:02:40,  3.56it/s]
 76%|███████▌  | 281162/371472 [12:17<6:54:11,  3.63it/s]
 76%|███████▌  | 281163/371472 [12:17<6:41:03,  3.75it/s]
 76%|███████▌  | 281164/371472 [12:17<6:35:37,  3.80it/s]
 76%|███████▌  | 281165/371472 [12:18<6:57:50,  3.60it/s]
 76%|███████▌  | 281166/371472 [12:18<7:11:05,  3.49it/s]
 76%|███████▌  | 281167/371472 [12:18<7:16:20,  3.45it/s]
 76%|███████▌  | 281168/371472 [12:18<7:13:57,  3.47it/s]
 76%|███████▌  | 281169/371472 [12:19<7:24:52,  3.38it/s]
 76%|███████▌  | 281170/371472 [12:19<7:37:18,  3.29it/s]
 76%|███████▌  | 281171/371472 [12:19<7:14:55,  3.46it/s]
 76%|███████▌  | 281172/371472 [12:20<7:15:58,  3.45it/s]
 76%|███████▌  | 281173/371472 [12:20<7:13:57,  3.47it/s]
 76%|███████▌  | 281174/371472 [12:20<7:17:08,  3.44it/s]
 76%|███████▌  | 281175/371472 [12:21<7:52:27,  3.19it/s]
 76%|███████▌  | 281176/371472 [12:21<7:21:27,  3.41it/s]
 76%|███████▌  | 281177/371472 [12:21<7:15:16,  3.46it/s]
 76%|███████▌  | 281178/371472 [12:21<7:35:43,  3.30it/s]
 76%|███████▌  | 281179/371472 [12:22<7:20:44,  3.41it/s]
 76%|███████▌  | 281180/371472 [12:22<7:11:42,  3.49it/s]
                                                         
{'loss': 2.5621, 'learning_rate': 3.188767264970157e-07, 'epoch': 12.11}

 76%|███████▌  | 281180/371472 [12:22<7:11:42,  3.49it/s]
 76%|███████▌  | 281181/371472 [12:22<7:54:41,  3.17it/s]
 76%|███████▌  | 281182/371472 [12:23<7:39:40,  3.27it/s]
 76%|███████▌  | 281183/371472 [12:23<7:16:38,  3.45it/s]
 76%|███████▌  | 281184/371472 [12:23<7:09:00,  3.51it/s]
 76%|███████▌  | 281185/371472 [12:23<7:04:38,  3.54it/s]
 76%|███████▌  | 281186/371472 [12:24<6:43:58,  3.72it/s]
 76%|███████▌  | 281187/371472 [12:24<6:36:40,  3.79it/s]
 76%|███████▌  | 281188/371472 [12:24<6:33:21,  3.83it/s]
 76%|███████▌  | 281189/371472 [12:25<6:50:43,  3.66it/s]
 76%|███████▌  | 281190/371472 [12:25<6:40:02,  3.76it/s]
 76%|███████▌  | 281191/371472 [12:25<6:40:59,  3.75it/s]
 76%|███████▌  | 281192/371472 [12:25<6:36:11,  3.80it/s]
 76%|███████▌  | 281193/371472 [12:26<6:46:28,  3.70it/s]
 76%|███████▌  | 281194/371472 [12:26<6:38:23,  3.78it/s]
 76%|███████▌  | 281195/371472 [12:26<6:57:29,  3.60it/s]
 76%|███████▌  | 281196/371472 [12:26<6:55:47,  3.62it/s]
 76%|███████▌  | 281197/371472 [12:27<6:48:34,  3.68it/s]
 76%|███████▌  | 281198/371472 [12:27<7:48:40,  3.21it/s]
 76%|███████▌  | 281199/371472 [12:27<7:49:06,  3.21it/s]
 76%|███████▌  | 281200/371472 [12:28<7:37:57,  3.29it/s]
                                                         
{'loss': 2.744, 'learning_rate': 3.188282445215367e-07, 'epoch': 12.11}

 76%|███████▌  | 281200/371472 [12:28<7:37:57,  3.29it/s]
 76%|███████▌  | 281201/371472 [12:28<7:51:27,  3.19it/s]
 76%|███████▌  | 281202/371472 [12:28<7:48:57,  3.21it/s]
 76%|███████▌  | 281203/371472 [12:29<7:38:02,  3.28it/s]
 76%|███████▌  | 281204/371472 [12:29<7:14:38,  3.46it/s]
 76%|███████▌  | 281205/371472 [12:29<7:04:12,  3.55it/s]
 76%|███████▌  | 281206/371472 [12:29<6:46:19,  3.70it/s]
 76%|███████▌  | 281207/371472 [12:30<6:52:49,  3.64it/s]
 76%|███████▌  | 281208/371472 [12:30<6:48:10,  3.69it/s]
 76%|███████▌  | 281209/371472 [12:30<6:54:48,  3.63it/s]
 76%|███████▌  | 281210/371472 [12:30<6:52:34,  3.65it/s]
 76%|███████▌  | 281211/371472 [12:31<7:02:44,  3.56it/s]
 76%|███████▌  | 281212/371472 [12:31<7:11:59,  3.48it/s]
 76%|███████▌  | 281213/371472 [12:31<6:57:32,  3.60it/s]
 76%|███████▌  | 281214/371472 [12:32<6:47:10,  3.69it/s]
 76%|███████▌  | 281215/371472 [12:32<6:59:16,  3.59it/s]
 76%|███████▌  | 281216/371472 [12:32<7:09:42,  3.50it/s]
 76%|███████▌  | 281217/371472 [12:32<7:28:25,  3.35it/s]
 76%|███████▌  | 281218/371472 [12:33<7:05:00,  3.54it/s]
 76%|███████▌  | 281219/371472 [12:33<7:12:49,  3.48it/s]
 76%|███████▌  | 281220/371472 [12:33<7:59:03,  3.14it/s]
                                                         
{'loss': 2.766, 'learning_rate': 3.187797625460579e-07, 'epoch': 12.11}

 76%|███████▌  | 281220/371472 [12:33<7:59:03,  3.14it/s]
 76%|███████▌  | 281221/371472 [12:34<7:38:04,  3.28it/s]
 76%|███████▌  | 281222/371472 [12:34<7:30:02,  3.34it/s]
 76%|███████▌  | 281223/371472 [12:34<7:50:03,  3.20it/s]
 76%|███████▌  | 281224/371472 [12:35<7:37:17,  3.29it/s]
 76%|███████▌  | 281225/371472 [12:35<7:24:26,  3.38it/s]
 76%|███████▌  | 281226/371472 [12:35<7:07:13,  3.52it/s]
 76%|███████▌  | 281227/371472 [12:35<7:04:26,  3.54it/s]
 76%|███████▌  | 281228/371472 [12:36<6:50:41,  3.66it/s]
 76%|███████▌  | 281229/371472 [12:36<6:47:13,  3.69it/s]
 76%|███████▌  | 281230/371472 [12:36<6:54:37,  3.63it/s]
 76%|███████▌  | 281231/371472 [12:37<6:57:53,  3.60it/s]
 76%|███████▌  | 281232/371472 [12:37<7:20:01,  3.42it/s]
 76%|███████▌  | 281233/371472 [12:37<7:12:25,  3.48it/s]
 76%|███████▌  | 281234/371472 [12:37<7:26:15,  3.37it/s]
 76%|███████▌  | 281235/371472 [12:38<7:41:57,  3.26it/s]
 76%|███████▌  | 281236/371472 [12:38<7:43:44,  3.24it/s]
 76%|███████▌  | 281237/371472 [12:38<7:41:26,  3.26it/s]
 76%|███████▌  | 281238/371472 [12:39<8:01:21,  3.12it/s]
 76%|███████▌  | 281239/371472 [12:39<8:12:24,  3.05it/s]
 76%|███████▌  | 281240/371472 [12:39<7:35:35,  3.30it/s]
                                                         
{'loss': 2.4181, 'learning_rate': 3.1873128057057895e-07, 'epoch': 12.11}

 76%|███████▌  | 281240/371472 [12:39<7:35:35,  3.30it/s]
 76%|███████▌  | 281241/371472 [12:40<7:22:50,  3.40it/s]
 76%|███████▌  | 281242/371472 [12:40<7:02:17,  3.56it/s]
 76%|███████▌  | 281243/371472 [12:40<7:09:38,  3.50it/s]
 76%|███████▌  | 281244/371472 [12:40<7:01:10,  3.57it/s]
 76%|███████▌  | 281245/371472 [12:41<6:53:05,  3.64it/s]
 76%|███████▌  | 281246/371472 [12:41<6:58:59,  3.59it/s]
 76%|███████▌  | 281247/371472 [12:41<6:48:34,  3.68it/s]
 76%|███████▌  | 281248/371472 [12:42<7:13:58,  3.46it/s]
 76%|███████▌  | 281249/371472 [12:42<6:51:22,  3.66it/s]
 76%|███████▌  | 281250/371472 [12:42<7:02:11,  3.56it/s]
 76%|███████▌  | 281251/371472 [12:42<6:48:51,  3.68it/s]
 76%|███████▌  | 281252/371472 [12:43<6:42:50,  3.73it/s]
 76%|███████▌  | 281253/371472 [12:43<6:28:32,  3.87it/s]
 76%|███████▌  | 281254/371472 [12:43<6:24:58,  3.91it/s]
 76%|███████▌  | 281255/371472 [12:43<6:32:40,  3.83it/s]
 76%|███████▌  | 281256/371472 [12:44<6:54:38,  3.63it/s]
 76%|███████▌  | 281257/371472 [12:44<7:06:58,  3.52it/s]
 76%|███████▌  | 281258/371472 [12:44<7:50:43,  3.19it/s]
 76%|███████▌  | 281259/371472 [12:45<7:22:28,  3.40it/s]
 76%|███████▌  | 281260/371472 [12:45<7:22:57,  3.39it/s]
                                                         
{'loss': 2.6702, 'learning_rate': 3.1868279859510013e-07, 'epoch': 12.11}

 76%|███████▌  | 281260/371472 [12:45<7:22:57,  3.39it/s]
 76%|███████▌  | 281261/371472 [12:45<7:15:28,  3.45it/s]
 76%|███████▌  | 281262/371472 [12:45<6:57:36,  3.60it/s]
 76%|███████▌  | 281263/371472 [12:46<7:04:46,  3.54it/s]
 76%|███████▌  | 281264/371472 [12:46<6:56:20,  3.61it/s]
 76%|███████▌  | 281265/371472 [12:46<6:55:27,  3.62it/s]
 76%|███████▌  | 281266/371472 [12:47<6:49:21,  3.67it/s]
 76%|███████▌  | 281267/371472 [12:47<6:38:10,  3.78it/s]
 76%|███████▌  | 281268/371472 [12:47<6:40:26,  3.75it/s]
 76%|███████▌  | 281269/371472 [12:47<6:35:03,  3.81it/s]
 76%|███████▌  | 281270/371472 [12:48<7:41:02,  3.26it/s]
 76%|███████▌  | 281271/371472 [12:48<7:25:03,  3.38it/s]
 76%|███████▌  | 281272/371472 [12:48<7:12:07,  3.48it/s]
 76%|███████▌  | 281273/371472 [12:49<7:02:52,  3.56it/s]
 76%|███████▌  | 281274/371472 [12:49<6:48:43,  3.68it/s]
 76%|███████▌  | 281275/371472 [12:49<7:27:48,  3.36it/s]
 76%|███████▌  | 281276/371472 [12:49<7:34:18,  3.31it/s]
 76%|███████▌  | 281277/371472 [12:50<7:23:32,  3.39it/s]
 76%|███████▌  | 281278/371472 [12:50<7:18:50,  3.43it/s]
 76%|███████▌  | 281279/371472 [12:50<7:19:23,  3.42it/s]
 76%|███████▌  | 281280/371472 [12:51<7:17:40,  3.43it/s]
                                                         
{'loss': 2.4436, 'learning_rate': 3.186343166196212e-07, 'epoch': 12.12}

 76%|███████▌  | 281280/371472 [12:51<7:17:40,  3.43it/s]
 76%|███████▌  | 281281/371472 [12:51<7:47:07,  3.22it/s]
 76%|███████▌  | 281282/371472 [12:51<7:58:55,  3.14it/s]
 76%|███████▌  | 281283/371472 [12:52<7:33:40,  3.31it/s]
 76%|███████▌  | 281284/371472 [12:52<7:26:04,  3.37it/s]
 76%|███████▌  | 281285/371472 [12:52<7:10:38,  3.49it/s]
 76%|███████▌  | 281286/371472 [12:52<7:04:37,  3.54it/s]
 76%|███████▌  | 281287/371472 [12:53<7:25:26,  3.37it/s]
 76%|███████▌  | 281288/371472 [12:53<7:07:48,  3.51it/s]
 76%|███████▌  | 281289/371472 [12:53<7:09:18,  3.50it/s]
 76%|███████▌  | 281290/371472 [12:54<7:22:00,  3.40it/s]
 76%|███████▌  | 281291/371472 [12:54<7:32:59,  3.32it/s]
 76%|███████▌  | 281292/371472 [12:54<7:13:11,  3.47it/s]
 76%|███████▌  | 281293/371472 [12:54<6:53:12,  3.64it/s]
 76%|███████▌  | 281294/371472 [12:55<6:36:06,  3.79it/s]
 76%|███████▌  | 281295/371472 [12:55<6:45:59,  3.70it/s]
 76%|███████▌  | 281296/371472 [12:55<6:43:32,  3.72it/s]
 76%|███████▌  | 281297/371472 [12:55<7:20:16,  3.41it/s]
 76%|███████▌  | 281298/371472 [12:56<7:10:17,  3.49it/s]
 76%|███████▌  | 281299/371472 [12:56<7:16:26,  3.44it/s]
 76%|███████▌  | 281300/371472 [12:56<7:15:48,  3.45it/s]
                                                         
{'loss': 2.825, 'learning_rate': 3.185858346441423e-07, 'epoch': 12.12}

 76%|███████▌  | 281300/371472 [12:56<7:15:48,  3.45it/s]
 76%|███████▌  | 281301/371472 [12:57<7:20:22,  3.41it/s]
 76%|███████▌  | 281302/371472 [12:57<7:56:06,  3.16it/s]
 76%|███████▌  | 281303/371472 [12:57<7:31:19,  3.33it/s]
 76%|███████▌  | 281304/371472 [12:58<7:20:37,  3.41it/s]
 76%|███████▌  | 281305/371472 [12:58<7:30:53,  3.33it/s]
 76%|███████▌  | 281306/371472 [12:58<7:30:44,  3.33it/s]
 76%|███████▌  | 281307/371472 [12:59<8:00:07,  3.13it/s]
 76%|███████▌  | 281308/371472 [12:59<7:44:28,  3.24it/s]
 76%|███████▌  | 281309/371472 [12:59<7:15:43,  3.45it/s]
 76%|███████▌  | 281310/371472 [12:59<7:08:17,  3.51it/s]
 76%|███████▌  | 281311/371472 [13:00<7:16:44,  3.44it/s]
 76%|███████▌  | 281312/371472 [13:00<7:06:54,  3.52it/s]
 76%|███████▌  | 281313/371472 [13:00<7:06:36,  3.52it/s]
 76%|███████▌  | 281314/371472 [13:00<6:56:38,  3.61it/s]
 76%|███████▌  | 281315/371472 [13:01<7:00:24,  3.57it/s]
 76%|███████▌  | 281316/371472 [13:01<6:57:05,  3.60it/s]
 76%|███████▌  | 281317/371472 [13:01<6:52:52,  3.64it/s]
 76%|███████▌  | 281318/371472 [13:02<6:46:37,  3.70it/s]
 76%|███████▌  | 281319/371472 [13:02<6:50:41,  3.66it/s]
 76%|███████▌  | 281320/371472 [13:02<6:53:33,  3.63it/s]
                                                         
{'loss': 2.76, 'learning_rate': 3.185373526686634e-07, 'epoch': 12.12}

 76%|███████▌  | 281320/371472 [13:02<6:53:33,  3.63it/s]
 76%|███████▌  | 281321/371472 [13:02<6:58:22,  3.59it/s]
 76%|███████▌  | 281322/371472 [13:03<6:51:39,  3.65it/s]
 76%|███████▌  | 281323/371472 [13:03<6:53:43,  3.63it/s]
 76%|███████▌  | 281324/371472 [13:03<7:41:06,  3.26it/s]
 76%|███████▌  | 281325/371472 [13:04<7:41:35,  3.25it/s]
 76%|███████▌  | 281326/371472 [13:04<7:32:12,  3.32it/s]
 76%|███████▌  | 281327/371472 [13:04<7:06:23,  3.52it/s]
 76%|███████▌  | 281328/371472 [13:05<7:37:12,  3.29it/s]
 76%|███████▌  | 281329/371472 [13:05<7:18:46,  3.42it/s]
 76%|███████▌  | 281330/371472 [13:05<7:04:13,  3.54it/s]
 76%|███████▌  | 281331/371472 [13:05<6:59:53,  3.58it/s]
 76%|███████▌  | 281332/371472 [13:06<6:42:36,  3.73it/s]
 76%|███████▌  | 281333/371472 [13:06<6:59:53,  3.58it/s]
 76%|███████▌  | 281334/371472 [13:06<7:21:37,  3.40it/s]
 76%|███████▌  | 281335/371472 [13:06<6:59:34,  3.58it/s]
 76%|███████▌  | 281336/371472 [13:07<7:21:57,  3.40it/s]
 76%|███████▌  | 281337/371472 [13:07<7:05:45,  3.53it/s]
 76%|███████▌  | 281338/371472 [13:07<7:00:35,  3.57it/s]
 76%|███████▌  | 281339/371472 [13:08<6:47:42,  3.68it/s]
 76%|███████▌  | 281340/371472 [13:08<6:50:49,  3.66it/s]
                                                         
{'loss': 2.7774, 'learning_rate': 3.184888706931845e-07, 'epoch': 12.12}

 76%|███████▌  | 281340/371472 [13:08<6:50:49,  3.66it/s]
 76%|███████▌  | 281341/371472 [13:08<7:02:46,  3.55it/s]
 76%|███████▌  | 281342/371472 [13:08<6:57:43,  3.60it/s]
 76%|███████▌  | 281343/371472 [13:09<6:46:45,  3.69it/s]
 76%|███████▌  | 281344/371472 [13:09<7:23:15,  3.39it/s]
 76%|███████▌  | 281345/371472 [13:09<7:13:33,  3.46it/s]
 76%|███████▌  | 281346/371472 [13:10<7:00:50,  3.57it/s]
 76%|███████▌  | 281347/371472 [13:10<6:42:08,  3.74it/s]
 76%|███████▌  | 281348/371472 [13:10<6:37:32,  3.78it/s]
 76%|███████▌  | 281349/371472 [13:10<6:46:40,  3.69it/s]
 76%|███████▌  | 281350/371472 [13:11<6:42:56,  3.73it/s]
 76%|███████▌  | 281351/371472 [13:11<6:46:33,  3.69it/s]
 76%|███████▌  | 281352/371472 [13:11<6:54:00,  3.63it/s]
 76%|███████▌  | 281353/371472 [13:11<6:55:38,  3.61it/s]
 76%|███████▌  | 281354/371472 [13:12<6:56:09,  3.61it/s]
 76%|███████▌  | 281355/371472 [13:12<6:50:52,  3.66it/s]
 76%|███████▌  | 281356/371472 [13:12<6:37:11,  3.78it/s]
 76%|███████▌  | 281357/371472 [13:12<6:32:25,  3.83it/s]
 76%|███████▌  | 281358/371472 [13:13<6:41:45,  3.74it/s]
 76%|███████▌  | 281359/371472 [13:13<6:39:51,  3.76it/s]
 76%|███████▌  | 281360/371472 [13:13<6:44:40,  3.71it/s]
                                                         
{'loss': 2.8402, 'learning_rate': 3.184403887177056e-07, 'epoch': 12.12}

 76%|███████▌  | 281360/371472 [13:13<6:44:40,  3.71it/s]
 76%|███████▌  | 281361/371472 [13:14<6:46:56,  3.69it/s]
 76%|███████▌  | 281362/371472 [13:14<6:55:21,  3.62it/s]
 76%|███████▌  | 281363/371472 [13:14<7:00:29,  3.57it/s]
 76%|███████▌  | 281364/371472 [13:14<6:56:32,  3.61it/s]
 76%|███████▌  | 281365/371472 [13:15<6:58:05,  3.59it/s]
 76%|███████▌  | 281366/371472 [13:15<6:48:53,  3.67it/s]
 76%|███████▌  | 281367/371472 [13:15<6:55:36,  3.61it/s]
 76%|███████▌  | 281368/371472 [13:15<6:47:45,  3.68it/s]
 76%|███████▌  | 281369/371472 [13:16<7:17:16,  3.43it/s]
 76%|███████▌  | 281370/371472 [13:16<7:17:24,  3.43it/s]
 76%|███████▌  | 281371/371472 [13:16<6:59:07,  3.58it/s]
 76%|███████▌  | 281372/371472 [13:17<6:56:07,  3.61it/s]
 76%|███████▌  | 281373/371472 [13:17<6:36:46,  3.78it/s]
 76%|███████▌  | 281374/371472 [13:17<6:53:37,  3.63it/s]
 76%|███████▌  | 281375/371472 [13:17<6:42:21,  3.73it/s]
 76%|███████▌  | 281376/371472 [13:18<6:48:07,  3.68it/s]
 76%|███████▌  | 281377/371472 [13:18<6:58:21,  3.59it/s]
 76%|███████▌  | 281378/371472 [13:18<7:04:57,  3.53it/s]
 76%|███████▌  | 281379/371472 [13:19<7:14:14,  3.46it/s]
 76%|███████▌  | 281380/371472 [13:19<6:57:53,  3.59it/s]
                                                         
{'loss': 2.5495, 'learning_rate': 3.1839190674222677e-07, 'epoch': 12.12}

 76%|███████▌  | 281380/371472 [13:19<6:57:53,  3.59it/s]
 76%|███████▌  | 281381/371472 [13:19<7:31:03,  3.33it/s]
 76%|███████▌  | 281382/371472 [13:19<7:26:19,  3.36it/s]
 76%|███████▌  | 281383/371472 [13:20<7:06:34,  3.52it/s]
 76%|███████▌  | 281384/371472 [13:20<7:39:18,  3.27it/s]
 76%|███████▌  | 281385/371472 [13:20<7:41:27,  3.25it/s]
 76%|███████▌  | 281386/371472 [13:21<7:27:49,  3.35it/s]
 76%|███████▌  | 281387/371472 [13:21<7:24:18,  3.38it/s]
 76%|███████▌  | 281388/371472 [13:21<8:06:01,  3.09it/s]
 76%|███████▌  | 281389/371472 [13:22<7:58:20,  3.14it/s]
 76%|███████▌  | 281390/371472 [13:22<7:23:35,  3.38it/s]
 76%|███████▌  | 281391/371472 [13:22<7:18:02,  3.43it/s]
 76%|███████▌  | 281392/371472 [13:22<7:01:11,  3.56it/s]
 76%|███████▌  | 281393/371472 [13:23<7:38:18,  3.28it/s]
 76%|███████▌  | 281394/371472 [13:23<7:24:42,  3.38it/s]
 76%|███████▌  | 281395/371472 [13:23<7:44:34,  3.23it/s]
 76%|███████▌  | 281396/371472 [13:24<7:30:19,  3.33it/s]
 76%|███████▌  | 281397/371472 [13:24<7:28:32,  3.35it/s]
 76%|███████▌  | 281398/371472 [13:24<7:09:34,  3.49it/s]
 76%|███████▌  | 281399/371472 [13:25<7:05:44,  3.53it/s]
 76%|███████▌  | 281400/371472 [13:25<6:59:47,  3.58it/s]
                                                         
{'loss': 2.5337, 'learning_rate': 3.1834342476674784e-07, 'epoch': 12.12}

 76%|███████▌  | 281400/371472 [13:25<6:59:47,  3.58it/s]
 76%|███████▌  | 281401/371472 [13:25<7:22:09,  3.40it/s]
 76%|███████▌  | 281402/371472 [13:25<7:08:54,  3.50it/s]
 76%|███████▌  | 281403/371472 [13:26<7:25:29,  3.37it/s]
 76%|███████▌  | 281404/371472 [13:26<7:10:14,  3.49it/s]
 76%|███████▌  | 281405/371472 [13:26<7:18:20,  3.42it/s]
 76%|███████▌  | 281406/371472 [13:27<7:38:05,  3.28it/s]
 76%|███████▌  | 281407/371472 [13:27<7:12:20,  3.47it/s]
 76%|███████▌  | 281408/371472 [13:27<6:51:16,  3.65it/s]
 76%|███████▌  | 281409/371472 [13:27<6:55:55,  3.61it/s]
 76%|███████▌  | 281410/371472 [13:28<6:55:47,  3.61it/s]
 76%|███████▌  | 281411/371472 [13:28<7:12:07,  3.47it/s]
 76%|███████▌  | 281412/371472 [13:28<7:30:35,  3.33it/s]
 76%|███████▌  | 281413/371472 [13:29<8:11:12,  3.06it/s]
 76%|███████▌  | 281414/371472 [13:29<7:39:55,  3.26it/s]
 76%|███████▌  | 281415/371472 [13:29<7:17:52,  3.43it/s]
 76%|███████▌  | 281416/371472 [13:30<7:12:46,  3.47it/s]
 76%|███████▌  | 281417/371472 [13:30<7:01:35,  3.56it/s]
 76%|███████▌  | 281418/371472 [13:30<7:14:32,  3.45it/s]
 76%|███████▌  | 281419/371472 [13:30<7:03:57,  3.54it/s]
 76%|███████▌  | 281420/371472 [13:31<6:57:43,  3.59it/s]
                                                         
{'loss': 2.6677, 'learning_rate': 3.182949427912689e-07, 'epoch': 12.12}

 76%|███████▌  | 281420/371472 [13:31<6:57:43,  3.59it/s]
 76%|███████▌  | 281421/371472 [13:31<6:42:59,  3.72it/s]
 76%|███████▌  | 281422/371472 [13:31<7:17:10,  3.43it/s]
 76%|███████▌  | 281423/371472 [13:31<6:52:05,  3.64it/s]
 76%|███████▌  | 281424/371472 [13:32<6:45:29,  3.70it/s]
 76%|███████▌  | 281425/371472 [13:32<7:12:16,  3.47it/s]
 76%|███████▌  | 281426/371472 [13:32<6:57:32,  3.59it/s]
 76%|███████▌  | 281427/371472 [13:33<7:41:22,  3.25it/s]
 76%|███████▌  | 281428/371472 [13:33<7:24:08,  3.38it/s]
 76%|███████▌  | 281429/371472 [13:33<7:19:12,  3.42it/s]
 76%|███████▌  | 281430/371472 [13:34<7:17:13,  3.43it/s]
 76%|███████▌  | 281431/371472 [13:34<7:48:09,  3.21it/s]
 76%|███████▌  | 281432/371472 [13:34<7:37:40,  3.28it/s]
 76%|███████▌  | 281433/371472 [13:34<7:14:46,  3.45it/s]
 76%|███████▌  | 281434/371472 [13:35<7:22:10,  3.39it/s]
 76%|███████▌  | 281435/371472 [13:35<7:10:48,  3.48it/s]
 76%|███████▌  | 281436/371472 [13:35<7:06:03,  3.52it/s]
 76%|███████▌  | 281437/371472 [13:36<7:00:36,  3.57it/s]
 76%|███████▌  | 281438/371472 [13:36<6:47:24,  3.68it/s]
 76%|███████▌  | 281439/371472 [13:36<7:04:56,  3.53it/s]
 76%|███████▌  | 281440/371472 [13:36<6:56:39,  3.60it/s]
                                                         
{'loss': 2.5728, 'learning_rate': 3.1824646081579004e-07, 'epoch': 12.12}

 76%|███████▌  | 281440/371472 [13:36<6:56:39,  3.60it/s]
 76%|███████▌  | 281441/371472 [13:37<6:51:08,  3.65it/s]
 76%|███████▌  | 281442/371472 [13:37<6:40:47,  3.74it/s]
 76%|███████▌  | 281443/371472 [13:37<6:52:47,  3.63it/s]
 76%|███████▌  | 281444/371472 [13:37<6:38:06,  3.77it/s]
 76%|███████▌  | 281445/371472 [13:38<6:32:53,  3.82it/s]
 76%|███████▌  | 281446/371472 [13:38<6:43:27,  3.72it/s]
 76%|███████▌  | 281447/371472 [13:38<6:47:00,  3.69it/s]
 76%|███████▌  | 281448/371472 [13:38<6:40:03,  3.75it/s]
 76%|███████▌  | 281449/371472 [13:39<6:52:29,  3.64it/s]
 76%|███████▌  | 281450/371472 [13:39<6:39:05,  3.76it/s]
 76%|███████▌  | 281451/371472 [13:39<6:41:03,  3.74it/s]
 76%|███████▌  | 281452/371472 [13:40<6:46:10,  3.69it/s]
 76%|███████▌  | 281453/371472 [13:40<6:57:44,  3.59it/s]
 76%|███████▌  | 281454/371472 [13:40<6:48:59,  3.67it/s]
 76%|███████▌  | 281455/371472 [13:40<7:32:20,  3.32it/s]
 76%|███████▌  | 281456/371472 [13:41<7:41:17,  3.25it/s]
 76%|███████▌  | 281457/371472 [13:41<7:10:14,  3.49it/s]
 76%|███████▌  | 281458/371472 [13:41<6:56:18,  3.60it/s]
 76%|███████▌  | 281459/371472 [13:42<6:47:06,  3.69it/s]
 76%|███████▌  | 281460/371472 [13:42<6:39:19,  3.76it/s]
                                                         
{'loss': 2.7419, 'learning_rate': 3.1819797884031105e-07, 'epoch': 12.12}

 76%|███████▌  | 281460/371472 [13:42<6:39:19,  3.76it/s]
 76%|███████▌  | 281461/371472 [13:42<7:21:06,  3.40it/s]
 76%|███████▌  | 281462/371472 [13:42<7:11:04,  3.48it/s]
 76%|███████▌  | 281463/371472 [13:43<6:57:52,  3.59it/s]
 76%|███████▌  | 281464/371472 [13:43<6:57:53,  3.59it/s]
 76%|███████▌  | 281465/371472 [13:43<6:57:44,  3.59it/s]
 76%|███████▌  | 281466/371472 [13:44<6:57:11,  3.60it/s]
 76%|███████▌  | 281467/371472 [13:44<7:04:14,  3.54it/s]
 76%|███████▌  | 281468/371472 [13:44<7:15:51,  3.44it/s]
 76%|███████▌  | 281469/371472 [13:44<7:02:33,  3.55it/s]
 76%|███████▌  | 281470/371472 [13:45<7:29:04,  3.34it/s]
 76%|███████▌  | 281471/371472 [13:45<7:14:08,  3.46it/s]
 76%|███████▌  | 281472/371472 [13:45<6:58:09,  3.59it/s]
 76%|███████▌  | 281473/371472 [13:46<6:51:26,  3.65it/s]
 76%|███████▌  | 281474/371472 [13:46<8:56:04,  2.80it/s]
 76%|███████▌  | 281475/371472 [13:46<8:17:06,  3.02it/s]
 76%|███████▌  | 281476/371472 [13:47<8:12:45,  3.04it/s]
 76%|███████▌  | 281477/371472 [13:47<7:56:26,  3.15it/s]
 76%|███████▌  | 281478/371472 [13:47<7:23:56,  3.38it/s]
 76%|███████▌  | 281479/371472 [13:47<7:18:31,  3.42it/s]
 76%|███████▌  | 281480/371472 [13:48<7:14:50,  3.45it/s]
                                                         
{'loss': 2.6847, 'learning_rate': 3.1814949686483223e-07, 'epoch': 12.12}

 76%|███████▌  | 281480/371472 [13:48<7:14:50,  3.45it/s]
 76%|███████▌  | 281481/371472 [13:48<7:13:15,  3.46it/s]
 76%|███████▌  | 281482/371472 [13:48<7:20:31,  3.40it/s]
 76%|███████▌  | 281483/371472 [13:49<7:57:37,  3.14it/s]
 76%|███████▌  | 281484/371472 [13:49<7:21:58,  3.39it/s]
 76%|███████▌  | 281485/371472 [13:49<7:15:10,  3.45it/s]
 76%|███████▌  | 281486/371472 [13:50<7:17:59,  3.42it/s]
 76%|███████▌  | 281487/371472 [13:50<7:02:01,  3.55it/s]
 76%|███████▌  | 281488/371472 [13:50<6:57:46,  3.59it/s]
 76%|███████▌  | 281489/371472 [13:50<7:13:15,  3.46it/s]
 76%|███████▌  | 281490/371472 [13:51<6:58:20,  3.58it/s]
 76%|███████▌  | 281491/371472 [13:51<6:47:30,  3.68it/s]
 76%|███████▌  | 281492/371472 [13:51<7:20:11,  3.41it/s]
 76%|███████▌  | 281493/371472 [13:52<7:25:01,  3.37it/s]
 76%|███████▌  | 281494/371472 [13:52<8:21:10,  2.99it/s]
 76%|███████▌  | 281495/371472 [13:52<8:04:24,  3.10it/s]
 76%|███████▌  | 281496/371472 [13:53<7:31:45,  3.32it/s]
 76%|███████▌  | 281497/371472 [13:53<7:23:22,  3.38it/s]
 76%|███████▌  | 281498/371472 [13:53<7:13:19,  3.46it/s]
 76%|███████▌  | 281499/371472 [13:53<6:55:20,  3.61it/s]
 76%|███████▌  | 281500/371472 [13:54<6:56:37,  3.60it/s]
                                                         
{'loss': 2.5298, 'learning_rate': 3.181010148893533e-07, 'epoch': 12.12}

 76%|███████▌  | 281500/371472 [13:54<6:56:37,  3.60it/s]
 76%|███████▌  | 281501/371472 [13:54<6:46:39,  3.69it/s]
 76%|███████▌  | 281502/371472 [13:54<7:11:06,  3.48it/s]
 76%|███████▌  | 281503/371472 [13:55<7:21:47,  3.39it/s]
 76%|███████▌  | 281504/371472 [13:55<7:13:49,  3.46it/s]
 76%|███████▌  | 281505/371472 [13:55<7:07:52,  3.50it/s]
 76%|███████▌  | 281506/371472 [13:55<7:24:05,  3.38it/s]
 76%|███████▌  | 281507/371472 [13:56<7:14:54,  3.45it/s]
 76%|███████▌  | 281508/371472 [13:56<7:06:34,  3.51it/s]
 76%|███████▌  | 281509/371472 [13:56<7:06:51,  3.51it/s]
 76%|███████▌  | 281510/371472 [13:57<7:08:22,  3.50it/s]
 76%|███████▌  | 281511/371472 [13:57<6:50:58,  3.65it/s]
 76%|███████▌  | 281512/371472 [13:57<6:45:53,  3.69it/s]
 76%|███████▌  | 281513/371472 [13:57<6:40:36,  3.74it/s]
 76%|███████▌  | 281514/371472 [13:58<7:03:29,  3.54it/s]
 76%|███████▌  | 281515/371472 [13:58<7:22:46,  3.39it/s]
 76%|███████▌  | 281516/371472 [13:58<6:59:02,  3.58it/s]
 76%|███████▌  | 281517/371472 [13:58<6:46:29,  3.69it/s]
 76%|███████▌  | 281518/371472 [13:59<6:49:28,  3.66it/s]
 76%|███████▌  | 281519/371472 [13:59<6:53:22,  3.63it/s]
 76%|███████▌  | 281520/371472 [13:59<6:48:13,  3.67it/s]
                                                         
{'loss': 2.7803, 'learning_rate': 3.180525329138745e-07, 'epoch': 12.13}

 76%|███████▌  | 281520/371472 [13:59<6:48:13,  3.67it/s]
 76%|███████▌  | 281521/371472 [13:59<6:44:06,  3.71it/s]
 76%|███████▌  | 281522/371472 [14:00<7:11:56,  3.47it/s]
 76%|███████▌  | 281523/371472 [14:00<6:59:55,  3.57it/s]
 76%|███████▌  | 281524/371472 [14:00<6:55:53,  3.60it/s]
 76%|███████▌  | 281525/371472 [14:01<7:17:04,  3.43it/s]
 76%|███████▌  | 281526/371472 [14:01<6:56:59,  3.59it/s]
 76%|███████▌  | 281527/371472 [14:01<6:59:12,  3.58it/s]
 76%|███████▌  | 281528/371472 [14:02<7:00:24,  3.57it/s]
 76%|███████▌  | 281529/371472 [14:02<6:49:58,  3.66it/s]
 76%|███████▌  | 281530/371472 [14:02<7:12:47,  3.46it/s]
 76%|███████▌  | 281531/371472 [14:02<7:35:46,  3.29it/s]
 76%|███████▌  | 281532/371472 [14:03<7:15:13,  3.44it/s]
 76%|███████▌  | 281533/371472 [14:03<7:05:24,  3.52it/s]
 76%|███████▌  | 281534/371472 [14:03<6:53:03,  3.63it/s]
 76%|███████▌  | 281535/371472 [14:04<7:24:39,  3.37it/s]
 76%|███████▌  | 281536/371472 [14:04<7:09:31,  3.49it/s]
 76%|███████▌  | 281537/371472 [14:04<7:04:05,  3.53it/s]
 76%|███████▌  | 281538/371472 [14:04<7:10:21,  3.48it/s]
 76%|███████▌  | 281539/371472 [14:05<6:57:02,  3.59it/s]
 76%|███████▌  | 281540/371472 [14:05<6:45:30,  3.70it/s]
                                                         
{'loss': 2.6021, 'learning_rate': 3.1800405093839555e-07, 'epoch': 12.13}

 76%|███████▌  | 281540/371472 [14:05<6:45:30,  3.70it/s]
 76%|███████▌  | 281541/371472 [14:05<7:13:41,  3.46it/s]
 76%|███████▌  | 281542/371472 [14:06<7:59:05,  3.13it/s]
 76%|███████▌  | 281543/371472 [14:06<7:55:48,  3.15it/s]
 76%|███████▌  | 281544/371472 [14:06<7:44:56,  3.22it/s]
 76%|███████▌  | 281545/371472 [14:07<7:39:57,  3.26it/s]
 76%|███████▌  | 281546/371472 [14:07<7:53:17,  3.17it/s]
 76%|███████▌  | 281547/371472 [14:07<8:15:20,  3.03it/s]
 76%|███████▌  | 281548/371472 [14:08<8:04:20,  3.09it/s]
 76%|███████▌  | 281549/371472 [14:08<7:38:53,  3.27it/s]
 76%|███████▌  | 281550/371472 [14:08<7:38:20,  3.27it/s]
 76%|███████▌  | 281551/371472 [14:08<7:28:46,  3.34it/s]
 76%|███████▌  | 281552/371472 [14:09<7:49:38,  3.19it/s]
 76%|███████▌  | 281553/371472 [14:09<7:26:58,  3.35it/s]
 76%|███████▌  | 281554/371472 [14:09<7:07:41,  3.50it/s]
 76%|███████▌  | 281555/371472 [14:10<6:53:11,  3.63it/s]
 76%|███████▌  | 281556/371472 [14:10<6:53:07,  3.63it/s]
 76%|███████▌  | 281557/371472 [14:10<6:42:03,  3.73it/s]
 76%|███████▌  | 281558/371472 [14:10<6:36:50,  3.78it/s]
 76%|███████▌  | 281559/371472 [14:11<6:51:13,  3.64it/s]
 76%|███████▌  | 281560/371472 [14:11<6:42:52,  3.72it/s]
                                                         
{'loss': 2.6996, 'learning_rate': 3.179555689629167e-07, 'epoch': 12.13}

 76%|███████▌  | 281560/371472 [14:11<6:42:52,  3.72it/s]
 76%|███████▌  | 281561/371472 [14:11<7:00:41,  3.56it/s]
 76%|███████▌  | 281562/371472 [14:11<7:23:50,  3.38it/s]
 76%|███████▌  | 281563/371472 [14:12<7:19:34,  3.41it/s]
 76%|███████▌  | 281564/371472 [14:12<7:08:51,  3.49it/s]
 76%|███████▌  | 281565/371472 [14:12<7:05:00,  3.53it/s]
 76%|███████▌  | 281566/371472 [14:13<7:52:16,  3.17it/s]
 76%|███████▌  | 281567/371472 [14:13<7:54:20,  3.16it/s]
 76%|███████▌  | 281568/371472 [14:13<7:34:41,  3.30it/s]
 76%|███████▌  | 281569/371472 [14:14<7:36:13,  3.28it/s]
 76%|███████▌  | 281570/371472 [14:14<7:13:24,  3.46it/s]
 76%|███████▌  | 281571/371472 [14:14<6:59:02,  3.58it/s]
 76%|███████▌  | 281572/371472 [14:14<7:02:21,  3.55it/s]
 76%|███████▌  | 281573/371472 [14:15<7:17:23,  3.43it/s]
 76%|███████▌  | 281574/371472 [14:15<7:14:02,  3.45it/s]
 76%|███████▌  | 281575/371472 [14:15<7:17:48,  3.42it/s]
 76%|███████▌  | 281576/371472 [14:16<7:11:02,  3.48it/s]
 76%|███████▌  | 281577/371472 [14:16<7:03:10,  3.54it/s]
 76%|███████▌  | 281578/371472 [14:16<7:08:10,  3.50it/s]
 76%|███████▌  | 281579/371472 [14:16<6:56:40,  3.60it/s]
 76%|███████▌  | 281580/371472 [14:17<6:54:43,  3.61it/s]
                                                         
{'loss': 2.7017, 'learning_rate': 3.179070869874377e-07, 'epoch': 12.13}

 76%|███████▌  | 281580/371472 [14:17<6:54:43,  3.61it/s]
 76%|███████▌  | 281581/371472 [14:17<6:56:45,  3.59it/s]
 76%|███████▌  | 281582/371472 [14:17<7:02:59,  3.54it/s]
 76%|███████▌  | 281583/371472 [14:18<7:08:12,  3.50it/s]
 76%|███████▌  | 281584/371472 [14:18<7:03:08,  3.54it/s]
 76%|███████▌  | 281585/371472 [14:18<6:48:23,  3.67it/s]
 76%|███████▌  | 281586/371472 [14:18<6:48:44,  3.67it/s]
 76%|███████▌  | 281587/371472 [14:19<6:58:12,  3.58it/s]
 76%|███████▌  | 281588/371472 [14:19<6:50:58,  3.65it/s]
 76%|███████▌  | 281589/371472 [14:19<6:53:39,  3.62it/s]
 76%|███████▌  | 281590/371472 [14:19<6:45:20,  3.70it/s]
 76%|███████▌  | 281591/371472 [14:20<6:50:51,  3.65it/s]
 76%|███████▌  | 281592/371472 [14:20<7:27:58,  3.34it/s]
 76%|███████▌  | 281593/371472 [14:20<7:11:28,  3.47it/s]
 76%|███████▌  | 281594/371472 [14:21<7:13:42,  3.45it/s]
 76%|███████▌  | 281595/371472 [14:21<7:02:16,  3.55it/s]
 76%|███████▌  | 281596/371472 [14:21<7:50:06,  3.19it/s]
 76%|███████▌  | 281597/371472 [14:22<7:27:29,  3.35it/s]
 76%|███████▌  | 281598/371472 [14:22<7:40:12,  3.25it/s]
 76%|███████▌  | 281599/371472 [14:22<7:12:56,  3.46it/s]
 76%|███████▌  | 281600/371472 [14:22<7:30:34,  3.32it/s]
                                                         
{'loss': 2.732, 'learning_rate': 3.1785860501195887e-07, 'epoch': 12.13}

 76%|███████▌  | 281600/371472 [14:22<7:30:34,  3.32it/s]
 76%|███████▌  | 281601/371472 [14:23<7:08:14,  3.50it/s]
 76%|███████▌  | 281602/371472 [14:23<7:12:02,  3.47it/s]
 76%|███████▌  | 281603/371472 [14:23<7:01:47,  3.55it/s]
 76%|███████▌  | 281604/371472 [14:24<6:50:25,  3.65it/s]
 76%|███████▌  | 281605/371472 [14:24<6:55:58,  3.60it/s]
 76%|███████▌  | 281606/371472 [14:24<7:04:55,  3.52it/s]
 76%|███████▌  | 281607/371472 [14:24<7:06:40,  3.51it/s]
 76%|███████▌  | 281608/371472 [14:25<7:43:12,  3.23it/s]
 76%|███████▌  | 281609/371472 [14:25<7:28:30,  3.34it/s]
 76%|███████▌  | 281610/371472 [14:25<8:02:09,  3.11it/s]
 76%|███████▌  | 281611/371472 [14:26<7:41:59,  3.24it/s]
 76%|███████▌  | 281612/371472 [14:26<7:28:49,  3.34it/s]
 76%|███████▌  | 281613/371472 [14:26<7:43:24,  3.23it/s]
 76%|███████▌  | 281614/371472 [14:27<8:15:13,  3.02it/s]
 76%|███████▌  | 281615/371472 [14:27<7:43:23,  3.23it/s]
 76%|███████▌  | 281616/371472 [14:27<7:22:12,  3.39it/s]
 76%|███████▌  | 281617/371472 [14:28<7:36:43,  3.28it/s]
 76%|███████▌  | 281618/371472 [14:28<7:21:59,  3.39it/s]
 76%|███████▌  | 281619/371472 [14:28<7:09:33,  3.49it/s]
 76%|███████▌  | 281620/371472 [14:28<6:57:25,  3.59it/s]
                                                         
{'loss': 2.5736, 'learning_rate': 3.178101230364799e-07, 'epoch': 12.13}

 76%|███████▌  | 281620/371472 [14:28<6:57:25,  3.59it/s]
 76%|███████▌  | 281621/371472 [14:29<7:00:36,  3.56it/s]
 76%|███████▌  | 281622/371472 [14:29<6:50:17,  3.65it/s]
 76%|███████▌  | 281623/371472 [14:29<7:09:03,  3.49it/s]
 76%|███████▌  | 281624/371472 [14:29<6:54:30,  3.61it/s]
 76%|███████▌  | 281625/371472 [14:30<7:21:35,  3.39it/s]
 76%|███████▌  | 281626/371472 [14:30<7:19:36,  3.41it/s]
 76%|███████▌  | 281627/371472 [14:30<7:10:58,  3.47it/s]
 76%|███████▌  | 281628/371472 [14:31<7:03:19,  3.54it/s]
 76%|███████▌  | 281629/371472 [14:31<7:25:34,  3.36it/s]
 76%|███████▌  | 281630/371472 [14:31<7:30:03,  3.33it/s]
 76%|███████▌  | 281631/371472 [14:32<7:35:31,  3.29it/s]
 76%|███████▌  | 281632/371472 [14:32<7:18:08,  3.42it/s]
 76%|███████▌  | 281633/371472 [14:32<7:09:18,  3.49it/s]
 76%|███████▌  | 281634/371472 [14:32<7:06:09,  3.51it/s]
 76%|███████▌  | 281635/371472 [14:33<6:53:32,  3.62it/s]
 76%|███████▌  | 281636/371472 [14:33<6:51:48,  3.64it/s]
 76%|███████▌  | 281637/371472 [14:33<6:58:30,  3.58it/s]
 76%|███████▌  | 281638/371472 [14:33<7:03:57,  3.53it/s]
 76%|███████▌  | 281639/371472 [14:34<7:01:12,  3.55it/s]
 76%|███████▌  | 281640/371472 [14:34<6:58:23,  3.58it/s]
                                                         
{'loss': 2.6226, 'learning_rate': 3.177616410610011e-07, 'epoch': 12.13}

 76%|███████▌  | 281640/371472 [14:34<6:58:23,  3.58it/s]
 76%|███████▌  | 281641/371472 [14:34<6:59:38,  3.57it/s]
 76%|███████▌  | 281642/371472 [14:35<6:53:59,  3.62it/s]
 76%|███████▌  | 281643/371472 [14:35<6:47:36,  3.67it/s]
 76%|███████▌  | 281644/371472 [14:35<7:11:39,  3.47it/s]
 76%|███████▌  | 281645/371472 [14:35<6:53:29,  3.62it/s]
 76%|███████▌  | 281646/371472 [14:36<6:39:48,  3.74it/s]
 76%|███████▌  | 281647/371472 [14:36<7:37:12,  3.27it/s]
 76%|███████▌  | 281648/371472 [14:36<7:27:42,  3.34it/s]
 76%|███████▌  | 281649/371472 [14:37<7:22:40,  3.38it/s]
 76%|███████▌  | 281650/371472 [14:37<7:58:50,  3.13it/s]
 76%|███████▌  | 281651/371472 [14:37<7:22:23,  3.38it/s]
 76%|███████▌  | 281652/371472 [14:38<8:35:48,  2.90it/s]
 76%|███████▌  | 281653/371472 [14:38<8:05:58,  3.08it/s]
 76%|███████▌  | 281654/371472 [14:38<8:37:44,  2.89it/s]
 76%|███████▌  | 281655/371472 [14:39<8:07:11,  3.07it/s]
 76%|███████▌  | 281656/371472 [14:39<7:36:27,  3.28it/s]
 76%|███████▌  | 281657/371472 [14:39<7:56:32,  3.14it/s]
 76%|███████▌  | 281658/371472 [14:40<7:31:12,  3.32it/s]
 76%|███████▌  | 281659/371472 [14:40<7:07:31,  3.50it/s]
 76%|███████▌  | 281660/371472 [14:40<7:09:43,  3.48it/s]
                                                         
{'loss': 2.6062, 'learning_rate': 3.177131590855222e-07, 'epoch': 12.13}

 76%|███████▌  | 281660/371472 [14:40<7:09:43,  3.48it/s]
 76%|███████▌  | 281661/371472 [14:40<7:17:42,  3.42it/s]
 76%|███████▌  | 281662/371472 [14:41<7:18:02,  3.42it/s]
 76%|███████▌  | 281663/371472 [14:41<7:08:45,  3.49it/s]
 76%|███████▌  | 281664/371472 [14:41<6:57:44,  3.58it/s]
 76%|███████▌  | 281665/371472 [14:42<7:15:38,  3.44it/s]
 76%|███████▌  | 281666/371472 [14:42<7:10:29,  3.48it/s]
 76%|███████▌  | 281667/371472 [14:42<7:09:38,  3.48it/s]
 76%|███████▌  | 281668/371472 [14:42<6:58:47,  3.57it/s]
 76%|███████▌  | 281669/371472 [14:43<6:44:06,  3.70it/s]
 76%|███████▌  | 281670/371472 [14:43<7:11:10,  3.47it/s]
 76%|███████▌  | 281671/371472 [14:43<7:00:15,  3.56it/s]
 76%|███████▌  | 281672/371472 [14:44<7:15:04,  3.44it/s]
 76%|███████▌  | 281673/371472 [14:44<7:11:27,  3.47it/s]
 76%|███████▌  | 281674/371472 [14:44<7:05:46,  3.52it/s]
 76%|███████▌  | 281675/371472 [14:44<7:02:03,  3.55it/s]
 76%|███████▌  | 281676/371472 [14:45<7:11:45,  3.47it/s]
 76%|███████▌  | 281677/371472 [14:45<7:02:12,  3.54it/s]
 76%|███████▌  | 281678/371472 [14:45<7:39:52,  3.25it/s]
 76%|███████▌  | 281679/371472 [14:46<7:12:47,  3.46it/s]
 76%|███████▌  | 281680/371472 [14:46<7:34:48,  3.29it/s]
                                                         
{'loss': 2.6981, 'learning_rate': 3.176646771100433e-07, 'epoch': 12.13}

 76%|███████▌  | 281680/371472 [14:46<7:34:48,  3.29it/s]
 76%|███████▌  | 281681/371472 [14:46<7:42:05,  3.24it/s]
 76%|███████▌  | 281682/371472 [14:46<7:26:10,  3.35it/s]
 76%|███████▌  | 281683/371472 [14:47<7:09:43,  3.48it/s]
 76%|███████▌  | 281684/371472 [14:47<7:01:11,  3.55it/s]
 76%|███████▌  | 281685/371472 [14:47<7:04:23,  3.53it/s]
 76%|███████▌  | 281686/371472 [14:48<6:55:16,  3.60it/s]
 76%|███████▌  | 281687/371472 [14:48<6:54:31,  3.61it/s]
 76%|███████▌  | 281688/371472 [14:48<6:43:04,  3.71it/s]
 76%|███████▌  | 281689/371472 [14:48<6:53:42,  3.62it/s]
 76%|███████▌  | 281690/371472 [14:49<6:56:40,  3.59it/s]
 76%|███████▌  | 281691/371472 [14:49<6:57:24,  3.58it/s]
 76%|███████▌  | 281692/371472 [14:49<7:28:47,  3.33it/s]
 76%|███████▌  | 281693/371472 [14:50<7:04:40,  3.52it/s]
 76%|███████▌  | 281694/371472 [14:50<7:04:38,  3.52it/s]
 76%|███████▌  | 281695/371472 [14:50<7:03:27,  3.53it/s]
 76%|███████▌  | 281696/371472 [14:50<6:56:26,  3.59it/s]
 76%|███████▌  | 281697/371472 [14:51<6:48:43,  3.66it/s]
 76%|███████▌  | 281698/371472 [14:51<7:08:31,  3.49it/s]
 76%|███████▌  | 281699/371472 [14:51<7:37:24,  3.27it/s]
 76%|███████▌  | 281700/371472 [14:52<7:25:33,  3.36it/s]
                                                         
{'loss': 2.6678, 'learning_rate': 3.176161951345644e-07, 'epoch': 12.13}

 76%|███████▌  | 281700/371472 [14:52<7:25:33,  3.36it/s]
 76%|███████▌  | 281701/371472 [14:52<7:18:48,  3.41it/s]
 76%|███████▌  | 281702/371472 [14:52<7:06:05,  3.51it/s]
 76%|███████▌  | 281703/371472 [14:52<6:53:30,  3.62it/s]
 76%|███████▌  | 281704/371472 [14:53<6:59:49,  3.56it/s]
 76%|███████▌  | 281705/371472 [14:53<7:31:44,  3.31it/s]
 76%|███████▌  | 281706/371472 [14:53<7:22:52,  3.38it/s]
 76%|███████▌  | 281707/371472 [14:54<8:01:49,  3.11it/s]
 76%|███████▌  | 281708/371472 [14:54<7:40:13,  3.25it/s]
 76%|███████▌  | 281709/371472 [14:54<7:18:11,  3.41it/s]
 76%|███████▌  | 281710/371472 [14:54<7:15:58,  3.43it/s]
 76%|███████▌  | 281711/371472 [14:55<7:19:28,  3.40it/s]
 76%|███████▌  | 281712/371472 [14:55<7:14:16,  3.44it/s]
 76%|███████▌  | 281713/371472 [14:55<7:25:21,  3.36it/s]
 76%|███████▌  | 281714/371472 [14:56<7:43:14,  3.23it/s]
 76%|███████▌  | 281715/371472 [14:56<7:40:59,  3.25it/s]
 76%|███████▌  | 281716/371472 [14:56<7:46:07,  3.21it/s]
 76%|███████▌  | 281717/371472 [14:57<8:13:52,  3.03it/s]
 76%|███████▌  | 281718/371472 [14:57<7:56:53,  3.14it/s]
 76%|███████▌  | 281719/371472 [14:57<8:00:39,  3.11it/s]
 76%|███████▌  | 281720/371472 [14:58<7:32:23,  3.31it/s]
                                                         
{'loss': 2.5356, 'learning_rate': 3.175677131590855e-07, 'epoch': 12.13}

 76%|███████▌  | 281720/371472 [14:58<7:32:23,  3.31it/s]
 76%|███████▌  | 281721/371472 [14:58<7:16:00,  3.43it/s]
 76%|███████▌  | 281722/371472 [14:58<7:07:57,  3.50it/s]
 76%|███████▌  | 281723/371472 [14:58<7:04:44,  3.52it/s]
 76%|███████▌  | 281724/371472 [14:59<6:54:51,  3.61it/s]
 76%|███████▌  | 281725/371472 [14:59<6:57:46,  3.58it/s]
 76%|███████▌  | 281726/371472 [14:59<6:55:16,  3.60it/s]
 76%|███████▌  | 281727/371472 [15:00<7:23:34,  3.37it/s]
 76%|███████▌  | 281728/371472 [15:00<7:04:03,  3.53it/s]
 76%|███████▌  | 281729/371472 [15:00<7:07:49,  3.50it/s]
 76%|███████▌  | 281730/371472 [15:01<8:41:29,  2.87it/s]
 76%|███████▌  | 281731/371472 [15:01<7:54:24,  3.15it/s]
 76%|███████▌  | 281732/371472 [15:01<8:03:58,  3.09it/s]
 76%|███████▌  | 281733/371472 [15:02<7:58:55,  3.12it/s]
 76%|███████▌  | 281734/371472 [15:02<7:57:13,  3.13it/s]
 76%|███████▌  | 281735/371472 [15:02<7:41:26,  3.24it/s]
 76%|███████▌  | 281736/371472 [15:02<7:26:18,  3.35it/s]
 76%|███████▌  | 281737/371472 [15:03<7:42:10,  3.24it/s]
 76%|███████▌  | 281738/371472 [15:03<7:29:13,  3.33it/s]
 76%|███████▌  | 281739/371472 [15:03<7:17:48,  3.42it/s]
 76%|███████▌  | 281740/371472 [15:04<7:24:23,  3.37it/s]
                                                         
{'loss': 2.8069, 'learning_rate': 3.175192311836066e-07, 'epoch': 12.14}

 76%|███████▌  | 281740/371472 [15:04<7:24:23,  3.37it/s]
 76%|███████▌  | 281741/371472 [15:04<7:08:09,  3.49it/s]
 76%|███████▌  | 281742/371472 [15:04<7:05:32,  3.51it/s]
 76%|███████▌  | 281743/371472 [15:04<6:59:44,  3.56it/s]
 76%|███████▌  | 281744/371472 [15:05<7:06:41,  3.50it/s]
 76%|███████▌  | 281745/371472 [15:05<7:24:40,  3.36it/s]
 76%|███████▌  | 281746/371472 [15:05<7:10:19,  3.48it/s]
 76%|███████▌  | 281747/371472 [15:06<7:11:30,  3.47it/s]
 76%|███████▌  | 281748/371472 [15:06<6:57:34,  3.58it/s]
 76%|███████▌  | 281749/371472 [15:06<7:20:25,  3.40it/s]
 76%|███████▌  | 281750/371472 [15:07<7:57:47,  3.13it/s]
 76%|███████▌  | 281751/371472 [15:07<7:34:05,  3.29it/s]
 76%|███████▌  | 281752/371472 [15:07<7:16:11,  3.43it/s]
 76%|███████▌  | 281753/371472 [15:07<7:19:36,  3.40it/s]
 76%|███████▌  | 281754/371472 [15:08<7:09:48,  3.48it/s]
 76%|███████▌  | 281755/371472 [15:08<7:37:45,  3.27it/s]
 76%|███████▌  | 281756/371472 [15:08<7:14:46,  3.44it/s]
 76%|███████▌  | 281757/371472 [15:09<7:06:37,  3.50it/s]
 76%|███████▌  | 281758/371472 [15:09<7:40:56,  3.24it/s]
 76%|███████▌  | 281759/371472 [15:09<7:56:08,  3.14it/s]
 76%|███████▌  | 281760/371472 [15:09<7:34:08,  3.29it/s]
                                                         
{'loss': 2.6572, 'learning_rate': 3.1747074920812776e-07, 'epoch': 12.14}

 76%|███████▌  | 281760/371472 [15:09<7:34:08,  3.29it/s]
 76%|███████▌  | 281761/371472 [15:10<7:28:58,  3.33it/s]
 76%|███████▌  | 281762/371472 [15:10<7:30:43,  3.32it/s]
 76%|███████▌  | 281763/371472 [15:10<7:06:25,  3.51it/s]
 76%|███████▌  | 281764/371472 [15:11<7:05:03,  3.52it/s]
 76%|███████▌  | 281765/371472 [15:11<7:13:01,  3.45it/s]
 76%|███████▌  | 281766/371472 [15:11<7:17:05,  3.42it/s]
 76%|███████▌  | 281767/371472 [15:11<7:03:24,  3.53it/s]
 76%|███████▌  | 281768/371472 [15:12<7:16:53,  3.42it/s]
 76%|███████▌  | 281769/371472 [15:12<7:38:38,  3.26it/s]
 76%|███████▌  | 281770/371472 [15:12<7:30:54,  3.32it/s]
 76%|███████▌  | 281771/371472 [15:13<7:26:36,  3.35it/s]
 76%|███████▌  | 281772/371472 [15:13<7:09:14,  3.48it/s]
 76%|███████▌  | 281773/371472 [15:13<7:12:57,  3.45it/s]
 76%|███████▌  | 281774/371472 [15:14<7:18:25,  3.41it/s]
 76%|███████▌  | 281775/371472 [15:14<7:30:51,  3.32it/s]
 76%|███████▌  | 281776/371472 [15:14<7:18:12,  3.41it/s]
 76%|███████▌  | 281777/371472 [15:14<7:07:32,  3.50it/s]
 76%|███████▌  | 281778/371472 [15:15<7:18:08,  3.41it/s]
 76%|███████▌  | 281779/371472 [15:15<7:10:26,  3.47it/s]
 76%|███████▌  | 281780/371472 [15:15<7:07:57,  3.49it/s]
                                                         
{'loss': 2.7969, 'learning_rate': 3.1742226723264883e-07, 'epoch': 12.14}

 76%|███████▌  | 281780/371472 [15:15<7:07:57,  3.49it/s]
 76%|███████▌  | 281781/371472 [15:16<7:22:33,  3.38it/s]
 76%|███████▌  | 281782/371472 [15:16<7:13:18,  3.45it/s]
 76%|███████▌  | 281783/371472 [15:16<7:21:48,  3.38it/s]
 76%|███████▌  | 281784/371472 [15:17<7:22:36,  3.38it/s]
 76%|███████▌  | 281785/371472 [15:17<7:14:07,  3.44it/s]
 76%|███████▌  | 281786/371472 [15:17<7:20:14,  3.40it/s]
 76%|███████▌  | 281787/371472 [15:17<7:38:30,  3.26it/s]
 76%|███████▌  | 281788/371472 [15:18<7:08:55,  3.48it/s]
 76%|███████▌  | 281789/371472 [15:18<6:55:00,  3.60it/s]
 76%|███████▌  | 281790/371472 [15:18<6:58:22,  3.57it/s]
 76%|███████▌  | 281791/371472 [15:18<6:54:37,  3.60it/s]
 76%|███████▌  | 281792/371472 [15:19<6:47:17,  3.67it/s]
 76%|███████▌  | 281793/371472 [15:19<6:48:13,  3.66it/s]
 76%|███████▌  | 281794/371472 [15:19<6:53:33,  3.61it/s]
 76%|███████▌  | 281795/371472 [15:20<6:42:46,  3.71it/s]
 76%|███████▌  | 281796/371472 [15:20<6:36:25,  3.77it/s]
 76%|███████▌  | 281797/371472 [15:20<6:33:34,  3.80it/s]
 76%|███████▌  | 281798/371472 [15:20<6:33:14,  3.80it/s]
 76%|███████▌  | 281799/371472 [15:21<6:32:13,  3.81it/s]
 76%|███████▌  | 281800/371472 [15:21<6:34:39,  3.79it/s]
                                                         
{'loss': 2.635, 'learning_rate': 3.1737378525716996e-07, 'epoch': 12.14}

 76%|███████▌  | 281800/371472 [15:21<6:34:39,  3.79it/s]
 76%|███████▌  | 281801/371472 [15:21<6:30:50,  3.82it/s]
 76%|███████▌  | 281802/371472 [15:21<7:01:26,  3.55it/s]
 76%|███████▌  | 281803/371472 [15:22<6:51:01,  3.64it/s]
 76%|███████▌  | 281804/371472 [15:22<7:06:59,  3.50it/s]
 76%|███████▌  | 281805/371472 [15:22<7:15:30,  3.43it/s]
 76%|███████▌  | 281806/371472 [15:23<7:02:48,  3.53it/s]
 76%|███████▌  | 281807/371472 [15:23<7:04:19,  3.52it/s]
 76%|███████▌  | 281808/371472 [15:23<7:54:45,  3.15it/s]
 76%|███████▌  | 281809/371472 [15:24<7:30:47,  3.32it/s]
 76%|███████▌  | 281810/371472 [15:24<7:27:33,  3.34it/s]
 76%|███████▌  | 281811/371472 [15:24<7:22:55,  3.37it/s]
 76%|███████▌  | 281812/371472 [15:24<7:13:51,  3.44it/s]
 76%|███████▌  | 281813/371472 [15:25<7:01:35,  3.54it/s]
 76%|███████▌  | 281814/371472 [15:25<6:42:46,  3.71it/s]
 76%|███████▌  | 281815/371472 [15:25<6:45:21,  3.69it/s]
 76%|███████▌  | 281816/371472 [15:25<6:34:34,  3.79it/s]
 76%|███████▌  | 281817/371472 [15:26<6:48:04,  3.66it/s]
 76%|███████▌  | 281818/371472 [15:26<7:07:23,  3.50it/s]
 76%|███████▌  | 281819/371472 [15:26<7:09:05,  3.48it/s]
 76%|███████▌  | 281820/371472 [15:27<7:31:26,  3.31it/s]
                                                         
{'loss': 2.7737, 'learning_rate': 3.1732530328169103e-07, 'epoch': 12.14}

 76%|███████▌  | 281820/371472 [15:27<7:31:26,  3.31it/s]
 76%|███████▌  | 281821/371472 [15:27<7:39:09,  3.25it/s]
 76%|███████▌  | 281822/371472 [15:27<7:23:51,  3.37it/s]
 76%|███████▌  | 281823/371472 [15:28<7:31:34,  3.31it/s]
 76%|███████▌  | 281824/371472 [15:28<7:17:43,  3.41it/s]
 76%|███████▌  | 281825/371472 [15:28<7:13:35,  3.45it/s]
 76%|███████▌  | 281826/371472 [15:28<7:26:54,  3.34it/s]
 76%|███████▌  | 281827/371472 [15:29<7:30:07,  3.32it/s]
 76%|███████▌  | 281828/371472 [15:29<7:17:24,  3.42it/s]
 76%|███████▌  | 281829/371472 [15:29<7:03:31,  3.53it/s]
 76%|███████▌  | 281830/371472 [15:30<7:05:00,  3.52it/s]
 76%|███████▌  | 281831/371472 [15:30<7:42:41,  3.23it/s]
 76%|███████▌  | 281832/371472 [15:30<7:22:54,  3.37it/s]
 76%|███████▌  | 281833/371472 [15:30<7:09:56,  3.47it/s]
 76%|███████▌  | 281834/371472 [15:31<6:56:28,  3.59it/s]
 76%|███████▌  | 281835/371472 [15:31<6:54:14,  3.61it/s]
 76%|███████▌  | 281836/371472 [15:31<6:41:54,  3.72it/s]
 76%|███████▌  | 281837/371472 [15:32<6:47:14,  3.67it/s]
 76%|███████▌  | 281838/371472 [15:32<6:52:25,  3.62it/s]
 76%|███████▌  | 281839/371472 [15:32<6:43:53,  3.70it/s]
 76%|███████▌  | 281840/371472 [15:32<6:46:34,  3.67it/s]
                                                         
{'loss': 2.6968, 'learning_rate': 3.1727682130621215e-07, 'epoch': 12.14}

 76%|███████▌  | 281840/371472 [15:32<6:46:34,  3.67it/s]
 76%|███████▌  | 281841/371472 [15:33<6:52:40,  3.62it/s]
 76%|███████▌  | 281842/371472 [15:33<6:59:37,  3.56it/s]
 76%|███████▌  | 281843/371472 [15:33<6:52:36,  3.62it/s]
 76%|███████▌  | 281844/371472 [15:33<6:49:59,  3.64it/s]
 76%|███████▌  | 281845/371472 [15:34<7:08:25,  3.49it/s]
 76%|███████▌  | 281846/371472 [15:34<6:56:55,  3.58it/s]
 76%|███████▌  | 281847/371472 [15:34<6:54:12,  3.61it/s]
 76%|███████▌  | 281848/371472 [15:35<6:45:07,  3.69it/s]
 76%|███████▌  | 281849/371472 [15:35<6:45:40,  3.68it/s]
 76%|███████▌  | 281850/371472 [15:35<6:48:44,  3.65it/s]
 76%|███████▌  | 281851/371472 [15:35<7:05:26,  3.51it/s]
 76%|███████▌  | 281852/371472 [15:36<7:02:19,  3.54it/s]
 76%|███████▌  | 281853/371472 [15:36<7:13:04,  3.45it/s]
 76%|███████▌  | 281854/371472 [15:36<7:34:31,  3.29it/s]
 76%|███████▌  | 281855/371472 [15:37<7:24:42,  3.36it/s]
 76%|███████▌  | 281856/371472 [15:37<7:01:03,  3.55it/s]
 76%|███████▌  | 281857/371472 [15:37<6:57:32,  3.58it/s]
 76%|███████▌  | 281858/371472 [15:37<7:01:18,  3.55it/s]
 76%|███████▌  | 281859/371472 [15:38<7:18:55,  3.40it/s]
 76%|███████▌  | 281860/371472 [15:38<7:22:06,  3.38it/s]
                                                         
{'loss': 2.6456, 'learning_rate': 3.172283393307332e-07, 'epoch': 12.14}

 76%|███████▌  | 281860/371472 [15:38<7:22:06,  3.38it/s]
 76%|███████▌  | 281861/371472 [15:38<7:30:40,  3.31it/s]
 76%|███████▌  | 281862/371472 [15:39<7:12:58,  3.45it/s]
 76%|███████▌  | 281863/371472 [15:39<7:17:22,  3.41it/s]
 76%|███████▌  | 281864/371472 [15:39<6:58:01,  3.57it/s]
 76%|███████▌  | 281865/371472 [15:39<6:54:35,  3.60it/s]
 76%|███████▌  | 281866/371472 [15:40<6:51:17,  3.63it/s]
 76%|███████▌  | 281867/371472 [15:40<6:45:52,  3.68it/s]
 76%|███████▌  | 281868/371472 [15:40<7:01:18,  3.54it/s]
 76%|███████▌  | 281869/371472 [15:41<6:48:15,  3.66it/s]
 76%|███████▌  | 281870/371472 [15:41<7:31:55,  3.30it/s]
 76%|███████▌  | 281871/371472 [15:41<7:31:35,  3.31it/s]
 76%|███████▌  | 281872/371472 [15:42<7:31:38,  3.31it/s]
 76%|███████▌  | 281873/371472 [15:42<8:00:44,  3.11it/s]
 76%|███████▌  | 281874/371472 [15:42<7:51:25,  3.17it/s]
 76%|███████▌  | 281875/371472 [15:42<7:26:53,  3.34it/s]
 76%|███████▌  | 281876/371472 [15:43<7:21:33,  3.38it/s]
 76%|███████▌  | 281877/371472 [15:43<7:11:31,  3.46it/s]
 76%|███████▌  | 281878/371472 [15:43<7:08:57,  3.48it/s]
 76%|███████▌  | 281879/371472 [15:44<6:56:17,  3.59it/s]
 76%|███████▌  | 281880/371472 [15:44<7:19:46,  3.40it/s]
                                                         
{'loss': 2.7025, 'learning_rate': 3.171798573552544e-07, 'epoch': 12.14}

 76%|███████▌  | 281880/371472 [15:44<7:19:46,  3.40it/s]
 76%|███████▌  | 281881/371472 [15:44<7:04:34,  3.52it/s]
 76%|███████▌  | 281882/371472 [15:44<6:53:31,  3.61it/s]
 76%|███████▌  | 281883/371472 [15:45<6:57:45,  3.57it/s]
 76%|███████▌  | 281884/371472 [15:45<7:26:11,  3.35it/s]
 76%|███████▌  | 281885/371472 [15:45<7:19:45,  3.40it/s]
 76%|███████▌  | 281886/371472 [15:46<7:12:23,  3.45it/s]
 76%|███████▌  | 281887/371472 [15:46<8:27:31,  2.94it/s]
 76%|███████▌  | 281888/371472 [15:46<7:52:38,  3.16it/s]
 76%|███████▌  | 281889/371472 [15:47<7:37:55,  3.26it/s]
 76%|███████▌  | 281890/371472 [15:47<8:09:04,  3.05it/s]
 76%|███████▌  | 281891/371472 [15:47<7:33:36,  3.29it/s]
 76%|███████▌  | 281892/371472 [15:47<7:19:02,  3.40it/s]
 76%|███████▌  | 281893/371472 [15:48<7:01:55,  3.54it/s]
 76%|███████▌  | 281894/371472 [15:48<6:56:39,  3.58it/s]
 76%|███████▌  | 281895/371472 [15:48<7:07:08,  3.50it/s]
 76%|███████▌  | 281896/371472 [15:49<6:58:21,  3.57it/s]
 76%|███████▌  | 281897/371472 [15:49<6:57:21,  3.58it/s]
 76%|███████▌  | 281898/371472 [15:49<7:23:41,  3.36it/s]
 76%|███████▌  | 281899/371472 [15:50<7:56:53,  3.13it/s]
 76%|███████▌  | 281900/371472 [15:50<7:36:26,  3.27it/s]
                                                         
{'loss': 2.7486, 'learning_rate': 3.171313753797755e-07, 'epoch': 12.14}

 76%|███████▌  | 281900/371472 [15:50<7:36:26,  3.27it/s]
 76%|███████▌  | 281901/371472 [15:50<7:50:13,  3.17it/s]
 76%|███████▌  | 281902/371472 [15:50<7:21:35,  3.38it/s]
 76%|███████▌  | 281903/371472 [15:51<7:12:31,  3.45it/s]
 76%|███████▌  | 281904/371472 [15:51<7:07:46,  3.49it/s]
 76%|███████▌  | 281905/371472 [15:51<7:02:39,  3.53it/s]
 76%|███████▌  | 281906/371472 [15:52<7:00:27,  3.55it/s]
 76%|███████▌  | 281907/371472 [15:52<7:07:15,  3.49it/s]
 76%|███████▌  | 281908/371472 [15:52<7:08:06,  3.49it/s]
 76%|███████▌  | 281909/371472 [15:52<7:31:25,  3.31it/s]
 76%|███████▌  | 281910/371472 [15:53<7:18:22,  3.41it/s]
 76%|███████▌  | 281911/371472 [15:53<7:35:48,  3.27it/s]
 76%|███████▌  | 281912/371472 [15:53<7:14:23,  3.44it/s]
 76%|███████▌  | 281913/371472 [15:54<7:18:02,  3.41it/s]
 76%|███████▌  | 281914/371472 [15:54<7:10:09,  3.47it/s]
 76%|███████▌  | 281915/371472 [15:54<7:08:40,  3.48it/s]
 76%|███████▌  | 281916/371472 [15:55<7:31:50,  3.30it/s]
 76%|███████▌  | 281917/371472 [15:55<7:12:26,  3.45it/s]
 76%|███████▌  | 281918/371472 [15:55<7:10:42,  3.47it/s]
 76%|███████▌  | 281919/371472 [15:55<6:58:32,  3.57it/s]
 76%|███████▌  | 281920/371472 [15:56<7:39:38,  3.25it/s]
                                                         
{'loss': 2.5102, 'learning_rate': 3.1708289340429665e-07, 'epoch': 12.14}

 76%|███████▌  | 281920/371472 [15:56<7:39:38,  3.25it/s]
 76%|███████▌  | 281921/371472 [15:56<7:13:45,  3.44it/s]
 76%|███████▌  | 281922/371472 [15:56<7:24:26,  3.36it/s]
 76%|███████▌  | 281923/371472 [15:57<7:08:40,  3.48it/s]
 76%|███████▌  | 281924/371472 [15:57<7:52:13,  3.16it/s]
 76%|███████▌  | 281925/371472 [15:57<8:04:27,  3.08it/s]
 76%|███████▌  | 281926/371472 [15:58<7:37:42,  3.26it/s]
 76%|███████▌  | 281927/371472 [15:58<7:27:04,  3.34it/s]
 76%|███████▌  | 281928/371472 [15:58<7:29:04,  3.32it/s]
 76%|███████▌  | 281929/371472 [15:58<7:14:01,  3.44it/s]
 76%|███████▌  | 281930/371472 [15:59<7:06:35,  3.50it/s]
 76%|███████▌  | 281931/371472 [15:59<6:57:24,  3.58it/s]
 76%|███████▌  | 281932/371472 [15:59<6:54:19,  3.60it/s]
 76%|███████▌  | 281933/371472 [15:59<6:47:40,  3.66it/s]
 76%|███████▌  | 281934/371472 [16:00<6:43:48,  3.70it/s]
 76%|███████▌  | 281935/371472 [16:00<6:30:20,  3.82it/s]
 76%|███████▌  | 281936/371472 [16:00<6:31:13,  3.81it/s]
 76%|███████▌  | 281937/371472 [16:01<6:53:16,  3.61it/s]
 76%|███████▌  | 281938/371472 [16:01<7:16:37,  3.42it/s]
 76%|███████▌  | 281939/371472 [16:01<7:12:59,  3.45it/s]
 76%|███████▌  | 281940/371472 [16:01<7:02:28,  3.53it/s]
                                                         
{'loss': 2.7809, 'learning_rate': 3.1703441142881767e-07, 'epoch': 12.14}

 76%|███████▌  | 281940/371472 [16:01<7:02:28,  3.53it/s]
 76%|███████▌  | 281941/371472 [16:02<6:50:56,  3.63it/s]
 76%|███████▌  | 281942/371472 [16:02<7:23:38,  3.36it/s]
 76%|███████▌  | 281943/371472 [16:02<7:30:54,  3.31it/s]
 76%|███████▌  | 281944/371472 [16:03<7:43:19,  3.22it/s]
 76%|███████▌  | 281945/371472 [16:03<7:23:50,  3.36it/s]
 76%|███████▌  | 281946/371472 [16:03<7:19:14,  3.40it/s]
 76%|███████▌  | 281947/371472 [16:03<7:05:29,  3.51it/s]
 76%|███████▌  | 281948/371472 [16:04<7:08:38,  3.48it/s]
 76%|███████▌  | 281949/371472 [16:04<7:00:28,  3.55it/s]
 76%|███████▌  | 281950/371472 [16:04<7:21:09,  3.38it/s]
 76%|███████▌  | 281951/371472 [16:05<7:14:42,  3.43it/s]
 76%|███████▌  | 281952/371472 [16:05<7:08:14,  3.48it/s]
 76%|███████▌  | 281953/371472 [16:05<7:10:13,  3.47it/s]
 76%|███████▌  | 281954/371472 [16:06<7:15:20,  3.43it/s]
 76%|███████▌  | 281955/371472 [16:06<6:54:27,  3.60it/s]
 76%|███████▌  | 281956/371472 [16:06<7:01:59,  3.54it/s]
 76%|███████▌  | 281957/371472 [16:06<6:44:31,  3.69it/s]
 76%|███████▌  | 281958/371472 [16:07<6:43:14,  3.70it/s]
 76%|███████▌  | 281959/371472 [16:07<6:44:40,  3.69it/s]
 76%|███████▌  | 281960/371472 [16:07<6:44:07,  3.69it/s]
                                                         
{'loss': 2.507, 'learning_rate': 3.1698592945333874e-07, 'epoch': 12.14}

 76%|███████▌  | 281960/371472 [16:07<6:44:07,  3.69it/s]
 76%|███████▌  | 281961/371472 [16:07<7:14:01,  3.44it/s]
 76%|███████▌  | 281962/371472 [16:08<6:54:53,  3.60it/s]
 76%|███████▌  | 281963/371472 [16:08<7:35:22,  3.28it/s]
 76%|███████▌  | 281964/371472 [16:08<7:22:47,  3.37it/s]
 76%|███████▌  | 281965/371472 [16:09<7:14:28,  3.43it/s]
 76%|███████▌  | 281966/371472 [16:09<7:06:51,  3.49it/s]
 76%|███████▌  | 281967/371472 [16:09<7:07:07,  3.49it/s]
 76%|███████▌  | 281968/371472 [16:10<7:15:13,  3.43it/s]
 76%|███████▌  | 281969/371472 [16:10<7:10:42,  3.46it/s]
 76%|███████▌  | 281970/371472 [16:10<7:03:36,  3.52it/s]
 76%|███████▌  | 281971/371472 [16:10<6:48:46,  3.65it/s]
 76%|███████▌  | 281972/371472 [16:11<6:44:32,  3.69it/s]
 76%|███████▌  | 281973/371472 [16:11<6:44:22,  3.69it/s]
 76%|███████▌  | 281974/371472 [16:11<6:55:17,  3.59it/s]
 76%|███████▌  | 281975/371472 [16:11<7:04:07,  3.52it/s]
 76%|███████▌  | 281976/371472 [16:12<7:14:12,  3.44it/s]
 76%|███████▌  | 281977/371472 [16:12<6:58:35,  3.56it/s]
 76%|███████▌  | 281978/371472 [16:13<10:12:38,  2.43it/s]
 76%|███████▌  | 281979/371472 [16:13<9:24:47,  2.64it/s] 
 76%|███████▌  | 281980/371472 [16:13<8:59:52,  2.76it/s]
                                                         
{'loss': 2.7553, 'learning_rate': 3.1693744747785987e-07, 'epoch': 12.15}

 76%|███████▌  | 281980/371472 [16:13<8:59:52,  2.76it/s]
 76%|███████▌  | 281981/371472 [16:14<8:15:51,  3.01it/s]
 76%|███████▌  | 281982/371472 [16:14<7:41:50,  3.23it/s]
 76%|███████▌  | 281983/371472 [16:14<7:35:12,  3.28it/s]
 76%|███████▌  | 281984/371472 [16:14<7:23:50,  3.36it/s]
 76%|███████▌  | 281985/371472 [16:15<7:40:34,  3.24it/s]
 76%|███████▌  | 281986/371472 [16:15<7:38:37,  3.25it/s]
 76%|███████▌  | 281987/371472 [16:15<7:20:25,  3.39it/s]
 76%|███████▌  | 281988/371472 [16:16<7:04:25,  3.51it/s]
 76%|███████▌  | 281989/371472 [16:16<7:12:50,  3.45it/s]
 76%|███████▌  | 281990/371472 [16:16<7:05:01,  3.51it/s]
 76%|███████▌  | 281991/371472 [16:16<6:56:54,  3.58it/s]
 76%|███████▌  | 281992/371472 [16:17<7:07:51,  3.49it/s]
 76%|███████▌  | 281993/371472 [16:17<7:08:44,  3.48it/s]
 76%|███████▌  | 281994/371472 [16:17<7:04:29,  3.51it/s]
 76%|███████▌  | 281995/371472 [16:18<7:14:27,  3.43it/s]
 76%|███████▌  | 281996/371472 [16:18<7:05:18,  3.51it/s]
 76%|███████▌  | 281997/371472 [16:18<6:54:15,  3.60it/s]
 76%|███████▌  | 281998/371472 [16:18<6:45:21,  3.68it/s]
 76%|███████▌  | 281999/371472 [16:19<6:51:44,  3.62it/s]
 76%|███████▌  | 282000/371472 [16:19<6:37:02,  3.76it/s]
                                                         
{'loss': 2.6774, 'learning_rate': 3.1688896550238094e-07, 'epoch': 12.15}

 76%|███████▌  | 282000/371472 [16:19<6:37:02,  3.76it/s]
 76%|███████▌  | 282001/371472 [16:19<6:38:36,  3.74it/s]
 76%|███████▌  | 282002/371472 [16:19<6:27:51,  3.84it/s]
 76%|███████▌  | 282003/371472 [16:20<6:27:11,  3.85it/s]
 76%|███████▌  | 282004/371472 [16:20<6:46:45,  3.67it/s]
 76%|███████▌  | 282005/371472 [16:20<6:55:00,  3.59it/s]
 76%|███████▌  | 282006/371472 [16:21<6:59:39,  3.55it/s]
 76%|███████▌  | 282007/371472 [16:21<6:49:31,  3.64it/s]
 76%|███████▌  | 282008/371472 [16:21<7:03:07,  3.52it/s]
 76%|███████▌  | 282009/371472 [16:21<7:22:33,  3.37it/s]
 76%|███████▌  | 282010/371472 [16:22<7:18:30,  3.40it/s]
 76%|███████▌  | 282011/371472 [16:22<6:53:23,  3.61it/s]
 76%|███████▌  | 282012/371472 [16:22<6:42:14,  3.71it/s]
 76%|███████▌  | 282013/371472 [16:23<6:33:21,  3.79it/s]
 76%|███████▌  | 282014/371472 [16:23<6:27:23,  3.85it/s]
 76%|███████▌  | 282015/371472 [16:23<7:08:11,  3.48it/s]
 76%|███████▌  | 282016/371472 [16:23<7:17:23,  3.41it/s]
 76%|███████▌  | 282017/371472 [16:24<7:11:30,  3.46it/s]
 76%|███████▌  | 282018/371472 [16:24<7:05:42,  3.50it/s]
 76%|███████▌  | 282019/371472 [16:24<7:51:05,  3.16it/s]
 76%|███████▌  | 282020/371472 [16:25<7:44:17,  3.21it/s]
                                                         
{'loss': 2.6614, 'learning_rate': 3.168404835269021e-07, 'epoch': 12.15}

 76%|███████▌  | 282020/371472 [16:25<7:44:17,  3.21it/s]
 76%|███████▌  | 282021/371472 [16:25<7:45:02,  3.21it/s]
 76%|███████▌  | 282022/371472 [16:25<7:31:58,  3.30it/s]
 76%|███████▌  | 282023/371472 [16:26<8:08:24,  3.05it/s]
 76%|███████▌  | 282024/371472 [16:26<7:40:39,  3.24it/s]
 76%|███████▌  | 282025/371472 [16:26<7:36:51,  3.26it/s]
 76%|███████▌  | 282026/371472 [16:26<7:13:17,  3.44it/s]
 76%|███████▌  | 282027/371472 [16:27<6:58:19,  3.56it/s]
 76%|███████▌  | 282028/371472 [16:27<7:13:20,  3.44it/s]
 76%|███████▌  | 282029/371472 [16:27<6:53:57,  3.60it/s]
 76%|███████▌  | 282030/371472 [16:28<6:47:03,  3.66it/s]
 76%|███████▌  | 282031/371472 [16:28<6:44:54,  3.68it/s]
 76%|███████▌  | 282032/371472 [16:28<6:51:55,  3.62it/s]
 76%|███████▌  | 282033/371472 [16:28<7:06:20,  3.50it/s]
 76%|███████▌  | 282034/371472 [16:29<7:08:58,  3.47it/s]
 76%|███████▌  | 282035/371472 [16:29<7:06:14,  3.50it/s]
 76%|███████▌  | 282036/371472 [16:29<7:07:47,  3.48it/s]
 76%|███████▌  | 282037/371472 [16:30<7:03:52,  3.52it/s]
 76%|███████▌  | 282038/371472 [16:30<6:56:18,  3.58it/s]
 76%|███████▌  | 282039/371472 [16:30<7:23:30,  3.36it/s]
 76%|███████▌  | 282040/371472 [16:30<7:18:09,  3.40it/s]
                                                         
{'loss': 2.6563, 'learning_rate': 3.167920015514232e-07, 'epoch': 12.15}

 76%|███████▌  | 282040/371472 [16:30<7:18:09,  3.40it/s]
 76%|███████▌  | 282041/371472 [16:31<7:10:08,  3.47it/s]
 76%|███████▌  | 282042/371472 [16:31<7:23:24,  3.36it/s]
 76%|███████▌  | 282043/371472 [16:31<7:08:37,  3.48it/s]
 76%|███████▌  | 282044/371472 [16:32<7:01:29,  3.54it/s]
 76%|███████▌  | 282045/371472 [16:32<7:04:26,  3.51it/s]
 76%|███████▌  | 282046/371472 [16:32<7:12:02,  3.45it/s]
 76%|███████▌  | 282047/371472 [16:32<6:54:44,  3.59it/s]
 76%|███████▌  | 282048/371472 [16:33<6:47:19,  3.66it/s]
 76%|███████▌  | 282049/371472 [16:33<6:46:14,  3.67it/s]
 76%|███████▌  | 282050/371472 [16:33<7:05:51,  3.50it/s]
 76%|███████▌  | 282051/371472 [16:34<7:01:01,  3.54it/s]
 76%|███████▌  | 282052/371472 [16:34<6:56:11,  3.58it/s]
 76%|███████▌  | 282053/371472 [16:34<6:50:15,  3.63it/s]
 76%|███████▌  | 282054/371472 [16:34<6:53:49,  3.60it/s]
 76%|███████▌  | 282055/371472 [16:35<6:53:57,  3.60it/s]
 76%|███████▌  | 282056/371472 [16:35<7:13:19,  3.44it/s]
 76%|███████▌  | 282057/371472 [16:35<7:53:33,  3.15it/s]
 76%|███████▌  | 282058/371472 [16:36<7:40:45,  3.23it/s]
 76%|███████▌  | 282059/371472 [16:36<7:24:31,  3.35it/s]
 76%|███████▌  | 282060/371472 [16:36<7:28:51,  3.32it/s]
                                                         
{'loss': 2.524, 'learning_rate': 3.167435195759443e-07, 'epoch': 12.15}

 76%|███████▌  | 282060/371472 [16:36<7:28:51,  3.32it/s]
 76%|███████▌  | 282061/371472 [16:36<7:13:35,  3.44it/s]
 76%|███████▌  | 282062/371472 [16:37<7:01:04,  3.54it/s]
 76%|███████▌  | 282063/371472 [16:37<6:55:03,  3.59it/s]
 76%|███████▌  | 282064/371472 [16:37<6:53:22,  3.60it/s]
 76%|███████▌  | 282065/371472 [16:38<6:46:28,  3.67it/s]
 76%|███████▌  | 282066/371472 [16:38<6:55:06,  3.59it/s]
 76%|███████▌  | 282067/371472 [16:38<6:46:30,  3.67it/s]
 76%|███████▌  | 282068/371472 [16:38<6:46:06,  3.67it/s]
 76%|███████▌  | 282069/371472 [16:39<6:59:45,  3.55it/s]
 76%|███████▌  | 282070/371472 [16:39<7:17:28,  3.41it/s]
 76%|███████▌  | 282071/371472 [16:39<7:17:52,  3.40it/s]
 76%|███████▌  | 282072/371472 [16:40<7:09:54,  3.47it/s]
 76%|███████▌  | 282073/371472 [16:40<7:03:05,  3.52it/s]
 76%|███████▌  | 282074/371472 [16:40<7:07:57,  3.48it/s]
 76%|███████▌  | 282075/371472 [16:40<6:57:28,  3.57it/s]
 76%|███████▌  | 282076/371472 [16:41<6:43:14,  3.69it/s]
 76%|███████▌  | 282077/371472 [16:41<6:35:29,  3.77it/s]
 76%|███████▌  | 282078/371472 [16:41<6:42:57,  3.70it/s]
 76%|███████▌  | 282079/371472 [16:41<6:39:39,  3.73it/s]
 76%|███████▌  | 282080/371472 [16:42<6:54:38,  3.59it/s]
                                                         
{'loss': 2.8813, 'learning_rate': 3.166950376004654e-07, 'epoch': 12.15}

 76%|███████▌  | 282080/371472 [16:42<6:54:38,  3.59it/s]
 76%|███████▌  | 282081/371472 [16:42<7:07:17,  3.49it/s]
 76%|███████▌  | 282082/371472 [16:42<6:59:20,  3.55it/s]
 76%|███████▌  | 282083/371472 [16:43<6:54:46,  3.59it/s]
 76%|███████▌  | 282084/371472 [16:43<6:56:52,  3.57it/s]
 76%|███████▌  | 282085/371472 [16:43<7:23:43,  3.36it/s]
 76%|███████▌  | 282086/371472 [16:44<7:23:05,  3.36it/s]
 76%|███████▌  | 282087/371472 [16:44<7:18:35,  3.40it/s]
 76%|███████▌  | 282088/371472 [16:44<7:05:06,  3.50it/s]
 76%|███████▌  | 282089/371472 [16:44<7:00:20,  3.54it/s]
 76%|███████▌  | 282090/371472 [16:45<6:55:07,  3.59it/s]
 76%|███████▌  | 282091/371472 [16:45<7:00:45,  3.54it/s]
 76%|███████▌  | 282092/371472 [16:45<6:50:53,  3.63it/s]
 76%|███████▌  | 282093/371472 [16:45<7:07:02,  3.49it/s]
 76%|███████▌  | 282094/371472 [16:46<7:00:37,  3.54it/s]
 76%|███████▌  | 282095/371472 [16:46<6:59:07,  3.55it/s]
 76%|███████▌  | 282096/371472 [16:46<7:19:02,  3.39it/s]
 76%|███████▌  | 282097/371472 [16:47<6:59:49,  3.55it/s]
 76%|███████▌  | 282098/371472 [16:47<6:56:20,  3.58it/s]
 76%|███████▌  | 282099/371472 [16:47<7:33:17,  3.29it/s]
 76%|███████▌  | 282100/371472 [16:47<7:11:11,  3.45it/s]
                                                         
{'loss': 2.5361, 'learning_rate': 3.166465556249865e-07, 'epoch': 12.15}

 76%|███████▌  | 282100/371472 [16:48<7:11:11,  3.45it/s]
 76%|███████▌  | 282101/371472 [16:48<7:09:03,  3.47it/s]
 76%|███████▌  | 282102/371472 [16:48<7:23:11,  3.36it/s]
 76%|███████▌  | 282103/371472 [16:48<7:05:42,  3.50it/s]
 76%|███████▌  | 282104/371472 [16:49<6:59:15,  3.55it/s]
 76%|███████▌  | 282105/371472 [16:49<6:56:51,  3.57it/s]
 76%|███████▌  | 282106/371472 [16:49<6:48:16,  3.65it/s]
 76%|███████▌  | 282107/371472 [16:49<6:53:36,  3.60it/s]
 76%|███████▌  | 282108/371472 [16:50<7:25:23,  3.34it/s]
 76%|███████▌  | 282109/371472 [16:50<7:11:30,  3.45it/s]
 76%|███████▌  | 282110/371472 [16:50<7:14:51,  3.42it/s]
 76%|███████▌  | 282111/371472 [16:51<8:28:51,  2.93it/s]
 76%|███████▌  | 282112/371472 [16:51<7:50:03,  3.17it/s]
 76%|███████▌  | 282113/371472 [16:51<7:31:59,  3.30it/s]
 76%|███████▌  | 282114/371472 [16:52<7:13:51,  3.43it/s]
 76%|███████▌  | 282115/371472 [16:52<6:59:11,  3.55it/s]
 76%|███████▌  | 282116/371472 [16:52<6:46:11,  3.67it/s]
 76%|███████▌  | 282117/371472 [16:52<6:47:59,  3.65it/s]
 76%|███████▌  | 282118/371472 [16:53<7:03:16,  3.52it/s]
 76%|███████▌  | 282119/371472 [16:53<6:58:45,  3.56it/s]
 76%|███████▌  | 282120/371472 [16:53<7:15:44,  3.42it/s]
                                                         
{'loss': 2.7264, 'learning_rate': 3.165980736495076e-07, 'epoch': 12.15}

 76%|███████▌  | 282120/371472 [16:53<7:15:44,  3.42it/s]
 76%|███████▌  | 282121/371472 [16:54<7:13:12,  3.44it/s]
 76%|███████▌  | 282122/371472 [16:54<7:09:42,  3.47it/s]
 76%|███████▌  | 282123/371472 [16:54<7:39:44,  3.24it/s]
 76%|███████▌  | 282124/371472 [16:55<7:20:05,  3.38it/s]
 76%|███████▌  | 282125/371472 [16:55<7:00:23,  3.54it/s]
 76%|███████▌  | 282126/371472 [16:55<6:43:05,  3.69it/s]
 76%|███████▌  | 282127/371472 [16:55<6:36:10,  3.76it/s]
 76%|███████▌  | 282128/371472 [16:56<6:42:03,  3.70it/s]
 76%|███████▌  | 282129/371472 [16:56<6:48:05,  3.65it/s]
 76%|███████▌  | 282130/371472 [16:56<6:45:53,  3.67it/s]
 76%|███████▌  | 282131/371472 [16:56<6:44:58,  3.68it/s]
 76%|███████▌  | 282132/371472 [16:57<7:24:02,  3.35it/s]
 76%|███████▌  | 282133/371472 [16:57<7:13:15,  3.44it/s]
 76%|███████▌  | 282134/371472 [16:57<7:32:50,  3.29it/s]
 76%|███████▌  | 282135/371472 [16:58<7:09:52,  3.46it/s]
 76%|███████▌  | 282136/371472 [16:58<6:59:16,  3.55it/s]
 76%|███████▌  | 282137/371472 [16:58<6:53:22,  3.60it/s]
 76%|███████▌  | 282138/371472 [16:58<7:27:00,  3.33it/s]
 76%|███████▌  | 282139/371472 [16:59<7:24:16,  3.35it/s]
 76%|███████▌  | 282140/371472 [16:59<6:59:32,  3.55it/s]
                                                         
{'loss': 2.86, 'learning_rate': 3.165495916740288e-07, 'epoch': 12.15}

 76%|███████▌  | 282140/371472 [16:59<6:59:32,  3.55it/s]
 76%|███████▌  | 282141/371472 [16:59<6:38:15,  3.74it/s]
 76%|███████▌  | 282142/371472 [16:59<6:31:26,  3.80it/s]
 76%|███████▌  | 282143/371472 [17:00<6:36:59,  3.75it/s]
 76%|███████▌  | 282144/371472 [17:00<6:56:08,  3.58it/s]
 76%|███████▌  | 282145/371472 [17:00<6:49:15,  3.64it/s]
 76%|███████▌  | 282146/371472 [17:01<6:50:13,  3.63it/s]
 76%|███████▌  | 282147/371472 [17:01<6:44:04,  3.68it/s]
 76%|███████▌  | 282148/371472 [17:01<7:16:15,  3.41it/s]
 76%|███████▌  | 282149/371472 [17:02<7:14:49,  3.42it/s]
 76%|███████▌  | 282150/371472 [17:02<7:04:25,  3.51it/s]
 76%|███████▌  | 282151/371472 [17:02<7:09:56,  3.46it/s]
 76%|███████▌  | 282152/371472 [17:02<6:55:35,  3.58it/s]
 76%|███████▌  | 282153/371472 [17:03<7:11:28,  3.45it/s]
 76%|███████▌  | 282154/371472 [17:03<6:59:26,  3.55it/s]
 76%|███████▌  | 282155/371472 [17:03<6:50:32,  3.63it/s]
 76%|███████▌  | 282156/371472 [17:03<6:36:48,  3.75it/s]
 76%|███████▌  | 282157/371472 [17:04<6:30:46,  3.81it/s]
 76%|███████▌  | 282158/371472 [17:04<6:27:46,  3.84it/s]
 76%|███████▌  | 282159/371472 [17:04<6:25:01,  3.87it/s]
 76%|███████▌  | 282160/371472 [17:04<6:33:56,  3.78it/s]
                                                         
{'loss': 2.692, 'learning_rate': 3.1650110969854983e-07, 'epoch': 12.15}

 76%|███████▌  | 282160/371472 [17:04<6:33:56,  3.78it/s]
 76%|███████▌  | 282161/371472 [17:05<6:49:03,  3.64it/s]
 76%|███████▌  | 282162/371472 [17:05<6:54:21,  3.59it/s]
 76%|███████▌  | 282163/371472 [17:05<7:11:30,  3.45it/s]
 76%|███████▌  | 282164/371472 [17:06<7:05:11,  3.50it/s]
 76%|███████▌  | 282165/371472 [17:06<6:55:53,  3.58it/s]
 76%|███████▌  | 282166/371472 [17:06<7:26:03,  3.34it/s]
 76%|███████▌  | 282167/371472 [17:07<7:06:39,  3.49it/s]
 76%|███████▌  | 282168/371472 [17:07<6:57:46,  3.56it/s]
 76%|███████▌  | 282169/371472 [17:07<7:03:27,  3.51it/s]
 76%|███████▌  | 282170/371472 [17:07<7:33:03,  3.29it/s]
 76%|███████▌  | 282171/371472 [17:08<7:17:50,  3.40it/s]
 76%|███████▌  | 282172/371472 [17:08<7:30:15,  3.31it/s]
 76%|███████▌  | 282173/371472 [17:08<7:26:18,  3.33it/s]
 76%|███████▌  | 282174/371472 [17:09<7:23:07,  3.36it/s]
 76%|███████▌  | 282175/371472 [17:09<7:44:41,  3.20it/s]
 76%|███████▌  | 282176/371472 [17:09<7:20:00,  3.38it/s]
 76%|███████▌  | 282177/371472 [17:09<7:01:39,  3.53it/s]
 76%|███████▌  | 282178/371472 [17:10<6:55:23,  3.58it/s]
 76%|███████▌  | 282179/371472 [17:10<7:09:41,  3.46it/s]
 76%|███████▌  | 282180/371472 [17:10<6:57:46,  3.56it/s]
                                                         
{'loss': 2.556, 'learning_rate': 3.1645262772307095e-07, 'epoch': 12.15}

 76%|███████▌  | 282180/371472 [17:10<6:57:46,  3.56it/s]
 76%|███████▌  | 282181/371472 [17:11<7:21:23,  3.37it/s]
 76%|███████▌  | 282182/371472 [17:11<6:57:20,  3.57it/s]
 76%|███████▌  | 282183/371472 [17:11<7:17:04,  3.40it/s]
 76%|███████▌  | 282184/371472 [17:11<7:02:45,  3.52it/s]
 76%|███████▌  | 282185/371472 [17:12<7:15:41,  3.42it/s]
 76%|███████▌  | 282186/371472 [17:12<6:54:52,  3.59it/s]
 76%|███████▌  | 282187/371472 [17:12<6:55:34,  3.58it/s]
 76%|███████▌  | 282188/371472 [17:13<7:24:32,  3.35it/s]
 76%|███████▌  | 282189/371472 [17:13<7:25:48,  3.34it/s]
 76%|███████▌  | 282190/371472 [17:13<7:04:28,  3.51it/s]
 76%|███████▌  | 282191/371472 [17:13<6:56:50,  3.57it/s]
 76%|███████▌  | 282192/371472 [17:14<6:51:37,  3.61it/s]
 76%|███████▌  | 282193/371472 [17:14<6:38:44,  3.73it/s]
 76%|███████▌  | 282194/371472 [17:14<6:30:08,  3.81it/s]
 76%|███████▌  | 282195/371472 [17:15<6:44:16,  3.68it/s]
 76%|███████▌  | 282196/371472 [17:15<6:58:03,  3.56it/s]
 76%|███████▌  | 282197/371472 [17:15<6:41:44,  3.70it/s]
 76%|███████▌  | 282198/371472 [17:15<7:23:49,  3.35it/s]
 76%|███████▌  | 282199/371472 [17:16<7:11:11,  3.45it/s]
 76%|███████▌  | 282200/371472 [17:16<6:58:46,  3.55it/s]
                                                         
{'loss': 2.7177, 'learning_rate': 3.16404145747592e-07, 'epoch': 12.15}

 76%|███████▌  | 282200/371472 [17:16<6:58:46,  3.55it/s]
 76%|███████▌  | 282201/371472 [17:16<7:31:37,  3.29it/s]
 76%|███████▌  | 282202/371472 [17:17<7:15:46,  3.41it/s]
 76%|███████▌  | 282203/371472 [17:17<7:57:32,  3.12it/s]
 76%|███████▌  | 282204/371472 [17:17<7:52:02,  3.15it/s]
 76%|███████▌  | 282205/371472 [17:18<7:39:38,  3.24it/s]
 76%|███████▌  | 282206/371472 [17:18<7:06:10,  3.49it/s]
 76%|███████▌  | 282207/371472 [17:18<7:14:43,  3.42it/s]
 76%|███████▌  | 282208/371472 [17:18<7:01:18,  3.53it/s]
 76%|███████▌  | 282209/371472 [17:19<7:07:45,  3.48it/s]
 76%|███████▌  | 282210/371472 [17:19<7:04:28,  3.50it/s]
 76%|███████▌  | 282211/371472 [17:19<6:57:03,  3.57it/s]
 76%|███████▌  | 282212/371472 [17:19<6:56:24,  3.57it/s]
 76%|███████▌  | 282213/371472 [17:20<7:21:15,  3.37it/s]
 76%|███████▌  | 282214/371472 [17:20<7:15:01,  3.42it/s]
 76%|███████▌  | 282215/371472 [17:20<7:35:57,  3.26it/s]
 76%|███████▌  | 282216/371472 [17:21<7:21:21,  3.37it/s]
 76%|███████▌  | 282217/371472 [17:21<7:21:53,  3.37it/s]
 76%|███████▌  | 282218/371472 [17:21<7:19:43,  3.38it/s]
 76%|███████▌  | 282219/371472 [17:22<7:09:52,  3.46it/s]
 76%|███████▌  | 282220/371472 [17:22<7:17:53,  3.40it/s]
                                                         
{'loss': 2.6877, 'learning_rate': 3.1635566377211315e-07, 'epoch': 12.16}

 76%|███████▌  | 282220/371472 [17:22<7:17:53,  3.40it/s]
 76%|███████▌  | 282221/371472 [17:22<7:24:28,  3.35it/s]
 76%|███████▌  | 282222/371472 [17:22<7:12:37,  3.44it/s]
 76%|███████▌  | 282223/371472 [17:23<6:57:08,  3.57it/s]
 76%|███████▌  | 282224/371472 [17:23<6:56:20,  3.57it/s]
 76%|███████▌  | 282225/371472 [17:23<6:58:08,  3.56it/s]
 76%|███████▌  | 282226/371472 [17:24<7:05:38,  3.49it/s]
 76%|███████▌  | 282227/371472 [17:24<7:05:23,  3.50it/s]
 76%|███████▌  | 282228/371472 [17:24<7:22:38,  3.36it/s]
 76%|███████▌  | 282229/371472 [17:24<6:55:59,  3.58it/s]
 76%|███████▌  | 282230/371472 [17:25<7:09:16,  3.46it/s]
 76%|███████▌  | 282231/371472 [17:25<7:02:01,  3.52it/s]
 76%|███████▌  | 282232/371472 [17:25<6:59:53,  3.54it/s]
 76%|███████▌  | 282233/371472 [17:26<6:55:31,  3.58it/s]
 76%|███████▌  | 282234/371472 [17:26<6:45:57,  3.66it/s]
 76%|███████▌  | 282235/371472 [17:26<7:01:29,  3.53it/s]
 76%|███████▌  | 282236/371472 [17:26<7:03:02,  3.52it/s]
 76%|███████▌  | 282237/371472 [17:27<7:05:51,  3.49it/s]
 76%|███████▌  | 282238/371472 [17:27<7:22:54,  3.36it/s]
 76%|███████▌  | 282239/371472 [17:27<7:24:35,  3.35it/s]
 76%|███████▌  | 282240/371472 [17:28<7:02:48,  3.52it/s]
                                                         
{'loss': 2.6802, 'learning_rate': 3.163071817966342e-07, 'epoch': 12.16}

 76%|███████▌  | 282240/371472 [17:28<7:02:48,  3.52it/s]
 76%|███████▌  | 282241/371472 [17:28<7:07:45,  3.48it/s]
 76%|███████▌  | 282242/371472 [17:28<6:47:47,  3.65it/s]
 76%|███████▌  | 282243/371472 [17:28<7:03:44,  3.51it/s]
 76%|███████▌  | 282244/371472 [17:29<6:45:30,  3.67it/s]
 76%|███████▌  | 282245/371472 [17:29<6:45:29,  3.67it/s]
 76%|███████▌  | 282246/371472 [17:29<6:51:48,  3.61it/s]
 76%|███████▌  | 282247/371472 [17:30<6:47:49,  3.65it/s]
 76%|███████▌  | 282248/371472 [17:30<6:54:01,  3.59it/s]
 76%|███████▌  | 282249/371472 [17:30<7:08:45,  3.47it/s]
 76%|███████▌  | 282250/371472 [17:30<7:03:59,  3.51it/s]
 76%|███████▌  | 282251/371472 [17:31<6:45:31,  3.67it/s]
 76%|███████▌  | 282252/371472 [17:31<6:42:19,  3.70it/s]
 76%|███████▌  | 282253/371472 [17:31<6:52:09,  3.61it/s]
 76%|███████▌  | 282254/371472 [17:31<6:54:05,  3.59it/s]
 76%|███████▌  | 282255/371472 [17:32<6:51:31,  3.61it/s]
 76%|███████▌  | 282256/371472 [17:32<6:47:26,  3.65it/s]
 76%|███████▌  | 282257/371472 [17:32<7:19:13,  3.39it/s]
 76%|███████▌  | 282258/371472 [17:33<7:13:29,  3.43it/s]
 76%|███████▌  | 282259/371472 [17:33<6:58:15,  3.56it/s]
 76%|███████▌  | 282260/371472 [17:33<6:58:40,  3.55it/s]
                                                         
{'loss': 2.7304, 'learning_rate': 3.162586998211554e-07, 'epoch': 12.16}

 76%|███████▌  | 282260/371472 [17:33<6:58:40,  3.55it/s]
 76%|███████▌  | 282261/371472 [17:33<6:49:43,  3.63it/s]
 76%|███████▌  | 282262/371472 [17:34<7:17:56,  3.40it/s]
 76%|███████▌  | 282263/371472 [17:34<7:22:19,  3.36it/s]
 76%|███████▌  | 282264/371472 [17:34<7:21:22,  3.37it/s]
 76%|███████▌  | 282265/371472 [17:35<7:22:36,  3.36it/s]
 76%|███████▌  | 282266/371472 [17:35<7:18:23,  3.39it/s]
 76%|███████▌  | 282267/371472 [17:35<7:15:57,  3.41it/s]
 76%|███████▌  | 282268/371472 [17:36<7:34:23,  3.27it/s]
 76%|███████▌  | 282269/371472 [17:36<7:12:07,  3.44it/s]
 76%|███████▌  | 282270/371472 [17:36<7:01:22,  3.53it/s]
 76%|███████▌  | 282271/371472 [17:36<7:08:29,  3.47it/s]
 76%|███████▌  | 282272/371472 [17:37<6:52:00,  3.61it/s]
 76%|███████▌  | 282273/371472 [17:37<6:51:56,  3.61it/s]
 76%|███████▌  | 282274/371472 [17:37<6:43:33,  3.68it/s]
 76%|███████▌  | 282275/371472 [17:38<7:05:45,  3.49it/s]
 76%|███████▌  | 282276/371472 [17:38<8:04:47,  3.07it/s]
 76%|███████▌  | 282277/371472 [17:38<7:39:20,  3.24it/s]
 76%|███████▌  | 282278/371472 [17:38<7:19:05,  3.39it/s]
 76%|███████▌  | 282279/371472 [17:39<7:06:32,  3.49it/s]
 76%|███████▌  | 282280/371472 [17:39<7:05:50,  3.49it/s]
                                                         
{'loss': 2.6478, 'learning_rate': 3.1621021784567647e-07, 'epoch': 12.16}

 76%|███████▌  | 282280/371472 [17:39<7:05:50,  3.49it/s]
 76%|███████▌  | 282281/371472 [17:39<6:58:12,  3.55it/s]
 76%|███████▌  | 282282/371472 [17:40<6:56:08,  3.57it/s]
 76%|███████▌  | 282283/371472 [17:40<7:02:33,  3.52it/s]
 76%|███████▌  | 282284/371472 [17:40<6:42:29,  3.69it/s]
 76%|███████▌  | 282285/371472 [17:40<7:15:11,  3.42it/s]
 76%|███████▌  | 282286/371472 [17:41<7:07:40,  3.48it/s]
 76%|███████▌  | 282287/371472 [17:41<7:38:03,  3.25it/s]
 76%|███████▌  | 282288/371472 [17:41<7:30:54,  3.30it/s]
 76%|███████▌  | 282289/371472 [17:42<7:17:11,  3.40it/s]
 76%|███████▌  | 282290/371472 [17:42<7:14:55,  3.42it/s]
 76%|███████▌  | 282291/371472 [17:42<7:17:31,  3.40it/s]
 76%|███████▌  | 282292/371472 [17:43<7:04:32,  3.50it/s]
 76%|███████▌  | 282293/371472 [17:43<7:08:49,  3.47it/s]
 76%|███████▌  | 282294/371472 [17:43<6:57:33,  3.56it/s]
 76%|███████▌  | 282295/371472 [17:43<6:53:06,  3.60it/s]
 76%|███████▌  | 282296/371472 [17:44<6:39:26,  3.72it/s]
 76%|███████▌  | 282297/371472 [17:44<7:18:03,  3.39it/s]
 76%|███████▌  | 282298/371472 [17:44<7:19:35,  3.38it/s]
 76%|███████▌  | 282299/371472 [17:45<7:23:05,  3.35it/s]
 76%|███████▌  | 282300/371472 [17:45<7:09:29,  3.46it/s]
                                                         
{'loss': 2.7325, 'learning_rate': 3.1616173587019764e-07, 'epoch': 12.16}

 76%|███████▌  | 282300/371472 [17:45<7:09:29,  3.46it/s]
 76%|███████▌  | 282301/371472 [17:45<7:00:19,  3.54it/s]
 76%|███████▌  | 282302/371472 [17:45<6:48:46,  3.64it/s]
 76%|███████▌  | 282303/371472 [17:46<6:49:49,  3.63it/s]
 76%|███████▌  | 282304/371472 [17:46<6:38:36,  3.73it/s]
 76%|███████▌  | 282305/371472 [17:46<6:57:54,  3.56it/s]
 76%|███████▌  | 282306/371472 [17:46<6:51:13,  3.61it/s]
 76%|███████▌  | 282307/371472 [17:47<6:48:45,  3.64it/s]
 76%|███████▌  | 282308/371472 [17:47<6:57:27,  3.56it/s]
 76%|███████▌  | 282309/371472 [17:47<7:01:04,  3.53it/s]
 76%|███████▌  | 282310/371472 [17:48<6:54:11,  3.59it/s]
 76%|███████▌  | 282311/371472 [17:48<6:49:23,  3.63it/s]
 76%|███████▌  | 282312/371472 [17:48<6:43:01,  3.69it/s]
 76%|███████▌  | 282313/371472 [17:48<7:18:55,  3.39it/s]
 76%|███████▌  | 282314/371472 [17:49<7:05:41,  3.49it/s]
 76%|███████▌  | 282315/371472 [17:49<7:03:07,  3.51it/s]
 76%|███████▌  | 282316/371472 [17:49<6:48:08,  3.64it/s]
 76%|███████▌  | 282317/371472 [17:50<6:51:04,  3.61it/s]
 76%|███████▌  | 282318/371472 [17:50<6:39:12,  3.72it/s]
 76%|███████▌  | 282319/371472 [17:50<6:46:46,  3.65it/s]
 76%|███████▌  | 282320/371472 [17:50<6:41:55,  3.70it/s]
                                                         
{'loss': 2.6768, 'learning_rate': 3.1611325389471866e-07, 'epoch': 12.16}

 76%|███████▌  | 282320/371472 [17:50<6:41:55,  3.70it/s]
 76%|███████▌  | 282321/371472 [17:51<6:36:29,  3.75it/s]
 76%|███████▌  | 282322/371472 [17:51<6:38:10,  3.73it/s]
 76%|███████▌  | 282323/371472 [17:51<6:33:57,  3.77it/s]
 76%|███████▌  | 282324/371472 [17:51<7:08:12,  3.47it/s]
 76%|███████▌  | 282325/371472 [17:52<7:43:08,  3.21it/s]
 76%|███████▌  | 282326/371472 [17:52<7:25:59,  3.33it/s]
 76%|███████▌  | 282327/371472 [17:52<7:18:49,  3.39it/s]
 76%|███████▌  | 282328/371472 [17:53<7:09:12,  3.46it/s]
 76%|███████▌  | 282329/371472 [17:53<7:57:21,  3.11it/s]
 76%|███████▌  | 282330/371472 [17:53<7:19:06,  3.38it/s]
 76%|███████▌  | 282331/371472 [17:54<7:14:04,  3.42it/s]
 76%|███████▌  | 282332/371472 [17:54<7:24:37,  3.34it/s]
 76%|███████▌  | 282333/371472 [17:54<7:10:33,  3.45it/s]
 76%|███████▌  | 282334/371472 [17:54<7:33:52,  3.27it/s]
 76%|███████▌  | 282335/371472 [17:55<7:29:59,  3.30it/s]
 76%|███████▌  | 282336/371472 [17:55<7:11:21,  3.44it/s]
 76%|███████▌  | 282337/371472 [17:55<7:33:44,  3.27it/s]
 76%|███████▌  | 282338/371472 [17:56<7:08:24,  3.47it/s]
 76%|███████▌  | 282339/371472 [17:56<7:07:18,  3.48it/s]
 76%|███████▌  | 282340/371472 [17:56<7:01:59,  3.52it/s]
                                                         
{'loss': 2.601, 'learning_rate': 3.160647719192398e-07, 'epoch': 12.16}

 76%|███████▌  | 282340/371472 [17:56<7:01:59,  3.52it/s]
 76%|███████▌  | 282341/371472 [17:56<7:03:13,  3.51it/s]
 76%|███████▌  | 282342/371472 [17:57<7:12:32,  3.43it/s]
 76%|███████▌  | 282343/371472 [17:57<7:18:53,  3.38it/s]
 76%|███████▌  | 282344/371472 [17:57<7:43:09,  3.21it/s]
 76%|███████▌  | 282345/371472 [17:58<7:25:34,  3.33it/s]
 76%|███████▌  | 282346/371472 [17:58<7:11:08,  3.45it/s]
 76%|███████▌  | 282347/371472 [17:58<7:03:15,  3.51it/s]
 76%|███████▌  | 282348/371472 [17:59<6:53:20,  3.59it/s]
 76%|███████▌  | 282349/371472 [17:59<6:40:49,  3.71it/s]
 76%|███████▌  | 282350/371472 [17:59<7:32:13,  3.28it/s]
 76%|███████▌  | 282351/371472 [17:59<7:04:31,  3.50it/s]
 76%|███████▌  | 282352/371472 [18:00<6:56:38,  3.57it/s]
 76%|███████▌  | 282353/371472 [18:00<7:02:26,  3.52it/s]
 76%|███████▌  | 282354/371472 [18:00<8:30:02,  2.91it/s]
 76%|███████▌  | 282355/371472 [18:01<8:03:27,  3.07it/s]
 76%|███████▌  | 282356/371472 [18:01<8:05:03,  3.06it/s]
 76%|███████▌  | 282357/371472 [18:01<8:00:48,  3.09it/s]
 76%|███████▌  | 282358/371472 [18:02<7:34:27,  3.27it/s]
 76%|███████▌  | 282359/371472 [18:02<7:13:59,  3.42it/s]
 76%|███████▌  | 282360/371472 [18:02<7:05:53,  3.49it/s]
                                                         
{'loss': 2.634, 'learning_rate': 3.1601628994376086e-07, 'epoch': 12.16}

 76%|███████▌  | 282360/371472 [18:02<7:05:53,  3.49it/s]
 76%|███████▌  | 282361/371472 [18:03<7:51:46,  3.15it/s]
 76%|███████▌  | 282362/371472 [18:03<7:52:21,  3.14it/s]
 76%|███████▌  | 282363/371472 [18:03<7:25:16,  3.34it/s]
 76%|███████▌  | 282364/371472 [18:03<7:09:12,  3.46it/s]
 76%|███████▌  | 282365/371472 [18:04<6:56:53,  3.56it/s]
 76%|███████▌  | 282366/371472 [18:04<6:59:07,  3.54it/s]
 76%|███████▌  | 282367/371472 [18:04<7:10:59,  3.45it/s]
 76%|███████▌  | 282368/371472 [18:05<7:28:38,  3.31it/s]
 76%|███████▌  | 282369/371472 [18:05<7:28:01,  3.31it/s]
 76%|███████▌  | 282370/371472 [18:05<7:11:24,  3.44it/s]
 76%|███████▌  | 282371/371472 [18:05<7:15:28,  3.41it/s]
 76%|███████▌  | 282372/371472 [18:06<7:23:00,  3.35it/s]
 76%|███████▌  | 282373/371472 [18:06<7:22:05,  3.36it/s]
 76%|███████▌  | 282374/371472 [18:06<7:21:08,  3.37it/s]
 76%|███████▌  | 282375/371472 [18:07<7:19:37,  3.38it/s]
 76%|███████▌  | 282376/371472 [18:07<7:23:50,  3.35it/s]
 76%|███████▌  | 282377/371472 [18:07<7:07:55,  3.47it/s]
 76%|███████▌  | 282378/371472 [18:08<7:07:01,  3.48it/s]
 76%|███████▌  | 282379/371472 [18:08<6:54:06,  3.59it/s]
 76%|███████▌  | 282380/371472 [18:08<6:39:25,  3.72it/s]
                                                         
{'loss': 2.6286, 'learning_rate': 3.1596780796828204e-07, 'epoch': 12.16}

 76%|███████▌  | 282380/371472 [18:08<6:39:25,  3.72it/s]
 76%|███████▌  | 282381/371472 [18:08<6:27:20,  3.83it/s]
 76%|███████▌  | 282382/371472 [18:08<6:19:11,  3.92it/s]
 76%|███████▌  | 282383/371472 [18:09<6:40:22,  3.71it/s]
 76%|███████▌  | 282384/371472 [18:09<6:33:31,  3.77it/s]
 76%|███████▌  | 282385/371472 [18:09<6:51:32,  3.61it/s]
 76%|███████▌  | 282386/371472 [18:10<7:06:46,  3.48it/s]
 76%|███████▌  | 282387/371472 [18:10<6:58:52,  3.54it/s]
 76%|███████▌  | 282388/371472 [18:10<7:21:16,  3.36it/s]
 76%|███████▌  | 282389/371472 [18:11<7:21:24,  3.36it/s]
 76%|███████▌  | 282390/371472 [18:11<7:19:54,  3.38it/s]
 76%|███████▌  | 282391/371472 [18:11<7:02:14,  3.52it/s]
 76%|███████▌  | 282392/371472 [18:11<6:49:59,  3.62it/s]
 76%|███████▌  | 282393/371472 [18:12<6:43:15,  3.68it/s]
 76%|███████▌  | 282394/371472 [18:12<6:46:15,  3.65it/s]
 76%|███████▌  | 282395/371472 [18:12<6:37:26,  3.74it/s]
 76%|███████▌  | 282396/371472 [18:12<6:46:32,  3.65it/s]
 76%|███████▌  | 282397/371472 [18:13<6:36:25,  3.74it/s]
 76%|███████▌  | 282398/371472 [18:13<6:43:04,  3.68it/s]
 76%|███████▌  | 282399/371472 [18:13<6:48:29,  3.63it/s]
 76%|███████▌  | 282400/371472 [18:14<7:07:59,  3.47it/s]
                                                         
{'loss': 2.6458, 'learning_rate': 3.159193259928031e-07, 'epoch': 12.16}

 76%|███████▌  | 282400/371472 [18:14<7:07:59,  3.47it/s]
 76%|███████▌  | 282401/371472 [18:14<7:04:42,  3.50it/s]
 76%|███████▌  | 282402/371472 [18:14<6:44:33,  3.67it/s]
 76%|███████▌  | 282403/371472 [18:14<6:31:35,  3.79it/s]
 76%|███████▌  | 282404/371472 [18:15<6:28:51,  3.82it/s]
 76%|███████▌  | 282405/371472 [18:15<6:29:07,  3.81it/s]
 76%|███████▌  | 282406/371472 [18:15<6:36:59,  3.74it/s]
 76%|███████▌  | 282407/371472 [18:15<6:41:57,  3.69it/s]
 76%|███████▌  | 282408/371472 [18:16<7:31:14,  3.29it/s]
 76%|███████▌  | 282409/371472 [18:16<7:32:34,  3.28it/s]
 76%|███████▌  | 282410/371472 [18:16<7:17:34,  3.39it/s]
 76%|███████▌  | 282411/371472 [18:17<7:13:26,  3.42it/s]
 76%|███████▌  | 282412/371472 [18:17<6:55:37,  3.57it/s]
 76%|███████▌  | 282413/371472 [18:17<6:44:47,  3.67it/s]
 76%|███████▌  | 282414/371472 [18:17<6:52:04,  3.60it/s]
 76%|███████▌  | 282415/371472 [18:18<6:40:35,  3.71it/s]
 76%|███████▌  | 282416/371472 [18:18<6:48:51,  3.63it/s]
 76%|███████▌  | 282417/371472 [18:18<6:42:42,  3.69it/s]
 76%|███████▌  | 282418/371472 [18:19<6:47:00,  3.65it/s]
 76%|███████▌  | 282419/371472 [18:19<6:47:25,  3.64it/s]
 76%|███████▌  | 282420/371472 [18:19<6:37:55,  3.73it/s]
                                                         
{'loss': 2.8183, 'learning_rate': 3.158708440173243e-07, 'epoch': 12.16}

 76%|███████▌  | 282420/371472 [18:19<6:37:55,  3.73it/s]
 76%|███████▌  | 282421/371472 [18:19<6:28:54,  3.82it/s]
 76%|███████▌  | 282422/371472 [18:20<7:00:05,  3.53it/s]
 76%|███████▌  | 282423/371472 [18:20<6:40:12,  3.71it/s]
 76%|███████▌  | 282424/371472 [18:20<6:42:18,  3.69it/s]
 76%|███████▌  | 282425/371472 [18:21<7:22:33,  3.35it/s]
 76%|███████▌  | 282426/371472 [18:21<7:24:25,  3.34it/s]
 76%|███████▌  | 282427/371472 [18:21<7:11:56,  3.44it/s]
 76%|███████▌  | 282428/371472 [18:21<7:20:43,  3.37it/s]
 76%|███████▌  | 282429/371472 [18:22<7:25:08,  3.33it/s]
 76%|███████▌  | 282430/371472 [18:22<7:15:39,  3.41it/s]
 76%|███████▌  | 282431/371472 [18:22<7:13:21,  3.42it/s]
 76%|███████▌  | 282432/371472 [18:23<7:02:45,  3.51it/s]
 76%|███████▌  | 282433/371472 [18:23<6:58:47,  3.54it/s]
 76%|███████▌  | 282434/371472 [18:23<7:01:22,  3.52it/s]
 76%|███████▌  | 282435/371472 [18:23<6:52:28,  3.60it/s]
 76%|███████▌  | 282436/371472 [18:24<6:51:17,  3.61it/s]
 76%|███████▌  | 282437/371472 [18:24<7:12:42,  3.43it/s]
 76%|███████▌  | 282438/371472 [18:24<7:04:22,  3.50it/s]
 76%|███████▌  | 282439/371472 [18:25<6:53:20,  3.59it/s]
 76%|███████▌  | 282440/371472 [18:25<6:42:58,  3.68it/s]
                                                         
{'loss': 2.7678, 'learning_rate': 3.158223620418453e-07, 'epoch': 12.17}

 76%|███████▌  | 282440/371472 [18:25<6:42:58,  3.68it/s]
 76%|███████▌  | 282441/371472 [18:25<6:37:50,  3.73it/s]
 76%|███████▌  | 282442/371472 [18:25<6:56:40,  3.56it/s]
 76%|███████▌  | 282443/371472 [18:26<7:06:33,  3.48it/s]
 76%|███████▌  | 282444/371472 [18:26<6:57:49,  3.55it/s]
 76%|███████▌  | 282445/371472 [18:26<7:22:54,  3.35it/s]
 76%|███████▌  | 282446/371472 [18:27<7:01:22,  3.52it/s]
 76%|███████▌  | 282447/371472 [18:27<6:53:43,  3.59it/s]
 76%|███████▌  | 282448/371472 [18:27<6:49:17,  3.63it/s]
 76%|███████▌  | 282449/371472 [18:27<6:58:54,  3.54it/s]
 76%|███████▌  | 282450/371472 [18:28<7:03:32,  3.50it/s]
 76%|███████▌  | 282451/371472 [18:28<6:50:48,  3.61it/s]
 76%|███████▌  | 282452/371472 [18:28<6:39:19,  3.72it/s]
 76%|███████▌  | 282453/371472 [18:28<6:42:52,  3.68it/s]
 76%|███████▌  | 282454/371472 [18:29<6:44:20,  3.67it/s]
 76%|███████▌  | 282455/371472 [18:29<6:40:47,  3.70it/s]
 76%|███████▌  | 282456/371472 [18:29<6:44:44,  3.67it/s]
 76%|███████▌  | 282457/371472 [18:30<6:54:56,  3.58it/s]
 76%|███████▌  | 282458/371472 [18:30<6:42:03,  3.69it/s]
 76%|███████▌  | 282459/371472 [18:30<6:30:07,  3.80it/s]
 76%|███████▌  | 282460/371472 [18:30<6:34:39,  3.76it/s]
                                                         
{'loss': 2.6007, 'learning_rate': 3.157738800663665e-07, 'epoch': 12.17}

 76%|███████▌  | 282460/371472 [18:30<6:34:39,  3.76it/s]
 76%|███████▌  | 282461/371472 [18:31<7:03:29,  3.50it/s]
 76%|███████▌  | 282462/371472 [18:31<6:56:33,  3.56it/s]
 76%|███████▌  | 282463/371472 [18:31<7:05:01,  3.49it/s]
 76%|███████▌  | 282464/371472 [18:32<7:25:42,  3.33it/s]
 76%|███████▌  | 282465/371472 [18:32<7:23:29,  3.34it/s]
 76%|███████▌  | 282466/371472 [18:32<7:03:44,  3.50it/s]
 76%|███████▌  | 282467/371472 [18:32<7:09:53,  3.45it/s]
 76%|███████▌  | 282468/371472 [18:33<7:13:50,  3.42it/s]
 76%|███████▌  | 282469/371472 [18:33<6:59:33,  3.54it/s]
 76%|███████▌  | 282470/371472 [18:33<7:03:12,  3.51it/s]
 76%|███████▌  | 282471/371472 [18:34<7:17:28,  3.39it/s]
 76%|███████▌  | 282472/371472 [18:34<7:21:42,  3.36it/s]
 76%|███████▌  | 282473/371472 [18:34<7:19:50,  3.37it/s]
 76%|███████▌  | 282474/371472 [18:34<7:16:30,  3.40it/s]
 76%|███████▌  | 282475/371472 [18:35<7:23:15,  3.35it/s]
 76%|███████▌  | 282476/371472 [18:35<7:14:24,  3.41it/s]
 76%|███████▌  | 282477/371472 [18:35<7:07:47,  3.47it/s]
 76%|███████▌  | 282478/371472 [18:36<7:30:46,  3.29it/s]
 76%|███████▌  | 282479/371472 [18:36<7:15:48,  3.40it/s]
 76%|███████▌  | 282480/371472 [18:36<7:40:32,  3.22it/s]
                                                         
{'loss': 2.6673, 'learning_rate': 3.157253980908875e-07, 'epoch': 12.17}

 76%|███████▌  | 282480/371472 [18:36<7:40:32,  3.22it/s]
 76%|███████▌  | 282481/371472 [18:37<7:38:50,  3.23it/s]
 76%|███████▌  | 282482/371472 [18:37<7:59:46,  3.09it/s]
 76%|███████▌  | 282483/371472 [18:37<7:49:54,  3.16it/s]
 76%|███████▌  | 282484/371472 [18:38<7:34:44,  3.26it/s]
 76%|███████▌  | 282485/371472 [18:38<7:20:21,  3.37it/s]
 76%|███████▌  | 282486/371472 [18:38<7:42:45,  3.20it/s]
 76%|███████▌  | 282487/371472 [18:38<7:42:51,  3.20it/s]
 76%|███████▌  | 282488/371472 [18:39<7:21:57,  3.36it/s]
 76%|███████▌  | 282489/371472 [18:39<7:31:48,  3.28it/s]
 76%|███████▌  | 282490/371472 [18:39<7:19:40,  3.37it/s]
 76%|███████▌  | 282491/371472 [18:40<7:06:30,  3.48it/s]
 76%|███████▌  | 282492/371472 [18:40<7:12:37,  3.43it/s]
 76%|███████▌  | 282493/371472 [18:40<7:11:15,  3.44it/s]
 76%|███████▌  | 282494/371472 [18:40<7:03:53,  3.50it/s]
 76%|███████▌  | 282495/371472 [18:41<6:58:49,  3.54it/s]
 76%|███████▌  | 282496/371472 [18:41<6:51:57,  3.60it/s]
 76%|███████▌  | 282497/371472 [18:41<7:09:49,  3.45it/s]
 76%|███████▌  | 282498/371472 [18:42<7:04:43,  3.49it/s]
 76%|███████▌  | 282499/371472 [18:42<6:47:59,  3.63it/s]
 76%|███████▌  | 282500/371472 [18:42<6:49:27,  3.62it/s]
                                                         
{'loss': 2.827, 'learning_rate': 3.1567691611540857e-07, 'epoch': 12.17}

 76%|███████▌  | 282500/371472 [18:42<6:49:27,  3.62it/s]
 76%|███████▌  | 282501/371472 [18:42<6:55:28,  3.57it/s]
 76%|███████▌  | 282502/371472 [18:43<7:21:20,  3.36it/s]
 76%|███████▌  | 282503/371472 [18:43<7:02:39,  3.51it/s]
 76%|███████▌  | 282504/371472 [18:43<6:56:20,  3.56it/s]
 76%|███████▌  | 282505/371472 [18:44<6:46:59,  3.64it/s]
 76%|███████▌  | 282506/371472 [18:44<6:59:34,  3.53it/s]
 76%|███████▌  | 282507/371472 [18:44<6:48:46,  3.63it/s]
 76%|███████▌  | 282508/371472 [18:44<6:47:54,  3.63it/s]
 76%|███████▌  | 282509/371472 [18:45<6:41:13,  3.70it/s]
 76%|███████▌  | 282510/371472 [18:45<6:43:23,  3.68it/s]
 76%|███████▌  | 282511/371472 [18:45<6:34:27,  3.76it/s]
 76%|███████▌  | 282512/371472 [18:45<6:24:19,  3.86it/s]
 76%|███████▌  | 282513/371472 [18:46<6:34:14,  3.76it/s]
 76%|███████▌  | 282514/371472 [18:46<6:33:09,  3.77it/s]
 76%|███████▌  | 282515/371472 [18:46<6:48:40,  3.63it/s]
 76%|███████▌  | 282516/371472 [18:47<6:50:47,  3.61it/s]
 76%|███████▌  | 282517/371472 [18:47<6:56:32,  3.56it/s]
 76%|███████▌  | 282518/371472 [18:47<6:45:36,  3.66it/s]
 76%|███████▌  | 282519/371472 [18:47<6:40:31,  3.70it/s]
 76%|███████▌  | 282520/371472 [18:48<6:39:06,  3.71it/s]
                                                         
{'loss': 2.7046, 'learning_rate': 3.1562843413992975e-07, 'epoch': 12.17}

 76%|███████▌  | 282520/371472 [18:48<6:39:06,  3.71it/s]
 76%|███████▌  | 282521/371472 [18:48<7:21:32,  3.36it/s]
 76%|███████▌  | 282522/371472 [18:48<7:11:06,  3.44it/s]
 76%|███████▌  | 282523/371472 [18:49<7:05:25,  3.48it/s]
 76%|███████▌  | 282524/371472 [18:49<6:55:40,  3.57it/s]
 76%|███████▌  | 282525/371472 [18:49<6:56:28,  3.56it/s]
 76%|███████▌  | 282526/371472 [18:49<6:57:31,  3.55it/s]
 76%|███████▌  | 282527/371472 [18:50<6:51:12,  3.61it/s]
 76%|███████▌  | 282528/371472 [18:50<6:49:09,  3.62it/s]
 76%|███████▌  | 282529/371472 [18:50<6:42:14,  3.69it/s]
 76%|███████▌  | 282530/371472 [18:50<6:41:00,  3.70it/s]
 76%|███████▌  | 282531/371472 [18:51<6:32:18,  3.78it/s]
 76%|███████▌  | 282532/371472 [18:51<6:36:24,  3.74it/s]
 76%|███████▌  | 282533/371472 [18:51<6:50:44,  3.61it/s]
 76%|███████▌  | 282534/371472 [18:52<7:02:01,  3.51it/s]
 76%|███████▌  | 282535/371472 [18:52<6:56:41,  3.56it/s]
 76%|███████▌  | 282536/371472 [18:52<6:40:29,  3.70it/s]
 76%|███████▌  | 282537/371472 [18:52<7:08:52,  3.46it/s]
 76%|███████▌  | 282538/371472 [18:53<7:03:22,  3.50it/s]
 76%|███████▌  | 282539/371472 [18:53<7:08:14,  3.46it/s]
 76%|███████▌  | 282540/371472 [18:53<7:19:41,  3.37it/s]
                                                         
{'loss': 2.788, 'learning_rate': 3.155799521644508e-07, 'epoch': 12.17}

 76%|███████▌  | 282540/371472 [18:53<7:19:41,  3.37it/s]
 76%|███████▌  | 282541/371472 [18:54<7:35:43,  3.25it/s]
 76%|███████▌  | 282542/371472 [18:54<7:21:12,  3.36it/s]
 76%|███████▌  | 282543/371472 [18:54<7:19:03,  3.38it/s]
 76%|███████▌  | 282544/371472 [18:54<7:05:11,  3.49it/s]
 76%|███████▌  | 282545/371472 [18:55<6:48:33,  3.63it/s]
 76%|███████▌  | 282546/371472 [18:55<7:00:34,  3.52it/s]
 76%|███████▌  | 282547/371472 [18:55<6:45:31,  3.65it/s]
 76%|███████▌  | 282548/371472 [18:56<6:45:14,  3.66it/s]
 76%|███████▌  | 282549/371472 [18:56<6:55:11,  3.57it/s]
 76%|███████▌  | 282550/371472 [18:56<6:53:22,  3.59it/s]
 76%|███████▌  | 282551/371472 [18:56<6:46:13,  3.65it/s]
 76%|███████▌  | 282552/371472 [18:57<6:38:36,  3.72it/s]
 76%|███████▌  | 282553/371472 [18:57<6:53:21,  3.59it/s]
 76%|███████▌  | 282554/371472 [18:57<7:03:26,  3.50it/s]
 76%|███████▌  | 282555/371472 [18:57<6:54:42,  3.57it/s]
 76%|███████▌  | 282556/371472 [18:58<6:38:27,  3.72it/s]
 76%|███████▌  | 282557/371472 [18:58<6:35:36,  3.75it/s]
 76%|███████▌  | 282558/371472 [18:58<6:24:41,  3.85it/s]
 76%|███████▌  | 282559/371472 [18:58<6:22:43,  3.87it/s]
 76%|███████▌  | 282560/371472 [18:59<6:22:02,  3.88it/s]
                                                         
{'loss': 2.7242, 'learning_rate': 3.1553147018897194e-07, 'epoch': 12.17}

 76%|███████▌  | 282560/371472 [18:59<6:22:02,  3.88it/s]
 76%|███████▌  | 282561/371472 [18:59<6:23:44,  3.86it/s]
 76%|███████▌  | 282562/371472 [18:59<6:30:55,  3.79it/s]
 76%|███████▌  | 282563/371472 [19:00<6:39:04,  3.71it/s]
 76%|███████▌  | 282564/371472 [19:00<6:27:37,  3.82it/s]
 76%|███████▌  | 282565/371472 [19:00<6:24:05,  3.86it/s]
 76%|███████▌  | 282566/371472 [19:00<6:39:21,  3.71it/s]
 76%|███████▌  | 282567/371472 [19:01<7:00:48,  3.52it/s]
 76%|███████▌  | 282568/371472 [19:01<6:56:31,  3.56it/s]
 76%|███████▌  | 282569/371472 [19:01<6:48:25,  3.63it/s]
 76%|███████▌  | 282570/371472 [19:01<6:45:20,  3.66it/s]
 76%|███████▌  | 282571/371472 [19:02<7:11:22,  3.43it/s]
 76%|███████▌  | 282572/371472 [19:02<6:57:49,  3.55it/s]
 76%|███████▌  | 282573/371472 [19:02<7:14:34,  3.41it/s]
 76%|███████▌  | 282574/371472 [19:03<7:11:27,  3.43it/s]
 76%|███████▌  | 282575/371472 [19:03<7:17:23,  3.39it/s]
 76%|███████▌  | 282576/371472 [19:03<7:02:12,  3.51it/s]
 76%|███████▌  | 282577/371472 [19:04<6:53:28,  3.58it/s]
 76%|███████▌  | 282578/371472 [19:04<6:40:10,  3.70it/s]
 76%|███████▌  | 282579/371472 [19:04<6:34:57,  3.75it/s]
 76%|███████▌  | 282580/371472 [19:04<6:58:40,  3.54it/s]
                                                         
{'loss': 2.7806, 'learning_rate': 3.15482988213493e-07, 'epoch': 12.17}

 76%|███████▌  | 282580/371472 [19:04<6:58:40,  3.54it/s]
 76%|███████▌  | 282581/371472 [19:05<7:04:17,  3.49it/s]
 76%|███████▌  | 282582/371472 [19:05<6:57:08,  3.55it/s]
 76%|███████▌  | 282583/371472 [19:05<7:00:38,  3.52it/s]
 76%|███████▌  | 282584/371472 [19:05<7:03:57,  3.49it/s]
 76%|███████▌  | 282585/371472 [19:06<7:01:48,  3.51it/s]
 76%|███████▌  | 282586/371472 [19:06<7:17:21,  3.39it/s]
 76%|███████▌  | 282587/371472 [19:06<7:03:35,  3.50it/s]
 76%|███████▌  | 282588/371472 [19:07<6:53:16,  3.58it/s]
 76%|███████▌  | 282589/371472 [19:07<6:43:37,  3.67it/s]
 76%|███████▌  | 282590/371472 [19:07<6:48:37,  3.63it/s]
 76%|███████▌  | 282591/371472 [19:07<7:01:17,  3.52it/s]
 76%|███████▌  | 282592/371472 [19:08<6:47:55,  3.63it/s]
 76%|███████▌  | 282593/371472 [19:08<6:46:01,  3.65it/s]
 76%|███████▌  | 282594/371472 [19:08<7:22:16,  3.35it/s]
 76%|███████▌  | 282595/371472 [19:09<7:24:27,  3.33it/s]
 76%|███████▌  | 282596/371472 [19:09<7:08:56,  3.45it/s]
 76%|███████▌  | 282597/371472 [19:09<7:09:12,  3.45it/s]
 76%|███████▌  | 282598/371472 [19:09<7:14:38,  3.41it/s]
 76%|███████▌  | 282599/371472 [19:10<6:57:04,  3.55it/s]
 76%|███████▌  | 282600/371472 [19:10<6:46:37,  3.64it/s]
                                                         
{'loss': 2.6444, 'learning_rate': 3.1543450623801414e-07, 'epoch': 12.17}

 76%|███████▌  | 282600/371472 [19:10<6:46:37,  3.64it/s]
 76%|███████▌  | 282601/371472 [19:10<6:47:20,  3.64it/s]
 76%|███████▌  | 282602/371472 [19:11<6:42:33,  3.68it/s]
 76%|███████▌  | 282603/371472 [19:11<6:42:05,  3.68it/s]
 76%|███████▌  | 282604/371472 [19:11<6:57:35,  3.55it/s]
 76%|███████▌  | 282605/371472 [19:11<6:59:31,  3.53it/s]
 76%|███████▌  | 282606/371472 [19:12<6:53:50,  3.58it/s]
 76%|███████▌  | 282607/371472 [19:12<6:55:37,  3.56it/s]
 76%|███████▌  | 282608/371472 [19:12<6:49:30,  3.62it/s]
 76%|███████▌  | 282609/371472 [19:13<6:48:05,  3.63it/s]
 76%|███████▌  | 282610/371472 [19:13<8:38:07,  2.86it/s]
 76%|███████▌  | 282611/371472 [19:13<8:01:52,  3.07it/s]
 76%|███████▌  | 282612/371472 [19:14<8:05:02,  3.05it/s]
 76%|███████▌  | 282613/371472 [19:14<7:59:37,  3.09it/s]
 76%|███████▌  | 282614/371472 [19:14<7:33:23,  3.27it/s]
 76%|███████▌  | 282615/371472 [19:14<7:15:59,  3.40it/s]
 76%|███████▌  | 282616/371472 [19:15<7:50:03,  3.15it/s]
 76%|███████▌  | 282617/371472 [19:15<7:33:29,  3.27it/s]
 76%|███████▌  | 282618/371472 [19:15<7:10:34,  3.44it/s]
 76%|███████▌  | 282619/371472 [19:16<7:18:57,  3.37it/s]
 76%|███████▌  | 282620/371472 [19:16<7:11:28,  3.43it/s]
                                                         
{'loss': 2.5881, 'learning_rate': 3.153860242625352e-07, 'epoch': 12.17}

 76%|███████▌  | 282620/371472 [19:16<7:11:28,  3.43it/s]
 76%|███████▌  | 282621/371472 [19:16<7:16:16,  3.39it/s]
 76%|███████▌  | 282622/371472 [19:17<7:05:01,  3.48it/s]
 76%|███████▌  | 282623/371472 [19:17<6:58:56,  3.53it/s]
 76%|███████▌  | 282624/371472 [19:17<7:38:40,  3.23it/s]
 76%|███████▌  | 282625/371472 [19:17<7:19:48,  3.37it/s]
 76%|███████▌  | 282626/371472 [19:18<7:21:58,  3.35it/s]
 76%|███████▌  | 282627/371472 [19:18<7:06:32,  3.47it/s]
 76%|███████▌  | 282628/371472 [19:18<7:22:50,  3.34it/s]
 76%|███████▌  | 282629/371472 [19:19<7:07:32,  3.46it/s]
 76%|███████▌  | 282630/371472 [19:19<7:20:22,  3.36it/s]
 76%|███████▌  | 282631/371472 [19:19<7:21:17,  3.36it/s]
 76%|███████▌  | 282632/371472 [19:20<7:20:18,  3.36it/s]
 76%|███████▌  | 282633/371472 [19:20<7:11:03,  3.43it/s]
 76%|███████▌  | 282634/371472 [19:20<6:55:04,  3.57it/s]
 76%|███████▌  | 282635/371472 [19:20<6:42:52,  3.68it/s]
 76%|███████▌  | 282636/371472 [19:21<7:03:40,  3.49it/s]
 76%|███████▌  | 282637/371472 [19:21<7:24:15,  3.33it/s]
 76%|███████▌  | 282638/371472 [19:21<7:11:25,  3.43it/s]
 76%|███████▌  | 282639/371472 [19:21<6:50:56,  3.60it/s]
 76%|███████▌  | 282640/371472 [19:22<6:49:01,  3.62it/s]
                                                         
{'loss': 2.7025, 'learning_rate': 3.153375422870564e-07, 'epoch': 12.17}

 76%|███████▌  | 282640/371472 [19:22<6:49:01,  3.62it/s]
 76%|███████▌  | 282641/371472 [19:22<7:04:54,  3.48it/s]
 76%|███████▌  | 282642/371472 [19:22<6:53:59,  3.58it/s]
 76%|███████▌  | 282643/371472 [19:23<7:09:22,  3.45it/s]
 76%|███████▌  | 282644/371472 [19:23<7:02:22,  3.51it/s]
 76%|███████▌  | 282645/371472 [19:23<7:08:35,  3.45it/s]
 76%|███████▌  | 282646/371472 [19:23<6:57:24,  3.55it/s]
 76%|███████▌  | 282647/371472 [19:24<6:44:56,  3.66it/s]
 76%|███████▌  | 282648/371472 [19:24<6:41:47,  3.68it/s]
 76%|███████▌  | 282649/371472 [19:24<6:56:52,  3.55it/s]
 76%|███████▌  | 282650/371472 [19:25<7:05:41,  3.48it/s]
 76%|███████▌  | 282651/371472 [19:25<7:31:08,  3.28it/s]
 76%|███████▌  | 282652/371472 [19:25<7:12:43,  3.42it/s]
 76%|███████▌  | 282653/371472 [19:25<6:55:05,  3.57it/s]
 76%|███████▌  | 282654/371472 [19:26<6:58:08,  3.54it/s]
 76%|███████▌  | 282655/371472 [19:26<7:09:02,  3.45it/s]
 76%|███████▌  | 282656/371472 [19:26<7:30:52,  3.28it/s]
 76%|███████▌  | 282657/371472 [19:27<7:35:20,  3.25it/s]
 76%|███████▌  | 282658/371472 [19:27<7:08:44,  3.45it/s]
 76%|███████▌  | 282659/371472 [19:27<7:01:03,  3.52it/s]
 76%|███████▌  | 282660/371472 [19:28<7:14:30,  3.41it/s]
                                                         
{'loss': 2.4754, 'learning_rate': 3.1528906031157746e-07, 'epoch': 12.17}

 76%|███████▌  | 282660/371472 [19:28<7:14:30,  3.41it/s]
 76%|███████▌  | 282661/371472 [19:28<7:35:08,  3.25it/s]
 76%|███████▌  | 282662/371472 [19:28<7:09:40,  3.44it/s]
 76%|███████▌  | 282663/371472 [19:28<7:09:37,  3.45it/s]
 76%|███████▌  | 282664/371472 [19:29<7:07:13,  3.46it/s]
 76%|███████▌  | 282665/371472 [19:29<7:23:12,  3.34it/s]
 76%|███████▌  | 282666/371472 [19:29<7:27:46,  3.31it/s]
 76%|███████▌  | 282667/371472 [19:30<7:15:44,  3.40it/s]
 76%|███████▌  | 282668/371472 [19:30<7:02:20,  3.50it/s]
 76%|███████▌  | 282669/371472 [19:30<6:43:00,  3.67it/s]
 76%|███████▌  | 282670/371472 [19:30<6:45:44,  3.65it/s]
 76%|███████▌  | 282671/371472 [19:31<6:43:19,  3.67it/s]
 76%|███████▌  | 282672/371472 [19:31<6:38:32,  3.71it/s]
 76%|███████▌  | 282673/371472 [19:31<6:38:12,  3.72it/s]
 76%|███████▌  | 282674/371472 [19:31<6:23:19,  3.86it/s]
 76%|███████▌  | 282675/371472 [19:32<6:21:08,  3.88it/s]
 76%|███████▌  | 282676/371472 [19:32<6:20:21,  3.89it/s]
 76%|███████▌  | 282677/371472 [19:32<6:19:14,  3.90it/s]
 76%|███████▌  | 282678/371472 [19:32<6:35:47,  3.74it/s]
 76%|███████▌  | 282679/371472 [19:33<6:32:13,  3.77it/s]
 76%|███████▌  | 282680/371472 [19:33<6:51:36,  3.60it/s]
                                                         
{'loss': 2.8031, 'learning_rate': 3.1524057833609864e-07, 'epoch': 12.18}

 76%|███████▌  | 282680/371472 [19:33<6:51:36,  3.60it/s]
 76%|███████▌  | 282681/371472 [19:33<6:37:04,  3.73it/s]
 76%|███████▌  | 282682/371472 [19:34<6:58:36,  3.54it/s]
 76%|███████▌  | 282683/371472 [19:34<6:44:47,  3.66it/s]
 76%|███████▌  | 282684/371472 [19:34<6:36:54,  3.73it/s]
 76%|███████▌  | 282685/371472 [19:34<6:55:48,  3.56it/s]
 76%|███████▌  | 282686/371472 [19:35<7:37:11,  3.24it/s]
 76%|███████▌  | 282687/371472 [19:35<7:26:46,  3.31it/s]
 76%|███████▌  | 282688/371472 [19:35<7:55:26,  3.11it/s]
 76%|███████▌  | 282689/371472 [19:36<7:39:48,  3.22it/s]
 76%|███████▌  | 282690/371472 [19:36<7:16:56,  3.39it/s]
 76%|███████▌  | 282691/371472 [19:36<7:32:05,  3.27it/s]
 76%|███████▌  | 282692/371472 [19:37<7:19:32,  3.37it/s]
 76%|███████▌  | 282693/371472 [19:37<6:56:50,  3.55it/s]
 76%|███████▌  | 282694/371472 [19:37<7:09:33,  3.44it/s]
 76%|███████▌  | 282695/371472 [19:37<7:07:41,  3.46it/s]
 76%|███████▌  | 282696/371472 [19:38<7:08:16,  3.45it/s]
 76%|███████▌  | 282697/371472 [19:38<7:03:17,  3.50it/s]
 76%|███████▌  | 282698/371472 [19:38<7:40:46,  3.21it/s]
 76%|███████▌  | 282699/371472 [19:39<7:42:58,  3.20it/s]
 76%|███████▌  | 282700/371472 [19:39<7:22:43,  3.34it/s]
                                                         
{'loss': 2.6491, 'learning_rate': 3.1519209636061966e-07, 'epoch': 12.18}

 76%|███████▌  | 282700/371472 [19:39<7:22:43,  3.34it/s]
 76%|███████▌  | 282701/371472 [19:39<7:25:40,  3.32it/s]
 76%|███████▌  | 282702/371472 [19:40<7:04:26,  3.49it/s]
 76%|███████▌  | 282703/371472 [19:40<6:48:52,  3.62it/s]
 76%|███████▌  | 282704/371472 [19:40<6:41:19,  3.69it/s]
 76%|███████▌  | 282705/371472 [19:40<6:54:22,  3.57it/s]
 76%|███████▌  | 282706/371472 [19:41<6:48:38,  3.62it/s]
 76%|███████▌  | 282707/371472 [19:41<6:58:51,  3.53it/s]
 76%|███████▌  | 282708/371472 [19:41<7:04:26,  3.49it/s]
 76%|███████▌  | 282709/371472 [19:41<6:56:06,  3.56it/s]
 76%|███████▌  | 282710/371472 [19:42<7:12:53,  3.42it/s]
 76%|███████▌  | 282711/371472 [19:42<7:48:56,  3.15it/s]
 76%|███████▌  | 282712/371472 [19:42<7:38:41,  3.23it/s]
 76%|███████▌  | 282713/371472 [19:43<7:15:16,  3.40it/s]
 76%|███████▌  | 282714/371472 [19:43<7:37:35,  3.23it/s]
 76%|███████▌  | 282715/371472 [19:43<7:50:35,  3.14it/s]
 76%|███████▌  | 282716/371472 [19:44<7:31:47,  3.27it/s]
 76%|███████▌  | 282717/371472 [19:44<7:30:26,  3.28it/s]
 76%|███████▌  | 282718/371472 [19:44<7:12:53,  3.42it/s]
 76%|███████▌  | 282719/371472 [19:45<7:10:14,  3.44it/s]
 76%|███████▌  | 282720/371472 [19:45<7:18:59,  3.37it/s]
                                                         
{'loss': 2.6157, 'learning_rate': 3.1514361438514083e-07, 'epoch': 12.18}

 76%|███████▌  | 282720/371472 [19:45<7:18:59,  3.37it/s]
 76%|███████▌  | 282721/371472 [19:45<7:04:28,  3.48it/s]
 76%|███████▌  | 282722/371472 [19:45<7:26:30,  3.31it/s]
 76%|███████▌  | 282723/371472 [19:46<7:20:05,  3.36it/s]
 76%|███████▌  | 282724/371472 [19:46<7:02:15,  3.50it/s]
 76%|███████▌  | 282725/371472 [19:46<7:27:42,  3.30it/s]
 76%|███████▌  | 282726/371472 [19:47<7:32:31,  3.27it/s]
 76%|███████▌  | 282727/371472 [19:47<7:23:18,  3.34it/s]
 76%|███████▌  | 282728/371472 [19:47<7:06:14,  3.47it/s]
 76%|███████▌  | 282729/371472 [19:47<6:53:37,  3.58it/s]
 76%|███████▌  | 282730/371472 [19:48<6:49:39,  3.61it/s]
 76%|███████▌  | 282731/371472 [19:48<6:54:35,  3.57it/s]
 76%|███████▌  | 282732/371472 [19:48<6:52:43,  3.58it/s]
 76%|███████▌  | 282733/371472 [19:49<6:38:40,  3.71it/s]
 76%|███████▌  | 282734/371472 [19:49<6:55:51,  3.56it/s]
 76%|███████▌  | 282735/371472 [19:49<6:40:58,  3.69it/s]
 76%|███████▌  | 282736/371472 [19:49<6:30:20,  3.79it/s]
 76%|███████▌  | 282737/371472 [19:50<6:44:38,  3.65it/s]
 76%|███████▌  | 282738/371472 [19:50<6:46:37,  3.64it/s]
 76%|███████▌  | 282739/371472 [19:50<6:41:01,  3.69it/s]
 76%|███████▌  | 282740/371472 [19:51<7:03:10,  3.49it/s]
                                                         
{'loss': 2.5549, 'learning_rate': 3.1509513240966185e-07, 'epoch': 12.18}

 76%|███████▌  | 282740/371472 [19:51<7:03:10,  3.49it/s]
 76%|███████▌  | 282741/371472 [19:51<7:22:17,  3.34it/s]
 76%|███████▌  | 282742/371472 [19:51<7:04:32,  3.48it/s]
 76%|███████▌  | 282743/371472 [19:51<6:52:24,  3.59it/s]
 76%|███████▌  | 282744/371472 [19:52<6:48:55,  3.62it/s]
 76%|███████▌  | 282745/371472 [19:52<7:01:23,  3.51it/s]
 76%|███████▌  | 282746/371472 [19:52<6:55:26,  3.56it/s]
 76%|███████▌  | 282747/371472 [19:53<7:15:33,  3.40it/s]
 76%|███████▌  | 282748/371472 [19:53<7:19:12,  3.37it/s]
 76%|███████▌  | 282749/371472 [19:53<7:22:43,  3.34it/s]
 76%|███████▌  | 282750/371472 [19:53<7:10:22,  3.44it/s]
 76%|███████▌  | 282751/371472 [19:54<7:19:01,  3.37it/s]
 76%|███████▌  | 282752/371472 [19:54<7:14:02,  3.41it/s]
 76%|███████▌  | 282753/371472 [19:54<6:56:19,  3.55it/s]
 76%|███████▌  | 282754/371472 [19:55<6:46:24,  3.64it/s]
 76%|███████▌  | 282755/371472 [19:55<7:10:50,  3.43it/s]
 76%|███████▌  | 282756/371472 [19:55<7:08:23,  3.45it/s]
 76%|███████▌  | 282757/371472 [19:55<6:56:31,  3.55it/s]
 76%|███████▌  | 282758/371472 [19:56<6:48:00,  3.62it/s]
 76%|███████▌  | 282759/371472 [19:56<6:43:06,  3.67it/s]
 76%|███████▌  | 282760/371472 [19:56<6:57:29,  3.54it/s]
                                                         
{'loss': 2.7368, 'learning_rate': 3.1504665043418303e-07, 'epoch': 12.18}

 76%|███████▌  | 282760/371472 [19:56<6:57:29,  3.54it/s]
 76%|███████▌  | 282761/371472 [19:57<6:54:39,  3.57it/s]
 76%|███████▌  | 282762/371472 [19:57<6:57:18,  3.54it/s]
 76%|███████▌  | 282763/371472 [19:57<7:01:43,  3.51it/s]
 76%|███████▌  | 282764/371472 [19:57<6:45:27,  3.65it/s]
 76%|███████▌  | 282765/371472 [19:58<6:36:46,  3.73it/s]
 76%|███████▌  | 282766/371472 [19:58<6:50:00,  3.61it/s]
 76%|███████▌  | 282767/371472 [19:58<6:46:09,  3.64it/s]
 76%|███████▌  | 282768/371472 [19:58<6:47:51,  3.62it/s]
 76%|███████▌  | 282769/371472 [19:59<6:42:41,  3.67it/s]
 76%|███████▌  | 282770/371472 [19:59<7:00:02,  3.52it/s]
 76%|███████▌  | 282771/371472 [19:59<6:42:13,  3.68it/s]
 76%|███████▌  | 282772/371472 [20:00<6:33:23,  3.76it/s]
 76%|███████▌  | 282773/371472 [20:00<6:26:14,  3.83it/s]
 76%|███████▌  | 282774/371472 [20:00<6:18:24,  3.91it/s]
 76%|███████▌  | 282775/371472 [20:00<6:58:56,  3.53it/s]
 76%|███████▌  | 282776/371472 [20:01<7:12:25,  3.42it/s]
 76%|███████▌  | 282777/371472 [20:01<6:58:20,  3.53it/s]
 76%|███████▌  | 282778/371472 [20:01<7:05:42,  3.47it/s]
 76%|███████▌  | 282779/371472 [20:02<7:07:15,  3.46it/s]
 76%|███████▌  | 282780/371472 [20:02<7:33:56,  3.26it/s]
                                                         
{'loss': 2.7308, 'learning_rate': 3.149981684587041e-07, 'epoch': 12.18}

 76%|███████▌  | 282780/371472 [20:02<7:33:56,  3.26it/s]
 76%|███████▌  | 282781/371472 [20:02<7:11:23,  3.43it/s]
 76%|███████▌  | 282782/371472 [20:02<7:02:44,  3.50it/s]
 76%|███████▌  | 282783/371472 [20:03<6:52:13,  3.59it/s]
 76%|███████▌  | 282784/371472 [20:03<6:45:13,  3.65it/s]
 76%|███████▌  | 282785/371472 [20:03<6:47:10,  3.63it/s]
 76%|███████▌  | 282786/371472 [20:03<6:49:06,  3.61it/s]
 76%|███████▌  | 282787/371472 [20:04<6:55:43,  3.56it/s]
 76%|███████▌  | 282788/371472 [20:04<7:15:52,  3.39it/s]
 76%|███████▌  | 282789/371472 [20:04<7:33:50,  3.26it/s]
 76%|███████▌  | 282790/371472 [20:05<7:16:51,  3.38it/s]
 76%|███████▌  | 282791/371472 [20:05<7:05:02,  3.48it/s]
 76%|███████▌  | 282792/371472 [20:05<7:04:14,  3.48it/s]
 76%|███████▌  | 282793/371472 [20:06<7:00:43,  3.51it/s]
 76%|███████▌  | 282794/371472 [20:06<6:49:30,  3.61it/s]
 76%|███████▌  | 282795/371472 [20:06<7:24:34,  3.32it/s]
 76%|███████▌  | 282796/371472 [20:06<7:26:37,  3.31it/s]
 76%|███████▌  | 282797/371472 [20:07<7:05:51,  3.47it/s]
 76%|███████▌  | 282798/371472 [20:07<7:31:25,  3.27it/s]
 76%|███████▌  | 282799/371472 [20:07<7:09:56,  3.44it/s]
 76%|███████▌  | 282800/371472 [20:08<7:10:05,  3.44it/s]
                                                         
{'loss': 2.6727, 'learning_rate': 3.149496864832253e-07, 'epoch': 12.18}

 76%|███████▌  | 282800/371472 [20:08<7:10:05,  3.44it/s]
 76%|███████▌  | 282801/371472 [20:08<7:16:11,  3.39it/s]
 76%|███████▌  | 282802/371472 [20:08<7:00:08,  3.52it/s]
 76%|███████▌  | 282803/371472 [20:08<7:17:14,  3.38it/s]
 76%|███████▌  | 282804/371472 [20:09<7:04:42,  3.48it/s]
 76%|███████▌  | 282805/371472 [20:09<7:02:14,  3.50it/s]
 76%|███████▌  | 282806/371472 [20:09<6:45:55,  3.64it/s]
 76%|███████▌  | 282807/371472 [20:10<6:38:16,  3.71it/s]
 76%|███████▌  | 282808/371472 [20:10<7:32:22,  3.27it/s]
 76%|███████▌  | 282809/371472 [20:10<7:15:33,  3.39it/s]
 76%|███████▌  | 282810/371472 [20:10<7:16:59,  3.38it/s]
 76%|███████▌  | 282811/371472 [20:11<6:52:10,  3.59it/s]
 76%|███████▌  | 282812/371472 [20:11<7:17:13,  3.38it/s]
 76%|███████▌  | 282813/371472 [20:11<7:02:31,  3.50it/s]
 76%|███████▌  | 282814/371472 [20:12<6:50:02,  3.60it/s]
 76%|███████▌  | 282815/371472 [20:12<7:03:22,  3.49it/s]
 76%|███████▌  | 282816/371472 [20:12<6:44:36,  3.65it/s]
 76%|███████▌  | 282817/371472 [20:13<7:56:49,  3.10it/s]
 76%|███████▌  | 282818/371472 [20:13<7:41:57,  3.20it/s]
 76%|███████▌  | 282819/371472 [20:13<7:37:55,  3.23it/s]
 76%|███████▌  | 282820/371472 [20:13<7:18:33,  3.37it/s]
                                                         
{'loss': 2.7379, 'learning_rate': 3.149012045077463e-07, 'epoch': 12.18}

 76%|███████▌  | 282820/371472 [20:13<7:18:33,  3.37it/s]
 76%|███████▌  | 282821/371472 [20:14<7:28:21,  3.30it/s]
 76%|███████▌  | 282822/371472 [20:14<7:17:09,  3.38it/s]
 76%|███████▌  | 282823/371472 [20:14<6:54:18,  3.57it/s]
 76%|███████▌  | 282824/371472 [20:15<7:09:55,  3.44it/s]
 76%|███████▌  | 282825/371472 [20:15<7:08:34,  3.45it/s]
 76%|███████▌  | 282826/371472 [20:15<7:03:27,  3.49it/s]
 76%|███████▌  | 282827/371472 [20:15<6:50:03,  3.60it/s]
 76%|███████▌  | 282828/371472 [20:16<6:53:43,  3.57it/s]
 76%|███████▌  | 282829/371472 [20:16<7:08:08,  3.45it/s]
 76%|███████▌  | 282830/371472 [20:16<7:20:09,  3.36it/s]
 76%|███████▌  | 282831/371472 [20:17<7:01:52,  3.50it/s]
 76%|███████▌  | 282832/371472 [20:17<6:54:52,  3.56it/s]
 76%|███████▌  | 282833/371472 [20:17<6:56:05,  3.55it/s]
 76%|███████▌  | 282834/371472 [20:17<6:42:41,  3.67it/s]
 76%|███████▌  | 282835/371472 [20:18<6:37:13,  3.72it/s]
 76%|███████▌  | 282836/371472 [20:18<6:53:07,  3.58it/s]
 76%|███████▌  | 282837/371472 [20:18<6:35:49,  3.73it/s]
 76%|███████▌  | 282838/371472 [20:18<6:26:44,  3.82it/s]
 76%|███████▌  | 282839/371472 [20:19<6:20:35,  3.88it/s]
 76%|███████▌  | 282840/371472 [20:19<6:36:36,  3.72it/s]
                                                         
{'loss': 2.562, 'learning_rate': 3.148527225322675e-07, 'epoch': 12.18}

 76%|███████▌  | 282840/371472 [20:19<6:36:36,  3.72it/s]
 76%|███████▌  | 282841/371472 [20:19<6:53:45,  3.57it/s]
 76%|███████▌  | 282842/371472 [20:20<7:00:15,  3.51it/s]
 76%|███████▌  | 282843/371472 [20:20<6:50:03,  3.60it/s]
 76%|███████▌  | 282844/371472 [20:20<6:53:00,  3.58it/s]
 76%|███████▌  | 282845/371472 [20:21<7:38:24,  3.22it/s]
 76%|███████▌  | 282846/371472 [20:21<7:32:53,  3.26it/s]
 76%|███████▌  | 282847/371472 [20:21<7:08:39,  3.45it/s]
 76%|███████▌  | 282848/371472 [20:21<7:14:32,  3.40it/s]
 76%|███████▌  | 282849/371472 [20:22<7:35:07,  3.25it/s]
 76%|███████▌  | 282850/371472 [20:22<7:13:10,  3.41it/s]
 76%|███████▌  | 282851/371472 [20:22<6:59:46,  3.52it/s]
 76%|███████▌  | 282852/371472 [20:23<7:00:32,  3.51it/s]
 76%|███████▌  | 282853/371472 [20:23<7:39:54,  3.21it/s]
 76%|███████▌  | 282854/371472 [20:23<7:30:41,  3.28it/s]
 76%|███████▌  | 282855/371472 [20:23<7:29:28,  3.29it/s]
 76%|███████▌  | 282856/371472 [20:24<7:11:18,  3.42it/s]
 76%|███████▌  | 282857/371472 [20:24<7:07:21,  3.46it/s]
 76%|███████▌  | 282858/371472 [20:24<7:11:08,  3.43it/s]
 76%|███████▌  | 282859/371472 [20:25<7:07:09,  3.46it/s]
 76%|███████▌  | 282860/371472 [20:25<7:00:25,  3.51it/s]
                                                         
{'loss': 2.5854, 'learning_rate': 3.148042405567885e-07, 'epoch': 12.18}

 76%|███████▌  | 282860/371472 [20:25<7:00:25,  3.51it/s]
 76%|███████▌  | 282861/371472 [20:25<6:51:07,  3.59it/s]
 76%|███████▌  | 282862/371472 [20:25<7:18:21,  3.37it/s]
 76%|███████▌  | 282863/371472 [20:26<7:13:16,  3.41it/s]
 76%|███████▌  | 282864/371472 [20:26<7:34:07,  3.25it/s]
 76%|███████▌  | 282865/371472 [20:26<7:13:10,  3.41it/s]
 76%|███████▌  | 282866/371472 [20:27<7:36:51,  3.23it/s]
 76%|███████▌  | 282867/371472 [20:27<7:31:37,  3.27it/s]
 76%|███████▌  | 282868/371472 [20:27<7:18:28,  3.37it/s]
 76%|███████▌  | 282869/371472 [20:28<6:53:28,  3.57it/s]
 76%|███████▌  | 282870/371472 [20:28<7:21:54,  3.34it/s]
 76%|███████▌  | 282871/371472 [20:28<6:55:28,  3.55it/s]
 76%|███████▌  | 282872/371472 [20:28<7:00:21,  3.51it/s]
 76%|███████▌  | 282873/371472 [20:29<7:01:18,  3.50it/s]
 76%|███████▌  | 282874/371472 [20:29<7:06:32,  3.46it/s]
 76%|███████▌  | 282875/371472 [20:29<7:13:57,  3.40it/s]
 76%|███████▌  | 282876/371472 [20:30<7:01:07,  3.51it/s]
 76%|███████▌  | 282877/371472 [20:30<6:51:39,  3.59it/s]
 76%|███████▌  | 282878/371472 [20:30<7:09:16,  3.44it/s]
 76%|███████▌  | 282879/371472 [20:30<7:02:00,  3.50it/s]
 76%|███████▌  | 282880/371472 [20:31<7:00:33,  3.51it/s]
                                                         
{'loss': 2.5675, 'learning_rate': 3.1475575858130967e-07, 'epoch': 12.18}

 76%|███████▌  | 282880/371472 [20:31<7:00:33,  3.51it/s]
 76%|███████▌  | 282881/371472 [20:31<6:54:24,  3.56it/s]
 76%|███████▌  | 282882/371472 [20:31<7:27:56,  3.30it/s]
 76%|███████▌  | 282883/371472 [20:32<7:04:49,  3.48it/s]
 76%|███████▌  | 282884/371472 [20:32<7:37:12,  3.23it/s]
 76%|███████▌  | 282885/371472 [20:32<7:53:39,  3.12it/s]
 76%|███████▌  | 282886/371472 [20:33<7:17:19,  3.38it/s]
 76%|███████▌  | 282887/371472 [20:33<7:15:44,  3.39it/s]
 76%|███████▌  | 282888/371472 [20:33<7:11:43,  3.42it/s]
 76%|███████▌  | 282889/371472 [20:33<7:03:46,  3.48it/s]
 76%|███████▌  | 282890/371472 [20:34<6:57:22,  3.54it/s]
 76%|███████▌  | 282891/371472 [20:34<6:42:26,  3.67it/s]
 76%|███████▌  | 282892/371472 [20:34<6:47:02,  3.63it/s]
 76%|███████▌  | 282893/371472 [20:34<6:47:57,  3.62it/s]
 76%|███████▌  | 282894/371472 [20:35<6:33:10,  3.75it/s]
 76%|███████▌  | 282895/371472 [20:35<6:47:00,  3.63it/s]
 76%|███████▌  | 282896/371472 [20:35<6:47:28,  3.62it/s]
 76%|███████▌  | 282897/371472 [20:36<6:45:45,  3.64it/s]
 76%|███████▌  | 282898/371472 [20:36<6:56:08,  3.55it/s]
 76%|███████▌  | 282899/371472 [20:36<7:39:14,  3.21it/s]
 76%|███████▌  | 282900/371472 [20:37<7:47:34,  3.16it/s]
                                                         
{'loss': 2.5105, 'learning_rate': 3.1470727660583074e-07, 'epoch': 12.19}

 76%|███████▌  | 282900/371472 [20:37<7:47:34,  3.16it/s]
 76%|███████▌  | 282901/371472 [20:37<7:55:05,  3.11it/s]
 76%|███████▌  | 282902/371472 [20:37<7:46:23,  3.17it/s]
 76%|███████▌  | 282903/371472 [20:37<7:27:33,  3.30it/s]
 76%|███████▌  | 282904/371472 [20:38<7:22:57,  3.33it/s]
 76%|███████▌  | 282905/371472 [20:38<7:33:21,  3.26it/s]
 76%|███████▌  | 282906/371472 [20:38<7:36:03,  3.24it/s]
 76%|███████▌  | 282907/371472 [20:39<7:45:21,  3.17it/s]
 76%|███████▌  | 282908/371472 [20:39<7:40:54,  3.20it/s]
 76%|███████▌  | 282909/371472 [20:39<7:45:27,  3.17it/s]
 76%|███████▌  | 282910/371472 [20:40<7:56:07,  3.10it/s]
 76%|███████▌  | 282911/371472 [20:40<7:37:16,  3.23it/s]
 76%|███████▌  | 282912/371472 [20:40<7:35:38,  3.24it/s]
 76%|███████▌  | 282913/371472 [20:41<7:50:01,  3.14it/s]
 76%|███████▌  | 282914/371472 [20:41<7:20:11,  3.35it/s]
 76%|███████▌  | 282915/371472 [20:41<7:06:03,  3.46it/s]
 76%|███████▌  | 282916/371472 [20:41<7:02:42,  3.49it/s]
 76%|███████▌  | 282917/371472 [20:42<7:02:21,  3.49it/s]
 76%|███████▌  | 282918/371472 [20:42<6:59:10,  3.52it/s]
 76%|███████▌  | 282919/371472 [20:42<6:52:17,  3.58it/s]
 76%|███████▌  | 282920/371472 [20:43<7:25:30,  3.31it/s]
                                                         
{'loss': 2.6114, 'learning_rate': 3.146587946303519e-07, 'epoch': 12.19}

 76%|███████▌  | 282920/371472 [20:43<7:25:30,  3.31it/s]
 76%|███████▌  | 282921/371472 [20:43<7:14:58,  3.39it/s]
 76%|███████▌  | 282922/371472 [20:43<7:15:36,  3.39it/s]
 76%|███████▌  | 282923/371472 [20:43<6:53:19,  3.57it/s]
 76%|███████▌  | 282924/371472 [20:44<6:44:00,  3.65it/s]
 76%|███████▌  | 282925/371472 [20:44<6:35:07,  3.73it/s]
 76%|███████▌  | 282926/371472 [20:44<6:36:21,  3.72it/s]
 76%|███████▌  | 282927/371472 [20:44<6:36:54,  3.72it/s]
 76%|███████▌  | 282928/371472 [20:45<6:42:37,  3.67it/s]
 76%|███████▌  | 282929/371472 [20:45<6:47:30,  3.62it/s]
 76%|███████▌  | 282930/371472 [20:45<6:56:29,  3.54it/s]
 76%|███████▌  | 282931/371472 [20:46<6:41:50,  3.67it/s]
 76%|███████▌  | 282932/371472 [20:46<7:11:35,  3.42it/s]
 76%|███████▌  | 282933/371472 [20:46<7:53:54,  3.11it/s]
 76%|███████▌  | 282934/371472 [20:47<7:28:14,  3.29it/s]
 76%|███████▌  | 282935/371472 [20:47<7:57:58,  3.09it/s]
 76%|███████▌  | 282936/371472 [20:47<7:44:52,  3.17it/s]
 76%|███████▌  | 282937/371472 [20:47<7:10:33,  3.43it/s]
 76%|███████▌  | 282938/371472 [20:48<6:51:17,  3.59it/s]
 76%|███████▌  | 282939/371472 [20:48<6:42:11,  3.67it/s]
 76%|███████▌  | 282940/371472 [20:48<6:32:45,  3.76it/s]
                                                         
{'loss': 2.6199, 'learning_rate': 3.14610312654873e-07, 'epoch': 12.19}

 76%|███████▌  | 282940/371472 [20:48<6:32:45,  3.76it/s]
 76%|███████▌  | 282941/371472 [20:48<6:22:49,  3.85it/s]
 76%|███████▌  | 282942/371472 [20:49<7:13:03,  3.41it/s]
 76%|███████▌  | 282943/371472 [20:49<7:03:26,  3.48it/s]
 76%|███████▌  | 282944/371472 [20:49<6:49:32,  3.60it/s]
 76%|███████▌  | 282945/371472 [20:50<6:49:14,  3.61it/s]
 76%|███████▌  | 282946/371472 [20:50<6:38:42,  3.70it/s]
 76%|███████▌  | 282947/371472 [20:50<6:43:07,  3.66it/s]
 76%|███████▌  | 282948/371472 [20:50<6:38:34,  3.70it/s]
 76%|███████▌  | 282949/371472 [20:51<6:34:17,  3.74it/s]
 76%|███████▌  | 282950/371472 [20:51<6:48:03,  3.62it/s]
 76%|███████▌  | 282951/371472 [20:51<6:34:10,  3.74it/s]
 76%|███████▌  | 282952/371472 [20:52<6:35:55,  3.73it/s]
 76%|███████▌  | 282953/371472 [20:52<7:08:32,  3.44it/s]
 76%|███████▌  | 282954/371472 [20:52<7:15:10,  3.39it/s]
 76%|███████▌  | 282955/371472 [20:52<7:05:36,  3.47it/s]
 76%|███████▌  | 282956/371472 [20:53<6:51:23,  3.59it/s]
 76%|███████▌  | 282957/371472 [20:53<7:10:40,  3.43it/s]
 76%|███████▌  | 282958/371472 [20:53<7:10:06,  3.43it/s]
 76%|███████▌  | 282959/371472 [20:54<7:38:17,  3.22it/s]
 76%|███████▌  | 282960/371472 [20:54<7:49:23,  3.14it/s]
                                                         
{'loss': 2.6921, 'learning_rate': 3.145618306793941e-07, 'epoch': 12.19}

 76%|███████▌  | 282960/371472 [20:54<7:49:23,  3.14it/s]
 76%|███████▌  | 282961/371472 [20:54<7:42:30,  3.19it/s]
 76%|███████▌  | 282962/371472 [20:55<7:49:10,  3.14it/s]
 76%|███████▌  | 282963/371472 [20:55<7:33:41,  3.25it/s]
 76%|███████▌  | 282964/371472 [20:55<7:30:33,  3.27it/s]
 76%|███████▌  | 282965/371472 [20:56<7:20:00,  3.35it/s]
 76%|███████▌  | 282966/371472 [20:56<7:02:23,  3.49it/s]
 76%|███████▌  | 282967/371472 [20:56<6:59:12,  3.52it/s]
 76%|███████▌  | 282968/371472 [20:56<6:58:35,  3.52it/s]
 76%|███████▌  | 282969/371472 [20:57<7:05:45,  3.46it/s]
 76%|███████▌  | 282970/371472 [20:57<7:12:56,  3.41it/s]
 76%|███████▌  | 282971/371472 [20:57<6:53:00,  3.57it/s]
 76%|███████▌  | 282972/371472 [20:57<6:41:02,  3.68it/s]
 76%|███████▌  | 282973/371472 [20:58<6:39:42,  3.69it/s]
 76%|███████▌  | 282974/371472 [20:58<6:28:18,  3.80it/s]
 76%|███████▌  | 282975/371472 [20:58<6:39:30,  3.69it/s]
 76%|███████▌  | 282976/371472 [20:58<6:25:20,  3.83it/s]
 76%|███████▌  | 282977/371472 [20:59<6:23:45,  3.84it/s]
 76%|███████▌  | 282978/371472 [20:59<6:30:32,  3.78it/s]
 76%|███████▌  | 282979/371472 [20:59<6:35:54,  3.73it/s]
 76%|███████▌  | 282980/371472 [21:00<6:34:02,  3.74it/s]
                                                         
{'loss': 2.6386, 'learning_rate': 3.1451334870391513e-07, 'epoch': 12.19}

 76%|███████▌  | 282980/371472 [21:00<6:34:02,  3.74it/s]
 76%|███████▌  | 282981/371472 [21:00<6:40:22,  3.68it/s]
 76%|███████▌  | 282982/371472 [21:00<6:35:10,  3.73it/s]
 76%|███████▌  | 282983/371472 [21:00<6:31:14,  3.77it/s]
 76%|███████▌  | 282984/371472 [21:01<6:37:03,  3.71it/s]
 76%|███████▌  | 282985/371472 [21:01<6:33:29,  3.75it/s]
 76%|███████▌  | 282986/371472 [21:01<6:39:11,  3.69it/s]
 76%|███████▌  | 282987/371472 [21:01<6:25:23,  3.83it/s]
 76%|███████▌  | 282988/371472 [21:02<6:39:18,  3.69it/s]
 76%|███████▌  | 282989/371472 [21:02<6:59:39,  3.51it/s]
 76%|███████▌  | 282990/371472 [21:02<7:01:21,  3.50it/s]
 76%|███████▌  | 282991/371472 [21:03<6:52:08,  3.58it/s]
 76%|███████▌  | 282992/371472 [21:03<6:33:11,  3.75it/s]
 76%|███████▌  | 282993/371472 [21:03<6:33:10,  3.75it/s]
 76%|███████▌  | 282994/371472 [21:03<6:45:26,  3.64it/s]
 76%|███████▌  | 282995/371472 [21:04<6:37:47,  3.71it/s]
 76%|███████▌  | 282996/371472 [21:04<6:31:43,  3.76it/s]
 76%|███████▌  | 282997/371472 [21:04<6:48:41,  3.61it/s]
 76%|███████▌  | 282998/371472 [21:04<6:40:27,  3.68it/s]
 76%|███████▌  | 282999/371472 [21:05<7:41:30,  3.20it/s]
 76%|███████▌  | 283000/371472 [21:05<7:15:25,  3.39it/s]
                                                         
{'loss': 2.5797, 'learning_rate': 3.144648667284363e-07, 'epoch': 12.19}

 76%|███████▌  | 283000/371472 [21:05<7:15:25,  3.39it/s]
 76%|███████▌  | 283001/371472 [21:05<7:19:29,  3.36it/s]
 76%|███████▌  | 283002/371472 [21:06<6:57:01,  3.54it/s]
 76%|███████▌  | 283003/371472 [21:06<6:50:39,  3.59it/s]
 76%|███████▌  | 283004/371472 [21:06<7:01:51,  3.50it/s]
 76%|███████▌  | 283005/371472 [21:07<6:49:54,  3.60it/s]
 76%|███████▌  | 283006/371472 [21:07<6:38:36,  3.70it/s]
 76%|███████▌  | 283007/371472 [21:07<7:20:03,  3.35it/s]
 76%|███████▌  | 283008/371472 [21:07<7:09:54,  3.43it/s]
 76%|███████▌  | 283009/371472 [21:08<7:21:35,  3.34it/s]
 76%|███████▌  | 283010/371472 [21:08<7:06:54,  3.45it/s]
 76%|███████▌  | 283011/371472 [21:08<7:10:01,  3.43it/s]
 76%|███████▌  | 283012/371472 [21:09<7:03:04,  3.48it/s]
 76%|███████▌  | 283013/371472 [21:09<6:58:01,  3.53it/s]
 76%|███████▌  | 283014/371472 [21:09<6:55:32,  3.55it/s]
 76%|███████▌  | 283015/371472 [21:09<6:39:45,  3.69it/s]
 76%|███████▌  | 283016/371472 [21:10<6:49:33,  3.60it/s]
 76%|███████▌  | 283017/371472 [21:10<6:43:46,  3.65it/s]
 76%|███████▌  | 283018/371472 [21:10<6:38:01,  3.70it/s]
 76%|███████▌  | 283019/371472 [21:10<6:51:04,  3.59it/s]
 76%|███████▌  | 283020/371472 [21:11<7:02:42,  3.49it/s]
                                                         
{'loss': 2.5456, 'learning_rate': 3.144163847529574e-07, 'epoch': 12.19}

 76%|███████▌  | 283020/371472 [21:11<7:02:42,  3.49it/s]
 76%|███████▌  | 283021/371472 [21:11<7:40:36,  3.20it/s]
 76%|███████▌  | 283022/371472 [21:12<8:08:14,  3.02it/s]
 76%|███████▌  | 283023/371472 [21:12<7:43:15,  3.18it/s]
 76%|███████▌  | 283024/371472 [21:12<7:19:08,  3.36it/s]
 76%|███████▌  | 283025/371472 [21:12<7:04:37,  3.47it/s]
 76%|███████▌  | 283026/371472 [21:13<6:50:08,  3.59it/s]
 76%|███████▌  | 283027/371472 [21:13<7:15:13,  3.39it/s]
 76%|███████▌  | 283028/371472 [21:13<7:04:40,  3.47it/s]
 76%|███████▌  | 283029/371472 [21:13<7:10:35,  3.42it/s]
 76%|███████▌  | 283030/371472 [21:14<7:51:56,  3.12it/s]
 76%|███████▌  | 283031/371472 [21:14<8:15:39,  2.97it/s]
 76%|███████▌  | 283032/371472 [21:15<7:53:52,  3.11it/s]
 76%|███████▌  | 283033/371472 [21:15<7:28:47,  3.28it/s]
 76%|███████▌  | 283034/371472 [21:15<7:19:43,  3.35it/s]
 76%|███████▌  | 283035/371472 [21:15<7:11:50,  3.41it/s]
 76%|███████▌  | 283036/371472 [21:16<6:59:26,  3.51it/s]
 76%|███████▌  | 283037/371472 [21:16<7:20:42,  3.34it/s]
 76%|███████▌  | 283038/371472 [21:16<7:10:15,  3.43it/s]
 76%|███████▌  | 283039/371472 [21:17<6:58:27,  3.52it/s]
 76%|███████▌  | 283040/371472 [21:17<6:40:16,  3.68it/s]
                                                         
{'loss': 2.5795, 'learning_rate': 3.1436790277747845e-07, 'epoch': 12.19}

 76%|███████▌  | 283040/371472 [21:17<6:40:16,  3.68it/s]
 76%|███████▌  | 283041/371472 [21:17<6:37:57,  3.70it/s]
 76%|███████▌  | 283042/371472 [21:17<6:30:12,  3.78it/s]
 76%|███████▌  | 283043/371472 [21:18<7:05:27,  3.46it/s]
 76%|███████▌  | 283044/371472 [21:18<7:42:03,  3.19it/s]
 76%|███████▌  | 283045/371472 [21:18<7:22:02,  3.33it/s]
 76%|███████▌  | 283046/371472 [21:19<7:14:16,  3.39it/s]
 76%|███████▌  | 283047/371472 [21:19<7:01:49,  3.49it/s]
 76%|███████▌  | 283048/371472 [21:19<6:58:41,  3.52it/s]
 76%|███████▌  | 283049/371472 [21:19<6:49:39,  3.60it/s]
 76%|███████▌  | 283050/371472 [21:20<6:55:59,  3.54it/s]
 76%|███████▌  | 283051/371472 [21:20<6:35:43,  3.72it/s]
 76%|███████▌  | 283052/371472 [21:20<6:37:31,  3.71it/s]
 76%|███████▌  | 283053/371472 [21:20<7:10:51,  3.42it/s]
 76%|███████▌  | 283054/371472 [21:21<7:18:42,  3.36it/s]
 76%|███████▌  | 283055/371472 [21:21<7:05:41,  3.46it/s]
 76%|███████▌  | 283056/371472 [21:21<6:49:00,  3.60it/s]
 76%|███████▌  | 283057/371472 [21:22<6:46:26,  3.63it/s]
 76%|███████▌  | 283058/371472 [21:22<6:46:32,  3.62it/s]
 76%|███████▌  | 283059/371472 [21:22<6:36:52,  3.71it/s]
 76%|███████▌  | 283060/371472 [21:22<6:38:29,  3.70it/s]
                                                         
{'loss': 2.8023, 'learning_rate': 3.1431942080199963e-07, 'epoch': 12.19}

 76%|███████▌  | 283060/371472 [21:22<6:38:29,  3.70it/s]
 76%|███████▌  | 283061/371472 [21:23<6:47:26,  3.62it/s]
 76%|███████▌  | 283062/371472 [21:23<7:02:41,  3.49it/s]
 76%|███████▌  | 283063/371472 [21:23<7:03:20,  3.48it/s]
 76%|███████▌  | 283064/371472 [21:24<6:51:13,  3.58it/s]
 76%|███████▌  | 283065/371472 [21:24<6:39:40,  3.69it/s]
 76%|███████▌  | 283066/371472 [21:24<6:32:06,  3.76it/s]
 76%|███████▌  | 283067/371472 [21:24<6:31:35,  3.76it/s]
 76%|███████▌  | 283068/371472 [21:25<6:37:07,  3.71it/s]
 76%|███████▌  | 283069/371472 [21:25<6:32:50,  3.75it/s]
 76%|███████▌  | 283070/371472 [21:25<6:27:13,  3.80it/s]
 76%|███████▌  | 283071/371472 [21:25<6:34:27,  3.74it/s]
 76%|███████▌  | 283072/371472 [21:26<6:38:09,  3.70it/s]
 76%|███████▌  | 283073/371472 [21:26<6:45:52,  3.63it/s]
 76%|███████▌  | 283074/371472 [21:26<6:54:36,  3.55it/s]
 76%|███████▌  | 283075/371472 [21:27<7:05:27,  3.46it/s]
 76%|███████▌  | 283076/371472 [21:27<6:49:14,  3.60it/s]
 76%|███████▌  | 283077/371472 [21:27<6:38:34,  3.70it/s]
 76%|███████▌  | 283078/371472 [21:27<6:35:05,  3.73it/s]
 76%|███████▌  | 283079/371472 [21:28<6:23:47,  3.84it/s]
 76%|███████▌  | 283080/371472 [21:28<6:23:53,  3.84it/s]
                                                         
{'loss': 2.7558, 'learning_rate': 3.1427093882652065e-07, 'epoch': 12.19}

 76%|███████▌  | 283080/371472 [21:28<6:23:53,  3.84it/s]
 76%|███████▌  | 283081/371472 [21:28<6:17:40,  3.90it/s]
 76%|███████▌  | 283082/371472 [21:28<6:30:58,  3.77it/s]
 76%|███████▌  | 283083/371472 [21:29<6:42:20,  3.66it/s]
 76%|███████▌  | 283084/371472 [21:29<6:55:02,  3.55it/s]
 76%|███████▌  | 283085/371472 [21:29<6:45:55,  3.63it/s]
 76%|███████▌  | 283086/371472 [21:30<7:08:22,  3.44it/s]
 76%|███████▌  | 283087/371472 [21:30<6:45:49,  3.63it/s]
 76%|███████▌  | 283088/371472 [21:30<6:41:46,  3.67it/s]
 76%|███████▌  | 283089/371472 [21:30<6:36:52,  3.71it/s]
 76%|███████▌  | 283090/371472 [21:31<6:56:55,  3.53it/s]
 76%|███████▌  | 283091/371472 [21:31<6:46:03,  3.63it/s]
 76%|███████▌  | 283092/371472 [21:31<6:50:32,  3.59it/s]
 76%|███████▌  | 283093/371472 [21:31<6:47:09,  3.62it/s]
 76%|███████▌  | 283094/371472 [21:32<6:42:51,  3.66it/s]
 76%|███████▌  | 283095/371472 [21:32<6:32:56,  3.75it/s]
 76%|███████▌  | 283096/371472 [21:32<6:37:45,  3.70it/s]
 76%|███████▌  | 283097/371472 [21:33<6:54:27,  3.55it/s]
 76%|███████▌  | 283098/371472 [21:33<7:14:20,  3.39it/s]
 76%|███████▌  | 283099/371472 [21:33<7:12:50,  3.40it/s]
 76%|███████▌  | 283100/371472 [21:33<7:17:59,  3.36it/s]
                                                         
{'loss': 2.6029, 'learning_rate': 3.1422245685104183e-07, 'epoch': 12.19}

 76%|███████▌  | 283100/371472 [21:33<7:17:59,  3.36it/s]
 76%|███████▌  | 283101/371472 [21:34<7:07:16,  3.45it/s]
 76%|███████▌  | 283102/371472 [21:34<6:57:36,  3.53it/s]
 76%|███████▌  | 283103/371472 [21:34<6:48:19,  3.61it/s]
 76%|███████▌  | 283104/371472 [21:35<6:59:28,  3.51it/s]
 76%|███████▌  | 283105/371472 [21:35<6:43:02,  3.65it/s]
 76%|███████▌  | 283106/371472 [21:35<6:38:37,  3.69it/s]
 76%|███████▌  | 283107/371472 [21:35<6:38:28,  3.70it/s]
 76%|███████▌  | 283108/371472 [21:36<6:57:13,  3.53it/s]
 76%|███████▌  | 283109/371472 [21:36<6:56:51,  3.53it/s]
 76%|███████▌  | 283110/371472 [21:36<6:47:43,  3.61it/s]
 76%|███████▌  | 283111/371472 [21:36<6:44:51,  3.64it/s]
 76%|███████▌  | 283112/371472 [21:37<6:36:52,  3.71it/s]
 76%|███████▌  | 283113/371472 [21:37<7:13:01,  3.40it/s]
 76%|███████▌  | 283114/371472 [21:37<6:56:01,  3.54it/s]
 76%|███████▌  | 283115/371472 [21:38<6:52:22,  3.57it/s]
 76%|███████▌  | 283116/371472 [21:38<6:47:54,  3.61it/s]
 76%|███████▌  | 283117/371472 [21:38<7:04:26,  3.47it/s]
 76%|███████▌  | 283118/371472 [21:38<6:59:13,  3.51it/s]
 76%|███████▌  | 283119/371472 [21:39<6:46:34,  3.62it/s]
 76%|███████▌  | 283120/371472 [21:39<6:57:29,  3.53it/s]
                                                         
{'loss': 2.6282, 'learning_rate': 3.1417397487556285e-07, 'epoch': 12.19}

 76%|███████▌  | 283120/371472 [21:39<6:57:29,  3.53it/s]
 76%|███████▌  | 283121/371472 [21:39<6:51:25,  3.58it/s]
 76%|███████▌  | 283122/371472 [21:40<6:47:30,  3.61it/s]
 76%|███████▌  | 283123/371472 [21:40<7:06:29,  3.45it/s]
 76%|███████▌  | 283124/371472 [21:40<6:48:11,  3.61it/s]
 76%|███████▌  | 283125/371472 [21:40<6:35:04,  3.73it/s]
 76%|███████▌  | 283126/371472 [21:41<6:36:55,  3.71it/s]
 76%|███████▌  | 283127/371472 [21:41<6:40:41,  3.67it/s]
 76%|███████▌  | 283128/371472 [21:41<6:46:56,  3.62it/s]
 76%|███████▌  | 283129/371472 [21:41<6:43:36,  3.65it/s]
 76%|███████▌  | 283130/371472 [21:42<6:51:43,  3.58it/s]
 76%|███████▌  | 283131/371472 [21:42<6:51:43,  3.58it/s]
 76%|███████▌  | 283132/371472 [21:42<7:15:52,  3.38it/s]
 76%|███████▌  | 283133/371472 [21:43<7:16:57,  3.37it/s]
 76%|███████▌  | 283134/371472 [21:43<8:09:37,  3.01it/s]
 76%|███████▌  | 283135/371472 [21:43<7:41:56,  3.19it/s]
 76%|███████▌  | 283136/371472 [21:44<7:20:21,  3.34it/s]
 76%|███████▌  | 283137/371472 [21:44<7:06:57,  3.45it/s]
 76%|███████▌  | 283138/371472 [21:44<6:45:40,  3.63it/s]
 76%|███████▌  | 283139/371472 [21:45<7:26:52,  3.29it/s]
 76%|███████▌  | 283140/371472 [21:45<7:28:55,  3.28it/s]
                                                         
{'loss': 2.777, 'learning_rate': 3.14125492900084e-07, 'epoch': 12.2}

 76%|███████▌  | 283140/371472 [21:45<7:28:55,  3.28it/s]
 76%|███████▌  | 283141/371472 [21:45<7:13:55,  3.39it/s]
 76%|███████▌  | 283142/371472 [21:45<7:10:55,  3.42it/s]
 76%|███████▌  | 283143/371472 [21:46<7:11:54,  3.41it/s]
 76%|███████▌  | 283144/371472 [21:46<7:30:45,  3.27it/s]
 76%|███████▌  | 283145/371472 [21:46<7:25:21,  3.31it/s]
 76%|███████▌  | 283146/371472 [21:47<7:09:58,  3.42it/s]
 76%|███████▌  | 283147/371472 [21:47<6:58:40,  3.52it/s]
 76%|███████▌  | 283148/371472 [21:47<6:50:39,  3.58it/s]
 76%|███████▌  | 283149/371472 [21:47<6:49:13,  3.60it/s]
 76%|███████▌  | 283150/371472 [21:48<6:56:49,  3.53it/s]
 76%|███████▌  | 283151/371472 [21:48<6:52:26,  3.57it/s]
 76%|███████▌  | 283152/371472 [21:48<7:15:53,  3.38it/s]
 76%|███████▌  | 283153/371472 [21:49<7:04:59,  3.46it/s]
 76%|███████▌  | 283154/371472 [21:49<7:10:26,  3.42it/s]
 76%|███████▌  | 283155/371472 [21:49<7:13:00,  3.40it/s]
 76%|███████▌  | 283156/371472 [21:49<6:53:54,  3.56it/s]
 76%|███████▌  | 283157/371472 [21:50<6:55:49,  3.54it/s]
 76%|███████▌  | 283158/371472 [21:50<7:00:30,  3.50it/s]
 76%|███████▌  | 283159/371472 [21:50<6:56:37,  3.53it/s]
 76%|███████▌  | 283160/371472 [21:51<7:05:54,  3.46it/s]
                                                         
{'loss': 2.7223, 'learning_rate': 3.140770109246051e-07, 'epoch': 12.2}

 76%|███████▌  | 283160/371472 [21:51<7:05:54,  3.46it/s]
 76%|███████▌  | 283161/371472 [21:51<7:13:39,  3.39it/s]
 76%|███████▌  | 283162/371472 [21:51<6:51:56,  3.57it/s]
 76%|███████▌  | 283163/371472 [21:51<6:45:38,  3.63it/s]
 76%|███████▌  | 283164/371472 [21:52<6:35:18,  3.72it/s]
 76%|███████▌  | 283165/371472 [21:52<6:40:10,  3.68it/s]
 76%|███████▌  | 283166/371472 [21:52<7:02:42,  3.48it/s]
 76%|███████▌  | 283167/371472 [21:53<8:10:31,  3.00it/s]
 76%|███████▌  | 283168/371472 [21:53<7:47:56,  3.15it/s]
 76%|███████▌  | 283169/371472 [21:53<7:22:37,  3.33it/s]
 76%|███████▌  | 283170/371472 [21:53<7:03:12,  3.48it/s]
 76%|███████▌  | 283171/371472 [21:54<7:34:12,  3.24it/s]
 76%|███████▌  | 283172/371472 [21:54<7:10:51,  3.42it/s]
 76%|███████▌  | 283173/371472 [21:54<7:11:00,  3.41it/s]
 76%|███████▌  | 283174/371472 [21:55<7:33:00,  3.25it/s]
 76%|███████▌  | 283175/371472 [21:55<7:28:57,  3.28it/s]
 76%|███████▌  | 283176/371472 [21:55<7:10:21,  3.42it/s]
 76%|███████▌  | 283177/371472 [21:56<6:53:15,  3.56it/s]
 76%|███████▌  | 283178/371472 [21:56<6:40:35,  3.67it/s]
 76%|███████▌  | 283179/371472 [21:56<6:57:56,  3.52it/s]
 76%|███████▌  | 283180/371472 [21:57<7:38:05,  3.21it/s]
                                                         
{'loss': 2.5273, 'learning_rate': 3.1402852894912627e-07, 'epoch': 12.2}

 76%|███████▌  | 283180/371472 [21:57<7:38:05,  3.21it/s]
 76%|███████▌  | 283181/371472 [21:57<7:11:49,  3.41it/s]
 76%|███████▌  | 283182/371472 [21:57<7:02:52,  3.48it/s]
 76%|███████▌  | 283183/371472 [21:57<7:02:01,  3.49it/s]
 76%|███████▌  | 283184/371472 [21:58<7:06:03,  3.45it/s]
 76%|███████▌  | 283185/371472 [21:58<6:51:52,  3.57it/s]
 76%|███████▌  | 283186/371472 [21:58<6:45:43,  3.63it/s]
 76%|███████▌  | 283187/371472 [21:58<7:25:21,  3.30it/s]
 76%|███████▌  | 283188/371472 [21:59<7:03:24,  3.48it/s]
 76%|███████▌  | 283189/371472 [21:59<6:56:28,  3.53it/s]
 76%|███████▌  | 283190/371472 [21:59<6:51:27,  3.58it/s]
 76%|███████▌  | 283191/371472 [22:00<6:42:29,  3.66it/s]
 76%|███████▌  | 283192/371472 [22:00<7:09:27,  3.43it/s]
 76%|███████▌  | 283193/371472 [22:00<6:52:50,  3.56it/s]
 76%|███████▌  | 283194/371472 [22:00<6:41:31,  3.66it/s]
 76%|███████▌  | 283195/371472 [22:01<7:12:34,  3.40it/s]
 76%|███████▌  | 283196/371472 [22:01<7:00:25,  3.50it/s]
 76%|███████▌  | 283197/371472 [22:01<7:11:58,  3.41it/s]
 76%|███████▌  | 283198/371472 [22:02<7:00:17,  3.50it/s]
 76%|███████▌  | 283199/371472 [22:02<6:49:54,  3.59it/s]
 76%|███████▌  | 283200/371472 [22:02<6:49:26,  3.59it/s]
                                                         
{'loss': 2.7031, 'learning_rate': 3.1398004697364734e-07, 'epoch': 12.2}

 76%|███████▌  | 283200/371472 [22:02<6:49:26,  3.59it/s]
 76%|███████▌  | 283201/371472 [22:02<6:38:18,  3.69it/s]
 76%|███████▌  | 283202/371472 [22:03<6:38:11,  3.69it/s]
 76%|███████▌  | 283203/371472 [22:03<6:55:56,  3.54it/s]
 76%|███████▌  | 283204/371472 [22:03<6:47:48,  3.61it/s]
 76%|███████▌  | 283205/371472 [22:04<6:52:59,  3.56it/s]
 76%|███████▌  | 283206/371472 [22:04<6:54:49,  3.55it/s]
 76%|███████▌  | 283207/371472 [22:04<6:53:32,  3.56it/s]
 76%|███████▌  | 283208/371472 [22:04<6:44:53,  3.63it/s]
 76%|███████▌  | 283209/371472 [22:05<6:49:41,  3.59it/s]
 76%|███████▌  | 283210/371472 [22:05<6:39:32,  3.68it/s]
 76%|███████▌  | 283211/371472 [22:05<6:58:35,  3.51it/s]
 76%|███████▌  | 283212/371472 [22:05<6:53:50,  3.55it/s]
 76%|███████▌  | 283213/371472 [22:06<7:03:00,  3.48it/s]
 76%|███████▌  | 283214/371472 [22:06<6:57:08,  3.53it/s]
 76%|███████▌  | 283215/371472 [22:06<7:07:13,  3.44it/s]
 76%|███████▌  | 283216/371472 [22:07<6:57:24,  3.52it/s]
 76%|███████▌  | 283217/371472 [22:07<7:04:42,  3.46it/s]
 76%|███████▌  | 283218/371472 [22:07<6:57:23,  3.52it/s]
 76%|███████▌  | 283219/371472 [22:07<6:56:17,  3.53it/s]
 76%|███████▌  | 283220/371472 [22:08<6:52:44,  3.56it/s]
                                                         
{'loss': 2.517, 'learning_rate': 3.1393156499816847e-07, 'epoch': 12.2}

 76%|███████▌  | 283220/371472 [22:08<6:52:44,  3.56it/s]
 76%|███████▌  | 283221/371472 [22:08<7:21:13,  3.33it/s]
 76%|███████▌  | 283222/371472 [22:08<7:16:12,  3.37it/s]
 76%|███████▌  | 283223/371472 [22:09<7:04:55,  3.46it/s]
 76%|███████▌  | 283224/371472 [22:09<6:53:07,  3.56it/s]
 76%|███████▌  | 283225/371472 [22:09<6:51:13,  3.58it/s]
 76%|███████▌  | 283226/371472 [22:09<6:42:01,  3.66it/s]
 76%|███████▌  | 283227/371472 [22:10<6:54:36,  3.55it/s]
 76%|███████▌  | 283228/371472 [22:10<6:51:31,  3.57it/s]
 76%|███████▌  | 283229/371472 [22:10<6:56:34,  3.53it/s]
 76%|███████▌  | 283230/371472 [22:11<7:04:06,  3.47it/s]
 76%|███████▌  | 283231/371472 [22:11<6:55:29,  3.54it/s]
 76%|███████▌  | 283232/371472 [22:11<6:48:32,  3.60it/s]
 76%|███████▌  | 283233/371472 [22:11<6:44:56,  3.63it/s]
 76%|███████▌  | 283234/371472 [22:12<6:55:39,  3.54it/s]
 76%|███████▌  | 283235/371472 [22:12<6:49:16,  3.59it/s]
 76%|███████▌  | 283236/371472 [22:12<6:37:02,  3.70it/s]
 76%|███████▌  | 283237/371472 [22:13<7:07:19,  3.44it/s]
 76%|███████▌  | 283238/371472 [22:13<6:55:43,  3.54it/s]
 76%|███████▌  | 283239/371472 [22:13<7:05:47,  3.45it/s]
 76%|███████▌  | 283240/371472 [22:13<7:04:46,  3.46it/s]
                                                         
{'loss': 2.5316, 'learning_rate': 3.138830830226895e-07, 'epoch': 12.2}

 76%|███████▌  | 283240/371472 [22:13<7:04:46,  3.46it/s]
 76%|███████▌  | 283241/371472 [22:14<6:53:53,  3.55it/s]
 76%|███████▌  | 283242/371472 [22:14<6:44:08,  3.64it/s]
 76%|███████▌  | 283243/371472 [22:14<6:45:45,  3.62it/s]
 76%|███████▌  | 283244/371472 [22:15<6:41:53,  3.66it/s]
 76%|███████▌  | 283245/371472 [22:15<6:50:07,  3.59it/s]
 76%|███████▌  | 283246/371472 [22:15<6:52:45,  3.56it/s]
 76%|███████▌  | 283247/371472 [22:15<6:46:58,  3.61it/s]
 76%|███████▋  | 283248/371472 [22:16<6:48:11,  3.60it/s]
 76%|███████▋  | 283249/371472 [22:16<6:46:57,  3.61it/s]
 76%|███████▋  | 283250/371472 [22:16<6:55:55,  3.54it/s]
 76%|███████▋  | 283251/371472 [22:17<7:15:19,  3.38it/s]
 76%|███████▋  | 283252/371472 [22:17<7:03:44,  3.47it/s]
 76%|███████▋  | 283253/371472 [22:17<6:54:03,  3.55it/s]
 76%|███████▋  | 283254/371472 [22:17<7:04:06,  3.47it/s]
 76%|███████▋  | 283255/371472 [22:18<6:53:32,  3.56it/s]
 76%|███████▋  | 283256/371472 [22:18<7:04:57,  3.46it/s]
 76%|███████▋  | 283257/371472 [22:18<7:48:14,  3.14it/s]
 76%|███████▋  | 283258/371472 [22:19<7:43:59,  3.17it/s]
 76%|███████▋  | 283259/371472 [22:19<7:23:09,  3.32it/s]
 76%|███████▋  | 283260/371472 [22:19<7:41:41,  3.18it/s]
                                                         
{'loss': 2.69, 'learning_rate': 3.1383460104721066e-07, 'epoch': 12.2}

 76%|███████▋  | 283260/371472 [22:19<7:41:41,  3.18it/s]
 76%|███████▋  | 283261/371472 [22:20<7:51:09,  3.12it/s]
 76%|███████▋  | 283262/371472 [22:20<7:49:40,  3.13it/s]
 76%|███████▋  | 283263/371472 [22:20<7:39:01,  3.20it/s]
 76%|███████▋  | 283264/371472 [22:20<7:06:24,  3.45it/s]
 76%|███████▋  | 283265/371472 [22:21<6:53:52,  3.55it/s]
 76%|███████▋  | 283266/371472 [22:21<6:45:26,  3.63it/s]
 76%|███████▋  | 283267/371472 [22:21<6:52:59,  3.56it/s]
 76%|███████▋  | 283268/371472 [22:22<6:51:37,  3.57it/s]
 76%|███████▋  | 283269/371472 [22:22<7:06:42,  3.45it/s]
 76%|███████▋  | 283270/371472 [22:22<7:08:20,  3.43it/s]
 76%|███████▋  | 283271/371472 [22:22<6:56:39,  3.53it/s]
 76%|███████▋  | 283272/371472 [22:23<6:50:50,  3.58it/s]
 76%|███████▋  | 283273/371472 [22:23<6:50:49,  3.58it/s]
 76%|███████▋  | 283274/371472 [22:23<6:41:15,  3.66it/s]
 76%|███████▋  | 283275/371472 [22:24<6:53:01,  3.56it/s]
 76%|███████▋  | 283276/371472 [22:24<7:15:52,  3.37it/s]
 76%|███████▋  | 283277/371472 [22:24<6:56:40,  3.53it/s]
 76%|███████▋  | 283278/371472 [22:24<6:46:40,  3.61it/s]
 76%|███████▋  | 283279/371472 [22:25<7:24:10,  3.31it/s]
 76%|███████▋  | 283280/371472 [22:25<7:02:54,  3.48it/s]
                                                         
{'loss': 2.6164, 'learning_rate': 3.1378611907173174e-07, 'epoch': 12.2}

 76%|███████▋  | 283280/371472 [22:25<7:02:54,  3.48it/s]
 76%|███████▋  | 283281/371472 [22:25<7:04:54,  3.46it/s]
 76%|███████▋  | 283282/371472 [22:26<6:57:15,  3.52it/s]
 76%|███████▋  | 283283/371472 [22:26<6:49:56,  3.59it/s]
 76%|███████▋  | 283284/371472 [22:26<6:43:23,  3.64it/s]
 76%|███████▋  | 283285/371472 [22:26<6:39:59,  3.67it/s]
 76%|███████▋  | 283286/371472 [22:27<6:41:56,  3.66it/s]
 76%|███████▋  | 283287/371472 [22:27<6:43:45,  3.64it/s]
 76%|███████▋  | 283288/371472 [22:27<6:43:57,  3.64it/s]
 76%|███████▋  | 283289/371472 [22:27<6:44:23,  3.63it/s]
 76%|███████▋  | 283290/371472 [22:28<6:39:42,  3.68it/s]
 76%|███████▋  | 283291/371472 [22:28<6:39:19,  3.68it/s]
 76%|███████▋  | 283292/371472 [22:28<6:43:09,  3.65it/s]
 76%|███████▋  | 283293/371472 [22:29<6:43:31,  3.64it/s]
 76%|███████▋  | 283294/371472 [22:29<7:16:13,  3.37it/s]
 76%|███████▋  | 283295/371472 [22:29<7:25:08,  3.30it/s]
 76%|███████▋  | 283296/371472 [22:29<7:14:58,  3.38it/s]
 76%|███████▋  | 283297/371472 [22:30<7:17:07,  3.36it/s]
 76%|███████▋  | 283298/371472 [22:30<7:11:40,  3.40it/s]
 76%|███████▋  | 283299/371472 [22:30<7:06:01,  3.45it/s]
 76%|███████▋  | 283300/371472 [22:31<7:09:46,  3.42it/s]
                                                         
{'loss': 2.6084, 'learning_rate': 3.137376370962529e-07, 'epoch': 12.2}

 76%|███████▋  | 283300/371472 [22:31<7:09:46,  3.42it/s]
 76%|███████▋  | 283301/371472 [22:31<7:14:01,  3.39it/s]
 76%|███████▋  | 283302/371472 [22:31<7:18:05,  3.35it/s]
 76%|███████▋  | 283303/371472 [22:32<7:06:52,  3.44it/s]
 76%|███████▋  | 283304/371472 [22:32<7:07:53,  3.43it/s]
 76%|███████▋  | 283305/371472 [22:32<7:07:44,  3.44it/s]
 76%|███████▋  | 283306/371472 [22:32<7:27:22,  3.28it/s]
 76%|███████▋  | 283307/371472 [22:33<7:06:33,  3.44it/s]
 76%|███████▋  | 283308/371472 [22:33<7:13:03,  3.39it/s]
 76%|███████▋  | 283309/371472 [22:33<6:58:44,  3.51it/s]
 76%|███████▋  | 283310/371472 [22:34<6:47:07,  3.61it/s]
 76%|███████▋  | 283311/371472 [22:34<6:56:03,  3.53it/s]
 76%|███████▋  | 283312/371472 [22:34<7:01:29,  3.49it/s]
 76%|███████▋  | 283313/371472 [22:34<6:51:24,  3.57it/s]
 76%|███████▋  | 283314/371472 [22:35<6:56:53,  3.52it/s]
 76%|███████▋  | 283315/371472 [22:35<6:41:45,  3.66it/s]
 76%|███████▋  | 283316/371472 [22:35<6:49:52,  3.58it/s]
 76%|███████▋  | 283317/371472 [22:36<7:35:06,  3.23it/s]
 76%|███████▋  | 283318/371472 [22:36<7:16:55,  3.36it/s]
 76%|███████▋  | 283319/371472 [22:36<7:21:40,  3.33it/s]
 76%|███████▋  | 283320/371472 [22:36<7:08:05,  3.43it/s]
                                                         
{'loss': 2.79, 'learning_rate': 3.13689155120774e-07, 'epoch': 12.2}

 76%|███████▋  | 283320/371472 [22:36<7:08:05,  3.43it/s]
 76%|███████▋  | 283321/371472 [22:37<7:30:55,  3.26it/s]
 76%|███████▋  | 283322/371472 [22:37<7:00:58,  3.49it/s]
 76%|███████▋  | 283323/371472 [22:37<7:15:00,  3.38it/s]
 76%|███████▋  | 283324/371472 [22:38<7:10:57,  3.41it/s]
 76%|███████▋  | 283325/371472 [22:38<7:05:22,  3.45it/s]
 76%|███████▋  | 283326/371472 [22:38<7:00:35,  3.49it/s]
 76%|███████▋  | 283327/371472 [22:38<6:45:16,  3.62it/s]
 76%|███████▋  | 283328/371472 [22:39<6:38:15,  3.69it/s]
 76%|███████▋  | 283329/371472 [22:39<6:32:36,  3.74it/s]
 76%|███████▋  | 283330/371472 [22:39<6:31:37,  3.75it/s]
 76%|███████▋  | 283331/371472 [22:39<6:29:45,  3.77it/s]
 76%|███████▋  | 283332/371472 [22:40<6:28:47,  3.78it/s]
 76%|███████▋  | 283333/371472 [22:40<6:21:40,  3.85it/s]
 76%|███████▋  | 283334/371472 [22:40<6:20:18,  3.86it/s]
 76%|███████▋  | 283335/371472 [22:41<6:22:03,  3.84it/s]
 76%|███████▋  | 283336/371472 [22:41<6:23:12,  3.83it/s]
 76%|███████▋  | 283337/371472 [22:41<6:58:21,  3.51it/s]
 76%|███████▋  | 283338/371472 [22:41<6:58:31,  3.51it/s]
 76%|███████▋  | 283339/371472 [22:42<6:51:01,  3.57it/s]
 76%|███████▋  | 283340/371472 [22:42<6:38:26,  3.69it/s]
                                                         
{'loss': 2.7838, 'learning_rate': 3.136406731452951e-07, 'epoch': 12.2}

 76%|███████▋  | 283340/371472 [22:42<6:38:26,  3.69it/s]
 76%|███████▋  | 283341/371472 [22:42<6:36:55,  3.70it/s]
 76%|███████▋  | 283342/371472 [22:42<6:36:16,  3.71it/s]
 76%|███████▋  | 283343/371472 [22:43<6:56:16,  3.53it/s]
 76%|███████▋  | 283344/371472 [22:43<7:05:36,  3.45it/s]
 76%|███████▋  | 283345/371472 [22:43<7:04:12,  3.46it/s]
 76%|███████▋  | 283346/371472 [22:44<6:52:48,  3.56it/s]
 76%|███████▋  | 283347/371472 [22:44<6:50:08,  3.58it/s]
 76%|███████▋  | 283348/371472 [22:44<6:41:03,  3.66it/s]
 76%|███████▋  | 283349/371472 [22:45<7:43:46,  3.17it/s]
 76%|███████▋  | 283350/371472 [22:45<7:43:49,  3.17it/s]
 76%|███████▋  | 283351/371472 [22:45<7:40:41,  3.19it/s]
 76%|███████▋  | 283352/371472 [22:46<7:32:27,  3.25it/s]
 76%|███████▋  | 283353/371472 [22:46<7:05:04,  3.45it/s]
 76%|███████▋  | 283354/371472 [22:46<7:13:34,  3.39it/s]
 76%|███████▋  | 283355/371472 [22:46<7:03:51,  3.46it/s]
 76%|███████▋  | 283356/371472 [22:47<7:03:47,  3.47it/s]
 76%|███████▋  | 283357/371472 [22:47<6:50:05,  3.58it/s]
 76%|███████▋  | 283358/371472 [22:47<6:49:49,  3.58it/s]
 76%|███████▋  | 283359/371472 [22:47<7:16:14,  3.37it/s]
 76%|███████▋  | 283360/371472 [22:48<7:25:41,  3.29it/s]
                                                         
{'loss': 2.5918, 'learning_rate': 3.1359219116981613e-07, 'epoch': 12.2}

 76%|███████▋  | 283360/371472 [22:48<7:25:41,  3.29it/s]
 76%|███████▋  | 283361/371472 [22:48<7:09:13,  3.42it/s]
 76%|███████▋  | 283362/371472 [22:48<7:37:25,  3.21it/s]
 76%|███████▋  | 283363/371472 [22:49<7:06:43,  3.44it/s]
 76%|███████▋  | 283364/371472 [22:49<7:04:36,  3.46it/s]
 76%|███████▋  | 283365/371472 [22:49<6:53:43,  3.55it/s]
 76%|███████▋  | 283366/371472 [22:49<6:47:16,  3.61it/s]
 76%|███████▋  | 283367/371472 [22:50<6:44:53,  3.63it/s]
 76%|███████▋  | 283368/371472 [22:50<6:41:08,  3.66it/s]
 76%|███████▋  | 283369/371472 [22:50<6:41:05,  3.66it/s]
 76%|███████▋  | 283370/371472 [22:51<6:35:56,  3.71it/s]
 76%|███████▋  | 283371/371472 [22:51<6:48:29,  3.59it/s]
 76%|███████▋  | 283372/371472 [22:51<6:53:39,  3.55it/s]
 76%|███████▋  | 283373/371472 [22:51<6:54:42,  3.54it/s]
 76%|███████▋  | 283374/371472 [22:52<6:54:03,  3.55it/s]
 76%|███████▋  | 283375/371472 [22:52<6:43:10,  3.64it/s]
 76%|███████▋  | 283376/371472 [22:52<6:41:16,  3.66it/s]
 76%|███████▋  | 283377/371472 [22:53<6:38:55,  3.68it/s]
 76%|███████▋  | 283378/371472 [22:53<6:36:01,  3.71it/s]
 76%|███████▋  | 283379/371472 [22:53<6:29:11,  3.77it/s]
 76%|███████▋  | 283380/371472 [22:53<6:38:37,  3.68it/s]
                                                         
{'loss': 2.6417, 'learning_rate': 3.135437091943373e-07, 'epoch': 12.21}

 76%|███████▋  | 283380/371472 [22:53<6:38:37,  3.68it/s]
 76%|███████▋  | 283381/371472 [22:54<6:51:00,  3.57it/s]
 76%|███████▋  | 283382/371472 [22:54<6:57:36,  3.52it/s]
 76%|███████▋  | 283383/371472 [22:54<6:48:20,  3.60it/s]
 76%|███████▋  | 283384/371472 [22:54<6:52:35,  3.56it/s]
 76%|███████▋  | 283385/371472 [22:55<6:53:51,  3.55it/s]
 76%|███████▋  | 283386/371472 [22:55<6:44:54,  3.63it/s]
 76%|███████▋  | 283387/371472 [22:55<6:43:59,  3.63it/s]
 76%|███████▋  | 283388/371472 [22:56<6:54:33,  3.54it/s]
 76%|███████▋  | 283389/371472 [22:56<6:39:26,  3.68it/s]
 76%|███████▋  | 283390/371472 [22:56<6:55:41,  3.53it/s]
 76%|███████▋  | 283391/371472 [22:56<6:50:06,  3.58it/s]
 76%|███████▋  | 283392/371472 [22:57<6:58:24,  3.51it/s]
 76%|███████▋  | 283393/371472 [22:57<7:00:48,  3.49it/s]
 76%|███████▋  | 283394/371472 [22:57<7:21:31,  3.32it/s]
 76%|███████▋  | 283395/371472 [22:58<6:55:47,  3.53it/s]
 76%|███████▋  | 283396/371472 [22:58<7:08:14,  3.43it/s]
 76%|███████▋  | 283397/371472 [22:58<6:58:06,  3.51it/s]
 76%|███████▋  | 283398/371472 [22:58<6:52:01,  3.56it/s]
 76%|███████▋  | 283399/371472 [22:59<6:34:20,  3.72it/s]
 76%|███████▋  | 283400/371472 [22:59<6:32:19,  3.74it/s]
                                                         
{'loss': 2.4747, 'learning_rate': 3.134952272188583e-07, 'epoch': 12.21}

 76%|███████▋  | 283400/371472 [22:59<6:32:19,  3.74it/s]
 76%|███████▋  | 283401/371472 [22:59<6:28:35,  3.78it/s]
 76%|███████▋  | 283402/371472 [22:59<6:32:13,  3.74it/s]
 76%|███████▋  | 283403/371472 [23:00<6:27:13,  3.79it/s]
 76%|███████▋  | 283404/371472 [23:00<6:55:06,  3.54it/s]
 76%|███████▋  | 283405/371472 [23:00<7:01:21,  3.48it/s]
 76%|███████▋  | 283406/371472 [23:01<6:42:36,  3.65it/s]
 76%|███████▋  | 283407/371472 [23:01<6:42:07,  3.65it/s]
 76%|███████▋  | 283408/371472 [23:01<6:32:06,  3.74it/s]
 76%|███████▋  | 283409/371472 [23:01<6:22:51,  3.83it/s]
 76%|███████▋  | 283410/371472 [23:02<6:35:47,  3.71it/s]
 76%|███████▋  | 283411/371472 [23:02<6:36:32,  3.70it/s]
 76%|███████▋  | 283412/371472 [23:02<6:41:58,  3.65it/s]
 76%|███████▋  | 283413/371472 [23:02<6:27:47,  3.78it/s]
 76%|███████▋  | 283414/371472 [23:03<6:30:08,  3.76it/s]
 76%|███████▋  | 283415/371472 [23:03<6:54:45,  3.54it/s]
 76%|███████▋  | 283416/371472 [23:03<6:51:45,  3.56it/s]
 76%|███████▋  | 283417/371472 [23:04<6:45:11,  3.62it/s]
 76%|███████▋  | 283418/371472 [23:04<6:47:27,  3.60it/s]
 76%|███████▋  | 283419/371472 [23:04<6:49:19,  3.59it/s]
 76%|███████▋  | 283420/371472 [23:04<6:52:59,  3.55it/s]
                                                         
{'loss': 2.6172, 'learning_rate': 3.1344674524337955e-07, 'epoch': 12.21}

 76%|███████▋  | 283420/371472 [23:04<6:52:59,  3.55it/s]
 76%|███████▋  | 283421/371472 [23:05<6:46:37,  3.61it/s]
 76%|███████▋  | 283422/371472 [23:05<6:50:18,  3.58it/s]
 76%|███████▋  | 283423/371472 [23:05<7:55:18,  3.09it/s]
 76%|███████▋  | 283424/371472 [23:06<7:30:56,  3.25it/s]
 76%|███████▋  | 283425/371472 [23:06<7:14:51,  3.37it/s]
 76%|███████▋  | 283426/371472 [23:06<7:56:55,  3.08it/s]
 76%|███████▋  | 283427/371472 [23:07<8:20:24,  2.93it/s]
 76%|███████▋  | 283428/371472 [23:07<7:35:59,  3.22it/s]
 76%|███████▋  | 283429/371472 [23:07<7:12:09,  3.40it/s]
 76%|███████▋  | 283430/371472 [23:07<7:04:52,  3.45it/s]
 76%|███████▋  | 283431/371472 [23:08<6:49:28,  3.58it/s]
 76%|███████▋  | 283432/371472 [23:08<6:39:47,  3.67it/s]
 76%|███████▋  | 283433/371472 [23:08<6:28:57,  3.77it/s]
 76%|███████▋  | 283434/371472 [23:09<7:04:18,  3.46it/s]
 76%|███████▋  | 283435/371472 [23:09<7:21:19,  3.32it/s]
 76%|███████▋  | 283436/371472 [23:09<7:16:12,  3.36it/s]
 76%|███████▋  | 283437/371472 [23:09<7:01:16,  3.48it/s]
 76%|███████▋  | 283438/371472 [23:10<6:56:36,  3.52it/s]
 76%|███████▋  | 283439/371472 [23:10<7:18:54,  3.34it/s]
 76%|███████▋  | 283440/371472 [23:10<7:49:10,  3.13it/s]
                                                         
{'loss': 2.4866, 'learning_rate': 3.133982632679006e-07, 'epoch': 12.21}

 76%|███████▋  | 283440/371472 [23:10<7:49:10,  3.13it/s]
 76%|███████▋  | 283441/371472 [23:11<7:23:31,  3.31it/s]
 76%|███████▋  | 283442/371472 [23:11<7:15:53,  3.37it/s]
 76%|███████▋  | 283443/371472 [23:11<7:13:12,  3.39it/s]
 76%|███████▋  | 283444/371472 [23:12<7:16:32,  3.36it/s]
 76%|███████▋  | 283445/371472 [23:12<6:55:00,  3.54it/s]
 76%|███████▋  | 283446/371472 [23:12<6:57:41,  3.51it/s]
 76%|███████▋  | 283447/371472 [23:12<6:48:13,  3.59it/s]
 76%|███████▋  | 283448/371472 [23:13<6:56:21,  3.52it/s]
 76%|███████▋  | 283449/371472 [23:13<6:37:10,  3.69it/s]
 76%|███████▋  | 283450/371472 [23:13<6:32:13,  3.74it/s]
 76%|███████▋  | 283451/371472 [23:14<7:09:07,  3.42it/s]
 76%|███████▋  | 283452/371472 [23:14<6:57:31,  3.51it/s]
 76%|███████▋  | 283453/371472 [23:14<7:35:11,  3.22it/s]
 76%|███████▋  | 283454/371472 [23:15<7:41:59,  3.18it/s]
 76%|███████▋  | 283455/371472 [23:15<7:11:10,  3.40it/s]
 76%|███████▋  | 283456/371472 [23:15<6:58:18,  3.51it/s]
 76%|███████▋  | 283457/371472 [23:15<6:53:04,  3.55it/s]
 76%|███████▋  | 283458/371472 [23:16<6:58:02,  3.51it/s]
 76%|███████▋  | 283459/371472 [23:16<7:18:57,  3.34it/s]
 76%|███████▋  | 283460/371472 [23:16<7:21:09,  3.32it/s]
                                                         
{'loss': 2.9154, 'learning_rate': 3.1334978129242175e-07, 'epoch': 12.21}

 76%|███████▋  | 283460/371472 [23:16<7:21:09,  3.32it/s]
 76%|███████▋  | 283461/371472 [23:17<7:27:40,  3.28it/s]
 76%|███████▋  | 283462/371472 [23:17<7:15:30,  3.37it/s]
 76%|███████▋  | 283463/371472 [23:17<7:01:27,  3.48it/s]
 76%|███████▋  | 283464/371472 [23:17<7:28:01,  3.27it/s]
 76%|███████▋  | 283465/371472 [23:18<6:57:37,  3.51it/s]
 76%|███████▋  | 283466/371472 [23:18<6:59:20,  3.50it/s]
 76%|███████▋  | 283467/371472 [23:18<6:58:13,  3.51it/s]
 76%|███████▋  | 283468/371472 [23:19<6:52:36,  3.55it/s]
 76%|███████▋  | 283469/371472 [23:19<6:46:20,  3.61it/s]
 76%|███████▋  | 283470/371472 [23:19<6:43:18,  3.64it/s]
 76%|███████▋  | 283471/371472 [23:19<6:55:11,  3.53it/s]
 76%|███████▋  | 283472/371472 [23:20<6:57:48,  3.51it/s]
 76%|███████▋  | 283473/371472 [23:20<6:49:55,  3.58it/s]
 76%|███████▋  | 283474/371472 [23:20<6:44:47,  3.62it/s]
 76%|███████▋  | 283475/371472 [23:20<6:42:00,  3.65it/s]
 76%|███████▋  | 283476/371472 [23:21<6:47:02,  3.60it/s]
 76%|███████▋  | 283477/371472 [23:21<7:16:55,  3.36it/s]
 76%|███████▋  | 283478/371472 [23:21<7:10:41,  3.41it/s]
 76%|███████▋  | 283479/371472 [23:22<7:32:00,  3.24it/s]
 76%|███████▋  | 283480/371472 [23:22<7:05:35,  3.45it/s]
                                                         
{'loss': 2.7597, 'learning_rate': 3.133012993169428e-07, 'epoch': 12.21}

 76%|███████▋  | 283480/371472 [23:22<7:05:35,  3.45it/s]
 76%|███████▋  | 283481/371472 [23:22<7:33:46,  3.23it/s]
 76%|███████▋  | 283482/371472 [23:23<7:41:28,  3.18it/s]
 76%|███████▋  | 283483/371472 [23:23<7:18:06,  3.35it/s]
 76%|███████▋  | 283484/371472 [23:23<7:23:56,  3.30it/s]
 76%|███████▋  | 283485/371472 [23:24<7:43:06,  3.17it/s]
 76%|███████▋  | 283486/371472 [23:24<7:33:58,  3.23it/s]
 76%|███████▋  | 283487/371472 [23:24<7:21:48,  3.32it/s]
 76%|███████▋  | 283488/371472 [23:24<6:55:11,  3.53it/s]
 76%|███████▋  | 283489/371472 [23:25<6:36:44,  3.70it/s]
 76%|███████▋  | 283490/371472 [23:25<6:27:35,  3.78it/s]
 76%|███████▋  | 283491/371472 [23:25<6:38:26,  3.68it/s]
 76%|███████▋  | 283492/371472 [23:25<6:38:45,  3.68it/s]
 76%|███████▋  | 283493/371472 [23:26<6:31:31,  3.75it/s]
 76%|███████▋  | 283494/371472 [23:26<6:34:13,  3.72it/s]
 76%|███████▋  | 283495/371472 [23:26<7:01:33,  3.48it/s]
 76%|███████▋  | 283496/371472 [23:27<7:19:19,  3.34it/s]
 76%|███████▋  | 283497/371472 [23:27<7:00:35,  3.49it/s]
 76%|███████▋  | 283498/371472 [23:27<6:47:07,  3.60it/s]
 76%|███████▋  | 283499/371472 [23:27<6:42:20,  3.64it/s]
 76%|███████▋  | 283500/371472 [23:28<6:30:39,  3.75it/s]
                                                         
{'loss': 2.668, 'learning_rate': 3.1325281734146395e-07, 'epoch': 12.21}

 76%|███████▋  | 283500/371472 [23:28<6:30:39,  3.75it/s]
 76%|███████▋  | 283501/371472 [23:28<6:46:26,  3.61it/s]
 76%|███████▋  | 283502/371472 [23:28<6:52:27,  3.55it/s]
 76%|███████▋  | 283503/371472 [23:29<7:12:43,  3.39it/s]
 76%|███████▋  | 283504/371472 [23:29<6:57:28,  3.51it/s]
 76%|███████▋  | 283505/371472 [23:29<7:44:22,  3.16it/s]
 76%|███████▋  | 283506/371472 [23:29<7:17:29,  3.35it/s]
 76%|███████▋  | 283507/371472 [23:30<6:56:03,  3.52it/s]
 76%|███████▋  | 283508/371472 [23:30<6:43:58,  3.63it/s]
 76%|███████▋  | 283509/371472 [23:30<7:04:46,  3.45it/s]
 76%|███████▋  | 283510/371472 [23:31<7:47:51,  3.13it/s]
 76%|███████▋  | 283511/371472 [23:31<7:23:08,  3.31it/s]
 76%|███████▋  | 283512/371472 [23:31<7:16:13,  3.36it/s]
 76%|███████▋  | 283513/371472 [23:32<7:06:49,  3.43it/s]
 76%|███████▋  | 283514/371472 [23:32<7:13:51,  3.38it/s]
 76%|███████▋  | 283515/371472 [23:32<7:09:07,  3.42it/s]
 76%|███████▋  | 283516/371472 [23:32<6:59:10,  3.50it/s]
 76%|███████▋  | 283517/371472 [23:33<7:00:59,  3.48it/s]
 76%|███████▋  | 283518/371472 [23:33<6:53:14,  3.55it/s]
 76%|███████▋  | 283519/371472 [23:33<6:51:05,  3.57it/s]
 76%|███████▋  | 283520/371472 [23:33<6:41:01,  3.66it/s]
                                                         
{'loss': 2.5891, 'learning_rate': 3.13204335365985e-07, 'epoch': 12.21}

 76%|███████▋  | 283520/371472 [23:33<6:41:01,  3.66it/s]
 76%|███████▋  | 283521/371472 [23:34<6:39:25,  3.67it/s]
 76%|███████▋  | 283522/371472 [23:34<6:34:34,  3.71it/s]
 76%|███████▋  | 283523/371472 [23:34<6:30:10,  3.76it/s]
 76%|███████▋  | 283524/371472 [23:35<7:28:57,  3.26it/s]
 76%|███████▋  | 283525/371472 [23:35<7:06:57,  3.43it/s]
 76%|███████▋  | 283526/371472 [23:35<7:07:11,  3.43it/s]
 76%|███████▋  | 283527/371472 [23:35<6:45:58,  3.61it/s]
 76%|███████▋  | 283528/371472 [23:36<6:51:28,  3.56it/s]
 76%|███████▋  | 283529/371472 [23:36<7:05:30,  3.44it/s]
 76%|███████▋  | 283530/371472 [23:36<6:51:16,  3.56it/s]
 76%|███████▋  | 283531/371472 [23:37<6:58:27,  3.50it/s]
 76%|███████▋  | 283532/371472 [23:37<6:42:45,  3.64it/s]
 76%|███████▋  | 283533/371472 [23:37<7:00:59,  3.48it/s]
 76%|███████▋  | 283534/371472 [23:37<6:39:54,  3.66it/s]
 76%|███████▋  | 283535/371472 [23:38<6:43:44,  3.63it/s]
 76%|███████▋  | 283536/371472 [23:38<6:39:37,  3.67it/s]
 76%|███████▋  | 283537/371472 [23:38<6:39:59,  3.66it/s]
 76%|███████▋  | 283538/371472 [23:39<6:58:56,  3.50it/s]
 76%|███████▋  | 283539/371472 [23:39<7:24:34,  3.30it/s]
 76%|███████▋  | 283540/371472 [23:39<7:19:33,  3.33it/s]
                                                         
{'loss': 2.7841, 'learning_rate': 3.131558533905062e-07, 'epoch': 12.21}

 76%|███████▋  | 283540/371472 [23:39<7:19:33,  3.33it/s]
 76%|███████▋  | 283541/371472 [23:39<7:16:12,  3.36it/s]
 76%|███████▋  | 283542/371472 [23:40<7:31:36,  3.25it/s]
 76%|███████▋  | 283543/371472 [23:40<7:08:38,  3.42it/s]
 76%|███████▋  | 283544/371472 [23:40<6:58:48,  3.50it/s]
 76%|███████▋  | 283545/371472 [23:41<6:54:07,  3.54it/s]
 76%|███████▋  | 283546/371472 [23:41<6:45:16,  3.62it/s]
 76%|███████▋  | 283547/371472 [23:41<6:36:02,  3.70it/s]
 76%|███████▋  | 283548/371472 [23:41<6:27:41,  3.78it/s]
 76%|███████▋  | 283549/371472 [23:42<6:19:36,  3.86it/s]
 76%|███████▋  | 283550/371472 [23:42<6:29:05,  3.77it/s]
 76%|███████▋  | 283551/371472 [23:42<6:50:10,  3.57it/s]
 76%|███████▋  | 283552/371472 [23:42<6:39:34,  3.67it/s]
 76%|███████▋  | 283553/371472 [23:43<6:34:41,  3.71it/s]
 76%|███████▋  | 283554/371472 [23:43<6:29:45,  3.76it/s]
 76%|███████▋  | 283555/371472 [23:43<6:43:00,  3.64it/s]
 76%|███████▋  | 283556/371472 [23:44<6:31:37,  3.74it/s]
 76%|███████▋  | 283557/371472 [23:44<6:39:47,  3.66it/s]
 76%|███████▋  | 283558/371472 [23:44<7:25:15,  3.29it/s]
 76%|███████▋  | 283559/371472 [23:44<7:01:19,  3.48it/s]
 76%|███████▋  | 283560/371472 [23:45<6:51:02,  3.56it/s]
                                                         
{'loss': 2.7817, 'learning_rate': 3.1310737141502727e-07, 'epoch': 12.21}

 76%|███████▋  | 283560/371472 [23:45<6:51:02,  3.56it/s]
 76%|███████▋  | 283561/371472 [23:45<6:52:13,  3.55it/s]
 76%|███████▋  | 283562/371472 [23:45<6:42:52,  3.64it/s]
 76%|███████▋  | 283563/371472 [23:46<7:04:31,  3.45it/s]
 76%|███████▋  | 283564/371472 [23:46<7:11:25,  3.40it/s]
 76%|███████▋  | 283565/371472 [23:46<7:01:47,  3.47it/s]
 76%|███████▋  | 283566/371472 [23:46<6:48:21,  3.59it/s]
 76%|███████▋  | 283567/371472 [23:47<6:44:48,  3.62it/s]
 76%|███████▋  | 283568/371472 [23:47<6:48:42,  3.58it/s]
 76%|███████▋  | 283569/371472 [23:47<6:46:07,  3.61it/s]
 76%|███████▋  | 283570/371472 [23:48<7:06:26,  3.44it/s]
 76%|███████▋  | 283571/371472 [23:48<7:38:41,  3.19it/s]
 76%|███████▋  | 283572/371472 [23:48<7:19:19,  3.33it/s]
 76%|███████▋  | 283573/371472 [23:49<7:54:04,  3.09it/s]
 76%|███████▋  | 283574/371472 [23:49<7:26:00,  3.28it/s]
 76%|███████▋  | 283575/371472 [23:49<7:06:03,  3.44it/s]
 76%|███████▋  | 283576/371472 [23:49<7:02:29,  3.47it/s]
 76%|███████▋  | 283577/371472 [23:50<6:59:15,  3.49it/s]
 76%|███████▋  | 283578/371472 [23:50<7:10:21,  3.40it/s]
 76%|███████▋  | 283579/371472 [23:50<7:02:48,  3.46it/s]
 76%|███████▋  | 283580/371472 [23:51<6:53:09,  3.55it/s]
                                                         
{'loss': 2.8051, 'learning_rate': 3.1305888943954834e-07, 'epoch': 12.21}

 76%|███████▋  | 283580/371472 [23:51<6:53:09,  3.55it/s]
 76%|███████▋  | 283581/371472 [23:51<6:35:46,  3.70it/s]
 76%|███████▋  | 283582/371472 [23:51<6:41:57,  3.64it/s]
 76%|███████▋  | 283583/371472 [23:51<6:46:02,  3.61it/s]
 76%|███████▋  | 283584/371472 [23:52<6:40:45,  3.66it/s]
 76%|███████▋  | 283585/371472 [23:52<6:36:22,  3.70it/s]
 76%|███████▋  | 283586/371472 [23:52<7:12:46,  3.38it/s]
 76%|███████▋  | 283587/371472 [23:52<6:54:29,  3.53it/s]
 76%|███████▋  | 283588/371472 [23:53<7:22:46,  3.31it/s]
 76%|███████▋  | 283589/371472 [23:53<7:17:50,  3.35it/s]
 76%|███████▋  | 283590/371472 [23:53<7:05:48,  3.44it/s]
 76%|███████▋  | 283591/371472 [23:54<6:48:07,  3.59it/s]
 76%|███████▋  | 283592/371472 [23:54<7:58:40,  3.06it/s]
 76%|███████▋  | 283593/371472 [23:54<7:46:49,  3.14it/s]
 76%|███████▋  | 283594/371472 [23:55<7:26:01,  3.28it/s]
 76%|███████▋  | 283595/371472 [23:55<7:36:43,  3.21it/s]
 76%|███████▋  | 283596/371472 [23:55<7:10:16,  3.40it/s]
 76%|███████▋  | 283597/371472 [23:55<6:59:10,  3.49it/s]
 76%|███████▋  | 283598/371472 [23:56<7:02:37,  3.47it/s]
 76%|███████▋  | 283599/371472 [23:56<6:55:00,  3.53it/s]
 76%|███████▋  | 283600/371472 [23:56<6:43:43,  3.63it/s]
                                                         
{'loss': 2.7293, 'learning_rate': 3.1301040746406946e-07, 'epoch': 12.22}

 76%|███████▋  | 283600/371472 [23:56<6:43:43,  3.63it/s]
 76%|███████▋  | 283601/371472 [23:57<6:40:48,  3.65it/s]
 76%|███████▋  | 283602/371472 [23:57<6:39:52,  3.66it/s]
 76%|███████▋  | 283603/371472 [23:57<6:43:05,  3.63it/s]
 76%|███████▋  | 283604/371472 [23:57<7:04:33,  3.45it/s]
 76%|███████▋  | 283605/371472 [23:58<7:12:15,  3.39it/s]
 76%|███████▋  | 283606/371472 [23:58<7:08:28,  3.42it/s]
 76%|███████▋  | 283607/371472 [23:58<7:00:06,  3.49it/s]
 76%|███████▋  | 283608/371472 [23:59<6:41:27,  3.65it/s]
 76%|███████▋  | 283609/371472 [23:59<6:44:53,  3.62it/s]
 76%|███████▋  | 283610/371472 [23:59<6:52:15,  3.55it/s]
 76%|███████▋  | 283611/371472 [23:59<6:58:21,  3.50it/s]
 76%|███████▋  | 283612/371472 [24:00<6:44:46,  3.62it/s]
 76%|███████▋  | 283613/371472 [24:00<6:30:18,  3.75it/s]
 76%|███████▋  | 283614/371472 [24:00<6:33:03,  3.73it/s]
 76%|███████▋  | 283615/371472 [24:01<7:02:57,  3.46it/s]
 76%|███████▋  | 283616/371472 [24:01<6:54:10,  3.54it/s]
 76%|███████▋  | 283617/371472 [24:01<7:38:21,  3.19it/s]
 76%|███████▋  | 283618/371472 [24:01<7:12:02,  3.39it/s]
 76%|███████▋  | 283619/371472 [24:02<6:57:03,  3.51it/s]
 76%|███████▋  | 283620/371472 [24:02<7:03:15,  3.46it/s]
                                                         
{'loss': 2.7359, 'learning_rate': 3.129619254885905e-07, 'epoch': 12.22}

 76%|███████▋  | 283620/371472 [24:02<7:03:15,  3.46it/s]
 76%|███████▋  | 283621/371472 [24:02<6:46:54,  3.60it/s]
 76%|███████▋  | 283622/371472 [24:03<6:47:30,  3.59it/s]
 76%|███████▋  | 283623/371472 [24:03<6:34:59,  3.71it/s]
 76%|███████▋  | 283624/371472 [24:03<7:20:07,  3.33it/s]
 76%|███████▋  | 283625/371472 [24:03<7:04:48,  3.45it/s]
 76%|███████▋  | 283626/371472 [24:04<7:07:40,  3.42it/s]
 76%|███████▋  | 283627/371472 [24:04<6:47:31,  3.59it/s]
 76%|███████▋  | 283628/371472 [24:04<6:40:03,  3.66it/s]
 76%|███████▋  | 283629/371472 [24:04<6:30:33,  3.75it/s]
 76%|███████▋  | 283630/371472 [24:05<6:41:51,  3.64it/s]
 76%|███████▋  | 283631/371472 [24:05<6:43:01,  3.63it/s]
 76%|███████▋  | 283632/371472 [24:05<6:23:18,  3.82it/s]
 76%|███████▋  | 283633/371472 [24:06<6:23:24,  3.82it/s]
 76%|███████▋  | 283634/371472 [24:06<7:14:04,  3.37it/s]
 76%|███████▋  | 283635/371472 [24:06<7:21:51,  3.31it/s]
 76%|███████▋  | 283636/371472 [24:07<7:10:13,  3.40it/s]
 76%|███████▋  | 283637/371472 [24:07<7:02:11,  3.47it/s]
 76%|███████▋  | 283638/371472 [24:07<7:12:50,  3.38it/s]
 76%|███████▋  | 283639/371472 [24:07<6:52:32,  3.55it/s]
 76%|███████▋  | 283640/371472 [24:08<7:05:33,  3.44it/s]
                                                         
{'loss': 2.6884, 'learning_rate': 3.1291344351311166e-07, 'epoch': 12.22}

 76%|███████▋  | 283640/371472 [24:08<7:05:33,  3.44it/s]
 76%|███████▋  | 283641/371472 [24:08<6:49:35,  3.57it/s]
 76%|███████▋  | 283642/371472 [24:08<7:20:00,  3.33it/s]
 76%|███████▋  | 283643/371472 [24:09<6:56:34,  3.51it/s]
 76%|███████▋  | 283644/371472 [24:09<7:01:17,  3.47it/s]
 76%|███████▋  | 283645/371472 [24:09<7:03:01,  3.46it/s]
 76%|███████▋  | 283646/371472 [24:09<6:56:35,  3.51it/s]
 76%|███████▋  | 283647/371472 [24:10<6:47:50,  3.59it/s]
 76%|███████▋  | 283648/371472 [24:10<6:42:43,  3.63it/s]
 76%|███████▋  | 283649/371472 [24:10<6:36:32,  3.69it/s]
 76%|███████▋  | 283650/371472 [24:10<6:23:09,  3.82it/s]
 76%|███████▋  | 283651/371472 [24:11<6:33:31,  3.72it/s]
 76%|███████▋  | 283652/371472 [24:11<6:56:30,  3.51it/s]
 76%|███████▋  | 283653/371472 [24:11<7:02:58,  3.46it/s]
 76%|███████▋  | 283654/371472 [24:12<7:04:44,  3.45it/s]
 76%|███████▋  | 283655/371472 [24:12<7:02:55,  3.46it/s]
 76%|███████▋  | 283656/371472 [24:12<6:54:13,  3.53it/s]
 76%|███████▋  | 283657/371472 [24:12<6:36:54,  3.69it/s]
 76%|███████▋  | 283658/371472 [24:13<6:45:57,  3.61it/s]
 76%|███████▋  | 283659/371472 [24:13<7:20:38,  3.32it/s]
 76%|███████▋  | 283660/371472 [24:13<7:01:05,  3.48it/s]
                                                         
{'loss': 2.721, 'learning_rate': 3.1286496153763273e-07, 'epoch': 12.22}

 76%|███████▋  | 283660/371472 [24:13<7:01:05,  3.48it/s]
 76%|███████▋  | 283661/371472 [24:14<6:45:48,  3.61it/s]
 76%|███████▋  | 283662/371472 [24:14<7:00:41,  3.48it/s]
 76%|███████▋  | 283663/371472 [24:14<6:47:51,  3.59it/s]
 76%|███████▋  | 283664/371472 [24:14<6:59:51,  3.49it/s]
 76%|███████▋  | 283665/371472 [24:15<7:23:38,  3.30it/s]
 76%|███████▋  | 283666/371472 [24:15<8:04:19,  3.02it/s]
 76%|███████▋  | 283667/371472 [24:15<7:41:41,  3.17it/s]
 76%|███████▋  | 283668/371472 [24:16<7:20:24,  3.32it/s]
 76%|███████▋  | 283669/371472 [24:16<7:21:42,  3.31it/s]
 76%|███████▋  | 283670/371472 [24:16<7:08:43,  3.41it/s]
 76%|███████▋  | 283671/371472 [24:17<7:10:08,  3.40it/s]
 76%|███████▋  | 283672/371472 [24:17<7:38:14,  3.19it/s]
 76%|███████▋  | 283673/371472 [24:17<7:20:06,  3.32it/s]
 76%|███████▋  | 283674/371472 [24:17<7:01:40,  3.47it/s]
 76%|███████▋  | 283675/371472 [24:18<7:03:25,  3.46it/s]
 76%|███████▋  | 283676/371472 [24:18<6:55:32,  3.52it/s]
 76%|███████▋  | 283677/371472 [24:18<6:47:40,  3.59it/s]
 76%|███████▋  | 283678/371472 [24:19<6:59:52,  3.48it/s]
 76%|███████▋  | 283679/371472 [24:19<6:48:33,  3.58it/s]
 76%|███████▋  | 283680/371472 [24:19<7:04:43,  3.44it/s]
                                                         
{'loss': 2.5913, 'learning_rate': 3.128164795621539e-07, 'epoch': 12.22}

 76%|███████▋  | 283680/371472 [24:19<7:04:43,  3.44it/s]
 76%|███████▋  | 283681/371472 [24:19<6:45:40,  3.61it/s]
 76%|███████▋  | 283682/371472 [24:20<7:08:03,  3.42it/s]
 76%|███████▋  | 283683/371472 [24:20<7:18:27,  3.34it/s]
 76%|███████▋  | 283684/371472 [24:20<7:04:41,  3.45it/s]
 76%|███████▋  | 283685/371472 [24:21<7:38:21,  3.19it/s]
 76%|███████▋  | 283686/371472 [24:21<7:49:25,  3.12it/s]
 76%|███████▋  | 283687/371472 [24:21<7:30:20,  3.25it/s]
 76%|███████▋  | 283688/371472 [24:22<7:39:56,  3.18it/s]
 76%|███████▋  | 283689/371472 [24:22<7:40:20,  3.18it/s]
 76%|███████▋  | 283690/371472 [24:22<7:21:51,  3.31it/s]
 76%|███████▋  | 283691/371472 [24:23<7:06:30,  3.43it/s]
 76%|███████▋  | 283692/371472 [24:23<7:31:53,  3.24it/s]
 76%|███████▋  | 283693/371472 [24:23<7:23:24,  3.30it/s]
 76%|███████▋  | 283694/371472 [24:23<7:07:52,  3.42it/s]
 76%|███████▋  | 283695/371472 [24:24<6:49:43,  3.57it/s]
 76%|███████▋  | 283696/371472 [24:24<6:49:58,  3.57it/s]
 76%|███████▋  | 283697/371472 [24:24<6:57:08,  3.51it/s]
 76%|███████▋  | 283698/371472 [24:25<6:50:39,  3.56it/s]
 76%|███████▋  | 283699/371472 [24:25<6:47:21,  3.59it/s]
 76%|███████▋  | 283700/371472 [24:25<6:49:46,  3.57it/s]
                                                         
{'loss': 2.6444, 'learning_rate': 3.12767997586675e-07, 'epoch': 12.22}

 76%|███████▋  | 283700/371472 [24:25<6:49:46,  3.57it/s]
 76%|███████▋  | 283701/371472 [24:25<6:49:14,  3.57it/s]
 76%|███████▋  | 283702/371472 [24:26<6:56:27,  3.51it/s]
 76%|███████▋  | 283703/371472 [24:26<6:40:41,  3.65it/s]
 76%|███████▋  | 283704/371472 [24:26<6:38:23,  3.67it/s]
 76%|███████▋  | 283705/371472 [24:26<6:35:50,  3.70it/s]
 76%|███████▋  | 283706/371472 [24:27<6:41:01,  3.65it/s]
 76%|███████▋  | 283707/371472 [24:27<6:49:58,  3.57it/s]
 76%|███████▋  | 283708/371472 [24:27<7:08:15,  3.42it/s]
 76%|███████▋  | 283709/371472 [24:28<7:05:51,  3.43it/s]
 76%|███████▋  | 283710/371472 [24:28<6:54:42,  3.53it/s]
 76%|███████▋  | 283711/371472 [24:28<6:41:45,  3.64it/s]
 76%|███████▋  | 283712/371472 [24:28<6:50:29,  3.56it/s]
 76%|███████▋  | 283713/371472 [24:29<6:35:54,  3.69it/s]
 76%|███████▋  | 283714/371472 [24:29<7:07:19,  3.42it/s]
 76%|███████▋  | 283715/371472 [24:29<7:13:41,  3.37it/s]
 76%|███████▋  | 283716/371472 [24:30<7:06:53,  3.43it/s]
 76%|███████▋  | 283717/371472 [24:30<7:31:03,  3.24it/s]
 76%|███████▋  | 283718/371472 [24:30<7:32:32,  3.23it/s]
 76%|███████▋  | 283719/371472 [24:31<7:28:11,  3.26it/s]
 76%|███████▋  | 283720/371472 [24:31<7:11:29,  3.39it/s]
                                                         
{'loss': 2.6475, 'learning_rate': 3.127195156111961e-07, 'epoch': 12.22}

 76%|███████▋  | 283720/371472 [24:31<7:11:29,  3.39it/s]
 76%|███████▋  | 283721/371472 [24:31<7:04:50,  3.44it/s]
 76%|███████▋  | 283722/371472 [24:31<6:59:24,  3.49it/s]
 76%|███████▋  | 283723/371472 [24:32<7:11:44,  3.39it/s]
 76%|███████▋  | 283724/371472 [24:32<7:38:28,  3.19it/s]
 76%|███████▋  | 283725/371472 [24:32<7:23:44,  3.30it/s]
 76%|███████▋  | 283726/371472 [24:33<7:05:42,  3.44it/s]
 76%|███████▋  | 283727/371472 [24:33<6:55:20,  3.52it/s]
 76%|███████▋  | 283728/371472 [24:33<7:53:28,  3.09it/s]
 76%|███████▋  | 283729/371472 [24:34<7:40:47,  3.17it/s]
 76%|███████▋  | 283730/371472 [24:34<7:19:37,  3.33it/s]
 76%|███████▋  | 283731/371472 [24:34<7:28:26,  3.26it/s]
 76%|███████▋  | 283732/371472 [24:34<7:12:06,  3.38it/s]
 76%|███████▋  | 283733/371472 [24:35<7:00:50,  3.47it/s]
 76%|███████▋  | 283734/371472 [24:35<6:53:56,  3.53it/s]
 76%|███████▋  | 283735/371472 [24:35<6:39:54,  3.66it/s]
 76%|███████▋  | 283736/371472 [24:36<6:54:42,  3.53it/s]
 76%|███████▋  | 283737/371472 [24:36<7:00:56,  3.47it/s]
 76%|███████▋  | 283738/371472 [24:36<6:58:13,  3.50it/s]
 76%|███████▋  | 283739/371472 [24:36<6:50:51,  3.56it/s]
 76%|███████▋  | 283740/371472 [24:37<6:45:36,  3.61it/s]
                                                         
{'loss': 2.693, 'learning_rate': 3.126710336357172e-07, 'epoch': 12.22}

 76%|███████▋  | 283740/371472 [24:37<6:45:36,  3.61it/s]
 76%|███████▋  | 283741/371472 [24:37<6:48:43,  3.58it/s]
 76%|███████▋  | 283742/371472 [24:37<6:42:51,  3.63it/s]
 76%|███████▋  | 283743/371472 [24:38<6:48:26,  3.58it/s]
 76%|███████▋  | 283744/371472 [24:38<6:50:19,  3.56it/s]
 76%|███████▋  | 283745/371472 [24:38<6:39:42,  3.66it/s]
 76%|███████▋  | 283746/371472 [24:38<7:24:44,  3.29it/s]
 76%|███████▋  | 283747/371472 [24:39<7:04:17,  3.45it/s]
 76%|███████▋  | 283748/371472 [24:39<6:50:00,  3.57it/s]
 76%|███████▋  | 283749/371472 [24:39<6:41:33,  3.64it/s]
 76%|███████▋  | 283750/371472 [24:40<7:24:59,  3.29it/s]
 76%|███████▋  | 283751/371472 [24:40<7:12:06,  3.38it/s]
 76%|███████▋  | 283752/371472 [24:40<6:55:51,  3.52it/s]
 76%|███████▋  | 283753/371472 [24:40<7:16:40,  3.35it/s]
 76%|███████▋  | 283754/371472 [24:41<7:01:25,  3.47it/s]
 76%|███████▋  | 283755/371472 [24:41<6:45:20,  3.61it/s]
 76%|███████▋  | 283756/371472 [24:41<6:48:48,  3.58it/s]
 76%|███████▋  | 283757/371472 [24:42<6:38:29,  3.67it/s]
 76%|███████▋  | 283758/371472 [24:42<6:33:43,  3.71it/s]
 76%|███████▋  | 283759/371472 [24:42<6:35:13,  3.70it/s]
 76%|███████▋  | 283760/371472 [24:42<6:36:15,  3.69it/s]
                                                         
{'loss': 2.7412, 'learning_rate': 3.126225516602383e-07, 'epoch': 12.22}

 76%|███████▋  | 283760/371472 [24:42<6:36:15,  3.69it/s]
 76%|███████▋  | 283761/371472 [24:43<6:53:46,  3.53it/s]
 76%|███████▋  | 283762/371472 [24:43<6:48:22,  3.58it/s]
 76%|███████▋  | 283763/371472 [24:43<6:33:56,  3.71it/s]
 76%|███████▋  | 283764/371472 [24:43<6:27:23,  3.77it/s]
 76%|███████▋  | 283765/371472 [24:44<6:23:03,  3.82it/s]
 76%|███████▋  | 283766/371472 [24:44<6:33:43,  3.71it/s]
 76%|███████▋  | 283767/371472 [24:44<6:42:30,  3.63it/s]
 76%|███████▋  | 283768/371472 [24:45<6:46:19,  3.60it/s]
 76%|███████▋  | 283769/371472 [24:45<7:03:49,  3.45it/s]
 76%|███████▋  | 283770/371472 [24:45<6:50:55,  3.56it/s]
 76%|███████▋  | 283771/371472 [24:45<7:27:26,  3.27it/s]
 76%|███████▋  | 283772/371472 [24:46<7:13:12,  3.37it/s]
 76%|███████▋  | 283773/371472 [24:46<6:54:26,  3.53it/s]
 76%|███████▋  | 283774/371472 [24:46<6:52:37,  3.54it/s]
 76%|███████▋  | 283775/371472 [24:47<7:13:07,  3.37it/s]
 76%|███████▋  | 283776/371472 [24:47<7:05:00,  3.44it/s]
 76%|███████▋  | 283777/371472 [24:47<7:00:43,  3.47it/s]
 76%|███████▋  | 283778/371472 [24:47<6:48:58,  3.57it/s]
 76%|███████▋  | 283779/371472 [24:48<6:31:50,  3.73it/s]
 76%|███████▋  | 283780/371472 [24:48<7:06:28,  3.43it/s]
                                                         
{'loss': 2.7226, 'learning_rate': 3.1257406968475937e-07, 'epoch': 12.22}

 76%|███████▋  | 283780/371472 [24:48<7:06:28,  3.43it/s]
 76%|███████▋  | 283781/371472 [24:48<6:52:31,  3.54it/s]
 76%|███████▋  | 283782/371472 [24:49<6:49:27,  3.57it/s]
 76%|███████▋  | 283783/371472 [24:49<6:51:04,  3.56it/s]
 76%|███████▋  | 283784/371472 [24:49<6:51:18,  3.55it/s]
 76%|███████▋  | 283785/371472 [24:49<6:44:47,  3.61it/s]
 76%|███████▋  | 283786/371472 [24:50<6:46:45,  3.59it/s]
 76%|███████▋  | 283787/371472 [24:50<6:56:44,  3.51it/s]
 76%|███████▋  | 283788/371472 [24:50<7:05:32,  3.43it/s]
 76%|███████▋  | 283789/371472 [24:51<7:03:01,  3.45it/s]
 76%|███████▋  | 283790/371472 [24:51<6:48:14,  3.58it/s]
 76%|███████▋  | 283791/371472 [24:51<6:41:16,  3.64it/s]
 76%|███████▋  | 283792/371472 [24:51<6:32:23,  3.72it/s]
 76%|███████▋  | 283793/371472 [24:52<6:29:28,  3.75it/s]
 76%|███████▋  | 283794/371472 [24:52<6:30:52,  3.74it/s]
 76%|███████▋  | 283795/371472 [24:52<6:36:11,  3.69it/s]
 76%|███████▋  | 283796/371472 [24:52<6:53:27,  3.53it/s]
 76%|███████▋  | 283797/371472 [24:53<6:38:24,  3.67it/s]
 76%|███████▋  | 283798/371472 [24:53<6:53:05,  3.54it/s]
 76%|███████▋  | 283799/371472 [24:53<6:43:44,  3.62it/s]
 76%|███████▋  | 283800/371472 [24:54<7:01:30,  3.47it/s]
                                                         
{'loss': 2.6661, 'learning_rate': 3.1252558770928055e-07, 'epoch': 12.22}

 76%|███████▋  | 283800/371472 [24:54<7:01:30,  3.47it/s]
 76%|███████▋  | 283801/371472 [24:54<6:50:44,  3.56it/s]
 76%|███████▋  | 283802/371472 [24:54<6:57:01,  3.50it/s]
 76%|███████▋  | 283803/371472 [24:54<7:12:52,  3.38it/s]
 76%|███████▋  | 283804/371472 [24:55<6:48:42,  3.58it/s]
 76%|███████▋  | 283805/371472 [24:55<7:08:06,  3.41it/s]
 76%|███████▋  | 283806/371472 [24:55<7:43:49,  3.15it/s]
 76%|███████▋  | 283807/371472 [24:56<7:53:27,  3.09it/s]
 76%|███████▋  | 283808/371472 [24:56<7:21:06,  3.31it/s]
 76%|███████▋  | 283809/371472 [24:56<7:05:08,  3.44it/s]
 76%|███████▋  | 283810/371472 [24:57<7:09:55,  3.40it/s]
 76%|███████▋  | 283811/371472 [24:57<7:15:20,  3.36it/s]
 76%|███████▋  | 283812/371472 [24:57<6:56:14,  3.51it/s]
 76%|███████▋  | 283813/371472 [24:57<7:16:37,  3.35it/s]
 76%|███████▋  | 283814/371472 [24:58<7:07:57,  3.41it/s]
 76%|███████▋  | 283815/371472 [24:58<6:57:54,  3.50it/s]
 76%|███████▋  | 283816/371472 [24:58<7:06:43,  3.42it/s]
 76%|███████▋  | 283817/371472 [24:59<7:02:27,  3.46it/s]
 76%|███████▋  | 283818/371472 [24:59<6:54:56,  3.52it/s]
 76%|███████▋  | 283819/371472 [24:59<6:43:01,  3.62it/s]
 76%|███████▋  | 283820/371472 [24:59<6:34:32,  3.70it/s]
                                                         
{'loss': 2.646, 'learning_rate': 3.124771057338016e-07, 'epoch': 12.22}

 76%|███████▋  | 283820/371472 [24:59<6:34:32,  3.70it/s]
 76%|███████▋  | 283821/371472 [25:00<6:32:12,  3.72it/s]
 76%|███████▋  | 283822/371472 [25:00<7:59:07,  3.05it/s]
 76%|███████▋  | 283823/371472 [25:00<7:30:44,  3.24it/s]
 76%|███████▋  | 283824/371472 [25:01<7:02:56,  3.45it/s]
 76%|███████▋  | 283825/371472 [25:01<7:03:33,  3.45it/s]
 76%|███████▋  | 283826/371472 [25:01<7:17:42,  3.34it/s]
 76%|███████▋  | 283827/371472 [25:02<7:58:20,  3.05it/s]
 76%|███████▋  | 283828/371472 [25:02<7:41:38,  3.16it/s]
 76%|███████▋  | 283829/371472 [25:02<7:59:12,  3.05it/s]
 76%|███████▋  | 283830/371472 [25:03<7:59:45,  3.04it/s]
 76%|███████▋  | 283831/371472 [25:03<7:32:17,  3.23it/s]
 76%|███████▋  | 283832/371472 [25:03<7:13:04,  3.37it/s]
 76%|███████▋  | 283833/371472 [25:03<7:02:10,  3.46it/s]
 76%|███████▋  | 283834/371472 [25:04<6:52:36,  3.54it/s]
 76%|███████▋  | 283835/371472 [25:04<7:30:27,  3.24it/s]
 76%|███████▋  | 283836/371472 [25:04<7:21:26,  3.31it/s]
 76%|███████▋  | 283837/371472 [25:05<7:01:03,  3.47it/s]
 76%|███████▋  | 283838/371472 [25:05<6:52:39,  3.54it/s]
 76%|███████▋  | 283839/371472 [25:05<6:50:48,  3.56it/s]
 76%|███████▋  | 283840/371472 [25:05<7:30:17,  3.24it/s]
                                                         
{'loss': 2.6183, 'learning_rate': 3.1242862375832274e-07, 'epoch': 12.23}

 76%|███████▋  | 283840/371472 [25:05<7:30:17,  3.24it/s]
 76%|███████▋  | 283841/371472 [25:06<7:31:11,  3.24it/s]
 76%|███████▋  | 283842/371472 [25:06<7:45:04,  3.14it/s]
 76%|███████▋  | 283843/371472 [25:06<7:18:03,  3.33it/s]
 76%|███████▋  | 283844/371472 [25:07<7:35:56,  3.20it/s]
 76%|███████▋  | 283845/371472 [25:07<7:12:20,  3.38it/s]
 76%|███████▋  | 283846/371472 [25:07<7:00:22,  3.47it/s]
 76%|███████▋  | 283847/371472 [25:08<7:06:26,  3.42it/s]
 76%|███████▋  | 283848/371472 [25:08<6:44:50,  3.61it/s]
 76%|███████▋  | 283849/371472 [25:08<6:38:40,  3.66it/s]
 76%|███████▋  | 283850/371472 [25:08<7:12:08,  3.38it/s]
 76%|███████▋  | 283851/371472 [25:09<7:11:11,  3.39it/s]
 76%|███████▋  | 283852/371472 [25:09<7:00:29,  3.47it/s]
 76%|███████▋  | 283853/371472 [25:09<6:57:16,  3.50it/s]
 76%|███████▋  | 283854/371472 [25:10<6:41:54,  3.63it/s]
 76%|███████▋  | 283855/371472 [25:10<6:54:44,  3.52it/s]
 76%|███████▋  | 283856/371472 [25:10<6:58:11,  3.49it/s]
 76%|███████▋  | 283857/371472 [25:10<6:50:44,  3.56it/s]
 76%|███████▋  | 283858/371472 [25:11<6:42:14,  3.63it/s]
 76%|███████▋  | 283859/371472 [25:11<6:45:17,  3.60it/s]
 76%|███████▋  | 283860/371472 [25:11<6:46:40,  3.59it/s]
                                                         
{'loss': 2.6285, 'learning_rate': 3.123801417828438e-07, 'epoch': 12.23}

 76%|███████▋  | 283860/371472 [25:11<6:46:40,  3.59it/s]
 76%|███████▋  | 283861/371472 [25:11<6:30:28,  3.74it/s]
 76%|███████▋  | 283862/371472 [25:12<6:36:00,  3.69it/s]
 76%|███████▋  | 283863/371472 [25:12<6:32:33,  3.72it/s]
 76%|███████▋  | 283864/371472 [25:12<7:12:24,  3.38it/s]
 76%|███████▋  | 283865/371472 [25:13<6:58:10,  3.49it/s]
 76%|███████▋  | 283866/371472 [25:13<7:23:48,  3.29it/s]
 76%|███████▋  | 283867/371472 [25:13<7:15:39,  3.35it/s]
 76%|███████▋  | 283868/371472 [25:14<7:23:19,  3.29it/s]
 76%|███████▋  | 283869/371472 [25:14<7:12:51,  3.37it/s]
 76%|███████▋  | 283870/371472 [25:14<7:04:00,  3.44it/s]
 76%|███████▋  | 283871/371472 [25:14<7:08:56,  3.40it/s]
 76%|███████▋  | 283872/371472 [25:15<6:52:39,  3.54it/s]
 76%|███████▋  | 283873/371472 [25:15<6:47:35,  3.58it/s]
 76%|███████▋  | 283874/371472 [25:15<6:41:08,  3.64it/s]
 76%|███████▋  | 283875/371472 [25:15<6:44:14,  3.61it/s]
 76%|███████▋  | 283876/371472 [25:16<6:44:33,  3.61it/s]
 76%|███████▋  | 283877/371472 [25:16<6:37:04,  3.68it/s]
 76%|███████▋  | 283878/371472 [25:16<6:49:26,  3.57it/s]
 76%|███████▋  | 283879/371472 [25:17<6:48:00,  3.58it/s]
 76%|███████▋  | 283880/371472 [25:17<6:40:13,  3.65it/s]
                                                         
{'loss': 2.7797, 'learning_rate': 3.1233165980736494e-07, 'epoch': 12.23}

 76%|███████▋  | 283880/371472 [25:17<6:40:13,  3.65it/s]
 76%|███████▋  | 283881/371472 [25:17<6:36:33,  3.68it/s]
 76%|███████▋  | 283882/371472 [25:17<6:43:26,  3.62it/s]
 76%|███████▋  | 283883/371472 [25:18<7:15:50,  3.35it/s]
 76%|███████▋  | 283884/371472 [25:18<7:03:26,  3.45it/s]
 76%|███████▋  | 283885/371472 [25:18<7:07:25,  3.42it/s]
 76%|███████▋  | 283886/371472 [25:19<7:36:24,  3.20it/s]
 76%|███████▋  | 283887/371472 [25:19<7:32:19,  3.23it/s]
 76%|███████▋  | 283888/371472 [25:19<7:40:09,  3.17it/s]
 76%|███████▋  | 283889/371472 [25:20<7:13:08,  3.37it/s]
 76%|███████▋  | 283890/371472 [25:20<7:12:11,  3.38it/s]
 76%|███████▋  | 283891/371472 [25:20<6:47:52,  3.58it/s]
 76%|███████▋  | 283892/371472 [25:20<6:43:40,  3.62it/s]
 76%|███████▋  | 283893/371472 [25:21<7:13:03,  3.37it/s]
 76%|███████▋  | 283894/371472 [25:21<7:02:54,  3.45it/s]
 76%|███████▋  | 283895/371472 [25:21<7:13:56,  3.36it/s]
 76%|███████▋  | 283896/371472 [25:22<7:07:33,  3.41it/s]
 76%|███████▋  | 283897/371472 [25:22<6:52:19,  3.54it/s]
 76%|███████▋  | 283898/371472 [25:22<6:43:18,  3.62it/s]
 76%|███████▋  | 283899/371472 [25:22<6:34:45,  3.70it/s]
 76%|███████▋  | 283900/371472 [25:23<6:36:23,  3.68it/s]
                                                         
{'loss': 2.5849, 'learning_rate': 3.12283177831886e-07, 'epoch': 12.23}

 76%|███████▋  | 283900/371472 [25:23<6:36:23,  3.68it/s]
 76%|███████▋  | 283901/371472 [25:23<6:34:00,  3.70it/s]
 76%|███████▋  | 283902/371472 [25:23<6:35:20,  3.69it/s]
 76%|███████▋  | 283903/371472 [25:23<6:21:01,  3.83it/s]
 76%|███████▋  | 283904/371472 [25:24<6:14:49,  3.89it/s]
 76%|███████▋  | 283905/371472 [25:24<6:49:02,  3.57it/s]
 76%|███████▋  | 283906/371472 [25:24<6:33:34,  3.71it/s]
 76%|███████▋  | 283907/371472 [25:25<6:55:35,  3.51it/s]
 76%|███████▋  | 283908/371472 [25:25<6:42:49,  3.62it/s]
 76%|███████▋  | 283909/371472 [25:25<6:59:14,  3.48it/s]
 76%|███████▋  | 283910/371472 [25:25<6:41:20,  3.64it/s]
 76%|███████▋  | 283911/371472 [25:26<6:57:52,  3.49it/s]
 76%|███████▋  | 283912/371472 [25:26<7:09:13,  3.40it/s]
 76%|███████▋  | 283913/371472 [25:26<7:30:28,  3.24it/s]
 76%|███████▋  | 283914/371472 [25:27<7:19:34,  3.32it/s]
 76%|███████▋  | 283915/371472 [25:27<6:59:13,  3.48it/s]
 76%|███████▋  | 283916/371472 [25:27<7:05:45,  3.43it/s]
 76%|███████▋  | 283917/371472 [25:27<6:57:13,  3.50it/s]
 76%|███████▋  | 283918/371472 [25:28<8:13:36,  2.96it/s]
 76%|███████▋  | 283919/371472 [25:28<7:41:26,  3.16it/s]
 76%|███████▋  | 283920/371472 [25:28<7:11:41,  3.38it/s]
                                                         
{'loss': 2.651, 'learning_rate': 3.1223469585640724e-07, 'epoch': 12.23}

 76%|███████▋  | 283920/371472 [25:28<7:11:41,  3.38it/s]
 76%|███████▋  | 283921/371472 [25:29<7:22:55,  3.29it/s]
 76%|███████▋  | 283922/371472 [25:29<7:01:48,  3.46it/s]
 76%|███████▋  | 283923/371472 [25:29<6:49:53,  3.56it/s]
 76%|███████▋  | 283924/371472 [25:30<6:50:05,  3.56it/s]
 76%|███████▋  | 283925/371472 [25:30<6:44:07,  3.61it/s]
 76%|███████▋  | 283926/371472 [25:30<6:50:27,  3.55it/s]
 76%|███████▋  | 283927/371472 [25:30<6:41:21,  3.64it/s]
 76%|███████▋  | 283928/371472 [25:31<7:23:40,  3.29it/s]
 76%|███████▋  | 283929/371472 [25:31<7:02:22,  3.45it/s]
 76%|███████▋  | 283930/371472 [25:31<6:53:41,  3.53it/s]
 76%|███████▋  | 283931/371472 [25:32<6:49:41,  3.56it/s]
 76%|███████▋  | 283932/371472 [25:32<6:58:40,  3.48it/s]
 76%|███████▋  | 283933/371472 [25:32<7:56:05,  3.06it/s]
 76%|███████▋  | 283934/371472 [25:33<7:21:21,  3.31it/s]
 76%|███████▋  | 283935/371472 [25:33<7:03:19,  3.45it/s]
 76%|███████▋  | 283936/371472 [25:33<7:06:52,  3.42it/s]
 76%|███████▋  | 283937/371472 [25:33<7:32:55,  3.22it/s]
 76%|███████▋  | 283938/371472 [25:34<7:08:09,  3.41it/s]
 76%|███████▋  | 283939/371472 [25:34<7:40:51,  3.17it/s]
 76%|███████▋  | 283940/371472 [25:34<7:57:33,  3.05it/s]
                                                         
{'loss': 2.6335, 'learning_rate': 3.1218621388092826e-07, 'epoch': 12.23}

 76%|███████▋  | 283940/371472 [25:34<7:57:33,  3.05it/s]
 76%|███████▋  | 283941/371472 [25:35<7:33:55,  3.21it/s]
 76%|███████▋  | 283942/371472 [25:35<7:13:59,  3.36it/s]
 76%|███████▋  | 283943/371472 [25:35<7:07:34,  3.41it/s]
 76%|███████▋  | 283944/371472 [25:36<7:52:12,  3.09it/s]
 76%|███████▋  | 283945/371472 [25:36<7:37:14,  3.19it/s]
 76%|███████▋  | 283946/371472 [25:36<7:46:16,  3.13it/s]
 76%|███████▋  | 283947/371472 [25:37<7:52:54,  3.08it/s]
 76%|███████▋  | 283948/371472 [25:37<7:24:01,  3.29it/s]
 76%|███████▋  | 283949/371472 [25:37<6:59:03,  3.48it/s]
 76%|███████▋  | 283950/371472 [25:37<6:41:20,  3.63it/s]
 76%|███████▋  | 283951/371472 [25:38<6:43:50,  3.61it/s]
 76%|███████▋  | 283952/371472 [25:38<7:14:48,  3.35it/s]
 76%|███████▋  | 283953/371472 [25:38<6:47:33,  3.58it/s]
 76%|███████▋  | 283954/371472 [25:38<6:37:00,  3.67it/s]
 76%|███████▋  | 283955/371472 [25:39<6:54:11,  3.52it/s]
 76%|███████▋  | 283956/371472 [25:39<6:46:33,  3.59it/s]
 76%|███████▋  | 283957/371472 [25:39<6:39:06,  3.65it/s]
 76%|███████▋  | 283958/371472 [25:40<6:39:18,  3.65it/s]
 76%|███████▋  | 283959/371472 [25:40<7:23:00,  3.29it/s]
 76%|███████▋  | 283960/371472 [25:40<7:19:50,  3.32it/s]
                                                         
{'loss': 2.4971, 'learning_rate': 3.121377319054494e-07, 'epoch': 12.23}

 76%|███████▋  | 283960/371472 [25:40<7:19:50,  3.32it/s]
 76%|███████▋  | 283961/371472 [25:41<7:04:41,  3.43it/s]
 76%|███████▋  | 283962/371472 [25:41<6:58:09,  3.49it/s]
 76%|███████▋  | 283963/371472 [25:41<6:40:06,  3.65it/s]
 76%|███████▋  | 283964/371472 [25:41<6:30:31,  3.73it/s]
 76%|███████▋  | 283965/371472 [25:42<6:44:14,  3.61it/s]
 76%|███████▋  | 283966/371472 [25:42<6:47:43,  3.58it/s]
 76%|███████▋  | 283967/371472 [25:42<6:43:43,  3.61it/s]
 76%|███████▋  | 283968/371472 [25:42<6:45:03,  3.60it/s]
 76%|███████▋  | 283969/371472 [25:43<6:48:51,  3.57it/s]
 76%|███████▋  | 283970/371472 [25:43<7:11:34,  3.38it/s]
 76%|███████▋  | 283971/371472 [25:43<7:00:31,  3.47it/s]
 76%|███████▋  | 283972/371472 [25:44<7:24:05,  3.28it/s]
 76%|███████▋  | 283973/371472 [25:44<7:06:37,  3.42it/s]
 76%|███████▋  | 283974/371472 [25:44<7:32:13,  3.22it/s]
 76%|███████▋  | 283975/371472 [25:45<7:26:51,  3.26it/s]
 76%|███████▋  | 283976/371472 [25:45<7:12:34,  3.37it/s]
 76%|███████▋  | 283977/371472 [25:45<7:13:41,  3.36it/s]
 76%|███████▋  | 283978/371472 [25:45<7:02:23,  3.45it/s]
 76%|███████▋  | 283979/371472 [25:46<6:54:12,  3.52it/s]
 76%|███████▋  | 283980/371472 [25:46<7:24:51,  3.28it/s]
                                                         
{'loss': 2.5143, 'learning_rate': 3.1208924992997046e-07, 'epoch': 12.23}

 76%|███████▋  | 283980/371472 [25:46<7:24:51,  3.28it/s]
 76%|███████▋  | 283981/371472 [25:46<7:07:53,  3.41it/s]
 76%|███████▋  | 283982/371472 [25:47<6:49:35,  3.56it/s]
 76%|███████▋  | 283983/371472 [25:47<6:43:53,  3.61it/s]
 76%|███████▋  | 283984/371472 [25:47<6:36:17,  3.68it/s]
 76%|███████▋  | 283985/371472 [25:47<6:29:54,  3.74it/s]
 76%|███████▋  | 283986/371472 [25:48<6:19:01,  3.85it/s]
 76%|███████▋  | 283987/371472 [25:48<6:24:39,  3.79it/s]
 76%|███████▋  | 283988/371472 [25:48<6:25:52,  3.78it/s]
 76%|███████▋  | 283989/371472 [25:48<6:22:27,  3.81it/s]
 76%|███████▋  | 283990/371472 [25:49<6:31:17,  3.73it/s]
 76%|███████▋  | 283991/371472 [25:49<6:26:11,  3.78it/s]
 76%|███████▋  | 283992/371472 [25:49<6:26:42,  3.77it/s]
 76%|███████▋  | 283993/371472 [25:49<6:19:51,  3.84it/s]
 76%|███████▋  | 283994/371472 [25:50<6:17:39,  3.86it/s]
 76%|███████▋  | 283995/371472 [25:50<6:21:35,  3.82it/s]
 76%|███████▋  | 283996/371472 [25:50<6:39:51,  3.65it/s]
 76%|███████▋  | 283997/371472 [25:51<6:37:11,  3.67it/s]
 76%|███████▋  | 283998/371472 [25:51<6:36:09,  3.68it/s]
 76%|███████▋  | 283999/371472 [25:51<6:47:58,  3.57it/s]
 76%|███████▋  | 284000/371472 [25:51<6:38:26,  3.66it/s]
                                                         
{'loss': 2.662, 'learning_rate': 3.120407679544916e-07, 'epoch': 12.23}

 76%|███████▋  | 284000/371472 [25:51<6:38:26,  3.66it/s]
 76%|███████▋  | 284001/371472 [25:52<6:52:14,  3.54it/s]
 76%|███████▋  | 284002/371472 [25:52<6:50:13,  3.55it/s]
 76%|███████▋  | 284003/371472 [25:52<6:34:11,  3.70it/s]
 76%|███████▋  | 284004/371472 [25:52<6:44:45,  3.60it/s]
 76%|███████▋  | 284005/371472 [25:53<7:00:33,  3.47it/s]
 76%|███████▋  | 284006/371472 [25:53<7:20:02,  3.31it/s]
 76%|███████▋  | 284007/371472 [25:53<6:56:46,  3.50it/s]
 76%|███████▋  | 284008/371472 [25:54<6:56:03,  3.50it/s]
 76%|███████▋  | 284009/371472 [25:54<7:15:59,  3.34it/s]
 76%|███████▋  | 284010/371472 [25:54<7:17:14,  3.33it/s]
 76%|███████▋  | 284011/371472 [25:55<6:50:31,  3.55it/s]
 76%|███████▋  | 284012/371472 [25:55<6:37:02,  3.67it/s]
 76%|███████▋  | 284013/371472 [25:55<7:05:56,  3.42it/s]
 76%|███████▋  | 284014/371472 [25:55<6:54:26,  3.52it/s]
 76%|███████▋  | 284015/371472 [25:56<6:56:46,  3.50it/s]
 76%|███████▋  | 284016/371472 [25:56<6:51:08,  3.55it/s]
 76%|███████▋  | 284017/371472 [25:56<6:49:07,  3.56it/s]
 76%|███████▋  | 284018/371472 [25:56<6:41:36,  3.63it/s]
 76%|███████▋  | 284019/371472 [25:57<6:34:34,  3.69it/s]
 76%|███████▋  | 284020/371472 [25:57<6:47:57,  3.57it/s]
                                                         
{'loss': 2.7152, 'learning_rate': 3.1199228597901265e-07, 'epoch': 12.23}

 76%|███████▋  | 284020/371472 [25:57<6:47:57,  3.57it/s]
 76%|███████▋  | 284021/371472 [25:57<7:07:28,  3.41it/s]
 76%|███████▋  | 284022/371472 [25:58<6:56:52,  3.50it/s]
 76%|███████▋  | 284023/371472 [25:58<7:48:38,  3.11it/s]
 76%|███████▋  | 284024/371472 [25:58<7:47:43,  3.12it/s]
 76%|███████▋  | 284025/371472 [25:59<7:23:10,  3.29it/s]
 76%|███████▋  | 284026/371472 [25:59<7:09:16,  3.40it/s]
 76%|███████▋  | 284027/371472 [25:59<7:27:02,  3.26it/s]
 76%|███████▋  | 284028/371472 [26:00<7:12:28,  3.37it/s]
 76%|███████▋  | 284029/371472 [26:00<6:54:07,  3.52it/s]
 76%|███████▋  | 284030/371472 [26:00<6:39:55,  3.64it/s]
 76%|███████▋  | 284031/371472 [26:00<6:50:02,  3.55it/s]
 76%|███████▋  | 284032/371472 [26:01<6:39:59,  3.64it/s]
 76%|███████▋  | 284033/371472 [26:01<6:32:38,  3.71it/s]
 76%|███████▋  | 284034/371472 [26:01<8:05:08,  3.00it/s]
 76%|███████▋  | 284035/371472 [26:02<7:35:09,  3.20it/s]
 76%|███████▋  | 284036/371472 [26:02<7:21:24,  3.30it/s]
 76%|███████▋  | 284037/371472 [26:02<7:00:18,  3.47it/s]
 76%|███████▋  | 284038/371472 [26:02<6:56:58,  3.49it/s]
 76%|███████▋  | 284039/371472 [26:03<6:47:06,  3.58it/s]
 76%|███████▋  | 284040/371472 [26:03<6:52:34,  3.53it/s]
                                                         
{'loss': 2.5785, 'learning_rate': 3.1194380400353383e-07, 'epoch': 12.23}

 76%|███████▋  | 284040/371472 [26:03<6:52:34,  3.53it/s]
 76%|███████▋  | 284041/371472 [26:03<7:10:21,  3.39it/s]
 76%|███████▋  | 284042/371472 [26:04<6:50:09,  3.55it/s]
 76%|███████▋  | 284043/371472 [26:04<6:40:53,  3.63it/s]
 76%|███████▋  | 284044/371472 [26:04<6:54:13,  3.52it/s]
 76%|███████▋  | 284045/371472 [26:04<7:10:02,  3.39it/s]
 76%|███████▋  | 284046/371472 [26:05<7:14:13,  3.36it/s]
 76%|███████▋  | 284047/371472 [26:05<7:13:09,  3.36it/s]
 76%|███████▋  | 284048/371472 [26:05<7:43:10,  3.15it/s]
 76%|███████▋  | 284049/371472 [26:06<7:11:59,  3.37it/s]
 76%|███████▋  | 284050/371472 [26:06<7:19:00,  3.32it/s]
 76%|███████▋  | 284051/371472 [26:06<7:39:44,  3.17it/s]
 76%|███████▋  | 284052/371472 [26:07<7:19:40,  3.31it/s]
 76%|███████▋  | 284053/371472 [26:07<7:13:09,  3.36it/s]
 76%|███████▋  | 284054/371472 [26:07<6:50:05,  3.55it/s]
 76%|███████▋  | 284055/371472 [26:07<6:44:57,  3.60it/s]
 76%|███████▋  | 284056/371472 [26:08<6:46:55,  3.58it/s]
 76%|███████▋  | 284057/371472 [26:08<6:41:33,  3.63it/s]
 76%|███████▋  | 284058/371472 [26:08<6:34:30,  3.69it/s]
 76%|███████▋  | 284059/371472 [26:08<6:28:31,  3.75it/s]
 76%|███████▋  | 284060/371472 [26:09<6:25:40,  3.78it/s]
                                                         
{'loss': 2.6094, 'learning_rate': 3.118953220280549e-07, 'epoch': 12.24}

 76%|███████▋  | 284060/371472 [26:09<6:25:40,  3.78it/s]
 76%|███████▋  | 284061/371472 [26:09<6:43:45,  3.61it/s]
 76%|███████▋  | 284062/371472 [26:09<6:45:41,  3.59it/s]
 76%|███████▋  | 284063/371472 [26:10<6:33:27,  3.70it/s]
 76%|███████▋  | 284064/371472 [26:10<6:37:29,  3.67it/s]
 76%|███████▋  | 284065/371472 [26:10<6:26:43,  3.77it/s]
 76%|███████▋  | 284066/371472 [26:10<6:35:51,  3.68it/s]
 76%|███████▋  | 284067/371472 [26:11<6:34:33,  3.69it/s]
 76%|███████▋  | 284068/371472 [26:11<6:36:10,  3.68it/s]
 76%|███████▋  | 284069/371472 [26:11<6:59:21,  3.47it/s]
 76%|███████▋  | 284070/371472 [26:11<6:54:48,  3.51it/s]
 76%|███████▋  | 284071/371472 [26:12<7:03:10,  3.44it/s]
 76%|███████▋  | 284072/371472 [26:12<6:46:00,  3.59it/s]
 76%|███████▋  | 284073/371472 [26:12<6:30:57,  3.73it/s]
 76%|███████▋  | 284074/371472 [26:13<6:57:19,  3.49it/s]
 76%|███████▋  | 284075/371472 [26:13<6:55:31,  3.51it/s]
 76%|███████▋  | 284076/371472 [26:13<6:43:57,  3.61it/s]
 76%|███████▋  | 284077/371472 [26:13<6:39:54,  3.64it/s]
 76%|███████▋  | 284078/371472 [26:14<6:32:31,  3.71it/s]
 76%|███████▋  | 284079/371472 [26:14<6:39:42,  3.64it/s]
 76%|███████▋  | 284080/371472 [26:14<7:20:46,  3.30it/s]
                                                         
{'loss': 2.7845, 'learning_rate': 3.118468400525761e-07, 'epoch': 12.24}

 76%|███████▋  | 284080/371472 [26:14<7:20:46,  3.30it/s]
 76%|███████▋  | 284081/371472 [26:15<6:55:00,  3.51it/s]
 76%|███████▋  | 284082/371472 [26:15<6:46:49,  3.58it/s]
 76%|███████▋  | 284083/371472 [26:15<6:38:06,  3.66it/s]
 76%|███████▋  | 284084/371472 [26:15<6:39:49,  3.64it/s]
 76%|███████▋  | 284085/371472 [26:16<6:38:27,  3.66it/s]
 76%|███████▋  | 284086/371472 [26:16<7:16:10,  3.34it/s]
 76%|███████▋  | 284087/371472 [26:16<7:30:54,  3.23it/s]
 76%|███████▋  | 284088/371472 [26:17<7:21:53,  3.30it/s]
 76%|███████▋  | 284089/371472 [26:17<7:45:56,  3.13it/s]
 76%|███████▋  | 284090/371472 [26:17<7:42:15,  3.15it/s]
 76%|███████▋  | 284091/371472 [26:18<7:18:42,  3.32it/s]
 76%|███████▋  | 284092/371472 [26:18<7:12:18,  3.37it/s]
 76%|███████▋  | 284093/371472 [26:18<7:00:15,  3.47it/s]
 76%|███████▋  | 284094/371472 [26:18<7:36:39,  3.19it/s]
 76%|███████▋  | 284095/371472 [26:19<7:20:35,  3.31it/s]
 76%|███████▋  | 284096/371472 [26:19<7:58:18,  3.04it/s]
 76%|███████▋  | 284097/371472 [26:19<7:34:45,  3.20it/s]
 76%|███████▋  | 284098/371472 [26:20<7:12:40,  3.37it/s]
 76%|███████▋  | 284099/371472 [26:20<7:38:50,  3.17it/s]
 76%|███████▋  | 284100/371472 [26:20<7:22:01,  3.29it/s]
                                                         
{'loss': 2.594, 'learning_rate': 3.117983580770971e-07, 'epoch': 12.24}

 76%|███████▋  | 284100/371472 [26:20<7:22:01,  3.29it/s]
 76%|███████▋  | 284101/371472 [26:21<7:47:51,  3.11it/s]
 76%|███████▋  | 284102/371472 [26:21<7:46:08,  3.12it/s]
 76%|███████▋  | 284103/371472 [26:21<8:40:03,  2.80it/s]
 76%|███████▋  | 284104/371472 [26:22<8:12:08,  2.96it/s]
 76%|███████▋  | 284105/371472 [26:22<7:50:48,  3.09it/s]
 76%|███████▋  | 284106/371472 [26:22<7:45:56,  3.13it/s]
 76%|███████▋  | 284107/371472 [26:23<7:15:32,  3.34it/s]
 76%|███████▋  | 284108/371472 [26:23<7:10:13,  3.38it/s]
 76%|███████▋  | 284109/371472 [26:23<7:05:53,  3.42it/s]
 76%|███████▋  | 284110/371472 [26:23<7:00:44,  3.46it/s]
 76%|███████▋  | 284111/371472 [26:24<7:25:42,  3.27it/s]
 76%|███████▋  | 284112/371472 [26:24<7:12:09,  3.37it/s]
 76%|███████▋  | 284113/371472 [26:24<7:50:06,  3.10it/s]
 76%|███████▋  | 284114/371472 [26:25<7:26:18,  3.26it/s]
 76%|███████▋  | 284115/371472 [26:25<7:06:14,  3.42it/s]
 76%|███████▋  | 284116/371472 [26:25<6:49:41,  3.55it/s]
 76%|███████▋  | 284117/371472 [26:26<6:59:40,  3.47it/s]
 76%|███████▋  | 284118/371472 [26:26<7:19:44,  3.31it/s]
 76%|███████▋  | 284119/371472 [26:26<7:12:05,  3.37it/s]
 76%|███████▋  | 284120/371472 [26:26<7:04:43,  3.43it/s]
                                                         
{'loss': 2.7624, 'learning_rate': 3.1174987610161817e-07, 'epoch': 12.24}

 76%|███████▋  | 284120/371472 [26:26<7:04:43,  3.43it/s]
 76%|███████▋  | 284121/371472 [26:27<7:41:06,  3.16it/s]
 76%|███████▋  | 284122/371472 [26:27<7:23:25,  3.28it/s]
 76%|███████▋  | 284123/371472 [26:27<6:56:29,  3.50it/s]
 76%|███████▋  | 284124/371472 [26:28<7:03:01,  3.44it/s]
 76%|███████▋  | 284125/371472 [26:28<6:56:55,  3.49it/s]
 76%|███████▋  | 284126/371472 [26:28<6:48:04,  3.57it/s]
 76%|███████▋  | 284127/371472 [26:29<7:13:13,  3.36it/s]
 76%|███████▋  | 284128/371472 [26:29<6:57:33,  3.49it/s]
 76%|███████▋  | 284129/371472 [26:29<7:02:20,  3.45it/s]
 76%|███████▋  | 284130/371472 [26:29<6:53:19,  3.52it/s]
 76%|███████▋  | 284131/371472 [26:30<6:39:37,  3.64it/s]
 76%|███████▋  | 284132/371472 [26:30<6:36:12,  3.67it/s]
 76%|███████▋  | 284133/371472 [26:30<7:02:59,  3.44it/s]
 76%|███████▋  | 284134/371472 [26:30<7:03:30,  3.44it/s]
 76%|███████▋  | 284135/371472 [26:31<6:42:13,  3.62it/s]
 76%|███████▋  | 284136/371472 [26:31<6:37:25,  3.66it/s]
 76%|███████▋  | 284137/371472 [26:31<6:33:58,  3.69it/s]
 76%|███████▋  | 284138/371472 [26:32<6:26:25,  3.77it/s]
 76%|███████▋  | 284139/371472 [26:32<6:44:29,  3.60it/s]
 76%|███████▋  | 284140/371472 [26:32<7:15:15,  3.34it/s]
                                                         
{'loss': 2.6621, 'learning_rate': 3.117013941261393e-07, 'epoch': 12.24}

 76%|███████▋  | 284140/371472 [26:32<7:15:15,  3.34it/s]
 76%|███████▋  | 284141/371472 [26:32<7:31:22,  3.22it/s]
 76%|███████▋  | 284142/371472 [26:33<7:03:44,  3.43it/s]
 76%|███████▋  | 284143/371472 [26:33<6:56:42,  3.49it/s]
 76%|███████▋  | 284144/371472 [26:33<7:16:28,  3.33it/s]
 76%|███████▋  | 284145/371472 [26:34<7:16:25,  3.33it/s]
 76%|███████▋  | 284146/371472 [26:34<7:02:26,  3.45it/s]
 76%|███████▋  | 284147/371472 [26:34<7:21:42,  3.29it/s]
 76%|███████▋  | 284148/371472 [26:35<7:03:20,  3.44it/s]
 76%|███████▋  | 284149/371472 [26:35<7:15:16,  3.34it/s]
 76%|███████▋  | 284150/371472 [26:35<7:00:54,  3.46it/s]
 76%|███████▋  | 284151/371472 [26:35<6:59:02,  3.47it/s]
 76%|███████▋  | 284152/371472 [26:36<6:44:38,  3.60it/s]
 76%|███████▋  | 284153/371472 [26:36<6:46:31,  3.58it/s]
 76%|███████▋  | 284154/371472 [26:36<6:44:56,  3.59it/s]
 76%|███████▋  | 284155/371472 [26:36<6:45:13,  3.59it/s]
 76%|███████▋  | 284156/371472 [26:37<6:25:48,  3.77it/s]
 76%|███████▋  | 284157/371472 [26:37<6:33:24,  3.70it/s]
 76%|███████▋  | 284158/371472 [26:37<6:40:50,  3.63it/s]
 76%|███████▋  | 284159/371472 [26:38<6:34:32,  3.69it/s]
 76%|███████▋  | 284160/371472 [26:38<6:33:11,  3.70it/s]
                                                         
{'loss': 2.7222, 'learning_rate': 3.1165291215066036e-07, 'epoch': 12.24}

 76%|███████▋  | 284160/371472 [26:38<6:33:11,  3.70it/s]
 76%|███████▋  | 284161/371472 [26:38<6:46:06,  3.58it/s]
 76%|███████▋  | 284162/371472 [26:38<6:57:35,  3.48it/s]
 76%|███████▋  | 284163/371472 [26:39<7:17:16,  3.33it/s]
 76%|███████▋  | 284164/371472 [26:39<6:51:13,  3.54it/s]
 76%|███████▋  | 284165/371472 [26:39<7:27:41,  3.25it/s]
 76%|███████▋  | 284166/371472 [26:40<7:23:48,  3.28it/s]
 76%|███████▋  | 284167/371472 [26:40<7:07:46,  3.40it/s]
 76%|███████▋  | 284168/371472 [26:40<6:58:43,  3.47it/s]
 76%|███████▋  | 284169/371472 [26:40<6:47:51,  3.57it/s]
 76%|███████▋  | 284170/371472 [26:41<6:39:38,  3.64it/s]
 76%|███████▋  | 284171/371472 [26:41<6:30:11,  3.73it/s]
 76%|███████▋  | 284172/371472 [26:41<6:47:54,  3.57it/s]
 76%|███████▋  | 284173/371472 [26:42<6:59:25,  3.47it/s]
 76%|███████▋  | 284174/371472 [26:42<7:01:19,  3.45it/s]
 76%|███████▋  | 284175/371472 [26:42<7:05:32,  3.42it/s]
 76%|███████▋  | 284176/371472 [26:43<7:47:57,  3.11it/s]
 77%|███████▋  | 284177/371472 [26:43<7:44:58,  3.13it/s]
 77%|███████▋  | 284178/371472 [26:43<7:18:51,  3.32it/s]
 77%|███████▋  | 284179/371472 [26:43<7:28:25,  3.24it/s]
 77%|███████▋  | 284180/371472 [26:44<7:10:25,  3.38it/s]
                                                         
{'loss': 2.6901, 'learning_rate': 3.1160443017518154e-07, 'epoch': 12.24}

 77%|███████▋  | 284180/371472 [26:44<7:10:25,  3.38it/s]
 77%|███████▋  | 284181/371472 [26:44<6:59:13,  3.47it/s]
 77%|███████▋  | 284182/371472 [26:44<6:44:15,  3.60it/s]
 77%|███████▋  | 284183/371472 [26:45<6:38:40,  3.65it/s]
 77%|███████▋  | 284184/371472 [26:45<6:41:51,  3.62it/s]
 77%|███████▋  | 284185/371472 [26:45<7:11:55,  3.37it/s]
 77%|███████▋  | 284186/371472 [26:45<6:54:28,  3.51it/s]
 77%|███████▋  | 284187/371472 [26:46<7:09:24,  3.39it/s]
 77%|███████▋  | 284188/371472 [26:46<6:52:19,  3.53it/s]
 77%|███████▋  | 284189/371472 [26:46<7:10:06,  3.38it/s]
 77%|███████▋  | 284190/371472 [26:47<6:56:55,  3.49it/s]
 77%|███████▋  | 284191/371472 [26:47<6:44:20,  3.60it/s]
 77%|███████▋  | 284192/371472 [26:47<7:05:52,  3.42it/s]
 77%|███████▋  | 284193/371472 [26:48<7:29:37,  3.24it/s]
 77%|███████▋  | 284194/371472 [26:48<7:01:35,  3.45it/s]
 77%|███████▋  | 284195/371472 [26:48<7:09:45,  3.38it/s]
 77%|███████▋  | 284196/371472 [26:48<7:11:42,  3.37it/s]
 77%|███████▋  | 284197/371472 [26:49<6:54:24,  3.51it/s]
 77%|███████▋  | 284198/371472 [26:49<6:38:45,  3.65it/s]
 77%|███████▋  | 284199/371472 [26:49<6:46:26,  3.58it/s]
 77%|███████▋  | 284200/371472 [26:49<6:48:03,  3.56it/s]
                                                         
{'loss': 2.7473, 'learning_rate': 3.115559481997026e-07, 'epoch': 12.24}

 77%|███████▋  | 284200/371472 [26:49<6:48:03,  3.56it/s]
 77%|███████▋  | 284201/371472 [26:50<6:42:26,  3.61it/s]
 77%|███████▋  | 284202/371472 [26:50<6:39:25,  3.64it/s]
 77%|███████▋  | 284203/371472 [26:50<6:27:36,  3.75it/s]
 77%|███████▋  | 284204/371472 [26:51<6:38:31,  3.65it/s]
 77%|███████▋  | 284205/371472 [26:51<6:34:25,  3.69it/s]
 77%|███████▋  | 284206/371472 [26:51<6:55:08,  3.50it/s]
 77%|███████▋  | 284207/371472 [26:51<6:47:06,  3.57it/s]
 77%|███████▋  | 284208/371472 [26:52<6:35:46,  3.67it/s]
 77%|███████▋  | 284209/371472 [26:52<9:22:39,  2.58it/s]
 77%|███████▋  | 284210/371472 [26:53<9:28:03,  2.56it/s]
 77%|███████▋  | 284211/371472 [26:53<8:55:30,  2.72it/s]
 77%|███████▋  | 284212/371472 [26:53<8:14:35,  2.94it/s]
 77%|███████▋  | 284213/371472 [26:54<7:48:18,  3.11it/s]
 77%|███████▋  | 284214/371472 [26:54<7:21:26,  3.29it/s]
 77%|███████▋  | 284215/371472 [26:54<7:13:45,  3.35it/s]
 77%|███████▋  | 284216/371472 [26:54<6:52:46,  3.52it/s]
 77%|███████▋  | 284217/371472 [26:55<6:38:15,  3.65it/s]
 77%|███████▋  | 284218/371472 [26:55<6:33:13,  3.70it/s]
 77%|███████▋  | 284219/371472 [26:55<6:32:13,  3.71it/s]
 77%|███████▋  | 284220/371472 [26:55<6:55:09,  3.50it/s]
                                                         
{'loss': 2.6592, 'learning_rate': 3.1150746622422374e-07, 'epoch': 12.24}

 77%|███████▋  | 284220/371472 [26:55<6:55:09,  3.50it/s]
 77%|███████▋  | 284221/371472 [26:56<6:49:49,  3.55it/s]
 77%|███████▋  | 284222/371472 [26:56<7:36:47,  3.18it/s]
 77%|███████▋  | 284223/371472 [26:56<7:17:24,  3.32it/s]
 77%|███████▋  | 284224/371472 [26:57<7:14:02,  3.35it/s]
 77%|███████▋  | 284225/371472 [26:57<7:39:55,  3.16it/s]
 77%|███████▋  | 284226/371472 [26:57<7:19:54,  3.31it/s]
 77%|███████▋  | 284227/371472 [26:58<7:01:06,  3.45it/s]
 77%|███████▋  | 284228/371472 [26:58<6:42:34,  3.61it/s]
 77%|███████▋  | 284229/371472 [26:58<6:45:01,  3.59it/s]
 77%|███████▋  | 284230/371472 [26:58<7:08:26,  3.39it/s]
 77%|███████▋  | 284231/371472 [26:59<7:12:06,  3.36it/s]
 77%|███████▋  | 284232/371472 [26:59<6:52:54,  3.52it/s]
 77%|███████▋  | 284233/371472 [26:59<6:50:50,  3.54it/s]
 77%|███████▋  | 284234/371472 [26:59<6:34:12,  3.69it/s]
 77%|███████▋  | 284235/371472 [27:00<6:39:05,  3.64it/s]
 77%|███████▋  | 284236/371472 [27:00<6:49:14,  3.55it/s]
 77%|███████▋  | 284237/371472 [27:00<6:52:32,  3.52it/s]
 77%|███████▋  | 284238/371472 [27:01<7:00:32,  3.46it/s]
 77%|███████▋  | 284239/371472 [27:01<7:21:29,  3.29it/s]
 77%|███████▋  | 284240/371472 [27:01<7:05:42,  3.42it/s]
                                                         
{'loss': 2.6421, 'learning_rate': 3.114589842487448e-07, 'epoch': 12.24}

 77%|███████▋  | 284240/371472 [27:01<7:05:42,  3.42it/s]
 77%|███████▋  | 284241/371472 [27:02<7:05:17,  3.42it/s]
 77%|███████▋  | 284242/371472 [27:02<6:52:19,  3.53it/s]
 77%|███████▋  | 284243/371472 [27:02<6:52:10,  3.53it/s]
 77%|███████▋  | 284244/371472 [27:02<6:42:54,  3.61it/s]
 77%|███████▋  | 284245/371472 [27:03<6:41:39,  3.62it/s]
 77%|███████▋  | 284246/371472 [27:03<6:47:05,  3.57it/s]
 77%|███████▋  | 284247/371472 [27:03<6:34:12,  3.69it/s]
 77%|███████▋  | 284248/371472 [27:03<6:36:43,  3.66it/s]
 77%|███████▋  | 284249/371472 [27:04<6:35:47,  3.67it/s]
 77%|███████▋  | 284250/371472 [27:04<6:51:06,  3.54it/s]
 77%|███████▋  | 284251/371472 [27:04<7:00:57,  3.45it/s]
 77%|███████▋  | 284252/371472 [27:05<6:56:51,  3.49it/s]
 77%|███████▋  | 284253/371472 [27:05<7:29:49,  3.23it/s]
 77%|███████▋  | 284254/371472 [27:05<7:21:08,  3.30it/s]
 77%|███████▋  | 284255/371472 [27:06<7:00:45,  3.45it/s]
 77%|███████▋  | 284256/371472 [27:06<7:26:14,  3.26it/s]
 77%|███████▋  | 284257/371472 [27:06<7:36:24,  3.18it/s]
 77%|███████▋  | 284258/371472 [27:07<7:38:09,  3.17it/s]
 77%|███████▋  | 284259/371472 [27:07<7:26:17,  3.26it/s]
 77%|███████▋  | 284260/371472 [27:07<7:14:26,  3.35it/s]
                                                         
{'loss': 2.602, 'learning_rate': 3.1141050227326593e-07, 'epoch': 12.24}

 77%|███████▋  | 284260/371472 [27:07<7:14:26,  3.35it/s]
 77%|███████▋  | 284261/371472 [27:07<7:05:04,  3.42it/s]
 77%|███████▋  | 284262/371472 [27:08<7:00:53,  3.45it/s]
 77%|███████▋  | 284263/371472 [27:08<7:00:40,  3.46it/s]
 77%|███████▋  | 284264/371472 [27:08<8:10:53,  2.96it/s]
 77%|███████▋  | 284265/371472 [27:09<7:37:30,  3.18it/s]
 77%|███████▋  | 284266/371472 [27:09<7:23:30,  3.28it/s]
 77%|███████▋  | 284267/371472 [27:09<7:08:24,  3.39it/s]
 77%|███████▋  | 284268/371472 [27:09<6:53:03,  3.52it/s]
 77%|███████▋  | 284269/371472 [27:10<6:51:39,  3.53it/s]
 77%|███████▋  | 284270/371472 [27:10<7:01:28,  3.45it/s]
 77%|███████▋  | 284271/371472 [27:10<6:50:43,  3.54it/s]
 77%|███████▋  | 284272/371472 [27:11<6:59:19,  3.47it/s]
 77%|███████▋  | 284273/371472 [27:11<7:03:04,  3.44it/s]
 77%|███████▋  | 284274/371472 [27:11<7:14:25,  3.35it/s]
 77%|███████▋  | 284275/371472 [27:11<6:49:53,  3.55it/s]
 77%|███████▋  | 284276/371472 [27:12<6:48:51,  3.55it/s]
 77%|███████▋  | 284277/371472 [27:12<6:48:50,  3.55it/s]
 77%|███████▋  | 284278/371472 [27:12<6:29:23,  3.73it/s]
 77%|███████▋  | 284279/371472 [27:13<7:02:46,  3.44it/s]
 77%|███████▋  | 284280/371472 [27:13<7:14:58,  3.34it/s]
                                                         
{'loss': 2.6711, 'learning_rate': 3.11362020297787e-07, 'epoch': 12.24}

 77%|███████▋  | 284280/371472 [27:13<7:14:58,  3.34it/s]
 77%|███████▋  | 284281/371472 [27:13<7:09:52,  3.38it/s]
 77%|███████▋  | 284282/371472 [27:14<6:58:34,  3.47it/s]
 77%|███████▋  | 284283/371472 [27:14<7:21:53,  3.29it/s]
 77%|███████▋  | 284284/371472 [27:14<7:12:14,  3.36it/s]
 77%|███████▋  | 284285/371472 [27:14<7:10:31,  3.38it/s]
 77%|███████▋  | 284286/371472 [27:15<7:20:34,  3.30it/s]
 77%|███████▋  | 284287/371472 [27:15<7:25:31,  3.26it/s]
 77%|███████▋  | 284288/371472 [27:15<7:22:26,  3.28it/s]
 77%|███████▋  | 284289/371472 [27:16<7:06:49,  3.40it/s]
 77%|███████▋  | 284290/371472 [27:16<6:44:07,  3.60it/s]
 77%|███████▋  | 284291/371472 [27:16<6:50:29,  3.54it/s]
 77%|███████▋  | 284292/371472 [27:16<6:38:52,  3.64it/s]
 77%|███████▋  | 284293/371472 [27:17<7:06:47,  3.40it/s]
 77%|███████▋  | 284294/371472 [27:17<7:38:05,  3.17it/s]
 77%|███████▋  | 284295/371472 [27:17<7:27:08,  3.25it/s]
 77%|███████▋  | 284296/371472 [27:18<7:21:46,  3.29it/s]
 77%|███████▋  | 284297/371472 [27:18<7:06:42,  3.40it/s]
 77%|███████▋  | 284298/371472 [27:18<6:52:30,  3.52it/s]
 77%|███████▋  | 284299/371472 [27:19<6:48:55,  3.55it/s]
 77%|███████▋  | 284300/371472 [27:19<7:08:26,  3.39it/s]
                                                         
{'loss': 2.7425, 'learning_rate': 3.113135383223082e-07, 'epoch': 12.25}

 77%|███████▋  | 284300/371472 [27:19<7:08:26,  3.39it/s]
 77%|███████▋  | 284301/371472 [27:19<6:46:25,  3.57it/s]
 77%|███████▋  | 284302/371472 [27:19<7:00:21,  3.46it/s]
 77%|███████▋  | 284303/371472 [27:20<6:38:54,  3.64it/s]
 77%|███████▋  | 284304/371472 [27:20<6:35:07,  3.68it/s]
 77%|███████▋  | 284305/371472 [27:20<6:29:22,  3.73it/s]
 77%|███████▋  | 284306/371472 [27:20<6:24:37,  3.78it/s]
 77%|███████▋  | 284307/371472 [27:21<6:38:47,  3.64it/s]
 77%|███████▋  | 284308/371472 [27:21<6:32:25,  3.70it/s]
 77%|███████▋  | 284309/371472 [27:21<6:31:55,  3.71it/s]
 77%|███████▋  | 284310/371472 [27:22<6:28:58,  3.73it/s]
 77%|███████▋  | 284311/371472 [27:22<6:24:23,  3.78it/s]
 77%|███████▋  | 284312/371472 [27:22<6:20:32,  3.82it/s]
 77%|███████▋  | 284313/371472 [27:22<6:12:25,  3.90it/s]
 77%|███████▋  | 284314/371472 [27:23<6:37:37,  3.65it/s]
 77%|███████▋  | 284315/371472 [27:23<7:10:10,  3.38it/s]
 77%|███████▋  | 284316/371472 [27:23<7:15:04,  3.34it/s]
 77%|███████▋  | 284317/371472 [27:23<6:53:41,  3.51it/s]
 77%|███████▋  | 284318/371472 [27:24<6:55:04,  3.50it/s]
 77%|███████▋  | 284319/371472 [27:24<6:56:17,  3.49it/s]
 77%|███████▋  | 284320/371472 [27:24<7:41:58,  3.14it/s]
                                                         
{'loss': 2.6025, 'learning_rate': 3.1126505634682925e-07, 'epoch': 12.25}

 77%|███████▋  | 284320/371472 [27:24<7:41:58,  3.14it/s]
 77%|███████▋  | 284321/371472 [27:25<7:12:28,  3.36it/s]
 77%|███████▋  | 284322/371472 [27:25<6:52:05,  3.52it/s]
 77%|███████▋  | 284323/371472 [27:25<6:42:46,  3.61it/s]
 77%|███████▋  | 284324/371472 [27:25<6:42:35,  3.61it/s]
 77%|███████▋  | 284325/371472 [27:26<6:35:05,  3.68it/s]
 77%|███████▋  | 284326/371472 [27:26<6:35:32,  3.67it/s]
 77%|███████▋  | 284327/371472 [27:26<6:46:41,  3.57it/s]
 77%|███████▋  | 284328/371472 [27:27<6:50:07,  3.54it/s]
 77%|███████▋  | 284329/371472 [27:27<7:28:50,  3.24it/s]
 77%|███████▋  | 284330/371472 [27:27<7:19:54,  3.30it/s]
 77%|███████▋  | 284331/371472 [27:28<7:20:12,  3.30it/s]
 77%|███████▋  | 284332/371472 [27:28<6:55:13,  3.50it/s]
 77%|███████▋  | 284333/371472 [27:28<6:50:00,  3.54it/s]
 77%|███████▋  | 284334/371472 [27:28<6:34:08,  3.68it/s]
 77%|███████▋  | 284335/371472 [27:29<6:40:29,  3.63it/s]
 77%|███████▋  | 284336/371472 [27:29<6:54:36,  3.50it/s]
 77%|███████▋  | 284337/371472 [27:29<6:44:55,  3.59it/s]
 77%|███████▋  | 284338/371472 [27:29<6:36:21,  3.66it/s]
 77%|███████▋  | 284339/371472 [27:30<6:54:23,  3.50it/s]
 77%|███████▋  | 284340/371472 [27:30<6:50:03,  3.54it/s]
                                                         
{'loss': 2.7317, 'learning_rate': 3.1121657437135043e-07, 'epoch': 12.25}

 77%|███████▋  | 284340/371472 [27:30<6:50:03,  3.54it/s]
 77%|███████▋  | 284341/371472 [27:30<6:46:57,  3.57it/s]
 77%|███████▋  | 284342/371472 [27:31<6:50:57,  3.53it/s]
 77%|███████▋  | 284343/371472 [27:31<6:47:08,  3.57it/s]
 77%|███████▋  | 284344/371472 [27:31<6:35:52,  3.67it/s]
 77%|███████▋  | 284345/371472 [27:31<6:46:53,  3.57it/s]
 77%|███████▋  | 284346/371472 [27:32<6:43:34,  3.60it/s]
 77%|███████▋  | 284347/371472 [27:32<6:43:57,  3.59it/s]
 77%|███████▋  | 284348/371472 [27:32<6:34:09,  3.68it/s]
 77%|███████▋  | 284349/371472 [27:32<6:25:27,  3.77it/s]
 77%|███████▋  | 284350/371472 [27:33<6:23:21,  3.79it/s]
 77%|███████▋  | 284351/371472 [27:33<6:51:43,  3.53it/s]
 77%|███████▋  | 284352/371472 [27:33<7:07:21,  3.40it/s]
 77%|███████▋  | 284353/371472 [27:34<7:02:31,  3.44it/s]
 77%|███████▋  | 284354/371472 [27:34<6:56:29,  3.49it/s]
 77%|███████▋  | 284355/371472 [27:34<7:27:50,  3.24it/s]
 77%|███████▋  | 284356/371472 [27:35<7:02:44,  3.43it/s]
 77%|███████▋  | 284357/371472 [27:35<6:54:44,  3.50it/s]
 77%|███████▋  | 284358/371472 [27:35<7:03:47,  3.43it/s]
 77%|███████▋  | 284359/371472 [27:35<7:15:13,  3.34it/s]
 77%|███████▋  | 284360/371472 [27:36<6:59:00,  3.46it/s]
                                                         
{'loss': 2.6941, 'learning_rate': 3.1116809239587145e-07, 'epoch': 12.25}

 77%|███████▋  | 284360/371472 [27:36<6:59:00,  3.46it/s]
 77%|███████▋  | 284361/371472 [27:36<6:56:51,  3.48it/s]
 77%|███████▋  | 284362/371472 [27:36<6:48:02,  3.56it/s]
 77%|███████▋  | 284363/371472 [27:37<6:47:44,  3.56it/s]
 77%|███████▋  | 284364/371472 [27:37<6:35:00,  3.68it/s]
 77%|███████▋  | 284365/371472 [27:37<6:42:52,  3.60it/s]
 77%|███████▋  | 284366/371472 [27:37<6:44:31,  3.59it/s]
 77%|███████▋  | 284367/371472 [27:38<6:30:20,  3.72it/s]
 77%|███████▋  | 284368/371472 [27:38<7:09:52,  3.38it/s]
 77%|███████▋  | 284369/371472 [27:38<6:52:00,  3.52it/s]
 77%|███████▋  | 284370/371472 [27:39<6:46:56,  3.57it/s]
 77%|███████▋  | 284371/371472 [27:39<6:51:35,  3.53it/s]
 77%|███████▋  | 284372/371472 [27:39<6:36:26,  3.66it/s]
 77%|███████▋  | 284373/371472 [27:39<6:41:29,  3.62it/s]
 77%|███████▋  | 284374/371472 [27:40<6:29:28,  3.73it/s]
 77%|███████▋  | 284375/371472 [27:40<6:24:58,  3.77it/s]
 77%|███████▋  | 284376/371472 [27:40<6:58:06,  3.47it/s]
 77%|███████▋  | 284377/371472 [27:40<6:57:35,  3.48it/s]
 77%|███████▋  | 284378/371472 [27:41<6:54:30,  3.50it/s]
 77%|███████▋  | 284379/371472 [27:41<6:36:29,  3.66it/s]
 77%|███████▋  | 284380/371472 [27:41<6:30:31,  3.72it/s]
                                                         
{'loss': 2.6338, 'learning_rate': 3.111196104203926e-07, 'epoch': 12.25}

 77%|███████▋  | 284380/371472 [27:41<6:30:31,  3.72it/s]
 77%|███████▋  | 284381/371472 [27:42<7:05:55,  3.41it/s]
 77%|███████▋  | 284382/371472 [27:42<6:55:17,  3.50it/s]
 77%|███████▋  | 284383/371472 [27:42<6:58:55,  3.46it/s]
 77%|███████▋  | 284384/371472 [27:42<6:54:01,  3.51it/s]
 77%|███████▋  | 284385/371472 [27:43<7:02:36,  3.43it/s]
 77%|███████▋  | 284386/371472 [27:43<6:50:55,  3.53it/s]
 77%|███████▋  | 284387/371472 [27:43<6:50:06,  3.54it/s]
 77%|███████▋  | 284388/371472 [27:44<6:51:11,  3.53it/s]
 77%|███████▋  | 284389/371472 [27:44<6:37:56,  3.65it/s]
 77%|███████▋  | 284390/371472 [27:44<6:47:16,  3.56it/s]
 77%|███████▋  | 284391/371472 [27:44<6:37:43,  3.65it/s]
 77%|███████▋  | 284392/371472 [27:45<6:48:44,  3.55it/s]
 77%|███████▋  | 284393/371472 [27:45<6:45:12,  3.58it/s]
 77%|███████▋  | 284394/371472 [27:45<6:38:27,  3.64it/s]
 77%|███████▋  | 284395/371472 [27:45<6:29:57,  3.72it/s]
 77%|███████▋  | 284396/371472 [27:46<6:31:14,  3.71it/s]
 77%|███████▋  | 284397/371472 [27:46<6:23:19,  3.79it/s]
 77%|███████▋  | 284398/371472 [27:46<7:03:58,  3.42it/s]
 77%|███████▋  | 284399/371472 [27:47<6:59:18,  3.46it/s]
 77%|███████▋  | 284400/371472 [27:47<7:15:55,  3.33it/s]
                                                         
{'loss': 2.6764, 'learning_rate': 3.1107112844491365e-07, 'epoch': 12.25}

 77%|███████▋  | 284400/371472 [27:47<7:15:55,  3.33it/s]
 77%|███████▋  | 284401/371472 [27:47<7:26:06,  3.25it/s]
 77%|███████▋  | 284402/371472 [27:48<7:23:08,  3.27it/s]
 77%|███████▋  | 284403/371472 [27:48<7:37:54,  3.17it/s]
 77%|███████▋  | 284404/371472 [27:48<7:25:12,  3.26it/s]
 77%|███████▋  | 284405/371472 [27:48<7:10:02,  3.37it/s]
 77%|███████▋  | 284406/371472 [27:49<6:47:49,  3.56it/s]
 77%|███████▋  | 284407/371472 [27:49<6:55:01,  3.50it/s]
 77%|███████▋  | 284408/371472 [27:49<6:57:27,  3.48it/s]
 77%|███████▋  | 284409/371472 [27:50<6:42:32,  3.60it/s]
 77%|███████▋  | 284410/371472 [27:50<6:47:20,  3.56it/s]
 77%|███████▋  | 284411/371472 [27:50<6:53:40,  3.51it/s]
 77%|███████▋  | 284412/371472 [27:50<6:46:42,  3.57it/s]
 77%|███████▋  | 284413/371472 [27:51<6:34:39,  3.68it/s]
 77%|███████▋  | 284414/371472 [27:51<6:42:21,  3.61it/s]
 77%|███████▋  | 284415/371472 [27:51<6:46:34,  3.57it/s]
 77%|███████▋  | 284416/371472 [27:52<6:51:35,  3.53it/s]
 77%|███████▋  | 284417/371472 [27:52<7:04:08,  3.42it/s]
 77%|███████▋  | 284418/371472 [27:52<6:52:30,  3.52it/s]
 77%|███████▋  | 284419/371472 [27:52<6:39:07,  3.64it/s]
 77%|███████▋  | 284420/371472 [27:53<6:46:59,  3.56it/s]
                                                         
{'loss': 2.5445, 'learning_rate': 3.110226464694348e-07, 'epoch': 12.25}

 77%|███████▋  | 284420/371472 [27:53<6:46:59,  3.56it/s]
 77%|███████▋  | 284421/371472 [27:53<6:53:10,  3.51it/s]
 77%|███████▋  | 284422/371472 [27:53<6:55:35,  3.49it/s]
 77%|███████▋  | 284423/371472 [27:54<7:37:02,  3.17it/s]
 77%|███████▋  | 284424/371472 [27:54<7:35:46,  3.18it/s]
 77%|███████▋  | 284425/371472 [27:54<7:29:06,  3.23it/s]
 77%|███████▋  | 284426/371472 [27:55<7:30:46,  3.22it/s]
 77%|███████▋  | 284427/371472 [27:55<7:29:18,  3.23it/s]
 77%|███████▋  | 284428/371472 [27:55<7:15:43,  3.33it/s]
 77%|███████▋  | 284429/371472 [27:55<6:59:33,  3.46it/s]
 77%|███████▋  | 284430/371472 [27:56<6:45:34,  3.58it/s]
 77%|███████▋  | 284431/371472 [27:56<7:37:51,  3.17it/s]
 77%|███████▋  | 284432/371472 [27:56<7:06:34,  3.40it/s]
 77%|███████▋  | 284433/371472 [27:57<6:56:26,  3.48it/s]
 77%|███████▋  | 284434/371472 [27:57<6:44:42,  3.58it/s]
 77%|███████▋  | 284435/371472 [27:57<7:14:01,  3.34it/s]
 77%|███████▋  | 284436/371472 [27:58<7:12:52,  3.35it/s]
 77%|███████▋  | 284437/371472 [27:58<7:03:06,  3.43it/s]
 77%|███████▋  | 284438/371472 [27:58<7:12:51,  3.35it/s]
 77%|███████▋  | 284439/371472 [27:59<8:07:12,  2.98it/s]
 77%|███████▋  | 284440/371472 [27:59<8:17:29,  2.92it/s]
                                                         
{'loss': 2.6504, 'learning_rate': 3.109741644939559e-07, 'epoch': 12.25}

 77%|███████▋  | 284440/371472 [27:59<8:17:29,  2.92it/s]
 77%|███████▋  | 284441/371472 [27:59<8:15:56,  2.92it/s]
 77%|███████▋  | 284442/371472 [27:59<7:38:35,  3.16it/s]
 77%|███████▋  | 284443/371472 [28:00<7:12:41,  3.35it/s]
 77%|███████▋  | 284444/371472 [28:00<6:59:24,  3.46it/s]
 77%|███████▋  | 284445/371472 [28:00<6:41:23,  3.61it/s]
 77%|███████▋  | 284446/371472 [28:01<6:43:54,  3.59it/s]
 77%|███████▋  | 284447/371472 [28:01<7:00:59,  3.45it/s]
 77%|███████▋  | 284448/371472 [28:01<6:53:48,  3.50it/s]
 77%|███████▋  | 284449/371472 [28:01<7:10:11,  3.37it/s]
 77%|███████▋  | 284450/371472 [28:02<6:54:24,  3.50it/s]
 77%|███████▋  | 284451/371472 [28:02<6:50:46,  3.53it/s]
 77%|███████▋  | 284452/371472 [28:02<6:41:39,  3.61it/s]
 77%|███████▋  | 284453/371472 [28:03<6:46:15,  3.57it/s]
 77%|███████▋  | 284454/371472 [28:03<6:54:25,  3.50it/s]
 77%|███████▋  | 284455/371472 [28:03<6:51:42,  3.52it/s]
 77%|███████▋  | 284456/371472 [28:03<6:52:13,  3.52it/s]
 77%|███████▋  | 284457/371472 [28:04<6:44:34,  3.58it/s]
 77%|███████▋  | 284458/371472 [28:04<6:43:24,  3.59it/s]
 77%|███████▋  | 284459/371472 [28:04<7:06:46,  3.40it/s]
 77%|███████▋  | 284460/371472 [28:05<7:24:16,  3.26it/s]
                                                         
{'loss': 2.5548, 'learning_rate': 3.1092568251847707e-07, 'epoch': 12.25}

 77%|███████▋  | 284460/371472 [28:05<7:24:16,  3.26it/s]
 77%|███████▋  | 284461/371472 [28:05<7:19:11,  3.30it/s]
 77%|███████▋  | 284462/371472 [28:05<7:18:58,  3.30it/s]
 77%|███████▋  | 284463/371472 [28:05<7:15:35,  3.33it/s]
 77%|███████▋  | 284464/371472 [28:06<6:56:13,  3.48it/s]
 77%|███████▋  | 284465/371472 [28:06<8:39:19,  2.79it/s]
 77%|███████▋  | 284466/371472 [28:07<8:09:58,  2.96it/s]
 77%|███████▋  | 284467/371472 [28:07<7:37:14,  3.17it/s]
 77%|███████▋  | 284468/371472 [28:07<7:42:14,  3.14it/s]
 77%|███████▋  | 284469/371472 [28:07<7:27:36,  3.24it/s]
 77%|███████▋  | 284470/371472 [28:08<7:31:43,  3.21it/s]
 77%|███████▋  | 284471/371472 [28:08<7:33:20,  3.20it/s]
 77%|███████▋  | 284472/371472 [28:08<7:10:06,  3.37it/s]
 77%|███████▋  | 284473/371472 [28:09<7:21:40,  3.28it/s]
 77%|███████▋  | 284474/371472 [28:09<7:04:31,  3.42it/s]
 77%|███████▋  | 284475/371472 [28:09<6:46:17,  3.57it/s]
 77%|███████▋  | 284476/371472 [28:09<6:45:25,  3.58it/s]
 77%|███████▋  | 284477/371472 [28:10<6:29:45,  3.72it/s]
 77%|███████▋  | 284478/371472 [28:10<6:40:07,  3.62it/s]
 77%|███████▋  | 284479/371472 [28:10<6:37:09,  3.65it/s]
 77%|███████▋  | 284480/371472 [28:11<6:57:39,  3.47it/s]
                                                         
{'loss': 2.7473, 'learning_rate': 3.108772005429981e-07, 'epoch': 12.25}

 77%|███████▋  | 284480/371472 [28:11<6:57:39,  3.47it/s]
 77%|███████▋  | 284481/371472 [28:11<7:13:27,  3.34it/s]
 77%|███████▋  | 284482/371472 [28:11<6:59:50,  3.45it/s]
 77%|███████▋  | 284483/371472 [28:11<7:01:50,  3.44it/s]
 77%|███████▋  | 284484/371472 [28:12<6:54:50,  3.49it/s]
 77%|███████▋  | 284485/371472 [28:12<7:05:52,  3.40it/s]
 77%|███████▋  | 284486/371472 [28:12<7:34:37,  3.19it/s]
 77%|███████▋  | 284487/371472 [28:13<7:08:00,  3.39it/s]
 77%|███████▋  | 284488/371472 [28:13<7:12:43,  3.35it/s]
 77%|███████▋  | 284489/371472 [28:13<7:21:12,  3.29it/s]
 77%|███████▋  | 284490/371472 [28:14<7:09:42,  3.37it/s]
 77%|███████▋  | 284491/371472 [28:14<8:03:01,  3.00it/s]
 77%|███████▋  | 284492/371472 [28:14<7:25:57,  3.25it/s]
 77%|███████▋  | 284493/371472 [28:14<6:56:22,  3.48it/s]
 77%|███████▋  | 284494/371472 [28:15<6:44:28,  3.58it/s]
 77%|███████▋  | 284495/371472 [28:15<6:36:07,  3.66it/s]
 77%|███████▋  | 284496/371472 [28:15<6:36:56,  3.65it/s]
 77%|███████▋  | 284497/371472 [28:16<6:37:57,  3.64it/s]
 77%|███████▋  | 284498/371472 [28:16<6:32:06,  3.70it/s]
 77%|███████▋  | 284499/371472 [28:16<6:34:57,  3.67it/s]
 77%|███████▋  | 284500/371472 [28:16<6:25:53,  3.76it/s]
                                                         
{'loss': 2.716, 'learning_rate': 3.1082871856751927e-07, 'epoch': 12.25}

 77%|███████▋  | 284500/371472 [28:16<6:25:53,  3.76it/s]
 77%|███████▋  | 284501/371472 [28:17<6:28:07,  3.73it/s]
 77%|███████▋  | 284502/371472 [28:17<6:19:43,  3.82it/s]
 77%|███████▋  | 284503/371472 [28:17<6:16:57,  3.85it/s]
 77%|███████▋  | 284504/371472 [28:17<6:46:25,  3.57it/s]
 77%|███████▋  | 284505/371472 [28:18<6:47:35,  3.56it/s]
 77%|███████▋  | 284506/371472 [28:18<7:13:44,  3.34it/s]
 77%|███████▋  | 284507/371472 [28:18<6:59:24,  3.46it/s]
 77%|███████▋  | 284508/371472 [28:19<6:41:13,  3.61it/s]
 77%|███████▋  | 284509/371472 [28:19<6:34:28,  3.67it/s]
 77%|███████▋  | 284510/371472 [28:19<6:30:42,  3.71it/s]
 77%|███████▋  | 284511/371472 [28:19<6:27:12,  3.74it/s]
 77%|███████▋  | 284512/371472 [28:20<6:38:46,  3.63it/s]
 77%|███████▋  | 284513/371472 [28:20<6:43:17,  3.59it/s]
 77%|███████▋  | 284514/371472 [28:20<6:31:19,  3.70it/s]
 77%|███████▋  | 284515/371472 [28:20<6:38:30,  3.64it/s]
 77%|███████▋  | 284516/371472 [28:21<6:31:47,  3.70it/s]
 77%|███████▋  | 284517/371472 [28:21<6:33:54,  3.68it/s]
 77%|███████▋  | 284518/371472 [28:21<6:32:32,  3.69it/s]
 77%|███████▋  | 284519/371472 [28:22<6:45:54,  3.57it/s]
 77%|███████▋  | 284520/371472 [28:22<6:42:29,  3.60it/s]
                                                         
{'loss': 2.787, 'learning_rate': 3.107802365920403e-07, 'epoch': 12.25}

 77%|███████▋  | 284520/371472 [28:22<6:42:29,  3.60it/s]
 77%|███████▋  | 284521/371472 [28:22<7:14:37,  3.33it/s]
 77%|███████▋  | 284522/371472 [28:22<7:10:50,  3.36it/s]
 77%|███████▋  | 284523/371472 [28:23<7:12:50,  3.35it/s]
 77%|███████▋  | 284524/371472 [28:23<7:42:38,  3.13it/s]
 77%|███████▋  | 284525/371472 [28:23<7:21:27,  3.28it/s]
 77%|███████▋  | 284526/371472 [28:24<7:03:33,  3.42it/s]
 77%|███████▋  | 284527/371472 [28:24<6:48:00,  3.55it/s]
 77%|███████▋  | 284528/371472 [28:24<6:38:28,  3.64it/s]
 77%|███████▋  | 284529/371472 [28:24<6:39:20,  3.63it/s]
 77%|███████▋  | 284530/371472 [28:25<7:13:07,  3.35it/s]
 77%|███████▋  | 284531/371472 [28:25<7:08:09,  3.38it/s]
 77%|███████▋  | 284532/371472 [28:25<6:59:20,  3.46it/s]
 77%|███████▋  | 284533/371472 [28:26<7:16:29,  3.32it/s]
 77%|███████▋  | 284534/371472 [28:26<7:00:53,  3.44it/s]
 77%|███████▋  | 284535/371472 [28:26<7:12:01,  3.35it/s]
 77%|███████▋  | 284536/371472 [28:27<6:56:49,  3.48it/s]
 77%|███████▋  | 284537/371472 [28:27<7:07:36,  3.39it/s]
 77%|███████▋  | 284538/371472 [28:27<7:07:43,  3.39it/s]
 77%|███████▋  | 284539/371472 [28:27<6:47:57,  3.55it/s]
 77%|███████▋  | 284540/371472 [28:28<7:01:17,  3.44it/s]
                                                         
{'loss': 2.5552, 'learning_rate': 3.1073175461656146e-07, 'epoch': 12.26}

 77%|███████▋  | 284540/371472 [28:28<7:01:17,  3.44it/s]
 77%|███████▋  | 284541/371472 [28:28<7:11:10,  3.36it/s]
 77%|███████▋  | 284542/371472 [28:28<7:06:57,  3.39it/s]
 77%|███████▋  | 284543/371472 [28:29<6:58:37,  3.46it/s]
 77%|███████▋  | 284544/371472 [28:29<6:43:46,  3.59it/s]
 77%|███████▋  | 284545/371472 [28:29<7:09:46,  3.37it/s]
 77%|███████▋  | 284546/371472 [28:29<6:53:34,  3.50it/s]
 77%|███████▋  | 284547/371472 [28:30<6:58:35,  3.46it/s]
 77%|███████▋  | 284548/371472 [28:30<7:16:36,  3.32it/s]
 77%|███████▋  | 284549/371472 [28:30<6:56:17,  3.48it/s]
 77%|███████▋  | 284550/371472 [28:31<6:58:44,  3.46it/s]
 77%|███████▋  | 284551/371472 [28:31<7:21:05,  3.28it/s]
 77%|███████▋  | 284552/371472 [28:31<6:56:45,  3.48it/s]
 77%|███████▋  | 284553/371472 [28:32<6:50:25,  3.53it/s]
 77%|███████▋  | 284554/371472 [28:32<7:04:50,  3.41it/s]
 77%|███████▋  | 284555/371472 [28:32<6:55:30,  3.49it/s]
 77%|███████▋  | 284556/371472 [28:32<7:07:13,  3.39it/s]
 77%|███████▋  | 284557/371472 [28:33<6:58:39,  3.46it/s]
 77%|███████▋  | 284558/371472 [28:33<6:59:23,  3.45it/s]
 77%|███████▋  | 284559/371472 [28:33<6:45:18,  3.57it/s]
 77%|███████▋  | 284560/371472 [28:34<6:46:02,  3.57it/s]
                                                         
{'loss': 2.5611, 'learning_rate': 3.1068327264108253e-07, 'epoch': 12.26}

 77%|███████▋  | 284560/371472 [28:34<6:46:02,  3.57it/s]
 77%|███████▋  | 284561/371472 [28:34<6:35:02,  3.67it/s]
 77%|███████▋  | 284562/371472 [28:34<6:32:15,  3.69it/s]
 77%|███████▋  | 284563/371472 [28:34<6:49:29,  3.54it/s]
 77%|███████▋  | 284564/371472 [28:35<7:05:32,  3.40it/s]
 77%|███████▋  | 284565/371472 [28:35<7:02:38,  3.43it/s]
 77%|███████▋  | 284566/371472 [28:35<6:58:04,  3.46it/s]
 77%|███████▋  | 284567/371472 [28:35<6:42:54,  3.59it/s]
 77%|███████▋  | 284568/371472 [28:36<6:41:32,  3.61it/s]
 77%|███████▋  | 284569/371472 [28:36<6:43:53,  3.59it/s]
 77%|███████▋  | 284570/371472 [28:36<6:47:15,  3.56it/s]
 77%|███████▋  | 284571/371472 [28:37<6:57:29,  3.47it/s]
 77%|███████▋  | 284572/371472 [28:37<7:02:53,  3.42it/s]
 77%|███████▋  | 284573/371472 [28:37<7:13:11,  3.34it/s]
 77%|███████▋  | 284574/371472 [28:38<6:52:58,  3.51it/s]
 77%|███████▋  | 284575/371472 [28:38<6:43:20,  3.59it/s]
 77%|███████▋  | 284576/371472 [28:38<6:38:09,  3.64it/s]
 77%|███████▋  | 284577/371472 [28:39<8:15:07,  2.93it/s]
 77%|███████▋  | 284578/371472 [28:39<7:59:00,  3.02it/s]
 77%|███████▋  | 284579/371472 [28:39<7:31:01,  3.21it/s]
 77%|███████▋  | 284580/371472 [28:39<7:11:36,  3.36it/s]
                                                         
{'loss': 2.6479, 'learning_rate': 3.106347906656037e-07, 'epoch': 12.26}

 77%|███████▋  | 284580/371472 [28:39<7:11:36,  3.36it/s]
 77%|███████▋  | 284581/371472 [28:40<6:50:23,  3.53it/s]
 77%|███████▋  | 284582/371472 [28:40<6:50:36,  3.53it/s]
 77%|███████▋  | 284583/371472 [28:40<6:45:29,  3.57it/s]
 77%|███████▋  | 284584/371472 [28:40<6:47:38,  3.55it/s]
 77%|███████▋  | 284585/371472 [28:41<6:45:58,  3.57it/s]
 77%|███████▋  | 284586/371472 [28:41<6:45:51,  3.57it/s]
 77%|███████▋  | 284587/371472 [28:41<6:28:01,  3.73it/s]
 77%|███████▋  | 284588/371472 [28:42<6:25:00,  3.76it/s]
 77%|███████▋  | 284589/371472 [28:42<6:27:39,  3.74it/s]
 77%|███████▋  | 284590/371472 [28:42<6:39:18,  3.63it/s]
 77%|███████▋  | 284591/371472 [28:42<6:35:50,  3.66it/s]
 77%|███████▋  | 284592/371472 [28:43<6:47:29,  3.55it/s]
 77%|███████▋  | 284593/371472 [28:43<6:38:26,  3.63it/s]
 77%|███████▋  | 284594/371472 [28:43<6:37:32,  3.64it/s]
 77%|███████▋  | 284595/371472 [28:43<6:26:08,  3.75it/s]
 77%|███████▋  | 284596/371472 [28:44<6:24:27,  3.77it/s]
 77%|███████▋  | 284597/371472 [28:44<6:31:20,  3.70it/s]
 77%|███████▋  | 284598/371472 [28:44<6:27:31,  3.74it/s]
 77%|███████▋  | 284599/371472 [28:45<6:37:19,  3.64it/s]
 77%|███████▋  | 284600/371472 [28:45<7:00:45,  3.44it/s]
                                                         
{'loss': 2.7255, 'learning_rate': 3.1058630869012473e-07, 'epoch': 12.26}

 77%|███████▋  | 284600/371472 [28:45<7:00:45,  3.44it/s]
 77%|███████▋  | 284601/371472 [28:45<6:49:03,  3.54it/s]
 77%|███████▋  | 284602/371472 [28:45<7:12:27,  3.35it/s]
 77%|███████▋  | 284603/371472 [28:46<7:45:57,  3.11it/s]
 77%|███████▋  | 284604/371472 [28:46<8:06:33,  2.98it/s]
 77%|███████▋  | 284605/371472 [28:46<7:32:36,  3.20it/s]
 77%|███████▋  | 284606/371472 [28:47<7:16:21,  3.32it/s]
 77%|███████▋  | 284607/371472 [28:47<7:21:20,  3.28it/s]
 77%|███████▋  | 284608/371472 [28:47<7:44:04,  3.12it/s]
 77%|███████▋  | 284609/371472 [28:48<7:08:46,  3.38it/s]
 77%|███████▋  | 284610/371472 [28:48<6:52:23,  3.51it/s]
 77%|███████▋  | 284611/371472 [28:48<6:49:40,  3.53it/s]
 77%|███████▋  | 284612/371472 [28:48<6:38:49,  3.63it/s]
 77%|███████▋  | 284613/371472 [28:49<6:30:04,  3.71it/s]
 77%|███████▋  | 284614/371472 [28:49<6:32:34,  3.69it/s]
 77%|███████▋  | 284615/371472 [28:49<6:33:12,  3.68it/s]
 77%|███████▋  | 284616/371472 [28:50<6:52:16,  3.51it/s]
 77%|███████▋  | 284617/371472 [28:50<6:49:08,  3.54it/s]
 77%|███████▋  | 284618/371472 [28:50<6:45:55,  3.57it/s]
 77%|███████▋  | 284619/371472 [28:50<6:30:12,  3.71it/s]
 77%|███████▋  | 284620/371472 [28:51<6:19:16,  3.82it/s]
                                                         
{'loss': 2.6212, 'learning_rate': 3.105378267146459e-07, 'epoch': 12.26}

 77%|███████▋  | 284620/371472 [28:51<6:19:16,  3.82it/s]
 77%|███████▋  | 284621/371472 [28:51<6:31:32,  3.70it/s]
 77%|███████▋  | 284622/371472 [28:51<6:22:57,  3.78it/s]
 77%|███████▋  | 284623/371472 [28:51<6:33:29,  3.68it/s]
 77%|███████▋  | 284624/371472 [28:52<6:24:03,  3.77it/s]
 77%|███████▋  | 284625/371472 [28:52<7:07:45,  3.38it/s]
 77%|███████▋  | 284626/371472 [28:52<7:02:15,  3.43it/s]
 77%|███████▋  | 284627/371472 [28:53<6:54:18,  3.49it/s]
 77%|███████▋  | 284628/371472 [28:53<6:34:21,  3.67it/s]
 77%|███████▋  | 284629/371472 [28:53<6:30:21,  3.71it/s]
 77%|███████▋  | 284630/371472 [28:53<7:16:08,  3.32it/s]
 77%|███████▋  | 284631/371472 [28:54<7:00:18,  3.44it/s]
 77%|███████▋  | 284632/371472 [28:54<7:01:33,  3.43it/s]
 77%|███████▋  | 284633/371472 [28:54<6:57:28,  3.47it/s]
 77%|███████▋  | 284634/371472 [28:55<6:44:54,  3.57it/s]
 77%|███████▋  | 284635/371472 [28:55<6:55:39,  3.48it/s]
 77%|███████▋  | 284636/371472 [28:55<7:01:42,  3.43it/s]
 77%|███████▋  | 284637/371472 [28:55<7:03:20,  3.42it/s]
 77%|███████▋  | 284638/371472 [28:56<6:51:24,  3.52it/s]
 77%|███████▋  | 284639/371472 [28:56<6:49:37,  3.53it/s]
 77%|███████▋  | 284640/371472 [28:56<6:53:20,  3.50it/s]
                                                         
{'loss': 2.4974, 'learning_rate': 3.1048934473916693e-07, 'epoch': 12.26}

 77%|███████▋  | 284640/371472 [28:56<6:53:20,  3.50it/s]
 77%|███████▋  | 284641/371472 [28:57<6:50:53,  3.52it/s]
 77%|███████▋  | 284642/371472 [28:57<6:42:26,  3.60it/s]
 77%|███████▋  | 284643/371472 [28:57<6:28:14,  3.73it/s]
 77%|███████▋  | 284644/371472 [28:57<6:40:00,  3.62it/s]
 77%|███████▋  | 284645/371472 [28:58<6:42:55,  3.59it/s]
 77%|███████▋  | 284646/371472 [28:58<6:41:30,  3.60it/s]
 77%|███████▋  | 284647/371472 [28:58<6:37:38,  3.64it/s]
 77%|███████▋  | 284648/371472 [28:59<6:33:03,  3.68it/s]
 77%|███████▋  | 284649/371472 [28:59<6:25:39,  3.75it/s]
 77%|███████▋  | 284650/371472 [28:59<8:26:08,  2.86it/s]
 77%|███████▋  | 284651/371472 [29:00<7:48:14,  3.09it/s]
 77%|███████▋  | 284652/371472 [29:00<7:20:28,  3.29it/s]
 77%|███████▋  | 284653/371472 [29:00<7:07:34,  3.38it/s]
 77%|███████▋  | 284654/371472 [29:00<7:13:05,  3.34it/s]
 77%|███████▋  | 284655/371472 [29:01<7:10:17,  3.36it/s]
 77%|███████▋  | 284656/371472 [29:01<7:13:21,  3.34it/s]
 77%|███████▋  | 284657/371472 [29:01<7:07:15,  3.39it/s]
 77%|███████▋  | 284658/371472 [29:02<7:08:18,  3.38it/s]
 77%|███████▋  | 284659/371472 [29:02<8:00:44,  3.01it/s]
 77%|███████▋  | 284660/371472 [29:02<7:28:22,  3.23it/s]
                                                         
{'loss': 2.6343, 'learning_rate': 3.10440862763688e-07, 'epoch': 12.26}

 77%|███████▋  | 284660/371472 [29:02<7:28:22,  3.23it/s]
 77%|███████▋  | 284661/371472 [29:03<7:11:15,  3.35it/s]
 77%|███████▋  | 284662/371472 [29:03<6:47:53,  3.55it/s]
 77%|███████▋  | 284663/371472 [29:03<6:35:12,  3.66it/s]
 77%|███████▋  | 284664/371472 [29:03<6:31:58,  3.69it/s]
 77%|███████▋  | 284665/371472 [29:04<6:59:42,  3.45it/s]
 77%|███████▋  | 284666/371472 [29:04<7:04:46,  3.41it/s]
 77%|███████▋  | 284667/371472 [29:04<7:01:43,  3.43it/s]
 77%|███████▋  | 284668/371472 [29:04<6:45:42,  3.57it/s]
 77%|███████▋  | 284669/371472 [29:05<6:45:32,  3.57it/s]
 77%|███████▋  | 284670/371472 [29:05<7:07:22,  3.39it/s]
 77%|███████▋  | 284671/371472 [29:05<7:26:49,  3.24it/s]
 77%|███████▋  | 284672/371472 [29:06<7:07:09,  3.39it/s]
 77%|███████▋  | 284673/371472 [29:06<7:07:57,  3.38it/s]
 77%|███████▋  | 284674/371472 [29:06<7:14:35,  3.33it/s]
 77%|███████▋  | 284675/371472 [29:07<7:21:51,  3.27it/s]
 77%|███████▋  | 284676/371472 [29:07<7:04:26,  3.41it/s]
 77%|███████▋  | 284677/371472 [29:07<6:47:51,  3.55it/s]
 77%|███████▋  | 284678/371472 [29:08<7:31:31,  3.20it/s]
 77%|███████▋  | 284679/371472 [29:08<7:06:22,  3.39it/s]
 77%|███████▋  | 284680/371472 [29:08<6:41:30,  3.60it/s]
                                                         
{'loss': 2.6822, 'learning_rate': 3.103923807882092e-07, 'epoch': 12.26}

 77%|███████▋  | 284680/371472 [29:08<6:41:30,  3.60it/s]
 77%|███████▋  | 284681/371472 [29:08<6:29:17,  3.72it/s]
 77%|███████▋  | 284682/371472 [29:09<6:32:31,  3.69it/s]
 77%|███████▋  | 284683/371472 [29:09<6:42:41,  3.59it/s]
 77%|███████▋  | 284684/371472 [29:09<7:18:22,  3.30it/s]
 77%|███████▋  | 284685/371472 [29:09<7:03:28,  3.42it/s]
 77%|███████▋  | 284686/371472 [29:10<6:56:15,  3.47it/s]
 77%|███████▋  | 284687/371472 [29:10<6:41:56,  3.60it/s]
 77%|███████▋  | 284688/371472 [29:10<6:38:19,  3.63it/s]
 77%|███████▋  | 284689/371472 [29:11<6:40:36,  3.61it/s]
 77%|███████▋  | 284690/371472 [29:11<6:29:13,  3.72it/s]
 77%|███████▋  | 284691/371472 [29:11<6:25:34,  3.75it/s]
 77%|███████▋  | 284692/371472 [29:11<6:21:24,  3.79it/s]
 77%|███████▋  | 284693/371472 [29:12<6:26:36,  3.74it/s]
 77%|███████▋  | 284694/371472 [29:12<6:27:55,  3.73it/s]
 77%|███████▋  | 284695/371472 [29:12<6:12:49,  3.88it/s]
 77%|███████▋  | 284696/371472 [29:12<6:17:24,  3.83it/s]
 77%|███████▋  | 284697/371472 [29:13<6:17:33,  3.83it/s]
 77%|███████▋  | 284698/371472 [29:13<6:22:52,  3.78it/s]
 77%|███████▋  | 284699/371472 [29:13<6:34:16,  3.67it/s]
 77%|███████▋  | 284700/371472 [29:13<6:24:53,  3.76it/s]
                                                         
{'loss': 2.6699, 'learning_rate': 3.1034389881273025e-07, 'epoch': 12.26}

 77%|███████▋  | 284700/371472 [29:13<6:24:53,  3.76it/s]
 77%|███████▋  | 284701/371472 [29:14<6:40:10,  3.61it/s]
 77%|███████▋  | 284702/371472 [29:14<6:27:50,  3.73it/s]
 77%|███████▋  | 284703/371472 [29:14<6:37:29,  3.64it/s]
 77%|███████▋  | 284704/371472 [29:15<7:09:51,  3.36it/s]
 77%|███████▋  | 284705/371472 [29:15<7:33:00,  3.19it/s]
 77%|███████▋  | 284706/371472 [29:15<7:15:30,  3.32it/s]
 77%|███████▋  | 284707/371472 [29:16<7:18:43,  3.30it/s]
 77%|███████▋  | 284708/371472 [29:16<7:16:01,  3.32it/s]
 77%|███████▋  | 284709/371472 [29:16<7:49:12,  3.08it/s]
 77%|███████▋  | 284710/371472 [29:17<7:27:17,  3.23it/s]
 77%|███████▋  | 284711/371472 [29:17<7:00:07,  3.44it/s]
 77%|███████▋  | 284712/371472 [29:17<6:59:48,  3.44it/s]
 77%|███████▋  | 284713/371472 [29:17<6:59:01,  3.45it/s]
 77%|███████▋  | 284714/371472 [29:18<6:52:01,  3.51it/s]
 77%|███████▋  | 284715/371472 [29:18<7:03:49,  3.41it/s]
 77%|███████▋  | 284716/371472 [29:18<7:34:53,  3.18it/s]
 77%|███████▋  | 284717/371472 [29:19<8:02:59,  2.99it/s]
 77%|███████▋  | 284718/371472 [29:19<7:30:20,  3.21it/s]
 77%|███████▋  | 284719/371472 [29:19<7:00:17,  3.44it/s]
 77%|███████▋  | 284720/371472 [29:19<6:56:44,  3.47it/s]
                                                         
{'loss': 2.4896, 'learning_rate': 3.102954168372514e-07, 'epoch': 12.26}

 77%|███████▋  | 284720/371472 [29:19<6:56:44,  3.47it/s]
 77%|███████▋  | 284721/371472 [29:20<7:02:41,  3.42it/s]
 77%|███████▋  | 284722/371472 [29:20<6:50:25,  3.52it/s]
 77%|███████▋  | 284723/371472 [29:20<6:46:52,  3.55it/s]
 77%|███████▋  | 284724/371472 [29:21<6:42:47,  3.59it/s]
 77%|███████▋  | 284725/371472 [29:21<6:40:40,  3.61it/s]
 77%|███████▋  | 284726/371472 [29:21<6:50:16,  3.52it/s]
 77%|███████▋  | 284727/371472 [29:22<7:34:19,  3.18it/s]
 77%|███████▋  | 284728/371472 [29:22<7:20:41,  3.28it/s]
 77%|███████▋  | 284729/371472 [29:22<7:30:29,  3.21it/s]
 77%|███████▋  | 284730/371472 [29:22<7:14:18,  3.33it/s]
 77%|███████▋  | 284731/371472 [29:23<7:11:31,  3.35it/s]
 77%|███████▋  | 284732/371472 [29:23<6:51:43,  3.51it/s]
 77%|███████▋  | 284733/371472 [29:23<6:48:07,  3.54it/s]
 77%|███████▋  | 284734/371472 [29:24<7:01:10,  3.43it/s]
 77%|███████▋  | 284735/371472 [29:24<6:52:49,  3.50it/s]
 77%|███████▋  | 284736/371472 [29:24<6:42:05,  3.60it/s]
 77%|███████▋  | 284737/371472 [29:24<6:45:18,  3.57it/s]
 77%|███████▋  | 284738/371472 [29:25<6:30:46,  3.70it/s]
 77%|███████▋  | 284739/371472 [29:25<6:31:05,  3.70it/s]
 77%|███████▋  | 284740/371472 [29:25<6:38:56,  3.62it/s]
                                                         
{'loss': 2.6407, 'learning_rate': 3.1024693486177244e-07, 'epoch': 12.26}

 77%|███████▋  | 284740/371472 [29:25<6:38:56,  3.62it/s]
 77%|███████▋  | 284741/371472 [29:25<6:43:56,  3.58it/s]
 77%|███████▋  | 284742/371472 [29:26<6:30:00,  3.71it/s]
 77%|███████▋  | 284743/371472 [29:26<6:31:48,  3.69it/s]
 77%|███████▋  | 284744/371472 [29:26<6:46:35,  3.56it/s]
 77%|███████▋  | 284745/371472 [29:27<6:50:45,  3.52it/s]
 77%|███████▋  | 284746/371472 [29:27<6:32:09,  3.69it/s]
 77%|███████▋  | 284747/371472 [29:27<6:51:44,  3.51it/s]
 77%|███████▋  | 284748/371472 [29:27<6:37:59,  3.63it/s]
 77%|███████▋  | 284749/371472 [29:28<6:33:29,  3.67it/s]
 77%|███████▋  | 284750/371472 [29:28<6:32:35,  3.68it/s]
 77%|███████▋  | 284751/371472 [29:28<6:27:57,  3.73it/s]
 77%|███████▋  | 284752/371472 [29:28<6:31:14,  3.69it/s]
 77%|███████▋  | 284753/371472 [29:29<6:22:17,  3.78it/s]
 77%|███████▋  | 284754/371472 [29:29<6:24:48,  3.76it/s]
 77%|███████▋  | 284755/371472 [29:29<6:19:17,  3.81it/s]
 77%|███████▋  | 284756/371472 [29:30<6:50:18,  3.52it/s]
 77%|███████▋  | 284757/371472 [29:30<8:05:23,  2.98it/s]
 77%|███████▋  | 284758/371472 [29:30<7:31:11,  3.20it/s]
 77%|███████▋  | 284759/371472 [29:31<7:45:40,  3.10it/s]
 77%|███████▋  | 284760/371472 [29:31<7:36:22,  3.17it/s]
                                                         
{'loss': 2.7113, 'learning_rate': 3.1019845288629357e-07, 'epoch': 12.27}

 77%|███████▋  | 284760/371472 [29:31<7:36:22,  3.17it/s]
 77%|███████▋  | 284761/371472 [29:31<7:20:10,  3.28it/s]
 77%|███████▋  | 284762/371472 [29:32<7:25:16,  3.25it/s]
 77%|███████▋  | 284763/371472 [29:32<7:13:36,  3.33it/s]
 77%|███████▋  | 284764/371472 [29:32<7:14:42,  3.32it/s]
 77%|███████▋  | 284765/371472 [29:32<7:05:10,  3.40it/s]
 77%|███████▋  | 284766/371472 [29:33<6:52:22,  3.50it/s]
 77%|███████▋  | 284767/371472 [29:33<6:48:44,  3.54it/s]
 77%|███████▋  | 284768/371472 [29:33<6:57:40,  3.46it/s]
 77%|███████▋  | 284769/371472 [29:33<6:46:03,  3.56it/s]
 77%|███████▋  | 284770/371472 [29:34<6:37:44,  3.63it/s]
 77%|███████▋  | 284771/371472 [29:34<6:46:27,  3.56it/s]
 77%|███████▋  | 284772/371472 [29:34<6:29:32,  3.71it/s]
 77%|███████▋  | 284773/371472 [29:35<6:32:54,  3.68it/s]
 77%|███████▋  | 284774/371472 [29:35<6:29:54,  3.71it/s]
 77%|███████▋  | 284775/371472 [29:35<6:34:31,  3.66it/s]
 77%|███████▋  | 284776/371472 [29:35<6:45:53,  3.56it/s]
 77%|███████▋  | 284777/371472 [29:36<7:22:39,  3.26it/s]
 77%|███████▋  | 284778/371472 [29:36<7:18:15,  3.30it/s]
 77%|███████▋  | 284779/371472 [29:36<7:31:21,  3.20it/s]
 77%|███████▋  | 284780/371472 [29:37<7:35:49,  3.17it/s]
                                                         
{'loss': 2.6378, 'learning_rate': 3.1014997091081464e-07, 'epoch': 12.27}

 77%|███████▋  | 284780/371472 [29:37<7:35:49,  3.17it/s]
 77%|███████▋  | 284781/371472 [29:37<7:12:53,  3.34it/s]
 77%|███████▋  | 284782/371472 [29:37<6:58:53,  3.45it/s]
 77%|███████▋  | 284783/371472 [29:38<7:01:37,  3.43it/s]
 77%|███████▋  | 284784/371472 [29:38<7:15:30,  3.32it/s]
 77%|███████▋  | 284785/371472 [29:38<6:54:43,  3.48it/s]
 77%|███████▋  | 284786/371472 [29:38<6:50:25,  3.52it/s]
 77%|███████▋  | 284787/371472 [29:39<6:47:52,  3.54it/s]
 77%|███████▋  | 284788/371472 [29:39<6:50:51,  3.52it/s]
 77%|███████▋  | 284789/371472 [29:39<6:54:10,  3.49it/s]
 77%|███████▋  | 284790/371472 [29:40<6:44:44,  3.57it/s]
 77%|███████▋  | 284791/371472 [29:40<6:30:08,  3.70it/s]
 77%|███████▋  | 284792/371472 [29:40<6:23:18,  3.77it/s]
 77%|███████▋  | 284793/371472 [29:40<6:36:56,  3.64it/s]
 77%|███████▋  | 284794/371472 [29:41<6:34:31,  3.66it/s]
 77%|███████▋  | 284795/371472 [29:41<6:25:01,  3.75it/s]
 77%|███████▋  | 284796/371472 [29:41<6:36:04,  3.65it/s]
 77%|███████▋  | 284797/371472 [29:41<6:39:12,  3.62it/s]
 77%|███████▋  | 284798/371472 [29:42<6:43:43,  3.58it/s]
 77%|███████▋  | 284799/371472 [29:42<6:33:54,  3.67it/s]
 77%|███████▋  | 284800/371472 [29:42<7:18:08,  3.30it/s]
                                                         
{'loss': 2.7009, 'learning_rate': 3.101014889353358e-07, 'epoch': 12.27}

 77%|███████▋  | 284800/371472 [29:42<7:18:08,  3.30it/s]
 77%|███████▋  | 284801/371472 [29:43<7:09:16,  3.37it/s]
 77%|███████▋  | 284802/371472 [29:43<6:47:10,  3.55it/s]
 77%|███████▋  | 284803/371472 [29:43<6:56:37,  3.47it/s]
 77%|███████▋  | 284804/371472 [29:43<6:43:29,  3.58it/s]
 77%|███████▋  | 284805/371472 [29:44<6:40:53,  3.60it/s]
 77%|███████▋  | 284806/371472 [29:44<6:29:33,  3.71it/s]
 77%|███████▋  | 284807/371472 [29:44<6:39:12,  3.62it/s]
 77%|███████▋  | 284808/371472 [29:44<6:30:09,  3.70it/s]
 77%|███████▋  | 284809/371472 [29:45<6:40:22,  3.61it/s]
 77%|███████▋  | 284810/371472 [29:45<6:50:19,  3.52it/s]
 77%|███████▋  | 284811/371472 [29:45<6:40:27,  3.61it/s]
 77%|███████▋  | 284812/371472 [29:46<6:26:40,  3.74it/s]
 77%|███████▋  | 284813/371472 [29:46<6:40:17,  3.61it/s]
 77%|███████▋  | 284814/371472 [29:46<6:43:12,  3.58it/s]
 77%|███████▋  | 284815/371472 [29:47<7:01:28,  3.43it/s]
 77%|███████▋  | 284816/371472 [29:47<6:43:12,  3.58it/s]
 77%|███████▋  | 284817/371472 [29:47<7:07:22,  3.38it/s]
 77%|███████▋  | 284818/371472 [29:47<6:53:12,  3.50it/s]
 77%|███████▋  | 284819/371472 [29:48<6:47:49,  3.54it/s]
 77%|███████▋  | 284820/371472 [29:48<6:45:32,  3.56it/s]
                                                         
{'loss': 2.7187, 'learning_rate': 3.100530069598569e-07, 'epoch': 12.27}

 77%|███████▋  | 284820/371472 [29:48<6:45:32,  3.56it/s]
 77%|███████▋  | 284821/371472 [29:48<6:41:02,  3.60it/s]
 77%|███████▋  | 284822/371472 [29:48<6:49:12,  3.53it/s]
 77%|███████▋  | 284823/371472 [29:49<7:03:04,  3.41it/s]
 77%|███████▋  | 284824/371472 [29:49<6:51:11,  3.51it/s]
 77%|███████▋  | 284825/371472 [29:49<6:43:36,  3.58it/s]
 77%|███████▋  | 284826/371472 [29:50<6:29:03,  3.71it/s]
 77%|███████▋  | 284827/371472 [29:50<6:49:34,  3.53it/s]
 77%|███████▋  | 284828/371472 [29:50<6:51:05,  3.51it/s]
 77%|███████▋  | 284829/371472 [29:50<6:58:58,  3.45it/s]
 77%|███████▋  | 284830/371472 [29:51<6:50:37,  3.52it/s]
 77%|███████▋  | 284831/371472 [29:51<6:54:01,  3.49it/s]
 77%|███████▋  | 284832/371472 [29:51<6:40:12,  3.61it/s]
 77%|███████▋  | 284833/371472 [29:52<6:47:45,  3.54it/s]
 77%|███████▋  | 284834/371472 [29:52<7:02:52,  3.41it/s]
 77%|███████▋  | 284835/371472 [29:52<6:49:13,  3.53it/s]
 77%|███████▋  | 284836/371472 [29:52<6:48:59,  3.53it/s]
 77%|███████▋  | 284837/371472 [29:53<6:47:27,  3.54it/s]
 77%|███████▋  | 284838/371472 [29:53<6:58:36,  3.45it/s]
 77%|███████▋  | 284839/371472 [29:53<6:38:00,  3.63it/s]
 77%|███████▋  | 284840/371472 [29:54<6:53:54,  3.49it/s]
                                                         
{'loss': 2.7304, 'learning_rate': 3.1000452498437807e-07, 'epoch': 12.27}

 77%|███████▋  | 284840/371472 [29:54<6:53:54,  3.49it/s]
 77%|███████▋  | 284841/371472 [29:54<6:46:54,  3.55it/s]
 77%|███████▋  | 284842/371472 [29:54<6:46:58,  3.55it/s]
 77%|███████▋  | 284843/371472 [29:54<6:35:09,  3.65it/s]
 77%|███████▋  | 284844/371472 [29:55<6:47:35,  3.54it/s]
 77%|███████▋  | 284845/371472 [29:55<6:39:08,  3.62it/s]
 77%|███████▋  | 284846/371472 [29:55<6:41:45,  3.59it/s]
 77%|███████▋  | 284847/371472 [29:56<6:40:12,  3.61it/s]
 77%|███████▋  | 284848/371472 [29:56<6:44:02,  3.57it/s]
 77%|███████▋  | 284849/371472 [29:56<6:40:03,  3.61it/s]
 77%|███████▋  | 284850/371472 [29:56<7:02:13,  3.42it/s]
 77%|███████▋  | 284851/371472 [29:57<6:51:02,  3.51it/s]
 77%|███████▋  | 284852/371472 [29:57<6:36:53,  3.64it/s]
 77%|███████▋  | 284853/371472 [29:57<6:42:39,  3.59it/s]
 77%|███████▋  | 284854/371472 [29:58<6:50:09,  3.52it/s]
 77%|███████▋  | 284855/371472 [29:58<6:50:57,  3.51it/s]
 77%|███████▋  | 284856/371472 [29:58<6:32:42,  3.68it/s]
 77%|███████▋  | 284857/371472 [29:58<6:26:22,  3.74it/s]
 77%|███████▋  | 284858/371472 [29:59<6:16:56,  3.83it/s]
 77%|███████▋  | 284859/371472 [29:59<6:19:13,  3.81it/s]
 77%|███████▋  | 284860/371472 [29:59<6:41:32,  3.59it/s]
                                                         
{'loss': 2.6793, 'learning_rate': 3.099560430088991e-07, 'epoch': 12.27}

 77%|███████▋  | 284860/371472 [29:59<6:41:32,  3.59it/s]
 77%|███████▋  | 284861/371472 [29:59<6:43:22,  3.58it/s]
 77%|███████▋  | 284862/371472 [30:00<6:59:51,  3.44it/s]
 77%|███████▋  | 284863/371472 [30:00<7:00:07,  3.44it/s]
 77%|███████▋  | 284864/371472 [30:00<7:09:19,  3.36it/s]
 77%|███████▋  | 284865/371472 [30:01<7:43:29,  3.11it/s]
 77%|███████▋  | 284866/371472 [30:01<7:23:56,  3.25it/s]
 77%|███████▋  | 284867/371472 [30:01<7:36:52,  3.16it/s]
 77%|███████▋  | 284868/371472 [30:02<7:15:03,  3.32it/s]
 77%|███████▋  | 284869/371472 [30:02<6:55:20,  3.48it/s]
 77%|███████▋  | 284870/371472 [30:02<6:52:37,  3.50it/s]
 77%|███████▋  | 284871/371472 [30:02<6:38:41,  3.62it/s]
 77%|███████▋  | 284872/371472 [30:03<6:41:17,  3.60it/s]
 77%|███████▋  | 284873/371472 [30:03<6:26:15,  3.74it/s]
 77%|███████▋  | 284874/371472 [30:03<6:50:14,  3.52it/s]
 77%|███████▋  | 284875/371472 [30:04<6:58:19,  3.45it/s]
 77%|███████▋  | 284876/371472 [30:04<6:59:46,  3.44it/s]
 77%|███████▋  | 284877/371472 [30:04<7:06:16,  3.39it/s]
 77%|███████▋  | 284878/371472 [30:04<6:51:05,  3.51it/s]
 77%|███████▋  | 284879/371472 [30:05<6:40:03,  3.61it/s]
 77%|███████▋  | 284880/371472 [30:05<6:51:33,  3.51it/s]
                                                         
{'loss': 2.5475, 'learning_rate': 3.0990756103342026e-07, 'epoch': 12.27}

 77%|███████▋  | 284880/371472 [30:05<6:51:33,  3.51it/s]
 77%|███████▋  | 284881/371472 [30:05<6:46:22,  3.55it/s]
 77%|███████▋  | 284882/371472 [30:06<6:56:31,  3.46it/s]
 77%|███████▋  | 284883/371472 [30:06<6:49:35,  3.52it/s]
 77%|███████▋  | 284884/371472 [30:06<6:55:05,  3.48it/s]
 77%|███████▋  | 284885/371472 [30:06<6:57:07,  3.46it/s]
 77%|███████▋  | 284886/371472 [30:07<6:43:59,  3.57it/s]
 77%|███████▋  | 284887/371472 [30:07<6:31:12,  3.69it/s]
 77%|███████▋  | 284888/371472 [30:07<6:54:11,  3.48it/s]
 77%|███████▋  | 284889/371472 [30:08<7:16:09,  3.31it/s]
 77%|███████▋  | 284890/371472 [30:08<7:10:13,  3.35it/s]
 77%|███████▋  | 284891/371472 [30:08<7:15:34,  3.31it/s]
 77%|███████▋  | 284892/371472 [30:08<7:17:39,  3.30it/s]
 77%|███████▋  | 284893/371472 [30:09<7:20:23,  3.28it/s]
 77%|███████▋  | 284894/371472 [30:09<7:31:14,  3.20it/s]
 77%|███████▋  | 284895/371472 [30:09<7:20:17,  3.28it/s]
 77%|███████▋  | 284896/371472 [30:10<7:25:42,  3.24it/s]
 77%|███████▋  | 284897/371472 [30:10<7:07:38,  3.37it/s]
 77%|███████▋  | 284898/371472 [30:10<6:59:43,  3.44it/s]
 77%|███████▋  | 284899/371472 [30:11<6:45:47,  3.56it/s]
 77%|███████▋  | 284900/371472 [30:11<7:57:38,  3.02it/s]
                                                         
{'loss': 2.5963, 'learning_rate': 3.098590790579413e-07, 'epoch': 12.27}

 77%|███████▋  | 284900/371472 [30:11<7:57:38,  3.02it/s]
 77%|███████▋  | 284901/371472 [30:11<7:34:11,  3.18it/s]
 77%|███████▋  | 284902/371472 [30:12<7:40:45,  3.13it/s]
 77%|███████▋  | 284903/371472 [30:12<8:03:23,  2.98it/s]
 77%|███████▋  | 284904/371472 [30:12<7:36:20,  3.16it/s]
 77%|███████▋  | 284905/371472 [30:12<7:18:24,  3.29it/s]
 77%|███████▋  | 284906/371472 [30:13<7:09:56,  3.36it/s]
 77%|███████▋  | 284907/371472 [30:13<7:00:54,  3.43it/s]
 77%|███████▋  | 284908/371472 [30:13<6:43:28,  3.58it/s]
 77%|███████▋  | 284909/371472 [30:14<6:52:27,  3.50it/s]
 77%|███████▋  | 284910/371472 [30:14<7:07:55,  3.37it/s]
 77%|███████▋  | 284911/371472 [30:14<7:24:49,  3.24it/s]
 77%|███████▋  | 284912/371472 [30:15<7:02:09,  3.42it/s]
 77%|███████▋  | 284913/371472 [30:15<6:46:31,  3.55it/s]
 77%|███████▋  | 284914/371472 [30:15<6:39:52,  3.61it/s]
 77%|███████▋  | 284915/371472 [30:15<6:30:38,  3.69it/s]
 77%|███████▋  | 284916/371472 [30:16<7:02:44,  3.41it/s]
 77%|███████▋  | 284917/371472 [30:16<6:59:53,  3.44it/s]
 77%|███████▋  | 284918/371472 [30:16<7:14:23,  3.32it/s]
 77%|███████▋  | 284919/371472 [30:17<7:13:24,  3.33it/s]
 77%|███████▋  | 284920/371472 [30:17<7:14:53,  3.32it/s]
                                                         
{'loss': 2.8119, 'learning_rate': 3.0981059708246246e-07, 'epoch': 12.27}

 77%|███████▋  | 284920/371472 [30:17<7:14:53,  3.32it/s]
 77%|███████▋  | 284921/371472 [30:17<7:10:18,  3.35it/s]
 77%|███████▋  | 284922/371472 [30:17<6:51:09,  3.51it/s]
 77%|███████▋  | 284923/371472 [30:18<6:55:15,  3.47it/s]
 77%|███████▋  | 284924/371472 [30:18<6:37:46,  3.63it/s]
 77%|███████▋  | 284925/371472 [30:18<6:23:18,  3.76it/s]
 77%|███████▋  | 284926/371472 [30:18<6:21:24,  3.78it/s]
 77%|███████▋  | 284927/371472 [30:19<7:20:02,  3.28it/s]
 77%|███████▋  | 284928/371472 [30:19<6:56:31,  3.46it/s]
 77%|███████▋  | 284929/371472 [30:19<6:44:19,  3.57it/s]
 77%|███████▋  | 284930/371472 [30:20<7:57:30,  3.02it/s]
 77%|███████▋  | 284931/371472 [30:20<7:51:54,  3.06it/s]
 77%|███████▋  | 284932/371472 [30:20<7:25:22,  3.24it/s]
 77%|███████▋  | 284933/371472 [30:21<7:05:58,  3.39it/s]
 77%|███████▋  | 284934/371472 [30:21<7:20:53,  3.27it/s]
 77%|███████▋  | 284935/371472 [30:21<7:08:35,  3.37it/s]
 77%|███████▋  | 284936/371472 [30:22<6:58:05,  3.45it/s]
 77%|███████▋  | 284937/371472 [30:22<7:14:15,  3.32it/s]
 77%|███████▋  | 284938/371472 [30:22<7:00:49,  3.43it/s]
 77%|███████▋  | 284939/371472 [30:22<6:47:10,  3.54it/s]
 77%|███████▋  | 284940/371472 [30:23<6:44:33,  3.56it/s]
                                                         
{'loss': 2.6846, 'learning_rate': 3.0976211510698353e-07, 'epoch': 12.27}

 77%|███████▋  | 284940/371472 [30:23<6:44:33,  3.56it/s]
 77%|███████▋  | 284941/371472 [30:23<6:42:55,  3.58it/s]
 77%|███████▋  | 284942/371472 [30:23<6:41:34,  3.59it/s]
 77%|███████▋  | 284943/371472 [30:24<6:47:32,  3.54it/s]
 77%|███████▋  | 284944/371472 [30:24<6:46:01,  3.55it/s]
 77%|███████▋  | 284945/371472 [30:24<6:38:41,  3.62it/s]
 77%|███████▋  | 284946/371472 [30:24<6:35:46,  3.64it/s]
 77%|███████▋  | 284947/371472 [30:25<6:31:07,  3.69it/s]
 77%|███████▋  | 284948/371472 [30:25<7:01:13,  3.42it/s]
 77%|███████▋  | 284949/371472 [30:25<7:22:03,  3.26it/s]
 77%|███████▋  | 284950/371472 [30:26<7:52:29,  3.05it/s]
 77%|███████▋  | 284951/371472 [30:26<7:21:54,  3.26it/s]
 77%|███████▋  | 284952/371472 [30:26<7:17:02,  3.30it/s]
 77%|███████▋  | 284953/371472 [30:26<7:09:27,  3.36it/s]
 77%|███████▋  | 284954/371472 [30:27<6:49:41,  3.52it/s]
 77%|███████▋  | 284955/371472 [30:27<6:39:04,  3.61it/s]
 77%|███████▋  | 284956/371472 [30:27<6:48:44,  3.53it/s]
 77%|███████▋  | 284957/371472 [30:28<6:49:05,  3.52it/s]
 77%|███████▋  | 284958/371472 [30:28<6:39:43,  3.61it/s]
 77%|███████▋  | 284959/371472 [30:28<6:53:19,  3.49it/s]
 77%|███████▋  | 284960/371472 [30:28<6:59:33,  3.44it/s]
                                                         
{'loss': 2.6876, 'learning_rate': 3.097136331315047e-07, 'epoch': 12.27}

 77%|███████▋  | 284960/371472 [30:28<6:59:33,  3.44it/s]
 77%|███████▋  | 284961/371472 [30:29<7:04:41,  3.40it/s]
 77%|███████▋  | 284962/371472 [30:29<7:01:24,  3.42it/s]
 77%|███████▋  | 284963/371472 [30:29<6:48:43,  3.53it/s]
 77%|███████▋  | 284964/371472 [30:30<6:31:58,  3.68it/s]
 77%|███████▋  | 284965/371472 [30:30<6:38:50,  3.61it/s]
 77%|███████▋  | 284966/371472 [30:30<6:39:14,  3.61it/s]
 77%|███████▋  | 284967/371472 [30:30<6:43:24,  3.57it/s]
 77%|███████▋  | 284968/371472 [30:31<6:41:00,  3.60it/s]
 77%|███████▋  | 284969/371472 [30:31<6:28:49,  3.71it/s]
 77%|███████▋  | 284970/371472 [30:31<6:24:38,  3.75it/s]
 77%|███████▋  | 284971/371472 [30:31<6:26:58,  3.73it/s]
 77%|███████▋  | 284972/371472 [30:32<6:22:35,  3.77it/s]
 77%|███████▋  | 284973/371472 [30:32<6:21:52,  3.78it/s]
 77%|███████▋  | 284974/371472 [30:32<6:16:38,  3.83it/s]
 77%|███████▋  | 284975/371472 [30:32<6:22:37,  3.77it/s]
 77%|███████▋  | 284976/371472 [30:33<6:21:44,  3.78it/s]
 77%|███████▋  | 284977/371472 [30:33<6:17:52,  3.81it/s]
 77%|███████▋  | 284978/371472 [30:33<6:30:54,  3.69it/s]
 77%|███████▋  | 284979/371472 [30:34<6:31:12,  3.68it/s]
 77%|███████▋  | 284980/371472 [30:34<6:38:36,  3.62it/s]
                                                         
{'loss': 2.5761, 'learning_rate': 3.096651511560258e-07, 'epoch': 12.27}

 77%|███████▋  | 284980/371472 [30:34<6:38:36,  3.62it/s]
 77%|███████▋  | 284981/371472 [30:34<6:41:54,  3.59it/s]
 77%|███████▋  | 284982/371472 [30:34<6:32:40,  3.67it/s]
 77%|███████▋  | 284983/371472 [30:35<6:51:52,  3.50it/s]
 77%|███████▋  | 284984/371472 [30:35<6:48:57,  3.52it/s]
 77%|███████▋  | 284985/371472 [30:35<6:48:34,  3.53it/s]
 77%|███████▋  | 284986/371472 [30:36<6:34:31,  3.65it/s]
 77%|███████▋  | 284987/371472 [30:36<6:40:38,  3.60it/s]
 77%|███████▋  | 284988/371472 [30:36<6:48:09,  3.53it/s]
 77%|███████▋  | 284989/371472 [30:36<6:36:58,  3.63it/s]
 77%|███████▋  | 284990/371472 [30:37<6:56:47,  3.46it/s]
 77%|███████▋  | 284991/371472 [30:37<6:45:30,  3.55it/s]
 77%|███████▋  | 284992/371472 [30:37<6:33:34,  3.66it/s]
 77%|███████▋  | 284993/371472 [30:37<6:19:32,  3.80it/s]
 77%|███████▋  | 284994/371472 [30:38<6:31:00,  3.69it/s]
 77%|███████▋  | 284995/371472 [30:38<7:14:45,  3.32it/s]
 77%|███████▋  | 284996/371472 [30:38<7:18:17,  3.29it/s]
 77%|███████▋  | 284997/371472 [30:39<7:30:01,  3.20it/s]
 77%|███████▋  | 284998/371472 [30:39<7:00:19,  3.43it/s]
 77%|███████▋  | 284999/371472 [30:39<7:00:35,  3.43it/s]
 77%|███████▋  | 285000/371472 [30:40<6:52:06,  3.50it/s]
                                                         
{'loss': 2.5684, 'learning_rate': 3.096166691805469e-07, 'epoch': 12.28}

 77%|███████▋  | 285000/371472 [30:40<6:52:06,  3.50it/s]
 77%|███████▋  | 285001/371472 [30:40<6:47:11,  3.54it/s]
 77%|███████▋  | 285002/371472 [30:40<6:35:26,  3.64it/s]
 77%|███████▋  | 285003/371472 [30:40<6:40:23,  3.60it/s]
 77%|███████▋  | 285004/371472 [30:41<6:40:22,  3.60it/s]
 77%|███████▋  | 285005/371472 [30:41<6:54:51,  3.47it/s]
 77%|███████▋  | 285006/371472 [30:41<6:56:32,  3.46it/s]
 77%|███████▋  | 285007/371472 [30:42<6:51:26,  3.50it/s]
 77%|███████▋  | 285008/371472 [30:42<6:37:24,  3.63it/s]
 77%|███████▋  | 285009/371472 [30:42<6:46:27,  3.55it/s]
 77%|███████▋  | 285010/371472 [30:42<7:03:55,  3.40it/s]
 77%|███████▋  | 285011/371472 [30:43<7:34:49,  3.17it/s]
 77%|███████▋  | 285012/371472 [30:43<7:11:43,  3.34it/s]
 77%|███████▋  | 285013/371472 [30:43<6:57:07,  3.45it/s]
 77%|███████▋  | 285014/371472 [30:44<6:39:57,  3.60it/s]
 77%|███████▋  | 285015/371472 [30:44<6:40:03,  3.60it/s]
 77%|███████▋  | 285016/371472 [30:44<6:45:49,  3.55it/s]
 77%|███████▋  | 285017/371472 [30:44<6:43:21,  3.57it/s]
 77%|███████▋  | 285018/371472 [30:45<6:54:52,  3.47it/s]
 77%|███████▋  | 285019/371472 [30:45<7:04:57,  3.39it/s]
 77%|███████▋  | 285020/371472 [30:45<6:59:54,  3.43it/s]
                                                         
{'loss': 2.6118, 'learning_rate': 3.095681872050679e-07, 'epoch': 12.28}

 77%|███████▋  | 285020/371472 [30:45<6:59:54,  3.43it/s]
 77%|███████▋  | 285021/371472 [30:46<6:44:26,  3.56it/s]
 77%|███████▋  | 285022/371472 [30:46<6:30:03,  3.69it/s]
 77%|███████▋  | 285023/371472 [30:46<6:24:37,  3.75it/s]
 77%|███████▋  | 285024/371472 [30:46<6:39:26,  3.61it/s]
 77%|███████▋  | 285025/371472 [30:47<6:29:03,  3.70it/s]
 77%|███████▋  | 285026/371472 [30:47<6:24:38,  3.75it/s]
 77%|███████▋  | 285027/371472 [30:47<6:52:23,  3.49it/s]
 77%|███████▋  | 285028/371472 [30:47<6:45:23,  3.55it/s]
 77%|███████▋  | 285029/371472 [30:48<6:31:10,  3.68it/s]
 77%|███████▋  | 285030/371472 [30:48<6:57:32,  3.45it/s]
 77%|███████▋  | 285031/371472 [30:48<7:45:56,  3.09it/s]
 77%|███████▋  | 285032/371472 [30:49<8:12:24,  2.93it/s]
 77%|███████▋  | 285033/371472 [30:49<7:44:41,  3.10it/s]
 77%|███████▋  | 285034/371472 [30:49<7:33:48,  3.17it/s]
 77%|███████▋  | 285035/371472 [30:50<7:15:38,  3.31it/s]
 77%|███████▋  | 285036/371472 [30:50<7:01:25,  3.42it/s]
 77%|███████▋  | 285037/371472 [30:50<6:56:38,  3.46it/s]
 77%|███████▋  | 285038/371472 [30:51<7:05:16,  3.39it/s]
 77%|███████▋  | 285039/371472 [30:51<6:52:00,  3.50it/s]
 77%|███████▋  | 285040/371472 [30:51<7:13:03,  3.33it/s]
                                                         
{'loss': 2.6284, 'learning_rate': 3.095197052295891e-07, 'epoch': 12.28}

 77%|███████▋  | 285040/371472 [30:51<7:13:03,  3.33it/s]
 77%|███████▋  | 285041/371472 [30:51<7:11:42,  3.34it/s]
 77%|███████▋  | 285042/371472 [30:52<6:49:18,  3.52it/s]
 77%|███████▋  | 285043/371472 [30:52<6:57:10,  3.45it/s]
 77%|███████▋  | 285044/371472 [30:52<6:47:39,  3.53it/s]
 77%|███████▋  | 285045/371472 [30:53<6:33:03,  3.66it/s]
 77%|███████▋  | 285046/371472 [30:53<6:27:06,  3.72it/s]
 77%|███████▋  | 285047/371472 [30:53<6:17:45,  3.81it/s]
 77%|███████▋  | 285048/371472 [30:53<6:18:16,  3.81it/s]
 77%|███████▋  | 285049/371472 [30:54<6:26:52,  3.72it/s]
 77%|███████▋  | 285050/371472 [30:54<6:33:07,  3.66it/s]
 77%|███████▋  | 285051/371472 [30:54<6:42:46,  3.58it/s]
 77%|███████▋  | 285052/371472 [30:54<6:38:01,  3.62it/s]
 77%|███████▋  | 285053/371472 [30:55<6:34:50,  3.65it/s]
 77%|███████▋  | 285054/371472 [30:55<6:41:41,  3.59it/s]
 77%|███████▋  | 285055/371472 [30:55<7:02:12,  3.41it/s]
 77%|███████▋  | 285056/371472 [30:56<6:52:25,  3.49it/s]
 77%|███████▋  | 285057/371472 [30:56<6:35:55,  3.64it/s]
 77%|███████▋  | 285058/371472 [30:56<6:39:36,  3.60it/s]
 77%|███████▋  | 285059/371472 [30:56<6:50:12,  3.51it/s]
 77%|███████▋  | 285060/371472 [30:57<6:45:06,  3.56it/s]
                                                         
{'loss': 2.7455, 'learning_rate': 3.0947122325411017e-07, 'epoch': 12.28}

 77%|███████▋  | 285060/371472 [30:57<6:45:06,  3.56it/s]
 77%|███████▋  | 285061/371472 [30:57<7:30:37,  3.20it/s]
 77%|███████▋  | 285062/371472 [30:57<7:06:51,  3.37it/s]
 77%|███████▋  | 285063/371472 [30:58<7:04:24,  3.39it/s]
 77%|███████▋  | 285064/371472 [30:58<7:04:31,  3.39it/s]
 77%|███████▋  | 285065/371472 [30:58<7:19:44,  3.27it/s]
 77%|███████▋  | 285066/371472 [30:59<7:03:38,  3.40it/s]
 77%|███████▋  | 285067/371472 [30:59<6:51:00,  3.50it/s]
 77%|███████▋  | 285068/371472 [30:59<6:43:06,  3.57it/s]
 77%|███████▋  | 285069/371472 [30:59<6:38:16,  3.62it/s]
 77%|███████▋  | 285070/371472 [31:00<6:30:48,  3.68it/s]
 77%|███████▋  | 285071/371472 [31:00<6:37:47,  3.62it/s]
 77%|███████▋  | 285072/371472 [31:00<6:38:08,  3.62it/s]
 77%|███████▋  | 285073/371472 [31:00<6:31:33,  3.68it/s]
 77%|███████▋  | 285074/371472 [31:01<6:42:15,  3.58it/s]
 77%|███████▋  | 285075/371472 [31:01<6:40:02,  3.60it/s]
 77%|███████▋  | 285076/371472 [31:01<6:33:10,  3.66it/s]
 77%|███████▋  | 285077/371472 [31:01<6:28:10,  3.71it/s]
 77%|███████▋  | 285078/371472 [31:02<6:19:41,  3.79it/s]
 77%|███████▋  | 285079/371472 [31:02<6:43:17,  3.57it/s]
 77%|███████▋  | 285080/371472 [31:02<7:33:44,  3.17it/s]
                                                         
{'loss': 2.676, 'learning_rate': 3.0942274127863135e-07, 'epoch': 12.28}

 77%|███████▋  | 285080/371472 [31:02<7:33:44,  3.17it/s]
 77%|███████▋  | 285081/371472 [31:03<7:37:57,  3.14it/s]
 77%|███████▋  | 285082/371472 [31:03<7:40:15,  3.13it/s]
 77%|███████▋  | 285083/371472 [31:03<7:09:20,  3.35it/s]
 77%|███████▋  | 285084/371472 [31:04<6:42:34,  3.58it/s]
 77%|███████▋  | 285085/371472 [31:04<6:42:32,  3.58it/s]
 77%|███████▋  | 285086/371472 [31:04<6:45:17,  3.55it/s]
 77%|███████▋  | 285087/371472 [31:04<6:50:35,  3.51it/s]
 77%|███████▋  | 285088/371472 [31:05<6:30:16,  3.69it/s]
 77%|███████▋  | 285089/371472 [31:05<6:33:27,  3.66it/s]
 77%|███████▋  | 285090/371472 [31:05<6:33:37,  3.66it/s]
 77%|███████▋  | 285091/371472 [31:06<6:26:56,  3.72it/s]
 77%|███████▋  | 285092/371472 [31:06<6:25:22,  3.74it/s]
 77%|███████▋  | 285093/371472 [31:06<6:44:14,  3.56it/s]
 77%|███████▋  | 285094/371472 [31:06<7:20:24,  3.27it/s]
 77%|███████▋  | 285095/371472 [31:07<7:00:50,  3.42it/s]
 77%|███████▋  | 285096/371472 [31:07<7:10:07,  3.35it/s]
 77%|███████▋  | 285097/371472 [31:07<7:03:15,  3.40it/s]
 77%|███████▋  | 285098/371472 [31:08<6:52:14,  3.49it/s]
 77%|███████▋  | 285099/371472 [31:08<6:43:14,  3.57it/s]
 77%|███████▋  | 285100/371472 [31:08<6:28:53,  3.70it/s]
                                                         
{'loss': 2.7163, 'learning_rate': 3.093742593031524e-07, 'epoch': 12.28}

 77%|███████▋  | 285100/371472 [31:08<6:28:53,  3.70it/s]
 77%|███████▋  | 285101/371472 [31:08<6:30:06,  3.69it/s]
 77%|███████▋  | 285102/371472 [31:09<6:24:12,  3.75it/s]
 77%|███████▋  | 285103/371472 [31:09<6:28:08,  3.71it/s]
 77%|███████▋  | 285104/371472 [31:09<6:45:44,  3.55it/s]
 77%|███████▋  | 285105/371472 [31:10<7:03:54,  3.40it/s]
 77%|███████▋  | 285106/371472 [31:10<6:58:54,  3.44it/s]
 77%|███████▋  | 285107/371472 [31:10<6:40:23,  3.59it/s]
 77%|███████▋  | 285108/371472 [31:10<6:28:30,  3.70it/s]
 77%|███████▋  | 285109/371472 [31:11<6:28:05,  3.71it/s]
 77%|███████▋  | 285110/371472 [31:11<6:53:15,  3.48it/s]
 77%|███████▋  | 285111/371472 [31:11<6:49:47,  3.51it/s]
 77%|███████▋  | 285112/371472 [31:12<7:10:57,  3.34it/s]
 77%|███████▋  | 285113/371472 [31:12<6:47:42,  3.53it/s]
 77%|███████▋  | 285114/371472 [31:12<6:52:03,  3.49it/s]
 77%|███████▋  | 285115/371472 [31:12<6:50:25,  3.51it/s]
 77%|███████▋  | 285116/371472 [31:13<7:30:29,  3.19it/s]
 77%|███████▋  | 285117/371472 [31:13<7:05:48,  3.38it/s]
 77%|███████▋  | 285118/371472 [31:13<7:06:19,  3.38it/s]
 77%|███████▋  | 285119/371472 [31:14<7:06:55,  3.37it/s]
 77%|███████▋  | 285120/371472 [31:14<7:04:24,  3.39it/s]
                                                         
{'loss': 2.5859, 'learning_rate': 3.0932577732767354e-07, 'epoch': 12.28}

 77%|███████▋  | 285120/371472 [31:14<7:04:24,  3.39it/s]
 77%|███████▋  | 285121/371472 [31:14<7:16:07,  3.30it/s]
 77%|███████▋  | 285122/371472 [31:14<7:04:06,  3.39it/s]
 77%|███████▋  | 285123/371472 [31:15<6:48:09,  3.53it/s]
 77%|███████▋  | 285124/371472 [31:15<6:49:09,  3.52it/s]
 77%|███████▋  | 285125/371472 [31:15<6:32:15,  3.67it/s]
 77%|███████▋  | 285126/371472 [31:16<6:27:59,  3.71it/s]
 77%|███████▋  | 285127/371472 [31:16<6:36:37,  3.63it/s]
 77%|███████▋  | 285128/371472 [31:16<6:40:59,  3.59it/s]
 77%|███████▋  | 285129/371472 [31:16<6:29:37,  3.69it/s]
 77%|███████▋  | 285130/371472 [31:17<6:19:00,  3.80it/s]
 77%|███████▋  | 285131/371472 [31:17<6:30:20,  3.69it/s]
 77%|███████▋  | 285132/371472 [31:17<7:27:28,  3.22it/s]
 77%|███████▋  | 285133/371472 [31:18<7:07:53,  3.36it/s]
 77%|███████▋  | 285134/371472 [31:18<7:02:36,  3.40it/s]
 77%|███████▋  | 285135/371472 [31:18<6:49:57,  3.51it/s]
 77%|███████▋  | 285136/371472 [31:18<6:28:55,  3.70it/s]
 77%|███████▋  | 285137/371472 [31:19<6:16:57,  3.82it/s]
 77%|███████▋  | 285138/371472 [31:19<6:14:39,  3.84it/s]
 77%|███████▋  | 285139/371472 [31:19<6:26:02,  3.73it/s]
 77%|███████▋  | 285140/371472 [31:19<6:40:03,  3.60it/s]
                                                         
{'loss': 2.7292, 'learning_rate': 3.0927729535219456e-07, 'epoch': 12.28}

 77%|███████▋  | 285140/371472 [31:19<6:40:03,  3.60it/s]
 77%|███████▋  | 285141/371472 [31:20<6:38:23,  3.61it/s]
 77%|███████▋  | 285142/371472 [31:20<6:27:12,  3.72it/s]
 77%|███████▋  | 285143/371472 [31:20<6:32:30,  3.67it/s]
 77%|███████▋  | 285144/371472 [31:20<6:26:51,  3.72it/s]
 77%|███████▋  | 285145/371472 [31:21<6:11:41,  3.87it/s]
 77%|███████▋  | 285146/371472 [31:21<6:55:56,  3.46it/s]
 77%|███████▋  | 285147/371472 [31:21<6:44:40,  3.56it/s]
 77%|███████▋  | 285148/371472 [31:22<6:40:04,  3.60it/s]
 77%|███████▋  | 285149/371472 [31:22<6:56:21,  3.46it/s]
 77%|███████▋  | 285150/371472 [31:22<6:46:41,  3.54it/s]
 77%|███████▋  | 285151/371472 [31:22<6:38:20,  3.61it/s]
 77%|███████▋  | 285152/371472 [31:23<6:56:57,  3.45it/s]
 77%|███████▋  | 285153/371472 [31:23<7:10:48,  3.34it/s]
 77%|███████▋  | 285154/371472 [31:23<7:07:33,  3.36it/s]
 77%|███████▋  | 285155/371472 [31:24<6:58:06,  3.44it/s]
 77%|███████▋  | 285156/371472 [31:24<6:40:01,  3.60it/s]
 77%|███████▋  | 285157/371472 [31:24<6:37:46,  3.62it/s]
 77%|███████▋  | 285158/371472 [31:25<7:05:56,  3.38it/s]
 77%|███████▋  | 285159/371472 [31:25<7:01:35,  3.41it/s]
 77%|███████▋  | 285160/371472 [31:25<6:49:14,  3.52it/s]
                                                         
{'loss': 2.6502, 'learning_rate': 3.0922881337671574e-07, 'epoch': 12.28}

 77%|███████▋  | 285160/371472 [31:25<6:49:14,  3.52it/s]
 77%|███████▋  | 285161/371472 [31:26<8:06:09,  2.96it/s]
 77%|███████▋  | 285162/371472 [31:26<8:01:38,  2.99it/s]
 77%|███████▋  | 285163/371472 [31:26<8:06:02,  2.96it/s]
 77%|███████▋  | 285164/371472 [31:26<7:44:40,  3.10it/s]
 77%|███████▋  | 285165/371472 [31:27<7:29:36,  3.20it/s]
 77%|███████▋  | 285166/371472 [31:27<7:06:10,  3.38it/s]
 77%|███████▋  | 285167/371472 [31:27<6:45:45,  3.55it/s]
 77%|███████▋  | 285168/371472 [31:28<7:09:11,  3.35it/s]
 77%|███████▋  | 285169/371472 [31:28<7:12:54,  3.32it/s]
 77%|███████▋  | 285170/371472 [31:28<7:15:37,  3.30it/s]
 77%|███████▋  | 285171/371472 [31:29<7:01:03,  3.42it/s]
 77%|███████▋  | 285172/371472 [31:29<6:43:57,  3.56it/s]
 77%|███████▋  | 285173/371472 [31:29<6:42:55,  3.57it/s]
 77%|███████▋  | 285174/371472 [31:29<7:00:30,  3.42it/s]
 77%|███████▋  | 285175/371472 [31:30<7:11:01,  3.34it/s]
 77%|███████▋  | 285176/371472 [31:30<7:05:49,  3.38it/s]
 77%|███████▋  | 285177/371472 [31:30<7:08:12,  3.36it/s]
 77%|███████▋  | 285178/371472 [31:31<6:51:43,  3.49it/s]
 77%|███████▋  | 285179/371472 [31:31<6:42:12,  3.58it/s]
 77%|███████▋  | 285180/371472 [31:31<7:13:43,  3.32it/s]
                                                         
{'loss': 2.6488, 'learning_rate': 3.0918033140123676e-07, 'epoch': 12.28}

 77%|███████▋  | 285180/371472 [31:31<7:13:43,  3.32it/s]
 77%|███████▋  | 285181/371472 [31:31<6:58:26,  3.44it/s]
 77%|███████▋  | 285182/371472 [31:32<7:06:09,  3.37it/s]
 77%|███████▋  | 285183/371472 [31:32<6:52:24,  3.49it/s]
 77%|███████▋  | 285184/371472 [31:32<6:44:27,  3.56it/s]
 77%|███████▋  | 285185/371472 [31:33<6:42:12,  3.58it/s]
 77%|███████▋  | 285186/371472 [31:33<6:36:40,  3.63it/s]
 77%|███████▋  | 285187/371472 [31:33<6:52:25,  3.49it/s]
 77%|███████▋  | 285188/371472 [31:33<6:54:47,  3.47it/s]
 77%|███████▋  | 285189/371472 [31:34<6:42:59,  3.57it/s]
 77%|███████▋  | 285190/371472 [31:34<7:14:03,  3.31it/s]
 77%|███████▋  | 285191/371472 [31:34<7:20:48,  3.26it/s]
 77%|███████▋  | 285192/371472 [31:35<7:10:44,  3.34it/s]
 77%|███████▋  | 285193/371472 [31:35<6:53:55,  3.47it/s]
 77%|███████▋  | 285194/371472 [31:35<6:32:13,  3.67it/s]
 77%|███████▋  | 285195/371472 [31:35<6:51:23,  3.50it/s]
 77%|███████▋  | 285196/371472 [31:36<7:38:28,  3.14it/s]
 77%|███████▋  | 285197/371472 [31:36<7:57:51,  3.01it/s]
 77%|███████▋  | 285198/371472 [31:36<7:37:56,  3.14it/s]
 77%|███████▋  | 285199/371472 [31:37<7:12:15,  3.33it/s]
 77%|███████▋  | 285200/371472 [31:37<7:09:08,  3.35it/s]
                                                         
{'loss': 2.6687, 'learning_rate': 3.091318494257579e-07, 'epoch': 12.28}

 77%|███████▋  | 285200/371472 [31:37<7:09:08,  3.35it/s]
 77%|███████▋  | 285201/371472 [31:37<6:57:00,  3.45it/s]
 77%|███████▋  | 285202/371472 [31:38<7:04:01,  3.39it/s]
 77%|███████▋  | 285203/371472 [31:38<7:02:09,  3.41it/s]
 77%|███████▋  | 285204/371472 [31:38<6:59:32,  3.43it/s]
 77%|███████▋  | 285205/371472 [31:38<7:05:49,  3.38it/s]
 77%|███████▋  | 285206/371472 [31:39<7:18:27,  3.28it/s]
 77%|███████▋  | 285207/371472 [31:39<6:54:55,  3.47it/s]
 77%|███████▋  | 285208/371472 [31:39<6:45:22,  3.55it/s]
 77%|███████▋  | 285209/371472 [31:40<6:56:55,  3.45it/s]
 77%|███████▋  | 285210/371472 [31:40<6:49:46,  3.51it/s]
 77%|███████▋  | 285211/371472 [31:40<6:31:29,  3.67it/s]
 77%|███████▋  | 285212/371472 [31:40<6:23:09,  3.75it/s]
 77%|███████▋  | 285213/371472 [31:41<6:23:36,  3.75it/s]
 77%|███████▋  | 285214/371472 [31:41<6:40:27,  3.59it/s]
 77%|███████▋  | 285215/371472 [31:41<6:56:15,  3.45it/s]
 77%|███████▋  | 285216/371472 [31:42<6:38:59,  3.60it/s]
 77%|███████▋  | 285217/371472 [31:42<6:37:21,  3.62it/s]
 77%|███████▋  | 285218/371472 [31:42<6:41:19,  3.58it/s]
 77%|███████▋  | 285219/371472 [31:42<6:51:57,  3.49it/s]
 77%|███████▋  | 285220/371472 [31:43<6:36:22,  3.63it/s]
                                                         
{'loss': 2.8292, 'learning_rate': 3.0908336745027906e-07, 'epoch': 12.28}

 77%|███████▋  | 285220/371472 [31:43<6:36:22,  3.63it/s]
 77%|███████▋  | 285221/371472 [31:43<6:29:18,  3.69it/s]
 77%|███████▋  | 285222/371472 [31:43<7:18:50,  3.28it/s]
 77%|███████▋  | 285223/371472 [31:44<6:56:10,  3.45it/s]
 77%|███████▋  | 285224/371472 [31:44<6:34:04,  3.65it/s]
 77%|███████▋  | 285225/371472 [31:44<6:57:49,  3.44it/s]
 77%|███████▋  | 285226/371472 [31:44<6:38:41,  3.61it/s]
 77%|███████▋  | 285227/371472 [31:45<6:41:03,  3.58it/s]
 77%|███████▋  | 285228/371472 [31:45<7:02:31,  3.40it/s]
 77%|███████▋  | 285229/371472 [31:45<8:04:29,  2.97it/s]
 77%|███████▋  | 285230/371472 [31:46<7:41:48,  3.11it/s]
 77%|███████▋  | 285231/371472 [31:46<7:29:37,  3.20it/s]
 77%|███████▋  | 285232/371472 [31:46<7:14:37,  3.31it/s]
 77%|███████▋  | 285233/371472 [31:47<7:09:44,  3.34it/s]
 77%|███████▋  | 285234/371472 [31:47<7:11:14,  3.33it/s]
 77%|███████▋  | 285235/371472 [31:47<6:56:26,  3.45it/s]
 77%|███████▋  | 285236/371472 [31:47<6:43:21,  3.56it/s]
 77%|███████▋  | 285237/371472 [31:48<6:43:34,  3.56it/s]
 77%|███████▋  | 285238/371472 [31:48<7:04:43,  3.38it/s]
 77%|███████▋  | 285239/371472 [31:48<7:09:59,  3.34it/s]
 77%|███████▋  | 285240/371472 [31:49<7:02:06,  3.40it/s]
                                                         
{'loss': 2.5875, 'learning_rate': 3.090348854748001e-07, 'epoch': 12.29}

 77%|███████▋  | 285240/371472 [31:49<7:02:06,  3.40it/s]
 77%|███████▋  | 285241/371472 [31:49<6:49:25,  3.51it/s]
 77%|███████▋  | 285242/371472 [31:49<7:05:04,  3.38it/s]
 77%|███████▋  | 285243/371472 [31:49<7:05:46,  3.38it/s]
 77%|███████▋  | 285244/371472 [31:50<6:43:37,  3.56it/s]
 77%|███████▋  | 285245/371472 [31:50<6:42:46,  3.57it/s]
 77%|███████▋  | 285246/371472 [31:50<6:57:45,  3.44it/s]
 77%|███████▋  | 285247/371472 [31:51<6:52:28,  3.48it/s]
 77%|███████▋  | 285248/371472 [31:51<7:00:03,  3.42it/s]
 77%|███████▋  | 285249/371472 [31:51<7:05:21,  3.38it/s]
 77%|███████▋  | 285250/371472 [31:51<6:51:07,  3.50it/s]
 77%|███████▋  | 285251/371472 [31:52<6:41:35,  3.58it/s]
 77%|███████▋  | 285252/371472 [31:52<7:17:41,  3.28it/s]
 77%|███████▋  | 285253/371472 [31:52<7:05:36,  3.38it/s]
 77%|███████▋  | 285254/371472 [31:53<7:08:41,  3.35it/s]
 77%|███████▋  | 285255/371472 [31:53<6:46:05,  3.54it/s]
 77%|███████▋  | 285256/371472 [31:53<6:41:22,  3.58it/s]
 77%|███████▋  | 285257/371472 [31:54<6:58:58,  3.43it/s]
 77%|███████▋  | 285258/371472 [31:54<6:48:25,  3.52it/s]
 77%|███████▋  | 285259/371472 [31:54<6:50:56,  3.50it/s]
 77%|███████▋  | 285260/371472 [31:54<6:43:42,  3.56it/s]
                                                         
{'loss': 2.6252, 'learning_rate': 3.0898640349932125e-07, 'epoch': 12.29}

 77%|███████▋  | 285260/371472 [31:54<6:43:42,  3.56it/s]
 77%|███████▋  | 285261/371472 [31:55<6:42:47,  3.57it/s]
 77%|███████▋  | 285262/371472 [31:55<6:43:10,  3.56it/s]
 77%|███████▋  | 285263/371472 [31:55<6:47:10,  3.53it/s]
 77%|███████▋  | 285264/371472 [31:55<6:43:48,  3.56it/s]
 77%|███████▋  | 285265/371472 [31:56<6:38:39,  3.60it/s]
 77%|███████▋  | 285266/371472 [31:56<6:39:34,  3.60it/s]
 77%|███████▋  | 285267/371472 [31:56<6:43:55,  3.56it/s]
 77%|███████▋  | 285268/371472 [31:57<7:47:06,  3.08it/s]
 77%|███████▋  | 285269/371472 [31:57<7:41:49,  3.11it/s]
 77%|███████▋  | 285270/371472 [31:57<7:25:08,  3.23it/s]
 77%|███████▋  | 285271/371472 [31:58<7:25:08,  3.23it/s]
 77%|███████▋  | 285272/371472 [31:58<7:08:04,  3.36it/s]
 77%|███████▋  | 285273/371472 [31:58<6:54:33,  3.47it/s]
 77%|███████▋  | 285274/371472 [31:58<6:54:27,  3.47it/s]
 77%|███████▋  | 285275/371472 [31:59<7:11:02,  3.33it/s]
 77%|███████▋  | 285276/371472 [31:59<7:02:32,  3.40it/s]
 77%|███████▋  | 285277/371472 [31:59<7:25:41,  3.22it/s]
 77%|███████▋  | 285278/371472 [32:00<7:29:50,  3.19it/s]
 77%|███████▋  | 285279/371472 [32:00<7:13:08,  3.32it/s]
 77%|███████▋  | 285280/371472 [32:00<7:30:58,  3.19it/s]
                                                         
{'loss': 2.6112, 'learning_rate': 3.0893792152384227e-07, 'epoch': 12.29}

 77%|███████▋  | 285280/371472 [32:00<7:30:58,  3.19it/s]
 77%|███████▋  | 285281/371472 [32:01<7:04:27,  3.38it/s]
 77%|███████▋  | 285282/371472 [32:01<6:54:47,  3.46it/s]
 77%|███████▋  | 285283/371472 [32:01<6:52:43,  3.48it/s]
 77%|███████▋  | 285284/371472 [32:01<6:39:57,  3.59it/s]
 77%|███████▋  | 285285/371472 [32:02<6:40:35,  3.59it/s]
 77%|███████▋  | 285286/371472 [32:02<6:55:17,  3.46it/s]
 77%|███████▋  | 285287/371472 [32:02<6:44:24,  3.55it/s]
 77%|███████▋  | 285288/371472 [32:03<6:37:38,  3.61it/s]
 77%|███████▋  | 285289/371472 [32:03<6:36:43,  3.62it/s]
 77%|███████▋  | 285290/371472 [32:03<6:27:31,  3.71it/s]
 77%|███████▋  | 285291/371472 [32:03<6:14:06,  3.84it/s]
 77%|███████▋  | 285292/371472 [32:04<6:14:58,  3.83it/s]
 77%|███████▋  | 285293/371472 [32:04<6:38:20,  3.61it/s]
 77%|███████▋  | 285294/371472 [32:04<6:39:11,  3.60it/s]
 77%|███████▋  | 285295/371472 [32:04<6:38:54,  3.60it/s]
 77%|███████▋  | 285296/371472 [32:05<6:29:21,  3.69it/s]
 77%|███████▋  | 285297/371472 [32:05<6:35:17,  3.63it/s]
 77%|███████▋  | 285298/371472 [32:05<6:39:13,  3.60it/s]
 77%|███████▋  | 285299/371472 [32:06<6:28:09,  3.70it/s]
 77%|███████▋  | 285300/371472 [32:06<6:37:29,  3.61it/s]
                                                         
{'loss': 2.625, 'learning_rate': 3.0888943954836345e-07, 'epoch': 12.29}

 77%|███████▋  | 285300/371472 [32:06<6:37:29,  3.61it/s]
 77%|███████▋  | 285301/371472 [32:06<6:45:17,  3.54it/s]
 77%|███████▋  | 285302/371472 [32:07<7:40:50,  3.12it/s]
 77%|███████▋  | 285303/371472 [32:07<7:37:19,  3.14it/s]
 77%|███████▋  | 285304/371472 [32:07<7:29:10,  3.20it/s]
 77%|███████▋  | 285305/371472 [32:07<7:03:23,  3.39it/s]
 77%|███████▋  | 285306/371472 [32:08<7:08:48,  3.35it/s]
 77%|███████▋  | 285307/371472 [32:08<6:59:34,  3.42it/s]
 77%|███████▋  | 285308/371472 [32:08<7:00:42,  3.41it/s]
 77%|███████▋  | 285309/371472 [32:09<6:55:42,  3.45it/s]
 77%|███████▋  | 285310/371472 [32:09<6:57:03,  3.44it/s]
 77%|███████▋  | 285311/371472 [32:09<6:41:15,  3.58it/s]
 77%|███████▋  | 285312/371472 [32:09<6:40:05,  3.59it/s]
 77%|███████▋  | 285313/371472 [32:10<6:45:51,  3.54it/s]
 77%|███████▋  | 285314/371472 [32:10<7:04:24,  3.38it/s]
 77%|███████▋  | 285315/371472 [32:10<6:59:33,  3.42it/s]
 77%|███████▋  | 285316/371472 [32:11<7:20:00,  3.26it/s]
 77%|███████▋  | 285317/371472 [32:11<7:08:43,  3.35it/s]
 77%|███████▋  | 285318/371472 [32:11<7:10:34,  3.33it/s]
 77%|███████▋  | 285319/371472 [32:11<6:56:36,  3.45it/s]
 77%|███████▋  | 285320/371472 [32:12<6:45:35,  3.54it/s]
                                                         
{'loss': 2.6753, 'learning_rate': 3.088409575728845e-07, 'epoch': 12.29}

 77%|███████▋  | 285320/371472 [32:12<6:45:35,  3.54it/s]
 77%|███████▋  | 285321/371472 [32:12<7:08:29,  3.35it/s]
 77%|███████▋  | 285322/371472 [32:12<6:54:58,  3.46it/s]
 77%|███████▋  | 285323/371472 [32:13<7:28:52,  3.20it/s]
 77%|███████▋  | 285324/371472 [32:13<7:25:32,  3.22it/s]
 77%|███████▋  | 285325/371472 [32:13<6:59:03,  3.43it/s]
 77%|███████▋  | 285326/371472 [32:14<6:51:12,  3.49it/s]
 77%|███████▋  | 285327/371472 [32:14<6:44:57,  3.55it/s]
 77%|███████▋  | 285328/371472 [32:14<6:35:14,  3.63it/s]
 77%|███████▋  | 285329/371472 [32:14<6:49:27,  3.51it/s]
 77%|███████▋  | 285330/371472 [32:15<7:14:17,  3.31it/s]
 77%|███████▋  | 285331/371472 [32:15<6:51:59,  3.48it/s]
 77%|███████▋  | 285332/371472 [32:15<6:49:56,  3.50it/s]
 77%|███████▋  | 285333/371472 [32:16<6:53:14,  3.47it/s]
 77%|███████▋  | 285334/371472 [32:16<6:43:42,  3.56it/s]
 77%|███████▋  | 285335/371472 [32:16<7:25:45,  3.22it/s]
 77%|███████▋  | 285336/371472 [32:17<7:35:12,  3.15it/s]
 77%|███████▋  | 285337/371472 [32:17<7:12:11,  3.32it/s]
 77%|███████▋  | 285338/371472 [32:17<6:54:34,  3.46it/s]
 77%|███████▋  | 285339/371472 [32:17<6:40:34,  3.58it/s]
 77%|███████▋  | 285340/371472 [32:18<6:35:05,  3.63it/s]
                                                         
{'loss': 2.6782, 'learning_rate': 3.087924755974057e-07, 'epoch': 12.29}

 77%|███████▋  | 285340/371472 [32:18<6:35:05,  3.63it/s]
 77%|███████▋  | 285341/371472 [32:18<6:42:15,  3.57it/s]
 77%|███████▋  | 285342/371472 [32:18<6:25:08,  3.73it/s]
 77%|███████▋  | 285343/371472 [32:18<6:24:35,  3.73it/s]
 77%|███████▋  | 285344/371472 [32:19<6:28:21,  3.70it/s]
 77%|███████▋  | 285345/371472 [32:19<6:22:22,  3.75it/s]
 77%|███████▋  | 285346/371472 [32:19<6:18:00,  3.80it/s]
 77%|███████▋  | 285347/371472 [32:19<6:09:42,  3.88it/s]
 77%|███████▋  | 285348/371472 [32:20<6:15:13,  3.83it/s]
 77%|███████▋  | 285349/371472 [32:20<6:24:20,  3.73it/s]
 77%|███████▋  | 285350/371472 [32:20<6:23:04,  3.75it/s]
 77%|███████▋  | 285351/371472 [32:20<6:25:56,  3.72it/s]
 77%|███████▋  | 285352/371472 [32:21<6:14:55,  3.83it/s]
 77%|███████▋  | 285353/371472 [32:21<6:47:30,  3.52it/s]
 77%|███████▋  | 285354/371472 [32:21<6:41:55,  3.57it/s]
 77%|███████▋  | 285355/371472 [32:22<6:41:26,  3.58it/s]
 77%|███████▋  | 285356/371472 [32:22<7:00:01,  3.42it/s]
 77%|███████▋  | 285357/371472 [32:22<6:55:32,  3.45it/s]
 77%|███████▋  | 285358/371472 [32:22<6:38:33,  3.60it/s]
 77%|███████▋  | 285359/371472 [32:23<6:29:57,  3.68it/s]
 77%|███████▋  | 285360/371472 [32:23<6:20:59,  3.77it/s]
                                                         
{'loss': 2.6865, 'learning_rate': 3.0874399362192677e-07, 'epoch': 12.29}

 77%|███████▋  | 285360/371472 [32:23<6:20:59,  3.77it/s]
 77%|███████▋  | 285361/371472 [32:23<6:24:24,  3.73it/s]
 77%|███████▋  | 285362/371472 [32:24<6:19:22,  3.78it/s]
 77%|███████▋  | 285363/371472 [32:24<6:23:09,  3.75it/s]
 77%|███████▋  | 285364/371472 [32:24<6:58:20,  3.43it/s]
 77%|███████▋  | 285365/371472 [32:24<6:42:41,  3.56it/s]
 77%|███████▋  | 285366/371472 [32:25<7:07:36,  3.36it/s]
 77%|███████▋  | 285367/371472 [32:25<6:43:18,  3.56it/s]
 77%|███████▋  | 285368/371472 [32:25<6:31:14,  3.67it/s]
 77%|███████▋  | 285369/371472 [32:26<6:40:54,  3.58it/s]
 77%|███████▋  | 285370/371472 [32:26<7:05:21,  3.37it/s]
 77%|███████▋  | 285371/371472 [32:26<6:56:49,  3.44it/s]
 77%|███████▋  | 285372/371472 [32:26<6:46:48,  3.53it/s]
 77%|███████▋  | 285373/371472 [32:27<7:02:51,  3.39it/s]
 77%|███████▋  | 285374/371472 [32:27<6:43:53,  3.55it/s]
 77%|███████▋  | 285375/371472 [32:27<6:44:31,  3.55it/s]
 77%|███████▋  | 285376/371472 [32:28<6:48:35,  3.51it/s]
 77%|███████▋  | 285377/371472 [32:28<6:49:55,  3.50it/s]
 77%|███████▋  | 285378/371472 [32:28<7:04:50,  3.38it/s]
 77%|███████▋  | 285379/371472 [32:28<6:51:01,  3.49it/s]
 77%|███████▋  | 285380/371472 [32:29<6:39:40,  3.59it/s]
                                                         
{'loss': 2.6781, 'learning_rate': 3.086955116464479e-07, 'epoch': 12.29}

 77%|███████▋  | 285380/371472 [32:29<6:39:40,  3.59it/s]
 77%|███████▋  | 285381/371472 [32:29<6:26:48,  3.71it/s]
 77%|███████▋  | 285382/371472 [32:29<6:33:32,  3.65it/s]
 77%|███████▋  | 285383/371472 [32:30<6:58:19,  3.43it/s]
 77%|███████▋  | 285384/371472 [32:30<6:50:15,  3.50it/s]
 77%|███████▋  | 285385/371472 [32:30<6:46:06,  3.53it/s]
 77%|███████▋  | 285386/371472 [32:30<7:24:12,  3.23it/s]
 77%|███████▋  | 285387/371472 [32:31<7:04:51,  3.38it/s]
 77%|███████▋  | 285388/371472 [32:31<6:46:46,  3.53it/s]
 77%|███████▋  | 285389/371472 [32:31<6:44:31,  3.55it/s]
 77%|███████▋  | 285390/371472 [32:32<6:34:10,  3.64it/s]
 77%|███████▋  | 285391/371472 [32:32<6:27:56,  3.70it/s]
 77%|███████▋  | 285392/371472 [32:32<6:58:48,  3.43it/s]
 77%|███████▋  | 285393/371472 [32:32<6:53:33,  3.47it/s]
 77%|███████▋  | 285394/371472 [32:33<7:15:10,  3.30it/s]
 77%|███████▋  | 285395/371472 [32:33<7:13:25,  3.31it/s]
 77%|███████▋  | 285396/371472 [32:33<7:19:27,  3.26it/s]
 77%|███████▋  | 285397/371472 [32:34<7:04:34,  3.38it/s]
 77%|███████▋  | 285398/371472 [32:34<7:26:05,  3.22it/s]
 77%|███████▋  | 285399/371472 [32:34<7:12:06,  3.32it/s]
 77%|███████▋  | 285400/371472 [32:34<6:51:13,  3.49it/s]
                                                         
{'loss': 2.5961, 'learning_rate': 3.086470296709689e-07, 'epoch': 12.29}

 77%|███████▋  | 285400/371472 [32:34<6:51:13,  3.49it/s]
 77%|███████▋  | 285401/371472 [32:35<6:55:02,  3.46it/s]
 77%|███████▋  | 285402/371472 [32:35<6:57:31,  3.44it/s]
 77%|███████▋  | 285403/371472 [32:35<6:41:37,  3.57it/s]
 77%|███████▋  | 285404/371472 [32:36<6:42:52,  3.56it/s]
 77%|███████▋  | 285405/371472 [32:36<6:30:33,  3.67it/s]
 77%|███████▋  | 285406/371472 [32:36<6:34:39,  3.63it/s]
 77%|███████▋  | 285407/371472 [32:36<6:31:58,  3.66it/s]
 77%|███████▋  | 285408/371472 [32:37<6:30:10,  3.68it/s]
 77%|███████▋  | 285409/371472 [32:37<6:37:21,  3.61it/s]
 77%|███████▋  | 285410/371472 [32:37<6:39:28,  3.59it/s]
 77%|███████▋  | 285411/371472 [32:38<6:47:46,  3.52it/s]
 77%|███████▋  | 285412/371472 [32:38<6:46:35,  3.53it/s]
 77%|███████▋  | 285413/371472 [32:38<7:11:36,  3.32it/s]
 77%|███████▋  | 285414/371472 [32:38<6:56:05,  3.45it/s]
 77%|███████▋  | 285415/371472 [32:39<7:18:08,  3.27it/s]
 77%|███████▋  | 285416/371472 [32:39<7:06:10,  3.37it/s]
 77%|███████▋  | 285417/371472 [32:39<7:07:21,  3.36it/s]
 77%|███████▋  | 285418/371472 [32:40<6:43:42,  3.55it/s]
 77%|███████▋  | 285419/371472 [32:40<6:31:24,  3.66it/s]
 77%|███████▋  | 285420/371472 [32:40<7:06:00,  3.37it/s]
                                                         
{'loss': 2.6303, 'learning_rate': 3.085985476954901e-07, 'epoch': 12.29}

 77%|███████▋  | 285420/371472 [32:40<7:06:00,  3.37it/s]
 77%|███████▋  | 285421/371472 [32:41<7:08:51,  3.34it/s]
 77%|███████▋  | 285422/371472 [32:41<7:16:31,  3.29it/s]
 77%|███████▋  | 285423/371472 [32:41<7:25:50,  3.22it/s]
 77%|███████▋  | 285424/371472 [32:41<7:18:48,  3.27it/s]
 77%|███████▋  | 285425/371472 [32:42<7:11:38,  3.32it/s]
 77%|███████▋  | 285426/371472 [32:42<7:11:31,  3.32it/s]
 77%|███████▋  | 285427/371472 [32:42<7:15:29,  3.29it/s]
 77%|███████▋  | 285428/371472 [32:43<7:22:46,  3.24it/s]
 77%|███████▋  | 285429/371472 [32:43<7:03:03,  3.39it/s]
 77%|███████▋  | 285430/371472 [32:43<6:51:25,  3.49it/s]
 77%|███████▋  | 285431/371472 [32:43<6:43:45,  3.55it/s]
 77%|███████▋  | 285432/371472 [32:44<7:24:57,  3.22it/s]
 77%|███████▋  | 285433/371472 [32:44<7:12:01,  3.32it/s]
 77%|███████▋  | 285434/371472 [32:44<6:57:43,  3.43it/s]
 77%|███████▋  | 285435/371472 [32:45<7:01:55,  3.40it/s]
 77%|███████▋  | 285436/371472 [32:45<6:54:18,  3.46it/s]
 77%|███████▋  | 285437/371472 [32:45<6:46:14,  3.53it/s]
 77%|███████▋  | 285438/371472 [32:46<6:34:01,  3.64it/s]
 77%|███████▋  | 285439/371472 [32:46<6:31:05,  3.67it/s]
 77%|███████▋  | 285440/371472 [32:46<7:09:00,  3.34it/s]
                                                         
{'loss': 2.558, 'learning_rate': 3.0855006572001116e-07, 'epoch': 12.29}

 77%|███████▋  | 285440/371472 [32:46<7:09:00,  3.34it/s]
 77%|███████▋  | 285441/371472 [32:46<6:51:42,  3.48it/s]
 77%|███████▋  | 285442/371472 [32:47<7:06:02,  3.37it/s]
 77%|███████▋  | 285443/371472 [32:47<6:53:06,  3.47it/s]
 77%|███████▋  | 285444/371472 [32:47<7:02:00,  3.40it/s]
 77%|███████▋  | 285445/371472 [32:48<6:50:14,  3.49it/s]
 77%|███████▋  | 285446/371472 [32:48<6:34:03,  3.64it/s]
 77%|███████▋  | 285447/371472 [32:48<6:25:06,  3.72it/s]
 77%|███████▋  | 285448/371472 [32:48<6:38:41,  3.60it/s]
 77%|███████▋  | 285449/371472 [32:49<6:36:32,  3.62it/s]
 77%|███████▋  | 285450/371472 [32:49<6:50:29,  3.49it/s]
 77%|███████▋  | 285451/371472 [32:49<7:01:52,  3.40it/s]
 77%|███████▋  | 285452/371472 [32:50<6:45:10,  3.54it/s]
 77%|███████▋  | 285453/371472 [32:50<6:43:53,  3.55it/s]
 77%|███████▋  | 285454/371472 [32:50<6:37:34,  3.61it/s]
 77%|███████▋  | 285455/371472 [32:50<7:04:01,  3.38it/s]
 77%|███████▋  | 285456/371472 [32:51<6:56:32,  3.44it/s]
 77%|███████▋  | 285457/371472 [32:51<6:58:37,  3.42it/s]
 77%|███████▋  | 285458/371472 [32:51<6:48:58,  3.51it/s]
 77%|███████▋  | 285459/371472 [32:52<6:44:19,  3.55it/s]
 77%|███████▋  | 285460/371472 [32:52<6:57:37,  3.43it/s]
                                                         
{'loss': 2.5607, 'learning_rate': 3.0850158374453234e-07, 'epoch': 12.3}

 77%|███████▋  | 285460/371472 [32:52<6:57:37,  3.43it/s]
 77%|███████▋  | 285461/371472 [32:52<6:52:03,  3.48it/s]
 77%|███████▋  | 285462/371472 [32:52<6:42:39,  3.56it/s]
 77%|███████▋  | 285463/371472 [32:53<7:00:51,  3.41it/s]
 77%|███████▋  | 285464/371472 [32:53<6:58:39,  3.42it/s]
 77%|███████▋  | 285465/371472 [32:53<7:01:16,  3.40it/s]
 77%|███████▋  | 285466/371472 [32:54<7:29:18,  3.19it/s]
 77%|███████▋  | 285467/371472 [32:54<6:59:20,  3.42it/s]
 77%|███████▋  | 285468/371472 [32:54<7:50:50,  3.04it/s]
 77%|███████▋  | 285469/371472 [32:55<7:35:12,  3.15it/s]
 77%|███████▋  | 285470/371472 [32:55<7:12:14,  3.32it/s]
 77%|███████▋  | 285471/371472 [32:55<7:09:43,  3.34it/s]
 77%|███████▋  | 285472/371472 [32:55<6:56:40,  3.44it/s]
 77%|███████▋  | 285473/371472 [32:56<6:49:00,  3.50it/s]
 77%|███████▋  | 285474/371472 [32:56<6:45:16,  3.54it/s]
 77%|███████▋  | 285475/371472 [32:56<6:42:10,  3.56it/s]
 77%|███████▋  | 285476/371472 [32:57<6:38:46,  3.59it/s]
 77%|███████▋  | 285477/371472 [32:57<7:08:49,  3.34it/s]
 77%|███████▋  | 285478/371472 [32:57<7:03:14,  3.39it/s]
 77%|███████▋  | 285479/371472 [32:57<6:53:04,  3.47it/s]
 77%|███████▋  | 285480/371472 [32:58<6:34:38,  3.63it/s]
                                                         
{'loss': 2.6177, 'learning_rate': 3.084531017690534e-07, 'epoch': 12.3}

 77%|███████▋  | 285480/371472 [32:58<6:34:38,  3.63it/s]
 77%|███████▋  | 285481/371472 [32:58<6:36:08,  3.62it/s]
 77%|███████▋  | 285482/371472 [32:58<6:38:17,  3.60it/s]
 77%|███████▋  | 285483/371472 [32:58<6:30:27,  3.67it/s]
 77%|███████▋  | 285484/371472 [32:59<6:24:19,  3.73it/s]
 77%|███████▋  | 285485/371472 [32:59<6:28:34,  3.69it/s]
 77%|███████▋  | 285486/371472 [32:59<6:31:45,  3.66it/s]
 77%|███████▋  | 285487/371472 [33:00<6:29:42,  3.68it/s]
 77%|███████▋  | 285488/371472 [33:00<6:36:00,  3.62it/s]
 77%|███████▋  | 285489/371472 [33:00<6:53:21,  3.47it/s]
 77%|███████▋  | 285490/371472 [33:00<6:57:43,  3.43it/s]
 77%|███████▋  | 285491/371472 [33:01<6:50:16,  3.49it/s]
 77%|███████▋  | 285492/371472 [33:01<6:43:40,  3.55it/s]
 77%|███████▋  | 285493/371472 [33:01<6:43:43,  3.55it/s]
 77%|███████▋  | 285494/371472 [33:02<6:42:55,  3.56it/s]
 77%|███████▋  | 285495/371472 [33:02<6:35:04,  3.63it/s]
 77%|███████▋  | 285496/371472 [33:02<6:30:04,  3.67it/s]
 77%|███████▋  | 285497/371472 [33:02<6:36:00,  3.62it/s]
 77%|███████▋  | 285498/371472 [33:03<6:31:17,  3.66it/s]
 77%|███████▋  | 285499/371472 [33:03<6:29:14,  3.68it/s]
 77%|███████▋  | 285500/371472 [33:03<6:30:42,  3.67it/s]
                                                         
{'loss': 2.6011, 'learning_rate': 3.0840461979357454e-07, 'epoch': 12.3}

 77%|███████▋  | 285500/371472 [33:03<6:30:42,  3.67it/s]
 77%|███████▋  | 285501/371472 [33:03<6:33:09,  3.64it/s]
 77%|███████▋  | 285502/371472 [33:04<6:38:03,  3.60it/s]
 77%|███████▋  | 285503/371472 [33:04<6:32:57,  3.65it/s]
 77%|███████▋  | 285504/371472 [33:04<6:24:08,  3.73it/s]
 77%|███████▋  | 285505/371472 [33:05<6:19:59,  3.77it/s]
 77%|███████▋  | 285506/371472 [33:05<6:11:07,  3.86it/s]
 77%|███████▋  | 285507/371472 [33:05<7:03:25,  3.38it/s]
 77%|███████▋  | 285508/371472 [33:06<7:35:45,  3.14it/s]
 77%|███████▋  | 285509/371472 [33:06<7:41:11,  3.11it/s]
 77%|███████▋  | 285510/371472 [33:06<7:43:36,  3.09it/s]
 77%|███████▋  | 285511/371472 [33:06<7:15:15,  3.29it/s]
 77%|███████▋  | 285512/371472 [33:07<6:50:06,  3.49it/s]
 77%|███████▋  | 285513/371472 [33:07<6:54:48,  3.45it/s]
 77%|███████▋  | 285514/371472 [33:07<6:42:17,  3.56it/s]
 77%|███████▋  | 285515/371472 [33:08<6:51:56,  3.48it/s]
 77%|███████▋  | 285516/371472 [33:08<6:51:33,  3.48it/s]
 77%|███████▋  | 285517/371472 [33:08<6:42:42,  3.56it/s]
 77%|███████▋  | 285518/371472 [33:08<6:31:23,  3.66it/s]
 77%|███████▋  | 285519/371472 [33:09<6:33:43,  3.64it/s]
 77%|███████▋  | 285520/371472 [33:09<6:23:13,  3.74it/s]
                                                         
{'loss': 2.7173, 'learning_rate': 3.083561378180956e-07, 'epoch': 12.3}

 77%|███████▋  | 285520/371472 [33:09<6:23:13,  3.74it/s]
 77%|███████▋  | 285521/371472 [33:09<6:23:42,  3.73it/s]
 77%|███████▋  | 285522/371472 [33:09<6:14:19,  3.83it/s]
 77%|███████▋  | 285523/371472 [33:10<6:24:08,  3.73it/s]
 77%|███████▋  | 285524/371472 [33:10<6:43:52,  3.55it/s]
 77%|███████▋  | 285525/371472 [33:10<6:52:51,  3.47it/s]
 77%|███████▋  | 285526/371472 [33:11<6:55:09,  3.45it/s]
 77%|███████▋  | 285527/371472 [33:11<6:47:17,  3.52it/s]
 77%|███████▋  | 285528/371472 [33:11<6:48:49,  3.50it/s]
 77%|███████▋  | 285529/371472 [33:11<6:54:10,  3.46it/s]
 77%|███████▋  | 285530/371472 [33:12<7:17:51,  3.27it/s]
 77%|███████▋  | 285531/371472 [33:12<7:34:16,  3.15it/s]
 77%|███████▋  | 285532/371472 [33:12<7:14:45,  3.29it/s]
 77%|███████▋  | 285533/371472 [33:13<7:35:20,  3.15it/s]
 77%|███████▋  | 285534/371472 [33:13<7:17:52,  3.27it/s]
 77%|███████▋  | 285535/371472 [33:13<7:18:24,  3.27it/s]
 77%|███████▋  | 285536/371472 [33:14<7:00:04,  3.41it/s]
 77%|███████▋  | 285537/371472 [33:14<6:58:41,  3.42it/s]
 77%|███████▋  | 285538/371472 [33:14<6:54:30,  3.46it/s]
 77%|███████▋  | 285539/371472 [33:14<6:36:56,  3.61it/s]
 77%|███████▋  | 285540/371472 [33:15<6:35:09,  3.62it/s]
                                                         
{'loss': 2.5973, 'learning_rate': 3.0830765584261673e-07, 'epoch': 12.3}

 77%|███████▋  | 285540/371472 [33:15<6:35:09,  3.62it/s]
 77%|███████▋  | 285541/371472 [33:15<6:30:52,  3.66it/s]
 77%|███████▋  | 285542/371472 [33:15<6:59:01,  3.42it/s]
 77%|███████▋  | 285543/371472 [33:16<6:59:55,  3.41it/s]
 77%|███████▋  | 285544/371472 [33:16<6:48:31,  3.51it/s]
 77%|███████▋  | 285545/371472 [33:16<6:39:14,  3.59it/s]
 77%|███████▋  | 285546/371472 [33:16<6:37:34,  3.60it/s]
 77%|███████▋  | 285547/371472 [33:17<6:42:23,  3.56it/s]
 77%|███████▋  | 285548/371472 [33:17<6:47:46,  3.51it/s]
 77%|███████▋  | 285549/371472 [33:17<6:37:23,  3.60it/s]
 77%|███████▋  | 285550/371472 [33:18<6:33:59,  3.63it/s]
 77%|███████▋  | 285551/371472 [33:18<6:38:55,  3.59it/s]
 77%|███████▋  | 285552/371472 [33:18<7:23:20,  3.23it/s]
 77%|███████▋  | 285553/371472 [33:19<7:21:57,  3.24it/s]
 77%|███████▋  | 285554/371472 [33:19<7:00:16,  3.41it/s]
 77%|███████▋  | 285555/371472 [33:19<7:03:18,  3.38it/s]
 77%|███████▋  | 285556/371472 [33:19<7:00:18,  3.41it/s]
 77%|███████▋  | 285557/371472 [33:20<6:47:25,  3.51it/s]
 77%|███████▋  | 285558/371472 [33:20<6:49:08,  3.50it/s]
 77%|███████▋  | 285559/371472 [33:20<6:35:40,  3.62it/s]
 77%|███████▋  | 285560/371472 [33:20<6:31:22,  3.66it/s]
                                                         
{'loss': 2.6453, 'learning_rate': 3.082591738671378e-07, 'epoch': 12.3}

 77%|███████▋  | 285560/371472 [33:20<6:31:22,  3.66it/s]
 77%|███████▋  | 285561/371472 [33:21<6:24:33,  3.72it/s]
 77%|███████▋  | 285562/371472 [33:21<6:23:04,  3.74it/s]
 77%|███████▋  | 285563/371472 [33:21<6:47:09,  3.52it/s]
 77%|███████▋  | 285564/371472 [33:22<7:32:17,  3.17it/s]
 77%|███████▋  | 285565/371472 [33:22<7:02:12,  3.39it/s]
 77%|███████▋  | 285566/371472 [33:22<6:48:50,  3.50it/s]
 77%|███████▋  | 285567/371472 [33:22<6:35:26,  3.62it/s]
 77%|███████▋  | 285568/371472 [33:23<6:37:17,  3.60it/s]
 77%|███████▋  | 285569/371472 [33:23<6:32:37,  3.65it/s]
 77%|███████▋  | 285570/371472 [33:23<6:36:46,  3.61it/s]
 77%|███████▋  | 285571/371472 [33:24<6:31:02,  3.66it/s]
 77%|███████▋  | 285572/371472 [33:24<6:48:13,  3.51it/s]
 77%|███████▋  | 285573/371472 [33:24<6:49:27,  3.50it/s]
 77%|███████▋  | 285574/371472 [33:24<7:09:19,  3.33it/s]
 77%|███████▋  | 285575/371472 [33:25<7:01:09,  3.40it/s]
 77%|███████▋  | 285576/371472 [33:25<7:18:46,  3.26it/s]
 77%|███████▋  | 285577/371472 [33:25<7:07:24,  3.35it/s]
 77%|███████▋  | 285578/371472 [33:26<7:03:36,  3.38it/s]
 77%|███████▋  | 285579/371472 [33:26<6:49:17,  3.50it/s]
 77%|███████▋  | 285580/371472 [33:26<6:47:59,  3.51it/s]
                                                         
{'loss': 2.6752, 'learning_rate': 3.08210691891659e-07, 'epoch': 12.3}

 77%|███████▋  | 285580/371472 [33:26<6:47:59,  3.51it/s]
 77%|███████▋  | 285581/371472 [33:27<7:09:26,  3.33it/s]
 77%|███████▋  | 285582/371472 [33:27<6:59:32,  3.41it/s]
 77%|███████▋  | 285583/371472 [33:27<7:08:29,  3.34it/s]
 77%|███████▋  | 285584/371472 [33:27<7:03:32,  3.38it/s]
 77%|███████▋  | 285585/371472 [33:28<7:19:51,  3.25it/s]
 77%|███████▋  | 285586/371472 [33:28<7:16:54,  3.28it/s]
 77%|███████▋  | 285587/371472 [33:28<7:08:14,  3.34it/s]
 77%|███████▋  | 285588/371472 [33:29<7:00:17,  3.41it/s]
 77%|███████▋  | 285589/371472 [33:29<6:45:34,  3.53it/s]
 77%|███████▋  | 285590/371472 [33:29<6:28:24,  3.69it/s]
 77%|███████▋  | 285591/371472 [33:29<6:24:37,  3.72it/s]
 77%|███████▋  | 285592/371472 [33:30<6:27:42,  3.69it/s]
 77%|███████▋  | 285593/371472 [33:30<6:22:49,  3.74it/s]
 77%|███████▋  | 285594/371472 [33:30<6:20:46,  3.76it/s]
 77%|███████▋  | 285595/371472 [33:30<6:28:26,  3.68it/s]
 77%|███████▋  | 285596/371472 [33:31<7:00:09,  3.41it/s]
 77%|███████▋  | 285597/371472 [33:31<6:49:05,  3.50it/s]
 77%|███████▋  | 285598/371472 [33:31<6:38:32,  3.59it/s]
 77%|███████▋  | 285599/371472 [33:32<6:49:43,  3.49it/s]
 77%|███████▋  | 285600/371472 [33:32<6:56:43,  3.43it/s]
                                                         
{'loss': 2.6393, 'learning_rate': 3.0816220991618005e-07, 'epoch': 12.3}

 77%|███████▋  | 285600/371472 [33:32<6:56:43,  3.43it/s]
 77%|███████▋  | 285601/371472 [33:32<6:39:26,  3.58it/s]
 77%|███████▋  | 285602/371472 [33:32<6:39:23,  3.58it/s]
 77%|███████▋  | 285603/371472 [33:33<6:28:55,  3.68it/s]
 77%|███████▋  | 285604/371472 [33:33<6:32:34,  3.65it/s]
 77%|███████▋  | 285605/371472 [33:33<6:22:20,  3.74it/s]
 77%|███████▋  | 285606/371472 [33:34<6:16:31,  3.80it/s]
 77%|███████▋  | 285607/371472 [33:34<6:38:54,  3.59it/s]
 77%|███████▋  | 285608/371472 [33:34<6:32:55,  3.64it/s]
 77%|███████▋  | 285609/371472 [33:34<6:27:12,  3.70it/s]
 77%|███████▋  | 285610/371472 [33:35<6:38:08,  3.59it/s]
 77%|███████▋  | 285611/371472 [33:35<6:35:11,  3.62it/s]
 77%|███████▋  | 285612/371472 [33:35<6:45:03,  3.53it/s]
 77%|███████▋  | 285613/371472 [33:36<7:21:53,  3.24it/s]
 77%|███████▋  | 285614/371472 [33:36<7:03:59,  3.38it/s]
 77%|███████▋  | 285615/371472 [33:36<7:06:15,  3.36it/s]
 77%|███████▋  | 285616/371472 [33:36<7:29:07,  3.19it/s]
 77%|███████▋  | 285617/371472 [33:37<7:16:30,  3.28it/s]
 77%|███████▋  | 285618/371472 [33:37<7:00:15,  3.40it/s]
 77%|███████▋  | 285619/371472 [33:37<6:48:09,  3.51it/s]
 77%|███████▋  | 285620/371472 [33:38<6:40:25,  3.57it/s]
                                                         
{'loss': 2.6705, 'learning_rate': 3.081137279407012e-07, 'epoch': 12.3}

 77%|███████▋  | 285620/371472 [33:38<6:40:25,  3.57it/s]
 77%|███████▋  | 285621/371472 [33:38<6:37:49,  3.60it/s]
 77%|███████▋  | 285622/371472 [33:38<6:48:09,  3.51it/s]
 77%|███████▋  | 285623/371472 [33:38<6:54:04,  3.46it/s]
 77%|███████▋  | 285624/371472 [33:39<7:20:10,  3.25it/s]
 77%|███████▋  | 285625/371472 [33:39<7:01:51,  3.39it/s]
 77%|███████▋  | 285626/371472 [33:39<6:54:13,  3.45it/s]
 77%|███████▋  | 285627/371472 [33:40<7:24:58,  3.22it/s]
 77%|███████▋  | 285628/371472 [33:40<7:22:42,  3.23it/s]
 77%|███████▋  | 285629/371472 [33:40<6:55:52,  3.44it/s]
 77%|███████▋  | 285630/371472 [33:41<6:39:56,  3.58it/s]
 77%|███████▋  | 285631/371472 [33:41<6:36:46,  3.61it/s]
 77%|███████▋  | 285632/371472 [33:41<6:29:49,  3.67it/s]
 77%|███████▋  | 285633/371472 [33:41<6:47:16,  3.51it/s]
 77%|███████▋  | 285634/371472 [33:42<6:39:16,  3.58it/s]
 77%|███████▋  | 285635/371472 [33:42<6:37:02,  3.60it/s]
 77%|███████▋  | 285636/371472 [33:42<6:36:26,  3.61it/s]
 77%|███████▋  | 285637/371472 [33:42<6:52:18,  3.47it/s]
 77%|███████▋  | 285638/371472 [33:43<6:31:40,  3.65it/s]
 77%|███████▋  | 285639/371472 [33:43<6:39:00,  3.59it/s]
 77%|███████▋  | 285640/371472 [33:43<6:45:39,  3.53it/s]
                                                         
{'loss': 2.6462, 'learning_rate': 3.0806524596522225e-07, 'epoch': 12.3}

 77%|███████▋  | 285640/371472 [33:43<6:45:39,  3.53it/s]
 77%|███████▋  | 285641/371472 [33:44<6:55:54,  3.44it/s]
 77%|███████▋  | 285642/371472 [33:44<6:51:00,  3.48it/s]
 77%|███████▋  | 285643/371472 [33:44<7:20:27,  3.25it/s]
 77%|███████▋  | 285644/371472 [33:45<6:58:23,  3.42it/s]
 77%|███████▋  | 285645/371472 [33:45<6:43:20,  3.55it/s]
 77%|███████▋  | 285646/371472 [33:45<6:32:49,  3.64it/s]
 77%|███████▋  | 285647/371472 [33:45<6:34:07,  3.63it/s]
 77%|███████▋  | 285648/371472 [33:46<6:54:30,  3.45it/s]
 77%|███████▋  | 285649/371472 [33:46<6:59:25,  3.41it/s]
 77%|███████▋  | 285650/371472 [33:46<7:16:02,  3.28it/s]
 77%|███████▋  | 285651/371472 [33:47<7:22:18,  3.23it/s]
 77%|███████▋  | 285652/371472 [33:47<7:03:17,  3.38it/s]
 77%|███████▋  | 285653/371472 [33:47<6:58:02,  3.42it/s]
 77%|███████▋  | 285654/371472 [33:47<6:49:13,  3.50it/s]
 77%|███████▋  | 285655/371472 [33:48<6:41:31,  3.56it/s]
 77%|███████▋  | 285656/371472 [33:48<6:59:24,  3.41it/s]
 77%|███████▋  | 285657/371472 [33:48<6:41:14,  3.56it/s]
 77%|███████▋  | 285658/371472 [33:49<6:38:47,  3.59it/s]
 77%|███████▋  | 285659/371472 [33:49<6:54:23,  3.45it/s]
 77%|███████▋  | 285660/371472 [33:49<6:50:39,  3.48it/s]
                                                         
{'loss': 2.6627, 'learning_rate': 3.0801676398974337e-07, 'epoch': 12.3}

 77%|███████▋  | 285660/371472 [33:49<6:50:39,  3.48it/s]
 77%|███████▋  | 285661/371472 [33:49<6:32:29,  3.64it/s]
 77%|███████▋  | 285662/371472 [33:50<6:42:28,  3.55it/s]
 77%|███████▋  | 285663/371472 [33:50<6:37:38,  3.60it/s]
 77%|███████▋  | 285664/371472 [33:50<6:44:42,  3.53it/s]
 77%|███████▋  | 285665/371472 [33:51<6:40:07,  3.57it/s]
 77%|███████▋  | 285666/371472 [33:51<6:30:13,  3.66it/s]
 77%|███████▋  | 285667/371472 [33:51<6:20:35,  3.76it/s]
 77%|███████▋  | 285668/371472 [33:51<6:22:44,  3.74it/s]
 77%|███████▋  | 285669/371472 [33:52<6:29:05,  3.68it/s]
 77%|███████▋  | 285670/371472 [33:52<6:28:30,  3.68it/s]
 77%|███████▋  | 285671/371472 [33:52<6:30:59,  3.66it/s]
 77%|███████▋  | 285672/371472 [33:52<6:24:35,  3.72it/s]
 77%|███████▋  | 285673/371472 [33:53<6:34:40,  3.62it/s]
 77%|███████▋  | 285674/371472 [33:53<7:15:02,  3.29it/s]
 77%|███████▋  | 285675/371472 [33:53<7:53:11,  3.02it/s]
 77%|███████▋  | 285676/371472 [33:54<7:33:46,  3.15it/s]
 77%|███████▋  | 285677/371472 [33:54<7:14:13,  3.29it/s]
 77%|███████▋  | 285678/371472 [33:54<7:00:13,  3.40it/s]
 77%|███████▋  | 285679/371472 [33:55<7:12:37,  3.31it/s]
 77%|███████▋  | 285680/371472 [33:55<6:55:27,  3.44it/s]
                                                         
{'loss': 2.5752, 'learning_rate': 3.0796828201426444e-07, 'epoch': 12.3}

 77%|███████▋  | 285680/371472 [33:55<6:55:27,  3.44it/s]
 77%|███████▋  | 285681/371472 [33:55<6:44:56,  3.53it/s]
 77%|███████▋  | 285682/371472 [33:55<6:53:06,  3.46it/s]
 77%|███████▋  | 285683/371472 [33:56<6:41:03,  3.57it/s]
 77%|███████▋  | 285684/371472 [33:56<6:35:54,  3.61it/s]
 77%|███████▋  | 285685/371472 [33:56<7:00:10,  3.40it/s]
 77%|███████▋  | 285686/371472 [33:57<7:39:47,  3.11it/s]
 77%|███████▋  | 285687/371472 [33:57<7:16:36,  3.27it/s]
 77%|███████▋  | 285688/371472 [33:57<6:57:42,  3.42it/s]
 77%|███████▋  | 285689/371472 [33:57<6:56:09,  3.44it/s]
 77%|███████▋  | 285690/371472 [33:58<6:42:08,  3.56it/s]
 77%|███████▋  | 285691/371472 [33:58<6:36:01,  3.61it/s]
 77%|███████▋  | 285692/371472 [33:58<6:52:23,  3.47it/s]
 77%|███████▋  | 285693/371472 [33:59<6:40:03,  3.57it/s]
 77%|███████▋  | 285694/371472 [33:59<6:37:32,  3.60it/s]
 77%|███████▋  | 285695/371472 [33:59<6:56:21,  3.43it/s]
 77%|███████▋  | 285696/371472 [33:59<6:55:17,  3.44it/s]
 77%|███████▋  | 285697/371472 [34:00<7:03:15,  3.38it/s]
 77%|███████▋  | 285698/371472 [34:00<7:24:48,  3.21it/s]
 77%|███████▋  | 285699/371472 [34:00<7:04:28,  3.37it/s]
 77%|███████▋  | 285700/371472 [34:01<7:31:59,  3.16it/s]
                                                         
{'loss': 2.6345, 'learning_rate': 3.079198000387857e-07, 'epoch': 12.31}

 77%|███████▋  | 285700/371472 [34:01<7:31:59,  3.16it/s]
 77%|███████▋  | 285701/371472 [34:01<7:10:23,  3.32it/s]
 77%|███████▋  | 285702/371472 [34:01<7:00:19,  3.40it/s]
 77%|███████▋  | 285703/371472 [34:02<6:53:23,  3.46it/s]
 77%|███████▋  | 285704/371472 [34:02<6:42:59,  3.55it/s]
 77%|███████▋  | 285705/371472 [34:02<6:33:38,  3.63it/s]
 77%|███████▋  | 285706/371472 [34:02<6:34:32,  3.62it/s]
 77%|███████▋  | 285707/371472 [34:03<6:40:11,  3.57it/s]
 77%|███████▋  | 285708/371472 [34:03<6:31:52,  3.65it/s]
 77%|███████▋  | 285709/371472 [34:03<6:23:12,  3.73it/s]
 77%|███████▋  | 285710/371472 [34:03<6:32:46,  3.64it/s]
 77%|███████▋  | 285711/371472 [34:04<6:38:45,  3.58it/s]
 77%|███████▋  | 285712/371472 [34:04<6:28:06,  3.68it/s]
 77%|███████▋  | 285713/371472 [34:04<6:23:52,  3.72it/s]
 77%|███████▋  | 285714/371472 [34:05<6:13:16,  3.83it/s]
 77%|███████▋  | 285715/371472 [34:05<6:18:46,  3.77it/s]
 77%|███████▋  | 285716/371472 [34:05<6:36:02,  3.61it/s]
 77%|███████▋  | 285717/371472 [34:05<6:53:44,  3.45it/s]
 77%|███████▋  | 285718/371472 [34:06<6:56:08,  3.43it/s]
 77%|███████▋  | 285719/371472 [34:06<6:50:56,  3.48it/s]
 77%|███████▋  | 285720/371472 [34:06<6:49:43,  3.49it/s]
                                                         
{'loss': 2.6414, 'learning_rate': 3.078713180633067e-07, 'epoch': 12.31}

 77%|███████▋  | 285720/371472 [34:06<6:49:43,  3.49it/s]
 77%|███████▋  | 285721/371472 [34:07<6:41:48,  3.56it/s]
 77%|███████▋  | 285722/371472 [34:07<6:40:48,  3.57it/s]
 77%|███████▋  | 285723/371472 [34:07<6:36:01,  3.61it/s]
 77%|███████▋  | 285724/371472 [34:07<6:36:00,  3.61it/s]
 77%|███████▋  | 285725/371472 [34:08<6:37:08,  3.60it/s]
 77%|███████▋  | 285726/371472 [34:08<6:34:42,  3.62it/s]
 77%|███████▋  | 285727/371472 [34:08<6:30:52,  3.66it/s]
 77%|███████▋  | 285728/371472 [34:08<6:50:09,  3.48it/s]
 77%|███████▋  | 285729/371472 [34:09<6:47:59,  3.50it/s]
 77%|███████▋  | 285730/371472 [34:09<6:41:41,  3.56it/s]
 77%|███████▋  | 285731/371472 [34:09<6:33:26,  3.63it/s]
 77%|███████▋  | 285732/371472 [34:10<6:35:00,  3.62it/s]
 77%|███████▋  | 285733/371472 [34:10<6:35:05,  3.62it/s]
 77%|███████▋  | 285734/371472 [34:10<6:46:42,  3.51it/s]
 77%|███████▋  | 285735/371472 [34:10<6:46:39,  3.51it/s]
 77%|███████▋  | 285736/371472 [34:11<6:41:32,  3.56it/s]
 77%|███████▋  | 285737/371472 [34:11<6:41:38,  3.56it/s]
 77%|███████▋  | 285738/371472 [34:11<6:38:12,  3.59it/s]
 77%|███████▋  | 285739/371472 [34:12<7:11:12,  3.31it/s]
 77%|███████▋  | 285740/371472 [34:12<6:55:29,  3.44it/s]
                                                         
{'loss': 2.695, 'learning_rate': 3.0782283608782776e-07, 'epoch': 12.31}

 77%|███████▋  | 285740/371472 [34:12<6:55:29,  3.44it/s]
 77%|███████▋  | 285741/371472 [34:12<7:23:02,  3.23it/s]
 77%|███████▋  | 285742/371472 [34:13<7:22:45,  3.23it/s]
 77%|███████▋  | 285743/371472 [34:13<7:23:03,  3.22it/s]
 77%|███████▋  | 285744/371472 [34:13<7:03:04,  3.38it/s]
 77%|███████▋  | 285745/371472 [34:13<6:54:16,  3.45it/s]
 77%|███████▋  | 285746/371472 [34:14<6:41:04,  3.56it/s]
 77%|███████▋  | 285747/371472 [34:14<6:37:12,  3.60it/s]
 77%|███████▋  | 285748/371472 [34:14<6:35:21,  3.61it/s]
 77%|███████▋  | 285749/371472 [34:15<7:15:10,  3.28it/s]
 77%|███████▋  | 285750/371472 [34:15<7:41:59,  3.09it/s]
 77%|███████▋  | 285751/371472 [34:15<7:22:43,  3.23it/s]
 77%|███████▋  | 285752/371472 [34:16<7:05:36,  3.36it/s]
 77%|███████▋  | 285753/371472 [34:16<7:03:32,  3.37it/s]
 77%|███████▋  | 285754/371472 [34:16<6:57:38,  3.42it/s]
 77%|███████▋  | 285755/371472 [34:16<6:44:11,  3.53it/s]
 77%|███████▋  | 285756/371472 [34:17<6:29:01,  3.67it/s]
 77%|███████▋  | 285757/371472 [34:17<6:20:49,  3.75it/s]
 77%|███████▋  | 285758/371472 [34:17<6:23:25,  3.73it/s]
 77%|███████▋  | 285759/371472 [34:17<6:33:43,  3.63it/s]
 77%|███████▋  | 285760/371472 [34:18<6:29:13,  3.67it/s]
                                                         
{'loss': 2.5002, 'learning_rate': 3.077743541123489e-07, 'epoch': 12.31}

 77%|███████▋  | 285760/371472 [34:18<6:29:13,  3.67it/s]
 77%|███████▋  | 285761/371472 [34:18<6:37:16,  3.60it/s]
 77%|███████▋  | 285762/371472 [34:18<6:27:23,  3.69it/s]
 77%|███████▋  | 285763/371472 [34:19<7:00:46,  3.39it/s]
 77%|███████▋  | 285764/371472 [34:19<6:42:26,  3.55it/s]
 77%|███████▋  | 285765/371472 [34:19<7:35:14,  3.14it/s]
 77%|███████▋  | 285766/371472 [34:20<7:26:51,  3.20it/s]
 77%|███████▋  | 285767/371472 [34:20<7:18:49,  3.26it/s]
 77%|███████▋  | 285768/371472 [34:20<7:08:41,  3.33it/s]
 77%|███████▋  | 285769/371472 [34:20<6:51:56,  3.47it/s]
 77%|███████▋  | 285770/371472 [34:21<6:40:08,  3.57it/s]
 77%|███████▋  | 285771/371472 [34:21<6:35:41,  3.61it/s]
 77%|███████▋  | 285772/371472 [34:21<7:22:13,  3.23it/s]
 77%|███████▋  | 285773/371472 [34:22<6:56:47,  3.43it/s]
 77%|███████▋  | 285774/371472 [34:22<6:41:19,  3.56it/s]
 77%|███████▋  | 285775/371472 [34:22<6:50:43,  3.48it/s]
 77%|███████▋  | 285776/371472 [34:22<6:36:55,  3.60it/s]
 77%|███████▋  | 285777/371472 [34:23<6:48:50,  3.49it/s]
 77%|███████▋  | 285778/371472 [34:23<7:27:20,  3.19it/s]
 77%|███████▋  | 285779/371472 [34:23<7:38:32,  3.11it/s]
 77%|███████▋  | 285780/371472 [34:24<7:14:10,  3.29it/s]
                                                         
{'loss': 2.6504, 'learning_rate': 3.077258721368699e-07, 'epoch': 12.31}

 77%|███████▋  | 285780/371472 [34:24<7:14:10,  3.29it/s]
 77%|███████▋  | 285781/371472 [34:24<6:58:38,  3.41it/s]
 77%|███████▋  | 285782/371472 [34:24<7:05:27,  3.36it/s]
 77%|███████▋  | 285783/371472 [34:24<6:52:39,  3.46it/s]
 77%|███████▋  | 285784/371472 [34:25<6:50:01,  3.48it/s]
 77%|███████▋  | 285785/371472 [34:25<6:49:23,  3.49it/s]
 77%|███████▋  | 285786/371472 [34:25<6:35:54,  3.61it/s]
 77%|███████▋  | 285787/371472 [34:26<6:26:54,  3.69it/s]
 77%|███████▋  | 285788/371472 [34:26<6:17:19,  3.78it/s]
 77%|███████▋  | 285789/371472 [34:26<6:19:28,  3.76it/s]
 77%|███████▋  | 285790/371472 [34:26<6:17:38,  3.78it/s]
 77%|███████▋  | 285791/371472 [34:27<6:20:19,  3.75it/s]
 77%|███████▋  | 285792/371472 [34:27<6:07:44,  3.88it/s]
 77%|███████▋  | 285793/371472 [34:27<6:27:03,  3.69it/s]
 77%|███████▋  | 285794/371472 [34:27<6:34:23,  3.62it/s]
 77%|███████▋  | 285795/371472 [34:28<6:45:51,  3.52it/s]
 77%|███████▋  | 285796/371472 [34:28<6:40:52,  3.56it/s]
 77%|███████▋  | 285797/371472 [34:28<6:56:53,  3.43it/s]
 77%|███████▋  | 285798/371472 [34:29<6:35:53,  3.61it/s]
 77%|███████▋  | 285799/371472 [34:29<6:59:06,  3.41it/s]
 77%|███████▋  | 285800/371472 [34:29<6:37:12,  3.59it/s]
                                                         
{'loss': 2.7466, 'learning_rate': 3.076773901613911e-07, 'epoch': 12.31}

 77%|███████▋  | 285800/371472 [34:29<6:37:12,  3.59it/s]
 77%|███████▋  | 285801/371472 [34:29<6:48:40,  3.49it/s]
 77%|███████▋  | 285802/371472 [34:30<6:39:43,  3.57it/s]
 77%|███████▋  | 285803/371472 [34:30<7:10:55,  3.31it/s]
 77%|███████▋  | 285804/371472 [34:30<6:56:53,  3.42it/s]
 77%|███████▋  | 285805/371472 [34:31<6:47:19,  3.51it/s]
 77%|███████▋  | 285806/371472 [34:31<6:44:21,  3.53it/s]
 77%|███████▋  | 285807/371472 [34:31<6:45:07,  3.52it/s]
 77%|███████▋  | 285808/371472 [34:31<6:32:25,  3.64it/s]
 77%|███████▋  | 285809/371472 [34:32<6:29:20,  3.67it/s]
 77%|███████▋  | 285810/371472 [34:32<6:43:09,  3.54it/s]
 77%|███████▋  | 285811/371472 [34:32<6:43:03,  3.54it/s]
 77%|███████▋  | 285812/371472 [34:33<6:37:06,  3.60it/s]
 77%|███████▋  | 285813/371472 [34:33<6:30:33,  3.66it/s]
 77%|███████▋  | 285814/371472 [34:33<6:25:41,  3.70it/s]
 77%|███████▋  | 285815/371472 [34:33<6:23:49,  3.72it/s]
 77%|███████▋  | 285816/371472 [34:34<7:12:21,  3.30it/s]
 77%|███████▋  | 285817/371472 [34:34<7:25:33,  3.20it/s]
 77%|███████▋  | 285818/371472 [34:34<7:20:23,  3.24it/s]
 77%|███████▋  | 285819/371472 [34:35<7:39:56,  3.10it/s]
 77%|███████▋  | 285820/371472 [34:35<7:21:40,  3.23it/s]
                                                         
{'loss': 2.6289, 'learning_rate': 3.0762890818591216e-07, 'epoch': 12.31}

 77%|███████▋  | 285820/371472 [34:35<7:21:40,  3.23it/s]
 77%|███████▋  | 285821/371472 [34:35<6:50:06,  3.48it/s]
 77%|███████▋  | 285822/371472 [34:36<7:04:32,  3.36it/s]
 77%|███████▋  | 285823/371472 [34:36<7:19:14,  3.25it/s]
 77%|███████▋  | 285824/371472 [34:36<7:25:13,  3.21it/s]
 77%|███████▋  | 285825/371472 [34:37<7:23:53,  3.22it/s]
 77%|███████▋  | 285826/371472 [34:37<7:04:47,  3.36it/s]
 77%|███████▋  | 285827/371472 [34:37<7:02:44,  3.38it/s]
 77%|███████▋  | 285828/371472 [34:37<7:33:12,  3.15it/s]
 77%|███████▋  | 285829/371472 [34:38<7:12:41,  3.30it/s]
 77%|███████▋  | 285830/371472 [34:38<6:50:13,  3.48it/s]
 77%|███████▋  | 285831/371472 [34:38<6:39:29,  3.57it/s]
 77%|███████▋  | 285832/371472 [34:39<6:44:16,  3.53it/s]
 77%|███████▋  | 285833/371472 [34:39<6:50:47,  3.47it/s]
 77%|███████▋  | 285834/371472 [34:39<6:44:31,  3.53it/s]
 77%|███████▋  | 285835/371472 [34:39<6:44:55,  3.52it/s]
 77%|███████▋  | 285836/371472 [34:40<6:32:45,  3.63it/s]
 77%|███████▋  | 285837/371472 [34:40<6:39:38,  3.57it/s]
 77%|███████▋  | 285838/371472 [34:40<6:35:17,  3.61it/s]
 77%|███████▋  | 285839/371472 [34:40<6:24:42,  3.71it/s]
 77%|███████▋  | 285840/371472 [34:41<7:09:42,  3.32it/s]
                                                         
{'loss': 2.6796, 'learning_rate': 3.0758042621043333e-07, 'epoch': 12.31}

 77%|███████▋  | 285840/371472 [34:41<7:09:42,  3.32it/s]
 77%|███████▋  | 285841/371472 [34:41<7:16:44,  3.27it/s]
 77%|███████▋  | 285842/371472 [34:41<7:02:05,  3.38it/s]
 77%|███████▋  | 285843/371472 [34:42<7:00:11,  3.40it/s]
 77%|███████▋  | 285844/371472 [34:42<6:56:30,  3.43it/s]
 77%|███████▋  | 285845/371472 [34:42<7:27:15,  3.19it/s]
 77%|███████▋  | 285846/371472 [34:43<7:08:13,  3.33it/s]
 77%|███████▋  | 285847/371472 [34:43<6:54:23,  3.44it/s]
 77%|███████▋  | 285848/371472 [34:43<7:20:59,  3.24it/s]
 77%|███████▋  | 285849/371472 [34:44<7:14:04,  3.29it/s]
 77%|███████▋  | 285850/371472 [34:44<6:57:17,  3.42it/s]
 77%|███████▋  | 285851/371472 [34:44<6:36:51,  3.60it/s]
 77%|███████▋  | 285852/371472 [34:44<6:51:38,  3.47it/s]
 77%|███████▋  | 285853/371472 [34:45<6:37:59,  3.59it/s]
 77%|███████▋  | 285854/371472 [34:45<6:50:15,  3.48it/s]
 77%|███████▋  | 285855/371472 [34:45<6:43:34,  3.54it/s]
 77%|███████▋  | 285856/371472 [34:45<6:37:07,  3.59it/s]
 77%|███████▋  | 285857/371472 [34:46<6:27:49,  3.68it/s]
 77%|███████▋  | 285858/371472 [34:46<6:46:52,  3.51it/s]
 77%|███████▋  | 285859/371472 [34:46<7:12:52,  3.30it/s]
 77%|███████▋  | 285860/371472 [34:47<7:07:54,  3.33it/s]
                                                         
{'loss': 2.5462, 'learning_rate': 3.0753194423495446e-07, 'epoch': 12.31}

 77%|███████▋  | 285860/371472 [34:47<7:07:54,  3.33it/s]
 77%|███████▋  | 285861/371472 [34:47<7:29:44,  3.17it/s]
 77%|███████▋  | 285862/371472 [34:47<7:35:21,  3.13it/s]
 77%|███████▋  | 285863/371472 [34:48<7:19:26,  3.25it/s]
 77%|███████▋  | 285864/371472 [34:48<7:02:03,  3.38it/s]
 77%|███████▋  | 285865/371472 [34:48<7:04:49,  3.36it/s]
 77%|███████▋  | 285866/371472 [34:48<6:55:04,  3.44it/s]
 77%|███████▋  | 285867/371472 [34:49<6:33:17,  3.63it/s]
 77%|███████▋  | 285868/371472 [34:49<6:24:46,  3.71it/s]
 77%|███████▋  | 285869/371472 [34:49<6:56:17,  3.43it/s]
 77%|███████▋  | 285870/371472 [34:50<7:04:08,  3.36it/s]
 77%|███████▋  | 285871/371472 [34:50<6:44:31,  3.53it/s]
 77%|███████▋  | 285872/371472 [34:50<6:38:55,  3.58it/s]
 77%|███████▋  | 285873/371472 [34:50<6:28:13,  3.67it/s]
 77%|███████▋  | 285874/371472 [34:51<6:19:12,  3.76it/s]
 77%|███████▋  | 285875/371472 [34:51<6:29:39,  3.66it/s]
 77%|███████▋  | 285876/371472 [34:51<6:48:17,  3.49it/s]
 77%|███████▋  | 285877/371472 [34:52<6:50:30,  3.48it/s]
 77%|███████▋  | 285878/371472 [34:52<6:48:39,  3.49it/s]
 77%|███████▋  | 285879/371472 [34:52<6:52:00,  3.46it/s]
 77%|███████▋  | 285880/371472 [34:52<7:25:20,  3.20it/s]
                                                         
{'loss': 2.6527, 'learning_rate': 3.0748346225947553e-07, 'epoch': 12.31}

 77%|███████▋  | 285880/371472 [34:52<7:25:20,  3.20it/s]
 77%|███████▋  | 285881/371472 [34:53<7:15:58,  3.27it/s]
 77%|███████▋  | 285882/371472 [34:53<7:25:24,  3.20it/s]
 77%|███████▋  | 285883/371472 [34:53<7:07:08,  3.34it/s]
 77%|███████▋  | 285884/371472 [34:54<6:55:51,  3.43it/s]
 77%|███████▋  | 285885/371472 [34:54<6:56:19,  3.43it/s]
 77%|███████▋  | 285886/371472 [34:54<6:53:10,  3.45it/s]
 77%|███████▋  | 285887/371472 [34:55<7:06:31,  3.34it/s]
 77%|███████▋  | 285888/371472 [34:55<6:42:17,  3.55it/s]
 77%|███████▋  | 285889/371472 [34:55<6:40:28,  3.56it/s]
 77%|███████▋  | 285890/371472 [34:55<6:35:06,  3.61it/s]
 77%|███████▋  | 285891/371472 [34:56<6:20:43,  3.75it/s]
 77%|███████▋  | 285892/371472 [34:56<6:21:43,  3.74it/s]
 77%|███████▋  | 285893/371472 [34:56<6:23:30,  3.72it/s]
 77%|███████▋  | 285894/371472 [34:56<6:30:04,  3.66it/s]
 77%|███████▋  | 285895/371472 [34:57<6:41:33,  3.55it/s]
 77%|███████▋  | 285896/371472 [34:57<6:54:50,  3.44it/s]
 77%|███████▋  | 285897/371472 [34:57<6:54:13,  3.44it/s]
 77%|███████▋  | 285898/371472 [34:58<7:02:16,  3.38it/s]
 77%|███████▋  | 285899/371472 [34:58<6:58:54,  3.40it/s]
 77%|███████▋  | 285900/371472 [34:58<6:35:38,  3.60it/s]
                                                         
{'loss': 2.499, 'learning_rate': 3.074349802839966e-07, 'epoch': 12.31}

 77%|███████▋  | 285900/371472 [34:58<6:35:38,  3.60it/s]
 77%|███████▋  | 285901/371472 [34:58<7:05:23,  3.35it/s]
 77%|███████▋  | 285902/371472 [34:59<7:03:03,  3.37it/s]
 77%|███████▋  | 285903/371472 [34:59<6:51:49,  3.46it/s]
 77%|███████▋  | 285904/371472 [34:59<6:40:02,  3.56it/s]
 77%|███████▋  | 285905/371472 [35:00<6:55:57,  3.43it/s]
 77%|███████▋  | 285906/371472 [35:00<6:51:31,  3.47it/s]
 77%|███████▋  | 285907/371472 [35:00<6:54:42,  3.44it/s]
 77%|███████▋  | 285908/371472 [35:00<6:46:08,  3.51it/s]
 77%|███████▋  | 285909/371472 [35:01<6:44:19,  3.53it/s]
 77%|███████▋  | 285910/371472 [35:01<6:51:40,  3.46it/s]
 77%|███████▋  | 285911/371472 [35:01<6:38:33,  3.58it/s]
 77%|███████▋  | 285912/371472 [35:02<6:32:40,  3.63it/s]
 77%|███████▋  | 285913/371472 [35:02<6:22:57,  3.72it/s]
 77%|███████▋  | 285914/371472 [35:02<7:06:05,  3.35it/s]
 77%|███████▋  | 285915/371472 [35:02<6:51:38,  3.46it/s]
 77%|███████▋  | 285916/371472 [35:03<7:13:34,  3.29it/s]
 77%|███████▋  | 285917/371472 [35:03<7:26:18,  3.19it/s]
 77%|███████▋  | 285918/371472 [35:03<7:08:19,  3.33it/s]
 77%|███████▋  | 285919/371472 [35:04<6:51:59,  3.46it/s]
 77%|███████▋  | 285920/371472 [35:04<6:44:10,  3.53it/s]
                                                         
{'loss': 2.6724, 'learning_rate': 3.073864983085177e-07, 'epoch': 12.32}

 77%|███████▋  | 285920/371472 [35:04<6:44:10,  3.53it/s]
 77%|███████▋  | 285921/371472 [35:04<6:38:28,  3.58it/s]
 77%|███████▋  | 285922/371472 [35:04<6:26:59,  3.68it/s]
 77%|███████▋  | 285923/371472 [35:05<6:18:11,  3.77it/s]
 77%|███████▋  | 285924/371472 [35:05<6:16:48,  3.78it/s]
 77%|███████▋  | 285925/371472 [35:05<6:07:31,  3.88it/s]
 77%|███████▋  | 285926/371472 [35:05<6:15:06,  3.80it/s]
 77%|███████▋  | 285927/371472 [35:06<6:34:33,  3.61it/s]
 77%|███████▋  | 285928/371472 [35:06<6:34:33,  3.61it/s]
 77%|███████▋  | 285929/371472 [35:06<6:33:40,  3.62it/s]
 77%|███████▋  | 285930/371472 [35:07<6:34:22,  3.62it/s]
 77%|███████▋  | 285931/371472 [35:07<6:44:46,  3.52it/s]
 77%|███████▋  | 285932/371472 [35:07<6:36:56,  3.59it/s]
 77%|███████▋  | 285933/371472 [35:07<6:42:25,  3.54it/s]
 77%|███████▋  | 285934/371472 [35:08<6:47:50,  3.50it/s]
 77%|███████▋  | 285935/371472 [35:08<6:28:44,  3.67it/s]
 77%|███████▋  | 285936/371472 [35:08<6:53:39,  3.45it/s]
 77%|███████▋  | 285937/371472 [35:09<7:38:43,  3.11it/s]
 77%|███████▋  | 285938/371472 [35:09<7:35:10,  3.13it/s]
 77%|███████▋  | 285939/371472 [35:09<7:17:34,  3.26it/s]
 77%|███████▋  | 285940/371472 [35:10<7:12:33,  3.30it/s]
                                                         
{'loss': 2.6488, 'learning_rate': 3.073380163330388e-07, 'epoch': 12.32}

 77%|███████▋  | 285940/371472 [35:10<7:12:33,  3.30it/s]
 77%|███████▋  | 285941/371472 [35:10<7:02:00,  3.38it/s]
 77%|███████▋  | 285942/371472 [35:10<6:55:51,  3.43it/s]
 77%|███████▋  | 285943/371472 [35:10<6:40:43,  3.56it/s]
 77%|███████▋  | 285944/371472 [35:11<6:25:04,  3.70it/s]
 77%|███████▋  | 285945/371472 [35:11<6:26:43,  3.69it/s]
 77%|███████▋  | 285946/371472 [35:11<6:35:05,  3.61it/s]
 77%|███████▋  | 285947/371472 [35:12<6:32:36,  3.63it/s]
 77%|███████▋  | 285948/371472 [35:12<6:35:31,  3.60it/s]
 77%|███████▋  | 285949/371472 [35:12<6:41:51,  3.55it/s]
 77%|███████▋  | 285950/371472 [35:12<6:48:32,  3.49it/s]
 77%|███████▋  | 285951/371472 [35:13<6:33:36,  3.62it/s]
 77%|███████▋  | 285952/371472 [35:13<6:25:28,  3.70it/s]
 77%|███████▋  | 285953/371472 [35:13<6:41:43,  3.55it/s]
 77%|███████▋  | 285954/371472 [35:13<6:26:29,  3.69it/s]
 77%|███████▋  | 285955/371472 [35:14<6:14:35,  3.80it/s]
 77%|███████▋  | 285956/371472 [35:14<6:06:41,  3.89it/s]
 77%|███████▋  | 285957/371472 [35:14<6:33:44,  3.62it/s]
 77%|███████▋  | 285958/371472 [35:15<6:35:06,  3.61it/s]
 77%|███████▋  | 285959/371472 [35:15<6:46:42,  3.50it/s]
 77%|███████▋  | 285960/371472 [35:15<6:37:35,  3.58it/s]
                                                         
{'loss': 2.6322, 'learning_rate': 3.0728953435756e-07, 'epoch': 12.32}

 77%|███████▋  | 285960/371472 [35:15<6:37:35,  3.58it/s]
 77%|███████▋  | 285961/371472 [35:15<6:34:04,  3.62it/s]
 77%|███████▋  | 285962/371472 [35:16<6:29:37,  3.66it/s]
 77%|███████▋  | 285963/371472 [35:16<6:34:08,  3.62it/s]
 77%|███████▋  | 285964/371472 [35:16<6:36:11,  3.60it/s]
 77%|███████▋  | 285965/371472 [35:17<7:07:19,  3.33it/s]
 77%|███████▋  | 285966/371472 [35:17<6:56:26,  3.42it/s]
 77%|███████▋  | 285967/371472 [35:17<7:03:00,  3.37it/s]
 77%|███████▋  | 285968/371472 [35:17<6:55:25,  3.43it/s]
 77%|███████▋  | 285969/371472 [35:18<6:52:33,  3.45it/s]
 77%|███████▋  | 285970/371472 [35:18<7:00:55,  3.39it/s]
 77%|███████▋  | 285971/371472 [35:18<7:33:37,  3.14it/s]
 77%|███████▋  | 285972/371472 [35:19<7:22:54,  3.22it/s]
 77%|███████▋  | 285973/371472 [35:19<7:31:32,  3.16it/s]
 77%|███████▋  | 285974/371472 [35:19<7:15:16,  3.27it/s]
 77%|███████▋  | 285975/371472 [35:20<7:18:28,  3.25it/s]
 77%|███████▋  | 285976/371472 [35:20<6:57:32,  3.41it/s]
 77%|███████▋  | 285977/371472 [35:20<6:42:53,  3.54it/s]
 77%|███████▋  | 285978/371472 [35:20<6:45:09,  3.52it/s]
 77%|███████▋  | 285979/371472 [35:21<6:44:30,  3.52it/s]
 77%|███████▋  | 285980/371472 [35:21<6:43:55,  3.53it/s]
                                                         
{'loss': 2.6622, 'learning_rate': 3.0724105238208105e-07, 'epoch': 12.32}

 77%|███████▋  | 285980/371472 [35:21<6:43:55,  3.53it/s]
 77%|███████▋  | 285981/371472 [35:21<6:39:13,  3.57it/s]
 77%|███████▋  | 285982/371472 [35:22<6:26:53,  3.68it/s]
 77%|███████▋  | 285983/371472 [35:22<6:35:29,  3.60it/s]
 77%|███████▋  | 285984/371472 [35:22<6:22:08,  3.73it/s]
 77%|███████▋  | 285985/371472 [35:22<6:18:02,  3.77it/s]
 77%|███████▋  | 285986/371472 [35:23<6:47:12,  3.50it/s]
 77%|███████▋  | 285987/371472 [35:23<6:38:42,  3.57it/s]
 77%|███████▋  | 285988/371472 [35:23<6:51:38,  3.46it/s]
 77%|███████▋  | 285989/371472 [35:23<6:35:41,  3.60it/s]
 77%|███████▋  | 285990/371472 [35:24<6:54:51,  3.43it/s]
 77%|███████▋  | 285991/371472 [35:24<6:55:05,  3.43it/s]
 77%|███████▋  | 285992/371472 [35:24<6:48:58,  3.48it/s]
 77%|███████▋  | 285993/371472 [35:25<6:52:27,  3.45it/s]
 77%|███████▋  | 285994/371472 [35:25<6:39:58,  3.56it/s]
 77%|███████▋  | 285995/371472 [35:25<6:35:10,  3.60it/s]
 77%|███████▋  | 285996/371472 [35:26<7:07:36,  3.33it/s]
 77%|███████▋  | 285997/371472 [35:26<7:31:41,  3.15it/s]
 77%|███████▋  | 285998/371472 [35:26<7:17:23,  3.26it/s]
 77%|███████▋  | 285999/371472 [35:26<7:06:22,  3.34it/s]
 77%|███████▋  | 286000/371472 [35:27<7:03:56,  3.36it/s]
                                                         
{'loss': 2.5092, 'learning_rate': 3.0719257040660217e-07, 'epoch': 12.32}

 77%|███████▋  | 286000/371472 [35:27<7:03:56,  3.36it/s]
 77%|███████▋  | 286001/371472 [35:27<6:54:37,  3.44it/s]
 77%|███████▋  | 286002/371472 [35:27<7:15:30,  3.27it/s]
 77%|███████▋  | 286003/371472 [35:28<6:54:29,  3.44it/s]
 77%|███████▋  | 286004/371472 [35:28<7:06:30,  3.34it/s]
 77%|███████▋  | 286005/371472 [35:28<7:23:52,  3.21it/s]
 77%|███████▋  | 286006/371472 [35:29<7:21:14,  3.23it/s]
 77%|███████▋  | 286007/371472 [35:29<6:54:55,  3.43it/s]
 77%|███████▋  | 286008/371472 [35:29<6:52:59,  3.45it/s]
 77%|███████▋  | 286009/371472 [35:29<7:01:15,  3.38it/s]
 77%|███████▋  | 286010/371472 [35:30<6:52:04,  3.46it/s]
 77%|███████▋  | 286011/371472 [35:30<6:51:39,  3.46it/s]
 77%|███████▋  | 286012/371472 [35:30<7:07:10,  3.33it/s]
 77%|███████▋  | 286013/371472 [35:31<6:51:26,  3.46it/s]
 77%|███████▋  | 286014/371472 [35:31<6:32:47,  3.63it/s]
 77%|███████▋  | 286015/371472 [35:31<6:29:51,  3.65it/s]
 77%|███████▋  | 286016/371472 [35:31<6:33:07,  3.62it/s]
 77%|███████▋  | 286017/371472 [35:32<6:37:54,  3.58it/s]
 77%|███████▋  | 286018/371472 [35:32<6:28:47,  3.66it/s]
 77%|███████▋  | 286019/371472 [35:32<6:27:46,  3.67it/s]
 77%|███████▋  | 286020/371472 [35:33<6:39:40,  3.56it/s]
                                                         
{'loss': 2.8079, 'learning_rate': 3.0714408843112324e-07, 'epoch': 12.32}

 77%|███████▋  | 286020/371472 [35:33<6:39:40,  3.56it/s]
 77%|███████▋  | 286021/371472 [35:33<6:32:23,  3.63it/s]
 77%|███████▋  | 286022/371472 [35:33<6:34:46,  3.61it/s]
 77%|███████▋  | 286023/371472 [35:33<6:35:55,  3.60it/s]
 77%|███████▋  | 286024/371472 [35:34<6:45:43,  3.51it/s]
 77%|███████▋  | 286025/371472 [35:34<6:29:57,  3.65it/s]
 77%|███████▋  | 286026/371472 [35:34<6:19:39,  3.75it/s]
 77%|███████▋  | 286027/371472 [35:34<6:45:54,  3.51it/s]
 77%|███████▋  | 286028/371472 [35:35<7:13:17,  3.29it/s]
 77%|███████▋  | 286029/371472 [35:35<6:57:28,  3.41it/s]
 77%|███████▋  | 286030/371472 [35:35<6:56:37,  3.42it/s]
 77%|███████▋  | 286031/371472 [35:36<6:50:50,  3.47it/s]
 77%|███████▋  | 286032/371472 [35:36<6:44:17,  3.52it/s]
 77%|███████▋  | 286033/371472 [35:36<6:52:10,  3.45it/s]
 77%|███████▋  | 286034/371472 [35:36<6:32:16,  3.63it/s]
 77%|███████▋  | 286035/371472 [35:37<6:32:47,  3.63it/s]
 77%|███████▋  | 286036/371472 [35:37<6:35:52,  3.60it/s]
 77%|███████▋  | 286037/371472 [35:37<6:36:06,  3.59it/s]
 77%|███████▋  | 286038/371472 [35:38<6:25:40,  3.69it/s]
 77%|███████▋  | 286039/371472 [35:38<6:18:20,  3.76it/s]
 77%|███████▋  | 286040/371472 [35:38<6:17:09,  3.78it/s]
                                                         
{'loss': 2.687, 'learning_rate': 3.0709560645564437e-07, 'epoch': 12.32}

 77%|███████▋  | 286040/371472 [35:38<6:17:09,  3.78it/s]
 77%|███████▋  | 286041/371472 [35:38<6:45:32,  3.51it/s]
 77%|███████▋  | 286042/371472 [35:39<6:40:53,  3.55it/s]
 77%|███████▋  | 286043/371472 [35:39<6:55:56,  3.42it/s]
 77%|███████▋  | 286044/371472 [35:39<6:37:06,  3.59it/s]
 77%|███████▋  | 286045/371472 [35:40<7:05:12,  3.35it/s]
 77%|███████▋  | 286046/371472 [35:40<6:56:18,  3.42it/s]
 77%|███████▋  | 286047/371472 [35:40<6:50:38,  3.47it/s]
 77%|███████▋  | 286048/371472 [35:40<6:34:59,  3.60it/s]
 77%|███████▋  | 286049/371472 [35:41<6:29:42,  3.65it/s]
 77%|███████▋  | 286050/371472 [35:41<6:33:38,  3.62it/s]
 77%|███████▋  | 286051/371472 [35:41<6:28:03,  3.67it/s]
 77%|███████▋  | 286052/371472 [35:41<6:21:54,  3.73it/s]
 77%|███████▋  | 286053/371472 [35:42<6:09:44,  3.85it/s]
 77%|███████▋  | 286054/371472 [35:42<6:43:00,  3.53it/s]
 77%|███████▋  | 286055/371472 [35:42<6:50:02,  3.47it/s]
 77%|███████▋  | 286056/371472 [35:43<6:44:31,  3.52it/s]
 77%|███████▋  | 286057/371472 [35:43<6:54:03,  3.44it/s]
 77%|███████▋  | 286058/371472 [35:43<6:40:57,  3.55it/s]
 77%|███████▋  | 286059/371472 [35:43<6:47:40,  3.49it/s]
 77%|███████▋  | 286060/371472 [35:44<6:34:32,  3.61it/s]
                                                         
{'loss': 2.7085, 'learning_rate': 3.0704712448016544e-07, 'epoch': 12.32}

 77%|███████▋  | 286060/371472 [35:44<6:34:32,  3.61it/s]
 77%|███████▋  | 286061/371472 [35:44<6:32:55,  3.62it/s]
 77%|███████▋  | 286062/371472 [35:44<6:31:58,  3.63it/s]
 77%|███████▋  | 286063/371472 [35:45<6:20:08,  3.74it/s]
 77%|███████▋  | 286064/371472 [35:45<6:20:48,  3.74it/s]
 77%|███████▋  | 286065/371472 [35:45<6:31:43,  3.63it/s]
 77%|███████▋  | 286066/371472 [35:45<6:21:18,  3.73it/s]
 77%|███████▋  | 286067/371472 [35:46<6:23:45,  3.71it/s]
 77%|███████▋  | 286068/371472 [35:46<6:53:47,  3.44it/s]
 77%|███████▋  | 286069/371472 [35:46<6:51:27,  3.46it/s]
 77%|███████▋  | 286070/371472 [35:47<7:08:28,  3.32it/s]
 77%|███████▋  | 286071/371472 [35:47<6:57:58,  3.41it/s]
 77%|███████▋  | 286072/371472 [35:47<7:12:40,  3.29it/s]
 77%|███████▋  | 286073/371472 [35:47<6:55:24,  3.43it/s]
 77%|███████▋  | 286074/371472 [35:48<6:54:53,  3.43it/s]
 77%|███████▋  | 286075/371472 [35:48<6:41:43,  3.54it/s]
 77%|███████▋  | 286076/371472 [35:48<6:44:09,  3.52it/s]
 77%|███████▋  | 286077/371472 [35:49<6:56:50,  3.41it/s]
 77%|███████▋  | 286078/371472 [35:49<7:06:29,  3.34it/s]
 77%|███████▋  | 286079/371472 [35:49<7:10:12,  3.31it/s]
 77%|███████▋  | 286080/371472 [35:49<6:47:51,  3.49it/s]
                                                         
{'loss': 2.6768, 'learning_rate': 3.069986425046866e-07, 'epoch': 12.32}

 77%|███████▋  | 286080/371472 [35:49<6:47:51,  3.49it/s]
 77%|███████▋  | 286081/371472 [35:50<8:00:27,  2.96it/s]
 77%|███████▋  | 286082/371472 [35:50<7:26:15,  3.19it/s]
 77%|███████▋  | 286083/371472 [35:51<7:33:42,  3.14it/s]
 77%|███████▋  | 286084/371472 [35:51<7:25:14,  3.20it/s]
 77%|███████▋  | 286085/371472 [35:51<6:54:04,  3.44it/s]
 77%|███████▋  | 286086/371472 [35:51<7:17:55,  3.25it/s]
 77%|███████▋  | 286087/371472 [35:52<7:05:47,  3.34it/s]
 77%|███████▋  | 286088/371472 [35:52<7:04:25,  3.35it/s]
 77%|███████▋  | 286089/371472 [35:52<7:06:32,  3.34it/s]
 77%|███████▋  | 286090/371472 [35:53<6:51:32,  3.46it/s]
 77%|███████▋  | 286091/371472 [35:53<6:39:46,  3.56it/s]
 77%|███████▋  | 286092/371472 [35:53<6:48:20,  3.48it/s]
 77%|███████▋  | 286093/371472 [35:53<6:57:09,  3.41it/s]
 77%|███████▋  | 286094/371472 [35:54<6:56:51,  3.41it/s]
 77%|███████▋  | 286095/371472 [35:54<6:42:52,  3.53it/s]
 77%|███████▋  | 286096/371472 [35:54<6:38:01,  3.58it/s]
 77%|███████▋  | 286097/371472 [35:54<6:29:51,  3.65it/s]
 77%|███████▋  | 286098/371472 [35:55<6:30:34,  3.64it/s]
 77%|███████▋  | 286099/371472 [35:55<6:12:20,  3.82it/s]
 77%|███████▋  | 286100/371472 [35:55<6:21:19,  3.73it/s]
                                                         
{'loss': 2.5259, 'learning_rate': 3.069501605292077e-07, 'epoch': 12.32}

 77%|███████▋  | 286100/371472 [35:55<6:21:19,  3.73it/s]
 77%|███████▋  | 286101/371472 [35:56<6:20:19,  3.74it/s]
 77%|███████▋  | 286102/371472 [35:56<6:23:53,  3.71it/s]
 77%|███████▋  | 286103/371472 [35:56<7:18:58,  3.24it/s]
 77%|███████▋  | 286104/371472 [35:57<7:07:41,  3.33it/s]
 77%|███████▋  | 286105/371472 [35:57<6:52:03,  3.45it/s]
 77%|███████▋  | 286106/371472 [35:57<6:55:51,  3.42it/s]
 77%|███████▋  | 286107/371472 [35:57<6:56:22,  3.42it/s]
 77%|███████▋  | 286108/371472 [35:58<7:08:43,  3.32it/s]
 77%|███████▋  | 286109/371472 [35:58<7:16:05,  3.26it/s]
 77%|███████▋  | 286110/371472 [35:58<7:04:45,  3.35it/s]
 77%|███████▋  | 286111/371472 [35:59<6:56:02,  3.42it/s]
 77%|███████▋  | 286112/371472 [35:59<7:16:44,  3.26it/s]
 77%|███████▋  | 286113/371472 [35:59<6:52:53,  3.45it/s]
 77%|███████▋  | 286114/371472 [35:59<6:39:09,  3.56it/s]
 77%|███████▋  | 286115/371472 [36:00<7:38:42,  3.10it/s]
 77%|███████▋  | 286116/371472 [36:00<7:34:59,  3.13it/s]
 77%|███████▋  | 286117/371472 [36:00<7:11:58,  3.29it/s]
 77%|███████▋  | 286118/371472 [36:01<6:58:18,  3.40it/s]
 77%|███████▋  | 286119/371472 [36:01<6:43:33,  3.53it/s]
 77%|███████▋  | 286120/371472 [36:01<6:36:32,  3.59it/s]
                                                         
{'loss': 2.4748, 'learning_rate': 3.0690167855372886e-07, 'epoch': 12.32}

 77%|███████▋  | 286120/371472 [36:01<6:36:32,  3.59it/s]
 77%|███████▋  | 286121/371472 [36:01<6:30:59,  3.64it/s]
 77%|███████▋  | 286122/371472 [36:02<6:30:22,  3.64it/s]
 77%|███████▋  | 286123/371472 [36:02<6:36:40,  3.59it/s]
 77%|███████▋  | 286124/371472 [36:02<6:29:50,  3.65it/s]
 77%|███████▋  | 286125/371472 [36:03<6:25:21,  3.69it/s]
 77%|███████▋  | 286126/371472 [36:03<6:41:33,  3.54it/s]
 77%|███████▋  | 286127/371472 [36:03<6:35:28,  3.60it/s]
 77%|███████▋  | 286128/371472 [36:03<6:24:01,  3.70it/s]
 77%|███████▋  | 286129/371472 [36:04<6:15:29,  3.79it/s]
 77%|███████▋  | 286130/371472 [36:04<6:34:25,  3.61it/s]
 77%|███████▋  | 286131/371472 [36:04<6:37:51,  3.58it/s]
 77%|███████▋  | 286132/371472 [36:05<7:08:28,  3.32it/s]
 77%|███████▋  | 286133/371472 [36:05<6:53:52,  3.44it/s]
 77%|███████▋  | 286134/371472 [36:05<6:41:25,  3.54it/s]
 77%|███████▋  | 286135/371472 [36:05<7:09:05,  3.31it/s]
 77%|███████▋  | 286136/371472 [36:06<7:07:37,  3.33it/s]
 77%|███████▋  | 286137/371472 [36:06<7:01:29,  3.37it/s]
 77%|███████▋  | 286138/371472 [36:06<6:44:10,  3.52it/s]
 77%|███████▋  | 286139/371472 [36:07<6:35:51,  3.59it/s]
 77%|███████▋  | 286140/371472 [36:07<6:57:00,  3.41it/s]
                                                         
{'loss': 2.5445, 'learning_rate': 3.068531965782499e-07, 'epoch': 12.32}

 77%|███████▋  | 286140/371472 [36:07<6:57:00,  3.41it/s]
 77%|███████▋  | 286141/371472 [36:07<6:47:58,  3.49it/s]
 77%|███████▋  | 286142/371472 [36:07<6:34:23,  3.61it/s]
 77%|███████▋  | 286143/371472 [36:08<6:36:09,  3.59it/s]
 77%|███████▋  | 286144/371472 [36:08<6:17:42,  3.77it/s]
 77%|███████▋  | 286145/371472 [36:08<6:32:39,  3.62it/s]
 77%|███████▋  | 286146/371472 [36:09<6:26:50,  3.68it/s]
 77%|███████▋  | 286147/371472 [36:09<6:22:24,  3.72it/s]
 77%|███████▋  | 286148/371472 [36:09<6:22:00,  3.72it/s]
 77%|███████▋  | 286149/371472 [36:09<6:27:36,  3.67it/s]
 77%|███████▋  | 286150/371472 [36:10<7:06:20,  3.34it/s]
 77%|███████▋  | 286151/371472 [36:10<6:54:31,  3.43it/s]
 77%|███████▋  | 286152/371472 [36:10<6:35:21,  3.60it/s]
 77%|███████▋  | 286153/371472 [36:10<6:29:02,  3.66it/s]
 77%|███████▋  | 286154/371472 [36:11<6:24:21,  3.70it/s]
 77%|███████▋  | 286155/371472 [36:11<6:49:10,  3.48it/s]
 77%|███████▋  | 286156/371472 [36:11<6:43:08,  3.53it/s]
 77%|███████▋  | 286157/371472 [36:12<6:32:10,  3.63it/s]
 77%|███████▋  | 286158/371472 [36:12<6:43:19,  3.53it/s]
 77%|███████▋  | 286159/371472 [36:12<6:32:12,  3.63it/s]
 77%|███████▋  | 286160/371472 [36:12<6:38:18,  3.57it/s]
                                                         
{'loss': 2.6947, 'learning_rate': 3.06804714602771e-07, 'epoch': 12.33}

 77%|███████▋  | 286160/371472 [36:12<6:38:18,  3.57it/s]
 77%|███████▋  | 286161/371472 [36:13<6:54:34,  3.43it/s]
 77%|███████▋  | 286162/371472 [36:13<6:56:04,  3.42it/s]
 77%|███████▋  | 286163/371472 [36:13<6:56:53,  3.41it/s]
 77%|███████▋  | 286164/371472 [36:14<6:52:08,  3.45it/s]
 77%|███████▋  | 286165/371472 [36:14<7:19:00,  3.24it/s]
 77%|███████▋  | 286166/371472 [36:14<7:02:09,  3.37it/s]
 77%|███████▋  | 286167/371472 [36:15<7:03:20,  3.36it/s]
 77%|███████▋  | 286168/371472 [36:15<7:03:34,  3.36it/s]
 77%|███████▋  | 286169/371472 [36:15<6:41:14,  3.54it/s]
 77%|███████▋  | 286170/371472 [36:15<6:28:27,  3.66it/s]
 77%|███████▋  | 286171/371472 [36:16<6:15:09,  3.79it/s]
 77%|███████▋  | 286172/371472 [36:16<6:15:23,  3.79it/s]
 77%|███████▋  | 286173/371472 [36:16<6:11:32,  3.83it/s]
 77%|███████▋  | 286174/371472 [36:16<6:14:35,  3.80it/s]
 77%|███████▋  | 286175/371472 [36:17<6:18:07,  3.76it/s]
 77%|███████▋  | 286176/371472 [36:17<6:41:13,  3.54it/s]
 77%|███████▋  | 286177/371472 [36:17<6:36:01,  3.59it/s]
 77%|███████▋  | 286178/371472 [36:17<6:22:42,  3.71it/s]
 77%|███████▋  | 286179/371472 [36:18<6:35:36,  3.59it/s]
 77%|███████▋  | 286180/371472 [36:18<6:36:06,  3.59it/s]
                                                         
{'loss': 2.7624, 'learning_rate': 3.067562326272921e-07, 'epoch': 12.33}

 77%|███████▋  | 286180/371472 [36:18<6:36:06,  3.59it/s]
 77%|███████▋  | 286181/371472 [36:18<6:38:16,  3.57it/s]
 77%|███████▋  | 286182/371472 [36:19<6:52:00,  3.45it/s]
 77%|███████▋  | 286183/371472 [36:19<6:37:58,  3.57it/s]
 77%|███████▋  | 286184/371472 [36:19<6:33:05,  3.62it/s]
 77%|███████▋  | 286185/371472 [36:19<6:35:17,  3.60it/s]
 77%|███████▋  | 286186/371472 [36:20<7:13:31,  3.28it/s]
 77%|███████▋  | 286187/371472 [36:20<7:11:58,  3.29it/s]
 77%|███████▋  | 286188/371472 [36:20<7:12:37,  3.29it/s]
 77%|███████▋  | 286189/371472 [36:21<7:01:57,  3.37it/s]
 77%|███████▋  | 286190/371472 [36:21<7:52:28,  3.01it/s]
 77%|███████▋  | 286191/371472 [36:21<7:38:15,  3.10it/s]
 77%|███████▋  | 286192/371472 [36:22<7:04:09,  3.35it/s]
 77%|███████▋  | 286193/371472 [36:22<6:41:56,  3.54it/s]
 77%|███████▋  | 286194/371472 [36:22<6:25:34,  3.69it/s]
 77%|███████▋  | 286195/371472 [36:22<6:26:37,  3.68it/s]
 77%|███████▋  | 286196/371472 [36:23<6:39:38,  3.56it/s]
 77%|███████▋  | 286197/371472 [36:23<6:46:36,  3.50it/s]
 77%|███████▋  | 286198/371472 [36:23<6:30:30,  3.64it/s]
 77%|███████▋  | 286199/371472 [36:24<6:27:24,  3.67it/s]
 77%|███████▋  | 286200/371472 [36:24<6:24:34,  3.70it/s]
                                                         
{'loss': 2.6549, 'learning_rate': 3.0670775065181326e-07, 'epoch': 12.33}

 77%|███████▋  | 286200/371472 [36:24<6:24:34,  3.70it/s]
 77%|███████▋  | 286201/371472 [36:24<6:34:18,  3.60it/s]
 77%|███████▋  | 286202/371472 [36:24<6:35:12,  3.60it/s]
 77%|███████▋  | 286203/371472 [36:25<6:54:38,  3.43it/s]
 77%|███████▋  | 286204/371472 [36:25<6:50:53,  3.46it/s]
 77%|███████▋  | 286205/371472 [36:25<6:39:45,  3.55it/s]
 77%|███████▋  | 286206/371472 [36:26<6:35:44,  3.59it/s]
 77%|███████▋  | 286207/371472 [36:26<6:43:51,  3.52it/s]
 77%|███████▋  | 286208/371472 [36:26<7:12:02,  3.29it/s]
 77%|███████▋  | 286209/371472 [36:26<6:56:06,  3.42it/s]
 77%|███████▋  | 286210/371472 [36:27<6:51:48,  3.45it/s]
 77%|███████▋  | 286211/371472 [36:27<6:54:08,  3.43it/s]
 77%|███████▋  | 286212/371472 [36:27<7:11:16,  3.29it/s]
 77%|███████▋  | 286213/371472 [36:28<6:54:47,  3.43it/s]
 77%|███████▋  | 286214/371472 [36:28<6:58:34,  3.39it/s]
 77%|███████▋  | 286215/371472 [36:28<7:18:26,  3.24it/s]
 77%|███████▋  | 286216/371472 [36:29<6:54:23,  3.43it/s]
 77%|███████▋  | 286217/371472 [36:29<6:42:45,  3.53it/s]
 77%|███████▋  | 286218/371472 [36:29<6:40:50,  3.54it/s]
 77%|███████▋  | 286219/371472 [36:29<6:38:44,  3.56it/s]
 77%|███████▋  | 286220/371472 [36:30<6:39:26,  3.56it/s]
                                                         
{'loss': 2.6655, 'learning_rate': 3.0665926867633433e-07, 'epoch': 12.33}

 77%|███████▋  | 286220/371472 [36:30<6:39:26,  3.56it/s]
 77%|███████▋  | 286221/371472 [36:30<6:21:18,  3.73it/s]
 77%|███████▋  | 286222/371472 [36:30<6:19:29,  3.74it/s]
 77%|███████▋  | 286223/371472 [36:30<6:25:57,  3.68it/s]
 77%|███████▋  | 286224/371472 [36:31<6:46:55,  3.49it/s]
 77%|███████▋  | 286225/371472 [36:31<6:46:33,  3.49it/s]
 77%|███████▋  | 286226/371472 [36:31<6:48:34,  3.48it/s]
 77%|███████▋  | 286227/371472 [36:32<6:50:12,  3.46it/s]
 77%|███████▋  | 286228/371472 [36:32<6:33:56,  3.61it/s]
 77%|███████▋  | 286229/371472 [36:32<6:42:27,  3.53it/s]
 77%|███████▋  | 286230/371472 [36:32<6:26:28,  3.68it/s]
 77%|███████▋  | 286231/371472 [36:33<6:26:34,  3.67it/s]
 77%|███████▋  | 286232/371472 [36:33<6:16:31,  3.77it/s]
 77%|███████▋  | 286233/371472 [36:33<6:29:14,  3.65it/s]
 77%|███████▋  | 286234/371472 [36:33<6:29:30,  3.65it/s]
 77%|███████▋  | 286235/371472 [36:34<6:16:07,  3.78it/s]
 77%|███████▋  | 286236/371472 [36:34<6:48:18,  3.48it/s]
 77%|███████▋  | 286237/371472 [36:34<6:35:13,  3.59it/s]
 77%|███████▋  | 286238/371472 [36:35<6:25:14,  3.69it/s]
 77%|███████▋  | 286239/371472 [36:35<6:13:25,  3.80it/s]
 77%|███████▋  | 286240/371472 [36:35<6:26:10,  3.68it/s]
                                                         
{'loss': 2.6721, 'learning_rate': 3.066107867008555e-07, 'epoch': 12.33}

 77%|███████▋  | 286240/371472 [36:35<6:26:10,  3.68it/s]
 77%|███████▋  | 286241/371472 [36:35<6:23:03,  3.71it/s]
 77%|███████▋  | 286242/371472 [36:36<6:59:32,  3.39it/s]
 77%|███████▋  | 286243/371472 [36:36<7:10:28,  3.30it/s]
 77%|███████▋  | 286244/371472 [36:36<6:54:34,  3.43it/s]
 77%|███████▋  | 286245/371472 [36:37<6:41:23,  3.54it/s]
 77%|███████▋  | 286246/371472 [36:37<6:26:15,  3.68it/s]
 77%|███████▋  | 286247/371472 [36:37<6:24:47,  3.69it/s]
 77%|███████▋  | 286248/371472 [36:37<6:25:10,  3.69it/s]
 77%|███████▋  | 286249/371472 [36:38<6:57:19,  3.40it/s]
 77%|███████▋  | 286250/371472 [36:38<7:07:56,  3.32it/s]
 77%|███████▋  | 286251/371472 [36:38<7:00:35,  3.38it/s]
 77%|███████▋  | 286252/371472 [36:39<6:36:28,  3.58it/s]
 77%|███████▋  | 286253/371472 [36:39<6:34:02,  3.60it/s]
 77%|███████▋  | 286254/371472 [36:39<6:31:11,  3.63it/s]
 77%|███████▋  | 286255/371472 [36:39<6:39:23,  3.56it/s]
 77%|███████▋  | 286256/371472 [36:40<6:32:03,  3.62it/s]
 77%|███████▋  | 286257/371472 [36:40<6:24:48,  3.69it/s]
 77%|███████▋  | 286258/371472 [36:40<6:15:24,  3.78it/s]
 77%|███████▋  | 286259/371472 [36:40<6:11:23,  3.82it/s]
 77%|███████▋  | 286260/371472 [36:41<6:06:26,  3.88it/s]
                                                         
{'loss': 2.4617, 'learning_rate': 3.065623047253765e-07, 'epoch': 12.33}

 77%|███████▋  | 286260/371472 [36:41<6:06:26,  3.88it/s]
 77%|███████▋  | 286261/371472 [36:41<6:19:15,  3.74it/s]
 77%|███████▋  | 286262/371472 [36:41<6:27:05,  3.67it/s]
 77%|███████▋  | 286263/371472 [36:42<6:29:03,  3.65it/s]
 77%|███████▋  | 286264/371472 [36:42<6:22:14,  3.72it/s]
 77%|███████▋  | 286265/371472 [36:42<6:24:59,  3.69it/s]
 77%|███████▋  | 286266/371472 [36:42<6:15:48,  3.78it/s]
 77%|███████▋  | 286267/371472 [36:43<6:17:50,  3.76it/s]
 77%|███████▋  | 286268/371472 [36:43<6:53:12,  3.44it/s]
 77%|███████▋  | 286269/371472 [36:43<6:57:52,  3.40it/s]
 77%|███████▋  | 286270/371472 [36:43<6:42:12,  3.53it/s]
 77%|███████▋  | 286271/371472 [36:44<6:45:47,  3.50it/s]
 77%|███████▋  | 286272/371472 [36:44<7:43:33,  3.06it/s]
 77%|███████▋  | 286273/371472 [36:44<7:31:39,  3.14it/s]
 77%|███████▋  | 286274/371472 [36:45<7:38:10,  3.10it/s]
 77%|███████▋  | 286275/371472 [36:45<7:53:19,  3.00it/s]
 77%|███████▋  | 286276/371472 [36:46<7:51:30,  3.01it/s]
 77%|███████▋  | 286277/371472 [36:46<7:32:45,  3.14it/s]
 77%|███████▋  | 286278/371472 [36:46<7:28:25,  3.17it/s]
 77%|███████▋  | 286279/371472 [36:46<7:16:38,  3.25it/s]
 77%|███████▋  | 286280/371472 [36:47<7:25:09,  3.19it/s]
                                                         
{'loss': 2.6777, 'learning_rate': 3.0651382274989765e-07, 'epoch': 12.33}

 77%|███████▋  | 286280/371472 [36:47<7:25:09,  3.19it/s]
 77%|███████▋  | 286281/371472 [36:47<7:08:05,  3.32it/s]
 77%|███████▋  | 286282/371472 [36:47<6:41:40,  3.53it/s]
 77%|███████▋  | 286283/371472 [36:48<6:35:42,  3.59it/s]
 77%|███████▋  | 286284/371472 [36:48<7:04:40,  3.34it/s]
 77%|███████▋  | 286285/371472 [36:48<6:59:00,  3.39it/s]
 77%|███████▋  | 286286/371472 [36:48<6:51:44,  3.45it/s]
 77%|███████▋  | 286287/371472 [36:49<6:36:57,  3.58it/s]
 77%|███████▋  | 286288/371472 [36:49<6:27:49,  3.66it/s]
 77%|███████▋  | 286289/371472 [36:49<6:18:25,  3.75it/s]
 77%|███████▋  | 286290/371472 [36:49<6:24:20,  3.69it/s]
 77%|███████▋  | 286291/371472 [36:50<6:26:31,  3.67it/s]
 77%|███████▋  | 286292/371472 [36:50<6:42:32,  3.53it/s]
 77%|███████▋  | 286293/371472 [36:50<6:26:11,  3.68it/s]
 77%|███████▋  | 286294/371472 [36:51<6:43:03,  3.52it/s]
 77%|███████▋  | 286295/371472 [36:51<7:38:57,  3.09it/s]
 77%|███████▋  | 286296/371472 [36:51<7:18:56,  3.23it/s]
 77%|███████▋  | 286297/371472 [36:52<7:12:20,  3.28it/s]
 77%|███████▋  | 286298/371472 [36:52<6:57:06,  3.40it/s]
 77%|███████▋  | 286299/371472 [36:52<6:58:37,  3.39it/s]
 77%|███████▋  | 286300/371472 [36:52<6:55:17,  3.42it/s]
                                                         
{'loss': 2.7041, 'learning_rate': 3.064653407744187e-07, 'epoch': 12.33}

 77%|███████▋  | 286300/371472 [36:52<6:55:17,  3.42it/s]
 77%|███████▋  | 286301/371472 [36:53<7:56:43,  2.98it/s]
 77%|███████▋  | 286302/371472 [36:53<7:37:24,  3.10it/s]
 77%|███████▋  | 286303/371472 [36:53<7:04:52,  3.34it/s]
 77%|███████▋  | 286304/371472 [36:54<6:52:40,  3.44it/s]
 77%|███████▋  | 286305/371472 [36:54<6:50:40,  3.46it/s]
 77%|███████▋  | 286306/371472 [36:54<6:40:30,  3.54it/s]
 77%|███████▋  | 286307/371472 [36:54<6:30:16,  3.64it/s]
 77%|███████▋  | 286308/371472 [36:55<6:23:38,  3.70it/s]
 77%|███████▋  | 286309/371472 [36:55<6:17:32,  3.76it/s]
 77%|███████▋  | 286310/371472 [36:55<6:16:17,  3.77it/s]
 77%|███████▋  | 286311/371472 [36:56<6:29:27,  3.64it/s]
 77%|███████▋  | 286312/371472 [36:56<6:15:44,  3.78it/s]
 77%|███████▋  | 286313/371472 [36:56<6:34:55,  3.59it/s]
 77%|███████▋  | 286314/371472 [36:56<6:34:58,  3.59it/s]
 77%|███████▋  | 286315/371472 [36:57<6:25:41,  3.68it/s]
 77%|███████▋  | 286316/371472 [36:57<6:57:20,  3.40it/s]
 77%|███████▋  | 286317/371472 [36:57<6:35:56,  3.58it/s]
 77%|███████▋  | 286318/371472 [36:58<6:34:32,  3.60it/s]
 77%|███████▋  | 286319/371472 [36:58<6:43:01,  3.52it/s]
 77%|███████▋  | 286320/371472 [36:58<7:15:23,  3.26it/s]
                                                         
{'loss': 2.6977, 'learning_rate': 3.064168587989398e-07, 'epoch': 12.33}

 77%|███████▋  | 286320/371472 [36:58<7:15:23,  3.26it/s]
 77%|███████▋  | 286321/371472 [36:58<6:59:35,  3.38it/s]
 77%|███████▋  | 286322/371472 [36:59<6:58:05,  3.39it/s]
 77%|███████▋  | 286323/371472 [36:59<7:13:06,  3.28it/s]
 77%|███████▋  | 286324/371472 [36:59<7:22:09,  3.21it/s]
 77%|███████▋  | 286325/371472 [37:00<6:54:56,  3.42it/s]
 77%|███████▋  | 286326/371472 [37:00<6:52:50,  3.44it/s]
 77%|███████▋  | 286327/371472 [37:00<6:32:24,  3.62it/s]
 77%|███████▋  | 286328/371472 [37:00<6:30:17,  3.64it/s]
 77%|███████▋  | 286329/371472 [37:01<6:32:04,  3.62it/s]
 77%|███████▋  | 286330/371472 [37:01<6:57:45,  3.40it/s]
 77%|███████▋  | 286331/371472 [37:01<6:58:25,  3.39it/s]
 77%|███████▋  | 286332/371472 [37:02<6:50:31,  3.46it/s]
 77%|███████▋  | 286333/371472 [37:02<6:42:18,  3.53it/s]
 77%|███████▋  | 286334/371472 [37:02<6:36:34,  3.58it/s]
 77%|███████▋  | 286335/371472 [37:02<6:26:52,  3.67it/s]
 77%|███████▋  | 286336/371472 [37:03<6:45:06,  3.50it/s]
 77%|███████▋  | 286337/371472 [37:03<7:01:48,  3.36it/s]
 77%|███████▋  | 286338/371472 [37:03<6:45:59,  3.49it/s]
 77%|███████▋  | 286339/371472 [37:04<6:55:18,  3.42it/s]
 77%|███████▋  | 286340/371472 [37:04<6:57:25,  3.40it/s]
                                                         
{'loss': 2.6874, 'learning_rate': 3.0636837682346097e-07, 'epoch': 12.33}

 77%|███████▋  | 286340/371472 [37:04<6:57:25,  3.40it/s]
 77%|███████▋  | 286341/371472 [37:04<6:59:04,  3.39it/s]
 77%|███████▋  | 286342/371472 [37:05<7:11:03,  3.29it/s]
 77%|███████▋  | 286343/371472 [37:05<6:52:44,  3.44it/s]
 77%|███████▋  | 286344/371472 [37:05<6:42:11,  3.53it/s]
 77%|███████▋  | 286345/371472 [37:05<6:35:45,  3.58it/s]
 77%|███████▋  | 286346/371472 [37:06<6:33:42,  3.60it/s]
 77%|███████▋  | 286347/371472 [37:06<6:39:31,  3.55it/s]
 77%|███████▋  | 286348/371472 [37:06<6:41:26,  3.53it/s]
 77%|███████▋  | 286349/371472 [37:06<6:39:07,  3.55it/s]
 77%|███████▋  | 286350/371472 [37:07<6:37:58,  3.56it/s]
 77%|███████▋  | 286351/371472 [37:07<6:47:17,  3.48it/s]
 77%|███████▋  | 286352/371472 [37:07<6:36:23,  3.58it/s]
 77%|███████▋  | 286353/371472 [37:08<7:00:24,  3.37it/s]
 77%|███████▋  | 286354/371472 [37:08<6:47:41,  3.48it/s]
 77%|███████▋  | 286355/371472 [37:08<6:43:48,  3.51it/s]
 77%|███████▋  | 286356/371472 [37:08<6:32:40,  3.61it/s]
 77%|███████▋  | 286357/371472 [37:09<6:31:07,  3.63it/s]
 77%|███████▋  | 286358/371472 [37:09<6:28:03,  3.66it/s]
 77%|███████▋  | 286359/371472 [37:09<7:20:16,  3.22it/s]
 77%|███████▋  | 286360/371472 [37:10<7:00:46,  3.37it/s]
                                                         
{'loss': 2.5615, 'learning_rate': 3.0631989484798204e-07, 'epoch': 12.33}

 77%|███████▋  | 286360/371472 [37:10<7:00:46,  3.37it/s]
 77%|███████▋  | 286361/371472 [37:10<7:19:31,  3.23it/s]
 77%|███████▋  | 286362/371472 [37:10<7:07:02,  3.32it/s]
 77%|███████▋  | 286363/371472 [37:11<6:43:11,  3.52it/s]
 77%|███████▋  | 286364/371472 [37:11<6:48:23,  3.47it/s]
 77%|███████▋  | 286365/371472 [37:11<6:50:39,  3.45it/s]
 77%|███████▋  | 286366/371472 [37:12<7:34:19,  3.12it/s]
 77%|███████▋  | 286367/371472 [37:12<7:10:49,  3.29it/s]
 77%|███████▋  | 286368/371472 [37:12<6:52:15,  3.44it/s]
 77%|███████▋  | 286369/371472 [37:12<6:49:03,  3.47it/s]
 77%|███████▋  | 286370/371472 [37:13<6:38:26,  3.56it/s]
 77%|███████▋  | 286371/371472 [37:13<7:02:17,  3.36it/s]
 77%|███████▋  | 286372/371472 [37:13<7:04:36,  3.34it/s]
 77%|███████▋  | 286373/371472 [37:14<7:26:40,  3.18it/s]
 77%|███████▋  | 286374/371472 [37:14<7:03:59,  3.35it/s]
 77%|███████▋  | 286375/371472 [37:14<6:59:02,  3.38it/s]
 77%|███████▋  | 286376/371472 [37:14<6:53:12,  3.43it/s]
 77%|███████▋  | 286377/371472 [37:15<6:38:28,  3.56it/s]
 77%|███████▋  | 286378/371472 [37:15<6:27:28,  3.66it/s]
 77%|███████▋  | 286379/371472 [37:15<6:44:21,  3.51it/s]
 77%|███████▋  | 286380/371472 [37:15<6:30:42,  3.63it/s]
                                                         
{'loss': 2.6366, 'learning_rate': 3.0627141287250316e-07, 'epoch': 12.33}

 77%|███████▋  | 286380/371472 [37:15<6:30:42,  3.63it/s]
 77%|███████▋  | 286381/371472 [37:16<6:29:57,  3.64it/s]
 77%|███████▋  | 286382/371472 [37:16<6:28:16,  3.65it/s]
 77%|███████▋  | 286383/371472 [37:16<6:37:57,  3.56it/s]
 77%|███████▋  | 286384/371472 [37:17<7:03:58,  3.34it/s]
 77%|███████▋  | 286385/371472 [37:17<7:05:16,  3.33it/s]
 77%|███████▋  | 286386/371472 [37:17<7:46:36,  3.04it/s]
 77%|███████▋  | 286387/371472 [37:18<7:16:48,  3.25it/s]
 77%|███████▋  | 286388/371472 [37:18<7:14:38,  3.26it/s]
 77%|███████▋  | 286389/371472 [37:18<8:22:13,  2.82it/s]
 77%|███████▋  | 286390/371472 [37:19<7:42:55,  3.06it/s]
 77%|███████▋  | 286391/371472 [37:19<7:23:31,  3.20it/s]
 77%|███████▋  | 286392/371472 [37:19<7:22:40,  3.20it/s]
 77%|███████▋  | 286393/371472 [37:20<7:04:10,  3.34it/s]
 77%|███████▋  | 286394/371472 [37:20<7:27:03,  3.17it/s]
 77%|███████▋  | 286395/371472 [37:20<7:21:30,  3.21it/s]
 77%|███████▋  | 286396/371472 [37:20<7:25:28,  3.18it/s]
 77%|███████▋  | 286397/371472 [37:21<7:12:02,  3.28it/s]
 77%|███████▋  | 286398/371472 [37:21<8:07:02,  2.91it/s]
 77%|███████▋  | 286399/371472 [37:21<7:26:52,  3.17it/s]
 77%|███████▋  | 286400/371472 [37:22<7:02:14,  3.36it/s]
                                                         
{'loss': 2.7173, 'learning_rate': 3.0622293089702424e-07, 'epoch': 12.34}

 77%|███████▋  | 286400/371472 [37:22<7:02:14,  3.36it/s]
 77%|███████▋  | 286401/371472 [37:22<6:44:28,  3.51it/s]
 77%|███████▋  | 286402/371472 [37:22<6:39:11,  3.55it/s]
 77%|███████▋  | 286403/371472 [37:23<6:53:11,  3.43it/s]
 77%|███████▋  | 286404/371472 [37:23<6:50:45,  3.45it/s]
 77%|███████▋  | 286405/371472 [37:23<6:57:03,  3.40it/s]
 77%|███████▋  | 286406/371472 [37:23<6:46:53,  3.48it/s]
 77%|███████▋  | 286407/371472 [37:24<6:53:09,  3.43it/s]
 77%|███████▋  | 286408/371472 [37:24<6:50:05,  3.46it/s]
 77%|███████▋  | 286409/371472 [37:24<6:46:23,  3.49it/s]
 77%|███████▋  | 286410/371472 [37:25<6:56:10,  3.41it/s]
 77%|███████▋  | 286411/371472 [37:25<6:40:54,  3.54it/s]
 77%|███████▋  | 286412/371472 [37:25<6:55:46,  3.41it/s]
 77%|███████▋  | 286413/371472 [37:25<6:46:40,  3.49it/s]
 77%|███████▋  | 286414/371472 [37:26<6:38:09,  3.56it/s]
 77%|███████▋  | 286415/371472 [37:26<6:30:28,  3.63it/s]
 77%|███████▋  | 286416/371472 [37:26<6:48:35,  3.47it/s]
 77%|███████▋  | 286417/371472 [37:27<6:37:01,  3.57it/s]
 77%|███████▋  | 286418/371472 [37:27<6:31:23,  3.62it/s]
 77%|███████▋  | 286419/371472 [37:27<6:42:37,  3.52it/s]
 77%|███████▋  | 286420/371472 [37:27<6:44:31,  3.50it/s]
                                                         
{'loss': 2.6211, 'learning_rate': 3.0617444892154536e-07, 'epoch': 12.34}

 77%|███████▋  | 286420/371472 [37:27<6:44:31,  3.50it/s]
 77%|███████▋  | 286421/371472 [37:28<6:41:57,  3.53it/s]
 77%|███████▋  | 286422/371472 [37:28<6:28:17,  3.65it/s]
 77%|███████▋  | 286423/371472 [37:28<6:19:00,  3.74it/s]
 77%|███████▋  | 286424/371472 [37:29<6:38:20,  3.56it/s]
 77%|███████▋  | 286425/371472 [37:29<6:39:41,  3.55it/s]
 77%|███████▋  | 286426/371472 [37:29<6:42:50,  3.52it/s]
 77%|███████▋  | 286427/371472 [37:29<7:05:00,  3.34it/s]
 77%|███████▋  | 286428/371472 [37:30<7:06:01,  3.33it/s]
 77%|███████▋  | 286429/371472 [37:30<6:51:57,  3.44it/s]
 77%|███████▋  | 286430/371472 [37:30<6:43:55,  3.51it/s]
 77%|███████▋  | 286431/371472 [37:31<6:57:18,  3.40it/s]
 77%|███████▋  | 286432/371472 [37:31<6:46:32,  3.49it/s]
 77%|███████▋  | 286433/371472 [37:31<6:36:35,  3.57it/s]
 77%|███████▋  | 286434/371472 [37:31<6:25:08,  3.68it/s]
 77%|███████▋  | 286435/371472 [37:32<6:23:05,  3.70it/s]
 77%|███████▋  | 286436/371472 [37:32<6:18:31,  3.74it/s]
 77%|███████▋  | 286437/371472 [37:32<6:16:23,  3.77it/s]
 77%|███████▋  | 286438/371472 [37:32<6:23:40,  3.69it/s]
 77%|███████▋  | 286439/371472 [37:33<6:13:47,  3.79it/s]
 77%|███████▋  | 286440/371472 [37:33<6:18:53,  3.74it/s]
                                                         
{'loss': 2.5845, 'learning_rate': 3.0612596694606643e-07, 'epoch': 12.34}

 77%|███████▋  | 286440/371472 [37:33<6:18:53,  3.74it/s]
 77%|███████▋  | 286441/371472 [37:33<6:22:59,  3.70it/s]
 77%|███████▋  | 286442/371472 [37:34<6:54:52,  3.42it/s]
 77%|███████▋  | 286443/371472 [37:34<6:38:37,  3.56it/s]
 77%|███████▋  | 286444/371472 [37:34<6:29:04,  3.64it/s]
 77%|███████▋  | 286445/371472 [37:34<6:24:07,  3.69it/s]
 77%|███████▋  | 286446/371472 [37:35<6:24:23,  3.69it/s]
 77%|███████▋  | 286447/371472 [37:35<6:22:36,  3.70it/s]
 77%|███████▋  | 286448/371472 [37:35<6:42:21,  3.52it/s]
 77%|███████▋  | 286449/371472 [37:35<6:33:37,  3.60it/s]
 77%|███████▋  | 286450/371472 [37:36<6:25:25,  3.68it/s]
 77%|███████▋  | 286451/371472 [37:36<6:35:17,  3.58it/s]
 77%|███████▋  | 286452/371472 [37:36<6:44:23,  3.50it/s]
 77%|███████▋  | 286453/371472 [37:37<6:43:25,  3.51it/s]
 77%|███████▋  | 286454/371472 [37:37<6:45:36,  3.49it/s]
 77%|███████▋  | 286455/371472 [37:37<6:37:58,  3.56it/s]
 77%|███████▋  | 286456/371472 [37:37<6:30:39,  3.63it/s]
 77%|███████▋  | 286457/371472 [37:38<6:25:26,  3.68it/s]
 77%|███████▋  | 286458/371472 [37:38<6:14:28,  3.78it/s]
 77%|███████▋  | 286459/371472 [37:38<6:17:03,  3.76it/s]
 77%|███████▋  | 286460/371472 [37:38<6:17:42,  3.75it/s]
                                                         
{'loss': 2.5355, 'learning_rate': 3.060774849705876e-07, 'epoch': 12.34}

 77%|███████▋  | 286460/371472 [37:38<6:17:42,  3.75it/s]
 77%|███████▋  | 286461/371472 [37:39<6:13:05,  3.80it/s]
 77%|███████▋  | 286462/371472 [37:39<6:22:31,  3.70it/s]
 77%|███████▋  | 286463/371472 [37:39<6:24:44,  3.68it/s]
 77%|███████▋  | 286464/371472 [37:40<6:29:17,  3.64it/s]
 77%|███████▋  | 286465/371472 [37:40<6:37:57,  3.56it/s]
 77%|███████▋  | 286466/371472 [37:40<7:08:19,  3.31it/s]
 77%|███████▋  | 286467/371472 [37:41<7:06:57,  3.32it/s]
 77%|███████▋  | 286468/371472 [37:41<7:00:47,  3.37it/s]
 77%|███████▋  | 286469/371472 [37:41<7:03:32,  3.34it/s]
 77%|███████▋  | 286470/371472 [37:41<6:50:21,  3.45it/s]
 77%|███████▋  | 286471/371472 [37:42<7:24:43,  3.19it/s]
 77%|███████▋  | 286472/371472 [37:42<7:13:43,  3.27it/s]
 77%|███████▋  | 286473/371472 [37:42<7:10:34,  3.29it/s]
 77%|███████▋  | 286474/371472 [37:43<6:47:50,  3.47it/s]
 77%|███████▋  | 286475/371472 [37:43<6:27:34,  3.66it/s]
 77%|███████▋  | 286476/371472 [37:43<6:30:30,  3.63it/s]
 77%|███████▋  | 286477/371472 [37:43<6:19:17,  3.73it/s]
 77%|███████▋  | 286478/371472 [37:44<6:41:53,  3.52it/s]
 77%|███████▋  | 286479/371472 [37:44<6:53:19,  3.43it/s]
 77%|███████▋  | 286480/371472 [37:44<6:35:36,  3.58it/s]
                                                         
{'loss': 2.4594, 'learning_rate': 3.060290029951087e-07, 'epoch': 12.34}

 77%|███████▋  | 286480/371472 [37:44<6:35:36,  3.58it/s]
 77%|███████▋  | 286481/371472 [37:45<6:35:46,  3.58it/s]
 77%|███████▋  | 286482/371472 [37:45<6:30:13,  3.63it/s]
 77%|███████▋  | 286483/371472 [37:45<6:26:19,  3.67it/s]
 77%|███████▋  | 286484/371472 [37:45<6:48:25,  3.47it/s]
 77%|███████▋  | 286485/371472 [37:46<6:37:02,  3.57it/s]
 77%|███████▋  | 286486/371472 [37:46<6:24:16,  3.69it/s]
 77%|███████▋  | 286487/371472 [37:46<6:34:31,  3.59it/s]
 77%|███████▋  | 286488/371472 [37:46<6:25:43,  3.67it/s]
 77%|███████▋  | 286489/371472 [37:47<6:36:04,  3.58it/s]
 77%|███████▋  | 286490/371472 [37:47<6:55:56,  3.41it/s]
 77%|███████▋  | 286491/371472 [37:47<6:48:33,  3.47it/s]
 77%|███████▋  | 286492/371472 [37:48<6:33:12,  3.60it/s]
 77%|███████▋  | 286493/371472 [37:48<6:33:22,  3.60it/s]
 77%|███████▋  | 286494/371472 [37:48<6:33:23,  3.60it/s]
 77%|███████▋  | 286495/371472 [37:48<6:30:31,  3.63it/s]
 77%|███████▋  | 286496/371472 [37:49<6:49:06,  3.46it/s]
 77%|███████▋  | 286497/371472 [37:49<6:40:31,  3.54it/s]
 77%|███████▋  | 286498/371472 [37:49<6:52:03,  3.44it/s]
 77%|███████▋  | 286499/371472 [37:50<6:55:21,  3.41it/s]
 77%|███████▋  | 286500/371472 [37:50<6:47:42,  3.47it/s]
                                                         
{'loss': 2.6302, 'learning_rate': 3.0598052101962986e-07, 'epoch': 12.34}

 77%|███████▋  | 286500/371472 [37:50<6:47:42,  3.47it/s]
 77%|███████▋  | 286501/371472 [37:50<6:43:29,  3.51it/s]
 77%|███████▋  | 286502/371472 [37:50<6:58:03,  3.39it/s]
 77%|███████▋  | 286503/371472 [37:51<6:43:07,  3.51it/s]
 77%|███████▋  | 286504/371472 [37:51<6:38:59,  3.55it/s]
 77%|███████▋  | 286505/371472 [37:51<6:48:54,  3.46it/s]
 77%|███████▋  | 286506/371472 [37:52<6:40:03,  3.54it/s]
 77%|███████▋  | 286507/371472 [37:52<6:41:21,  3.53it/s]
 77%|███████▋  | 286508/371472 [37:52<7:05:38,  3.33it/s]
 77%|███████▋  | 286509/371472 [37:52<6:51:19,  3.44it/s]
 77%|███████▋  | 286510/371472 [37:53<6:40:25,  3.54it/s]
 77%|███████▋  | 286511/371472 [37:53<6:55:29,  3.41it/s]
 77%|███████▋  | 286512/371472 [37:53<6:49:12,  3.46it/s]
 77%|███████▋  | 286513/371472 [37:54<6:57:48,  3.39it/s]
 77%|███████▋  | 286514/371472 [37:54<6:51:49,  3.44it/s]
 77%|███████▋  | 286515/371472 [37:54<6:46:02,  3.49it/s]
 77%|███████▋  | 286516/371472 [37:55<7:10:03,  3.29it/s]
 77%|███████▋  | 286517/371472 [37:55<6:48:45,  3.46it/s]
 77%|███████▋  | 286518/371472 [37:55<6:41:12,  3.53it/s]
 77%|███████▋  | 286519/371472 [37:55<6:43:27,  3.51it/s]
 77%|███████▋  | 286520/371472 [37:56<6:43:27,  3.51it/s]
                                                         
{'loss': 2.7743, 'learning_rate': 3.059320390441509e-07, 'epoch': 12.34}

 77%|███████▋  | 286520/371472 [37:56<6:43:27,  3.51it/s]
 77%|███████▋  | 286521/371472 [37:56<6:51:39,  3.44it/s]
 77%|███████▋  | 286522/371472 [37:56<7:15:30,  3.25it/s]
 77%|███████▋  | 286523/371472 [37:57<7:24:30,  3.19it/s]
 77%|███████▋  | 286524/371472 [37:57<7:19:00,  3.22it/s]
 77%|███████▋  | 286525/371472 [37:57<7:12:31,  3.27it/s]
 77%|███████▋  | 286526/371472 [37:57<6:49:03,  3.46it/s]
 77%|███████▋  | 286527/371472 [37:58<6:48:12,  3.47it/s]
 77%|███████▋  | 286528/371472 [37:58<6:43:44,  3.51it/s]
 77%|███████▋  | 286529/371472 [37:58<6:33:29,  3.60it/s]
 77%|███████▋  | 286530/371472 [37:59<6:37:28,  3.56it/s]
 77%|███████▋  | 286531/371472 [37:59<6:25:27,  3.67it/s]
 77%|███████▋  | 286532/371472 [37:59<6:23:31,  3.69it/s]
 77%|███████▋  | 286533/371472 [38:00<7:20:50,  3.21it/s]
 77%|███████▋  | 286534/371472 [38:00<6:58:51,  3.38it/s]
 77%|███████▋  | 286535/371472 [38:00<6:49:14,  3.46it/s]
 77%|███████▋  | 286536/371472 [38:00<6:28:27,  3.64it/s]
 77%|███████▋  | 286537/371472 [38:01<6:27:05,  3.66it/s]
 77%|███████▋  | 286538/371472 [38:01<6:17:22,  3.75it/s]
 77%|███████▋  | 286539/371472 [38:01<6:23:30,  3.69it/s]
 77%|███████▋  | 286540/371472 [38:01<6:21:33,  3.71it/s]
                                                         
{'loss': 2.6027, 'learning_rate': 3.05883557068672e-07, 'epoch': 12.34}

 77%|███████▋  | 286540/371472 [38:01<6:21:33,  3.71it/s]
 77%|███████▋  | 286541/371472 [38:02<6:42:33,  3.52it/s]
 77%|███████▋  | 286542/371472 [38:02<6:34:46,  3.59it/s]
 77%|███████▋  | 286543/371472 [38:02<6:31:59,  3.61it/s]
 77%|███████▋  | 286544/371472 [38:03<6:52:09,  3.43it/s]
 77%|███████▋  | 286545/371472 [38:03<6:36:50,  3.57it/s]
 77%|███████▋  | 286546/371472 [38:03<6:25:02,  3.68it/s]
 77%|███████▋  | 286547/371472 [38:03<6:35:38,  3.58it/s]
 77%|███████▋  | 286548/371472 [38:04<6:42:29,  3.52it/s]
 77%|███████▋  | 286549/371472 [38:04<6:38:29,  3.55it/s]
 77%|███████▋  | 286550/371472 [38:04<6:21:11,  3.71it/s]
 77%|███████▋  | 286551/371472 [38:04<6:30:49,  3.62it/s]
 77%|███████▋  | 286552/371472 [38:05<6:32:24,  3.61it/s]
 77%|███████▋  | 286553/371472 [38:05<6:38:58,  3.55it/s]
 77%|███████▋  | 286554/371472 [38:05<6:26:17,  3.66it/s]
 77%|███████▋  | 286555/371472 [38:06<6:59:38,  3.37it/s]
 77%|███████▋  | 286556/371472 [38:06<7:14:07,  3.26it/s]
 77%|███████▋  | 286557/371472 [38:06<7:21:11,  3.21it/s]
 77%|███████▋  | 286558/371472 [38:07<7:09:53,  3.29it/s]
 77%|███████▋  | 286559/371472 [38:07<7:26:56,  3.17it/s]
 77%|███████▋  | 286560/371472 [38:07<7:30:12,  3.14it/s]
                                                         
{'loss': 2.6636, 'learning_rate': 3.0583507509319307e-07, 'epoch': 12.34}

 77%|███████▋  | 286560/371472 [38:07<7:30:12,  3.14it/s]
 77%|███████▋  | 286561/371472 [38:08<7:23:07,  3.19it/s]
 77%|███████▋  | 286562/371472 [38:08<7:11:38,  3.28it/s]
 77%|███████▋  | 286563/371472 [38:08<7:23:01,  3.19it/s]
 77%|███████▋  | 286564/371472 [38:08<7:27:29,  3.16it/s]
 77%|███████▋  | 286565/371472 [38:09<8:00:34,  2.94it/s]
 77%|███████▋  | 286566/371472 [38:09<7:36:02,  3.10it/s]
 77%|███████▋  | 286567/371472 [38:09<7:14:15,  3.26it/s]
 77%|███████▋  | 286568/371472 [38:10<6:50:24,  3.45it/s]
 77%|███████▋  | 286569/371472 [38:10<6:48:40,  3.46it/s]
 77%|███████▋  | 286570/371472 [38:10<6:39:46,  3.54it/s]
 77%|███████▋  | 286571/371472 [38:11<6:33:13,  3.60it/s]
 77%|███████▋  | 286572/371472 [38:11<6:29:58,  3.63it/s]
 77%|███████▋  | 286573/371472 [38:11<6:53:18,  3.42it/s]
 77%|███████▋  | 286574/371472 [38:11<7:00:57,  3.36it/s]
 77%|███████▋  | 286575/371472 [38:12<6:55:33,  3.40it/s]
 77%|███████▋  | 286576/371472 [38:12<6:47:50,  3.47it/s]
 77%|███████▋  | 286577/371472 [38:12<7:00:49,  3.36it/s]
 77%|███████▋  | 286578/371472 [38:13<6:36:22,  3.57it/s]
 77%|███████▋  | 286579/371472 [38:13<6:40:04,  3.54it/s]
 77%|███████▋  | 286580/371472 [38:13<6:31:52,  3.61it/s]
                                                         
{'loss': 2.6098, 'learning_rate': 3.0578659311771425e-07, 'epoch': 12.34}

 77%|███████▋  | 286580/371472 [38:13<6:31:52,  3.61it/s]
 77%|███████▋  | 286581/371472 [38:13<6:24:54,  3.68it/s]
 77%|███████▋  | 286582/371472 [38:14<6:22:26,  3.70it/s]
 77%|███████▋  | 286583/371472 [38:14<6:40:26,  3.53it/s]
 77%|███████▋  | 286584/371472 [38:14<6:30:42,  3.62it/s]
 77%|███████▋  | 286585/371472 [38:14<6:23:54,  3.69it/s]
 77%|███████▋  | 286586/371472 [38:15<6:14:15,  3.78it/s]
 77%|███████▋  | 286587/371472 [38:15<6:21:24,  3.71it/s]
 77%|███████▋  | 286588/371472 [38:15<7:00:31,  3.36it/s]
 77%|███████▋  | 286589/371472 [38:16<6:42:09,  3.52it/s]
 77%|███████▋  | 286590/371472 [38:16<6:30:07,  3.63it/s]
 77%|███████▋  | 286591/371472 [38:16<6:23:36,  3.69it/s]
 77%|███████▋  | 286592/371472 [38:16<6:20:47,  3.71it/s]
 77%|███████▋  | 286593/371472 [38:17<6:18:56,  3.73it/s]
 77%|███████▋  | 286594/371472 [38:17<6:15:22,  3.77it/s]
 77%|███████▋  | 286595/371472 [38:17<6:14:51,  3.77it/s]
 77%|███████▋  | 286596/371472 [38:17<6:03:59,  3.89it/s]
 77%|███████▋  | 286597/371472 [38:18<6:29:00,  3.64it/s]
 77%|███████▋  | 286598/371472 [38:18<6:36:07,  3.57it/s]
 77%|███████▋  | 286599/371472 [38:18<6:39:20,  3.54it/s]
 77%|███████▋  | 286600/371472 [38:19<6:27:31,  3.65it/s]
                                                         
{'loss': 2.7154, 'learning_rate': 3.057381111422353e-07, 'epoch': 12.34}

 77%|███████▋  | 286600/371472 [38:19<6:27:31,  3.65it/s]
 77%|███████▋  | 286601/371472 [38:19<6:38:01,  3.55it/s]
 77%|███████▋  | 286602/371472 [38:19<6:29:25,  3.63it/s]
 77%|███████▋  | 286603/371472 [38:19<6:58:07,  3.38it/s]
 77%|███████▋  | 286604/371472 [38:20<7:13:44,  3.26it/s]
 77%|███████▋  | 286605/371472 [38:20<7:12:22,  3.27it/s]
 77%|███████▋  | 286606/371472 [38:20<7:00:38,  3.36it/s]
 77%|███████▋  | 286607/371472 [38:21<6:56:10,  3.40it/s]
 77%|███████▋  | 286608/371472 [38:21<6:56:53,  3.39it/s]
 77%|███████▋  | 286609/371472 [38:21<6:47:18,  3.47it/s]
 77%|███████▋  | 286610/371472 [38:22<6:57:40,  3.39it/s]
 77%|███████▋  | 286611/371472 [38:22<6:45:55,  3.48it/s]
 77%|███████▋  | 286612/371472 [38:22<6:44:07,  3.50it/s]
 77%|███████▋  | 286613/371472 [38:22<6:35:12,  3.58it/s]
 77%|███████▋  | 286614/371472 [38:23<6:40:03,  3.54it/s]
 77%|███████▋  | 286615/371472 [38:23<6:36:49,  3.56it/s]
 77%|███████▋  | 286616/371472 [38:23<6:38:15,  3.55it/s]
 77%|███████▋  | 286617/371472 [38:24<6:43:49,  3.50it/s]
 77%|███████▋  | 286618/371472 [38:24<7:39:12,  3.08it/s]
 77%|███████▋  | 286619/371472 [38:24<7:35:15,  3.11it/s]
 77%|███████▋  | 286620/371472 [38:25<7:33:35,  3.12it/s]
                                                         
{'loss': 2.5915, 'learning_rate': 3.056896291667565e-07, 'epoch': 12.35}

 77%|███████▋  | 286620/371472 [38:25<7:33:35,  3.12it/s]
 77%|███████▋  | 286621/371472 [38:25<7:12:30,  3.27it/s]
 77%|███████▋  | 286622/371472 [38:25<6:59:47,  3.37it/s]
 77%|███████▋  | 286623/371472 [38:25<7:35:02,  3.11it/s]
 77%|███████▋  | 286624/371472 [38:26<7:27:37,  3.16it/s]
 77%|███████▋  | 286625/371472 [38:26<7:21:36,  3.20it/s]
 77%|███████▋  | 286626/371472 [38:26<7:30:03,  3.14it/s]
 77%|███████▋  | 286627/371472 [38:27<7:40:38,  3.07it/s]
 77%|███████▋  | 286628/371472 [38:27<7:43:19,  3.05it/s]
 77%|███████▋  | 286629/371472 [38:27<7:25:56,  3.17it/s]
 77%|███████▋  | 286630/371472 [38:28<7:18:21,  3.23it/s]
 77%|███████▋  | 286631/371472 [38:28<7:21:01,  3.21it/s]
 77%|███████▋  | 286632/371472 [38:28<7:11:37,  3.28it/s]
 77%|███████▋  | 286633/371472 [38:29<7:03:37,  3.34it/s]
 77%|███████▋  | 286634/371472 [38:29<7:04:54,  3.33it/s]
 77%|███████▋  | 286635/371472 [38:29<6:57:08,  3.39it/s]
 77%|███████▋  | 286636/371472 [38:29<6:39:42,  3.54it/s]
 77%|███████▋  | 286637/371472 [38:30<6:34:32,  3.58it/s]
 77%|███████▋  | 286638/371472 [38:30<6:29:23,  3.63it/s]
 77%|███████▋  | 286639/371472 [38:30<6:45:01,  3.49it/s]
 77%|███████▋  | 286640/371472 [38:31<6:47:51,  3.47it/s]
                                                         
{'loss': 2.6958, 'learning_rate': 3.056411471912775e-07, 'epoch': 12.35}

 77%|███████▋  | 286640/371472 [38:31<6:47:51,  3.47it/s]
 77%|███████▋  | 286641/371472 [38:31<7:04:07,  3.33it/s]
 77%|███████▋  | 286642/371472 [38:31<6:50:47,  3.44it/s]
 77%|███████▋  | 286643/371472 [38:31<6:55:16,  3.40it/s]
 77%|███████▋  | 286644/371472 [38:32<6:44:34,  3.49it/s]
 77%|███████▋  | 286645/371472 [38:32<6:56:46,  3.39it/s]
 77%|███████▋  | 286646/371472 [38:32<6:52:15,  3.43it/s]
 77%|███████▋  | 286647/371472 [38:33<7:03:56,  3.33it/s]
 77%|███████▋  | 286648/371472 [38:33<7:06:42,  3.31it/s]
 77%|███████▋  | 286649/371472 [38:33<6:48:40,  3.46it/s]
 77%|███████▋  | 286650/371472 [38:33<6:44:11,  3.50it/s]
 77%|███████▋  | 286651/371472 [38:34<7:03:39,  3.34it/s]
 77%|███████▋  | 286652/371472 [38:34<6:53:03,  3.42it/s]
 77%|███████▋  | 286653/371472 [38:34<6:47:45,  3.47it/s]
 77%|███████▋  | 286654/371472 [38:35<6:43:59,  3.50it/s]
 77%|███████▋  | 286655/371472 [38:35<6:36:38,  3.56it/s]
 77%|███████▋  | 286656/371472 [38:35<6:44:10,  3.50it/s]
 77%|███████▋  | 286657/371472 [38:35<6:35:23,  3.58it/s]
 77%|███████▋  | 286658/371472 [38:36<6:45:47,  3.48it/s]
 77%|███████▋  | 286659/371472 [38:36<6:50:09,  3.45it/s]
 77%|███████▋  | 286660/371472 [38:36<7:03:10,  3.34it/s]
                                                         
{'loss': 2.6378, 'learning_rate': 3.055926652157987e-07, 'epoch': 12.35}

 77%|███████▋  | 286660/371472 [38:36<7:03:10,  3.34it/s]
 77%|███████▋  | 286661/371472 [38:37<6:51:08,  3.44it/s]
 77%|███████▋  | 286662/371472 [38:37<6:37:16,  3.56it/s]
 77%|███████▋  | 286663/371472 [38:37<6:29:27,  3.63it/s]
 77%|███████▋  | 286664/371472 [38:37<6:39:35,  3.54it/s]
 77%|███████▋  | 286665/371472 [38:38<6:25:18,  3.67it/s]
 77%|███████▋  | 286666/371472 [38:38<6:20:20,  3.72it/s]
 77%|███████▋  | 286667/371472 [38:38<6:24:31,  3.68it/s]
 77%|███████▋  | 286668/371472 [38:39<6:34:47,  3.58it/s]
 77%|███████▋  | 286669/371472 [38:39<6:26:06,  3.66it/s]
 77%|███████▋  | 286670/371472 [38:39<6:28:21,  3.64it/s]
 77%|███████▋  | 286671/371472 [38:39<6:26:16,  3.66it/s]
 77%|███████▋  | 286672/371472 [38:40<6:50:28,  3.44it/s]
 77%|███████▋  | 286673/371472 [38:40<6:58:56,  3.37it/s]
 77%|███████▋  | 286674/371472 [38:40<6:56:06,  3.40it/s]
 77%|███████▋  | 286675/371472 [38:41<6:43:53,  3.50it/s]
 77%|███████▋  | 286676/371472 [38:41<6:33:40,  3.59it/s]
 77%|███████▋  | 286677/371472 [38:41<6:49:15,  3.45it/s]
 77%|███████▋  | 286678/371472 [38:41<6:38:44,  3.54it/s]
 77%|███████▋  | 286679/371472 [38:42<6:34:49,  3.58it/s]
 77%|███████▋  | 286680/371472 [38:42<6:28:22,  3.64it/s]
                                                         
{'loss': 2.7855, 'learning_rate': 3.055441832403197e-07, 'epoch': 12.35}

 77%|███████▋  | 286680/371472 [38:42<6:28:22,  3.64it/s]
 77%|███████▋  | 286681/371472 [38:42<6:24:03,  3.68it/s]
 77%|███████▋  | 286682/371472 [38:43<6:28:18,  3.64it/s]
 77%|███████▋  | 286683/371472 [38:43<6:24:21,  3.68it/s]
 77%|███████▋  | 286684/371472 [38:43<6:28:12,  3.64it/s]
 77%|███████▋  | 286685/371472 [38:43<6:17:43,  3.74it/s]
 77%|███████▋  | 286686/371472 [38:44<6:12:05,  3.80it/s]
 77%|███████▋  | 286687/371472 [38:44<6:24:15,  3.68it/s]
 77%|███████▋  | 286688/371472 [38:44<6:53:01,  3.42it/s]
 77%|███████▋  | 286689/371472 [38:45<7:18:44,  3.22it/s]
 77%|███████▋  | 286690/371472 [38:45<7:21:13,  3.20it/s]
 77%|███████▋  | 286691/371472 [38:45<7:08:33,  3.30it/s]
 77%|███████▋  | 286692/371472 [38:45<6:56:28,  3.39it/s]
 77%|███████▋  | 286693/371472 [38:46<7:03:26,  3.34it/s]
 77%|███████▋  | 286694/371472 [38:46<7:07:47,  3.30it/s]
 77%|███████▋  | 286695/371472 [38:46<7:18:39,  3.22it/s]
 77%|███████▋  | 286696/371472 [38:47<7:13:12,  3.26it/s]
 77%|███████▋  | 286697/371472 [38:47<6:44:47,  3.49it/s]
 77%|███████▋  | 286698/371472 [38:47<6:42:06,  3.51it/s]
 77%|███████▋  | 286699/371472 [38:47<6:53:01,  3.42it/s]
 77%|███████▋  | 286700/371472 [38:48<7:10:26,  3.28it/s]
                                                         
{'loss': 2.7904, 'learning_rate': 3.054957012648409e-07, 'epoch': 12.35}

 77%|███████▋  | 286700/371472 [38:48<7:10:26,  3.28it/s]
 77%|███████▋  | 286701/371472 [38:48<7:12:14,  3.27it/s]
 77%|███████▋  | 286702/371472 [38:48<6:49:24,  3.45it/s]
 77%|███████▋  | 286703/371472 [38:49<6:59:04,  3.37it/s]
 77%|███████▋  | 286704/371472 [38:49<7:03:15,  3.34it/s]
 77%|███████▋  | 286705/371472 [38:49<6:51:57,  3.43it/s]
 77%|███████▋  | 286706/371472 [38:50<7:00:36,  3.36it/s]
 77%|███████▋  | 286707/371472 [38:50<6:43:43,  3.50it/s]
 77%|███████▋  | 286708/371472 [38:50<6:40:09,  3.53it/s]
 77%|███████▋  | 286709/371472 [38:50<6:55:38,  3.40it/s]
 77%|███████▋  | 286710/371472 [38:51<7:03:04,  3.34it/s]
 77%|███████▋  | 286711/371472 [38:51<6:46:13,  3.48it/s]
 77%|███████▋  | 286712/371472 [38:51<6:46:40,  3.47it/s]
 77%|███████▋  | 286713/371472 [38:52<6:49:56,  3.45it/s]
 77%|███████▋  | 286714/371472 [38:52<6:45:41,  3.48it/s]
 77%|███████▋  | 286715/371472 [38:52<6:49:57,  3.45it/s]
 77%|███████▋  | 286716/371472 [38:52<6:59:28,  3.37it/s]
 77%|███████▋  | 286717/371472 [38:53<6:56:17,  3.39it/s]
 77%|███████▋  | 286718/371472 [38:53<6:55:46,  3.40it/s]
 77%|███████▋  | 286719/371472 [38:53<6:35:04,  3.58it/s]
 77%|███████▋  | 286720/371472 [38:54<6:35:38,  3.57it/s]
                                                         
{'loss': 2.7063, 'learning_rate': 3.0544721928936196e-07, 'epoch': 12.35}

 77%|███████▋  | 286720/371472 [38:54<6:35:38,  3.57it/s]
 77%|███████▋  | 286721/371472 [38:54<6:18:21,  3.73it/s]
 77%|███████▋  | 286722/371472 [38:54<6:17:17,  3.74it/s]
 77%|███████▋  | 286723/371472 [38:54<6:10:10,  3.82it/s]
 77%|███████▋  | 286724/371472 [38:55<6:45:42,  3.48it/s]
 77%|███████▋  | 286725/371472 [38:55<6:56:15,  3.39it/s]
 77%|███████▋  | 286726/371472 [38:55<7:07:21,  3.31it/s]
 77%|███████▋  | 286727/371472 [38:56<6:50:31,  3.44it/s]
 77%|███████▋  | 286728/371472 [38:56<6:32:49,  3.60it/s]
 77%|███████▋  | 286729/371472 [38:56<6:23:13,  3.69it/s]
 77%|███████▋  | 286730/371472 [38:56<6:23:17,  3.68it/s]
 77%|███████▋  | 286731/371472 [38:57<6:20:35,  3.71it/s]
 77%|███████▋  | 286732/371472 [38:57<6:37:33,  3.55it/s]
 77%|███████▋  | 286733/371472 [38:57<7:09:40,  3.29it/s]
 77%|███████▋  | 286734/371472 [38:58<7:01:13,  3.35it/s]
 77%|███████▋  | 286735/371472 [38:58<7:11:35,  3.27it/s]
 77%|███████▋  | 286736/371472 [38:58<7:00:27,  3.36it/s]
 77%|███████▋  | 286737/371472 [38:58<7:05:24,  3.32it/s]
 77%|███████▋  | 286738/371472 [38:59<7:06:18,  3.31it/s]
 77%|███████▋  | 286739/371472 [38:59<6:59:47,  3.36it/s]
 77%|███████▋  | 286740/371472 [38:59<6:58:31,  3.37it/s]
                                                         
{'loss': 2.6036, 'learning_rate': 3.0539873731388314e-07, 'epoch': 12.35}

 77%|███████▋  | 286740/371472 [38:59<6:58:31,  3.37it/s]
 77%|███████▋  | 286741/371472 [39:00<6:36:00,  3.57it/s]
 77%|███████▋  | 286742/371472 [39:00<6:47:32,  3.47it/s]
 77%|███████▋  | 286743/371472 [39:00<6:47:07,  3.47it/s]
 77%|███████▋  | 286744/371472 [39:00<6:37:46,  3.55it/s]
 77%|███████▋  | 286745/371472 [39:01<6:33:32,  3.59it/s]
 77%|███████▋  | 286746/371472 [39:01<7:37:26,  3.09it/s]
 77%|███████▋  | 286747/371472 [39:01<7:13:50,  3.25it/s]
 77%|███████▋  | 286748/371472 [39:02<6:59:10,  3.37it/s]
 77%|███████▋  | 286749/371472 [39:02<6:51:20,  3.43it/s]
 77%|███████▋  | 286750/371472 [39:02<6:39:44,  3.53it/s]
 77%|███████▋  | 286751/371472 [39:03<6:49:56,  3.44it/s]
 77%|███████▋  | 286752/371472 [39:03<6:41:42,  3.52it/s]
 77%|███████▋  | 286753/371472 [39:03<6:37:08,  3.56it/s]
 77%|███████▋  | 286754/371472 [39:03<6:40:59,  3.52it/s]
 77%|███████▋  | 286755/371472 [39:04<6:34:35,  3.58it/s]
 77%|███████▋  | 286756/371472 [39:04<6:49:26,  3.45it/s]
 77%|███████▋  | 286757/371472 [39:04<6:42:17,  3.51it/s]
 77%|███████▋  | 286758/371472 [39:05<6:35:49,  3.57it/s]
 77%|███████▋  | 286759/371472 [39:05<6:30:27,  3.62it/s]
 77%|███████▋  | 286760/371472 [39:05<6:39:06,  3.54it/s]
                                                         
{'loss': 2.6396, 'learning_rate': 3.053502553384042e-07, 'epoch': 12.35}

 77%|███████▋  | 286760/371472 [39:05<6:39:06,  3.54it/s]
 77%|███████▋  | 286761/371472 [39:05<6:32:00,  3.60it/s]
 77%|███████▋  | 286762/371472 [39:06<6:18:07,  3.73it/s]
 77%|███████▋  | 286763/371472 [39:06<6:39:59,  3.53it/s]
 77%|███████▋  | 286764/371472 [39:06<6:58:30,  3.37it/s]
 77%|███████▋  | 286765/371472 [39:07<6:48:33,  3.46it/s]
 77%|███████▋  | 286766/371472 [39:07<6:42:31,  3.51it/s]
 77%|███████▋  | 286767/371472 [39:07<6:32:11,  3.60it/s]
 77%|███████▋  | 286768/371472 [39:07<6:39:32,  3.53it/s]
 77%|███████▋  | 286769/371472 [39:08<6:27:28,  3.64it/s]
 77%|███████▋  | 286770/371472 [39:08<6:36:52,  3.56it/s]
 77%|███████▋  | 286771/371472 [39:08<6:24:25,  3.67it/s]
 77%|███████▋  | 286772/371472 [39:08<6:26:53,  3.65it/s]
 77%|███████▋  | 286773/371472 [39:09<6:14:53,  3.77it/s]
 77%|███████▋  | 286774/371472 [39:09<6:11:06,  3.80it/s]
 77%|███████▋  | 286775/371472 [39:09<6:06:13,  3.85it/s]
 77%|███████▋  | 286776/371472 [39:10<6:50:34,  3.44it/s]
 77%|███████▋  | 286777/371472 [39:10<6:39:12,  3.54it/s]
 77%|███████▋  | 286778/371472 [39:10<6:45:03,  3.48it/s]
 77%|███████▋  | 286779/371472 [39:10<6:31:33,  3.60it/s]
 77%|███████▋  | 286780/371472 [39:11<6:25:00,  3.67it/s]
                                                         
{'loss': 2.7558, 'learning_rate': 3.0530177336292534e-07, 'epoch': 12.35}

 77%|███████▋  | 286780/371472 [39:11<6:25:00,  3.67it/s]
 77%|███████▋  | 286781/371472 [39:11<6:23:58,  3.68it/s]
 77%|███████▋  | 286782/371472 [39:11<6:32:47,  3.59it/s]
 77%|███████▋  | 286783/371472 [39:11<6:24:34,  3.67it/s]
 77%|███████▋  | 286784/371472 [39:12<7:02:11,  3.34it/s]
 77%|███████▋  | 286785/371472 [39:12<7:05:44,  3.32it/s]
 77%|███████▋  | 286786/371472 [39:12<6:50:52,  3.44it/s]
 77%|███████▋  | 286787/371472 [39:13<6:40:33,  3.52it/s]
 77%|███████▋  | 286788/371472 [39:13<6:46:27,  3.47it/s]
 77%|███████▋  | 286789/371472 [39:13<6:33:10,  3.59it/s]
 77%|███████▋  | 286790/371472 [39:14<6:33:40,  3.59it/s]
 77%|███████▋  | 286791/371472 [39:14<6:24:22,  3.67it/s]
 77%|███████▋  | 286792/371472 [39:14<6:18:57,  3.72it/s]
 77%|███████▋  | 286793/371472 [39:14<6:20:32,  3.71it/s]
 77%|███████▋  | 286794/371472 [39:15<6:25:33,  3.66it/s]
 77%|███████▋  | 286795/371472 [39:15<6:23:03,  3.68it/s]
 77%|███████▋  | 286796/371472 [39:15<6:57:20,  3.38it/s]
 77%|███████▋  | 286797/371472 [39:15<6:32:03,  3.60it/s]
 77%|███████▋  | 286798/371472 [39:16<6:27:25,  3.64it/s]
 77%|███████▋  | 286799/371472 [39:16<6:52:27,  3.42it/s]
 77%|███████▋  | 286800/371472 [39:16<6:59:35,  3.36it/s]
                                                         
{'loss': 2.5817, 'learning_rate': 3.0525329138744635e-07, 'epoch': 12.35}

 77%|███████▋  | 286800/371472 [39:16<6:59:35,  3.36it/s]
 77%|███████▋  | 286801/371472 [39:17<6:45:55,  3.48it/s]
 77%|███████▋  | 286802/371472 [39:17<6:45:17,  3.48it/s]
 77%|███████▋  | 286803/371472 [39:17<6:33:26,  3.59it/s]
 77%|███████▋  | 286804/371472 [39:17<6:54:24,  3.41it/s]
 77%|███████▋  | 286805/371472 [39:18<7:05:18,  3.32it/s]
 77%|███████▋  | 286806/371472 [39:18<6:57:21,  3.38it/s]
 77%|███████▋  | 286807/371472 [39:18<6:48:52,  3.45it/s]
 77%|███████▋  | 286808/371472 [39:19<6:40:38,  3.52it/s]
 77%|███████▋  | 286809/371472 [39:19<6:39:47,  3.53it/s]
 77%|███████▋  | 286810/371472 [39:19<6:28:54,  3.63it/s]
 77%|███████▋  | 286811/371472 [39:19<6:15:20,  3.76it/s]
 77%|███████▋  | 286812/371472 [39:20<6:25:40,  3.66it/s]
 77%|███████▋  | 286813/371472 [39:20<6:36:16,  3.56it/s]
 77%|███████▋  | 286814/371472 [39:20<6:29:49,  3.62it/s]
 77%|███████▋  | 286815/371472 [39:21<6:24:43,  3.67it/s]
 77%|███████▋  | 286816/371472 [39:21<6:19:27,  3.72it/s]
 77%|███████▋  | 286817/371472 [39:21<6:28:26,  3.63it/s]
 77%|███████▋  | 286818/371472 [39:21<6:28:17,  3.63it/s]
 77%|███████▋  | 286819/371472 [39:22<6:21:25,  3.70it/s]
 77%|███████▋  | 286820/371472 [39:22<6:23:26,  3.68it/s]
                                                         
{'loss': 2.7277, 'learning_rate': 3.052048094119674e-07, 'epoch': 12.35}

 77%|███████▋  | 286820/371472 [39:22<6:23:26,  3.68it/s]
 77%|███████▋  | 286821/371472 [39:22<6:37:27,  3.55it/s]
 77%|███████▋  | 286822/371472 [39:22<6:33:00,  3.59it/s]
 77%|███████▋  | 286823/371472 [39:23<6:45:08,  3.48it/s]
 77%|███████▋  | 286824/371472 [39:23<6:29:21,  3.62it/s]
 77%|███████▋  | 286825/371472 [39:23<6:29:53,  3.62it/s]
 77%|███████▋  | 286826/371472 [39:24<6:26:43,  3.65it/s]
 77%|███████▋  | 286827/371472 [39:24<6:16:28,  3.75it/s]
 77%|███████▋  | 286828/371472 [39:24<6:15:51,  3.75it/s]
 77%|███████▋  | 286829/371472 [39:24<6:26:38,  3.65it/s]
 77%|███████▋  | 286830/371472 [39:25<6:11:33,  3.80it/s]
 77%|███████▋  | 286831/371472 [39:25<6:28:41,  3.63it/s]
 77%|███████▋  | 286832/371472 [39:25<6:23:23,  3.68it/s]
 77%|███████▋  | 286833/371472 [39:25<6:20:41,  3.71it/s]
 77%|███████▋  | 286834/371472 [39:26<7:01:19,  3.35it/s]
 77%|███████▋  | 286835/371472 [39:26<7:04:44,  3.32it/s]
 77%|███████▋  | 286836/371472 [39:26<6:50:39,  3.43it/s]
 77%|███████▋  | 286837/371472 [39:27<6:55:41,  3.39it/s]
 77%|███████▋  | 286838/371472 [39:27<6:45:10,  3.48it/s]
 77%|███████▋  | 286839/371472 [39:27<6:55:10,  3.40it/s]
 77%|███████▋  | 286840/371472 [39:28<6:35:49,  3.56it/s]
                                                         
{'loss': 2.6564, 'learning_rate': 3.051563274364886e-07, 'epoch': 12.35}

 77%|███████▋  | 286840/371472 [39:28<6:35:49,  3.56it/s]
 77%|███████▋  | 286841/371472 [39:28<6:24:12,  3.67it/s]
 77%|███████▋  | 286842/371472 [39:28<6:14:27,  3.77it/s]
 77%|███████▋  | 286843/371472 [39:28<6:12:09,  3.79it/s]
 77%|███████▋  | 286844/371472 [39:29<6:26:23,  3.65it/s]
 77%|███████▋  | 286845/371472 [39:29<6:49:03,  3.45it/s]
 77%|███████▋  | 286846/371472 [39:29<6:43:51,  3.49it/s]
 77%|███████▋  | 286847/371472 [39:29<6:54:42,  3.40it/s]
 77%|███████▋  | 286848/371472 [39:30<7:06:30,  3.31it/s]
 77%|███████▋  | 286849/371472 [39:30<6:54:42,  3.40it/s]
 77%|███████▋  | 286850/371472 [39:30<6:41:32,  3.51it/s]
 77%|███████▋  | 286851/371472 [39:31<6:27:11,  3.64it/s]
 77%|███████▋  | 286852/371472 [39:31<6:43:02,  3.50it/s]
 77%|███████▋  | 286853/371472 [39:31<6:54:46,  3.40it/s]
 77%|███████▋  | 286854/371472 [39:32<6:45:34,  3.48it/s]
 77%|███████▋  | 286855/371472 [39:32<6:35:45,  3.56it/s]
 77%|███████▋  | 286856/371472 [39:32<6:41:37,  3.51it/s]
 77%|███████▋  | 286857/371472 [39:32<6:40:24,  3.52it/s]
 77%|███████▋  | 286858/371472 [39:33<6:26:54,  3.64it/s]
 77%|███████▋  | 286859/371472 [39:33<6:35:33,  3.57it/s]
 77%|███████▋  | 286860/371472 [39:33<6:36:00,  3.56it/s]
                                                         
{'loss': 2.5541, 'learning_rate': 3.051078454610097e-07, 'epoch': 12.36}

 77%|███████▋  | 286860/371472 [39:33<6:36:00,  3.56it/s]
 77%|███████▋  | 286861/371472 [39:34<6:58:33,  3.37it/s]
 77%|███████▋  | 286862/371472 [39:34<6:40:39,  3.52it/s]
 77%|███████▋  | 286863/371472 [39:34<6:29:36,  3.62it/s]
 77%|███████▋  | 286864/371472 [39:34<6:20:22,  3.71it/s]
 77%|███████▋  | 286865/371472 [39:35<6:30:34,  3.61it/s]
 77%|███████▋  | 286866/371472 [39:35<6:48:11,  3.45it/s]
 77%|███████▋  | 286867/371472 [39:35<6:41:58,  3.51it/s]
 77%|███████▋  | 286868/371472 [39:35<7:02:46,  3.34it/s]
 77%|███████▋  | 286869/371472 [39:36<6:48:45,  3.45it/s]
 77%|███████▋  | 286870/371472 [39:36<6:35:58,  3.56it/s]
 77%|███████▋  | 286871/371472 [39:36<6:59:15,  3.36it/s]
 77%|███████▋  | 286872/371472 [39:37<6:36:14,  3.56it/s]
 77%|███████▋  | 286873/371472 [39:37<6:27:48,  3.64it/s]
 77%|███████▋  | 286874/371472 [39:37<6:28:54,  3.63it/s]
 77%|███████▋  | 286875/371472 [39:37<6:27:43,  3.64it/s]
 77%|███████▋  | 286876/371472 [39:38<6:31:29,  3.60it/s]
 77%|███████▋  | 286877/371472 [39:38<6:19:43,  3.71it/s]
 77%|███████▋  | 286878/371472 [39:38<6:16:40,  3.74it/s]
 77%|███████▋  | 286879/371472 [39:38<6:23:44,  3.67it/s]
 77%|███████▋  | 286880/371472 [39:39<6:33:02,  3.59it/s]
                                                         
{'loss': 2.4774, 'learning_rate': 3.0505936348553085e-07, 'epoch': 12.36}

 77%|███████▋  | 286880/371472 [39:39<6:33:02,  3.59it/s]
 77%|███████▋  | 286881/371472 [39:39<6:39:05,  3.53it/s]
 77%|███████▋  | 286882/371472 [39:39<6:32:57,  3.59it/s]
 77%|███████▋  | 286883/371472 [39:40<6:26:15,  3.65it/s]
 77%|███████▋  | 286884/371472 [39:40<6:21:07,  3.70it/s]
 77%|███████▋  | 286885/371472 [39:40<6:15:33,  3.75it/s]
 77%|███████▋  | 286886/371472 [39:40<6:42:38,  3.50it/s]
 77%|███████▋  | 286887/371472 [39:41<6:39:37,  3.53it/s]
 77%|███████▋  | 286888/371472 [39:41<6:29:54,  3.62it/s]
 77%|███████▋  | 286889/371472 [39:41<6:37:41,  3.54it/s]
 77%|███████▋  | 286890/371472 [39:42<6:29:48,  3.62it/s]
 77%|███████▋  | 286891/371472 [39:42<6:24:46,  3.66it/s]
 77%|███████▋  | 286892/371472 [39:42<6:28:09,  3.63it/s]
 77%|███████▋  | 286893/371472 [39:42<6:31:38,  3.60it/s]
 77%|███████▋  | 286894/371472 [39:43<6:13:58,  3.77it/s]
 77%|███████▋  | 286895/371472 [39:43<6:18:09,  3.73it/s]
 77%|███████▋  | 286896/371472 [39:43<6:23:25,  3.68it/s]
 77%|███████▋  | 286897/371472 [39:43<6:31:41,  3.60it/s]
 77%|███████▋  | 286898/371472 [39:44<6:29:53,  3.62it/s]
 77%|███████▋  | 286899/371472 [39:44<6:36:59,  3.55it/s]
 77%|███████▋  | 286900/371472 [39:44<6:40:37,  3.52it/s]
                                                         
{'loss': 2.8436, 'learning_rate': 3.0501088151005187e-07, 'epoch': 12.36}

 77%|███████▋  | 286900/371472 [39:44<6:40:37,  3.52it/s]
 77%|███████▋  | 286901/371472 [39:45<6:47:02,  3.46it/s]
 77%|███████▋  | 286902/371472 [39:45<6:29:50,  3.62it/s]
 77%|███████▋  | 286903/371472 [39:45<6:46:20,  3.47it/s]
 77%|███████▋  | 286904/371472 [39:45<6:41:46,  3.51it/s]
 77%|███████▋  | 286905/371472 [39:46<6:57:26,  3.38it/s]
 77%|███████▋  | 286906/371472 [39:46<6:54:32,  3.40it/s]
 77%|███████▋  | 286907/371472 [39:46<6:43:55,  3.49it/s]
 77%|███████▋  | 286908/371472 [39:47<6:33:21,  3.58it/s]
 77%|███████▋  | 286909/371472 [39:47<6:59:59,  3.36it/s]
 77%|███████▋  | 286910/371472 [39:47<7:08:52,  3.29it/s]
 77%|███████▋  | 286911/371472 [39:48<6:43:50,  3.49it/s]
 77%|███████▋  | 286912/371472 [39:48<7:26:52,  3.15it/s]
 77%|███████▋  | 286913/371472 [39:48<7:21:45,  3.19it/s]
 77%|███████▋  | 286914/371472 [39:48<7:10:18,  3.28it/s]
 77%|███████▋  | 286915/371472 [39:49<7:02:52,  3.33it/s]
 77%|███████▋  | 286916/371472 [39:49<6:46:55,  3.46it/s]
 77%|███████▋  | 286917/371472 [39:49<6:54:51,  3.40it/s]
 77%|███████▋  | 286918/371472 [39:50<6:39:16,  3.53it/s]
 77%|███████▋  | 286919/371472 [39:50<6:44:03,  3.49it/s]
 77%|███████▋  | 286920/371472 [39:50<7:09:05,  3.28it/s]
                                                         
{'loss': 2.6681, 'learning_rate': 3.04962399534573e-07, 'epoch': 12.36}

 77%|███████▋  | 286920/371472 [39:50<7:09:05,  3.28it/s]
 77%|███████▋  | 286921/371472 [39:51<6:46:58,  3.46it/s]
 77%|███████▋  | 286922/371472 [39:51<6:45:28,  3.48it/s]
 77%|███████▋  | 286923/371472 [39:51<6:37:28,  3.55it/s]
 77%|███████▋  | 286924/371472 [39:51<6:29:42,  3.62it/s]
 77%|███████▋  | 286925/371472 [39:52<6:31:04,  3.60it/s]
 77%|███████▋  | 286926/371472 [39:52<6:40:28,  3.52it/s]
 77%|███████▋  | 286927/371472 [39:52<6:42:30,  3.50it/s]
 77%|███████▋  | 286928/371472 [39:53<6:54:07,  3.40it/s]
 77%|███████▋  | 286929/371472 [39:53<6:33:03,  3.58it/s]
 77%|███████▋  | 286930/371472 [39:53<6:34:00,  3.58it/s]
 77%|███████▋  | 286931/371472 [39:53<6:33:44,  3.58it/s]
 77%|███████▋  | 286932/371472 [39:54<6:49:39,  3.44it/s]
 77%|███████▋  | 286933/371472 [39:54<7:04:38,  3.32it/s]
 77%|███████▋  | 286934/371472 [39:54<6:59:52,  3.36it/s]
 77%|███████▋  | 286935/371472 [39:55<7:02:51,  3.33it/s]
 77%|███████▋  | 286936/371472 [39:55<6:42:58,  3.50it/s]
 77%|███████▋  | 286937/371472 [39:55<6:34:00,  3.58it/s]
 77%|███████▋  | 286938/371472 [39:55<6:26:21,  3.65it/s]
 77%|███████▋  | 286939/371472 [39:56<6:20:33,  3.70it/s]
 77%|███████▋  | 286940/371472 [39:56<6:25:15,  3.66it/s]
                                                         
{'loss': 2.692, 'learning_rate': 3.0491391755909407e-07, 'epoch': 12.36}

 77%|███████▋  | 286940/371472 [39:56<6:25:15,  3.66it/s]
 77%|███████▋  | 286941/371472 [39:56<6:45:02,  3.48it/s]
 77%|███████▋  | 286942/371472 [39:56<6:43:06,  3.49it/s]
 77%|███████▋  | 286943/371472 [39:57<6:30:33,  3.61it/s]
 77%|███████▋  | 286944/371472 [39:57<6:19:46,  3.71it/s]
 77%|███████▋  | 286945/371472 [39:57<6:19:01,  3.72it/s]
 77%|███████▋  | 286946/371472 [39:58<6:31:22,  3.60it/s]
 77%|███████▋  | 286947/371472 [39:58<6:38:46,  3.53it/s]
 77%|███████▋  | 286948/371472 [39:58<6:43:30,  3.49it/s]
 77%|███████▋  | 286949/371472 [39:58<6:29:15,  3.62it/s]
 77%|███████▋  | 286950/371472 [39:59<6:57:39,  3.37it/s]
 77%|███████▋  | 286951/371472 [39:59<6:39:08,  3.53it/s]
 77%|███████▋  | 286952/371472 [39:59<7:08:04,  3.29it/s]
 77%|███████▋  | 286953/371472 [40:00<6:46:48,  3.46it/s]
 77%|███████▋  | 286954/371472 [40:00<6:55:44,  3.39it/s]
 77%|███████▋  | 286955/371472 [40:00<6:51:33,  3.42it/s]
 77%|███████▋  | 286956/371472 [40:00<6:48:44,  3.45it/s]
 77%|███████▋  | 286957/371472 [40:01<6:39:50,  3.52it/s]
 77%|███████▋  | 286958/371472 [40:01<6:33:17,  3.58it/s]
 77%|███████▋  | 286959/371472 [40:01<6:22:23,  3.68it/s]
 77%|███████▋  | 286960/371472 [40:02<6:15:33,  3.75it/s]
                                                         
{'loss': 2.6182, 'learning_rate': 3.048654355836152e-07, 'epoch': 12.36}

 77%|███████▋  | 286960/371472 [40:02<6:15:33,  3.75it/s]
 77%|███████▋  | 286961/371472 [40:02<6:35:44,  3.56it/s]
 77%|███████▋  | 286962/371472 [40:02<6:18:15,  3.72it/s]
 77%|███████▋  | 286963/371472 [40:02<6:33:48,  3.58it/s]
 77%|███████▋  | 286964/371472 [40:03<6:19:26,  3.71it/s]
 77%|███████▋  | 286965/371472 [40:03<6:12:44,  3.78it/s]
 77%|███████▋  | 286966/371472 [40:03<6:27:06,  3.64it/s]
 77%|███████▋  | 286967/371472 [40:03<6:27:15,  3.64it/s]
 77%|███████▋  | 286968/371472 [40:04<6:18:21,  3.72it/s]
 77%|███████▋  | 286969/371472 [40:04<6:17:12,  3.73it/s]
 77%|███████▋  | 286970/371472 [40:04<6:20:37,  3.70it/s]
 77%|███████▋  | 286971/371472 [40:05<6:16:42,  3.74it/s]
 77%|███████▋  | 286972/371472 [40:05<6:15:21,  3.75it/s]
 77%|███████▋  | 286973/371472 [40:05<6:13:07,  3.77it/s]
 77%|███████▋  | 286974/371472 [40:05<6:07:47,  3.83it/s]
 77%|███████▋  | 286975/371472 [40:06<6:01:50,  3.89it/s]
 77%|███████▋  | 286976/371472 [40:06<6:07:22,  3.83it/s]
 77%|███████▋  | 286977/371472 [40:06<6:25:28,  3.65it/s]
 77%|███████▋  | 286978/371472 [40:06<6:36:06,  3.56it/s]
 77%|███████▋  | 286979/371472 [40:07<6:40:49,  3.51it/s]
 77%|███████▋  | 286980/371472 [40:07<6:31:56,  3.59it/s]
                                                         
{'loss': 2.7399, 'learning_rate': 3.048169536081363e-07, 'epoch': 12.36}

 77%|███████▋  | 286980/371472 [40:07<6:31:56,  3.59it/s]
 77%|███████▋  | 286981/371472 [40:07<6:24:50,  3.66it/s]
 77%|███████▋  | 286982/371472 [40:07<6:12:18,  3.78it/s]
 77%|███████▋  | 286983/371472 [40:08<6:06:43,  3.84it/s]
 77%|███████▋  | 286984/371472 [40:08<6:49:00,  3.44it/s]
 77%|███████▋  | 286985/371472 [40:08<6:34:26,  3.57it/s]
 77%|███████▋  | 286986/371472 [40:09<6:40:51,  3.51it/s]
 77%|███████▋  | 286987/371472 [40:09<6:29:03,  3.62it/s]
 77%|███████▋  | 286988/371472 [40:09<6:33:28,  3.58it/s]
 77%|███████▋  | 286989/371472 [40:10<6:57:36,  3.37it/s]
 77%|███████▋  | 286990/371472 [40:10<7:27:10,  3.15it/s]
 77%|███████▋  | 286991/371472 [40:10<7:30:38,  3.12it/s]
 77%|███████▋  | 286992/371472 [40:10<7:08:52,  3.28it/s]
 77%|███████▋  | 286993/371472 [40:11<7:07:17,  3.30it/s]
 77%|███████▋  | 286994/371472 [40:11<6:47:53,  3.45it/s]
 77%|███████▋  | 286995/371472 [40:11<7:20:12,  3.20it/s]
 77%|███████▋  | 286996/371472 [40:12<6:55:31,  3.39it/s]
 77%|███████▋  | 286997/371472 [40:12<6:36:03,  3.55it/s]
 77%|███████▋  | 286998/371472 [40:12<6:26:03,  3.65it/s]
 77%|███████▋  | 286999/371472 [40:12<6:28:02,  3.63it/s]
 77%|███████▋  | 287000/371472 [40:13<6:59:45,  3.35it/s]
                                                         
{'loss': 2.7216, 'learning_rate': 3.047684716326575e-07, 'epoch': 12.36}

 77%|███████▋  | 287000/371472 [40:13<6:59:45,  3.35it/s]
 77%|███████▋  | 287001/371472 [40:13<6:52:17,  3.41it/s]
 77%|███████▋  | 287002/371472 [40:13<6:36:23,  3.55it/s]
 77%|███████▋  | 287003/371472 [40:14<7:01:40,  3.34it/s]
 77%|███████▋  | 287004/371472 [40:14<6:45:22,  3.47it/s]
 77%|███████▋  | 287005/371472 [40:14<6:28:53,  3.62it/s]
 77%|███████▋  | 287006/371472 [40:14<6:26:23,  3.64it/s]
 77%|███████▋  | 287007/371472 [40:15<7:01:40,  3.34it/s]
 77%|███████▋  | 287008/371472 [40:15<6:48:08,  3.45it/s]
 77%|███████▋  | 287009/371472 [40:15<6:50:16,  3.43it/s]
 77%|███████▋  | 287010/371472 [40:16<7:08:46,  3.28it/s]
 77%|███████▋  | 287011/371472 [40:16<7:01:37,  3.34it/s]
 77%|███████▋  | 287012/371472 [40:16<6:57:41,  3.37it/s]
 77%|███████▋  | 287013/371472 [40:17<6:54:55,  3.39it/s]
 77%|███████▋  | 287014/371472 [40:17<6:52:16,  3.41it/s]
 77%|███████▋  | 287015/371472 [40:17<6:43:23,  3.49it/s]
 77%|███████▋  | 287016/371472 [40:17<6:27:21,  3.63it/s]
 77%|███████▋  | 287017/371472 [40:18<6:39:28,  3.52it/s]
 77%|███████▋  | 287018/371472 [40:18<6:28:56,  3.62it/s]
 77%|███████▋  | 287019/371472 [40:18<6:35:45,  3.56it/s]
 77%|███████▋  | 287020/371472 [40:19<7:26:44,  3.15it/s]
                                                         
{'loss': 2.5714, 'learning_rate': 3.047199896571785e-07, 'epoch': 12.36}

 77%|███████▋  | 287020/371472 [40:19<7:26:44,  3.15it/s]
 77%|███████▋  | 287021/371472 [40:19<7:17:44,  3.22it/s]
 77%|███████▋  | 287022/371472 [40:19<7:03:21,  3.32it/s]
 77%|███████▋  | 287023/371472 [40:19<6:46:29,  3.46it/s]
 77%|███████▋  | 287024/371472 [40:20<7:28:08,  3.14it/s]
 77%|███████▋  | 287025/371472 [40:20<7:03:25,  3.32it/s]
 77%|███████▋  | 287026/371472 [40:20<6:45:42,  3.47it/s]
 77%|███████▋  | 287027/371472 [40:21<6:43:00,  3.49it/s]
 77%|███████▋  | 287028/371472 [40:21<6:31:06,  3.60it/s]
 77%|███████▋  | 287029/371472 [40:21<6:27:14,  3.63it/s]
 77%|███████▋  | 287030/371472 [40:21<6:11:31,  3.79it/s]
 77%|███████▋  | 287031/371472 [40:22<6:25:08,  3.65it/s]
 77%|███████▋  | 287032/371472 [40:22<6:54:16,  3.40it/s]
 77%|███████▋  | 287033/371472 [40:22<6:53:53,  3.40it/s]
 77%|███████▋  | 287034/371472 [40:23<6:45:31,  3.47it/s]
 77%|███████▋  | 287035/371472 [40:23<6:52:32,  3.41it/s]
 77%|███████▋  | 287036/371472 [40:23<6:44:13,  3.48it/s]
 77%|███████▋  | 287037/371472 [40:23<6:44:42,  3.48it/s]
 77%|███████▋  | 287038/371472 [40:24<6:36:24,  3.55it/s]
 77%|███████▋  | 287039/371472 [40:24<6:28:56,  3.62it/s]
 77%|███████▋  | 287040/371472 [40:24<6:29:12,  3.62it/s]
                                                         
{'loss': 2.6329, 'learning_rate': 3.046715076816997e-07, 'epoch': 12.36}

 77%|███████▋  | 287040/371472 [40:24<6:29:12,  3.62it/s]
 77%|███████▋  | 287041/371472 [40:25<6:20:47,  3.70it/s]
 77%|███████▋  | 287042/371472 [40:25<6:35:59,  3.55it/s]
 77%|███████▋  | 287043/371472 [40:25<6:33:37,  3.57it/s]
 77%|███████▋  | 287044/371472 [40:25<6:23:23,  3.67it/s]
 77%|███████▋  | 287045/371472 [40:26<6:20:49,  3.69it/s]
 77%|███████▋  | 287046/371472 [40:26<6:17:43,  3.73it/s]
 77%|███████▋  | 287047/371472 [40:26<6:24:44,  3.66it/s]
 77%|███████▋  | 287048/371472 [40:26<6:32:01,  3.59it/s]
 77%|███████▋  | 287049/371472 [40:27<6:22:00,  3.68it/s]
 77%|███████▋  | 287050/371472 [40:27<6:40:54,  3.51it/s]
 77%|███████▋  | 287051/371472 [40:27<6:27:59,  3.63it/s]
 77%|███████▋  | 287052/371472 [40:28<6:33:52,  3.57it/s]
 77%|███████▋  | 287053/371472 [40:28<6:18:33,  3.72it/s]
 77%|███████▋  | 287054/371472 [40:28<6:27:31,  3.63it/s]
 77%|███████▋  | 287055/371472 [40:28<6:21:04,  3.69it/s]
 77%|███████▋  | 287056/371472 [40:29<6:18:51,  3.71it/s]
 77%|███████▋  | 287057/371472 [40:29<6:03:53,  3.87it/s]
 77%|███████▋  | 287058/371472 [40:29<6:31:02,  3.60it/s]
 77%|███████▋  | 287059/371472 [40:30<6:42:37,  3.49it/s]
 77%|███████▋  | 287060/371472 [40:30<6:44:29,  3.48it/s]
                                                         
{'loss': 2.7162, 'learning_rate': 3.046230257062207e-07, 'epoch': 12.36}

 77%|███████▋  | 287060/371472 [40:30<6:44:29,  3.48it/s]
 77%|███████▋  | 287061/371472 [40:30<6:48:25,  3.44it/s]
 77%|███████▋  | 287062/371472 [40:30<6:39:20,  3.52it/s]
 77%|███████▋  | 287063/371472 [40:31<6:44:25,  3.48it/s]
 77%|███████▋  | 287064/371472 [40:31<6:37:26,  3.54it/s]
 77%|███████▋  | 287065/371472 [40:31<6:44:00,  3.48it/s]
 77%|███████▋  | 287066/371472 [40:32<6:55:43,  3.38it/s]
 77%|███████▋  | 287067/371472 [40:32<6:56:31,  3.38it/s]
 77%|███████▋  | 287068/371472 [40:32<6:41:42,  3.50it/s]
 77%|███████▋  | 287069/371472 [40:32<6:38:26,  3.53it/s]
 77%|███████▋  | 287070/371472 [40:33<6:50:13,  3.43it/s]
 77%|███████▋  | 287071/371472 [40:33<6:58:08,  3.36it/s]
 77%|███████▋  | 287072/371472 [40:33<6:46:43,  3.46it/s]
 77%|███████▋  | 287073/371472 [40:34<6:39:59,  3.52it/s]
 77%|███████▋  | 287074/371472 [40:34<6:31:42,  3.59it/s]
 77%|███████▋  | 287075/371472 [40:34<6:31:24,  3.59it/s]
 77%|███████▋  | 287076/371472 [40:35<7:40:36,  3.05it/s]
 77%|███████▋  | 287077/371472 [40:35<7:32:43,  3.11it/s]
 77%|███████▋  | 287078/371472 [40:35<7:14:02,  3.24it/s]
 77%|███████▋  | 287079/371472 [40:35<7:32:56,  3.11it/s]
 77%|███████▋  | 287080/371472 [40:36<7:09:44,  3.27it/s]
                                                         
{'loss': 2.4998, 'learning_rate': 3.045745437307419e-07, 'epoch': 12.37}

 77%|███████▋  | 287080/371472 [40:36<7:09:44,  3.27it/s]
 77%|███████▋  | 287081/371472 [40:36<7:20:03,  3.20it/s]
 77%|███████▋  | 287082/371472 [40:36<7:08:44,  3.28it/s]
 77%|███████▋  | 287083/371472 [40:37<6:53:39,  3.40it/s]
 77%|███████▋  | 287084/371472 [40:37<6:46:08,  3.46it/s]
 77%|███████▋  | 287085/371472 [40:37<6:43:02,  3.49it/s]
 77%|███████▋  | 287086/371472 [40:37<6:44:39,  3.48it/s]
 77%|███████▋  | 287087/371472 [40:38<7:17:32,  3.21it/s]
 77%|███████▋  | 287088/371472 [40:38<6:57:13,  3.37it/s]
 77%|███████▋  | 287089/371472 [40:38<6:39:28,  3.52it/s]
 77%|███████▋  | 287090/371472 [40:39<6:49:22,  3.44it/s]
 77%|███████▋  | 287091/371472 [40:39<6:36:14,  3.55it/s]
 77%|███████▋  | 287092/371472 [40:39<6:41:29,  3.50it/s]
 77%|███████▋  | 287093/371472 [40:40<6:39:41,  3.52it/s]
 77%|███████▋  | 287094/371472 [40:40<7:09:04,  3.28it/s]
 77%|███████▋  | 287095/371472 [40:40<6:50:58,  3.42it/s]
 77%|███████▋  | 287096/371472 [40:40<6:40:17,  3.51it/s]
 77%|███████▋  | 287097/371472 [40:41<6:36:53,  3.54it/s]
 77%|███████▋  | 287098/371472 [40:41<6:47:09,  3.45it/s]
 77%|███████▋  | 287099/371472 [40:41<6:49:27,  3.43it/s]
 77%|███████▋  | 287100/371472 [40:42<6:33:00,  3.58it/s]
                                                         
{'loss': 2.6335, 'learning_rate': 3.0452606175526296e-07, 'epoch': 12.37}

 77%|███████▋  | 287100/371472 [40:42<6:33:00,  3.58it/s]
 77%|███████▋  | 287101/371472 [40:42<6:42:56,  3.49it/s]
 77%|███████▋  | 287102/371472 [40:42<6:36:11,  3.55it/s]
 77%|███████▋  | 287103/371472 [40:42<6:23:43,  3.66it/s]
 77%|███████▋  | 287104/371472 [40:43<6:20:23,  3.70it/s]
 77%|███████▋  | 287105/371472 [40:43<6:16:39,  3.73it/s]
 77%|███████▋  | 287106/371472 [40:43<6:20:46,  3.69it/s]
 77%|███████▋  | 287107/371472 [40:43<6:22:10,  3.68it/s]
 77%|███████▋  | 287108/371472 [40:44<6:34:59,  3.56it/s]
 77%|███████▋  | 287109/371472 [40:44<6:24:36,  3.66it/s]
 77%|███████▋  | 287110/371472 [40:44<6:40:43,  3.51it/s]
 77%|███████▋  | 287111/371472 [40:45<6:44:56,  3.47it/s]
 77%|███████▋  | 287112/371472 [40:45<6:47:55,  3.45it/s]
 77%|███████▋  | 287113/371472 [40:45<6:38:05,  3.53it/s]
 77%|███████▋  | 287114/371472 [40:45<6:18:20,  3.72it/s]
 77%|███████▋  | 287115/371472 [40:46<6:13:17,  3.77it/s]
 77%|███████▋  | 287116/371472 [40:46<6:23:31,  3.67it/s]
 77%|███████▋  | 287117/371472 [40:46<6:45:47,  3.46it/s]
 77%|███████▋  | 287118/371472 [40:47<6:44:40,  3.47it/s]
 77%|███████▋  | 287119/371472 [40:47<7:04:26,  3.31it/s]
 77%|███████▋  | 287120/371472 [40:47<7:06:13,  3.30it/s]
                                                         
{'loss': 2.6795, 'learning_rate': 3.0447757977978413e-07, 'epoch': 12.37}

 77%|███████▋  | 287120/371472 [40:47<7:06:13,  3.30it/s]
 77%|███████▋  | 287121/371472 [40:47<6:51:14,  3.42it/s]
 77%|███████▋  | 287122/371472 [40:48<6:39:20,  3.52it/s]
 77%|███████▋  | 287123/371472 [40:48<6:40:02,  3.51it/s]
 77%|███████▋  | 287124/371472 [40:48<6:40:59,  3.51it/s]
 77%|███████▋  | 287125/371472 [40:49<6:32:52,  3.58it/s]
 77%|███████▋  | 287126/371472 [40:49<6:32:12,  3.58it/s]
 77%|███████▋  | 287127/371472 [40:49<6:24:13,  3.66it/s]
 77%|███████▋  | 287128/371472 [40:49<6:46:03,  3.46it/s]
 77%|███████▋  | 287129/371472 [40:50<6:31:13,  3.59it/s]
 77%|███████▋  | 287130/371472 [40:50<6:22:12,  3.68it/s]
 77%|███████▋  | 287131/371472 [40:50<6:13:02,  3.77it/s]
 77%|███████▋  | 287132/371472 [40:50<6:10:24,  3.79it/s]
 77%|███████▋  | 287133/371472 [40:51<6:34:10,  3.57it/s]
 77%|███████▋  | 287134/371472 [40:51<7:18:34,  3.21it/s]
 77%|███████▋  | 287135/371472 [40:51<6:58:02,  3.36it/s]
 77%|███████▋  | 287136/371472 [40:52<6:51:17,  3.42it/s]
 77%|███████▋  | 287137/371472 [40:52<6:37:22,  3.54it/s]
 77%|███████▋  | 287138/371472 [40:52<6:31:55,  3.59it/s]
 77%|███████▋  | 287139/371472 [40:53<6:41:20,  3.50it/s]
 77%|███████▋  | 287140/371472 [40:53<6:21:47,  3.68it/s]
                                                         
{'loss': 2.7349, 'learning_rate': 3.044290978043052e-07, 'epoch': 12.37}

 77%|███████▋  | 287140/371472 [40:53<6:21:47,  3.68it/s]
 77%|███████▋  | 287141/371472 [40:53<6:18:11,  3.72it/s]
 77%|███████▋  | 287142/371472 [40:53<6:47:35,  3.45it/s]
 77%|███████▋  | 287143/371472 [40:54<6:32:32,  3.58it/s]
 77%|███████▋  | 287144/371472 [40:54<6:31:45,  3.59it/s]
 77%|███████▋  | 287145/371472 [40:54<6:28:25,  3.62it/s]
 77%|███████▋  | 287146/371472 [40:54<6:40:44,  3.51it/s]
 77%|███████▋  | 287147/371472 [40:55<6:46:03,  3.46it/s]
 77%|███████▋  | 287148/371472 [40:55<6:37:25,  3.54it/s]
 77%|███████▋  | 287149/371472 [40:55<6:34:50,  3.56it/s]
 77%|███████▋  | 287150/371472 [40:56<6:47:41,  3.45it/s]
 77%|███████▋  | 287151/371472 [40:56<6:53:07,  3.40it/s]
 77%|███████▋  | 287152/371472 [40:56<7:08:17,  3.28it/s]
 77%|███████▋  | 287153/371472 [40:57<7:19:57,  3.19it/s]
 77%|███████▋  | 287154/371472 [40:57<7:02:34,  3.33it/s]
 77%|███████▋  | 287155/371472 [40:57<6:51:07,  3.42it/s]
 77%|███████▋  | 287156/371472 [40:57<6:42:00,  3.50it/s]
 77%|███████▋  | 287157/371472 [40:58<6:43:18,  3.48it/s]
 77%|███████▋  | 287158/371472 [40:58<7:10:46,  3.26it/s]
 77%|███████▋  | 287159/371472 [40:58<7:15:13,  3.23it/s]
 77%|███████▋  | 287160/371472 [40:59<6:56:02,  3.38it/s]
                                                         
{'loss': 2.5806, 'learning_rate': 3.0438061582882633e-07, 'epoch': 12.37}

 77%|███████▋  | 287160/371472 [40:59<6:56:02,  3.38it/s]
 77%|███████▋  | 287161/371472 [40:59<6:42:55,  3.49it/s]
 77%|███████▋  | 287162/371472 [40:59<6:35:22,  3.55it/s]
 77%|███████▋  | 287163/371472 [40:59<6:47:50,  3.45it/s]
 77%|███████▋  | 287164/371472 [41:00<6:31:06,  3.59it/s]
 77%|███████▋  | 287165/371472 [41:00<6:23:31,  3.66it/s]
 77%|███████▋  | 287166/371472 [41:00<6:33:48,  3.57it/s]
 77%|███████▋  | 287167/371472 [41:01<7:04:35,  3.31it/s]
 77%|███████▋  | 287168/371472 [41:01<7:04:02,  3.31it/s]
 77%|███████▋  | 287169/371472 [41:01<6:42:49,  3.49it/s]
 77%|███████▋  | 287170/371472 [41:01<6:42:08,  3.49it/s]
 77%|███████▋  | 287171/371472 [41:02<6:24:36,  3.65it/s]
 77%|███████▋  | 287172/371472 [41:02<6:33:31,  3.57it/s]
 77%|███████▋  | 287173/371472 [41:02<6:36:52,  3.54it/s]
 77%|███████▋  | 287174/371472 [41:03<6:42:44,  3.49it/s]
 77%|███████▋  | 287175/371472 [41:03<6:36:07,  3.55it/s]
 77%|███████▋  | 287176/371472 [41:03<7:18:59,  3.20it/s]
 77%|███████▋  | 287177/371472 [41:04<6:59:46,  3.35it/s]
 77%|███████▋  | 287178/371472 [41:04<6:51:00,  3.42it/s]
 77%|███████▋  | 287179/371472 [41:04<6:41:39,  3.50it/s]
 77%|███████▋  | 287180/371472 [41:04<6:37:38,  3.53it/s]
                                                         
{'loss': 2.6251, 'learning_rate': 3.0433213385334735e-07, 'epoch': 12.37}

 77%|███████▋  | 287180/371472 [41:04<6:37:38,  3.53it/s]
 77%|███████▋  | 287181/371472 [41:05<7:23:49,  3.17it/s]
 77%|███████▋  | 287182/371472 [41:05<7:13:24,  3.24it/s]
 77%|███████▋  | 287183/371472 [41:05<6:51:09,  3.42it/s]
 77%|███████▋  | 287184/371472 [41:06<6:48:55,  3.44it/s]
 77%|███████▋  | 287185/371472 [41:06<6:28:37,  3.61it/s]
 77%|███████▋  | 287186/371472 [41:06<6:40:19,  3.51it/s]
 77%|███████▋  | 287187/371472 [41:06<6:31:04,  3.59it/s]
 77%|███████▋  | 287188/371472 [41:07<6:45:57,  3.46it/s]
 77%|███████▋  | 287189/371472 [41:07<6:33:09,  3.57it/s]
 77%|███████▋  | 287190/371472 [41:07<6:24:58,  3.65it/s]
 77%|███████▋  | 287191/371472 [41:07<6:17:17,  3.72it/s]
 77%|███████▋  | 287192/371472 [41:08<6:07:13,  3.83it/s]
 77%|███████▋  | 287193/371472 [41:08<6:19:44,  3.70it/s]
 77%|███████▋  | 287194/371472 [41:08<6:19:11,  3.70it/s]
 77%|███████▋  | 287195/371472 [41:09<6:16:34,  3.73it/s]
 77%|███████▋  | 287196/371472 [41:09<6:17:56,  3.72it/s]
 77%|███████▋  | 287197/371472 [41:09<6:18:32,  3.71it/s]
 77%|███████▋  | 287198/371472 [41:09<6:13:14,  3.76it/s]
 77%|███████▋  | 287199/371472 [41:10<6:05:08,  3.85it/s]
 77%|███████▋  | 287200/371472 [41:10<6:04:39,  3.85it/s]
                                                         
{'loss': 2.51, 'learning_rate': 3.042836518778685e-07, 'epoch': 12.37}

 77%|███████▋  | 287200/371472 [41:10<6:04:39,  3.85it/s]
 77%|███████▋  | 287201/371472 [41:10<6:14:39,  3.75it/s]
 77%|███████▋  | 287202/371472 [41:10<6:13:33,  3.76it/s]
 77%|███████▋  | 287203/371472 [41:11<6:22:07,  3.68it/s]
 77%|███████▋  | 287204/371472 [41:11<6:41:31,  3.50it/s]
 77%|███████▋  | 287205/371472 [41:11<6:26:57,  3.63it/s]
 77%|███████▋  | 287206/371472 [41:12<6:31:11,  3.59it/s]
 77%|███████▋  | 287207/371472 [41:12<6:22:58,  3.67it/s]
 77%|███████▋  | 287208/371472 [41:12<6:30:58,  3.59it/s]
 77%|███████▋  | 287209/371472 [41:12<6:50:54,  3.42it/s]
 77%|███████▋  | 287210/371472 [41:13<7:42:57,  3.03it/s]
 77%|███████▋  | 287211/371472 [41:13<7:38:08,  3.07it/s]
 77%|███████▋  | 287212/371472 [41:13<7:14:54,  3.23it/s]
 77%|███████▋  | 287213/371472 [41:14<7:06:04,  3.30it/s]
 77%|███████▋  | 287214/371472 [41:14<7:10:40,  3.26it/s]
 77%|███████▋  | 287215/371472 [41:14<7:12:49,  3.24it/s]
 77%|███████▋  | 287216/371472 [41:15<7:14:12,  3.23it/s]
 77%|███████▋  | 287217/371472 [41:15<7:02:14,  3.33it/s]
 77%|███████▋  | 287218/371472 [41:15<6:52:11,  3.41it/s]
 77%|███████▋  | 287219/371472 [41:15<6:44:39,  3.47it/s]
 77%|███████▋  | 287220/371472 [41:16<6:35:09,  3.55it/s]
                                                         
{'loss': 2.5275, 'learning_rate': 3.042351699023896e-07, 'epoch': 12.37}

 77%|███████▋  | 287220/371472 [41:16<6:35:09,  3.55it/s]
 77%|███████▋  | 287221/371472 [41:16<6:48:06,  3.44it/s]
 77%|███████▋  | 287222/371472 [41:16<6:37:08,  3.54it/s]
 77%|███████▋  | 287223/371472 [41:17<6:44:04,  3.47it/s]
 77%|███████▋  | 287224/371472 [41:17<6:37:25,  3.53it/s]
 77%|███████▋  | 287225/371472 [41:17<6:30:24,  3.60it/s]
 77%|███████▋  | 287226/371472 [41:17<6:37:00,  3.54it/s]
 77%|███████▋  | 287227/371472 [41:18<6:58:55,  3.35it/s]
 77%|███████▋  | 287228/371472 [41:18<6:56:12,  3.37it/s]
 77%|███████▋  | 287229/371472 [41:18<6:45:03,  3.47it/s]
 77%|███████▋  | 287230/371472 [41:19<6:47:10,  3.45it/s]
 77%|███████▋  | 287231/371472 [41:19<6:24:21,  3.65it/s]
 77%|███████▋  | 287232/371472 [41:19<6:19:39,  3.70it/s]
 77%|███████▋  | 287233/371472 [41:19<6:30:58,  3.59it/s]
 77%|███████▋  | 287234/371472 [41:20<6:31:34,  3.59it/s]
 77%|███████▋  | 287235/371472 [41:20<6:56:20,  3.37it/s]
 77%|███████▋  | 287236/371472 [41:20<6:42:43,  3.49it/s]
 77%|███████▋  | 287237/371472 [41:21<6:35:28,  3.55it/s]
 77%|███████▋  | 287238/371472 [41:21<6:52:24,  3.40it/s]
 77%|███████▋  | 287239/371472 [41:21<6:52:48,  3.40it/s]
 77%|███████▋  | 287240/371472 [41:21<6:36:30,  3.54it/s]
                                                         
{'loss': 2.6751, 'learning_rate': 3.041866879269108e-07, 'epoch': 12.37}

 77%|███████▋  | 287240/371472 [41:21<6:36:30,  3.54it/s]
 77%|███████▋  | 287241/371472 [41:22<6:35:53,  3.55it/s]
 77%|███████▋  | 287242/371472 [41:22<6:42:11,  3.49it/s]
 77%|███████▋  | 287243/371472 [41:22<6:42:35,  3.49it/s]
 77%|███████▋  | 287244/371472 [41:23<6:27:23,  3.62it/s]
 77%|███████▋  | 287245/371472 [41:23<6:36:50,  3.54it/s]
 77%|███████▋  | 287246/371472 [41:23<6:40:28,  3.51it/s]
 77%|███████▋  | 287247/371472 [41:23<6:50:07,  3.42it/s]
 77%|███████▋  | 287248/371472 [41:24<6:54:10,  3.39it/s]
 77%|███████▋  | 287249/371472 [41:24<6:56:29,  3.37it/s]
 77%|███████▋  | 287250/371472 [41:24<6:31:09,  3.59it/s]
 77%|███████▋  | 287251/371472 [41:25<6:24:38,  3.65it/s]
 77%|███████▋  | 287252/371472 [41:25<6:25:56,  3.64it/s]
 77%|███████▋  | 287253/371472 [41:25<6:42:09,  3.49it/s]
 77%|███████▋  | 287254/371472 [41:25<6:50:17,  3.42it/s]
 77%|███████▋  | 287255/371472 [41:26<6:44:37,  3.47it/s]
 77%|███████▋  | 287256/371472 [41:26<6:45:50,  3.46it/s]
 77%|███████▋  | 287257/371472 [41:26<6:45:51,  3.46it/s]
 77%|███████▋  | 287258/371472 [41:27<6:33:41,  3.57it/s]
 77%|███████▋  | 287259/371472 [41:27<6:28:26,  3.61it/s]
 77%|███████▋  | 287260/371472 [41:27<6:25:08,  3.64it/s]
                                                         
{'loss': 2.5879, 'learning_rate': 3.0413820595143185e-07, 'epoch': 12.37}

 77%|███████▋  | 287260/371472 [41:27<6:25:08,  3.64it/s]
 77%|███████▋  | 287261/371472 [41:27<6:25:11,  3.64it/s]
 77%|███████▋  | 287262/371472 [41:28<6:42:50,  3.48it/s]
 77%|███████▋  | 287263/371472 [41:28<6:30:13,  3.60it/s]
 77%|███████▋  | 287264/371472 [41:28<6:21:50,  3.68it/s]
 77%|███████▋  | 287265/371472 [41:29<6:20:42,  3.69it/s]
 77%|███████▋  | 287266/371472 [41:29<7:09:46,  3.27it/s]
 77%|███████▋  | 287267/371472 [41:29<6:49:38,  3.43it/s]
 77%|███████▋  | 287268/371472 [41:29<6:40:52,  3.50it/s]
 77%|███████▋  | 287269/371472 [41:30<6:39:16,  3.51it/s]
 77%|███████▋  | 287270/371472 [41:30<6:30:12,  3.60it/s]
 77%|███████▋  | 287271/371472 [41:30<6:14:22,  3.75it/s]
 77%|███████▋  | 287272/371472 [41:30<6:03:42,  3.86it/s]
 77%|███████▋  | 287273/371472 [41:31<5:59:45,  3.90it/s]
 77%|███████▋  | 287274/371472 [41:31<6:14:56,  3.74it/s]
 77%|███████▋  | 287275/371472 [41:31<6:46:07,  3.46it/s]
 77%|███████▋  | 287276/371472 [41:32<6:35:27,  3.55it/s]
 77%|███████▋  | 287277/371472 [41:32<6:26:29,  3.63it/s]
 77%|███████▋  | 287278/371472 [41:32<6:22:16,  3.67it/s]
 77%|███████▋  | 287279/371472 [41:32<6:12:57,  3.76it/s]
 77%|███████▋  | 287280/371472 [41:33<6:31:38,  3.58it/s]
                                                         
{'loss': 2.5084, 'learning_rate': 3.0408972397595297e-07, 'epoch': 12.37}

 77%|███████▋  | 287280/371472 [41:33<6:31:38,  3.58it/s]
 77%|███████▋  | 287281/371472 [41:33<6:28:31,  3.61it/s]
 77%|███████▋  | 287282/371472 [41:33<6:20:27,  3.69it/s]
 77%|███████▋  | 287283/371472 [41:34<6:24:58,  3.64it/s]
 77%|███████▋  | 287284/371472 [41:34<6:28:33,  3.61it/s]
 77%|███████▋  | 287285/371472 [41:34<6:37:59,  3.53it/s]
 77%|███████▋  | 287286/371472 [41:34<7:15:24,  3.22it/s]
 77%|███████▋  | 287287/371472 [41:35<7:17:11,  3.21it/s]
 77%|███████▋  | 287288/371472 [41:35<7:23:01,  3.17it/s]
 77%|███████▋  | 287289/371472 [41:35<7:01:11,  3.33it/s]
 77%|███████▋  | 287290/371472 [41:36<6:55:32,  3.38it/s]
 77%|███████▋  | 287291/371472 [41:36<7:11:32,  3.25it/s]
 77%|███████▋  | 287292/371472 [41:36<6:56:10,  3.37it/s]
 77%|███████▋  | 287293/371472 [41:37<6:51:00,  3.41it/s]
 77%|███████▋  | 287294/371472 [41:37<6:27:14,  3.62it/s]
 77%|███████▋  | 287295/371472 [41:37<6:30:07,  3.60it/s]
 77%|███████▋  | 287296/371472 [41:37<6:25:12,  3.64it/s]
 77%|███████▋  | 287297/371472 [41:38<6:16:17,  3.73it/s]
 77%|███████▋  | 287298/371472 [41:38<6:12:23,  3.77it/s]
 77%|███████▋  | 287299/371472 [41:38<6:11:24,  3.78it/s]
 77%|███████▋  | 287300/371472 [41:38<6:57:01,  3.36it/s]
                                                         
{'loss': 2.605, 'learning_rate': 3.0404124200047404e-07, 'epoch': 12.37}

 77%|███████▋  | 287300/371472 [41:38<6:57:01,  3.36it/s]
 77%|███████▋  | 287301/371472 [41:39<6:49:33,  3.43it/s]
 77%|███████▋  | 287302/371472 [41:39<6:48:05,  3.44it/s]
 77%|███████▋  | 287303/371472 [41:39<7:14:17,  3.23it/s]
 77%|███████▋  | 287304/371472 [41:40<7:20:34,  3.18it/s]
 77%|███████▋  | 287305/371472 [41:40<7:12:29,  3.24it/s]
 77%|███████▋  | 287306/371472 [41:40<6:48:14,  3.44it/s]
 77%|███████▋  | 287307/371472 [41:41<6:48:08,  3.44it/s]
 77%|███████▋  | 287308/371472 [41:41<6:58:27,  3.35it/s]
 77%|███████▋  | 287309/371472 [41:41<6:40:59,  3.50it/s]
 77%|███████▋  | 287310/371472 [41:41<6:46:11,  3.45it/s]
 77%|███████▋  | 287311/371472 [41:42<6:55:22,  3.38it/s]
 77%|███████▋  | 287312/371472 [41:42<6:36:40,  3.54it/s]
 77%|███████▋  | 287313/371472 [41:42<6:21:37,  3.68it/s]
 77%|███████▋  | 287314/371472 [41:43<6:27:26,  3.62it/s]
 77%|███████▋  | 287315/371472 [41:43<6:50:30,  3.42it/s]
 77%|███████▋  | 287316/371472 [41:43<6:41:07,  3.50it/s]
 77%|███████▋  | 287317/371472 [41:43<6:21:24,  3.68it/s]
 77%|███████▋  | 287318/371472 [41:44<6:24:29,  3.65it/s]
 77%|███████▋  | 287319/371472 [41:44<6:26:48,  3.63it/s]
 77%|███████▋  | 287320/371472 [41:44<6:25:56,  3.63it/s]
                                                         
{'loss': 2.631, 'learning_rate': 3.0399276002499517e-07, 'epoch': 12.38}

 77%|███████▋  | 287320/371472 [41:44<6:25:56,  3.63it/s]
 77%|███████▋  | 287321/371472 [41:44<6:25:24,  3.64it/s]
 77%|███████▋  | 287322/371472 [41:45<6:17:07,  3.72it/s]
 77%|███████▋  | 287323/371472 [41:45<6:17:35,  3.71it/s]
 77%|███████▋  | 287324/371472 [41:45<6:11:01,  3.78it/s]
 77%|███████▋  | 287325/371472 [41:45<6:02:36,  3.87it/s]
 77%|███████▋  | 287326/371472 [41:46<6:05:07,  3.84it/s]
 77%|███████▋  | 287327/371472 [41:46<6:16:43,  3.72it/s]
 77%|███████▋  | 287328/371472 [41:46<6:17:17,  3.72it/s]
 77%|███████▋  | 287329/371472 [41:47<6:28:21,  3.61it/s]
 77%|███████▋  | 287330/371472 [41:47<6:50:17,  3.42it/s]
 77%|███████▋  | 287331/371472 [41:47<7:05:23,  3.30it/s]
 77%|███████▋  | 287332/371472 [41:48<6:52:29,  3.40it/s]
 77%|███████▋  | 287333/371472 [41:48<6:38:05,  3.52it/s]
 77%|███████▋  | 287334/371472 [41:48<6:44:59,  3.46it/s]
 77%|███████▋  | 287335/371472 [41:48<6:25:46,  3.64it/s]
 77%|███████▋  | 287336/371472 [41:49<6:22:25,  3.67it/s]
 77%|███████▋  | 287337/371472 [41:49<6:22:00,  3.67it/s]
 77%|███████▋  | 287338/371472 [41:49<6:19:22,  3.70it/s]
 77%|███████▋  | 287339/371472 [41:49<6:41:28,  3.49it/s]
 77%|███████▋  | 287340/371472 [41:50<6:36:41,  3.53it/s]
                                                         
{'loss': 2.6851, 'learning_rate': 3.0394427804951624e-07, 'epoch': 12.38}

 77%|███████▋  | 287340/371472 [41:50<6:36:41,  3.53it/s]
 77%|███████▋  | 287341/371472 [41:50<6:41:20,  3.49it/s]
 77%|███████▋  | 287342/371472 [41:50<6:28:07,  3.61it/s]
 77%|███████▋  | 287343/371472 [41:51<6:30:33,  3.59it/s]
 77%|███████▋  | 287344/371472 [41:51<6:54:34,  3.38it/s]
 77%|███████▋  | 287345/371472 [41:51<6:42:04,  3.49it/s]
 77%|███████▋  | 287346/371472 [41:51<6:45:18,  3.46it/s]
 77%|███████▋  | 287347/371472 [41:52<6:36:55,  3.53it/s]
 77%|███████▋  | 287348/371472 [41:52<6:40:19,  3.50it/s]
 77%|███████▋  | 287349/371472 [41:52<6:40:17,  3.50it/s]
 77%|███████▋  | 287350/371472 [41:53<6:44:47,  3.46it/s]
 77%|███████▋  | 287351/371472 [41:53<7:08:43,  3.27it/s]
 77%|███████▋  | 287352/371472 [41:53<6:45:38,  3.46it/s]
 77%|███████▋  | 287353/371472 [41:53<6:26:34,  3.63it/s]
 77%|███████▋  | 287354/371472 [41:54<6:36:25,  3.54it/s]
 77%|███████▋  | 287355/371472 [41:54<6:31:34,  3.58it/s]
 77%|███████▋  | 287356/371472 [41:54<6:17:18,  3.72it/s]
 77%|███████▋  | 287357/371472 [41:55<6:23:06,  3.66it/s]
 77%|███████▋  | 287358/371472 [41:55<6:42:54,  3.48it/s]
 77%|███████▋  | 287359/371472 [41:55<6:40:11,  3.50it/s]
 77%|███████▋  | 287360/371472 [41:55<6:29:53,  3.60it/s]
                                                         
{'loss': 2.5198, 'learning_rate': 3.038957960740373e-07, 'epoch': 12.38}

 77%|███████▋  | 287360/371472 [41:55<6:29:53,  3.60it/s]
 77%|███████▋  | 287361/371472 [41:56<6:21:42,  3.67it/s]
 77%|███████▋  | 287362/371472 [41:56<6:32:56,  3.57it/s]
 77%|███████▋  | 287363/371472 [41:56<6:31:42,  3.58it/s]
 77%|███████▋  | 287364/371472 [41:57<6:20:37,  3.68it/s]
 77%|███████▋  | 287365/371472 [41:57<6:20:05,  3.69it/s]
 77%|███████▋  | 287366/371472 [41:57<6:37:42,  3.52it/s]
 77%|███████▋  | 287367/371472 [41:57<6:38:58,  3.51it/s]
 77%|███████▋  | 287368/371472 [41:58<6:24:07,  3.65it/s]
 77%|███████▋  | 287369/371472 [41:58<6:15:35,  3.73it/s]
 77%|███████▋  | 287370/371472 [41:58<6:36:29,  3.54it/s]
 77%|███████▋  | 287371/371472 [41:59<6:46:02,  3.45it/s]
 77%|███████▋  | 287372/371472 [41:59<6:50:12,  3.42it/s]
 77%|███████▋  | 287373/371472 [41:59<6:45:24,  3.46it/s]
 77%|███████▋  | 287374/371472 [41:59<6:29:43,  3.60it/s]
 77%|███████▋  | 287375/371472 [42:00<6:24:14,  3.65it/s]
 77%|███████▋  | 287376/371472 [42:00<6:29:21,  3.60it/s]
 77%|███████▋  | 287377/371472 [42:00<6:22:06,  3.67it/s]
 77%|███████▋  | 287378/371472 [42:00<6:49:22,  3.42it/s]
 77%|███████▋  | 287379/371472 [42:01<6:40:20,  3.50it/s]
 77%|███████▋  | 287380/371472 [42:01<6:35:56,  3.54it/s]
                                                         
{'loss': 2.6957, 'learning_rate': 3.038473140985585e-07, 'epoch': 12.38}

 77%|███████▋  | 287380/371472 [42:01<6:35:56,  3.54it/s]
 77%|███████▋  | 287381/371472 [42:01<6:36:07,  3.54it/s]
 77%|███████▋  | 287382/371472 [42:02<6:58:05,  3.35it/s]
 77%|███████▋  | 287383/371472 [42:02<6:57:47,  3.35it/s]
 77%|███████▋  | 287384/371472 [42:02<6:43:41,  3.47it/s]
 77%|███████▋  | 287385/371472 [42:03<6:46:49,  3.44it/s]
 77%|███████▋  | 287386/371472 [42:03<6:45:33,  3.46it/s]
 77%|███████▋  | 287387/371472 [42:03<6:48:43,  3.43it/s]
 77%|███████▋  | 287388/371472 [42:03<6:47:49,  3.44it/s]
 77%|███████▋  | 287389/371472 [42:04<7:16:37,  3.21it/s]
 77%|███████▋  | 287390/371472 [42:04<8:12:49,  2.84it/s]
 77%|███████▋  | 287391/371472 [42:04<7:33:58,  3.09it/s]
 77%|███████▋  | 287392/371472 [42:05<7:37:09,  3.07it/s]
 77%|███████▋  | 287393/371472 [42:05<7:19:19,  3.19it/s]
 77%|███████▋  | 287394/371472 [42:05<6:53:04,  3.39it/s]
 77%|███████▋  | 287395/371472 [42:06<6:38:50,  3.51it/s]
 77%|███████▋  | 287396/371472 [42:06<6:50:12,  3.42it/s]
 77%|███████▋  | 287397/371472 [42:06<7:14:26,  3.23it/s]
 77%|███████▋  | 287398/371472 [42:06<6:50:23,  3.41it/s]
 77%|███████▋  | 287399/371472 [42:07<6:49:57,  3.42it/s]
 77%|███████▋  | 287400/371472 [42:07<6:37:21,  3.53it/s]
                                                         
{'loss': 2.6435, 'learning_rate': 3.0379883212307956e-07, 'epoch': 12.38}

 77%|███████▋  | 287400/371472 [42:07<6:37:21,  3.53it/s]
 77%|███████▋  | 287401/371472 [42:07<6:24:48,  3.64it/s]
 77%|███████▋  | 287402/371472 [42:08<6:25:28,  3.63it/s]
 77%|███████▋  | 287403/371472 [42:08<6:49:57,  3.42it/s]
 77%|███████▋  | 287404/371472 [42:08<6:39:41,  3.51it/s]
 77%|███████▋  | 287405/371472 [42:08<6:30:05,  3.59it/s]
 77%|███████▋  | 287406/371472 [42:09<6:24:59,  3.64it/s]
 77%|███████▋  | 287407/371472 [42:09<6:54:36,  3.38it/s]
 77%|███████▋  | 287408/371472 [42:09<6:58:30,  3.35it/s]
 77%|███████▋  | 287409/371472 [42:10<6:47:01,  3.44it/s]
 77%|███████▋  | 287410/371472 [42:10<6:42:14,  3.48it/s]
 77%|███████▋  | 287411/371472 [42:10<6:30:35,  3.59it/s]
 77%|███████▋  | 287412/371472 [42:10<6:19:14,  3.69it/s]
 77%|███████▋  | 287413/371472 [42:11<6:11:41,  3.77it/s]
 77%|███████▋  | 287414/371472 [42:11<6:27:21,  3.62it/s]
 77%|███████▋  | 287415/371472 [42:11<6:30:26,  3.59it/s]
 77%|███████▋  | 287416/371472 [42:12<6:33:33,  3.56it/s]
 77%|███████▋  | 287417/371472 [42:12<6:50:10,  3.42it/s]
 77%|███████▋  | 287418/371472 [42:12<6:36:25,  3.53it/s]
 77%|███████▋  | 287419/371472 [42:12<6:36:26,  3.53it/s]
 77%|███████▋  | 287420/371472 [42:13<6:25:21,  3.64it/s]
                                                         
{'loss': 2.5182, 'learning_rate': 3.037503501476007e-07, 'epoch': 12.38}

 77%|███████▋  | 287420/371472 [42:13<6:25:21,  3.64it/s]
 77%|███████▋  | 287421/371472 [42:13<6:36:22,  3.53it/s]
 77%|███████▋  | 287422/371472 [42:13<6:52:41,  3.39it/s]
 77%|███████▋  | 287423/371472 [42:14<6:36:31,  3.53it/s]
 77%|███████▋  | 287424/371472 [42:14<6:29:39,  3.59it/s]
 77%|███████▋  | 287425/371472 [42:14<6:37:07,  3.53it/s]
 77%|███████▋  | 287426/371472 [42:14<6:33:16,  3.56it/s]
 77%|███████▋  | 287427/371472 [42:15<6:21:06,  3.68it/s]
 77%|███████▋  | 287428/371472 [42:15<6:25:06,  3.64it/s]
 77%|███████▋  | 287429/371472 [42:15<6:35:19,  3.54it/s]
 77%|███████▋  | 287430/371472 [42:16<6:50:20,  3.41it/s]
 77%|███████▋  | 287431/371472 [42:16<6:51:43,  3.40it/s]
 77%|███████▋  | 287432/371472 [42:16<6:49:04,  3.42it/s]
 77%|███████▋  | 287433/371472 [42:16<6:41:34,  3.49it/s]
 77%|███████▋  | 287434/371472 [42:17<6:31:35,  3.58it/s]
 77%|███████▋  | 287435/371472 [42:17<6:32:28,  3.57it/s]
 77%|███████▋  | 287436/371472 [42:17<6:17:56,  3.71it/s]
 77%|███████▋  | 287437/371472 [42:17<6:18:13,  3.70it/s]
 77%|███████▋  | 287438/371472 [42:18<6:09:02,  3.80it/s]
 77%|███████▋  | 287439/371472 [42:18<6:23:43,  3.65it/s]
 77%|███████▋  | 287440/371472 [42:18<6:22:31,  3.66it/s]
                                                         
{'loss': 2.7017, 'learning_rate': 3.037018681721217e-07, 'epoch': 12.38}

 77%|███████▋  | 287440/371472 [42:18<6:22:31,  3.66it/s]
 77%|███████▋  | 287441/371472 [42:19<6:14:19,  3.74it/s]
 77%|███████▋  | 287442/371472 [42:19<6:10:59,  3.77it/s]
 77%|███████▋  | 287443/371472 [42:19<6:19:04,  3.69it/s]
 77%|███████▋  | 287444/371472 [42:19<6:13:04,  3.75it/s]
 77%|███████▋  | 287445/371472 [42:20<7:08:46,  3.27it/s]
 77%|███████▋  | 287446/371472 [42:20<7:26:31,  3.14it/s]
 77%|███████▋  | 287447/371472 [42:20<7:27:51,  3.13it/s]
 77%|███████▋  | 287448/371472 [42:21<7:04:28,  3.30it/s]
 77%|███████▋  | 287449/371472 [42:21<6:37:49,  3.52it/s]
 77%|███████▋  | 287450/371472 [42:21<6:24:41,  3.64it/s]
 77%|███████▋  | 287451/371472 [42:21<6:18:34,  3.70it/s]
 77%|███████▋  | 287452/371472 [42:22<6:07:14,  3.81it/s]
 77%|███████▋  | 287453/371472 [42:22<6:28:28,  3.60it/s]
 77%|███████▋  | 287454/371472 [42:22<6:23:02,  3.66it/s]
 77%|███████▋  | 287455/371472 [42:23<6:27:29,  3.61it/s]
 77%|███████▋  | 287456/371472 [42:23<6:23:49,  3.65it/s]
 77%|███████▋  | 287457/371472 [42:23<6:25:31,  3.63it/s]
 77%|███████▋  | 287458/371472 [42:23<6:14:02,  3.74it/s]
 77%|███████▋  | 287459/371472 [42:24<6:55:42,  3.37it/s]
 77%|███████▋  | 287460/371472 [42:24<6:52:00,  3.40it/s]
                                                         
{'loss': 2.7335, 'learning_rate': 3.036533861966429e-07, 'epoch': 12.38}

 77%|███████▋  | 287460/371472 [42:24<6:52:00,  3.40it/s]
 77%|███████▋  | 287461/371472 [42:24<6:36:43,  3.53it/s]
 77%|███████▋  | 287462/371472 [42:25<6:42:42,  3.48it/s]
 77%|███████▋  | 287463/371472 [42:25<6:51:18,  3.40it/s]
 77%|███████▋  | 287464/371472 [42:25<6:49:48,  3.42it/s]
 77%|███████▋  | 287465/371472 [42:25<6:36:43,  3.53it/s]
 77%|███████▋  | 287466/371472 [42:26<6:37:56,  3.52it/s]
 77%|███████▋  | 287467/371472 [42:26<6:46:10,  3.45it/s]
 77%|███████▋  | 287468/371472 [42:26<7:05:37,  3.29it/s]
 77%|███████▋  | 287469/371472 [42:27<6:52:21,  3.40it/s]
 77%|███████▋  | 287470/371472 [42:27<6:47:45,  3.43it/s]
 77%|███████▋  | 287471/371472 [42:27<6:47:45,  3.43it/s]
 77%|███████▋  | 287472/371472 [42:27<6:50:15,  3.41it/s]
 77%|███████▋  | 287473/371472 [42:28<6:37:28,  3.52it/s]
 77%|███████▋  | 287474/371472 [42:28<7:00:25,  3.33it/s]
 77%|███████▋  | 287475/371472 [42:28<6:46:20,  3.45it/s]
 77%|███████▋  | 287476/371472 [42:29<6:36:39,  3.53it/s]
 77%|███████▋  | 287477/371472 [42:29<6:31:03,  3.58it/s]
 77%|███████▋  | 287478/371472 [42:29<7:04:56,  3.29it/s]
 77%|███████▋  | 287479/371472 [42:29<6:46:41,  3.44it/s]
 77%|███████▋  | 287480/371472 [42:30<6:30:44,  3.58it/s]
                                                         
{'loss': 2.69, 'learning_rate': 3.0360490422116395e-07, 'epoch': 12.38}

 77%|███████▋  | 287480/371472 [42:30<6:30:44,  3.58it/s]
 77%|███████▋  | 287481/371472 [42:30<6:31:28,  3.58it/s]
 77%|███████▋  | 287482/371472 [42:30<6:30:57,  3.58it/s]
 77%|███████▋  | 287483/371472 [42:31<6:41:30,  3.49it/s]
 77%|███████▋  | 287484/371472 [42:31<6:42:56,  3.47it/s]
 77%|███████▋  | 287485/371472 [42:31<6:32:32,  3.57it/s]
 77%|███████▋  | 287486/371472 [42:31<6:27:48,  3.61it/s]
 77%|███████▋  | 287487/371472 [42:32<6:52:10,  3.40it/s]
 77%|███████▋  | 287488/371472 [42:32<6:27:31,  3.61it/s]
 77%|███████▋  | 287489/371472 [42:32<6:26:07,  3.62it/s]
 77%|███████▋  | 287490/371472 [42:33<6:28:17,  3.60it/s]
 77%|███████▋  | 287491/371472 [42:33<6:14:08,  3.74it/s]
 77%|███████▋  | 287492/371472 [42:33<6:57:52,  3.35it/s]
 77%|███████▋  | 287493/371472 [42:34<7:48:33,  2.99it/s]
 77%|███████▋  | 287494/371472 [42:34<7:23:04,  3.16it/s]
 77%|███████▋  | 287495/371472 [42:34<7:17:25,  3.20it/s]
 77%|███████▋  | 287496/371472 [42:34<6:59:34,  3.34it/s]
 77%|███████▋  | 287497/371472 [42:35<6:39:20,  3.50it/s]
 77%|███████▋  | 287498/371472 [42:35<7:07:46,  3.27it/s]
 77%|███████▋  | 287499/371472 [42:35<6:48:54,  3.42it/s]
 77%|███████▋  | 287500/371472 [42:36<7:21:58,  3.17it/s]
                                                         
{'loss': 2.4446, 'learning_rate': 3.035564222456851e-07, 'epoch': 12.38}

 77%|███████▋  | 287500/371472 [42:36<7:21:58,  3.17it/s]
 77%|███████▋  | 287501/371472 [42:36<7:11:56,  3.24it/s]
 77%|███████▋  | 287502/371472 [42:36<7:03:53,  3.30it/s]
 77%|███████▋  | 287503/371472 [42:37<7:07:45,  3.27it/s]
 77%|███████▋  | 287504/371472 [42:37<7:00:10,  3.33it/s]
 77%|███████▋  | 287505/371472 [42:37<7:10:32,  3.25it/s]
 77%|███████▋  | 287506/371472 [42:37<6:57:31,  3.35it/s]
 77%|███████▋  | 287507/371472 [42:38<6:37:14,  3.52it/s]
 77%|███████▋  | 287508/371472 [42:38<6:36:13,  3.53it/s]
 77%|███████▋  | 287509/371472 [42:38<6:31:03,  3.58it/s]
 77%|███████▋  | 287510/371472 [42:39<6:44:47,  3.46it/s]
 77%|███████▋  | 287511/371472 [42:39<6:44:35,  3.46it/s]
 77%|███████▋  | 287512/371472 [42:39<6:33:22,  3.56it/s]
 77%|███████▋  | 287513/371472 [42:39<6:34:18,  3.55it/s]
 77%|███████▋  | 287514/371472 [42:40<6:47:26,  3.43it/s]
 77%|███████▋  | 287515/371472 [42:40<6:43:09,  3.47it/s]
 77%|███████▋  | 287516/371472 [42:40<6:30:38,  3.58it/s]
 77%|███████▋  | 287517/371472 [42:41<6:49:00,  3.42it/s]
 77%|███████▋  | 287518/371472 [42:41<6:58:58,  3.34it/s]
 77%|███████▋  | 287519/371472 [42:41<6:52:08,  3.40it/s]
 77%|███████▋  | 287520/371472 [42:41<6:36:53,  3.53it/s]
                                                         
{'loss': 2.6119, 'learning_rate': 3.035079402702062e-07, 'epoch': 12.38}

 77%|███████▋  | 287520/371472 [42:41<6:36:53,  3.53it/s]
 77%|███████▋  | 287521/371472 [42:42<7:12:17,  3.24it/s]
 77%|███████▋  | 287522/371472 [42:42<6:54:00,  3.38it/s]
 77%|███████▋  | 287523/371472 [42:42<6:33:18,  3.56it/s]
 77%|███████▋  | 287524/371472 [42:43<6:50:24,  3.41it/s]
 77%|███████▋  | 287525/371472 [42:43<6:38:59,  3.51it/s]
 77%|███████▋  | 287526/371472 [42:43<6:49:30,  3.42it/s]
 77%|███████▋  | 287527/371472 [42:43<6:43:50,  3.46it/s]
 77%|███████▋  | 287528/371472 [42:44<6:36:38,  3.53it/s]
 77%|███████▋  | 287529/371472 [42:44<6:31:08,  3.58it/s]
 77%|███████▋  | 287530/371472 [42:44<6:26:01,  3.62it/s]
 77%|███████▋  | 287531/371472 [42:45<6:31:51,  3.57it/s]
 77%|███████▋  | 287532/371472 [42:45<7:05:20,  3.29it/s]
 77%|███████▋  | 287533/371472 [42:45<6:54:24,  3.38it/s]
 77%|███████▋  | 287534/371472 [42:46<6:56:27,  3.36it/s]
 77%|███████▋  | 287535/371472 [42:46<6:52:35,  3.39it/s]
 77%|███████▋  | 287536/371472 [42:46<7:05:05,  3.29it/s]
 77%|███████▋  | 287537/371472 [42:46<6:57:29,  3.35it/s]
 77%|███████▋  | 287538/371472 [42:47<7:08:17,  3.27it/s]
 77%|███████▋  | 287539/371472 [42:47<6:45:43,  3.45it/s]
 77%|███████▋  | 287540/371472 [42:47<6:38:29,  3.51it/s]
                                                         
{'loss': 2.7492, 'learning_rate': 3.034594582947273e-07, 'epoch': 12.38}

 77%|███████▋  | 287540/371472 [42:47<6:38:29,  3.51it/s]
 77%|███████▋  | 287541/371472 [42:48<6:45:06,  3.45it/s]
 77%|███████▋  | 287542/371472 [42:48<6:34:58,  3.54it/s]
 77%|███████▋  | 287543/371472 [42:48<6:52:36,  3.39it/s]
 77%|███████▋  | 287544/371472 [42:48<6:54:24,  3.38it/s]
 77%|███████▋  | 287545/371472 [42:49<6:52:26,  3.39it/s]
 77%|███████▋  | 287546/371472 [42:49<7:25:57,  3.14it/s]
 77%|███████▋  | 287547/371472 [42:49<6:59:33,  3.33it/s]
 77%|███████▋  | 287548/371472 [42:50<6:53:13,  3.38it/s]
 77%|███████▋  | 287549/371472 [42:50<6:42:15,  3.48it/s]
 77%|███████▋  | 287550/371472 [42:50<6:47:25,  3.43it/s]
 77%|███████▋  | 287551/371472 [42:51<6:39:22,  3.50it/s]
 77%|███████▋  | 287552/371472 [42:51<6:28:07,  3.60it/s]
 77%|███████▋  | 287553/371472 [42:51<6:16:11,  3.72it/s]
 77%|███████▋  | 287554/371472 [42:51<6:23:31,  3.65it/s]
 77%|███████▋  | 287555/371472 [42:52<6:46:09,  3.44it/s]
 77%|███████▋  | 287556/371472 [42:52<6:33:01,  3.56it/s]
 77%|███████▋  | 287557/371472 [42:52<6:42:34,  3.47it/s]
 77%|███████▋  | 287558/371472 [42:52<6:30:50,  3.58it/s]
 77%|███████▋  | 287559/371472 [42:53<6:31:27,  3.57it/s]
 77%|███████▋  | 287560/371472 [42:53<6:32:45,  3.56it/s]
                                                         
{'loss': 2.5787, 'learning_rate': 3.0341097631924834e-07, 'epoch': 12.39}

 77%|███████▋  | 287560/371472 [42:53<6:32:45,  3.56it/s]
 77%|███████▋  | 287561/371472 [42:53<6:21:30,  3.67it/s]
 77%|███████▋  | 287562/371472 [42:54<6:15:09,  3.73it/s]
 77%|███████▋  | 287563/371472 [42:54<6:14:05,  3.74it/s]
 77%|███████▋  | 287564/371472 [42:54<6:18:26,  3.70it/s]
 77%|███████▋  | 287565/371472 [42:54<6:05:03,  3.83it/s]
 77%|███████▋  | 287566/371472 [42:55<6:02:30,  3.86it/s]
 77%|███████▋  | 287567/371472 [42:55<6:06:44,  3.81it/s]
 77%|███████▋  | 287568/371472 [42:55<6:02:48,  3.85it/s]
 77%|███████▋  | 287569/371472 [42:55<5:59:30,  3.89it/s]
 77%|███████▋  | 287570/371472 [42:56<8:03:12,  2.89it/s]
 77%|███████▋  | 287571/371472 [42:56<7:28:47,  3.12it/s]
 77%|███████▋  | 287572/371472 [42:56<7:20:58,  3.17it/s]
 77%|███████▋  | 287573/371472 [42:57<7:03:20,  3.30it/s]
 77%|███████▋  | 287574/371472 [42:57<7:00:20,  3.33it/s]
 77%|███████▋  | 287575/371472 [42:57<6:47:50,  3.43it/s]
 77%|███████▋  | 287576/371472 [42:58<6:38:07,  3.51it/s]
 77%|███████▋  | 287577/371472 [42:58<6:24:25,  3.64it/s]
 77%|███████▋  | 287578/371472 [42:58<6:11:29,  3.76it/s]
 77%|███████▋  | 287579/371472 [42:58<5:56:38,  3.92it/s]
 77%|███████▋  | 287580/371472 [42:59<6:01:58,  3.86it/s]
                                                         
{'loss': 2.7187, 'learning_rate': 3.033624943437695e-07, 'epoch': 12.39}

 77%|███████▋  | 287580/371472 [42:59<6:01:58,  3.86it/s]
 77%|███████▋  | 287581/371472 [42:59<6:03:07,  3.85it/s]
 77%|███████▋  | 287582/371472 [42:59<5:59:29,  3.89it/s]
 77%|███████▋  | 287583/371472 [42:59<6:28:09,  3.60it/s]
 77%|███████▋  | 287584/371472 [43:00<6:36:23,  3.53it/s]
 77%|███████▋  | 287585/371472 [43:00<6:44:50,  3.45it/s]
 77%|███████▋  | 287586/371472 [43:00<6:25:40,  3.63it/s]
 77%|███████▋  | 287587/371472 [43:00<6:13:02,  3.75it/s]
 77%|███████▋  | 287588/371472 [43:01<6:11:28,  3.76it/s]
 77%|███████▋  | 287589/371472 [43:01<6:01:12,  3.87it/s]
 77%|███████▋  | 287590/371472 [43:01<6:17:46,  3.70it/s]
 77%|███████▋  | 287591/371472 [43:02<6:25:31,  3.63it/s]
 77%|███████▋  | 287592/371472 [43:02<6:32:14,  3.56it/s]
 77%|███████▋  | 287593/371472 [43:02<6:27:52,  3.60it/s]
 77%|███████▋  | 287594/371472 [43:02<6:43:31,  3.46it/s]
 77%|███████▋  | 287595/371472 [43:03<6:34:28,  3.54it/s]
 77%|███████▋  | 287596/371472 [43:03<6:31:07,  3.57it/s]
 77%|███████▋  | 287597/371472 [43:03<6:28:09,  3.60it/s]
 77%|███████▋  | 287598/371472 [43:04<6:24:57,  3.63it/s]
 77%|███████▋  | 287599/371472 [43:04<6:10:47,  3.77it/s]
 77%|███████▋  | 287600/371472 [43:04<6:12:28,  3.75it/s]
                                                         
{'loss': 2.5064, 'learning_rate': 3.033140123682906e-07, 'epoch': 12.39}

 77%|███████▋  | 287600/371472 [43:04<6:12:28,  3.75it/s]
 77%|███████▋  | 287601/371472 [43:04<5:59:12,  3.89it/s]
 77%|███████▋  | 287602/371472 [43:05<6:31:10,  3.57it/s]
 77%|███████▋  | 287603/371472 [43:05<6:24:24,  3.64it/s]
 77%|███████▋  | 287604/371472 [43:05<6:17:31,  3.70it/s]
 77%|███████▋  | 287605/371472 [43:05<6:14:25,  3.73it/s]
 77%|███████▋  | 287606/371472 [43:06<6:05:20,  3.83it/s]
 77%|███████▋  | 287607/371472 [43:06<6:10:17,  3.77it/s]
 77%|███████▋  | 287608/371472 [43:06<6:19:18,  3.68it/s]
 77%|███████▋  | 287609/371472 [43:06<6:27:23,  3.61it/s]
 77%|███████▋  | 287610/371472 [43:07<6:31:04,  3.57it/s]
 77%|███████▋  | 287611/371472 [43:07<6:33:26,  3.55it/s]
 77%|███████▋  | 287612/371472 [43:07<6:32:35,  3.56it/s]
 77%|███████▋  | 287613/371472 [43:08<6:16:45,  3.71it/s]
 77%|███████▋  | 287614/371472 [43:08<6:32:59,  3.56it/s]
 77%|███████▋  | 287615/371472 [43:08<6:51:17,  3.40it/s]
 77%|███████▋  | 287616/371472 [43:08<6:44:16,  3.46it/s]
 77%|███████▋  | 287617/371472 [43:09<7:15:26,  3.21it/s]
 77%|███████▋  | 287618/371472 [43:09<6:50:12,  3.41it/s]
 77%|███████▋  | 287619/371472 [43:09<6:53:22,  3.38it/s]
 77%|███████▋  | 287620/371472 [43:10<6:45:49,  3.44it/s]
                                                         
{'loss': 2.8349, 'learning_rate': 3.0326553039281177e-07, 'epoch': 12.39}

 77%|███████▋  | 287620/371472 [43:10<6:45:49,  3.44it/s]
 77%|███████▋  | 287621/371472 [43:10<6:54:12,  3.37it/s]
 77%|███████▋  | 287622/371472 [43:10<7:04:21,  3.29it/s]
 77%|███████▋  | 287623/371472 [43:11<6:52:01,  3.39it/s]
 77%|███████▋  | 287624/371472 [43:11<7:10:28,  3.25it/s]
 77%|███████▋  | 287625/371472 [43:11<7:29:55,  3.11it/s]
 77%|███████▋  | 287626/371472 [43:12<7:08:14,  3.26it/s]
 77%|███████▋  | 287627/371472 [43:12<6:56:26,  3.36it/s]
 77%|███████▋  | 287628/371472 [43:12<6:39:47,  3.50it/s]
 77%|███████▋  | 287629/371472 [43:12<6:43:27,  3.46it/s]
 77%|███████▋  | 287630/371472 [43:13<6:34:52,  3.54it/s]
 77%|███████▋  | 287631/371472 [43:13<6:26:03,  3.62it/s]
 77%|███████▋  | 287632/371472 [43:13<6:35:19,  3.53it/s]
 77%|███████▋  | 287633/371472 [43:13<6:33:21,  3.55it/s]
 77%|███████▋  | 287634/371472 [43:14<6:25:23,  3.63it/s]
 77%|███████▋  | 287635/371472 [43:14<6:22:52,  3.65it/s]
 77%|███████▋  | 287636/371472 [43:14<6:45:27,  3.45it/s]
 77%|███████▋  | 287637/371472 [43:15<6:28:54,  3.59it/s]
 77%|███████▋  | 287638/371472 [43:15<6:36:50,  3.52it/s]
 77%|███████▋  | 287639/371472 [43:15<6:23:24,  3.64it/s]
 77%|███████▋  | 287640/371472 [43:15<6:21:48,  3.66it/s]
                                                         
{'loss': 2.5825, 'learning_rate': 3.032170484173329e-07, 'epoch': 12.39}

 77%|███████▋  | 287640/371472 [43:15<6:21:48,  3.66it/s]
 77%|███████▋  | 287641/371472 [43:16<6:22:41,  3.65it/s]
 77%|███████▋  | 287642/371472 [43:16<6:39:47,  3.49it/s]
 77%|███████▋  | 287643/371472 [43:16<6:38:13,  3.51it/s]
 77%|███████▋  | 287644/371472 [43:17<6:39:12,  3.50it/s]
 77%|███████▋  | 287645/371472 [43:17<6:39:09,  3.50it/s]
 77%|███████▋  | 287646/371472 [43:17<6:43:54,  3.46it/s]
 77%|███████▋  | 287647/371472 [43:17<6:43:54,  3.46it/s]
 77%|███████▋  | 287648/371472 [43:18<6:29:48,  3.58it/s]
 77%|███████▋  | 287649/371472 [43:18<7:51:03,  2.97it/s]
 77%|███████▋  | 287650/371472 [43:19<7:50:01,  2.97it/s]
 77%|███████▋  | 287651/371472 [43:19<7:25:04,  3.14it/s]
 77%|███████▋  | 287652/371472 [43:19<6:57:54,  3.34it/s]
 77%|███████▋  | 287653/371472 [43:19<7:11:59,  3.23it/s]
 77%|███████▋  | 287654/371472 [43:20<7:53:32,  2.95it/s]
 77%|███████▋  | 287655/371472 [43:20<7:57:27,  2.93it/s]
 77%|███████▋  | 287656/371472 [43:20<7:24:40,  3.14it/s]
 77%|███████▋  | 287657/371472 [43:21<7:01:16,  3.32it/s]
 77%|███████▋  | 287658/371472 [43:21<6:39:53,  3.49it/s]
 77%|███████▋  | 287659/371472 [43:21<6:30:34,  3.58it/s]
 77%|███████▋  | 287660/371472 [43:21<6:22:23,  3.65it/s]
                                                         
{'loss': 2.6366, 'learning_rate': 3.0316856644185396e-07, 'epoch': 12.39}

 77%|███████▋  | 287660/371472 [43:21<6:22:23,  3.65it/s]
 77%|███████▋  | 287661/371472 [43:22<6:26:31,  3.61it/s]
 77%|███████▋  | 287662/371472 [43:22<6:29:45,  3.58it/s]
 77%|███████▋  | 287663/371472 [43:22<7:15:13,  3.21it/s]
 77%|███████▋  | 287664/371472 [43:23<6:54:47,  3.37it/s]
 77%|███████▋  | 287665/371472 [43:23<6:48:06,  3.42it/s]
 77%|███████▋  | 287666/371472 [43:23<6:54:53,  3.37it/s]
 77%|███████▋  | 287667/371472 [43:24<6:45:35,  3.44it/s]
 77%|███████▋  | 287668/371472 [43:24<7:09:52,  3.25it/s]
 77%|███████▋  | 287669/371472 [43:24<6:44:53,  3.45it/s]
 77%|███████▋  | 287670/371472 [43:24<6:48:17,  3.42it/s]
 77%|███████▋  | 287671/371472 [43:25<6:33:42,  3.55it/s]
 77%|███████▋  | 287672/371472 [43:25<6:11:03,  3.76it/s]
 77%|███████▋  | 287673/371472 [43:25<6:39:54,  3.49it/s]
 77%|███████▋  | 287674/371472 [43:26<6:42:48,  3.47it/s]
 77%|███████▋  | 287675/371472 [43:26<6:31:06,  3.57it/s]
 77%|███████▋  | 287676/371472 [43:26<6:46:17,  3.44it/s]
 77%|███████▋  | 287677/371472 [43:26<6:43:41,  3.46it/s]
 77%|███████▋  | 287678/371472 [43:27<6:38:20,  3.51it/s]
 77%|███████▋  | 287679/371472 [43:27<6:28:15,  3.60it/s]
 77%|███████▋  | 287680/371472 [43:27<6:52:42,  3.38it/s]
                                                         
{'loss': 2.5046, 'learning_rate': 3.0312008446637503e-07, 'epoch': 12.39}

 77%|███████▋  | 287680/371472 [43:27<6:52:42,  3.38it/s]
 77%|███████▋  | 287681/371472 [43:28<7:11:14,  3.24it/s]
 77%|███████▋  | 287682/371472 [43:28<6:51:00,  3.40it/s]
 77%|███████▋  | 287683/371472 [43:28<6:39:14,  3.50it/s]
 77%|███████▋  | 287684/371472 [43:28<6:39:26,  3.50it/s]
 77%|███████▋  | 287685/371472 [43:29<6:38:31,  3.50it/s]
 77%|███████▋  | 287686/371472 [43:29<7:21:43,  3.16it/s]
 77%|███████▋  | 287687/371472 [43:29<7:01:42,  3.31it/s]
 77%|███████▋  | 287688/371472 [43:30<6:40:28,  3.49it/s]
 77%|███████▋  | 287689/371472 [43:30<6:29:56,  3.58it/s]
 77%|███████▋  | 287690/371472 [43:30<6:23:18,  3.64it/s]
 77%|███████▋  | 287691/371472 [43:30<6:49:34,  3.41it/s]
 77%|███████▋  | 287692/371472 [43:31<6:29:13,  3.59it/s]
 77%|███████▋  | 287693/371472 [43:31<6:20:37,  3.67it/s]
 77%|███████▋  | 287694/371472 [43:31<6:50:34,  3.40it/s]
 77%|███████▋  | 287695/371472 [43:32<6:42:22,  3.47it/s]
 77%|███████▋  | 287696/371472 [43:32<6:47:00,  3.43it/s]
 77%|███████▋  | 287697/371472 [43:32<6:37:52,  3.51it/s]
 77%|███████▋  | 287698/371472 [43:32<6:30:51,  3.57it/s]
 77%|███████▋  | 287699/371472 [43:33<6:48:40,  3.42it/s]
 77%|███████▋  | 287700/371472 [43:33<6:31:04,  3.57it/s]
                                                         
{'loss': 2.6494, 'learning_rate': 3.0307160249089616e-07, 'epoch': 12.39}

 77%|███████▋  | 287700/371472 [43:33<6:31:04,  3.57it/s]
 77%|███████▋  | 287701/371472 [43:33<6:34:22,  3.54it/s]
 77%|███████▋  | 287702/371472 [43:34<6:29:46,  3.58it/s]
 77%|███████▋  | 287703/371472 [43:34<6:18:20,  3.69it/s]
 77%|███████▋  | 287704/371472 [43:34<6:33:30,  3.55it/s]
 77%|███████▋  | 287705/371472 [43:34<6:23:06,  3.64it/s]
 77%|███████▋  | 287706/371472 [43:35<6:07:51,  3.80it/s]
 77%|███████▋  | 287707/371472 [43:35<6:02:53,  3.85it/s]
 77%|███████▋  | 287708/371472 [43:35<6:44:01,  3.46it/s]
 77%|███████▋  | 287709/371472 [43:36<6:42:23,  3.47it/s]
 77%|███████▋  | 287710/371472 [43:36<6:44:33,  3.45it/s]
 77%|███████▋  | 287711/371472 [43:36<6:43:44,  3.46it/s]
 77%|███████▋  | 287712/371472 [43:36<6:27:42,  3.60it/s]
 77%|███████▋  | 287713/371472 [43:37<6:19:29,  3.68it/s]
 77%|███████▋  | 287714/371472 [43:37<6:09:00,  3.78it/s]
 77%|███████▋  | 287715/371472 [43:37<6:13:45,  3.73it/s]
 77%|███████▋  | 287716/371472 [43:37<6:11:39,  3.76it/s]
 77%|███████▋  | 287717/371472 [43:38<6:12:28,  3.75it/s]
 77%|███████▋  | 287718/371472 [43:38<6:20:14,  3.67it/s]
 77%|███████▋  | 287719/371472 [43:38<6:37:39,  3.51it/s]
 77%|███████▋  | 287720/371472 [43:39<6:41:27,  3.48it/s]
                                                         
{'loss': 2.7099, 'learning_rate': 3.0302312051541723e-07, 'epoch': 12.39}

 77%|███████▋  | 287720/371472 [43:39<6:41:27,  3.48it/s]
 77%|███████▋  | 287721/371472 [43:39<6:33:23,  3.55it/s]
 77%|███████▋  | 287722/371472 [43:39<6:35:37,  3.53it/s]
 77%|███████▋  | 287723/371472 [43:39<6:30:18,  3.58it/s]
 77%|███████▋  | 287724/371472 [43:40<6:27:01,  3.61it/s]
 77%|███████▋  | 287725/371472 [43:40<6:49:13,  3.41it/s]
 77%|███████▋  | 287726/371472 [43:40<6:39:47,  3.49it/s]
 77%|███████▋  | 287727/371472 [43:41<6:32:39,  3.55it/s]
 77%|███████▋  | 287728/371472 [43:41<6:33:55,  3.54it/s]
 77%|███████▋  | 287729/371472 [43:41<6:38:53,  3.50it/s]
 77%|███████▋  | 287730/371472 [43:41<6:29:03,  3.59it/s]
 77%|███████▋  | 287731/371472 [43:42<6:29:24,  3.58it/s]
 77%|███████▋  | 287732/371472 [43:42<6:38:32,  3.50it/s]
 77%|███████▋  | 287733/371472 [43:42<7:01:07,  3.31it/s]
 77%|███████▋  | 287734/371472 [43:43<7:00:23,  3.32it/s]
 77%|███████▋  | 287735/371472 [43:43<7:06:52,  3.27it/s]
 77%|███████▋  | 287736/371472 [43:43<7:14:39,  3.21it/s]
 77%|███████▋  | 287737/371472 [43:43<6:50:16,  3.40it/s]
 77%|███████▋  | 287738/371472 [43:44<6:28:05,  3.60it/s]
 77%|███████▋  | 287739/371472 [43:44<6:25:42,  3.62it/s]
 77%|███████▋  | 287740/371472 [43:44<6:29:36,  3.58it/s]
                                                         
{'loss': 2.6851, 'learning_rate': 3.029746385399384e-07, 'epoch': 12.39}

 77%|███████▋  | 287740/371472 [43:44<6:29:36,  3.58it/s]
 77%|███████▋  | 287741/371472 [43:45<6:50:15,  3.40it/s]
 77%|███████▋  | 287742/371472 [43:45<6:41:31,  3.48it/s]
 77%|███████▋  | 287743/371472 [43:45<6:31:00,  3.57it/s]
 77%|███████▋  | 287744/371472 [43:45<6:40:47,  3.48it/s]
 77%|███████▋  | 287745/371472 [43:46<6:20:44,  3.67it/s]
 77%|███████▋  | 287746/371472 [43:46<6:14:56,  3.72it/s]
 77%|███████▋  | 287747/371472 [43:46<6:18:21,  3.69it/s]
 77%|███████▋  | 287748/371472 [43:47<6:28:57,  3.59it/s]
 77%|███████▋  | 287749/371472 [43:47<6:15:52,  3.71it/s]
 77%|███████▋  | 287750/371472 [43:47<6:12:37,  3.74it/s]
 77%|███████▋  | 287751/371472 [43:47<6:29:58,  3.58it/s]
 77%|███████▋  | 287752/371472 [43:48<6:26:11,  3.61it/s]
 77%|███████▋  | 287753/371472 [43:48<6:26:53,  3.61it/s]
 77%|███████▋  | 287754/371472 [43:48<6:11:10,  3.76it/s]
 77%|███████▋  | 287755/371472 [43:48<6:23:07,  3.64it/s]
 77%|███████▋  | 287756/371472 [43:49<6:17:20,  3.70it/s]
 77%|███████▋  | 287757/371472 [43:49<6:26:59,  3.61it/s]
 77%|███████▋  | 287758/371472 [43:49<6:23:07,  3.64it/s]
 77%|███████▋  | 287759/371472 [43:49<6:13:56,  3.73it/s]
 77%|███████▋  | 287760/371472 [43:50<6:14:55,  3.72it/s]
                                                         
{'loss': 2.7689, 'learning_rate': 3.029261565644595e-07, 'epoch': 12.39}

 77%|███████▋  | 287760/371472 [43:50<6:14:55,  3.72it/s]
 77%|███████▋  | 287761/371472 [43:50<6:19:07,  3.68it/s]
 77%|███████▋  | 287762/371472 [43:50<6:21:39,  3.66it/s]
 77%|███████▋  | 287763/371472 [43:51<6:23:40,  3.64it/s]
 77%|███████▋  | 287764/371472 [43:51<6:34:36,  3.54it/s]
 77%|███████▋  | 287765/371472 [43:51<6:28:52,  3.59it/s]
 77%|███████▋  | 287766/371472 [43:52<6:50:00,  3.40it/s]
 77%|███████▋  | 287767/371472 [43:52<6:54:20,  3.37it/s]
 77%|███████▋  | 287768/371472 [43:52<6:52:22,  3.38it/s]
 77%|███████▋  | 287769/371472 [43:52<7:11:15,  3.23it/s]
 77%|███████▋  | 287770/371472 [43:53<6:45:29,  3.44it/s]
 77%|███████▋  | 287771/371472 [43:53<6:41:42,  3.47it/s]
 77%|███████▋  | 287772/371472 [43:53<6:54:42,  3.36it/s]
 77%|███████▋  | 287773/371472 [43:54<6:51:55,  3.39it/s]
 77%|███████▋  | 287774/371472 [43:54<7:03:48,  3.29it/s]
 77%|███████▋  | 287775/371472 [43:54<6:41:48,  3.47it/s]
 77%|███████▋  | 287776/371472 [43:54<6:41:15,  3.48it/s]
 77%|███████▋  | 287777/371472 [43:55<6:32:31,  3.55it/s]
 77%|███████▋  | 287778/371472 [43:55<6:37:47,  3.51it/s]
 77%|███████▋  | 287779/371472 [43:55<6:51:48,  3.39it/s]
 77%|███████▋  | 287780/371472 [43:56<6:52:32,  3.38it/s]
                                                         
{'loss': 2.7105, 'learning_rate': 3.028776745889806e-07, 'epoch': 12.4}

 77%|███████▋  | 287780/371472 [43:56<6:52:32,  3.38it/s]
 77%|███████▋  | 287781/371472 [43:56<7:08:19,  3.26it/s]
 77%|███████▋  | 287782/371472 [43:56<7:04:36,  3.28it/s]
 77%|███████▋  | 287783/371472 [43:56<6:40:23,  3.48it/s]
 77%|███████▋  | 287784/371472 [43:57<6:31:29,  3.56it/s]
 77%|███████▋  | 287785/371472 [43:57<6:33:10,  3.55it/s]
 77%|███████▋  | 287786/371472 [43:57<6:35:12,  3.53it/s]
 77%|███████▋  | 287787/371472 [43:58<6:31:31,  3.56it/s]
 77%|███████▋  | 287788/371472 [43:58<6:54:51,  3.36it/s]
 77%|███████▋  | 287789/371472 [43:58<6:54:10,  3.37it/s]
 77%|███████▋  | 287790/371472 [43:59<7:01:44,  3.31it/s]
 77%|███████▋  | 287791/371472 [43:59<7:15:37,  3.20it/s]
 77%|███████▋  | 287792/371472 [43:59<7:10:07,  3.24it/s]
 77%|███████▋  | 287793/371472 [44:00<7:31:50,  3.09it/s]
 77%|███████▋  | 287794/371472 [44:00<7:04:26,  3.29it/s]
 77%|███████▋  | 287795/371472 [44:00<6:42:07,  3.47it/s]
 77%|███████▋  | 287796/371472 [44:00<6:39:09,  3.49it/s]
 77%|███████▋  | 287797/371472 [44:01<6:50:11,  3.40it/s]
 77%|███████▋  | 287798/371472 [44:01<6:41:40,  3.47it/s]
 77%|███████▋  | 287799/371472 [44:01<6:46:06,  3.43it/s]
 77%|███████▋  | 287800/371472 [44:02<7:18:43,  3.18it/s]
                                                         
{'loss': 2.6311, 'learning_rate': 3.028291926135017e-07, 'epoch': 12.4}

 77%|███████▋  | 287800/371472 [44:02<7:18:43,  3.18it/s]
 77%|███████▋  | 287801/371472 [44:02<7:14:42,  3.21it/s]
 77%|███████▋  | 287802/371472 [44:02<7:01:01,  3.31it/s]
 77%|███████▋  | 287803/371472 [44:02<7:10:05,  3.24it/s]
 77%|███████▋  | 287804/371472 [44:03<7:08:27,  3.25it/s]
 77%|███████▋  | 287805/371472 [44:03<7:16:11,  3.20it/s]
 77%|███████▋  | 287806/371472 [44:03<7:27:02,  3.12it/s]
 77%|███████▋  | 287807/371472 [44:04<7:06:40,  3.27it/s]
 77%|███████▋  | 287808/371472 [44:04<6:50:30,  3.40it/s]
 77%|███████▋  | 287809/371472 [44:04<6:33:31,  3.54it/s]
 77%|███████▋  | 287810/371472 [44:05<6:26:32,  3.61it/s]
 77%|███████▋  | 287811/371472 [44:05<6:38:15,  3.50it/s]
 77%|███████▋  | 287812/371472 [44:05<6:41:14,  3.47it/s]
 77%|███████▋  | 287813/371472 [44:05<6:51:30,  3.39it/s]
 77%|███████▋  | 287814/371472 [44:06<6:48:17,  3.41it/s]
 77%|███████▋  | 287815/371472 [44:06<6:53:50,  3.37it/s]
 77%|███████▋  | 287816/371472 [44:06<6:56:54,  3.34it/s]
 77%|███████▋  | 287817/371472 [44:07<6:39:14,  3.49it/s]
 77%|███████▋  | 287818/371472 [44:07<6:44:50,  3.44it/s]
 77%|███████▋  | 287819/371472 [44:07<6:39:07,  3.49it/s]
 77%|███████▋  | 287820/371472 [44:07<6:23:11,  3.64it/s]
                                                         
{'loss': 2.7113, 'learning_rate': 3.027807106380228e-07, 'epoch': 12.4}

 77%|███████▋  | 287820/371472 [44:07<6:23:11,  3.64it/s]
 77%|███████▋  | 287821/371472 [44:08<6:21:38,  3.65it/s]
 77%|███████▋  | 287822/371472 [44:08<6:15:44,  3.71it/s]
 77%|███████▋  | 287823/371472 [44:08<6:21:10,  3.66it/s]
 77%|███████▋  | 287824/371472 [44:09<6:35:48,  3.52it/s]
 77%|███████▋  | 287825/371472 [44:09<6:45:10,  3.44it/s]
 77%|███████▋  | 287826/371472 [44:09<6:40:51,  3.48it/s]
 77%|███████▋  | 287827/371472 [44:09<6:38:13,  3.50it/s]
 77%|███████▋  | 287828/371472 [44:10<6:44:36,  3.45it/s]
 77%|███████▋  | 287829/371472 [44:10<6:50:20,  3.40it/s]
 77%|███████▋  | 287830/371472 [44:10<6:30:41,  3.57it/s]
 77%|███████▋  | 287831/371472 [44:11<6:52:59,  3.38it/s]
 77%|███████▋  | 287832/371472 [44:11<6:42:51,  3.46it/s]
 77%|███████▋  | 287833/371472 [44:11<6:31:24,  3.56it/s]
 77%|███████▋  | 287834/371472 [44:11<6:58:32,  3.33it/s]
 77%|███████▋  | 287835/371472 [44:12<7:08:52,  3.25it/s]
 77%|███████▋  | 287836/371472 [44:12<6:43:16,  3.46it/s]
 77%|███████▋  | 287837/371472 [44:12<6:39:01,  3.49it/s]
 77%|███████▋  | 287838/371472 [44:13<7:10:20,  3.24it/s]
 77%|███████▋  | 287839/371472 [44:13<6:49:35,  3.40it/s]
 77%|███████▋  | 287840/371472 [44:13<6:36:01,  3.52it/s]
                                                         
{'loss': 2.6197, 'learning_rate': 3.0273222866254387e-07, 'epoch': 12.4}

 77%|███████▋  | 287840/371472 [44:13<6:36:01,  3.52it/s]
 77%|███████▋  | 287841/371472 [44:13<6:23:28,  3.63it/s]
 77%|███████▋  | 287842/371472 [44:14<6:18:04,  3.69it/s]
 77%|███████▋  | 287843/371472 [44:14<6:07:09,  3.80it/s]
 77%|███████▋  | 287844/371472 [44:14<6:08:59,  3.78it/s]
 77%|███████▋  | 287845/371472 [44:14<5:58:51,  3.88it/s]
 77%|███████▋  | 287846/371472 [44:15<5:58:54,  3.88it/s]
 77%|███████▋  | 287847/371472 [44:15<6:37:14,  3.51it/s]
 77%|███████▋  | 287848/371472 [44:15<6:50:20,  3.40it/s]
 77%|███████▋  | 287849/371472 [44:16<6:36:35,  3.51it/s]
 77%|███████▋  | 287850/371472 [44:16<6:37:40,  3.50it/s]
 77%|███████▋  | 287851/371472 [44:16<6:38:33,  3.50it/s]
 77%|███████▋  | 287852/371472 [44:17<6:47:37,  3.42it/s]
 77%|███████▋  | 287853/371472 [44:17<6:32:44,  3.55it/s]
 77%|███████▋  | 287854/371472 [44:17<6:31:30,  3.56it/s]
 77%|███████▋  | 287855/371472 [44:17<7:09:38,  3.24it/s]
 77%|███████▋  | 287856/371472 [44:18<7:16:41,  3.19it/s]
 77%|███████▋  | 287857/371472 [44:18<7:16:17,  3.19it/s]
 77%|███████▋  | 287858/371472 [44:18<7:22:56,  3.15it/s]
 77%|███████▋  | 287859/371472 [44:19<6:59:14,  3.32it/s]
 77%|███████▋  | 287860/371472 [44:19<6:39:56,  3.48it/s]
                                                         
{'loss': 2.6443, 'learning_rate': 3.0268374668706505e-07, 'epoch': 12.4}

 77%|███████▋  | 287860/371472 [44:19<6:39:56,  3.48it/s]
 77%|███████▋  | 287861/371472 [44:19<6:27:58,  3.59it/s]
 77%|███████▋  | 287862/371472 [44:19<6:32:14,  3.55it/s]
 77%|███████▋  | 287863/371472 [44:20<6:33:07,  3.54it/s]
 77%|███████▋  | 287864/371472 [44:20<6:45:35,  3.44it/s]
 77%|███████▋  | 287865/371472 [44:20<7:26:22,  3.12it/s]
 77%|███████▋  | 287866/371472 [44:21<6:54:54,  3.36it/s]
 77%|███████▋  | 287867/371472 [44:21<6:51:11,  3.39it/s]
 77%|███████▋  | 287868/371472 [44:21<6:39:05,  3.49it/s]
 77%|███████▋  | 287869/371472 [44:22<6:58:22,  3.33it/s]
 77%|███████▋  | 287870/371472 [44:22<6:37:26,  3.51it/s]
 77%|███████▋  | 287871/371472 [44:22<6:40:45,  3.48it/s]
 77%|███████▋  | 287872/371472 [44:22<7:00:19,  3.31it/s]
 77%|███████▋  | 287873/371472 [44:23<6:49:23,  3.40it/s]
 77%|███████▋  | 287874/371472 [44:23<6:40:05,  3.48it/s]
 77%|███████▋  | 287875/371472 [44:23<6:27:32,  3.60it/s]
 77%|███████▋  | 287876/371472 [44:24<6:24:02,  3.63it/s]
 77%|███████▋  | 287877/371472 [44:24<6:17:37,  3.69it/s]
 77%|███████▋  | 287878/371472 [44:24<6:19:01,  3.68it/s]
 77%|███████▋  | 287879/371472 [44:24<6:18:28,  3.68it/s]
 77%|███████▋  | 287880/371472 [44:25<6:45:02,  3.44it/s]
                                                         
{'loss': 2.6092, 'learning_rate': 3.026352647115861e-07, 'epoch': 12.4}

 77%|███████▋  | 287880/371472 [44:25<6:45:02,  3.44it/s]
 77%|███████▋  | 287881/371472 [44:25<6:47:35,  3.42it/s]
 77%|███████▋  | 287882/371472 [44:25<6:32:39,  3.55it/s]
 77%|███████▋  | 287883/371472 [44:26<6:31:56,  3.55it/s]
 77%|███████▋  | 287884/371472 [44:26<6:29:36,  3.58it/s]
 77%|███████▋  | 287885/371472 [44:26<6:27:52,  3.59it/s]
 77%|███████▋  | 287886/371472 [44:26<6:45:02,  3.44it/s]
 77%|███████▋  | 287887/371472 [44:27<6:34:17,  3.53it/s]
 77%|███████▋  | 287888/371472 [44:27<6:34:21,  3.53it/s]
 77%|███████▋  | 287889/371472 [44:27<6:33:06,  3.54it/s]
 77%|███████▋  | 287890/371472 [44:28<6:58:30,  3.33it/s]
 78%|███████▊  | 287891/371472 [44:28<6:44:59,  3.44it/s]
 78%|███████▊  | 287892/371472 [44:28<6:54:51,  3.36it/s]
 78%|███████▊  | 287893/371472 [44:28<6:50:58,  3.39it/s]
 78%|███████▊  | 287894/371472 [44:29<6:37:31,  3.50it/s]
 78%|███████▊  | 287895/371472 [44:29<7:10:18,  3.24it/s]
 78%|███████▊  | 287896/371472 [44:29<7:36:14,  3.05it/s]
 78%|███████▊  | 287897/371472 [44:30<7:22:06,  3.15it/s]
 78%|███████▊  | 287898/371472 [44:30<7:28:01,  3.11it/s]
 78%|███████▊  | 287899/371472 [44:30<7:18:50,  3.17it/s]
 78%|███████▊  | 287900/371472 [44:31<7:05:42,  3.27it/s]
                                                         
{'loss': 2.7041, 'learning_rate': 3.025867827361072e-07, 'epoch': 12.4}

 78%|███████▊  | 287900/371472 [44:31<7:05:42,  3.27it/s]
 78%|███████▊  | 287901/371472 [44:31<7:04:05,  3.28it/s]
 78%|███████▊  | 287902/371472 [44:31<6:52:02,  3.38it/s]
 78%|███████▊  | 287903/371472 [44:31<6:41:21,  3.47it/s]
 78%|███████▊  | 287904/371472 [44:32<6:38:46,  3.49it/s]
 78%|███████▊  | 287905/371472 [44:32<6:38:23,  3.50it/s]
 78%|███████▊  | 287906/371472 [44:32<6:32:47,  3.55it/s]
 78%|███████▊  | 287907/371472 [44:33<6:30:00,  3.57it/s]
 78%|███████▊  | 287908/371472 [44:33<6:36:00,  3.52it/s]
 78%|███████▊  | 287909/371472 [44:33<6:21:56,  3.65it/s]
 78%|███████▊  | 287910/371472 [44:33<6:24:50,  3.62it/s]
 78%|███████▊  | 287911/371472 [44:34<6:20:19,  3.66it/s]
 78%|███████▊  | 287912/371472 [44:34<6:32:51,  3.54it/s]
 78%|███████▊  | 287913/371472 [44:34<6:58:18,  3.33it/s]
 78%|███████▊  | 287914/371472 [44:35<6:45:43,  3.43it/s]
 78%|███████▊  | 287915/371472 [44:35<6:43:59,  3.45it/s]
 78%|███████▊  | 287916/371472 [44:35<6:37:37,  3.50it/s]
 78%|███████▊  | 287917/371472 [44:35<6:18:33,  3.68it/s]
 78%|███████▊  | 287918/371472 [44:36<6:25:34,  3.61it/s]
 78%|███████▊  | 287919/371472 [44:36<6:21:29,  3.65it/s]
 78%|███████▊  | 287920/371472 [44:36<6:23:26,  3.63it/s]
                                                         
{'loss': 2.6403, 'learning_rate': 3.025383007606283e-07, 'epoch': 12.4}

 78%|███████▊  | 287920/371472 [44:36<6:23:26,  3.63it/s]
 78%|███████▊  | 287921/371472 [44:37<6:22:07,  3.64it/s]
 78%|███████▊  | 287922/371472 [44:37<6:08:34,  3.78it/s]
 78%|███████▊  | 287923/371472 [44:37<6:06:43,  3.80it/s]
 78%|███████▊  | 287924/371472 [44:37<6:07:38,  3.79it/s]
 78%|███████▊  | 287925/371472 [44:38<6:14:47,  3.72it/s]
 78%|███████▊  | 287926/371472 [44:38<6:14:54,  3.71it/s]
 78%|███████▊  | 287927/371472 [44:38<6:12:48,  3.73it/s]
 78%|███████▊  | 287928/371472 [44:38<5:59:01,  3.88it/s]
 78%|███████▊  | 287929/371472 [44:39<6:08:24,  3.78it/s]
 78%|███████▊  | 287930/371472 [44:39<6:18:50,  3.68it/s]
 78%|███████▊  | 287931/371472 [44:39<6:22:29,  3.64it/s]
 78%|███████▊  | 287932/371472 [44:39<6:12:25,  3.74it/s]
 78%|███████▊  | 287933/371472 [44:40<6:19:30,  3.67it/s]
 78%|███████▊  | 287934/371472 [44:40<6:43:26,  3.45it/s]
 78%|███████▊  | 287935/371472 [44:40<6:38:35,  3.49it/s]
 78%|███████▊  | 287936/371472 [44:41<6:38:24,  3.49it/s]
 78%|███████▊  | 287937/371472 [44:41<6:50:12,  3.39it/s]
 78%|███████▊  | 287938/371472 [44:41<7:09:12,  3.24it/s]
 78%|███████▊  | 287939/371472 [44:42<6:55:41,  3.35it/s]
 78%|███████▊  | 287940/371472 [44:42<6:50:46,  3.39it/s]
                                                         
{'loss': 2.6281, 'learning_rate': 3.024898187851494e-07, 'epoch': 12.4}

 78%|███████▊  | 287940/371472 [44:42<6:50:46,  3.39it/s]
 78%|███████▊  | 287941/371472 [44:42<6:53:12,  3.37it/s]
 78%|███████▊  | 287942/371472 [44:43<7:21:58,  3.15it/s]
 78%|███████▊  | 287943/371472 [44:43<6:55:36,  3.35it/s]
 78%|███████▊  | 287944/371472 [44:43<6:39:24,  3.49it/s]
 78%|███████▊  | 287945/371472 [44:43<6:32:06,  3.55it/s]
 78%|███████▊  | 287946/371472 [44:44<6:41:31,  3.47it/s]
 78%|███████▊  | 287947/371472 [44:44<6:29:10,  3.58it/s]
 78%|███████▊  | 287948/371472 [44:44<6:20:22,  3.66it/s]
 78%|███████▊  | 287949/371472 [44:44<6:32:14,  3.55it/s]
 78%|███████▊  | 287950/371472 [44:45<6:26:13,  3.60it/s]
 78%|███████▊  | 287951/371472 [44:45<6:21:24,  3.65it/s]
 78%|███████▊  | 287952/371472 [44:45<6:40:29,  3.48it/s]
 78%|███████▊  | 287953/371472 [44:46<7:19:48,  3.17it/s]
 78%|███████▊  | 287954/371472 [44:46<7:06:25,  3.26it/s]
 78%|███████▊  | 287955/371472 [44:46<6:56:06,  3.35it/s]
 78%|███████▊  | 287956/371472 [44:46<6:43:13,  3.45it/s]
 78%|███████▊  | 287957/371472 [44:47<6:35:23,  3.52it/s]
 78%|███████▊  | 287958/371472 [44:47<6:21:39,  3.65it/s]
 78%|███████▊  | 287959/371472 [44:47<6:53:40,  3.36it/s]
 78%|███████▊  | 287960/371472 [44:48<6:35:19,  3.52it/s]
                                                         
{'loss': 2.5521, 'learning_rate': 3.024413368096705e-07, 'epoch': 12.4}

 78%|███████▊  | 287960/371472 [44:48<6:35:19,  3.52it/s]
 78%|███████▊  | 287961/371472 [44:48<6:53:38,  3.36it/s]
 78%|███████▊  | 287962/371472 [44:48<6:54:48,  3.36it/s]
 78%|███████▊  | 287963/371472 [44:48<6:35:45,  3.52it/s]
 78%|███████▊  | 287964/371472 [44:49<6:26:38,  3.60it/s]
 78%|███████▊  | 287965/371472 [44:49<6:32:26,  3.55it/s]
 78%|███████▊  | 287966/371472 [44:49<6:20:25,  3.66it/s]
 78%|███████▊  | 287967/371472 [44:50<6:26:08,  3.60it/s]
 78%|███████▊  | 287968/371472 [44:50<6:47:41,  3.41it/s]
 78%|███████▊  | 287969/371472 [44:50<6:54:29,  3.36it/s]
 78%|███████▊  | 287970/371472 [44:50<6:34:11,  3.53it/s]
 78%|███████▊  | 287971/371472 [44:51<6:26:05,  3.60it/s]
 78%|███████▊  | 287972/371472 [44:51<6:15:53,  3.70it/s]
 78%|███████▊  | 287973/371472 [44:51<6:08:57,  3.77it/s]
 78%|███████▊  | 287974/371472 [44:52<6:35:34,  3.52it/s]
 78%|███████▊  | 287975/371472 [44:52<6:39:11,  3.49it/s]
 78%|███████▊  | 287976/371472 [44:52<6:33:07,  3.54it/s]
 78%|███████▊  | 287977/371472 [44:52<6:26:53,  3.60it/s]
 78%|███████▊  | 287978/371472 [44:53<6:23:18,  3.63it/s]
 78%|███████▊  | 287979/371472 [44:53<6:28:59,  3.58it/s]
 78%|███████▊  | 287980/371472 [44:53<6:28:06,  3.59it/s]
                                                         
{'loss': 2.7908, 'learning_rate': 3.023928548341916e-07, 'epoch': 12.4}

 78%|███████▊  | 287980/371472 [44:53<6:28:06,  3.59it/s]
 78%|███████▊  | 287981/371472 [44:54<6:34:13,  3.53it/s]
 78%|███████▊  | 287982/371472 [44:54<6:30:45,  3.56it/s]
 78%|███████▊  | 287983/371472 [44:54<6:26:12,  3.60it/s]
 78%|███████▊  | 287984/371472 [44:54<6:15:26,  3.71it/s]
 78%|███████▊  | 287985/371472 [44:55<6:30:57,  3.56it/s]
 78%|███████▊  | 287986/371472 [44:55<6:27:04,  3.59it/s]
 78%|███████▊  | 287987/371472 [44:55<6:23:14,  3.63it/s]
 78%|███████▊  | 287988/371472 [44:55<6:24:11,  3.62it/s]
 78%|███████▊  | 287989/371472 [44:56<6:18:06,  3.68it/s]
 78%|███████▊  | 287990/371472 [44:56<6:58:48,  3.32it/s]
 78%|███████▊  | 287991/371472 [44:56<6:53:49,  3.36it/s]
 78%|███████▊  | 287992/371472 [44:57<7:01:37,  3.30it/s]
 78%|███████▊  | 287993/371472 [44:57<6:47:07,  3.42it/s]
 78%|███████▊  | 287994/371472 [44:57<6:50:50,  3.39it/s]
 78%|███████▊  | 287995/371472 [44:58<6:40:21,  3.48it/s]
 78%|███████▊  | 287996/371472 [44:58<6:35:07,  3.52it/s]
 78%|███████▊  | 287997/371472 [44:58<6:40:10,  3.48it/s]
 78%|███████▊  | 287998/371472 [44:58<7:04:18,  3.28it/s]
 78%|███████▊  | 287999/371472 [44:59<6:55:46,  3.35it/s]
 78%|███████▊  | 288000/371472 [44:59<6:35:45,  3.52it/s]
                                                         
{'loss': 2.5934, 'learning_rate': 3.0234437285871276e-07, 'epoch': 12.4}

 78%|███████▊  | 288000/371472 [44:59<6:35:45,  3.52it/s]
 78%|███████▊  | 288001/371472 [44:59<6:24:44,  3.62it/s]
 78%|███████▊  | 288002/371472 [44:59<6:17:55,  3.68it/s]
 78%|███████▊  | 288003/371472 [45:00<6:08:51,  3.77it/s]
 78%|███████▊  | 288004/371472 [45:00<6:09:40,  3.76it/s]
 78%|███████▊  | 288005/371472 [45:00<6:25:09,  3.61it/s]
 78%|███████▊  | 288006/371472 [45:01<6:25:15,  3.61it/s]
 78%|███████▊  | 288007/371472 [45:01<6:23:28,  3.63it/s]
 78%|███████▊  | 288008/371472 [45:01<6:25:31,  3.61it/s]
 78%|███████▊  | 288009/371472 [45:01<6:46:10,  3.42it/s]
 78%|███████▊  | 288010/371472 [45:02<6:41:40,  3.46it/s]
 78%|███████▊  | 288011/371472 [45:02<6:41:50,  3.46it/s]
 78%|███████▊  | 288012/371472 [45:02<6:32:23,  3.54it/s]
 78%|███████▊  | 288013/371472 [45:03<6:47:24,  3.41it/s]
 78%|███████▊  | 288014/371472 [45:03<6:36:53,  3.50it/s]
 78%|███████▊  | 288015/371472 [45:03<6:58:53,  3.32it/s]
 78%|███████▊  | 288016/371472 [45:04<7:04:16,  3.28it/s]
 78%|███████▊  | 288017/371472 [45:04<6:50:37,  3.39it/s]
 78%|███████▊  | 288018/371472 [45:04<7:00:35,  3.31it/s]
 78%|███████▊  | 288019/371472 [45:04<7:18:26,  3.17it/s]
 78%|███████▊  | 288020/371472 [45:05<7:50:29,  2.96it/s]
                                                         
{'loss': 2.6662, 'learning_rate': 3.0229589088323383e-07, 'epoch': 12.41}

 78%|███████▊  | 288020/371472 [45:05<7:50:29,  2.96it/s]
 78%|███████▊  | 288021/371472 [45:05<7:24:37,  3.13it/s]
 78%|███████▊  | 288022/371472 [45:05<7:08:37,  3.24it/s]
 78%|███████▊  | 288023/371472 [45:06<6:47:48,  3.41it/s]
 78%|███████▊  | 288024/371472 [45:06<7:07:55,  3.25it/s]
 78%|███████▊  | 288025/371472 [45:06<6:59:04,  3.32it/s]
 78%|███████▊  | 288026/371472 [45:07<6:42:00,  3.46it/s]
 78%|███████▊  | 288027/371472 [45:07<6:30:07,  3.56it/s]
 78%|███████▊  | 288028/371472 [45:07<6:22:38,  3.63it/s]
 78%|███████▊  | 288029/371472 [45:07<6:27:10,  3.59it/s]
 78%|███████▊  | 288030/371472 [45:08<6:17:40,  3.68it/s]
 78%|███████▊  | 288031/371472 [45:08<6:32:10,  3.55it/s]
 78%|███████▊  | 288032/371472 [45:08<6:17:22,  3.69it/s]
 78%|███████▊  | 288033/371472 [45:08<6:17:51,  3.68it/s]
 78%|███████▊  | 288034/371472 [45:09<6:29:57,  3.57it/s]
 78%|███████▊  | 288035/371472 [45:09<6:30:59,  3.56it/s]
 78%|███████▊  | 288036/371472 [45:09<6:41:44,  3.46it/s]
 78%|███████▊  | 288037/371472 [45:10<6:32:24,  3.54it/s]
 78%|███████▊  | 288038/371472 [45:10<6:32:02,  3.55it/s]
 78%|███████▊  | 288039/371472 [45:10<6:47:18,  3.41it/s]
 78%|███████▊  | 288040/371472 [45:11<6:44:57,  3.43it/s]
                                                         
{'loss': 2.5668, 'learning_rate': 3.0224740890775496e-07, 'epoch': 12.41}

 78%|███████▊  | 288040/371472 [45:11<6:44:57,  3.43it/s]
 78%|███████▊  | 288041/371472 [45:11<6:38:13,  3.49it/s]
 78%|███████▊  | 288042/371472 [45:11<6:27:46,  3.59it/s]
 78%|███████▊  | 288043/371472 [45:11<6:25:02,  3.61it/s]
 78%|███████▊  | 288044/371472 [45:12<6:24:07,  3.62it/s]
 78%|███████▊  | 288045/371472 [45:12<6:19:10,  3.67it/s]
 78%|███████▊  | 288046/371472 [45:12<6:24:07,  3.62it/s]
 78%|███████▊  | 288047/371472 [45:12<6:31:44,  3.55it/s]
 78%|███████▊  | 288048/371472 [45:13<6:26:19,  3.60it/s]
 78%|███████▊  | 288049/371472 [45:13<6:26:50,  3.59it/s]
 78%|███████▊  | 288050/371472 [45:13<6:43:17,  3.45it/s]
 78%|███████▊  | 288051/371472 [45:14<6:56:22,  3.34it/s]
 78%|███████▊  | 288052/371472 [45:14<6:48:30,  3.40it/s]
 78%|███████▊  | 288053/371472 [45:14<6:41:42,  3.46it/s]
 78%|███████▊  | 288054/371472 [45:14<6:50:51,  3.38it/s]
 78%|███████▊  | 288055/371472 [45:15<6:40:10,  3.47it/s]
 78%|███████▊  | 288056/371472 [45:15<6:34:51,  3.52it/s]
 78%|███████▊  | 288057/371472 [45:15<6:31:20,  3.55it/s]
 78%|███████▊  | 288058/371472 [45:16<7:39:00,  3.03it/s]
 78%|███████▊  | 288059/371472 [45:16<7:22:56,  3.14it/s]
 78%|███████▊  | 288060/371472 [45:16<7:15:04,  3.20it/s]
                                                         
{'loss': 2.4194, 'learning_rate': 3.021989269322761e-07, 'epoch': 12.41}

 78%|███████▊  | 288060/371472 [45:16<7:15:04,  3.20it/s]
 78%|███████▊  | 288061/371472 [45:17<7:03:54,  3.28it/s]
 78%|███████▊  | 288062/371472 [45:17<7:19:16,  3.16it/s]
 78%|███████▊  | 288063/371472 [45:17<7:10:47,  3.23it/s]
 78%|███████▊  | 288064/371472 [45:18<7:10:50,  3.23it/s]
 78%|███████▊  | 288065/371472 [45:18<7:10:03,  3.23it/s]
 78%|███████▊  | 288066/371472 [45:18<7:31:21,  3.08it/s]
 78%|███████▊  | 288067/371472 [45:19<7:20:09,  3.16it/s]
 78%|███████▊  | 288068/371472 [45:19<7:02:19,  3.29it/s]
 78%|███████▊  | 288069/371472 [45:19<6:48:15,  3.40it/s]
 78%|███████▊  | 288070/371472 [45:19<6:50:29,  3.39it/s]
 78%|███████▊  | 288071/371472 [45:20<6:54:38,  3.35it/s]
 78%|███████▊  | 288072/371472 [45:20<6:36:16,  3.51it/s]
 78%|███████▊  | 288073/371472 [45:20<6:19:42,  3.66it/s]
 78%|███████▊  | 288074/371472 [45:20<6:27:01,  3.59it/s]
 78%|███████▊  | 288075/371472 [45:21<6:24:01,  3.62it/s]
 78%|███████▊  | 288076/371472 [45:21<6:19:14,  3.66it/s]
 78%|███████▊  | 288077/371472 [45:21<6:18:46,  3.67it/s]
 78%|███████▊  | 288078/371472 [45:22<6:08:30,  3.77it/s]
 78%|███████▊  | 288079/371472 [45:22<6:14:41,  3.71it/s]
 78%|███████▊  | 288080/371472 [45:22<6:10:02,  3.76it/s]
                                                         
{'loss': 2.5457, 'learning_rate': 3.0215044495679715e-07, 'epoch': 12.41}

 78%|███████▊  | 288080/371472 [45:22<6:10:02,  3.76it/s]
 78%|███████▊  | 288081/371472 [45:22<6:05:50,  3.80it/s]
 78%|███████▊  | 288082/371472 [45:23<6:21:51,  3.64it/s]
 78%|███████▊  | 288083/371472 [45:23<6:39:42,  3.48it/s]
 78%|███████▊  | 288084/371472 [45:23<6:38:20,  3.49it/s]
 78%|███████▊  | 288085/371472 [45:24<6:54:54,  3.35it/s]
 78%|███████▊  | 288086/371472 [45:24<6:35:14,  3.52it/s]
 78%|███████▊  | 288087/371472 [45:24<6:20:22,  3.65it/s]
 78%|███████▊  | 288088/371472 [45:24<6:22:24,  3.63it/s]
 78%|███████▊  | 288089/371472 [45:25<6:14:14,  3.71it/s]
 78%|███████▊  | 288090/371472 [45:25<6:09:09,  3.76it/s]
 78%|███████▊  | 288091/371472 [45:25<6:13:35,  3.72it/s]
 78%|███████▊  | 288092/371472 [45:25<6:16:48,  3.69it/s]
 78%|███████▊  | 288093/371472 [45:26<6:38:18,  3.49it/s]
 78%|███████▊  | 288094/371472 [45:26<6:26:45,  3.59it/s]
 78%|███████▊  | 288095/371472 [45:26<6:38:19,  3.49it/s]
 78%|███████▊  | 288096/371472 [45:27<6:48:57,  3.40it/s]
 78%|███████▊  | 288097/371472 [45:27<6:37:01,  3.50it/s]
 78%|███████▊  | 288098/371472 [45:27<6:54:18,  3.35it/s]
 78%|███████▊  | 288099/371472 [45:27<6:44:22,  3.44it/s]
 78%|███████▊  | 288100/371472 [45:28<6:38:59,  3.48it/s]
                                                         
{'loss': 2.6923, 'learning_rate': 3.021019629813182e-07, 'epoch': 12.41}

 78%|███████▊  | 288100/371472 [45:28<6:38:59,  3.48it/s]
 78%|███████▊  | 288101/371472 [45:28<6:50:11,  3.39it/s]
 78%|███████▊  | 288102/371472 [45:28<6:28:57,  3.57it/s]
 78%|███████▊  | 288103/371472 [45:29<6:57:06,  3.33it/s]
 78%|███████▊  | 288104/371472 [45:29<6:53:02,  3.36it/s]
 78%|███████▊  | 288105/371472 [45:29<6:53:12,  3.36it/s]
 78%|███████▊  | 288106/371472 [45:30<6:45:30,  3.43it/s]
 78%|███████▊  | 288107/371472 [45:30<6:40:35,  3.47it/s]
 78%|███████▊  | 288108/371472 [45:30<7:34:07,  3.06it/s]
 78%|███████▊  | 288109/371472 [45:31<8:29:05,  2.73it/s]
 78%|███████▊  | 288110/371472 [45:31<7:51:27,  2.95it/s]
 78%|███████▊  | 288111/371472 [45:31<7:21:55,  3.14it/s]
 78%|███████▊  | 288112/371472 [45:32<7:18:54,  3.17it/s]
 78%|███████▊  | 288113/371472 [45:32<7:39:40,  3.02it/s]
 78%|███████▊  | 288114/371472 [45:32<7:13:27,  3.21it/s]
 78%|███████▊  | 288115/371472 [45:32<6:58:43,  3.32it/s]
 78%|███████▊  | 288116/371472 [45:33<6:57:01,  3.33it/s]
 78%|███████▊  | 288117/371472 [45:33<6:51:32,  3.38it/s]
 78%|███████▊  | 288118/371472 [45:33<6:41:07,  3.46it/s]
 78%|███████▊  | 288119/371472 [45:34<6:31:00,  3.55it/s]
 78%|███████▊  | 288120/371472 [45:34<6:30:42,  3.56it/s]
                                                         
{'loss': 2.697, 'learning_rate': 3.020534810058394e-07, 'epoch': 12.41}

 78%|███████▊  | 288120/371472 [45:34<6:30:42,  3.56it/s]
 78%|███████▊  | 288121/371472 [45:34<6:24:50,  3.61it/s]
 78%|███████▊  | 288122/371472 [45:34<6:15:22,  3.70it/s]
 78%|███████▊  | 288123/371472 [45:35<6:10:07,  3.75it/s]
 78%|███████▊  | 288124/371472 [45:35<6:01:30,  3.84it/s]
 78%|███████▊  | 288125/371472 [45:35<5:59:26,  3.86it/s]
 78%|███████▊  | 288126/371472 [45:35<5:56:16,  3.90it/s]
 78%|███████▊  | 288127/371472 [45:36<6:20:02,  3.66it/s]
 78%|███████▊  | 288128/371472 [45:36<6:11:30,  3.74it/s]
 78%|███████▊  | 288129/371472 [45:36<6:35:51,  3.51it/s]
 78%|███████▊  | 288130/371472 [45:37<6:24:28,  3.61it/s]
 78%|███████▊  | 288131/371472 [45:37<6:16:46,  3.69it/s]
 78%|███████▊  | 288132/371472 [45:37<6:16:57,  3.68it/s]
 78%|███████▊  | 288133/371472 [45:37<6:19:15,  3.66it/s]
 78%|███████▊  | 288134/371472 [45:38<6:21:52,  3.64it/s]
 78%|███████▊  | 288135/371472 [45:38<6:24:10,  3.62it/s]
 78%|███████▊  | 288136/371472 [45:38<6:15:28,  3.70it/s]
 78%|███████▊  | 288137/371472 [45:38<6:23:49,  3.62it/s]
 78%|███████▊  | 288138/371472 [45:39<6:49:30,  3.39it/s]
 78%|███████▊  | 288139/371472 [45:39<7:10:30,  3.23it/s]
 78%|███████▊  | 288140/371472 [45:39<7:10:39,  3.22it/s]
                                                         
{'loss': 2.837, 'learning_rate': 3.0200499903036047e-07, 'epoch': 12.41}

 78%|███████▊  | 288140/371472 [45:39<7:10:39,  3.22it/s]
 78%|███████▊  | 288141/371472 [45:40<6:54:24,  3.35it/s]
 78%|███████▊  | 288142/371472 [45:40<6:49:10,  3.39it/s]
 78%|███████▊  | 288143/371472 [45:40<6:35:43,  3.51it/s]
 78%|███████▊  | 288144/371472 [45:41<6:39:50,  3.47it/s]
 78%|███████▊  | 288145/371472 [45:41<6:23:18,  3.62it/s]
 78%|███████▊  | 288146/371472 [45:41<6:17:37,  3.68it/s]
 78%|███████▊  | 288147/371472 [45:41<6:45:36,  3.42it/s]
 78%|███████▊  | 288148/371472 [45:42<6:52:09,  3.37it/s]
 78%|███████▊  | 288149/371472 [45:42<6:45:04,  3.43it/s]
 78%|███████▊  | 288150/371472 [45:42<7:01:38,  3.29it/s]
 78%|███████▊  | 288151/371472 [45:43<6:44:27,  3.43it/s]
 78%|███████▊  | 288152/371472 [45:43<6:44:26,  3.43it/s]
 78%|███████▊  | 288153/371472 [45:43<6:39:05,  3.48it/s]
 78%|███████▊  | 288154/371472 [45:43<6:38:27,  3.49it/s]
 78%|███████▊  | 288155/371472 [45:44<6:43:40,  3.44it/s]
 78%|███████▊  | 288156/371472 [45:44<6:55:14,  3.34it/s]
 78%|███████▊  | 288157/371472 [45:44<6:46:18,  3.42it/s]
 78%|███████▊  | 288158/371472 [45:45<7:12:29,  3.21it/s]
 78%|███████▊  | 288159/371472 [45:45<7:01:13,  3.30it/s]
 78%|███████▊  | 288160/371472 [45:45<6:50:16,  3.38it/s]
                                                         
{'loss': 2.6677, 'learning_rate': 3.019565170548816e-07, 'epoch': 12.41}

 78%|███████▊  | 288160/371472 [45:45<6:50:16,  3.38it/s]
 78%|███████▊  | 288161/371472 [45:46<7:20:06,  3.15it/s]
 78%|███████▊  | 288162/371472 [45:46<7:20:34,  3.15it/s]
 78%|███████▊  | 288163/371472 [45:46<7:07:59,  3.24it/s]
 78%|███████▊  | 288164/371472 [45:46<6:44:41,  3.43it/s]
 78%|███████▊  | 288165/371472 [45:47<6:52:01,  3.37it/s]
 78%|███████▊  | 288166/371472 [45:47<6:33:09,  3.53it/s]
 78%|███████▊  | 288167/371472 [45:47<6:26:22,  3.59it/s]
 78%|███████▊  | 288168/371472 [45:48<6:30:31,  3.56it/s]
 78%|███████▊  | 288169/371472 [45:48<6:23:25,  3.62it/s]
 78%|███████▊  | 288170/371472 [45:48<6:22:44,  3.63it/s]
 78%|███████▊  | 288171/371472 [45:48<6:34:12,  3.52it/s]
 78%|███████▊  | 288172/371472 [45:49<6:25:17,  3.60it/s]
 78%|███████▊  | 288173/371472 [45:49<6:27:39,  3.58it/s]
 78%|███████▊  | 288174/371472 [45:49<6:43:32,  3.44it/s]
 78%|███████▊  | 288175/371472 [45:50<6:34:32,  3.52it/s]
 78%|███████▊  | 288176/371472 [45:50<6:57:55,  3.32it/s]
 78%|███████▊  | 288177/371472 [45:50<7:20:54,  3.15it/s]
 78%|███████▊  | 288178/371472 [45:51<7:00:02,  3.31it/s]
 78%|███████▊  | 288179/371472 [45:51<7:50:31,  2.95it/s]
 78%|███████▊  | 288180/371472 [45:51<7:25:06,  3.12it/s]
                                                         
{'loss': 2.5443, 'learning_rate': 3.0190803507940267e-07, 'epoch': 12.41}

 78%|███████▊  | 288180/371472 [45:51<7:25:06,  3.12it/s]
 78%|███████▊  | 288181/371472 [45:52<7:08:53,  3.24it/s]
 78%|███████▊  | 288182/371472 [45:52<6:48:03,  3.40it/s]
 78%|███████▊  | 288183/371472 [45:52<6:34:03,  3.52it/s]
 78%|███████▊  | 288184/371472 [45:52<6:39:59,  3.47it/s]
 78%|███████▊  | 288185/371472 [45:53<7:15:58,  3.18it/s]
 78%|███████▊  | 288186/371472 [45:53<6:53:08,  3.36it/s]
 78%|███████▊  | 288187/371472 [45:53<7:33:08,  3.06it/s]
 78%|███████▊  | 288188/371472 [45:54<7:11:10,  3.22it/s]
 78%|███████▊  | 288189/371472 [45:54<6:51:56,  3.37it/s]
 78%|███████▊  | 288190/371472 [45:54<6:28:27,  3.57it/s]
 78%|███████▊  | 288191/371472 [45:54<6:24:30,  3.61it/s]
 78%|███████▊  | 288192/371472 [45:55<6:37:50,  3.49it/s]
 78%|███████▊  | 288193/371472 [45:55<6:21:52,  3.63it/s]
 78%|███████▊  | 288194/371472 [45:55<6:09:44,  3.75it/s]
 78%|███████▊  | 288195/371472 [45:55<6:07:04,  3.78it/s]
 78%|███████▊  | 288196/371472 [45:56<6:20:33,  3.65it/s]
 78%|███████▊  | 288197/371472 [45:56<6:37:23,  3.49it/s]
 78%|███████▊  | 288198/371472 [45:56<6:30:42,  3.55it/s]
 78%|███████▊  | 288199/371472 [45:57<6:25:28,  3.60it/s]
 78%|███████▊  | 288200/371472 [45:57<6:25:09,  3.60it/s]
                                                         
{'loss': 2.5745, 'learning_rate': 3.018595531039238e-07, 'epoch': 12.41}

 78%|███████▊  | 288200/371472 [45:57<6:25:09,  3.60it/s]
 78%|███████▊  | 288201/371472 [45:57<6:36:50,  3.50it/s]
 78%|███████▊  | 288202/371472 [45:57<6:21:38,  3.64it/s]
 78%|███████▊  | 288203/371472 [45:58<6:09:44,  3.75it/s]
 78%|███████▊  | 288204/371472 [45:58<6:08:49,  3.76it/s]
 78%|███████▊  | 288205/371472 [45:58<6:20:51,  3.64it/s]
 78%|███████▊  | 288206/371472 [45:59<6:16:18,  3.69it/s]
 78%|███████▊  | 288207/371472 [45:59<6:24:00,  3.61it/s]
 78%|███████▊  | 288208/371472 [45:59<6:33:30,  3.53it/s]
 78%|███████▊  | 288209/371472 [45:59<6:35:29,  3.51it/s]
 78%|███████▊  | 288210/371472 [46:00<6:30:00,  3.56it/s]
 78%|███████▊  | 288211/371472 [46:00<6:42:48,  3.45it/s]
 78%|███████▊  | 288212/371472 [46:00<6:34:35,  3.52it/s]
 78%|███████▊  | 288213/371472 [46:01<6:43:26,  3.44it/s]
 78%|███████▊  | 288214/371472 [46:01<6:24:00,  3.61it/s]
 78%|███████▊  | 288215/371472 [46:01<6:13:27,  3.72it/s]
 78%|███████▊  | 288216/371472 [46:01<6:10:02,  3.75it/s]
 78%|███████▊  | 288217/371472 [46:02<6:09:05,  3.76it/s]
 78%|███████▊  | 288218/371472 [46:02<6:09:59,  3.75it/s]
 78%|███████▊  | 288219/371472 [46:02<6:36:03,  3.50it/s]
 78%|███████▊  | 288220/371472 [46:02<6:44:17,  3.43it/s]
                                                         
{'loss': 2.714, 'learning_rate': 3.0181107112844486e-07, 'epoch': 12.41}

 78%|███████▊  | 288220/371472 [46:02<6:44:17,  3.43it/s]
 78%|███████▊  | 288221/371472 [46:03<6:42:44,  3.45it/s]
 78%|███████▊  | 288222/371472 [46:03<6:31:06,  3.55it/s]
 78%|███████▊  | 288223/371472 [46:03<6:51:32,  3.37it/s]
 78%|███████▊  | 288224/371472 [46:04<6:48:20,  3.40it/s]
 78%|███████▊  | 288225/371472 [46:04<6:48:52,  3.39it/s]
 78%|███████▊  | 288226/371472 [46:04<6:44:29,  3.43it/s]
 78%|███████▊  | 288227/371472 [46:05<6:50:55,  3.38it/s]
 78%|███████▊  | 288228/371472 [46:05<6:44:13,  3.43it/s]
 78%|███████▊  | 288229/371472 [46:05<6:57:39,  3.32it/s]
 78%|███████▊  | 288230/371472 [46:05<6:52:07,  3.37it/s]
 78%|███████▊  | 288231/371472 [46:06<6:55:41,  3.34it/s]
 78%|███████▊  | 288232/371472 [46:06<6:57:04,  3.33it/s]
 78%|███████▊  | 288233/371472 [46:06<6:55:02,  3.34it/s]
 78%|███████▊  | 288234/371472 [46:07<6:48:19,  3.40it/s]
 78%|███████▊  | 288235/371472 [46:07<6:35:28,  3.51it/s]
 78%|███████▊  | 288236/371472 [46:07<6:17:00,  3.68it/s]
 78%|███████▊  | 288237/371472 [46:07<6:06:21,  3.79it/s]
 78%|███████▊  | 288238/371472 [46:08<6:16:27,  3.68it/s]
 78%|███████▊  | 288239/371472 [46:08<6:30:52,  3.55it/s]
 78%|███████▊  | 288240/371472 [46:08<6:59:22,  3.31it/s]
                                                         
{'loss': 2.6238, 'learning_rate': 3.0176258915296604e-07, 'epoch': 12.42}

 78%|███████▊  | 288240/371472 [46:08<6:59:22,  3.31it/s]
 78%|███████▊  | 288241/371472 [46:09<7:05:43,  3.26it/s]
 78%|███████▊  | 288242/371472 [46:09<6:59:33,  3.31it/s]
 78%|███████▊  | 288243/371472 [46:09<6:48:09,  3.40it/s]
 78%|███████▊  | 288244/371472 [46:09<6:42:42,  3.44it/s]
 78%|███████▊  | 288245/371472 [46:10<6:27:52,  3.58it/s]
 78%|███████▊  | 288246/371472 [46:10<6:13:56,  3.71it/s]
 78%|███████▊  | 288247/371472 [46:10<6:02:33,  3.83it/s]
 78%|███████▊  | 288248/371472 [46:10<5:59:17,  3.86it/s]
 78%|███████▊  | 288249/371472 [46:11<6:08:58,  3.76it/s]
 78%|███████▊  | 288250/371472 [46:11<6:16:04,  3.69it/s]
 78%|███████▊  | 288251/371472 [46:11<6:09:27,  3.75it/s]
 78%|███████▊  | 288252/371472 [46:12<6:08:00,  3.77it/s]
 78%|███████▊  | 288253/371472 [46:12<6:28:28,  3.57it/s]
 78%|███████▊  | 288254/371472 [46:12<6:26:15,  3.59it/s]
 78%|███████▊  | 288255/371472 [46:12<6:24:28,  3.61it/s]
 78%|███████▊  | 288256/371472 [46:13<6:27:34,  3.58it/s]
 78%|███████▊  | 288257/371472 [46:13<6:27:44,  3.58it/s]
 78%|███████▊  | 288258/371472 [46:13<6:40:20,  3.46it/s]
 78%|███████▊  | 288259/371472 [46:14<6:38:19,  3.48it/s]
 78%|███████▊  | 288260/371472 [46:14<6:21:18,  3.64it/s]
                                                         
{'loss': 2.7704, 'learning_rate': 3.017141071774871e-07, 'epoch': 12.42}

 78%|███████▊  | 288260/371472 [46:14<6:21:18,  3.64it/s]
 78%|███████▊  | 288261/371472 [46:14<6:18:19,  3.67it/s]
 78%|███████▊  | 288262/371472 [46:14<6:16:22,  3.68it/s]
 78%|███████▊  | 288263/371472 [46:15<6:18:50,  3.66it/s]
 78%|███████▊  | 288264/371472 [46:15<6:28:30,  3.57it/s]
 78%|███████▊  | 288265/371472 [46:15<6:21:33,  3.63it/s]
 78%|███████▊  | 288266/371472 [46:15<6:12:15,  3.73it/s]
 78%|███████▊  | 288267/371472 [46:16<6:50:42,  3.38it/s]
 78%|███████▊  | 288268/371472 [46:16<7:03:34,  3.27it/s]
 78%|███████▊  | 288269/371472 [46:16<7:20:34,  3.15it/s]
 78%|███████▊  | 288270/371472 [46:17<6:58:45,  3.31it/s]
 78%|███████▊  | 288271/371472 [46:17<6:50:58,  3.37it/s]
 78%|███████▊  | 288272/371472 [46:17<6:49:56,  3.38it/s]
 78%|███████▊  | 288273/371472 [46:18<6:37:05,  3.49it/s]
 78%|███████▊  | 288274/371472 [46:18<6:26:04,  3.59it/s]
 78%|███████▊  | 288275/371472 [46:18<6:34:08,  3.52it/s]
 78%|███████▊  | 288276/371472 [46:18<6:32:46,  3.53it/s]
 78%|███████▊  | 288277/371472 [46:19<6:27:56,  3.57it/s]
 78%|███████▊  | 288278/371472 [46:19<6:52:33,  3.36it/s]
 78%|███████▊  | 288279/371472 [46:19<6:44:23,  3.43it/s]
 78%|███████▊  | 288280/371472 [46:20<7:02:50,  3.28it/s]
                                                         
{'loss': 2.5917, 'learning_rate': 3.016656252020083e-07, 'epoch': 12.42}

 78%|███████▊  | 288280/371472 [46:20<7:02:50,  3.28it/s]
 78%|███████▊  | 288281/371472 [46:20<6:47:22,  3.40it/s]
 78%|███████▊  | 288282/371472 [46:20<6:41:59,  3.45it/s]
 78%|███████▊  | 288283/371472 [46:21<6:51:31,  3.37it/s]
 78%|███████▊  | 288284/371472 [46:21<6:36:25,  3.50it/s]
 78%|███████▊  | 288285/371472 [46:21<6:39:42,  3.47it/s]
 78%|███████▊  | 288286/371472 [46:21<6:49:28,  3.39it/s]
 78%|███████▊  | 288287/371472 [46:22<6:28:40,  3.57it/s]
 78%|███████▊  | 288288/371472 [46:22<6:12:34,  3.72it/s]
 78%|███████▊  | 288289/371472 [46:22<6:35:21,  3.51it/s]
 78%|███████▊  | 288290/371472 [46:22<6:22:38,  3.62it/s]
 78%|███████▊  | 288291/371472 [46:23<6:50:36,  3.38it/s]
 78%|███████▊  | 288292/371472 [46:23<6:57:58,  3.32it/s]
 78%|███████▊  | 288293/371472 [46:23<6:44:44,  3.43it/s]
 78%|███████▊  | 288294/371472 [46:24<6:41:38,  3.45it/s]
 78%|███████▊  | 288295/371472 [46:24<6:28:51,  3.56it/s]
 78%|███████▊  | 288296/371472 [46:24<6:14:31,  3.70it/s]
 78%|███████▊  | 288297/371472 [46:25<7:18:14,  3.16it/s]
 78%|███████▊  | 288298/371472 [46:25<7:06:30,  3.25it/s]
 78%|███████▊  | 288299/371472 [46:25<7:12:30,  3.21it/s]
 78%|███████▊  | 288300/371472 [46:25<6:53:21,  3.35it/s]
                                                         
{'loss': 2.7871, 'learning_rate': 3.016171432265293e-07, 'epoch': 12.42}

 78%|███████▊  | 288300/371472 [46:25<6:53:21,  3.35it/s]
 78%|███████▊  | 288301/371472 [46:26<6:56:53,  3.33it/s]
 78%|███████▊  | 288302/371472 [46:26<6:45:35,  3.42it/s]
 78%|███████▊  | 288303/371472 [46:26<6:37:31,  3.49it/s]
 78%|███████▊  | 288304/371472 [46:27<6:25:20,  3.60it/s]
 78%|███████▊  | 288305/371472 [46:27<6:41:11,  3.46it/s]
 78%|███████▊  | 288306/371472 [46:27<6:44:57,  3.42it/s]
 78%|███████▊  | 288307/371472 [46:27<6:38:35,  3.48it/s]
 78%|███████▊  | 288308/371472 [46:28<6:57:54,  3.32it/s]
 78%|███████▊  | 288309/371472 [46:28<7:15:17,  3.18it/s]
 78%|███████▊  | 288310/371472 [46:28<6:54:02,  3.35it/s]
 78%|███████▊  | 288311/371472 [46:29<6:43:39,  3.43it/s]
 78%|███████▊  | 288312/371472 [46:29<6:40:23,  3.46it/s]
 78%|███████▊  | 288313/371472 [46:29<6:26:45,  3.58it/s]
 78%|███████▊  | 288314/371472 [46:30<6:24:43,  3.60it/s]
 78%|███████▊  | 288315/371472 [46:30<6:36:23,  3.50it/s]
 78%|███████▊  | 288316/371472 [46:30<6:40:03,  3.46it/s]
 78%|███████▊  | 288317/371472 [46:30<6:52:39,  3.36it/s]
 78%|███████▊  | 288318/371472 [46:31<6:58:41,  3.31it/s]
 78%|███████▊  | 288319/371472 [46:31<7:31:10,  3.07it/s]
 78%|███████▊  | 288320/371472 [46:31<7:03:52,  3.27it/s]
                                                         
{'loss': 2.6234, 'learning_rate': 3.0156866125105043e-07, 'epoch': 12.42}

 78%|███████▊  | 288320/371472 [46:31<7:03:52,  3.27it/s]
 78%|███████▊  | 288321/371472 [46:32<6:46:29,  3.41it/s]
 78%|███████▊  | 288322/371472 [46:32<6:34:31,  3.51it/s]
 78%|███████▊  | 288323/371472 [46:32<6:19:13,  3.65it/s]
 78%|███████▊  | 288324/371472 [46:32<6:42:33,  3.44it/s]
 78%|███████▊  | 288325/371472 [46:33<6:31:59,  3.54it/s]
 78%|███████▊  | 288326/371472 [46:33<6:24:03,  3.61it/s]
 78%|███████▊  | 288327/371472 [46:33<6:16:25,  3.68it/s]
 78%|███████▊  | 288328/371472 [46:34<6:08:47,  3.76it/s]
 78%|███████▊  | 288329/371472 [46:34<6:14:49,  3.70it/s]
 78%|███████▊  | 288330/371472 [46:34<6:20:27,  3.64it/s]
 78%|███████▊  | 288331/371472 [46:34<6:30:25,  3.55it/s]
 78%|███████▊  | 288332/371472 [46:35<6:37:36,  3.49it/s]
 78%|███████▊  | 288333/371472 [46:35<6:46:07,  3.41it/s]
 78%|███████▊  | 288334/371472 [46:35<6:50:04,  3.38it/s]
 78%|███████▊  | 288335/371472 [46:36<6:47:35,  3.40it/s]
 78%|███████▊  | 288336/371472 [46:36<6:58:55,  3.31it/s]
 78%|███████▊  | 288337/371472 [46:36<7:06:18,  3.25it/s]
 78%|███████▊  | 288338/371472 [46:37<6:53:07,  3.35it/s]
 78%|███████▊  | 288339/371472 [46:37<6:45:37,  3.42it/s]
 78%|███████▊  | 288340/371472 [46:37<6:35:03,  3.51it/s]
                                                         
{'loss': 2.6935, 'learning_rate': 3.015201792755715e-07, 'epoch': 12.42}

 78%|███████▊  | 288340/371472 [46:37<6:35:03,  3.51it/s]
 78%|███████▊  | 288341/371472 [46:37<6:18:15,  3.66it/s]
 78%|███████▊  | 288342/371472 [46:38<6:49:24,  3.38it/s]
 78%|███████▊  | 288343/371472 [46:38<7:02:44,  3.28it/s]
 78%|███████▊  | 288344/371472 [46:38<6:39:04,  3.47it/s]
 78%|███████▊  | 288345/371472 [46:38<6:25:16,  3.60it/s]
 78%|███████▊  | 288346/371472 [46:39<6:16:23,  3.68it/s]
 78%|███████▊  | 288347/371472 [46:39<6:31:14,  3.54it/s]
 78%|███████▊  | 288348/371472 [46:39<6:49:03,  3.39it/s]
 78%|███████▊  | 288349/371472 [46:40<6:43:51,  3.43it/s]
 78%|███████▊  | 288350/371472 [46:40<6:52:26,  3.36it/s]
 78%|███████▊  | 288351/371472 [46:40<6:37:03,  3.49it/s]
 78%|███████▊  | 288352/371472 [46:40<6:31:57,  3.53it/s]
 78%|███████▊  | 288353/371472 [46:41<6:17:25,  3.67it/s]
 78%|███████▊  | 288354/371472 [46:41<6:19:07,  3.65it/s]
 78%|███████▊  | 288355/371472 [46:41<6:08:13,  3.76it/s]
 78%|███████▊  | 288356/371472 [46:42<6:07:51,  3.77it/s]
 78%|███████▊  | 288357/371472 [46:42<6:34:42,  3.51it/s]
 78%|███████▊  | 288358/371472 [46:42<7:06:09,  3.25it/s]
 78%|███████▊  | 288359/371472 [46:42<6:39:34,  3.47it/s]
 78%|███████▊  | 288360/371472 [46:43<6:33:20,  3.52it/s]
                                                         
{'loss': 2.7246, 'learning_rate': 3.014716973000927e-07, 'epoch': 12.42}

 78%|███████▊  | 288360/371472 [46:43<6:33:20,  3.52it/s]
 78%|███████▊  | 288361/371472 [46:43<6:28:14,  3.57it/s]
 78%|███████▊  | 288362/371472 [46:43<6:16:45,  3.68it/s]
 78%|███████▊  | 288363/371472 [46:44<6:12:56,  3.71it/s]
 78%|███████▊  | 288364/371472 [46:44<6:02:05,  3.83it/s]
 78%|███████▊  | 288365/371472 [46:44<6:31:00,  3.54it/s]
 78%|███████▊  | 288366/371472 [46:44<6:16:29,  3.68it/s]
 78%|███████▊  | 288367/371472 [46:45<6:25:14,  3.60it/s]
 78%|███████▊  | 288368/371472 [46:45<6:23:41,  3.61it/s]
 78%|███████▊  | 288369/371472 [46:45<6:09:42,  3.75it/s]
 78%|███████▊  | 288370/371472 [46:45<6:10:39,  3.74it/s]
 78%|███████▊  | 288371/371472 [46:46<6:08:09,  3.76it/s]
 78%|███████▊  | 288372/371472 [46:46<6:23:38,  3.61it/s]
 78%|███████▊  | 288373/371472 [46:46<6:23:25,  3.61it/s]
 78%|███████▊  | 288374/371472 [46:47<6:08:35,  3.76it/s]
 78%|███████▊  | 288375/371472 [46:47<6:12:51,  3.71it/s]
 78%|███████▊  | 288376/371472 [46:47<6:07:04,  3.77it/s]
 78%|███████▊  | 288377/371472 [46:47<6:06:16,  3.78it/s]
 78%|███████▊  | 288378/371472 [46:48<6:09:59,  3.74it/s]
 78%|███████▊  | 288379/371472 [46:48<6:25:23,  3.59it/s]
 78%|███████▊  | 288380/371472 [46:48<6:21:59,  3.63it/s]
                                                         
{'loss': 2.6798, 'learning_rate': 3.0142321532461375e-07, 'epoch': 12.42}

 78%|███████▊  | 288380/371472 [46:48<6:21:59,  3.63it/s]
 78%|███████▊  | 288381/371472 [46:48<6:49:18,  3.38it/s]
 78%|███████▊  | 288382/371472 [46:49<7:42:45,  2.99it/s]
 78%|███████▊  | 288383/371472 [46:49<7:36:32,  3.03it/s]
 78%|███████▊  | 288384/371472 [46:50<7:09:53,  3.22it/s]
 78%|███████▊  | 288385/371472 [46:50<6:55:02,  3.34it/s]
 78%|███████▊  | 288386/371472 [46:50<6:58:44,  3.31it/s]
 78%|███████▊  | 288387/371472 [46:50<6:44:45,  3.42it/s]
 78%|███████▊  | 288388/371472 [46:51<6:38:54,  3.47it/s]
 78%|███████▊  | 288389/371472 [46:51<6:22:09,  3.62it/s]
 78%|███████▊  | 288390/371472 [46:51<6:22:42,  3.62it/s]
 78%|███████▊  | 288391/371472 [46:51<6:23:48,  3.61it/s]
 78%|███████▊  | 288392/371472 [46:52<6:19:44,  3.65it/s]
 78%|███████▊  | 288393/371472 [46:52<6:21:41,  3.63it/s]
 78%|███████▊  | 288394/371472 [46:52<6:25:03,  3.60it/s]
 78%|███████▊  | 288395/371472 [46:53<6:47:52,  3.39it/s]
 78%|███████▊  | 288396/371472 [46:53<6:34:51,  3.51it/s]
 78%|███████▊  | 288397/371472 [46:53<6:22:24,  3.62it/s]
 78%|███████▊  | 288398/371472 [46:53<6:23:31,  3.61it/s]
 78%|███████▊  | 288399/371472 [46:54<6:34:33,  3.51it/s]
 78%|███████▊  | 288400/371472 [46:54<6:58:42,  3.31it/s]
                                                         
{'loss': 2.5673, 'learning_rate': 3.0137473334913493e-07, 'epoch': 12.42}

 78%|███████▊  | 288400/371472 [46:54<6:58:42,  3.31it/s]
 78%|███████▊  | 288401/371472 [46:54<6:47:42,  3.40it/s]
 78%|███████▊  | 288402/371472 [46:55<6:47:47,  3.40it/s]
 78%|███████▊  | 288403/371472 [46:55<6:40:44,  3.45it/s]
 78%|███████▊  | 288404/371472 [46:55<6:23:58,  3.61it/s]
 78%|███████▊  | 288405/371472 [46:55<6:27:54,  3.57it/s]
 78%|███████▊  | 288406/371472 [46:56<6:29:14,  3.56it/s]
 78%|███████▊  | 288407/371472 [46:56<6:45:50,  3.41it/s]
 78%|███████▊  | 288408/371472 [46:56<6:44:55,  3.42it/s]
 78%|███████▊  | 288409/371472 [46:57<6:46:19,  3.41it/s]
 78%|███████▊  | 288410/371472 [46:57<6:31:52,  3.53it/s]
 78%|███████▊  | 288411/371472 [46:57<6:35:55,  3.50it/s]
 78%|███████▊  | 288412/371472 [46:57<6:29:29,  3.55it/s]
 78%|███████▊  | 288413/371472 [46:58<6:29:53,  3.55it/s]
 78%|███████▊  | 288414/371472 [46:58<6:41:26,  3.45it/s]
 78%|███████▊  | 288415/371472 [46:58<6:35:13,  3.50it/s]
 78%|███████▊  | 288416/371472 [46:59<6:29:49,  3.55it/s]
 78%|███████▊  | 288417/371472 [46:59<6:52:59,  3.35it/s]
 78%|███████▊  | 288418/371472 [46:59<6:45:47,  3.41it/s]
 78%|███████▊  | 288419/371472 [46:59<6:41:46,  3.45it/s]
 78%|███████▊  | 288420/371472 [47:00<6:27:25,  3.57it/s]
                                                         
{'loss': 2.6549, 'learning_rate': 3.0132625137365595e-07, 'epoch': 12.42}

 78%|███████▊  | 288420/371472 [47:00<6:27:25,  3.57it/s]
 78%|███████▊  | 288421/371472 [47:00<6:36:00,  3.50it/s]
 78%|███████▊  | 288422/371472 [47:00<6:30:12,  3.55it/s]
 78%|███████▊  | 288423/371472 [47:01<6:18:22,  3.66it/s]
 78%|███████▊  | 288424/371472 [47:01<6:20:15,  3.64it/s]
 78%|███████▊  | 288425/371472 [47:01<6:34:12,  3.51it/s]
 78%|███████▊  | 288426/371472 [47:01<6:26:52,  3.58it/s]
 78%|███████▊  | 288427/371472 [47:02<6:15:30,  3.69it/s]
 78%|███████▊  | 288428/371472 [47:02<6:38:58,  3.47it/s]
 78%|███████▊  | 288429/371472 [47:02<6:58:48,  3.30it/s]
 78%|███████▊  | 288430/371472 [47:03<6:54:49,  3.34it/s]
 78%|███████▊  | 288431/371472 [47:03<6:37:26,  3.48it/s]
 78%|███████▊  | 288432/371472 [47:03<6:36:53,  3.49it/s]
 78%|███████▊  | 288433/371472 [47:03<6:37:04,  3.49it/s]
 78%|███████▊  | 288434/371472 [47:04<6:41:25,  3.45it/s]
 78%|███████▊  | 288435/371472 [47:04<6:26:23,  3.58it/s]
 78%|███████▊  | 288436/371472 [47:04<6:50:20,  3.37it/s]
 78%|███████▊  | 288437/371472 [47:05<6:54:09,  3.34it/s]
 78%|███████▊  | 288438/371472 [47:05<6:39:00,  3.47it/s]
 78%|███████▊  | 288439/371472 [47:05<6:27:09,  3.57it/s]
 78%|███████▊  | 288440/371472 [47:05<6:33:03,  3.52it/s]
                                                         
{'loss': 2.6266, 'learning_rate': 3.01277769398177e-07, 'epoch': 12.42}

 78%|███████▊  | 288440/371472 [47:05<6:33:03,  3.52it/s]
 78%|███████▊  | 288441/371472 [47:06<6:19:20,  3.65it/s]
 78%|███████▊  | 288442/371472 [47:06<6:39:03,  3.47it/s]
 78%|███████▊  | 288443/371472 [47:06<6:36:33,  3.49it/s]
 78%|███████▊  | 288444/371472 [47:07<6:45:12,  3.41it/s]
 78%|███████▊  | 288445/371472 [47:07<6:48:19,  3.39it/s]
 78%|███████▊  | 288446/371472 [47:07<6:40:22,  3.46it/s]
 78%|███████▊  | 288447/371472 [47:07<6:26:02,  3.58it/s]
 78%|███████▊  | 288448/371472 [47:08<6:15:58,  3.68it/s]
 78%|███████▊  | 288449/371472 [47:08<6:08:53,  3.75it/s]
 78%|███████▊  | 288450/371472 [47:08<6:10:25,  3.74it/s]
 78%|███████▊  | 288451/371472 [47:09<6:07:56,  3.76it/s]
 78%|███████▊  | 288452/371472 [47:09<6:37:25,  3.48it/s]
 78%|███████▊  | 288453/371472 [47:09<7:15:14,  3.18it/s]
 78%|███████▊  | 288454/371472 [47:10<7:06:32,  3.24it/s]
 78%|███████▊  | 288455/371472 [47:10<6:37:32,  3.48it/s]
 78%|███████▊  | 288456/371472 [47:10<6:32:59,  3.52it/s]
 78%|███████▊  | 288457/371472 [47:10<6:24:45,  3.60it/s]
 78%|███████▊  | 288458/371472 [47:11<6:27:45,  3.57it/s]
 78%|███████▊  | 288459/371472 [47:11<6:10:45,  3.73it/s]
 78%|███████▊  | 288460/371472 [47:11<6:12:03,  3.72it/s]
                                                         
{'loss': 2.6031, 'learning_rate': 3.0122928742269815e-07, 'epoch': 12.42}

 78%|███████▊  | 288460/371472 [47:11<6:12:03,  3.72it/s]
 78%|███████▊  | 288461/371472 [47:11<6:28:43,  3.56it/s]
 78%|███████▊  | 288462/371472 [47:12<6:43:48,  3.43it/s]
 78%|███████▊  | 288463/371472 [47:12<6:24:24,  3.60it/s]
 78%|███████▊  | 288464/371472 [47:12<6:15:59,  3.68it/s]
 78%|███████▊  | 288465/371472 [47:13<6:26:59,  3.57it/s]
 78%|███████▊  | 288466/371472 [47:13<6:42:58,  3.43it/s]
 78%|███████▊  | 288467/371472 [47:13<6:34:29,  3.51it/s]
 78%|███████▊  | 288468/371472 [47:13<6:14:27,  3.69it/s]
 78%|███████▊  | 288469/371472 [47:14<6:09:17,  3.75it/s]
 78%|███████▊  | 288470/371472 [47:14<6:17:56,  3.66it/s]
 78%|███████▊  | 288471/371472 [47:14<6:22:00,  3.62it/s]
 78%|███████▊  | 288472/371472 [47:14<6:35:03,  3.50it/s]
 78%|███████▊  | 288473/371472 [47:15<6:34:06,  3.51it/s]
 78%|███████▊  | 288474/371472 [47:15<6:32:33,  3.52it/s]
 78%|███████▊  | 288475/371472 [47:15<6:38:37,  3.47it/s]
 78%|███████▊  | 288476/371472 [47:16<6:46:56,  3.40it/s]
 78%|███████▊  | 288477/371472 [47:16<6:44:55,  3.42it/s]
 78%|███████▊  | 288478/371472 [47:16<6:44:47,  3.42it/s]
 78%|███████▊  | 288479/371472 [47:17<6:47:02,  3.40it/s]
 78%|███████▊  | 288480/371472 [47:17<6:31:06,  3.54it/s]
                                                         
{'loss': 2.6059, 'learning_rate': 3.011808054472192e-07, 'epoch': 12.43}

 78%|███████▊  | 288480/371472 [47:17<6:31:06,  3.54it/s]
 78%|███████▊  | 288481/371472 [47:17<6:19:21,  3.65it/s]
 78%|███████▊  | 288482/371472 [47:17<6:20:24,  3.64it/s]
 78%|███████▊  | 288483/371472 [47:18<6:15:39,  3.68it/s]
 78%|███████▊  | 288484/371472 [47:18<6:38:13,  3.47it/s]
 78%|███████▊  | 288485/371472 [47:18<6:45:26,  3.41it/s]
 78%|███████▊  | 288486/371472 [47:18<6:40:59,  3.45it/s]
 78%|███████▊  | 288487/371472 [47:19<6:37:19,  3.48it/s]
 78%|███████▊  | 288488/371472 [47:19<6:32:04,  3.53it/s]
 78%|███████▊  | 288489/371472 [47:19<6:30:04,  3.55it/s]
 78%|███████▊  | 288490/371472 [47:20<7:03:31,  3.27it/s]
 78%|███████▊  | 288491/371472 [47:20<7:26:20,  3.10it/s]
 78%|███████▊  | 288492/371472 [47:20<7:28:29,  3.08it/s]
 78%|███████▊  | 288493/371472 [47:21<6:58:17,  3.31it/s]
 78%|███████▊  | 288494/371472 [47:21<6:53:57,  3.34it/s]
 78%|███████▊  | 288495/371472 [47:21<6:42:23,  3.44it/s]
 78%|███████▊  | 288496/371472 [47:22<7:08:32,  3.23it/s]
 78%|███████▊  | 288497/371472 [47:22<6:54:09,  3.34it/s]
 78%|███████▊  | 288498/371472 [47:22<6:50:07,  3.37it/s]
 78%|███████▊  | 288499/371472 [47:22<6:40:18,  3.45it/s]
 78%|███████▊  | 288500/371472 [47:23<6:23:08,  3.61it/s]
                                                         
{'loss': 2.6938, 'learning_rate': 3.011323234717404e-07, 'epoch': 12.43}

 78%|███████▊  | 288500/371472 [47:23<6:23:08,  3.61it/s]
 78%|███████▊  | 288501/371472 [47:23<6:13:30,  3.70it/s]
 78%|███████▊  | 288502/371472 [47:23<6:16:21,  3.67it/s]
 78%|███████▊  | 288503/371472 [47:23<6:18:21,  3.65it/s]
 78%|███████▊  | 288504/371472 [47:24<6:30:02,  3.55it/s]
 78%|███████▊  | 288505/371472 [47:24<6:21:20,  3.63it/s]
 78%|███████▊  | 288506/371472 [47:24<6:14:33,  3.69it/s]
 78%|███████▊  | 288507/371472 [47:25<6:07:09,  3.77it/s]
 78%|███████▊  | 288508/371472 [47:25<6:17:20,  3.66it/s]
 78%|███████▊  | 288509/371472 [47:25<6:45:54,  3.41it/s]
 78%|███████▊  | 288510/371472 [47:25<6:38:26,  3.47it/s]
 78%|███████▊  | 288511/371472 [47:26<6:30:31,  3.54it/s]
 78%|███████▊  | 288512/371472 [47:26<6:29:24,  3.55it/s]
 78%|███████▊  | 288513/371472 [47:26<7:17:09,  3.16it/s]
 78%|███████▊  | 288514/371472 [47:27<7:02:41,  3.27it/s]
 78%|███████▊  | 288515/371472 [47:27<6:34:16,  3.51it/s]
 78%|███████▊  | 288516/371472 [47:27<6:43:47,  3.42it/s]
 78%|███████▊  | 288517/371472 [47:27<6:27:36,  3.57it/s]
 78%|███████▊  | 288518/371472 [47:28<6:14:46,  3.69it/s]
 78%|███████▊  | 288519/371472 [47:28<6:08:00,  3.76it/s]
 78%|███████▊  | 288520/371472 [47:28<6:08:47,  3.75it/s]
                                                         
{'loss': 2.8276, 'learning_rate': 3.0108384149626147e-07, 'epoch': 12.43}

 78%|███████▊  | 288520/371472 [47:28<6:08:47,  3.75it/s]
 78%|███████▊  | 288521/371472 [47:29<6:29:07,  3.55it/s]
 78%|███████▊  | 288522/371472 [47:29<6:24:20,  3.60it/s]
 78%|███████▊  | 288523/371472 [47:29<6:26:39,  3.58it/s]
 78%|███████▊  | 288524/371472 [47:29<7:06:15,  3.24it/s]
 78%|███████▊  | 288525/371472 [47:30<7:07:55,  3.23it/s]
 78%|███████▊  | 288526/371472 [47:30<7:33:46,  3.05it/s]
 78%|███████▊  | 288527/371472 [47:30<7:20:53,  3.14it/s]
 78%|███████▊  | 288528/371472 [47:31<7:02:03,  3.28it/s]
 78%|███████▊  | 288529/371472 [47:31<7:14:16,  3.18it/s]
 78%|███████▊  | 288530/371472 [47:31<6:55:10,  3.33it/s]
 78%|███████▊  | 288531/371472 [47:32<6:59:13,  3.30it/s]
 78%|███████▊  | 288532/371472 [47:32<6:48:01,  3.39it/s]
 78%|███████▊  | 288533/371472 [47:32<6:36:48,  3.48it/s]
 78%|███████▊  | 288534/371472 [47:32<6:22:18,  3.62it/s]
 78%|███████▊  | 288535/371472 [47:33<7:07:44,  3.23it/s]
 78%|███████▊  | 288536/371472 [47:33<7:32:36,  3.05it/s]
 78%|███████▊  | 288537/371472 [47:33<7:15:35,  3.17it/s]
 78%|███████▊  | 288538/371472 [47:34<7:31:13,  3.06it/s]
 78%|███████▊  | 288539/371472 [47:34<7:51:08,  2.93it/s]
 78%|███████▊  | 288540/371472 [47:34<7:25:28,  3.10it/s]
                                                         
{'loss': 2.717, 'learning_rate': 3.0103535952078264e-07, 'epoch': 12.43}

 78%|███████▊  | 288540/371472 [47:34<7:25:28,  3.10it/s]
 78%|███████▊  | 288541/371472 [47:35<7:00:14,  3.29it/s]
 78%|███████▊  | 288542/371472 [47:35<6:54:27,  3.33it/s]
 78%|███████▊  | 288543/371472 [47:35<7:14:41,  3.18it/s]
 78%|███████▊  | 288544/371472 [47:36<6:41:57,  3.44it/s]
 78%|███████▊  | 288545/371472 [47:36<6:51:03,  3.36it/s]
 78%|███████▊  | 288546/371472 [47:36<6:53:38,  3.34it/s]
 78%|███████▊  | 288547/371472 [47:37<7:05:11,  3.25it/s]
 78%|███████▊  | 288548/371472 [47:37<6:56:55,  3.31it/s]
 78%|███████▊  | 288549/371472 [47:37<6:41:58,  3.44it/s]
 78%|███████▊  | 288550/371472 [47:37<6:27:28,  3.57it/s]
 78%|███████▊  | 288551/371472 [47:38<6:36:36,  3.48it/s]
 78%|███████▊  | 288552/371472 [47:38<6:26:09,  3.58it/s]
 78%|███████▊  | 288553/371472 [47:38<6:19:53,  3.64it/s]
 78%|███████▊  | 288554/371472 [47:38<6:16:06,  3.67it/s]
 78%|███████▊  | 288555/371472 [47:39<6:06:44,  3.77it/s]
 78%|███████▊  | 288556/371472 [47:39<6:08:53,  3.75it/s]
 78%|███████▊  | 288557/371472 [47:39<6:09:52,  3.74it/s]
 78%|███████▊  | 288558/371472 [47:40<6:40:54,  3.45it/s]
 78%|███████▊  | 288559/371472 [47:40<6:53:25,  3.34it/s]
 78%|███████▊  | 288560/371472 [47:40<6:38:15,  3.47it/s]
                                                         
{'loss': 2.6925, 'learning_rate': 3.0098687754530366e-07, 'epoch': 12.43}

 78%|███████▊  | 288560/371472 [47:40<6:38:15,  3.47it/s]
 78%|███████▊  | 288561/371472 [47:41<7:25:27,  3.10it/s]
 78%|███████▊  | 288562/371472 [47:41<7:10:27,  3.21it/s]
 78%|███████▊  | 288563/371472 [47:41<6:52:49,  3.35it/s]
 78%|███████▊  | 288564/371472 [47:41<6:44:28,  3.42it/s]
 78%|███████▊  | 288565/371472 [47:42<6:39:46,  3.46it/s]
 78%|███████▊  | 288566/371472 [47:42<6:40:08,  3.45it/s]
 78%|███████▊  | 288567/371472 [47:42<6:33:27,  3.51it/s]
 78%|███████▊  | 288568/371472 [47:43<6:47:32,  3.39it/s]
 78%|███████▊  | 288569/371472 [47:43<6:29:59,  3.54it/s]
 78%|███████▊  | 288570/371472 [47:43<6:34:15,  3.50it/s]
 78%|███████▊  | 288571/371472 [47:43<6:30:17,  3.54it/s]
 78%|███████▊  | 288572/371472 [47:44<6:27:02,  3.57it/s]
 78%|███████▊  | 288573/371472 [47:44<6:20:20,  3.63it/s]
 78%|███████▊  | 288574/371472 [47:44<6:19:36,  3.64it/s]
 78%|███████▊  | 288575/371472 [47:45<6:42:35,  3.43it/s]
 78%|███████▊  | 288576/371472 [47:45<6:31:00,  3.53it/s]
 78%|███████▊  | 288577/371472 [47:45<6:30:11,  3.54it/s]
 78%|███████▊  | 288578/371472 [47:45<6:35:44,  3.49it/s]
 78%|███████▊  | 288579/371472 [47:46<6:51:50,  3.35it/s]
 78%|███████▊  | 288580/371472 [47:46<6:57:43,  3.31it/s]
                                                         
{'loss': 2.5705, 'learning_rate': 3.009383955698248e-07, 'epoch': 12.43}

 78%|███████▊  | 288580/371472 [47:46<6:57:43,  3.31it/s]
 78%|███████▊  | 288581/371472 [47:46<7:04:39,  3.25it/s]
 78%|███████▊  | 288582/371472 [47:47<7:07:19,  3.23it/s]
 78%|███████▊  | 288583/371472 [47:47<7:22:06,  3.12it/s]
 78%|███████▊  | 288584/371472 [47:47<6:58:46,  3.30it/s]
 78%|███████▊  | 288585/371472 [47:48<6:55:38,  3.32it/s]
 78%|███████▊  | 288586/371472 [47:48<6:41:26,  3.44it/s]
 78%|███████▊  | 288587/371472 [47:48<6:27:18,  3.57it/s]
 78%|███████▊  | 288588/371472 [47:48<6:27:33,  3.56it/s]
 78%|███████▊  | 288589/371472 [47:49<6:24:08,  3.60it/s]
 78%|███████▊  | 288590/371472 [47:49<6:30:03,  3.54it/s]
 78%|███████▊  | 288591/371472 [47:49<7:03:06,  3.26it/s]
 78%|███████▊  | 288592/371472 [47:50<6:50:35,  3.36it/s]
 78%|███████▊  | 288593/371472 [47:50<6:39:54,  3.45it/s]
 78%|███████▊  | 288594/371472 [47:50<6:41:39,  3.44it/s]
 78%|███████▊  | 288595/371472 [47:50<6:43:53,  3.42it/s]
 78%|███████▊  | 288596/371472 [47:51<6:52:29,  3.35it/s]
 78%|███████▊  | 288597/371472 [47:51<6:42:19,  3.43it/s]
 78%|███████▊  | 288598/371472 [47:51<6:23:24,  3.60it/s]
 78%|███████▊  | 288599/371472 [47:52<6:13:35,  3.70it/s]
 78%|███████▊  | 288600/371472 [47:52<6:06:18,  3.77it/s]
                                                         
{'loss': 2.6878, 'learning_rate': 3.0088991359434586e-07, 'epoch': 12.43}

 78%|███████▊  | 288600/371472 [47:52<6:06:18,  3.77it/s]
 78%|███████▊  | 288601/371472 [47:52<6:13:24,  3.70it/s]
 78%|███████▊  | 288602/371472 [47:52<6:19:36,  3.64it/s]
 78%|███████▊  | 288603/371472 [47:53<6:45:35,  3.41it/s]
 78%|███████▊  | 288604/371472 [47:53<6:39:54,  3.45it/s]
 78%|███████▊  | 288605/371472 [47:53<6:23:51,  3.60it/s]
 78%|███████▊  | 288606/371472 [47:53<6:15:42,  3.68it/s]
 78%|███████▊  | 288607/371472 [47:54<6:29:56,  3.54it/s]
 78%|███████▊  | 288608/371472 [47:54<6:39:48,  3.45it/s]
 78%|███████▊  | 288609/371472 [47:54<6:39:06,  3.46it/s]
 78%|███████▊  | 288610/371472 [47:55<6:22:43,  3.61it/s]
 78%|███████▊  | 288611/371472 [47:55<6:15:34,  3.68it/s]
 78%|███████▊  | 288612/371472 [47:55<6:37:34,  3.47it/s]
 78%|███████▊  | 288613/371472 [47:55<6:41:44,  3.44it/s]
 78%|███████▊  | 288614/371472 [47:56<6:33:42,  3.51it/s]
 78%|███████▊  | 288615/371472 [47:56<6:18:21,  3.65it/s]
 78%|███████▊  | 288616/371472 [47:56<6:21:40,  3.62it/s]
 78%|███████▊  | 288617/371472 [47:57<6:39:04,  3.46it/s]
 78%|███████▊  | 288618/371472 [47:57<6:33:19,  3.51it/s]
 78%|███████▊  | 288619/371472 [47:57<6:18:08,  3.65it/s]
 78%|███████▊  | 288620/371472 [47:57<6:18:04,  3.65it/s]
                                                         
{'loss': 2.5579, 'learning_rate': 3.0084143161886704e-07, 'epoch': 12.43}

 78%|███████▊  | 288620/371472 [47:57<6:18:04,  3.65it/s]
 78%|███████▊  | 288621/371472 [47:58<6:17:50,  3.65it/s]
 78%|███████▊  | 288622/371472 [47:58<6:33:15,  3.51it/s]
 78%|███████▊  | 288623/371472 [47:58<6:28:20,  3.56it/s]
 78%|███████▊  | 288624/371472 [47:59<7:05:45,  3.24it/s]
 78%|███████▊  | 288625/371472 [47:59<6:42:21,  3.43it/s]
 78%|███████▊  | 288626/371472 [47:59<6:29:39,  3.54it/s]
 78%|███████▊  | 288627/371472 [47:59<6:52:49,  3.34it/s]
 78%|███████▊  | 288628/371472 [48:00<6:35:39,  3.49it/s]
 78%|███████▊  | 288629/371472 [48:00<6:23:24,  3.60it/s]
 78%|███████▊  | 288630/371472 [48:00<6:15:25,  3.68it/s]
 78%|███████▊  | 288631/371472 [48:01<6:39:58,  3.45it/s]
 78%|███████▊  | 288632/371472 [48:01<7:16:42,  3.16it/s]
 78%|███████▊  | 288633/371472 [48:01<7:11:05,  3.20it/s]
 78%|███████▊  | 288634/371472 [48:02<6:50:51,  3.36it/s]
 78%|███████▊  | 288635/371472 [48:02<6:59:00,  3.29it/s]
 78%|███████▊  | 288636/371472 [48:02<7:03:47,  3.26it/s]
 78%|███████▊  | 288637/371472 [48:03<7:22:43,  3.12it/s]
 78%|███████▊  | 288638/371472 [48:03<7:00:05,  3.29it/s]
 78%|███████▊  | 288639/371472 [48:03<6:44:17,  3.41it/s]
 78%|███████▊  | 288640/371472 [48:03<6:21:36,  3.62it/s]
                                                         
{'loss': 2.6674, 'learning_rate': 3.007929496433881e-07, 'epoch': 12.43}

 78%|███████▊  | 288640/371472 [48:03<6:21:36,  3.62it/s]
 78%|███████▊  | 288641/371472 [48:04<6:33:55,  3.50it/s]
 78%|███████▊  | 288642/371472 [48:04<6:33:08,  3.51it/s]
 78%|███████▊  | 288643/371472 [48:04<6:24:34,  3.59it/s]
 78%|███████▊  | 288644/371472 [48:04<6:21:51,  3.62it/s]
 78%|███████▊  | 288645/371472 [48:05<6:23:28,  3.60it/s]
 78%|███████▊  | 288646/371472 [48:05<6:11:03,  3.72it/s]
 78%|███████▊  | 288647/371472 [48:05<6:15:52,  3.67it/s]
 78%|███████▊  | 288648/371472 [48:06<6:18:59,  3.64it/s]
 78%|███████▊  | 288649/371472 [48:06<6:15:45,  3.67it/s]
 78%|███████▊  | 288650/371472 [48:06<6:42:53,  3.43it/s]
 78%|███████▊  | 288651/371472 [48:06<6:55:20,  3.32it/s]
 78%|███████▊  | 288652/371472 [48:07<6:41:52,  3.43it/s]
 78%|███████▊  | 288653/371472 [48:07<6:25:57,  3.58it/s]
 78%|███████▊  | 288654/371472 [48:07<6:15:02,  3.68it/s]
 78%|███████▊  | 288655/371472 [48:07<6:23:07,  3.60it/s]
 78%|███████▊  | 288656/371472 [48:08<6:52:28,  3.35it/s]
 78%|███████▊  | 288657/371472 [48:08<6:53:57,  3.33it/s]
 78%|███████▊  | 288658/371472 [48:08<6:46:51,  3.39it/s]
 78%|███████▊  | 288659/371472 [48:09<6:58:26,  3.30it/s]
 78%|███████▊  | 288660/371472 [48:09<6:54:33,  3.33it/s]
                                                         
{'loss': 2.5969, 'learning_rate': 3.007444676679093e-07, 'epoch': 12.43}

 78%|███████▊  | 288660/371472 [48:09<6:54:33,  3.33it/s]
 78%|███████▊  | 288661/371472 [48:09<6:46:24,  3.40it/s]
 78%|███████▊  | 288662/371472 [48:10<6:50:05,  3.37it/s]
 78%|███████▊  | 288663/371472 [48:10<6:39:33,  3.45it/s]
 78%|███████▊  | 288664/371472 [48:10<6:29:06,  3.55it/s]
 78%|███████▊  | 288665/371472 [48:10<6:16:54,  3.66it/s]
 78%|███████▊  | 288666/371472 [48:11<6:12:51,  3.70it/s]
 78%|███████▊  | 288667/371472 [48:11<5:57:50,  3.86it/s]
 78%|███████▊  | 288668/371472 [48:11<6:10:55,  3.72it/s]
 78%|███████▊  | 288669/371472 [48:11<6:15:09,  3.68it/s]
 78%|███████▊  | 288670/371472 [48:12<6:18:52,  3.64it/s]
 78%|███████▊  | 288671/371472 [48:12<6:42:40,  3.43it/s]
 78%|███████▊  | 288672/371472 [48:12<7:09:05,  3.22it/s]
 78%|███████▊  | 288673/371472 [48:13<6:50:35,  3.36it/s]
 78%|███████▊  | 288674/371472 [48:13<6:29:26,  3.54it/s]
 78%|███████▊  | 288675/371472 [48:13<6:30:54,  3.53it/s]
 78%|███████▊  | 288676/371472 [48:14<6:22:17,  3.61it/s]
 78%|███████▊  | 288677/371472 [48:14<6:19:57,  3.63it/s]
 78%|███████▊  | 288678/371472 [48:14<6:22:28,  3.61it/s]
 78%|███████▊  | 288679/371472 [48:14<7:02:04,  3.27it/s]
 78%|███████▊  | 288680/371472 [48:15<6:49:56,  3.37it/s]
                                                         
{'loss': 2.6961, 'learning_rate': 3.006959856924303e-07, 'epoch': 12.43}

 78%|███████▊  | 288680/371472 [48:15<6:49:56,  3.37it/s]
 78%|███████▊  | 288681/371472 [48:15<6:35:38,  3.49it/s]
 78%|███████▊  | 288682/371472 [48:15<7:05:40,  3.24it/s]
 78%|███████▊  | 288683/371472 [48:16<6:48:35,  3.38it/s]
 78%|███████▊  | 288684/371472 [48:16<6:37:18,  3.47it/s]
 78%|███████▊  | 288685/371472 [48:16<6:50:46,  3.36it/s]
 78%|███████▊  | 288686/371472 [48:16<6:46:32,  3.39it/s]
 78%|███████▊  | 288687/371472 [48:17<7:05:50,  3.24it/s]
 78%|███████▊  | 288688/371472 [48:17<6:42:11,  3.43it/s]
 78%|███████▊  | 288689/371472 [48:17<6:25:08,  3.58it/s]
 78%|███████▊  | 288690/371472 [48:18<6:14:26,  3.68it/s]
 78%|███████▊  | 288691/371472 [48:18<6:16:27,  3.66it/s]
 78%|███████▊  | 288692/371472 [48:18<7:04:24,  3.25it/s]
 78%|███████▊  | 288693/371472 [48:19<6:58:53,  3.29it/s]
 78%|███████▊  | 288694/371472 [48:19<6:34:51,  3.49it/s]
 78%|███████▊  | 288695/371472 [48:19<6:29:03,  3.55it/s]
 78%|███████▊  | 288696/371472 [48:19<6:12:42,  3.70it/s]
 78%|███████▊  | 288697/371472 [48:20<6:48:17,  3.38it/s]
 78%|███████▊  | 288698/371472 [48:20<6:49:07,  3.37it/s]
 78%|███████▊  | 288699/371472 [48:20<6:32:06,  3.52it/s]
 78%|███████▊  | 288700/371472 [48:20<6:23:17,  3.60it/s]
                                                         
{'loss': 2.7223, 'learning_rate': 3.0064750371695143e-07, 'epoch': 12.43}

 78%|███████▊  | 288700/371472 [48:20<6:23:17,  3.60it/s]
 78%|███████▊  | 288701/371472 [48:21<6:25:46,  3.58it/s]
 78%|███████▊  | 288702/371472 [48:21<6:14:08,  3.69it/s]
 78%|███████▊  | 288703/371472 [48:21<6:12:28,  3.70it/s]
 78%|███████▊  | 288704/371472 [48:22<6:47:39,  3.38it/s]
 78%|███████▊  | 288705/371472 [48:22<6:51:01,  3.36it/s]
 78%|███████▊  | 288706/371472 [48:22<6:46:31,  3.39it/s]
 78%|███████▊  | 288707/371472 [48:23<6:40:05,  3.45it/s]
 78%|███████▊  | 288708/371472 [48:23<7:29:19,  3.07it/s]
 78%|███████▊  | 288709/371472 [48:23<7:16:53,  3.16it/s]
 78%|███████▊  | 288710/371472 [48:24<7:33:08,  3.04it/s]
 78%|███████▊  | 288711/371472 [48:24<6:59:01,  3.29it/s]
 78%|███████▊  | 288712/371472 [48:24<6:40:20,  3.45it/s]
 78%|███████▊  | 288713/371472 [48:24<6:59:03,  3.29it/s]
 78%|███████▊  | 288714/371472 [48:25<6:49:35,  3.37it/s]
 78%|███████▊  | 288715/371472 [48:25<6:39:06,  3.46it/s]
 78%|███████▊  | 288716/371472 [48:25<7:01:54,  3.27it/s]
 78%|███████▊  | 288717/371472 [48:26<6:44:39,  3.41it/s]
 78%|███████▊  | 288718/371472 [48:26<7:05:35,  3.24it/s]
 78%|███████▊  | 288719/371472 [48:26<7:05:12,  3.24it/s]
 78%|███████▊  | 288720/371472 [48:27<7:20:37,  3.13it/s]
                                                         
{'loss': 2.6462, 'learning_rate': 3.005990217414725e-07, 'epoch': 12.44}

 78%|███████▊  | 288720/371472 [48:27<7:20:37,  3.13it/s]
 78%|███████▊  | 288721/371472 [48:27<7:10:52,  3.20it/s]
 78%|███████▊  | 288722/371472 [48:27<6:42:45,  3.42it/s]
 78%|███████▊  | 288723/371472 [48:27<6:33:54,  3.50it/s]
 78%|███████▊  | 288724/371472 [48:28<6:28:29,  3.55it/s]
 78%|███████▊  | 288725/371472 [48:28<6:19:16,  3.64it/s]
 78%|███████▊  | 288726/371472 [48:28<6:16:27,  3.66it/s]
 78%|███████▊  | 288727/371472 [48:28<6:22:49,  3.60it/s]
 78%|███████▊  | 288728/371472 [48:29<6:38:55,  3.46it/s]
 78%|███████▊  | 288729/371472 [48:29<6:23:46,  3.59it/s]
 78%|███████▊  | 288730/371472 [48:29<6:41:12,  3.44it/s]
 78%|███████▊  | 288731/371472 [48:30<6:24:54,  3.58it/s]
 78%|███████▊  | 288732/371472 [48:30<6:15:27,  3.67it/s]
 78%|███████▊  | 288733/371472 [48:30<6:14:02,  3.69it/s]
 78%|███████▊  | 288734/371472 [48:30<6:14:56,  3.68it/s]
 78%|███████▊  | 288735/371472 [48:31<6:22:49,  3.60it/s]
 78%|███████▊  | 288736/371472 [48:31<6:18:30,  3.64it/s]
 78%|███████▊  | 288737/371472 [48:31<6:10:10,  3.72it/s]
 78%|███████▊  | 288738/371472 [48:32<6:19:13,  3.64it/s]
 78%|███████▊  | 288739/371472 [48:32<6:34:10,  3.50it/s]
 78%|███████▊  | 288740/371472 [48:32<6:26:03,  3.57it/s]
                                                         
{'loss': 2.6288, 'learning_rate': 3.005505397659936e-07, 'epoch': 12.44}

 78%|███████▊  | 288740/371472 [48:32<6:26:03,  3.57it/s]
 78%|███████▊  | 288741/371472 [48:32<6:32:58,  3.51it/s]
 78%|███████▊  | 288742/371472 [48:33<6:24:04,  3.59it/s]
 78%|███████▊  | 288743/371472 [48:33<6:36:39,  3.48it/s]
 78%|███████▊  | 288744/371472 [48:33<6:20:34,  3.62it/s]
 78%|███████▊  | 288745/371472 [48:34<6:36:31,  3.48it/s]
 78%|███████▊  | 288746/371472 [48:34<7:13:31,  3.18it/s]
 78%|███████▊  | 288747/371472 [48:34<7:09:38,  3.21it/s]
 78%|███████▊  | 288748/371472 [48:34<6:56:56,  3.31it/s]
 78%|███████▊  | 288749/371472 [48:35<6:29:43,  3.54it/s]
 78%|███████▊  | 288750/371472 [48:35<6:23:24,  3.60it/s]
 78%|███████▊  | 288751/371472 [48:35<6:46:11,  3.39it/s]
 78%|███████▊  | 288752/371472 [48:36<6:46:24,  3.39it/s]
 78%|███████▊  | 288753/371472 [48:36<6:33:00,  3.51it/s]
 78%|███████▊  | 288754/371472 [48:36<7:01:43,  3.27it/s]
 78%|███████▊  | 288755/371472 [48:37<6:54:00,  3.33it/s]
 78%|███████▊  | 288756/371472 [48:37<6:57:13,  3.30it/s]
 78%|███████▊  | 288757/371472 [48:37<7:05:51,  3.24it/s]
 78%|███████▊  | 288758/371472 [48:37<7:03:00,  3.26it/s]
 78%|███████▊  | 288759/371472 [48:38<6:44:46,  3.41it/s]
 78%|███████▊  | 288760/371472 [48:38<6:35:13,  3.49it/s]
                                                         
{'loss': 2.662, 'learning_rate': 3.0050205779051475e-07, 'epoch': 12.44}

 78%|███████▊  | 288760/371472 [48:38<6:35:13,  3.49it/s]
 78%|███████▊  | 288761/371472 [48:38<6:31:58,  3.52it/s]
 78%|███████▊  | 288762/371472 [48:39<6:28:30,  3.55it/s]
 78%|███████▊  | 288763/371472 [48:39<6:12:14,  3.70it/s]
 78%|███████▊  | 288764/371472 [48:39<6:21:36,  3.61it/s]
 78%|███████▊  | 288765/371472 [48:39<6:49:12,  3.37it/s]
 78%|███████▊  | 288766/371472 [48:40<6:59:25,  3.29it/s]
 78%|███████▊  | 288767/371472 [48:40<7:20:30,  3.13it/s]
 78%|███████▊  | 288768/371472 [48:40<7:06:04,  3.24it/s]
 78%|███████▊  | 288769/371472 [48:41<7:06:18,  3.23it/s]
 78%|███████▊  | 288770/371472 [48:41<6:51:08,  3.35it/s]
 78%|███████▊  | 288771/371472 [48:41<6:31:47,  3.52it/s]
 78%|███████▊  | 288772/371472 [48:41<6:32:47,  3.51it/s]
 78%|███████▊  | 288773/371472 [48:42<6:24:17,  3.59it/s]
 78%|███████▊  | 288774/371472 [48:42<6:17:15,  3.65it/s]
 78%|███████▊  | 288775/371472 [48:42<6:13:46,  3.69it/s]
 78%|███████▊  | 288776/371472 [48:43<6:10:11,  3.72it/s]
 78%|███████▊  | 288777/371472 [48:43<6:36:47,  3.47it/s]
 78%|███████▊  | 288778/371472 [48:43<6:29:27,  3.54it/s]
 78%|███████▊  | 288779/371472 [48:43<6:23:48,  3.59it/s]
 78%|███████▊  | 288780/371472 [48:44<6:14:27,  3.68it/s]
                                                         
{'loss': 2.7825, 'learning_rate': 3.004535758150359e-07, 'epoch': 12.44}

 78%|███████▊  | 288780/371472 [48:44<6:14:27,  3.68it/s]
 78%|███████▊  | 288781/371472 [48:44<6:12:03,  3.70it/s]
 78%|███████▊  | 288782/371472 [48:44<6:20:02,  3.63it/s]
 78%|███████▊  | 288783/371472 [48:45<6:17:31,  3.65it/s]
 78%|███████▊  | 288784/371472 [48:45<6:11:14,  3.71it/s]
 78%|███████▊  | 288785/371472 [48:45<6:29:59,  3.53it/s]
 78%|███████▊  | 288786/371472 [48:45<6:45:11,  3.40it/s]
 78%|███████▊  | 288787/371472 [48:46<7:01:36,  3.27it/s]
 78%|███████▊  | 288788/371472 [48:46<6:55:31,  3.32it/s]
 78%|███████▊  | 288789/371472 [48:46<6:45:02,  3.40it/s]
 78%|███████▊  | 288790/371472 [48:47<6:55:55,  3.31it/s]
 78%|███████▊  | 288791/371472 [48:47<6:36:56,  3.47it/s]
 78%|███████▊  | 288792/371472 [48:47<6:31:03,  3.52it/s]
 78%|███████▊  | 288793/371472 [48:47<6:45:59,  3.39it/s]
 78%|███████▊  | 288794/371472 [48:48<6:26:16,  3.57it/s]
 78%|███████▊  | 288795/371472 [48:48<6:22:45,  3.60it/s]
 78%|███████▊  | 288796/371472 [48:48<6:39:54,  3.45it/s]
 78%|███████▊  | 288797/371472 [48:49<6:33:24,  3.50it/s]
 78%|███████▊  | 288798/371472 [48:49<6:16:47,  3.66it/s]
 78%|███████▊  | 288799/371472 [48:49<6:41:28,  3.43it/s]
 78%|███████▊  | 288800/371472 [48:49<6:49:45,  3.36it/s]
                                                         
{'loss': 2.6859, 'learning_rate': 3.0040509383955694e-07, 'epoch': 12.44}

 78%|███████▊  | 288800/371472 [48:49<6:49:45,  3.36it/s]
 78%|███████▊  | 288801/371472 [48:50<6:50:02,  3.36it/s]
 78%|███████▊  | 288802/371472 [48:50<7:50:48,  2.93it/s]
 78%|███████▊  | 288803/371472 [48:51<7:29:29,  3.07it/s]
 78%|███████▊  | 288804/371472 [48:51<7:21:26,  3.12it/s]
 78%|███████▊  | 288805/371472 [48:51<7:10:29,  3.20it/s]
 78%|███████▊  | 288806/371472 [48:51<6:41:26,  3.43it/s]
 78%|███████▊  | 288807/371472 [48:52<6:52:30,  3.34it/s]
 78%|███████▊  | 288808/371472 [48:52<7:23:55,  3.10it/s]
 78%|███████▊  | 288809/371472 [48:52<7:09:00,  3.21it/s]
 78%|███████▊  | 288810/371472 [48:53<6:45:55,  3.39it/s]
 78%|███████▊  | 288811/371472 [48:53<7:08:16,  3.22it/s]
 78%|███████▊  | 288812/371472 [48:53<7:04:24,  3.25it/s]
 78%|███████▊  | 288813/371472 [48:54<7:12:42,  3.18it/s]
 78%|███████▊  | 288814/371472 [48:54<7:01:46,  3.27it/s]
 78%|███████▊  | 288815/371472 [48:54<6:56:46,  3.31it/s]
 78%|███████▊  | 288816/371472 [48:54<6:42:44,  3.42it/s]
 78%|███████▊  | 288817/371472 [48:55<6:26:10,  3.57it/s]
 78%|███████▊  | 288818/371472 [48:55<6:21:01,  3.62it/s]
 78%|███████▊  | 288819/371472 [48:55<6:21:55,  3.61it/s]
 78%|███████▊  | 288820/371472 [48:56<6:49:18,  3.37it/s]
                                                         
{'loss': 2.6473, 'learning_rate': 3.003566118640781e-07, 'epoch': 12.44}

 78%|███████▊  | 288820/371472 [48:56<6:49:18,  3.37it/s]
 78%|███████▊  | 288821/371472 [48:56<6:27:10,  3.56it/s]
 78%|███████▊  | 288822/371472 [48:56<6:27:10,  3.56it/s]
 78%|███████▊  | 288823/371472 [48:56<6:46:27,  3.39it/s]
 78%|███████▊  | 288824/371472 [48:57<6:44:33,  3.40it/s]
 78%|███████▊  | 288825/371472 [48:57<6:29:57,  3.53it/s]
 78%|███████▊  | 288826/371472 [48:57<6:14:48,  3.68it/s]
 78%|███████▊  | 288827/371472 [48:57<6:14:13,  3.68it/s]
 78%|███████▊  | 288828/371472 [48:58<6:56:41,  3.31it/s]
 78%|███████▊  | 288829/371472 [48:58<7:00:52,  3.27it/s]
 78%|███████▊  | 288830/371472 [48:58<6:35:56,  3.48it/s]
 78%|███████▊  | 288831/371472 [48:59<6:28:13,  3.55it/s]
 78%|███████▊  | 288832/371472 [48:59<6:49:39,  3.36it/s]
 78%|███████▊  | 288833/371472 [48:59<6:54:19,  3.32it/s]
 78%|███████▊  | 288834/371472 [49:00<6:48:26,  3.37it/s]
 78%|███████▊  | 288835/371472 [49:00<6:35:06,  3.49it/s]
 78%|███████▊  | 288836/371472 [49:00<7:07:22,  3.22it/s]
 78%|███████▊  | 288837/371472 [49:01<6:58:38,  3.29it/s]
 78%|███████▊  | 288838/371472 [49:01<6:39:01,  3.45it/s]
 78%|███████▊  | 288839/371472 [49:01<7:03:50,  3.25it/s]
 78%|███████▊  | 288840/371472 [49:01<6:45:48,  3.39it/s]
                                                         
{'loss': 2.6463, 'learning_rate': 3.0030812988859914e-07, 'epoch': 12.44}

 78%|███████▊  | 288840/371472 [49:01<6:45:48,  3.39it/s]
 78%|███████▊  | 288841/371472 [49:02<6:53:16,  3.33it/s]
 78%|███████▊  | 288842/371472 [49:02<6:37:17,  3.47it/s]
 78%|███████▊  | 288843/371472 [49:02<6:56:17,  3.31it/s]
 78%|███████▊  | 288844/371472 [49:03<6:57:02,  3.30it/s]
 78%|███████▊  | 288845/371472 [49:03<7:08:03,  3.22it/s]
 78%|███████▊  | 288846/371472 [49:03<6:48:07,  3.37it/s]
 78%|███████▊  | 288847/371472 [49:04<7:05:33,  3.24it/s]
 78%|███████▊  | 288848/371472 [49:04<7:17:31,  3.15it/s]
 78%|███████▊  | 288849/371472 [49:04<7:08:31,  3.21it/s]
 78%|███████▊  | 288850/371472 [49:04<7:10:53,  3.20it/s]
 78%|███████▊  | 288851/371472 [49:05<6:53:53,  3.33it/s]
 78%|███████▊  | 288852/371472 [49:05<6:45:51,  3.39it/s]
 78%|███████▊  | 288853/371472 [49:05<6:41:33,  3.43it/s]
 78%|███████▊  | 288854/371472 [49:06<6:43:48,  3.41it/s]
 78%|███████▊  | 288855/371472 [49:06<6:39:55,  3.44it/s]
 78%|███████▊  | 288856/371472 [49:06<6:36:26,  3.47it/s]
 78%|███████▊  | 288857/371472 [49:06<6:46:42,  3.39it/s]
 78%|███████▊  | 288858/371472 [49:07<6:25:28,  3.57it/s]
 78%|███████▊  | 288859/371472 [49:07<6:28:09,  3.55it/s]
 78%|███████▊  | 288860/371472 [49:07<6:34:08,  3.49it/s]
                                                         
{'loss': 2.6285, 'learning_rate': 3.002596479131203e-07, 'epoch': 12.44}

 78%|███████▊  | 288860/371472 [49:07<6:34:08,  3.49it/s]
 78%|███████▊  | 288861/371472 [49:08<6:22:06,  3.60it/s]
 78%|███████▊  | 288862/371472 [49:08<6:21:32,  3.61it/s]
 78%|███████▊  | 288863/371472 [49:08<6:05:21,  3.77it/s]
 78%|███████▊  | 288864/371472 [49:08<6:10:00,  3.72it/s]
 78%|███████▊  | 288865/371472 [49:09<6:08:16,  3.74it/s]
 78%|███████▊  | 288866/371472 [49:09<6:11:22,  3.71it/s]
 78%|███████▊  | 288867/371472 [49:09<6:09:24,  3.73it/s]
 78%|███████▊  | 288868/371472 [49:09<6:01:01,  3.81it/s]
 78%|███████▊  | 288869/371472 [49:10<5:53:39,  3.89it/s]
 78%|███████▊  | 288870/371472 [49:10<6:06:33,  3.76it/s]
 78%|███████▊  | 288871/371472 [49:10<6:06:49,  3.75it/s]
 78%|███████▊  | 288872/371472 [49:10<6:06:40,  3.75it/s]
 78%|███████▊  | 288873/371472 [49:11<6:09:29,  3.73it/s]
 78%|███████▊  | 288874/371472 [49:11<6:33:43,  3.50it/s]
 78%|███████▊  | 288875/371472 [49:11<7:00:33,  3.27it/s]
 78%|███████▊  | 288876/371472 [49:12<7:09:00,  3.21it/s]
 78%|███████▊  | 288877/371472 [49:12<7:33:01,  3.04it/s]
 78%|███████▊  | 288878/371472 [49:12<7:08:25,  3.21it/s]
 78%|███████▊  | 288879/371472 [49:13<6:59:09,  3.28it/s]
 78%|███████▊  | 288880/371472 [49:13<6:42:51,  3.42it/s]
                                                         
{'loss': 2.7403, 'learning_rate': 3.002111659376414e-07, 'epoch': 12.44}

 78%|███████▊  | 288880/371472 [49:13<6:42:51,  3.42it/s]
 78%|███████▊  | 288881/371472 [49:13<6:28:40,  3.54it/s]
 78%|███████▊  | 288882/371472 [49:14<6:33:57,  3.49it/s]
 78%|███████▊  | 288883/371472 [49:14<6:23:01,  3.59it/s]
 78%|███████▊  | 288884/371472 [49:14<6:06:39,  3.75it/s]
 78%|███████▊  | 288885/371472 [49:14<6:06:08,  3.76it/s]
 78%|███████▊  | 288886/371472 [49:15<6:03:43,  3.78it/s]
 78%|███████▊  | 288887/371472 [49:15<5:53:43,  3.89it/s]
 78%|███████▊  | 288888/371472 [49:15<5:48:39,  3.95it/s]
 78%|███████▊  | 288889/371472 [49:15<5:54:54,  3.88it/s]
 78%|███████▊  | 288890/371472 [49:16<5:54:09,  3.89it/s]
 78%|███████▊  | 288891/371472 [49:16<5:59:09,  3.83it/s]
 78%|███████▊  | 288892/371472 [49:16<6:16:21,  3.66it/s]
 78%|███████▊  | 288893/371472 [49:16<6:36:45,  3.47it/s]
 78%|███████▊  | 288894/371472 [49:17<6:27:32,  3.55it/s]
 78%|███████▊  | 288895/371472 [49:17<6:18:54,  3.63it/s]
 78%|███████▊  | 288896/371472 [49:17<6:10:12,  3.72it/s]
 78%|███████▊  | 288897/371472 [49:17<6:11:56,  3.70it/s]
 78%|███████▊  | 288898/371472 [49:18<6:41:06,  3.43it/s]
 78%|███████▊  | 288899/371472 [49:18<6:31:36,  3.51it/s]
 78%|███████▊  | 288900/371472 [49:18<6:15:16,  3.67it/s]
                                                         
{'loss': 2.6494, 'learning_rate': 3.0016268396216257e-07, 'epoch': 12.44}

 78%|███████▊  | 288900/371472 [49:18<6:15:16,  3.67it/s]
 78%|███████▊  | 288901/371472 [49:19<6:10:01,  3.72it/s]
 78%|███████▊  | 288902/371472 [49:19<6:07:44,  3.74it/s]
 78%|███████▊  | 288903/371472 [49:19<6:10:02,  3.72it/s]
 78%|███████▊  | 288904/371472 [49:19<6:28:08,  3.55it/s]
 78%|███████▊  | 288905/371472 [49:20<6:09:04,  3.73it/s]
 78%|███████▊  | 288906/371472 [49:20<6:19:02,  3.63it/s]
 78%|███████▊  | 288907/371472 [49:20<6:26:41,  3.56it/s]
 78%|███████▊  | 288908/371472 [49:21<6:22:46,  3.59it/s]
 78%|███████▊  | 288909/371472 [49:21<6:25:19,  3.57it/s]
 78%|███████▊  | 288910/371472 [49:21<6:20:51,  3.61it/s]
 78%|███████▊  | 288911/371472 [49:21<6:27:21,  3.55it/s]
 78%|███████▊  | 288912/371472 [49:22<6:37:35,  3.46it/s]
 78%|███████▊  | 288913/371472 [49:22<6:34:25,  3.49it/s]
 78%|███████▊  | 288914/371472 [49:22<6:32:23,  3.51it/s]
 78%|███████▊  | 288915/371472 [49:23<6:20:47,  3.61it/s]
 78%|███████▊  | 288916/371472 [49:23<6:16:10,  3.66it/s]
 78%|███████▊  | 288917/371472 [49:23<6:10:47,  3.71it/s]
 78%|███████▊  | 288918/371472 [49:23<6:32:43,  3.50it/s]
 78%|███████▊  | 288919/371472 [49:24<6:30:24,  3.52it/s]
 78%|███████▊  | 288920/371472 [49:24<6:26:10,  3.56it/s]
                                                         
{'loss': 2.6691, 'learning_rate': 3.0011420198668364e-07, 'epoch': 12.44}

 78%|███████▊  | 288920/371472 [49:24<6:26:10,  3.56it/s]
 78%|███████▊  | 288921/371472 [49:24<6:22:40,  3.60it/s]
 78%|███████▊  | 288922/371472 [49:24<6:28:29,  3.54it/s]
 78%|███████▊  | 288923/371472 [49:25<6:52:39,  3.33it/s]
 78%|███████▊  | 288924/371472 [49:25<6:48:55,  3.36it/s]
 78%|███████▊  | 288925/371472 [49:25<6:30:29,  3.52it/s]
 78%|███████▊  | 288926/371472 [49:26<6:21:40,  3.60it/s]
 78%|███████▊  | 288927/371472 [49:26<6:23:44,  3.59it/s]
 78%|███████▊  | 288928/371472 [49:26<6:28:58,  3.54it/s]
 78%|███████▊  | 288929/371472 [49:27<6:35:07,  3.48it/s]
 78%|███████▊  | 288930/371472 [49:27<6:14:43,  3.67it/s]
 78%|███████▊  | 288931/371472 [49:27<6:13:28,  3.68it/s]
 78%|███████▊  | 288932/371472 [49:27<6:15:16,  3.67it/s]
 78%|███████▊  | 288933/371472 [49:28<6:54:23,  3.32it/s]
 78%|███████▊  | 288934/371472 [49:28<6:32:14,  3.51it/s]
 78%|███████▊  | 288935/371472 [49:28<6:21:33,  3.61it/s]
 78%|███████▊  | 288936/371472 [49:28<6:26:02,  3.56it/s]
 78%|███████▊  | 288937/371472 [49:29<6:21:26,  3.61it/s]
 78%|███████▊  | 288938/371472 [49:29<6:22:48,  3.59it/s]
 78%|███████▊  | 288939/371472 [49:29<6:25:15,  3.57it/s]
 78%|███████▊  | 288940/371472 [49:30<6:18:43,  3.63it/s]
                                                         
{'loss': 2.488, 'learning_rate': 3.0006572001120476e-07, 'epoch': 12.45}

 78%|███████▊  | 288940/371472 [49:30<6:18:43,  3.63it/s]
 78%|███████▊  | 288941/371472 [49:30<6:16:52,  3.65it/s]
 78%|███████▊  | 288942/371472 [49:30<6:16:23,  3.65it/s]
 78%|███████▊  | 288943/371472 [49:30<6:28:25,  3.54it/s]
 78%|███████▊  | 288944/371472 [49:31<6:29:22,  3.53it/s]
 78%|███████▊  | 288945/371472 [49:31<6:23:30,  3.59it/s]
 78%|███████▊  | 288946/371472 [49:31<6:19:12,  3.63it/s]
 78%|███████▊  | 288947/371472 [49:32<6:33:15,  3.50it/s]
 78%|███████▊  | 288948/371472 [49:32<6:19:36,  3.62it/s]
 78%|███████▊  | 288949/371472 [49:32<6:41:21,  3.43it/s]
 78%|███████▊  | 288950/371472 [49:32<6:33:29,  3.50it/s]
 78%|███████▊  | 288951/371472 [49:33<6:24:37,  3.58it/s]
 78%|███████▊  | 288952/371472 [49:33<6:33:59,  3.49it/s]
 78%|███████▊  | 288953/371472 [49:33<6:21:45,  3.60it/s]
 78%|███████▊  | 288954/371472 [49:34<6:33:31,  3.49it/s]
 78%|███████▊  | 288955/371472 [49:34<6:25:58,  3.56it/s]
 78%|███████▊  | 288956/371472 [49:34<6:16:48,  3.65it/s]
 78%|███████▊  | 288957/371472 [49:34<6:44:39,  3.40it/s]
 78%|███████▊  | 288958/371472 [49:35<6:26:40,  3.56it/s]
 78%|███████▊  | 288959/371472 [49:35<6:44:50,  3.40it/s]
 78%|███████▊  | 288960/371472 [49:35<6:42:03,  3.42it/s]
                                                         
{'loss': 2.6129, 'learning_rate': 3.000172380357258e-07, 'epoch': 12.45}

 78%|███████▊  | 288960/371472 [49:35<6:42:03,  3.42it/s]
 78%|███████▊  | 288961/371472 [49:36<7:11:00,  3.19it/s]
 78%|███████▊  | 288962/371472 [49:36<7:02:14,  3.26it/s]
 78%|███████▊  | 288963/371472 [49:36<6:56:43,  3.30it/s]
 78%|███████▊  | 288964/371472 [49:37<7:09:20,  3.20it/s]
 78%|███████▊  | 288965/371472 [49:37<7:28:39,  3.06it/s]
 78%|███████▊  | 288966/371472 [49:37<7:02:25,  3.26it/s]
 78%|███████▊  | 288967/371472 [49:37<6:45:25,  3.39it/s]
 78%|███████▊  | 288968/371472 [49:38<6:36:46,  3.47it/s]
 78%|███████▊  | 288969/371472 [49:38<6:19:34,  3.62it/s]
 78%|███████▊  | 288970/371472 [49:38<6:19:28,  3.62it/s]
 78%|███████▊  | 288971/371472 [49:38<6:20:07,  3.62it/s]
 78%|███████▊  | 288972/371472 [49:39<6:10:16,  3.71it/s]
 78%|███████▊  | 288973/371472 [49:39<6:13:52,  3.68it/s]
 78%|███████▊  | 288974/371472 [49:39<6:21:26,  3.60it/s]
 78%|███████▊  | 288975/371472 [49:40<6:28:28,  3.54it/s]
 78%|███████▊  | 288976/371472 [49:40<6:13:54,  3.68it/s]
 78%|███████▊  | 288977/371472 [49:40<6:02:52,  3.79it/s]
 78%|███████▊  | 288978/371472 [49:40<6:50:29,  3.35it/s]
 78%|███████▊  | 288979/371472 [49:41<6:38:44,  3.45it/s]
 78%|███████▊  | 288980/371472 [49:41<6:25:47,  3.56it/s]
                                                         
{'loss': 2.574, 'learning_rate': 2.9996875606024685e-07, 'epoch': 12.45}

 78%|███████▊  | 288980/371472 [49:41<6:25:47,  3.56it/s]
 78%|███████▊  | 288981/371472 [49:41<6:33:59,  3.49it/s]
 78%|███████▊  | 288982/371472 [49:42<6:22:50,  3.59it/s]
 78%|███████▊  | 288983/371472 [49:42<6:15:31,  3.66it/s]
 78%|███████▊  | 288984/371472 [49:42<6:23:16,  3.59it/s]
 78%|███████▊  | 288985/371472 [49:42<6:15:52,  3.66it/s]
 78%|███████▊  | 288986/371472 [49:43<6:17:00,  3.65it/s]
 78%|███████▊  | 288987/371472 [49:43<6:20:31,  3.61it/s]
 78%|███████▊  | 288988/371472 [49:43<6:18:19,  3.63it/s]
 78%|███████▊  | 288989/371472 [49:44<6:23:29,  3.58it/s]
 78%|███████▊  | 288990/371472 [49:44<6:49:00,  3.36it/s]
 78%|███████▊  | 288991/371472 [49:44<6:33:55,  3.49it/s]
 78%|███████▊  | 288992/371472 [49:44<6:26:47,  3.55it/s]
 78%|███████▊  | 288993/371472 [49:45<6:23:31,  3.58it/s]
 78%|███████▊  | 288994/371472 [49:45<6:27:40,  3.55it/s]
 78%|███████▊  | 288995/371472 [49:45<6:31:02,  3.52it/s]
 78%|███████▊  | 288996/371472 [49:46<6:31:03,  3.52it/s]
 78%|███████▊  | 288997/371472 [49:46<6:44:09,  3.40it/s]
 78%|███████▊  | 288998/371472 [49:46<6:53:53,  3.32it/s]
 78%|███████▊  | 288999/371472 [49:46<6:33:29,  3.49it/s]
 78%|███████▊  | 289000/371472 [49:47<6:18:01,  3.64it/s]
                                                         
{'loss': 2.7323, 'learning_rate': 2.9992027408476803e-07, 'epoch': 12.45}

 78%|███████▊  | 289000/371472 [49:47<6:18:01,  3.64it/s]
 78%|███████▊  | 289001/371472 [49:47<6:12:40,  3.69it/s]
 78%|███████▊  | 289002/371472 [49:47<6:41:30,  3.42it/s]
 78%|███████▊  | 289003/371472 [49:48<7:07:30,  3.22it/s]
 78%|███████▊  | 289004/371472 [49:48<6:51:53,  3.34it/s]
 78%|███████▊  | 289005/371472 [49:48<6:45:15,  3.39it/s]
 78%|███████▊  | 289006/371472 [49:48<6:25:22,  3.57it/s]
 78%|███████▊  | 289007/371472 [49:49<6:20:07,  3.62it/s]
 78%|███████▊  | 289008/371472 [49:49<6:12:14,  3.69it/s]
 78%|███████▊  | 289009/371472 [49:49<7:03:30,  3.25it/s]
 78%|███████▊  | 289010/371472 [49:50<6:40:54,  3.43it/s]
 78%|███████▊  | 289011/371472 [49:50<7:44:28,  2.96it/s]
 78%|███████▊  | 289012/371472 [49:50<7:14:36,  3.16it/s]
 78%|███████▊  | 289013/371472 [49:51<6:59:41,  3.27it/s]
 78%|███████▊  | 289014/371472 [49:51<6:54:54,  3.31it/s]
 78%|███████▊  | 289015/371472 [49:51<6:56:52,  3.30it/s]
 78%|███████▊  | 289016/371472 [49:51<6:38:37,  3.45it/s]
 78%|███████▊  | 289017/371472 [49:52<6:33:36,  3.49it/s]
 78%|███████▊  | 289018/371472 [49:52<6:30:40,  3.52it/s]
 78%|███████▊  | 289019/371472 [49:52<6:37:51,  3.45it/s]
 78%|███████▊  | 289020/371472 [49:53<6:28:41,  3.54it/s]
                                                         
{'loss': 2.6815, 'learning_rate': 2.998717921092891e-07, 'epoch': 12.45}

 78%|███████▊  | 289020/371472 [49:53<6:28:41,  3.54it/s]
 78%|███████▊  | 289021/371472 [49:53<6:11:15,  3.70it/s]
 78%|███████▊  | 289022/371472 [49:53<6:17:14,  3.64it/s]
 78%|███████▊  | 289023/371472 [49:53<6:15:29,  3.66it/s]
 78%|███████▊  | 289024/371472 [49:54<6:32:32,  3.50it/s]
 78%|███████▊  | 289025/371472 [49:54<6:23:16,  3.59it/s]
 78%|███████▊  | 289026/371472 [49:54<6:18:48,  3.63it/s]
 78%|███████▊  | 289027/371472 [49:54<6:12:39,  3.69it/s]
 78%|███████▊  | 289028/371472 [49:55<6:04:43,  3.77it/s]
 78%|███████▊  | 289029/371472 [49:55<5:57:00,  3.85it/s]
 78%|███████▊  | 289030/371472 [49:55<5:47:52,  3.95it/s]
 78%|███████▊  | 289031/371472 [49:55<5:48:33,  3.94it/s]
 78%|███████▊  | 289032/371472 [49:56<5:52:48,  3.89it/s]
 78%|███████▊  | 289033/371472 [49:56<6:15:27,  3.66it/s]
 78%|███████▊  | 289034/371472 [49:56<6:25:51,  3.56it/s]
 78%|███████▊  | 289035/371472 [49:57<6:14:12,  3.67it/s]
 78%|███████▊  | 289036/371472 [49:57<6:24:59,  3.57it/s]
 78%|███████▊  | 289037/371472 [49:57<6:28:42,  3.53it/s]
 78%|███████▊  | 289038/371472 [49:57<6:19:49,  3.62it/s]
 78%|███████▊  | 289039/371472 [49:58<6:18:09,  3.63it/s]
 78%|███████▊  | 289040/371472 [49:58<6:13:49,  3.68it/s]
                                                         
{'loss': 2.6763, 'learning_rate': 2.998233101338103e-07, 'epoch': 12.45}

 78%|███████▊  | 289040/371472 [49:58<6:13:49,  3.68it/s]
 78%|███████▊  | 289041/371472 [49:58<6:09:28,  3.72it/s]
 78%|███████▊  | 289042/371472 [49:58<6:07:04,  3.74it/s]
 78%|███████▊  | 289043/371472 [49:59<6:34:58,  3.48it/s]
 78%|███████▊  | 289044/371472 [49:59<6:25:46,  3.56it/s]
 78%|███████▊  | 289045/371472 [49:59<6:21:28,  3.60it/s]
 78%|███████▊  | 289046/371472 [50:00<6:26:38,  3.55it/s]
 78%|███████▊  | 289047/371472 [50:00<6:37:21,  3.46it/s]
 78%|███████▊  | 289048/371472 [50:00<6:35:14,  3.48it/s]
 78%|███████▊  | 289049/371472 [50:00<6:22:07,  3.59it/s]
 78%|███████▊  | 289050/371472 [50:01<6:23:37,  3.58it/s]
 78%|███████▊  | 289051/371472 [50:01<6:36:40,  3.46it/s]
 78%|███████▊  | 289052/371472 [50:01<6:29:16,  3.53it/s]
 78%|███████▊  | 289053/371472 [50:02<6:21:02,  3.60it/s]
 78%|███████▊  | 289054/371472 [50:02<6:26:47,  3.55it/s]
 78%|███████▊  | 289055/371472 [50:02<6:32:54,  3.50it/s]
 78%|███████▊  | 289056/371472 [50:03<6:38:07,  3.45it/s]
 78%|███████▊  | 289057/371472 [50:03<6:37:42,  3.45it/s]
 78%|███████▊  | 289058/371472 [50:03<6:26:22,  3.55it/s]
 78%|███████▊  | 289059/371472 [50:03<6:13:13,  3.68it/s]
 78%|███████▊  | 289060/371472 [50:04<6:06:00,  3.75it/s]
                                                         
{'loss': 2.6663, 'learning_rate': 2.997748281583313e-07, 'epoch': 12.45}

 78%|███████▊  | 289060/371472 [50:04<6:06:00,  3.75it/s]
 78%|███████▊  | 289061/371472 [50:04<6:12:28,  3.69it/s]
 78%|███████▊  | 289062/371472 [50:04<6:10:08,  3.71it/s]
 78%|███████▊  | 289063/371472 [50:04<6:07:07,  3.74it/s]
 78%|███████▊  | 289064/371472 [50:05<6:29:32,  3.53it/s]
 78%|███████▊  | 289065/371472 [50:05<7:13:29,  3.17it/s]
 78%|███████▊  | 289066/371472 [50:05<7:05:55,  3.22it/s]
 78%|███████▊  | 289067/371472 [50:06<6:44:29,  3.40it/s]
 78%|███████▊  | 289068/371472 [50:06<6:39:53,  3.43it/s]
 78%|███████▊  | 289069/371472 [50:06<6:40:24,  3.43it/s]
 78%|███████▊  | 289070/371472 [50:06<6:31:13,  3.51it/s]
 78%|███████▊  | 289071/371472 [50:07<6:35:20,  3.47it/s]
 78%|███████▊  | 289072/371472 [50:07<7:05:30,  3.23it/s]
 78%|███████▊  | 289073/371472 [50:07<6:58:53,  3.28it/s]
 78%|███████▊  | 289074/371472 [50:08<6:48:41,  3.36it/s]
 78%|███████▊  | 289075/371472 [50:08<6:36:15,  3.47it/s]
 78%|███████▊  | 289076/371472 [50:08<7:19:24,  3.13it/s]
 78%|███████▊  | 289077/371472 [50:09<7:16:48,  3.14it/s]
 78%|███████▊  | 289078/371472 [50:09<7:41:59,  2.97it/s]
 78%|███████▊  | 289079/371472 [50:09<7:01:33,  3.26it/s]
 78%|███████▊  | 289080/371472 [50:10<7:22:53,  3.10it/s]
                                                         
{'loss': 2.6307, 'learning_rate': 2.997263461828525e-07, 'epoch': 12.45}

 78%|███████▊  | 289080/371472 [50:10<7:22:53,  3.10it/s]
 78%|███████▊  | 289081/371472 [50:10<7:04:49,  3.23it/s]
 78%|███████▊  | 289082/371472 [50:10<6:41:04,  3.42it/s]
 78%|███████▊  | 289083/371472 [50:10<6:28:52,  3.53it/s]
 78%|███████▊  | 289084/371472 [50:11<6:29:38,  3.52it/s]
 78%|███████▊  | 289085/371472 [50:11<6:26:42,  3.55it/s]
 78%|███████▊  | 289086/371472 [50:11<6:20:53,  3.60it/s]
 78%|███████▊  | 289087/371472 [50:12<6:34:40,  3.48it/s]
 78%|███████▊  | 289088/371472 [50:12<6:29:47,  3.52it/s]
 78%|███████▊  | 289089/371472 [50:12<6:36:49,  3.46it/s]
 78%|███████▊  | 289090/371472 [50:13<6:56:55,  3.29it/s]
 78%|███████▊  | 289091/371472 [50:13<6:39:11,  3.44it/s]
 78%|███████▊  | 289092/371472 [50:13<6:26:30,  3.55it/s]
 78%|███████▊  | 289093/371472 [50:13<6:31:28,  3.51it/s]
 78%|███████▊  | 289094/371472 [50:14<6:30:42,  3.51it/s]
 78%|███████▊  | 289095/371472 [50:14<6:25:39,  3.56it/s]
 78%|███████▊  | 289096/371472 [50:14<6:32:44,  3.50it/s]
 78%|███████▊  | 289097/371472 [50:14<6:20:54,  3.60it/s]
 78%|███████▊  | 289098/371472 [50:15<6:26:58,  3.55it/s]
 78%|███████▊  | 289099/371472 [50:15<6:18:19,  3.63it/s]
 78%|███████▊  | 289100/371472 [50:15<6:22:53,  3.59it/s]
                                                         
{'loss': 2.5369, 'learning_rate': 2.996778642073735e-07, 'epoch': 12.45}

 78%|███████▊  | 289100/371472 [50:15<6:22:53,  3.59it/s]
 78%|███████▊  | 289101/371472 [50:16<6:46:22,  3.38it/s]
 78%|███████▊  | 289102/371472 [50:16<6:28:55,  3.53it/s]
 78%|███████▊  | 289103/371472 [50:16<6:47:36,  3.37it/s]
 78%|███████▊  | 289104/371472 [50:16<6:35:54,  3.47it/s]
 78%|███████▊  | 289105/371472 [50:17<6:28:54,  3.53it/s]
 78%|███████▊  | 289106/371472 [50:17<6:14:06,  3.67it/s]
 78%|███████▊  | 289107/371472 [50:17<6:06:57,  3.74it/s]
 78%|███████▊  | 289108/371472 [50:17<6:02:19,  3.79it/s]
 78%|███████▊  | 289109/371472 [50:18<5:57:40,  3.84it/s]
 78%|███████▊  | 289110/371472 [50:18<6:02:20,  3.79it/s]
 78%|███████▊  | 289111/371472 [50:18<6:01:55,  3.79it/s]
 78%|███████▊  | 289112/371472 [50:19<6:03:45,  3.77it/s]
 78%|███████▊  | 289113/371472 [50:19<7:07:49,  3.21it/s]
 78%|███████▊  | 289114/371472 [50:19<7:08:18,  3.20it/s]
 78%|███████▊  | 289115/371472 [50:20<6:47:29,  3.37it/s]
 78%|███████▊  | 289116/371472 [50:20<6:42:50,  3.41it/s]
 78%|███████▊  | 289117/371472 [50:20<6:27:37,  3.54it/s]
 78%|███████▊  | 289118/371472 [50:20<6:19:56,  3.61it/s]
 78%|███████▊  | 289119/371472 [50:21<6:11:15,  3.70it/s]
 78%|███████▊  | 289120/371472 [50:21<5:59:41,  3.82it/s]
                                                         
{'loss': 2.5533, 'learning_rate': 2.9962938223189467e-07, 'epoch': 12.45}

 78%|███████▊  | 289120/371472 [50:21<5:59:41,  3.82it/s]
 78%|███████▊  | 289121/371472 [50:21<5:57:42,  3.84it/s]
 78%|███████▊  | 289122/371472 [50:21<6:06:34,  3.74it/s]
 78%|███████▊  | 289123/371472 [50:22<6:09:17,  3.72it/s]
 78%|███████▊  | 289124/371472 [50:22<6:29:55,  3.52it/s]
 78%|███████▊  | 289125/371472 [50:22<6:25:07,  3.56it/s]
 78%|███████▊  | 289126/371472 [50:23<6:41:43,  3.42it/s]
 78%|███████▊  | 289127/371472 [50:23<6:37:44,  3.45it/s]
 78%|███████▊  | 289128/371472 [50:23<6:20:04,  3.61it/s]
 78%|███████▊  | 289129/371472 [50:23<6:56:18,  3.30it/s]
 78%|███████▊  | 289130/371472 [50:24<6:51:39,  3.33it/s]
 78%|███████▊  | 289131/371472 [50:24<6:35:38,  3.47it/s]
 78%|███████▊  | 289132/371472 [50:24<6:51:21,  3.34it/s]
 78%|███████▊  | 289133/371472 [50:25<6:21:13,  3.60it/s]
 78%|███████▊  | 289134/371472 [50:25<6:15:22,  3.66it/s]
 78%|███████▊  | 289135/371472 [50:25<6:18:35,  3.62it/s]
 78%|███████▊  | 289136/371472 [50:25<6:22:34,  3.59it/s]
 78%|███████▊  | 289137/371472 [50:26<6:34:16,  3.48it/s]
 78%|███████▊  | 289138/371472 [50:26<6:38:07,  3.45it/s]
 78%|███████▊  | 289139/371472 [50:26<6:21:59,  3.59it/s]
 78%|███████▊  | 289140/371472 [50:27<6:14:38,  3.66it/s]
                                                         
{'loss': 2.8373, 'learning_rate': 2.9958090025641574e-07, 'epoch': 12.45}

 78%|███████▊  | 289140/371472 [50:27<6:14:38,  3.66it/s]
 78%|███████▊  | 289141/371472 [50:27<6:25:55,  3.56it/s]
 78%|███████▊  | 289142/371472 [50:27<6:26:17,  3.55it/s]
 78%|███████▊  | 289143/371472 [50:27<6:23:07,  3.58it/s]
 78%|███████▊  | 289144/371472 [50:28<6:30:36,  3.51it/s]
 78%|███████▊  | 289145/371472 [50:28<6:32:48,  3.49it/s]
 78%|███████▊  | 289146/371472 [50:28<6:32:00,  3.50it/s]
 78%|███████▊  | 289147/371472 [50:29<6:28:59,  3.53it/s]
 78%|███████▊  | 289148/371472 [50:29<6:16:43,  3.64it/s]
 78%|███████▊  | 289149/371472 [50:29<6:15:59,  3.65it/s]
 78%|███████▊  | 289150/371472 [50:29<6:11:07,  3.70it/s]
 78%|███████▊  | 289151/371472 [50:30<6:45:47,  3.38it/s]
 78%|███████▊  | 289152/371472 [50:30<6:36:43,  3.46it/s]
 78%|███████▊  | 289153/371472 [50:30<6:29:57,  3.52it/s]
 78%|███████▊  | 289154/371472 [50:31<6:28:41,  3.53it/s]
 78%|███████▊  | 289155/371472 [50:31<6:24:44,  3.57it/s]
 78%|███████▊  | 289156/371472 [50:31<6:36:52,  3.46it/s]
 78%|███████▊  | 289157/371472 [50:31<6:48:17,  3.36it/s]
 78%|███████▊  | 289158/371472 [50:32<6:37:54,  3.45it/s]
 78%|███████▊  | 289159/371472 [50:32<6:33:48,  3.48it/s]
 78%|███████▊  | 289160/371472 [50:32<6:35:06,  3.47it/s]
                                                         
{'loss': 2.5433, 'learning_rate': 2.995324182809369e-07, 'epoch': 12.45}

 78%|███████▊  | 289160/371472 [50:32<6:35:06,  3.47it/s]
 78%|███████▊  | 289161/371472 [50:33<6:27:50,  3.54it/s]
 78%|███████▊  | 289162/371472 [50:33<6:27:54,  3.54it/s]
 78%|███████▊  | 289163/371472 [50:33<6:17:39,  3.63it/s]
 78%|███████▊  | 289164/371472 [50:33<6:36:32,  3.46it/s]
 78%|███████▊  | 289165/371472 [50:34<6:46:00,  3.38it/s]
 78%|███████▊  | 289166/371472 [50:34<6:31:30,  3.50it/s]
 78%|███████▊  | 289167/371472 [50:34<6:13:38,  3.67it/s]
 78%|███████▊  | 289168/371472 [50:35<6:34:27,  3.48it/s]
 78%|███████▊  | 289169/371472 [50:35<6:40:02,  3.43it/s]
 78%|███████▊  | 289170/371472 [50:35<6:40:22,  3.43it/s]
 78%|███████▊  | 289171/371472 [50:35<6:31:24,  3.50it/s]
 78%|███████▊  | 289172/371472 [50:36<6:57:09,  3.29it/s]
 78%|███████▊  | 289173/371472 [50:36<7:06:30,  3.22it/s]
 78%|███████▊  | 289174/371472 [50:36<7:17:50,  3.13it/s]
 78%|███████▊  | 289175/371472 [50:37<6:59:10,  3.27it/s]
 78%|███████▊  | 289176/371472 [50:37<6:34:02,  3.48it/s]
 78%|███████▊  | 289177/371472 [50:37<6:28:30,  3.53it/s]
 78%|███████▊  | 289178/371472 [50:37<6:21:36,  3.59it/s]
 78%|███████▊  | 289179/371472 [50:38<6:17:45,  3.63it/s]
 78%|███████▊  | 289180/371472 [50:38<6:08:41,  3.72it/s]
                                                         
{'loss': 2.7266, 'learning_rate': 2.99483936305458e-07, 'epoch': 12.46}

 78%|███████▊  | 289180/371472 [50:38<6:08:41,  3.72it/s]
 78%|███████▊  | 289181/371472 [50:38<6:09:00,  3.72it/s]
 78%|███████▊  | 289182/371472 [50:39<6:04:29,  3.76it/s]
 78%|███████▊  | 289183/371472 [50:39<6:18:55,  3.62it/s]
 78%|███████▊  | 289184/371472 [50:39<6:03:34,  3.77it/s]
 78%|███████▊  | 289185/371472 [50:39<6:17:54,  3.63it/s]
 78%|███████▊  | 289186/371472 [50:40<6:10:18,  3.70it/s]
 78%|███████▊  | 289187/371472 [50:40<6:02:05,  3.79it/s]
 78%|███████▊  | 289188/371472 [50:40<6:18:45,  3.62it/s]
 78%|███████▊  | 289189/371472 [50:40<6:28:08,  3.53it/s]
 78%|███████▊  | 289190/371472 [50:41<6:33:18,  3.49it/s]
 78%|███████▊  | 289191/371472 [50:41<6:17:28,  3.63it/s]
 78%|███████▊  | 289192/371472 [50:41<6:23:00,  3.58it/s]
 78%|███████▊  | 289193/371472 [50:42<6:14:46,  3.66it/s]
 78%|███████▊  | 289194/371472 [50:42<6:21:53,  3.59it/s]
 78%|███████▊  | 289195/371472 [50:42<6:29:11,  3.52it/s]
 78%|███████▊  | 289196/371472 [50:42<6:17:05,  3.64it/s]
 78%|███████▊  | 289197/371472 [50:43<6:50:21,  3.34it/s]
 78%|███████▊  | 289198/371472 [50:43<6:37:59,  3.45it/s]
 78%|███████▊  | 289199/371472 [50:43<6:36:16,  3.46it/s]
 78%|███████▊  | 289200/371472 [50:44<6:50:30,  3.34it/s]
                                                         
{'loss': 2.7163, 'learning_rate': 2.994354543299791e-07, 'epoch': 12.46}

 78%|███████▊  | 289200/371472 [50:44<6:50:30,  3.34it/s]
 78%|███████▊  | 289201/371472 [50:44<7:09:02,  3.20it/s]
 78%|███████▊  | 289202/371472 [50:44<6:47:39,  3.36it/s]
 78%|███████▊  | 289203/371472 [50:44<6:32:40,  3.49it/s]
 78%|███████▊  | 289204/371472 [50:45<6:35:03,  3.47it/s]
 78%|███████▊  | 289205/371472 [50:45<7:00:57,  3.26it/s]
 78%|███████▊  | 289206/371472 [50:45<6:39:26,  3.43it/s]
 78%|███████▊  | 289207/371472 [50:46<6:32:30,  3.49it/s]
 78%|███████▊  | 289208/371472 [50:46<6:26:27,  3.55it/s]
 78%|███████▊  | 289209/371472 [50:46<7:01:39,  3.25it/s]
 78%|███████▊  | 289210/371472 [50:47<7:10:03,  3.19it/s]
 78%|███████▊  | 289211/371472 [50:47<6:43:05,  3.40it/s]
 78%|███████▊  | 289212/371472 [50:47<6:37:25,  3.45it/s]
 78%|███████▊  | 289213/371472 [50:47<6:35:25,  3.47it/s]
 78%|███████▊  | 289214/371472 [50:48<6:49:01,  3.35it/s]
 78%|███████▊  | 289215/371472 [50:48<7:02:35,  3.24it/s]
 78%|███████▊  | 289216/371472 [50:48<6:47:16,  3.37it/s]
 78%|███████▊  | 289217/371472 [50:49<6:19:37,  3.61it/s]
 78%|███████▊  | 289218/371472 [50:49<6:27:57,  3.53it/s]
 78%|███████▊  | 289219/371472 [50:49<6:24:45,  3.56it/s]
 78%|███████▊  | 289220/371472 [50:49<6:18:10,  3.62it/s]
                                                         
{'loss': 2.5602, 'learning_rate': 2.9938697235450013e-07, 'epoch': 12.46}

 78%|███████▊  | 289220/371472 [50:49<6:18:10,  3.62it/s]
 78%|███████▊  | 289221/371472 [50:50<6:16:54,  3.64it/s]
 78%|███████▊  | 289222/371472 [50:50<6:04:10,  3.76it/s]
 78%|███████▊  | 289223/371472 [50:50<6:40:27,  3.42it/s]
 78%|███████▊  | 289224/371472 [50:51<6:36:16,  3.46it/s]
 78%|███████▊  | 289225/371472 [50:51<6:35:15,  3.47it/s]
 78%|███████▊  | 289226/371472 [50:51<6:39:22,  3.43it/s]
 78%|███████▊  | 289227/371472 [50:51<6:32:27,  3.49it/s]
 78%|███████▊  | 289228/371472 [50:52<6:32:12,  3.49it/s]
 78%|███████▊  | 289229/371472 [50:52<6:28:45,  3.53it/s]
 78%|███████▊  | 289230/371472 [50:52<6:15:10,  3.65it/s]
 78%|███████▊  | 289231/371472 [50:53<6:57:55,  3.28it/s]
 78%|███████▊  | 289232/371472 [50:53<6:52:07,  3.33it/s]
 78%|███████▊  | 289233/371472 [50:53<6:41:19,  3.42it/s]
 78%|███████▊  | 289234/371472 [50:54<7:09:12,  3.19it/s]
 78%|███████▊  | 289235/371472 [50:54<6:49:01,  3.35it/s]
 78%|███████▊  | 289236/371472 [50:54<6:59:21,  3.27it/s]
 78%|███████▊  | 289237/371472 [50:54<6:53:08,  3.32it/s]
 78%|███████▊  | 289238/371472 [50:55<6:40:50,  3.42it/s]
 78%|███████▊  | 289239/371472 [50:55<6:40:56,  3.42it/s]
 78%|███████▊  | 289240/371472 [50:55<6:23:04,  3.58it/s]
                                                         
{'loss': 2.6478, 'learning_rate': 2.993384903790213e-07, 'epoch': 12.46}

 78%|███████▊  | 289240/371472 [50:55<6:23:04,  3.58it/s]
 78%|███████▊  | 289241/371472 [50:56<6:41:15,  3.42it/s]
 78%|███████▊  | 289242/371472 [50:56<6:26:26,  3.55it/s]
 78%|███████▊  | 289243/371472 [50:56<6:14:48,  3.66it/s]
 78%|███████▊  | 289244/371472 [50:56<6:30:29,  3.51it/s]
 78%|███████▊  | 289245/371472 [50:57<6:23:09,  3.58it/s]
 78%|███████▊  | 289246/371472 [50:57<6:20:43,  3.60it/s]
 78%|███████▊  | 289247/371472 [50:57<6:24:06,  3.57it/s]
 78%|███████▊  | 289248/371472 [50:57<6:21:10,  3.60it/s]
 78%|███████▊  | 289249/371472 [50:58<6:31:36,  3.50it/s]
 78%|███████▊  | 289250/371472 [50:58<6:30:50,  3.51it/s]
 78%|███████▊  | 289251/371472 [50:58<7:00:56,  3.26it/s]
 78%|███████▊  | 289252/371472 [50:59<7:17:13,  3.13it/s]
 78%|███████▊  | 289253/371472 [50:59<7:03:09,  3.24it/s]
 78%|███████▊  | 289254/371472 [50:59<6:52:47,  3.32it/s]
 78%|███████▊  | 289255/371472 [51:00<6:33:36,  3.48it/s]
 78%|███████▊  | 289256/371472 [51:00<6:25:27,  3.55it/s]
 78%|███████▊  | 289257/371472 [51:00<6:20:40,  3.60it/s]
 78%|███████▊  | 289258/371472 [51:00<6:11:12,  3.69it/s]
 78%|███████▊  | 289259/371472 [51:01<6:28:47,  3.52it/s]
 78%|███████▊  | 289260/371472 [51:01<6:43:58,  3.39it/s]
                                                         
{'loss': 2.5214, 'learning_rate': 2.992900084035424e-07, 'epoch': 12.46}

 78%|███████▊  | 289260/371472 [51:01<6:43:58,  3.39it/s]
 78%|███████▊  | 289261/371472 [51:01<6:49:15,  3.35it/s]
 78%|███████▊  | 289262/371472 [51:02<6:36:36,  3.45it/s]
 78%|███████▊  | 289263/371472 [51:02<7:04:01,  3.23it/s]
 78%|███████▊  | 289264/371472 [51:02<6:53:04,  3.32it/s]
 78%|███████▊  | 289265/371472 [51:03<6:43:05,  3.40it/s]
 78%|███████▊  | 289266/371472 [51:03<6:32:40,  3.49it/s]
 78%|███████▊  | 289267/371472 [51:03<6:24:56,  3.56it/s]
 78%|███████▊  | 289268/371472 [51:03<6:38:33,  3.44it/s]
 78%|███████▊  | 289269/371472 [51:04<6:45:39,  3.38it/s]
 78%|███████▊  | 289270/371472 [51:04<6:44:08,  3.39it/s]
 78%|███████▊  | 289271/371472 [51:04<6:32:16,  3.49it/s]
 78%|███████▊  | 289272/371472 [51:05<7:02:51,  3.24it/s]
 78%|███████▊  | 289273/371472 [51:05<7:12:35,  3.17it/s]
 78%|███████▊  | 289274/371472 [51:05<6:52:16,  3.32it/s]
 78%|███████▊  | 289275/371472 [51:06<6:54:08,  3.31it/s]
 78%|███████▊  | 289276/371472 [51:06<6:54:34,  3.30it/s]
 78%|███████▊  | 289277/371472 [51:06<7:05:23,  3.22it/s]
 78%|███████▊  | 289278/371472 [51:06<6:52:04,  3.32it/s]
 78%|███████▊  | 289279/371472 [51:07<6:39:31,  3.43it/s]
 78%|███████▊  | 289280/371472 [51:07<6:33:33,  3.48it/s]
                                                         
{'loss': 2.5694, 'learning_rate': 2.9924152642806356e-07, 'epoch': 12.46}

 78%|███████▊  | 289280/371472 [51:07<6:33:33,  3.48it/s]
 78%|███████▊  | 289281/371472 [51:07<6:28:49,  3.52it/s]
 78%|███████▊  | 289282/371472 [51:08<6:41:49,  3.41it/s]
 78%|███████▊  | 289283/371472 [51:08<6:31:47,  3.50it/s]
 78%|███████▊  | 289284/371472 [51:08<6:37:47,  3.44it/s]
 78%|███████▊  | 289285/371472 [51:09<7:28:36,  3.05it/s]
 78%|███████▊  | 289286/371472 [51:09<7:19:26,  3.12it/s]
 78%|███████▊  | 289287/371472 [51:09<7:01:02,  3.25it/s]
 78%|███████▊  | 289288/371472 [51:09<7:04:40,  3.23it/s]
 78%|███████▊  | 289289/371472 [51:10<6:50:51,  3.33it/s]
 78%|███████▊  | 289290/371472 [51:10<6:42:39,  3.40it/s]
 78%|███████▊  | 289291/371472 [51:10<6:36:27,  3.45it/s]
 78%|███████▊  | 289292/371472 [51:11<6:33:38,  3.48it/s]
 78%|███████▊  | 289293/371472 [51:11<6:23:13,  3.57it/s]
 78%|███████▊  | 289294/371472 [51:11<6:14:02,  3.66it/s]
 78%|███████▊  | 289295/371472 [51:11<6:22:32,  3.58it/s]
 78%|███████▊  | 289296/371472 [51:12<6:29:20,  3.52it/s]
 78%|███████▊  | 289297/371472 [51:12<6:19:50,  3.61it/s]
 78%|███████▊  | 289298/371472 [51:12<6:11:14,  3.69it/s]
 78%|███████▊  | 289299/371472 [51:12<6:02:03,  3.78it/s]
 78%|███████▊  | 289300/371472 [51:13<6:16:48,  3.63it/s]
                                                         
{'loss': 2.5812, 'learning_rate': 2.9919304445258463e-07, 'epoch': 12.46}

 78%|███████▊  | 289300/371472 [51:13<6:16:48,  3.63it/s]
 78%|███████▊  | 289301/371472 [51:13<6:13:37,  3.67it/s]
 78%|███████▊  | 289302/371472 [51:13<6:13:23,  3.67it/s]
 78%|███████▊  | 289303/371472 [51:14<6:28:06,  3.53it/s]
 78%|███████▊  | 289304/371472 [51:14<6:32:13,  3.49it/s]
 78%|███████▊  | 289305/371472 [51:14<6:58:52,  3.27it/s]
 78%|███████▊  | 289306/371472 [51:14<6:42:40,  3.40it/s]
 78%|███████▊  | 289307/371472 [51:15<7:01:21,  3.25it/s]
 78%|███████▊  | 289308/371472 [51:15<6:43:37,  3.39it/s]
 78%|███████▊  | 289309/371472 [51:15<6:58:32,  3.27it/s]
 78%|███████▊  | 289310/371472 [51:16<6:58:02,  3.28it/s]
 78%|███████▊  | 289311/371472 [51:16<6:57:53,  3.28it/s]
 78%|███████▊  | 289312/371472 [51:16<7:07:58,  3.20it/s]
 78%|███████▊  | 289313/371472 [51:17<6:44:07,  3.39it/s]
 78%|███████▊  | 289314/371472 [51:17<6:43:46,  3.39it/s]
 78%|███████▊  | 289315/371472 [51:17<6:35:41,  3.46it/s]
 78%|███████▊  | 289316/371472 [51:17<6:18:50,  3.61it/s]
 78%|███████▊  | 289317/371472 [51:18<6:13:37,  3.66it/s]
 78%|███████▊  | 289318/371472 [51:18<6:13:26,  3.67it/s]
 78%|███████▊  | 289319/371472 [51:18<6:04:18,  3.76it/s]
 78%|███████▊  | 289320/371472 [51:19<6:22:07,  3.58it/s]
                                                         
{'loss': 2.6201, 'learning_rate': 2.9914456247710576e-07, 'epoch': 12.46}

 78%|███████▊  | 289320/371472 [51:19<6:22:07,  3.58it/s]
 78%|███████▊  | 289321/371472 [51:19<6:11:21,  3.69it/s]
 78%|███████▊  | 289322/371472 [51:19<6:04:47,  3.75it/s]
 78%|███████▊  | 289323/371472 [51:19<6:05:19,  3.75it/s]
 78%|███████▊  | 289324/371472 [51:20<6:12:13,  3.68it/s]
 78%|███████▊  | 289325/371472 [51:20<6:06:51,  3.73it/s]
 78%|███████▊  | 289326/371472 [51:20<6:10:21,  3.70it/s]
 78%|███████▊  | 289327/371472 [51:20<6:17:50,  3.62it/s]
 78%|███████▊  | 289328/371472 [51:21<6:16:21,  3.64it/s]
 78%|███████▊  | 289329/371472 [51:21<6:01:20,  3.79it/s]
 78%|███████▊  | 289330/371472 [51:21<5:58:13,  3.82it/s]
 78%|███████▊  | 289331/371472 [51:21<6:03:00,  3.77it/s]
 78%|███████▊  | 289332/371472 [51:22<6:11:59,  3.68it/s]
 78%|███████▊  | 289333/371472 [51:22<6:14:08,  3.66it/s]
 78%|███████▊  | 289334/371472 [51:22<6:36:07,  3.46it/s]
 78%|███████▊  | 289335/371472 [51:23<6:31:04,  3.50it/s]
 78%|███████▊  | 289336/371472 [51:23<6:45:03,  3.38it/s]
 78%|███████▊  | 289337/371472 [51:23<6:36:17,  3.45it/s]
 78%|███████▊  | 289338/371472 [51:24<6:37:22,  3.44it/s]
 78%|███████▊  | 289339/371472 [51:24<6:22:39,  3.58it/s]
 78%|███████▊  | 289340/371472 [51:24<6:12:51,  3.67it/s]
                                                         
{'loss': 2.6816, 'learning_rate': 2.990960805016268e-07, 'epoch': 12.46}

 78%|███████▊  | 289340/371472 [51:24<6:12:51,  3.67it/s]
 78%|███████▊  | 289341/371472 [51:24<6:15:56,  3.64it/s]
 78%|███████▊  | 289342/371472 [51:25<6:22:26,  3.58it/s]
 78%|███████▊  | 289343/371472 [51:25<6:11:01,  3.69it/s]
 78%|███████▊  | 289344/371472 [51:25<6:22:22,  3.58it/s]
 78%|███████▊  | 289345/371472 [51:26<7:02:13,  3.24it/s]
 78%|███████▊  | 289346/371472 [51:26<7:20:43,  3.11it/s]
 78%|███████▊  | 289347/371472 [51:26<7:01:58,  3.24it/s]
 78%|███████▊  | 289348/371472 [51:26<6:38:59,  3.43it/s]
 78%|███████▊  | 289349/371472 [51:27<6:29:00,  3.52it/s]
 78%|███████▊  | 289350/371472 [51:27<6:24:59,  3.56it/s]
 78%|███████▊  | 289351/371472 [51:27<6:50:34,  3.33it/s]
 78%|███████▊  | 289352/371472 [51:28<6:32:43,  3.49it/s]
 78%|███████▊  | 289353/371472 [51:28<7:11:46,  3.17it/s]
 78%|███████▊  | 289354/371472 [51:28<6:51:59,  3.32it/s]
 78%|███████▊  | 289355/371472 [51:29<7:00:45,  3.25it/s]
 78%|███████▊  | 289356/371472 [51:29<6:36:55,  3.45it/s]
 78%|███████▊  | 289357/371472 [51:29<6:23:21,  3.57it/s]
 78%|███████▊  | 289358/371472 [51:29<6:21:50,  3.58it/s]
 78%|███████▊  | 289359/371472 [51:30<6:19:51,  3.60it/s]
 78%|███████▊  | 289360/371472 [51:30<6:43:04,  3.40it/s]
                                                         
{'loss': 2.7573, 'learning_rate': 2.9904759852614795e-07, 'epoch': 12.46}

 78%|███████▊  | 289360/371472 [51:30<6:43:04,  3.40it/s]
 78%|███████▊  | 289361/371472 [51:30<7:17:22,  3.13it/s]
 78%|███████▊  | 289362/371472 [51:31<6:57:35,  3.28it/s]
 78%|███████▊  | 289363/371472 [51:31<6:50:47,  3.33it/s]
 78%|███████▊  | 289364/371472 [51:31<6:35:37,  3.46it/s]
 78%|███████▊  | 289365/371472 [51:31<6:31:52,  3.49it/s]
 78%|███████▊  | 289366/371472 [51:32<6:30:34,  3.50it/s]
 78%|███████▊  | 289367/371472 [51:32<6:22:21,  3.58it/s]
 78%|███████▊  | 289368/371472 [51:32<6:15:16,  3.65it/s]
 78%|███████▊  | 289369/371472 [51:32<6:15:17,  3.65it/s]
 78%|███████▊  | 289370/371472 [51:33<6:54:16,  3.30it/s]
 78%|███████▊  | 289371/371472 [51:33<6:35:41,  3.46it/s]
 78%|███████▊  | 289372/371472 [51:33<6:51:31,  3.33it/s]
 78%|███████▊  | 289373/371472 [51:34<6:33:42,  3.48it/s]
 78%|███████▊  | 289374/371472 [51:34<6:18:30,  3.62it/s]
 78%|███████▊  | 289375/371472 [51:34<6:32:44,  3.48it/s]
 78%|███████▊  | 289376/371472 [51:35<6:57:22,  3.28it/s]
 78%|███████▊  | 289377/371472 [51:35<6:44:01,  3.39it/s]
 78%|███████▊  | 289378/371472 [51:35<6:35:40,  3.46it/s]
 78%|███████▊  | 289379/371472 [51:35<6:37:17,  3.44it/s]
 78%|███████▊  | 289380/371472 [51:36<6:28:07,  3.53it/s]
                                                         
{'loss': 2.6741, 'learning_rate': 2.98999116550669e-07, 'epoch': 12.46}

 78%|███████▊  | 289380/371472 [51:36<6:28:07,  3.53it/s]
 78%|███████▊  | 289381/371472 [51:36<6:30:45,  3.50it/s]
 78%|███████▊  | 289382/371472 [51:36<6:48:00,  3.35it/s]
 78%|███████▊  | 289383/371472 [51:37<6:40:20,  3.42it/s]
 78%|███████▊  | 289384/371472 [51:37<6:44:50,  3.38it/s]
 78%|███████▊  | 289385/371472 [51:37<6:40:24,  3.42it/s]
 78%|███████▊  | 289386/371472 [51:37<6:35:06,  3.46it/s]
 78%|███████▊  | 289387/371472 [51:38<6:24:53,  3.55it/s]
 78%|███████▊  | 289388/371472 [51:38<6:59:40,  3.26it/s]
 78%|███████▊  | 289389/371472 [51:38<6:42:59,  3.39it/s]
 78%|███████▊  | 289390/371472 [51:39<6:41:42,  3.41it/s]
 78%|███████▊  | 289391/371472 [51:39<6:30:08,  3.51it/s]
 78%|███████▊  | 289392/371472 [51:39<6:43:07,  3.39it/s]
 78%|███████▊  | 289393/371472 [51:40<6:46:37,  3.36it/s]
 78%|███████▊  | 289394/371472 [51:40<6:37:59,  3.44it/s]
 78%|███████▊  | 289395/371472 [51:40<6:35:40,  3.46it/s]
 78%|███████▊  | 289396/371472 [51:40<6:24:39,  3.56it/s]
 78%|███████▊  | 289397/371472 [51:41<6:27:29,  3.53it/s]
 78%|███████▊  | 289398/371472 [51:41<6:23:47,  3.56it/s]
 78%|███████▊  | 289399/371472 [51:41<6:24:36,  3.56it/s]
 78%|███████▊  | 289400/371472 [51:42<6:35:06,  3.46it/s]
                                                         
{'loss': 2.6681, 'learning_rate': 2.989506345751902e-07, 'epoch': 12.47}

 78%|███████▊  | 289400/371472 [51:42<6:35:06,  3.46it/s]
 78%|███████▊  | 289401/371472 [51:42<6:53:47,  3.31it/s]
 78%|███████▊  | 289402/371472 [51:42<6:30:58,  3.50it/s]
 78%|███████▊  | 289403/371472 [51:42<6:19:00,  3.61it/s]
 78%|███████▊  | 289404/371472 [51:43<6:13:18,  3.66it/s]
 78%|███████▊  | 289405/371472 [51:43<6:09:53,  3.70it/s]
 78%|███████▊  | 289406/371472 [51:43<6:23:58,  3.56it/s]
 78%|███████▊  | 289407/371472 [51:43<6:25:03,  3.55it/s]
 78%|███████▊  | 289408/371472 [51:44<6:20:11,  3.60it/s]
 78%|███████▊  | 289409/371472 [51:44<6:04:30,  3.75it/s]
 78%|███████▊  | 289410/371472 [51:44<6:08:40,  3.71it/s]
 78%|███████▊  | 289411/371472 [51:45<6:09:36,  3.70it/s]
 78%|███████▊  | 289412/371472 [51:45<6:14:16,  3.65it/s]
 78%|███████▊  | 289413/371472 [51:45<6:50:44,  3.33it/s]
 78%|███████▊  | 289414/371472 [51:45<6:42:14,  3.40it/s]
 78%|███████▊  | 289415/371472 [51:46<6:30:22,  3.50it/s]
 78%|███████▊  | 289416/371472 [51:46<6:49:13,  3.34it/s]
 78%|███████▊  | 289417/371472 [51:46<6:54:53,  3.30it/s]
 78%|███████▊  | 289418/371472 [51:47<6:52:19,  3.32it/s]
 78%|███████▊  | 289419/371472 [51:47<6:49:00,  3.34it/s]
 78%|███████▊  | 289420/371472 [51:47<6:38:01,  3.44it/s]
                                                         
{'loss': 2.6111, 'learning_rate': 2.989021525997113e-07, 'epoch': 12.47}

 78%|███████▊  | 289420/371472 [51:47<6:38:01,  3.44it/s]
 78%|███████▊  | 289421/371472 [51:48<6:44:54,  3.38it/s]
 78%|███████▊  | 289422/371472 [51:48<6:27:48,  3.53it/s]
 78%|███████▊  | 289423/371472 [51:48<6:38:59,  3.43it/s]
 78%|███████▊  | 289424/371472 [51:48<6:31:32,  3.49it/s]
 78%|███████▊  | 289425/371472 [51:49<6:24:27,  3.56it/s]
 78%|███████▊  | 289426/371472 [51:49<6:38:36,  3.43it/s]
 78%|███████▊  | 289427/371472 [51:49<6:39:10,  3.43it/s]
 78%|███████▊  | 289428/371472 [51:50<6:40:40,  3.41it/s]
 78%|███████▊  | 289429/371472 [51:50<6:25:18,  3.55it/s]
 78%|███████▊  | 289430/371472 [51:50<6:36:07,  3.45it/s]
 78%|███████▊  | 289431/371472 [51:50<6:31:56,  3.49it/s]
 78%|███████▊  | 289432/371472 [51:51<6:42:14,  3.40it/s]
 78%|███████▊  | 289433/371472 [51:51<6:37:04,  3.44it/s]
 78%|███████▊  | 289434/371472 [51:51<6:48:50,  3.34it/s]
 78%|███████▊  | 289435/371472 [51:52<7:00:23,  3.25it/s]
 78%|███████▊  | 289436/371472 [51:52<6:36:36,  3.45it/s]
 78%|███████▊  | 289437/371472 [51:52<6:39:31,  3.42it/s]
 78%|███████▊  | 289438/371472 [51:52<6:28:42,  3.52it/s]
 78%|███████▊  | 289439/371472 [51:53<6:27:55,  3.52it/s]
 78%|███████▊  | 289440/371472 [51:53<6:37:07,  3.44it/s]
                                                         
{'loss': 2.6715, 'learning_rate': 2.988536706242324e-07, 'epoch': 12.47}

 78%|███████▊  | 289440/371472 [51:53<6:37:07,  3.44it/s]
 78%|███████▊  | 289441/371472 [51:53<6:41:29,  3.41it/s]
 78%|███████▊  | 289442/371472 [51:54<6:39:41,  3.42it/s]
 78%|███████▊  | 289443/371472 [51:54<6:44:24,  3.38it/s]
 78%|███████▊  | 289444/371472 [51:54<6:30:51,  3.50it/s]
 78%|███████▊  | 289445/371472 [51:54<6:29:01,  3.51it/s]
 78%|███████▊  | 289446/371472 [51:55<6:34:37,  3.46it/s]
 78%|███████▊  | 289447/371472 [51:55<6:40:12,  3.42it/s]
 78%|███████▊  | 289448/371472 [51:55<6:42:09,  3.40it/s]
 78%|███████▊  | 289449/371472 [51:56<7:04:30,  3.22it/s]
 78%|███████▊  | 289450/371472 [51:56<7:09:25,  3.18it/s]
 78%|███████▊  | 289451/371472 [51:56<7:17:00,  3.13it/s]
 78%|███████▊  | 289452/371472 [51:57<6:52:10,  3.32it/s]
 78%|███████▊  | 289453/371472 [51:57<6:38:24,  3.43it/s]
 78%|███████▊  | 289454/371472 [51:57<6:31:53,  3.49it/s]
 78%|███████▊  | 289455/371472 [51:57<6:32:16,  3.48it/s]
 78%|███████▊  | 289456/371472 [51:58<6:23:44,  3.56it/s]
 78%|███████▊  | 289457/371472 [51:58<6:24:56,  3.55it/s]
 78%|███████▊  | 289458/371472 [51:58<6:16:54,  3.63it/s]
 78%|███████▊  | 289459/371472 [51:59<6:16:45,  3.63it/s]
 78%|███████▊  | 289460/371472 [51:59<6:26:10,  3.54it/s]
                                                         
{'loss': 2.583, 'learning_rate': 2.9880518864875347e-07, 'epoch': 12.47}

 78%|███████▊  | 289460/371472 [51:59<6:26:10,  3.54it/s]
 78%|███████▊  | 289461/371472 [51:59<6:28:52,  3.51it/s]
 78%|███████▊  | 289462/371472 [51:59<6:49:33,  3.34it/s]
 78%|███████▊  | 289463/371472 [52:00<6:29:42,  3.51it/s]
 78%|███████▊  | 289464/371472 [52:00<6:36:48,  3.44it/s]
 78%|███████▊  | 289465/371472 [52:00<6:16:38,  3.63it/s]
 78%|███████▊  | 289466/371472 [52:01<6:33:08,  3.48it/s]
 78%|███████▊  | 289467/371472 [52:01<6:32:08,  3.49it/s]
 78%|███████▊  | 289468/371472 [52:01<6:36:43,  3.44it/s]
 78%|███████▊  | 289469/371472 [52:01<6:47:50,  3.35it/s]
 78%|███████▊  | 289470/371472 [52:02<6:30:30,  3.50it/s]
 78%|███████▊  | 289471/371472 [52:02<6:40:02,  3.42it/s]
 78%|███████▊  | 289472/371472 [52:02<6:30:22,  3.50it/s]
 78%|███████▊  | 289473/371472 [52:03<6:32:32,  3.48it/s]
 78%|███████▊  | 289474/371472 [52:03<6:27:14,  3.53it/s]
 78%|███████▊  | 289475/371472 [52:03<6:25:23,  3.55it/s]
 78%|███████▊  | 289476/371472 [52:03<6:22:35,  3.57it/s]
 78%|███████▊  | 289477/371472 [52:04<6:29:08,  3.51it/s]
 78%|███████▊  | 289478/371472 [52:04<6:42:24,  3.40it/s]
 78%|███████▊  | 289479/371472 [52:04<6:31:03,  3.49it/s]
 78%|███████▊  | 289480/371472 [52:05<6:21:55,  3.58it/s]
                                                         
{'loss': 2.7964, 'learning_rate': 2.987567066732746e-07, 'epoch': 12.47}

 78%|███████▊  | 289480/371472 [52:05<6:21:55,  3.58it/s]
 78%|███████▊  | 289481/371472 [52:05<6:41:41,  3.40it/s]
 78%|███████▊  | 289482/371472 [52:05<7:00:39,  3.25it/s]
 78%|███████▊  | 289483/371472 [52:06<6:43:44,  3.38it/s]
 78%|███████▊  | 289484/371472 [52:06<6:38:16,  3.43it/s]
 78%|███████▊  | 289485/371472 [52:06<6:31:37,  3.49it/s]
 78%|███████▊  | 289486/371472 [52:06<6:16:24,  3.63it/s]
 78%|███████▊  | 289487/371472 [52:07<6:18:30,  3.61it/s]
 78%|███████▊  | 289488/371472 [52:07<6:29:44,  3.51it/s]
 78%|███████▊  | 289489/371472 [52:07<6:15:14,  3.64it/s]
 78%|███████▊  | 289490/371472 [52:07<6:10:47,  3.69it/s]
 78%|███████▊  | 289491/371472 [52:08<6:04:28,  3.75it/s]
 78%|███████▊  | 289492/371472 [52:08<6:11:05,  3.68it/s]
 78%|███████▊  | 289493/371472 [52:08<6:33:00,  3.48it/s]
 78%|███████▊  | 289494/371472 [52:09<6:36:21,  3.45it/s]
 78%|███████▊  | 289495/371472 [52:09<6:14:59,  3.64it/s]
 78%|███████▊  | 289496/371472 [52:09<6:23:10,  3.57it/s]
 78%|███████▊  | 289497/371472 [52:09<6:13:58,  3.65it/s]
 78%|███████▊  | 289498/371472 [52:10<6:12:28,  3.67it/s]
 78%|███████▊  | 289499/371472 [52:10<6:10:01,  3.69it/s]
 78%|███████▊  | 289500/371472 [52:10<6:14:18,  3.65it/s]
                                                         
{'loss': 2.762, 'learning_rate': 2.9870822469779566e-07, 'epoch': 12.47}

 78%|███████▊  | 289500/371472 [52:10<6:14:18,  3.65it/s]
 78%|███████▊  | 289501/371472 [52:10<6:09:56,  3.69it/s]
 78%|███████▊  | 289502/371472 [52:11<6:17:02,  3.62it/s]
 78%|███████▊  | 289503/371472 [52:11<6:39:14,  3.42it/s]
 78%|███████▊  | 289504/371472 [52:11<6:30:50,  3.50it/s]
 78%|███████▊  | 289505/371472 [52:12<6:36:44,  3.44it/s]
 78%|███████▊  | 289506/371472 [52:12<6:36:29,  3.45it/s]
 78%|███████▊  | 289507/371472 [52:12<6:29:28,  3.51it/s]
 78%|███████▊  | 289508/371472 [52:13<6:46:52,  3.36it/s]
 78%|███████▊  | 289509/371472 [52:13<6:57:23,  3.27it/s]
 78%|███████▊  | 289510/371472 [52:13<6:38:37,  3.43it/s]
 78%|███████▊  | 289511/371472 [52:13<6:28:48,  3.51it/s]
 78%|███████▊  | 289512/371472 [52:14<7:06:14,  3.20it/s]
 78%|███████▊  | 289513/371472 [52:14<6:49:46,  3.33it/s]
 78%|███████▊  | 289514/371472 [52:14<6:32:54,  3.48it/s]
 78%|███████▊  | 289515/371472 [52:15<6:27:08,  3.53it/s]
 78%|███████▊  | 289516/371472 [52:15<6:12:09,  3.67it/s]
 78%|███████▊  | 289517/371472 [52:15<5:59:38,  3.80it/s]
 78%|███████▊  | 289518/371472 [52:15<6:21:43,  3.58it/s]
 78%|███████▊  | 289519/371472 [52:16<6:39:45,  3.42it/s]
 78%|███████▊  | 289520/371472 [52:16<6:22:44,  3.57it/s]
                                                         
{'loss': 2.66, 'learning_rate': 2.9865974272231674e-07, 'epoch': 12.47}

 78%|███████▊  | 289520/371472 [52:16<6:22:44,  3.57it/s]
 78%|███████▊  | 289521/371472 [52:16<6:22:18,  3.57it/s]
 78%|███████▊  | 289522/371472 [52:17<7:01:57,  3.24it/s]
 78%|███████▊  | 289523/371472 [52:17<7:09:16,  3.18it/s]
 78%|███████▊  | 289524/371472 [52:17<6:47:49,  3.35it/s]
 78%|███████▊  | 289525/371472 [52:17<6:48:59,  3.34it/s]
 78%|███████▊  | 289526/371472 [52:18<7:09:33,  3.18it/s]
 78%|███████▊  | 289527/371472 [52:18<7:30:29,  3.03it/s]
 78%|███████▊  | 289528/371472 [52:18<7:11:13,  3.17it/s]
 78%|███████▊  | 289529/371472 [52:19<7:00:24,  3.25it/s]
 78%|███████▊  | 289530/371472 [52:19<7:05:21,  3.21it/s]
 78%|███████▊  | 289531/371472 [52:19<6:43:15,  3.39it/s]
 78%|███████▊  | 289532/371472 [52:20<6:38:18,  3.43it/s]
 78%|███████▊  | 289533/371472 [52:20<6:27:42,  3.52it/s]
 78%|███████▊  | 289534/371472 [52:20<6:19:56,  3.59it/s]
 78%|███████▊  | 289535/371472 [52:20<6:03:09,  3.76it/s]
 78%|███████▊  | 289536/371472 [52:21<6:07:37,  3.71it/s]
 78%|███████▊  | 289537/371472 [52:21<6:03:55,  3.75it/s]
 78%|███████▊  | 289538/371472 [52:21<7:04:59,  3.21it/s]
 78%|███████▊  | 289539/371472 [52:22<7:11:19,  3.17it/s]
 78%|███████▊  | 289540/371472 [52:22<6:47:56,  3.35it/s]
                                                         
{'loss': 2.5871, 'learning_rate': 2.986112607468379e-07, 'epoch': 12.47}

 78%|███████▊  | 289540/371472 [52:22<6:47:56,  3.35it/s]
 78%|███████▊  | 289541/371472 [52:22<6:27:01,  3.53it/s]
 78%|███████▊  | 289542/371472 [52:22<6:27:24,  3.52it/s]
 78%|███████▊  | 289543/371472 [52:23<6:20:54,  3.58it/s]
 78%|███████▊  | 289544/371472 [52:23<6:17:04,  3.62it/s]
 78%|███████▊  | 289545/371472 [52:23<6:31:53,  3.48it/s]
 78%|███████▊  | 289546/371472 [52:24<6:27:00,  3.53it/s]
 78%|███████▊  | 289547/371472 [52:24<6:30:38,  3.50it/s]
 78%|███████▊  | 289548/371472 [52:24<6:54:24,  3.29it/s]
 78%|███████▊  | 289549/371472 [52:25<6:51:32,  3.32it/s]
 78%|███████▊  | 289550/371472 [52:25<6:33:49,  3.47it/s]
 78%|███████▊  | 289551/371472 [52:25<6:48:55,  3.34it/s]
 78%|███████▊  | 289552/371472 [52:25<6:42:47,  3.39it/s]
 78%|███████▊  | 289553/371472 [52:26<6:51:18,  3.32it/s]
 78%|███████▊  | 289554/371472 [52:26<6:45:39,  3.37it/s]
 78%|███████▊  | 289555/371472 [52:26<6:38:24,  3.43it/s]
 78%|███████▊  | 289556/371472 [52:27<6:40:26,  3.41it/s]
 78%|███████▊  | 289557/371472 [52:27<6:21:19,  3.58it/s]
 78%|███████▊  | 289558/371472 [52:27<6:14:19,  3.65it/s]
 78%|███████▊  | 289559/371472 [52:27<6:08:14,  3.71it/s]
 78%|███████▊  | 289560/371472 [52:28<6:36:19,  3.44it/s]
                                                         
{'loss': 2.5938, 'learning_rate': 2.98562778771359e-07, 'epoch': 12.47}

 78%|███████▊  | 289560/371472 [52:28<6:36:19,  3.44it/s]
 78%|███████▊  | 289561/371472 [52:28<6:27:05,  3.53it/s]
 78%|███████▊  | 289562/371472 [52:28<6:18:35,  3.61it/s]
 78%|███████▊  | 289563/371472 [52:29<6:30:37,  3.49it/s]
 78%|███████▊  | 289564/371472 [52:29<6:25:10,  3.54it/s]
 78%|███████▊  | 289565/371472 [52:29<6:18:12,  3.61it/s]
 78%|███████▊  | 289566/371472 [52:29<6:14:12,  3.65it/s]
 78%|███████▊  | 289567/371472 [52:30<6:10:33,  3.68it/s]
 78%|███████▊  | 289568/371472 [52:30<6:06:05,  3.73it/s]
 78%|███████▊  | 289569/371472 [52:30<6:06:28,  3.72it/s]
 78%|███████▊  | 289570/371472 [52:30<6:11:16,  3.68it/s]
 78%|███████▊  | 289571/371472 [52:31<6:49:05,  3.34it/s]
 78%|███████▊  | 289572/371472 [52:31<6:33:35,  3.47it/s]
 78%|███████▊  | 289573/371472 [52:31<7:03:12,  3.23it/s]
 78%|███████▊  | 289574/371472 [52:32<6:58:58,  3.26it/s]
 78%|███████▊  | 289575/371472 [52:32<6:54:58,  3.29it/s]
 78%|███████▊  | 289576/371472 [52:32<6:46:19,  3.36it/s]
 78%|███████▊  | 289577/371472 [52:33<6:56:42,  3.28it/s]
 78%|███████▊  | 289578/371472 [52:33<6:50:08,  3.33it/s]
 78%|███████▊  | 289579/371472 [52:33<6:32:43,  3.48it/s]
 78%|███████▊  | 289580/371472 [52:33<6:29:55,  3.50it/s]
                                                         
{'loss': 2.6893, 'learning_rate': 2.985142967958801e-07, 'epoch': 12.47}

 78%|███████▊  | 289580/371472 [52:33<6:29:55,  3.50it/s]
 78%|███████▊  | 289581/371472 [52:34<6:17:11,  3.62it/s]
 78%|███████▊  | 289582/371472 [52:34<6:30:10,  3.50it/s]
 78%|███████▊  | 289583/371472 [52:34<6:30:18,  3.50it/s]
 78%|███████▊  | 289584/371472 [52:35<6:18:10,  3.61it/s]
 78%|███████▊  | 289585/371472 [52:35<6:07:50,  3.71it/s]
 78%|███████▊  | 289586/371472 [52:35<6:16:33,  3.62it/s]
 78%|███████▊  | 289587/371472 [52:35<6:31:55,  3.48it/s]
 78%|███████▊  | 289588/371472 [52:36<6:08:59,  3.70it/s]
 78%|███████▊  | 289589/371472 [52:36<6:31:13,  3.49it/s]
 78%|███████▊  | 289590/371472 [52:36<6:35:16,  3.45it/s]
 78%|███████▊  | 289591/371472 [52:37<6:28:38,  3.51it/s]
 78%|███████▊  | 289592/371472 [52:37<6:38:45,  3.42it/s]
 78%|███████▊  | 289593/371472 [52:37<6:28:29,  3.51it/s]
 78%|███████▊  | 289594/371472 [52:37<6:26:39,  3.53it/s]
 78%|███████▊  | 289595/371472 [52:38<6:15:36,  3.63it/s]
 78%|███████▊  | 289596/371472 [52:38<6:11:49,  3.67it/s]
 78%|███████▊  | 289597/371472 [52:38<6:25:28,  3.54it/s]
 78%|███████▊  | 289598/371472 [52:39<6:50:21,  3.33it/s]
 78%|███████▊  | 289599/371472 [52:39<6:44:14,  3.38it/s]
 78%|███████▊  | 289600/371472 [52:39<6:34:23,  3.46it/s]
                                                         
{'loss': 2.7183, 'learning_rate': 2.9846581482040113e-07, 'epoch': 12.47}

 78%|███████▊  | 289600/371472 [52:39<6:34:23,  3.46it/s]
 78%|███████▊  | 289601/371472 [52:39<6:28:19,  3.51it/s]
 78%|███████▊  | 289602/371472 [52:40<6:26:40,  3.53it/s]
 78%|███████▊  | 289603/371472 [52:40<6:52:45,  3.31it/s]
 78%|███████▊  | 289604/371472 [52:40<6:49:26,  3.33it/s]
 78%|███████▊  | 289605/371472 [52:41<6:28:45,  3.51it/s]
 78%|███████▊  | 289606/371472 [52:41<6:57:48,  3.27it/s]
 78%|███████▊  | 289607/371472 [52:41<6:34:28,  3.46it/s]
 78%|███████▊  | 289608/371472 [52:41<6:21:05,  3.58it/s]
 78%|███████▊  | 289609/371472 [52:42<6:16:03,  3.63it/s]
 78%|███████▊  | 289610/371472 [52:42<6:06:54,  3.72it/s]
 78%|███████▊  | 289611/371472 [52:42<6:00:21,  3.79it/s]
 78%|███████▊  | 289612/371472 [52:42<6:11:48,  3.67it/s]
 78%|███████▊  | 289613/371472 [52:43<6:08:19,  3.70it/s]
 78%|███████▊  | 289614/371472 [52:43<5:57:30,  3.82it/s]
 78%|███████▊  | 289615/371472 [52:43<5:51:32,  3.88it/s]
 78%|███████▊  | 289616/371472 [52:43<5:51:17,  3.88it/s]
 78%|███████▊  | 289617/371472 [52:44<6:13:19,  3.65it/s]
 78%|███████▊  | 289618/371472 [52:44<6:37:52,  3.43it/s]
 78%|███████▊  | 289619/371472 [52:44<6:21:29,  3.58it/s]
 78%|███████▊  | 289620/371472 [52:45<6:07:16,  3.71it/s]
                                                         
{'loss': 2.702, 'learning_rate': 2.984173328449223e-07, 'epoch': 12.47}

 78%|███████▊  | 289620/371472 [52:45<6:07:16,  3.71it/s]
 78%|███████▊  | 289621/371472 [52:45<6:34:16,  3.46it/s]
 78%|███████▊  | 289622/371472 [52:45<6:33:27,  3.47it/s]
 78%|███████▊  | 289623/371472 [52:46<6:28:03,  3.52it/s]
 78%|███████▊  | 289624/371472 [52:46<6:12:57,  3.66it/s]
 78%|███████▊  | 289625/371472 [52:46<6:00:56,  3.78it/s]
 78%|███████▊  | 289626/371472 [52:46<6:08:07,  3.71it/s]
 78%|███████▊  | 289627/371472 [52:47<6:33:28,  3.47it/s]
 78%|███████▊  | 289628/371472 [52:47<6:27:48,  3.52it/s]
 78%|███████▊  | 289629/371472 [52:47<6:37:46,  3.43it/s]
 78%|███████▊  | 289630/371472 [52:47<6:20:47,  3.58it/s]
 78%|███████▊  | 289631/371472 [52:48<6:18:59,  3.60it/s]
 78%|███████▊  | 289632/371472 [52:48<6:34:46,  3.46it/s]
 78%|███████▊  | 289633/371472 [52:48<6:49:21,  3.33it/s]
 78%|███████▊  | 289634/371472 [52:49<6:31:58,  3.48it/s]
 78%|███████▊  | 289635/371472 [52:49<6:28:08,  3.51it/s]
 78%|███████▊  | 289636/371472 [52:49<6:24:54,  3.54it/s]
 78%|███████▊  | 289637/371472 [52:50<6:37:43,  3.43it/s]
 78%|███████▊  | 289638/371472 [52:50<6:31:14,  3.49it/s]
 78%|███████▊  | 289639/371472 [52:50<6:25:01,  3.54it/s]
 78%|███████▊  | 289640/371472 [52:50<6:08:02,  3.71it/s]
                                                         
{'loss': 2.5105, 'learning_rate': 2.983688508694434e-07, 'epoch': 12.48}

 78%|███████▊  | 289640/371472 [52:50<6:08:02,  3.71it/s]
 78%|███████▊  | 289641/371472 [52:51<6:01:20,  3.77it/s]
 78%|███████▊  | 289642/371472 [52:51<5:59:58,  3.79it/s]
 78%|███████▊  | 289643/371472 [52:51<5:57:41,  3.81it/s]
 78%|███████▊  | 289644/371472 [52:51<5:56:57,  3.82it/s]
 78%|███████▊  | 289645/371472 [52:52<5:52:21,  3.87it/s]
 78%|███████▊  | 289646/371472 [52:52<6:04:24,  3.74it/s]
 78%|███████▊  | 289647/371472 [52:52<6:02:21,  3.76it/s]
 78%|███████▊  | 289648/371472 [52:52<6:19:35,  3.59it/s]
 78%|███████▊  | 289649/371472 [52:53<6:04:00,  3.75it/s]
 78%|███████▊  | 289650/371472 [52:53<6:40:35,  3.40it/s]
 78%|███████▊  | 289651/371472 [52:53<6:32:21,  3.48it/s]
 78%|███████▊  | 289652/371472 [52:54<6:37:33,  3.43it/s]
 78%|███████▊  | 289653/371472 [52:54<6:21:28,  3.57it/s]
 78%|███████▊  | 289654/371472 [52:54<6:12:54,  3.66it/s]
 78%|███████▊  | 289655/371472 [52:54<6:17:02,  3.62it/s]
 78%|███████▊  | 289656/371472 [52:55<6:49:29,  3.33it/s]
 78%|███████▊  | 289657/371472 [52:55<6:30:42,  3.49it/s]
 78%|███████▊  | 289658/371472 [52:55<6:26:59,  3.52it/s]
 78%|███████▊  | 289659/371472 [52:56<6:22:10,  3.57it/s]
 78%|███████▊  | 289660/371472 [52:56<6:35:22,  3.45it/s]
                                                         
{'loss': 2.7753, 'learning_rate': 2.9832036889396455e-07, 'epoch': 12.48}

 78%|███████▊  | 289660/371472 [52:56<6:35:22,  3.45it/s]
 78%|███████▊  | 289661/371472 [52:56<6:38:23,  3.42it/s]
 78%|███████▊  | 289662/371472 [52:57<7:01:41,  3.23it/s]
 78%|███████▊  | 289663/371472 [52:57<7:18:15,  3.11it/s]
 78%|███████▊  | 289664/371472 [52:57<7:03:47,  3.22it/s]
 78%|███████▊  | 289665/371472 [52:57<6:49:20,  3.33it/s]
 78%|███████▊  | 289666/371472 [52:58<6:38:25,  3.42it/s]
 78%|███████▊  | 289667/371472 [52:58<6:36:23,  3.44it/s]
 78%|███████▊  | 289668/371472 [52:58<6:33:12,  3.47it/s]
 78%|███████▊  | 289669/371472 [52:59<6:41:41,  3.39it/s]
 78%|███████▊  | 289670/371472 [52:59<7:00:47,  3.24it/s]
 78%|███████▊  | 289671/371472 [52:59<6:51:30,  3.31it/s]
 78%|███████▊  | 289672/371472 [52:59<6:22:39,  3.56it/s]
 78%|███████▊  | 289673/371472 [53:00<6:42:36,  3.39it/s]
 78%|███████▊  | 289674/371472 [53:00<6:17:12,  3.61it/s]
 78%|███████▊  | 289675/371472 [53:00<6:51:20,  3.31it/s]
 78%|███████▊  | 289676/371472 [53:01<7:12:25,  3.15it/s]
 78%|███████▊  | 289677/371472 [53:01<6:59:09,  3.25it/s]
 78%|███████▊  | 289678/371472 [53:01<6:46:36,  3.35it/s]
 78%|███████▊  | 289679/371472 [53:02<6:57:38,  3.26it/s]
 78%|███████▊  | 289680/371472 [53:02<7:17:25,  3.12it/s]
                                                         
{'loss': 2.6572, 'learning_rate': 2.982718869184856e-07, 'epoch': 12.48}

 78%|███████▊  | 289680/371472 [53:02<7:17:25,  3.12it/s]
 78%|███████▊  | 289681/371472 [53:02<6:58:17,  3.26it/s]
 78%|███████▊  | 289682/371472 [53:03<7:06:15,  3.20it/s]
 78%|███████▊  | 289683/371472 [53:03<6:38:02,  3.42it/s]
 78%|███████▊  | 289684/371472 [53:03<6:37:54,  3.43it/s]
 78%|███████▊  | 289685/371472 [53:03<6:24:28,  3.55it/s]
 78%|███████▊  | 289686/371472 [53:04<6:15:57,  3.63it/s]
 78%|███████▊  | 289687/371472 [53:04<6:34:09,  3.46it/s]
 78%|███████▊  | 289688/371472 [53:04<6:31:35,  3.48it/s]
 78%|███████▊  | 289689/371472 [53:05<6:51:47,  3.31it/s]
 78%|███████▊  | 289690/371472 [53:05<6:41:39,  3.39it/s]
 78%|███████▊  | 289691/371472 [53:05<7:12:14,  3.15it/s]
 78%|███████▊  | 289692/371472 [53:05<7:02:17,  3.23it/s]
 78%|███████▊  | 289693/371472 [53:06<6:37:14,  3.43it/s]
 78%|███████▊  | 289694/371472 [53:06<6:43:18,  3.38it/s]
 78%|███████▊  | 289695/371472 [53:06<6:22:24,  3.56it/s]
 78%|███████▊  | 289696/371472 [53:07<6:10:42,  3.68it/s]
 78%|███████▊  | 289697/371472 [53:07<6:09:42,  3.69it/s]
 78%|███████▊  | 289698/371472 [53:07<6:04:27,  3.74it/s]
 78%|███████▊  | 289699/371472 [53:07<6:03:58,  3.74it/s]
 78%|███████▊  | 289700/371472 [53:08<6:39:53,  3.41it/s]
                                                         
{'loss': 2.5335, 'learning_rate': 2.9822340494300675e-07, 'epoch': 12.48}

 78%|███████▊  | 289700/371472 [53:08<6:39:53,  3.41it/s]
 78%|███████▊  | 289701/371472 [53:08<6:30:22,  3.49it/s]
 78%|███████▊  | 289702/371472 [53:08<6:22:02,  3.57it/s]
 78%|███████▊  | 289703/371472 [53:08<6:13:09,  3.65it/s]
 78%|███████▊  | 289704/371472 [53:09<6:16:22,  3.62it/s]
 78%|███████▊  | 289705/371472 [53:09<6:07:27,  3.71it/s]
 78%|███████▊  | 289706/371472 [53:09<6:04:27,  3.74it/s]
 78%|███████▊  | 289707/371472 [53:10<6:13:34,  3.65it/s]
 78%|███████▊  | 289708/371472 [53:10<6:20:01,  3.59it/s]
 78%|███████▊  | 289709/371472 [53:10<6:11:40,  3.67it/s]
 78%|███████▊  | 289710/371472 [53:10<6:25:10,  3.54it/s]
 78%|███████▊  | 289711/371472 [53:11<6:41:04,  3.40it/s]
 78%|███████▊  | 289712/371472 [53:11<6:27:36,  3.52it/s]
 78%|███████▊  | 289713/371472 [53:11<6:15:31,  3.63it/s]
 78%|███████▊  | 289714/371472 [53:12<5:58:02,  3.81it/s]
 78%|███████▊  | 289715/371472 [53:12<5:50:47,  3.88it/s]
 78%|███████▊  | 289716/371472 [53:12<5:52:32,  3.87it/s]
 78%|███████▊  | 289717/371472 [53:12<6:08:00,  3.70it/s]
 78%|███████▊  | 289718/371472 [53:13<6:07:18,  3.71it/s]
 78%|███████▊  | 289719/371472 [53:13<6:12:11,  3.66it/s]
 78%|███████▊  | 289720/371472 [53:13<6:11:54,  3.66it/s]
                                                         
{'loss': 2.5776, 'learning_rate': 2.981749229675278e-07, 'epoch': 12.48}

 78%|███████▊  | 289720/371472 [53:13<6:11:54,  3.66it/s]
 78%|███████▊  | 289721/371472 [53:13<6:10:21,  3.68it/s]
 78%|███████▊  | 289722/371472 [53:14<6:33:14,  3.46it/s]
 78%|███████▊  | 289723/371472 [53:14<6:26:34,  3.52it/s]
 78%|███████▊  | 289724/371472 [53:14<6:18:31,  3.60it/s]
 78%|███████▊  | 289725/371472 [53:15<6:20:12,  3.58it/s]
 78%|███████▊  | 289726/371472 [53:15<6:37:44,  3.43it/s]
 78%|███████▊  | 289727/371472 [53:15<6:28:28,  3.51it/s]
 78%|███████▊  | 289728/371472 [53:15<6:17:41,  3.61it/s]
 78%|███████▊  | 289729/371472 [53:16<6:08:08,  3.70it/s]
 78%|███████▊  | 289730/371472 [53:16<6:07:32,  3.71it/s]
 78%|███████▊  | 289731/371472 [53:16<6:12:40,  3.66it/s]
 78%|███████▊  | 289732/371472 [53:17<6:35:57,  3.44it/s]
 78%|███████▊  | 289733/371472 [53:17<6:21:43,  3.57it/s]
 78%|███████▊  | 289734/371472 [53:17<6:07:03,  3.71it/s]
 78%|███████▊  | 289735/371472 [53:17<6:28:52,  3.50it/s]
 78%|███████▊  | 289736/371472 [53:18<6:15:52,  3.62it/s]
 78%|███████▊  | 289737/371472 [53:18<6:05:42,  3.73it/s]
 78%|███████▊  | 289738/371472 [53:18<5:56:39,  3.82it/s]
 78%|███████▊  | 289739/371472 [53:19<6:57:32,  3.26it/s]
 78%|███████▊  | 289740/371472 [53:19<6:41:36,  3.39it/s]
                                                         
{'loss': 2.7473, 'learning_rate': 2.9812644099204895e-07, 'epoch': 12.48}

 78%|███████▊  | 289740/371472 [53:19<6:41:36,  3.39it/s]
 78%|███████▊  | 289741/371472 [53:19<7:11:43,  3.16it/s]
 78%|███████▊  | 289742/371472 [53:20<8:07:06,  2.80it/s]
 78%|███████▊  | 289743/371472 [53:20<7:34:25,  3.00it/s]
 78%|███████▊  | 289744/371472 [53:20<7:02:51,  3.22it/s]
 78%|███████▊  | 289745/371472 [53:20<6:57:12,  3.26it/s]
 78%|███████▊  | 289746/371472 [53:21<6:41:22,  3.39it/s]
 78%|███████▊  | 289747/371472 [53:21<6:47:28,  3.34it/s]
 78%|███████▊  | 289748/371472 [53:21<6:53:14,  3.30it/s]
 78%|███████▊  | 289749/371472 [53:22<6:33:23,  3.46it/s]
 78%|███████▊  | 289750/371472 [53:22<6:39:34,  3.41it/s]
 78%|███████▊  | 289751/371472 [53:22<7:02:03,  3.23it/s]
 78%|███████▊  | 289752/371472 [53:22<6:43:13,  3.38it/s]
 78%|███████▊  | 289753/371472 [53:23<6:34:41,  3.45it/s]
 78%|███████▊  | 289754/371472 [53:23<6:44:20,  3.37it/s]
 78%|███████▊  | 289755/371472 [53:23<6:29:23,  3.50it/s]
 78%|███████▊  | 289756/371472 [53:24<6:13:07,  3.65it/s]
 78%|███████▊  | 289757/371472 [53:24<6:05:19,  3.73it/s]
 78%|███████▊  | 289758/371472 [53:24<5:56:05,  3.82it/s]
 78%|███████▊  | 289759/371472 [53:24<5:58:09,  3.80it/s]
 78%|███████▊  | 289760/371472 [53:25<6:14:48,  3.63it/s]
                                                         
{'loss': 2.6801, 'learning_rate': 2.9807795901657e-07, 'epoch': 12.48}

 78%|███████▊  | 289760/371472 [53:25<6:14:48,  3.63it/s]
 78%|███████▊  | 289761/371472 [53:25<6:03:18,  3.75it/s]
 78%|███████▊  | 289762/371472 [53:25<5:57:39,  3.81it/s]
 78%|███████▊  | 289763/371472 [53:25<5:57:38,  3.81it/s]
 78%|███████▊  | 289764/371472 [53:26<6:05:17,  3.73it/s]
 78%|███████▊  | 289765/371472 [53:26<6:04:17,  3.74it/s]
 78%|███████▊  | 289766/371472 [53:26<6:12:35,  3.65it/s]
 78%|███████▊  | 289767/371472 [53:27<6:14:46,  3.63it/s]
 78%|███████▊  | 289768/371472 [53:27<6:13:20,  3.65it/s]
 78%|███████▊  | 289769/371472 [53:27<6:13:02,  3.65it/s]
 78%|███████▊  | 289770/371472 [53:27<6:16:25,  3.62it/s]
 78%|███████▊  | 289771/371472 [53:28<6:13:56,  3.64it/s]
 78%|███████▊  | 289772/371472 [53:28<6:10:42,  3.67it/s]
 78%|███████▊  | 289773/371472 [53:28<6:01:04,  3.77it/s]
 78%|███████▊  | 289774/371472 [53:28<6:06:22,  3.72it/s]
 78%|███████▊  | 289775/371472 [53:29<6:10:47,  3.67it/s]
 78%|███████▊  | 289776/371472 [53:29<6:33:13,  3.46it/s]
 78%|███████▊  | 289777/371472 [53:29<6:17:02,  3.61it/s]
 78%|███████▊  | 289778/371472 [53:30<6:08:29,  3.69it/s]
 78%|███████▊  | 289779/371472 [53:30<6:02:46,  3.75it/s]
 78%|███████▊  | 289780/371472 [53:30<6:03:40,  3.74it/s]
                                                         
{'loss': 2.7145, 'learning_rate': 2.980294770410912e-07, 'epoch': 12.48}

 78%|███████▊  | 289780/371472 [53:30<6:03:40,  3.74it/s]
 78%|███████▊  | 289781/371472 [53:30<6:01:52,  3.76it/s]
 78%|███████▊  | 289782/371472 [53:31<6:15:25,  3.63it/s]
 78%|███████▊  | 289783/371472 [53:31<6:19:53,  3.58it/s]
 78%|███████▊  | 289784/371472 [53:31<6:29:14,  3.50it/s]
 78%|███████▊  | 289785/371472 [53:32<6:42:35,  3.38it/s]
 78%|███████▊  | 289786/371472 [53:32<6:34:28,  3.45it/s]
 78%|███████▊  | 289787/371472 [53:32<6:38:11,  3.42it/s]
 78%|███████▊  | 289788/371472 [53:32<6:23:59,  3.55it/s]
 78%|███████▊  | 289789/371472 [53:33<6:45:25,  3.36it/s]
 78%|███████▊  | 289790/371472 [53:33<7:01:37,  3.23it/s]
 78%|███████▊  | 289791/371472 [53:33<7:21:42,  3.08it/s]
 78%|███████▊  | 289792/371472 [53:34<6:56:15,  3.27it/s]
 78%|███████▊  | 289793/371472 [53:34<7:00:38,  3.24it/s]
 78%|███████▊  | 289794/371472 [53:34<6:47:57,  3.34it/s]
 78%|███████▊  | 289795/371472 [53:35<6:30:30,  3.49it/s]
 78%|███████▊  | 289796/371472 [53:35<6:47:35,  3.34it/s]
 78%|███████▊  | 289797/371472 [53:35<6:43:20,  3.37it/s]
 78%|███████▊  | 289798/371472 [53:35<7:02:24,  3.22it/s]
 78%|███████▊  | 289799/371472 [53:36<7:32:29,  3.01it/s]
 78%|███████▊  | 289800/371472 [53:36<7:15:10,  3.13it/s]
                                                         
{'loss': 2.6253, 'learning_rate': 2.9798099506561227e-07, 'epoch': 12.48}

 78%|███████▊  | 289800/371472 [53:36<7:15:10,  3.13it/s]
 78%|███████▊  | 289801/371472 [53:36<7:01:21,  3.23it/s]
 78%|███████▊  | 289802/371472 [53:37<6:45:11,  3.36it/s]
 78%|███████▊  | 289803/371472 [53:37<6:36:06,  3.44it/s]
 78%|███████▊  | 289804/371472 [53:37<6:56:09,  3.27it/s]
 78%|███████▊  | 289805/371472 [53:38<7:11:29,  3.15it/s]
 78%|███████▊  | 289806/371472 [53:38<6:54:45,  3.28it/s]
 78%|███████▊  | 289807/371472 [53:38<6:34:54,  3.45it/s]
 78%|███████▊  | 289808/371472 [53:38<6:22:54,  3.55it/s]
 78%|███████▊  | 289809/371472 [53:39<6:26:48,  3.52it/s]
 78%|███████▊  | 289810/371472 [53:39<6:23:27,  3.55it/s]
 78%|███████▊  | 289811/371472 [53:39<6:46:05,  3.35it/s]
 78%|███████▊  | 289812/371472 [53:40<6:49:30,  3.32it/s]
 78%|███████▊  | 289813/371472 [53:40<6:35:28,  3.44it/s]
 78%|███████▊  | 289814/371472 [53:40<6:34:23,  3.45it/s]
 78%|███████▊  | 289815/371472 [53:41<6:31:44,  3.47it/s]
 78%|███████▊  | 289816/371472 [53:41<6:34:15,  3.45it/s]
 78%|███████▊  | 289817/371472 [53:41<6:25:16,  3.53it/s]
 78%|███████▊  | 289818/371472 [53:41<6:32:11,  3.47it/s]
 78%|███████▊  | 289819/371472 [53:42<6:24:41,  3.54it/s]
 78%|███████▊  | 289820/371472 [53:42<6:32:04,  3.47it/s]
                                                         
{'loss': 2.5986, 'learning_rate': 2.979325130901334e-07, 'epoch': 12.48}

 78%|███████▊  | 289820/371472 [53:42<6:32:04,  3.47it/s]
 78%|███████▊  | 289821/371472 [53:42<6:17:39,  3.60it/s]
 78%|███████▊  | 289822/371472 [53:43<6:33:59,  3.45it/s]
 78%|███████▊  | 289823/371472 [53:43<6:24:03,  3.54it/s]
 78%|███████▊  | 289824/371472 [53:43<6:34:01,  3.45it/s]
 78%|███████▊  | 289825/371472 [53:43<6:30:58,  3.48it/s]
 78%|███████▊  | 289826/371472 [53:44<6:12:27,  3.65it/s]
 78%|███████▊  | 289827/371472 [53:44<6:24:21,  3.54it/s]
 78%|███████▊  | 289828/371472 [53:44<8:16:18,  2.74it/s]
 78%|███████▊  | 289829/371472 [53:45<7:34:55,  2.99it/s]
 78%|███████▊  | 289830/371472 [53:45<7:07:21,  3.18it/s]
 78%|███████▊  | 289831/371472 [53:45<6:56:37,  3.27it/s]
 78%|███████▊  | 289832/371472 [53:46<7:02:11,  3.22it/s]
 78%|███████▊  | 289833/371472 [53:46<6:54:21,  3.28it/s]
 78%|███████▊  | 289834/371472 [53:46<6:52:32,  3.30it/s]
 78%|███████▊  | 289835/371472 [53:47<6:59:42,  3.24it/s]
 78%|███████▊  | 289836/371472 [53:47<6:52:26,  3.30it/s]
 78%|███████▊  | 289837/371472 [53:47<7:15:40,  3.12it/s]
 78%|███████▊  | 289838/371472 [53:47<6:58:27,  3.25it/s]
 78%|███████▊  | 289839/371472 [53:48<6:53:32,  3.29it/s]
 78%|███████▊  | 289840/371472 [53:48<7:00:00,  3.24it/s]
                                                         
{'loss': 2.6511, 'learning_rate': 2.978840311146545e-07, 'epoch': 12.48}

 78%|███████▊  | 289840/371472 [53:48<7:00:00,  3.24it/s]
 78%|███████▊  | 289841/371472 [53:48<6:39:43,  3.40it/s]
 78%|███████▊  | 289842/371472 [53:49<6:20:16,  3.58it/s]
 78%|███████▊  | 289843/371472 [53:49<6:11:52,  3.66it/s]
 78%|███████▊  | 289844/371472 [53:49<6:10:00,  3.68it/s]
 78%|███████▊  | 289845/371472 [53:49<6:44:57,  3.36it/s]
 78%|███████▊  | 289846/371472 [53:50<6:58:10,  3.25it/s]
 78%|███████▊  | 289847/371472 [53:50<6:52:52,  3.29it/s]
 78%|███████▊  | 289848/371472 [53:50<6:52:55,  3.29it/s]
 78%|███████▊  | 289849/371472 [53:51<6:38:28,  3.41it/s]
 78%|███████▊  | 289850/371472 [53:51<6:16:30,  3.61it/s]
 78%|███████▊  | 289851/371472 [53:51<6:08:22,  3.69it/s]
 78%|███████▊  | 289852/371472 [53:51<6:07:55,  3.70it/s]
 78%|███████▊  | 289853/371472 [53:52<6:57:04,  3.26it/s]
 78%|███████▊  | 289854/371472 [53:52<7:04:44,  3.20it/s]
 78%|███████▊  | 289855/371472 [53:52<6:55:06,  3.28it/s]
 78%|███████▊  | 289856/371472 [53:53<6:58:25,  3.25it/s]
 78%|███████▊  | 289857/371472 [53:53<6:48:30,  3.33it/s]
 78%|███████▊  | 289858/371472 [53:53<6:53:23,  3.29it/s]
 78%|███████▊  | 289859/371472 [53:54<6:49:55,  3.32it/s]
 78%|███████▊  | 289860/371472 [53:54<7:11:29,  3.15it/s]
                                                         
{'loss': 2.7623, 'learning_rate': 2.978355491391756e-07, 'epoch': 12.48}

 78%|███████▊  | 289860/371472 [53:54<7:11:29,  3.15it/s]
 78%|███████▊  | 289861/371472 [53:54<6:56:50,  3.26it/s]
 78%|███████▊  | 289862/371472 [53:55<7:02:43,  3.22it/s]
 78%|███████▊  | 289863/371472 [53:55<6:40:14,  3.40it/s]
 78%|███████▊  | 289864/371472 [53:55<7:19:29,  3.09it/s]
 78%|███████▊  | 289865/371472 [53:56<7:02:40,  3.22it/s]
 78%|███████▊  | 289866/371472 [53:56<6:41:16,  3.39it/s]
 78%|███████▊  | 289867/371472 [53:56<6:37:07,  3.42it/s]
 78%|███████▊  | 289868/371472 [53:56<6:24:14,  3.54it/s]
 78%|███████▊  | 289869/371472 [53:57<6:55:55,  3.27it/s]
 78%|███████▊  | 289870/371472 [53:57<7:00:10,  3.24it/s]
 78%|███████▊  | 289871/371472 [53:57<7:17:01,  3.11it/s]
 78%|███████▊  | 289872/371472 [53:58<6:50:28,  3.31it/s]
 78%|███████▊  | 289873/371472 [53:58<6:36:33,  3.43it/s]
 78%|███████▊  | 289874/371472 [53:58<6:36:25,  3.43it/s]
 78%|███████▊  | 289875/371472 [53:58<6:22:18,  3.56it/s]
 78%|███████▊  | 289876/371472 [53:59<6:15:38,  3.62it/s]
 78%|███████▊  | 289877/371472 [53:59<6:42:23,  3.38it/s]
 78%|███████▊  | 289878/371472 [53:59<6:49:13,  3.32it/s]
 78%|███████▊  | 289879/371472 [54:00<7:01:11,  3.23it/s]
 78%|███████▊  | 289880/371472 [54:00<6:36:42,  3.43it/s]
                                                         
{'loss': 2.654, 'learning_rate': 2.9778706716369666e-07, 'epoch': 12.49}

 78%|███████▊  | 289880/371472 [54:00<6:36:42,  3.43it/s]
 78%|███████▊  | 289881/371472 [54:00<6:26:37,  3.52it/s]
 78%|███████▊  | 289882/371472 [54:01<7:01:16,  3.23it/s]
 78%|███████▊  | 289883/371472 [54:01<6:40:17,  3.40it/s]
 78%|███████▊  | 289884/371472 [54:01<6:29:25,  3.49it/s]
 78%|███████▊  | 289885/371472 [54:01<6:23:10,  3.55it/s]
 78%|███████▊  | 289886/371472 [54:02<6:33:28,  3.46it/s]
 78%|███████▊  | 289887/371472 [54:02<6:42:00,  3.38it/s]
 78%|███████▊  | 289888/371472 [54:02<6:51:05,  3.31it/s]
 78%|███████▊  | 289889/371472 [54:03<6:50:07,  3.32it/s]
 78%|███████▊  | 289890/371472 [54:03<6:40:46,  3.39it/s]
 78%|███████▊  | 289891/371472 [54:03<6:35:18,  3.44it/s]
 78%|███████▊  | 289892/371472 [54:03<6:36:23,  3.43it/s]
 78%|███████▊  | 289893/371472 [54:04<6:27:01,  3.51it/s]
 78%|███████▊  | 289894/371472 [54:04<6:26:18,  3.52it/s]
 78%|███████▊  | 289895/371472 [54:04<6:05:30,  3.72it/s]
 78%|███████▊  | 289896/371472 [54:05<6:14:58,  3.63it/s]
 78%|███████▊  | 289897/371472 [54:05<6:52:05,  3.30it/s]
 78%|███████▊  | 289898/371472 [54:05<6:47:04,  3.34it/s]
 78%|███████▊  | 289899/371472 [54:05<6:42:35,  3.38it/s]
 78%|███████▊  | 289900/371472 [54:06<6:50:15,  3.31it/s]
                                                         
{'loss': 2.581, 'learning_rate': 2.9773858518821783e-07, 'epoch': 12.49}

 78%|███████▊  | 289900/371472 [54:06<6:50:15,  3.31it/s]
 78%|███████▊  | 289901/371472 [54:06<6:38:20,  3.41it/s]
 78%|███████▊  | 289902/371472 [54:06<6:36:42,  3.43it/s]
 78%|███████▊  | 289903/371472 [54:07<6:30:01,  3.49it/s]
 78%|███████▊  | 289904/371472 [54:07<6:32:25,  3.46it/s]
 78%|███████▊  | 289905/371472 [54:07<6:35:50,  3.43it/s]
 78%|███████▊  | 289906/371472 [54:07<6:31:24,  3.47it/s]
 78%|███████▊  | 289907/371472 [54:08<6:12:30,  3.65it/s]
 78%|███████▊  | 289908/371472 [54:08<6:18:04,  3.60it/s]
 78%|███████▊  | 289909/371472 [54:08<6:50:23,  3.31it/s]
 78%|███████▊  | 289910/371472 [54:09<6:58:44,  3.25it/s]
 78%|███████▊  | 289911/371472 [54:09<7:01:40,  3.22it/s]
 78%|███████▊  | 289912/371472 [54:09<7:11:29,  3.15it/s]
 78%|███████▊  | 289913/371472 [54:10<7:11:35,  3.15it/s]
 78%|███████▊  | 289914/371472 [54:10<6:49:17,  3.32it/s]
 78%|███████▊  | 289915/371472 [54:10<6:50:52,  3.31it/s]
 78%|███████▊  | 289916/371472 [54:10<6:34:49,  3.44it/s]
 78%|███████▊  | 289917/371472 [54:11<6:23:23,  3.55it/s]
 78%|███████▊  | 289918/371472 [54:11<6:06:13,  3.71it/s]
 78%|███████▊  | 289919/371472 [54:11<6:05:35,  3.72it/s]
 78%|███████▊  | 289920/371472 [54:12<5:59:58,  3.78it/s]
                                                         
{'loss': 2.5641, 'learning_rate': 2.976901032127389e-07, 'epoch': 12.49}

 78%|███████▊  | 289920/371472 [54:12<5:59:58,  3.78it/s]
 78%|███████▊  | 289921/371472 [54:12<6:11:28,  3.66it/s]
 78%|███████▊  | 289922/371472 [54:12<6:10:53,  3.66it/s]
 78%|███████▊  | 289923/371472 [54:12<6:01:05,  3.76it/s]
 78%|███████▊  | 289924/371472 [54:13<6:27:19,  3.51it/s]
 78%|███████▊  | 289925/371472 [54:13<6:15:08,  3.62it/s]
 78%|███████▊  | 289926/371472 [54:13<6:09:08,  3.68it/s]
 78%|███████▊  | 289927/371472 [54:13<6:06:06,  3.71it/s]
 78%|███████▊  | 289928/371472 [54:14<6:10:27,  3.67it/s]
 78%|███████▊  | 289929/371472 [54:14<6:04:40,  3.73it/s]
 78%|███████▊  | 289930/371472 [54:14<6:31:04,  3.48it/s]
 78%|███████▊  | 289931/371472 [54:15<6:46:26,  3.34it/s]
 78%|███████▊  | 289932/371472 [54:15<6:33:12,  3.46it/s]
 78%|███████▊  | 289933/371472 [54:15<6:33:39,  3.45it/s]
 78%|███████▊  | 289934/371472 [54:15<6:43:00,  3.37it/s]
 78%|███████▊  | 289935/371472 [54:16<6:35:31,  3.44it/s]
 78%|███████▊  | 289936/371472 [54:16<6:28:03,  3.50it/s]
 78%|███████▊  | 289937/371472 [54:16<6:28:40,  3.50it/s]
 78%|███████▊  | 289938/371472 [54:17<6:30:28,  3.48it/s]
 78%|███████▊  | 289939/371472 [54:17<6:15:59,  3.61it/s]
 78%|███████▊  | 289940/371472 [54:17<6:16:32,  3.61it/s]
                                                         
{'loss': 2.6614, 'learning_rate': 2.9764162123726003e-07, 'epoch': 12.49}

 78%|███████▊  | 289940/371472 [54:17<6:16:32,  3.61it/s]
 78%|███████▊  | 289941/371472 [54:17<6:13:25,  3.64it/s]
 78%|███████▊  | 289942/371472 [54:18<6:11:53,  3.65it/s]
 78%|███████▊  | 289943/371472 [54:18<6:04:33,  3.73it/s]
 78%|███████▊  | 289944/371472 [54:18<6:17:40,  3.60it/s]
 78%|███████▊  | 289945/371472 [54:19<6:22:12,  3.56it/s]
 78%|███████▊  | 289946/371472 [54:19<6:39:11,  3.40it/s]
 78%|███████▊  | 289947/371472 [54:19<6:28:52,  3.49it/s]
 78%|███████▊  | 289948/371472 [54:19<6:20:16,  3.57it/s]
 78%|███████▊  | 289949/371472 [54:20<6:13:40,  3.64it/s]
 78%|███████▊  | 289950/371472 [54:20<6:23:08,  3.55it/s]
 78%|███████▊  | 289951/371472 [54:20<6:22:17,  3.55it/s]
 78%|███████▊  | 289952/371472 [54:21<6:13:46,  3.63it/s]
 78%|███████▊  | 289953/371472 [54:21<6:14:14,  3.63it/s]
 78%|███████▊  | 289954/371472 [54:21<6:19:39,  3.58it/s]
 78%|███████▊  | 289955/371472 [54:21<6:07:17,  3.70it/s]
 78%|███████▊  | 289956/371472 [54:22<6:02:38,  3.75it/s]
 78%|███████▊  | 289957/371472 [54:22<6:15:57,  3.61it/s]
 78%|███████▊  | 289958/371472 [54:22<6:03:42,  3.74it/s]
 78%|███████▊  | 289959/371472 [54:22<5:56:32,  3.81it/s]
 78%|███████▊  | 289960/371472 [54:23<5:53:54,  3.84it/s]
                                                         
{'loss': 2.7834, 'learning_rate': 2.975931392617811e-07, 'epoch': 12.49}

 78%|███████▊  | 289960/371472 [54:23<5:53:54,  3.84it/s]
 78%|███████▊  | 289961/371472 [54:23<6:16:26,  3.61it/s]
 78%|███████▊  | 289962/371472 [54:23<6:30:30,  3.48it/s]
 78%|███████▊  | 289963/371472 [54:24<6:31:33,  3.47it/s]
 78%|███████▊  | 289964/371472 [54:24<6:18:47,  3.59it/s]
 78%|███████▊  | 289965/371472 [54:24<6:15:38,  3.62it/s]
 78%|███████▊  | 289966/371472 [54:24<6:08:59,  3.68it/s]
 78%|███████▊  | 289967/371472 [54:25<6:17:10,  3.60it/s]
 78%|███████▊  | 289968/371472 [54:25<6:04:38,  3.73it/s]
 78%|███████▊  | 289969/371472 [54:25<6:18:26,  3.59it/s]
 78%|███████▊  | 289970/371472 [54:25<6:20:26,  3.57it/s]
 78%|███████▊  | 289971/371472 [54:26<6:15:30,  3.62it/s]
 78%|███████▊  | 289972/371472 [54:26<6:43:31,  3.37it/s]
 78%|███████▊  | 289973/371472 [54:26<6:40:04,  3.40it/s]
 78%|███████▊  | 289974/371472 [54:27<6:29:56,  3.48it/s]
 78%|███████▊  | 289975/371472 [54:27<6:33:43,  3.45it/s]
 78%|███████▊  | 289976/371472 [54:27<6:27:57,  3.50it/s]
 78%|███████▊  | 289977/371472 [54:28<6:52:52,  3.29it/s]
 78%|███████▊  | 289978/371472 [54:28<7:43:08,  2.93it/s]
 78%|███████▊  | 289979/371472 [54:28<7:13:33,  3.13it/s]
 78%|███████▊  | 289980/371472 [54:29<6:57:15,  3.26it/s]
                                                         
{'loss': 2.6106, 'learning_rate': 2.9754465728630223e-07, 'epoch': 12.49}

 78%|███████▊  | 289980/371472 [54:29<6:57:15,  3.26it/s]
 78%|███████▊  | 289981/371472 [54:29<6:32:49,  3.46it/s]
 78%|███████▊  | 289982/371472 [54:29<6:20:39,  3.57it/s]
 78%|███████▊  | 289983/371472 [54:29<6:24:11,  3.54it/s]
 78%|███████▊  | 289984/371472 [54:30<6:20:27,  3.57it/s]
 78%|███████▊  | 289985/371472 [54:30<6:18:34,  3.59it/s]
 78%|███████▊  | 289986/371472 [54:30<6:09:25,  3.68it/s]
 78%|███████▊  | 289987/371472 [54:30<6:07:54,  3.69it/s]
 78%|███████▊  | 289988/371472 [54:31<6:13:34,  3.64it/s]
 78%|███████▊  | 289989/371472 [54:31<6:14:40,  3.62it/s]
 78%|███████▊  | 289990/371472 [54:31<6:51:12,  3.30it/s]
 78%|███████▊  | 289991/371472 [54:32<7:01:34,  3.22it/s]
 78%|███████▊  | 289992/371472 [54:32<6:55:41,  3.27it/s]
 78%|███████▊  | 289993/371472 [54:32<6:41:59,  3.38it/s]
 78%|███████▊  | 289994/371472 [54:32<6:26:28,  3.51it/s]
 78%|███████▊  | 289995/371472 [54:33<6:47:39,  3.33it/s]
 78%|███████▊  | 289996/371472 [54:33<6:35:20,  3.43it/s]
 78%|███████▊  | 289997/371472 [54:33<6:42:18,  3.38it/s]
 78%|███████▊  | 289998/371472 [54:34<6:26:08,  3.52it/s]
 78%|███████▊  | 289999/371472 [54:34<6:24:43,  3.53it/s]
 78%|███████▊  | 290000/371472 [54:34<6:13:18,  3.64it/s]
                                                         
{'loss': 2.6796, 'learning_rate': 2.974961753108233e-07, 'epoch': 12.49}

 78%|███████▊  | 290000/371472 [54:34<6:13:18,  3.64it/s]
 78%|███████▊  | 290001/371472 [54:34<6:21:04,  3.56it/s]
 78%|███████▊  | 290002/371472 [54:35<6:10:54,  3.66it/s]
 78%|███████▊  | 290003/371472 [54:35<7:24:17,  3.06it/s]
 78%|███████▊  | 290004/371472 [54:36<7:40:04,  2.95it/s]
 78%|███████▊  | 290005/371472 [54:36<7:27:12,  3.04it/s]
 78%|███████▊  | 290006/371472 [54:36<7:06:55,  3.18it/s]
 78%|███████▊  | 290007/371472 [54:36<6:43:54,  3.36it/s]
 78%|███████▊  | 290008/371472 [54:37<6:36:30,  3.42it/s]
 78%|███████▊  | 290009/371472 [54:37<6:34:48,  3.44it/s]
 78%|███████▊  | 290010/371472 [54:38<8:36:01,  2.63it/s]
 78%|███████▊  | 290011/371472 [54:38<8:19:11,  2.72it/s]
 78%|███████▊  | 290012/371472 [54:38<7:47:55,  2.90it/s]
 78%|███████▊  | 290013/371472 [54:38<7:11:09,  3.15it/s]
 78%|███████▊  | 290014/371472 [54:39<7:30:15,  3.02it/s]
 78%|███████▊  | 290015/371472 [54:39<6:59:05,  3.24it/s]
 78%|███████▊  | 290016/371472 [54:39<6:49:54,  3.31it/s]
 78%|███████▊  | 290017/371472 [54:40<6:48:05,  3.33it/s]
 78%|███████▊  | 290018/371472 [54:40<6:28:00,  3.50it/s]
 78%|███████▊  | 290019/371472 [54:40<6:17:43,  3.59it/s]
 78%|███████▊  | 290020/371472 [54:40<6:20:24,  3.57it/s]
                                                         
{'loss': 2.5155, 'learning_rate': 2.974476933353445e-07, 'epoch': 12.49}

 78%|███████▊  | 290020/371472 [54:40<6:20:24,  3.57it/s]
 78%|███████▊  | 290021/371472 [54:41<6:12:25,  3.65it/s]
 78%|███████▊  | 290022/371472 [54:41<6:18:51,  3.58it/s]
 78%|███████▊  | 290023/371472 [54:41<6:11:41,  3.65it/s]
 78%|███████▊  | 290024/371472 [54:42<6:09:52,  3.67it/s]
 78%|███████▊  | 290025/371472 [54:42<6:09:29,  3.67it/s]
 78%|███████▊  | 290026/371472 [54:42<6:16:10,  3.61it/s]
 78%|███████▊  | 290027/371472 [54:42<6:35:51,  3.43it/s]
 78%|███████▊  | 290028/371472 [54:43<6:24:58,  3.53it/s]
 78%|███████▊  | 290029/371472 [54:43<6:42:55,  3.37it/s]
 78%|███████▊  | 290030/371472 [54:43<7:08:19,  3.17it/s]
 78%|███████▊  | 290031/371472 [54:44<6:38:47,  3.40it/s]
 78%|███████▊  | 290032/371472 [54:44<6:39:17,  3.40it/s]
 78%|███████▊  | 290033/371472 [54:44<6:38:20,  3.41it/s]
 78%|███████▊  | 290034/371472 [54:44<6:22:53,  3.54it/s]
 78%|███████▊  | 290035/371472 [54:45<6:08:43,  3.68it/s]
 78%|███████▊  | 290036/371472 [54:45<6:07:44,  3.69it/s]
 78%|███████▊  | 290037/371472 [54:45<6:09:45,  3.67it/s]
 78%|███████▊  | 290038/371472 [54:45<6:05:41,  3.71it/s]
 78%|███████▊  | 290039/371472 [54:46<6:08:28,  3.68it/s]
 78%|███████▊  | 290040/371472 [54:46<6:21:41,  3.56it/s]
                                                         
{'loss': 2.6256, 'learning_rate': 2.9739921135986555e-07, 'epoch': 12.49}

 78%|███████▊  | 290040/371472 [54:46<6:21:41,  3.56it/s]
 78%|███████▊  | 290041/371472 [54:46<6:13:50,  3.63it/s]
 78%|███████▊  | 290042/371472 [54:47<6:15:31,  3.61it/s]
 78%|███████▊  | 290043/371472 [54:47<6:07:30,  3.69it/s]
 78%|███████▊  | 290044/371472 [54:47<6:23:14,  3.54it/s]
 78%|███████▊  | 290045/371472 [54:47<6:15:02,  3.62it/s]
 78%|███████▊  | 290046/371472 [54:48<6:18:15,  3.59it/s]
 78%|███████▊  | 290047/371472 [54:48<6:13:41,  3.63it/s]
 78%|███████▊  | 290048/371472 [54:48<6:21:11,  3.56it/s]
 78%|███████▊  | 290049/371472 [54:49<6:20:45,  3.56it/s]
 78%|███████▊  | 290050/371472 [54:49<6:17:00,  3.60it/s]
 78%|███████▊  | 290051/371472 [54:49<6:57:34,  3.25it/s]
 78%|███████▊  | 290052/371472 [54:50<6:49:23,  3.31it/s]
 78%|███████▊  | 290053/371472 [54:50<6:34:41,  3.44it/s]
 78%|███████▊  | 290054/371472 [54:50<6:20:13,  3.57it/s]
 78%|███████▊  | 290055/371472 [54:50<6:09:44,  3.67it/s]
 78%|███████▊  | 290056/371472 [54:51<5:57:10,  3.80it/s]
 78%|███████▊  | 290057/371472 [54:51<6:09:03,  3.68it/s]
 78%|███████▊  | 290058/371472 [54:51<6:11:48,  3.65it/s]
 78%|███████▊  | 290059/371472 [54:51<6:04:53,  3.72it/s]
 78%|███████▊  | 290060/371472 [54:52<6:09:42,  3.67it/s]
                                                         
{'loss': 2.8283, 'learning_rate': 2.973507293843866e-07, 'epoch': 12.49}

 78%|███████▊  | 290060/371472 [54:52<6:09:42,  3.67it/s]
 78%|███████▊  | 290061/371472 [54:52<6:01:42,  3.75it/s]
 78%|███████▊  | 290062/371472 [54:52<6:00:58,  3.76it/s]
 78%|███████▊  | 290063/371472 [54:52<6:15:28,  3.61it/s]
 78%|███████▊  | 290064/371472 [54:53<6:23:10,  3.54it/s]
 78%|███████▊  | 290065/371472 [54:53<6:44:03,  3.36it/s]
 78%|███████▊  | 290066/371472 [54:53<6:29:37,  3.48it/s]
 78%|███████▊  | 290067/371472 [54:54<6:25:49,  3.52it/s]
 78%|███████▊  | 290068/371472 [54:54<7:14:17,  3.12it/s]
 78%|███████▊  | 290069/371472 [54:54<6:58:51,  3.24it/s]
 78%|███████▊  | 290070/371472 [54:55<6:52:04,  3.29it/s]
 78%|███████▊  | 290071/371472 [54:55<6:29:41,  3.48it/s]
 78%|███████▊  | 290072/371472 [54:55<6:16:27,  3.60it/s]
 78%|███████▊  | 290073/371472 [54:55<6:06:11,  3.70it/s]
 78%|███████▊  | 290074/371472 [54:56<6:01:40,  3.75it/s]
 78%|███████▊  | 290075/371472 [54:56<6:13:20,  3.63it/s]
 78%|███████▊  | 290076/371472 [54:56<6:22:29,  3.55it/s]
 78%|███████▊  | 290077/371472 [54:57<6:39:54,  3.39it/s]
 78%|███████▊  | 290078/371472 [54:57<6:43:23,  3.36it/s]
 78%|███████▊  | 290079/371472 [54:57<6:30:56,  3.47it/s]
 78%|███████▊  | 290080/371472 [54:57<6:16:34,  3.60it/s]
                                                         
{'loss': 2.5472, 'learning_rate': 2.9730224740890774e-07, 'epoch': 12.49}

 78%|███████▊  | 290080/371472 [54:57<6:16:34,  3.60it/s]
 78%|███████▊  | 290081/371472 [54:58<6:07:57,  3.69it/s]
 78%|███████▊  | 290082/371472 [54:58<6:11:34,  3.65it/s]
 78%|███████▊  | 290083/371472 [54:58<6:09:46,  3.67it/s]
 78%|███████▊  | 290084/371472 [54:58<6:08:17,  3.68it/s]
 78%|███████▊  | 290085/371472 [54:59<6:36:42,  3.42it/s]
 78%|███████▊  | 290086/371472 [54:59<6:45:36,  3.34it/s]
 78%|███████▊  | 290087/371472 [54:59<6:25:15,  3.52it/s]
 78%|███████▊  | 290088/371472 [55:00<6:10:42,  3.66it/s]
 78%|███████▊  | 290089/371472 [55:00<6:33:14,  3.45it/s]
 78%|███████▊  | 290090/371472 [55:00<6:31:02,  3.47it/s]
 78%|███████▊  | 290091/371472 [55:00<6:23:02,  3.54it/s]
 78%|███████▊  | 290092/371472 [55:01<6:20:17,  3.57it/s]
 78%|███████▊  | 290093/371472 [55:01<6:29:05,  3.49it/s]
 78%|███████▊  | 290094/371472 [55:01<6:21:07,  3.56it/s]
 78%|███████▊  | 290095/371472 [55:02<6:16:44,  3.60it/s]
 78%|███████▊  | 290096/371472 [55:02<6:10:22,  3.66it/s]
 78%|███████▊  | 290097/371472 [55:02<6:01:45,  3.75it/s]
 78%|███████▊  | 290098/371472 [55:02<6:33:09,  3.45it/s]
 78%|███████▊  | 290099/371472 [55:03<6:29:32,  3.48it/s]
 78%|███████▊  | 290100/371472 [55:03<6:20:47,  3.56it/s]
                                                         
{'loss': 2.64, 'learning_rate': 2.972537654334288e-07, 'epoch': 12.5}

 78%|███████▊  | 290100/371472 [55:03<6:20:47,  3.56it/s]
 78%|███████▊  | 290101/371472 [55:03<6:18:25,  3.58it/s]
 78%|███████▊  | 290102/371472 [55:04<6:40:15,  3.39it/s]
 78%|███████▊  | 290103/371472 [55:04<6:23:57,  3.53it/s]
 78%|███████▊  | 290104/371472 [55:04<6:32:52,  3.45it/s]
 78%|███████▊  | 290105/371472 [55:04<6:15:24,  3.61it/s]
 78%|███████▊  | 290106/371472 [55:05<6:31:15,  3.47it/s]
 78%|███████▊  | 290107/371472 [55:05<6:35:47,  3.43it/s]
 78%|███████▊  | 290108/371472 [55:05<6:23:06,  3.54it/s]
 78%|███████▊  | 290109/371472 [55:06<6:49:54,  3.31it/s]
 78%|███████▊  | 290110/371472 [55:06<6:35:44,  3.43it/s]
 78%|███████▊  | 290111/371472 [55:06<6:34:49,  3.43it/s]
 78%|███████▊  | 290112/371472 [55:06<6:13:30,  3.63it/s]
 78%|███████▊  | 290113/371472 [55:07<6:12:27,  3.64it/s]
 78%|███████▊  | 290114/371472 [55:07<6:13:40,  3.63it/s]
 78%|███████▊  | 290115/371472 [55:07<5:57:48,  3.79it/s]
 78%|███████▊  | 290116/371472 [55:08<6:42:51,  3.37it/s]
 78%|███████▊  | 290117/371472 [55:08<6:28:52,  3.49it/s]
 78%|███████▊  | 290118/371472 [55:08<6:19:54,  3.57it/s]
 78%|███████▊  | 290119/371472 [55:08<6:14:05,  3.62it/s]
 78%|███████▊  | 290120/371472 [55:09<6:40:08,  3.39it/s]
                                                         
{'loss': 2.7291, 'learning_rate': 2.9720528345794994e-07, 'epoch': 12.5}

 78%|███████▊  | 290120/371472 [55:09<6:40:08,  3.39it/s]
 78%|███████▊  | 290121/371472 [55:09<6:49:25,  3.31it/s]
 78%|███████▊  | 290122/371472 [55:09<6:44:17,  3.35it/s]
 78%|███████▊  | 290123/371472 [55:10<6:55:06,  3.27it/s]
 78%|███████▊  | 290124/371472 [55:10<7:11:44,  3.14it/s]
 78%|███████▊  | 290125/371472 [55:10<6:42:05,  3.37it/s]
 78%|███████▊  | 290126/371472 [55:11<6:27:27,  3.50it/s]
 78%|███████▊  | 290127/371472 [55:11<6:23:19,  3.54it/s]
 78%|███████▊  | 290128/371472 [55:11<6:12:22,  3.64it/s]
 78%|███████▊  | 290129/371472 [55:11<6:06:47,  3.70it/s]
 78%|███████▊  | 290130/371472 [55:12<8:35:26,  2.63it/s]
 78%|███████▊  | 290131/371472 [55:12<8:02:26,  2.81it/s]
 78%|███████▊  | 290132/371472 [55:13<7:32:34,  3.00it/s]
 78%|███████▊  | 290133/371472 [55:13<6:57:52,  3.24it/s]
 78%|███████▊  | 290134/371472 [55:13<6:42:56,  3.36it/s]
 78%|███████▊  | 290135/371472 [55:13<6:22:56,  3.54it/s]
 78%|███████▊  | 290136/371472 [55:14<6:06:12,  3.70it/s]
 78%|███████▊  | 290137/371472 [55:14<6:04:53,  3.72it/s]
 78%|███████▊  | 290138/371472 [55:14<6:40:52,  3.38it/s]
 78%|███████▊  | 290139/371472 [55:14<6:27:01,  3.50it/s]
 78%|███████▊  | 290140/371472 [55:15<6:43:17,  3.36it/s]
                                                         
{'loss': 2.5455, 'learning_rate': 2.97156801482471e-07, 'epoch': 12.5}

 78%|███████▊  | 290140/371472 [55:15<6:43:17,  3.36it/s]
 78%|███████▊  | 290141/371472 [55:15<6:22:15,  3.55it/s]
 78%|███████▊  | 290142/371472 [55:15<6:25:56,  3.51it/s]
 78%|███████▊  | 290143/371472 [55:16<6:12:12,  3.64it/s]
 78%|███████▊  | 290144/371472 [55:16<6:24:56,  3.52it/s]
 78%|███████▊  | 290145/371472 [55:16<6:31:55,  3.46it/s]
 78%|███████▊  | 290146/371472 [55:16<6:39:11,  3.40it/s]
 78%|███████▊  | 290147/371472 [55:17<6:17:31,  3.59it/s]
 78%|███████▊  | 290148/371472 [55:17<6:22:52,  3.54it/s]
 78%|███████▊  | 290149/371472 [55:17<6:38:00,  3.41it/s]
 78%|███████▊  | 290150/371472 [55:18<6:26:17,  3.51it/s]
 78%|███████▊  | 290151/371472 [55:18<6:26:13,  3.51it/s]
 78%|███████▊  | 290152/371472 [55:18<6:32:34,  3.45it/s]
 78%|███████▊  | 290153/371472 [55:18<6:21:16,  3.55it/s]
 78%|███████▊  | 290154/371472 [55:19<6:26:50,  3.50it/s]
 78%|███████▊  | 290155/371472 [55:19<6:46:33,  3.33it/s]
 78%|███████▊  | 290156/371472 [55:19<6:34:12,  3.44it/s]
 78%|███████▊  | 290157/371472 [55:20<6:36:43,  3.42it/s]
 78%|███████▊  | 290158/371472 [55:20<6:24:48,  3.52it/s]
 78%|███████▊  | 290159/371472 [55:20<6:21:42,  3.55it/s]
 78%|███████▊  | 290160/371472 [55:20<6:39:37,  3.39it/s]
                                                         
{'loss': 2.5293, 'learning_rate': 2.971083195069922e-07, 'epoch': 12.5}

 78%|███████▊  | 290160/371472 [55:20<6:39:37,  3.39it/s]
 78%|███████▊  | 290161/371472 [55:21<6:44:31,  3.35it/s]
 78%|███████▊  | 290162/371472 [55:21<6:23:54,  3.53it/s]
 78%|███████▊  | 290163/371472 [55:21<6:22:18,  3.54it/s]
 78%|███████▊  | 290164/371472 [55:22<6:24:49,  3.52it/s]
 78%|███████▊  | 290165/371472 [55:22<6:10:06,  3.66it/s]
 78%|███████▊  | 290166/371472 [55:22<6:16:20,  3.60it/s]
 78%|███████▊  | 290167/371472 [55:22<6:16:46,  3.60it/s]
 78%|███████▊  | 290168/371472 [55:23<6:17:35,  3.59it/s]
 78%|███████▊  | 290169/371472 [55:23<6:10:18,  3.66it/s]
 78%|███████▊  | 290170/371472 [55:23<6:22:25,  3.54it/s]
 78%|███████▊  | 290171/371472 [55:24<6:21:09,  3.56it/s]
 78%|███████▊  | 290172/371472 [55:24<6:18:02,  3.58it/s]
 78%|███████▊  | 290173/371472 [55:24<6:13:43,  3.63it/s]
 78%|███████▊  | 290174/371472 [55:24<6:06:04,  3.70it/s]
 78%|███████▊  | 290175/371472 [55:25<6:16:52,  3.60it/s]
 78%|███████▊  | 290176/371472 [55:25<6:13:11,  3.63it/s]
 78%|███████▊  | 290177/371472 [55:25<6:42:50,  3.36it/s]
 78%|███████▊  | 290178/371472 [55:26<6:41:55,  3.37it/s]
 78%|███████▊  | 290179/371472 [55:26<6:57:21,  3.25it/s]
 78%|███████▊  | 290180/371472 [55:26<7:03:41,  3.20it/s]
                                                         
{'loss': 2.6717, 'learning_rate': 2.9705983753151326e-07, 'epoch': 12.5}

 78%|███████▊  | 290180/371472 [55:26<7:03:41,  3.20it/s]
 78%|███████▊  | 290181/371472 [55:26<6:44:11,  3.35it/s]
 78%|███████▊  | 290182/371472 [55:27<6:35:19,  3.43it/s]
 78%|███████▊  | 290183/371472 [55:27<6:26:42,  3.50it/s]
 78%|███████▊  | 290184/371472 [55:27<6:35:12,  3.43it/s]
 78%|███████▊  | 290185/371472 [55:28<6:44:58,  3.35it/s]
 78%|███████▊  | 290186/371472 [55:28<6:33:20,  3.44it/s]
 78%|███████▊  | 290187/371472 [55:28<6:51:43,  3.29it/s]
 78%|███████▊  | 290188/371472 [55:29<6:43:04,  3.36it/s]
 78%|███████▊  | 290189/371472 [55:29<6:31:09,  3.46it/s]
 78%|███████▊  | 290190/371472 [55:29<6:44:46,  3.35it/s]
 78%|███████▊  | 290191/371472 [55:29<6:34:35,  3.43it/s]
 78%|███████▊  | 290192/371472 [55:30<6:24:35,  3.52it/s]
 78%|███████▊  | 290193/371472 [55:30<6:32:36,  3.45it/s]
 78%|███████▊  | 290194/371472 [55:30<6:19:36,  3.57it/s]
 78%|███████▊  | 290195/371472 [55:30<6:09:59,  3.66it/s]
 78%|███████▊  | 290196/371472 [55:31<6:09:32,  3.67it/s]
 78%|███████▊  | 290197/371472 [55:31<6:08:47,  3.67it/s]
 78%|███████▊  | 290198/371472 [55:31<6:05:23,  3.71it/s]
 78%|███████▊  | 290199/371472 [55:32<6:06:46,  3.69it/s]
 78%|███████▊  | 290200/371472 [55:32<6:06:13,  3.70it/s]
                                                         
{'loss': 2.7297, 'learning_rate': 2.970113555560344e-07, 'epoch': 12.5}

 78%|███████▊  | 290200/371472 [55:32<6:06:13,  3.70it/s]
 78%|███████▊  | 290201/371472 [55:32<5:57:37,  3.79it/s]
 78%|███████▊  | 290202/371472 [55:32<6:06:13,  3.70it/s]
 78%|███████▊  | 290203/371472 [55:33<6:22:20,  3.54it/s]
 78%|███████▊  | 290204/371472 [55:33<6:39:33,  3.39it/s]
 78%|███████▊  | 290205/371472 [55:33<6:29:46,  3.47it/s]
 78%|███████▊  | 290206/371472 [55:34<6:14:48,  3.61it/s]
 78%|███████▊  | 290207/371472 [55:34<6:07:23,  3.69it/s]
 78%|███████▊  | 290208/371472 [55:34<6:07:18,  3.69it/s]
 78%|███████▊  | 290209/371472 [55:34<6:17:57,  3.58it/s]
 78%|███████▊  | 290210/371472 [55:35<6:05:20,  3.71it/s]
 78%|███████▊  | 290211/371472 [55:35<6:10:01,  3.66it/s]
 78%|███████▊  | 290212/371472 [55:35<6:23:50,  3.53it/s]
 78%|███████▊  | 290213/371472 [55:35<6:14:25,  3.62it/s]
 78%|███████▊  | 290214/371472 [55:36<6:12:06,  3.64it/s]
 78%|███████▊  | 290215/371472 [55:36<6:20:51,  3.56it/s]
 78%|███████▊  | 290216/371472 [55:36<6:23:12,  3.53it/s]
 78%|███████▊  | 290217/371472 [55:37<6:09:18,  3.67it/s]
 78%|███████▊  | 290218/371472 [55:37<6:10:23,  3.66it/s]
 78%|███████▊  | 290219/371472 [55:37<7:01:51,  3.21it/s]
 78%|███████▊  | 290220/371472 [55:37<6:49:11,  3.31it/s]
                                                         
{'loss': 2.6091, 'learning_rate': 2.9696287358055546e-07, 'epoch': 12.5}

 78%|███████▊  | 290220/371472 [55:37<6:49:11,  3.31it/s]
 78%|███████▊  | 290221/371472 [55:38<6:48:57,  3.31it/s]
 78%|███████▊  | 290222/371472 [55:38<6:37:01,  3.41it/s]
 78%|███████▊  | 290223/371472 [55:38<6:30:24,  3.47it/s]
 78%|███████▊  | 290224/371472 [55:39<6:31:39,  3.46it/s]
 78%|███████▊  | 290225/371472 [55:39<6:48:51,  3.31it/s]
 78%|███████▊  | 290226/371472 [55:39<6:40:09,  3.38it/s]
 78%|███████▊  | 290227/371472 [55:40<6:55:32,  3.26it/s]
 78%|███████▊  | 290228/371472 [55:40<6:53:47,  3.27it/s]
 78%|███████▊  | 290229/371472 [55:40<6:28:52,  3.48it/s]
 78%|███████▊  | 290230/371472 [55:40<6:21:33,  3.55it/s]
 78%|███████▊  | 290231/371472 [55:41<6:31:16,  3.46it/s]
 78%|███████▊  | 290232/371472 [55:41<6:30:26,  3.47it/s]
 78%|███████▊  | 290233/371472 [55:41<6:52:01,  3.29it/s]
 78%|███████▊  | 290234/371472 [55:42<6:48:55,  3.31it/s]
 78%|███████▊  | 290235/371472 [55:42<6:25:59,  3.51it/s]
 78%|███████▊  | 290236/371472 [55:42<6:14:02,  3.62it/s]
 78%|███████▊  | 290237/371472 [55:42<6:12:42,  3.63it/s]
 78%|███████▊  | 290238/371472 [55:43<6:31:17,  3.46it/s]
 78%|███████▊  | 290239/371472 [55:43<6:33:06,  3.44it/s]
 78%|███████▊  | 290240/371472 [55:43<6:23:54,  3.53it/s]
                                                         
{'loss': 2.6265, 'learning_rate': 2.969143916050766e-07, 'epoch': 12.5}

 78%|███████▊  | 290240/371472 [55:43<6:23:54,  3.53it/s]
 78%|███████▊  | 290241/371472 [55:44<6:21:05,  3.55it/s]
 78%|███████▊  | 290242/371472 [55:44<6:49:06,  3.31it/s]
 78%|███████▊  | 290243/371472 [55:44<6:58:25,  3.24it/s]
 78%|███████▊  | 290244/371472 [55:45<6:47:30,  3.32it/s]
 78%|███████▊  | 290245/371472 [55:45<6:26:13,  3.51it/s]
 78%|███████▊  | 290246/371472 [55:45<6:40:43,  3.38it/s]
 78%|███████▊  | 290247/371472 [55:45<6:32:35,  3.45it/s]
 78%|███████▊  | 290248/371472 [55:46<6:38:00,  3.40it/s]
 78%|███████▊  | 290249/371472 [55:46<6:24:56,  3.52it/s]
 78%|███████▊  | 290250/371472 [55:46<6:34:27,  3.43it/s]
 78%|███████▊  | 290251/371472 [55:46<6:17:59,  3.58it/s]
 78%|███████▊  | 290252/371472 [55:47<6:09:51,  3.66it/s]
 78%|███████▊  | 290253/371472 [55:47<6:14:13,  3.62it/s]
 78%|███████▊  | 290254/371472 [55:47<6:02:26,  3.73it/s]
 78%|███████▊  | 290255/371472 [55:48<6:02:18,  3.74it/s]
 78%|███████▊  | 290256/371472 [55:48<6:18:22,  3.58it/s]
 78%|███████▊  | 290257/371472 [55:48<6:35:07,  3.43it/s]
 78%|███████▊  | 290258/371472 [55:48<6:51:28,  3.29it/s]
 78%|███████▊  | 290259/371472 [55:49<7:07:14,  3.17it/s]
 78%|███████▊  | 290260/371472 [55:49<7:04:41,  3.19it/s]
                                                         
{'loss': 2.5136, 'learning_rate': 2.9686590962959765e-07, 'epoch': 12.5}

 78%|███████▊  | 290260/371472 [55:49<7:04:41,  3.19it/s]
 78%|███████▊  | 290261/371472 [55:49<7:07:03,  3.17it/s]
 78%|███████▊  | 290262/371472 [55:50<6:43:59,  3.35it/s]
 78%|███████▊  | 290263/371472 [55:50<6:29:12,  3.48it/s]
 78%|███████▊  | 290264/371472 [55:50<6:13:49,  3.62it/s]
 78%|███████▊  | 290265/371472 [55:50<6:00:09,  3.76it/s]
 78%|███████▊  | 290266/371472 [55:51<5:50:55,  3.86it/s]
 78%|███████▊  | 290267/371472 [55:51<5:53:41,  3.83it/s]
 78%|███████▊  | 290268/371472 [55:51<5:43:51,  3.94it/s]
 78%|███████▊  | 290269/371472 [55:52<6:06:53,  3.69it/s]
 78%|███████▊  | 290270/371472 [55:52<6:14:10,  3.62it/s]
 78%|███████▊  | 290271/371472 [55:52<6:18:08,  3.58it/s]
 78%|███████▊  | 290272/371472 [55:52<6:07:35,  3.68it/s]
 78%|███████▊  | 290273/371472 [55:53<6:08:18,  3.67it/s]
 78%|███████▊  | 290274/371472 [55:53<6:00:48,  3.75it/s]
 78%|███████▊  | 290275/371472 [55:53<6:24:20,  3.52it/s]
 78%|███████▊  | 290276/371472 [55:54<6:39:13,  3.39it/s]
 78%|███████▊  | 290277/371472 [55:54<6:57:26,  3.24it/s]
 78%|███████▊  | 290278/371472 [55:54<6:38:59,  3.39it/s]
 78%|███████▊  | 290279/371472 [55:54<6:24:02,  3.52it/s]
 78%|███████▊  | 290280/371472 [55:55<6:15:52,  3.60it/s]
                                                         
{'loss': 2.5363, 'learning_rate': 2.9681742765411883e-07, 'epoch': 12.5}

 78%|███████▊  | 290280/371472 [55:55<6:15:52,  3.60it/s]
 78%|███████▊  | 290281/371472 [55:55<6:24:36,  3.52it/s]
 78%|███████▊  | 290282/371472 [55:55<6:17:24,  3.59it/s]
 78%|███████▊  | 290283/371472 [55:56<6:18:23,  3.58it/s]
 78%|███████▊  | 290284/371472 [55:56<6:06:23,  3.69it/s]
 78%|███████▊  | 290285/371472 [55:56<6:11:26,  3.64it/s]
 78%|███████▊  | 290286/371472 [55:56<6:37:41,  3.40it/s]
 78%|███████▊  | 290287/371472 [55:57<6:31:59,  3.45it/s]
 78%|███████▊  | 290288/371472 [55:57<7:10:55,  3.14it/s]
 78%|███████▊  | 290289/371472 [55:57<7:13:07,  3.12it/s]
 78%|███████▊  | 290290/371472 [55:58<7:15:49,  3.10it/s]
 78%|███████▊  | 290291/371472 [55:58<6:45:24,  3.34it/s]
 78%|███████▊  | 290292/371472 [55:58<6:39:36,  3.39it/s]
 78%|███████▊  | 290293/371472 [55:59<6:29:34,  3.47it/s]
 78%|███████▊  | 290294/371472 [55:59<6:22:50,  3.53it/s]
 78%|███████▊  | 290295/371472 [55:59<6:15:50,  3.60it/s]
 78%|███████▊  | 290296/371472 [55:59<6:10:15,  3.65it/s]
 78%|███████▊  | 290297/371472 [56:00<6:05:09,  3.71it/s]
 78%|███████▊  | 290298/371472 [56:00<5:53:17,  3.83it/s]
 78%|███████▊  | 290299/371472 [56:00<6:01:52,  3.74it/s]
 78%|███████▊  | 290300/371472 [56:00<5:58:07,  3.78it/s]
                                                         
{'loss': 2.5, 'learning_rate': 2.967689456786399e-07, 'epoch': 12.5}

 78%|███████▊  | 290300/371472 [56:00<5:58:07,  3.78it/s]
 78%|███████▊  | 290301/371472 [56:01<6:04:19,  3.71it/s]
 78%|███████▊  | 290302/371472 [56:01<6:08:58,  3.67it/s]
 78%|███████▊  | 290303/371472 [56:01<6:16:17,  3.60it/s]
 78%|███████▊  | 290304/371472 [56:01<6:01:46,  3.74it/s]
 78%|███████▊  | 290305/371472 [56:02<5:58:26,  3.77it/s]
 78%|███████▊  | 290306/371472 [56:02<6:14:45,  3.61it/s]
 78%|███████▊  | 290307/371472 [56:02<6:03:26,  3.72it/s]
 78%|███████▊  | 290308/371472 [56:03<6:16:29,  3.59it/s]
 78%|███████▊  | 290309/371472 [56:03<7:01:16,  3.21it/s]
 78%|███████▊  | 290310/371472 [56:03<6:43:04,  3.36it/s]
 78%|███████▊  | 290311/371472 [56:04<6:42:36,  3.36it/s]
 78%|███████▊  | 290312/371472 [56:04<6:18:53,  3.57it/s]
 78%|███████▊  | 290313/371472 [56:04<6:39:26,  3.39it/s]
 78%|███████▊  | 290314/371472 [56:04<6:35:22,  3.42it/s]
 78%|███████▊  | 290315/371472 [56:05<6:27:17,  3.49it/s]
 78%|███████▊  | 290316/371472 [56:05<6:24:51,  3.51it/s]
 78%|███████▊  | 290317/371472 [56:05<6:19:03,  3.57it/s]
 78%|███████▊  | 290318/371472 [56:05<6:17:15,  3.59it/s]
 78%|███████▊  | 290319/371472 [56:06<6:11:58,  3.64it/s]
 78%|███████▊  | 290320/371472 [56:06<6:18:59,  3.57it/s]
                                                         
{'loss': 2.5634, 'learning_rate': 2.967204637031611e-07, 'epoch': 12.5}

 78%|███████▊  | 290320/371472 [56:06<6:18:59,  3.57it/s]
 78%|███████▊  | 290321/371472 [56:06<6:53:22,  3.27it/s]
 78%|███████▊  | 290322/371472 [56:07<6:34:08,  3.43it/s]
 78%|███████▊  | 290323/371472 [56:07<6:23:48,  3.52it/s]
 78%|███████▊  | 290324/371472 [56:07<6:20:52,  3.55it/s]
 78%|███████▊  | 290325/371472 [56:07<6:14:19,  3.61it/s]
 78%|███████▊  | 290326/371472 [56:08<6:07:58,  3.68it/s]
 78%|███████▊  | 290327/371472 [56:08<6:29:14,  3.47it/s]
 78%|███████▊  | 290328/371472 [56:08<6:12:36,  3.63it/s]
 78%|███████▊  | 290329/371472 [56:09<6:37:15,  3.40it/s]
 78%|███████▊  | 290330/371472 [56:09<6:16:53,  3.59it/s]
 78%|███████▊  | 290331/371472 [56:09<6:41:10,  3.37it/s]
 78%|███████▊  | 290332/371472 [56:10<6:51:41,  3.28it/s]
 78%|███████▊  | 290333/371472 [56:10<6:33:53,  3.43it/s]
 78%|███████▊  | 290334/371472 [56:10<6:51:02,  3.29it/s]
 78%|███████▊  | 290335/371472 [56:10<6:46:21,  3.33it/s]
 78%|███████▊  | 290336/371472 [56:11<6:40:06,  3.38it/s]
 78%|███████▊  | 290337/371472 [56:11<6:51:37,  3.29it/s]
 78%|███████▊  | 290338/371472 [56:11<6:48:56,  3.31it/s]
 78%|███████▊  | 290339/371472 [56:12<7:28:46,  3.01it/s]
 78%|███████▊  | 290340/371472 [56:12<7:09:33,  3.15it/s]
                                                         
{'loss': 2.5178, 'learning_rate': 2.966719817276821e-07, 'epoch': 12.51}

 78%|███████▊  | 290340/371472 [56:12<7:09:33,  3.15it/s]
 78%|███████▊  | 290341/371472 [56:12<6:58:23,  3.23it/s]
 78%|███████▊  | 290342/371472 [56:13<6:40:06,  3.38it/s]
 78%|███████▊  | 290343/371472 [56:13<6:32:12,  3.45it/s]
 78%|███████▊  | 290344/371472 [56:13<6:44:40,  3.34it/s]
 78%|███████▊  | 290345/371472 [56:14<7:04:11,  3.19it/s]
 78%|███████▊  | 290346/371472 [56:14<6:45:42,  3.33it/s]
 78%|███████▊  | 290347/371472 [56:14<6:29:58,  3.47it/s]
 78%|███████▊  | 290348/371472 [56:14<6:13:13,  3.62it/s]
 78%|███████▊  | 290349/371472 [56:15<6:17:39,  3.58it/s]
 78%|███████▊  | 290350/371472 [56:15<6:14:11,  3.61it/s]
 78%|███████▊  | 290351/371472 [56:15<6:24:57,  3.51it/s]
 78%|███████▊  | 290352/371472 [56:15<6:11:38,  3.64it/s]
 78%|███████▊  | 290353/371472 [56:16<5:56:29,  3.79it/s]
 78%|███████▊  | 290354/371472 [56:16<6:06:06,  3.69it/s]
 78%|███████▊  | 290355/371472 [56:16<6:18:43,  3.57it/s]
 78%|███████▊  | 290356/371472 [56:17<6:46:05,  3.33it/s]
 78%|███████▊  | 290357/371472 [56:17<6:55:32,  3.25it/s]
 78%|███████▊  | 290358/371472 [56:17<6:47:30,  3.32it/s]
 78%|███████▊  | 290359/371472 [56:17<6:30:59,  3.46it/s]
 78%|███████▊  | 290360/371472 [56:18<6:09:03,  3.66it/s]
                                                         
{'loss': 2.7307, 'learning_rate': 2.966234997522032e-07, 'epoch': 12.51}

 78%|███████▊  | 290360/371472 [56:18<6:09:03,  3.66it/s]
 78%|███████▊  | 290361/371472 [56:18<6:05:09,  3.70it/s]
 78%|███████▊  | 290362/371472 [56:18<6:08:03,  3.67it/s]
 78%|███████▊  | 290363/371472 [56:18<6:09:34,  3.66it/s]
 78%|███████▊  | 290364/371472 [56:19<6:04:04,  3.71it/s]
 78%|███████▊  | 290365/371472 [56:19<6:12:45,  3.63it/s]
 78%|███████▊  | 290366/371472 [56:19<6:22:23,  3.53it/s]
 78%|███████▊  | 290367/371472 [56:20<6:37:08,  3.40it/s]
 78%|███████▊  | 290368/371472 [56:20<6:42:06,  3.36it/s]
 78%|███████▊  | 290369/371472 [56:20<6:35:15,  3.42it/s]
 78%|███████▊  | 290370/371472 [56:21<6:34:17,  3.43it/s]
 78%|███████▊  | 290371/371472 [56:21<6:29:47,  3.47it/s]
 78%|███████▊  | 290372/371472 [56:21<6:26:53,  3.49it/s]
 78%|███████▊  | 290373/371472 [56:21<6:32:59,  3.44it/s]
 78%|███████▊  | 290374/371472 [56:22<6:28:49,  3.48it/s]
 78%|███████▊  | 290375/371472 [56:22<6:16:03,  3.59it/s]
 78%|███████▊  | 290376/371472 [56:22<6:15:38,  3.60it/s]
 78%|███████▊  | 290377/371472 [56:23<6:32:17,  3.45it/s]
 78%|███████▊  | 290378/371472 [56:23<6:23:33,  3.52it/s]
 78%|███████▊  | 290379/371472 [56:23<6:25:26,  3.51it/s]
 78%|███████▊  | 290380/371472 [56:23<6:39:08,  3.39it/s]
                                                         
{'loss': 2.6083, 'learning_rate': 2.965750177767243e-07, 'epoch': 12.51}

 78%|███████▊  | 290380/371472 [56:23<6:39:08,  3.39it/s]
 78%|███████▊  | 290381/371472 [56:24<6:22:42,  3.53it/s]
 78%|███████▊  | 290382/371472 [56:24<6:45:25,  3.33it/s]
 78%|███████▊  | 290383/371472 [56:24<6:49:02,  3.30it/s]
 78%|███████▊  | 290384/371472 [56:25<6:29:30,  3.47it/s]
 78%|███████▊  | 290385/371472 [56:25<6:13:35,  3.62it/s]
 78%|███████▊  | 290386/371472 [56:25<6:39:23,  3.38it/s]
 78%|███████▊  | 290387/371472 [56:25<6:32:27,  3.44it/s]
 78%|███████▊  | 290388/371472 [56:26<6:21:32,  3.54it/s]
 78%|███████▊  | 290389/371472 [56:26<6:10:50,  3.64it/s]
 78%|███████▊  | 290390/371472 [56:26<6:18:33,  3.57it/s]
 78%|███████▊  | 290391/371472 [56:27<6:19:15,  3.56it/s]
 78%|███████▊  | 290392/371472 [56:27<7:06:26,  3.17it/s]
 78%|███████▊  | 290393/371472 [56:27<6:52:26,  3.28it/s]
 78%|███████▊  | 290394/371472 [56:27<6:43:05,  3.35it/s]
 78%|███████▊  | 290395/371472 [56:28<7:00:24,  3.21it/s]
 78%|███████▊  | 290396/371472 [56:28<6:54:16,  3.26it/s]
 78%|███████▊  | 290397/371472 [56:28<6:40:13,  3.38it/s]
 78%|███████▊  | 290398/371472 [56:29<6:26:49,  3.49it/s]
 78%|███████▊  | 290399/371472 [56:29<6:19:07,  3.56it/s]
 78%|███████▊  | 290400/371472 [56:29<6:07:46,  3.67it/s]
                                                         
{'loss': 2.4803, 'learning_rate': 2.9652653580124547e-07, 'epoch': 12.51}

 78%|███████▊  | 290400/371472 [56:29<6:07:46,  3.67it/s]
 78%|███████▊  | 290401/371472 [56:29<6:15:16,  3.60it/s]
 78%|███████▊  | 290402/371472 [56:30<6:29:20,  3.47it/s]
 78%|███████▊  | 290403/371472 [56:30<6:24:27,  3.51it/s]
 78%|███████▊  | 290404/371472 [56:30<6:40:40,  3.37it/s]
 78%|███████▊  | 290405/371472 [56:31<6:41:15,  3.37it/s]
 78%|███████▊  | 290406/371472 [56:31<6:33:32,  3.43it/s]
 78%|███████▊  | 290407/371472 [56:31<6:41:03,  3.37it/s]
 78%|███████▊  | 290408/371472 [56:32<6:52:10,  3.28it/s]
 78%|███████▊  | 290409/371472 [56:32<6:37:24,  3.40it/s]
 78%|███████▊  | 290410/371472 [56:32<7:08:40,  3.15it/s]
 78%|███████▊  | 290411/371472 [56:33<6:54:52,  3.26it/s]
 78%|███████▊  | 290412/371472 [56:33<6:56:34,  3.24it/s]
 78%|███████▊  | 290413/371472 [56:33<6:50:55,  3.29it/s]
 78%|███████▊  | 290414/371472 [56:33<6:38:16,  3.39it/s]
 78%|███████▊  | 290415/371472 [56:34<6:33:12,  3.44it/s]
 78%|███████▊  | 290416/371472 [56:34<6:20:09,  3.55it/s]
 78%|███████▊  | 290417/371472 [56:34<6:18:57,  3.56it/s]
 78%|███████▊  | 290418/371472 [56:34<6:09:22,  3.66it/s]
 78%|███████▊  | 290419/371472 [56:35<5:55:05,  3.80it/s]
 78%|███████▊  | 290420/371472 [56:35<6:52:24,  3.28it/s]
                                                         
{'loss': 2.7073, 'learning_rate': 2.9647805382576654e-07, 'epoch': 12.51}

 78%|███████▊  | 290420/371472 [56:35<6:52:24,  3.28it/s]
 78%|███████▊  | 290421/371472 [56:35<6:50:25,  3.29it/s]
 78%|███████▊  | 290422/371472 [56:36<6:39:15,  3.38it/s]
 78%|███████▊  | 290423/371472 [56:36<6:28:41,  3.48it/s]
 78%|███████▊  | 290424/371472 [56:36<6:33:03,  3.44it/s]
 78%|███████▊  | 290425/371472 [56:37<6:29:02,  3.47it/s]
 78%|███████▊  | 290426/371472 [56:37<6:47:31,  3.31it/s]
 78%|███████▊  | 290427/371472 [56:37<6:27:12,  3.49it/s]
 78%|███████▊  | 290428/371472 [56:37<6:18:39,  3.57it/s]
 78%|███████▊  | 290429/371472 [56:38<6:08:06,  3.67it/s]
 78%|███████▊  | 290430/371472 [56:38<6:31:54,  3.45it/s]
 78%|███████▊  | 290431/371472 [56:38<6:25:18,  3.51it/s]
 78%|███████▊  | 290432/371472 [56:39<6:32:56,  3.44it/s]
 78%|███████▊  | 290433/371472 [56:39<6:31:30,  3.45it/s]
 78%|███████▊  | 290434/371472 [56:39<6:18:43,  3.57it/s]
 78%|███████▊  | 290435/371472 [56:39<6:25:16,  3.51it/s]
 78%|███████▊  | 290436/371472 [56:40<6:33:49,  3.43it/s]
 78%|███████▊  | 290437/371472 [56:40<6:23:15,  3.52it/s]
 78%|███████▊  | 290438/371472 [56:40<6:27:34,  3.48it/s]
 78%|███████▊  | 290439/371472 [56:41<6:17:15,  3.58it/s]
 78%|███████▊  | 290440/371472 [56:41<6:33:18,  3.43it/s]
                                                         
{'loss': 2.7129, 'learning_rate': 2.964295718502877e-07, 'epoch': 12.51}

 78%|███████▊  | 290440/371472 [56:41<6:33:18,  3.43it/s]
 78%|███████▊  | 290441/371472 [56:41<6:19:10,  3.56it/s]
 78%|███████▊  | 290442/371472 [56:41<6:17:32,  3.58it/s]
 78%|███████▊  | 290443/371472 [56:42<6:16:13,  3.59it/s]
 78%|███████▊  | 290444/371472 [56:42<6:37:39,  3.40it/s]
 78%|███████▊  | 290445/371472 [56:42<6:32:39,  3.44it/s]
 78%|███████▊  | 290446/371472 [56:43<6:24:32,  3.51it/s]
 78%|███████▊  | 290447/371472 [56:43<6:22:27,  3.53it/s]
 78%|███████▊  | 290448/371472 [56:43<6:28:04,  3.48it/s]
 78%|███████▊  | 290449/371472 [56:43<6:25:50,  3.50it/s]
 78%|███████▊  | 290450/371472 [56:44<6:19:55,  3.55it/s]
 78%|███████▊  | 290451/371472 [56:44<6:19:14,  3.56it/s]
 78%|███████▊  | 290452/371472 [56:44<6:30:57,  3.45it/s]
 78%|███████▊  | 290453/371472 [56:45<6:33:59,  3.43it/s]
 78%|███████▊  | 290454/371472 [56:45<6:21:37,  3.54it/s]
 78%|███████▊  | 290455/371472 [56:45<6:17:31,  3.58it/s]
 78%|███████▊  | 290456/371472 [56:45<6:14:52,  3.60it/s]
 78%|███████▊  | 290457/371472 [56:46<6:19:38,  3.56it/s]
 78%|███████▊  | 290458/371472 [56:46<6:34:54,  3.42it/s]
 78%|███████▊  | 290459/371472 [56:46<6:35:01,  3.42it/s]
 78%|███████▊  | 290460/371472 [56:46<6:11:45,  3.63it/s]
                                                         
{'loss': 2.6443, 'learning_rate': 2.9638108987480874e-07, 'epoch': 12.51}

 78%|███████▊  | 290460/371472 [56:46<6:11:45,  3.63it/s]
 78%|███████▊  | 290461/371472 [56:47<6:47:01,  3.32it/s]
 78%|███████▊  | 290462/371472 [56:47<6:38:12,  3.39it/s]
 78%|███████▊  | 290463/371472 [56:47<6:39:13,  3.38it/s]
 78%|███████▊  | 290464/371472 [56:48<6:40:40,  3.37it/s]
 78%|███████▊  | 290465/371472 [56:48<6:26:10,  3.50it/s]
 78%|███████▊  | 290466/371472 [56:48<6:26:17,  3.50it/s]
 78%|███████▊  | 290467/371472 [56:49<6:17:47,  3.57it/s]
 78%|███████▊  | 290468/371472 [56:49<6:07:24,  3.67it/s]
 78%|███████▊  | 290469/371472 [56:49<6:05:58,  3.69it/s]
 78%|███████▊  | 290470/371472 [56:49<6:07:08,  3.68it/s]
 78%|███████▊  | 290471/371472 [56:50<6:01:47,  3.73it/s]
 78%|███████▊  | 290472/371472 [56:50<6:03:16,  3.72it/s]
 78%|███████▊  | 290473/371472 [56:50<6:36:58,  3.40it/s]
 78%|███████▊  | 290474/371472 [56:51<6:36:49,  3.40it/s]
 78%|███████▊  | 290475/371472 [56:51<6:21:46,  3.54it/s]
 78%|███████▊  | 290476/371472 [56:51<6:17:21,  3.58it/s]
 78%|███████▊  | 290477/371472 [56:51<6:03:24,  3.71it/s]
 78%|███████▊  | 290478/371472 [56:52<5:58:03,  3.77it/s]
 78%|███████▊  | 290479/371472 [56:52<6:26:03,  3.50it/s]
 78%|███████▊  | 290480/371472 [56:52<6:19:53,  3.55it/s]
                                                         
{'loss': 2.5839, 'learning_rate': 2.9633260789932986e-07, 'epoch': 12.51}

 78%|███████▊  | 290480/371472 [56:52<6:19:53,  3.55it/s]
 78%|███████▊  | 290481/371472 [56:52<6:10:05,  3.65it/s]
 78%|███████▊  | 290482/371472 [56:53<6:09:43,  3.65it/s]
 78%|███████▊  | 290483/371472 [56:53<6:07:50,  3.67it/s]
 78%|███████▊  | 290484/371472 [56:53<6:04:29,  3.70it/s]
 78%|███████▊  | 290485/371472 [56:53<6:02:28,  3.72it/s]
 78%|███████▊  | 290486/371472 [56:54<6:19:30,  3.56it/s]
 78%|███████▊  | 290487/371472 [56:54<6:12:57,  3.62it/s]
 78%|███████▊  | 290488/371472 [56:54<6:20:08,  3.55it/s]
 78%|███████▊  | 290489/371472 [56:55<6:14:08,  3.61it/s]
 78%|███████▊  | 290490/371472 [56:55<6:24:33,  3.51it/s]
 78%|███████▊  | 290491/371472 [56:55<6:13:26,  3.61it/s]
 78%|███████▊  | 290492/371472 [56:55<6:19:53,  3.55it/s]
 78%|███████▊  | 290493/371472 [56:56<6:19:15,  3.56it/s]
 78%|███████▊  | 290494/371472 [56:56<6:27:41,  3.48it/s]
 78%|███████▊  | 290495/371472 [56:56<6:47:43,  3.31it/s]
 78%|███████▊  | 290496/371472 [56:57<6:28:50,  3.47it/s]
 78%|███████▊  | 290497/371472 [56:57<6:12:47,  3.62it/s]
 78%|███████▊  | 290498/371472 [56:57<6:13:36,  3.61it/s]
 78%|███████▊  | 290499/371472 [56:57<6:19:33,  3.56it/s]
 78%|███████▊  | 290500/371472 [56:58<6:18:10,  3.57it/s]
                                                         
{'loss': 2.8655, 'learning_rate': 2.9628412592385093e-07, 'epoch': 12.51}

 78%|███████▊  | 290500/371472 [56:58<6:18:10,  3.57it/s]
 78%|███████▊  | 290501/371472 [56:58<6:32:44,  3.44it/s]
 78%|███████▊  | 290502/371472 [56:58<6:32:29,  3.44it/s]
 78%|███████▊  | 290503/371472 [56:59<6:27:10,  3.49it/s]
 78%|███████▊  | 290504/371472 [56:59<6:19:44,  3.55it/s]
 78%|███████▊  | 290505/371472 [56:59<6:51:49,  3.28it/s]
 78%|███████▊  | 290506/371472 [57:00<6:34:13,  3.42it/s]
 78%|███████▊  | 290507/371472 [57:00<6:43:08,  3.35it/s]
 78%|███████▊  | 290508/371472 [57:00<6:37:29,  3.39it/s]
 78%|███████▊  | 290509/371472 [57:00<6:58:11,  3.23it/s]
 78%|███████▊  | 290510/371472 [57:01<6:31:31,  3.45it/s]
 78%|███████▊  | 290511/371472 [57:01<6:25:08,  3.50it/s]
 78%|███████▊  | 290512/371472 [57:01<6:33:09,  3.43it/s]
 78%|███████▊  | 290513/371472 [57:02<6:20:22,  3.55it/s]
 78%|███████▊  | 290514/371472 [57:02<6:35:35,  3.41it/s]
 78%|███████▊  | 290515/371472 [57:02<6:54:49,  3.25it/s]
 78%|███████▊  | 290516/371472 [57:02<6:40:35,  3.37it/s]
 78%|███████▊  | 290517/371472 [57:03<6:26:16,  3.49it/s]
 78%|███████▊  | 290518/371472 [57:03<6:13:21,  3.61it/s]
 78%|███████▊  | 290519/371472 [57:03<6:02:48,  3.72it/s]
 78%|███████▊  | 290520/371472 [57:04<6:01:52,  3.73it/s]
                                                         
{'loss': 2.6249, 'learning_rate': 2.9623564394837206e-07, 'epoch': 12.51}

 78%|███████▊  | 290520/371472 [57:04<6:01:52,  3.73it/s]
 78%|███████▊  | 290521/371472 [57:04<5:54:58,  3.80it/s]
 78%|███████▊  | 290522/371472 [57:04<5:59:59,  3.75it/s]
 78%|███████▊  | 290523/371472 [57:04<7:08:08,  3.15it/s]
 78%|███████▊  | 290524/371472 [57:05<7:11:41,  3.13it/s]
 78%|███████▊  | 290525/371472 [57:05<6:52:17,  3.27it/s]
 78%|███████▊  | 290526/371472 [57:05<6:33:05,  3.43it/s]
 78%|███████▊  | 290527/371472 [57:06<7:00:07,  3.21it/s]
 78%|███████▊  | 290528/371472 [57:06<6:52:53,  3.27it/s]
 78%|███████▊  | 290529/371472 [57:06<7:01:01,  3.20it/s]
 78%|███████▊  | 290530/371472 [57:07<6:45:21,  3.33it/s]
 78%|███████▊  | 290531/371472 [57:07<6:33:40,  3.43it/s]
 78%|███████▊  | 290532/371472 [57:07<6:12:10,  3.62it/s]
 78%|███████▊  | 290533/371472 [57:08<7:51:51,  2.86it/s]
 78%|███████▊  | 290534/371472 [57:08<7:20:02,  3.07it/s]
 78%|███████▊  | 290535/371472 [57:08<6:52:46,  3.27it/s]
 78%|███████▊  | 290536/371472 [57:08<6:49:24,  3.29it/s]
 78%|███████▊  | 290537/371472 [57:09<6:51:13,  3.28it/s]
 78%|███████▊  | 290538/371472 [57:09<6:54:07,  3.26it/s]
 78%|███████▊  | 290539/371472 [57:10<8:23:21,  2.68it/s]
 78%|███████▊  | 290540/371472 [57:10<7:54:01,  2.85it/s]
                                                         
{'loss': 2.7372, 'learning_rate': 2.961871619728932e-07, 'epoch': 12.51}

 78%|███████▊  | 290540/371472 [57:10<7:54:01,  2.85it/s]
 78%|███████▊  | 290541/371472 [57:10<7:30:18,  3.00it/s]
 78%|███████▊  | 290542/371472 [57:10<7:18:18,  3.08it/s]
 78%|███████▊  | 290543/371472 [57:11<6:53:50,  3.26it/s]
 78%|███████▊  | 290544/371472 [57:11<6:46:12,  3.32it/s]
 78%|███████▊  | 290545/371472 [57:11<6:39:38,  3.37it/s]
 78%|███████▊  | 290546/371472 [57:12<6:24:42,  3.51it/s]
 78%|███████▊  | 290547/371472 [57:12<6:18:53,  3.56it/s]
 78%|███████▊  | 290548/371472 [57:12<6:16:01,  3.59it/s]
 78%|███████▊  | 290549/371472 [57:12<6:39:07,  3.38it/s]
 78%|███████▊  | 290550/371472 [57:13<6:28:03,  3.48it/s]
 78%|███████▊  | 290551/371472 [57:13<6:35:21,  3.41it/s]
 78%|███████▊  | 290552/371472 [57:13<6:23:34,  3.52it/s]
 78%|███████▊  | 290553/371472 [57:14<6:08:01,  3.66it/s]
 78%|███████▊  | 290554/371472 [57:14<6:15:45,  3.59it/s]
 78%|███████▊  | 290555/371472 [57:14<6:36:37,  3.40it/s]
 78%|███████▊  | 290556/371472 [57:14<6:39:07,  3.38it/s]
 78%|███████▊  | 290557/371472 [57:15<6:52:22,  3.27it/s]
 78%|███████▊  | 290558/371472 [57:15<7:46:20,  2.89it/s]
 78%|███████▊  | 290559/371472 [57:16<7:25:59,  3.02it/s]
 78%|███████▊  | 290560/371472 [57:16<7:17:25,  3.08it/s]
                                                         
{'loss': 2.6209, 'learning_rate': 2.9613867999741425e-07, 'epoch': 12.51}

 78%|███████▊  | 290560/371472 [57:16<7:17:25,  3.08it/s]
 78%|███████▊  | 290561/371472 [57:16<6:58:49,  3.22it/s]
 78%|███████▊  | 290562/371472 [57:16<7:08:52,  3.14it/s]
 78%|███████▊  | 290563/371472 [57:17<6:51:45,  3.27it/s]
 78%|███████▊  | 290564/371472 [57:17<6:59:32,  3.21it/s]
 78%|███████▊  | 290565/371472 [57:17<6:46:47,  3.31it/s]
 78%|███████▊  | 290566/371472 [57:18<6:47:44,  3.31it/s]
 78%|███████▊  | 290567/371472 [57:18<7:03:37,  3.18it/s]
 78%|███████▊  | 290568/371472 [57:18<6:45:38,  3.32it/s]
 78%|███████▊  | 290569/371472 [57:19<6:33:38,  3.43it/s]
 78%|███████▊  | 290570/371472 [57:19<6:42:25,  3.35it/s]
 78%|███████▊  | 290571/371472 [57:19<6:46:22,  3.32it/s]
 78%|███████▊  | 290572/371472 [57:19<6:47:33,  3.31it/s]
 78%|███████▊  | 290573/371472 [57:20<6:32:49,  3.43it/s]
 78%|███████▊  | 290574/371472 [57:20<6:17:12,  3.57it/s]
 78%|███████▊  | 290575/371472 [57:20<6:18:55,  3.56it/s]
 78%|███████▊  | 290576/371472 [57:21<6:04:41,  3.70it/s]
 78%|███████▊  | 290577/371472 [57:21<6:01:30,  3.73it/s]
 78%|███████▊  | 290578/371472 [57:21<6:07:28,  3.67it/s]
 78%|███████▊  | 290579/371472 [57:21<6:10:13,  3.64it/s]
 78%|███████▊  | 290580/371472 [57:22<6:07:36,  3.67it/s]
                                                         
{'loss': 2.7, 'learning_rate': 2.960901980219354e-07, 'epoch': 12.52}

 78%|███████▊  | 290580/371472 [57:22<6:07:36,  3.67it/s]
 78%|███████▊  | 290581/371472 [57:22<6:13:20,  3.61it/s]
 78%|███████▊  | 290582/371472 [57:22<6:15:06,  3.59it/s]
 78%|███████▊  | 290583/371472 [57:23<6:45:53,  3.32it/s]
 78%|███████▊  | 290584/371472 [57:23<6:22:46,  3.52it/s]
 78%|███████▊  | 290585/371472 [57:23<6:19:41,  3.55it/s]
 78%|███████▊  | 290586/371472 [57:23<6:09:41,  3.65it/s]
 78%|███████▊  | 290587/371472 [57:24<6:59:39,  3.21it/s]
 78%|███████▊  | 290588/371472 [57:24<8:04:26,  2.78it/s]
 78%|███████▊  | 290589/371472 [57:24<7:29:31,  3.00it/s]
 78%|███████▊  | 290590/371472 [57:25<7:08:44,  3.14it/s]
 78%|███████▊  | 290591/371472 [57:25<7:14:51,  3.10it/s]
 78%|███████▊  | 290592/371472 [57:25<7:02:30,  3.19it/s]
 78%|███████▊  | 290593/371472 [57:26<6:35:46,  3.41it/s]
 78%|███████▊  | 290594/371472 [57:26<6:26:18,  3.49it/s]
 78%|███████▊  | 290595/371472 [57:26<6:45:25,  3.32it/s]
 78%|███████▊  | 290596/371472 [57:26<6:33:03,  3.43it/s]
 78%|███████▊  | 290597/371472 [57:27<6:17:18,  3.57it/s]
 78%|███████▊  | 290598/371472 [57:27<6:20:19,  3.54it/s]
 78%|███████▊  | 290599/371472 [57:27<6:15:51,  3.59it/s]
 78%|███████▊  | 290600/371472 [57:28<6:23:01,  3.52it/s]
                                                         
{'loss': 2.655, 'learning_rate': 2.9604171604645645e-07, 'epoch': 12.52}

 78%|███████▊  | 290600/371472 [57:28<6:23:01,  3.52it/s]
 78%|███████▊  | 290601/371472 [57:28<6:39:44,  3.37it/s]
 78%|███████▊  | 290602/371472 [57:28<6:31:46,  3.44it/s]
 78%|███████▊  | 290603/371472 [57:29<6:45:52,  3.32it/s]
 78%|███████▊  | 290604/371472 [57:29<6:28:19,  3.47it/s]
 78%|███████▊  | 290605/371472 [57:29<6:41:16,  3.36it/s]
 78%|███████▊  | 290606/371472 [57:29<6:39:18,  3.38it/s]
 78%|███████▊  | 290607/371472 [57:30<6:37:10,  3.39it/s]
 78%|███████▊  | 290608/371472 [57:30<6:28:49,  3.47it/s]
 78%|███████▊  | 290609/371472 [57:30<6:14:19,  3.60it/s]
 78%|███████▊  | 290610/371472 [57:31<6:28:56,  3.46it/s]
 78%|███████▊  | 290611/371472 [57:31<7:05:25,  3.17it/s]
 78%|███████▊  | 290612/371472 [57:31<7:24:58,  3.03it/s]
 78%|███████▊  | 290613/371472 [57:32<7:22:09,  3.05it/s]
 78%|███████▊  | 290614/371472 [57:32<6:56:10,  3.24it/s]
 78%|███████▊  | 290615/371472 [57:32<6:35:04,  3.41it/s]
 78%|███████▊  | 290616/371472 [57:32<6:23:56,  3.51it/s]
 78%|███████▊  | 290617/371472 [57:33<6:25:15,  3.50it/s]
 78%|███████▊  | 290618/371472 [57:33<6:08:55,  3.65it/s]
 78%|███████▊  | 290619/371472 [57:33<5:58:07,  3.76it/s]
 78%|███████▊  | 290620/371472 [57:33<5:58:02,  3.76it/s]
                                                         
{'loss': 2.6453, 'learning_rate': 2.9599323407097757e-07, 'epoch': 12.52}

 78%|███████▊  | 290620/371472 [57:33<5:58:02,  3.76it/s]
 78%|███████▊  | 290621/371472 [57:34<5:54:18,  3.80it/s]
 78%|███████▊  | 290622/371472 [57:34<5:55:39,  3.79it/s]
 78%|███████▊  | 290623/371472 [57:34<6:28:28,  3.47it/s]
 78%|███████▊  | 290624/371472 [57:35<6:37:28,  3.39it/s]
 78%|███████▊  | 290625/371472 [57:35<6:43:24,  3.34it/s]
 78%|███████▊  | 290626/371472 [57:35<6:37:19,  3.39it/s]
 78%|███████▊  | 290627/371472 [57:35<6:24:07,  3.51it/s]
 78%|███████▊  | 290628/371472 [57:36<7:04:06,  3.18it/s]
 78%|███████▊  | 290629/371472 [57:36<6:48:39,  3.30it/s]
 78%|███████▊  | 290630/371472 [57:36<6:44:16,  3.33it/s]
 78%|███████▊  | 290631/371472 [57:37<6:45:37,  3.32it/s]
 78%|███████▊  | 290632/371472 [57:37<6:32:00,  3.44it/s]
 78%|███████▊  | 290633/371472 [57:37<6:20:37,  3.54it/s]
 78%|███████▊  | 290634/371472 [57:37<6:08:51,  3.65it/s]
 78%|███████▊  | 290635/371472 [57:38<6:17:46,  3.57it/s]
 78%|███████▊  | 290636/371472 [57:38<6:13:16,  3.61it/s]
 78%|███████▊  | 290637/371472 [57:38<6:10:40,  3.63it/s]
 78%|███████▊  | 290638/371472 [57:39<5:58:33,  3.76it/s]
 78%|███████▊  | 290639/371472 [57:39<6:07:08,  3.67it/s]
 78%|███████▊  | 290640/371472 [57:39<6:08:05,  3.66it/s]
                                                         
{'loss': 2.8287, 'learning_rate': 2.9594475209549864e-07, 'epoch': 12.52}

 78%|███████▊  | 290640/371472 [57:39<6:08:05,  3.66it/s]
 78%|███████▊  | 290641/371472 [57:39<6:08:35,  3.66it/s]
 78%|███████▊  | 290642/371472 [57:40<6:01:47,  3.72it/s]
 78%|███████▊  | 290643/371472 [57:40<6:05:51,  3.68it/s]
 78%|███████▊  | 290644/371472 [57:40<6:10:45,  3.63it/s]
 78%|███████▊  | 290645/371472 [57:41<6:35:13,  3.41it/s]
 78%|███████▊  | 290646/371472 [57:41<7:12:53,  3.11it/s]
 78%|███████▊  | 290647/371472 [57:41<7:15:08,  3.10it/s]
 78%|███████▊  | 290648/371472 [57:42<6:53:26,  3.26it/s]
 78%|███████▊  | 290649/371472 [57:42<6:52:01,  3.27it/s]
 78%|███████▊  | 290650/371472 [57:42<6:34:09,  3.42it/s]
 78%|███████▊  | 290651/371472 [57:42<6:59:21,  3.21it/s]
 78%|███████▊  | 290652/371472 [57:43<6:55:06,  3.24it/s]
 78%|███████▊  | 290653/371472 [57:43<7:09:46,  3.13it/s]
 78%|███████▊  | 290654/371472 [57:43<6:45:52,  3.32it/s]
 78%|███████▊  | 290655/371472 [57:44<6:45:12,  3.32it/s]
 78%|███████▊  | 290656/371472 [57:44<6:34:10,  3.42it/s]
 78%|███████▊  | 290657/371472 [57:44<6:36:59,  3.39it/s]
 78%|███████▊  | 290658/371472 [57:44<6:21:32,  3.53it/s]
 78%|███████▊  | 290659/371472 [57:45<6:15:05,  3.59it/s]
 78%|███████▊  | 290660/371472 [57:45<6:32:22,  3.43it/s]
                                                         
{'loss': 2.626, 'learning_rate': 2.958962701200198e-07, 'epoch': 12.52}

 78%|███████▊  | 290660/371472 [57:45<6:32:22,  3.43it/s]
 78%|███████▊  | 290661/371472 [57:45<6:22:30,  3.52it/s]
 78%|███████▊  | 290662/371472 [57:46<6:12:32,  3.62it/s]
 78%|███████▊  | 290663/371472 [57:46<6:47:52,  3.30it/s]
 78%|███████▊  | 290664/371472 [57:46<6:51:09,  3.28it/s]
 78%|███████▊  | 290665/371472 [57:47<6:37:45,  3.39it/s]
 78%|███████▊  | 290666/371472 [57:47<6:30:00,  3.45it/s]
 78%|███████▊  | 290667/371472 [57:47<6:23:43,  3.51it/s]
 78%|███████▊  | 290668/371472 [57:47<6:02:35,  3.71it/s]
 78%|███████▊  | 290669/371472 [57:48<6:16:34,  3.58it/s]
 78%|███████▊  | 290670/371472 [57:48<6:14:40,  3.59it/s]
 78%|███████▊  | 290671/371472 [57:48<7:30:49,  2.99it/s]
 78%|███████▊  | 290672/371472 [57:49<6:49:29,  3.29it/s]
 78%|███████▊  | 290673/371472 [57:49<6:39:37,  3.37it/s]
 78%|███████▊  | 290674/371472 [57:49<6:50:02,  3.28it/s]
 78%|███████▊  | 290675/371472 [57:49<6:37:16,  3.39it/s]
 78%|███████▊  | 290676/371472 [57:50<6:57:41,  3.22it/s]
 78%|███████▊  | 290677/371472 [57:50<6:50:37,  3.28it/s]
 78%|███████▊  | 290678/371472 [57:50<6:59:34,  3.21it/s]
 78%|███████▊  | 290679/371472 [57:51<6:44:26,  3.33it/s]
 78%|███████▊  | 290680/371472 [57:51<6:47:57,  3.30it/s]
                                                         
{'loss': 2.5116, 'learning_rate': 2.9584778814454084e-07, 'epoch': 12.52}

 78%|███████▊  | 290680/371472 [57:51<6:47:57,  3.30it/s]
 78%|███████▊  | 290681/371472 [57:51<7:04:54,  3.17it/s]
 78%|███████▊  | 290682/371472 [57:52<6:46:48,  3.31it/s]
 78%|███████▊  | 290683/371472 [57:52<6:49:15,  3.29it/s]
 78%|███████▊  | 290684/371472 [57:52<6:38:53,  3.38it/s]
 78%|███████▊  | 290685/371472 [57:53<7:07:53,  3.15it/s]
 78%|███████▊  | 290686/371472 [57:53<6:38:28,  3.38it/s]
 78%|███████▊  | 290687/371472 [57:53<6:29:36,  3.46it/s]
 78%|███████▊  | 290688/371472 [57:53<6:12:11,  3.62it/s]
 78%|███████▊  | 290689/371472 [57:54<6:05:38,  3.68it/s]
 78%|███████▊  | 290690/371472 [57:54<6:25:26,  3.49it/s]
 78%|███████▊  | 290691/371472 [57:54<6:39:28,  3.37it/s]
 78%|███████▊  | 290692/371472 [57:55<6:49:21,  3.29it/s]
 78%|███████▊  | 290693/371472 [57:55<6:38:37,  3.38it/s]
 78%|███████▊  | 290694/371472 [57:55<6:20:54,  3.53it/s]
 78%|███████▊  | 290695/371472 [57:55<6:10:24,  3.63it/s]
 78%|███████▊  | 290696/371472 [57:56<6:14:37,  3.59it/s]
 78%|███████▊  | 290697/371472 [57:56<6:06:44,  3.67it/s]
 78%|███████▊  | 290698/371472 [57:56<6:20:22,  3.54it/s]
 78%|███████▊  | 290699/371472 [57:57<6:24:31,  3.50it/s]
 78%|███████▊  | 290700/371472 [57:57<6:10:24,  3.63it/s]
                                                         
{'loss': 2.7038, 'learning_rate': 2.9579930616906207e-07, 'epoch': 12.52}

 78%|███████▊  | 290700/371472 [57:57<6:10:24,  3.63it/s]
 78%|███████▊  | 290701/371472 [57:57<6:01:47,  3.72it/s]
 78%|███████▊  | 290702/371472 [57:57<6:01:58,  3.72it/s]
 78%|███████▊  | 290703/371472 [57:58<5:59:19,  3.75it/s]
 78%|███████▊  | 290704/371472 [57:58<6:03:31,  3.70it/s]
 78%|███████▊  | 290705/371472 [57:58<6:00:15,  3.74it/s]
 78%|███████▊  | 290706/371472 [57:58<5:56:31,  3.78it/s]
 78%|███████▊  | 290707/371472 [57:59<5:58:32,  3.75it/s]
 78%|███████▊  | 290708/371472 [57:59<5:57:48,  3.76it/s]
 78%|███████▊  | 290709/371472 [57:59<6:06:47,  3.67it/s]
 78%|███████▊  | 290710/371472 [57:59<6:08:41,  3.65it/s]
 78%|███████▊  | 290711/371472 [58:00<6:20:19,  3.54it/s]
 78%|███████▊  | 290712/371472 [58:00<6:44:28,  3.33it/s]
 78%|███████▊  | 290713/371472 [58:00<6:34:17,  3.41it/s]
 78%|███████▊  | 290714/371472 [58:01<6:44:52,  3.32it/s]
 78%|███████▊  | 290715/371472 [58:01<6:29:21,  3.46it/s]
 78%|███████▊  | 290716/371472 [58:01<6:28:59,  3.46it/s]
 78%|███████▊  | 290717/371472 [58:02<6:30:14,  3.45it/s]
 78%|███████▊  | 290718/371472 [58:02<6:30:49,  3.44it/s]
 78%|███████▊  | 290719/371472 [58:02<6:25:22,  3.49it/s]
 78%|███████▊  | 290720/371472 [58:02<6:29:12,  3.46it/s]
                                                         
{'loss': 2.7353, 'learning_rate': 2.957508241935831e-07, 'epoch': 12.52}

 78%|███████▊  | 290720/371472 [58:02<6:29:12,  3.46it/s]
 78%|███████▊  | 290721/371472 [58:03<6:28:14,  3.47it/s]
 78%|███████▊  | 290722/371472 [58:03<6:46:55,  3.31it/s]
 78%|███████▊  | 290723/371472 [58:03<6:52:58,  3.26it/s]
 78%|███████▊  | 290724/371472 [58:04<6:35:53,  3.40it/s]
 78%|███████▊  | 290725/371472 [58:04<6:30:09,  3.45it/s]
 78%|███████▊  | 290726/371472 [58:04<6:17:46,  3.56it/s]
 78%|███████▊  | 290727/371472 [58:04<6:05:43,  3.68it/s]
 78%|███████▊  | 290728/371472 [58:05<6:38:51,  3.37it/s]
 78%|███████▊  | 290729/371472 [58:05<6:31:00,  3.44it/s]
 78%|███████▊  | 290730/371472 [58:05<6:21:51,  3.52it/s]
 78%|███████▊  | 290731/371472 [58:06<6:03:42,  3.70it/s]
 78%|███████▊  | 290732/371472 [58:06<6:24:59,  3.50it/s]
 78%|███████▊  | 290733/371472 [58:06<6:35:26,  3.40it/s]
 78%|███████▊  | 290734/371472 [58:07<7:11:17,  3.12it/s]
 78%|███████▊  | 290735/371472 [58:07<6:51:08,  3.27it/s]
 78%|███████▊  | 290736/371472 [58:07<6:37:15,  3.39it/s]
 78%|███████▊  | 290737/371472 [58:07<6:21:31,  3.53it/s]
 78%|███████▊  | 290738/371472 [58:08<6:11:11,  3.63it/s]
 78%|███████▊  | 290739/371472 [58:08<6:16:49,  3.57it/s]
 78%|███████▊  | 290740/371472 [58:08<6:15:44,  3.58it/s]
                                                         
{'loss': 2.5879, 'learning_rate': 2.957023422181042e-07, 'epoch': 12.52}

 78%|███████▊  | 290740/371472 [58:08<6:15:44,  3.58it/s]
 78%|███████▊  | 290741/371472 [58:08<6:09:02,  3.65it/s]
 78%|███████▊  | 290742/371472 [58:09<6:10:22,  3.63it/s]
 78%|███████▊  | 290743/371472 [58:09<6:06:08,  3.67it/s]
 78%|███████▊  | 290744/371472 [58:09<5:56:29,  3.77it/s]
 78%|███████▊  | 290745/371472 [58:10<6:06:20,  3.67it/s]
 78%|███████▊  | 290746/371472 [58:10<6:09:11,  3.64it/s]
 78%|███████▊  | 290747/371472 [58:10<5:52:44,  3.81it/s]
 78%|███████▊  | 290748/371472 [58:10<6:08:00,  3.66it/s]
 78%|███████▊  | 290749/371472 [58:11<6:11:28,  3.62it/s]
 78%|███████▊  | 290750/371472 [58:11<6:15:51,  3.58it/s]
 78%|███████▊  | 290751/371472 [58:11<6:20:51,  3.53it/s]
 78%|███████▊  | 290752/371472 [58:11<6:11:39,  3.62it/s]
 78%|███████▊  | 290753/371472 [58:12<6:13:40,  3.60it/s]
 78%|███████▊  | 290754/371472 [58:12<6:15:34,  3.58it/s]
 78%|███████▊  | 290755/371472 [58:12<6:33:50,  3.42it/s]
 78%|███████▊  | 290756/371472 [58:13<7:09:45,  3.13it/s]
 78%|███████▊  | 290757/371472 [58:13<6:39:50,  3.36it/s]
 78%|███████▊  | 290758/371472 [58:13<6:32:09,  3.43it/s]
 78%|███████▊  | 290759/371472 [58:14<6:37:43,  3.38it/s]
 78%|███████▊  | 290760/371472 [58:14<6:45:22,  3.32it/s]
                                                         
{'loss': 2.6836, 'learning_rate': 2.956538602426253e-07, 'epoch': 12.52}

 78%|███████▊  | 290760/371472 [58:14<6:45:22,  3.32it/s]
 78%|███████▊  | 290761/371472 [58:14<6:56:51,  3.23it/s]
 78%|███████▊  | 290762/371472 [58:14<6:40:19,  3.36it/s]
 78%|███████▊  | 290763/371472 [58:15<6:48:07,  3.30it/s]
 78%|███████▊  | 290764/371472 [58:15<6:21:54,  3.52it/s]
 78%|███████▊  | 290765/371472 [58:15<6:19:01,  3.55it/s]
 78%|███████▊  | 290766/371472 [58:16<6:08:13,  3.65it/s]
 78%|███████▊  | 290767/371472 [58:16<6:26:52,  3.48it/s]
 78%|███████▊  | 290768/371472 [58:16<6:23:50,  3.50it/s]
 78%|███████▊  | 290769/371472 [58:17<6:53:08,  3.26it/s]
 78%|███████▊  | 290770/371472 [58:17<6:35:15,  3.40it/s]
 78%|███████▊  | 290771/371472 [58:17<6:46:33,  3.31it/s]
 78%|███████▊  | 290772/371472 [58:17<6:45:42,  3.32it/s]
 78%|███████▊  | 290773/371472 [58:18<6:40:03,  3.36it/s]
 78%|███████▊  | 290774/371472 [58:18<6:33:07,  3.42it/s]
 78%|███████▊  | 290775/371472 [58:18<6:19:04,  3.55it/s]
 78%|███████▊  | 290776/371472 [58:18<6:02:26,  3.71it/s]
 78%|███████▊  | 290777/371472 [58:19<6:09:48,  3.64it/s]
 78%|███████▊  | 290778/371472 [58:19<5:58:07,  3.76it/s]
 78%|███████▊  | 290779/371472 [58:19<6:15:05,  3.59it/s]
 78%|███████▊  | 290780/371472 [58:20<6:48:57,  3.29it/s]
                                                         
{'loss': 2.7696, 'learning_rate': 2.9560537826714646e-07, 'epoch': 12.52}

 78%|███████▊  | 290780/371472 [58:20<6:48:57,  3.29it/s]
 78%|███████▊  | 290781/371472 [58:20<6:44:50,  3.32it/s]
 78%|███████▊  | 290782/371472 [58:20<6:35:53,  3.40it/s]
 78%|███████▊  | 290783/371472 [58:21<6:32:43,  3.42it/s]
 78%|███████▊  | 290784/371472 [58:21<6:31:16,  3.44it/s]
 78%|███████▊  | 290785/371472 [58:21<6:36:19,  3.39it/s]
 78%|███████▊  | 290786/371472 [58:21<7:01:45,  3.19it/s]
 78%|███████▊  | 290787/371472 [58:22<6:50:47,  3.27it/s]
 78%|███████▊  | 290788/371472 [58:22<6:36:39,  3.39it/s]
 78%|███████▊  | 290789/371472 [58:22<6:31:53,  3.43it/s]
 78%|███████▊  | 290790/371472 [58:23<7:00:04,  3.20it/s]
 78%|███████▊  | 290791/371472 [58:23<6:45:12,  3.32it/s]
 78%|███████▊  | 290792/371472 [58:23<6:30:27,  3.44it/s]
 78%|███████▊  | 290793/371472 [58:24<6:32:56,  3.42it/s]
 78%|███████▊  | 290794/371472 [58:24<6:14:42,  3.59it/s]
 78%|███████▊  | 290795/371472 [58:24<6:08:09,  3.65it/s]
 78%|███████▊  | 290796/371472 [58:24<6:18:19,  3.55it/s]
 78%|███████▊  | 290797/371472 [58:25<6:17:24,  3.56it/s]
 78%|███████▊  | 290798/371472 [58:25<6:18:25,  3.55it/s]
 78%|███████▊  | 290799/371472 [58:25<6:10:41,  3.63it/s]
 78%|███████▊  | 290800/371472 [58:26<6:52:58,  3.26it/s]
                                                         
{'loss': 2.5073, 'learning_rate': 2.9555689629166753e-07, 'epoch': 12.53}

 78%|███████▊  | 290800/371472 [58:26<6:52:58,  3.26it/s]
 78%|███████▊  | 290801/371472 [58:26<6:39:17,  3.37it/s]
 78%|███████▊  | 290802/371472 [58:26<6:29:29,  3.45it/s]
 78%|███████▊  | 290803/371472 [58:26<6:21:52,  3.52it/s]
 78%|███████▊  | 290804/371472 [58:27<6:18:47,  3.55it/s]
 78%|███████▊  | 290805/371472 [58:27<6:22:59,  3.51it/s]
 78%|███████▊  | 290806/371472 [58:27<6:15:24,  3.58it/s]
 78%|███████▊  | 290807/371472 [58:27<6:27:04,  3.47it/s]
 78%|███████▊  | 290808/371472 [58:28<6:06:21,  3.67it/s]
 78%|███████▊  | 290809/371472 [58:28<6:06:31,  3.67it/s]
 78%|███████▊  | 290810/371472 [58:28<6:10:27,  3.63it/s]
 78%|███████▊  | 290811/371472 [58:29<6:17:39,  3.56it/s]
 78%|███████▊  | 290812/371472 [58:29<6:29:43,  3.45it/s]
 78%|███████▊  | 290813/371472 [58:29<6:18:01,  3.56it/s]
 78%|███████▊  | 290814/371472 [58:29<6:15:48,  3.58it/s]
 78%|███████▊  | 290815/371472 [58:30<6:11:48,  3.62it/s]
 78%|███████▊  | 290816/371472 [58:30<6:09:52,  3.63it/s]
 78%|███████▊  | 290817/371472 [58:30<6:21:15,  3.53it/s]
 78%|███████▊  | 290818/371472 [58:31<6:05:29,  3.68it/s]
 78%|███████▊  | 290819/371472 [58:31<6:04:35,  3.69it/s]
 78%|███████▊  | 290820/371472 [58:31<6:07:43,  3.66it/s]
                                                         
{'loss': 2.7461, 'learning_rate': 2.955084143161887e-07, 'epoch': 12.53}

 78%|███████▊  | 290820/371472 [58:31<6:07:43,  3.66it/s]
 78%|███████▊  | 290821/371472 [58:31<6:38:01,  3.38it/s]
 78%|███████▊  | 290822/371472 [58:32<6:37:10,  3.38it/s]
 78%|███████▊  | 290823/371472 [58:32<6:23:42,  3.50it/s]
 78%|███████▊  | 290824/371472 [58:32<6:48:22,  3.29it/s]
 78%|███████▊  | 290825/371472 [58:33<6:29:31,  3.45it/s]
 78%|███████▊  | 290826/371472 [58:33<6:31:04,  3.44it/s]
 78%|███████▊  | 290827/371472 [58:33<6:35:15,  3.40it/s]
 78%|███████▊  | 290828/371472 [58:33<6:21:06,  3.53it/s]
 78%|███████▊  | 290829/371472 [58:34<6:26:35,  3.48it/s]
 78%|███████▊  | 290830/371472 [58:34<6:10:21,  3.63it/s]
 78%|███████▊  | 290831/371472 [58:34<6:30:53,  3.44it/s]
 78%|███████▊  | 290832/371472 [58:35<6:22:54,  3.51it/s]
 78%|███████▊  | 290833/371472 [58:35<6:20:38,  3.53it/s]
 78%|███████▊  | 290834/371472 [58:35<6:06:11,  3.67it/s]
 78%|███████▊  | 290835/371472 [58:35<5:59:53,  3.73it/s]
 78%|███████▊  | 290836/371472 [58:36<6:21:01,  3.53it/s]
 78%|███████▊  | 290837/371472 [58:36<6:08:11,  3.65it/s]
 78%|███████▊  | 290838/371472 [58:36<6:12:17,  3.61it/s]
 78%|███████▊  | 290839/371472 [58:37<6:32:54,  3.42it/s]
 78%|███████▊  | 290840/371472 [58:37<6:16:19,  3.57it/s]
                                                         
{'loss': 2.7101, 'learning_rate': 2.9545993234070973e-07, 'epoch': 12.53}

 78%|███████▊  | 290840/371472 [58:37<6:16:19,  3.57it/s]
 78%|███████▊  | 290841/371472 [58:37<6:04:51,  3.68it/s]
 78%|███████▊  | 290842/371472 [58:37<6:28:31,  3.46it/s]
 78%|███████▊  | 290843/371472 [58:38<6:16:52,  3.57it/s]
 78%|███████▊  | 290844/371472 [58:38<6:11:32,  3.62it/s]
 78%|███████▊  | 290845/371472 [58:38<6:11:56,  3.61it/s]
 78%|███████▊  | 290846/371472 [58:38<6:21:19,  3.52it/s]
 78%|███████▊  | 290847/371472 [58:39<6:13:17,  3.60it/s]
 78%|███████▊  | 290848/371472 [58:39<6:07:34,  3.66it/s]
 78%|███████▊  | 290849/371472 [58:39<6:23:41,  3.50it/s]
 78%|███████▊  | 290850/371472 [58:40<6:24:43,  3.49it/s]
 78%|███████▊  | 290851/371472 [58:40<6:18:01,  3.55it/s]
 78%|███████▊  | 290852/371472 [58:40<6:16:18,  3.57it/s]
 78%|███████▊  | 290853/371472 [58:40<6:13:05,  3.60it/s]
 78%|███████▊  | 290854/371472 [58:41<6:06:01,  3.67it/s]
 78%|███████▊  | 290855/371472 [58:41<6:04:29,  3.69it/s]
 78%|███████▊  | 290856/371472 [58:41<5:59:03,  3.74it/s]
 78%|███████▊  | 290857/371472 [58:41<6:01:55,  3.71it/s]
 78%|███████▊  | 290858/371472 [58:42<6:07:05,  3.66it/s]
 78%|███████▊  | 290859/371472 [58:42<6:05:02,  3.68it/s]
 78%|███████▊  | 290860/371472 [58:42<6:11:45,  3.61it/s]
                                                         
{'loss': 2.6116, 'learning_rate': 2.954114503652309e-07, 'epoch': 12.53}

 78%|███████▊  | 290860/371472 [58:42<6:11:45,  3.61it/s]
 78%|███████▊  | 290861/371472 [58:43<6:24:56,  3.49it/s]
 78%|███████▊  | 290862/371472 [58:43<6:25:47,  3.48it/s]
 78%|███████▊  | 290863/371472 [58:43<6:17:47,  3.56it/s]
 78%|███████▊  | 290864/371472 [58:43<6:09:33,  3.64it/s]
 78%|███████▊  | 290865/371472 [58:44<6:10:04,  3.63it/s]
 78%|███████▊  | 290866/371472 [58:44<5:58:15,  3.75it/s]
 78%|███████▊  | 290867/371472 [58:44<5:51:30,  3.82it/s]
 78%|███████▊  | 290868/371472 [58:44<6:00:11,  3.73it/s]
 78%|███████▊  | 290869/371472 [58:45<5:54:35,  3.79it/s]
 78%|███████▊  | 290870/371472 [58:45<5:48:27,  3.86it/s]
 78%|███████▊  | 290871/371472 [58:45<5:57:51,  3.75it/s]
 78%|███████▊  | 290872/371472 [58:46<6:01:30,  3.72it/s]
 78%|███████▊  | 290873/371472 [58:46<5:54:01,  3.79it/s]
 78%|███████▊  | 290874/371472 [58:46<5:56:59,  3.76it/s]
 78%|███████▊  | 290875/371472 [58:46<6:14:48,  3.58it/s]
 78%|███████▊  | 290876/371472 [58:47<6:03:28,  3.70it/s]
 78%|███████▊  | 290877/371472 [58:47<6:18:06,  3.55it/s]
 78%|███████▊  | 290878/371472 [58:47<6:10:32,  3.63it/s]
 78%|███████▊  | 290879/371472 [58:47<6:13:13,  3.60it/s]
 78%|███████▊  | 290880/371472 [58:48<6:18:11,  3.55it/s]
                                                         
{'loss': 2.7061, 'learning_rate': 2.953629683897519e-07, 'epoch': 12.53}

 78%|███████▊  | 290880/371472 [58:48<6:18:11,  3.55it/s]
 78%|███████▊  | 290881/371472 [58:48<6:08:05,  3.65it/s]
 78%|███████▊  | 290882/371472 [58:48<6:03:32,  3.69it/s]
 78%|███████▊  | 290883/371472 [58:49<6:04:21,  3.69it/s]
 78%|███████▊  | 290884/371472 [58:49<6:32:17,  3.42it/s]
 78%|███████▊  | 290885/371472 [58:49<6:26:54,  3.47it/s]
 78%|███████▊  | 290886/371472 [58:49<6:20:14,  3.53it/s]
 78%|███████▊  | 290887/371472 [58:50<6:17:36,  3.56it/s]
 78%|███████▊  | 290888/371472 [58:50<6:08:10,  3.65it/s]
 78%|███████▊  | 290889/371472 [58:50<6:07:21,  3.66it/s]
 78%|███████▊  | 290890/371472 [58:51<6:10:56,  3.62it/s]
 78%|███████▊  | 290891/371472 [58:51<6:08:50,  3.64it/s]
 78%|███████▊  | 290892/371472 [58:51<6:01:54,  3.71it/s]
 78%|███████▊  | 290893/371472 [58:51<6:02:03,  3.71it/s]
 78%|███████▊  | 290894/371472 [58:52<6:38:54,  3.37it/s]
 78%|███████▊  | 290895/371472 [58:52<6:15:30,  3.58it/s]
 78%|███████▊  | 290896/371472 [58:52<6:13:25,  3.60it/s]
 78%|███████▊  | 290897/371472 [58:53<6:46:32,  3.30it/s]
 78%|███████▊  | 290898/371472 [58:53<6:44:33,  3.32it/s]
 78%|███████▊  | 290899/371472 [58:53<6:41:19,  3.35it/s]
 78%|███████▊  | 290900/371472 [58:53<6:25:06,  3.49it/s]
                                                         
{'loss': 2.6589, 'learning_rate': 2.953144864142731e-07, 'epoch': 12.53}

 78%|███████▊  | 290900/371472 [58:53<6:25:06,  3.49it/s]
 78%|███████▊  | 290901/371472 [58:54<6:08:35,  3.64it/s]
 78%|███████▊  | 290902/371472 [58:54<6:13:56,  3.59it/s]
 78%|███████▊  | 290903/371472 [58:54<6:10:08,  3.63it/s]
 78%|███████▊  | 290904/371472 [58:55<6:05:23,  3.67it/s]
 78%|███████▊  | 290905/371472 [58:55<5:59:18,  3.74it/s]
 78%|███████▊  | 290906/371472 [58:55<5:55:38,  3.78it/s]
 78%|███████▊  | 290907/371472 [58:55<6:02:44,  3.70it/s]
 78%|███████▊  | 290908/371472 [58:56<6:19:29,  3.54it/s]
 78%|███████▊  | 290909/371472 [58:56<6:08:57,  3.64it/s]
 78%|███████▊  | 290910/371472 [58:56<6:16:28,  3.57it/s]
 78%|███████▊  | 290911/371472 [58:56<6:31:48,  3.43it/s]
 78%|███████▊  | 290912/371472 [58:57<6:22:35,  3.51it/s]
 78%|███████▊  | 290913/371472 [58:57<6:54:34,  3.24it/s]
 78%|███████▊  | 290914/371472 [58:57<6:55:42,  3.23it/s]
 78%|███████▊  | 290915/371472 [58:58<6:34:12,  3.41it/s]
 78%|███████▊  | 290916/371472 [58:58<6:26:36,  3.47it/s]
 78%|███████▊  | 290917/371472 [58:58<6:20:05,  3.53it/s]
 78%|███████▊  | 290918/371472 [58:58<6:02:24,  3.70it/s]
 78%|███████▊  | 290919/371472 [58:59<6:00:02,  3.73it/s]
 78%|███████▊  | 290920/371472 [58:59<5:52:28,  3.81it/s]
                                                         
{'loss': 2.5656, 'learning_rate': 2.952660044387942e-07, 'epoch': 12.53}

 78%|███████▊  | 290920/371472 [58:59<5:52:28,  3.81it/s]
 78%|███████▊  | 290921/371472 [58:59<5:51:08,  3.82it/s]
 78%|███████▊  | 290922/371472 [59:00<5:49:45,  3.84it/s]
 78%|███████▊  | 290923/371472 [59:00<6:13:25,  3.59it/s]
 78%|███████▊  | 290924/371472 [59:00<6:11:57,  3.61it/s]
 78%|███████▊  | 290925/371472 [59:00<6:42:54,  3.33it/s]
 78%|███████▊  | 290926/371472 [59:01<6:30:00,  3.44it/s]
 78%|███████▊  | 290927/371472 [59:01<6:22:33,  3.51it/s]
 78%|███████▊  | 290928/371472 [59:01<6:27:58,  3.46it/s]
 78%|███████▊  | 290929/371472 [59:02<6:40:40,  3.35it/s]
 78%|███████▊  | 290930/371472 [59:02<6:42:35,  3.33it/s]
 78%|███████▊  | 290931/371472 [59:02<6:30:38,  3.44it/s]
 78%|███████▊  | 290932/371472 [59:02<6:34:00,  3.41it/s]
 78%|███████▊  | 290933/371472 [59:03<7:12:09,  3.11it/s]
 78%|███████▊  | 290934/371472 [59:03<6:47:01,  3.30it/s]
 78%|███████▊  | 290935/371472 [59:03<6:57:36,  3.21it/s]
 78%|███████▊  | 290936/371472 [59:04<6:48:59,  3.28it/s]
 78%|███████▊  | 290937/371472 [59:04<6:41:58,  3.34it/s]
 78%|███████▊  | 290938/371472 [59:04<6:38:58,  3.36it/s]
 78%|███████▊  | 290939/371472 [59:05<6:23:53,  3.50it/s]
 78%|███████▊  | 290940/371472 [59:05<6:23:23,  3.50it/s]
                                                         
{'loss': 2.6399, 'learning_rate': 2.9521752246331535e-07, 'epoch': 12.53}

 78%|███████▊  | 290940/371472 [59:05<6:23:23,  3.50it/s]
 78%|███████▊  | 290941/371472 [59:05<6:28:46,  3.45it/s]
 78%|███████▊  | 290942/371472 [59:05<6:28:41,  3.45it/s]
 78%|███████▊  | 290943/371472 [59:06<6:33:36,  3.41it/s]
 78%|███████▊  | 290944/371472 [59:06<7:25:02,  3.02it/s]
 78%|███████▊  | 290945/371472 [59:07<7:27:22,  3.00it/s]
 78%|███████▊  | 290946/371472 [59:07<6:57:57,  3.21it/s]
 78%|███████▊  | 290947/371472 [59:07<6:32:43,  3.42it/s]
 78%|███████▊  | 290948/371472 [59:07<6:20:13,  3.53it/s]
 78%|███████▊  | 290949/371472 [59:08<6:17:52,  3.55it/s]
 78%|███████▊  | 290950/371472 [59:08<6:21:03,  3.52it/s]
 78%|███████▊  | 290951/371472 [59:08<6:15:40,  3.57it/s]
 78%|███████▊  | 290952/371472 [59:08<6:02:05,  3.71it/s]
 78%|███████▊  | 290953/371472 [59:09<6:02:23,  3.70it/s]
 78%|███████▊  | 290954/371472 [59:09<5:58:50,  3.74it/s]
 78%|███████▊  | 290955/371472 [59:09<5:51:25,  3.82it/s]
 78%|███████▊  | 290956/371472 [59:09<5:52:22,  3.81it/s]
 78%|███████▊  | 290957/371472 [59:10<6:32:32,  3.42it/s]
 78%|███████▊  | 290958/371472 [59:10<6:18:39,  3.54it/s]
 78%|███████▊  | 290959/371472 [59:10<6:45:46,  3.31it/s]
 78%|███████▊  | 290960/371472 [59:11<6:28:02,  3.46it/s]
                                                         
{'loss': 2.4765, 'learning_rate': 2.951690404878364e-07, 'epoch': 12.53}

 78%|███████▊  | 290960/371472 [59:11<6:28:02,  3.46it/s]
 78%|███████▊  | 290961/371472 [59:11<6:27:35,  3.46it/s]
 78%|███████▊  | 290962/371472 [59:11<6:28:34,  3.45it/s]
 78%|███████▊  | 290963/371472 [59:12<6:54:50,  3.23it/s]
 78%|███████▊  | 290964/371472 [59:12<6:38:59,  3.36it/s]
 78%|███████▊  | 290965/371472 [59:12<6:20:18,  3.53it/s]
 78%|███████▊  | 290966/371472 [59:12<6:19:21,  3.54it/s]
 78%|███████▊  | 290967/371472 [59:13<6:24:57,  3.49it/s]
 78%|███████▊  | 290968/371472 [59:13<6:19:59,  3.53it/s]
 78%|███████▊  | 290969/371472 [59:13<6:07:11,  3.65it/s]
 78%|███████▊  | 290970/371472 [59:14<6:15:21,  3.57it/s]
 78%|███████▊  | 290971/371472 [59:14<6:07:37,  3.65it/s]
 78%|███████▊  | 290972/371472 [59:14<6:21:22,  3.52it/s]
 78%|███████▊  | 290973/371472 [59:14<6:21:39,  3.52it/s]
 78%|███████▊  | 290974/371472 [59:15<6:52:27,  3.25it/s]
 78%|███████▊  | 290975/371472 [59:15<6:52:48,  3.25it/s]
 78%|███████▊  | 290976/371472 [59:15<6:28:38,  3.45it/s]
 78%|███████▊  | 290977/371472 [59:16<6:30:16,  3.44it/s]
 78%|███████▊  | 290978/371472 [59:16<6:26:11,  3.47it/s]
 78%|███████▊  | 290979/371472 [59:16<6:30:49,  3.43it/s]
 78%|███████▊  | 290980/371472 [59:16<6:46:33,  3.30it/s]
                                                         
{'loss': 2.692, 'learning_rate': 2.9512055851235755e-07, 'epoch': 12.53}

 78%|███████▊  | 290980/371472 [59:16<6:46:33,  3.30it/s]
 78%|███████▊  | 290981/371472 [59:17<6:43:24,  3.33it/s]
 78%|███████▊  | 290982/371472 [59:17<6:47:52,  3.29it/s]
 78%|███████▊  | 290983/371472 [59:17<6:43:32,  3.32it/s]
 78%|███████▊  | 290984/371472 [59:18<6:23:35,  3.50it/s]
 78%|███████▊  | 290985/371472 [59:18<6:13:15,  3.59it/s]
 78%|███████▊  | 290986/371472 [59:18<6:33:58,  3.40it/s]
 78%|███████▊  | 290987/371472 [59:18<6:24:54,  3.48it/s]
 78%|███████▊  | 290988/371472 [59:19<6:33:12,  3.41it/s]
 78%|███████▊  | 290989/371472 [59:19<6:13:13,  3.59it/s]
 78%|███████▊  | 290990/371472 [59:19<6:10:01,  3.63it/s]
 78%|███████▊  | 290991/371472 [59:20<5:58:25,  3.74it/s]
 78%|███████▊  | 290992/371472 [59:20<6:13:54,  3.59it/s]
 78%|███████▊  | 290993/371472 [59:20<6:19:44,  3.53it/s]
 78%|███████▊  | 290994/371472 [59:21<7:02:31,  3.17it/s]
 78%|███████▊  | 290995/371472 [59:21<6:58:54,  3.20it/s]
 78%|███████▊  | 290996/371472 [59:21<6:39:11,  3.36it/s]
 78%|███████▊  | 290997/371472 [59:21<6:25:43,  3.48it/s]
 78%|███████▊  | 290998/371472 [59:22<6:14:33,  3.58it/s]
 78%|███████▊  | 290999/371472 [59:22<6:11:10,  3.61it/s]
 78%|███████▊  | 291000/371472 [59:22<6:00:43,  3.72it/s]
                                                         
{'loss': 2.5797, 'learning_rate': 2.9507207653687857e-07, 'epoch': 12.53}

 78%|███████▊  | 291000/371472 [59:22<6:00:43,  3.72it/s]
 78%|███████▊  | 291001/371472 [59:22<6:01:03,  3.71it/s]
 78%|███████▊  | 291002/371472 [59:23<5:55:27,  3.77it/s]
 78%|███████▊  | 291003/371472 [59:23<6:00:48,  3.72it/s]
 78%|███████▊  | 291004/371472 [59:23<5:59:00,  3.74it/s]
 78%|███████▊  | 291005/371472 [59:23<5:58:40,  3.74it/s]
 78%|███████▊  | 291006/371472 [59:24<5:55:33,  3.77it/s]
 78%|███████▊  | 291007/371472 [59:24<5:49:38,  3.84it/s]
 78%|███████▊  | 291008/371472 [59:24<5:54:38,  3.78it/s]
 78%|███████▊  | 291009/371472 [59:25<6:01:45,  3.71it/s]
 78%|███████▊  | 291010/371472 [59:25<5:55:11,  3.78it/s]
 78%|███████▊  | 291011/371472 [59:25<6:52:35,  3.25it/s]
 78%|███████▊  | 291012/371472 [59:26<7:13:39,  3.09it/s]
 78%|███████▊  | 291013/371472 [59:26<6:59:21,  3.20it/s]
 78%|███████▊  | 291014/371472 [59:26<7:13:11,  3.10it/s]
 78%|███████▊  | 291015/371472 [59:26<6:52:44,  3.25it/s]
 78%|███████▊  | 291016/371472 [59:27<6:38:20,  3.37it/s]
 78%|███████▊  | 291017/371472 [59:27<6:31:18,  3.43it/s]
 78%|███████▊  | 291018/371472 [59:27<6:16:24,  3.56it/s]
 78%|███████▊  | 291019/371472 [59:28<6:25:36,  3.48it/s]
 78%|███████▊  | 291020/371472 [59:28<6:21:33,  3.51it/s]
                                                         
{'loss': 2.5788, 'learning_rate': 2.9502359456139974e-07, 'epoch': 12.53}

 78%|███████▊  | 291020/371472 [59:28<6:21:33,  3.51it/s]
 78%|███████▊  | 291021/371472 [59:28<6:13:41,  3.59it/s]
 78%|███████▊  | 291022/371472 [59:28<6:16:51,  3.56it/s]
 78%|███████▊  | 291023/371472 [59:29<6:19:19,  3.53it/s]
 78%|███████▊  | 291024/371472 [59:29<6:38:19,  3.37it/s]
 78%|███████▊  | 291025/371472 [59:29<6:31:57,  3.42it/s]
 78%|███████▊  | 291026/371472 [59:30<6:15:32,  3.57it/s]
 78%|███████▊  | 291027/371472 [59:30<6:15:43,  3.57it/s]
 78%|███████▊  | 291028/371472 [59:30<6:12:16,  3.60it/s]
 78%|███████▊  | 291029/371472 [59:30<6:48:40,  3.28it/s]
 78%|███████▊  | 291030/371472 [59:31<6:49:20,  3.28it/s]
 78%|███████▊  | 291031/371472 [59:31<6:30:41,  3.43it/s]
 78%|███████▊  | 291032/371472 [59:31<6:42:13,  3.33it/s]
 78%|███████▊  | 291033/371472 [59:32<6:22:46,  3.50it/s]
 78%|███████▊  | 291034/371472 [59:32<6:08:55,  3.63it/s]
 78%|███████▊  | 291035/371472 [59:32<6:27:05,  3.46it/s]
 78%|███████▊  | 291036/371472 [59:32<6:20:33,  3.52it/s]
 78%|███████▊  | 291037/371472 [59:33<6:38:20,  3.37it/s]
 78%|███████▊  | 291038/371472 [59:33<6:48:58,  3.28it/s]
 78%|███████▊  | 291039/371472 [59:33<6:51:24,  3.26it/s]
 78%|███████▊  | 291040/371472 [59:34<6:42:21,  3.33it/s]
                                                         
{'loss': 2.6033, 'learning_rate': 2.949751125859208e-07, 'epoch': 12.54}

 78%|███████▊  | 291040/371472 [59:34<6:42:21,  3.33it/s]
 78%|███████▊  | 291041/371472 [59:34<6:40:06,  3.35it/s]
 78%|███████▊  | 291042/371472 [59:34<6:20:31,  3.52it/s]
 78%|███████▊  | 291043/371472 [59:35<6:31:35,  3.42it/s]
 78%|███████▊  | 291044/371472 [59:35<6:19:16,  3.53it/s]
 78%|███████▊  | 291045/371472 [59:35<6:23:17,  3.50it/s]
 78%|███████▊  | 291046/371472 [59:35<6:48:09,  3.28it/s]
 78%|███████▊  | 291047/371472 [59:36<7:16:47,  3.07it/s]
 78%|███████▊  | 291048/371472 [59:36<7:05:48,  3.15it/s]
 78%|███████▊  | 291049/371472 [59:36<7:07:44,  3.13it/s]
 78%|███████▊  | 291050/371472 [59:37<6:51:53,  3.25it/s]
 78%|███████▊  | 291051/371472 [59:37<6:41:34,  3.34it/s]
 78%|███████▊  | 291052/371472 [59:37<6:48:51,  3.28it/s]
 78%|███████▊  | 291053/371472 [59:38<6:30:05,  3.44it/s]
 78%|███████▊  | 291054/371472 [59:38<6:12:12,  3.60it/s]
 78%|███████▊  | 291055/371472 [59:38<6:00:52,  3.71it/s]
 78%|███████▊  | 291056/371472 [59:38<6:04:44,  3.67it/s]
 78%|███████▊  | 291057/371472 [59:39<6:15:49,  3.57it/s]
 78%|███████▊  | 291058/371472 [59:39<6:31:26,  3.42it/s]
 78%|███████▊  | 291059/371472 [59:39<6:42:41,  3.33it/s]
 78%|███████▊  | 291060/371472 [59:40<6:32:43,  3.41it/s]
                                                         
{'loss': 2.6274, 'learning_rate': 2.94926630610442e-07, 'epoch': 12.54}

 78%|███████▊  | 291060/371472 [59:40<6:32:43,  3.41it/s]
 78%|███████▊  | 291061/371472 [59:40<6:29:42,  3.44it/s]
 78%|███████▊  | 291062/371472 [59:40<6:38:54,  3.36it/s]
 78%|███████▊  | 291063/371472 [59:40<6:22:54,  3.50it/s]
 78%|███████▊  | 291064/371472 [59:41<6:18:02,  3.54it/s]
 78%|███████▊  | 291065/371472 [59:41<6:18:25,  3.54it/s]
 78%|███████▊  | 291066/371472 [59:41<6:16:27,  3.56it/s]
 78%|███████▊  | 291067/371472 [59:42<6:33:02,  3.41it/s]
 78%|███████▊  | 291068/371472 [59:42<6:34:34,  3.40it/s]
 78%|███████▊  | 291069/371472 [59:42<6:28:29,  3.45it/s]
 78%|███████▊  | 291070/371472 [59:42<6:21:50,  3.51it/s]
 78%|███████▊  | 291071/371472 [59:43<6:06:52,  3.65it/s]
 78%|███████▊  | 291072/371472 [59:43<6:08:59,  3.63it/s]
 78%|███████▊  | 291073/371472 [59:43<6:15:59,  3.56it/s]
 78%|███████▊  | 291074/371472 [59:44<6:25:30,  3.48it/s]
 78%|███████▊  | 291075/371472 [59:44<6:45:24,  3.31it/s]
 78%|███████▊  | 291076/371472 [59:44<6:19:49,  3.53it/s]
 78%|███████▊  | 291077/371472 [59:44<6:10:17,  3.62it/s]
 78%|███████▊  | 291078/371472 [59:45<6:06:18,  3.66it/s]
 78%|███████▊  | 291079/371472 [59:45<6:07:11,  3.65it/s]
 78%|███████▊  | 291080/371472 [59:45<6:12:22,  3.60it/s]
                                                         
{'loss': 2.5821, 'learning_rate': 2.9487814863496306e-07, 'epoch': 12.54}

 78%|███████▊  | 291080/371472 [59:45<6:12:22,  3.60it/s]
 78%|███████▊  | 291081/371472 [59:46<6:21:53,  3.51it/s]
 78%|███████▊  | 291082/371472 [59:46<6:14:10,  3.58it/s]
 78%|███████▊  | 291083/371472 [59:46<6:02:47,  3.69it/s]
 78%|███████▊  | 291084/371472 [59:46<6:01:02,  3.71it/s]
 78%|███████▊  | 291085/371472 [59:47<6:00:27,  3.72it/s]
 78%|███████▊  | 291086/371472 [59:47<6:13:45,  3.58it/s]
 78%|███████▊  | 291087/371472 [59:47<6:23:34,  3.49it/s]
 78%|███████▊  | 291088/371472 [59:48<6:21:59,  3.51it/s]
 78%|███████▊  | 291089/371472 [59:48<6:35:00,  3.39it/s]
 78%|███████▊  | 291090/371472 [59:48<6:41:18,  3.34it/s]
 78%|███████▊  | 291091/371472 [59:48<6:51:37,  3.25it/s]
 78%|███████▊  | 291092/371472 [59:49<6:44:40,  3.31it/s]
 78%|███████▊  | 291093/371472 [59:49<6:29:26,  3.44it/s]
 78%|███████▊  | 291094/371472 [59:49<6:16:24,  3.56it/s]
 78%|███████▊  | 291095/371472 [59:50<6:29:51,  3.44it/s]
 78%|███████▊  | 291096/371472 [59:50<6:24:35,  3.48it/s]
 78%|███████▊  | 291097/371472 [59:50<6:11:41,  3.60it/s]
 78%|███████▊  | 291098/371472 [59:50<6:17:38,  3.55it/s]
 78%|███████▊  | 291099/371472 [59:51<6:08:57,  3.63it/s]
 78%|███████▊  | 291100/371472 [59:51<6:37:50,  3.37it/s]
                                                         
{'loss': 2.6164, 'learning_rate': 2.9482966665948414e-07, 'epoch': 12.54}

 78%|███████▊  | 291100/371472 [59:51<6:37:50,  3.37it/s]
 78%|███████▊  | 291101/371472 [59:51<6:33:11,  3.41it/s]
 78%|███████▊  | 291102/371472 [59:52<6:37:07,  3.37it/s]
 78%|███████▊  | 291103/371472 [59:52<6:59:52,  3.19it/s]
 78%|███████▊  | 291104/371472 [59:52<6:57:46,  3.21it/s]
 78%|███████▊  | 291105/371472 [59:53<6:29:13,  3.44it/s]
 78%|███████▊  | 291106/371472 [59:53<6:15:24,  3.57it/s]
 78%|███████▊  | 291107/371472 [59:53<6:10:07,  3.62it/s]
 78%|███████▊  | 291108/371472 [59:53<6:31:52,  3.42it/s]
 78%|███████▊  | 291109/371472 [59:54<6:37:52,  3.37it/s]
 78%|███████▊  | 291110/371472 [59:54<6:28:18,  3.45it/s]
 78%|███████▊  | 291111/371472 [59:54<6:09:32,  3.62it/s]
 78%|███████▊  | 291112/371472 [59:54<6:07:17,  3.65it/s]
 78%|███████▊  | 291113/371472 [59:55<5:59:18,  3.73it/s]
 78%|███████▊  | 291114/371472 [59:55<6:06:57,  3.65it/s]
 78%|███████▊  | 291115/371472 [59:55<5:58:20,  3.74it/s]
 78%|███████▊  | 291116/371472 [59:56<6:45:33,  3.30it/s]
 78%|███████▊  | 291117/371472 [59:56<6:31:04,  3.42it/s]
 78%|███████▊  | 291118/371472 [59:56<6:34:03,  3.40it/s]
 78%|███████▊  | 291119/371472 [59:56<6:22:07,  3.50it/s]
 78%|███████▊  | 291120/371472 [59:57<6:12:30,  3.60it/s]
                                                         
{'loss': 2.637, 'learning_rate': 2.947811846840052e-07, 'epoch': 12.54}

 78%|███████▊  | 291120/371472 [59:57<6:12:30,  3.60it/s]
 78%|███████▊  | 291121/371472 [59:57<6:11:50,  3.60it/s]
 78%|███████▊  | 291122/371472 [59:57<6:12:23,  3.60it/s]
 78%|███████▊  | 291123/371472 [59:58<6:14:24,  3.58it/s]
 78%|███████▊  | 291124/371472 [59:58<6:09:40,  3.62it/s]
 78%|███████▊  | 291125/371472 [59:58<5:56:49,  3.75it/s]
 78%|███████▊  | 291126/371472 [59:58<5:52:56,  3.79it/s]
 78%|███████▊  | 291127/371472 [59:59<5:41:22,  3.92it/s]
 78%|███████▊  | 291128/371472 [59:59<5:43:34,  3.90it/s]
 78%|███████▊  | 291129/371472 [59:59<5:44:20,  3.89it/s]
 78%|███████▊  | 291130/371472 [59:59<5:45:23,  3.88it/s]
 78%|███████▊  | 291131/371472 [1:00:00<5:45:19,  3.88it/s]
 78%|███████▊  | 291132/371472 [1:00:00<6:16:15,  3.56it/s]
 78%|███████▊  | 291133/371472 [1:00:00<6:20:19,  3.52it/s]
 78%|███████▊  | 291134/371472 [1:00:01<6:24:04,  3.49it/s]
 78%|███████▊  | 291135/371472 [1:00:01<6:06:56,  3.65it/s]
 78%|███████▊  | 291136/371472 [1:00:01<6:25:36,  3.47it/s]
 78%|███████▊  | 291137/371472 [1:00:01<6:55:49,  3.22it/s]
 78%|███████▊  | 291138/371472 [1:00:02<6:31:48,  3.42it/s]
 78%|███████▊  | 291139/371472 [1:00:02<6:22:49,  3.50it/s]
 78%|███████▊  | 291140/371472 [1:00:02<6:14:34,  3.57it/s]
                                                           
{'loss': 2.7307, 'learning_rate': 2.947327027085263e-07, 'epoch': 12.54}

 78%|███████▊  | 291140/371472 [1:00:02<6:14:34,  3.57it/s]
 78%|███████▊  | 291141/371472 [1:00:03<6:21:22,  3.51it/s]
 78%|███████▊  | 291142/371472 [1:00:03<6:06:40,  3.65it/s]
 78%|███████▊  | 291143/371472 [1:00:03<6:18:23,  3.54it/s]
 78%|███████▊  | 291144/371472 [1:00:03<6:03:44,  3.68it/s]
 78%|███████▊  | 291145/371472 [1:00:04<6:12:11,  3.60it/s]
 78%|███████▊  | 291146/371472 [1:00:04<6:06:19,  3.65it/s]
 78%|███████▊  | 291147/371472 [1:00:04<5:59:29,  3.72it/s]
 78%|███████▊  | 291148/371472 [1:00:04<6:05:32,  3.66it/s]
 78%|███████▊  | 291149/371472 [1:00:05<6:06:20,  3.65it/s]
 78%|███████▊  | 291150/371472 [1:00:05<6:13:06,  3.59it/s]
 78%|███████▊  | 291151/371472 [1:00:05<6:08:14,  3.64it/s]
 78%|███████▊  | 291152/371472 [1:00:06<5:55:09,  3.77it/s]
 78%|███████▊  | 291153/371472 [1:00:06<5:51:29,  3.81it/s]
 78%|███████▊  | 291154/371472 [1:00:06<6:09:10,  3.63it/s]
 78%|███████▊  | 291155/371472 [1:00:06<6:05:39,  3.66it/s]
 78%|███████▊  | 291156/371472 [1:00:07<6:07:41,  3.64it/s]
 78%|███████▊  | 291157/371472 [1:00:07<6:20:51,  3.51it/s]
 78%|███████▊  | 291158/371472 [1:00:07<6:14:35,  3.57it/s]
 78%|███████▊  | 291159/371472 [1:00:07<6:18:06,  3.54it/s]
 78%|███████▊  | 291160/371472 [1:00:08<6:30:12,  3.43it/s]
                                                           
{'loss': 2.73, 'learning_rate': 2.9468422073304746e-07, 'epoch': 12.54}

 78%|███████▊  | 291160/371472 [1:00:08<6:30:12,  3.43it/s]
 78%|███████▊  | 291161/371472 [1:00:08<6:42:37,  3.32it/s]
 78%|███████▊  | 291162/371472 [1:00:08<6:46:25,  3.29it/s]
 78%|███████▊  | 291163/371472 [1:00:09<6:25:28,  3.47it/s]
 78%|███████▊  | 291164/371472 [1:00:09<6:18:20,  3.54it/s]
 78%|███████▊  | 291165/371472 [1:00:09<6:30:31,  3.43it/s]
 78%|███████▊  | 291166/371472 [1:00:10<6:13:47,  3.58it/s]
 78%|███████▊  | 291167/371472 [1:00:10<6:25:45,  3.47it/s]
 78%|███████▊  | 291168/371472 [1:00:10<6:25:47,  3.47it/s]
 78%|███████▊  | 291169/371472 [1:00:10<6:44:54,  3.31it/s]
 78%|███████▊  | 291170/371472 [1:00:11<6:36:15,  3.38it/s]
 78%|███████▊  | 291171/371472 [1:00:11<6:23:33,  3.49it/s]
 78%|███████▊  | 291172/371472 [1:00:11<6:33:42,  3.40it/s]
 78%|███████▊  | 291173/371472 [1:00:12<6:45:42,  3.30it/s]
 78%|███████▊  | 291174/371472 [1:00:12<6:39:22,  3.35it/s]
 78%|███████▊  | 291175/371472 [1:00:12<6:32:44,  3.41it/s]
 78%|███████▊  | 291176/371472 [1:00:13<6:51:28,  3.25it/s]
 78%|███████▊  | 291177/371472 [1:00:13<7:13:16,  3.09it/s]
 78%|███████▊  | 291178/371472 [1:00:13<6:48:46,  3.27it/s]
 78%|███████▊  | 291179/371472 [1:00:13<6:31:45,  3.42it/s]
 78%|███████▊  | 291180/371472 [1:00:14<6:18:05,  3.54it/s]
                                                           
{'loss': 2.6702, 'learning_rate': 2.9463573875756853e-07, 'epoch': 12.54}

 78%|███████▊  | 291180/371472 [1:00:14<6:18:05,  3.54it/s]
 78%|███████▊  | 291181/371472 [1:00:14<6:19:49,  3.52it/s]
 78%|███████▊  | 291182/371472 [1:00:14<6:30:22,  3.43it/s]
 78%|███████▊  | 291183/371472 [1:00:15<6:24:54,  3.48it/s]
 78%|███████▊  | 291184/371472 [1:00:15<6:24:40,  3.48it/s]
 78%|███████▊  | 291185/371472 [1:00:15<6:15:43,  3.56it/s]
 78%|███████▊  | 291186/371472 [1:00:15<6:29:45,  3.43it/s]
 78%|███████▊  | 291187/371472 [1:00:16<6:43:36,  3.32it/s]
 78%|███████▊  | 291188/371472 [1:00:16<6:30:32,  3.43it/s]
 78%|███████▊  | 291189/371472 [1:00:16<6:29:09,  3.44it/s]
 78%|███████▊  | 291190/371472 [1:00:17<6:17:04,  3.55it/s]
 78%|███████▊  | 291191/371472 [1:00:17<6:05:08,  3.66it/s]
 78%|███████▊  | 291192/371472 [1:00:17<6:06:45,  3.65it/s]
 78%|███████▊  | 291193/371472 [1:00:17<6:12:39,  3.59it/s]
 78%|███████▊  | 291194/371472 [1:00:18<6:05:24,  3.66it/s]
 78%|███████▊  | 291195/371472 [1:00:18<6:14:17,  3.57it/s]
 78%|███████▊  | 291196/371472 [1:00:18<6:01:05,  3.71it/s]
 78%|███████▊  | 291197/371472 [1:00:19<6:28:02,  3.45it/s]
 78%|███████▊  | 291198/371472 [1:00:19<6:35:49,  3.38it/s]
 78%|███████▊  | 291199/371472 [1:00:19<6:29:07,  3.44it/s]
 78%|███████▊  | 291200/371472 [1:00:19<6:32:08,  3.41it/s]
                                                           
{'loss': 2.7146, 'learning_rate': 2.9458725678208976e-07, 'epoch': 12.54}

 78%|███████▊  | 291200/371472 [1:00:19<6:32:08,  3.41it/s]
 78%|███████▊  | 291201/371472 [1:00:20<6:18:48,  3.53it/s]
 78%|███████▊  | 291202/371472 [1:00:20<6:11:52,  3.60it/s]
 78%|███████▊  | 291203/371472 [1:00:20<6:11:39,  3.60it/s]
 78%|███████▊  | 291204/371472 [1:00:20<6:14:03,  3.58it/s]
 78%|███████▊  | 291205/371472 [1:00:21<6:15:47,  3.56it/s]
 78%|███████▊  | 291206/371472 [1:00:21<6:08:20,  3.63it/s]
 78%|███████▊  | 291207/371472 [1:00:21<5:56:48,  3.75it/s]
 78%|███████▊  | 291208/371472 [1:00:22<6:08:15,  3.63it/s]
 78%|███████▊  | 291209/371472 [1:00:22<6:34:34,  3.39it/s]
 78%|███████▊  | 291210/371472 [1:00:22<6:15:17,  3.56it/s]
 78%|███████▊  | 291211/371472 [1:00:23<6:46:54,  3.29it/s]
 78%|███████▊  | 291212/371472 [1:00:23<6:47:03,  3.29it/s]
 78%|███████▊  | 291213/371472 [1:00:23<6:49:55,  3.26it/s]
 78%|███████▊  | 291214/371472 [1:00:23<6:43:08,  3.32it/s]
 78%|███████▊  | 291215/371472 [1:00:24<6:34:56,  3.39it/s]
 78%|███████▊  | 291216/371472 [1:00:24<6:13:32,  3.58it/s]
 78%|███████▊  | 291217/371472 [1:00:24<6:05:52,  3.66it/s]
 78%|███████▊  | 291218/371472 [1:00:25<6:12:21,  3.59it/s]
 78%|███████▊  | 291219/371472 [1:00:25<6:12:47,  3.59it/s]
 78%|███████▊  | 291220/371472 [1:00:25<6:03:25,  3.68it/s]
                                                           
{'loss': 2.7799, 'learning_rate': 2.945387748066107e-07, 'epoch': 12.54}

 78%|███████▊  | 291220/371472 [1:00:25<6:03:25,  3.68it/s]
 78%|███████▊  | 291221/371472 [1:00:25<6:03:37,  3.68it/s]
 78%|███████▊  | 291222/371472 [1:00:26<6:00:20,  3.71it/s]
 78%|███████▊  | 291223/371472 [1:00:26<6:13:07,  3.58it/s]
 78%|███████▊  | 291224/371472 [1:00:26<6:23:22,  3.49it/s]
 78%|███████▊  | 291225/371472 [1:00:27<6:34:04,  3.39it/s]
 78%|███████▊  | 291226/371472 [1:00:27<6:19:31,  3.52it/s]
 78%|███████▊  | 291227/371472 [1:00:27<6:26:04,  3.46it/s]
 78%|███████▊  | 291228/371472 [1:00:27<6:19:31,  3.52it/s]
 78%|███████▊  | 291229/371472 [1:00:28<6:39:51,  3.34it/s]
 78%|███████▊  | 291230/371472 [1:00:28<6:39:02,  3.35it/s]
 78%|███████▊  | 291231/371472 [1:00:28<6:22:39,  3.49it/s]
 78%|███████▊  | 291232/371472 [1:00:28<6:15:29,  3.56it/s]
 78%|███████▊  | 291233/371472 [1:00:29<5:58:12,  3.73it/s]
 78%|███████▊  | 291234/371472 [1:00:29<6:02:42,  3.69it/s]
 78%|███████▊  | 291235/371472 [1:00:29<6:27:42,  3.45it/s]
 78%|███████▊  | 291236/371472 [1:00:30<6:20:08,  3.52it/s]
 78%|███████▊  | 291237/371472 [1:00:30<6:34:49,  3.39it/s]
 78%|███████▊  | 291238/371472 [1:00:30<6:58:40,  3.19it/s]
 78%|███████▊  | 291239/371472 [1:00:31<6:37:55,  3.36it/s]
 78%|███████▊  | 291240/371472 [1:00:31<6:21:41,  3.50it/s]
                                                           
{'loss': 2.729, 'learning_rate': 2.944902928311319e-07, 'epoch': 12.54}

 78%|███████▊  | 291240/371472 [1:00:31<6:21:41,  3.50it/s]
 78%|███████▊  | 291241/371472 [1:00:31<6:32:03,  3.41it/s]
 78%|███████▊  | 291242/371472 [1:00:31<6:19:24,  3.52it/s]
 78%|███████▊  | 291243/371472 [1:00:32<6:21:38,  3.50it/s]
 78%|███████▊  | 291244/371472 [1:00:32<6:43:38,  3.31it/s]
 78%|███████▊  | 291245/371472 [1:00:32<6:39:56,  3.34it/s]
 78%|███████▊  | 291246/371472 [1:00:33<6:17:58,  3.54it/s]
 78%|███████▊  | 291247/371472 [1:00:33<6:26:55,  3.46it/s]
 78%|███████▊  | 291248/371472 [1:00:33<6:28:10,  3.44it/s]
 78%|███████▊  | 291249/371472 [1:00:33<6:44:15,  3.31it/s]
 78%|███████▊  | 291250/371472 [1:00:34<6:38:03,  3.36it/s]
 78%|███████▊  | 291251/371472 [1:00:34<6:27:04,  3.45it/s]
 78%|███████▊  | 291252/371472 [1:00:34<6:08:10,  3.63it/s]
 78%|███████▊  | 291253/371472 [1:00:35<6:04:02,  3.67it/s]
 78%|███████▊  | 291254/371472 [1:00:35<6:26:03,  3.46it/s]
 78%|███████▊  | 291255/371472 [1:00:35<6:26:35,  3.46it/s]
 78%|███████▊  | 291256/371472 [1:00:35<6:12:02,  3.59it/s]
 78%|███████▊  | 291257/371472 [1:00:36<6:20:26,  3.51it/s]
 78%|███████▊  | 291258/371472 [1:00:36<6:06:31,  3.65it/s]
 78%|███████▊  | 291259/371472 [1:00:36<6:13:19,  3.58it/s]
 78%|███████▊  | 291260/371472 [1:00:37<6:12:03,  3.59it/s]
                                                           
{'loss': 2.7877, 'learning_rate': 2.944418108556529e-07, 'epoch': 12.55}

 78%|███████▊  | 291260/371472 [1:00:37<6:12:03,  3.59it/s]
 78%|███████▊  | 291261/371472 [1:00:37<6:02:55,  3.68it/s]
 78%|███████▊  | 291262/371472 [1:00:37<6:12:17,  3.59it/s]
 78%|███████▊  | 291263/371472 [1:00:37<6:19:59,  3.52it/s]
 78%|███████▊  | 291264/371472 [1:00:38<6:42:18,  3.32it/s]
 78%|███████▊  | 291265/371472 [1:00:38<6:39:19,  3.35it/s]
 78%|███████▊  | 291266/371472 [1:00:38<6:41:46,  3.33it/s]
 78%|███████▊  | 291267/371472 [1:00:39<6:30:38,  3.42it/s]
 78%|███████▊  | 291268/371472 [1:00:39<6:14:31,  3.57it/s]
 78%|███████▊  | 291269/371472 [1:00:39<6:03:26,  3.68it/s]
 78%|███████▊  | 291270/371472 [1:00:39<6:13:20,  3.58it/s]
 78%|███████▊  | 291271/371472 [1:00:40<5:57:08,  3.74it/s]
 78%|███████▊  | 291272/371472 [1:00:40<5:51:48,  3.80it/s]
 78%|███████▊  | 291273/371472 [1:00:40<5:58:44,  3.73it/s]
 78%|███████▊  | 291274/371472 [1:00:40<6:00:27,  3.71it/s]
 78%|███████▊  | 291275/371472 [1:00:41<5:53:53,  3.78it/s]
 78%|███████▊  | 291276/371472 [1:00:41<6:12:25,  3.59it/s]
 78%|███████▊  | 291277/371472 [1:00:41<6:22:37,  3.49it/s]
 78%|███████▊  | 291278/371472 [1:00:42<6:24:37,  3.48it/s]
 78%|███████▊  | 291279/371472 [1:00:42<6:08:16,  3.63it/s]
 78%|███████▊  | 291280/371472 [1:00:42<5:59:19,  3.72it/s]
                                                           
{'loss': 2.7767, 'learning_rate': 2.943933288801741e-07, 'epoch': 12.55}

 78%|███████▊  | 291280/371472 [1:00:42<5:59:19,  3.72it/s]
 78%|███████▊  | 291281/371472 [1:00:42<6:00:50,  3.70it/s]
 78%|███████▊  | 291282/371472 [1:00:43<6:27:29,  3.45it/s]
 78%|███████▊  | 291283/371472 [1:00:43<6:15:27,  3.56it/s]
 78%|███████▊  | 291284/371472 [1:00:43<6:07:57,  3.63it/s]
 78%|███████▊  | 291285/371472 [1:00:44<6:30:00,  3.43it/s]
 78%|███████▊  | 291286/371472 [1:00:44<6:21:06,  3.51it/s]
 78%|███████▊  | 291287/371472 [1:00:44<6:07:56,  3.63it/s]
 78%|███████▊  | 291288/371472 [1:00:44<6:03:11,  3.68it/s]
 78%|███████▊  | 291289/371472 [1:00:45<5:58:20,  3.73it/s]
 78%|███████▊  | 291290/371472 [1:00:45<5:53:24,  3.78it/s]
 78%|███████▊  | 291291/371472 [1:00:45<6:29:43,  3.43it/s]
 78%|███████▊  | 291292/371472 [1:00:45<6:19:13,  3.52it/s]
 78%|███████▊  | 291293/371472 [1:00:46<6:09:57,  3.61it/s]
 78%|███████▊  | 291294/371472 [1:00:46<5:57:31,  3.74it/s]
 78%|███████▊  | 291295/371472 [1:00:46<6:13:24,  3.58it/s]
 78%|███████▊  | 291296/371472 [1:00:47<6:10:15,  3.61it/s]
 78%|███████▊  | 291297/371472 [1:00:47<6:26:39,  3.46it/s]
 78%|███████▊  | 291298/371472 [1:00:47<6:32:41,  3.40it/s]
 78%|███████▊  | 291299/371472 [1:00:47<6:32:03,  3.41it/s]
 78%|███████▊  | 291300/371472 [1:00:48<6:18:44,  3.53it/s]
                                                           
{'loss': 2.824, 'learning_rate': 2.9434484690469517e-07, 'epoch': 12.55}

 78%|███████▊  | 291300/371472 [1:00:48<6:18:44,  3.53it/s]
 78%|███████▊  | 291301/371472 [1:00:48<6:19:36,  3.52it/s]
 78%|███████▊  | 291302/371472 [1:00:48<6:08:02,  3.63it/s]
 78%|███████▊  | 291303/371472 [1:00:49<6:04:10,  3.67it/s]
 78%|███████▊  | 291304/371472 [1:00:49<6:19:36,  3.52it/s]
 78%|███████▊  | 291305/371472 [1:00:49<6:23:37,  3.48it/s]
 78%|███████▊  | 291306/371472 [1:00:49<6:21:15,  3.50it/s]
 78%|███████▊  | 291307/371472 [1:00:50<6:06:27,  3.65it/s]
 78%|███████▊  | 291308/371472 [1:00:50<6:09:03,  3.62it/s]
 78%|███████▊  | 291309/371472 [1:00:50<6:15:45,  3.56it/s]
 78%|███████▊  | 291310/371472 [1:00:51<6:34:16,  3.39it/s]
 78%|███████▊  | 291311/371472 [1:00:51<6:15:19,  3.56it/s]
 78%|███████▊  | 291312/371472 [1:00:51<6:09:32,  3.62it/s]
 78%|███████▊  | 291313/371472 [1:00:51<5:57:37,  3.74it/s]
 78%|███████▊  | 291314/371472 [1:00:52<5:53:39,  3.78it/s]
 78%|███████▊  | 291315/371472 [1:00:52<5:51:10,  3.80it/s]
 78%|███████▊  | 291316/371472 [1:00:52<6:15:08,  3.56it/s]
 78%|███████▊  | 291317/371472 [1:00:52<6:31:48,  3.41it/s]
 78%|███████▊  | 291318/371472 [1:00:53<6:29:05,  3.43it/s]
 78%|███████▊  | 291319/371472 [1:00:53<6:26:05,  3.46it/s]
 78%|███████▊  | 291320/371472 [1:00:53<6:14:25,  3.57it/s]
                                                           
{'loss': 2.7196, 'learning_rate': 2.9429636492921635e-07, 'epoch': 12.55}

 78%|███████▊  | 291320/371472 [1:00:53<6:14:25,  3.57it/s]
 78%|███████▊  | 291321/371472 [1:00:54<6:10:20,  3.61it/s]
 78%|███████▊  | 291322/371472 [1:00:54<6:20:08,  3.51it/s]
 78%|███████▊  | 291323/371472 [1:00:54<6:35:28,  3.38it/s]
 78%|███████▊  | 291324/371472 [1:00:55<6:38:35,  3.35it/s]
 78%|███████▊  | 291325/371472 [1:00:55<6:31:59,  3.41it/s]
 78%|███████▊  | 291326/371472 [1:00:55<6:23:43,  3.48it/s]
 78%|███████▊  | 291327/371472 [1:00:55<6:10:16,  3.61it/s]
 78%|███████▊  | 291328/371472 [1:00:56<6:05:08,  3.66it/s]
 78%|███████▊  | 291329/371472 [1:00:56<6:05:01,  3.66it/s]
 78%|███████▊  | 291330/371472 [1:00:56<7:17:22,  3.05it/s]
 78%|███████▊  | 291331/371472 [1:00:57<7:00:37,  3.18it/s]
 78%|███████▊  | 291332/371472 [1:00:57<6:56:52,  3.20it/s]
 78%|███████▊  | 291333/371472 [1:00:57<6:46:41,  3.28it/s]
 78%|███████▊  | 291334/371472 [1:00:57<6:25:18,  3.47it/s]
 78%|███████▊  | 291335/371472 [1:00:58<6:18:30,  3.53it/s]
 78%|███████▊  | 291336/371472 [1:00:58<6:13:47,  3.57it/s]
 78%|███████▊  | 291337/371472 [1:00:58<6:15:11,  3.56it/s]
 78%|███████▊  | 291338/371472 [1:00:59<6:32:24,  3.40it/s]
 78%|███████▊  | 291339/371472 [1:00:59<6:30:00,  3.42it/s]
 78%|███████▊  | 291340/371472 [1:00:59<6:20:09,  3.51it/s]
                                                           
{'loss': 2.7268, 'learning_rate': 2.942478829537374e-07, 'epoch': 12.55}

 78%|███████▊  | 291340/371472 [1:00:59<6:20:09,  3.51it/s]
 78%|███████▊  | 291341/371472 [1:00:59<6:13:14,  3.58it/s]
 78%|███████▊  | 291342/371472 [1:01:00<6:12:43,  3.58it/s]
 78%|███████▊  | 291343/371472 [1:01:00<6:24:06,  3.48it/s]
 78%|███████▊  | 291344/371472 [1:01:00<6:08:13,  3.63it/s]
 78%|███████▊  | 291345/371472 [1:01:01<6:01:20,  3.70it/s]
 78%|███████▊  | 291346/371472 [1:01:01<6:08:39,  3.62it/s]
 78%|███████▊  | 291347/371472 [1:01:01<6:00:10,  3.71it/s]
 78%|███████▊  | 291348/371472 [1:01:01<5:55:21,  3.76it/s]
 78%|███████▊  | 291349/371472 [1:01:02<6:32:14,  3.40it/s]
 78%|███████▊  | 291350/371472 [1:01:02<6:18:36,  3.53it/s]
 78%|███████▊  | 291351/371472 [1:01:02<6:31:02,  3.41it/s]
 78%|███████▊  | 291352/371472 [1:01:03<6:18:54,  3.52it/s]
 78%|███████▊  | 291353/371472 [1:01:03<6:19:03,  3.52it/s]
 78%|███████▊  | 291354/371472 [1:01:03<6:11:06,  3.60it/s]
 78%|███████▊  | 291355/371472 [1:01:03<6:07:46,  3.63it/s]
 78%|███████▊  | 291356/371472 [1:01:04<7:09:56,  3.11it/s]
 78%|███████▊  | 291357/371472 [1:01:04<6:52:52,  3.23it/s]
 78%|███████▊  | 291358/371472 [1:01:04<6:46:42,  3.28it/s]
 78%|███████▊  | 291359/371472 [1:01:05<6:43:43,  3.31it/s]
 78%|███████▊  | 291360/371472 [1:01:05<6:27:56,  3.44it/s]
                                                           
{'loss': 2.7069, 'learning_rate': 2.9419940097825854e-07, 'epoch': 12.55}

 78%|███████▊  | 291360/371472 [1:01:05<6:27:56,  3.44it/s]
 78%|███████▊  | 291361/371472 [1:01:05<6:12:52,  3.58it/s]
 78%|███████▊  | 291362/371472 [1:01:05<6:09:21,  3.61it/s]
 78%|███████▊  | 291363/371472 [1:01:06<6:14:40,  3.56it/s]
 78%|███████▊  | 291364/371472 [1:01:06<6:12:36,  3.58it/s]
 78%|███████▊  | 291365/371472 [1:01:06<6:19:35,  3.52it/s]
 78%|███████▊  | 291366/371472 [1:01:07<6:27:16,  3.45it/s]
 78%|███████▊  | 291367/371472 [1:01:07<6:13:19,  3.58it/s]
 78%|███████▊  | 291368/371472 [1:01:07<6:03:42,  3.67it/s]
 78%|███████▊  | 291369/371472 [1:01:07<6:18:28,  3.53it/s]
 78%|███████▊  | 291370/371472 [1:01:08<6:41:57,  3.32it/s]
 78%|███████▊  | 291371/371472 [1:01:08<6:25:37,  3.46it/s]
 78%|███████▊  | 291372/371472 [1:01:08<6:36:42,  3.37it/s]
 78%|███████▊  | 291373/371472 [1:01:09<6:27:24,  3.45it/s]
 78%|███████▊  | 291374/371472 [1:01:09<6:18:49,  3.52it/s]
 78%|███████▊  | 291375/371472 [1:01:09<6:03:03,  3.68it/s]
 78%|███████▊  | 291376/371472 [1:01:09<6:11:10,  3.60it/s]
 78%|███████▊  | 291377/371472 [1:01:10<6:05:55,  3.65it/s]
 78%|███████▊  | 291378/371472 [1:01:10<6:04:54,  3.66it/s]
 78%|███████▊  | 291379/371472 [1:01:10<6:24:02,  3.48it/s]
 78%|███████▊  | 291380/371472 [1:01:11<6:14:55,  3.56it/s]
                                                           
{'loss': 2.6513, 'learning_rate': 2.9415091900277956e-07, 'epoch': 12.55}

 78%|███████▊  | 291380/371472 [1:01:11<6:14:55,  3.56it/s]
 78%|███████▊  | 291381/371472 [1:01:11<6:18:36,  3.53it/s]
 78%|███████▊  | 291382/371472 [1:01:11<6:04:11,  3.67it/s]
 78%|███████▊  | 291383/371472 [1:01:11<6:46:08,  3.29it/s]
 78%|███████▊  | 291384/371472 [1:01:12<6:23:37,  3.48it/s]
 78%|███████▊  | 291385/371472 [1:01:12<6:07:56,  3.63it/s]
 78%|███████▊  | 291386/371472 [1:01:12<5:52:00,  3.79it/s]
 78%|███████▊  | 291387/371472 [1:01:13<6:27:07,  3.45it/s]
 78%|███████▊  | 291388/371472 [1:01:13<6:25:04,  3.47it/s]
 78%|███████▊  | 291389/371472 [1:01:13<6:32:47,  3.40it/s]
 78%|███████▊  | 291390/371472 [1:01:13<6:29:29,  3.43it/s]
 78%|███████▊  | 291391/371472 [1:01:14<6:37:35,  3.36it/s]
 78%|███████▊  | 291392/371472 [1:01:14<6:41:57,  3.32it/s]
 78%|███████▊  | 291393/371472 [1:01:14<6:24:09,  3.47it/s]
 78%|███████▊  | 291394/371472 [1:01:15<6:20:33,  3.51it/s]
 78%|███████▊  | 291395/371472 [1:01:15<6:37:56,  3.35it/s]
 78%|███████▊  | 291396/371472 [1:01:15<6:22:12,  3.49it/s]
 78%|███████▊  | 291397/371472 [1:01:15<6:24:12,  3.47it/s]
 78%|███████▊  | 291398/371472 [1:01:16<6:12:39,  3.58it/s]
 78%|███████▊  | 291399/371472 [1:01:16<6:06:32,  3.64it/s]
 78%|███████▊  | 291400/371472 [1:01:16<6:25:31,  3.46it/s]
                                                           
{'loss': 2.6835, 'learning_rate': 2.9410243702730074e-07, 'epoch': 12.55}

 78%|███████▊  | 291400/371472 [1:01:16<6:25:31,  3.46it/s]
 78%|███████▊  | 291401/371472 [1:01:17<6:26:12,  3.46it/s]
 78%|███████▊  | 291402/371472 [1:01:17<6:20:56,  3.50it/s]
 78%|███████▊  | 291403/371472 [1:01:17<6:18:54,  3.52it/s]
 78%|███████▊  | 291404/371472 [1:01:17<6:17:12,  3.54it/s]
 78%|███████▊  | 291405/371472 [1:01:18<6:09:01,  3.62it/s]
 78%|███████▊  | 291406/371472 [1:01:18<6:04:30,  3.66it/s]
 78%|███████▊  | 291407/371472 [1:01:18<6:07:08,  3.63it/s]
 78%|███████▊  | 291408/371472 [1:01:18<5:58:56,  3.72it/s]
 78%|███████▊  | 291409/371472 [1:01:19<6:09:51,  3.61it/s]
 78%|███████▊  | 291410/371472 [1:01:19<6:11:46,  3.59it/s]
 78%|███████▊  | 291411/371472 [1:01:19<6:08:16,  3.62it/s]
 78%|███████▊  | 291412/371472 [1:01:20<6:08:43,  3.62it/s]
 78%|███████▊  | 291413/371472 [1:01:20<5:57:22,  3.73it/s]
 78%|███████▊  | 291414/371472 [1:01:20<6:13:56,  3.57it/s]
 78%|███████▊  | 291415/371472 [1:01:20<6:18:13,  3.53it/s]
 78%|███████▊  | 291416/371472 [1:01:21<6:03:29,  3.67it/s]
 78%|███████▊  | 291417/371472 [1:01:21<6:18:13,  3.53it/s]
 78%|███████▊  | 291418/371472 [1:01:21<6:38:48,  3.35it/s]
 78%|███████▊  | 291419/371472 [1:01:22<6:43:57,  3.30it/s]
 78%|███████▊  | 291420/371472 [1:01:22<6:26:10,  3.45it/s]
                                                           
{'loss': 2.7296, 'learning_rate': 2.940539550518218e-07, 'epoch': 12.55}

 78%|███████▊  | 291420/371472 [1:01:22<6:26:10,  3.45it/s]
 78%|███████▊  | 291421/371472 [1:01:22<6:13:25,  3.57it/s]
 78%|███████▊  | 291422/371472 [1:01:22<6:04:48,  3.66it/s]
 78%|███████▊  | 291423/371472 [1:01:23<6:00:18,  3.70it/s]
 78%|███████▊  | 291424/371472 [1:01:23<5:52:43,  3.78it/s]
 78%|███████▊  | 291425/371472 [1:01:23<5:43:23,  3.89it/s]
 78%|███████▊  | 291426/371472 [1:01:24<6:10:10,  3.60it/s]
 78%|███████▊  | 291427/371472 [1:01:24<6:01:42,  3.69it/s]
 78%|███████▊  | 291428/371472 [1:01:24<6:16:28,  3.54it/s]
 78%|███████▊  | 291429/371472 [1:01:24<6:19:39,  3.51it/s]
 78%|███████▊  | 291430/371472 [1:01:25<6:19:15,  3.52it/s]
 78%|███████▊  | 291431/371472 [1:01:25<6:18:48,  3.52it/s]
 78%|███████▊  | 291432/371472 [1:01:25<6:21:31,  3.50it/s]
 78%|███████▊  | 291433/371472 [1:01:26<6:46:19,  3.28it/s]
 78%|███████▊  | 291434/371472 [1:01:26<7:08:13,  3.12it/s]
 78%|███████▊  | 291435/371472 [1:01:26<7:18:56,  3.04it/s]
 78%|███████▊  | 291436/371472 [1:01:27<7:08:19,  3.11it/s]
 78%|███████▊  | 291437/371472 [1:01:27<6:42:25,  3.31it/s]
 78%|███████▊  | 291438/371472 [1:01:27<6:21:08,  3.50it/s]
 78%|███████▊  | 291439/371472 [1:01:27<6:18:24,  3.52it/s]
 78%|███████▊  | 291440/371472 [1:01:28<6:15:04,  3.56it/s]
                                                           
{'loss': 2.7143, 'learning_rate': 2.94005473076343e-07, 'epoch': 12.55}

 78%|███████▊  | 291440/371472 [1:01:28<6:15:04,  3.56it/s]
 78%|███████▊  | 291441/371472 [1:01:28<6:11:41,  3.59it/s]
 78%|███████▊  | 291442/371472 [1:01:28<6:08:22,  3.62it/s]
 78%|███████▊  | 291443/371472 [1:01:28<6:08:24,  3.62it/s]
 78%|███████▊  | 291444/371472 [1:01:29<6:24:12,  3.47it/s]
 78%|███████▊  | 291445/371472 [1:01:29<6:55:13,  3.21it/s]
 78%|███████▊  | 291446/371472 [1:01:29<6:42:40,  3.31it/s]
 78%|███████▊  | 291447/371472 [1:01:30<6:27:59,  3.44it/s]
 78%|███████▊  | 291448/371472 [1:01:30<6:22:19,  3.49it/s]
 78%|███████▊  | 291449/371472 [1:01:30<6:33:13,  3.39it/s]
 78%|███████▊  | 291450/371472 [1:01:31<6:23:27,  3.48it/s]
 78%|███████▊  | 291451/371472 [1:01:31<6:08:54,  3.62it/s]
 78%|███████▊  | 291452/371472 [1:01:31<6:10:13,  3.60it/s]
 78%|███████▊  | 291453/371472 [1:01:31<6:16:09,  3.55it/s]
 78%|███████▊  | 291454/371472 [1:01:32<6:20:53,  3.50it/s]
 78%|███████▊  | 291455/371472 [1:01:32<6:09:55,  3.61it/s]
 78%|███████▊  | 291456/371472 [1:01:32<6:03:22,  3.67it/s]
 78%|███████▊  | 291457/371472 [1:01:32<6:10:08,  3.60it/s]
 78%|███████▊  | 291458/371472 [1:01:33<6:00:37,  3.70it/s]
 78%|███████▊  | 291459/371472 [1:01:33<6:19:34,  3.51it/s]
 78%|███████▊  | 291460/371472 [1:01:33<6:11:09,  3.59it/s]
                                                           
{'loss': 2.4909, 'learning_rate': 2.9395699110086406e-07, 'epoch': 12.55}

 78%|███████▊  | 291460/371472 [1:01:33<6:11:09,  3.59it/s]
 78%|███████▊  | 291461/371472 [1:01:34<6:15:58,  3.55it/s]
 78%|███████▊  | 291462/371472 [1:01:34<6:09:20,  3.61it/s]
 78%|███████▊  | 291463/371472 [1:01:34<7:02:36,  3.16it/s]
 78%|███████▊  | 291464/371472 [1:01:35<6:56:37,  3.20it/s]
 78%|███████▊  | 291465/371472 [1:01:35<7:14:26,  3.07it/s]
 78%|███████▊  | 291466/371472 [1:01:35<6:56:00,  3.21it/s]
 78%|███████▊  | 291467/371472 [1:01:35<6:32:36,  3.40it/s]
 78%|███████▊  | 291468/371472 [1:01:36<6:47:36,  3.27it/s]
 78%|███████▊  | 291469/371472 [1:01:36<7:25:54,  2.99it/s]
 78%|███████▊  | 291470/371472 [1:01:37<7:19:52,  3.03it/s]
 78%|███████▊  | 291471/371472 [1:01:37<7:17:44,  3.05it/s]
 78%|███████▊  | 291472/371472 [1:01:37<7:18:58,  3.04it/s]
 78%|███████▊  | 291473/371472 [1:01:37<6:58:26,  3.19it/s]
 78%|███████▊  | 291474/371472 [1:01:38<6:54:24,  3.22it/s]
 78%|███████▊  | 291475/371472 [1:01:38<6:57:56,  3.19it/s]
 78%|███████▊  | 291476/371472 [1:01:38<6:36:09,  3.37it/s]
 78%|███████▊  | 291477/371472 [1:01:39<6:11:27,  3.59it/s]
 78%|███████▊  | 291478/371472 [1:01:39<6:01:24,  3.69it/s]
 78%|███████▊  | 291479/371472 [1:01:39<6:19:53,  3.51it/s]
 78%|███████▊  | 291480/371472 [1:01:39<6:06:51,  3.63it/s]
                                                           
{'loss': 2.6139, 'learning_rate': 2.939085091253852e-07, 'epoch': 12.55}

 78%|███████▊  | 291480/371472 [1:01:39<6:06:51,  3.63it/s]
 78%|███████▊  | 291481/371472 [1:01:40<6:26:01,  3.45it/s]
 78%|███████▊  | 291482/371472 [1:01:40<6:24:45,  3.46it/s]
 78%|███████▊  | 291483/371472 [1:01:40<6:19:13,  3.52it/s]
 78%|███████▊  | 291484/371472 [1:01:41<6:25:10,  3.46it/s]
 78%|███████▊  | 291485/371472 [1:01:41<6:24:00,  3.47it/s]
 78%|███████▊  | 291486/371472 [1:01:41<6:16:55,  3.54it/s]
 78%|███████▊  | 291487/371472 [1:01:41<6:41:34,  3.32it/s]
 78%|███████▊  | 291488/371472 [1:01:42<7:07:48,  3.12it/s]
 78%|███████▊  | 291489/371472 [1:01:42<6:53:25,  3.22it/s]
 78%|███████▊  | 291490/371472 [1:01:42<6:34:52,  3.38it/s]
 78%|███████▊  | 291491/371472 [1:01:43<6:32:46,  3.39it/s]
 78%|███████▊  | 291492/371472 [1:01:43<6:31:28,  3.41it/s]
 78%|███████▊  | 291493/371472 [1:01:43<6:16:23,  3.54it/s]
 78%|███████▊  | 291494/371472 [1:01:43<6:00:05,  3.70it/s]
 78%|███████▊  | 291495/371472 [1:01:44<5:57:43,  3.73it/s]
 78%|███████▊  | 291496/371472 [1:01:44<5:53:28,  3.77it/s]
 78%|███████▊  | 291497/371472 [1:01:44<5:45:27,  3.86it/s]
 78%|███████▊  | 291498/371472 [1:01:45<5:59:16,  3.71it/s]
 78%|███████▊  | 291499/371472 [1:01:45<5:44:18,  3.87it/s]
 78%|███████▊  | 291500/371472 [1:01:45<5:47:13,  3.84it/s]
                                                           
{'loss': 2.5784, 'learning_rate': 2.9386002714990625e-07, 'epoch': 12.56}

 78%|███████▊  | 291500/371472 [1:01:45<5:47:13,  3.84it/s]
 78%|███████▊  | 291501/371472 [1:01:45<5:57:59,  3.72it/s]
 78%|███████▊  | 291502/371472 [1:01:46<5:55:29,  3.75it/s]
 78%|███████▊  | 291503/371472 [1:01:46<5:59:40,  3.71it/s]
 78%|███████▊  | 291504/371472 [1:01:46<6:09:43,  3.60it/s]
 78%|███████▊  | 291505/371472 [1:01:46<6:26:07,  3.45it/s]
 78%|███████▊  | 291506/371472 [1:01:47<6:19:18,  3.51it/s]
 78%|███████▊  | 291507/371472 [1:01:47<6:29:35,  3.42it/s]
 78%|███████▊  | 291508/371472 [1:01:47<6:31:33,  3.40it/s]
 78%|███████▊  | 291509/371472 [1:01:48<6:45:50,  3.28it/s]
 78%|███████▊  | 291510/371472 [1:01:48<6:27:49,  3.44it/s]
 78%|███████▊  | 291511/371472 [1:01:48<7:01:52,  3.16it/s]
 78%|███████▊  | 291512/371472 [1:01:49<6:42:37,  3.31it/s]
 78%|███████▊  | 291513/371472 [1:01:49<6:38:18,  3.35it/s]
 78%|███████▊  | 291514/371472 [1:01:49<6:30:00,  3.42it/s]
 78%|███████▊  | 291515/371472 [1:01:49<6:20:34,  3.50it/s]
 78%|███████▊  | 291516/371472 [1:01:50<6:15:58,  3.54it/s]
 78%|███████▊  | 291517/371472 [1:01:50<6:07:37,  3.62it/s]
 78%|███████▊  | 291518/371472 [1:01:50<6:17:39,  3.53it/s]
 78%|███████▊  | 291519/371472 [1:01:51<6:12:17,  3.58it/s]
 78%|███████▊  | 291520/371472 [1:01:51<6:03:29,  3.67it/s]
                                                           
{'loss': 2.6652, 'learning_rate': 2.938115451744274e-07, 'epoch': 12.56}

 78%|███████▊  | 291520/371472 [1:01:51<6:03:29,  3.67it/s]
 78%|███████▊  | 291521/371472 [1:01:51<6:00:37,  3.70it/s]
 78%|███████▊  | 291522/371472 [1:01:51<5:57:49,  3.72it/s]
 78%|███████▊  | 291523/371472 [1:01:52<5:59:00,  3.71it/s]
 78%|███████▊  | 291524/371472 [1:01:52<6:03:23,  3.67it/s]
 78%|███████▊  | 291525/371472 [1:01:52<6:14:12,  3.56it/s]
 78%|███████▊  | 291526/371472 [1:01:52<6:04:57,  3.65it/s]
 78%|███████▊  | 291527/371472 [1:01:53<6:36:46,  3.36it/s]
 78%|███████▊  | 291528/371472 [1:01:53<6:21:15,  3.49it/s]
 78%|███████▊  | 291529/371472 [1:01:53<6:08:39,  3.61it/s]
 78%|███████▊  | 291530/371472 [1:01:54<6:03:59,  3.66it/s]
 78%|███████▊  | 291531/371472 [1:01:54<6:10:26,  3.60it/s]
 78%|███████▊  | 291532/371472 [1:01:54<6:20:18,  3.50it/s]
 78%|███████▊  | 291533/371472 [1:01:54<6:23:55,  3.47it/s]
 78%|███████▊  | 291534/371472 [1:01:55<6:06:20,  3.64it/s]
 78%|███████▊  | 291535/371472 [1:01:55<6:01:43,  3.68it/s]
 78%|███████▊  | 291536/371472 [1:01:55<5:58:38,  3.71it/s]
 78%|███████▊  | 291537/371472 [1:01:56<6:16:05,  3.54it/s]
 78%|███████▊  | 291538/371472 [1:01:56<6:05:14,  3.65it/s]
 78%|███████▊  | 291539/371472 [1:01:56<6:08:08,  3.62it/s]
 78%|███████▊  | 291540/371472 [1:01:56<6:12:40,  3.57it/s]
                                                           
{'loss': 2.714, 'learning_rate': 2.9376306319894845e-07, 'epoch': 12.56}

 78%|███████▊  | 291540/371472 [1:01:56<6:12:40,  3.57it/s]
 78%|███████▊  | 291541/371472 [1:01:57<6:13:38,  3.57it/s]
 78%|███████▊  | 291542/371472 [1:01:57<6:30:34,  3.41it/s]
 78%|███████▊  | 291543/371472 [1:01:57<6:35:50,  3.37it/s]
 78%|███████▊  | 291544/371472 [1:01:58<6:38:20,  3.34it/s]
 78%|███████▊  | 291545/371472 [1:01:58<6:25:02,  3.46it/s]
 78%|███████▊  | 291546/371472 [1:01:58<6:12:14,  3.58it/s]
 78%|███████▊  | 291547/371472 [1:01:58<6:29:15,  3.42it/s]
 78%|███████▊  | 291548/371472 [1:01:59<6:49:06,  3.26it/s]
 78%|███████▊  | 291549/371472 [1:01:59<6:28:50,  3.43it/s]
 78%|███████▊  | 291550/371472 [1:01:59<7:00:31,  3.17it/s]
 78%|███████▊  | 291551/371472 [1:02:00<6:45:38,  3.28it/s]
 78%|███████▊  | 291552/371472 [1:02:00<6:51:07,  3.24it/s]
 78%|███████▊  | 291553/371472 [1:02:00<6:27:34,  3.44it/s]
 78%|███████▊  | 291554/371472 [1:02:01<6:28:59,  3.42it/s]
 78%|███████▊  | 291555/371472 [1:02:01<6:24:27,  3.46it/s]
 78%|███████▊  | 291556/371472 [1:02:01<6:32:04,  3.40it/s]
 78%|███████▊  | 291557/371472 [1:02:01<6:39:24,  3.33it/s]
 78%|███████▊  | 291558/371472 [1:02:02<6:49:32,  3.25it/s]
 78%|███████▊  | 291559/371472 [1:02:02<6:35:18,  3.37it/s]
 78%|███████▊  | 291560/371472 [1:02:02<6:55:29,  3.21it/s]
                                                           
{'loss': 2.6572, 'learning_rate': 2.9371458122346963e-07, 'epoch': 12.56}

 78%|███████▊  | 291560/371472 [1:02:02<6:55:29,  3.21it/s]
 78%|███████▊  | 291561/371472 [1:02:03<7:09:23,  3.10it/s]
 78%|███████▊  | 291562/371472 [1:02:03<6:36:27,  3.36it/s]
 78%|███████▊  | 291563/371472 [1:02:03<6:29:14,  3.42it/s]
 78%|███████▊  | 291564/371472 [1:02:03<6:15:51,  3.54it/s]
 78%|███████▊  | 291565/371472 [1:02:04<6:21:29,  3.49it/s]
 78%|███████▊  | 291566/371472 [1:02:04<6:22:42,  3.48it/s]
 78%|███████▊  | 291567/371472 [1:02:04<6:06:52,  3.63it/s]
 78%|███████▊  | 291568/371472 [1:02:05<6:12:12,  3.58it/s]
 78%|███████▊  | 291569/371472 [1:02:05<6:04:46,  3.65it/s]
 78%|███████▊  | 291570/371472 [1:02:05<6:24:56,  3.46it/s]
 78%|███████▊  | 291571/371472 [1:02:05<6:18:57,  3.51it/s]
 78%|███████▊  | 291572/371472 [1:02:06<6:48:58,  3.26it/s]
 78%|███████▊  | 291573/371472 [1:02:06<6:53:58,  3.22it/s]
 78%|███████▊  | 291574/371472 [1:02:06<6:47:20,  3.27it/s]
 78%|███████▊  | 291575/371472 [1:02:07<6:42:44,  3.31it/s]
 78%|███████▊  | 291576/371472 [1:02:07<6:32:36,  3.39it/s]
 78%|███████▊  | 291577/371472 [1:02:07<6:17:45,  3.52it/s]
 78%|███████▊  | 291578/371472 [1:02:08<6:10:21,  3.60it/s]
 78%|███████▊  | 291579/371472 [1:02:08<6:20:36,  3.50it/s]
 78%|███████▊  | 291580/371472 [1:02:08<6:19:34,  3.51it/s]
                                                           
{'loss': 2.6315, 'learning_rate': 2.936660992479907e-07, 'epoch': 12.56}

 78%|███████▊  | 291580/371472 [1:02:08<6:19:34,  3.51it/s]
 78%|███████▊  | 291581/371472 [1:02:08<6:02:08,  3.68it/s]
 78%|███████▊  | 291582/371472 [1:02:09<5:55:27,  3.75it/s]
 78%|███████▊  | 291583/371472 [1:02:09<5:54:55,  3.75it/s]
 78%|███████▊  | 291584/371472 [1:02:09<6:08:57,  3.61it/s]
 78%|███████▊  | 291585/371472 [1:02:09<6:17:04,  3.53it/s]
 78%|███████▊  | 291586/371472 [1:02:10<6:22:30,  3.48it/s]
 78%|███████▊  | 291587/371472 [1:02:10<6:19:51,  3.51it/s]
 78%|███████▊  | 291588/371472 [1:02:11<7:20:04,  3.03it/s]
 78%|███████▊  | 291589/371472 [1:02:11<7:03:29,  3.14it/s]
 78%|███████▊  | 291590/371472 [1:02:11<6:57:54,  3.19it/s]
 78%|███████▊  | 291591/371472 [1:02:11<6:52:43,  3.23it/s]
 78%|███████▊  | 291592/371472 [1:02:12<6:45:11,  3.29it/s]
 78%|███████▊  | 291593/371472 [1:02:12<6:38:49,  3.34it/s]
 78%|███████▊  | 291594/371472 [1:02:12<6:35:10,  3.37it/s]
 78%|███████▊  | 291595/371472 [1:02:13<6:32:02,  3.40it/s]
 78%|███████▊  | 291596/371472 [1:02:13<6:16:39,  3.53it/s]
 78%|███████▊  | 291597/371472 [1:02:13<6:06:40,  3.63it/s]
 78%|███████▊  | 291598/371472 [1:02:13<6:57:50,  3.19it/s]
 78%|███████▊  | 291599/371472 [1:02:14<6:50:23,  3.24it/s]
 78%|███████▊  | 291600/371472 [1:02:14<6:33:47,  3.38it/s]
                                                           
{'loss': 2.6029, 'learning_rate': 2.936176172725118e-07, 'epoch': 12.56}

 78%|███████▊  | 291600/371472 [1:02:14<6:33:47,  3.38it/s]
 78%|███████▊  | 291601/371472 [1:02:14<6:39:20,  3.33it/s]
 78%|███████▊  | 291602/371472 [1:02:15<6:28:02,  3.43it/s]
 78%|███████▊  | 291603/371472 [1:02:15<6:18:11,  3.52it/s]
 78%|███████▊  | 291604/371472 [1:02:15<6:20:58,  3.49it/s]
 78%|███████▊  | 291605/371472 [1:02:15<6:12:42,  3.57it/s]
 79%|███████▊  | 291606/371472 [1:02:16<6:25:35,  3.45it/s]
 79%|███████▊  | 291607/371472 [1:02:16<6:13:44,  3.56it/s]
 79%|███████▊  | 291608/371472 [1:02:16<6:22:45,  3.48it/s]
 79%|███████▊  | 291609/371472 [1:02:17<6:32:25,  3.39it/s]
 79%|███████▊  | 291610/371472 [1:02:17<6:23:20,  3.47it/s]
 79%|███████▊  | 291611/371472 [1:02:17<6:19:21,  3.51it/s]
 79%|███████▊  | 291612/371472 [1:02:17<6:09:25,  3.60it/s]
 79%|███████▊  | 291613/371472 [1:02:18<6:12:52,  3.57it/s]
 79%|███████▊  | 291614/371472 [1:02:18<6:07:39,  3.62it/s]
 79%|███████▊  | 291615/371472 [1:02:18<5:59:15,  3.70it/s]
 79%|███████▊  | 291616/371472 [1:02:19<6:01:17,  3.68it/s]
 79%|███████▊  | 291617/371472 [1:02:19<5:59:15,  3.70it/s]
 79%|███████▊  | 291618/371472 [1:02:19<5:58:14,  3.72it/s]
 79%|███████▊  | 291619/371472 [1:02:19<5:48:03,  3.82it/s]
 79%|███████▊  | 291620/371472 [1:02:20<5:54:46,  3.75it/s]
                                                           
{'loss': 2.7119, 'learning_rate': 2.9356913529703295e-07, 'epoch': 12.56}

 79%|███████▊  | 291620/371472 [1:02:20<5:54:46,  3.75it/s]
 79%|███████▊  | 291621/371472 [1:02:20<5:50:47,  3.79it/s]
 79%|███████▊  | 291622/371472 [1:02:20<5:56:49,  3.73it/s]
 79%|███████▊  | 291623/371472 [1:02:20<5:51:13,  3.79it/s]
 79%|███████▊  | 291624/371472 [1:02:21<5:45:39,  3.85it/s]
 79%|███████▊  | 291625/371472 [1:02:21<5:52:09,  3.78it/s]
 79%|███████▊  | 291626/371472 [1:02:21<5:47:57,  3.82it/s]
 79%|███████▊  | 291627/371472 [1:02:21<6:00:46,  3.69it/s]
 79%|███████▊  | 291628/371472 [1:02:22<6:11:12,  3.58it/s]
 79%|███████▊  | 291629/371472 [1:02:22<6:21:00,  3.49it/s]
 79%|███████▊  | 291630/371472 [1:02:22<6:14:45,  3.55it/s]
 79%|███████▊  | 291631/371472 [1:02:23<6:16:00,  3.54it/s]
 79%|███████▊  | 291632/371472 [1:02:23<6:34:37,  3.37it/s]
 79%|███████▊  | 291633/371472 [1:02:23<6:22:23,  3.48it/s]
 79%|███████▊  | 291634/371472 [1:02:24<6:35:28,  3.36it/s]
 79%|███████▊  | 291635/371472 [1:02:24<6:20:15,  3.50it/s]
 79%|███████▊  | 291636/371472 [1:02:24<6:04:41,  3.65it/s]
 79%|███████▊  | 291637/371472 [1:02:24<6:10:21,  3.59it/s]
 79%|███████▊  | 291638/371472 [1:02:25<6:25:48,  3.45it/s]
 79%|███████▊  | 291639/371472 [1:02:25<6:20:46,  3.49it/s]
 79%|███████▊  | 291640/371472 [1:02:25<6:22:32,  3.48it/s]
                                                           
{'loss': 2.6676, 'learning_rate': 2.935206533215539e-07, 'epoch': 12.56}

 79%|███████▊  | 291640/371472 [1:02:25<6:22:32,  3.48it/s]
 79%|███████▊  | 291641/371472 [1:02:26<6:43:37,  3.30it/s]
 79%|███████▊  | 291642/371472 [1:02:26<6:19:55,  3.50it/s]
 79%|███████▊  | 291643/371472 [1:02:26<6:51:04,  3.24it/s]
 79%|███████▊  | 291644/371472 [1:02:26<7:05:04,  3.13it/s]
 79%|███████▊  | 291645/371472 [1:02:27<7:10:32,  3.09it/s]
 79%|███████▊  | 291646/371472 [1:02:27<7:09:50,  3.10it/s]
 79%|███████▊  | 291647/371472 [1:02:27<6:51:47,  3.23it/s]
 79%|███████▊  | 291648/371472 [1:02:28<6:30:48,  3.40it/s]
 79%|███████▊  | 291649/371472 [1:02:28<6:54:06,  3.21it/s]
 79%|███████▊  | 291650/371472 [1:02:28<6:45:56,  3.28it/s]
 79%|███████▊  | 291651/371472 [1:02:29<6:34:39,  3.37it/s]
 79%|███████▊  | 291652/371472 [1:02:29<6:30:14,  3.41it/s]
 79%|███████▊  | 291653/371472 [1:02:29<6:16:52,  3.53it/s]
 79%|███████▊  | 291654/371472 [1:02:29<6:10:40,  3.59it/s]
 79%|███████▊  | 291655/371472 [1:02:30<6:04:23,  3.65it/s]
 79%|███████▊  | 291656/371472 [1:02:30<6:01:40,  3.68it/s]
 79%|███████▊  | 291657/371472 [1:02:30<5:57:51,  3.72it/s]
 79%|███████▊  | 291658/371472 [1:02:30<5:49:48,  3.80it/s]
 79%|███████▊  | 291659/371472 [1:02:31<5:59:36,  3.70it/s]
 79%|███████▊  | 291660/371472 [1:02:31<6:29:40,  3.41it/s]
                                                           
{'loss': 2.6439, 'learning_rate': 2.934721713460751e-07, 'epoch': 12.56}

 79%|███████▊  | 291660/371472 [1:02:31<6:29:40,  3.41it/s]
 79%|███████▊  | 291661/371472 [1:02:31<6:21:28,  3.49it/s]
 79%|███████▊  | 291662/371472 [1:02:32<6:29:02,  3.42it/s]
 79%|███████▊  | 291663/371472 [1:02:32<6:15:03,  3.55it/s]
 79%|███████▊  | 291664/371472 [1:02:32<7:08:47,  3.10it/s]
 79%|███████▊  | 291665/371472 [1:02:33<6:55:45,  3.20it/s]
 79%|███████▊  | 291666/371472 [1:02:33<6:40:29,  3.32it/s]
 79%|███████▊  | 291667/371472 [1:02:33<6:31:12,  3.40it/s]
 79%|███████▊  | 291668/371472 [1:02:33<6:10:22,  3.59it/s]
 79%|███████▊  | 291669/371472 [1:02:34<6:06:42,  3.63it/s]
 79%|███████▊  | 291670/371472 [1:02:34<6:10:48,  3.59it/s]
 79%|███████▊  | 291671/371472 [1:02:34<6:06:39,  3.63it/s]
 79%|███████▊  | 291672/371472 [1:02:35<6:04:30,  3.65it/s]
 79%|███████▊  | 291673/371472 [1:02:35<6:07:54,  3.62it/s]
 79%|███████▊  | 291674/371472 [1:02:35<6:09:31,  3.60it/s]
 79%|███████▊  | 291675/371472 [1:02:35<5:58:17,  3.71it/s]
 79%|███████▊  | 291676/371472 [1:02:36<5:48:10,  3.82it/s]
 79%|███████▊  | 291677/371472 [1:02:36<6:06:43,  3.63it/s]
 79%|███████▊  | 291678/371472 [1:02:36<6:17:09,  3.53it/s]
 79%|███████▊  | 291679/371472 [1:02:36<6:21:58,  3.48it/s]
 79%|███████▊  | 291680/371472 [1:02:37<6:08:33,  3.61it/s]
                                                           
{'loss': 2.7212, 'learning_rate': 2.9342368937059616e-07, 'epoch': 12.56}

 79%|███████▊  | 291680/371472 [1:02:37<6:08:33,  3.61it/s]
 79%|███████▊  | 291681/371472 [1:02:37<6:01:10,  3.68it/s]
 79%|███████▊  | 291682/371472 [1:02:37<6:07:36,  3.62it/s]
 79%|███████▊  | 291683/371472 [1:02:38<6:11:04,  3.58it/s]
 79%|███████▊  | 291684/371472 [1:02:38<6:10:09,  3.59it/s]
 79%|███████▊  | 291685/371472 [1:02:38<6:15:49,  3.54it/s]
 79%|███████▊  | 291686/371472 [1:02:38<6:39:39,  3.33it/s]
 79%|███████▊  | 291687/371472 [1:02:39<6:40:55,  3.32it/s]
 79%|███████▊  | 291688/371472 [1:02:39<6:23:41,  3.47it/s]
 79%|███████▊  | 291689/371472 [1:02:39<6:32:30,  3.39it/s]
 79%|███████▊  | 291690/371472 [1:02:40<6:30:41,  3.40it/s]
 79%|███████▊  | 291691/371472 [1:02:40<6:17:08,  3.53it/s]
 79%|███████▊  | 291692/371472 [1:02:40<6:03:14,  3.66it/s]
 79%|███████▊  | 291693/371472 [1:02:40<5:57:14,  3.72it/s]
 79%|███████▊  | 291694/371472 [1:02:41<6:06:07,  3.63it/s]
 79%|███████▊  | 291695/371472 [1:02:41<5:56:51,  3.73it/s]
 79%|███████▊  | 291696/371472 [1:02:41<6:12:38,  3.57it/s]
 79%|███████▊  | 291697/371472 [1:02:41<5:57:55,  3.71it/s]
 79%|███████▊  | 291698/371472 [1:02:42<5:51:57,  3.78it/s]
 79%|███████▊  | 291699/371472 [1:02:42<5:55:07,  3.74it/s]
 79%|███████▊  | 291700/371472 [1:02:42<6:17:48,  3.52it/s]
                                                           
{'loss': 2.7353, 'learning_rate': 2.9337520739511734e-07, 'epoch': 12.56}

 79%|███████▊  | 291700/371472 [1:02:42<6:17:48,  3.52it/s]
 79%|███████▊  | 291701/371472 [1:02:43<6:22:53,  3.47it/s]
 79%|███████▊  | 291702/371472 [1:02:43<6:24:51,  3.45it/s]
 79%|███████▊  | 291703/371472 [1:02:43<6:18:42,  3.51it/s]
 79%|███████▊  | 291704/371472 [1:02:44<6:26:17,  3.44it/s]
 79%|███████▊  | 291705/371472 [1:02:44<6:21:23,  3.49it/s]
 79%|███████▊  | 291706/371472 [1:02:44<6:34:00,  3.37it/s]
 79%|███████▊  | 291707/371472 [1:02:44<6:30:08,  3.41it/s]
 79%|███████▊  | 291708/371472 [1:02:45<6:21:33,  3.48it/s]
 79%|███████▊  | 291709/371472 [1:02:45<6:11:02,  3.58it/s]
 79%|███████▊  | 291710/371472 [1:02:45<5:57:45,  3.72it/s]
 79%|███████▊  | 291711/371472 [1:02:45<6:00:24,  3.69it/s]
 79%|███████▊  | 291712/371472 [1:02:46<6:01:18,  3.68it/s]
 79%|███████▊  | 291713/371472 [1:02:46<5:59:39,  3.70it/s]
 79%|███████▊  | 291714/371472 [1:02:46<6:05:32,  3.64it/s]
 79%|███████▊  | 291715/371472 [1:02:47<6:24:17,  3.46it/s]
 79%|███████▊  | 291716/371472 [1:02:47<6:24:43,  3.46it/s]
 79%|███████▊  | 291717/371472 [1:02:47<6:27:21,  3.43it/s]
 79%|███████▊  | 291718/371472 [1:02:47<6:19:24,  3.50it/s]
 79%|███████▊  | 291719/371472 [1:02:48<6:12:49,  3.57it/s]
 79%|███████▊  | 291720/371472 [1:02:48<5:53:32,  3.76it/s]
                                                           
{'loss': 2.6276, 'learning_rate': 2.933267254196384e-07, 'epoch': 12.56}

 79%|███████▊  | 291720/371472 [1:02:48<5:53:32,  3.76it/s]
 79%|███████▊  | 291721/371472 [1:02:48<5:49:48,  3.80it/s]
 79%|███████▊  | 291722/371472 [1:02:48<5:52:49,  3.77it/s]
 79%|███████▊  | 291723/371472 [1:02:49<5:55:56,  3.73it/s]
 79%|███████▊  | 291724/371472 [1:02:49<5:55:11,  3.74it/s]
 79%|███████▊  | 291725/371472 [1:02:49<5:56:37,  3.73it/s]
 79%|███████▊  | 291726/371472 [1:02:50<5:53:43,  3.76it/s]
 79%|███████▊  | 291727/371472 [1:02:50<5:53:14,  3.76it/s]
 79%|███████▊  | 291728/371472 [1:02:50<6:05:35,  3.64it/s]
 79%|███████▊  | 291729/371472 [1:02:50<6:06:24,  3.63it/s]
 79%|███████▊  | 291730/371472 [1:02:51<6:00:16,  3.69it/s]
 79%|███████▊  | 291731/371472 [1:02:51<6:46:13,  3.27it/s]
 79%|███████▊  | 291732/371472 [1:02:51<6:29:19,  3.41it/s]
 79%|███████▊  | 291733/371472 [1:02:52<6:22:30,  3.47it/s]
 79%|███████▊  | 291734/371472 [1:02:52<6:13:14,  3.56it/s]
 79%|███████▊  | 291735/371472 [1:02:52<6:05:14,  3.64it/s]
 79%|███████▊  | 291736/371472 [1:02:52<6:25:24,  3.45it/s]
 79%|███████▊  | 291737/371472 [1:02:53<6:20:17,  3.49it/s]
 79%|███████▊  | 291738/371472 [1:02:53<6:22:48,  3.47it/s]
 79%|███████▊  | 291739/371472 [1:02:53<7:13:15,  3.07it/s]
 79%|███████▊  | 291740/371472 [1:02:54<6:40:22,  3.32it/s]
                                                           
{'loss': 2.6812, 'learning_rate': 2.9327824344415954e-07, 'epoch': 12.57}

 79%|███████▊  | 291740/371472 [1:02:54<6:40:22,  3.32it/s]
 79%|███████▊  | 291741/371472 [1:02:54<6:26:52,  3.43it/s]
 79%|███████▊  | 291742/371472 [1:02:54<6:14:37,  3.55it/s]
 79%|███████▊  | 291743/371472 [1:02:55<6:27:53,  3.43it/s]
 79%|███████▊  | 291744/371472 [1:02:55<6:40:22,  3.32it/s]
 79%|███████▊  | 291745/371472 [1:02:55<6:38:09,  3.34it/s]
 79%|███████▊  | 291746/371472 [1:02:55<6:24:06,  3.46it/s]
 79%|███████▊  | 291747/371472 [1:02:56<6:17:27,  3.52it/s]
 79%|███████▊  | 291748/371472 [1:02:56<6:18:38,  3.51it/s]
 79%|███████▊  | 291749/371472 [1:02:56<6:27:36,  3.43it/s]
 79%|███████▊  | 291750/371472 [1:02:57<6:19:44,  3.50it/s]
 79%|███████▊  | 291751/371472 [1:02:57<6:10:58,  3.58it/s]
 79%|███████▊  | 291752/371472 [1:02:57<6:14:19,  3.55it/s]
 79%|███████▊  | 291753/371472 [1:02:57<6:49:26,  3.25it/s]
 79%|███████▊  | 291754/371472 [1:02:58<6:40:13,  3.32it/s]
 79%|███████▊  | 291755/371472 [1:02:58<7:19:37,  3.02it/s]
 79%|███████▊  | 291756/371472 [1:02:58<6:44:33,  3.28it/s]
 79%|███████▊  | 291757/371472 [1:02:59<6:28:28,  3.42it/s]
 79%|███████▊  | 291758/371472 [1:02:59<6:50:13,  3.24it/s]
 79%|███████▊  | 291759/371472 [1:02:59<6:31:02,  3.40it/s]
 79%|███████▊  | 291760/371472 [1:03:00<6:36:01,  3.35it/s]
                                                           
{'loss': 2.5885, 'learning_rate': 2.9322976146868055e-07, 'epoch': 12.57}

 79%|███████▊  | 291760/371472 [1:03:00<6:36:01,  3.35it/s]
 79%|███████▊  | 291761/371472 [1:03:00<6:41:39,  3.31it/s]
 79%|███████▊  | 291762/371472 [1:03:00<6:57:02,  3.19it/s]
 79%|███████▊  | 291763/371472 [1:03:00<6:39:34,  3.32it/s]
 79%|███████▊  | 291764/371472 [1:03:01<6:24:53,  3.45it/s]
 79%|███████▊  | 291765/371472 [1:03:01<6:52:26,  3.22it/s]
 79%|███████▊  | 291766/371472 [1:03:01<7:14:06,  3.06it/s]
 79%|███████▊  | 291767/371472 [1:03:02<6:52:09,  3.22it/s]
 79%|███████▊  | 291768/371472 [1:03:02<6:30:54,  3.40it/s]
 79%|███████▊  | 291769/371472 [1:03:02<6:26:00,  3.44it/s]
 79%|███████▊  | 291770/371472 [1:03:03<6:19:57,  3.50it/s]
 79%|███████▊  | 291771/371472 [1:03:03<6:09:03,  3.60it/s]
 79%|███████▊  | 291772/371472 [1:03:03<6:29:59,  3.41it/s]
 79%|███████▊  | 291773/371472 [1:03:03<6:25:56,  3.44it/s]
 79%|███████▊  | 291774/371472 [1:03:04<6:29:19,  3.41it/s]
 79%|███████▊  | 291775/371472 [1:03:04<6:06:26,  3.62it/s]
 79%|███████▊  | 291776/371472 [1:03:04<5:52:46,  3.77it/s]
 79%|███████▊  | 291777/371472 [1:03:05<6:13:52,  3.55it/s]
 79%|███████▊  | 291778/371472 [1:03:05<6:07:17,  3.62it/s]
 79%|███████▊  | 291779/371472 [1:03:05<5:57:47,  3.71it/s]
 79%|███████▊  | 291780/371472 [1:03:05<6:01:49,  3.67it/s]
                                                           
{'loss': 2.667, 'learning_rate': 2.9318127949320173e-07, 'epoch': 12.57}

 79%|███████▊  | 291780/371472 [1:03:05<6:01:49,  3.67it/s]
 79%|███████▊  | 291781/371472 [1:03:06<6:42:23,  3.30it/s]
 79%|███████▊  | 291782/371472 [1:03:06<6:25:24,  3.45it/s]
 79%|███████▊  | 291783/371472 [1:03:06<6:25:04,  3.45it/s]
 79%|███████▊  | 291784/371472 [1:03:07<6:41:11,  3.31it/s]
 79%|███████▊  | 291785/371472 [1:03:07<6:24:21,  3.46it/s]
 79%|███████▊  | 291786/371472 [1:03:07<6:20:49,  3.49it/s]
 79%|███████▊  | 291787/371472 [1:03:07<6:54:27,  3.20it/s]
 79%|███████▊  | 291788/371472 [1:03:08<6:51:29,  3.23it/s]
 79%|███████▊  | 291789/371472 [1:03:08<7:27:12,  2.97it/s]
 79%|███████▊  | 291790/371472 [1:03:08<7:01:05,  3.15it/s]
 79%|███████▊  | 291791/371472 [1:03:09<6:43:06,  3.29it/s]
 79%|███████▊  | 291792/371472 [1:03:09<6:30:21,  3.40it/s]
 79%|███████▊  | 291793/371472 [1:03:09<6:16:21,  3.53it/s]
 79%|███████▊  | 291794/371472 [1:03:10<6:24:33,  3.45it/s]
 79%|███████▊  | 291795/371472 [1:03:10<6:11:10,  3.58it/s]
 79%|███████▊  | 291796/371472 [1:03:10<6:00:03,  3.69it/s]
 79%|███████▊  | 291797/371472 [1:03:10<6:00:17,  3.69it/s]
 79%|███████▊  | 291798/371472 [1:03:11<6:06:30,  3.62it/s]
 79%|███████▊  | 291799/371472 [1:03:11<5:55:34,  3.73it/s]
 79%|███████▊  | 291800/371472 [1:03:11<6:31:55,  3.39it/s]
                                                           
{'loss': 2.6812, 'learning_rate': 2.931327975177228e-07, 'epoch': 12.57}

 79%|███████▊  | 291800/371472 [1:03:11<6:31:55,  3.39it/s]
 79%|███████▊  | 291801/371472 [1:03:12<6:19:41,  3.50it/s]
 79%|███████▊  | 291802/371472 [1:03:12<6:29:50,  3.41it/s]
 79%|███████▊  | 291803/371472 [1:03:12<6:17:06,  3.52it/s]
 79%|███████▊  | 291804/371472 [1:03:12<6:14:48,  3.54it/s]
 79%|███████▊  | 291805/371472 [1:03:13<6:09:26,  3.59it/s]
 79%|███████▊  | 291806/371472 [1:03:13<6:03:46,  3.65it/s]
 79%|███████▊  | 291807/371472 [1:03:13<5:53:58,  3.75it/s]
 79%|███████▊  | 291808/371472 [1:03:13<5:43:18,  3.87it/s]
 79%|███████▊  | 291809/371472 [1:03:14<5:58:36,  3.70it/s]
 79%|███████▊  | 291810/371472 [1:03:14<6:00:22,  3.68it/s]
 79%|███████▊  | 291811/371472 [1:03:14<5:59:46,  3.69it/s]
 79%|███████▊  | 291812/371472 [1:03:15<6:10:01,  3.59it/s]
 79%|███████▊  | 291813/371472 [1:03:15<6:13:54,  3.55it/s]
 79%|███████▊  | 291814/371472 [1:03:15<6:01:03,  3.68it/s]
 79%|███████▊  | 291815/371472 [1:03:15<6:00:15,  3.69it/s]
 79%|███████▊  | 291816/371472 [1:03:16<5:53:55,  3.75it/s]
 79%|███████▊  | 291817/371472 [1:03:16<6:10:47,  3.58it/s]
 79%|███████▊  | 291818/371472 [1:03:16<6:25:40,  3.44it/s]
 79%|███████▊  | 291819/371472 [1:03:17<7:04:01,  3.13it/s]
 79%|███████▊  | 291820/371472 [1:03:17<6:50:17,  3.24it/s]
                                                           
{'loss': 2.6638, 'learning_rate': 2.93084315542244e-07, 'epoch': 12.57}

 79%|███████▊  | 291820/371472 [1:03:17<6:50:17,  3.24it/s]
 79%|███████▊  | 291821/371472 [1:03:17<6:57:57,  3.18it/s]
 79%|███████▊  | 291822/371472 [1:03:17<6:29:34,  3.41it/s]
 79%|███████▊  | 291823/371472 [1:03:18<6:20:52,  3.49it/s]
 79%|███████▊  | 291824/371472 [1:03:18<6:16:27,  3.53it/s]
 79%|███████▊  | 291825/371472 [1:03:18<6:11:01,  3.58it/s]
 79%|███████▊  | 291826/371472 [1:03:19<6:12:27,  3.56it/s]
 79%|███████▊  | 291827/371472 [1:03:19<6:02:15,  3.66it/s]
 79%|███████▊  | 291828/371472 [1:03:19<6:09:13,  3.60it/s]
 79%|███████▊  | 291829/371472 [1:03:19<6:04:47,  3.64it/s]
 79%|███████▊  | 291830/371472 [1:03:20<5:56:59,  3.72it/s]
 79%|███████▊  | 291831/371472 [1:03:20<5:52:02,  3.77it/s]
 79%|███████▊  | 291832/371472 [1:03:20<5:44:22,  3.85it/s]
 79%|███████▊  | 291833/371472 [1:03:20<5:48:32,  3.81it/s]
 79%|███████▊  | 291834/371472 [1:03:21<6:05:26,  3.63it/s]
 79%|███████▊  | 291835/371472 [1:03:21<5:49:54,  3.79it/s]
 79%|███████▊  | 291836/371472 [1:03:21<6:07:46,  3.61it/s]
 79%|███████▊  | 291837/371472 [1:03:22<6:13:13,  3.56it/s]
 79%|███████▊  | 291838/371472 [1:03:22<6:03:33,  3.65it/s]
 79%|███████▊  | 291839/371472 [1:03:22<6:03:57,  3.65it/s]
 79%|███████▊  | 291840/371472 [1:03:22<6:02:31,  3.66it/s]
                                                           
{'loss': 2.5995, 'learning_rate': 2.9303583356676505e-07, 'epoch': 12.57}

 79%|███████▊  | 291840/371472 [1:03:22<6:02:31,  3.66it/s]
 79%|███████▊  | 291841/371472 [1:03:23<6:37:40,  3.34it/s]
 79%|███████▊  | 291842/371472 [1:03:23<6:27:10,  3.43it/s]
 79%|███████▊  | 291843/371472 [1:03:23<6:15:07,  3.54it/s]
 79%|███████▊  | 291844/371472 [1:03:23<6:11:30,  3.57it/s]
 79%|███████▊  | 291845/371472 [1:03:24<6:24:51,  3.45it/s]
 79%|███████▊  | 291846/371472 [1:03:24<6:27:56,  3.42it/s]
 79%|███████▊  | 291847/371472 [1:03:24<6:14:44,  3.54it/s]
 79%|███████▊  | 291848/371472 [1:03:25<6:09:00,  3.60it/s]
 79%|███████▊  | 291849/371472 [1:03:25<6:27:51,  3.42it/s]
 79%|███████▊  | 291850/371472 [1:03:25<6:27:31,  3.42it/s]
 79%|███████▊  | 291851/371472 [1:03:26<6:09:28,  3.59it/s]
 79%|███████▊  | 291852/371472 [1:03:26<6:06:52,  3.62it/s]
 79%|███████▊  | 291853/371472 [1:03:26<6:17:25,  3.52it/s]
 79%|███████▊  | 291854/371472 [1:03:26<6:17:12,  3.52it/s]
 79%|███████▊  | 291855/371472 [1:03:27<6:09:24,  3.59it/s]
 79%|███████▊  | 291856/371472 [1:03:27<6:08:18,  3.60it/s]
 79%|███████▊  | 291857/371472 [1:03:27<6:16:36,  3.52it/s]
 79%|███████▊  | 291858/371472 [1:03:27<6:01:18,  3.67it/s]
 79%|███████▊  | 291859/371472 [1:03:28<6:04:35,  3.64it/s]
 79%|███████▊  | 291860/371472 [1:03:28<6:05:35,  3.63it/s]
                                                           
{'loss': 2.6172, 'learning_rate': 2.929873515912862e-07, 'epoch': 12.57}

 79%|███████▊  | 291860/371472 [1:03:28<6:05:35,  3.63it/s]
 79%|███████▊  | 291861/371472 [1:03:28<5:59:53,  3.69it/s]
 79%|███████▊  | 291862/371472 [1:03:29<6:23:09,  3.46it/s]
 79%|███████▊  | 291863/371472 [1:03:29<7:02:00,  3.14it/s]
 79%|███████▊  | 291864/371472 [1:03:29<6:51:52,  3.22it/s]
 79%|███████▊  | 291865/371472 [1:03:30<6:42:06,  3.30it/s]
 79%|███████▊  | 291866/371472 [1:03:30<6:35:43,  3.35it/s]
 79%|███████▊  | 291867/371472 [1:03:30<6:30:51,  3.39it/s]
 79%|███████▊  | 291868/371472 [1:03:30<6:23:44,  3.46it/s]
 79%|███████▊  | 291869/371472 [1:03:31<6:11:25,  3.57it/s]
 79%|███████▊  | 291870/371472 [1:03:31<6:13:45,  3.55it/s]
 79%|███████▊  | 291871/371472 [1:03:31<6:17:58,  3.51it/s]
 79%|███████▊  | 291872/371472 [1:03:32<6:15:38,  3.53it/s]
 79%|███████▊  | 291873/371472 [1:03:32<6:29:11,  3.41it/s]
 79%|███████▊  | 291874/371472 [1:03:32<6:15:10,  3.54it/s]
 79%|███████▊  | 291875/371472 [1:03:32<6:04:38,  3.64it/s]
 79%|███████▊  | 291876/371472 [1:03:33<6:11:15,  3.57it/s]
 79%|███████▊  | 291877/371472 [1:03:33<6:16:07,  3.53it/s]
 79%|███████▊  | 291878/371472 [1:03:33<6:19:23,  3.50it/s]
 79%|███████▊  | 291879/371472 [1:03:34<6:22:37,  3.47it/s]
 79%|███████▊  | 291880/371472 [1:03:34<6:29:54,  3.40it/s]
                                                           
{'loss': 2.7344, 'learning_rate': 2.9293886961580725e-07, 'epoch': 12.57}

 79%|███████▊  | 291880/371472 [1:03:34<6:29:54,  3.40it/s]
 79%|███████▊  | 291881/371472 [1:03:34<6:23:05,  3.46it/s]
 79%|███████▊  | 291882/371472 [1:03:34<6:46:49,  3.26it/s]
 79%|███████▊  | 291883/371472 [1:03:35<6:48:31,  3.25it/s]
 79%|███████▊  | 291884/371472 [1:03:35<6:59:06,  3.16it/s]
 79%|███████▊  | 291885/371472 [1:03:35<6:41:36,  3.30it/s]
 79%|███████▊  | 291886/371472 [1:03:36<6:40:29,  3.31it/s]
 79%|███████▊  | 291887/371472 [1:03:36<6:41:43,  3.30it/s]
 79%|███████▊  | 291888/371472 [1:03:36<6:51:11,  3.23it/s]
 79%|███████▊  | 291889/371472 [1:03:37<6:35:34,  3.35it/s]
 79%|███████▊  | 291890/371472 [1:03:37<6:31:51,  3.38it/s]
 79%|███████▊  | 291891/371472 [1:03:37<6:25:13,  3.44it/s]
 79%|███████▊  | 291892/371472 [1:03:37<6:31:34,  3.39it/s]
 79%|███████▊  | 291893/371472 [1:03:38<6:17:28,  3.51it/s]
 79%|███████▊  | 291894/371472 [1:03:38<6:00:04,  3.68it/s]
 79%|███████▊  | 291895/371472 [1:03:38<5:56:29,  3.72it/s]
 79%|███████▊  | 291896/371472 [1:03:38<5:57:39,  3.71it/s]
 79%|███████▊  | 291897/371472 [1:03:39<6:04:47,  3.64it/s]
 79%|███████▊  | 291898/371472 [1:03:39<6:08:55,  3.59it/s]
 79%|███████▊  | 291899/371472 [1:03:39<6:12:43,  3.56it/s]
 79%|███████▊  | 291900/371472 [1:03:40<6:06:55,  3.61it/s]
                                                           
{'loss': 2.5708, 'learning_rate': 2.9289038764032837e-07, 'epoch': 12.57}

 79%|███████▊  | 291900/371472 [1:03:40<6:06:55,  3.61it/s]
 79%|███████▊  | 291901/371472 [1:03:40<6:15:03,  3.54it/s]
 79%|███████▊  | 291902/371472 [1:03:40<6:11:12,  3.57it/s]
 79%|███████▊  | 291903/371472 [1:03:40<6:22:43,  3.47it/s]
 79%|███████▊  | 291904/371472 [1:03:41<6:21:09,  3.48it/s]
 79%|███████▊  | 291905/371472 [1:03:41<6:37:22,  3.34it/s]
 79%|███████▊  | 291906/371472 [1:03:41<6:38:05,  3.33it/s]
 79%|███████▊  | 291907/371472 [1:03:42<7:44:41,  2.85it/s]
 79%|███████▊  | 291908/371472 [1:03:42<7:18:49,  3.02it/s]
 79%|███████▊  | 291909/371472 [1:03:42<6:49:17,  3.24it/s]
 79%|███████▊  | 291910/371472 [1:03:43<6:29:43,  3.40it/s]
 79%|███████▊  | 291911/371472 [1:03:43<6:23:07,  3.46it/s]
 79%|███████▊  | 291912/371472 [1:03:43<6:09:00,  3.59it/s]
 79%|███████▊  | 291913/371472 [1:03:43<6:03:03,  3.65it/s]
 79%|███████▊  | 291914/371472 [1:03:44<6:04:28,  3.64it/s]
 79%|███████▊  | 291915/371472 [1:03:44<6:21:27,  3.48it/s]
 79%|███████▊  | 291916/371472 [1:03:44<6:20:52,  3.48it/s]
 79%|███████▊  | 291917/371472 [1:03:45<6:24:45,  3.45it/s]
 79%|███████▊  | 291918/371472 [1:03:45<6:24:06,  3.45it/s]
 79%|███████▊  | 291919/371472 [1:03:45<6:11:39,  3.57it/s]
 79%|███████▊  | 291920/371472 [1:03:45<6:17:20,  3.51it/s]
                                                           
{'loss': 2.7894, 'learning_rate': 2.9284190566484944e-07, 'epoch': 12.57}

 79%|███████▊  | 291920/371472 [1:03:45<6:17:20,  3.51it/s]
 79%|███████▊  | 291921/371472 [1:03:46<6:31:29,  3.39it/s]
 79%|███████▊  | 291922/371472 [1:03:46<6:40:56,  3.31it/s]
 79%|███████▊  | 291923/371472 [1:03:46<6:26:41,  3.43it/s]
 79%|███████▊  | 291924/371472 [1:03:47<6:27:16,  3.42it/s]
 79%|███████▊  | 291925/371472 [1:03:47<6:26:21,  3.43it/s]
 79%|███████▊  | 291926/371472 [1:03:47<6:39:21,  3.32it/s]
 79%|███████▊  | 291927/371472 [1:03:48<7:22:04,  3.00it/s]
 79%|███████▊  | 291928/371472 [1:03:48<7:11:22,  3.07it/s]
 79%|███████▊  | 291929/371472 [1:03:48<6:50:56,  3.23it/s]
 79%|███████▊  | 291930/371472 [1:03:49<6:38:43,  3.32it/s]
 79%|███████▊  | 291931/371472 [1:03:49<6:24:59,  3.44it/s]
 79%|███████▊  | 291932/371472 [1:03:49<6:17:28,  3.51it/s]
 79%|███████▊  | 291933/371472 [1:03:49<6:22:52,  3.46it/s]
 79%|███████▊  | 291934/371472 [1:03:50<6:29:24,  3.40it/s]
 79%|███████▊  | 291935/371472 [1:03:50<6:25:46,  3.44it/s]
 79%|███████▊  | 291936/371472 [1:03:50<6:11:16,  3.57it/s]
 79%|███████▊  | 291937/371472 [1:03:51<6:09:59,  3.58it/s]
 79%|███████▊  | 291938/371472 [1:03:51<6:09:30,  3.59it/s]
 79%|███████▊  | 291939/371472 [1:03:51<6:14:43,  3.54it/s]
 79%|███████▊  | 291940/371472 [1:03:51<6:04:23,  3.64it/s]
                                                           
{'loss': 2.6047, 'learning_rate': 2.927934236893706e-07, 'epoch': 12.57}

 79%|███████▊  | 291940/371472 [1:03:51<6:04:23,  3.64it/s]
 79%|███████▊  | 291941/371472 [1:03:52<5:59:09,  3.69it/s]
 79%|███████▊  | 291942/371472 [1:03:52<6:20:27,  3.48it/s]
 79%|███████▊  | 291943/371472 [1:03:52<6:29:55,  3.40it/s]
 79%|███████▊  | 291944/371472 [1:03:53<6:36:33,  3.34it/s]
 79%|███████▊  | 291945/371472 [1:03:53<6:28:46,  3.41it/s]
 79%|███████▊  | 291946/371472 [1:03:53<6:13:11,  3.55it/s]
 79%|███████▊  | 291947/371472 [1:03:53<6:24:47,  3.44it/s]
 79%|███████▊  | 291948/371472 [1:03:54<6:11:05,  3.57it/s]
 79%|███████▊  | 291949/371472 [1:03:54<6:07:30,  3.61it/s]
 79%|███████▊  | 291950/371472 [1:03:54<6:08:36,  3.60it/s]
 79%|███████▊  | 291951/371472 [1:03:55<6:14:27,  3.54it/s]
 79%|███████▊  | 291952/371472 [1:03:55<6:05:34,  3.63it/s]
 79%|███████▊  | 291953/371472 [1:03:55<6:00:49,  3.67it/s]
 79%|███████▊  | 291954/371472 [1:03:55<6:07:03,  3.61it/s]
 79%|███████▊  | 291955/371472 [1:03:56<6:25:36,  3.44it/s]
 79%|███████▊  | 291956/371472 [1:03:56<6:08:14,  3.60it/s]
 79%|███████▊  | 291957/371472 [1:03:56<6:18:15,  3.50it/s]
 79%|███████▊  | 291958/371472 [1:03:56<6:10:39,  3.58it/s]
 79%|███████▊  | 291959/371472 [1:03:57<6:10:21,  3.58it/s]
 79%|███████▊  | 291960/371472 [1:03:57<6:08:09,  3.60it/s]
                                                           
{'loss': 2.6845, 'learning_rate': 2.927449417138917e-07, 'epoch': 12.58}

 79%|███████▊  | 291960/371472 [1:03:57<6:08:09,  3.60it/s]
 79%|███████▊  | 291961/371472 [1:03:57<6:06:32,  3.62it/s]
 79%|███████▊  | 291962/371472 [1:03:58<5:56:46,  3.71it/s]
 79%|███████▊  | 291963/371472 [1:03:58<6:27:12,  3.42it/s]
 79%|███████▊  | 291964/371472 [1:03:58<6:12:47,  3.55it/s]
 79%|███████▊  | 291965/371472 [1:03:58<6:16:05,  3.52it/s]
 79%|███████▊  | 291966/371472 [1:03:59<6:06:13,  3.62it/s]
 79%|███████▊  | 291967/371472 [1:03:59<6:08:28,  3.60it/s]
 79%|███████▊  | 291968/371472 [1:03:59<6:06:13,  3.62it/s]
 79%|███████▊  | 291969/371472 [1:04:00<6:10:44,  3.57it/s]
 79%|███████▊  | 291970/371472 [1:04:00<6:01:30,  3.67it/s]
 79%|███████▊  | 291971/371472 [1:04:00<6:10:37,  3.58it/s]
 79%|███████▊  | 291972/371472 [1:04:00<6:07:32,  3.60it/s]
 79%|███████▊  | 291973/371472 [1:04:01<5:54:05,  3.74it/s]
 79%|███████▊  | 291974/371472 [1:04:01<5:48:52,  3.80it/s]
 79%|███████▊  | 291975/371472 [1:04:01<5:57:45,  3.70it/s]
 79%|███████▊  | 291976/371472 [1:04:01<5:45:52,  3.83it/s]
 79%|███████▊  | 291977/371472 [1:04:02<5:52:36,  3.76it/s]
 79%|███████▊  | 291978/371472 [1:04:02<6:19:49,  3.49it/s]
 79%|███████▊  | 291979/371472 [1:04:02<6:28:01,  3.41it/s]
 79%|███████▊  | 291980/371472 [1:04:03<6:26:46,  3.43it/s]
                                                           
{'loss': 2.724, 'learning_rate': 2.926964597384128e-07, 'epoch': 12.58}

 79%|███████▊  | 291980/371472 [1:04:03<6:26:46,  3.43it/s]
 79%|███████▊  | 291981/371472 [1:04:03<6:11:27,  3.57it/s]
 79%|███████▊  | 291982/371472 [1:04:03<6:02:33,  3.65it/s]
 79%|███████▊  | 291983/371472 [1:04:03<6:15:59,  3.52it/s]
 79%|███████▊  | 291984/371472 [1:04:04<6:12:22,  3.56it/s]
 79%|███████▊  | 291985/371472 [1:04:04<6:08:32,  3.59it/s]
 79%|███████▊  | 291986/371472 [1:04:04<6:10:29,  3.58it/s]
 79%|███████▊  | 291987/371472 [1:04:05<6:44:36,  3.27it/s]
 79%|███████▊  | 291988/371472 [1:04:05<6:18:20,  3.50it/s]
 79%|███████▊  | 291989/371472 [1:04:05<6:05:33,  3.62it/s]
 79%|███████▊  | 291990/371472 [1:04:05<6:25:21,  3.44it/s]
 79%|███████▊  | 291991/371472 [1:04:06<6:29:31,  3.40it/s]
 79%|███████▊  | 291992/371472 [1:04:06<6:39:31,  3.32it/s]
 79%|███████▊  | 291993/371472 [1:04:06<6:27:14,  3.42it/s]
 79%|███████▊  | 291994/371472 [1:04:07<6:16:45,  3.52it/s]
 79%|███████▊  | 291995/371472 [1:04:07<6:08:43,  3.59it/s]
 79%|███████▊  | 291996/371472 [1:04:07<6:01:37,  3.66it/s]
 79%|███████▊  | 291997/371472 [1:04:07<6:02:05,  3.66it/s]
 79%|███████▊  | 291998/371472 [1:04:08<5:57:05,  3.71it/s]
 79%|███████▊  | 291999/371472 [1:04:08<5:55:42,  3.72it/s]
 79%|███████▊  | 292000/371472 [1:04:08<6:21:59,  3.47it/s]
                                                           
{'loss': 2.581, 'learning_rate': 2.926479777629339e-07, 'epoch': 12.58}

 79%|███████▊  | 292000/371472 [1:04:08<6:21:59,  3.47it/s]
 79%|███████▊  | 292001/371472 [1:04:09<6:31:43,  3.38it/s]
 79%|███████▊  | 292002/371472 [1:04:09<6:18:50,  3.50it/s]
 79%|███████▊  | 292003/371472 [1:04:09<6:20:32,  3.48it/s]
 79%|███████▊  | 292004/371472 [1:04:09<6:27:35,  3.42it/s]
 79%|███████▊  | 292005/371472 [1:04:10<6:24:58,  3.44it/s]
 79%|███████▊  | 292006/371472 [1:04:10<6:30:06,  3.40it/s]
 79%|███████▊  | 292007/371472 [1:04:10<6:34:44,  3.36it/s]
 79%|███████▊  | 292008/371472 [1:04:11<6:35:56,  3.34it/s]
 79%|███████▊  | 292009/371472 [1:04:11<6:40:43,  3.30it/s]
 79%|███████▊  | 292010/371472 [1:04:11<6:50:47,  3.22it/s]
 79%|███████▊  | 292011/371472 [1:04:12<6:47:58,  3.25it/s]
 79%|███████▊  | 292012/371472 [1:04:12<6:32:34,  3.37it/s]
 79%|███████▊  | 292013/371472 [1:04:12<6:21:22,  3.47it/s]
 79%|███████▊  | 292014/371472 [1:04:12<6:13:09,  3.55it/s]
 79%|███████▊  | 292015/371472 [1:04:13<6:21:17,  3.47it/s]
 79%|███████▊  | 292016/371472 [1:04:13<6:23:24,  3.45it/s]
 79%|███████▊  | 292017/371472 [1:04:13<6:07:53,  3.60it/s]
 79%|███████▊  | 292018/371472 [1:04:13<6:11:43,  3.56it/s]
 79%|███████▊  | 292019/371472 [1:04:14<6:15:12,  3.53it/s]
 79%|███████▊  | 292020/371472 [1:04:14<6:15:54,  3.52it/s]
                                                           
{'loss': 2.6285, 'learning_rate': 2.92599495787455e-07, 'epoch': 12.58}

 79%|███████▊  | 292020/371472 [1:04:14<6:15:54,  3.52it/s]
 79%|███████▊  | 292021/371472 [1:04:14<6:09:45,  3.58it/s]
 79%|███████▊  | 292022/371472 [1:04:15<6:01:14,  3.67it/s]
 79%|███████▊  | 292023/371472 [1:04:15<6:34:26,  3.36it/s]
 79%|███████▊  | 292024/371472 [1:04:15<6:33:09,  3.37it/s]
 79%|███████▊  | 292025/371472 [1:04:16<6:33:41,  3.36it/s]
 79%|███████▊  | 292026/371472 [1:04:16<6:38:24,  3.32it/s]
 79%|███████▊  | 292027/371472 [1:04:16<6:29:31,  3.40it/s]
 79%|███████▊  | 292028/371472 [1:04:16<6:43:16,  3.28it/s]
 79%|███████▊  | 292029/371472 [1:04:17<6:45:19,  3.27it/s]
 79%|███████▊  | 292030/371472 [1:04:17<6:56:01,  3.18it/s]
 79%|███████▊  | 292031/371472 [1:04:17<6:39:42,  3.31it/s]
 79%|███████▊  | 292032/371472 [1:04:18<6:35:13,  3.35it/s]
 79%|███████▊  | 292033/371472 [1:04:18<6:35:12,  3.35it/s]
 79%|███████▊  | 292034/371472 [1:04:18<6:17:28,  3.51it/s]
 79%|███████▊  | 292035/371472 [1:04:18<6:06:12,  3.62it/s]
 79%|███████▊  | 292036/371472 [1:04:19<5:56:05,  3.72it/s]
 79%|███████▊  | 292037/371472 [1:04:19<5:54:55,  3.73it/s]
 79%|███████▊  | 292038/371472 [1:04:19<5:47:40,  3.81it/s]
 79%|███████▊  | 292039/371472 [1:04:20<5:53:31,  3.74it/s]
 79%|███████▊  | 292040/371472 [1:04:20<5:52:59,  3.75it/s]
                                                           
{'loss': 2.6735, 'learning_rate': 2.925510138119761e-07, 'epoch': 12.58}

 79%|███████▊  | 292040/371472 [1:04:20<5:52:59,  3.75it/s]
 79%|███████▊  | 292041/371472 [1:04:20<5:58:29,  3.69it/s]
 79%|███████▊  | 292042/371472 [1:04:20<5:45:52,  3.83it/s]
 79%|███████▊  | 292043/371472 [1:04:21<5:50:25,  3.78it/s]
 79%|███████▊  | 292044/371472 [1:04:21<5:43:49,  3.85it/s]
 79%|███████▊  | 292045/371472 [1:04:21<6:00:39,  3.67it/s]
 79%|███████▊  | 292046/371472 [1:04:21<5:56:38,  3.71it/s]
 79%|███████▊  | 292047/371472 [1:04:22<5:49:26,  3.79it/s]
 79%|███████▊  | 292048/371472 [1:04:22<6:08:46,  3.59it/s]
 79%|███████▊  | 292049/371472 [1:04:22<6:33:52,  3.36it/s]
 79%|███████▊  | 292050/371472 [1:04:23<6:48:40,  3.24it/s]
 79%|███████▊  | 292051/371472 [1:04:23<6:37:23,  3.33it/s]
 79%|███████▊  | 292052/371472 [1:04:23<6:22:08,  3.46it/s]
 79%|███████▊  | 292053/371472 [1:04:23<6:16:30,  3.52it/s]
 79%|███████▊  | 292054/371472 [1:04:24<6:03:48,  3.64it/s]
 79%|███████▊  | 292055/371472 [1:04:24<5:55:44,  3.72it/s]
 79%|███████▊  | 292056/371472 [1:04:24<5:59:42,  3.68it/s]
 79%|███████▊  | 292057/371472 [1:04:24<5:57:23,  3.70it/s]
 79%|███████▊  | 292058/371472 [1:04:25<5:49:40,  3.79it/s]
 79%|███████▊  | 292059/371472 [1:04:25<6:08:50,  3.59it/s]
 79%|███████▊  | 292060/371472 [1:04:25<6:14:29,  3.53it/s]
                                                           
{'loss': 2.7533, 'learning_rate': 2.9250253183649726e-07, 'epoch': 12.58}

 79%|███████▊  | 292060/371472 [1:04:25<6:14:29,  3.53it/s]
 79%|███████▊  | 292061/371472 [1:04:26<6:14:55,  3.53it/s]
 79%|███████▊  | 292062/371472 [1:04:26<6:08:55,  3.59it/s]
 79%|███████▊  | 292063/371472 [1:04:26<6:09:08,  3.59it/s]
 79%|███████▊  | 292064/371472 [1:04:27<6:28:00,  3.41it/s]
 79%|███████▊  | 292065/371472 [1:04:27<6:18:28,  3.50it/s]
 79%|███████▊  | 292066/371472 [1:04:27<6:14:25,  3.53it/s]
 79%|███████▊  | 292067/371472 [1:04:27<6:06:54,  3.61it/s]
 79%|███████▊  | 292068/371472 [1:04:28<6:59:59,  3.15it/s]
 79%|███████▊  | 292069/371472 [1:04:28<6:48:38,  3.24it/s]
 79%|███████▊  | 292070/371472 [1:04:28<6:39:09,  3.32it/s]
 79%|███████▊  | 292071/371472 [1:04:29<6:39:42,  3.31it/s]
 79%|███████▊  | 292072/371472 [1:04:29<6:25:10,  3.44it/s]
 79%|███████▊  | 292073/371472 [1:04:29<6:21:23,  3.47it/s]
 79%|███████▊  | 292074/371472 [1:04:29<6:11:41,  3.56it/s]
 79%|███████▊  | 292075/371472 [1:04:30<6:08:53,  3.59it/s]
 79%|███████▊  | 292076/371472 [1:04:30<6:06:12,  3.61it/s]
 79%|███████▊  | 292077/371472 [1:04:30<6:34:28,  3.35it/s]
 79%|███████▊  | 292078/371472 [1:04:31<6:20:57,  3.47it/s]
 79%|███████▊  | 292079/371472 [1:04:31<6:24:19,  3.44it/s]
 79%|███████▊  | 292080/371472 [1:04:31<6:34:39,  3.35it/s]
                                                           
{'loss': 2.8235, 'learning_rate': 2.9245404986101833e-07, 'epoch': 12.58}

 79%|███████▊  | 292080/371472 [1:04:31<6:34:39,  3.35it/s]
 79%|███████▊  | 292081/371472 [1:04:31<6:19:44,  3.48it/s]
 79%|███████▊  | 292082/371472 [1:04:32<6:42:26,  3.29it/s]
 79%|███████▊  | 292083/371472 [1:04:32<6:18:19,  3.50it/s]
 79%|███████▊  | 292084/371472 [1:04:32<6:09:03,  3.59it/s]
 79%|███████▊  | 292085/371472 [1:04:33<5:53:29,  3.74it/s]
 79%|███████▊  | 292086/371472 [1:04:33<6:24:20,  3.44it/s]
 79%|███████▊  | 292087/371472 [1:04:33<6:11:34,  3.56it/s]
 79%|███████▊  | 292088/371472 [1:04:33<6:18:57,  3.49it/s]
 79%|███████▊  | 292089/371472 [1:04:34<6:14:02,  3.54it/s]
 79%|███████▊  | 292090/371472 [1:04:34<6:25:01,  3.44it/s]
 79%|███████▊  | 292091/371472 [1:04:34<6:37:20,  3.33it/s]
 79%|███████▊  | 292092/371472 [1:04:35<6:42:51,  3.28it/s]
 79%|███████▊  | 292093/371472 [1:04:35<6:27:35,  3.41it/s]
 79%|███████▊  | 292094/371472 [1:04:35<6:08:23,  3.59it/s]
 79%|███████▊  | 292095/371472 [1:04:35<6:05:12,  3.62it/s]
 79%|███████▊  | 292096/371472 [1:04:36<6:13:08,  3.55it/s]
 79%|███████▊  | 292097/371472 [1:04:36<6:16:21,  3.52it/s]
 79%|███████▊  | 292098/371472 [1:04:36<6:18:55,  3.49it/s]
 79%|███████▊  | 292099/371472 [1:04:37<6:05:54,  3.62it/s]
 79%|███████▊  | 292100/371472 [1:04:37<6:12:48,  3.55it/s]
                                                           
{'loss': 2.6697, 'learning_rate': 2.924055678855395e-07, 'epoch': 12.58}

 79%|███████▊  | 292100/371472 [1:04:37<6:12:48,  3.55it/s]
 79%|███████▊  | 292101/371472 [1:04:37<6:05:19,  3.62it/s]
 79%|███████▊  | 292102/371472 [1:04:38<7:25:30,  2.97it/s]
 79%|███████▊  | 292103/371472 [1:04:38<6:58:33,  3.16it/s]
 79%|███████▊  | 292104/371472 [1:04:38<6:50:52,  3.22it/s]
 79%|███████▊  | 292105/371472 [1:04:38<6:52:07,  3.21it/s]
 79%|███████▊  | 292106/371472 [1:04:39<6:57:40,  3.17it/s]
 79%|███████▊  | 292107/371472 [1:04:39<6:38:11,  3.32it/s]
 79%|███████▊  | 292108/371472 [1:04:39<6:29:24,  3.40it/s]
 79%|███████▊  | 292109/371472 [1:04:40<6:19:26,  3.49it/s]
 79%|███████▊  | 292110/371472 [1:04:40<6:17:36,  3.50it/s]
 79%|███████▊  | 292111/371472 [1:04:40<6:38:49,  3.32it/s]
 79%|███████▊  | 292112/371472 [1:04:41<6:26:58,  3.42it/s]
 79%|███████▊  | 292113/371472 [1:04:41<6:22:53,  3.45it/s]
 79%|███████▊  | 292114/371472 [1:04:41<6:07:49,  3.60it/s]
 79%|███████▊  | 292115/371472 [1:04:41<6:13:05,  3.55it/s]
 79%|███████▊  | 292116/371472 [1:04:42<6:10:35,  3.57it/s]
 79%|███████▊  | 292117/371472 [1:04:42<6:11:50,  3.56it/s]
 79%|███████▊  | 292118/371472 [1:04:42<6:33:14,  3.36it/s]
 79%|███████▊  | 292119/371472 [1:04:43<6:23:39,  3.45it/s]
 79%|███████▊  | 292120/371472 [1:04:43<6:09:35,  3.58it/s]
                                                           
{'loss': 2.6171, 'learning_rate': 2.9235708591006053e-07, 'epoch': 12.58}

 79%|███████▊  | 292120/371472 [1:04:43<6:09:35,  3.58it/s]
 79%|███████▊  | 292121/371472 [1:04:43<6:06:49,  3.61it/s]
 79%|███████▊  | 292122/371472 [1:04:43<5:57:38,  3.70it/s]
 79%|███████▊  | 292123/371472 [1:04:44<5:53:47,  3.74it/s]
 79%|███████▊  | 292124/371472 [1:04:44<6:00:21,  3.67it/s]
 79%|███████▊  | 292125/371472 [1:04:44<5:51:53,  3.76it/s]
 79%|███████▊  | 292126/371472 [1:04:44<5:58:44,  3.69it/s]
 79%|███████▊  | 292127/371472 [1:04:45<6:10:58,  3.56it/s]
 79%|███████▊  | 292128/371472 [1:04:45<6:32:56,  3.37it/s]
 79%|███████▊  | 292129/371472 [1:04:45<6:16:45,  3.51it/s]
 79%|███████▊  | 292130/371472 [1:04:46<6:17:33,  3.50it/s]
 79%|███████▊  | 292131/371472 [1:04:46<6:09:29,  3.58it/s]
 79%|███████▊  | 292132/371472 [1:04:46<6:10:55,  3.56it/s]
 79%|███████▊  | 292133/371472 [1:04:46<6:10:56,  3.56it/s]
 79%|███████▊  | 292134/371472 [1:04:47<6:28:15,  3.41it/s]
 79%|███████▊  | 292135/371472 [1:04:47<6:22:37,  3.46it/s]
 79%|███████▊  | 292136/371472 [1:04:47<6:33:39,  3.36it/s]
 79%|███████▊  | 292137/371472 [1:04:48<6:53:35,  3.20it/s]
 79%|███████▊  | 292138/371472 [1:04:48<6:44:03,  3.27it/s]
 79%|███████▊  | 292139/371472 [1:04:48<6:31:31,  3.38it/s]
 79%|███████▊  | 292140/371472 [1:04:48<6:22:05,  3.46it/s]
                                                           
{'loss': 2.6433, 'learning_rate': 2.9230860393458165e-07, 'epoch': 12.58}

 79%|███████▊  | 292140/371472 [1:04:48<6:22:05,  3.46it/s]
 79%|███████▊  | 292141/371472 [1:04:49<6:24:56,  3.43it/s]
 79%|███████▊  | 292142/371472 [1:04:49<6:21:45,  3.46it/s]
 79%|███████▊  | 292143/371472 [1:04:49<6:18:24,  3.49it/s]
 79%|███████▊  | 292144/371472 [1:04:50<6:10:51,  3.57it/s]
 79%|███████▊  | 292145/371472 [1:04:50<6:21:23,  3.47it/s]
 79%|███████▊  | 292146/371472 [1:04:50<6:12:14,  3.55it/s]
 79%|███████▊  | 292147/371472 [1:04:50<6:15:57,  3.52it/s]
 79%|███████▊  | 292148/371472 [1:04:51<6:00:14,  3.67it/s]
 79%|███████▊  | 292149/371472 [1:04:51<6:04:24,  3.63it/s]
 79%|███████▊  | 292150/371472 [1:04:51<5:55:27,  3.72it/s]
 79%|███████▊  | 292151/371472 [1:04:52<5:55:48,  3.72it/s]
 79%|███████▊  | 292152/371472 [1:04:52<6:17:03,  3.51it/s]
 79%|███████▊  | 292153/371472 [1:04:52<6:01:03,  3.66it/s]
 79%|███████▊  | 292154/371472 [1:04:52<6:26:26,  3.42it/s]
 79%|███████▊  | 292155/371472 [1:04:53<6:08:14,  3.59it/s]
 79%|███████▊  | 292156/371472 [1:04:53<6:01:21,  3.66it/s]
 79%|███████▊  | 292157/371472 [1:04:53<6:18:02,  3.50it/s]
 79%|███████▊  | 292158/371472 [1:04:54<6:13:29,  3.54it/s]
 79%|███████▊  | 292159/371472 [1:04:54<6:33:43,  3.36it/s]
 79%|███████▊  | 292160/371472 [1:04:54<6:22:09,  3.46it/s]
                                                           
{'loss': 2.5921, 'learning_rate': 2.922601219591027e-07, 'epoch': 12.58}

 79%|███████▊  | 292160/371472 [1:04:54<6:22:09,  3.46it/s]
 79%|███████▊  | 292161/371472 [1:04:54<6:14:00,  3.53it/s]
 79%|███████▊  | 292162/371472 [1:04:55<6:12:06,  3.55it/s]
 79%|███████▊  | 292163/371472 [1:04:55<6:02:25,  3.65it/s]
 79%|███████▊  | 292164/371472 [1:04:55<6:01:32,  3.66it/s]
 79%|███████▊  | 292165/371472 [1:04:56<6:36:42,  3.33it/s]
 79%|███████▊  | 292166/371472 [1:04:56<6:29:17,  3.40it/s]
 79%|███████▊  | 292167/371472 [1:04:56<6:14:29,  3.53it/s]
 79%|███████▊  | 292168/371472 [1:04:56<6:09:40,  3.58it/s]
 79%|███████▊  | 292169/371472 [1:04:57<6:27:44,  3.41it/s]
 79%|███████▊  | 292170/371472 [1:04:57<6:23:41,  3.44it/s]
 79%|███████▊  | 292171/371472 [1:04:57<6:15:31,  3.52it/s]
 79%|███████▊  | 292172/371472 [1:04:58<6:36:48,  3.33it/s]
 79%|███████▊  | 292173/371472 [1:04:58<6:19:16,  3.48it/s]
 79%|███████▊  | 292174/371472 [1:04:58<6:17:48,  3.50it/s]
 79%|███████▊  | 292175/371472 [1:04:58<6:02:00,  3.65it/s]
 79%|███████▊  | 292176/371472 [1:04:59<6:17:16,  3.50it/s]
 79%|███████▊  | 292177/371472 [1:04:59<5:59:41,  3.67it/s]
 79%|███████▊  | 292178/371472 [1:04:59<5:46:42,  3.81it/s]
 79%|███████▊  | 292179/371472 [1:04:59<5:45:51,  3.82it/s]
 79%|███████▊  | 292180/371472 [1:05:00<5:59:37,  3.67it/s]
                                                           
{'loss': 2.695, 'learning_rate': 2.922116399836238e-07, 'epoch': 12.58}

 79%|███████▊  | 292180/371472 [1:05:00<5:59:37,  3.67it/s]
 79%|███████▊  | 292181/371472 [1:05:00<6:18:06,  3.50it/s]
 79%|███████▊  | 292182/371472 [1:05:00<6:14:12,  3.53it/s]
 79%|███████▊  | 292183/371472 [1:05:01<6:26:45,  3.42it/s]
 79%|███████▊  | 292184/371472 [1:05:01<6:13:29,  3.54it/s]
 79%|███████▊  | 292185/371472 [1:05:01<6:13:00,  3.54it/s]
 79%|███████▊  | 292186/371472 [1:05:01<6:20:33,  3.47it/s]
 79%|███████▊  | 292187/371472 [1:05:02<6:08:21,  3.59it/s]
 79%|███████▊  | 292188/371472 [1:05:02<6:03:48,  3.63it/s]
 79%|███████▊  | 292189/371472 [1:05:02<6:16:55,  3.51it/s]
 79%|███████▊  | 292190/371472 [1:05:03<6:16:56,  3.51it/s]
 79%|███████▊  | 292191/371472 [1:05:03<6:07:10,  3.60it/s]
 79%|███████▊  | 292192/371472 [1:05:03<6:11:08,  3.56it/s]
 79%|███████▊  | 292193/371472 [1:05:03<5:56:10,  3.71it/s]
 79%|███████▊  | 292194/371472 [1:05:04<6:12:49,  3.54it/s]
 79%|███████▊  | 292195/371472 [1:05:04<5:58:51,  3.68it/s]
 79%|███████▊  | 292196/371472 [1:05:04<6:02:07,  3.65it/s]
 79%|███████▊  | 292197/371472 [1:05:05<6:33:50,  3.35it/s]
 79%|███████▊  | 292198/371472 [1:05:05<6:32:48,  3.36it/s]
 79%|███████▊  | 292199/371472 [1:05:05<6:38:12,  3.32it/s]
 79%|███████▊  | 292200/371472 [1:05:05<6:28:41,  3.40it/s]
                                                           
{'loss': 2.8238, 'learning_rate': 2.92163158008145e-07, 'epoch': 12.59}

 79%|███████▊  | 292200/371472 [1:05:05<6:28:41,  3.40it/s]
 79%|███████▊  | 292201/371472 [1:05:06<6:22:16,  3.46it/s]
 79%|███████▊  | 292202/371472 [1:05:06<6:24:53,  3.43it/s]
 79%|███████▊  | 292203/371472 [1:05:06<6:17:14,  3.50it/s]
 79%|███████▊  | 292204/371472 [1:05:07<6:34:20,  3.35it/s]
 79%|███████▊  | 292205/371472 [1:05:07<6:30:24,  3.38it/s]
 79%|███████▊  | 292206/371472 [1:05:07<6:22:59,  3.45it/s]
 79%|███████▊  | 292207/371472 [1:05:08<6:27:04,  3.41it/s]
 79%|███████▊  | 292208/371472 [1:05:08<6:10:04,  3.57it/s]
 79%|███████▊  | 292209/371472 [1:05:08<6:01:37,  3.65it/s]
 79%|███████▊  | 292210/371472 [1:05:08<5:54:59,  3.72it/s]
 79%|███████▊  | 292211/371472 [1:05:09<6:01:01,  3.66it/s]
 79%|███████▊  | 292212/371472 [1:05:09<5:47:08,  3.81it/s]
 79%|███████▊  | 292213/371472 [1:05:09<5:45:17,  3.83it/s]
 79%|███████▊  | 292214/371472 [1:05:09<5:49:50,  3.78it/s]
 79%|███████▊  | 292215/371472 [1:05:10<5:49:59,  3.77it/s]
 79%|███████▊  | 292216/371472 [1:05:10<6:12:01,  3.55it/s]
 79%|███████▊  | 292217/371472 [1:05:10<6:09:21,  3.58it/s]
 79%|███████▊  | 292218/371472 [1:05:10<6:10:06,  3.57it/s]
 79%|███████▊  | 292219/371472 [1:05:11<6:43:12,  3.28it/s]
 79%|███████▊  | 292220/371472 [1:05:11<6:32:12,  3.37it/s]
                                                           
{'loss': 2.7444, 'learning_rate': 2.9211467603266605e-07, 'epoch': 12.59}

 79%|███████▊  | 292220/371472 [1:05:11<6:32:12,  3.37it/s]
 79%|███████▊  | 292221/371472 [1:05:11<6:17:17,  3.50it/s]
 79%|███████▊  | 292222/371472 [1:05:12<6:09:03,  3.58it/s]
 79%|███████▊  | 292223/371472 [1:05:12<6:03:54,  3.63it/s]
 79%|███████▊  | 292224/371472 [1:05:12<5:53:14,  3.74it/s]
 79%|███████▊  | 292225/371472 [1:05:12<6:01:14,  3.66it/s]
 79%|███████▊  | 292226/371472 [1:05:13<6:29:11,  3.39it/s]
 79%|███████▊  | 292227/371472 [1:05:13<6:40:17,  3.30it/s]
 79%|███████▊  | 292228/371472 [1:05:13<6:17:47,  3.50it/s]
 79%|███████▊  | 292229/371472 [1:05:14<6:36:22,  3.33it/s]
 79%|███████▊  | 292230/371472 [1:05:14<6:35:31,  3.34it/s]
 79%|███████▊  | 292231/371472 [1:05:14<6:38:12,  3.32it/s]
 79%|███████▊  | 292232/371472 [1:05:15<6:29:09,  3.39it/s]
 79%|███████▊  | 292233/371472 [1:05:15<6:23:02,  3.45it/s]
 79%|███████▊  | 292234/371472 [1:05:15<6:26:28,  3.42it/s]
 79%|███████▊  | 292235/371472 [1:05:15<6:28:19,  3.40it/s]
 79%|███████▊  | 292236/371472 [1:05:16<6:23:18,  3.45it/s]
 79%|███████▊  | 292237/371472 [1:05:16<6:01:13,  3.66it/s]
 79%|███████▊  | 292238/371472 [1:05:16<6:12:05,  3.55it/s]
 79%|███████▊  | 292239/371472 [1:05:17<6:02:09,  3.65it/s]
 79%|███████▊  | 292240/371472 [1:05:17<6:04:46,  3.62it/s]
                                                           
{'loss': 2.6187, 'learning_rate': 2.9206619405718717e-07, 'epoch': 12.59}

 79%|███████▊  | 292240/371472 [1:05:17<6:04:46,  3.62it/s]
 79%|███████▊  | 292241/371472 [1:05:17<6:26:28,  3.42it/s]
 79%|███████▊  | 292242/371472 [1:05:17<6:11:09,  3.56it/s]
 79%|███████▊  | 292243/371472 [1:05:18<5:59:02,  3.68it/s]
 79%|███████▊  | 292244/371472 [1:05:18<6:10:18,  3.57it/s]
 79%|███████▊  | 292245/371472 [1:05:18<6:00:09,  3.67it/s]
 79%|███████▊  | 292246/371472 [1:05:18<5:52:43,  3.74it/s]
 79%|███████▊  | 292247/371472 [1:05:19<6:44:56,  3.26it/s]
 79%|███████▊  | 292248/371472 [1:05:19<6:29:15,  3.39it/s]
 79%|███████▊  | 292249/371472 [1:05:19<6:15:10,  3.52it/s]
 79%|███████▊  | 292250/371472 [1:05:20<6:04:49,  3.62it/s]
 79%|███████▊  | 292251/371472 [1:05:20<5:51:34,  3.76it/s]
 79%|███████▊  | 292252/371472 [1:05:20<5:54:16,  3.73it/s]
 79%|███████▊  | 292253/371472 [1:05:20<5:59:21,  3.67it/s]
 79%|███████▊  | 292254/371472 [1:05:21<6:05:47,  3.61it/s]
 79%|███████▊  | 292255/371472 [1:05:21<6:01:35,  3.65it/s]
 79%|███████▊  | 292256/371472 [1:05:21<6:06:25,  3.60it/s]
 79%|███████▊  | 292257/371472 [1:05:22<6:25:37,  3.42it/s]
 79%|███████▊  | 292258/371472 [1:05:22<6:17:56,  3.49it/s]
 79%|███████▊  | 292259/371472 [1:05:22<6:10:49,  3.56it/s]
 79%|███████▊  | 292260/371472 [1:05:22<5:56:15,  3.71it/s]
                                                           
{'loss': 2.7259, 'learning_rate': 2.9201771208170824e-07, 'epoch': 12.59}

 79%|███████▊  | 292260/371472 [1:05:22<5:56:15,  3.71it/s]
 79%|███████▊  | 292261/371472 [1:05:23<5:48:24,  3.79it/s]
 79%|███████▊  | 292262/371472 [1:05:23<5:44:32,  3.83it/s]
 79%|███████▊  | 292263/371472 [1:05:23<6:16:43,  3.50it/s]
 79%|███████▊  | 292264/371472 [1:05:24<6:36:32,  3.33it/s]
 79%|███████▊  | 292265/371472 [1:05:24<6:26:49,  3.41it/s]
 79%|███████▊  | 292266/371472 [1:05:24<6:42:36,  3.28it/s]
 79%|███████▊  | 292267/371472 [1:05:24<6:26:43,  3.41it/s]
 79%|███████▊  | 292268/371472 [1:05:25<6:24:19,  3.43it/s]
 79%|███████▊  | 292269/371472 [1:05:25<6:34:29,  3.35it/s]
 79%|███████▊  | 292270/371472 [1:05:25<6:39:19,  3.31it/s]
 79%|███████▊  | 292271/371472 [1:05:26<6:16:22,  3.51it/s]
 79%|███████▊  | 292272/371472 [1:05:26<6:07:03,  3.60it/s]
 79%|███████▊  | 292273/371472 [1:05:26<6:07:56,  3.59it/s]
 79%|███████▊  | 292274/371472 [1:05:26<6:07:40,  3.59it/s]
 79%|███████▊  | 292275/371472 [1:05:27<6:11:22,  3.55it/s]
 79%|███████▊  | 292276/371472 [1:05:27<6:09:13,  3.57it/s]
 79%|███████▊  | 292277/371472 [1:05:27<6:09:01,  3.58it/s]
 79%|███████▊  | 292278/371472 [1:05:28<6:33:03,  3.36it/s]
 79%|███████▊  | 292279/371472 [1:05:28<6:20:17,  3.47it/s]
 79%|███████▊  | 292280/371472 [1:05:28<6:11:20,  3.55it/s]
                                                           
{'loss': 2.6344, 'learning_rate': 2.9196923010622937e-07, 'epoch': 12.59}

 79%|███████▊  | 292280/371472 [1:05:28<6:11:20,  3.55it/s]
 79%|███████▊  | 292281/371472 [1:05:28<6:03:55,  3.63it/s]
 79%|███████▊  | 292282/371472 [1:05:29<5:50:48,  3.76it/s]
 79%|███████▊  | 292283/371472 [1:05:29<5:49:15,  3.78it/s]
 79%|███████▊  | 292284/371472 [1:05:29<5:54:59,  3.72it/s]
 79%|███████▊  | 292285/371472 [1:05:29<5:58:07,  3.69it/s]
 79%|███████▊  | 292286/371472 [1:05:30<6:00:05,  3.67it/s]
 79%|███████▊  | 292287/371472 [1:05:30<6:25:49,  3.42it/s]
 79%|███████▊  | 292288/371472 [1:05:30<6:05:43,  3.61it/s]
 79%|███████▊  | 292289/371472 [1:05:31<6:03:12,  3.63it/s]
 79%|███████▊  | 292290/371472 [1:05:31<5:54:41,  3.72it/s]
 79%|███████▊  | 292291/371472 [1:05:31<6:02:36,  3.64it/s]
 79%|███████▊  | 292292/371472 [1:05:31<6:32:40,  3.36it/s]
 79%|███████▊  | 292293/371472 [1:05:32<6:32:49,  3.36it/s]
 79%|███████▊  | 292294/371472 [1:05:32<6:25:17,  3.43it/s]
 79%|███████▊  | 292295/371472 [1:05:32<6:28:16,  3.40it/s]
 79%|███████▊  | 292296/371472 [1:05:33<6:06:39,  3.60it/s]
 79%|███████▊  | 292297/371472 [1:05:33<5:56:00,  3.71it/s]
 79%|███████▊  | 292298/371472 [1:05:33<5:52:54,  3.74it/s]
 79%|███████▊  | 292299/371472 [1:05:33<5:53:26,  3.73it/s]
 79%|███████▊  | 292300/371472 [1:05:34<6:12:45,  3.54it/s]
                                                           
{'loss': 2.649, 'learning_rate': 2.9192074813075044e-07, 'epoch': 12.59}

 79%|███████▊  | 292300/371472 [1:05:34<6:12:45,  3.54it/s]
 79%|███████▊  | 292301/371472 [1:05:34<6:08:30,  3.58it/s]
 79%|███████▊  | 292302/371472 [1:05:34<6:17:04,  3.50it/s]
 79%|███████▊  | 292303/371472 [1:05:35<6:55:46,  3.17it/s]
 79%|███████▊  | 292304/371472 [1:05:35<6:30:22,  3.38it/s]
 79%|███████▊  | 292305/371472 [1:05:35<6:16:17,  3.51it/s]
 79%|███████▊  | 292306/371472 [1:05:35<6:00:44,  3.66it/s]
 79%|███████▊  | 292307/371472 [1:05:36<6:15:49,  3.51it/s]
 79%|███████▊  | 292308/371472 [1:05:36<6:14:10,  3.53it/s]
 79%|███████▊  | 292309/371472 [1:05:36<6:32:52,  3.36it/s]
 79%|███████▊  | 292310/371472 [1:05:37<6:23:50,  3.44it/s]
 79%|███████▊  | 292311/371472 [1:05:37<6:11:01,  3.56it/s]
 79%|███████▊  | 292312/371472 [1:05:37<6:12:45,  3.54it/s]
 79%|███████▊  | 292313/371472 [1:05:37<6:22:55,  3.45it/s]
 79%|███████▊  | 292314/371472 [1:05:38<6:30:10,  3.38it/s]
 79%|███████▊  | 292315/371472 [1:05:38<6:33:51,  3.35it/s]
 79%|███████▊  | 292316/371472 [1:05:38<6:52:32,  3.20it/s]
 79%|███████▊  | 292317/371472 [1:05:39<6:38:58,  3.31it/s]
 79%|███████▊  | 292318/371472 [1:05:39<6:21:44,  3.46it/s]
 79%|███████▊  | 292319/371472 [1:05:39<6:06:19,  3.60it/s]
 79%|███████▊  | 292320/371472 [1:05:39<5:58:50,  3.68it/s]
                                                           
{'loss': 2.6747, 'learning_rate': 2.918722661552716e-07, 'epoch': 12.59}

 79%|███████▊  | 292320/371472 [1:05:39<5:58:50,  3.68it/s]
 79%|███████▊  | 292321/371472 [1:05:40<5:55:27,  3.71it/s]
 79%|███████▊  | 292322/371472 [1:05:40<5:59:55,  3.67it/s]
 79%|███████▊  | 292323/371472 [1:05:40<5:58:27,  3.68it/s]
 79%|███████▊  | 292324/371472 [1:05:41<6:03:00,  3.63it/s]
 79%|███████▊  | 292325/371472 [1:05:41<5:56:52,  3.70it/s]
 79%|███████▊  | 292326/371472 [1:05:41<5:48:30,  3.78it/s]
 79%|███████▊  | 292327/371472 [1:05:41<5:54:57,  3.72it/s]
 79%|███████▊  | 292328/371472 [1:05:42<6:01:28,  3.65it/s]
 79%|███████▊  | 292329/371472 [1:05:42<6:13:38,  3.53it/s]
 79%|███████▊  | 292330/371472 [1:05:42<6:09:25,  3.57it/s]
 79%|███████▊  | 292331/371472 [1:05:43<6:26:17,  3.41it/s]
 79%|███████▊  | 292332/371472 [1:05:43<6:25:56,  3.42it/s]
 79%|███████▊  | 292333/371472 [1:05:43<6:20:38,  3.47it/s]
 79%|███████▊  | 292334/371472 [1:05:43<6:05:10,  3.61it/s]
 79%|███████▊  | 292335/371472 [1:05:44<6:23:04,  3.44it/s]
 79%|███████▊  | 292336/371472 [1:05:44<6:11:06,  3.55it/s]
 79%|███████▊  | 292337/371472 [1:05:44<6:05:28,  3.61it/s]
 79%|███████▊  | 292338/371472 [1:05:44<6:08:18,  3.58it/s]
 79%|███████▊  | 292339/371472 [1:05:45<6:06:18,  3.60it/s]
 79%|███████▊  | 292340/371472 [1:05:45<6:37:22,  3.32it/s]
                                                           
{'loss': 2.7064, 'learning_rate': 2.918237841797927e-07, 'epoch': 12.59}

 79%|███████▊  | 292340/371472 [1:05:45<6:37:22,  3.32it/s]
 79%|███████▊  | 292341/371472 [1:05:45<6:22:16,  3.45it/s]
 79%|███████▊  | 292342/371472 [1:05:46<6:48:27,  3.23it/s]
 79%|███████▊  | 292343/371472 [1:05:46<7:00:45,  3.13it/s]
 79%|███████▊  | 292344/371472 [1:05:46<7:08:06,  3.08it/s]
 79%|███████▊  | 292345/371472 [1:05:47<6:46:49,  3.24it/s]
 79%|███████▊  | 292346/371472 [1:05:47<6:42:38,  3.28it/s]
 79%|███████▊  | 292347/371472 [1:05:47<6:32:43,  3.36it/s]
 79%|███████▊  | 292348/371472 [1:05:48<6:30:00,  3.38it/s]
 79%|███████▊  | 292349/371472 [1:05:48<6:39:18,  3.30it/s]
 79%|███████▊  | 292350/371472 [1:05:48<6:16:54,  3.50it/s]
 79%|███████▊  | 292351/371472 [1:05:48<5:59:58,  3.66it/s]
 79%|███████▊  | 292352/371472 [1:05:49<6:26:31,  3.41it/s]
 79%|███████▊  | 292353/371472 [1:05:49<6:55:27,  3.17it/s]
 79%|███████▊  | 292354/371472 [1:05:49<6:36:42,  3.32it/s]
 79%|███████▊  | 292355/371472 [1:05:50<6:50:57,  3.21it/s]
 79%|███████▊  | 292356/371472 [1:05:50<6:33:53,  3.35it/s]
 79%|███████▊  | 292357/371472 [1:05:50<6:30:43,  3.37it/s]
 79%|███████▊  | 292358/371472 [1:05:50<6:12:09,  3.54it/s]
 79%|███████▊  | 292359/371472 [1:05:51<6:08:58,  3.57it/s]
 79%|███████▊  | 292360/371472 [1:05:51<6:13:08,  3.53it/s]
                                                           
{'loss': 2.6012, 'learning_rate': 2.917753022043138e-07, 'epoch': 12.59}

 79%|███████▊  | 292360/371472 [1:05:51<6:13:08,  3.53it/s]
 79%|███████▊  | 292361/371472 [1:05:51<6:27:24,  3.40it/s]
 79%|███████▊  | 292362/371472 [1:05:52<6:19:08,  3.48it/s]
 79%|███████▊  | 292363/371472 [1:05:52<7:16:59,  3.02it/s]
 79%|███████▊  | 292364/371472 [1:05:52<6:59:33,  3.14it/s]
 79%|███████▊  | 292365/371472 [1:05:53<7:11:32,  3.06it/s]
 79%|███████▊  | 292366/371472 [1:05:53<7:46:33,  2.83it/s]
 79%|███████▊  | 292367/371472 [1:05:53<7:29:08,  2.94it/s]
 79%|███████▊  | 292368/371472 [1:05:54<7:08:33,  3.08it/s]
 79%|███████▊  | 292369/371472 [1:05:54<6:46:16,  3.25it/s]
 79%|███████▊  | 292370/371472 [1:05:54<6:28:56,  3.39it/s]
 79%|███████▊  | 292371/371472 [1:05:55<6:25:24,  3.42it/s]
 79%|███████▊  | 292372/371472 [1:05:55<6:27:05,  3.41it/s]
 79%|███████▊  | 292373/371472 [1:05:55<6:22:18,  3.45it/s]
 79%|███████▊  | 292374/371472 [1:05:55<6:50:32,  3.21it/s]
 79%|███████▊  | 292375/371472 [1:05:56<6:22:58,  3.44it/s]
 79%|███████▊  | 292376/371472 [1:05:56<6:32:59,  3.35it/s]
 79%|███████▊  | 292377/371472 [1:05:56<6:27:30,  3.40it/s]
 79%|███████▊  | 292378/371472 [1:05:57<6:14:55,  3.52it/s]
 79%|███████▊  | 292379/371472 [1:05:57<6:12:35,  3.54it/s]
 79%|███████▊  | 292380/371472 [1:05:57<6:44:02,  3.26it/s]
                                                           
{'loss': 2.5918, 'learning_rate': 2.917268202288349e-07, 'epoch': 12.59}

 79%|███████▊  | 292380/371472 [1:05:57<6:44:02,  3.26it/s]
 79%|███████▊  | 292381/371472 [1:05:57<6:33:24,  3.35it/s]
 79%|███████▊  | 292382/371472 [1:05:58<6:33:13,  3.35it/s]
 79%|███████▊  | 292383/371472 [1:05:58<6:09:37,  3.57it/s]
 79%|███████▊  | 292384/371472 [1:05:58<6:28:21,  3.39it/s]
 79%|███████▊  | 292385/371472 [1:05:59<6:27:15,  3.40it/s]
 79%|███████▊  | 292386/371472 [1:05:59<6:14:45,  3.52it/s]
 79%|███████▊  | 292387/371472 [1:05:59<6:28:57,  3.39it/s]
 79%|███████▊  | 292388/371472 [1:06:00<6:25:21,  3.42it/s]
 79%|███████▊  | 292389/371472 [1:06:00<6:08:06,  3.58it/s]
 79%|███████▊  | 292390/371472 [1:06:00<6:05:25,  3.61it/s]
 79%|███████▊  | 292391/371472 [1:06:00<6:01:14,  3.65it/s]
 79%|███████▊  | 292392/371472 [1:06:01<6:52:23,  3.20it/s]
 79%|███████▊  | 292393/371472 [1:06:01<6:48:39,  3.23it/s]
 79%|███████▊  | 292394/371472 [1:06:01<6:26:12,  3.41it/s]
 79%|███████▊  | 292395/371472 [1:06:02<6:20:26,  3.46it/s]
 79%|███████▊  | 292396/371472 [1:06:02<6:01:14,  3.65it/s]
 79%|███████▊  | 292397/371472 [1:06:02<6:05:32,  3.61it/s]
 79%|███████▊  | 292398/371472 [1:06:02<6:47:15,  3.24it/s]
 79%|███████▊  | 292399/371472 [1:06:03<6:26:59,  3.41it/s]
 79%|███████▊  | 292400/371472 [1:06:03<6:35:14,  3.33it/s]
                                                           
{'loss': 2.6065, 'learning_rate': 2.91678338253356e-07, 'epoch': 12.59}

 79%|███████▊  | 292400/371472 [1:06:03<6:35:14,  3.33it/s]
 79%|███████▊  | 292401/371472 [1:06:03<6:24:38,  3.43it/s]
 79%|███████▊  | 292402/371472 [1:06:04<6:12:41,  3.54it/s]
 79%|███████▊  | 292403/371472 [1:06:04<6:03:02,  3.63it/s]
 79%|███████▊  | 292404/371472 [1:06:04<5:59:12,  3.67it/s]
 79%|███████▊  | 292405/371472 [1:06:04<6:01:37,  3.64it/s]
 79%|███████▊  | 292406/371472 [1:06:05<5:53:23,  3.73it/s]
 79%|███████▊  | 292407/371472 [1:06:05<6:08:46,  3.57it/s]
 79%|███████▊  | 292408/371472 [1:06:05<6:08:46,  3.57it/s]
 79%|███████▊  | 292409/371472 [1:06:05<5:56:22,  3.70it/s]
 79%|███████▊  | 292410/371472 [1:06:06<5:55:52,  3.70it/s]
 79%|███████▊  | 292411/371472 [1:06:06<6:17:39,  3.49it/s]
 79%|███████▊  | 292412/371472 [1:06:06<6:05:55,  3.60it/s]
 79%|███████▊  | 292413/371472 [1:06:07<6:14:30,  3.52it/s]
 79%|███████▊  | 292414/371472 [1:06:07<6:05:13,  3.61it/s]
 79%|███████▊  | 292415/371472 [1:06:07<6:13:13,  3.53it/s]
 79%|███████▊  | 292416/371472 [1:06:07<6:04:08,  3.62it/s]
 79%|███████▊  | 292417/371472 [1:06:08<6:04:45,  3.61it/s]
 79%|███████▊  | 292418/371472 [1:06:08<6:07:10,  3.59it/s]
 79%|███████▊  | 292419/371472 [1:06:08<6:05:12,  3.61it/s]
 79%|███████▊  | 292420/371472 [1:06:09<5:58:06,  3.68it/s]
                                                           
{'loss': 2.8146, 'learning_rate': 2.916298562778771e-07, 'epoch': 12.6}

 79%|███████▊  | 292420/371472 [1:06:09<5:58:06,  3.68it/s]
 79%|███████▊  | 292421/371472 [1:06:09<6:21:47,  3.45it/s]
 79%|███████▊  | 292422/371472 [1:06:09<6:03:23,  3.63it/s]
 79%|███████▊  | 292423/371472 [1:06:09<6:25:04,  3.42it/s]
 79%|███████▊  | 292424/371472 [1:06:10<6:04:19,  3.62it/s]
 79%|███████▊  | 292425/371472 [1:06:10<6:14:14,  3.52it/s]
 79%|███████▊  | 292426/371472 [1:06:10<6:02:52,  3.63it/s]
 79%|███████▊  | 292427/371472 [1:06:11<6:27:42,  3.40it/s]
 79%|███████▊  | 292428/371472 [1:06:11<6:21:08,  3.46it/s]
 79%|███████▊  | 292429/371472 [1:06:11<6:28:51,  3.39it/s]
 79%|███████▊  | 292430/371472 [1:06:11<6:11:24,  3.55it/s]
 79%|███████▊  | 292431/371472 [1:06:12<5:58:52,  3.67it/s]
 79%|███████▊  | 292432/371472 [1:06:12<5:59:04,  3.67it/s]
 79%|███████▊  | 292433/371472 [1:06:12<6:01:06,  3.65it/s]
 79%|███████▊  | 292434/371472 [1:06:12<6:08:24,  3.58it/s]
 79%|███████▊  | 292435/371472 [1:06:13<6:00:01,  3.66it/s]
 79%|███████▊  | 292436/371472 [1:06:13<6:20:19,  3.46it/s]
 79%|███████▊  | 292437/371472 [1:06:13<6:12:57,  3.53it/s]
 79%|███████▊  | 292438/371472 [1:06:14<6:11:07,  3.55it/s]
 79%|███████▊  | 292439/371472 [1:06:14<6:18:58,  3.48it/s]
 79%|███████▊  | 292440/371472 [1:06:14<6:04:18,  3.62it/s]
                                                           
{'loss': 2.6774, 'learning_rate': 2.9158137430239826e-07, 'epoch': 12.6}

 79%|███████▊  | 292440/371472 [1:06:14<6:04:18,  3.62it/s]
 79%|███████▊  | 292441/371472 [1:06:14<6:00:01,  3.66it/s]
 79%|███████▊  | 292442/371472 [1:06:15<5:57:34,  3.68it/s]
 79%|███████▊  | 292443/371472 [1:06:15<6:13:37,  3.53it/s]
 79%|███████▊  | 292444/371472 [1:06:15<6:57:17,  3.16it/s]
 79%|███████▊  | 292445/371472 [1:06:16<6:36:09,  3.32it/s]
 79%|███████▊  | 292446/371472 [1:06:16<6:10:23,  3.56it/s]
 79%|███████▊  | 292447/371472 [1:06:16<6:16:16,  3.50it/s]
 79%|███████▊  | 292448/371472 [1:06:17<6:30:45,  3.37it/s]
 79%|███████▊  | 292449/371472 [1:06:17<6:34:22,  3.34it/s]
 79%|███████▊  | 292450/371472 [1:06:17<6:19:14,  3.47it/s]
 79%|███████▊  | 292451/371472 [1:06:17<6:34:14,  3.34it/s]
 79%|███████▊  | 292452/371472 [1:06:18<6:25:18,  3.42it/s]
 79%|███████▊  | 292453/371472 [1:06:18<6:39:25,  3.30it/s]
 79%|███████▊  | 292454/371472 [1:06:18<6:47:23,  3.23it/s]
 79%|███████▊  | 292455/371472 [1:06:19<6:32:50,  3.35it/s]
 79%|███████▊  | 292456/371472 [1:06:19<6:13:37,  3.52it/s]
 79%|███████▊  | 292457/371472 [1:06:19<6:12:34,  3.53it/s]
 79%|███████▊  | 292458/371472 [1:06:19<6:02:46,  3.63it/s]
 79%|███████▊  | 292459/371472 [1:06:20<6:05:23,  3.60it/s]
 79%|███████▊  | 292460/371472 [1:06:20<5:58:12,  3.68it/s]
                                                           
{'loss': 2.7255, 'learning_rate': 2.915328923269193e-07, 'epoch': 12.6}

 79%|███████▊  | 292460/371472 [1:06:20<5:58:12,  3.68it/s]
 79%|███████▊  | 292461/371472 [1:06:20<5:52:50,  3.73it/s]
 79%|███████▊  | 292462/371472 [1:06:20<5:50:07,  3.76it/s]
 79%|███████▊  | 292463/371472 [1:06:21<6:08:25,  3.57it/s]
 79%|███████▊  | 292464/371472 [1:06:21<6:06:59,  3.59it/s]
 79%|███████▊  | 292465/371472 [1:06:21<6:15:27,  3.51it/s]
 79%|███████▊  | 292466/371472 [1:06:22<6:14:31,  3.52it/s]
 79%|███████▊  | 292467/371472 [1:06:22<6:06:41,  3.59it/s]
 79%|███████▊  | 292468/371472 [1:06:22<6:04:41,  3.61it/s]
 79%|███████▊  | 292469/371472 [1:06:22<5:53:58,  3.72it/s]
 79%|███████▊  | 292470/371472 [1:06:23<5:50:54,  3.75it/s]
 79%|███████▊  | 292471/371472 [1:06:23<6:03:50,  3.62it/s]
 79%|███████▊  | 292472/371472 [1:06:23<6:11:55,  3.54it/s]
 79%|███████▊  | 292473/371472 [1:06:24<6:15:27,  3.51it/s]
 79%|███████▊  | 292474/371472 [1:06:24<6:08:16,  3.58it/s]
 79%|███████▊  | 292475/371472 [1:06:24<5:58:40,  3.67it/s]
 79%|███████▊  | 292476/371472 [1:06:24<5:58:33,  3.67it/s]
 79%|███████▊  | 292477/371472 [1:06:25<6:20:54,  3.46it/s]
 79%|███████▊  | 292478/371472 [1:06:25<6:12:36,  3.53it/s]
 79%|███████▊  | 292479/371472 [1:06:25<6:03:18,  3.62it/s]
 79%|███████▊  | 292480/371472 [1:06:26<6:47:49,  3.23it/s]
                                                           
{'loss': 2.697, 'learning_rate': 2.914844103514405e-07, 'epoch': 12.6}

 79%|███████▊  | 292480/371472 [1:06:26<6:47:49,  3.23it/s]
 79%|███████▊  | 292481/371472 [1:06:26<6:45:01,  3.25it/s]
 79%|███████▊  | 292482/371472 [1:06:26<6:37:20,  3.31it/s]
 79%|███████▊  | 292483/371472 [1:06:26<6:17:43,  3.49it/s]
 79%|███████▊  | 292484/371472 [1:06:27<6:09:49,  3.56it/s]
 79%|███████▊  | 292485/371472 [1:06:27<6:05:16,  3.60it/s]
 79%|███████▊  | 292486/371472 [1:06:27<6:04:32,  3.61it/s]
 79%|███████▊  | 292487/371472 [1:06:28<6:04:42,  3.61it/s]
 79%|███████▊  | 292488/371472 [1:06:28<6:04:18,  3.61it/s]
 79%|███████▊  | 292489/371472 [1:06:28<5:59:54,  3.66it/s]
 79%|███████▊  | 292490/371472 [1:06:28<6:10:17,  3.56it/s]
 79%|███████▊  | 292491/371472 [1:06:29<6:04:14,  3.61it/s]
 79%|███████▊  | 292492/371472 [1:06:29<6:05:25,  3.60it/s]
 79%|███████▊  | 292493/371472 [1:06:29<6:02:45,  3.63it/s]
 79%|███████▊  | 292494/371472 [1:06:29<6:00:07,  3.66it/s]
 79%|███████▊  | 292495/371472 [1:06:30<5:50:00,  3.76it/s]
 79%|███████▊  | 292496/371472 [1:06:30<5:51:03,  3.75it/s]
 79%|███████▊  | 292497/371472 [1:06:30<5:49:10,  3.77it/s]
 79%|███████▊  | 292498/371472 [1:06:31<6:13:47,  3.52it/s]
 79%|███████▊  | 292499/371472 [1:06:31<6:41:06,  3.28it/s]
 79%|███████▊  | 292500/371472 [1:06:31<6:50:29,  3.21it/s]
                                                           
{'loss': 2.6327, 'learning_rate': 2.914359283759615e-07, 'epoch': 12.6}

 79%|███████▊  | 292500/371472 [1:06:31<6:50:29,  3.21it/s]
 79%|███████▊  | 292501/371472 [1:06:32<6:45:56,  3.24it/s]
 79%|███████▊  | 292502/371472 [1:06:32<7:07:38,  3.08it/s]
 79%|███████▊  | 292503/371472 [1:06:32<6:42:08,  3.27it/s]
 79%|███████▊  | 292504/371472 [1:06:32<6:32:51,  3.35it/s]
 79%|███████▊  | 292505/371472 [1:06:33<6:44:08,  3.26it/s]
 79%|███████▊  | 292506/371472 [1:06:33<6:30:08,  3.37it/s]
 79%|███████▊  | 292507/371472 [1:06:33<6:54:42,  3.17it/s]
 79%|███████▊  | 292508/371472 [1:06:34<6:46:20,  3.24it/s]
 79%|███████▊  | 292509/371472 [1:06:34<6:32:06,  3.36it/s]
 79%|███████▊  | 292510/371472 [1:06:34<6:16:51,  3.49it/s]
 79%|███████▊  | 292511/371472 [1:06:35<6:25:32,  3.41it/s]
 79%|███████▊  | 292512/371472 [1:06:35<6:06:43,  3.59it/s]
 79%|███████▊  | 292513/371472 [1:06:35<6:05:58,  3.60it/s]
 79%|███████▊  | 292514/371472 [1:06:35<5:57:38,  3.68it/s]
 79%|███████▊  | 292515/371472 [1:06:36<5:49:27,  3.77it/s]
 79%|███████▊  | 292516/371472 [1:06:36<5:47:50,  3.78it/s]
 79%|███████▊  | 292517/371472 [1:06:36<6:12:29,  3.53it/s]
 79%|███████▊  | 292518/371472 [1:06:36<6:23:16,  3.43it/s]
 79%|███████▊  | 292519/371472 [1:06:37<6:31:49,  3.36it/s]
 79%|███████▊  | 292520/371472 [1:06:37<6:14:26,  3.51it/s]
                                                           
{'loss': 2.8909, 'learning_rate': 2.9138744640048265e-07, 'epoch': 12.6}

 79%|███████▊  | 292520/371472 [1:06:37<6:14:26,  3.51it/s]
 79%|███████▊  | 292521/371472 [1:06:37<6:05:29,  3.60it/s]
 79%|███████▊  | 292522/371472 [1:06:38<5:52:20,  3.73it/s]
 79%|███████▊  | 292523/371472 [1:06:38<6:17:48,  3.48it/s]
 79%|███████▊  | 292524/371472 [1:06:38<6:00:48,  3.65it/s]
 79%|███████▊  | 292525/371472 [1:06:38<5:59:44,  3.66it/s]
 79%|███████▊  | 292526/371472 [1:06:39<5:56:05,  3.70it/s]
 79%|███████▊  | 292527/371472 [1:06:39<6:05:41,  3.60it/s]
 79%|███████▊  | 292528/371472 [1:06:39<6:07:45,  3.58it/s]
 79%|███████▊  | 292529/371472 [1:06:40<6:57:18,  3.15it/s]
 79%|███████▊  | 292530/371472 [1:06:40<6:52:39,  3.19it/s]
 79%|███████▊  | 292531/371472 [1:06:40<6:32:25,  3.35it/s]
 79%|███████▊  | 292532/371472 [1:06:41<6:21:37,  3.45it/s]
 79%|███████▊  | 292533/371472 [1:06:41<6:16:19,  3.50it/s]
 79%|███████▊  | 292534/371472 [1:06:41<6:08:01,  3.57it/s]
 79%|███████▉  | 292535/371472 [1:06:41<6:02:38,  3.63it/s]
 79%|███████▉  | 292536/371472 [1:06:42<6:24:23,  3.42it/s]
 79%|███████▉  | 292537/371472 [1:06:42<6:19:29,  3.47it/s]
 79%|███████▉  | 292538/371472 [1:06:42<6:20:22,  3.46it/s]
 79%|███████▉  | 292539/371472 [1:06:43<6:23:35,  3.43it/s]
 79%|███████▉  | 292540/371472 [1:06:43<6:09:33,  3.56it/s]
                                                           
{'loss': 2.6471, 'learning_rate': 2.913389644250037e-07, 'epoch': 12.6}

 79%|███████▉  | 292540/371472 [1:06:43<6:09:33,  3.56it/s]
 79%|███████▉  | 292541/371472 [1:06:43<6:05:37,  3.60it/s]
 79%|███████▉  | 292542/371472 [1:06:43<6:01:12,  3.64it/s]
 79%|███████▉  | 292543/371472 [1:06:44<6:12:48,  3.53it/s]
 79%|███████▉  | 292544/371472 [1:06:44<6:15:04,  3.51it/s]
 79%|███████▉  | 292545/371472 [1:06:44<6:00:01,  3.65it/s]
 79%|███████▉  | 292546/371472 [1:06:44<5:50:34,  3.75it/s]
 79%|███████▉  | 292547/371472 [1:06:45<6:16:00,  3.50it/s]
 79%|███████▉  | 292548/371472 [1:06:45<6:07:04,  3.58it/s]
 79%|███████▉  | 292549/371472 [1:06:45<5:59:21,  3.66it/s]
 79%|███████▉  | 292550/371472 [1:06:46<6:36:10,  3.32it/s]
 79%|███████▉  | 292551/371472 [1:06:46<6:37:12,  3.31it/s]
 79%|███████▉  | 292552/371472 [1:06:46<6:23:43,  3.43it/s]
 79%|███████▉  | 292553/371472 [1:06:46<6:23:59,  3.43it/s]
 79%|███████▉  | 292554/371472 [1:06:47<6:31:09,  3.36it/s]
 79%|███████▉  | 292555/371472 [1:06:47<6:29:38,  3.38it/s]
 79%|███████▉  | 292556/371472 [1:06:47<6:10:18,  3.55it/s]
 79%|███████▉  | 292557/371472 [1:06:48<6:07:37,  3.58it/s]
 79%|███████▉  | 292558/371472 [1:06:48<6:08:39,  3.57it/s]
 79%|███████▉  | 292559/371472 [1:06:48<6:30:57,  3.36it/s]
 79%|███████▉  | 292560/371472 [1:06:49<6:24:32,  3.42it/s]
                                                           
{'loss': 2.7794, 'learning_rate': 2.912904824495249e-07, 'epoch': 12.6}

 79%|███████▉  | 292560/371472 [1:06:49<6:24:32,  3.42it/s]
 79%|███████▉  | 292561/371472 [1:06:49<6:16:55,  3.49it/s]
 79%|███████▉  | 292562/371472 [1:06:49<6:00:19,  3.65it/s]
 79%|███████▉  | 292563/371472 [1:06:49<5:56:01,  3.69it/s]
 79%|███████▉  | 292564/371472 [1:06:50<6:42:12,  3.27it/s]
 79%|███████▉  | 292565/371472 [1:06:50<6:36:55,  3.31it/s]
 79%|███████▉  | 292566/371472 [1:06:50<6:11:50,  3.54it/s]
 79%|███████▉  | 292567/371472 [1:06:50<6:09:55,  3.56it/s]
 79%|███████▉  | 292568/371472 [1:06:51<6:09:12,  3.56it/s]
 79%|███████▉  | 292569/371472 [1:06:51<6:15:48,  3.50it/s]
 79%|███████▉  | 292570/371472 [1:06:51<6:18:43,  3.47it/s]
 79%|███████▉  | 292571/371472 [1:06:52<6:12:09,  3.53it/s]
 79%|███████▉  | 292572/371472 [1:06:52<6:11:07,  3.54it/s]
 79%|███████▉  | 292573/371472 [1:06:52<6:07:18,  3.58it/s]
 79%|███████▉  | 292574/371472 [1:06:52<5:59:44,  3.66it/s]
 79%|███████▉  | 292575/371472 [1:06:53<6:24:13,  3.42it/s]
 79%|███████▉  | 292576/371472 [1:06:53<6:13:25,  3.52it/s]
 79%|███████▉  | 292577/371472 [1:06:53<6:25:32,  3.41it/s]
 79%|███████▉  | 292578/371472 [1:06:54<6:14:04,  3.52it/s]
 79%|███████▉  | 292579/371472 [1:06:54<6:09:41,  3.56it/s]
 79%|███████▉  | 292580/371472 [1:06:54<6:01:33,  3.64it/s]
                                                           
{'loss': 2.5778, 'learning_rate': 2.9124200047404597e-07, 'epoch': 12.6}

 79%|███████▉  | 292580/371472 [1:06:54<6:01:33,  3.64it/s]
 79%|███████▉  | 292581/371472 [1:06:54<6:17:09,  3.49it/s]
 79%|███████▉  | 292582/371472 [1:06:55<6:05:05,  3.60it/s]
 79%|███████▉  | 292583/371472 [1:06:55<6:13:57,  3.52it/s]
 79%|███████▉  | 292584/371472 [1:06:55<6:13:40,  3.52it/s]
 79%|███████▉  | 292585/371472 [1:06:56<6:24:43,  3.42it/s]
 79%|███████▉  | 292586/371472 [1:06:56<7:21:52,  2.98it/s]
 79%|███████▉  | 292587/371472 [1:06:56<6:54:27,  3.17it/s]
 79%|███████▉  | 292588/371472 [1:06:57<6:40:31,  3.28it/s]
 79%|███████▉  | 292589/371472 [1:06:57<6:27:58,  3.39it/s]
 79%|███████▉  | 292590/371472 [1:06:57<6:12:45,  3.53it/s]
 79%|███████▉  | 292591/371472 [1:06:57<6:13:24,  3.52it/s]
 79%|███████▉  | 292592/371472 [1:06:58<6:27:46,  3.39it/s]
 79%|███████▉  | 292593/371472 [1:06:58<6:17:14,  3.48it/s]
 79%|███████▉  | 292594/371472 [1:06:58<6:08:22,  3.57it/s]
 79%|███████▉  | 292595/371472 [1:06:59<5:56:57,  3.68it/s]
 79%|███████▉  | 292596/371472 [1:06:59<6:18:54,  3.47it/s]
 79%|███████▉  | 292597/371472 [1:06:59<6:12:47,  3.53it/s]
 79%|███████▉  | 292598/371472 [1:06:59<6:29:40,  3.37it/s]
 79%|███████▉  | 292599/371472 [1:07:00<6:19:01,  3.47it/s]
 79%|███████▉  | 292600/371472 [1:07:00<6:15:48,  3.50it/s]
                                                           
{'loss': 2.5811, 'learning_rate': 2.9119351849856714e-07, 'epoch': 12.6}

 79%|███████▉  | 292600/371472 [1:07:00<6:15:48,  3.50it/s]
 79%|███████▉  | 292601/371472 [1:07:00<7:13:48,  3.03it/s]
 79%|███████▉  | 292602/371472 [1:07:01<6:53:26,  3.18it/s]
 79%|███████▉  | 292603/371472 [1:07:01<6:40:03,  3.29it/s]
 79%|███████▉  | 292604/371472 [1:07:01<6:20:02,  3.46it/s]
 79%|███████▉  | 292605/371472 [1:07:02<6:28:51,  3.38it/s]
 79%|███████▉  | 292606/371472 [1:07:02<6:22:05,  3.44it/s]
 79%|███████▉  | 292607/371472 [1:07:02<6:14:35,  3.51it/s]
 79%|███████▉  | 292608/371472 [1:07:02<6:10:39,  3.55it/s]
 79%|███████▉  | 292609/371472 [1:07:03<6:12:45,  3.53it/s]
 79%|███████▉  | 292610/371472 [1:07:03<6:15:42,  3.50it/s]
 79%|███████▉  | 292611/371472 [1:07:03<6:32:32,  3.35it/s]
 79%|███████▉  | 292612/371472 [1:07:04<6:19:30,  3.46it/s]
 79%|███████▉  | 292613/371472 [1:07:04<6:25:52,  3.41it/s]
 79%|███████▉  | 292614/371472 [1:07:04<6:35:15,  3.33it/s]
 79%|███████▉  | 292615/371472 [1:07:04<6:31:40,  3.36it/s]
 79%|███████▉  | 292616/371472 [1:07:05<6:13:43,  3.52it/s]
 79%|███████▉  | 292617/371472 [1:07:05<6:08:48,  3.56it/s]
 79%|███████▉  | 292618/371472 [1:07:05<6:19:05,  3.47it/s]
 79%|███████▉  | 292619/371472 [1:07:06<6:00:03,  3.65it/s]
 79%|███████▉  | 292620/371472 [1:07:06<6:00:36,  3.64it/s]
                                                           
{'loss': 2.6495, 'learning_rate': 2.9114503652308816e-07, 'epoch': 12.6}

 79%|███████▉  | 292620/371472 [1:07:06<6:00:36,  3.64it/s]
 79%|███████▉  | 292621/371472 [1:07:06<6:12:56,  3.52it/s]
 79%|███████▉  | 292622/371472 [1:07:06<6:27:05,  3.40it/s]
 79%|███████▉  | 292623/371472 [1:07:07<6:21:28,  3.44it/s]
 79%|███████▉  | 292624/371472 [1:07:07<6:21:45,  3.44it/s]
 79%|███████▉  | 292625/371472 [1:07:07<6:09:18,  3.56it/s]
 79%|███████▉  | 292626/371472 [1:07:08<6:23:44,  3.42it/s]
 79%|███████▉  | 292627/371472 [1:07:08<6:31:57,  3.35it/s]
 79%|███████▉  | 292628/371472 [1:07:08<6:31:12,  3.36it/s]
 79%|███████▉  | 292629/371472 [1:07:08<6:29:10,  3.38it/s]
 79%|███████▉  | 292630/371472 [1:07:09<6:26:03,  3.40it/s]
 79%|███████▉  | 292631/371472 [1:07:09<6:16:08,  3.49it/s]
 79%|███████▉  | 292632/371472 [1:07:09<6:06:13,  3.59it/s]
 79%|███████▉  | 292633/371472 [1:07:10<6:05:51,  3.59it/s]
 79%|███████▉  | 292634/371472 [1:07:10<5:58:16,  3.67it/s]
 79%|███████▉  | 292635/371472 [1:07:10<6:29:17,  3.38it/s]
 79%|███████▉  | 292636/371472 [1:07:10<6:24:19,  3.42it/s]
 79%|███████▉  | 292637/371472 [1:07:11<6:13:28,  3.52it/s]
 79%|███████▉  | 292638/371472 [1:07:11<6:20:54,  3.45it/s]
 79%|███████▉  | 292639/371472 [1:07:11<6:12:23,  3.53it/s]
 79%|███████▉  | 292640/371472 [1:07:12<6:19:54,  3.46it/s]
                                                           
{'loss': 2.5725, 'learning_rate': 2.9109655454760934e-07, 'epoch': 12.6}

 79%|███████▉  | 292640/371472 [1:07:12<6:19:54,  3.46it/s]
 79%|███████▉  | 292641/371472 [1:07:12<6:04:29,  3.60it/s]
 79%|███████▉  | 292642/371472 [1:07:12<6:03:47,  3.61it/s]
 79%|███████▉  | 292643/371472 [1:07:12<5:57:38,  3.67it/s]
 79%|███████▉  | 292644/371472 [1:07:13<6:18:53,  3.47it/s]
 79%|███████▉  | 292645/371472 [1:07:13<6:27:41,  3.39it/s]
 79%|███████▉  | 292646/371472 [1:07:13<6:15:38,  3.50it/s]
 79%|███████▉  | 292647/371472 [1:07:14<6:05:27,  3.59it/s]
 79%|███████▉  | 292648/371472 [1:07:14<5:59:22,  3.66it/s]
 79%|███████▉  | 292649/371472 [1:07:14<5:56:05,  3.69it/s]
 79%|███████▉  | 292650/371472 [1:07:14<6:19:04,  3.47it/s]
 79%|███████▉  | 292651/371472 [1:07:15<6:21:07,  3.45it/s]
 79%|███████▉  | 292652/371472 [1:07:15<6:04:18,  3.61it/s]
 79%|███████▉  | 292653/371472 [1:07:15<6:00:11,  3.65it/s]
 79%|███████▉  | 292654/371472 [1:07:16<5:59:36,  3.65it/s]
 79%|███████▉  | 292655/371472 [1:07:16<6:14:14,  3.51it/s]
 79%|███████▉  | 292656/371472 [1:07:16<6:37:47,  3.30it/s]
 79%|███████▉  | 292657/371472 [1:07:16<6:10:39,  3.54it/s]
 79%|███████▉  | 292658/371472 [1:07:17<6:04:02,  3.61it/s]
 79%|███████▉  | 292659/371472 [1:07:17<6:02:13,  3.63it/s]
 79%|███████▉  | 292660/371472 [1:07:17<6:08:40,  3.56it/s]
                                                           
{'loss': 2.7022, 'learning_rate': 2.9104807257213036e-07, 'epoch': 12.61}

 79%|███████▉  | 292660/371472 [1:07:17<6:08:40,  3.56it/s]
 79%|███████▉  | 292661/371472 [1:07:17<5:54:01,  3.71it/s]
 79%|███████▉  | 292662/371472 [1:07:18<5:59:31,  3.65it/s]
 79%|███████▉  | 292663/371472 [1:07:18<5:57:52,  3.67it/s]
 79%|███████▉  | 292664/371472 [1:07:18<6:22:10,  3.44it/s]
 79%|███████▉  | 292665/371472 [1:07:19<6:07:12,  3.58it/s]
 79%|███████▉  | 292666/371472 [1:07:19<6:21:43,  3.44it/s]
 79%|███████▉  | 292667/371472 [1:07:19<6:47:20,  3.22it/s]
 79%|███████▉  | 292668/371472 [1:07:20<6:40:48,  3.28it/s]
 79%|███████▉  | 292669/371472 [1:07:20<6:33:57,  3.33it/s]
 79%|███████▉  | 292670/371472 [1:07:20<6:23:09,  3.43it/s]
 79%|███████▉  | 292671/371472 [1:07:20<6:07:37,  3.57it/s]
 79%|███████▉  | 292672/371472 [1:07:21<6:23:23,  3.43it/s]
 79%|███████▉  | 292673/371472 [1:07:21<6:09:06,  3.56it/s]
 79%|███████▉  | 292674/371472 [1:07:21<6:15:13,  3.50it/s]
 79%|███████▉  | 292675/371472 [1:07:22<6:04:08,  3.61it/s]
 79%|███████▉  | 292676/371472 [1:07:22<6:27:12,  3.39it/s]
 79%|███████▉  | 292677/371472 [1:07:22<6:40:24,  3.28it/s]
 79%|███████▉  | 292678/371472 [1:07:22<6:46:57,  3.23it/s]
 79%|███████▉  | 292679/371472 [1:07:23<6:47:10,  3.23it/s]
 79%|███████▉  | 292680/371472 [1:07:23<6:38:51,  3.29it/s]
                                                           
{'loss': 2.6003, 'learning_rate': 2.9099959059665154e-07, 'epoch': 12.61}

 79%|███████▉  | 292680/371472 [1:07:23<6:38:51,  3.29it/s]
 79%|███████▉  | 292681/371472 [1:07:23<6:31:36,  3.35it/s]
 79%|███████▉  | 292682/371472 [1:07:24<6:38:57,  3.29it/s]
 79%|███████▉  | 292683/371472 [1:07:24<6:20:29,  3.45it/s]
 79%|███████▉  | 292684/371472 [1:07:24<6:05:31,  3.59it/s]
 79%|███████▉  | 292685/371472 [1:07:25<6:36:45,  3.31it/s]
 79%|███████▉  | 292686/371472 [1:07:25<6:39:27,  3.29it/s]
 79%|███████▉  | 292687/371472 [1:07:25<6:40:36,  3.28it/s]
 79%|███████▉  | 292688/371472 [1:07:25<6:40:15,  3.28it/s]
 79%|███████▉  | 292689/371472 [1:07:26<6:37:19,  3.30it/s]
 79%|███████▉  | 292690/371472 [1:07:26<6:28:32,  3.38it/s]
 79%|███████▉  | 292691/371472 [1:07:26<6:32:07,  3.35it/s]
 79%|███████▉  | 292692/371472 [1:07:27<6:17:53,  3.47it/s]
 79%|███████▉  | 292693/371472 [1:07:27<6:01:22,  3.63it/s]
 79%|███████▉  | 292694/371472 [1:07:27<5:46:41,  3.79it/s]
 79%|███████▉  | 292695/371472 [1:07:27<6:05:19,  3.59it/s]
 79%|███████▉  | 292696/371472 [1:07:28<5:57:59,  3.67it/s]
 79%|███████▉  | 292697/371472 [1:07:28<5:48:26,  3.77it/s]
 79%|███████▉  | 292698/371472 [1:07:28<6:17:46,  3.48it/s]
 79%|███████▉  | 292699/371472 [1:07:29<6:30:48,  3.36it/s]
 79%|███████▉  | 292700/371472 [1:07:29<6:40:31,  3.28it/s]
                                                           
{'loss': 2.5838, 'learning_rate': 2.909511086211726e-07, 'epoch': 12.61}

 79%|███████▉  | 292700/371472 [1:07:29<6:40:31,  3.28it/s]
 79%|███████▉  | 292701/371472 [1:07:29<6:25:23,  3.41it/s]
 79%|███████▉  | 292702/371472 [1:07:29<6:25:00,  3.41it/s]
 79%|███████▉  | 292703/371472 [1:07:30<6:16:42,  3.49it/s]
 79%|███████▉  | 292704/371472 [1:07:30<6:06:00,  3.59it/s]
 79%|███████▉  | 292705/371472 [1:07:30<5:59:45,  3.65it/s]
 79%|███████▉  | 292706/371472 [1:07:31<5:50:25,  3.75it/s]
 79%|███████▉  | 292707/371472 [1:07:31<6:02:05,  3.63it/s]
 79%|███████▉  | 292708/371472 [1:07:31<6:01:50,  3.63it/s]
 79%|███████▉  | 292709/371472 [1:07:31<6:02:39,  3.62it/s]
 79%|███████▉  | 292710/371472 [1:07:32<5:56:42,  3.68it/s]
 79%|███████▉  | 292711/371472 [1:07:32<5:48:41,  3.76it/s]
 79%|███████▉  | 292712/371472 [1:07:32<5:43:08,  3.83it/s]
 79%|███████▉  | 292713/371472 [1:07:32<5:37:23,  3.89it/s]
 79%|███████▉  | 292714/371472 [1:07:33<5:45:38,  3.80it/s]
 79%|███████▉  | 292715/371472 [1:07:33<5:45:01,  3.80it/s]
 79%|███████▉  | 292716/371472 [1:07:33<5:43:47,  3.82it/s]
 79%|███████▉  | 292717/371472 [1:07:33<5:52:13,  3.73it/s]
 79%|███████▉  | 292718/371472 [1:07:34<5:43:52,  3.82it/s]
 79%|███████▉  | 292719/371472 [1:07:34<5:46:17,  3.79it/s]
 79%|███████▉  | 292720/371472 [1:07:34<6:05:53,  3.59it/s]
                                                           
{'loss': 2.7696, 'learning_rate': 2.909026266456937e-07, 'epoch': 12.61}

 79%|███████▉  | 292720/371472 [1:07:34<6:05:53,  3.59it/s]
 79%|███████▉  | 292721/371472 [1:07:35<6:06:27,  3.58it/s]
 79%|███████▉  | 292722/371472 [1:07:35<5:57:52,  3.67it/s]
 79%|███████▉  | 292723/371472 [1:07:35<5:52:46,  3.72it/s]
 79%|███████▉  | 292724/371472 [1:07:35<5:56:04,  3.69it/s]
 79%|███████▉  | 292725/371472 [1:07:36<5:44:29,  3.81it/s]
 79%|███████▉  | 292726/371472 [1:07:36<5:47:28,  3.78it/s]
 79%|███████▉  | 292727/371472 [1:07:36<5:54:43,  3.70it/s]
 79%|███████▉  | 292728/371472 [1:07:36<5:58:47,  3.66it/s]
 79%|███████▉  | 292729/371472 [1:07:37<6:07:54,  3.57it/s]
 79%|███████▉  | 292730/371472 [1:07:37<6:22:27,  3.43it/s]
 79%|███████▉  | 292731/371472 [1:07:37<6:17:37,  3.48it/s]
 79%|███████▉  | 292732/371472 [1:07:38<6:08:41,  3.56it/s]
 79%|███████▉  | 292733/371472 [1:07:38<6:04:27,  3.60it/s]
 79%|███████▉  | 292734/371472 [1:07:38<6:02:27,  3.62it/s]
 79%|███████▉  | 292735/371472 [1:07:38<5:59:29,  3.65it/s]
 79%|███████▉  | 292736/371472 [1:07:39<6:05:52,  3.59it/s]
 79%|███████▉  | 292737/371472 [1:07:39<6:07:30,  3.57it/s]
 79%|███████▉  | 292738/371472 [1:07:39<6:25:36,  3.40it/s]
 79%|███████▉  | 292739/371472 [1:07:40<6:33:14,  3.34it/s]
 79%|███████▉  | 292740/371472 [1:07:40<6:18:40,  3.47it/s]
                                                           
{'loss': 2.6116, 'learning_rate': 2.9085414467021486e-07, 'epoch': 12.61}

 79%|███████▉  | 292740/371472 [1:07:40<6:18:40,  3.47it/s]
 79%|███████▉  | 292741/371472 [1:07:40<6:17:22,  3.48it/s]
 79%|███████▉  | 292742/371472 [1:07:40<6:10:56,  3.54it/s]
 79%|███████▉  | 292743/371472 [1:07:41<6:10:08,  3.54it/s]
 79%|███████▉  | 292744/371472 [1:07:41<6:10:07,  3.55it/s]
 79%|███████▉  | 292745/371472 [1:07:41<5:56:51,  3.68it/s]
 79%|███████▉  | 292746/371472 [1:07:42<6:00:41,  3.64it/s]
 79%|███████▉  | 292747/371472 [1:07:42<6:06:30,  3.58it/s]
 79%|███████▉  | 292748/371472 [1:07:42<6:08:49,  3.56it/s]
 79%|███████▉  | 292749/371472 [1:07:42<6:08:32,  3.56it/s]
 79%|███████▉  | 292750/371472 [1:07:43<6:01:17,  3.63it/s]
 79%|███████▉  | 292751/371472 [1:07:43<6:39:38,  3.28it/s]
 79%|███████▉  | 292752/371472 [1:07:43<7:11:01,  3.04it/s]
 79%|███████▉  | 292753/371472 [1:07:44<7:04:33,  3.09it/s]
 79%|███████▉  | 292754/371472 [1:07:44<6:45:41,  3.23it/s]
 79%|███████▉  | 292755/371472 [1:07:44<6:30:49,  3.36it/s]
 79%|███████▉  | 292756/371472 [1:07:45<6:28:24,  3.38it/s]
 79%|███████▉  | 292757/371472 [1:07:45<6:25:39,  3.40it/s]
 79%|███████▉  | 292758/371472 [1:07:45<6:21:03,  3.44it/s]
 79%|███████▉  | 292759/371472 [1:07:45<6:10:53,  3.54it/s]
 79%|███████▉  | 292760/371472 [1:07:46<5:57:27,  3.67it/s]
                                                           
{'loss': 2.7159, 'learning_rate': 2.908056626947359e-07, 'epoch': 12.61}

 79%|███████▉  | 292760/371472 [1:07:46<5:57:27,  3.67it/s]
 79%|███████▉  | 292761/371472 [1:07:46<6:00:16,  3.64it/s]
 79%|███████▉  | 292762/371472 [1:07:46<6:17:19,  3.48it/s]
 79%|███████▉  | 292763/371472 [1:07:47<6:07:27,  3.57it/s]
 79%|███████▉  | 292764/371472 [1:07:47<6:12:01,  3.53it/s]
 79%|███████▉  | 292765/371472 [1:07:47<6:05:59,  3.58it/s]
 79%|███████▉  | 292766/371472 [1:07:47<6:00:25,  3.64it/s]
 79%|███████▉  | 292767/371472 [1:07:48<5:56:28,  3.68it/s]
 79%|███████▉  | 292768/371472 [1:07:48<5:52:15,  3.72it/s]
 79%|███████▉  | 292769/371472 [1:07:48<6:31:09,  3.35it/s]
 79%|███████▉  | 292770/371472 [1:07:49<6:29:44,  3.37it/s]
 79%|███████▉  | 292771/371472 [1:07:49<6:21:28,  3.44it/s]
 79%|███████▉  | 292772/371472 [1:07:49<6:28:53,  3.37it/s]
 79%|███████▉  | 292773/371472 [1:07:49<6:17:02,  3.48it/s]
 79%|███████▉  | 292774/371472 [1:07:50<6:09:17,  3.55it/s]
 79%|███████▉  | 292775/371472 [1:07:50<6:17:06,  3.48it/s]
 79%|███████▉  | 292776/371472 [1:07:50<6:12:55,  3.52it/s]
 79%|███████▉  | 292777/371472 [1:07:51<6:22:56,  3.43it/s]
 79%|███████▉  | 292778/371472 [1:07:51<6:11:39,  3.53it/s]
 79%|███████▉  | 292779/371472 [1:07:51<6:04:51,  3.59it/s]
 79%|███████▉  | 292780/371472 [1:07:51<6:11:50,  3.53it/s]
                                                           
{'loss': 2.6302, 'learning_rate': 2.90757180719257e-07, 'epoch': 12.61}

 79%|███████▉  | 292780/371472 [1:07:51<6:11:50,  3.53it/s]
 79%|███████▉  | 292781/371472 [1:07:52<6:13:12,  3.51it/s]
 79%|███████▉  | 292782/371472 [1:07:52<6:18:02,  3.47it/s]
 79%|███████▉  | 292783/371472 [1:07:52<6:04:51,  3.59it/s]
 79%|███████▉  | 292784/371472 [1:07:53<6:46:38,  3.23it/s]
 79%|███████▉  | 292785/371472 [1:07:53<6:33:14,  3.33it/s]
 79%|███████▉  | 292786/371472 [1:07:53<7:10:21,  3.05it/s]
 79%|███████▉  | 292787/371472 [1:07:54<6:54:07,  3.17it/s]
 79%|███████▉  | 292788/371472 [1:07:54<6:41:21,  3.27it/s]
 79%|███████▉  | 292789/371472 [1:07:54<6:41:59,  3.26it/s]
 79%|███████▉  | 292790/371472 [1:07:54<6:39:21,  3.28it/s]
 79%|███████▉  | 292791/371472 [1:07:55<6:53:08,  3.17it/s]
 79%|███████▉  | 292792/371472 [1:07:55<6:35:18,  3.32it/s]
 79%|███████▉  | 292793/371472 [1:07:55<6:44:08,  3.24it/s]
 79%|███████▉  | 292794/371472 [1:07:56<6:36:46,  3.30it/s]
 79%|███████▉  | 292795/371472 [1:07:56<6:19:11,  3.46it/s]
 79%|███████▉  | 292796/371472 [1:07:56<6:19:53,  3.45it/s]
 79%|███████▉  | 292797/371472 [1:07:57<6:33:42,  3.33it/s]
 79%|███████▉  | 292798/371472 [1:07:57<6:36:45,  3.30it/s]
 79%|███████▉  | 292799/371472 [1:07:57<6:18:42,  3.46it/s]
 79%|███████▉  | 292800/371472 [1:07:57<6:04:41,  3.60it/s]
                                                           
{'loss': 2.6525, 'learning_rate': 2.9070869874377807e-07, 'epoch': 12.61}

 79%|███████▉  | 292800/371472 [1:07:57<6:04:41,  3.60it/s]
 79%|███████▉  | 292801/371472 [1:07:58<6:03:34,  3.61it/s]
 79%|███████▉  | 292802/371472 [1:07:58<5:57:15,  3.67it/s]
 79%|███████▉  | 292803/371472 [1:07:58<5:54:17,  3.70it/s]
 79%|███████▉  | 292804/371472 [1:07:58<6:02:00,  3.62it/s]
 79%|███████▉  | 292805/371472 [1:07:59<6:40:58,  3.27it/s]
 79%|███████▉  | 292806/371472 [1:07:59<6:16:47,  3.48it/s]
 79%|███████▉  | 292807/371472 [1:07:59<6:02:47,  3.61it/s]
 79%|███████▉  | 292808/371472 [1:08:00<5:53:10,  3.71it/s]
 79%|███████▉  | 292809/371472 [1:08:00<5:49:48,  3.75it/s]
 79%|███████▉  | 292810/371472 [1:08:00<5:58:00,  3.66it/s]
 79%|███████▉  | 292811/371472 [1:08:00<5:54:07,  3.70it/s]
 79%|███████▉  | 292812/371472 [1:08:01<5:51:12,  3.73it/s]
 79%|███████▉  | 292813/371472 [1:08:01<6:13:03,  3.51it/s]
 79%|███████▉  | 292814/371472 [1:08:01<5:53:56,  3.70it/s]
 79%|███████▉  | 292815/371472 [1:08:01<5:53:14,  3.71it/s]
 79%|███████▉  | 292816/371472 [1:08:02<6:21:41,  3.43it/s]
 79%|███████▉  | 292817/371472 [1:08:02<6:14:46,  3.50it/s]
 79%|███████▉  | 292818/371472 [1:08:02<6:06:30,  3.58it/s]
 79%|███████▉  | 292819/371472 [1:08:03<6:03:52,  3.60it/s]
 79%|███████▉  | 292820/371472 [1:08:03<6:05:11,  3.59it/s]
                                                           
{'loss': 2.6844, 'learning_rate': 2.9066021676829925e-07, 'epoch': 12.61}

 79%|███████▉  | 292820/371472 [1:08:03<6:05:11,  3.59it/s]
 79%|███████▉  | 292821/371472 [1:08:03<6:05:09,  3.59it/s]
 79%|███████▉  | 292822/371472 [1:08:03<6:11:18,  3.53it/s]
 79%|███████▉  | 292823/371472 [1:08:04<6:00:02,  3.64it/s]
 79%|███████▉  | 292824/371472 [1:08:04<6:04:15,  3.60it/s]
 79%|███████▉  | 292825/371472 [1:08:04<6:34:17,  3.32it/s]
 79%|███████▉  | 292826/371472 [1:08:05<6:19:12,  3.46it/s]
 79%|███████▉  | 292827/371472 [1:08:05<7:07:20,  3.07it/s]
 79%|███████▉  | 292828/371472 [1:08:05<6:38:04,  3.29it/s]
 79%|███████▉  | 292829/371472 [1:08:06<6:29:17,  3.37it/s]
 79%|███████▉  | 292830/371472 [1:08:06<6:25:23,  3.40it/s]
 79%|███████▉  | 292831/371472 [1:08:06<6:32:19,  3.34it/s]
 79%|███████▉  | 292832/371472 [1:08:06<6:23:21,  3.42it/s]
 79%|███████▉  | 292833/371472 [1:08:07<6:25:42,  3.40it/s]
 79%|███████▉  | 292834/371472 [1:08:07<6:15:20,  3.49it/s]
 79%|███████▉  | 292835/371472 [1:08:07<6:29:21,  3.37it/s]
 79%|███████▉  | 292836/371472 [1:08:08<6:40:01,  3.28it/s]
 79%|███████▉  | 292837/371472 [1:08:08<6:21:07,  3.44it/s]
 79%|███████▉  | 292838/371472 [1:08:08<6:13:47,  3.51it/s]
 79%|███████▉  | 292839/371472 [1:08:08<6:13:34,  3.51it/s]
 79%|███████▉  | 292840/371472 [1:08:09<6:29:59,  3.36it/s]
                                                           
{'loss': 2.5995, 'learning_rate': 2.906117347928203e-07, 'epoch': 12.61}

 79%|███████▉  | 292840/371472 [1:08:09<6:29:59,  3.36it/s]
 79%|███████▉  | 292841/371472 [1:08:09<6:19:45,  3.45it/s]
 79%|███████▉  | 292842/371472 [1:08:09<6:28:37,  3.37it/s]
 79%|███████▉  | 292843/371472 [1:08:10<6:18:06,  3.47it/s]
 79%|███████▉  | 292844/371472 [1:08:10<6:03:25,  3.61it/s]
 79%|███████▉  | 292845/371472 [1:08:10<6:12:01,  3.52it/s]
 79%|███████▉  | 292846/371472 [1:08:10<6:04:28,  3.60it/s]
 79%|███████▉  | 292847/371472 [1:08:11<5:52:36,  3.72it/s]
 79%|███████▉  | 292848/371472 [1:08:11<5:42:56,  3.82it/s]
 79%|███████▉  | 292849/371472 [1:08:11<5:40:29,  3.85it/s]
 79%|███████▉  | 292850/371472 [1:08:11<5:43:27,  3.82it/s]
 79%|███████▉  | 292851/371472 [1:08:12<5:50:04,  3.74it/s]
 79%|███████▉  | 292852/371472 [1:08:12<6:05:54,  3.58it/s]
 79%|███████▉  | 292853/371472 [1:08:12<6:03:09,  3.61it/s]
 79%|███████▉  | 292854/371472 [1:08:13<5:53:44,  3.70it/s]
 79%|███████▉  | 292855/371472 [1:08:13<5:59:44,  3.64it/s]
 79%|███████▉  | 292856/371472 [1:08:13<6:03:12,  3.61it/s]
 79%|███████▉  | 292857/371472 [1:08:13<5:58:45,  3.65it/s]
 79%|███████▉  | 292858/371472 [1:08:14<5:50:14,  3.74it/s]
 79%|███████▉  | 292859/371472 [1:08:14<5:55:35,  3.68it/s]
 79%|███████▉  | 292860/371472 [1:08:14<5:52:24,  3.72it/s]
                                                           
{'loss': 2.6287, 'learning_rate': 2.905632528173415e-07, 'epoch': 12.61}

 79%|███████▉  | 292860/371472 [1:08:14<5:52:24,  3.72it/s]
 79%|███████▉  | 292861/371472 [1:08:15<6:10:26,  3.54it/s]
 79%|███████▉  | 292862/371472 [1:08:15<6:04:48,  3.59it/s]
 79%|███████▉  | 292863/371472 [1:08:15<6:12:15,  3.52it/s]
 79%|███████▉  | 292864/371472 [1:08:15<6:23:19,  3.42it/s]
 79%|███████▉  | 292865/371472 [1:08:16<6:05:56,  3.58it/s]
 79%|███████▉  | 292866/371472 [1:08:16<5:59:42,  3.64it/s]
 79%|███████▉  | 292867/371472 [1:08:16<6:06:04,  3.58it/s]
 79%|███████▉  | 292868/371472 [1:08:16<5:53:03,  3.71it/s]
 79%|███████▉  | 292869/371472 [1:08:17<5:59:09,  3.65it/s]
 79%|███████▉  | 292870/371472 [1:08:17<6:18:54,  3.46it/s]
 79%|███████▉  | 292871/371472 [1:08:17<6:10:37,  3.53it/s]
 79%|███████▉  | 292872/371472 [1:08:18<5:52:52,  3.71it/s]
 79%|███████▉  | 292873/371472 [1:08:18<5:52:19,  3.72it/s]
 79%|███████▉  | 292874/371472 [1:08:18<5:46:14,  3.78it/s]
 79%|███████▉  | 292875/371472 [1:08:18<5:41:54,  3.83it/s]
 79%|███████▉  | 292876/371472 [1:08:19<5:48:39,  3.76it/s]
 79%|███████▉  | 292877/371472 [1:08:19<5:56:46,  3.67it/s]
 79%|███████▉  | 292878/371472 [1:08:19<6:14:15,  3.50it/s]
 79%|███████▉  | 292879/371472 [1:08:20<6:56:53,  3.14it/s]
 79%|███████▉  | 292880/371472 [1:08:20<6:26:49,  3.39it/s]
                                                           
{'loss': 2.6232, 'learning_rate': 2.9051477084186246e-07, 'epoch': 12.61}

 79%|███████▉  | 292880/371472 [1:08:20<6:26:49,  3.39it/s]
 79%|███████▉  | 292881/371472 [1:08:20<6:22:58,  3.42it/s]
 79%|███████▉  | 292882/371472 [1:08:20<6:20:35,  3.44it/s]
 79%|███████▉  | 292883/371472 [1:08:21<6:06:07,  3.58it/s]
 79%|███████▉  | 292884/371472 [1:08:21<5:49:36,  3.75it/s]
 79%|███████▉  | 292885/371472 [1:08:21<5:48:14,  3.76it/s]
 79%|███████▉  | 292886/371472 [1:08:21<5:52:27,  3.72it/s]
 79%|███████▉  | 292887/371472 [1:08:22<5:47:38,  3.77it/s]
 79%|███████▉  | 292888/371472 [1:08:22<6:27:16,  3.38it/s]
 79%|███████▉  | 292889/371472 [1:08:22<6:40:44,  3.27it/s]
 79%|███████▉  | 292890/371472 [1:08:23<6:16:35,  3.48it/s]
 79%|███████▉  | 292891/371472 [1:08:23<6:19:20,  3.45it/s]
 79%|███████▉  | 292892/371472 [1:08:23<6:28:47,  3.37it/s]
 79%|███████▉  | 292893/371472 [1:08:24<6:31:47,  3.34it/s]
 79%|███████▉  | 292894/371472 [1:08:24<6:19:56,  3.45it/s]
 79%|███████▉  | 292895/371472 [1:08:24<6:16:30,  3.48it/s]
 79%|███████▉  | 292896/371472 [1:08:24<6:09:15,  3.55it/s]
 79%|███████▉  | 292897/371472 [1:08:25<6:20:45,  3.44it/s]
 79%|███████▉  | 292898/371472 [1:08:25<6:05:13,  3.59it/s]
 79%|███████▉  | 292899/371472 [1:08:25<6:38:39,  3.28it/s]
 79%|███████▉  | 292900/371472 [1:08:26<6:31:27,  3.35it/s]
                                                           
{'loss': 2.7094, 'learning_rate': 2.9046628886638364e-07, 'epoch': 12.62}

 79%|███████▉  | 292900/371472 [1:08:26<6:31:27,  3.35it/s]
 79%|███████▉  | 292901/371472 [1:08:26<6:35:59,  3.31it/s]
 79%|███████▉  | 292902/371472 [1:08:26<6:31:32,  3.34it/s]
 79%|███████▉  | 292903/371472 [1:08:27<6:48:35,  3.20it/s]
 79%|███████▉  | 292904/371472 [1:08:27<6:32:06,  3.34it/s]
 79%|███████▉  | 292905/371472 [1:08:27<6:43:28,  3.25it/s]
 79%|███████▉  | 292906/371472 [1:08:27<6:23:52,  3.41it/s]
 79%|███████▉  | 292907/371472 [1:08:28<6:16:06,  3.48it/s]
 79%|███████▉  | 292908/371472 [1:08:28<6:06:12,  3.58it/s]
 79%|███████▉  | 292909/371472 [1:08:28<6:16:34,  3.48it/s]
 79%|███████▉  | 292910/371472 [1:08:29<5:59:26,  3.64it/s]
 79%|███████▉  | 292911/371472 [1:08:29<5:51:12,  3.73it/s]
 79%|███████▉  | 292912/371472 [1:08:29<5:56:15,  3.68it/s]
 79%|███████▉  | 292913/371472 [1:08:29<6:01:42,  3.62it/s]
 79%|███████▉  | 292914/371472 [1:08:30<5:53:02,  3.71it/s]
 79%|███████▉  | 292915/371472 [1:08:30<5:44:00,  3.81it/s]
 79%|███████▉  | 292916/371472 [1:08:30<6:05:19,  3.58it/s]
 79%|███████▉  | 292917/371472 [1:08:30<5:55:53,  3.68it/s]
 79%|███████▉  | 292918/371472 [1:08:31<5:43:24,  3.81it/s]
 79%|███████▉  | 292919/371472 [1:08:31<5:47:54,  3.76it/s]
 79%|███████▉  | 292920/371472 [1:08:31<5:51:05,  3.73it/s]
                                                           
{'loss': 2.6561, 'learning_rate': 2.904178068909047e-07, 'epoch': 12.62}

 79%|███████▉  | 292920/371472 [1:08:31<5:51:05,  3.73it/s]
 79%|███████▉  | 292921/371472 [1:08:31<5:50:03,  3.74it/s]
 79%|███████▉  | 292922/371472 [1:08:32<5:54:09,  3.70it/s]
 79%|███████▉  | 292923/371472 [1:08:32<5:44:20,  3.80it/s]
 79%|███████▉  | 292924/371472 [1:08:32<5:53:50,  3.70it/s]
 79%|███████▉  | 292925/371472 [1:08:33<5:50:30,  3.73it/s]
 79%|███████▉  | 292926/371472 [1:08:33<5:51:06,  3.73it/s]
 79%|███████▉  | 292927/371472 [1:08:33<6:13:02,  3.51it/s]
 79%|███████▉  | 292928/371472 [1:08:33<6:02:03,  3.62it/s]
 79%|███████▉  | 292929/371472 [1:08:34<5:47:56,  3.76it/s]
 79%|███████▉  | 292930/371472 [1:08:34<5:50:11,  3.74it/s]
 79%|███████▉  | 292931/371472 [1:08:34<5:51:51,  3.72it/s]
 79%|███████▉  | 292932/371472 [1:08:34<5:45:40,  3.79it/s]
 79%|███████▉  | 292933/371472 [1:08:35<5:53:26,  3.70it/s]
 79%|███████▉  | 292934/371472 [1:08:35<5:46:26,  3.78it/s]
 79%|███████▉  | 292935/371472 [1:08:35<6:10:43,  3.53it/s]
 79%|███████▉  | 292936/371472 [1:08:36<6:07:02,  3.57it/s]
 79%|███████▉  | 292937/371472 [1:08:36<6:34:58,  3.31it/s]
 79%|███████▉  | 292938/371472 [1:08:36<6:33:30,  3.33it/s]
 79%|███████▉  | 292939/371472 [1:08:36<6:09:57,  3.54it/s]
 79%|███████▉  | 292940/371472 [1:08:37<6:11:38,  3.52it/s]
                                                           
{'loss': 2.5999, 'learning_rate': 2.903693249154259e-07, 'epoch': 12.62}

 79%|███████▉  | 292940/371472 [1:08:37<6:11:38,  3.52it/s]
 79%|███████▉  | 292941/371472 [1:08:37<6:07:54,  3.56it/s]
 79%|███████▉  | 292942/371472 [1:08:37<5:53:34,  3.70it/s]
 79%|███████▉  | 292943/371472 [1:08:38<5:50:47,  3.73it/s]
 79%|███████▉  | 292944/371472 [1:08:38<5:53:02,  3.71it/s]
 79%|███████▉  | 292945/371472 [1:08:38<6:22:29,  3.42it/s]
 79%|███████▉  | 292946/371472 [1:08:38<6:19:14,  3.45it/s]
 79%|███████▉  | 292947/371472 [1:08:39<6:25:52,  3.39it/s]
 79%|███████▉  | 292948/371472 [1:08:39<6:13:01,  3.51it/s]
 79%|███████▉  | 292949/371472 [1:08:39<6:05:12,  3.58it/s]
 79%|███████▉  | 292950/371472 [1:08:40<5:59:34,  3.64it/s]
 79%|███████▉  | 292951/371472 [1:08:40<6:05:01,  3.59it/s]
 79%|███████▉  | 292952/371472 [1:08:40<6:22:20,  3.42it/s]
 79%|███████▉  | 292953/371472 [1:08:40<6:19:38,  3.45it/s]
 79%|███████▉  | 292954/371472 [1:08:41<6:20:29,  3.44it/s]
 79%|███████▉  | 292955/371472 [1:08:41<6:40:46,  3.27it/s]
 79%|███████▉  | 292956/371472 [1:08:41<6:56:45,  3.14it/s]
 79%|███████▉  | 292957/371472 [1:08:42<6:56:47,  3.14it/s]
 79%|███████▉  | 292958/371472 [1:08:42<7:02:38,  3.10it/s]
 79%|███████▉  | 292959/371472 [1:08:42<6:32:10,  3.34it/s]
 79%|███████▉  | 292960/371472 [1:08:43<6:29:20,  3.36it/s]
                                                           
{'loss': 2.6093, 'learning_rate': 2.9032084293994696e-07, 'epoch': 12.62}

 79%|███████▉  | 292960/371472 [1:08:43<6:29:20,  3.36it/s]
 79%|███████▉  | 292961/371472 [1:08:43<6:07:30,  3.56it/s]
 79%|███████▉  | 292962/371472 [1:08:43<6:30:37,  3.35it/s]
 79%|███████▉  | 292963/371472 [1:08:43<6:17:18,  3.47it/s]
 79%|███████▉  | 292964/371472 [1:08:44<6:10:57,  3.53it/s]
 79%|███████▉  | 292965/371472 [1:08:44<6:11:07,  3.53it/s]
 79%|███████▉  | 292966/371472 [1:08:44<6:18:11,  3.46it/s]
 79%|███████▉  | 292967/371472 [1:08:45<6:22:04,  3.42it/s]
 79%|███████▉  | 292968/371472 [1:08:45<6:44:54,  3.23it/s]
 79%|███████▉  | 292969/371472 [1:08:45<6:19:55,  3.44it/s]
 79%|███████▉  | 292970/371472 [1:08:45<6:04:17,  3.59it/s]
 79%|███████▉  | 292971/371472 [1:08:46<5:57:56,  3.66it/s]
 79%|███████▉  | 292972/371472 [1:08:46<6:43:34,  3.24it/s]
 79%|███████▉  | 292973/371472 [1:08:46<6:26:58,  3.38it/s]
 79%|███████▉  | 292974/371472 [1:08:47<6:12:22,  3.51it/s]
 79%|███████▉  | 292975/371472 [1:08:47<6:06:02,  3.57it/s]
 79%|███████▉  | 292976/371472 [1:08:47<6:13:28,  3.50it/s]
 79%|███████▉  | 292977/371472 [1:08:48<6:35:08,  3.31it/s]
 79%|███████▉  | 292978/371472 [1:08:48<6:20:01,  3.44it/s]
 79%|███████▉  | 292979/371472 [1:08:48<6:09:38,  3.54it/s]
 79%|███████▉  | 292980/371472 [1:08:48<6:22:54,  3.42it/s]
                                                           
{'loss': 2.5226, 'learning_rate': 2.902723609644682e-07, 'epoch': 12.62}

 79%|███████▉  | 292980/371472 [1:08:48<6:22:54,  3.42it/s]
 79%|███████▉  | 292981/371472 [1:08:49<6:07:53,  3.56it/s]
 79%|███████▉  | 292982/371472 [1:08:49<6:03:33,  3.60it/s]
 79%|███████▉  | 292983/371472 [1:08:49<5:56:25,  3.67it/s]
 79%|███████▉  | 292984/371472 [1:08:49<5:49:38,  3.74it/s]
 79%|███████▉  | 292985/371472 [1:08:50<5:44:51,  3.79it/s]
 79%|███████▉  | 292986/371472 [1:08:50<5:59:51,  3.64it/s]
 79%|███████▉  | 292987/371472 [1:08:50<5:52:42,  3.71it/s]
 79%|███████▉  | 292988/371472 [1:08:51<6:20:53,  3.43it/s]
 79%|███████▉  | 292989/371472 [1:08:51<6:49:45,  3.19it/s]
 79%|███████▉  | 292990/371472 [1:08:51<6:47:17,  3.21it/s]
 79%|███████▉  | 292991/371472 [1:08:52<6:33:42,  3.32it/s]
 79%|███████▉  | 292992/371472 [1:08:52<6:16:49,  3.47it/s]
 79%|███████▉  | 292993/371472 [1:08:52<6:12:39,  3.51it/s]
 79%|███████▉  | 292994/371472 [1:08:52<6:24:02,  3.41it/s]
 79%|███████▉  | 292995/371472 [1:08:53<6:22:56,  3.42it/s]
 79%|███████▉  | 292996/371472 [1:08:53<6:08:45,  3.55it/s]
 79%|███████▉  | 292997/371472 [1:08:53<6:05:26,  3.58it/s]
 79%|███████▉  | 292998/371472 [1:08:53<5:57:09,  3.66it/s]
 79%|███████▉  | 292999/371472 [1:08:54<6:18:24,  3.46it/s]
 79%|███████▉  | 293000/371472 [1:08:54<6:22:30,  3.42it/s]
                                                           
{'loss': 2.5581, 'learning_rate': 2.9022387898898916e-07, 'epoch': 12.62}

 79%|███████▉  | 293000/371472 [1:08:54<6:22:30,  3.42it/s]
 79%|███████▉  | 293001/371472 [1:08:54<6:12:56,  3.51it/s]
 79%|███████▉  | 293002/371472 [1:08:55<6:04:04,  3.59it/s]
 79%|███████▉  | 293003/371472 [1:08:55<6:01:30,  3.62it/s]
 79%|███████▉  | 293004/371472 [1:08:55<6:06:12,  3.57it/s]
 79%|███████▉  | 293005/371472 [1:08:55<6:02:39,  3.61it/s]
 79%|███████▉  | 293006/371472 [1:08:56<6:04:31,  3.59it/s]
 79%|███████▉  | 293007/371472 [1:08:56<6:10:19,  3.53it/s]
 79%|███████▉  | 293008/371472 [1:08:56<6:14:29,  3.49it/s]
 79%|███████▉  | 293009/371472 [1:08:57<6:10:09,  3.53it/s]
 79%|███████▉  | 293010/371472 [1:08:57<5:58:07,  3.65it/s]
 79%|███████▉  | 293011/371472 [1:08:57<6:03:08,  3.60it/s]
 79%|███████▉  | 293012/371472 [1:08:57<5:58:46,  3.64it/s]
 79%|███████▉  | 293013/371472 [1:08:58<6:01:46,  3.61it/s]
 79%|███████▉  | 293014/371472 [1:08:58<6:19:24,  3.45it/s]
 79%|███████▉  | 293015/371472 [1:08:58<6:15:11,  3.49it/s]
 79%|███████▉  | 293016/371472 [1:08:59<6:08:40,  3.55it/s]
 79%|███████▉  | 293017/371472 [1:08:59<6:06:58,  3.56it/s]
 79%|███████▉  | 293018/371472 [1:08:59<6:05:25,  3.58it/s]
 79%|███████▉  | 293019/371472 [1:08:59<6:37:54,  3.29it/s]
 79%|███████▉  | 293020/371472 [1:09:00<6:28:18,  3.37it/s]
                                                           
{'loss': 2.5949, 'learning_rate': 2.9017539701351033e-07, 'epoch': 12.62}

 79%|███████▉  | 293020/371472 [1:09:00<6:28:18,  3.37it/s]
 79%|███████▉  | 293021/371472 [1:09:00<6:15:39,  3.48it/s]
 79%|███████▉  | 293022/371472 [1:09:00<6:23:03,  3.41it/s]
 79%|███████▉  | 293023/371472 [1:09:01<6:09:28,  3.54it/s]
 79%|███████▉  | 293024/371472 [1:09:01<6:30:28,  3.35it/s]
 79%|███████▉  | 293025/371472 [1:09:01<6:22:17,  3.42it/s]
 79%|███████▉  | 293026/371472 [1:09:01<6:40:07,  3.27it/s]
 79%|███████▉  | 293027/371472 [1:09:02<6:43:04,  3.24it/s]
 79%|███████▉  | 293028/371472 [1:09:02<6:27:24,  3.37it/s]
 79%|███████▉  | 293029/371472 [1:09:02<6:25:57,  3.39it/s]
 79%|███████▉  | 293030/371472 [1:09:03<6:17:03,  3.47it/s]
 79%|███████▉  | 293031/371472 [1:09:03<6:11:47,  3.52it/s]
 79%|███████▉  | 293032/371472 [1:09:03<6:02:14,  3.61it/s]
 79%|███████▉  | 293033/371472 [1:09:03<5:54:53,  3.68it/s]
 79%|███████▉  | 293034/371472 [1:09:04<5:46:12,  3.78it/s]
 79%|███████▉  | 293035/371472 [1:09:04<6:00:15,  3.63it/s]
 79%|███████▉  | 293036/371472 [1:09:04<6:39:28,  3.27it/s]
 79%|███████▉  | 293037/371472 [1:09:05<6:30:23,  3.35it/s]
 79%|███████▉  | 293038/371472 [1:09:05<6:28:42,  3.36it/s]
 79%|███████▉  | 293039/371472 [1:09:05<6:36:16,  3.30it/s]
 79%|███████▉  | 293040/371472 [1:09:06<6:15:16,  3.48it/s]
                                                           
{'loss': 2.4308, 'learning_rate': 2.9012691503803135e-07, 'epoch': 12.62}

 79%|███████▉  | 293040/371472 [1:09:06<6:15:16,  3.48it/s]
 79%|███████▉  | 293041/371472 [1:09:06<6:11:53,  3.51it/s]
 79%|███████▉  | 293042/371472 [1:09:06<6:05:08,  3.58it/s]
 79%|███████▉  | 293043/371472 [1:09:06<6:02:58,  3.60it/s]
 79%|███████▉  | 293044/371472 [1:09:07<6:09:16,  3.54it/s]
 79%|███████▉  | 293045/371472 [1:09:07<6:17:10,  3.47it/s]
 79%|███████▉  | 293046/371472 [1:09:07<6:30:36,  3.35it/s]
 79%|███████▉  | 293047/371472 [1:09:07<6:10:05,  3.53it/s]
 79%|███████▉  | 293048/371472 [1:09:08<6:18:19,  3.45it/s]
 79%|███████▉  | 293049/371472 [1:09:08<6:05:03,  3.58it/s]
 79%|███████▉  | 293050/371472 [1:09:08<5:50:39,  3.73it/s]
 79%|███████▉  | 293051/371472 [1:09:09<5:48:05,  3.75it/s]
 79%|███████▉  | 293052/371472 [1:09:09<5:43:56,  3.80it/s]
 79%|███████▉  | 293053/371472 [1:09:09<6:05:43,  3.57it/s]
 79%|███████▉  | 293054/371472 [1:09:09<5:56:55,  3.66it/s]
 79%|███████▉  | 293055/371472 [1:09:10<6:01:27,  3.62it/s]
 79%|███████▉  | 293056/371472 [1:09:10<6:11:15,  3.52it/s]
 79%|███████▉  | 293057/371472 [1:09:10<6:28:54,  3.36it/s]
 79%|███████▉  | 293058/371472 [1:09:11<6:26:56,  3.38it/s]
 79%|███████▉  | 293059/371472 [1:09:11<6:20:06,  3.44it/s]
 79%|███████▉  | 293060/371472 [1:09:11<6:39:22,  3.27it/s]
                                                           
{'loss': 2.709, 'learning_rate': 2.9007843306255253e-07, 'epoch': 12.62}

 79%|███████▉  | 293060/371472 [1:09:11<6:39:22,  3.27it/s]
 79%|███████▉  | 293061/371472 [1:09:11<6:21:40,  3.42it/s]
 79%|███████▉  | 293062/371472 [1:09:12<6:24:57,  3.39it/s]
 79%|███████▉  | 293063/371472 [1:09:12<6:10:34,  3.53it/s]
 79%|███████▉  | 293064/371472 [1:09:12<6:10:11,  3.53it/s]
 79%|███████▉  | 293065/371472 [1:09:13<6:23:29,  3.41it/s]
 79%|███████▉  | 293066/371472 [1:09:13<6:04:20,  3.59it/s]
 79%|███████▉  | 293067/371472 [1:09:13<6:13:27,  3.50it/s]
 79%|███████▉  | 293068/371472 [1:09:13<6:07:23,  3.56it/s]
 79%|███████▉  | 293069/371472 [1:09:14<6:08:30,  3.55it/s]
 79%|███████▉  | 293070/371472 [1:09:14<6:02:27,  3.61it/s]
 79%|███████▉  | 293071/371472 [1:09:14<6:08:51,  3.54it/s]
 79%|███████▉  | 293072/371472 [1:09:15<6:43:46,  3.24it/s]
 79%|███████▉  | 293073/371472 [1:09:15<6:35:37,  3.30it/s]
 79%|███████▉  | 293074/371472 [1:09:15<7:01:06,  3.10it/s]
 79%|███████▉  | 293075/371472 [1:09:16<7:00:54,  3.10it/s]
 79%|███████▉  | 293076/371472 [1:09:16<6:48:23,  3.20it/s]
 79%|███████▉  | 293077/371472 [1:09:16<6:35:59,  3.30it/s]
 79%|███████▉  | 293078/371472 [1:09:16<6:19:30,  3.44it/s]
 79%|███████▉  | 293079/371472 [1:09:17<6:44:47,  3.23it/s]
 79%|███████▉  | 293080/371472 [1:09:17<6:23:30,  3.41it/s]
                                                           
{'loss': 2.6412, 'learning_rate': 2.900299510870736e-07, 'epoch': 12.62}

 79%|███████▉  | 293080/371472 [1:09:17<6:23:30,  3.41it/s]
 79%|███████▉  | 293081/371472 [1:09:17<6:26:36,  3.38it/s]
 79%|███████▉  | 293082/371472 [1:09:18<6:09:52,  3.53it/s]
 79%|███████▉  | 293083/371472 [1:09:18<6:18:21,  3.45it/s]
 79%|███████▉  | 293084/371472 [1:09:18<6:10:33,  3.53it/s]
 79%|███████▉  | 293085/371472 [1:09:18<6:08:24,  3.55it/s]
 79%|███████▉  | 293086/371472 [1:09:19<6:22:30,  3.42it/s]
 79%|███████▉  | 293087/371472 [1:09:19<6:20:25,  3.43it/s]
 79%|███████▉  | 293088/371472 [1:09:19<6:02:52,  3.60it/s]
 79%|███████▉  | 293089/371472 [1:09:20<6:07:20,  3.56it/s]
 79%|███████▉  | 293090/371472 [1:09:20<6:12:04,  3.51it/s]
 79%|███████▉  | 293091/371472 [1:09:20<5:55:35,  3.67it/s]
 79%|███████▉  | 293092/371472 [1:09:21<6:29:57,  3.35it/s]
 79%|███████▉  | 293093/371472 [1:09:21<8:15:45,  2.63it/s]
 79%|███████▉  | 293094/371472 [1:09:21<7:39:12,  2.84it/s]
 79%|███████▉  | 293095/371472 [1:09:22<7:18:39,  2.98it/s]
 79%|███████▉  | 293096/371472 [1:09:22<7:57:28,  2.74it/s]
 79%|███████▉  | 293097/371472 [1:09:22<7:16:55,  2.99it/s]
 79%|███████▉  | 293098/371472 [1:09:23<7:11:41,  3.03it/s]
 79%|███████▉  | 293099/371472 [1:09:23<7:10:40,  3.03it/s]
 79%|███████▉  | 293100/371472 [1:09:23<6:47:12,  3.21it/s]
                                                           
{'loss': 2.6504, 'learning_rate': 2.899814691115948e-07, 'epoch': 12.62}

 79%|███████▉  | 293100/371472 [1:09:23<6:47:12,  3.21it/s]
 79%|███████▉  | 293101/371472 [1:09:24<6:28:29,  3.36it/s]
 79%|███████▉  | 293102/371472 [1:09:24<6:44:24,  3.23it/s]
 79%|███████▉  | 293103/371472 [1:09:24<6:27:01,  3.37it/s]
 79%|███████▉  | 293104/371472 [1:09:25<7:07:18,  3.06it/s]
 79%|███████▉  | 293105/371472 [1:09:25<7:36:34,  2.86it/s]
 79%|███████▉  | 293106/371472 [1:09:25<7:01:02,  3.10it/s]
 79%|███████▉  | 293107/371472 [1:09:25<6:31:35,  3.34it/s]
 79%|███████▉  | 293108/371472 [1:09:26<6:16:59,  3.46it/s]
 79%|███████▉  | 293109/371472 [1:09:26<6:15:26,  3.48it/s]
 79%|███████▉  | 293110/371472 [1:09:26<6:24:42,  3.39it/s]
 79%|███████▉  | 293111/371472 [1:09:27<6:11:20,  3.52it/s]
 79%|███████▉  | 293112/371472 [1:09:27<6:09:23,  3.54it/s]
 79%|███████▉  | 293113/371472 [1:09:27<5:58:55,  3.64it/s]
 79%|███████▉  | 293114/371472 [1:09:27<5:59:08,  3.64it/s]
 79%|███████▉  | 293115/371472 [1:09:28<6:02:11,  3.61it/s]
 79%|███████▉  | 293116/371472 [1:09:28<6:49:12,  3.19it/s]
 79%|███████▉  | 293117/371472 [1:09:28<6:24:43,  3.39it/s]
 79%|███████▉  | 293118/371472 [1:09:29<6:34:47,  3.31it/s]
 79%|███████▉  | 293119/371472 [1:09:29<6:18:48,  3.45it/s]
 79%|███████▉  | 293120/371472 [1:09:29<6:12:22,  3.51it/s]
                                                           
{'loss': 2.6869, 'learning_rate': 2.8993298713611585e-07, 'epoch': 12.63}

 79%|███████▉  | 293120/371472 [1:09:29<6:12:22,  3.51it/s]
 79%|███████▉  | 293121/371472 [1:09:29<6:14:57,  3.48it/s]
 79%|███████▉  | 293122/371472 [1:09:30<6:08:03,  3.55it/s]
 79%|███████▉  | 293123/371472 [1:09:30<6:11:02,  3.52it/s]
 79%|███████▉  | 293124/371472 [1:09:30<6:18:54,  3.45it/s]
 79%|███████▉  | 293125/371472 [1:09:31<6:08:31,  3.54it/s]
 79%|███████▉  | 293126/371472 [1:09:31<6:10:39,  3.52it/s]
 79%|███████▉  | 293127/371472 [1:09:31<6:10:39,  3.52it/s]
 79%|███████▉  | 293128/371472 [1:09:32<6:41:04,  3.26it/s]
 79%|███████▉  | 293129/371472 [1:09:32<6:17:54,  3.46it/s]
 79%|███████▉  | 293130/371472 [1:09:32<6:16:56,  3.46it/s]
 79%|███████▉  | 293131/371472 [1:09:32<7:08:25,  3.05it/s]
 79%|███████▉  | 293132/371472 [1:09:33<6:43:35,  3.24it/s]
 79%|███████▉  | 293133/371472 [1:09:33<6:33:09,  3.32it/s]
 79%|███████▉  | 293134/371472 [1:09:33<6:28:58,  3.36it/s]
 79%|███████▉  | 293135/371472 [1:09:34<6:41:40,  3.25it/s]
 79%|███████▉  | 293136/371472 [1:09:34<6:19:17,  3.44it/s]
 79%|███████▉  | 293137/371472 [1:09:34<6:26:45,  3.38it/s]
 79%|███████▉  | 293138/371472 [1:09:35<6:25:28,  3.39it/s]
 79%|███████▉  | 293139/371472 [1:09:35<6:06:07,  3.57it/s]
 79%|███████▉  | 293140/371472 [1:09:35<6:17:27,  3.46it/s]
                                                           
{'loss': 2.7405, 'learning_rate': 2.89884505160637e-07, 'epoch': 12.63}

 79%|███████▉  | 293140/371472 [1:09:35<6:17:27,  3.46it/s]
 79%|███████▉  | 293141/371472 [1:09:35<6:13:05,  3.50it/s]
 79%|███████▉  | 293142/371472 [1:09:36<6:08:24,  3.54it/s]
 79%|███████▉  | 293143/371472 [1:09:36<5:57:33,  3.65it/s]
 79%|███████▉  | 293144/371472 [1:09:36<5:59:30,  3.63it/s]
 79%|███████▉  | 293145/371472 [1:09:36<5:45:54,  3.77it/s]
 79%|███████▉  | 293146/371472 [1:09:37<6:34:14,  3.31it/s]
 79%|███████▉  | 293147/371472 [1:09:37<6:54:36,  3.15it/s]
 79%|███████▉  | 293148/371472 [1:09:37<6:29:41,  3.35it/s]
 79%|███████▉  | 293149/371472 [1:09:38<6:11:26,  3.51it/s]
 79%|███████▉  | 293150/371472 [1:09:38<6:10:05,  3.53it/s]
 79%|███████▉  | 293151/371472 [1:09:38<6:10:16,  3.53it/s]
 79%|███████▉  | 293152/371472 [1:09:38<5:55:05,  3.68it/s]
 79%|███████▉  | 293153/371472 [1:09:39<6:22:26,  3.41it/s]
 79%|███████▉  | 293154/371472 [1:09:39<6:11:06,  3.52it/s]
 79%|███████▉  | 293155/371472 [1:09:39<6:01:09,  3.61it/s]
 79%|███████▉  | 293156/371472 [1:09:40<5:54:52,  3.68it/s]
 79%|███████▉  | 293157/371472 [1:09:40<6:12:51,  3.50it/s]
 79%|███████▉  | 293158/371472 [1:09:40<6:13:55,  3.49it/s]
 79%|███████▉  | 293159/371472 [1:09:40<6:13:38,  3.49it/s]
 79%|███████▉  | 293160/371472 [1:09:41<6:07:18,  3.55it/s]
                                                           
{'loss': 2.7138, 'learning_rate': 2.89836023185158e-07, 'epoch': 12.63}

 79%|███████▉  | 293160/371472 [1:09:41<6:07:18,  3.55it/s]
 79%|███████▉  | 293161/371472 [1:09:41<6:02:23,  3.60it/s]
 79%|███████▉  | 293162/371472 [1:09:41<6:08:48,  3.54it/s]
 79%|███████▉  | 293163/371472 [1:09:42<6:07:47,  3.55it/s]
 79%|███████▉  | 293164/371472 [1:09:42<5:53:52,  3.69it/s]
 79%|███████▉  | 293165/371472 [1:09:42<5:54:52,  3.68it/s]
 79%|███████▉  | 293166/371472 [1:09:42<6:21:55,  3.42it/s]
 79%|███████▉  | 293167/371472 [1:09:43<6:07:53,  3.55it/s]
 79%|███████▉  | 293168/371472 [1:09:43<5:57:37,  3.65it/s]
 79%|███████▉  | 293169/371472 [1:09:43<6:06:11,  3.56it/s]
 79%|███████▉  | 293170/371472 [1:09:44<5:55:01,  3.68it/s]
 79%|███████▉  | 293171/371472 [1:09:44<6:01:48,  3.61it/s]
 79%|███████▉  | 293172/371472 [1:09:44<6:00:49,  3.62it/s]
 79%|███████▉  | 293173/371472 [1:09:44<5:55:23,  3.67it/s]
 79%|███████▉  | 293174/371472 [1:09:45<6:12:42,  3.50it/s]
 79%|███████▉  | 293175/371472 [1:09:45<6:19:03,  3.44it/s]
 79%|███████▉  | 293176/371472 [1:09:45<6:03:52,  3.59it/s]
 79%|███████▉  | 293177/371472 [1:09:45<6:05:06,  3.57it/s]
 79%|███████▉  | 293178/371472 [1:09:46<5:57:51,  3.65it/s]
 79%|███████▉  | 293179/371472 [1:09:46<5:52:17,  3.70it/s]
 79%|███████▉  | 293180/371472 [1:09:46<6:25:29,  3.38it/s]
                                                           
{'loss': 2.7541, 'learning_rate': 2.8978754120967917e-07, 'epoch': 12.63}

 79%|███████▉  | 293180/371472 [1:09:46<6:25:29,  3.38it/s]
 79%|███████▉  | 293181/371472 [1:09:47<6:51:18,  3.17it/s]
 79%|███████▉  | 293182/371472 [1:09:47<6:38:51,  3.27it/s]
 79%|███████▉  | 293183/371472 [1:09:47<6:31:44,  3.33it/s]
 79%|███████▉  | 293184/371472 [1:09:48<6:21:35,  3.42it/s]
 79%|███████▉  | 293185/371472 [1:09:48<7:46:36,  2.80it/s]
 79%|███████▉  | 293186/371472 [1:09:48<7:19:00,  2.97it/s]
 79%|███████▉  | 293187/371472 [1:09:49<7:27:30,  2.92it/s]
 79%|███████▉  | 293188/371472 [1:09:49<7:47:41,  2.79it/s]
 79%|███████▉  | 293189/371472 [1:09:49<7:27:54,  2.91it/s]
 79%|███████▉  | 293190/371472 [1:09:50<6:54:18,  3.15it/s]
 79%|███████▉  | 293191/371472 [1:09:50<6:25:27,  3.38it/s]
 79%|███████▉  | 293192/371472 [1:09:50<6:09:20,  3.53it/s]
 79%|███████▉  | 293193/371472 [1:09:50<6:10:42,  3.52it/s]
 79%|███████▉  | 293194/371472 [1:09:51<6:01:35,  3.61it/s]
 79%|███████▉  | 293195/371472 [1:09:51<5:47:48,  3.75it/s]
 79%|███████▉  | 293196/371472 [1:09:51<6:16:04,  3.47it/s]
 79%|███████▉  | 293197/371472 [1:09:52<6:19:03,  3.44it/s]
 79%|███████▉  | 293198/371472 [1:09:52<6:19:22,  3.44it/s]
 79%|███████▉  | 293199/371472 [1:09:52<6:03:21,  3.59it/s]
 79%|███████▉  | 293200/371472 [1:09:52<6:10:05,  3.52it/s]
                                                           
{'loss': 2.508, 'learning_rate': 2.8973905923420024e-07, 'epoch': 12.63}

 79%|███████▉  | 293200/371472 [1:09:52<6:10:05,  3.52it/s]
 79%|███████▉  | 293201/371472 [1:09:53<6:17:19,  3.46it/s]
 79%|███████▉  | 293202/371472 [1:09:53<6:02:28,  3.60it/s]
 79%|███████▉  | 293203/371472 [1:09:53<5:57:31,  3.65it/s]
 79%|███████▉  | 293204/371472 [1:09:54<5:54:13,  3.68it/s]
 79%|███████▉  | 293205/371472 [1:09:54<6:00:12,  3.62it/s]
 79%|███████▉  | 293206/371472 [1:09:54<5:57:57,  3.64it/s]
 79%|███████▉  | 293207/371472 [1:09:54<5:54:01,  3.68it/s]
 79%|███████▉  | 293208/371472 [1:09:55<5:48:11,  3.75it/s]
 79%|███████▉  | 293209/371472 [1:09:55<6:07:57,  3.54it/s]
 79%|███████▉  | 293210/371472 [1:09:55<6:12:05,  3.51it/s]
 79%|███████▉  | 293211/371472 [1:09:55<5:57:39,  3.65it/s]
 79%|███████▉  | 293212/371472 [1:09:56<6:01:58,  3.60it/s]
 79%|███████▉  | 293213/371472 [1:09:56<5:58:26,  3.64it/s]
 79%|███████▉  | 293214/371472 [1:09:56<6:06:44,  3.56it/s]
 79%|███████▉  | 293215/371472 [1:09:57<5:57:19,  3.65it/s]
 79%|███████▉  | 293216/371472 [1:09:57<5:49:17,  3.73it/s]
 79%|███████▉  | 293217/371472 [1:09:57<6:00:05,  3.62it/s]
 79%|███████▉  | 293218/371472 [1:09:57<6:05:49,  3.57it/s]
 79%|███████▉  | 293219/371472 [1:09:58<6:02:35,  3.60it/s]
 79%|███████▉  | 293220/371472 [1:09:58<6:09:59,  3.52it/s]
                                                           
{'loss': 2.6663, 'learning_rate': 2.896905772587214e-07, 'epoch': 12.63}

 79%|███████▉  | 293220/371472 [1:09:58<6:09:59,  3.52it/s]
 79%|███████▉  | 293221/371472 [1:09:58<6:04:54,  3.57it/s]
 79%|███████▉  | 293222/371472 [1:09:58<5:49:27,  3.73it/s]
 79%|███████▉  | 293223/371472 [1:09:59<5:52:10,  3.70it/s]
 79%|███████▉  | 293224/371472 [1:09:59<5:55:23,  3.67it/s]
 79%|███████▉  | 293225/371472 [1:09:59<6:19:11,  3.44it/s]
 79%|███████▉  | 293226/371472 [1:10:00<6:28:39,  3.36it/s]
 79%|███████▉  | 293227/371472 [1:10:00<6:06:12,  3.56it/s]
 79%|███████▉  | 293228/371472 [1:10:00<5:50:01,  3.73it/s]
 79%|███████▉  | 293229/371472 [1:10:01<6:22:06,  3.41it/s]
 79%|███████▉  | 293230/371472 [1:10:01<6:35:20,  3.30it/s]
 79%|███████▉  | 293231/371472 [1:10:01<6:21:13,  3.42it/s]
 79%|███████▉  | 293232/371472 [1:10:01<6:33:17,  3.32it/s]
 79%|███████▉  | 293233/371472 [1:10:02<6:38:11,  3.27it/s]
 79%|███████▉  | 293234/371472 [1:10:02<6:41:24,  3.25it/s]
 79%|███████▉  | 293235/371472 [1:10:02<6:46:38,  3.21it/s]
 79%|███████▉  | 293236/371472 [1:10:03<6:36:45,  3.29it/s]
 79%|███████▉  | 293237/371472 [1:10:03<6:10:58,  3.51it/s]
 79%|███████▉  | 293238/371472 [1:10:03<6:14:39,  3.48it/s]
 79%|███████▉  | 293239/371472 [1:10:04<6:56:07,  3.13it/s]
 79%|███████▉  | 293240/371472 [1:10:04<6:47:09,  3.20it/s]
                                                           
{'loss': 2.6477, 'learning_rate': 2.896420952832425e-07, 'epoch': 12.63}

 79%|███████▉  | 293240/371472 [1:10:04<6:47:09,  3.20it/s]
 79%|███████▉  | 293241/371472 [1:10:04<6:58:40,  3.11it/s]
 79%|███████▉  | 293242/371472 [1:10:05<6:52:15,  3.16it/s]
 79%|███████▉  | 293243/371472 [1:10:05<6:35:51,  3.29it/s]
 79%|███████▉  | 293244/371472 [1:10:05<6:33:14,  3.32it/s]
 79%|███████▉  | 293245/371472 [1:10:05<6:24:35,  3.39it/s]
 79%|███████▉  | 293246/371472 [1:10:06<6:11:28,  3.51it/s]
 79%|███████▉  | 293247/371472 [1:10:06<6:28:51,  3.35it/s]
 79%|███████▉  | 293248/371472 [1:10:06<6:38:01,  3.28it/s]
 79%|███████▉  | 293249/371472 [1:10:07<6:29:12,  3.35it/s]
 79%|███████▉  | 293250/371472 [1:10:07<6:11:06,  3.51it/s]
 79%|███████▉  | 293251/371472 [1:10:07<6:32:28,  3.32it/s]
 79%|███████▉  | 293252/371472 [1:10:07<6:07:40,  3.55it/s]
 79%|███████▉  | 293253/371472 [1:10:08<6:04:38,  3.58it/s]
 79%|███████▉  | 293254/371472 [1:10:08<5:52:42,  3.70it/s]
 79%|███████▉  | 293255/371472 [1:10:08<5:46:38,  3.76it/s]
 79%|███████▉  | 293256/371472 [1:10:09<6:43:18,  3.23it/s]
 79%|███████▉  | 293257/371472 [1:10:09<6:24:30,  3.39it/s]
 79%|███████▉  | 293258/371472 [1:10:09<6:23:53,  3.40it/s]
 79%|███████▉  | 293259/371472 [1:10:09<6:13:24,  3.49it/s]
 79%|███████▉  | 293260/371472 [1:10:10<6:00:53,  3.61it/s]
                                                           
{'loss': 2.7621, 'learning_rate': 2.895936133077635e-07, 'epoch': 12.63}

 79%|███████▉  | 293260/371472 [1:10:10<6:00:53,  3.61it/s]
 79%|███████▉  | 293261/371472 [1:10:10<5:44:30,  3.78it/s]
 79%|███████▉  | 293262/371472 [1:10:10<6:03:38,  3.58it/s]
 79%|███████▉  | 293263/371472 [1:10:11<6:04:57,  3.57it/s]
 79%|███████▉  | 293264/371472 [1:10:11<6:03:37,  3.58it/s]
 79%|███████▉  | 293265/371472 [1:10:11<6:02:32,  3.60it/s]
 79%|███████▉  | 293266/371472 [1:10:11<5:48:37,  3.74it/s]
 79%|███████▉  | 293267/371472 [1:10:12<5:55:29,  3.67it/s]
 79%|███████▉  | 293268/371472 [1:10:12<6:17:56,  3.45it/s]
 79%|███████▉  | 293269/371472 [1:10:12<6:05:00,  3.57it/s]
 79%|███████▉  | 293270/371472 [1:10:12<5:58:48,  3.63it/s]
 79%|███████▉  | 293271/371472 [1:10:13<6:21:08,  3.42it/s]
 79%|███████▉  | 293272/371472 [1:10:13<6:12:12,  3.50it/s]
 79%|███████▉  | 293273/371472 [1:10:13<5:54:04,  3.68it/s]
 79%|███████▉  | 293274/371472 [1:10:14<6:02:30,  3.60it/s]
 79%|███████▉  | 293275/371472 [1:10:14<6:23:24,  3.40it/s]
 79%|███████▉  | 293276/371472 [1:10:14<6:11:39,  3.51it/s]
 79%|███████▉  | 293277/371472 [1:10:14<6:11:53,  3.50it/s]
 79%|███████▉  | 293278/371472 [1:10:15<6:40:27,  3.25it/s]
 79%|███████▉  | 293279/371472 [1:10:15<6:25:56,  3.38it/s]
 79%|███████▉  | 293280/371472 [1:10:15<6:10:29,  3.52it/s]
                                                           
{'loss': 2.5569, 'learning_rate': 2.895451313322847e-07, 'epoch': 12.63}

 79%|███████▉  | 293280/371472 [1:10:15<6:10:29,  3.52it/s]
 79%|███████▉  | 293281/371472 [1:10:16<5:55:35,  3.66it/s]
 79%|███████▉  | 293282/371472 [1:10:16<6:03:50,  3.58it/s]
 79%|███████▉  | 293283/371472 [1:10:16<6:49:48,  3.18it/s]
 79%|███████▉  | 293284/371472 [1:10:17<6:25:46,  3.38it/s]
 79%|███████▉  | 293285/371472 [1:10:17<6:05:58,  3.56it/s]
 79%|███████▉  | 293286/371472 [1:10:17<5:57:00,  3.65it/s]
 79%|███████▉  | 293287/371472 [1:10:17<5:54:43,  3.67it/s]
 79%|███████▉  | 293288/371472 [1:10:18<5:49:54,  3.72it/s]
 79%|███████▉  | 293289/371472 [1:10:18<5:42:03,  3.81it/s]
 79%|███████▉  | 293290/371472 [1:10:18<6:23:42,  3.40it/s]
 79%|███████▉  | 293291/371472 [1:10:18<6:16:42,  3.46it/s]
 79%|███████▉  | 293292/371472 [1:10:19<6:22:05,  3.41it/s]
 79%|███████▉  | 293293/371472 [1:10:19<6:25:12,  3.38it/s]
 79%|███████▉  | 293294/371472 [1:10:19<6:20:20,  3.43it/s]
 79%|███████▉  | 293295/371472 [1:10:20<6:10:40,  3.52it/s]
 79%|███████▉  | 293296/371472 [1:10:20<6:05:54,  3.56it/s]
 79%|███████▉  | 293297/371472 [1:10:20<5:58:57,  3.63it/s]
 79%|███████▉  | 293298/371472 [1:10:20<6:08:21,  3.54it/s]
 79%|███████▉  | 293299/371472 [1:10:21<6:07:50,  3.54it/s]
 79%|███████▉  | 293300/371472 [1:10:21<6:37:15,  3.28it/s]
                                                           
{'loss': 2.5897, 'learning_rate': 2.8949664935680576e-07, 'epoch': 12.63}

 79%|███████▉  | 293300/371472 [1:10:21<6:37:15,  3.28it/s]
 79%|███████▉  | 293301/371472 [1:10:21<6:17:20,  3.45it/s]
 79%|███████▉  | 293302/371472 [1:10:22<6:17:25,  3.45it/s]
 79%|███████▉  | 293303/371472 [1:10:22<6:32:52,  3.32it/s]
 79%|███████▉  | 293304/371472 [1:10:22<6:21:15,  3.42it/s]
 79%|███████▉  | 293305/371472 [1:10:23<6:12:53,  3.49it/s]
 79%|███████▉  | 293306/371472 [1:10:23<6:19:02,  3.44it/s]
 79%|███████▉  | 293307/371472 [1:10:23<6:09:37,  3.52it/s]
 79%|███████▉  | 293308/371472 [1:10:23<6:01:26,  3.60it/s]
 79%|███████▉  | 293309/371472 [1:10:24<5:59:02,  3.63it/s]
 79%|███████▉  | 293310/371472 [1:10:24<5:52:26,  3.70it/s]
 79%|███████▉  | 293311/371472 [1:10:24<6:09:48,  3.52it/s]
 79%|███████▉  | 293312/371472 [1:10:24<5:57:31,  3.64it/s]
 79%|███████▉  | 293313/371472 [1:10:25<5:51:07,  3.71it/s]
 79%|███████▉  | 293314/371472 [1:10:25<6:50:50,  3.17it/s]
 79%|███████▉  | 293315/371472 [1:10:25<6:45:01,  3.22it/s]
 79%|███████▉  | 293316/371472 [1:10:26<6:35:45,  3.29it/s]
 79%|███████▉  | 293317/371472 [1:10:26<6:31:54,  3.32it/s]
 79%|███████▉  | 293318/371472 [1:10:26<6:21:17,  3.42it/s]
 79%|███████▉  | 293319/371472 [1:10:27<6:28:40,  3.35it/s]
 79%|███████▉  | 293320/371472 [1:10:27<6:47:00,  3.20it/s]
                                                           
{'loss': 2.5062, 'learning_rate': 2.894481673813269e-07, 'epoch': 12.63}

 79%|███████▉  | 293320/371472 [1:10:27<6:47:00,  3.20it/s]
 79%|███████▉  | 293321/371472 [1:10:27<6:30:17,  3.34it/s]
 79%|███████▉  | 293322/371472 [1:10:27<6:15:46,  3.47it/s]
 79%|███████▉  | 293323/371472 [1:10:28<6:00:23,  3.61it/s]
 79%|███████▉  | 293324/371472 [1:10:28<5:57:28,  3.64it/s]
 79%|███████▉  | 293325/371472 [1:10:28<6:10:15,  3.52it/s]
 79%|███████▉  | 293326/371472 [1:10:29<6:19:09,  3.44it/s]
 79%|███████▉  | 293327/371472 [1:10:29<6:17:56,  3.45it/s]
 79%|███████▉  | 293328/371472 [1:10:29<6:43:52,  3.22it/s]
 79%|███████▉  | 293329/371472 [1:10:30<6:23:23,  3.40it/s]
 79%|███████▉  | 293330/371472 [1:10:30<6:07:02,  3.55it/s]
 79%|███████▉  | 293331/371472 [1:10:30<6:04:09,  3.58it/s]
 79%|███████▉  | 293332/371472 [1:10:30<6:05:44,  3.56it/s]
 79%|███████▉  | 293333/371472 [1:10:31<5:57:25,  3.64it/s]
 79%|███████▉  | 293334/371472 [1:10:31<5:52:10,  3.70it/s]
 79%|███████▉  | 293335/371472 [1:10:31<6:03:41,  3.58it/s]
 79%|███████▉  | 293336/371472 [1:10:31<5:52:05,  3.70it/s]
 79%|███████▉  | 293337/371472 [1:10:32<5:48:05,  3.74it/s]
 79%|███████▉  | 293338/371472 [1:10:32<5:47:02,  3.75it/s]
 79%|███████▉  | 293339/371472 [1:10:32<6:09:28,  3.52it/s]
 79%|███████▉  | 293340/371472 [1:10:33<6:27:15,  3.36it/s]
                                                           
{'loss': 2.5871, 'learning_rate': 2.8939968540584795e-07, 'epoch': 12.63}

 79%|███████▉  | 293340/371472 [1:10:33<6:27:15,  3.36it/s]
 79%|███████▉  | 293341/371472 [1:10:33<6:16:27,  3.46it/s]
 79%|███████▉  | 293342/371472 [1:10:33<5:56:20,  3.65it/s]
 79%|███████▉  | 293343/371472 [1:10:33<5:46:30,  3.76it/s]
 79%|███████▉  | 293344/371472 [1:10:34<6:20:49,  3.42it/s]
 79%|███████▉  | 293345/371472 [1:10:34<6:20:07,  3.43it/s]
 79%|███████▉  | 293346/371472 [1:10:34<6:04:51,  3.57it/s]
 79%|███████▉  | 293347/371472 [1:10:34<6:02:41,  3.59it/s]
 79%|███████▉  | 293348/371472 [1:10:35<5:52:11,  3.70it/s]
 79%|███████▉  | 293349/371472 [1:10:35<6:00:45,  3.61it/s]
 79%|███████▉  | 293350/371472 [1:10:35<6:13:17,  3.49it/s]
 79%|███████▉  | 293351/371472 [1:10:36<6:06:01,  3.56it/s]
 79%|███████▉  | 293352/371472 [1:10:36<6:41:20,  3.24it/s]
 79%|███████▉  | 293353/371472 [1:10:36<6:34:58,  3.30it/s]
 79%|███████▉  | 293354/371472 [1:10:37<6:48:33,  3.19it/s]
 79%|███████▉  | 293355/371472 [1:10:37<6:26:42,  3.37it/s]
 79%|███████▉  | 293356/371472 [1:10:37<6:25:30,  3.38it/s]
 79%|███████▉  | 293357/371472 [1:10:37<6:18:21,  3.44it/s]
 79%|███████▉  | 293358/371472 [1:10:38<6:07:16,  3.54it/s]
 79%|███████▉  | 293359/371472 [1:10:38<6:26:56,  3.36it/s]
 79%|███████▉  | 293360/371472 [1:10:38<6:28:28,  3.35it/s]
                                                           
{'loss': 2.5131, 'learning_rate': 2.8935120343036913e-07, 'epoch': 12.64}

 79%|███████▉  | 293360/371472 [1:10:38<6:28:28,  3.35it/s]
 79%|███████▉  | 293361/371472 [1:10:39<6:22:51,  3.40it/s]
 79%|███████▉  | 293362/371472 [1:10:39<6:08:42,  3.53it/s]
 79%|███████▉  | 293363/371472 [1:10:39<6:06:25,  3.55it/s]
 79%|███████▉  | 293364/371472 [1:10:39<6:21:59,  3.41it/s]
 79%|███████▉  | 293365/371472 [1:10:40<6:01:11,  3.60it/s]
 79%|███████▉  | 293366/371472 [1:10:40<5:51:44,  3.70it/s]
 79%|███████▉  | 293367/371472 [1:10:40<5:45:31,  3.77it/s]
 79%|███████▉  | 293368/371472 [1:10:41<5:54:18,  3.67it/s]
 79%|███████▉  | 293369/371472 [1:10:41<6:00:50,  3.61it/s]
 79%|███████▉  | 293370/371472 [1:10:41<6:43:16,  3.23it/s]
 79%|███████▉  | 293371/371472 [1:10:41<6:41:19,  3.24it/s]
 79%|███████▉  | 293372/371472 [1:10:42<6:19:10,  3.43it/s]
 79%|███████▉  | 293373/371472 [1:10:42<6:44:51,  3.22it/s]
 79%|███████▉  | 293374/371472 [1:10:42<6:18:10,  3.44it/s]
 79%|███████▉  | 293375/371472 [1:10:43<6:11:50,  3.50it/s]
 79%|███████▉  | 293376/371472 [1:10:43<6:33:19,  3.31it/s]
 79%|███████▉  | 293377/371472 [1:10:43<6:33:22,  3.31it/s]
 79%|███████▉  | 293378/371472 [1:10:44<6:10:18,  3.51it/s]
 79%|███████▉  | 293379/371472 [1:10:44<6:01:12,  3.60it/s]
 79%|███████▉  | 293380/371472 [1:10:44<6:14:52,  3.47it/s]
                                                           
{'loss': 2.4774, 'learning_rate': 2.893027214548902e-07, 'epoch': 12.64}

 79%|███████▉  | 293380/371472 [1:10:44<6:14:52,  3.47it/s]
 79%|███████▉  | 293381/371472 [1:10:44<6:16:37,  3.46it/s]
 79%|███████▉  | 293382/371472 [1:10:45<6:32:09,  3.32it/s]
 79%|███████▉  | 293383/371472 [1:10:45<6:31:58,  3.32it/s]
 79%|███████▉  | 293384/371472 [1:10:45<6:18:07,  3.44it/s]
 79%|███████▉  | 293385/371472 [1:10:46<6:02:13,  3.59it/s]
 79%|███████▉  | 293386/371472 [1:10:46<6:03:44,  3.58it/s]
 79%|███████▉  | 293387/371472 [1:10:46<5:57:55,  3.64it/s]
 79%|███████▉  | 293388/371472 [1:10:46<5:54:29,  3.67it/s]
 79%|███████▉  | 293389/371472 [1:10:47<5:56:41,  3.65it/s]
 79%|███████▉  | 293390/371472 [1:10:47<5:49:46,  3.72it/s]
 79%|███████▉  | 293391/371472 [1:10:47<5:44:14,  3.78it/s]
 79%|███████▉  | 293392/371472 [1:10:47<5:37:54,  3.85it/s]
 79%|███████▉  | 293393/371472 [1:10:48<5:49:51,  3.72it/s]
 79%|███████▉  | 293394/371472 [1:10:48<6:38:05,  3.27it/s]
 79%|███████▉  | 293395/371472 [1:10:48<6:44:26,  3.22it/s]
 79%|███████▉  | 293396/371472 [1:10:49<6:54:15,  3.14it/s]
 79%|███████▉  | 293397/371472 [1:10:49<6:31:26,  3.32it/s]
 79%|███████▉  | 293398/371472 [1:10:49<6:10:19,  3.51it/s]
 79%|███████▉  | 293399/371472 [1:10:50<6:13:14,  3.49it/s]
 79%|███████▉  | 293400/371472 [1:10:50<6:17:20,  3.45it/s]
                                                           
{'loss': 2.7408, 'learning_rate': 2.892542394794114e-07, 'epoch': 12.64}

 79%|███████▉  | 293400/371472 [1:10:50<6:17:20,  3.45it/s]
 79%|███████▉  | 293401/371472 [1:10:50<6:38:05,  3.27it/s]
 79%|███████▉  | 293402/371472 [1:10:50<6:48:45,  3.18it/s]
 79%|███████▉  | 293403/371472 [1:10:51<6:26:46,  3.36it/s]
 79%|███████▉  | 293404/371472 [1:10:51<6:43:41,  3.22it/s]
 79%|███████▉  | 293405/371472 [1:10:51<6:39:06,  3.26it/s]
 79%|███████▉  | 293406/371472 [1:10:52<6:52:28,  3.15it/s]
 79%|███████▉  | 293407/371472 [1:10:52<7:17:20,  2.98it/s]
 79%|███████▉  | 293408/371472 [1:10:52<6:52:36,  3.15it/s]
 79%|███████▉  | 293409/371472 [1:10:53<6:30:53,  3.33it/s]
 79%|███████▉  | 293410/371472 [1:10:53<6:48:07,  3.19it/s]
 79%|███████▉  | 293411/371472 [1:10:53<6:32:21,  3.32it/s]
 79%|███████▉  | 293412/371472 [1:10:54<6:22:43,  3.40it/s]
 79%|███████▉  | 293413/371472 [1:10:54<6:17:07,  3.45it/s]
 79%|███████▉  | 293414/371472 [1:10:54<6:07:53,  3.54it/s]
 79%|███████▉  | 293415/371472 [1:10:54<6:48:23,  3.19it/s]
 79%|███████▉  | 293416/371472 [1:10:55<6:38:50,  3.26it/s]
 79%|███████▉  | 293417/371472 [1:10:55<6:25:09,  3.38it/s]
 79%|███████▉  | 293418/371472 [1:10:55<6:16:21,  3.46it/s]
 79%|███████▉  | 293419/371472 [1:10:56<6:34:12,  3.30it/s]
 79%|███████▉  | 293420/371472 [1:10:56<6:13:58,  3.48it/s]
                                                           
{'loss': 2.5466, 'learning_rate': 2.8920575750393235e-07, 'epoch': 12.64}

 79%|███████▉  | 293420/371472 [1:10:56<6:13:58,  3.48it/s]
 79%|███████▉  | 293421/371472 [1:10:56<6:21:39,  3.41it/s]
 79%|███████▉  | 293422/371472 [1:10:56<6:08:06,  3.53it/s]
 79%|███████▉  | 293423/371472 [1:10:57<6:21:41,  3.41it/s]
 79%|███████▉  | 293424/371472 [1:10:57<6:55:47,  3.13it/s]
 79%|███████▉  | 293425/371472 [1:10:57<6:53:07,  3.15it/s]
 79%|███████▉  | 293426/371472 [1:10:58<6:31:36,  3.32it/s]
 79%|███████▉  | 293427/371472 [1:10:58<6:12:03,  3.50it/s]
 79%|███████▉  | 293428/371472 [1:10:58<6:08:35,  3.53it/s]
 79%|███████▉  | 293429/371472 [1:10:59<6:08:44,  3.53it/s]
 79%|███████▉  | 293430/371472 [1:10:59<6:12:12,  3.49it/s]
 79%|███████▉  | 293431/371472 [1:10:59<6:14:21,  3.47it/s]
 79%|███████▉  | 293432/371472 [1:10:59<6:12:25,  3.49it/s]
 79%|███████▉  | 293433/371472 [1:11:00<5:59:13,  3.62it/s]
 79%|███████▉  | 293434/371472 [1:11:00<5:57:02,  3.64it/s]
 79%|███████▉  | 293435/371472 [1:11:00<5:44:41,  3.77it/s]
 79%|███████▉  | 293436/371472 [1:11:00<6:08:46,  3.53it/s]
 79%|███████▉  | 293437/371472 [1:11:01<6:03:28,  3.58it/s]
 79%|███████▉  | 293438/371472 [1:11:01<6:00:53,  3.60it/s]
 79%|███████▉  | 293439/371472 [1:11:01<5:57:24,  3.64it/s]
 79%|███████▉  | 293440/371472 [1:11:02<5:53:27,  3.68it/s]
                                                           
{'loss': 2.86, 'learning_rate': 2.891572755284535e-07, 'epoch': 12.64}

 79%|███████▉  | 293440/371472 [1:11:02<5:53:27,  3.68it/s]
 79%|███████▉  | 293441/371472 [1:11:02<5:47:40,  3.74it/s]
 79%|███████▉  | 293442/371472 [1:11:02<5:53:49,  3.68it/s]
 79%|███████▉  | 293443/371472 [1:11:02<5:50:20,  3.71it/s]
 79%|███████▉  | 293444/371472 [1:11:03<6:03:09,  3.58it/s]
 79%|███████▉  | 293445/371472 [1:11:03<6:47:09,  3.19it/s]
 79%|███████▉  | 293446/371472 [1:11:03<6:39:24,  3.26it/s]
 79%|███████▉  | 293447/371472 [1:11:04<6:32:12,  3.32it/s]
 79%|███████▉  | 293448/371472 [1:11:04<6:09:05,  3.52it/s]
 79%|███████▉  | 293449/371472 [1:11:04<6:36:12,  3.28it/s]
 79%|███████▉  | 293450/371472 [1:11:05<6:48:40,  3.18it/s]
 79%|███████▉  | 293451/371472 [1:11:05<6:38:09,  3.27it/s]
 79%|███████▉  | 293452/371472 [1:11:05<6:26:20,  3.37it/s]
 79%|███████▉  | 293453/371472 [1:11:05<6:19:52,  3.42it/s]
 79%|███████▉  | 293454/371472 [1:11:06<6:07:16,  3.54it/s]
 79%|███████▉  | 293455/371472 [1:11:06<6:05:08,  3.56it/s]
 79%|███████▉  | 293456/371472 [1:11:06<6:10:52,  3.51it/s]
 79%|███████▉  | 293457/371472 [1:11:07<6:51:26,  3.16it/s]
 79%|███████▉  | 293458/371472 [1:11:07<6:40:41,  3.24it/s]
 79%|███████▉  | 293459/371472 [1:11:07<6:41:42,  3.24it/s]
 79%|███████▉  | 293460/371472 [1:11:08<6:24:49,  3.38it/s]
                                                           
{'loss': 2.6317, 'learning_rate': 2.891087935529746e-07, 'epoch': 12.64}

 79%|███████▉  | 293460/371472 [1:11:08<6:24:49,  3.38it/s]
 79%|███████▉  | 293461/371472 [1:11:08<6:15:51,  3.46it/s]
 79%|███████▉  | 293462/371472 [1:11:08<6:34:27,  3.30it/s]
 79%|███████▉  | 293463/371472 [1:11:08<6:15:24,  3.46it/s]
 79%|███████▉  | 293464/371472 [1:11:09<6:35:00,  3.29it/s]
 79%|███████▉  | 293465/371472 [1:11:09<6:22:32,  3.40it/s]
 79%|███████▉  | 293466/371472 [1:11:09<6:18:18,  3.44it/s]
 79%|███████▉  | 293467/371472 [1:11:10<6:06:02,  3.55it/s]
 79%|███████▉  | 293468/371472 [1:11:10<6:18:20,  3.44it/s]
 79%|███████▉  | 293469/371472 [1:11:10<6:15:44,  3.46it/s]
 79%|███████▉  | 293470/371472 [1:11:10<6:05:23,  3.56it/s]
 79%|███████▉  | 293471/371472 [1:11:11<6:29:57,  3.33it/s]
 79%|███████▉  | 293472/371472 [1:11:11<6:16:20,  3.45it/s]
 79%|███████▉  | 293473/371472 [1:11:11<6:05:11,  3.56it/s]
 79%|███████▉  | 293474/371472 [1:11:12<6:01:38,  3.59it/s]
 79%|███████▉  | 293475/371472 [1:11:12<5:53:02,  3.68it/s]
 79%|███████▉  | 293476/371472 [1:11:12<5:51:56,  3.69it/s]
 79%|███████▉  | 293477/371472 [1:11:12<5:58:21,  3.63it/s]
 79%|███████▉  | 293478/371472 [1:11:13<6:03:07,  3.58it/s]
 79%|███████▉  | 293479/371472 [1:11:13<6:45:34,  3.21it/s]
 79%|███████▉  | 293480/371472 [1:11:13<6:23:24,  3.39it/s]
                                                           
{'loss': 2.5677, 'learning_rate': 2.8906031157749577e-07, 'epoch': 12.64}

 79%|███████▉  | 293480/371472 [1:11:13<6:23:24,  3.39it/s]
 79%|███████▉  | 293481/371472 [1:11:14<6:16:40,  3.45it/s]
 79%|███████▉  | 293482/371472 [1:11:14<6:07:14,  3.54it/s]
 79%|███████▉  | 293483/371472 [1:11:14<6:27:41,  3.35it/s]
 79%|███████▉  | 293484/371472 [1:11:14<6:34:48,  3.29it/s]
 79%|███████▉  | 293485/371472 [1:11:15<6:14:35,  3.47it/s]
 79%|███████▉  | 293486/371472 [1:11:15<5:58:39,  3.62it/s]
 79%|███████▉  | 293487/371472 [1:11:15<6:03:11,  3.58it/s]
 79%|███████▉  | 293488/371472 [1:11:16<6:10:02,  3.51it/s]
 79%|███████▉  | 293489/371472 [1:11:16<6:34:39,  3.29it/s]
 79%|███████▉  | 293490/371472 [1:11:16<6:23:23,  3.39it/s]
 79%|███████▉  | 293491/371472 [1:11:16<6:23:21,  3.39it/s]
 79%|███████▉  | 293492/371472 [1:11:17<6:15:50,  3.46it/s]
 79%|███████▉  | 293493/371472 [1:11:17<6:31:10,  3.32it/s]
 79%|███████▉  | 293494/371472 [1:11:17<6:14:19,  3.47it/s]
 79%|███████▉  | 293495/371472 [1:11:18<6:29:27,  3.34it/s]
 79%|███████▉  | 293496/371472 [1:11:18<6:10:14,  3.51it/s]
 79%|███████▉  | 293497/371472 [1:11:18<5:57:19,  3.64it/s]
 79%|███████▉  | 293498/371472 [1:11:18<5:59:50,  3.61it/s]
 79%|███████▉  | 293499/371472 [1:11:19<6:02:50,  3.58it/s]
 79%|███████▉  | 293500/371472 [1:11:19<6:19:34,  3.42it/s]
                                                           
{'loss': 2.7134, 'learning_rate': 2.8901182960201684e-07, 'epoch': 12.64}

 79%|███████▉  | 293500/371472 [1:11:19<6:19:34,  3.42it/s]
 79%|███████▉  | 293501/371472 [1:11:19<6:06:35,  3.54it/s]
 79%|███████▉  | 293502/371472 [1:11:20<6:00:15,  3.61it/s]
 79%|███████▉  | 293503/371472 [1:11:20<5:54:14,  3.67it/s]
 79%|███████▉  | 293504/371472 [1:11:20<6:02:46,  3.58it/s]
 79%|███████▉  | 293505/371472 [1:11:20<6:03:56,  3.57it/s]
 79%|███████▉  | 293506/371472 [1:11:21<6:02:04,  3.59it/s]
 79%|███████▉  | 293507/371472 [1:11:21<6:31:56,  3.32it/s]
 79%|███████▉  | 293508/371472 [1:11:21<6:36:42,  3.28it/s]
 79%|███████▉  | 293509/371472 [1:11:22<6:15:57,  3.46it/s]
 79%|███████▉  | 293510/371472 [1:11:22<6:17:21,  3.44it/s]
 79%|███████▉  | 293511/371472 [1:11:22<6:23:49,  3.39it/s]
 79%|███████▉  | 293512/371472 [1:11:22<6:05:07,  3.56it/s]
 79%|███████▉  | 293513/371472 [1:11:23<6:09:48,  3.51it/s]
 79%|███████▉  | 293514/371472 [1:11:23<6:38:06,  3.26it/s]
 79%|███████▉  | 293515/371472 [1:11:23<6:47:35,  3.19it/s]
 79%|███████▉  | 293516/371472 [1:11:24<6:32:27,  3.31it/s]
 79%|███████▉  | 293517/371472 [1:11:24<6:14:07,  3.47it/s]
 79%|███████▉  | 293518/371472 [1:11:24<6:33:01,  3.31it/s]
 79%|███████▉  | 293519/371472 [1:11:25<6:41:49,  3.23it/s]
 79%|███████▉  | 293520/371472 [1:11:25<6:50:11,  3.17it/s]
                                                           
{'loss': 2.7171, 'learning_rate': 2.8896334762653797e-07, 'epoch': 12.64}

 79%|███████▉  | 293520/371472 [1:11:25<6:50:11,  3.17it/s]
 79%|███████▉  | 293521/371472 [1:11:25<6:28:38,  3.34it/s]
 79%|███████▉  | 293522/371472 [1:11:25<6:11:21,  3.50it/s]
 79%|███████▉  | 293523/371472 [1:11:26<6:15:59,  3.46it/s]
 79%|███████▉  | 293524/371472 [1:11:26<6:33:24,  3.30it/s]
 79%|███████▉  | 293525/371472 [1:11:26<6:19:26,  3.42it/s]
 79%|███████▉  | 293526/371472 [1:11:27<6:14:06,  3.47it/s]
 79%|███████▉  | 293527/371472 [1:11:27<6:04:57,  3.56it/s]
 79%|███████▉  | 293528/371472 [1:11:27<6:15:54,  3.46it/s]
 79%|███████▉  | 293529/371472 [1:11:28<6:11:00,  3.50it/s]
 79%|███████▉  | 293530/371472 [1:11:28<6:03:28,  3.57it/s]
 79%|███████▉  | 293531/371472 [1:11:28<6:06:47,  3.54it/s]
 79%|███████▉  | 293532/371472 [1:11:28<6:42:18,  3.23it/s]
 79%|███████▉  | 293533/371472 [1:11:29<6:21:44,  3.40it/s]
 79%|███████▉  | 293534/371472 [1:11:29<6:04:30,  3.56it/s]
 79%|███████▉  | 293535/371472 [1:11:29<6:09:30,  3.52it/s]
 79%|███████▉  | 293536/371472 [1:11:30<6:24:03,  3.38it/s]
 79%|███████▉  | 293537/371472 [1:11:30<6:34:51,  3.29it/s]
 79%|███████▉  | 293538/371472 [1:11:30<6:42:16,  3.23it/s]
 79%|███████▉  | 293539/371472 [1:11:30<6:25:14,  3.37it/s]
 79%|███████▉  | 293540/371472 [1:11:31<6:12:53,  3.48it/s]
                                                           
{'loss': 2.6595, 'learning_rate': 2.88914865651059e-07, 'epoch': 12.64}

 79%|███████▉  | 293540/371472 [1:11:31<6:12:53,  3.48it/s]
 79%|███████▉  | 293541/371472 [1:11:31<6:04:34,  3.56it/s]
 79%|███████▉  | 293542/371472 [1:11:31<6:08:21,  3.53it/s]
 79%|███████▉  | 293543/371472 [1:11:32<6:06:45,  3.54it/s]
 79%|███████▉  | 293544/371472 [1:11:32<6:47:44,  3.19it/s]
 79%|███████▉  | 293545/371472 [1:11:32<6:31:59,  3.31it/s]
 79%|███████▉  | 293546/371472 [1:11:33<6:26:26,  3.36it/s]
 79%|███████▉  | 293547/371472 [1:11:33<6:24:21,  3.38it/s]
 79%|███████▉  | 293548/371472 [1:11:33<6:09:33,  3.51it/s]
 79%|███████▉  | 293549/371472 [1:11:33<6:05:34,  3.55it/s]
 79%|███████▉  | 293550/371472 [1:11:34<6:41:15,  3.24it/s]
 79%|███████▉  | 293551/371472 [1:11:34<6:43:04,  3.22it/s]
 79%|███████▉  | 293552/371472 [1:11:34<6:27:27,  3.35it/s]
 79%|███████▉  | 293553/371472 [1:11:35<6:15:58,  3.45it/s]
 79%|███████▉  | 293554/371472 [1:11:35<6:21:03,  3.41it/s]
 79%|███████▉  | 293555/371472 [1:11:35<6:14:26,  3.47it/s]
 79%|███████▉  | 293556/371472 [1:11:35<6:06:43,  3.54it/s]
 79%|███████▉  | 293557/371472 [1:11:36<5:52:29,  3.68it/s]
 79%|███████▉  | 293558/371472 [1:11:36<5:44:41,  3.77it/s]
 79%|███████▉  | 293559/371472 [1:11:36<6:06:50,  3.54it/s]
 79%|███████▉  | 293560/371472 [1:11:37<6:11:26,  3.50it/s]
                                                           
{'loss': 2.4712, 'learning_rate': 2.8886638367558016e-07, 'epoch': 12.64}

 79%|███████▉  | 293560/371472 [1:11:37<6:11:26,  3.50it/s]
 79%|███████▉  | 293561/371472 [1:11:37<6:11:30,  3.50it/s]
 79%|███████▉  | 293562/371472 [1:11:37<6:10:20,  3.51it/s]
 79%|███████▉  | 293563/371472 [1:11:37<6:29:09,  3.34it/s]
 79%|███████▉  | 293564/371472 [1:11:38<6:16:03,  3.45it/s]
 79%|███████▉  | 293565/371472 [1:11:38<6:10:32,  3.50it/s]
 79%|███████▉  | 293566/371472 [1:11:38<6:02:36,  3.58it/s]
 79%|███████▉  | 293567/371472 [1:11:38<5:49:08,  3.72it/s]
 79%|███████▉  | 293568/371472 [1:11:39<6:01:34,  3.59it/s]
 79%|███████▉  | 293569/371472 [1:11:39<5:52:54,  3.68it/s]
 79%|███████▉  | 293570/371472 [1:11:39<6:07:04,  3.54it/s]
 79%|███████▉  | 293571/371472 [1:11:40<6:30:04,  3.33it/s]
 79%|███████▉  | 293572/371472 [1:11:40<6:26:44,  3.36it/s]
 79%|███████▉  | 293573/371472 [1:11:40<6:22:31,  3.39it/s]
 79%|███████▉  | 293574/371472 [1:11:41<6:06:28,  3.54it/s]
 79%|███████▉  | 293575/371472 [1:11:41<6:05:19,  3.55it/s]
 79%|███████▉  | 293576/371472 [1:11:41<5:57:49,  3.63it/s]
 79%|███████▉  | 293577/371472 [1:11:41<6:01:11,  3.59it/s]
 79%|███████▉  | 293578/371472 [1:11:42<5:52:03,  3.69it/s]
 79%|███████▉  | 293579/371472 [1:11:42<5:48:52,  3.72it/s]
 79%|███████▉  | 293580/371472 [1:11:42<5:47:56,  3.73it/s]
                                                           
{'loss': 2.6573, 'learning_rate': 2.8881790170010124e-07, 'epoch': 12.65}

 79%|███████▉  | 293580/371472 [1:11:42<5:47:56,  3.73it/s]
 79%|███████▉  | 293581/371472 [1:11:42<5:38:46,  3.83it/s]
 79%|███████▉  | 293582/371472 [1:11:43<5:30:32,  3.93it/s]
 79%|███████▉  | 293583/371472 [1:11:43<6:04:42,  3.56it/s]
 79%|███████▉  | 293584/371472 [1:11:43<6:36:06,  3.28it/s]
 79%|███████▉  | 293585/371472 [1:11:44<6:27:55,  3.35it/s]
 79%|███████▉  | 293586/371472 [1:11:44<6:10:50,  3.50it/s]
 79%|███████▉  | 293587/371472 [1:11:44<6:00:06,  3.60it/s]
 79%|███████▉  | 293588/371472 [1:11:44<5:56:01,  3.65it/s]
 79%|███████▉  | 293589/371472 [1:11:45<5:51:59,  3.69it/s]
 79%|███████▉  | 293590/371472 [1:11:45<5:44:57,  3.76it/s]
 79%|███████▉  | 293591/371472 [1:11:45<6:01:38,  3.59it/s]
 79%|███████▉  | 293592/371472 [1:11:46<6:08:18,  3.52it/s]
 79%|███████▉  | 293593/371472 [1:11:46<5:57:46,  3.63it/s]
 79%|███████▉  | 293594/371472 [1:11:46<5:50:47,  3.70it/s]
 79%|███████▉  | 293595/371472 [1:11:46<5:55:20,  3.65it/s]
 79%|███████▉  | 293596/371472 [1:11:47<6:30:52,  3.32it/s]
 79%|███████▉  | 293597/371472 [1:11:47<6:16:46,  3.44it/s]
 79%|███████▉  | 293598/371472 [1:11:47<6:00:54,  3.60it/s]
 79%|███████▉  | 293599/371472 [1:11:47<6:07:24,  3.53it/s]
 79%|███████▉  | 293600/371472 [1:11:48<5:59:13,  3.61it/s]
                                                           
{'loss': 2.7136, 'learning_rate': 2.887694197246224e-07, 'epoch': 12.65}

 79%|███████▉  | 293600/371472 [1:11:48<5:59:13,  3.61it/s]
 79%|███████▉  | 293601/371472 [1:11:48<5:53:39,  3.67it/s]
 79%|███████▉  | 293602/371472 [1:11:48<6:31:23,  3.32it/s]
 79%|███████▉  | 293603/371472 [1:11:49<6:13:10,  3.48it/s]
 79%|███████▉  | 293604/371472 [1:11:49<6:15:45,  3.45it/s]
 79%|███████▉  | 293605/371472 [1:11:49<6:20:06,  3.41it/s]
 79%|███████▉  | 293606/371472 [1:11:49<6:13:47,  3.47it/s]
 79%|███████▉  | 293607/371472 [1:11:50<6:04:25,  3.56it/s]
 79%|███████▉  | 293608/371472 [1:11:50<5:58:37,  3.62it/s]
 79%|███████▉  | 293609/371472 [1:11:50<6:31:31,  3.31it/s]
 79%|███████▉  | 293610/371472 [1:11:51<6:26:02,  3.36it/s]
 79%|███████▉  | 293611/371472 [1:11:51<6:14:24,  3.47it/s]
 79%|███████▉  | 293612/371472 [1:11:51<6:09:43,  3.51it/s]
 79%|███████▉  | 293613/371472 [1:11:51<6:07:17,  3.53it/s]
 79%|███████▉  | 293614/371472 [1:11:52<5:54:48,  3.66it/s]
 79%|███████▉  | 293615/371472 [1:11:52<6:10:33,  3.50it/s]
 79%|███████▉  | 293616/371472 [1:11:52<6:14:15,  3.47it/s]
 79%|███████▉  | 293617/371472 [1:11:53<6:14:56,  3.46it/s]
 79%|███████▉  | 293618/371472 [1:11:53<6:26:37,  3.36it/s]
 79%|███████▉  | 293619/371472 [1:11:53<6:42:57,  3.22it/s]
 79%|███████▉  | 293620/371472 [1:11:54<6:16:53,  3.44it/s]
                                                           
{'loss': 2.5816, 'learning_rate': 2.887209377491435e-07, 'epoch': 12.65}

 79%|███████▉  | 293620/371472 [1:11:54<6:16:53,  3.44it/s]
 79%|███████▉  | 293621/371472 [1:11:54<6:13:44,  3.47it/s]
 79%|███████▉  | 293622/371472 [1:11:54<6:15:01,  3.46it/s]
 79%|███████▉  | 293623/371472 [1:11:54<6:06:26,  3.54it/s]
 79%|███████▉  | 293624/371472 [1:11:55<6:19:22,  3.42it/s]
 79%|███████▉  | 293625/371472 [1:11:55<6:02:31,  3.58it/s]
 79%|███████▉  | 293626/371472 [1:11:55<6:01:23,  3.59it/s]
 79%|███████▉  | 293627/371472 [1:11:56<5:56:41,  3.64it/s]
 79%|███████▉  | 293628/371472 [1:11:56<6:04:28,  3.56it/s]
 79%|███████▉  | 293629/371472 [1:11:56<6:06:05,  3.54it/s]
 79%|███████▉  | 293630/371472 [1:11:56<5:55:44,  3.65it/s]
 79%|███████▉  | 293631/371472 [1:11:57<6:14:55,  3.46it/s]
 79%|███████▉  | 293632/371472 [1:11:57<6:43:40,  3.21it/s]
 79%|███████▉  | 293633/371472 [1:11:57<7:04:27,  3.06it/s]
 79%|███████▉  | 293634/371472 [1:11:58<6:39:04,  3.25it/s]
 79%|███████▉  | 293635/371472 [1:11:58<6:15:04,  3.46it/s]
 79%|███████▉  | 293636/371472 [1:11:58<6:11:00,  3.50it/s]
 79%|███████▉  | 293637/371472 [1:11:58<6:06:41,  3.54it/s]
 79%|███████▉  | 293638/371472 [1:11:59<6:36:54,  3.27it/s]
 79%|███████▉  | 293639/371472 [1:11:59<6:21:44,  3.40it/s]
 79%|███████▉  | 293640/371472 [1:11:59<6:16:08,  3.45it/s]
                                                           
{'loss': 2.6257, 'learning_rate': 2.886724557736646e-07, 'epoch': 12.65}

 79%|███████▉  | 293640/371472 [1:11:59<6:16:08,  3.45it/s]
 79%|███████▉  | 293641/371472 [1:12:00<6:18:44,  3.42it/s]
 79%|███████▉  | 293642/371472 [1:12:00<6:14:47,  3.46it/s]
 79%|███████▉  | 293643/371472 [1:12:00<6:14:49,  3.46it/s]
 79%|███████▉  | 293644/371472 [1:12:01<6:11:15,  3.49it/s]
 79%|███████▉  | 293645/371472 [1:12:01<6:21:53,  3.40it/s]
 79%|███████▉  | 293646/371472 [1:12:01<6:13:38,  3.47it/s]
 79%|███████▉  | 293647/371472 [1:12:01<6:26:36,  3.36it/s]
 79%|███████▉  | 293648/371472 [1:12:02<6:09:18,  3.51it/s]
 79%|███████▉  | 293649/371472 [1:12:02<5:54:19,  3.66it/s]
 79%|███████▉  | 293650/371472 [1:12:02<5:51:22,  3.69it/s]
 79%|███████▉  | 293651/371472 [1:12:02<6:00:58,  3.59it/s]
 79%|███████▉  | 293652/371472 [1:12:03<6:24:33,  3.37it/s]
 79%|███████▉  | 293653/371472 [1:12:03<6:13:00,  3.48it/s]
 79%|███████▉  | 293654/371472 [1:12:03<6:22:00,  3.40it/s]
 79%|███████▉  | 293655/371472 [1:12:04<6:08:24,  3.52it/s]
 79%|███████▉  | 293656/371472 [1:12:04<6:04:51,  3.55it/s]
 79%|███████▉  | 293657/371472 [1:12:04<6:00:47,  3.59it/s]
 79%|███████▉  | 293658/371472 [1:12:04<6:04:46,  3.56it/s]
 79%|███████▉  | 293659/371472 [1:12:05<6:07:53,  3.53it/s]
 79%|███████▉  | 293660/371472 [1:12:05<5:53:50,  3.67it/s]
                                                           
{'loss': 2.5202, 'learning_rate': 2.886239737981857e-07, 'epoch': 12.65}

 79%|███████▉  | 293660/371472 [1:12:05<5:53:50,  3.67it/s]
 79%|███████▉  | 293661/371472 [1:12:05<5:52:44,  3.68it/s]
 79%|███████▉  | 293662/371472 [1:12:06<6:12:48,  3.48it/s]
 79%|███████▉  | 293663/371472 [1:12:06<6:06:20,  3.54it/s]
 79%|███████▉  | 293664/371472 [1:12:06<6:10:04,  3.50it/s]
 79%|███████▉  | 293665/371472 [1:12:06<6:05:19,  3.55it/s]
 79%|███████▉  | 293666/371472 [1:12:07<5:49:03,  3.72it/s]
 79%|███████▉  | 293667/371472 [1:12:07<6:18:48,  3.42it/s]
 79%|███████▉  | 293668/371472 [1:12:07<6:13:19,  3.47it/s]
 79%|███████▉  | 293669/371472 [1:12:08<6:54:09,  3.13it/s]
 79%|███████▉  | 293670/371472 [1:12:08<6:39:32,  3.25it/s]
 79%|███████▉  | 293671/371472 [1:12:08<6:32:35,  3.30it/s]
 79%|███████▉  | 293672/371472 [1:12:09<6:43:11,  3.22it/s]
 79%|███████▉  | 293673/371472 [1:12:09<6:13:27,  3.47it/s]
 79%|███████▉  | 293674/371472 [1:12:09<6:09:17,  3.51it/s]
 79%|███████▉  | 293675/371472 [1:12:09<6:27:55,  3.34it/s]
 79%|███████▉  | 293676/371472 [1:12:10<6:25:41,  3.36it/s]
 79%|███████▉  | 293677/371472 [1:12:10<6:21:34,  3.40it/s]
 79%|███████▉  | 293678/371472 [1:12:10<6:22:35,  3.39it/s]
 79%|███████▉  | 293679/371472 [1:12:11<6:28:30,  3.34it/s]
 79%|███████▉  | 293680/371472 [1:12:11<6:17:19,  3.44it/s]
                                                           
{'loss': 2.5755, 'learning_rate': 2.885754918227068e-07, 'epoch': 12.65}

 79%|███████▉  | 293680/371472 [1:12:11<6:17:19,  3.44it/s]
 79%|███████▉  | 293681/371472 [1:12:11<6:37:49,  3.26it/s]
 79%|███████▉  | 293682/371472 [1:12:12<6:22:18,  3.39it/s]
 79%|███████▉  | 293683/371472 [1:12:12<6:17:18,  3.44it/s]
 79%|███████▉  | 293684/371472 [1:12:12<5:59:54,  3.60it/s]
 79%|███████▉  | 293685/371472 [1:12:12<5:51:02,  3.69it/s]
 79%|███████▉  | 293686/371472 [1:12:13<5:49:39,  3.71it/s]
 79%|███████▉  | 293687/371472 [1:12:13<6:13:21,  3.47it/s]
 79%|███████▉  | 293688/371472 [1:12:13<5:50:45,  3.70it/s]
 79%|███████▉  | 293689/371472 [1:12:13<6:04:17,  3.56it/s]
 79%|███████▉  | 293690/371472 [1:12:14<5:58:01,  3.62it/s]
 79%|███████▉  | 293691/371472 [1:12:14<6:06:33,  3.54it/s]
 79%|███████▉  | 293692/371472 [1:12:14<5:55:48,  3.64it/s]
 79%|███████▉  | 293693/371472 [1:12:15<5:44:15,  3.77it/s]
 79%|███████▉  | 293694/371472 [1:12:15<6:30:08,  3.32it/s]
 79%|███████▉  | 293695/371472 [1:12:15<6:13:07,  3.47it/s]
 79%|███████▉  | 293696/371472 [1:12:15<6:28:35,  3.34it/s]
 79%|███████▉  | 293697/371472 [1:12:16<7:00:31,  3.08it/s]
 79%|███████▉  | 293698/371472 [1:12:16<6:32:57,  3.30it/s]
 79%|███████▉  | 293699/371472 [1:12:16<6:16:38,  3.44it/s]
 79%|███████▉  | 293700/371472 [1:12:17<6:12:45,  3.48it/s]
                                                           
{'loss': 2.5538, 'learning_rate': 2.885270098472279e-07, 'epoch': 12.65}

 79%|███████▉  | 293700/371472 [1:12:17<6:12:45,  3.48it/s]
 79%|███████▉  | 293701/371472 [1:12:17<6:18:43,  3.42it/s]
 79%|███████▉  | 293702/371472 [1:12:17<6:40:09,  3.24it/s]
 79%|███████▉  | 293703/371472 [1:12:18<6:26:45,  3.35it/s]
 79%|███████▉  | 293704/371472 [1:12:18<6:26:20,  3.35it/s]
 79%|███████▉  | 293705/371472 [1:12:18<6:20:29,  3.41it/s]
 79%|███████▉  | 293706/371472 [1:12:18<6:12:09,  3.48it/s]
 79%|███████▉  | 293707/371472 [1:12:19<6:23:22,  3.38it/s]
 79%|███████▉  | 293708/371472 [1:12:19<6:43:55,  3.21it/s]
 79%|███████▉  | 293709/371472 [1:12:19<6:50:17,  3.16it/s]
 79%|███████▉  | 293710/371472 [1:12:20<6:24:42,  3.37it/s]
 79%|███████▉  | 293711/371472 [1:12:20<6:20:41,  3.40it/s]
 79%|███████▉  | 293712/371472 [1:12:20<6:10:39,  3.50it/s]
 79%|███████▉  | 293713/371472 [1:12:21<6:33:46,  3.29it/s]
 79%|███████▉  | 293714/371472 [1:12:21<6:13:01,  3.47it/s]
 79%|███████▉  | 293715/371472 [1:12:21<6:14:07,  3.46it/s]
 79%|███████▉  | 293716/371472 [1:12:21<5:59:28,  3.61it/s]
 79%|███████▉  | 293717/371472 [1:12:22<6:01:53,  3.58it/s]
 79%|███████▉  | 293718/371472 [1:12:22<5:59:21,  3.61it/s]
 79%|███████▉  | 293719/371472 [1:12:22<6:12:34,  3.48it/s]
 79%|███████▉  | 293720/371472 [1:12:23<6:12:00,  3.48it/s]
                                                           
{'loss': 2.6555, 'learning_rate': 2.8847852787174905e-07, 'epoch': 12.65}

 79%|███████▉  | 293720/371472 [1:12:23<6:12:00,  3.48it/s]
 79%|███████▉  | 293721/371472 [1:12:23<6:35:47,  3.27it/s]
 79%|███████▉  | 293722/371472 [1:12:23<6:27:34,  3.34it/s]
 79%|███████▉  | 293723/371472 [1:12:23<6:42:22,  3.22it/s]
 79%|███████▉  | 293724/371472 [1:12:24<7:13:14,  2.99it/s]
 79%|███████▉  | 293725/371472 [1:12:24<6:43:32,  3.21it/s]
 79%|███████▉  | 293726/371472 [1:12:24<6:27:58,  3.34it/s]
 79%|███████▉  | 293727/371472 [1:12:25<6:21:56,  3.39it/s]
 79%|███████▉  | 293728/371472 [1:12:25<6:05:39,  3.54it/s]
 79%|███████▉  | 293729/371472 [1:12:25<5:57:44,  3.62it/s]
 79%|███████▉  | 293730/371472 [1:12:25<5:52:15,  3.68it/s]
 79%|███████▉  | 293731/371472 [1:12:26<6:30:14,  3.32it/s]
 79%|███████▉  | 293732/371472 [1:12:26<6:22:43,  3.39it/s]
 79%|███████▉  | 293733/371472 [1:12:26<6:11:29,  3.49it/s]
 79%|███████▉  | 293734/371472 [1:12:27<6:16:46,  3.44it/s]
 79%|███████▉  | 293735/371472 [1:12:27<6:28:47,  3.33it/s]
 79%|███████▉  | 293736/371472 [1:12:27<6:10:57,  3.49it/s]
 79%|███████▉  | 293737/371472 [1:12:28<6:01:00,  3.59it/s]
 79%|███████▉  | 293738/371472 [1:12:28<5:55:09,  3.65it/s]
 79%|███████▉  | 293739/371472 [1:12:28<5:51:36,  3.68it/s]
 79%|███████▉  | 293740/371472 [1:12:28<5:47:27,  3.73it/s]
                                                           
{'loss': 2.5887, 'learning_rate': 2.884300458962701e-07, 'epoch': 12.65}

 79%|███████▉  | 293740/371472 [1:12:28<5:47:27,  3.73it/s]
 79%|███████▉  | 293741/371472 [1:12:29<5:40:05,  3.81it/s]
 79%|███████▉  | 293742/371472 [1:12:29<5:46:50,  3.74it/s]
 79%|███████▉  | 293743/371472 [1:12:29<5:49:05,  3.71it/s]
 79%|███████▉  | 293744/371472 [1:12:29<5:38:56,  3.82it/s]
 79%|███████▉  | 293745/371472 [1:12:30<6:19:16,  3.42it/s]
 79%|███████▉  | 293746/371472 [1:12:30<6:08:26,  3.52it/s]
 79%|███████▉  | 293747/371472 [1:12:30<5:58:06,  3.62it/s]
 79%|███████▉  | 293748/371472 [1:12:31<8:27:04,  2.55it/s]
 79%|███████▉  | 293749/371472 [1:12:31<7:37:27,  2.83it/s]
 79%|███████▉  | 293750/371472 [1:12:31<6:59:46,  3.09it/s]
 79%|███████▉  | 293751/371472 [1:12:32<6:39:28,  3.24it/s]
 79%|███████▉  | 293752/371472 [1:12:32<6:37:33,  3.26it/s]
 79%|███████▉  | 293753/371472 [1:12:32<6:09:52,  3.50it/s]
 79%|███████▉  | 293754/371472 [1:12:33<6:03:07,  3.57it/s]
 79%|███████▉  | 293755/371472 [1:12:33<5:50:22,  3.70it/s]
 79%|███████▉  | 293756/371472 [1:12:33<5:41:18,  3.79it/s]
 79%|███████▉  | 293757/371472 [1:12:33<6:00:23,  3.59it/s]
 79%|███████▉  | 293758/371472 [1:12:34<5:54:16,  3.66it/s]
 79%|███████▉  | 293759/371472 [1:12:34<5:43:38,  3.77it/s]
 79%|███████▉  | 293760/371472 [1:12:34<5:50:59,  3.69it/s]
                                                           
{'loss': 2.656, 'learning_rate': 2.8838156392079125e-07, 'epoch': 12.65}

 79%|███████▉  | 293760/371472 [1:12:34<5:50:59,  3.69it/s]
 79%|███████▉  | 293761/371472 [1:12:34<5:45:44,  3.75it/s]
 79%|███████▉  | 293762/371472 [1:12:35<5:44:22,  3.76it/s]
 79%|███████▉  | 293763/371472 [1:12:35<5:55:41,  3.64it/s]
 79%|███████▉  | 293764/371472 [1:12:35<6:05:53,  3.54it/s]
 79%|███████▉  | 293765/371472 [1:12:35<5:58:58,  3.61it/s]
 79%|███████▉  | 293766/371472 [1:12:36<5:59:18,  3.60it/s]
 79%|███████▉  | 293767/371472 [1:12:36<5:57:04,  3.63it/s]
 79%|███████▉  | 293768/371472 [1:12:36<6:14:40,  3.46it/s]
 79%|███████▉  | 293769/371472 [1:12:37<6:34:24,  3.28it/s]
 79%|███████▉  | 293770/371472 [1:12:37<6:29:11,  3.33it/s]
 79%|███████▉  | 293771/371472 [1:12:37<6:11:48,  3.48it/s]
 79%|███████▉  | 293772/371472 [1:12:38<6:08:10,  3.52it/s]
 79%|███████▉  | 293773/371472 [1:12:38<6:02:01,  3.58it/s]
 79%|███████▉  | 293774/371472 [1:12:38<6:07:00,  3.53it/s]
 79%|███████▉  | 293775/371472 [1:12:38<5:59:35,  3.60it/s]
 79%|███████▉  | 293776/371472 [1:12:39<6:10:52,  3.49it/s]
 79%|███████▉  | 293777/371472 [1:12:39<5:51:03,  3.69it/s]
 79%|███████▉  | 293778/371472 [1:12:39<6:08:05,  3.52it/s]
 79%|███████▉  | 293779/371472 [1:12:39<6:11:25,  3.49it/s]
 79%|███████▉  | 293780/371472 [1:12:40<6:18:18,  3.42it/s]
                                                           
{'loss': 2.5881, 'learning_rate': 2.883330819453123e-07, 'epoch': 12.65}

 79%|███████▉  | 293780/371472 [1:12:40<6:18:18,  3.42it/s]
 79%|███████▉  | 293781/371472 [1:12:40<6:22:37,  3.38it/s]
 79%|███████▉  | 293782/371472 [1:12:40<6:11:11,  3.49it/s]
 79%|███████▉  | 293783/371472 [1:12:41<6:05:52,  3.54it/s]
 79%|███████▉  | 293784/371472 [1:12:41<5:49:15,  3.71it/s]
 79%|███████▉  | 293785/371472 [1:12:41<5:56:11,  3.64it/s]
 79%|███████▉  | 293786/371472 [1:12:41<6:03:10,  3.57it/s]
 79%|███████▉  | 293787/371472 [1:12:42<6:08:12,  3.52it/s]
 79%|███████▉  | 293788/371472 [1:12:42<6:02:07,  3.58it/s]
 79%|███████▉  | 293789/371472 [1:12:42<6:08:44,  3.51it/s]
 79%|███████▉  | 293790/371472 [1:12:43<6:19:42,  3.41it/s]
 79%|███████▉  | 293791/371472 [1:12:43<6:21:22,  3.39it/s]
 79%|███████▉  | 293792/371472 [1:12:43<6:09:36,  3.50it/s]
 79%|███████▉  | 293793/371472 [1:12:43<6:09:29,  3.50it/s]
 79%|███████▉  | 293794/371472 [1:12:44<6:05:00,  3.55it/s]
 79%|███████▉  | 293795/371472 [1:12:44<5:58:54,  3.61it/s]
 79%|███████▉  | 293796/371472 [1:12:44<5:58:32,  3.61it/s]
 79%|███████▉  | 293797/371472 [1:12:45<6:05:41,  3.54it/s]
 79%|███████▉  | 293798/371472 [1:12:45<6:07:02,  3.53it/s]
 79%|███████▉  | 293799/371472 [1:12:45<6:28:32,  3.33it/s]
 79%|███████▉  | 293800/371472 [1:12:46<6:22:47,  3.38it/s]
                                                           
{'loss': 2.6702, 'learning_rate': 2.8828459996983334e-07, 'epoch': 12.65}

 79%|███████▉  | 293800/371472 [1:12:46<6:22:47,  3.38it/s]
 79%|███████▉  | 293801/371472 [1:12:46<6:36:15,  3.27it/s]
 79%|███████▉  | 293802/371472 [1:12:46<6:21:49,  3.39it/s]
 79%|███████▉  | 293803/371472 [1:12:46<6:19:13,  3.41it/s]
 79%|███████▉  | 293804/371472 [1:12:47<6:09:20,  3.50it/s]
 79%|███████▉  | 293805/371472 [1:12:47<6:13:18,  3.47it/s]
 79%|███████▉  | 293806/371472 [1:12:47<6:11:22,  3.49it/s]
 79%|███████▉  | 293807/371472 [1:12:48<6:06:07,  3.54it/s]
 79%|███████▉  | 293808/371472 [1:12:48<6:08:42,  3.51it/s]
 79%|███████▉  | 293809/371472 [1:12:48<6:33:20,  3.29it/s]
 79%|███████▉  | 293810/371472 [1:12:49<7:26:32,  2.90it/s]
 79%|███████▉  | 293811/371472 [1:12:49<7:33:28,  2.85it/s]
 79%|███████▉  | 293812/371472 [1:12:49<6:55:33,  3.11it/s]
 79%|███████▉  | 293813/371472 [1:12:49<6:37:05,  3.26it/s]
 79%|███████▉  | 293814/371472 [1:12:50<6:22:50,  3.38it/s]
 79%|███████▉  | 293815/371472 [1:12:50<6:04:03,  3.56it/s]
 79%|███████▉  | 293816/371472 [1:12:50<5:52:23,  3.67it/s]
 79%|███████▉  | 293817/371472 [1:12:51<5:48:12,  3.72it/s]
 79%|███████▉  | 293818/371472 [1:12:51<5:55:53,  3.64it/s]
 79%|███████▉  | 293819/371472 [1:12:51<6:05:12,  3.54it/s]
 79%|███████▉  | 293820/371472 [1:12:51<6:09:25,  3.50it/s]
                                                           
{'loss': 2.6164, 'learning_rate': 2.882361179943545e-07, 'epoch': 12.66}

 79%|███████▉  | 293820/371472 [1:12:51<6:09:25,  3.50it/s]
 79%|███████▉  | 293821/371472 [1:12:52<6:04:55,  3.55it/s]
 79%|███████▉  | 293822/371472 [1:12:52<5:55:32,  3.64it/s]
 79%|███████▉  | 293823/371472 [1:12:52<6:21:20,  3.39it/s]
 79%|███████▉  | 293824/371472 [1:12:53<6:17:50,  3.43it/s]
 79%|███████▉  | 293825/371472 [1:12:53<6:42:34,  3.21it/s]
 79%|███████▉  | 293826/371472 [1:12:53<6:33:23,  3.29it/s]
 79%|███████▉  | 293827/371472 [1:12:53<6:19:12,  3.41it/s]
 79%|███████▉  | 293828/371472 [1:12:54<6:24:39,  3.36it/s]
 79%|███████▉  | 293829/371472 [1:12:54<6:14:42,  3.45it/s]
 79%|███████▉  | 293830/371472 [1:12:54<5:58:49,  3.61it/s]
 79%|███████▉  | 293831/371472 [1:12:55<5:55:42,  3.64it/s]
 79%|███████▉  | 293832/371472 [1:12:55<6:01:50,  3.58it/s]
 79%|███████▉  | 293833/371472 [1:12:55<6:08:57,  3.51it/s]
 79%|███████▉  | 293834/371472 [1:12:55<6:06:24,  3.53it/s]
 79%|███████▉  | 293835/371472 [1:12:56<6:00:57,  3.58it/s]
 79%|███████▉  | 293836/371472 [1:12:56<6:05:08,  3.54it/s]
 79%|███████▉  | 293837/371472 [1:12:56<6:14:06,  3.46it/s]
 79%|███████▉  | 293838/371472 [1:12:57<6:06:03,  3.53it/s]
 79%|███████▉  | 293839/371472 [1:12:57<5:48:16,  3.72it/s]
 79%|███████▉  | 293840/371472 [1:12:57<5:57:02,  3.62it/s]
                                                           
{'loss': 2.7417, 'learning_rate': 2.881876360188756e-07, 'epoch': 12.66}

 79%|███████▉  | 293840/371472 [1:12:57<5:57:02,  3.62it/s]
 79%|███████▉  | 293841/371472 [1:12:57<5:57:39,  3.62it/s]
 79%|███████▉  | 293842/371472 [1:12:58<6:07:36,  3.52it/s]
 79%|███████▉  | 293843/371472 [1:12:58<6:15:03,  3.45it/s]
 79%|███████▉  | 293844/371472 [1:12:58<6:21:43,  3.39it/s]
 79%|███████▉  | 293845/371472 [1:12:59<6:15:57,  3.44it/s]
 79%|███████▉  | 293846/371472 [1:12:59<6:08:58,  3.51it/s]
 79%|███████▉  | 293847/371472 [1:12:59<6:22:48,  3.38it/s]
 79%|███████▉  | 293848/371472 [1:12:59<6:08:33,  3.51it/s]
 79%|███████▉  | 293849/371472 [1:13:00<6:05:04,  3.54it/s]
 79%|███████▉  | 293850/371472 [1:13:00<6:07:44,  3.52it/s]
 79%|███████▉  | 293851/371472 [1:13:00<6:18:57,  3.41it/s]
 79%|███████▉  | 293852/371472 [1:13:01<6:38:16,  3.25it/s]
 79%|███████▉  | 293853/371472 [1:13:01<6:13:29,  3.46it/s]
 79%|███████▉  | 293854/371472 [1:13:01<6:20:48,  3.40it/s]
 79%|███████▉  | 293855/371472 [1:13:01<6:09:25,  3.50it/s]
 79%|███████▉  | 293856/371472 [1:13:02<6:48:02,  3.17it/s]
 79%|███████▉  | 293857/371472 [1:13:02<6:46:38,  3.18it/s]
 79%|███████▉  | 293858/371472 [1:13:02<6:25:49,  3.35it/s]
 79%|███████▉  | 293859/371472 [1:13:03<7:00:26,  3.08it/s]
 79%|███████▉  | 293860/371472 [1:13:03<6:51:07,  3.15it/s]
                                                           
{'loss': 2.7723, 'learning_rate': 2.8813915404339677e-07, 'epoch': 12.66}

 79%|███████▉  | 293860/371472 [1:13:03<6:51:07,  3.15it/s]
 79%|███████▉  | 293861/371472 [1:13:03<6:39:04,  3.24it/s]
 79%|███████▉  | 293862/371472 [1:13:04<6:27:08,  3.34it/s]
 79%|███████▉  | 293863/371472 [1:13:04<6:45:49,  3.19it/s]
 79%|███████▉  | 293864/371472 [1:13:04<6:34:00,  3.28it/s]
 79%|███████▉  | 293865/371472 [1:13:05<6:27:13,  3.34it/s]
 79%|███████▉  | 293866/371472 [1:13:05<6:20:48,  3.40it/s]
 79%|███████▉  | 293867/371472 [1:13:05<6:06:25,  3.53it/s]
 79%|███████▉  | 293868/371472 [1:13:05<6:06:01,  3.53it/s]
 79%|███████▉  | 293869/371472 [1:13:06<6:35:52,  3.27it/s]
 79%|███████▉  | 293870/371472 [1:13:06<6:31:43,  3.30it/s]
 79%|███████▉  | 293871/371472 [1:13:06<6:26:28,  3.35it/s]
 79%|███████▉  | 293872/371472 [1:13:07<6:18:15,  3.42it/s]
 79%|███████▉  | 293873/371472 [1:13:07<6:51:15,  3.14it/s]
 79%|███████▉  | 293874/371472 [1:13:07<6:32:51,  3.29it/s]
 79%|███████▉  | 293875/371472 [1:13:08<6:25:29,  3.35it/s]
 79%|███████▉  | 293876/371472 [1:13:08<6:16:22,  3.44it/s]
 79%|███████▉  | 293877/371472 [1:13:08<5:58:33,  3.61it/s]
 79%|███████▉  | 293878/371472 [1:13:08<6:22:30,  3.38it/s]
 79%|███████▉  | 293879/371472 [1:13:09<6:04:22,  3.55it/s]
 79%|███████▉  | 293880/371472 [1:13:09<5:53:47,  3.66it/s]
                                                           
{'loss': 2.6107, 'learning_rate': 2.8809067206791784e-07, 'epoch': 12.66}

 79%|███████▉  | 293880/371472 [1:13:09<5:53:47,  3.66it/s]
 79%|███████▉  | 293881/371472 [1:13:09<5:45:16,  3.75it/s]
 79%|███████▉  | 293882/371472 [1:13:09<6:03:33,  3.56it/s]
 79%|███████▉  | 293883/371472 [1:13:10<6:08:23,  3.51it/s]
 79%|███████▉  | 293884/371472 [1:13:10<5:53:47,  3.65it/s]
 79%|███████▉  | 293885/371472 [1:13:10<6:10:25,  3.49it/s]
 79%|███████▉  | 293886/371472 [1:13:11<6:02:22,  3.57it/s]
 79%|███████▉  | 293887/371472 [1:13:11<5:58:45,  3.60it/s]
 79%|███████▉  | 293888/371472 [1:13:11<5:54:31,  3.65it/s]
 79%|███████▉  | 293889/371472 [1:13:11<6:00:49,  3.58it/s]
 79%|███████▉  | 293890/371472 [1:13:12<6:04:33,  3.55it/s]
 79%|███████▉  | 293891/371472 [1:13:12<5:56:12,  3.63it/s]
 79%|███████▉  | 293892/371472 [1:13:12<5:51:13,  3.68it/s]
 79%|███████▉  | 293893/371472 [1:13:12<5:38:08,  3.82it/s]
 79%|███████▉  | 293894/371472 [1:13:13<5:41:45,  3.78it/s]
 79%|███████▉  | 293895/371472 [1:13:13<5:48:25,  3.71it/s]
 79%|███████▉  | 293896/371472 [1:13:13<5:57:47,  3.61it/s]
 79%|███████▉  | 293897/371472 [1:13:14<5:49:56,  3.69it/s]
 79%|███████▉  | 293898/371472 [1:13:14<5:47:20,  3.72it/s]
 79%|███████▉  | 293899/371472 [1:13:14<5:39:41,  3.81it/s]
 79%|███████▉  | 293900/371472 [1:13:14<5:50:21,  3.69it/s]
                                                           
{'loss': 2.7768, 'learning_rate': 2.8804219009243896e-07, 'epoch': 12.66}

 79%|███████▉  | 293900/371472 [1:13:14<5:50:21,  3.69it/s]
 79%|███████▉  | 293901/371472 [1:13:15<5:57:10,  3.62it/s]
 79%|███████▉  | 293902/371472 [1:13:15<5:53:48,  3.65it/s]
 79%|███████▉  | 293903/371472 [1:13:15<5:50:35,  3.69it/s]
 79%|███████▉  | 293904/371472 [1:13:15<5:45:58,  3.74it/s]
 79%|███████▉  | 293905/371472 [1:13:16<5:45:17,  3.74it/s]
 79%|███████▉  | 293906/371472 [1:13:16<5:50:28,  3.69it/s]
 79%|███████▉  | 293907/371472 [1:13:16<6:00:14,  3.59it/s]
 79%|███████▉  | 293908/371472 [1:13:17<6:39:00,  3.24it/s]
 79%|███████▉  | 293909/371472 [1:13:17<6:34:14,  3.28it/s]
 79%|███████▉  | 293910/371472 [1:13:17<6:27:20,  3.34it/s]
 79%|███████▉  | 293911/371472 [1:13:18<6:18:39,  3.41it/s]
 79%|███████▉  | 293912/371472 [1:13:18<6:17:36,  3.42it/s]
 79%|███████▉  | 293913/371472 [1:13:18<6:33:07,  3.29it/s]
 79%|███████▉  | 293914/371472 [1:13:18<6:20:01,  3.40it/s]
 79%|███████▉  | 293915/371472 [1:13:19<6:22:25,  3.38it/s]
 79%|███████▉  | 293916/371472 [1:13:19<6:12:05,  3.47it/s]
 79%|███████▉  | 293917/371472 [1:13:19<6:03:29,  3.56it/s]
 79%|███████▉  | 293918/371472 [1:13:20<6:26:03,  3.35it/s]
 79%|███████▉  | 293919/371472 [1:13:20<6:22:42,  3.38it/s]
 79%|███████▉  | 293920/371472 [1:13:20<6:22:23,  3.38it/s]
                                                           
{'loss': 2.6019, 'learning_rate': 2.8799370811696003e-07, 'epoch': 12.66}

 79%|███████▉  | 293920/371472 [1:13:20<6:22:23,  3.38it/s]
 79%|███████▉  | 293921/371472 [1:13:21<6:41:41,  3.22it/s]
 79%|███████▉  | 293922/371472 [1:13:21<6:34:46,  3.27it/s]
 79%|███████▉  | 293923/371472 [1:13:21<6:19:16,  3.41it/s]
 79%|███████▉  | 293924/371472 [1:13:21<6:08:54,  3.50it/s]
 79%|███████▉  | 293925/371472 [1:13:22<5:57:01,  3.62it/s]
 79%|███████▉  | 293926/371472 [1:13:22<6:18:10,  3.42it/s]
 79%|███████▉  | 293927/371472 [1:13:22<6:10:01,  3.49it/s]
 79%|███████▉  | 293928/371472 [1:13:22<5:59:57,  3.59it/s]
 79%|███████▉  | 293929/371472 [1:13:23<6:03:41,  3.55it/s]
 79%|███████▉  | 293930/371472 [1:13:23<5:53:08,  3.66it/s]
 79%|███████▉  | 293931/371472 [1:13:23<6:03:28,  3.56it/s]
 79%|███████▉  | 293932/371472 [1:13:24<6:26:44,  3.34it/s]
 79%|███████▉  | 293933/371472 [1:13:24<6:12:02,  3.47it/s]
 79%|███████▉  | 293934/371472 [1:13:24<5:52:58,  3.66it/s]
 79%|███████▉  | 293935/371472 [1:13:24<5:54:02,  3.65it/s]
 79%|███████▉  | 293936/371472 [1:13:25<6:02:16,  3.57it/s]
 79%|███████▉  | 293937/371472 [1:13:25<6:04:00,  3.55it/s]
 79%|███████▉  | 293938/371472 [1:13:25<6:24:53,  3.36it/s]
 79%|███████▉  | 293939/371472 [1:13:26<6:40:41,  3.22it/s]
 79%|███████▉  | 293940/371472 [1:13:26<6:24:41,  3.36it/s]
                                                           
{'loss': 2.6657, 'learning_rate': 2.8794522614148116e-07, 'epoch': 12.66}

 79%|███████▉  | 293940/371472 [1:13:26<6:24:41,  3.36it/s]
 79%|███████▉  | 293941/371472 [1:13:26<6:32:41,  3.29it/s]
 79%|███████▉  | 293942/371472 [1:13:27<6:29:25,  3.32it/s]
 79%|███████▉  | 293943/371472 [1:13:27<6:30:20,  3.31it/s]
 79%|███████▉  | 293944/371472 [1:13:27<6:24:20,  3.36it/s]
 79%|███████▉  | 293945/371472 [1:13:27<6:09:46,  3.49it/s]
 79%|███████▉  | 293946/371472 [1:13:28<6:23:25,  3.37it/s]
 79%|███████▉  | 293947/371472 [1:13:28<6:14:58,  3.45it/s]
 79%|███████▉  | 293948/371472 [1:13:28<6:06:14,  3.53it/s]
 79%|███████▉  | 293949/371472 [1:13:29<6:11:29,  3.48it/s]
 79%|███████▉  | 293950/371472 [1:13:29<5:58:52,  3.60it/s]
 79%|███████▉  | 293951/371472 [1:13:29<5:56:34,  3.62it/s]
 79%|███████▉  | 293952/371472 [1:13:29<6:04:18,  3.55it/s]
 79%|███████▉  | 293953/371472 [1:13:30<5:58:46,  3.60it/s]
 79%|███████▉  | 293954/371472 [1:13:30<6:39:59,  3.23it/s]
 79%|███████▉  | 293955/371472 [1:13:30<6:37:55,  3.25it/s]
 79%|███████▉  | 293956/371472 [1:13:31<6:46:29,  3.18it/s]
 79%|███████▉  | 293957/371472 [1:13:31<6:45:31,  3.19it/s]
 79%|███████▉  | 293958/371472 [1:13:31<6:34:53,  3.27it/s]
 79%|███████▉  | 293959/371472 [1:13:32<6:38:13,  3.24it/s]
 79%|███████▉  | 293960/371472 [1:13:32<6:12:39,  3.47it/s]
                                                           
{'loss': 2.5644, 'learning_rate': 2.8789674416600223e-07, 'epoch': 12.66}

 79%|███████▉  | 293960/371472 [1:13:32<6:12:39,  3.47it/s]
 79%|███████▉  | 293961/371472 [1:13:32<5:59:45,  3.59it/s]
 79%|███████▉  | 293962/371472 [1:13:32<5:44:53,  3.75it/s]
 79%|███████▉  | 293963/371472 [1:13:33<5:46:38,  3.73it/s]
 79%|███████▉  | 293964/371472 [1:13:33<5:37:42,  3.83it/s]
 79%|███████▉  | 293965/371472 [1:13:33<5:39:04,  3.81it/s]
 79%|███████▉  | 293966/371472 [1:13:33<5:38:58,  3.81it/s]
 79%|███████▉  | 293967/371472 [1:13:34<5:49:10,  3.70it/s]
 79%|███████▉  | 293968/371472 [1:13:34<6:01:51,  3.57it/s]
 79%|███████▉  | 293969/371472 [1:13:34<5:53:10,  3.66it/s]
 79%|███████▉  | 293970/371472 [1:13:35<6:13:19,  3.46it/s]
 79%|███████▉  | 293971/371472 [1:13:35<6:02:34,  3.56it/s]
 79%|███████▉  | 293972/371472 [1:13:35<6:09:25,  3.50it/s]
 79%|███████▉  | 293973/371472 [1:13:35<5:51:05,  3.68it/s]
 79%|███████▉  | 293974/371472 [1:13:36<5:43:10,  3.76it/s]
 79%|███████▉  | 293975/371472 [1:13:36<5:54:20,  3.65it/s]
 79%|███████▉  | 293976/371472 [1:13:36<5:57:06,  3.62it/s]
 79%|███████▉  | 293977/371472 [1:13:37<6:14:15,  3.45it/s]
 79%|███████▉  | 293978/371472 [1:13:37<6:04:10,  3.55it/s]
 79%|███████▉  | 293979/371472 [1:13:37<5:56:19,  3.62it/s]
 79%|███████▉  | 293980/371472 [1:13:37<5:46:20,  3.73it/s]
                                                           
{'loss': 2.6796, 'learning_rate': 2.878482621905234e-07, 'epoch': 12.66}

 79%|███████▉  | 293980/371472 [1:13:37<5:46:20,  3.73it/s]
 79%|███████▉  | 293981/371472 [1:13:38<5:44:48,  3.75it/s]
 79%|███████▉  | 293982/371472 [1:13:38<5:44:09,  3.75it/s]
 79%|███████▉  | 293983/371472 [1:13:38<5:50:02,  3.69it/s]
 79%|███████▉  | 293984/371472 [1:13:38<5:52:30,  3.66it/s]
 79%|███████▉  | 293985/371472 [1:13:39<5:54:24,  3.64it/s]
 79%|███████▉  | 293986/371472 [1:13:39<5:44:31,  3.75it/s]
 79%|███████▉  | 293987/371472 [1:13:39<5:49:34,  3.69it/s]
 79%|███████▉  | 293988/371472 [1:13:39<5:44:12,  3.75it/s]
 79%|███████▉  | 293989/371472 [1:13:40<5:45:30,  3.74it/s]
 79%|███████▉  | 293990/371472 [1:13:40<5:50:38,  3.68it/s]
 79%|███████▉  | 293991/371472 [1:13:40<5:50:07,  3.69it/s]
 79%|███████▉  | 293992/371472 [1:13:41<5:50:10,  3.69it/s]
 79%|███████▉  | 293993/371472 [1:13:41<5:44:02,  3.75it/s]
 79%|███████▉  | 293994/371472 [1:13:41<5:37:31,  3.83it/s]
 79%|███████▉  | 293995/371472 [1:13:41<6:01:53,  3.57it/s]
 79%|███████▉  | 293996/371472 [1:13:42<6:01:20,  3.57it/s]
 79%|███████▉  | 293997/371472 [1:13:42<6:14:56,  3.44it/s]
 79%|███████▉  | 293998/371472 [1:13:42<6:00:02,  3.59it/s]
 79%|███████▉  | 293999/371472 [1:13:43<6:18:00,  3.42it/s]
 79%|███████▉  | 294000/371472 [1:13:43<6:24:14,  3.36it/s]
                                                           
{'loss': 2.614, 'learning_rate': 2.877997802150445e-07, 'epoch': 12.66}

 79%|███████▉  | 294000/371472 [1:13:43<6:24:14,  3.36it/s]
 79%|███████▉  | 294001/371472 [1:13:43<6:09:36,  3.49it/s]
 79%|███████▉  | 294002/371472 [1:13:43<5:58:13,  3.60it/s]
 79%|███████▉  | 294003/371472 [1:13:44<5:46:58,  3.72it/s]
 79%|███████▉  | 294004/371472 [1:13:44<5:45:44,  3.73it/s]
 79%|███████▉  | 294005/371472 [1:13:44<6:13:58,  3.45it/s]
 79%|███████▉  | 294006/371472 [1:13:45<6:14:59,  3.44it/s]
 79%|███████▉  | 294007/371472 [1:13:45<6:05:12,  3.54it/s]
 79%|███████▉  | 294008/371472 [1:13:45<6:09:49,  3.49it/s]
 79%|███████▉  | 294009/371472 [1:13:45<6:05:22,  3.53it/s]
 79%|███████▉  | 294010/371472 [1:13:46<5:50:52,  3.68it/s]
 79%|███████▉  | 294011/371472 [1:13:46<6:18:41,  3.41it/s]
 79%|███████▉  | 294012/371472 [1:13:46<6:31:51,  3.29it/s]
 79%|███████▉  | 294013/371472 [1:13:47<6:28:22,  3.32it/s]
 79%|███████▉  | 294014/371472 [1:13:47<6:20:53,  3.39it/s]
 79%|███████▉  | 294015/371472 [1:13:47<6:22:09,  3.38it/s]
 79%|███████▉  | 294016/371472 [1:13:47<6:21:42,  3.38it/s]
 79%|███████▉  | 294017/371472 [1:13:48<6:42:27,  3.21it/s]
 79%|███████▉  | 294018/371472 [1:13:48<6:35:36,  3.26it/s]
 79%|███████▉  | 294019/371472 [1:13:48<6:20:16,  3.39it/s]
 79%|███████▉  | 294020/371472 [1:13:49<6:03:13,  3.55it/s]
                                                           
{'loss': 2.5702, 'learning_rate': 2.877512982395656e-07, 'epoch': 12.66}

 79%|███████▉  | 294020/371472 [1:13:49<6:03:13,  3.55it/s]
 79%|███████▉  | 294021/371472 [1:13:49<6:14:22,  3.45it/s]
 79%|███████▉  | 294022/371472 [1:13:49<6:27:33,  3.33it/s]
 79%|███████▉  | 294023/371472 [1:13:50<6:51:14,  3.14it/s]
 79%|███████▉  | 294024/371472 [1:13:50<6:46:15,  3.18it/s]
 79%|███████▉  | 294025/371472 [1:13:50<6:24:33,  3.36it/s]
 79%|███████▉  | 294026/371472 [1:13:50<6:16:48,  3.43it/s]
 79%|███████▉  | 294027/371472 [1:13:51<6:24:55,  3.35it/s]
 79%|███████▉  | 294028/371472 [1:13:51<6:12:19,  3.47it/s]
 79%|███████▉  | 294029/371472 [1:13:51<6:00:56,  3.58it/s]
 79%|███████▉  | 294030/371472 [1:13:52<5:55:48,  3.63it/s]
 79%|███████▉  | 294031/371472 [1:13:52<6:12:12,  3.47it/s]
 79%|███████▉  | 294032/371472 [1:13:52<6:02:10,  3.56it/s]
 79%|███████▉  | 294033/371472 [1:13:52<6:17:26,  3.42it/s]
 79%|███████▉  | 294034/371472 [1:13:53<6:17:41,  3.42it/s]
 79%|███████▉  | 294035/371472 [1:13:53<6:02:34,  3.56it/s]
 79%|███████▉  | 294036/371472 [1:13:53<6:25:08,  3.35it/s]
 79%|███████▉  | 294037/371472 [1:13:54<6:10:27,  3.48it/s]
 79%|███████▉  | 294038/371472 [1:13:54<6:07:47,  3.51it/s]
 79%|███████▉  | 294039/371472 [1:13:54<5:58:38,  3.60it/s]
 79%|███████▉  | 294040/371472 [1:13:54<6:03:31,  3.55it/s]
                                                           
{'loss': 2.5226, 'learning_rate': 2.877028162640867e-07, 'epoch': 12.66}

 79%|███████▉  | 294040/371472 [1:13:54<6:03:31,  3.55it/s]
 79%|███████▉  | 294041/371472 [1:13:55<6:25:56,  3.34it/s]
 79%|███████▉  | 294042/371472 [1:13:55<6:10:23,  3.48it/s]
 79%|███████▉  | 294043/371472 [1:13:55<6:32:16,  3.29it/s]
 79%|███████▉  | 294044/371472 [1:13:56<6:17:30,  3.42it/s]
 79%|███████▉  | 294045/371472 [1:13:56<6:25:51,  3.34it/s]
 79%|███████▉  | 294046/371472 [1:13:56<6:52:43,  3.13it/s]
 79%|███████▉  | 294047/371472 [1:13:57<6:39:53,  3.23it/s]
 79%|███████▉  | 294048/371472 [1:13:57<7:06:36,  3.02it/s]
 79%|███████▉  | 294049/371472 [1:13:57<7:21:33,  2.92it/s]
 79%|███████▉  | 294050/371472 [1:13:58<6:56:39,  3.10it/s]
 79%|███████▉  | 294051/371472 [1:13:58<6:41:15,  3.22it/s]
 79%|███████▉  | 294052/371472 [1:13:58<6:24:34,  3.36it/s]
 79%|███████▉  | 294053/371472 [1:13:58<6:15:29,  3.44it/s]
 79%|███████▉  | 294054/371472 [1:13:59<6:07:28,  3.51it/s]
 79%|███████▉  | 294055/371472 [1:13:59<5:54:38,  3.64it/s]
 79%|███████▉  | 294056/371472 [1:13:59<5:53:14,  3.65it/s]
 79%|███████▉  | 294057/371472 [1:13:59<5:37:21,  3.82it/s]
 79%|███████▉  | 294058/371472 [1:14:00<5:58:41,  3.60it/s]
 79%|███████▉  | 294059/371472 [1:14:00<5:49:09,  3.70it/s]
 79%|███████▉  | 294060/371472 [1:14:00<5:57:18,  3.61it/s]
                                                           
{'loss': 2.5579, 'learning_rate': 2.876543342886078e-07, 'epoch': 12.67}

 79%|███████▉  | 294060/371472 [1:14:00<5:57:18,  3.61it/s]
 79%|███████▉  | 294061/371472 [1:14:01<5:43:15,  3.76it/s]
 79%|███████▉  | 294062/371472 [1:14:01<5:42:15,  3.77it/s]
 79%|███████▉  | 294063/371472 [1:14:01<5:44:07,  3.75it/s]
 79%|███████▉  | 294064/371472 [1:14:01<5:49:19,  3.69it/s]
 79%|███████▉  | 294065/371472 [1:14:02<5:54:27,  3.64it/s]
 79%|███████▉  | 294066/371472 [1:14:02<6:50:28,  3.14it/s]
 79%|███████▉  | 294067/371472 [1:14:02<6:25:34,  3.35it/s]
 79%|███████▉  | 294068/371472 [1:14:03<6:07:20,  3.51it/s]
 79%|███████▉  | 294069/371472 [1:14:03<5:51:35,  3.67it/s]
 79%|███████▉  | 294070/371472 [1:14:03<5:47:16,  3.71it/s]
 79%|███████▉  | 294071/371472 [1:14:03<5:39:16,  3.80it/s]
 79%|███████▉  | 294072/371472 [1:14:04<5:52:36,  3.66it/s]
 79%|███████▉  | 294073/371472 [1:14:04<5:53:47,  3.65it/s]
 79%|███████▉  | 294074/371472 [1:14:04<5:40:15,  3.79it/s]
 79%|███████▉  | 294075/371472 [1:14:04<5:43:50,  3.75it/s]
 79%|███████▉  | 294076/371472 [1:14:05<5:51:03,  3.67it/s]
 79%|███████▉  | 294077/371472 [1:14:05<5:46:23,  3.72it/s]
 79%|███████▉  | 294078/371472 [1:14:05<5:45:12,  3.74it/s]
 79%|███████▉  | 294079/371472 [1:14:06<5:56:46,  3.62it/s]
 79%|███████▉  | 294080/371472 [1:14:06<6:11:50,  3.47it/s]
                                                           
{'loss': 2.5395, 'learning_rate': 2.8760585231312887e-07, 'epoch': 12.67}

 79%|███████▉  | 294080/371472 [1:14:06<6:11:50,  3.47it/s]
 79%|███████▉  | 294081/371472 [1:14:06<6:02:42,  3.56it/s]
 79%|███████▉  | 294082/371472 [1:14:06<6:01:39,  3.57it/s]
 79%|███████▉  | 294083/371472 [1:14:07<5:53:27,  3.65it/s]
 79%|███████▉  | 294084/371472 [1:14:07<5:51:21,  3.67it/s]
 79%|███████▉  | 294085/371472 [1:14:07<5:45:22,  3.73it/s]
 79%|███████▉  | 294086/371472 [1:14:07<5:50:10,  3.68it/s]
 79%|███████▉  | 294087/371472 [1:14:08<5:48:20,  3.70it/s]
 79%|███████▉  | 294088/371472 [1:14:08<6:08:02,  3.50it/s]
 79%|███████▉  | 294089/371472 [1:14:08<6:03:09,  3.55it/s]
 79%|███████▉  | 294090/371472 [1:14:09<5:52:44,  3.66it/s]
 79%|███████▉  | 294091/371472 [1:14:09<5:46:59,  3.72it/s]
 79%|███████▉  | 294092/371472 [1:14:09<5:44:40,  3.74it/s]
 79%|███████▉  | 294093/371472 [1:14:09<5:45:16,  3.74it/s]
 79%|███████▉  | 294094/371472 [1:14:10<5:42:01,  3.77it/s]
 79%|███████▉  | 294095/371472 [1:14:10<6:09:13,  3.49it/s]
 79%|███████▉  | 294096/371472 [1:14:10<6:09:48,  3.49it/s]
 79%|███████▉  | 294097/371472 [1:14:11<6:09:17,  3.49it/s]
 79%|███████▉  | 294098/371472 [1:14:11<5:55:29,  3.63it/s]
 79%|███████▉  | 294099/371472 [1:14:11<6:15:48,  3.43it/s]
 79%|███████▉  | 294100/371472 [1:14:11<6:14:52,  3.44it/s]
                                                           
{'loss': 2.7392, 'learning_rate': 2.8755737033765005e-07, 'epoch': 12.67}

 79%|███████▉  | 294100/371472 [1:14:11<6:14:52,  3.44it/s]
 79%|███████▉  | 294101/371472 [1:14:12<6:07:31,  3.51it/s]
 79%|███████▉  | 294102/371472 [1:14:12<6:02:40,  3.56it/s]
 79%|███████▉  | 294103/371472 [1:14:12<6:07:13,  3.51it/s]
 79%|███████▉  | 294104/371472 [1:14:13<6:21:01,  3.38it/s]
 79%|███████▉  | 294105/371472 [1:14:13<6:27:50,  3.32it/s]
 79%|███████▉  | 294106/371472 [1:14:13<6:14:42,  3.44it/s]
 79%|███████▉  | 294107/371472 [1:14:13<6:04:13,  3.54it/s]
 79%|███████▉  | 294108/371472 [1:14:14<6:13:53,  3.45it/s]
 79%|███████▉  | 294109/371472 [1:14:14<6:12:14,  3.46it/s]
 79%|███████▉  | 294110/371472 [1:14:14<6:30:09,  3.30it/s]
 79%|███████▉  | 294111/371472 [1:14:15<6:08:50,  3.50it/s]
 79%|███████▉  | 294112/371472 [1:14:15<6:00:10,  3.58it/s]
 79%|███████▉  | 294113/371472 [1:14:15<5:55:17,  3.63it/s]
 79%|███████▉  | 294114/371472 [1:14:15<6:06:39,  3.52it/s]
 79%|███████▉  | 294115/371472 [1:14:16<6:07:32,  3.51it/s]
 79%|███████▉  | 294116/371472 [1:14:16<6:26:47,  3.33it/s]
 79%|███████▉  | 294117/371472 [1:14:16<6:47:17,  3.17it/s]
 79%|███████▉  | 294118/371472 [1:14:17<7:03:48,  3.04it/s]
 79%|███████▉  | 294119/371472 [1:14:17<6:45:58,  3.18it/s]
 79%|███████▉  | 294120/371472 [1:14:17<6:38:22,  3.24it/s]
                                                           
{'loss': 2.6625, 'learning_rate': 2.875088883621711e-07, 'epoch': 12.67}

 79%|███████▉  | 294120/371472 [1:14:17<6:38:22,  3.24it/s]
 79%|███████▉  | 294121/371472 [1:14:18<6:16:21,  3.43it/s]
 79%|███████▉  | 294122/371472 [1:14:18<6:20:17,  3.39it/s]
 79%|███████▉  | 294123/371472 [1:14:18<6:06:05,  3.52it/s]
 79%|███████▉  | 294124/371472 [1:14:18<6:04:47,  3.53it/s]
 79%|███████▉  | 294125/371472 [1:14:19<6:31:49,  3.29it/s]
 79%|███████▉  | 294126/371472 [1:14:19<6:31:20,  3.29it/s]
 79%|███████▉  | 294127/371472 [1:14:19<6:23:32,  3.36it/s]
 79%|███████▉  | 294128/371472 [1:14:20<6:26:01,  3.34it/s]
 79%|███████▉  | 294129/371472 [1:14:20<6:22:53,  3.37it/s]
 79%|███████▉  | 294130/371472 [1:14:20<6:12:11,  3.46it/s]
 79%|███████▉  | 294131/371472 [1:14:21<6:13:47,  3.45it/s]
 79%|███████▉  | 294132/371472 [1:14:21<5:56:11,  3.62it/s]
 79%|███████▉  | 294133/371472 [1:14:21<6:06:35,  3.52it/s]
 79%|███████▉  | 294134/371472 [1:14:21<5:51:01,  3.67it/s]
 79%|███████▉  | 294135/371472 [1:14:22<5:46:57,  3.71it/s]
 79%|███████▉  | 294136/371472 [1:14:22<6:03:34,  3.55it/s]
 79%|███████▉  | 294137/371472 [1:14:22<6:32:42,  3.28it/s]
 79%|███████▉  | 294138/371472 [1:14:23<6:51:31,  3.13it/s]
 79%|███████▉  | 294139/371472 [1:14:23<6:31:31,  3.29it/s]
 79%|███████▉  | 294140/371472 [1:14:23<6:03:27,  3.55it/s]
                                                           
{'loss': 2.6292, 'learning_rate': 2.8746040638669224e-07, 'epoch': 12.67}

 79%|███████▉  | 294140/371472 [1:14:23<6:03:27,  3.55it/s]
 79%|███████▉  | 294141/371472 [1:14:23<6:09:44,  3.49it/s]
 79%|███████▉  | 294142/371472 [1:14:24<6:27:17,  3.33it/s]
 79%|███████▉  | 294143/371472 [1:14:24<6:13:18,  3.45it/s]
 79%|███████▉  | 294144/371472 [1:14:24<6:04:57,  3.53it/s]
 79%|███████▉  | 294145/371472 [1:14:25<5:51:49,  3.66it/s]
 79%|███████▉  | 294146/371472 [1:14:25<5:56:42,  3.61it/s]
 79%|███████▉  | 294147/371472 [1:14:25<5:55:41,  3.62it/s]
 79%|███████▉  | 294148/371472 [1:14:25<5:47:27,  3.71it/s]
 79%|███████▉  | 294149/371472 [1:14:26<5:42:59,  3.76it/s]
 79%|███████▉  | 294150/371472 [1:14:26<5:39:55,  3.79it/s]
 79%|███████▉  | 294151/371472 [1:14:26<6:07:49,  3.50it/s]
 79%|███████▉  | 294152/371472 [1:14:26<5:52:39,  3.65it/s]
 79%|███████▉  | 294153/371472 [1:14:27<6:03:22,  3.55it/s]
 79%|███████▉  | 294154/371472 [1:14:27<5:44:30,  3.74it/s]
 79%|███████▉  | 294155/371472 [1:14:27<6:20:05,  3.39it/s]
 79%|███████▉  | 294156/371472 [1:14:28<6:11:12,  3.47it/s]
 79%|███████▉  | 294157/371472 [1:14:28<5:57:32,  3.60it/s]
 79%|███████▉  | 294158/371472 [1:14:28<5:48:49,  3.69it/s]
 79%|███████▉  | 294159/371472 [1:14:28<6:20:20,  3.39it/s]
 79%|███████▉  | 294160/371472 [1:14:29<6:20:31,  3.39it/s]
                                                           
{'loss': 2.8294, 'learning_rate': 2.874119244112133e-07, 'epoch': 12.67}

 79%|███████▉  | 294160/371472 [1:14:29<6:20:31,  3.39it/s]
 79%|███████▉  | 294161/371472 [1:14:29<6:09:25,  3.49it/s]
 79%|███████▉  | 294162/371472 [1:14:29<6:27:47,  3.32it/s]
 79%|███████▉  | 294163/371472 [1:14:30<6:16:48,  3.42it/s]
 79%|███████▉  | 294164/371472 [1:14:30<6:00:56,  3.57it/s]
 79%|███████▉  | 294165/371472 [1:14:30<5:54:43,  3.63it/s]
 79%|███████▉  | 294166/371472 [1:14:30<6:01:40,  3.56it/s]
 79%|███████▉  | 294167/371472 [1:14:31<5:50:35,  3.67it/s]
 79%|███████▉  | 294168/371472 [1:14:31<6:01:12,  3.57it/s]
 79%|███████▉  | 294169/371472 [1:14:31<5:57:57,  3.60it/s]
 79%|███████▉  | 294170/371472 [1:14:32<6:07:34,  3.51it/s]
 79%|███████▉  | 294171/371472 [1:14:32<6:53:15,  3.12it/s]
 79%|███████▉  | 294172/371472 [1:14:32<7:05:27,  3.03it/s]
 79%|███████▉  | 294173/371472 [1:14:33<6:35:26,  3.26it/s]
 79%|███████▉  | 294174/371472 [1:14:33<7:09:59,  3.00it/s]
 79%|███████▉  | 294175/371472 [1:14:33<7:12:41,  2.98it/s]
 79%|███████▉  | 294176/371472 [1:14:34<6:53:09,  3.12it/s]
 79%|███████▉  | 294177/371472 [1:14:34<6:48:59,  3.15it/s]
 79%|███████▉  | 294178/371472 [1:14:34<6:20:40,  3.38it/s]
 79%|███████▉  | 294179/371472 [1:14:34<6:04:37,  3.53it/s]
 79%|███████▉  | 294180/371472 [1:14:35<6:32:18,  3.28it/s]
                                                           
{'loss': 2.5904, 'learning_rate': 2.8736344243573444e-07, 'epoch': 12.67}

 79%|███████▉  | 294180/371472 [1:14:35<6:32:18,  3.28it/s]
 79%|███████▉  | 294181/371472 [1:14:35<6:26:25,  3.33it/s]
 79%|███████▉  | 294182/371472 [1:14:35<6:22:33,  3.37it/s]
 79%|███████▉  | 294183/371472 [1:14:36<6:18:40,  3.40it/s]
 79%|███████▉  | 294184/371472 [1:14:36<6:12:26,  3.46it/s]
 79%|███████▉  | 294185/371472 [1:14:36<6:06:30,  3.51it/s]
 79%|███████▉  | 294186/371472 [1:14:36<6:15:51,  3.43it/s]
 79%|███████▉  | 294187/371472 [1:14:37<6:05:43,  3.52it/s]
 79%|███████▉  | 294188/371472 [1:14:37<5:56:41,  3.61it/s]
 79%|███████▉  | 294189/371472 [1:14:37<6:00:25,  3.57it/s]
 79%|███████▉  | 294190/371472 [1:14:38<6:05:15,  3.53it/s]
 79%|███████▉  | 294191/371472 [1:14:38<6:03:44,  3.54it/s]
 79%|███████▉  | 294192/371472 [1:14:38<6:14:13,  3.44it/s]
 79%|███████▉  | 294193/371472 [1:14:38<6:13:17,  3.45it/s]
 79%|███████▉  | 294194/371472 [1:14:39<6:07:54,  3.50it/s]
 79%|███████▉  | 294195/371472 [1:14:39<6:20:55,  3.38it/s]
 79%|███████▉  | 294196/371472 [1:14:39<6:11:41,  3.47it/s]
 79%|███████▉  | 294197/371472 [1:14:40<6:17:45,  3.41it/s]
 79%|███████▉  | 294198/371472 [1:14:40<6:12:12,  3.46it/s]
 79%|███████▉  | 294199/371472 [1:14:40<6:13:01,  3.45it/s]
 79%|███████▉  | 294200/371472 [1:14:40<6:10:09,  3.48it/s]
                                                           
{'loss': 2.5297, 'learning_rate': 2.873149604602555e-07, 'epoch': 12.67}

 79%|███████▉  | 294200/371472 [1:14:40<6:10:09,  3.48it/s]
 79%|███████▉  | 294201/371472 [1:14:41<6:15:45,  3.43it/s]
 79%|███████▉  | 294202/371472 [1:14:41<6:01:25,  3.56it/s]
 79%|███████▉  | 294203/371472 [1:14:41<6:09:44,  3.48it/s]
 79%|███████▉  | 294204/371472 [1:14:42<6:07:30,  3.50it/s]
 79%|███████▉  | 294205/371472 [1:14:42<6:14:00,  3.44it/s]
 79%|███████▉  | 294206/371472 [1:14:42<6:29:49,  3.30it/s]
 79%|███████▉  | 294207/371472 [1:14:43<6:20:23,  3.39it/s]
 79%|███████▉  | 294208/371472 [1:14:43<6:35:00,  3.26it/s]
 79%|███████▉  | 294209/371472 [1:14:43<6:21:19,  3.38it/s]
 79%|███████▉  | 294210/371472 [1:14:43<6:08:30,  3.49it/s]
 79%|███████▉  | 294211/371472 [1:14:44<6:03:37,  3.54it/s]
 79%|███████▉  | 294212/371472 [1:14:44<6:07:27,  3.50it/s]
 79%|███████▉  | 294213/371472 [1:14:44<6:35:04,  3.26it/s]
 79%|███████▉  | 294214/371472 [1:14:45<6:13:37,  3.45it/s]
 79%|███████▉  | 294215/371472 [1:14:45<6:04:20,  3.53it/s]
 79%|███████▉  | 294216/371472 [1:14:45<6:04:22,  3.53it/s]
 79%|███████▉  | 294217/371472 [1:14:45<6:22:59,  3.36it/s]
 79%|███████▉  | 294218/371472 [1:14:46<6:20:33,  3.38it/s]
 79%|███████▉  | 294219/371472 [1:14:46<6:31:56,  3.29it/s]
 79%|███████▉  | 294220/371472 [1:14:46<6:23:19,  3.36it/s]
                                                           
{'loss': 2.6002, 'learning_rate': 2.872664784847767e-07, 'epoch': 12.67}

 79%|███████▉  | 294220/371472 [1:14:46<6:23:19,  3.36it/s]
 79%|███████▉  | 294221/371472 [1:14:47<6:21:56,  3.37it/s]
 79%|███████▉  | 294222/371472 [1:14:47<6:17:24,  3.41it/s]
 79%|███████▉  | 294223/371472 [1:14:47<5:59:40,  3.58it/s]
 79%|███████▉  | 294224/371472 [1:14:47<6:12:13,  3.46it/s]
 79%|███████▉  | 294225/371472 [1:14:48<6:03:49,  3.54it/s]
 79%|███████▉  | 294226/371472 [1:14:48<6:10:32,  3.47it/s]
 79%|███████▉  | 294227/371472 [1:14:48<5:59:18,  3.58it/s]
 79%|███████▉  | 294228/371472 [1:14:49<6:03:01,  3.55it/s]
 79%|███████▉  | 294229/371472 [1:14:49<6:05:20,  3.52it/s]
 79%|███████▉  | 294230/371472 [1:14:49<6:03:19,  3.54it/s]
 79%|███████▉  | 294231/371472 [1:14:49<5:56:34,  3.61it/s]
 79%|███████▉  | 294232/371472 [1:14:50<5:49:52,  3.68it/s]
 79%|███████▉  | 294233/371472 [1:14:50<5:48:09,  3.70it/s]
 79%|███████▉  | 294234/371472 [1:14:50<5:50:26,  3.67it/s]
 79%|███████▉  | 294235/371472 [1:14:51<5:57:33,  3.60it/s]
 79%|███████▉  | 294236/371472 [1:14:51<6:26:06,  3.33it/s]
 79%|███████▉  | 294237/371472 [1:14:51<6:27:35,  3.32it/s]
 79%|███████▉  | 294238/371472 [1:14:51<6:14:54,  3.43it/s]
 79%|███████▉  | 294239/371472 [1:14:52<6:17:18,  3.41it/s]
 79%|███████▉  | 294240/371472 [1:14:52<7:00:19,  3.06it/s]
                                                           
{'loss': 2.6644, 'learning_rate': 2.872179965092977e-07, 'epoch': 12.67}

 79%|███████▉  | 294240/371472 [1:14:52<7:00:19,  3.06it/s]
 79%|███████▉  | 294241/371472 [1:14:52<6:47:30,  3.16it/s]
 79%|███████▉  | 294242/371472 [1:14:53<6:21:03,  3.38it/s]
 79%|███████▉  | 294243/371472 [1:14:53<6:07:37,  3.50it/s]
 79%|███████▉  | 294244/371472 [1:14:53<6:07:04,  3.51it/s]
 79%|███████▉  | 294245/371472 [1:14:53<5:55:01,  3.63it/s]
 79%|███████▉  | 294246/371472 [1:14:54<5:48:39,  3.69it/s]
 79%|███████▉  | 294247/371472 [1:14:54<5:36:54,  3.82it/s]
 79%|███████▉  | 294248/371472 [1:14:54<5:56:19,  3.61it/s]
 79%|███████▉  | 294249/371472 [1:14:55<5:46:57,  3.71it/s]
 79%|███████▉  | 294250/371472 [1:14:55<5:46:36,  3.71it/s]
 79%|███████▉  | 294251/371472 [1:14:55<5:53:34,  3.64it/s]
 79%|███████▉  | 294252/371472 [1:14:55<5:54:39,  3.63it/s]
 79%|███████▉  | 294253/371472 [1:14:56<5:43:32,  3.75it/s]
 79%|███████▉  | 294254/371472 [1:14:56<5:46:42,  3.71it/s]
 79%|███████▉  | 294255/371472 [1:14:56<5:56:34,  3.61it/s]
 79%|███████▉  | 294256/371472 [1:14:57<6:06:02,  3.52it/s]
 79%|███████▉  | 294257/371472 [1:14:57<6:13:37,  3.44it/s]
 79%|███████▉  | 294258/371472 [1:14:57<6:11:28,  3.46it/s]
 79%|███████▉  | 294259/371472 [1:14:57<5:59:12,  3.58it/s]
 79%|███████▉  | 294260/371472 [1:14:58<5:53:25,  3.64it/s]
                                                           
{'loss': 2.5754, 'learning_rate': 2.8716951453381894e-07, 'epoch': 12.67}

 79%|███████▉  | 294260/371472 [1:14:58<5:53:25,  3.64it/s]
 79%|███████▉  | 294261/371472 [1:14:58<6:05:51,  3.52it/s]
 79%|███████▉  | 294262/371472 [1:14:58<5:57:59,  3.59it/s]
 79%|███████▉  | 294263/371472 [1:14:58<5:47:50,  3.70it/s]
 79%|███████▉  | 294264/371472 [1:14:59<5:43:38,  3.74it/s]
 79%|███████▉  | 294265/371472 [1:14:59<6:27:46,  3.32it/s]
 79%|███████▉  | 294266/371472 [1:14:59<6:32:15,  3.28it/s]
 79%|███████▉  | 294267/371472 [1:15:00<6:21:38,  3.37it/s]
 79%|███████▉  | 294268/371472 [1:15:00<6:16:47,  3.42it/s]
 79%|███████▉  | 294269/371472 [1:15:00<6:17:18,  3.41it/s]
 79%|███████▉  | 294270/371472 [1:15:01<6:20:06,  3.39it/s]
 79%|███████▉  | 294271/371472 [1:15:01<6:15:38,  3.43it/s]
 79%|███████▉  | 294272/371472 [1:15:01<6:42:09,  3.20it/s]
 79%|███████▉  | 294273/371472 [1:15:02<6:41:50,  3.20it/s]
 79%|███████▉  | 294274/371472 [1:15:02<6:47:40,  3.16it/s]
 79%|███████▉  | 294275/371472 [1:15:02<6:17:34,  3.41it/s]
 79%|███████▉  | 294276/371472 [1:15:02<6:44:14,  3.18it/s]
 79%|███████▉  | 294277/371472 [1:15:03<6:19:38,  3.39it/s]
 79%|███████▉  | 294278/371472 [1:15:03<6:03:07,  3.54it/s]
 79%|███████▉  | 294279/371472 [1:15:03<5:55:24,  3.62it/s]
 79%|███████▉  | 294280/371472 [1:15:03<5:48:36,  3.69it/s]
                                                           
{'loss': 2.6956, 'learning_rate': 2.8712103255833996e-07, 'epoch': 12.68}

 79%|███████▉  | 294280/371472 [1:15:03<5:48:36,  3.69it/s]
 79%|███████▉  | 294281/371472 [1:15:04<5:55:23,  3.62it/s]
 79%|███████▉  | 294282/371472 [1:15:04<6:01:43,  3.56it/s]
 79%|███████▉  | 294283/371472 [1:15:04<6:59:46,  3.06it/s]
 79%|███████▉  | 294284/371472 [1:15:05<6:39:52,  3.22it/s]
 79%|███████▉  | 294285/371472 [1:15:05<6:34:03,  3.26it/s]
 79%|███████▉  | 294286/371472 [1:15:05<6:23:00,  3.36it/s]
 79%|███████▉  | 294287/371472 [1:15:06<6:23:00,  3.36it/s]
 79%|███████▉  | 294288/371472 [1:15:06<6:11:35,  3.46it/s]
 79%|███████▉  | 294289/371472 [1:15:06<6:04:55,  3.53it/s]
 79%|███████▉  | 294290/371472 [1:15:06<6:06:57,  3.51it/s]
 79%|███████▉  | 294291/371472 [1:15:07<5:58:45,  3.59it/s]
 79%|███████▉  | 294292/371472 [1:15:07<5:54:31,  3.63it/s]
 79%|███████▉  | 294293/371472 [1:15:07<5:47:52,  3.70it/s]
 79%|███████▉  | 294294/371472 [1:15:08<6:25:25,  3.34it/s]
 79%|███████▉  | 294295/371472 [1:15:08<6:07:20,  3.50it/s]
 79%|███████▉  | 294296/371472 [1:15:08<6:08:44,  3.49it/s]
 79%|███████▉  | 294297/371472 [1:15:08<6:22:56,  3.36it/s]
 79%|███████▉  | 294298/371472 [1:15:09<6:09:11,  3.48it/s]
 79%|███████▉  | 294299/371472 [1:15:09<6:08:01,  3.49it/s]
 79%|███████▉  | 294300/371472 [1:15:09<6:15:15,  3.43it/s]
                                                           
{'loss': 2.6064, 'learning_rate': 2.870725505828611e-07, 'epoch': 12.68}

 79%|███████▉  | 294300/371472 [1:15:09<6:15:15,  3.43it/s]
 79%|███████▉  | 294301/371472 [1:15:10<6:21:17,  3.37it/s]
 79%|███████▉  | 294302/371472 [1:15:10<6:40:21,  3.21it/s]
 79%|███████▉  | 294303/371472 [1:15:10<6:34:14,  3.26it/s]
 79%|███████▉  | 294304/371472 [1:15:11<6:29:28,  3.30it/s]
 79%|███████▉  | 294305/371472 [1:15:11<6:11:57,  3.46it/s]
 79%|███████▉  | 294306/371472 [1:15:11<6:20:50,  3.38it/s]
 79%|███████▉  | 294307/371472 [1:15:11<6:36:14,  3.25it/s]
 79%|███████▉  | 294308/371472 [1:15:12<6:31:52,  3.28it/s]
 79%|███████▉  | 294309/371472 [1:15:12<6:27:22,  3.32it/s]
 79%|███████▉  | 294310/371472 [1:15:12<6:18:47,  3.40it/s]
 79%|███████▉  | 294311/371472 [1:15:13<6:09:05,  3.48it/s]
 79%|███████▉  | 294312/371472 [1:15:13<6:13:17,  3.44it/s]
 79%|███████▉  | 294313/371472 [1:15:13<6:00:32,  3.57it/s]
 79%|███████▉  | 294314/371472 [1:15:13<5:54:44,  3.63it/s]
 79%|███████▉  | 294315/371472 [1:15:14<5:57:36,  3.60it/s]
 79%|███████▉  | 294316/371472 [1:15:14<6:08:04,  3.49it/s]
 79%|███████▉  | 294317/371472 [1:15:14<6:00:23,  3.57it/s]
 79%|███████▉  | 294318/371472 [1:15:15<6:34:22,  3.26it/s]
 79%|███████▉  | 294319/371472 [1:15:15<6:19:16,  3.39it/s]
 79%|███████▉  | 294320/371472 [1:15:15<6:08:00,  3.49it/s]
                                                           
{'loss': 2.6565, 'learning_rate': 2.8702406860738215e-07, 'epoch': 12.68}

 79%|███████▉  | 294320/371472 [1:15:15<6:08:00,  3.49it/s]
 79%|███████▉  | 294321/371472 [1:15:15<6:11:08,  3.46it/s]
 79%|███████▉  | 294322/371472 [1:15:16<6:02:23,  3.55it/s]
 79%|███████▉  | 294323/371472 [1:15:16<5:58:18,  3.59it/s]
 79%|███████▉  | 294324/371472 [1:15:16<6:01:28,  3.56it/s]
 79%|███████▉  | 294325/371472 [1:15:17<5:57:52,  3.59it/s]
 79%|███████▉  | 294326/371472 [1:15:17<6:11:50,  3.46it/s]
 79%|███████▉  | 294327/371472 [1:15:17<5:58:39,  3.58it/s]
 79%|███████▉  | 294328/371472 [1:15:18<6:51:34,  3.12it/s]
 79%|███████▉  | 294329/371472 [1:15:18<6:38:57,  3.22it/s]
 79%|███████▉  | 294330/371472 [1:15:18<6:16:53,  3.41it/s]
 79%|███████▉  | 294331/371472 [1:15:18<6:34:14,  3.26it/s]
 79%|███████▉  | 294332/371472 [1:15:19<6:20:46,  3.38it/s]
 79%|███████▉  | 294333/371472 [1:15:19<6:07:46,  3.50it/s]
 79%|███████▉  | 294334/371472 [1:15:19<6:00:40,  3.56it/s]
 79%|███████▉  | 294335/371472 [1:15:20<5:54:02,  3.63it/s]
 79%|███████▉  | 294336/371472 [1:15:20<6:00:54,  3.56it/s]
 79%|███████▉  | 294337/371472 [1:15:20<5:52:10,  3.65it/s]
 79%|███████▉  | 294338/371472 [1:15:20<6:00:46,  3.56it/s]
 79%|███████▉  | 294339/371472 [1:15:21<6:02:09,  3.55it/s]
 79%|███████▉  | 294340/371472 [1:15:21<5:59:27,  3.58it/s]
                                                           
{'loss': 2.8212, 'learning_rate': 2.869755866319032e-07, 'epoch': 12.68}

 79%|███████▉  | 294340/371472 [1:15:21<5:59:27,  3.58it/s]
 79%|███████▉  | 294341/371472 [1:15:21<6:05:49,  3.51it/s]
 79%|███████▉  | 294342/371472 [1:15:21<5:53:11,  3.64it/s]
 79%|███████▉  | 294343/371472 [1:15:22<6:21:40,  3.37it/s]
 79%|███████▉  | 294344/371472 [1:15:22<6:25:06,  3.34it/s]
 79%|███████▉  | 294345/371472 [1:15:22<6:05:21,  3.52it/s]
 79%|███████▉  | 294346/371472 [1:15:23<6:23:09,  3.35it/s]
 79%|███████▉  | 294347/371472 [1:15:23<7:02:20,  3.04it/s]
 79%|███████▉  | 294348/371472 [1:15:23<6:45:57,  3.17it/s]
 79%|███████▉  | 294349/371472 [1:15:24<6:25:42,  3.33it/s]
 79%|███████▉  | 294350/371472 [1:15:24<6:07:33,  3.50it/s]
 79%|███████▉  | 294351/371472 [1:15:24<6:50:12,  3.13it/s]
 79%|███████▉  | 294352/371472 [1:15:25<6:43:53,  3.18it/s]
 79%|███████▉  | 294353/371472 [1:15:25<7:20:22,  2.92it/s]
 79%|███████▉  | 294354/371472 [1:15:25<7:04:03,  3.03it/s]
 79%|███████▉  | 294355/371472 [1:15:26<6:42:42,  3.19it/s]
 79%|███████▉  | 294356/371472 [1:15:26<6:27:37,  3.32it/s]
 79%|███████▉  | 294357/371472 [1:15:26<6:28:08,  3.31it/s]
 79%|███████▉  | 294358/371472 [1:15:26<6:08:21,  3.49it/s]
 79%|███████▉  | 294359/371472 [1:15:27<6:15:46,  3.42it/s]
 79%|███████▉  | 294360/371472 [1:15:27<6:11:12,  3.46it/s]
                                                           
{'loss': 2.5368, 'learning_rate': 2.869271046564244e-07, 'epoch': 12.68}

 79%|███████▉  | 294360/371472 [1:15:27<6:11:12,  3.46it/s]
 79%|███████▉  | 294361/371472 [1:15:27<6:12:48,  3.45it/s]
 79%|███████▉  | 294362/371472 [1:15:28<6:08:42,  3.49it/s]
 79%|███████▉  | 294363/371472 [1:15:28<6:00:34,  3.56it/s]
 79%|███████▉  | 294364/371472 [1:15:28<6:19:17,  3.39it/s]
 79%|███████▉  | 294365/371472 [1:15:28<6:15:02,  3.43it/s]
 79%|███████▉  | 294366/371472 [1:15:29<6:29:39,  3.30it/s]
 79%|███████▉  | 294367/371472 [1:15:29<6:35:12,  3.25it/s]
 79%|███████▉  | 294368/371472 [1:15:29<6:13:23,  3.44it/s]
 79%|███████▉  | 294369/371472 [1:15:30<6:11:04,  3.46it/s]
 79%|███████▉  | 294370/371472 [1:15:30<6:19:16,  3.39it/s]
 79%|███████▉  | 294371/371472 [1:15:30<6:00:23,  3.57it/s]
 79%|███████▉  | 294372/371472 [1:15:30<6:04:56,  3.52it/s]
 79%|███████▉  | 294373/371472 [1:15:31<6:06:27,  3.51it/s]
 79%|███████▉  | 294374/371472 [1:15:31<6:06:20,  3.51it/s]
 79%|███████▉  | 294375/371472 [1:15:31<5:49:41,  3.67it/s]
 79%|███████▉  | 294376/371472 [1:15:32<5:50:44,  3.66it/s]
 79%|███████▉  | 294377/371472 [1:15:32<6:09:47,  3.47it/s]
 79%|███████▉  | 294378/371472 [1:15:32<6:17:30,  3.40it/s]
 79%|███████▉  | 294379/371472 [1:15:33<6:23:15,  3.35it/s]
 79%|███████▉  | 294380/371472 [1:15:33<6:19:37,  3.38it/s]
                                                           
{'loss': 2.6298, 'learning_rate': 2.8687862268094547e-07, 'epoch': 12.68}

 79%|███████▉  | 294380/371472 [1:15:33<6:19:37,  3.38it/s]
 79%|███████▉  | 294381/371472 [1:15:33<6:20:25,  3.38it/s]
 79%|███████▉  | 294382/371472 [1:15:33<6:11:42,  3.46it/s]
 79%|███████▉  | 294383/371472 [1:15:34<6:04:15,  3.53it/s]
 79%|███████▉  | 294384/371472 [1:15:34<6:11:43,  3.46it/s]
 79%|███████▉  | 294385/371472 [1:15:34<6:01:01,  3.56it/s]
 79%|███████▉  | 294386/371472 [1:15:34<6:03:47,  3.53it/s]
 79%|███████▉  | 294387/371472 [1:15:35<6:07:13,  3.50it/s]
 79%|███████▉  | 294388/371472 [1:15:35<5:58:35,  3.58it/s]
 79%|███████▉  | 294389/371472 [1:15:35<5:57:04,  3.60it/s]
 79%|███████▉  | 294390/371472 [1:15:36<5:48:43,  3.68it/s]
 79%|███████▉  | 294391/371472 [1:15:36<5:51:54,  3.65it/s]
 79%|███████▉  | 294392/371472 [1:15:36<5:54:21,  3.63it/s]
 79%|███████▉  | 294393/371472 [1:15:36<5:46:30,  3.71it/s]
 79%|███████▉  | 294394/371472 [1:15:37<5:46:20,  3.71it/s]
 79%|███████▉  | 294395/371472 [1:15:37<5:46:36,  3.71it/s]
 79%|███████▉  | 294396/371472 [1:15:37<6:02:32,  3.54it/s]
 79%|███████▉  | 294397/371472 [1:15:38<5:55:59,  3.61it/s]
 79%|███████▉  | 294398/371472 [1:15:38<5:50:48,  3.66it/s]
 79%|███████▉  | 294399/371472 [1:15:38<5:51:40,  3.65it/s]
 79%|███████▉  | 294400/371472 [1:15:38<6:22:08,  3.36it/s]
                                                           
{'loss': 2.6617, 'learning_rate': 2.868301407054666e-07, 'epoch': 12.68}

 79%|███████▉  | 294400/371472 [1:15:38<6:22:08,  3.36it/s]
 79%|███████▉  | 294401/371472 [1:15:39<6:06:24,  3.51it/s]
 79%|███████▉  | 294402/371472 [1:15:39<5:57:46,  3.59it/s]
 79%|███████▉  | 294403/371472 [1:15:39<5:52:45,  3.64it/s]
 79%|███████▉  | 294404/371472 [1:15:39<5:46:01,  3.71it/s]
 79%|███████▉  | 294405/371472 [1:15:40<5:48:50,  3.68it/s]
 79%|███████▉  | 294406/371472 [1:15:40<6:07:41,  3.49it/s]
 79%|███████▉  | 294407/371472 [1:15:40<6:21:27,  3.37it/s]
 79%|███████▉  | 294408/371472 [1:15:41<6:08:05,  3.49it/s]
 79%|███████▉  | 294409/371472 [1:15:41<5:58:52,  3.58it/s]
 79%|███████▉  | 294410/371472 [1:15:41<5:41:48,  3.76it/s]
 79%|███████▉  | 294411/371472 [1:15:42<6:26:03,  3.33it/s]
 79%|███████▉  | 294412/371472 [1:15:42<6:10:17,  3.47it/s]
 79%|███████▉  | 294413/371472 [1:15:42<6:25:36,  3.33it/s]
 79%|███████▉  | 294414/371472 [1:15:42<6:08:56,  3.48it/s]
 79%|███████▉  | 294415/371472 [1:15:43<6:11:58,  3.45it/s]
 79%|███████▉  | 294416/371472 [1:15:43<6:09:17,  3.48it/s]
 79%|███████▉  | 294417/371472 [1:15:43<5:58:03,  3.59it/s]
 79%|███████▉  | 294418/371472 [1:15:44<6:21:33,  3.37it/s]
 79%|███████▉  | 294419/371472 [1:15:44<6:17:35,  3.40it/s]
 79%|███████▉  | 294420/371472 [1:15:44<6:15:11,  3.42it/s]
                                                           
{'loss': 2.7764, 'learning_rate': 2.8678165872998767e-07, 'epoch': 12.68}

 79%|███████▉  | 294420/371472 [1:15:44<6:15:11,  3.42it/s]
 79%|███████▉  | 294421/371472 [1:15:44<6:26:40,  3.32it/s]
 79%|███████▉  | 294422/371472 [1:15:45<6:22:47,  3.35it/s]
 79%|███████▉  | 294423/371472 [1:15:45<6:35:12,  3.25it/s]
 79%|███████▉  | 294424/371472 [1:15:45<6:33:42,  3.26it/s]
 79%|███████▉  | 294425/371472 [1:15:46<6:11:05,  3.46it/s]
 79%|███████▉  | 294426/371472 [1:15:46<6:02:12,  3.55it/s]
 79%|███████▉  | 294427/371472 [1:15:46<5:58:01,  3.59it/s]
 79%|███████▉  | 294428/371472 [1:15:46<5:59:15,  3.57it/s]
 79%|███████▉  | 294429/371472 [1:15:47<6:01:09,  3.56it/s]
 79%|███████▉  | 294430/371472 [1:15:47<5:56:49,  3.60it/s]
 79%|███████▉  | 294431/371472 [1:15:47<6:05:08,  3.52it/s]
 79%|███████▉  | 294432/371472 [1:15:48<5:51:58,  3.65it/s]
 79%|███████▉  | 294433/371472 [1:15:48<5:45:08,  3.72it/s]
 79%|███████▉  | 294434/371472 [1:15:48<6:20:27,  3.37it/s]
 79%|███████▉  | 294435/371472 [1:15:48<6:24:01,  3.34it/s]
 79%|███████▉  | 294436/371472 [1:15:49<6:15:29,  3.42it/s]
 79%|███████▉  | 294437/371472 [1:15:49<6:09:52,  3.47it/s]
 79%|███████▉  | 294438/371472 [1:15:49<6:00:17,  3.56it/s]
 79%|███████▉  | 294439/371472 [1:15:50<6:19:05,  3.39it/s]
 79%|███████▉  | 294440/371472 [1:15:50<6:09:39,  3.47it/s]
                                                           
{'loss': 2.529, 'learning_rate': 2.867331767545088e-07, 'epoch': 12.68}

 79%|███████▉  | 294440/371472 [1:15:50<6:09:39,  3.47it/s]
 79%|███████▉  | 294441/371472 [1:15:50<6:11:38,  3.45it/s]
 79%|███████▉  | 294442/371472 [1:15:50<6:14:51,  3.42it/s]
 79%|███████▉  | 294443/371472 [1:15:51<6:12:48,  3.44it/s]
 79%|███████▉  | 294444/371472 [1:15:51<6:20:10,  3.38it/s]
 79%|███████▉  | 294445/371472 [1:15:51<6:19:11,  3.39it/s]
 79%|███████▉  | 294446/371472 [1:15:52<6:23:18,  3.35it/s]
 79%|███████▉  | 294447/371472 [1:15:52<6:23:51,  3.34it/s]
 79%|███████▉  | 294448/371472 [1:15:52<6:10:41,  3.46it/s]
 79%|███████▉  | 294449/371472 [1:15:53<6:44:00,  3.18it/s]
 79%|███████▉  | 294450/371472 [1:15:53<6:33:59,  3.26it/s]
 79%|███████▉  | 294451/371472 [1:15:53<6:42:25,  3.19it/s]
 79%|███████▉  | 294452/371472 [1:15:53<6:17:55,  3.40it/s]
 79%|███████▉  | 294453/371472 [1:15:54<6:06:47,  3.50it/s]
 79%|███████▉  | 294454/371472 [1:15:54<5:58:28,  3.58it/s]
 79%|███████▉  | 294455/371472 [1:15:54<6:14:16,  3.43it/s]
 79%|███████▉  | 294456/371472 [1:15:55<5:56:40,  3.60it/s]
 79%|███████▉  | 294457/371472 [1:15:55<5:59:28,  3.57it/s]
 79%|███████▉  | 294458/371472 [1:15:55<6:38:40,  3.22it/s]
 79%|███████▉  | 294459/371472 [1:15:56<6:36:31,  3.24it/s]
 79%|███████▉  | 294460/371472 [1:15:56<6:27:09,  3.32it/s]
                                                           
{'loss': 2.7669, 'learning_rate': 2.8668469477902986e-07, 'epoch': 12.68}

 79%|███████▉  | 294460/371472 [1:15:56<6:27:09,  3.32it/s]
 79%|███████▉  | 294461/371472 [1:15:56<6:16:38,  3.41it/s]
 79%|███████▉  | 294462/371472 [1:15:56<6:10:21,  3.47it/s]
 79%|███████▉  | 294463/371472 [1:15:57<6:05:53,  3.51it/s]
 79%|███████▉  | 294464/371472 [1:15:57<6:26:30,  3.32it/s]
 79%|███████▉  | 294465/371472 [1:15:57<6:12:36,  3.44it/s]
 79%|███████▉  | 294466/371472 [1:15:58<6:26:32,  3.32it/s]
 79%|███████▉  | 294467/371472 [1:15:58<6:49:02,  3.14it/s]
 79%|███████▉  | 294468/371472 [1:15:58<6:43:34,  3.18it/s]
 79%|███████▉  | 294469/371472 [1:15:58<6:21:45,  3.36it/s]
 79%|███████▉  | 294470/371472 [1:15:59<6:27:20,  3.31it/s]
 79%|███████▉  | 294471/371472 [1:15:59<6:08:33,  3.48it/s]
 79%|███████▉  | 294472/371472 [1:15:59<5:52:07,  3.64it/s]
 79%|███████▉  | 294473/371472 [1:16:00<5:55:04,  3.61it/s]
 79%|███████▉  | 294474/371472 [1:16:00<6:04:06,  3.52it/s]
 79%|███████▉  | 294475/371472 [1:16:00<6:12:48,  3.44it/s]
 79%|███████▉  | 294476/371472 [1:16:00<6:03:33,  3.53it/s]
 79%|███████▉  | 294477/371472 [1:16:01<5:49:02,  3.68it/s]
 79%|███████▉  | 294478/371472 [1:16:01<5:54:23,  3.62it/s]
 79%|███████▉  | 294479/371472 [1:16:01<6:27:40,  3.31it/s]
 79%|███████▉  | 294480/371472 [1:16:02<6:12:00,  3.45it/s]
                                                           
{'loss': 2.6813, 'learning_rate': 2.8663621280355104e-07, 'epoch': 12.68}

 79%|███████▉  | 294480/371472 [1:16:02<6:12:00,  3.45it/s]
 79%|███████▉  | 294481/371472 [1:16:02<6:16:05,  3.41it/s]
 79%|███████▉  | 294482/371472 [1:16:02<6:36:06,  3.24it/s]
 79%|███████▉  | 294483/371472 [1:16:03<6:34:14,  3.25it/s]
 79%|███████▉  | 294484/371472 [1:16:03<6:20:58,  3.37it/s]
 79%|███████▉  | 294485/371472 [1:16:03<6:21:03,  3.37it/s]
 79%|███████▉  | 294486/371472 [1:16:03<6:36:02,  3.24it/s]
 79%|███████▉  | 294487/371472 [1:16:04<6:21:04,  3.37it/s]
 79%|███████▉  | 294488/371472 [1:16:04<6:20:51,  3.37it/s]
 79%|███████▉  | 294489/371472 [1:16:04<6:08:26,  3.48it/s]
 79%|███████▉  | 294490/371472 [1:16:05<5:58:41,  3.58it/s]
 79%|███████▉  | 294491/371472 [1:16:05<5:50:51,  3.66it/s]
 79%|███████▉  | 294492/371472 [1:16:05<5:40:54,  3.76it/s]
 79%|███████▉  | 294493/371472 [1:16:05<5:34:42,  3.83it/s]
 79%|███████▉  | 294494/371472 [1:16:06<5:53:04,  3.63it/s]
 79%|███████▉  | 294495/371472 [1:16:06<5:48:06,  3.69it/s]
 79%|███████▉  | 294496/371472 [1:16:06<6:06:13,  3.50it/s]
 79%|███████▉  | 294497/371472 [1:16:06<5:55:31,  3.61it/s]
 79%|███████▉  | 294498/371472 [1:16:07<5:49:55,  3.67it/s]
 79%|███████▉  | 294499/371472 [1:16:07<5:47:06,  3.70it/s]
 79%|███████▉  | 294500/371472 [1:16:07<5:53:27,  3.63it/s]
                                                           
{'loss': 2.4994, 'learning_rate': 2.865877308280721e-07, 'epoch': 12.68}

 79%|███████▉  | 294500/371472 [1:16:07<5:53:27,  3.63it/s]
 79%|███████▉  | 294501/371472 [1:16:08<5:52:57,  3.63it/s]
 79%|███████▉  | 294502/371472 [1:16:08<5:52:36,  3.64it/s]
 79%|███████▉  | 294503/371472 [1:16:08<6:16:46,  3.40it/s]
 79%|███████▉  | 294504/371472 [1:16:08<6:07:01,  3.50it/s]
 79%|███████▉  | 294505/371472 [1:16:09<5:54:22,  3.62it/s]
 79%|███████▉  | 294506/371472 [1:16:09<5:40:20,  3.77it/s]
 79%|███████▉  | 294507/371472 [1:16:09<5:39:52,  3.77it/s]
 79%|███████▉  | 294508/371472 [1:16:09<5:56:14,  3.60it/s]
 79%|███████▉  | 294509/371472 [1:16:10<6:07:25,  3.49it/s]
 79%|███████▉  | 294510/371472 [1:16:10<5:54:45,  3.62it/s]
 79%|███████▉  | 294511/371472 [1:16:10<5:47:19,  3.69it/s]
 79%|███████▉  | 294512/371472 [1:16:11<5:50:45,  3.66it/s]
 79%|███████▉  | 294513/371472 [1:16:11<5:45:07,  3.72it/s]
 79%|███████▉  | 294514/371472 [1:16:11<5:42:23,  3.75it/s]
 79%|███████▉  | 294515/371472 [1:16:11<5:37:22,  3.80it/s]
 79%|███████▉  | 294516/371472 [1:16:12<5:28:27,  3.90it/s]
 79%|███████▉  | 294517/371472 [1:16:12<5:52:06,  3.64it/s]
 79%|███████▉  | 294518/371472 [1:16:12<5:42:45,  3.74it/s]
 79%|███████▉  | 294519/371472 [1:16:12<5:41:14,  3.76it/s]
 79%|███████▉  | 294520/371472 [1:16:13<6:07:14,  3.49it/s]
                                                           
{'loss': 2.6074, 'learning_rate': 2.865392488525933e-07, 'epoch': 12.69}

 79%|███████▉  | 294520/371472 [1:16:13<6:07:14,  3.49it/s]
 79%|███████▉  | 294521/371472 [1:16:13<6:01:24,  3.55it/s]
 79%|███████▉  | 294522/371472 [1:16:13<6:03:41,  3.53it/s]
 79%|███████▉  | 294523/371472 [1:16:14<5:55:32,  3.61it/s]
 79%|███████▉  | 294524/371472 [1:16:14<5:47:21,  3.69it/s]
 79%|███████▉  | 294525/371472 [1:16:14<5:51:20,  3.65it/s]
 79%|███████▉  | 294526/371472 [1:16:14<5:41:27,  3.76it/s]
 79%|███████▉  | 294527/371472 [1:16:15<5:37:24,  3.80it/s]
 79%|███████▉  | 294528/371472 [1:16:15<5:38:51,  3.78it/s]
 79%|███████▉  | 294529/371472 [1:16:15<5:52:36,  3.64it/s]
 79%|███████▉  | 294530/371472 [1:16:16<6:07:40,  3.49it/s]
 79%|███████▉  | 294531/371472 [1:16:16<6:04:48,  3.52it/s]
 79%|███████▉  | 294532/371472 [1:16:16<6:08:56,  3.48it/s]
 79%|███████▉  | 294533/371472 [1:16:16<6:23:25,  3.34it/s]
 79%|███████▉  | 294534/371472 [1:16:17<6:03:41,  3.53it/s]
 79%|███████▉  | 294535/371472 [1:16:17<6:03:10,  3.53it/s]
 79%|███████▉  | 294536/371472 [1:16:17<6:02:14,  3.54it/s]
 79%|███████▉  | 294537/371472 [1:16:18<6:08:25,  3.48it/s]
 79%|███████▉  | 294538/371472 [1:16:18<5:57:07,  3.59it/s]
 79%|███████▉  | 294539/371472 [1:16:18<5:55:27,  3.61it/s]
 79%|███████▉  | 294540/371472 [1:16:18<6:41:34,  3.19it/s]
                                                           
{'loss': 2.6493, 'learning_rate': 2.864907668771143e-07, 'epoch': 12.69}

 79%|███████▉  | 294540/371472 [1:16:18<6:41:34,  3.19it/s]
 79%|███████▉  | 294541/371472 [1:16:19<6:20:10,  3.37it/s]
 79%|███████▉  | 294542/371472 [1:16:19<6:22:28,  3.35it/s]
 79%|███████▉  | 294543/371472 [1:16:19<6:15:11,  3.42it/s]
 79%|███████▉  | 294544/371472 [1:16:20<6:01:52,  3.54it/s]
 79%|███████▉  | 294545/371472 [1:16:20<6:08:06,  3.48it/s]
 79%|███████▉  | 294546/371472 [1:16:20<5:57:52,  3.58it/s]
 79%|███████▉  | 294547/371472 [1:16:20<5:47:47,  3.69it/s]
 79%|███████▉  | 294548/371472 [1:16:21<5:48:19,  3.68it/s]
 79%|███████▉  | 294549/371472 [1:16:21<5:43:56,  3.73it/s]
 79%|███████▉  | 294550/371472 [1:16:21<5:46:00,  3.71it/s]
 79%|███████▉  | 294551/371472 [1:16:21<5:42:03,  3.75it/s]
 79%|███████▉  | 294552/371472 [1:16:22<5:47:02,  3.69it/s]
 79%|███████▉  | 294553/371472 [1:16:22<6:22:23,  3.35it/s]
 79%|███████▉  | 294554/371472 [1:16:22<6:00:50,  3.55it/s]
 79%|███████▉  | 294555/371472 [1:16:23<6:05:08,  3.51it/s]
 79%|███████▉  | 294556/371472 [1:16:23<5:57:30,  3.59it/s]
 79%|███████▉  | 294557/371472 [1:16:23<6:13:15,  3.43it/s]
 79%|███████▉  | 294558/371472 [1:16:24<6:29:01,  3.30it/s]
 79%|███████▉  | 294559/371472 [1:16:24<6:28:42,  3.30it/s]
 79%|███████▉  | 294560/371472 [1:16:24<6:15:37,  3.41it/s]
                                                           
{'loss': 2.5249, 'learning_rate': 2.8644228490163543e-07, 'epoch': 12.69}

 79%|███████▉  | 294560/371472 [1:16:24<6:15:37,  3.41it/s]
 79%|███████▉  | 294561/371472 [1:16:24<6:07:29,  3.49it/s]
 79%|███████▉  | 294562/371472 [1:16:25<6:15:11,  3.42it/s]
 79%|███████▉  | 294563/371472 [1:16:25<6:01:30,  3.55it/s]
 79%|███████▉  | 294564/371472 [1:16:25<6:49:19,  3.13it/s]
 79%|███████▉  | 294565/371472 [1:16:26<6:28:50,  3.30it/s]
 79%|███████▉  | 294566/371472 [1:16:26<6:27:25,  3.31it/s]
 79%|███████▉  | 294567/371472 [1:16:26<6:25:03,  3.33it/s]
 79%|███████▉  | 294568/371472 [1:16:27<6:25:50,  3.32it/s]
 79%|███████▉  | 294569/371472 [1:16:27<6:22:03,  3.35it/s]
 79%|███████▉  | 294570/371472 [1:16:27<6:21:26,  3.36it/s]
 79%|███████▉  | 294571/371472 [1:16:27<6:09:10,  3.47it/s]
 79%|███████▉  | 294572/371472 [1:16:28<5:51:15,  3.65it/s]
 79%|███████▉  | 294573/371472 [1:16:28<5:53:28,  3.63it/s]
 79%|███████▉  | 294574/371472 [1:16:28<5:58:41,  3.57it/s]
 79%|███████▉  | 294575/371472 [1:16:28<6:06:03,  3.50it/s]
 79%|███████▉  | 294576/371472 [1:16:29<6:12:51,  3.44it/s]
 79%|███████▉  | 294577/371472 [1:16:29<6:17:03,  3.40it/s]
 79%|███████▉  | 294578/371472 [1:16:29<6:03:21,  3.53it/s]
 79%|███████▉  | 294579/371472 [1:16:30<6:10:32,  3.46it/s]
 79%|███████▉  | 294580/371472 [1:16:30<6:18:07,  3.39it/s]
                                                           
{'loss': 2.5256, 'learning_rate': 2.863938029261565e-07, 'epoch': 12.69}

 79%|███████▉  | 294580/371472 [1:16:30<6:18:07,  3.39it/s]
 79%|███████▉  | 294581/371472 [1:16:30<6:13:27,  3.43it/s]
 79%|███████▉  | 294582/371472 [1:16:31<6:17:05,  3.40it/s]
 79%|███████▉  | 294583/371472 [1:16:31<5:59:05,  3.57it/s]
 79%|███████▉  | 294584/371472 [1:16:31<6:22:17,  3.35it/s]
 79%|███████▉  | 294585/371472 [1:16:31<6:04:07,  3.52it/s]
 79%|███████▉  | 294586/371472 [1:16:32<6:10:30,  3.46it/s]
 79%|███████▉  | 294587/371472 [1:16:32<6:08:56,  3.47it/s]
 79%|███████▉  | 294588/371472 [1:16:32<5:57:31,  3.58it/s]
 79%|███████▉  | 294589/371472 [1:16:33<6:24:15,  3.33it/s]
 79%|███████▉  | 294590/371472 [1:16:33<6:18:20,  3.39it/s]
 79%|███████▉  | 294591/371472 [1:16:33<6:37:13,  3.23it/s]
 79%|███████▉  | 294592/371472 [1:16:33<6:24:52,  3.33it/s]
 79%|███████▉  | 294593/371472 [1:16:34<6:46:46,  3.15it/s]
 79%|███████▉  | 294594/371472 [1:16:34<6:31:18,  3.27it/s]
 79%|███████▉  | 294595/371472 [1:16:34<6:20:55,  3.36it/s]
 79%|███████▉  | 294596/371472 [1:16:35<6:20:46,  3.36it/s]
 79%|███████▉  | 294597/371472 [1:16:35<6:03:55,  3.52it/s]
 79%|███████▉  | 294598/371472 [1:16:35<5:55:16,  3.61it/s]
 79%|███████▉  | 294599/371472 [1:16:35<5:51:55,  3.64it/s]
 79%|███████▉  | 294600/371472 [1:16:36<5:53:43,  3.62it/s]
                                                           
{'loss': 2.5343, 'learning_rate': 2.863453209506777e-07, 'epoch': 12.69}

 79%|███████▉  | 294600/371472 [1:16:36<5:53:43,  3.62it/s]
 79%|███████▉  | 294601/371472 [1:16:36<6:08:38,  3.48it/s]
 79%|███████▉  | 294602/371472 [1:16:36<6:05:58,  3.50it/s]
 79%|███████▉  | 294603/371472 [1:16:37<5:58:02,  3.58it/s]
 79%|███████▉  | 294604/371472 [1:16:37<6:01:20,  3.55it/s]
 79%|███████▉  | 294605/371472 [1:16:37<5:53:50,  3.62it/s]
 79%|███████▉  | 294606/371472 [1:16:37<5:41:05,  3.76it/s]
 79%|███████▉  | 294607/371472 [1:16:38<5:43:53,  3.73it/s]
 79%|███████▉  | 294608/371472 [1:16:38<6:02:03,  3.54it/s]
 79%|███████▉  | 294609/371472 [1:16:38<5:51:18,  3.65it/s]
 79%|███████▉  | 294610/371472 [1:16:39<5:55:16,  3.61it/s]
 79%|███████▉  | 294611/371472 [1:16:39<5:40:53,  3.76it/s]
 79%|███████▉  | 294612/371472 [1:16:39<5:56:56,  3.59it/s]
 79%|███████▉  | 294613/371472 [1:16:39<5:51:25,  3.65it/s]
 79%|███████▉  | 294614/371472 [1:16:40<5:45:40,  3.71it/s]
 79%|███████▉  | 294615/371472 [1:16:40<5:41:26,  3.75it/s]
 79%|███████▉  | 294616/371472 [1:16:40<6:05:12,  3.51it/s]
 79%|███████▉  | 294617/371472 [1:16:40<5:56:30,  3.59it/s]
 79%|███████▉  | 294618/371472 [1:16:41<5:47:36,  3.68it/s]
 79%|███████▉  | 294619/371472 [1:16:41<6:05:12,  3.51it/s]
 79%|███████▉  | 294620/371472 [1:16:41<6:01:01,  3.55it/s]
                                                           
{'loss': 2.6197, 'learning_rate': 2.8629683897519875e-07, 'epoch': 12.69}

 79%|███████▉  | 294620/371472 [1:16:41<6:01:01,  3.55it/s]
 79%|███████▉  | 294621/371472 [1:16:42<5:59:29,  3.56it/s]
 79%|███████▉  | 294622/371472 [1:16:42<6:16:58,  3.40it/s]
 79%|███████▉  | 294623/371472 [1:16:42<6:01:01,  3.55it/s]
 79%|███████▉  | 294624/371472 [1:16:42<5:52:38,  3.63it/s]
 79%|███████▉  | 294625/371472 [1:16:43<5:52:26,  3.63it/s]
 79%|███████▉  | 294626/371472 [1:16:43<5:57:15,  3.58it/s]
 79%|███████▉  | 294627/371472 [1:16:43<5:47:45,  3.68it/s]
 79%|███████▉  | 294628/371472 [1:16:44<5:53:30,  3.62it/s]
 79%|███████▉  | 294629/371472 [1:16:44<6:01:19,  3.54it/s]
 79%|███████▉  | 294630/371472 [1:16:44<6:03:31,  3.52it/s]
 79%|███████▉  | 294631/371472 [1:16:44<5:56:28,  3.59it/s]
 79%|███████▉  | 294632/371472 [1:16:45<6:01:12,  3.55it/s]
 79%|███████▉  | 294633/371472 [1:16:45<5:56:34,  3.59it/s]
 79%|███████▉  | 294634/371472 [1:16:45<5:49:46,  3.66it/s]
 79%|███████▉  | 294635/371472 [1:16:45<5:50:39,  3.65it/s]
 79%|███████▉  | 294636/371472 [1:16:46<5:52:10,  3.64it/s]
 79%|███████▉  | 294637/371472 [1:16:46<5:52:22,  3.63it/s]
 79%|███████▉  | 294638/371472 [1:16:46<5:59:42,  3.56it/s]
 79%|███████▉  | 294639/371472 [1:16:47<5:54:18,  3.61it/s]
 79%|███████▉  | 294640/371472 [1:16:47<6:00:13,  3.55it/s]
                                                           
{'loss': 2.6576, 'learning_rate': 2.8624835699971993e-07, 'epoch': 12.69}

 79%|███████▉  | 294640/371472 [1:16:47<6:00:13,  3.55it/s]
 79%|███████▉  | 294641/371472 [1:16:47<6:10:24,  3.46it/s]
 79%|███████▉  | 294642/371472 [1:16:47<6:10:47,  3.45it/s]
 79%|███████▉  | 294643/371472 [1:16:48<6:00:43,  3.55it/s]
 79%|███████▉  | 294644/371472 [1:16:48<5:48:33,  3.67it/s]
 79%|███████▉  | 294645/371472 [1:16:48<5:46:18,  3.70it/s]
 79%|███████▉  | 294646/371472 [1:16:49<5:52:56,  3.63it/s]
 79%|███████▉  | 294647/371472 [1:16:49<5:50:23,  3.65it/s]
 79%|███████▉  | 294648/371472 [1:16:49<6:13:20,  3.43it/s]
 79%|███████▉  | 294649/371472 [1:16:49<6:16:41,  3.40it/s]
 79%|███████▉  | 294650/371472 [1:16:50<6:19:33,  3.37it/s]
 79%|███████▉  | 294651/371472 [1:16:50<6:14:26,  3.42it/s]
 79%|███████▉  | 294652/371472 [1:16:50<6:08:52,  3.47it/s]
 79%|███████▉  | 294653/371472 [1:16:51<6:00:31,  3.55it/s]
 79%|███████▉  | 294654/371472 [1:16:51<5:49:23,  3.66it/s]
 79%|███████▉  | 294655/371472 [1:16:51<5:53:44,  3.62it/s]
 79%|███████▉  | 294656/371472 [1:16:51<6:31:12,  3.27it/s]
 79%|███████▉  | 294657/371472 [1:16:52<6:45:03,  3.16it/s]
 79%|███████▉  | 294658/371472 [1:16:52<6:42:55,  3.18it/s]
 79%|███████▉  | 294659/371472 [1:16:52<6:25:58,  3.32it/s]
 79%|███████▉  | 294660/371472 [1:16:53<6:52:37,  3.10it/s]
                                                           
{'loss': 2.7261, 'learning_rate': 2.861998750242409e-07, 'epoch': 12.69}

 79%|███████▉  | 294660/371472 [1:16:53<6:52:37,  3.10it/s]
 79%|███████▉  | 294661/371472 [1:16:53<6:20:52,  3.36it/s]
 79%|███████▉  | 294662/371472 [1:16:53<6:11:04,  3.45it/s]
 79%|███████▉  | 294663/371472 [1:16:54<6:06:16,  3.50it/s]
 79%|███████▉  | 294664/371472 [1:16:54<5:55:19,  3.60it/s]
 79%|███████▉  | 294665/371472 [1:16:54<5:59:00,  3.57it/s]
 79%|███████▉  | 294666/371472 [1:16:54<5:43:20,  3.73it/s]
 79%|███████▉  | 294667/371472 [1:16:55<5:44:54,  3.71it/s]
 79%|███████▉  | 294668/371472 [1:16:55<5:42:37,  3.74it/s]
 79%|███████▉  | 294669/371472 [1:16:55<5:37:12,  3.80it/s]
 79%|███████▉  | 294670/371472 [1:16:55<5:45:55,  3.70it/s]
 79%|███████▉  | 294671/371472 [1:16:56<6:02:21,  3.53it/s]
 79%|███████▉  | 294672/371472 [1:16:56<5:57:20,  3.58it/s]
 79%|███████▉  | 294673/371472 [1:16:56<6:11:51,  3.44it/s]
 79%|███████▉  | 294674/371472 [1:16:57<6:04:09,  3.51it/s]
 79%|███████▉  | 294675/371472 [1:16:57<6:01:14,  3.54it/s]
 79%|███████▉  | 294676/371472 [1:16:57<5:49:47,  3.66it/s]
 79%|███████▉  | 294677/371472 [1:16:57<5:49:20,  3.66it/s]
 79%|███████▉  | 294678/371472 [1:16:58<5:43:19,  3.73it/s]
 79%|███████▉  | 294679/371472 [1:16:58<6:04:31,  3.51it/s]
 79%|███████▉  | 294680/371472 [1:16:58<5:57:34,  3.58it/s]
                                                           
{'loss': 2.703, 'learning_rate': 2.861513930487621e-07, 'epoch': 12.69}

 79%|███████▉  | 294680/371472 [1:16:58<5:57:34,  3.58it/s]
 79%|███████▉  | 294681/371472 [1:16:59<6:12:56,  3.43it/s]
 79%|███████▉  | 294682/371472 [1:16:59<6:00:06,  3.55it/s]
 79%|███████▉  | 294683/371472 [1:16:59<6:20:05,  3.37it/s]
 79%|███████▉  | 294684/371472 [1:16:59<6:08:19,  3.47it/s]
 79%|███████▉  | 294685/371472 [1:17:00<6:21:54,  3.35it/s]
 79%|███████▉  | 294686/371472 [1:17:00<6:09:14,  3.47it/s]
 79%|███████▉  | 294687/371472 [1:17:00<6:56:10,  3.08it/s]
 79%|███████▉  | 294688/371472 [1:17:01<6:30:47,  3.27it/s]
 79%|███████▉  | 294689/371472 [1:17:01<6:09:57,  3.46it/s]
 79%|███████▉  | 294690/371472 [1:17:01<5:59:53,  3.56it/s]
 79%|███████▉  | 294691/371472 [1:17:01<6:05:59,  3.50it/s]
 79%|███████▉  | 294692/371472 [1:17:02<5:56:53,  3.59it/s]
 79%|███████▉  | 294693/371472 [1:17:02<6:07:17,  3.48it/s]
 79%|███████▉  | 294694/371472 [1:17:02<6:06:55,  3.49it/s]
 79%|███████▉  | 294695/371472 [1:17:03<5:56:11,  3.59it/s]
 79%|███████▉  | 294696/371472 [1:17:03<6:02:45,  3.53it/s]
 79%|███████▉  | 294697/371472 [1:17:03<6:02:03,  3.53it/s]
 79%|███████▉  | 294698/371472 [1:17:03<5:55:15,  3.60it/s]
 79%|███████▉  | 294699/371472 [1:17:04<6:10:55,  3.45it/s]
 79%|███████▉  | 294700/371472 [1:17:04<5:53:07,  3.62it/s]
                                                           
{'loss': 2.5973, 'learning_rate': 2.8610291107328315e-07, 'epoch': 12.69}

 79%|███████▉  | 294700/371472 [1:17:04<5:53:07,  3.62it/s]
 79%|███████▉  | 294701/371472 [1:17:04<5:45:58,  3.70it/s]
 79%|███████▉  | 294702/371472 [1:17:05<5:46:48,  3.69it/s]
 79%|███████▉  | 294703/371472 [1:17:05<6:10:49,  3.45it/s]
 79%|███████▉  | 294704/371472 [1:17:05<6:02:21,  3.53it/s]
 79%|███████▉  | 294705/371472 [1:17:05<5:58:15,  3.57it/s]
 79%|███████▉  | 294706/371472 [1:17:06<5:47:51,  3.68it/s]
 79%|███████▉  | 294707/371472 [1:17:06<5:52:25,  3.63it/s]
 79%|███████▉  | 294708/371472 [1:17:06<6:03:00,  3.52it/s]
 79%|███████▉  | 294709/371472 [1:17:07<6:05:04,  3.50it/s]
 79%|███████▉  | 294710/371472 [1:17:07<6:05:10,  3.50it/s]
 79%|███████▉  | 294711/371472 [1:17:07<5:59:54,  3.55it/s]
 79%|███████▉  | 294712/371472 [1:17:07<5:58:36,  3.57it/s]
 79%|███████▉  | 294713/371472 [1:17:08<5:46:21,  3.69it/s]
 79%|███████▉  | 294714/371472 [1:17:08<5:43:42,  3.72it/s]
 79%|███████▉  | 294715/371472 [1:17:08<6:10:14,  3.46it/s]
 79%|███████▉  | 294716/371472 [1:17:08<6:07:59,  3.48it/s]
 79%|███████▉  | 294717/371472 [1:17:09<6:04:34,  3.51it/s]
 79%|███████▉  | 294718/371472 [1:17:09<6:03:13,  3.52it/s]
 79%|███████▉  | 294719/371472 [1:17:09<6:00:56,  3.54it/s]
 79%|███████▉  | 294720/371472 [1:17:10<6:04:34,  3.51it/s]
                                                           
{'loss': 2.4556, 'learning_rate': 2.860544290978043e-07, 'epoch': 12.69}

 79%|███████▉  | 294720/371472 [1:17:10<6:04:34,  3.51it/s]
 79%|███████▉  | 294721/371472 [1:17:10<6:15:07,  3.41it/s]
 79%|███████▉  | 294722/371472 [1:17:10<6:39:43,  3.20it/s]
 79%|███████▉  | 294723/371472 [1:17:11<6:16:27,  3.40it/s]
 79%|███████▉  | 294724/371472 [1:17:11<6:09:35,  3.46it/s]
 79%|███████▉  | 294725/371472 [1:17:11<6:23:32,  3.34it/s]
 79%|███████▉  | 294726/371472 [1:17:11<6:08:01,  3.48it/s]
 79%|███████▉  | 294727/371472 [1:17:12<6:13:42,  3.42it/s]
 79%|███████▉  | 294728/371472 [1:17:12<6:23:33,  3.33it/s]
 79%|███████▉  | 294729/371472 [1:17:12<6:08:34,  3.47it/s]
 79%|███████▉  | 294730/371472 [1:17:13<6:24:27,  3.33it/s]
 79%|███████▉  | 294731/371472 [1:17:13<6:11:26,  3.44it/s]
 79%|███████▉  | 294732/371472 [1:17:13<6:06:42,  3.49it/s]
 79%|███████▉  | 294733/371472 [1:17:13<5:55:47,  3.59it/s]
 79%|███████▉  | 294734/371472 [1:17:14<6:17:09,  3.39it/s]
 79%|███████▉  | 294735/371472 [1:17:14<6:10:51,  3.45it/s]
 79%|███████▉  | 294736/371472 [1:17:14<6:20:55,  3.36it/s]
 79%|███████▉  | 294737/371472 [1:17:15<5:59:02,  3.56it/s]
 79%|███████▉  | 294738/371472 [1:17:15<6:01:57,  3.53it/s]
 79%|███████▉  | 294739/371472 [1:17:15<5:57:44,  3.57it/s]
 79%|███████▉  | 294740/371472 [1:17:15<6:00:20,  3.55it/s]
                                                           
{'loss': 2.5586, 'learning_rate': 2.860059471223254e-07, 'epoch': 12.7}

 79%|███████▉  | 294740/371472 [1:17:15<6:00:20,  3.55it/s]
 79%|███████▉  | 294741/371472 [1:17:16<5:55:33,  3.60it/s]
 79%|███████▉  | 294742/371472 [1:17:16<5:51:49,  3.63it/s]
 79%|███████▉  | 294743/371472 [1:17:16<6:08:08,  3.47it/s]
 79%|███████▉  | 294744/371472 [1:17:17<6:12:39,  3.43it/s]
 79%|███████▉  | 294745/371472 [1:17:17<6:17:42,  3.39it/s]
 79%|███████▉  | 294746/371472 [1:17:17<6:11:13,  3.44it/s]
 79%|███████▉  | 294747/371472 [1:17:18<6:28:57,  3.29it/s]
 79%|███████▉  | 294748/371472 [1:17:18<6:15:19,  3.41it/s]
 79%|███████▉  | 294749/371472 [1:17:18<6:08:08,  3.47it/s]
 79%|███████▉  | 294750/371472 [1:17:18<6:02:47,  3.52it/s]
 79%|███████▉  | 294751/371472 [1:17:19<6:10:55,  3.45it/s]
 79%|███████▉  | 294752/371472 [1:17:19<5:56:49,  3.58it/s]
 79%|███████▉  | 294753/371472 [1:17:19<5:49:50,  3.65it/s]
 79%|███████▉  | 294754/371472 [1:17:19<5:51:42,  3.64it/s]
 79%|███████▉  | 294755/371472 [1:17:20<5:52:11,  3.63it/s]
 79%|███████▉  | 294756/371472 [1:17:20<6:06:39,  3.49it/s]
 79%|███████▉  | 294757/371472 [1:17:20<5:52:36,  3.63it/s]
 79%|███████▉  | 294758/371472 [1:17:21<5:44:53,  3.71it/s]
 79%|███████▉  | 294759/371472 [1:17:21<5:42:27,  3.73it/s]
 79%|███████▉  | 294760/371472 [1:17:21<5:42:21,  3.73it/s]
                                                           
{'loss': 2.5931, 'learning_rate': 2.859574651468466e-07, 'epoch': 12.7}

 79%|███████▉  | 294760/371472 [1:17:21<5:42:21,  3.73it/s]
 79%|███████▉  | 294761/371472 [1:17:21<5:41:02,  3.75it/s]
 79%|███████▉  | 294762/371472 [1:17:22<5:40:10,  3.76it/s]
 79%|███████▉  | 294763/371472 [1:17:22<5:35:19,  3.81it/s]
 79%|███████▉  | 294764/371472 [1:17:22<5:42:45,  3.73it/s]
 79%|███████▉  | 294765/371472 [1:17:22<5:46:40,  3.69it/s]
 79%|███████▉  | 294766/371472 [1:17:23<5:54:22,  3.61it/s]
 79%|███████▉  | 294767/371472 [1:17:23<5:56:07,  3.59it/s]
 79%|███████▉  | 294768/371472 [1:17:23<5:58:13,  3.57it/s]
 79%|███████▉  | 294769/371472 [1:17:24<5:59:06,  3.56it/s]
 79%|███████▉  | 294770/371472 [1:17:24<5:53:09,  3.62it/s]
 79%|███████▉  | 294771/371472 [1:17:24<5:49:17,  3.66it/s]
 79%|███████▉  | 294772/371472 [1:17:24<6:15:55,  3.40it/s]
 79%|███████▉  | 294773/371472 [1:17:25<6:04:19,  3.51it/s]
 79%|███████▉  | 294774/371472 [1:17:25<5:59:04,  3.56it/s]
 79%|███████▉  | 294775/371472 [1:17:25<6:04:29,  3.51it/s]
 79%|███████▉  | 294776/371472 [1:17:25<5:50:26,  3.65it/s]
 79%|███████▉  | 294777/371472 [1:17:26<5:52:53,  3.62it/s]
 79%|███████▉  | 294778/371472 [1:17:26<5:48:58,  3.66it/s]
 79%|███████▉  | 294779/371472 [1:17:26<5:56:14,  3.59it/s]
 79%|███████▉  | 294780/371472 [1:17:27<5:54:29,  3.61it/s]
                                                           
{'loss': 2.6477, 'learning_rate': 2.859089831713676e-07, 'epoch': 12.7}

 79%|███████▉  | 294780/371472 [1:17:27<5:54:29,  3.61it/s]
 79%|███████▉  | 294781/371472 [1:17:27<5:45:18,  3.70it/s]
 79%|███████▉  | 294782/371472 [1:17:27<5:46:13,  3.69it/s]
 79%|███████▉  | 294783/371472 [1:17:27<5:53:19,  3.62it/s]
 79%|███████▉  | 294784/371472 [1:17:28<5:46:19,  3.69it/s]
 79%|███████▉  | 294785/371472 [1:17:28<5:38:37,  3.77it/s]
 79%|███████▉  | 294786/371472 [1:17:28<5:33:46,  3.83it/s]
 79%|███████▉  | 294787/371472 [1:17:28<5:48:44,  3.66it/s]
 79%|███████▉  | 294788/371472 [1:17:29<5:51:46,  3.63it/s]
 79%|███████▉  | 294789/371472 [1:17:29<6:03:41,  3.51it/s]
 79%|███████▉  | 294790/371472 [1:17:29<5:52:07,  3.63it/s]
 79%|███████▉  | 294791/371472 [1:17:30<5:56:03,  3.59it/s]
 79%|███████▉  | 294792/371472 [1:17:30<6:30:22,  3.27it/s]
 79%|███████▉  | 294793/371472 [1:17:30<6:13:24,  3.42it/s]
 79%|███████▉  | 294794/371472 [1:17:31<6:05:27,  3.50it/s]
 79%|███████▉  | 294795/371472 [1:17:31<5:58:18,  3.57it/s]
 79%|███████▉  | 294796/371472 [1:17:31<6:07:37,  3.48it/s]
 79%|███████▉  | 294797/371472 [1:17:31<6:03:21,  3.52it/s]
 79%|███████▉  | 294798/371472 [1:17:32<6:12:21,  3.43it/s]
 79%|███████▉  | 294799/371472 [1:17:32<6:14:25,  3.41it/s]
 79%|███████▉  | 294800/371472 [1:17:32<6:08:00,  3.47it/s]
                                                           
{'loss': 2.569, 'learning_rate': 2.8586050119588877e-07, 'epoch': 12.7}

 79%|███████▉  | 294800/371472 [1:17:32<6:08:00,  3.47it/s]
 79%|███████▉  | 294801/371472 [1:17:33<6:13:56,  3.42it/s]
 79%|███████▉  | 294802/371472 [1:17:33<6:16:45,  3.39it/s]
 79%|███████▉  | 294803/371472 [1:17:33<6:10:45,  3.45it/s]
 79%|███████▉  | 294804/371472 [1:17:33<5:53:25,  3.62it/s]
 79%|███████▉  | 294805/371472 [1:17:34<5:50:41,  3.64it/s]
 79%|███████▉  | 294806/371472 [1:17:34<6:07:06,  3.48it/s]
 79%|███████▉  | 294807/371472 [1:17:34<6:03:33,  3.51it/s]
 79%|███████▉  | 294808/371472 [1:17:34<5:53:24,  3.62it/s]
 79%|███████▉  | 294809/371472 [1:17:35<5:54:26,  3.60it/s]
 79%|███████▉  | 294810/371472 [1:17:35<6:03:48,  3.51it/s]
 79%|███████▉  | 294811/371472 [1:17:35<5:59:45,  3.55it/s]
 79%|███████▉  | 294812/371472 [1:17:36<6:03:36,  3.51it/s]
 79%|███████▉  | 294813/371472 [1:17:36<6:02:35,  3.52it/s]
 79%|███████▉  | 294814/371472 [1:17:36<6:11:34,  3.44it/s]
 79%|███████▉  | 294815/371472 [1:17:36<6:05:26,  3.50it/s]
 79%|███████▉  | 294816/371472 [1:17:37<6:03:08,  3.52it/s]
 79%|███████▉  | 294817/371472 [1:17:37<6:20:27,  3.36it/s]
 79%|███████▉  | 294818/371472 [1:17:37<6:33:12,  3.25it/s]
 79%|███████▉  | 294819/371472 [1:17:38<6:29:46,  3.28it/s]
 79%|███████▉  | 294820/371472 [1:17:38<6:44:28,  3.16it/s]
                                                           
{'loss': 2.6582, 'learning_rate': 2.858120192204098e-07, 'epoch': 12.7}

 79%|███████▉  | 294820/371472 [1:17:38<6:44:28,  3.16it/s]
 79%|███████▉  | 294821/371472 [1:17:38<6:35:47,  3.23it/s]
 79%|███████▉  | 294822/371472 [1:17:39<6:26:03,  3.31it/s]
 79%|███████▉  | 294823/371472 [1:17:39<6:14:27,  3.41it/s]
 79%|███████▉  | 294824/371472 [1:17:39<6:00:40,  3.54it/s]
 79%|███████▉  | 294825/371472 [1:17:39<6:10:29,  3.45it/s]
 79%|███████▉  | 294826/371472 [1:17:40<6:00:24,  3.54it/s]
 79%|███████▉  | 294827/371472 [1:17:40<6:18:35,  3.37it/s]
 79%|███████▉  | 294828/371472 [1:17:40<6:01:48,  3.53it/s]
 79%|███████▉  | 294829/371472 [1:17:41<6:19:08,  3.37it/s]
 79%|███████▉  | 294830/371472 [1:17:41<6:25:36,  3.31it/s]
 79%|███████▉  | 294831/371472 [1:17:41<6:05:24,  3.50it/s]
 79%|███████▉  | 294832/371472 [1:17:41<5:52:28,  3.62it/s]
 79%|███████▉  | 294833/371472 [1:17:42<5:50:11,  3.65it/s]
 79%|███████▉  | 294834/371472 [1:17:42<5:42:54,  3.72it/s]
 79%|███████▉  | 294835/371472 [1:17:42<5:33:57,  3.82it/s]
 79%|███████▉  | 294836/371472 [1:17:43<6:01:25,  3.53it/s]
 79%|███████▉  | 294837/371472 [1:17:43<5:58:05,  3.57it/s]
 79%|███████▉  | 294838/371472 [1:17:43<5:58:32,  3.56it/s]
 79%|███████▉  | 294839/371472 [1:17:43<6:06:40,  3.48it/s]
 79%|███████▉  | 294840/371472 [1:17:44<6:22:32,  3.34it/s]
                                                           
{'loss': 2.5656, 'learning_rate': 2.8576353724493096e-07, 'epoch': 12.7}

 79%|███████▉  | 294840/371472 [1:17:44<6:22:32,  3.34it/s]
 79%|███████▉  | 294841/371472 [1:17:44<6:55:24,  3.07it/s]
 79%|███████▉  | 294842/371472 [1:17:44<6:22:28,  3.34it/s]
 79%|███████▉  | 294843/371472 [1:17:45<6:08:32,  3.47it/s]
 79%|███████▉  | 294844/371472 [1:17:45<6:09:10,  3.46it/s]
 79%|███████▉  | 294845/371472 [1:17:45<6:06:42,  3.48it/s]
 79%|███████▉  | 294846/371472 [1:17:46<6:22:36,  3.34it/s]
 79%|███████▉  | 294847/371472 [1:17:46<6:00:32,  3.54it/s]
 79%|███████▉  | 294848/371472 [1:17:46<5:52:08,  3.63it/s]
 79%|███████▉  | 294849/371472 [1:17:46<6:01:12,  3.54it/s]
 79%|███████▉  | 294850/371472 [1:17:47<6:43:09,  3.17it/s]
 79%|███████▉  | 294851/371472 [1:17:47<6:47:50,  3.13it/s]
 79%|███████▉  | 294852/371472 [1:17:47<6:25:32,  3.31it/s]
 79%|███████▉  | 294853/371472 [1:17:48<6:26:32,  3.30it/s]
 79%|███████▉  | 294854/371472 [1:17:48<6:32:23,  3.25it/s]
 79%|███████▉  | 294855/371472 [1:17:48<6:14:14,  3.41it/s]
 79%|███████▉  | 294856/371472 [1:17:49<6:16:29,  3.39it/s]
 79%|███████▉  | 294857/371472 [1:17:49<6:05:20,  3.50it/s]
 79%|███████▉  | 294858/371472 [1:17:49<6:18:44,  3.37it/s]
 79%|███████▉  | 294859/371472 [1:17:49<6:02:36,  3.52it/s]
 79%|███████▉  | 294860/371472 [1:17:50<6:46:30,  3.14it/s]
                                                           
{'loss': 2.3716, 'learning_rate': 2.8571505526945204e-07, 'epoch': 12.7}

 79%|███████▉  | 294860/371472 [1:17:50<6:46:30,  3.14it/s]
 79%|███████▉  | 294861/371472 [1:17:50<6:34:22,  3.24it/s]
 79%|███████▉  | 294862/371472 [1:17:50<6:11:41,  3.44it/s]
 79%|███████▉  | 294863/371472 [1:17:51<6:09:01,  3.46it/s]
 79%|███████▉  | 294864/371472 [1:17:51<6:08:34,  3.46it/s]
 79%|███████▉  | 294865/371472 [1:17:51<6:39:25,  3.20it/s]
 79%|███████▉  | 294866/371472 [1:17:51<6:15:01,  3.40it/s]
 79%|███████▉  | 294867/371472 [1:17:52<6:00:02,  3.55it/s]
 79%|███████▉  | 294868/371472 [1:17:52<6:01:21,  3.53it/s]
 79%|███████▉  | 294869/371472 [1:17:52<6:05:40,  3.49it/s]
 79%|███████▉  | 294870/371472 [1:17:53<5:52:34,  3.62it/s]
 79%|███████▉  | 294871/371472 [1:17:53<5:38:40,  3.77it/s]
 79%|███████▉  | 294872/371472 [1:17:53<5:35:50,  3.80it/s]
 79%|███████▉  | 294873/371472 [1:17:53<5:37:56,  3.78it/s]
 79%|███████▉  | 294874/371472 [1:17:54<5:28:09,  3.89it/s]
 79%|███████▉  | 294875/371472 [1:17:54<5:21:32,  3.97it/s]
 79%|███████▉  | 294876/371472 [1:17:54<5:32:09,  3.84it/s]
 79%|███████▉  | 294877/371472 [1:17:54<5:36:00,  3.80it/s]
 79%|███████▉  | 294878/371472 [1:17:55<5:54:17,  3.60it/s]
 79%|███████▉  | 294879/371472 [1:17:55<5:52:03,  3.63it/s]
 79%|███████▉  | 294880/371472 [1:17:55<5:57:15,  3.57it/s]
                                                           
{'loss': 2.7706, 'learning_rate': 2.856665732939731e-07, 'epoch': 12.7}

 79%|███████▉  | 294880/371472 [1:17:55<5:57:15,  3.57it/s]
 79%|███████▉  | 294881/371472 [1:17:56<5:54:56,  3.60it/s]
 79%|███████▉  | 294882/371472 [1:17:56<6:13:14,  3.42it/s]
 79%|███████▉  | 294883/371472 [1:17:56<6:11:13,  3.44it/s]
 79%|███████▉  | 294884/371472 [1:17:56<6:35:13,  3.23it/s]
 79%|███████▉  | 294885/371472 [1:17:57<6:26:09,  3.31it/s]
 79%|███████▉  | 294886/371472 [1:17:57<6:16:17,  3.39it/s]
 79%|███████▉  | 294887/371472 [1:17:57<6:44:02,  3.16it/s]
 79%|███████▉  | 294888/371472 [1:17:58<6:30:28,  3.27it/s]
 79%|███████▉  | 294889/371472 [1:17:58<6:25:01,  3.32it/s]
 79%|███████▉  | 294890/371472 [1:17:58<6:13:03,  3.42it/s]
 79%|███████▉  | 294891/371472 [1:17:59<6:34:45,  3.23it/s]
 79%|███████▉  | 294892/371472 [1:17:59<6:29:09,  3.28it/s]
 79%|███████▉  | 294893/371472 [1:17:59<6:18:52,  3.37it/s]
 79%|███████▉  | 294894/371472 [1:17:59<6:19:58,  3.36it/s]
 79%|███████▉  | 294895/371472 [1:18:00<6:10:18,  3.45it/s]
 79%|███████▉  | 294896/371472 [1:18:00<5:59:42,  3.55it/s]
 79%|███████▉  | 294897/371472 [1:18:00<5:58:05,  3.56it/s]
 79%|███████▉  | 294898/371472 [1:18:01<5:52:08,  3.62it/s]
 79%|███████▉  | 294899/371472 [1:18:01<5:45:30,  3.69it/s]
 79%|███████▉  | 294900/371472 [1:18:01<5:48:08,  3.67it/s]
                                                           
{'loss': 2.5786, 'learning_rate': 2.856180913184943e-07, 'epoch': 12.7}

 79%|███████▉  | 294900/371472 [1:18:01<5:48:08,  3.67it/s]
 79%|███████▉  | 294901/371472 [1:18:01<5:48:33,  3.66it/s]
 79%|███████▉  | 294902/371472 [1:18:02<5:54:49,  3.60it/s]
 79%|███████▉  | 294903/371472 [1:18:02<5:53:08,  3.61it/s]
 79%|███████▉  | 294904/371472 [1:18:02<6:06:21,  3.48it/s]
 79%|███████▉  | 294905/371472 [1:18:03<6:00:24,  3.54it/s]
 79%|███████▉  | 294906/371472 [1:18:03<5:50:05,  3.65it/s]
 79%|███████▉  | 294907/371472 [1:18:03<5:41:39,  3.73it/s]
 79%|███████▉  | 294908/371472 [1:18:03<5:54:02,  3.60it/s]
 79%|███████▉  | 294909/371472 [1:18:04<6:00:34,  3.54it/s]
 79%|███████▉  | 294910/371472 [1:18:04<5:58:48,  3.56it/s]
 79%|███████▉  | 294911/371472 [1:18:04<6:03:28,  3.51it/s]
 79%|███████▉  | 294912/371472 [1:18:04<6:02:10,  3.52it/s]
 79%|███████▉  | 294913/371472 [1:18:05<6:15:28,  3.40it/s]
 79%|███████▉  | 294914/371472 [1:18:05<6:06:27,  3.48it/s]
 79%|███████▉  | 294915/371472 [1:18:05<6:04:39,  3.50it/s]
 79%|███████▉  | 294916/371472 [1:18:06<6:08:32,  3.46it/s]
 79%|███████▉  | 294917/371472 [1:18:06<6:00:14,  3.54it/s]
 79%|███████▉  | 294918/371472 [1:18:06<6:05:02,  3.50it/s]
 79%|███████▉  | 294919/371472 [1:18:06<5:52:01,  3.62it/s]
 79%|███████▉  | 294920/371472 [1:18:07<5:43:52,  3.71it/s]
                                                           
{'loss': 2.7228, 'learning_rate': 2.855696093430153e-07, 'epoch': 12.7}

 79%|███████▉  | 294920/371472 [1:18:07<5:43:52,  3.71it/s]
 79%|███████▉  | 294921/371472 [1:18:07<5:37:45,  3.78it/s]
 79%|███████▉  | 294922/371472 [1:18:07<6:50:38,  3.11it/s]
 79%|███████▉  | 294923/371472 [1:18:08<6:24:13,  3.32it/s]
 79%|███████▉  | 294924/371472 [1:18:08<6:52:56,  3.09it/s]
 79%|███████▉  | 294925/371472 [1:18:08<6:43:56,  3.16it/s]
 79%|███████▉  | 294926/371472 [1:18:09<6:43:26,  3.16it/s]
 79%|███████▉  | 294927/371472 [1:18:09<6:29:10,  3.28it/s]
 79%|███████▉  | 294928/371472 [1:18:09<6:15:19,  3.40it/s]
 79%|███████▉  | 294929/371472 [1:18:10<6:17:57,  3.38it/s]
 79%|███████▉  | 294930/371472 [1:18:10<6:08:32,  3.46it/s]
 79%|███████▉  | 294931/371472 [1:18:10<6:10:54,  3.44it/s]
 79%|███████▉  | 294932/371472 [1:18:10<5:57:55,  3.56it/s]
 79%|███████▉  | 294933/371472 [1:18:11<6:39:03,  3.20it/s]
 79%|███████▉  | 294934/371472 [1:18:11<6:21:47,  3.34it/s]
 79%|███████▉  | 294935/371472 [1:18:11<6:10:26,  3.44it/s]
 79%|███████▉  | 294936/371472 [1:18:12<6:03:42,  3.51it/s]
 79%|███████▉  | 294937/371472 [1:18:12<6:01:33,  3.53it/s]
 79%|███████▉  | 294938/371472 [1:18:12<5:59:16,  3.55it/s]
 79%|███████▉  | 294939/371472 [1:18:12<6:13:51,  3.41it/s]
 79%|███████▉  | 294940/371472 [1:18:13<6:14:40,  3.40it/s]
                                                           
{'loss': 2.5741, 'learning_rate': 2.8552112736753643e-07, 'epoch': 12.7}

 79%|███████▉  | 294940/371472 [1:18:13<6:14:40,  3.40it/s]
 79%|███████▉  | 294941/371472 [1:18:13<6:12:16,  3.43it/s]
 79%|███████▉  | 294942/371472 [1:18:13<5:58:50,  3.55it/s]
 79%|███████▉  | 294943/371472 [1:18:14<6:01:51,  3.52it/s]
 79%|███████▉  | 294944/371472 [1:18:14<5:49:48,  3.65it/s]
 79%|███████▉  | 294945/371472 [1:18:14<5:49:55,  3.64it/s]
 79%|███████▉  | 294946/371472 [1:18:14<5:49:19,  3.65it/s]
 79%|███████▉  | 294947/371472 [1:18:15<5:40:45,  3.74it/s]
 79%|███████▉  | 294948/371472 [1:18:15<6:02:54,  3.51it/s]
 79%|███████▉  | 294949/371472 [1:18:15<6:17:29,  3.38it/s]
 79%|███████▉  | 294950/371472 [1:18:16<6:48:08,  3.12it/s]
 79%|███████▉  | 294951/371472 [1:18:16<6:27:21,  3.29it/s]
 79%|███████▉  | 294952/371472 [1:18:16<6:37:09,  3.21it/s]
 79%|███████▉  | 294953/371472 [1:18:16<6:15:37,  3.40it/s]
 79%|███████▉  | 294954/371472 [1:18:17<6:16:48,  3.38it/s]
 79%|███████▉  | 294955/371472 [1:18:17<6:34:06,  3.24it/s]
 79%|███████▉  | 294956/371472 [1:18:17<6:04:57,  3.49it/s]
 79%|███████▉  | 294957/371472 [1:18:18<5:53:07,  3.61it/s]
 79%|███████▉  | 294958/371472 [1:18:18<5:54:35,  3.60it/s]
 79%|███████▉  | 294959/371472 [1:18:18<5:59:33,  3.55it/s]
 79%|███████▉  | 294960/371472 [1:18:18<6:11:03,  3.44it/s]
                                                           
{'loss': 2.6002, 'learning_rate': 2.854726453920575e-07, 'epoch': 12.7}

 79%|███████▉  | 294960/371472 [1:18:18<6:11:03,  3.44it/s]
 79%|███████▉  | 294961/371472 [1:18:19<6:18:46,  3.37it/s]
 79%|███████▉  | 294962/371472 [1:18:19<6:33:57,  3.24it/s]
 79%|███████▉  | 294963/371472 [1:18:19<6:16:22,  3.39it/s]
 79%|███████▉  | 294964/371472 [1:18:20<6:34:01,  3.24it/s]
 79%|███████▉  | 294965/371472 [1:18:20<6:58:56,  3.04it/s]
 79%|███████▉  | 294966/371472 [1:18:20<7:04:33,  3.00it/s]
 79%|███████▉  | 294967/371472 [1:18:21<6:45:37,  3.14it/s]
 79%|███████▉  | 294968/371472 [1:18:21<6:26:36,  3.30it/s]
 79%|███████▉  | 294969/371472 [1:18:21<6:22:44,  3.33it/s]
 79%|███████▉  | 294970/371472 [1:18:22<6:13:50,  3.41it/s]
 79%|███████▉  | 294971/371472 [1:18:22<6:01:43,  3.52it/s]
 79%|███████▉  | 294972/371472 [1:18:22<5:46:19,  3.68it/s]
 79%|███████▉  | 294973/371472 [1:18:22<5:55:45,  3.58it/s]
 79%|███████▉  | 294974/371472 [1:18:23<5:52:53,  3.61it/s]
 79%|███████▉  | 294975/371472 [1:18:23<5:50:25,  3.64it/s]
 79%|███████▉  | 294976/371472 [1:18:23<6:04:04,  3.50it/s]
 79%|███████▉  | 294977/371472 [1:18:24<6:08:56,  3.46it/s]
 79%|███████▉  | 294978/371472 [1:18:24<6:38:52,  3.20it/s]
 79%|███████▉  | 294979/371472 [1:18:24<6:16:52,  3.38it/s]
 79%|███████▉  | 294980/371472 [1:18:24<6:19:50,  3.36it/s]
                                                           
{'loss': 2.6618, 'learning_rate': 2.854241634165787e-07, 'epoch': 12.71}

 79%|███████▉  | 294980/371472 [1:18:24<6:19:50,  3.36it/s]
 79%|███████▉  | 294981/371472 [1:18:25<6:22:00,  3.34it/s]
 79%|███████▉  | 294982/371472 [1:18:25<6:09:17,  3.45it/s]
 79%|███████▉  | 294983/371472 [1:18:25<6:06:17,  3.48it/s]
 79%|███████▉  | 294984/371472 [1:18:26<6:01:37,  3.53it/s]
 79%|███████▉  | 294985/371472 [1:18:26<5:49:21,  3.65it/s]
 79%|███████▉  | 294986/371472 [1:18:26<6:04:33,  3.50it/s]
 79%|███████▉  | 294987/371472 [1:18:27<6:57:10,  3.06it/s]
 79%|███████▉  | 294988/371472 [1:18:27<6:34:42,  3.23it/s]
 79%|███████▉  | 294989/371472 [1:18:27<6:20:37,  3.35it/s]
 79%|███████▉  | 294990/371472 [1:18:27<6:20:05,  3.35it/s]
 79%|███████▉  | 294991/371472 [1:18:28<6:12:19,  3.42it/s]
 79%|███████▉  | 294992/371472 [1:18:28<6:24:53,  3.31it/s]
 79%|███████▉  | 294993/371472 [1:18:28<6:10:07,  3.44it/s]
 79%|███████▉  | 294994/371472 [1:18:29<6:04:11,  3.50it/s]
 79%|███████▉  | 294995/371472 [1:18:29<5:55:39,  3.58it/s]
 79%|███████▉  | 294996/371472 [1:18:29<6:12:46,  3.42it/s]
 79%|███████▉  | 294997/371472 [1:18:29<6:16:07,  3.39it/s]
 79%|███████▉  | 294998/371472 [1:18:30<5:57:45,  3.56it/s]
 79%|███████▉  | 294999/371472 [1:18:30<6:24:41,  3.31it/s]
 79%|███████▉  | 295000/371472 [1:18:30<6:13:46,  3.41it/s]
                                                           
{'loss': 2.7533, 'learning_rate': 2.8537568144109975e-07, 'epoch': 12.71}

 79%|███████▉  | 295000/371472 [1:18:30<6:13:46,  3.41it/s]
 79%|███████▉  | 295001/371472 [1:18:31<6:04:32,  3.50it/s]
 79%|███████▉  | 295002/371472 [1:18:31<5:54:18,  3.60it/s]
 79%|███████▉  | 295003/371472 [1:18:31<6:18:01,  3.37it/s]
 79%|███████▉  | 295004/371472 [1:18:31<6:01:16,  3.53it/s]
 79%|███████▉  | 295005/371472 [1:18:32<6:02:41,  3.51it/s]
 79%|███████▉  | 295006/371472 [1:18:32<6:05:44,  3.48it/s]
 79%|███████▉  | 295007/371472 [1:18:32<5:50:36,  3.63it/s]
 79%|███████▉  | 295008/371472 [1:18:33<5:45:32,  3.69it/s]
 79%|███████▉  | 295009/371472 [1:18:33<5:50:31,  3.64it/s]
 79%|███████▉  | 295010/371472 [1:18:33<5:54:20,  3.60it/s]
 79%|███████▉  | 295011/371472 [1:18:33<5:48:04,  3.66it/s]
 79%|███████▉  | 295012/371472 [1:18:34<5:41:09,  3.74it/s]
 79%|███████▉  | 295013/371472 [1:18:34<5:36:55,  3.78it/s]
 79%|███████▉  | 295014/371472 [1:18:34<5:34:48,  3.81it/s]
 79%|███████▉  | 295015/371472 [1:18:34<5:27:28,  3.89it/s]
 79%|███████▉  | 295016/371472 [1:18:35<5:42:38,  3.72it/s]
 79%|███████▉  | 295017/371472 [1:18:35<6:30:25,  3.26it/s]
 79%|███████▉  | 295018/371472 [1:18:35<6:43:57,  3.15it/s]
 79%|███████▉  | 295019/371472 [1:18:36<6:17:26,  3.38it/s]
 79%|███████▉  | 295020/371472 [1:18:36<5:56:20,  3.58it/s]
                                                           
{'loss': 2.5936, 'learning_rate': 2.853271994656209e-07, 'epoch': 12.71}

 79%|███████▉  | 295020/371472 [1:18:36<5:56:20,  3.58it/s]
 79%|███████▉  | 295021/371472 [1:18:36<6:24:54,  3.31it/s]
 79%|███████▉  | 295022/371472 [1:18:36<6:01:40,  3.52it/s]
 79%|███████▉  | 295023/371472 [1:18:37<5:52:14,  3.62it/s]
 79%|███████▉  | 295024/371472 [1:18:37<5:51:09,  3.63it/s]
 79%|███████▉  | 295025/371472 [1:18:37<5:51:05,  3.63it/s]
 79%|███████▉  | 295026/371472 [1:18:38<5:46:21,  3.68it/s]
 79%|███████▉  | 295027/371472 [1:18:38<5:42:22,  3.72it/s]
 79%|███████▉  | 295028/371472 [1:18:38<5:45:40,  3.69it/s]
 79%|███████▉  | 295029/371472 [1:18:38<5:52:38,  3.61it/s]
 79%|███████▉  | 295030/371472 [1:18:39<5:37:14,  3.78it/s]
 79%|███████▉  | 295031/371472 [1:18:39<5:38:51,  3.76it/s]
 79%|███████▉  | 295032/371472 [1:18:39<5:47:31,  3.67it/s]
 79%|███████▉  | 295033/371472 [1:18:39<5:42:21,  3.72it/s]
 79%|███████▉  | 295034/371472 [1:18:40<5:35:14,  3.80it/s]
 79%|███████▉  | 295035/371472 [1:18:40<5:52:48,  3.61it/s]
 79%|███████▉  | 295036/371472 [1:18:40<6:05:27,  3.49it/s]
 79%|███████▉  | 295037/371472 [1:18:41<6:07:56,  3.46it/s]
 79%|███████▉  | 295038/371472 [1:18:41<6:09:26,  3.45it/s]
 79%|███████▉  | 295039/371472 [1:18:41<5:59:21,  3.54it/s]
 79%|███████▉  | 295040/371472 [1:18:41<6:16:37,  3.38it/s]
                                                           
{'loss': 2.7275, 'learning_rate': 2.8527871749014194e-07, 'epoch': 12.71}

 79%|███████▉  | 295040/371472 [1:18:41<6:16:37,  3.38it/s]
 79%|███████▉  | 295041/371472 [1:18:42<6:05:33,  3.48it/s]
 79%|███████▉  | 295042/371472 [1:18:42<5:50:55,  3.63it/s]
 79%|███████▉  | 295043/371472 [1:18:42<5:48:28,  3.66it/s]
 79%|███████▉  | 295044/371472 [1:18:43<5:42:30,  3.72it/s]
 79%|███████▉  | 295045/371472 [1:18:43<5:39:25,  3.75it/s]
 79%|███████▉  | 295046/371472 [1:18:43<5:39:11,  3.76it/s]
 79%|███████▉  | 295047/371472 [1:18:43<5:34:17,  3.81it/s]
 79%|███████▉  | 295048/371472 [1:18:44<5:46:55,  3.67it/s]
 79%|███████▉  | 295049/371472 [1:18:44<5:43:27,  3.71it/s]
 79%|███████▉  | 295050/371472 [1:18:44<6:04:22,  3.50it/s]
 79%|███████▉  | 295051/371472 [1:18:44<5:59:57,  3.54it/s]
 79%|███████▉  | 295052/371472 [1:18:45<5:52:40,  3.61it/s]
 79%|███████▉  | 295053/371472 [1:18:45<5:56:40,  3.57it/s]
 79%|███████▉  | 295054/371472 [1:18:45<5:46:55,  3.67it/s]
 79%|███████▉  | 295055/371472 [1:18:46<6:24:58,  3.31it/s]
 79%|███████▉  | 295056/371472 [1:18:46<6:20:00,  3.35it/s]
 79%|███████▉  | 295057/371472 [1:18:46<6:20:20,  3.35it/s]
 79%|███████▉  | 295058/371472 [1:18:46<6:06:01,  3.48it/s]
 79%|███████▉  | 295059/371472 [1:18:47<5:58:36,  3.55it/s]
 79%|███████▉  | 295060/371472 [1:18:47<6:09:18,  3.45it/s]
                                                           
{'loss': 2.5928, 'learning_rate': 2.852302355146631e-07, 'epoch': 12.71}

 79%|███████▉  | 295060/371472 [1:18:47<6:09:18,  3.45it/s]
 79%|███████▉  | 295061/371472 [1:18:47<6:14:32,  3.40it/s]
 79%|███████▉  | 295062/371472 [1:18:48<6:16:53,  3.38it/s]
 79%|███████▉  | 295063/371472 [1:18:48<6:21:38,  3.34it/s]
 79%|███████▉  | 295064/371472 [1:18:48<6:15:34,  3.39it/s]
 79%|███████▉  | 295065/371472 [1:18:49<6:16:46,  3.38it/s]
 79%|███████▉  | 295066/371472 [1:18:49<6:19:10,  3.36it/s]
 79%|███████▉  | 295067/371472 [1:18:49<6:39:57,  3.18it/s]
 79%|███████▉  | 295068/371472 [1:18:49<6:21:23,  3.34it/s]
 79%|███████▉  | 295069/371472 [1:18:50<6:11:09,  3.43it/s]
 79%|███████▉  | 295070/371472 [1:18:50<6:37:11,  3.21it/s]
 79%|███████▉  | 295071/371472 [1:18:50<6:32:38,  3.24it/s]
 79%|███████▉  | 295072/371472 [1:18:51<6:19:19,  3.36it/s]
 79%|███████▉  | 295073/371472 [1:18:51<6:06:04,  3.48it/s]
 79%|███████▉  | 295074/371472 [1:18:51<5:55:58,  3.58it/s]
 79%|███████▉  | 295075/371472 [1:18:51<5:53:15,  3.60it/s]
 79%|███████▉  | 295076/371472 [1:18:52<5:57:46,  3.56it/s]
 79%|███████▉  | 295077/371472 [1:18:52<5:53:11,  3.61it/s]
 79%|███████▉  | 295078/371472 [1:18:52<5:45:30,  3.69it/s]
 79%|███████▉  | 295079/371472 [1:18:53<5:52:45,  3.61it/s]
 79%|███████▉  | 295080/371472 [1:18:53<6:09:07,  3.45it/s]
                                                           
{'loss': 2.5949, 'learning_rate': 2.851817535391842e-07, 'epoch': 12.71}

 79%|███████▉  | 295080/371472 [1:18:53<6:09:07,  3.45it/s]
 79%|███████▉  | 295081/371472 [1:18:53<5:54:52,  3.59it/s]
 79%|███████▉  | 295082/371472 [1:18:53<5:48:04,  3.66it/s]
 79%|███████▉  | 295083/371472 [1:18:54<5:36:27,  3.78it/s]
 79%|███████▉  | 295084/371472 [1:18:54<5:41:26,  3.73it/s]
 79%|███████▉  | 295085/371472 [1:18:54<5:49:58,  3.64it/s]
 79%|███████▉  | 295086/371472 [1:18:54<5:34:07,  3.81it/s]
 79%|███████▉  | 295087/371472 [1:18:55<5:48:42,  3.65it/s]
 79%|███████▉  | 295088/371472 [1:18:55<6:03:37,  3.50it/s]
 79%|███████▉  | 295089/371472 [1:18:55<5:57:36,  3.56it/s]
 79%|███████▉  | 295090/371472 [1:18:56<5:49:49,  3.64it/s]
 79%|███████▉  | 295091/371472 [1:18:56<5:51:04,  3.63it/s]
 79%|███████▉  | 295092/371472 [1:18:56<6:27:50,  3.28it/s]
 79%|███████▉  | 295093/371472 [1:18:57<6:14:02,  3.40it/s]
 79%|███████▉  | 295094/371472 [1:18:57<6:00:34,  3.53it/s]
 79%|███████▉  | 295095/371472 [1:18:57<6:35:10,  3.22it/s]
 79%|███████▉  | 295096/371472 [1:18:58<6:59:39,  3.03it/s]
 79%|███████▉  | 295097/371472 [1:18:58<6:44:00,  3.15it/s]
 79%|███████▉  | 295098/371472 [1:18:58<6:23:44,  3.32it/s]
 79%|███████▉  | 295099/371472 [1:18:58<6:24:53,  3.31it/s]
 79%|███████▉  | 295100/371472 [1:18:59<7:13:37,  2.94it/s]
                                                           
{'loss': 2.6181, 'learning_rate': 2.851332715637053e-07, 'epoch': 12.71}

 79%|███████▉  | 295100/371472 [1:18:59<7:13:37,  2.94it/s]
 79%|███████▉  | 295101/371472 [1:18:59<6:46:26,  3.13it/s]
 79%|███████▉  | 295102/371472 [1:18:59<6:33:14,  3.24it/s]
 79%|███████▉  | 295103/371472 [1:19:00<6:08:15,  3.46it/s]
 79%|███████▉  | 295104/371472 [1:19:00<6:01:50,  3.52it/s]
 79%|███████▉  | 295105/371472 [1:19:00<5:57:54,  3.56it/s]
 79%|███████▉  | 295106/371472 [1:19:00<6:05:52,  3.48it/s]
 79%|███████▉  | 295107/371472 [1:19:01<5:52:35,  3.61it/s]
 79%|███████▉  | 295108/371472 [1:19:01<6:03:49,  3.50it/s]
 79%|███████▉  | 295109/371472 [1:19:01<5:59:28,  3.54it/s]
 79%|███████▉  | 295110/371472 [1:19:02<6:24:22,  3.31it/s]
 79%|███████▉  | 295111/371472 [1:19:02<6:25:03,  3.31it/s]
 79%|███████▉  | 295112/371472 [1:19:02<6:19:40,  3.35it/s]
 79%|███████▉  | 295113/371472 [1:19:02<6:03:25,  3.50it/s]
 79%|███████▉  | 295114/371472 [1:19:03<6:13:28,  3.41it/s]
 79%|███████▉  | 295115/371472 [1:19:03<6:04:20,  3.49it/s]
 79%|███████▉  | 295116/371472 [1:19:03<6:04:48,  3.49it/s]
 79%|███████▉  | 295117/371472 [1:19:04<6:20:32,  3.34it/s]
 79%|███████▉  | 295118/371472 [1:19:04<6:13:49,  3.40it/s]
 79%|███████▉  | 295119/371472 [1:19:04<6:16:31,  3.38it/s]
 79%|███████▉  | 295120/371472 [1:19:05<6:06:46,  3.47it/s]
                                                           
{'loss': 2.6434, 'learning_rate': 2.850847895882264e-07, 'epoch': 12.71}

 79%|███████▉  | 295120/371472 [1:19:05<6:06:46,  3.47it/s]
 79%|███████▉  | 295121/371472 [1:19:05<6:02:15,  3.51it/s]
 79%|███████▉  | 295122/371472 [1:19:05<6:00:31,  3.53it/s]
 79%|███████▉  | 295123/371472 [1:19:05<5:59:22,  3.54it/s]
 79%|███████▉  | 295124/371472 [1:19:06<5:49:54,  3.64it/s]
 79%|███████▉  | 295125/371472 [1:19:06<6:11:21,  3.43it/s]
 79%|███████▉  | 295126/371472 [1:19:06<6:10:57,  3.43it/s]
 79%|███████▉  | 295127/371472 [1:19:07<6:03:24,  3.50it/s]
 79%|███████▉  | 295128/371472 [1:19:07<6:06:15,  3.47it/s]
 79%|███████▉  | 295129/371472 [1:19:07<5:51:50,  3.62it/s]
 79%|███████▉  | 295130/371472 [1:19:07<5:52:25,  3.61it/s]
 79%|███████▉  | 295131/371472 [1:19:08<5:54:23,  3.59it/s]
 79%|███████▉  | 295132/371472 [1:19:08<5:45:45,  3.68it/s]
 79%|███████▉  | 295133/371472 [1:19:08<6:13:31,  3.41it/s]
 79%|███████▉  | 295134/371472 [1:19:08<5:57:15,  3.56it/s]
 79%|███████▉  | 295135/371472 [1:19:09<6:05:36,  3.48it/s]
 79%|███████▉  | 295136/371472 [1:19:09<5:59:57,  3.53it/s]
 79%|███████▉  | 295137/371472 [1:19:09<6:03:01,  3.50it/s]
 79%|███████▉  | 295138/371472 [1:19:10<6:10:17,  3.44it/s]
 79%|███████▉  | 295139/371472 [1:19:10<6:29:01,  3.27it/s]
 79%|███████▉  | 295140/371472 [1:19:10<6:22:27,  3.33it/s]
                                                           
{'loss': 2.6966, 'learning_rate': 2.8503630761274757e-07, 'epoch': 12.71}

 79%|███████▉  | 295140/371472 [1:19:10<6:22:27,  3.33it/s]
 79%|███████▉  | 295141/371472 [1:19:11<6:47:28,  3.12it/s]
 79%|███████▉  | 295142/371472 [1:19:11<6:25:34,  3.30it/s]
 79%|███████▉  | 295143/371472 [1:19:11<6:20:53,  3.34it/s]
 79%|███████▉  | 295144/371472 [1:19:11<6:11:05,  3.43it/s]
 79%|███████▉  | 295145/371472 [1:19:12<6:10:50,  3.43it/s]
 79%|███████▉  | 295146/371472 [1:19:12<6:10:39,  3.43it/s]
 79%|███████▉  | 295147/371472 [1:19:12<5:59:05,  3.54it/s]
 79%|███████▉  | 295148/371472 [1:19:13<5:49:00,  3.64it/s]
 79%|███████▉  | 295149/371472 [1:19:13<5:50:34,  3.63it/s]
 79%|███████▉  | 295150/371472 [1:19:13<5:52:05,  3.61it/s]
 79%|███████▉  | 295151/371472 [1:19:13<6:15:39,  3.39it/s]
 79%|███████▉  | 295152/371472 [1:19:14<6:08:29,  3.45it/s]
 79%|███████▉  | 295153/371472 [1:19:14<6:22:45,  3.32it/s]
 79%|███████▉  | 295154/371472 [1:19:14<6:21:57,  3.33it/s]
 79%|███████▉  | 295155/371472 [1:19:15<6:07:41,  3.46it/s]
 79%|███████▉  | 295156/371472 [1:19:15<5:58:00,  3.55it/s]
 79%|███████▉  | 295157/371472 [1:19:15<5:46:46,  3.67it/s]
 79%|███████▉  | 295158/371472 [1:19:15<6:08:59,  3.45it/s]
 79%|███████▉  | 295159/371472 [1:19:16<6:09:46,  3.44it/s]
 79%|███████▉  | 295160/371472 [1:19:16<6:40:58,  3.17it/s]
                                                           
{'loss': 2.4387, 'learning_rate': 2.8498782563726864e-07, 'epoch': 12.71}

 79%|███████▉  | 295160/371472 [1:19:16<6:40:58,  3.17it/s]
 79%|███████▉  | 295161/371472 [1:19:16<6:31:53,  3.25it/s]
 79%|███████▉  | 295162/371472 [1:19:17<6:30:48,  3.25it/s]
 79%|███████▉  | 295163/371472 [1:19:17<6:18:47,  3.36it/s]
 79%|███████▉  | 295164/371472 [1:19:17<6:06:14,  3.47it/s]
 79%|███████▉  | 295165/371472 [1:19:18<5:56:45,  3.56it/s]
 79%|███████▉  | 295166/371472 [1:19:18<5:54:19,  3.59it/s]
 79%|███████▉  | 295167/371472 [1:19:18<6:02:34,  3.51it/s]
 79%|███████▉  | 295168/371472 [1:19:18<5:59:13,  3.54it/s]
 79%|███████▉  | 295169/371472 [1:19:19<6:11:08,  3.43it/s]
 79%|███████▉  | 295170/371472 [1:19:19<6:08:58,  3.45it/s]
 79%|███████▉  | 295171/371472 [1:19:19<6:08:07,  3.45it/s]
 79%|███████▉  | 295172/371472 [1:19:20<6:03:19,  3.50it/s]
 79%|███████▉  | 295173/371472 [1:19:20<6:35:00,  3.22it/s]
 79%|███████▉  | 295174/371472 [1:19:20<6:15:27,  3.39it/s]
 79%|███████▉  | 295175/371472 [1:19:20<6:02:56,  3.50it/s]
 79%|███████▉  | 295176/371472 [1:19:21<5:54:47,  3.58it/s]
 79%|███████▉  | 295177/371472 [1:19:21<5:48:47,  3.65it/s]
 79%|███████▉  | 295178/371472 [1:19:21<6:09:08,  3.44it/s]
 79%|███████▉  | 295179/371472 [1:19:22<6:01:36,  3.52it/s]
 79%|███████▉  | 295180/371472 [1:19:22<6:20:38,  3.34it/s]
                                                           
{'loss': 2.5376, 'learning_rate': 2.849393436617898e-07, 'epoch': 12.71}

 79%|███████▉  | 295180/371472 [1:19:22<6:20:38,  3.34it/s]
 79%|███████▉  | 295181/371472 [1:19:22<6:08:01,  3.45it/s]
 79%|███████▉  | 295182/371472 [1:19:22<6:02:50,  3.50it/s]
 79%|███████▉  | 295183/371472 [1:19:23<6:26:46,  3.29it/s]
 79%|███████▉  | 295184/371472 [1:19:23<6:43:35,  3.15it/s]
 79%|███████▉  | 295185/371472 [1:19:23<6:35:17,  3.22it/s]
 79%|███████▉  | 295186/371472 [1:19:24<6:07:53,  3.46it/s]
 79%|███████▉  | 295187/371472 [1:19:24<5:56:54,  3.56it/s]
 79%|███████▉  | 295188/371472 [1:19:24<5:56:41,  3.56it/s]
 79%|███████▉  | 295189/371472 [1:19:25<5:54:30,  3.59it/s]
 79%|███████▉  | 295190/371472 [1:19:25<5:42:17,  3.71it/s]
 79%|███████▉  | 295191/371472 [1:19:25<5:51:45,  3.61it/s]
 79%|███████▉  | 295192/371472 [1:19:25<6:07:28,  3.46it/s]
 79%|███████▉  | 295193/371472 [1:19:26<6:02:15,  3.51it/s]
 79%|███████▉  | 295194/371472 [1:19:26<6:26:40,  3.29it/s]
 79%|███████▉  | 295195/371472 [1:19:26<6:45:17,  3.14it/s]
 79%|███████▉  | 295196/371472 [1:19:27<6:31:00,  3.25it/s]
 79%|███████▉  | 295197/371472 [1:19:27<6:09:24,  3.44it/s]
 79%|███████▉  | 295198/371472 [1:19:27<5:59:37,  3.53it/s]
 79%|███████▉  | 295199/371472 [1:19:27<5:51:05,  3.62it/s]
 79%|███████▉  | 295200/371472 [1:19:28<5:45:50,  3.68it/s]
                                                           
{'loss': 2.7144, 'learning_rate': 2.848908616863108e-07, 'epoch': 12.71}

 79%|███████▉  | 295200/371472 [1:19:28<5:45:50,  3.68it/s]
 79%|███████▉  | 295201/371472 [1:19:28<5:51:44,  3.61it/s]
 79%|███████▉  | 295202/371472 [1:19:28<5:54:14,  3.59it/s]
 79%|███████▉  | 295203/371472 [1:19:29<5:52:47,  3.60it/s]
 79%|███████▉  | 295204/371472 [1:19:29<5:54:32,  3.59it/s]
 79%|███████▉  | 295205/371472 [1:19:29<5:51:02,  3.62it/s]
 79%|███████▉  | 295206/371472 [1:19:29<5:57:31,  3.56it/s]
 79%|███████▉  | 295207/371472 [1:19:30<6:15:48,  3.38it/s]
 79%|███████▉  | 295208/371472 [1:19:30<6:19:15,  3.35it/s]
 79%|███████▉  | 295209/371472 [1:19:30<6:05:35,  3.48it/s]
 79%|███████▉  | 295210/371472 [1:19:31<6:11:03,  3.43it/s]
 79%|███████▉  | 295211/371472 [1:19:31<6:08:11,  3.45it/s]
 79%|███████▉  | 295212/371472 [1:19:31<5:53:08,  3.60it/s]
 79%|███████▉  | 295213/371472 [1:19:31<6:04:21,  3.49it/s]
 79%|███████▉  | 295214/371472 [1:19:32<5:54:44,  3.58it/s]
 79%|███████▉  | 295215/371472 [1:19:32<6:19:48,  3.35it/s]
 79%|███████▉  | 295216/371472 [1:19:32<6:12:43,  3.41it/s]
 79%|███████▉  | 295217/371472 [1:19:33<6:24:19,  3.31it/s]
 79%|███████▉  | 295218/371472 [1:19:33<6:07:20,  3.46it/s]
 79%|███████▉  | 295219/371472 [1:19:33<6:55:42,  3.06it/s]
 79%|███████▉  | 295220/371472 [1:19:34<7:15:55,  2.92it/s]
                                                           
{'loss': 2.6114, 'learning_rate': 2.8484237971083196e-07, 'epoch': 12.72}

 79%|███████▉  | 295220/371472 [1:19:34<7:15:55,  2.92it/s]
 79%|███████▉  | 295221/371472 [1:19:34<6:59:05,  3.03it/s]
 79%|███████▉  | 295222/371472 [1:19:34<7:01:44,  3.01it/s]
 79%|███████▉  | 295223/371472 [1:19:35<7:05:15,  2.99it/s]
 79%|███████▉  | 295224/371472 [1:19:35<6:30:44,  3.25it/s]
 79%|███████▉  | 295225/371472 [1:19:35<6:18:06,  3.36it/s]
 79%|███████▉  | 295226/371472 [1:19:35<6:04:04,  3.49it/s]
 79%|███████▉  | 295227/371472 [1:19:36<5:59:34,  3.53it/s]
 79%|███████▉  | 295228/371472 [1:19:36<5:55:15,  3.58it/s]
 79%|███████▉  | 295229/371472 [1:19:36<6:04:30,  3.49it/s]
 79%|███████▉  | 295230/371472 [1:19:37<5:58:10,  3.55it/s]
 79%|███████▉  | 295231/371472 [1:19:37<6:19:17,  3.35it/s]
 79%|███████▉  | 295232/371472 [1:19:37<6:05:06,  3.48it/s]
 79%|███████▉  | 295233/371472 [1:19:37<6:12:53,  3.41it/s]
 79%|███████▉  | 295234/371472 [1:19:38<5:58:16,  3.55it/s]
 79%|███████▉  | 295235/371472 [1:19:38<6:21:56,  3.33it/s]
 79%|███████▉  | 295236/371472 [1:19:38<6:13:24,  3.40it/s]
 79%|███████▉  | 295237/371472 [1:19:39<5:59:13,  3.54it/s]
 79%|███████▉  | 295238/371472 [1:19:39<6:16:03,  3.38it/s]
 79%|███████▉  | 295239/371472 [1:19:39<6:13:54,  3.40it/s]
 79%|███████▉  | 295240/371472 [1:19:40<6:53:46,  3.07it/s]
                                                           
{'loss': 2.7665, 'learning_rate': 2.8479389773535303e-07, 'epoch': 12.72}

 79%|███████▉  | 295240/371472 [1:19:40<6:53:46,  3.07it/s]
 79%|███████▉  | 295241/371472 [1:19:40<6:45:40,  3.13it/s]
 79%|███████▉  | 295242/371472 [1:19:40<6:46:58,  3.12it/s]
 79%|███████▉  | 295243/371472 [1:19:41<6:48:38,  3.11it/s]
 79%|███████▉  | 295244/371472 [1:19:41<6:42:34,  3.16it/s]
 79%|███████▉  | 295245/371472 [1:19:41<6:36:30,  3.20it/s]
 79%|███████▉  | 295246/371472 [1:19:41<6:42:28,  3.16it/s]
 79%|███████▉  | 295247/371472 [1:19:42<6:25:47,  3.29it/s]
 79%|███████▉  | 295248/371472 [1:19:42<6:34:59,  3.22it/s]
 79%|███████▉  | 295249/371472 [1:19:42<6:11:30,  3.42it/s]
 79%|███████▉  | 295250/371472 [1:19:43<5:59:26,  3.53it/s]
 79%|███████▉  | 295251/371472 [1:19:43<5:58:49,  3.54it/s]
 79%|███████▉  | 295252/371472 [1:19:43<6:20:04,  3.34it/s]
 79%|███████▉  | 295253/371472 [1:19:44<6:17:39,  3.36it/s]
 79%|███████▉  | 295254/371472 [1:19:44<6:16:37,  3.37it/s]
 79%|███████▉  | 295255/371472 [1:19:44<6:21:11,  3.33it/s]
 79%|███████▉  | 295256/371472 [1:19:44<6:11:25,  3.42it/s]
 79%|███████▉  | 295257/371472 [1:19:45<5:52:02,  3.61it/s]
 79%|███████▉  | 295258/371472 [1:19:45<5:51:57,  3.61it/s]
 79%|███████▉  | 295259/371472 [1:19:45<5:48:39,  3.64it/s]
 79%|███████▉  | 295260/371472 [1:19:45<5:57:11,  3.56it/s]
                                                           
{'loss': 2.6, 'learning_rate': 2.847454157598742e-07, 'epoch': 12.72}

 79%|███████▉  | 295260/371472 [1:19:45<5:57:11,  3.56it/s]
 79%|███████▉  | 295261/371472 [1:19:46<5:50:09,  3.63it/s]
 79%|███████▉  | 295262/371472 [1:19:46<5:44:12,  3.69it/s]
 79%|███████▉  | 295263/371472 [1:19:46<6:01:31,  3.51it/s]
 79%|███████▉  | 295264/371472 [1:19:47<6:27:25,  3.28it/s]
 79%|███████▉  | 295265/371472 [1:19:47<6:10:48,  3.43it/s]
 79%|███████▉  | 295266/371472 [1:19:47<5:59:44,  3.53it/s]
 79%|███████▉  | 295267/371472 [1:19:47<5:53:25,  3.59it/s]
 79%|███████▉  | 295268/371472 [1:19:48<5:54:17,  3.58it/s]
 79%|███████▉  | 295269/371472 [1:19:48<5:46:38,  3.66it/s]
 79%|███████▉  | 295270/371472 [1:19:48<5:40:13,  3.73it/s]
 79%|███████▉  | 295271/371472 [1:19:49<6:04:18,  3.49it/s]
 79%|███████▉  | 295272/371472 [1:19:49<6:31:46,  3.24it/s]
 79%|███████▉  | 295273/371472 [1:19:49<6:43:34,  3.15it/s]
 79%|███████▉  | 295274/371472 [1:19:50<6:11:07,  3.42it/s]
 79%|███████▉  | 295275/371472 [1:19:50<6:09:56,  3.43it/s]
 79%|███████▉  | 295276/371472 [1:19:50<6:01:41,  3.51it/s]
 79%|███████▉  | 295277/371472 [1:19:50<5:57:56,  3.55it/s]
 79%|███████▉  | 295278/371472 [1:19:51<5:45:31,  3.68it/s]
 79%|███████▉  | 295279/371472 [1:19:51<5:37:56,  3.76it/s]
 79%|███████▉  | 295280/371472 [1:19:51<5:58:36,  3.54it/s]
                                                           
{'loss': 2.5887, 'learning_rate': 2.846969337843953e-07, 'epoch': 12.72}

 79%|███████▉  | 295280/371472 [1:19:51<5:58:36,  3.54it/s]
 79%|███████▉  | 295281/371472 [1:19:51<6:07:27,  3.46it/s]
 79%|███████▉  | 295282/371472 [1:19:52<5:57:59,  3.55it/s]
 79%|███████▉  | 295283/371472 [1:19:52<5:56:06,  3.57it/s]
 79%|███████▉  | 295284/371472 [1:19:52<5:54:46,  3.58it/s]
 79%|███████▉  | 295285/371472 [1:19:53<6:14:10,  3.39it/s]
 79%|███████▉  | 295286/371472 [1:19:53<6:13:47,  3.40it/s]
 79%|███████▉  | 295287/371472 [1:19:53<6:06:51,  3.46it/s]
 79%|███████▉  | 295288/371472 [1:19:54<6:32:56,  3.23it/s]
 79%|███████▉  | 295289/371472 [1:19:54<6:19:49,  3.34it/s]
 79%|███████▉  | 295290/371472 [1:19:54<6:27:38,  3.28it/s]
 79%|███████▉  | 295291/371472 [1:19:54<6:09:45,  3.43it/s]
 79%|███████▉  | 295292/371472 [1:19:55<6:02:16,  3.50it/s]
 79%|███████▉  | 295293/371472 [1:19:55<6:24:04,  3.31it/s]
 79%|███████▉  | 295294/371472 [1:19:55<6:11:26,  3.42it/s]
 79%|███████▉  | 295295/371472 [1:19:56<6:04:32,  3.48it/s]
 79%|███████▉  | 295296/371472 [1:19:56<6:03:44,  3.49it/s]
 79%|███████▉  | 295297/371472 [1:19:56<5:49:51,  3.63it/s]
 79%|███████▉  | 295298/371472 [1:19:56<5:49:35,  3.63it/s]
 79%|███████▉  | 295299/371472 [1:19:57<5:48:59,  3.64it/s]
 79%|███████▉  | 295300/371472 [1:19:57<5:49:20,  3.63it/s]
                                                           
{'loss': 2.5904, 'learning_rate': 2.846484518089164e-07, 'epoch': 12.72}

 79%|███████▉  | 295300/371472 [1:19:57<5:49:20,  3.63it/s]
 79%|███████▉  | 295301/371472 [1:19:57<6:45:25,  3.13it/s]
 79%|███████▉  | 295302/371472 [1:19:58<6:21:02,  3.33it/s]
 79%|███████▉  | 295303/371472 [1:19:58<6:05:37,  3.47it/s]
 79%|███████▉  | 295304/371472 [1:19:58<6:17:40,  3.36it/s]
 79%|███████▉  | 295305/371472 [1:19:58<5:56:46,  3.56it/s]
 79%|███████▉  | 295306/371472 [1:19:59<5:49:50,  3.63it/s]
 79%|███████▉  | 295307/371472 [1:19:59<5:47:28,  3.65it/s]
 79%|███████▉  | 295308/371472 [1:19:59<5:57:35,  3.55it/s]
 79%|███████▉  | 295309/371472 [1:19:59<5:41:19,  3.72it/s]
 79%|███████▉  | 295310/371472 [1:20:00<5:44:39,  3.68it/s]
 79%|███████▉  | 295311/371472 [1:20:00<6:05:10,  3.48it/s]
 79%|███████▉  | 295312/371472 [1:20:00<6:05:11,  3.48it/s]
 79%|███████▉  | 295313/371472 [1:20:01<6:27:51,  3.27it/s]
 79%|███████▉  | 295314/371472 [1:20:01<6:20:39,  3.33it/s]
 79%|███████▉  | 295315/371472 [1:20:01<6:11:05,  3.42it/s]
 79%|███████▉  | 295316/371472 [1:20:02<6:08:39,  3.44it/s]
 79%|███████▉  | 295317/371472 [1:20:02<6:14:04,  3.39it/s]
 79%|███████▉  | 295318/371472 [1:20:02<6:05:39,  3.47it/s]
 79%|███████▉  | 295319/371472 [1:20:03<6:30:49,  3.25it/s]
 79%|███████▉  | 295320/371472 [1:20:03<6:11:24,  3.42it/s]
                                                           
{'loss': 2.7059, 'learning_rate': 2.845999698334374e-07, 'epoch': 12.72}

 79%|███████▉  | 295320/371472 [1:20:03<6:11:24,  3.42it/s]
 80%|███████▉  | 295321/371472 [1:20:03<5:53:12,  3.59it/s]
 80%|███████▉  | 295322/371472 [1:20:03<6:01:58,  3.51it/s]
 80%|███████▉  | 295323/371472 [1:20:04<6:37:49,  3.19it/s]
 80%|███████▉  | 295324/371472 [1:20:04<6:12:53,  3.40it/s]
 80%|███████▉  | 295325/371472 [1:20:04<6:14:33,  3.39it/s]
 80%|███████▉  | 295326/371472 [1:20:04<6:01:43,  3.51it/s]
 80%|███████▉  | 295327/371472 [1:20:05<6:04:11,  3.48it/s]
 80%|███████▉  | 295328/371472 [1:20:05<5:59:11,  3.53it/s]
 80%|███████▉  | 295329/371472 [1:20:05<6:08:02,  3.45it/s]
 80%|███████▉  | 295330/371472 [1:20:06<5:54:31,  3.58it/s]
 80%|███████▉  | 295331/371472 [1:20:06<5:54:28,  3.58it/s]
 80%|███████▉  | 295332/371472 [1:20:06<6:05:50,  3.47it/s]
 80%|███████▉  | 295333/371472 [1:20:06<6:03:52,  3.49it/s]
 80%|███████▉  | 295334/371472 [1:20:07<6:07:36,  3.45it/s]
 80%|███████▉  | 295335/371472 [1:20:07<6:26:40,  3.28it/s]
 80%|███████▉  | 295336/371472 [1:20:07<6:19:20,  3.35it/s]
 80%|███████▉  | 295337/371472 [1:20:08<6:06:58,  3.46it/s]
 80%|███████▉  | 295338/371472 [1:20:08<6:02:52,  3.50it/s]
 80%|███████▉  | 295339/371472 [1:20:08<6:13:14,  3.40it/s]
 80%|███████▉  | 295340/371472 [1:20:09<6:13:53,  3.39it/s]
                                                           
{'loss': 2.6135, 'learning_rate': 2.845514878579586e-07, 'epoch': 12.72}

 80%|███████▉  | 295340/371472 [1:20:09<6:13:53,  3.39it/s]
 80%|███████▉  | 295341/371472 [1:20:09<6:02:42,  3.50it/s]
 80%|███████▉  | 295342/371472 [1:20:09<5:47:24,  3.65it/s]
 80%|███████▉  | 295343/371472 [1:20:09<5:45:24,  3.67it/s]
 80%|███████▉  | 295344/371472 [1:20:10<5:50:52,  3.62it/s]
 80%|███████▉  | 295345/371472 [1:20:10<6:36:01,  3.20it/s]
 80%|███████▉  | 295346/371472 [1:20:10<6:16:36,  3.37it/s]
 80%|███████▉  | 295347/371472 [1:20:11<6:25:13,  3.29it/s]
 80%|███████▉  | 295348/371472 [1:20:11<6:12:46,  3.40it/s]
 80%|███████▉  | 295349/371472 [1:20:11<6:32:04,  3.24it/s]
 80%|███████▉  | 295350/371472 [1:20:12<6:35:29,  3.21it/s]
 80%|███████▉  | 295351/371472 [1:20:12<6:12:26,  3.41it/s]
 80%|███████▉  | 295352/371472 [1:20:12<6:01:57,  3.51it/s]
 80%|███████▉  | 295353/371472 [1:20:12<5:59:39,  3.53it/s]
 80%|███████▉  | 295354/371472 [1:20:13<6:29:14,  3.26it/s]
 80%|███████▉  | 295355/371472 [1:20:13<6:14:56,  3.38it/s]
 80%|███████▉  | 295356/371472 [1:20:13<6:30:00,  3.25it/s]
 80%|███████▉  | 295357/371472 [1:20:14<6:06:54,  3.46it/s]
 80%|███████▉  | 295358/371472 [1:20:14<6:01:31,  3.51it/s]
 80%|███████▉  | 295359/371472 [1:20:14<6:07:12,  3.45it/s]
 80%|███████▉  | 295360/371472 [1:20:14<6:00:31,  3.52it/s]
                                                           
{'loss': 2.5256, 'learning_rate': 2.8450300588247967e-07, 'epoch': 12.72}

 80%|███████▉  | 295360/371472 [1:20:14<6:00:31,  3.52it/s]
 80%|███████▉  | 295361/371472 [1:20:15<5:57:12,  3.55it/s]
 80%|███████▉  | 295362/371472 [1:20:15<5:59:27,  3.53it/s]
 80%|███████▉  | 295363/371472 [1:20:15<6:03:20,  3.49it/s]
 80%|███████▉  | 295364/371472 [1:20:16<6:13:50,  3.39it/s]
 80%|███████▉  | 295365/371472 [1:20:16<6:03:03,  3.49it/s]
 80%|███████▉  | 295366/371472 [1:20:16<6:04:11,  3.48it/s]
 80%|███████▉  | 295367/371472 [1:20:16<5:58:49,  3.53it/s]
 80%|███████▉  | 295368/371472 [1:20:17<5:53:06,  3.59it/s]
 80%|███████▉  | 295369/371472 [1:20:17<5:48:22,  3.64it/s]
 80%|███████▉  | 295370/371472 [1:20:17<5:40:18,  3.73it/s]
 80%|███████▉  | 295371/371472 [1:20:17<5:55:27,  3.57it/s]
 80%|███████▉  | 295372/371472 [1:20:18<5:48:55,  3.63it/s]
 80%|███████▉  | 295373/371472 [1:20:18<6:00:52,  3.51it/s]
 80%|███████▉  | 295374/371472 [1:20:18<6:02:44,  3.50it/s]
 80%|███████▉  | 295375/371472 [1:20:19<5:57:14,  3.55it/s]
 80%|███████▉  | 295376/371472 [1:20:19<6:21:16,  3.33it/s]
 80%|███████▉  | 295377/371472 [1:20:19<6:37:11,  3.19it/s]
 80%|███████▉  | 295378/371472 [1:20:20<6:27:29,  3.27it/s]
 80%|███████▉  | 295379/371472 [1:20:20<6:12:34,  3.40it/s]
 80%|███████▉  | 295380/371472 [1:20:20<6:09:23,  3.43it/s]
                                                           
{'loss': 2.5843, 'learning_rate': 2.8445452390700085e-07, 'epoch': 12.72}

 80%|███████▉  | 295380/371472 [1:20:20<6:09:23,  3.43it/s]
 80%|███████▉  | 295381/371472 [1:20:20<6:16:08,  3.37it/s]
 80%|███████▉  | 295382/371472 [1:20:21<6:04:02,  3.48it/s]
 80%|███████▉  | 295383/371472 [1:20:21<6:11:45,  3.41it/s]
 80%|███████▉  | 295384/371472 [1:20:21<5:55:10,  3.57it/s]
 80%|███████▉  | 295385/371472 [1:20:22<5:43:43,  3.69it/s]
 80%|███████▉  | 295386/371472 [1:20:22<5:38:52,  3.74it/s]
 80%|███████▉  | 295387/371472 [1:20:22<5:39:42,  3.73it/s]
 80%|███████▉  | 295388/371472 [1:20:22<5:48:49,  3.64it/s]
 80%|███████▉  | 295389/371472 [1:20:23<6:04:00,  3.48it/s]
 80%|███████▉  | 295390/371472 [1:20:23<6:00:30,  3.52it/s]
 80%|███████▉  | 295391/371472 [1:20:23<5:47:04,  3.65it/s]
 80%|███████▉  | 295392/371472 [1:20:24<6:01:48,  3.50it/s]
 80%|███████▉  | 295393/371472 [1:20:24<5:50:13,  3.62it/s]
 80%|███████▉  | 295394/371472 [1:20:24<5:47:34,  3.65it/s]
 80%|███████▉  | 295395/371472 [1:20:24<5:49:27,  3.63it/s]
 80%|███████▉  | 295396/371472 [1:20:25<5:46:24,  3.66it/s]
 80%|███████▉  | 295397/371472 [1:20:25<5:35:41,  3.78it/s]
 80%|███████▉  | 295398/371472 [1:20:25<5:36:55,  3.76it/s]
 80%|███████▉  | 295399/371472 [1:20:25<5:57:00,  3.55it/s]
 80%|███████▉  | 295400/371472 [1:20:26<5:53:34,  3.59it/s]
                                                           
{'loss': 2.7224, 'learning_rate': 2.844060419315219e-07, 'epoch': 12.72}

 80%|███████▉  | 295400/371472 [1:20:26<5:53:34,  3.59it/s]
 80%|███████▉  | 295401/371472 [1:20:26<6:13:26,  3.40it/s]
 80%|███████▉  | 295402/371472 [1:20:26<6:10:30,  3.42it/s]
 80%|███████▉  | 295403/371472 [1:20:27<6:01:13,  3.51it/s]
 80%|███████▉  | 295404/371472 [1:20:27<6:08:00,  3.45it/s]
 80%|███████▉  | 295405/371472 [1:20:27<5:55:21,  3.57it/s]
 80%|███████▉  | 295406/371472 [1:20:27<5:46:47,  3.66it/s]
 80%|███████▉  | 295407/371472 [1:20:28<5:55:11,  3.57it/s]
 80%|███████▉  | 295408/371472 [1:20:28<5:43:14,  3.69it/s]
 80%|███████▉  | 295409/371472 [1:20:28<6:01:14,  3.51it/s]
 80%|███████▉  | 295410/371472 [1:20:29<6:35:07,  3.21it/s]
 80%|███████▉  | 295411/371472 [1:20:29<6:15:56,  3.37it/s]
 80%|███████▉  | 295412/371472 [1:20:29<5:55:21,  3.57it/s]
 80%|███████▉  | 295413/371472 [1:20:29<5:45:26,  3.67it/s]
 80%|███████▉  | 295414/371472 [1:20:30<5:45:48,  3.67it/s]
 80%|███████▉  | 295415/371472 [1:20:30<6:19:21,  3.34it/s]
 80%|███████▉  | 295416/371472 [1:20:30<6:02:26,  3.50it/s]
 80%|███████▉  | 295417/371472 [1:20:31<5:52:52,  3.59it/s]
 80%|███████▉  | 295418/371472 [1:20:31<5:50:13,  3.62it/s]
 80%|███████▉  | 295419/371472 [1:20:31<5:45:36,  3.67it/s]
 80%|███████▉  | 295420/371472 [1:20:31<6:14:55,  3.38it/s]
                                                           
{'loss': 2.6084, 'learning_rate': 2.8435755995604294e-07, 'epoch': 12.72}

 80%|███████▉  | 295420/371472 [1:20:31<6:14:55,  3.38it/s]
 80%|███████▉  | 295421/371472 [1:20:32<5:56:35,  3.55it/s]
 80%|███████▉  | 295422/371472 [1:20:32<6:07:55,  3.44it/s]
 80%|███████▉  | 295423/371472 [1:20:32<5:59:20,  3.53it/s]
 80%|███████▉  | 295424/371472 [1:20:33<6:07:54,  3.45it/s]
 80%|███████▉  | 295425/371472 [1:20:33<6:07:57,  3.44it/s]
 80%|███████▉  | 295426/371472 [1:20:33<6:10:33,  3.42it/s]
 80%|███████▉  | 295427/371472 [1:20:33<6:08:59,  3.43it/s]
 80%|███████▉  | 295428/371472 [1:20:34<6:03:47,  3.48it/s]
 80%|███████▉  | 295429/371472 [1:20:34<6:02:12,  3.50it/s]
 80%|███████▉  | 295430/371472 [1:20:34<6:03:38,  3.49it/s]
 80%|███████▉  | 295431/371472 [1:20:35<5:47:17,  3.65it/s]
 80%|███████▉  | 295432/371472 [1:20:35<5:34:38,  3.79it/s]
 80%|███████▉  | 295433/371472 [1:20:35<6:25:22,  3.29it/s]
 80%|███████▉  | 295434/371472 [1:20:35<6:08:31,  3.44it/s]
 80%|███████▉  | 295435/371472 [1:20:36<5:57:35,  3.54it/s]
 80%|███████▉  | 295436/371472 [1:20:36<6:18:39,  3.35it/s]
 80%|███████▉  | 295437/371472 [1:20:36<6:14:18,  3.39it/s]
 80%|███████▉  | 295438/371472 [1:20:37<6:04:16,  3.48it/s]
 80%|███████▉  | 295439/371472 [1:20:37<5:45:06,  3.67it/s]
 80%|███████▉  | 295440/371472 [1:20:37<6:55:39,  3.05it/s]
                                                           
{'loss': 2.5841, 'learning_rate': 2.843090779805641e-07, 'epoch': 12.73}

 80%|███████▉  | 295440/371472 [1:20:37<6:55:39,  3.05it/s]
 80%|███████▉  | 295441/371472 [1:20:38<6:31:57,  3.23it/s]
 80%|███████▉  | 295442/371472 [1:20:38<6:12:07,  3.41it/s]
 80%|███████▉  | 295443/371472 [1:20:38<6:00:02,  3.52it/s]
 80%|███████▉  | 295444/371472 [1:20:38<5:48:00,  3.64it/s]
 80%|███████▉  | 295445/371472 [1:20:39<5:52:58,  3.59it/s]
 80%|███████▉  | 295446/371472 [1:20:39<5:42:14,  3.70it/s]
 80%|███████▉  | 295447/371472 [1:20:39<5:39:22,  3.73it/s]
 80%|███████▉  | 295448/371472 [1:20:39<5:47:58,  3.64it/s]
 80%|███████▉  | 295449/371472 [1:20:40<5:48:30,  3.64it/s]
 80%|███████▉  | 295450/371472 [1:20:40<6:45:47,  3.12it/s]
 80%|███████▉  | 295451/371472 [1:20:40<6:40:24,  3.16it/s]
 80%|███████▉  | 295452/371472 [1:20:41<6:17:36,  3.36it/s]
 80%|███████▉  | 295453/371472 [1:20:41<6:12:51,  3.40it/s]
 80%|███████▉  | 295454/371472 [1:20:41<6:38:29,  3.18it/s]
 80%|███████▉  | 295455/371472 [1:20:42<6:51:51,  3.08it/s]
 80%|███████▉  | 295456/371472 [1:20:42<6:30:03,  3.25it/s]
 80%|███████▉  | 295457/371472 [1:20:42<6:11:20,  3.41it/s]
 80%|███████▉  | 295458/371472 [1:20:42<5:51:33,  3.60it/s]
 80%|███████▉  | 295459/371472 [1:20:43<5:53:57,  3.58it/s]
 80%|███████▉  | 295460/371472 [1:20:43<5:54:54,  3.57it/s]
                                                           
{'loss': 2.6595, 'learning_rate': 2.8426059600508513e-07, 'epoch': 12.73}

 80%|███████▉  | 295460/371472 [1:20:43<5:54:54,  3.57it/s]
 80%|███████▉  | 295461/371472 [1:20:43<5:44:09,  3.68it/s]
 80%|███████▉  | 295462/371472 [1:20:44<5:44:20,  3.68it/s]
 80%|███████▉  | 295463/371472 [1:20:44<5:38:42,  3.74it/s]
 80%|███████▉  | 295464/371472 [1:20:44<5:33:02,  3.80it/s]
 80%|███████▉  | 295465/371472 [1:20:44<5:53:48,  3.58it/s]
 80%|███████▉  | 295466/371472 [1:20:45<5:48:18,  3.64it/s]
 80%|███████▉  | 295467/371472 [1:20:45<6:06:14,  3.46it/s]
 80%|███████▉  | 295468/371472 [1:20:45<6:10:10,  3.42it/s]
 80%|███████▉  | 295469/371472 [1:20:45<6:03:22,  3.49it/s]
 80%|███████▉  | 295470/371472 [1:20:46<6:07:05,  3.45it/s]
 80%|███████▉  | 295471/371472 [1:20:46<6:06:59,  3.45it/s]
 80%|███████▉  | 295472/371472 [1:20:46<6:02:12,  3.50it/s]
 80%|███████▉  | 295473/371472 [1:20:47<5:50:23,  3.61it/s]
 80%|███████▉  | 295474/371472 [1:20:47<5:41:22,  3.71it/s]
 80%|███████▉  | 295475/371472 [1:20:47<5:35:00,  3.78it/s]
 80%|███████▉  | 295476/371472 [1:20:47<5:35:19,  3.78it/s]
 80%|███████▉  | 295477/371472 [1:20:48<5:29:23,  3.85it/s]
 80%|███████▉  | 295478/371472 [1:20:48<5:33:19,  3.80it/s]
 80%|███████▉  | 295479/371472 [1:20:48<5:47:11,  3.65it/s]
 80%|███████▉  | 295480/371472 [1:20:48<5:41:56,  3.70it/s]
                                                           
{'loss': 2.6791, 'learning_rate': 2.842121140296063e-07, 'epoch': 12.73}

 80%|███████▉  | 295480/371472 [1:20:48<5:41:56,  3.70it/s]
 80%|███████▉  | 295481/371472 [1:20:49<5:48:20,  3.64it/s]
 80%|███████▉  | 295482/371472 [1:20:49<6:46:57,  3.11it/s]
 80%|███████▉  | 295483/371472 [1:20:49<6:28:18,  3.26it/s]
 80%|███████▉  | 295484/371472 [1:20:50<6:27:34,  3.27it/s]
 80%|███████▉  | 295485/371472 [1:20:50<6:21:39,  3.32it/s]
 80%|███████▉  | 295486/371472 [1:20:50<6:14:19,  3.38it/s]
 80%|███████▉  | 295487/371472 [1:20:51<6:00:57,  3.51it/s]
 80%|███████▉  | 295488/371472 [1:20:51<5:53:40,  3.58it/s]
 80%|███████▉  | 295489/371472 [1:20:51<5:55:27,  3.56it/s]
 80%|███████▉  | 295490/371472 [1:20:51<5:43:46,  3.68it/s]
 80%|███████▉  | 295491/371472 [1:20:52<5:39:17,  3.73it/s]
 80%|███████▉  | 295492/371472 [1:20:52<5:42:07,  3.70it/s]
 80%|███████▉  | 295493/371472 [1:20:52<5:36:22,  3.76it/s]
 80%|███████▉  | 295494/371472 [1:20:52<5:42:25,  3.70it/s]
 80%|███████▉  | 295495/371472 [1:20:53<6:09:36,  3.43it/s]
 80%|███████▉  | 295496/371472 [1:20:53<6:03:45,  3.48it/s]
 80%|███████▉  | 295497/371472 [1:20:53<5:47:33,  3.64it/s]
 80%|███████▉  | 295498/371472 [1:20:54<5:42:34,  3.70it/s]
 80%|███████▉  | 295499/371472 [1:20:54<5:36:49,  3.76it/s]
 80%|███████▉  | 295500/371472 [1:20:54<5:52:24,  3.59it/s]
                                                           
{'loss': 2.57, 'learning_rate': 2.841636320541274e-07, 'epoch': 12.73}

 80%|███████▉  | 295500/371472 [1:20:54<5:52:24,  3.59it/s]
 80%|███████▉  | 295501/371472 [1:20:54<5:58:44,  3.53it/s]
 80%|███████▉  | 295502/371472 [1:20:55<6:01:19,  3.50it/s]
 80%|███████▉  | 295503/371472 [1:20:55<6:06:40,  3.45it/s]
 80%|███████▉  | 295504/371472 [1:20:55<6:15:20,  3.37it/s]
 80%|███████▉  | 295505/371472 [1:20:56<6:15:11,  3.37it/s]
 80%|███████▉  | 295506/371472 [1:20:56<6:19:13,  3.34it/s]
 80%|███████▉  | 295507/371472 [1:20:56<6:09:47,  3.42it/s]
 80%|███████▉  | 295508/371472 [1:20:57<6:09:21,  3.43it/s]
 80%|███████▉  | 295509/371472 [1:20:57<6:25:27,  3.28it/s]
 80%|███████▉  | 295510/371472 [1:20:57<6:13:59,  3.39it/s]
 80%|███████▉  | 295511/371472 [1:20:57<6:18:39,  3.34it/s]
 80%|███████▉  | 295512/371472 [1:20:58<6:28:15,  3.26it/s]
 80%|███████▉  | 295513/371472 [1:20:58<6:06:55,  3.45it/s]
 80%|███████▉  | 295514/371472 [1:20:58<6:06:31,  3.45it/s]
 80%|███████▉  | 295515/371472 [1:20:59<5:56:02,  3.56it/s]
 80%|███████▉  | 295516/371472 [1:20:59<5:58:49,  3.53it/s]
 80%|███████▉  | 295517/371472 [1:20:59<5:59:12,  3.52it/s]
 80%|███████▉  | 295518/371472 [1:20:59<6:06:51,  3.45it/s]
 80%|███████▉  | 295519/371472 [1:21:00<5:57:38,  3.54it/s]
 80%|███████▉  | 295520/371472 [1:21:00<5:59:39,  3.52it/s]
                                                           
{'loss': 2.6894, 'learning_rate': 2.8411515007864856e-07, 'epoch': 12.73}

 80%|███████▉  | 295520/371472 [1:21:00<5:59:39,  3.52it/s]
 80%|███████▉  | 295521/371472 [1:21:00<5:56:28,  3.55it/s]
 80%|███████▉  | 295522/371472 [1:21:01<5:54:51,  3.57it/s]
 80%|███████▉  | 295523/371472 [1:21:01<5:43:38,  3.68it/s]
 80%|███████▉  | 295524/371472 [1:21:01<6:03:09,  3.49it/s]
 80%|███████▉  | 295525/371472 [1:21:01<5:50:57,  3.61it/s]
 80%|███████▉  | 295526/371472 [1:21:02<6:16:03,  3.37it/s]
 80%|███████▉  | 295527/371472 [1:21:02<6:08:00,  3.44it/s]
 80%|███████▉  | 295528/371472 [1:21:02<6:37:15,  3.19it/s]
 80%|███████▉  | 295529/371472 [1:21:03<6:34:08,  3.21it/s]
 80%|███████▉  | 295530/371472 [1:21:03<6:24:37,  3.29it/s]
 80%|███████▉  | 295531/371472 [1:21:03<6:14:03,  3.38it/s]
 80%|███████▉  | 295532/371472 [1:21:04<6:19:08,  3.34it/s]
 80%|███████▉  | 295533/371472 [1:21:04<6:08:37,  3.43it/s]
 80%|███████▉  | 295534/371472 [1:21:04<6:10:41,  3.41it/s]
 80%|███████▉  | 295535/371472 [1:21:04<6:03:43,  3.48it/s]
 80%|███████▉  | 295536/371472 [1:21:05<5:45:40,  3.66it/s]
 80%|███████▉  | 295537/371472 [1:21:05<5:31:59,  3.81it/s]
 80%|███████▉  | 295538/371472 [1:21:05<5:29:57,  3.84it/s]
 80%|███████▉  | 295539/371472 [1:21:05<5:28:08,  3.86it/s]
 80%|███████▉  | 295540/371472 [1:21:06<5:23:20,  3.91it/s]
                                                           
{'loss': 2.5993, 'learning_rate': 2.8406666810316963e-07, 'epoch': 12.73}

 80%|███████▉  | 295540/371472 [1:21:06<5:23:20,  3.91it/s]
 80%|███████▉  | 295541/371472 [1:21:06<5:59:24,  3.52it/s]
 80%|███████▉  | 295542/371472 [1:21:06<5:50:38,  3.61it/s]
 80%|███████▉  | 295543/371472 [1:21:06<5:44:27,  3.67it/s]
 80%|███████▉  | 295544/371472 [1:21:07<5:45:07,  3.67it/s]
 80%|███████▉  | 295545/371472 [1:21:07<6:05:57,  3.46it/s]
 80%|███████▉  | 295546/371472 [1:21:07<6:01:22,  3.50it/s]
 80%|███████▉  | 295547/371472 [1:21:08<6:12:37,  3.40it/s]
 80%|███████▉  | 295548/371472 [1:21:08<6:11:17,  3.41it/s]
 80%|███████▉  | 295549/371472 [1:21:08<6:28:56,  3.25it/s]
 80%|███████▉  | 295550/371472 [1:21:09<6:25:11,  3.29it/s]
 80%|███████▉  | 295551/371472 [1:21:09<6:02:13,  3.49it/s]
 80%|███████▉  | 295552/371472 [1:21:09<6:15:15,  3.37it/s]
 80%|███████▉  | 295553/371472 [1:21:09<5:57:31,  3.54it/s]
 80%|███████▉  | 295554/371472 [1:21:10<5:54:03,  3.57it/s]
 80%|███████▉  | 295555/371472 [1:21:10<6:02:13,  3.49it/s]
 80%|███████▉  | 295556/371472 [1:21:10<5:47:32,  3.64it/s]
 80%|███████▉  | 295557/371472 [1:21:11<5:55:36,  3.56it/s]
 80%|███████▉  | 295558/371472 [1:21:11<6:05:10,  3.46it/s]
 80%|███████▉  | 295559/371472 [1:21:11<5:54:48,  3.57it/s]
 80%|███████▉  | 295560/371472 [1:21:11<5:41:23,  3.71it/s]
                                                           
{'loss': 2.7104, 'learning_rate': 2.8401818612769076e-07, 'epoch': 12.73}

 80%|███████▉  | 295560/371472 [1:21:11<5:41:23,  3.71it/s]
 80%|███████▉  | 295561/371472 [1:21:12<5:38:50,  3.73it/s]
 80%|███████▉  | 295562/371472 [1:21:12<5:44:46,  3.67it/s]
 80%|███████▉  | 295563/371472 [1:21:12<5:54:50,  3.57it/s]
 80%|███████▉  | 295564/371472 [1:21:12<5:54:35,  3.57it/s]
 80%|███████▉  | 295565/371472 [1:21:13<5:57:16,  3.54it/s]
 80%|███████▉  | 295566/371472 [1:21:13<6:09:08,  3.43it/s]
 80%|███████▉  | 295567/371472 [1:21:13<6:29:01,  3.25it/s]
 80%|███████▉  | 295568/371472 [1:21:14<6:29:43,  3.25it/s]
 80%|███████▉  | 295569/371472 [1:21:14<6:34:14,  3.21it/s]
 80%|███████▉  | 295570/371472 [1:21:14<6:20:02,  3.33it/s]
 80%|███████▉  | 295571/371472 [1:21:15<6:06:01,  3.46it/s]
 80%|███████▉  | 295572/371472 [1:21:15<5:50:57,  3.60it/s]
 80%|███████▉  | 295573/371472 [1:21:15<5:43:41,  3.68it/s]
 80%|███████▉  | 295574/371472 [1:21:15<5:36:50,  3.76it/s]
 80%|███████▉  | 295575/371472 [1:21:16<5:57:11,  3.54it/s]
 80%|███████▉  | 295576/371472 [1:21:16<6:15:04,  3.37it/s]
 80%|███████▉  | 295577/371472 [1:21:16<6:54:29,  3.05it/s]
 80%|███████▉  | 295578/371472 [1:21:17<6:36:39,  3.19it/s]
 80%|███████▉  | 295579/371472 [1:21:17<6:32:12,  3.23it/s]
 80%|███████▉  | 295580/371472 [1:21:17<6:23:07,  3.30it/s]
                                                           
{'loss': 2.6457, 'learning_rate': 2.839697041522118e-07, 'epoch': 12.73}

 80%|███████▉  | 295580/371472 [1:21:17<6:23:07,  3.30it/s]
 80%|███████▉  | 295581/371472 [1:21:18<6:33:19,  3.22it/s]
 80%|███████▉  | 295582/371472 [1:21:18<6:13:35,  3.39it/s]
 80%|███████▉  | 295583/371472 [1:21:18<5:53:00,  3.58it/s]
 80%|███████▉  | 295584/371472 [1:21:18<5:48:06,  3.63it/s]
 80%|███████▉  | 295585/371472 [1:21:19<5:47:50,  3.64it/s]
 80%|███████▉  | 295586/371472 [1:21:19<6:06:51,  3.45it/s]
 80%|███████▉  | 295587/371472 [1:21:19<5:56:53,  3.54it/s]
 80%|███████▉  | 295588/371472 [1:21:20<5:55:26,  3.56it/s]
 80%|███████▉  | 295589/371472 [1:21:20<5:48:30,  3.63it/s]
 80%|███████▉  | 295590/371472 [1:21:20<5:35:38,  3.77it/s]
 80%|███████▉  | 295591/371472 [1:21:20<5:32:48,  3.80it/s]
 80%|███████▉  | 295592/371472 [1:21:21<5:39:50,  3.72it/s]
 80%|███████▉  | 295593/371472 [1:21:21<5:58:16,  3.53it/s]
 80%|███████▉  | 295594/371472 [1:21:21<5:59:17,  3.52it/s]
 80%|███████▉  | 295595/371472 [1:21:21<5:57:48,  3.53it/s]
 80%|███████▉  | 295596/371472 [1:21:22<5:57:20,  3.54it/s]
 80%|███████▉  | 295597/371472 [1:21:22<5:42:17,  3.69it/s]
 80%|███████▉  | 295598/371472 [1:21:22<6:04:07,  3.47it/s]
 80%|███████▉  | 295599/371472 [1:21:23<6:04:03,  3.47it/s]
 80%|███████▉  | 295600/371472 [1:21:23<5:52:36,  3.59it/s]
                                                           
{'loss': 2.5959, 'learning_rate': 2.8392122217673295e-07, 'epoch': 12.73}

 80%|███████▉  | 295600/371472 [1:21:23<5:52:36,  3.59it/s]
 80%|███████▉  | 295601/371472 [1:21:23<6:03:45,  3.48it/s]
 80%|███████▉  | 295602/371472 [1:21:23<6:00:52,  3.50it/s]
 80%|███████▉  | 295603/371472 [1:21:24<5:59:16,  3.52it/s]
 80%|███████▉  | 295604/371472 [1:21:24<5:57:17,  3.54it/s]
 80%|███████▉  | 295605/371472 [1:21:24<6:03:51,  3.48it/s]
 80%|███████▉  | 295606/371472 [1:21:25<6:03:31,  3.48it/s]
 80%|███████▉  | 295607/371472 [1:21:25<6:06:48,  3.45it/s]
 80%|███████▉  | 295608/371472 [1:21:25<6:01:03,  3.50it/s]
 80%|███████▉  | 295609/371472 [1:21:25<5:59:40,  3.52it/s]
 80%|███████▉  | 295610/371472 [1:21:26<6:00:41,  3.51it/s]
 80%|███████▉  | 295611/371472 [1:21:26<6:00:28,  3.51it/s]
 80%|███████▉  | 295612/371472 [1:21:26<5:57:55,  3.53it/s]
 80%|███████▉  | 295613/371472 [1:21:27<5:50:01,  3.61it/s]
 80%|███████▉  | 295614/371472 [1:21:27<6:02:00,  3.49it/s]
 80%|███████▉  | 295615/371472 [1:21:27<6:09:42,  3.42it/s]
 80%|███████▉  | 295616/371472 [1:21:27<6:08:10,  3.43it/s]
 80%|███████▉  | 295617/371472 [1:21:28<6:02:38,  3.49it/s]
 80%|███████▉  | 295618/371472 [1:21:28<6:01:29,  3.50it/s]
 80%|███████▉  | 295619/371472 [1:21:28<6:21:49,  3.31it/s]
 80%|███████▉  | 295620/371472 [1:21:29<6:01:46,  3.49it/s]
                                                           
{'loss': 2.6245, 'learning_rate': 2.83872740201254e-07, 'epoch': 12.73}

 80%|███████▉  | 295620/371472 [1:21:29<6:01:46,  3.49it/s]
 80%|███████▉  | 295621/371472 [1:21:29<6:09:02,  3.43it/s]
 80%|███████▉  | 295622/371472 [1:21:29<7:16:42,  2.89it/s]
 80%|███████▉  | 295623/371472 [1:21:30<6:49:51,  3.08it/s]
 80%|███████▉  | 295624/371472 [1:21:30<6:36:51,  3.19it/s]
 80%|███████▉  | 295625/371472 [1:21:30<6:27:14,  3.26it/s]
 80%|███████▉  | 295626/371472 [1:21:30<6:12:08,  3.40it/s]
 80%|███████▉  | 295627/371472 [1:21:31<6:26:31,  3.27it/s]
 80%|███████▉  | 295628/371472 [1:21:31<6:01:58,  3.49it/s]
 80%|███████▉  | 295629/371472 [1:21:31<6:04:29,  3.47it/s]
 80%|███████▉  | 295630/371472 [1:21:32<5:51:12,  3.60it/s]
 80%|███████▉  | 295631/371472 [1:21:32<5:43:51,  3.68it/s]
 80%|███████▉  | 295632/371472 [1:21:32<5:44:34,  3.67it/s]
 80%|███████▉  | 295633/371472 [1:21:32<5:39:15,  3.73it/s]
 80%|███████▉  | 295634/371472 [1:21:33<5:47:15,  3.64it/s]
 80%|███████▉  | 295635/371472 [1:21:33<5:43:31,  3.68it/s]
 80%|███████▉  | 295636/371472 [1:21:33<5:42:12,  3.69it/s]
 80%|███████▉  | 295637/371472 [1:21:34<5:58:10,  3.53it/s]
 80%|███████▉  | 295638/371472 [1:21:34<5:47:13,  3.64it/s]
 80%|███████▉  | 295639/371472 [1:21:34<5:45:10,  3.66it/s]
 80%|███████▉  | 295640/371472 [1:21:34<5:37:36,  3.74it/s]
                                                           
{'loss': 2.6517, 'learning_rate': 2.838242582257752e-07, 'epoch': 12.73}

 80%|███████▉  | 295640/371472 [1:21:34<5:37:36,  3.74it/s]
 80%|███████▉  | 295641/371472 [1:21:35<5:54:29,  3.57it/s]
 80%|███████▉  | 295642/371472 [1:21:35<5:52:28,  3.59it/s]
 80%|███████▉  | 295643/371472 [1:21:35<5:42:27,  3.69it/s]
 80%|███████▉  | 295644/371472 [1:21:35<5:46:13,  3.65it/s]
 80%|███████▉  | 295645/371472 [1:21:36<5:50:26,  3.61it/s]
 80%|███████▉  | 295646/371472 [1:21:36<5:45:53,  3.65it/s]
 80%|███████▉  | 295647/371472 [1:21:36<6:16:04,  3.36it/s]
 80%|███████▉  | 295648/371472 [1:21:37<5:56:09,  3.55it/s]
 80%|███████▉  | 295649/371472 [1:21:37<6:00:25,  3.51it/s]
 80%|███████▉  | 295650/371472 [1:21:37<6:27:13,  3.26it/s]
 80%|███████▉  | 295651/371472 [1:21:37<6:01:02,  3.50it/s]
 80%|███████▉  | 295652/371472 [1:21:38<5:51:47,  3.59it/s]
 80%|███████▉  | 295653/371472 [1:21:38<5:57:15,  3.54it/s]
 80%|███████▉  | 295654/371472 [1:21:38<5:56:06,  3.55it/s]
 80%|███████▉  | 295655/371472 [1:21:39<6:20:57,  3.32it/s]
 80%|███████▉  | 295656/371472 [1:21:39<6:24:21,  3.29it/s]
 80%|███████▉  | 295657/371472 [1:21:39<6:14:23,  3.37it/s]
 80%|███████▉  | 295658/371472 [1:21:40<6:06:57,  3.44it/s]
 80%|███████▉  | 295659/371472 [1:21:40<5:58:36,  3.52it/s]
 80%|███████▉  | 295660/371472 [1:21:40<5:47:55,  3.63it/s]
                                                           
{'loss': 2.6414, 'learning_rate': 2.8377577625029627e-07, 'epoch': 12.73}

 80%|███████▉  | 295660/371472 [1:21:40<5:47:55,  3.63it/s]
 80%|███████▉  | 295661/371472 [1:21:40<5:40:54,  3.71it/s]
 80%|███████▉  | 295662/371472 [1:21:41<5:47:58,  3.63it/s]
 80%|███████▉  | 295663/371472 [1:21:41<5:47:43,  3.63it/s]
 80%|███████▉  | 295664/371472 [1:21:41<5:56:17,  3.55it/s]
 80%|███████▉  | 295665/371472 [1:21:41<5:49:39,  3.61it/s]
 80%|███████▉  | 295666/371472 [1:21:42<6:16:39,  3.35it/s]
 80%|███████▉  | 295667/371472 [1:21:42<6:29:37,  3.24it/s]
 80%|███████▉  | 295668/371472 [1:21:42<6:40:20,  3.16it/s]
 80%|███████▉  | 295669/371472 [1:21:43<6:21:38,  3.31it/s]
 80%|███████▉  | 295670/371472 [1:21:43<6:42:32,  3.14it/s]
 80%|███████▉  | 295671/371472 [1:21:43<7:05:08,  2.97it/s]
 80%|███████▉  | 295672/371472 [1:21:44<6:33:53,  3.21it/s]
 80%|███████▉  | 295673/371472 [1:21:44<6:49:19,  3.09it/s]
 80%|███████▉  | 295674/371472 [1:21:44<6:36:55,  3.18it/s]
 80%|███████▉  | 295675/371472 [1:21:45<6:23:24,  3.29it/s]
 80%|███████▉  | 295676/371472 [1:21:45<5:59:25,  3.51it/s]
 80%|███████▉  | 295677/371472 [1:21:45<6:31:59,  3.22it/s]
 80%|███████▉  | 295678/371472 [1:21:46<6:35:19,  3.20it/s]
 80%|███████▉  | 295679/371472 [1:21:46<6:31:58,  3.22it/s]
 80%|███████▉  | 295680/371472 [1:21:46<6:29:01,  3.25it/s]
                                                           
{'loss': 2.5139, 'learning_rate': 2.837272942748174e-07, 'epoch': 12.74}

 80%|███████▉  | 295680/371472 [1:21:46<6:29:01,  3.25it/s]
 80%|███████▉  | 295681/371472 [1:21:46<6:12:10,  3.39it/s]
 80%|███████▉  | 295682/371472 [1:21:47<6:17:33,  3.35it/s]
 80%|███████▉  | 295683/371472 [1:21:47<6:03:42,  3.47it/s]
 80%|███████▉  | 295684/371472 [1:21:47<6:06:29,  3.45it/s]
 80%|███████▉  | 295685/371472 [1:21:48<6:01:48,  3.49it/s]
 80%|███████▉  | 295686/371472 [1:21:48<5:59:12,  3.52it/s]
 80%|███████▉  | 295687/371472 [1:21:48<6:07:10,  3.44it/s]
 80%|███████▉  | 295688/371472 [1:21:48<5:53:53,  3.57it/s]
 80%|███████▉  | 295689/371472 [1:21:49<5:48:08,  3.63it/s]
 80%|███████▉  | 295690/371472 [1:21:49<5:49:50,  3.61it/s]
 80%|███████▉  | 295691/371472 [1:21:49<5:52:04,  3.59it/s]
 80%|███████▉  | 295692/371472 [1:21:50<5:59:10,  3.52it/s]
 80%|███████▉  | 295693/371472 [1:21:50<5:47:59,  3.63it/s]
 80%|███████▉  | 295694/371472 [1:21:50<5:40:31,  3.71it/s]
 80%|███████▉  | 295695/371472 [1:21:50<5:41:41,  3.70it/s]
 80%|███████▉  | 295696/371472 [1:21:51<5:54:19,  3.56it/s]
 80%|███████▉  | 295697/371472 [1:21:51<6:17:04,  3.35it/s]
 80%|███████▉  | 295698/371472 [1:21:51<6:19:03,  3.33it/s]
 80%|███████▉  | 295699/371472 [1:21:52<6:06:16,  3.45it/s]
 80%|███████▉  | 295700/371472 [1:21:52<5:53:05,  3.58it/s]
                                                           
{'loss': 2.5954, 'learning_rate': 2.8367881229933847e-07, 'epoch': 12.74}

 80%|███████▉  | 295700/371472 [1:21:52<5:53:05,  3.58it/s]
 80%|███████▉  | 295701/371472 [1:21:52<6:08:44,  3.42it/s]
 80%|███████▉  | 295702/371472 [1:21:52<5:48:46,  3.62it/s]
 80%|███████▉  | 295703/371472 [1:21:53<5:51:41,  3.59it/s]
 80%|███████▉  | 295704/371472 [1:21:53<6:21:45,  3.31it/s]
 80%|███████▉  | 295705/371472 [1:21:53<6:08:27,  3.43it/s]
 80%|███████▉  | 295706/371472 [1:21:54<6:22:32,  3.30it/s]
 80%|███████▉  | 295707/371472 [1:21:54<6:14:45,  3.37it/s]
 80%|███████▉  | 295708/371472 [1:21:54<6:24:56,  3.28it/s]
 80%|███████▉  | 295709/371472 [1:21:55<6:55:39,  3.04it/s]
 80%|███████▉  | 295710/371472 [1:21:55<6:40:29,  3.15it/s]
 80%|███████▉  | 295711/371472 [1:21:55<6:24:11,  3.29it/s]
 80%|███████▉  | 295712/371472 [1:21:56<6:52:56,  3.06it/s]
 80%|███████▉  | 295713/371472 [1:21:56<6:35:37,  3.19it/s]
 80%|███████▉  | 295714/371472 [1:21:56<6:20:18,  3.32it/s]
 80%|███████▉  | 295715/371472 [1:21:56<6:42:58,  3.13it/s]
 80%|███████▉  | 295716/371472 [1:21:57<6:52:04,  3.06it/s]
 80%|███████▉  | 295717/371472 [1:21:57<6:27:06,  3.26it/s]
 80%|███████▉  | 295718/371472 [1:21:57<6:11:04,  3.40it/s]
 80%|███████▉  | 295719/371472 [1:21:58<5:56:56,  3.54it/s]
 80%|███████▉  | 295720/371472 [1:21:58<5:40:58,  3.70it/s]
                                                           
{'loss': 2.6218, 'learning_rate': 2.836303303238596e-07, 'epoch': 12.74}

 80%|███████▉  | 295720/371472 [1:21:58<5:40:58,  3.70it/s]
 80%|███████▉  | 295721/371472 [1:21:58<6:04:32,  3.46it/s]
 80%|███████▉  | 295722/371472 [1:21:58<6:17:50,  3.34it/s]
 80%|███████▉  | 295723/371472 [1:21:59<6:11:39,  3.40it/s]
 80%|███████▉  | 295724/371472 [1:21:59<6:15:06,  3.37it/s]
 80%|███████▉  | 295725/371472 [1:21:59<6:03:54,  3.47it/s]
 80%|███████▉  | 295726/371472 [1:22:00<6:08:49,  3.42it/s]
 80%|███████▉  | 295727/371472 [1:22:00<5:57:42,  3.53it/s]
 80%|███████▉  | 295728/371472 [1:22:00<5:41:47,  3.69it/s]
 80%|███████▉  | 295729/371472 [1:22:00<5:56:31,  3.54it/s]
 80%|███████▉  | 295730/371472 [1:22:01<5:46:28,  3.64it/s]
 80%|███████▉  | 295731/371472 [1:22:01<5:48:48,  3.62it/s]
 80%|███████▉  | 295732/371472 [1:22:01<5:43:48,  3.67it/s]
 80%|███████▉  | 295733/371472 [1:22:01<5:44:26,  3.66it/s]
 80%|███████▉  | 295734/371472 [1:22:02<6:09:36,  3.42it/s]
 80%|███████▉  | 295735/371472 [1:22:02<5:56:48,  3.54it/s]
 80%|███████▉  | 295736/371472 [1:22:02<5:41:35,  3.70it/s]
 80%|███████▉  | 295737/371472 [1:22:03<5:40:53,  3.70it/s]
 80%|███████▉  | 295738/371472 [1:22:03<5:32:57,  3.79it/s]
 80%|███████▉  | 295739/371472 [1:22:03<5:30:40,  3.82it/s]
 80%|███████▉  | 295740/371472 [1:22:03<5:39:45,  3.71it/s]
                                                           
{'loss': 2.7151, 'learning_rate': 2.8358184834838066e-07, 'epoch': 12.74}

 80%|███████▉  | 295740/371472 [1:22:03<5:39:45,  3.71it/s]
 80%|███████▉  | 295741/371472 [1:22:04<5:33:35,  3.78it/s]
 80%|███████▉  | 295742/371472 [1:22:04<5:47:54,  3.63it/s]
 80%|███████▉  | 295743/371472 [1:22:04<6:04:36,  3.46it/s]
 80%|███████▉  | 295744/371472 [1:22:05<5:57:12,  3.53it/s]
 80%|███████▉  | 295745/371472 [1:22:05<5:48:09,  3.63it/s]
 80%|███████▉  | 295746/371472 [1:22:05<5:53:19,  3.57it/s]
 80%|███████▉  | 295747/371472 [1:22:05<5:47:16,  3.63it/s]
 80%|███████▉  | 295748/371472 [1:22:06<5:41:48,  3.69it/s]
 80%|███████▉  | 295749/371472 [1:22:06<5:32:03,  3.80it/s]
 80%|███████▉  | 295750/371472 [1:22:06<6:24:37,  3.28it/s]
 80%|███████▉  | 295751/371472 [1:22:07<6:20:19,  3.32it/s]
 80%|███████▉  | 295752/371472 [1:22:07<6:08:26,  3.43it/s]
 80%|███████▉  | 295753/371472 [1:22:07<6:28:16,  3.25it/s]
 80%|███████▉  | 295754/371472 [1:22:07<6:04:27,  3.46it/s]
 80%|███████▉  | 295755/371472 [1:22:08<6:27:17,  3.26it/s]
 80%|███████▉  | 295756/371472 [1:22:08<6:17:50,  3.34it/s]
 80%|███████▉  | 295757/371472 [1:22:08<6:56:07,  3.03it/s]
 80%|███████▉  | 295758/371472 [1:22:09<7:13:56,  2.91it/s]
 80%|███████▉  | 295759/371472 [1:22:09<6:43:21,  3.13it/s]
 80%|███████▉  | 295760/371472 [1:22:09<6:45:31,  3.11it/s]
                                                           
{'loss': 2.6355, 'learning_rate': 2.8353336637290184e-07, 'epoch': 12.74}

 80%|███████▉  | 295760/371472 [1:22:09<6:45:31,  3.11it/s]
 80%|███████▉  | 295761/371472 [1:22:10<6:18:26,  3.33it/s]
 80%|███████▉  | 295762/371472 [1:22:10<6:03:25,  3.47it/s]
 80%|███████▉  | 295763/371472 [1:22:10<6:34:22,  3.20it/s]
 80%|███████▉  | 295764/371472 [1:22:11<6:36:39,  3.18it/s]
 80%|███████▉  | 295765/371472 [1:22:11<6:23:59,  3.29it/s]
 80%|███████▉  | 295766/371472 [1:22:11<6:13:57,  3.37it/s]
 80%|███████▉  | 295767/371472 [1:22:11<6:19:53,  3.32it/s]
 80%|███████▉  | 295768/371472 [1:22:12<6:24:45,  3.28it/s]
 80%|███████▉  | 295769/371472 [1:22:12<6:09:38,  3.41it/s]
 80%|███████▉  | 295770/371472 [1:22:12<6:06:46,  3.44it/s]
 80%|███████▉  | 295771/371472 [1:22:13<5:46:32,  3.64it/s]
 80%|███████▉  | 295772/371472 [1:22:13<5:43:58,  3.67it/s]
 80%|███████▉  | 295773/371472 [1:22:13<5:34:58,  3.77it/s]
 80%|███████▉  | 295774/371472 [1:22:13<5:32:07,  3.80it/s]
 80%|███████▉  | 295775/371472 [1:22:14<5:29:36,  3.83it/s]
 80%|███████▉  | 295776/371472 [1:22:14<6:07:53,  3.43it/s]
 80%|███████▉  | 295777/371472 [1:22:14<5:53:41,  3.57it/s]
 80%|███████▉  | 295778/371472 [1:22:14<5:44:36,  3.66it/s]
 80%|███████▉  | 295779/371472 [1:22:15<5:41:26,  3.69it/s]
 80%|███████▉  | 295780/371472 [1:22:15<5:40:40,  3.70it/s]
                                                           
{'loss': 2.7098, 'learning_rate': 2.834848843974229e-07, 'epoch': 12.74}

 80%|███████▉  | 295780/371472 [1:22:15<5:40:40,  3.70it/s]
 80%|███████▉  | 295781/371472 [1:22:15<5:44:19,  3.66it/s]
 80%|███████▉  | 295782/371472 [1:22:16<5:39:41,  3.71it/s]
 80%|███████▉  | 295783/371472 [1:22:16<5:49:21,  3.61it/s]
 80%|███████▉  | 295784/371472 [1:22:16<5:50:38,  3.60it/s]
 80%|███████▉  | 295785/371472 [1:22:16<6:01:43,  3.49it/s]
 80%|███████▉  | 295786/371472 [1:22:17<6:08:57,  3.42it/s]
 80%|███████▉  | 295787/371472 [1:22:17<6:17:39,  3.34it/s]
 80%|███████▉  | 295788/371472 [1:22:17<6:56:03,  3.03it/s]
 80%|███████▉  | 295789/371472 [1:22:18<6:38:47,  3.16it/s]
 80%|███████▉  | 295790/371472 [1:22:18<6:29:50,  3.24it/s]
 80%|███████▉  | 295791/371472 [1:22:18<6:20:47,  3.31it/s]
 80%|███████▉  | 295792/371472 [1:22:19<6:04:34,  3.46it/s]
 80%|███████▉  | 295793/371472 [1:22:19<5:56:04,  3.54it/s]
 80%|███████▉  | 295794/371472 [1:22:19<5:44:09,  3.66it/s]
 80%|███████▉  | 295795/371472 [1:22:19<6:12:41,  3.38it/s]
 80%|███████▉  | 295796/371472 [1:22:20<6:07:12,  3.43it/s]
 80%|███████▉  | 295797/371472 [1:22:20<6:15:22,  3.36it/s]
 80%|███████▉  | 295798/371472 [1:22:20<6:39:17,  3.16it/s]
 80%|███████▉  | 295799/371472 [1:22:21<6:14:53,  3.36it/s]
 80%|███████▉  | 295800/371472 [1:22:21<5:56:10,  3.54it/s]
                                                           
{'loss': 2.5331, 'learning_rate': 2.8343640242194404e-07, 'epoch': 12.74}

 80%|███████▉  | 295800/371472 [1:22:21<5:56:10,  3.54it/s]
 80%|███████▉  | 295801/371472 [1:22:21<5:58:07,  3.52it/s]
 80%|███████▉  | 295802/371472 [1:22:21<5:45:43,  3.65it/s]
 80%|███████▉  | 295803/371472 [1:22:22<5:47:52,  3.63it/s]
 80%|███████▉  | 295804/371472 [1:22:22<5:47:28,  3.63it/s]
 80%|███████▉  | 295805/371472 [1:22:22<5:52:17,  3.58it/s]
 80%|███████▉  | 295806/371472 [1:22:23<5:50:42,  3.60it/s]
 80%|███████▉  | 295807/371472 [1:22:23<5:43:39,  3.67it/s]
 80%|███████▉  | 295808/371472 [1:22:23<5:46:25,  3.64it/s]
 80%|███████▉  | 295809/371472 [1:22:23<6:19:53,  3.32it/s]
 80%|███████▉  | 295810/371472 [1:22:24<6:24:13,  3.28it/s]
 80%|███████▉  | 295811/371472 [1:22:24<6:17:24,  3.34it/s]
 80%|███████▉  | 295812/371472 [1:22:24<6:15:40,  3.36it/s]
 80%|███████▉  | 295813/371472 [1:22:25<6:10:22,  3.40it/s]
 80%|███████▉  | 295814/371472 [1:22:25<6:18:23,  3.33it/s]
 80%|███████▉  | 295815/371472 [1:22:25<6:14:41,  3.37it/s]
 80%|███████▉  | 295816/371472 [1:22:26<6:05:45,  3.45it/s]
 80%|███████▉  | 295817/371472 [1:22:26<6:00:43,  3.50it/s]
 80%|███████▉  | 295818/371472 [1:22:26<5:55:25,  3.55it/s]
 80%|███████▉  | 295819/371472 [1:22:26<6:12:59,  3.38it/s]
 80%|███████▉  | 295820/371472 [1:22:27<6:28:00,  3.25it/s]
                                                           
{'loss': 2.7369, 'learning_rate': 2.833879204464651e-07, 'epoch': 12.74}

 80%|███████▉  | 295820/371472 [1:22:27<6:28:00,  3.25it/s]
 80%|███████▉  | 295821/371472 [1:22:27<6:12:12,  3.39it/s]
 80%|███████▉  | 295822/371472 [1:22:27<5:55:54,  3.54it/s]
 80%|███████▉  | 295823/371472 [1:22:28<6:07:38,  3.43it/s]
 80%|███████▉  | 295824/371472 [1:22:28<6:55:51,  3.03it/s]
 80%|███████▉  | 295825/371472 [1:22:28<6:32:09,  3.21it/s]
 80%|███████▉  | 295826/371472 [1:22:29<6:26:28,  3.26it/s]
 80%|███████▉  | 295827/371472 [1:22:29<6:06:56,  3.44it/s]
 80%|███████▉  | 295828/371472 [1:22:29<6:01:35,  3.49it/s]
 80%|███████▉  | 295829/371472 [1:22:29<6:08:23,  3.42it/s]
 80%|███████▉  | 295830/371472 [1:22:30<5:49:26,  3.61it/s]
 80%|███████▉  | 295831/371472 [1:22:30<5:42:06,  3.69it/s]
 80%|███████▉  | 295832/371472 [1:22:30<5:45:28,  3.65it/s]
 80%|███████▉  | 295833/371472 [1:22:30<5:42:05,  3.69it/s]
 80%|███████▉  | 295834/371472 [1:22:31<5:38:12,  3.73it/s]
 80%|███████▉  | 295835/371472 [1:22:31<5:40:00,  3.71it/s]
 80%|███████▉  | 295836/371472 [1:22:31<5:36:58,  3.74it/s]
 80%|███████▉  | 295837/371472 [1:22:32<5:43:49,  3.67it/s]
 80%|███████▉  | 295838/371472 [1:22:32<5:52:37,  3.57it/s]
 80%|███████▉  | 295839/371472 [1:22:32<5:51:57,  3.58it/s]
 80%|███████▉  | 295840/371472 [1:22:32<6:01:55,  3.48it/s]
                                                           
{'loss': 2.6565, 'learning_rate': 2.8333943847098623e-07, 'epoch': 12.74}

 80%|███████▉  | 295840/371472 [1:22:32<6:01:55,  3.48it/s]
 80%|███████▉  | 295841/371472 [1:22:33<5:53:03,  3.57it/s]
 80%|███████▉  | 295842/371472 [1:22:33<5:46:39,  3.64it/s]
 80%|███████▉  | 295843/371472 [1:22:33<5:45:01,  3.65it/s]
 80%|███████▉  | 295844/371472 [1:22:33<5:49:45,  3.60it/s]
 80%|███████▉  | 295845/371472 [1:22:34<6:12:36,  3.38it/s]
 80%|███████▉  | 295846/371472 [1:22:34<5:53:18,  3.57it/s]
 80%|███████▉  | 295847/371472 [1:22:34<5:52:36,  3.57it/s]
 80%|███████▉  | 295848/371472 [1:22:35<5:55:00,  3.55it/s]
 80%|███████▉  | 295849/371472 [1:22:35<5:49:20,  3.61it/s]
 80%|███████▉  | 295850/371472 [1:22:35<5:57:25,  3.53it/s]
 80%|███████▉  | 295851/371472 [1:22:36<6:19:33,  3.32it/s]
 80%|███████▉  | 295852/371472 [1:22:36<6:17:19,  3.34it/s]
 80%|███████▉  | 295853/371472 [1:22:36<6:14:10,  3.37it/s]
 80%|███████▉  | 295854/371472 [1:22:36<6:06:34,  3.44it/s]
 80%|███████▉  | 295855/371472 [1:22:37<6:20:44,  3.31it/s]
 80%|███████▉  | 295856/371472 [1:22:37<6:18:43,  3.33it/s]
 80%|███████▉  | 295857/371472 [1:22:37<6:08:10,  3.42it/s]
 80%|███████▉  | 295858/371472 [1:22:38<5:58:14,  3.52it/s]
 80%|███████▉  | 295859/371472 [1:22:38<5:49:18,  3.61it/s]
 80%|███████▉  | 295860/371472 [1:22:38<5:38:45,  3.72it/s]
                                                           
{'loss': 2.664, 'learning_rate': 2.832909564955073e-07, 'epoch': 12.74}

 80%|███████▉  | 295860/371472 [1:22:38<5:38:45,  3.72it/s]
 80%|███████▉  | 295861/371472 [1:22:38<5:32:57,  3.78it/s]
 80%|███████▉  | 295862/371472 [1:22:39<5:24:36,  3.88it/s]
 80%|███████▉  | 295863/371472 [1:22:39<5:35:34,  3.76it/s]
 80%|███████▉  | 295864/371472 [1:22:39<5:47:02,  3.63it/s]
 80%|███████▉  | 295865/371472 [1:22:39<5:43:46,  3.67it/s]
 80%|███████▉  | 295866/371472 [1:22:40<5:37:11,  3.74it/s]
 80%|███████▉  | 295867/371472 [1:22:40<5:34:50,  3.76it/s]
 80%|███████▉  | 295868/371472 [1:22:40<5:26:13,  3.86it/s]
 80%|███████▉  | 295869/371472 [1:22:40<5:31:18,  3.80it/s]
 80%|███████▉  | 295870/371472 [1:22:41<5:42:31,  3.68it/s]
 80%|███████▉  | 295871/371472 [1:22:41<5:44:32,  3.66it/s]
 80%|███████▉  | 295872/371472 [1:22:41<5:34:06,  3.77it/s]
 80%|███████▉  | 295873/371472 [1:22:42<6:04:38,  3.46it/s]
 80%|███████▉  | 295874/371472 [1:22:42<6:36:13,  3.18it/s]
 80%|███████▉  | 295875/371472 [1:22:42<6:16:17,  3.35it/s]
 80%|███████▉  | 295876/371472 [1:22:43<6:27:44,  3.25it/s]
 80%|███████▉  | 295877/371472 [1:22:43<6:21:20,  3.30it/s]
 80%|███████▉  | 295878/371472 [1:22:43<6:14:21,  3.37it/s]
 80%|███████▉  | 295879/371472 [1:22:43<6:13:30,  3.37it/s]
 80%|███████▉  | 295880/371472 [1:22:44<5:52:39,  3.57it/s]
                                                           
{'loss': 2.7261, 'learning_rate': 2.832424745200285e-07, 'epoch': 12.74}

 80%|███████▉  | 295880/371472 [1:22:44<5:52:39,  3.57it/s]
 80%|███████▉  | 295881/371472 [1:22:44<5:48:10,  3.62it/s]
 80%|███████▉  | 295882/371472 [1:22:44<5:53:58,  3.56it/s]
 80%|███████▉  | 295883/371472 [1:22:44<5:46:34,  3.64it/s]
 80%|███████▉  | 295884/371472 [1:22:45<5:58:20,  3.52it/s]
 80%|███████▉  | 295885/371472 [1:22:45<6:03:42,  3.46it/s]
 80%|███████▉  | 295886/371472 [1:22:45<6:16:30,  3.35it/s]
 80%|███████▉  | 295887/371472 [1:22:46<5:57:07,  3.53it/s]
 80%|███████▉  | 295888/371472 [1:22:46<5:49:31,  3.60it/s]
 80%|███████▉  | 295889/371472 [1:22:46<5:59:48,  3.50it/s]
 80%|███████▉  | 295890/371472 [1:22:47<6:10:15,  3.40it/s]
 80%|███████▉  | 295891/371472 [1:22:47<6:05:50,  3.44it/s]
 80%|███████▉  | 295892/371472 [1:22:47<5:51:30,  3.58it/s]
 80%|███████▉  | 295893/371472 [1:22:47<5:49:23,  3.61it/s]
 80%|███████▉  | 295894/371472 [1:22:48<5:42:44,  3.68it/s]
 80%|███████▉  | 295895/371472 [1:22:48<5:36:46,  3.74it/s]
 80%|███████▉  | 295896/371472 [1:22:48<5:48:40,  3.61it/s]
 80%|███████▉  | 295897/371472 [1:22:48<6:00:38,  3.49it/s]
 80%|███████▉  | 295898/371472 [1:22:49<5:57:37,  3.52it/s]
 80%|███████▉  | 295899/371472 [1:22:49<5:55:24,  3.54it/s]
 80%|███████▉  | 295900/371472 [1:22:49<5:43:43,  3.66it/s]
                                                           
{'loss': 2.7797, 'learning_rate': 2.8319399254454955e-07, 'epoch': 12.74}

 80%|███████▉  | 295900/371472 [1:22:49<5:43:43,  3.66it/s]
 80%|███████▉  | 295901/371472 [1:22:50<5:40:51,  3.70it/s]
 80%|███████▉  | 295902/371472 [1:22:50<5:51:26,  3.58it/s]
 80%|███████▉  | 295903/371472 [1:22:50<6:29:26,  3.23it/s]
 80%|███████▉  | 295904/371472 [1:22:50<6:11:06,  3.39it/s]
 80%|███████▉  | 295905/371472 [1:22:51<6:06:18,  3.44it/s]
 80%|███████▉  | 295906/371472 [1:22:51<6:09:17,  3.41it/s]
 80%|███████▉  | 295907/371472 [1:22:51<6:05:04,  3.45it/s]
 80%|███████▉  | 295908/371472 [1:22:52<6:03:23,  3.47it/s]
 80%|███████▉  | 295909/371472 [1:22:52<6:00:25,  3.49it/s]
 80%|███████▉  | 295910/371472 [1:22:52<5:53:26,  3.56it/s]
 80%|███████▉  | 295911/371472 [1:22:53<6:04:39,  3.45it/s]
 80%|███████▉  | 295912/371472 [1:22:53<6:05:02,  3.45it/s]
 80%|███████▉  | 295913/371472 [1:22:53<6:00:59,  3.49it/s]
 80%|███████▉  | 295914/371472 [1:22:53<5:53:18,  3.56it/s]
 80%|███████▉  | 295915/371472 [1:22:54<5:39:50,  3.71it/s]
 80%|███████▉  | 295916/371472 [1:22:54<5:49:05,  3.61it/s]
 80%|███████▉  | 295917/371472 [1:22:54<5:37:13,  3.73it/s]
 80%|███████▉  | 295918/371472 [1:22:54<5:32:37,  3.79it/s]
 80%|███████▉  | 295919/371472 [1:22:55<5:28:21,  3.83it/s]
 80%|███████▉  | 295920/371472 [1:22:55<5:50:02,  3.60it/s]
                                                           
{'loss': 2.5473, 'learning_rate': 2.831455105690707e-07, 'epoch': 12.75}

 80%|███████▉  | 295920/371472 [1:22:55<5:50:02,  3.60it/s]
 80%|███████▉  | 295921/371472 [1:22:55<5:53:15,  3.56it/s]
 80%|███████▉  | 295922/371472 [1:22:56<5:46:30,  3.63it/s]
 80%|███████▉  | 295923/371472 [1:22:56<6:04:04,  3.46it/s]
 80%|███████▉  | 295924/371472 [1:22:56<5:57:27,  3.52it/s]
 80%|███████▉  | 295925/371472 [1:22:56<6:04:16,  3.46it/s]
 80%|███████▉  | 295926/371472 [1:22:57<5:51:48,  3.58it/s]
 80%|███████▉  | 295927/371472 [1:22:57<5:44:44,  3.65it/s]
 80%|███████▉  | 295928/371472 [1:22:57<5:37:44,  3.73it/s]
 80%|███████▉  | 295929/371472 [1:22:57<5:40:32,  3.70it/s]
 80%|███████▉  | 295930/371472 [1:22:58<5:47:51,  3.62it/s]
 80%|███████▉  | 295931/371472 [1:22:58<5:43:03,  3.67it/s]
 80%|███████▉  | 295932/371472 [1:22:58<5:40:16,  3.70it/s]
 80%|███████▉  | 295933/371472 [1:22:59<5:39:09,  3.71it/s]
 80%|███████▉  | 295934/371472 [1:22:59<5:52:45,  3.57it/s]
 80%|███████▉  | 295935/371472 [1:22:59<5:43:16,  3.67it/s]
 80%|███████▉  | 295936/371472 [1:22:59<5:41:38,  3.68it/s]
 80%|███████▉  | 295937/371472 [1:23:00<5:53:26,  3.56it/s]
 80%|███████▉  | 295938/371472 [1:23:00<5:58:46,  3.51it/s]
 80%|███████▉  | 295939/371472 [1:23:00<5:48:55,  3.61it/s]
 80%|███████▉  | 295940/371472 [1:23:01<5:55:59,  3.54it/s]
                                                           
{'loss': 2.5462, 'learning_rate': 2.8309702859359175e-07, 'epoch': 12.75}

 80%|███████▉  | 295940/371472 [1:23:01<5:55:59,  3.54it/s]
 80%|███████▉  | 295941/371472 [1:23:01<5:56:28,  3.53it/s]
 80%|███████▉  | 295942/371472 [1:23:01<6:22:51,  3.29it/s]
 80%|███████▉  | 295943/371472 [1:23:01<6:13:59,  3.37it/s]
 80%|███████▉  | 295944/371472 [1:23:02<6:02:55,  3.47it/s]
 80%|███████▉  | 295945/371472 [1:23:02<5:51:32,  3.58it/s]
 80%|███████▉  | 295946/371472 [1:23:02<5:41:49,  3.68it/s]
 80%|███████▉  | 295947/371472 [1:23:02<5:28:33,  3.83it/s]
 80%|███████▉  | 295948/371472 [1:23:03<5:39:17,  3.71it/s]
 80%|███████▉  | 295949/371472 [1:23:03<5:48:45,  3.61it/s]
 80%|███████▉  | 295950/371472 [1:23:03<5:49:04,  3.61it/s]
 80%|███████▉  | 295951/371472 [1:23:04<6:07:22,  3.43it/s]
 80%|███████▉  | 295952/371472 [1:23:04<5:57:34,  3.52it/s]
 80%|███████▉  | 295953/371472 [1:23:04<5:58:43,  3.51it/s]
 80%|███████▉  | 295954/371472 [1:23:04<5:50:03,  3.60it/s]
 80%|███████▉  | 295955/371472 [1:23:05<5:46:11,  3.64it/s]
 80%|███████▉  | 295956/371472 [1:23:05<6:08:13,  3.42it/s]
 80%|███████▉  | 295957/371472 [1:23:05<5:58:23,  3.51it/s]
 80%|███████▉  | 295958/371472 [1:23:06<5:57:23,  3.52it/s]
 80%|███████▉  | 295959/371472 [1:23:06<6:16:21,  3.34it/s]
 80%|███████▉  | 295960/371472 [1:23:06<6:36:32,  3.17it/s]
                                                           
{'loss': 2.6234, 'learning_rate': 2.8304854661811277e-07, 'epoch': 12.75}

 80%|███████▉  | 295960/371472 [1:23:06<6:36:32,  3.17it/s]
 80%|███████▉  | 295961/371472 [1:23:07<6:19:37,  3.32it/s]
 80%|███████▉  | 295962/371472 [1:23:07<6:00:36,  3.49it/s]
 80%|███████▉  | 295963/371472 [1:23:07<6:08:12,  3.42it/s]
 80%|███████▉  | 295964/371472 [1:23:07<5:54:26,  3.55it/s]
 80%|███████▉  | 295965/371472 [1:23:08<5:52:52,  3.57it/s]
 80%|███████▉  | 295966/371472 [1:23:08<5:57:12,  3.52it/s]
 80%|███████▉  | 295967/371472 [1:23:08<5:43:20,  3.67it/s]
 80%|███████▉  | 295968/371472 [1:23:08<5:45:30,  3.64it/s]
 80%|███████▉  | 295969/371472 [1:23:09<5:42:05,  3.68it/s]
 80%|███████▉  | 295970/371472 [1:23:09<6:15:40,  3.35it/s]
 80%|███████▉  | 295971/371472 [1:23:09<5:59:00,  3.51it/s]
 80%|███████▉  | 295972/371472 [1:23:10<5:46:16,  3.63it/s]
 80%|███████▉  | 295973/371472 [1:23:10<6:36:16,  3.18it/s]
 80%|███████▉  | 295974/371472 [1:23:10<6:41:16,  3.14it/s]
 80%|███████▉  | 295975/371472 [1:23:11<6:30:56,  3.22it/s]
 80%|███████▉  | 295976/371472 [1:23:11<6:33:50,  3.19it/s]
 80%|███████▉  | 295977/371472 [1:23:11<6:26:03,  3.26it/s]
 80%|███████▉  | 295978/371472 [1:23:12<6:22:01,  3.29it/s]
 80%|███████▉  | 295979/371472 [1:23:12<6:07:31,  3.42it/s]
 80%|███████▉  | 295980/371472 [1:23:12<6:01:54,  3.48it/s]
                                                           
{'loss': 2.5749, 'learning_rate': 2.8300006464263394e-07, 'epoch': 12.75}

 80%|███████▉  | 295980/371472 [1:23:12<6:01:54,  3.48it/s]
 80%|███████▉  | 295981/371472 [1:23:12<5:49:50,  3.60it/s]
 80%|███████▉  | 295982/371472 [1:23:13<5:47:48,  3.62it/s]
 80%|███████▉  | 295983/371472 [1:23:13<5:46:31,  3.63it/s]
 80%|███████▉  | 295984/371472 [1:23:13<5:39:59,  3.70it/s]
 80%|███████▉  | 295985/371472 [1:23:13<5:51:05,  3.58it/s]
 80%|███████▉  | 295986/371472 [1:23:14<5:52:35,  3.57it/s]
 80%|███████▉  | 295987/371472 [1:23:14<5:42:07,  3.68it/s]
 80%|███████▉  | 295988/371472 [1:23:14<6:17:09,  3.34it/s]
 80%|███████▉  | 295989/371472 [1:23:15<6:15:30,  3.35it/s]
 80%|███████▉  | 295990/371472 [1:23:15<6:07:13,  3.43it/s]
 80%|███████▉  | 295991/371472 [1:23:15<6:24:25,  3.27it/s]
 80%|███████▉  | 295992/371472 [1:23:16<6:12:45,  3.37it/s]
 80%|███████▉  | 295993/371472 [1:23:16<6:05:43,  3.44it/s]
 80%|███████▉  | 295994/371472 [1:23:16<6:02:33,  3.47it/s]
 80%|███████▉  | 295995/371472 [1:23:16<5:49:50,  3.60it/s]
 80%|███████▉  | 295996/371472 [1:23:17<5:48:50,  3.61it/s]
 80%|███████▉  | 295997/371472 [1:23:17<5:56:15,  3.53it/s]
 80%|███████▉  | 295998/371472 [1:23:17<5:46:55,  3.63it/s]
 80%|███████▉  | 295999/371472 [1:23:17<5:43:54,  3.66it/s]
 80%|███████▉  | 296000/371472 [1:23:18<5:46:24,  3.63it/s]
                                                           
{'loss': 2.5439, 'learning_rate': 2.82951582667155e-07, 'epoch': 12.75}

 80%|███████▉  | 296000/371472 [1:23:18<5:46:24,  3.63it/s]
 80%|███████▉  | 296001/371472 [1:23:18<5:44:27,  3.65it/s]
 80%|███████▉  | 296002/371472 [1:23:18<5:46:05,  3.63it/s]
 80%|███████▉  | 296003/371472 [1:23:19<5:43:49,  3.66it/s]
 80%|███████▉  | 296004/371472 [1:23:19<5:42:40,  3.67it/s]
 80%|███████▉  | 296005/371472 [1:23:19<5:45:35,  3.64it/s]
 80%|███████▉  | 296006/371472 [1:23:19<5:56:18,  3.53it/s]
 80%|███████▉  | 296007/371472 [1:23:20<5:51:44,  3.58it/s]
 80%|███████▉  | 296008/371472 [1:23:20<5:42:28,  3.67it/s]
 80%|███████▉  | 296009/371472 [1:23:20<5:59:41,  3.50it/s]
 80%|███████▉  | 296010/371472 [1:23:20<5:49:13,  3.60it/s]
 80%|███████▉  | 296011/371472 [1:23:21<5:45:51,  3.64it/s]
 80%|███████▉  | 296012/371472 [1:23:21<5:45:29,  3.64it/s]
 80%|███████▉  | 296013/371472 [1:23:21<5:34:20,  3.76it/s]
 80%|███████▉  | 296014/371472 [1:23:22<5:32:27,  3.78it/s]
 80%|███████▉  | 296015/371472 [1:23:22<5:53:47,  3.55it/s]
 80%|███████▉  | 296016/371472 [1:23:22<6:05:45,  3.44it/s]
 80%|███████▉  | 296017/371472 [1:23:22<5:55:14,  3.54it/s]
 80%|███████▉  | 296018/371472 [1:23:23<6:00:55,  3.48it/s]
 80%|███████▉  | 296019/371472 [1:23:23<5:56:53,  3.52it/s]
 80%|███████▉  | 296020/371472 [1:23:23<5:47:49,  3.62it/s]
                                                           
{'loss': 2.4526, 'learning_rate': 2.8290310069167614e-07, 'epoch': 12.75}

 80%|███████▉  | 296020/371472 [1:23:23<5:47:49,  3.62it/s]
 80%|███████▉  | 296021/371472 [1:23:24<5:36:04,  3.74it/s]
 80%|███████▉  | 296022/371472 [1:23:24<5:43:08,  3.66it/s]
 80%|███████▉  | 296023/371472 [1:23:24<5:38:29,  3.71it/s]
 80%|███████▉  | 296024/371472 [1:23:24<5:35:30,  3.75it/s]
 80%|███████▉  | 296025/371472 [1:23:25<5:37:52,  3.72it/s]
 80%|███████▉  | 296026/371472 [1:23:25<5:46:42,  3.63it/s]
 80%|███████▉  | 296027/371472 [1:23:25<5:37:16,  3.73it/s]
 80%|███████▉  | 296028/371472 [1:23:25<5:36:26,  3.74it/s]
 80%|███████▉  | 296029/371472 [1:23:26<5:33:54,  3.77it/s]
 80%|███████▉  | 296030/371472 [1:23:26<5:34:56,  3.75it/s]
 80%|███████▉  | 296031/371472 [1:23:26<5:38:59,  3.71it/s]
 80%|███████▉  | 296032/371472 [1:23:26<5:41:04,  3.69it/s]
 80%|███████▉  | 296033/371472 [1:23:27<5:46:54,  3.62it/s]
 80%|███████▉  | 296034/371472 [1:23:27<5:49:14,  3.60it/s]
 80%|███████▉  | 296035/371472 [1:23:27<6:09:10,  3.41it/s]
 80%|███████▉  | 296036/371472 [1:23:28<6:19:41,  3.31it/s]
 80%|███████▉  | 296037/371472 [1:23:28<6:01:56,  3.47it/s]
 80%|███████▉  | 296038/371472 [1:23:28<6:00:59,  3.48it/s]
 80%|███████▉  | 296039/371472 [1:23:29<6:16:52,  3.34it/s]
 80%|███████▉  | 296040/371472 [1:23:29<6:18:30,  3.32it/s]
                                                           
{'loss': 2.786, 'learning_rate': 2.8285461871619726e-07, 'epoch': 12.75}

 80%|███████▉  | 296040/371472 [1:23:29<6:18:30,  3.32it/s]
 80%|███████▉  | 296041/371472 [1:23:29<6:03:56,  3.45it/s]
 80%|███████▉  | 296042/371472 [1:23:29<5:57:42,  3.51it/s]
 80%|███████▉  | 296043/371472 [1:23:30<6:13:47,  3.36it/s]
 80%|███████▉  | 296044/371472 [1:23:30<6:06:16,  3.43it/s]
 80%|███████▉  | 296045/371472 [1:23:30<5:47:49,  3.61it/s]
 80%|███████▉  | 296046/371472 [1:23:31<5:39:45,  3.70it/s]
 80%|███████▉  | 296047/371472 [1:23:31<5:39:01,  3.71it/s]
 80%|███████▉  | 296048/371472 [1:23:31<5:49:01,  3.60it/s]
 80%|███████▉  | 296049/371472 [1:23:31<5:44:59,  3.64it/s]
 80%|███████▉  | 296050/371472 [1:23:32<6:04:32,  3.45it/s]
 80%|███████▉  | 296051/371472 [1:23:32<5:55:27,  3.54it/s]
 80%|███████▉  | 296052/371472 [1:23:32<5:49:21,  3.60it/s]
 80%|███████▉  | 296053/371472 [1:23:32<5:41:10,  3.68it/s]
 80%|███████▉  | 296054/371472 [1:23:33<5:46:32,  3.63it/s]
 80%|███████▉  | 296055/371472 [1:23:33<5:45:43,  3.64it/s]
 80%|███████▉  | 296056/371472 [1:23:33<5:55:10,  3.54it/s]
 80%|███████▉  | 296057/371472 [1:23:34<6:09:53,  3.40it/s]
 80%|███████▉  | 296058/371472 [1:23:34<6:07:26,  3.42it/s]
 80%|███████▉  | 296059/371472 [1:23:34<5:51:56,  3.57it/s]
 80%|███████▉  | 296060/371472 [1:23:34<5:40:43,  3.69it/s]
                                                           
{'loss': 2.7407, 'learning_rate': 2.828061367407184e-07, 'epoch': 12.75}

 80%|███████▉  | 296060/371472 [1:23:34<5:40:43,  3.69it/s]
 80%|███████▉  | 296061/371472 [1:23:35<5:55:31,  3.54it/s]
 80%|███████▉  | 296062/371472 [1:23:35<5:53:32,  3.56it/s]
 80%|███████▉  | 296063/371472 [1:23:35<6:35:32,  3.18it/s]
 80%|███████▉  | 296064/371472 [1:23:36<6:42:55,  3.12it/s]
 80%|███████▉  | 296065/371472 [1:23:36<6:30:06,  3.22it/s]
 80%|███████▉  | 296066/371472 [1:23:36<6:29:01,  3.23it/s]
 80%|███████▉  | 296067/371472 [1:23:37<6:13:19,  3.37it/s]
 80%|███████▉  | 296068/371472 [1:23:37<6:39:15,  3.15it/s]
 80%|███████▉  | 296069/371472 [1:23:37<6:24:09,  3.27it/s]
 80%|███████▉  | 296070/371472 [1:23:37<6:01:22,  3.48it/s]
 80%|███████▉  | 296071/371472 [1:23:38<5:49:25,  3.60it/s]
 80%|███████▉  | 296072/371472 [1:23:38<5:44:01,  3.65it/s]
 80%|███████▉  | 296073/371472 [1:23:38<6:16:56,  3.33it/s]
 80%|███████▉  | 296074/371472 [1:23:39<6:14:49,  3.35it/s]
 80%|███████▉  | 296075/371472 [1:23:39<6:00:21,  3.49it/s]
 80%|███████▉  | 296076/371472 [1:23:39<5:58:06,  3.51it/s]
 80%|███████▉  | 296077/371472 [1:23:39<5:56:37,  3.52it/s]
 80%|███████▉  | 296078/371472 [1:23:40<6:07:41,  3.42it/s]
 80%|███████▉  | 296079/371472 [1:23:40<6:38:48,  3.15it/s]
 80%|███████▉  | 296080/371472 [1:23:40<6:21:10,  3.30it/s]
                                                           
{'loss': 2.5435, 'learning_rate': 2.8275765476523946e-07, 'epoch': 12.75}

 80%|███████▉  | 296080/371472 [1:23:40<6:21:10,  3.30it/s]
 80%|███████▉  | 296081/371472 [1:23:41<6:13:51,  3.36it/s]
 80%|███████▉  | 296082/371472 [1:23:41<5:55:35,  3.53it/s]
 80%|███████▉  | 296083/371472 [1:23:41<5:49:01,  3.60it/s]
 80%|███████▉  | 296084/371472 [1:23:41<5:37:18,  3.72it/s]
 80%|███████▉  | 296085/371472 [1:23:42<5:35:59,  3.74it/s]
 80%|███████▉  | 296086/371472 [1:23:42<5:47:17,  3.62it/s]
 80%|███████▉  | 296087/371472 [1:23:42<5:50:03,  3.59it/s]
 80%|███████▉  | 296088/371472 [1:23:43<5:49:31,  3.59it/s]
 80%|███████▉  | 296089/371472 [1:23:43<6:09:06,  3.40it/s]
 80%|███████▉  | 296090/371472 [1:23:43<6:04:02,  3.45it/s]
 80%|███████▉  | 296091/371472 [1:23:44<5:58:57,  3.50it/s]
 80%|███████▉  | 296092/371472 [1:23:44<6:11:11,  3.38it/s]
 80%|███████▉  | 296093/371472 [1:23:44<5:56:39,  3.52it/s]
 80%|███████▉  | 296094/371472 [1:23:44<5:56:46,  3.52it/s]
 80%|███████▉  | 296095/371472 [1:23:45<5:55:30,  3.53it/s]
 80%|███████▉  | 296096/371472 [1:23:45<6:07:34,  3.42it/s]
 80%|███████▉  | 296097/371472 [1:23:45<6:03:48,  3.45it/s]
 80%|███████▉  | 296098/371472 [1:23:46<5:57:44,  3.51it/s]
 80%|███████▉  | 296099/371472 [1:23:46<6:16:23,  3.34it/s]
 80%|███████▉  | 296100/371472 [1:23:46<6:12:16,  3.37it/s]
                                                           
{'loss': 2.6374, 'learning_rate': 2.827091727897606e-07, 'epoch': 12.75}

 80%|███████▉  | 296100/371472 [1:23:46<6:12:16,  3.37it/s]
 80%|███████▉  | 296101/371472 [1:23:46<6:12:47,  3.37it/s]
 80%|███████▉  | 296102/371472 [1:23:47<5:59:26,  3.49it/s]
 80%|███████▉  | 296103/371472 [1:23:47<6:06:28,  3.43it/s]
 80%|███████▉  | 296104/371472 [1:23:47<5:56:54,  3.52it/s]
 80%|███████▉  | 296105/371472 [1:23:48<6:05:16,  3.44it/s]
 80%|███████▉  | 296106/371472 [1:23:48<5:53:27,  3.55it/s]
 80%|███████▉  | 296107/371472 [1:23:48<6:00:34,  3.48it/s]
 80%|███████▉  | 296108/371472 [1:23:48<6:23:25,  3.28it/s]
 80%|███████▉  | 296109/371472 [1:23:49<6:11:37,  3.38it/s]
 80%|███████▉  | 296110/371472 [1:23:49<6:01:01,  3.48it/s]
 80%|███████▉  | 296111/371472 [1:23:49<5:53:50,  3.55it/s]
 80%|███████▉  | 296112/371472 [1:23:50<6:03:57,  3.45it/s]
 80%|███████▉  | 296113/371472 [1:23:50<6:11:04,  3.38it/s]
 80%|███████▉  | 296114/371472 [1:23:50<6:03:24,  3.46it/s]
 80%|███████▉  | 296115/371472 [1:23:50<5:48:48,  3.60it/s]
 80%|███████▉  | 296116/371472 [1:23:51<5:49:56,  3.59it/s]
 80%|███████▉  | 296117/371472 [1:23:51<5:49:45,  3.59it/s]
 80%|███████▉  | 296118/371472 [1:23:51<5:57:00,  3.52it/s]
 80%|███████▉  | 296119/371472 [1:23:52<5:54:39,  3.54it/s]
 80%|███████▉  | 296120/371472 [1:23:52<6:00:56,  3.48it/s]
                                                           
{'loss': 2.5454, 'learning_rate': 2.8266069081428166e-07, 'epoch': 12.75}

 80%|███████▉  | 296120/371472 [1:23:52<6:00:56,  3.48it/s]
 80%|███████▉  | 296121/371472 [1:23:52<6:02:16,  3.47it/s]
 80%|███████▉  | 296122/371472 [1:23:52<6:13:04,  3.37it/s]
 80%|███████▉  | 296123/371472 [1:23:53<6:01:48,  3.47it/s]
 80%|███████▉  | 296124/371472 [1:23:53<5:56:23,  3.52it/s]
 80%|███████▉  | 296125/371472 [1:23:53<5:57:31,  3.51it/s]
 80%|███████▉  | 296126/371472 [1:23:54<5:51:35,  3.57it/s]
 80%|███████▉  | 296127/371472 [1:23:54<5:52:13,  3.57it/s]
 80%|███████▉  | 296128/371472 [1:23:54<6:11:09,  3.38it/s]
 80%|███████▉  | 296129/371472 [1:23:55<6:22:13,  3.29it/s]
 80%|███████▉  | 296130/371472 [1:23:55<6:28:59,  3.23it/s]
 80%|███████▉  | 296131/371472 [1:23:55<6:15:38,  3.34it/s]
 80%|███████▉  | 296132/371472 [1:23:55<6:01:02,  3.48it/s]
 80%|███████▉  | 296133/371472 [1:23:56<6:25:30,  3.26it/s]
 80%|███████▉  | 296134/371472 [1:23:56<6:06:49,  3.42it/s]
 80%|███████▉  | 296135/371472 [1:23:56<6:02:16,  3.47it/s]
 80%|███████▉  | 296136/371472 [1:23:57<5:51:09,  3.58it/s]
 80%|███████▉  | 296137/371472 [1:23:57<5:47:10,  3.62it/s]
 80%|███████▉  | 296138/371472 [1:23:57<6:02:37,  3.46it/s]
 80%|███████▉  | 296139/371472 [1:23:57<6:02:42,  3.46it/s]
 80%|███████▉  | 296140/371472 [1:23:58<5:53:55,  3.55it/s]
                                                           
{'loss': 2.5536, 'learning_rate': 2.8261220883880283e-07, 'epoch': 12.76}

 80%|███████▉  | 296140/371472 [1:23:58<5:53:55,  3.55it/s]
 80%|███████▉  | 296141/371472 [1:23:58<5:50:06,  3.59it/s]
 80%|███████▉  | 296142/371472 [1:23:58<5:52:23,  3.56it/s]
 80%|███████▉  | 296143/371472 [1:23:58<5:45:15,  3.64it/s]
 80%|███████▉  | 296144/371472 [1:23:59<5:49:39,  3.59it/s]
 80%|███████▉  | 296145/371472 [1:23:59<5:48:06,  3.61it/s]
 80%|███████▉  | 296146/371472 [1:23:59<6:06:27,  3.43it/s]
 80%|███████▉  | 296147/371472 [1:24:00<6:00:47,  3.48it/s]
 80%|███████▉  | 296148/371472 [1:24:00<5:55:47,  3.53it/s]
 80%|███████▉  | 296149/371472 [1:24:00<5:59:48,  3.49it/s]
 80%|███████▉  | 296150/371472 [1:24:01<6:18:18,  3.32it/s]
 80%|███████▉  | 296151/371472 [1:24:01<6:03:44,  3.45it/s]
 80%|███████▉  | 296152/371472 [1:24:01<5:59:59,  3.49it/s]
 80%|███████▉  | 296153/371472 [1:24:01<5:51:27,  3.57it/s]
 80%|███████▉  | 296154/371472 [1:24:02<6:07:44,  3.41it/s]
 80%|███████▉  | 296155/371472 [1:24:02<6:19:52,  3.30it/s]
 80%|███████▉  | 296156/371472 [1:24:02<6:14:21,  3.35it/s]
 80%|███████▉  | 296157/371472 [1:24:03<6:11:48,  3.38it/s]
 80%|███████▉  | 296158/371472 [1:24:03<5:58:54,  3.50it/s]
 80%|███████▉  | 296159/371472 [1:24:03<6:07:51,  3.41it/s]
 80%|███████▉  | 296160/371472 [1:24:03<6:04:02,  3.45it/s]
                                                           
{'loss': 2.7044, 'learning_rate': 2.825637268633239e-07, 'epoch': 12.76}

 80%|███████▉  | 296160/371472 [1:24:03<6:04:02,  3.45it/s]
 80%|███████▉  | 296161/371472 [1:24:04<6:02:51,  3.46it/s]
 80%|███████▉  | 296162/371472 [1:24:04<5:48:29,  3.60it/s]
 80%|███████▉  | 296163/371472 [1:24:04<5:39:24,  3.70it/s]
 80%|███████▉  | 296164/371472 [1:24:04<5:32:39,  3.77it/s]
 80%|███████▉  | 296165/371472 [1:24:05<5:57:05,  3.51it/s]
 80%|███████▉  | 296166/371472 [1:24:05<5:52:15,  3.56it/s]
 80%|███████▉  | 296167/371472 [1:24:05<5:42:37,  3.66it/s]
 80%|███████▉  | 296168/371472 [1:24:06<5:56:43,  3.52it/s]
 80%|███████▉  | 296169/371472 [1:24:06<5:55:58,  3.53it/s]
 80%|███████▉  | 296170/371472 [1:24:06<5:53:33,  3.55it/s]
 80%|███████▉  | 296171/371472 [1:24:07<6:07:20,  3.42it/s]
 80%|███████▉  | 296172/371472 [1:24:07<6:24:53,  3.26it/s]
 80%|███████▉  | 296173/371472 [1:24:07<6:12:06,  3.37it/s]
 80%|███████▉  | 296174/371472 [1:24:07<6:02:16,  3.46it/s]
 80%|███████▉  | 296175/371472 [1:24:08<6:02:10,  3.47it/s]
 80%|███████▉  | 296176/371472 [1:24:08<6:26:42,  3.25it/s]
 80%|███████▉  | 296177/371472 [1:24:08<6:31:32,  3.21it/s]
 80%|███████▉  | 296178/371472 [1:24:09<6:05:56,  3.43it/s]
 80%|███████▉  | 296179/371472 [1:24:09<6:00:34,  3.48it/s]
 80%|███████▉  | 296180/371472 [1:24:09<5:46:22,  3.62it/s]
                                                           
{'loss': 2.6375, 'learning_rate': 2.8251524488784503e-07, 'epoch': 12.76}

 80%|███████▉  | 296180/371472 [1:24:09<5:46:22,  3.62it/s]
 80%|███████▉  | 296181/371472 [1:24:09<5:43:20,  3.65it/s]
 80%|███████▉  | 296182/371472 [1:24:10<6:07:10,  3.42it/s]
 80%|███████▉  | 296183/371472 [1:24:10<6:25:37,  3.25it/s]
 80%|███████▉  | 296184/371472 [1:24:10<6:15:36,  3.34it/s]
 80%|███████▉  | 296185/371472 [1:24:11<6:02:47,  3.46it/s]
 80%|███████▉  | 296186/371472 [1:24:11<5:47:48,  3.61it/s]
 80%|███████▉  | 296187/371472 [1:24:11<5:40:14,  3.69it/s]
 80%|███████▉  | 296188/371472 [1:24:11<5:43:15,  3.66it/s]
 80%|███████▉  | 296189/371472 [1:24:12<5:42:08,  3.67it/s]
 80%|███████▉  | 296190/371472 [1:24:12<5:38:24,  3.71it/s]
 80%|███████▉  | 296191/371472 [1:24:12<5:36:18,  3.73it/s]
 80%|███████▉  | 296192/371472 [1:24:12<5:39:30,  3.70it/s]
 80%|███████▉  | 296193/371472 [1:24:13<5:58:32,  3.50it/s]
 80%|███████▉  | 296194/371472 [1:24:13<5:41:56,  3.67it/s]
 80%|███████▉  | 296195/371472 [1:24:13<5:40:42,  3.68it/s]
 80%|███████▉  | 296196/371472 [1:24:14<5:39:43,  3.69it/s]
 80%|███████▉  | 296197/371472 [1:24:14<5:44:42,  3.64it/s]
 80%|███████▉  | 296198/371472 [1:24:14<5:59:47,  3.49it/s]
 80%|███████▉  | 296199/371472 [1:24:14<6:05:29,  3.43it/s]
 80%|███████▉  | 296200/371472 [1:24:15<5:59:50,  3.49it/s]
                                                           
{'loss': 2.5967, 'learning_rate': 2.824667629123661e-07, 'epoch': 12.76}

 80%|███████▉  | 296200/371472 [1:24:15<5:59:50,  3.49it/s]
 80%|███████▉  | 296201/371472 [1:24:15<6:03:40,  3.45it/s]
 80%|███████▉  | 296202/371472 [1:24:15<5:53:42,  3.55it/s]
 80%|███████▉  | 296203/371472 [1:24:16<5:50:28,  3.58it/s]
 80%|███████▉  | 296204/371472 [1:24:16<5:54:39,  3.54it/s]
 80%|███████▉  | 296205/371472 [1:24:16<5:54:12,  3.54it/s]
 80%|███████▉  | 296206/371472 [1:24:16<6:08:17,  3.41it/s]
 80%|███████▉  | 296207/371472 [1:24:17<6:07:13,  3.42it/s]
 80%|███████▉  | 296208/371472 [1:24:17<5:59:19,  3.49it/s]
 80%|███████▉  | 296209/371472 [1:24:17<5:58:18,  3.50it/s]
 80%|███████▉  | 296210/371472 [1:24:18<6:01:08,  3.47it/s]
 80%|███████▉  | 296211/371472 [1:24:18<5:54:13,  3.54it/s]
 80%|███████▉  | 296212/371472 [1:24:18<5:39:32,  3.69it/s]
 80%|███████▉  | 296213/371472 [1:24:18<6:02:31,  3.46it/s]
 80%|███████▉  | 296214/371472 [1:24:19<6:02:04,  3.46it/s]
 80%|███████▉  | 296215/371472 [1:24:19<6:06:48,  3.42it/s]
 80%|███████▉  | 296216/371472 [1:24:19<6:10:35,  3.38it/s]
 80%|███████▉  | 296217/371472 [1:24:20<6:02:27,  3.46it/s]
 80%|███████▉  | 296218/371472 [1:24:20<6:07:23,  3.41it/s]
 80%|███████▉  | 296219/371472 [1:24:20<5:53:11,  3.55it/s]
 80%|███████▉  | 296220/371472 [1:24:20<5:50:10,  3.58it/s]
                                                           
{'loss': 2.6012, 'learning_rate': 2.824182809368872e-07, 'epoch': 12.76}

 80%|███████▉  | 296220/371472 [1:24:20<5:50:10,  3.58it/s]
 80%|███████▉  | 296221/371472 [1:24:21<6:01:37,  3.47it/s]
 80%|███████▉  | 296222/371472 [1:24:21<6:20:02,  3.30it/s]
 80%|███████▉  | 296223/371472 [1:24:21<6:09:12,  3.40it/s]
 80%|███████▉  | 296224/371472 [1:24:22<5:53:22,  3.55it/s]
 80%|███████▉  | 296225/371472 [1:24:22<6:13:12,  3.36it/s]
 80%|███████▉  | 296226/371472 [1:24:22<6:15:00,  3.34it/s]
 80%|███████▉  | 296227/371472 [1:24:23<6:01:26,  3.47it/s]
 80%|███████▉  | 296228/371472 [1:24:23<6:03:21,  3.45it/s]
 80%|███████▉  | 296229/371472 [1:24:23<6:02:54,  3.46it/s]
 80%|███████▉  | 296230/371472 [1:24:23<6:06:22,  3.42it/s]
 80%|███████▉  | 296231/371472 [1:24:24<5:56:24,  3.52it/s]
 80%|███████▉  | 296232/371472 [1:24:24<5:41:32,  3.67it/s]
 80%|███████▉  | 296233/371472 [1:24:24<6:14:48,  3.35it/s]
 80%|███████▉  | 296234/371472 [1:24:25<6:39:11,  3.14it/s]
 80%|███████▉  | 296235/371472 [1:24:25<6:33:06,  3.19it/s]
 80%|███████▉  | 296236/371472 [1:24:25<6:33:06,  3.19it/s]
 80%|███████▉  | 296237/371472 [1:24:26<6:10:01,  3.39it/s]
 80%|███████▉  | 296238/371472 [1:24:26<6:49:04,  3.07it/s]
 80%|███████▉  | 296239/371472 [1:24:26<6:35:10,  3.17it/s]
 80%|███████▉  | 296240/371472 [1:24:26<6:14:09,  3.35it/s]
                                                           
{'loss': 2.5654, 'learning_rate': 2.823697989614083e-07, 'epoch': 12.76}

 80%|███████▉  | 296240/371472 [1:24:26<6:14:09,  3.35it/s]
 80%|███████▉  | 296241/371472 [1:24:27<5:59:54,  3.48it/s]
 80%|███████▉  | 296242/371472 [1:24:27<5:57:42,  3.51it/s]
 80%|███████▉  | 296243/371472 [1:24:27<5:47:04,  3.61it/s]
 80%|███████▉  | 296244/371472 [1:24:28<5:59:33,  3.49it/s]
 80%|███████▉  | 296245/371472 [1:24:28<5:54:06,  3.54it/s]
 80%|███████▉  | 296246/371472 [1:24:28<5:57:22,  3.51it/s]
 80%|███████▉  | 296247/371472 [1:24:28<5:50:39,  3.58it/s]
 80%|███████▉  | 296248/371472 [1:24:29<6:00:06,  3.48it/s]
 80%|███████▉  | 296249/371472 [1:24:29<5:56:58,  3.51it/s]
 80%|███████▉  | 296250/371472 [1:24:29<5:50:29,  3.58it/s]
 80%|███████▉  | 296251/371472 [1:24:30<5:39:07,  3.70it/s]
 80%|███████▉  | 296252/371472 [1:24:30<5:40:40,  3.68it/s]
 80%|███████▉  | 296253/371472 [1:24:30<5:37:00,  3.72it/s]
 80%|███████▉  | 296254/371472 [1:24:30<5:42:41,  3.66it/s]
 80%|███████▉  | 296255/371472 [1:24:31<5:47:28,  3.61it/s]
 80%|███████▉  | 296256/371472 [1:24:31<5:51:15,  3.57it/s]
 80%|███████▉  | 296257/371472 [1:24:31<5:49:55,  3.58it/s]
 80%|███████▉  | 296258/371472 [1:24:32<6:00:48,  3.47it/s]
 80%|███████▉  | 296259/371472 [1:24:32<5:52:43,  3.55it/s]
 80%|███████▉  | 296260/371472 [1:24:32<5:51:07,  3.57it/s]
                                                           
{'loss': 2.6531, 'learning_rate': 2.823213169859295e-07, 'epoch': 12.76}

 80%|███████▉  | 296260/371472 [1:24:32<5:51:07,  3.57it/s]
 80%|███████▉  | 296261/371472 [1:24:32<5:58:58,  3.49it/s]
 80%|███████▉  | 296262/371472 [1:24:33<5:56:51,  3.51it/s]
 80%|███████▉  | 296263/371472 [1:24:33<5:54:00,  3.54it/s]
 80%|███████▉  | 296264/371472 [1:24:33<6:14:13,  3.35it/s]
 80%|███████▉  | 296265/371472 [1:24:34<6:23:17,  3.27it/s]
 80%|███████▉  | 296266/371472 [1:24:34<6:16:43,  3.33it/s]
 80%|███████▉  | 296267/371472 [1:24:34<6:03:44,  3.45it/s]
 80%|███████▉  | 296268/371472 [1:24:34<5:56:44,  3.51it/s]
 80%|███████▉  | 296269/371472 [1:24:35<5:55:32,  3.53it/s]
 80%|███████▉  | 296270/371472 [1:24:35<6:13:25,  3.36it/s]
 80%|███████▉  | 296271/371472 [1:24:35<6:00:19,  3.48it/s]
 80%|███████▉  | 296272/371472 [1:24:36<5:54:42,  3.53it/s]
 80%|███████▉  | 296273/371472 [1:24:36<5:53:22,  3.55it/s]
 80%|███████▉  | 296274/371472 [1:24:36<5:45:33,  3.63it/s]
 80%|███████▉  | 296275/371472 [1:24:36<5:52:40,  3.55it/s]
 80%|███████▉  | 296276/371472 [1:24:37<5:45:53,  3.62it/s]
 80%|███████▉  | 296277/371472 [1:24:37<5:42:33,  3.66it/s]
 80%|███████▉  | 296278/371472 [1:24:37<5:57:27,  3.51it/s]
 80%|███████▉  | 296279/371472 [1:24:37<5:40:59,  3.68it/s]
 80%|███████▉  | 296280/371472 [1:24:38<5:56:26,  3.52it/s]
                                                           
{'loss': 2.5965, 'learning_rate': 2.8227283501045055e-07, 'epoch': 12.76}

 80%|███████▉  | 296280/371472 [1:24:38<5:56:26,  3.52it/s]
 80%|███████▉  | 296281/371472 [1:24:38<5:56:52,  3.51it/s]
 80%|███████▉  | 296282/371472 [1:24:38<5:51:51,  3.56it/s]
 80%|███████▉  | 296283/371472 [1:24:39<5:50:37,  3.57it/s]
 80%|███████▉  | 296284/371472 [1:24:39<6:11:14,  3.38it/s]
 80%|███████▉  | 296285/371472 [1:24:39<5:58:41,  3.49it/s]
 80%|███████▉  | 296286/371472 [1:24:39<5:51:46,  3.56it/s]
 80%|███████▉  | 296287/371472 [1:24:40<5:58:30,  3.50it/s]
 80%|███████▉  | 296288/371472 [1:24:40<5:49:08,  3.59it/s]
 80%|███████▉  | 296289/371472 [1:24:40<5:42:08,  3.66it/s]
 80%|███████▉  | 296290/371472 [1:24:41<5:50:33,  3.57it/s]
 80%|███████▉  | 296291/371472 [1:24:41<5:55:00,  3.53it/s]
 80%|███████▉  | 296292/371472 [1:24:41<5:53:41,  3.54it/s]
 80%|███████▉  | 296293/371472 [1:24:41<5:53:42,  3.54it/s]
 80%|███████▉  | 296294/371472 [1:24:42<5:46:45,  3.61it/s]
 80%|███████▉  | 296295/371472 [1:24:42<5:43:46,  3.64it/s]
 80%|███████▉  | 296296/371472 [1:24:42<6:16:04,  3.33it/s]
 80%|███████▉  | 296297/371472 [1:24:43<6:03:57,  3.44it/s]
 80%|███████▉  | 296298/371472 [1:24:43<6:09:14,  3.39it/s]
 80%|███████▉  | 296299/371472 [1:24:43<6:21:16,  3.29it/s]
 80%|███████▉  | 296300/371472 [1:24:44<6:20:33,  3.29it/s]
                                                           
{'loss': 2.5703, 'learning_rate': 2.822243530349717e-07, 'epoch': 12.76}

 80%|███████▉  | 296300/371472 [1:24:44<6:20:33,  3.29it/s]
 80%|███████▉  | 296301/371472 [1:24:44<6:19:22,  3.30it/s]
 80%|███████▉  | 296302/371472 [1:24:44<6:18:00,  3.31it/s]
 80%|███████▉  | 296303/371472 [1:24:44<6:01:00,  3.47it/s]
 80%|███████▉  | 296304/371472 [1:24:45<5:56:41,  3.51it/s]
 80%|███████▉  | 296305/371472 [1:24:45<6:13:04,  3.36it/s]
 80%|███████▉  | 296306/371472 [1:24:45<6:09:35,  3.39it/s]
 80%|███████▉  | 296307/371472 [1:24:46<6:02:34,  3.46it/s]
 80%|███████▉  | 296308/371472 [1:24:46<5:58:49,  3.49it/s]
 80%|███████▉  | 296309/371472 [1:24:46<5:56:18,  3.52it/s]
 80%|███████▉  | 296310/371472 [1:24:46<5:55:20,  3.53it/s]
 80%|███████▉  | 296311/371472 [1:24:47<6:22:44,  3.27it/s]
 80%|███████▉  | 296312/371472 [1:24:47<6:19:54,  3.30it/s]
 80%|███████▉  | 296313/371472 [1:24:47<6:28:19,  3.23it/s]
 80%|███████▉  | 296314/371472 [1:24:48<6:16:55,  3.32it/s]
 80%|███████▉  | 296315/371472 [1:24:48<6:10:14,  3.38it/s]
 80%|███████▉  | 296316/371472 [1:24:48<6:08:16,  3.40it/s]
 80%|███████▉  | 296317/371472 [1:24:49<6:26:04,  3.24it/s]
 80%|███████▉  | 296318/371472 [1:24:49<6:06:12,  3.42it/s]
 80%|███████▉  | 296319/371472 [1:24:49<6:03:12,  3.45it/s]
 80%|███████▉  | 296320/371472 [1:24:50<7:10:38,  2.91it/s]
                                                           
{'loss': 2.661, 'learning_rate': 2.8217587105949274e-07, 'epoch': 12.76}

 80%|███████▉  | 296320/371472 [1:24:50<7:10:38,  2.91it/s]
 80%|███████▉  | 296321/371472 [1:24:50<6:40:44,  3.13it/s]
 80%|███████▉  | 296322/371472 [1:24:50<6:27:08,  3.24it/s]
 80%|███████▉  | 296323/371472 [1:24:51<7:29:01,  2.79it/s]
 80%|███████▉  | 296324/371472 [1:24:51<6:48:38,  3.06it/s]
 80%|███████▉  | 296325/371472 [1:24:51<6:26:31,  3.24it/s]
 80%|███████▉  | 296326/371472 [1:24:51<6:09:36,  3.39it/s]
 80%|███████▉  | 296327/371472 [1:24:52<6:08:22,  3.40it/s]
 80%|███████▉  | 296328/371472 [1:24:52<5:58:24,  3.49it/s]
 80%|███████▉  | 296329/371472 [1:24:52<6:03:04,  3.45it/s]
 80%|███████▉  | 296330/371472 [1:24:53<5:54:41,  3.53it/s]
 80%|███████▉  | 296331/371472 [1:24:53<5:56:05,  3.52it/s]
 80%|███████▉  | 296332/371472 [1:24:53<5:49:06,  3.59it/s]
 80%|███████▉  | 296333/371472 [1:24:53<5:58:24,  3.49it/s]
 80%|███████▉  | 296334/371472 [1:24:54<6:01:22,  3.47it/s]
 80%|███████▉  | 296335/371472 [1:24:54<6:29:17,  3.22it/s]
 80%|███████▉  | 296336/371472 [1:24:54<6:16:57,  3.32it/s]
 80%|███████▉  | 296337/371472 [1:24:55<6:13:44,  3.35it/s]
 80%|███████▉  | 296338/371472 [1:24:55<5:57:15,  3.51it/s]
 80%|███████▉  | 296339/371472 [1:24:55<5:49:33,  3.58it/s]
 80%|███████▉  | 296340/371472 [1:24:55<5:47:17,  3.61it/s]
                                                           
{'loss': 2.7292, 'learning_rate': 2.8212738908401387e-07, 'epoch': 12.76}

 80%|███████▉  | 296340/371472 [1:24:55<5:47:17,  3.61it/s]
 80%|███████▉  | 296341/371472 [1:24:56<5:50:11,  3.58it/s]
 80%|███████▉  | 296342/371472 [1:24:56<5:52:22,  3.55it/s]
 80%|███████▉  | 296343/371472 [1:24:56<6:01:20,  3.47it/s]
 80%|███████▉  | 296344/371472 [1:24:57<6:21:38,  3.28it/s]
 80%|███████▉  | 296345/371472 [1:24:57<6:29:03,  3.22it/s]
 80%|███████▉  | 296346/371472 [1:24:57<6:17:22,  3.32it/s]
 80%|███████▉  | 296347/371472 [1:24:57<6:10:19,  3.38it/s]
 80%|███████▉  | 296348/371472 [1:24:58<6:46:23,  3.08it/s]
 80%|███████▉  | 296349/371472 [1:24:58<6:33:07,  3.18it/s]
 80%|███████▉  | 296350/371472 [1:24:59<6:48:33,  3.06it/s]
 80%|███████▉  | 296351/371472 [1:24:59<6:26:01,  3.24it/s]
 80%|███████▉  | 296352/371472 [1:24:59<6:26:44,  3.24it/s]
 80%|███████▉  | 296353/371472 [1:24:59<6:21:43,  3.28it/s]
 80%|███████▉  | 296354/371472 [1:25:00<6:20:55,  3.29it/s]
 80%|███████▉  | 296355/371472 [1:25:00<6:20:38,  3.29it/s]
 80%|███████▉  | 296356/371472 [1:25:00<6:03:03,  3.45it/s]
 80%|███████▉  | 296357/371472 [1:25:01<6:22:31,  3.27it/s]
 80%|███████▉  | 296358/371472 [1:25:01<6:12:28,  3.36it/s]
 80%|███████▉  | 296359/371472 [1:25:01<5:54:54,  3.53it/s]
 80%|███████▉  | 296360/371472 [1:25:01<5:55:04,  3.53it/s]
                                                           
{'loss': 2.7687, 'learning_rate': 2.8207890710853494e-07, 'epoch': 12.76}

 80%|███████▉  | 296360/371472 [1:25:01<5:55:04,  3.53it/s]
 80%|███████▉  | 296361/371472 [1:25:02<5:51:24,  3.56it/s]
 80%|███████▉  | 296362/371472 [1:25:02<5:37:22,  3.71it/s]
 80%|███████▉  | 296363/371472 [1:25:02<5:36:14,  3.72it/s]
 80%|███████▉  | 296364/371472 [1:25:03<5:52:37,  3.55it/s]
 80%|███████▉  | 296365/371472 [1:25:03<6:00:32,  3.47it/s]
 80%|███████▉  | 296366/371472 [1:25:03<6:38:10,  3.14it/s]
 80%|███████▉  | 296367/371472 [1:25:04<6:35:26,  3.17it/s]
 80%|███████▉  | 296368/371472 [1:25:04<6:23:00,  3.27it/s]
 80%|███████▉  | 296369/371472 [1:25:04<6:10:46,  3.38it/s]
 80%|███████▉  | 296370/371472 [1:25:04<5:54:28,  3.53it/s]
 80%|███████▉  | 296371/371472 [1:25:05<5:54:33,  3.53it/s]
 80%|███████▉  | 296372/371472 [1:25:05<5:57:08,  3.50it/s]
 80%|███████▉  | 296373/371472 [1:25:05<5:53:48,  3.54it/s]
 80%|███████▉  | 296374/371472 [1:25:05<5:50:36,  3.57it/s]
 80%|███████▉  | 296375/371472 [1:25:06<6:01:55,  3.46it/s]
 80%|███████▉  | 296376/371472 [1:25:06<6:19:47,  3.30it/s]
 80%|███████▉  | 296377/371472 [1:25:06<6:36:12,  3.16it/s]
 80%|███████▉  | 296378/371472 [1:25:07<6:40:52,  3.12it/s]
 80%|███████▉  | 296379/371472 [1:25:07<6:13:23,  3.35it/s]
 80%|███████▉  | 296380/371472 [1:25:07<6:02:29,  3.45it/s]
                                                           
{'loss': 2.5975, 'learning_rate': 2.820304251330561e-07, 'epoch': 12.77}

 80%|███████▉  | 296380/371472 [1:25:07<6:02:29,  3.45it/s]
 80%|███████▉  | 296381/371472 [1:25:08<6:04:09,  3.44it/s]
 80%|███████▉  | 296382/371472 [1:25:08<6:08:01,  3.40it/s]
 80%|███████▉  | 296383/371472 [1:25:08<5:54:40,  3.53it/s]
 80%|███████▉  | 296384/371472 [1:25:08<5:52:20,  3.55it/s]
 80%|███████▉  | 296385/371472 [1:25:09<5:53:09,  3.54it/s]
 80%|███████▉  | 296386/371472 [1:25:09<6:05:17,  3.43it/s]
 80%|███████▉  | 296387/371472 [1:25:09<6:14:23,  3.34it/s]
 80%|███████▉  | 296388/371472 [1:25:10<6:27:06,  3.23it/s]
 80%|███████▉  | 296389/371472 [1:25:10<6:12:17,  3.36it/s]
 80%|███████▉  | 296390/371472 [1:25:10<6:25:59,  3.24it/s]
 80%|███████▉  | 296391/371472 [1:25:11<6:17:44,  3.31it/s]
 80%|███████▉  | 296392/371472 [1:25:11<6:40:11,  3.13it/s]
 80%|███████▉  | 296393/371472 [1:25:11<6:19:03,  3.30it/s]
 80%|███████▉  | 296394/371472 [1:25:11<6:19:33,  3.30it/s]
 80%|███████▉  | 296395/371472 [1:25:12<6:00:04,  3.48it/s]
 80%|███████▉  | 296396/371472 [1:25:12<6:03:48,  3.44it/s]
 80%|███████▉  | 296397/371472 [1:25:12<6:03:42,  3.44it/s]
 80%|███████▉  | 296398/371472 [1:25:13<5:47:59,  3.60it/s]
 80%|███████▉  | 296399/371472 [1:25:13<5:44:30,  3.63it/s]
 80%|███████▉  | 296400/371472 [1:25:13<5:46:32,  3.61it/s]
                                                           
{'loss': 2.6269, 'learning_rate': 2.819819431575772e-07, 'epoch': 12.77}

 80%|███████▉  | 296400/371472 [1:25:13<5:46:32,  3.61it/s]
 80%|███████▉  | 296401/371472 [1:25:13<5:47:53,  3.60it/s]
 80%|███████▉  | 296402/371472 [1:25:14<6:17:12,  3.32it/s]
 80%|███████▉  | 296403/371472 [1:25:14<5:58:36,  3.49it/s]
 80%|███████▉  | 296404/371472 [1:25:14<5:57:39,  3.50it/s]
 80%|███████▉  | 296405/371472 [1:25:15<6:11:41,  3.37it/s]
 80%|███████▉  | 296406/371472 [1:25:15<6:01:22,  3.46it/s]
 80%|███████▉  | 296407/371472 [1:25:15<5:58:08,  3.49it/s]
 80%|███████▉  | 296408/371472 [1:25:15<5:55:23,  3.52it/s]
 80%|███████▉  | 296409/371472 [1:25:16<5:54:47,  3.53it/s]
 80%|███████▉  | 296410/371472 [1:25:16<6:07:43,  3.40it/s]
 80%|███████▉  | 296411/371472 [1:25:16<6:13:32,  3.35it/s]
 80%|███████▉  | 296412/371472 [1:25:17<6:23:05,  3.27it/s]
 80%|███████▉  | 296413/371472 [1:25:17<6:31:58,  3.19it/s]
 80%|███████▉  | 296414/371472 [1:25:17<6:49:01,  3.06it/s]
 80%|███████▉  | 296415/371472 [1:25:18<6:34:06,  3.17it/s]
 80%|███████▉  | 296416/371472 [1:25:18<6:10:29,  3.38it/s]
 80%|███████▉  | 296417/371472 [1:25:18<5:59:54,  3.48it/s]
 80%|███████▉  | 296418/371472 [1:25:18<6:04:35,  3.43it/s]
 80%|███████▉  | 296419/371472 [1:25:19<5:52:25,  3.55it/s]
 80%|███████▉  | 296420/371472 [1:25:19<5:54:59,  3.52it/s]
                                                           
{'loss': 2.5782, 'learning_rate': 2.8193346118209836e-07, 'epoch': 12.77}

 80%|███████▉  | 296420/371472 [1:25:19<5:54:59,  3.52it/s]
 80%|███████▉  | 296421/371472 [1:25:19<5:52:43,  3.55it/s]
 80%|███████▉  | 296422/371472 [1:25:20<5:52:32,  3.55it/s]
 80%|███████▉  | 296423/371472 [1:25:20<5:49:16,  3.58it/s]
 80%|███████▉  | 296424/371472 [1:25:20<5:55:04,  3.52it/s]
 80%|███████▉  | 296425/371472 [1:25:20<5:52:49,  3.55it/s]
 80%|███████▉  | 296426/371472 [1:25:21<5:44:18,  3.63it/s]
 80%|███████▉  | 296427/371472 [1:25:21<5:58:04,  3.49it/s]
 80%|███████▉  | 296428/371472 [1:25:21<7:10:01,  2.91it/s]
 80%|███████▉  | 296429/371472 [1:25:22<6:52:06,  3.03it/s]
 80%|███████▉  | 296430/371472 [1:25:22<6:57:31,  3.00it/s]
 80%|███████▉  | 296431/371472 [1:25:22<7:05:44,  2.94it/s]
 80%|███████▉  | 296432/371472 [1:25:23<6:43:47,  3.10it/s]
 80%|███████▉  | 296433/371472 [1:25:23<6:18:00,  3.31it/s]
 80%|███████▉  | 296434/371472 [1:25:23<6:17:29,  3.31it/s]
 80%|███████▉  | 296435/371472 [1:25:24<6:12:19,  3.36it/s]
 80%|███████▉  | 296436/371472 [1:25:24<6:02:46,  3.45it/s]
 80%|███████▉  | 296437/371472 [1:25:24<6:07:43,  3.40it/s]
 80%|███████▉  | 296438/371472 [1:25:24<6:03:03,  3.44it/s]
 80%|███████▉  | 296439/371472 [1:25:25<6:03:03,  3.44it/s]
 80%|███████▉  | 296440/371472 [1:25:25<5:48:37,  3.59it/s]
                                                           
{'loss': 2.6674, 'learning_rate': 2.8188497920661933e-07, 'epoch': 12.77}

 80%|███████▉  | 296440/371472 [1:25:25<5:48:37,  3.59it/s]
 80%|███████▉  | 296441/371472 [1:25:25<5:45:42,  3.62it/s]
 80%|███████▉  | 296442/371472 [1:25:26<7:08:33,  2.92it/s]
 80%|███████▉  | 296443/371472 [1:25:26<7:32:31,  2.76it/s]
 80%|███████▉  | 296444/371472 [1:25:26<7:08:42,  2.92it/s]
 80%|███████▉  | 296445/371472 [1:25:27<6:48:13,  3.06it/s]
 80%|███████▉  | 296446/371472 [1:25:27<6:25:14,  3.25it/s]
 80%|███████▉  | 296447/371472 [1:25:27<6:24:40,  3.25it/s]
 80%|███████▉  | 296448/371472 [1:25:28<6:19:40,  3.29it/s]
 80%|███████▉  | 296449/371472 [1:25:28<6:33:13,  3.18it/s]
 80%|███████▉  | 296450/371472 [1:25:28<6:26:56,  3.23it/s]
 80%|███████▉  | 296451/371472 [1:25:29<6:22:28,  3.27it/s]
 80%|███████▉  | 296452/371472 [1:25:29<6:17:55,  3.31it/s]
 80%|███████▉  | 296453/371472 [1:25:29<6:03:33,  3.44it/s]
 80%|███████▉  | 296454/371472 [1:25:29<6:20:26,  3.29it/s]
 80%|███████▉  | 296455/371472 [1:25:30<6:25:14,  3.25it/s]
 80%|███████▉  | 296456/371472 [1:25:30<6:21:06,  3.28it/s]
 80%|███████▉  | 296457/371472 [1:25:30<6:03:07,  3.44it/s]
 80%|███████▉  | 296458/371472 [1:25:31<6:17:42,  3.31it/s]
 80%|███████▉  | 296459/371472 [1:25:31<6:11:29,  3.37it/s]
 80%|███████▉  | 296460/371472 [1:25:31<5:54:12,  3.53it/s]
                                                           
{'loss': 2.5672, 'learning_rate': 2.818364972311405e-07, 'epoch': 12.77}

 80%|███████▉  | 296460/371472 [1:25:31<5:54:12,  3.53it/s]
 80%|███████▉  | 296461/371472 [1:25:31<5:47:29,  3.60it/s]
 80%|███████▉  | 296462/371472 [1:25:32<5:41:18,  3.66it/s]
 80%|███████▉  | 296463/371472 [1:25:32<5:46:16,  3.61it/s]
 80%|███████▉  | 296464/371472 [1:25:32<5:59:19,  3.48it/s]
 80%|███████▉  | 296465/371472 [1:25:33<6:01:46,  3.46it/s]
 80%|███████▉  | 296466/371472 [1:25:33<6:00:53,  3.46it/s]
 80%|███████▉  | 296467/371472 [1:25:33<6:10:39,  3.37it/s]
 80%|███████▉  | 296468/371472 [1:25:34<6:12:30,  3.36it/s]
 80%|███████▉  | 296469/371472 [1:25:34<6:08:11,  3.40it/s]
 80%|███████▉  | 296470/371472 [1:25:34<5:54:53,  3.52it/s]
 80%|███████▉  | 296471/371472 [1:25:34<5:46:56,  3.60it/s]
 80%|███████▉  | 296472/371472 [1:25:35<5:49:03,  3.58it/s]
 80%|███████▉  | 296473/371472 [1:25:35<5:48:03,  3.59it/s]
 80%|███████▉  | 296474/371472 [1:25:35<5:35:29,  3.73it/s]
 80%|███████▉  | 296475/371472 [1:25:35<5:34:49,  3.73it/s]
 80%|███████▉  | 296476/371472 [1:25:36<5:41:16,  3.66it/s]
 80%|███████▉  | 296477/371472 [1:25:36<5:29:11,  3.80it/s]
 80%|███████▉  | 296478/371472 [1:25:36<5:31:14,  3.77it/s]
 80%|███████▉  | 296479/371472 [1:25:37<5:46:58,  3.60it/s]
 80%|███████▉  | 296480/371472 [1:25:37<5:46:39,  3.61it/s]
                                                           
{'loss': 2.5856, 'learning_rate': 2.817880152556616e-07, 'epoch': 12.77}

 80%|███████▉  | 296480/371472 [1:25:37<5:46:39,  3.61it/s]
 80%|███████▉  | 296481/371472 [1:25:37<5:37:59,  3.70it/s]
 80%|███████▉  | 296482/371472 [1:25:37<5:51:40,  3.55it/s]
 80%|███████▉  | 296483/371472 [1:25:38<5:41:09,  3.66it/s]
 80%|███████▉  | 296484/371472 [1:25:38<5:37:53,  3.70it/s]
 80%|███████▉  | 296485/371472 [1:25:38<5:40:05,  3.67it/s]
 80%|███████▉  | 296486/371472 [1:25:38<5:38:01,  3.70it/s]
 80%|███████▉  | 296487/371472 [1:25:39<5:32:13,  3.76it/s]
 80%|███████▉  | 296488/371472 [1:25:39<5:32:07,  3.76it/s]
 80%|███████▉  | 296489/371472 [1:25:39<5:27:42,  3.81it/s]
 80%|███████▉  | 296490/371472 [1:25:39<5:35:34,  3.72it/s]
 80%|███████▉  | 296491/371472 [1:25:40<5:47:17,  3.60it/s]
 80%|███████▉  | 296492/371472 [1:25:40<5:52:24,  3.55it/s]
 80%|███████▉  | 296493/371472 [1:25:40<6:00:13,  3.47it/s]
 80%|███████▉  | 296494/371472 [1:25:41<5:45:06,  3.62it/s]
 80%|███████▉  | 296495/371472 [1:25:41<5:43:48,  3.63it/s]
 80%|███████▉  | 296496/371472 [1:25:41<5:50:35,  3.56it/s]
 80%|███████▉  | 296497/371472 [1:25:41<5:53:40,  3.53it/s]
 80%|███████▉  | 296498/371472 [1:25:42<6:00:52,  3.46it/s]
 80%|███████▉  | 296499/371472 [1:25:42<5:48:29,  3.59it/s]
 80%|███████▉  | 296500/371472 [1:25:42<5:47:14,  3.60it/s]
                                                           
{'loss': 2.623, 'learning_rate': 2.8173953328018265e-07, 'epoch': 12.77}

 80%|███████▉  | 296500/371472 [1:25:42<5:47:14,  3.60it/s]
 80%|███████▉  | 296501/371472 [1:25:43<5:39:08,  3.68it/s]
 80%|███████▉  | 296502/371472 [1:25:43<5:56:21,  3.51it/s]
 80%|███████▉  | 296503/371472 [1:25:43<6:02:16,  3.45it/s]
 80%|███████▉  | 296504/371472 [1:25:43<5:54:02,  3.53it/s]
 80%|███████▉  | 296505/371472 [1:25:44<5:48:37,  3.58it/s]
 80%|███████▉  | 296506/371472 [1:25:44<5:58:58,  3.48it/s]
 80%|███████▉  | 296507/371472 [1:25:44<5:48:05,  3.59it/s]
 80%|███████▉  | 296508/371472 [1:25:45<5:58:51,  3.48it/s]
 80%|███████▉  | 296509/371472 [1:25:45<5:55:52,  3.51it/s]
 80%|███████▉  | 296510/371472 [1:25:45<6:25:19,  3.24it/s]
 80%|███████▉  | 296511/371472 [1:25:45<6:10:27,  3.37it/s]
 80%|███████▉  | 296512/371472 [1:25:46<6:42:04,  3.11it/s]
 80%|███████▉  | 296513/371472 [1:25:46<6:41:13,  3.11it/s]
 80%|███████▉  | 296514/371472 [1:25:46<6:11:54,  3.36it/s]
 80%|███████▉  | 296515/371472 [1:25:47<5:54:32,  3.52it/s]
 80%|███████▉  | 296516/371472 [1:25:47<5:38:59,  3.69it/s]
 80%|███████▉  | 296517/371472 [1:25:47<5:33:17,  3.75it/s]
 80%|███████▉  | 296518/371472 [1:25:47<5:35:27,  3.72it/s]
 80%|███████▉  | 296519/371472 [1:25:48<5:40:19,  3.67it/s]
 80%|███████▉  | 296520/371472 [1:25:48<5:34:03,  3.74it/s]
                                                           
{'loss': 2.6967, 'learning_rate': 2.8169105130470383e-07, 'epoch': 12.77}

 80%|███████▉  | 296520/371472 [1:25:48<5:34:03,  3.74it/s]
 80%|███████▉  | 296521/371472 [1:25:48<5:41:45,  3.66it/s]
 80%|███████▉  | 296522/371472 [1:25:49<5:44:01,  3.63it/s]
 80%|███████▉  | 296523/371472 [1:25:49<5:37:04,  3.71it/s]
 80%|███████▉  | 296524/371472 [1:25:49<5:51:23,  3.55it/s]
 80%|███████▉  | 296525/371472 [1:25:49<5:55:08,  3.52it/s]
 80%|███████▉  | 296526/371472 [1:25:50<5:46:01,  3.61it/s]
 80%|███████▉  | 296527/371472 [1:25:50<6:13:05,  3.35it/s]
 80%|███████▉  | 296528/371472 [1:25:50<6:12:48,  3.35it/s]
 80%|███████▉  | 296529/371472 [1:25:51<6:40:41,  3.12it/s]
 80%|███████▉  | 296530/371472 [1:25:51<6:27:22,  3.22it/s]
 80%|███████▉  | 296531/371472 [1:25:51<6:30:05,  3.20it/s]
 80%|███████▉  | 296532/371472 [1:25:52<6:11:19,  3.36it/s]
 80%|███████▉  | 296533/371472 [1:25:52<6:00:57,  3.46it/s]
 80%|███████▉  | 296534/371472 [1:25:52<5:50:06,  3.57it/s]
 80%|███████▉  | 296535/371472 [1:25:52<6:15:15,  3.33it/s]
 80%|███████▉  | 296536/371472 [1:25:53<6:09:56,  3.38it/s]
 80%|███████▉  | 296537/371472 [1:25:53<5:56:17,  3.51it/s]
 80%|███████▉  | 296538/371472 [1:25:53<5:46:17,  3.61it/s]
 80%|███████▉  | 296539/371472 [1:25:53<5:37:16,  3.70it/s]
 80%|███████▉  | 296540/371472 [1:25:54<5:41:27,  3.66it/s]
                                                           
{'loss': 2.7119, 'learning_rate': 2.816425693292249e-07, 'epoch': 12.77}

 80%|███████▉  | 296540/371472 [1:25:54<5:41:27,  3.66it/s]
 80%|███████▉  | 296541/371472 [1:25:54<5:48:01,  3.59it/s]
 80%|███████▉  | 296542/371472 [1:25:54<6:00:34,  3.46it/s]
 80%|███████▉  | 296543/371472 [1:25:55<6:15:44,  3.32it/s]
 80%|███████▉  | 296544/371472 [1:25:55<6:06:37,  3.41it/s]
 80%|███████▉  | 296545/371472 [1:25:55<5:47:39,  3.59it/s]
 80%|███████▉  | 296546/371472 [1:25:56<6:02:19,  3.45it/s]
 80%|███████▉  | 296547/371472 [1:25:56<5:54:03,  3.53it/s]
 80%|███████▉  | 296548/371472 [1:25:56<5:42:44,  3.64it/s]
 80%|███████▉  | 296549/371472 [1:25:56<5:38:59,  3.68it/s]
 80%|███████▉  | 296550/371472 [1:25:57<5:43:33,  3.63it/s]
 80%|███████▉  | 296551/371472 [1:25:57<5:47:45,  3.59it/s]
 80%|███████▉  | 296552/371472 [1:25:57<5:50:07,  3.57it/s]
 80%|███████▉  | 296553/371472 [1:25:57<5:49:24,  3.57it/s]
 80%|███████▉  | 296554/371472 [1:25:58<5:45:57,  3.61it/s]
 80%|███████▉  | 296555/371472 [1:25:58<5:44:52,  3.62it/s]
 80%|███████▉  | 296556/371472 [1:25:58<5:48:10,  3.59it/s]
 80%|███████▉  | 296557/371472 [1:25:59<5:41:56,  3.65it/s]
 80%|███████▉  | 296558/371472 [1:25:59<5:49:20,  3.57it/s]
 80%|███████▉  | 296559/371472 [1:25:59<5:45:30,  3.61it/s]
 80%|███████▉  | 296560/371472 [1:25:59<5:39:24,  3.68it/s]
                                                           
{'loss': 2.5336, 'learning_rate': 2.81594087353746e-07, 'epoch': 12.77}

 80%|███████▉  | 296560/371472 [1:25:59<5:39:24,  3.68it/s]
 80%|███████▉  | 296561/371472 [1:26:00<5:38:35,  3.69it/s]
 80%|███████▉  | 296562/371472 [1:26:00<5:44:34,  3.62it/s]
 80%|███████▉  | 296563/371472 [1:26:00<5:40:37,  3.67it/s]
 80%|███████▉  | 296564/371472 [1:26:00<5:44:08,  3.63it/s]
 80%|███████▉  | 296565/371472 [1:26:01<5:44:13,  3.63it/s]
 80%|███████▉  | 296566/371472 [1:26:01<5:32:54,  3.75it/s]
 80%|███████▉  | 296567/371472 [1:26:01<5:35:36,  3.72it/s]
 80%|███████▉  | 296568/371472 [1:26:02<5:39:45,  3.67it/s]
 80%|███████▉  | 296569/371472 [1:26:02<5:48:37,  3.58it/s]
 80%|███████▉  | 296570/371472 [1:26:02<6:59:20,  2.98it/s]
 80%|███████▉  | 296571/371472 [1:26:03<6:44:18,  3.09it/s]
 80%|███████▉  | 296572/371472 [1:26:03<6:34:54,  3.16it/s]
 80%|███████▉  | 296573/371472 [1:26:03<6:08:28,  3.39it/s]
 80%|███████▉  | 296574/371472 [1:26:03<6:03:01,  3.44it/s]
 80%|███████▉  | 296575/371472 [1:26:04<5:59:52,  3.47it/s]
 80%|███████▉  | 296576/371472 [1:26:04<5:51:51,  3.55it/s]
 80%|███████▉  | 296577/371472 [1:26:04<6:13:22,  3.34it/s]
 80%|███████▉  | 296578/371472 [1:26:05<6:29:50,  3.20it/s]
 80%|███████▉  | 296579/371472 [1:26:05<6:40:10,  3.12it/s]
 80%|███████▉  | 296580/371472 [1:26:05<6:14:18,  3.33it/s]
                                                           
{'loss': 2.6224, 'learning_rate': 2.815456053782671e-07, 'epoch': 12.77}

 80%|███████▉  | 296580/371472 [1:26:05<6:14:18,  3.33it/s]
 80%|███████▉  | 296581/371472 [1:26:06<6:08:58,  3.38it/s]
 80%|███████▉  | 296582/371472 [1:26:06<5:57:07,  3.50it/s]
 80%|███████▉  | 296583/371472 [1:26:06<5:55:54,  3.51it/s]
 80%|███████▉  | 296584/371472 [1:26:06<6:13:21,  3.34it/s]
 80%|███████▉  | 296585/371472 [1:26:07<6:07:47,  3.39it/s]
 80%|███████▉  | 296586/371472 [1:26:07<6:17:01,  3.31it/s]
 80%|███████▉  | 296587/371472 [1:26:07<6:11:56,  3.36it/s]
 80%|███████▉  | 296588/371472 [1:26:08<5:59:24,  3.47it/s]
 80%|███████▉  | 296589/371472 [1:26:08<5:47:34,  3.59it/s]
 80%|███████▉  | 296590/371472 [1:26:08<5:50:42,  3.56it/s]
 80%|███████▉  | 296591/371472 [1:26:08<5:59:49,  3.47it/s]
 80%|███████▉  | 296592/371472 [1:26:09<5:53:55,  3.53it/s]
 80%|███████▉  | 296593/371472 [1:26:09<5:49:57,  3.57it/s]
 80%|███████▉  | 296594/371472 [1:26:09<5:44:26,  3.62it/s]
 80%|███████▉  | 296595/371472 [1:26:10<6:09:03,  3.38it/s]
 80%|███████▉  | 296596/371472 [1:26:10<5:52:34,  3.54it/s]
 80%|███████▉  | 296597/371472 [1:26:10<5:39:30,  3.68it/s]
 80%|███████▉  | 296598/371472 [1:26:10<5:37:32,  3.70it/s]
 80%|███████▉  | 296599/371472 [1:26:11<5:44:15,  3.62it/s]
 80%|███████▉  | 296600/371472 [1:26:11<5:47:28,  3.59it/s]
                                                           
{'loss': 2.7981, 'learning_rate': 2.814971234027882e-07, 'epoch': 12.78}

 80%|███████▉  | 296600/371472 [1:26:11<5:47:28,  3.59it/s]
 80%|███████▉  | 296601/371472 [1:26:11<5:36:08,  3.71it/s]
 80%|███████▉  | 296602/371472 [1:26:11<5:30:24,  3.78it/s]
 80%|███████▉  | 296603/371472 [1:26:12<5:36:13,  3.71it/s]
 80%|███████▉  | 296604/371472 [1:26:12<5:44:15,  3.62it/s]
 80%|███████▉  | 296605/371472 [1:26:12<5:52:33,  3.54it/s]
 80%|███████▉  | 296606/371472 [1:26:13<5:44:28,  3.62it/s]
 80%|███████▉  | 296607/371472 [1:26:13<5:44:55,  3.62it/s]
 80%|███████▉  | 296608/371472 [1:26:13<5:48:36,  3.58it/s]
 80%|███████▉  | 296609/371472 [1:26:13<5:56:51,  3.50it/s]
 80%|███████▉  | 296610/371472 [1:26:14<5:41:03,  3.66it/s]
 80%|███████▉  | 296611/371472 [1:26:14<5:33:53,  3.74it/s]
 80%|███████▉  | 296612/371472 [1:26:14<5:33:06,  3.75it/s]
 80%|███████▉  | 296613/371472 [1:26:14<5:33:18,  3.74it/s]
 80%|███████▉  | 296614/371472 [1:26:15<5:39:24,  3.68it/s]
 80%|███████▉  | 296615/371472 [1:26:15<6:08:05,  3.39it/s]
 80%|███████▉  | 296616/371472 [1:26:15<6:07:41,  3.39it/s]
 80%|███████▉  | 296617/371472 [1:26:16<6:02:43,  3.44it/s]
 80%|███████▉  | 296618/371472 [1:26:16<6:04:22,  3.42it/s]
 80%|███████▉  | 296619/371472 [1:26:16<6:48:01,  3.06it/s]
 80%|███████▉  | 296620/371472 [1:26:17<6:49:05,  3.05it/s]
                                                           
{'loss': 2.9213, 'learning_rate': 2.814486414273093e-07, 'epoch': 12.78}

 80%|███████▉  | 296620/371472 [1:26:17<6:49:05,  3.05it/s]
 80%|███████▉  | 296621/371472 [1:26:17<6:23:58,  3.25it/s]
 80%|███████▉  | 296622/371472 [1:26:17<6:23:54,  3.25it/s]
 80%|███████▉  | 296623/371472 [1:26:18<6:16:59,  3.31it/s]
 80%|███████▉  | 296624/371472 [1:26:18<6:31:28,  3.19it/s]
 80%|███████▉  | 296625/371472 [1:26:18<6:10:52,  3.36it/s]
 80%|███████▉  | 296626/371472 [1:26:18<6:14:20,  3.33it/s]
 80%|███████▉  | 296627/371472 [1:26:19<6:07:39,  3.39it/s]
 80%|███████▉  | 296628/371472 [1:26:19<5:57:50,  3.49it/s]
 80%|███████▉  | 296629/371472 [1:26:19<5:52:40,  3.54it/s]
 80%|███████▉  | 296630/371472 [1:26:20<5:36:56,  3.70it/s]
 80%|███████▉  | 296631/371472 [1:26:20<5:40:47,  3.66it/s]
 80%|███████▉  | 296632/371472 [1:26:20<6:13:39,  3.34it/s]
 80%|███████▉  | 296633/371472 [1:26:20<6:09:47,  3.37it/s]
 80%|███████▉  | 296634/371472 [1:26:21<6:13:04,  3.34it/s]
 80%|███████▉  | 296635/371472 [1:26:21<6:07:24,  3.39it/s]
 80%|███████▉  | 296636/371472 [1:26:21<5:56:04,  3.50it/s]
 80%|███████▉  | 296637/371472 [1:26:22<5:55:09,  3.51it/s]
 80%|███████▉  | 296638/371472 [1:26:22<5:50:25,  3.56it/s]
 80%|███████▉  | 296639/371472 [1:26:22<5:45:07,  3.61it/s]
 80%|███████▉  | 296640/371472 [1:26:22<5:45:25,  3.61it/s]
                                                           
{'loss': 2.552, 'learning_rate': 2.8140015945183047e-07, 'epoch': 12.78}

 80%|███████▉  | 296640/371472 [1:26:22<5:45:25,  3.61it/s]
 80%|███████▉  | 296641/371472 [1:26:23<5:52:21,  3.54it/s]
 80%|███████▉  | 296642/371472 [1:26:23<5:51:31,  3.55it/s]
 80%|███████▉  | 296643/371472 [1:26:23<5:48:25,  3.58it/s]
 80%|███████▉  | 296644/371472 [1:26:24<5:53:54,  3.52it/s]
 80%|███████▉  | 296645/371472 [1:26:24<7:11:38,  2.89it/s]
 80%|███████▉  | 296646/371472 [1:26:24<6:36:43,  3.14it/s]
 80%|███████▉  | 296647/371472 [1:26:25<6:18:29,  3.29it/s]
 80%|███████▉  | 296648/371472 [1:26:25<6:24:46,  3.24it/s]
 80%|███████▉  | 296649/371472 [1:26:25<6:14:09,  3.33it/s]
 80%|███████▉  | 296650/371472 [1:26:25<5:59:27,  3.47it/s]
 80%|███████▉  | 296651/371472 [1:26:26<5:56:55,  3.49it/s]
 80%|███████▉  | 296652/371472 [1:26:26<6:13:53,  3.34it/s]
 80%|███████▉  | 296653/371472 [1:26:26<6:01:52,  3.45it/s]
 80%|███████▉  | 296654/371472 [1:26:27<5:55:49,  3.50it/s]
 80%|███████▉  | 296655/371472 [1:26:27<6:12:54,  3.34it/s]
 80%|███████▉  | 296656/371472 [1:26:27<5:58:09,  3.48it/s]
 80%|███████▉  | 296657/371472 [1:26:27<6:06:59,  3.40it/s]
 80%|███████▉  | 296658/371472 [1:26:28<6:35:56,  3.15it/s]
 80%|███████▉  | 296659/371472 [1:26:28<6:18:23,  3.30it/s]
 80%|███████▉  | 296660/371472 [1:26:28<6:12:42,  3.35it/s]
                                                           
{'loss': 2.5508, 'learning_rate': 2.8135167747635154e-07, 'epoch': 12.78}

 80%|███████▉  | 296660/371472 [1:26:28<6:12:42,  3.35it/s]
 80%|███████▉  | 296661/371472 [1:26:29<6:01:16,  3.45it/s]
 80%|███████▉  | 296662/371472 [1:26:29<5:48:32,  3.58it/s]
 80%|███████▉  | 296663/371472 [1:26:29<5:44:51,  3.62it/s]
 80%|███████▉  | 296664/371472 [1:26:30<6:22:49,  3.26it/s]
 80%|███████▉  | 296665/371472 [1:26:30<6:08:20,  3.38it/s]
 80%|███████▉  | 296666/371472 [1:26:30<6:02:54,  3.44it/s]
 80%|███████▉  | 296667/371472 [1:26:30<5:54:42,  3.51it/s]
 80%|███████▉  | 296668/371472 [1:26:31<5:49:42,  3.57it/s]
 80%|███████▉  | 296669/371472 [1:26:31<5:44:20,  3.62it/s]
 80%|███████▉  | 296670/371472 [1:26:31<6:03:19,  3.43it/s]
 80%|███████▉  | 296671/371472 [1:26:32<6:09:55,  3.37it/s]
 80%|███████▉  | 296672/371472 [1:26:32<6:36:25,  3.14it/s]
 80%|███████▉  | 296673/371472 [1:26:32<6:12:55,  3.34it/s]
 80%|███████▉  | 296674/371472 [1:26:33<6:50:53,  3.03it/s]
 80%|███████▉  | 296675/371472 [1:26:33<6:30:23,  3.19it/s]
 80%|███████▉  | 296676/371472 [1:26:33<6:09:46,  3.37it/s]
 80%|███████▉  | 296677/371472 [1:26:33<6:07:42,  3.39it/s]
 80%|███████▉  | 296678/371472 [1:26:34<6:23:15,  3.25it/s]
 80%|███████▉  | 296679/371472 [1:26:34<6:27:23,  3.22it/s]
 80%|███████▉  | 296680/371472 [1:26:34<6:06:26,  3.40it/s]
                                                           
{'loss': 2.798, 'learning_rate': 2.813031955008727e-07, 'epoch': 12.78}

 80%|███████▉  | 296680/371472 [1:26:34<6:06:26,  3.40it/s]
 80%|███████▉  | 296681/371472 [1:26:35<5:52:32,  3.54it/s]
 80%|███████▉  | 296682/371472 [1:26:35<5:52:44,  3.53it/s]
 80%|███████▉  | 296683/371472 [1:26:35<6:37:59,  3.13it/s]
 80%|███████▉  | 296684/371472 [1:26:36<6:35:32,  3.15it/s]
 80%|███████▉  | 296685/371472 [1:26:36<6:23:58,  3.25it/s]
 80%|███████▉  | 296686/371472 [1:26:36<6:36:49,  3.14it/s]
 80%|███████▉  | 296687/371472 [1:26:37<6:36:15,  3.15it/s]
 80%|███████▉  | 296688/371472 [1:26:37<6:40:25,  3.11it/s]
 80%|███████▉  | 296689/371472 [1:26:37<6:31:02,  3.19it/s]
 80%|███████▉  | 296690/371472 [1:26:37<6:11:31,  3.35it/s]
 80%|███████▉  | 296691/371472 [1:26:38<5:56:08,  3.50it/s]
 80%|███████▉  | 296692/371472 [1:26:38<5:44:51,  3.61it/s]
 80%|███████▉  | 296693/371472 [1:26:38<5:39:46,  3.67it/s]
 80%|███████▉  | 296694/371472 [1:26:39<5:55:43,  3.50it/s]
 80%|███████▉  | 296695/371472 [1:26:39<5:49:24,  3.57it/s]
 80%|███████▉  | 296696/371472 [1:26:39<5:40:55,  3.66it/s]
 80%|███████▉  | 296697/371472 [1:26:39<5:52:37,  3.53it/s]
 80%|███████▉  | 296698/371472 [1:26:40<6:02:11,  3.44it/s]
 80%|███████▉  | 296699/371472 [1:26:40<5:56:59,  3.49it/s]
 80%|███████▉  | 296700/371472 [1:26:40<5:57:19,  3.49it/s]
                                                           
{'loss': 2.6025, 'learning_rate': 2.8125471352539374e-07, 'epoch': 12.78}

 80%|███████▉  | 296700/371472 [1:26:40<5:57:19,  3.49it/s]
 80%|███████▉  | 296701/371472 [1:26:41<6:00:27,  3.46it/s]
 80%|███████▉  | 296702/371472 [1:26:41<6:12:57,  3.34it/s]
 80%|███████▉  | 296703/371472 [1:26:41<5:57:54,  3.48it/s]
 80%|███████▉  | 296704/371472 [1:26:41<5:54:13,  3.52it/s]
 80%|███████▉  | 296705/371472 [1:26:42<5:52:07,  3.54it/s]
 80%|███████▉  | 296706/371472 [1:26:42<6:05:23,  3.41it/s]
 80%|███████▉  | 296707/371472 [1:26:42<6:03:48,  3.43it/s]
 80%|███████▉  | 296708/371472 [1:26:43<6:16:19,  3.31it/s]
 80%|███████▉  | 296709/371472 [1:26:43<6:30:33,  3.19it/s]
 80%|███████▉  | 296710/371472 [1:26:43<6:36:24,  3.14it/s]
 80%|███████▉  | 296711/371472 [1:26:44<6:52:54,  3.02it/s]
 80%|███████▉  | 296712/371472 [1:26:44<6:31:41,  3.18it/s]
 80%|███████▉  | 296713/371472 [1:26:44<6:13:05,  3.34it/s]
 80%|███████▉  | 296714/371472 [1:26:44<6:18:47,  3.29it/s]
 80%|███████▉  | 296715/371472 [1:26:45<6:04:07,  3.42it/s]
 80%|███████▉  | 296716/371472 [1:26:45<5:52:29,  3.53it/s]
 80%|███████▉  | 296717/371472 [1:26:45<5:52:08,  3.54it/s]
 80%|███████▉  | 296718/371472 [1:26:46<5:42:10,  3.64it/s]
 80%|███████▉  | 296719/371472 [1:26:46<5:44:16,  3.62it/s]
 80%|███████▉  | 296720/371472 [1:26:46<5:44:12,  3.62it/s]
                                                           
{'loss': 2.538, 'learning_rate': 2.8120623154991486e-07, 'epoch': 12.78}

 80%|███████▉  | 296720/371472 [1:26:46<5:44:12,  3.62it/s]
 80%|███████▉  | 296721/371472 [1:26:46<5:36:44,  3.70it/s]
 80%|███████▉  | 296722/371472 [1:26:47<5:37:06,  3.70it/s]
 80%|███████▉  | 296723/371472 [1:26:47<5:49:47,  3.56it/s]
 80%|███████▉  | 296724/371472 [1:26:47<5:55:42,  3.50it/s]
 80%|███████▉  | 296725/371472 [1:26:48<5:52:52,  3.53it/s]
 80%|███████▉  | 296726/371472 [1:26:48<5:44:51,  3.61it/s]
 80%|███████▉  | 296727/371472 [1:26:48<5:35:43,  3.71it/s]
 80%|███████▉  | 296728/371472 [1:26:48<5:48:40,  3.57it/s]
 80%|███████▉  | 296729/371472 [1:26:49<5:47:35,  3.58it/s]
 80%|███████▉  | 296730/371472 [1:26:49<5:52:18,  3.54it/s]
 80%|███████▉  | 296731/371472 [1:26:49<5:49:05,  3.57it/s]
 80%|███████▉  | 296732/371472 [1:26:49<5:40:17,  3.66it/s]
 80%|███████▉  | 296733/371472 [1:26:50<5:40:14,  3.66it/s]
 80%|███████▉  | 296734/371472 [1:26:50<6:03:12,  3.43it/s]
 80%|███████▉  | 296735/371472 [1:26:50<5:50:25,  3.55it/s]
 80%|███████▉  | 296736/371472 [1:26:51<5:57:00,  3.49it/s]
 80%|███████▉  | 296737/371472 [1:26:51<5:59:34,  3.46it/s]
 80%|███████▉  | 296738/371472 [1:26:51<5:53:17,  3.53it/s]
 80%|███████▉  | 296739/371472 [1:26:51<5:43:41,  3.62it/s]
 80%|███████▉  | 296740/371472 [1:26:52<5:58:10,  3.48it/s]
                                                           
{'loss': 2.5814, 'learning_rate': 2.8115774957443593e-07, 'epoch': 12.78}

 80%|███████▉  | 296740/371472 [1:26:52<5:58:10,  3.48it/s]
 80%|███████▉  | 296741/371472 [1:26:52<6:01:23,  3.45it/s]
 80%|███████▉  | 296742/371472 [1:26:52<5:58:15,  3.48it/s]
 80%|███████▉  | 296743/371472 [1:26:53<5:48:29,  3.57it/s]
 80%|███████▉  | 296744/371472 [1:26:53<5:48:29,  3.57it/s]
 80%|███████▉  | 296745/371472 [1:26:53<5:48:00,  3.58it/s]
 80%|███████▉  | 296746/371472 [1:26:53<5:40:04,  3.66it/s]
 80%|███████▉  | 296747/371472 [1:26:54<5:37:20,  3.69it/s]
 80%|███████▉  | 296748/371472 [1:26:54<5:42:07,  3.64it/s]
 80%|███████▉  | 296749/371472 [1:26:54<5:41:14,  3.65it/s]
 80%|███████▉  | 296750/371472 [1:26:54<5:39:12,  3.67it/s]
 80%|███████▉  | 296751/371472 [1:26:55<5:40:24,  3.66it/s]
 80%|███████▉  | 296752/371472 [1:26:55<5:28:58,  3.79it/s]
 80%|███████▉  | 296753/371472 [1:26:55<5:22:34,  3.86it/s]
 80%|███████▉  | 296754/371472 [1:26:55<5:19:25,  3.90it/s]
 80%|███████▉  | 296755/371472 [1:26:56<5:22:52,  3.86it/s]
 80%|███████▉  | 296756/371472 [1:26:56<5:25:57,  3.82it/s]
 80%|███████▉  | 296757/371472 [1:26:56<5:27:50,  3.80it/s]
 80%|███████▉  | 296758/371472 [1:26:57<5:33:39,  3.73it/s]
 80%|███████▉  | 296759/371472 [1:26:57<5:23:17,  3.85it/s]
 80%|███████▉  | 296760/371472 [1:26:57<5:32:57,  3.74it/s]
                                                           
{'loss': 2.7343, 'learning_rate': 2.811092675989571e-07, 'epoch': 12.78}

 80%|███████▉  | 296760/371472 [1:26:57<5:32:57,  3.74it/s]
 80%|███████▉  | 296761/371472 [1:26:57<5:30:06,  3.77it/s]
 80%|███████▉  | 296762/371472 [1:26:58<5:29:27,  3.78it/s]
 80%|███████▉  | 296763/371472 [1:26:58<5:32:46,  3.74it/s]
 80%|███████▉  | 296764/371472 [1:26:58<5:42:12,  3.64it/s]
 80%|███████▉  | 296765/371472 [1:26:58<5:31:16,  3.76it/s]
 80%|███████▉  | 296766/371472 [1:26:59<5:35:27,  3.71it/s]
 80%|███████▉  | 296767/371472 [1:26:59<5:28:40,  3.79it/s]
 80%|███████▉  | 296768/371472 [1:26:59<5:27:14,  3.80it/s]
 80%|███████▉  | 296769/371472 [1:27:00<5:38:32,  3.68it/s]
 80%|███████▉  | 296770/371472 [1:27:00<6:24:22,  3.24it/s]
 80%|███████▉  | 296771/371472 [1:27:00<6:07:41,  3.39it/s]
 80%|███████▉  | 296772/371472 [1:27:00<6:07:28,  3.39it/s]
 80%|███████▉  | 296773/371472 [1:27:01<6:11:37,  3.35it/s]
 80%|███████▉  | 296774/371472 [1:27:01<6:28:22,  3.21it/s]
 80%|███████▉  | 296775/371472 [1:27:01<6:42:02,  3.10it/s]
 80%|███████▉  | 296776/371472 [1:27:02<6:48:38,  3.05it/s]
 80%|███████▉  | 296777/371472 [1:27:02<6:30:54,  3.18it/s]
 80%|███████▉  | 296778/371472 [1:27:02<6:32:15,  3.17it/s]
 80%|███████▉  | 296779/371472 [1:27:03<6:06:47,  3.39it/s]
 80%|███████▉  | 296780/371472 [1:27:03<6:12:06,  3.35it/s]
                                                           
{'loss': 2.6081, 'learning_rate': 2.810607856234782e-07, 'epoch': 12.78}

 80%|███████▉  | 296780/371472 [1:27:03<6:12:06,  3.35it/s]
 80%|███████▉  | 296781/371472 [1:27:03<6:04:29,  3.42it/s]
 80%|███████▉  | 296782/371472 [1:27:04<6:22:15,  3.26it/s]
 80%|███████▉  | 296783/371472 [1:27:04<6:02:59,  3.43it/s]
 80%|███████▉  | 296784/371472 [1:27:04<5:56:43,  3.49it/s]
 80%|███████▉  | 296785/371472 [1:27:04<5:42:44,  3.63it/s]
 80%|███████▉  | 296786/371472 [1:27:05<5:36:43,  3.70it/s]
 80%|███████▉  | 296787/371472 [1:27:05<5:40:17,  3.66it/s]
 80%|███████▉  | 296788/371472 [1:27:05<5:33:02,  3.74it/s]
 80%|███████▉  | 296789/371472 [1:27:05<5:53:49,  3.52it/s]
 80%|███████▉  | 296790/371472 [1:27:06<5:40:50,  3.65it/s]
 80%|███████▉  | 296791/371472 [1:27:06<5:36:37,  3.70it/s]
 80%|███████▉  | 296792/371472 [1:27:06<5:52:19,  3.53it/s]
 80%|███████▉  | 296793/371472 [1:27:07<5:40:44,  3.65it/s]
 80%|███████▉  | 296794/371472 [1:27:07<5:55:14,  3.50it/s]
 80%|███████▉  | 296795/371472 [1:27:07<6:03:08,  3.43it/s]
 80%|███████▉  | 296796/371472 [1:27:07<6:09:14,  3.37it/s]
 80%|███████▉  | 296797/371472 [1:27:08<6:20:12,  3.27it/s]
 80%|███████▉  | 296798/371472 [1:27:08<6:09:44,  3.37it/s]
 80%|███████▉  | 296799/371472 [1:27:08<5:59:02,  3.47it/s]
 80%|███████▉  | 296800/371472 [1:27:09<5:48:10,  3.57it/s]
                                                           
{'loss': 2.6453, 'learning_rate': 2.8101230364799936e-07, 'epoch': 12.78}

 80%|███████▉  | 296800/371472 [1:27:09<5:48:10,  3.57it/s]
 80%|███████▉  | 296801/371472 [1:27:09<6:03:58,  3.42it/s]
 80%|███████▉  | 296802/371472 [1:27:09<6:00:24,  3.45it/s]
 80%|███████▉  | 296803/371472 [1:27:10<6:03:44,  3.42it/s]
 80%|███████▉  | 296804/371472 [1:27:10<5:53:47,  3.52it/s]
 80%|███████▉  | 296805/371472 [1:27:10<6:01:29,  3.44it/s]
 80%|███████▉  | 296806/371472 [1:27:10<6:04:54,  3.41it/s]
 80%|███████▉  | 296807/371472 [1:27:11<7:41:44,  2.70it/s]
 80%|███████▉  | 296808/371472 [1:27:11<7:02:42,  2.94it/s]
 80%|███████▉  | 296809/371472 [1:27:11<6:34:08,  3.16it/s]
 80%|███████▉  | 296810/371472 [1:27:12<6:19:21,  3.28it/s]
 80%|███████▉  | 296811/371472 [1:27:12<6:17:37,  3.30it/s]
 80%|███████▉  | 296812/371472 [1:27:12<6:22:39,  3.25it/s]
 80%|███████▉  | 296813/371472 [1:27:13<6:07:37,  3.38it/s]
 80%|███████▉  | 296814/371472 [1:27:13<6:13:33,  3.33it/s]
 80%|███████▉  | 296815/371472 [1:27:13<6:02:28,  3.43it/s]
 80%|███████▉  | 296816/371472 [1:27:13<5:59:11,  3.46it/s]
 80%|███████▉  | 296817/371472 [1:27:14<5:56:17,  3.49it/s]
 80%|███████▉  | 296818/371472 [1:27:14<5:46:52,  3.59it/s]
 80%|███████▉  | 296819/371472 [1:27:14<5:51:54,  3.54it/s]
 80%|███████▉  | 296820/371472 [1:27:15<5:50:07,  3.55it/s]
                                                           
{'loss': 2.6074, 'learning_rate': 2.809638216725204e-07, 'epoch': 12.78}

 80%|███████▉  | 296820/371472 [1:27:15<5:50:07,  3.55it/s]
 80%|███████▉  | 296821/371472 [1:27:15<6:06:11,  3.40it/s]
 80%|███████▉  | 296822/371472 [1:27:15<6:21:20,  3.26it/s]
 80%|███████▉  | 296823/371472 [1:27:16<6:13:04,  3.33it/s]
 80%|███████▉  | 296824/371472 [1:27:16<6:02:19,  3.43it/s]
 80%|███████▉  | 296825/371472 [1:27:16<5:52:24,  3.53it/s]
 80%|███████▉  | 296826/371472 [1:27:16<5:45:54,  3.60it/s]
 80%|███████▉  | 296827/371472 [1:27:17<5:51:17,  3.54it/s]
 80%|███████▉  | 296828/371472 [1:27:17<5:43:54,  3.62it/s]
 80%|███████▉  | 296829/371472 [1:27:17<5:36:29,  3.70it/s]
 80%|███████▉  | 296830/371472 [1:27:17<5:41:02,  3.65it/s]
 80%|███████▉  | 296831/371472 [1:27:18<5:51:58,  3.53it/s]
 80%|███████▉  | 296832/371472 [1:27:18<6:01:50,  3.44it/s]
 80%|███████▉  | 296833/371472 [1:27:18<6:01:51,  3.44it/s]
 80%|███████▉  | 296834/371472 [1:27:19<5:57:08,  3.48it/s]
 80%|███████▉  | 296835/371472 [1:27:19<5:45:50,  3.60it/s]
 80%|███████▉  | 296836/371472 [1:27:19<6:03:04,  3.43it/s]
 80%|███████▉  | 296837/371472 [1:27:20<6:07:39,  3.38it/s]
 80%|███████▉  | 296838/371472 [1:27:20<5:55:24,  3.50it/s]
 80%|███████▉  | 296839/371472 [1:27:20<5:53:34,  3.52it/s]
 80%|███████▉  | 296840/371472 [1:27:20<6:02:01,  3.44it/s]
                                                           
{'loss': 2.5665, 'learning_rate': 2.8091533969704155e-07, 'epoch': 12.79}

 80%|███████▉  | 296840/371472 [1:27:20<6:02:01,  3.44it/s]
 80%|███████▉  | 296841/371472 [1:27:21<5:55:15,  3.50it/s]
 80%|███████▉  | 296842/371472 [1:27:21<5:45:26,  3.60it/s]
 80%|███████▉  | 296843/371472 [1:27:21<5:56:16,  3.49it/s]
 80%|███████▉  | 296844/371472 [1:27:21<5:54:38,  3.51it/s]
 80%|███████▉  | 296845/371472 [1:27:22<5:49:21,  3.56it/s]
 80%|███████▉  | 296846/371472 [1:27:22<5:40:22,  3.65it/s]
 80%|███████▉  | 296847/371472 [1:27:22<5:39:10,  3.67it/s]
 80%|███████▉  | 296848/371472 [1:27:23<5:51:32,  3.54it/s]
 80%|███████▉  | 296849/371472 [1:27:23<6:01:54,  3.44it/s]
 80%|███████▉  | 296850/371472 [1:27:23<5:50:29,  3.55it/s]
 80%|███████▉  | 296851/371472 [1:27:23<6:01:51,  3.44it/s]
 80%|███████▉  | 296852/371472 [1:27:24<5:51:53,  3.53it/s]
 80%|███████▉  | 296853/371472 [1:27:24<5:48:09,  3.57it/s]
 80%|███████▉  | 296854/371472 [1:27:24<5:35:12,  3.71it/s]
 80%|███████▉  | 296855/371472 [1:27:24<5:28:33,  3.79it/s]
 80%|███████▉  | 296856/371472 [1:27:25<5:31:34,  3.75it/s]
 80%|███████▉  | 296857/371472 [1:27:25<6:09:21,  3.37it/s]
 80%|███████▉  | 296858/371472 [1:27:25<6:08:00,  3.38it/s]
 80%|███████▉  | 296859/371472 [1:27:26<5:58:25,  3.47it/s]
 80%|███████▉  | 296860/371472 [1:27:26<5:58:18,  3.47it/s]
                                                           
{'loss': 2.6258, 'learning_rate': 2.808668577215626e-07, 'epoch': 12.79}

 80%|███████▉  | 296860/371472 [1:27:26<5:58:18,  3.47it/s]
 80%|███████▉  | 296861/371472 [1:27:26<6:22:58,  3.25it/s]
 80%|███████▉  | 296862/371472 [1:27:27<6:10:49,  3.35it/s]
 80%|███████▉  | 296863/371472 [1:27:27<6:06:09,  3.40it/s]
 80%|███████▉  | 296864/371472 [1:27:27<6:02:46,  3.43it/s]
 80%|███████▉  | 296865/371472 [1:27:27<5:47:06,  3.58it/s]
 80%|███████▉  | 296866/371472 [1:27:28<5:46:39,  3.59it/s]
 80%|███████▉  | 296867/371472 [1:27:28<5:35:47,  3.70it/s]
 80%|███████▉  | 296868/371472 [1:27:28<5:30:59,  3.76it/s]
 80%|███████▉  | 296869/371472 [1:27:29<5:49:24,  3.56it/s]
 80%|███████▉  | 296870/371472 [1:27:29<5:57:42,  3.48it/s]
 80%|███████▉  | 296871/371472 [1:27:29<5:50:55,  3.54it/s]
 80%|███████▉  | 296872/371472 [1:27:29<5:43:29,  3.62it/s]
 80%|███████▉  | 296873/371472 [1:27:30<5:44:20,  3.61it/s]
 80%|███████▉  | 296874/371472 [1:27:30<6:00:45,  3.45it/s]
 80%|███████▉  | 296875/371472 [1:27:30<5:57:26,  3.48it/s]
 80%|███████▉  | 296876/371472 [1:27:31<6:12:26,  3.34it/s]
 80%|███████▉  | 296877/371472 [1:27:31<6:22:55,  3.25it/s]
 80%|███████▉  | 296878/371472 [1:27:31<6:18:05,  3.29it/s]
 80%|███████▉  | 296879/371472 [1:27:32<6:34:04,  3.15it/s]
 80%|███████▉  | 296880/371472 [1:27:32<6:34:10,  3.15it/s]
                                                           
{'loss': 2.6744, 'learning_rate': 2.8081837574608375e-07, 'epoch': 12.79}

 80%|███████▉  | 296880/371472 [1:27:32<6:34:10,  3.15it/s]
 80%|███████▉  | 296881/371472 [1:27:32<6:24:53,  3.23it/s]
 80%|███████▉  | 296882/371472 [1:27:32<6:00:33,  3.45it/s]
 80%|███████▉  | 296883/371472 [1:27:33<6:03:17,  3.42it/s]
 80%|███████▉  | 296884/371472 [1:27:33<6:08:37,  3.37it/s]
 80%|███████▉  | 296885/371472 [1:27:33<6:10:13,  3.36it/s]
 80%|███████▉  | 296886/371472 [1:27:34<6:02:33,  3.43it/s]
 80%|███████▉  | 296887/371472 [1:27:34<5:48:26,  3.57it/s]
 80%|███████▉  | 296888/371472 [1:27:34<5:43:44,  3.62it/s]
 80%|███████▉  | 296889/371472 [1:27:34<5:38:58,  3.67it/s]
 80%|███████▉  | 296890/371472 [1:27:35<5:32:20,  3.74it/s]
 80%|███████▉  | 296891/371472 [1:27:35<5:52:21,  3.53it/s]
 80%|███████▉  | 296892/371472 [1:27:35<5:45:36,  3.60it/s]
 80%|███████▉  | 296893/371472 [1:27:36<6:04:43,  3.41it/s]
 80%|███████▉  | 296894/371472 [1:27:36<6:00:47,  3.45it/s]
 80%|███████▉  | 296895/371472 [1:27:36<5:58:33,  3.47it/s]
 80%|███████▉  | 296896/371472 [1:27:36<5:58:21,  3.47it/s]
 80%|███████▉  | 296897/371472 [1:27:37<6:09:17,  3.37it/s]
 80%|███████▉  | 296898/371472 [1:27:37<5:54:46,  3.50it/s]
 80%|███████▉  | 296899/371472 [1:27:37<5:55:44,  3.49it/s]
 80%|███████▉  | 296900/371472 [1:27:38<6:09:47,  3.36it/s]
                                                           
{'loss': 2.5914, 'learning_rate': 2.807698937706048e-07, 'epoch': 12.79}

 80%|███████▉  | 296900/371472 [1:27:38<6:09:47,  3.36it/s]
 80%|███████▉  | 296901/371472 [1:27:38<6:03:16,  3.42it/s]
 80%|███████▉  | 296902/371472 [1:27:38<6:13:12,  3.33it/s]
 80%|███████▉  | 296903/371472 [1:27:39<6:20:31,  3.27it/s]
 80%|███████▉  | 296904/371472 [1:27:39<5:58:21,  3.47it/s]
 80%|███████▉  | 296905/371472 [1:27:39<6:04:09,  3.41it/s]
 80%|███████▉  | 296906/371472 [1:27:39<5:53:55,  3.51it/s]
 80%|███████▉  | 296907/371472 [1:27:40<6:00:10,  3.45it/s]
 80%|███████▉  | 296908/371472 [1:27:40<5:51:07,  3.54it/s]
 80%|███████▉  | 296909/371472 [1:27:40<5:40:26,  3.65it/s]
 80%|███████▉  | 296910/371472 [1:27:40<5:43:37,  3.62it/s]
 80%|███████▉  | 296911/371472 [1:27:41<5:51:16,  3.54it/s]
 80%|███████▉  | 296912/371472 [1:27:41<6:07:19,  3.38it/s]
 80%|███████▉  | 296913/371472 [1:27:41<6:26:54,  3.21it/s]
 80%|███████▉  | 296914/371472 [1:27:42<6:24:20,  3.23it/s]
 80%|███████▉  | 296915/371472 [1:27:42<6:09:19,  3.36it/s]
 80%|███████▉  | 296916/371472 [1:27:42<6:03:23,  3.42it/s]
 80%|███████▉  | 296917/371472 [1:27:43<6:14:01,  3.32it/s]
 80%|███████▉  | 296918/371472 [1:27:43<6:01:30,  3.44it/s]
 80%|███████▉  | 296919/371472 [1:27:43<6:28:04,  3.20it/s]
 80%|███████▉  | 296920/371472 [1:27:43<6:14:09,  3.32it/s]
                                                           
{'loss': 2.5855, 'learning_rate': 2.80721411795126e-07, 'epoch': 12.79}

 80%|███████▉  | 296920/371472 [1:27:43<6:14:09,  3.32it/s]
 80%|███████▉  | 296921/371472 [1:27:44<6:04:06,  3.41it/s]
 80%|███████▉  | 296922/371472 [1:27:44<6:20:46,  3.26it/s]
 80%|███████▉  | 296923/371472 [1:27:44<6:55:41,  2.99it/s]
 80%|███████▉  | 296924/371472 [1:27:45<6:42:19,  3.09it/s]
 80%|███████▉  | 296925/371472 [1:27:45<6:31:21,  3.17it/s]
 80%|███████▉  | 296926/371472 [1:27:45<7:04:31,  2.93it/s]
 80%|███████▉  | 296927/371472 [1:27:46<7:22:04,  2.81it/s]
 80%|███████▉  | 296928/371472 [1:27:46<6:51:56,  3.02it/s]
 80%|███████▉  | 296929/371472 [1:27:46<6:51:43,  3.02it/s]
 80%|███████▉  | 296930/371472 [1:27:47<6:26:52,  3.21it/s]
 80%|███████▉  | 296931/371472 [1:27:47<6:18:26,  3.28it/s]
 80%|███████▉  | 296932/371472 [1:27:47<6:19:29,  3.27it/s]
 80%|███████▉  | 296933/371472 [1:27:48<6:06:24,  3.39it/s]
 80%|███████▉  | 296934/371472 [1:27:48<5:58:34,  3.46it/s]
 80%|███████▉  | 296935/371472 [1:27:48<6:35:51,  3.14it/s]
 80%|███████▉  | 296936/371472 [1:27:49<6:18:55,  3.28it/s]
 80%|███████▉  | 296937/371472 [1:27:49<6:52:21,  3.01it/s]
 80%|███████▉  | 296938/371472 [1:27:49<6:34:17,  3.15it/s]
 80%|███████▉  | 296939/371472 [1:27:50<6:43:09,  3.08it/s]
 80%|███████▉  | 296940/371472 [1:27:50<6:22:32,  3.25it/s]
                                                           
{'loss': 2.6165, 'learning_rate': 2.8067292981964707e-07, 'epoch': 12.79}

 80%|███████▉  | 296940/371472 [1:27:50<6:22:32,  3.25it/s]
 80%|███████▉  | 296941/371472 [1:27:50<6:26:31,  3.21it/s]
 80%|███████▉  | 296942/371472 [1:27:50<6:14:54,  3.31it/s]
 80%|███████▉  | 296943/371472 [1:27:51<6:48:58,  3.04it/s]
 80%|███████▉  | 296944/371472 [1:27:51<6:24:20,  3.23it/s]
 80%|███████▉  | 296945/371472 [1:27:51<6:04:40,  3.41it/s]
 80%|███████▉  | 296946/371472 [1:27:52<5:48:00,  3.57it/s]
 80%|███████▉  | 296947/371472 [1:27:52<5:34:10,  3.72it/s]
 80%|███████▉  | 296948/371472 [1:27:52<5:45:00,  3.60it/s]
 80%|███████▉  | 296949/371472 [1:27:52<5:49:29,  3.55it/s]
 80%|███████▉  | 296950/371472 [1:27:53<5:44:01,  3.61it/s]
 80%|███████▉  | 296951/371472 [1:27:53<5:47:22,  3.58it/s]
 80%|███████▉  | 296952/371472 [1:27:53<5:41:25,  3.64it/s]
 80%|███████▉  | 296953/371472 [1:27:54<5:46:28,  3.58it/s]
 80%|███████▉  | 296954/371472 [1:27:54<5:37:23,  3.68it/s]
 80%|███████▉  | 296955/371472 [1:27:54<6:16:25,  3.30it/s]
 80%|███████▉  | 296956/371472 [1:27:54<6:05:33,  3.40it/s]
 80%|███████▉  | 296957/371472 [1:27:55<5:53:19,  3.52it/s]
 80%|███████▉  | 296958/371472 [1:27:55<5:53:48,  3.51it/s]
 80%|███████▉  | 296959/371472 [1:27:55<5:49:15,  3.56it/s]
 80%|███████▉  | 296960/371472 [1:27:56<5:39:56,  3.65it/s]
                                                           
{'loss': 2.6862, 'learning_rate': 2.8062444784416825e-07, 'epoch': 12.79}

 80%|███████▉  | 296960/371472 [1:27:56<5:39:56,  3.65it/s]
 80%|███████▉  | 296961/371472 [1:27:56<5:40:51,  3.64it/s]
 80%|███████▉  | 296962/371472 [1:27:56<5:57:47,  3.47it/s]
 80%|███████▉  | 296963/371472 [1:27:56<6:10:01,  3.36it/s]
 80%|███████▉  | 296964/371472 [1:27:57<5:58:47,  3.46it/s]
 80%|███████▉  | 296965/371472 [1:27:57<6:23:23,  3.24it/s]
 80%|███████▉  | 296966/371472 [1:27:57<6:23:15,  3.24it/s]
 80%|███████▉  | 296967/371472 [1:27:58<7:18:29,  2.83it/s]
 80%|███████▉  | 296968/371472 [1:27:58<7:00:23,  2.95it/s]
 80%|███████▉  | 296969/371472 [1:27:58<6:37:34,  3.12it/s]
 80%|███████▉  | 296970/371472 [1:27:59<6:28:44,  3.19it/s]
 80%|███████▉  | 296971/371472 [1:27:59<6:14:20,  3.32it/s]
 80%|███████▉  | 296972/371472 [1:27:59<6:21:26,  3.26it/s]
 80%|███████▉  | 296973/371472 [1:28:00<6:26:13,  3.21it/s]
 80%|███████▉  | 296974/371472 [1:28:00<6:30:16,  3.18it/s]
 80%|███████▉  | 296975/371472 [1:28:00<6:18:29,  3.28it/s]
 80%|███████▉  | 296976/371472 [1:28:01<6:30:42,  3.18it/s]
 80%|███████▉  | 296977/371472 [1:28:01<6:25:27,  3.22it/s]
 80%|███████▉  | 296978/371472 [1:28:01<6:04:17,  3.41it/s]
 80%|███████▉  | 296979/371472 [1:28:01<5:44:48,  3.60it/s]
 80%|███████▉  | 296980/371472 [1:28:02<6:04:34,  3.41it/s]
                                                           
{'loss': 2.6403, 'learning_rate': 2.805759658686892e-07, 'epoch': 12.79}

 80%|███████▉  | 296980/371472 [1:28:02<6:04:34,  3.41it/s]
 80%|███████▉  | 296981/371472 [1:28:02<6:07:41,  3.38it/s]
 80%|███████▉  | 296982/371472 [1:28:02<6:22:58,  3.24it/s]
 80%|███████▉  | 296983/371472 [1:28:03<6:08:56,  3.36it/s]
 80%|███████▉  | 296984/371472 [1:28:03<6:17:38,  3.29it/s]
 80%|███████▉  | 296985/371472 [1:28:03<6:21:44,  3.25it/s]
 80%|███████▉  | 296986/371472 [1:28:03<6:03:35,  3.41it/s]
 80%|███████▉  | 296987/371472 [1:28:04<6:18:14,  3.28it/s]
 80%|███████▉  | 296988/371472 [1:28:04<6:14:42,  3.31it/s]
 80%|███████▉  | 296989/371472 [1:28:04<6:08:11,  3.37it/s]
 80%|███████▉  | 296990/371472 [1:28:05<5:56:33,  3.48it/s]
 80%|███████▉  | 296991/371472 [1:28:05<6:20:43,  3.26it/s]
 80%|███████▉  | 296992/371472 [1:28:05<6:10:21,  3.35it/s]
 80%|███████▉  | 296993/371472 [1:28:06<6:08:41,  3.37it/s]
 80%|███████▉  | 296994/371472 [1:28:06<6:14:05,  3.32it/s]
 80%|███████▉  | 296995/371472 [1:28:06<6:08:14,  3.37it/s]
 80%|███████▉  | 296996/371472 [1:28:06<6:01:01,  3.44it/s]
 80%|███████▉  | 296997/371472 [1:28:07<6:06:49,  3.38it/s]
 80%|███████▉  | 296998/371472 [1:28:07<6:01:54,  3.43it/s]
 80%|███████▉  | 296999/371472 [1:28:07<5:53:29,  3.51it/s]
 80%|███████▉  | 297000/371472 [1:28:08<6:01:07,  3.44it/s]
                                                           
{'loss': 2.4418, 'learning_rate': 2.805274838932104e-07, 'epoch': 12.79}

 80%|███████▉  | 297000/371472 [1:28:08<6:01:07,  3.44it/s]
 80%|███████▉  | 297001/371472 [1:28:08<5:55:50,  3.49it/s]
 80%|███████▉  | 297002/371472 [1:28:08<5:53:51,  3.51it/s]
 80%|███████▉  | 297003/371472 [1:28:08<6:03:22,  3.42it/s]
 80%|███████▉  | 297004/371472 [1:28:09<5:50:58,  3.54it/s]
 80%|███████▉  | 297005/371472 [1:28:09<5:51:34,  3.53it/s]
 80%|███████▉  | 297006/371472 [1:28:09<5:59:54,  3.45it/s]
 80%|███████▉  | 297007/371472 [1:28:10<5:51:18,  3.53it/s]
 80%|███████▉  | 297008/371472 [1:28:10<6:03:27,  3.41it/s]
 80%|███████▉  | 297009/371472 [1:28:10<5:53:27,  3.51it/s]
 80%|███████▉  | 297010/371472 [1:28:10<5:55:22,  3.49it/s]
 80%|███████▉  | 297011/371472 [1:28:11<5:49:24,  3.55it/s]
 80%|███████▉  | 297012/371472 [1:28:11<5:44:00,  3.61it/s]
 80%|███████▉  | 297013/371472 [1:28:11<6:06:57,  3.38it/s]
 80%|███████▉  | 297014/371472 [1:28:12<5:58:29,  3.46it/s]
 80%|███████▉  | 297015/371472 [1:28:12<5:45:19,  3.59it/s]
 80%|███████▉  | 297016/371472 [1:28:12<5:49:42,  3.55it/s]
 80%|███████▉  | 297017/371472 [1:28:12<5:50:16,  3.54it/s]
 80%|███████▉  | 297018/371472 [1:28:13<5:50:42,  3.54it/s]
 80%|███████▉  | 297019/371472 [1:28:13<6:09:44,  3.36it/s]
 80%|███████▉  | 297020/371472 [1:28:13<6:01:34,  3.43it/s]
                                                           
{'loss': 2.4945, 'learning_rate': 2.8047900191773146e-07, 'epoch': 12.79}

 80%|███████▉  | 297020/371472 [1:28:13<6:01:34,  3.43it/s]
 80%|███████▉  | 297021/371472 [1:28:14<6:04:31,  3.40it/s]
 80%|███████▉  | 297022/371472 [1:28:14<6:00:06,  3.45it/s]
 80%|███████▉  | 297023/371472 [1:28:14<6:05:11,  3.40it/s]
 80%|███████▉  | 297024/371472 [1:28:15<6:03:31,  3.41it/s]
 80%|███████▉  | 297025/371472 [1:28:15<6:14:45,  3.31it/s]
 80%|███████▉  | 297026/371472 [1:28:15<6:07:55,  3.37it/s]
 80%|███████▉  | 297027/371472 [1:28:15<6:10:23,  3.35it/s]
 80%|███████▉  | 297028/371472 [1:28:16<5:54:27,  3.50it/s]
 80%|███████▉  | 297029/371472 [1:28:16<5:54:09,  3.50it/s]
 80%|███████▉  | 297030/371472 [1:28:16<6:02:52,  3.42it/s]
 80%|███████▉  | 297031/371472 [1:28:17<6:29:22,  3.19it/s]
 80%|███████▉  | 297032/371472 [1:28:17<6:24:50,  3.22it/s]
 80%|███████▉  | 297033/371472 [1:28:17<6:10:24,  3.35it/s]
 80%|███████▉  | 297034/371472 [1:28:18<6:32:35,  3.16it/s]
 80%|███████▉  | 297035/371472 [1:28:18<6:25:25,  3.22it/s]
 80%|███████▉  | 297036/371472 [1:28:18<6:08:55,  3.36it/s]
 80%|███████▉  | 297037/371472 [1:28:18<5:59:21,  3.45it/s]
 80%|███████▉  | 297038/371472 [1:28:19<6:00:38,  3.44it/s]
 80%|███████▉  | 297039/371472 [1:28:19<6:11:25,  3.34it/s]
 80%|███████▉  | 297040/371472 [1:28:19<6:05:49,  3.39it/s]
                                                           
{'loss': 2.7498, 'learning_rate': 2.8043051994225253e-07, 'epoch': 12.79}

 80%|███████▉  | 297040/371472 [1:28:19<6:05:49,  3.39it/s]
 80%|███████▉  | 297041/371472 [1:28:20<5:57:14,  3.47it/s]
 80%|███████▉  | 297042/371472 [1:28:20<5:44:47,  3.60it/s]
 80%|███████▉  | 297043/371472 [1:28:20<5:59:18,  3.45it/s]
 80%|███████▉  | 297044/371472 [1:28:20<5:52:32,  3.52it/s]
 80%|███████▉  | 297045/371472 [1:28:21<5:54:23,  3.50it/s]
 80%|███████▉  | 297046/371472 [1:28:21<5:40:48,  3.64it/s]
 80%|███████▉  | 297047/371472 [1:28:21<5:55:37,  3.49it/s]
 80%|███████▉  | 297048/371472 [1:28:22<6:01:35,  3.43it/s]
 80%|███████▉  | 297049/371472 [1:28:22<6:00:50,  3.44it/s]
 80%|███████▉  | 297050/371472 [1:28:22<6:01:45,  3.43it/s]
 80%|███████▉  | 297051/371472 [1:28:22<5:51:06,  3.53it/s]
 80%|███████▉  | 297052/371472 [1:28:23<5:41:57,  3.63it/s]
 80%|███████▉  | 297053/371472 [1:28:23<5:40:38,  3.64it/s]
 80%|███████▉  | 297054/371472 [1:28:23<5:37:37,  3.67it/s]
 80%|███████▉  | 297055/371472 [1:28:24<5:45:42,  3.59it/s]
 80%|███████▉  | 297056/371472 [1:28:24<5:45:24,  3.59it/s]
 80%|███████▉  | 297057/371472 [1:28:24<6:04:57,  3.40it/s]
 80%|███████▉  | 297058/371472 [1:28:24<6:00:00,  3.45it/s]
 80%|███████▉  | 297059/371472 [1:28:25<6:11:48,  3.34it/s]
 80%|███████▉  | 297060/371472 [1:28:25<6:15:13,  3.31it/s]
                                                           
{'loss': 2.6761, 'learning_rate': 2.803820379667737e-07, 'epoch': 12.79}

 80%|███████▉  | 297060/371472 [1:28:25<6:15:13,  3.31it/s]
 80%|███████▉  | 297061/371472 [1:28:25<6:15:58,  3.30it/s]
 80%|███████▉  | 297062/371472 [1:28:26<6:25:08,  3.22it/s]
 80%|███████▉  | 297063/371472 [1:28:26<6:04:44,  3.40it/s]
 80%|███████▉  | 297064/371472 [1:28:26<5:58:29,  3.46it/s]
 80%|███████▉  | 297065/371472 [1:28:27<6:06:09,  3.39it/s]
 80%|███████▉  | 297066/371472 [1:28:27<6:01:47,  3.43it/s]
 80%|███████▉  | 297067/371472 [1:28:27<5:54:35,  3.50it/s]
 80%|███████▉  | 297068/371472 [1:28:27<5:51:22,  3.53it/s]
 80%|███████▉  | 297069/371472 [1:28:28<5:45:49,  3.59it/s]
 80%|███████▉  | 297070/371472 [1:28:28<5:41:49,  3.63it/s]
 80%|███████▉  | 297071/371472 [1:28:28<5:50:29,  3.54it/s]
 80%|███████▉  | 297072/371472 [1:28:28<5:46:31,  3.58it/s]
 80%|███████▉  | 297073/371472 [1:28:29<6:13:08,  3.32it/s]
 80%|███████▉  | 297074/371472 [1:28:29<6:09:48,  3.35it/s]
 80%|███████▉  | 297075/371472 [1:28:29<6:02:26,  3.42it/s]
 80%|███████▉  | 297076/371472 [1:28:30<6:00:32,  3.44it/s]
 80%|███████▉  | 297077/371472 [1:28:30<6:22:48,  3.24it/s]
 80%|███████▉  | 297078/371472 [1:28:30<6:16:05,  3.30it/s]
 80%|███████▉  | 297079/371472 [1:28:31<6:02:21,  3.42it/s]
 80%|███████▉  | 297080/371472 [1:28:31<5:52:26,  3.52it/s]
                                                           
{'loss': 2.7213, 'learning_rate': 2.8033355599129473e-07, 'epoch': 12.8}

 80%|███████▉  | 297080/371472 [1:28:31<5:52:26,  3.52it/s]
 80%|███████▉  | 297081/371472 [1:28:31<6:00:56,  3.44it/s]
 80%|███████▉  | 297082/371472 [1:28:31<5:42:00,  3.63it/s]
 80%|███████▉  | 297083/371472 [1:28:32<5:47:16,  3.57it/s]
 80%|███████▉  | 297084/371472 [1:28:32<5:45:03,  3.59it/s]
 80%|███████▉  | 297085/371472 [1:28:32<6:04:51,  3.40it/s]
 80%|███████▉  | 297086/371472 [1:28:33<6:03:53,  3.41it/s]
 80%|███████▉  | 297087/371472 [1:28:33<5:51:32,  3.53it/s]
 80%|███████▉  | 297088/371472 [1:28:33<6:02:36,  3.42it/s]
 80%|███████▉  | 297089/371472 [1:28:33<6:16:06,  3.30it/s]
 80%|███████▉  | 297090/371472 [1:28:34<6:15:06,  3.30it/s]
 80%|███████▉  | 297091/371472 [1:28:34<5:56:49,  3.47it/s]
 80%|███████▉  | 297092/371472 [1:28:34<6:00:59,  3.43it/s]
 80%|███████▉  | 297093/371472 [1:28:35<6:04:37,  3.40it/s]
 80%|███████▉  | 297094/371472 [1:28:35<6:01:45,  3.43it/s]
 80%|███████▉  | 297095/371472 [1:28:35<5:48:54,  3.55it/s]
 80%|███████▉  | 297096/371472 [1:28:35<5:49:37,  3.55it/s]
 80%|███████▉  | 297097/371472 [1:28:36<6:14:14,  3.31it/s]
 80%|███████▉  | 297098/371472 [1:28:36<6:09:56,  3.35it/s]
 80%|███████▉  | 297099/371472 [1:28:36<6:01:23,  3.43it/s]
 80%|███████▉  | 297100/371472 [1:28:37<6:01:09,  3.43it/s]
                                                           
{'loss': 2.6271, 'learning_rate': 2.8028507401581585e-07, 'epoch': 12.8}

 80%|███████▉  | 297100/371472 [1:28:37<6:01:09,  3.43it/s]
 80%|███████▉  | 297101/371472 [1:28:37<5:58:45,  3.45it/s]
 80%|███████▉  | 297102/371472 [1:28:37<5:52:59,  3.51it/s]
 80%|███████▉  | 297103/371472 [1:28:37<5:42:59,  3.61it/s]
 80%|███████▉  | 297104/371472 [1:28:38<5:44:29,  3.60it/s]
 80%|███████▉  | 297105/371472 [1:28:38<5:38:09,  3.67it/s]
 80%|███████▉  | 297106/371472 [1:28:38<5:59:38,  3.45it/s]
 80%|███████▉  | 297107/371472 [1:28:39<5:54:30,  3.50it/s]
 80%|███████▉  | 297108/371472 [1:28:39<5:44:51,  3.59it/s]
 80%|███████▉  | 297109/371472 [1:28:39<5:57:29,  3.47it/s]
 80%|███████▉  | 297110/371472 [1:28:39<5:54:57,  3.49it/s]
 80%|███████▉  | 297111/371472 [1:28:40<5:53:52,  3.50it/s]
 80%|███████▉  | 297112/371472 [1:28:40<5:59:32,  3.45it/s]
 80%|███████▉  | 297113/371472 [1:28:40<6:13:01,  3.32it/s]
 80%|███████▉  | 297114/371472 [1:28:41<5:59:12,  3.45it/s]
 80%|███████▉  | 297115/371472 [1:28:41<6:17:54,  3.28it/s]
 80%|███████▉  | 297116/371472 [1:28:41<6:09:23,  3.35it/s]
 80%|███████▉  | 297117/371472 [1:28:42<6:21:08,  3.25it/s]
 80%|███████▉  | 297118/371472 [1:28:42<6:09:16,  3.36it/s]
 80%|███████▉  | 297119/371472 [1:28:42<6:10:17,  3.35it/s]
 80%|███████▉  | 297120/371472 [1:28:42<5:55:14,  3.49it/s]
                                                           
{'loss': 2.5896, 'learning_rate': 2.802365920403369e-07, 'epoch': 12.8}

 80%|███████▉  | 297120/371472 [1:28:42<5:55:14,  3.49it/s]
 80%|███████▉  | 297121/371472 [1:28:43<5:45:03,  3.59it/s]
 80%|███████▉  | 297122/371472 [1:28:43<5:52:39,  3.51it/s]
 80%|███████▉  | 297123/371472 [1:28:43<5:46:22,  3.58it/s]
 80%|███████▉  | 297124/371472 [1:28:44<5:36:05,  3.69it/s]
 80%|███████▉  | 297125/371472 [1:28:44<5:26:14,  3.80it/s]
 80%|███████▉  | 297126/371472 [1:28:44<5:25:54,  3.80it/s]
 80%|███████▉  | 297127/371472 [1:28:44<5:49:07,  3.55it/s]
 80%|███████▉  | 297128/371472 [1:28:45<5:51:16,  3.53it/s]
 80%|███████▉  | 297129/371472 [1:28:45<5:41:36,  3.63it/s]
 80%|███████▉  | 297130/371472 [1:28:45<5:34:45,  3.70it/s]
 80%|███████▉  | 297131/371472 [1:28:45<5:37:40,  3.67it/s]
 80%|███████▉  | 297132/371472 [1:28:46<5:45:01,  3.59it/s]
 80%|███████▉  | 297133/371472 [1:28:46<5:52:32,  3.51it/s]
 80%|███████▉  | 297134/371472 [1:28:46<5:49:22,  3.55it/s]
 80%|███████▉  | 297135/371472 [1:28:47<5:54:57,  3.49it/s]
 80%|███████▉  | 297136/371472 [1:28:47<6:05:28,  3.39it/s]
 80%|███████▉  | 297137/371472 [1:28:47<6:07:43,  3.37it/s]
 80%|███████▉  | 297138/371472 [1:28:48<6:07:55,  3.37it/s]
 80%|███████▉  | 297139/371472 [1:28:48<6:10:49,  3.34it/s]
 80%|███████▉  | 297140/371472 [1:28:48<5:53:15,  3.51it/s]
                                                           
{'loss': 2.7081, 'learning_rate': 2.801881100648581e-07, 'epoch': 12.8}

 80%|███████▉  | 297140/371472 [1:28:48<5:53:15,  3.51it/s]
 80%|███████▉  | 297141/371472 [1:28:48<6:24:18,  3.22it/s]
 80%|███████▉  | 297142/371472 [1:28:49<6:07:59,  3.37it/s]
 80%|███████▉  | 297143/371472 [1:28:49<6:03:00,  3.41it/s]
 80%|███████▉  | 297144/371472 [1:28:49<5:56:09,  3.48it/s]
 80%|███████▉  | 297145/371472 [1:28:50<5:56:31,  3.47it/s]
 80%|███████▉  | 297146/371472 [1:28:50<6:10:54,  3.34it/s]
 80%|███████▉  | 297147/371472 [1:28:50<6:03:49,  3.40it/s]
 80%|███████▉  | 297148/371472 [1:28:50<6:00:38,  3.43it/s]
 80%|███████▉  | 297149/371472 [1:28:51<5:49:07,  3.55it/s]
 80%|███████▉  | 297150/371472 [1:28:51<5:46:09,  3.58it/s]
 80%|███████▉  | 297151/371472 [1:28:51<5:32:39,  3.72it/s]
 80%|███████▉  | 297152/371472 [1:28:52<5:44:13,  3.60it/s]
 80%|███████▉  | 297153/371472 [1:28:52<5:36:52,  3.68it/s]
 80%|███████▉  | 297154/371472 [1:28:52<5:43:36,  3.60it/s]
 80%|███████▉  | 297155/371472 [1:28:52<5:29:53,  3.75it/s]
 80%|███████▉  | 297156/371472 [1:28:53<5:29:05,  3.76it/s]
 80%|███████▉  | 297157/371472 [1:28:53<5:35:50,  3.69it/s]
 80%|███████▉  | 297158/371472 [1:28:53<5:39:43,  3.65it/s]
 80%|███████▉  | 297159/371472 [1:28:53<5:53:04,  3.51it/s]
 80%|███████▉  | 297160/371472 [1:28:54<5:47:41,  3.56it/s]
                                                           
{'loss': 2.678, 'learning_rate': 2.801396280893792e-07, 'epoch': 12.8}

 80%|███████▉  | 297160/371472 [1:28:54<5:47:41,  3.56it/s]
 80%|███████▉  | 297161/371472 [1:28:54<5:43:48,  3.60it/s]
 80%|███████▉  | 297162/371472 [1:28:54<5:43:11,  3.61it/s]
 80%|███████▉  | 297163/371472 [1:28:55<5:41:24,  3.63it/s]
 80%|███████▉  | 297164/371472 [1:28:55<5:50:20,  3.54it/s]
 80%|███████▉  | 297165/371472 [1:28:55<5:53:11,  3.51it/s]
 80%|███████▉  | 297166/371472 [1:28:55<6:00:31,  3.44it/s]
 80%|███████▉  | 297167/371472 [1:28:56<5:52:39,  3.51it/s]
 80%|███████▉  | 297168/371472 [1:28:56<5:48:58,  3.55it/s]
 80%|███████▉  | 297169/371472 [1:28:56<5:59:21,  3.45it/s]
 80%|███████▉  | 297170/371472 [1:28:57<6:35:08,  3.13it/s]
 80%|███████▉  | 297171/371472 [1:28:57<6:19:15,  3.27it/s]
 80%|███████▉  | 297172/371472 [1:28:57<6:11:48,  3.33it/s]
 80%|███████▉  | 297173/371472 [1:28:57<5:55:56,  3.48it/s]
 80%|███████▉  | 297174/371472 [1:28:58<5:49:31,  3.54it/s]
 80%|███████▉  | 297175/371472 [1:28:58<5:42:11,  3.62it/s]
 80%|███████▉  | 297176/371472 [1:28:58<5:45:43,  3.58it/s]
 80%|███████▉  | 297177/371472 [1:28:59<5:50:05,  3.54it/s]
 80%|████████  | 297178/371472 [1:28:59<5:45:26,  3.58it/s]
 80%|████████  | 297179/371472 [1:28:59<5:36:38,  3.68it/s]
 80%|████████  | 297180/371472 [1:28:59<5:32:34,  3.72it/s]
                                                           
{'loss': 2.7735, 'learning_rate': 2.8009114611390035e-07, 'epoch': 12.8}

 80%|████████  | 297180/371472 [1:28:59<5:32:34,  3.72it/s]
 80%|████████  | 297181/371472 [1:29:00<5:26:34,  3.79it/s]
 80%|████████  | 297182/371472 [1:29:00<5:21:20,  3.85it/s]
 80%|████████  | 297183/371472 [1:29:00<5:23:08,  3.83it/s]
 80%|████████  | 297184/371472 [1:29:00<5:26:16,  3.79it/s]
 80%|████████  | 297185/371472 [1:29:01<5:27:37,  3.78it/s]
 80%|████████  | 297186/371472 [1:29:01<5:33:42,  3.71it/s]
 80%|████████  | 297187/371472 [1:29:01<5:32:01,  3.73it/s]
 80%|████████  | 297188/371472 [1:29:02<5:38:04,  3.66it/s]
 80%|████████  | 297189/371472 [1:29:02<5:39:17,  3.65it/s]
 80%|████████  | 297190/371472 [1:29:02<5:42:34,  3.61it/s]
 80%|████████  | 297191/371472 [1:29:02<5:48:01,  3.56it/s]
 80%|████████  | 297192/371472 [1:29:03<5:41:16,  3.63it/s]
 80%|████████  | 297193/371472 [1:29:03<5:46:31,  3.57it/s]
 80%|████████  | 297194/371472 [1:29:03<5:44:12,  3.60it/s]
 80%|████████  | 297195/371472 [1:29:04<6:13:19,  3.32it/s]
 80%|████████  | 297196/371472 [1:29:04<5:59:47,  3.44it/s]
 80%|████████  | 297197/371472 [1:29:04<5:57:24,  3.46it/s]
 80%|████████  | 297198/371472 [1:29:04<5:46:12,  3.58it/s]
 80%|████████  | 297199/371472 [1:29:05<5:42:33,  3.61it/s]
 80%|████████  | 297200/371472 [1:29:05<5:31:07,  3.74it/s]
                                                           
{'loss': 2.7146, 'learning_rate': 2.8004266413842137e-07, 'epoch': 12.8}

 80%|████████  | 297200/371472 [1:29:05<5:31:07,  3.74it/s]
 80%|████████  | 297201/371472 [1:29:05<5:48:29,  3.55it/s]
 80%|████████  | 297202/371472 [1:29:05<5:46:31,  3.57it/s]
 80%|████████  | 297203/371472 [1:29:06<5:39:53,  3.64it/s]
 80%|████████  | 297204/371472 [1:29:06<5:47:38,  3.56it/s]
 80%|████████  | 297205/371472 [1:29:06<5:57:11,  3.47it/s]
 80%|████████  | 297206/371472 [1:29:07<5:54:45,  3.49it/s]
 80%|████████  | 297207/371472 [1:29:07<5:40:07,  3.64it/s]
 80%|████████  | 297208/371472 [1:29:07<5:48:04,  3.56it/s]
 80%|████████  | 297209/371472 [1:29:07<5:51:58,  3.52it/s]
 80%|████████  | 297210/371472 [1:29:08<5:58:56,  3.45it/s]
 80%|████████  | 297211/371472 [1:29:08<5:51:34,  3.52it/s]
 80%|████████  | 297212/371472 [1:29:08<5:59:56,  3.44it/s]
 80%|████████  | 297213/371472 [1:29:09<5:53:45,  3.50it/s]
 80%|████████  | 297214/371472 [1:29:09<5:52:30,  3.51it/s]
 80%|████████  | 297215/371472 [1:29:09<5:50:04,  3.54it/s]
 80%|████████  | 297216/371472 [1:29:10<6:26:43,  3.20it/s]
 80%|████████  | 297217/371472 [1:29:10<6:08:32,  3.36it/s]
 80%|████████  | 297218/371472 [1:29:10<6:21:26,  3.24it/s]
 80%|████████  | 297219/371472 [1:29:11<6:38:49,  3.10it/s]
 80%|████████  | 297220/371472 [1:29:11<6:21:32,  3.24it/s]
                                                           
{'loss': 2.4159, 'learning_rate': 2.7999418216294255e-07, 'epoch': 12.8}

 80%|████████  | 297220/371472 [1:29:11<6:21:32,  3.24it/s]
 80%|████████  | 297221/371472 [1:29:11<6:23:12,  3.23it/s]
 80%|████████  | 297222/371472 [1:29:11<6:18:31,  3.27it/s]
 80%|████████  | 297223/371472 [1:29:12<6:09:47,  3.35it/s]
 80%|████████  | 297224/371472 [1:29:12<5:56:45,  3.47it/s]
 80%|████████  | 297225/371472 [1:29:12<5:49:12,  3.54it/s]
 80%|████████  | 297226/371472 [1:29:13<6:19:08,  3.26it/s]
 80%|████████  | 297227/371472 [1:29:13<6:07:06,  3.37it/s]
 80%|████████  | 297228/371472 [1:29:13<5:55:40,  3.48it/s]
 80%|████████  | 297229/371472 [1:29:13<5:48:42,  3.55it/s]
 80%|████████  | 297230/371472 [1:29:14<5:42:20,  3.61it/s]
 80%|████████  | 297231/371472 [1:29:14<5:42:42,  3.61it/s]
 80%|████████  | 297232/371472 [1:29:14<5:35:44,  3.69it/s]
 80%|████████  | 297233/371472 [1:29:14<5:40:42,  3.63it/s]
 80%|████████  | 297234/371472 [1:29:15<5:57:42,  3.46it/s]
 80%|████████  | 297235/371472 [1:29:15<5:49:24,  3.54it/s]
 80%|████████  | 297236/371472 [1:29:15<6:27:43,  3.19it/s]
 80%|████████  | 297237/371472 [1:29:16<6:20:57,  3.25it/s]
 80%|████████  | 297238/371472 [1:29:16<6:20:17,  3.25it/s]
 80%|████████  | 297239/371472 [1:29:16<6:20:48,  3.25it/s]
 80%|████████  | 297240/371472 [1:29:17<6:13:18,  3.31it/s]
                                                           
{'loss': 2.52, 'learning_rate': 2.7994570018746357e-07, 'epoch': 12.8}

 80%|████████  | 297240/371472 [1:29:17<6:13:18,  3.31it/s]
 80%|████████  | 297241/371472 [1:29:17<6:01:08,  3.43it/s]
 80%|████████  | 297242/371472 [1:29:17<5:52:03,  3.51it/s]
 80%|████████  | 297243/371472 [1:29:17<5:37:56,  3.66it/s]
 80%|████████  | 297244/371472 [1:29:18<5:53:50,  3.50it/s]
 80%|████████  | 297245/371472 [1:29:18<5:57:54,  3.46it/s]
 80%|████████  | 297246/371472 [1:29:18<5:52:48,  3.51it/s]
 80%|████████  | 297247/371472 [1:29:19<6:00:15,  3.43it/s]
 80%|████████  | 297248/371472 [1:29:19<5:50:50,  3.53it/s]
 80%|████████  | 297249/371472 [1:29:19<5:39:23,  3.64it/s]
 80%|████████  | 297250/371472 [1:29:19<5:41:18,  3.62it/s]
 80%|████████  | 297251/371472 [1:29:20<5:45:51,  3.58it/s]
 80%|████████  | 297252/371472 [1:29:20<5:42:33,  3.61it/s]
 80%|████████  | 297253/371472 [1:29:20<5:43:18,  3.60it/s]
 80%|████████  | 297254/371472 [1:29:21<5:47:02,  3.56it/s]
 80%|████████  | 297255/371472 [1:29:21<5:48:34,  3.55it/s]
 80%|████████  | 297256/371472 [1:29:21<5:49:15,  3.54it/s]
 80%|████████  | 297257/371472 [1:29:21<5:53:19,  3.50it/s]
 80%|████████  | 297258/371472 [1:29:22<5:47:01,  3.56it/s]
 80%|████████  | 297259/371472 [1:29:22<5:52:21,  3.51it/s]
 80%|████████  | 297260/371472 [1:29:22<5:38:17,  3.66it/s]
                                                           
{'loss': 2.5229, 'learning_rate': 2.7989721821198474e-07, 'epoch': 12.8}

 80%|████████  | 297260/371472 [1:29:22<5:38:17,  3.66it/s]
 80%|████████  | 297261/371472 [1:29:22<5:31:27,  3.73it/s]
 80%|████████  | 297262/371472 [1:29:23<5:25:36,  3.80it/s]
 80%|████████  | 297263/371472 [1:29:23<5:23:32,  3.82it/s]
 80%|████████  | 297264/371472 [1:29:23<5:21:04,  3.85it/s]
 80%|████████  | 297265/371472 [1:29:24<5:36:03,  3.68it/s]
 80%|████████  | 297266/371472 [1:29:24<5:39:10,  3.65it/s]
 80%|████████  | 297267/371472 [1:29:24<5:40:16,  3.63it/s]
 80%|████████  | 297268/371472 [1:29:24<5:45:32,  3.58it/s]
 80%|████████  | 297269/371472 [1:29:25<5:37:05,  3.67it/s]
 80%|████████  | 297270/371472 [1:29:25<5:51:16,  3.52it/s]
 80%|████████  | 297271/371472 [1:29:25<5:45:54,  3.58it/s]
 80%|████████  | 297272/371472 [1:29:26<5:51:41,  3.52it/s]
 80%|████████  | 297273/371472 [1:29:26<5:43:53,  3.60it/s]
 80%|████████  | 297274/371472 [1:29:26<5:47:39,  3.56it/s]
 80%|████████  | 297275/371472 [1:29:26<6:00:20,  3.43it/s]
 80%|████████  | 297276/371472 [1:29:27<5:55:57,  3.47it/s]
 80%|████████  | 297277/371472 [1:29:27<5:55:14,  3.48it/s]
 80%|████████  | 297278/371472 [1:29:27<5:47:32,  3.56it/s]
 80%|████████  | 297279/371472 [1:29:27<5:43:17,  3.60it/s]
 80%|████████  | 297280/371472 [1:29:28<5:42:48,  3.61it/s]
                                                           
{'loss': 2.5813, 'learning_rate': 2.798487362365058e-07, 'epoch': 12.8}

 80%|████████  | 297280/371472 [1:29:28<5:42:48,  3.61it/s]
 80%|████████  | 297281/371472 [1:29:28<5:49:50,  3.53it/s]
 80%|████████  | 297282/371472 [1:29:28<5:59:23,  3.44it/s]
 80%|████████  | 297283/371472 [1:29:29<5:53:14,  3.50it/s]
 80%|████████  | 297284/371472 [1:29:29<5:57:54,  3.45it/s]
 80%|████████  | 297285/371472 [1:29:29<6:13:27,  3.31it/s]
 80%|████████  | 297286/371472 [1:29:30<5:56:18,  3.47it/s]
 80%|████████  | 297287/371472 [1:29:30<5:50:35,  3.53it/s]
 80%|████████  | 297288/371472 [1:29:30<5:54:30,  3.49it/s]
 80%|████████  | 297289/371472 [1:29:30<5:55:44,  3.48it/s]
 80%|████████  | 297290/371472 [1:29:31<5:47:19,  3.56it/s]
 80%|████████  | 297291/371472 [1:29:31<5:39:33,  3.64it/s]
 80%|████████  | 297292/371472 [1:29:31<5:55:33,  3.48it/s]
 80%|████████  | 297293/371472 [1:29:31<5:41:48,  3.62it/s]
 80%|████████  | 297294/371472 [1:29:32<5:44:37,  3.59it/s]
 80%|████████  | 297295/371472 [1:29:32<5:39:46,  3.64it/s]
 80%|████████  | 297296/371472 [1:29:32<5:54:16,  3.49it/s]
 80%|████████  | 297297/371472 [1:29:33<6:33:09,  3.14it/s]
 80%|████████  | 297298/371472 [1:29:33<6:30:38,  3.16it/s]
 80%|████████  | 297299/371472 [1:29:33<6:23:36,  3.22it/s]
 80%|████████  | 297300/371472 [1:29:34<6:15:32,  3.29it/s]
                                                           
{'loss': 2.5456, 'learning_rate': 2.79800254261027e-07, 'epoch': 12.81}

 80%|████████  | 297300/371472 [1:29:34<6:15:32,  3.29it/s]
 80%|████████  | 297301/371472 [1:29:34<6:20:15,  3.25it/s]
 80%|████████  | 297302/371472 [1:29:34<6:13:59,  3.31it/s]
 80%|████████  | 297303/371472 [1:29:34<5:59:08,  3.44it/s]
 80%|████████  | 297304/371472 [1:29:35<5:47:46,  3.55it/s]
 80%|████████  | 297305/371472 [1:29:35<5:36:00,  3.68it/s]
 80%|████████  | 297306/371472 [1:29:35<6:25:53,  3.20it/s]
 80%|████████  | 297307/371472 [1:29:36<6:25:33,  3.21it/s]
 80%|████████  | 297308/371472 [1:29:36<6:11:06,  3.33it/s]
 80%|████████  | 297309/371472 [1:29:36<6:19:40,  3.26it/s]
 80%|████████  | 297310/371472 [1:29:37<6:12:57,  3.31it/s]
 80%|████████  | 297311/371472 [1:29:37<5:52:11,  3.51it/s]
 80%|████████  | 297312/371472 [1:29:37<5:53:15,  3.50it/s]
 80%|████████  | 297313/371472 [1:29:37<5:39:15,  3.64it/s]
 80%|████████  | 297314/371472 [1:29:38<5:46:47,  3.56it/s]
 80%|████████  | 297315/371472 [1:29:38<6:18:31,  3.27it/s]
 80%|████████  | 297316/371472 [1:29:38<6:06:42,  3.37it/s]
 80%|████████  | 297317/371472 [1:29:39<5:59:58,  3.43it/s]
 80%|████████  | 297318/371472 [1:29:39<5:57:56,  3.45it/s]
 80%|████████  | 297319/371472 [1:29:39<5:49:33,  3.54it/s]
 80%|████████  | 297320/371472 [1:29:39<5:53:44,  3.49it/s]
                                                           
{'loss': 2.5308, 'learning_rate': 2.7975177228554806e-07, 'epoch': 12.81}

 80%|████████  | 297320/371472 [1:29:39<5:53:44,  3.49it/s]
 80%|████████  | 297321/371472 [1:29:40<6:37:17,  3.11it/s]
 80%|████████  | 297322/371472 [1:29:40<6:19:27,  3.26it/s]
 80%|████████  | 297323/371472 [1:29:40<6:06:13,  3.37it/s]
 80%|████████  | 297324/371472 [1:29:41<6:05:01,  3.39it/s]
 80%|████████  | 297325/371472 [1:29:41<5:56:23,  3.47it/s]
 80%|████████  | 297326/371472 [1:29:41<5:49:59,  3.53it/s]
 80%|████████  | 297327/371472 [1:29:42<5:58:17,  3.45it/s]
 80%|████████  | 297328/371472 [1:29:42<5:56:49,  3.46it/s]
 80%|████████  | 297329/371472 [1:29:42<6:14:29,  3.30it/s]
 80%|████████  | 297330/371472 [1:29:42<6:09:44,  3.34it/s]
 80%|████████  | 297331/371472 [1:29:43<6:21:22,  3.24it/s]
 80%|████████  | 297332/371472 [1:29:43<6:38:26,  3.10it/s]
 80%|████████  | 297333/371472 [1:29:43<6:23:26,  3.22it/s]
 80%|████████  | 297334/371472 [1:29:44<6:17:51,  3.27it/s]
 80%|████████  | 297335/371472 [1:29:44<6:18:05,  3.27it/s]
 80%|████████  | 297336/371472 [1:29:44<6:35:08,  3.13it/s]
 80%|████████  | 297337/371472 [1:29:45<6:27:59,  3.18it/s]
 80%|████████  | 297338/371472 [1:29:45<6:27:39,  3.19it/s]
 80%|████████  | 297339/371472 [1:29:45<6:58:22,  2.95it/s]
 80%|████████  | 297340/371472 [1:29:46<6:36:32,  3.12it/s]
                                                           
{'loss': 2.4351, 'learning_rate': 2.797032903100692e-07, 'epoch': 12.81}

 80%|████████  | 297340/371472 [1:29:46<6:36:32,  3.12it/s]
 80%|████████  | 297341/371472 [1:29:46<6:30:36,  3.16it/s]
 80%|████████  | 297342/371472 [1:29:46<6:27:53,  3.19it/s]
 80%|████████  | 297343/371472 [1:29:47<6:19:11,  3.26it/s]
 80%|████████  | 297344/371472 [1:29:47<5:59:13,  3.44it/s]
 80%|████████  | 297345/371472 [1:29:47<5:49:33,  3.53it/s]
 80%|████████  | 297346/371472 [1:29:47<5:56:26,  3.47it/s]
 80%|████████  | 297347/371472 [1:29:48<5:40:19,  3.63it/s]
 80%|████████  | 297348/371472 [1:29:48<6:01:06,  3.42it/s]
 80%|████████  | 297349/371472 [1:29:48<5:54:27,  3.49it/s]
 80%|████████  | 297350/371472 [1:29:49<5:53:13,  3.50it/s]
 80%|████████  | 297351/371472 [1:29:49<5:59:09,  3.44it/s]
 80%|████████  | 297352/371472 [1:29:49<5:52:04,  3.51it/s]
 80%|████████  | 297353/371472 [1:29:49<6:10:19,  3.34it/s]
 80%|████████  | 297354/371472 [1:29:50<6:14:44,  3.30it/s]
 80%|████████  | 297355/371472 [1:29:50<6:10:18,  3.34it/s]
 80%|████████  | 297356/371472 [1:29:50<5:57:06,  3.46it/s]
 80%|████████  | 297357/371472 [1:29:51<5:58:00,  3.45it/s]
 80%|████████  | 297358/371472 [1:29:51<5:52:58,  3.50it/s]
 80%|████████  | 297359/371472 [1:29:51<5:43:30,  3.60it/s]
 80%|████████  | 297360/371472 [1:29:51<6:01:14,  3.42it/s]
                                                           
{'loss': 2.4958, 'learning_rate': 2.796548083345902e-07, 'epoch': 12.81}

 80%|████████  | 297360/371472 [1:29:51<6:01:14,  3.42it/s]
 80%|████████  | 297361/371472 [1:29:52<6:23:17,  3.22it/s]
 80%|████████  | 297362/371472 [1:29:52<6:08:38,  3.35it/s]
 80%|████████  | 297363/371472 [1:29:52<6:01:12,  3.42it/s]
 80%|████████  | 297364/371472 [1:29:53<6:14:37,  3.30it/s]
 80%|████████  | 297365/371472 [1:29:53<6:02:19,  3.41it/s]
 80%|████████  | 297366/371472 [1:29:53<5:46:42,  3.56it/s]
 80%|████████  | 297367/371472 [1:29:53<5:47:37,  3.55it/s]
 80%|████████  | 297368/371472 [1:29:54<5:43:03,  3.60it/s]
 80%|████████  | 297369/371472 [1:29:54<5:39:05,  3.64it/s]
 80%|████████  | 297370/371472 [1:29:54<6:05:09,  3.38it/s]
 80%|████████  | 297371/371472 [1:29:55<5:46:22,  3.57it/s]
 80%|████████  | 297372/371472 [1:29:55<5:57:03,  3.46it/s]
 80%|████████  | 297373/371472 [1:29:55<5:42:36,  3.60it/s]
 80%|████████  | 297374/371472 [1:29:55<5:57:31,  3.45it/s]
 80%|████████  | 297375/371472 [1:29:56<5:41:14,  3.62it/s]
 80%|████████  | 297376/371472 [1:29:56<5:46:01,  3.57it/s]
 80%|████████  | 297377/371472 [1:29:56<5:54:56,  3.48it/s]
 80%|████████  | 297378/371472 [1:29:57<5:43:31,  3.59it/s]
 80%|████████  | 297379/371472 [1:29:57<5:41:42,  3.61it/s]
 80%|████████  | 297380/371472 [1:29:57<5:46:50,  3.56it/s]
                                                           
{'loss': 2.6359, 'learning_rate': 2.796063263591114e-07, 'epoch': 12.81}

 80%|████████  | 297380/371472 [1:29:57<5:46:50,  3.56it/s]
 80%|████████  | 297381/371472 [1:29:57<5:59:57,  3.43it/s]
 80%|████████  | 297382/371472 [1:29:58<5:53:57,  3.49it/s]
 80%|████████  | 297383/371472 [1:29:58<5:50:57,  3.52it/s]
 80%|████████  | 297384/371472 [1:29:58<5:55:56,  3.47it/s]
 80%|████████  | 297385/371472 [1:29:59<5:59:48,  3.43it/s]
 80%|████████  | 297386/371472 [1:29:59<6:02:51,  3.40it/s]
 80%|████████  | 297387/371472 [1:29:59<6:01:41,  3.41it/s]
 80%|████████  | 297388/371472 [1:30:00<6:17:11,  3.27it/s]
 80%|████████  | 297389/371472 [1:30:00<5:58:53,  3.44it/s]
 80%|████████  | 297390/371472 [1:30:00<5:55:46,  3.47it/s]
 80%|████████  | 297391/371472 [1:30:00<5:47:49,  3.55it/s]
 80%|████████  | 297392/371472 [1:30:01<5:35:32,  3.68it/s]
 80%|████████  | 297393/371472 [1:30:01<5:52:08,  3.51it/s]
 80%|████████  | 297394/371472 [1:30:01<5:55:24,  3.47it/s]
 80%|████████  | 297395/371472 [1:30:02<6:35:16,  3.12it/s]
 80%|████████  | 297396/371472 [1:30:02<6:14:46,  3.29it/s]
 80%|████████  | 297397/371472 [1:30:02<6:00:28,  3.42it/s]
 80%|████████  | 297398/371472 [1:30:02<6:02:09,  3.41it/s]
 80%|████████  | 297399/371472 [1:30:03<5:54:29,  3.48it/s]
 80%|████████  | 297400/371472 [1:30:03<6:12:47,  3.31it/s]
                                                           
{'loss': 2.5897, 'learning_rate': 2.7955784438363246e-07, 'epoch': 12.81}

 80%|████████  | 297400/371472 [1:30:03<6:12:47,  3.31it/s]
 80%|████████  | 297401/371472 [1:30:03<5:59:02,  3.44it/s]
 80%|████████  | 297402/371472 [1:30:04<5:48:23,  3.54it/s]
 80%|████████  | 297403/371472 [1:30:04<5:48:17,  3.54it/s]
 80%|████████  | 297404/371472 [1:30:04<6:01:55,  3.41it/s]
 80%|████████  | 297405/371472 [1:30:04<6:05:23,  3.38it/s]
 80%|████████  | 297406/371472 [1:30:05<5:59:17,  3.44it/s]
 80%|████████  | 297407/371472 [1:30:05<6:25:51,  3.20it/s]
 80%|████████  | 297408/371472 [1:30:05<6:15:30,  3.29it/s]
 80%|████████  | 297409/371472 [1:30:06<5:59:57,  3.43it/s]
 80%|████████  | 297410/371472 [1:30:06<6:20:22,  3.25it/s]
 80%|████████  | 297411/371472 [1:30:06<6:34:10,  3.13it/s]
 80%|████████  | 297412/371472 [1:30:07<6:17:28,  3.27it/s]
 80%|████████  | 297413/371472 [1:30:07<6:01:27,  3.41it/s]
 80%|████████  | 297414/371472 [1:30:07<5:47:09,  3.56it/s]
 80%|████████  | 297415/371472 [1:30:07<6:04:07,  3.39it/s]
 80%|████████  | 297416/371472 [1:30:08<6:39:33,  3.09it/s]
 80%|████████  | 297417/371472 [1:30:08<6:17:48,  3.27it/s]
 80%|████████  | 297418/371472 [1:30:08<6:05:46,  3.37it/s]
 80%|████████  | 297419/371472 [1:30:09<6:04:48,  3.38it/s]
 80%|████████  | 297420/371472 [1:30:09<6:03:15,  3.40it/s]
                                                           
{'loss': 2.727, 'learning_rate': 2.7950936240815363e-07, 'epoch': 12.81}

 80%|████████  | 297420/371472 [1:30:09<6:03:15,  3.40it/s]
 80%|████████  | 297421/371472 [1:30:09<6:34:49,  3.13it/s]
 80%|████████  | 297422/371472 [1:30:10<6:09:34,  3.34it/s]
 80%|████████  | 297423/371472 [1:30:10<6:21:14,  3.24it/s]
 80%|████████  | 297424/371472 [1:30:10<6:11:15,  3.32it/s]
 80%|████████  | 297425/371472 [1:30:10<5:53:02,  3.50it/s]
 80%|████████  | 297426/371472 [1:30:11<5:54:40,  3.48it/s]
 80%|████████  | 297427/371472 [1:30:11<6:25:20,  3.20it/s]
 80%|████████  | 297428/371472 [1:30:11<6:17:20,  3.27it/s]
 80%|████████  | 297429/371472 [1:30:12<5:55:24,  3.47it/s]
 80%|████████  | 297430/371472 [1:30:12<5:54:51,  3.48it/s]
 80%|████████  | 297431/371472 [1:30:12<5:57:48,  3.45it/s]
 80%|████████  | 297432/371472 [1:30:13<6:21:06,  3.24it/s]
 80%|████████  | 297433/371472 [1:30:13<6:09:57,  3.34it/s]
 80%|████████  | 297434/371472 [1:30:13<5:55:04,  3.48it/s]
 80%|████████  | 297435/371472 [1:30:13<6:08:13,  3.35it/s]
 80%|████████  | 297436/371472 [1:30:14<6:04:02,  3.39it/s]
 80%|████████  | 297437/371472 [1:30:14<6:05:28,  3.38it/s]
 80%|████████  | 297438/371472 [1:30:14<5:53:53,  3.49it/s]
 80%|████████  | 297439/371472 [1:30:15<5:55:47,  3.47it/s]
 80%|████████  | 297440/371472 [1:30:15<5:53:00,  3.50it/s]
                                                           
{'loss': 2.5589, 'learning_rate': 2.794608804326747e-07, 'epoch': 12.81}

 80%|████████  | 297440/371472 [1:30:15<5:53:00,  3.50it/s]
 80%|████████  | 297441/371472 [1:30:15<5:44:39,  3.58it/s]
 80%|████████  | 297442/371472 [1:30:15<5:56:10,  3.46it/s]
 80%|████████  | 297443/371472 [1:30:16<5:56:01,  3.47it/s]
 80%|████████  | 297444/371472 [1:30:16<6:13:43,  3.30it/s]
 80%|████████  | 297445/371472 [1:30:16<5:59:09,  3.44it/s]
 80%|████████  | 297446/371472 [1:30:17<5:48:01,  3.55it/s]
 80%|████████  | 297447/371472 [1:30:17<5:56:52,  3.46it/s]
 80%|████████  | 297448/371472 [1:30:17<5:51:09,  3.51it/s]
 80%|████████  | 297449/371472 [1:30:17<5:43:29,  3.59it/s]
 80%|████████  | 297450/371472 [1:30:18<6:01:19,  3.41it/s]
 80%|████████  | 297451/371472 [1:30:18<5:54:44,  3.48it/s]
 80%|████████  | 297452/371472 [1:30:18<5:53:20,  3.49it/s]
 80%|████████  | 297453/371472 [1:30:19<5:40:13,  3.63it/s]
 80%|████████  | 297454/371472 [1:30:19<5:33:51,  3.70it/s]
 80%|████████  | 297455/371472 [1:30:19<5:27:45,  3.76it/s]
 80%|████████  | 297456/371472 [1:30:20<6:22:30,  3.23it/s]
 80%|████████  | 297457/371472 [1:30:20<6:13:45,  3.30it/s]
 80%|████████  | 297458/371472 [1:30:20<6:04:45,  3.38it/s]
 80%|████████  | 297459/371472 [1:30:20<6:01:05,  3.42it/s]
 80%|████████  | 297460/371472 [1:30:21<5:55:02,  3.47it/s]
                                                           
{'loss': 2.7046, 'learning_rate': 2.7941239845719583e-07, 'epoch': 12.81}

 80%|████████  | 297460/371472 [1:30:21<5:55:02,  3.47it/s]
 80%|████████  | 297461/371472 [1:30:21<5:57:56,  3.45it/s]
 80%|████████  | 297462/371472 [1:30:21<5:43:53,  3.59it/s]
 80%|████████  | 297463/371472 [1:30:21<5:50:31,  3.52it/s]
 80%|████████  | 297464/371472 [1:30:22<5:40:22,  3.62it/s]
 80%|████████  | 297465/371472 [1:30:22<5:40:00,  3.63it/s]
 80%|████████  | 297466/371472 [1:30:22<5:53:53,  3.49it/s]
 80%|████████  | 297467/371472 [1:30:23<5:45:01,  3.57it/s]
 80%|████████  | 297468/371472 [1:30:23<5:48:19,  3.54it/s]
 80%|████████  | 297469/371472 [1:30:23<6:07:04,  3.36it/s]
 80%|████████  | 297470/371472 [1:30:23<5:50:14,  3.52it/s]
 80%|████████  | 297471/371472 [1:30:24<6:08:53,  3.34it/s]
 80%|████████  | 297472/371472 [1:30:24<6:15:32,  3.28it/s]
 80%|████████  | 297473/371472 [1:30:24<5:58:06,  3.44it/s]
 80%|████████  | 297474/371472 [1:30:25<6:07:57,  3.35it/s]
 80%|████████  | 297475/371472 [1:30:25<5:51:38,  3.51it/s]
 80%|████████  | 297476/371472 [1:30:25<5:45:03,  3.57it/s]
 80%|████████  | 297477/371472 [1:30:26<5:55:09,  3.47it/s]
 80%|████████  | 297478/371472 [1:30:26<5:57:08,  3.45it/s]
 80%|████████  | 297479/371472 [1:30:26<5:52:25,  3.50it/s]
 80%|████████  | 297480/371472 [1:30:26<6:04:55,  3.38it/s]
                                                           
{'loss': 2.6463, 'learning_rate': 2.793639164817169e-07, 'epoch': 12.81}

 80%|████████  | 297480/371472 [1:30:26<6:04:55,  3.38it/s]
 80%|████████  | 297481/371472 [1:30:27<6:01:56,  3.41it/s]
 80%|████████  | 297482/371472 [1:30:27<5:59:44,  3.43it/s]
 80%|████████  | 297483/371472 [1:30:27<5:55:31,  3.47it/s]
 80%|████████  | 297484/371472 [1:30:28<5:45:55,  3.56it/s]
 80%|████████  | 297485/371472 [1:30:28<5:35:45,  3.67it/s]
 80%|████████  | 297486/371472 [1:30:28<5:45:46,  3.57it/s]
 80%|████████  | 297487/371472 [1:30:28<5:51:35,  3.51it/s]
 80%|████████  | 297488/371472 [1:30:29<5:59:26,  3.43it/s]
 80%|████████  | 297489/371472 [1:30:29<5:52:03,  3.50it/s]
 80%|████████  | 297490/371472 [1:30:29<5:54:27,  3.48it/s]
 80%|████████  | 297491/371472 [1:30:30<6:10:37,  3.33it/s]
 80%|████████  | 297492/371472 [1:30:30<6:07:38,  3.35it/s]
 80%|████████  | 297493/371472 [1:30:30<5:59:09,  3.43it/s]
 80%|████████  | 297494/371472 [1:30:30<5:53:54,  3.48it/s]
 80%|████████  | 297495/371472 [1:30:31<5:53:44,  3.49it/s]
 80%|████████  | 297496/371472 [1:30:31<5:45:40,  3.57it/s]
 80%|████████  | 297497/371472 [1:30:31<5:43:09,  3.59it/s]
 80%|████████  | 297498/371472 [1:30:32<6:04:22,  3.38it/s]
 80%|████████  | 297499/371472 [1:30:32<5:55:16,  3.47it/s]
 80%|████████  | 297500/371472 [1:30:32<5:46:29,  3.56it/s]
                                                           
{'loss': 2.716, 'learning_rate': 2.79315434506238e-07, 'epoch': 12.81}

 80%|████████  | 297500/371472 [1:30:32<5:46:29,  3.56it/s]
 80%|████████  | 297501/371472 [1:30:32<5:58:32,  3.44it/s]
 80%|████████  | 297502/371472 [1:30:33<6:39:01,  3.09it/s]
 80%|████████  | 297503/371472 [1:30:33<6:27:41,  3.18it/s]
 80%|████████  | 297504/371472 [1:30:33<6:13:59,  3.30it/s]
 80%|████████  | 297505/371472 [1:30:34<6:05:23,  3.37it/s]
 80%|████████  | 297506/371472 [1:30:34<5:52:31,  3.50it/s]
 80%|████████  | 297507/371472 [1:30:34<5:57:17,  3.45it/s]
 80%|████████  | 297508/371472 [1:30:35<5:54:07,  3.48it/s]
 80%|████████  | 297509/371472 [1:30:35<5:50:01,  3.52it/s]
 80%|████████  | 297510/371472 [1:30:35<6:00:29,  3.42it/s]
 80%|████████  | 297511/371472 [1:30:35<5:47:12,  3.55it/s]
 80%|████████  | 297512/371472 [1:30:36<5:51:01,  3.51it/s]
 80%|████████  | 297513/371472 [1:30:36<6:27:57,  3.18it/s]
 80%|████████  | 297514/371472 [1:30:36<6:17:37,  3.26it/s]
 80%|████████  | 297515/371472 [1:30:37<6:02:03,  3.40it/s]
 80%|████████  | 297516/371472 [1:30:37<5:55:35,  3.47it/s]
 80%|████████  | 297517/371472 [1:30:37<6:24:30,  3.21it/s]
 80%|████████  | 297518/371472 [1:30:38<6:11:07,  3.32it/s]
 80%|████████  | 297519/371472 [1:30:38<6:03:13,  3.39it/s]
 80%|████████  | 297520/371472 [1:30:38<6:09:47,  3.33it/s]
                                                           
{'loss': 2.5513, 'learning_rate': 2.792669525307591e-07, 'epoch': 12.81}

 80%|████████  | 297520/371472 [1:30:38<6:09:47,  3.33it/s]
 80%|████████  | 297521/371472 [1:30:38<5:57:10,  3.45it/s]
 80%|████████  | 297522/371472 [1:30:39<5:52:51,  3.49it/s]
 80%|████████  | 297523/371472 [1:30:39<5:35:41,  3.67it/s]
 80%|████████  | 297524/371472 [1:30:39<5:36:16,  3.67it/s]
 80%|████████  | 297525/371472 [1:30:39<5:41:41,  3.61it/s]
 80%|████████  | 297526/371472 [1:30:40<5:36:31,  3.66it/s]
 80%|████████  | 297527/371472 [1:30:40<5:32:41,  3.70it/s]
 80%|████████  | 297528/371472 [1:30:40<6:20:10,  3.24it/s]
 80%|████████  | 297529/371472 [1:30:41<6:13:16,  3.30it/s]
 80%|████████  | 297530/371472 [1:30:41<6:06:21,  3.36it/s]
 80%|████████  | 297531/371472 [1:30:41<6:02:35,  3.40it/s]
 80%|████████  | 297532/371472 [1:30:42<6:48:57,  3.01it/s]
 80%|████████  | 297533/371472 [1:30:42<6:28:59,  3.17it/s]
 80%|████████  | 297534/371472 [1:30:42<6:26:18,  3.19it/s]
 80%|████████  | 297535/371472 [1:30:43<6:25:38,  3.20it/s]
 80%|████████  | 297536/371472 [1:30:43<6:01:25,  3.41it/s]
 80%|████████  | 297537/371472 [1:30:43<6:16:42,  3.27it/s]
 80%|████████  | 297538/371472 [1:30:43<6:11:16,  3.32it/s]
 80%|████████  | 297539/371472 [1:30:44<5:48:44,  3.53it/s]
 80%|████████  | 297540/371472 [1:30:44<5:45:58,  3.56it/s]
                                                           
{'loss': 2.6723, 'learning_rate': 2.792184705552803e-07, 'epoch': 12.82}

 80%|████████  | 297540/371472 [1:30:44<5:45:58,  3.56it/s]
 80%|████████  | 297541/371472 [1:30:44<5:38:09,  3.64it/s]
 80%|████████  | 297542/371472 [1:30:44<5:36:36,  3.66it/s]
 80%|████████  | 297543/371472 [1:30:45<5:40:25,  3.62it/s]
 80%|████████  | 297544/371472 [1:30:45<5:56:22,  3.46it/s]
 80%|████████  | 297545/371472 [1:30:45<5:50:43,  3.51it/s]
 80%|████████  | 297546/371472 [1:30:46<6:09:19,  3.34it/s]
 80%|████████  | 297547/371472 [1:30:46<5:53:18,  3.49it/s]
 80%|████████  | 297548/371472 [1:30:46<5:59:42,  3.43it/s]
 80%|████████  | 297549/371472 [1:30:47<5:58:30,  3.44it/s]
 80%|████████  | 297550/371472 [1:30:47<5:54:18,  3.48it/s]
 80%|████████  | 297551/371472 [1:30:47<6:25:33,  3.20it/s]
 80%|████████  | 297552/371472 [1:30:48<6:25:31,  3.20it/s]
 80%|████████  | 297553/371472 [1:30:48<6:30:22,  3.16it/s]
 80%|████████  | 297554/371472 [1:30:48<6:18:55,  3.25it/s]
 80%|████████  | 297555/371472 [1:30:48<6:07:21,  3.35it/s]
 80%|████████  | 297556/371472 [1:30:49<5:56:54,  3.45it/s]
 80%|████████  | 297557/371472 [1:30:49<5:59:39,  3.43it/s]
 80%|████████  | 297558/371472 [1:30:49<5:48:20,  3.54it/s]
 80%|████████  | 297559/371472 [1:30:49<5:41:52,  3.60it/s]
 80%|████████  | 297560/371472 [1:30:50<5:54:11,  3.48it/s]
                                                           
{'loss': 2.5926, 'learning_rate': 2.7916998857980135e-07, 'epoch': 12.82}

 80%|████████  | 297560/371472 [1:30:50<5:54:11,  3.48it/s]
 80%|████████  | 297561/371472 [1:30:50<6:16:21,  3.27it/s]
 80%|████████  | 297562/371472 [1:30:50<6:29:22,  3.16it/s]
 80%|████████  | 297563/371472 [1:30:51<6:19:19,  3.25it/s]
 80%|████████  | 297564/371472 [1:30:51<6:22:10,  3.22it/s]
 80%|████████  | 297565/371472 [1:30:51<6:14:29,  3.29it/s]
 80%|████████  | 297566/371472 [1:30:52<6:15:14,  3.28it/s]
 80%|████████  | 297567/371472 [1:30:52<6:05:48,  3.37it/s]
 80%|████████  | 297568/371472 [1:30:52<5:50:52,  3.51it/s]
 80%|████████  | 297569/371472 [1:30:53<5:57:42,  3.44it/s]
 80%|████████  | 297570/371472 [1:30:53<5:50:11,  3.52it/s]
 80%|████████  | 297571/371472 [1:30:53<5:54:24,  3.48it/s]
 80%|████████  | 297572/371472 [1:30:53<5:52:18,  3.50it/s]
 80%|████████  | 297573/371472 [1:30:54<5:45:37,  3.56it/s]
 80%|████████  | 297574/371472 [1:30:54<5:52:52,  3.49it/s]
 80%|████████  | 297575/371472 [1:30:54<5:34:59,  3.68it/s]
 80%|████████  | 297576/371472 [1:30:54<5:29:48,  3.73it/s]
 80%|████████  | 297577/371472 [1:30:55<5:42:40,  3.59it/s]
 80%|████████  | 297578/371472 [1:30:55<5:54:02,  3.48it/s]
 80%|████████  | 297579/371472 [1:30:55<5:59:37,  3.42it/s]
 80%|████████  | 297580/371472 [1:30:56<5:46:09,  3.56it/s]
                                                           
{'loss': 2.6568, 'learning_rate': 2.7912150660432236e-07, 'epoch': 12.82}

 80%|████████  | 297580/371472 [1:30:56<5:46:09,  3.56it/s]
 80%|████████  | 297581/371472 [1:30:56<5:38:05,  3.64it/s]
 80%|████████  | 297582/371472 [1:30:56<5:49:41,  3.52it/s]
 80%|████████  | 297583/371472 [1:30:56<5:50:16,  3.52it/s]
 80%|████████  | 297584/371472 [1:30:57<5:47:08,  3.55it/s]
 80%|████████  | 297585/371472 [1:30:57<5:41:53,  3.60it/s]
 80%|████████  | 297586/371472 [1:30:57<5:50:43,  3.51it/s]
 80%|████████  | 297587/371472 [1:30:58<5:46:59,  3.55it/s]
 80%|████████  | 297588/371472 [1:30:58<5:42:06,  3.60it/s]
 80%|████████  | 297589/371472 [1:30:58<5:41:57,  3.60it/s]
 80%|████████  | 297590/371472 [1:30:58<5:31:55,  3.71it/s]
 80%|████████  | 297591/371472 [1:30:59<5:33:30,  3.69it/s]
 80%|████████  | 297592/371472 [1:30:59<5:47:06,  3.55it/s]
 80%|████████  | 297593/371472 [1:30:59<5:49:26,  3.52it/s]
 80%|████████  | 297594/371472 [1:31:00<5:46:16,  3.56it/s]
 80%|████████  | 297595/371472 [1:31:00<5:43:56,  3.58it/s]
 80%|████████  | 297596/371472 [1:31:00<5:42:03,  3.60it/s]
 80%|████████  | 297597/371472 [1:31:00<6:25:42,  3.19it/s]
 80%|████████  | 297598/371472 [1:31:01<6:11:37,  3.31it/s]
 80%|████████  | 297599/371472 [1:31:01<6:06:56,  3.36it/s]
 80%|████████  | 297600/371472 [1:31:01<5:53:54,  3.48it/s]
                                                           
{'loss': 2.811, 'learning_rate': 2.7907302462884354e-07, 'epoch': 12.82}

 80%|████████  | 297600/371472 [1:31:01<5:53:54,  3.48it/s]
 80%|████████  | 297601/371472 [1:31:02<6:13:06,  3.30it/s]
 80%|████████  | 297602/371472 [1:31:02<5:59:24,  3.43it/s]
 80%|████████  | 297603/371472 [1:31:02<6:05:42,  3.37it/s]
 80%|████████  | 297604/371472 [1:31:02<6:02:32,  3.40it/s]
 80%|████████  | 297605/371472 [1:31:03<5:52:09,  3.50it/s]
 80%|████████  | 297606/371472 [1:31:03<5:47:51,  3.54it/s]
 80%|████████  | 297607/371472 [1:31:03<5:53:01,  3.49it/s]
 80%|████████  | 297608/371472 [1:31:04<6:08:53,  3.34it/s]
 80%|████████  | 297609/371472 [1:31:04<6:12:20,  3.31it/s]
 80%|████████  | 297610/371472 [1:31:04<6:03:16,  3.39it/s]
 80%|████████  | 297611/371472 [1:31:05<6:12:20,  3.31it/s]
 80%|████████  | 297612/371472 [1:31:05<5:54:25,  3.47it/s]
 80%|████████  | 297613/371472 [1:31:05<6:12:30,  3.30it/s]
 80%|████████  | 297614/371472 [1:31:06<6:32:07,  3.14it/s]
 80%|████████  | 297615/371472 [1:31:06<6:24:49,  3.20it/s]
 80%|████████  | 297616/371472 [1:31:06<6:19:47,  3.24it/s]
 80%|████████  | 297617/371472 [1:31:06<6:22:12,  3.22it/s]
 80%|████████  | 297618/371472 [1:31:07<6:08:39,  3.34it/s]
 80%|████████  | 297619/371472 [1:31:07<6:02:17,  3.40it/s]
 80%|████████  | 297620/371472 [1:31:07<5:51:03,  3.51it/s]
                                                           
{'loss': 2.4933, 'learning_rate': 2.7902454265336456e-07, 'epoch': 12.82}

 80%|████████  | 297620/371472 [1:31:07<5:51:03,  3.51it/s]
 80%|████████  | 297621/371472 [1:31:08<6:23:47,  3.21it/s]
 80%|████████  | 297622/371472 [1:31:08<6:02:05,  3.40it/s]
 80%|████████  | 297623/371472 [1:31:08<6:04:05,  3.38it/s]
 80%|████████  | 297624/371472 [1:31:09<6:15:05,  3.28it/s]
 80%|████████  | 297625/371472 [1:31:09<6:03:19,  3.39it/s]
 80%|████████  | 297626/371472 [1:31:09<5:56:53,  3.45it/s]
 80%|████████  | 297627/371472 [1:31:09<5:44:27,  3.57it/s]
 80%|████████  | 297628/371472 [1:31:10<5:59:02,  3.43it/s]
 80%|████████  | 297629/371472 [1:31:10<6:21:08,  3.23it/s]
 80%|████████  | 297630/371472 [1:31:10<6:07:26,  3.35it/s]
 80%|████████  | 297631/371472 [1:31:11<5:59:56,  3.42it/s]
 80%|████████  | 297632/371472 [1:31:11<6:02:53,  3.39it/s]
 80%|████████  | 297633/371472 [1:31:11<5:53:51,  3.48it/s]
 80%|████████  | 297634/371472 [1:31:11<6:06:48,  3.35it/s]
 80%|████████  | 297635/371472 [1:31:12<5:53:55,  3.48it/s]
 80%|████████  | 297636/371472 [1:31:12<5:56:22,  3.45it/s]
 80%|████████  | 297637/371472 [1:31:12<5:56:21,  3.45it/s]
 80%|████████  | 297638/371472 [1:31:13<6:06:53,  3.35it/s]
 80%|████████  | 297639/371472 [1:31:13<6:27:17,  3.18it/s]
 80%|████████  | 297640/371472 [1:31:13<6:11:47,  3.31it/s]
                                                           
{'loss': 2.6083, 'learning_rate': 2.7897606067788574e-07, 'epoch': 12.82}

 80%|████████  | 297640/371472 [1:31:13<6:11:47,  3.31it/s]
 80%|████████  | 297641/371472 [1:31:13<5:56:59,  3.45it/s]
 80%|████████  | 297642/371472 [1:31:14<5:56:42,  3.45it/s]
 80%|████████  | 297643/371472 [1:31:14<6:11:33,  3.31it/s]
 80%|████████  | 297644/371472 [1:31:14<5:53:44,  3.48it/s]
 80%|████████  | 297645/371472 [1:31:15<6:33:34,  3.13it/s]
 80%|████████  | 297646/371472 [1:31:15<6:14:57,  3.28it/s]
 80%|████████  | 297647/371472 [1:31:15<6:04:09,  3.38it/s]
 80%|████████  | 297648/371472 [1:31:16<6:00:10,  3.42it/s]
 80%|████████  | 297649/371472 [1:31:16<6:07:08,  3.35it/s]
 80%|████████  | 297650/371472 [1:31:16<6:01:05,  3.41it/s]
 80%|████████  | 297651/371472 [1:31:16<5:47:26,  3.54it/s]
 80%|████████  | 297652/371472 [1:31:17<6:03:35,  3.38it/s]
 80%|████████  | 297653/371472 [1:31:17<5:55:37,  3.46it/s]
 80%|████████  | 297654/371472 [1:31:17<6:06:11,  3.36it/s]
 80%|████████  | 297655/371472 [1:31:18<6:00:43,  3.41it/s]
 80%|████████  | 297656/371472 [1:31:18<6:03:47,  3.38it/s]
 80%|████████  | 297657/371472 [1:31:18<5:55:33,  3.46it/s]
 80%|████████  | 297658/371472 [1:31:19<6:00:26,  3.41it/s]
 80%|████████  | 297659/371472 [1:31:19<5:56:19,  3.45it/s]
 80%|████████  | 297660/371472 [1:31:19<6:03:13,  3.39it/s]
                                                           
{'loss': 2.5614, 'learning_rate': 2.789275787024068e-07, 'epoch': 12.82}

 80%|████████  | 297660/371472 [1:31:19<6:03:13,  3.39it/s]
 80%|████████  | 297661/371472 [1:31:19<6:07:12,  3.35it/s]
 80%|████████  | 297662/371472 [1:31:20<6:04:22,  3.38it/s]
 80%|████████  | 297663/371472 [1:31:20<5:48:30,  3.53it/s]
 80%|████████  | 297664/371472 [1:31:20<6:03:20,  3.39it/s]
 80%|████████  | 297665/371472 [1:31:21<5:50:04,  3.51it/s]
 80%|████████  | 297666/371472 [1:31:21<5:46:19,  3.55it/s]
 80%|████████  | 297667/371472 [1:31:21<5:59:17,  3.42it/s]
 80%|████████  | 297668/371472 [1:31:21<5:54:38,  3.47it/s]
 80%|████████  | 297669/371472 [1:31:22<5:48:04,  3.53it/s]
 80%|████████  | 297670/371472 [1:31:22<5:45:31,  3.56it/s]
 80%|████████  | 297671/371472 [1:31:22<5:40:22,  3.61it/s]
 80%|████████  | 297672/371472 [1:31:23<6:07:34,  3.35it/s]
 80%|████████  | 297673/371472 [1:31:23<6:11:14,  3.31it/s]
 80%|████████  | 297674/371472 [1:31:23<6:04:50,  3.37it/s]
 80%|████████  | 297675/371472 [1:31:23<6:19:19,  3.24it/s]
 80%|████████  | 297676/371472 [1:31:24<6:09:49,  3.33it/s]
 80%|████████  | 297677/371472 [1:31:24<5:54:12,  3.47it/s]
 80%|████████  | 297678/371472 [1:31:24<5:47:00,  3.54it/s]
 80%|████████  | 297679/371472 [1:31:25<5:41:22,  3.60it/s]
 80%|████████  | 297680/371472 [1:31:25<5:38:32,  3.63it/s]
                                                           
{'loss': 2.5322, 'learning_rate': 2.78879096726928e-07, 'epoch': 12.82}

 80%|████████  | 297680/371472 [1:31:25<5:38:32,  3.63it/s]
 80%|████████  | 297681/371472 [1:31:25<5:39:13,  3.63it/s]
 80%|████████  | 297682/371472 [1:31:26<6:33:22,  3.13it/s]
 80%|████████  | 297683/371472 [1:31:26<6:13:25,  3.29it/s]
 80%|████████  | 297684/371472 [1:31:26<6:06:16,  3.36it/s]
 80%|████████  | 297685/371472 [1:31:26<5:56:11,  3.45it/s]
 80%|████████  | 297686/371472 [1:31:27<5:53:21,  3.48it/s]
 80%|████████  | 297687/371472 [1:31:27<5:46:09,  3.55it/s]
 80%|████████  | 297688/371472 [1:31:27<5:43:37,  3.58it/s]
 80%|████████  | 297689/371472 [1:31:27<5:57:53,  3.44it/s]
 80%|████████  | 297690/371472 [1:31:28<5:50:22,  3.51it/s]
 80%|████████  | 297691/371472 [1:31:28<5:57:40,  3.44it/s]
 80%|████████  | 297692/371472 [1:31:28<6:16:26,  3.27it/s]
 80%|████████  | 297693/371472 [1:31:29<5:57:01,  3.44it/s]
 80%|████████  | 297694/371472 [1:31:29<5:56:52,  3.45it/s]
 80%|████████  | 297695/371472 [1:31:29<6:06:42,  3.35it/s]
 80%|████████  | 297696/371472 [1:31:30<6:07:32,  3.35it/s]
 80%|████████  | 297697/371472 [1:31:30<6:08:51,  3.33it/s]
 80%|████████  | 297698/371472 [1:31:30<6:30:18,  3.15it/s]
 80%|████████  | 297699/371472 [1:31:30<6:04:37,  3.37it/s]
 80%|████████  | 297700/371472 [1:31:31<5:52:14,  3.49it/s]
                                                           
{'loss': 2.5783, 'learning_rate': 2.7883061475144906e-07, 'epoch': 12.82}

 80%|████████  | 297700/371472 [1:31:31<5:52:14,  3.49it/s]
 80%|████████  | 297701/371472 [1:31:31<5:52:10,  3.49it/s]
 80%|████████  | 297702/371472 [1:31:31<6:02:17,  3.39it/s]
 80%|████████  | 297703/371472 [1:31:32<6:10:16,  3.32it/s]
 80%|████████  | 297704/371472 [1:31:32<6:09:49,  3.32it/s]
 80%|████████  | 297705/371472 [1:31:32<6:04:08,  3.38it/s]
 80%|████████  | 297706/371472 [1:31:33<6:20:51,  3.23it/s]
 80%|████████  | 297707/371472 [1:31:33<6:04:44,  3.37it/s]
 80%|████████  | 297708/371472 [1:31:33<5:54:06,  3.47it/s]
 80%|████████  | 297709/371472 [1:31:33<5:43:15,  3.58it/s]
 80%|████████  | 297710/371472 [1:31:34<5:40:52,  3.61it/s]
 80%|████████  | 297711/371472 [1:31:34<5:39:11,  3.62it/s]
 80%|████████  | 297712/371472 [1:31:34<6:06:28,  3.35it/s]
 80%|████████  | 297713/371472 [1:31:35<6:12:28,  3.30it/s]
 80%|████████  | 297714/371472 [1:31:35<5:58:33,  3.43it/s]
 80%|████████  | 297715/371472 [1:31:35<5:53:59,  3.47it/s]
 80%|████████  | 297716/371472 [1:31:35<5:44:56,  3.56it/s]
 80%|████████  | 297717/371472 [1:31:36<5:53:54,  3.47it/s]
 80%|████████  | 297718/371472 [1:31:36<6:02:00,  3.40it/s]
 80%|████████  | 297719/371472 [1:31:36<5:56:18,  3.45it/s]
 80%|████████  | 297720/371472 [1:31:37<5:56:21,  3.45it/s]
                                                           
{'loss': 2.5832, 'learning_rate': 2.787821327759702e-07, 'epoch': 12.82}

 80%|████████  | 297720/371472 [1:31:37<5:56:21,  3.45it/s]
 80%|████████  | 297721/371472 [1:31:37<6:10:20,  3.32it/s]
 80%|████████  | 297722/371472 [1:31:37<6:14:30,  3.28it/s]
 80%|████████  | 297723/371472 [1:31:38<6:40:07,  3.07it/s]
 80%|████████  | 297724/371472 [1:31:38<6:20:47,  3.23it/s]
 80%|████████  | 297725/371472 [1:31:38<6:11:20,  3.31it/s]
 80%|████████  | 297726/371472 [1:31:38<5:58:48,  3.43it/s]
 80%|████████  | 297727/371472 [1:31:39<5:50:52,  3.50it/s]
 80%|████████  | 297728/371472 [1:31:39<5:45:04,  3.56it/s]
 80%|████████  | 297729/371472 [1:31:39<5:46:10,  3.55it/s]
 80%|████████  | 297730/371472 [1:31:40<6:02:37,  3.39it/s]
 80%|████████  | 297731/371472 [1:31:40<6:02:42,  3.39it/s]
 80%|████████  | 297732/371472 [1:31:40<6:02:12,  3.39it/s]
 80%|████████  | 297733/371472 [1:31:40<5:51:56,  3.49it/s]
 80%|████████  | 297734/371472 [1:31:41<5:58:28,  3.43it/s]
 80%|████████  | 297735/371472 [1:31:41<5:55:50,  3.45it/s]
 80%|████████  | 297736/371472 [1:31:41<5:36:51,  3.65it/s]
 80%|████████  | 297737/371472 [1:31:42<5:36:48,  3.65it/s]
 80%|████████  | 297738/371472 [1:31:42<5:49:10,  3.52it/s]
 80%|████████  | 297739/371472 [1:31:42<6:16:04,  3.27it/s]
 80%|████████  | 297740/371472 [1:31:42<6:08:42,  3.33it/s]
                                                           
{'loss': 2.6054, 'learning_rate': 2.787336508004912e-07, 'epoch': 12.82}

 80%|████████  | 297740/371472 [1:31:42<6:08:42,  3.33it/s]
 80%|████████  | 297741/371472 [1:31:43<6:24:56,  3.19it/s]
 80%|████████  | 297742/371472 [1:31:43<6:10:44,  3.31it/s]
 80%|████████  | 297743/371472 [1:31:43<5:56:07,  3.45it/s]
 80%|████████  | 297744/371472 [1:31:44<5:49:54,  3.51it/s]
 80%|████████  | 297745/371472 [1:31:44<5:50:05,  3.51it/s]
 80%|████████  | 297746/371472 [1:31:44<5:55:49,  3.45it/s]
 80%|████████  | 297747/371472 [1:31:44<5:47:29,  3.54it/s]
 80%|████████  | 297748/371472 [1:31:45<5:47:40,  3.53it/s]
 80%|████████  | 297749/371472 [1:31:45<5:53:13,  3.48it/s]
 80%|████████  | 297750/371472 [1:31:45<5:40:06,  3.61it/s]
 80%|████████  | 297751/371472 [1:31:46<5:40:10,  3.61it/s]
 80%|████████  | 297752/371472 [1:31:46<5:41:53,  3.59it/s]
 80%|████████  | 297753/371472 [1:31:46<6:14:22,  3.28it/s]
 80%|████████  | 297754/371472 [1:31:47<6:21:40,  3.22it/s]
 80%|████████  | 297755/371472 [1:31:47<6:12:06,  3.30it/s]
 80%|████████  | 297756/371472 [1:31:47<5:49:09,  3.52it/s]
 80%|████████  | 297757/371472 [1:31:47<5:56:12,  3.45it/s]
 80%|████████  | 297758/371472 [1:31:48<5:56:58,  3.44it/s]
 80%|████████  | 297759/371472 [1:31:48<6:01:16,  3.40it/s]
 80%|████████  | 297760/371472 [1:31:48<5:57:43,  3.43it/s]
                                                           
{'loss': 2.5139, 'learning_rate': 2.786851688250124e-07, 'epoch': 12.83}

 80%|████████  | 297760/371472 [1:31:48<5:57:43,  3.43it/s]
 80%|████████  | 297761/371472 [1:31:49<6:16:15,  3.27it/s]
 80%|████████  | 297762/371472 [1:31:49<6:07:11,  3.35it/s]
 80%|████████  | 297763/371472 [1:31:49<6:18:21,  3.25it/s]
 80%|████████  | 297764/371472 [1:31:50<6:09:39,  3.32it/s]
 80%|████████  | 297765/371472 [1:31:50<5:52:52,  3.48it/s]
 80%|████████  | 297766/371472 [1:31:50<5:50:52,  3.50it/s]
 80%|████████  | 297767/371472 [1:31:50<5:50:03,  3.51it/s]
 80%|████████  | 297768/371472 [1:31:51<5:55:08,  3.46it/s]
 80%|████████  | 297769/371472 [1:31:51<5:51:17,  3.50it/s]
 80%|████████  | 297770/371472 [1:31:51<5:44:46,  3.56it/s]
 80%|████████  | 297771/371472 [1:31:52<6:10:28,  3.32it/s]
 80%|████████  | 297772/371472 [1:31:52<5:59:04,  3.42it/s]
 80%|████████  | 297773/371472 [1:31:52<5:47:11,  3.54it/s]
 80%|████████  | 297774/371472 [1:31:52<5:45:23,  3.56it/s]
 80%|████████  | 297775/371472 [1:31:53<5:36:06,  3.65it/s]
 80%|████████  | 297776/371472 [1:31:53<5:36:01,  3.66it/s]
 80%|████████  | 297777/371472 [1:31:53<5:35:08,  3.66it/s]
 80%|████████  | 297778/371472 [1:31:53<5:28:52,  3.73it/s]
 80%|████████  | 297779/371472 [1:31:54<5:23:41,  3.79it/s]
 80%|████████  | 297780/371472 [1:31:54<6:03:30,  3.38it/s]
                                                           
{'loss': 2.5547, 'learning_rate': 2.7863668684953345e-07, 'epoch': 12.83}

 80%|████████  | 297780/371472 [1:31:54<6:03:30,  3.38it/s]
 80%|████████  | 297781/371472 [1:31:54<5:54:30,  3.46it/s]
 80%|████████  | 297782/371472 [1:31:55<5:42:22,  3.59it/s]
 80%|████████  | 297783/371472 [1:31:55<5:31:12,  3.71it/s]
 80%|████████  | 297784/371472 [1:31:55<5:23:39,  3.79it/s]
 80%|████████  | 297785/371472 [1:31:55<5:37:18,  3.64it/s]
 80%|████████  | 297786/371472 [1:31:56<5:31:33,  3.70it/s]
 80%|████████  | 297787/371472 [1:31:56<5:32:29,  3.69it/s]
 80%|████████  | 297788/371472 [1:31:56<5:45:42,  3.55it/s]
 80%|████████  | 297789/371472 [1:31:56<5:39:56,  3.61it/s]
 80%|████████  | 297790/371472 [1:31:57<5:54:26,  3.46it/s]
 80%|████████  | 297791/371472 [1:31:57<5:39:55,  3.61it/s]
 80%|████████  | 297792/371472 [1:31:57<5:36:03,  3.65it/s]
 80%|████████  | 297793/371472 [1:31:58<5:37:27,  3.64it/s]
 80%|████████  | 297794/371472 [1:31:58<5:54:20,  3.47it/s]
 80%|████████  | 297795/371472 [1:31:58<5:51:58,  3.49it/s]
 80%|████████  | 297796/371472 [1:31:58<5:59:43,  3.41it/s]
 80%|████████  | 297797/371472 [1:31:59<6:03:34,  3.38it/s]
 80%|████████  | 297798/371472 [1:31:59<6:32:37,  3.13it/s]
 80%|████████  | 297799/371472 [1:31:59<6:24:41,  3.19it/s]
 80%|████████  | 297800/371472 [1:32:00<6:10:41,  3.31it/s]
                                                           
{'loss': 2.5324, 'learning_rate': 2.785882048740546e-07, 'epoch': 12.83}

 80%|████████  | 297800/371472 [1:32:00<6:10:41,  3.31it/s]
 80%|████████  | 297801/371472 [1:32:00<6:04:55,  3.36it/s]
 80%|████████  | 297802/371472 [1:32:00<5:51:16,  3.50it/s]
 80%|████████  | 297803/371472 [1:32:01<5:47:33,  3.53it/s]
 80%|████████  | 297804/371472 [1:32:01<5:43:56,  3.57it/s]
 80%|████████  | 297805/371472 [1:32:01<5:33:36,  3.68it/s]
 80%|████████  | 297806/371472 [1:32:01<5:28:29,  3.74it/s]
 80%|████████  | 297807/371472 [1:32:02<5:45:16,  3.56it/s]
 80%|████████  | 297808/371472 [1:32:02<5:54:59,  3.46it/s]
 80%|████████  | 297809/371472 [1:32:02<5:56:34,  3.44it/s]
 80%|████████  | 297810/371472 [1:32:03<5:45:10,  3.56it/s]
 80%|████████  | 297811/371472 [1:32:03<5:36:16,  3.65it/s]
 80%|████████  | 297812/371472 [1:32:03<5:47:54,  3.53it/s]
 80%|████████  | 297813/371472 [1:32:03<5:48:00,  3.53it/s]
 80%|████████  | 297814/371472 [1:32:04<5:50:51,  3.50it/s]
 80%|████████  | 297815/371472 [1:32:04<6:21:04,  3.22it/s]
 80%|████████  | 297816/371472 [1:32:04<6:24:18,  3.19it/s]
 80%|████████  | 297817/371472 [1:32:05<6:11:53,  3.30it/s]
 80%|████████  | 297818/371472 [1:32:05<6:00:01,  3.41it/s]
 80%|████████  | 297819/371472 [1:32:05<5:47:25,  3.53it/s]
 80%|████████  | 297820/371472 [1:32:05<5:52:10,  3.49it/s]
                                                           
{'loss': 2.61, 'learning_rate': 2.785397228985757e-07, 'epoch': 12.83}

 80%|████████  | 297820/371472 [1:32:05<5:52:10,  3.49it/s]
 80%|████████  | 297821/371472 [1:32:06<5:45:27,  3.55it/s]
 80%|████████  | 297822/371472 [1:32:06<7:31:27,  2.72it/s]
 80%|████████  | 297823/371472 [1:32:07<6:58:27,  2.93it/s]
 80%|████████  | 297824/371472 [1:32:07<6:35:15,  3.11it/s]
 80%|████████  | 297825/371472 [1:32:07<6:20:22,  3.23it/s]
 80%|████████  | 297826/371472 [1:32:07<6:08:58,  3.33it/s]
 80%|████████  | 297827/371472 [1:32:08<5:53:26,  3.47it/s]
 80%|████████  | 297828/371472 [1:32:08<5:48:10,  3.53it/s]
 80%|████████  | 297829/371472 [1:32:08<5:34:45,  3.67it/s]
 80%|████████  | 297830/371472 [1:32:08<5:40:25,  3.61it/s]
 80%|████████  | 297831/371472 [1:32:09<5:46:00,  3.55it/s]
 80%|████████  | 297832/371472 [1:32:09<5:54:25,  3.46it/s]
 80%|████████  | 297833/371472 [1:32:09<6:07:35,  3.34it/s]
 80%|████████  | 297834/371472 [1:32:10<5:54:44,  3.46it/s]
 80%|████████  | 297835/371472 [1:32:10<6:03:40,  3.37it/s]
 80%|████████  | 297836/371472 [1:32:10<6:06:47,  3.35it/s]
 80%|████████  | 297837/371472 [1:32:11<6:20:39,  3.22it/s]
 80%|████████  | 297838/371472 [1:32:11<6:04:24,  3.37it/s]
 80%|████████  | 297839/371472 [1:32:11<6:00:57,  3.40it/s]
 80%|████████  | 297840/371472 [1:32:11<5:56:48,  3.44it/s]
                                                           
{'loss': 2.6532, 'learning_rate': 2.784912409230968e-07, 'epoch': 12.83}

 80%|████████  | 297840/371472 [1:32:11<5:56:48,  3.44it/s]
 80%|████████  | 297841/371472 [1:32:12<6:02:50,  3.38it/s]
 80%|████████  | 297842/371472 [1:32:12<6:05:33,  3.36it/s]
 80%|████████  | 297843/371472 [1:32:12<6:20:34,  3.22it/s]
 80%|████████  | 297844/371472 [1:32:13<6:14:55,  3.27it/s]
 80%|████████  | 297845/371472 [1:32:13<6:08:20,  3.33it/s]
 80%|████████  | 297846/371472 [1:32:13<5:47:12,  3.53it/s]
 80%|████████  | 297847/371472 [1:32:14<5:55:50,  3.45it/s]
 80%|████████  | 297848/371472 [1:32:14<5:38:16,  3.63it/s]
 80%|████████  | 297849/371472 [1:32:14<5:43:04,  3.58it/s]
 80%|████████  | 297850/371472 [1:32:14<5:34:41,  3.67it/s]
 80%|████████  | 297851/371472 [1:32:15<5:32:30,  3.69it/s]
 80%|████████  | 297852/371472 [1:32:15<5:35:28,  3.66it/s]
 80%|████████  | 297853/371472 [1:32:15<5:39:24,  3.62it/s]
 80%|████████  | 297854/371472 [1:32:15<5:50:16,  3.50it/s]
 80%|████████  | 297855/371472 [1:32:16<6:03:38,  3.37it/s]
 80%|████████  | 297856/371472 [1:32:16<5:56:10,  3.44it/s]
 80%|████████  | 297857/371472 [1:32:16<5:54:13,  3.46it/s]
 80%|████████  | 297858/371472 [1:32:17<6:04:10,  3.37it/s]
 80%|████████  | 297859/371472 [1:32:17<6:26:42,  3.17it/s]
 80%|████████  | 297860/371472 [1:32:17<7:34:36,  2.70it/s]
                                                           
{'loss': 2.6585, 'learning_rate': 2.784427589476179e-07, 'epoch': 12.83}

 80%|████████  | 297860/371472 [1:32:17<7:34:36,  2.70it/s]
 80%|████████  | 297861/371472 [1:32:18<6:54:09,  2.96it/s]
 80%|████████  | 297862/371472 [1:32:18<6:27:55,  3.16it/s]
 80%|████████  | 297863/371472 [1:32:18<6:06:17,  3.35it/s]
 80%|████████  | 297864/371472 [1:32:19<6:03:31,  3.37it/s]
 80%|████████  | 297865/371472 [1:32:19<5:56:30,  3.44it/s]
 80%|████████  | 297866/371472 [1:32:19<5:43:25,  3.57it/s]
 80%|████████  | 297867/371472 [1:32:19<5:41:16,  3.59it/s]
 80%|████████  | 297868/371472 [1:32:20<5:47:40,  3.53it/s]
 80%|████████  | 297869/371472 [1:32:20<6:34:30,  3.11it/s]
 80%|████████  | 297870/371472 [1:32:20<6:15:47,  3.26it/s]
 80%|████████  | 297871/371472 [1:32:21<5:52:52,  3.48it/s]
 80%|████████  | 297872/371472 [1:32:21<5:51:22,  3.49it/s]
 80%|████████  | 297873/371472 [1:32:21<5:51:11,  3.49it/s]
 80%|████████  | 297874/371472 [1:32:21<5:37:09,  3.64it/s]
 80%|████████  | 297875/371472 [1:32:22<5:31:28,  3.70it/s]
 80%|████████  | 297876/371472 [1:32:22<5:23:45,  3.79it/s]
 80%|████████  | 297877/371472 [1:32:22<5:26:55,  3.75it/s]
 80%|████████  | 297878/371472 [1:32:22<5:24:43,  3.78it/s]
 80%|████████  | 297879/371472 [1:32:23<5:19:47,  3.84it/s]
 80%|████████  | 297880/371472 [1:32:23<5:33:36,  3.68it/s]
                                                           
{'loss': 2.5425, 'learning_rate': 2.78394276972139e-07, 'epoch': 12.83}

 80%|████████  | 297880/371472 [1:32:23<5:33:36,  3.68it/s]
 80%|████████  | 297881/371472 [1:32:23<5:58:40,  3.42it/s]
 80%|████████  | 297882/371472 [1:32:24<6:02:29,  3.38it/s]
 80%|████████  | 297883/371472 [1:32:24<6:08:47,  3.33it/s]
 80%|████████  | 297884/371472 [1:32:24<5:47:39,  3.53it/s]
 80%|████████  | 297885/371472 [1:32:24<5:50:25,  3.50it/s]
 80%|████████  | 297886/371472 [1:32:25<5:59:56,  3.41it/s]
 80%|████████  | 297887/371472 [1:32:25<5:53:23,  3.47it/s]
 80%|████████  | 297888/371472 [1:32:25<5:48:20,  3.52it/s]
 80%|████████  | 297889/371472 [1:32:26<5:37:59,  3.63it/s]
 80%|████████  | 297890/371472 [1:32:26<5:51:14,  3.49it/s]
 80%|████████  | 297891/371472 [1:32:26<5:54:14,  3.46it/s]
 80%|████████  | 297892/371472 [1:32:26<5:46:31,  3.54it/s]
 80%|████████  | 297893/371472 [1:32:27<5:56:36,  3.44it/s]
 80%|████████  | 297894/371472 [1:32:27<5:39:53,  3.61it/s]
 80%|████████  | 297895/371472 [1:32:27<5:27:56,  3.74it/s]
 80%|████████  | 297896/371472 [1:32:28<5:18:28,  3.85it/s]
 80%|████████  | 297897/371472 [1:32:28<5:23:13,  3.79it/s]
 80%|████████  | 297898/371472 [1:32:28<5:29:49,  3.72it/s]
 80%|████████  | 297899/371472 [1:32:28<5:27:56,  3.74it/s]
 80%|████████  | 297900/371472 [1:32:29<5:26:24,  3.76it/s]
                                                           
{'loss': 2.6938, 'learning_rate': 2.783457949966601e-07, 'epoch': 12.83}

 80%|████████  | 297900/371472 [1:32:29<5:26:24,  3.76it/s]
 80%|████████  | 297901/371472 [1:32:29<5:27:36,  3.74it/s]
 80%|████████  | 297902/371472 [1:32:29<5:15:14,  3.89it/s]
 80%|████████  | 297903/371472 [1:32:29<5:31:14,  3.70it/s]
 80%|████████  | 297904/371472 [1:32:30<5:35:06,  3.66it/s]
 80%|████████  | 297905/371472 [1:32:30<5:44:39,  3.56it/s]
 80%|████████  | 297906/371472 [1:32:30<5:51:56,  3.48it/s]
 80%|████████  | 297907/371472 [1:32:31<5:38:32,  3.62it/s]
 80%|████████  | 297908/371472 [1:32:31<5:32:54,  3.68it/s]
 80%|████████  | 297909/371472 [1:32:31<5:42:55,  3.58it/s]
 80%|████████  | 297910/371472 [1:32:31<5:38:09,  3.63it/s]
 80%|████████  | 297911/371472 [1:32:32<5:33:44,  3.67it/s]
 80%|████████  | 297912/371472 [1:32:32<5:27:02,  3.75it/s]
 80%|████████  | 297913/371472 [1:32:32<5:49:37,  3.51it/s]
 80%|████████  | 297914/371472 [1:32:33<5:48:33,  3.52it/s]
 80%|████████  | 297915/371472 [1:32:33<5:45:45,  3.55it/s]
 80%|████████  | 297916/371472 [1:32:33<6:02:53,  3.38it/s]
 80%|████████  | 297917/371472 [1:32:33<5:41:42,  3.59it/s]
 80%|████████  | 297918/371472 [1:32:34<6:18:13,  3.24it/s]
 80%|████████  | 297919/371472 [1:32:34<5:54:39,  3.46it/s]
 80%|████████  | 297920/371472 [1:32:34<5:48:11,  3.52it/s]
                                                           
{'loss': 2.7733, 'learning_rate': 2.7829731302118127e-07, 'epoch': 12.83}

 80%|████████  | 297920/371472 [1:32:34<5:48:11,  3.52it/s]
 80%|████████  | 297921/371472 [1:32:35<5:52:02,  3.48it/s]
 80%|████████  | 297922/371472 [1:32:35<5:54:46,  3.46it/s]
 80%|████████  | 297923/371472 [1:32:35<5:49:36,  3.51it/s]
 80%|████████  | 297924/371472 [1:32:35<5:35:51,  3.65it/s]
 80%|████████  | 297925/371472 [1:32:36<5:29:11,  3.72it/s]
 80%|████████  | 297926/371472 [1:32:36<5:22:04,  3.81it/s]
 80%|████████  | 297927/371472 [1:32:36<5:19:36,  3.84it/s]
 80%|████████  | 297928/371472 [1:32:36<5:24:30,  3.78it/s]
 80%|████████  | 297929/371472 [1:32:37<5:26:54,  3.75it/s]
 80%|████████  | 297930/371472 [1:32:37<5:22:06,  3.81it/s]
 80%|████████  | 297931/371472 [1:32:37<5:19:55,  3.83it/s]
 80%|████████  | 297932/371472 [1:32:38<6:01:29,  3.39it/s]
 80%|████████  | 297933/371472 [1:32:38<5:46:56,  3.53it/s]
 80%|████████  | 297934/371472 [1:32:38<5:51:31,  3.49it/s]
 80%|████████  | 297935/371472 [1:32:38<5:36:06,  3.65it/s]
 80%|████████  | 297936/371472 [1:32:39<5:52:42,  3.47it/s]
 80%|████████  | 297937/371472 [1:32:39<5:59:12,  3.41it/s]
 80%|████████  | 297938/371472 [1:32:39<5:55:25,  3.45it/s]
 80%|████████  | 297939/371472 [1:32:40<6:06:57,  3.34it/s]
 80%|████████  | 297940/371472 [1:32:40<6:06:42,  3.34it/s]
                                                           
{'loss': 2.5951, 'learning_rate': 2.7824883104570234e-07, 'epoch': 12.83}

 80%|████████  | 297940/371472 [1:32:40<6:06:42,  3.34it/s]
 80%|████████  | 297941/371472 [1:32:40<6:09:44,  3.31it/s]
 80%|████████  | 297942/371472 [1:32:40<5:45:28,  3.55it/s]
 80%|████████  | 297943/371472 [1:32:41<5:49:22,  3.51it/s]
 80%|████████  | 297944/371472 [1:32:41<5:50:11,  3.50it/s]
 80%|████████  | 297945/371472 [1:32:41<5:50:10,  3.50it/s]
 80%|████████  | 297946/371472 [1:32:42<6:13:22,  3.28it/s]
 80%|████████  | 297947/371472 [1:32:42<5:51:36,  3.49it/s]
 80%|████████  | 297948/371472 [1:32:42<6:05:34,  3.35it/s]
 80%|████████  | 297949/371472 [1:32:42<5:58:27,  3.42it/s]
 80%|████████  | 297950/371472 [1:32:43<5:48:20,  3.52it/s]
 80%|████████  | 297951/371472 [1:32:43<6:29:22,  3.15it/s]
 80%|████████  | 297952/371472 [1:32:43<6:08:38,  3.32it/s]
 80%|████████  | 297953/371472 [1:32:44<5:52:55,  3.47it/s]
 80%|████████  | 297954/371472 [1:32:44<5:52:33,  3.48it/s]
 80%|████████  | 297955/371472 [1:32:44<5:42:25,  3.58it/s]
 80%|████████  | 297956/371472 [1:32:44<5:48:47,  3.51it/s]
 80%|████████  | 297957/371472 [1:32:45<5:53:20,  3.47it/s]
 80%|████████  | 297958/371472 [1:32:45<6:06:48,  3.34it/s]
 80%|████████  | 297959/371472 [1:32:45<6:00:10,  3.40it/s]
 80%|████████  | 297960/371472 [1:32:46<5:52:15,  3.48it/s]
                                                           
{'loss': 2.7898, 'learning_rate': 2.7820034907022346e-07, 'epoch': 12.83}

 80%|████████  | 297960/371472 [1:32:46<5:52:15,  3.48it/s]
 80%|████████  | 297961/371472 [1:32:46<5:33:28,  3.67it/s]
 80%|████████  | 297962/371472 [1:32:46<5:33:45,  3.67it/s]
 80%|████████  | 297963/371472 [1:32:46<5:33:42,  3.67it/s]
 80%|████████  | 297964/371472 [1:32:47<5:32:57,  3.68it/s]
 80%|████████  | 297965/371472 [1:32:47<5:26:32,  3.75it/s]
 80%|████████  | 297966/371472 [1:32:47<5:25:55,  3.76it/s]
 80%|████████  | 297967/371472 [1:32:48<5:28:22,  3.73it/s]
 80%|████████  | 297968/371472 [1:32:48<5:41:33,  3.59it/s]
 80%|████████  | 297969/371472 [1:32:48<5:28:47,  3.73it/s]
 80%|████████  | 297970/371472 [1:32:48<5:40:57,  3.59it/s]
 80%|████████  | 297971/371472 [1:32:49<5:33:22,  3.67it/s]
 80%|████████  | 297972/371472 [1:32:49<5:24:06,  3.78it/s]
 80%|████████  | 297973/371472 [1:32:49<5:34:19,  3.66it/s]
 80%|████████  | 297974/371472 [1:32:49<5:29:17,  3.72it/s]
 80%|████████  | 297975/371472 [1:32:50<5:32:45,  3.68it/s]
 80%|████████  | 297976/371472 [1:32:50<5:35:27,  3.65it/s]
 80%|████████  | 297977/371472 [1:32:50<5:34:15,  3.66it/s]
 80%|████████  | 297978/371472 [1:32:50<5:19:52,  3.83it/s]
 80%|████████  | 297979/371472 [1:32:51<5:18:44,  3.84it/s]
 80%|████████  | 297980/371472 [1:32:51<5:35:01,  3.66it/s]
                                                           
{'loss': 2.7569, 'learning_rate': 2.7815186709474453e-07, 'epoch': 12.83}

 80%|████████  | 297980/371472 [1:32:51<5:35:01,  3.66it/s]
 80%|████████  | 297981/371472 [1:32:51<5:34:57,  3.66it/s]
 80%|████████  | 297982/371472 [1:32:52<5:44:50,  3.55it/s]
 80%|████████  | 297983/371472 [1:32:52<5:46:53,  3.53it/s]
 80%|████████  | 297984/371472 [1:32:52<5:56:34,  3.43it/s]
 80%|████████  | 297985/371472 [1:32:52<5:42:05,  3.58it/s]
 80%|████████  | 297986/371472 [1:32:53<5:39:35,  3.61it/s]
 80%|████████  | 297987/371472 [1:32:53<5:24:09,  3.78it/s]
 80%|████████  | 297988/371472 [1:32:53<5:20:16,  3.82it/s]
 80%|████████  | 297989/371472 [1:32:53<5:18:53,  3.84it/s]
 80%|████████  | 297990/371472 [1:32:54<5:21:23,  3.81it/s]
 80%|████████  | 297991/371472 [1:32:54<5:15:28,  3.88it/s]
 80%|████████  | 297992/371472 [1:32:54<5:51:13,  3.49it/s]
 80%|████████  | 297993/371472 [1:32:55<5:37:01,  3.63it/s]
 80%|████████  | 297994/371472 [1:32:55<5:30:03,  3.71it/s]
 80%|████████  | 297995/371472 [1:32:55<5:25:39,  3.76it/s]
 80%|████████  | 297996/371472 [1:32:55<5:28:18,  3.73it/s]
 80%|████████  | 297997/371472 [1:32:56<5:36:55,  3.63it/s]
 80%|████████  | 297998/371472 [1:32:56<5:36:56,  3.63it/s]
 80%|████████  | 297999/371472 [1:32:56<5:38:02,  3.62it/s]
 80%|████████  | 298000/371472 [1:32:57<5:53:08,  3.47it/s]
                                                           
{'loss': 2.6097, 'learning_rate': 2.7810338511926566e-07, 'epoch': 12.84}

 80%|████████  | 298000/371472 [1:32:57<5:53:08,  3.47it/s]
 80%|████████  | 298001/371472 [1:32:57<5:49:16,  3.51it/s]
 80%|████████  | 298002/371472 [1:32:57<5:41:57,  3.58it/s]
 80%|████████  | 298003/371472 [1:32:57<5:37:25,  3.63it/s]
 80%|████████  | 298004/371472 [1:32:58<5:39:17,  3.61it/s]
 80%|████████  | 298005/371472 [1:32:58<5:31:41,  3.69it/s]
 80%|████████  | 298006/371472 [1:32:58<5:26:19,  3.75it/s]
 80%|████████  | 298007/371472 [1:32:58<5:27:40,  3.74it/s]
 80%|████████  | 298008/371472 [1:32:59<5:29:02,  3.72it/s]
 80%|████████  | 298009/371472 [1:32:59<5:33:44,  3.67it/s]
 80%|████████  | 298010/371472 [1:32:59<6:02:35,  3.38it/s]
 80%|████████  | 298011/371472 [1:33:00<6:08:43,  3.32it/s]
 80%|████████  | 298012/371472 [1:33:00<6:01:16,  3.39it/s]
 80%|████████  | 298013/371472 [1:33:00<5:48:33,  3.51it/s]
 80%|████████  | 298014/371472 [1:33:01<6:00:03,  3.40it/s]
 80%|████████  | 298015/371472 [1:33:01<6:01:50,  3.38it/s]
 80%|████████  | 298016/371472 [1:33:01<5:45:57,  3.54it/s]
 80%|████████  | 298017/371472 [1:33:01<5:42:50,  3.57it/s]
 80%|████████  | 298018/371472 [1:33:02<5:49:12,  3.51it/s]
 80%|████████  | 298019/371472 [1:33:02<5:43:53,  3.56it/s]
 80%|████████  | 298020/371472 [1:33:02<5:41:43,  3.58it/s]
                                                           
{'loss': 2.6816, 'learning_rate': 2.7805490314378673e-07, 'epoch': 12.84}

 80%|████████  | 298020/371472 [1:33:02<5:41:43,  3.58it/s]
 80%|████████  | 298021/371472 [1:33:02<5:42:44,  3.57it/s]
 80%|████████  | 298022/371472 [1:33:03<5:28:22,  3.73it/s]
 80%|████████  | 298023/371472 [1:33:03<5:31:02,  3.70it/s]
 80%|████████  | 298024/371472 [1:33:03<5:28:38,  3.72it/s]
 80%|████████  | 298025/371472 [1:33:03<5:26:13,  3.75it/s]
 80%|████████  | 298026/371472 [1:33:04<5:21:42,  3.81it/s]
 80%|████████  | 298027/371472 [1:33:04<5:13:37,  3.90it/s]
 80%|████████  | 298028/371472 [1:33:04<5:36:57,  3.63it/s]
 80%|████████  | 298029/371472 [1:33:05<5:51:50,  3.48it/s]
 80%|████████  | 298030/371472 [1:33:05<5:43:30,  3.56it/s]
 80%|████████  | 298031/371472 [1:33:05<5:55:45,  3.44it/s]
 80%|████████  | 298032/371472 [1:33:05<5:46:18,  3.53it/s]
 80%|████████  | 298033/371472 [1:33:06<5:56:38,  3.43it/s]
 80%|████████  | 298034/371472 [1:33:06<5:47:55,  3.52it/s]
 80%|████████  | 298035/371472 [1:33:06<5:51:52,  3.48it/s]
 80%|████████  | 298036/371472 [1:33:07<6:13:32,  3.28it/s]
 80%|████████  | 298037/371472 [1:33:07<6:04:06,  3.36it/s]
 80%|████████  | 298038/371472 [1:33:07<5:53:42,  3.46it/s]
 80%|████████  | 298039/371472 [1:33:08<5:42:56,  3.57it/s]
 80%|████████  | 298040/371472 [1:33:08<5:33:48,  3.67it/s]
                                                           
{'loss': 2.6504, 'learning_rate': 2.780064211683079e-07, 'epoch': 12.84}

 80%|████████  | 298040/371472 [1:33:08<5:33:48,  3.67it/s]
 80%|████████  | 298041/371472 [1:33:08<5:53:56,  3.46it/s]
 80%|████████  | 298042/371472 [1:33:08<5:38:57,  3.61it/s]
 80%|████████  | 298043/371472 [1:33:09<5:52:03,  3.48it/s]
 80%|████████  | 298044/371472 [1:33:09<5:34:43,  3.66it/s]
 80%|████████  | 298045/371472 [1:33:09<5:45:42,  3.54it/s]
 80%|████████  | 298046/371472 [1:33:09<5:42:19,  3.57it/s]
 80%|████████  | 298047/371472 [1:33:10<6:02:52,  3.37it/s]
 80%|████████  | 298048/371472 [1:33:10<5:42:37,  3.57it/s]
 80%|████████  | 298049/371472 [1:33:10<5:31:11,  3.69it/s]
 80%|████████  | 298050/371472 [1:33:11<5:30:44,  3.70it/s]
 80%|████████  | 298051/371472 [1:33:11<5:28:24,  3.73it/s]
 80%|████████  | 298052/371472 [1:33:11<5:22:33,  3.79it/s]
 80%|████████  | 298053/371472 [1:33:11<6:20:59,  3.21it/s]
 80%|████████  | 298054/371472 [1:33:12<6:31:49,  3.12it/s]
 80%|████████  | 298055/371472 [1:33:12<6:25:06,  3.18it/s]
 80%|████████  | 298056/371472 [1:33:12<6:20:39,  3.21it/s]
 80%|████████  | 298057/371472 [1:33:13<6:17:21,  3.24it/s]
 80%|████████  | 298058/371472 [1:33:13<5:54:24,  3.45it/s]
 80%|████████  | 298059/371472 [1:33:13<5:35:24,  3.65it/s]
 80%|████████  | 298060/371472 [1:33:13<5:19:05,  3.83it/s]
                                                           
{'loss': 2.6471, 'learning_rate': 2.77957939192829e-07, 'epoch': 12.84}

 80%|████████  | 298060/371472 [1:33:13<5:19:05,  3.83it/s]
 80%|████████  | 298061/371472 [1:33:14<5:37:30,  3.63it/s]
 80%|████████  | 298062/371472 [1:33:14<5:29:45,  3.71it/s]
 80%|████████  | 298063/371472 [1:33:14<5:25:46,  3.76it/s]
 80%|████████  | 298064/371472 [1:33:15<5:45:09,  3.54it/s]
 80%|████████  | 298065/371472 [1:33:15<5:40:39,  3.59it/s]
 80%|████████  | 298066/371472 [1:33:15<5:51:14,  3.48it/s]
 80%|████████  | 298067/371472 [1:33:15<5:50:12,  3.49it/s]
 80%|████████  | 298068/371472 [1:33:16<5:42:56,  3.57it/s]
 80%|████████  | 298069/371472 [1:33:16<5:32:16,  3.68it/s]
 80%|████████  | 298070/371472 [1:33:16<6:06:12,  3.34it/s]
 80%|████████  | 298071/371472 [1:33:17<6:01:11,  3.39it/s]
 80%|████████  | 298072/371472 [1:33:17<6:00:55,  3.39it/s]
 80%|████████  | 298073/371472 [1:33:17<5:43:33,  3.56it/s]
 80%|████████  | 298074/371472 [1:33:17<5:38:11,  3.62it/s]
 80%|████████  | 298075/371472 [1:33:18<5:44:55,  3.55it/s]
 80%|████████  | 298076/371472 [1:33:18<5:50:56,  3.49it/s]
 80%|████████  | 298077/371472 [1:33:18<5:44:41,  3.55it/s]
 80%|████████  | 298078/371472 [1:33:19<5:56:37,  3.43it/s]
 80%|████████  | 298079/371472 [1:33:19<6:09:31,  3.31it/s]
 80%|████████  | 298080/371472 [1:33:19<6:05:35,  3.35it/s]
                                                           
{'loss': 2.5633, 'learning_rate': 2.7790945721735016e-07, 'epoch': 12.84}

 80%|████████  | 298080/371472 [1:33:19<6:05:35,  3.35it/s]
 80%|████████  | 298081/371472 [1:33:20<6:00:18,  3.39it/s]
 80%|████████  | 298082/371472 [1:33:20<5:45:06,  3.54it/s]
 80%|████████  | 298083/371472 [1:33:20<5:35:44,  3.64it/s]
 80%|████████  | 298084/371472 [1:33:20<5:32:50,  3.67it/s]
 80%|████████  | 298085/371472 [1:33:21<5:29:40,  3.71it/s]
 80%|████████  | 298086/371472 [1:33:21<5:35:28,  3.65it/s]
 80%|████████  | 298087/371472 [1:33:21<5:34:08,  3.66it/s]
 80%|████████  | 298088/371472 [1:33:21<5:27:07,  3.74it/s]
 80%|████████  | 298089/371472 [1:33:22<5:35:57,  3.64it/s]
 80%|████████  | 298090/371472 [1:33:22<5:35:12,  3.65it/s]
 80%|████████  | 298091/371472 [1:33:22<5:29:18,  3.71it/s]
 80%|████████  | 298092/371472 [1:33:22<5:28:54,  3.72it/s]
 80%|████████  | 298093/371472 [1:33:23<5:33:32,  3.67it/s]
 80%|████████  | 298094/371472 [1:33:23<5:34:17,  3.66it/s]
 80%|████████  | 298095/371472 [1:33:23<5:20:10,  3.82it/s]
 80%|████████  | 298096/371472 [1:33:24<5:17:55,  3.85it/s]
 80%|████████  | 298097/371472 [1:33:24<5:21:19,  3.81it/s]
 80%|████████  | 298098/371472 [1:33:24<5:23:30,  3.78it/s]
 80%|████████  | 298099/371472 [1:33:24<5:31:34,  3.69it/s]
 80%|████████  | 298100/371472 [1:33:25<6:02:17,  3.38it/s]
                                                           
{'loss': 2.9068, 'learning_rate': 2.778609752418712e-07, 'epoch': 12.84}

 80%|████████  | 298100/371472 [1:33:25<6:02:17,  3.38it/s]
 80%|████████  | 298101/371472 [1:33:25<5:53:08,  3.46it/s]
 80%|████████  | 298102/371472 [1:33:25<5:51:30,  3.48it/s]
 80%|████████  | 298103/371472 [1:33:25<5:31:57,  3.68it/s]
 80%|████████  | 298104/371472 [1:33:26<5:33:00,  3.67it/s]
 80%|████████  | 298105/371472 [1:33:26<5:42:02,  3.58it/s]
 80%|████████  | 298106/371472 [1:33:26<5:42:19,  3.57it/s]
 80%|████████  | 298107/371472 [1:33:27<5:42:48,  3.57it/s]
 80%|████████  | 298108/371472 [1:33:27<5:34:29,  3.66it/s]
 80%|████████  | 298109/371472 [1:33:27<5:36:00,  3.64it/s]
 80%|████████  | 298110/371472 [1:33:27<5:45:51,  3.54it/s]
 80%|████████  | 298111/371472 [1:33:28<5:39:30,  3.60it/s]
 80%|████████  | 298112/371472 [1:33:28<5:27:29,  3.73it/s]
 80%|████████  | 298113/371472 [1:33:28<5:21:27,  3.80it/s]
 80%|████████  | 298114/371472 [1:33:28<5:11:35,  3.92it/s]
 80%|████████  | 298115/371472 [1:33:29<5:21:36,  3.80it/s]
 80%|████████  | 298116/371472 [1:33:29<5:39:54,  3.60it/s]
 80%|████████  | 298117/371472 [1:33:29<5:36:19,  3.64it/s]
 80%|████████  | 298118/371472 [1:33:30<5:47:13,  3.52it/s]
 80%|████████  | 298119/371472 [1:33:30<5:37:58,  3.62it/s]
 80%|████████  | 298120/371472 [1:33:30<6:10:51,  3.30it/s]
                                                           
{'loss': 2.8216, 'learning_rate': 2.7781249326639214e-07, 'epoch': 12.84}

 80%|████████  | 298120/371472 [1:33:30<6:10:51,  3.30it/s]
 80%|████████  | 298121/371472 [1:33:31<6:01:16,  3.38it/s]
 80%|████████  | 298122/371472 [1:33:31<5:59:54,  3.40it/s]
 80%|████████  | 298123/371472 [1:33:31<5:50:15,  3.49it/s]
 80%|████████  | 298124/371472 [1:33:31<6:07:21,  3.33it/s]
 80%|████████  | 298125/371472 [1:33:32<6:07:04,  3.33it/s]
 80%|████████  | 298126/371472 [1:33:32<6:04:32,  3.35it/s]
 80%|████████  | 298127/371472 [1:33:32<5:57:57,  3.41it/s]
 80%|████████  | 298128/371472 [1:33:33<5:42:51,  3.57it/s]
 80%|████████  | 298129/371472 [1:33:33<5:33:19,  3.67it/s]
 80%|████████  | 298130/371472 [1:33:33<5:47:00,  3.52it/s]
 80%|████████  | 298131/371472 [1:33:33<5:49:39,  3.50it/s]
 80%|████████  | 298132/371472 [1:33:34<6:00:38,  3.39it/s]
 80%|████████  | 298133/371472 [1:33:34<5:45:43,  3.54it/s]
 80%|████████  | 298134/371472 [1:33:34<5:43:12,  3.56it/s]
 80%|████████  | 298135/371472 [1:33:35<5:39:42,  3.60it/s]
 80%|████████  | 298136/371472 [1:33:35<5:32:41,  3.67it/s]
 80%|████████  | 298137/371472 [1:33:35<5:29:24,  3.71it/s]
 80%|████████  | 298138/371472 [1:33:35<5:27:38,  3.73it/s]
 80%|████████  | 298139/371472 [1:33:36<5:59:45,  3.40it/s]
 80%|████████  | 298140/371472 [1:33:36<5:41:44,  3.58it/s]
                                                           
{'loss': 2.6191, 'learning_rate': 2.7776401129091337e-07, 'epoch': 12.84}

 80%|████████  | 298140/371472 [1:33:36<5:41:44,  3.58it/s]
 80%|████████  | 298141/371472 [1:33:36<5:52:08,  3.47it/s]
 80%|████████  | 298142/371472 [1:33:36<5:42:44,  3.57it/s]
 80%|████████  | 298143/371472 [1:33:37<5:51:50,  3.47it/s]
 80%|████████  | 298144/371472 [1:33:37<5:42:57,  3.56it/s]
 80%|████████  | 298145/371472 [1:33:37<5:44:02,  3.55it/s]
 80%|████████  | 298146/371472 [1:33:38<5:37:28,  3.62it/s]
 80%|████████  | 298147/371472 [1:33:38<5:37:33,  3.62it/s]
 80%|████████  | 298148/371472 [1:33:38<5:25:26,  3.76it/s]
 80%|████████  | 298149/371472 [1:33:38<5:17:43,  3.85it/s]
 80%|████████  | 298150/371472 [1:33:39<5:18:33,  3.84it/s]
 80%|████████  | 298151/371472 [1:33:39<5:26:18,  3.75it/s]
 80%|████████  | 298152/371472 [1:33:39<5:26:15,  3.75it/s]
 80%|████████  | 298153/371472 [1:33:39<5:33:21,  3.67it/s]
 80%|████████  | 298154/371472 [1:33:40<5:48:09,  3.51it/s]
 80%|████████  | 298155/371472 [1:33:40<5:50:04,  3.49it/s]
 80%|████████  | 298156/371472 [1:33:40<5:37:47,  3.62it/s]
 80%|████████  | 298157/371472 [1:33:41<5:28:33,  3.72it/s]
 80%|████████  | 298158/371472 [1:33:41<5:54:53,  3.44it/s]
 80%|████████  | 298159/371472 [1:33:41<5:51:08,  3.48it/s]
 80%|████████  | 298160/371472 [1:33:41<5:34:40,  3.65it/s]
                                                           
{'loss': 2.7182, 'learning_rate': 2.7771552931543444e-07, 'epoch': 12.84}

 80%|████████  | 298160/371472 [1:33:41<5:34:40,  3.65it/s]
 80%|████████  | 298161/371472 [1:33:42<5:32:49,  3.67it/s]
 80%|████████  | 298162/371472 [1:33:42<5:20:43,  3.81it/s]
 80%|████████  | 298163/371472 [1:33:42<5:33:08,  3.67it/s]
 80%|████████  | 298164/371472 [1:33:42<5:30:03,  3.70it/s]
 80%|████████  | 298165/371472 [1:33:43<5:39:03,  3.60it/s]
 80%|████████  | 298166/371472 [1:33:43<5:29:47,  3.70it/s]
 80%|████████  | 298167/371472 [1:33:43<6:11:06,  3.29it/s]
 80%|████████  | 298168/371472 [1:33:44<5:45:17,  3.54it/s]
 80%|████████  | 298169/371472 [1:33:44<5:32:28,  3.67it/s]
 80%|████████  | 298170/371472 [1:33:44<5:26:49,  3.74it/s]
 80%|████████  | 298171/371472 [1:33:44<5:31:40,  3.68it/s]
 80%|████████  | 298172/371472 [1:33:45<5:47:45,  3.51it/s]
 80%|████████  | 298173/371472 [1:33:45<5:40:09,  3.59it/s]
 80%|████████  | 298174/371472 [1:33:45<5:51:27,  3.48it/s]
 80%|████████  | 298175/371472 [1:33:46<6:15:29,  3.25it/s]
 80%|████████  | 298176/371472 [1:33:46<6:03:38,  3.36it/s]
 80%|████████  | 298177/371472 [1:33:46<6:23:49,  3.18it/s]
 80%|████████  | 298178/371472 [1:33:47<6:20:51,  3.21it/s]
 80%|████████  | 298179/371472 [1:33:47<5:58:51,  3.40it/s]
 80%|████████  | 298180/371472 [1:33:47<5:56:30,  3.43it/s]
                                                           
{'loss': 2.7419, 'learning_rate': 2.776670473399556e-07, 'epoch': 12.84}

 80%|████████  | 298180/371472 [1:33:47<5:56:30,  3.43it/s]
 80%|████████  | 298181/371472 [1:33:47<5:44:52,  3.54it/s]
 80%|████████  | 298182/371472 [1:33:48<5:35:08,  3.64it/s]
 80%|████████  | 298183/371472 [1:33:48<5:23:26,  3.78it/s]
 80%|████████  | 298184/371472 [1:33:48<5:20:50,  3.81it/s]
 80%|████████  | 298185/371472 [1:33:49<5:53:13,  3.46it/s]
 80%|████████  | 298186/371472 [1:33:49<5:44:07,  3.55it/s]
 80%|████████  | 298187/371472 [1:33:49<5:44:24,  3.55it/s]
 80%|████████  | 298188/371472 [1:33:49<5:48:36,  3.50it/s]
 80%|████████  | 298189/371472 [1:33:50<5:38:42,  3.61it/s]
 80%|████████  | 298190/371472 [1:33:50<5:34:58,  3.65it/s]
 80%|████████  | 298191/371472 [1:33:50<5:33:32,  3.66it/s]
 80%|████████  | 298192/371472 [1:33:50<5:43:23,  3.56it/s]
 80%|████████  | 298193/371472 [1:33:51<5:41:35,  3.58it/s]
 80%|████████  | 298194/371472 [1:33:51<5:26:16,  3.74it/s]
 80%|████████  | 298195/371472 [1:33:51<5:24:52,  3.76it/s]
 80%|████████  | 298196/371472 [1:33:51<5:25:15,  3.75it/s]
 80%|████████  | 298197/371472 [1:33:52<5:28:56,  3.71it/s]
 80%|████████  | 298198/371472 [1:33:52<5:34:11,  3.65it/s]
 80%|████████  | 298199/371472 [1:33:52<5:20:52,  3.81it/s]
 80%|████████  | 298200/371472 [1:33:53<5:46:14,  3.53it/s]
                                                           
{'loss': 2.6258, 'learning_rate': 2.776185653644767e-07, 'epoch': 12.84}

 80%|████████  | 298200/371472 [1:33:53<5:46:14,  3.53it/s]
 80%|████████  | 298201/371472 [1:33:53<5:56:05,  3.43it/s]
 80%|████████  | 298202/371472 [1:33:53<6:06:36,  3.33it/s]
 80%|████████  | 298203/371472 [1:33:54<6:23:38,  3.18it/s]
 80%|████████  | 298204/371472 [1:33:54<6:01:26,  3.38it/s]
 80%|████████  | 298205/371472 [1:33:54<5:46:05,  3.53it/s]
 80%|████████  | 298206/371472 [1:33:54<5:55:29,  3.44it/s]
 80%|████████  | 298207/371472 [1:33:55<6:09:30,  3.30it/s]
 80%|████████  | 298208/371472 [1:33:55<5:44:17,  3.55it/s]
 80%|████████  | 298209/371472 [1:33:55<5:36:29,  3.63it/s]
 80%|████████  | 298210/371472 [1:33:56<6:04:15,  3.35it/s]
 80%|████████  | 298211/371472 [1:33:56<5:50:06,  3.49it/s]
 80%|████████  | 298212/371472 [1:33:56<6:00:09,  3.39it/s]
 80%|████████  | 298213/371472 [1:33:56<5:47:50,  3.51it/s]
 80%|████████  | 298214/371472 [1:33:57<5:57:53,  3.41it/s]
 80%|████████  | 298215/371472 [1:33:57<5:46:21,  3.53it/s]
 80%|████████  | 298216/371472 [1:33:57<5:33:27,  3.66it/s]
 80%|████████  | 298217/371472 [1:33:58<5:31:51,  3.68it/s]
 80%|████████  | 298218/371472 [1:33:58<5:27:30,  3.73it/s]
 80%|████████  | 298219/371472 [1:33:58<5:51:48,  3.47it/s]
 80%|████████  | 298220/371472 [1:33:58<5:43:17,  3.56it/s]
                                                           
{'loss': 2.5853, 'learning_rate': 2.7757008338899776e-07, 'epoch': 12.84}

 80%|████████  | 298220/371472 [1:33:58<5:43:17,  3.56it/s]
 80%|████████  | 298221/371472 [1:33:59<5:44:45,  3.54it/s]
 80%|████████  | 298222/371472 [1:33:59<5:42:23,  3.57it/s]
 80%|████████  | 298223/371472 [1:33:59<5:42:54,  3.56it/s]
 80%|████████  | 298224/371472 [1:34:00<6:03:38,  3.36it/s]
 80%|████████  | 298225/371472 [1:34:00<5:51:29,  3.47it/s]
 80%|████████  | 298226/371472 [1:34:00<5:44:39,  3.54it/s]
 80%|████████  | 298227/371472 [1:34:00<5:45:41,  3.53it/s]
 80%|████████  | 298228/371472 [1:34:01<5:52:31,  3.46it/s]
 80%|████████  | 298229/371472 [1:34:01<5:38:28,  3.61it/s]
 80%|████████  | 298230/371472 [1:34:01<5:34:57,  3.64it/s]
 80%|████████  | 298231/371472 [1:34:02<5:50:00,  3.49it/s]
 80%|████████  | 298232/371472 [1:34:02<5:35:57,  3.63it/s]
 80%|████████  | 298233/371472 [1:34:02<5:30:43,  3.69it/s]
 80%|████████  | 298234/371472 [1:34:02<5:25:56,  3.74it/s]
 80%|████████  | 298235/371472 [1:34:03<5:21:27,  3.80it/s]
 80%|████████  | 298236/371472 [1:34:03<5:22:15,  3.79it/s]
 80%|████████  | 298237/371472 [1:34:03<5:16:37,  3.86it/s]
 80%|████████  | 298238/371472 [1:34:03<5:18:01,  3.84it/s]
 80%|████████  | 298239/371472 [1:34:04<5:36:01,  3.63it/s]
 80%|████████  | 298240/371472 [1:34:04<5:45:44,  3.53it/s]
                                                           
{'loss': 2.5797, 'learning_rate': 2.775216014135189e-07, 'epoch': 12.85}

 80%|████████  | 298240/371472 [1:34:04<5:45:44,  3.53it/s]
 80%|████████  | 298241/371472 [1:34:04<6:04:47,  3.35it/s]
 80%|████████  | 298242/371472 [1:34:05<5:44:10,  3.55it/s]
 80%|████████  | 298243/371472 [1:34:05<5:34:44,  3.65it/s]
 80%|████████  | 298244/371472 [1:34:05<5:27:36,  3.73it/s]
 80%|████████  | 298245/371472 [1:34:05<5:28:39,  3.71it/s]
 80%|████████  | 298246/371472 [1:34:06<5:17:16,  3.85it/s]
 80%|████████  | 298247/371472 [1:34:06<5:51:57,  3.47it/s]
 80%|████████  | 298248/371472 [1:34:06<5:51:11,  3.48it/s]
 80%|████████  | 298249/371472 [1:34:07<6:11:00,  3.29it/s]
 80%|████████  | 298250/371472 [1:34:07<6:05:37,  3.34it/s]
 80%|████████  | 298251/371472 [1:34:07<5:43:53,  3.55it/s]
 80%|████████  | 298252/371472 [1:34:07<5:30:45,  3.69it/s]
 80%|████████  | 298253/371472 [1:34:08<5:27:28,  3.73it/s]
 80%|████████  | 298254/371472 [1:34:08<5:22:16,  3.79it/s]
 80%|████████  | 298255/371472 [1:34:08<5:45:14,  3.53it/s]
 80%|████████  | 298256/371472 [1:34:09<6:20:58,  3.20it/s]
 80%|████████  | 298257/371472 [1:34:09<6:01:47,  3.37it/s]
 80%|████████  | 298258/371472 [1:34:09<5:46:16,  3.52it/s]
 80%|████████  | 298259/371472 [1:34:09<5:38:13,  3.61it/s]
 80%|████████  | 298260/371472 [1:34:10<6:04:00,  3.35it/s]
                                                           
{'loss': 2.5357, 'learning_rate': 2.7747311943804e-07, 'epoch': 12.85}

 80%|████████  | 298260/371472 [1:34:10<6:04:00,  3.35it/s]
 80%|████████  | 298261/371472 [1:34:10<5:51:45,  3.47it/s]
 80%|████████  | 298262/371472 [1:34:10<5:42:54,  3.56it/s]
 80%|████████  | 298263/371472 [1:34:11<6:07:26,  3.32it/s]
 80%|████████  | 298264/371472 [1:34:11<5:47:20,  3.51it/s]
 80%|████████  | 298265/371472 [1:34:11<5:42:47,  3.56it/s]
 80%|████████  | 298266/371472 [1:34:11<5:30:40,  3.69it/s]
 80%|████████  | 298267/371472 [1:34:12<5:25:29,  3.75it/s]
 80%|████████  | 298268/371472 [1:34:12<5:25:53,  3.74it/s]
 80%|████████  | 298269/371472 [1:34:12<5:28:29,  3.71it/s]
 80%|████████  | 298270/371472 [1:34:12<5:38:02,  3.61it/s]
 80%|████████  | 298271/371472 [1:34:13<5:52:26,  3.46it/s]
 80%|████████  | 298272/371472 [1:34:13<5:48:53,  3.50it/s]
 80%|████████  | 298273/371472 [1:34:13<5:49:12,  3.49it/s]
 80%|████████  | 298274/371472 [1:34:14<5:37:53,  3.61it/s]
 80%|████████  | 298275/371472 [1:34:14<5:51:35,  3.47it/s]
 80%|████████  | 298276/371472 [1:34:14<6:07:18,  3.32it/s]
 80%|████████  | 298277/371472 [1:34:14<6:25:17,  3.17it/s]
 80%|████████  | 298278/371472 [1:34:15<6:01:25,  3.38it/s]
 80%|████████  | 298279/371472 [1:34:15<5:41:41,  3.57it/s]
 80%|████████  | 298280/371472 [1:34:15<5:41:02,  3.58it/s]
                                                           
{'loss': 2.5866, 'learning_rate': 2.774246374625611e-07, 'epoch': 12.85}

 80%|████████  | 298280/371472 [1:34:15<5:41:02,  3.58it/s]
 80%|████████  | 298281/371472 [1:34:16<5:48:04,  3.50it/s]
 80%|████████  | 298282/371472 [1:34:16<5:49:55,  3.49it/s]
 80%|████████  | 298283/371472 [1:34:16<5:36:31,  3.62it/s]
 80%|████████  | 298284/371472 [1:34:16<5:51:23,  3.47it/s]
 80%|████████  | 298285/371472 [1:34:17<5:38:25,  3.60it/s]
 80%|████████  | 298286/371472 [1:34:17<5:42:03,  3.57it/s]
 80%|████████  | 298287/371472 [1:34:17<5:31:19,  3.68it/s]
 80%|████████  | 298288/371472 [1:34:17<5:25:41,  3.75it/s]
 80%|████████  | 298289/371472 [1:34:18<5:24:46,  3.76it/s]
 80%|████████  | 298290/371472 [1:34:18<5:28:26,  3.71it/s]
 80%|████████  | 298291/371472 [1:34:18<5:36:44,  3.62it/s]
 80%|████████  | 298292/371472 [1:34:19<5:50:34,  3.48it/s]
 80%|████████  | 298293/371472 [1:34:19<5:32:28,  3.67it/s]
 80%|████████  | 298294/371472 [1:34:19<6:00:59,  3.38it/s]
 80%|████████  | 298295/371472 [1:34:19<5:45:43,  3.53it/s]
 80%|████████  | 298296/371472 [1:34:20<5:46:14,  3.52it/s]
 80%|████████  | 298297/371472 [1:34:20<5:44:07,  3.54it/s]
 80%|████████  | 298298/371472 [1:34:20<5:38:24,  3.60it/s]
 80%|████████  | 298299/371472 [1:34:21<5:59:42,  3.39it/s]
 80%|████████  | 298300/371472 [1:34:21<5:56:07,  3.42it/s]
                                                           
{'loss': 2.5728, 'learning_rate': 2.7737615548708226e-07, 'epoch': 12.85}

 80%|████████  | 298300/371472 [1:34:21<5:56:07,  3.42it/s]
 80%|████████  | 298301/371472 [1:34:21<5:51:29,  3.47it/s]
 80%|████████  | 298302/371472 [1:34:21<5:33:07,  3.66it/s]
 80%|████████  | 298303/371472 [1:34:22<5:43:45,  3.55it/s]
 80%|████████  | 298304/371472 [1:34:22<5:36:17,  3.63it/s]
 80%|████████  | 298305/371472 [1:34:22<5:49:32,  3.49it/s]
 80%|████████  | 298306/371472 [1:34:23<6:01:00,  3.38it/s]
 80%|████████  | 298307/371472 [1:34:23<5:53:46,  3.45it/s]
 80%|████████  | 298308/371472 [1:34:23<6:14:39,  3.25it/s]
 80%|████████  | 298309/371472 [1:34:23<5:52:25,  3.46it/s]
 80%|████████  | 298310/371472 [1:34:24<5:37:25,  3.61it/s]
 80%|████████  | 298311/371472 [1:34:24<5:38:16,  3.60it/s]
 80%|████████  | 298312/371472 [1:34:24<5:28:26,  3.71it/s]
 80%|████████  | 298313/371472 [1:34:25<5:26:50,  3.73it/s]
 80%|████████  | 298314/371472 [1:34:25<5:19:03,  3.82it/s]
 80%|████████  | 298315/371472 [1:34:25<5:15:36,  3.86it/s]
 80%|████████  | 298316/371472 [1:34:25<5:20:28,  3.80it/s]
 80%|████████  | 298317/371472 [1:34:26<5:30:08,  3.69it/s]
 80%|████████  | 298318/371472 [1:34:26<5:48:52,  3.49it/s]
 80%|████████  | 298319/371472 [1:34:26<5:58:31,  3.40it/s]
 80%|████████  | 298320/371472 [1:34:26<5:43:54,  3.55it/s]
                                                           
{'loss': 2.5743, 'learning_rate': 2.7732767351160333e-07, 'epoch': 12.85}

 80%|████████  | 298320/371472 [1:34:26<5:43:54,  3.55it/s]
 80%|████████  | 298321/371472 [1:34:27<5:29:17,  3.70it/s]
 80%|████████  | 298322/371472 [1:34:27<5:39:06,  3.60it/s]
 80%|████████  | 298323/371472 [1:34:27<5:37:57,  3.61it/s]
 80%|████████  | 298324/371472 [1:34:28<5:38:27,  3.60it/s]
 80%|████████  | 298325/371472 [1:34:28<5:26:40,  3.73it/s]
 80%|████████  | 298326/371472 [1:34:28<5:26:12,  3.74it/s]
 80%|████████  | 298327/371472 [1:34:28<5:19:54,  3.81it/s]
 80%|████████  | 298328/371472 [1:34:29<5:12:18,  3.90it/s]
 80%|████████  | 298329/371472 [1:34:29<5:27:19,  3.72it/s]
 80%|████████  | 298330/371472 [1:34:29<5:19:35,  3.81it/s]
 80%|████████  | 298331/371472 [1:34:29<5:11:24,  3.91it/s]
 80%|████████  | 298332/371472 [1:34:30<5:08:06,  3.96it/s]
 80%|████████  | 298333/371472 [1:34:30<5:04:08,  4.01it/s]
 80%|████████  | 298334/371472 [1:34:30<5:18:49,  3.82it/s]
 80%|████████  | 298335/371472 [1:34:30<5:11:31,  3.91it/s]
 80%|████████  | 298336/371472 [1:34:31<5:15:25,  3.86it/s]
 80%|████████  | 298337/371472 [1:34:31<5:22:17,  3.78it/s]
 80%|████████  | 298338/371472 [1:34:31<5:27:50,  3.72it/s]
 80%|████████  | 298339/371472 [1:34:32<5:42:21,  3.56it/s]
 80%|████████  | 298340/371472 [1:34:32<5:56:12,  3.42it/s]
                                                           
{'loss': 2.5963, 'learning_rate': 2.7727919153612446e-07, 'epoch': 12.85}

 80%|████████  | 298340/371472 [1:34:32<5:56:12,  3.42it/s]
 80%|████████  | 298341/371472 [1:34:32<6:12:46,  3.27it/s]
 80%|████████  | 298342/371472 [1:34:32<5:59:56,  3.39it/s]
 80%|████████  | 298343/371472 [1:34:33<5:52:11,  3.46it/s]
 80%|████████  | 298344/371472 [1:34:33<5:54:05,  3.44it/s]
 80%|████████  | 298345/371472 [1:34:33<5:49:30,  3.49it/s]
 80%|████████  | 298346/371472 [1:34:34<5:50:41,  3.48it/s]
 80%|████████  | 298347/371472 [1:34:34<5:50:53,  3.47it/s]
 80%|████████  | 298348/371472 [1:34:34<5:35:41,  3.63it/s]
 80%|████████  | 298349/371472 [1:34:34<5:46:19,  3.52it/s]
 80%|████████  | 298350/371472 [1:34:35<5:34:54,  3.64it/s]
 80%|████████  | 298351/371472 [1:34:35<6:06:06,  3.33it/s]
 80%|████████  | 298352/371472 [1:34:35<6:22:51,  3.18it/s]
 80%|████████  | 298353/371472 [1:34:36<6:02:47,  3.36it/s]
 80%|████████  | 298354/371472 [1:34:36<5:44:16,  3.54it/s]
 80%|████████  | 298355/371472 [1:34:36<5:37:14,  3.61it/s]
 80%|████████  | 298356/371472 [1:34:36<5:48:12,  3.50it/s]
 80%|████████  | 298357/371472 [1:34:37<5:47:15,  3.51it/s]
 80%|████████  | 298358/371472 [1:34:37<5:38:33,  3.60it/s]
 80%|████████  | 298359/371472 [1:34:37<5:36:06,  3.63it/s]
 80%|████████  | 298360/371472 [1:34:38<5:47:03,  3.51it/s]
                                                           
{'loss': 2.5451, 'learning_rate': 2.7723070956064553e-07, 'epoch': 12.85}

 80%|████████  | 298360/371472 [1:34:38<5:47:03,  3.51it/s]
 80%|████████  | 298361/371472 [1:34:38<5:36:47,  3.62it/s]
 80%|████████  | 298362/371472 [1:34:38<5:28:25,  3.71it/s]
 80%|████████  | 298363/371472 [1:34:38<5:45:13,  3.53it/s]
 80%|████████  | 298364/371472 [1:34:39<5:46:59,  3.51it/s]
 80%|████████  | 298365/371472 [1:34:39<5:54:58,  3.43it/s]
 80%|████████  | 298366/371472 [1:34:39<5:48:58,  3.49it/s]
 80%|████████  | 298367/371472 [1:34:40<5:42:15,  3.56it/s]
 80%|████████  | 298368/371472 [1:34:40<5:32:44,  3.66it/s]
 80%|████████  | 298369/371472 [1:34:40<5:44:22,  3.54it/s]
 80%|████████  | 298370/371472 [1:34:40<6:11:56,  3.28it/s]
 80%|████████  | 298371/371472 [1:34:41<6:58:31,  2.91it/s]
 80%|████████  | 298372/371472 [1:34:41<6:39:37,  3.05it/s]
 80%|████████  | 298373/371472 [1:34:41<6:25:15,  3.16it/s]
 80%|████████  | 298374/371472 [1:34:42<6:03:35,  3.35it/s]
 80%|████████  | 298375/371472 [1:34:42<5:48:33,  3.50it/s]
 80%|████████  | 298376/371472 [1:34:42<5:40:41,  3.58it/s]
 80%|████████  | 298377/371472 [1:34:43<5:35:18,  3.63it/s]
 80%|████████  | 298378/371472 [1:34:43<5:22:22,  3.78it/s]
 80%|████████  | 298379/371472 [1:34:43<5:12:42,  3.90it/s]
 80%|████████  | 298380/371472 [1:34:43<5:07:19,  3.96it/s]
                                                           
{'loss': 2.6661, 'learning_rate': 2.7718222758516665e-07, 'epoch': 12.85}

 80%|████████  | 298380/371472 [1:34:43<5:07:19,  3.96it/s]
 80%|████████  | 298381/371472 [1:34:43<5:08:41,  3.95it/s]
 80%|████████  | 298382/371472 [1:34:44<5:41:18,  3.57it/s]
 80%|████████  | 298383/371472 [1:34:44<5:46:16,  3.52it/s]
 80%|████████  | 298384/371472 [1:34:44<5:48:48,  3.49it/s]
 80%|████████  | 298385/371472 [1:34:45<5:37:08,  3.61it/s]
 80%|████████  | 298386/371472 [1:34:45<5:28:26,  3.71it/s]
 80%|████████  | 298387/371472 [1:34:45<5:35:44,  3.63it/s]
 80%|████████  | 298388/371472 [1:34:45<5:35:20,  3.63it/s]
 80%|████████  | 298389/371472 [1:34:46<5:47:07,  3.51it/s]
 80%|████████  | 298390/371472 [1:34:46<5:51:09,  3.47it/s]
 80%|████████  | 298391/371472 [1:34:46<5:59:48,  3.39it/s]
 80%|████████  | 298392/371472 [1:34:47<5:54:15,  3.44it/s]
 80%|████████  | 298393/371472 [1:34:47<5:42:12,  3.56it/s]
 80%|████████  | 298394/371472 [1:34:47<5:25:04,  3.75it/s]
 80%|████████  | 298395/371472 [1:34:47<5:24:21,  3.75it/s]
 80%|████████  | 298396/371472 [1:34:48<5:13:37,  3.88it/s]
 80%|████████  | 298397/371472 [1:34:48<5:09:02,  3.94it/s]
 80%|████████  | 298398/371472 [1:34:48<5:08:35,  3.95it/s]
 80%|████████  | 298399/371472 [1:34:48<5:07:07,  3.97it/s]
 80%|████████  | 298400/371472 [1:34:49<5:16:27,  3.85it/s]
                                                           
{'loss': 2.6282, 'learning_rate': 2.771337456096877e-07, 'epoch': 12.85}

 80%|████████  | 298400/371472 [1:34:49<5:16:27,  3.85it/s]
 80%|████████  | 298401/371472 [1:34:49<5:39:42,  3.59it/s]
 80%|████████  | 298402/371472 [1:34:49<5:48:42,  3.49it/s]
 80%|████████  | 298403/371472 [1:34:50<5:35:34,  3.63it/s]
 80%|████████  | 298404/371472 [1:34:50<5:32:49,  3.66it/s]
 80%|████████  | 298405/371472 [1:34:50<5:38:52,  3.59it/s]
 80%|████████  | 298406/371472 [1:34:50<5:36:14,  3.62it/s]
 80%|████████  | 298407/371472 [1:34:51<5:24:35,  3.75it/s]
 80%|████████  | 298408/371472 [1:34:51<5:29:26,  3.70it/s]
 80%|████████  | 298409/371472 [1:34:51<5:25:52,  3.74it/s]
 80%|████████  | 298410/371472 [1:34:52<6:20:20,  3.20it/s]
 80%|████████  | 298411/371472 [1:34:52<6:17:15,  3.23it/s]
 80%|████████  | 298412/371472 [1:34:52<5:59:35,  3.39it/s]
 80%|████████  | 298413/371472 [1:34:52<6:04:34,  3.34it/s]
 80%|████████  | 298414/371472 [1:34:53<6:08:53,  3.30it/s]
 80%|████████  | 298415/371472 [1:34:53<5:48:42,  3.49it/s]
 80%|████████  | 298416/371472 [1:34:53<5:37:25,  3.61it/s]
 80%|████████  | 298417/371472 [1:34:54<5:34:53,  3.64it/s]
 80%|████████  | 298418/371472 [1:34:54<5:42:04,  3.56it/s]
 80%|████████  | 298419/371472 [1:34:54<5:40:08,  3.58it/s]
 80%|████████  | 298420/371472 [1:34:54<5:42:37,  3.55it/s]
                                                           
{'loss': 2.5869, 'learning_rate': 2.770852636342089e-07, 'epoch': 12.85}

 80%|████████  | 298420/371472 [1:34:54<5:42:37,  3.55it/s]
 80%|████████  | 298421/371472 [1:34:55<5:45:20,  3.53it/s]
 80%|████████  | 298422/371472 [1:34:55<5:41:17,  3.57it/s]
 80%|████████  | 298423/371472 [1:34:55<5:57:58,  3.40it/s]
 80%|████████  | 298424/371472 [1:34:56<5:58:27,  3.40it/s]
 80%|████████  | 298425/371472 [1:34:56<5:40:51,  3.57it/s]
 80%|████████  | 298426/371472 [1:34:56<5:29:44,  3.69it/s]
 80%|████████  | 298427/371472 [1:34:56<5:40:47,  3.57it/s]
 80%|████████  | 298428/371472 [1:34:57<5:50:06,  3.48it/s]
 80%|████████  | 298429/371472 [1:34:57<6:28:09,  3.14it/s]
 80%|████████  | 298430/371472 [1:34:57<6:22:57,  3.18it/s]
 80%|████████  | 298431/371472 [1:34:58<6:28:37,  3.13it/s]
 80%|████████  | 298432/371472 [1:34:58<6:11:45,  3.27it/s]
 80%|████████  | 298433/371472 [1:34:58<6:30:48,  3.11it/s]
 80%|████████  | 298434/371472 [1:34:59<6:20:14,  3.20it/s]
 80%|████████  | 298435/371472 [1:34:59<5:58:07,  3.40it/s]
 80%|████████  | 298436/371472 [1:34:59<5:41:42,  3.56it/s]
 80%|████████  | 298437/371472 [1:34:59<5:36:56,  3.61it/s]
 80%|████████  | 298438/371472 [1:35:00<5:29:56,  3.69it/s]
 80%|████████  | 298439/371472 [1:35:00<5:52:29,  3.45it/s]
 80%|████████  | 298440/371472 [1:35:00<5:45:24,  3.52it/s]
                                                           
{'loss': 2.6933, 'learning_rate': 2.7703678165872997e-07, 'epoch': 12.85}

 80%|████████  | 298440/371472 [1:35:00<5:45:24,  3.52it/s]
 80%|████████  | 298441/371472 [1:35:01<5:40:50,  3.57it/s]
 80%|████████  | 298442/371472 [1:35:01<6:55:59,  2.93it/s]
 80%|████████  | 298443/371472 [1:35:01<7:18:40,  2.77it/s]
 80%|████████  | 298444/371472 [1:35:02<6:31:21,  3.11it/s]
 80%|████████  | 298445/371472 [1:35:02<6:13:06,  3.26it/s]
 80%|████████  | 298446/371472 [1:35:02<6:21:10,  3.19it/s]
 80%|████████  | 298447/371472 [1:35:03<6:04:08,  3.34it/s]
 80%|████████  | 298448/371472 [1:35:03<5:47:26,  3.50it/s]
 80%|████████  | 298449/371472 [1:35:03<6:06:35,  3.32it/s]
 80%|████████  | 298450/371472 [1:35:03<5:48:50,  3.49it/s]
 80%|████████  | 298451/371472 [1:35:04<5:55:03,  3.43it/s]
 80%|████████  | 298452/371472 [1:35:04<5:45:40,  3.52it/s]
 80%|████████  | 298453/371472 [1:35:04<5:31:37,  3.67it/s]
 80%|████████  | 298454/371472 [1:35:05<5:41:56,  3.56it/s]
 80%|████████  | 298455/371472 [1:35:05<5:44:14,  3.54it/s]
 80%|████████  | 298456/371472 [1:35:05<5:56:16,  3.42it/s]
 80%|████████  | 298457/371472 [1:35:05<5:45:20,  3.52it/s]
 80%|████████  | 298458/371472 [1:35:06<5:54:03,  3.44it/s]
 80%|████████  | 298459/371472 [1:35:06<6:02:47,  3.35it/s]
 80%|████████  | 298460/371472 [1:35:06<6:04:04,  3.34it/s]
                                                           
{'loss': 2.6399, 'learning_rate': 2.7698829968325115e-07, 'epoch': 12.86}

 80%|████████  | 298460/371472 [1:35:06<6:04:04,  3.34it/s]
 80%|████████  | 298461/371472 [1:35:07<6:04:17,  3.34it/s]
 80%|████████  | 298462/371472 [1:35:07<5:51:22,  3.46it/s]
 80%|████████  | 298463/371472 [1:35:07<6:01:18,  3.37it/s]
 80%|████████  | 298464/371472 [1:35:08<6:14:40,  3.25it/s]
 80%|████████  | 298465/371472 [1:35:08<5:59:34,  3.38it/s]
 80%|████████  | 298466/371472 [1:35:08<5:47:01,  3.51it/s]
 80%|████████  | 298467/371472 [1:35:08<5:34:04,  3.64it/s]
 80%|████████  | 298468/371472 [1:35:09<5:35:42,  3.62it/s]
 80%|████████  | 298469/371472 [1:35:09<5:51:00,  3.47it/s]
 80%|████████  | 298470/371472 [1:35:09<5:40:01,  3.58it/s]
 80%|████████  | 298471/371472 [1:35:09<5:31:25,  3.67it/s]
 80%|████████  | 298472/371472 [1:35:10<5:20:05,  3.80it/s]
 80%|████████  | 298473/371472 [1:35:10<5:24:14,  3.75it/s]
 80%|████████  | 298474/371472 [1:35:10<5:34:25,  3.64it/s]
 80%|████████  | 298475/371472 [1:35:10<5:30:44,  3.68it/s]
 80%|████████  | 298476/371472 [1:35:11<5:40:03,  3.58it/s]
 80%|████████  | 298477/371472 [1:35:11<5:39:22,  3.58it/s]
 80%|████████  | 298478/371472 [1:35:11<6:38:59,  3.05it/s]
 80%|████████  | 298479/371472 [1:35:12<6:19:26,  3.21it/s]
 80%|████████  | 298480/371472 [1:35:12<6:10:22,  3.28it/s]
                                                           
{'loss': 2.5716, 'learning_rate': 2.7693981770777217e-07, 'epoch': 12.86}

 80%|████████  | 298480/371472 [1:35:12<6:10:22,  3.28it/s]
 80%|████████  | 298481/371472 [1:35:12<6:10:12,  3.29it/s]
 80%|████████  | 298482/371472 [1:35:13<5:54:57,  3.43it/s]
 80%|████████  | 298483/371472 [1:35:13<6:13:24,  3.26it/s]
 80%|████████  | 298484/371472 [1:35:13<6:08:42,  3.30it/s]
 80%|████████  | 298485/371472 [1:35:14<6:02:24,  3.36it/s]
 80%|████████  | 298486/371472 [1:35:14<5:55:14,  3.42it/s]
 80%|████████  | 298487/371472 [1:35:14<5:40:14,  3.58it/s]
 80%|████████  | 298488/371472 [1:35:14<5:32:00,  3.66it/s]
 80%|████████  | 298489/371472 [1:35:15<5:21:38,  3.78it/s]
 80%|████████  | 298490/371472 [1:35:15<5:10:18,  3.92it/s]
 80%|████████  | 298491/371472 [1:35:15<5:13:18,  3.88it/s]
 80%|████████  | 298492/371472 [1:35:15<5:19:26,  3.81it/s]
 80%|████████  | 298493/371472 [1:35:16<5:55:50,  3.42it/s]
 80%|████████  | 298494/371472 [1:35:16<6:08:21,  3.30it/s]
 80%|████████  | 298495/371472 [1:35:16<5:57:32,  3.40it/s]
 80%|████████  | 298496/371472 [1:35:17<5:49:48,  3.48it/s]
 80%|████████  | 298497/371472 [1:35:17<5:38:57,  3.59it/s]
 80%|████████  | 298498/371472 [1:35:17<5:34:34,  3.64it/s]
 80%|████████  | 298499/371472 [1:35:17<5:29:55,  3.69it/s]
 80%|████████  | 298500/371472 [1:35:18<5:43:43,  3.54it/s]
                                                           
{'loss': 2.5783, 'learning_rate': 2.768913357322933e-07, 'epoch': 12.86}

 80%|████████  | 298500/371472 [1:35:18<5:43:43,  3.54it/s]
 80%|████████  | 298501/371472 [1:35:18<5:30:44,  3.68it/s]
 80%|████████  | 298502/371472 [1:35:18<5:20:48,  3.79it/s]
 80%|████████  | 298503/371472 [1:35:18<5:31:38,  3.67it/s]
 80%|████████  | 298504/371472 [1:35:19<5:23:52,  3.75it/s]
 80%|████████  | 298505/371472 [1:35:19<5:29:59,  3.69it/s]
 80%|████████  | 298506/371472 [1:35:19<5:16:19,  3.84it/s]
 80%|████████  | 298507/371472 [1:35:20<5:26:08,  3.73it/s]
 80%|████████  | 298508/371472 [1:35:20<5:31:36,  3.67it/s]
 80%|████████  | 298509/371472 [1:35:20<5:25:55,  3.73it/s]
 80%|████████  | 298510/371472 [1:35:20<5:42:09,  3.55it/s]
 80%|████████  | 298511/371472 [1:35:21<5:52:41,  3.45it/s]
 80%|████████  | 298512/371472 [1:35:21<5:57:01,  3.41it/s]
 80%|████████  | 298513/371472 [1:35:21<5:59:50,  3.38it/s]
 80%|████████  | 298514/371472 [1:35:22<5:48:29,  3.49it/s]
 80%|████████  | 298515/371472 [1:35:22<5:39:30,  3.58it/s]
 80%|████████  | 298516/371472 [1:35:22<5:38:15,  3.59it/s]
 80%|████████  | 298517/371472 [1:35:22<5:42:26,  3.55it/s]
 80%|████████  | 298518/371472 [1:35:23<5:38:53,  3.59it/s]
 80%|████████  | 298519/371472 [1:35:23<5:35:14,  3.63it/s]
 80%|████████  | 298520/371472 [1:35:23<5:31:18,  3.67it/s]
                                                           
{'loss': 2.624, 'learning_rate': 2.7684285375681437e-07, 'epoch': 12.86}

 80%|████████  | 298520/371472 [1:35:23<5:31:18,  3.67it/s]
 80%|████████  | 298521/371472 [1:35:24<5:50:09,  3.47it/s]
 80%|████████  | 298522/371472 [1:35:24<6:17:04,  3.22it/s]
 80%|████████  | 298523/371472 [1:35:24<6:29:31,  3.12it/s]
 80%|████████  | 298524/371472 [1:35:25<6:41:23,  3.03it/s]
 80%|████████  | 298525/371472 [1:35:25<6:36:20,  3.07it/s]
 80%|████████  | 298526/371472 [1:35:25<6:34:22,  3.08it/s]
 80%|████████  | 298527/371472 [1:35:25<6:19:04,  3.21it/s]
 80%|████████  | 298528/371472 [1:35:26<5:54:23,  3.43it/s]
 80%|████████  | 298529/371472 [1:35:26<6:17:01,  3.22it/s]
 80%|████████  | 298530/371472 [1:35:26<6:22:51,  3.18it/s]
 80%|████████  | 298531/371472 [1:35:27<6:15:44,  3.24it/s]
 80%|████████  | 298532/371472 [1:35:27<6:22:50,  3.18it/s]
 80%|████████  | 298533/371472 [1:35:27<5:55:51,  3.42it/s]
 80%|████████  | 298534/371472 [1:35:28<5:38:30,  3.59it/s]
 80%|████████  | 298535/371472 [1:35:28<5:39:28,  3.58it/s]
 80%|████████  | 298536/371472 [1:35:28<5:34:10,  3.64it/s]
 80%|████████  | 298537/371472 [1:35:28<5:25:02,  3.74it/s]
 80%|████████  | 298538/371472 [1:35:29<5:24:21,  3.75it/s]
 80%|████████  | 298539/371472 [1:35:29<5:32:08,  3.66it/s]
 80%|████████  | 298540/371472 [1:35:29<5:28:29,  3.70it/s]
                                                           
{'loss': 2.5406, 'learning_rate': 2.7679437178133554e-07, 'epoch': 12.86}

 80%|████████  | 298540/371472 [1:35:29<5:28:29,  3.70it/s]
 80%|████████  | 298541/371472 [1:35:29<5:42:53,  3.54it/s]
 80%|████████  | 298542/371472 [1:35:30<5:42:54,  3.54it/s]
 80%|████████  | 298543/371472 [1:35:30<5:29:55,  3.68it/s]
 80%|████████  | 298544/371472 [1:35:30<5:29:15,  3.69it/s]
 80%|████████  | 298545/371472 [1:35:31<5:26:55,  3.72it/s]
 80%|████████  | 298546/371472 [1:35:31<5:25:51,  3.73it/s]
 80%|████████  | 298547/371472 [1:35:31<5:21:34,  3.78it/s]
 80%|████████  | 298548/371472 [1:35:31<5:18:00,  3.82it/s]
 80%|████████  | 298549/371472 [1:35:32<5:43:44,  3.54it/s]
 80%|████████  | 298550/371472 [1:35:32<5:28:14,  3.70it/s]
 80%|████████  | 298551/371472 [1:35:32<5:19:25,  3.80it/s]
 80%|████████  | 298552/371472 [1:35:32<5:23:11,  3.76it/s]
 80%|████████  | 298553/371472 [1:35:33<5:25:33,  3.73it/s]
 80%|████████  | 298554/371472 [1:35:33<5:25:35,  3.73it/s]
 80%|████████  | 298555/371472 [1:35:33<5:53:37,  3.44it/s]
 80%|████████  | 298556/371472 [1:35:34<5:44:00,  3.53it/s]
 80%|████████  | 298557/371472 [1:35:34<5:45:53,  3.51it/s]
 80%|████████  | 298558/371472 [1:35:34<5:28:39,  3.70it/s]
 80%|████████  | 298559/371472 [1:35:34<5:26:01,  3.73it/s]
 80%|████████  | 298560/371472 [1:35:35<5:26:01,  3.73it/s]
                                                           
{'loss': 2.7869, 'learning_rate': 2.767458898058566e-07, 'epoch': 12.86}

 80%|████████  | 298560/371472 [1:35:35<5:26:01,  3.73it/s]
 80%|████████  | 298561/371472 [1:35:35<5:21:11,  3.78it/s]
 80%|████████  | 298562/371472 [1:35:35<5:20:27,  3.79it/s]
 80%|████████  | 298563/371472 [1:35:35<5:20:55,  3.79it/s]
 80%|████████  | 298564/371472 [1:35:36<5:34:19,  3.63it/s]
 80%|████████  | 298565/371472 [1:35:36<5:31:56,  3.66it/s]
 80%|████████  | 298566/371472 [1:35:36<5:44:44,  3.52it/s]
 80%|████████  | 298567/371472 [1:35:36<5:33:47,  3.64it/s]
 80%|████████  | 298568/371472 [1:35:37<5:22:54,  3.76it/s]
 80%|████████  | 298569/371472 [1:35:37<5:29:33,  3.69it/s]
 80%|████████  | 298570/371472 [1:35:37<5:27:24,  3.71it/s]
 80%|████████  | 298571/371472 [1:35:38<5:53:36,  3.44it/s]
 80%|████████  | 298572/371472 [1:35:38<5:41:49,  3.55it/s]
 80%|████████  | 298573/371472 [1:35:38<5:31:35,  3.66it/s]
 80%|████████  | 298574/371472 [1:35:38<5:33:40,  3.64it/s]
 80%|████████  | 298575/371472 [1:35:39<5:55:38,  3.42it/s]
 80%|████████  | 298576/371472 [1:35:39<5:35:51,  3.62it/s]
 80%|████████  | 298577/371472 [1:35:39<5:29:42,  3.68it/s]
 80%|████████  | 298578/371472 [1:35:40<5:22:07,  3.77it/s]
 80%|████████  | 298579/371472 [1:35:40<5:17:04,  3.83it/s]
 80%|████████  | 298580/371472 [1:35:40<5:43:34,  3.54it/s]
                                                           
{'loss': 2.5571, 'learning_rate': 2.766974078303778e-07, 'epoch': 12.86}

 80%|████████  | 298580/371472 [1:35:40<5:43:34,  3.54it/s]
 80%|████████  | 298581/371472 [1:35:40<6:00:50,  3.37it/s]
 80%|████████  | 298582/371472 [1:35:41<6:00:18,  3.37it/s]
 80%|████████  | 298583/371472 [1:35:41<6:00:01,  3.37it/s]
 80%|████████  | 298584/371472 [1:35:41<5:57:45,  3.40it/s]
 80%|████████  | 298585/371472 [1:35:42<6:07:29,  3.31it/s]
 80%|████████  | 298586/371472 [1:35:42<6:12:16,  3.26it/s]
 80%|████████  | 298587/371472 [1:35:42<6:09:48,  3.28it/s]
 80%|████████  | 298588/371472 [1:35:43<5:54:01,  3.43it/s]
 80%|████████  | 298589/371472 [1:35:43<5:46:09,  3.51it/s]
 80%|████████  | 298590/371472 [1:35:43<5:32:55,  3.65it/s]
 80%|████████  | 298591/371472 [1:35:43<5:53:04,  3.44it/s]
 80%|████████  | 298592/371472 [1:35:44<5:58:43,  3.39it/s]
 80%|████████  | 298593/371472 [1:35:44<5:41:43,  3.55it/s]
 80%|████████  | 298594/371472 [1:35:44<5:39:44,  3.58it/s]
 80%|████████  | 298595/371472 [1:35:44<5:29:39,  3.68it/s]
 80%|████████  | 298596/371472 [1:35:45<5:27:47,  3.71it/s]
 80%|████████  | 298597/371472 [1:35:45<5:25:42,  3.73it/s]
 80%|████████  | 298598/371472 [1:35:45<5:22:17,  3.77it/s]
 80%|████████  | 298599/371472 [1:35:45<5:19:23,  3.80it/s]
 80%|████████  | 298600/371472 [1:35:46<5:34:38,  3.63it/s]
                                                           
{'loss': 2.6057, 'learning_rate': 2.766489258548988e-07, 'epoch': 12.86}

 80%|████████  | 298600/371472 [1:35:46<5:34:38,  3.63it/s]
 80%|████████  | 298601/371472 [1:35:46<5:40:58,  3.56it/s]
 80%|████████  | 298602/371472 [1:35:46<6:08:52,  3.29it/s]
 80%|████████  | 298603/371472 [1:35:47<6:01:57,  3.36it/s]
 80%|████████  | 298604/371472 [1:35:47<6:14:17,  3.24it/s]
 80%|████████  | 298605/371472 [1:35:47<6:14:49,  3.24it/s]
 80%|████████  | 298606/371472 [1:35:48<6:21:48,  3.18it/s]
 80%|████████  | 298607/371472 [1:35:48<6:08:15,  3.30it/s]
 80%|████████  | 298608/371472 [1:35:48<6:16:40,  3.22it/s]
 80%|████████  | 298609/371472 [1:35:49<6:29:32,  3.12it/s]
 80%|████████  | 298610/371472 [1:35:49<6:02:55,  3.35it/s]
 80%|████████  | 298611/371472 [1:35:49<5:51:46,  3.45it/s]
 80%|████████  | 298612/371472 [1:35:49<5:41:39,  3.55it/s]
 80%|████████  | 298613/371472 [1:35:50<5:40:24,  3.57it/s]
 80%|████████  | 298614/371472 [1:35:50<5:48:21,  3.49it/s]
 80%|████████  | 298615/371472 [1:35:50<5:40:00,  3.57it/s]
 80%|████████  | 298616/371472 [1:35:51<5:35:25,  3.62it/s]
 80%|████████  | 298617/371472 [1:35:51<5:34:44,  3.63it/s]
 80%|████████  | 298618/371472 [1:35:51<5:44:18,  3.53it/s]
 80%|████████  | 298619/371472 [1:35:51<5:33:09,  3.64it/s]
 80%|████████  | 298620/371472 [1:35:52<5:23:53,  3.75it/s]
                                                           
{'loss': 2.5953, 'learning_rate': 2.7660044387942e-07, 'epoch': 12.86}

 80%|████████  | 298620/371472 [1:35:52<5:23:53,  3.75it/s]
 80%|████████  | 298621/371472 [1:35:52<5:18:22,  3.81it/s]
 80%|████████  | 298622/371472 [1:35:52<5:13:11,  3.88it/s]
 80%|████████  | 298623/371472 [1:35:52<5:05:35,  3.97it/s]
 80%|████████  | 298624/371472 [1:35:53<5:01:48,  4.02it/s]
 80%|████████  | 298625/371472 [1:35:53<5:25:07,  3.73it/s]
 80%|████████  | 298626/371472 [1:35:53<5:54:31,  3.42it/s]
 80%|████████  | 298627/371472 [1:35:54<5:42:47,  3.54it/s]
 80%|████████  | 298628/371472 [1:35:54<5:34:02,  3.63it/s]
 80%|████████  | 298629/371472 [1:35:54<5:53:35,  3.43it/s]
 80%|████████  | 298630/371472 [1:35:54<5:43:01,  3.54it/s]
 80%|████████  | 298631/371472 [1:35:55<5:26:43,  3.72it/s]
 80%|████████  | 298632/371472 [1:35:55<5:52:55,  3.44it/s]
 80%|████████  | 298633/371472 [1:35:55<6:07:51,  3.30it/s]
 80%|████████  | 298634/371472 [1:35:56<5:51:30,  3.45it/s]
 80%|████████  | 298635/371472 [1:35:56<5:51:08,  3.46it/s]
 80%|████████  | 298636/371472 [1:35:56<5:59:26,  3.38it/s]
 80%|████████  | 298637/371472 [1:35:56<5:57:27,  3.40it/s]
 80%|████████  | 298638/371472 [1:35:57<5:52:56,  3.44it/s]
 80%|████████  | 298639/371472 [1:35:57<5:38:00,  3.59it/s]
 80%|████████  | 298640/371472 [1:35:57<5:39:54,  3.57it/s]
                                                           
{'loss': 2.7274, 'learning_rate': 2.7655196190394106e-07, 'epoch': 12.86}

 80%|████████  | 298640/371472 [1:35:57<5:39:54,  3.57it/s]
 80%|████████  | 298641/371472 [1:35:58<5:56:28,  3.41it/s]
 80%|████████  | 298642/371472 [1:35:58<5:51:17,  3.46it/s]
 80%|████████  | 298643/371472 [1:35:58<5:48:38,  3.48it/s]
 80%|████████  | 298644/371472 [1:35:58<5:55:25,  3.42it/s]
 80%|████████  | 298645/371472 [1:35:59<5:44:26,  3.52it/s]
 80%|████████  | 298646/371472 [1:35:59<5:41:44,  3.55it/s]
 80%|████████  | 298647/371472 [1:35:59<5:27:37,  3.70it/s]
 80%|████████  | 298648/371472 [1:35:59<5:29:03,  3.69it/s]
 80%|████████  | 298649/371472 [1:36:00<5:33:23,  3.64it/s]
 80%|████████  | 298650/371472 [1:36:00<5:22:50,  3.76it/s]
 80%|████████  | 298651/371472 [1:36:00<5:45:45,  3.51it/s]
 80%|████████  | 298652/371472 [1:36:01<5:41:38,  3.55it/s]
 80%|████████  | 298653/371472 [1:36:01<6:02:57,  3.34it/s]
 80%|████████  | 298654/371472 [1:36:01<5:55:23,  3.41it/s]
 80%|████████  | 298655/371472 [1:36:01<5:34:23,  3.63it/s]
 80%|████████  | 298656/371472 [1:36:02<5:18:27,  3.81it/s]
 80%|████████  | 298657/371472 [1:36:02<5:30:23,  3.67it/s]
 80%|████████  | 298658/371472 [1:36:02<5:52:42,  3.44it/s]
 80%|████████  | 298659/371472 [1:36:03<5:46:01,  3.51it/s]
 80%|████████  | 298660/371472 [1:36:03<5:46:12,  3.51it/s]
                                                           
{'loss': 2.7594, 'learning_rate': 2.765034799284621e-07, 'epoch': 12.86}

 80%|████████  | 298660/371472 [1:36:03<5:46:12,  3.51it/s]
 80%|████████  | 298661/371472 [1:36:03<5:26:24,  3.72it/s]
 80%|████████  | 298662/371472 [1:36:03<5:38:12,  3.59it/s]
 80%|████████  | 298663/371472 [1:36:04<5:36:36,  3.61it/s]
 80%|████████  | 298664/371472 [1:36:04<5:19:09,  3.80it/s]
 80%|████████  | 298665/371472 [1:36:04<5:21:18,  3.78it/s]
 80%|████████  | 298666/371472 [1:36:05<5:38:45,  3.58it/s]
 80%|████████  | 298667/371472 [1:36:05<5:36:02,  3.61it/s]
 80%|████████  | 298668/371472 [1:36:05<5:36:02,  3.61it/s]
 80%|████████  | 298669/371472 [1:36:05<5:35:18,  3.62it/s]
 80%|████████  | 298670/371472 [1:36:06<5:51:48,  3.45it/s]
 80%|████████  | 298671/371472 [1:36:06<6:01:37,  3.36it/s]
 80%|████████  | 298672/371472 [1:36:06<5:53:40,  3.43it/s]
 80%|████████  | 298673/371472 [1:36:07<6:26:38,  3.14it/s]
 80%|████████  | 298674/371472 [1:36:07<6:07:34,  3.30it/s]
 80%|████████  | 298675/371472 [1:36:07<5:48:44,  3.48it/s]
 80%|████████  | 298676/371472 [1:36:07<5:48:09,  3.48it/s]
 80%|████████  | 298677/371472 [1:36:08<5:32:16,  3.65it/s]
 80%|████████  | 298678/371472 [1:36:08<5:26:41,  3.71it/s]
 80%|████████  | 298679/371472 [1:36:08<5:48:52,  3.48it/s]
 80%|████████  | 298680/371472 [1:36:09<5:40:07,  3.57it/s]
                                                           
{'loss': 2.6732, 'learning_rate': 2.7645499795298325e-07, 'epoch': 12.86}

 80%|████████  | 298680/371472 [1:36:09<5:40:07,  3.57it/s]
 80%|████████  | 298681/371472 [1:36:09<5:51:26,  3.45it/s]
 80%|████████  | 298682/371472 [1:36:09<5:59:37,  3.37it/s]
 80%|████████  | 298683/371472 [1:36:09<5:54:44,  3.42it/s]
 80%|████████  | 298684/371472 [1:36:10<5:54:03,  3.43it/s]
 80%|████████  | 298685/371472 [1:36:10<5:56:12,  3.41it/s]
 80%|████████  | 298686/371472 [1:36:10<5:48:46,  3.48it/s]
 80%|████████  | 298687/371472 [1:36:11<5:39:30,  3.57it/s]
 80%|████████  | 298688/371472 [1:36:11<5:41:33,  3.55it/s]
 80%|████████  | 298689/371472 [1:36:11<5:37:08,  3.60it/s]
 80%|████████  | 298690/371472 [1:36:11<5:54:58,  3.42it/s]
 80%|████████  | 298691/371472 [1:36:12<6:02:21,  3.35it/s]
 80%|████████  | 298692/371472 [1:36:12<5:58:44,  3.38it/s]
 80%|████████  | 298693/371472 [1:36:12<6:01:33,  3.35it/s]
 80%|████████  | 298694/371472 [1:36:13<5:56:45,  3.40it/s]
 80%|████████  | 298695/371472 [1:36:13<5:51:46,  3.45it/s]
 80%|████████  | 298696/371472 [1:36:13<5:48:29,  3.48it/s]
 80%|████████  | 298697/371472 [1:36:13<5:57:14,  3.40it/s]
 80%|████████  | 298698/371472 [1:36:14<5:38:16,  3.59it/s]
 80%|████████  | 298699/371472 [1:36:14<5:34:57,  3.62it/s]
 80%|████████  | 298700/371472 [1:36:14<5:24:23,  3.74it/s]
                                                           
{'loss': 2.7139, 'learning_rate': 2.764065159775043e-07, 'epoch': 12.87}

 80%|████████  | 298700/371472 [1:36:14<5:24:23,  3.74it/s]
 80%|████████  | 298701/371472 [1:36:15<5:23:39,  3.75it/s]
 80%|████████  | 298702/371472 [1:36:15<5:21:00,  3.78it/s]
 80%|████████  | 298703/371472 [1:36:15<5:23:19,  3.75it/s]
 80%|████████  | 298704/371472 [1:36:15<5:32:16,  3.65it/s]
 80%|████████  | 298705/371472 [1:36:16<5:46:28,  3.50it/s]
 80%|████████  | 298706/371472 [1:36:16<5:32:36,  3.65it/s]
 80%|████████  | 298707/371472 [1:36:16<5:50:36,  3.46it/s]
 80%|████████  | 298708/371472 [1:36:16<5:43:51,  3.53it/s]
 80%|████████  | 298709/371472 [1:36:17<6:00:09,  3.37it/s]
 80%|████████  | 298710/371472 [1:36:17<5:51:01,  3.45it/s]
 80%|████████  | 298711/371472 [1:36:17<5:43:13,  3.53it/s]
 80%|████████  | 298712/371472 [1:36:18<5:42:30,  3.54it/s]
 80%|████████  | 298713/371472 [1:36:18<5:33:45,  3.63it/s]
 80%|████████  | 298714/371472 [1:36:18<5:34:12,  3.63it/s]
 80%|████████  | 298715/371472 [1:36:19<6:02:41,  3.34it/s]
 80%|████████  | 298716/371472 [1:36:19<5:57:23,  3.39it/s]
 80%|████████  | 298717/371472 [1:36:19<5:54:32,  3.42it/s]
 80%|████████  | 298718/371472 [1:36:19<6:22:39,  3.17it/s]
 80%|████████  | 298719/371472 [1:36:20<6:09:50,  3.28it/s]
 80%|████████  | 298720/371472 [1:36:20<6:11:35,  3.26it/s]
                                                           
{'loss': 2.6373, 'learning_rate': 2.763580340020255e-07, 'epoch': 12.87}

 80%|████████  | 298720/371472 [1:36:20<6:11:35,  3.26it/s]
 80%|████████  | 298721/371472 [1:36:20<5:53:53,  3.43it/s]
 80%|████████  | 298722/371472 [1:36:21<5:47:40,  3.49it/s]
 80%|████████  | 298723/371472 [1:36:21<5:51:12,  3.45it/s]
 80%|████████  | 298724/371472 [1:36:21<5:50:32,  3.46it/s]
 80%|████████  | 298725/371472 [1:36:21<5:55:54,  3.41it/s]
 80%|████████  | 298726/371472 [1:36:22<5:52:39,  3.44it/s]
 80%|████████  | 298727/371472 [1:36:22<5:36:20,  3.60it/s]
 80%|████████  | 298728/371472 [1:36:22<5:52:00,  3.44it/s]
 80%|████████  | 298729/371472 [1:36:23<5:37:17,  3.59it/s]
 80%|████████  | 298730/371472 [1:36:23<5:30:25,  3.67it/s]
 80%|████████  | 298731/371472 [1:36:23<5:35:43,  3.61it/s]
 80%|████████  | 298732/371472 [1:36:23<5:28:14,  3.69it/s]
 80%|████████  | 298733/371472 [1:36:24<5:30:44,  3.67it/s]
 80%|████████  | 298734/371472 [1:36:24<5:38:45,  3.58it/s]
 80%|████████  | 298735/371472 [1:36:24<5:40:16,  3.56it/s]
 80%|████████  | 298736/371472 [1:36:25<5:44:05,  3.52it/s]
 80%|████████  | 298737/371472 [1:36:25<5:37:40,  3.59it/s]
 80%|████████  | 298738/371472 [1:36:25<5:33:18,  3.64it/s]
 80%|████████  | 298739/371472 [1:36:25<5:21:56,  3.77it/s]
 80%|████████  | 298740/371472 [1:36:26<5:14:56,  3.85it/s]
                                                           
{'loss': 2.5931, 'learning_rate': 2.763095520265465e-07, 'epoch': 12.87}

 80%|████████  | 298740/371472 [1:36:26<5:14:56,  3.85it/s]
 80%|████████  | 298741/371472 [1:36:26<5:19:55,  3.79it/s]
 80%|████████  | 298742/371472 [1:36:26<5:29:14,  3.68it/s]
 80%|████████  | 298743/371472 [1:36:26<5:50:18,  3.46it/s]
 80%|████████  | 298744/371472 [1:36:27<6:03:55,  3.33it/s]
 80%|████████  | 298745/371472 [1:36:27<6:05:32,  3.32it/s]
 80%|████████  | 298746/371472 [1:36:27<6:21:45,  3.18it/s]
 80%|████████  | 298747/371472 [1:36:28<6:33:06,  3.08it/s]
 80%|████████  | 298748/371472 [1:36:28<6:15:06,  3.23it/s]
 80%|████████  | 298749/371472 [1:36:28<6:01:26,  3.35it/s]
 80%|████████  | 298750/371472 [1:36:29<6:01:49,  3.35it/s]
 80%|████████  | 298751/371472 [1:36:29<5:50:06,  3.46it/s]
 80%|████████  | 298752/371472 [1:36:29<5:34:20,  3.63it/s]
 80%|████████  | 298753/371472 [1:36:29<5:46:36,  3.50it/s]
 80%|████████  | 298754/371472 [1:36:30<6:19:20,  3.19it/s]
 80%|████████  | 298755/371472 [1:36:30<6:01:18,  3.35it/s]
 80%|████████  | 298756/371472 [1:36:30<5:52:32,  3.44it/s]
 80%|████████  | 298757/371472 [1:36:31<5:44:58,  3.51it/s]
 80%|████████  | 298758/371472 [1:36:31<5:51:58,  3.44it/s]
 80%|████████  | 298759/371472 [1:36:31<6:20:56,  3.18it/s]
 80%|████████  | 298760/371472 [1:36:32<5:57:38,  3.39it/s]
                                                           
{'loss': 2.7149, 'learning_rate': 2.7626107005106765e-07, 'epoch': 12.87}

 80%|████████  | 298760/371472 [1:36:32<5:57:38,  3.39it/s]
 80%|████████  | 298761/371472 [1:36:32<5:44:38,  3.52it/s]
 80%|████████  | 298762/371472 [1:36:32<5:37:59,  3.59it/s]
 80%|████████  | 298763/371472 [1:36:32<5:35:46,  3.61it/s]
 80%|████████  | 298764/371472 [1:36:33<5:28:45,  3.69it/s]
 80%|████████  | 298765/371472 [1:36:33<5:28:54,  3.68it/s]
 80%|████████  | 298766/371472 [1:36:33<5:25:07,  3.73it/s]
 80%|████████  | 298767/371472 [1:36:33<5:24:36,  3.73it/s]
 80%|████████  | 298768/371472 [1:36:34<5:40:30,  3.56it/s]
 80%|████████  | 298769/371472 [1:36:34<5:34:28,  3.62it/s]
 80%|████████  | 298770/371472 [1:36:34<5:30:10,  3.67it/s]
 80%|████████  | 298771/371472 [1:36:35<5:22:40,  3.76it/s]
 80%|████████  | 298772/371472 [1:36:35<5:22:56,  3.75it/s]
 80%|████████  | 298773/371472 [1:36:35<5:26:34,  3.71it/s]
 80%|████████  | 298774/371472 [1:36:35<5:40:26,  3.56it/s]
 80%|████████  | 298775/371472 [1:36:36<5:31:50,  3.65it/s]
 80%|████████  | 298776/371472 [1:36:36<5:42:34,  3.54it/s]
 80%|████████  | 298777/371472 [1:36:36<5:43:34,  3.53it/s]
 80%|████████  | 298778/371472 [1:36:37<6:00:37,  3.36it/s]
 80%|████████  | 298779/371472 [1:36:37<5:38:49,  3.58it/s]
 80%|████████  | 298780/371472 [1:36:37<5:28:01,  3.69it/s]
                                                           
{'loss': 2.6343, 'learning_rate': 2.762125880755887e-07, 'epoch': 12.87}

 80%|████████  | 298780/371472 [1:36:37<5:28:01,  3.69it/s]
 80%|████████  | 298781/371472 [1:36:37<5:39:32,  3.57it/s]
 80%|████████  | 298782/371472 [1:36:38<5:36:51,  3.60it/s]
 80%|████████  | 298783/371472 [1:36:38<5:35:41,  3.61it/s]
 80%|████████  | 298784/371472 [1:36:38<5:30:42,  3.66it/s]
 80%|████████  | 298785/371472 [1:36:38<5:39:37,  3.57it/s]
 80%|████████  | 298786/371472 [1:36:39<5:45:45,  3.50it/s]
 80%|████████  | 298787/371472 [1:36:39<5:33:52,  3.63it/s]
 80%|████████  | 298788/371472 [1:36:39<5:17:12,  3.82it/s]
 80%|████████  | 298789/371472 [1:36:39<5:21:15,  3.77it/s]
 80%|████████  | 298790/371472 [1:36:40<5:21:36,  3.77it/s]
 80%|████████  | 298791/371472 [1:36:40<5:25:52,  3.72it/s]
 80%|████████  | 298792/371472 [1:36:40<5:28:02,  3.69it/s]
 80%|████████  | 298793/371472 [1:36:41<5:36:29,  3.60it/s]
 80%|████████  | 298794/371472 [1:36:41<5:26:34,  3.71it/s]
 80%|████████  | 298795/371472 [1:36:41<5:37:36,  3.59it/s]
 80%|████████  | 298796/371472 [1:36:41<5:39:53,  3.56it/s]
 80%|████████  | 298797/371472 [1:36:42<5:54:06,  3.42it/s]
 80%|████████  | 298798/371472 [1:36:42<5:52:10,  3.44it/s]
 80%|████████  | 298799/371472 [1:36:42<5:47:09,  3.49it/s]
 80%|████████  | 298800/371472 [1:36:43<5:52:26,  3.44it/s]
                                                           
{'loss': 2.6087, 'learning_rate': 2.761641061001099e-07, 'epoch': 12.87}

 80%|████████  | 298800/371472 [1:36:43<5:52:26,  3.44it/s]
 80%|████████  | 298801/371472 [1:36:43<6:00:03,  3.36it/s]
 80%|████████  | 298802/371472 [1:36:43<6:08:16,  3.29it/s]
 80%|████████  | 298803/371472 [1:36:44<5:55:53,  3.40it/s]
 80%|████████  | 298804/371472 [1:36:44<5:55:57,  3.40it/s]
 80%|████████  | 298805/371472 [1:36:44<5:45:38,  3.50it/s]
 80%|████████  | 298806/371472 [1:36:44<5:40:37,  3.56it/s]
 80%|████████  | 298807/371472 [1:36:45<5:29:27,  3.68it/s]
 80%|████████  | 298808/371472 [1:36:45<5:29:14,  3.68it/s]
 80%|████████  | 298809/371472 [1:36:45<5:40:06,  3.56it/s]
 80%|████████  | 298810/371472 [1:36:45<5:33:23,  3.63it/s]
 80%|████████  | 298811/371472 [1:36:46<5:30:50,  3.66it/s]
 80%|████████  | 298812/371472 [1:36:46<5:46:38,  3.49it/s]
 80%|████████  | 298813/371472 [1:36:46<5:44:12,  3.52it/s]
 80%|████████  | 298814/371472 [1:36:47<5:36:47,  3.60it/s]
 80%|████████  | 298815/371472 [1:36:47<5:24:53,  3.73it/s]
 80%|████████  | 298816/371472 [1:36:47<5:48:30,  3.47it/s]
 80%|████████  | 298817/371472 [1:36:47<5:54:45,  3.41it/s]
 80%|████████  | 298818/371472 [1:36:48<6:05:15,  3.32it/s]
 80%|████████  | 298819/371472 [1:36:48<6:11:53,  3.26it/s]
 80%|████████  | 298820/371472 [1:36:48<5:59:54,  3.36it/s]
                                                           
{'loss': 2.6823, 'learning_rate': 2.7611562412463097e-07, 'epoch': 12.87}

 80%|████████  | 298820/371472 [1:36:48<5:59:54,  3.36it/s]
 80%|████████  | 298821/371472 [1:36:49<5:55:58,  3.40it/s]
 80%|████████  | 298822/371472 [1:36:49<5:44:56,  3.51it/s]
 80%|████████  | 298823/371472 [1:36:49<5:25:57,  3.71it/s]
 80%|████████  | 298824/371472 [1:36:49<5:21:11,  3.77it/s]
 80%|████████  | 298825/371472 [1:36:50<5:11:14,  3.89it/s]
 80%|████████  | 298826/371472 [1:36:50<5:13:28,  3.86it/s]
 80%|████████  | 298827/371472 [1:36:50<5:15:16,  3.84it/s]
 80%|████████  | 298828/371472 [1:36:50<5:20:37,  3.78it/s]
 80%|████████  | 298829/371472 [1:36:51<5:25:38,  3.72it/s]
 80%|████████  | 298830/371472 [1:36:51<5:27:57,  3.69it/s]
 80%|████████  | 298831/371472 [1:36:51<5:28:48,  3.68it/s]
 80%|████████  | 298832/371472 [1:36:52<5:31:49,  3.65it/s]
 80%|████████  | 298833/371472 [1:36:52<5:34:30,  3.62it/s]
 80%|████████  | 298834/371472 [1:36:52<5:23:38,  3.74it/s]
 80%|████████  | 298835/371472 [1:36:52<5:27:29,  3.70it/s]
 80%|████████  | 298836/371472 [1:36:53<5:21:27,  3.77it/s]
 80%|████████  | 298837/371472 [1:36:53<5:41:17,  3.55it/s]
 80%|████████  | 298838/371472 [1:36:53<5:42:27,  3.53it/s]
 80%|████████  | 298839/371472 [1:36:54<5:46:46,  3.49it/s]
 80%|████████  | 298840/371472 [1:36:54<5:42:26,  3.53it/s]
                                                           
{'loss': 2.6577, 'learning_rate': 2.7606714214915214e-07, 'epoch': 12.87}

 80%|████████  | 298840/371472 [1:36:54<5:42:26,  3.53it/s]
 80%|████████  | 298841/371472 [1:36:54<5:47:10,  3.49it/s]
 80%|████████  | 298842/371472 [1:36:54<5:52:49,  3.43it/s]
 80%|████████  | 298843/371472 [1:36:55<5:37:24,  3.59it/s]
 80%|████████  | 298844/371472 [1:36:55<5:38:17,  3.58it/s]
 80%|████████  | 298845/371472 [1:36:55<5:33:22,  3.63it/s]
 80%|████████  | 298846/371472 [1:36:55<5:21:31,  3.76it/s]
 80%|████████  | 298847/371472 [1:36:56<5:20:09,  3.78it/s]
 80%|████████  | 298848/371472 [1:36:56<5:23:38,  3.74it/s]
 80%|████████  | 298849/371472 [1:36:56<5:29:04,  3.68it/s]
 80%|████████  | 298850/371472 [1:36:57<5:33:59,  3.62it/s]
 80%|████████  | 298851/371472 [1:36:57<5:25:33,  3.72it/s]
 80%|████████  | 298852/371472 [1:36:57<6:11:06,  3.26it/s]
 80%|████████  | 298853/371472 [1:36:57<5:51:03,  3.45it/s]
 80%|████████  | 298854/371472 [1:36:58<5:51:02,  3.45it/s]
 80%|████████  | 298855/371472 [1:36:58<5:53:55,  3.42it/s]
 80%|████████  | 298856/371472 [1:36:58<5:56:18,  3.40it/s]
 80%|████████  | 298857/371472 [1:36:59<5:48:33,  3.47it/s]
 80%|████████  | 298858/371472 [1:36:59<5:35:37,  3.61it/s]
 80%|████████  | 298859/371472 [1:36:59<5:51:29,  3.44it/s]
 80%|████████  | 298860/371472 [1:36:59<5:46:12,  3.50it/s]
                                                           
{'loss': 2.7138, 'learning_rate': 2.7601866017367316e-07, 'epoch': 12.87}

 80%|████████  | 298860/371472 [1:36:59<5:46:12,  3.50it/s]
 80%|████████  | 298861/371472 [1:37:00<5:39:43,  3.56it/s]
 80%|████████  | 298862/371472 [1:37:00<5:44:25,  3.51it/s]
 80%|████████  | 298863/371472 [1:37:00<5:45:47,  3.50it/s]
 80%|████████  | 298864/371472 [1:37:01<5:30:45,  3.66it/s]
 80%|████████  | 298865/371472 [1:37:01<5:26:40,  3.70it/s]
 80%|████████  | 298866/371472 [1:37:01<5:33:08,  3.63it/s]
 80%|████████  | 298867/371472 [1:37:01<5:51:41,  3.44it/s]
 80%|████████  | 298868/371472 [1:37:02<5:42:32,  3.53it/s]
 80%|████████  | 298869/371472 [1:37:02<5:45:02,  3.51it/s]
 80%|████████  | 298870/371472 [1:37:02<5:36:55,  3.59it/s]
 80%|████████  | 298871/371472 [1:37:02<5:34:26,  3.62it/s]
 80%|████████  | 298872/371472 [1:37:03<5:32:05,  3.64it/s]
 80%|████████  | 298873/371472 [1:37:03<5:30:20,  3.66it/s]
 80%|████████  | 298874/371472 [1:37:03<5:27:12,  3.70it/s]
 80%|████████  | 298875/371472 [1:37:04<5:27:18,  3.70it/s]
 80%|████████  | 298876/371472 [1:37:04<5:30:51,  3.66it/s]
 80%|████████  | 298877/371472 [1:37:04<5:34:56,  3.61it/s]
 80%|████████  | 298878/371472 [1:37:04<5:42:48,  3.53it/s]
 80%|████████  | 298879/371472 [1:37:05<5:40:02,  3.56it/s]
 80%|████████  | 298880/371472 [1:37:05<5:46:26,  3.49it/s]
                                                           
{'loss': 2.6444, 'learning_rate': 2.759701781981943e-07, 'epoch': 12.87}

 80%|████████  | 298880/371472 [1:37:05<5:46:26,  3.49it/s]
 80%|████████  | 298881/371472 [1:37:05<5:44:54,  3.51it/s]
 80%|████████  | 298882/371472 [1:37:06<5:47:37,  3.48it/s]
 80%|████████  | 298883/371472 [1:37:06<5:48:19,  3.47it/s]
 80%|████████  | 298884/371472 [1:37:06<5:57:20,  3.39it/s]
 80%|████████  | 298885/371472 [1:37:06<5:47:37,  3.48it/s]
 80%|████████  | 298886/371472 [1:37:07<5:41:28,  3.54it/s]
 80%|████████  | 298887/371472 [1:37:07<5:54:51,  3.41it/s]
 80%|████████  | 298888/371472 [1:37:07<6:10:11,  3.27it/s]
 80%|████████  | 298889/371472 [1:37:08<6:31:02,  3.09it/s]
 80%|████████  | 298890/371472 [1:37:08<6:11:50,  3.25it/s]
 80%|████████  | 298891/371472 [1:37:08<6:02:35,  3.34it/s]
 80%|████████  | 298892/371472 [1:37:09<6:03:51,  3.32it/s]
 80%|████████  | 298893/371472 [1:37:09<6:02:23,  3.34it/s]
 80%|████████  | 298894/371472 [1:37:09<5:42:44,  3.53it/s]
 80%|████████  | 298895/371472 [1:37:09<6:12:06,  3.25it/s]
 80%|████████  | 298896/371472 [1:37:10<6:11:28,  3.26it/s]
 80%|████████  | 298897/371472 [1:37:10<5:55:31,  3.40it/s]
 80%|████████  | 298898/371472 [1:37:10<5:35:50,  3.60it/s]
 80%|████████  | 298899/371472 [1:37:11<5:18:28,  3.80it/s]
 80%|████████  | 298900/371472 [1:37:11<5:16:04,  3.83it/s]
                                                           
{'loss': 2.633, 'learning_rate': 2.7592169622271536e-07, 'epoch': 12.87}

 80%|████████  | 298900/371472 [1:37:11<5:16:04,  3.83it/s]
 80%|████████  | 298901/371472 [1:37:11<5:16:42,  3.82it/s]
 80%|████████  | 298902/371472 [1:37:11<5:19:18,  3.79it/s]
 80%|████████  | 298903/371472 [1:37:12<5:18:57,  3.79it/s]
 80%|████████  | 298904/371472 [1:37:12<5:42:12,  3.53it/s]
 80%|████████  | 298905/371472 [1:37:12<5:50:09,  3.45it/s]
 80%|████████  | 298906/371472 [1:37:12<5:38:17,  3.58it/s]
 80%|████████  | 298907/371472 [1:37:13<5:22:57,  3.74it/s]
 80%|████████  | 298908/371472 [1:37:13<5:45:41,  3.50it/s]
 80%|████████  | 298909/371472 [1:37:13<5:42:17,  3.53it/s]
 80%|████████  | 298910/371472 [1:37:14<5:24:03,  3.73it/s]
 80%|████████  | 298911/371472 [1:37:14<5:30:27,  3.66it/s]
 80%|████████  | 298912/371472 [1:37:14<5:49:25,  3.46it/s]
 80%|████████  | 298913/371472 [1:37:14<5:44:47,  3.51it/s]
 80%|████████  | 298914/371472 [1:37:15<5:34:36,  3.61it/s]
 80%|████████  | 298915/371472 [1:37:15<5:34:49,  3.61it/s]
 80%|████████  | 298916/371472 [1:37:15<5:40:15,  3.55it/s]
 80%|████████  | 298917/371472 [1:37:16<5:47:08,  3.48it/s]
 80%|████████  | 298918/371472 [1:37:16<5:57:05,  3.39it/s]
 80%|████████  | 298919/371472 [1:37:16<5:59:24,  3.36it/s]
 80%|████████  | 298920/371472 [1:37:16<6:02:02,  3.34it/s]
                                                           
{'loss': 2.5574, 'learning_rate': 2.7587321424723654e-07, 'epoch': 12.88}

 80%|████████  | 298920/371472 [1:37:16<6:02:02,  3.34it/s]
 80%|████████  | 298921/371472 [1:37:17<5:45:36,  3.50it/s]
 80%|████████  | 298922/371472 [1:37:17<5:29:45,  3.67it/s]
 80%|████████  | 298923/371472 [1:37:17<5:39:08,  3.57it/s]
 80%|████████  | 298924/371472 [1:37:18<5:31:22,  3.65it/s]
 80%|████████  | 298925/371472 [1:37:18<5:33:26,  3.63it/s]
 80%|████████  | 298926/371472 [1:37:18<5:50:25,  3.45it/s]
 80%|████████  | 298927/371472 [1:37:18<5:38:55,  3.57it/s]
 80%|████████  | 298928/371472 [1:37:19<5:42:21,  3.53it/s]
 80%|████████  | 298929/371472 [1:37:19<5:42:04,  3.53it/s]
 80%|████████  | 298930/371472 [1:37:19<5:47:06,  3.48it/s]
 80%|████████  | 298931/371472 [1:37:20<5:40:25,  3.55it/s]
 80%|████████  | 298932/371472 [1:37:20<5:31:05,  3.65it/s]
 80%|████████  | 298933/371472 [1:37:20<5:36:55,  3.59it/s]
 80%|████████  | 298934/371472 [1:37:20<5:34:57,  3.61it/s]
 80%|████████  | 298935/371472 [1:37:21<6:01:23,  3.35it/s]
 80%|████████  | 298936/371472 [1:37:21<6:11:06,  3.26it/s]
 80%|████████  | 298937/371472 [1:37:21<6:07:32,  3.29it/s]
 80%|████████  | 298938/371472 [1:37:22<5:49:36,  3.46it/s]
 80%|████████  | 298939/371472 [1:37:22<5:45:00,  3.50it/s]
 80%|████████  | 298940/371472 [1:37:22<6:02:55,  3.33it/s]
                                                           
{'loss': 2.4667, 'learning_rate': 2.758247322717576e-07, 'epoch': 12.88}

 80%|████████  | 298940/371472 [1:37:22<6:02:55,  3.33it/s]
 80%|████████  | 298941/371472 [1:37:22<5:49:59,  3.45it/s]
 80%|████████  | 298942/371472 [1:37:23<5:42:36,  3.53it/s]
 80%|████████  | 298943/371472 [1:37:23<5:34:53,  3.61it/s]
 80%|████████  | 298944/371472 [1:37:23<5:31:38,  3.64it/s]
 80%|████████  | 298945/371472 [1:37:24<5:34:57,  3.61it/s]
 80%|████████  | 298946/371472 [1:37:24<5:25:17,  3.72it/s]
 80%|████████  | 298947/371472 [1:37:24<5:39:44,  3.56it/s]
 80%|████████  | 298948/371472 [1:37:24<5:29:15,  3.67it/s]
 80%|████████  | 298949/371472 [1:37:25<5:47:31,  3.48it/s]
 80%|████████  | 298950/371472 [1:37:25<5:48:47,  3.47it/s]
 80%|████████  | 298951/371472 [1:37:25<5:40:02,  3.55it/s]
 80%|████████  | 298952/371472 [1:37:26<6:14:34,  3.23it/s]
 80%|████████  | 298953/371472 [1:37:26<5:59:05,  3.37it/s]
 80%|████████  | 298954/371472 [1:37:26<5:53:41,  3.42it/s]
 80%|████████  | 298955/371472 [1:37:26<5:43:21,  3.52it/s]
 80%|████████  | 298956/371472 [1:37:27<5:47:07,  3.48it/s]
 80%|████████  | 298957/371472 [1:37:27<5:54:04,  3.41it/s]
 80%|████████  | 298958/371472 [1:37:27<5:37:25,  3.58it/s]
 80%|████████  | 298959/371472 [1:37:28<5:36:08,  3.60it/s]
 80%|████████  | 298960/371472 [1:37:28<5:57:58,  3.38it/s]
                                                           
{'loss': 2.6237, 'learning_rate': 2.757762502962788e-07, 'epoch': 12.88}

 80%|████████  | 298960/371472 [1:37:28<5:57:58,  3.38it/s]
 80%|████████  | 298961/371472 [1:37:28<5:45:24,  3.50it/s]
 80%|████████  | 298962/371472 [1:37:28<5:59:48,  3.36it/s]
 80%|████████  | 298963/371472 [1:37:29<5:51:33,  3.44it/s]
 80%|████████  | 298964/371472 [1:37:29<5:30:23,  3.66it/s]
 80%|████████  | 298965/371472 [1:37:29<5:17:56,  3.80it/s]
 80%|████████  | 298966/371472 [1:37:30<5:42:37,  3.53it/s]
 80%|████████  | 298967/371472 [1:37:30<6:31:18,  3.09it/s]
 80%|████████  | 298968/371472 [1:37:30<6:04:13,  3.32it/s]
 80%|████████  | 298969/371472 [1:37:30<5:41:16,  3.54it/s]
 80%|████████  | 298970/371472 [1:37:31<5:31:10,  3.65it/s]
 80%|████████  | 298971/371472 [1:37:31<5:48:01,  3.47it/s]
 80%|████████  | 298972/371472 [1:37:31<5:43:03,  3.52it/s]
 80%|████████  | 298973/371472 [1:37:32<5:24:27,  3.72it/s]
 80%|████████  | 298974/371472 [1:37:32<5:26:51,  3.70it/s]
 80%|████████  | 298975/371472 [1:37:32<5:27:09,  3.69it/s]
 80%|████████  | 298976/371472 [1:37:32<5:21:24,  3.76it/s]
 80%|████████  | 298977/371472 [1:37:33<5:19:42,  3.78it/s]
 80%|████████  | 298978/371472 [1:37:33<5:20:13,  3.77it/s]
 80%|████████  | 298979/371472 [1:37:33<5:18:46,  3.79it/s]
 80%|████████  | 298980/371472 [1:37:33<5:13:57,  3.85it/s]
                                                           
{'loss': 2.7041, 'learning_rate': 2.757277683207998e-07, 'epoch': 12.88}

 80%|████████  | 298980/371472 [1:37:33<5:13:57,  3.85it/s]
 80%|████████  | 298981/371472 [1:37:34<5:45:27,  3.50it/s]
 80%|████████  | 298982/371472 [1:37:34<5:44:59,  3.50it/s]
 80%|████████  | 298983/371472 [1:37:34<5:47:09,  3.48it/s]
 80%|████████  | 298984/371472 [1:37:35<5:32:05,  3.64it/s]
 80%|████████  | 298985/371472 [1:37:35<5:26:18,  3.70it/s]
 80%|████████  | 298986/371472 [1:37:35<5:29:14,  3.67it/s]
 80%|████████  | 298987/371472 [1:37:35<5:37:21,  3.58it/s]
 80%|████████  | 298988/371472 [1:37:36<5:27:56,  3.68it/s]
 80%|████████  | 298989/371472 [1:37:36<5:20:05,  3.77it/s]
 80%|████████  | 298990/371472 [1:37:36<5:33:04,  3.63it/s]
 80%|████████  | 298991/371472 [1:37:36<5:30:37,  3.65it/s]
 80%|████████  | 298992/371472 [1:37:37<5:25:32,  3.71it/s]
 80%|████████  | 298993/371472 [1:37:37<5:43:49,  3.51it/s]
 80%|████████  | 298994/371472 [1:37:37<5:43:52,  3.51it/s]
 80%|████████  | 298995/371472 [1:37:38<5:49:16,  3.46it/s]
 80%|████████  | 298996/371472 [1:37:38<6:05:18,  3.31it/s]
 80%|████████  | 298997/371472 [1:37:38<6:17:43,  3.20it/s]
 80%|████████  | 298998/371472 [1:37:39<6:03:20,  3.32it/s]
 80%|████████  | 298999/371472 [1:37:39<5:48:50,  3.46it/s]
 80%|████████  | 299000/371472 [1:37:39<5:46:49,  3.48it/s]
                                                           
{'loss': 2.6107, 'learning_rate': 2.75679286345321e-07, 'epoch': 12.88}

 80%|████████  | 299000/371472 [1:37:39<5:46:49,  3.48it/s]
 80%|████████  | 299001/371472 [1:37:39<5:40:08,  3.55it/s]
 80%|████████  | 299002/371472 [1:37:40<6:03:44,  3.32it/s]
 80%|████████  | 299003/371472 [1:37:40<5:47:38,  3.47it/s]
 80%|████████  | 299004/371472 [1:37:40<5:36:06,  3.59it/s]
 80%|████████  | 299005/371472 [1:37:40<5:29:38,  3.66it/s]
 80%|████████  | 299006/371472 [1:37:41<5:55:47,  3.39it/s]
 80%|████████  | 299007/371472 [1:37:41<5:41:09,  3.54it/s]
 80%|████████  | 299008/371472 [1:37:41<5:34:40,  3.61it/s]
 80%|████████  | 299009/371472 [1:37:42<5:44:57,  3.50it/s]
 80%|████████  | 299010/371472 [1:37:42<5:46:55,  3.48it/s]
 80%|████████  | 299011/371472 [1:37:42<5:44:04,  3.51it/s]
 80%|████████  | 299012/371472 [1:37:43<5:40:44,  3.54it/s]
 80%|████████  | 299013/371472 [1:37:43<5:37:05,  3.58it/s]
 80%|████████  | 299014/371472 [1:37:43<5:34:39,  3.61it/s]
 80%|████████  | 299015/371472 [1:37:43<5:41:13,  3.54it/s]
 80%|████████  | 299016/371472 [1:37:44<5:40:53,  3.54it/s]
 80%|████████  | 299017/371472 [1:37:44<5:29:30,  3.66it/s]
 80%|████████  | 299018/371472 [1:37:44<5:21:55,  3.75it/s]
 80%|████████  | 299019/371472 [1:37:44<5:21:04,  3.76it/s]
 80%|████████  | 299020/371472 [1:37:45<5:18:43,  3.79it/s]
                                                           
{'loss': 2.7385, 'learning_rate': 2.75630804369842e-07, 'epoch': 12.88}

 80%|████████  | 299020/371472 [1:37:45<5:18:43,  3.79it/s]
 80%|████████  | 299021/371472 [1:37:45<5:31:55,  3.64it/s]
 80%|████████  | 299022/371472 [1:37:45<5:56:46,  3.38it/s]
 80%|████████  | 299023/371472 [1:37:46<5:48:35,  3.46it/s]
 80%|████████  | 299024/371472 [1:37:46<5:39:25,  3.56it/s]
 80%|████████  | 299025/371472 [1:37:46<6:08:47,  3.27it/s]
 80%|████████  | 299026/371472 [1:37:46<5:51:56,  3.43it/s]
 80%|████████  | 299027/371472 [1:37:47<5:41:15,  3.54it/s]
 80%|████████  | 299028/371472 [1:37:47<5:29:38,  3.66it/s]
 80%|████████  | 299029/371472 [1:37:47<5:27:10,  3.69it/s]
 80%|████████  | 299030/371472 [1:37:48<5:44:08,  3.51it/s]
 80%|████████  | 299031/371472 [1:37:48<5:38:37,  3.57it/s]
 80%|████████  | 299032/371472 [1:37:48<5:25:00,  3.71it/s]
 80%|████████  | 299033/371472 [1:37:48<5:16:18,  3.82it/s]
 80%|████████  | 299034/371472 [1:37:49<5:08:58,  3.91it/s]
 81%|████████  | 299035/371472 [1:37:49<5:33:38,  3.62it/s]
 81%|████████  | 299036/371472 [1:37:49<5:22:30,  3.74it/s]
 81%|████████  | 299037/371472 [1:37:49<5:22:59,  3.74it/s]
 81%|████████  | 299038/371472 [1:37:50<5:21:20,  3.76it/s]
 81%|████████  | 299039/371472 [1:37:50<5:18:06,  3.80it/s]
 81%|████████  | 299040/371472 [1:37:50<5:40:41,  3.54it/s]
                                                           
{'loss': 2.6392, 'learning_rate': 2.755823223943632e-07, 'epoch': 12.88}

 81%|████████  | 299040/371472 [1:37:50<5:40:41,  3.54it/s]
 81%|████████  | 299041/371472 [1:37:51<5:53:08,  3.42it/s]
 81%|████████  | 299042/371472 [1:37:51<5:49:48,  3.45it/s]
 81%|████████  | 299043/371472 [1:37:51<5:38:10,  3.57it/s]
 81%|████████  | 299044/371472 [1:37:51<5:46:15,  3.49it/s]
 81%|████████  | 299045/371472 [1:37:52<5:40:11,  3.55it/s]
 81%|████████  | 299046/371472 [1:37:52<5:42:52,  3.52it/s]
 81%|████████  | 299047/371472 [1:37:52<5:52:17,  3.43it/s]
 81%|████████  | 299048/371472 [1:37:53<5:39:55,  3.55it/s]
 81%|████████  | 299049/371472 [1:37:53<5:36:26,  3.59it/s]
 81%|████████  | 299050/371472 [1:37:53<5:30:11,  3.66it/s]
 81%|████████  | 299051/371472 [1:37:53<5:36:37,  3.59it/s]
 81%|████████  | 299052/371472 [1:37:54<5:26:25,  3.70it/s]
 81%|████████  | 299053/371472 [1:37:54<5:30:59,  3.65it/s]
 81%|████████  | 299054/371472 [1:37:54<5:50:27,  3.44it/s]
 81%|████████  | 299055/371472 [1:37:55<6:03:15,  3.32it/s]
 81%|████████  | 299056/371472 [1:37:55<5:42:54,  3.52it/s]
 81%|████████  | 299057/371472 [1:37:55<5:43:25,  3.51it/s]
 81%|████████  | 299058/371472 [1:37:55<5:49:24,  3.45it/s]
 81%|████████  | 299059/371472 [1:37:56<5:55:19,  3.40it/s]
 81%|████████  | 299060/371472 [1:37:56<5:58:20,  3.37it/s]
                                                           
{'loss': 2.6229, 'learning_rate': 2.7553384041888425e-07, 'epoch': 12.88}

 81%|████████  | 299060/371472 [1:37:56<5:58:20,  3.37it/s]
 81%|████████  | 299061/371472 [1:37:56<6:08:43,  3.27it/s]
 81%|████████  | 299062/371472 [1:37:57<6:09:03,  3.27it/s]
 81%|████████  | 299063/371472 [1:37:57<5:56:29,  3.39it/s]
 81%|████████  | 299064/371472 [1:37:57<5:48:33,  3.46it/s]
 81%|████████  | 299065/371472 [1:37:57<5:46:48,  3.48it/s]
 81%|████████  | 299066/371472 [1:37:58<5:36:58,  3.58it/s]
 81%|████████  | 299067/371472 [1:37:58<5:35:40,  3.59it/s]
 81%|████████  | 299068/371472 [1:37:58<5:33:50,  3.61it/s]
 81%|████████  | 299069/371472 [1:37:59<5:24:15,  3.72it/s]
 81%|████████  | 299070/371472 [1:37:59<5:29:22,  3.66it/s]
 81%|████████  | 299071/371472 [1:37:59<5:28:14,  3.68it/s]
 81%|████████  | 299072/371472 [1:37:59<5:22:45,  3.74it/s]
 81%|████████  | 299073/371472 [1:38:00<5:36:58,  3.58it/s]
 81%|████████  | 299074/371472 [1:38:00<5:28:07,  3.68it/s]
 81%|████████  | 299075/371472 [1:38:00<5:26:20,  3.70it/s]
 81%|████████  | 299076/371472 [1:38:00<5:22:57,  3.74it/s]
 81%|████████  | 299077/371472 [1:38:01<5:22:32,  3.74it/s]
 81%|████████  | 299078/371472 [1:38:01<6:06:06,  3.30it/s]
 81%|████████  | 299079/371472 [1:38:01<6:12:04,  3.24it/s]
 81%|████████  | 299080/371472 [1:38:02<6:09:35,  3.26it/s]
                                                           
{'loss': 2.7297, 'learning_rate': 2.754853584434054e-07, 'epoch': 12.88}

 81%|████████  | 299080/371472 [1:38:02<6:09:35,  3.26it/s]
 81%|████████  | 299081/371472 [1:38:02<6:02:36,  3.33it/s]
 81%|████████  | 299082/371472 [1:38:02<6:06:19,  3.29it/s]
 81%|████████  | 299083/371472 [1:38:03<6:44:10,  2.99it/s]
 81%|████████  | 299084/371472 [1:38:03<6:25:52,  3.13it/s]
 81%|████████  | 299085/371472 [1:38:03<6:21:21,  3.16it/s]
 81%|████████  | 299086/371472 [1:38:04<6:16:39,  3.20it/s]
 81%|████████  | 299087/371472 [1:38:04<6:14:48,  3.22it/s]
 81%|████████  | 299088/371472 [1:38:04<6:01:03,  3.34it/s]
 81%|████████  | 299089/371472 [1:38:04<5:57:47,  3.37it/s]
 81%|████████  | 299090/371472 [1:38:05<5:48:53,  3.46it/s]
 81%|████████  | 299091/371472 [1:38:05<5:37:23,  3.58it/s]
 81%|████████  | 299092/371472 [1:38:05<6:01:01,  3.34it/s]
 81%|████████  | 299093/371472 [1:38:06<5:58:44,  3.36it/s]
 81%|████████  | 299094/371472 [1:38:06<5:47:18,  3.47it/s]
 81%|████████  | 299095/371472 [1:38:06<5:50:34,  3.44it/s]
 81%|████████  | 299096/371472 [1:38:06<5:53:10,  3.42it/s]
 81%|████████  | 299097/371472 [1:38:07<5:55:53,  3.39it/s]
 81%|████████  | 299098/371472 [1:38:07<5:50:54,  3.44it/s]
 81%|████████  | 299099/371472 [1:38:07<5:42:56,  3.52it/s]
 81%|████████  | 299100/371472 [1:38:08<5:34:15,  3.61it/s]
                                                           
{'loss': 2.6914, 'learning_rate': 2.754368764679265e-07, 'epoch': 12.88}

 81%|████████  | 299100/371472 [1:38:08<5:34:15,  3.61it/s]
 81%|████████  | 299101/371472 [1:38:08<5:48:30,  3.46it/s]
 81%|████████  | 299102/371472 [1:38:08<5:48:31,  3.46it/s]
 81%|████████  | 299103/371472 [1:38:09<6:06:38,  3.29it/s]
 81%|████████  | 299104/371472 [1:38:09<5:52:29,  3.42it/s]
 81%|████████  | 299105/371472 [1:38:09<5:37:30,  3.57it/s]
 81%|████████  | 299106/371472 [1:38:09<5:38:40,  3.56it/s]
 81%|████████  | 299107/371472 [1:38:10<5:43:17,  3.51it/s]
 81%|████████  | 299108/371472 [1:38:10<5:33:47,  3.61it/s]
 81%|████████  | 299109/371472 [1:38:10<5:35:55,  3.59it/s]
 81%|████████  | 299110/371472 [1:38:10<5:36:18,  3.59it/s]
 81%|████████  | 299111/371472 [1:38:11<5:31:25,  3.64it/s]
 81%|████████  | 299112/371472 [1:38:11<5:24:55,  3.71it/s]
 81%|████████  | 299113/371472 [1:38:11<5:24:49,  3.71it/s]
 81%|████████  | 299114/371472 [1:38:12<5:36:03,  3.59it/s]
 81%|████████  | 299115/371472 [1:38:12<5:25:38,  3.70it/s]
 81%|████████  | 299116/371472 [1:38:12<5:20:08,  3.77it/s]
 81%|████████  | 299117/371472 [1:38:12<5:23:25,  3.73it/s]
 81%|████████  | 299118/371472 [1:38:13<5:18:13,  3.79it/s]
 81%|████████  | 299119/371472 [1:38:13<5:19:33,  3.77it/s]
 81%|████████  | 299120/371472 [1:38:13<5:50:26,  3.44it/s]
                                                           
{'loss': 2.5897, 'learning_rate': 2.753883944924476e-07, 'epoch': 12.88}

 81%|████████  | 299120/371472 [1:38:13<5:50:26,  3.44it/s]
 81%|████████  | 299121/371472 [1:38:13<5:38:54,  3.56it/s]
 81%|████████  | 299122/371472 [1:38:14<5:45:28,  3.49it/s]
 81%|████████  | 299123/371472 [1:38:14<6:13:52,  3.23it/s]
 81%|████████  | 299124/371472 [1:38:14<5:58:48,  3.36it/s]
 81%|████████  | 299125/371472 [1:38:15<5:47:43,  3.47it/s]
 81%|████████  | 299126/371472 [1:38:15<6:28:53,  3.10it/s]
 81%|████████  | 299127/371472 [1:38:15<6:57:00,  2.89it/s]
 81%|████████  | 299128/371472 [1:38:16<6:31:39,  3.08it/s]
 81%|████████  | 299129/371472 [1:38:16<6:07:38,  3.28it/s]
 81%|████████  | 299130/371472 [1:38:16<6:05:43,  3.30it/s]
 81%|████████  | 299131/371472 [1:38:17<5:48:16,  3.46it/s]
 81%|████████  | 299132/371472 [1:38:17<5:47:25,  3.47it/s]
 81%|████████  | 299133/371472 [1:38:17<5:37:09,  3.58it/s]
 81%|████████  | 299134/371472 [1:38:17<5:30:15,  3.65it/s]
 81%|████████  | 299135/371472 [1:38:18<5:41:10,  3.53it/s]
 81%|████████  | 299136/371472 [1:38:18<5:37:11,  3.58it/s]
 81%|████████  | 299137/371472 [1:38:18<5:31:17,  3.64it/s]
 81%|████████  | 299138/371472 [1:38:18<5:31:22,  3.64it/s]
 81%|████████  | 299139/371472 [1:38:19<5:25:33,  3.70it/s]
 81%|████████  | 299140/371472 [1:38:19<5:21:43,  3.75it/s]
                                                           
{'loss': 2.6271, 'learning_rate': 2.7533991251696864e-07, 'epoch': 12.88}

 81%|████████  | 299140/371472 [1:38:19<5:21:43,  3.75it/s]
 81%|████████  | 299141/371472 [1:38:19<5:26:01,  3.70it/s]
 81%|████████  | 299142/371472 [1:38:20<5:20:18,  3.76it/s]
 81%|████████  | 299143/371472 [1:38:20<5:36:52,  3.58it/s]
 81%|████████  | 299144/371472 [1:38:20<5:34:07,  3.61it/s]
 81%|████████  | 299145/371472 [1:38:20<5:38:25,  3.56it/s]
 81%|████████  | 299146/371472 [1:38:21<5:43:27,  3.51it/s]
 81%|████████  | 299147/371472 [1:38:21<6:10:47,  3.25it/s]
 81%|████████  | 299148/371472 [1:38:21<5:56:51,  3.38it/s]
 81%|████████  | 299149/371472 [1:38:22<5:35:30,  3.59it/s]
 81%|████████  | 299150/371472 [1:38:22<5:43:23,  3.51it/s]
 81%|████████  | 299151/371472 [1:38:22<5:40:24,  3.54it/s]
 81%|████████  | 299152/371472 [1:38:22<5:37:45,  3.57it/s]
 81%|████████  | 299153/371472 [1:38:23<5:29:42,  3.66it/s]
 81%|████████  | 299154/371472 [1:38:23<5:27:50,  3.68it/s]
 81%|████████  | 299155/371472 [1:38:23<5:28:10,  3.67it/s]
 81%|████████  | 299156/371472 [1:38:24<5:43:49,  3.51it/s]
 81%|████████  | 299157/371472 [1:38:24<5:47:11,  3.47it/s]
 81%|████████  | 299158/371472 [1:38:24<5:39:16,  3.55it/s]
 81%|████████  | 299159/371472 [1:38:24<5:38:13,  3.56it/s]
 81%|████████  | 299160/371472 [1:38:25<5:48:47,  3.46it/s]
                                                           
{'loss': 2.5833, 'learning_rate': 2.7529143054148987e-07, 'epoch': 12.89}

 81%|████████  | 299160/371472 [1:38:25<5:48:47,  3.46it/s]
 81%|████████  | 299161/371472 [1:38:25<5:54:03,  3.40it/s]
 81%|████████  | 299162/371472 [1:38:25<5:58:24,  3.36it/s]
 81%|████████  | 299163/371472 [1:38:26<5:57:46,  3.37it/s]
 81%|████████  | 299164/371472 [1:38:26<5:50:12,  3.44it/s]
 81%|████████  | 299165/371472 [1:38:26<5:46:50,  3.47it/s]
 81%|████████  | 299166/371472 [1:38:26<5:36:09,  3.58it/s]
 81%|████████  | 299167/371472 [1:38:27<5:38:29,  3.56it/s]
 81%|████████  | 299168/371472 [1:38:27<5:29:39,  3.66it/s]
 81%|████████  | 299169/371472 [1:38:27<5:21:50,  3.74it/s]
 81%|████████  | 299170/371472 [1:38:27<5:18:34,  3.78it/s]
 81%|████████  | 299171/371472 [1:38:28<5:20:03,  3.77it/s]
 81%|████████  | 299172/371472 [1:38:28<5:17:26,  3.80it/s]
 81%|████████  | 299173/371472 [1:38:28<5:12:32,  3.86it/s]
 81%|████████  | 299174/371472 [1:38:28<5:12:14,  3.86it/s]
 81%|████████  | 299175/371472 [1:38:29<5:30:13,  3.65it/s]
 81%|████████  | 299176/371472 [1:38:29<5:28:48,  3.66it/s]
 81%|████████  | 299177/371472 [1:38:29<5:55:37,  3.39it/s]
 81%|████████  | 299178/371472 [1:38:30<5:48:04,  3.46it/s]
 81%|████████  | 299179/371472 [1:38:30<6:19:57,  3.17it/s]
 81%|████████  | 299180/371472 [1:38:30<5:58:03,  3.36it/s]
                                                           
{'loss': 2.6166, 'learning_rate': 2.752429485660109e-07, 'epoch': 12.89}

 81%|████████  | 299180/371472 [1:38:30<5:58:03,  3.36it/s]
 81%|████████  | 299181/371472 [1:38:31<5:57:49,  3.37it/s]
 81%|████████  | 299182/371472 [1:38:31<5:41:06,  3.53it/s]
 81%|████████  | 299183/371472 [1:38:31<5:30:41,  3.64it/s]
 81%|████████  | 299184/371472 [1:38:31<5:39:11,  3.55it/s]
 81%|████████  | 299185/371472 [1:38:32<5:57:18,  3.37it/s]
 81%|████████  | 299186/371472 [1:38:32<5:41:42,  3.53it/s]
 81%|████████  | 299187/371472 [1:38:32<5:40:59,  3.53it/s]
 81%|████████  | 299188/371472 [1:38:33<5:43:35,  3.51it/s]
 81%|████████  | 299189/371472 [1:38:33<5:55:22,  3.39it/s]
 81%|████████  | 299190/371472 [1:38:33<5:42:51,  3.51it/s]
 81%|████████  | 299191/371472 [1:38:33<5:49:08,  3.45it/s]
 81%|████████  | 299192/371472 [1:38:34<5:46:21,  3.48it/s]
 81%|████████  | 299193/371472 [1:38:34<5:40:38,  3.54it/s]
 81%|████████  | 299194/371472 [1:38:34<6:22:07,  3.15it/s]
 81%|████████  | 299195/371472 [1:38:35<6:00:16,  3.34it/s]
 81%|████████  | 299196/371472 [1:38:35<5:46:20,  3.48it/s]
 81%|████████  | 299197/371472 [1:38:35<5:35:27,  3.59it/s]
 81%|████████  | 299198/371472 [1:38:35<5:39:15,  3.55it/s]
 81%|████████  | 299199/371472 [1:38:36<5:57:45,  3.37it/s]
 81%|████████  | 299200/371472 [1:38:36<5:51:14,  3.43it/s]
                                                           
{'loss': 2.5666, 'learning_rate': 2.7519446659053196e-07, 'epoch': 12.89}

 81%|████████  | 299200/371472 [1:38:36<5:51:14,  3.43it/s]
 81%|████████  | 299201/371472 [1:38:36<5:51:30,  3.43it/s]
 81%|████████  | 299202/371472 [1:38:37<5:48:26,  3.46it/s]
 81%|████████  | 299203/371472 [1:38:37<5:48:01,  3.46it/s]
 81%|████████  | 299204/371472 [1:38:37<5:42:44,  3.51it/s]
 81%|████████  | 299205/371472 [1:38:37<5:39:52,  3.54it/s]
 81%|████████  | 299206/371472 [1:38:38<5:28:29,  3.67it/s]
 81%|████████  | 299207/371472 [1:38:38<5:44:48,  3.49it/s]
 81%|████████  | 299208/371472 [1:38:38<5:36:34,  3.58it/s]
 81%|████████  | 299209/371472 [1:38:39<5:39:58,  3.54it/s]
 81%|████████  | 299210/371472 [1:38:39<5:35:17,  3.59it/s]
 81%|████████  | 299211/371472 [1:38:39<5:31:54,  3.63it/s]
 81%|████████  | 299212/371472 [1:38:39<5:27:53,  3.67it/s]
 81%|████████  | 299213/371472 [1:38:40<5:15:48,  3.81it/s]
 81%|████████  | 299214/371472 [1:38:40<5:19:27,  3.77it/s]
 81%|████████  | 299215/371472 [1:38:40<5:36:41,  3.58it/s]
 81%|████████  | 299216/371472 [1:38:41<5:46:41,  3.47it/s]
 81%|████████  | 299217/371472 [1:38:41<5:29:26,  3.66it/s]
 81%|████████  | 299218/371472 [1:38:41<5:22:43,  3.73it/s]
 81%|████████  | 299219/371472 [1:38:41<5:19:14,  3.77it/s]
 81%|████████  | 299220/371472 [1:38:42<5:28:56,  3.66it/s]
                                                           
{'loss': 2.6638, 'learning_rate': 2.7514598461505314e-07, 'epoch': 12.89}

 81%|████████  | 299220/371472 [1:38:42<5:28:56,  3.66it/s]
 81%|████████  | 299221/371472 [1:38:42<6:04:36,  3.30it/s]
 81%|████████  | 299222/371472 [1:38:42<5:52:46,  3.41it/s]
 81%|████████  | 299223/371472 [1:38:43<6:02:13,  3.32it/s]
 81%|████████  | 299224/371472 [1:38:43<6:06:09,  3.29it/s]
 81%|████████  | 299225/371472 [1:38:43<5:58:56,  3.35it/s]
 81%|████████  | 299226/371472 [1:38:43<5:48:41,  3.45it/s]
 81%|████████  | 299227/371472 [1:38:44<5:40:13,  3.54it/s]
 81%|████████  | 299228/371472 [1:38:44<5:35:46,  3.59it/s]
 81%|████████  | 299229/371472 [1:38:44<5:42:38,  3.51it/s]
 81%|████████  | 299230/371472 [1:38:45<5:38:37,  3.56it/s]
 81%|████████  | 299231/371472 [1:38:45<5:37:12,  3.57it/s]
 81%|████████  | 299232/371472 [1:38:45<5:51:06,  3.43it/s]
 81%|████████  | 299233/371472 [1:38:45<5:51:13,  3.43it/s]
 81%|████████  | 299234/371472 [1:38:46<5:37:06,  3.57it/s]
 81%|████████  | 299235/371472 [1:38:46<6:01:03,  3.33it/s]
 81%|████████  | 299236/371472 [1:38:46<6:04:09,  3.31it/s]
 81%|████████  | 299237/371472 [1:38:47<6:28:03,  3.10it/s]
 81%|████████  | 299238/371472 [1:38:47<6:06:43,  3.28it/s]
 81%|████████  | 299239/371472 [1:38:47<5:50:28,  3.44it/s]
 81%|████████  | 299240/371472 [1:38:48<5:54:28,  3.40it/s]
                                                           
{'loss': 2.6017, 'learning_rate': 2.7509750263957416e-07, 'epoch': 12.89}

 81%|████████  | 299240/371472 [1:38:48<5:54:28,  3.40it/s]
 81%|████████  | 299241/371472 [1:38:48<6:02:54,  3.32it/s]
 81%|████████  | 299242/371472 [1:38:48<6:06:57,  3.28it/s]
 81%|████████  | 299243/371472 [1:38:48<6:02:01,  3.33it/s]
 81%|████████  | 299244/371472 [1:38:49<5:43:23,  3.51it/s]
 81%|████████  | 299245/371472 [1:38:49<5:46:57,  3.47it/s]
 81%|████████  | 299246/371472 [1:38:49<5:37:58,  3.56it/s]
 81%|████████  | 299247/371472 [1:38:50<5:41:58,  3.52it/s]
 81%|████████  | 299248/371472 [1:38:50<5:30:12,  3.65it/s]
 81%|████████  | 299249/371472 [1:38:50<5:40:53,  3.53it/s]
 81%|████████  | 299250/371472 [1:38:50<5:37:42,  3.56it/s]
 81%|████████  | 299251/371472 [1:38:51<6:53:02,  2.91it/s]
 81%|████████  | 299252/371472 [1:38:51<6:15:30,  3.21it/s]
 81%|████████  | 299253/371472 [1:38:51<5:57:31,  3.37it/s]
 81%|████████  | 299254/371472 [1:38:52<5:57:31,  3.37it/s]
 81%|████████  | 299255/371472 [1:38:52<5:53:34,  3.40it/s]
 81%|████████  | 299256/371472 [1:38:52<5:31:09,  3.63it/s]
 81%|████████  | 299257/371472 [1:38:52<5:32:16,  3.62it/s]
 81%|████████  | 299258/371472 [1:38:53<5:28:48,  3.66it/s]
 81%|████████  | 299259/371472 [1:38:53<5:31:25,  3.63it/s]
 81%|████████  | 299260/371472 [1:38:53<5:21:51,  3.74it/s]
                                                           
{'loss': 2.6313, 'learning_rate': 2.7504902066409533e-07, 'epoch': 12.89}

 81%|████████  | 299260/371472 [1:38:53<5:21:51,  3.74it/s]
 81%|████████  | 299261/371472 [1:38:54<5:35:59,  3.58it/s]
 81%|████████  | 299262/371472 [1:38:54<5:50:23,  3.43it/s]
 81%|████████  | 299263/371472 [1:38:54<5:31:59,  3.63it/s]
 81%|████████  | 299264/371472 [1:38:54<5:49:50,  3.44it/s]
 81%|████████  | 299265/371472 [1:38:55<5:48:37,  3.45it/s]
 81%|████████  | 299266/371472 [1:38:55<5:34:08,  3.60it/s]
 81%|████████  | 299267/371472 [1:38:55<5:35:17,  3.59it/s]
 81%|████████  | 299268/371472 [1:38:56<5:29:18,  3.65it/s]
 81%|████████  | 299269/371472 [1:38:56<5:54:13,  3.40it/s]
 81%|████████  | 299270/371472 [1:38:56<6:16:12,  3.20it/s]
 81%|████████  | 299271/371472 [1:38:57<6:11:11,  3.24it/s]
 81%|████████  | 299272/371472 [1:38:57<6:05:21,  3.29it/s]
 81%|████████  | 299273/371472 [1:38:57<5:48:08,  3.46it/s]
 81%|████████  | 299274/371472 [1:38:57<5:46:10,  3.48it/s]
 81%|████████  | 299275/371472 [1:38:58<5:53:06,  3.41it/s]
 81%|████████  | 299276/371472 [1:38:58<5:37:07,  3.57it/s]
 81%|████████  | 299277/371472 [1:38:58<5:34:28,  3.60it/s]
 81%|████████  | 299278/371472 [1:38:59<5:57:12,  3.37it/s]
 81%|████████  | 299279/371472 [1:38:59<5:51:37,  3.42it/s]
 81%|████████  | 299280/371472 [1:38:59<5:45:16,  3.48it/s]
                                                           
{'loss': 2.6531, 'learning_rate': 2.7500053868861635e-07, 'epoch': 12.89}

 81%|████████  | 299280/371472 [1:38:59<5:45:16,  3.48it/s]
 81%|████████  | 299281/371472 [1:38:59<5:33:45,  3.60it/s]
 81%|████████  | 299282/371472 [1:39:00<5:38:15,  3.56it/s]
 81%|████████  | 299283/371472 [1:39:00<5:36:35,  3.57it/s]
 81%|████████  | 299284/371472 [1:39:00<5:40:59,  3.53it/s]
 81%|████████  | 299285/371472 [1:39:00<5:38:09,  3.56it/s]
 81%|████████  | 299286/371472 [1:39:01<5:29:00,  3.66it/s]
 81%|████████  | 299287/371472 [1:39:01<5:32:26,  3.62it/s]
 81%|████████  | 299288/371472 [1:39:01<5:22:07,  3.73it/s]
 81%|████████  | 299289/371472 [1:39:02<5:26:23,  3.69it/s]
 81%|████████  | 299290/371472 [1:39:02<5:38:05,  3.56it/s]
 81%|████████  | 299291/371472 [1:39:02<5:46:46,  3.47it/s]
 81%|████████  | 299292/371472 [1:39:02<5:41:08,  3.53it/s]
 81%|████████  | 299293/371472 [1:39:03<6:26:48,  3.11it/s]
 81%|████████  | 299294/371472 [1:39:03<6:38:46,  3.02it/s]
 81%|████████  | 299295/371472 [1:39:03<6:11:56,  3.23it/s]
 81%|████████  | 299296/371472 [1:39:04<6:03:52,  3.31it/s]
 81%|████████  | 299297/371472 [1:39:04<6:04:54,  3.30it/s]
 81%|████████  | 299298/371472 [1:39:04<5:57:39,  3.36it/s]
 81%|████████  | 299299/371472 [1:39:05<5:51:41,  3.42it/s]
 81%|████████  | 299300/371472 [1:39:05<5:50:08,  3.44it/s]
                                                           
{'loss': 2.7054, 'learning_rate': 2.7495205671313753e-07, 'epoch': 12.89}

 81%|████████  | 299300/371472 [1:39:05<5:50:08,  3.44it/s]
 81%|████████  | 299301/371472 [1:39:05<5:40:12,  3.54it/s]
 81%|████████  | 299302/371472 [1:39:05<5:23:56,  3.71it/s]
 81%|████████  | 299303/371472 [1:39:06<5:56:19,  3.38it/s]
 81%|████████  | 299304/371472 [1:39:06<6:24:31,  3.13it/s]
 81%|████████  | 299305/371472 [1:39:06<6:21:23,  3.15it/s]
 81%|████████  | 299306/371472 [1:39:07<5:54:29,  3.39it/s]
 81%|████████  | 299307/371472 [1:39:07<5:51:47,  3.42it/s]
 81%|████████  | 299308/371472 [1:39:07<5:47:12,  3.46it/s]
 81%|████████  | 299309/371472 [1:39:07<5:37:26,  3.56it/s]
 81%|████████  | 299310/371472 [1:39:08<5:33:18,  3.61it/s]
 81%|████████  | 299311/371472 [1:39:08<5:21:57,  3.74it/s]
 81%|████████  | 299312/371472 [1:39:08<5:25:09,  3.70it/s]
 81%|████████  | 299313/371472 [1:39:09<5:11:52,  3.86it/s]
 81%|████████  | 299314/371472 [1:39:09<5:28:53,  3.66it/s]
 81%|████████  | 299315/371472 [1:39:09<5:27:00,  3.68it/s]
 81%|████████  | 299316/371472 [1:39:09<5:25:10,  3.70it/s]
 81%|████████  | 299317/371472 [1:39:10<5:29:51,  3.65it/s]
 81%|████████  | 299318/371472 [1:39:10<5:29:37,  3.65it/s]
 81%|████████  | 299319/371472 [1:39:10<5:22:23,  3.73it/s]
 81%|████████  | 299320/371472 [1:39:10<5:13:59,  3.83it/s]
                                                           
{'loss': 2.5938, 'learning_rate': 2.7490357473765865e-07, 'epoch': 12.89}

 81%|████████  | 299320/371472 [1:39:10<5:13:59,  3.83it/s]
 81%|████████  | 299321/371472 [1:39:11<5:26:32,  3.68it/s]
 81%|████████  | 299322/371472 [1:39:11<5:22:56,  3.72it/s]
 81%|████████  | 299323/371472 [1:39:11<5:21:21,  3.74it/s]
 81%|████████  | 299324/371472 [1:39:11<5:22:17,  3.73it/s]
 81%|████████  | 299325/371472 [1:39:12<5:23:21,  3.72it/s]
 81%|████████  | 299326/371472 [1:39:12<5:13:02,  3.84it/s]
 81%|████████  | 299327/371472 [1:39:12<5:38:45,  3.55it/s]
 81%|████████  | 299328/371472 [1:39:13<5:46:20,  3.47it/s]
 81%|████████  | 299329/371472 [1:39:13<5:32:33,  3.62it/s]
 81%|████████  | 299330/371472 [1:39:13<5:43:43,  3.50it/s]
 81%|████████  | 299331/371472 [1:39:13<5:29:46,  3.65it/s]
 81%|████████  | 299332/371472 [1:39:14<5:19:00,  3.77it/s]
 81%|████████  | 299333/371472 [1:39:14<5:21:38,  3.74it/s]
 81%|████████  | 299334/371472 [1:39:14<5:25:02,  3.70it/s]
 81%|████████  | 299335/371472 [1:39:15<5:23:49,  3.71it/s]
 81%|████████  | 299336/371472 [1:39:15<5:18:14,  3.78it/s]
 81%|████████  | 299337/371472 [1:39:15<5:16:53,  3.79it/s]
 81%|████████  | 299338/371472 [1:39:15<5:22:12,  3.73it/s]
 81%|████████  | 299339/371472 [1:39:16<5:25:06,  3.70it/s]
 81%|████████  | 299340/371472 [1:39:16<5:37:51,  3.56it/s]
                                                           
{'loss': 2.5624, 'learning_rate': 2.748550927621798e-07, 'epoch': 12.89}

 81%|████████  | 299340/371472 [1:39:16<5:37:51,  3.56it/s]
 81%|████████  | 299341/371472 [1:39:16<5:50:52,  3.43it/s]
 81%|████████  | 299342/371472 [1:39:16<5:34:42,  3.59it/s]
 81%|████████  | 299343/371472 [1:39:17<5:31:58,  3.62it/s]
 81%|████████  | 299344/371472 [1:39:17<5:19:58,  3.76it/s]
 81%|████████  | 299345/371472 [1:39:17<5:28:17,  3.66it/s]
 81%|████████  | 299346/371472 [1:39:17<5:12:38,  3.84it/s]
 81%|████████  | 299347/371472 [1:39:18<5:12:42,  3.84it/s]
 81%|████████  | 299348/371472 [1:39:18<5:18:43,  3.77it/s]
 81%|████████  | 299349/371472 [1:39:18<5:30:24,  3.64it/s]
 81%|████████  | 299350/371472 [1:39:19<5:25:44,  3.69it/s]
 81%|████████  | 299351/371472 [1:39:19<5:36:39,  3.57it/s]
 81%|████████  | 299352/371472 [1:39:19<5:27:47,  3.67it/s]
 81%|████████  | 299353/371472 [1:39:19<5:51:46,  3.42it/s]
 81%|████████  | 299354/371472 [1:39:20<5:47:05,  3.46it/s]
 81%|████████  | 299355/371472 [1:39:20<5:29:57,  3.64it/s]
 81%|████████  | 299356/371472 [1:39:20<5:40:48,  3.53it/s]
 81%|████████  | 299357/371472 [1:39:21<6:10:33,  3.24it/s]
 81%|████████  | 299358/371472 [1:39:21<6:03:46,  3.30it/s]
 81%|████████  | 299359/371472 [1:39:21<5:52:27,  3.41it/s]
 81%|████████  | 299360/371472 [1:39:22<5:56:55,  3.37it/s]
                                                           
{'loss': 2.7195, 'learning_rate': 2.748066107867008e-07, 'epoch': 12.89}

 81%|████████  | 299360/371472 [1:39:22<5:56:55,  3.37it/s]
 81%|████████  | 299361/371472 [1:39:22<5:45:57,  3.47it/s]
 81%|████████  | 299362/371472 [1:39:22<5:31:40,  3.62it/s]
 81%|████████  | 299363/371472 [1:39:22<5:35:38,  3.58it/s]
 81%|████████  | 299364/371472 [1:39:23<5:50:33,  3.43it/s]
 81%|████████  | 299365/371472 [1:39:23<5:50:59,  3.42it/s]
 81%|████████  | 299366/371472 [1:39:23<5:48:43,  3.45it/s]
 81%|████████  | 299367/371472 [1:39:24<5:43:05,  3.50it/s]
 81%|████████  | 299368/371472 [1:39:24<5:47:01,  3.46it/s]
 81%|████████  | 299369/371472 [1:39:24<5:34:58,  3.59it/s]
 81%|████████  | 299370/371472 [1:39:24<5:34:25,  3.59it/s]
 81%|████████  | 299371/371472 [1:39:25<5:24:02,  3.71it/s]
 81%|████████  | 299372/371472 [1:39:25<5:24:17,  3.71it/s]
 81%|████████  | 299373/371472 [1:39:25<5:17:49,  3.78it/s]
 81%|████████  | 299374/371472 [1:39:25<5:20:47,  3.75it/s]
 81%|████████  | 299375/371472 [1:39:26<5:25:42,  3.69it/s]
 81%|████████  | 299376/371472 [1:39:26<5:21:32,  3.74it/s]
 81%|████████  | 299377/371472 [1:39:26<5:27:06,  3.67it/s]
 81%|████████  | 299378/371472 [1:39:26<5:18:16,  3.78it/s]
 81%|████████  | 299379/371472 [1:39:27<5:16:50,  3.79it/s]
 81%|████████  | 299380/371472 [1:39:27<5:10:55,  3.86it/s]
                                                           
{'loss': 2.5893, 'learning_rate': 2.74758128811222e-07, 'epoch': 12.89}

 81%|████████  | 299380/371472 [1:39:27<5:10:55,  3.86it/s]
 81%|████████  | 299381/371472 [1:39:27<5:14:14,  3.82it/s]
 81%|████████  | 299382/371472 [1:39:28<5:21:25,  3.74it/s]
 81%|████████  | 299383/371472 [1:39:28<5:42:32,  3.51it/s]
 81%|████████  | 299384/371472 [1:39:28<5:38:04,  3.55it/s]
 81%|████████  | 299385/371472 [1:39:28<5:20:23,  3.75it/s]
 81%|████████  | 299386/371472 [1:39:29<5:52:50,  3.41it/s]
 81%|████████  | 299387/371472 [1:39:29<5:51:25,  3.42it/s]
 81%|████████  | 299388/371472 [1:39:29<5:36:08,  3.57it/s]
 81%|████████  | 299389/371472 [1:39:30<5:47:08,  3.46it/s]
 81%|████████  | 299390/371472 [1:39:30<6:04:49,  3.29it/s]
 81%|████████  | 299391/371472 [1:39:30<5:59:39,  3.34it/s]
 81%|████████  | 299392/371472 [1:39:30<5:43:53,  3.49it/s]
 81%|████████  | 299393/371472 [1:39:31<5:30:39,  3.63it/s]
 81%|████████  | 299394/371472 [1:39:31<5:34:33,  3.59it/s]
 81%|████████  | 299395/371472 [1:39:31<5:26:39,  3.68it/s]
 81%|████████  | 299396/371472 [1:39:31<5:15:16,  3.81it/s]
 81%|████████  | 299397/371472 [1:39:32<5:26:19,  3.68it/s]
 81%|████████  | 299398/371472 [1:39:32<5:41:37,  3.52it/s]
 81%|████████  | 299399/371472 [1:39:32<5:38:34,  3.55it/s]
 81%|████████  | 299400/371472 [1:39:33<5:53:33,  3.40it/s]
                                                           
{'loss': 2.6357, 'learning_rate': 2.74709646835743e-07, 'epoch': 12.9}

 81%|████████  | 299400/371472 [1:39:33<5:53:33,  3.40it/s]
 81%|████████  | 299401/371472 [1:39:33<5:35:36,  3.58it/s]
 81%|████████  | 299402/371472 [1:39:33<6:05:32,  3.29it/s]
 81%|████████  | 299403/371472 [1:39:34<5:51:05,  3.42it/s]
 81%|████████  | 299404/371472 [1:39:34<5:52:09,  3.41it/s]
 81%|████████  | 299405/371472 [1:39:34<5:37:57,  3.55it/s]
 81%|████████  | 299406/371472 [1:39:34<5:43:04,  3.50it/s]
 81%|████████  | 299407/371472 [1:39:35<5:35:17,  3.58it/s]
 81%|████████  | 299408/371472 [1:39:35<6:01:17,  3.32it/s]
 81%|████████  | 299409/371472 [1:39:35<5:58:08,  3.35it/s]
 81%|████████  | 299410/371472 [1:39:36<5:47:02,  3.46it/s]
 81%|████████  | 299411/371472 [1:39:36<5:31:17,  3.63it/s]
 81%|████████  | 299412/371472 [1:39:36<5:27:30,  3.67it/s]
 81%|████████  | 299413/371472 [1:39:36<5:32:09,  3.62it/s]
 81%|████████  | 299414/371472 [1:39:37<5:43:53,  3.49it/s]
 81%|████████  | 299415/371472 [1:39:37<5:42:52,  3.50it/s]
 81%|████████  | 299416/371472 [1:39:37<5:29:00,  3.65it/s]
 81%|████████  | 299417/371472 [1:39:38<6:01:53,  3.32it/s]
 81%|████████  | 299418/371472 [1:39:38<5:46:14,  3.47it/s]
 81%|████████  | 299419/371472 [1:39:38<5:58:21,  3.35it/s]
 81%|████████  | 299420/371472 [1:39:38<6:04:31,  3.29it/s]
                                                           
{'loss': 2.6014, 'learning_rate': 2.7466116486026417e-07, 'epoch': 12.9}

 81%|████████  | 299420/371472 [1:39:38<6:04:31,  3.29it/s]
 81%|████████  | 299421/371472 [1:39:39<5:41:07,  3.52it/s]
 81%|████████  | 299422/371472 [1:39:39<5:45:00,  3.48it/s]
 81%|████████  | 299423/371472 [1:39:39<5:43:52,  3.49it/s]
 81%|████████  | 299424/371472 [1:39:40<5:42:41,  3.50it/s]
 81%|████████  | 299425/371472 [1:39:40<5:41:06,  3.52it/s]
 81%|████████  | 299426/371472 [1:39:40<6:04:03,  3.30it/s]
 81%|████████  | 299427/371472 [1:39:40<5:50:33,  3.43it/s]
 81%|████████  | 299428/371472 [1:39:41<5:32:02,  3.62it/s]
 81%|████████  | 299429/371472 [1:39:41<5:20:39,  3.74it/s]
 81%|████████  | 299430/371472 [1:39:41<5:11:57,  3.85it/s]
 81%|████████  | 299431/371472 [1:39:41<5:13:12,  3.83it/s]
 81%|████████  | 299432/371472 [1:39:42<5:29:30,  3.64it/s]
 81%|████████  | 299433/371472 [1:39:42<6:11:12,  3.23it/s]
 81%|████████  | 299434/371472 [1:39:42<5:58:36,  3.35it/s]
 81%|████████  | 299435/371472 [1:39:43<5:45:56,  3.47it/s]
 81%|████████  | 299436/371472 [1:39:43<5:37:51,  3.55it/s]
 81%|████████  | 299437/371472 [1:39:43<5:31:17,  3.62it/s]
 81%|████████  | 299438/371472 [1:39:43<5:20:41,  3.74it/s]
 81%|████████  | 299439/371472 [1:39:44<5:27:30,  3.67it/s]
 81%|████████  | 299440/371472 [1:39:44<5:35:41,  3.58it/s]
                                                           
{'loss': 2.6344, 'learning_rate': 2.7461268288478524e-07, 'epoch': 12.9}

 81%|████████  | 299440/371472 [1:39:44<5:35:41,  3.58it/s]
 81%|████████  | 299441/371472 [1:39:44<5:35:35,  3.58it/s]
 81%|████████  | 299442/371472 [1:39:45<5:31:58,  3.62it/s]
 81%|████████  | 299443/371472 [1:39:45<5:46:25,  3.47it/s]
 81%|████████  | 299444/371472 [1:39:45<5:35:06,  3.58it/s]
 81%|████████  | 299445/371472 [1:39:45<5:26:59,  3.67it/s]
 81%|████████  | 299446/371472 [1:39:46<5:36:30,  3.57it/s]
 81%|████████  | 299447/371472 [1:39:46<5:49:52,  3.43it/s]
 81%|████████  | 299448/371472 [1:39:46<6:12:01,  3.23it/s]
 81%|████████  | 299449/371472 [1:39:47<6:08:24,  3.26it/s]
 81%|████████  | 299450/371472 [1:39:47<5:53:33,  3.40it/s]
 81%|████████  | 299451/371472 [1:39:47<5:45:48,  3.47it/s]
 81%|████████  | 299452/371472 [1:39:48<6:28:11,  3.09it/s]
 81%|████████  | 299453/371472 [1:39:48<6:06:06,  3.28it/s]
 81%|████████  | 299454/371472 [1:39:48<6:00:51,  3.33it/s]
 81%|████████  | 299455/371472 [1:39:48<5:44:59,  3.48it/s]
 81%|████████  | 299456/371472 [1:39:49<5:34:43,  3.59it/s]
 81%|████████  | 299457/371472 [1:39:49<5:44:54,  3.48it/s]
 81%|████████  | 299458/371472 [1:39:49<5:41:18,  3.52it/s]
 81%|████████  | 299459/371472 [1:39:50<5:38:26,  3.55it/s]
 81%|████████  | 299460/371472 [1:39:50<5:30:09,  3.64it/s]
                                                           
{'loss': 2.6459, 'learning_rate': 2.745642009093064e-07, 'epoch': 12.9}

 81%|████████  | 299460/371472 [1:39:50<5:30:09,  3.64it/s]
 81%|████████  | 299461/371472 [1:39:50<5:37:50,  3.55it/s]
 81%|████████  | 299462/371472 [1:39:50<5:24:52,  3.69it/s]
 81%|████████  | 299463/371472 [1:39:51<5:19:16,  3.76it/s]
 81%|████████  | 299464/371472 [1:39:51<5:19:33,  3.76it/s]
 81%|████████  | 299465/371472 [1:39:51<5:27:36,  3.66it/s]
 81%|████████  | 299466/371472 [1:39:52<6:03:27,  3.30it/s]
 81%|████████  | 299467/371472 [1:39:52<5:37:59,  3.55it/s]
 81%|████████  | 299468/371472 [1:39:52<5:42:04,  3.51it/s]
 81%|████████  | 299469/371472 [1:39:52<5:29:20,  3.64it/s]
 81%|████████  | 299470/371472 [1:39:53<5:42:44,  3.50it/s]
 81%|████████  | 299471/371472 [1:39:53<5:52:29,  3.40it/s]
 81%|████████  | 299472/371472 [1:39:53<6:56:45,  2.88it/s]
 81%|████████  | 299473/371472 [1:39:54<6:31:23,  3.07it/s]
 81%|████████  | 299474/371472 [1:39:54<6:16:43,  3.19it/s]
 81%|████████  | 299475/371472 [1:39:54<5:56:49,  3.36it/s]
 81%|████████  | 299476/371472 [1:39:54<5:46:52,  3.46it/s]
 81%|████████  | 299477/371472 [1:39:55<5:38:15,  3.55it/s]
 81%|████████  | 299478/371472 [1:39:55<5:28:53,  3.65it/s]
 81%|████████  | 299479/371472 [1:39:55<5:32:34,  3.61it/s]
 81%|████████  | 299480/371472 [1:39:56<5:14:24,  3.82it/s]
                                                           
{'loss': 2.6501, 'learning_rate': 2.745157189338275e-07, 'epoch': 12.9}

 81%|████████  | 299480/371472 [1:39:56<5:14:24,  3.82it/s]
 81%|████████  | 299481/371472 [1:39:56<5:21:28,  3.73it/s]
 81%|████████  | 299482/371472 [1:39:56<5:32:12,  3.61it/s]
 81%|████████  | 299483/371472 [1:39:56<5:35:11,  3.58it/s]
 81%|████████  | 299484/371472 [1:39:57<5:31:59,  3.61it/s]
 81%|████████  | 299485/371472 [1:39:57<5:43:06,  3.50it/s]
 81%|████████  | 299486/371472 [1:39:57<5:29:12,  3.64it/s]
 81%|████████  | 299487/371472 [1:39:57<5:19:54,  3.75it/s]
 81%|████████  | 299488/371472 [1:39:58<5:36:35,  3.56it/s]
 81%|████████  | 299489/371472 [1:39:58<5:25:10,  3.69it/s]
 81%|████████  | 299490/371472 [1:39:58<5:25:07,  3.69it/s]
 81%|████████  | 299491/371472 [1:39:59<5:32:43,  3.61it/s]
 81%|████████  | 299492/371472 [1:39:59<5:46:07,  3.47it/s]
 81%|████████  | 299493/371472 [1:39:59<5:35:46,  3.57it/s]
 81%|████████  | 299494/371472 [1:39:59<5:31:01,  3.62it/s]
 81%|████████  | 299495/371472 [1:40:00<5:25:19,  3.69it/s]
 81%|████████  | 299496/371472 [1:40:00<5:24:54,  3.69it/s]
 81%|████████  | 299497/371472 [1:40:00<5:24:53,  3.69it/s]
 81%|████████  | 299498/371472 [1:40:01<5:45:44,  3.47it/s]
 81%|████████  | 299499/371472 [1:40:01<5:37:26,  3.55it/s]
 81%|████████  | 299500/371472 [1:40:01<5:33:58,  3.59it/s]
                                                           
{'loss': 2.5032, 'learning_rate': 2.744672369583486e-07, 'epoch': 12.9}

 81%|████████  | 299500/371472 [1:40:01<5:33:58,  3.59it/s]
 81%|████████  | 299501/371472 [1:40:01<5:28:21,  3.65it/s]
 81%|████████  | 299502/371472 [1:40:02<5:18:37,  3.76it/s]
 81%|████████  | 299503/371472 [1:40:02<5:15:31,  3.80it/s]
 81%|████████  | 299504/371472 [1:40:02<5:18:37,  3.76it/s]
 81%|████████  | 299505/371472 [1:40:02<5:22:24,  3.72it/s]
 81%|████████  | 299506/371472 [1:40:03<5:20:29,  3.74it/s]
 81%|████████  | 299507/371472 [1:40:03<5:14:08,  3.82it/s]
 81%|████████  | 299508/371472 [1:40:03<5:38:27,  3.54it/s]
 81%|████████  | 299509/371472 [1:40:04<5:32:57,  3.60it/s]
 81%|████████  | 299510/371472 [1:40:04<5:36:33,  3.56it/s]
 81%|████████  | 299511/371472 [1:40:04<5:28:14,  3.65it/s]
 81%|████████  | 299512/371472 [1:40:04<5:26:19,  3.68it/s]
 81%|████████  | 299513/371472 [1:40:05<5:31:24,  3.62it/s]
 81%|████████  | 299514/371472 [1:40:05<5:25:24,  3.69it/s]
 81%|████████  | 299515/371472 [1:40:05<5:27:46,  3.66it/s]
 81%|████████  | 299516/371472 [1:40:05<5:31:27,  3.62it/s]
 81%|████████  | 299517/371472 [1:40:06<5:25:15,  3.69it/s]
 81%|████████  | 299518/371472 [1:40:06<5:22:53,  3.71it/s]
 81%|████████  | 299519/371472 [1:40:06<5:40:56,  3.52it/s]
 81%|████████  | 299520/371472 [1:40:07<5:42:12,  3.50it/s]
                                                           
{'loss': 2.8034, 'learning_rate': 2.7441875498286963e-07, 'epoch': 12.9}

 81%|████████  | 299520/371472 [1:40:07<5:42:12,  3.50it/s]
 81%|████████  | 299521/371472 [1:40:07<5:36:12,  3.57it/s]
 81%|████████  | 299522/371472 [1:40:07<5:24:41,  3.69it/s]
 81%|████████  | 299523/371472 [1:40:07<5:55:02,  3.38it/s]
 81%|████████  | 299524/371472 [1:40:08<5:38:38,  3.54it/s]
 81%|████████  | 299525/371472 [1:40:08<5:37:44,  3.55it/s]
 81%|████████  | 299526/371472 [1:40:08<5:34:50,  3.58it/s]
 81%|████████  | 299527/371472 [1:40:09<5:39:34,  3.53it/s]
 81%|████████  | 299528/371472 [1:40:09<5:28:15,  3.65it/s]
 81%|████████  | 299529/371472 [1:40:09<5:32:12,  3.61it/s]
 81%|████████  | 299530/371472 [1:40:09<5:17:32,  3.78it/s]
 81%|████████  | 299531/371472 [1:40:10<5:12:10,  3.84it/s]
 81%|████████  | 299532/371472 [1:40:10<5:44:34,  3.48it/s]
 81%|████████  | 299533/371472 [1:40:10<5:40:34,  3.52it/s]
 81%|████████  | 299534/371472 [1:40:10<5:31:26,  3.62it/s]
 81%|████████  | 299535/371472 [1:40:11<5:28:52,  3.65it/s]
 81%|████████  | 299536/371472 [1:40:11<5:19:26,  3.75it/s]
 81%|████████  | 299537/371472 [1:40:11<5:19:32,  3.75it/s]
 81%|████████  | 299538/371472 [1:40:12<5:17:50,  3.77it/s]
 81%|████████  | 299539/371472 [1:40:12<5:16:24,  3.79it/s]
 81%|████████  | 299540/371472 [1:40:12<5:30:23,  3.63it/s]
                                                           
{'loss': 2.5474, 'learning_rate': 2.743702730073908e-07, 'epoch': 12.9}

 81%|████████  | 299540/371472 [1:40:12<5:30:23,  3.63it/s]
 81%|████████  | 299541/371472 [1:40:12<5:19:59,  3.75it/s]
 81%|████████  | 299542/371472 [1:40:13<5:21:57,  3.72it/s]
 81%|████████  | 299543/371472 [1:40:13<5:09:00,  3.88it/s]
 81%|████████  | 299544/371472 [1:40:13<5:04:05,  3.94it/s]
 81%|████████  | 299545/371472 [1:40:13<4:56:06,  4.05it/s]
 81%|████████  | 299546/371472 [1:40:14<5:14:17,  3.81it/s]
 81%|████████  | 299547/371472 [1:40:14<5:22:42,  3.71it/s]
 81%|████████  | 299548/371472 [1:40:14<5:20:50,  3.74it/s]
 81%|████████  | 299549/371472 [1:40:14<5:20:15,  3.74it/s]
 81%|████████  | 299550/371472 [1:40:15<5:41:16,  3.51it/s]
 81%|████████  | 299551/371472 [1:40:15<6:01:56,  3.31it/s]
 81%|████████  | 299552/371472 [1:40:15<6:38:43,  3.01it/s]
 81%|████████  | 299553/371472 [1:40:16<6:12:27,  3.22it/s]
 81%|████████  | 299554/371472 [1:40:16<5:47:23,  3.45it/s]
 81%|████████  | 299555/371472 [1:40:16<5:42:44,  3.50it/s]
 81%|████████  | 299556/371472 [1:40:17<5:39:49,  3.53it/s]
 81%|████████  | 299557/371472 [1:40:17<5:31:52,  3.61it/s]
 81%|████████  | 299558/371472 [1:40:17<5:23:58,  3.70it/s]
 81%|████████  | 299559/371472 [1:40:17<5:19:37,  3.75it/s]
 81%|████████  | 299560/371472 [1:40:18<5:38:27,  3.54it/s]
                                                           
{'loss': 2.4991, 'learning_rate': 2.743217910319119e-07, 'epoch': 12.9}

 81%|████████  | 299560/371472 [1:40:18<5:38:27,  3.54it/s]
 81%|████████  | 299561/371472 [1:40:18<5:27:28,  3.66it/s]
 81%|████████  | 299562/371472 [1:40:18<5:35:11,  3.58it/s]
 81%|████████  | 299563/371472 [1:40:18<5:34:51,  3.58it/s]
 81%|████████  | 299564/371472 [1:40:19<5:39:05,  3.53it/s]
 81%|████████  | 299565/371472 [1:40:19<5:54:50,  3.38it/s]
 81%|████████  | 299566/371472 [1:40:19<5:50:29,  3.42it/s]
 81%|████████  | 299567/371472 [1:40:20<5:49:11,  3.43it/s]
 81%|████████  | 299568/371472 [1:40:20<5:46:04,  3.46it/s]
 81%|████████  | 299569/371472 [1:40:20<5:33:38,  3.59it/s]
 81%|████████  | 299570/371472 [1:40:20<5:23:15,  3.71it/s]
 81%|████████  | 299571/371472 [1:40:21<5:20:00,  3.74it/s]
 81%|████████  | 299572/371472 [1:40:21<5:34:19,  3.58it/s]
 81%|████████  | 299573/371472 [1:40:21<6:00:23,  3.33it/s]
 81%|████████  | 299574/371472 [1:40:22<5:57:44,  3.35it/s]
 81%|████████  | 299575/371472 [1:40:22<5:46:49,  3.46it/s]
 81%|████████  | 299576/371472 [1:40:22<5:44:12,  3.48it/s]
 81%|████████  | 299577/371472 [1:40:22<5:28:22,  3.65it/s]
 81%|████████  | 299578/371472 [1:40:23<5:29:56,  3.63it/s]
 81%|████████  | 299579/371472 [1:40:23<5:34:07,  3.59it/s]
 81%|████████  | 299580/371472 [1:40:23<5:22:43,  3.71it/s]
                                                           
{'loss': 2.6761, 'learning_rate': 2.74273309056433e-07, 'epoch': 12.9}

 81%|████████  | 299580/371472 [1:40:23<5:22:43,  3.71it/s]
 81%|████████  | 299581/371472 [1:40:24<6:04:18,  3.29it/s]
 81%|████████  | 299582/371472 [1:40:24<6:03:04,  3.30it/s]
 81%|████████  | 299583/371472 [1:40:24<5:37:20,  3.55it/s]
 81%|████████  | 299584/371472 [1:40:24<5:27:58,  3.65it/s]
 81%|████████  | 299585/371472 [1:40:25<6:05:19,  3.28it/s]
 81%|████████  | 299586/371472 [1:40:25<5:51:20,  3.41it/s]
 81%|████████  | 299587/371472 [1:40:25<5:45:15,  3.47it/s]
 81%|████████  | 299588/371472 [1:40:26<5:33:33,  3.59it/s]
 81%|████████  | 299589/371472 [1:40:26<5:20:46,  3.73it/s]
 81%|████████  | 299590/371472 [1:40:26<5:37:30,  3.55it/s]
 81%|████████  | 299591/371472 [1:40:26<5:28:02,  3.65it/s]
 81%|████████  | 299592/371472 [1:40:27<5:26:54,  3.66it/s]
 81%|████████  | 299593/371472 [1:40:27<5:20:00,  3.74it/s]
 81%|████████  | 299594/371472 [1:40:27<5:23:18,  3.71it/s]
 81%|████████  | 299595/371472 [1:40:27<5:16:24,  3.79it/s]
 81%|████████  | 299596/371472 [1:40:28<5:19:32,  3.75it/s]
 81%|████████  | 299597/371472 [1:40:28<5:31:10,  3.62it/s]
 81%|████████  | 299598/371472 [1:40:28<5:16:17,  3.79it/s]
 81%|████████  | 299599/371472 [1:40:29<5:23:19,  3.70it/s]
 81%|████████  | 299600/371472 [1:40:29<5:23:43,  3.70it/s]
                                                           
{'loss': 2.5863, 'learning_rate': 2.7422482708095413e-07, 'epoch': 12.9}

 81%|████████  | 299600/371472 [1:40:29<5:23:43,  3.70it/s]
 81%|████████  | 299601/371472 [1:40:29<5:26:16,  3.67it/s]
 81%|████████  | 299602/371472 [1:40:29<5:37:36,  3.55it/s]
 81%|████████  | 299603/371472 [1:40:30<5:39:28,  3.53it/s]
 81%|████████  | 299604/371472 [1:40:30<5:36:54,  3.56it/s]
 81%|████████  | 299605/371472 [1:40:30<5:22:05,  3.72it/s]
 81%|████████  | 299606/371472 [1:40:30<5:22:04,  3.72it/s]
 81%|████████  | 299607/371472 [1:40:31<5:23:22,  3.70it/s]
 81%|████████  | 299608/371472 [1:40:31<5:29:12,  3.64it/s]
 81%|████████  | 299609/371472 [1:40:31<5:24:44,  3.69it/s]
 81%|████████  | 299610/371472 [1:40:32<5:39:14,  3.53it/s]
 81%|████████  | 299611/371472 [1:40:32<5:32:51,  3.60it/s]
 81%|████████  | 299612/371472 [1:40:32<5:38:18,  3.54it/s]
 81%|████████  | 299613/371472 [1:40:32<5:35:54,  3.57it/s]
 81%|████████  | 299614/371472 [1:40:33<5:34:50,  3.58it/s]
 81%|████████  | 299615/371472 [1:40:33<6:10:16,  3.23it/s]
 81%|████████  | 299616/371472 [1:40:33<6:06:45,  3.27it/s]
 81%|████████  | 299617/371472 [1:40:34<6:22:15,  3.13it/s]
 81%|████████  | 299618/371472 [1:40:34<6:11:53,  3.22it/s]
 81%|████████  | 299619/371472 [1:40:34<5:52:26,  3.40it/s]
 81%|████████  | 299620/371472 [1:40:35<6:01:09,  3.32it/s]
                                                           
{'loss': 2.6597, 'learning_rate': 2.7417634510547526e-07, 'epoch': 12.91}

 81%|████████  | 299620/371472 [1:40:35<6:01:09,  3.32it/s]
 81%|████████  | 299621/371472 [1:40:35<5:55:53,  3.36it/s]
 81%|████████  | 299622/371472 [1:40:35<6:04:55,  3.28it/s]
 81%|████████  | 299623/371472 [1:40:36<6:22:30,  3.13it/s]
 81%|████████  | 299624/371472 [1:40:36<5:51:44,  3.40it/s]
 81%|████████  | 299625/371472 [1:40:36<5:42:13,  3.50it/s]
 81%|████████  | 299626/371472 [1:40:36<5:33:48,  3.59it/s]
 81%|████████  | 299627/371472 [1:40:37<5:34:59,  3.57it/s]
 81%|████████  | 299628/371472 [1:40:37<5:45:57,  3.46it/s]
 81%|████████  | 299629/371472 [1:40:37<5:29:14,  3.64it/s]
 81%|████████  | 299630/371472 [1:40:37<5:31:31,  3.61it/s]
 81%|████████  | 299631/371472 [1:40:38<5:32:11,  3.60it/s]
 81%|████████  | 299632/371472 [1:40:38<5:37:51,  3.54it/s]
 81%|████████  | 299633/371472 [1:40:38<5:37:36,  3.55it/s]
 81%|████████  | 299634/371472 [1:40:39<5:43:36,  3.48it/s]
 81%|████████  | 299635/371472 [1:40:39<5:35:22,  3.57it/s]
 81%|████████  | 299636/371472 [1:40:39<6:20:20,  3.15it/s]
 81%|████████  | 299637/371472 [1:40:40<6:08:22,  3.25it/s]
 81%|████████  | 299638/371472 [1:40:40<5:59:00,  3.33it/s]
 81%|████████  | 299639/371472 [1:40:40<5:42:50,  3.49it/s]
 81%|████████  | 299640/371472 [1:40:40<5:37:21,  3.55it/s]
                                                           
{'loss': 2.6865, 'learning_rate': 2.7412786312999633e-07, 'epoch': 12.91}

 81%|████████  | 299640/371472 [1:40:40<5:37:21,  3.55it/s]
 81%|████████  | 299641/371472 [1:40:41<5:46:36,  3.45it/s]
 81%|████████  | 299642/371472 [1:40:41<5:37:02,  3.55it/s]
 81%|████████  | 299643/371472 [1:40:41<5:26:51,  3.66it/s]
 81%|████████  | 299644/371472 [1:40:42<5:48:14,  3.44it/s]
 81%|████████  | 299645/371472 [1:40:42<6:22:02,  3.13it/s]
 81%|████████  | 299646/371472 [1:40:42<6:07:56,  3.25it/s]
 81%|████████  | 299647/371472 [1:40:42<5:57:56,  3.34it/s]
 81%|████████  | 299648/371472 [1:40:43<6:04:18,  3.29it/s]
 81%|████████  | 299649/371472 [1:40:43<5:47:16,  3.45it/s]
 81%|████████  | 299650/371472 [1:40:43<6:05:34,  3.27it/s]
 81%|████████  | 299651/371472 [1:40:44<5:54:12,  3.38it/s]
 81%|████████  | 299652/371472 [1:40:44<5:46:21,  3.46it/s]
 81%|████████  | 299653/371472 [1:40:44<5:55:21,  3.37it/s]
 81%|████████  | 299654/371472 [1:40:45<5:50:36,  3.41it/s]
 81%|████████  | 299655/371472 [1:40:45<5:44:27,  3.47it/s]
 81%|████████  | 299656/371472 [1:40:45<5:37:44,  3.54it/s]
 81%|████████  | 299657/371472 [1:40:45<5:52:45,  3.39it/s]
 81%|████████  | 299658/371472 [1:40:46<5:48:16,  3.44it/s]
 81%|████████  | 299659/371472 [1:40:46<5:44:33,  3.47it/s]
 81%|████████  | 299660/371472 [1:40:46<5:51:00,  3.41it/s]
                                                           
{'loss': 2.6143, 'learning_rate': 2.7407938115451745e-07, 'epoch': 12.91}

 81%|████████  | 299660/371472 [1:40:46<5:51:00,  3.41it/s]
 81%|████████  | 299661/371472 [1:40:47<5:38:51,  3.53it/s]
 81%|████████  | 299662/371472 [1:40:47<5:52:41,  3.39it/s]
 81%|████████  | 299663/371472 [1:40:47<5:42:56,  3.49it/s]
 81%|████████  | 299664/371472 [1:40:47<5:47:38,  3.44it/s]
 81%|████████  | 299665/371472 [1:40:48<5:36:33,  3.56it/s]
 81%|████████  | 299666/371472 [1:40:48<5:34:23,  3.58it/s]
 81%|████████  | 299667/371472 [1:40:48<5:28:42,  3.64it/s]
 81%|████████  | 299668/371472 [1:40:49<6:00:00,  3.32it/s]
 81%|████████  | 299669/371472 [1:40:49<5:52:24,  3.40it/s]
 81%|████████  | 299670/371472 [1:40:49<5:31:43,  3.61it/s]
 81%|████████  | 299671/371472 [1:40:49<5:29:23,  3.63it/s]
 81%|████████  | 299672/371472 [1:40:50<5:54:12,  3.38it/s]
 81%|████████  | 299673/371472 [1:40:50<5:55:50,  3.36it/s]
 81%|████████  | 299674/371472 [1:40:50<5:49:04,  3.43it/s]
 81%|████████  | 299675/371472 [1:40:51<5:40:32,  3.51it/s]
 81%|████████  | 299676/371472 [1:40:51<5:37:22,  3.55it/s]
 81%|████████  | 299677/371472 [1:40:51<5:32:03,  3.60it/s]
 81%|████████  | 299678/371472 [1:40:51<5:17:04,  3.77it/s]
 81%|████████  | 299679/371472 [1:40:52<5:26:06,  3.67it/s]
 81%|████████  | 299680/371472 [1:40:52<5:53:02,  3.39it/s]
                                                           
{'loss': 2.6175, 'learning_rate': 2.740308991790385e-07, 'epoch': 12.91}

 81%|████████  | 299680/371472 [1:40:52<5:53:02,  3.39it/s]
 81%|████████  | 299681/371472 [1:40:52<5:55:28,  3.37it/s]
 81%|████████  | 299682/371472 [1:40:53<5:33:22,  3.59it/s]
 81%|████████  | 299683/371472 [1:40:53<6:32:11,  3.05it/s]
 81%|████████  | 299684/371472 [1:40:53<6:18:22,  3.16it/s]
 81%|████████  | 299685/371472 [1:40:53<5:51:44,  3.40it/s]
 81%|████████  | 299686/371472 [1:40:54<5:59:54,  3.32it/s]
 81%|████████  | 299687/371472 [1:40:54<5:48:23,  3.43it/s]
 81%|████████  | 299688/371472 [1:40:54<5:44:23,  3.47it/s]
 81%|████████  | 299689/371472 [1:40:55<5:27:25,  3.65it/s]
 81%|████████  | 299690/371472 [1:40:55<5:19:30,  3.74it/s]
 81%|████████  | 299691/371472 [1:40:55<5:46:48,  3.45it/s]
 81%|████████  | 299692/371472 [1:40:55<5:26:21,  3.67it/s]
 81%|████████  | 299693/371472 [1:40:56<5:28:09,  3.65it/s]
 81%|████████  | 299694/371472 [1:40:56<5:51:18,  3.41it/s]
 81%|████████  | 299695/371472 [1:40:56<5:54:05,  3.38it/s]
 81%|████████  | 299696/371472 [1:40:57<6:13:18,  3.20it/s]
 81%|████████  | 299697/371472 [1:40:57<6:03:54,  3.29it/s]
 81%|████████  | 299698/371472 [1:40:57<6:05:13,  3.28it/s]
 81%|████████  | 299699/371472 [1:40:58<5:44:09,  3.48it/s]
 81%|████████  | 299700/371472 [1:40:58<5:31:28,  3.61it/s]
                                                           
{'loss': 2.6008, 'learning_rate': 2.739824172035597e-07, 'epoch': 12.91}

 81%|████████  | 299700/371472 [1:40:58<5:31:28,  3.61it/s]
 81%|████████  | 299701/371472 [1:40:58<5:35:04,  3.57it/s]
 81%|████████  | 299702/371472 [1:40:58<5:32:56,  3.59it/s]
 81%|████████  | 299703/371472 [1:40:59<5:29:27,  3.63it/s]
 81%|████████  | 299704/371472 [1:40:59<5:21:33,  3.72it/s]
 81%|████████  | 299705/371472 [1:40:59<5:17:37,  3.77it/s]
 81%|████████  | 299706/371472 [1:40:59<5:11:32,  3.84it/s]
 81%|████████  | 299707/371472 [1:41:00<5:19:08,  3.75it/s]
 81%|████████  | 299708/371472 [1:41:00<5:38:11,  3.54it/s]
 81%|████████  | 299709/371472 [1:41:00<5:25:50,  3.67it/s]
 81%|████████  | 299710/371472 [1:41:01<5:39:04,  3.53it/s]
 81%|████████  | 299711/371472 [1:41:01<5:45:08,  3.47it/s]
 81%|████████  | 299712/371472 [1:41:01<5:48:22,  3.43it/s]
 81%|████████  | 299713/371472 [1:41:01<5:38:46,  3.53it/s]
 81%|████████  | 299714/371472 [1:41:02<5:25:55,  3.67it/s]
 81%|████████  | 299715/371472 [1:41:02<5:27:02,  3.66it/s]
 81%|████████  | 299716/371472 [1:41:02<5:40:37,  3.51it/s]
 81%|████████  | 299717/371472 [1:41:02<5:35:33,  3.56it/s]
 81%|████████  | 299718/371472 [1:41:03<5:45:47,  3.46it/s]
 81%|████████  | 299719/371472 [1:41:03<5:44:32,  3.47it/s]
 81%|████████  | 299720/371472 [1:41:03<5:33:51,  3.58it/s]
                                                           
{'loss': 2.6534, 'learning_rate': 2.7393393522808077e-07, 'epoch': 12.91}

 81%|████████  | 299720/371472 [1:41:03<5:33:51,  3.58it/s]
 81%|████████  | 299721/371472 [1:41:04<5:32:42,  3.59it/s]
 81%|████████  | 299722/371472 [1:41:04<5:51:35,  3.40it/s]
 81%|████████  | 299723/371472 [1:41:04<5:38:22,  3.53it/s]
 81%|████████  | 299724/371472 [1:41:05<6:12:29,  3.21it/s]
 81%|████████  | 299725/371472 [1:41:05<5:59:03,  3.33it/s]
 81%|████████  | 299726/371472 [1:41:05<5:58:39,  3.33it/s]
 81%|████████  | 299727/371472 [1:41:05<5:38:20,  3.53it/s]
 81%|████████  | 299728/371472 [1:41:06<5:38:56,  3.53it/s]
 81%|████████  | 299729/371472 [1:41:06<5:23:39,  3.69it/s]
 81%|████████  | 299730/371472 [1:41:06<5:31:18,  3.61it/s]
 81%|████████  | 299731/371472 [1:41:06<5:15:12,  3.79it/s]
 81%|████████  | 299732/371472 [1:41:07<5:13:03,  3.82it/s]
 81%|████████  | 299733/371472 [1:41:07<5:28:59,  3.63it/s]
 81%|████████  | 299734/371472 [1:41:07<5:16:50,  3.77it/s]
 81%|████████  | 299735/371472 [1:41:08<5:21:01,  3.72it/s]
 81%|████████  | 299736/371472 [1:41:08<5:26:50,  3.66it/s]
 81%|████████  | 299737/371472 [1:41:08<5:50:57,  3.41it/s]
 81%|████████  | 299738/371472 [1:41:08<5:49:17,  3.42it/s]
 81%|████████  | 299739/371472 [1:41:09<5:42:22,  3.49it/s]
 81%|████████  | 299740/371472 [1:41:09<5:39:34,  3.52it/s]
                                                           
{'loss': 2.4686, 'learning_rate': 2.738854532526018e-07, 'epoch': 12.91}

 81%|████████  | 299740/371472 [1:41:09<5:39:34,  3.52it/s]
 81%|████████  | 299741/371472 [1:41:09<5:39:16,  3.52it/s]
 81%|████████  | 299742/371472 [1:41:10<5:39:50,  3.52it/s]
 81%|████████  | 299743/371472 [1:41:10<5:23:56,  3.69it/s]
 81%|████████  | 299744/371472 [1:41:10<5:21:07,  3.72it/s]
 81%|████████  | 299745/371472 [1:41:10<5:14:31,  3.80it/s]
 81%|████████  | 299746/371472 [1:41:11<5:56:32,  3.35it/s]
 81%|████████  | 299747/371472 [1:41:11<6:05:01,  3.27it/s]
 81%|████████  | 299748/371472 [1:41:11<5:50:13,  3.41it/s]
 81%|████████  | 299749/371472 [1:41:12<5:36:31,  3.55it/s]
 81%|████████  | 299750/371472 [1:41:12<6:06:39,  3.26it/s]
 81%|████████  | 299751/371472 [1:41:12<5:48:58,  3.43it/s]
 81%|████████  | 299752/371472 [1:41:12<5:42:01,  3.49it/s]
 81%|████████  | 299753/371472 [1:41:13<5:36:46,  3.55it/s]
 81%|████████  | 299754/371472 [1:41:13<6:29:54,  3.07it/s]
 81%|████████  | 299755/371472 [1:41:13<6:02:57,  3.29it/s]
 81%|████████  | 299756/371472 [1:41:14<5:51:35,  3.40it/s]
 81%|████████  | 299757/371472 [1:41:14<5:37:11,  3.54it/s]
 81%|████████  | 299758/371472 [1:41:14<5:19:21,  3.74it/s]
 81%|████████  | 299759/371472 [1:41:14<5:26:34,  3.66it/s]
 81%|████████  | 299760/371472 [1:41:15<5:40:39,  3.51it/s]
                                                           
{'loss': 2.5069, 'learning_rate': 2.7383697127712297e-07, 'epoch': 12.91}

 81%|████████  | 299760/371472 [1:41:15<5:40:39,  3.51it/s]
 81%|████████  | 299761/371472 [1:41:15<5:46:33,  3.45it/s]
 81%|████████  | 299762/371472 [1:41:15<6:01:08,  3.31it/s]
 81%|████████  | 299763/371472 [1:41:16<5:42:29,  3.49it/s]
 81%|████████  | 299764/371472 [1:41:16<6:10:03,  3.23it/s]
 81%|████████  | 299765/371472 [1:41:16<6:06:29,  3.26it/s]
 81%|████████  | 299766/371472 [1:41:17<6:00:22,  3.32it/s]
 81%|████████  | 299767/371472 [1:41:17<6:11:35,  3.22it/s]
 81%|████████  | 299768/371472 [1:41:17<5:51:08,  3.40it/s]
 81%|████████  | 299769/371472 [1:41:17<5:38:40,  3.53it/s]
 81%|████████  | 299770/371472 [1:41:18<5:30:48,  3.61it/s]
 81%|████████  | 299771/371472 [1:41:18<5:31:24,  3.61it/s]
 81%|████████  | 299772/371472 [1:41:18<5:31:53,  3.60it/s]
 81%|████████  | 299773/371472 [1:41:18<5:21:22,  3.72it/s]
 81%|████████  | 299774/371472 [1:41:19<5:25:35,  3.67it/s]
 81%|████████  | 299775/371472 [1:41:19<5:12:56,  3.82it/s]
 81%|████████  | 299776/371472 [1:41:19<5:20:56,  3.72it/s]
 81%|████████  | 299777/371472 [1:41:20<5:11:55,  3.83it/s]
 81%|████████  | 299778/371472 [1:41:20<5:06:44,  3.90it/s]
 81%|████████  | 299779/371472 [1:41:20<5:05:55,  3.91it/s]
 81%|████████  | 299780/371472 [1:41:20<5:01:37,  3.96it/s]
                                                           
{'loss': 2.5873, 'learning_rate': 2.73788489301644e-07, 'epoch': 12.91}

 81%|████████  | 299780/371472 [1:41:20<5:01:37,  3.96it/s]
 81%|████████  | 299781/371472 [1:41:21<5:13:10,  3.82it/s]
 81%|████████  | 299782/371472 [1:41:21<5:12:58,  3.82it/s]
 81%|████████  | 299783/371472 [1:41:21<5:10:43,  3.85it/s]
 81%|████████  | 299784/371472 [1:41:21<5:42:44,  3.49it/s]
 81%|████████  | 299785/371472 [1:41:22<5:59:09,  3.33it/s]
 81%|████████  | 299786/371472 [1:41:22<5:45:23,  3.46it/s]
 81%|████████  | 299787/371472 [1:41:22<5:35:53,  3.56it/s]
 81%|████████  | 299788/371472 [1:41:23<5:18:45,  3.75it/s]
 81%|████████  | 299789/371472 [1:41:23<5:15:32,  3.79it/s]
 81%|████████  | 299790/371472 [1:41:23<5:23:16,  3.70it/s]
 81%|████████  | 299791/371472 [1:41:23<5:24:06,  3.69it/s]
 81%|████████  | 299792/371472 [1:41:24<5:23:41,  3.69it/s]
 81%|████████  | 299793/371472 [1:41:24<5:32:02,  3.60it/s]
 81%|████████  | 299794/371472 [1:41:24<5:51:00,  3.40it/s]
 81%|████████  | 299795/371472 [1:41:25<5:57:40,  3.34it/s]
 81%|████████  | 299796/371472 [1:41:25<5:38:20,  3.53it/s]
 81%|████████  | 299797/371472 [1:41:25<5:44:04,  3.47it/s]
 81%|████████  | 299798/371472 [1:41:25<5:44:56,  3.46it/s]
 81%|████████  | 299799/371472 [1:41:26<5:55:16,  3.36it/s]
 81%|████████  | 299800/371472 [1:41:26<5:58:16,  3.33it/s]
                                                           
{'loss': 2.6245, 'learning_rate': 2.7374000732616516e-07, 'epoch': 12.91}

 81%|████████  | 299800/371472 [1:41:26<5:58:16,  3.33it/s]
 81%|████████  | 299801/371472 [1:41:26<6:05:43,  3.27it/s]
 81%|████████  | 299802/371472 [1:41:27<5:48:02,  3.43it/s]
 81%|████████  | 299803/371472 [1:41:27<5:45:24,  3.46it/s]
 81%|████████  | 299804/371472 [1:41:27<5:41:13,  3.50it/s]
 81%|████████  | 299805/371472 [1:41:27<5:37:42,  3.54it/s]
 81%|████████  | 299806/371472 [1:41:28<5:21:36,  3.71it/s]
 81%|████████  | 299807/371472 [1:41:28<5:19:44,  3.74it/s]
 81%|████████  | 299808/371472 [1:41:28<5:14:48,  3.79it/s]
 81%|████████  | 299809/371472 [1:41:28<5:29:36,  3.62it/s]
 81%|████████  | 299810/371472 [1:41:29<5:22:23,  3.70it/s]
 81%|████████  | 299811/371472 [1:41:29<5:26:01,  3.66it/s]
 81%|████████  | 299812/371472 [1:41:29<5:19:41,  3.74it/s]
 81%|████████  | 299813/371472 [1:41:30<5:21:07,  3.72it/s]
 81%|████████  | 299814/371472 [1:41:30<5:47:23,  3.44it/s]
 81%|████████  | 299815/371472 [1:41:30<5:45:23,  3.46it/s]
 81%|████████  | 299816/371472 [1:41:30<5:49:23,  3.42it/s]
 81%|████████  | 299817/371472 [1:41:31<6:14:24,  3.19it/s]
 81%|████████  | 299818/371472 [1:41:31<5:51:37,  3.40it/s]
 81%|████████  | 299819/371472 [1:41:31<5:38:58,  3.52it/s]
 81%|████████  | 299820/371472 [1:41:32<5:29:39,  3.62it/s]
                                                           
{'loss': 2.7032, 'learning_rate': 2.7369152535068624e-07, 'epoch': 12.91}

 81%|████████  | 299820/371472 [1:41:32<5:29:39,  3.62it/s]
 81%|████████  | 299821/371472 [1:41:32<5:25:40,  3.67it/s]
 81%|████████  | 299822/371472 [1:41:32<5:14:51,  3.79it/s]
 81%|████████  | 299823/371472 [1:41:32<5:06:30,  3.90it/s]
 81%|████████  | 299824/371472 [1:41:33<5:17:26,  3.76it/s]
 81%|████████  | 299825/371472 [1:41:33<5:16:48,  3.77it/s]
 81%|████████  | 299826/371472 [1:41:33<5:09:31,  3.86it/s]
 81%|████████  | 299827/371472 [1:41:33<5:29:36,  3.62it/s]
 81%|████████  | 299828/371472 [1:41:34<5:46:33,  3.45it/s]
 81%|████████  | 299829/371472 [1:41:34<5:39:31,  3.52it/s]
 81%|████████  | 299830/371472 [1:41:34<5:26:35,  3.66it/s]
 81%|████████  | 299831/371472 [1:41:35<5:24:34,  3.68it/s]
 81%|████████  | 299832/371472 [1:41:35<5:22:55,  3.70it/s]
 81%|████████  | 299833/371472 [1:41:35<5:11:22,  3.83it/s]
 81%|████████  | 299834/371472 [1:41:35<5:18:31,  3.75it/s]
 81%|████████  | 299835/371472 [1:41:36<5:16:06,  3.78it/s]
 81%|████████  | 299836/371472 [1:41:36<5:17:54,  3.76it/s]
 81%|████████  | 299837/371472 [1:41:36<5:36:06,  3.55it/s]
 81%|████████  | 299838/371472 [1:41:37<5:38:45,  3.52it/s]
 81%|████████  | 299839/371472 [1:41:37<5:44:31,  3.47it/s]
 81%|████████  | 299840/371472 [1:41:37<5:29:23,  3.62it/s]
                                                           
{'loss': 2.6818, 'learning_rate': 2.736430433752074e-07, 'epoch': 12.91}

 81%|████████  | 299840/371472 [1:41:37<5:29:23,  3.62it/s]
 81%|████████  | 299841/371472 [1:41:37<5:36:32,  3.55it/s]
 81%|████████  | 299842/371472 [1:41:38<5:25:19,  3.67it/s]
 81%|████████  | 299843/371472 [1:41:38<5:25:05,  3.67it/s]
 81%|████████  | 299844/371472 [1:41:38<5:10:22,  3.85it/s]
 81%|████████  | 299845/371472 [1:41:38<5:09:49,  3.85it/s]
 81%|████████  | 299846/371472 [1:41:39<5:06:53,  3.89it/s]
 81%|████████  | 299847/371472 [1:41:39<5:22:06,  3.71it/s]
 81%|████████  | 299848/371472 [1:41:39<5:35:52,  3.55it/s]
 81%|████████  | 299849/371472 [1:41:40<5:46:17,  3.45it/s]
 81%|████████  | 299850/371472 [1:41:40<5:52:18,  3.39it/s]
 81%|████████  | 299851/371472 [1:41:40<5:35:52,  3.55it/s]
 81%|████████  | 299852/371472 [1:41:40<5:36:29,  3.55it/s]
 81%|████████  | 299853/371472 [1:41:41<5:36:01,  3.55it/s]
 81%|████████  | 299854/371472 [1:41:41<5:33:34,  3.58it/s]
 81%|████████  | 299855/371472 [1:41:41<5:33:16,  3.58it/s]
 81%|████████  | 299856/371472 [1:41:42<5:43:14,  3.48it/s]
 81%|████████  | 299857/371472 [1:41:42<5:41:43,  3.49it/s]
 81%|████████  | 299858/371472 [1:41:42<5:32:44,  3.59it/s]
 81%|████████  | 299859/371472 [1:41:42<6:25:28,  3.10it/s]
 81%|████████  | 299860/371472 [1:41:43<6:21:02,  3.13it/s]
                                                           
{'loss': 2.5451, 'learning_rate': 2.735945613997285e-07, 'epoch': 12.92}

 81%|████████  | 299860/371472 [1:41:43<6:21:02,  3.13it/s]
 81%|████████  | 299861/371472 [1:41:43<6:10:49,  3.22it/s]
 81%|████████  | 299862/371472 [1:41:43<6:06:09,  3.26it/s]
 81%|████████  | 299863/371472 [1:41:44<6:24:21,  3.11it/s]
 81%|████████  | 299864/371472 [1:41:44<6:18:36,  3.15it/s]
 81%|████████  | 299865/371472 [1:41:44<6:01:36,  3.30it/s]
 81%|████████  | 299866/371472 [1:41:45<5:38:40,  3.52it/s]
 81%|████████  | 299867/371472 [1:41:45<5:27:08,  3.65it/s]
 81%|████████  | 299868/371472 [1:41:45<5:21:52,  3.71it/s]
 81%|████████  | 299869/371472 [1:41:45<5:14:20,  3.80it/s]
 81%|████████  | 299870/371472 [1:41:46<5:08:05,  3.87it/s]
 81%|████████  | 299871/371472 [1:41:46<5:15:12,  3.79it/s]
 81%|████████  | 299872/371472 [1:41:46<5:15:13,  3.79it/s]
 81%|████████  | 299873/371472 [1:41:46<5:27:02,  3.65it/s]
 81%|████████  | 299874/371472 [1:41:47<5:36:01,  3.55it/s]
 81%|████████  | 299875/371472 [1:41:47<5:24:52,  3.67it/s]
 81%|████████  | 299876/371472 [1:41:47<5:16:28,  3.77it/s]
 81%|████████  | 299877/371472 [1:41:47<5:25:50,  3.66it/s]
 81%|████████  | 299878/371472 [1:41:48<5:13:08,  3.81it/s]
 81%|████████  | 299879/371472 [1:41:48<6:31:49,  3.05it/s]
 81%|████████  | 299880/371472 [1:41:48<6:09:07,  3.23it/s]
                                                           
{'loss': 2.6756, 'learning_rate': 2.735460794242496e-07, 'epoch': 12.92}

 81%|████████  | 299880/371472 [1:41:48<6:09:07,  3.23it/s]
 81%|████████  | 299881/371472 [1:41:49<5:51:04,  3.40it/s]
 81%|████████  | 299882/371472 [1:41:49<5:51:59,  3.39it/s]
 81%|████████  | 299883/371472 [1:41:49<5:45:47,  3.45it/s]
 81%|████████  | 299884/371472 [1:41:50<5:37:57,  3.53it/s]
 81%|████████  | 299885/371472 [1:41:50<5:29:55,  3.62it/s]
 81%|████████  | 299886/371472 [1:41:50<5:22:10,  3.70it/s]
 81%|████████  | 299887/371472 [1:41:50<5:14:38,  3.79it/s]
 81%|████████  | 299888/371472 [1:41:51<5:08:38,  3.87it/s]
 81%|████████  | 299889/371472 [1:41:51<5:02:13,  3.95it/s]
 81%|████████  | 299890/371472 [1:41:51<5:06:13,  3.90it/s]
 81%|████████  | 299891/371472 [1:41:51<5:19:12,  3.74it/s]
 81%|████████  | 299892/371472 [1:41:52<5:25:36,  3.66it/s]
 81%|████████  | 299893/371472 [1:41:52<5:20:38,  3.72it/s]
 81%|████████  | 299894/371472 [1:41:52<5:17:12,  3.76it/s]
 81%|████████  | 299895/371472 [1:41:53<5:53:21,  3.38it/s]
 81%|████████  | 299896/371472 [1:41:53<5:41:59,  3.49it/s]
 81%|████████  | 299897/371472 [1:41:53<5:28:29,  3.63it/s]
 81%|████████  | 299898/371472 [1:41:53<5:30:03,  3.61it/s]
 81%|████████  | 299899/371472 [1:41:54<6:06:23,  3.26it/s]
 81%|████████  | 299900/371472 [1:41:54<5:44:43,  3.46it/s]
                                                           
{'loss': 2.6983, 'learning_rate': 2.734975974487706e-07, 'epoch': 12.92}

 81%|████████  | 299900/371472 [1:41:54<5:44:43,  3.46it/s]
 81%|████████  | 299901/371472 [1:41:54<5:45:12,  3.46it/s]
 81%|████████  | 299902/371472 [1:41:55<5:39:55,  3.51it/s]
 81%|████████  | 299903/371472 [1:41:55<5:31:03,  3.60it/s]
 81%|████████  | 299904/371472 [1:41:55<5:28:05,  3.64it/s]
 81%|████████  | 299905/371472 [1:41:55<5:24:10,  3.68it/s]
 81%|████████  | 299906/371472 [1:41:56<5:13:56,  3.80it/s]
 81%|████████  | 299907/371472 [1:41:56<5:40:19,  3.50it/s]
 81%|████████  | 299908/371472 [1:41:56<5:43:45,  3.47it/s]
 81%|████████  | 299909/371472 [1:41:56<5:31:11,  3.60it/s]
 81%|████████  | 299910/371472 [1:41:57<5:36:47,  3.54it/s]
 81%|████████  | 299911/371472 [1:41:57<6:00:12,  3.31it/s]
 81%|████████  | 299912/371472 [1:41:57<5:44:23,  3.46it/s]
 81%|████████  | 299913/371472 [1:41:58<5:27:39,  3.64it/s]
 81%|████████  | 299914/371472 [1:41:58<5:35:16,  3.56it/s]
 81%|████████  | 299915/371472 [1:41:58<5:28:30,  3.63it/s]
 81%|████████  | 299916/371472 [1:41:58<5:42:03,  3.49it/s]
 81%|████████  | 299917/371472 [1:41:59<5:29:23,  3.62it/s]
 81%|████████  | 299918/371472 [1:41:59<5:40:32,  3.50it/s]
 81%|████████  | 299919/371472 [1:41:59<5:35:15,  3.56it/s]
 81%|████████  | 299920/371472 [1:42:00<5:24:00,  3.68it/s]
                                                           
{'loss': 2.6017, 'learning_rate': 2.734491154732918e-07, 'epoch': 12.92}

 81%|████████  | 299920/371472 [1:42:00<5:24:00,  3.68it/s]
 81%|████████  | 299921/371472 [1:42:00<5:31:22,  3.60it/s]
 81%|████████  | 299922/371472 [1:42:00<5:27:09,  3.65it/s]
 81%|████████  | 299923/371472 [1:42:00<5:37:57,  3.53it/s]
 81%|████████  | 299924/371472 [1:42:01<5:54:02,  3.37it/s]
 81%|████████  | 299925/371472 [1:42:01<5:44:58,  3.46it/s]
 81%|████████  | 299926/371472 [1:42:01<5:34:02,  3.57it/s]
 81%|████████  | 299927/371472 [1:42:02<5:23:38,  3.68it/s]
 81%|████████  | 299928/371472 [1:42:02<5:18:37,  3.74it/s]
 81%|████████  | 299929/371472 [1:42:02<5:45:21,  3.45it/s]
 81%|████████  | 299930/371472 [1:42:02<5:51:50,  3.39it/s]
 81%|████████  | 299931/371472 [1:42:03<6:03:52,  3.28it/s]
 81%|████████  | 299932/371472 [1:42:03<5:42:17,  3.48it/s]
 81%|████████  | 299933/371472 [1:42:03<5:34:22,  3.57it/s]
 81%|████████  | 299934/371472 [1:42:04<5:41:35,  3.49it/s]
 81%|████████  | 299935/371472 [1:42:04<5:29:28,  3.62it/s]
 81%|████████  | 299936/371472 [1:42:04<5:28:11,  3.63it/s]
 81%|████████  | 299937/371472 [1:42:04<5:17:01,  3.76it/s]
 81%|████████  | 299938/371472 [1:42:05<5:12:03,  3.82it/s]
 81%|████████  | 299939/371472 [1:42:05<5:07:11,  3.88it/s]
 81%|████████  | 299940/371472 [1:42:05<5:07:56,  3.87it/s]
                                                           
{'loss': 2.5622, 'learning_rate': 2.734006334978129e-07, 'epoch': 12.92}

 81%|████████  | 299940/371472 [1:42:05<5:07:56,  3.87it/s]
 81%|████████  | 299941/371472 [1:42:05<5:16:08,  3.77it/s]
 81%|████████  | 299942/371472 [1:42:06<5:10:38,  3.84it/s]
 81%|████████  | 299943/371472 [1:42:06<5:11:37,  3.83it/s]
 81%|████████  | 299944/371472 [1:42:06<5:56:11,  3.35it/s]
 81%|████████  | 299945/371472 [1:42:07<5:47:40,  3.43it/s]
 81%|████████  | 299946/371472 [1:42:07<5:41:15,  3.49it/s]
 81%|████████  | 299947/371472 [1:42:07<5:40:00,  3.51it/s]
 81%|████████  | 299948/371472 [1:42:07<5:34:23,  3.56it/s]
 81%|████████  | 299949/371472 [1:42:08<5:26:29,  3.65it/s]
 81%|████████  | 299950/371472 [1:42:08<5:21:47,  3.70it/s]
 81%|████████  | 299951/371472 [1:42:08<5:32:01,  3.59it/s]
 81%|████████  | 299952/371472 [1:42:08<5:39:50,  3.51it/s]
 81%|████████  | 299953/371472 [1:42:09<6:01:05,  3.30it/s]
 81%|████████  | 299954/371472 [1:42:09<5:44:50,  3.46it/s]
 81%|████████  | 299955/371472 [1:42:09<5:30:48,  3.60it/s]
 81%|████████  | 299956/371472 [1:42:10<6:04:54,  3.27it/s]
 81%|████████  | 299957/371472 [1:42:10<6:19:46,  3.14it/s]
 81%|████████  | 299958/371472 [1:42:10<6:00:44,  3.30it/s]
 81%|████████  | 299959/371472 [1:42:11<5:52:57,  3.38it/s]
 81%|████████  | 299960/371472 [1:42:11<6:02:05,  3.29it/s]
                                                           
{'loss': 2.542, 'learning_rate': 2.7335215152233405e-07, 'epoch': 12.92}

 81%|████████  | 299960/371472 [1:42:11<6:02:05,  3.29it/s]
 81%|████████  | 299961/371472 [1:42:11<5:45:46,  3.45it/s]
 81%|████████  | 299962/371472 [1:42:11<5:37:00,  3.54it/s]
 81%|████████  | 299963/371472 [1:42:12<5:38:12,  3.52it/s]
 81%|████████  | 299964/371472 [1:42:12<5:56:56,  3.34it/s]
 81%|████████  | 299965/371472 [1:42:12<5:40:54,  3.50it/s]
 81%|████████  | 299966/371472 [1:42:13<5:39:33,  3.51it/s]
 81%|████████  | 299967/371472 [1:42:13<5:50:28,  3.40it/s]
 81%|████████  | 299968/371472 [1:42:13<5:40:04,  3.50it/s]
 81%|████████  | 299969/371472 [1:42:13<5:30:58,  3.60it/s]
 81%|████████  | 299970/371472 [1:42:14<5:21:37,  3.71it/s]
 81%|████████  | 299971/371472 [1:42:14<5:24:39,  3.67it/s]
 81%|████████  | 299972/371472 [1:42:14<5:46:27,  3.44it/s]
 81%|████████  | 299973/371472 [1:42:15<5:36:08,  3.55it/s]
 81%|████████  | 299974/371472 [1:42:15<5:59:01,  3.32it/s]
 81%|████████  | 299975/371472 [1:42:15<5:43:29,  3.47it/s]
 81%|████████  | 299976/371472 [1:42:15<5:31:13,  3.60it/s]
 81%|████████  | 299977/371472 [1:42:16<5:44:19,  3.46it/s]
 81%|████████  | 299978/371472 [1:42:16<5:29:44,  3.61it/s]
 81%|████████  | 299979/371472 [1:42:16<5:39:39,  3.51it/s]
 81%|████████  | 299980/371472 [1:42:17<5:30:01,  3.61it/s]
                                                           
{'loss': 2.695, 'learning_rate': 2.733036695468551e-07, 'epoch': 12.92}

 81%|████████  | 299980/371472 [1:42:17<5:30:01,  3.61it/s]
 81%|████████  | 299981/371472 [1:42:17<5:40:56,  3.49it/s]
 81%|████████  | 299982/371472 [1:42:17<5:45:11,  3.45it/s]
 81%|████████  | 299983/371472 [1:42:17<5:29:01,  3.62it/s]
 81%|████████  | 299984/371472 [1:42:18<5:21:32,  3.71it/s]
 81%|████████  | 299985/371472 [1:42:18<5:31:07,  3.60it/s]
 81%|████████  | 299986/371472 [1:42:18<5:39:25,  3.51it/s]
 81%|████████  | 299987/371472 [1:42:19<5:28:39,  3.63it/s]
 81%|████████  | 299988/371472 [1:42:19<5:22:43,  3.69it/s]
 81%|████████  | 299989/371472 [1:42:19<5:27:08,  3.64it/s]
 81%|████████  | 299990/371472 [1:42:19<5:25:42,  3.66it/s]
 81%|████████  | 299991/371472 [1:42:20<5:14:04,  3.79it/s]
 81%|████████  | 299992/371472 [1:42:20<5:08:22,  3.86it/s]
 81%|████████  | 299993/371472 [1:42:20<5:02:11,  3.94it/s]
 81%|████████  | 299994/371472 [1:42:20<5:08:11,  3.87it/s]
 81%|████████  | 299995/371472 [1:42:21<5:35:21,  3.55it/s]
 81%|████████  | 299996/371472 [1:42:21<5:31:21,  3.60it/s]
 81%|████████  | 299997/371472 [1:42:21<5:22:45,  3.69it/s]
 81%|████████  | 299998/371472 [1:42:21<5:16:54,  3.76it/s]
 81%|████████  | 299999/371472 [1:42:22<5:45:53,  3.44it/s]
 81%|████████  | 300000/371472 [1:42:22<5:47:30,  3.43it/s]
                                                           
{'loss': 2.7653, 'learning_rate': 2.732551875713762e-07, 'epoch': 12.92}

 81%|████████  | 300000/371472 [1:42:22<5:47:30,  3.43it/s]
 81%|████████  | 300001/371472 [1:42:22<5:42:49,  3.47it/s]
 81%|████████  | 300002/371472 [1:42:23<5:44:01,  3.46it/s]
 81%|████████  | 300003/371472 [1:42:23<5:49:37,  3.41it/s]
 81%|████████  | 300004/371472 [1:42:23<5:35:28,  3.55it/s]
 81%|████████  | 300005/371472 [1:42:24<5:51:39,  3.39it/s]
 81%|████████  | 300006/371472 [1:42:24<5:35:20,  3.55it/s]
 81%|████████  | 300007/371472 [1:42:24<5:21:27,  3.71it/s]
 81%|████████  | 300008/371472 [1:42:24<5:30:01,  3.61it/s]
 81%|████████  | 300009/371472 [1:42:25<5:22:20,  3.70it/s]
 81%|████████  | 300010/371472 [1:42:25<5:16:57,  3.76it/s]
 81%|████████  | 300011/371472 [1:42:25<5:28:27,  3.63it/s]
 81%|████████  | 300012/371472 [1:42:25<5:21:52,  3.70it/s]
 81%|████████  | 300013/371472 [1:42:26<5:18:43,  3.74it/s]
 81%|████████  | 300014/371472 [1:42:26<5:38:16,  3.52it/s]
 81%|████████  | 300015/371472 [1:42:26<5:37:04,  3.53it/s]
 81%|████████  | 300016/371472 [1:42:27<5:33:46,  3.57it/s]
 81%|████████  | 300017/371472 [1:42:27<5:28:17,  3.63it/s]
 81%|████████  | 300018/371472 [1:42:27<5:36:17,  3.54it/s]
 81%|████████  | 300019/371472 [1:42:27<5:28:10,  3.63it/s]
 81%|████████  | 300020/371472 [1:42:28<5:27:04,  3.64it/s]
                                                           
{'loss': 2.7004, 'learning_rate': 2.732067055958973e-07, 'epoch': 12.92}

 81%|████████  | 300020/371472 [1:42:28<5:27:04,  3.64it/s]
 81%|████████  | 300021/371472 [1:42:28<5:13:08,  3.80it/s]
 81%|████████  | 300022/371472 [1:42:28<5:39:18,  3.51it/s]
 81%|████████  | 300023/371472 [1:42:29<6:00:11,  3.31it/s]
 81%|████████  | 300024/371472 [1:42:29<5:52:57,  3.37it/s]
 81%|████████  | 300025/371472 [1:42:29<5:57:56,  3.33it/s]
 81%|████████  | 300026/371472 [1:42:29<5:37:21,  3.53it/s]
 81%|████████  | 300027/371472 [1:42:30<5:29:43,  3.61it/s]
 81%|████████  | 300028/371472 [1:42:30<5:32:30,  3.58it/s]
 81%|████████  | 300029/371472 [1:42:30<5:39:09,  3.51it/s]
 81%|████████  | 300030/371472 [1:42:31<5:41:04,  3.49it/s]
 81%|████████  | 300031/371472 [1:42:31<5:45:52,  3.44it/s]
 81%|████████  | 300032/371472 [1:42:31<5:37:26,  3.53it/s]
 81%|████████  | 300033/371472 [1:42:31<5:29:06,  3.62it/s]
 81%|████████  | 300034/371472 [1:42:32<5:14:31,  3.79it/s]
 81%|████████  | 300035/371472 [1:42:32<5:25:49,  3.65it/s]
 81%|████████  | 300036/371472 [1:42:32<5:30:12,  3.61it/s]
 81%|████████  | 300037/371472 [1:42:32<5:31:34,  3.59it/s]
 81%|████████  | 300038/371472 [1:42:33<5:22:42,  3.69it/s]
 81%|████████  | 300039/371472 [1:42:33<5:44:13,  3.46it/s]
 81%|████████  | 300040/371472 [1:42:33<5:34:56,  3.55it/s]
                                                           
{'loss': 2.7434, 'learning_rate': 2.7315822362041845e-07, 'epoch': 12.92}

 81%|████████  | 300040/371472 [1:42:33<5:34:56,  3.55it/s]
 81%|████████  | 300041/371472 [1:42:34<5:32:43,  3.58it/s]
 81%|████████  | 300042/371472 [1:42:34<6:00:15,  3.30it/s]
 81%|████████  | 300043/371472 [1:42:34<5:39:54,  3.50it/s]
 81%|████████  | 300044/371472 [1:42:34<5:30:00,  3.61it/s]
 81%|████████  | 300045/371472 [1:42:35<5:32:55,  3.58it/s]
 81%|████████  | 300046/371472 [1:42:35<5:33:04,  3.57it/s]
 81%|████████  | 300047/371472 [1:42:35<5:39:14,  3.51it/s]
 81%|████████  | 300048/371472 [1:42:36<5:46:49,  3.43it/s]
 81%|████████  | 300049/371472 [1:42:36<5:31:26,  3.59it/s]
 81%|████████  | 300050/371472 [1:42:36<5:25:12,  3.66it/s]
 81%|████████  | 300051/371472 [1:42:36<5:20:38,  3.71it/s]
 81%|████████  | 300052/371472 [1:42:37<5:55:13,  3.35it/s]
 81%|████████  | 300053/371472 [1:42:37<5:44:57,  3.45it/s]
 81%|████████  | 300054/371472 [1:42:37<5:43:59,  3.46it/s]
 81%|████████  | 300055/371472 [1:42:38<5:47:08,  3.43it/s]
 81%|████████  | 300056/371472 [1:42:38<5:40:45,  3.49it/s]
 81%|████████  | 300057/371472 [1:42:38<5:37:22,  3.53it/s]
 81%|████████  | 300058/371472 [1:42:38<5:35:19,  3.55it/s]
 81%|████████  | 300059/371472 [1:42:39<5:46:53,  3.43it/s]
 81%|████████  | 300060/371472 [1:42:39<5:38:28,  3.52it/s]
                                                           
{'loss': 2.5178, 'learning_rate': 2.731097416449395e-07, 'epoch': 12.92}

 81%|████████  | 300060/371472 [1:42:39<5:38:28,  3.52it/s]
 81%|████████  | 300061/371472 [1:42:39<5:24:39,  3.67it/s]
 81%|████████  | 300062/371472 [1:42:40<5:28:31,  3.62it/s]
 81%|████████  | 300063/371472 [1:42:40<5:22:10,  3.69it/s]
 81%|████████  | 300064/371472 [1:42:40<5:19:37,  3.72it/s]
 81%|████████  | 300065/371472 [1:42:40<5:10:47,  3.83it/s]
 81%|████████  | 300066/371472 [1:42:41<5:11:00,  3.83it/s]
 81%|████████  | 300067/371472 [1:42:41<5:54:43,  3.35it/s]
 81%|████████  | 300068/371472 [1:42:41<5:44:49,  3.45it/s]
 81%|████████  | 300069/371472 [1:42:42<5:53:34,  3.37it/s]
 81%|████████  | 300070/371472 [1:42:42<5:43:34,  3.46it/s]
 81%|████████  | 300071/371472 [1:42:42<5:41:38,  3.48it/s]
 81%|████████  | 300072/371472 [1:42:42<6:00:58,  3.30it/s]
 81%|████████  | 300073/371472 [1:42:43<5:42:28,  3.47it/s]
 81%|████████  | 300074/371472 [1:42:43<5:45:51,  3.44it/s]
 81%|████████  | 300075/371472 [1:42:43<5:43:10,  3.47it/s]
 81%|████████  | 300076/371472 [1:42:44<5:44:17,  3.46it/s]
 81%|████████  | 300077/371472 [1:42:44<5:34:57,  3.55it/s]
 81%|████████  | 300078/371472 [1:42:44<5:34:01,  3.56it/s]
 81%|████████  | 300079/371472 [1:42:44<5:25:01,  3.66it/s]
 81%|████████  | 300080/371472 [1:42:45<5:24:17,  3.67it/s]
                                                           
{'loss': 2.5278, 'learning_rate': 2.730612596694607e-07, 'epoch': 12.93}

 81%|████████  | 300080/371472 [1:42:45<5:24:17,  3.67it/s]
 81%|████████  | 300081/371472 [1:42:45<5:27:01,  3.64it/s]
 81%|████████  | 300082/371472 [1:42:45<5:21:58,  3.70it/s]
 81%|████████  | 300083/371472 [1:42:45<5:23:52,  3.67it/s]
 81%|████████  | 300084/371472 [1:42:46<5:28:36,  3.62it/s]
 81%|████████  | 300085/371472 [1:42:46<5:40:14,  3.50it/s]
 81%|████████  | 300086/371472 [1:42:46<5:55:03,  3.35it/s]
 81%|████████  | 300087/371472 [1:42:47<5:35:09,  3.55it/s]
 81%|████████  | 300088/371472 [1:42:47<5:24:28,  3.67it/s]
 81%|████████  | 300089/371472 [1:42:47<5:24:52,  3.66it/s]
 81%|████████  | 300090/371472 [1:42:47<5:18:14,  3.74it/s]
 81%|████████  | 300091/371472 [1:42:48<5:06:09,  3.89it/s]
 81%|████████  | 300092/371472 [1:42:48<5:04:44,  3.90it/s]
 81%|████████  | 300093/371472 [1:42:48<5:27:23,  3.63it/s]
 81%|████████  | 300094/371472 [1:42:48<5:21:46,  3.70it/s]
 81%|████████  | 300095/371472 [1:42:49<5:28:27,  3.62it/s]
 81%|████████  | 300096/371472 [1:42:49<5:28:05,  3.63it/s]
 81%|████████  | 300097/371472 [1:42:49<5:26:48,  3.64it/s]
 81%|████████  | 300098/371472 [1:42:50<5:24:27,  3.67it/s]
 81%|████████  | 300099/371472 [1:42:50<5:29:21,  3.61it/s]
 81%|████████  | 300100/371472 [1:42:50<5:22:12,  3.69it/s]
                                                           
{'loss': 2.6071, 'learning_rate': 2.7301277769398177e-07, 'epoch': 12.93}

 81%|████████  | 300100/371472 [1:42:50<5:22:12,  3.69it/s]
 81%|████████  | 300101/371472 [1:42:50<5:25:13,  3.66it/s]
 81%|████████  | 300102/371472 [1:42:51<5:23:50,  3.67it/s]
 81%|████████  | 300103/371472 [1:42:51<5:40:53,  3.49it/s]
 81%|████████  | 300104/371472 [1:42:51<5:38:41,  3.51it/s]
 81%|████████  | 300105/371472 [1:42:52<5:58:25,  3.32it/s]
 81%|████████  | 300106/371472 [1:42:52<5:47:27,  3.42it/s]
 81%|████████  | 300107/371472 [1:42:52<5:41:51,  3.48it/s]
 81%|████████  | 300108/371472 [1:42:52<5:46:44,  3.43it/s]
 81%|████████  | 300109/371472 [1:42:53<5:57:34,  3.33it/s]
 81%|████████  | 300110/371472 [1:42:53<5:39:46,  3.50it/s]
 81%|████████  | 300111/371472 [1:42:53<5:25:40,  3.65it/s]
 81%|████████  | 300112/371472 [1:42:54<5:26:26,  3.64it/s]
 81%|████████  | 300113/371472 [1:42:54<5:20:14,  3.71it/s]
 81%|████████  | 300114/371472 [1:42:54<5:30:39,  3.60it/s]
 81%|████████  | 300115/371472 [1:42:54<5:13:23,  3.79it/s]
 81%|████████  | 300116/371472 [1:42:55<5:15:58,  3.76it/s]
 81%|████████  | 300117/371472 [1:42:55<5:33:02,  3.57it/s]
 81%|████████  | 300118/371472 [1:42:55<5:20:24,  3.71it/s]
 81%|████████  | 300119/371472 [1:42:55<5:07:07,  3.87it/s]
 81%|████████  | 300120/371472 [1:42:56<5:08:49,  3.85it/s]
                                                           
{'loss': 2.6055, 'learning_rate': 2.729642957185029e-07, 'epoch': 12.93}

 81%|████████  | 300120/371472 [1:42:56<5:08:49,  3.85it/s]
 81%|████████  | 300121/371472 [1:42:56<5:09:15,  3.85it/s]
 81%|████████  | 300122/371472 [1:42:56<5:36:08,  3.54it/s]
 81%|████████  | 300123/371472 [1:42:56<5:30:24,  3.60it/s]
 81%|████████  | 300124/371472 [1:42:57<5:49:01,  3.41it/s]
 81%|████████  | 300125/371472 [1:42:57<5:49:18,  3.40it/s]
 81%|████████  | 300126/371472 [1:42:57<6:01:53,  3.29it/s]
 81%|████████  | 300127/371472 [1:42:58<5:42:45,  3.47it/s]
 81%|████████  | 300128/371472 [1:42:58<5:37:28,  3.52it/s]
 81%|████████  | 300129/371472 [1:42:58<5:21:46,  3.70it/s]
 81%|████████  | 300130/371472 [1:42:58<5:20:15,  3.71it/s]
 81%|████████  | 300131/371472 [1:42:59<5:29:43,  3.61it/s]
 81%|████████  | 300132/371472 [1:42:59<5:24:22,  3.67it/s]
 81%|████████  | 300133/371472 [1:42:59<5:29:41,  3.61it/s]
 81%|████████  | 300134/371472 [1:43:00<5:39:07,  3.51it/s]
 81%|████████  | 300135/371472 [1:43:00<5:44:49,  3.45it/s]
 81%|████████  | 300136/371472 [1:43:00<5:42:49,  3.47it/s]
 81%|████████  | 300137/371472 [1:43:00<5:32:57,  3.57it/s]
 81%|████████  | 300138/371472 [1:43:01<5:24:01,  3.67it/s]
 81%|████████  | 300139/371472 [1:43:01<5:22:58,  3.68it/s]
 81%|████████  | 300140/371472 [1:43:01<5:38:20,  3.51it/s]
                                                           
{'loss': 2.7922, 'learning_rate': 2.7291581374302396e-07, 'epoch': 12.93}

 81%|████████  | 300140/371472 [1:43:01<5:38:20,  3.51it/s]
 81%|████████  | 300141/371472 [1:43:02<5:30:24,  3.60it/s]
 81%|████████  | 300142/371472 [1:43:02<5:46:39,  3.43it/s]
 81%|████████  | 300143/371472 [1:43:02<5:53:33,  3.36it/s]
 81%|████████  | 300144/371472 [1:43:03<6:02:06,  3.28it/s]
 81%|████████  | 300145/371472 [1:43:03<5:46:05,  3.43it/s]
 81%|████████  | 300146/371472 [1:43:03<5:28:18,  3.62it/s]
 81%|████████  | 300147/371472 [1:43:03<5:26:35,  3.64it/s]
 81%|████████  | 300148/371472 [1:43:04<5:37:43,  3.52it/s]
 81%|████████  | 300149/371472 [1:43:04<5:30:42,  3.59it/s]
 81%|████████  | 300150/371472 [1:43:04<5:24:57,  3.66it/s]
 81%|████████  | 300151/371472 [1:43:04<5:20:22,  3.71it/s]
 81%|████████  | 300152/371472 [1:43:05<5:32:12,  3.58it/s]
 81%|████████  | 300153/371472 [1:43:05<5:13:05,  3.80it/s]
 81%|████████  | 300154/371472 [1:43:05<5:08:27,  3.85it/s]
 81%|████████  | 300155/371472 [1:43:05<4:59:03,  3.97it/s]
 81%|████████  | 300156/371472 [1:43:06<4:55:48,  4.02it/s]
 81%|████████  | 300157/371472 [1:43:06<5:02:04,  3.93it/s]
 81%|████████  | 300158/371472 [1:43:06<5:26:09,  3.64it/s]
 81%|████████  | 300159/371472 [1:43:07<5:23:21,  3.68it/s]
 81%|████████  | 300160/371472 [1:43:07<5:21:37,  3.70it/s]
                                                           
{'loss': 2.6208, 'learning_rate': 2.728673317675451e-07, 'epoch': 12.93}

 81%|████████  | 300160/371472 [1:43:07<5:21:37,  3.70it/s]
 81%|████████  | 300161/371472 [1:43:07<5:24:46,  3.66it/s]
 81%|████████  | 300162/371472 [1:43:07<5:18:56,  3.73it/s]
 81%|████████  | 300163/371472 [1:43:08<5:13:06,  3.80it/s]
 81%|████████  | 300164/371472 [1:43:08<5:05:33,  3.89it/s]
 81%|████████  | 300165/371472 [1:43:08<5:16:07,  3.76it/s]
 81%|████████  | 300166/371472 [1:43:08<5:24:42,  3.66it/s]
 81%|████████  | 300167/371472 [1:43:09<5:21:14,  3.70it/s]
 81%|████████  | 300168/371472 [1:43:09<5:26:44,  3.64it/s]
 81%|████████  | 300169/371472 [1:43:09<5:16:57,  3.75it/s]
 81%|████████  | 300170/371472 [1:43:10<5:41:56,  3.48it/s]
 81%|████████  | 300171/371472 [1:43:10<5:32:09,  3.58it/s]
 81%|████████  | 300172/371472 [1:43:10<5:31:53,  3.58it/s]
 81%|████████  | 300173/371472 [1:43:10<5:19:45,  3.72it/s]
 81%|████████  | 300174/371472 [1:43:11<5:36:20,  3.53it/s]
 81%|████████  | 300175/371472 [1:43:11<5:27:25,  3.63it/s]
 81%|████████  | 300176/371472 [1:43:11<5:27:39,  3.63it/s]
 81%|████████  | 300177/371472 [1:43:11<5:21:28,  3.70it/s]
 81%|████████  | 300178/371472 [1:43:12<5:18:22,  3.73it/s]
 81%|████████  | 300179/371472 [1:43:12<5:31:24,  3.59it/s]
 81%|████████  | 300180/371472 [1:43:12<5:34:21,  3.55it/s]
                                                           
{'loss': 2.5856, 'learning_rate': 2.7281884979206616e-07, 'epoch': 12.93}

 81%|████████  | 300180/371472 [1:43:12<5:34:21,  3.55it/s]
 81%|████████  | 300181/371472 [1:43:13<5:21:29,  3.70it/s]
 81%|████████  | 300182/371472 [1:43:13<5:13:24,  3.79it/s]
 81%|████████  | 300183/371472 [1:43:13<5:19:45,  3.72it/s]
 81%|████████  | 300184/371472 [1:43:13<5:10:56,  3.82it/s]
 81%|████████  | 300185/371472 [1:43:14<5:02:10,  3.93it/s]
 81%|████████  | 300186/371472 [1:43:14<5:21:17,  3.70it/s]
 81%|████████  | 300187/371472 [1:43:14<5:31:59,  3.58it/s]
 81%|████████  | 300188/371472 [1:43:14<5:40:02,  3.49it/s]
 81%|████████  | 300189/371472 [1:43:15<5:43:12,  3.46it/s]
 81%|████████  | 300190/371472 [1:43:15<5:42:50,  3.47it/s]
 81%|████████  | 300191/371472 [1:43:15<5:54:44,  3.35it/s]
 81%|████████  | 300192/371472 [1:43:16<5:52:03,  3.37it/s]
 81%|████████  | 300193/371472 [1:43:16<5:52:17,  3.37it/s]
 81%|████████  | 300194/371472 [1:43:16<5:55:10,  3.34it/s]
 81%|████████  | 300195/371472 [1:43:17<5:48:28,  3.41it/s]
 81%|████████  | 300196/371472 [1:43:17<5:35:08,  3.54it/s]
 81%|████████  | 300197/371472 [1:43:17<5:23:24,  3.67it/s]
 81%|████████  | 300198/371472 [1:43:17<5:23:06,  3.68it/s]
 81%|████████  | 300199/371472 [1:43:18<5:16:40,  3.75it/s]
 81%|████████  | 300200/371472 [1:43:18<5:09:40,  3.84it/s]
                                                           
{'loss': 2.6802, 'learning_rate': 2.7277036781658734e-07, 'epoch': 12.93}

 81%|████████  | 300200/371472 [1:43:18<5:09:40,  3.84it/s]
 81%|████████  | 300201/371472 [1:43:18<5:05:27,  3.89it/s]
 81%|████████  | 300202/371472 [1:43:18<5:20:59,  3.70it/s]
 81%|████████  | 300203/371472 [1:43:19<5:30:07,  3.60it/s]
 81%|████████  | 300204/371472 [1:43:19<5:38:38,  3.51it/s]
 81%|████████  | 300205/371472 [1:43:19<5:33:24,  3.56it/s]
 81%|████████  | 300206/371472 [1:43:19<5:28:40,  3.61it/s]
 81%|████████  | 300207/371472 [1:43:20<5:17:54,  3.74it/s]
 81%|████████  | 300208/371472 [1:43:20<5:31:21,  3.58it/s]
 81%|████████  | 300209/371472 [1:43:20<6:11:06,  3.20it/s]
 81%|████████  | 300210/371472 [1:43:21<6:07:06,  3.24it/s]
 81%|████████  | 300211/371472 [1:43:21<5:50:30,  3.39it/s]
 81%|████████  | 300212/371472 [1:43:21<5:43:36,  3.46it/s]
 81%|████████  | 300213/371472 [1:43:21<5:23:34,  3.67it/s]
 81%|████████  | 300214/371472 [1:43:22<5:44:08,  3.45it/s]
 81%|████████  | 300215/371472 [1:43:22<5:25:51,  3.64it/s]
 81%|████████  | 300216/371472 [1:43:22<5:14:14,  3.78it/s]
 81%|████████  | 300217/371472 [1:43:23<5:24:54,  3.66it/s]
 81%|████████  | 300218/371472 [1:43:23<5:21:35,  3.69it/s]
 81%|████████  | 300219/371472 [1:43:23<5:40:53,  3.48it/s]
 81%|████████  | 300220/371472 [1:43:23<5:30:26,  3.59it/s]
                                                           
{'loss': 2.6973, 'learning_rate': 2.727218858411084e-07, 'epoch': 12.93}

 81%|████████  | 300220/371472 [1:43:23<5:30:26,  3.59it/s]
 81%|████████  | 300221/371472 [1:43:24<5:35:39,  3.54it/s]
 81%|████████  | 300222/371472 [1:43:24<5:31:22,  3.58it/s]
 81%|████████  | 300223/371472 [1:43:24<5:35:08,  3.54it/s]
 81%|████████  | 300224/371472 [1:43:25<5:39:40,  3.50it/s]
 81%|████████  | 300225/371472 [1:43:25<5:25:45,  3.65it/s]
 81%|████████  | 300226/371472 [1:43:25<5:31:48,  3.58it/s]
 81%|████████  | 300227/371472 [1:43:25<5:39:42,  3.50it/s]
 81%|████████  | 300228/371472 [1:43:26<5:36:36,  3.53it/s]
 81%|████████  | 300229/371472 [1:43:26<5:21:17,  3.70it/s]
 81%|████████  | 300230/371472 [1:43:26<5:31:16,  3.58it/s]
 81%|████████  | 300231/371472 [1:43:27<5:31:55,  3.58it/s]
 81%|████████  | 300232/371472 [1:43:27<5:26:42,  3.63it/s]
 81%|████████  | 300233/371472 [1:43:27<5:28:49,  3.61it/s]
 81%|████████  | 300234/371472 [1:43:27<5:31:57,  3.58it/s]
 81%|████████  | 300235/371472 [1:43:28<5:38:06,  3.51it/s]
 81%|████████  | 300236/371472 [1:43:28<5:28:03,  3.62it/s]
 81%|████████  | 300237/371472 [1:43:28<5:42:32,  3.47it/s]
 81%|████████  | 300238/371472 [1:43:29<5:43:45,  3.45it/s]
 81%|████████  | 300239/371472 [1:43:29<5:43:36,  3.46it/s]
 81%|████████  | 300240/371472 [1:43:29<5:37:42,  3.52it/s]
                                                           
{'loss': 2.5916, 'learning_rate': 2.726734038656296e-07, 'epoch': 12.93}

 81%|████████  | 300240/371472 [1:43:29<5:37:42,  3.52it/s]
 81%|████████  | 300241/371472 [1:43:29<6:05:20,  3.25it/s]
 81%|████████  | 300242/371472 [1:43:30<5:41:12,  3.48it/s]
 81%|████████  | 300243/371472 [1:43:30<5:42:03,  3.47it/s]
 81%|████████  | 300244/371472 [1:43:30<5:46:18,  3.43it/s]
 81%|████████  | 300245/371472 [1:43:31<5:29:21,  3.60it/s]
 81%|████████  | 300246/371472 [1:43:31<5:42:04,  3.47it/s]
 81%|████████  | 300247/371472 [1:43:31<5:32:55,  3.57it/s]
 81%|████████  | 300248/371472 [1:43:31<5:43:01,  3.46it/s]
 81%|████████  | 300249/371472 [1:43:32<5:36:48,  3.52it/s]
 81%|████████  | 300250/371472 [1:43:32<6:00:32,  3.29it/s]
 81%|████████  | 300251/371472 [1:43:32<5:46:31,  3.43it/s]
 81%|████████  | 300252/371472 [1:43:33<5:33:41,  3.56it/s]
 81%|████████  | 300253/371472 [1:43:33<5:28:46,  3.61it/s]
 81%|████████  | 300254/371472 [1:43:33<5:25:59,  3.64it/s]
 81%|████████  | 300255/371472 [1:43:33<5:21:00,  3.70it/s]
 81%|████████  | 300256/371472 [1:43:34<5:19:57,  3.71it/s]
 81%|████████  | 300257/371472 [1:43:34<5:13:25,  3.79it/s]
 81%|████████  | 300258/371472 [1:43:34<5:13:03,  3.79it/s]
 81%|████████  | 300259/371472 [1:43:34<5:44:30,  3.45it/s]
 81%|████████  | 300260/371472 [1:43:35<5:31:48,  3.58it/s]
                                                           
{'loss': 2.6747, 'learning_rate': 2.726249218901506e-07, 'epoch': 12.93}

 81%|████████  | 300260/371472 [1:43:35<5:31:48,  3.58it/s]
 81%|████████  | 300261/371472 [1:43:35<5:34:19,  3.55it/s]
 81%|████████  | 300262/371472 [1:43:35<5:23:45,  3.67it/s]
 81%|████████  | 300263/371472 [1:43:36<5:39:13,  3.50it/s]
 81%|████████  | 300264/371472 [1:43:36<5:37:57,  3.51it/s]
 81%|████████  | 300265/371472 [1:43:36<5:39:34,  3.49it/s]
 81%|████████  | 300266/371472 [1:43:36<5:39:53,  3.49it/s]
 81%|████████  | 300267/371472 [1:43:37<5:35:51,  3.53it/s]
 81%|████████  | 300268/371472 [1:43:37<5:45:02,  3.44it/s]
 81%|████████  | 300269/371472 [1:43:37<5:35:42,  3.53it/s]
 81%|████████  | 300270/371472 [1:43:38<5:25:33,  3.65it/s]
 81%|████████  | 300271/371472 [1:43:38<5:16:34,  3.75it/s]
 81%|████████  | 300272/371472 [1:43:38<5:12:52,  3.79it/s]
 81%|████████  | 300273/371472 [1:43:38<5:12:18,  3.80it/s]
 81%|████████  | 300274/371472 [1:43:39<5:13:41,  3.78it/s]
 81%|████████  | 300275/371472 [1:43:39<5:17:18,  3.74it/s]
 81%|████████  | 300276/371472 [1:43:39<5:25:59,  3.64it/s]
 81%|████████  | 300277/371472 [1:43:39<5:28:11,  3.62it/s]
 81%|████████  | 300278/371472 [1:43:40<5:42:06,  3.47it/s]
 81%|████████  | 300279/371472 [1:43:40<5:36:57,  3.52it/s]
 81%|████████  | 300280/371472 [1:43:40<5:25:30,  3.65it/s]
                                                           
{'loss': 2.7069, 'learning_rate': 2.725764399146717e-07, 'epoch': 12.93}

 81%|████████  | 300280/371472 [1:43:40<5:25:30,  3.65it/s]
 81%|████████  | 300281/371472 [1:43:41<5:23:30,  3.67it/s]
 81%|████████  | 300282/371472 [1:43:41<5:41:03,  3.48it/s]
 81%|████████  | 300283/371472 [1:43:41<5:47:34,  3.41it/s]
 81%|████████  | 300284/371472 [1:43:41<5:44:56,  3.44it/s]
 81%|████████  | 300285/371472 [1:43:42<5:36:27,  3.53it/s]
 81%|████████  | 300286/371472 [1:43:42<5:35:38,  3.53it/s]
 81%|████████  | 300287/371472 [1:43:42<5:23:53,  3.66it/s]
 81%|████████  | 300288/371472 [1:43:43<5:49:56,  3.39it/s]
 81%|████████  | 300289/371472 [1:43:43<5:33:46,  3.55it/s]
 81%|████████  | 300290/371472 [1:43:43<5:45:38,  3.43it/s]
 81%|████████  | 300291/371472 [1:43:43<5:52:29,  3.37it/s]
 81%|████████  | 300292/371472 [1:43:44<5:30:48,  3.59it/s]
 81%|████████  | 300293/371472 [1:43:44<5:18:59,  3.72it/s]
 81%|████████  | 300294/371472 [1:43:44<5:19:31,  3.71it/s]
 81%|████████  | 300295/371472 [1:43:44<5:16:40,  3.75it/s]
 81%|████████  | 300296/371472 [1:43:45<5:13:00,  3.79it/s]
 81%|████████  | 300297/371472 [1:43:45<5:12:00,  3.80it/s]
 81%|████████  | 300298/371472 [1:43:45<5:28:18,  3.61it/s]
 81%|████████  | 300299/371472 [1:43:46<5:22:05,  3.68it/s]
 81%|████████  | 300300/371472 [1:43:46<5:43:40,  3.45it/s]
                                                           
{'loss': 2.6773, 'learning_rate': 2.725279579391928e-07, 'epoch': 12.93}

 81%|████████  | 300300/371472 [1:43:46<5:43:40,  3.45it/s]
 81%|████████  | 300301/371472 [1:43:46<6:05:27,  3.25it/s]
 81%|████████  | 300302/371472 [1:43:47<6:04:14,  3.26it/s]
 81%|████████  | 300303/371472 [1:43:47<5:53:49,  3.35it/s]
 81%|████████  | 300304/371472 [1:43:47<5:36:19,  3.53it/s]
 81%|████████  | 300305/371472 [1:43:47<5:34:35,  3.55it/s]
 81%|████████  | 300306/371472 [1:43:48<5:48:57,  3.40it/s]
 81%|████████  | 300307/371472 [1:43:48<6:16:32,  3.15it/s]
 81%|████████  | 300308/371472 [1:43:48<6:09:45,  3.21it/s]
 81%|████████  | 300309/371472 [1:43:49<5:57:36,  3.32it/s]
 81%|████████  | 300310/371472 [1:43:49<5:38:20,  3.51it/s]
 81%|████████  | 300311/371472 [1:43:49<5:31:40,  3.58it/s]
 81%|████████  | 300312/371472 [1:43:49<5:18:13,  3.73it/s]
 81%|████████  | 300313/371472 [1:43:50<5:06:21,  3.87it/s]
 81%|████████  | 300314/371472 [1:43:50<5:06:21,  3.87it/s]
 81%|████████  | 300315/371472 [1:43:50<4:57:42,  3.98it/s]
 81%|████████  | 300316/371472 [1:43:50<4:55:18,  4.02it/s]
 81%|████████  | 300317/371472 [1:43:51<5:07:01,  3.86it/s]
 81%|████████  | 300318/371472 [1:43:51<5:10:03,  3.82it/s]
 81%|████████  | 300319/371472 [1:43:51<5:05:59,  3.88it/s]
 81%|████████  | 300320/371472 [1:43:51<5:05:22,  3.88it/s]
                                                           
{'loss': 2.6966, 'learning_rate': 2.7247947596371387e-07, 'epoch': 12.94}

 81%|████████  | 300320/371472 [1:43:51<5:05:22,  3.88it/s]
 81%|████████  | 300321/371472 [1:43:52<5:19:19,  3.71it/s]
 81%|████████  | 300322/371472 [1:43:52<5:10:11,  3.82it/s]
 81%|████████  | 300323/371472 [1:43:52<5:09:16,  3.83it/s]
 81%|████████  | 300324/371472 [1:43:52<5:08:42,  3.84it/s]
 81%|████████  | 300325/371472 [1:43:53<5:15:20,  3.76it/s]
 81%|████████  | 300326/371472 [1:43:53<5:26:20,  3.63it/s]
 81%|████████  | 300327/371472 [1:43:53<5:13:10,  3.79it/s]
 81%|████████  | 300328/371472 [1:43:54<5:03:38,  3.91it/s]
 81%|████████  | 300329/371472 [1:43:54<5:10:51,  3.81it/s]
 81%|████████  | 300330/371472 [1:43:54<5:16:00,  3.75it/s]
 81%|████████  | 300331/371472 [1:43:54<5:11:39,  3.80it/s]
 81%|████████  | 300332/371472 [1:43:55<5:23:34,  3.66it/s]
 81%|████████  | 300333/371472 [1:43:55<5:14:23,  3.77it/s]
 81%|████████  | 300334/371472 [1:43:55<5:09:20,  3.83it/s]
 81%|████████  | 300335/371472 [1:43:55<5:03:10,  3.91it/s]
 81%|████████  | 300336/371472 [1:43:56<5:18:49,  3.72it/s]
 81%|████████  | 300337/371472 [1:43:56<5:42:00,  3.47it/s]
 81%|████████  | 300338/371472 [1:43:56<5:41:32,  3.47it/s]
 81%|████████  | 300339/371472 [1:43:57<5:41:37,  3.47it/s]
 81%|████████  | 300340/371472 [1:43:57<5:34:27,  3.54it/s]
                                                           
{'loss': 2.6603, 'learning_rate': 2.7243099398823505e-07, 'epoch': 12.94}

 81%|████████  | 300340/371472 [1:43:57<5:34:27,  3.54it/s]
 81%|████████  | 300341/371472 [1:43:57<5:27:23,  3.62it/s]
 81%|████████  | 300342/371472 [1:43:57<5:12:30,  3.79it/s]
 81%|████████  | 300343/371472 [1:43:58<5:26:08,  3.63it/s]
 81%|████████  | 300344/371472 [1:43:58<5:26:10,  3.63it/s]
 81%|████████  | 300345/371472 [1:43:58<5:15:26,  3.76it/s]
 81%|████████  | 300346/371472 [1:43:58<5:15:18,  3.76it/s]
 81%|████████  | 300347/371472 [1:43:59<5:28:33,  3.61it/s]
 81%|████████  | 300348/371472 [1:43:59<5:18:32,  3.72it/s]
 81%|████████  | 300349/371472 [1:43:59<5:21:21,  3.69it/s]
 81%|████████  | 300350/371472 [1:44:00<5:11:58,  3.80it/s]
 81%|████████  | 300351/371472 [1:44:00<5:07:25,  3.86it/s]
 81%|████████  | 300352/371472 [1:44:00<5:14:05,  3.77it/s]
 81%|████████  | 300353/371472 [1:44:00<5:13:26,  3.78it/s]
 81%|████████  | 300354/371472 [1:44:01<5:14:11,  3.77it/s]
 81%|████████  | 300355/371472 [1:44:01<5:27:31,  3.62it/s]
 81%|████████  | 300356/371472 [1:44:01<5:22:27,  3.68it/s]
 81%|████████  | 300357/371472 [1:44:01<5:15:22,  3.76it/s]
 81%|████████  | 300358/371472 [1:44:02<5:08:27,  3.84it/s]
 81%|████████  | 300359/371472 [1:44:02<5:27:44,  3.62it/s]
 81%|████████  | 300360/371472 [1:44:02<5:26:21,  3.63it/s]
                                                           
{'loss': 2.6822, 'learning_rate': 2.723825120127561e-07, 'epoch': 12.94}

 81%|████████  | 300360/371472 [1:44:02<5:26:21,  3.63it/s]
 81%|████████  | 300361/371472 [1:44:02<5:09:34,  3.83it/s]
 81%|████████  | 300362/371472 [1:44:03<5:08:03,  3.85it/s]
 81%|████████  | 300363/371472 [1:44:03<5:07:37,  3.85it/s]
 81%|████████  | 300364/371472 [1:44:03<5:04:58,  3.89it/s]
 81%|████████  | 300365/371472 [1:44:03<5:02:54,  3.91it/s]
 81%|████████  | 300366/371472 [1:44:04<5:09:58,  3.82it/s]
 81%|████████  | 300367/371472 [1:44:04<5:09:59,  3.82it/s]
 81%|████████  | 300368/371472 [1:44:04<5:34:17,  3.54it/s]
 81%|████████  | 300369/371472 [1:44:05<5:25:44,  3.64it/s]
 81%|████████  | 300370/371472 [1:44:05<5:32:18,  3.57it/s]
 81%|████████  | 300371/371472 [1:44:05<5:20:28,  3.70it/s]
 81%|████████  | 300372/371472 [1:44:05<5:27:51,  3.61it/s]
 81%|████████  | 300373/371472 [1:44:06<5:51:13,  3.37it/s]
 81%|████████  | 300374/371472 [1:44:06<5:57:08,  3.32it/s]
 81%|████████  | 300375/371472 [1:44:06<5:41:45,  3.47it/s]
 81%|████████  | 300376/371472 [1:44:07<6:01:58,  3.27it/s]
 81%|████████  | 300377/371472 [1:44:07<5:51:54,  3.37it/s]
 81%|████████  | 300378/371472 [1:44:07<5:48:06,  3.40it/s]
 81%|████████  | 300379/371472 [1:44:08<6:35:00,  3.00it/s]
 81%|████████  | 300380/371472 [1:44:08<6:11:11,  3.19it/s]
                                                           
{'loss': 2.6672, 'learning_rate': 2.7233403003727724e-07, 'epoch': 12.94}

 81%|████████  | 300380/371472 [1:44:08<6:11:11,  3.19it/s]
 81%|████████  | 300381/371472 [1:44:08<5:58:52,  3.30it/s]
 81%|████████  | 300382/371472 [1:44:09<6:07:18,  3.23it/s]
 81%|████████  | 300383/371472 [1:44:09<5:53:41,  3.35it/s]
 81%|████████  | 300384/371472 [1:44:09<6:40:02,  2.96it/s]
 81%|████████  | 300385/371472 [1:44:09<6:07:48,  3.22it/s]
 81%|████████  | 300386/371472 [1:44:10<6:27:42,  3.06it/s]
 81%|████████  | 300387/371472 [1:44:10<6:00:06,  3.29it/s]
 81%|████████  | 300388/371472 [1:44:10<5:42:34,  3.46it/s]
 81%|████████  | 300389/371472 [1:44:11<5:28:58,  3.60it/s]
 81%|████████  | 300390/371472 [1:44:11<5:20:48,  3.69it/s]
 81%|████████  | 300391/371472 [1:44:11<5:24:21,  3.65it/s]
 81%|████████  | 300392/371472 [1:44:11<5:42:38,  3.46it/s]
 81%|████████  | 300393/371472 [1:44:12<5:51:20,  3.37it/s]
 81%|████████  | 300394/371472 [1:44:12<5:41:22,  3.47it/s]
 81%|████████  | 300395/371472 [1:44:12<6:03:43,  3.26it/s]
 81%|████████  | 300396/371472 [1:44:13<5:40:22,  3.48it/s]
 81%|████████  | 300397/371472 [1:44:13<5:36:45,  3.52it/s]
 81%|████████  | 300398/371472 [1:44:13<5:38:41,  3.50it/s]
 81%|████████  | 300399/371472 [1:44:13<5:23:51,  3.66it/s]
 81%|████████  | 300400/371472 [1:44:14<5:10:38,  3.81it/s]
                                                           
{'loss': 2.6388, 'learning_rate': 2.722855480617983e-07, 'epoch': 12.94}

 81%|████████  | 300400/371472 [1:44:14<5:10:38,  3.81it/s]
 81%|████████  | 300401/371472 [1:44:14<5:05:37,  3.88it/s]
 81%|████████  | 300402/371472 [1:44:14<5:06:14,  3.87it/s]
 81%|████████  | 300403/371472 [1:44:14<5:01:53,  3.92it/s]
 81%|████████  | 300404/371472 [1:44:15<5:07:25,  3.85it/s]
 81%|████████  | 300405/371472 [1:44:15<5:11:39,  3.80it/s]
 81%|████████  | 300406/371472 [1:44:15<5:22:08,  3.68it/s]
 81%|████████  | 300407/371472 [1:44:16<5:26:49,  3.62it/s]
 81%|████████  | 300408/371472 [1:44:16<5:36:36,  3.52it/s]
 81%|████████  | 300409/371472 [1:44:16<5:28:43,  3.60it/s]
 81%|████████  | 300410/371472 [1:44:16<5:42:36,  3.46it/s]
 81%|████████  | 300411/371472 [1:44:17<5:35:23,  3.53it/s]
 81%|████████  | 300412/371472 [1:44:17<5:44:14,  3.44it/s]
 81%|████████  | 300413/371472 [1:44:17<5:29:44,  3.59it/s]
 81%|████████  | 300414/371472 [1:44:18<5:50:56,  3.37it/s]
 81%|████████  | 300415/371472 [1:44:18<6:04:14,  3.25it/s]
 81%|████████  | 300416/371472 [1:44:18<6:01:14,  3.28it/s]
 81%|████████  | 300417/371472 [1:44:19<5:48:02,  3.40it/s]
 81%|████████  | 300418/371472 [1:44:19<5:34:21,  3.54it/s]
 81%|████████  | 300419/371472 [1:44:19<5:24:01,  3.65it/s]
 81%|████████  | 300420/371472 [1:44:19<5:25:42,  3.64it/s]
                                                           
{'loss': 2.6384, 'learning_rate': 2.722370660863195e-07, 'epoch': 12.94}

 81%|████████  | 300420/371472 [1:44:19<5:25:42,  3.64it/s]
 81%|████████  | 300421/371472 [1:44:20<5:30:33,  3.58it/s]
 81%|████████  | 300422/371472 [1:44:20<5:27:21,  3.62it/s]
 81%|████████  | 300423/371472 [1:44:20<5:22:02,  3.68it/s]
 81%|████████  | 300424/371472 [1:44:20<5:20:29,  3.69it/s]
 81%|████████  | 300425/371472 [1:44:21<5:30:49,  3.58it/s]
 81%|████████  | 300426/371472 [1:44:21<5:23:23,  3.66it/s]
 81%|████████  | 300427/371472 [1:44:21<5:23:27,  3.66it/s]
 81%|████████  | 300428/371472 [1:44:22<6:54:47,  2.85it/s]
 81%|████████  | 300429/371472 [1:44:22<6:18:39,  3.13it/s]
 81%|████████  | 300430/371472 [1:44:22<5:49:49,  3.38it/s]
 81%|████████  | 300431/371472 [1:44:22<5:33:02,  3.56it/s]
 81%|████████  | 300432/371472 [1:44:23<5:23:55,  3.66it/s]
 81%|████████  | 300433/371472 [1:44:23<5:20:09,  3.70it/s]
 81%|████████  | 300434/371472 [1:44:23<5:46:07,  3.42it/s]
 81%|████████  | 300435/371472 [1:44:24<5:38:37,  3.50it/s]
 81%|████████  | 300436/371472 [1:44:24<5:29:11,  3.60it/s]
 81%|████████  | 300437/371472 [1:44:24<5:51:40,  3.37it/s]
 81%|████████  | 300438/371472 [1:44:25<5:51:37,  3.37it/s]
 81%|████████  | 300439/371472 [1:44:25<5:43:30,  3.45it/s]
 81%|████████  | 300440/371472 [1:44:25<5:44:27,  3.44it/s]
                                                           
{'loss': 2.6712, 'learning_rate': 2.721885841108405e-07, 'epoch': 12.94}

 81%|████████  | 300440/371472 [1:44:25<5:44:27,  3.44it/s]
 81%|████████  | 300441/371472 [1:44:25<5:38:55,  3.49it/s]
 81%|████████  | 300442/371472 [1:44:26<5:22:24,  3.67it/s]
 81%|████████  | 300443/371472 [1:44:26<5:20:37,  3.69it/s]
 81%|████████  | 300444/371472 [1:44:26<5:23:26,  3.66it/s]
 81%|████████  | 300445/371472 [1:44:26<5:25:46,  3.63it/s]
 81%|████████  | 300446/371472 [1:44:27<5:42:22,  3.46it/s]
 81%|████████  | 300447/371472 [1:44:27<5:41:27,  3.47it/s]
 81%|████████  | 300448/371472 [1:44:27<5:31:26,  3.57it/s]
 81%|████████  | 300449/371472 [1:44:28<5:48:25,  3.40it/s]
 81%|████████  | 300450/371472 [1:44:28<5:59:54,  3.29it/s]
 81%|████████  | 300451/371472 [1:44:28<5:48:28,  3.40it/s]
 81%|████████  | 300452/371472 [1:44:28<5:44:04,  3.44it/s]
 81%|████████  | 300453/371472 [1:44:29<5:56:33,  3.32it/s]
 81%|████████  | 300454/371472 [1:44:29<5:59:16,  3.29it/s]
 81%|████████  | 300455/371472 [1:44:29<5:48:28,  3.40it/s]
 81%|████████  | 300456/371472 [1:44:30<5:37:36,  3.51it/s]
 81%|████████  | 300457/371472 [1:44:30<5:29:19,  3.59it/s]
 81%|████████  | 300458/371472 [1:44:30<5:50:51,  3.37it/s]
 81%|████████  | 300459/371472 [1:44:31<5:38:05,  3.50it/s]
 81%|████████  | 300460/371472 [1:44:31<5:36:47,  3.51it/s]
                                                           
{'loss': 2.6658, 'learning_rate': 2.721401021353617e-07, 'epoch': 12.94}

 81%|████████  | 300460/371472 [1:44:31<5:36:47,  3.51it/s]
 81%|████████  | 300461/371472 [1:44:31<5:28:29,  3.60it/s]
 81%|████████  | 300462/371472 [1:44:31<5:35:13,  3.53it/s]
 81%|████████  | 300463/371472 [1:44:32<5:49:39,  3.38it/s]
 81%|████████  | 300464/371472 [1:44:32<5:45:05,  3.43it/s]
 81%|████████  | 300465/371472 [1:44:32<5:29:17,  3.59it/s]
 81%|████████  | 300466/371472 [1:44:32<5:19:53,  3.70it/s]
 81%|████████  | 300467/371472 [1:44:33<5:33:29,  3.55it/s]
 81%|████████  | 300468/371472 [1:44:33<5:30:32,  3.58it/s]
 81%|████████  | 300469/371472 [1:44:33<5:22:24,  3.67it/s]
 81%|████████  | 300470/371472 [1:44:34<5:29:06,  3.60it/s]
 81%|████████  | 300471/371472 [1:44:34<5:25:28,  3.64it/s]
 81%|████████  | 300472/371472 [1:44:34<5:25:27,  3.64it/s]
 81%|████████  | 300473/371472 [1:44:34<5:13:58,  3.77it/s]
 81%|████████  | 300474/371472 [1:44:35<5:14:17,  3.76it/s]
 81%|████████  | 300475/371472 [1:44:35<5:12:59,  3.78it/s]
 81%|████████  | 300476/371472 [1:44:35<5:19:54,  3.70it/s]
 81%|████████  | 300477/371472 [1:44:35<5:23:39,  3.66it/s]
 81%|████████  | 300478/371472 [1:44:36<5:17:59,  3.72it/s]
 81%|████████  | 300479/371472 [1:44:36<5:25:43,  3.63it/s]
 81%|████████  | 300480/371472 [1:44:36<5:28:41,  3.60it/s]
                                                           
{'loss': 2.583, 'learning_rate': 2.7209162015988276e-07, 'epoch': 12.94}

 81%|████████  | 300480/371472 [1:44:36<5:28:41,  3.60it/s]
 81%|████████  | 300481/371472 [1:44:37<5:22:01,  3.67it/s]
 81%|████████  | 300482/371472 [1:44:37<5:22:38,  3.67it/s]
 81%|████████  | 300483/371472 [1:44:37<5:21:08,  3.68it/s]
 81%|████████  | 300484/371472 [1:44:37<5:28:38,  3.60it/s]
 81%|████████  | 300485/371472 [1:44:38<5:19:34,  3.70it/s]
 81%|████████  | 300486/371472 [1:44:38<5:33:15,  3.55it/s]
 81%|████████  | 300487/371472 [1:44:38<5:25:19,  3.64it/s]
 81%|████████  | 300488/371472 [1:44:39<5:56:56,  3.31it/s]
 81%|████████  | 300489/371472 [1:44:39<5:55:54,  3.32it/s]
 81%|████████  | 300490/371472 [1:44:39<6:15:40,  3.15it/s]
 81%|████████  | 300491/371472 [1:44:40<5:52:11,  3.36it/s]
 81%|████████  | 300492/371472 [1:44:40<6:02:24,  3.26it/s]
 81%|████████  | 300493/371472 [1:44:40<5:47:57,  3.40it/s]
 81%|████████  | 300494/371472 [1:44:40<5:39:33,  3.48it/s]
 81%|████████  | 300495/371472 [1:44:41<5:21:55,  3.67it/s]
 81%|████████  | 300496/371472 [1:44:41<5:17:25,  3.73it/s]
 81%|████████  | 300497/371472 [1:44:41<5:16:51,  3.73it/s]
 81%|████████  | 300498/371472 [1:44:41<5:24:24,  3.65it/s]
 81%|████████  | 300499/371472 [1:44:42<5:16:18,  3.74it/s]
 81%|████████  | 300500/371472 [1:44:42<5:15:32,  3.75it/s]
                                                           
{'loss': 2.6777, 'learning_rate': 2.7204313818440394e-07, 'epoch': 12.94}

 81%|████████  | 300500/371472 [1:44:42<5:15:32,  3.75it/s]
 81%|████████  | 300501/371472 [1:44:42<5:11:40,  3.80it/s]
 81%|████████  | 300502/371472 [1:44:42<5:12:55,  3.78it/s]
 81%|████████  | 300503/371472 [1:44:43<5:26:13,  3.63it/s]
 81%|████████  | 300504/371472 [1:44:43<5:48:49,  3.39it/s]
 81%|████████  | 300505/371472 [1:44:43<5:31:21,  3.57it/s]
 81%|████████  | 300506/371472 [1:44:44<5:48:27,  3.39it/s]
 81%|████████  | 300507/371472 [1:44:44<5:39:49,  3.48it/s]
 81%|████████  | 300508/371472 [1:44:44<5:26:31,  3.62it/s]
 81%|████████  | 300509/371472 [1:44:44<5:19:29,  3.70it/s]
 81%|████████  | 300510/371472 [1:44:45<5:40:13,  3.48it/s]
 81%|████████  | 300511/371472 [1:44:45<5:21:03,  3.68it/s]
 81%|████████  | 300512/371472 [1:44:45<5:20:48,  3.69it/s]
 81%|████████  | 300513/371472 [1:44:46<5:19:02,  3.71it/s]
 81%|████████  | 300514/371472 [1:44:46<5:34:55,  3.53it/s]
 81%|████████  | 300515/371472 [1:44:46<5:35:43,  3.52it/s]
 81%|████████  | 300516/371472 [1:44:46<5:55:23,  3.33it/s]
 81%|████████  | 300517/371472 [1:44:47<6:21:57,  3.10it/s]
 81%|████████  | 300518/371472 [1:44:47<6:18:52,  3.12it/s]
 81%|████████  | 300519/371472 [1:44:47<5:55:57,  3.32it/s]
 81%|████████  | 300520/371472 [1:44:48<5:58:59,  3.29it/s]
                                                           
{'loss': 2.7412, 'learning_rate': 2.7199465620892496e-07, 'epoch': 12.94}

 81%|████████  | 300520/371472 [1:44:48<5:58:59,  3.29it/s]
 81%|████████  | 300521/371472 [1:44:48<5:45:40,  3.42it/s]
 81%|████████  | 300522/371472 [1:44:48<5:42:11,  3.46it/s]
 81%|████████  | 300523/371472 [1:44:49<5:44:33,  3.43it/s]
 81%|████████  | 300524/371472 [1:44:49<6:01:24,  3.27it/s]
 81%|████████  | 300525/371472 [1:44:49<6:13:05,  3.17it/s]
 81%|████████  | 300526/371472 [1:44:50<5:54:13,  3.34it/s]
 81%|████████  | 300527/371472 [1:44:50<5:36:55,  3.51it/s]
 81%|████████  | 300528/371472 [1:44:50<5:24:33,  3.64it/s]
 81%|████████  | 300529/371472 [1:44:50<5:19:04,  3.71it/s]
 81%|████████  | 300530/371472 [1:44:51<5:09:07,  3.82it/s]
 81%|████████  | 300531/371472 [1:44:51<5:12:50,  3.78it/s]
 81%|████████  | 300532/371472 [1:44:51<5:13:12,  3.77it/s]
 81%|████████  | 300533/371472 [1:44:51<5:11:28,  3.80it/s]
 81%|████████  | 300534/371472 [1:44:52<5:07:52,  3.84it/s]
 81%|████████  | 300535/371472 [1:44:52<5:16:27,  3.74it/s]
 81%|████████  | 300536/371472 [1:44:52<5:15:41,  3.75it/s]
 81%|████████  | 300537/371472 [1:44:52<5:30:53,  3.57it/s]
 81%|████████  | 300538/371472 [1:44:53<5:29:20,  3.59it/s]
 81%|████████  | 300539/371472 [1:44:53<5:24:30,  3.64it/s]
 81%|████████  | 300540/371472 [1:44:53<5:30:12,  3.58it/s]
                                                           
{'loss': 2.6379, 'learning_rate': 2.719461742334461e-07, 'epoch': 12.94}

 81%|████████  | 300540/371472 [1:44:53<5:30:12,  3.58it/s]
 81%|████████  | 300541/371472 [1:44:54<5:15:49,  3.74it/s]
 81%|████████  | 300542/371472 [1:44:54<5:07:42,  3.84it/s]
 81%|████████  | 300543/371472 [1:44:54<5:01:56,  3.92it/s]
 81%|████████  | 300544/371472 [1:44:54<5:02:43,  3.90it/s]
 81%|████████  | 300545/371472 [1:44:55<5:09:49,  3.82it/s]
 81%|████████  | 300546/371472 [1:44:55<5:13:59,  3.76it/s]
 81%|████████  | 300547/371472 [1:44:55<5:11:18,  3.80it/s]
 81%|████████  | 300548/371472 [1:44:55<5:14:03,  3.76it/s]
 81%|████████  | 300549/371472 [1:44:56<5:30:23,  3.58it/s]
 81%|████████  | 300550/371472 [1:44:56<5:22:06,  3.67it/s]
 81%|████████  | 300551/371472 [1:44:56<5:39:13,  3.48it/s]
 81%|████████  | 300552/371472 [1:44:57<5:45:04,  3.43it/s]
 81%|████████  | 300553/371472 [1:44:57<5:36:44,  3.51it/s]
 81%|████████  | 300554/371472 [1:44:57<5:35:04,  3.53it/s]
 81%|████████  | 300555/371472 [1:44:57<5:33:28,  3.54it/s]
 81%|████████  | 300556/371472 [1:44:58<5:34:48,  3.53it/s]
 81%|████████  | 300557/371472 [1:44:58<5:52:21,  3.35it/s]
 81%|████████  | 300558/371472 [1:44:58<5:41:23,  3.46it/s]
 81%|████████  | 300559/371472 [1:44:59<5:53:29,  3.34it/s]
 81%|████████  | 300560/371472 [1:44:59<5:46:11,  3.41it/s]
                                                           
{'loss': 2.7214, 'learning_rate': 2.7189769225796715e-07, 'epoch': 12.95}

 81%|████████  | 300560/371472 [1:44:59<5:46:11,  3.41it/s]
 81%|████████  | 300561/371472 [1:44:59<5:35:08,  3.53it/s]
 81%|████████  | 300562/371472 [1:44:59<5:30:39,  3.57it/s]
 81%|████████  | 300563/371472 [1:45:00<5:24:34,  3.64it/s]
 81%|████████  | 300564/371472 [1:45:00<5:29:12,  3.59it/s]
 81%|████████  | 300565/371472 [1:45:00<5:28:20,  3.60it/s]
 81%|████████  | 300566/371472 [1:45:01<6:24:23,  3.07it/s]
 81%|████████  | 300567/371472 [1:45:01<6:14:46,  3.15it/s]
 81%|████████  | 300568/371472 [1:45:01<5:58:25,  3.30it/s]
 81%|████████  | 300569/371472 [1:45:02<5:54:52,  3.33it/s]
 81%|████████  | 300570/371472 [1:45:02<6:13:31,  3.16it/s]
 81%|████████  | 300571/371472 [1:45:02<5:58:45,  3.29it/s]
 81%|████████  | 300572/371472 [1:45:02<5:53:39,  3.34it/s]
 81%|████████  | 300573/371472 [1:45:03<5:34:22,  3.53it/s]
 81%|████████  | 300574/371472 [1:45:03<5:26:01,  3.62it/s]
 81%|████████  | 300575/371472 [1:45:03<5:11:22,  3.79it/s]
 81%|████████  | 300576/371472 [1:45:03<5:04:21,  3.88it/s]
 81%|████████  | 300577/371472 [1:45:04<5:10:13,  3.81it/s]
 81%|████████  | 300578/371472 [1:45:04<5:16:52,  3.73it/s]
 81%|████████  | 300579/371472 [1:45:04<5:16:40,  3.73it/s]
 81%|████████  | 300580/371472 [1:45:05<5:31:23,  3.57it/s]
                                                           
{'loss': 2.6133, 'learning_rate': 2.7184921028248833e-07, 'epoch': 12.95}

 81%|████████  | 300580/371472 [1:45:05<5:31:23,  3.57it/s]
 81%|████████  | 300581/371472 [1:45:05<5:46:59,  3.41it/s]
 81%|████████  | 300582/371472 [1:45:05<5:43:38,  3.44it/s]
 81%|████████  | 300583/371472 [1:45:05<5:43:15,  3.44it/s]
 81%|████████  | 300584/371472 [1:45:06<6:05:04,  3.24it/s]
 81%|████████  | 300585/371472 [1:45:06<5:57:09,  3.31it/s]
 81%|████████  | 300586/371472 [1:45:06<5:37:52,  3.50it/s]
 81%|████████  | 300587/371472 [1:45:07<5:25:08,  3.63it/s]
 81%|████████  | 300588/371472 [1:45:07<5:26:59,  3.61it/s]
 81%|████████  | 300589/371472 [1:45:07<5:25:13,  3.63it/s]
 81%|████████  | 300590/371472 [1:45:07<5:43:12,  3.44it/s]
 81%|████████  | 300591/371472 [1:45:08<5:30:00,  3.58it/s]
 81%|████████  | 300592/371472 [1:45:08<6:01:18,  3.27it/s]
 81%|████████  | 300593/371472 [1:45:08<6:12:01,  3.18it/s]
 81%|████████  | 300594/371472 [1:45:09<5:58:01,  3.30it/s]
 81%|████████  | 300595/371472 [1:45:09<6:00:58,  3.27it/s]
 81%|████████  | 300596/371472 [1:45:09<5:43:16,  3.44it/s]
 81%|████████  | 300597/371472 [1:45:10<5:40:29,  3.47it/s]
 81%|████████  | 300598/371472 [1:45:10<5:33:33,  3.54it/s]
 81%|████████  | 300599/371472 [1:45:10<5:24:14,  3.64it/s]
 81%|████████  | 300600/371472 [1:45:10<6:09:11,  3.20it/s]
                                                           
{'loss': 2.5743, 'learning_rate': 2.718007283070094e-07, 'epoch': 12.95}

 81%|████████  | 300600/371472 [1:45:10<6:09:11,  3.20it/s]
 81%|████████  | 300601/371472 [1:45:11<5:48:51,  3.39it/s]
 81%|████████  | 300602/371472 [1:45:11<5:39:51,  3.48it/s]
 81%|████████  | 300603/371472 [1:45:11<5:36:20,  3.51it/s]
 81%|████████  | 300604/371472 [1:45:12<5:26:15,  3.62it/s]
 81%|████████  | 300605/371472 [1:45:12<5:16:50,  3.73it/s]
 81%|████████  | 300606/371472 [1:45:12<5:13:04,  3.77it/s]
 81%|████████  | 300607/371472 [1:45:12<5:02:55,  3.90it/s]
 81%|████████  | 300608/371472 [1:45:13<5:12:42,  3.78it/s]
 81%|████████  | 300609/371472 [1:45:13<5:12:00,  3.79it/s]
 81%|████████  | 300610/371472 [1:45:13<5:21:30,  3.67it/s]
 81%|████████  | 300611/371472 [1:45:13<5:23:28,  3.65it/s]
 81%|████████  | 300612/371472 [1:45:14<5:18:26,  3.71it/s]
 81%|████████  | 300613/371472 [1:45:14<5:18:22,  3.71it/s]
 81%|████████  | 300614/371472 [1:45:14<5:28:02,  3.60it/s]
 81%|████████  | 300615/371472 [1:45:14<5:32:44,  3.55it/s]
 81%|████████  | 300616/371472 [1:45:15<5:26:59,  3.61it/s]
 81%|████████  | 300617/371472 [1:45:15<5:25:01,  3.63it/s]
 81%|████████  | 300618/371472 [1:45:15<5:33:01,  3.55it/s]
 81%|████████  | 300619/371472 [1:45:16<5:27:06,  3.61it/s]
 81%|████████  | 300620/371472 [1:45:16<5:37:22,  3.50it/s]
                                                           
{'loss': 2.7952, 'learning_rate': 2.717522463315306e-07, 'epoch': 12.95}

 81%|████████  | 300620/371472 [1:45:16<5:37:22,  3.50it/s]
 81%|████████  | 300621/371472 [1:45:16<5:51:19,  3.36it/s]
 81%|████████  | 300622/371472 [1:45:16<5:29:52,  3.58it/s]
 81%|████████  | 300623/371472 [1:45:17<5:21:55,  3.67it/s]
 81%|████████  | 300624/371472 [1:45:17<5:17:01,  3.72it/s]
 81%|████████  | 300625/371472 [1:45:17<5:32:43,  3.55it/s]
 81%|████████  | 300626/371472 [1:45:18<5:36:07,  3.51it/s]
 81%|████████  | 300627/371472 [1:45:18<5:36:33,  3.51it/s]
 81%|████████  | 300628/371472 [1:45:18<5:25:41,  3.63it/s]
 81%|████████  | 300629/371472 [1:45:18<5:51:50,  3.36it/s]
 81%|████████  | 300630/371472 [1:45:19<5:48:10,  3.39it/s]
 81%|████████  | 300631/371472 [1:45:19<5:42:03,  3.45it/s]
 81%|████████  | 300632/371472 [1:45:19<5:28:45,  3.59it/s]
 81%|████████  | 300633/371472 [1:45:20<5:46:12,  3.41it/s]
 81%|████████  | 300634/371472 [1:45:20<5:47:51,  3.39it/s]
 81%|████████  | 300635/371472 [1:45:20<5:40:16,  3.47it/s]
 81%|████████  | 300636/371472 [1:45:20<5:30:08,  3.58it/s]
 81%|████████  | 300637/371472 [1:45:21<5:23:41,  3.65it/s]
 81%|████████  | 300638/371472 [1:45:21<5:28:43,  3.59it/s]
 81%|████████  | 300639/371472 [1:45:21<5:11:11,  3.79it/s]
 81%|████████  | 300640/371472 [1:45:21<5:08:22,  3.83it/s]
                                                           
{'loss': 2.4734, 'learning_rate': 2.717037643560516e-07, 'epoch': 12.95}

 81%|████████  | 300640/371472 [1:45:21<5:08:22,  3.83it/s]
 81%|████████  | 300641/371472 [1:45:22<5:23:19,  3.65it/s]
 81%|████████  | 300642/371472 [1:45:22<5:44:16,  3.43it/s]
 81%|████████  | 300643/371472 [1:45:22<5:36:00,  3.51it/s]
 81%|████████  | 300644/371472 [1:45:23<5:33:09,  3.54it/s]
 81%|████████  | 300645/371472 [1:45:23<5:44:47,  3.42it/s]
 81%|████████  | 300646/371472 [1:45:23<5:33:52,  3.54it/s]
 81%|████████  | 300647/371472 [1:45:24<5:41:20,  3.46it/s]
 81%|████████  | 300648/371472 [1:45:24<5:30:53,  3.57it/s]
 81%|████████  | 300649/371472 [1:45:24<5:14:37,  3.75it/s]
 81%|████████  | 300650/371472 [1:45:24<5:13:30,  3.77it/s]
 81%|████████  | 300651/371472 [1:45:25<5:11:42,  3.79it/s]
 81%|████████  | 300652/371472 [1:45:25<5:46:31,  3.41it/s]
 81%|████████  | 300653/371472 [1:45:25<5:44:42,  3.42it/s]
 81%|████████  | 300654/371472 [1:45:25<5:36:18,  3.51it/s]
 81%|████████  | 300655/371472 [1:45:26<5:57:05,  3.31it/s]
 81%|████████  | 300656/371472 [1:45:26<5:50:21,  3.37it/s]
 81%|████████  | 300657/371472 [1:45:26<5:41:08,  3.46it/s]
 81%|████████  | 300658/371472 [1:45:27<5:55:32,  3.32it/s]
 81%|████████  | 300659/371472 [1:45:27<5:37:12,  3.50it/s]
 81%|████████  | 300660/371472 [1:45:27<5:33:17,  3.54it/s]
                                                           
{'loss': 2.6176, 'learning_rate': 2.716552823805727e-07, 'epoch': 12.95}

 81%|████████  | 300660/371472 [1:45:27<5:33:17,  3.54it/s]
 81%|████████  | 300661/371472 [1:45:28<5:51:06,  3.36it/s]
 81%|████████  | 300662/371472 [1:45:28<5:44:25,  3.43it/s]
 81%|████████  | 300663/371472 [1:45:28<5:36:10,  3.51it/s]
 81%|████████  | 300664/371472 [1:45:28<5:17:04,  3.72it/s]
 81%|████████  | 300665/371472 [1:45:29<5:31:44,  3.56it/s]
 81%|████████  | 300666/371472 [1:45:29<5:24:16,  3.64it/s]
 81%|████████  | 300667/371472 [1:45:29<5:24:15,  3.64it/s]
 81%|████████  | 300668/371472 [1:45:30<6:27:48,  3.04it/s]
 81%|████████  | 300669/371472 [1:45:30<6:02:18,  3.26it/s]
 81%|████████  | 300670/371472 [1:45:30<5:47:05,  3.40it/s]
 81%|████████  | 300671/371472 [1:45:30<5:53:07,  3.34it/s]
 81%|████████  | 300672/371472 [1:45:31<5:38:29,  3.49it/s]
 81%|████████  | 300673/371472 [1:45:31<6:12:16,  3.17it/s]
 81%|████████  | 300674/371472 [1:45:31<5:59:48,  3.28it/s]
 81%|████████  | 300675/371472 [1:45:32<5:55:32,  3.32it/s]
 81%|████████  | 300676/371472 [1:45:32<5:52:17,  3.35it/s]
 81%|████████  | 300677/371472 [1:45:32<6:08:56,  3.20it/s]
 81%|████████  | 300678/371472 [1:45:33<6:38:59,  2.96it/s]
 81%|████████  | 300679/371472 [1:45:33<6:12:21,  3.17it/s]
 81%|████████  | 300680/371472 [1:45:33<6:07:50,  3.21it/s]
                                                           
{'loss': 2.5759, 'learning_rate': 2.716068004050938e-07, 'epoch': 12.95}

 81%|████████  | 300680/371472 [1:45:33<6:07:50,  3.21it/s]
 81%|████████  | 300681/371472 [1:45:34<6:05:39,  3.23it/s]
 81%|████████  | 300682/371472 [1:45:34<5:47:04,  3.40it/s]
 81%|████████  | 300683/371472 [1:45:34<5:51:30,  3.36it/s]
 81%|████████  | 300684/371472 [1:45:34<5:40:52,  3.46it/s]
 81%|████████  | 300685/371472 [1:45:35<6:02:32,  3.25it/s]
 81%|████████  | 300686/371472 [1:45:35<6:05:24,  3.23it/s]
 81%|████████  | 300687/371472 [1:45:35<5:53:14,  3.34it/s]
 81%|████████  | 300688/371472 [1:45:36<5:40:39,  3.46it/s]
 81%|████████  | 300689/371472 [1:45:36<5:33:54,  3.53it/s]
 81%|████████  | 300690/371472 [1:45:36<5:47:40,  3.39it/s]
 81%|████████  | 300691/371472 [1:45:36<5:33:31,  3.54it/s]
 81%|████████  | 300692/371472 [1:45:37<5:41:19,  3.46it/s]
 81%|████████  | 300693/371472 [1:45:37<5:26:11,  3.62it/s]
 81%|████████  | 300694/371472 [1:45:37<5:15:05,  3.74it/s]
 81%|████████  | 300695/371472 [1:45:38<5:14:04,  3.76it/s]
 81%|████████  | 300696/371472 [1:45:38<5:11:53,  3.78it/s]
 81%|████████  | 300697/371472 [1:45:38<5:22:29,  3.66it/s]
 81%|████████  | 300698/371472 [1:45:39<6:22:53,  3.08it/s]
 81%|████████  | 300699/371472 [1:45:39<6:00:45,  3.27it/s]
 81%|████████  | 300700/371472 [1:45:39<5:40:08,  3.47it/s]
                                                           
{'loss': 2.6594, 'learning_rate': 2.7155831842961497e-07, 'epoch': 12.95}

 81%|████████  | 300700/371472 [1:45:39<5:40:08,  3.47it/s]
 81%|████████  | 300701/371472 [1:45:39<5:31:17,  3.56it/s]
 81%|████████  | 300702/371472 [1:45:40<5:14:05,  3.76it/s]
 81%|████████  | 300703/371472 [1:45:40<5:19:00,  3.70it/s]
 81%|████████  | 300704/371472 [1:45:40<5:22:14,  3.66it/s]
 81%|████████  | 300705/371472 [1:45:40<5:07:07,  3.84it/s]
 81%|████████  | 300706/371472 [1:45:41<5:20:01,  3.69it/s]
 81%|████████  | 300707/371472 [1:45:41<5:17:50,  3.71it/s]
 81%|████████  | 300708/371472 [1:45:41<5:11:19,  3.79it/s]
 81%|████████  | 300709/371472 [1:45:41<5:31:33,  3.56it/s]
 81%|████████  | 300710/371472 [1:45:42<5:30:12,  3.57it/s]
 81%|████████  | 300711/371472 [1:45:42<5:34:54,  3.52it/s]
 81%|████████  | 300712/371472 [1:45:42<5:43:01,  3.44it/s]
 81%|████████  | 300713/371472 [1:45:43<5:48:50,  3.38it/s]
 81%|████████  | 300714/371472 [1:45:43<5:40:54,  3.46it/s]
 81%|████████  | 300715/371472 [1:45:43<5:38:17,  3.49it/s]
 81%|████████  | 300716/371472 [1:45:43<5:35:22,  3.52it/s]
 81%|████████  | 300717/371472 [1:45:44<5:30:54,  3.56it/s]
 81%|████████  | 300718/371472 [1:45:44<5:23:15,  3.65it/s]
 81%|████████  | 300719/371472 [1:45:44<5:14:07,  3.75it/s]
 81%|████████  | 300720/371472 [1:45:45<5:17:10,  3.72it/s]
                                                           
{'loss': 2.737, 'learning_rate': 2.7150983645413604e-07, 'epoch': 12.95}

 81%|████████  | 300720/371472 [1:45:45<5:17:10,  3.72it/s]
 81%|████████  | 300721/371472 [1:45:45<5:17:35,  3.71it/s]
 81%|████████  | 300722/371472 [1:45:45<5:04:05,  3.88it/s]
 81%|████████  | 300723/371472 [1:45:45<5:00:56,  3.92it/s]
 81%|████████  | 300724/371472 [1:45:46<4:57:09,  3.97it/s]
 81%|████████  | 300725/371472 [1:45:46<4:56:11,  3.98it/s]
 81%|████████  | 300726/371472 [1:45:46<4:57:51,  3.96it/s]
 81%|████████  | 300727/371472 [1:45:46<5:02:01,  3.90it/s]
 81%|████████  | 300728/371472 [1:45:47<5:00:40,  3.92it/s]
 81%|████████  | 300729/371472 [1:45:47<5:20:06,  3.68it/s]
 81%|████████  | 300730/371472 [1:45:47<5:18:48,  3.70it/s]
 81%|████████  | 300731/371472 [1:45:47<5:23:45,  3.64it/s]
 81%|████████  | 300732/371472 [1:45:48<5:20:52,  3.67it/s]
 81%|████████  | 300733/371472 [1:45:48<5:27:50,  3.60it/s]
 81%|████████  | 300734/371472 [1:45:48<5:19:54,  3.69it/s]
 81%|████████  | 300735/371472 [1:45:49<5:31:12,  3.56it/s]
 81%|████████  | 300736/371472 [1:45:49<5:17:41,  3.71it/s]
 81%|████████  | 300737/371472 [1:45:49<5:50:55,  3.36it/s]
 81%|████████  | 300738/371472 [1:45:49<5:34:08,  3.53it/s]
 81%|████████  | 300739/371472 [1:45:50<5:30:56,  3.56it/s]
 81%|████████  | 300740/371472 [1:45:50<5:21:14,  3.67it/s]
                                                           
{'loss': 2.5943, 'learning_rate': 2.714613544786572e-07, 'epoch': 12.95}

 81%|████████  | 300740/371472 [1:45:50<5:21:14,  3.67it/s]
 81%|████████  | 300741/371472 [1:45:50<5:18:40,  3.70it/s]
 81%|████████  | 300742/371472 [1:45:50<5:21:21,  3.67it/s]
 81%|████████  | 300743/371472 [1:45:51<5:12:37,  3.77it/s]
 81%|████████  | 300744/371472 [1:45:51<5:25:00,  3.63it/s]
 81%|████████  | 300745/371472 [1:45:51<5:23:03,  3.65it/s]
 81%|████████  | 300746/371472 [1:45:52<5:16:53,  3.72it/s]
 81%|████████  | 300747/371472 [1:45:52<5:25:40,  3.62it/s]
 81%|████████  | 300748/371472 [1:45:52<5:14:55,  3.74it/s]
 81%|████████  | 300749/371472 [1:45:52<5:09:21,  3.81it/s]
 81%|████████  | 300750/371472 [1:45:53<5:27:45,  3.60it/s]
 81%|████████  | 300751/371472 [1:45:53<5:42:21,  3.44it/s]
 81%|████████  | 300752/371472 [1:45:53<5:55:42,  3.31it/s]
 81%|████████  | 300753/371472 [1:45:54<5:42:59,  3.44it/s]
 81%|████████  | 300754/371472 [1:45:54<6:44:45,  2.91it/s]
 81%|████████  | 300755/371472 [1:45:54<6:25:14,  3.06it/s]
 81%|████████  | 300756/371472 [1:45:55<5:55:43,  3.31it/s]
 81%|████████  | 300757/371472 [1:45:55<5:52:34,  3.34it/s]
 81%|████████  | 300758/371472 [1:45:55<5:37:47,  3.49it/s]
 81%|████████  | 300759/371472 [1:45:55<5:29:51,  3.57it/s]
 81%|████████  | 300760/371472 [1:45:56<5:41:50,  3.45it/s]
                                                           
{'loss': 2.7416, 'learning_rate': 2.7141287250317824e-07, 'epoch': 12.95}

 81%|████████  | 300760/371472 [1:45:56<5:41:50,  3.45it/s]
 81%|████████  | 300761/371472 [1:45:56<5:31:20,  3.56it/s]
 81%|████████  | 300762/371472 [1:45:56<5:40:44,  3.46it/s]
 81%|████████  | 300763/371472 [1:45:57<5:55:06,  3.32it/s]
 81%|████████  | 300764/371472 [1:45:57<5:52:44,  3.34it/s]
 81%|████████  | 300765/371472 [1:45:57<5:39:47,  3.47it/s]
 81%|████████  | 300766/371472 [1:45:57<5:40:18,  3.46it/s]
 81%|████████  | 300767/371472 [1:45:58<5:34:32,  3.52it/s]
 81%|████████  | 300768/371472 [1:45:58<5:41:50,  3.45it/s]
 81%|████████  | 300769/371472 [1:45:58<5:38:22,  3.48it/s]
 81%|████████  | 300770/371472 [1:45:59<5:28:24,  3.59it/s]
 81%|████████  | 300771/371472 [1:45:59<5:29:20,  3.58it/s]
 81%|████████  | 300772/371472 [1:45:59<5:37:57,  3.49it/s]
 81%|████████  | 300773/371472 [1:45:59<5:28:32,  3.59it/s]
 81%|████████  | 300774/371472 [1:46:00<5:32:31,  3.54it/s]
 81%|████████  | 300775/371472 [1:46:00<5:25:27,  3.62it/s]
 81%|████████  | 300776/371472 [1:46:00<5:29:22,  3.58it/s]
 81%|████████  | 300777/371472 [1:46:01<5:34:01,  3.53it/s]
 81%|████████  | 300778/371472 [1:46:01<5:29:46,  3.57it/s]
 81%|████████  | 300779/371472 [1:46:01<5:28:21,  3.59it/s]
 81%|████████  | 300780/371472 [1:46:01<5:24:28,  3.63it/s]
                                                           
{'loss': 2.5609, 'learning_rate': 2.713643905276994e-07, 'epoch': 12.96}

 81%|████████  | 300780/371472 [1:46:01<5:24:28,  3.63it/s]
 81%|████████  | 300781/371472 [1:46:02<5:35:11,  3.51it/s]
 81%|████████  | 300782/371472 [1:46:02<5:36:28,  3.50it/s]
 81%|████████  | 300783/371472 [1:46:02<5:28:33,  3.59it/s]
 81%|████████  | 300784/371472 [1:46:02<5:26:20,  3.61it/s]
 81%|████████  | 300785/371472 [1:46:03<5:15:25,  3.73it/s]
 81%|████████  | 300786/371472 [1:46:03<5:26:13,  3.61it/s]
 81%|████████  | 300787/371472 [1:46:03<5:23:48,  3.64it/s]
 81%|████████  | 300788/371472 [1:46:04<5:28:32,  3.59it/s]
 81%|████████  | 300789/371472 [1:46:04<5:25:04,  3.62it/s]
 81%|████████  | 300790/371472 [1:46:04<5:26:04,  3.61it/s]
 81%|████████  | 300791/371472 [1:46:04<5:32:34,  3.54it/s]
 81%|████████  | 300792/371472 [1:46:05<5:53:16,  3.33it/s]
 81%|████████  | 300793/371472 [1:46:05<5:38:12,  3.48it/s]
 81%|████████  | 300794/371472 [1:46:05<5:47:52,  3.39it/s]
 81%|████████  | 300795/371472 [1:46:06<5:31:31,  3.55it/s]
 81%|████████  | 300796/371472 [1:46:06<5:24:30,  3.63it/s]
 81%|████████  | 300797/371472 [1:46:06<5:28:29,  3.59it/s]
 81%|████████  | 300798/371472 [1:46:06<5:37:12,  3.49it/s]
 81%|████████  | 300799/371472 [1:46:07<5:22:45,  3.65it/s]
 81%|████████  | 300800/371472 [1:46:07<5:22:55,  3.65it/s]
                                                           
{'loss': 2.6876, 'learning_rate': 2.7131590855222043e-07, 'epoch': 12.96}

 81%|████████  | 300800/371472 [1:46:07<5:22:55,  3.65it/s]
 81%|████████  | 300801/371472 [1:46:07<5:32:36,  3.54it/s]
 81%|████████  | 300802/371472 [1:46:08<5:32:32,  3.54it/s]
 81%|████████  | 300803/371472 [1:46:08<5:28:57,  3.58it/s]
 81%|████████  | 300804/371472 [1:46:08<5:31:12,  3.56it/s]
 81%|████████  | 300805/371472 [1:46:08<5:27:50,  3.59it/s]
 81%|████████  | 300806/371472 [1:46:09<5:31:16,  3.56it/s]
 81%|████████  | 300807/371472 [1:46:09<5:34:43,  3.52it/s]
 81%|████████  | 300808/371472 [1:46:09<5:34:20,  3.52it/s]
 81%|████████  | 300809/371472 [1:46:10<5:33:04,  3.54it/s]
 81%|████████  | 300810/371472 [1:46:10<5:20:40,  3.67it/s]
 81%|████████  | 300811/371472 [1:46:10<5:18:58,  3.69it/s]
 81%|████████  | 300812/371472 [1:46:10<5:35:32,  3.51it/s]
 81%|████████  | 300813/371472 [1:46:11<5:31:24,  3.55it/s]
 81%|████████  | 300814/371472 [1:46:11<5:35:53,  3.51it/s]
 81%|████████  | 300815/371472 [1:46:11<5:35:51,  3.51it/s]
 81%|████████  | 300816/371472 [1:46:11<5:31:15,  3.55it/s]
 81%|████████  | 300817/371472 [1:46:12<5:14:46,  3.74it/s]
 81%|████████  | 300818/371472 [1:46:12<5:18:39,  3.70it/s]
 81%|████████  | 300819/371472 [1:46:12<5:17:28,  3.71it/s]
 81%|████████  | 300820/371472 [1:46:13<5:15:10,  3.74it/s]
                                                           
{'loss': 2.5753, 'learning_rate': 2.712674265767415e-07, 'epoch': 12.96}

 81%|████████  | 300820/371472 [1:46:13<5:15:10,  3.74it/s]
 81%|████████  | 300821/371472 [1:46:13<5:19:54,  3.68it/s]
 81%|████████  | 300822/371472 [1:46:13<5:20:55,  3.67it/s]
 81%|████████  | 300823/371472 [1:46:13<5:19:17,  3.69it/s]
 81%|████████  | 300824/371472 [1:46:14<5:31:55,  3.55it/s]
 81%|████████  | 300825/371472 [1:46:14<5:21:44,  3.66it/s]
 81%|████████  | 300826/371472 [1:46:14<5:32:00,  3.55it/s]
 81%|████████  | 300827/371472 [1:46:15<5:44:41,  3.42it/s]
 81%|████████  | 300828/371472 [1:46:15<5:40:43,  3.46it/s]
 81%|████████  | 300829/371472 [1:46:15<5:46:51,  3.39it/s]
 81%|████████  | 300830/371472 [1:46:15<5:27:50,  3.59it/s]
 81%|████████  | 300831/371472 [1:46:16<5:17:55,  3.70it/s]
 81%|████████  | 300832/371472 [1:46:16<6:02:20,  3.25it/s]
 81%|████████  | 300833/371472 [1:46:16<6:16:14,  3.13it/s]
 81%|████████  | 300834/371472 [1:46:17<6:15:36,  3.13it/s]
 81%|████████  | 300835/371472 [1:46:17<6:20:12,  3.10it/s]
 81%|████████  | 300836/371472 [1:46:17<6:47:46,  2.89it/s]
 81%|████████  | 300837/371472 [1:46:18<6:21:56,  3.08it/s]
 81%|████████  | 300838/371472 [1:46:18<7:06:53,  2.76it/s]
 81%|████████  | 300839/371472 [1:46:18<6:29:22,  3.02it/s]
 81%|████████  | 300840/371472 [1:46:19<6:04:40,  3.23it/s]
                                                           
{'loss': 2.6136, 'learning_rate': 2.712189446012627e-07, 'epoch': 12.96}

 81%|████████  | 300840/371472 [1:46:19<6:04:40,  3.23it/s]
 81%|████████  | 300841/371472 [1:46:19<5:50:57,  3.35it/s]
 81%|████████  | 300842/371472 [1:46:19<5:39:04,  3.47it/s]
 81%|████████  | 300843/371472 [1:46:19<5:33:40,  3.53it/s]
 81%|████████  | 300844/371472 [1:46:20<5:35:27,  3.51it/s]
 81%|████████  | 300845/371472 [1:46:20<5:38:18,  3.48it/s]
 81%|████████  | 300846/371472 [1:46:20<5:40:20,  3.46it/s]
 81%|████████  | 300847/371472 [1:46:21<5:54:50,  3.32it/s]
 81%|████████  | 300848/371472 [1:46:21<5:45:19,  3.41it/s]
 81%|████████  | 300849/371472 [1:46:21<5:29:24,  3.57it/s]
 81%|████████  | 300850/371472 [1:46:21<5:31:08,  3.55it/s]
 81%|████████  | 300851/371472 [1:46:22<5:18:37,  3.69it/s]
 81%|████████  | 300852/371472 [1:46:22<5:14:40,  3.74it/s]
 81%|████████  | 300853/371472 [1:46:22<5:13:00,  3.76it/s]
 81%|████████  | 300854/371472 [1:46:23<5:22:10,  3.65it/s]
 81%|████████  | 300855/371472 [1:46:23<5:24:35,  3.63it/s]
 81%|████████  | 300856/371472 [1:46:23<5:27:44,  3.59it/s]
 81%|████████  | 300857/371472 [1:46:23<5:17:52,  3.70it/s]
 81%|████████  | 300858/371472 [1:46:24<6:10:26,  3.18it/s]
 81%|████████  | 300859/371472 [1:46:24<5:51:35,  3.35it/s]
 81%|████████  | 300860/371472 [1:46:24<5:31:16,  3.55it/s]
                                                           
{'loss': 2.7641, 'learning_rate': 2.7117046262578375e-07, 'epoch': 12.96}

 81%|████████  | 300860/371472 [1:46:24<5:31:16,  3.55it/s]
 81%|████████  | 300861/371472 [1:46:25<5:27:46,  3.59it/s]
 81%|████████  | 300862/371472 [1:46:25<5:25:38,  3.61it/s]
 81%|████████  | 300863/371472 [1:46:25<5:15:01,  3.74it/s]
 81%|████████  | 300864/371472 [1:46:25<5:28:05,  3.59it/s]
 81%|████████  | 300865/371472 [1:46:26<5:32:13,  3.54it/s]
 81%|████████  | 300866/371472 [1:46:26<5:46:43,  3.39it/s]
 81%|████████  | 300867/371472 [1:46:26<5:38:27,  3.48it/s]
 81%|████████  | 300868/371472 [1:46:26<5:33:39,  3.53it/s]
 81%|████████  | 300869/371472 [1:46:27<5:29:18,  3.57it/s]
 81%|████████  | 300870/371472 [1:46:27<5:21:28,  3.66it/s]
 81%|████████  | 300871/371472 [1:46:27<5:13:24,  3.75it/s]
 81%|████████  | 300872/371472 [1:46:28<5:57:06,  3.29it/s]
 81%|████████  | 300873/371472 [1:46:28<5:35:18,  3.51it/s]
 81%|████████  | 300874/371472 [1:46:28<5:25:33,  3.61it/s]
 81%|████████  | 300875/371472 [1:46:28<5:23:09,  3.64it/s]
 81%|████████  | 300876/371472 [1:46:29<5:34:23,  3.52it/s]
 81%|████████  | 300877/371472 [1:46:29<5:30:46,  3.56it/s]
 81%|████████  | 300878/371472 [1:46:29<5:16:49,  3.71it/s]
 81%|████████  | 300879/371472 [1:46:30<5:39:43,  3.46it/s]
 81%|████████  | 300880/371472 [1:46:30<5:37:54,  3.48it/s]
                                                           
{'loss': 2.7037, 'learning_rate': 2.7112198065030493e-07, 'epoch': 12.96}

 81%|████████  | 300880/371472 [1:46:30<5:37:54,  3.48it/s]
 81%|████████  | 300881/371472 [1:46:30<5:26:41,  3.60it/s]
 81%|████████  | 300882/371472 [1:46:30<5:28:00,  3.59it/s]
 81%|████████  | 300883/371472 [1:46:31<5:21:51,  3.66it/s]
 81%|████████  | 300884/371472 [1:46:31<5:13:02,  3.76it/s]
 81%|████████  | 300885/371472 [1:46:31<5:07:32,  3.83it/s]
 81%|████████  | 300886/371472 [1:46:31<5:19:55,  3.68it/s]
 81%|████████  | 300887/371472 [1:46:32<5:16:27,  3.72it/s]
 81%|████████  | 300888/371472 [1:46:32<5:29:37,  3.57it/s]
 81%|████████  | 300889/371472 [1:46:32<5:30:36,  3.56it/s]
 81%|████████  | 300890/371472 [1:46:33<5:21:58,  3.65it/s]
 81%|████████  | 300891/371472 [1:46:33<5:17:11,  3.71it/s]
 81%|████████  | 300892/371472 [1:46:33<5:06:15,  3.84it/s]
 81%|████████  | 300893/371472 [1:46:33<5:44:05,  3.42it/s]
 81%|████████  | 300894/371472 [1:46:34<5:34:36,  3.52it/s]
 81%|████████  | 300895/371472 [1:46:34<5:26:36,  3.60it/s]
 81%|████████  | 300896/371472 [1:46:34<5:48:11,  3.38it/s]
 81%|████████  | 300897/371472 [1:46:35<5:50:15,  3.36it/s]
 81%|████████  | 300898/371472 [1:46:35<5:56:32,  3.30it/s]
 81%|████████  | 300899/371472 [1:46:35<5:41:24,  3.45it/s]
 81%|████████  | 300900/371472 [1:46:36<5:56:34,  3.30it/s]
                                                           
{'loss': 2.5892, 'learning_rate': 2.7107349867482595e-07, 'epoch': 12.96}

 81%|████████  | 300900/371472 [1:46:36<5:56:34,  3.30it/s]
 81%|████████  | 300901/371472 [1:46:36<5:53:35,  3.33it/s]
 81%|████████  | 300902/371472 [1:46:36<6:01:21,  3.25it/s]
 81%|████████  | 300903/371472 [1:46:36<5:46:51,  3.39it/s]
 81%|████████  | 300904/371472 [1:46:37<5:46:02,  3.40it/s]
 81%|████████  | 300905/371472 [1:46:37<5:39:06,  3.47it/s]
 81%|████████  | 300906/371472 [1:46:37<5:30:37,  3.56it/s]
 81%|████████  | 300907/371472 [1:46:38<5:49:59,  3.36it/s]
 81%|████████  | 300908/371472 [1:46:38<5:37:22,  3.49it/s]
 81%|████████  | 300909/371472 [1:46:38<5:34:04,  3.52it/s]
 81%|████████  | 300910/371472 [1:46:38<5:29:02,  3.57it/s]
 81%|████████  | 300911/371472 [1:46:39<5:48:32,  3.37it/s]
 81%|████████  | 300912/371472 [1:46:39<5:45:47,  3.40it/s]
 81%|████████  | 300913/371472 [1:46:39<5:33:36,  3.53it/s]
 81%|████████  | 300914/371472 [1:46:40<5:27:18,  3.59it/s]
 81%|████████  | 300915/371472 [1:46:40<5:15:55,  3.72it/s]
 81%|████████  | 300916/371472 [1:46:40<5:13:55,  3.75it/s]
 81%|████████  | 300917/371472 [1:46:40<5:19:59,  3.67it/s]
 81%|████████  | 300918/371472 [1:46:41<5:19:28,  3.68it/s]
 81%|████████  | 300919/371472 [1:46:41<5:24:05,  3.63it/s]
 81%|████████  | 300920/371472 [1:46:41<5:33:54,  3.52it/s]
                                                           
{'loss': 2.7004, 'learning_rate': 2.710250166993471e-07, 'epoch': 12.96}

 81%|████████  | 300920/371472 [1:46:41<5:33:54,  3.52it/s]
 81%|████████  | 300921/371472 [1:46:41<5:46:23,  3.39it/s]
 81%|████████  | 300922/371472 [1:46:42<5:44:00,  3.42it/s]
 81%|████████  | 300923/371472 [1:46:42<5:43:36,  3.42it/s]
 81%|████████  | 300924/371472 [1:46:42<5:57:05,  3.29it/s]
 81%|████████  | 300925/371472 [1:46:43<5:48:37,  3.37it/s]
 81%|████████  | 300926/371472 [1:46:43<5:41:43,  3.44it/s]
 81%|████████  | 300927/371472 [1:46:43<5:36:58,  3.49it/s]
 81%|████████  | 300928/371472 [1:46:44<6:44:02,  2.91it/s]
 81%|████████  | 300929/371472 [1:46:44<6:07:39,  3.20it/s]
 81%|████████  | 300930/371472 [1:46:44<5:47:57,  3.38it/s]
 81%|████████  | 300931/371472 [1:46:44<5:39:46,  3.46it/s]
 81%|████████  | 300932/371472 [1:46:45<5:35:23,  3.51it/s]
 81%|████████  | 300933/371472 [1:46:45<5:31:15,  3.55it/s]
 81%|████████  | 300934/371472 [1:46:45<5:19:32,  3.68it/s]
 81%|████████  | 300935/371472 [1:46:46<5:32:22,  3.54it/s]
 81%|████████  | 300936/371472 [1:46:46<5:35:20,  3.51it/s]
 81%|████████  | 300937/371472 [1:46:46<5:30:36,  3.56it/s]
 81%|████████  | 300938/371472 [1:46:46<5:24:27,  3.62it/s]
 81%|████████  | 300939/371472 [1:46:47<5:20:21,  3.67it/s]
 81%|████████  | 300940/371472 [1:46:47<5:28:53,  3.57it/s]
                                                           
{'loss': 2.5434, 'learning_rate': 2.7097653472386815e-07, 'epoch': 12.96}

 81%|████████  | 300940/371472 [1:46:47<5:28:53,  3.57it/s]
 81%|████████  | 300941/371472 [1:46:47<5:19:06,  3.68it/s]
 81%|████████  | 300942/371472 [1:46:48<5:22:12,  3.65it/s]
 81%|████████  | 300943/371472 [1:46:48<5:20:33,  3.67it/s]
 81%|████████  | 300944/371472 [1:46:48<5:19:09,  3.68it/s]
 81%|████████  | 300945/371472 [1:46:48<5:20:33,  3.67it/s]
 81%|████████  | 300946/371472 [1:46:49<5:19:23,  3.68it/s]
 81%|████████  | 300947/371472 [1:46:49<5:46:32,  3.39it/s]
 81%|████████  | 300948/371472 [1:46:49<5:39:40,  3.46it/s]
 81%|████████  | 300949/371472 [1:46:50<6:19:27,  3.10it/s]
 81%|████████  | 300950/371472 [1:46:50<6:16:21,  3.12it/s]
 81%|████████  | 300951/371472 [1:46:50<5:54:11,  3.32it/s]
 81%|████████  | 300952/371472 [1:46:51<5:55:18,  3.31it/s]
 81%|████████  | 300953/371472 [1:46:51<5:47:36,  3.38it/s]
 81%|████████  | 300954/371472 [1:46:51<5:32:44,  3.53it/s]
 81%|████████  | 300955/371472 [1:46:51<5:30:00,  3.56it/s]
 81%|████████  | 300956/371472 [1:46:52<5:33:38,  3.52it/s]
 81%|████████  | 300957/371472 [1:46:52<5:34:11,  3.52it/s]
 81%|████████  | 300958/371472 [1:46:52<5:32:46,  3.53it/s]
 81%|████████  | 300959/371472 [1:46:52<5:41:28,  3.44it/s]
 81%|████████  | 300960/371472 [1:46:53<5:29:12,  3.57it/s]
                                                           
{'loss': 2.6784, 'learning_rate': 2.709280527483893e-07, 'epoch': 12.96}

 81%|████████  | 300960/371472 [1:46:53<5:29:12,  3.57it/s]
 81%|████████  | 300961/371472 [1:46:53<5:31:43,  3.54it/s]
 81%|████████  | 300962/371472 [1:46:53<5:29:35,  3.57it/s]
 81%|████████  | 300963/371472 [1:46:54<5:23:21,  3.63it/s]
 81%|████████  | 300964/371472 [1:46:54<5:37:49,  3.48it/s]
 81%|████████  | 300965/371472 [1:46:54<6:55:44,  2.83it/s]
 81%|████████  | 300966/371472 [1:46:55<6:44:09,  2.91it/s]
 81%|████████  | 300967/371472 [1:46:55<6:10:39,  3.17it/s]
 81%|████████  | 300968/371472 [1:46:55<6:09:02,  3.18it/s]
 81%|████████  | 300969/371472 [1:46:56<5:49:39,  3.36it/s]
 81%|████████  | 300970/371472 [1:46:56<5:31:07,  3.55it/s]
 81%|████████  | 300971/371472 [1:46:56<5:31:43,  3.54it/s]
 81%|████████  | 300972/371472 [1:46:56<5:30:41,  3.55it/s]
 81%|████████  | 300973/371472 [1:46:57<5:35:28,  3.50it/s]
 81%|████████  | 300974/371472 [1:46:57<5:26:53,  3.59it/s]
 81%|████████  | 300975/371472 [1:46:57<5:20:53,  3.66it/s]
 81%|████████  | 300976/371472 [1:46:57<5:22:36,  3.64it/s]
 81%|████████  | 300977/371472 [1:46:58<5:16:13,  3.72it/s]
 81%|████████  | 300978/371472 [1:46:58<5:26:09,  3.60it/s]
 81%|████████  | 300979/371472 [1:46:58<5:26:23,  3.60it/s]
 81%|████████  | 300980/371472 [1:46:59<5:27:31,  3.59it/s]
                                                           
{'loss': 2.4164, 'learning_rate': 2.708795707729104e-07, 'epoch': 12.96}

 81%|████████  | 300980/371472 [1:46:59<5:27:31,  3.59it/s]
 81%|████████  | 300981/371472 [1:46:59<5:47:31,  3.38it/s]
 81%|████████  | 300982/371472 [1:46:59<5:33:07,  3.53it/s]
 81%|████████  | 300983/371472 [1:46:59<5:15:01,  3.73it/s]
 81%|████████  | 300984/371472 [1:47:00<5:06:03,  3.84it/s]
 81%|████████  | 300985/371472 [1:47:00<5:04:48,  3.85it/s]
 81%|████████  | 300986/371472 [1:47:00<5:18:18,  3.69it/s]
 81%|████████  | 300987/371472 [1:47:01<5:47:32,  3.38it/s]
 81%|████████  | 300988/371472 [1:47:01<6:26:20,  3.04it/s]
 81%|████████  | 300989/371472 [1:47:01<6:34:38,  2.98it/s]
 81%|████████  | 300990/371472 [1:47:02<6:09:05,  3.18it/s]
 81%|████████  | 300991/371472 [1:47:02<6:27:03,  3.03it/s]
 81%|████████  | 300992/371472 [1:47:02<6:09:21,  3.18it/s]
 81%|████████  | 300993/371472 [1:47:02<5:49:00,  3.37it/s]
 81%|████████  | 300994/371472 [1:47:03<7:11:37,  2.72it/s]
 81%|████████  | 300995/371472 [1:47:03<6:43:19,  2.91it/s]
 81%|████████  | 300996/371472 [1:47:04<6:30:10,  3.01it/s]
 81%|████████  | 300997/371472 [1:47:04<6:03:10,  3.23it/s]
 81%|████████  | 300998/371472 [1:47:04<5:44:13,  3.41it/s]
 81%|████████  | 300999/371472 [1:47:04<5:23:01,  3.64it/s]
 81%|████████  | 301000/371472 [1:47:05<5:18:22,  3.69it/s]
                                                           
{'loss': 2.5784, 'learning_rate': 2.7083108879743157e-07, 'epoch': 12.96}

 81%|████████  | 301000/371472 [1:47:05<5:18:22,  3.69it/s]
 81%|████████  | 301001/371472 [1:47:05<5:12:44,  3.76it/s]
 81%|████████  | 301002/371472 [1:47:05<5:19:27,  3.68it/s]
 81%|████████  | 301003/371472 [1:47:05<5:23:01,  3.64it/s]
 81%|████████  | 301004/371472 [1:47:06<5:18:29,  3.69it/s]
 81%|████████  | 301005/371472 [1:47:06<5:38:14,  3.47it/s]
 81%|████████  | 301006/371472 [1:47:06<5:48:23,  3.37it/s]
 81%|████████  | 301007/371472 [1:47:07<5:56:38,  3.29it/s]
 81%|████████  | 301008/371472 [1:47:07<5:58:50,  3.27it/s]
 81%|████████  | 301009/371472 [1:47:07<5:47:57,  3.38it/s]
 81%|████████  | 301010/371472 [1:47:07<5:48:25,  3.37it/s]
 81%|████████  | 301011/371472 [1:47:08<5:34:28,  3.51it/s]
 81%|████████  | 301012/371472 [1:47:08<5:49:30,  3.36it/s]
 81%|████████  | 301013/371472 [1:47:08<5:45:40,  3.40it/s]
 81%|████████  | 301014/371472 [1:47:09<5:44:34,  3.41it/s]
 81%|████████  | 301015/371472 [1:47:09<6:02:25,  3.24it/s]
 81%|████████  | 301016/371472 [1:47:09<6:05:36,  3.21it/s]
 81%|████████  | 301017/371472 [1:47:10<5:48:32,  3.37it/s]
 81%|████████  | 301018/371472 [1:47:10<5:41:53,  3.43it/s]
 81%|████████  | 301019/371472 [1:47:10<6:06:35,  3.20it/s]
 81%|████████  | 301020/371472 [1:47:10<5:44:46,  3.41it/s]
                                                           
{'loss': 2.4189, 'learning_rate': 2.707826068219526e-07, 'epoch': 12.97}

 81%|████████  | 301020/371472 [1:47:10<5:44:46,  3.41it/s]
 81%|████████  | 301021/371472 [1:47:11<5:52:20,  3.33it/s]
 81%|████████  | 301022/371472 [1:47:11<5:41:01,  3.44it/s]
 81%|████████  | 301023/371472 [1:47:11<5:31:33,  3.54it/s]
 81%|████████  | 301024/371472 [1:47:12<5:29:49,  3.56it/s]
 81%|████████  | 301025/371472 [1:47:12<5:49:21,  3.36it/s]
 81%|████████  | 301026/371472 [1:47:12<5:34:29,  3.51it/s]
 81%|████████  | 301027/371472 [1:47:12<5:23:53,  3.62it/s]
 81%|████████  | 301028/371472 [1:47:13<5:12:53,  3.75it/s]
 81%|████████  | 301029/371472 [1:47:13<5:30:05,  3.56it/s]
 81%|████████  | 301030/371472 [1:47:13<5:21:59,  3.65it/s]
 81%|████████  | 301031/371472 [1:47:14<5:23:58,  3.62it/s]
 81%|████████  | 301032/371472 [1:47:14<5:20:36,  3.66it/s]
 81%|████████  | 301033/371472 [1:47:14<6:02:24,  3.24it/s]
 81%|████████  | 301034/371472 [1:47:14<5:50:40,  3.35it/s]
 81%|████████  | 301035/371472 [1:47:15<5:31:29,  3.54it/s]
 81%|████████  | 301036/371472 [1:47:15<5:32:23,  3.53it/s]
 81%|████████  | 301037/371472 [1:47:15<5:21:40,  3.65it/s]
 81%|████████  | 301038/371472 [1:47:16<5:54:50,  3.31it/s]
 81%|████████  | 301039/371472 [1:47:16<5:41:27,  3.44it/s]
 81%|████████  | 301040/371472 [1:47:16<5:40:35,  3.45it/s]
                                                           
{'loss': 2.5985, 'learning_rate': 2.7073412484647377e-07, 'epoch': 12.97}

 81%|████████  | 301040/371472 [1:47:16<5:40:35,  3.45it/s]
 81%|████████  | 301041/371472 [1:47:16<5:35:04,  3.50it/s]
 81%|████████  | 301042/371472 [1:47:17<5:23:07,  3.63it/s]
 81%|████████  | 301043/371472 [1:47:17<5:13:59,  3.74it/s]
 81%|████████  | 301044/371472 [1:47:17<5:12:51,  3.75it/s]
 81%|████████  | 301045/371472 [1:47:17<5:06:33,  3.83it/s]
 81%|████████  | 301046/371472 [1:47:18<5:11:24,  3.77it/s]
 81%|████████  | 301047/371472 [1:47:18<5:35:04,  3.50it/s]
 81%|████████  | 301048/371472 [1:47:18<5:17:29,  3.70it/s]
 81%|████████  | 301049/371472 [1:47:19<5:03:19,  3.87it/s]
 81%|████████  | 301050/371472 [1:47:19<5:02:42,  3.88it/s]
 81%|████████  | 301051/371472 [1:47:19<4:59:37,  3.92it/s]
 81%|████████  | 301052/371472 [1:47:19<4:56:06,  3.96it/s]
 81%|████████  | 301053/371472 [1:47:20<5:09:58,  3.79it/s]
 81%|████████  | 301054/371472 [1:47:20<5:24:38,  3.62it/s]
 81%|████████  | 301055/371472 [1:47:20<5:22:26,  3.64it/s]
 81%|████████  | 301056/371472 [1:47:20<5:43:51,  3.41it/s]
 81%|████████  | 301057/371472 [1:47:21<6:09:04,  3.18it/s]
 81%|████████  | 301058/371472 [1:47:21<5:58:44,  3.27it/s]
 81%|████████  | 301059/371472 [1:47:21<6:02:07,  3.24it/s]
 81%|████████  | 301060/371472 [1:47:22<5:47:59,  3.37it/s]
                                                           
{'loss': 2.6717, 'learning_rate': 2.706856428709948e-07, 'epoch': 12.97}

 81%|████████  | 301060/371472 [1:47:22<5:47:59,  3.37it/s]
 81%|████████  | 301061/371472 [1:47:22<5:52:08,  3.33it/s]
 81%|████████  | 301062/371472 [1:47:22<5:38:47,  3.46it/s]
 81%|████████  | 301063/371472 [1:47:23<5:24:15,  3.62it/s]
 81%|████████  | 301064/371472 [1:47:23<5:23:20,  3.63it/s]
 81%|████████  | 301065/371472 [1:47:23<5:10:51,  3.77it/s]
 81%|████████  | 301066/371472 [1:47:23<5:08:20,  3.81it/s]
 81%|████████  | 301067/371472 [1:47:24<5:21:12,  3.65it/s]
 81%|████████  | 301068/371472 [1:47:24<5:16:47,  3.70it/s]
 81%|████████  | 301069/371472 [1:47:24<5:12:39,  3.75it/s]
 81%|████████  | 301070/371472 [1:47:24<5:08:41,  3.80it/s]
 81%|████████  | 301071/371472 [1:47:25<5:13:45,  3.74it/s]
 81%|████████  | 301072/371472 [1:47:25<5:19:23,  3.67it/s]
 81%|████████  | 301073/371472 [1:47:25<5:25:02,  3.61it/s]
 81%|████████  | 301074/371472 [1:47:26<5:25:21,  3.61it/s]
 81%|████████  | 301075/371472 [1:47:26<5:24:27,  3.62it/s]
 81%|████████  | 301076/371472 [1:47:26<5:36:49,  3.48it/s]
 81%|████████  | 301077/371472 [1:47:26<5:23:20,  3.63it/s]
 81%|████████  | 301078/371472 [1:47:27<5:46:39,  3.38it/s]
 81%|████████  | 301079/371472 [1:47:27<5:37:42,  3.47it/s]
 81%|████████  | 301080/371472 [1:47:27<5:41:28,  3.44it/s]
                                                           
{'loss': 2.6696, 'learning_rate': 2.7063716089551596e-07, 'epoch': 12.97}

 81%|████████  | 301080/371472 [1:47:27<5:41:28,  3.44it/s]
 81%|████████  | 301081/371472 [1:47:28<5:39:30,  3.46it/s]
 81%|████████  | 301082/371472 [1:47:28<5:23:51,  3.62it/s]
 81%|████████  | 301083/371472 [1:47:28<5:22:53,  3.63it/s]
 81%|████████  | 301084/371472 [1:47:28<5:39:14,  3.46it/s]
 81%|████████  | 301085/371472 [1:47:29<5:27:24,  3.58it/s]
 81%|████████  | 301086/371472 [1:47:29<5:17:21,  3.70it/s]
 81%|████████  | 301087/371472 [1:47:29<5:25:09,  3.61it/s]
 81%|████████  | 301088/371472 [1:47:29<5:35:57,  3.49it/s]
 81%|████████  | 301089/371472 [1:47:30<5:36:47,  3.48it/s]
 81%|████████  | 301090/371472 [1:47:30<5:27:57,  3.58it/s]
 81%|████████  | 301091/371472 [1:47:30<5:29:13,  3.56it/s]
 81%|████████  | 301092/371472 [1:47:31<5:41:27,  3.44it/s]
 81%|████████  | 301093/371472 [1:47:31<5:29:39,  3.56it/s]
 81%|████████  | 301094/371472 [1:47:31<5:23:24,  3.63it/s]
 81%|████████  | 301095/371472 [1:47:31<5:17:04,  3.70it/s]
 81%|████████  | 301096/371472 [1:47:32<5:08:46,  3.80it/s]
 81%|████████  | 301097/371472 [1:47:32<5:18:14,  3.69it/s]
 81%|████████  | 301098/371472 [1:47:32<5:15:36,  3.72it/s]
 81%|████████  | 301099/371472 [1:47:33<5:33:29,  3.52it/s]
 81%|████████  | 301100/371472 [1:47:33<5:30:09,  3.55it/s]
                                                           
{'loss': 2.4904, 'learning_rate': 2.705886789200371e-07, 'epoch': 12.97}

 81%|████████  | 301100/371472 [1:47:33<5:30:09,  3.55it/s]
 81%|████████  | 301101/371472 [1:47:33<5:37:38,  3.47it/s]
 81%|████████  | 301102/371472 [1:47:33<5:35:12,  3.50it/s]
 81%|████████  | 301103/371472 [1:47:34<5:32:01,  3.53it/s]
 81%|████████  | 301104/371472 [1:47:34<5:25:01,  3.61it/s]
 81%|████████  | 301105/371472 [1:47:34<5:25:24,  3.60it/s]
 81%|████████  | 301106/371472 [1:47:35<5:33:46,  3.51it/s]
 81%|████████  | 301107/371472 [1:47:35<5:21:48,  3.64it/s]
 81%|████████  | 301108/371472 [1:47:35<5:29:14,  3.56it/s]
 81%|████████  | 301109/371472 [1:47:35<5:20:06,  3.66it/s]
 81%|████████  | 301110/371472 [1:47:36<5:28:23,  3.57it/s]
 81%|████████  | 301111/371472 [1:47:36<5:22:33,  3.64it/s]
 81%|████████  | 301112/371472 [1:47:36<5:58:33,  3.27it/s]
 81%|████████  | 301113/371472 [1:47:37<5:50:04,  3.35it/s]
 81%|████████  | 301114/371472 [1:47:37<6:20:53,  3.08it/s]
 81%|████████  | 301115/371472 [1:47:37<5:57:09,  3.28it/s]
 81%|████████  | 301116/371472 [1:47:38<6:01:20,  3.25it/s]
 81%|████████  | 301117/371472 [1:47:38<5:45:24,  3.39it/s]
 81%|████████  | 301118/371472 [1:47:38<5:31:29,  3.54it/s]
 81%|████████  | 301119/371472 [1:47:38<5:20:36,  3.66it/s]
 81%|████████  | 301120/371472 [1:47:39<5:16:33,  3.70it/s]
                                                           
{'loss': 2.6252, 'learning_rate': 2.705401969445582e-07, 'epoch': 12.97}

 81%|████████  | 301120/371472 [1:47:39<5:16:33,  3.70it/s]
 81%|████████  | 301121/371472 [1:47:39<5:14:58,  3.72it/s]
 81%|████████  | 301122/371472 [1:47:39<5:20:00,  3.66it/s]
 81%|████████  | 301123/371472 [1:47:39<5:29:39,  3.56it/s]
 81%|████████  | 301124/371472 [1:47:40<5:23:28,  3.62it/s]
 81%|████████  | 301125/371472 [1:47:40<5:18:18,  3.68it/s]
 81%|████████  | 301126/371472 [1:47:40<5:26:49,  3.59it/s]
 81%|████████  | 301127/371472 [1:47:41<5:35:45,  3.49it/s]
 81%|████████  | 301128/371472 [1:47:41<5:28:21,  3.57it/s]
 81%|████████  | 301129/371472 [1:47:41<5:24:01,  3.62it/s]
 81%|████████  | 301130/371472 [1:47:41<5:39:39,  3.45it/s]
 81%|████████  | 301131/371472 [1:47:42<5:38:19,  3.47it/s]
 81%|████████  | 301132/371472 [1:47:42<5:26:34,  3.59it/s]
 81%|████████  | 301133/371472 [1:47:42<5:24:42,  3.61it/s]
 81%|████████  | 301134/371472 [1:47:42<5:31:03,  3.54it/s]
 81%|████████  | 301135/371472 [1:47:43<5:19:41,  3.67it/s]
 81%|████████  | 301136/371472 [1:47:43<5:08:11,  3.80it/s]
 81%|████████  | 301137/371472 [1:47:43<5:11:08,  3.77it/s]
 81%|████████  | 301138/371472 [1:47:43<5:02:03,  3.88it/s]
 81%|████████  | 301139/371472 [1:47:44<5:18:27,  3.68it/s]
 81%|████████  | 301140/371472 [1:47:44<5:29:52,  3.55it/s]
                                                           
{'loss': 2.5448, 'learning_rate': 2.7049171496907923e-07, 'epoch': 12.97}

 81%|████████  | 301140/371472 [1:47:44<5:29:52,  3.55it/s]
 81%|████████  | 301141/371472 [1:47:44<5:31:20,  3.54it/s]
 81%|████████  | 301142/371472 [1:47:45<5:21:10,  3.65it/s]
 81%|████████  | 301143/371472 [1:47:45<5:12:58,  3.75it/s]
 81%|████████  | 301144/371472 [1:47:45<5:22:55,  3.63it/s]
 81%|████████  | 301145/371472 [1:47:45<5:11:25,  3.76it/s]
 81%|████████  | 301146/371472 [1:47:46<5:16:54,  3.70it/s]
 81%|████████  | 301147/371472 [1:47:46<5:19:15,  3.67it/s]
 81%|████████  | 301148/371472 [1:47:46<5:27:34,  3.58it/s]
 81%|████████  | 301149/371472 [1:47:47<5:42:46,  3.42it/s]
 81%|████████  | 301150/371472 [1:47:47<5:44:38,  3.40it/s]
 81%|████████  | 301151/371472 [1:47:47<5:36:14,  3.49it/s]
 81%|████████  | 301152/371472 [1:47:47<5:41:17,  3.43it/s]
 81%|████████  | 301153/371472 [1:47:48<5:54:15,  3.31it/s]
 81%|████████  | 301154/371472 [1:47:48<5:47:55,  3.37it/s]
 81%|████████  | 301155/371472 [1:47:48<5:36:43,  3.48it/s]
 81%|████████  | 301156/371472 [1:47:49<5:28:41,  3.57it/s]
 81%|████████  | 301157/371472 [1:47:49<5:26:38,  3.59it/s]
 81%|████████  | 301158/371472 [1:47:49<5:27:51,  3.57it/s]
 81%|████████  | 301159/371472 [1:47:49<5:35:15,  3.50it/s]
 81%|████████  | 301160/371472 [1:47:50<5:26:28,  3.59it/s]
                                                           
{'loss': 2.5831, 'learning_rate': 2.704432329936004e-07, 'epoch': 12.97}

 81%|████████  | 301160/371472 [1:47:50<5:26:28,  3.59it/s]
 81%|████████  | 301161/371472 [1:47:50<5:19:40,  3.67it/s]
 81%|████████  | 301162/371472 [1:47:50<5:17:03,  3.70it/s]
 81%|████████  | 301163/371472 [1:47:51<5:19:40,  3.67it/s]
 81%|████████  | 301164/371472 [1:47:51<5:17:00,  3.70it/s]
 81%|████████  | 301165/371472 [1:47:51<5:15:59,  3.71it/s]
 81%|████████  | 301166/371472 [1:47:51<5:45:46,  3.39it/s]
 81%|████████  | 301167/371472 [1:47:52<5:34:57,  3.50it/s]
 81%|████████  | 301168/371472 [1:47:52<5:27:01,  3.58it/s]
 81%|████████  | 301169/371472 [1:47:52<5:37:07,  3.48it/s]
 81%|████████  | 301170/371472 [1:47:53<5:47:43,  3.37it/s]
 81%|████████  | 301171/371472 [1:47:53<5:39:25,  3.45it/s]
 81%|████████  | 301172/371472 [1:47:53<5:29:46,  3.55it/s]
 81%|████████  | 301173/371472 [1:47:53<5:21:50,  3.64it/s]
 81%|████████  | 301174/371472 [1:47:54<6:00:37,  3.25it/s]
 81%|████████  | 301175/371472 [1:47:54<5:42:13,  3.42it/s]
 81%|████████  | 301176/371472 [1:47:54<5:38:34,  3.46it/s]
 81%|████████  | 301177/371472 [1:47:55<5:35:21,  3.49it/s]
 81%|████████  | 301178/371472 [1:47:55<5:26:25,  3.59it/s]
 81%|████████  | 301179/371472 [1:47:55<5:21:27,  3.64it/s]
 81%|████████  | 301180/371472 [1:47:55<5:42:22,  3.42it/s]
                                                           
{'loss': 2.6472, 'learning_rate': 2.7039475101812143e-07, 'epoch': 12.97}

 81%|████████  | 301180/371472 [1:47:55<5:42:22,  3.42it/s]
 81%|████████  | 301181/371472 [1:47:56<5:31:13,  3.54it/s]
 81%|████████  | 301182/371472 [1:47:56<5:20:41,  3.65it/s]
 81%|████████  | 301183/371472 [1:47:56<5:17:14,  3.69it/s]
 81%|████████  | 301184/371472 [1:47:57<5:35:03,  3.50it/s]
 81%|████████  | 301185/371472 [1:47:57<5:34:14,  3.50it/s]
 81%|████████  | 301186/371472 [1:47:57<5:44:26,  3.40it/s]
 81%|████████  | 301187/371472 [1:47:57<5:55:38,  3.29it/s]
 81%|████████  | 301188/371472 [1:47:58<5:40:47,  3.44it/s]
 81%|████████  | 301189/371472 [1:47:58<5:32:10,  3.53it/s]
 81%|████████  | 301190/371472 [1:47:58<5:25:59,  3.59it/s]
 81%|████████  | 301191/371472 [1:47:59<6:11:49,  3.15it/s]
 81%|████████  | 301192/371472 [1:47:59<5:42:54,  3.42it/s]
 81%|████████  | 301193/371472 [1:47:59<5:36:05,  3.49it/s]
 81%|████████  | 301194/371472 [1:47:59<5:22:04,  3.64it/s]
 81%|████████  | 301195/371472 [1:48:00<5:49:28,  3.35it/s]
 81%|████████  | 301196/371472 [1:48:00<5:47:49,  3.37it/s]
 81%|████████  | 301197/371472 [1:48:00<5:36:33,  3.48it/s]
 81%|████████  | 301198/371472 [1:48:01<5:27:13,  3.58it/s]
 81%|████████  | 301199/371472 [1:48:01<5:18:28,  3.68it/s]
 81%|████████  | 301200/371472 [1:48:01<5:13:56,  3.73it/s]
                                                           
{'loss': 2.5724, 'learning_rate': 2.703462690426426e-07, 'epoch': 12.97}

 81%|████████  | 301200/371472 [1:48:01<5:13:56,  3.73it/s]
 81%|████████  | 301201/371472 [1:48:01<5:26:44,  3.58it/s]
 81%|████████  | 301202/371472 [1:48:02<5:21:24,  3.64it/s]
 81%|████████  | 301203/371472 [1:48:02<5:14:30,  3.72it/s]
 81%|████████  | 301204/371472 [1:48:02<5:17:23,  3.69it/s]
 81%|████████  | 301205/371472 [1:48:02<5:06:17,  3.82it/s]
 81%|████████  | 301206/371472 [1:48:03<5:18:17,  3.68it/s]
 81%|████████  | 301207/371472 [1:48:03<5:07:48,  3.80it/s]
 81%|████████  | 301208/371472 [1:48:03<5:07:40,  3.81it/s]
 81%|████████  | 301209/371472 [1:48:04<5:16:36,  3.70it/s]
 81%|████████  | 301210/371472 [1:48:04<5:39:51,  3.45it/s]
 81%|████████  | 301211/371472 [1:48:04<5:29:44,  3.55it/s]
 81%|████████  | 301212/371472 [1:48:04<5:39:14,  3.45it/s]
 81%|████████  | 301213/371472 [1:48:05<5:39:32,  3.45it/s]
 81%|████████  | 301214/371472 [1:48:05<6:03:19,  3.22it/s]
 81%|████████  | 301215/371472 [1:48:05<6:03:30,  3.22it/s]
 81%|████████  | 301216/371472 [1:48:06<5:55:17,  3.30it/s]
 81%|████████  | 301217/371472 [1:48:06<5:40:37,  3.44it/s]
 81%|████████  | 301218/371472 [1:48:06<5:43:19,  3.41it/s]
 81%|████████  | 301219/371472 [1:48:06<5:26:34,  3.59it/s]
 81%|████████  | 301220/371472 [1:48:07<5:18:48,  3.67it/s]
                                                           
{'loss': 2.626, 'learning_rate': 2.702977870671637e-07, 'epoch': 12.97}

 81%|████████  | 301220/371472 [1:48:07<5:18:48,  3.67it/s]
 81%|████████  | 301221/371472 [1:48:07<5:20:35,  3.65it/s]
 81%|████████  | 301222/371472 [1:48:07<5:33:55,  3.51it/s]
 81%|████████  | 301223/371472 [1:48:08<5:59:05,  3.26it/s]
 81%|████████  | 301224/371472 [1:48:08<5:44:40,  3.40it/s]
 81%|████████  | 301225/371472 [1:48:08<5:33:58,  3.51it/s]
 81%|████████  | 301226/371472 [1:48:08<5:26:22,  3.59it/s]
 81%|████████  | 301227/371472 [1:48:09<5:17:20,  3.69it/s]
 81%|████████  | 301228/371472 [1:48:09<5:08:18,  3.80it/s]
 81%|████████  | 301229/371472 [1:48:09<5:02:03,  3.88it/s]
 81%|████████  | 301230/371472 [1:48:10<5:27:45,  3.57it/s]
 81%|████████  | 301231/371472 [1:48:10<5:19:33,  3.66it/s]
 81%|████████  | 301232/371472 [1:48:10<5:18:46,  3.67it/s]
 81%|████████  | 301233/371472 [1:48:10<5:18:10,  3.68it/s]
 81%|████████  | 301234/371472 [1:48:11<5:19:15,  3.67it/s]
 81%|████████  | 301235/371472 [1:48:11<5:08:35,  3.79it/s]
 81%|████████  | 301236/371472 [1:48:11<5:08:56,  3.79it/s]
 81%|████████  | 301237/371472 [1:48:11<5:35:35,  3.49it/s]
 81%|████████  | 301238/371472 [1:48:12<6:05:17,  3.20it/s]
 81%|████████  | 301239/371472 [1:48:12<6:02:55,  3.23it/s]
 81%|████████  | 301240/371472 [1:48:12<6:01:46,  3.24it/s]
                                                           
{'loss': 2.5409, 'learning_rate': 2.7024930509168485e-07, 'epoch': 12.97}

 81%|████████  | 301240/371472 [1:48:12<6:01:46,  3.24it/s]
 81%|████████  | 301241/371472 [1:48:13<5:45:48,  3.38it/s]
 81%|████████  | 301242/371472 [1:48:13<5:52:42,  3.32it/s]
 81%|████████  | 301243/371472 [1:48:13<5:35:58,  3.48it/s]
 81%|████████  | 301244/371472 [1:48:14<5:26:16,  3.59it/s]
 81%|████████  | 301245/371472 [1:48:14<5:11:35,  3.76it/s]
 81%|████████  | 301246/371472 [1:48:14<5:09:46,  3.78it/s]
 81%|████████  | 301247/371472 [1:48:14<5:00:19,  3.90it/s]
 81%|████████  | 301248/371472 [1:48:15<5:05:02,  3.84it/s]
 81%|████████  | 301249/371472 [1:48:15<5:04:55,  3.84it/s]
 81%|████████  | 301250/371472 [1:48:15<5:16:03,  3.70it/s]
 81%|████████  | 301251/371472 [1:48:15<5:11:08,  3.76it/s]
 81%|████████  | 301252/371472 [1:48:16<5:20:11,  3.66it/s]
 81%|████████  | 301253/371472 [1:48:16<5:16:16,  3.70it/s]
 81%|████████  | 301254/371472 [1:48:16<5:37:15,  3.47it/s]
 81%|████████  | 301255/371472 [1:48:17<5:32:14,  3.52it/s]
 81%|████████  | 301256/371472 [1:48:17<5:29:13,  3.55it/s]
 81%|████████  | 301257/371472 [1:48:17<5:29:31,  3.55it/s]
 81%|████████  | 301258/371472 [1:48:17<5:27:08,  3.58it/s]
 81%|████████  | 301259/371472 [1:48:18<5:21:19,  3.64it/s]
 81%|████████  | 301260/371472 [1:48:18<5:31:25,  3.53it/s]
                                                           
{'loss': 2.6202, 'learning_rate': 2.702008231162059e-07, 'epoch': 12.98}

 81%|████████  | 301260/371472 [1:48:18<5:31:25,  3.53it/s]
 81%|████████  | 301261/371472 [1:48:18<5:19:52,  3.66it/s]
 81%|████████  | 301262/371472 [1:48:18<5:16:33,  3.70it/s]
 81%|████████  | 301263/371472 [1:48:19<5:23:31,  3.62it/s]
 81%|████████  | 301264/371472 [1:48:19<5:12:15,  3.75it/s]
 81%|████████  | 301265/371472 [1:48:19<5:25:22,  3.60it/s]
 81%|████████  | 301266/371472 [1:48:20<5:24:16,  3.61it/s]
 81%|████████  | 301267/371472 [1:48:20<5:23:00,  3.62it/s]
 81%|████████  | 301268/371472 [1:48:20<5:36:34,  3.48it/s]
 81%|████████  | 301269/371472 [1:48:20<5:43:15,  3.41it/s]
 81%|████████  | 301270/371472 [1:48:21<5:36:23,  3.48it/s]
 81%|████████  | 301271/371472 [1:48:21<5:44:34,  3.40it/s]
 81%|████████  | 301272/371472 [1:48:21<5:31:08,  3.53it/s]
 81%|████████  | 301273/371472 [1:48:22<5:21:47,  3.64it/s]
 81%|████████  | 301274/371472 [1:48:22<5:26:19,  3.59it/s]
 81%|████████  | 301275/371472 [1:48:22<5:16:49,  3.69it/s]
 81%|████████  | 301276/371472 [1:48:22<5:13:39,  3.73it/s]
 81%|████████  | 301277/371472 [1:48:23<5:12:04,  3.75it/s]
 81%|████████  | 301278/371472 [1:48:23<5:31:44,  3.53it/s]
 81%|████████  | 301279/371472 [1:48:23<5:46:24,  3.38it/s]
 81%|████████  | 301280/371472 [1:48:24<5:50:01,  3.34it/s]
                                                           
{'loss': 2.6305, 'learning_rate': 2.7015234114072705e-07, 'epoch': 12.98}

 81%|████████  | 301280/371472 [1:48:24<5:50:01,  3.34it/s]
 81%|████████  | 301281/371472 [1:48:24<5:41:52,  3.42it/s]
 81%|████████  | 301282/371472 [1:48:24<5:49:46,  3.34it/s]
 81%|████████  | 301283/371472 [1:48:24<5:35:51,  3.48it/s]
 81%|████████  | 301284/371472 [1:48:25<5:41:48,  3.42it/s]
 81%|████████  | 301285/371472 [1:48:25<5:46:09,  3.38it/s]
 81%|████████  | 301286/371472 [1:48:25<5:38:55,  3.45it/s]
 81%|████████  | 301287/371472 [1:48:26<5:17:57,  3.68it/s]
 81%|████████  | 301288/371472 [1:48:26<5:20:36,  3.65it/s]
 81%|████████  | 301289/371472 [1:48:26<5:11:59,  3.75it/s]
 81%|████████  | 301290/371472 [1:48:26<5:45:51,  3.38it/s]
 81%|████████  | 301291/371472 [1:48:27<5:38:36,  3.45it/s]
 81%|████████  | 301292/371472 [1:48:27<5:29:11,  3.55it/s]
 81%|████████  | 301293/371472 [1:48:27<5:20:54,  3.64it/s]
 81%|████████  | 301294/371472 [1:48:27<5:16:52,  3.69it/s]
 81%|████████  | 301295/371472 [1:48:28<5:19:44,  3.66it/s]
 81%|████████  | 301296/371472 [1:48:28<5:29:09,  3.55it/s]
 81%|████████  | 301297/371472 [1:48:28<5:39:53,  3.44it/s]
 81%|████████  | 301298/371472 [1:48:29<5:46:45,  3.37it/s]
 81%|████████  | 301299/371472 [1:48:29<5:56:39,  3.28it/s]
 81%|████████  | 301300/371472 [1:48:29<6:07:00,  3.19it/s]
                                                           
{'loss': 2.5864, 'learning_rate': 2.7010385916524807e-07, 'epoch': 12.98}

 81%|████████  | 301300/371472 [1:48:29<6:07:00,  3.19it/s]
 81%|████████  | 301301/371472 [1:48:30<6:46:57,  2.87it/s]
 81%|████████  | 301302/371472 [1:48:30<6:23:18,  3.05it/s]
 81%|████████  | 301303/371472 [1:48:30<5:54:12,  3.30it/s]
 81%|████████  | 301304/371472 [1:48:31<5:49:11,  3.35it/s]
 81%|████████  | 301305/371472 [1:48:31<5:48:40,  3.35it/s]
 81%|████████  | 301306/371472 [1:48:31<5:44:40,  3.39it/s]
 81%|████████  | 301307/371472 [1:48:31<5:37:05,  3.47it/s]
 81%|████████  | 301308/371472 [1:48:32<5:57:33,  3.27it/s]
 81%|████████  | 301309/371472 [1:48:32<5:46:37,  3.37it/s]
 81%|████████  | 301310/371472 [1:48:32<5:56:54,  3.28it/s]
 81%|████████  | 301311/371472 [1:48:33<5:40:08,  3.44it/s]
 81%|████████  | 301312/371472 [1:48:33<5:44:20,  3.40it/s]
 81%|████████  | 301313/371472 [1:48:33<5:39:53,  3.44it/s]
 81%|████████  | 301314/371472 [1:48:33<5:37:14,  3.47it/s]
 81%|████████  | 301315/371472 [1:48:34<5:22:16,  3.63it/s]
 81%|████████  | 301316/371472 [1:48:34<5:17:24,  3.68it/s]
 81%|████████  | 301317/371472 [1:48:34<5:12:05,  3.75it/s]
 81%|████████  | 301318/371472 [1:48:35<5:17:17,  3.69it/s]
 81%|████████  | 301319/371472 [1:48:35<5:52:08,  3.32it/s]
 81%|████████  | 301320/371472 [1:48:35<5:52:32,  3.32it/s]
                                                           
{'loss': 2.6463, 'learning_rate': 2.7005537718976924e-07, 'epoch': 12.98}

 81%|████████  | 301320/371472 [1:48:35<5:52:32,  3.32it/s]
 81%|████████  | 301321/371472 [1:48:36<5:51:32,  3.33it/s]
 81%|████████  | 301322/371472 [1:48:36<5:41:38,  3.42it/s]
 81%|████████  | 301323/371472 [1:48:36<5:52:27,  3.32it/s]
 81%|████████  | 301324/371472 [1:48:36<5:41:02,  3.43it/s]
 81%|████████  | 301325/371472 [1:48:37<5:26:48,  3.58it/s]
 81%|████████  | 301326/371472 [1:48:37<5:24:12,  3.61it/s]
 81%|████████  | 301327/371472 [1:48:37<5:54:42,  3.30it/s]
 81%|████████  | 301328/371472 [1:48:38<6:04:09,  3.21it/s]
 81%|████████  | 301329/371472 [1:48:38<6:01:28,  3.23it/s]
 81%|████████  | 301330/371472 [1:48:38<6:01:19,  3.24it/s]
 81%|████████  | 301331/371472 [1:48:38<5:51:58,  3.32it/s]
 81%|████████  | 301332/371472 [1:48:39<5:41:40,  3.42it/s]
 81%|████████  | 301333/371472 [1:48:39<5:41:14,  3.43it/s]
 81%|████████  | 301334/371472 [1:48:39<5:33:49,  3.50it/s]
 81%|████████  | 301335/371472 [1:48:40<5:42:41,  3.41it/s]
 81%|████████  | 301336/371472 [1:48:40<5:42:48,  3.41it/s]
 81%|████████  | 301337/371472 [1:48:40<5:21:33,  3.64it/s]
 81%|████████  | 301338/371472 [1:48:40<5:13:44,  3.73it/s]
 81%|████████  | 301339/371472 [1:48:41<5:06:06,  3.82it/s]
 81%|████████  | 301340/371472 [1:48:41<4:58:15,  3.92it/s]
                                                           
{'loss': 2.5249, 'learning_rate': 2.700068952142903e-07, 'epoch': 12.98}

 81%|████████  | 301340/371472 [1:48:41<4:58:15,  3.92it/s]
 81%|████████  | 301341/371472 [1:48:41<5:07:51,  3.80it/s]
 81%|████████  | 301342/371472 [1:48:41<5:03:21,  3.85it/s]
 81%|████████  | 301343/371472 [1:48:42<5:02:13,  3.87it/s]
 81%|████████  | 301344/371472 [1:48:42<5:21:57,  3.63it/s]
 81%|████████  | 301345/371472 [1:48:42<5:13:49,  3.72it/s]
 81%|████████  | 301346/371472 [1:48:43<5:31:04,  3.53it/s]
 81%|████████  | 301347/371472 [1:48:43<5:31:45,  3.52it/s]
 81%|████████  | 301348/371472 [1:48:43<5:21:09,  3.64it/s]
 81%|████████  | 301349/371472 [1:48:43<5:45:34,  3.38it/s]
 81%|████████  | 301350/371472 [1:48:44<5:32:59,  3.51it/s]
 81%|████████  | 301351/371472 [1:48:44<5:24:21,  3.60it/s]
 81%|████████  | 301352/371472 [1:48:44<5:20:55,  3.64it/s]
 81%|████████  | 301353/371472 [1:48:45<5:17:10,  3.68it/s]
 81%|████████  | 301354/371472 [1:48:45<5:19:56,  3.65it/s]
 81%|████████  | 301355/371472 [1:48:45<5:09:41,  3.77it/s]
 81%|████████  | 301356/371472 [1:48:45<5:33:51,  3.50it/s]
 81%|████████  | 301357/371472 [1:48:46<5:41:24,  3.42it/s]
 81%|████████  | 301358/371472 [1:48:46<5:42:43,  3.41it/s]
 81%|████████  | 301359/371472 [1:48:46<5:51:22,  3.33it/s]
 81%|████████  | 301360/371472 [1:48:47<5:46:14,  3.37it/s]
                                                           
{'loss': 2.6206, 'learning_rate': 2.699584132388114e-07, 'epoch': 12.98}

 81%|████████  | 301360/371472 [1:48:47<5:46:14,  3.37it/s]
 81%|████████  | 301361/371472 [1:48:47<5:57:03,  3.27it/s]
 81%|████████  | 301362/371472 [1:48:47<5:37:29,  3.46it/s]
 81%|████████  | 301363/371472 [1:48:47<5:29:08,  3.55it/s]
 81%|████████  | 301364/371472 [1:48:48<5:13:26,  3.73it/s]
 81%|████████  | 301365/371472 [1:48:48<5:02:16,  3.87it/s]
 81%|████████  | 301366/371472 [1:48:48<5:18:50,  3.66it/s]
 81%|████████  | 301367/371472 [1:48:49<5:44:23,  3.39it/s]
 81%|████████  | 301368/371472 [1:48:49<5:26:50,  3.57it/s]
 81%|████████  | 301369/371472 [1:48:49<5:23:24,  3.61it/s]
 81%|████████  | 301370/371472 [1:48:49<5:30:20,  3.54it/s]
 81%|████████  | 301371/371472 [1:48:50<5:34:50,  3.49it/s]
 81%|████████  | 301372/371472 [1:48:50<5:36:50,  3.47it/s]
 81%|████████  | 301373/371472 [1:48:50<5:32:01,  3.52it/s]
 81%|████████  | 301374/371472 [1:48:51<5:36:25,  3.47it/s]
 81%|████████  | 301375/371472 [1:48:51<5:23:59,  3.61it/s]
 81%|████████  | 301376/371472 [1:48:51<5:13:26,  3.73it/s]
 81%|████████  | 301377/371472 [1:48:51<5:17:57,  3.67it/s]
 81%|████████  | 301378/371472 [1:48:52<5:28:21,  3.56it/s]
 81%|████████  | 301379/371472 [1:48:52<5:33:26,  3.50it/s]
 81%|████████  | 301380/371472 [1:48:52<5:27:53,  3.56it/s]
                                                           
{'loss': 2.7297, 'learning_rate': 2.6990993126333256e-07, 'epoch': 12.98}

 81%|████████  | 301380/371472 [1:48:52<5:27:53,  3.56it/s]
 81%|████████  | 301381/371472 [1:48:52<5:40:05,  3.43it/s]
 81%|████████  | 301382/371472 [1:48:53<5:43:45,  3.40it/s]
 81%|████████  | 301383/371472 [1:48:53<5:34:32,  3.49it/s]
 81%|████████  | 301384/371472 [1:48:53<5:19:18,  3.66it/s]
 81%|████████  | 301385/371472 [1:48:54<5:22:26,  3.62it/s]
 81%|████████  | 301386/371472 [1:48:54<5:26:43,  3.58it/s]
 81%|████████  | 301387/371472 [1:48:54<5:35:51,  3.48it/s]
 81%|████████  | 301388/371472 [1:48:54<5:31:31,  3.52it/s]
 81%|████████  | 301389/371472 [1:48:55<5:37:15,  3.46it/s]
 81%|████████  | 301390/371472 [1:48:55<5:37:38,  3.46it/s]
 81%|████████  | 301391/371472 [1:48:55<5:21:32,  3.63it/s]
 81%|████████  | 301392/371472 [1:48:56<5:46:49,  3.37it/s]
 81%|████████  | 301393/371472 [1:48:56<5:32:59,  3.51it/s]
 81%|████████  | 301394/371472 [1:48:56<5:29:47,  3.54it/s]
 81%|████████  | 301395/371472 [1:48:56<5:47:47,  3.36it/s]
 81%|████████  | 301396/371472 [1:48:57<5:54:37,  3.29it/s]
 81%|████████  | 301397/371472 [1:48:57<5:45:30,  3.38it/s]
 81%|████████  | 301398/371472 [1:48:57<5:30:43,  3.53it/s]
 81%|████████  | 301399/371472 [1:48:58<5:40:56,  3.43it/s]
 81%|████████  | 301400/371472 [1:48:58<5:52:39,  3.31it/s]
                                                           
{'loss': 2.6632, 'learning_rate': 2.698614492878536e-07, 'epoch': 12.98}

 81%|████████  | 301400/371472 [1:48:58<5:52:39,  3.31it/s]
 81%|████████  | 301401/371472 [1:48:58<5:58:48,  3.25it/s]
 81%|████████  | 301402/371472 [1:48:59<6:21:45,  3.06it/s]
 81%|████████  | 301403/371472 [1:48:59<5:55:49,  3.28it/s]
 81%|████████  | 301404/371472 [1:48:59<5:43:22,  3.40it/s]
 81%|████████  | 301405/371472 [1:48:59<5:41:44,  3.42it/s]
 81%|████████  | 301406/371472 [1:49:00<5:58:40,  3.26it/s]
 81%|████████  | 301407/371472 [1:49:00<6:02:17,  3.22it/s]
 81%|████████  | 301408/371472 [1:49:00<5:53:55,  3.30it/s]
 81%|████████  | 301409/371472 [1:49:01<6:11:12,  3.15it/s]
 81%|████████  | 301410/371472 [1:49:01<6:05:24,  3.20it/s]
 81%|████████  | 301411/371472 [1:49:01<5:42:30,  3.41it/s]
 81%|████████  | 301412/371472 [1:49:02<5:31:15,  3.52it/s]
 81%|████████  | 301413/371472 [1:49:02<5:16:13,  3.69it/s]
 81%|████████  | 301414/371472 [1:49:02<5:18:57,  3.66it/s]
 81%|████████  | 301415/371472 [1:49:02<5:33:04,  3.51it/s]
 81%|████████  | 301416/371472 [1:49:03<5:31:04,  3.53it/s]
 81%|████████  | 301417/371472 [1:49:03<5:45:36,  3.38it/s]
 81%|████████  | 301418/371472 [1:49:03<5:46:13,  3.37it/s]
 81%|████████  | 301419/371472 [1:49:04<5:24:50,  3.59it/s]
 81%|████████  | 301420/371472 [1:49:04<5:11:28,  3.75it/s]
                                                           
{'loss': 2.7352, 'learning_rate': 2.6981296731237476e-07, 'epoch': 12.98}

 81%|████████  | 301420/371472 [1:49:04<5:11:28,  3.75it/s]
 81%|████████  | 301421/371472 [1:49:04<5:33:33,  3.50it/s]
 81%|████████  | 301422/371472 [1:49:04<5:59:20,  3.25it/s]
 81%|████████  | 301423/371472 [1:49:05<5:52:49,  3.31it/s]
 81%|████████  | 301424/371472 [1:49:05<5:36:27,  3.47it/s]
 81%|████████  | 301425/371472 [1:49:05<5:21:52,  3.63it/s]
 81%|████████  | 301426/371472 [1:49:06<5:22:33,  3.62it/s]
 81%|████████  | 301427/371472 [1:49:06<5:27:56,  3.56it/s]
 81%|████████  | 301428/371472 [1:49:06<5:30:16,  3.53it/s]
 81%|████████  | 301429/371472 [1:49:06<5:22:17,  3.62it/s]
 81%|████████  | 301430/371472 [1:49:07<5:10:30,  3.76it/s]
 81%|████████  | 301431/371472 [1:49:07<5:23:10,  3.61it/s]
 81%|████████  | 301432/371472 [1:49:07<5:16:03,  3.69it/s]
 81%|████████  | 301433/371472 [1:49:07<5:16:33,  3.69it/s]
 81%|████████  | 301434/371472 [1:49:08<5:17:18,  3.68it/s]
 81%|████████  | 301435/371472 [1:49:08<5:09:27,  3.77it/s]
 81%|████████  | 301436/371472 [1:49:08<5:21:31,  3.63it/s]
 81%|████████  | 301437/371472 [1:49:09<5:19:33,  3.65it/s]
 81%|████████  | 301438/371472 [1:49:09<5:45:06,  3.38it/s]
 81%|████████  | 301439/371472 [1:49:09<5:43:41,  3.40it/s]
 81%|████████  | 301440/371472 [1:49:09<5:43:41,  3.40it/s]
                                                           
{'loss': 2.7319, 'learning_rate': 2.697644853368958e-07, 'epoch': 12.98}

 81%|████████  | 301440/371472 [1:49:09<5:43:41,  3.40it/s]
 81%|████████  | 301441/371472 [1:49:10<5:29:58,  3.54it/s]
 81%|████████  | 301442/371472 [1:49:10<5:29:01,  3.55it/s]
 81%|████████  | 301443/371472 [1:49:10<5:17:10,  3.68it/s]
 81%|████████  | 301444/371472 [1:49:11<5:14:39,  3.71it/s]
 81%|████████  | 301445/371472 [1:49:11<5:15:36,  3.70it/s]
 81%|████████  | 301446/371472 [1:49:11<5:38:04,  3.45it/s]
 81%|████████  | 301447/371472 [1:49:11<5:49:18,  3.34it/s]
 81%|████████  | 301448/371472 [1:49:12<5:48:53,  3.34it/s]
 81%|████████  | 301449/371472 [1:49:12<5:39:09,  3.44it/s]
 81%|████████  | 301450/371472 [1:49:12<5:36:51,  3.46it/s]
 81%|████████  | 301451/371472 [1:49:13<5:40:55,  3.42it/s]
 81%|████████  | 301452/371472 [1:49:13<6:16:17,  3.10it/s]
 81%|████████  | 301453/371472 [1:49:13<5:59:31,  3.25it/s]
 81%|████████  | 301454/371472 [1:49:14<5:59:31,  3.25it/s]
 81%|████████  | 301455/371472 [1:49:14<6:11:06,  3.14it/s]
 81%|████████  | 301456/371472 [1:49:14<5:51:19,  3.32it/s]
 81%|████████  | 301457/371472 [1:49:14<5:41:22,  3.42it/s]
 81%|████████  | 301458/371472 [1:49:15<5:45:09,  3.38it/s]
 81%|████████  | 301459/371472 [1:49:15<5:35:58,  3.47it/s]
 81%|████████  | 301460/371472 [1:49:15<5:35:36,  3.48it/s]
                                                           
{'loss': 2.6456, 'learning_rate': 2.6971600336141696e-07, 'epoch': 12.98}

 81%|████████  | 301460/371472 [1:49:15<5:35:36,  3.48it/s]
 81%|████████  | 301461/371472 [1:49:16<5:38:05,  3.45it/s]
 81%|████████  | 301462/371472 [1:49:16<5:25:16,  3.59it/s]
 81%|████████  | 301463/371472 [1:49:16<5:30:29,  3.53it/s]
 81%|████████  | 301464/371472 [1:49:16<5:18:55,  3.66it/s]
 81%|████████  | 301465/371472 [1:49:17<5:17:38,  3.67it/s]
 81%|████████  | 301466/371472 [1:49:17<5:20:41,  3.64it/s]
 81%|████████  | 301467/371472 [1:49:17<5:24:57,  3.59it/s]
 81%|████████  | 301468/371472 [1:49:18<5:25:00,  3.59it/s]
 81%|████████  | 301469/371472 [1:49:18<5:38:56,  3.44it/s]
 81%|████████  | 301470/371472 [1:49:18<6:07:28,  3.17it/s]
 81%|████████  | 301471/371472 [1:49:19<5:57:29,  3.26it/s]
 81%|████████  | 301472/371472 [1:49:19<5:52:09,  3.31it/s]
 81%|████████  | 301473/371472 [1:49:19<6:41:33,  2.91it/s]
 81%|████████  | 301474/371472 [1:49:20<6:13:08,  3.13it/s]
 81%|████████  | 301475/371472 [1:49:20<5:50:44,  3.33it/s]
 81%|████████  | 301476/371472 [1:49:20<5:39:07,  3.44it/s]
 81%|████████  | 301477/371472 [1:49:20<5:49:42,  3.34it/s]
 81%|████████  | 301478/371472 [1:49:21<5:32:04,  3.51it/s]
 81%|████████  | 301479/371472 [1:49:21<5:20:07,  3.64it/s]
 81%|████████  | 301480/371472 [1:49:21<5:21:26,  3.63it/s]
                                                           
{'loss': 2.7005, 'learning_rate': 2.6966752138593803e-07, 'epoch': 12.99}

 81%|████████  | 301480/371472 [1:49:21<5:21:26,  3.63it/s]
 81%|████████  | 301481/371472 [1:49:21<5:34:31,  3.49it/s]
 81%|████████  | 301482/371472 [1:49:22<5:20:57,  3.63it/s]
 81%|████████  | 301483/371472 [1:49:22<5:22:31,  3.62it/s]
 81%|████████  | 301484/371472 [1:49:22<5:17:07,  3.68it/s]
 81%|████████  | 301485/371472 [1:49:23<5:28:58,  3.55it/s]
 81%|████████  | 301486/371472 [1:49:23<5:23:20,  3.61it/s]
 81%|████████  | 301487/371472 [1:49:23<5:47:08,  3.36it/s]
 81%|████████  | 301488/371472 [1:49:23<5:32:08,  3.51it/s]
 81%|████████  | 301489/371472 [1:49:24<5:33:26,  3.50it/s]
 81%|████████  | 301490/371472 [1:49:24<5:32:40,  3.51it/s]
 81%|████████  | 301491/371472 [1:49:24<5:21:02,  3.63it/s]
 81%|████████  | 301492/371472 [1:49:25<5:20:39,  3.64it/s]
 81%|████████  | 301493/371472 [1:49:25<5:20:23,  3.64it/s]
 81%|████████  | 301494/371472 [1:49:25<5:28:35,  3.55it/s]
 81%|████████  | 301495/371472 [1:49:25<5:31:57,  3.51it/s]
 81%|████████  | 301496/371472 [1:49:26<5:21:06,  3.63it/s]
 81%|████████  | 301497/371472 [1:49:26<5:22:21,  3.62it/s]
 81%|████████  | 301498/371472 [1:49:26<5:27:05,  3.57it/s]
 81%|████████  | 301499/371472 [1:49:26<5:22:35,  3.62it/s]
 81%|████████  | 301500/371472 [1:49:27<5:59:49,  3.24it/s]
                                                           
{'loss': 2.6033, 'learning_rate': 2.696190394104592e-07, 'epoch': 12.99}

 81%|████████  | 301500/371472 [1:49:27<5:59:49,  3.24it/s]
 81%|████████  | 301501/371472 [1:49:27<6:10:14,  3.15it/s]
 81%|████████  | 301502/371472 [1:49:28<6:18:28,  3.08it/s]
 81%|████████  | 301503/371472 [1:49:28<6:01:01,  3.23it/s]
 81%|████████  | 301504/371472 [1:49:28<5:40:48,  3.42it/s]
 81%|████████  | 301505/371472 [1:49:28<5:39:39,  3.43it/s]
 81%|████████  | 301506/371472 [1:49:29<5:39:44,  3.43it/s]
 81%|████████  | 301507/371472 [1:49:29<5:35:28,  3.48it/s]
 81%|████████  | 301508/371472 [1:49:29<5:26:57,  3.57it/s]
 81%|████████  | 301509/371472 [1:49:29<5:21:12,  3.63it/s]
 81%|████████  | 301510/371472 [1:49:30<5:09:51,  3.76it/s]
 81%|████████  | 301511/371472 [1:49:30<5:49:54,  3.33it/s]
 81%|████████  | 301512/371472 [1:49:30<5:42:45,  3.40it/s]
 81%|████████  | 301513/371472 [1:49:31<5:53:51,  3.30it/s]
 81%|████████  | 301514/371472 [1:49:31<5:48:27,  3.35it/s]
 81%|████████  | 301515/371472 [1:49:31<5:57:48,  3.26it/s]
 81%|████████  | 301516/371472 [1:49:32<5:44:14,  3.39it/s]
 81%|████████  | 301517/371472 [1:49:32<5:59:10,  3.25it/s]
 81%|████████  | 301518/371472 [1:49:32<6:03:05,  3.21it/s]
 81%|████████  | 301519/371472 [1:49:32<5:43:57,  3.39it/s]
 81%|████████  | 301520/371472 [1:49:33<5:34:41,  3.48it/s]
                                                           
{'loss': 2.6314, 'learning_rate': 2.695705574349802e-07, 'epoch': 12.99}

 81%|████████  | 301520/371472 [1:49:33<5:34:41,  3.48it/s]
 81%|████████  | 301521/371472 [1:49:33<5:21:23,  3.63it/s]
 81%|████████  | 301522/371472 [1:49:33<5:14:53,  3.70it/s]
 81%|████████  | 301523/371472 [1:49:33<5:08:36,  3.78it/s]
 81%|████████  | 301524/371472 [1:49:34<5:06:31,  3.80it/s]
 81%|████████  | 301525/371472 [1:49:34<5:16:57,  3.68it/s]
 81%|████████  | 301526/371472 [1:49:34<5:05:37,  3.81it/s]
 81%|████████  | 301527/371472 [1:49:35<5:03:53,  3.84it/s]
 81%|████████  | 301528/371472 [1:49:35<4:58:59,  3.90it/s]
 81%|████████  | 301529/371472 [1:49:35<5:14:13,  3.71it/s]
 81%|████████  | 301530/371472 [1:49:35<5:10:16,  3.76it/s]
 81%|████████  | 301531/371472 [1:49:36<5:07:01,  3.80it/s]
 81%|████████  | 301532/371472 [1:49:36<5:08:24,  3.78it/s]
 81%|████████  | 301533/371472 [1:49:36<5:19:22,  3.65it/s]
 81%|████████  | 301534/371472 [1:49:36<5:22:37,  3.61it/s]
 81%|████████  | 301535/371472 [1:49:37<5:16:42,  3.68it/s]
 81%|████████  | 301536/371472 [1:49:37<5:11:37,  3.74it/s]
 81%|████████  | 301537/371472 [1:49:37<5:17:43,  3.67it/s]
 81%|████████  | 301538/371472 [1:49:38<5:39:46,  3.43it/s]
 81%|████████  | 301539/371472 [1:49:38<5:28:25,  3.55it/s]
 81%|████████  | 301540/371472 [1:49:38<5:18:12,  3.66it/s]
                                                           
{'loss': 2.5994, 'learning_rate': 2.695220754595014e-07, 'epoch': 12.99}

 81%|████████  | 301540/371472 [1:49:38<5:18:12,  3.66it/s]
 81%|████████  | 301541/371472 [1:49:38<5:20:02,  3.64it/s]
 81%|████████  | 301542/371472 [1:49:39<5:13:30,  3.72it/s]
 81%|████████  | 301543/371472 [1:49:39<5:32:04,  3.51it/s]
 81%|████████  | 301544/371472 [1:49:39<5:46:15,  3.37it/s]
 81%|████████  | 301545/371472 [1:49:40<5:30:40,  3.52it/s]
 81%|████████  | 301546/371472 [1:49:40<5:23:42,  3.60it/s]
 81%|████████  | 301547/371472 [1:49:40<5:15:12,  3.70it/s]
 81%|████████  | 301548/371472 [1:49:40<5:51:46,  3.31it/s]
 81%|████████  | 301549/371472 [1:49:41<5:41:45,  3.41it/s]
 81%|████████  | 301550/371472 [1:49:41<5:54:26,  3.29it/s]
 81%|████████  | 301551/371472 [1:49:41<6:09:31,  3.15it/s]
 81%|████████  | 301552/371472 [1:49:42<5:50:53,  3.32it/s]
 81%|████████  | 301553/371472 [1:49:42<5:47:39,  3.35it/s]
 81%|████████  | 301554/371472 [1:49:42<5:31:13,  3.52it/s]
 81%|████████  | 301555/371472 [1:49:42<5:19:03,  3.65it/s]
 81%|████████  | 301556/371472 [1:49:43<5:28:25,  3.55it/s]
 81%|████████  | 301557/371472 [1:49:43<5:17:53,  3.67it/s]
 81%|████████  | 301558/371472 [1:49:43<5:43:39,  3.39it/s]
 81%|████████  | 301559/371472 [1:49:44<5:34:22,  3.48it/s]
 81%|████████  | 301560/371472 [1:49:44<5:35:55,  3.47it/s]
                                                           
{'loss': 2.643, 'learning_rate': 2.694735934840224e-07, 'epoch': 12.99}

 81%|████████  | 301560/371472 [1:49:44<5:35:55,  3.47it/s]
 81%|████████  | 301561/371472 [1:49:44<5:35:26,  3.47it/s]
 81%|████████  | 301562/371472 [1:49:44<5:30:19,  3.53it/s]
 81%|████████  | 301563/371472 [1:49:45<5:26:19,  3.57it/s]
 81%|████████  | 301564/371472 [1:49:45<5:40:22,  3.42it/s]
 81%|████████  | 301565/371472 [1:49:45<5:49:58,  3.33it/s]
 81%|████████  | 301566/371472 [1:49:46<5:28:26,  3.55it/s]
 81%|████████  | 301567/371472 [1:49:46<5:41:58,  3.41it/s]
 81%|████████  | 301568/371472 [1:49:46<5:45:32,  3.37it/s]
 81%|████████  | 301569/371472 [1:49:47<6:11:06,  3.14it/s]
 81%|████████  | 301570/371472 [1:49:47<5:47:16,  3.35it/s]
 81%|████████  | 301571/371472 [1:49:47<5:39:03,  3.44it/s]
 81%|████████  | 301572/371472 [1:49:47<5:24:01,  3.60it/s]
 81%|████████  | 301573/371472 [1:49:48<5:17:33,  3.67it/s]
 81%|████████  | 301574/371472 [1:49:48<5:12:56,  3.72it/s]
 81%|████████  | 301575/371472 [1:49:48<5:29:06,  3.54it/s]
 81%|████████  | 301576/371472 [1:49:48<5:30:10,  3.53it/s]
 81%|████████  | 301577/371472 [1:49:49<5:52:21,  3.31it/s]
 81%|████████  | 301578/371472 [1:49:49<5:36:07,  3.47it/s]
 81%|████████  | 301579/371472 [1:49:49<6:04:59,  3.19it/s]
 81%|████████  | 301580/371472 [1:49:50<5:39:25,  3.43it/s]
                                                           
{'loss': 2.7575, 'learning_rate': 2.694251115085436e-07, 'epoch': 12.99}

 81%|████████  | 301580/371472 [1:49:50<5:39:25,  3.43it/s]
 81%|████████  | 301581/371472 [1:49:50<5:49:10,  3.34it/s]
 81%|████████  | 301582/371472 [1:49:50<5:36:26,  3.46it/s]
 81%|████████  | 301583/371472 [1:49:51<5:26:21,  3.57it/s]
 81%|████████  | 301584/371472 [1:49:51<5:20:12,  3.64it/s]
 81%|████████  | 301585/371472 [1:49:51<5:35:27,  3.47it/s]
 81%|████████  | 301586/371472 [1:49:51<5:28:17,  3.55it/s]
 81%|████████  | 301587/371472 [1:49:52<5:23:42,  3.60it/s]
 81%|████████  | 301588/371472 [1:49:52<5:29:07,  3.54it/s]
 81%|████████  | 301589/371472 [1:49:52<5:36:51,  3.46it/s]
 81%|████████  | 301590/371472 [1:49:53<5:23:44,  3.60it/s]
 81%|████████  | 301591/371472 [1:49:53<5:31:33,  3.51it/s]
 81%|████████  | 301592/371472 [1:49:53<5:22:22,  3.61it/s]
 81%|████████  | 301593/371472 [1:49:53<5:06:47,  3.80it/s]
 81%|████████  | 301594/371472 [1:49:54<5:01:27,  3.86it/s]
 81%|████████  | 301595/371472 [1:49:54<5:20:11,  3.64it/s]
 81%|████████  | 301596/371472 [1:49:54<5:40:52,  3.42it/s]
 81%|████████  | 301597/371472 [1:49:54<5:28:31,  3.54it/s]
 81%|████████  | 301598/371472 [1:49:55<5:30:46,  3.52it/s]
 81%|████████  | 301599/371472 [1:49:55<5:23:56,  3.59it/s]
 81%|████████  | 301600/371472 [1:49:55<5:25:45,  3.57it/s]
                                                           
{'loss': 2.6093, 'learning_rate': 2.6937662953306467e-07, 'epoch': 12.99}

 81%|████████  | 301600/371472 [1:49:55<5:25:45,  3.57it/s]
 81%|████████  | 301601/371472 [1:49:56<5:31:56,  3.51it/s]
 81%|████████  | 301602/371472 [1:49:56<5:29:06,  3.54it/s]
 81%|████████  | 301603/371472 [1:49:56<5:40:40,  3.42it/s]
 81%|████████  | 301604/371472 [1:49:56<5:30:04,  3.53it/s]
 81%|████████  | 301605/371472 [1:49:57<5:49:03,  3.34it/s]
 81%|████████  | 301606/371472 [1:49:57<5:27:08,  3.56it/s]
 81%|████████  | 301607/371472 [1:49:57<5:20:15,  3.64it/s]
 81%|████████  | 301608/371472 [1:49:58<5:15:32,  3.69it/s]
 81%|████████  | 301609/371472 [1:49:58<5:20:01,  3.64it/s]
 81%|████████  | 301610/371472 [1:49:58<5:31:27,  3.51it/s]
 81%|████████  | 301611/371472 [1:49:58<5:19:16,  3.65it/s]
 81%|████████  | 301612/371472 [1:49:59<5:18:03,  3.66it/s]
 81%|████████  | 301613/371472 [1:49:59<5:19:06,  3.65it/s]
 81%|████████  | 301614/371472 [1:49:59<5:41:56,  3.40it/s]
 81%|████████  | 301615/371472 [1:50:00<5:41:15,  3.41it/s]
 81%|████████  | 301616/371472 [1:50:00<5:44:14,  3.38it/s]
 81%|████████  | 301617/371472 [1:50:00<6:00:02,  3.23it/s]
 81%|████████  | 301618/371472 [1:50:00<5:36:19,  3.46it/s]
 81%|████████  | 301619/371472 [1:50:01<5:15:50,  3.69it/s]
 81%|████████  | 301620/371472 [1:50:01<5:12:11,  3.73it/s]
                                                           
{'loss': 2.6586, 'learning_rate': 2.6932814755758585e-07, 'epoch': 12.99}

 81%|████████  | 301620/371472 [1:50:01<5:12:11,  3.73it/s]
 81%|████████  | 301621/371472 [1:50:01<5:21:50,  3.62it/s]
 81%|████████  | 301622/371472 [1:50:01<5:13:13,  3.72it/s]
 81%|████████  | 301623/371472 [1:50:02<5:16:46,  3.68it/s]
 81%|████████  | 301624/371472 [1:50:02<5:24:13,  3.59it/s]
 81%|████████  | 301625/371472 [1:50:02<5:20:39,  3.63it/s]
 81%|████████  | 301626/371472 [1:50:03<5:23:28,  3.60it/s]
 81%|████████  | 301627/371472 [1:50:03<6:01:49,  3.22it/s]
 81%|████████  | 301628/371472 [1:50:03<5:49:23,  3.33it/s]
 81%|████████  | 301629/371472 [1:50:04<5:58:48,  3.24it/s]
 81%|████████  | 301630/371472 [1:50:04<5:40:23,  3.42it/s]
 81%|████████  | 301631/371472 [1:50:04<5:34:50,  3.48it/s]
 81%|████████  | 301632/371472 [1:50:04<5:53:34,  3.29it/s]
 81%|████████  | 301633/371472 [1:50:05<5:41:28,  3.41it/s]
 81%|████████  | 301634/371472 [1:50:05<5:26:29,  3.57it/s]
 81%|████████  | 301635/371472 [1:50:05<5:29:25,  3.53it/s]
 81%|████████  | 301636/371472 [1:50:06<5:31:52,  3.51it/s]
 81%|████████  | 301637/371472 [1:50:06<5:38:01,  3.44it/s]
 81%|████████  | 301638/371472 [1:50:06<5:43:57,  3.38it/s]
 81%|████████  | 301639/371472 [1:50:06<5:52:34,  3.30it/s]
 81%|████████  | 301640/371472 [1:50:07<5:39:13,  3.43it/s]
                                                           
{'loss': 2.5421, 'learning_rate': 2.692796655821069e-07, 'epoch': 12.99}

 81%|████████  | 301640/371472 [1:50:07<5:39:13,  3.43it/s]
 81%|████████  | 301641/371472 [1:50:07<6:04:16,  3.20it/s]
 81%|████████  | 301642/371472 [1:50:07<5:50:32,  3.32it/s]
 81%|████████  | 301643/371472 [1:50:08<5:28:58,  3.54it/s]
 81%|████████  | 301644/371472 [1:50:08<5:55:02,  3.28it/s]
 81%|████████  | 301645/371472 [1:50:08<6:05:30,  3.18it/s]
 81%|████████  | 301646/371472 [1:50:09<6:26:03,  3.01it/s]
 81%|████████  | 301647/371472 [1:50:09<6:19:08,  3.07it/s]
 81%|████████  | 301648/371472 [1:50:09<6:06:50,  3.17it/s]
 81%|████████  | 301649/371472 [1:50:10<5:50:42,  3.32it/s]
 81%|████████  | 301650/371472 [1:50:10<5:50:58,  3.32it/s]
 81%|████████  | 301651/371472 [1:50:10<5:36:25,  3.46it/s]
 81%|████████  | 301652/371472 [1:50:10<5:27:56,  3.55it/s]
 81%|████████  | 301653/371472 [1:50:11<5:37:33,  3.45it/s]
 81%|████████  | 301654/371472 [1:50:11<5:29:30,  3.53it/s]
 81%|████████  | 301655/371472 [1:50:11<5:24:52,  3.58it/s]
 81%|████████  | 301656/371472 [1:50:12<5:15:35,  3.69it/s]
 81%|████████  | 301657/371472 [1:50:12<5:19:25,  3.64it/s]
 81%|████████  | 301658/371472 [1:50:12<5:52:05,  3.30it/s]
 81%|████████  | 301659/371472 [1:50:12<5:42:55,  3.39it/s]
 81%|████████  | 301660/371472 [1:50:13<5:35:48,  3.46it/s]
                                                           
{'loss': 2.6485, 'learning_rate': 2.6923118360662804e-07, 'epoch': 12.99}

 81%|████████  | 301660/371472 [1:50:13<5:35:48,  3.46it/s]
 81%|████████  | 301661/371472 [1:50:13<5:29:20,  3.53it/s]
 81%|████████  | 301662/371472 [1:50:13<5:22:21,  3.61it/s]
 81%|████████  | 301663/371472 [1:50:14<5:27:55,  3.55it/s]
 81%|████████  | 301664/371472 [1:50:14<5:16:28,  3.68it/s]
 81%|████████  | 301665/371472 [1:50:14<5:11:54,  3.73it/s]
 81%|████████  | 301666/371472 [1:50:14<5:32:17,  3.50it/s]
 81%|████████  | 301667/371472 [1:50:15<5:29:06,  3.54it/s]
 81%|████████  | 301668/371472 [1:50:15<5:42:11,  3.40it/s]
 81%|████████  | 301669/371472 [1:50:15<5:55:07,  3.28it/s]
 81%|████████  | 301670/371472 [1:50:16<5:40:25,  3.42it/s]
 81%|████████  | 301671/371472 [1:50:16<5:25:18,  3.58it/s]
 81%|████████  | 301672/371472 [1:50:16<5:14:10,  3.70it/s]
 81%|████████  | 301673/371472 [1:50:16<5:22:32,  3.61it/s]
 81%|████████  | 301674/371472 [1:50:17<5:28:30,  3.54it/s]
 81%|████████  | 301675/371472 [1:50:17<5:28:06,  3.55it/s]
 81%|████████  | 301676/371472 [1:50:17<5:26:20,  3.56it/s]
 81%|████████  | 301677/371472 [1:50:18<5:36:22,  3.46it/s]
 81%|████████  | 301678/371472 [1:50:18<6:52:47,  2.82it/s]
 81%|████████  | 301679/371472 [1:50:18<6:48:06,  2.85it/s]
 81%|████████  | 301680/371472 [1:50:19<6:15:21,  3.10it/s]
                                                           
{'loss': 2.7305, 'learning_rate': 2.691827016311491e-07, 'epoch': 12.99}

 81%|████████  | 301680/371472 [1:50:19<6:15:21,  3.10it/s]
 81%|████████  | 301681/371472 [1:50:19<5:52:51,  3.30it/s]
 81%|████████  | 301682/371472 [1:50:19<5:36:46,  3.45it/s]
 81%|████████  | 301683/371472 [1:50:19<5:24:38,  3.58it/s]
 81%|████████  | 301684/371472 [1:50:20<5:19:14,  3.64it/s]
 81%|████████  | 301685/371472 [1:50:20<5:10:18,  3.75it/s]
 81%|████████  | 301686/371472 [1:50:20<5:08:43,  3.77it/s]
 81%|████████  | 301687/371472 [1:50:20<5:03:33,  3.83it/s]
 81%|████████  | 301688/371472 [1:50:21<5:04:33,  3.82it/s]
 81%|████████  | 301689/371472 [1:50:21<5:24:00,  3.59it/s]
 81%|████████  | 301690/371472 [1:50:21<5:34:53,  3.47it/s]
 81%|████████  | 301691/371472 [1:50:22<5:24:35,  3.58it/s]
 81%|████████  | 301692/371472 [1:50:22<5:24:30,  3.58it/s]
 81%|████████  | 301693/371472 [1:50:22<5:21:18,  3.62it/s]
 81%|████████  | 301694/371472 [1:50:22<5:23:31,  3.59it/s]
 81%|████████  | 301695/371472 [1:50:23<5:14:58,  3.69it/s]
 81%|████████  | 301696/371472 [1:50:23<5:09:58,  3.75it/s]
 81%|████████  | 301697/371472 [1:50:23<5:03:30,  3.83it/s]
 81%|████████  | 301698/371472 [1:50:23<5:34:07,  3.48it/s]
 81%|████████  | 301699/371472 [1:50:24<5:24:18,  3.59it/s]
 81%|████████  | 301700/371472 [1:50:24<5:11:16,  3.74it/s]
                                                           
{'loss': 2.6815, 'learning_rate': 2.6913421965567024e-07, 'epoch': 12.99}

 81%|████████  | 301700/371472 [1:50:24<5:11:16,  3.74it/s]
 81%|████████  | 301701/371472 [1:50:24<5:11:14,  3.74it/s]
 81%|████████  | 301702/371472 [1:50:25<5:30:15,  3.52it/s]
 81%|████████  | 301703/371472 [1:50:25<5:38:38,  3.43it/s]
 81%|████████  | 301704/371472 [1:50:25<5:22:26,  3.61it/s]
 81%|████████  | 301705/371472 [1:50:25<5:21:42,  3.61it/s]
 81%|████████  | 301706/371472 [1:50:26<5:19:25,  3.64it/s]
 81%|████████  | 301707/371472 [1:50:26<5:13:46,  3.71it/s]
 81%|████████  | 301708/371472 [1:50:26<5:23:00,  3.60it/s]
 81%|████████  | 301709/371472 [1:50:27<5:31:31,  3.51it/s]
 81%|████████  | 301710/371472 [1:50:27<6:56:31,  2.79it/s]
 81%|████████  | 301711/371472 [1:50:27<6:24:23,  3.02it/s]
 81%|████████  | 301712/371472 [1:50:28<6:12:52,  3.12it/s]
 81%|████████  | 301713/371472 [1:50:28<6:11:18,  3.13it/s]
 81%|████████  | 301714/371472 [1:50:28<5:42:31,  3.39it/s]
 81%|████████  | 301715/371472 [1:50:28<5:30:37,  3.52it/s]
 81%|████████  | 301716/371472 [1:50:29<5:26:44,  3.56it/s]
 81%|████████  | 301717/371472 [1:50:29<5:31:10,  3.51it/s]
 81%|████████  | 301718/371472 [1:50:29<5:18:42,  3.65it/s]
 81%|████████  | 301719/371472 [1:50:30<5:22:57,  3.60it/s]
 81%|████████  | 301720/371472 [1:50:30<5:47:21,  3.35it/s]
                                                           
{'loss': 2.6734, 'learning_rate': 2.690857376801913e-07, 'epoch': 13.0}

 81%|████████  | 301720/371472 [1:50:30<5:47:21,  3.35it/s]
 81%|████████  | 301721/371472 [1:50:30<5:53:37,  3.29it/s]
 81%|████████  | 301722/371472 [1:50:30<5:39:25,  3.42it/s]
 81%|████████  | 301723/371472 [1:50:31<5:28:04,  3.54it/s]
 81%|████████  | 301724/371472 [1:50:31<5:42:22,  3.40it/s]
 81%|████████  | 301725/371472 [1:50:31<5:40:59,  3.41it/s]
 81%|████████  | 301726/371472 [1:50:32<5:36:45,  3.45it/s]
 81%|████████  | 301727/371472 [1:50:32<5:31:25,  3.51it/s]
 81%|████████  | 301728/371472 [1:50:32<5:25:26,  3.57it/s]
 81%|████████  | 301729/371472 [1:50:32<5:27:17,  3.55it/s]
 81%|████████  | 301730/371472 [1:50:33<5:14:48,  3.69it/s]
 81%|████████  | 301731/371472 [1:50:33<5:18:54,  3.64it/s]
 81%|████████  | 301732/371472 [1:50:33<5:21:10,  3.62it/s]
 81%|████████  | 301733/371472 [1:50:34<5:23:59,  3.59it/s]
 81%|████████  | 301734/371472 [1:50:34<5:33:02,  3.49it/s]
 81%|████████  | 301735/371472 [1:50:34<5:19:56,  3.63it/s]
 81%|████████  | 301736/371472 [1:50:34<5:18:17,  3.65it/s]
 81%|████████  | 301737/371472 [1:50:35<5:31:46,  3.50it/s]
 81%|████████  | 301738/371472 [1:50:35<5:23:37,  3.59it/s]
 81%|████████  | 301739/371472 [1:50:35<5:15:09,  3.69it/s]
 81%|████████  | 301740/371472 [1:50:35<5:13:25,  3.71it/s]
                                                           
{'loss': 2.671, 'learning_rate': 2.690372557047125e-07, 'epoch': 13.0}

 81%|████████  | 301740/371472 [1:50:35<5:13:25,  3.71it/s]
 81%|████████  | 301741/371472 [1:50:36<5:07:40,  3.78it/s]
 81%|████████  | 301742/371472 [1:50:36<5:06:24,  3.79it/s]
 81%|████████  | 301743/371472 [1:50:36<5:16:24,  3.67it/s]
 81%|████████  | 301744/371472 [1:50:37<5:04:55,  3.81it/s]
 81%|████████  | 301745/371472 [1:50:37<5:31:29,  3.51it/s]
 81%|████████  | 301746/371472 [1:50:37<5:30:14,  3.52it/s]
 81%|████████  | 301747/371472 [1:50:37<5:17:21,  3.66it/s]
 81%|████████  | 301748/371472 [1:50:38<5:21:14,  3.62it/s]
 81%|████████  | 301749/371472 [1:50:38<5:11:36,  3.73it/s]
 81%|████████  | 301750/371472 [1:50:38<5:17:42,  3.66it/s]
 81%|████████  | 301751/371472 [1:50:38<5:14:09,  3.70it/s]
 81%|████████  | 301752/371472 [1:50:39<5:14:10,  3.70it/s]
 81%|████████  | 301753/371472 [1:50:39<5:49:52,  3.32it/s]
 81%|████████  | 301754/371472 [1:50:39<5:45:53,  3.36it/s]
 81%|████████  | 301755/371472 [1:50:40<6:14:26,  3.10it/s]
 81%|████████  | 301756/371472 [1:50:40<6:22:43,  3.04it/s]
 81%|████████  | 301757/371472 [1:50:40<5:59:44,  3.23it/s]
 81%|████████  | 301758/371472 [1:50:41<5:41:49,  3.40it/s]
 81%|████████  | 301759/371472 [1:50:41<5:51:27,  3.31it/s]
 81%|████████  | 301760/371472 [1:50:41<5:32:58,  3.49it/s]
                                                           
{'loss': 2.5003, 'learning_rate': 2.6898877372923356e-07, 'epoch': 13.0}

 81%|████████  | 301760/371472 [1:50:41<5:32:58,  3.49it/s]
 81%|████████  | 301761/371472 [1:50:41<5:23:36,  3.59it/s]
 81%|████████  | 301762/371472 [1:50:42<5:14:27,  3.69it/s]
 81%|████████  | 301763/371472 [1:50:42<5:11:24,  3.73it/s]
 81%|████████  | 301764/371472 [1:50:42<5:11:45,  3.73it/s]
 81%|████████  | 301765/371472 [1:50:43<5:25:14,  3.57it/s]
 81%|████████  | 301766/371472 [1:50:43<5:19:31,  3.64it/s]
 81%|████████  | 301767/371472 [1:50:43<5:11:55,  3.72it/s]
 81%|████████  | 301768/371472 [1:50:43<5:10:17,  3.74it/s]
 81%|████████  | 301769/371472 [1:50:44<4:58:35,  3.89it/s]
 81%|████████  | 301770/371472 [1:50:44<5:08:15,  3.77it/s]
 81%|████████  | 301771/371472 [1:50:44<5:25:23,  3.57it/s]
 81%|████████  | 301772/371472 [1:50:44<5:13:36,  3.70it/s]
 81%|████████  | 301773/371472 [1:50:45<5:24:59,  3.57it/s]
 81%|████████  | 301774/371472 [1:50:45<5:23:49,  3.59it/s]
 81%|████████  | 301775/371472 [1:50:45<5:41:37,  3.40it/s]
 81%|████████  | 301776/371472 [1:50:46<5:31:51,  3.50it/s]
 81%|████████  | 301777/371472 [1:50:46<5:24:09,  3.58it/s]
 81%|████████  | 301778/371472 [1:50:46<5:34:36,  3.47it/s]
 81%|████████  | 301779/371472 [1:50:46<5:24:10,  3.58it/s]
 81%|████████  | 301780/371472 [1:50:47<5:43:38,  3.38it/s]
                                                           
{'loss': 2.7639, 'learning_rate': 2.6894029175375463e-07, 'epoch': 13.0}

 81%|████████  | 301780/371472 [1:50:47<5:43:38,  3.38it/s]
 81%|████████  | 301781/371472 [1:50:47<5:42:33,  3.39it/s]
 81%|████████  | 301782/371472 [1:50:47<5:50:14,  3.32it/s]
 81%|████████  | 301783/371472 [1:50:48<5:33:14,  3.49it/s]
 81%|████████  | 301784/371472 [1:50:48<5:29:28,  3.53it/s]
 81%|████████  | 301785/371472 [1:50:48<5:36:23,  3.45it/s]
 81%|████████  | 301786/371472 [1:50:49<6:08:26,  3.15it/s]
 81%|████████  | 301787/371472 [1:50:49<6:18:13,  3.07it/s]
 81%|████████  | 301788/371472 [1:50:49<5:59:54,  3.23it/s]
 81%|████████  | 301789/371472 [1:50:49<5:41:31,  3.40it/s]
 81%|████████  | 301790/371472 [1:50:50<5:27:33,  3.55it/s]
 81%|████████  | 301791/371472 [1:50:50<5:15:31,  3.68it/s]
 81%|████████  | 301792/371472 [1:50:50<5:06:49,  3.79it/s]
 81%|████████  | 301793/371472 [1:50:51<5:48:57,  3.33it/s]
 81%|████████  | 301794/371472 [1:50:51<5:48:16,  3.33it/s]
 81%|████████  | 301795/371472 [1:50:51<5:41:26,  3.40it/s]
 81%|████████  | 301796/371472 [1:50:51<5:30:46,  3.51it/s]
 81%|████████  | 301797/371472 [1:50:52<5:50:16,  3.32it/s]
 81%|████████  | 301798/371472 [1:50:52<5:46:41,  3.35it/s]
 81%|████████  | 301799/371472 [1:50:52<5:40:31,  3.41it/s]
 81%|████████  | 301800/371472 [1:50:53<5:54:47,  3.27it/s]
                                                           
{'loss': 2.5628, 'learning_rate': 2.6889180977827575e-07, 'epoch': 13.0}

 81%|████████  | 301800/371472 [1:50:53<5:54:47,  3.27it/s]
 81%|████████  | 301801/371472 [1:50:53<5:51:25,  3.30it/s]
 81%|████████  | 301802/371472 [1:50:53<5:35:16,  3.46it/s]
 81%|████████  | 301803/371472 [1:50:54<5:41:00,  3.41it/s]
 81%|████████  | 301804/371472 [1:50:54<5:29:51,  3.52it/s]
 81%|████████  | 301805/371472 [1:50:54<5:28:21,  3.54it/s]
 81%|████████  | 301806/371472 [1:50:54<5:43:05,  3.38it/s]
 81%|████████  | 301807/371472 [1:50:55<5:39:24,  3.42it/s]
 81%|████████  | 301808/371472 [1:50:55<5:30:39,  3.51it/s]
 81%|████████  | 301809/371472 [1:50:55<5:36:19,  3.45it/s]
 81%|████████  | 301810/371472 [1:50:56<5:32:47,  3.49it/s]
 81%|████████  | 301811/371472 [1:50:56<5:20:45,  3.62it/s]
 81%|████████  | 301812/371472 [1:50:56<5:49:31,  3.32it/s]
 81%|████████  | 301813/371472 [1:50:56<5:35:25,  3.46it/s]
 81%|████████  | 301814/371472 [1:50:57<5:23:45,  3.59it/s]
 81%|████████  | 301815/371472 [1:50:57<5:15:54,  3.67it/s]
 81%|████████  | 301816/371472 [1:50:57<5:10:55,  3.73it/s]
 81%|████████  | 301817/371472 [1:50:57<5:03:41,  3.82it/s]
 81%|████████  | 301818/371472 [1:50:58<5:14:01,  3.70it/s]
 81%|████████  | 301819/371472 [1:50:58<5:14:56,  3.69it/s]
 81%|████████  | 301820/371472 [1:50:58<5:32:50,  3.49it/s]
                                                           
{'loss': 2.6752, 'learning_rate': 2.688433278027969e-07, 'epoch': 13.0}

 81%|████████  | 301820/371472 [1:50:58<5:32:50,  3.49it/s]
 81%|████████▏ | 301821/371472 [1:50:59<5:44:35,  3.37it/s]Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
Non-default generation parameters: {'max_length': 200, 'early_stopping': True, 'num_beams': 5, 'forced_eos_token_id': 2}
/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

 81%|████████▏ | 301822/371472 [1:51:18<117:28:43,  6.07s/it]
 81%|████████▏ | 301823/371472 [1:51:18<83:55:57,  4.34s/it] 
 81%|████████▏ | 301824/371472 [1:51:19<60:37:39,  3.13s/it]
 81%|████████▏ | 301825/371472 [1:51:19<44:09:37,  2.28s/it]
 81%|████████▏ | 301826/371472 [1:51:19<32:44:42,  1.69s/it]
 81%|████████▏ | 301827/371472 [1:51:20<24:19:17,  1.26s/it]
 81%|████████▏ | 301828/371472 [1:51:20<18:41:48,  1.03it/s]
 81%|████████▏ | 301829/371472 [1:51:20<14:39:13,  1.32it/s]
 81%|████████▏ | 301830/371472 [1:51:21<11:52:27,  1.63it/s]
 81%|████████▏ | 301831/371472 [1:51:21<10:05:00,  1.92it/s]
 81%|████████▏ | 301832/371472 [1:51:21<8:29:24,  2.28it/s] 
 81%|████████▏ | 301833/371472 [1:51:21<7:27:38,  2.59it/s]
 81%|████████▏ | 301834/371472 [1:51:22<6:40:26,  2.90it/s]
 81%|████████▏ | 301835/371472 [1:51:22<6:13:16,  3.11it/s]
 81%|████████▏ | 301836/371472 [1:51:22<5:54:20,  3.28it/s]
 81%|████████▏ | 301837/371472 [1:51:22<5:35:27,  3.46it/s]
 81%|████████▏ | 301838/371472 [1:51:23<6:48:17,  2.84it/s]
 81%|████████▏ | 301839/371472 [1:51:23<6:17:56,  3.07it/s]
 81%|████████▏ | 301840/371472 [1:51:23<6:12:56,  3.11it/s]
                                                           
{'loss': 2.5615, 'learning_rate': 2.6879484582731795e-07, 'epoch': 13.0}

 81%|████████▏ | 301840/371472 [1:51:23<6:12:56,  3.11it/s]
 81%|████████▏ | 301841/371472 [1:51:24<5:57:08,  3.25it/s]
 81%|████████▏ | 301842/371472 [1:51:24<6:00:07,  3.22it/s]
 81%|████████▏ | 301843/371472 [1:51:24<6:00:05,  3.22it/s]
 81%|████████▏ | 301844/371472 [1:51:25<6:03:57,  3.19it/s]
 81%|████████▏ | 301845/371472 [1:51:25<5:47:46,  3.34it/s]
 81%|████████▏ | 301846/371472 [1:51:25<6:38:30,  2.91it/s]
 81%|████████▏ | 301847/371472 [1:51:26<6:21:08,  3.04it/s]
 81%|████████▏ | 301848/371472 [1:51:26<6:17:19,  3.08it/s]
 81%|████████▏ | 301849/371472 [1:51:26<6:39:06,  2.91it/s]
 81%|████████▏ | 301850/371472 [1:51:27<6:29:40,  2.98it/s]
 81%|████████▏ | 301851/371472 [1:51:27<6:08:47,  3.15it/s]
 81%|████████▏ | 301852/371472 [1:51:27<6:12:54,  3.11it/s]
 81%|████████▏ | 301853/371472 [1:51:28<6:10:36,  3.13it/s]
 81%|████████▏ | 301854/371472 [1:51:28<6:10:48,  3.13it/s]
 81%|████████▏ | 301855/371472 [1:51:28<6:24:55,  3.01it/s]
 81%|████████▏ | 301856/371472 [1:51:29<6:00:38,  3.22it/s]
 81%|████████▏ | 301857/371472 [1:51:29<6:09:47,  3.14it/s]
 81%|████████▏ | 301858/371472 [1:51:29<5:49:33,  3.32it/s]
 81%|████████▏ | 301859/371472 [1:51:29<5:52:29,  3.29it/s]
 81%|████████▏ | 301860/371472 [1:51:30<5:40:18,  3.41it/s]
                                                           
{'loss': 2.6487, 'learning_rate': 2.6874636385183913e-07, 'epoch': 13.0}

 81%|████████▏ | 301860/371472 [1:51:30<5:40:18,  3.41it/s]
 81%|████████▏ | 301861/371472 [1:51:30<5:40:07,  3.41it/s]
 81%|████████▏ | 301862/371472 [1:51:30<5:34:44,  3.47it/s]
 81%|████████▏ | 301863/371472 [1:51:31<5:25:43,  3.56it/s]
 81%|████████▏ | 301864/371472 [1:51:31<5:26:00,  3.56it/s]
 81%|████████▏ | 301865/371472 [1:51:31<5:31:06,  3.50it/s]
 81%|████████▏ | 301866/371472 [1:51:31<5:28:50,  3.53it/s]
 81%|████████▏ | 301867/371472 [1:51:32<5:29:21,  3.52it/s]
 81%|████████▏ | 301868/371472 [1:51:32<5:34:33,  3.47it/s]
 81%|████████▏ | 301869/371472 [1:51:32<5:31:51,  3.50it/s]
 81%|████████▏ | 301870/371472 [1:51:33<5:24:46,  3.57it/s]
 81%|████████▏ | 301871/371472 [1:51:33<5:28:16,  3.53it/s]
 81%|████████▏ | 301872/371472 [1:51:33<5:20:22,  3.62it/s]
 81%|████████▏ | 301873/371472 [1:51:33<5:18:12,  3.65it/s]
 81%|████████▏ | 301874/371472 [1:51:34<5:59:42,  3.22it/s]
 81%|████████▏ | 301875/371472 [1:51:34<5:44:22,  3.37it/s]
 81%|████████▏ | 301876/371472 [1:51:34<5:51:31,  3.30it/s]
 81%|████████▏ | 301877/371472 [1:51:35<5:56:51,  3.25it/s]
 81%|████████▏ | 301878/371472 [1:51:35<6:00:44,  3.22it/s]
 81%|████████▏ | 301879/371472 [1:51:35<5:52:23,  3.29it/s]
 81%|████████▏ | 301880/371472 [1:51:36<6:14:12,  3.10it/s]
                                                           
{'loss': 2.6064, 'learning_rate': 2.686978818763602e-07, 'epoch': 13.0}

 81%|████████▏ | 301880/371472 [1:51:36<6:14:12,  3.10it/s]
 81%|████████▏ | 301881/371472 [1:51:36<6:05:01,  3.18it/s]
 81%|████████▏ | 301882/371472 [1:51:36<6:11:20,  3.12it/s]
 81%|████████▏ | 301883/371472 [1:51:37<5:57:59,  3.24it/s]
 81%|████████▏ | 301884/371472 [1:51:37<5:50:48,  3.31it/s]
 81%|████████▏ | 301885/371472 [1:51:37<5:41:03,  3.40it/s]
 81%|████████▏ | 301886/371472 [1:51:37<6:13:40,  3.10it/s]
 81%|████████▏ | 301887/371472 [1:51:38<5:55:24,  3.26it/s]
 81%|████████▏ | 301888/371472 [1:51:38<5:47:21,  3.34it/s]
 81%|████████▏ | 301889/371472 [1:51:38<5:49:24,  3.32it/s]
 81%|████████▏ | 301890/371472 [1:51:39<5:43:10,  3.38it/s]
 81%|████████▏ | 301891/371472 [1:51:39<5:43:18,  3.38it/s]
 81%|████████▏ | 301892/371472 [1:51:39<6:27:31,  2.99it/s]
 81%|████████▏ | 301893/371472 [1:51:40<6:01:34,  3.21it/s]
 81%|████████▏ | 301894/371472 [1:51:40<5:46:20,  3.35it/s]
 81%|████████▏ | 301895/371472 [1:51:40<5:35:13,  3.46it/s]
 81%|████████▏ | 301896/371472 [1:51:40<5:38:56,  3.42it/s]
 81%|████████▏ | 301897/371472 [1:51:41<5:51:29,  3.30it/s]
 81%|████████▏ | 301898/371472 [1:51:41<5:57:01,  3.25it/s]
 81%|████████▏ | 301899/371472 [1:51:41<6:00:56,  3.21it/s]
 81%|████████▏ | 301900/371472 [1:51:42<5:53:49,  3.28it/s]
                                                           
{'loss': 2.5395, 'learning_rate': 2.6864939990088127e-07, 'epoch': 13.0}

 81%|████████▏ | 301900/371472 [1:51:42<5:53:49,  3.28it/s]
 81%|████████▏ | 301901/371472 [1:51:42<5:58:40,  3.23it/s]
 81%|████████▏ | 301902/371472 [1:51:42<5:40:32,  3.40it/s]
 81%|████████▏ | 301903/371472 [1:51:43<5:43:59,  3.37it/s]
 81%|████████▏ | 301904/371472 [1:51:43<5:51:22,  3.30it/s]
 81%|████████▏ | 301905/371472 [1:51:43<5:41:10,  3.40it/s]
 81%|████████▏ | 301906/371472 [1:51:43<5:36:04,  3.45it/s]
 81%|████████▏ | 301907/371472 [1:51:44<5:31:03,  3.50it/s]
 81%|████████▏ | 301908/371472 [1:51:44<5:22:31,  3.59it/s]
 81%|████████▏ | 301909/371472 [1:51:44<5:15:20,  3.68it/s]
 81%|████████▏ | 301910/371472 [1:51:44<5:08:11,  3.76it/s]
 81%|████████▏ | 301911/371472 [1:51:45<5:02:46,  3.83it/s]
 81%|████████▏ | 301912/371472 [1:51:45<5:11:28,  3.72it/s]
 81%|████████▏ | 301913/371472 [1:51:45<5:41:22,  3.40it/s]
 81%|████████▏ | 301914/371472 [1:51:46<5:44:24,  3.37it/s]
 81%|████████▏ | 301915/371472 [1:51:46<5:43:19,  3.38it/s]
 81%|████████▏ | 301916/371472 [1:51:46<5:53:38,  3.28it/s]
 81%|████████▏ | 301917/371472 [1:51:47<5:39:23,  3.42it/s]
 81%|████████▏ | 301918/371472 [1:51:47<5:33:26,  3.48it/s]
 81%|████████▏ | 301919/371472 [1:51:47<5:34:55,  3.46it/s]
 81%|████████▏ | 301920/371472 [1:51:47<5:30:14,  3.51it/s]
                                                           
{'loss': 2.677, 'learning_rate': 2.686009179254024e-07, 'epoch': 13.0}

 81%|████████▏ | 301920/371472 [1:51:47<5:30:14,  3.51it/s]
 81%|████████▏ | 301921/371472 [1:51:48<5:29:12,  3.52it/s]
 81%|████████▏ | 301922/371472 [1:51:48<5:45:19,  3.36it/s]
 81%|████████▏ | 301923/371472 [1:51:48<5:55:34,  3.26it/s]
 81%|████████▏ | 301924/371472 [1:51:49<6:00:03,  3.22it/s]
 81%|████████▏ | 301925/371472 [1:51:49<5:52:15,  3.29it/s]
 81%|████████▏ | 301926/371472 [1:51:49<5:58:00,  3.24it/s]
 81%|████████▏ | 301927/371472 [1:51:50<5:56:45,  3.25it/s]
 81%|████████▏ | 301928/371472 [1:51:50<5:50:00,  3.31it/s]
 81%|████████▏ | 301929/371472 [1:51:50<6:09:49,  3.13it/s]
 81%|████████▏ | 301930/371472 [1:51:51<5:56:00,  3.26it/s]
 81%|████████▏ | 301931/371472 [1:51:51<5:55:42,  3.26it/s]
 81%|████████▏ | 301932/371472 [1:51:51<5:38:56,  3.42it/s]
 81%|████████▏ | 301933/371472 [1:51:51<5:47:28,  3.34it/s]
 81%|████████▏ | 301934/371472 [1:51:52<5:48:02,  3.33it/s]
 81%|████████▏ | 301935/371472 [1:51:52<6:10:10,  3.13it/s]
 81%|████████▏ | 301936/371472 [1:51:52<6:12:46,  3.11it/s]
 81%|████████▏ | 301937/371472 [1:51:53<5:52:11,  3.29it/s]
 81%|████████▏ | 301938/371472 [1:51:53<5:31:01,  3.50it/s]
 81%|████████▏ | 301939/371472 [1:51:53<5:36:42,  3.44it/s]
 81%|████████▏ | 301940/371472 [1:51:53<5:33:57,  3.47it/s]
                                                           
{'loss': 2.61, 'learning_rate': 2.685524359499234e-07, 'epoch': 13.01}

 81%|████████▏ | 301940/371472 [1:51:53<5:33:57,  3.47it/s]
 81%|████████▏ | 301941/371472 [1:51:54<5:22:56,  3.59it/s]
 81%|████████▏ | 301942/371472 [1:51:54<5:19:45,  3.62it/s]
 81%|████████▏ | 301943/371472 [1:51:54<5:32:51,  3.48it/s]
 81%|████████▏ | 301944/371472 [1:51:55<5:18:20,  3.64it/s]
 81%|████████▏ | 301945/371472 [1:51:55<5:34:07,  3.47it/s]
 81%|████████▏ | 301946/371472 [1:51:55<6:39:16,  2.90it/s]
 81%|████████▏ | 301947/371472 [1:51:56<6:02:49,  3.19it/s]
 81%|████████▏ | 301948/371472 [1:51:56<5:47:14,  3.34it/s]
 81%|████████▏ | 301949/371472 [1:51:56<5:50:40,  3.30it/s]
 81%|████████▏ | 301950/371472 [1:51:56<5:41:18,  3.39it/s]
 81%|████████▏ | 301951/371472 [1:51:57<5:34:18,  3.47it/s]
 81%|████████▏ | 301952/371472 [1:51:57<5:35:27,  3.45it/s]
 81%|████████▏ | 301953/371472 [1:51:57<5:37:47,  3.43it/s]
 81%|████████▏ | 301954/371472 [1:51:58<6:14:15,  3.10it/s]
 81%|████████▏ | 301955/371472 [1:51:58<5:48:31,  3.32it/s]
 81%|████████▏ | 301956/371472 [1:51:58<5:46:47,  3.34it/s]
 81%|████████▏ | 301957/371472 [1:51:59<5:33:04,  3.48it/s]
 81%|████████▏ | 301958/371472 [1:51:59<5:31:13,  3.50it/s]
 81%|████████▏ | 301959/371472 [1:51:59<5:36:51,  3.44it/s]
 81%|████████▏ | 301960/371472 [1:51:59<5:50:47,  3.30it/s]
                                                           
{'loss': 2.6091, 'learning_rate': 2.685039539744446e-07, 'epoch': 13.01}

 81%|████████▏ | 301960/371472 [1:51:59<5:50:47,  3.30it/s]
 81%|████████▏ | 301961/371472 [1:52:00<6:06:12,  3.16it/s]
 81%|████████▏ | 301962/371472 [1:52:00<6:26:40,  3.00it/s]
 81%|████████▏ | 301963/371472 [1:52:00<6:11:26,  3.12it/s]
 81%|████████▏ | 301964/371472 [1:52:01<6:02:02,  3.20it/s]
 81%|████████▏ | 301965/371472 [1:52:01<6:03:17,  3.19it/s]
 81%|████████▏ | 301966/371472 [1:52:01<5:36:39,  3.44it/s]
 81%|████████▏ | 301967/371472 [1:52:02<5:46:59,  3.34it/s]
 81%|████████▏ | 301968/371472 [1:52:02<5:37:15,  3.43it/s]
 81%|████████▏ | 301969/371472 [1:52:02<5:55:45,  3.26it/s]
 81%|████████▏ | 301970/371472 [1:52:03<5:51:41,  3.29it/s]
 81%|████████▏ | 301971/371472 [1:52:03<5:47:11,  3.34it/s]
 81%|████████▏ | 301972/371472 [1:52:03<5:47:35,  3.33it/s]
 81%|████████▏ | 301973/371472 [1:52:03<5:42:23,  3.38it/s]
 81%|████████▏ | 301974/371472 [1:52:04<5:32:01,  3.49it/s]
 81%|████████▏ | 301975/371472 [1:52:04<5:17:38,  3.65it/s]
 81%|████████▏ | 301976/371472 [1:52:04<5:12:43,  3.70it/s]
 81%|████████▏ | 301977/371472 [1:52:04<5:11:15,  3.72it/s]
 81%|████████▏ | 301978/371472 [1:52:05<5:39:13,  3.41it/s]
 81%|████████▏ | 301979/371472 [1:52:05<5:28:59,  3.52it/s]
 81%|████████▏ | 301980/371472 [1:52:05<5:31:51,  3.49it/s]
                                                           
{'loss': 2.5934, 'learning_rate': 2.6845547199896566e-07, 'epoch': 13.01}

 81%|████████▏ | 301980/371472 [1:52:05<5:31:51,  3.49it/s]
 81%|████████▏ | 301981/371472 [1:52:06<5:25:26,  3.56it/s]
 81%|████████▏ | 301982/371472 [1:52:06<5:32:11,  3.49it/s]
 81%|████████▏ | 301983/371472 [1:52:06<5:35:57,  3.45it/s]
 81%|████████▏ | 301984/371472 [1:52:06<5:28:16,  3.53it/s]
 81%|████████▏ | 301985/371472 [1:52:07<5:18:10,  3.64it/s]
 81%|████████▏ | 301986/371472 [1:52:07<5:12:21,  3.71it/s]
 81%|████████▏ | 301987/371472 [1:52:07<5:28:44,  3.52it/s]
 81%|████████▏ | 301988/371472 [1:52:08<5:41:57,  3.39it/s]
 81%|████████▏ | 301989/371472 [1:52:08<5:37:03,  3.44it/s]
 81%|████████▏ | 301990/371472 [1:52:08<5:48:51,  3.32it/s]
 81%|████████▏ | 301991/371472 [1:52:09<5:39:29,  3.41it/s]
 81%|████████▏ | 301992/371472 [1:52:09<5:32:16,  3.49it/s]
 81%|████████▏ | 301993/371472 [1:52:09<5:31:23,  3.49it/s]
 81%|████████▏ | 301994/371472 [1:52:09<5:24:17,  3.57it/s]
 81%|████████▏ | 301995/371472 [1:52:10<5:21:48,  3.60it/s]
 81%|████████▏ | 301996/371472 [1:52:10<5:09:38,  3.74it/s]
 81%|████████▏ | 301997/371472 [1:52:10<5:37:37,  3.43it/s]
 81%|████████▏ | 301998/371472 [1:52:10<5:40:45,  3.40it/s]
 81%|████████▏ | 301999/371472 [1:52:11<5:30:17,  3.51it/s]
 81%|████████▏ | 302000/371472 [1:52:11<5:24:22,  3.57it/s]
                                                           
{'loss': 2.6411, 'learning_rate': 2.6840699002348684e-07, 'epoch': 13.01}

 81%|████████▏ | 302000/371472 [1:52:11<5:24:22,  3.57it/s]
 81%|████████▏ | 302001/371472 [1:52:11<5:43:28,  3.37it/s]
 81%|████████▏ | 302002/371472 [1:52:12<5:40:09,  3.40it/s]
 81%|████████▏ | 302003/371472 [1:52:12<6:05:48,  3.17it/s]
 81%|████████▏ | 302004/371472 [1:52:12<6:10:56,  3.12it/s]
 81%|████████▏ | 302005/371472 [1:52:13<6:01:56,  3.20it/s]
 81%|████████▏ | 302006/371472 [1:52:13<6:08:52,  3.14it/s]
 81%|████████▏ | 302007/371472 [1:52:13<6:00:44,  3.21it/s]
 81%|████████▏ | 302008/371472 [1:52:14<5:36:03,  3.45it/s]
 81%|████████▏ | 302009/371472 [1:52:14<5:32:24,  3.48it/s]
 81%|████████▏ | 302010/371472 [1:52:14<5:27:12,  3.54it/s]
 81%|████████▏ | 302011/371472 [1:52:14<5:25:27,  3.56it/s]
 81%|████████▏ | 302012/371472 [1:52:15<5:24:41,  3.57it/s]
 81%|████████▏ | 302013/371472 [1:52:15<5:22:24,  3.59it/s]
 81%|████████▏ | 302014/371472 [1:52:15<5:26:47,  3.54it/s]
 81%|████████▏ | 302015/371472 [1:52:15<5:21:21,  3.60it/s]
 81%|████████▏ | 302016/371472 [1:52:16<5:13:47,  3.69it/s]
 81%|████████▏ | 302017/371472 [1:52:16<5:09:58,  3.73it/s]
 81%|████████▏ | 302018/371472 [1:52:16<5:09:43,  3.74it/s]
 81%|████████▏ | 302019/371472 [1:52:17<5:16:02,  3.66it/s]
 81%|████████▏ | 302020/371472 [1:52:17<5:55:42,  3.25it/s]
                                                           
{'loss': 2.5554, 'learning_rate': 2.683585080480079e-07, 'epoch': 13.01}

 81%|████████▏ | 302020/371472 [1:52:17<5:55:42,  3.25it/s]
 81%|████████▏ | 302021/371472 [1:52:17<5:36:14,  3.44it/s]
 81%|████████▏ | 302022/371472 [1:52:17<5:43:58,  3.37it/s]
 81%|████████▏ | 302023/371472 [1:52:18<5:31:45,  3.49it/s]
 81%|████████▏ | 302024/371472 [1:52:18<5:39:35,  3.41it/s]
 81%|████████▏ | 302025/371472 [1:52:18<5:42:20,  3.38it/s]
 81%|████████▏ | 302026/371472 [1:52:19<5:39:32,  3.41it/s]
 81%|████████▏ | 302027/371472 [1:52:19<5:21:42,  3.60it/s]
 81%|████████▏ | 302028/371472 [1:52:19<5:47:42,  3.33it/s]
 81%|████████▏ | 302029/371472 [1:52:19<5:36:16,  3.44it/s]
 81%|████████▏ | 302030/371472 [1:52:20<5:34:33,  3.46it/s]
 81%|████████▏ | 302031/371472 [1:52:20<5:23:03,  3.58it/s]
 81%|████████▏ | 302032/371472 [1:52:20<5:17:52,  3.64it/s]
 81%|████████▏ | 302033/371472 [1:52:21<5:18:13,  3.64it/s]
 81%|████████▏ | 302034/371472 [1:52:21<5:19:37,  3.62it/s]
 81%|████████▏ | 302035/371472 [1:52:21<5:36:25,  3.44it/s]
 81%|████████▏ | 302036/371472 [1:52:21<5:30:31,  3.50it/s]
 81%|████████▏ | 302037/371472 [1:52:22<5:50:21,  3.30it/s]
 81%|████████▏ | 302038/371472 [1:52:22<5:49:41,  3.31it/s]
 81%|████████▏ | 302039/371472 [1:52:22<5:52:00,  3.29it/s]
 81%|████████▏ | 302040/371472 [1:52:23<5:28:35,  3.52it/s]
                                                           
{'loss': 2.4619, 'learning_rate': 2.6831002607252904e-07, 'epoch': 13.01}

 81%|████████▏ | 302040/371472 [1:52:23<5:28:35,  3.52it/s]
 81%|████████▏ | 302041/371472 [1:52:23<5:42:13,  3.38it/s]
 81%|████████▏ | 302042/371472 [1:52:23<5:37:12,  3.43it/s]
 81%|████████▏ | 302043/371472 [1:52:24<5:57:32,  3.24it/s]
 81%|████████▏ | 302044/371472 [1:52:24<6:19:29,  3.05it/s]
 81%|████████▏ | 302045/371472 [1:52:24<6:00:11,  3.21it/s]
 81%|████████▏ | 302046/371472 [1:52:25<5:54:10,  3.27it/s]
 81%|████████▏ | 302047/371472 [1:52:25<5:44:09,  3.36it/s]
 81%|████████▏ | 302048/371472 [1:52:25<5:36:36,  3.44it/s]
 81%|████████▏ | 302049/371472 [1:52:25<5:28:08,  3.53it/s]
 81%|████████▏ | 302050/371472 [1:52:26<5:36:11,  3.44it/s]
 81%|████████▏ | 302051/371472 [1:52:26<5:37:49,  3.42it/s]
 81%|████████▏ | 302052/371472 [1:52:26<5:45:30,  3.35it/s]
 81%|████████▏ | 302053/371472 [1:52:27<5:31:54,  3.49it/s]
 81%|████████▏ | 302054/371472 [1:52:27<5:37:56,  3.42it/s]
 81%|████████▏ | 302055/371472 [1:52:27<5:28:52,  3.52it/s]
 81%|████████▏ | 302056/371472 [1:52:27<5:19:25,  3.62it/s]
 81%|████████▏ | 302057/371472 [1:52:28<5:22:02,  3.59it/s]
 81%|████████▏ | 302058/371472 [1:52:28<5:21:57,  3.59it/s]
 81%|████████▏ | 302059/371472 [1:52:28<5:45:38,  3.35it/s]
 81%|████████▏ | 302060/371472 [1:52:29<5:33:27,  3.47it/s]
                                                           
{'loss': 2.6895, 'learning_rate': 2.682615440970501e-07, 'epoch': 13.01}

 81%|████████▏ | 302060/371472 [1:52:29<5:33:27,  3.47it/s]
 81%|████████▏ | 302061/371472 [1:52:29<5:43:11,  3.37it/s]
 81%|████████▏ | 302062/371472 [1:52:29<5:45:26,  3.35it/s]
 81%|████████▏ | 302063/371472 [1:52:29<5:37:43,  3.43it/s]
 81%|████████▏ | 302064/371472 [1:52:30<5:33:53,  3.46it/s]
 81%|████████▏ | 302065/371472 [1:52:30<5:39:38,  3.41it/s]
 81%|████████▏ | 302066/371472 [1:52:30<5:28:46,  3.52it/s]
 81%|████████▏ | 302067/371472 [1:52:31<5:27:15,  3.53it/s]
 81%|████████▏ | 302068/371472 [1:52:31<5:19:51,  3.62it/s]
 81%|████████▏ | 302069/371472 [1:52:31<5:09:44,  3.73it/s]
 81%|████████▏ | 302070/371472 [1:52:31<5:21:18,  3.60it/s]
 81%|████████▏ | 302071/371472 [1:52:32<5:25:58,  3.55it/s]
 81%|████████▏ | 302072/371472 [1:52:32<5:33:01,  3.47it/s]
 81%|████████▏ | 302073/371472 [1:52:32<5:59:48,  3.21it/s]
 81%|████████▏ | 302074/371472 [1:52:33<6:04:06,  3.18it/s]
 81%|████████▏ | 302075/371472 [1:52:33<6:08:21,  3.14it/s]
 81%|████████▏ | 302076/371472 [1:52:33<5:50:27,  3.30it/s]
 81%|████████▏ | 302077/371472 [1:52:34<5:47:03,  3.33it/s]
 81%|████████▏ | 302078/371472 [1:52:34<5:54:41,  3.26it/s]
 81%|████████▏ | 302079/371472 [1:52:34<6:12:48,  3.10it/s]
 81%|████████▏ | 302080/371472 [1:52:34<5:52:08,  3.28it/s]
                                                           
{'loss': 2.5049, 'learning_rate': 2.6821306212157123e-07, 'epoch': 13.01}

 81%|████████▏ | 302080/371472 [1:52:34<5:52:08,  3.28it/s]
 81%|████████▏ | 302081/371472 [1:52:35<6:10:01,  3.13it/s]
 81%|████████▏ | 302082/371472 [1:52:35<6:04:42,  3.17it/s]
 81%|████████▏ | 302083/371472 [1:52:35<6:10:52,  3.12it/s]
 81%|████████▏ | 302084/371472 [1:52:36<5:57:52,  3.23it/s]
 81%|████████▏ | 302085/371472 [1:52:36<6:10:59,  3.12it/s]
 81%|████████▏ | 302086/371472 [1:52:36<6:16:48,  3.07it/s]
 81%|████████▏ | 302087/371472 [1:52:37<6:00:57,  3.20it/s]
 81%|████████▏ | 302088/371472 [1:52:37<5:48:49,  3.32it/s]
 81%|████████▏ | 302089/371472 [1:52:37<5:57:45,  3.23it/s]
 81%|████████▏ | 302090/371472 [1:52:38<5:59:57,  3.21it/s]
 81%|████████▏ | 302091/371472 [1:52:38<5:46:08,  3.34it/s]
 81%|████████▏ | 302092/371472 [1:52:38<5:45:37,  3.35it/s]
 81%|████████▏ | 302093/371472 [1:52:38<5:34:48,  3.45it/s]
 81%|████████▏ | 302094/371472 [1:52:39<5:55:14,  3.26it/s]
 81%|████████▏ | 302095/371472 [1:52:39<5:48:08,  3.32it/s]
 81%|████████▏ | 302096/371472 [1:52:39<5:51:26,  3.29it/s]
 81%|████████▏ | 302097/371472 [1:52:40<5:45:55,  3.34it/s]
 81%|████████▏ | 302098/371472 [1:52:40<5:49:32,  3.31it/s]
 81%|████████▏ | 302099/371472 [1:52:40<5:57:58,  3.23it/s]
 81%|████████▏ | 302100/371472 [1:52:41<5:41:08,  3.39it/s]
                                                           
{'loss': 2.6687, 'learning_rate': 2.681645801460923e-07, 'epoch': 13.01}

 81%|████████▏ | 302100/371472 [1:52:41<5:41:08,  3.39it/s]
 81%|████████▏ | 302101/371472 [1:52:41<5:57:21,  3.24it/s]
 81%|████████▏ | 302102/371472 [1:52:41<5:53:03,  3.27it/s]
 81%|████████▏ | 302103/371472 [1:52:42<5:39:04,  3.41it/s]
 81%|████████▏ | 302104/371472 [1:52:42<5:56:28,  3.24it/s]
 81%|████████▏ | 302105/371472 [1:52:42<5:46:41,  3.33it/s]
 81%|████████▏ | 302106/371472 [1:52:42<5:42:08,  3.38it/s]
 81%|████████▏ | 302107/371472 [1:52:43<5:34:28,  3.46it/s]
 81%|████████▏ | 302108/371472 [1:52:43<5:25:34,  3.55it/s]
 81%|████████▏ | 302109/371472 [1:52:43<5:25:32,  3.55it/s]
 81%|████████▏ | 302110/371472 [1:52:44<5:22:44,  3.58it/s]
 81%|████████▏ | 302111/371472 [1:52:44<5:44:12,  3.36it/s]
 81%|████████▏ | 302112/371472 [1:52:44<5:39:09,  3.41it/s]
 81%|████████▏ | 302113/371472 [1:52:44<5:42:18,  3.38it/s]
 81%|████████▏ | 302114/371472 [1:52:45<5:31:40,  3.49it/s]
 81%|████████▏ | 302115/371472 [1:52:45<5:44:30,  3.36it/s]
 81%|████████▏ | 302116/371472 [1:52:45<5:37:22,  3.43it/s]
 81%|████████▏ | 302117/371472 [1:52:46<5:27:38,  3.53it/s]
 81%|████████▏ | 302118/371472 [1:52:46<5:31:22,  3.49it/s]
 81%|████████▏ | 302119/371472 [1:52:46<5:48:22,  3.32it/s]
 81%|████████▏ | 302120/371472 [1:52:47<6:00:35,  3.21it/s]
                                                           
{'loss': 2.7094, 'learning_rate': 2.681160981706135e-07, 'epoch': 13.01}

 81%|████████▏ | 302120/371472 [1:52:47<6:00:35,  3.21it/s]
 81%|████████▏ | 302121/371472 [1:52:47<6:00:06,  3.21it/s]
 81%|████████▏ | 302122/371472 [1:52:47<5:54:56,  3.26it/s]
 81%|████████▏ | 302123/371472 [1:52:47<5:51:21,  3.29it/s]
 81%|████████▏ | 302124/371472 [1:52:48<5:39:27,  3.40it/s]
 81%|████████▏ | 302125/371472 [1:52:48<5:35:09,  3.45it/s]
 81%|████████▏ | 302126/371472 [1:52:48<5:51:50,  3.28it/s]
 81%|████████▏ | 302127/371472 [1:52:49<5:53:42,  3.27it/s]
 81%|████████▏ | 302128/371472 [1:52:49<5:57:10,  3.24it/s]
 81%|████████▏ | 302129/371472 [1:52:49<6:24:14,  3.01it/s]
 81%|████████▏ | 302130/371472 [1:52:50<6:17:28,  3.06it/s]
 81%|████████▏ | 302131/371472 [1:52:50<6:06:07,  3.16it/s]
 81%|████████▏ | 302132/371472 [1:52:50<6:13:53,  3.09it/s]
 81%|████████▏ | 302133/371472 [1:52:51<6:12:37,  3.10it/s]
 81%|████████▏ | 302134/371472 [1:52:51<6:00:53,  3.20it/s]
 81%|████████▏ | 302135/371472 [1:52:51<5:44:53,  3.35it/s]
 81%|████████▏ | 302136/371472 [1:52:51<5:41:33,  3.38it/s]
 81%|████████▏ | 302137/371472 [1:52:52<5:43:32,  3.36it/s]
 81%|████████▏ | 302138/371472 [1:52:52<5:34:40,  3.45it/s]
 81%|████████▏ | 302139/371472 [1:52:52<5:40:53,  3.39it/s]
 81%|████████▏ | 302140/371472 [1:52:53<5:40:24,  3.39it/s]
                                                           
{'loss': 2.4551, 'learning_rate': 2.6806761619513455e-07, 'epoch': 13.01}

 81%|████████▏ | 302140/371472 [1:52:53<5:40:24,  3.39it/s]
 81%|████████▏ | 302141/371472 [1:52:53<5:39:12,  3.41it/s]
 81%|████████▏ | 302142/371472 [1:52:53<5:34:31,  3.45it/s]
 81%|████████▏ | 302143/371472 [1:52:54<5:43:43,  3.36it/s]
 81%|████████▏ | 302144/371472 [1:52:54<5:40:08,  3.40it/s]
 81%|████████▏ | 302145/371472 [1:52:54<5:50:36,  3.30it/s]
 81%|████████▏ | 302146/371472 [1:52:54<5:55:11,  3.25it/s]
 81%|████████▏ | 302147/371472 [1:52:55<6:28:44,  2.97it/s]
 81%|████████▏ | 302148/371472 [1:52:55<5:53:09,  3.27it/s]
 81%|████████▏ | 302149/371472 [1:52:55<5:39:57,  3.40it/s]
 81%|████████▏ | 302150/371472 [1:52:56<5:50:59,  3.29it/s]
 81%|████████▏ | 302151/371472 [1:52:56<5:50:59,  3.29it/s]
 81%|████████▏ | 302152/371472 [1:52:56<5:48:38,  3.31it/s]
 81%|████████▏ | 302153/371472 [1:52:57<5:38:42,  3.41it/s]
 81%|████████▏ | 302154/371472 [1:52:57<5:30:40,  3.49it/s]
 81%|████████▏ | 302155/371472 [1:52:57<5:36:41,  3.43it/s]
 81%|████████▏ | 302156/371472 [1:52:57<5:24:43,  3.56it/s]
 81%|████████▏ | 302157/371472 [1:52:58<5:17:24,  3.64it/s]
 81%|████████▏ | 302158/371472 [1:52:58<5:22:37,  3.58it/s]
 81%|████████▏ | 302159/371472 [1:52:58<5:31:46,  3.48it/s]
 81%|████████▏ | 302160/371472 [1:52:59<6:01:16,  3.20it/s]
                                                           
{'loss': 2.5582, 'learning_rate': 2.680191342196557e-07, 'epoch': 13.01}

 81%|████████▏ | 302160/371472 [1:52:59<6:01:16,  3.20it/s]
 81%|████████▏ | 302161/371472 [1:52:59<5:47:46,  3.32it/s]
 81%|████████▏ | 302162/371472 [1:52:59<6:22:12,  3.02it/s]
 81%|████████▏ | 302163/371472 [1:53:00<6:47:06,  2.84it/s]
 81%|████████▏ | 302164/371472 [1:53:00<6:12:32,  3.10it/s]
 81%|████████▏ | 302165/371472 [1:53:00<5:54:43,  3.26it/s]
 81%|████████▏ | 302166/371472 [1:53:01<5:52:47,  3.27it/s]
 81%|████████▏ | 302167/371472 [1:53:01<5:50:33,  3.29it/s]
 81%|████████▏ | 302168/371472 [1:53:01<5:59:33,  3.21it/s]
 81%|████████▏ | 302169/371472 [1:53:01<5:44:49,  3.35it/s]
 81%|████████▏ | 302170/371472 [1:53:02<5:34:11,  3.46it/s]
 81%|████████▏ | 302171/371472 [1:53:02<5:30:06,  3.50it/s]
 81%|████████▏ | 302172/371472 [1:53:02<5:41:59,  3.38it/s]
 81%|████████▏ | 302173/371472 [1:53:03<5:34:23,  3.45it/s]
 81%|████████▏ | 302174/371472 [1:53:03<5:48:10,  3.32it/s]
 81%|████████▏ | 302175/371472 [1:53:03<5:53:09,  3.27it/s]
 81%|████████▏ | 302176/371472 [1:53:03<5:48:26,  3.31it/s]
 81%|████████▏ | 302177/371472 [1:53:04<6:00:06,  3.21it/s]
 81%|████████▏ | 302178/371472 [1:53:04<5:50:10,  3.30it/s]
 81%|████████▏ | 302179/371472 [1:53:04<5:34:15,  3.46it/s]
 81%|████████▏ | 302180/371472 [1:53:05<5:26:22,  3.54it/s]
                                                           
{'loss': 2.692, 'learning_rate': 2.6797065224417675e-07, 'epoch': 13.02}

 81%|████████▏ | 302180/371472 [1:53:05<5:26:22,  3.54it/s]
 81%|████████▏ | 302181/371472 [1:53:05<5:13:58,  3.68it/s]
 81%|████████▏ | 302182/371472 [1:53:05<5:13:09,  3.69it/s]
 81%|████████▏ | 302183/371472 [1:53:05<5:15:32,  3.66it/s]
 81%|████████▏ | 302184/371472 [1:53:06<5:15:08,  3.66it/s]
 81%|████████▏ | 302185/371472 [1:53:06<5:29:31,  3.50it/s]
 81%|████████▏ | 302186/371472 [1:53:06<6:00:08,  3.21it/s]
 81%|████████▏ | 302187/371472 [1:53:07<5:40:16,  3.39it/s]
 81%|████████▏ | 302188/371472 [1:53:07<5:44:17,  3.35it/s]
 81%|████████▏ | 302189/371472 [1:53:07<6:01:51,  3.19it/s]
 81%|████████▏ | 302190/371472 [1:53:08<5:51:33,  3.28it/s]
 81%|████████▏ | 302191/371472 [1:53:08<5:54:52,  3.25it/s]
 81%|████████▏ | 302192/371472 [1:53:08<5:44:31,  3.35it/s]
 81%|████████▏ | 302193/371472 [1:53:08<5:46:28,  3.33it/s]
 81%|████████▏ | 302194/371472 [1:53:09<5:56:10,  3.24it/s]
 81%|████████▏ | 302195/371472 [1:53:09<5:44:50,  3.35it/s]
 81%|████████▏ | 302196/371472 [1:53:09<5:26:55,  3.53it/s]
 81%|████████▏ | 302197/371472 [1:53:10<5:28:32,  3.51it/s]
 81%|████████▏ | 302198/371472 [1:53:10<5:22:55,  3.58it/s]
 81%|████████▏ | 302199/371472 [1:53:10<5:38:47,  3.41it/s]
 81%|████████▏ | 302200/371472 [1:53:11<5:53:07,  3.27it/s]
                                                           
{'loss': 2.606, 'learning_rate': 2.679221702686979e-07, 'epoch': 13.02}

 81%|████████▏ | 302200/371472 [1:53:11<5:53:07,  3.27it/s]
 81%|████████▏ | 302201/371472 [1:53:11<5:42:18,  3.37it/s]
 81%|████████▏ | 302202/371472 [1:53:11<5:58:08,  3.22it/s]
 81%|████████▏ | 302203/371472 [1:53:11<5:55:14,  3.25it/s]
 81%|████████▏ | 302204/371472 [1:53:12<5:50:01,  3.30it/s]
 81%|████████▏ | 302205/371472 [1:53:12<5:49:15,  3.31it/s]
 81%|████████▏ | 302206/371472 [1:53:12<5:40:13,  3.39it/s]
 81%|████████▏ | 302207/371472 [1:53:13<5:36:43,  3.43it/s]
 81%|████████▏ | 302208/371472 [1:53:13<5:29:11,  3.51it/s]
 81%|████████▏ | 302209/371472 [1:53:13<5:36:43,  3.43it/s]
 81%|████████▏ | 302210/371472 [1:53:13<5:32:11,  3.48it/s]
 81%|████████▏ | 302211/371472 [1:53:14<5:41:54,  3.38it/s]
 81%|████████▏ | 302212/371472 [1:53:14<5:33:03,  3.47it/s]
 81%|████████▏ | 302213/371472 [1:53:14<5:20:19,  3.60it/s]
 81%|████████▏ | 302214/371472 [1:53:15<5:22:46,  3.58it/s]
 81%|████████▏ | 302215/371472 [1:53:15<5:30:26,  3.49it/s]
 81%|████████▏ | 302216/371472 [1:53:15<5:41:11,  3.38it/s]
 81%|████████▏ | 302217/371472 [1:53:16<5:41:54,  3.38it/s]
 81%|████████▏ | 302218/371472 [1:53:16<5:32:42,  3.47it/s]
 81%|████████▏ | 302219/371472 [1:53:16<5:43:22,  3.36it/s]
 81%|████████▏ | 302220/371472 [1:53:16<5:36:49,  3.43it/s]
                                                           
{'loss': 2.633, 'learning_rate': 2.6787368829321894e-07, 'epoch': 13.02}

 81%|████████▏ | 302220/371472 [1:53:16<5:36:49,  3.43it/s]
 81%|████████▏ | 302221/371472 [1:53:17<5:46:30,  3.33it/s]
 81%|████████▏ | 302222/371472 [1:53:17<5:56:36,  3.24it/s]
 81%|████████▏ | 302223/371472 [1:53:17<6:15:58,  3.07it/s]
 81%|████████▏ | 302224/371472 [1:53:18<6:03:17,  3.18it/s]
 81%|████████▏ | 302225/371472 [1:53:18<5:53:39,  3.26it/s]
 81%|████████▏ | 302226/371472 [1:53:18<6:13:59,  3.09it/s]
 81%|████████▏ | 302227/371472 [1:53:19<6:19:33,  3.04it/s]
 81%|████████▏ | 302228/371472 [1:53:19<5:56:06,  3.24it/s]
 81%|████████▏ | 302229/371472 [1:53:19<5:56:44,  3.24it/s]
 81%|████████▏ | 302230/371472 [1:53:20<5:47:40,  3.32it/s]
 81%|████████▏ | 302231/371472 [1:53:20<6:04:57,  3.16it/s]
 81%|████████▏ | 302232/371472 [1:53:20<5:59:38,  3.21it/s]
 81%|████████▏ | 302233/371472 [1:53:20<5:53:27,  3.26it/s]
 81%|████████▏ | 302234/371472 [1:53:21<5:38:41,  3.41it/s]
 81%|████████▏ | 302235/371472 [1:53:21<5:22:24,  3.58it/s]
 81%|████████▏ | 302236/371472 [1:53:21<5:25:25,  3.55it/s]
 81%|████████▏ | 302237/371472 [1:53:22<5:09:40,  3.73it/s]
 81%|████████▏ | 302238/371472 [1:53:22<5:06:03,  3.77it/s]
 81%|████████▏ | 302239/371472 [1:53:22<5:12:25,  3.69it/s]
 81%|████████▏ | 302240/371472 [1:53:22<5:26:48,  3.53it/s]
                                                           
{'loss': 2.5473, 'learning_rate': 2.678252063177401e-07, 'epoch': 13.02}

 81%|████████▏ | 302240/371472 [1:53:22<5:26:48,  3.53it/s]
 81%|████████▏ | 302241/371472 [1:53:23<5:21:10,  3.59it/s]
 81%|████████▏ | 302242/371472 [1:53:23<5:27:05,  3.53it/s]
 81%|████████▏ | 302243/371472 [1:53:23<5:18:05,  3.63it/s]
 81%|████████▏ | 302244/371472 [1:53:23<5:15:38,  3.66it/s]
 81%|████████▏ | 302245/371472 [1:53:24<5:12:37,  3.69it/s]
 81%|████████▏ | 302246/371472 [1:53:24<5:13:30,  3.68it/s]
 81%|████████▏ | 302247/371472 [1:53:24<5:17:40,  3.63it/s]
 81%|████████▏ | 302248/371472 [1:53:25<5:07:03,  3.76it/s]
 81%|████████▏ | 302249/371472 [1:53:25<5:02:11,  3.82it/s]
 81%|████████▏ | 302250/371472 [1:53:25<5:21:32,  3.59it/s]
 81%|████████▏ | 302251/371472 [1:53:25<5:17:32,  3.63it/s]
 81%|████████▏ | 302252/371472 [1:53:26<5:08:57,  3.73it/s]
 81%|████████▏ | 302253/371472 [1:53:26<5:07:54,  3.75it/s]
 81%|████████▏ | 302254/371472 [1:53:26<5:30:48,  3.49it/s]
 81%|████████▏ | 302255/371472 [1:53:26<5:27:49,  3.52it/s]
 81%|████████▏ | 302256/371472 [1:53:27<5:22:28,  3.58it/s]
 81%|████████▏ | 302257/371472 [1:53:27<5:13:37,  3.68it/s]
 81%|████████▏ | 302258/371472 [1:53:27<5:10:26,  3.72it/s]
 81%|████████▏ | 302259/371472 [1:53:28<5:10:22,  3.72it/s]
 81%|████████▏ | 302260/371472 [1:53:28<5:23:16,  3.57it/s]
                                                           
{'loss': 2.4885, 'learning_rate': 2.677767243422612e-07, 'epoch': 13.02}

 81%|████████▏ | 302260/371472 [1:53:28<5:23:16,  3.57it/s]
 81%|████████▏ | 302261/371472 [1:53:28<5:18:58,  3.62it/s]
 81%|████████▏ | 302262/371472 [1:53:28<5:24:23,  3.56it/s]
 81%|████████▏ | 302263/371472 [1:53:29<5:17:00,  3.64it/s]
 81%|████████▏ | 302264/371472 [1:53:29<5:41:08,  3.38it/s]
 81%|████████▏ | 302265/371472 [1:53:29<5:47:02,  3.32it/s]
 81%|████████▏ | 302266/371472 [1:53:30<5:45:29,  3.34it/s]
 81%|████████▏ | 302267/371472 [1:53:30<5:25:46,  3.54it/s]
 81%|████████▏ | 302268/371472 [1:53:30<5:27:09,  3.53it/s]
 81%|████████▏ | 302269/371472 [1:53:31<7:29:26,  2.57it/s]
 81%|████████▏ | 302270/371472 [1:53:31<6:41:49,  2.87it/s]
 81%|████████▏ | 302271/371472 [1:53:31<6:51:27,  2.80it/s]
 81%|████████▏ | 302272/371472 [1:53:32<6:18:49,  3.04it/s]
 81%|████████▏ | 302273/371472 [1:53:32<5:59:48,  3.21it/s]
 81%|████████▏ | 302274/371472 [1:53:32<5:36:20,  3.43it/s]
 81%|████████▏ | 302275/371472 [1:53:32<5:43:33,  3.36it/s]
 81%|████████▏ | 302276/371472 [1:53:33<5:23:41,  3.56it/s]
 81%|████████▏ | 302277/371472 [1:53:33<6:09:06,  3.12it/s]
 81%|████████▏ | 302278/371472 [1:53:33<5:47:21,  3.32it/s]
 81%|████████▏ | 302279/371472 [1:53:34<5:40:55,  3.38it/s]
 81%|████████▏ | 302280/371472 [1:53:34<5:39:13,  3.40it/s]
                                                           
{'loss': 2.5479, 'learning_rate': 2.6772824236678237e-07, 'epoch': 13.02}

 81%|████████▏ | 302280/371472 [1:53:34<5:39:13,  3.40it/s]
 81%|████████▏ | 302281/371472 [1:53:34<5:31:23,  3.48it/s]
 81%|████████▏ | 302282/371472 [1:53:35<5:39:17,  3.40it/s]
 81%|████████▏ | 302283/371472 [1:53:35<5:18:53,  3.62it/s]
 81%|████████▏ | 302284/371472 [1:53:35<5:10:53,  3.71it/s]
 81%|████████▏ | 302285/371472 [1:53:35<5:20:01,  3.60it/s]
 81%|████████▏ | 302286/371472 [1:53:36<5:25:27,  3.54it/s]
 81%|████████▏ | 302287/371472 [1:53:36<5:14:05,  3.67it/s]
 81%|████████▏ | 302288/371472 [1:53:36<5:18:26,  3.62it/s]
 81%|████████▏ | 302289/371472 [1:53:36<5:12:20,  3.69it/s]
 81%|████████▏ | 302290/371472 [1:53:37<5:07:03,  3.76it/s]
 81%|████████▏ | 302291/371472 [1:53:37<5:17:15,  3.63it/s]
 81%|████████▏ | 302292/371472 [1:53:37<5:12:46,  3.69it/s]
 81%|████████▏ | 302293/371472 [1:53:38<5:23:42,  3.56it/s]
 81%|████████▏ | 302294/371472 [1:53:38<5:19:16,  3.61it/s]
 81%|████████▏ | 302295/371472 [1:53:38<5:25:35,  3.54it/s]
 81%|████████▏ | 302296/371472 [1:53:38<5:15:03,  3.66it/s]
 81%|████████▏ | 302297/371472 [1:53:39<5:08:37,  3.74it/s]
 81%|████████▏ | 302298/371472 [1:53:39<5:19:27,  3.61it/s]
 81%|████████▏ | 302299/371472 [1:53:39<5:22:25,  3.58it/s]
 81%|████████▏ | 302300/371472 [1:53:40<5:36:00,  3.43it/s]
                                                           
{'loss': 2.5428, 'learning_rate': 2.676797603913034e-07, 'epoch': 13.02}

 81%|████████▏ | 302300/371472 [1:53:40<5:36:00,  3.43it/s]
 81%|████████▏ | 302301/371472 [1:53:40<5:31:59,  3.47it/s]
 81%|████████▏ | 302302/371472 [1:53:40<5:15:09,  3.66it/s]
 81%|████████▏ | 302303/371472 [1:53:40<5:17:01,  3.64it/s]
 81%|████████▏ | 302304/371472 [1:53:41<5:24:28,  3.55it/s]
 81%|████████▏ | 302305/371472 [1:53:41<5:18:14,  3.62it/s]
 81%|████████▏ | 302306/371472 [1:53:41<5:33:20,  3.46it/s]
 81%|████████▏ | 302307/371472 [1:53:41<5:19:53,  3.60it/s]
 81%|████████▏ | 302308/371472 [1:53:42<5:18:06,  3.62it/s]
 81%|████████▏ | 302309/371472 [1:53:42<5:18:46,  3.62it/s]
 81%|████████▏ | 302310/371472 [1:53:42<5:20:28,  3.60it/s]
 81%|████████▏ | 302311/371472 [1:53:43<5:18:32,  3.62it/s]
 81%|████████▏ | 302312/371472 [1:53:43<5:12:23,  3.69it/s]
 81%|████████▏ | 302313/371472 [1:53:43<5:11:06,  3.70it/s]
 81%|████████▏ | 302314/371472 [1:53:43<5:28:36,  3.51it/s]
 81%|████████▏ | 302315/371472 [1:53:44<5:29:12,  3.50it/s]
 81%|████████▏ | 302316/371472 [1:53:44<5:19:16,  3.61it/s]
 81%|████████▏ | 302317/371472 [1:53:44<5:20:53,  3.59it/s]
 81%|████████▏ | 302318/371472 [1:53:45<5:23:28,  3.56it/s]
 81%|████████▏ | 302319/371472 [1:53:45<5:14:33,  3.66it/s]
 81%|████████▏ | 302320/371472 [1:53:45<5:20:27,  3.60it/s]
                                                           
{'loss': 2.5308, 'learning_rate': 2.676312784158245e-07, 'epoch': 13.02}

 81%|████████▏ | 302320/371472 [1:53:45<5:20:27,  3.60it/s]
 81%|████████▏ | 302321/371472 [1:53:45<5:11:31,  3.70it/s]
 81%|████████▏ | 302322/371472 [1:53:46<5:02:51,  3.81it/s]
 81%|████████▏ | 302323/371472 [1:53:46<5:17:59,  3.62it/s]
 81%|████████▏ | 302324/371472 [1:53:46<5:38:31,  3.40it/s]
 81%|████████▏ | 302325/371472 [1:53:46<5:26:21,  3.53it/s]
 81%|████████▏ | 302326/371472 [1:53:47<5:14:30,  3.66it/s]
 81%|████████▏ | 302327/371472 [1:53:47<5:05:57,  3.77it/s]
 81%|████████▏ | 302328/371472 [1:53:47<5:01:31,  3.82it/s]
 81%|████████▏ | 302329/371472 [1:53:47<5:11:26,  3.70it/s]
 81%|████████▏ | 302330/371472 [1:53:48<5:04:49,  3.78it/s]
 81%|████████▏ | 302331/371472 [1:53:48<5:15:53,  3.65it/s]
 81%|████████▏ | 302332/371472 [1:53:48<5:36:23,  3.43it/s]
 81%|████████▏ | 302333/371472 [1:53:49<5:27:29,  3.52it/s]
 81%|████████▏ | 302334/371472 [1:53:49<5:21:53,  3.58it/s]
 81%|████████▏ | 302335/371472 [1:53:49<5:14:02,  3.67it/s]
 81%|████████▏ | 302336/371472 [1:53:49<5:19:28,  3.61it/s]
 81%|████████▏ | 302337/371472 [1:53:50<5:45:49,  3.33it/s]
 81%|████████▏ | 302338/371472 [1:53:50<5:38:07,  3.41it/s]
 81%|████████▏ | 302339/371472 [1:53:50<5:25:20,  3.54it/s]
 81%|████████▏ | 302340/371472 [1:53:51<5:12:51,  3.68it/s]
                                                           
{'loss': 2.7441, 'learning_rate': 2.675827964403456e-07, 'epoch': 13.02}

 81%|████████▏ | 302340/371472 [1:53:51<5:12:51,  3.68it/s]
 81%|████████▏ | 302341/371472 [1:53:51<5:05:12,  3.78it/s]
 81%|████████▏ | 302342/371472 [1:53:51<5:03:40,  3.79it/s]
 81%|████████▏ | 302343/371472 [1:53:51<5:04:54,  3.78it/s]
 81%|████████▏ | 302344/371472 [1:53:52<5:11:11,  3.70it/s]
 81%|████████▏ | 302345/371472 [1:53:52<5:27:44,  3.52it/s]
 81%|████████▏ | 302346/371472 [1:53:52<5:21:49,  3.58it/s]
 81%|████████▏ | 302347/371472 [1:53:52<5:14:13,  3.67it/s]
 81%|████████▏ | 302348/371472 [1:53:53<5:24:38,  3.55it/s]
 81%|████████▏ | 302349/371472 [1:53:53<5:24:23,  3.55it/s]
 81%|████████▏ | 302350/371472 [1:53:53<6:03:54,  3.17it/s]
 81%|████████▏ | 302351/371472 [1:53:54<5:36:32,  3.42it/s]
 81%|████████▏ | 302352/371472 [1:53:54<5:20:54,  3.59it/s]
 81%|████████▏ | 302353/371472 [1:53:54<5:16:42,  3.64it/s]
 81%|████████▏ | 302354/371472 [1:53:54<5:03:40,  3.79it/s]
 81%|████████▏ | 302355/371472 [1:53:55<5:00:44,  3.83it/s]
 81%|████████▏ | 302356/371472 [1:53:55<4:52:53,  3.93it/s]
 81%|████████▏ | 302357/371472 [1:53:55<5:01:48,  3.82it/s]
 81%|████████▏ | 302358/371472 [1:53:56<5:05:00,  3.78it/s]
 81%|████████▏ | 302359/371472 [1:53:56<5:09:58,  3.72it/s]
 81%|████████▏ | 302360/371472 [1:53:56<5:14:51,  3.66it/s]
                                                           
{'loss': 2.5769, 'learning_rate': 2.6753431446486676e-07, 'epoch': 13.02}

 81%|████████▏ | 302360/371472 [1:53:56<5:14:51,  3.66it/s]
 81%|████████▏ | 302361/371472 [1:53:56<5:57:47,  3.22it/s]
 81%|████████▏ | 302362/371472 [1:53:57<5:48:10,  3.31it/s]
 81%|████████▏ | 302363/371472 [1:53:57<5:33:51,  3.45it/s]
 81%|████████▏ | 302364/371472 [1:53:57<5:28:20,  3.51it/s]
 81%|████████▏ | 302365/371472 [1:53:58<5:16:16,  3.64it/s]
 81%|████████▏ | 302366/371472 [1:53:58<5:11:50,  3.69it/s]
 81%|████████▏ | 302367/371472 [1:53:58<5:07:42,  3.74it/s]
 81%|████████▏ | 302368/371472 [1:53:58<5:06:53,  3.75it/s]
 81%|████████▏ | 302369/371472 [1:53:59<5:15:29,  3.65it/s]
 81%|████████▏ | 302370/371472 [1:53:59<5:23:37,  3.56it/s]
 81%|████████▏ | 302371/371472 [1:53:59<5:14:24,  3.66it/s]
 81%|████████▏ | 302372/371472 [1:53:59<5:04:59,  3.78it/s]
 81%|████████▏ | 302373/371472 [1:54:00<5:10:24,  3.71it/s]
 81%|████████▏ | 302374/371472 [1:54:00<5:39:38,  3.39it/s]
 81%|████████▏ | 302375/371472 [1:54:00<5:41:38,  3.37it/s]
 81%|████████▏ | 302376/371472 [1:54:01<5:27:47,  3.51it/s]
 81%|████████▏ | 302377/371472 [1:54:01<5:19:24,  3.61it/s]
 81%|████████▏ | 302378/371472 [1:54:01<5:15:15,  3.65it/s]
 81%|████████▏ | 302379/371472 [1:54:01<5:46:34,  3.32it/s]
 81%|████████▏ | 302380/371472 [1:54:02<5:27:43,  3.51it/s]
                                                           
{'loss': 2.7615, 'learning_rate': 2.6748583248938783e-07, 'epoch': 13.02}

 81%|████████▏ | 302380/371472 [1:54:02<5:27:43,  3.51it/s]
 81%|████████▏ | 302381/371472 [1:54:02<5:28:31,  3.51it/s]
 81%|████████▏ | 302382/371472 [1:54:02<5:39:49,  3.39it/s]
 81%|████████▏ | 302383/371472 [1:54:03<5:22:53,  3.57it/s]
 81%|████████▏ | 302384/371472 [1:54:03<5:07:13,  3.75it/s]
 81%|████████▏ | 302385/371472 [1:54:03<4:59:27,  3.85it/s]
 81%|████████▏ | 302386/371472 [1:54:03<5:00:30,  3.83it/s]
 81%|████████▏ | 302387/371472 [1:54:04<5:01:29,  3.82it/s]
 81%|████████▏ | 302388/371472 [1:54:04<5:10:49,  3.70it/s]
 81%|████████▏ | 302389/371472 [1:54:04<5:07:09,  3.75it/s]
 81%|████████▏ | 302390/371472 [1:54:04<5:21:47,  3.58it/s]
 81%|████████▏ | 302391/371472 [1:54:05<5:20:05,  3.60it/s]
 81%|████████▏ | 302392/371472 [1:54:05<5:33:28,  3.45it/s]
 81%|████████▏ | 302393/371472 [1:54:05<5:14:13,  3.66it/s]
 81%|████████▏ | 302394/371472 [1:54:06<5:10:21,  3.71it/s]
 81%|████████▏ | 302395/371472 [1:54:06<5:32:42,  3.46it/s]
 81%|████████▏ | 302396/371472 [1:54:06<5:46:47,  3.32it/s]
 81%|████████▏ | 302397/371472 [1:54:06<5:38:04,  3.41it/s]
 81%|████████▏ | 302398/371472 [1:54:07<5:29:29,  3.49it/s]
 81%|████████▏ | 302399/371472 [1:54:07<5:41:44,  3.37it/s]
 81%|████████▏ | 302400/371472 [1:54:07<5:37:19,  3.41it/s]
                                                           
{'loss': 2.6189, 'learning_rate': 2.67437350513909e-07, 'epoch': 13.02}

 81%|████████▏ | 302400/371472 [1:54:07<5:37:19,  3.41it/s]
 81%|████████▏ | 302401/371472 [1:54:08<5:30:05,  3.49it/s]
 81%|████████▏ | 302402/371472 [1:54:08<5:26:19,  3.53it/s]
 81%|████████▏ | 302403/371472 [1:54:08<5:17:59,  3.62it/s]
 81%|████████▏ | 302404/371472 [1:54:09<5:49:03,  3.30it/s]
 81%|████████▏ | 302405/371472 [1:54:09<5:43:34,  3.35it/s]
 81%|████████▏ | 302406/371472 [1:54:09<5:50:56,  3.28it/s]
 81%|████████▏ | 302407/371472 [1:54:09<5:58:12,  3.21it/s]
 81%|████████▏ | 302408/371472 [1:54:10<5:45:36,  3.33it/s]
 81%|████████▏ | 302409/371472 [1:54:10<5:30:54,  3.48it/s]
 81%|████████▏ | 302410/371472 [1:54:10<5:47:11,  3.32it/s]
 81%|████████▏ | 302411/371472 [1:54:11<5:46:41,  3.32it/s]
 81%|████████▏ | 302412/371472 [1:54:11<6:31:03,  2.94it/s]
 81%|████████▏ | 302413/371472 [1:54:11<6:05:09,  3.15it/s]
 81%|████████▏ | 302414/371472 [1:54:12<5:55:03,  3.24it/s]
 81%|████████▏ | 302415/371472 [1:54:12<5:52:21,  3.27it/s]
 81%|████████▏ | 302416/371472 [1:54:12<5:42:15,  3.36it/s]
 81%|████████▏ | 302417/371472 [1:54:12<5:28:00,  3.51it/s]
 81%|████████▏ | 302418/371472 [1:54:13<5:22:11,  3.57it/s]
 81%|████████▏ | 302419/371472 [1:54:13<5:35:18,  3.43it/s]
 81%|████████▏ | 302420/371472 [1:54:13<5:29:43,  3.49it/s]
                                                           
{'loss': 2.6219, 'learning_rate': 2.6738886853843003e-07, 'epoch': 13.03}

 81%|████████▏ | 302420/371472 [1:54:13<5:29:43,  3.49it/s]
 81%|████████▏ | 302421/371472 [1:54:14<5:36:31,  3.42it/s]
 81%|████████▏ | 302422/371472 [1:54:14<5:48:46,  3.30it/s]
 81%|████████▏ | 302423/371472 [1:54:14<5:30:53,  3.48it/s]
 81%|████████▏ | 302424/371472 [1:54:14<5:17:44,  3.62it/s]
 81%|████████▏ | 302425/371472 [1:54:15<5:27:37,  3.51it/s]
 81%|████████▏ | 302426/371472 [1:54:15<5:25:20,  3.54it/s]
 81%|████████▏ | 302427/371472 [1:54:15<5:24:51,  3.54it/s]
 81%|████████▏ | 302428/371472 [1:54:16<5:20:42,  3.59it/s]
 81%|████████▏ | 302429/371472 [1:54:16<5:10:19,  3.71it/s]
 81%|████████▏ | 302430/371472 [1:54:16<5:23:31,  3.56it/s]
 81%|████████▏ | 302431/371472 [1:54:16<5:20:33,  3.59it/s]
 81%|████████▏ | 302432/371472 [1:54:17<5:11:31,  3.69it/s]
 81%|████████▏ | 302433/371472 [1:54:17<5:12:21,  3.68it/s]
 81%|████████▏ | 302434/371472 [1:54:17<5:29:46,  3.49it/s]
 81%|████████▏ | 302435/371472 [1:54:17<5:13:16,  3.67it/s]
 81%|████████▏ | 302436/371472 [1:54:18<5:10:04,  3.71it/s]
 81%|████████▏ | 302437/371472 [1:54:18<5:09:37,  3.72it/s]
 81%|████████▏ | 302438/371472 [1:54:18<5:04:56,  3.77it/s]
 81%|████████▏ | 302439/371472 [1:54:19<4:58:14,  3.86it/s]
 81%|████████▏ | 302440/371472 [1:54:19<5:26:41,  3.52it/s]
                                                           
{'loss': 2.7262, 'learning_rate': 2.673403865629511e-07, 'epoch': 13.03}

 81%|████████▏ | 302440/371472 [1:54:19<5:26:41,  3.52it/s]
 81%|████████▏ | 302441/371472 [1:54:19<5:24:40,  3.54it/s]
 81%|████████▏ | 302442/371472 [1:54:19<5:50:07,  3.29it/s]
 81%|████████▏ | 302443/371472 [1:54:20<5:54:29,  3.25it/s]
 81%|████████▏ | 302444/371472 [1:54:20<5:56:01,  3.23it/s]
 81%|████████▏ | 302445/371472 [1:54:20<6:05:42,  3.15it/s]
 81%|████████▏ | 302446/371472 [1:54:21<5:42:18,  3.36it/s]
 81%|████████▏ | 302447/371472 [1:54:21<5:45:19,  3.33it/s]
 81%|████████▏ | 302448/371472 [1:54:21<5:24:52,  3.54it/s]
 81%|████████▏ | 302449/371472 [1:54:22<5:17:37,  3.62it/s]
 81%|████████▏ | 302450/371472 [1:54:22<5:08:46,  3.73it/s]
 81%|████████▏ | 302451/371472 [1:54:22<5:05:59,  3.76it/s]
 81%|████████▏ | 302452/371472 [1:54:22<5:13:10,  3.67it/s]
 81%|████████▏ | 302453/371472 [1:54:23<5:12:01,  3.69it/s]
 81%|████████▏ | 302454/371472 [1:54:23<5:12:10,  3.68it/s]
 81%|████████▏ | 302455/371472 [1:54:23<5:12:04,  3.69it/s]
 81%|████████▏ | 302456/371472 [1:54:23<5:07:59,  3.73it/s]
 81%|████████▏ | 302457/371472 [1:54:24<5:03:37,  3.79it/s]
 81%|████████▏ | 302458/371472 [1:54:24<5:03:26,  3.79it/s]
 81%|████████▏ | 302459/371472 [1:54:24<5:21:44,  3.57it/s]
 81%|████████▏ | 302460/371472 [1:54:24<5:10:41,  3.70it/s]
                                                           
{'loss': 2.4711, 'learning_rate': 2.672919045874722e-07, 'epoch': 13.03}

 81%|████████▏ | 302460/371472 [1:54:24<5:10:41,  3.70it/s]
 81%|████████▏ | 302461/371472 [1:54:25<5:29:35,  3.49it/s]
 81%|████████▏ | 302462/371472 [1:54:25<5:20:46,  3.59it/s]
 81%|████████▏ | 302463/371472 [1:54:25<5:38:12,  3.40it/s]
 81%|████████▏ | 302464/371472 [1:54:26<5:36:16,  3.42it/s]
 81%|████████▏ | 302465/371472 [1:54:26<5:24:49,  3.54it/s]
 81%|████████▏ | 302466/371472 [1:54:26<5:21:14,  3.58it/s]
 81%|████████▏ | 302467/371472 [1:54:27<5:42:50,  3.35it/s]
 81%|████████▏ | 302468/371472 [1:54:27<5:30:22,  3.48it/s]
 81%|████████▏ | 302469/371472 [1:54:27<5:44:04,  3.34it/s]
 81%|████████▏ | 302470/371472 [1:54:27<5:31:46,  3.47it/s]
 81%|████████▏ | 302471/371472 [1:54:28<5:19:25,  3.60it/s]
 81%|████████▏ | 302472/371472 [1:54:28<5:27:10,  3.51it/s]
 81%|████████▏ | 302473/371472 [1:54:28<5:37:21,  3.41it/s]
 81%|████████▏ | 302474/371472 [1:54:29<5:22:45,  3.56it/s]
 81%|████████▏ | 302475/371472 [1:54:29<5:22:56,  3.56it/s]
 81%|████████▏ | 302476/371472 [1:54:29<5:17:51,  3.62it/s]
 81%|████████▏ | 302477/371472 [1:54:29<5:09:50,  3.71it/s]
 81%|████████▏ | 302478/371472 [1:54:30<5:19:58,  3.59it/s]
 81%|████████▏ | 302479/371472 [1:54:30<5:43:00,  3.35it/s]
 81%|████████▏ | 302480/371472 [1:54:30<5:41:23,  3.37it/s]
                                                           
{'loss': 2.6528, 'learning_rate': 2.672434226119933e-07, 'epoch': 13.03}

 81%|████████▏ | 302480/371472 [1:54:30<5:41:23,  3.37it/s]
 81%|████████▏ | 302481/371472 [1:54:31<5:42:27,  3.36it/s]
 81%|████████▏ | 302482/371472 [1:54:31<5:40:57,  3.37it/s]
 81%|████████▏ | 302483/371472 [1:54:31<5:48:34,  3.30it/s]
 81%|████████▏ | 302484/371472 [1:54:31<5:52:00,  3.27it/s]
 81%|████████▏ | 302485/371472 [1:54:32<5:54:00,  3.25it/s]
 81%|████████▏ | 302486/371472 [1:54:32<5:34:21,  3.44it/s]
 81%|████████▏ | 302487/371472 [1:54:32<5:20:13,  3.59it/s]
 81%|████████▏ | 302488/371472 [1:54:33<5:25:20,  3.53it/s]
 81%|████████▏ | 302489/371472 [1:54:33<5:16:34,  3.63it/s]
 81%|████████▏ | 302490/371472 [1:54:33<5:09:51,  3.71it/s]
 81%|████████▏ | 302491/371472 [1:54:33<5:30:56,  3.47it/s]
 81%|████████▏ | 302492/371472 [1:54:34<5:19:42,  3.60it/s]
 81%|████████▏ | 302493/371472 [1:54:34<5:30:00,  3.48it/s]
 81%|████████▏ | 302494/371472 [1:54:34<5:24:11,  3.55it/s]
 81%|████████▏ | 302495/371472 [1:54:35<5:30:20,  3.48it/s]
 81%|████████▏ | 302496/371472 [1:54:35<5:44:33,  3.34it/s]
 81%|████████▏ | 302497/371472 [1:54:35<5:30:16,  3.48it/s]
 81%|████████▏ | 302498/371472 [1:54:35<5:29:17,  3.49it/s]
 81%|████████▏ | 302499/371472 [1:54:36<5:17:32,  3.62it/s]
 81%|████████▏ | 302500/371472 [1:54:36<5:22:11,  3.57it/s]
                                                           
{'loss': 2.7579, 'learning_rate': 2.671949406365145e-07, 'epoch': 13.03}

 81%|████████▏ | 302500/371472 [1:54:36<5:22:11,  3.57it/s]
 81%|████████▏ | 302501/371472 [1:54:36<5:23:04,  3.56it/s]
 81%|████████▏ | 302502/371472 [1:54:37<5:11:47,  3.69it/s]
 81%|████████▏ | 302503/371472 [1:54:37<5:21:02,  3.58it/s]
 81%|████████▏ | 302504/371472 [1:54:37<5:18:31,  3.61it/s]
 81%|████████▏ | 302505/371472 [1:54:37<5:25:21,  3.53it/s]
 81%|████████▏ | 302506/371472 [1:54:38<5:21:18,  3.58it/s]
 81%|████████▏ | 302507/371472 [1:54:38<5:52:04,  3.26it/s]
 81%|████████▏ | 302508/371472 [1:54:38<5:38:18,  3.40it/s]
 81%|████████▏ | 302509/371472 [1:54:39<5:28:35,  3.50it/s]
 81%|████████▏ | 302510/371472 [1:54:39<5:18:28,  3.61it/s]
 81%|████████▏ | 302511/371472 [1:54:39<5:24:04,  3.55it/s]
 81%|████████▏ | 302512/371472 [1:54:39<5:15:45,  3.64it/s]
 81%|████████▏ | 302513/371472 [1:54:40<5:07:14,  3.74it/s]
 81%|████████▏ | 302514/371472 [1:54:40<5:11:48,  3.69it/s]
 81%|████████▏ | 302515/371472 [1:54:40<5:04:59,  3.77it/s]
 81%|████████▏ | 302516/371472 [1:54:40<5:07:23,  3.74it/s]
 81%|████████▏ | 302517/371472 [1:54:41<5:06:00,  3.76it/s]
 81%|████████▏ | 302518/371472 [1:54:41<5:15:32,  3.64it/s]
 81%|████████▏ | 302519/371472 [1:54:41<5:06:59,  3.74it/s]
 81%|████████▏ | 302520/371472 [1:54:42<5:21:04,  3.58it/s]
                                                           
{'loss': 2.5941, 'learning_rate': 2.6714645866103555e-07, 'epoch': 13.03}

 81%|████████▏ | 302520/371472 [1:54:42<5:21:04,  3.58it/s]
 81%|████████▏ | 302521/371472 [1:54:42<5:13:06,  3.67it/s]
 81%|████████▏ | 302522/371472 [1:54:42<5:10:00,  3.71it/s]
 81%|████████▏ | 302523/371472 [1:54:42<5:05:32,  3.76it/s]
 81%|████████▏ | 302524/371472 [1:54:43<5:28:29,  3.50it/s]
 81%|████████▏ | 302525/371472 [1:54:43<6:05:45,  3.14it/s]
 81%|████████▏ | 302526/371472 [1:54:43<5:52:08,  3.26it/s]
 81%|████████▏ | 302527/371472 [1:54:44<5:30:31,  3.48it/s]
 81%|████████▏ | 302528/371472 [1:54:44<5:23:59,  3.55it/s]
 81%|████████▏ | 302529/371472 [1:54:44<5:13:58,  3.66it/s]
 81%|████████▏ | 302530/371472 [1:54:44<5:26:14,  3.52it/s]
 81%|████████▏ | 302531/371472 [1:54:45<5:26:15,  3.52it/s]
 81%|████████▏ | 302532/371472 [1:54:45<5:19:35,  3.60it/s]
 81%|████████▏ | 302533/371472 [1:54:45<5:06:59,  3.74it/s]
 81%|████████▏ | 302534/371472 [1:54:45<5:19:36,  3.59it/s]
 81%|████████▏ | 302535/371472 [1:54:46<5:09:52,  3.71it/s]
 81%|████████▏ | 302536/371472 [1:54:46<5:12:55,  3.67it/s]
 81%|████████▏ | 302537/371472 [1:54:46<5:26:55,  3.51it/s]
 81%|████████▏ | 302538/371472 [1:54:47<5:26:53,  3.51it/s]
 81%|████████▏ | 302539/371472 [1:54:47<5:53:38,  3.25it/s]
 81%|████████▏ | 302540/371472 [1:54:47<5:44:37,  3.33it/s]
                                                           
{'loss': 2.6373, 'learning_rate': 2.6709797668555667e-07, 'epoch': 13.03}

 81%|████████▏ | 302540/371472 [1:54:47<5:44:37,  3.33it/s]
 81%|████████▏ | 302541/371472 [1:54:48<5:55:56,  3.23it/s]
 81%|████████▏ | 302542/371472 [1:54:48<5:33:18,  3.45it/s]
 81%|████████▏ | 302543/371472 [1:54:48<5:36:40,  3.41it/s]
 81%|████████▏ | 302544/371472 [1:54:48<5:27:23,  3.51it/s]
 81%|████████▏ | 302545/371472 [1:54:49<5:49:14,  3.29it/s]
 81%|████████▏ | 302546/371472 [1:54:49<5:30:01,  3.48it/s]
 81%|████████▏ | 302547/371472 [1:54:49<5:12:26,  3.68it/s]
 81%|████████▏ | 302548/371472 [1:54:50<5:24:55,  3.54it/s]
 81%|████████▏ | 302549/371472 [1:54:50<5:16:17,  3.63it/s]
 81%|████████▏ | 302550/371472 [1:54:50<5:24:22,  3.54it/s]
 81%|████████▏ | 302551/371472 [1:54:50<5:53:40,  3.25it/s]
 81%|████████▏ | 302552/371472 [1:54:51<5:44:20,  3.34it/s]
 81%|████████▏ | 302553/371472 [1:54:51<5:32:05,  3.46it/s]
 81%|████████▏ | 302554/371472 [1:54:51<5:29:26,  3.49it/s]
 81%|████████▏ | 302555/371472 [1:54:52<5:34:16,  3.44it/s]
 81%|████████▏ | 302556/371472 [1:54:52<5:24:16,  3.54it/s]
 81%|████████▏ | 302557/371472 [1:54:52<5:17:39,  3.62it/s]
 81%|████████▏ | 302558/371472 [1:54:52<5:25:24,  3.53it/s]
 81%|████████▏ | 302559/371472 [1:54:53<5:19:08,  3.60it/s]
 81%|████████▏ | 302560/371472 [1:54:53<5:16:28,  3.63it/s]
                                                           
{'loss': 2.7049, 'learning_rate': 2.6704949471007774e-07, 'epoch': 13.03}

 81%|████████▏ | 302560/371472 [1:54:53<5:16:28,  3.63it/s]
 81%|████████▏ | 302561/371472 [1:54:53<5:22:19,  3.56it/s]
 81%|████████▏ | 302562/371472 [1:54:54<5:30:53,  3.47it/s]
 81%|████████▏ | 302563/371472 [1:54:54<5:46:15,  3.32it/s]
 81%|████████▏ | 302564/371472 [1:54:54<5:36:14,  3.42it/s]
 81%|████████▏ | 302565/371472 [1:54:54<5:28:28,  3.50it/s]
 81%|████████▏ | 302566/371472 [1:54:55<5:41:46,  3.36it/s]
 81%|████████▏ | 302567/371472 [1:54:55<5:35:00,  3.43it/s]
 81%|████████▏ | 302568/371472 [1:54:55<5:31:20,  3.47it/s]
 81%|████████▏ | 302569/371472 [1:54:56<5:33:24,  3.44it/s]
 81%|████████▏ | 302570/371472 [1:54:56<5:47:05,  3.31it/s]
 81%|████████▏ | 302571/371472 [1:54:56<5:46:46,  3.31it/s]
 81%|████████▏ | 302572/371472 [1:54:56<5:32:18,  3.46it/s]
 81%|████████▏ | 302573/371472 [1:54:57<5:27:14,  3.51it/s]
 81%|████████▏ | 302574/371472 [1:54:57<5:21:10,  3.58it/s]
 81%|████████▏ | 302575/371472 [1:54:57<5:19:00,  3.60it/s]
 81%|████████▏ | 302576/371472 [1:54:58<5:13:52,  3.66it/s]
 81%|████████▏ | 302577/371472 [1:54:58<5:25:08,  3.53it/s]
 81%|████████▏ | 302578/371472 [1:54:58<5:17:22,  3.62it/s]
 81%|████████▏ | 302579/371472 [1:54:58<5:24:27,  3.54it/s]
 81%|████████▏ | 302580/371472 [1:54:59<5:22:35,  3.56it/s]
                                                           
{'loss': 2.6878, 'learning_rate': 2.6700101273459887e-07, 'epoch': 13.03}

 81%|████████▏ | 302580/371472 [1:54:59<5:22:35,  3.56it/s]
 81%|████████▏ | 302581/371472 [1:54:59<5:09:15,  3.71it/s]
 81%|████████▏ | 302582/371472 [1:54:59<5:08:07,  3.73it/s]
 81%|████████▏ | 302583/371472 [1:54:59<5:10:20,  3.70it/s]
 81%|████████▏ | 302584/371472 [1:55:00<5:06:57,  3.74it/s]
 81%|████████▏ | 302585/371472 [1:55:00<5:10:25,  3.70it/s]
 81%|████████▏ | 302586/371472 [1:55:00<5:01:00,  3.81it/s]
 81%|████████▏ | 302587/371472 [1:55:01<4:59:56,  3.83it/s]
 81%|████████▏ | 302588/371472 [1:55:01<5:12:39,  3.67it/s]
 81%|████████▏ | 302589/371472 [1:55:01<5:17:50,  3.61it/s]
 81%|████████▏ | 302590/371472 [1:55:01<5:07:05,  3.74it/s]
 81%|████████▏ | 302591/371472 [1:55:02<4:59:02,  3.84it/s]
 81%|████████▏ | 302592/371472 [1:55:02<5:21:36,  3.57it/s]
 81%|████████▏ | 302593/371472 [1:55:02<5:14:54,  3.65it/s]
 81%|████████▏ | 302594/371472 [1:55:02<5:16:27,  3.63it/s]
 81%|████████▏ | 302595/371472 [1:55:03<5:23:17,  3.55it/s]
 81%|████████▏ | 302596/371472 [1:55:03<5:29:01,  3.49it/s]
 81%|████████▏ | 302597/371472 [1:55:03<5:22:18,  3.56it/s]
 81%|████████▏ | 302598/371472 [1:55:04<5:41:43,  3.36it/s]
 81%|████████▏ | 302599/371472 [1:55:04<5:29:55,  3.48it/s]
 81%|████████▏ | 302600/371472 [1:55:04<5:47:30,  3.30it/s]
                                                           
{'loss': 2.6419, 'learning_rate': 2.6695253075911994e-07, 'epoch': 13.03}

 81%|████████▏ | 302600/371472 [1:55:04<5:47:30,  3.30it/s]
 81%|████████▏ | 302601/371472 [1:55:05<5:43:34,  3.34it/s]
 81%|████████▏ | 302602/371472 [1:55:05<5:32:16,  3.45it/s]
 81%|████████▏ | 302603/371472 [1:55:05<5:22:47,  3.56it/s]
 81%|████████▏ | 302604/371472 [1:55:05<5:34:00,  3.44it/s]
 81%|████████▏ | 302605/371472 [1:55:06<5:23:54,  3.54it/s]
 81%|████████▏ | 302606/371472 [1:55:06<5:26:53,  3.51it/s]
 81%|████████▏ | 302607/371472 [1:55:06<5:35:51,  3.42it/s]
 81%|████████▏ | 302608/371472 [1:55:07<5:35:58,  3.42it/s]
 81%|████████▏ | 302609/371472 [1:55:07<5:39:31,  3.38it/s]
 81%|████████▏ | 302610/371472 [1:55:07<5:34:50,  3.43it/s]
 81%|████████▏ | 302611/371472 [1:55:07<5:22:52,  3.55it/s]
 81%|████████▏ | 302612/371472 [1:55:08<6:09:11,  3.11it/s]
 81%|████████▏ | 302613/371472 [1:55:08<5:43:29,  3.34it/s]
 81%|████████▏ | 302614/371472 [1:55:08<5:55:22,  3.23it/s]
 81%|████████▏ | 302615/371472 [1:55:09<5:51:41,  3.26it/s]
 81%|████████▏ | 302616/371472 [1:55:09<5:36:44,  3.41it/s]
 81%|████████▏ | 302617/371472 [1:55:09<5:44:56,  3.33it/s]
 81%|████████▏ | 302618/371472 [1:55:10<5:30:04,  3.48it/s]
 81%|████████▏ | 302619/371472 [1:55:10<5:19:48,  3.59it/s]
 81%|████████▏ | 302620/371472 [1:55:10<5:20:12,  3.58it/s]
                                                           
{'loss': 2.5144, 'learning_rate': 2.669040487836411e-07, 'epoch': 13.03}

 81%|████████▏ | 302620/371472 [1:55:10<5:20:12,  3.58it/s]
 81%|████████▏ | 302621/371472 [1:55:10<5:15:33,  3.64it/s]
 81%|████████▏ | 302622/371472 [1:55:11<5:12:43,  3.67it/s]
 81%|████████▏ | 302623/371472 [1:55:11<5:16:31,  3.63it/s]
 81%|████████▏ | 302624/371472 [1:55:11<5:08:14,  3.72it/s]
 81%|████████▏ | 302625/371472 [1:55:11<5:12:09,  3.68it/s]
 81%|████████▏ | 302626/371472 [1:55:12<5:11:51,  3.68it/s]
 81%|████████▏ | 302627/371472 [1:55:12<5:07:35,  3.73it/s]
 81%|████████▏ | 302628/371472 [1:55:12<5:37:40,  3.40it/s]
 81%|████████▏ | 302629/371472 [1:55:13<5:21:37,  3.57it/s]
 81%|████████▏ | 302630/371472 [1:55:13<5:20:12,  3.58it/s]
 81%|████████▏ | 302631/371472 [1:55:13<5:12:44,  3.67it/s]
 81%|████████▏ | 302632/371472 [1:55:13<5:09:15,  3.71it/s]
 81%|████████▏ | 302633/371472 [1:55:14<5:20:15,  3.58it/s]
 81%|████████▏ | 302634/371472 [1:55:14<5:19:36,  3.59it/s]
 81%|████████▏ | 302635/371472 [1:55:14<5:21:07,  3.57it/s]
 81%|████████▏ | 302636/371472 [1:55:14<5:11:50,  3.68it/s]
 81%|████████▏ | 302637/371472 [1:55:15<5:11:57,  3.68it/s]
 81%|████████▏ | 302638/371472 [1:55:15<5:02:45,  3.79it/s]
 81%|████████▏ | 302639/371472 [1:55:15<5:12:44,  3.67it/s]
 81%|████████▏ | 302640/371472 [1:55:16<5:26:45,  3.51it/s]
                                                           
{'loss': 2.6666, 'learning_rate': 2.668555668081622e-07, 'epoch': 13.04}

 81%|████████▏ | 302640/371472 [1:55:16<5:26:45,  3.51it/s]
 81%|████████▏ | 302641/371472 [1:55:16<5:29:38,  3.48it/s]
 81%|████████▏ | 302642/371472 [1:55:16<5:30:10,  3.47it/s]
 81%|████████▏ | 302643/371472 [1:55:16<5:22:12,  3.56it/s]
 81%|████████▏ | 302644/371472 [1:55:17<5:11:59,  3.68it/s]
 81%|████████▏ | 302645/371472 [1:55:17<5:40:13,  3.37it/s]
 81%|████████▏ | 302646/371472 [1:55:17<5:50:16,  3.27it/s]
 81%|████████▏ | 302647/371472 [1:55:18<5:27:32,  3.50it/s]
 81%|████████▏ | 302648/371472 [1:55:18<5:18:59,  3.60it/s]
 81%|████████▏ | 302649/371472 [1:55:18<5:11:11,  3.69it/s]
 81%|████████▏ | 302650/371472 [1:55:18<5:12:32,  3.67it/s]
 81%|████████▏ | 302651/371472 [1:55:19<5:13:38,  3.66it/s]
 81%|████████▏ | 302652/371472 [1:55:19<5:27:07,  3.51it/s]
 81%|████████▏ | 302653/371472 [1:55:19<5:08:11,  3.72it/s]
 81%|████████▏ | 302654/371472 [1:55:19<5:10:56,  3.69it/s]
 81%|████████▏ | 302655/371472 [1:55:20<6:00:57,  3.18it/s]
 81%|████████▏ | 302656/371472 [1:55:20<5:39:31,  3.38it/s]
 81%|████████▏ | 302657/371472 [1:55:20<5:22:59,  3.55it/s]
 81%|████████▏ | 302658/371472 [1:55:21<5:31:48,  3.46it/s]
 81%|████████▏ | 302659/371472 [1:55:21<5:38:37,  3.39it/s]
 81%|████████▏ | 302660/371472 [1:55:21<5:35:01,  3.42it/s]
                                                           
{'loss': 2.7529, 'learning_rate': 2.6680708483268336e-07, 'epoch': 13.04}

 81%|████████▏ | 302660/371472 [1:55:21<5:35:01,  3.42it/s]
 81%|████████▏ | 302661/371472 [1:55:22<5:24:44,  3.53it/s]
 81%|████████▏ | 302662/371472 [1:55:22<5:18:56,  3.60it/s]
 81%|████████▏ | 302663/371472 [1:55:22<5:03:38,  3.78it/s]
 81%|████████▏ | 302664/371472 [1:55:22<5:08:51,  3.71it/s]
 81%|████████▏ | 302665/371472 [1:55:23<5:14:40,  3.64it/s]
 81%|████████▏ | 302666/371472 [1:55:23<5:13:33,  3.66it/s]
 81%|████████▏ | 302667/371472 [1:55:23<5:22:50,  3.55it/s]
 81%|████████▏ | 302668/371472 [1:55:23<5:20:32,  3.58it/s]
 81%|████████▏ | 302669/371472 [1:55:24<5:10:10,  3.70it/s]
 81%|████████▏ | 302670/371472 [1:55:24<5:12:00,  3.68it/s]
 81%|████████▏ | 302671/371472 [1:55:24<4:58:00,  3.85it/s]
 81%|████████▏ | 302672/371472 [1:55:24<4:51:33,  3.93it/s]
 81%|████████▏ | 302673/371472 [1:55:25<4:59:28,  3.83it/s]
 81%|████████▏ | 302674/371472 [1:55:25<5:06:56,  3.74it/s]
 81%|████████▏ | 302675/371472 [1:55:25<5:21:30,  3.57it/s]
 81%|████████▏ | 302676/371472 [1:55:26<5:16:19,  3.62it/s]
 81%|████████▏ | 302677/371472 [1:55:26<5:09:01,  3.71it/s]
 81%|████████▏ | 302678/371472 [1:55:26<5:29:41,  3.48it/s]
 81%|████████▏ | 302679/371472 [1:55:26<5:19:21,  3.59it/s]
 81%|████████▏ | 302680/371472 [1:55:27<5:08:53,  3.71it/s]
                                                           
{'loss': 2.7241, 'learning_rate': 2.667586028572044e-07, 'epoch': 13.04}

 81%|████████▏ | 302680/371472 [1:55:27<5:08:53,  3.71it/s]
 81%|████████▏ | 302681/371472 [1:55:27<5:03:39,  3.78it/s]
 81%|████████▏ | 302682/371472 [1:55:27<5:03:57,  3.77it/s]
 81%|████████▏ | 302683/371472 [1:55:27<5:03:57,  3.77it/s]
 81%|████████▏ | 302684/371472 [1:55:28<5:05:20,  3.75it/s]
 81%|████████▏ | 302685/371472 [1:55:28<5:11:28,  3.68it/s]
 81%|████████▏ | 302686/371472 [1:55:28<4:58:59,  3.83it/s]
 81%|████████▏ | 302687/371472 [1:55:29<4:53:39,  3.90it/s]
 81%|████████▏ | 302688/371472 [1:55:29<5:23:41,  3.54it/s]
 81%|████████▏ | 302689/371472 [1:55:29<5:28:24,  3.49it/s]
 81%|████████▏ | 302690/371472 [1:55:30<5:43:54,  3.33it/s]
 81%|████████▏ | 302691/371472 [1:55:30<5:40:17,  3.37it/s]
 81%|████████▏ | 302692/371472 [1:55:30<5:26:57,  3.51it/s]
 81%|████████▏ | 302693/371472 [1:55:30<5:14:39,  3.64it/s]
 81%|████████▏ | 302694/371472 [1:55:31<5:17:35,  3.61it/s]
 81%|████████▏ | 302695/371472 [1:55:31<5:12:58,  3.66it/s]
 81%|████████▏ | 302696/371472 [1:55:31<5:24:38,  3.53it/s]
 81%|████████▏ | 302697/371472 [1:55:31<5:21:37,  3.56it/s]
 81%|████████▏ | 302698/371472 [1:55:32<5:38:21,  3.39it/s]
 81%|████████▏ | 302699/371472 [1:55:32<5:50:55,  3.27it/s]
 81%|████████▏ | 302700/371472 [1:55:32<5:38:39,  3.38it/s]
                                                           
{'loss': 2.6292, 'learning_rate': 2.667101208817255e-07, 'epoch': 13.04}

 81%|████████▏ | 302700/371472 [1:55:32<5:38:39,  3.38it/s]
 81%|████████▏ | 302701/371472 [1:55:33<5:40:54,  3.36it/s]
 81%|████████▏ | 302702/371472 [1:55:33<5:27:58,  3.49it/s]
 81%|████████▏ | 302703/371472 [1:55:33<5:10:30,  3.69it/s]
 81%|████████▏ | 302704/371472 [1:55:33<5:14:03,  3.65it/s]
 81%|████████▏ | 302705/371472 [1:55:34<5:10:08,  3.70it/s]
 81%|████████▏ | 302706/371472 [1:55:34<5:09:37,  3.70it/s]
 81%|████████▏ | 302707/371472 [1:55:34<4:59:07,  3.83it/s]
 81%|████████▏ | 302708/371472 [1:55:35<5:18:28,  3.60it/s]
 81%|████████▏ | 302709/371472 [1:55:35<5:21:34,  3.56it/s]
 81%|████████▏ | 302710/371472 [1:55:35<5:17:29,  3.61it/s]
 81%|████████▏ | 302711/371472 [1:55:35<5:28:19,  3.49it/s]
 81%|████████▏ | 302712/371472 [1:55:36<5:38:57,  3.38it/s]
 81%|████████▏ | 302713/371472 [1:55:36<5:27:51,  3.50it/s]
 81%|████████▏ | 302714/371472 [1:55:36<5:33:00,  3.44it/s]
 81%|████████▏ | 302715/371472 [1:55:37<5:28:34,  3.49it/s]
 81%|████████▏ | 302716/371472 [1:55:37<5:39:35,  3.37it/s]
 81%|████████▏ | 302717/371472 [1:55:37<5:38:37,  3.38it/s]
 81%|████████▏ | 302718/371472 [1:55:37<5:40:12,  3.37it/s]
 81%|████████▏ | 302719/371472 [1:55:38<5:38:57,  3.38it/s]
 81%|████████▏ | 302720/371472 [1:55:38<5:22:07,  3.56it/s]
                                                           
{'loss': 2.676, 'learning_rate': 2.666616389062466e-07, 'epoch': 13.04}

 81%|████████▏ | 302720/371472 [1:55:38<5:22:07,  3.56it/s]
 81%|████████▏ | 302721/371472 [1:55:38<5:13:08,  3.66it/s]
 81%|████████▏ | 302722/371472 [1:55:39<5:15:34,  3.63it/s]
 81%|████████▏ | 302723/371472 [1:55:39<5:02:58,  3.78it/s]
 81%|████████▏ | 302724/371472 [1:55:39<5:04:01,  3.77it/s]
 81%|████████▏ | 302725/371472 [1:55:39<5:06:21,  3.74it/s]
 81%|████████▏ | 302726/371472 [1:55:40<5:13:19,  3.66it/s]
 81%|████████▏ | 302727/371472 [1:55:40<5:22:03,  3.56it/s]
 81%|████████▏ | 302728/371472 [1:55:40<5:10:17,  3.69it/s]
 81%|████████▏ | 302729/371472 [1:55:40<5:09:36,  3.70it/s]
 81%|████████▏ | 302730/371472 [1:55:41<5:03:26,  3.78it/s]
 81%|████████▏ | 302731/371472 [1:55:41<5:19:42,  3.58it/s]
 81%|████████▏ | 302732/371472 [1:55:41<5:14:36,  3.64it/s]
 81%|████████▏ | 302733/371472 [1:55:41<5:02:04,  3.79it/s]
 81%|████████▏ | 302734/371472 [1:55:42<5:00:59,  3.81it/s]
 81%|████████▏ | 302735/371472 [1:55:42<5:01:55,  3.79it/s]
 81%|████████▏ | 302736/371472 [1:55:42<5:22:28,  3.55it/s]
 81%|████████▏ | 302737/371472 [1:55:43<5:21:22,  3.56it/s]
 81%|████████▏ | 302738/371472 [1:55:43<5:22:21,  3.55it/s]
 81%|████████▏ | 302739/371472 [1:55:43<5:20:21,  3.58it/s]
 81%|████████▏ | 302740/371472 [1:55:43<5:17:24,  3.61it/s]
                                                           
{'loss': 2.6695, 'learning_rate': 2.6661315693076776e-07, 'epoch': 13.04}

 81%|████████▏ | 302740/371472 [1:55:43<5:17:24,  3.61it/s]
 81%|████████▏ | 302741/371472 [1:55:44<5:11:42,  3.67it/s]
 81%|████████▏ | 302742/371472 [1:55:44<5:05:29,  3.75it/s]
 81%|████████▏ | 302743/371472 [1:55:44<5:05:02,  3.76it/s]
 81%|████████▏ | 302744/371472 [1:55:44<5:04:59,  3.76it/s]
 81%|████████▏ | 302745/371472 [1:55:45<5:27:17,  3.50it/s]
 81%|████████▏ | 302746/371472 [1:55:45<5:30:29,  3.47it/s]
 81%|████████▏ | 302747/371472 [1:55:45<5:21:01,  3.57it/s]
 81%|████████▏ | 302748/371472 [1:55:46<5:32:22,  3.45it/s]
 81%|████████▏ | 302749/371472 [1:55:46<5:24:14,  3.53it/s]
 82%|████████▏ | 302750/371472 [1:55:46<5:32:19,  3.45it/s]
 82%|████████▏ | 302751/371472 [1:55:47<5:28:17,  3.49it/s]
 82%|████████▏ | 302752/371472 [1:55:47<5:18:50,  3.59it/s]
 82%|████████▏ | 302753/371472 [1:55:47<5:44:38,  3.32it/s]
 82%|████████▏ | 302754/371472 [1:55:47<5:29:45,  3.47it/s]
 82%|████████▏ | 302755/371472 [1:55:48<5:17:30,  3.61it/s]
 82%|████████▏ | 302756/371472 [1:55:48<5:08:52,  3.71it/s]
 82%|████████▏ | 302757/371472 [1:55:48<5:13:51,  3.65it/s]
 82%|████████▏ | 302758/371472 [1:55:48<5:19:23,  3.59it/s]
 82%|████████▏ | 302759/371472 [1:55:49<5:09:54,  3.70it/s]
 82%|████████▏ | 302760/371472 [1:55:49<5:07:25,  3.73it/s]
                                                           
{'loss': 2.7132, 'learning_rate': 2.6656467495528883e-07, 'epoch': 13.04}

 82%|████████▏ | 302760/371472 [1:55:49<5:07:25,  3.73it/s]
 82%|████████▏ | 302761/371472 [1:55:49<5:06:53,  3.73it/s]
 82%|████████▏ | 302762/371472 [1:55:50<5:23:20,  3.54it/s]
 82%|████████▏ | 302763/371472 [1:55:50<5:37:25,  3.39it/s]
 82%|████████▏ | 302764/371472 [1:55:50<5:32:38,  3.44it/s]
 82%|████████▏ | 302765/371472 [1:55:51<5:55:24,  3.22it/s]
 82%|████████▏ | 302766/371472 [1:55:51<5:49:02,  3.28it/s]
 82%|████████▏ | 302767/371472 [1:55:51<6:01:41,  3.17it/s]
 82%|████████▏ | 302768/371472 [1:55:51<5:50:30,  3.27it/s]
 82%|████████▏ | 302769/371472 [1:55:52<5:38:53,  3.38it/s]
 82%|████████▏ | 302770/371472 [1:55:52<5:33:04,  3.44it/s]
 82%|████████▏ | 302771/371472 [1:55:52<5:21:52,  3.56it/s]
 82%|████████▏ | 302772/371472 [1:55:53<5:11:24,  3.68it/s]
 82%|████████▏ | 302773/371472 [1:55:53<5:11:18,  3.68it/s]
 82%|████████▏ | 302774/371472 [1:55:53<5:37:54,  3.39it/s]
 82%|████████▏ | 302775/371472 [1:55:53<5:45:03,  3.32it/s]
 82%|████████▏ | 302776/371472 [1:55:54<5:22:04,  3.55it/s]
 82%|████████▏ | 302777/371472 [1:55:54<5:51:40,  3.26it/s]
 82%|████████▏ | 302778/371472 [1:55:54<5:39:58,  3.37it/s]
 82%|████████▏ | 302779/371472 [1:55:55<5:36:48,  3.40it/s]
 82%|████████▏ | 302780/371472 [1:55:55<5:26:00,  3.51it/s]
                                                           
{'loss': 2.5231, 'learning_rate': 2.6651619297981e-07, 'epoch': 13.04}

 82%|████████▏ | 302780/371472 [1:55:55<5:26:00,  3.51it/s]
 82%|████████▏ | 302781/371472 [1:55:55<5:29:46,  3.47it/s]
 82%|████████▏ | 302782/371472 [1:55:55<5:25:22,  3.52it/s]
 82%|████████▏ | 302783/371472 [1:55:56<5:12:42,  3.66it/s]
 82%|████████▏ | 302784/371472 [1:55:56<5:25:11,  3.52it/s]
 82%|████████▏ | 302785/371472 [1:55:56<5:25:19,  3.52it/s]
 82%|████████▏ | 302786/371472 [1:55:57<5:30:24,  3.46it/s]
 82%|████████▏ | 302787/371472 [1:55:57<5:10:25,  3.69it/s]
 82%|████████▏ | 302788/371472 [1:55:57<5:02:27,  3.78it/s]
 82%|████████▏ | 302789/371472 [1:55:57<5:09:08,  3.70it/s]
 82%|████████▏ | 302790/371472 [1:55:58<5:07:01,  3.73it/s]
 82%|████████▏ | 302791/371472 [1:55:58<5:10:57,  3.68it/s]
 82%|████████▏ | 302792/371472 [1:55:58<5:01:31,  3.80it/s]
 82%|████████▏ | 302793/371472 [1:55:58<5:09:14,  3.70it/s]
 82%|████████▏ | 302794/371472 [1:55:59<5:02:01,  3.79it/s]
 82%|████████▏ | 302795/371472 [1:55:59<5:34:51,  3.42it/s]
 82%|████████▏ | 302796/371472 [1:55:59<5:34:59,  3.42it/s]
 82%|████████▏ | 302797/371472 [1:56:00<5:29:32,  3.47it/s]
 82%|████████▏ | 302798/371472 [1:56:00<5:19:18,  3.58it/s]
 82%|████████▏ | 302799/371472 [1:56:00<5:23:19,  3.54it/s]
 82%|████████▏ | 302800/371472 [1:56:00<5:04:58,  3.75it/s]
                                                           
{'loss': 2.6172, 'learning_rate': 2.66467711004331e-07, 'epoch': 13.04}

 82%|████████▏ | 302800/371472 [1:56:00<5:04:58,  3.75it/s]
 82%|████████▏ | 302801/371472 [1:56:01<5:00:14,  3.81it/s]
 82%|████████▏ | 302802/371472 [1:56:01<4:54:25,  3.89it/s]
 82%|████████▏ | 302803/371472 [1:56:01<4:58:12,  3.84it/s]
 82%|████████▏ | 302804/371472 [1:56:01<5:04:29,  3.76it/s]
 82%|████████▏ | 302805/371472 [1:56:02<5:05:09,  3.75it/s]
 82%|████████▏ | 302806/371472 [1:56:02<5:28:24,  3.48it/s]
 82%|████████▏ | 302807/371472 [1:56:02<5:17:44,  3.60it/s]
 82%|████████▏ | 302808/371472 [1:56:03<5:34:06,  3.43it/s]
 82%|████████▏ | 302809/371472 [1:56:03<5:42:13,  3.34it/s]
 82%|████████▏ | 302810/371472 [1:56:03<5:28:16,  3.49it/s]
 82%|████████▏ | 302811/371472 [1:56:04<5:49:36,  3.27it/s]
 82%|████████▏ | 302812/371472 [1:56:04<5:43:21,  3.33it/s]
 82%|████████▏ | 302813/371472 [1:56:04<5:38:56,  3.38it/s]
 82%|████████▏ | 302814/371472 [1:56:04<5:32:49,  3.44it/s]
 82%|████████▏ | 302815/371472 [1:56:05<5:19:28,  3.58it/s]
 82%|████████▏ | 302816/371472 [1:56:05<5:06:53,  3.73it/s]
 82%|████████▏ | 302817/371472 [1:56:05<5:00:24,  3.81it/s]
 82%|████████▏ | 302818/371472 [1:56:05<5:12:42,  3.66it/s]
 82%|████████▏ | 302819/371472 [1:56:06<5:14:16,  3.64it/s]
 82%|████████▏ | 302820/371472 [1:56:06<5:18:31,  3.59it/s]
                                                           
{'loss': 2.6135, 'learning_rate': 2.664192290288522e-07, 'epoch': 13.04}

 82%|████████▏ | 302820/371472 [1:56:06<5:18:31,  3.59it/s]
 82%|████████▏ | 302821/371472 [1:56:06<5:24:25,  3.53it/s]
 82%|████████▏ | 302822/371472 [1:56:07<5:30:14,  3.46it/s]
 82%|████████▏ | 302823/371472 [1:56:07<5:23:30,  3.54it/s]
 82%|████████▏ | 302824/371472 [1:56:07<5:33:53,  3.43it/s]
 82%|████████▏ | 302825/371472 [1:56:07<5:34:44,  3.42it/s]
 82%|████████▏ | 302826/371472 [1:56:08<5:32:32,  3.44it/s]
 82%|████████▏ | 302827/371472 [1:56:08<5:50:59,  3.26it/s]
 82%|████████▏ | 302828/371472 [1:56:08<5:35:45,  3.41it/s]
 82%|████████▏ | 302829/371472 [1:56:09<5:33:07,  3.43it/s]
 82%|████████▏ | 302830/371472 [1:56:09<5:23:27,  3.54it/s]
 82%|████████▏ | 302831/371472 [1:56:09<5:26:33,  3.50it/s]
 82%|████████▏ | 302832/371472 [1:56:10<5:28:26,  3.48it/s]
 82%|████████▏ | 302833/371472 [1:56:10<5:32:47,  3.44it/s]
 82%|████████▏ | 302834/371472 [1:56:10<5:34:38,  3.42it/s]
 82%|████████▏ | 302835/371472 [1:56:10<5:33:01,  3.43it/s]
 82%|████████▏ | 302836/371472 [1:56:11<5:41:07,  3.35it/s]
 82%|████████▏ | 302837/371472 [1:56:11<5:38:29,  3.38it/s]
 82%|████████▏ | 302838/371472 [1:56:11<5:55:57,  3.21it/s]
 82%|████████▏ | 302839/371472 [1:56:12<5:55:40,  3.22it/s]
 82%|████████▏ | 302840/371472 [1:56:12<6:20:58,  3.00it/s]
                                                           
{'loss': 2.5796, 'learning_rate': 2.663707470533732e-07, 'epoch': 13.04}

 82%|████████▏ | 302840/371472 [1:56:12<6:20:58,  3.00it/s]
 82%|████████▏ | 302841/371472 [1:56:12<5:50:03,  3.27it/s]
 82%|████████▏ | 302842/371472 [1:56:13<6:15:38,  3.05it/s]
 82%|████████▏ | 302843/371472 [1:56:13<6:03:26,  3.15it/s]
 82%|████████▏ | 302844/371472 [1:56:13<5:50:14,  3.27it/s]
 82%|████████▏ | 302845/371472 [1:56:14<5:38:45,  3.38it/s]
 82%|████████▏ | 302846/371472 [1:56:14<5:42:15,  3.34it/s]
 82%|████████▏ | 302847/371472 [1:56:14<5:32:14,  3.44it/s]
 82%|████████▏ | 302848/371472 [1:56:14<5:21:23,  3.56it/s]
 82%|████████▏ | 302849/371472 [1:56:15<6:01:24,  3.16it/s]
 82%|████████▏ | 302850/371472 [1:56:15<5:49:31,  3.27it/s]
 82%|████████▏ | 302851/371472 [1:56:15<5:43:01,  3.33it/s]
 82%|████████▏ | 302852/371472 [1:56:16<5:31:00,  3.46it/s]
 82%|████████▏ | 302853/371472 [1:56:16<5:24:46,  3.52it/s]
 82%|████████▏ | 302854/371472 [1:56:16<5:20:12,  3.57it/s]
 82%|████████▏ | 302855/371472 [1:56:16<5:14:55,  3.63it/s]
 82%|████████▏ | 302856/371472 [1:56:17<5:29:23,  3.47it/s]
 82%|████████▏ | 302857/371472 [1:56:17<5:32:12,  3.44it/s]
 82%|████████▏ | 302858/371472 [1:56:17<5:32:47,  3.44it/s]
 82%|████████▏ | 302859/371472 [1:56:18<5:18:38,  3.59it/s]
 82%|████████▏ | 302860/371472 [1:56:18<5:59:44,  3.18it/s]
                                                           
{'loss': 2.7081, 'learning_rate': 2.663222650778944e-07, 'epoch': 13.04}

 82%|████████▏ | 302860/371472 [1:56:18<5:59:44,  3.18it/s]
 82%|████████▏ | 302861/371472 [1:56:18<5:58:17,  3.19it/s]
 82%|████████▏ | 302862/371472 [1:56:19<5:48:14,  3.28it/s]
 82%|████████▏ | 302863/371472 [1:56:19<5:39:20,  3.37it/s]
 82%|████████▏ | 302864/371472 [1:56:19<5:46:24,  3.30it/s]
 82%|████████▏ | 302865/371472 [1:56:19<5:53:26,  3.24it/s]
 82%|████████▏ | 302866/371472 [1:56:20<5:54:05,  3.23it/s]
 82%|████████▏ | 302867/371472 [1:56:20<5:40:07,  3.36it/s]
 82%|████████▏ | 302868/371472 [1:56:20<5:37:21,  3.39it/s]
 82%|████████▏ | 302869/371472 [1:56:21<5:20:56,  3.56it/s]
 82%|████████▏ | 302870/371472 [1:56:21<5:22:14,  3.55it/s]
 82%|████████▏ | 302871/371472 [1:56:21<5:18:27,  3.59it/s]
 82%|████████▏ | 302872/371472 [1:56:21<5:19:11,  3.58it/s]
 82%|████████▏ | 302873/371472 [1:56:22<5:31:09,  3.45it/s]
 82%|████████▏ | 302874/371472 [1:56:22<5:23:05,  3.54it/s]
 82%|████████▏ | 302875/371472 [1:56:22<5:25:44,  3.51it/s]
 82%|████████▏ | 302876/371472 [1:56:23<5:30:37,  3.46it/s]
 82%|████████▏ | 302877/371472 [1:56:23<5:20:54,  3.56it/s]
 82%|████████▏ | 302878/371472 [1:56:23<5:07:58,  3.71it/s]
 82%|████████▏ | 302879/371472 [1:56:23<5:09:54,  3.69it/s]
 82%|████████▏ | 302880/371472 [1:56:24<5:14:46,  3.63it/s]
                                                           
{'loss': 2.621, 'learning_rate': 2.662737831024155e-07, 'epoch': 13.05}

 82%|████████▏ | 302880/371472 [1:56:24<5:14:46,  3.63it/s]
 82%|████████▏ | 302881/371472 [1:56:24<5:07:15,  3.72it/s]
 82%|████████▏ | 302882/371472 [1:56:24<5:03:21,  3.77it/s]
 82%|████████▏ | 302883/371472 [1:56:24<5:13:55,  3.64it/s]
 82%|████████▏ | 302884/371472 [1:56:25<5:36:52,  3.39it/s]
 82%|████████▏ | 302885/371472 [1:56:25<5:24:56,  3.52it/s]
 82%|████████▏ | 302886/371472 [1:56:25<5:18:26,  3.59it/s]
 82%|████████▏ | 302887/371472 [1:56:26<5:35:17,  3.41it/s]
 82%|████████▏ | 302888/371472 [1:56:26<5:38:04,  3.38it/s]
 82%|████████▏ | 302889/371472 [1:56:26<5:42:05,  3.34it/s]
 82%|████████▏ | 302890/371472 [1:56:27<5:49:24,  3.27it/s]
 82%|████████▏ | 302891/371472 [1:56:27<5:38:56,  3.37it/s]
 82%|████████▏ | 302892/371472 [1:56:27<5:28:18,  3.48it/s]
 82%|████████▏ | 302893/371472 [1:56:27<5:12:39,  3.66it/s]
 82%|████████▏ | 302894/371472 [1:56:28<5:01:11,  3.79it/s]
 82%|████████▏ | 302895/371472 [1:56:28<5:17:22,  3.60it/s]
 82%|████████▏ | 302896/371472 [1:56:28<5:09:07,  3.70it/s]
 82%|████████▏ | 302897/371472 [1:56:28<5:27:44,  3.49it/s]
 82%|████████▏ | 302898/371472 [1:56:29<5:42:33,  3.34it/s]
 82%|████████▏ | 302899/371472 [1:56:29<5:59:22,  3.18it/s]
 82%|████████▏ | 302900/371472 [1:56:29<6:10:02,  3.09it/s]
                                                           
{'loss': 2.5306, 'learning_rate': 2.6622530112693665e-07, 'epoch': 13.05}

 82%|████████▏ | 302900/371472 [1:56:29<6:10:02,  3.09it/s]
 82%|████████▏ | 302901/371472 [1:56:30<6:15:32,  3.04it/s]
 82%|████████▏ | 302902/371472 [1:56:30<5:47:35,  3.29it/s]
 82%|████████▏ | 302903/371472 [1:56:30<5:34:55,  3.41it/s]
 82%|████████▏ | 302904/371472 [1:56:31<5:31:31,  3.45it/s]
 82%|████████▏ | 302905/371472 [1:56:31<5:21:36,  3.55it/s]
 82%|████████▏ | 302906/371472 [1:56:31<5:14:22,  3.64it/s]
 82%|████████▏ | 302907/371472 [1:56:32<6:17:51,  3.02it/s]
 82%|████████▏ | 302908/371472 [1:56:32<5:59:22,  3.18it/s]
 82%|████████▏ | 302909/371472 [1:56:32<5:34:23,  3.42it/s]
 82%|████████▏ | 302910/371472 [1:56:32<5:53:19,  3.23it/s]
 82%|████████▏ | 302911/371472 [1:56:33<5:51:16,  3.25it/s]
 82%|████████▏ | 302912/371472 [1:56:33<5:38:51,  3.37it/s]
 82%|████████▏ | 302913/371472 [1:56:33<5:50:16,  3.26it/s]
 82%|████████▏ | 302914/371472 [1:56:34<5:39:45,  3.36it/s]
 82%|████████▏ | 302915/371472 [1:56:34<5:20:10,  3.57it/s]
 82%|████████▏ | 302916/371472 [1:56:34<5:13:37,  3.64it/s]
 82%|████████▏ | 302917/371472 [1:56:34<5:17:16,  3.60it/s]
 82%|████████▏ | 302918/371472 [1:56:35<5:21:14,  3.56it/s]
 82%|████████▏ | 302919/371472 [1:56:35<5:12:05,  3.66it/s]
 82%|████████▏ | 302920/371472 [1:56:35<5:24:49,  3.52it/s]
                                                           
{'loss': 2.6119, 'learning_rate': 2.6617681915145766e-07, 'epoch': 13.05}

 82%|████████▏ | 302920/371472 [1:56:35<5:24:49,  3.52it/s]
 82%|████████▏ | 302921/371472 [1:56:36<5:15:47,  3.62it/s]
 82%|████████▏ | 302922/371472 [1:56:36<5:01:26,  3.79it/s]
 82%|████████▏ | 302923/371472 [1:56:36<5:24:33,  3.52it/s]
 82%|████████▏ | 302924/371472 [1:56:36<5:12:14,  3.66it/s]
 82%|████████▏ | 302925/371472 [1:56:37<5:35:59,  3.40it/s]
 82%|████████▏ | 302926/371472 [1:56:37<5:22:52,  3.54it/s]
 82%|████████▏ | 302927/371472 [1:56:37<5:29:32,  3.47it/s]
 82%|████████▏ | 302928/371472 [1:56:38<5:37:36,  3.38it/s]
 82%|████████▏ | 302929/371472 [1:56:38<5:23:53,  3.53it/s]
 82%|████████▏ | 302930/371472 [1:56:38<5:13:27,  3.64it/s]
 82%|████████▏ | 302931/371472 [1:56:38<5:09:24,  3.69it/s]
 82%|████████▏ | 302932/371472 [1:56:39<5:15:50,  3.62it/s]
 82%|████████▏ | 302933/371472 [1:56:39<5:19:43,  3.57it/s]
 82%|████████▏ | 302934/371472 [1:56:39<5:09:22,  3.69it/s]
 82%|████████▏ | 302935/371472 [1:56:39<5:09:28,  3.69it/s]
 82%|████████▏ | 302936/371472 [1:56:40<5:38:48,  3.37it/s]
 82%|████████▏ | 302937/371472 [1:56:40<5:43:32,  3.32it/s]
 82%|████████▏ | 302938/371472 [1:56:40<6:07:16,  3.11it/s]
 82%|████████▏ | 302939/371472 [1:56:41<5:50:43,  3.26it/s]
 82%|████████▏ | 302940/371472 [1:56:41<5:35:52,  3.40it/s]
                                                           
{'loss': 2.6158, 'learning_rate': 2.6612833717597884e-07, 'epoch': 13.05}

 82%|████████▏ | 302940/371472 [1:56:41<5:35:52,  3.40it/s]
 82%|████████▏ | 302941/371472 [1:56:41<6:04:05,  3.14it/s]
 82%|████████▏ | 302942/371472 [1:56:42<6:07:24,  3.11it/s]
 82%|████████▏ | 302943/371472 [1:56:42<6:46:25,  2.81it/s]
 82%|████████▏ | 302944/371472 [1:56:42<6:29:53,  2.93it/s]
 82%|████████▏ | 302945/371472 [1:56:43<6:00:38,  3.17it/s]
 82%|████████▏ | 302946/371472 [1:56:43<5:38:22,  3.38it/s]
 82%|████████▏ | 302947/371472 [1:56:43<5:26:26,  3.50it/s]
 82%|████████▏ | 302948/371472 [1:56:44<5:19:48,  3.57it/s]
 82%|████████▏ | 302949/371472 [1:56:44<5:14:32,  3.63it/s]
 82%|████████▏ | 302950/371472 [1:56:44<5:12:04,  3.66it/s]
 82%|████████▏ | 302951/371472 [1:56:44<5:11:19,  3.67it/s]
 82%|████████▏ | 302952/371472 [1:56:45<5:19:58,  3.57it/s]
 82%|████████▏ | 302953/371472 [1:56:45<5:10:05,  3.68it/s]
 82%|████████▏ | 302954/371472 [1:56:45<5:33:33,  3.42it/s]
 82%|████████▏ | 302955/371472 [1:56:45<5:25:50,  3.50it/s]
 82%|████████▏ | 302956/371472 [1:56:46<5:18:49,  3.58it/s]
 82%|████████▏ | 302957/371472 [1:56:46<5:35:21,  3.41it/s]
 82%|████████▏ | 302958/371472 [1:56:46<5:54:22,  3.22it/s]
 82%|████████▏ | 302959/371472 [1:56:47<5:40:08,  3.36it/s]
 82%|████████▏ | 302960/371472 [1:56:47<5:26:24,  3.50it/s]
                                                           
{'loss': 2.6629, 'learning_rate': 2.6607985520049986e-07, 'epoch': 13.05}

 82%|████████▏ | 302960/371472 [1:56:47<5:26:24,  3.50it/s]
 82%|████████▏ | 302961/371472 [1:56:47<5:25:52,  3.50it/s]
 82%|████████▏ | 302962/371472 [1:56:47<5:15:49,  3.62it/s]
 82%|████████▏ | 302963/371472 [1:56:48<5:18:35,  3.58it/s]
 82%|████████▏ | 302964/371472 [1:56:48<5:25:39,  3.51it/s]
 82%|████████▏ | 302965/371472 [1:56:48<5:25:48,  3.50it/s]
 82%|████████▏ | 302966/371472 [1:56:49<5:32:55,  3.43it/s]
 82%|████████▏ | 302967/371472 [1:56:49<5:34:59,  3.41it/s]
 82%|████████▏ | 302968/371472 [1:56:49<5:35:50,  3.40it/s]
 82%|████████▏ | 302969/371472 [1:56:50<5:40:12,  3.36it/s]
 82%|████████▏ | 302970/371472 [1:56:50<5:44:04,  3.32it/s]
 82%|████████▏ | 302971/371472 [1:56:50<5:32:30,  3.43it/s]
 82%|████████▏ | 302972/371472 [1:56:50<5:27:49,  3.48it/s]
 82%|████████▏ | 302973/371472 [1:56:51<5:32:00,  3.44it/s]
 82%|████████▏ | 302974/371472 [1:56:51<5:33:24,  3.42it/s]
 82%|████████▏ | 302975/371472 [1:56:51<5:54:32,  3.22it/s]
 82%|████████▏ | 302976/371472 [1:56:52<5:41:27,  3.34it/s]
 82%|████████▏ | 302977/371472 [1:56:52<5:30:32,  3.45it/s]
 82%|████████▏ | 302978/371472 [1:56:52<5:27:19,  3.49it/s]
 82%|████████▏ | 302979/371472 [1:56:52<5:19:24,  3.57it/s]
 82%|████████▏ | 302980/371472 [1:56:53<5:19:19,  3.57it/s]
                                                           
{'loss': 2.5772, 'learning_rate': 2.6603137322502093e-07, 'epoch': 13.05}

 82%|████████▏ | 302980/371472 [1:56:53<5:19:19,  3.57it/s]
 82%|████████▏ | 302981/371472 [1:56:53<5:24:26,  3.52it/s]
 82%|████████▏ | 302982/371472 [1:56:53<5:14:51,  3.63it/s]
 82%|████████▏ | 302983/371472 [1:56:54<5:15:18,  3.62it/s]
 82%|████████▏ | 302984/371472 [1:56:54<5:24:32,  3.52it/s]
 82%|████████▏ | 302985/371472 [1:56:54<5:23:15,  3.53it/s]
 82%|████████▏ | 302986/371472 [1:56:54<5:32:53,  3.43it/s]
 82%|████████▏ | 302987/371472 [1:56:55<5:27:13,  3.49it/s]
 82%|████████▏ | 302988/371472 [1:56:55<5:33:28,  3.42it/s]
 82%|████████▏ | 302989/371472 [1:56:55<5:18:57,  3.58it/s]
 82%|████████▏ | 302990/371472 [1:56:56<5:41:03,  3.35it/s]
 82%|████████▏ | 302991/371472 [1:56:56<5:42:14,  3.33it/s]
 82%|████████▏ | 302992/371472 [1:56:56<5:48:28,  3.28it/s]
 82%|████████▏ | 302993/371472 [1:56:57<5:53:40,  3.23it/s]
 82%|████████▏ | 302994/371472 [1:56:57<5:58:14,  3.19it/s]
 82%|████████▏ | 302995/371472 [1:56:57<5:56:01,  3.21it/s]
 82%|████████▏ | 302996/371472 [1:56:58<5:57:04,  3.20it/s]
 82%|████████▏ | 302997/371472 [1:56:58<6:18:06,  3.02it/s]
 82%|████████▏ | 302998/371472 [1:56:58<5:50:21,  3.26it/s]
 82%|████████▏ | 302999/371472 [1:56:58<5:35:42,  3.40it/s]
 82%|████████▏ | 303000/371472 [1:56:59<5:32:26,  3.43it/s]
                                                           
{'loss': 2.6038, 'learning_rate': 2.659828912495421e-07, 'epoch': 13.05}

 82%|████████▏ | 303000/371472 [1:56:59<5:32:26,  3.43it/s]
 82%|████████▏ | 303001/371472 [1:56:59<5:26:33,  3.49it/s]
 82%|████████▏ | 303002/371472 [1:56:59<5:18:36,  3.58it/s]
 82%|████████▏ | 303003/371472 [1:56:59<5:11:30,  3.66it/s]
 82%|████████▏ | 303004/371472 [1:57:00<5:28:00,  3.48it/s]
 82%|████████▏ | 303005/371472 [1:57:00<5:52:20,  3.24it/s]
 82%|████████▏ | 303006/371472 [1:57:00<5:34:02,  3.42it/s]
 82%|████████▏ | 303007/371472 [1:57:01<5:24:21,  3.52it/s]
 82%|████████▏ | 303008/371472 [1:57:01<5:24:37,  3.52it/s]
 82%|████████▏ | 303009/371472 [1:57:01<5:15:33,  3.62it/s]
 82%|████████▏ | 303010/371472 [1:57:02<5:16:44,  3.60it/s]
 82%|████████▏ | 303011/371472 [1:57:02<5:07:13,  3.71it/s]
 82%|████████▏ | 303012/371472 [1:57:02<5:13:11,  3.64it/s]
 82%|████████▏ | 303013/371472 [1:57:02<5:14:28,  3.63it/s]
 82%|████████▏ | 303014/371472 [1:57:03<5:13:41,  3.64it/s]
 82%|████████▏ | 303015/371472 [1:57:03<5:12:25,  3.65it/s]
 82%|████████▏ | 303016/371472 [1:57:03<5:11:24,  3.66it/s]
 82%|████████▏ | 303017/371472 [1:57:03<5:00:38,  3.80it/s]
 82%|████████▏ | 303018/371472 [1:57:04<4:56:43,  3.84it/s]
 82%|████████▏ | 303019/371472 [1:57:04<4:56:35,  3.85it/s]
 82%|████████▏ | 303020/371472 [1:57:04<4:49:18,  3.94it/s]
                                                           
{'loss': 2.4844, 'learning_rate': 2.659344092740632e-07, 'epoch': 13.05}

 82%|████████▏ | 303020/371472 [1:57:04<4:49:18,  3.94it/s]
 82%|████████▏ | 303021/371472 [1:57:04<4:59:40,  3.81it/s]
 82%|████████▏ | 303022/371472 [1:57:05<4:59:44,  3.81it/s]
 82%|████████▏ | 303023/371472 [1:57:05<4:59:40,  3.81it/s]
 82%|████████▏ | 303024/371472 [1:57:05<4:59:25,  3.81it/s]
 82%|████████▏ | 303025/371472 [1:57:05<5:01:45,  3.78it/s]
 82%|████████▏ | 303026/371472 [1:57:06<5:06:19,  3.72it/s]
 82%|████████▏ | 303027/371472 [1:57:06<5:16:19,  3.61it/s]
 82%|████████▏ | 303028/371472 [1:57:06<5:19:46,  3.57it/s]
 82%|████████▏ | 303029/371472 [1:57:07<5:21:49,  3.54it/s]
 82%|████████▏ | 303030/371472 [1:57:07<5:21:24,  3.55it/s]
 82%|████████▏ | 303031/371472 [1:57:07<5:18:55,  3.58it/s]
 82%|████████▏ | 303032/371472 [1:57:07<5:13:51,  3.63it/s]
 82%|████████▏ | 303033/371472 [1:57:08<5:29:58,  3.46it/s]
 82%|████████▏ | 303034/371472 [1:57:08<5:21:55,  3.54it/s]
 82%|████████▏ | 303035/371472 [1:57:08<5:44:21,  3.31it/s]
 82%|████████▏ | 303036/371472 [1:57:09<5:55:11,  3.21it/s]
 82%|████████▏ | 303037/371472 [1:57:09<5:48:45,  3.27it/s]
 82%|████████▏ | 303038/371472 [1:57:09<5:43:44,  3.32it/s]
 82%|████████▏ | 303039/371472 [1:57:10<5:29:04,  3.47it/s]
 82%|████████▏ | 303040/371472 [1:57:10<5:30:00,  3.46it/s]
                                                           
{'loss': 2.6601, 'learning_rate': 2.6588592729858436e-07, 'epoch': 13.05}

 82%|████████▏ | 303040/371472 [1:57:10<5:30:00,  3.46it/s]
 82%|████████▏ | 303041/371472 [1:57:10<5:28:38,  3.47it/s]
 82%|████████▏ | 303042/371472 [1:57:10<5:35:42,  3.40it/s]
 82%|████████▏ | 303043/371472 [1:57:11<6:03:20,  3.14it/s]
 82%|████████▏ | 303044/371472 [1:57:11<6:03:24,  3.14it/s]
 82%|████████▏ | 303045/371472 [1:57:11<5:56:38,  3.20it/s]
 82%|████████▏ | 303046/371472 [1:57:12<6:04:32,  3.13it/s]
 82%|████████▏ | 303047/371472 [1:57:12<5:42:24,  3.33it/s]
 82%|████████▏ | 303048/371472 [1:57:12<5:30:08,  3.45it/s]
 82%|████████▏ | 303049/371472 [1:57:13<5:27:45,  3.48it/s]
 82%|████████▏ | 303050/371472 [1:57:13<5:11:02,  3.67it/s]
 82%|████████▏ | 303051/371472 [1:57:13<5:00:18,  3.80it/s]
 82%|████████▏ | 303052/371472 [1:57:13<5:09:32,  3.68it/s]
 82%|████████▏ | 303053/371472 [1:57:14<5:01:08,  3.79it/s]
 82%|████████▏ | 303054/371472 [1:57:14<5:30:47,  3.45it/s]
 82%|████████▏ | 303055/371472 [1:57:14<5:38:23,  3.37it/s]
 82%|████████▏ | 303056/371472 [1:57:15<5:43:04,  3.32it/s]
 82%|████████▏ | 303057/371472 [1:57:15<5:33:37,  3.42it/s]
 82%|████████▏ | 303058/371472 [1:57:15<5:21:56,  3.54it/s]
 82%|████████▏ | 303059/371472 [1:57:15<5:15:37,  3.61it/s]
 82%|████████▏ | 303060/371472 [1:57:16<5:11:36,  3.66it/s]
                                                           
{'loss': 2.4765, 'learning_rate': 2.658374453231054e-07, 'epoch': 13.05}

 82%|████████▏ | 303060/371472 [1:57:16<5:11:36,  3.66it/s]
 82%|████████▏ | 303061/371472 [1:57:16<5:09:33,  3.68it/s]
 82%|████████▏ | 303062/371472 [1:57:16<5:10:38,  3.67it/s]
 82%|████████▏ | 303063/371472 [1:57:16<5:20:24,  3.56it/s]
 82%|████████▏ | 303064/371472 [1:57:17<5:24:13,  3.52it/s]
 82%|████████▏ | 303065/371472 [1:57:17<5:23:52,  3.52it/s]
 82%|████████▏ | 303066/371472 [1:57:17<5:34:35,  3.41it/s]
 82%|████████▏ | 303067/371472 [1:57:18<6:02:30,  3.14it/s]
 82%|████████▏ | 303068/371472 [1:57:18<5:48:06,  3.27it/s]
 82%|████████▏ | 303069/371472 [1:57:18<5:49:53,  3.26it/s]
 82%|████████▏ | 303070/371472 [1:57:19<5:32:12,  3.43it/s]
 82%|████████▏ | 303071/371472 [1:57:19<5:22:34,  3.53it/s]
 82%|████████▏ | 303072/371472 [1:57:19<5:28:55,  3.47it/s]
 82%|████████▏ | 303073/371472 [1:57:19<5:18:03,  3.58it/s]
 82%|████████▏ | 303074/371472 [1:57:20<5:14:40,  3.62it/s]
 82%|████████▏ | 303075/371472 [1:57:20<5:26:54,  3.49it/s]
 82%|████████▏ | 303076/371472 [1:57:20<5:24:57,  3.51it/s]
 82%|████████▏ | 303077/371472 [1:57:21<5:41:14,  3.34it/s]
 82%|████████▏ | 303078/371472 [1:57:21<6:15:52,  3.03it/s]
 82%|████████▏ | 303079/371472 [1:57:21<6:16:46,  3.03it/s]
 82%|████████▏ | 303080/371472 [1:57:22<6:06:29,  3.11it/s]
                                                           
{'loss': 2.5308, 'learning_rate': 2.657889633476265e-07, 'epoch': 13.05}

 82%|████████▏ | 303080/371472 [1:57:22<6:06:29,  3.11it/s]
 82%|████████▏ | 303081/371472 [1:57:22<5:58:46,  3.18it/s]
 82%|████████▏ | 303082/371472 [1:57:22<5:41:49,  3.33it/s]
 82%|████████▏ | 303083/371472 [1:57:22<5:33:34,  3.42it/s]
 82%|████████▏ | 303084/371472 [1:57:23<5:26:28,  3.49it/s]
 82%|████████▏ | 303085/371472 [1:57:23<5:18:24,  3.58it/s]
 82%|████████▏ | 303086/371472 [1:57:23<5:13:05,  3.64it/s]
 82%|████████▏ | 303087/371472 [1:57:24<5:06:27,  3.72it/s]
 82%|████████▏ | 303088/371472 [1:57:24<5:09:46,  3.68it/s]
 82%|████████▏ | 303089/371472 [1:57:24<5:16:56,  3.60it/s]
 82%|████████▏ | 303090/371472 [1:57:24<5:10:49,  3.67it/s]
 82%|████████▏ | 303091/371472 [1:57:25<5:09:31,  3.68it/s]
 82%|████████▏ | 303092/371472 [1:57:25<5:09:37,  3.68it/s]
 82%|████████▏ | 303093/371472 [1:57:25<5:08:54,  3.69it/s]
 82%|████████▏ | 303094/371472 [1:57:25<5:12:29,  3.65it/s]
 82%|████████▏ | 303095/371472 [1:57:26<5:11:40,  3.66it/s]
 82%|████████▏ | 303096/371472 [1:57:26<5:08:08,  3.70it/s]
 82%|████████▏ | 303097/371472 [1:57:26<5:25:45,  3.50it/s]
 82%|████████▏ | 303098/371472 [1:57:27<5:27:13,  3.48it/s]
 82%|████████▏ | 303099/371472 [1:57:27<5:26:18,  3.49it/s]
 82%|████████▏ | 303100/371472 [1:57:27<5:18:13,  3.58it/s]
                                                           
{'loss': 2.6465, 'learning_rate': 2.6574048137214757e-07, 'epoch': 13.06}

 82%|████████▏ | 303100/371472 [1:57:27<5:18:13,  3.58it/s]
 82%|████████▏ | 303101/371472 [1:57:27<5:16:53,  3.60it/s]
 82%|████████▏ | 303102/371472 [1:57:28<5:10:19,  3.67it/s]
 82%|████████▏ | 303103/371472 [1:57:28<5:08:46,  3.69it/s]
 82%|████████▏ | 303104/371472 [1:57:28<5:04:07,  3.75it/s]
 82%|████████▏ | 303105/371472 [1:57:28<5:09:49,  3.68it/s]
 82%|████████▏ | 303106/371472 [1:57:29<5:01:35,  3.78it/s]
 82%|████████▏ | 303107/371472 [1:57:29<5:10:11,  3.67it/s]
 82%|████████▏ | 303108/371472 [1:57:29<5:02:28,  3.77it/s]
 82%|████████▏ | 303109/371472 [1:57:30<5:04:41,  3.74it/s]
 82%|████████▏ | 303110/371472 [1:57:30<5:07:07,  3.71it/s]
 82%|████████▏ | 303111/371472 [1:57:30<5:15:28,  3.61it/s]
 82%|████████▏ | 303112/371472 [1:57:30<5:07:46,  3.70it/s]
 82%|████████▏ | 303113/371472 [1:57:31<5:13:25,  3.64it/s]
 82%|████████▏ | 303114/371472 [1:57:31<5:23:21,  3.52it/s]
 82%|████████▏ | 303115/371472 [1:57:31<5:17:07,  3.59it/s]
 82%|████████▏ | 303116/371472 [1:57:31<5:08:02,  3.70it/s]
 82%|████████▏ | 303117/371472 [1:57:32<5:02:48,  3.76it/s]
 82%|████████▏ | 303118/371472 [1:57:32<5:09:58,  3.68it/s]
 82%|████████▏ | 303119/371472 [1:57:32<5:22:52,  3.53it/s]
 82%|████████▏ | 303120/371472 [1:57:33<5:30:24,  3.45it/s]
                                                           
{'loss': 2.5301, 'learning_rate': 2.6569199939666875e-07, 'epoch': 13.06}

 82%|████████▏ | 303120/371472 [1:57:33<5:30:24,  3.45it/s]
 82%|████████▏ | 303121/371472 [1:57:33<5:25:16,  3.50it/s]
 82%|████████▏ | 303122/371472 [1:57:33<5:24:45,  3.51it/s]
 82%|████████▏ | 303123/371472 [1:57:33<5:26:53,  3.48it/s]
 82%|████████▏ | 303124/371472 [1:57:34<5:16:51,  3.60it/s]
 82%|████████▏ | 303125/371472 [1:57:34<5:07:24,  3.71it/s]
 82%|████████▏ | 303126/371472 [1:57:34<5:08:22,  3.69it/s]
 82%|████████▏ | 303127/371472 [1:57:35<5:42:24,  3.33it/s]
 82%|████████▏ | 303128/371472 [1:57:35<5:28:05,  3.47it/s]
 82%|████████▏ | 303129/371472 [1:57:35<5:28:58,  3.46it/s]
 82%|████████▏ | 303130/371472 [1:57:35<5:23:19,  3.52it/s]
 82%|████████▏ | 303131/371472 [1:57:36<5:12:35,  3.64it/s]
 82%|████████▏ | 303132/371472 [1:57:36<5:06:16,  3.72it/s]
 82%|████████▏ | 303133/371472 [1:57:36<5:12:57,  3.64it/s]
 82%|████████▏ | 303134/371472 [1:57:36<4:58:09,  3.82it/s]
 82%|████████▏ | 303135/371472 [1:57:37<5:12:26,  3.65it/s]
 82%|████████▏ | 303136/371472 [1:57:37<5:15:15,  3.61it/s]
 82%|████████▏ | 303137/371472 [1:57:37<5:15:13,  3.61it/s]
 82%|████████▏ | 303138/371472 [1:57:38<5:27:06,  3.48it/s]
 82%|████████▏ | 303139/371472 [1:57:38<5:55:35,  3.20it/s]
 82%|████████▏ | 303140/371472 [1:57:38<5:39:27,  3.35it/s]
                                                           
{'loss': 2.6109, 'learning_rate': 2.656435174211898e-07, 'epoch': 13.06}

 82%|████████▏ | 303140/371472 [1:57:38<5:39:27,  3.35it/s]
 82%|████████▏ | 303141/371472 [1:57:39<5:39:45,  3.35it/s]
 82%|████████▏ | 303142/371472 [1:57:39<5:33:48,  3.41it/s]
 82%|████████▏ | 303143/371472 [1:57:39<5:29:57,  3.45it/s]
 82%|████████▏ | 303144/371472 [1:57:39<5:10:42,  3.67it/s]
 82%|████████▏ | 303145/371472 [1:57:40<5:15:57,  3.60it/s]
 82%|████████▏ | 303146/371472 [1:57:40<5:09:57,  3.67it/s]
 82%|████████▏ | 303147/371472 [1:57:40<5:16:29,  3.60it/s]
 82%|████████▏ | 303148/371472 [1:57:41<5:25:09,  3.50it/s]
 82%|████████▏ | 303149/371472 [1:57:41<5:09:49,  3.68it/s]
 82%|████████▏ | 303150/371472 [1:57:41<5:04:03,  3.75it/s]
 82%|████████▏ | 303151/371472 [1:57:41<5:15:13,  3.61it/s]
 82%|████████▏ | 303152/371472 [1:57:42<5:16:07,  3.60it/s]
 82%|████████▏ | 303153/371472 [1:57:42<5:30:27,  3.45it/s]
 82%|████████▏ | 303154/371472 [1:57:42<5:11:03,  3.66it/s]
 82%|████████▏ | 303155/371472 [1:57:42<5:09:13,  3.68it/s]
 82%|████████▏ | 303156/371472 [1:57:43<5:25:02,  3.50it/s]
 82%|████████▏ | 303157/371472 [1:57:43<5:13:37,  3.63it/s]
 82%|████████▏ | 303158/371472 [1:57:43<5:31:51,  3.43it/s]
 82%|████████▏ | 303159/371472 [1:57:44<5:21:05,  3.55it/s]
 82%|████████▏ | 303160/371472 [1:57:44<5:16:46,  3.59it/s]
                                                           
{'loss': 2.662, 'learning_rate': 2.65595035445711e-07, 'epoch': 13.06}

 82%|████████▏ | 303160/371472 [1:57:44<5:16:46,  3.59it/s]
 82%|████████▏ | 303161/371472 [1:57:44<5:51:33,  3.24it/s]
 82%|████████▏ | 303162/371472 [1:57:45<5:48:55,  3.26it/s]
 82%|████████▏ | 303163/371472 [1:57:45<5:27:43,  3.47it/s]
 82%|████████▏ | 303164/371472 [1:57:45<5:43:28,  3.31it/s]
 82%|████████▏ | 303165/371472 [1:57:45<5:31:32,  3.43it/s]
 82%|████████▏ | 303166/371472 [1:57:46<5:14:57,  3.61it/s]
 82%|████████▏ | 303167/371472 [1:57:46<5:52:36,  3.23it/s]
 82%|████████▏ | 303168/371472 [1:57:46<5:47:44,  3.27it/s]
 82%|████████▏ | 303169/371472 [1:57:47<5:45:15,  3.30it/s]
 82%|████████▏ | 303170/371472 [1:57:47<5:39:49,  3.35it/s]
 82%|████████▏ | 303171/371472 [1:57:47<5:32:06,  3.43it/s]
 82%|████████▏ | 303172/371472 [1:57:47<5:20:30,  3.55it/s]
 82%|████████▏ | 303173/371472 [1:57:48<5:21:54,  3.54it/s]
 82%|████████▏ | 303174/371472 [1:57:48<5:14:22,  3.62it/s]
 82%|████████▏ | 303175/371472 [1:57:48<5:21:36,  3.54it/s]
 82%|████████▏ | 303176/371472 [1:57:49<5:12:46,  3.64it/s]
 82%|████████▏ | 303177/371472 [1:57:49<5:02:13,  3.77it/s]
 82%|████████▏ | 303178/371472 [1:57:49<4:55:15,  3.86it/s]
 82%|████████▏ | 303179/371472 [1:57:49<4:49:57,  3.93it/s]
 82%|████████▏ | 303180/371472 [1:57:50<4:54:13,  3.87it/s]
                                                           
{'loss': 2.6763, 'learning_rate': 2.65546553470232e-07, 'epoch': 13.06}

 82%|████████▏ | 303180/371472 [1:57:50<4:54:13,  3.87it/s]
 82%|████████▏ | 303181/371472 [1:57:50<5:04:08,  3.74it/s]
 82%|████████▏ | 303182/371472 [1:57:50<5:05:11,  3.73it/s]
 82%|████████▏ | 303183/371472 [1:57:50<5:02:36,  3.76it/s]
 82%|████████▏ | 303184/371472 [1:57:51<5:16:05,  3.60it/s]
 82%|████████▏ | 303185/371472 [1:57:51<5:38:00,  3.37it/s]
 82%|████████▏ | 303186/371472 [1:57:51<5:21:00,  3.55it/s]
 82%|████████▏ | 303187/371472 [1:57:52<5:28:39,  3.46it/s]
 82%|████████▏ | 303188/371472 [1:57:52<5:33:33,  3.41it/s]
 82%|████████▏ | 303189/371472 [1:57:52<5:21:56,  3.53it/s]
 82%|████████▏ | 303190/371472 [1:57:52<5:18:01,  3.58it/s]
 82%|████████▏ | 303191/371472 [1:57:53<5:14:40,  3.62it/s]
 82%|████████▏ | 303192/371472 [1:57:53<5:19:55,  3.56it/s]
 82%|████████▏ | 303193/371472 [1:57:53<5:39:23,  3.35it/s]
 82%|████████▏ | 303194/371472 [1:57:54<5:42:18,  3.32it/s]
 82%|████████▏ | 303195/371472 [1:57:54<5:46:27,  3.28it/s]
 82%|████████▏ | 303196/371472 [1:57:54<5:46:14,  3.29it/s]
 82%|████████▏ | 303197/371472 [1:57:54<5:28:22,  3.47it/s]
 82%|████████▏ | 303198/371472 [1:57:55<5:36:51,  3.38it/s]
 82%|████████▏ | 303199/371472 [1:57:55<5:25:30,  3.50it/s]
 82%|████████▏ | 303200/371472 [1:57:55<5:12:59,  3.64it/s]
                                                           
{'loss': 2.701, 'learning_rate': 2.654980714947532e-07, 'epoch': 13.06}

 82%|████████▏ | 303200/371472 [1:57:55<5:12:59,  3.64it/s]
 82%|████████▏ | 303201/371472 [1:57:56<5:12:38,  3.64it/s]
 82%|████████▏ | 303202/371472 [1:57:56<5:23:23,  3.52it/s]
 82%|████████▏ | 303203/371472 [1:57:56<5:15:56,  3.60it/s]
 82%|████████▏ | 303204/371472 [1:57:56<5:11:54,  3.65it/s]
 82%|████████▏ | 303205/371472 [1:57:57<5:10:35,  3.66it/s]
 82%|████████▏ | 303206/371472 [1:57:57<5:13:47,  3.63it/s]
 82%|████████▏ | 303207/371472 [1:57:57<5:07:54,  3.70it/s]
 82%|████████▏ | 303208/371472 [1:57:57<5:02:04,  3.77it/s]
 82%|████████▏ | 303209/371472 [1:57:58<5:01:15,  3.78it/s]
 82%|████████▏ | 303210/371472 [1:57:58<5:14:35,  3.62it/s]
 82%|████████▏ | 303211/371472 [1:57:58<5:06:31,  3.71it/s]
 82%|████████▏ | 303212/371472 [1:57:59<5:05:15,  3.73it/s]
 82%|████████▏ | 303213/371472 [1:57:59<5:05:21,  3.73it/s]
 82%|████████▏ | 303214/371472 [1:57:59<5:13:56,  3.62it/s]
 82%|████████▏ | 303215/371472 [1:57:59<5:12:37,  3.64it/s]
 82%|████████▏ | 303216/371472 [1:58:00<5:38:23,  3.36it/s]
 82%|████████▏ | 303217/371472 [1:58:00<6:04:31,  3.12it/s]
 82%|████████▏ | 303218/371472 [1:58:00<5:48:25,  3.26it/s]
 82%|████████▏ | 303219/371472 [1:58:01<5:39:22,  3.35it/s]
 82%|████████▏ | 303220/371472 [1:58:01<5:27:14,  3.48it/s]
                                                           
{'loss': 2.6614, 'learning_rate': 2.654495895192742e-07, 'epoch': 13.06}

 82%|████████▏ | 303220/371472 [1:58:01<5:27:14,  3.48it/s]
 82%|████████▏ | 303221/371472 [1:58:01<5:13:22,  3.63it/s]
 82%|████████▏ | 303222/371472 [1:58:02<5:52:34,  3.23it/s]
 82%|████████▏ | 303223/371472 [1:58:02<5:46:43,  3.28it/s]
 82%|████████▏ | 303224/371472 [1:58:02<5:44:08,  3.31it/s]
 82%|████████▏ | 303225/371472 [1:58:02<5:25:39,  3.49it/s]
 82%|████████▏ | 303226/371472 [1:58:03<5:36:15,  3.38it/s]
 82%|████████▏ | 303227/371472 [1:58:03<6:08:36,  3.09it/s]
 82%|████████▏ | 303228/371472 [1:58:03<6:07:55,  3.09it/s]
 82%|████████▏ | 303229/371472 [1:58:04<5:47:58,  3.27it/s]
 82%|████████▏ | 303230/371472 [1:58:04<5:48:27,  3.26it/s]
 82%|████████▏ | 303231/371472 [1:58:04<5:43:26,  3.31it/s]
 82%|████████▏ | 303232/371472 [1:58:05<5:44:58,  3.30it/s]
 82%|████████▏ | 303233/371472 [1:58:05<5:35:03,  3.39it/s]
 82%|████████▏ | 303234/371472 [1:58:05<5:18:55,  3.57it/s]
 82%|████████▏ | 303235/371472 [1:58:05<5:13:39,  3.63it/s]
 82%|████████▏ | 303236/371472 [1:58:06<5:17:20,  3.58it/s]
 82%|████████▏ | 303237/371472 [1:58:06<5:32:54,  3.42it/s]
 82%|████████▏ | 303238/371472 [1:58:06<5:38:07,  3.36it/s]
 82%|████████▏ | 303239/371472 [1:58:07<5:23:26,  3.52it/s]
 82%|████████▏ | 303240/371472 [1:58:07<5:08:08,  3.69it/s]
                                                           
{'loss': 2.525, 'learning_rate': 2.654011075437954e-07, 'epoch': 13.06}

 82%|████████▏ | 303240/371472 [1:58:07<5:08:08,  3.69it/s]
 82%|████████▏ | 303241/371472 [1:58:07<5:06:30,  3.71it/s]
 82%|████████▏ | 303242/371472 [1:58:07<5:04:07,  3.74it/s]
 82%|████████▏ | 303243/371472 [1:58:08<5:19:15,  3.56it/s]
 82%|████████▏ | 303244/371472 [1:58:08<5:13:20,  3.63it/s]
 82%|████████▏ | 303245/371472 [1:58:08<5:10:48,  3.66it/s]
 82%|████████▏ | 303246/371472 [1:58:09<5:49:25,  3.25it/s]
 82%|████████▏ | 303247/371472 [1:58:09<5:33:11,  3.41it/s]
 82%|████████▏ | 303248/371472 [1:58:09<5:31:19,  3.43it/s]
 82%|████████▏ | 303249/371472 [1:58:09<5:22:16,  3.53it/s]
 82%|████████▏ | 303250/371472 [1:58:10<5:19:12,  3.56it/s]
 82%|████████▏ | 303251/371472 [1:58:10<5:03:51,  3.74it/s]
 82%|████████▏ | 303252/371472 [1:58:10<5:27:35,  3.47it/s]
 82%|████████▏ | 303253/371472 [1:58:11<5:50:11,  3.25it/s]
 82%|████████▏ | 303254/371472 [1:58:11<5:34:53,  3.40it/s]
 82%|████████▏ | 303255/371472 [1:58:11<5:21:40,  3.53it/s]
 82%|████████▏ | 303256/371472 [1:58:11<5:08:36,  3.68it/s]
 82%|████████▏ | 303257/371472 [1:58:12<5:05:58,  3.72it/s]
 82%|████████▏ | 303258/371472 [1:58:12<4:59:00,  3.80it/s]
 82%|████████▏ | 303259/371472 [1:58:12<5:44:45,  3.30it/s]
 82%|████████▏ | 303260/371472 [1:58:12<5:29:37,  3.45it/s]
                                                           
{'loss': 2.7763, 'learning_rate': 2.6535262556831646e-07, 'epoch': 13.06}

 82%|████████▏ | 303260/371472 [1:58:12<5:29:37,  3.45it/s]
 82%|████████▏ | 303261/371472 [1:58:13<5:26:28,  3.48it/s]
 82%|████████▏ | 303262/371472 [1:58:13<5:16:13,  3.60it/s]
 82%|████████▏ | 303263/371472 [1:58:13<5:17:59,  3.58it/s]
 82%|████████▏ | 303264/371472 [1:58:14<5:07:54,  3.69it/s]
 82%|████████▏ | 303265/371472 [1:58:14<4:54:16,  3.86it/s]
 82%|████████▏ | 303266/371472 [1:58:14<5:11:11,  3.65it/s]
 82%|████████▏ | 303267/371472 [1:58:14<5:28:48,  3.46it/s]
 82%|████████▏ | 303268/371472 [1:58:15<5:18:20,  3.57it/s]
 82%|████████▏ | 303269/371472 [1:58:15<5:09:04,  3.68it/s]
 82%|████████▏ | 303270/371472 [1:58:15<5:04:39,  3.73it/s]
 82%|████████▏ | 303271/371472 [1:58:16<5:31:04,  3.43it/s]
 82%|████████▏ | 303272/371472 [1:58:16<5:21:47,  3.53it/s]
 82%|████████▏ | 303273/371472 [1:58:16<5:30:44,  3.44it/s]
 82%|████████▏ | 303274/371472 [1:58:16<5:19:39,  3.56it/s]
 82%|████████▏ | 303275/371472 [1:58:17<5:25:49,  3.49it/s]
 82%|████████▏ | 303276/371472 [1:58:17<5:11:32,  3.65it/s]
 82%|████████▏ | 303277/371472 [1:58:17<5:06:38,  3.71it/s]
 82%|████████▏ | 303278/371472 [1:58:17<4:57:48,  3.82it/s]
 82%|████████▏ | 303279/371472 [1:58:18<5:08:20,  3.69it/s]
 82%|████████▏ | 303280/371472 [1:58:18<5:01:36,  3.77it/s]
                                                           
{'loss': 2.5338, 'learning_rate': 2.6530414359283764e-07, 'epoch': 13.06}

 82%|████████▏ | 303280/371472 [1:58:18<5:01:36,  3.77it/s]
 82%|████████▏ | 303281/371472 [1:58:18<5:06:29,  3.71it/s]
 82%|████████▏ | 303282/371472 [1:58:19<5:09:21,  3.67it/s]
 82%|████████▏ | 303283/371472 [1:58:19<5:11:32,  3.65it/s]
 82%|████████▏ | 303284/371472 [1:58:19<5:17:21,  3.58it/s]
 82%|████████▏ | 303285/371472 [1:58:19<5:22:51,  3.52it/s]
 82%|████████▏ | 303286/371472 [1:58:20<6:03:34,  3.13it/s]
 82%|████████▏ | 303287/371472 [1:58:20<5:37:42,  3.37it/s]
 82%|████████▏ | 303288/371472 [1:58:20<5:26:06,  3.48it/s]
 82%|████████▏ | 303289/371472 [1:58:21<5:36:20,  3.38it/s]
 82%|████████▏ | 303290/371472 [1:58:21<5:46:58,  3.27it/s]
 82%|████████▏ | 303291/371472 [1:58:21<5:41:07,  3.33it/s]
 82%|████████▏ | 303292/371472 [1:58:21<5:30:36,  3.44it/s]
 82%|████████▏ | 303293/371472 [1:58:22<5:25:21,  3.49it/s]
 82%|████████▏ | 303294/371472 [1:58:22<5:12:00,  3.64it/s]
 82%|████████▏ | 303295/371472 [1:58:22<5:04:43,  3.73it/s]
 82%|████████▏ | 303296/371472 [1:58:23<4:56:18,  3.83it/s]
 82%|████████▏ | 303297/371472 [1:58:23<5:08:04,  3.69it/s]
 82%|████████▏ | 303298/371472 [1:58:23<5:21:11,  3.54it/s]
 82%|████████▏ | 303299/371472 [1:58:23<5:18:49,  3.56it/s]
 82%|████████▏ | 303300/371472 [1:58:24<5:17:10,  3.58it/s]
                                                           
{'loss': 2.5807, 'learning_rate': 2.6525566161735866e-07, 'epoch': 13.06}

 82%|████████▏ | 303300/371472 [1:58:24<5:17:10,  3.58it/s]
 82%|████████▏ | 303301/371472 [1:58:24<5:09:11,  3.67it/s]
 82%|████████▏ | 303302/371472 [1:58:24<5:07:14,  3.70it/s]
 82%|████████▏ | 303303/371472 [1:58:24<5:09:06,  3.68it/s]
 82%|████████▏ | 303304/371472 [1:58:25<5:12:05,  3.64it/s]
 82%|████████▏ | 303305/371472 [1:58:25<5:19:03,  3.56it/s]
 82%|████████▏ | 303306/371472 [1:58:25<5:13:14,  3.63it/s]
 82%|████████▏ | 303307/371472 [1:58:26<5:02:11,  3.76it/s]
 82%|████████▏ | 303308/371472 [1:58:26<5:02:33,  3.75it/s]
 82%|████████▏ | 303309/371472 [1:58:26<5:09:14,  3.67it/s]
 82%|████████▏ | 303310/371472 [1:58:26<5:01:46,  3.76it/s]
 82%|████████▏ | 303311/371472 [1:58:27<5:15:32,  3.60it/s]
 82%|████████▏ | 303312/371472 [1:58:27<5:06:12,  3.71it/s]
 82%|████████▏ | 303313/371472 [1:58:27<5:15:59,  3.59it/s]
 82%|████████▏ | 303314/371472 [1:58:27<5:18:24,  3.57it/s]
 82%|████████▏ | 303315/371472 [1:58:28<5:24:18,  3.50it/s]
 82%|████████▏ | 303316/371472 [1:58:28<5:09:18,  3.67it/s]
 82%|████████▏ | 303317/371472 [1:58:28<5:18:11,  3.57it/s]
 82%|████████▏ | 303318/371472 [1:58:29<6:15:55,  3.02it/s]
 82%|████████▏ | 303319/371472 [1:58:29<5:50:53,  3.24it/s]
 82%|████████▏ | 303320/371472 [1:58:29<5:55:08,  3.20it/s]
                                                           
{'loss': 2.6429, 'learning_rate': 2.6520717964187983e-07, 'epoch': 13.06}

 82%|████████▏ | 303320/371472 [1:58:29<5:55:08,  3.20it/s]
 82%|████████▏ | 303321/371472 [1:58:30<5:43:16,  3.31it/s]
 82%|████████▏ | 303322/371472 [1:58:30<5:43:58,  3.30it/s]
 82%|████████▏ | 303323/371472 [1:58:30<5:29:44,  3.44it/s]
 82%|████████▏ | 303324/371472 [1:58:30<5:13:25,  3.62it/s]
 82%|████████▏ | 303325/371472 [1:58:31<5:14:07,  3.62it/s]
 82%|████████▏ | 303326/371472 [1:58:31<5:12:47,  3.63it/s]
 82%|████████▏ | 303327/371472 [1:58:31<5:08:22,  3.68it/s]
 82%|████████▏ | 303328/371472 [1:58:32<5:05:02,  3.72it/s]
 82%|████████▏ | 303329/371472 [1:58:32<5:04:08,  3.73it/s]
 82%|████████▏ | 303330/371472 [1:58:32<5:01:25,  3.77it/s]
 82%|████████▏ | 303331/371472 [1:58:32<5:21:35,  3.53it/s]
 82%|████████▏ | 303332/371472 [1:58:33<5:13:59,  3.62it/s]
 82%|████████▏ | 303333/371472 [1:58:33<5:03:26,  3.74it/s]
 82%|████████▏ | 303334/371472 [1:58:33<4:58:04,  3.81it/s]
 82%|████████▏ | 303335/371472 [1:58:33<5:04:52,  3.72it/s]
 82%|████████▏ | 303336/371472 [1:58:34<4:57:20,  3.82it/s]
 82%|████████▏ | 303337/371472 [1:58:34<5:37:32,  3.36it/s]
 82%|████████▏ | 303338/371472 [1:58:34<5:27:10,  3.47it/s]
 82%|████████▏ | 303339/371472 [1:58:35<5:22:40,  3.52it/s]
 82%|████████▏ | 303340/371472 [1:58:35<5:38:33,  3.35it/s]
                                                           
{'loss': 2.5146, 'learning_rate': 2.6515869766640085e-07, 'epoch': 13.07}

 82%|████████▏ | 303340/371472 [1:58:35<5:38:33,  3.35it/s]
 82%|████████▏ | 303341/371472 [1:58:35<5:25:20,  3.49it/s]
 82%|████████▏ | 303342/371472 [1:58:35<5:40:47,  3.33it/s]
 82%|████████▏ | 303343/371472 [1:58:36<5:26:35,  3.48it/s]
 82%|████████▏ | 303344/371472 [1:58:36<5:18:56,  3.56it/s]
 82%|████████▏ | 303345/371472 [1:58:36<5:19:39,  3.55it/s]
 82%|████████▏ | 303346/371472 [1:58:37<5:17:55,  3.57it/s]
 82%|████████▏ | 303347/371472 [1:58:37<5:17:17,  3.58it/s]
 82%|████████▏ | 303348/371472 [1:58:37<5:12:17,  3.64it/s]
 82%|████████▏ | 303349/371472 [1:58:37<5:09:23,  3.67it/s]
 82%|████████▏ | 303350/371472 [1:58:38<5:06:55,  3.70it/s]
 82%|████████▏ | 303351/371472 [1:58:38<4:56:45,  3.83it/s]
 82%|████████▏ | 303352/371472 [1:58:38<5:02:36,  3.75it/s]
 82%|████████▏ | 303353/371472 [1:58:38<5:16:09,  3.59it/s]
 82%|████████▏ | 303354/371472 [1:58:39<5:03:08,  3.75it/s]
 82%|████████▏ | 303355/371472 [1:58:39<4:54:48,  3.85it/s]
 82%|████████▏ | 303356/371472 [1:58:39<5:01:38,  3.76it/s]
 82%|████████▏ | 303357/371472 [1:58:40<5:00:21,  3.78it/s]
 82%|████████▏ | 303358/371472 [1:58:40<4:58:37,  3.80it/s]
 82%|████████▏ | 303359/371472 [1:58:40<4:51:11,  3.90it/s]
 82%|████████▏ | 303360/371472 [1:58:40<4:46:40,  3.96it/s]
                                                           
{'loss': 2.4708, 'learning_rate': 2.6511021569092203e-07, 'epoch': 13.07}

 82%|████████▏ | 303360/371472 [1:58:40<4:46:40,  3.96it/s]
 82%|████████▏ | 303361/371472 [1:58:41<4:49:39,  3.92it/s]
 82%|████████▏ | 303362/371472 [1:58:41<4:44:32,  3.99it/s]
 82%|████████▏ | 303363/371472 [1:58:41<5:00:46,  3.77it/s]
 82%|████████▏ | 303364/371472 [1:58:41<5:17:55,  3.57it/s]
 82%|████████▏ | 303365/371472 [1:58:42<5:10:36,  3.65it/s]
 82%|████████▏ | 303366/371472 [1:58:42<5:37:19,  3.37it/s]
 82%|████████▏ | 303367/371472 [1:58:42<5:26:17,  3.48it/s]
 82%|████████▏ | 303368/371472 [1:58:43<5:24:16,  3.50it/s]
 82%|████████▏ | 303369/371472 [1:58:43<5:11:39,  3.64it/s]
 82%|████████▏ | 303370/371472 [1:58:43<5:18:11,  3.57it/s]
 82%|████████▏ | 303371/371472 [1:58:43<5:54:52,  3.20it/s]
 82%|████████▏ | 303372/371472 [1:58:44<5:32:27,  3.41it/s]
 82%|████████▏ | 303373/371472 [1:58:44<5:28:53,  3.45it/s]
 82%|████████▏ | 303374/371472 [1:58:44<5:16:41,  3.58it/s]
 82%|████████▏ | 303375/371472 [1:58:44<5:08:55,  3.67it/s]
 82%|████████▏ | 303376/371472 [1:58:45<5:06:53,  3.70it/s]
 82%|████████▏ | 303377/371472 [1:58:45<5:41:23,  3.32it/s]
 82%|████████▏ | 303378/371472 [1:58:45<5:15:42,  3.59it/s]
 82%|████████▏ | 303379/371472 [1:58:46<5:18:02,  3.57it/s]
 82%|████████▏ | 303380/371472 [1:58:46<5:31:38,  3.42it/s]
                                                           
{'loss': 2.5624, 'learning_rate': 2.650617337154431e-07, 'epoch': 13.07}

 82%|████████▏ | 303380/371472 [1:58:46<5:31:38,  3.42it/s]
 82%|████████▏ | 303381/371472 [1:58:46<5:21:24,  3.53it/s]
 82%|████████▏ | 303382/371472 [1:58:46<5:12:26,  3.63it/s]
 82%|████████▏ | 303383/371472 [1:58:47<5:04:18,  3.73it/s]
 82%|████████▏ | 303384/371472 [1:58:47<5:25:18,  3.49it/s]
 82%|████████▏ | 303385/371472 [1:58:47<5:24:26,  3.50it/s]
 82%|████████▏ | 303386/371472 [1:58:48<5:16:45,  3.58it/s]
 82%|████████▏ | 303387/371472 [1:58:48<5:06:41,  3.70it/s]
 82%|████████▏ | 303388/371472 [1:58:48<5:05:25,  3.72it/s]
 82%|████████▏ | 303389/371472 [1:58:48<4:57:46,  3.81it/s]
 82%|████████▏ | 303390/371472 [1:58:49<4:47:49,  3.94it/s]
 82%|████████▏ | 303391/371472 [1:58:49<4:55:31,  3.84it/s]
 82%|████████▏ | 303392/371472 [1:58:49<4:52:15,  3.88it/s]
 82%|████████▏ | 303393/371472 [1:58:49<4:48:03,  3.94it/s]
 82%|████████▏ | 303394/371472 [1:58:50<4:50:23,  3.91it/s]
 82%|████████▏ | 303395/371472 [1:58:50<4:55:29,  3.84it/s]
 82%|████████▏ | 303396/371472 [1:58:50<4:48:56,  3.93it/s]
 82%|████████▏ | 303397/371472 [1:58:50<4:50:46,  3.90it/s]
 82%|████████▏ | 303398/371472 [1:58:51<4:48:50,  3.93it/s]
 82%|████████▏ | 303399/371472 [1:58:51<5:54:33,  3.20it/s]
 82%|████████▏ | 303400/371472 [1:58:51<5:36:52,  3.37it/s]
                                                           
{'loss': 2.6605, 'learning_rate': 2.650132517399643e-07, 'epoch': 13.07}

 82%|████████▏ | 303400/371472 [1:58:51<5:36:52,  3.37it/s]
 82%|████████▏ | 303401/371472 [1:58:52<5:23:58,  3.50it/s]
 82%|████████▏ | 303402/371472 [1:58:52<5:36:04,  3.38it/s]
 82%|████████▏ | 303403/371472 [1:58:52<5:46:12,  3.28it/s]
 82%|████████▏ | 303404/371472 [1:58:53<5:47:01,  3.27it/s]
 82%|████████▏ | 303405/371472 [1:58:53<5:56:53,  3.18it/s]
 82%|████████▏ | 303406/371472 [1:58:53<5:41:56,  3.32it/s]
 82%|████████▏ | 303407/371472 [1:58:54<5:45:56,  3.28it/s]
 82%|████████▏ | 303408/371472 [1:58:54<5:33:32,  3.40it/s]
 82%|████████▏ | 303409/371472 [1:58:54<5:14:55,  3.60it/s]
 82%|████████▏ | 303410/371472 [1:58:54<5:19:27,  3.55it/s]
 82%|████████▏ | 303411/371472 [1:58:55<5:19:47,  3.55it/s]
 82%|████████▏ | 303412/371472 [1:58:55<5:15:04,  3.60it/s]
 82%|████████▏ | 303413/371472 [1:58:55<5:16:55,  3.58it/s]
 82%|████████▏ | 303414/371472 [1:58:55<5:12:16,  3.63it/s]
 82%|████████▏ | 303415/371472 [1:58:56<5:01:19,  3.76it/s]
 82%|████████▏ | 303416/371472 [1:58:56<5:46:15,  3.28it/s]
 82%|████████▏ | 303417/371472 [1:58:56<5:53:11,  3.21it/s]
 82%|████████▏ | 303418/371472 [1:58:57<5:37:52,  3.36it/s]
 82%|████████▏ | 303419/371472 [1:58:57<5:34:59,  3.39it/s]
 82%|████████▏ | 303420/371472 [1:58:57<5:24:09,  3.50it/s]
                                                           
{'loss': 2.6118, 'learning_rate': 2.6496476976448535e-07, 'epoch': 13.07}

 82%|████████▏ | 303420/371472 [1:58:57<5:24:09,  3.50it/s]
 82%|████████▏ | 303421/371472 [1:58:57<5:31:24,  3.42it/s]
 82%|████████▏ | 303422/371472 [1:58:58<5:14:39,  3.60it/s]
 82%|████████▏ | 303423/371472 [1:58:58<5:40:34,  3.33it/s]
 82%|████████▏ | 303424/371472 [1:58:58<5:28:27,  3.45it/s]
 82%|████████▏ | 303425/371472 [1:58:59<5:27:56,  3.46it/s]
 82%|████████▏ | 303426/371472 [1:58:59<5:20:46,  3.54it/s]
 82%|████████▏ | 303427/371472 [1:58:59<5:23:01,  3.51it/s]
 82%|████████▏ | 303428/371472 [1:59:00<5:41:17,  3.32it/s]
 82%|████████▏ | 303429/371472 [1:59:00<5:38:22,  3.35it/s]
 82%|████████▏ | 303430/371472 [1:59:00<5:29:10,  3.45it/s]
 82%|████████▏ | 303431/371472 [1:59:00<5:30:28,  3.43it/s]
 82%|████████▏ | 303432/371472 [1:59:01<5:24:25,  3.50it/s]
 82%|████████▏ | 303433/371472 [1:59:01<5:11:59,  3.63it/s]
 82%|████████▏ | 303434/371472 [1:59:01<5:25:18,  3.49it/s]
 82%|████████▏ | 303435/371472 [1:59:01<5:12:38,  3.63it/s]
 82%|████████▏ | 303436/371472 [1:59:02<5:05:52,  3.71it/s]
 82%|████████▏ | 303437/371472 [1:59:02<5:07:08,  3.69it/s]
 82%|████████▏ | 303438/371472 [1:59:02<5:00:26,  3.77it/s]
 82%|████████▏ | 303439/371472 [1:59:03<5:07:03,  3.69it/s]
 82%|████████▏ | 303440/371472 [1:59:03<5:15:09,  3.60it/s]
                                                           
{'loss': 2.6912, 'learning_rate': 2.649162877890065e-07, 'epoch': 13.07}

 82%|████████▏ | 303440/371472 [1:59:03<5:15:09,  3.60it/s]
 82%|████████▏ | 303441/371472 [1:59:03<5:18:57,  3.55it/s]
 82%|████████▏ | 303442/371472 [1:59:03<5:27:10,  3.47it/s]
 82%|████████▏ | 303443/371472 [1:59:04<5:33:29,  3.40it/s]
 82%|████████▏ | 303444/371472 [1:59:04<5:33:14,  3.40it/s]
 82%|████████▏ | 303445/371472 [1:59:04<5:23:43,  3.50it/s]
 82%|████████▏ | 303446/371472 [1:59:05<5:19:21,  3.55it/s]
 82%|████████▏ | 303447/371472 [1:59:05<5:33:00,  3.40it/s]
 82%|████████▏ | 303448/371472 [1:59:05<5:39:09,  3.34it/s]
 82%|████████▏ | 303449/371472 [1:59:05<5:26:32,  3.47it/s]
 82%|████████▏ | 303450/371472 [1:59:06<5:18:40,  3.56it/s]
 82%|████████▏ | 303451/371472 [1:59:06<5:17:09,  3.57it/s]
 82%|████████▏ | 303452/371472 [1:59:06<5:24:12,  3.50it/s]
 82%|████████▏ | 303453/371472 [1:59:07<5:18:29,  3.56it/s]
 82%|████████▏ | 303454/371472 [1:59:07<5:33:21,  3.40it/s]
 82%|████████▏ | 303455/371472 [1:59:07<5:27:16,  3.46it/s]
 82%|████████▏ | 303456/371472 [1:59:07<5:28:06,  3.45it/s]
 82%|████████▏ | 303457/371472 [1:59:08<5:17:34,  3.57it/s]
 82%|████████▏ | 303458/371472 [1:59:08<6:32:09,  2.89it/s]
 82%|████████▏ | 303459/371472 [1:59:09<6:19:32,  2.99it/s]
 82%|████████▏ | 303460/371472 [1:59:09<5:54:15,  3.20it/s]
                                                           
{'loss': 2.6579, 'learning_rate': 2.6486780581352755e-07, 'epoch': 13.07}

 82%|████████▏ | 303460/371472 [1:59:09<5:54:15,  3.20it/s]
 82%|████████▏ | 303461/371472 [1:59:09<5:35:02,  3.38it/s]
 82%|████████▏ | 303462/371472 [1:59:09<5:19:59,  3.54it/s]
 82%|████████▏ | 303463/371472 [1:59:10<5:12:06,  3.63it/s]
 82%|████████▏ | 303464/371472 [1:59:10<5:02:17,  3.75it/s]
 82%|████████▏ | 303465/371472 [1:59:10<5:02:33,  3.75it/s]
 82%|████████▏ | 303466/371472 [1:59:10<5:12:42,  3.62it/s]
 82%|████████▏ | 303467/371472 [1:59:11<5:02:54,  3.74it/s]
 82%|████████▏ | 303468/371472 [1:59:11<5:07:29,  3.69it/s]
 82%|████████▏ | 303469/371472 [1:59:11<5:17:31,  3.57it/s]
 82%|████████▏ | 303470/371472 [1:59:11<5:14:15,  3.61it/s]
 82%|████████▏ | 303471/371472 [1:59:12<5:06:59,  3.69it/s]
 82%|████████▏ | 303472/371472 [1:59:12<5:30:29,  3.43it/s]
 82%|████████▏ | 303473/371472 [1:59:12<5:21:39,  3.52it/s]
 82%|████████▏ | 303474/371472 [1:59:13<5:38:55,  3.34it/s]
 82%|████████▏ | 303475/371472 [1:59:13<5:31:15,  3.42it/s]
 82%|████████▏ | 303476/371472 [1:59:13<5:49:43,  3.24it/s]
 82%|████████▏ | 303477/371472 [1:59:14<5:35:06,  3.38it/s]
 82%|████████▏ | 303478/371472 [1:59:14<6:15:13,  3.02it/s]
 82%|████████▏ | 303479/371472 [1:59:14<6:05:33,  3.10it/s]
 82%|████████▏ | 303480/371472 [1:59:15<6:18:19,  3.00it/s]
                                                           
{'loss': 2.6719, 'learning_rate': 2.6481932383804867e-07, 'epoch': 13.07}

 82%|████████▏ | 303480/371472 [1:59:15<6:18:19,  3.00it/s]
 82%|████████▏ | 303481/371472 [1:59:15<6:18:21,  2.99it/s]
 82%|████████▏ | 303482/371472 [1:59:15<6:03:07,  3.12it/s]
 82%|████████▏ | 303483/371472 [1:59:16<5:57:33,  3.17it/s]
 82%|████████▏ | 303484/371472 [1:59:16<5:50:46,  3.23it/s]
 82%|████████▏ | 303485/371472 [1:59:16<5:55:59,  3.18it/s]
 82%|████████▏ | 303486/371472 [1:59:16<5:33:29,  3.40it/s]
 82%|████████▏ | 303487/371472 [1:59:17<5:22:34,  3.51it/s]
 82%|████████▏ | 303488/371472 [1:59:17<5:31:54,  3.41it/s]
 82%|████████▏ | 303489/371472 [1:59:17<5:17:14,  3.57it/s]
 82%|████████▏ | 303490/371472 [1:59:18<5:28:59,  3.44it/s]
 82%|████████▏ | 303491/371472 [1:59:18<5:55:29,  3.19it/s]
 82%|████████▏ | 303492/371472 [1:59:18<5:36:24,  3.37it/s]
 82%|████████▏ | 303493/371472 [1:59:18<5:27:45,  3.46it/s]
 82%|████████▏ | 303494/371472 [1:59:19<5:18:02,  3.56it/s]
 82%|████████▏ | 303495/371472 [1:59:19<5:14:14,  3.61it/s]
 82%|████████▏ | 303496/371472 [1:59:19<5:10:13,  3.65it/s]
 82%|████████▏ | 303497/371472 [1:59:20<5:02:22,  3.75it/s]
 82%|████████▏ | 303498/371472 [1:59:20<4:59:44,  3.78it/s]
 82%|████████▏ | 303499/371472 [1:59:20<5:09:57,  3.65it/s]
 82%|████████▏ | 303500/371472 [1:59:20<5:01:13,  3.76it/s]
                                                           
{'loss': 2.7401, 'learning_rate': 2.6477084186256974e-07, 'epoch': 13.07}

 82%|████████▏ | 303500/371472 [1:59:20<5:01:13,  3.76it/s]
 82%|████████▏ | 303501/371472 [1:59:21<5:34:46,  3.38it/s]
 82%|████████▏ | 303502/371472 [1:59:21<5:24:53,  3.49it/s]
 82%|████████▏ | 303503/371472 [1:59:21<5:24:19,  3.49it/s]
 82%|████████▏ | 303504/371472 [1:59:21<5:11:53,  3.63it/s]
 82%|████████▏ | 303505/371472 [1:59:22<5:07:05,  3.69it/s]
 82%|████████▏ | 303506/371472 [1:59:22<5:14:48,  3.60it/s]
 82%|████████▏ | 303507/371472 [1:59:22<5:13:01,  3.62it/s]
 82%|████████▏ | 303508/371472 [1:59:23<5:31:57,  3.41it/s]
 82%|████████▏ | 303509/371472 [1:59:23<5:24:52,  3.49it/s]
 82%|████████▏ | 303510/371472 [1:59:23<5:25:47,  3.48it/s]
 82%|████████▏ | 303511/371472 [1:59:24<5:37:01,  3.36it/s]
 82%|████████▏ | 303512/371472 [1:59:24<5:30:44,  3.42it/s]
 82%|████████▏ | 303513/371472 [1:59:24<5:29:41,  3.44it/s]
 82%|████████▏ | 303514/371472 [1:59:24<5:09:28,  3.66it/s]
 82%|████████▏ | 303515/371472 [1:59:25<4:58:50,  3.79it/s]
 82%|████████▏ | 303516/371472 [1:59:25<4:55:49,  3.83it/s]
 82%|████████▏ | 303517/371472 [1:59:25<4:53:32,  3.86it/s]
 82%|████████▏ | 303518/371472 [1:59:25<5:07:38,  3.68it/s]
 82%|████████▏ | 303519/371472 [1:59:26<5:01:35,  3.76it/s]
 82%|████████▏ | 303520/371472 [1:59:26<4:59:57,  3.78it/s]
                                                           
{'loss': 2.6363, 'learning_rate': 2.647223598870908e-07, 'epoch': 13.07}

 82%|████████▏ | 303520/371472 [1:59:26<4:59:57,  3.78it/s]
 82%|████████▏ | 303521/371472 [1:59:26<5:07:18,  3.69it/s]
 82%|████████▏ | 303522/371472 [1:59:26<5:09:41,  3.66it/s]
 82%|████████▏ | 303523/371472 [1:59:27<5:08:49,  3.67it/s]
 82%|████████▏ | 303524/371472 [1:59:27<5:00:31,  3.77it/s]
 82%|████████▏ | 303525/371472 [1:59:27<5:05:19,  3.71it/s]
 82%|████████▏ | 303526/371472 [1:59:28<5:15:40,  3.59it/s]
 82%|████████▏ | 303527/371472 [1:59:28<5:19:04,  3.55it/s]
 82%|████████▏ | 303528/371472 [1:59:28<5:17:24,  3.57it/s]
 82%|████████▏ | 303529/371472 [1:59:28<5:22:08,  3.52it/s]
 82%|████████▏ | 303530/371472 [1:59:29<5:11:50,  3.63it/s]
 82%|████████▏ | 303531/371472 [1:59:29<5:13:23,  3.61it/s]
 82%|████████▏ | 303532/371472 [1:59:29<5:10:38,  3.65it/s]
 82%|████████▏ | 303533/371472 [1:59:30<5:22:45,  3.51it/s]
 82%|████████▏ | 303534/371472 [1:59:30<5:17:42,  3.56it/s]
 82%|████████▏ | 303535/371472 [1:59:30<5:34:51,  3.38it/s]
 82%|████████▏ | 303536/371472 [1:59:30<5:33:04,  3.40it/s]
 82%|████████▏ | 303537/371472 [1:59:31<5:17:24,  3.57it/s]
 82%|████████▏ | 303538/371472 [1:59:31<5:20:30,  3.53it/s]
 82%|████████▏ | 303539/371472 [1:59:31<5:22:13,  3.51it/s]
 82%|████████▏ | 303540/371472 [1:59:32<5:43:49,  3.29it/s]
                                                           
{'loss': 2.5892, 'learning_rate': 2.64673877911612e-07, 'epoch': 13.07}

 82%|████████▏ | 303540/371472 [1:59:32<5:43:49,  3.29it/s]
 82%|████████▏ | 303541/371472 [1:59:32<5:36:16,  3.37it/s]
 82%|████████▏ | 303542/371472 [1:59:32<5:24:21,  3.49it/s]
 82%|████████▏ | 303543/371472 [1:59:33<6:43:07,  2.81it/s]
 82%|████████▏ | 303544/371472 [1:59:33<6:17:27,  3.00it/s]
 82%|████████▏ | 303545/371472 [1:59:33<5:49:37,  3.24it/s]
 82%|████████▏ | 303546/371472 [1:59:33<5:45:58,  3.27it/s]
 82%|████████▏ | 303547/371472 [1:59:34<5:50:48,  3.23it/s]
 82%|████████▏ | 303548/371472 [1:59:34<5:25:20,  3.48it/s]
 82%|████████▏ | 303549/371472 [1:59:34<5:19:09,  3.55it/s]
 82%|████████▏ | 303550/371472 [1:59:35<5:05:17,  3.71it/s]
 82%|████████▏ | 303551/371472 [1:59:35<5:25:36,  3.48it/s]
 82%|████████▏ | 303552/371472 [1:59:35<5:21:22,  3.52it/s]
 82%|████████▏ | 303553/371472 [1:59:35<5:14:20,  3.60it/s]
 82%|████████▏ | 303554/371472 [1:59:36<5:05:30,  3.71it/s]
 82%|████████▏ | 303555/371472 [1:59:36<5:04:02,  3.72it/s]
 82%|████████▏ | 303556/371472 [1:59:36<5:12:05,  3.63it/s]
 82%|████████▏ | 303557/371472 [1:59:37<5:12:38,  3.62it/s]
 82%|████████▏ | 303558/371472 [1:59:37<5:02:30,  3.74it/s]
 82%|████████▏ | 303559/371472 [1:59:37<5:04:43,  3.71it/s]
 82%|████████▏ | 303560/371472 [1:59:37<5:04:07,  3.72it/s]
                                                           
{'loss': 2.5345, 'learning_rate': 2.64625395936133e-07, 'epoch': 13.07}

 82%|████████▏ | 303560/371472 [1:59:37<5:04:07,  3.72it/s]
 82%|████████▏ | 303561/371472 [1:59:38<4:56:11,  3.82it/s]
 82%|████████▏ | 303562/371472 [1:59:38<5:02:06,  3.75it/s]
 82%|████████▏ | 303563/371472 [1:59:38<5:09:00,  3.66it/s]
 82%|████████▏ | 303564/371472 [1:59:38<5:03:04,  3.73it/s]
 82%|████████▏ | 303565/371472 [1:59:39<5:33:19,  3.40it/s]
 82%|████████▏ | 303566/371472 [1:59:39<5:27:26,  3.46it/s]
 82%|████████▏ | 303567/371472 [1:59:39<5:37:00,  3.36it/s]
 82%|████████▏ | 303568/371472 [1:59:40<5:45:45,  3.27it/s]
 82%|████████▏ | 303569/371472 [1:59:40<5:29:35,  3.43it/s]
 82%|████████▏ | 303570/371472 [1:59:40<5:17:13,  3.57it/s]
 82%|████████▏ | 303571/371472 [1:59:40<5:11:56,  3.63it/s]
 82%|████████▏ | 303572/371472 [1:59:41<5:31:37,  3.41it/s]
 82%|████████▏ | 303573/371472 [1:59:41<5:26:44,  3.46it/s]
 82%|████████▏ | 303574/371472 [1:59:41<5:27:39,  3.45it/s]
 82%|████████▏ | 303575/371472 [1:59:42<5:18:41,  3.55it/s]
 82%|████████▏ | 303576/371472 [1:59:42<5:04:02,  3.72it/s]
 82%|████████▏ | 303577/371472 [1:59:42<5:20:43,  3.53it/s]
 82%|████████▏ | 303578/371472 [1:59:42<5:16:18,  3.58it/s]
 82%|████████▏ | 303579/371472 [1:59:43<5:12:04,  3.63it/s]
 82%|████████▏ | 303580/371472 [1:59:43<5:02:02,  3.75it/s]
                                                           
{'loss': 2.6091, 'learning_rate': 2.645769139606542e-07, 'epoch': 13.08}

 82%|████████▏ | 303580/371472 [1:59:43<5:02:02,  3.75it/s]
 82%|████████▏ | 303581/371472 [1:59:43<5:03:44,  3.73it/s]
 82%|████████▏ | 303582/371472 [1:59:43<4:56:28,  3.82it/s]
 82%|████████▏ | 303583/371472 [1:59:44<5:20:18,  3.53it/s]
 82%|████████▏ | 303584/371472 [1:59:44<5:13:36,  3.61it/s]
 82%|████████▏ | 303585/371472 [1:59:44<5:32:52,  3.40it/s]
 82%|████████▏ | 303586/371472 [1:59:45<5:26:24,  3.47it/s]
 82%|████████▏ | 303587/371472 [1:59:45<5:19:26,  3.54it/s]
 82%|████████▏ | 303588/371472 [1:59:45<5:48:19,  3.25it/s]
 82%|████████▏ | 303589/371472 [1:59:46<5:29:53,  3.43it/s]
 82%|████████▏ | 303590/371472 [1:59:46<5:32:40,  3.40it/s]
 82%|████████▏ | 303591/371472 [1:59:46<5:27:00,  3.46it/s]
 82%|████████▏ | 303592/371472 [1:59:46<5:26:40,  3.46it/s]
 82%|████████▏ | 303593/371472 [1:59:47<5:12:03,  3.63it/s]
 82%|████████▏ | 303594/371472 [1:59:47<5:15:30,  3.59it/s]
 82%|████████▏ | 303595/371472 [1:59:47<5:10:39,  3.64it/s]
 82%|████████▏ | 303596/371472 [1:59:47<5:15:34,  3.58it/s]
 82%|████████▏ | 303597/371472 [1:59:48<5:13:04,  3.61it/s]
 82%|████████▏ | 303598/371472 [1:59:48<5:04:01,  3.72it/s]
 82%|████████▏ | 303599/371472 [1:59:48<5:01:53,  3.75it/s]
 82%|████████▏ | 303600/371472 [1:59:49<5:03:53,  3.72it/s]
                                                           
{'loss': 2.5794, 'learning_rate': 2.645284319851752e-07, 'epoch': 13.08}

 82%|████████▏ | 303600/371472 [1:59:49<5:03:53,  3.72it/s]
 82%|████████▏ | 303601/371472 [1:59:49<5:09:58,  3.65it/s]
 82%|████████▏ | 303602/371472 [1:59:49<5:21:39,  3.52it/s]
 82%|████████▏ | 303603/371472 [1:59:49<5:22:28,  3.51it/s]
 82%|████████▏ | 303604/371472 [1:59:50<5:16:03,  3.58it/s]
 82%|████████▏ | 303605/371472 [1:59:50<5:09:11,  3.66it/s]
 82%|████████▏ | 303606/371472 [1:59:50<5:21:27,  3.52it/s]
 82%|████████▏ | 303607/371472 [1:59:51<5:17:52,  3.56it/s]
 82%|████████▏ | 303608/371472 [1:59:51<5:10:25,  3.64it/s]
 82%|████████▏ | 303609/371472 [1:59:51<5:10:30,  3.64it/s]
 82%|████████▏ | 303610/371472 [1:59:51<5:05:01,  3.71it/s]
 82%|████████▏ | 303611/371472 [1:59:52<5:01:07,  3.76it/s]
 82%|████████▏ | 303612/371472 [1:59:52<5:12:23,  3.62it/s]
 82%|████████▏ | 303613/371472 [1:59:52<5:10:54,  3.64it/s]
 82%|████████▏ | 303614/371472 [1:59:52<5:28:19,  3.44it/s]
 82%|████████▏ | 303615/371472 [1:59:53<5:23:11,  3.50it/s]
 82%|████████▏ | 303616/371472 [1:59:53<5:12:33,  3.62it/s]
 82%|████████▏ | 303617/371472 [1:59:53<5:15:13,  3.59it/s]
 82%|████████▏ | 303618/371472 [1:59:54<5:12:45,  3.62it/s]
 82%|████████▏ | 303619/371472 [1:59:54<5:25:13,  3.48it/s]
 82%|████████▏ | 303620/371472 [1:59:54<5:20:26,  3.53it/s]
                                                           
{'loss': 2.6407, 'learning_rate': 2.644799500096964e-07, 'epoch': 13.08}

 82%|████████▏ | 303620/371472 [1:59:54<5:20:26,  3.53it/s]
 82%|████████▏ | 303621/371472 [1:59:54<5:14:18,  3.60it/s]
 82%|████████▏ | 303622/371472 [1:59:55<5:17:12,  3.56it/s]
 82%|████████▏ | 303623/371472 [1:59:55<5:04:35,  3.71it/s]
 82%|████████▏ | 303624/371472 [1:59:55<5:06:41,  3.69it/s]
 82%|████████▏ | 303625/371472 [1:59:55<5:04:20,  3.72it/s]
 82%|████████▏ | 303626/371472 [1:59:56<4:57:05,  3.81it/s]
 82%|████████▏ | 303627/371472 [1:59:56<5:35:35,  3.37it/s]
 82%|████████▏ | 303628/371472 [1:59:56<5:50:01,  3.23it/s]
 82%|████████▏ | 303629/371472 [1:59:57<5:36:11,  3.36it/s]
 82%|████████▏ | 303630/371472 [1:59:57<5:32:16,  3.40it/s]
 82%|████████▏ | 303631/371472 [1:59:57<5:52:32,  3.21it/s]
 82%|████████▏ | 303632/371472 [1:59:58<5:38:05,  3.34it/s]
 82%|████████▏ | 303633/371472 [1:59:58<5:55:21,  3.18it/s]
 82%|████████▏ | 303634/371472 [1:59:58<5:44:27,  3.28it/s]
 82%|████████▏ | 303635/371472 [1:59:59<5:47:30,  3.25it/s]
 82%|████████▏ | 303636/371472 [1:59:59<5:37:25,  3.35it/s]
 82%|████████▏ | 303637/371472 [1:59:59<5:29:05,  3.44it/s]
 82%|████████▏ | 303638/371472 [1:59:59<5:15:38,  3.58it/s]
 82%|████████▏ | 303639/371472 [2:00:00<5:29:47,  3.43it/s]
 82%|████████▏ | 303640/371472 [2:00:00<5:26:10,  3.47it/s]
                                                           
{'loss': 2.5916, 'learning_rate': 2.6443146803421746e-07, 'epoch': 13.08}

 82%|████████▏ | 303640/371472 [2:00:00<5:26:10,  3.47it/s]
 82%|████████▏ | 303641/371472 [2:00:00<5:36:19,  3.36it/s]
 82%|████████▏ | 303642/371472 [2:00:01<5:59:17,  3.15it/s]
 82%|████████▏ | 303643/371472 [2:00:01<5:35:26,  3.37it/s]
 82%|████████▏ | 303644/371472 [2:00:01<5:32:40,  3.40it/s]
 82%|████████▏ | 303645/371472 [2:00:01<5:17:36,  3.56it/s]
 82%|████████▏ | 303646/371472 [2:00:02<5:12:08,  3.62it/s]
 82%|████████▏ | 303647/371472 [2:00:02<5:05:10,  3.70it/s]
 82%|████████▏ | 303648/371472 [2:00:02<5:12:12,  3.62it/s]
 82%|████████▏ | 303649/371472 [2:00:03<5:04:32,  3.71it/s]
 82%|████████▏ | 303650/371472 [2:00:03<5:25:45,  3.47it/s]
 82%|████████▏ | 303651/371472 [2:00:03<5:16:31,  3.57it/s]
 82%|████████▏ | 303652/371472 [2:00:03<5:25:15,  3.48it/s]
 82%|████████▏ | 303653/371472 [2:00:04<5:52:10,  3.21it/s]
 82%|████████▏ | 303654/371472 [2:00:04<5:58:28,  3.15it/s]
 82%|████████▏ | 303655/371472 [2:00:04<5:56:58,  3.17it/s]
 82%|████████▏ | 303656/371472 [2:00:05<5:36:35,  3.36it/s]
 82%|████████▏ | 303657/371472 [2:00:05<5:34:52,  3.38it/s]
 82%|████████▏ | 303658/371472 [2:00:05<5:45:34,  3.27it/s]
 82%|████████▏ | 303659/371472 [2:00:06<5:39:50,  3.33it/s]
 82%|████████▏ | 303660/371472 [2:00:06<5:39:50,  3.33it/s]
                                                           
{'loss': 2.6332, 'learning_rate': 2.6438298605873863e-07, 'epoch': 13.08}

 82%|████████▏ | 303660/371472 [2:00:06<5:39:50,  3.33it/s]
 82%|████████▏ | 303661/371472 [2:00:06<5:42:57,  3.30it/s]
 82%|████████▏ | 303662/371472 [2:00:06<5:23:50,  3.49it/s]
 82%|████████▏ | 303663/371472 [2:00:07<5:14:12,  3.60it/s]
 82%|████████▏ | 303664/371472 [2:00:07<5:18:26,  3.55it/s]
 82%|████████▏ | 303665/371472 [2:00:07<5:40:37,  3.32it/s]
 82%|████████▏ | 303666/371472 [2:00:08<5:34:27,  3.38it/s]
 82%|████████▏ | 303667/371472 [2:00:08<5:37:33,  3.35it/s]
 82%|████████▏ | 303668/371472 [2:00:08<5:49:40,  3.23it/s]
 82%|████████▏ | 303669/371472 [2:00:09<5:37:38,  3.35it/s]
 82%|████████▏ | 303670/371472 [2:00:09<5:23:34,  3.49it/s]
 82%|████████▏ | 303671/371472 [2:00:09<5:10:18,  3.64it/s]
 82%|████████▏ | 303672/371472 [2:00:09<5:28:45,  3.44it/s]
 82%|████████▏ | 303673/371472 [2:00:10<5:20:31,  3.53it/s]
 82%|████████▏ | 303674/371472 [2:00:10<5:44:31,  3.28it/s]
 82%|████████▏ | 303675/371472 [2:00:10<5:33:29,  3.39it/s]
 82%|████████▏ | 303676/371472 [2:00:11<5:33:03,  3.39it/s]
 82%|████████▏ | 303677/371472 [2:00:11<5:23:57,  3.49it/s]
 82%|████████▏ | 303678/371472 [2:00:11<5:14:06,  3.60it/s]
 82%|████████▏ | 303679/371472 [2:00:11<5:16:05,  3.57it/s]
 82%|████████▏ | 303680/371472 [2:00:12<5:12:04,  3.62it/s]
                                                           
{'loss': 2.652, 'learning_rate': 2.643345040832597e-07, 'epoch': 13.08}

 82%|████████▏ | 303680/371472 [2:00:12<5:12:04,  3.62it/s]
 82%|████████▏ | 303681/371472 [2:00:12<5:24:21,  3.48it/s]
 82%|████████▏ | 303682/371472 [2:00:12<5:18:30,  3.55it/s]
 82%|████████▏ | 303683/371472 [2:00:13<5:21:25,  3.51it/s]
 82%|████████▏ | 303684/371472 [2:00:13<5:08:55,  3.66it/s]
 82%|████████▏ | 303685/371472 [2:00:13<5:16:48,  3.57it/s]
 82%|████████▏ | 303686/371472 [2:00:13<5:11:08,  3.63it/s]
 82%|████████▏ | 303687/371472 [2:00:14<5:09:47,  3.65it/s]
 82%|████████▏ | 303688/371472 [2:00:14<5:07:14,  3.68it/s]
 82%|████████▏ | 303689/371472 [2:00:14<5:01:58,  3.74it/s]
 82%|████████▏ | 303690/371472 [2:00:14<4:58:41,  3.78it/s]
 82%|████████▏ | 303691/371472 [2:00:15<4:55:37,  3.82it/s]
 82%|████████▏ | 303692/371472 [2:00:15<4:57:20,  3.80it/s]
 82%|████████▏ | 303693/371472 [2:00:15<5:18:18,  3.55it/s]
 82%|████████▏ | 303694/371472 [2:00:16<5:54:58,  3.18it/s]
 82%|████████▏ | 303695/371472 [2:00:16<5:41:24,  3.31it/s]
 82%|████████▏ | 303696/371472 [2:00:16<5:41:33,  3.31it/s]
 82%|████████▏ | 303697/371472 [2:00:16<5:25:22,  3.47it/s]
 82%|████████▏ | 303698/371472 [2:00:17<5:19:07,  3.54it/s]
 82%|████████▏ | 303699/371472 [2:00:17<5:19:56,  3.53it/s]
 82%|████████▏ | 303700/371472 [2:00:17<5:44:40,  3.28it/s]
                                                           
{'loss': 2.6237, 'learning_rate': 2.6428602210778083e-07, 'epoch': 13.08}

 82%|████████▏ | 303700/371472 [2:00:17<5:44:40,  3.28it/s]
 82%|████████▏ | 303701/371472 [2:00:18<5:29:28,  3.43it/s]
 82%|████████▏ | 303702/371472 [2:00:18<5:22:33,  3.50it/s]
 82%|████████▏ | 303703/371472 [2:00:18<5:13:04,  3.61it/s]
 82%|████████▏ | 303704/371472 [2:00:18<5:25:15,  3.47it/s]
 82%|████████▏ | 303705/371472 [2:00:19<5:11:49,  3.62it/s]
 82%|████████▏ | 303706/371472 [2:00:19<5:17:31,  3.56it/s]
 82%|████████▏ | 303707/371472 [2:00:19<5:09:06,  3.65it/s]
 82%|████████▏ | 303708/371472 [2:00:20<5:17:29,  3.56it/s]
 82%|████████▏ | 303709/371472 [2:00:20<5:07:54,  3.67it/s]
 82%|████████▏ | 303710/371472 [2:00:20<5:07:11,  3.68it/s]
 82%|████████▏ | 303711/371472 [2:00:20<5:09:14,  3.65it/s]
 82%|████████▏ | 303712/371472 [2:00:21<5:04:56,  3.70it/s]
 82%|████████▏ | 303713/371472 [2:00:21<4:57:53,  3.79it/s]
 82%|████████▏ | 303714/371472 [2:00:21<4:53:22,  3.85it/s]
 82%|████████▏ | 303715/371472 [2:00:21<4:55:37,  3.82it/s]
 82%|████████▏ | 303716/371472 [2:00:22<4:57:14,  3.80it/s]
 82%|████████▏ | 303717/371472 [2:00:22<4:54:25,  3.84it/s]
 82%|████████▏ | 303718/371472 [2:00:22<4:59:58,  3.76it/s]
 82%|████████▏ | 303719/371472 [2:00:22<5:05:33,  3.70it/s]
 82%|████████▏ | 303720/371472 [2:00:23<5:04:19,  3.71it/s]
                                                           
{'loss': 2.6612, 'learning_rate': 2.6423754013230185e-07, 'epoch': 13.08}

 82%|████████▏ | 303720/371472 [2:00:23<5:04:19,  3.71it/s]
 82%|████████▏ | 303721/371472 [2:00:23<5:04:13,  3.71it/s]
 82%|████████▏ | 303722/371472 [2:00:23<5:15:03,  3.58it/s]
 82%|████████▏ | 303723/371472 [2:00:24<5:34:40,  3.37it/s]
 82%|████████▏ | 303724/371472 [2:00:24<5:26:47,  3.46it/s]
 82%|████████▏ | 303725/371472 [2:00:24<5:15:54,  3.57it/s]
 82%|████████▏ | 303726/371472 [2:00:24<5:16:30,  3.57it/s]
 82%|████████▏ | 303727/371472 [2:00:25<5:24:03,  3.48it/s]
 82%|████████▏ | 303728/371472 [2:00:25<5:14:02,  3.60it/s]
 82%|████████▏ | 303729/371472 [2:00:25<5:22:03,  3.51it/s]
 82%|████████▏ | 303730/371472 [2:00:26<5:13:32,  3.60it/s]
 82%|████████▏ | 303731/371472 [2:00:26<5:12:04,  3.62it/s]
 82%|████████▏ | 303732/371472 [2:00:26<5:51:49,  3.21it/s]
 82%|████████▏ | 303733/371472 [2:00:26<5:35:00,  3.37it/s]
 82%|████████▏ | 303734/371472 [2:00:27<5:23:29,  3.49it/s]
 82%|████████▏ | 303735/371472 [2:00:27<5:14:30,  3.59it/s]
 82%|████████▏ | 303736/371472 [2:00:27<5:17:51,  3.55it/s]
 82%|████████▏ | 303737/371472 [2:00:28<5:22:40,  3.50it/s]
 82%|████████▏ | 303738/371472 [2:00:28<5:20:23,  3.52it/s]
 82%|████████▏ | 303739/371472 [2:00:28<5:11:48,  3.62it/s]
 82%|████████▏ | 303740/371472 [2:00:28<5:37:51,  3.34it/s]
                                                           
{'loss': 2.6535, 'learning_rate': 2.64189058156823e-07, 'epoch': 13.08}

 82%|████████▏ | 303740/371472 [2:00:28<5:37:51,  3.34it/s]
 82%|████████▏ | 303741/371472 [2:00:29<5:44:00,  3.28it/s]
 82%|████████▏ | 303742/371472 [2:00:29<5:28:11,  3.44it/s]
 82%|████████▏ | 303743/371472 [2:00:29<5:19:37,  3.53it/s]
 82%|████████▏ | 303744/371472 [2:00:30<5:22:21,  3.50it/s]
 82%|████████▏ | 303745/371472 [2:00:30<5:21:12,  3.51it/s]
 82%|████████▏ | 303746/371472 [2:00:30<6:12:29,  3.03it/s]
 82%|████████▏ | 303747/371472 [2:00:31<5:51:46,  3.21it/s]
 82%|████████▏ | 303748/371472 [2:00:31<5:45:33,  3.27it/s]
 82%|████████▏ | 303749/371472 [2:00:31<5:49:03,  3.23it/s]
 82%|████████▏ | 303750/371472 [2:00:31<5:28:35,  3.43it/s]
 82%|████████▏ | 303751/371472 [2:00:32<5:16:22,  3.57it/s]
 82%|████████▏ | 303752/371472 [2:00:32<5:18:30,  3.54it/s]
 82%|████████▏ | 303753/371472 [2:00:32<5:36:25,  3.35it/s]
 82%|████████▏ | 303754/371472 [2:00:33<5:22:00,  3.50it/s]
 82%|████████▏ | 303755/371472 [2:00:33<5:15:36,  3.58it/s]
 82%|████████▏ | 303756/371472 [2:00:33<5:05:42,  3.69it/s]
 82%|████████▏ | 303757/371472 [2:00:33<5:16:04,  3.57it/s]
 82%|████████▏ | 303758/371472 [2:00:34<5:14:11,  3.59it/s]
 82%|████████▏ | 303759/371472 [2:00:34<5:41:26,  3.31it/s]
 82%|████████▏ | 303760/371472 [2:00:34<5:28:52,  3.43it/s]
                                                           
{'loss': 2.62, 'learning_rate': 2.641405761813441e-07, 'epoch': 13.08}

 82%|████████▏ | 303760/371472 [2:00:34<5:28:52,  3.43it/s]
 82%|████████▏ | 303761/371472 [2:00:35<5:41:27,  3.31it/s]
 82%|████████▏ | 303762/371472 [2:00:35<6:14:25,  3.01it/s]
 82%|████████▏ | 303763/371472 [2:00:35<5:55:31,  3.17it/s]
 82%|████████▏ | 303764/371472 [2:00:36<5:36:04,  3.36it/s]
 82%|████████▏ | 303765/371472 [2:00:36<5:37:53,  3.34it/s]
 82%|████████▏ | 303766/371472 [2:00:36<5:40:05,  3.32it/s]
 82%|████████▏ | 303767/371472 [2:00:36<5:38:43,  3.33it/s]
 82%|████████▏ | 303768/371472 [2:00:37<5:36:24,  3.35it/s]
 82%|████████▏ | 303769/371472 [2:00:37<5:30:44,  3.41it/s]
 82%|████████▏ | 303770/371472 [2:00:37<5:41:25,  3.30it/s]
 82%|████████▏ | 303771/371472 [2:00:38<5:31:09,  3.41it/s]
 82%|████████▏ | 303772/371472 [2:00:38<5:20:10,  3.52it/s]
 82%|████████▏ | 303773/371472 [2:00:38<5:15:28,  3.58it/s]
 82%|████████▏ | 303774/371472 [2:00:39<5:29:50,  3.42it/s]
 82%|████████▏ | 303775/371472 [2:00:39<5:19:48,  3.53it/s]
 82%|████████▏ | 303776/371472 [2:00:39<5:12:31,  3.61it/s]
 82%|████████▏ | 303777/371472 [2:00:39<5:08:23,  3.66it/s]
 82%|████████▏ | 303778/371472 [2:00:40<5:05:48,  3.69it/s]
 82%|████████▏ | 303779/371472 [2:00:40<5:16:12,  3.57it/s]
 82%|████████▏ | 303780/371472 [2:00:40<5:26:12,  3.46it/s]
                                                           
{'loss': 2.7925, 'learning_rate': 2.6409209420586527e-07, 'epoch': 13.08}

 82%|████████▏ | 303780/371472 [2:00:40<5:26:12,  3.46it/s]
 82%|████████▏ | 303781/371472 [2:00:40<5:13:03,  3.60it/s]
 82%|████████▏ | 303782/371472 [2:00:41<5:27:54,  3.44it/s]
 82%|████████▏ | 303783/371472 [2:00:41<5:28:29,  3.43it/s]
 82%|████████▏ | 303784/371472 [2:00:41<5:26:21,  3.46it/s]
 82%|████████▏ | 303785/371472 [2:00:42<5:20:21,  3.52it/s]
 82%|████████▏ | 303786/371472 [2:00:42<5:14:29,  3.59it/s]
 82%|████████▏ | 303787/371472 [2:00:42<5:24:05,  3.48it/s]
 82%|████████▏ | 303788/371472 [2:00:42<5:20:38,  3.52it/s]
 82%|████████▏ | 303789/371472 [2:00:43<5:17:38,  3.55it/s]
 82%|████████▏ | 303790/371472 [2:00:43<5:12:05,  3.61it/s]
 82%|████████▏ | 303791/371472 [2:00:43<5:08:24,  3.66it/s]
 82%|████████▏ | 303792/371472 [2:00:44<5:05:37,  3.69it/s]
 82%|████████▏ | 303793/371472 [2:00:44<5:30:43,  3.41it/s]
 82%|████████▏ | 303794/371472 [2:00:44<5:21:56,  3.50it/s]
 82%|████████▏ | 303795/371472 [2:00:44<5:21:40,  3.51it/s]
 82%|████████▏ | 303796/371472 [2:00:45<5:52:24,  3.20it/s]
 82%|████████▏ | 303797/371472 [2:00:45<5:44:55,  3.27it/s]
 82%|████████▏ | 303798/371472 [2:00:45<6:02:25,  3.11it/s]
 82%|████████▏ | 303799/371472 [2:00:46<5:42:37,  3.29it/s]
 82%|████████▏ | 303800/371472 [2:00:46<5:49:28,  3.23it/s]
                                                           
{'loss': 2.7772, 'learning_rate': 2.6404361223038634e-07, 'epoch': 13.09}

 82%|████████▏ | 303800/371472 [2:00:46<5:49:28,  3.23it/s]
 82%|████████▏ | 303801/371472 [2:00:46<5:49:50,  3.22it/s]
 82%|████████▏ | 303802/371472 [2:00:47<5:54:22,  3.18it/s]
 82%|████████▏ | 303803/371472 [2:00:47<5:52:14,  3.20it/s]
 82%|████████▏ | 303804/371472 [2:00:47<5:37:09,  3.35it/s]
 82%|████████▏ | 303805/371472 [2:00:48<5:30:21,  3.41it/s]
 82%|████████▏ | 303806/371472 [2:00:48<5:29:58,  3.42it/s]
 82%|████████▏ | 303807/371472 [2:00:48<5:27:22,  3.44it/s]
 82%|████████▏ | 303808/371472 [2:00:48<5:20:38,  3.52it/s]
 82%|████████▏ | 303809/371472 [2:00:49<5:47:47,  3.24it/s]
 82%|████████▏ | 303810/371472 [2:00:49<5:42:42,  3.29it/s]
 82%|████████▏ | 303811/371472 [2:00:49<5:22:30,  3.50it/s]
 82%|████████▏ | 303812/371472 [2:00:50<5:21:48,  3.50it/s]
 82%|████████▏ | 303813/371472 [2:00:50<5:13:42,  3.59it/s]
 82%|████████▏ | 303814/371472 [2:00:50<5:12:52,  3.60it/s]
 82%|████████▏ | 303815/371472 [2:00:50<5:20:33,  3.52it/s]
 82%|████████▏ | 303816/371472 [2:00:51<5:10:57,  3.63it/s]
 82%|████████▏ | 303817/371472 [2:00:51<5:04:27,  3.70it/s]
 82%|████████▏ | 303818/371472 [2:00:51<5:31:43,  3.40it/s]
 82%|████████▏ | 303819/371472 [2:00:52<5:23:41,  3.48it/s]
 82%|████████▏ | 303820/371472 [2:00:52<5:08:13,  3.66it/s]
                                                           
{'loss': 2.6268, 'learning_rate': 2.6399513025490747e-07, 'epoch': 13.09}

 82%|████████▏ | 303820/371472 [2:00:52<5:08:13,  3.66it/s]
 82%|████████▏ | 303821/371472 [2:00:52<5:21:32,  3.51it/s]
 82%|████████▏ | 303822/371472 [2:00:53<6:28:04,  2.91it/s]
 82%|████████▏ | 303823/371472 [2:00:53<5:57:57,  3.15it/s]
 82%|████████▏ | 303824/371472 [2:00:53<5:39:11,  3.32it/s]
 82%|████████▏ | 303825/371472 [2:00:53<5:51:04,  3.21it/s]
 82%|████████▏ | 303826/371472 [2:00:54<5:35:33,  3.36it/s]
 82%|████████▏ | 303827/371472 [2:00:54<5:19:54,  3.52it/s]
 82%|████████▏ | 303828/371472 [2:00:54<5:10:08,  3.64it/s]
 82%|████████▏ | 303829/371472 [2:00:54<5:12:52,  3.60it/s]
 82%|████████▏ | 303830/371472 [2:00:55<5:03:03,  3.72it/s]
 82%|████████▏ | 303831/371472 [2:00:55<5:03:32,  3.71it/s]
 82%|████████▏ | 303832/371472 [2:00:55<4:59:23,  3.77it/s]
 82%|████████▏ | 303833/371472 [2:00:56<5:03:22,  3.72it/s]
 82%|████████▏ | 303834/371472 [2:00:56<5:24:17,  3.48it/s]
 82%|████████▏ | 303835/371472 [2:00:56<5:44:44,  3.27it/s]
 82%|████████▏ | 303836/371472 [2:00:57<5:54:48,  3.18it/s]
 82%|████████▏ | 303837/371472 [2:00:57<6:27:19,  2.91it/s]
 82%|████████▏ | 303838/371472 [2:00:57<6:00:44,  3.12it/s]
 82%|████████▏ | 303839/371472 [2:00:58<5:49:27,  3.23it/s]
 82%|████████▏ | 303840/371472 [2:00:58<5:48:26,  3.23it/s]
                                                           
{'loss': 2.5434, 'learning_rate': 2.6394664827942854e-07, 'epoch': 13.09}

 82%|████████▏ | 303840/371472 [2:00:58<5:48:26,  3.23it/s]
 82%|████████▏ | 303841/371472 [2:00:58<5:41:47,  3.30it/s]
 82%|████████▏ | 303842/371472 [2:00:58<5:26:43,  3.45it/s]
 82%|████████▏ | 303843/371472 [2:00:59<5:17:09,  3.55it/s]
 82%|████████▏ | 303844/371472 [2:00:59<5:10:24,  3.63it/s]
 82%|████████▏ | 303845/371472 [2:00:59<5:18:47,  3.54it/s]
 82%|████████▏ | 303846/371472 [2:00:59<5:10:51,  3.63it/s]
 82%|████████▏ | 303847/371472 [2:01:00<5:10:49,  3.63it/s]
 82%|████████▏ | 303848/371472 [2:01:00<5:05:41,  3.69it/s]
 82%|████████▏ | 303849/371472 [2:01:00<5:03:40,  3.71it/s]
 82%|████████▏ | 303850/371472 [2:01:01<5:23:02,  3.49it/s]
 82%|████████▏ | 303851/371472 [2:01:01<5:26:27,  3.45it/s]
 82%|████████▏ | 303852/371472 [2:01:01<5:20:00,  3.52it/s]
 82%|████████▏ | 303853/371472 [2:01:01<5:21:34,  3.50it/s]
 82%|████████▏ | 303854/371472 [2:01:02<5:16:44,  3.56it/s]
 82%|████████▏ | 303855/371472 [2:01:02<5:10:38,  3.63it/s]
 82%|████████▏ | 303856/371472 [2:01:02<4:59:38,  3.76it/s]
 82%|████████▏ | 303857/371472 [2:01:02<4:57:48,  3.78it/s]
 82%|████████▏ | 303858/371472 [2:01:03<5:01:23,  3.74it/s]
 82%|████████▏ | 303859/371472 [2:01:03<5:17:13,  3.55it/s]
 82%|████████▏ | 303860/371472 [2:01:03<5:23:25,  3.48it/s]
                                                           
{'loss': 2.594, 'learning_rate': 2.6389816630394967e-07, 'epoch': 13.09}

 82%|████████▏ | 303860/371472 [2:01:03<5:23:25,  3.48it/s]
 82%|████████▏ | 303861/371472 [2:01:04<5:46:23,  3.25it/s]
 82%|████████▏ | 303862/371472 [2:01:04<5:26:51,  3.45it/s]
 82%|████████▏ | 303863/371472 [2:01:04<5:16:13,  3.56it/s]
 82%|████████▏ | 303864/371472 [2:01:05<5:20:03,  3.52it/s]
 82%|████████▏ | 303865/371472 [2:01:05<5:15:34,  3.57it/s]
 82%|████████▏ | 303866/371472 [2:01:05<5:03:39,  3.71it/s]
 82%|████████▏ | 303867/371472 [2:01:05<5:15:00,  3.58it/s]
 82%|████████▏ | 303868/371472 [2:01:06<5:09:18,  3.64it/s]
 82%|████████▏ | 303869/371472 [2:01:06<5:19:25,  3.53it/s]
 82%|████████▏ | 303870/371472 [2:01:06<5:19:54,  3.52it/s]
 82%|████████▏ | 303871/371472 [2:01:06<5:20:59,  3.51it/s]
 82%|████████▏ | 303872/371472 [2:01:07<6:00:37,  3.12it/s]
 82%|████████▏ | 303873/371472 [2:01:07<5:37:29,  3.34it/s]
 82%|████████▏ | 303874/371472 [2:01:07<5:25:54,  3.46it/s]
 82%|████████▏ | 303875/371472 [2:01:08<5:18:24,  3.54it/s]
 82%|████████▏ | 303876/371472 [2:01:08<5:06:21,  3.68it/s]
 82%|████████▏ | 303877/371472 [2:01:08<5:08:32,  3.65it/s]
 82%|████████▏ | 303878/371472 [2:01:08<5:20:55,  3.51it/s]
 82%|████████▏ | 303879/371472 [2:01:09<5:13:55,  3.59it/s]
 82%|████████▏ | 303880/371472 [2:01:09<5:22:38,  3.49it/s]
                                                           
{'loss': 2.6446, 'learning_rate': 2.6384968432847074e-07, 'epoch': 13.09}

 82%|████████▏ | 303880/371472 [2:01:09<5:22:38,  3.49it/s]
 82%|████████▏ | 303881/371472 [2:01:09<5:23:23,  3.48it/s]
 82%|████████▏ | 303882/371472 [2:01:10<5:46:05,  3.25it/s]
 82%|████████▏ | 303883/371472 [2:01:10<5:26:24,  3.45it/s]
 82%|████████▏ | 303884/371472 [2:01:10<5:34:17,  3.37it/s]
 82%|████████▏ | 303885/371472 [2:01:11<5:45:52,  3.26it/s]
 82%|████████▏ | 303886/371472 [2:01:11<5:34:36,  3.37it/s]
 82%|████████▏ | 303887/371472 [2:01:11<5:28:29,  3.43it/s]
 82%|████████▏ | 303888/371472 [2:01:11<5:38:50,  3.32it/s]
 82%|████████▏ | 303889/371472 [2:01:12<6:14:49,  3.01it/s]
 82%|████████▏ | 303890/371472 [2:01:12<6:19:22,  2.97it/s]
 82%|████████▏ | 303891/371472 [2:01:13<6:22:34,  2.94it/s]
 82%|████████▏ | 303892/371472 [2:01:13<5:55:46,  3.17it/s]
 82%|████████▏ | 303893/371472 [2:01:13<5:46:48,  3.25it/s]
 82%|████████▏ | 303894/371472 [2:01:13<5:34:42,  3.37it/s]
 82%|████████▏ | 303895/371472 [2:01:14<5:18:49,  3.53it/s]
 82%|████████▏ | 303896/371472 [2:01:14<5:23:08,  3.49it/s]
 82%|████████▏ | 303897/371472 [2:01:14<5:19:34,  3.52it/s]
 82%|████████▏ | 303898/371472 [2:01:15<5:37:52,  3.33it/s]
 82%|████████▏ | 303899/371472 [2:01:15<5:28:34,  3.43it/s]
 82%|████████▏ | 303900/371472 [2:01:15<5:29:10,  3.42it/s]
                                                           
{'loss': 2.4759, 'learning_rate': 2.638012023529919e-07, 'epoch': 13.09}

 82%|████████▏ | 303900/371472 [2:01:15<5:29:10,  3.42it/s]
 82%|████████▏ | 303901/371472 [2:01:15<5:28:58,  3.42it/s]
 82%|████████▏ | 303902/371472 [2:01:16<5:12:56,  3.60it/s]
 82%|████████▏ | 303903/371472 [2:01:16<5:15:45,  3.57it/s]
 82%|████████▏ | 303904/371472 [2:01:16<5:11:40,  3.61it/s]
 82%|████████▏ | 303905/371472 [2:01:16<5:06:45,  3.67it/s]
 82%|████████▏ | 303906/371472 [2:01:17<4:57:47,  3.78it/s]
 82%|████████▏ | 303907/371472 [2:01:17<5:05:56,  3.68it/s]
 82%|████████▏ | 303908/371472 [2:01:17<5:34:59,  3.36it/s]
 82%|████████▏ | 303909/371472 [2:01:18<5:47:09,  3.24it/s]
 82%|████████▏ | 303910/371472 [2:01:18<5:53:57,  3.18it/s]
 82%|████████▏ | 303911/371472 [2:01:18<5:38:35,  3.33it/s]
 82%|████████▏ | 303912/371472 [2:01:19<5:49:42,  3.22it/s]
 82%|████████▏ | 303913/371472 [2:01:19<5:38:09,  3.33it/s]
 82%|████████▏ | 303914/371472 [2:01:19<5:22:41,  3.49it/s]
 82%|████████▏ | 303915/371472 [2:01:19<5:16:05,  3.56it/s]
 82%|████████▏ | 303916/371472 [2:01:20<5:04:41,  3.70it/s]
 82%|████████▏ | 303917/371472 [2:01:20<5:06:37,  3.67it/s]
 82%|████████▏ | 303918/371472 [2:01:20<4:55:48,  3.81it/s]
 82%|████████▏ | 303919/371472 [2:01:20<4:50:28,  3.88it/s]
 82%|████████▏ | 303920/371472 [2:01:21<4:44:09,  3.96it/s]
                                                           
{'loss': 2.6055, 'learning_rate': 2.63752720377513e-07, 'epoch': 13.09}

 82%|████████▏ | 303920/371472 [2:01:21<4:44:09,  3.96it/s]
 82%|████████▏ | 303921/371472 [2:01:21<5:14:17,  3.58it/s]
 82%|████████▏ | 303922/371472 [2:01:21<5:36:56,  3.34it/s]
 82%|████████▏ | 303923/371472 [2:01:22<5:30:41,  3.40it/s]
 82%|████████▏ | 303924/371472 [2:01:22<5:23:43,  3.48it/s]
 82%|████████▏ | 303925/371472 [2:01:22<5:16:05,  3.56it/s]
 82%|████████▏ | 303926/371472 [2:01:22<5:22:46,  3.49it/s]
 82%|████████▏ | 303927/371472 [2:01:23<5:26:05,  3.45it/s]
 82%|████████▏ | 303928/371472 [2:01:23<5:20:29,  3.51it/s]
 82%|████████▏ | 303929/371472 [2:01:23<5:13:13,  3.59it/s]
 82%|████████▏ | 303930/371472 [2:01:24<5:13:00,  3.60it/s]
 82%|████████▏ | 303931/371472 [2:01:24<5:28:53,  3.42it/s]
 82%|████████▏ | 303932/371472 [2:01:24<6:44:56,  2.78it/s]
 82%|████████▏ | 303933/371472 [2:01:25<6:17:28,  2.98it/s]
 82%|████████▏ | 303934/371472 [2:01:25<5:53:06,  3.19it/s]
 82%|████████▏ | 303935/371472 [2:01:25<5:39:33,  3.31it/s]
 82%|████████▏ | 303936/371472 [2:01:26<6:29:45,  2.89it/s]
 82%|████████▏ | 303937/371472 [2:01:26<6:03:42,  3.09it/s]
 82%|████████▏ | 303938/371472 [2:01:26<5:48:00,  3.23it/s]
 82%|████████▏ | 303939/371472 [2:01:27<5:50:07,  3.21it/s]
 82%|████████▏ | 303940/371472 [2:01:27<5:38:17,  3.33it/s]
                                                           
{'loss': 2.597, 'learning_rate': 2.637042384020341e-07, 'epoch': 13.09}

 82%|████████▏ | 303940/371472 [2:01:27<5:38:17,  3.33it/s]
 82%|████████▏ | 303941/371472 [2:01:27<5:37:21,  3.34it/s]
 82%|████████▏ | 303942/371472 [2:01:27<5:47:38,  3.24it/s]
 82%|████████▏ | 303943/371472 [2:01:28<5:55:25,  3.17it/s]
 82%|████████▏ | 303944/371472 [2:01:28<6:33:23,  2.86it/s]
 82%|████████▏ | 303945/371472 [2:01:29<6:12:58,  3.02it/s]
 82%|████████▏ | 303946/371472 [2:01:29<5:48:40,  3.23it/s]
 82%|████████▏ | 303947/371472 [2:01:29<5:45:21,  3.26it/s]
 82%|████████▏ | 303948/371472 [2:01:29<6:04:43,  3.09it/s]
 82%|████████▏ | 303949/371472 [2:01:30<5:58:11,  3.14it/s]
 82%|████████▏ | 303950/371472 [2:01:30<5:48:22,  3.23it/s]
 82%|████████▏ | 303951/371472 [2:01:30<6:09:05,  3.05it/s]
 82%|████████▏ | 303952/371472 [2:01:31<6:19:09,  2.97it/s]
 82%|████████▏ | 303953/371472 [2:01:31<6:00:12,  3.12it/s]
 82%|████████▏ | 303954/371472 [2:01:31<5:31:08,  3.40it/s]
 82%|████████▏ | 303955/371472 [2:01:32<5:24:27,  3.47it/s]
 82%|████████▏ | 303956/371472 [2:01:32<5:11:11,  3.62it/s]
 82%|████████▏ | 303957/371472 [2:01:32<5:02:38,  3.72it/s]
 82%|████████▏ | 303958/371472 [2:01:32<5:07:30,  3.66it/s]
 82%|████████▏ | 303959/371472 [2:01:33<5:14:08,  3.58it/s]
 82%|████████▏ | 303960/371472 [2:01:33<5:11:51,  3.61it/s]
                                                           
{'loss': 2.6991, 'learning_rate': 2.636557564265552e-07, 'epoch': 13.09}

 82%|████████▏ | 303960/371472 [2:01:33<5:11:51,  3.61it/s]
 82%|████████▏ | 303961/371472 [2:01:33<5:08:17,  3.65it/s]
 82%|████████▏ | 303962/371472 [2:01:33<5:03:12,  3.71it/s]
 82%|████████▏ | 303963/371472 [2:01:34<4:59:52,  3.75it/s]
 82%|████████▏ | 303964/371472 [2:01:34<4:58:53,  3.76it/s]
 82%|████████▏ | 303965/371472 [2:01:34<4:54:47,  3.82it/s]
 82%|████████▏ | 303966/371472 [2:01:34<4:47:45,  3.91it/s]
 82%|████████▏ | 303967/371472 [2:01:35<5:03:41,  3.70it/s]
 82%|████████▏ | 303968/371472 [2:01:35<5:13:25,  3.59it/s]
 82%|████████▏ | 303969/371472 [2:01:35<5:10:45,  3.62it/s]
 82%|████████▏ | 303970/371472 [2:01:36<5:07:17,  3.66it/s]
 82%|████████▏ | 303971/371472 [2:01:36<4:58:49,  3.76it/s]
 82%|████████▏ | 303972/371472 [2:01:36<5:10:18,  3.63it/s]
 82%|████████▏ | 303973/371472 [2:01:36<5:04:18,  3.70it/s]
 82%|████████▏ | 303974/371472 [2:01:37<5:28:44,  3.42it/s]
 82%|████████▏ | 303975/371472 [2:01:37<5:23:58,  3.47it/s]
 82%|████████▏ | 303976/371472 [2:01:37<5:35:22,  3.35it/s]
 82%|████████▏ | 303977/371472 [2:01:38<5:25:52,  3.45it/s]
 82%|████████▏ | 303978/371472 [2:01:38<5:12:19,  3.60it/s]
 82%|████████▏ | 303979/371472 [2:01:38<5:05:08,  3.69it/s]
 82%|████████▏ | 303980/371472 [2:01:38<5:18:32,  3.53it/s]
                                                           
{'loss': 2.6913, 'learning_rate': 2.6360727445107636e-07, 'epoch': 13.09}

 82%|████████▏ | 303980/371472 [2:01:38<5:18:32,  3.53it/s]
 82%|████████▏ | 303981/371472 [2:01:39<5:35:29,  3.35it/s]
 82%|████████▏ | 303982/371472 [2:01:39<5:24:11,  3.47it/s]
 82%|████████▏ | 303983/371472 [2:01:39<5:39:48,  3.31it/s]
 82%|████████▏ | 303984/371472 [2:01:40<5:29:34,  3.41it/s]
 82%|████████▏ | 303985/371472 [2:01:40<5:14:10,  3.58it/s]
 82%|████████▏ | 303986/371472 [2:01:40<5:20:41,  3.51it/s]
 82%|████████▏ | 303987/371472 [2:01:40<5:18:08,  3.54it/s]
 82%|████████▏ | 303988/371472 [2:01:41<5:11:41,  3.61it/s]
 82%|████████▏ | 303989/371472 [2:01:41<5:26:03,  3.45it/s]
 82%|████████▏ | 303990/371472 [2:01:41<5:37:22,  3.33it/s]
 82%|████████▏ | 303991/371472 [2:01:42<5:29:37,  3.41it/s]
 82%|████████▏ | 303992/371472 [2:01:42<5:47:23,  3.24it/s]
 82%|████████▏ | 303993/371472 [2:01:42<6:19:52,  2.96it/s]
 82%|████████▏ | 303994/371472 [2:01:43<6:12:32,  3.02it/s]
 82%|████████▏ | 303995/371472 [2:01:43<5:39:36,  3.31it/s]
 82%|████████▏ | 303996/371472 [2:01:43<5:32:57,  3.38it/s]
 82%|████████▏ | 303997/371472 [2:01:43<5:19:49,  3.52it/s]
 82%|████████▏ | 303998/371472 [2:01:44<5:22:57,  3.48it/s]
 82%|████████▏ | 303999/371472 [2:01:44<5:20:57,  3.50it/s]
 82%|████████▏ | 304000/371472 [2:01:44<5:15:12,  3.57it/s]
                                                           
{'loss': 2.5528, 'learning_rate': 2.635587924755974e-07, 'epoch': 13.09}

 82%|████████▏ | 304000/371472 [2:01:44<5:15:12,  3.57it/s]
 82%|████████▏ | 304001/371472 [2:01:45<5:17:03,  3.55it/s]
 82%|████████▏ | 304002/371472 [2:01:45<5:05:13,  3.68it/s]
 82%|████████▏ | 304003/371472 [2:01:45<5:23:39,  3.47it/s]
 82%|████████▏ | 304004/371472 [2:01:45<5:25:34,  3.45it/s]
 82%|████████▏ | 304005/371472 [2:01:46<5:57:26,  3.15it/s]
 82%|████████▏ | 304006/371472 [2:01:46<5:47:36,  3.23it/s]
 82%|████████▏ | 304007/371472 [2:01:46<6:00:21,  3.12it/s]
 82%|████████▏ | 304008/371472 [2:01:47<5:44:57,  3.26it/s]
 82%|████████▏ | 304009/371472 [2:01:47<5:33:59,  3.37it/s]
 82%|████████▏ | 304010/371472 [2:01:47<5:32:07,  3.39it/s]
 82%|████████▏ | 304011/371472 [2:01:48<5:48:34,  3.23it/s]
 82%|████████▏ | 304012/371472 [2:01:48<5:28:28,  3.42it/s]
 82%|████████▏ | 304013/371472 [2:01:48<5:15:19,  3.57it/s]
 82%|████████▏ | 304014/371472 [2:01:49<5:34:23,  3.36it/s]
 82%|████████▏ | 304015/371472 [2:01:49<5:43:42,  3.27it/s]
 82%|████████▏ | 304016/371472 [2:01:49<5:51:08,  3.20it/s]
 82%|████████▏ | 304017/371472 [2:01:49<5:48:51,  3.22it/s]
 82%|████████▏ | 304018/371472 [2:01:50<5:44:09,  3.27it/s]
 82%|████████▏ | 304019/371472 [2:01:50<5:55:33,  3.16it/s]
 82%|████████▏ | 304020/371472 [2:01:50<5:34:17,  3.36it/s]
                                                           
{'loss': 2.6152, 'learning_rate': 2.6351031050011855e-07, 'epoch': 13.09}

 82%|████████▏ | 304020/371472 [2:01:50<5:34:17,  3.36it/s]
 82%|████████▏ | 304021/371472 [2:01:51<5:18:25,  3.53it/s]
 82%|████████▏ | 304022/371472 [2:01:51<5:06:17,  3.67it/s]
 82%|████████▏ | 304023/371472 [2:01:51<5:03:07,  3.71it/s]
 82%|████████▏ | 304024/371472 [2:01:51<4:54:19,  3.82it/s]
 82%|████████▏ | 304025/371472 [2:01:52<5:18:47,  3.53it/s]
 82%|████████▏ | 304026/371472 [2:01:52<5:10:43,  3.62it/s]
 82%|████████▏ | 304027/371472 [2:01:52<5:11:16,  3.61it/s]
 82%|████████▏ | 304028/371472 [2:01:52<5:02:57,  3.71it/s]
 82%|████████▏ | 304029/371472 [2:01:53<4:59:29,  3.75it/s]
 82%|████████▏ | 304030/371472 [2:01:53<5:20:29,  3.51it/s]
 82%|████████▏ | 304031/371472 [2:01:53<5:17:51,  3.54it/s]
 82%|████████▏ | 304032/371472 [2:01:54<5:11:09,  3.61it/s]
 82%|████████▏ | 304033/371472 [2:01:54<5:13:19,  3.59it/s]
 82%|████████▏ | 304034/371472 [2:01:54<5:29:47,  3.41it/s]
 82%|████████▏ | 304035/371472 [2:01:54<5:20:25,  3.51it/s]
 82%|████████▏ | 304036/371472 [2:01:55<5:07:02,  3.66it/s]
 82%|████████▏ | 304037/371472 [2:01:55<5:02:10,  3.72it/s]
 82%|████████▏ | 304038/371472 [2:01:55<4:55:43,  3.80it/s]
 82%|████████▏ | 304039/371472 [2:01:56<4:59:31,  3.75it/s]
 82%|████████▏ | 304040/371472 [2:01:56<4:52:02,  3.85it/s]
                                                           
{'loss': 2.6309, 'learning_rate': 2.634618285246396e-07, 'epoch': 13.1}

 82%|████████▏ | 304040/371472 [2:01:56<4:52:02,  3.85it/s]
 82%|████████▏ | 304041/371472 [2:01:56<4:54:08,  3.82it/s]
 82%|████████▏ | 304042/371472 [2:01:56<5:03:17,  3.71it/s]
 82%|████████▏ | 304043/371472 [2:01:57<5:02:03,  3.72it/s]
 82%|████████▏ | 304044/371472 [2:01:57<5:06:00,  3.67it/s]
 82%|████████▏ | 304045/371472 [2:01:57<4:59:50,  3.75it/s]
 82%|████████▏ | 304046/371472 [2:01:57<5:00:33,  3.74it/s]
 82%|████████▏ | 304047/371472 [2:01:58<5:10:11,  3.62it/s]
 82%|████████▏ | 304048/371472 [2:01:58<5:18:06,  3.53it/s]
 82%|████████▏ | 304049/371472 [2:01:58<5:09:41,  3.63it/s]
 82%|████████▏ | 304050/371472 [2:01:58<4:56:41,  3.79it/s]
 82%|████████▏ | 304051/371472 [2:01:59<4:54:33,  3.81it/s]
 82%|████████▏ | 304052/371472 [2:01:59<4:47:10,  3.91it/s]
 82%|████████▏ | 304053/371472 [2:01:59<4:47:16,  3.91it/s]
 82%|████████▏ | 304054/371472 [2:02:00<4:55:18,  3.80it/s]
 82%|████████▏ | 304055/371472 [2:02:00<4:45:44,  3.93it/s]
 82%|████████▏ | 304056/371472 [2:02:00<4:41:08,  4.00it/s]
 82%|████████▏ | 304057/371472 [2:02:00<4:40:47,  4.00it/s]
 82%|████████▏ | 304058/371472 [2:02:00<4:38:56,  4.03it/s]
 82%|████████▏ | 304059/371472 [2:02:01<4:39:26,  4.02it/s]
 82%|████████▏ | 304060/371472 [2:02:01<4:35:52,  4.07it/s]
                                                           
{'loss': 2.7013, 'learning_rate': 2.634133465491607e-07, 'epoch': 13.1}

 82%|████████▏ | 304060/371472 [2:02:01<4:35:52,  4.07it/s]
 82%|████████▏ | 304061/371472 [2:02:01<4:53:14,  3.83it/s]
 82%|████████▏ | 304062/371472 [2:02:02<4:52:48,  3.84it/s]
 82%|████████▏ | 304063/371472 [2:02:02<4:51:38,  3.85it/s]
 82%|████████▏ | 304064/371472 [2:02:02<5:01:22,  3.73it/s]
 82%|████████▏ | 304065/371472 [2:02:02<5:09:47,  3.63it/s]
 82%|████████▏ | 304066/371472 [2:02:03<5:19:17,  3.52it/s]
 82%|████████▏ | 304067/371472 [2:02:03<5:14:36,  3.57it/s]
 82%|████████▏ | 304068/371472 [2:02:03<5:03:57,  3.70it/s]
 82%|████████▏ | 304069/371472 [2:02:03<5:03:23,  3.70it/s]
 82%|████████▏ | 304070/371472 [2:02:04<5:18:28,  3.53it/s]
 82%|████████▏ | 304071/371472 [2:02:04<5:20:20,  3.51it/s]
 82%|████████▏ | 304072/371472 [2:02:04<5:15:08,  3.56it/s]
 82%|████████▏ | 304073/371472 [2:02:05<5:31:45,  3.39it/s]
 82%|████████▏ | 304074/371472 [2:02:05<5:15:29,  3.56it/s]
 82%|████████▏ | 304075/371472 [2:02:05<5:22:12,  3.49it/s]
 82%|████████▏ | 304076/371472 [2:02:05<5:09:48,  3.63it/s]
 82%|████████▏ | 304077/371472 [2:02:06<5:05:51,  3.67it/s]
 82%|████████▏ | 304078/371472 [2:02:06<5:23:19,  3.47it/s]
 82%|████████▏ | 304079/371472 [2:02:06<5:17:19,  3.54it/s]
 82%|████████▏ | 304080/371472 [2:02:07<5:16:57,  3.54it/s]
                                                           
{'loss': 2.71, 'learning_rate': 2.633648645736818e-07, 'epoch': 13.1}

 82%|████████▏ | 304080/371472 [2:02:07<5:16:57,  3.54it/s]
 82%|████████▏ | 304081/371472 [2:02:07<5:20:02,  3.51it/s]
 82%|████████▏ | 304082/371472 [2:02:07<5:11:38,  3.60it/s]
 82%|████████▏ | 304083/371472 [2:02:07<5:17:27,  3.54it/s]
 82%|████████▏ | 304084/371472 [2:02:08<5:08:09,  3.64it/s]
 82%|████████▏ | 304085/371472 [2:02:08<5:03:48,  3.70it/s]
 82%|████████▏ | 304086/371472 [2:02:08<5:17:13,  3.54it/s]
 82%|████████▏ | 304087/371472 [2:02:09<5:30:47,  3.40it/s]
 82%|████████▏ | 304088/371472 [2:02:09<5:19:21,  3.52it/s]
 82%|████████▏ | 304089/371472 [2:02:09<5:04:53,  3.68it/s]
 82%|████████▏ | 304090/371472 [2:02:09<5:11:53,  3.60it/s]
 82%|████████▏ | 304091/371472 [2:02:10<5:19:09,  3.52it/s]
 82%|████████▏ | 304092/371472 [2:02:10<5:08:29,  3.64it/s]
 82%|████████▏ | 304093/371472 [2:02:10<5:22:05,  3.49it/s]
 82%|████████▏ | 304094/371472 [2:02:11<5:27:38,  3.43it/s]
 82%|████████▏ | 304095/371472 [2:02:11<5:34:38,  3.36it/s]
 82%|████████▏ | 304096/371472 [2:02:11<5:22:26,  3.48it/s]
 82%|████████▏ | 304097/371472 [2:02:11<5:11:47,  3.60it/s]
 82%|████████▏ | 304098/371472 [2:02:12<5:12:53,  3.59it/s]
 82%|████████▏ | 304099/371472 [2:02:12<5:11:41,  3.60it/s]
 82%|████████▏ | 304100/371472 [2:02:12<5:11:41,  3.60it/s]
                                                           
{'loss': 2.4768, 'learning_rate': 2.6331638259820284e-07, 'epoch': 13.1}

 82%|████████▏ | 304100/371472 [2:02:12<5:11:41,  3.60it/s]
 82%|████████▏ | 304101/371472 [2:02:12<5:11:54,  3.60it/s]
 82%|████████▏ | 304102/371472 [2:02:13<5:33:38,  3.37it/s]
 82%|████████▏ | 304103/371472 [2:02:13<5:31:36,  3.39it/s]
 82%|████████▏ | 304104/371472 [2:02:13<5:10:44,  3.61it/s]
 82%|████████▏ | 304105/371472 [2:02:14<5:08:03,  3.64it/s]
 82%|████████▏ | 304106/371472 [2:02:14<5:04:43,  3.68it/s]
 82%|████████▏ | 304107/371472 [2:02:14<5:05:14,  3.68it/s]
 82%|████████▏ | 304108/371472 [2:02:14<5:00:47,  3.73it/s]
 82%|████████▏ | 304109/371472 [2:02:15<4:59:01,  3.75it/s]
 82%|████████▏ | 304110/371472 [2:02:15<4:54:22,  3.81it/s]
 82%|████████▏ | 304111/371472 [2:02:15<5:01:20,  3.73it/s]
 82%|████████▏ | 304112/371472 [2:02:15<5:00:10,  3.74it/s]
 82%|████████▏ | 304113/371472 [2:02:16<5:04:01,  3.69it/s]
 82%|████████▏ | 304114/371472 [2:02:16<5:06:05,  3.67it/s]
 82%|████████▏ | 304115/371472 [2:02:16<5:17:42,  3.53it/s]
 82%|████████▏ | 304116/371472 [2:02:17<5:12:31,  3.59it/s]
 82%|████████▏ | 304117/371472 [2:02:17<5:10:03,  3.62it/s]
 82%|████████▏ | 304118/371472 [2:02:17<5:39:15,  3.31it/s]
 82%|████████▏ | 304119/371472 [2:02:18<5:30:02,  3.40it/s]
 82%|████████▏ | 304120/371472 [2:02:18<5:17:20,  3.54it/s]
                                                           
{'loss': 2.4884, 'learning_rate': 2.63267900622724e-07, 'epoch': 13.1}

 82%|████████▏ | 304120/371472 [2:02:18<5:17:20,  3.54it/s]
 82%|████████▏ | 304121/371472 [2:02:18<5:08:18,  3.64it/s]
 82%|████████▏ | 304122/371472 [2:02:18<5:04:57,  3.68it/s]
 82%|████████▏ | 304123/371472 [2:02:19<5:22:06,  3.48it/s]
 82%|████████▏ | 304124/371472 [2:02:19<5:29:21,  3.41it/s]
 82%|████████▏ | 304125/371472 [2:02:19<5:29:36,  3.41it/s]
 82%|████████▏ | 304126/371472 [2:02:19<5:19:32,  3.51it/s]
 82%|████████▏ | 304127/371472 [2:02:20<5:08:25,  3.64it/s]
 82%|████████▏ | 304128/371472 [2:02:20<5:07:06,  3.65it/s]
 82%|████████▏ | 304129/371472 [2:02:20<5:02:58,  3.70it/s]
 82%|████████▏ | 304130/371472 [2:02:21<6:16:22,  2.98it/s]
 82%|████████▏ | 304131/371472 [2:02:21<6:01:35,  3.10it/s]
 82%|████████▏ | 304132/371472 [2:02:21<5:47:35,  3.23it/s]
 82%|████████▏ | 304133/371472 [2:02:22<5:25:56,  3.44it/s]
 82%|████████▏ | 304134/371472 [2:02:22<5:20:30,  3.50it/s]
 82%|████████▏ | 304135/371472 [2:02:22<5:11:48,  3.60it/s]
 82%|████████▏ | 304136/371472 [2:02:22<4:55:06,  3.80it/s]
 82%|████████▏ | 304137/371472 [2:02:23<5:00:10,  3.74it/s]
 82%|████████▏ | 304138/371472 [2:02:23<5:30:46,  3.39it/s]
 82%|████████▏ | 304139/371472 [2:02:23<5:32:09,  3.38it/s]
 82%|████████▏ | 304140/371472 [2:02:24<5:22:07,  3.48it/s]
                                                           
{'loss': 2.7565, 'learning_rate': 2.6321941864724514e-07, 'epoch': 13.1}

 82%|████████▏ | 304140/371472 [2:02:24<5:22:07,  3.48it/s]
 82%|████████▏ | 304141/371472 [2:02:24<5:15:24,  3.56it/s]
 82%|████████▏ | 304142/371472 [2:02:24<5:23:33,  3.47it/s]
 82%|████████▏ | 304143/371472 [2:02:24<5:09:36,  3.62it/s]
 82%|████████▏ | 304144/371472 [2:02:25<5:01:24,  3.72it/s]
 82%|████████▏ | 304145/371472 [2:02:25<5:11:06,  3.61it/s]
 82%|████████▏ | 304146/371472 [2:02:25<5:01:20,  3.72it/s]
 82%|████████▏ | 304147/371472 [2:02:26<5:29:20,  3.41it/s]
 82%|████████▏ | 304148/371472 [2:02:26<5:19:35,  3.51it/s]
 82%|████████▏ | 304149/371472 [2:02:26<5:08:51,  3.63it/s]
 82%|████████▏ | 304150/371472 [2:02:26<5:13:38,  3.58it/s]
 82%|████████▏ | 304151/371472 [2:02:27<5:20:11,  3.50it/s]
 82%|████████▏ | 304152/371472 [2:02:27<5:07:45,  3.65it/s]
 82%|████████▏ | 304153/371472 [2:02:27<5:13:03,  3.58it/s]
 82%|████████▏ | 304154/371472 [2:02:27<5:13:30,  3.58it/s]
 82%|████████▏ | 304155/371472 [2:02:28<5:00:13,  3.74it/s]
 82%|████████▏ | 304156/371472 [2:02:28<5:04:58,  3.68it/s]
 82%|████████▏ | 304157/371472 [2:02:28<5:00:05,  3.74it/s]
 82%|████████▏ | 304158/371472 [2:02:29<5:20:05,  3.50it/s]
 82%|████████▏ | 304159/371472 [2:02:29<5:13:21,  3.58it/s]
 82%|████████▏ | 304160/371472 [2:02:29<5:04:44,  3.68it/s]
                                                           
{'loss': 2.7113, 'learning_rate': 2.6317093667176627e-07, 'epoch': 13.1}

 82%|████████▏ | 304160/371472 [2:02:29<5:04:44,  3.68it/s]
 82%|████████▏ | 304161/371472 [2:02:29<5:02:35,  3.71it/s]
 82%|████████▏ | 304162/371472 [2:02:30<4:54:43,  3.81it/s]
 82%|████████▏ | 304163/371472 [2:02:30<4:52:55,  3.83it/s]
 82%|████████▏ | 304164/371472 [2:02:30<5:07:30,  3.65it/s]
 82%|████████▏ | 304165/371472 [2:02:30<5:25:41,  3.44it/s]
 82%|████████▏ | 304166/371472 [2:02:31<5:09:12,  3.63it/s]
 82%|████████▏ | 304167/371472 [2:02:31<5:11:54,  3.60it/s]
 82%|████████▏ | 304168/371472 [2:02:31<5:04:51,  3.68it/s]
 82%|████████▏ | 304169/371472 [2:02:32<5:16:19,  3.55it/s]
 82%|████████▏ | 304170/371472 [2:02:32<5:16:55,  3.54it/s]
 82%|████████▏ | 304171/371472 [2:02:32<5:28:54,  3.41it/s]
 82%|████████▏ | 304172/371472 [2:02:33<5:50:51,  3.20it/s]
 82%|████████▏ | 304173/371472 [2:02:33<5:44:38,  3.25it/s]
 82%|████████▏ | 304174/371472 [2:02:33<5:33:47,  3.36it/s]
 82%|████████▏ | 304175/371472 [2:02:33<5:14:30,  3.57it/s]
 82%|████████▏ | 304176/371472 [2:02:34<5:20:43,  3.50it/s]
 82%|████████▏ | 304177/371472 [2:02:34<5:23:22,  3.47it/s]
 82%|████████▏ | 304178/371472 [2:02:34<5:23:31,  3.47it/s]
 82%|████████▏ | 304179/371472 [2:02:34<5:12:13,  3.59it/s]
 82%|████████▏ | 304180/371472 [2:02:35<5:13:46,  3.57it/s]
                                                           
{'loss': 2.5984, 'learning_rate': 2.6312245469628734e-07, 'epoch': 13.1}

 82%|████████▏ | 304180/371472 [2:02:35<5:13:46,  3.57it/s]
 82%|████████▏ | 304181/371472 [2:02:35<5:08:16,  3.64it/s]
 82%|████████▏ | 304182/371472 [2:02:35<5:20:49,  3.50it/s]
 82%|████████▏ | 304183/371472 [2:02:36<5:14:57,  3.56it/s]
 82%|████████▏ | 304184/371472 [2:02:36<5:14:02,  3.57it/s]
 82%|████████▏ | 304185/371472 [2:02:36<5:24:59,  3.45it/s]
 82%|████████▏ | 304186/371472 [2:02:37<5:39:00,  3.31it/s]
 82%|████████▏ | 304187/371472 [2:02:37<5:34:12,  3.36it/s]
 82%|████████▏ | 304188/371472 [2:02:37<5:25:21,  3.45it/s]
 82%|████████▏ | 304189/371472 [2:02:37<5:33:08,  3.37it/s]
 82%|████████▏ | 304190/371472 [2:02:38<5:53:14,  3.17it/s]
 82%|████████▏ | 304191/371472 [2:02:38<5:36:00,  3.34it/s]
 82%|████████▏ | 304192/371472 [2:02:38<5:48:14,  3.22it/s]
 82%|████████▏ | 304193/371472 [2:02:39<5:57:38,  3.14it/s]
 82%|████████▏ | 304194/371472 [2:02:39<5:33:32,  3.36it/s]
 82%|████████▏ | 304195/371472 [2:02:39<5:25:54,  3.44it/s]
 82%|████████▏ | 304196/371472 [2:02:39<5:23:33,  3.47it/s]
 82%|████████▏ | 304197/371472 [2:02:40<5:18:53,  3.52it/s]
 82%|████████▏ | 304198/371472 [2:02:40<5:06:46,  3.65it/s]
 82%|████████▏ | 304199/371472 [2:02:40<5:07:35,  3.65it/s]
 82%|████████▏ | 304200/371472 [2:02:41<5:14:16,  3.57it/s]
                                                           
{'loss': 2.71, 'learning_rate': 2.6307397272080846e-07, 'epoch': 13.1}

 82%|████████▏ | 304200/371472 [2:02:41<5:14:16,  3.57it/s]
 82%|████████▏ | 304201/371472 [2:02:41<5:32:03,  3.38it/s]
 82%|████████▏ | 304202/371472 [2:02:41<5:32:07,  3.38it/s]
 82%|████████▏ | 304203/371472 [2:02:42<5:57:50,  3.13it/s]
 82%|████████▏ | 304204/371472 [2:02:42<5:35:14,  3.34it/s]
 82%|████████▏ | 304205/371472 [2:02:42<5:16:30,  3.54it/s]
 82%|████████▏ | 304206/371472 [2:02:42<5:15:28,  3.55it/s]
 82%|████████▏ | 304207/371472 [2:02:43<5:13:28,  3.58it/s]
 82%|████████▏ | 304208/371472 [2:02:43<5:32:38,  3.37it/s]
 82%|████████▏ | 304209/371472 [2:02:43<5:44:40,  3.25it/s]
 82%|████████▏ | 304210/371472 [2:02:44<5:37:51,  3.32it/s]
 82%|████████▏ | 304211/371472 [2:02:44<5:25:40,  3.44it/s]
 82%|████████▏ | 304212/371472 [2:02:44<5:13:28,  3.58it/s]
 82%|████████▏ | 304213/371472 [2:02:44<5:11:53,  3.59it/s]
 82%|████████▏ | 304214/371472 [2:02:45<5:00:46,  3.73it/s]
 82%|████████▏ | 304215/371472 [2:02:45<5:08:25,  3.63it/s]
 82%|████████▏ | 304216/371472 [2:02:45<5:30:22,  3.39it/s]
 82%|████████▏ | 304217/371472 [2:02:46<5:30:44,  3.39it/s]
 82%|████████▏ | 304218/371472 [2:02:46<5:37:50,  3.32it/s]
 82%|████████▏ | 304219/371472 [2:02:46<5:36:43,  3.33it/s]
 82%|████████▏ | 304220/371472 [2:02:46<5:39:33,  3.30it/s]
                                                           
{'loss': 2.7681, 'learning_rate': 2.6302549074532953e-07, 'epoch': 13.1}

 82%|████████▏ | 304220/371472 [2:02:46<5:39:33,  3.30it/s]
 82%|████████▏ | 304221/371472 [2:02:47<5:21:03,  3.49it/s]
 82%|████████▏ | 304222/371472 [2:02:47<5:29:58,  3.40it/s]
 82%|████████▏ | 304223/371472 [2:02:47<5:17:11,  3.53it/s]
 82%|████████▏ | 304224/371472 [2:02:48<5:07:30,  3.64it/s]
 82%|████████▏ | 304225/371472 [2:02:48<5:09:01,  3.63it/s]
 82%|████████▏ | 304226/371472 [2:02:48<5:00:01,  3.74it/s]
 82%|████████▏ | 304227/371472 [2:02:49<5:51:44,  3.19it/s]
 82%|████████▏ | 304228/371472 [2:02:49<5:38:39,  3.31it/s]
 82%|████████▏ | 304229/371472 [2:02:49<5:29:24,  3.40it/s]
 82%|████████▏ | 304230/371472 [2:02:49<5:32:04,  3.37it/s]
 82%|████████▏ | 304231/371472 [2:02:50<5:20:35,  3.50it/s]
 82%|████████▏ | 304232/371472 [2:02:50<5:13:52,  3.57it/s]
 82%|████████▏ | 304233/371472 [2:02:50<5:30:00,  3.40it/s]
 82%|████████▏ | 304234/371472 [2:02:50<5:23:26,  3.46it/s]
 82%|████████▏ | 304235/371472 [2:02:51<5:11:42,  3.60it/s]
 82%|████████▏ | 304236/371472 [2:02:51<5:16:41,  3.54it/s]
 82%|████████▏ | 304237/371472 [2:02:51<5:17:49,  3.53it/s]
 82%|████████▏ | 304238/371472 [2:02:52<5:16:25,  3.54it/s]
 82%|████████▏ | 304239/371472 [2:02:52<5:13:28,  3.57it/s]
 82%|████████▏ | 304240/371472 [2:02:52<5:14:29,  3.56it/s]
                                                           
{'loss': 2.6624, 'learning_rate': 2.6297700876985066e-07, 'epoch': 13.1}

 82%|████████▏ | 304240/371472 [2:02:52<5:14:29,  3.56it/s]
 82%|████████▏ | 304241/371472 [2:02:52<5:12:19,  3.59it/s]
 82%|████████▏ | 304242/371472 [2:02:53<5:20:51,  3.49it/s]
 82%|████████▏ | 304243/371472 [2:02:53<5:03:36,  3.69it/s]
 82%|████████▏ | 304244/371472 [2:02:53<5:12:51,  3.58it/s]
 82%|████████▏ | 304245/371472 [2:02:54<5:12:08,  3.59it/s]
 82%|████████▏ | 304246/371472 [2:02:54<5:11:07,  3.60it/s]
 82%|████████▏ | 304247/371472 [2:02:54<4:59:54,  3.74it/s]
 82%|████████▏ | 304248/371472 [2:02:54<5:06:31,  3.66it/s]
 82%|████████▏ | 304249/371472 [2:02:55<5:14:51,  3.56it/s]
 82%|████████▏ | 304250/371472 [2:02:55<5:26:33,  3.43it/s]
 82%|████████▏ | 304251/371472 [2:02:55<5:12:13,  3.59it/s]
 82%|████████▏ | 304252/371472 [2:02:56<5:16:21,  3.54it/s]
 82%|████████▏ | 304253/371472 [2:02:56<5:17:20,  3.53it/s]
 82%|████████▏ | 304254/371472 [2:02:56<5:14:41,  3.56it/s]
 82%|████████▏ | 304255/371472 [2:02:56<5:13:15,  3.58it/s]
 82%|████████▏ | 304256/371472 [2:02:57<5:05:28,  3.67it/s]
 82%|████████▏ | 304257/371472 [2:02:57<4:51:09,  3.85it/s]
 82%|████████▏ | 304258/371472 [2:02:57<5:16:48,  3.54it/s]
 82%|████████▏ | 304259/371472 [2:02:57<5:02:42,  3.70it/s]
 82%|████████▏ | 304260/371472 [2:02:58<4:55:33,  3.79it/s]
                                                           
{'loss': 2.556, 'learning_rate': 2.6292852679437173e-07, 'epoch': 13.11}

 82%|████████▏ | 304260/371472 [2:02:58<4:55:33,  3.79it/s]
 82%|████████▏ | 304261/371472 [2:02:58<4:58:50,  3.75it/s]
 82%|████████▏ | 304262/371472 [2:02:58<4:50:45,  3.85it/s]
 82%|████████▏ | 304263/371472 [2:02:58<5:05:05,  3.67it/s]
 82%|████████▏ | 304264/371472 [2:02:59<5:42:20,  3.27it/s]
 82%|████████▏ | 304265/371472 [2:02:59<5:25:21,  3.44it/s]
 82%|████████▏ | 304266/371472 [2:02:59<5:10:19,  3.61it/s]
 82%|████████▏ | 304267/371472 [2:03:00<5:05:13,  3.67it/s]
 82%|████████▏ | 304268/371472 [2:03:00<5:06:39,  3.65it/s]
 82%|████████▏ | 304269/371472 [2:03:00<5:11:30,  3.60it/s]
 82%|████████▏ | 304270/371472 [2:03:00<5:13:34,  3.57it/s]
 82%|████████▏ | 304271/371472 [2:03:01<5:24:33,  3.45it/s]
 82%|████████▏ | 304272/371472 [2:03:01<5:18:52,  3.51it/s]
 82%|████████▏ | 304273/371472 [2:03:01<5:31:24,  3.38it/s]
 82%|████████▏ | 304274/371472 [2:03:02<5:22:04,  3.48it/s]
 82%|████████▏ | 304275/371472 [2:03:02<5:08:41,  3.63it/s]
 82%|████████▏ | 304276/371472 [2:03:02<5:08:00,  3.64it/s]
 82%|████████▏ | 304277/371472 [2:03:02<5:07:17,  3.64it/s]
 82%|████████▏ | 304278/371472 [2:03:03<5:10:04,  3.61it/s]
 82%|████████▏ | 304279/371472 [2:03:03<5:04:18,  3.68it/s]
 82%|████████▏ | 304280/371472 [2:03:03<5:04:46,  3.67it/s]
                                                           
{'loss': 2.5369, 'learning_rate': 2.628800448188929e-07, 'epoch': 13.11}

 82%|████████▏ | 304280/371472 [2:03:03<5:04:46,  3.67it/s]
 82%|████████▏ | 304281/371472 [2:03:04<5:17:03,  3.53it/s]
 82%|████████▏ | 304282/371472 [2:03:04<5:13:39,  3.57it/s]
 82%|████████▏ | 304283/371472 [2:03:04<5:18:50,  3.51it/s]
 82%|████████▏ | 304284/371472 [2:03:04<5:13:37,  3.57it/s]
 82%|████████▏ | 304285/371472 [2:03:05<5:13:36,  3.57it/s]
 82%|████████▏ | 304286/371472 [2:03:05<5:04:56,  3.67it/s]
 82%|████████▏ | 304287/371472 [2:03:05<4:54:43,  3.80it/s]
 82%|████████▏ | 304288/371472 [2:03:05<4:52:32,  3.83it/s]
 82%|████████▏ | 304289/371472 [2:03:06<4:59:56,  3.73it/s]
 82%|████████▏ | 304290/371472 [2:03:06<5:01:25,  3.71it/s]
 82%|████████▏ | 304291/371472 [2:03:06<5:07:38,  3.64it/s]
 82%|████████▏ | 304292/371472 [2:03:07<4:59:03,  3.74it/s]
 82%|████████▏ | 304293/371472 [2:03:07<5:07:44,  3.64it/s]
 82%|████████▏ | 304294/371472 [2:03:07<5:17:41,  3.52it/s]
 82%|████████▏ | 304295/371472 [2:03:07<5:25:11,  3.44it/s]
 82%|████████▏ | 304296/371472 [2:03:08<5:32:57,  3.36it/s]
 82%|████████▏ | 304297/371472 [2:03:08<6:01:33,  3.10it/s]
 82%|████████▏ | 304298/371472 [2:03:09<6:20:19,  2.94it/s]
 82%|████████▏ | 304299/371472 [2:03:09<5:51:02,  3.19it/s]
 82%|████████▏ | 304300/371472 [2:03:09<5:36:20,  3.33it/s]
                                                           
{'loss': 2.7743, 'learning_rate': 2.62831562843414e-07, 'epoch': 13.11}

 82%|████████▏ | 304300/371472 [2:03:09<5:36:20,  3.33it/s]
 82%|████████▏ | 304301/371472 [2:03:09<5:28:14,  3.41it/s]
 82%|████████▏ | 304302/371472 [2:03:10<5:09:08,  3.62it/s]
 82%|████████▏ | 304303/371472 [2:03:10<5:12:01,  3.59it/s]
 82%|████████▏ | 304304/371472 [2:03:10<5:29:46,  3.39it/s]
 82%|████████▏ | 304305/371472 [2:03:10<5:18:49,  3.51it/s]
 82%|████████▏ | 304306/371472 [2:03:11<5:28:19,  3.41it/s]
 82%|████████▏ | 304307/371472 [2:03:11<5:15:57,  3.54it/s]
 82%|████████▏ | 304308/371472 [2:03:11<5:17:07,  3.53it/s]
 82%|████████▏ | 304309/371472 [2:03:12<5:35:54,  3.33it/s]
 82%|████████▏ | 304310/371472 [2:03:12<5:42:57,  3.26it/s]
 82%|████████▏ | 304311/371472 [2:03:12<5:53:40,  3.16it/s]
 82%|████████▏ | 304312/371472 [2:03:13<5:48:45,  3.21it/s]
 82%|████████▏ | 304313/371472 [2:03:13<5:32:13,  3.37it/s]
 82%|████████▏ | 304314/371472 [2:03:13<7:12:20,  2.59it/s]
 82%|████████▏ | 304315/371472 [2:03:14<6:29:40,  2.87it/s]
 82%|████████▏ | 304316/371472 [2:03:14<6:21:04,  2.94it/s]
 82%|████████▏ | 304317/371472 [2:03:14<6:25:41,  2.90it/s]
 82%|████████▏ | 304318/371472 [2:03:15<5:54:10,  3.16it/s]
 82%|████████▏ | 304319/371472 [2:03:15<5:37:29,  3.32it/s]
 82%|████████▏ | 304320/371472 [2:03:15<5:24:19,  3.45it/s]
                                                           
{'loss': 2.5478, 'learning_rate': 2.627830808679351e-07, 'epoch': 13.11}

 82%|████████▏ | 304320/371472 [2:03:15<5:24:19,  3.45it/s]
 82%|████████▏ | 304321/371472 [2:03:15<5:08:22,  3.63it/s]
 82%|████████▏ | 304322/371472 [2:03:16<5:11:56,  3.59it/s]
 82%|████████▏ | 304323/371472 [2:03:16<5:02:46,  3.70it/s]
 82%|████████▏ | 304324/371472 [2:03:16<5:17:50,  3.52it/s]
 82%|████████▏ | 304325/371472 [2:03:17<5:25:04,  3.44it/s]
 82%|████████▏ | 304326/371472 [2:03:17<5:21:15,  3.48it/s]
 82%|████████▏ | 304327/371472 [2:03:17<5:18:11,  3.52it/s]
 82%|████████▏ | 304328/371472 [2:03:17<5:18:38,  3.51it/s]
 82%|████████▏ | 304329/371472 [2:03:18<5:05:19,  3.67it/s]
 82%|████████▏ | 304330/371472 [2:03:18<5:21:07,  3.48it/s]
 82%|████████▏ | 304331/371472 [2:03:18<5:13:15,  3.57it/s]
 82%|████████▏ | 304332/371472 [2:03:18<5:07:27,  3.64it/s]
 82%|████████▏ | 304333/371472 [2:03:19<5:12:17,  3.58it/s]
 82%|████████▏ | 304334/371472 [2:03:19<4:59:56,  3.73it/s]
 82%|████████▏ | 304335/371472 [2:03:19<4:55:29,  3.79it/s]
 82%|████████▏ | 304336/371472 [2:03:20<4:45:27,  3.92it/s]
 82%|████████▏ | 304337/371472 [2:03:20<4:50:09,  3.86it/s]
 82%|████████▏ | 304338/371472 [2:03:20<4:58:53,  3.74it/s]
 82%|████████▏ | 304339/371472 [2:03:20<4:51:35,  3.84it/s]
 82%|████████▏ | 304340/371472 [2:03:21<4:57:56,  3.76it/s]
                                                           
{'loss': 2.6478, 'learning_rate': 2.627345988924562e-07, 'epoch': 13.11}

 82%|████████▏ | 304340/371472 [2:03:21<4:57:56,  3.76it/s]
 82%|████████▏ | 304341/371472 [2:03:21<4:55:50,  3.78it/s]
 82%|████████▏ | 304342/371472 [2:03:21<5:02:12,  3.70it/s]
 82%|████████▏ | 304343/371472 [2:03:21<5:22:00,  3.47it/s]
 82%|████████▏ | 304344/371472 [2:03:22<5:27:39,  3.41it/s]
 82%|████████▏ | 304345/371472 [2:03:22<5:23:34,  3.46it/s]
 82%|████████▏ | 304346/371472 [2:03:22<5:21:34,  3.48it/s]
 82%|████████▏ | 304347/371472 [2:03:23<5:15:43,  3.54it/s]
 82%|████████▏ | 304348/371472 [2:03:23<5:19:36,  3.50it/s]
 82%|████████▏ | 304349/371472 [2:03:23<5:35:19,  3.34it/s]
 82%|████████▏ | 304350/371472 [2:03:24<5:34:20,  3.35it/s]
 82%|████████▏ | 304351/371472 [2:03:24<5:54:41,  3.15it/s]
 82%|████████▏ | 304352/371472 [2:03:24<5:37:54,  3.31it/s]
 82%|████████▏ | 304353/371472 [2:03:24<5:25:11,  3.44it/s]
 82%|████████▏ | 304354/371472 [2:03:25<5:34:44,  3.34it/s]
 82%|████████▏ | 304355/371472 [2:03:25<5:36:30,  3.32it/s]
 82%|████████▏ | 304356/371472 [2:03:25<5:24:56,  3.44it/s]
 82%|████████▏ | 304357/371472 [2:03:26<5:13:39,  3.57it/s]
 82%|████████▏ | 304358/371472 [2:03:26<5:06:19,  3.65it/s]
 82%|████████▏ | 304359/371472 [2:03:26<5:10:06,  3.61it/s]
 82%|████████▏ | 304360/371472 [2:03:26<5:21:45,  3.48it/s]
                                                           
{'loss': 2.6533, 'learning_rate': 2.626861169169773e-07, 'epoch': 13.11}

 82%|████████▏ | 304360/371472 [2:03:26<5:21:45,  3.48it/s]
 82%|████████▏ | 304361/371472 [2:03:27<5:24:08,  3.45it/s]
 82%|████████▏ | 304362/371472 [2:03:27<5:25:57,  3.43it/s]
 82%|████████▏ | 304363/371472 [2:03:27<5:13:02,  3.57it/s]
 82%|████████▏ | 304364/371472 [2:03:27<5:01:52,  3.71it/s]
 82%|████████▏ | 304365/371472 [2:03:28<5:04:18,  3.68it/s]
 82%|████████▏ | 304366/371472 [2:03:28<5:05:01,  3.67it/s]
 82%|████████▏ | 304367/371472 [2:03:28<5:01:19,  3.71it/s]
 82%|████████▏ | 304368/371472 [2:03:29<5:08:07,  3.63it/s]
 82%|████████▏ | 304369/371472 [2:03:29<5:11:52,  3.59it/s]
 82%|████████▏ | 304370/371472 [2:03:29<5:13:36,  3.57it/s]
 82%|████████▏ | 304371/371472 [2:03:29<5:08:53,  3.62it/s]
 82%|████████▏ | 304372/371472 [2:03:30<5:24:00,  3.45it/s]
 82%|████████▏ | 304373/371472 [2:03:30<5:27:51,  3.41it/s]
 82%|████████▏ | 304374/371472 [2:03:30<5:31:24,  3.37it/s]
 82%|████████▏ | 304375/371472 [2:03:31<6:15:34,  2.98it/s]
 82%|████████▏ | 304376/371472 [2:03:31<6:21:59,  2.93it/s]
 82%|████████▏ | 304377/371472 [2:03:31<5:47:14,  3.22it/s]
 82%|████████▏ | 304378/371472 [2:03:32<5:40:14,  3.29it/s]
 82%|████████▏ | 304379/371472 [2:03:32<5:32:30,  3.36it/s]
 82%|████████▏ | 304380/371472 [2:03:32<5:43:11,  3.26it/s]
                                                           
{'loss': 2.555, 'learning_rate': 2.6263763494149837e-07, 'epoch': 13.11}

 82%|████████▏ | 304380/371472 [2:03:32<5:43:11,  3.26it/s]
 82%|████████▏ | 304381/371472 [2:03:33<5:38:49,  3.30it/s]
 82%|████████▏ | 304382/371472 [2:03:33<5:31:31,  3.37it/s]
 82%|████████▏ | 304383/371472 [2:03:33<5:24:25,  3.45it/s]
 82%|████████▏ | 304384/371472 [2:03:33<5:40:51,  3.28it/s]
 82%|████████▏ | 304385/371472 [2:03:34<5:43:05,  3.26it/s]
 82%|████████▏ | 304386/371472 [2:03:34<5:43:43,  3.25it/s]
 82%|████████▏ | 304387/371472 [2:03:34<5:38:03,  3.31it/s]
 82%|████████▏ | 304388/371472 [2:03:35<5:29:53,  3.39it/s]
 82%|████████▏ | 304389/371472 [2:03:35<5:19:06,  3.50it/s]
 82%|████████▏ | 304390/371472 [2:03:35<5:06:50,  3.64it/s]
 82%|████████▏ | 304391/371472 [2:03:36<5:48:36,  3.21it/s]
 82%|████████▏ | 304392/371472 [2:03:36<5:29:12,  3.40it/s]
 82%|████████▏ | 304393/371472 [2:03:36<5:22:11,  3.47it/s]
 82%|████████▏ | 304394/371472 [2:03:36<5:48:52,  3.20it/s]
 82%|████████▏ | 304395/371472 [2:03:37<5:32:54,  3.36it/s]
 82%|████████▏ | 304396/371472 [2:03:37<5:31:00,  3.38it/s]
 82%|████████▏ | 304397/371472 [2:03:37<5:27:51,  3.41it/s]
 82%|████████▏ | 304398/371472 [2:03:38<5:12:56,  3.57it/s]
 82%|████████▏ | 304399/371472 [2:03:38<5:08:53,  3.62it/s]
 82%|████████▏ | 304400/371472 [2:03:38<5:16:54,  3.53it/s]
                                                           
{'loss': 2.5419, 'learning_rate': 2.6258915296601955e-07, 'epoch': 13.11}

 82%|████████▏ | 304400/371472 [2:03:38<5:16:54,  3.53it/s]
 82%|████████▏ | 304401/371472 [2:03:38<5:13:56,  3.56it/s]
 82%|████████▏ | 304402/371472 [2:03:39<5:28:01,  3.41it/s]
 82%|████████▏ | 304403/371472 [2:03:39<5:23:12,  3.46it/s]
 82%|████████▏ | 304404/371472 [2:03:39<5:15:15,  3.55it/s]
 82%|████████▏ | 304405/371472 [2:03:40<5:15:22,  3.54it/s]
 82%|████████▏ | 304406/371472 [2:03:40<5:14:12,  3.56it/s]
 82%|████████▏ | 304407/371472 [2:03:40<5:37:37,  3.31it/s]
 82%|████████▏ | 304408/371472 [2:03:40<5:21:57,  3.47it/s]
 82%|████████▏ | 304409/371472 [2:03:41<5:19:48,  3.49it/s]
 82%|████████▏ | 304410/371472 [2:03:41<5:11:42,  3.59it/s]
 82%|████████▏ | 304411/371472 [2:03:41<5:07:23,  3.64it/s]
 82%|████████▏ | 304412/371472 [2:03:42<5:07:13,  3.64it/s]
 82%|████████▏ | 304413/371472 [2:03:42<5:00:46,  3.72it/s]
 82%|████████▏ | 304414/371472 [2:03:42<5:07:29,  3.63it/s]
 82%|████████▏ | 304415/371472 [2:03:42<5:07:35,  3.63it/s]
 82%|████████▏ | 304416/371472 [2:03:43<5:12:53,  3.57it/s]
 82%|████████▏ | 304417/371472 [2:03:43<5:21:15,  3.48it/s]
 82%|████████▏ | 304418/371472 [2:03:43<5:28:47,  3.40it/s]
 82%|████████▏ | 304419/371472 [2:03:44<5:19:43,  3.50it/s]
 82%|████████▏ | 304420/371472 [2:03:44<5:17:36,  3.52it/s]
                                                           
{'loss': 2.5613, 'learning_rate': 2.625406709905406e-07, 'epoch': 13.11}

 82%|████████▏ | 304420/371472 [2:03:44<5:17:36,  3.52it/s]
 82%|████████▏ | 304421/371472 [2:03:44<5:14:49,  3.55it/s]
 82%|████████▏ | 304422/371472 [2:03:44<5:04:53,  3.67it/s]
 82%|████████▏ | 304423/371472 [2:03:45<5:06:50,  3.64it/s]
 82%|████████▏ | 304424/371472 [2:03:45<5:16:13,  3.53it/s]
 82%|████████▏ | 304425/371472 [2:03:45<5:08:18,  3.62it/s]
 82%|████████▏ | 304426/371472 [2:03:45<5:02:28,  3.69it/s]
 82%|████████▏ | 304427/371472 [2:03:46<5:01:48,  3.70it/s]
 82%|████████▏ | 304428/371472 [2:03:46<5:00:47,  3.71it/s]
 82%|████████▏ | 304429/371472 [2:03:46<5:06:51,  3.64it/s]
 82%|████████▏ | 304430/371472 [2:03:47<5:31:17,  3.37it/s]
 82%|████████▏ | 304431/371472 [2:03:47<5:29:36,  3.39it/s]
 82%|████████▏ | 304432/371472 [2:03:47<5:54:05,  3.16it/s]
 82%|████████▏ | 304433/371472 [2:03:48<5:39:07,  3.29it/s]
 82%|████████▏ | 304434/371472 [2:03:48<5:24:37,  3.44it/s]
 82%|████████▏ | 304435/371472 [2:03:48<5:18:44,  3.51it/s]
 82%|████████▏ | 304436/371472 [2:03:48<5:11:34,  3.59it/s]
 82%|████████▏ | 304437/371472 [2:03:49<5:13:04,  3.57it/s]
 82%|████████▏ | 304438/371472 [2:03:49<5:02:05,  3.70it/s]
 82%|████████▏ | 304439/371472 [2:03:49<4:57:35,  3.75it/s]
 82%|████████▏ | 304440/371472 [2:03:49<5:04:13,  3.67it/s]
                                                           
{'loss': 2.6712, 'learning_rate': 2.624921890150618e-07, 'epoch': 13.11}

 82%|████████▏ | 304440/371472 [2:03:49<5:04:13,  3.67it/s]
 82%|████████▏ | 304441/371472 [2:03:50<5:24:26,  3.44it/s]
 82%|████████▏ | 304442/371472 [2:03:50<5:17:00,  3.52it/s]
 82%|████████▏ | 304443/371472 [2:03:50<5:02:09,  3.70it/s]
 82%|████████▏ | 304444/371472 [2:03:51<5:03:42,  3.68it/s]
 82%|████████▏ | 304445/371472 [2:03:51<5:04:26,  3.67it/s]
 82%|████████▏ | 304446/371472 [2:03:51<4:56:25,  3.77it/s]
 82%|████████▏ | 304447/371472 [2:03:51<5:08:19,  3.62it/s]
 82%|████████▏ | 304448/371472 [2:03:52<5:04:21,  3.67it/s]
 82%|████████▏ | 304449/371472 [2:03:52<5:03:10,  3.68it/s]
 82%|████████▏ | 304450/371472 [2:03:52<5:17:45,  3.52it/s]
 82%|████████▏ | 304451/371472 [2:03:52<5:10:52,  3.59it/s]
 82%|████████▏ | 304452/371472 [2:03:53<5:07:17,  3.64it/s]
 82%|████████▏ | 304453/371472 [2:03:53<5:02:47,  3.69it/s]
 82%|████████▏ | 304454/371472 [2:03:53<5:03:42,  3.68it/s]
 82%|████████▏ | 304455/371472 [2:03:54<5:07:38,  3.63it/s]
 82%|████████▏ | 304456/371472 [2:03:54<5:16:44,  3.53it/s]
 82%|████████▏ | 304457/371472 [2:03:54<5:08:18,  3.62it/s]
 82%|████████▏ | 304458/371472 [2:03:54<5:15:34,  3.54it/s]
 82%|████████▏ | 304459/371472 [2:03:55<5:11:37,  3.58it/s]
 82%|████████▏ | 304460/371472 [2:03:55<5:30:03,  3.38it/s]
                                                           
{'loss': 2.5835, 'learning_rate': 2.624437070395828e-07, 'epoch': 13.11}

 82%|████████▏ | 304460/371472 [2:03:55<5:30:03,  3.38it/s]
 82%|████████▏ | 304461/371472 [2:03:55<5:32:22,  3.36it/s]
 82%|████████▏ | 304462/371472 [2:03:56<5:32:13,  3.36it/s]
 82%|████████▏ | 304463/371472 [2:03:56<5:25:36,  3.43it/s]
 82%|████████▏ | 304464/371472 [2:03:56<5:20:18,  3.49it/s]
 82%|████████▏ | 304465/371472 [2:03:56<5:29:33,  3.39it/s]
 82%|████████▏ | 304466/371472 [2:03:57<5:31:52,  3.37it/s]
 82%|████████▏ | 304467/371472 [2:03:57<5:26:08,  3.42it/s]
 82%|████████▏ | 304468/371472 [2:03:57<5:20:53,  3.48it/s]
 82%|████████▏ | 304469/371472 [2:03:58<5:20:37,  3.48it/s]
 82%|████████▏ | 304470/371472 [2:03:58<5:18:59,  3.50it/s]
 82%|████████▏ | 304471/371472 [2:03:58<5:12:55,  3.57it/s]
 82%|████████▏ | 304472/371472 [2:03:58<5:11:16,  3.59it/s]
 82%|████████▏ | 304473/371472 [2:03:59<5:06:21,  3.64it/s]
 82%|████████▏ | 304474/371472 [2:03:59<5:11:15,  3.59it/s]
 82%|████████▏ | 304475/371472 [2:03:59<5:37:07,  3.31it/s]
 82%|████████▏ | 304476/371472 [2:04:00<5:21:54,  3.47it/s]
 82%|████████▏ | 304477/371472 [2:04:00<5:16:20,  3.53it/s]
 82%|████████▏ | 304478/371472 [2:04:00<5:09:30,  3.61it/s]
 82%|████████▏ | 304479/371472 [2:04:00<5:20:33,  3.48it/s]
 82%|████████▏ | 304480/371472 [2:04:01<5:44:47,  3.24it/s]
                                                           
{'loss': 2.6367, 'learning_rate': 2.6239522506410394e-07, 'epoch': 13.11}

 82%|████████▏ | 304480/371472 [2:04:01<5:44:47,  3.24it/s]
 82%|████████▏ | 304481/371472 [2:04:01<5:32:11,  3.36it/s]
 82%|████████▏ | 304482/371472 [2:04:01<5:30:45,  3.38it/s]
 82%|████████▏ | 304483/371472 [2:04:02<5:20:28,  3.48it/s]
 82%|████████▏ | 304484/371472 [2:04:02<5:39:38,  3.29it/s]
 82%|████████▏ | 304485/371472 [2:04:02<5:27:08,  3.41it/s]
 82%|████████▏ | 304486/371472 [2:04:03<5:15:18,  3.54it/s]
 82%|████████▏ | 304487/371472 [2:04:03<5:13:30,  3.56it/s]
 82%|████████▏ | 304488/371472 [2:04:03<5:10:41,  3.59it/s]
 82%|████████▏ | 304489/371472 [2:04:03<5:13:14,  3.56it/s]
 82%|████████▏ | 304490/371472 [2:04:04<5:08:28,  3.62it/s]
 82%|████████▏ | 304491/371472 [2:04:04<5:05:00,  3.66it/s]
 82%|████████▏ | 304492/371472 [2:04:04<5:13:34,  3.56it/s]
 82%|████████▏ | 304493/371472 [2:04:04<5:01:21,  3.70it/s]
 82%|████████▏ | 304494/371472 [2:04:05<4:57:40,  3.75it/s]
 82%|████████▏ | 304495/371472 [2:04:05<5:13:28,  3.56it/s]
 82%|████████▏ | 304496/371472 [2:04:05<5:14:48,  3.55it/s]
 82%|████████▏ | 304497/371472 [2:04:06<5:04:13,  3.67it/s]
 82%|████████▏ | 304498/371472 [2:04:06<5:06:54,  3.64it/s]
 82%|████████▏ | 304499/371472 [2:04:06<5:19:34,  3.49it/s]
 82%|████████▏ | 304500/371472 [2:04:06<5:19:35,  3.49it/s]
                                                           
{'loss': 2.7958, 'learning_rate': 2.62346743088625e-07, 'epoch': 13.12}

 82%|████████▏ | 304500/371472 [2:04:06<5:19:35,  3.49it/s]
 82%|████████▏ | 304501/371472 [2:04:07<5:32:44,  3.35it/s]
 82%|████████▏ | 304502/371472 [2:04:07<5:44:39,  3.24it/s]
 82%|████████▏ | 304503/371472 [2:04:07<5:43:12,  3.25it/s]
 82%|████████▏ | 304504/371472 [2:04:08<5:23:21,  3.45it/s]
 82%|████████▏ | 304505/371472 [2:04:08<5:21:20,  3.47it/s]
 82%|████████▏ | 304506/371472 [2:04:08<5:34:31,  3.34it/s]
 82%|████████▏ | 304507/371472 [2:04:09<5:35:39,  3.33it/s]
 82%|████████▏ | 304508/371472 [2:04:09<5:37:35,  3.31it/s]
 82%|████████▏ | 304509/371472 [2:04:09<5:27:50,  3.40it/s]
 82%|████████▏ | 304510/371472 [2:04:09<5:30:52,  3.37it/s]
 82%|████████▏ | 304511/371472 [2:04:10<5:24:30,  3.44it/s]
 82%|████████▏ | 304512/371472 [2:04:10<5:16:56,  3.52it/s]
 82%|████████▏ | 304513/371472 [2:04:10<5:37:24,  3.31it/s]
 82%|████████▏ | 304514/371472 [2:04:11<5:45:13,  3.23it/s]
 82%|████████▏ | 304515/371472 [2:04:11<5:27:40,  3.41it/s]
 82%|████████▏ | 304516/371472 [2:04:11<5:12:04,  3.58it/s]
 82%|████████▏ | 304517/371472 [2:04:11<5:10:19,  3.60it/s]
 82%|████████▏ | 304518/371472 [2:04:12<5:10:16,  3.60it/s]
 82%|████████▏ | 304519/371472 [2:04:12<5:01:56,  3.70it/s]
 82%|████████▏ | 304520/371472 [2:04:12<4:58:54,  3.73it/s]
                                                           
{'loss': 2.6331, 'learning_rate': 2.622982611131462e-07, 'epoch': 13.12}

 82%|████████▏ | 304520/371472 [2:04:12<4:58:54,  3.73it/s]
 82%|████████▏ | 304521/371472 [2:04:12<4:57:42,  3.75it/s]
 82%|████████▏ | 304522/371472 [2:04:13<5:21:00,  3.48it/s]
 82%|████████▏ | 304523/371472 [2:04:13<5:15:09,  3.54it/s]
 82%|████████▏ | 304524/371472 [2:04:13<5:09:34,  3.60it/s]
 82%|████████▏ | 304525/371472 [2:04:14<5:07:13,  3.63it/s]
 82%|████████▏ | 304526/371472 [2:04:14<5:06:04,  3.65it/s]
 82%|████████▏ | 304527/371472 [2:04:14<5:05:09,  3.66it/s]
 82%|████████▏ | 304528/371472 [2:04:14<4:58:55,  3.73it/s]
 82%|████████▏ | 304529/371472 [2:04:15<4:57:28,  3.75it/s]
 82%|████████▏ | 304530/371472 [2:04:15<4:48:51,  3.86it/s]
 82%|████████▏ | 304531/371472 [2:04:15<4:45:52,  3.90it/s]
 82%|████████▏ | 304532/371472 [2:04:15<4:58:55,  3.73it/s]
 82%|████████▏ | 304533/371472 [2:04:16<4:59:07,  3.73it/s]
 82%|████████▏ | 304534/371472 [2:04:16<5:24:10,  3.44it/s]
 82%|████████▏ | 304535/371472 [2:04:16<6:07:05,  3.04it/s]
 82%|████████▏ | 304536/371472 [2:04:17<5:43:45,  3.25it/s]
 82%|████████▏ | 304537/371472 [2:04:17<5:25:35,  3.43it/s]
 82%|████████▏ | 304538/371472 [2:04:17<5:36:18,  3.32it/s]
 82%|████████▏ | 304539/371472 [2:04:18<5:25:35,  3.43it/s]
 82%|████████▏ | 304540/371472 [2:04:18<5:17:35,  3.51it/s]
                                                           
{'loss': 2.6486, 'learning_rate': 2.6224977913766726e-07, 'epoch': 13.12}

 82%|████████▏ | 304540/371472 [2:04:18<5:17:35,  3.51it/s]
 82%|████████▏ | 304541/371472 [2:04:18<5:13:44,  3.56it/s]
 82%|████████▏ | 304542/371472 [2:04:18<5:10:25,  3.59it/s]
 82%|████████▏ | 304543/371472 [2:04:19<5:00:32,  3.71it/s]
 82%|████████▏ | 304544/371472 [2:04:19<4:55:02,  3.78it/s]
 82%|████████▏ | 304545/371472 [2:04:19<5:01:50,  3.70it/s]
 82%|████████▏ | 304546/371472 [2:04:19<4:59:47,  3.72it/s]
 82%|████████▏ | 304547/371472 [2:04:20<4:56:03,  3.77it/s]
 82%|████████▏ | 304548/371472 [2:04:20<5:09:48,  3.60it/s]
 82%|████████▏ | 304549/371472 [2:04:20<5:03:56,  3.67it/s]
 82%|████████▏ | 304550/371472 [2:04:21<5:02:34,  3.69it/s]
 82%|████████▏ | 304551/371472 [2:04:21<5:11:33,  3.58it/s]
 82%|████████▏ | 304552/371472 [2:04:21<5:05:15,  3.65it/s]
 82%|████████▏ | 304553/371472 [2:04:21<5:01:21,  3.70it/s]
 82%|████████▏ | 304554/371472 [2:04:22<5:03:46,  3.67it/s]
 82%|████████▏ | 304555/371472 [2:04:22<5:03:32,  3.67it/s]
 82%|████████▏ | 304556/371472 [2:04:22<5:12:26,  3.57it/s]
 82%|████████▏ | 304557/371472 [2:04:23<5:15:57,  3.53it/s]
 82%|████████▏ | 304558/371472 [2:04:23<5:30:28,  3.37it/s]
 82%|████████▏ | 304559/371472 [2:04:23<5:23:09,  3.45it/s]
 82%|████████▏ | 304560/371472 [2:04:23<5:28:14,  3.40it/s]
                                                           
{'loss': 2.5002, 'learning_rate': 2.6220129716218844e-07, 'epoch': 13.12}

 82%|████████▏ | 304560/371472 [2:04:23<5:28:14,  3.40it/s]
 82%|████████▏ | 304561/371472 [2:04:24<5:29:21,  3.39it/s]
 82%|████████▏ | 304562/371472 [2:04:24<5:51:47,  3.17it/s]
 82%|████████▏ | 304563/371472 [2:04:24<5:30:11,  3.38it/s]
 82%|████████▏ | 304564/371472 [2:04:25<5:24:51,  3.43it/s]
 82%|████████▏ | 304565/371472 [2:04:25<5:24:42,  3.43it/s]
 82%|████████▏ | 304566/371472 [2:04:25<5:15:25,  3.54it/s]
 82%|████████▏ | 304567/371472 [2:04:25<4:57:43,  3.75it/s]
 82%|████████▏ | 304568/371472 [2:04:26<4:59:48,  3.72it/s]
 82%|████████▏ | 304569/371472 [2:04:26<5:28:12,  3.40it/s]
 82%|████████▏ | 304570/371472 [2:04:26<5:28:55,  3.39it/s]
 82%|████████▏ | 304571/371472 [2:04:27<5:32:14,  3.36it/s]
 82%|████████▏ | 304572/371472 [2:04:27<5:17:20,  3.51it/s]
 82%|████████▏ | 304573/371472 [2:04:27<5:14:11,  3.55it/s]
 82%|████████▏ | 304574/371472 [2:04:27<5:19:28,  3.49it/s]
 82%|████████▏ | 304575/371472 [2:04:28<5:07:20,  3.63it/s]
 82%|████████▏ | 304576/371472 [2:04:28<4:57:56,  3.74it/s]
 82%|████████▏ | 304577/371472 [2:04:28<5:06:15,  3.64it/s]
 82%|████████▏ | 304578/371472 [2:04:29<5:04:40,  3.66it/s]
 82%|████████▏ | 304579/371472 [2:04:29<5:26:45,  3.41it/s]
 82%|████████▏ | 304580/371472 [2:04:29<5:12:44,  3.56it/s]
                                                           
{'loss': 2.6136, 'learning_rate': 2.6215281518670946e-07, 'epoch': 13.12}

 82%|████████▏ | 304580/371472 [2:04:29<5:12:44,  3.56it/s]
 82%|████████▏ | 304581/371472 [2:04:29<5:01:03,  3.70it/s]
 82%|████████▏ | 304582/371472 [2:04:30<5:03:17,  3.68it/s]
 82%|████████▏ | 304583/371472 [2:04:30<5:07:48,  3.62it/s]
 82%|████████▏ | 304584/371472 [2:04:30<5:33:52,  3.34it/s]
 82%|████████▏ | 304585/371472 [2:04:31<5:20:33,  3.48it/s]
 82%|████████▏ | 304586/371472 [2:04:31<5:20:10,  3.48it/s]
 82%|████████▏ | 304587/371472 [2:04:31<5:06:58,  3.63it/s]
 82%|████████▏ | 304588/371472 [2:04:31<4:59:15,  3.72it/s]
 82%|████████▏ | 304589/371472 [2:04:32<5:01:56,  3.69it/s]
 82%|████████▏ | 304590/371472 [2:04:32<4:56:31,  3.76it/s]
 82%|████████▏ | 304591/371472 [2:04:32<5:16:49,  3.52it/s]
 82%|████████▏ | 304592/371472 [2:04:32<5:17:55,  3.51it/s]
 82%|████████▏ | 304593/371472 [2:04:33<5:13:33,  3.55it/s]
 82%|████████▏ | 304594/371472 [2:04:33<4:58:57,  3.73it/s]
 82%|████████▏ | 304595/371472 [2:04:33<4:59:37,  3.72it/s]
 82%|████████▏ | 304596/371472 [2:04:33<4:57:35,  3.75it/s]
 82%|████████▏ | 304597/371472 [2:04:34<4:54:31,  3.78it/s]
 82%|████████▏ | 304598/371472 [2:04:34<4:51:15,  3.83it/s]
 82%|████████▏ | 304599/371472 [2:04:34<4:44:51,  3.91it/s]
 82%|████████▏ | 304600/371472 [2:04:35<4:50:36,  3.84it/s]
                                                           
{'loss': 2.4932, 'learning_rate': 2.6210433321123053e-07, 'epoch': 13.12}

 82%|████████▏ | 304600/371472 [2:04:35<4:50:36,  3.84it/s]
 82%|████████▏ | 304601/371472 [2:04:35<4:49:48,  3.85it/s]
 82%|████████▏ | 304602/371472 [2:04:35<4:58:55,  3.73it/s]
 82%|████████▏ | 304603/371472 [2:04:35<5:00:40,  3.71it/s]
 82%|████████▏ | 304604/371472 [2:04:36<5:03:02,  3.68it/s]
 82%|████████▏ | 304605/371472 [2:04:36<5:08:20,  3.61it/s]
 82%|████████▏ | 304606/371472 [2:04:36<5:06:51,  3.63it/s]
 82%|████████▏ | 304607/371472 [2:04:36<5:09:04,  3.61it/s]
 82%|████████▏ | 304608/371472 [2:04:37<5:03:59,  3.67it/s]
 82%|████████▏ | 304609/371472 [2:04:37<5:09:28,  3.60it/s]
 82%|████████▏ | 304610/371472 [2:04:37<5:12:21,  3.57it/s]
 82%|████████▏ | 304611/371472 [2:04:38<5:10:06,  3.59it/s]
 82%|████████▏ | 304612/371472 [2:04:38<5:29:28,  3.38it/s]
 82%|████████▏ | 304613/371472 [2:04:38<5:15:59,  3.53it/s]
 82%|████████▏ | 304614/371472 [2:04:38<5:04:07,  3.66it/s]
 82%|████████▏ | 304615/371472 [2:04:39<4:56:47,  3.75it/s]
 82%|████████▏ | 304616/371472 [2:04:39<4:51:16,  3.83it/s]
 82%|████████▏ | 304617/371472 [2:04:39<4:51:31,  3.82it/s]
 82%|████████▏ | 304618/371472 [2:04:39<4:51:21,  3.82it/s]
 82%|████████▏ | 304619/371472 [2:04:40<5:28:15,  3.39it/s]
 82%|████████▏ | 304620/371472 [2:04:40<5:34:24,  3.33it/s]
                                                           
{'loss': 2.6518, 'learning_rate': 2.6205585123575165e-07, 'epoch': 13.12}

 82%|████████▏ | 304620/371472 [2:04:40<5:34:24,  3.33it/s]
 82%|████████▏ | 304621/371472 [2:04:40<5:45:23,  3.23it/s]
 82%|████████▏ | 304622/371472 [2:04:41<5:25:53,  3.42it/s]
 82%|████████▏ | 304623/371472 [2:04:41<5:27:59,  3.40it/s]
 82%|████████▏ | 304624/371472 [2:04:41<5:44:20,  3.24it/s]
 82%|████████▏ | 304625/371472 [2:04:42<5:40:45,  3.27it/s]
 82%|████████▏ | 304626/371472 [2:04:42<5:34:44,  3.33it/s]
 82%|████████▏ | 304627/371472 [2:04:42<5:18:08,  3.50it/s]
 82%|████████▏ | 304628/371472 [2:04:42<5:22:28,  3.45it/s]
 82%|████████▏ | 304629/371472 [2:04:43<5:43:31,  3.24it/s]
 82%|████████▏ | 304630/371472 [2:04:43<5:27:48,  3.40it/s]
 82%|████████▏ | 304631/371472 [2:04:43<5:19:30,  3.49it/s]
 82%|████████▏ | 304632/371472 [2:04:44<5:12:59,  3.56it/s]
 82%|████████▏ | 304633/371472 [2:04:44<5:27:36,  3.40it/s]
 82%|████████▏ | 304634/371472 [2:04:44<5:08:46,  3.61it/s]
 82%|████████▏ | 304635/371472 [2:04:44<5:07:59,  3.62it/s]
 82%|████████▏ | 304636/371472 [2:04:45<5:04:00,  3.66it/s]
 82%|████████▏ | 304637/371472 [2:04:45<5:07:34,  3.62it/s]
 82%|████████▏ | 304638/371472 [2:04:45<5:05:25,  3.65it/s]
 82%|████████▏ | 304639/371472 [2:04:46<5:03:15,  3.67it/s]
 82%|████████▏ | 304640/371472 [2:04:46<5:06:18,  3.64it/s]
                                                           
{'loss': 2.5847, 'learning_rate': 2.620073692602727e-07, 'epoch': 13.12}

 82%|████████▏ | 304640/371472 [2:04:46<5:06:18,  3.64it/s]
 82%|████████▏ | 304641/371472 [2:04:46<5:05:34,  3.65it/s]
 82%|████████▏ | 304642/371472 [2:04:46<5:11:01,  3.58it/s]
 82%|████████▏ | 304643/371472 [2:04:47<5:31:05,  3.36it/s]
 82%|████████▏ | 304644/371472 [2:04:47<5:26:08,  3.42it/s]
 82%|████████▏ | 304645/371472 [2:04:47<5:23:52,  3.44it/s]
 82%|████████▏ | 304646/371472 [2:04:48<5:12:25,  3.56it/s]
 82%|████████▏ | 304647/371472 [2:04:48<5:11:31,  3.58it/s]
 82%|████████▏ | 304648/371472 [2:04:48<5:14:00,  3.55it/s]
 82%|████████▏ | 304649/371472 [2:04:48<5:05:52,  3.64it/s]
 82%|████████▏ | 304650/371472 [2:04:49<5:06:11,  3.64it/s]
 82%|████████▏ | 304651/371472 [2:04:49<5:08:34,  3.61it/s]
 82%|████████▏ | 304652/371472 [2:04:49<5:03:24,  3.67it/s]
 82%|████████▏ | 304653/371472 [2:04:49<5:02:51,  3.68it/s]
 82%|████████▏ | 304654/371472 [2:04:50<5:12:37,  3.56it/s]
 82%|████████▏ | 304655/371472 [2:04:50<5:22:59,  3.45it/s]
 82%|████████▏ | 304656/371472 [2:04:50<5:13:02,  3.56it/s]
 82%|████████▏ | 304657/371472 [2:04:51<5:11:58,  3.57it/s]
 82%|████████▏ | 304658/371472 [2:04:51<5:01:18,  3.70it/s]
 82%|████████▏ | 304659/371472 [2:04:51<4:58:47,  3.73it/s]
 82%|████████▏ | 304660/371472 [2:04:51<4:52:21,  3.81it/s]
                                                           
{'loss': 2.5423, 'learning_rate': 2.6195888728479395e-07, 'epoch': 13.12}

 82%|████████▏ | 304660/371472 [2:04:51<4:52:21,  3.81it/s]
 82%|████████▏ | 304661/371472 [2:04:52<5:02:19,  3.68it/s]
 82%|████████▏ | 304662/371472 [2:04:52<5:15:43,  3.53it/s]
 82%|████████▏ | 304663/371472 [2:04:52<5:01:35,  3.69it/s]
 82%|████████▏ | 304664/371472 [2:04:53<5:04:20,  3.66it/s]
 82%|████████▏ | 304665/371472 [2:04:53<5:13:04,  3.56it/s]
 82%|████████▏ | 304666/371472 [2:04:53<5:07:06,  3.63it/s]
 82%|████████▏ | 304667/371472 [2:04:53<5:13:48,  3.55it/s]
 82%|████████▏ | 304668/371472 [2:04:54<5:16:50,  3.51it/s]
 82%|████████▏ | 304669/371472 [2:04:54<5:18:29,  3.50it/s]
 82%|████████▏ | 304670/371472 [2:04:54<5:28:14,  3.39it/s]
 82%|████████▏ | 304671/371472 [2:04:55<5:27:18,  3.40it/s]
 82%|████████▏ | 304672/371472 [2:04:55<5:15:40,  3.53it/s]
 82%|████████▏ | 304673/371472 [2:04:55<5:34:26,  3.33it/s]
 82%|████████▏ | 304674/371472 [2:04:55<5:36:59,  3.30it/s]
 82%|████████▏ | 304675/371472 [2:04:56<5:33:09,  3.34it/s]
 82%|████████▏ | 304676/371472 [2:04:56<5:58:27,  3.11it/s]
 82%|████████▏ | 304677/371472 [2:04:57<6:28:30,  2.87it/s]
 82%|████████▏ | 304678/371472 [2:04:57<6:06:25,  3.04it/s]
 82%|████████▏ | 304679/371472 [2:04:57<5:47:42,  3.20it/s]
 82%|████████▏ | 304680/371472 [2:04:57<5:25:32,  3.42it/s]
                                                           
{'loss': 2.5294, 'learning_rate': 2.6191040530931497e-07, 'epoch': 13.12}

 82%|████████▏ | 304680/371472 [2:04:57<5:25:32,  3.42it/s]
 82%|████████▏ | 304681/371472 [2:04:58<5:24:09,  3.43it/s]
 82%|████████▏ | 304682/371472 [2:04:58<5:15:47,  3.53it/s]
 82%|████████▏ | 304683/371472 [2:04:58<5:12:45,  3.56it/s]
 82%|████████▏ | 304684/371472 [2:04:58<5:15:17,  3.53it/s]
 82%|████████▏ | 304685/371472 [2:04:59<5:00:07,  3.71it/s]
 82%|████████▏ | 304686/371472 [2:04:59<4:51:49,  3.81it/s]
 82%|████████▏ | 304687/371472 [2:04:59<4:53:36,  3.79it/s]
 82%|████████▏ | 304688/371472 [2:04:59<4:48:25,  3.86it/s]
 82%|████████▏ | 304689/371472 [2:05:00<5:00:27,  3.70it/s]
 82%|████████▏ | 304690/371472 [2:05:00<5:13:13,  3.55it/s]
 82%|████████▏ | 304691/371472 [2:05:00<5:06:43,  3.63it/s]
 82%|████████▏ | 304692/371472 [2:05:01<5:39:11,  3.28it/s]
 82%|████████▏ | 304693/371472 [2:05:01<5:45:19,  3.22it/s]
 82%|████████▏ | 304694/371472 [2:05:01<5:39:52,  3.27it/s]
 82%|████████▏ | 304695/371472 [2:05:02<5:42:29,  3.25it/s]
 82%|████████▏ | 304696/371472 [2:05:02<5:20:34,  3.47it/s]
 82%|████████▏ | 304697/371472 [2:05:02<5:37:48,  3.29it/s]
 82%|████████▏ | 304698/371472 [2:05:03<5:41:48,  3.26it/s]
 82%|████████▏ | 304699/371472 [2:05:03<5:18:58,  3.49it/s]
 82%|████████▏ | 304700/371472 [2:05:03<5:05:52,  3.64it/s]
                                                           
{'loss': 2.6553, 'learning_rate': 2.618619233338361e-07, 'epoch': 13.12}

 82%|████████▏ | 304700/371472 [2:05:03<5:05:52,  3.64it/s]
 82%|████████▏ | 304701/371472 [2:05:03<5:31:38,  3.36it/s]
 82%|████████▏ | 304702/371472 [2:05:04<5:40:38,  3.27it/s]
 82%|████████▏ | 304703/371472 [2:05:04<5:28:43,  3.39it/s]
 82%|████████▏ | 304704/371472 [2:05:04<5:19:26,  3.48it/s]
 82%|████████▏ | 304705/371472 [2:05:05<5:19:31,  3.48it/s]
 82%|████████▏ | 304706/371472 [2:05:05<5:09:58,  3.59it/s]
 82%|████████▏ | 304707/371472 [2:05:05<5:08:49,  3.60it/s]
 82%|████████▏ | 304708/371472 [2:05:05<5:45:41,  3.22it/s]
 82%|████████▏ | 304709/371472 [2:05:06<5:30:45,  3.36it/s]
 82%|████████▏ | 304710/371472 [2:05:06<5:52:30,  3.16it/s]
 82%|████████▏ | 304711/371472 [2:05:06<5:27:30,  3.40it/s]
 82%|████████▏ | 304712/371472 [2:05:07<5:07:53,  3.61it/s]
 82%|████████▏ | 304713/371472 [2:05:07<4:56:51,  3.75it/s]
 82%|████████▏ | 304714/371472 [2:05:07<5:08:20,  3.61it/s]
 82%|████████▏ | 304715/371472 [2:05:07<5:33:05,  3.34it/s]
 82%|████████▏ | 304716/371472 [2:05:08<5:19:20,  3.48it/s]
 82%|████████▏ | 304717/371472 [2:05:08<5:15:54,  3.52it/s]
 82%|████████▏ | 304718/371472 [2:05:08<5:14:54,  3.53it/s]
 82%|████████▏ | 304719/371472 [2:05:09<5:37:43,  3.29it/s]
 82%|████████▏ | 304720/371472 [2:05:09<5:22:16,  3.45it/s]
                                                           
{'loss': 2.5032, 'learning_rate': 2.6181344135835717e-07, 'epoch': 13.12}

 82%|████████▏ | 304720/371472 [2:05:09<5:22:16,  3.45it/s]
 82%|████████▏ | 304721/371472 [2:05:09<5:26:06,  3.41it/s]
 82%|████████▏ | 304722/371472 [2:05:09<5:37:28,  3.30it/s]
 82%|████████▏ | 304723/371472 [2:05:10<5:26:21,  3.41it/s]
 82%|████████▏ | 304724/371472 [2:05:10<5:13:37,  3.55it/s]
 82%|████████▏ | 304725/371472 [2:05:10<5:07:28,  3.62it/s]
 82%|████████▏ | 304726/371472 [2:05:11<5:04:23,  3.65it/s]
 82%|████████▏ | 304727/371472 [2:05:11<4:58:27,  3.73it/s]
 82%|████████▏ | 304728/371472 [2:05:11<5:36:28,  3.31it/s]
 82%|████████▏ | 304729/371472 [2:05:12<5:44:05,  3.23it/s]
 82%|████████▏ | 304730/371472 [2:05:12<5:47:07,  3.20it/s]
 82%|████████▏ | 304731/371472 [2:05:12<5:49:17,  3.18it/s]
 82%|████████▏ | 304732/371472 [2:05:12<5:42:24,  3.25it/s]
 82%|████████▏ | 304733/371472 [2:05:13<5:36:26,  3.31it/s]
 82%|████████▏ | 304734/371472 [2:05:13<5:32:46,  3.34it/s]
 82%|████████▏ | 304735/371472 [2:05:13<5:21:54,  3.46it/s]
 82%|████████▏ | 304736/371472 [2:05:14<5:10:06,  3.59it/s]
 82%|████████▏ | 304737/371472 [2:05:14<5:08:36,  3.60it/s]
 82%|████████▏ | 304738/371472 [2:05:14<5:00:35,  3.70it/s]
 82%|████████▏ | 304739/371472 [2:05:14<4:57:21,  3.74it/s]
 82%|████████▏ | 304740/371472 [2:05:15<5:30:33,  3.36it/s]
                                                           
{'loss': 2.7025, 'learning_rate': 2.617649593828783e-07, 'epoch': 13.13}

 82%|████████▏ | 304740/371472 [2:05:15<5:30:33,  3.36it/s]
 82%|████████▏ | 304741/371472 [2:05:15<5:20:59,  3.46it/s]
 82%|████████▏ | 304742/371472 [2:05:15<5:16:15,  3.52it/s]
 82%|████████▏ | 304743/371472 [2:05:16<5:19:28,  3.48it/s]
 82%|████████▏ | 304744/371472 [2:05:16<5:00:57,  3.70it/s]
 82%|████████▏ | 304745/371472 [2:05:16<5:02:59,  3.67it/s]
 82%|████████▏ | 304746/371472 [2:05:16<4:57:35,  3.74it/s]
 82%|████████▏ | 304747/371472 [2:05:17<4:56:29,  3.75it/s]
 82%|████████▏ | 304748/371472 [2:05:17<4:45:57,  3.89it/s]
 82%|████████▏ | 304749/371472 [2:05:17<4:52:57,  3.80it/s]
 82%|████████▏ | 304750/371472 [2:05:17<5:05:10,  3.64it/s]
 82%|████████▏ | 304751/371472 [2:05:18<4:58:26,  3.73it/s]
 82%|████████▏ | 304752/371472 [2:05:18<4:53:51,  3.78it/s]
 82%|████████▏ | 304753/371472 [2:05:18<4:46:10,  3.89it/s]
 82%|████████▏ | 304754/371472 [2:05:18<4:52:00,  3.81it/s]
 82%|████████▏ | 304755/371472 [2:05:19<4:55:04,  3.77it/s]
 82%|████████▏ | 304756/371472 [2:05:19<4:47:55,  3.86it/s]
 82%|████████▏ | 304757/371472 [2:05:19<5:15:00,  3.53it/s]
 82%|████████▏ | 304758/371472 [2:05:20<5:04:50,  3.65it/s]
 82%|████████▏ | 304759/371472 [2:05:20<4:50:18,  3.83it/s]
 82%|████████▏ | 304760/371472 [2:05:20<5:12:47,  3.55it/s]
                                                           
{'loss': 2.6432, 'learning_rate': 2.6171647740739936e-07, 'epoch': 13.13}

 82%|████████▏ | 304760/371472 [2:05:20<5:12:47,  3.55it/s]
 82%|████████▏ | 304761/371472 [2:05:20<5:04:46,  3.65it/s]
 82%|████████▏ | 304762/371472 [2:05:21<5:01:21,  3.69it/s]
 82%|████████▏ | 304763/371472 [2:05:21<5:19:19,  3.48it/s]
 82%|████████▏ | 304764/371472 [2:05:21<5:55:36,  3.13it/s]
 82%|████████▏ | 304765/371472 [2:05:22<5:45:01,  3.22it/s]
 82%|████████▏ | 304766/371472 [2:05:22<5:20:47,  3.47it/s]
 82%|████████▏ | 304767/371472 [2:05:22<5:12:53,  3.55it/s]
 82%|████████▏ | 304768/371472 [2:05:22<5:07:26,  3.62it/s]
 82%|████████▏ | 304769/371472 [2:05:23<5:07:58,  3.61it/s]
 82%|████████▏ | 304770/371472 [2:05:23<5:08:05,  3.61it/s]
 82%|████████▏ | 304771/371472 [2:05:23<5:07:18,  3.62it/s]
 82%|████████▏ | 304772/371472 [2:05:24<5:17:09,  3.51it/s]
 82%|████████▏ | 304773/371472 [2:05:24<5:08:22,  3.60it/s]
 82%|████████▏ | 304774/371472 [2:05:24<5:52:29,  3.15it/s]
 82%|████████▏ | 304775/371472 [2:05:24<5:37:52,  3.29it/s]
 82%|████████▏ | 304776/371472 [2:05:25<5:34:19,  3.32it/s]
 82%|████████▏ | 304777/371472 [2:05:25<5:49:38,  3.18it/s]
 82%|████████▏ | 304778/371472 [2:05:25<5:40:58,  3.26it/s]
 82%|████████▏ | 304779/371472 [2:05:26<5:37:14,  3.30it/s]
 82%|████████▏ | 304780/371472 [2:05:26<5:29:06,  3.38it/s]
                                                           
{'loss': 2.6117, 'learning_rate': 2.6166799543192054e-07, 'epoch': 13.13}

 82%|████████▏ | 304780/371472 [2:05:26<5:29:06,  3.38it/s]
 82%|████████▏ | 304781/371472 [2:05:26<5:32:24,  3.34it/s]
 82%|████████▏ | 304782/371472 [2:05:27<5:19:40,  3.48it/s]
 82%|████████▏ | 304783/371472 [2:05:27<5:15:14,  3.53it/s]
 82%|████████▏ | 304784/371472 [2:05:27<5:25:40,  3.41it/s]
 82%|████████▏ | 304785/371472 [2:05:27<5:32:26,  3.34it/s]
 82%|████████▏ | 304786/371472 [2:05:28<5:27:18,  3.40it/s]
 82%|████████▏ | 304787/371472 [2:05:28<5:12:51,  3.55it/s]
 82%|████████▏ | 304788/371472 [2:05:28<5:08:09,  3.61it/s]
 82%|████████▏ | 304789/371472 [2:05:29<5:10:11,  3.58it/s]
 82%|████████▏ | 304790/371472 [2:05:29<5:02:49,  3.67it/s]
 82%|████████▏ | 304791/371472 [2:05:29<5:07:17,  3.62it/s]
 82%|████████▏ | 304792/371472 [2:05:29<5:02:05,  3.68it/s]
 82%|████████▏ | 304793/371472 [2:05:30<5:15:34,  3.52it/s]
 82%|████████▏ | 304794/371472 [2:05:30<5:09:39,  3.59it/s]
 82%|████████▏ | 304795/371472 [2:05:30<5:25:36,  3.41it/s]
 82%|████████▏ | 304796/371472 [2:05:30<5:10:41,  3.58it/s]
 82%|████████▏ | 304797/371472 [2:05:31<5:19:15,  3.48it/s]
 82%|████████▏ | 304798/371472 [2:05:31<5:08:47,  3.60it/s]
 82%|████████▏ | 304799/371472 [2:05:31<5:14:51,  3.53it/s]
 82%|████████▏ | 304800/371472 [2:05:32<5:10:59,  3.57it/s]
                                                           
{'loss': 2.3488, 'learning_rate': 2.616195134564416e-07, 'epoch': 13.13}

 82%|████████▏ | 304800/371472 [2:05:32<5:10:59,  3.57it/s]
 82%|████████▏ | 304801/371472 [2:05:32<5:11:25,  3.57it/s]
 82%|████████▏ | 304802/371472 [2:05:32<5:33:29,  3.33it/s]
 82%|████████▏ | 304803/371472 [2:05:33<5:35:22,  3.31it/s]
 82%|████████▏ | 304804/371472 [2:05:33<5:55:22,  3.13it/s]
 82%|████████▏ | 304805/371472 [2:05:33<5:36:05,  3.31it/s]
 82%|████████▏ | 304806/371472 [2:05:33<5:34:09,  3.33it/s]
 82%|████████▏ | 304807/371472 [2:05:34<5:45:00,  3.22it/s]
 82%|████████▏ | 304808/371472 [2:05:34<5:47:38,  3.20it/s]
 82%|████████▏ | 304809/371472 [2:05:34<5:25:58,  3.41it/s]
 82%|████████▏ | 304810/371472 [2:05:35<5:16:40,  3.51it/s]
 82%|████████▏ | 304811/371472 [2:05:35<5:00:57,  3.69it/s]
 82%|████████▏ | 304812/371472 [2:05:35<5:20:13,  3.47it/s]
 82%|████████▏ | 304813/371472 [2:05:36<5:41:16,  3.26it/s]
 82%|████████▏ | 304814/371472 [2:05:36<5:34:46,  3.32it/s]
 82%|████████▏ | 304815/371472 [2:05:36<5:31:09,  3.35it/s]
 82%|████████▏ | 304816/371472 [2:05:36<5:13:27,  3.54it/s]
 82%|████████▏ | 304817/371472 [2:05:37<5:15:15,  3.52it/s]
 82%|████████▏ | 304818/371472 [2:05:37<5:26:18,  3.40it/s]
 82%|████████▏ | 304819/371472 [2:05:37<5:25:51,  3.41it/s]
 82%|████████▏ | 304820/371472 [2:05:38<5:13:05,  3.55it/s]
                                                           
{'loss': 2.6994, 'learning_rate': 2.615710314809628e-07, 'epoch': 13.13}

 82%|████████▏ | 304820/371472 [2:05:38<5:13:05,  3.55it/s]
 82%|████████▏ | 304821/371472 [2:05:38<5:06:37,  3.62it/s]
 82%|████████▏ | 304822/371472 [2:05:38<5:09:41,  3.59it/s]
 82%|████████▏ | 304823/371472 [2:05:38<5:04:13,  3.65it/s]
 82%|████████▏ | 304824/371472 [2:05:39<5:00:31,  3.70it/s]
 82%|████████▏ | 304825/371472 [2:05:39<4:56:43,  3.74it/s]
 82%|████████▏ | 304826/371472 [2:05:39<5:01:58,  3.68it/s]
 82%|████████▏ | 304827/371472 [2:05:39<5:10:27,  3.58it/s]
 82%|████████▏ | 304828/371472 [2:05:40<5:30:13,  3.36it/s]
 82%|████████▏ | 304829/371472 [2:05:40<5:29:32,  3.37it/s]
 82%|████████▏ | 304830/371472 [2:05:40<5:24:39,  3.42it/s]
 82%|████████▏ | 304831/371472 [2:05:41<5:55:02,  3.13it/s]
 82%|████████▏ | 304832/371472 [2:05:41<5:29:28,  3.37it/s]
 82%|████████▏ | 304833/371472 [2:05:41<5:05:39,  3.63it/s]
 82%|████████▏ | 304834/371472 [2:05:41<5:15:21,  3.52it/s]
 82%|████████▏ | 304835/371472 [2:05:42<5:12:02,  3.56it/s]
 82%|████████▏ | 304836/371472 [2:05:42<5:04:39,  3.65it/s]
 82%|████████▏ | 304837/371472 [2:05:42<5:15:36,  3.52it/s]
 82%|████████▏ | 304838/371472 [2:05:43<5:20:17,  3.47it/s]
 82%|████████▏ | 304839/371472 [2:05:43<5:06:10,  3.63it/s]
 82%|████████▏ | 304840/371472 [2:05:43<5:06:30,  3.62it/s]
                                                           
{'loss': 2.6947, 'learning_rate': 2.615225495054838e-07, 'epoch': 13.13}

 82%|████████▏ | 304840/371472 [2:05:43<5:06:30,  3.62it/s]
 82%|████████▏ | 304841/371472 [2:05:43<5:03:24,  3.66it/s]
 82%|████████▏ | 304842/371472 [2:05:44<5:05:00,  3.64it/s]
 82%|████████▏ | 304843/371472 [2:05:44<5:32:30,  3.34it/s]
 82%|████████▏ | 304844/371472 [2:05:44<5:31:59,  3.34it/s]
 82%|████████▏ | 304845/371472 [2:05:45<5:20:51,  3.46it/s]
 82%|████████▏ | 304846/371472 [2:05:45<5:38:44,  3.28it/s]
 82%|████████▏ | 304847/371472 [2:05:45<5:26:19,  3.40it/s]
 82%|████████▏ | 304848/371472 [2:05:45<5:12:50,  3.55it/s]
 82%|████████▏ | 304849/371472 [2:05:46<5:11:20,  3.57it/s]
 82%|████████▏ | 304850/371472 [2:05:46<5:17:25,  3.50it/s]
 82%|████████▏ | 304851/371472 [2:05:46<5:08:09,  3.60it/s]
 82%|████████▏ | 304852/371472 [2:05:47<5:43:11,  3.24it/s]
 82%|████████▏ | 304853/371472 [2:05:47<5:35:41,  3.31it/s]
 82%|████████▏ | 304854/371472 [2:05:47<5:34:59,  3.31it/s]
 82%|████████▏ | 304855/371472 [2:05:48<5:25:21,  3.41it/s]
 82%|████████▏ | 304856/371472 [2:05:48<5:15:54,  3.51it/s]
 82%|████████▏ | 304857/371472 [2:05:48<5:02:11,  3.67it/s]
 82%|████████▏ | 304858/371472 [2:05:48<4:59:11,  3.71it/s]
 82%|████████▏ | 304859/371472 [2:05:49<4:58:36,  3.72it/s]
 82%|████████▏ | 304860/371472 [2:05:49<4:49:24,  3.84it/s]
                                                           
{'loss': 2.8372, 'learning_rate': 2.6147406753000493e-07, 'epoch': 13.13}

 82%|████████▏ | 304860/371472 [2:05:49<4:49:24,  3.84it/s]
 82%|████████▏ | 304861/371472 [2:05:49<4:45:22,  3.89it/s]
 82%|████████▏ | 304862/371472 [2:05:49<4:56:31,  3.74it/s]
 82%|████████▏ | 304863/371472 [2:05:50<5:38:51,  3.28it/s]
 82%|████████▏ | 304864/371472 [2:05:50<5:31:38,  3.35it/s]
 82%|████████▏ | 304865/371472 [2:05:50<5:39:12,  3.27it/s]
 82%|████████▏ | 304866/371472 [2:05:51<5:21:08,  3.46it/s]
 82%|████████▏ | 304867/371472 [2:05:51<5:44:24,  3.22it/s]
 82%|████████▏ | 304868/371472 [2:05:51<5:20:35,  3.46it/s]
 82%|████████▏ | 304869/371472 [2:05:52<5:20:09,  3.47it/s]
 82%|████████▏ | 304870/371472 [2:05:52<5:05:24,  3.63it/s]
 82%|████████▏ | 304871/371472 [2:05:52<5:02:55,  3.66it/s]
 82%|████████▏ | 304872/371472 [2:05:52<5:00:24,  3.69it/s]
 82%|████████▏ | 304873/371472 [2:05:53<5:03:35,  3.66it/s]
 82%|████████▏ | 304874/371472 [2:05:53<5:58:55,  3.09it/s]
 82%|████████▏ | 304875/371472 [2:05:53<5:31:28,  3.35it/s]
 82%|████████▏ | 304876/371472 [2:05:54<5:22:59,  3.44it/s]
 82%|████████▏ | 304877/371472 [2:05:54<5:30:30,  3.36it/s]
 82%|████████▏ | 304878/371472 [2:05:54<5:16:45,  3.50it/s]
 82%|████████▏ | 304879/371472 [2:05:54<5:14:23,  3.53it/s]
 82%|████████▏ | 304880/371472 [2:05:55<5:21:11,  3.46it/s]
                                                           
{'loss': 2.5578, 'learning_rate': 2.61425585554526e-07, 'epoch': 13.13}

 82%|████████▏ | 304880/371472 [2:05:55<5:21:11,  3.46it/s]
 82%|████████▏ | 304881/371472 [2:05:55<5:18:33,  3.48it/s]
 82%|████████▏ | 304882/371472 [2:05:55<5:19:46,  3.47it/s]
 82%|████████▏ | 304883/371472 [2:05:55<5:06:06,  3.63it/s]
 82%|████████▏ | 304884/371472 [2:05:56<5:04:30,  3.64it/s]
 82%|████████▏ | 304885/371472 [2:05:56<5:04:06,  3.65it/s]
 82%|████████▏ | 304886/371472 [2:05:56<5:03:34,  3.66it/s]
 82%|████████▏ | 304887/371472 [2:05:57<5:14:17,  3.53it/s]
 82%|████████▏ | 304888/371472 [2:05:57<5:13:38,  3.54it/s]
 82%|████████▏ | 304889/371472 [2:05:57<5:12:31,  3.55it/s]
 82%|████████▏ | 304890/371472 [2:05:57<5:10:35,  3.57it/s]
 82%|████████▏ | 304891/371472 [2:05:58<5:16:07,  3.51it/s]
 82%|████████▏ | 304892/371472 [2:05:58<5:22:46,  3.44it/s]
 82%|████████▏ | 304893/371472 [2:05:58<5:11:34,  3.56it/s]
 82%|████████▏ | 304894/371472 [2:05:59<5:04:11,  3.65it/s]
 82%|████████▏ | 304895/371472 [2:05:59<5:15:17,  3.52it/s]
 82%|████████▏ | 304896/371472 [2:05:59<5:09:50,  3.58it/s]
 82%|████████▏ | 304897/371472 [2:05:59<5:17:49,  3.49it/s]
 82%|████████▏ | 304898/371472 [2:06:00<5:11:43,  3.56it/s]
 82%|████████▏ | 304899/371472 [2:06:00<5:30:56,  3.35it/s]
 82%|████████▏ | 304900/371472 [2:06:00<5:26:46,  3.40it/s]
                                                           
{'loss': 2.598, 'learning_rate': 2.613771035790472e-07, 'epoch': 13.13}

 82%|████████▏ | 304900/371472 [2:06:00<5:26:46,  3.40it/s]
 82%|████████▏ | 304901/371472 [2:06:01<5:18:14,  3.49it/s]
 82%|████████▏ | 304902/371472 [2:06:01<5:11:43,  3.56it/s]
 82%|████████▏ | 304903/371472 [2:06:01<5:18:22,  3.48it/s]
 82%|████████▏ | 304904/371472 [2:06:01<5:10:49,  3.57it/s]
 82%|████████▏ | 304905/371472 [2:06:02<5:20:52,  3.46it/s]
 82%|████████▏ | 304906/371472 [2:06:02<5:10:03,  3.58it/s]
 82%|████████▏ | 304907/371472 [2:06:02<5:03:50,  3.65it/s]
 82%|████████▏ | 304908/371472 [2:06:03<5:11:43,  3.56it/s]
 82%|████████▏ | 304909/371472 [2:06:03<5:02:16,  3.67it/s]
 82%|████████▏ | 304910/371472 [2:06:03<5:09:11,  3.59it/s]
 82%|████████▏ | 304911/371472 [2:06:03<5:00:11,  3.70it/s]
 82%|████████▏ | 304912/371472 [2:06:04<5:07:01,  3.61it/s]
 82%|████████▏ | 304913/371472 [2:06:04<4:58:43,  3.71it/s]
 82%|████████▏ | 304914/371472 [2:06:04<5:09:53,  3.58it/s]
 82%|████████▏ | 304915/371472 [2:06:04<5:10:00,  3.58it/s]
 82%|████████▏ | 304916/371472 [2:06:05<5:16:00,  3.51it/s]
 82%|████████▏ | 304917/371472 [2:06:05<5:23:48,  3.43it/s]
 82%|████████▏ | 304918/371472 [2:06:05<5:17:58,  3.49it/s]
 82%|████████▏ | 304919/371472 [2:06:06<5:14:35,  3.53it/s]
 82%|████████▏ | 304920/371472 [2:06:06<5:07:11,  3.61it/s]
                                                           
{'loss': 2.6546, 'learning_rate': 2.6132862160356825e-07, 'epoch': 13.13}

 82%|████████▏ | 304920/371472 [2:06:06<5:07:11,  3.61it/s]
 82%|████████▏ | 304921/371472 [2:06:06<5:24:18,  3.42it/s]
 82%|████████▏ | 304922/371472 [2:06:07<5:27:21,  3.39it/s]
 82%|████████▏ | 304923/371472 [2:06:07<5:13:48,  3.53it/s]
 82%|████████▏ | 304924/371472 [2:06:07<5:08:46,  3.59it/s]
 82%|████████▏ | 304925/371472 [2:06:07<5:03:44,  3.65it/s]
 82%|████████▏ | 304926/371472 [2:06:08<5:15:56,  3.51it/s]
 82%|████████▏ | 304927/371472 [2:06:08<5:04:31,  3.64it/s]
 82%|████████▏ | 304928/371472 [2:06:08<5:00:54,  3.69it/s]
 82%|████████▏ | 304929/371472 [2:06:08<4:54:08,  3.77it/s]
 82%|████████▏ | 304930/371472 [2:06:09<5:22:14,  3.44it/s]
 82%|████████▏ | 304931/371472 [2:06:09<5:12:50,  3.54it/s]
 82%|████████▏ | 304932/371472 [2:06:09<5:19:25,  3.47it/s]
 82%|████████▏ | 304933/371472 [2:06:10<5:22:07,  3.44it/s]
 82%|████████▏ | 304934/371472 [2:06:10<5:22:02,  3.44it/s]
 82%|████████▏ | 304935/371472 [2:06:10<5:26:51,  3.39it/s]
 82%|████████▏ | 304936/371472 [2:06:10<5:15:42,  3.51it/s]
 82%|████████▏ | 304937/371472 [2:06:11<5:20:28,  3.46it/s]
 82%|████████▏ | 304938/371472 [2:06:11<5:19:21,  3.47it/s]
 82%|████████▏ | 304939/371472 [2:06:11<5:10:36,  3.57it/s]
 82%|████████▏ | 304940/371472 [2:06:12<4:58:39,  3.71it/s]
                                                           
{'loss': 2.5749, 'learning_rate': 2.6128013962808943e-07, 'epoch': 13.13}

 82%|████████▏ | 304940/371472 [2:06:12<4:58:39,  3.71it/s]
 82%|████████▏ | 304941/371472 [2:06:12<4:57:28,  3.73it/s]
 82%|████████▏ | 304942/371472 [2:06:12<5:20:02,  3.46it/s]
 82%|████████▏ | 304943/371472 [2:06:12<5:11:23,  3.56it/s]
 82%|████████▏ | 304944/371472 [2:06:13<4:55:59,  3.75it/s]
 82%|████████▏ | 304945/371472 [2:06:13<4:57:01,  3.73it/s]
 82%|████████▏ | 304946/371472 [2:06:13<4:59:26,  3.70it/s]
 82%|████████▏ | 304947/371472 [2:06:14<5:18:41,  3.48it/s]
 82%|████████▏ | 304948/371472 [2:06:14<5:39:40,  3.26it/s]
 82%|████████▏ | 304949/371472 [2:06:14<5:24:04,  3.42it/s]
 82%|████████▏ | 304950/371472 [2:06:14<5:15:05,  3.52it/s]
 82%|████████▏ | 304951/371472 [2:06:15<5:00:21,  3.69it/s]
 82%|████████▏ | 304952/371472 [2:06:15<4:58:39,  3.71it/s]
 82%|████████▏ | 304953/371472 [2:06:15<5:10:20,  3.57it/s]
 82%|████████▏ | 304954/371472 [2:06:15<5:11:17,  3.56it/s]
 82%|████████▏ | 304955/371472 [2:06:16<5:26:45,  3.39it/s]
 82%|████████▏ | 304956/371472 [2:06:16<5:20:50,  3.46it/s]
 82%|████████▏ | 304957/371472 [2:06:16<5:09:12,  3.59it/s]
 82%|████████▏ | 304958/371472 [2:06:17<5:03:40,  3.65it/s]
 82%|████████▏ | 304959/371472 [2:06:17<4:57:17,  3.73it/s]
 82%|████████▏ | 304960/371472 [2:06:17<4:50:42,  3.81it/s]
                                                           
{'loss': 2.7047, 'learning_rate': 2.6123165765261045e-07, 'epoch': 13.14}

 82%|████████▏ | 304960/371472 [2:06:17<4:50:42,  3.81it/s]
 82%|████████▏ | 304961/371472 [2:06:17<4:51:57,  3.80it/s]
 82%|████████▏ | 304962/371472 [2:06:18<4:50:49,  3.81it/s]
 82%|████████▏ | 304963/371472 [2:06:18<4:45:59,  3.88it/s]
 82%|████████▏ | 304964/371472 [2:06:18<4:49:54,  3.82it/s]
 82%|████████▏ | 304965/371472 [2:06:18<4:45:44,  3.88it/s]
 82%|████████▏ | 304966/371472 [2:06:19<4:39:51,  3.96it/s]
 82%|████████▏ | 304967/371472 [2:06:19<4:42:31,  3.92it/s]
 82%|████████▏ | 304968/371472 [2:06:19<4:48:41,  3.84it/s]
 82%|████████▏ | 304969/371472 [2:06:19<4:54:18,  3.77it/s]
 82%|████████▏ | 304970/371472 [2:06:20<4:47:31,  3.85it/s]
 82%|████████▏ | 304971/371472 [2:06:20<4:47:35,  3.85it/s]
 82%|████████▏ | 304972/371472 [2:06:20<5:12:01,  3.55it/s]
 82%|████████▏ | 304973/371472 [2:06:21<5:10:40,  3.57it/s]
 82%|████████▏ | 304974/371472 [2:06:21<5:35:37,  3.30it/s]
 82%|████████▏ | 304975/371472 [2:06:21<5:24:12,  3.42it/s]
 82%|████████▏ | 304976/371472 [2:06:21<5:13:22,  3.54it/s]
 82%|████████▏ | 304977/371472 [2:06:22<5:02:15,  3.67it/s]
 82%|████████▏ | 304978/371472 [2:06:22<5:14:56,  3.52it/s]
 82%|████████▏ | 304979/371472 [2:06:22<5:04:54,  3.63it/s]
 82%|████████▏ | 304980/371472 [2:06:23<5:01:56,  3.67it/s]
                                                           
{'loss': 2.8053, 'learning_rate': 2.6118317567713163e-07, 'epoch': 13.14}

 82%|████████▏ | 304980/371472 [2:06:23<5:01:56,  3.67it/s]
 82%|████████▏ | 304981/371472 [2:06:23<4:54:07,  3.77it/s]
 82%|████████▏ | 304982/371472 [2:06:23<5:18:31,  3.48it/s]
 82%|████████▏ | 304983/371472 [2:06:23<5:21:23,  3.45it/s]
 82%|████████▏ | 304984/371472 [2:06:24<5:09:48,  3.58it/s]
 82%|████████▏ | 304985/371472 [2:06:24<5:07:46,  3.60it/s]
 82%|████████▏ | 304986/371472 [2:06:24<5:04:37,  3.64it/s]
 82%|████████▏ | 304987/371472 [2:06:24<4:55:32,  3.75it/s]
 82%|████████▏ | 304988/371472 [2:06:25<4:48:37,  3.84it/s]
 82%|████████▏ | 304989/371472 [2:06:25<4:45:18,  3.88it/s]
 82%|████████▏ | 304990/371472 [2:06:25<4:47:07,  3.86it/s]
 82%|████████▏ | 304991/371472 [2:06:25<4:47:13,  3.86it/s]
 82%|████████▏ | 304992/371472 [2:06:26<4:38:23,  3.98it/s]
 82%|████████▏ | 304993/371472 [2:06:26<4:39:30,  3.96it/s]
 82%|████████▏ | 304994/371472 [2:06:26<5:01:59,  3.67it/s]
 82%|████████▏ | 304995/371472 [2:06:27<4:59:10,  3.70it/s]
 82%|████████▏ | 304996/371472 [2:06:27<5:36:15,  3.29it/s]
 82%|████████▏ | 304997/371472 [2:06:27<5:27:04,  3.39it/s]
 82%|████████▏ | 304998/371472 [2:06:27<5:16:17,  3.50it/s]
 82%|████████▏ | 304999/371472 [2:06:28<5:07:49,  3.60it/s]
 82%|████████▏ | 305000/371472 [2:06:28<5:18:35,  3.48it/s]
                                                           
{'loss': 2.765, 'learning_rate': 2.6113469370165265e-07, 'epoch': 13.14}

 82%|████████▏ | 305000/371472 [2:06:28<5:18:35,  3.48it/s]
 82%|████████▏ | 305001/371472 [2:06:28<5:33:20,  3.32it/s]
 82%|████████▏ | 305002/371472 [2:06:29<5:27:17,  3.38it/s]
 82%|████████▏ | 305003/371472 [2:06:29<5:44:17,  3.22it/s]
 82%|████████▏ | 305004/371472 [2:06:29<5:46:48,  3.19it/s]
 82%|████████▏ | 305005/371472 [2:06:30<5:30:53,  3.35it/s]
 82%|████████▏ | 305006/371472 [2:06:30<5:18:58,  3.47it/s]
 82%|████████▏ | 305007/371472 [2:06:30<5:09:51,  3.58it/s]
 82%|████████▏ | 305008/371472 [2:06:30<4:58:40,  3.71it/s]
 82%|████████▏ | 305009/371472 [2:06:31<4:50:06,  3.82it/s]
 82%|████████▏ | 305010/371472 [2:06:31<4:58:22,  3.71it/s]
 82%|████████▏ | 305011/371472 [2:06:31<4:56:58,  3.73it/s]
 82%|████████▏ | 305012/371472 [2:06:31<4:48:26,  3.84it/s]
 82%|████████▏ | 305013/371472 [2:06:32<4:46:06,  3.87it/s]
 82%|████████▏ | 305014/371472 [2:06:32<4:52:04,  3.79it/s]
 82%|████████▏ | 305015/371472 [2:06:32<4:45:41,  3.88it/s]
 82%|████████▏ | 305016/371472 [2:06:32<4:49:03,  3.83it/s]
 82%|████████▏ | 305017/371472 [2:06:33<4:59:05,  3.70it/s]
 82%|████████▏ | 305018/371472 [2:06:33<5:16:55,  3.49it/s]
 82%|████████▏ | 305019/371472 [2:06:33<5:18:14,  3.48it/s]
 82%|████████▏ | 305020/371472 [2:06:34<5:07:13,  3.60it/s]
                                                           
{'loss': 2.5409, 'learning_rate': 2.610862117261738e-07, 'epoch': 13.14}

 82%|████████▏ | 305020/371472 [2:06:34<5:07:13,  3.60it/s]
 82%|████████▏ | 305021/371472 [2:06:34<5:10:50,  3.56it/s]
 82%|████████▏ | 305022/371472 [2:06:34<4:56:52,  3.73it/s]
 82%|████████▏ | 305023/371472 [2:06:34<4:53:08,  3.78it/s]
 82%|████████▏ | 305024/371472 [2:06:35<4:58:26,  3.71it/s]
 82%|████████▏ | 305025/371472 [2:06:35<5:12:10,  3.55it/s]
 82%|████████▏ | 305026/371472 [2:06:35<5:03:18,  3.65it/s]
 82%|████████▏ | 305027/371472 [2:06:35<4:51:24,  3.80it/s]
 82%|████████▏ | 305028/371472 [2:06:36<4:43:39,  3.90it/s]
 82%|████████▏ | 305029/371472 [2:06:36<4:46:45,  3.86it/s]
 82%|████████▏ | 305030/371472 [2:06:36<5:08:56,  3.58it/s]
 82%|████████▏ | 305031/371472 [2:06:37<4:57:06,  3.73it/s]
 82%|████████▏ | 305032/371472 [2:06:37<4:55:47,  3.74it/s]
 82%|████████▏ | 305033/371472 [2:06:37<4:50:22,  3.81it/s]
 82%|████████▏ | 305034/371472 [2:06:37<5:20:04,  3.46it/s]
 82%|████████▏ | 305035/371472 [2:06:38<5:09:02,  3.58it/s]
 82%|████████▏ | 305036/371472 [2:06:38<5:04:22,  3.64it/s]
 82%|████████▏ | 305037/371472 [2:06:38<5:03:49,  3.64it/s]
 82%|████████▏ | 305038/371472 [2:06:38<4:59:16,  3.70it/s]
 82%|████████▏ | 305039/371472 [2:06:39<4:51:39,  3.80it/s]
 82%|████████▏ | 305040/371472 [2:06:39<4:54:47,  3.76it/s]
                                                           
{'loss': 2.5443, 'learning_rate': 2.610377297506949e-07, 'epoch': 13.14}

 82%|████████▏ | 305040/371472 [2:06:39<4:54:47,  3.76it/s]
 82%|████████▏ | 305041/371472 [2:06:39<5:03:23,  3.65it/s]
 82%|████████▏ | 305042/371472 [2:06:40<4:54:50,  3.76it/s]
 82%|████████▏ | 305043/371472 [2:06:40<4:52:41,  3.78it/s]
 82%|████████▏ | 305044/371472 [2:06:40<4:42:56,  3.91it/s]
 82%|████████▏ | 305045/371472 [2:06:40<4:51:59,  3.79it/s]
 82%|████████▏ | 305046/371472 [2:06:41<5:12:54,  3.54it/s]
 82%|████████▏ | 305047/371472 [2:06:41<5:32:20,  3.33it/s]
 82%|████████▏ | 305048/371472 [2:06:41<5:41:59,  3.24it/s]
 82%|████████▏ | 305049/371472 [2:06:42<5:25:43,  3.40it/s]
 82%|████████▏ | 305050/371472 [2:06:42<5:44:31,  3.21it/s]
 82%|████████▏ | 305051/371472 [2:06:42<5:33:12,  3.32it/s]
 82%|████████▏ | 305052/371472 [2:06:42<5:29:29,  3.36it/s]
 82%|████████▏ | 305053/371472 [2:06:43<5:15:26,  3.51it/s]
 82%|████████▏ | 305054/371472 [2:06:43<4:59:25,  3.70it/s]
 82%|████████▏ | 305055/371472 [2:06:43<5:21:59,  3.44it/s]
 82%|████████▏ | 305056/371472 [2:06:44<5:09:37,  3.58it/s]
 82%|████████▏ | 305057/371472 [2:06:44<5:03:35,  3.65it/s]
 82%|████████▏ | 305058/371472 [2:06:44<5:05:32,  3.62it/s]
 82%|████████▏ | 305059/371472 [2:06:44<5:16:52,  3.49it/s]
 82%|████████▏ | 305060/371472 [2:06:45<5:21:33,  3.44it/s]
                                                           
{'loss': 2.5643, 'learning_rate': 2.6098924777521607e-07, 'epoch': 13.14}

 82%|████████▏ | 305060/371472 [2:06:45<5:21:33,  3.44it/s]
 82%|████████▏ | 305061/371472 [2:06:45<5:28:52,  3.37it/s]
 82%|████████▏ | 305062/371472 [2:06:45<5:20:36,  3.45it/s]
 82%|████████▏ | 305063/371472 [2:06:46<5:24:01,  3.42it/s]
 82%|████████▏ | 305064/371472 [2:06:46<5:39:33,  3.26it/s]
 82%|████████▏ | 305065/371472 [2:06:46<5:36:34,  3.29it/s]
 82%|████████▏ | 305066/371472 [2:06:47<5:36:12,  3.29it/s]
 82%|████████▏ | 305067/371472 [2:06:47<5:35:57,  3.29it/s]
 82%|████████▏ | 305068/371472 [2:06:47<5:49:19,  3.17it/s]
 82%|████████▏ | 305069/371472 [2:06:47<5:43:54,  3.22it/s]
 82%|████████▏ | 305070/371472 [2:06:48<5:33:18,  3.32it/s]
 82%|████████▏ | 305071/371472 [2:06:48<5:12:32,  3.54it/s]
 82%|████████▏ | 305072/371472 [2:06:48<5:04:52,  3.63it/s]
 82%|████████▏ | 305073/371472 [2:06:49<5:08:32,  3.59it/s]
 82%|████████▏ | 305074/371472 [2:06:49<5:03:16,  3.65it/s]
 82%|████████▏ | 305075/371472 [2:06:49<4:59:11,  3.70it/s]
 82%|████████▏ | 305076/371472 [2:06:49<5:05:37,  3.62it/s]
 82%|████████▏ | 305077/371472 [2:06:50<5:02:19,  3.66it/s]
 82%|████████▏ | 305078/371472 [2:06:50<5:06:49,  3.61it/s]
 82%|████████▏ | 305079/371472 [2:06:50<5:02:38,  3.66it/s]
 82%|████████▏ | 305080/371472 [2:06:51<5:26:09,  3.39it/s]
                                                           
{'loss': 2.837, 'learning_rate': 2.609407657997371e-07, 'epoch': 13.14}

 82%|████████▏ | 305080/371472 [2:06:51<5:26:09,  3.39it/s]
 82%|████████▏ | 305081/371472 [2:06:51<5:31:02,  3.34it/s]
 82%|████████▏ | 305082/371472 [2:06:51<5:34:13,  3.31it/s]
 82%|████████▏ | 305083/371472 [2:06:51<5:09:56,  3.57it/s]
 82%|████████▏ | 305084/371472 [2:06:52<5:12:49,  3.54it/s]
 82%|████████▏ | 305085/371472 [2:06:52<5:07:22,  3.60it/s]
 82%|████████▏ | 305086/371472 [2:06:52<5:21:11,  3.44it/s]
 82%|████████▏ | 305087/371472 [2:06:53<5:21:13,  3.44it/s]
 82%|████████▏ | 305088/371472 [2:06:53<5:24:29,  3.41it/s]
 82%|████████▏ | 305089/371472 [2:06:53<5:22:17,  3.43it/s]
 82%|████████▏ | 305090/371472 [2:06:53<5:16:35,  3.49it/s]
 82%|████████▏ | 305091/371472 [2:06:54<5:23:14,  3.42it/s]
 82%|████████▏ | 305092/371472 [2:06:54<5:23:21,  3.42it/s]
 82%|████████▏ | 305093/371472 [2:06:54<5:18:24,  3.47it/s]
 82%|████████▏ | 305094/371472 [2:06:55<5:22:53,  3.43it/s]
 82%|████████▏ | 305095/371472 [2:06:55<5:08:58,  3.58it/s]
 82%|████████▏ | 305096/371472 [2:06:55<6:09:44,  2.99it/s]
 82%|████████▏ | 305097/371472 [2:06:56<6:06:46,  3.02it/s]
 82%|████████▏ | 305098/371472 [2:06:56<5:56:41,  3.10it/s]
 82%|████████▏ | 305099/371472 [2:06:56<5:43:33,  3.22it/s]
 82%|████████▏ | 305100/371472 [2:06:56<5:28:17,  3.37it/s]
                                                           
{'loss': 2.5216, 'learning_rate': 2.6089228382425827e-07, 'epoch': 13.14}

 82%|████████▏ | 305100/371472 [2:06:56<5:28:17,  3.37it/s]
 82%|████████▏ | 305101/371472 [2:06:57<5:13:11,  3.53it/s]
 82%|████████▏ | 305102/371472 [2:06:57<5:10:09,  3.57it/s]
 82%|████████▏ | 305103/371472 [2:06:57<5:14:28,  3.52it/s]
 82%|████████▏ | 305104/371472 [2:06:58<5:15:37,  3.50it/s]
 82%|████████▏ | 305105/371472 [2:06:58<5:04:58,  3.63it/s]
 82%|████████▏ | 305106/371472 [2:06:58<5:10:20,  3.56it/s]
 82%|████████▏ | 305107/371472 [2:06:58<5:07:15,  3.60it/s]
 82%|████████▏ | 305108/371472 [2:06:59<5:02:02,  3.66it/s]
 82%|████████▏ | 305109/371472 [2:06:59<5:10:06,  3.57it/s]
 82%|████████▏ | 305110/371472 [2:06:59<5:04:28,  3.63it/s]
 82%|████████▏ | 305111/371472 [2:06:59<4:57:11,  3.72it/s]
 82%|████████▏ | 305112/371472 [2:07:00<5:27:27,  3.38it/s]
 82%|████████▏ | 305113/371472 [2:07:00<5:59:33,  3.08it/s]
 82%|████████▏ | 305114/371472 [2:07:01<5:47:57,  3.18it/s]
 82%|████████▏ | 305115/371472 [2:07:01<5:25:25,  3.40it/s]
 82%|████████▏ | 305116/371472 [2:07:01<5:05:31,  3.62it/s]
 82%|████████▏ | 305117/371472 [2:07:01<5:01:11,  3.67it/s]
 82%|████████▏ | 305118/371472 [2:07:02<4:54:38,  3.75it/s]
 82%|████████▏ | 305119/371472 [2:07:02<6:09:36,  2.99it/s]
 82%|████████▏ | 305120/371472 [2:07:02<5:47:15,  3.18it/s]
                                                           
{'loss': 2.5768, 'learning_rate': 2.608438018487793e-07, 'epoch': 13.14}

 82%|████████▏ | 305120/371472 [2:07:02<5:47:15,  3.18it/s]
 82%|████████▏ | 305121/371472 [2:07:03<5:52:15,  3.14it/s]
 82%|████████▏ | 305122/371472 [2:07:03<5:44:25,  3.21it/s]
 82%|████████▏ | 305123/371472 [2:07:03<5:19:21,  3.46it/s]
 82%|████████▏ | 305124/371472 [2:07:03<5:07:26,  3.60it/s]
 82%|████████▏ | 305125/371472 [2:07:04<6:04:42,  3.03it/s]
 82%|████████▏ | 305126/371472 [2:07:04<5:45:29,  3.20it/s]
 82%|████████▏ | 305127/371472 [2:07:04<5:35:53,  3.29it/s]
 82%|████████▏ | 305128/371472 [2:07:05<5:28:30,  3.37it/s]
 82%|████████▏ | 305129/371472 [2:07:05<5:35:53,  3.29it/s]
 82%|████████▏ | 305130/371472 [2:07:05<5:23:42,  3.42it/s]
 82%|████████▏ | 305131/371472 [2:07:06<5:20:28,  3.45it/s]
 82%|████████▏ | 305132/371472 [2:07:06<5:23:27,  3.42it/s]
 82%|████████▏ | 305133/371472 [2:07:06<5:34:35,  3.30it/s]
 82%|████████▏ | 305134/371472 [2:07:07<5:47:16,  3.18it/s]
 82%|████████▏ | 305135/371472 [2:07:07<5:57:08,  3.10it/s]
 82%|████████▏ | 305136/371472 [2:07:07<5:41:45,  3.24it/s]
 82%|████████▏ | 305137/371472 [2:07:07<5:27:07,  3.38it/s]
 82%|████████▏ | 305138/371472 [2:07:08<5:16:25,  3.49it/s]
 82%|████████▏ | 305139/371472 [2:07:08<5:25:18,  3.40it/s]
 82%|████████▏ | 305140/371472 [2:07:08<5:05:46,  3.62it/s]
                                                           
{'loss': 2.6189, 'learning_rate': 2.6079531987330036e-07, 'epoch': 13.14}

 82%|████████▏ | 305140/371472 [2:07:08<5:05:46,  3.62it/s]
 82%|████████▏ | 305141/371472 [2:07:08<5:00:55,  3.67it/s]
 82%|████████▏ | 305142/371472 [2:07:09<6:08:05,  3.00it/s]
 82%|████████▏ | 305143/371472 [2:07:09<5:55:24,  3.11it/s]
 82%|████████▏ | 305144/371472 [2:07:10<5:41:27,  3.24it/s]
 82%|████████▏ | 305145/371472 [2:07:10<5:40:30,  3.25it/s]
 82%|████████▏ | 305146/371472 [2:07:10<5:23:40,  3.42it/s]
 82%|████████▏ | 305147/371472 [2:07:10<5:11:36,  3.55it/s]
 82%|████████▏ | 305148/371472 [2:07:11<6:34:04,  2.81it/s]
 82%|████████▏ | 305149/371472 [2:07:11<6:06:32,  3.02it/s]
 82%|████████▏ | 305150/371472 [2:07:11<5:50:59,  3.15it/s]
 82%|████████▏ | 305151/371472 [2:07:12<5:27:05,  3.38it/s]
 82%|████████▏ | 305152/371472 [2:07:12<5:20:23,  3.45it/s]
 82%|████████▏ | 305153/371472 [2:07:12<5:21:17,  3.44it/s]
 82%|████████▏ | 305154/371472 [2:07:13<5:29:21,  3.36it/s]
 82%|████████▏ | 305155/371472 [2:07:13<5:11:45,  3.55it/s]
 82%|████████▏ | 305156/371472 [2:07:13<5:11:24,  3.55it/s]
 82%|████████▏ | 305157/371472 [2:07:13<5:14:33,  3.51it/s]
 82%|████████▏ | 305158/371472 [2:07:14<5:08:41,  3.58it/s]
 82%|████████▏ | 305159/371472 [2:07:14<4:56:28,  3.73it/s]
 82%|████████▏ | 305160/371472 [2:07:14<5:25:08,  3.40it/s]
                                                           
{'loss': 2.6443, 'learning_rate': 2.6074683789782154e-07, 'epoch': 13.14}

 82%|████████▏ | 305160/371472 [2:07:14<5:25:08,  3.40it/s]
 82%|████████▏ | 305161/371472 [2:07:15<5:36:39,  3.28it/s]
 82%|████████▏ | 305162/371472 [2:07:15<5:42:05,  3.23it/s]
 82%|████████▏ | 305163/371472 [2:07:15<5:22:21,  3.43it/s]
 82%|████████▏ | 305164/371472 [2:07:15<5:17:56,  3.48it/s]
 82%|████████▏ | 305165/371472 [2:07:16<5:03:45,  3.64it/s]
 82%|████████▏ | 305166/371472 [2:07:16<5:07:38,  3.59it/s]
 82%|████████▏ | 305167/371472 [2:07:16<5:18:03,  3.47it/s]
 82%|████████▏ | 305168/371472 [2:07:16<5:02:13,  3.66it/s]
 82%|████████▏ | 305169/371472 [2:07:17<4:49:16,  3.82it/s]
 82%|████████▏ | 305170/371472 [2:07:17<4:46:54,  3.85it/s]
 82%|████████▏ | 305171/371472 [2:07:17<5:04:25,  3.63it/s]
 82%|████████▏ | 305172/371472 [2:07:18<5:40:02,  3.25it/s]
 82%|████████▏ | 305173/371472 [2:07:18<5:41:58,  3.23it/s]
 82%|████████▏ | 305174/371472 [2:07:18<5:27:07,  3.38it/s]
 82%|████████▏ | 305175/371472 [2:07:19<5:12:26,  3.54it/s]
 82%|████████▏ | 305176/371472 [2:07:19<5:10:27,  3.56it/s]
 82%|████████▏ | 305177/371472 [2:07:19<4:58:57,  3.70it/s]
 82%|████████▏ | 305178/371472 [2:07:19<4:52:37,  3.78it/s]
 82%|████████▏ | 305179/371472 [2:07:20<4:46:59,  3.85it/s]
 82%|████████▏ | 305180/371472 [2:07:20<4:50:54,  3.80it/s]
                                                           
{'loss': 2.817, 'learning_rate': 2.606983559223426e-07, 'epoch': 13.14}

 82%|████████▏ | 305180/371472 [2:07:20<4:50:54,  3.80it/s]
 82%|████████▏ | 305181/371472 [2:07:20<5:14:11,  3.52it/s]
 82%|████████▏ | 305182/371472 [2:07:20<5:14:55,  3.51it/s]
 82%|████████▏ | 305183/371472 [2:07:21<5:05:51,  3.61it/s]
 82%|████████▏ | 305184/371472 [2:07:21<5:20:45,  3.44it/s]
 82%|████████▏ | 305185/371472 [2:07:21<5:27:43,  3.37it/s]
 82%|████████▏ | 305186/371472 [2:07:22<5:20:47,  3.44it/s]
 82%|████████▏ | 305187/371472 [2:07:22<5:10:22,  3.56it/s]
 82%|████████▏ | 305188/371472 [2:07:22<5:08:26,  3.58it/s]
 82%|████████▏ | 305189/371472 [2:07:22<4:58:33,  3.70it/s]
 82%|████████▏ | 305190/371472 [2:07:23<5:12:27,  3.54it/s]
 82%|████████▏ | 305191/371472 [2:07:23<5:12:53,  3.53it/s]
 82%|████████▏ | 305192/371472 [2:07:23<4:58:29,  3.70it/s]
 82%|████████▏ | 305193/371472 [2:07:23<5:04:40,  3.63it/s]
 82%|████████▏ | 305194/371472 [2:07:24<5:08:01,  3.59it/s]
 82%|████████▏ | 305195/371472 [2:07:24<5:02:43,  3.65it/s]
 82%|████████▏ | 305196/371472 [2:07:24<4:50:27,  3.80it/s]
 82%|████████▏ | 305197/371472 [2:07:25<5:01:34,  3.66it/s]
 82%|████████▏ | 305198/371472 [2:07:25<5:07:04,  3.60it/s]
 82%|████████▏ | 305199/371472 [2:07:25<5:17:14,  3.48it/s]
 82%|████████▏ | 305200/371472 [2:07:25<5:13:03,  3.53it/s]
                                                           
{'loss': 2.6411, 'learning_rate': 2.606498739468638e-07, 'epoch': 13.15}

 82%|████████▏ | 305200/371472 [2:07:25<5:13:03,  3.53it/s]
 82%|████████▏ | 305201/371472 [2:07:26<5:20:13,  3.45it/s]
 82%|████████▏ | 305202/371472 [2:07:26<5:21:41,  3.43it/s]
 82%|████████▏ | 305203/371472 [2:07:26<5:19:15,  3.46it/s]
 82%|████████▏ | 305204/371472 [2:07:27<5:09:27,  3.57it/s]
 82%|████████▏ | 305205/371472 [2:07:27<5:10:11,  3.56it/s]
 82%|████████▏ | 305206/371472 [2:07:27<5:03:28,  3.64it/s]
 82%|████████▏ | 305207/371472 [2:07:27<4:56:25,  3.73it/s]
 82%|████████▏ | 305208/371472 [2:07:28<4:51:59,  3.78it/s]
 82%|████████▏ | 305209/371472 [2:07:28<5:06:18,  3.61it/s]
 82%|████████▏ | 305210/371472 [2:07:28<5:01:47,  3.66it/s]
 82%|████████▏ | 305211/371472 [2:07:29<5:05:21,  3.62it/s]
 82%|████████▏ | 305212/371472 [2:07:29<5:07:53,  3.59it/s]
 82%|████████▏ | 305213/371472 [2:07:29<5:10:51,  3.55it/s]
 82%|████████▏ | 305214/371472 [2:07:29<5:19:34,  3.46it/s]
 82%|████████▏ | 305215/371472 [2:07:30<5:02:21,  3.65it/s]
 82%|████████▏ | 305216/371472 [2:07:30<4:57:15,  3.71it/s]
 82%|████████▏ | 305217/371472 [2:07:30<5:00:17,  3.68it/s]
 82%|████████▏ | 305218/371472 [2:07:30<5:05:04,  3.62it/s]
 82%|████████▏ | 305219/371472 [2:07:31<4:58:05,  3.70it/s]
 82%|████████▏ | 305220/371472 [2:07:31<5:02:32,  3.65it/s]
                                                           
{'loss': 2.5729, 'learning_rate': 2.606013919713848e-07, 'epoch': 13.15}

 82%|████████▏ | 305220/371472 [2:07:31<5:02:32,  3.65it/s]
 82%|████████▏ | 305221/371472 [2:07:31<5:16:07,  3.49it/s]
 82%|████████▏ | 305222/371472 [2:07:32<5:22:58,  3.42it/s]
 82%|████████▏ | 305223/371472 [2:07:32<5:11:16,  3.55it/s]
 82%|████████▏ | 305224/371472 [2:07:32<4:59:26,  3.69it/s]
 82%|████████▏ | 305225/371472 [2:07:32<5:02:53,  3.65it/s]
 82%|████████▏ | 305226/371472 [2:07:33<4:55:35,  3.74it/s]
 82%|████████▏ | 305227/371472 [2:07:33<5:01:22,  3.66it/s]
 82%|████████▏ | 305228/371472 [2:07:33<5:13:07,  3.53it/s]
 82%|████████▏ | 305229/371472 [2:07:34<5:07:41,  3.59it/s]
 82%|████████▏ | 305230/371472 [2:07:34<5:25:38,  3.39it/s]
 82%|████████▏ | 305231/371472 [2:07:34<5:27:37,  3.37it/s]
 82%|████████▏ | 305232/371472 [2:07:34<5:18:00,  3.47it/s]
 82%|████████▏ | 305233/371472 [2:07:35<6:42:49,  2.74it/s]
 82%|████████▏ | 305234/371472 [2:07:35<6:07:20,  3.01it/s]
 82%|████████▏ | 305235/371472 [2:07:36<5:55:57,  3.10it/s]
 82%|████████▏ | 305236/371472 [2:07:36<5:59:05,  3.07it/s]
 82%|████████▏ | 305237/371472 [2:07:36<5:48:17,  3.17it/s]
 82%|████████▏ | 305238/371472 [2:07:36<5:27:46,  3.37it/s]
 82%|████████▏ | 305239/371472 [2:07:37<5:23:28,  3.41it/s]
 82%|████████▏ | 305240/371472 [2:07:37<5:15:23,  3.50it/s]
                                                           
{'loss': 2.7698, 'learning_rate': 2.60552909995906e-07, 'epoch': 13.15}

 82%|████████▏ | 305240/371472 [2:07:37<5:15:23,  3.50it/s]
 82%|████████▏ | 305241/371472 [2:07:37<5:07:24,  3.59it/s]
 82%|████████▏ | 305242/371472 [2:07:37<5:01:26,  3.66it/s]
 82%|████████▏ | 305243/371472 [2:07:38<4:50:53,  3.79it/s]
 82%|████████▏ | 305244/371472 [2:07:38<4:45:43,  3.86it/s]
 82%|████████▏ | 305245/371472 [2:07:38<4:40:16,  3.94it/s]
 82%|████████▏ | 305246/371472 [2:07:38<4:45:40,  3.86it/s]
 82%|████████▏ | 305247/371472 [2:07:39<5:08:06,  3.58it/s]
 82%|████████▏ | 305248/371472 [2:07:39<5:26:21,  3.38it/s]
 82%|████████▏ | 305249/371472 [2:07:39<5:16:44,  3.48it/s]
 82%|████████▏ | 305250/371472 [2:07:40<5:06:07,  3.61it/s]
 82%|████████▏ | 305251/371472 [2:07:40<5:21:53,  3.43it/s]
 82%|████████▏ | 305252/371472 [2:07:40<5:08:30,  3.58it/s]
 82%|████████▏ | 305253/371472 [2:07:41<5:16:49,  3.48it/s]
 82%|████████▏ | 305254/371472 [2:07:41<5:33:30,  3.31it/s]
 82%|████████▏ | 305255/371472 [2:07:41<5:20:57,  3.44it/s]
 82%|████████▏ | 305256/371472 [2:07:41<5:18:47,  3.46it/s]
 82%|████████▏ | 305257/371472 [2:07:42<5:11:28,  3.54it/s]
 82%|████████▏ | 305258/371472 [2:07:42<4:59:11,  3.69it/s]
 82%|████████▏ | 305259/371472 [2:07:42<4:53:15,  3.76it/s]
 82%|████████▏ | 305260/371472 [2:07:42<4:55:45,  3.73it/s]
                                                           
{'loss': 2.53, 'learning_rate': 2.60504428020427e-07, 'epoch': 13.15}

 82%|████████▏ | 305260/371472 [2:07:42<4:55:45,  3.73it/s]
 82%|████████▏ | 305261/371472 [2:07:43<4:49:36,  3.81it/s]
 82%|████████▏ | 305262/371472 [2:07:43<4:47:59,  3.83it/s]
 82%|████████▏ | 305263/371472 [2:07:43<5:06:51,  3.60it/s]
 82%|████████▏ | 305264/371472 [2:07:44<4:58:51,  3.69it/s]
 82%|████████▏ | 305265/371472 [2:07:44<4:58:02,  3.70it/s]
 82%|████████▏ | 305266/371472 [2:07:44<5:18:09,  3.47it/s]
 82%|████████▏ | 305267/371472 [2:07:44<5:07:19,  3.59it/s]
 82%|████████▏ | 305268/371472 [2:07:45<4:58:40,  3.69it/s]
 82%|████████▏ | 305269/371472 [2:07:45<4:54:12,  3.75it/s]
 82%|████████▏ | 305270/371472 [2:07:45<5:10:12,  3.56it/s]
 82%|████████▏ | 305271/371472 [2:07:45<4:55:01,  3.74it/s]
 82%|████████▏ | 305272/371472 [2:07:46<4:47:26,  3.84it/s]
 82%|████████▏ | 305273/371472 [2:07:46<4:58:24,  3.70it/s]
 82%|████████▏ | 305274/371472 [2:07:46<5:43:10,  3.22it/s]
 82%|████████▏ | 305275/371472 [2:07:47<5:56:08,  3.10it/s]
 82%|████████▏ | 305276/371472 [2:07:47<5:30:36,  3.34it/s]
 82%|████████▏ | 305277/371472 [2:07:47<5:41:47,  3.23it/s]
 82%|████████▏ | 305278/371472 [2:07:48<5:55:42,  3.10it/s]
 82%|████████▏ | 305279/371472 [2:07:48<5:32:34,  3.32it/s]
 82%|████████▏ | 305280/371472 [2:07:48<5:11:34,  3.54it/s]
                                                           
{'loss': 2.6859, 'learning_rate': 2.604559460449482e-07, 'epoch': 13.15}

 82%|████████▏ | 305280/371472 [2:07:48<5:11:34,  3.54it/s]
 82%|████████▏ | 305281/371472 [2:07:48<5:16:19,  3.49it/s]
 82%|████████▏ | 305282/371472 [2:07:49<5:11:43,  3.54it/s]
 82%|████████▏ | 305283/371472 [2:07:49<5:16:49,  3.48it/s]
 82%|████████▏ | 305284/371472 [2:07:49<5:08:11,  3.58it/s]
 82%|████████▏ | 305285/371472 [2:07:50<5:21:16,  3.43it/s]
 82%|████████▏ | 305286/371472 [2:07:50<5:16:38,  3.48it/s]
 82%|████████▏ | 305287/371472 [2:07:50<5:15:34,  3.50it/s]
 82%|████████▏ | 305288/371472 [2:07:51<5:37:45,  3.27it/s]
 82%|████████▏ | 305289/371472 [2:07:51<5:39:38,  3.25it/s]
 82%|████████▏ | 305290/371472 [2:07:51<5:26:39,  3.38it/s]
 82%|████████▏ | 305291/371472 [2:07:51<5:13:47,  3.52it/s]
 82%|████████▏ | 305292/371472 [2:07:52<5:34:30,  3.30it/s]
 82%|████████▏ | 305293/371472 [2:07:52<5:19:41,  3.45it/s]
 82%|████████▏ | 305294/371472 [2:07:52<5:08:45,  3.57it/s]
 82%|████████▏ | 305295/371472 [2:07:52<4:56:20,  3.72it/s]
 82%|████████▏ | 305296/371472 [2:07:53<4:50:13,  3.80it/s]
 82%|████████▏ | 305297/371472 [2:07:53<4:50:32,  3.80it/s]
 82%|████████▏ | 305298/371472 [2:07:53<4:49:59,  3.80it/s]
 82%|████████▏ | 305299/371472 [2:07:53<4:47:08,  3.84it/s]
 82%|████████▏ | 305300/371472 [2:07:54<4:47:58,  3.83it/s]
                                                           
{'loss': 2.6277, 'learning_rate': 2.6040746406946925e-07, 'epoch': 13.15}

 82%|████████▏ | 305300/371472 [2:07:54<4:47:58,  3.83it/s]
 82%|████████▏ | 305301/371472 [2:07:54<4:51:04,  3.79it/s]
 82%|████████▏ | 305302/371472 [2:07:54<4:48:26,  3.82it/s]
 82%|████████▏ | 305303/371472 [2:07:55<4:41:40,  3.92it/s]
 82%|████████▏ | 305304/371472 [2:07:55<4:42:13,  3.91it/s]
 82%|████████▏ | 305305/371472 [2:07:55<4:43:34,  3.89it/s]
 82%|████████▏ | 305306/371472 [2:07:55<4:44:08,  3.88it/s]
 82%|████████▏ | 305307/371472 [2:07:56<4:44:23,  3.88it/s]
 82%|████████▏ | 305308/371472 [2:07:56<4:46:32,  3.85it/s]
 82%|████████▏ | 305309/371472 [2:07:56<4:59:43,  3.68it/s]
 82%|████████▏ | 305310/371472 [2:07:56<5:00:02,  3.68it/s]
 82%|████████▏ | 305311/371472 [2:07:57<5:28:09,  3.36it/s]
 82%|████████▏ | 305312/371472 [2:07:57<5:26:58,  3.37it/s]
 82%|████████▏ | 305313/371472 [2:07:57<5:53:07,  3.12it/s]
 82%|████████▏ | 305314/371472 [2:07:58<5:38:18,  3.26it/s]
 82%|████████▏ | 305315/371472 [2:07:58<5:27:27,  3.37it/s]
 82%|████████▏ | 305316/371472 [2:07:58<5:09:29,  3.56it/s]
 82%|████████▏ | 305317/371472 [2:07:59<5:16:57,  3.48it/s]
 82%|████████▏ | 305318/371472 [2:07:59<5:06:20,  3.60it/s]
 82%|████████▏ | 305319/371472 [2:07:59<5:08:39,  3.57it/s]
 82%|████████▏ | 305320/371472 [2:07:59<5:14:27,  3.51it/s]
                                                           
{'loss': 2.6258, 'learning_rate': 2.603589820939904e-07, 'epoch': 13.15}

 82%|████████▏ | 305320/371472 [2:07:59<5:14:27,  3.51it/s]
 82%|████████▏ | 305321/371472 [2:08:00<5:12:55,  3.52it/s]
 82%|████████▏ | 305322/371472 [2:08:00<5:21:54,  3.42it/s]
 82%|████████▏ | 305323/371472 [2:08:00<5:28:03,  3.36it/s]
 82%|████████▏ | 305324/371472 [2:08:01<5:17:59,  3.47it/s]
 82%|████████▏ | 305325/371472 [2:08:01<5:36:59,  3.27it/s]
 82%|████████▏ | 305326/371472 [2:08:01<5:46:27,  3.18it/s]
 82%|████████▏ | 305327/371472 [2:08:02<5:56:44,  3.09it/s]
 82%|████████▏ | 305328/371472 [2:08:02<5:35:23,  3.29it/s]
 82%|████████▏ | 305329/371472 [2:08:02<5:47:48,  3.17it/s]
 82%|████████▏ | 305330/371472 [2:08:02<5:31:04,  3.33it/s]
 82%|████████▏ | 305331/371472 [2:08:03<5:10:01,  3.56it/s]
 82%|████████▏ | 305332/371472 [2:08:03<5:02:42,  3.64it/s]
 82%|████████▏ | 305333/371472 [2:08:03<5:06:33,  3.60it/s]
 82%|████████▏ | 305334/371472 [2:08:03<4:58:47,  3.69it/s]
 82%|████████▏ | 305335/371472 [2:08:04<4:56:24,  3.72it/s]
 82%|████████▏ | 305336/371472 [2:08:04<5:09:34,  3.56it/s]
 82%|████████▏ | 305337/371472 [2:08:04<4:57:01,  3.71it/s]
 82%|████████▏ | 305338/371472 [2:08:05<5:04:48,  3.62it/s]
 82%|████████▏ | 305339/371472 [2:08:05<5:27:23,  3.37it/s]
 82%|████████▏ | 305340/371472 [2:08:05<5:21:33,  3.43it/s]
                                                           
{'loss': 2.5243, 'learning_rate': 2.6031050011851144e-07, 'epoch': 13.15}

 82%|████████▏ | 305340/371472 [2:08:05<5:21:33,  3.43it/s]
 82%|████████▏ | 305341/371472 [2:08:05<5:06:04,  3.60it/s]
 82%|████████▏ | 305342/371472 [2:08:06<5:12:25,  3.53it/s]
 82%|████████▏ | 305343/371472 [2:08:06<5:40:28,  3.24it/s]
 82%|████████▏ | 305344/371472 [2:08:06<5:25:28,  3.39it/s]
 82%|████████▏ | 305345/371472 [2:08:07<5:14:27,  3.50it/s]
 82%|████████▏ | 305346/371472 [2:08:07<5:05:10,  3.61it/s]
 82%|████████▏ | 305347/371472 [2:08:07<5:08:16,  3.58it/s]
 82%|████████▏ | 305348/371472 [2:08:07<5:14:23,  3.51it/s]
 82%|████████▏ | 305349/371472 [2:08:08<5:15:24,  3.49it/s]
 82%|████████▏ | 305350/371472 [2:08:08<5:02:33,  3.64it/s]
 82%|████████▏ | 305351/371472 [2:08:08<5:39:24,  3.25it/s]
 82%|████████▏ | 305352/371472 [2:08:09<5:35:39,  3.28it/s]
 82%|████████▏ | 305353/371472 [2:08:09<5:32:12,  3.32it/s]
 82%|████████▏ | 305354/371472 [2:08:09<5:28:02,  3.36it/s]
 82%|████████▏ | 305355/371472 [2:08:10<5:38:37,  3.25it/s]
 82%|████████▏ | 305356/371472 [2:08:10<5:34:41,  3.29it/s]
 82%|████████▏ | 305357/371472 [2:08:10<5:32:19,  3.32it/s]
 82%|████████▏ | 305358/371472 [2:08:10<5:18:34,  3.46it/s]
 82%|████████▏ | 305359/371472 [2:08:11<5:22:07,  3.42it/s]
 82%|████████▏ | 305360/371472 [2:08:11<5:16:44,  3.48it/s]
                                                           
{'loss': 2.548, 'learning_rate': 2.602620181430326e-07, 'epoch': 13.15}

 82%|████████▏ | 305360/371472 [2:08:11<5:16:44,  3.48it/s]
 82%|████████▏ | 305361/371472 [2:08:11<5:32:11,  3.32it/s]
 82%|████████▏ | 305362/371472 [2:08:12<5:20:18,  3.44it/s]
 82%|████████▏ | 305363/371472 [2:08:12<5:07:39,  3.58it/s]
 82%|████████▏ | 305364/371472 [2:08:12<4:58:24,  3.69it/s]
 82%|████████▏ | 305365/371472 [2:08:12<4:49:53,  3.80it/s]
 82%|████████▏ | 305366/371472 [2:08:13<5:10:18,  3.55it/s]
 82%|████████▏ | 305367/371472 [2:08:13<5:08:22,  3.57it/s]
 82%|████████▏ | 305368/371472 [2:08:13<4:54:20,  3.74it/s]
 82%|████████▏ | 305369/371472 [2:08:13<4:58:29,  3.69it/s]
 82%|████████▏ | 305370/371472 [2:08:14<4:54:41,  3.74it/s]
 82%|████████▏ | 305371/371472 [2:08:14<4:48:32,  3.82it/s]
 82%|████████▏ | 305372/371472 [2:08:14<4:50:32,  3.79it/s]
 82%|████████▏ | 305373/371472 [2:08:15<5:01:58,  3.65it/s]
 82%|████████▏ | 305374/371472 [2:08:15<5:02:08,  3.65it/s]
 82%|████████▏ | 305375/371472 [2:08:15<5:13:46,  3.51it/s]
 82%|████████▏ | 305376/371472 [2:08:15<5:13:03,  3.52it/s]
 82%|████████▏ | 305377/371472 [2:08:16<5:00:34,  3.66it/s]
 82%|████████▏ | 305378/371472 [2:08:16<4:57:34,  3.70it/s]
 82%|████████▏ | 305379/371472 [2:08:16<4:58:48,  3.69it/s]
 82%|████████▏ | 305380/371472 [2:08:16<4:52:09,  3.77it/s]
                                                           
{'loss': 2.5161, 'learning_rate': 2.6021353616755364e-07, 'epoch': 13.15}

 82%|████████▏ | 305380/371472 [2:08:16<4:52:09,  3.77it/s]
 82%|████████▏ | 305381/371472 [2:08:17<4:55:30,  3.73it/s]
 82%|████████▏ | 305382/371472 [2:08:17<5:02:10,  3.65it/s]
 82%|████████▏ | 305383/371472 [2:08:17<5:18:08,  3.46it/s]
 82%|████████▏ | 305384/371472 [2:08:18<5:20:00,  3.44it/s]
 82%|████████▏ | 305385/371472 [2:08:18<5:12:51,  3.52it/s]
 82%|████████▏ | 305386/371472 [2:08:18<5:23:51,  3.40it/s]
 82%|████████▏ | 305387/371472 [2:08:19<5:27:48,  3.36it/s]
 82%|████████▏ | 305388/371472 [2:08:19<5:17:50,  3.47it/s]
 82%|████████▏ | 305389/371472 [2:08:19<5:39:25,  3.24it/s]
 82%|████████▏ | 305390/371472 [2:08:19<5:23:21,  3.41it/s]
 82%|████████▏ | 305391/371472 [2:08:20<5:16:35,  3.48it/s]
 82%|████████▏ | 305392/371472 [2:08:20<5:06:44,  3.59it/s]
 82%|████████▏ | 305393/371472 [2:08:20<5:04:36,  3.62it/s]
 82%|████████▏ | 305394/371472 [2:08:21<5:05:46,  3.60it/s]
 82%|████████▏ | 305395/371472 [2:08:21<5:19:21,  3.45it/s]
 82%|████████▏ | 305396/371472 [2:08:21<5:35:27,  3.28it/s]
 82%|████████▏ | 305397/371472 [2:08:21<5:26:08,  3.38it/s]
 82%|████████▏ | 305398/371472 [2:08:22<5:18:04,  3.46it/s]
 82%|████████▏ | 305399/371472 [2:08:22<5:03:46,  3.63it/s]
 82%|████████▏ | 305400/371472 [2:08:22<4:57:52,  3.70it/s]
                                                           
{'loss': 2.6547, 'learning_rate': 2.601650541920748e-07, 'epoch': 13.15}

 82%|████████▏ | 305400/371472 [2:08:22<4:57:52,  3.70it/s]
 82%|████████▏ | 305401/371472 [2:08:22<4:43:54,  3.88it/s]
 82%|████████▏ | 305402/371472 [2:08:23<4:42:58,  3.89it/s]
 82%|████████▏ | 305403/371472 [2:08:23<4:44:29,  3.87it/s]
 82%|████████▏ | 305404/371472 [2:08:23<4:46:51,  3.84it/s]
 82%|████████▏ | 305405/371472 [2:08:24<4:57:36,  3.70it/s]
 82%|████████▏ | 305406/371472 [2:08:24<5:03:05,  3.63it/s]
 82%|████████▏ | 305407/371472 [2:08:24<5:21:03,  3.43it/s]
 82%|████████▏ | 305408/371472 [2:08:24<5:06:40,  3.59it/s]
 82%|████████▏ | 305409/371472 [2:08:25<5:10:00,  3.55it/s]
 82%|████████▏ | 305410/371472 [2:08:25<5:18:59,  3.45it/s]
 82%|████████▏ | 305411/371472 [2:08:25<5:07:40,  3.58it/s]
 82%|████████▏ | 305412/371472 [2:08:26<5:08:49,  3.57it/s]
 82%|████████▏ | 305413/371472 [2:08:26<5:23:37,  3.40it/s]
 82%|████████▏ | 305414/371472 [2:08:26<5:28:51,  3.35it/s]
 82%|████████▏ | 305415/371472 [2:08:26<5:34:07,  3.30it/s]
 82%|████████▏ | 305416/371472 [2:08:27<5:35:22,  3.28it/s]
 82%|████████▏ | 305417/371472 [2:08:27<5:41:09,  3.23it/s]
 82%|████████▏ | 305418/371472 [2:08:27<5:41:41,  3.22it/s]
 82%|████████▏ | 305419/371472 [2:08:28<5:32:27,  3.31it/s]
 82%|████████▏ | 305420/371472 [2:08:28<5:34:09,  3.29it/s]
                                                           
{'loss': 2.6246, 'learning_rate': 2.601165722165959e-07, 'epoch': 13.16}

 82%|████████▏ | 305420/371472 [2:08:28<5:34:09,  3.29it/s]
 82%|████████▏ | 305421/371472 [2:08:28<5:17:26,  3.47it/s]
 82%|████████▏ | 305422/371472 [2:08:28<5:05:03,  3.61it/s]
 82%|████████▏ | 305423/371472 [2:08:29<5:06:22,  3.59it/s]
 82%|████████▏ | 305424/371472 [2:08:29<5:02:25,  3.64it/s]
 82%|████████▏ | 305425/371472 [2:08:29<4:55:11,  3.73it/s]
 82%|████████▏ | 305426/371472 [2:08:30<5:12:40,  3.52it/s]
 82%|████████▏ | 305427/371472 [2:08:30<5:14:38,  3.50it/s]
 82%|████████▏ | 305428/371472 [2:08:30<5:06:55,  3.59it/s]
 82%|████████▏ | 305429/371472 [2:08:30<5:04:45,  3.61it/s]
 82%|████████▏ | 305430/371472 [2:08:31<5:06:48,  3.59it/s]
 82%|████████▏ | 305431/371472 [2:08:31<5:22:02,  3.42it/s]
 82%|████████▏ | 305432/371472 [2:08:31<5:36:12,  3.27it/s]
 82%|████████▏ | 305433/371472 [2:08:32<5:22:26,  3.41it/s]
 82%|████████▏ | 305434/371472 [2:08:32<5:08:18,  3.57it/s]
 82%|████████▏ | 305435/371472 [2:08:32<5:06:26,  3.59it/s]
 82%|████████▏ | 305436/371472 [2:08:32<5:05:52,  3.60it/s]
 82%|████████▏ | 305437/371472 [2:08:33<5:05:05,  3.61it/s]
 82%|████████▏ | 305438/371472 [2:08:33<4:58:59,  3.68it/s]
 82%|████████▏ | 305439/371472 [2:08:33<4:50:36,  3.79it/s]
 82%|████████▏ | 305440/371472 [2:08:34<5:05:44,  3.60it/s]
                                                           
{'loss': 2.6358, 'learning_rate': 2.6006809024111707e-07, 'epoch': 13.16}

 82%|████████▏ | 305440/371472 [2:08:34<5:05:44,  3.60it/s]
 82%|████████▏ | 305441/371472 [2:08:34<5:03:44,  3.62it/s]
 82%|████████▏ | 305442/371472 [2:08:34<4:58:51,  3.68it/s]
 82%|████████▏ | 305443/371472 [2:08:34<4:46:07,  3.85it/s]
 82%|████████▏ | 305444/371472 [2:08:35<4:41:27,  3.91it/s]
 82%|████████▏ | 305445/371472 [2:08:35<4:38:24,  3.95it/s]
 82%|████████▏ | 305446/371472 [2:08:35<4:46:01,  3.85it/s]
 82%|████████▏ | 305447/371472 [2:08:35<4:51:44,  3.77it/s]
 82%|████████▏ | 305448/371472 [2:08:36<4:44:14,  3.87it/s]
 82%|████████▏ | 305449/371472 [2:08:36<4:35:22,  4.00it/s]
 82%|████████▏ | 305450/371472 [2:08:36<4:56:04,  3.72it/s]
 82%|████████▏ | 305451/371472 [2:08:36<5:00:58,  3.66it/s]
 82%|████████▏ | 305452/371472 [2:08:37<5:01:42,  3.65it/s]
 82%|████████▏ | 305453/371472 [2:08:37<4:55:49,  3.72it/s]
 82%|████████▏ | 305454/371472 [2:08:37<5:02:30,  3.64it/s]
 82%|████████▏ | 305455/371472 [2:08:38<5:23:05,  3.41it/s]
 82%|████████▏ | 305456/371472 [2:08:38<5:33:26,  3.30it/s]
 82%|████████▏ | 305457/371472 [2:08:38<5:58:02,  3.07it/s]
 82%|████████▏ | 305458/371472 [2:08:39<5:38:41,  3.25it/s]
 82%|████████▏ | 305459/371472 [2:08:39<5:28:32,  3.35it/s]
 82%|████████▏ | 305460/371472 [2:08:39<5:23:02,  3.41it/s]
                                                           
{'loss': 2.6986, 'learning_rate': 2.6001960826563814e-07, 'epoch': 13.16}

 82%|████████▏ | 305460/371472 [2:08:39<5:23:02,  3.41it/s]
 82%|████████▏ | 305461/371472 [2:08:39<5:21:02,  3.43it/s]
 82%|████████▏ | 305462/371472 [2:08:40<5:30:05,  3.33it/s]
 82%|████████▏ | 305463/371472 [2:08:40<5:22:33,  3.41it/s]
 82%|████████▏ | 305464/371472 [2:08:40<5:33:49,  3.30it/s]
 82%|████████▏ | 305465/371472 [2:08:41<5:19:16,  3.45it/s]
 82%|████████▏ | 305466/371472 [2:08:41<5:11:00,  3.54it/s]
 82%|████████▏ | 305467/371472 [2:08:41<5:25:44,  3.38it/s]
 82%|████████▏ | 305468/371472 [2:08:42<5:39:53,  3.24it/s]
 82%|████████▏ | 305469/371472 [2:08:42<5:25:23,  3.38it/s]
 82%|████████▏ | 305470/371472 [2:08:42<5:12:39,  3.52it/s]
 82%|████████▏ | 305471/371472 [2:08:42<4:59:54,  3.67it/s]
 82%|████████▏ | 305472/371472 [2:08:43<4:51:28,  3.77it/s]
 82%|████████▏ | 305473/371472 [2:08:43<4:54:59,  3.73it/s]
 82%|████████▏ | 305474/371472 [2:08:43<5:09:28,  3.55it/s]
 82%|████████▏ | 305475/371472 [2:08:43<5:03:34,  3.62it/s]
 82%|████████▏ | 305476/371472 [2:08:44<4:54:10,  3.74it/s]
 82%|████████▏ | 305477/371472 [2:08:44<5:04:09,  3.62it/s]
 82%|████████▏ | 305478/371472 [2:08:44<4:57:40,  3.70it/s]
 82%|████████▏ | 305479/371472 [2:08:44<4:55:20,  3.72it/s]
 82%|████████▏ | 305480/371472 [2:08:45<5:07:33,  3.58it/s]
                                                           
{'loss': 2.4145, 'learning_rate': 2.5997112629015926e-07, 'epoch': 13.16}

 82%|████████▏ | 305480/371472 [2:08:45<5:07:33,  3.58it/s]
 82%|████████▏ | 305481/371472 [2:08:45<5:24:04,  3.39it/s]
 82%|████████▏ | 305482/371472 [2:08:45<5:13:31,  3.51it/s]
 82%|████████▏ | 305483/371472 [2:08:46<5:09:28,  3.55it/s]
 82%|████████▏ | 305484/371472 [2:08:46<5:02:47,  3.63it/s]
 82%|████████▏ | 305485/371472 [2:08:46<5:30:09,  3.33it/s]
 82%|████████▏ | 305486/371472 [2:08:46<5:14:21,  3.50it/s]
 82%|████████▏ | 305487/371472 [2:08:47<5:05:23,  3.60it/s]
 82%|████████▏ | 305488/371472 [2:08:47<5:00:11,  3.66it/s]
 82%|████████▏ | 305489/371472 [2:08:47<5:22:08,  3.41it/s]
 82%|████████▏ | 305490/371472 [2:08:48<5:13:37,  3.51it/s]
 82%|████████▏ | 305491/371472 [2:08:48<5:08:28,  3.56it/s]
 82%|████████▏ | 305492/371472 [2:08:48<5:45:48,  3.18it/s]
 82%|████████▏ | 305493/371472 [2:08:49<5:36:31,  3.27it/s]
 82%|████████▏ | 305494/371472 [2:08:49<5:24:18,  3.39it/s]
 82%|████████▏ | 305495/371472 [2:08:49<5:17:09,  3.47it/s]
 82%|████████▏ | 305496/371472 [2:08:49<5:13:00,  3.51it/s]
 82%|████████▏ | 305497/371472 [2:08:50<5:24:42,  3.39it/s]
 82%|████████▏ | 305498/371472 [2:08:50<5:28:10,  3.35it/s]
 82%|████████▏ | 305499/371472 [2:08:50<5:21:18,  3.42it/s]
 82%|████████▏ | 305500/371472 [2:08:51<5:17:33,  3.46it/s]
                                                           
{'loss': 2.5752, 'learning_rate': 2.599226443146803e-07, 'epoch': 13.16}

 82%|████████▏ | 305500/371472 [2:08:51<5:17:33,  3.46it/s]
 82%|████████▏ | 305501/371472 [2:08:51<5:32:45,  3.30it/s]
 82%|████████▏ | 305502/371472 [2:08:51<5:38:54,  3.24it/s]
 82%|████████▏ | 305503/371472 [2:08:52<5:43:05,  3.20it/s]
 82%|████████▏ | 305504/371472 [2:08:52<5:35:24,  3.28it/s]
 82%|████████▏ | 305505/371472 [2:08:52<5:23:23,  3.40it/s]
 82%|████████▏ | 305506/371472 [2:08:52<5:18:56,  3.45it/s]
 82%|████████▏ | 305507/371472 [2:08:53<5:12:19,  3.52it/s]
 82%|████████▏ | 305508/371472 [2:08:53<5:09:34,  3.55it/s]
 82%|████████▏ | 305509/371472 [2:08:53<5:02:30,  3.63it/s]
 82%|████████▏ | 305510/371472 [2:08:53<5:09:14,  3.56it/s]
 82%|████████▏ | 305511/371472 [2:08:54<5:00:03,  3.66it/s]
 82%|████████▏ | 305512/371472 [2:08:54<5:13:29,  3.51it/s]
 82%|████████▏ | 305513/371472 [2:08:54<5:17:53,  3.46it/s]
 82%|████████▏ | 305514/371472 [2:08:55<5:15:38,  3.48it/s]
 82%|████████▏ | 305515/371472 [2:08:55<5:19:52,  3.44it/s]
 82%|████████▏ | 305516/371472 [2:08:55<5:06:29,  3.59it/s]
 82%|████████▏ | 305517/371472 [2:08:55<5:04:08,  3.61it/s]
 82%|████████▏ | 305518/371472 [2:08:56<5:21:56,  3.41it/s]
 82%|████████▏ | 305519/371472 [2:08:56<5:21:36,  3.42it/s]
 82%|████████▏ | 305520/371472 [2:08:56<5:11:03,  3.53it/s]
                                                           
{'loss': 2.5435, 'learning_rate': 2.5987416233920146e-07, 'epoch': 13.16}

 82%|████████▏ | 305520/371472 [2:08:56<5:11:03,  3.53it/s]
 82%|████████▏ | 305521/371472 [2:08:57<5:09:10,  3.56it/s]
 82%|████████▏ | 305522/371472 [2:08:57<5:03:18,  3.62it/s]
 82%|████████▏ | 305523/371472 [2:08:57<5:35:30,  3.28it/s]
 82%|████████▏ | 305524/371472 [2:08:58<5:25:03,  3.38it/s]
 82%|████████▏ | 305525/371472 [2:08:58<5:17:24,  3.46it/s]
 82%|████████▏ | 305526/371472 [2:08:58<5:07:17,  3.58it/s]
 82%|████████▏ | 305527/371472 [2:08:58<5:11:54,  3.52it/s]
 82%|████████▏ | 305528/371472 [2:08:59<5:18:52,  3.45it/s]
 82%|████████▏ | 305529/371472 [2:08:59<5:21:06,  3.42it/s]
 82%|████████▏ | 305530/371472 [2:08:59<5:08:40,  3.56it/s]
 82%|████████▏ | 305531/371472 [2:09:00<5:15:50,  3.48it/s]
 82%|████████▏ | 305532/371472 [2:09:00<5:35:37,  3.27it/s]
 82%|████████▏ | 305533/371472 [2:09:00<5:31:16,  3.32it/s]
 82%|████████▏ | 305534/371472 [2:09:00<5:20:43,  3.43it/s]
 82%|████████▏ | 305535/371472 [2:09:01<5:16:15,  3.47it/s]
 82%|████████▏ | 305536/371472 [2:09:01<5:06:53,  3.58it/s]
 82%|████████▏ | 305537/371472 [2:09:01<5:02:32,  3.63it/s]
 82%|████████▏ | 305538/371472 [2:09:01<4:49:42,  3.79it/s]
 82%|████████▏ | 305539/371472 [2:09:02<5:50:37,  3.13it/s]
 82%|████████▏ | 305540/371472 [2:09:02<5:41:15,  3.22it/s]
                                                           
{'loss': 2.7423, 'learning_rate': 2.5982568036372253e-07, 'epoch': 13.16}

 82%|████████▏ | 305540/371472 [2:09:02<5:41:15,  3.22it/s]
 82%|████████▏ | 305541/371472 [2:09:03<5:45:00,  3.19it/s]
 82%|████████▏ | 305542/371472 [2:09:03<5:30:07,  3.33it/s]
 82%|████████▏ | 305543/371472 [2:09:03<5:23:31,  3.40it/s]
 82%|████████▏ | 305544/371472 [2:09:03<5:23:31,  3.40it/s]
 82%|████████▏ | 305545/371472 [2:09:04<5:12:09,  3.52it/s]
 82%|████████▏ | 305546/371472 [2:09:04<5:16:57,  3.47it/s]
 82%|████████▏ | 305547/371472 [2:09:04<5:07:24,  3.57it/s]
 82%|████████▏ | 305548/371472 [2:09:04<5:12:08,  3.52it/s]
 82%|████████▏ | 305549/371472 [2:09:05<5:10:24,  3.54it/s]
 82%|████████▏ | 305550/371472 [2:09:05<5:18:27,  3.45it/s]
 82%|████████▏ | 305551/371472 [2:09:05<5:18:47,  3.45it/s]
 82%|████████▏ | 305552/371472 [2:09:06<5:11:17,  3.53it/s]
 82%|████████▏ | 305553/371472 [2:09:06<5:13:44,  3.50it/s]
 82%|████████▏ | 305554/371472 [2:09:06<5:16:33,  3.47it/s]
 82%|████████▏ | 305555/371472 [2:09:06<5:07:22,  3.57it/s]
 82%|████████▏ | 305556/371472 [2:09:07<5:00:37,  3.65it/s]
 82%|████████▏ | 305557/371472 [2:09:07<4:55:12,  3.72it/s]
 82%|████████▏ | 305558/371472 [2:09:07<5:03:20,  3.62it/s]
 82%|████████▏ | 305559/371472 [2:09:08<4:50:59,  3.78it/s]
 82%|████████▏ | 305560/371472 [2:09:08<4:53:23,  3.74it/s]
                                                           
{'loss': 2.702, 'learning_rate': 2.597771983882437e-07, 'epoch': 13.16}

 82%|████████▏ | 305560/371472 [2:09:08<4:53:23,  3.74it/s]
 82%|████████▏ | 305561/371472 [2:09:08<5:05:18,  3.60it/s]
 82%|████████▏ | 305562/371472 [2:09:08<5:06:19,  3.59it/s]
 82%|████████▏ | 305563/371472 [2:09:09<4:55:16,  3.72it/s]
 82%|████████▏ | 305564/371472 [2:09:09<4:41:40,  3.90it/s]
 82%|████████▏ | 305565/371472 [2:09:09<4:49:14,  3.80it/s]
 82%|████████▏ | 305566/371472 [2:09:09<4:39:47,  3.93it/s]
 82%|████████▏ | 305567/371472 [2:09:10<4:57:33,  3.69it/s]
 82%|████████▏ | 305568/371472 [2:09:10<4:54:57,  3.72it/s]
 82%|████████▏ | 305569/371472 [2:09:10<5:07:15,  3.57it/s]
 82%|████████▏ | 305570/371472 [2:09:10<5:01:00,  3.65it/s]
 82%|████████▏ | 305571/371472 [2:09:11<5:00:35,  3.65it/s]
 82%|████████▏ | 305572/371472 [2:09:11<5:05:07,  3.60it/s]
 82%|████████▏ | 305573/371472 [2:09:11<4:59:58,  3.66it/s]
 82%|████████▏ | 305574/371472 [2:09:12<5:04:23,  3.61it/s]
 82%|████████▏ | 305575/371472 [2:09:12<4:57:36,  3.69it/s]
 82%|████████▏ | 305576/371472 [2:09:12<5:42:47,  3.20it/s]
 82%|████████▏ | 305577/371472 [2:09:13<5:50:19,  3.13it/s]
 82%|████████▏ | 305578/371472 [2:09:13<5:34:12,  3.29it/s]
 82%|████████▏ | 305579/371472 [2:09:13<5:18:41,  3.45it/s]
 82%|████████▏ | 305580/371472 [2:09:13<5:24:51,  3.38it/s]
                                                           
{'loss': 2.6743, 'learning_rate': 2.597287164127648e-07, 'epoch': 13.16}

 82%|████████▏ | 305580/371472 [2:09:13<5:24:51,  3.38it/s]
 82%|████████▏ | 305581/371472 [2:09:14<5:22:06,  3.41it/s]
 82%|████████▏ | 305582/371472 [2:09:14<5:21:20,  3.42it/s]
 82%|████████▏ | 305583/371472 [2:09:14<5:17:59,  3.45it/s]
 82%|████████▏ | 305584/371472 [2:09:15<5:09:30,  3.55it/s]
 82%|████████▏ | 305585/371472 [2:09:15<5:08:49,  3.56it/s]
 82%|████████▏ | 305586/371472 [2:09:15<5:01:44,  3.64it/s]
 82%|████████▏ | 305587/371472 [2:09:15<4:50:03,  3.79it/s]
 82%|████████▏ | 305588/371472 [2:09:16<4:50:43,  3.78it/s]
 82%|████████▏ | 305589/371472 [2:09:16<5:05:51,  3.59it/s]
 82%|████████▏ | 305590/371472 [2:09:16<5:02:56,  3.62it/s]
 82%|████████▏ | 305591/371472 [2:09:16<5:02:38,  3.63it/s]
 82%|████████▏ | 305592/371472 [2:09:17<4:57:42,  3.69it/s]
 82%|████████▏ | 305593/371472 [2:09:17<4:54:14,  3.73it/s]
 82%|████████▏ | 305594/371472 [2:09:17<4:59:55,  3.66it/s]
 82%|████████▏ | 305595/371472 [2:09:18<5:08:57,  3.55it/s]
 82%|████████▏ | 305596/371472 [2:09:18<4:59:05,  3.67it/s]
 82%|████████▏ | 305597/371472 [2:09:18<5:01:20,  3.64it/s]
 82%|████████▏ | 305598/371472 [2:09:18<4:57:57,  3.68it/s]
 82%|████████▏ | 305599/371472 [2:09:19<5:03:12,  3.62it/s]
 82%|████████▏ | 305600/371472 [2:09:19<5:25:09,  3.38it/s]
                                                           
{'loss': 2.6351, 'learning_rate': 2.596802344372859e-07, 'epoch': 13.16}

 82%|████████▏ | 305600/371472 [2:09:19<5:25:09,  3.38it/s]
 82%|████████▏ | 305601/371472 [2:09:19<5:19:01,  3.44it/s]
 82%|████████▏ | 305602/371472 [2:09:20<5:12:14,  3.52it/s]
 82%|████████▏ | 305603/371472 [2:09:20<5:12:09,  3.52it/s]
 82%|████████▏ | 305604/371472 [2:09:20<5:05:11,  3.60it/s]
 82%|████████▏ | 305605/371472 [2:09:20<5:07:21,  3.57it/s]
 82%|████████▏ | 305606/371472 [2:09:21<5:12:28,  3.51it/s]
 82%|████████▏ | 305607/371472 [2:09:21<5:02:31,  3.63it/s]
 82%|████████▏ | 305608/371472 [2:09:21<5:12:28,  3.51it/s]
 82%|████████▏ | 305609/371472 [2:09:22<5:10:58,  3.53it/s]
 82%|████████▏ | 305610/371472 [2:09:22<5:26:57,  3.36it/s]
 82%|████████▏ | 305611/371472 [2:09:22<5:10:08,  3.54it/s]
 82%|████████▏ | 305612/371472 [2:09:22<4:59:22,  3.67it/s]
 82%|████████▏ | 305613/371472 [2:09:23<4:55:56,  3.71it/s]
 82%|████████▏ | 305614/371472 [2:09:23<4:55:30,  3.71it/s]
 82%|████████▏ | 305615/371472 [2:09:23<5:17:20,  3.46it/s]
 82%|████████▏ | 305616/371472 [2:09:23<5:12:07,  3.52it/s]
 82%|████████▏ | 305617/371472 [2:09:24<5:07:31,  3.57it/s]
 82%|████████▏ | 305618/371472 [2:09:24<5:20:26,  3.43it/s]
 82%|████████▏ | 305619/371472 [2:09:24<5:32:32,  3.30it/s]
 82%|████████▏ | 305620/371472 [2:09:25<5:14:27,  3.49it/s]
                                                           
{'loss': 2.6873, 'learning_rate': 2.59631752461807e-07, 'epoch': 13.16}

 82%|████████▏ | 305620/371472 [2:09:25<5:14:27,  3.49it/s]
 82%|████████▏ | 305621/371472 [2:09:25<5:26:47,  3.36it/s]
 82%|████████▏ | 305622/371472 [2:09:25<5:34:32,  3.28it/s]
 82%|████████▏ | 305623/371472 [2:09:26<5:28:29,  3.34it/s]
 82%|████████▏ | 305624/371472 [2:09:26<5:44:55,  3.18it/s]
 82%|████████▏ | 305625/371472 [2:09:26<5:41:16,  3.22it/s]
 82%|████████▏ | 305626/371472 [2:09:27<5:28:18,  3.34it/s]
 82%|████████▏ | 305627/371472 [2:09:27<5:22:29,  3.40it/s]
 82%|████████▏ | 305628/371472 [2:09:27<5:15:55,  3.47it/s]
 82%|████████▏ | 305629/371472 [2:09:27<5:07:10,  3.57it/s]
 82%|████████▏ | 305630/371472 [2:09:28<5:34:25,  3.28it/s]
 82%|████████▏ | 305631/371472 [2:09:28<5:23:48,  3.39it/s]
 82%|████████▏ | 305632/371472 [2:09:28<5:02:33,  3.63it/s]
 82%|████████▏ | 305633/371472 [2:09:28<5:04:32,  3.60it/s]
 82%|████████▏ | 305634/371472 [2:09:29<4:58:06,  3.68it/s]
 82%|████████▏ | 305635/371472 [2:09:29<5:30:21,  3.32it/s]
 82%|████████▏ | 305636/371472 [2:09:29<5:20:09,  3.43it/s]
 82%|████████▏ | 305637/371472 [2:09:30<5:20:12,  3.43it/s]
 82%|████████▏ | 305638/371472 [2:09:30<5:16:25,  3.47it/s]
 82%|████████▏ | 305639/371472 [2:09:30<5:27:58,  3.35it/s]
 82%|████████▏ | 305640/371472 [2:09:31<5:31:22,  3.31it/s]
                                                           
{'loss': 2.6427, 'learning_rate': 2.595832704863281e-07, 'epoch': 13.16}

 82%|████████▏ | 305640/371472 [2:09:31<5:31:22,  3.31it/s]
 82%|████████▏ | 305641/371472 [2:09:31<5:22:09,  3.41it/s]
 82%|████████▏ | 305642/371472 [2:09:31<5:35:29,  3.27it/s]
 82%|████████▏ | 305643/371472 [2:09:31<5:16:38,  3.46it/s]
 82%|████████▏ | 305644/371472 [2:09:32<5:13:30,  3.50it/s]
 82%|████████▏ | 305645/371472 [2:09:32<5:52:07,  3.12it/s]
 82%|████████▏ | 305646/371472 [2:09:32<5:27:36,  3.35it/s]
 82%|████████▏ | 305647/371472 [2:09:33<5:12:32,  3.51it/s]
 82%|████████▏ | 305648/371472 [2:09:33<5:00:18,  3.65it/s]
 82%|████████▏ | 305649/371472 [2:09:33<4:55:20,  3.71it/s]
 82%|████████▏ | 305650/371472 [2:09:33<4:44:23,  3.86it/s]
 82%|████████▏ | 305651/371472 [2:09:34<4:43:08,  3.87it/s]
 82%|████████▏ | 305652/371472 [2:09:34<4:47:21,  3.82it/s]
 82%|████████▏ | 305653/371472 [2:09:34<4:51:24,  3.76it/s]
 82%|████████▏ | 305654/371472 [2:09:34<4:57:06,  3.69it/s]
 82%|████████▏ | 305655/371472 [2:09:35<4:50:22,  3.78it/s]
 82%|████████▏ | 305656/371472 [2:09:35<4:59:39,  3.66it/s]
 82%|████████▏ | 305657/371472 [2:09:35<5:20:30,  3.42it/s]
 82%|████████▏ | 305658/371472 [2:09:36<5:30:06,  3.32it/s]
 82%|████████▏ | 305659/371472 [2:09:36<5:26:36,  3.36it/s]
 82%|████████▏ | 305660/371472 [2:09:36<5:29:48,  3.33it/s]
                                                           
{'loss': 2.6083, 'learning_rate': 2.5953478851084917e-07, 'epoch': 13.17}

 82%|████████▏ | 305660/371472 [2:09:36<5:29:48,  3.33it/s]
 82%|████████▏ | 305661/371472 [2:09:37<5:34:43,  3.28it/s]
 82%|████████▏ | 305662/371472 [2:09:37<5:38:19,  3.24it/s]
 82%|████████▏ | 305663/371472 [2:09:37<5:22:59,  3.40it/s]
 82%|████████▏ | 305664/371472 [2:09:37<5:34:10,  3.28it/s]
 82%|████████▏ | 305665/371472 [2:09:38<5:26:40,  3.36it/s]
 82%|████████▏ | 305666/371472 [2:09:38<5:08:54,  3.55it/s]
 82%|████████▏ | 305667/371472 [2:09:38<5:03:28,  3.61it/s]
 82%|████████▏ | 305668/371472 [2:09:39<5:16:55,  3.46it/s]
 82%|████████▏ | 305669/371472 [2:09:39<5:12:40,  3.51it/s]
 82%|████████▏ | 305670/371472 [2:09:39<5:03:50,  3.61it/s]
 82%|████████▏ | 305671/371472 [2:09:40<6:20:01,  2.89it/s]
 82%|████████▏ | 305672/371472 [2:09:40<5:49:01,  3.14it/s]
 82%|████████▏ | 305673/371472 [2:09:40<5:56:08,  3.08it/s]
 82%|████████▏ | 305674/371472 [2:09:40<5:42:34,  3.20it/s]
 82%|████████▏ | 305675/371472 [2:09:41<5:21:34,  3.41it/s]
 82%|████████▏ | 305676/371472 [2:09:41<5:12:50,  3.51it/s]
 82%|████████▏ | 305677/371472 [2:09:41<5:31:27,  3.31it/s]
 82%|████████▏ | 305678/371472 [2:09:42<5:08:58,  3.55it/s]
 82%|████████▏ | 305679/371472 [2:09:42<4:53:48,  3.73it/s]
 82%|████████▏ | 305680/371472 [2:09:42<4:51:03,  3.77it/s]
                                                           
{'loss': 2.486, 'learning_rate': 2.5948630653537024e-07, 'epoch': 13.17}

 82%|████████▏ | 305680/371472 [2:09:42<4:51:03,  3.77it/s]
 82%|████████▏ | 305681/371472 [2:09:42<4:41:49,  3.89it/s]
 82%|████████▏ | 305682/371472 [2:09:43<5:04:06,  3.61it/s]
 82%|████████▏ | 305683/371472 [2:09:43<4:59:26,  3.66it/s]
 82%|████████▏ | 305684/371472 [2:09:43<4:52:41,  3.75it/s]
 82%|████████▏ | 305685/371472 [2:09:43<4:49:19,  3.79it/s]
 82%|████████▏ | 305686/371472 [2:09:44<5:04:58,  3.60it/s]
 82%|████████▏ | 305687/371472 [2:09:44<5:11:08,  3.52it/s]
 82%|████████▏ | 305688/371472 [2:09:44<5:13:43,  3.49it/s]
 82%|████████▏ | 305689/371472 [2:09:45<5:04:38,  3.60it/s]
 82%|████████▏ | 305690/371472 [2:09:45<5:06:50,  3.57it/s]
 82%|████████▏ | 305691/371472 [2:09:45<5:03:57,  3.61it/s]
 82%|████████▏ | 305692/371472 [2:09:45<5:08:07,  3.56it/s]
 82%|████████▏ | 305693/371472 [2:09:46<4:57:46,  3.68it/s]
 82%|████████▏ | 305694/371472 [2:09:46<4:54:06,  3.73it/s]
 82%|████████▏ | 305695/371472 [2:09:46<5:22:57,  3.39it/s]
 82%|████████▏ | 305696/371472 [2:09:47<5:13:58,  3.49it/s]
 82%|████████▏ | 305697/371472 [2:09:47<5:03:19,  3.61it/s]
 82%|████████▏ | 305698/371472 [2:09:47<5:08:28,  3.55it/s]
 82%|████████▏ | 305699/371472 [2:09:47<5:25:53,  3.36it/s]
 82%|████████▏ | 305700/371472 [2:09:48<5:31:46,  3.30it/s]
                                                           
{'loss': 2.6573, 'learning_rate': 2.594378245598914e-07, 'epoch': 13.17}

 82%|████████▏ | 305700/371472 [2:09:48<5:31:46,  3.30it/s]
 82%|████████▏ | 305701/371472 [2:09:48<5:59:19,  3.05it/s]
 82%|████████▏ | 305702/371472 [2:09:48<5:29:16,  3.33it/s]
 82%|████████▏ | 305703/371472 [2:09:49<5:20:11,  3.42it/s]
 82%|████████▏ | 305704/371472 [2:09:49<5:14:11,  3.49it/s]
 82%|████████▏ | 305705/371472 [2:09:49<5:06:17,  3.58it/s]
 82%|████████▏ | 305706/371472 [2:09:49<5:06:21,  3.58it/s]
 82%|████████▏ | 305707/371472 [2:09:50<4:55:43,  3.71it/s]
 82%|████████▏ | 305708/371472 [2:09:50<5:00:47,  3.64it/s]
 82%|████████▏ | 305709/371472 [2:09:50<5:28:24,  3.34it/s]
 82%|████████▏ | 305710/371472 [2:09:51<5:16:51,  3.46it/s]
 82%|████████▏ | 305711/371472 [2:09:51<5:14:10,  3.49it/s]
 82%|████████▏ | 305712/371472 [2:09:51<5:18:41,  3.44it/s]
 82%|████████▏ | 305713/371472 [2:09:51<5:11:20,  3.52it/s]
 82%|████████▏ | 305714/371472 [2:09:52<5:06:12,  3.58it/s]
 82%|████████▏ | 305715/371472 [2:09:52<5:09:39,  3.54it/s]
 82%|████████▏ | 305716/371472 [2:09:52<5:06:40,  3.57it/s]
 82%|████████▏ | 305717/371472 [2:09:53<5:07:52,  3.56it/s]
 82%|████████▏ | 305718/371472 [2:09:53<4:57:25,  3.68it/s]
 82%|████████▏ | 305719/371472 [2:09:53<4:51:53,  3.75it/s]
 82%|████████▏ | 305720/371472 [2:09:53<5:05:52,  3.58it/s]
                                                           
{'loss': 2.6877, 'learning_rate': 2.593893425844125e-07, 'epoch': 13.17}

 82%|████████▏ | 305720/371472 [2:09:53<5:05:52,  3.58it/s]
 82%|████████▏ | 305721/371472 [2:09:54<5:02:05,  3.63it/s]
 82%|████████▏ | 305722/371472 [2:09:54<5:03:52,  3.61it/s]
 82%|████████▏ | 305723/371472 [2:09:54<5:01:58,  3.63it/s]
 82%|████████▏ | 305724/371472 [2:09:54<5:08:06,  3.56it/s]
 82%|████████▏ | 305725/371472 [2:09:55<5:12:48,  3.50it/s]
 82%|████████▏ | 305726/371472 [2:09:55<5:26:11,  3.36it/s]
 82%|████████▏ | 305727/371472 [2:09:55<5:11:04,  3.52it/s]
 82%|████████▏ | 305728/371472 [2:09:56<5:35:22,  3.27it/s]
 82%|████████▏ | 305729/371472 [2:09:56<5:26:09,  3.36it/s]
 82%|████████▏ | 305730/371472 [2:09:56<5:47:27,  3.15it/s]
 82%|████████▏ | 305731/371472 [2:09:57<5:28:50,  3.33it/s]
 82%|████████▏ | 305732/371472 [2:09:57<5:04:14,  3.60it/s]
 82%|████████▏ | 305733/371472 [2:09:57<4:58:42,  3.67it/s]
 82%|████████▏ | 305734/371472 [2:09:57<4:56:31,  3.69it/s]
 82%|████████▏ | 305735/371472 [2:09:58<5:03:05,  3.61it/s]
 82%|████████▏ | 305736/371472 [2:09:58<5:14:50,  3.48it/s]
 82%|████████▏ | 305737/371472 [2:09:58<5:12:32,  3.51it/s]
 82%|████████▏ | 305738/371472 [2:09:59<5:14:29,  3.48it/s]
 82%|████████▏ | 305739/371472 [2:09:59<5:16:17,  3.46it/s]
 82%|████████▏ | 305740/371472 [2:09:59<5:08:53,  3.55it/s]
                                                           
{'loss': 2.6386, 'learning_rate': 2.593408606089336e-07, 'epoch': 13.17}

 82%|████████▏ | 305740/371472 [2:09:59<5:08:53,  3.55it/s]
 82%|████████▏ | 305741/371472 [2:09:59<5:04:53,  3.59it/s]
 82%|████████▏ | 305742/371472 [2:10:00<5:06:37,  3.57it/s]
 82%|████████▏ | 305743/371472 [2:10:00<4:52:33,  3.74it/s]
 82%|████████▏ | 305744/371472 [2:10:00<4:52:46,  3.74it/s]
 82%|████████▏ | 305745/371472 [2:10:00<4:44:57,  3.84it/s]
 82%|████████▏ | 305746/371472 [2:10:01<5:04:25,  3.60it/s]
 82%|████████▏ | 305747/371472 [2:10:01<5:24:53,  3.37it/s]
 82%|████████▏ | 305748/371472 [2:10:01<5:11:36,  3.52it/s]
 82%|████████▏ | 305749/371472 [2:10:02<5:08:01,  3.56it/s]
 82%|████████▏ | 305750/371472 [2:10:02<4:58:38,  3.67it/s]
 82%|████████▏ | 305751/371472 [2:10:02<5:09:29,  3.54it/s]
 82%|████████▏ | 305752/371472 [2:10:02<5:10:33,  3.53it/s]
 82%|████████▏ | 305753/371472 [2:10:03<5:11:31,  3.52it/s]
 82%|████████▏ | 305754/371472 [2:10:03<5:36:54,  3.25it/s]
 82%|████████▏ | 305755/371472 [2:10:03<5:19:26,  3.43it/s]
 82%|████████▏ | 305756/371472 [2:10:04<5:03:27,  3.61it/s]
 82%|████████▏ | 305757/371472 [2:10:04<5:08:45,  3.55it/s]
 82%|████████▏ | 305758/371472 [2:10:04<5:16:12,  3.46it/s]
 82%|████████▏ | 305759/371472 [2:10:04<5:10:42,  3.52it/s]
 82%|████████▏ | 305760/371472 [2:10:05<5:05:47,  3.58it/s]
                                                           
{'loss': 2.6084, 'learning_rate': 2.5929237863345463e-07, 'epoch': 13.17}

 82%|████████▏ | 305760/371472 [2:10:05<5:05:47,  3.58it/s]
 82%|████████▏ | 305761/371472 [2:10:05<6:15:08,  2.92it/s]
 82%|████████▏ | 305762/371472 [2:10:05<5:47:10,  3.15it/s]
 82%|████████▏ | 305763/371472 [2:10:06<5:42:23,  3.20it/s]
 82%|████████▏ | 305764/371472 [2:10:06<5:34:31,  3.27it/s]
 82%|████████▏ | 305765/371472 [2:10:06<5:22:55,  3.39it/s]
 82%|████████▏ | 305766/371472 [2:10:07<5:08:12,  3.55it/s]
 82%|████████▏ | 305767/371472 [2:10:07<5:00:09,  3.65it/s]
 82%|████████▏ | 305768/371472 [2:10:07<5:07:42,  3.56it/s]
 82%|████████▏ | 305769/371472 [2:10:07<4:59:11,  3.66it/s]
 82%|████████▏ | 305770/371472 [2:10:08<4:51:13,  3.76it/s]
 82%|████████▏ | 305771/371472 [2:10:08<4:56:52,  3.69it/s]
 82%|████████▏ | 305772/371472 [2:10:08<4:46:18,  3.82it/s]
 82%|████████▏ | 305773/371472 [2:10:08<4:42:09,  3.88it/s]
 82%|████████▏ | 305774/371472 [2:10:09<4:46:32,  3.82it/s]
 82%|████████▏ | 305775/371472 [2:10:09<4:50:49,  3.76it/s]
 82%|████████▏ | 305776/371472 [2:10:09<4:47:45,  3.80it/s]
 82%|████████▏ | 305777/371472 [2:10:09<4:47:08,  3.81it/s]
 82%|████████▏ | 305778/371472 [2:10:10<4:43:01,  3.87it/s]
 82%|████████▏ | 305779/371472 [2:10:10<4:52:39,  3.74it/s]
 82%|████████▏ | 305780/371472 [2:10:10<4:46:54,  3.82it/s]
                                                           
{'loss': 2.713, 'learning_rate': 2.592438966579758e-07, 'epoch': 13.17}

 82%|████████▏ | 305780/371472 [2:10:10<4:46:54,  3.82it/s]
 82%|████████▏ | 305781/371472 [2:10:11<4:43:17,  3.86it/s]
 82%|████████▏ | 305782/371472 [2:10:11<4:54:25,  3.72it/s]
 82%|████████▏ | 305783/371472 [2:10:11<4:58:10,  3.67it/s]
 82%|████████▏ | 305784/371472 [2:10:11<4:57:20,  3.68it/s]
 82%|████████▏ | 305785/371472 [2:10:12<5:10:18,  3.53it/s]
 82%|████████▏ | 305786/371472 [2:10:12<5:01:17,  3.63it/s]
 82%|████████▏ | 305787/371472 [2:10:12<5:06:11,  3.58it/s]
 82%|████████▏ | 305788/371472 [2:10:13<5:16:51,  3.45it/s]
 82%|████████▏ | 305789/371472 [2:10:13<5:43:26,  3.19it/s]
 82%|████████▏ | 305790/371472 [2:10:13<5:19:30,  3.43it/s]
 82%|████████▏ | 305791/371472 [2:10:13<5:24:38,  3.37it/s]
 82%|████████▏ | 305792/371472 [2:10:14<5:24:46,  3.37it/s]
 82%|████████▏ | 305793/371472 [2:10:14<5:20:57,  3.41it/s]
 82%|████████▏ | 305794/371472 [2:10:14<5:04:17,  3.60it/s]
 82%|████████▏ | 305795/371472 [2:10:15<5:01:27,  3.63it/s]
 82%|████████▏ | 305796/371472 [2:10:15<5:05:54,  3.58it/s]
 82%|████████▏ | 305797/371472 [2:10:15<5:04:45,  3.59it/s]
 82%|████████▏ | 305798/371472 [2:10:15<4:55:11,  3.71it/s]
 82%|████████▏ | 305799/371472 [2:10:16<4:56:19,  3.69it/s]
 82%|████████▏ | 305800/371472 [2:10:16<4:54:17,  3.72it/s]
                                                           
{'loss': 2.5676, 'learning_rate': 2.591954146824969e-07, 'epoch': 13.17}

 82%|████████▏ | 305800/371472 [2:10:16<4:54:17,  3.72it/s]
 82%|████████▏ | 305801/371472 [2:10:16<5:02:31,  3.62it/s]
 82%|████████▏ | 305802/371472 [2:10:16<5:03:26,  3.61it/s]
 82%|████████▏ | 305803/371472 [2:10:17<4:56:30,  3.69it/s]
 82%|████████▏ | 305804/371472 [2:10:17<4:46:56,  3.81it/s]
 82%|████████▏ | 305805/371472 [2:10:17<5:31:52,  3.30it/s]
 82%|████████▏ | 305806/371472 [2:10:18<5:44:37,  3.18it/s]
 82%|████████▏ | 305807/371472 [2:10:18<5:22:54,  3.39it/s]
 82%|████████▏ | 305808/371472 [2:10:18<5:30:13,  3.31it/s]
 82%|████████▏ | 305809/371472 [2:10:19<5:15:52,  3.46it/s]
 82%|████████▏ | 305810/371472 [2:10:19<5:07:46,  3.56it/s]
 82%|████████▏ | 305811/371472 [2:10:19<5:09:23,  3.54it/s]
 82%|████████▏ | 305812/371472 [2:10:19<5:08:47,  3.54it/s]
 82%|████████▏ | 305813/371472 [2:10:20<5:16:34,  3.46it/s]
 82%|████████▏ | 305814/371472 [2:10:20<5:12:04,  3.51it/s]
 82%|████████▏ | 305815/371472 [2:10:20<5:19:53,  3.42it/s]
 82%|████████▏ | 305816/371472 [2:10:21<5:20:29,  3.41it/s]
 82%|████████▏ | 305817/371472 [2:10:21<5:16:44,  3.45it/s]
 82%|████████▏ | 305818/371472 [2:10:21<5:23:23,  3.38it/s]
 82%|████████▏ | 305819/371472 [2:10:21<5:25:00,  3.37it/s]
 82%|████████▏ | 305820/371472 [2:10:22<5:18:47,  3.43it/s]
                                                           
{'loss': 2.7775, 'learning_rate': 2.5914693270701806e-07, 'epoch': 13.17}

 82%|████████▏ | 305820/371472 [2:10:22<5:18:47,  3.43it/s]
 82%|████████▏ | 305821/371472 [2:10:22<5:24:14,  3.37it/s]
 82%|████████▏ | 305822/371472 [2:10:22<5:24:16,  3.37it/s]
 82%|████████▏ | 305823/371472 [2:10:23<5:20:30,  3.41it/s]
 82%|████████▏ | 305824/371472 [2:10:23<5:17:35,  3.45it/s]
 82%|████████▏ | 305825/371472 [2:10:24<7:31:30,  2.42it/s]
 82%|████████▏ | 305826/371472 [2:10:24<6:42:33,  2.72it/s]
 82%|████████▏ | 305827/371472 [2:10:24<6:12:01,  2.94it/s]
 82%|████████▏ | 305828/371472 [2:10:24<5:49:25,  3.13it/s]
 82%|████████▏ | 305829/371472 [2:10:25<5:36:18,  3.25it/s]
 82%|████████▏ | 305830/371472 [2:10:25<5:28:30,  3.33it/s]
 82%|████████▏ | 305831/371472 [2:10:25<5:15:17,  3.47it/s]
 82%|████████▏ | 305832/371472 [2:10:26<5:24:50,  3.37it/s]
 82%|████████▏ | 305833/371472 [2:10:26<5:24:17,  3.37it/s]
 82%|████████▏ | 305834/371472 [2:10:26<5:24:53,  3.37it/s]
 82%|████████▏ | 305835/371472 [2:10:26<5:29:10,  3.32it/s]
 82%|████████▏ | 305836/371472 [2:10:27<5:30:04,  3.31it/s]
 82%|████████▏ | 305837/371472 [2:10:27<5:13:02,  3.49it/s]
 82%|████████▏ | 305838/371472 [2:10:27<5:03:04,  3.61it/s]
 82%|████████▏ | 305839/371472 [2:10:28<5:19:42,  3.42it/s]
 82%|████████▏ | 305840/371472 [2:10:28<5:32:40,  3.29it/s]
                                                           
{'loss': 2.5596, 'learning_rate': 2.5909845073153913e-07, 'epoch': 13.17}

 82%|████████▏ | 305840/371472 [2:10:28<5:32:40,  3.29it/s]
 82%|████████▏ | 305841/371472 [2:10:28<5:21:37,  3.40it/s]
 82%|████████▏ | 305842/371472 [2:10:28<5:13:29,  3.49it/s]
 82%|████████▏ | 305843/371472 [2:10:29<4:59:03,  3.66it/s]
 82%|████████▏ | 305844/371472 [2:10:29<4:55:19,  3.70it/s]
 82%|████████▏ | 305845/371472 [2:10:29<4:50:20,  3.77it/s]
 82%|████████▏ | 305846/371472 [2:10:29<4:39:05,  3.92it/s]
 82%|████████▏ | 305847/371472 [2:10:30<4:38:41,  3.92it/s]
 82%|████████▏ | 305848/371472 [2:10:30<4:41:28,  3.89it/s]
 82%|████████▏ | 305849/371472 [2:10:30<4:49:33,  3.78it/s]
 82%|████████▏ | 305850/371472 [2:10:31<4:45:49,  3.83it/s]
 82%|████████▏ | 305851/371472 [2:10:31<4:47:43,  3.80it/s]
 82%|████████▏ | 305852/371472 [2:10:31<4:48:17,  3.79it/s]
 82%|████████▏ | 305853/371472 [2:10:31<5:05:58,  3.57it/s]
 82%|████████▏ | 305854/371472 [2:10:32<5:41:57,  3.20it/s]
 82%|████████▏ | 305855/371472 [2:10:32<5:25:18,  3.36it/s]
 82%|████████▏ | 305856/371472 [2:10:32<5:38:16,  3.23it/s]
 82%|████████▏ | 305857/371472 [2:10:33<5:21:50,  3.40it/s]
 82%|████████▏ | 305858/371472 [2:10:33<5:13:44,  3.49it/s]
 82%|████████▏ | 305859/371472 [2:10:33<5:02:49,  3.61it/s]
 82%|████████▏ | 305860/371472 [2:10:33<5:22:48,  3.39it/s]
                                                           
{'loss': 2.6065, 'learning_rate': 2.5904996875606026e-07, 'epoch': 13.17}

 82%|████████▏ | 305860/371472 [2:10:33<5:22:48,  3.39it/s]
 82%|████████▏ | 305861/371472 [2:10:34<5:05:13,  3.58it/s]
 82%|████████▏ | 305862/371472 [2:10:34<4:59:48,  3.65it/s]
 82%|████████▏ | 305863/371472 [2:10:34<5:24:28,  3.37it/s]
 82%|████████▏ | 305864/371472 [2:10:35<6:00:09,  3.04it/s]
 82%|████████▏ | 305865/371472 [2:10:35<5:41:43,  3.20it/s]
 82%|████████▏ | 305866/371472 [2:10:35<5:42:22,  3.19it/s]
 82%|████████▏ | 305867/371472 [2:10:36<5:24:23,  3.37it/s]
 82%|████████▏ | 305868/371472 [2:10:36<5:28:07,  3.33it/s]
 82%|████████▏ | 305869/371472 [2:10:36<5:20:01,  3.42it/s]
 82%|████████▏ | 305870/371472 [2:10:36<5:02:45,  3.61it/s]
 82%|████████▏ | 305871/371472 [2:10:37<5:04:27,  3.59it/s]
 82%|████████▏ | 305872/371472 [2:10:37<5:07:30,  3.56it/s]
 82%|████████▏ | 305873/371472 [2:10:37<5:04:18,  3.59it/s]
 82%|████████▏ | 305874/371472 [2:10:38<5:16:56,  3.45it/s]
 82%|████████▏ | 305875/371472 [2:10:38<5:13:14,  3.49it/s]
 82%|████████▏ | 305876/371472 [2:10:38<5:05:17,  3.58it/s]
 82%|████████▏ | 305877/371472 [2:10:38<5:40:28,  3.21it/s]
 82%|████████▏ | 305878/371472 [2:10:39<5:36:10,  3.25it/s]
 82%|████████▏ | 305879/371472 [2:10:39<5:53:31,  3.09it/s]
 82%|████████▏ | 305880/371472 [2:10:39<5:40:36,  3.21it/s]
                                                           
{'loss': 2.6292, 'learning_rate': 2.590014867805813e-07, 'epoch': 13.17}

 82%|████████▏ | 305880/371472 [2:10:39<5:40:36,  3.21it/s]
 82%|████████▏ | 305881/371472 [2:10:40<5:23:11,  3.38it/s]
 82%|████████▏ | 305882/371472 [2:10:40<5:05:34,  3.58it/s]
 82%|████████▏ | 305883/371472 [2:10:40<5:02:11,  3.62it/s]
 82%|████████▏ | 305884/371472 [2:10:40<5:07:18,  3.56it/s]
 82%|████████▏ | 305885/371472 [2:10:41<5:24:56,  3.36it/s]
 82%|████████▏ | 305886/371472 [2:10:41<5:15:53,  3.46it/s]
 82%|████████▏ | 305887/371472 [2:10:41<4:57:30,  3.67it/s]
 82%|████████▏ | 305888/371472 [2:10:42<4:52:17,  3.74it/s]
 82%|████████▏ | 305889/371472 [2:10:42<4:54:01,  3.72it/s]
 82%|████████▏ | 305890/371472 [2:10:42<4:45:18,  3.83it/s]
 82%|████████▏ | 305891/371472 [2:10:42<5:14:08,  3.48it/s]
 82%|████████▏ | 305892/371472 [2:10:43<5:04:14,  3.59it/s]
 82%|████████▏ | 305893/371472 [2:10:43<5:08:42,  3.54it/s]
 82%|████████▏ | 305894/371472 [2:10:43<5:08:52,  3.54it/s]
 82%|████████▏ | 305895/371472 [2:10:44<5:08:47,  3.54it/s]
 82%|████████▏ | 305896/371472 [2:10:44<5:25:48,  3.35it/s]
 82%|████████▏ | 305897/371472 [2:10:44<5:23:26,  3.38it/s]
 82%|████████▏ | 305898/371472 [2:10:44<5:17:10,  3.45it/s]
 82%|████████▏ | 305899/371472 [2:10:45<5:05:49,  3.57it/s]
 82%|████████▏ | 305900/371472 [2:10:45<4:58:38,  3.66it/s]
                                                           
{'loss': 2.6403, 'learning_rate': 2.5895300480510245e-07, 'epoch': 13.18}

 82%|████████▏ | 305900/371472 [2:10:45<4:58:38,  3.66it/s]
 82%|████████▏ | 305901/371472 [2:10:45<4:56:09,  3.69it/s]
 82%|████████▏ | 305902/371472 [2:10:46<4:59:28,  3.65it/s]
 82%|████████▏ | 305903/371472 [2:10:46<5:07:01,  3.56it/s]
 82%|████████▏ | 305904/371472 [2:10:46<5:01:58,  3.62it/s]
 82%|████████▏ | 305905/371472 [2:10:46<5:21:25,  3.40it/s]
 82%|████████▏ | 305906/371472 [2:10:47<5:09:25,  3.53it/s]
 82%|████████▏ | 305907/371472 [2:10:47<5:04:39,  3.59it/s]
 82%|████████▏ | 305908/371472 [2:10:47<4:55:41,  3.70it/s]
 82%|████████▏ | 305909/371472 [2:10:47<4:58:03,  3.67it/s]
 82%|████████▏ | 305910/371472 [2:10:48<5:07:46,  3.55it/s]
 82%|████████▏ | 305911/371472 [2:10:48<5:02:55,  3.61it/s]
 82%|████████▏ | 305912/371472 [2:10:48<4:56:03,  3.69it/s]
 82%|████████▏ | 305913/371472 [2:10:49<5:18:36,  3.43it/s]
 82%|████████▏ | 305914/371472 [2:10:49<5:03:34,  3.60it/s]
 82%|████████▏ | 305915/371472 [2:10:49<5:05:11,  3.58it/s]
 82%|████████▏ | 305916/371472 [2:10:49<5:05:17,  3.58it/s]
 82%|████████▏ | 305917/371472 [2:10:50<5:03:59,  3.59it/s]
 82%|████████▏ | 305918/371472 [2:10:50<5:11:42,  3.51it/s]
 82%|████████▏ | 305919/371472 [2:10:50<5:33:30,  3.28it/s]
 82%|████████▏ | 305920/371472 [2:10:51<5:39:49,  3.21it/s]
                                                           
{'loss': 2.5729, 'learning_rate': 2.5890452282962347e-07, 'epoch': 13.18}

 82%|████████▏ | 305920/371472 [2:10:51<5:39:49,  3.21it/s]
 82%|████████▏ | 305921/371472 [2:10:51<5:31:19,  3.30it/s]
 82%|████████▏ | 305922/371472 [2:10:51<5:24:34,  3.37it/s]
 82%|████████▏ | 305923/371472 [2:10:52<5:16:30,  3.45it/s]
 82%|████████▏ | 305924/371472 [2:10:52<5:11:06,  3.51it/s]
 82%|████████▏ | 305925/371472 [2:10:52<5:32:50,  3.28it/s]
 82%|████████▏ | 305926/371472 [2:10:52<5:36:55,  3.24it/s]
 82%|████████▏ | 305927/371472 [2:10:53<5:25:51,  3.35it/s]
 82%|████████▏ | 305928/371472 [2:10:53<5:09:48,  3.53it/s]
 82%|████████▏ | 305929/371472 [2:10:53<5:00:05,  3.64it/s]
 82%|████████▏ | 305930/371472 [2:10:54<5:03:38,  3.60it/s]
 82%|████████▏ | 305931/371472 [2:10:54<5:16:38,  3.45it/s]
 82%|████████▏ | 305932/371472 [2:10:54<5:09:29,  3.53it/s]
 82%|████████▏ | 305933/371472 [2:10:54<5:00:41,  3.63it/s]
 82%|████████▏ | 305934/371472 [2:10:55<5:03:56,  3.59it/s]
 82%|████████▏ | 305935/371472 [2:10:55<5:02:52,  3.61it/s]
 82%|████████▏ | 305936/371472 [2:10:55<5:03:56,  3.59it/s]
 82%|████████▏ | 305937/371472 [2:10:56<5:08:47,  3.54it/s]
 82%|████████▏ | 305938/371472 [2:10:56<5:07:50,  3.55it/s]
 82%|████████▏ | 305939/371472 [2:10:56<5:04:22,  3.59it/s]
 82%|████████▏ | 305940/371472 [2:10:56<5:15:40,  3.46it/s]
                                                           
{'loss': 2.6555, 'learning_rate': 2.588560408541447e-07, 'epoch': 13.18}

 82%|████████▏ | 305940/371472 [2:10:56<5:15:40,  3.46it/s]
 82%|████████▏ | 305941/371472 [2:10:57<5:43:32,  3.18it/s]
 82%|████████▏ | 305942/371472 [2:10:57<5:48:33,  3.13it/s]
 82%|████████▏ | 305943/371472 [2:10:57<6:05:18,  2.99it/s]
 82%|████████▏ | 305944/371472 [2:10:58<5:38:27,  3.23it/s]
 82%|████████▏ | 305945/371472 [2:10:58<5:26:15,  3.35it/s]
 82%|████████▏ | 305946/371472 [2:10:58<5:18:55,  3.42it/s]
 82%|████████▏ | 305947/371472 [2:10:59<5:23:19,  3.38it/s]
 82%|████████▏ | 305948/371472 [2:10:59<5:18:43,  3.43it/s]
 82%|████████▏ | 305949/371472 [2:10:59<5:15:52,  3.46it/s]
 82%|████████▏ | 305950/371472 [2:10:59<5:03:06,  3.60it/s]
 82%|████████▏ | 305951/371472 [2:11:00<5:24:58,  3.36it/s]
 82%|████████▏ | 305952/371472 [2:11:00<5:09:49,  3.52it/s]
 82%|████████▏ | 305953/371472 [2:11:00<5:07:41,  3.55it/s]
 82%|████████▏ | 305954/371472 [2:11:01<5:24:27,  3.37it/s]
 82%|████████▏ | 305955/371472 [2:11:01<5:10:42,  3.51it/s]
 82%|████████▏ | 305956/371472 [2:11:01<5:18:54,  3.42it/s]
 82%|████████▏ | 305957/371472 [2:11:01<5:07:32,  3.55it/s]
 82%|████████▏ | 305958/371472 [2:11:02<5:10:31,  3.52it/s]
 82%|████████▏ | 305959/371472 [2:11:02<4:57:54,  3.67it/s]
 82%|████████▏ | 305960/371472 [2:11:02<4:53:02,  3.73it/s]
                                                           
{'loss': 2.6704, 'learning_rate': 2.5880755887866577e-07, 'epoch': 13.18}

 82%|████████▏ | 305960/371472 [2:11:02<4:53:02,  3.73it/s]
 82%|████████▏ | 305961/371472 [2:11:03<5:13:48,  3.48it/s]
 82%|████████▏ | 305962/371472 [2:11:03<5:03:16,  3.60it/s]
 82%|████████▏ | 305963/371472 [2:11:03<5:11:49,  3.50it/s]
 82%|████████▏ | 305964/371472 [2:11:03<5:07:55,  3.55it/s]
 82%|████████▏ | 305965/371472 [2:11:04<4:57:48,  3.67it/s]
 82%|████████▏ | 305966/371472 [2:11:04<4:56:33,  3.68it/s]
 82%|████████▏ | 305967/371472 [2:11:04<5:01:47,  3.62it/s]
 82%|████████▏ | 305968/371472 [2:11:04<5:04:55,  3.58it/s]
 82%|████████▏ | 305969/371472 [2:11:05<5:02:50,  3.60it/s]
 82%|████████▏ | 305970/371472 [2:11:05<5:07:49,  3.55it/s]
 82%|████████▏ | 305971/371472 [2:11:05<5:11:31,  3.50it/s]
 82%|████████▏ | 305972/371472 [2:11:06<5:11:43,  3.50it/s]
 82%|████████▏ | 305973/371472 [2:11:06<5:10:11,  3.52it/s]
 82%|████████▏ | 305974/371472 [2:11:06<5:19:05,  3.42it/s]
 82%|████████▏ | 305975/371472 [2:11:06<5:08:06,  3.54it/s]
 82%|████████▏ | 305976/371472 [2:11:07<5:23:35,  3.37it/s]
 82%|████████▏ | 305977/371472 [2:11:07<5:29:00,  3.32it/s]
 82%|████████▏ | 305978/371472 [2:11:07<5:17:26,  3.44it/s]
 82%|████████▏ | 305979/371472 [2:11:08<5:14:12,  3.47it/s]
 82%|████████▏ | 305980/371472 [2:11:08<5:05:10,  3.58it/s]
                                                           
{'loss': 2.4828, 'learning_rate': 2.587590769031869e-07, 'epoch': 13.18}

 82%|████████▏ | 305980/371472 [2:11:08<5:05:10,  3.58it/s]
 82%|████████▏ | 305981/371472 [2:11:08<4:53:51,  3.71it/s]
 82%|████████▏ | 305982/371472 [2:11:09<5:28:42,  3.32it/s]
 82%|████████▏ | 305983/371472 [2:11:09<5:27:18,  3.33it/s]
 82%|████████▏ | 305984/371472 [2:11:09<5:29:10,  3.32it/s]
 82%|████████▏ | 305985/371472 [2:11:09<5:12:55,  3.49it/s]
 82%|████████▏ | 305986/371472 [2:11:10<5:18:10,  3.43it/s]
 82%|████████▏ | 305987/371472 [2:11:10<5:15:03,  3.46it/s]
 82%|████████▏ | 305988/371472 [2:11:10<5:09:50,  3.52it/s]
 82%|████████▏ | 305989/371472 [2:11:10<5:02:00,  3.61it/s]
 82%|████████▏ | 305990/371472 [2:11:11<4:58:36,  3.65it/s]
 82%|████████▏ | 305991/371472 [2:11:11<4:47:09,  3.80it/s]
 82%|████████▏ | 305992/371472 [2:11:11<4:46:07,  3.81it/s]
 82%|████████▏ | 305993/371472 [2:11:12<4:43:42,  3.85it/s]
 82%|████████▏ | 305994/371472 [2:11:12<4:53:01,  3.72it/s]
 82%|████████▏ | 305995/371472 [2:11:12<5:06:14,  3.56it/s]
 82%|████████▏ | 305996/371472 [2:11:12<5:02:51,  3.60it/s]
 82%|████████▏ | 305997/371472 [2:11:13<5:10:28,  3.51it/s]
 82%|████████▏ | 305998/371472 [2:11:13<5:11:03,  3.51it/s]
 82%|████████▏ | 305999/371472 [2:11:13<5:06:12,  3.56it/s]
 82%|████████▏ | 306000/371472 [2:11:14<5:02:10,  3.61it/s]
                                                           
{'loss': 2.7224, 'learning_rate': 2.5871059492770797e-07, 'epoch': 13.18}

 82%|████████▏ | 306000/371472 [2:11:14<5:02:10,  3.61it/s]
 82%|████████▏ | 306001/371472 [2:11:14<4:57:03,  3.67it/s]
 82%|████████▏ | 306002/371472 [2:11:14<4:52:20,  3.73it/s]
 82%|████████▏ | 306003/371472 [2:11:14<5:09:25,  3.53it/s]
 82%|████████▏ | 306004/371472 [2:11:15<5:04:26,  3.58it/s]
 82%|████████▏ | 306005/371472 [2:11:15<5:50:00,  3.12it/s]
 82%|████████▏ | 306006/371472 [2:11:15<5:29:03,  3.32it/s]
 82%|████████▏ | 306007/371472 [2:11:16<5:16:07,  3.45it/s]
 82%|████████▏ | 306008/371472 [2:11:16<5:03:15,  3.60it/s]
 82%|████████▏ | 306009/371472 [2:11:16<5:00:31,  3.63it/s]
 82%|████████▏ | 306010/371472 [2:11:16<5:12:25,  3.49it/s]
 82%|████████▏ | 306011/371472 [2:11:17<5:20:55,  3.40it/s]
 82%|████████▏ | 306012/371472 [2:11:17<5:16:37,  3.45it/s]
 82%|████████▏ | 306013/371472 [2:11:17<5:03:03,  3.60it/s]
 82%|████████▏ | 306014/371472 [2:11:17<4:50:57,  3.75it/s]
 82%|████████▏ | 306015/371472 [2:11:18<4:46:54,  3.80it/s]
 82%|████████▏ | 306016/371472 [2:11:18<4:38:23,  3.92it/s]
 82%|████████▏ | 306017/371472 [2:11:18<4:48:20,  3.78it/s]
 82%|████████▏ | 306018/371472 [2:11:19<4:53:16,  3.72it/s]
 82%|████████▏ | 306019/371472 [2:11:19<5:07:13,  3.55it/s]
 82%|████████▏ | 306020/371472 [2:11:19<5:00:18,  3.63it/s]
                                                           
{'loss': 2.5742, 'learning_rate': 2.586621129522291e-07, 'epoch': 13.18}

 82%|████████▏ | 306020/371472 [2:11:19<5:00:18,  3.63it/s]
 82%|████████▏ | 306021/371472 [2:11:19<5:04:10,  3.59it/s]
 82%|████████▏ | 306022/371472 [2:11:20<5:03:58,  3.59it/s]
 82%|████████▏ | 306023/371472 [2:11:20<6:37:55,  2.74it/s]
 82%|████████▏ | 306024/371472 [2:11:21<6:16:11,  2.90it/s]
 82%|████████▏ | 306025/371472 [2:11:21<5:48:39,  3.13it/s]
 82%|████████▏ | 306026/371472 [2:11:21<5:28:48,  3.32it/s]
 82%|████████▏ | 306027/371472 [2:11:21<5:31:35,  3.29it/s]
 82%|████████▏ | 306028/371472 [2:11:22<5:51:25,  3.10it/s]
 82%|████████▏ | 306029/371472 [2:11:22<5:50:04,  3.12it/s]
 82%|████████▏ | 306030/371472 [2:11:22<5:24:09,  3.36it/s]
 82%|████████▏ | 306031/371472 [2:11:23<5:10:29,  3.51it/s]
 82%|████████▏ | 306032/371472 [2:11:23<5:23:31,  3.37it/s]
 82%|████████▏ | 306033/371472 [2:11:23<5:07:13,  3.55it/s]
 82%|████████▏ | 306034/371472 [2:11:23<5:03:22,  3.60it/s]
 82%|████████▏ | 306035/371472 [2:11:24<5:09:36,  3.52it/s]
 82%|████████▏ | 306036/371472 [2:11:24<5:27:54,  3.33it/s]
 82%|████████▏ | 306037/371472 [2:11:24<5:10:07,  3.52it/s]
 82%|████████▏ | 306038/371472 [2:11:24<4:54:27,  3.70it/s]
 82%|████████▏ | 306039/371472 [2:11:25<4:57:06,  3.67it/s]
 82%|████████▏ | 306040/371472 [2:11:25<4:59:47,  3.64it/s]
                                                           
{'loss': 2.4122, 'learning_rate': 2.5861363097675016e-07, 'epoch': 13.18}

 82%|████████▏ | 306040/371472 [2:11:25<4:59:47,  3.64it/s]
 82%|████████▏ | 306041/371472 [2:11:25<4:59:50,  3.64it/s]
 82%|████████▏ | 306042/371472 [2:11:26<5:08:16,  3.54it/s]
 82%|████████▏ | 306043/371472 [2:11:26<5:23:22,  3.37it/s]
 82%|████████▏ | 306044/371472 [2:11:26<5:15:24,  3.46it/s]
 82%|████████▏ | 306045/371472 [2:11:27<5:09:13,  3.53it/s]
 82%|████████▏ | 306046/371472 [2:11:27<5:11:09,  3.50it/s]
 82%|████████▏ | 306047/371472 [2:11:27<4:56:26,  3.68it/s]
 82%|████████▏ | 306048/371472 [2:11:27<5:47:06,  3.14it/s]
 82%|████████▏ | 306049/371472 [2:11:28<5:21:08,  3.40it/s]
 82%|████████▏ | 306050/371472 [2:11:28<5:33:23,  3.27it/s]
 82%|████████▏ | 306051/371472 [2:11:28<5:46:59,  3.14it/s]
 82%|████████▏ | 306052/371472 [2:11:29<5:41:44,  3.19it/s]
 82%|████████▏ | 306053/371472 [2:11:29<5:25:57,  3.34it/s]
 82%|████████▏ | 306054/371472 [2:11:29<5:13:16,  3.48it/s]
 82%|████████▏ | 306055/371472 [2:11:29<5:03:09,  3.60it/s]
 82%|████████▏ | 306056/371472 [2:11:30<4:57:06,  3.67it/s]
 82%|████████▏ | 306057/371472 [2:11:30<4:56:30,  3.68it/s]
 82%|████████▏ | 306058/371472 [2:11:30<5:01:09,  3.62it/s]
 82%|████████▏ | 306059/371472 [2:11:31<4:51:35,  3.74it/s]
 82%|████████▏ | 306060/371472 [2:11:31<5:00:34,  3.63it/s]
                                                           
{'loss': 2.6164, 'learning_rate': 2.5856514900127134e-07, 'epoch': 13.18}

 82%|████████▏ | 306060/371472 [2:11:31<5:00:34,  3.63it/s]
 82%|████████▏ | 306061/371472 [2:11:31<6:10:31,  2.94it/s]
 82%|████████▏ | 306062/371472 [2:11:32<5:46:20,  3.15it/s]
 82%|████████▏ | 306063/371472 [2:11:32<5:37:17,  3.23it/s]
 82%|████████▏ | 306064/371472 [2:11:32<5:19:40,  3.41it/s]
 82%|████████▏ | 306065/371472 [2:11:32<5:04:02,  3.59it/s]
 82%|████████▏ | 306066/371472 [2:11:33<5:02:40,  3.60it/s]
 82%|████████▏ | 306067/371472 [2:11:33<5:06:03,  3.56it/s]
 82%|████████▏ | 306068/371472 [2:11:33<4:56:23,  3.68it/s]
 82%|████████▏ | 306069/371472 [2:11:33<5:08:39,  3.53it/s]
 82%|████████▏ | 306070/371472 [2:11:34<5:09:25,  3.52it/s]
 82%|████████▏ | 306071/371472 [2:11:34<5:02:11,  3.61it/s]
 82%|████████▏ | 306072/371472 [2:11:34<4:55:57,  3.68it/s]
 82%|████████▏ | 306073/371472 [2:11:35<5:23:54,  3.37it/s]
 82%|████████▏ | 306074/371472 [2:11:35<5:26:35,  3.34it/s]
 82%|████████▏ | 306075/371472 [2:11:35<5:14:00,  3.47it/s]
 82%|████████▏ | 306076/371472 [2:11:35<5:05:21,  3.57it/s]
 82%|████████▏ | 306077/371472 [2:11:36<5:06:38,  3.55it/s]
 82%|████████▏ | 306078/371472 [2:11:36<5:04:11,  3.58it/s]
 82%|████████▏ | 306079/371472 [2:11:36<5:08:29,  3.53it/s]
 82%|████████▏ | 306080/371472 [2:11:37<5:00:09,  3.63it/s]
                                                           
{'loss': 2.6388, 'learning_rate': 2.585166670257924e-07, 'epoch': 13.18}

 82%|████████▏ | 306080/371472 [2:11:37<5:00:09,  3.63it/s]
 82%|████████▏ | 306081/371472 [2:11:37<6:03:14,  3.00it/s]
 82%|████████▏ | 306082/371472 [2:11:37<5:37:11,  3.23it/s]
 82%|████████▏ | 306083/371472 [2:11:38<5:39:09,  3.21it/s]
 82%|████████▏ | 306084/371472 [2:11:38<5:33:07,  3.27it/s]
 82%|████████▏ | 306085/371472 [2:11:38<5:13:56,  3.47it/s]
 82%|████████▏ | 306086/371472 [2:11:38<4:57:46,  3.66it/s]
 82%|████████▏ | 306087/371472 [2:11:39<4:57:06,  3.67it/s]
 82%|████████▏ | 306088/371472 [2:11:39<5:09:56,  3.52it/s]
 82%|████████▏ | 306089/371472 [2:11:39<5:21:55,  3.39it/s]
 82%|████████▏ | 306090/371472 [2:11:40<5:11:39,  3.50it/s]
 82%|████████▏ | 306091/371472 [2:11:40<5:17:39,  3.43it/s]
 82%|████████▏ | 306092/371472 [2:11:40<4:59:32,  3.64it/s]
 82%|████████▏ | 306093/371472 [2:11:40<4:52:44,  3.72it/s]
 82%|████████▏ | 306094/371472 [2:11:41<4:56:21,  3.68it/s]
 82%|████████▏ | 306095/371472 [2:11:41<5:01:44,  3.61it/s]
 82%|████████▏ | 306096/371472 [2:11:41<4:57:59,  3.66it/s]
 82%|████████▏ | 306097/371472 [2:11:41<4:54:42,  3.70it/s]
 82%|████████▏ | 306098/371472 [2:11:42<4:55:47,  3.68it/s]
 82%|████████▏ | 306099/371472 [2:11:42<4:56:32,  3.67it/s]
 82%|████████▏ | 306100/371472 [2:11:42<4:49:43,  3.76it/s]
                                                           
{'loss': 2.4858, 'learning_rate': 2.5846818505031354e-07, 'epoch': 13.18}

 82%|████████▏ | 306100/371472 [2:11:42<4:49:43,  3.76it/s]
 82%|████████▏ | 306101/371472 [2:11:43<4:49:55,  3.76it/s]
 82%|████████▏ | 306102/371472 [2:11:43<4:56:40,  3.67it/s]
 82%|████████▏ | 306103/371472 [2:11:43<4:44:20,  3.83it/s]
 82%|████████▏ | 306104/371472 [2:11:43<5:19:42,  3.41it/s]
 82%|████████▏ | 306105/371472 [2:11:44<5:02:41,  3.60it/s]
 82%|████████▏ | 306106/371472 [2:11:44<4:59:24,  3.64it/s]
 82%|████████▏ | 306107/371472 [2:11:44<5:02:18,  3.60it/s]
 82%|████████▏ | 306108/371472 [2:11:44<4:54:25,  3.70it/s]
 82%|████████▏ | 306109/371472 [2:11:45<4:49:40,  3.76it/s]
 82%|████████▏ | 306110/371472 [2:11:45<5:01:23,  3.61it/s]
 82%|████████▏ | 306111/371472 [2:11:45<5:08:08,  3.54it/s]
 82%|████████▏ | 306112/371472 [2:11:46<5:00:55,  3.62it/s]
 82%|████████▏ | 306113/371472 [2:11:46<4:49:15,  3.77it/s]
 82%|████████▏ | 306114/371472 [2:11:46<4:51:19,  3.74it/s]
 82%|████████▏ | 306115/371472 [2:11:46<5:00:28,  3.63it/s]
 82%|████████▏ | 306116/371472 [2:11:47<4:47:22,  3.79it/s]
 82%|████████▏ | 306117/371472 [2:11:47<4:42:18,  3.86it/s]
 82%|████████▏ | 306118/371472 [2:11:47<5:01:37,  3.61it/s]
 82%|████████▏ | 306119/371472 [2:11:47<4:47:16,  3.79it/s]
 82%|████████▏ | 306120/371472 [2:11:48<4:44:56,  3.82it/s]
                                                           
{'loss': 2.6263, 'learning_rate': 2.584197030748346e-07, 'epoch': 13.19}

 82%|████████▏ | 306120/371472 [2:11:48<4:44:56,  3.82it/s]
 82%|████████▏ | 306121/371472 [2:11:48<4:37:53,  3.92it/s]
 82%|████████▏ | 306122/371472 [2:11:48<4:45:36,  3.81it/s]
 82%|████████▏ | 306123/371472 [2:11:49<5:08:26,  3.53it/s]
 82%|████████▏ | 306124/371472 [2:11:49<5:13:38,  3.47it/s]
 82%|████████▏ | 306125/371472 [2:11:49<5:00:48,  3.62it/s]
 82%|████████▏ | 306126/371472 [2:11:49<4:47:49,  3.78it/s]
 82%|████████▏ | 306127/371472 [2:11:50<4:50:59,  3.74it/s]
 82%|████████▏ | 306128/371472 [2:11:50<5:01:03,  3.62it/s]
 82%|████████▏ | 306129/371472 [2:11:50<4:58:07,  3.65it/s]
 82%|████████▏ | 306130/371472 [2:11:50<5:01:13,  3.62it/s]
 82%|████████▏ | 306131/371472 [2:11:51<5:05:40,  3.56it/s]
 82%|████████▏ | 306132/371472 [2:11:51<5:25:53,  3.34it/s]
 82%|████████▏ | 306133/371472 [2:11:51<5:11:17,  3.50it/s]
 82%|████████▏ | 306134/371472 [2:11:52<5:21:15,  3.39it/s]
 82%|████████▏ | 306135/371472 [2:11:52<5:17:40,  3.43it/s]
 82%|████████▏ | 306136/371472 [2:11:52<5:05:44,  3.56it/s]
 82%|████████▏ | 306137/371472 [2:11:52<5:16:45,  3.44it/s]
 82%|████████▏ | 306138/371472 [2:11:53<5:36:28,  3.24it/s]
 82%|████████▏ | 306139/371472 [2:11:53<5:19:23,  3.41it/s]
 82%|████████▏ | 306140/371472 [2:11:53<5:00:08,  3.63it/s]
                                                           
{'loss': 2.6685, 'learning_rate': 2.5837122109935573e-07, 'epoch': 13.19}

 82%|████████▏ | 306140/371472 [2:11:53<5:00:08,  3.63it/s]
 82%|████████▏ | 306141/371472 [2:11:54<5:01:45,  3.61it/s]
 82%|████████▏ | 306142/371472 [2:11:54<5:05:19,  3.57it/s]
 82%|████████▏ | 306143/371472 [2:11:54<5:03:58,  3.58it/s]
 82%|████████▏ | 306144/371472 [2:11:54<4:55:48,  3.68it/s]
 82%|████████▏ | 306145/371472 [2:11:55<5:11:14,  3.50it/s]
 82%|████████▏ | 306146/371472 [2:11:55<5:00:15,  3.63it/s]
 82%|████████▏ | 306147/371472 [2:11:55<4:57:24,  3.66it/s]
 82%|████████▏ | 306148/371472 [2:11:56<5:18:08,  3.42it/s]
 82%|████████▏ | 306149/371472 [2:11:56<5:10:22,  3.51it/s]
 82%|████████▏ | 306150/371472 [2:11:56<5:18:55,  3.41it/s]
 82%|████████▏ | 306151/371472 [2:11:56<5:11:20,  3.50it/s]
 82%|████████▏ | 306152/371472 [2:11:57<5:21:57,  3.38it/s]
 82%|████████▏ | 306153/371472 [2:11:57<5:06:31,  3.55it/s]
 82%|████████▏ | 306154/371472 [2:11:57<5:00:17,  3.63it/s]
 82%|████████▏ | 306155/371472 [2:11:58<4:59:46,  3.63it/s]
 82%|████████▏ | 306156/371472 [2:11:58<4:53:34,  3.71it/s]
 82%|████████▏ | 306157/371472 [2:11:58<5:00:16,  3.63it/s]
 82%|████████▏ | 306158/371472 [2:11:58<5:12:49,  3.48it/s]
 82%|████████▏ | 306159/371472 [2:11:59<5:03:45,  3.58it/s]
 82%|████████▏ | 306160/371472 [2:11:59<4:58:09,  3.65it/s]
                                                           
{'loss': 2.6296, 'learning_rate': 2.583227391238768e-07, 'epoch': 13.19}

 82%|████████▏ | 306160/371472 [2:11:59<4:58:09,  3.65it/s]
 82%|████████▏ | 306161/371472 [2:11:59<5:06:17,  3.55it/s]
 82%|████████▏ | 306162/371472 [2:12:00<5:02:02,  3.60it/s]
 82%|████████▏ | 306163/371472 [2:12:00<5:00:01,  3.63it/s]
 82%|████████▏ | 306164/371472 [2:12:00<5:10:25,  3.51it/s]
 82%|████████▏ | 306165/371472 [2:12:00<5:13:54,  3.47it/s]
 82%|████████▏ | 306166/371472 [2:12:01<5:05:47,  3.56it/s]
 82%|████████▏ | 306167/371472 [2:12:01<5:10:44,  3.50it/s]
 82%|████████▏ | 306168/371472 [2:12:01<5:03:08,  3.59it/s]
 82%|████████▏ | 306169/371472 [2:12:01<4:59:35,  3.63it/s]
 82%|████████▏ | 306170/371472 [2:12:02<4:49:28,  3.76it/s]
 82%|████████▏ | 306171/371472 [2:12:02<5:23:10,  3.37it/s]
 82%|████████▏ | 306172/371472 [2:12:02<5:15:34,  3.45it/s]
 82%|████████▏ | 306173/371472 [2:12:03<5:09:51,  3.51it/s]
 82%|████████▏ | 306174/371472 [2:12:03<5:08:49,  3.52it/s]
 82%|████████▏ | 306175/371472 [2:12:03<5:16:10,  3.44it/s]
 82%|████████▏ | 306176/371472 [2:12:03<5:06:24,  3.55it/s]
 82%|████████▏ | 306177/371472 [2:12:04<5:33:25,  3.26it/s]
 82%|████████▏ | 306178/371472 [2:12:04<5:30:41,  3.29it/s]
 82%|████████▏ | 306179/371472 [2:12:04<5:12:22,  3.48it/s]
 82%|████████▏ | 306180/371472 [2:12:05<5:01:28,  3.61it/s]
                                                           
{'loss': 2.4683, 'learning_rate': 2.58274257148398e-07, 'epoch': 13.19}

 82%|████████▏ | 306180/371472 [2:12:05<5:01:28,  3.61it/s]
 82%|████████▏ | 306181/371472 [2:12:05<4:55:27,  3.68it/s]
 82%|████████▏ | 306182/371472 [2:12:05<4:57:43,  3.65it/s]
 82%|████████▏ | 306183/371472 [2:12:06<5:13:04,  3.48it/s]
 82%|████████▏ | 306184/371472 [2:12:06<4:56:55,  3.66it/s]
 82%|████████▏ | 306185/371472 [2:12:06<5:10:49,  3.50it/s]
 82%|████████▏ | 306186/371472 [2:12:06<5:45:10,  3.15it/s]
 82%|████████▏ | 306187/371472 [2:12:07<5:25:23,  3.34it/s]
 82%|████████▏ | 306188/371472 [2:12:07<5:10:02,  3.51it/s]
 82%|████████▏ | 306189/371472 [2:12:07<5:06:12,  3.55it/s]
 82%|████████▏ | 306190/371472 [2:12:08<5:03:23,  3.59it/s]
 82%|████████▏ | 306191/371472 [2:12:08<5:08:38,  3.53it/s]
 82%|████████▏ | 306192/371472 [2:12:08<4:59:17,  3.64it/s]
 82%|████████▏ | 306193/371472 [2:12:08<4:58:31,  3.64it/s]
 82%|████████▏ | 306194/371472 [2:12:09<4:54:46,  3.69it/s]
 82%|████████▏ | 306195/371472 [2:12:09<5:02:24,  3.60it/s]
 82%|████████▏ | 306196/371472 [2:12:09<5:08:32,  3.53it/s]
 82%|████████▏ | 306197/371472 [2:12:09<4:58:25,  3.65it/s]
 82%|████████▏ | 306198/371472 [2:12:10<5:08:13,  3.53it/s]
 82%|████████▏ | 306199/371472 [2:12:10<4:55:51,  3.68it/s]
 82%|████████▏ | 306200/371472 [2:12:10<4:55:03,  3.69it/s]
                                                           
{'loss': 2.5284, 'learning_rate': 2.5822577517291905e-07, 'epoch': 13.19}

 82%|████████▏ | 306200/371472 [2:12:10<4:55:03,  3.69it/s]
 82%|████████▏ | 306201/371472 [2:12:11<4:45:19,  3.81it/s]
 82%|████████▏ | 306202/371472 [2:12:11<4:42:53,  3.85it/s]
 82%|████████▏ | 306203/371472 [2:12:11<4:52:04,  3.72it/s]
 82%|████████▏ | 306204/371472 [2:12:11<5:09:38,  3.51it/s]
 82%|████████▏ | 306205/371472 [2:12:12<5:02:49,  3.59it/s]
 82%|████████▏ | 306206/371472 [2:12:12<4:58:19,  3.65it/s]
 82%|████████▏ | 306207/371472 [2:12:12<4:51:09,  3.74it/s]
 82%|████████▏ | 306208/371472 [2:12:12<4:45:53,  3.80it/s]
 82%|████████▏ | 306209/371472 [2:12:13<5:12:33,  3.48it/s]
 82%|████████▏ | 306210/371472 [2:12:13<5:28:04,  3.32it/s]
 82%|████████▏ | 306211/371472 [2:12:13<5:13:28,  3.47it/s]
 82%|████████▏ | 306212/371472 [2:12:14<5:08:07,  3.53it/s]
 82%|████████▏ | 306213/371472 [2:12:14<5:15:28,  3.45it/s]
 82%|████████▏ | 306214/371472 [2:12:14<5:11:47,  3.49it/s]
 82%|████████▏ | 306215/371472 [2:12:15<5:38:12,  3.22it/s]
 82%|████████▏ | 306216/371472 [2:12:15<5:29:34,  3.30it/s]
 82%|████████▏ | 306217/371472 [2:12:15<5:14:18,  3.46it/s]
 82%|████████▏ | 306218/371472 [2:12:15<5:12:13,  3.48it/s]
 82%|████████▏ | 306219/371472 [2:12:16<5:20:07,  3.40it/s]
 82%|████████▏ | 306220/371472 [2:12:16<5:06:31,  3.55it/s]
                                                           
{'loss': 2.7702, 'learning_rate': 2.581772931974401e-07, 'epoch': 13.19}

 82%|████████▏ | 306220/371472 [2:12:16<5:06:31,  3.55it/s]
 82%|████████▏ | 306221/371472 [2:12:16<5:09:43,  3.51it/s]
 82%|████████▏ | 306222/371472 [2:12:17<5:04:53,  3.57it/s]
 82%|████████▏ | 306223/371472 [2:12:17<4:56:36,  3.67it/s]
 82%|████████▏ | 306224/371472 [2:12:17<5:07:33,  3.54it/s]
 82%|████████▏ | 306225/371472 [2:12:17<5:20:03,  3.40it/s]
 82%|████████▏ | 306226/371472 [2:12:18<5:12:27,  3.48it/s]
 82%|████████▏ | 306227/371472 [2:12:18<5:14:59,  3.45it/s]
 82%|████████▏ | 306228/371472 [2:12:18<5:05:08,  3.56it/s]
 82%|████████▏ | 306229/371472 [2:12:19<5:12:41,  3.48it/s]
 82%|████████▏ | 306230/371472 [2:12:19<5:06:08,  3.55it/s]
 82%|████████▏ | 306231/371472 [2:12:19<5:18:18,  3.42it/s]
 82%|████████▏ | 306232/371472 [2:12:19<5:16:27,  3.44it/s]
 82%|████████▏ | 306233/371472 [2:12:20<5:07:27,  3.54it/s]
 82%|████████▏ | 306234/371472 [2:12:20<5:06:27,  3.55it/s]
 82%|████████▏ | 306235/371472 [2:12:20<5:00:52,  3.61it/s]
 82%|████████▏ | 306236/371472 [2:12:20<4:56:06,  3.67it/s]
 82%|████████▏ | 306237/371472 [2:12:21<5:00:14,  3.62it/s]
 82%|████████▏ | 306238/371472 [2:12:21<5:00:45,  3.61it/s]
 82%|████████▏ | 306239/371472 [2:12:21<4:55:53,  3.67it/s]
 82%|████████▏ | 306240/371472 [2:12:22<5:04:01,  3.58it/s]
                                                           
{'loss': 2.708, 'learning_rate': 2.5812881122196125e-07, 'epoch': 13.19}

 82%|████████▏ | 306240/371472 [2:12:22<5:04:01,  3.58it/s]
 82%|████████▏ | 306241/371472 [2:12:22<4:56:03,  3.67it/s]
 82%|████████▏ | 306242/371472 [2:12:22<5:09:27,  3.51it/s]
 82%|████████▏ | 306243/371472 [2:12:22<5:07:18,  3.54it/s]
 82%|████████▏ | 306244/371472 [2:12:23<4:58:29,  3.64it/s]
 82%|████████▏ | 306245/371472 [2:12:23<5:00:33,  3.62it/s]
 82%|████████▏ | 306246/371472 [2:12:23<4:59:10,  3.63it/s]
 82%|████████▏ | 306247/371472 [2:12:23<4:52:31,  3.72it/s]
 82%|████████▏ | 306248/371472 [2:12:24<4:52:37,  3.71it/s]
 82%|████████▏ | 306249/371472 [2:12:24<4:47:28,  3.78it/s]
 82%|████████▏ | 306250/371472 [2:12:24<4:40:33,  3.87it/s]
 82%|████████▏ | 306251/371472 [2:12:25<5:07:07,  3.54it/s]
 82%|████████▏ | 306252/371472 [2:12:25<5:07:32,  3.53it/s]
 82%|████████▏ | 306253/371472 [2:12:25<4:57:42,  3.65it/s]
 82%|████████▏ | 306254/371472 [2:12:25<5:12:43,  3.48it/s]
 82%|████████▏ | 306255/371472 [2:12:26<5:25:00,  3.34it/s]
 82%|████████▏ | 306256/371472 [2:12:26<5:19:20,  3.40it/s]
 82%|████████▏ | 306257/371472 [2:12:26<5:02:37,  3.59it/s]
 82%|████████▏ | 306258/371472 [2:12:27<5:03:28,  3.58it/s]
 82%|████████▏ | 306259/371472 [2:12:27<4:59:31,  3.63it/s]
 82%|████████▏ | 306260/371472 [2:12:27<5:01:08,  3.61it/s]
                                                           
{'loss': 2.6489, 'learning_rate': 2.580803292464823e-07, 'epoch': 13.19}

 82%|████████▏ | 306260/371472 [2:12:27<5:01:08,  3.61it/s]
 82%|████████▏ | 306261/371472 [2:12:27<5:00:40,  3.61it/s]
 82%|████████▏ | 306262/371472 [2:12:28<5:19:33,  3.40it/s]
 82%|████████▏ | 306263/371472 [2:12:28<5:02:44,  3.59it/s]
 82%|████████▏ | 306264/371472 [2:12:28<4:51:08,  3.73it/s]
 82%|████████▏ | 306265/371472 [2:12:28<4:49:11,  3.76it/s]
 82%|████████▏ | 306266/371472 [2:12:29<4:44:03,  3.83it/s]
 82%|████████▏ | 306267/371472 [2:12:29<4:43:52,  3.83it/s]
 82%|████████▏ | 306268/371472 [2:12:29<5:10:32,  3.50it/s]
 82%|████████▏ | 306269/371472 [2:12:30<5:43:00,  3.17it/s]
 82%|████████▏ | 306270/371472 [2:12:30<5:26:37,  3.33it/s]
 82%|████████▏ | 306271/371472 [2:12:30<5:18:34,  3.41it/s]
 82%|████████▏ | 306272/371472 [2:12:31<5:41:13,  3.18it/s]
 82%|████████▏ | 306273/371472 [2:12:31<5:36:03,  3.23it/s]
 82%|████████▏ | 306274/371472 [2:12:31<5:42:18,  3.17it/s]
 82%|████████▏ | 306275/371472 [2:12:32<5:32:05,  3.27it/s]
 82%|████████▏ | 306276/371472 [2:12:32<5:18:50,  3.41it/s]
 82%|████████▏ | 306277/371472 [2:12:32<5:46:20,  3.14it/s]
 82%|████████▏ | 306278/371472 [2:12:32<5:31:38,  3.28it/s]
 82%|████████▏ | 306279/371472 [2:12:33<5:29:26,  3.30it/s]
 82%|████████▏ | 306280/371472 [2:12:33<5:31:32,  3.28it/s]
                                                           
{'loss': 2.7037, 'learning_rate': 2.5803184727100344e-07, 'epoch': 13.19}

 82%|████████▏ | 306280/371472 [2:12:33<5:31:32,  3.28it/s]
 82%|████████▏ | 306281/371472 [2:12:33<5:21:19,  3.38it/s]
 82%|████████▏ | 306282/371472 [2:12:34<5:22:04,  3.37it/s]
 82%|████████▏ | 306283/371472 [2:12:34<5:12:44,  3.47it/s]
 82%|████████▏ | 306284/371472 [2:12:34<4:58:21,  3.64it/s]
 82%|████████▏ | 306285/371472 [2:12:34<5:02:36,  3.59it/s]
 82%|████████▏ | 306286/371472 [2:12:35<5:04:47,  3.56it/s]
 82%|████████▏ | 306287/371472 [2:12:35<5:04:30,  3.57it/s]
 82%|████████▏ | 306288/371472 [2:12:35<5:33:13,  3.26it/s]
 82%|████████▏ | 306289/371472 [2:12:36<5:12:45,  3.47it/s]
 82%|████████▏ | 306290/371472 [2:12:36<4:58:31,  3.64it/s]
 82%|████████▏ | 306291/371472 [2:12:36<5:04:09,  3.57it/s]
 82%|████████▏ | 306292/371472 [2:12:36<4:57:01,  3.66it/s]
 82%|████████▏ | 306293/371472 [2:12:37<5:07:36,  3.53it/s]
 82%|████████▏ | 306294/371472 [2:12:37<5:02:13,  3.59it/s]
 82%|████████▏ | 306295/371472 [2:12:37<4:58:50,  3.63it/s]
 82%|████████▏ | 306296/371472 [2:12:38<4:53:11,  3.70it/s]
 82%|████████▏ | 306297/371472 [2:12:38<5:23:46,  3.35it/s]
 82%|████████▏ | 306298/371472 [2:12:38<5:05:08,  3.56it/s]
 82%|████████▏ | 306299/371472 [2:12:38<5:00:48,  3.61it/s]
 82%|████████▏ | 306300/371472 [2:12:39<5:06:24,  3.54it/s]
                                                           
{'loss': 2.488, 'learning_rate': 2.579833652955245e-07, 'epoch': 13.19}

 82%|████████▏ | 306300/371472 [2:12:39<5:06:24,  3.54it/s]
 82%|████████▏ | 306301/371472 [2:12:39<5:10:31,  3.50it/s]
 82%|████████▏ | 306302/371472 [2:12:39<5:29:46,  3.29it/s]
 82%|████████▏ | 306303/371472 [2:12:40<5:12:51,  3.47it/s]
 82%|████████▏ | 306304/371472 [2:12:40<5:10:14,  3.50it/s]
 82%|████████▏ | 306305/371472 [2:12:40<5:08:16,  3.52it/s]
 82%|████████▏ | 306306/371472 [2:12:40<5:08:21,  3.52it/s]
 82%|████████▏ | 306307/371472 [2:12:41<4:56:28,  3.66it/s]
 82%|████████▏ | 306308/371472 [2:12:41<5:02:35,  3.59it/s]
 82%|████████▏ | 306309/371472 [2:12:41<4:56:31,  3.66it/s]
 82%|████████▏ | 306310/371472 [2:12:42<5:00:30,  3.61it/s]
 82%|████████▏ | 306311/371472 [2:12:42<4:55:57,  3.67it/s]
 82%|████████▏ | 306312/371472 [2:12:42<5:06:34,  3.54it/s]
 82%|████████▏ | 306313/371472 [2:12:42<4:59:19,  3.63it/s]
 82%|████████▏ | 306314/371472 [2:12:43<4:59:49,  3.62it/s]
 82%|████████▏ | 306315/371472 [2:12:43<5:07:13,  3.53it/s]
 82%|████████▏ | 306316/371472 [2:12:43<4:55:42,  3.67it/s]
 82%|████████▏ | 306317/371472 [2:12:43<5:00:59,  3.61it/s]
 82%|████████▏ | 306318/371472 [2:12:44<4:51:35,  3.72it/s]
 82%|████████▏ | 306319/371472 [2:12:44<4:52:08,  3.72it/s]
 82%|████████▏ | 306320/371472 [2:12:44<4:52:05,  3.72it/s]
                                                           
{'loss': 2.7993, 'learning_rate': 2.579348833200457e-07, 'epoch': 13.19}

 82%|████████▏ | 306320/371472 [2:12:44<4:52:05,  3.72it/s]
 82%|████████▏ | 306321/371472 [2:12:45<5:00:08,  3.62it/s]
 82%|████████▏ | 306322/371472 [2:12:45<5:28:23,  3.31it/s]
 82%|████████▏ | 306323/371472 [2:12:45<5:17:00,  3.43it/s]
 82%|████████▏ | 306324/371472 [2:12:45<5:06:26,  3.54it/s]
 82%|████████▏ | 306325/371472 [2:12:46<5:03:52,  3.57it/s]
 82%|████████▏ | 306326/371472 [2:12:46<5:35:39,  3.23it/s]
 82%|████████▏ | 306327/371472 [2:12:46<5:26:06,  3.33it/s]
 82%|████████▏ | 306328/371472 [2:12:47<5:16:20,  3.43it/s]
 82%|████████▏ | 306329/371472 [2:12:47<5:10:13,  3.50it/s]
 82%|████████▏ | 306330/371472 [2:12:47<5:28:55,  3.30it/s]
 82%|████████▏ | 306331/371472 [2:12:47<5:16:15,  3.43it/s]
 82%|████████▏ | 306332/371472 [2:12:48<5:08:12,  3.52it/s]
 82%|████████▏ | 306333/371472 [2:12:48<5:28:31,  3.30it/s]
 82%|████████▏ | 306334/371472 [2:12:48<5:17:35,  3.42it/s]
 82%|████████▏ | 306335/371472 [2:12:49<5:03:00,  3.58it/s]
 82%|████████▏ | 306336/371472 [2:12:49<4:58:26,  3.64it/s]
 82%|████████▏ | 306337/371472 [2:12:49<4:56:56,  3.66it/s]
 82%|████████▏ | 306338/371472 [2:12:49<5:01:59,  3.59it/s]
 82%|████████▏ | 306339/371472 [2:12:50<4:49:03,  3.76it/s]
 82%|████████▏ | 306340/371472 [2:12:50<4:44:16,  3.82it/s]
                                                           
{'loss': 2.6552, 'learning_rate': 2.5788640134456677e-07, 'epoch': 13.19}

 82%|████████▏ | 306340/371472 [2:12:50<4:44:16,  3.82it/s]
 82%|████████▏ | 306341/371472 [2:12:50<4:42:58,  3.84it/s]
 82%|████████▏ | 306342/371472 [2:12:50<4:42:08,  3.85it/s]
 82%|████████▏ | 306343/371472 [2:12:51<4:41:18,  3.86it/s]
 82%|████████▏ | 306344/371472 [2:12:51<4:46:22,  3.79it/s]
 82%|████████▏ | 306345/371472 [2:12:51<4:55:38,  3.67it/s]
 82%|████████▏ | 306346/371472 [2:12:52<5:32:25,  3.27it/s]
 82%|████████▏ | 306347/371472 [2:12:52<5:19:27,  3.40it/s]
 82%|████████▏ | 306348/371472 [2:12:52<5:06:08,  3.55it/s]
 82%|████████▏ | 306349/371472 [2:12:52<4:55:40,  3.67it/s]
 82%|████████▏ | 306350/371472 [2:12:53<4:48:54,  3.76it/s]
 82%|████████▏ | 306351/371472 [2:12:53<4:43:38,  3.83it/s]
 82%|████████▏ | 306352/371472 [2:12:53<4:42:38,  3.84it/s]
 82%|████████▏ | 306353/371472 [2:12:53<4:47:48,  3.77it/s]
 82%|████████▏ | 306354/371472 [2:12:54<4:49:36,  3.75it/s]
 82%|████████▏ | 306355/371472 [2:12:54<4:54:45,  3.68it/s]
 82%|████████▏ | 306356/371472 [2:12:54<4:59:50,  3.62it/s]
 82%|████████▏ | 306357/371472 [2:12:55<5:03:00,  3.58it/s]
 82%|████████▏ | 306358/371472 [2:12:55<5:04:53,  3.56it/s]
 82%|████████▏ | 306359/371472 [2:12:55<5:02:15,  3.59it/s]
 82%|████████▏ | 306360/371472 [2:12:55<5:00:34,  3.61it/s]
                                                           
{'loss': 2.5938, 'learning_rate': 2.578379193690879e-07, 'epoch': 13.2}

 82%|████████▏ | 306360/371472 [2:12:55<5:00:34,  3.61it/s]
 82%|████████▏ | 306361/371472 [2:12:56<5:03:45,  3.57it/s]
 82%|████████▏ | 306362/371472 [2:12:56<5:07:40,  3.53it/s]
 82%|████████▏ | 306363/371472 [2:12:56<5:01:19,  3.60it/s]
 82%|████████▏ | 306364/371472 [2:12:57<5:21:36,  3.37it/s]
 82%|████████▏ | 306365/371472 [2:12:57<5:27:37,  3.31it/s]
 82%|████████▏ | 306366/371472 [2:12:57<5:16:34,  3.43it/s]
 82%|████████▏ | 306367/371472 [2:12:57<5:01:48,  3.60it/s]
 82%|████████▏ | 306368/371472 [2:12:58<4:59:59,  3.62it/s]
 82%|████████▏ | 306369/371472 [2:12:58<5:18:26,  3.41it/s]
 82%|████████▏ | 306370/371472 [2:12:58<5:07:42,  3.53it/s]
 82%|████████▏ | 306371/371472 [2:12:59<5:02:56,  3.58it/s]
 82%|████████▏ | 306372/371472 [2:12:59<5:12:41,  3.47it/s]
 82%|████████▏ | 306373/371472 [2:12:59<5:11:47,  3.48it/s]
 82%|████████▏ | 306374/371472 [2:12:59<5:05:23,  3.55it/s]
 82%|████████▏ | 306375/371472 [2:13:00<4:57:01,  3.65it/s]
 82%|████████▏ | 306376/371472 [2:13:00<5:00:52,  3.61it/s]
 82%|████████▏ | 306377/371472 [2:13:00<4:59:53,  3.62it/s]
 82%|████████▏ | 306378/371472 [2:13:01<5:09:21,  3.51it/s]
 82%|████████▏ | 306379/371472 [2:13:01<5:05:31,  3.55it/s]
 82%|████████▏ | 306380/371472 [2:13:01<5:01:43,  3.60it/s]
                                                           
{'loss': 2.7372, 'learning_rate': 2.5778943739360896e-07, 'epoch': 13.2}

 82%|████████▏ | 306380/371472 [2:13:01<5:01:43,  3.60it/s]
 82%|████████▏ | 306381/371472 [2:13:01<4:56:39,  3.66it/s]
 82%|████████▏ | 306382/371472 [2:13:02<4:57:18,  3.65it/s]
 82%|████████▏ | 306383/371472 [2:13:02<4:58:05,  3.64it/s]
 82%|████████▏ | 306384/371472 [2:13:02<4:50:42,  3.73it/s]
 82%|████████▏ | 306385/371472 [2:13:02<5:01:26,  3.60it/s]
 82%|████████▏ | 306386/371472 [2:13:03<5:26:18,  3.32it/s]
 82%|████████▏ | 306387/371472 [2:13:03<5:59:44,  3.02it/s]
 82%|████████▏ | 306388/371472 [2:13:04<5:59:16,  3.02it/s]
 82%|████████▏ | 306389/371472 [2:13:04<5:51:32,  3.09it/s]
 82%|████████▏ | 306390/371472 [2:13:04<5:46:31,  3.13it/s]
 82%|████████▏ | 306391/371472 [2:13:04<5:29:39,  3.29it/s]
 82%|████████▏ | 306392/371472 [2:13:05<5:15:17,  3.44it/s]
 82%|████████▏ | 306393/371472 [2:13:05<5:09:54,  3.50it/s]
 82%|████████▏ | 306394/371472 [2:13:05<5:19:13,  3.40it/s]
 82%|████████▏ | 306395/371472 [2:13:06<5:05:25,  3.55it/s]
 82%|████████▏ | 306396/371472 [2:13:06<5:08:13,  3.52it/s]
 82%|████████▏ | 306397/371472 [2:13:06<6:13:06,  2.91it/s]
 82%|████████▏ | 306398/371472 [2:13:07<5:48:50,  3.11it/s]
 82%|████████▏ | 306399/371472 [2:13:07<5:31:01,  3.28it/s]
 82%|████████▏ | 306400/371472 [2:13:07<5:16:21,  3.43it/s]
                                                           
{'loss': 2.6503, 'learning_rate': 2.577409554181301e-07, 'epoch': 13.2}

 82%|████████▏ | 306400/371472 [2:13:07<5:16:21,  3.43it/s]
 82%|████████▏ | 306401/371472 [2:13:07<5:03:27,  3.57it/s]
 82%|████████▏ | 306402/371472 [2:13:08<5:21:15,  3.38it/s]
 82%|████████▏ | 306403/371472 [2:13:08<5:10:37,  3.49it/s]
 82%|████████▏ | 306404/371472 [2:13:08<5:12:12,  3.47it/s]
 82%|████████▏ | 306405/371472 [2:13:09<5:07:48,  3.52it/s]
 82%|████████▏ | 306406/371472 [2:13:09<4:58:18,  3.64it/s]
 82%|████████▏ | 306407/371472 [2:13:09<4:54:57,  3.68it/s]
 82%|████████▏ | 306408/371472 [2:13:09<4:56:16,  3.66it/s]
 82%|████████▏ | 306409/371472 [2:13:10<4:46:27,  3.79it/s]
 82%|████████▏ | 306410/371472 [2:13:10<5:08:11,  3.52it/s]
 82%|████████▏ | 306411/371472 [2:13:10<5:21:36,  3.37it/s]
 82%|████████▏ | 306412/371472 [2:13:11<5:22:04,  3.37it/s]
 82%|████████▏ | 306413/371472 [2:13:11<5:07:02,  3.53it/s]
 82%|████████▏ | 306414/371472 [2:13:11<4:57:56,  3.64it/s]
 82%|████████▏ | 306415/371472 [2:13:11<5:02:02,  3.59it/s]
 82%|████████▏ | 306416/371472 [2:13:12<5:01:44,  3.59it/s]
 82%|████████▏ | 306417/371472 [2:13:12<5:02:27,  3.58it/s]
 82%|████████▏ | 306418/371472 [2:13:12<5:09:00,  3.51it/s]
 82%|████████▏ | 306419/371472 [2:13:13<5:34:07,  3.24it/s]
 82%|████████▏ | 306420/371472 [2:13:13<5:21:54,  3.37it/s]
                                                           
{'loss': 2.5986, 'learning_rate': 2.5769247344265116e-07, 'epoch': 13.2}

 82%|████████▏ | 306420/371472 [2:13:13<5:21:54,  3.37it/s]
 82%|████████▏ | 306421/371472 [2:13:13<5:08:38,  3.51it/s]
 82%|████████▏ | 306422/371472 [2:13:13<5:04:44,  3.56it/s]
 82%|████████▏ | 306423/371472 [2:13:14<5:09:43,  3.50it/s]
 82%|████████▏ | 306424/371472 [2:13:14<4:59:33,  3.62it/s]
 82%|████████▏ | 306425/371472 [2:13:14<5:04:38,  3.56it/s]
 82%|████████▏ | 306426/371472 [2:13:14<4:57:49,  3.64it/s]
 82%|████████▏ | 306427/371472 [2:13:15<4:48:02,  3.76it/s]
 82%|████████▏ | 306428/371472 [2:13:15<4:51:40,  3.72it/s]
 82%|████████▏ | 306429/371472 [2:13:15<4:51:51,  3.71it/s]
 82%|████████▏ | 306430/371472 [2:13:15<4:47:01,  3.78it/s]
 82%|████████▏ | 306431/371472 [2:13:16<4:49:46,  3.74it/s]
 82%|████████▏ | 306432/371472 [2:13:16<4:49:27,  3.74it/s]
 82%|████████▏ | 306433/371472 [2:13:16<4:47:41,  3.77it/s]
 82%|████████▏ | 306434/371472 [2:13:17<4:48:08,  3.76it/s]
 82%|████████▏ | 306435/371472 [2:13:17<4:42:54,  3.83it/s]
 82%|████████▏ | 306436/371472 [2:13:17<4:42:34,  3.84it/s]
 82%|████████▏ | 306437/371472 [2:13:17<4:40:44,  3.86it/s]
 82%|████████▏ | 306438/371472 [2:13:18<4:53:50,  3.69it/s]
 82%|████████▏ | 306439/371472 [2:13:18<4:53:42,  3.69it/s]
 82%|████████▏ | 306440/371472 [2:13:18<4:52:33,  3.70it/s]
                                                           
{'loss': 2.6749, 'learning_rate': 2.576439914671724e-07, 'epoch': 13.2}

 82%|████████▏ | 306440/371472 [2:13:18<4:52:33,  3.70it/s]
 82%|████████▏ | 306441/371472 [2:13:18<4:49:29,  3.74it/s]
 82%|████████▏ | 306442/371472 [2:13:19<5:30:45,  3.28it/s]
 82%|████████▏ | 306443/371472 [2:13:19<5:19:11,  3.40it/s]
 82%|████████▏ | 306444/371472 [2:13:19<5:03:42,  3.57it/s]
 82%|████████▏ | 306445/371472 [2:13:20<5:03:57,  3.57it/s]
 82%|████████▏ | 306446/371472 [2:13:20<5:05:16,  3.55it/s]
 82%|████████▏ | 306447/371472 [2:13:20<5:13:25,  3.46it/s]
 82%|████████▏ | 306448/371472 [2:13:20<5:04:05,  3.56it/s]
 82%|████████▏ | 306449/371472 [2:13:21<5:03:46,  3.57it/s]
 82%|████████▏ | 306450/371472 [2:13:21<4:53:14,  3.70it/s]
 82%|████████▏ | 306451/371472 [2:13:21<4:46:52,  3.78it/s]
 82%|████████▏ | 306452/371472 [2:13:21<4:46:50,  3.78it/s]
 82%|████████▏ | 306453/371472 [2:13:22<4:44:48,  3.80it/s]
 82%|████████▏ | 306454/371472 [2:13:22<4:45:21,  3.80it/s]
 82%|████████▏ | 306455/371472 [2:13:22<4:52:26,  3.71it/s]
 82%|████████▏ | 306456/371472 [2:13:23<4:50:25,  3.73it/s]
 82%|████████▏ | 306457/371472 [2:13:23<4:47:42,  3.77it/s]
 82%|████████▏ | 306458/371472 [2:13:23<4:55:59,  3.66it/s]
 82%|████████▏ | 306459/371472 [2:13:23<5:04:40,  3.56it/s]
 82%|████████▏ | 306460/371472 [2:13:24<4:58:39,  3.63it/s]
                                                           
{'loss': 2.5863, 'learning_rate': 2.575955094916934e-07, 'epoch': 13.2}

 82%|████████▏ | 306460/371472 [2:13:24<4:58:39,  3.63it/s]
 82%|████████▏ | 306461/371472 [2:13:24<4:53:31,  3.69it/s]
 82%|████████▏ | 306462/371472 [2:13:24<4:50:19,  3.73it/s]
 82%|████████▏ | 306463/371472 [2:13:24<4:48:01,  3.76it/s]
 82%|████████▏ | 306464/371472 [2:13:25<4:41:39,  3.85it/s]
 83%|████████▎ | 306465/371472 [2:13:25<4:52:42,  3.70it/s]
 83%|████████▎ | 306466/371472 [2:13:25<4:49:45,  3.74it/s]
 83%|████████▎ | 306467/371472 [2:13:26<5:12:23,  3.47it/s]
 83%|████████▎ | 306468/371472 [2:13:26<5:42:34,  3.16it/s]
 83%|████████▎ | 306469/371472 [2:13:26<5:28:36,  3.30it/s]
 83%|████████▎ | 306470/371472 [2:13:27<5:16:33,  3.42it/s]
 83%|████████▎ | 306471/371472 [2:13:27<5:12:03,  3.47it/s]
 83%|████████▎ | 306472/371472 [2:13:27<5:21:54,  3.37it/s]
 83%|████████▎ | 306473/371472 [2:13:27<5:17:05,  3.42it/s]
 83%|████████▎ | 306474/371472 [2:13:28<5:14:31,  3.44it/s]
 83%|████████▎ | 306475/371472 [2:13:28<5:14:49,  3.44it/s]
 83%|████████▎ | 306476/371472 [2:13:28<5:17:09,  3.42it/s]
 83%|████████▎ | 306477/371472 [2:13:29<5:14:58,  3.44it/s]
 83%|████████▎ | 306478/371472 [2:13:29<5:08:31,  3.51it/s]
 83%|████████▎ | 306479/371472 [2:13:29<5:34:20,  3.24it/s]
 83%|████████▎ | 306480/371472 [2:13:29<5:30:16,  3.28it/s]
                                                           
{'loss': 2.53, 'learning_rate': 2.5754702751621453e-07, 'epoch': 13.2}

 83%|████████▎ | 306480/371472 [2:13:29<5:30:16,  3.28it/s]
 83%|████████▎ | 306481/371472 [2:13:30<5:20:49,  3.38it/s]
 83%|████████▎ | 306482/371472 [2:13:30<5:34:14,  3.24it/s]
 83%|████████▎ | 306483/371472 [2:13:30<5:37:25,  3.21it/s]
 83%|████████▎ | 306484/371472 [2:13:31<5:34:43,  3.24it/s]
 83%|████████▎ | 306485/371472 [2:13:31<5:20:59,  3.37it/s]
 83%|████████▎ | 306486/371472 [2:13:31<5:10:44,  3.49it/s]
 83%|████████▎ | 306487/371472 [2:13:32<4:59:23,  3.62it/s]
 83%|████████▎ | 306488/371472 [2:13:32<5:02:49,  3.58it/s]
 83%|████████▎ | 306489/371472 [2:13:32<4:56:45,  3.65it/s]
 83%|████████▎ | 306490/371472 [2:13:32<5:00:03,  3.61it/s]
 83%|████████▎ | 306491/371472 [2:13:33<5:00:28,  3.60it/s]
 83%|████████▎ | 306492/371472 [2:13:33<5:02:43,  3.58it/s]
 83%|████████▎ | 306493/371472 [2:13:33<4:58:50,  3.62it/s]
 83%|████████▎ | 306494/371472 [2:13:33<4:49:33,  3.74it/s]
 83%|████████▎ | 306495/371472 [2:13:34<4:57:52,  3.64it/s]
 83%|████████▎ | 306496/371472 [2:13:34<5:02:46,  3.58it/s]
 83%|████████▎ | 306497/371472 [2:13:34<4:56:36,  3.65it/s]
 83%|████████▎ | 306498/371472 [2:13:35<5:08:07,  3.51it/s]
 83%|████████▎ | 306499/371472 [2:13:35<5:18:22,  3.40it/s]
 83%|████████▎ | 306500/371472 [2:13:35<5:25:04,  3.33it/s]
                                                           
{'loss': 2.642, 'learning_rate': 2.574985455407356e-07, 'epoch': 13.2}

 83%|████████▎ | 306500/371472 [2:13:35<5:25:04,  3.33it/s]
 83%|████████▎ | 306501/371472 [2:13:35<5:07:28,  3.52it/s]
 83%|████████▎ | 306502/371472 [2:13:36<5:08:44,  3.51it/s]
 83%|████████▎ | 306503/371472 [2:13:36<5:13:09,  3.46it/s]
 83%|████████▎ | 306504/371472 [2:13:36<5:16:51,  3.42it/s]
 83%|████████▎ | 306505/371472 [2:13:37<5:05:17,  3.55it/s]
 83%|████████▎ | 306506/371472 [2:13:37<4:53:57,  3.68it/s]
 83%|████████▎ | 306507/371472 [2:13:37<4:47:12,  3.77it/s]
 83%|████████▎ | 306508/371472 [2:13:37<4:50:05,  3.73it/s]
 83%|████████▎ | 306509/371472 [2:13:38<4:47:36,  3.76it/s]
 83%|████████▎ | 306510/371472 [2:13:38<4:57:24,  3.64it/s]
 83%|████████▎ | 306511/371472 [2:13:38<4:56:52,  3.65it/s]
 83%|████████▎ | 306512/371472 [2:13:38<4:49:55,  3.73it/s]
 83%|████████▎ | 306513/371472 [2:13:39<4:53:23,  3.69it/s]
 83%|████████▎ | 306514/371472 [2:13:39<5:21:52,  3.36it/s]
 83%|████████▎ | 306515/371472 [2:13:39<5:39:05,  3.19it/s]
 83%|████████▎ | 306516/371472 [2:13:40<5:27:22,  3.31it/s]
 83%|████████▎ | 306517/371472 [2:13:40<5:17:13,  3.41it/s]
 83%|████████▎ | 306518/371472 [2:13:40<5:10:32,  3.49it/s]
 83%|████████▎ | 306519/371472 [2:13:41<5:02:47,  3.58it/s]
 83%|████████▎ | 306520/371472 [2:13:41<4:57:58,  3.63it/s]
                                                           
{'loss': 2.6451, 'learning_rate': 2.574500635652567e-07, 'epoch': 13.2}

 83%|████████▎ | 306520/371472 [2:13:41<4:57:58,  3.63it/s]
 83%|████████▎ | 306521/371472 [2:13:41<4:52:19,  3.70it/s]
 83%|████████▎ | 306522/371472 [2:13:41<4:53:11,  3.69it/s]
 83%|████████▎ | 306523/371472 [2:13:42<4:57:30,  3.64it/s]
 83%|████████▎ | 306524/371472 [2:13:42<4:51:19,  3.72it/s]
 83%|████████▎ | 306525/371472 [2:13:42<4:49:32,  3.74it/s]
 83%|████████▎ | 306526/371472 [2:13:42<4:43:17,  3.82it/s]
 83%|████████▎ | 306527/371472 [2:13:43<4:41:23,  3.85it/s]
 83%|████████▎ | 306528/371472 [2:13:43<4:51:12,  3.72it/s]
 83%|████████▎ | 306529/371472 [2:13:43<4:57:28,  3.64it/s]
 83%|████████▎ | 306530/371472 [2:13:44<5:15:28,  3.43it/s]
 83%|████████▎ | 306531/371472 [2:13:44<5:13:32,  3.45it/s]
 83%|████████▎ | 306532/371472 [2:13:44<5:09:55,  3.49it/s]
 83%|████████▎ | 306533/371472 [2:13:44<5:12:49,  3.46it/s]
 83%|████████▎ | 306534/371472 [2:13:45<5:06:51,  3.53it/s]
 83%|████████▎ | 306535/371472 [2:13:45<4:53:56,  3.68it/s]
 83%|████████▎ | 306536/371472 [2:13:45<4:47:23,  3.77it/s]
 83%|████████▎ | 306537/371472 [2:13:45<4:37:40,  3.90it/s]
 83%|████████▎ | 306538/371472 [2:13:46<4:37:09,  3.90it/s]
 83%|████████▎ | 306539/371472 [2:13:46<5:02:34,  3.58it/s]
 83%|████████▎ | 306540/371472 [2:13:46<5:13:54,  3.45it/s]
                                                           
{'loss': 2.5487, 'learning_rate': 2.574015815897778e-07, 'epoch': 13.2}

 83%|████████▎ | 306540/371472 [2:13:46<5:13:54,  3.45it/s]
 83%|████████▎ | 306541/371472 [2:13:47<5:02:04,  3.58it/s]
 83%|████████▎ | 306542/371472 [2:13:47<5:04:56,  3.55it/s]
 83%|████████▎ | 306543/371472 [2:13:47<5:03:12,  3.57it/s]
 83%|████████▎ | 306544/371472 [2:13:47<5:17:26,  3.41it/s]
 83%|████████▎ | 306545/371472 [2:13:48<5:32:47,  3.25it/s]
 83%|████████▎ | 306546/371472 [2:13:48<5:20:30,  3.38it/s]
 83%|████████▎ | 306547/371472 [2:13:48<5:18:04,  3.40it/s]
 83%|████████▎ | 306548/371472 [2:13:49<5:22:37,  3.35it/s]
 83%|████████▎ | 306549/371472 [2:13:49<5:08:49,  3.50it/s]
 83%|████████▎ | 306550/371472 [2:13:49<5:11:36,  3.47it/s]
 83%|████████▎ | 306551/371472 [2:13:49<5:12:17,  3.46it/s]
 83%|████████▎ | 306552/371472 [2:13:50<4:59:13,  3.62it/s]
 83%|████████▎ | 306553/371472 [2:13:50<5:35:35,  3.22it/s]
 83%|████████▎ | 306554/371472 [2:13:50<5:23:27,  3.35it/s]
 83%|████████▎ | 306555/371472 [2:13:51<5:34:56,  3.23it/s]
 83%|████████▎ | 306556/371472 [2:13:51<5:25:27,  3.32it/s]
 83%|████████▎ | 306557/371472 [2:13:51<5:21:09,  3.37it/s]
 83%|████████▎ | 306558/371472 [2:13:52<5:11:21,  3.47it/s]
 83%|████████▎ | 306559/371472 [2:13:52<4:58:40,  3.62it/s]
 83%|████████▎ | 306560/371472 [2:13:52<5:16:25,  3.42it/s]
                                                           
{'loss': 2.6412, 'learning_rate': 2.57353099614299e-07, 'epoch': 13.2}

 83%|████████▎ | 306560/371472 [2:13:52<5:16:25,  3.42it/s]
 83%|████████▎ | 306561/371472 [2:13:52<5:17:45,  3.40it/s]
 83%|████████▎ | 306562/371472 [2:13:53<5:10:39,  3.48it/s]
 83%|████████▎ | 306563/371472 [2:13:53<4:56:18,  3.65it/s]
 83%|████████▎ | 306564/371472 [2:13:53<4:53:53,  3.68it/s]
 83%|████████▎ | 306565/371472 [2:13:54<4:55:00,  3.67it/s]
 83%|████████▎ | 306566/371472 [2:13:54<4:47:08,  3.77it/s]
 83%|████████▎ | 306567/371472 [2:13:54<5:08:21,  3.51it/s]
 83%|████████▎ | 306568/371472 [2:13:54<4:55:53,  3.66it/s]
 83%|████████▎ | 306569/371472 [2:13:55<5:01:11,  3.59it/s]
 83%|████████▎ | 306570/371472 [2:13:55<5:02:17,  3.58it/s]
 83%|████████▎ | 306571/371472 [2:13:55<5:06:45,  3.53it/s]
 83%|████████▎ | 306572/371472 [2:13:55<4:57:24,  3.64it/s]
 83%|████████▎ | 306573/371472 [2:13:56<4:55:16,  3.66it/s]
 83%|████████▎ | 306574/371472 [2:13:56<4:53:34,  3.68it/s]
 83%|████████▎ | 306575/371472 [2:13:56<5:01:21,  3.59it/s]
 83%|████████▎ | 306576/371472 [2:13:57<4:56:33,  3.65it/s]
 83%|████████▎ | 306577/371472 [2:13:57<4:47:14,  3.77it/s]
 83%|████████▎ | 306578/371472 [2:13:57<5:29:24,  3.28it/s]
 83%|████████▎ | 306579/371472 [2:13:58<5:34:44,  3.23it/s]
 83%|████████▎ | 306580/371472 [2:13:58<5:21:39,  3.36it/s]
                                                           
{'loss': 2.6531, 'learning_rate': 2.5730461763882005e-07, 'epoch': 13.2}

 83%|████████▎ | 306580/371472 [2:13:58<5:21:39,  3.36it/s]
 83%|████████▎ | 306581/371472 [2:13:58<5:34:15,  3.24it/s]
 83%|████████▎ | 306582/371472 [2:13:58<5:50:22,  3.09it/s]
 83%|████████▎ | 306583/371472 [2:13:59<6:10:49,  2.92it/s]
 83%|████████▎ | 306584/371472 [2:13:59<5:49:58,  3.09it/s]
 83%|████████▎ | 306585/371472 [2:13:59<5:37:49,  3.20it/s]
 83%|████████▎ | 306586/371472 [2:14:00<5:23:06,  3.35it/s]
 83%|████████▎ | 306587/371472 [2:14:00<5:07:53,  3.51it/s]
 83%|████████▎ | 306588/371472 [2:14:00<5:10:16,  3.49it/s]
 83%|████████▎ | 306589/371472 [2:14:00<4:54:20,  3.67it/s]
 83%|████████▎ | 306590/371472 [2:14:01<4:52:43,  3.69it/s]
 83%|████████▎ | 306591/371472 [2:14:01<5:09:11,  3.50it/s]
 83%|████████▎ | 306592/371472 [2:14:01<5:01:26,  3.59it/s]
 83%|████████▎ | 306593/371472 [2:14:02<4:56:30,  3.65it/s]
 83%|████████▎ | 306594/371472 [2:14:02<5:08:31,  3.50it/s]
 83%|████████▎ | 306595/371472 [2:14:02<4:58:56,  3.62it/s]
 83%|████████▎ | 306596/371472 [2:14:02<4:49:58,  3.73it/s]
 83%|████████▎ | 306597/371472 [2:14:03<4:54:13,  3.67it/s]
 83%|████████▎ | 306598/371472 [2:14:03<4:52:26,  3.70it/s]
 83%|████████▎ | 306599/371472 [2:14:03<4:57:27,  3.63it/s]
 83%|████████▎ | 306600/371472 [2:14:04<4:57:19,  3.64it/s]
                                                           
{'loss': 2.64, 'learning_rate': 2.572561356633412e-07, 'epoch': 13.21}

 83%|████████▎ | 306600/371472 [2:14:04<4:57:19,  3.64it/s]
 83%|████████▎ | 306601/371472 [2:14:04<4:56:58,  3.64it/s]
 83%|████████▎ | 306602/371472 [2:14:04<4:47:59,  3.75it/s]
 83%|████████▎ | 306603/371472 [2:14:04<4:48:36,  3.75it/s]
 83%|████████▎ | 306604/371472 [2:14:05<4:38:06,  3.89it/s]
 83%|████████▎ | 306605/371472 [2:14:05<4:46:59,  3.77it/s]
 83%|████████▎ | 306606/371472 [2:14:05<4:53:37,  3.68it/s]
 83%|████████▎ | 306607/371472 [2:14:05<4:52:29,  3.70it/s]
 83%|████████▎ | 306608/371472 [2:14:06<4:56:43,  3.64it/s]
 83%|████████▎ | 306609/371472 [2:14:06<5:06:00,  3.53it/s]
 83%|████████▎ | 306610/371472 [2:14:06<5:03:23,  3.56it/s]
 83%|████████▎ | 306611/371472 [2:14:07<5:02:14,  3.58it/s]
 83%|████████▎ | 306612/371472 [2:14:07<5:02:04,  3.58it/s]
 83%|████████▎ | 306613/371472 [2:14:07<5:16:12,  3.42it/s]
 83%|████████▎ | 306614/371472 [2:14:07<5:09:09,  3.50it/s]
 83%|████████▎ | 306615/371472 [2:14:08<5:02:41,  3.57it/s]
 83%|████████▎ | 306616/371472 [2:14:08<5:08:33,  3.50it/s]
 83%|████████▎ | 306617/371472 [2:14:08<5:11:42,  3.47it/s]
 83%|████████▎ | 306618/371472 [2:14:09<5:14:44,  3.43it/s]
 83%|████████▎ | 306619/371472 [2:14:09<5:04:27,  3.55it/s]
 83%|████████▎ | 306620/371472 [2:14:09<5:00:59,  3.59it/s]
                                                           
{'loss': 2.6314, 'learning_rate': 2.5720765368786224e-07, 'epoch': 13.21}

 83%|████████▎ | 306620/371472 [2:14:09<5:00:59,  3.59it/s]
 83%|████████▎ | 306621/371472 [2:14:09<5:04:32,  3.55it/s]
 83%|████████▎ | 306622/371472 [2:14:10<5:00:06,  3.60it/s]
 83%|████████▎ | 306623/371472 [2:14:10<5:46:00,  3.12it/s]
 83%|████████▎ | 306624/371472 [2:14:10<5:49:22,  3.09it/s]
 83%|████████▎ | 306625/371472 [2:14:11<5:32:48,  3.25it/s]
 83%|████████▎ | 306626/371472 [2:14:11<5:30:04,  3.27it/s]
 83%|████████▎ | 306627/371472 [2:14:11<5:07:36,  3.51it/s]
 83%|████████▎ | 306628/371472 [2:14:11<5:01:09,  3.59it/s]
 83%|████████▎ | 306629/371472 [2:14:12<5:03:02,  3.57it/s]
 83%|████████▎ | 306630/371472 [2:14:12<5:03:00,  3.57it/s]
 83%|████████▎ | 306631/371472 [2:14:12<5:02:24,  3.57it/s]
 83%|████████▎ | 306632/371472 [2:14:13<4:50:25,  3.72it/s]
 83%|████████▎ | 306633/371472 [2:14:13<4:38:59,  3.87it/s]
 83%|████████▎ | 306634/371472 [2:14:13<4:34:18,  3.94it/s]
 83%|████████▎ | 306635/371472 [2:14:13<4:36:40,  3.91it/s]
 83%|████████▎ | 306636/371472 [2:14:14<4:39:34,  3.87it/s]
 83%|████████▎ | 306637/371472 [2:14:14<4:51:04,  3.71it/s]
 83%|████████▎ | 306638/371472 [2:14:14<4:40:42,  3.85it/s]
 83%|████████▎ | 306639/371472 [2:14:14<4:38:43,  3.88it/s]
 83%|████████▎ | 306640/371472 [2:14:15<4:50:11,  3.72it/s]
                                                           
{'loss': 2.6048, 'learning_rate': 2.5715917171238337e-07, 'epoch': 13.21}

 83%|████████▎ | 306640/371472 [2:14:15<4:50:11,  3.72it/s]
 83%|████████▎ | 306641/371472 [2:14:15<4:52:12,  3.70it/s]
 83%|████████▎ | 306642/371472 [2:14:15<4:56:34,  3.64it/s]
 83%|████████▎ | 306643/371472 [2:14:15<4:56:57,  3.64it/s]
 83%|████████▎ | 306644/371472 [2:14:16<4:56:38,  3.64it/s]
 83%|████████▎ | 306645/371472 [2:14:16<5:01:21,  3.59it/s]
 83%|████████▎ | 306646/371472 [2:14:16<4:59:35,  3.61it/s]
 83%|████████▎ | 306647/371472 [2:14:17<4:51:20,  3.71it/s]
 83%|████████▎ | 306648/371472 [2:14:17<4:46:15,  3.77it/s]
 83%|████████▎ | 306649/371472 [2:14:17<5:00:41,  3.59it/s]
 83%|████████▎ | 306650/371472 [2:14:17<4:55:40,  3.65it/s]
 83%|████████▎ | 306651/371472 [2:14:18<4:56:02,  3.65it/s]
 83%|████████▎ | 306652/371472 [2:14:18<4:50:37,  3.72it/s]
 83%|████████▎ | 306653/371472 [2:14:18<4:52:51,  3.69it/s]
 83%|████████▎ | 306654/371472 [2:14:18<4:45:54,  3.78it/s]
 83%|████████▎ | 306655/371472 [2:14:19<4:39:13,  3.87it/s]
 83%|████████▎ | 306656/371472 [2:14:19<4:35:34,  3.92it/s]
 83%|████████▎ | 306657/371472 [2:14:19<4:38:10,  3.88it/s]
 83%|████████▎ | 306658/371472 [2:14:19<4:40:28,  3.85it/s]
 83%|████████▎ | 306659/371472 [2:14:20<4:53:29,  3.68it/s]
 83%|████████▎ | 306660/371472 [2:14:20<5:13:21,  3.45it/s]
                                                           
{'loss': 2.5858, 'learning_rate': 2.5711068973690444e-07, 'epoch': 13.21}

 83%|████████▎ | 306660/371472 [2:14:20<5:13:21,  3.45it/s]
 83%|████████▎ | 306661/371472 [2:14:20<5:27:51,  3.29it/s]
 83%|████████▎ | 306662/371472 [2:14:21<5:26:33,  3.31it/s]
 83%|████████▎ | 306663/371472 [2:14:21<5:18:29,  3.39it/s]
 83%|████████▎ | 306664/371472 [2:14:21<5:21:51,  3.36it/s]
 83%|████████▎ | 306665/371472 [2:14:22<5:11:02,  3.47it/s]
 83%|████████▎ | 306666/371472 [2:14:22<4:54:59,  3.66it/s]
 83%|████████▎ | 306667/371472 [2:14:22<5:16:02,  3.42it/s]
 83%|████████▎ | 306668/371472 [2:14:22<5:17:16,  3.40it/s]
 83%|████████▎ | 306669/371472 [2:14:23<5:19:27,  3.38it/s]
 83%|████████▎ | 306670/371472 [2:14:23<5:12:45,  3.45it/s]
 83%|████████▎ | 306671/371472 [2:14:23<5:06:30,  3.52it/s]
 83%|████████▎ | 306672/371472 [2:14:24<4:57:54,  3.63it/s]
 83%|████████▎ | 306673/371472 [2:14:24<4:52:53,  3.69it/s]
 83%|████████▎ | 306674/371472 [2:14:24<4:48:49,  3.74it/s]
 83%|████████▎ | 306675/371472 [2:14:24<4:55:21,  3.66it/s]
 83%|████████▎ | 306676/371472 [2:14:25<5:28:53,  3.28it/s]
 83%|████████▎ | 306677/371472 [2:14:25<5:28:52,  3.28it/s]
 83%|████████▎ | 306678/371472 [2:14:25<5:50:10,  3.08it/s]
 83%|████████▎ | 306679/371472 [2:14:26<5:55:40,  3.04it/s]
 83%|████████▎ | 306680/371472 [2:14:26<5:37:15,  3.20it/s]
                                                           
{'loss': 2.5769, 'learning_rate': 2.570622077614256e-07, 'epoch': 13.21}

 83%|████████▎ | 306680/371472 [2:14:26<5:37:15,  3.20it/s]
 83%|████████▎ | 306681/371472 [2:14:26<5:34:53,  3.22it/s]
 83%|████████▎ | 306682/371472 [2:14:27<5:28:23,  3.29it/s]
 83%|████████▎ | 306683/371472 [2:14:27<5:20:26,  3.37it/s]
 83%|████████▎ | 306684/371472 [2:14:27<5:09:03,  3.49it/s]
 83%|████████▎ | 306685/371472 [2:14:27<4:57:56,  3.62it/s]
 83%|████████▎ | 306686/371472 [2:14:28<4:45:44,  3.78it/s]
 83%|████████▎ | 306687/371472 [2:14:28<4:48:12,  3.75it/s]
 83%|████████▎ | 306688/371472 [2:14:28<4:51:01,  3.71it/s]
 83%|████████▎ | 306689/371472 [2:14:28<4:39:05,  3.87it/s]
 83%|████████▎ | 306690/371472 [2:14:29<4:47:07,  3.76it/s]
 83%|████████▎ | 306691/371472 [2:14:29<4:55:58,  3.65it/s]
 83%|████████▎ | 306692/371472 [2:14:29<4:55:57,  3.65it/s]
 83%|████████▎ | 306693/371472 [2:14:30<4:53:25,  3.68it/s]
 83%|████████▎ | 306694/371472 [2:14:30<4:49:20,  3.73it/s]
 83%|████████▎ | 306695/371472 [2:14:30<4:51:00,  3.71it/s]
 83%|████████▎ | 306696/371472 [2:14:30<4:40:29,  3.85it/s]
 83%|████████▎ | 306697/371472 [2:14:31<4:49:28,  3.73it/s]
 83%|████████▎ | 306698/371472 [2:14:31<5:11:44,  3.46it/s]
 83%|████████▎ | 306699/371472 [2:14:31<4:56:15,  3.64it/s]
 83%|████████▎ | 306700/371472 [2:14:31<4:46:31,  3.77it/s]
                                                           
{'loss': 2.7004, 'learning_rate': 2.570137257859467e-07, 'epoch': 13.21}

 83%|████████▎ | 306700/371472 [2:14:31<4:46:31,  3.77it/s]
 83%|████████▎ | 306701/371472 [2:14:32<4:52:20,  3.69it/s]
 83%|████████▎ | 306702/371472 [2:14:32<4:56:33,  3.64it/s]
 83%|████████▎ | 306703/371472 [2:14:32<5:09:16,  3.49it/s]
 83%|████████▎ | 306704/371472 [2:14:33<5:00:31,  3.59it/s]
 83%|████████▎ | 306705/371472 [2:14:33<5:10:46,  3.47it/s]
 83%|████████▎ | 306706/371472 [2:14:33<5:05:13,  3.54it/s]
 83%|████████▎ | 306707/371472 [2:14:33<4:52:12,  3.69it/s]
 83%|████████▎ | 306708/371472 [2:14:34<4:47:19,  3.76it/s]
 83%|████████▎ | 306709/371472 [2:14:34<4:44:33,  3.79it/s]
 83%|████████▎ | 306710/371472 [2:14:34<5:17:12,  3.40it/s]
 83%|████████▎ | 306711/371472 [2:14:35<5:09:00,  3.49it/s]
 83%|████████▎ | 306712/371472 [2:14:35<5:03:15,  3.56it/s]
 83%|████████▎ | 306713/371472 [2:14:35<4:56:32,  3.64it/s]
 83%|████████▎ | 306714/371472 [2:14:35<4:44:03,  3.80it/s]
 83%|████████▎ | 306715/371472 [2:14:36<4:43:40,  3.80it/s]
 83%|████████▎ | 306716/371472 [2:14:36<4:57:04,  3.63it/s]
 83%|████████▎ | 306717/371472 [2:14:36<5:34:01,  3.23it/s]
 83%|████████▎ | 306718/371472 [2:14:37<5:19:05,  3.38it/s]
 83%|████████▎ | 306719/371472 [2:14:37<5:12:13,  3.46it/s]
 83%|████████▎ | 306720/371472 [2:14:37<5:10:21,  3.48it/s]
                                                           
{'loss': 2.6033, 'learning_rate': 2.5696524381046786e-07, 'epoch': 13.21}

 83%|████████▎ | 306720/371472 [2:14:37<5:10:21,  3.48it/s]
 83%|████████▎ | 306721/371472 [2:14:37<5:22:39,  3.34it/s]
 83%|████████▎ | 306722/371472 [2:14:38<5:19:18,  3.38it/s]
 83%|████████▎ | 306723/371472 [2:14:38<5:01:59,  3.57it/s]
 83%|████████▎ | 306724/371472 [2:14:38<4:55:35,  3.65it/s]
 83%|████████▎ | 306725/371472 [2:14:39<5:17:27,  3.40it/s]
 83%|████████▎ | 306726/371472 [2:14:39<4:58:35,  3.61it/s]
 83%|████████▎ | 306727/371472 [2:14:39<4:56:43,  3.64it/s]
 83%|████████▎ | 306728/371472 [2:14:39<4:50:59,  3.71it/s]
 83%|████████▎ | 306729/371472 [2:14:40<4:46:21,  3.77it/s]
 83%|████████▎ | 306730/371472 [2:14:40<5:02:11,  3.57it/s]
 83%|████████▎ | 306731/371472 [2:14:40<5:05:58,  3.53it/s]
 83%|████████▎ | 306732/371472 [2:14:41<5:30:47,  3.26it/s]
 83%|████████▎ | 306733/371472 [2:14:41<5:20:00,  3.37it/s]
 83%|████████▎ | 306734/371472 [2:14:41<5:16:40,  3.41it/s]
 83%|████████▎ | 306735/371472 [2:14:41<5:17:39,  3.40it/s]
 83%|████████▎ | 306736/371472 [2:14:42<5:07:18,  3.51it/s]
 83%|████████▎ | 306737/371472 [2:14:42<4:57:50,  3.62it/s]
 83%|████████▎ | 306738/371472 [2:14:42<5:01:22,  3.58it/s]
 83%|████████▎ | 306739/371472 [2:14:42<4:57:15,  3.63it/s]
 83%|████████▎ | 306740/371472 [2:14:43<4:48:41,  3.74it/s]
                                                           
{'loss': 2.7423, 'learning_rate': 2.569167618349889e-07, 'epoch': 13.21}

 83%|████████▎ | 306740/371472 [2:14:43<4:48:41,  3.74it/s]
 83%|████████▎ | 306741/371472 [2:14:43<4:55:56,  3.65it/s]
 83%|████████▎ | 306742/371472 [2:14:43<4:47:54,  3.75it/s]
 83%|████████▎ | 306743/371472 [2:14:44<5:11:03,  3.47it/s]
 83%|████████▎ | 306744/371472 [2:14:44<5:10:01,  3.48it/s]
 83%|████████▎ | 306745/371472 [2:14:44<5:08:36,  3.50it/s]
 83%|████████▎ | 306746/371472 [2:14:44<5:02:54,  3.56it/s]
 83%|████████▎ | 306747/371472 [2:14:45<4:55:17,  3.65it/s]
 83%|████████▎ | 306748/371472 [2:14:45<4:51:09,  3.71it/s]
 83%|████████▎ | 306749/371472 [2:14:45<4:43:00,  3.81it/s]
 83%|████████▎ | 306750/371472 [2:14:45<4:53:23,  3.68it/s]
 83%|████████▎ | 306751/371472 [2:14:46<4:50:05,  3.72it/s]
 83%|████████▎ | 306752/371472 [2:14:46<5:09:29,  3.49it/s]
 83%|████████▎ | 306753/371472 [2:14:46<5:42:45,  3.15it/s]
 83%|████████▎ | 306754/371472 [2:14:47<5:19:40,  3.37it/s]
 83%|████████▎ | 306755/371472 [2:14:47<5:15:52,  3.41it/s]
 83%|████████▎ | 306756/371472 [2:14:47<5:06:49,  3.52it/s]
 83%|████████▎ | 306757/371472 [2:14:48<5:02:04,  3.57it/s]
 83%|████████▎ | 306758/371472 [2:14:48<4:57:51,  3.62it/s]
 83%|████████▎ | 306759/371472 [2:14:48<5:42:27,  3.15it/s]
 83%|████████▎ | 306760/371472 [2:14:48<5:19:43,  3.37it/s]
                                                           
{'loss': 2.7109, 'learning_rate': 2.5686827985950995e-07, 'epoch': 13.21}

 83%|████████▎ | 306760/371472 [2:14:48<5:19:43,  3.37it/s]
 83%|████████▎ | 306761/371472 [2:14:49<5:31:52,  3.25it/s]
 83%|████████▎ | 306762/371472 [2:14:49<5:19:04,  3.38it/s]
 83%|████████▎ | 306763/371472 [2:14:49<5:13:36,  3.44it/s]
 83%|████████▎ | 306764/371472 [2:14:50<5:03:51,  3.55it/s]
 83%|████████▎ | 306765/371472 [2:14:50<4:57:14,  3.63it/s]
 83%|████████▎ | 306766/371472 [2:14:50<5:09:46,  3.48it/s]
 83%|████████▎ | 306767/371472 [2:14:50<5:13:16,  3.44it/s]
 83%|████████▎ | 306768/371472 [2:14:51<5:38:21,  3.19it/s]
 83%|████████▎ | 306769/371472 [2:14:51<5:36:34,  3.20it/s]
 83%|████████▎ | 306770/371472 [2:14:51<5:21:03,  3.36it/s]
 83%|████████▎ | 306771/371472 [2:14:52<5:00:47,  3.59it/s]
 83%|████████▎ | 306772/371472 [2:14:52<4:51:16,  3.70it/s]
 83%|████████▎ | 306773/371472 [2:14:52<4:54:04,  3.67it/s]
 83%|████████▎ | 306774/371472 [2:14:52<4:55:10,  3.65it/s]
 83%|████████▎ | 306775/371472 [2:14:53<4:49:18,  3.73it/s]
 83%|████████▎ | 306776/371472 [2:14:53<5:11:26,  3.46it/s]
 83%|████████▎ | 306777/371472 [2:14:53<4:54:09,  3.67it/s]
 83%|████████▎ | 306778/371472 [2:14:54<4:54:21,  3.66it/s]
 83%|████████▎ | 306779/371472 [2:14:54<5:07:13,  3.51it/s]
 83%|████████▎ | 306780/371472 [2:14:54<4:54:26,  3.66it/s]
                                                           
{'loss': 2.5836, 'learning_rate': 2.568197978840311e-07, 'epoch': 13.21}

 83%|████████▎ | 306780/371472 [2:14:54<4:54:26,  3.66it/s]
 83%|████████▎ | 306781/371472 [2:14:54<5:07:19,  3.51it/s]
 83%|████████▎ | 306782/371472 [2:14:55<5:11:12,  3.46it/s]
 83%|████████▎ | 306783/371472 [2:14:55<5:11:33,  3.46it/s]
 83%|████████▎ | 306784/371472 [2:14:55<5:07:43,  3.50it/s]
 83%|████████▎ | 306785/371472 [2:14:56<5:07:34,  3.51it/s]
 83%|████████▎ | 306786/371472 [2:14:56<5:08:23,  3.50it/s]
 83%|████████▎ | 306787/371472 [2:14:56<5:26:43,  3.30it/s]
 83%|████████▎ | 306788/371472 [2:14:56<5:13:44,  3.44it/s]
 83%|████████▎ | 306789/371472 [2:14:57<5:08:10,  3.50it/s]
 83%|████████▎ | 306790/371472 [2:14:57<4:53:26,  3.67it/s]
 83%|████████▎ | 306791/371472 [2:14:57<4:54:32,  3.66it/s]
 83%|████████▎ | 306792/371472 [2:14:58<5:01:47,  3.57it/s]
 83%|████████▎ | 306793/371472 [2:14:58<5:13:52,  3.43it/s]
 83%|████████▎ | 306794/371472 [2:14:58<5:10:04,  3.48it/s]
 83%|████████▎ | 306795/371472 [2:14:58<5:00:49,  3.58it/s]
 83%|████████▎ | 306796/371472 [2:14:59<5:07:04,  3.51it/s]
 83%|████████▎ | 306797/371472 [2:14:59<4:57:08,  3.63it/s]
 83%|████████▎ | 306798/371472 [2:14:59<5:06:11,  3.52it/s]
 83%|████████▎ | 306799/371472 [2:15:00<5:11:48,  3.46it/s]
 83%|████████▎ | 306800/371472 [2:15:00<5:00:44,  3.58it/s]
                                                           
{'loss': 2.6771, 'learning_rate': 2.5677131590855215e-07, 'epoch': 13.21}

 83%|████████▎ | 306800/371472 [2:15:00<5:00:44,  3.58it/s]
 83%|████████▎ | 306801/371472 [2:15:00<4:54:18,  3.66it/s]
 83%|████████▎ | 306802/371472 [2:15:00<4:50:51,  3.71it/s]
 83%|████████▎ | 306803/371472 [2:15:01<4:54:01,  3.67it/s]
 83%|████████▎ | 306804/371472 [2:15:01<4:45:57,  3.77it/s]
 83%|████████▎ | 306805/371472 [2:15:01<4:46:58,  3.76it/s]
 83%|████████▎ | 306806/371472 [2:15:01<5:09:14,  3.49it/s]
 83%|████████▎ | 306807/371472 [2:15:02<5:00:24,  3.59it/s]
 83%|████████▎ | 306808/371472 [2:15:02<4:59:53,  3.59it/s]
 83%|████████▎ | 306809/371472 [2:15:02<4:53:49,  3.67it/s]
 83%|████████▎ | 306810/371472 [2:15:03<5:15:38,  3.41it/s]
 83%|████████▎ | 306811/371472 [2:15:03<5:07:29,  3.50it/s]
 83%|████████▎ | 306812/371472 [2:15:03<5:03:31,  3.55it/s]
 83%|████████▎ | 306813/371472 [2:15:03<4:57:39,  3.62it/s]
 83%|████████▎ | 306814/371472 [2:15:04<4:56:23,  3.64it/s]
 83%|████████▎ | 306815/371472 [2:15:04<4:48:02,  3.74it/s]
 83%|████████▎ | 306816/371472 [2:15:04<4:44:21,  3.79it/s]
 83%|████████▎ | 306817/371472 [2:15:04<4:49:48,  3.72it/s]
 83%|████████▎ | 306818/371472 [2:15:05<4:47:12,  3.75it/s]
 83%|████████▎ | 306819/371472 [2:15:05<4:47:42,  3.75it/s]
 83%|████████▎ | 306820/371472 [2:15:05<4:41:24,  3.83it/s]
                                                           
{'loss': 2.6578, 'learning_rate': 2.5672283393307333e-07, 'epoch': 13.22}

 83%|████████▎ | 306820/371472 [2:15:05<4:41:24,  3.83it/s]
 83%|████████▎ | 306821/371472 [2:15:05<4:42:10,  3.82it/s]
 83%|████████▎ | 306822/371472 [2:15:06<5:08:20,  3.49it/s]
 83%|████████▎ | 306823/371472 [2:15:06<5:32:38,  3.24it/s]
 83%|████████▎ | 306824/371472 [2:15:06<5:17:22,  3.39it/s]
 83%|████████▎ | 306825/371472 [2:15:07<5:02:39,  3.56it/s]
 83%|████████▎ | 306826/371472 [2:15:07<4:53:21,  3.67it/s]
 83%|████████▎ | 306827/371472 [2:15:07<4:55:48,  3.64it/s]
 83%|████████▎ | 306828/371472 [2:15:08<4:59:09,  3.60it/s]
 83%|████████▎ | 306829/371472 [2:15:08<5:00:52,  3.58it/s]
 83%|████████▎ | 306830/371472 [2:15:08<5:02:43,  3.56it/s]
 83%|████████▎ | 306831/371472 [2:15:08<5:07:41,  3.50it/s]
 83%|████████▎ | 306832/371472 [2:15:09<5:07:45,  3.50it/s]
 83%|████████▎ | 306833/371472 [2:15:09<5:42:26,  3.15it/s]
 83%|████████▎ | 306834/371472 [2:15:09<5:21:46,  3.35it/s]
 83%|████████▎ | 306835/371472 [2:15:10<5:32:36,  3.24it/s]
 83%|████████▎ | 306836/371472 [2:15:10<6:08:37,  2.92it/s]
 83%|████████▎ | 306837/371472 [2:15:10<5:41:48,  3.15it/s]
 83%|████████▎ | 306838/371472 [2:15:11<5:19:52,  3.37it/s]
 83%|████████▎ | 306839/371472 [2:15:11<5:18:56,  3.38it/s]
 83%|████████▎ | 306840/371472 [2:15:11<5:11:24,  3.46it/s]
                                                           
{'loss': 2.5415, 'learning_rate': 2.566743519575944e-07, 'epoch': 13.22}

 83%|████████▎ | 306840/371472 [2:15:11<5:11:24,  3.46it/s]
 83%|████████▎ | 306841/371472 [2:15:11<5:01:36,  3.57it/s]
 83%|████████▎ | 306842/371472 [2:15:12<5:17:09,  3.40it/s]
 83%|████████▎ | 306843/371472 [2:15:12<5:07:41,  3.50it/s]
 83%|████████▎ | 306844/371472 [2:15:12<5:08:44,  3.49it/s]
 83%|████████▎ | 306845/371472 [2:15:13<4:57:49,  3.62it/s]
 83%|████████▎ | 306846/371472 [2:15:13<5:00:46,  3.58it/s]
 83%|████████▎ | 306847/371472 [2:15:13<5:02:11,  3.56it/s]
 83%|████████▎ | 306848/371472 [2:15:13<5:06:30,  3.51it/s]
 83%|████████▎ | 306849/371472 [2:15:14<5:11:51,  3.45it/s]
 83%|████████▎ | 306850/371472 [2:15:14<5:17:42,  3.39it/s]
 83%|████████▎ | 306851/371472 [2:15:14<5:22:20,  3.34it/s]
 83%|████████▎ | 306852/371472 [2:15:15<5:17:22,  3.39it/s]
 83%|████████▎ | 306853/371472 [2:15:15<5:12:09,  3.45it/s]
 83%|████████▎ | 306854/371472 [2:15:15<4:59:07,  3.60it/s]
 83%|████████▎ | 306855/371472 [2:15:15<4:57:47,  3.62it/s]
 83%|████████▎ | 306856/371472 [2:15:16<4:59:07,  3.60it/s]
 83%|████████▎ | 306857/371472 [2:15:16<5:09:50,  3.48it/s]
 83%|████████▎ | 306858/371472 [2:15:16<5:18:43,  3.38it/s]
 83%|████████▎ | 306859/371472 [2:15:17<5:01:43,  3.57it/s]
 83%|████████▎ | 306860/371472 [2:15:17<4:57:02,  3.63it/s]
                                                           
{'loss': 2.5031, 'learning_rate': 2.566258699821155e-07, 'epoch': 13.22}

 83%|████████▎ | 306860/371472 [2:15:17<4:57:02,  3.63it/s]
 83%|████████▎ | 306861/371472 [2:15:17<5:06:33,  3.51it/s]
 83%|████████▎ | 306862/371472 [2:15:17<5:11:16,  3.46it/s]
 83%|████████▎ | 306863/371472 [2:15:18<4:56:02,  3.64it/s]
 83%|████████▎ | 306864/371472 [2:15:18<4:42:16,  3.81it/s]
 83%|████████▎ | 306865/371472 [2:15:18<4:41:48,  3.82it/s]
 83%|████████▎ | 306866/371472 [2:15:18<4:42:41,  3.81it/s]
 83%|████████▎ | 306867/371472 [2:15:19<4:51:33,  3.69it/s]
 83%|████████▎ | 306868/371472 [2:15:19<4:46:54,  3.75it/s]
 83%|████████▎ | 306869/371472 [2:15:19<4:45:30,  3.77it/s]
 83%|████████▎ | 306870/371472 [2:15:20<4:57:11,  3.62it/s]
 83%|████████▎ | 306871/371472 [2:15:20<4:51:30,  3.69it/s]
 83%|████████▎ | 306872/371472 [2:15:20<4:48:00,  3.74it/s]
 83%|████████▎ | 306873/371472 [2:15:20<4:49:03,  3.72it/s]
 83%|████████▎ | 306874/371472 [2:15:21<4:56:58,  3.63it/s]
 83%|████████▎ | 306875/371472 [2:15:21<4:50:29,  3.71it/s]
 83%|████████▎ | 306876/371472 [2:15:21<5:00:23,  3.58it/s]
 83%|████████▎ | 306877/371472 [2:15:21<4:59:08,  3.60it/s]
 83%|████████▎ | 306878/371472 [2:15:22<5:16:07,  3.41it/s]
 83%|████████▎ | 306879/371472 [2:15:22<5:11:27,  3.46it/s]
 83%|████████▎ | 306880/371472 [2:15:22<5:14:32,  3.42it/s]
                                                           
{'loss': 2.458, 'learning_rate': 2.565773880066366e-07, 'epoch': 13.22}

 83%|████████▎ | 306880/371472 [2:15:22<5:14:32,  3.42it/s]
 83%|████████▎ | 306881/371472 [2:15:23<5:29:50,  3.26it/s]
 83%|████████▎ | 306882/371472 [2:15:23<5:20:24,  3.36it/s]
 83%|████████▎ | 306883/371472 [2:15:23<5:06:42,  3.51it/s]
 83%|████████▎ | 306884/371472 [2:15:23<5:00:43,  3.58it/s]
 83%|████████▎ | 306885/371472 [2:15:24<5:17:27,  3.39it/s]
 83%|████████▎ | 306886/371472 [2:15:24<5:01:14,  3.57it/s]
 83%|████████▎ | 306887/371472 [2:15:24<5:04:31,  3.53it/s]
 83%|████████▎ | 306888/371472 [2:15:25<4:56:28,  3.63it/s]
 83%|████████▎ | 306889/371472 [2:15:25<4:45:11,  3.77it/s]
 83%|████████▎ | 306890/371472 [2:15:25<4:50:20,  3.71it/s]
 83%|████████▎ | 306891/371472 [2:15:25<4:55:08,  3.65it/s]
 83%|████████▎ | 306892/371472 [2:15:26<4:54:55,  3.65it/s]
 83%|████████▎ | 306893/371472 [2:15:26<5:25:27,  3.31it/s]
 83%|████████▎ | 306894/371472 [2:15:26<5:10:43,  3.46it/s]
 83%|████████▎ | 306895/371472 [2:15:27<5:18:06,  3.38it/s]
 83%|████████▎ | 306896/371472 [2:15:27<5:22:41,  3.34it/s]
 83%|████████▎ | 306897/371472 [2:15:27<5:11:10,  3.46it/s]
 83%|████████▎ | 306898/371472 [2:15:27<5:05:44,  3.52it/s]
 83%|████████▎ | 306899/371472 [2:15:28<5:00:30,  3.58it/s]
 83%|████████▎ | 306900/371472 [2:15:28<4:56:55,  3.62it/s]
                                                           
{'loss': 2.6473, 'learning_rate': 2.565289060311577e-07, 'epoch': 13.22}

 83%|████████▎ | 306900/371472 [2:15:28<4:56:55,  3.62it/s]
 83%|████████▎ | 306901/371472 [2:15:28<4:52:07,  3.68it/s]
 83%|████████▎ | 306902/371472 [2:15:29<4:49:19,  3.72it/s]
 83%|████████▎ | 306903/371472 [2:15:29<4:47:32,  3.74it/s]
 83%|████████▎ | 306904/371472 [2:15:29<4:49:13,  3.72it/s]
 83%|████████▎ | 306905/371472 [2:15:29<4:45:11,  3.77it/s]
 83%|████████▎ | 306906/371472 [2:15:30<4:49:41,  3.71it/s]
 83%|████████▎ | 306907/371472 [2:15:30<5:02:34,  3.56it/s]
 83%|████████▎ | 306908/371472 [2:15:30<5:12:15,  3.45it/s]
 83%|████████▎ | 306909/371472 [2:15:31<5:07:22,  3.50it/s]
 83%|████████▎ | 306910/371472 [2:15:31<5:06:13,  3.51it/s]
 83%|████████▎ | 306911/371472 [2:15:31<4:59:52,  3.59it/s]
 83%|████████▎ | 306912/371472 [2:15:31<4:47:37,  3.74it/s]
 83%|████████▎ | 306913/371472 [2:15:32<4:39:26,  3.85it/s]
 83%|████████▎ | 306914/371472 [2:15:32<4:37:41,  3.87it/s]
 83%|████████▎ | 306915/371472 [2:15:32<4:42:39,  3.81it/s]
 83%|████████▎ | 306916/371472 [2:15:32<4:56:24,  3.63it/s]
 83%|████████▎ | 306917/371472 [2:15:33<4:55:39,  3.64it/s]
 83%|████████▎ | 306918/371472 [2:15:33<4:45:42,  3.77it/s]
 83%|████████▎ | 306919/371472 [2:15:33<4:44:59,  3.78it/s]
 83%|████████▎ | 306920/371472 [2:15:33<4:53:00,  3.67it/s]
                                                           
{'loss': 2.7272, 'learning_rate': 2.564804240556788e-07, 'epoch': 13.22}

 83%|████████▎ | 306920/371472 [2:15:33<4:53:00,  3.67it/s]
 83%|████████▎ | 306921/371472 [2:15:34<5:08:29,  3.49it/s]
 83%|████████▎ | 306922/371472 [2:15:34<4:57:39,  3.61it/s]
 83%|████████▎ | 306923/371472 [2:15:34<4:48:10,  3.73it/s]
 83%|████████▎ | 306924/371472 [2:15:35<5:11:42,  3.45it/s]
 83%|████████▎ | 306925/371472 [2:15:35<5:11:06,  3.46it/s]
 83%|████████▎ | 306926/371472 [2:15:35<5:20:19,  3.36it/s]
 83%|████████▎ | 306927/371472 [2:15:36<5:26:35,  3.29it/s]
 83%|████████▎ | 306928/371472 [2:15:36<5:09:04,  3.48it/s]
 83%|████████▎ | 306929/371472 [2:15:36<5:24:03,  3.32it/s]
 83%|████████▎ | 306930/371472 [2:15:37<6:11:15,  2.90it/s]
 83%|████████▎ | 306931/371472 [2:15:37<6:04:02,  2.95it/s]
 83%|████████▎ | 306932/371472 [2:15:37<5:41:34,  3.15it/s]
 83%|████████▎ | 306933/371472 [2:15:37<5:26:23,  3.30it/s]
 83%|████████▎ | 306934/371472 [2:15:38<5:38:27,  3.18it/s]
 83%|████████▎ | 306935/371472 [2:15:38<5:24:44,  3.31it/s]
 83%|████████▎ | 306936/371472 [2:15:38<5:07:35,  3.50it/s]
 83%|████████▎ | 306937/371472 [2:15:39<5:00:16,  3.58it/s]
 83%|████████▎ | 306938/371472 [2:15:39<4:55:30,  3.64it/s]
 83%|████████▎ | 306939/371472 [2:15:39<5:11:58,  3.45it/s]
 83%|████████▎ | 306940/371472 [2:15:39<5:05:58,  3.52it/s]
                                                           
{'loss': 2.5685, 'learning_rate': 2.5643194208019997e-07, 'epoch': 13.22}

 83%|████████▎ | 306940/371472 [2:15:39<5:05:58,  3.52it/s]
 83%|████████▎ | 306941/371472 [2:15:40<5:02:49,  3.55it/s]
 83%|████████▎ | 306942/371472 [2:15:40<5:14:36,  3.42it/s]
 83%|████████▎ | 306943/371472 [2:15:40<5:16:12,  3.40it/s]
 83%|████████▎ | 306944/371472 [2:15:41<5:36:18,  3.20it/s]
 83%|████████▎ | 306945/371472 [2:15:41<5:15:26,  3.41it/s]
 83%|████████▎ | 306946/371472 [2:15:41<5:17:36,  3.39it/s]
 83%|████████▎ | 306947/371472 [2:15:42<5:32:51,  3.23it/s]
 83%|████████▎ | 306948/371472 [2:15:42<5:21:46,  3.34it/s]
 83%|████████▎ | 306949/371472 [2:15:42<5:04:24,  3.53it/s]
 83%|████████▎ | 306950/371472 [2:15:42<5:04:00,  3.54it/s]
 83%|████████▎ | 306951/371472 [2:15:43<5:07:00,  3.50it/s]
 83%|████████▎ | 306952/371472 [2:15:43<5:08:34,  3.48it/s]
 83%|████████▎ | 306953/371472 [2:15:43<4:57:11,  3.62it/s]
 83%|████████▎ | 306954/371472 [2:15:43<5:03:33,  3.54it/s]
 83%|████████▎ | 306955/371472 [2:15:44<4:55:34,  3.64it/s]
 83%|████████▎ | 306956/371472 [2:15:44<4:50:45,  3.70it/s]
 83%|████████▎ | 306957/371472 [2:15:44<5:04:10,  3.54it/s]
 83%|████████▎ | 306958/371472 [2:15:45<4:52:17,  3.68it/s]
 83%|████████▎ | 306959/371472 [2:15:45<4:54:18,  3.65it/s]
 83%|████████▎ | 306960/371472 [2:15:45<4:59:21,  3.59it/s]
                                                           
{'loss': 2.6429, 'learning_rate': 2.5638346010472104e-07, 'epoch': 13.22}

 83%|████████▎ | 306960/371472 [2:15:45<4:59:21,  3.59it/s]
 83%|████████▎ | 306961/371472 [2:15:45<5:04:20,  3.53it/s]
 83%|████████▎ | 306962/371472 [2:15:46<5:04:34,  3.53it/s]
 83%|████████▎ | 306963/371472 [2:15:46<5:04:49,  3.53it/s]
 83%|████████▎ | 306964/371472 [2:15:46<5:10:51,  3.46it/s]
 83%|████████▎ | 306965/371472 [2:15:47<5:15:39,  3.41it/s]
 83%|████████▎ | 306966/371472 [2:15:47<5:10:47,  3.46it/s]
 83%|████████▎ | 306967/371472 [2:15:47<5:05:59,  3.51it/s]
 83%|████████▎ | 306968/371472 [2:15:47<4:58:50,  3.60it/s]
 83%|████████▎ | 306969/371472 [2:15:48<4:52:57,  3.67it/s]
 83%|████████▎ | 306970/371472 [2:15:48<5:06:54,  3.50it/s]
 83%|████████▎ | 306971/371472 [2:15:48<5:09:49,  3.47it/s]
 83%|████████▎ | 306972/371472 [2:15:49<5:12:41,  3.44it/s]
 83%|████████▎ | 306973/371472 [2:15:49<5:03:55,  3.54it/s]
 83%|████████▎ | 306974/371472 [2:15:49<5:16:22,  3.40it/s]
 83%|████████▎ | 306975/371472 [2:15:49<5:19:52,  3.36it/s]
 83%|████████▎ | 306976/371472 [2:15:50<5:37:07,  3.19it/s]
 83%|████████▎ | 306977/371472 [2:15:50<5:09:07,  3.48it/s]
 83%|████████▎ | 306978/371472 [2:15:50<5:04:20,  3.53it/s]
 83%|████████▎ | 306979/371472 [2:15:51<5:05:31,  3.52it/s]
 83%|████████▎ | 306980/371472 [2:15:51<5:13:49,  3.42it/s]
                                                           
{'loss': 2.6118, 'learning_rate': 2.563349781292422e-07, 'epoch': 13.22}

 83%|████████▎ | 306980/371472 [2:15:51<5:13:49,  3.42it/s]
 83%|████████▎ | 306981/371472 [2:15:51<5:03:52,  3.54it/s]
 83%|████████▎ | 306982/371472 [2:15:51<5:16:44,  3.39it/s]
 83%|████████▎ | 306983/371472 [2:15:52<5:02:17,  3.56it/s]
 83%|████████▎ | 306984/371472 [2:15:52<5:14:27,  3.42it/s]
 83%|████████▎ | 306985/371472 [2:15:52<5:08:07,  3.49it/s]
 83%|████████▎ | 306986/371472 [2:15:53<4:59:20,  3.59it/s]
 83%|████████▎ | 306987/371472 [2:15:53<5:05:14,  3.52it/s]
 83%|████████▎ | 306988/371472 [2:15:53<4:59:39,  3.59it/s]
 83%|████████▎ | 306989/371472 [2:15:54<5:39:34,  3.16it/s]
 83%|████████▎ | 306990/371472 [2:15:54<5:20:05,  3.36it/s]
 83%|████████▎ | 306991/371472 [2:15:54<5:33:46,  3.22it/s]
 83%|████████▎ | 306992/371472 [2:15:54<5:36:47,  3.19it/s]
 83%|████████▎ | 306993/371472 [2:15:55<5:26:26,  3.29it/s]
 83%|████████▎ | 306994/371472 [2:15:55<5:30:30,  3.25it/s]
 83%|████████▎ | 306995/371472 [2:15:55<5:27:10,  3.28it/s]
 83%|████████▎ | 306996/371472 [2:15:56<5:19:05,  3.37it/s]
 83%|████████▎ | 306997/371472 [2:15:56<5:03:14,  3.54it/s]
 83%|████████▎ | 306998/371472 [2:15:56<5:04:30,  3.53it/s]
 83%|████████▎ | 306999/371472 [2:15:56<5:04:12,  3.53it/s]
 83%|████████▎ | 307000/371472 [2:15:57<5:04:07,  3.53it/s]
                                                           
{'loss': 2.5783, 'learning_rate': 2.5628649615376324e-07, 'epoch': 13.22}

 83%|████████▎ | 307000/371472 [2:15:57<5:04:07,  3.53it/s]
 83%|████████▎ | 307001/371472 [2:15:57<5:08:56,  3.48it/s]
 83%|████████▎ | 307002/371472 [2:15:57<4:58:14,  3.60it/s]
 83%|████████▎ | 307003/371472 [2:15:58<4:51:44,  3.68it/s]
 83%|████████▎ | 307004/371472 [2:15:58<4:54:08,  3.65it/s]
 83%|████████▎ | 307005/371472 [2:15:58<4:57:40,  3.61it/s]
 83%|████████▎ | 307006/371472 [2:15:58<4:46:06,  3.76it/s]
 83%|████████▎ | 307007/371472 [2:15:59<5:03:48,  3.54it/s]
 83%|████████▎ | 307008/371472 [2:15:59<5:00:35,  3.57it/s]
 83%|████████▎ | 307009/371472 [2:15:59<4:56:38,  3.62it/s]
 83%|████████▎ | 307010/371472 [2:15:59<4:47:02,  3.74it/s]
 83%|████████▎ | 307011/371472 [2:16:00<4:59:28,  3.59it/s]
 83%|████████▎ | 307012/371472 [2:16:00<5:19:24,  3.36it/s]
 83%|████████▎ | 307013/371472 [2:16:00<5:07:14,  3.50it/s]
 83%|████████▎ | 307014/371472 [2:16:01<4:56:59,  3.62it/s]
 83%|████████▎ | 307015/371472 [2:16:01<5:03:37,  3.54it/s]
 83%|████████▎ | 307016/371472 [2:16:01<5:01:47,  3.56it/s]
 83%|████████▎ | 307017/371472 [2:16:01<5:04:06,  3.53it/s]
 83%|████████▎ | 307018/371472 [2:16:02<4:56:07,  3.63it/s]
 83%|████████▎ | 307019/371472 [2:16:02<4:44:41,  3.77it/s]
 83%|████████▎ | 307020/371472 [2:16:02<5:18:12,  3.38it/s]
                                                           
{'loss': 2.5645, 'learning_rate': 2.562380141782844e-07, 'epoch': 13.22}

 83%|████████▎ | 307020/371472 [2:16:02<5:18:12,  3.38it/s]
 83%|████████▎ | 307021/371472 [2:16:03<5:07:46,  3.49it/s]
 83%|████████▎ | 307022/371472 [2:16:03<4:59:41,  3.58it/s]
 83%|████████▎ | 307023/371472 [2:16:03<4:48:19,  3.73it/s]
 83%|████████▎ | 307024/371472 [2:16:03<4:51:10,  3.69it/s]
 83%|████████▎ | 307025/371472 [2:16:04<4:47:17,  3.74it/s]
 83%|████████▎ | 307026/371472 [2:16:04<4:53:09,  3.66it/s]
 83%|████████▎ | 307027/371472 [2:16:04<4:52:48,  3.67it/s]
 83%|████████▎ | 307028/371472 [2:16:04<4:47:48,  3.73it/s]
 83%|████████▎ | 307029/371472 [2:16:05<5:00:07,  3.58it/s]
 83%|████████▎ | 307030/371472 [2:16:05<5:13:22,  3.43it/s]
 83%|████████▎ | 307031/371472 [2:16:05<5:04:42,  3.52it/s]
 83%|████████▎ | 307032/371472 [2:16:06<4:55:38,  3.63it/s]
 83%|████████▎ | 307033/371472 [2:16:06<5:06:29,  3.50it/s]
 83%|████████▎ | 307034/371472 [2:16:06<5:27:05,  3.28it/s]
 83%|████████▎ | 307035/371472 [2:16:07<5:13:35,  3.42it/s]
 83%|████████▎ | 307036/371472 [2:16:07<5:07:31,  3.49it/s]
 83%|████████▎ | 307037/371472 [2:16:07<5:28:57,  3.26it/s]
 83%|████████▎ | 307038/371472 [2:16:07<5:12:43,  3.43it/s]
 83%|████████▎ | 307039/371472 [2:16:08<5:17:10,  3.39it/s]
 83%|████████▎ | 307040/371472 [2:16:08<5:20:42,  3.35it/s]
                                                           
{'loss': 2.56, 'learning_rate': 2.5618953220280543e-07, 'epoch': 13.22}

 83%|████████▎ | 307040/371472 [2:16:08<5:20:42,  3.35it/s]
 83%|████████▎ | 307041/371472 [2:16:08<5:17:18,  3.38it/s]
 83%|████████▎ | 307042/371472 [2:16:09<5:12:08,  3.44it/s]
 83%|████████▎ | 307043/371472 [2:16:09<5:01:47,  3.56it/s]
 83%|████████▎ | 307044/371472 [2:16:09<4:52:56,  3.67it/s]
 83%|████████▎ | 307045/371472 [2:16:09<5:03:44,  3.54it/s]
 83%|████████▎ | 307046/371472 [2:16:10<5:01:13,  3.56it/s]
 83%|████████▎ | 307047/371472 [2:16:10<5:26:04,  3.29it/s]
 83%|████████▎ | 307048/371472 [2:16:10<5:28:28,  3.27it/s]
 83%|████████▎ | 307049/371472 [2:16:11<5:10:12,  3.46it/s]
 83%|████████▎ | 307050/371472 [2:16:11<4:59:50,  3.58it/s]
 83%|████████▎ | 307051/371472 [2:16:11<5:03:40,  3.54it/s]
 83%|████████▎ | 307052/371472 [2:16:11<5:00:15,  3.58it/s]
 83%|████████▎ | 307053/371472 [2:16:12<5:06:43,  3.50it/s]
 83%|████████▎ | 307054/371472 [2:16:12<5:01:52,  3.56it/s]
 83%|████████▎ | 307055/371472 [2:16:12<4:59:40,  3.58it/s]
 83%|████████▎ | 307056/371472 [2:16:13<5:17:10,  3.38it/s]
 83%|████████▎ | 307057/371472 [2:16:13<5:05:42,  3.51it/s]
 83%|████████▎ | 307058/371472 [2:16:13<5:00:22,  3.57it/s]
 83%|████████▎ | 307059/371472 [2:16:13<4:59:35,  3.58it/s]
 83%|████████▎ | 307060/371472 [2:16:14<4:55:44,  3.63it/s]
                                                           
{'loss': 2.7697, 'learning_rate': 2.561410502273266e-07, 'epoch': 13.23}

 83%|████████▎ | 307060/371472 [2:16:14<4:55:44,  3.63it/s]
 83%|████████▎ | 307061/371472 [2:16:14<4:54:30,  3.65it/s]
 83%|████████▎ | 307062/371472 [2:16:14<4:46:27,  3.75it/s]
 83%|████████▎ | 307063/371472 [2:16:14<4:42:53,  3.79it/s]
 83%|████████▎ | 307064/371472 [2:16:15<4:49:44,  3.70it/s]
 83%|████████▎ | 307065/371472 [2:16:15<5:07:48,  3.49it/s]
 83%|████████▎ | 307066/371472 [2:16:15<5:07:24,  3.49it/s]
 83%|████████▎ | 307067/371472 [2:16:16<4:56:38,  3.62it/s]
 83%|████████▎ | 307068/371472 [2:16:16<5:01:45,  3.56it/s]
 83%|████████▎ | 307069/371472 [2:16:16<5:08:15,  3.48it/s]
 83%|████████▎ | 307070/371472 [2:16:16<5:03:37,  3.54it/s]
 83%|████████▎ | 307071/371472 [2:16:17<4:55:16,  3.64it/s]
 83%|████████▎ | 307072/371472 [2:16:17<4:56:43,  3.62it/s]
 83%|████████▎ | 307073/371472 [2:16:17<5:17:22,  3.38it/s]
 83%|████████▎ | 307074/371472 [2:16:18<5:08:54,  3.47it/s]
 83%|████████▎ | 307075/371472 [2:16:18<4:54:38,  3.64it/s]
 83%|████████▎ | 307076/371472 [2:16:18<5:03:29,  3.54it/s]
 83%|████████▎ | 307077/371472 [2:16:18<5:14:20,  3.41it/s]
 83%|████████▎ | 307078/371472 [2:16:19<5:10:30,  3.46it/s]
 83%|████████▎ | 307079/371472 [2:16:19<5:04:44,  3.52it/s]
 83%|████████▎ | 307080/371472 [2:16:19<5:12:34,  3.43it/s]
                                                           
{'loss': 2.5968, 'learning_rate': 2.560925682518477e-07, 'epoch': 13.23}

 83%|████████▎ | 307080/371472 [2:16:19<5:12:34,  3.43it/s]
 83%|████████▎ | 307081/371472 [2:16:20<4:59:21,  3.58it/s]
 83%|████████▎ | 307082/371472 [2:16:20<4:54:53,  3.64it/s]
 83%|████████▎ | 307083/371472 [2:16:20<4:54:31,  3.64it/s]
 83%|████████▎ | 307084/371472 [2:16:20<4:50:16,  3.70it/s]
 83%|████████▎ | 307085/371472 [2:16:21<4:46:19,  3.75it/s]
 83%|████████▎ | 307086/371472 [2:16:21<4:49:44,  3.70it/s]
 83%|████████▎ | 307087/371472 [2:16:21<4:46:51,  3.74it/s]
 83%|████████▎ | 307088/371472 [2:16:21<4:38:53,  3.85it/s]
 83%|████████▎ | 307089/371472 [2:16:22<4:51:31,  3.68it/s]
 83%|████████▎ | 307090/371472 [2:16:22<5:19:16,  3.36it/s]
 83%|████████▎ | 307091/371472 [2:16:22<5:30:18,  3.25it/s]
 83%|████████▎ | 307092/371472 [2:16:23<5:09:49,  3.46it/s]
 83%|████████▎ | 307093/371472 [2:16:23<4:59:18,  3.58it/s]
 83%|████████▎ | 307094/371472 [2:16:23<5:09:48,  3.46it/s]
 83%|████████▎ | 307095/371472 [2:16:24<5:38:52,  3.17it/s]
 83%|████████▎ | 307096/371472 [2:16:24<5:24:14,  3.31it/s]
 83%|████████▎ | 307097/371472 [2:16:24<5:10:57,  3.45it/s]
 83%|████████▎ | 307098/371472 [2:16:24<4:50:44,  3.69it/s]
 83%|████████▎ | 307099/371472 [2:16:25<4:49:57,  3.70it/s]
 83%|████████▎ | 307100/371472 [2:16:25<4:40:14,  3.83it/s]
                                                           
{'loss': 2.5923, 'learning_rate': 2.5604408627636886e-07, 'epoch': 13.23}

 83%|████████▎ | 307100/371472 [2:16:25<4:40:14,  3.83it/s]
 83%|████████▎ | 307101/371472 [2:16:25<5:11:04,  3.45it/s]
 83%|████████▎ | 307102/371472 [2:16:26<5:19:44,  3.36it/s]
 83%|████████▎ | 307103/371472 [2:16:26<5:04:49,  3.52it/s]
 83%|████████▎ | 307104/371472 [2:16:26<4:57:01,  3.61it/s]
 83%|████████▎ | 307105/371472 [2:16:26<4:56:36,  3.62it/s]
 83%|████████▎ | 307106/371472 [2:16:27<5:20:54,  3.34it/s]
 83%|████████▎ | 307107/371472 [2:16:27<5:15:13,  3.40it/s]
 83%|████████▎ | 307108/371472 [2:16:27<5:16:07,  3.39it/s]
 83%|████████▎ | 307109/371472 [2:16:28<4:58:52,  3.59it/s]
 83%|████████▎ | 307110/371472 [2:16:28<4:45:38,  3.76it/s]
 83%|████████▎ | 307111/371472 [2:16:28<4:38:48,  3.85it/s]
 83%|████████▎ | 307112/371472 [2:16:28<4:37:32,  3.86it/s]
 83%|████████▎ | 307113/371472 [2:16:29<4:37:09,  3.87it/s]
 83%|████████▎ | 307114/371472 [2:16:29<4:35:26,  3.89it/s]
 83%|████████▎ | 307115/371472 [2:16:29<4:43:42,  3.78it/s]
 83%|████████▎ | 307116/371472 [2:16:29<5:03:16,  3.54it/s]
 83%|████████▎ | 307117/371472 [2:16:30<4:58:35,  3.59it/s]
 83%|████████▎ | 307118/371472 [2:16:30<5:10:46,  3.45it/s]
 83%|████████▎ | 307119/371472 [2:16:30<4:55:02,  3.64it/s]
 83%|████████▎ | 307120/371472 [2:16:30<4:42:06,  3.80it/s]
                                                           
{'loss': 2.7173, 'learning_rate': 2.559956043008899e-07, 'epoch': 13.23}

 83%|████████▎ | 307120/371472 [2:16:30<4:42:06,  3.80it/s]
 83%|████████▎ | 307121/371472 [2:16:31<4:51:33,  3.68it/s]
 83%|████████▎ | 307122/371472 [2:16:31<4:56:27,  3.62it/s]
 83%|████████▎ | 307123/371472 [2:16:31<5:05:09,  3.51it/s]
 83%|████████▎ | 307124/371472 [2:16:32<5:15:20,  3.40it/s]
 83%|████████▎ | 307125/371472 [2:16:32<4:58:14,  3.60it/s]
 83%|████████▎ | 307126/371472 [2:16:32<4:50:50,  3.69it/s]
 83%|████████▎ | 307127/371472 [2:16:32<5:01:38,  3.56it/s]
 83%|████████▎ | 307128/371472 [2:16:33<5:02:39,  3.54it/s]
 83%|████████▎ | 307129/371472 [2:16:33<4:56:12,  3.62it/s]
 83%|████████▎ | 307130/371472 [2:16:33<4:57:49,  3.60it/s]
 83%|████████▎ | 307131/371472 [2:16:34<5:06:30,  3.50it/s]
 83%|████████▎ | 307132/371472 [2:16:34<5:17:58,  3.37it/s]
 83%|████████▎ | 307133/371472 [2:16:34<5:12:28,  3.43it/s]
 83%|████████▎ | 307134/371472 [2:16:35<5:35:15,  3.20it/s]
 83%|████████▎ | 307135/371472 [2:16:35<5:22:18,  3.33it/s]
 83%|████████▎ | 307136/371472 [2:16:35<5:03:56,  3.53it/s]
 83%|████████▎ | 307137/371472 [2:16:35<4:54:44,  3.64it/s]
 83%|████████▎ | 307138/371472 [2:16:36<4:54:11,  3.64it/s]
 83%|████████▎ | 307139/371472 [2:16:36<4:49:14,  3.71it/s]
 83%|████████▎ | 307140/371472 [2:16:36<4:42:01,  3.80it/s]
                                                           
{'loss': 2.6259, 'learning_rate': 2.5594712232541105e-07, 'epoch': 13.23}

 83%|████████▎ | 307140/371472 [2:16:36<4:42:01,  3.80it/s]
 83%|████████▎ | 307141/371472 [2:16:36<4:53:18,  3.66it/s]
 83%|████████▎ | 307142/371472 [2:16:37<4:49:26,  3.70it/s]
 83%|████████▎ | 307143/371472 [2:16:37<4:53:00,  3.66it/s]
 83%|████████▎ | 307144/371472 [2:16:37<4:44:40,  3.77it/s]
 83%|████████▎ | 307145/371472 [2:16:37<4:42:01,  3.80it/s]
 83%|████████▎ | 307146/371472 [2:16:38<4:40:37,  3.82it/s]
 83%|████████▎ | 307147/371472 [2:16:38<4:41:13,  3.81it/s]
 83%|████████▎ | 307148/371472 [2:16:38<4:48:29,  3.72it/s]
 83%|████████▎ | 307149/371472 [2:16:39<4:49:19,  3.71it/s]
 83%|████████▎ | 307150/371472 [2:16:39<4:47:31,  3.73it/s]
 83%|████████▎ | 307151/371472 [2:16:39<4:42:42,  3.79it/s]
 83%|████████▎ | 307152/371472 [2:16:39<4:54:17,  3.64it/s]
 83%|████████▎ | 307153/371472 [2:16:40<5:02:00,  3.55it/s]
 83%|████████▎ | 307154/371472 [2:16:40<4:54:31,  3.64it/s]
 83%|████████▎ | 307155/371472 [2:16:40<4:47:28,  3.73it/s]
 83%|████████▎ | 307156/371472 [2:16:40<4:44:03,  3.77it/s]
 83%|████████▎ | 307157/371472 [2:16:41<4:44:07,  3.77it/s]
 83%|████████▎ | 307158/371472 [2:16:41<4:52:36,  3.66it/s]
 83%|████████▎ | 307159/371472 [2:16:41<4:57:59,  3.60it/s]
 83%|████████▎ | 307160/371472 [2:16:42<5:07:38,  3.48it/s]
                                                           
{'loss': 2.7521, 'learning_rate': 2.5589864034993207e-07, 'epoch': 13.23}

 83%|████████▎ | 307160/371472 [2:16:42<5:07:38,  3.48it/s]
 83%|████████▎ | 307161/371472 [2:16:42<5:04:36,  3.52it/s]
 83%|████████▎ | 307162/371472 [2:16:42<5:01:01,  3.56it/s]
 83%|████████▎ | 307163/371472 [2:16:42<5:05:36,  3.51it/s]
 83%|████████▎ | 307164/371472 [2:16:43<5:02:23,  3.54it/s]
 83%|████████▎ | 307165/371472 [2:16:43<4:56:41,  3.61it/s]
 83%|████████▎ | 307166/371472 [2:16:43<4:48:42,  3.71it/s]
 83%|████████▎ | 307167/371472 [2:16:43<4:55:25,  3.63it/s]
 83%|████████▎ | 307168/371472 [2:16:44<4:44:17,  3.77it/s]
 83%|████████▎ | 307169/371472 [2:16:44<5:39:40,  3.16it/s]
 83%|████████▎ | 307170/371472 [2:16:44<5:09:46,  3.46it/s]
 83%|████████▎ | 307171/371472 [2:16:45<5:03:56,  3.53it/s]
 83%|████████▎ | 307172/371472 [2:16:45<6:03:26,  2.95it/s]
 83%|████████▎ | 307173/371472 [2:16:45<5:42:53,  3.13it/s]
 83%|████████▎ | 307174/371472 [2:16:46<5:17:39,  3.37it/s]
 83%|████████▎ | 307175/371472 [2:16:46<5:05:35,  3.51it/s]
 83%|████████▎ | 307176/371472 [2:16:46<5:11:38,  3.44it/s]
 83%|████████▎ | 307177/371472 [2:16:47<5:31:41,  3.23it/s]
 83%|████████▎ | 307178/371472 [2:16:47<5:16:37,  3.38it/s]
 83%|████████▎ | 307179/371472 [2:16:47<5:10:40,  3.45it/s]
 83%|████████▎ | 307180/371472 [2:16:47<5:08:09,  3.48it/s]
                                                           
{'loss': 2.8089, 'learning_rate': 2.5585015837445325e-07, 'epoch': 13.23}

 83%|████████▎ | 307180/371472 [2:16:47<5:08:09,  3.48it/s]
 83%|████████▎ | 307181/371472 [2:16:48<4:59:21,  3.58it/s]
 83%|████████▎ | 307182/371472 [2:16:48<5:13:59,  3.41it/s]
 83%|████████▎ | 307183/371472 [2:16:48<5:13:20,  3.42it/s]
 83%|████████▎ | 307184/371472 [2:16:49<5:11:22,  3.44it/s]
 83%|████████▎ | 307185/371472 [2:16:49<5:15:29,  3.40it/s]
 83%|████████▎ | 307186/371472 [2:16:49<5:22:08,  3.33it/s]
 83%|████████▎ | 307187/371472 [2:16:49<5:13:40,  3.42it/s]
 83%|████████▎ | 307188/371472 [2:16:50<5:27:43,  3.27it/s]
 83%|████████▎ | 307189/371472 [2:16:50<5:05:23,  3.51it/s]
 83%|████████▎ | 307190/371472 [2:16:50<4:49:05,  3.71it/s]
 83%|████████▎ | 307191/371472 [2:16:51<4:55:55,  3.62it/s]
 83%|████████▎ | 307192/371472 [2:16:51<5:15:37,  3.39it/s]
 83%|████████▎ | 307193/371472 [2:16:51<5:16:52,  3.38it/s]
 83%|████████▎ | 307194/371472 [2:16:51<5:20:03,  3.35it/s]
 83%|████████▎ | 307195/371472 [2:16:52<5:05:11,  3.51it/s]
 83%|████████▎ | 307196/371472 [2:16:52<4:56:13,  3.62it/s]
 83%|████████▎ | 307197/371472 [2:16:52<4:51:36,  3.67it/s]
 83%|████████▎ | 307198/371472 [2:16:53<4:58:50,  3.58it/s]
 83%|████████▎ | 307199/371472 [2:16:53<5:12:09,  3.43it/s]
 83%|████████▎ | 307200/371472 [2:16:53<5:07:08,  3.49it/s]
                                                           
{'loss': 2.4875, 'learning_rate': 2.558016763989743e-07, 'epoch': 13.23}

 83%|████████▎ | 307200/371472 [2:16:53<5:07:08,  3.49it/s]
 83%|████████▎ | 307201/371472 [2:16:53<4:52:57,  3.66it/s]
 83%|████████▎ | 307202/371472 [2:16:54<4:47:48,  3.72it/s]
 83%|████████▎ | 307203/371472 [2:16:54<4:40:21,  3.82it/s]
 83%|████████▎ | 307204/371472 [2:16:54<4:37:27,  3.86it/s]
 83%|████████▎ | 307205/371472 [2:16:54<4:43:29,  3.78it/s]
 83%|████████▎ | 307206/371472 [2:16:55<4:53:01,  3.66it/s]
 83%|████████▎ | 307207/371472 [2:16:55<5:00:16,  3.57it/s]
 83%|████████▎ | 307208/371472 [2:16:55<5:02:14,  3.54it/s]
 83%|████████▎ | 307209/371472 [2:16:56<4:47:34,  3.72it/s]
 83%|████████▎ | 307210/371472 [2:16:56<4:43:21,  3.78it/s]
 83%|████████▎ | 307211/371472 [2:16:56<4:41:35,  3.80it/s]
 83%|████████▎ | 307212/371472 [2:16:56<4:50:57,  3.68it/s]
 83%|████████▎ | 307213/371472 [2:16:57<4:52:17,  3.66it/s]
 83%|████████▎ | 307214/371472 [2:16:57<4:58:17,  3.59it/s]
 83%|████████▎ | 307215/371472 [2:16:57<5:30:42,  3.24it/s]
 83%|████████▎ | 307216/371472 [2:16:58<5:18:57,  3.36it/s]
 83%|████████▎ | 307217/371472 [2:16:58<5:27:18,  3.27it/s]
 83%|████████▎ | 307218/371472 [2:16:58<5:57:17,  3.00it/s]
 83%|████████▎ | 307219/371472 [2:16:59<5:33:29,  3.21it/s]
 83%|████████▎ | 307220/371472 [2:16:59<5:33:46,  3.21it/s]
                                                           
{'loss': 2.5141, 'learning_rate': 2.557531944234955e-07, 'epoch': 13.23}

 83%|████████▎ | 307220/371472 [2:16:59<5:33:46,  3.21it/s]
 83%|████████▎ | 307221/371472 [2:16:59<5:17:05,  3.38it/s]
 83%|████████▎ | 307222/371472 [2:16:59<5:08:15,  3.47it/s]
 83%|████████▎ | 307223/371472 [2:17:00<5:12:33,  3.43it/s]
 83%|████████▎ | 307224/371472 [2:17:00<5:16:30,  3.38it/s]
 83%|████████▎ | 307225/371472 [2:17:00<5:14:22,  3.41it/s]
 83%|████████▎ | 307226/371472 [2:17:01<5:08:30,  3.47it/s]
 83%|████████▎ | 307227/371472 [2:17:01<5:24:33,  3.30it/s]
 83%|████████▎ | 307228/371472 [2:17:01<5:13:27,  3.42it/s]
 83%|████████▎ | 307229/371472 [2:17:02<5:39:23,  3.15it/s]
 83%|████████▎ | 307230/371472 [2:17:02<5:30:03,  3.24it/s]
 83%|████████▎ | 307231/371472 [2:17:02<5:15:54,  3.39it/s]
 83%|████████▎ | 307232/371472 [2:17:02<5:08:19,  3.47it/s]
 83%|████████▎ | 307233/371472 [2:17:03<4:59:46,  3.57it/s]
 83%|████████▎ | 307234/371472 [2:17:03<4:58:12,  3.59it/s]
 83%|████████▎ | 307235/371472 [2:17:03<4:54:52,  3.63it/s]
 83%|████████▎ | 307236/371472 [2:17:03<4:59:52,  3.57it/s]
 83%|████████▎ | 307237/371472 [2:17:04<6:16:11,  2.85it/s]
 83%|████████▎ | 307238/371472 [2:17:04<6:03:15,  2.95it/s]
 83%|████████▎ | 307239/371472 [2:17:05<5:44:26,  3.11it/s]
 83%|████████▎ | 307240/371472 [2:17:05<5:35:03,  3.20it/s]
                                                           
{'loss': 2.6736, 'learning_rate': 2.5570471244801657e-07, 'epoch': 13.23}

 83%|████████▎ | 307240/371472 [2:17:05<5:35:03,  3.20it/s]
 83%|████████▎ | 307241/371472 [2:17:05<5:22:27,  3.32it/s]
 83%|████████▎ | 307242/371472 [2:17:05<5:09:18,  3.46it/s]
 83%|████████▎ | 307243/371472 [2:17:06<5:05:56,  3.50it/s]
 83%|████████▎ | 307244/371472 [2:17:06<4:56:39,  3.61it/s]
 83%|████████▎ | 307245/371472 [2:17:06<5:51:52,  3.04it/s]
 83%|████████▎ | 307246/371472 [2:17:07<5:32:13,  3.22it/s]
 83%|████████▎ | 307247/371472 [2:17:07<5:11:25,  3.44it/s]
 83%|████████▎ | 307248/371472 [2:17:07<5:11:28,  3.44it/s]
 83%|████████▎ | 307249/371472 [2:17:07<5:11:53,  3.43it/s]
 83%|████████▎ | 307250/371472 [2:17:08<5:01:52,  3.55it/s]
 83%|████████▎ | 307251/371472 [2:17:08<4:51:36,  3.67it/s]
 83%|████████▎ | 307252/371472 [2:17:08<5:01:05,  3.55it/s]
 83%|████████▎ | 307253/371472 [2:17:09<4:56:55,  3.60it/s]
 83%|████████▎ | 307254/371472 [2:17:09<4:52:20,  3.66it/s]
 83%|████████▎ | 307255/371472 [2:17:09<4:46:28,  3.74it/s]
 83%|████████▎ | 307256/371472 [2:17:09<4:40:05,  3.82it/s]
 83%|████████▎ | 307257/371472 [2:17:10<4:35:04,  3.89it/s]
 83%|████████▎ | 307258/371472 [2:17:10<4:41:18,  3.80it/s]
 83%|████████▎ | 307259/371472 [2:17:10<4:45:11,  3.75it/s]
 83%|████████▎ | 307260/371472 [2:17:10<5:07:06,  3.48it/s]
                                                           
{'loss': 2.5106, 'learning_rate': 2.556562304725376e-07, 'epoch': 13.23}

 83%|████████▎ | 307260/371472 [2:17:10<5:07:06,  3.48it/s]
 83%|████████▎ | 307261/371472 [2:17:11<4:55:34,  3.62it/s]
 83%|████████▎ | 307262/371472 [2:17:11<4:50:21,  3.69it/s]
 83%|████████▎ | 307263/371472 [2:17:11<4:56:47,  3.61it/s]
 83%|████████▎ | 307264/371472 [2:17:12<4:58:30,  3.58it/s]
 83%|████████▎ | 307265/371472 [2:17:12<5:00:14,  3.56it/s]
 83%|████████▎ | 307266/371472 [2:17:12<5:05:48,  3.50it/s]
 83%|████████▎ | 307267/371472 [2:17:12<4:52:51,  3.65it/s]
 83%|████████▎ | 307268/371472 [2:17:13<4:48:06,  3.71it/s]
 83%|████████▎ | 307269/371472 [2:17:13<4:48:16,  3.71it/s]
 83%|████████▎ | 307270/371472 [2:17:13<5:32:07,  3.22it/s]
 83%|████████▎ | 307271/371472 [2:17:14<5:19:23,  3.35it/s]
 83%|████████▎ | 307272/371472 [2:17:14<5:16:28,  3.38it/s]
 83%|████████▎ | 307273/371472 [2:17:14<5:06:22,  3.49it/s]
 83%|████████▎ | 307274/371472 [2:17:14<4:57:25,  3.60it/s]
 83%|████████▎ | 307275/371472 [2:17:15<4:54:16,  3.64it/s]
 83%|████████▎ | 307276/371472 [2:17:15<5:20:05,  3.34it/s]
 83%|████████▎ | 307277/371472 [2:17:15<5:12:33,  3.42it/s]
 83%|████████▎ | 307278/371472 [2:17:16<4:58:44,  3.58it/s]
 83%|████████▎ | 307279/371472 [2:17:16<4:55:31,  3.62it/s]
 83%|████████▎ | 307280/371472 [2:17:16<5:08:32,  3.47it/s]
                                                           
{'loss': 2.5701, 'learning_rate': 2.556077484970587e-07, 'epoch': 13.24}

 83%|████████▎ | 307280/371472 [2:17:16<5:08:32,  3.47it/s]
 83%|████████▎ | 307281/371472 [2:17:16<5:17:05,  3.37it/s]
 83%|████████▎ | 307282/371472 [2:17:17<5:25:37,  3.29it/s]
 83%|████████▎ | 307283/371472 [2:17:17<5:21:02,  3.33it/s]
 83%|████████▎ | 307284/371472 [2:17:17<5:04:38,  3.51it/s]
 83%|████████▎ | 307285/371472 [2:17:18<4:56:35,  3.61it/s]
 83%|████████▎ | 307286/371472 [2:17:18<4:56:13,  3.61it/s]
 83%|████████▎ | 307287/371472 [2:17:18<5:04:24,  3.51it/s]
 83%|████████▎ | 307288/371472 [2:17:18<4:59:31,  3.57it/s]
 83%|████████▎ | 307289/371472 [2:17:19<4:54:08,  3.64it/s]
 83%|████████▎ | 307290/371472 [2:17:19<4:53:32,  3.64it/s]
 83%|████████▎ | 307291/371472 [2:17:19<5:09:41,  3.45it/s]
 83%|████████▎ | 307292/371472 [2:17:20<5:21:10,  3.33it/s]
 83%|████████▎ | 307293/371472 [2:17:20<5:10:47,  3.44it/s]
 83%|████████▎ | 307294/371472 [2:17:20<5:08:26,  3.47it/s]
 83%|████████▎ | 307295/371472 [2:17:20<4:52:54,  3.65it/s]
 83%|████████▎ | 307296/371472 [2:17:21<4:43:15,  3.78it/s]
 83%|████████▎ | 307297/371472 [2:17:21<4:40:36,  3.81it/s]
 83%|████████▎ | 307298/371472 [2:17:21<4:39:24,  3.83it/s]
 83%|████████▎ | 307299/371472 [2:17:21<4:36:17,  3.87it/s]
 83%|████████▎ | 307300/371472 [2:17:22<4:38:19,  3.84it/s]
                                                           
{'loss': 2.5772, 'learning_rate': 2.555592665215798e-07, 'epoch': 13.24}

 83%|████████▎ | 307300/371472 [2:17:22<4:38:19,  3.84it/s]
 83%|████████▎ | 307301/371472 [2:17:22<4:41:01,  3.81it/s]
 83%|████████▎ | 307302/371472 [2:17:22<4:55:01,  3.63it/s]
 83%|████████▎ | 307303/371472 [2:17:23<5:04:46,  3.51it/s]
 83%|████████▎ | 307304/371472 [2:17:23<5:17:42,  3.37it/s]
 83%|████████▎ | 307305/371472 [2:17:23<5:15:33,  3.39it/s]
 83%|████████▎ | 307306/371472 [2:17:23<5:07:38,  3.48it/s]
 83%|████████▎ | 307307/371472 [2:17:24<5:03:08,  3.53it/s]
 83%|████████▎ | 307308/371472 [2:17:24<5:04:53,  3.51it/s]
 83%|████████▎ | 307309/371472 [2:17:24<4:55:14,  3.62it/s]
 83%|████████▎ | 307310/371472 [2:17:24<4:53:07,  3.65it/s]
 83%|████████▎ | 307311/371472 [2:17:25<4:59:04,  3.58it/s]
 83%|████████▎ | 307312/371472 [2:17:25<5:17:33,  3.37it/s]
 83%|████████▎ | 307313/371472 [2:17:25<5:12:37,  3.42it/s]
 83%|████████▎ | 307314/371472 [2:17:26<5:13:13,  3.41it/s]
 83%|████████▎ | 307315/371472 [2:17:26<5:28:29,  3.26it/s]
 83%|████████▎ | 307316/371472 [2:17:26<5:22:12,  3.32it/s]
 83%|████████▎ | 307317/371472 [2:17:27<5:10:24,  3.44it/s]
 83%|████████▎ | 307318/371472 [2:17:27<5:06:54,  3.48it/s]
 83%|████████▎ | 307319/371472 [2:17:27<5:09:35,  3.45it/s]
 83%|████████▎ | 307320/371472 [2:17:27<5:14:20,  3.40it/s]
                                                           
{'loss': 2.6105, 'learning_rate': 2.5551078454610096e-07, 'epoch': 13.24}

 83%|████████▎ | 307320/371472 [2:17:27<5:14:20,  3.40it/s]
 83%|████████▎ | 307321/371472 [2:17:28<5:27:49,  3.26it/s]
 83%|████████▎ | 307322/371472 [2:17:28<5:17:54,  3.36it/s]
 83%|████████▎ | 307323/371472 [2:17:28<5:11:11,  3.44it/s]
 83%|████████▎ | 307324/371472 [2:17:29<5:09:01,  3.46it/s]
 83%|████████▎ | 307325/371472 [2:17:29<5:00:54,  3.55it/s]
 83%|████████▎ | 307326/371472 [2:17:29<4:58:02,  3.59it/s]
 83%|████████▎ | 307327/371472 [2:17:29<5:07:38,  3.48it/s]
 83%|████████▎ | 307328/371472 [2:17:30<5:11:38,  3.43it/s]
 83%|████████▎ | 307329/371472 [2:17:30<5:13:02,  3.42it/s]
 83%|████████▎ | 307330/371472 [2:17:30<5:04:04,  3.52it/s]
 83%|████████▎ | 307331/371472 [2:17:31<5:04:49,  3.51it/s]
 83%|████████▎ | 307332/371472 [2:17:31<5:06:17,  3.49it/s]
 83%|████████▎ | 307333/371472 [2:17:31<4:50:18,  3.68it/s]
 83%|████████▎ | 307334/371472 [2:17:31<4:41:37,  3.80it/s]
 83%|████████▎ | 307335/371472 [2:17:32<4:45:19,  3.75it/s]
 83%|████████▎ | 307336/371472 [2:17:32<4:47:32,  3.72it/s]
 83%|████████▎ | 307337/371472 [2:17:32<4:48:01,  3.71it/s]
 83%|████████▎ | 307338/371472 [2:17:32<4:47:57,  3.71it/s]
 83%|████████▎ | 307339/371472 [2:17:33<4:41:07,  3.80it/s]
 83%|████████▎ | 307340/371472 [2:17:33<4:49:21,  3.69it/s]
                                                           
{'loss': 2.5223, 'learning_rate': 2.5546230257062203e-07, 'epoch': 13.24}

 83%|████████▎ | 307340/371472 [2:17:33<4:49:21,  3.69it/s]
 83%|████████▎ | 307341/371472 [2:17:33<4:40:07,  3.82it/s]
 83%|████████▎ | 307342/371472 [2:17:34<4:47:50,  3.71it/s]
 83%|████████▎ | 307343/371472 [2:17:34<5:00:34,  3.56it/s]
 83%|████████▎ | 307344/371472 [2:17:34<5:03:15,  3.52it/s]
 83%|████████▎ | 307345/371472 [2:17:34<5:03:57,  3.52it/s]
 83%|████████▎ | 307346/371472 [2:17:35<4:50:56,  3.67it/s]
 83%|████████▎ | 307347/371472 [2:17:35<4:48:42,  3.70it/s]
 83%|████████▎ | 307348/371472 [2:17:35<4:54:00,  3.64it/s]
 83%|████████▎ | 307349/371472 [2:17:35<4:46:40,  3.73it/s]
 83%|████████▎ | 307350/371472 [2:17:36<4:55:11,  3.62it/s]
 83%|████████▎ | 307351/371472 [2:17:36<4:48:29,  3.70it/s]
 83%|████████▎ | 307352/371472 [2:17:36<4:50:50,  3.67it/s]
 83%|████████▎ | 307353/371472 [2:17:37<5:26:40,  3.27it/s]
 83%|████████▎ | 307354/371472 [2:17:37<5:28:52,  3.25it/s]
 83%|████████▎ | 307355/371472 [2:17:37<5:15:55,  3.38it/s]
 83%|████████▎ | 307356/371472 [2:17:38<5:17:27,  3.37it/s]
 83%|████████▎ | 307357/371472 [2:17:38<5:04:03,  3.51it/s]
 83%|████████▎ | 307358/371472 [2:17:38<4:56:36,  3.60it/s]
 83%|████████▎ | 307359/371472 [2:17:38<4:52:50,  3.65it/s]
 83%|████████▎ | 307360/371472 [2:17:39<4:53:53,  3.64it/s]
                                                           
{'loss': 2.5373, 'learning_rate': 2.554138205951432e-07, 'epoch': 13.24}

 83%|████████▎ | 307360/371472 [2:17:39<4:53:53,  3.64it/s]
 83%|████████▎ | 307361/371472 [2:17:39<4:58:36,  3.58it/s]
 83%|████████▎ | 307362/371472 [2:17:39<5:15:47,  3.38it/s]
 83%|████████▎ | 307363/371472 [2:17:40<5:02:27,  3.53it/s]
 83%|████████▎ | 307364/371472 [2:17:40<4:50:40,  3.68it/s]
 83%|████████▎ | 307365/371472 [2:17:40<5:10:07,  3.45it/s]
 83%|████████▎ | 307366/371472 [2:17:40<5:09:08,  3.46it/s]
 83%|████████▎ | 307367/371472 [2:17:41<5:10:26,  3.44it/s]
 83%|████████▎ | 307368/371472 [2:17:41<5:02:43,  3.53it/s]
 83%|████████▎ | 307369/371472 [2:17:41<5:01:18,  3.55it/s]
 83%|████████▎ | 307370/371472 [2:17:41<4:45:59,  3.74it/s]
 83%|████████▎ | 307371/371472 [2:17:42<4:50:44,  3.67it/s]
 83%|████████▎ | 307372/371472 [2:17:42<4:45:58,  3.74it/s]
 83%|████████▎ | 307373/371472 [2:17:42<4:58:32,  3.58it/s]
 83%|████████▎ | 307374/371472 [2:17:43<4:53:06,  3.64it/s]
 83%|████████▎ | 307375/371472 [2:17:43<4:53:25,  3.64it/s]
 83%|████████▎ | 307376/371472 [2:17:43<4:54:50,  3.62it/s]
 83%|████████▎ | 307377/371472 [2:17:43<5:07:33,  3.47it/s]
 83%|████████▎ | 307378/371472 [2:17:44<4:55:29,  3.62it/s]
 83%|████████▎ | 307379/371472 [2:17:44<5:03:02,  3.52it/s]
 83%|████████▎ | 307380/371472 [2:17:44<4:52:16,  3.65it/s]
                                                           
{'loss': 2.5587, 'learning_rate': 2.5536533861966423e-07, 'epoch': 13.24}

 83%|████████▎ | 307380/371472 [2:17:44<4:52:16,  3.65it/s]
 83%|████████▎ | 307381/371472 [2:17:45<4:57:06,  3.60it/s]
 83%|████████▎ | 307382/371472 [2:17:45<4:59:40,  3.56it/s]
 83%|████████▎ | 307383/371472 [2:17:45<5:04:33,  3.51it/s]
 83%|████████▎ | 307384/371472 [2:17:45<5:02:42,  3.53it/s]
 83%|████████▎ | 307385/371472 [2:17:46<5:00:28,  3.55it/s]
 83%|████████▎ | 307386/371472 [2:17:46<5:22:13,  3.31it/s]
 83%|████████▎ | 307387/371472 [2:17:46<5:11:58,  3.42it/s]
 83%|████████▎ | 307388/371472 [2:17:47<5:06:16,  3.49it/s]
 83%|████████▎ | 307389/371472 [2:17:47<5:01:49,  3.54it/s]
 83%|████████▎ | 307390/371472 [2:17:47<5:04:49,  3.50it/s]
 83%|████████▎ | 307391/371472 [2:17:47<5:17:10,  3.37it/s]
 83%|████████▎ | 307392/371472 [2:17:48<5:19:45,  3.34it/s]
 83%|████████▎ | 307393/371472 [2:17:48<5:17:31,  3.36it/s]
 83%|████████▎ | 307394/371472 [2:17:48<5:28:32,  3.25it/s]
 83%|████████▎ | 307395/371472 [2:17:49<5:13:31,  3.41it/s]
 83%|████████▎ | 307396/371472 [2:17:49<5:36:07,  3.18it/s]
 83%|████████▎ | 307397/371472 [2:17:49<5:20:09,  3.34it/s]
 83%|████████▎ | 307398/371472 [2:17:50<5:07:20,  3.47it/s]
 83%|████████▎ | 307399/371472 [2:17:50<4:59:36,  3.56it/s]
 83%|████████▎ | 307400/371472 [2:17:50<5:07:54,  3.47it/s]
                                                           
{'loss': 2.6929, 'learning_rate': 2.553168566441854e-07, 'epoch': 13.24}

 83%|████████▎ | 307400/371472 [2:17:50<5:07:54,  3.47it/s]
 83%|████████▎ | 307401/371472 [2:17:50<5:09:09,  3.45it/s]
 83%|████████▎ | 307402/371472 [2:17:51<4:59:35,  3.56it/s]
 83%|████████▎ | 307403/371472 [2:17:51<4:50:52,  3.67it/s]
 83%|████████▎ | 307404/371472 [2:17:51<4:46:23,  3.73it/s]
 83%|████████▎ | 307405/371472 [2:17:51<4:46:57,  3.72it/s]
 83%|████████▎ | 307406/371472 [2:17:52<5:02:32,  3.53it/s]
 83%|████████▎ | 307407/371472 [2:17:52<5:01:40,  3.54it/s]
 83%|████████▎ | 307408/371472 [2:17:52<5:06:43,  3.48it/s]
 83%|████████▎ | 307409/371472 [2:17:53<5:24:49,  3.29it/s]
 83%|████████▎ | 307410/371472 [2:17:53<5:05:20,  3.50it/s]
 83%|████████▎ | 307411/371472 [2:17:53<5:08:21,  3.46it/s]
 83%|████████▎ | 307412/371472 [2:17:53<4:54:34,  3.62it/s]
 83%|████████▎ | 307413/371472 [2:17:54<4:48:41,  3.70it/s]
 83%|████████▎ | 307414/371472 [2:17:54<4:42:29,  3.78it/s]
 83%|████████▎ | 307415/371472 [2:17:54<4:56:48,  3.60it/s]
 83%|████████▎ | 307416/371472 [2:17:55<4:50:42,  3.67it/s]
 83%|████████▎ | 307417/371472 [2:17:55<4:45:44,  3.74it/s]
 83%|████████▎ | 307418/371472 [2:17:55<4:48:15,  3.70it/s]
 83%|████████▎ | 307419/371472 [2:17:55<4:37:58,  3.84it/s]
 83%|████████▎ | 307420/371472 [2:17:56<4:46:42,  3.72it/s]
                                                           
{'loss': 2.5897, 'learning_rate': 2.552683746687064e-07, 'epoch': 13.24}

 83%|████████▎ | 307420/371472 [2:17:56<4:46:42,  3.72it/s]
 83%|████████▎ | 307421/371472 [2:17:56<5:06:43,  3.48it/s]
 83%|████████▎ | 307422/371472 [2:17:56<5:14:23,  3.40it/s]
 83%|████████▎ | 307423/371472 [2:17:57<5:06:11,  3.49it/s]
 83%|████████▎ | 307424/371472 [2:17:57<5:26:21,  3.27it/s]
 83%|████████▎ | 307425/371472 [2:17:57<5:03:45,  3.51it/s]
 83%|████████▎ | 307426/371472 [2:17:58<6:33:27,  2.71it/s]
 83%|████████▎ | 307427/371472 [2:17:58<5:57:54,  2.98it/s]
 83%|████████▎ | 307428/371472 [2:17:58<5:31:16,  3.22it/s]
 83%|████████▎ | 307429/371472 [2:17:58<5:23:46,  3.30it/s]
 83%|████████▎ | 307430/371472 [2:17:59<5:20:13,  3.33it/s]
 83%|████████▎ | 307431/371472 [2:17:59<5:12:27,  3.42it/s]
 83%|████████▎ | 307432/371472 [2:17:59<5:01:53,  3.54it/s]
 83%|████████▎ | 307433/371472 [2:18:00<4:55:37,  3.61it/s]
 83%|████████▎ | 307434/371472 [2:18:00<4:51:40,  3.66it/s]
 83%|████████▎ | 307435/371472 [2:18:00<5:25:12,  3.28it/s]
 83%|████████▎ | 307436/371472 [2:18:00<5:19:43,  3.34it/s]
 83%|████████▎ | 307437/371472 [2:18:01<5:29:35,  3.24it/s]
 83%|████████▎ | 307438/371472 [2:18:01<5:12:38,  3.41it/s]
 83%|████████▎ | 307439/371472 [2:18:01<5:10:00,  3.44it/s]
 83%|████████▎ | 307440/371472 [2:18:02<4:58:23,  3.58it/s]
                                                           
{'loss': 2.7799, 'learning_rate': 2.552198926932276e-07, 'epoch': 13.24}

 83%|████████▎ | 307440/371472 [2:18:02<4:58:23,  3.58it/s]
 83%|████████▎ | 307441/371472 [2:18:02<4:51:02,  3.67it/s]
 83%|████████▎ | 307442/371472 [2:18:02<4:42:55,  3.77it/s]
 83%|████████▎ | 307443/371472 [2:18:02<4:50:53,  3.67it/s]
 83%|████████▎ | 307444/371472 [2:18:03<5:04:15,  3.51it/s]
 83%|████████▎ | 307445/371472 [2:18:03<5:31:06,  3.22it/s]
 83%|████████▎ | 307446/371472 [2:18:03<5:21:16,  3.32it/s]
 83%|████████▎ | 307447/371472 [2:18:04<5:43:03,  3.11it/s]
 83%|████████▎ | 307448/371472 [2:18:04<5:18:19,  3.35it/s]
 83%|████████▎ | 307449/371472 [2:18:04<5:09:12,  3.45it/s]
 83%|████████▎ | 307450/371472 [2:18:04<5:00:27,  3.55it/s]
 83%|████████▎ | 307451/371472 [2:18:05<4:58:24,  3.58it/s]
 83%|████████▎ | 307452/371472 [2:18:05<4:57:47,  3.58it/s]
 83%|████████▎ | 307453/371472 [2:18:05<4:50:38,  3.67it/s]
 83%|████████▎ | 307454/371472 [2:18:06<4:53:22,  3.64it/s]
 83%|████████▎ | 307455/371472 [2:18:06<4:53:55,  3.63it/s]
 83%|████████▎ | 307456/371472 [2:18:06<5:12:50,  3.41it/s]
 83%|████████▎ | 307457/371472 [2:18:06<5:05:08,  3.50it/s]
 83%|████████▎ | 307458/371472 [2:18:07<4:51:38,  3.66it/s]
 83%|████████▎ | 307459/371472 [2:18:07<5:03:58,  3.51it/s]
 83%|████████▎ | 307460/371472 [2:18:07<5:33:22,  3.20it/s]
                                                           
{'loss': 2.7503, 'learning_rate': 2.551714107177487e-07, 'epoch': 13.24}

 83%|████████▎ | 307460/371472 [2:18:07<5:33:22,  3.20it/s]
 83%|████████▎ | 307461/371472 [2:18:08<5:38:26,  3.15it/s]
 83%|████████▎ | 307462/371472 [2:18:08<5:33:23,  3.20it/s]
 83%|████████▎ | 307463/371472 [2:18:08<5:17:26,  3.36it/s]
 83%|████████▎ | 307464/371472 [2:18:09<5:11:08,  3.43it/s]
 83%|████████▎ | 307465/371472 [2:18:09<4:57:51,  3.58it/s]
 83%|████████▎ | 307466/371472 [2:18:09<5:00:19,  3.55it/s]
 83%|████████▎ | 307467/371472 [2:18:09<4:56:05,  3.60it/s]
 83%|████████▎ | 307468/371472 [2:18:10<4:41:23,  3.79it/s]
 83%|████████▎ | 307469/371472 [2:18:10<4:36:46,  3.85it/s]
 83%|████████▎ | 307470/371472 [2:18:10<4:36:51,  3.85it/s]
 83%|████████▎ | 307471/371472 [2:18:10<4:48:54,  3.69it/s]
 83%|████████▎ | 307472/371472 [2:18:11<4:54:52,  3.62it/s]
 83%|████████▎ | 307473/371472 [2:18:11<5:22:02,  3.31it/s]
 83%|████████▎ | 307474/371472 [2:18:11<5:00:36,  3.55it/s]
 83%|████████▎ | 307475/371472 [2:18:12<4:53:15,  3.64it/s]
 83%|████████▎ | 307476/371472 [2:18:12<4:51:43,  3.66it/s]
 83%|████████▎ | 307477/371472 [2:18:12<5:12:00,  3.42it/s]
 83%|████████▎ | 307478/371472 [2:18:12<4:59:36,  3.56it/s]
 83%|████████▎ | 307479/371472 [2:18:13<4:45:16,  3.74it/s]
 83%|████████▎ | 307480/371472 [2:18:13<4:40:35,  3.80it/s]
                                                           
{'loss': 2.6107, 'learning_rate': 2.5512292874226985e-07, 'epoch': 13.24}

 83%|████████▎ | 307480/371472 [2:18:13<4:40:35,  3.80it/s]
 83%|████████▎ | 307481/371472 [2:18:13<4:32:42,  3.91it/s]
 83%|████████▎ | 307482/371472 [2:18:13<4:41:46,  3.79it/s]
 83%|████████▎ | 307483/371472 [2:18:14<4:40:58,  3.80it/s]
 83%|████████▎ | 307484/371472 [2:18:14<4:51:43,  3.66it/s]
 83%|████████▎ | 307485/371472 [2:18:14<4:54:57,  3.62it/s]
 83%|████████▎ | 307486/371472 [2:18:15<4:46:44,  3.72it/s]
 83%|████████▎ | 307487/371472 [2:18:15<4:45:00,  3.74it/s]
 83%|████████▎ | 307488/371472 [2:18:15<5:03:29,  3.51it/s]
 83%|████████▎ | 307489/371472 [2:18:15<5:00:34,  3.55it/s]
 83%|████████▎ | 307490/371472 [2:18:16<4:51:33,  3.66it/s]
 83%|████████▎ | 307491/371472 [2:18:16<4:49:22,  3.68it/s]
 83%|████████▎ | 307492/371472 [2:18:16<5:34:19,  3.19it/s]
 83%|████████▎ | 307493/371472 [2:18:17<5:36:33,  3.17it/s]
 83%|████████▎ | 307494/371472 [2:18:17<5:30:38,  3.22it/s]
 83%|████████▎ | 307495/371472 [2:18:17<5:23:52,  3.29it/s]
 83%|████████▎ | 307496/371472 [2:18:17<5:12:18,  3.41it/s]
 83%|████████▎ | 307497/371472 [2:18:18<5:14:08,  3.39it/s]
 83%|████████▎ | 307498/371472 [2:18:18<4:59:15,  3.56it/s]
 83%|████████▎ | 307499/371472 [2:18:18<5:01:41,  3.53it/s]
 83%|████████▎ | 307500/371472 [2:18:19<5:25:20,  3.28it/s]
                                                           
{'loss': 2.7337, 'learning_rate': 2.550744467667909e-07, 'epoch': 13.24}

 83%|████████▎ | 307500/371472 [2:18:19<5:25:20,  3.28it/s]
 83%|████████▎ | 307501/371472 [2:18:19<5:26:38,  3.26it/s]
 83%|████████▎ | 307502/371472 [2:18:19<5:13:58,  3.40it/s]
 83%|████████▎ | 307503/371472 [2:18:20<4:55:32,  3.61it/s]
 83%|████████▎ | 307504/371472 [2:18:20<4:52:57,  3.64it/s]
 83%|████████▎ | 307505/371472 [2:18:20<4:44:52,  3.74it/s]
 83%|████████▎ | 307506/371472 [2:18:20<4:45:00,  3.74it/s]
 83%|████████▎ | 307507/371472 [2:18:21<4:45:08,  3.74it/s]
 83%|████████▎ | 307508/371472 [2:18:21<4:44:13,  3.75it/s]
 83%|████████▎ | 307509/371472 [2:18:21<4:50:01,  3.68it/s]
 83%|████████▎ | 307510/371472 [2:18:21<4:51:10,  3.66it/s]
 83%|████████▎ | 307511/371472 [2:18:22<5:03:11,  3.52it/s]
 83%|████████▎ | 307512/371472 [2:18:22<5:01:32,  3.54it/s]
 83%|████████▎ | 307513/371472 [2:18:22<4:57:59,  3.58it/s]
 83%|████████▎ | 307514/371472 [2:18:23<4:59:55,  3.55it/s]
 83%|████████▎ | 307515/371472 [2:18:23<4:53:24,  3.63it/s]
 83%|████████▎ | 307516/371472 [2:18:23<4:48:32,  3.69it/s]
 83%|████████▎ | 307517/371472 [2:18:23<5:06:22,  3.48it/s]
 83%|████████▎ | 307518/371472 [2:18:24<5:22:24,  3.31it/s]
 83%|████████▎ | 307519/371472 [2:18:24<5:28:45,  3.24it/s]
 83%|████████▎ | 307520/371472 [2:18:24<5:11:48,  3.42it/s]
                                                           
{'loss': 2.6188, 'learning_rate': 2.5502596479131205e-07, 'epoch': 13.25}

 83%|████████▎ | 307520/371472 [2:18:24<5:11:48,  3.42it/s]
 83%|████████▎ | 307521/371472 [2:18:25<5:07:34,  3.47it/s]
 83%|████████▎ | 307522/371472 [2:18:25<4:48:03,  3.70it/s]
 83%|████████▎ | 307523/371472 [2:18:25<4:56:07,  3.60it/s]
 83%|████████▎ | 307524/371472 [2:18:25<4:48:39,  3.69it/s]
 83%|████████▎ | 307525/371472 [2:18:26<4:56:03,  3.60it/s]
 83%|████████▎ | 307526/371472 [2:18:26<4:56:23,  3.60it/s]
 83%|████████▎ | 307527/371472 [2:18:26<5:00:31,  3.55it/s]
 83%|████████▎ | 307528/371472 [2:18:26<4:54:30,  3.62it/s]
 83%|████████▎ | 307529/371472 [2:18:27<5:14:06,  3.39it/s]
 83%|████████▎ | 307530/371472 [2:18:27<5:06:23,  3.48it/s]
 83%|████████▎ | 307531/371472 [2:18:27<5:13:04,  3.40it/s]
 83%|████████▎ | 307532/371472 [2:18:28<5:12:59,  3.40it/s]
 83%|████████▎ | 307533/371472 [2:18:28<5:03:38,  3.51it/s]
 83%|████████▎ | 307534/371472 [2:18:28<5:12:59,  3.40it/s]
 83%|████████▎ | 307535/371472 [2:18:29<5:23:48,  3.29it/s]
 83%|████████▎ | 307536/371472 [2:18:29<5:06:20,  3.48it/s]
 83%|████████▎ | 307537/371472 [2:18:29<5:16:39,  3.37it/s]
 83%|████████▎ | 307538/371472 [2:18:29<5:07:16,  3.47it/s]
 83%|████████▎ | 307539/371472 [2:18:30<5:04:45,  3.50it/s]
 83%|████████▎ | 307540/371472 [2:18:30<4:53:52,  3.63it/s]
                                                           
{'loss': 2.5774, 'learning_rate': 2.5497748281583307e-07, 'epoch': 13.25}

 83%|████████▎ | 307540/371472 [2:18:30<4:53:52,  3.63it/s]
 83%|████████▎ | 307541/371472 [2:18:30<5:17:53,  3.35it/s]
 83%|████████▎ | 307542/371472 [2:18:31<5:20:06,  3.33it/s]
 83%|████████▎ | 307543/371472 [2:18:31<5:09:51,  3.44it/s]
 83%|████████▎ | 307544/371472 [2:18:31<5:39:18,  3.14it/s]
 83%|████████▎ | 307545/371472 [2:18:32<5:22:11,  3.31it/s]
 83%|████████▎ | 307546/371472 [2:18:32<5:06:00,  3.48it/s]
 83%|████████▎ | 307547/371472 [2:18:32<5:01:11,  3.54it/s]
 83%|████████▎ | 307548/371472 [2:18:32<5:27:13,  3.26it/s]
 83%|████████▎ | 307549/371472 [2:18:33<5:45:14,  3.09it/s]
 83%|████████▎ | 307550/371472 [2:18:33<5:35:58,  3.17it/s]
 83%|████████▎ | 307551/371472 [2:18:33<5:28:16,  3.25it/s]
 83%|████████▎ | 307552/371472 [2:18:34<5:26:26,  3.26it/s]
 83%|████████▎ | 307553/371472 [2:18:34<5:22:53,  3.30it/s]
 83%|████████▎ | 307554/371472 [2:18:34<5:03:15,  3.51it/s]
 83%|████████▎ | 307555/371472 [2:18:34<4:53:23,  3.63it/s]
 83%|████████▎ | 307556/371472 [2:18:35<5:34:58,  3.18it/s]
 83%|████████▎ | 307557/371472 [2:18:35<5:20:38,  3.32it/s]
 83%|████████▎ | 307558/371472 [2:18:35<5:33:57,  3.19it/s]
 83%|████████▎ | 307559/371472 [2:18:36<5:10:17,  3.43it/s]
 83%|████████▎ | 307560/371472 [2:18:36<5:27:09,  3.26it/s]
                                                           
{'loss': 2.6083, 'learning_rate': 2.5492900084035424e-07, 'epoch': 13.25}

 83%|████████▎ | 307560/371472 [2:18:36<5:27:09,  3.26it/s]
 83%|████████▎ | 307561/371472 [2:18:36<5:20:09,  3.33it/s]
 83%|████████▎ | 307562/371472 [2:18:37<5:07:57,  3.46it/s]
 83%|████████▎ | 307563/371472 [2:18:37<5:14:37,  3.39it/s]
 83%|████████▎ | 307564/371472 [2:18:37<5:08:25,  3.45it/s]
 83%|████████▎ | 307565/371472 [2:18:38<5:14:21,  3.39it/s]
 83%|████████▎ | 307566/371472 [2:18:38<5:08:51,  3.45it/s]
 83%|████████▎ | 307567/371472 [2:18:38<5:00:16,  3.55it/s]
 83%|████████▎ | 307568/371472 [2:18:38<5:11:28,  3.42it/s]
 83%|████████▎ | 307569/371472 [2:18:39<5:10:38,  3.43it/s]
 83%|████████▎ | 307570/371472 [2:18:39<4:57:19,  3.58it/s]
 83%|████████▎ | 307571/371472 [2:18:39<4:45:46,  3.73it/s]
 83%|████████▎ | 307572/371472 [2:18:39<4:38:05,  3.83it/s]
 83%|████████▎ | 307573/371472 [2:18:40<4:41:29,  3.78it/s]
 83%|████████▎ | 307574/371472 [2:18:40<5:53:04,  3.02it/s]
 83%|████████▎ | 307575/371472 [2:18:40<5:25:59,  3.27it/s]
 83%|████████▎ | 307576/371472 [2:18:41<5:08:31,  3.45it/s]
 83%|████████▎ | 307577/371472 [2:18:41<5:17:16,  3.36it/s]
 83%|████████▎ | 307578/371472 [2:18:41<5:06:00,  3.48it/s]
 83%|████████▎ | 307579/371472 [2:18:42<5:05:11,  3.49it/s]
 83%|████████▎ | 307580/371472 [2:18:42<4:49:26,  3.68it/s]
                                                           
{'loss': 2.7326, 'learning_rate': 2.548805188648753e-07, 'epoch': 13.25}

 83%|████████▎ | 307580/371472 [2:18:42<4:49:26,  3.68it/s]
 83%|████████▎ | 307581/371472 [2:18:42<4:46:20,  3.72it/s]
 83%|████████▎ | 307582/371472 [2:18:42<5:14:27,  3.39it/s]
 83%|████████▎ | 307583/371472 [2:18:43<5:22:47,  3.30it/s]
 83%|████████▎ | 307584/371472 [2:18:43<5:16:00,  3.37it/s]
 83%|████████▎ | 307585/371472 [2:18:43<5:30:02,  3.23it/s]
 83%|████████▎ | 307586/371472 [2:18:44<5:11:43,  3.42it/s]
 83%|████████▎ | 307587/371472 [2:18:44<5:07:01,  3.47it/s]
 83%|████████▎ | 307588/371472 [2:18:44<4:51:08,  3.66it/s]
 83%|████████▎ | 307589/371472 [2:18:44<5:03:00,  3.51it/s]
 83%|████████▎ | 307590/371472 [2:18:45<5:08:52,  3.45it/s]
 83%|████████▎ | 307591/371472 [2:18:45<5:20:49,  3.32it/s]
 83%|████████▎ | 307592/371472 [2:18:45<5:08:51,  3.45it/s]
 83%|████████▎ | 307593/371472 [2:18:46<5:07:41,  3.46it/s]
 83%|████████▎ | 307594/371472 [2:18:46<4:56:00,  3.60it/s]
 83%|████████▎ | 307595/371472 [2:18:46<5:14:53,  3.38it/s]
 83%|████████▎ | 307596/371472 [2:18:46<5:02:45,  3.52it/s]
 83%|████████▎ | 307597/371472 [2:18:47<4:58:19,  3.57it/s]
 83%|████████▎ | 307598/371472 [2:18:47<4:45:48,  3.72it/s]
 83%|████████▎ | 307599/371472 [2:18:47<4:43:11,  3.76it/s]
 83%|████████▎ | 307600/371472 [2:18:47<4:48:16,  3.69it/s]
                                                           
{'loss': 2.7897, 'learning_rate': 2.548320368893965e-07, 'epoch': 13.25}

 83%|████████▎ | 307600/371472 [2:18:47<4:48:16,  3.69it/s]
 83%|████████▎ | 307601/371472 [2:18:48<5:13:18,  3.40it/s]
 83%|████████▎ | 307602/371472 [2:18:48<5:11:37,  3.42it/s]
 83%|████████▎ | 307603/371472 [2:18:48<5:04:28,  3.50it/s]
 83%|████████▎ | 307604/371472 [2:18:49<4:56:55,  3.58it/s]
 83%|████████▎ | 307605/371472 [2:18:49<4:49:13,  3.68it/s]
 83%|████████▎ | 307606/371472 [2:18:49<4:56:54,  3.59it/s]
 83%|████████▎ | 307607/371472 [2:18:49<4:51:27,  3.65it/s]
 83%|████████▎ | 307608/371472 [2:18:50<4:59:55,  3.55it/s]
 83%|████████▎ | 307609/371472 [2:18:50<4:49:21,  3.68it/s]
 83%|████████▎ | 307610/371472 [2:18:50<4:56:10,  3.59it/s]
 83%|████████▎ | 307611/371472 [2:18:51<4:44:05,  3.75it/s]
 83%|████████▎ | 307612/371472 [2:18:51<4:54:38,  3.61it/s]
 83%|████████▎ | 307613/371472 [2:18:51<5:10:03,  3.43it/s]
 83%|████████▎ | 307614/371472 [2:18:51<4:56:49,  3.59it/s]
 83%|████████▎ | 307615/371472 [2:18:52<5:02:16,  3.52it/s]
 83%|████████▎ | 307616/371472 [2:18:52<4:52:27,  3.64it/s]
 83%|████████▎ | 307617/371472 [2:18:52<4:52:59,  3.63it/s]
 83%|████████▎ | 307618/371472 [2:18:53<4:46:49,  3.71it/s]
 83%|████████▎ | 307619/371472 [2:18:53<5:03:49,  3.50it/s]
 83%|████████▎ | 307620/371472 [2:18:53<5:02:03,  3.52it/s]
                                                           
{'loss': 2.8053, 'learning_rate': 2.5478355491391756e-07, 'epoch': 13.25}

 83%|████████▎ | 307620/371472 [2:18:53<5:02:03,  3.52it/s]
 83%|████████▎ | 307621/371472 [2:18:53<4:53:04,  3.63it/s]
 83%|████████▎ | 307622/371472 [2:18:54<4:49:27,  3.68it/s]
 83%|████████▎ | 307623/371472 [2:18:54<4:59:35,  3.55it/s]
 83%|████████▎ | 307624/371472 [2:18:54<4:54:35,  3.61it/s]
 83%|████████▎ | 307625/371472 [2:18:54<4:49:13,  3.68it/s]
 83%|████████▎ | 307626/371472 [2:18:55<4:39:19,  3.81it/s]
 83%|████████▎ | 307627/371472 [2:18:55<4:39:23,  3.81it/s]
 83%|████████▎ | 307628/371472 [2:18:55<4:40:03,  3.80it/s]
 83%|████████▎ | 307629/371472 [2:18:55<4:36:43,  3.85it/s]
 83%|████████▎ | 307630/371472 [2:18:56<4:57:48,  3.57it/s]
 83%|████████▎ | 307631/371472 [2:18:56<4:59:11,  3.56it/s]
 83%|████████▎ | 307632/371472 [2:18:56<5:06:52,  3.47it/s]
 83%|████████▎ | 307633/371472 [2:18:57<4:54:24,  3.61it/s]
 83%|████████▎ | 307634/371472 [2:18:57<5:16:52,  3.36it/s]
 83%|████████▎ | 307635/371472 [2:18:57<5:07:41,  3.46it/s]
 83%|████████▎ | 307636/371472 [2:18:58<5:13:10,  3.40it/s]
 83%|████████▎ | 307637/371472 [2:18:58<5:12:10,  3.41it/s]
 83%|████████▎ | 307638/371472 [2:18:58<5:12:12,  3.41it/s]
 83%|████████▎ | 307639/371472 [2:18:58<4:59:17,  3.55it/s]
 83%|████████▎ | 307640/371472 [2:18:59<4:52:35,  3.64it/s]
                                                           
{'loss': 2.6573, 'learning_rate': 2.547350729384387e-07, 'epoch': 13.25}

 83%|████████▎ | 307640/371472 [2:18:59<4:52:35,  3.64it/s]
 83%|████████▎ | 307641/371472 [2:18:59<5:06:38,  3.47it/s]
 83%|████████▎ | 307642/371472 [2:18:59<4:55:49,  3.60it/s]
 83%|████████▎ | 307643/371472 [2:18:59<4:46:21,  3.72it/s]
 83%|████████▎ | 307644/371472 [2:19:00<4:49:19,  3.68it/s]
 83%|████████▎ | 307645/371472 [2:19:00<4:42:29,  3.77it/s]
 83%|████████▎ | 307646/371472 [2:19:00<4:47:02,  3.71it/s]
 83%|████████▎ | 307647/371472 [2:19:01<4:42:26,  3.77it/s]
 83%|████████▎ | 307648/371472 [2:19:01<5:06:58,  3.47it/s]
 83%|████████▎ | 307649/371472 [2:19:01<4:55:09,  3.60it/s]
 83%|████████▎ | 307650/371472 [2:19:01<4:48:21,  3.69it/s]
 83%|████████▎ | 307651/371472 [2:19:02<5:04:26,  3.49it/s]
 83%|████████▎ | 307652/371472 [2:19:02<5:00:59,  3.53it/s]
 83%|████████▎ | 307653/371472 [2:19:02<4:54:17,  3.61it/s]
 83%|████████▎ | 307654/371472 [2:19:03<4:49:22,  3.68it/s]
 83%|████████▎ | 307655/371472 [2:19:03<4:47:37,  3.70it/s]
 83%|████████▎ | 307656/371472 [2:19:03<5:24:15,  3.28it/s]
 83%|████████▎ | 307657/371472 [2:19:03<5:13:37,  3.39it/s]
 83%|████████▎ | 307658/371472 [2:19:04<5:03:24,  3.51it/s]
 83%|████████▎ | 307659/371472 [2:19:04<4:55:31,  3.60it/s]
 83%|████████▎ | 307660/371472 [2:19:04<4:52:55,  3.63it/s]
                                                           
{'loss': 2.498, 'learning_rate': 2.546865909629597e-07, 'epoch': 13.25}

 83%|████████▎ | 307660/371472 [2:19:04<4:52:55,  3.63it/s]
 83%|████████▎ | 307661/371472 [2:19:04<4:39:49,  3.80it/s]
 83%|████████▎ | 307662/371472 [2:19:05<4:34:42,  3.87it/s]
 83%|████████▎ | 307663/371472 [2:19:05<4:49:36,  3.67it/s]
 83%|████████▎ | 307664/371472 [2:19:05<4:42:47,  3.76it/s]
 83%|████████▎ | 307665/371472 [2:19:06<4:44:52,  3.73it/s]
 83%|████████▎ | 307666/371472 [2:19:06<4:40:23,  3.79it/s]
 83%|████████▎ | 307667/371472 [2:19:06<4:47:20,  3.70it/s]
 83%|████████▎ | 307668/371472 [2:19:06<4:47:00,  3.71it/s]
 83%|████████▎ | 307669/371472 [2:19:07<5:10:46,  3.42it/s]
 83%|████████▎ | 307670/371472 [2:19:07<4:55:41,  3.60it/s]
 83%|████████▎ | 307671/371472 [2:19:07<4:59:43,  3.55it/s]
 83%|████████▎ | 307672/371472 [2:19:08<5:00:06,  3.54it/s]
 83%|████████▎ | 307673/371472 [2:19:08<5:12:17,  3.40it/s]
 83%|████████▎ | 307674/371472 [2:19:08<5:23:16,  3.29it/s]
 83%|████████▎ | 307675/371472 [2:19:09<5:40:36,  3.12it/s]
 83%|████████▎ | 307676/371472 [2:19:09<5:22:50,  3.29it/s]
 83%|████████▎ | 307677/371472 [2:19:09<5:14:40,  3.38it/s]
 83%|████████▎ | 307678/371472 [2:19:09<4:57:29,  3.57it/s]
 83%|████████▎ | 307679/371472 [2:19:10<4:46:00,  3.72it/s]
 83%|████████▎ | 307680/371472 [2:19:10<4:40:02,  3.80it/s]
                                                           
{'loss': 2.572, 'learning_rate': 2.546381089874809e-07, 'epoch': 13.25}

 83%|████████▎ | 307680/371472 [2:19:10<4:40:02,  3.80it/s]
 83%|████████▎ | 307681/371472 [2:19:10<4:37:51,  3.83it/s]
 83%|████████▎ | 307682/371472 [2:19:10<4:43:21,  3.75it/s]
 83%|████████▎ | 307683/371472 [2:19:11<4:55:23,  3.60it/s]
 83%|████████▎ | 307684/371472 [2:19:11<4:46:00,  3.72it/s]
 83%|████████▎ | 307685/371472 [2:19:11<4:48:56,  3.68it/s]
 83%|████████▎ | 307686/371472 [2:19:11<4:42:23,  3.76it/s]
 83%|████████▎ | 307687/371472 [2:19:12<4:43:12,  3.75it/s]
 83%|████████▎ | 307688/371472 [2:19:12<4:55:06,  3.60it/s]
 83%|████████▎ | 307689/371472 [2:19:12<5:32:46,  3.19it/s]
 83%|████████▎ | 307690/371472 [2:19:13<5:42:32,  3.10it/s]
 83%|████████▎ | 307691/371472 [2:19:13<5:36:56,  3.15it/s]
 83%|████████▎ | 307692/371472 [2:19:13<5:36:52,  3.16it/s]
 83%|████████▎ | 307693/371472 [2:19:14<5:17:58,  3.34it/s]
 83%|████████▎ | 307694/371472 [2:19:14<5:36:20,  3.16it/s]
 83%|████████▎ | 307695/371472 [2:19:14<5:13:14,  3.39it/s]
 83%|████████▎ | 307696/371472 [2:19:14<4:56:11,  3.59it/s]
 83%|████████▎ | 307697/371472 [2:19:15<4:59:14,  3.55it/s]
 83%|████████▎ | 307698/371472 [2:19:15<5:07:38,  3.45it/s]
 83%|████████▎ | 307699/371472 [2:19:15<5:04:02,  3.50it/s]
 83%|████████▎ | 307700/371472 [2:19:16<4:48:35,  3.68it/s]
                                                           
{'loss': 2.6217, 'learning_rate': 2.545896270120019e-07, 'epoch': 13.25}

 83%|████████▎ | 307700/371472 [2:19:16<4:48:35,  3.68it/s]
 83%|████████▎ | 307701/371472 [2:19:16<4:42:52,  3.76it/s]
 83%|████████▎ | 307702/371472 [2:19:16<5:02:03,  3.52it/s]
 83%|████████▎ | 307703/371472 [2:19:16<4:51:27,  3.65it/s]
 83%|████████▎ | 307704/371472 [2:19:17<5:17:19,  3.35it/s]
 83%|████████▎ | 307705/371472 [2:19:17<4:58:41,  3.56it/s]
 83%|████████▎ | 307706/371472 [2:19:17<5:25:17,  3.27it/s]
 83%|████████▎ | 307707/371472 [2:19:18<5:23:26,  3.29it/s]
 83%|████████▎ | 307708/371472 [2:19:18<5:06:35,  3.47it/s]
 83%|████████▎ | 307709/371472 [2:19:18<4:58:12,  3.56it/s]
 83%|████████▎ | 307710/371472 [2:19:18<4:48:34,  3.68it/s]
 83%|████████▎ | 307711/371472 [2:19:19<4:49:37,  3.67it/s]
 83%|████████▎ | 307712/371472 [2:19:19<4:52:44,  3.63it/s]
 83%|████████▎ | 307713/371472 [2:19:19<4:54:10,  3.61it/s]
 83%|████████▎ | 307714/371472 [2:19:20<5:02:41,  3.51it/s]
 83%|████████▎ | 307715/371472 [2:19:20<5:04:45,  3.49it/s]
 83%|████████▎ | 307716/371472 [2:19:20<4:50:02,  3.66it/s]
 83%|████████▎ | 307717/371472 [2:19:20<4:52:45,  3.63it/s]
 83%|████████▎ | 307718/371472 [2:19:21<4:44:22,  3.74it/s]
 83%|████████▎ | 307719/371472 [2:19:21<4:38:09,  3.82it/s]
 83%|████████▎ | 307720/371472 [2:19:21<4:34:24,  3.87it/s]
                                                           
{'loss': 2.575, 'learning_rate': 2.5454114503652313e-07, 'epoch': 13.25}

 83%|████████▎ | 307720/371472 [2:19:21<4:34:24,  3.87it/s]
 83%|████████▎ | 307721/371472 [2:19:21<4:33:52,  3.88it/s]
 83%|████████▎ | 307722/371472 [2:19:22<4:35:50,  3.85it/s]
 83%|████████▎ | 307723/371472 [2:19:22<4:36:40,  3.84it/s]
 83%|████████▎ | 307724/371472 [2:19:22<4:33:11,  3.89it/s]
 83%|████████▎ | 307725/371472 [2:19:22<4:36:45,  3.84it/s]
 83%|████████▎ | 307726/371472 [2:19:23<4:43:17,  3.75it/s]
 83%|████████▎ | 307727/371472 [2:19:23<4:54:48,  3.60it/s]
 83%|████████▎ | 307728/371472 [2:19:23<4:46:17,  3.71it/s]
 83%|████████▎ | 307729/371472 [2:19:24<4:54:23,  3.61it/s]
 83%|████████▎ | 307730/371472 [2:19:24<4:47:23,  3.70it/s]
 83%|████████▎ | 307731/371472 [2:19:24<4:40:36,  3.79it/s]
 83%|████████▎ | 307732/371472 [2:19:24<4:39:40,  3.80it/s]
 83%|████████▎ | 307733/371472 [2:19:25<4:45:15,  3.72it/s]
 83%|████████▎ | 307734/371472 [2:19:25<4:50:56,  3.65it/s]
 83%|████████▎ | 307735/371472 [2:19:25<4:51:44,  3.64it/s]
 83%|████████▎ | 307736/371472 [2:19:25<4:42:02,  3.77it/s]
 83%|████████▎ | 307737/371472 [2:19:26<4:38:02,  3.82it/s]
 83%|████████▎ | 307738/371472 [2:19:26<4:50:58,  3.65it/s]
 83%|████████▎ | 307739/371472 [2:19:26<4:55:40,  3.59it/s]
 83%|████████▎ | 307740/371472 [2:19:27<4:55:44,  3.59it/s]
                                                           
{'loss': 2.7143, 'learning_rate': 2.544926630610442e-07, 'epoch': 13.25}

 83%|████████▎ | 307740/371472 [2:19:27<4:55:44,  3.59it/s]
 83%|████████▎ | 307741/371472 [2:19:27<4:47:29,  3.69it/s]
 83%|████████▎ | 307742/371472 [2:19:27<5:08:59,  3.44it/s]
 83%|████████▎ | 307743/371472 [2:19:27<5:01:42,  3.52it/s]
 83%|████████▎ | 307744/371472 [2:19:28<5:06:24,  3.47it/s]
 83%|████████▎ | 307745/371472 [2:19:28<5:02:59,  3.51it/s]
 83%|████████▎ | 307746/371472 [2:19:28<4:53:47,  3.62it/s]
 83%|████████▎ | 307747/371472 [2:19:29<5:03:25,  3.50it/s]
 83%|████████▎ | 307748/371472 [2:19:29<5:03:07,  3.50it/s]
 83%|████████▎ | 307749/371472 [2:19:29<4:57:37,  3.57it/s]
 83%|████████▎ | 307750/371472 [2:19:29<4:53:18,  3.62it/s]
 83%|████████▎ | 307751/371472 [2:19:30<5:05:57,  3.47it/s]
 83%|████████▎ | 307752/371472 [2:19:30<5:14:39,  3.38it/s]
 83%|████████▎ | 307753/371472 [2:19:30<5:02:54,  3.51it/s]
 83%|████████▎ | 307754/371472 [2:19:30<4:46:42,  3.70it/s]
 83%|████████▎ | 307755/371472 [2:19:31<4:37:32,  3.83it/s]
 83%|████████▎ | 307756/371472 [2:19:31<4:39:28,  3.80it/s]
 83%|████████▎ | 307757/371472 [2:19:31<4:49:35,  3.67it/s]
 83%|████████▎ | 307758/371472 [2:19:32<4:53:32,  3.62it/s]
 83%|████████▎ | 307759/371472 [2:19:32<4:44:11,  3.74it/s]
 83%|████████▎ | 307760/371472 [2:19:32<4:40:09,  3.79it/s]
                                                           
{'loss': 2.6312, 'learning_rate': 2.5444418108556533e-07, 'epoch': 13.26}

 83%|████████▎ | 307760/371472 [2:19:32<4:40:09,  3.79it/s]
 83%|████████▎ | 307761/371472 [2:19:32<4:53:38,  3.62it/s]
 83%|████████▎ | 307762/371472 [2:19:33<4:47:28,  3.69it/s]
 83%|████████▎ | 307763/371472 [2:19:33<4:49:43,  3.67it/s]
 83%|████████▎ | 307764/371472 [2:19:33<4:45:32,  3.72it/s]
 83%|████████▎ | 307765/371472 [2:19:33<4:41:07,  3.78it/s]
 83%|████████▎ | 307766/371472 [2:19:34<4:52:00,  3.64it/s]
 83%|████████▎ | 307767/371472 [2:19:34<4:47:36,  3.69it/s]
 83%|████████▎ | 307768/371472 [2:19:34<4:40:29,  3.79it/s]
 83%|████████▎ | 307769/371472 [2:19:34<4:42:47,  3.75it/s]
 83%|████████▎ | 307770/371472 [2:19:35<4:49:34,  3.67it/s]
 83%|████████▎ | 307771/371472 [2:19:35<5:03:50,  3.49it/s]
 83%|████████▎ | 307772/371472 [2:19:35<5:07:33,  3.45it/s]
 83%|████████▎ | 307773/371472 [2:19:36<4:59:12,  3.55it/s]
 83%|████████▎ | 307774/371472 [2:19:36<5:05:15,  3.48it/s]
 83%|████████▎ | 307775/371472 [2:19:36<5:07:27,  3.45it/s]
 83%|████████▎ | 307776/371472 [2:19:37<5:02:10,  3.51it/s]
 83%|████████▎ | 307777/371472 [2:19:37<4:55:26,  3.59it/s]
 83%|████████▎ | 307778/371472 [2:19:37<4:47:20,  3.69it/s]
 83%|████████▎ | 307779/371472 [2:19:37<4:43:45,  3.74it/s]
 83%|████████▎ | 307780/371472 [2:19:38<4:43:26,  3.75it/s]
                                                           
{'loss': 2.5298, 'learning_rate': 2.543956991100864e-07, 'epoch': 13.26}

 83%|████████▎ | 307780/371472 [2:19:38<4:43:26,  3.75it/s]
 83%|████████▎ | 307781/371472 [2:19:38<4:39:11,  3.80it/s]
 83%|████████▎ | 307782/371472 [2:19:38<4:53:07,  3.62it/s]
 83%|████████▎ | 307783/371472 [2:19:38<4:51:52,  3.64it/s]
 83%|████████▎ | 307784/371472 [2:19:39<4:52:33,  3.63it/s]
 83%|████████▎ | 307785/371472 [2:19:39<4:43:04,  3.75it/s]
 83%|████████▎ | 307786/371472 [2:19:39<4:48:57,  3.67it/s]
 83%|████████▎ | 307787/371472 [2:19:39<4:44:50,  3.73it/s]
 83%|████████▎ | 307788/371472 [2:19:40<4:54:26,  3.60it/s]
 83%|████████▎ | 307789/371472 [2:19:40<5:00:21,  3.53it/s]
 83%|████████▎ | 307790/371472 [2:19:40<5:04:10,  3.49it/s]
 83%|████████▎ | 307791/371472 [2:19:41<5:09:58,  3.42it/s]
 83%|████████▎ | 307792/371472 [2:19:41<5:11:09,  3.41it/s]
 83%|████████▎ | 307793/371472 [2:19:41<5:11:40,  3.41it/s]
 83%|████████▎ | 307794/371472 [2:19:42<5:17:56,  3.34it/s]
 83%|████████▎ | 307795/371472 [2:19:42<5:08:56,  3.44it/s]
 83%|████████▎ | 307796/371472 [2:19:42<5:24:27,  3.27it/s]
 83%|████████▎ | 307797/371472 [2:19:42<5:09:18,  3.43it/s]
 83%|████████▎ | 307798/371472 [2:19:43<5:11:42,  3.40it/s]
 83%|████████▎ | 307799/371472 [2:19:43<5:02:19,  3.51it/s]
 83%|████████▎ | 307800/371472 [2:19:43<4:53:29,  3.62it/s]
                                                           
{'loss': 2.6041, 'learning_rate': 2.543472171346074e-07, 'epoch': 13.26}

 83%|████████▎ | 307800/371472 [2:19:43<4:53:29,  3.62it/s]
 83%|████████▎ | 307801/371472 [2:19:44<4:44:25,  3.73it/s]
 83%|████████▎ | 307802/371472 [2:19:44<4:45:54,  3.71it/s]
 83%|████████▎ | 307803/371472 [2:19:44<4:41:01,  3.78it/s]
 83%|████████▎ | 307804/371472 [2:19:44<4:35:44,  3.85it/s]
 83%|████████▎ | 307805/371472 [2:19:45<4:36:08,  3.84it/s]
 83%|████████▎ | 307806/371472 [2:19:45<4:26:52,  3.98it/s]
 83%|████████▎ | 307807/371472 [2:19:45<4:28:21,  3.95it/s]
 83%|████████▎ | 307808/371472 [2:19:45<4:40:57,  3.78it/s]
 83%|████████▎ | 307809/371472 [2:19:46<4:48:37,  3.68it/s]
 83%|████████▎ | 307810/371472 [2:19:46<4:59:08,  3.55it/s]
 83%|████████▎ | 307811/371472 [2:19:46<5:01:19,  3.52it/s]
 83%|████████▎ | 307812/371472 [2:19:46<5:00:11,  3.53it/s]
 83%|████████▎ | 307813/371472 [2:19:47<4:50:33,  3.65it/s]
 83%|████████▎ | 307814/371472 [2:19:47<4:48:58,  3.67it/s]
 83%|████████▎ | 307815/371472 [2:19:47<4:59:02,  3.55it/s]
 83%|████████▎ | 307816/371472 [2:19:48<4:51:28,  3.64it/s]
 83%|████████▎ | 307817/371472 [2:19:48<5:00:20,  3.53it/s]
 83%|████████▎ | 307818/371472 [2:19:48<4:52:05,  3.63it/s]
 83%|████████▎ | 307819/371472 [2:19:48<5:13:14,  3.39it/s]
 83%|████████▎ | 307820/371472 [2:19:49<5:05:49,  3.47it/s]
                                                           
{'loss': 2.5693, 'learning_rate': 2.542987351591286e-07, 'epoch': 13.26}

 83%|████████▎ | 307820/371472 [2:19:49<5:05:49,  3.47it/s]
 83%|████████▎ | 307821/371472 [2:19:49<5:24:18,  3.27it/s]
 83%|████████▎ | 307822/371472 [2:19:49<5:14:37,  3.37it/s]
 83%|████████▎ | 307823/371472 [2:19:50<5:07:24,  3.45it/s]
 83%|████████▎ | 307824/371472 [2:19:50<4:57:48,  3.56it/s]
 83%|████████▎ | 307825/371472 [2:19:50<5:30:45,  3.21it/s]
 83%|████████▎ | 307826/371472 [2:19:51<5:22:27,  3.29it/s]
 83%|████████▎ | 307827/371472 [2:19:51<5:12:17,  3.40it/s]
 83%|████████▎ | 307828/371472 [2:19:51<5:44:48,  3.08it/s]
 83%|████████▎ | 307829/371472 [2:19:51<5:21:46,  3.30it/s]
 83%|████████▎ | 307830/371472 [2:19:52<5:06:53,  3.46it/s]
 83%|████████▎ | 307831/371472 [2:19:52<5:02:38,  3.50it/s]
 83%|████████▎ | 307832/371472 [2:19:52<4:54:16,  3.60it/s]
 83%|████████▎ | 307833/371472 [2:19:53<4:41:37,  3.77it/s]
 83%|████████▎ | 307834/371472 [2:19:53<4:47:52,  3.68it/s]
 83%|████████▎ | 307835/371472 [2:19:53<4:59:17,  3.54it/s]
 83%|████████▎ | 307836/371472 [2:19:53<4:52:56,  3.62it/s]
 83%|████████▎ | 307837/371472 [2:19:54<4:52:51,  3.62it/s]
 83%|████████▎ | 307838/371472 [2:19:54<4:57:31,  3.56it/s]
 83%|████████▎ | 307839/371472 [2:19:54<4:45:00,  3.72it/s]
 83%|████████▎ | 307840/371472 [2:19:54<4:43:19,  3.74it/s]
                                                           
{'loss': 2.6481, 'learning_rate': 2.5425025318364967e-07, 'epoch': 13.26}

 83%|████████▎ | 307840/371472 [2:19:54<4:43:19,  3.74it/s]
 83%|████████▎ | 307841/371472 [2:19:55<4:44:01,  3.73it/s]
 83%|████████▎ | 307842/371472 [2:19:55<4:45:03,  3.72it/s]
 83%|████████▎ | 307843/371472 [2:19:55<4:41:32,  3.77it/s]
 83%|████████▎ | 307844/371472 [2:19:56<5:26:55,  3.24it/s]
 83%|████████▎ | 307845/371472 [2:19:56<5:23:13,  3.28it/s]
 83%|████████▎ | 307846/371472 [2:19:56<5:22:08,  3.29it/s]
 83%|████████▎ | 307847/371472 [2:19:57<5:21:04,  3.30it/s]
 83%|████████▎ | 307848/371472 [2:19:57<5:45:14,  3.07it/s]
 83%|████████▎ | 307849/371472 [2:19:57<5:49:09,  3.04it/s]
 83%|████████▎ | 307850/371472 [2:19:58<5:27:56,  3.23it/s]
 83%|████████▎ | 307851/371472 [2:19:58<5:18:17,  3.33it/s]
 83%|████████▎ | 307852/371472 [2:19:58<5:05:43,  3.47it/s]
 83%|████████▎ | 307853/371472 [2:19:58<5:03:45,  3.49it/s]
 83%|████████▎ | 307854/371472 [2:19:59<5:01:19,  3.52it/s]
 83%|████████▎ | 307855/371472 [2:19:59<4:50:32,  3.65it/s]
 83%|████████▎ | 307856/371472 [2:19:59<4:42:49,  3.75it/s]
 83%|████████▎ | 307857/371472 [2:19:59<4:55:53,  3.58it/s]
 83%|████████▎ | 307858/371472 [2:20:00<4:59:22,  3.54it/s]
 83%|████████▎ | 307859/371472 [2:20:00<4:48:57,  3.67it/s]
 83%|████████▎ | 307860/371472 [2:20:00<4:43:51,  3.73it/s]
                                                           
{'loss': 2.5942, 'learning_rate': 2.5420177120817085e-07, 'epoch': 13.26}

 83%|████████▎ | 307860/371472 [2:20:00<4:43:51,  3.73it/s]
 83%|████████▎ | 307861/371472 [2:20:01<4:56:40,  3.57it/s]
 83%|████████▎ | 307862/371472 [2:20:01<4:55:05,  3.59it/s]
 83%|████████▎ | 307863/371472 [2:20:01<4:43:00,  3.75it/s]
 83%|████████▎ | 307864/371472 [2:20:01<4:50:41,  3.65it/s]
 83%|████████▎ | 307865/371472 [2:20:02<4:44:41,  3.72it/s]
 83%|████████▎ | 307866/371472 [2:20:02<4:54:28,  3.60it/s]
 83%|████████▎ | 307867/371472 [2:20:02<5:14:12,  3.37it/s]
 83%|████████▎ | 307868/371472 [2:20:03<5:32:22,  3.19it/s]
 83%|████████▎ | 307869/371472 [2:20:03<5:22:03,  3.29it/s]
 83%|████████▎ | 307870/371472 [2:20:03<5:05:37,  3.47it/s]
 83%|████████▎ | 307871/371472 [2:20:03<4:51:28,  3.64it/s]
 83%|████████▎ | 307872/371472 [2:20:04<4:50:25,  3.65it/s]
 83%|████████▎ | 307873/371472 [2:20:04<5:05:47,  3.47it/s]
 83%|████████▎ | 307874/371472 [2:20:04<5:04:25,  3.48it/s]
 83%|████████▎ | 307875/371472 [2:20:04<4:50:45,  3.65it/s]
 83%|████████▎ | 307876/371472 [2:20:05<4:46:59,  3.69it/s]
 83%|████████▎ | 307877/371472 [2:20:05<4:43:14,  3.74it/s]
 83%|████████▎ | 307878/371472 [2:20:05<4:40:41,  3.78it/s]
 83%|████████▎ | 307879/371472 [2:20:06<4:40:42,  3.78it/s]
 83%|████████▎ | 307880/371472 [2:20:06<4:57:50,  3.56it/s]
                                                           
{'loss': 2.5565, 'learning_rate': 2.541532892326919e-07, 'epoch': 13.26}

 83%|████████▎ | 307880/371472 [2:20:06<4:57:50,  3.56it/s]
 83%|████████▎ | 307881/371472 [2:20:06<5:12:17,  3.39it/s]
 83%|████████▎ | 307882/371472 [2:20:06<5:16:25,  3.35it/s]
 83%|████████▎ | 307883/371472 [2:20:07<5:15:10,  3.36it/s]
 83%|████████▎ | 307884/371472 [2:20:07<5:09:29,  3.42it/s]
 83%|████████▎ | 307885/371472 [2:20:07<5:23:19,  3.28it/s]
 83%|████████▎ | 307886/371472 [2:20:08<5:15:02,  3.36it/s]
 83%|████████▎ | 307887/371472 [2:20:08<5:50:32,  3.02it/s]
 83%|████████▎ | 307888/371472 [2:20:08<5:22:29,  3.29it/s]
 83%|████████▎ | 307889/371472 [2:20:09<5:22:18,  3.29it/s]
 83%|████████▎ | 307890/371472 [2:20:09<5:18:14,  3.33it/s]
 83%|████████▎ | 307891/371472 [2:20:09<5:19:01,  3.32it/s]
 83%|████████▎ | 307892/371472 [2:20:09<5:00:55,  3.52it/s]
 83%|████████▎ | 307893/371472 [2:20:10<4:46:49,  3.69it/s]
 83%|████████▎ | 307894/371472 [2:20:10<4:52:46,  3.62it/s]
 83%|████████▎ | 307895/371472 [2:20:10<4:50:37,  3.65it/s]
 83%|████████▎ | 307896/371472 [2:20:11<4:45:05,  3.72it/s]
 83%|████████▎ | 307897/371472 [2:20:11<4:37:16,  3.82it/s]
 83%|████████▎ | 307898/371472 [2:20:11<4:35:32,  3.85it/s]
 83%|████████▎ | 307899/371472 [2:20:11<4:29:32,  3.93it/s]
 83%|████████▎ | 307900/371472 [2:20:12<4:32:51,  3.88it/s]
                                                           
{'loss': 2.5537, 'learning_rate': 2.5410480725721304e-07, 'epoch': 13.26}

 83%|████████▎ | 307900/371472 [2:20:12<4:32:51,  3.88it/s]
 83%|████████▎ | 307901/371472 [2:20:12<4:34:07,  3.87it/s]
 83%|████████▎ | 307902/371472 [2:20:12<4:29:15,  3.93it/s]
 83%|████████▎ | 307903/371472 [2:20:12<4:36:26,  3.83it/s]
 83%|████████▎ | 307904/371472 [2:20:13<4:40:02,  3.78it/s]
 83%|████████▎ | 307905/371472 [2:20:13<4:34:19,  3.86it/s]
 83%|████████▎ | 307906/371472 [2:20:13<4:44:04,  3.73it/s]
 83%|████████▎ | 307907/371472 [2:20:13<5:09:42,  3.42it/s]
 83%|████████▎ | 307908/371472 [2:20:14<5:00:26,  3.53it/s]
 83%|████████▎ | 307909/371472 [2:20:14<4:53:46,  3.61it/s]
 83%|████████▎ | 307910/371472 [2:20:14<4:42:41,  3.75it/s]
 83%|████████▎ | 307911/371472 [2:20:15<4:42:21,  3.75it/s]
 83%|████████▎ | 307912/371472 [2:20:15<4:38:34,  3.80it/s]
 83%|████████▎ | 307913/371472 [2:20:15<4:36:00,  3.84it/s]
 83%|████████▎ | 307914/371472 [2:20:15<4:34:11,  3.86it/s]
 83%|████████▎ | 307915/371472 [2:20:16<4:32:29,  3.89it/s]
 83%|████████▎ | 307916/371472 [2:20:16<4:42:39,  3.75it/s]
 83%|████████▎ | 307917/371472 [2:20:16<4:51:31,  3.63it/s]
 83%|████████▎ | 307918/371472 [2:20:16<5:00:28,  3.53it/s]
 83%|████████▎ | 307919/371472 [2:20:17<4:55:05,  3.59it/s]
 83%|████████▎ | 307920/371472 [2:20:17<4:55:04,  3.59it/s]
                                                           
{'loss': 2.6801, 'learning_rate': 2.5405632528173406e-07, 'epoch': 13.26}

 83%|████████▎ | 307920/371472 [2:20:17<4:55:04,  3.59it/s]
 83%|████████▎ | 307921/371472 [2:20:17<4:56:53,  3.57it/s]
 83%|████████▎ | 307922/371472 [2:20:18<5:07:11,  3.45it/s]
 83%|████████▎ | 307923/371472 [2:20:18<4:51:47,  3.63it/s]
 83%|████████▎ | 307924/371472 [2:20:18<4:43:15,  3.74it/s]
 83%|████████▎ | 307925/371472 [2:20:18<5:04:13,  3.48it/s]
 83%|████████▎ | 307926/371472 [2:20:19<4:48:39,  3.67it/s]
 83%|████████▎ | 307927/371472 [2:20:19<5:09:11,  3.43it/s]
 83%|████████▎ | 307928/371472 [2:20:19<4:52:42,  3.62it/s]
 83%|████████▎ | 307929/371472 [2:20:19<4:45:23,  3.71it/s]
 83%|████████▎ | 307930/371472 [2:20:20<4:51:17,  3.64it/s]
 83%|████████▎ | 307931/371472 [2:20:20<5:05:10,  3.47it/s]
 83%|████████▎ | 307932/371472 [2:20:20<4:54:06,  3.60it/s]
 83%|████████▎ | 307933/371472 [2:20:21<5:02:33,  3.50it/s]
 83%|████████▎ | 307934/371472 [2:20:21<4:52:43,  3.62it/s]
 83%|████████▎ | 307935/371472 [2:20:21<4:43:06,  3.74it/s]
 83%|████████▎ | 307936/371472 [2:20:21<4:40:24,  3.78it/s]
 83%|████████▎ | 307937/371472 [2:20:22<4:47:56,  3.68it/s]
 83%|████████▎ | 307938/371472 [2:20:22<4:48:56,  3.66it/s]
 83%|████████▎ | 307939/371472 [2:20:22<4:50:40,  3.64it/s]
 83%|████████▎ | 307940/371472 [2:20:22<4:51:40,  3.63it/s]
                                                           
{'loss': 2.72, 'learning_rate': 2.5400784330625524e-07, 'epoch': 13.26}

 83%|████████▎ | 307940/371472 [2:20:23<4:51:40,  3.63it/s]
 83%|████████▎ | 307941/371472 [2:20:23<5:07:46,  3.44it/s]
 83%|████████▎ | 307942/371472 [2:20:23<5:03:23,  3.49it/s]
 83%|████████▎ | 307943/371472 [2:20:23<4:54:20,  3.60it/s]
 83%|████████▎ | 307944/371472 [2:20:24<4:47:11,  3.69it/s]
 83%|████████▎ | 307945/371472 [2:20:24<4:58:46,  3.54it/s]
 83%|████████▎ | 307946/371472 [2:20:24<4:58:52,  3.54it/s]
 83%|████████▎ | 307947/371472 [2:20:24<4:50:58,  3.64it/s]
 83%|████████▎ | 307948/371472 [2:20:25<4:47:24,  3.68it/s]
 83%|████████▎ | 307949/371472 [2:20:25<5:21:34,  3.29it/s]
 83%|████████▎ | 307950/371472 [2:20:25<5:24:07,  3.27it/s]
 83%|████████▎ | 307951/371472 [2:20:26<5:34:06,  3.17it/s]
 83%|████████▎ | 307952/371472 [2:20:26<5:25:44,  3.25it/s]
 83%|████████▎ | 307953/371472 [2:20:26<5:27:49,  3.23it/s]
 83%|████████▎ | 307954/371472 [2:20:27<5:05:45,  3.46it/s]
 83%|████████▎ | 307955/371472 [2:20:27<4:47:03,  3.69it/s]
 83%|████████▎ | 307956/371472 [2:20:27<5:10:50,  3.41it/s]
 83%|████████▎ | 307957/371472 [2:20:27<5:06:39,  3.45it/s]
 83%|████████▎ | 307958/371472 [2:20:28<5:08:22,  3.43it/s]
 83%|████████▎ | 307959/371472 [2:20:28<5:01:58,  3.51it/s]
 83%|████████▎ | 307960/371472 [2:20:28<5:25:16,  3.25it/s]
                                                           
{'loss': 2.4685, 'learning_rate': 2.539593613307763e-07, 'epoch': 13.26}

 83%|████████▎ | 307960/371472 [2:20:28<5:25:16,  3.25it/s]
 83%|████████▎ | 307961/371472 [2:20:29<5:13:39,  3.37it/s]
 83%|████████▎ | 307962/371472 [2:20:29<5:11:07,  3.40it/s]
 83%|████████▎ | 307963/371472 [2:20:29<4:57:10,  3.56it/s]
 83%|████████▎ | 307964/371472 [2:20:30<5:25:40,  3.25it/s]
 83%|████████▎ | 307965/371472 [2:20:30<5:12:17,  3.39it/s]
 83%|████████▎ | 307966/371472 [2:20:30<5:08:35,  3.43it/s]
 83%|████████▎ | 307967/371472 [2:20:30<5:03:31,  3.49it/s]
 83%|████████▎ | 307968/371472 [2:20:31<4:59:34,  3.53it/s]
 83%|████████▎ | 307969/371472 [2:20:31<4:43:15,  3.74it/s]
 83%|████████▎ | 307970/371472 [2:20:31<4:43:32,  3.73it/s]
 83%|████████▎ | 307971/371472 [2:20:32<5:10:49,  3.40it/s]
 83%|████████▎ | 307972/371472 [2:20:32<4:58:47,  3.54it/s]
 83%|████████▎ | 307973/371472 [2:20:32<4:48:15,  3.67it/s]
 83%|████████▎ | 307974/371472 [2:20:32<4:45:09,  3.71it/s]
 83%|████████▎ | 307975/371472 [2:20:33<5:03:05,  3.49it/s]
 83%|████████▎ | 307976/371472 [2:20:33<5:01:42,  3.51it/s]
 83%|████████▎ | 307977/371472 [2:20:33<5:01:39,  3.51it/s]
 83%|████████▎ | 307978/371472 [2:20:33<4:46:57,  3.69it/s]
 83%|████████▎ | 307979/371472 [2:20:34<4:38:08,  3.80it/s]
 83%|████████▎ | 307980/371472 [2:20:34<4:34:26,  3.86it/s]
                                                           
{'loss': 2.7236, 'learning_rate': 2.539108793552975e-07, 'epoch': 13.27}

 83%|████████▎ | 307980/371472 [2:20:34<4:34:26,  3.86it/s]
 83%|████████▎ | 307981/371472 [2:20:34<4:31:51,  3.89it/s]
 83%|████████▎ | 307982/371472 [2:20:34<4:28:17,  3.94it/s]
 83%|████████▎ | 307983/371472 [2:20:35<4:36:52,  3.82it/s]
 83%|████████▎ | 307984/371472 [2:20:35<5:02:19,  3.50it/s]
 83%|████████▎ | 307985/371472 [2:20:35<4:57:09,  3.56it/s]
 83%|████████▎ | 307986/371472 [2:20:36<4:51:56,  3.62it/s]
 83%|████████▎ | 307987/371472 [2:20:36<4:47:24,  3.68it/s]
 83%|████████▎ | 307988/371472 [2:20:36<4:47:18,  3.68it/s]
 83%|████████▎ | 307989/371472 [2:20:36<5:07:17,  3.44it/s]
 83%|████████▎ | 307990/371472 [2:20:37<5:00:26,  3.52it/s]
 83%|████████▎ | 307991/371472 [2:20:37<4:59:10,  3.54it/s]
 83%|████████▎ | 307992/371472 [2:20:37<5:02:23,  3.50it/s]
 83%|████████▎ | 307993/371472 [2:20:38<5:11:26,  3.40it/s]
 83%|████████▎ | 307994/371472 [2:20:38<5:10:12,  3.41it/s]
 83%|████████▎ | 307995/371472 [2:20:38<5:04:22,  3.48it/s]
 83%|████████▎ | 307996/371472 [2:20:38<5:16:08,  3.35it/s]
 83%|████████▎ | 307997/371472 [2:20:39<5:11:36,  3.39it/s]
 83%|████████▎ | 307998/371472 [2:20:39<5:16:04,  3.35it/s]
 83%|████████▎ | 307999/371472 [2:20:39<5:06:00,  3.46it/s]
 83%|████████▎ | 308000/371472 [2:20:40<4:57:38,  3.55it/s]
                                                           
{'loss': 2.6655, 'learning_rate': 2.5386239737981856e-07, 'epoch': 13.27}

 83%|████████▎ | 308000/371472 [2:20:40<4:57:38,  3.55it/s]
 83%|████████▎ | 308001/371472 [2:20:40<5:15:07,  3.36it/s]
 83%|████████▎ | 308002/371472 [2:20:40<5:07:07,  3.44it/s]
 83%|████████▎ | 308003/371472 [2:20:40<4:55:27,  3.58it/s]
 83%|████████▎ | 308004/371472 [2:20:41<5:01:36,  3.51it/s]
 83%|████████▎ | 308005/371472 [2:20:41<5:08:31,  3.43it/s]
 83%|████████▎ | 308006/371472 [2:20:41<5:05:57,  3.46it/s]
 83%|████████▎ | 308007/371472 [2:20:42<4:53:49,  3.60it/s]
 83%|████████▎ | 308008/371472 [2:20:42<4:55:25,  3.58it/s]
 83%|████████▎ | 308009/371472 [2:20:42<6:17:15,  2.80it/s]
 83%|████████▎ | 308010/371472 [2:20:43<5:46:22,  3.05it/s]
 83%|████████▎ | 308011/371472 [2:20:43<5:23:33,  3.27it/s]
 83%|████████▎ | 308012/371472 [2:20:43<5:12:43,  3.38it/s]
 83%|████████▎ | 308013/371472 [2:20:43<5:00:39,  3.52it/s]
 83%|████████▎ | 308014/371472 [2:20:44<4:55:19,  3.58it/s]
 83%|████████▎ | 308015/371472 [2:20:44<5:07:33,  3.44it/s]
 83%|████████▎ | 308016/371472 [2:20:44<4:57:29,  3.55it/s]
 83%|████████▎ | 308017/371472 [2:20:45<4:43:06,  3.74it/s]
 83%|████████▎ | 308018/371472 [2:20:45<4:35:05,  3.84it/s]
 83%|████████▎ | 308019/371472 [2:20:45<4:38:19,  3.80it/s]
 83%|████████▎ | 308020/371472 [2:20:45<4:58:28,  3.54it/s]
                                                           
{'loss': 2.6397, 'learning_rate': 2.538139154043397e-07, 'epoch': 13.27}

 83%|████████▎ | 308020/371472 [2:20:45<4:58:28,  3.54it/s]
 83%|████████▎ | 308021/371472 [2:20:46<4:52:02,  3.62it/s]
 83%|████████▎ | 308022/371472 [2:20:46<4:43:41,  3.73it/s]
 83%|████████▎ | 308023/371472 [2:20:46<4:53:34,  3.60it/s]
 83%|████████▎ | 308024/371472 [2:20:46<4:55:57,  3.57it/s]
 83%|████████▎ | 308025/371472 [2:20:47<5:01:48,  3.50it/s]
 83%|████████▎ | 308026/371472 [2:20:47<5:06:17,  3.45it/s]
 83%|████████▎ | 308027/371472 [2:20:47<5:08:12,  3.43it/s]
 83%|████████▎ | 308028/371472 [2:20:48<5:03:40,  3.48it/s]
 83%|████████▎ | 308029/371472 [2:20:48<5:08:37,  3.43it/s]
 83%|████████▎ | 308030/371472 [2:20:48<5:22:08,  3.28it/s]
 83%|████████▎ | 308031/371472 [2:20:49<5:22:35,  3.28it/s]
 83%|████████▎ | 308032/371472 [2:20:49<5:01:52,  3.50it/s]
 83%|████████▎ | 308033/371472 [2:20:49<5:00:27,  3.52it/s]
 83%|████████▎ | 308034/371472 [2:20:49<4:59:42,  3.53it/s]
 83%|████████▎ | 308035/371472 [2:20:50<5:16:53,  3.34it/s]
 83%|████████▎ | 308036/371472 [2:20:50<5:21:59,  3.28it/s]
 83%|████████▎ | 308037/371472 [2:20:50<5:00:09,  3.52it/s]
 83%|████████▎ | 308038/371472 [2:20:51<4:51:40,  3.62it/s]
 83%|████████▎ | 308039/371472 [2:20:51<4:45:16,  3.71it/s]
 83%|████████▎ | 308040/371472 [2:20:51<4:49:46,  3.65it/s]
                                                           
{'loss': 2.6042, 'learning_rate': 2.5376543342886075e-07, 'epoch': 13.27}

 83%|████████▎ | 308040/371472 [2:20:51<4:49:46,  3.65it/s]
 83%|████████▎ | 308041/371472 [2:20:51<4:45:32,  3.70it/s]
 83%|████████▎ | 308042/371472 [2:20:52<4:50:30,  3.64it/s]
 83%|████████▎ | 308043/371472 [2:20:52<5:21:12,  3.29it/s]
 83%|████████▎ | 308044/371472 [2:20:52<5:14:53,  3.36it/s]
 83%|████████▎ | 308045/371472 [2:20:53<5:12:24,  3.38it/s]
 83%|████████▎ | 308046/371472 [2:20:53<5:01:52,  3.50it/s]
 83%|████████▎ | 308047/371472 [2:20:53<4:53:03,  3.61it/s]
 83%|████████▎ | 308048/371472 [2:20:53<5:18:36,  3.32it/s]
 83%|████████▎ | 308049/371472 [2:20:54<5:08:36,  3.43it/s]
 83%|████████▎ | 308050/371472 [2:20:54<4:59:11,  3.53it/s]
 83%|████████▎ | 308051/371472 [2:20:54<5:00:00,  3.52it/s]
 83%|████████▎ | 308052/371472 [2:20:55<4:58:39,  3.54it/s]
 83%|████████▎ | 308053/371472 [2:20:55<4:55:00,  3.58it/s]
 83%|████████▎ | 308054/371472 [2:20:55<4:43:42,  3.73it/s]
 83%|████████▎ | 308055/371472 [2:20:55<4:43:15,  3.73it/s]
 83%|████████▎ | 308056/371472 [2:20:56<4:50:25,  3.64it/s]
 83%|████████▎ | 308057/371472 [2:20:56<4:43:34,  3.73it/s]
 83%|████████▎ | 308058/371472 [2:20:56<5:24:43,  3.25it/s]
 83%|████████▎ | 308059/371472 [2:20:57<5:16:14,  3.34it/s]
 83%|████████▎ | 308060/371472 [2:20:57<5:39:29,  3.11it/s]
                                                           
{'loss': 2.7883, 'learning_rate': 2.537169514533819e-07, 'epoch': 13.27}

 83%|████████▎ | 308060/371472 [2:20:57<5:39:29,  3.11it/s]
 83%|████████▎ | 308061/371472 [2:20:57<5:16:24,  3.34it/s]
 83%|████████▎ | 308062/371472 [2:20:57<4:58:31,  3.54it/s]
 83%|████████▎ | 308063/371472 [2:20:58<4:56:52,  3.56it/s]
 83%|████████▎ | 308064/371472 [2:20:58<4:48:09,  3.67it/s]
 83%|████████▎ | 308065/371472 [2:20:58<4:44:20,  3.72it/s]
 83%|████████▎ | 308066/371472 [2:20:58<4:48:10,  3.67it/s]
 83%|████████▎ | 308067/371472 [2:20:59<4:58:54,  3.54it/s]
 83%|████████▎ | 308068/371472 [2:20:59<5:07:34,  3.44it/s]
 83%|████████▎ | 308069/371472 [2:20:59<4:57:53,  3.55it/s]
 83%|████████▎ | 308070/371472 [2:21:00<5:07:37,  3.44it/s]
 83%|████████▎ | 308071/371472 [2:21:00<5:08:25,  3.43it/s]
 83%|████████▎ | 308072/371472 [2:21:00<5:23:32,  3.27it/s]
 83%|████████▎ | 308073/371472 [2:21:01<5:15:50,  3.35it/s]
 83%|████████▎ | 308074/371472 [2:21:01<5:26:17,  3.24it/s]
 83%|████████▎ | 308075/371472 [2:21:01<5:08:56,  3.42it/s]
 83%|████████▎ | 308076/371472 [2:21:01<5:14:00,  3.36it/s]
 83%|████████▎ | 308077/371472 [2:21:02<4:56:59,  3.56it/s]
 83%|████████▎ | 308078/371472 [2:21:02<4:54:41,  3.59it/s]
 83%|████████▎ | 308079/371472 [2:21:02<4:48:54,  3.66it/s]
 83%|████████▎ | 308080/371472 [2:21:03<4:57:39,  3.55it/s]
                                                           
{'loss': 2.6145, 'learning_rate': 2.5366846947790295e-07, 'epoch': 13.27}

 83%|████████▎ | 308080/371472 [2:21:03<4:57:39,  3.55it/s]
 83%|████████▎ | 308081/371472 [2:21:03<4:46:59,  3.68it/s]
 83%|████████▎ | 308082/371472 [2:21:03<4:53:54,  3.59it/s]
 83%|████████▎ | 308083/371472 [2:21:03<5:00:21,  3.52it/s]
 83%|████████▎ | 308084/371472 [2:21:04<4:53:41,  3.60it/s]
 83%|████████▎ | 308085/371472 [2:21:04<5:06:26,  3.45it/s]
 83%|████████▎ | 308086/371472 [2:21:04<4:58:42,  3.54it/s]
 83%|████████▎ | 308087/371472 [2:21:05<4:52:45,  3.61it/s]
 83%|████████▎ | 308088/371472 [2:21:05<5:06:57,  3.44it/s]
 83%|████████▎ | 308089/371472 [2:21:05<4:55:15,  3.58it/s]
 83%|████████▎ | 308090/371472 [2:21:05<4:49:15,  3.65it/s]
 83%|████████▎ | 308091/371472 [2:21:06<4:52:37,  3.61it/s]
 83%|████████▎ | 308092/371472 [2:21:06<4:57:27,  3.55it/s]
 83%|████████▎ | 308093/371472 [2:21:06<4:51:17,  3.63it/s]
 83%|████████▎ | 308094/371472 [2:21:06<4:51:36,  3.62it/s]
 83%|████████▎ | 308095/371472 [2:21:07<4:49:52,  3.64it/s]
 83%|████████▎ | 308096/371472 [2:21:07<5:01:02,  3.51it/s]
 83%|████████▎ | 308097/371472 [2:21:07<4:56:45,  3.56it/s]
 83%|████████▎ | 308098/371472 [2:21:08<5:02:39,  3.49it/s]
 83%|████████▎ | 308099/371472 [2:21:08<5:03:25,  3.48it/s]
 83%|████████▎ | 308100/371472 [2:21:08<4:52:44,  3.61it/s]
                                                           
{'loss': 2.5496, 'learning_rate': 2.5361998750242413e-07, 'epoch': 13.27}

 83%|████████▎ | 308100/371472 [2:21:08<4:52:44,  3.61it/s]
 83%|████████▎ | 308101/371472 [2:21:08<4:56:51,  3.56it/s]
 83%|████████▎ | 308102/371472 [2:21:09<4:51:56,  3.62it/s]
 83%|████████▎ | 308103/371472 [2:21:09<4:48:08,  3.67it/s]
 83%|████████▎ | 308104/371472 [2:21:09<4:40:29,  3.77it/s]
 83%|████████▎ | 308105/371472 [2:21:10<4:41:21,  3.75it/s]
 83%|████████▎ | 308106/371472 [2:21:10<4:32:19,  3.88it/s]
 83%|████████▎ | 308107/371472 [2:21:10<4:45:56,  3.69it/s]
 83%|████████▎ | 308108/371472 [2:21:10<4:50:12,  3.64it/s]
 83%|████████▎ | 308109/371472 [2:21:11<4:50:59,  3.63it/s]
 83%|████████▎ | 308110/371472 [2:21:11<5:18:03,  3.32it/s]
 83%|████████▎ | 308111/371472 [2:21:11<5:13:13,  3.37it/s]
 83%|████████▎ | 308112/371472 [2:21:12<5:02:19,  3.49it/s]
 83%|████████▎ | 308113/371472 [2:21:12<5:02:33,  3.49it/s]
 83%|████████▎ | 308114/371472 [2:21:12<5:25:59,  3.24it/s]
 83%|████████▎ | 308115/371472 [2:21:12<5:13:18,  3.37it/s]
 83%|████████▎ | 308116/371472 [2:21:13<5:10:19,  3.40it/s]
 83%|████████▎ | 308117/371472 [2:21:13<5:08:27,  3.42it/s]
 83%|████████▎ | 308118/371472 [2:21:13<4:58:47,  3.53it/s]
 83%|████████▎ | 308119/371472 [2:21:14<4:50:56,  3.63it/s]
 83%|████████▎ | 308120/371472 [2:21:14<4:58:44,  3.53it/s]
                                                           
{'loss': 2.6875, 'learning_rate': 2.535715055269452e-07, 'epoch': 13.27}

 83%|████████▎ | 308120/371472 [2:21:14<4:58:44,  3.53it/s]
 83%|████████▎ | 308121/371472 [2:21:14<4:44:24,  3.71it/s]
 83%|████████▎ | 308122/371472 [2:21:14<4:52:01,  3.62it/s]
 83%|████████▎ | 308123/371472 [2:21:15<5:15:21,  3.35it/s]
 83%|████████▎ | 308124/371472 [2:21:15<5:27:34,  3.22it/s]
 83%|████████▎ | 308125/371472 [2:21:15<5:27:19,  3.23it/s]
 83%|████████▎ | 308126/371472 [2:21:16<5:09:58,  3.41it/s]
 83%|████████▎ | 308127/371472 [2:21:16<5:02:04,  3.50it/s]
 83%|████████▎ | 308128/371472 [2:21:16<4:59:45,  3.52it/s]
 83%|████████▎ | 308129/371472 [2:21:16<5:09:55,  3.41it/s]
 83%|████████▎ | 308130/371472 [2:21:17<5:04:21,  3.47it/s]
 83%|████████▎ | 308131/371472 [2:21:17<4:52:35,  3.61it/s]
 83%|████████▎ | 308132/371472 [2:21:17<4:51:59,  3.62it/s]
 83%|████████▎ | 308133/371472 [2:21:18<4:48:38,  3.66it/s]
 83%|████████▎ | 308134/371472 [2:21:18<4:40:56,  3.76it/s]
 83%|████████▎ | 308135/371472 [2:21:18<4:36:42,  3.81it/s]
 83%|████████▎ | 308136/371472 [2:21:18<4:43:32,  3.72it/s]
 83%|████████▎ | 308137/371472 [2:21:19<4:49:39,  3.64it/s]
 83%|████████▎ | 308138/371472 [2:21:19<5:22:33,  3.27it/s]
 83%|████████▎ | 308139/371472 [2:21:19<5:05:06,  3.46it/s]
 83%|████████▎ | 308140/371472 [2:21:19<4:53:30,  3.60it/s]
                                                           
{'loss': 2.7115, 'learning_rate': 2.535230235514663e-07, 'epoch': 13.27}

 83%|████████▎ | 308140/371472 [2:21:19<4:53:30,  3.60it/s]
 83%|████████▎ | 308141/371472 [2:21:20<4:48:13,  3.66it/s]
 83%|████████▎ | 308142/371472 [2:21:20<4:53:19,  3.60it/s]
 83%|████████▎ | 308143/371472 [2:21:20<4:59:42,  3.52it/s]
 83%|████████▎ | 308144/371472 [2:21:21<5:10:57,  3.39it/s]
 83%|████████▎ | 308145/371472 [2:21:21<5:36:09,  3.14it/s]
 83%|████████▎ | 308146/371472 [2:21:21<5:16:19,  3.34it/s]
 83%|████████▎ | 308147/371472 [2:21:22<5:02:54,  3.48it/s]
 83%|████████▎ | 308148/371472 [2:21:22<4:55:35,  3.57it/s]
 83%|████████▎ | 308149/371472 [2:21:22<4:48:56,  3.65it/s]
 83%|████████▎ | 308150/371472 [2:21:22<4:53:07,  3.60it/s]
 83%|████████▎ | 308151/371472 [2:21:23<4:47:12,  3.67it/s]
 83%|████████▎ | 308152/371472 [2:21:23<4:54:47,  3.58it/s]
 83%|████████▎ | 308153/371472 [2:21:23<4:50:49,  3.63it/s]
 83%|████████▎ | 308154/371472 [2:21:23<4:45:00,  3.70it/s]
 83%|████████▎ | 308155/371472 [2:21:24<4:47:28,  3.67it/s]
 83%|████████▎ | 308156/371472 [2:21:24<5:01:22,  3.50it/s]
 83%|████████▎ | 308157/371472 [2:21:24<4:57:14,  3.55it/s]
 83%|████████▎ | 308158/371472 [2:21:25<4:51:47,  3.62it/s]
 83%|████████▎ | 308159/371472 [2:21:25<5:00:38,  3.51it/s]
 83%|████████▎ | 308160/371472 [2:21:25<4:58:37,  3.53it/s]
                                                           
{'loss': 2.6078, 'learning_rate': 2.534745415759874e-07, 'epoch': 13.27}

 83%|████████▎ | 308160/371472 [2:21:25<4:58:37,  3.53it/s]
 83%|████████▎ | 308161/371472 [2:21:25<4:49:16,  3.65it/s]
 83%|████████▎ | 308162/371472 [2:21:26<5:01:54,  3.50it/s]
 83%|████████▎ | 308163/371472 [2:21:26<4:57:09,  3.55it/s]
 83%|████████▎ | 308164/371472 [2:21:26<4:51:21,  3.62it/s]
 83%|████████▎ | 308165/371472 [2:21:27<4:52:20,  3.61it/s]
 83%|████████▎ | 308166/371472 [2:21:27<4:46:28,  3.68it/s]
 83%|████████▎ | 308167/371472 [2:21:27<4:52:55,  3.60it/s]
 83%|████████▎ | 308168/371472 [2:21:27<4:44:09,  3.71it/s]
 83%|████████▎ | 308169/371472 [2:21:28<4:40:50,  3.76it/s]
 83%|████████▎ | 308170/371472 [2:21:28<4:44:16,  3.71it/s]
 83%|████████▎ | 308171/371472 [2:21:28<4:50:24,  3.63it/s]
 83%|████████▎ | 308172/371472 [2:21:28<4:48:45,  3.65it/s]
 83%|████████▎ | 308173/371472 [2:21:29<5:01:27,  3.50it/s]
 83%|████████▎ | 308174/371472 [2:21:29<5:03:28,  3.48it/s]
 83%|████████▎ | 308175/371472 [2:21:29<5:28:52,  3.21it/s]
 83%|████████▎ | 308176/371472 [2:21:30<5:22:00,  3.28it/s]
 83%|████████▎ | 308177/371472 [2:21:30<5:06:10,  3.45it/s]
 83%|████████▎ | 308178/371472 [2:21:30<4:59:07,  3.53it/s]
 83%|████████▎ | 308179/371472 [2:21:30<4:55:37,  3.57it/s]
 83%|████████▎ | 308180/371472 [2:21:31<4:53:10,  3.60it/s]
                                                           
{'loss': 2.5669, 'learning_rate': 2.534260596005085e-07, 'epoch': 13.27}

 83%|████████▎ | 308180/371472 [2:21:31<4:53:10,  3.60it/s]
 83%|████████▎ | 308181/371472 [2:21:31<4:46:35,  3.68it/s]
 83%|████████▎ | 308182/371472 [2:21:31<4:37:20,  3.80it/s]
 83%|████████▎ | 308183/371472 [2:21:32<4:39:17,  3.78it/s]
 83%|████████▎ | 308184/371472 [2:21:32<4:32:40,  3.87it/s]
 83%|████████▎ | 308185/371472 [2:21:32<4:51:18,  3.62it/s]
 83%|████████▎ | 308186/371472 [2:21:32<5:09:52,  3.40it/s]
 83%|████████▎ | 308187/371472 [2:21:33<5:05:41,  3.45it/s]
 83%|████████▎ | 308188/371472 [2:21:33<4:54:59,  3.58it/s]
 83%|████████▎ | 308189/371472 [2:21:33<4:45:43,  3.69it/s]
 83%|████████▎ | 308190/371472 [2:21:33<4:48:18,  3.66it/s]
 83%|████████▎ | 308191/371472 [2:21:34<4:50:18,  3.63it/s]
 83%|████████▎ | 308192/371472 [2:21:34<5:32:02,  3.18it/s]
 83%|████████▎ | 308193/371472 [2:21:34<5:23:49,  3.26it/s]
 83%|████████▎ | 308194/371472 [2:21:35<5:46:25,  3.04it/s]
 83%|████████▎ | 308195/371472 [2:21:35<5:24:24,  3.25it/s]
 83%|████████▎ | 308196/371472 [2:21:35<5:29:24,  3.20it/s]
 83%|████████▎ | 308197/371472 [2:21:36<5:11:59,  3.38it/s]
 83%|████████▎ | 308198/371472 [2:21:36<4:59:36,  3.52it/s]
 83%|████████▎ | 308199/371472 [2:21:36<4:51:49,  3.61it/s]
 83%|████████▎ | 308200/371472 [2:21:36<4:44:07,  3.71it/s]
                                                           
{'loss': 2.5691, 'learning_rate': 2.533775776250296e-07, 'epoch': 13.27}

 83%|████████▎ | 308200/371472 [2:21:36<4:44:07,  3.71it/s]
 83%|████████▎ | 308201/371472 [2:21:37<4:42:16,  3.74it/s]
 83%|████████▎ | 308202/371472 [2:21:37<4:42:58,  3.73it/s]
 83%|████████▎ | 308203/371472 [2:21:37<4:36:38,  3.81it/s]
 83%|████████▎ | 308204/371472 [2:21:37<4:31:27,  3.88it/s]
 83%|████████▎ | 308205/371472 [2:21:38<4:48:23,  3.66it/s]
 83%|████████▎ | 308206/371472 [2:21:38<4:51:43,  3.61it/s]
 83%|████████▎ | 308207/371472 [2:21:38<4:59:04,  3.53it/s]
 83%|████████▎ | 308208/371472 [2:21:39<4:50:07,  3.63it/s]
 83%|████████▎ | 308209/371472 [2:21:39<5:16:56,  3.33it/s]
 83%|████████▎ | 308210/371472 [2:21:39<5:06:50,  3.44it/s]
 83%|████████▎ | 308211/371472 [2:21:40<4:51:13,  3.62it/s]
 83%|████████▎ | 308212/371472 [2:21:40<4:44:18,  3.71it/s]
 83%|████████▎ | 308213/371472 [2:21:40<4:52:22,  3.61it/s]
 83%|████████▎ | 308214/371472 [2:21:40<4:43:20,  3.72it/s]
 83%|████████▎ | 308215/371472 [2:21:41<4:50:23,  3.63it/s]
 83%|████████▎ | 308216/371472 [2:21:41<4:40:55,  3.75it/s]
 83%|████████▎ | 308217/371472 [2:21:41<4:52:26,  3.60it/s]
 83%|████████▎ | 308218/371472 [2:21:41<4:45:07,  3.70it/s]
 83%|████████▎ | 308219/371472 [2:21:42<4:37:51,  3.79it/s]
 83%|████████▎ | 308220/371472 [2:21:42<4:36:26,  3.81it/s]
                                                           
{'loss': 2.5338, 'learning_rate': 2.533290956495508e-07, 'epoch': 13.28}

 83%|████████▎ | 308220/371472 [2:21:42<4:36:26,  3.81it/s]
 83%|████████▎ | 308221/371472 [2:21:42<4:52:28,  3.60it/s]
 83%|████████▎ | 308222/371472 [2:21:43<5:22:49,  3.27it/s]
 83%|████████▎ | 308223/371472 [2:21:43<5:10:54,  3.39it/s]
 83%|████████▎ | 308224/371472 [2:21:43<5:19:26,  3.30it/s]
 83%|████████▎ | 308225/371472 [2:21:43<5:11:53,  3.38it/s]
 83%|████████▎ | 308226/371472 [2:21:44<4:59:15,  3.52it/s]
 83%|████████▎ | 308227/371472 [2:21:44<5:02:20,  3.49it/s]
 83%|████████▎ | 308228/371472 [2:21:44<5:01:55,  3.49it/s]
 83%|████████▎ | 308229/371472 [2:21:45<4:45:29,  3.69it/s]
 83%|████████▎ | 308230/371472 [2:21:45<4:45:22,  3.69it/s]
 83%|████████▎ | 308231/371472 [2:21:45<4:35:00,  3.83it/s]
 83%|████████▎ | 308232/371472 [2:21:45<5:14:08,  3.36it/s]
 83%|████████▎ | 308233/371472 [2:21:46<5:03:33,  3.47it/s]
 83%|████████▎ | 308234/371472 [2:21:46<5:06:25,  3.44it/s]
 83%|████████▎ | 308235/371472 [2:21:46<5:12:40,  3.37it/s]
 83%|████████▎ | 308236/371472 [2:21:47<5:04:39,  3.46it/s]
 83%|████████▎ | 308237/371472 [2:21:47<4:57:29,  3.54it/s]
 83%|████████▎ | 308238/371472 [2:21:47<4:52:08,  3.61it/s]
 83%|████████▎ | 308239/371472 [2:21:47<4:48:22,  3.65it/s]
 83%|████████▎ | 308240/371472 [2:21:48<4:50:17,  3.63it/s]
                                                           
{'loss': 2.7222, 'learning_rate': 2.5328061367407184e-07, 'epoch': 13.28}

 83%|████████▎ | 308240/371472 [2:21:48<4:50:17,  3.63it/s]
 83%|████████▎ | 308241/371472 [2:21:48<4:41:27,  3.74it/s]
 83%|████████▎ | 308242/371472 [2:21:48<4:34:37,  3.84it/s]
 83%|████████▎ | 308243/371472 [2:21:48<4:31:24,  3.88it/s]
 83%|████████▎ | 308244/371472 [2:21:49<4:34:04,  3.85it/s]
 83%|████████▎ | 308245/371472 [2:21:49<4:34:52,  3.83it/s]
 83%|████████▎ | 308246/371472 [2:21:49<4:49:55,  3.63it/s]
 83%|████████▎ | 308247/371472 [2:21:50<4:51:51,  3.61it/s]
 83%|████████▎ | 308248/371472 [2:21:50<4:52:37,  3.60it/s]
 83%|████████▎ | 308249/371472 [2:21:50<4:50:45,  3.62it/s]
 83%|████████▎ | 308250/371472 [2:21:50<4:44:18,  3.71it/s]
 83%|████████▎ | 308251/371472 [2:21:51<4:38:12,  3.79it/s]
 83%|████████▎ | 308252/371472 [2:21:51<4:38:36,  3.78it/s]
 83%|████████▎ | 308253/371472 [2:21:51<4:37:53,  3.79it/s]
 83%|████████▎ | 308254/371472 [2:21:51<4:44:08,  3.71it/s]
 83%|████████▎ | 308255/371472 [2:21:52<5:22:34,  3.27it/s]
 83%|████████▎ | 308256/371472 [2:21:52<5:10:22,  3.39it/s]
 83%|████████▎ | 308257/371472 [2:21:52<4:58:14,  3.53it/s]
 83%|████████▎ | 308258/371472 [2:21:53<4:42:23,  3.73it/s]
 83%|████████▎ | 308259/371472 [2:21:53<5:13:26,  3.36it/s]
 83%|████████▎ | 308260/371472 [2:21:53<5:04:37,  3.46it/s]
                                                           
{'loss': 2.6525, 'learning_rate': 2.5323213169859296e-07, 'epoch': 13.28}

 83%|████████▎ | 308260/371472 [2:21:53<5:04:37,  3.46it/s]
 83%|████████▎ | 308261/371472 [2:21:53<5:03:23,  3.47it/s]
 83%|████████▎ | 308262/371472 [2:21:54<5:10:55,  3.39it/s]
 83%|████████▎ | 308263/371472 [2:21:54<5:09:06,  3.41it/s]
 83%|████████▎ | 308264/371472 [2:21:54<4:58:10,  3.53it/s]
 83%|████████▎ | 308265/371472 [2:21:55<4:43:12,  3.72it/s]
 83%|████████▎ | 308266/371472 [2:21:55<4:41:23,  3.74it/s]
 83%|████████▎ | 308267/371472 [2:21:55<4:52:13,  3.60it/s]
 83%|████████▎ | 308268/371472 [2:21:55<4:47:09,  3.67it/s]
 83%|████████▎ | 308269/371472 [2:21:56<4:50:24,  3.63it/s]
 83%|████████▎ | 308270/371472 [2:21:56<4:58:50,  3.52it/s]
 83%|████████▎ | 308271/371472 [2:21:56<5:00:37,  3.50it/s]
 83%|████████▎ | 308272/371472 [2:21:57<4:54:24,  3.58it/s]
 83%|████████▎ | 308273/371472 [2:21:57<4:52:35,  3.60it/s]
 83%|████████▎ | 308274/371472 [2:21:57<4:55:50,  3.56it/s]
 83%|████████▎ | 308275/371472 [2:21:57<4:58:34,  3.53it/s]
 83%|████████▎ | 308276/371472 [2:21:58<5:27:26,  3.22it/s]
 83%|████████▎ | 308277/371472 [2:21:58<5:22:57,  3.26it/s]
 83%|████████▎ | 308278/371472 [2:21:58<5:31:08,  3.18it/s]
 83%|████████▎ | 308279/371472 [2:21:59<5:16:47,  3.32it/s]
 83%|████████▎ | 308280/371472 [2:21:59<5:18:46,  3.30it/s]
                                                           
{'loss': 2.5824, 'learning_rate': 2.5318364972311404e-07, 'epoch': 13.28}

 83%|████████▎ | 308280/371472 [2:21:59<5:18:46,  3.30it/s]
 83%|████████▎ | 308281/371472 [2:21:59<4:55:40,  3.56it/s]
 83%|████████▎ | 308282/371472 [2:21:59<4:59:25,  3.52it/s]
 83%|████████▎ | 308283/371472 [2:22:00<4:54:55,  3.57it/s]
 83%|████████▎ | 308284/371472 [2:22:00<4:40:27,  3.76it/s]
 83%|████████▎ | 308285/371472 [2:22:00<4:30:15,  3.90it/s]
 83%|████████▎ | 308286/371472 [2:22:00<4:38:13,  3.79it/s]
 83%|████████▎ | 308287/371472 [2:22:01<4:40:42,  3.75it/s]
 83%|████████▎ | 308288/371472 [2:22:01<4:34:22,  3.84it/s]
 83%|████████▎ | 308289/371472 [2:22:01<4:50:35,  3.62it/s]
 83%|████████▎ | 308290/371472 [2:22:02<4:36:25,  3.81it/s]
 83%|████████▎ | 308291/371472 [2:22:02<4:37:50,  3.79it/s]
 83%|████████▎ | 308292/371472 [2:22:02<4:42:02,  3.73it/s]
 83%|████████▎ | 308293/371472 [2:22:02<4:44:33,  3.70it/s]
 83%|████████▎ | 308294/371472 [2:22:03<4:44:09,  3.71it/s]
 83%|████████▎ | 308295/371472 [2:22:03<4:49:30,  3.64it/s]
 83%|████████▎ | 308296/371472 [2:22:03<4:46:31,  3.67it/s]
 83%|████████▎ | 308297/371472 [2:22:03<4:35:19,  3.82it/s]
 83%|████████▎ | 308298/371472 [2:22:04<4:36:53,  3.80it/s]
 83%|████████▎ | 308299/371472 [2:22:04<4:35:13,  3.83it/s]
 83%|████████▎ | 308300/371472 [2:22:04<4:41:23,  3.74it/s]
                                                           
{'loss': 2.5384, 'learning_rate': 2.5313516774763516e-07, 'epoch': 13.28}

 83%|████████▎ | 308300/371472 [2:22:04<4:41:23,  3.74it/s]
 83%|████████▎ | 308301/371472 [2:22:04<4:36:35,  3.81it/s]
 83%|████████▎ | 308302/371472 [2:22:05<5:17:14,  3.32it/s]
 83%|████████▎ | 308303/371472 [2:22:05<5:32:04,  3.17it/s]
 83%|████████▎ | 308304/371472 [2:22:05<5:18:31,  3.31it/s]
 83%|████████▎ | 308305/371472 [2:22:06<5:05:30,  3.45it/s]
 83%|████████▎ | 308306/371472 [2:22:06<5:08:09,  3.42it/s]
 83%|████████▎ | 308307/371472 [2:22:06<4:58:01,  3.53it/s]
 83%|████████▎ | 308308/371472 [2:22:07<4:47:56,  3.66it/s]
 83%|████████▎ | 308309/371472 [2:22:07<4:40:30,  3.75it/s]
 83%|████████▎ | 308310/371472 [2:22:07<4:43:12,  3.72it/s]
 83%|████████▎ | 308311/371472 [2:22:07<4:41:23,  3.74it/s]
 83%|████████▎ | 308312/371472 [2:22:08<4:37:05,  3.80it/s]
 83%|████████▎ | 308313/371472 [2:22:08<4:57:43,  3.54it/s]
 83%|████████▎ | 308314/371472 [2:22:08<4:48:01,  3.65it/s]
 83%|████████▎ | 308315/371472 [2:22:08<4:45:18,  3.69it/s]
 83%|████████▎ | 308316/371472 [2:22:09<4:58:36,  3.53it/s]
 83%|████████▎ | 308317/371472 [2:22:09<4:57:11,  3.54it/s]
 83%|████████▎ | 308318/371472 [2:22:09<4:59:48,  3.51it/s]
 83%|████████▎ | 308319/371472 [2:22:10<4:56:40,  3.55it/s]
 83%|████████▎ | 308320/371472 [2:22:10<4:56:29,  3.55it/s]
                                                           
{'loss': 2.6637, 'learning_rate': 2.5308668577215623e-07, 'epoch': 13.28}

 83%|████████▎ | 308320/371472 [2:22:10<4:56:29,  3.55it/s]
 83%|████████▎ | 308321/371472 [2:22:10<4:47:39,  3.66it/s]
 83%|████████▎ | 308322/371472 [2:22:10<4:55:26,  3.56it/s]
 83%|████████▎ | 308323/371472 [2:22:11<5:18:20,  3.31it/s]
 83%|████████▎ | 308324/371472 [2:22:11<5:08:23,  3.41it/s]
 83%|████████▎ | 308325/371472 [2:22:11<5:27:46,  3.21it/s]
 83%|████████▎ | 308326/371472 [2:22:12<5:15:15,  3.34it/s]
 83%|████████▎ | 308327/371472 [2:22:12<4:59:27,  3.51it/s]
 83%|████████▎ | 308328/371472 [2:22:12<5:07:37,  3.42it/s]
 83%|████████▎ | 308329/371472 [2:22:13<5:05:27,  3.45it/s]
 83%|████████▎ | 308330/371472 [2:22:13<4:54:40,  3.57it/s]
 83%|████████▎ | 308331/371472 [2:22:13<5:04:40,  3.45it/s]
 83%|████████▎ | 308332/371472 [2:22:13<4:54:55,  3.57it/s]
 83%|████████▎ | 308333/371472 [2:22:14<4:45:59,  3.68it/s]
 83%|████████▎ | 308334/371472 [2:22:14<4:42:06,  3.73it/s]
 83%|████████▎ | 308335/371472 [2:22:14<4:44:19,  3.70it/s]
 83%|████████▎ | 308336/371472 [2:22:14<4:58:10,  3.53it/s]
 83%|████████▎ | 308337/371472 [2:22:15<5:03:06,  3.47it/s]
 83%|████████▎ | 308338/371472 [2:22:15<4:51:16,  3.61it/s]
 83%|████████▎ | 308339/371472 [2:22:15<5:04:48,  3.45it/s]
 83%|████████▎ | 308340/371472 [2:22:16<5:05:31,  3.44it/s]
                                                           
{'loss': 2.5735, 'learning_rate': 2.530382037966773e-07, 'epoch': 13.28}

 83%|████████▎ | 308340/371472 [2:22:16<5:05:31,  3.44it/s]
 83%|████████▎ | 308341/371472 [2:22:16<5:03:17,  3.47it/s]
 83%|████████▎ | 308342/371472 [2:22:16<4:57:30,  3.54it/s]
 83%|████████▎ | 308343/371472 [2:22:17<5:16:20,  3.33it/s]
 83%|████████▎ | 308344/371472 [2:22:17<5:07:57,  3.42it/s]
 83%|████████▎ | 308345/371472 [2:22:17<4:51:15,  3.61it/s]
 83%|████████▎ | 308346/371472 [2:22:17<4:40:07,  3.76it/s]
 83%|████████▎ | 308347/371472 [2:22:18<4:49:01,  3.64it/s]
 83%|████████▎ | 308348/371472 [2:22:18<5:07:20,  3.42it/s]
 83%|████████▎ | 308349/371472 [2:22:18<5:00:22,  3.50it/s]
 83%|████████▎ | 308350/371472 [2:22:18<4:44:30,  3.70it/s]
 83%|████████▎ | 308351/371472 [2:22:19<4:54:24,  3.57it/s]
 83%|████████▎ | 308352/371472 [2:22:19<4:49:42,  3.63it/s]
 83%|████████▎ | 308353/371472 [2:22:19<4:57:43,  3.53it/s]
 83%|████████▎ | 308354/371472 [2:22:20<5:10:14,  3.39it/s]
 83%|████████▎ | 308355/371472 [2:22:20<4:52:23,  3.60it/s]
 83%|████████▎ | 308356/371472 [2:22:20<4:51:35,  3.61it/s]
 83%|████████▎ | 308357/371472 [2:22:20<5:01:17,  3.49it/s]
 83%|████████▎ | 308358/371472 [2:22:21<4:59:19,  3.51it/s]
 83%|████████▎ | 308359/371472 [2:22:21<4:47:25,  3.66it/s]
 83%|████████▎ | 308360/371472 [2:22:21<5:06:50,  3.43it/s]
                                                           
{'loss': 2.5317, 'learning_rate': 2.529897218211985e-07, 'epoch': 13.28}

 83%|████████▎ | 308360/371472 [2:22:21<5:06:50,  3.43it/s]
 83%|████████▎ | 308361/371472 [2:22:22<5:14:36,  3.34it/s]
 83%|████████▎ | 308362/371472 [2:22:22<5:02:34,  3.48it/s]
 83%|████████▎ | 308363/371472 [2:22:22<5:02:14,  3.48it/s]
 83%|████████▎ | 308364/371472 [2:22:22<5:01:59,  3.48it/s]
 83%|████████▎ | 308365/371472 [2:22:23<5:08:55,  3.40it/s]
 83%|████████▎ | 308366/371472 [2:22:23<5:15:24,  3.33it/s]
 83%|████████▎ | 308367/371472 [2:22:23<5:02:23,  3.48it/s]
 83%|████████▎ | 308368/371472 [2:22:24<4:54:24,  3.57it/s]
 83%|████████▎ | 308369/371472 [2:22:24<4:43:04,  3.72it/s]
 83%|████████▎ | 308370/371472 [2:22:24<4:42:39,  3.72it/s]
 83%|████████▎ | 308371/371472 [2:22:24<4:52:59,  3.59it/s]
 83%|████████▎ | 308372/371472 [2:22:25<4:49:33,  3.63it/s]
 83%|████████▎ | 308373/371472 [2:22:25<4:50:32,  3.62it/s]
 83%|████████▎ | 308374/371472 [2:22:25<4:39:18,  3.77it/s]
 83%|████████▎ | 308375/371472 [2:22:25<4:52:36,  3.59it/s]
 83%|████████▎ | 308376/371472 [2:22:26<4:58:55,  3.52it/s]
 83%|████████▎ | 308377/371472 [2:22:26<4:55:35,  3.56it/s]
 83%|████████▎ | 308378/371472 [2:22:26<4:57:58,  3.53it/s]
 83%|████████▎ | 308379/371472 [2:22:27<5:08:15,  3.41it/s]
 83%|████████▎ | 308380/371472 [2:22:27<5:06:54,  3.43it/s]
                                                           
{'loss': 2.5293, 'learning_rate': 2.529412398457196e-07, 'epoch': 13.28}

 83%|████████▎ | 308380/371472 [2:22:27<5:06:54,  3.43it/s]
 83%|████████▎ | 308381/371472 [2:22:27<5:01:52,  3.48it/s]
 83%|████████▎ | 308382/371472 [2:22:28<4:59:54,  3.51it/s]
 83%|████████▎ | 308383/371472 [2:22:28<4:48:52,  3.64it/s]
 83%|████████▎ | 308384/371472 [2:22:28<4:52:18,  3.60it/s]
 83%|████████▎ | 308385/371472 [2:22:28<5:02:45,  3.47it/s]
 83%|████████▎ | 308386/371472 [2:22:29<5:02:45,  3.47it/s]
 83%|████████▎ | 308387/371472 [2:22:29<5:13:39,  3.35it/s]
 83%|████████▎ | 308388/371472 [2:22:29<4:59:10,  3.51it/s]
 83%|████████▎ | 308389/371472 [2:22:29<4:49:23,  3.63it/s]
 83%|████████▎ | 308390/371472 [2:22:30<4:45:54,  3.68it/s]
 83%|████████▎ | 308391/371472 [2:22:30<4:56:52,  3.54it/s]
 83%|████████▎ | 308392/371472 [2:22:30<4:56:50,  3.54it/s]
 83%|████████▎ | 308393/371472 [2:22:31<4:49:51,  3.63it/s]
 83%|████████▎ | 308394/371472 [2:22:31<4:49:31,  3.63it/s]
 83%|████████▎ | 308395/371472 [2:22:31<4:50:16,  3.62it/s]
 83%|████████▎ | 308396/371472 [2:22:31<4:43:58,  3.70it/s]
 83%|████████▎ | 308397/371472 [2:22:32<5:15:52,  3.33it/s]
 83%|████████▎ | 308398/371472 [2:22:32<5:07:04,  3.42it/s]
 83%|████████▎ | 308399/371472 [2:22:32<5:04:53,  3.45it/s]
 83%|████████▎ | 308400/371472 [2:22:33<5:28:33,  3.20it/s]
                                                           
{'loss': 2.4983, 'learning_rate': 2.528927578702407e-07, 'epoch': 13.28}

 83%|████████▎ | 308400/371472 [2:22:33<5:28:33,  3.20it/s]
 83%|████████▎ | 308401/371472 [2:22:33<5:16:13,  3.32it/s]
 83%|████████▎ | 308402/371472 [2:22:33<4:58:44,  3.52it/s]
 83%|████████▎ | 308403/371472 [2:22:33<4:56:27,  3.55it/s]
 83%|████████▎ | 308404/371472 [2:22:34<5:05:33,  3.44it/s]
 83%|████████▎ | 308405/371472 [2:22:34<5:01:18,  3.49it/s]
 83%|████████▎ | 308406/371472 [2:22:34<4:56:20,  3.55it/s]
 83%|████████▎ | 308407/371472 [2:22:35<4:44:16,  3.70it/s]
 83%|████████▎ | 308408/371472 [2:22:35<4:54:09,  3.57it/s]
 83%|████████▎ | 308409/371472 [2:22:35<5:00:58,  3.49it/s]
 83%|████████▎ | 308410/371472 [2:22:35<5:05:19,  3.44it/s]
 83%|████████▎ | 308411/371472 [2:22:36<5:17:00,  3.32it/s]
 83%|████████▎ | 308412/371472 [2:22:36<5:04:46,  3.45it/s]
 83%|████████▎ | 308413/371472 [2:22:36<5:09:05,  3.40it/s]
 83%|████████▎ | 308414/371472 [2:22:37<5:34:43,  3.14it/s]
 83%|████████▎ | 308415/371472 [2:22:37<5:29:18,  3.19it/s]
 83%|████████▎ | 308416/371472 [2:22:37<5:15:19,  3.33it/s]
 83%|████████▎ | 308417/371472 [2:22:38<5:27:56,  3.20it/s]
 83%|████████▎ | 308418/371472 [2:22:38<5:14:01,  3.35it/s]
 83%|████████▎ | 308419/371472 [2:22:38<5:04:33,  3.45it/s]
 83%|████████▎ | 308420/371472 [2:22:38<5:03:54,  3.46it/s]
                                                           
{'loss': 2.439, 'learning_rate': 2.5284427589476175e-07, 'epoch': 13.28}

 83%|████████▎ | 308420/371472 [2:22:38<5:03:54,  3.46it/s]
 83%|████████▎ | 308421/371472 [2:22:39<5:02:37,  3.47it/s]
 83%|████████▎ | 308422/371472 [2:22:39<5:00:49,  3.49it/s]
 83%|████████▎ | 308423/371472 [2:22:39<4:59:37,  3.51it/s]
 83%|████████▎ | 308424/371472 [2:22:40<5:05:54,  3.44it/s]
 83%|████████▎ | 308425/371472 [2:22:40<4:56:52,  3.54it/s]
 83%|████████▎ | 308426/371472 [2:22:40<5:04:01,  3.46it/s]
 83%|████████▎ | 308427/371472 [2:22:40<4:54:21,  3.57it/s]
 83%|████████▎ | 308428/371472 [2:22:41<5:12:57,  3.36it/s]
 83%|████████▎ | 308429/371472 [2:22:41<4:53:06,  3.58it/s]
 83%|████████▎ | 308430/371472 [2:22:41<4:42:02,  3.73it/s]
 83%|████████▎ | 308431/371472 [2:22:42<4:43:27,  3.71it/s]
 83%|████████▎ | 308432/371472 [2:22:42<4:44:07,  3.70it/s]
 83%|████████▎ | 308433/371472 [2:22:42<4:34:40,  3.83it/s]
 83%|████████▎ | 308434/371472 [2:22:42<4:52:31,  3.59it/s]
 83%|████████▎ | 308435/371472 [2:22:43<4:41:02,  3.74it/s]
 83%|████████▎ | 308436/371472 [2:22:43<4:50:23,  3.62it/s]
 83%|████████▎ | 308437/371472 [2:22:43<4:47:18,  3.66it/s]
 83%|████████▎ | 308438/371472 [2:22:43<4:42:09,  3.72it/s]
 83%|████████▎ | 308439/371472 [2:22:44<5:16:17,  3.32it/s]
 83%|████████▎ | 308440/371472 [2:22:44<5:08:24,  3.41it/s]
                                                           
{'loss': 2.5472, 'learning_rate': 2.5279579391928287e-07, 'epoch': 13.29}

 83%|████████▎ | 308440/371472 [2:22:44<5:08:24,  3.41it/s]
 83%|████████▎ | 308441/371472 [2:22:44<5:02:14,  3.48it/s]
 83%|████████▎ | 308442/371472 [2:22:45<4:59:32,  3.51it/s]
 83%|████████▎ | 308443/371472 [2:22:45<4:50:20,  3.62it/s]
 83%|████████▎ | 308444/371472 [2:22:45<4:45:52,  3.67it/s]
 83%|████████▎ | 308445/371472 [2:22:45<4:46:47,  3.66it/s]
 83%|████████▎ | 308446/371472 [2:22:46<4:46:01,  3.67it/s]
 83%|████████▎ | 308447/371472 [2:22:46<4:51:10,  3.61it/s]
 83%|████████▎ | 308448/371472 [2:22:46<4:56:11,  3.55it/s]
 83%|████████▎ | 308449/371472 [2:22:47<5:33:10,  3.15it/s]
 83%|████████▎ | 308450/371472 [2:22:47<6:29:38,  2.70it/s]
 83%|████████▎ | 308451/371472 [2:22:47<5:54:41,  2.96it/s]
 83%|████████▎ | 308452/371472 [2:22:48<5:34:52,  3.14it/s]
 83%|████████▎ | 308453/371472 [2:22:48<5:32:31,  3.16it/s]
 83%|████████▎ | 308454/371472 [2:22:48<5:20:15,  3.28it/s]
 83%|████████▎ | 308455/371472 [2:22:49<5:09:20,  3.40it/s]
 83%|████████▎ | 308456/371472 [2:22:49<4:52:14,  3.59it/s]
 83%|████████▎ | 308457/371472 [2:22:49<4:56:29,  3.54it/s]
 83%|████████▎ | 308458/371472 [2:22:49<5:13:48,  3.35it/s]
 83%|████████▎ | 308459/371472 [2:22:50<4:56:28,  3.54it/s]
 83%|████████▎ | 308460/371472 [2:22:50<4:50:05,  3.62it/s]
                                                           
{'loss': 2.5931, 'learning_rate': 2.5274731194380394e-07, 'epoch': 13.29}

 83%|████████▎ | 308460/371472 [2:22:50<4:50:05,  3.62it/s]
 83%|████████▎ | 308461/371472 [2:22:50<4:48:23,  3.64it/s]
 83%|████████▎ | 308462/371472 [2:22:51<4:47:46,  3.65it/s]
 83%|████████▎ | 308463/371472 [2:22:51<4:50:10,  3.62it/s]
 83%|████████▎ | 308464/371472 [2:22:51<4:50:21,  3.62it/s]
 83%|████████▎ | 308465/371472 [2:22:51<5:05:09,  3.44it/s]
 83%|████████▎ | 308466/371472 [2:22:52<5:01:55,  3.48it/s]
 83%|████████▎ | 308467/371472 [2:22:52<5:05:42,  3.43it/s]
 83%|████████▎ | 308468/371472 [2:22:52<5:02:12,  3.47it/s]
 83%|████████▎ | 308469/371472 [2:22:53<4:59:23,  3.51it/s]
 83%|████████▎ | 308470/371472 [2:22:53<4:47:16,  3.66it/s]
 83%|████████▎ | 308471/371472 [2:22:53<4:40:14,  3.75it/s]
 83%|████████▎ | 308472/371472 [2:22:53<4:53:00,  3.58it/s]
 83%|████████▎ | 308473/371472 [2:22:54<4:41:56,  3.72it/s]
 83%|████████▎ | 308474/371472 [2:22:54<4:46:53,  3.66it/s]
 83%|████████▎ | 308475/371472 [2:22:54<4:51:51,  3.60it/s]
 83%|████████▎ | 308476/371472 [2:22:54<5:04:13,  3.45it/s]
 83%|████████▎ | 308477/371472 [2:22:55<4:48:35,  3.64it/s]
 83%|████████▎ | 308478/371472 [2:22:55<4:48:08,  3.64it/s]
 83%|████████▎ | 308479/371472 [2:22:55<4:55:19,  3.56it/s]
 83%|████████▎ | 308480/371472 [2:22:56<5:18:24,  3.30it/s]
                                                           
{'loss': 2.6459, 'learning_rate': 2.526988299683251e-07, 'epoch': 13.29}

 83%|████████▎ | 308480/371472 [2:22:56<5:18:24,  3.30it/s]
 83%|████████▎ | 308481/371472 [2:22:56<5:13:07,  3.35it/s]
 83%|████████▎ | 308482/371472 [2:22:56<5:17:32,  3.31it/s]
 83%|████████▎ | 308483/371472 [2:22:57<5:39:11,  3.10it/s]
 83%|████████▎ | 308484/371472 [2:22:57<5:17:45,  3.30it/s]
 83%|████████▎ | 308485/371472 [2:22:57<5:11:54,  3.37it/s]
 83%|████████▎ | 308486/371472 [2:22:57<5:09:03,  3.40it/s]
 83%|████████▎ | 308487/371472 [2:22:58<5:14:57,  3.33it/s]
 83%|████████▎ | 308488/371472 [2:22:58<5:02:49,  3.47it/s]
 83%|████████▎ | 308489/371472 [2:22:58<4:55:56,  3.55it/s]
 83%|████████▎ | 308490/371472 [2:22:59<4:56:17,  3.54it/s]
 83%|████████▎ | 308491/371472 [2:22:59<4:57:58,  3.52it/s]
 83%|████████▎ | 308492/371472 [2:22:59<4:54:34,  3.56it/s]
 83%|████████▎ | 308493/371472 [2:22:59<4:58:42,  3.51it/s]
 83%|████████▎ | 308494/371472 [2:23:00<5:02:34,  3.47it/s]
 83%|████████▎ | 308495/371472 [2:23:00<4:53:30,  3.58it/s]
 83%|████████▎ | 308496/371472 [2:23:00<5:11:00,  3.37it/s]
 83%|████████▎ | 308497/371472 [2:23:01<5:09:56,  3.39it/s]
 83%|████████▎ | 308498/371472 [2:23:01<5:10:07,  3.38it/s]
 83%|████████▎ | 308499/371472 [2:23:01<4:55:42,  3.55it/s]
 83%|████████▎ | 308500/371472 [2:23:01<4:47:55,  3.65it/s]
                                                           
{'loss': 2.5263, 'learning_rate': 2.526503479928462e-07, 'epoch': 13.29}

 83%|████████▎ | 308500/371472 [2:23:01<4:47:55,  3.65it/s]
 83%|████████▎ | 308501/371472 [2:23:02<4:34:46,  3.82it/s]
 83%|████████▎ | 308502/371472 [2:23:02<4:34:52,  3.82it/s]
 83%|████████▎ | 308503/371472 [2:23:02<4:56:36,  3.54it/s]
 83%|████████▎ | 308504/371472 [2:23:03<5:31:03,  3.17it/s]
 83%|████████▎ | 308505/371472 [2:23:03<5:08:15,  3.40it/s]
 83%|████████▎ | 308506/371472 [2:23:03<4:58:07,  3.52it/s]
 83%|████████▎ | 308507/371472 [2:23:03<5:08:01,  3.41it/s]
 83%|████████▎ | 308508/371472 [2:23:04<4:55:33,  3.55it/s]
 83%|████████▎ | 308509/371472 [2:23:04<4:54:41,  3.56it/s]
 83%|████████▎ | 308510/371472 [2:23:04<4:41:55,  3.72it/s]
 83%|████████▎ | 308511/371472 [2:23:04<4:45:18,  3.68it/s]
 83%|████████▎ | 308512/371472 [2:23:05<4:58:05,  3.52it/s]
 83%|████████▎ | 308513/371472 [2:23:05<4:48:27,  3.64it/s]
 83%|████████▎ | 308514/371472 [2:23:05<4:52:51,  3.58it/s]
 83%|████████▎ | 308515/371472 [2:23:06<5:03:04,  3.46it/s]
 83%|████████▎ | 308516/371472 [2:23:06<5:08:31,  3.40it/s]
 83%|████████▎ | 308517/371472 [2:23:06<5:07:37,  3.41it/s]
 83%|████████▎ | 308518/371472 [2:23:07<4:52:42,  3.58it/s]
 83%|████████▎ | 308519/371472 [2:23:07<4:49:44,  3.62it/s]
 83%|████████▎ | 308520/371472 [2:23:07<4:34:55,  3.82it/s]
                                                           
{'loss': 2.6128, 'learning_rate': 2.526018660173673e-07, 'epoch': 13.29}

 83%|████████▎ | 308520/371472 [2:23:07<4:34:55,  3.82it/s]
 83%|████████▎ | 308521/371472 [2:23:07<5:10:28,  3.38it/s]
 83%|████████▎ | 308522/371472 [2:23:08<5:01:13,  3.48it/s]
 83%|████████▎ | 308523/371472 [2:23:08<4:54:30,  3.56it/s]
 83%|████████▎ | 308524/371472 [2:23:08<4:44:08,  3.69it/s]
 83%|████████▎ | 308525/371472 [2:23:08<4:34:22,  3.82it/s]
 83%|████████▎ | 308526/371472 [2:23:09<4:28:20,  3.91it/s]
 83%|████████▎ | 308527/371472 [2:23:09<4:46:37,  3.66it/s]
 83%|████████▎ | 308528/371472 [2:23:09<4:39:50,  3.75it/s]
 83%|████████▎ | 308529/371472 [2:23:10<4:50:00,  3.62it/s]
 83%|████████▎ | 308530/371472 [2:23:10<4:50:10,  3.62it/s]
 83%|████████▎ | 308531/371472 [2:23:10<4:40:48,  3.74it/s]
 83%|████████▎ | 308532/371472 [2:23:10<5:32:50,  3.15it/s]
 83%|████████▎ | 308533/371472 [2:23:11<5:31:47,  3.16it/s]
 83%|████████▎ | 308534/371472 [2:23:11<5:30:55,  3.17it/s]
 83%|████████▎ | 308535/371472 [2:23:11<5:20:08,  3.28it/s]
 83%|████████▎ | 308536/371472 [2:23:12<5:23:23,  3.24it/s]
 83%|████████▎ | 308537/371472 [2:23:12<5:58:56,  2.92it/s]
 83%|████████▎ | 308538/371472 [2:23:12<5:38:17,  3.10it/s]
 83%|████████▎ | 308539/371472 [2:23:13<5:36:48,  3.11it/s]
 83%|████████▎ | 308540/371472 [2:23:13<5:23:51,  3.24it/s]
                                                           
{'loss': 2.6853, 'learning_rate': 2.525533840418884e-07, 'epoch': 13.29}

 83%|████████▎ | 308540/371472 [2:23:13<5:23:51,  3.24it/s]
 83%|████████▎ | 308541/371472 [2:23:13<5:06:11,  3.43it/s]
 83%|████████▎ | 308542/371472 [2:23:14<5:21:05,  3.27it/s]
 83%|████████▎ | 308543/371472 [2:23:14<5:25:24,  3.22it/s]
 83%|████████▎ | 308544/371472 [2:23:14<5:23:07,  3.25it/s]
 83%|████████▎ | 308545/371472 [2:23:14<5:09:16,  3.39it/s]
 83%|████████▎ | 308546/371472 [2:23:15<4:58:36,  3.51it/s]
 83%|████████▎ | 308547/371472 [2:23:15<4:47:28,  3.65it/s]
 83%|████████▎ | 308548/371472 [2:23:15<4:57:41,  3.52it/s]
 83%|████████▎ | 308549/371472 [2:23:16<4:57:31,  3.52it/s]
 83%|████████▎ | 308550/371472 [2:23:16<4:50:52,  3.61it/s]
 83%|████████▎ | 308551/371472 [2:23:16<4:57:19,  3.53it/s]
 83%|████████▎ | 308552/371472 [2:23:16<4:57:51,  3.52it/s]
 83%|████████▎ | 308553/371472 [2:23:17<6:22:12,  2.74it/s]
 83%|████████▎ | 308554/371472 [2:23:17<5:49:57,  3.00it/s]
 83%|████████▎ | 308555/371472 [2:23:18<5:38:37,  3.10it/s]
 83%|████████▎ | 308556/371472 [2:23:18<5:26:23,  3.21it/s]
 83%|████████▎ | 308557/371472 [2:23:18<5:28:05,  3.20it/s]
 83%|████████▎ | 308558/371472 [2:23:18<5:09:14,  3.39it/s]
 83%|████████▎ | 308559/371472 [2:23:19<5:01:32,  3.48it/s]
 83%|████████▎ | 308560/371472 [2:23:19<4:59:36,  3.50it/s]
                                                           
{'loss': 2.7502, 'learning_rate': 2.525049020664095e-07, 'epoch': 13.29}

 83%|████████▎ | 308560/371472 [2:23:19<4:59:36,  3.50it/s]
 83%|████████▎ | 308561/371472 [2:23:19<4:48:15,  3.64it/s]
 83%|████████▎ | 308562/371472 [2:23:19<4:35:44,  3.80it/s]
 83%|████████▎ | 308563/371472 [2:23:20<4:42:08,  3.72it/s]
 83%|████████▎ | 308564/371472 [2:23:20<4:59:20,  3.50it/s]
 83%|████████▎ | 308565/371472 [2:23:20<4:56:42,  3.53it/s]
 83%|████████▎ | 308566/371472 [2:23:21<4:59:33,  3.50it/s]
 83%|████████▎ | 308567/371472 [2:23:21<4:57:04,  3.53it/s]
 83%|████████▎ | 308568/371472 [2:23:21<4:54:20,  3.56it/s]
 83%|████████▎ | 308569/371472 [2:23:21<4:55:39,  3.55it/s]
 83%|████████▎ | 308570/371472 [2:23:22<5:05:48,  3.43it/s]
 83%|████████▎ | 308571/371472 [2:23:22<5:02:29,  3.47it/s]
 83%|████████▎ | 308572/371472 [2:23:22<5:01:40,  3.48it/s]
 83%|████████▎ | 308573/371472 [2:23:23<4:51:48,  3.59it/s]
 83%|████████▎ | 308574/371472 [2:23:23<4:54:15,  3.56it/s]
 83%|████████▎ | 308575/371472 [2:23:23<5:20:34,  3.27it/s]
 83%|████████▎ | 308576/371472 [2:23:24<5:26:15,  3.21it/s]
 83%|████████▎ | 308577/371472 [2:23:24<5:11:43,  3.36it/s]
 83%|████████▎ | 308578/371472 [2:23:24<5:09:16,  3.39it/s]
 83%|████████▎ | 308579/371472 [2:23:24<5:18:08,  3.29it/s]
 83%|████████▎ | 308580/371472 [2:23:25<5:05:35,  3.43it/s]
                                                           
{'loss': 2.5823, 'learning_rate': 2.524564200909306e-07, 'epoch': 13.29}

 83%|████████▎ | 308580/371472 [2:23:25<5:05:35,  3.43it/s]
 83%|████████▎ | 308581/371472 [2:23:25<4:57:53,  3.52it/s]
 83%|████████▎ | 308582/371472 [2:23:25<5:11:59,  3.36it/s]
 83%|████████▎ | 308583/371472 [2:23:26<5:10:24,  3.38it/s]
 83%|████████▎ | 308584/371472 [2:23:26<5:07:59,  3.40it/s]
 83%|████████▎ | 308585/371472 [2:23:26<4:52:57,  3.58it/s]
 83%|████████▎ | 308586/371472 [2:23:26<4:47:07,  3.65it/s]
 83%|████████▎ | 308587/371472 [2:23:27<4:48:21,  3.63it/s]
 83%|████████▎ | 308588/371472 [2:23:27<4:42:39,  3.71it/s]
 83%|████████▎ | 308589/371472 [2:23:27<5:08:06,  3.40it/s]
 83%|████████▎ | 308590/371472 [2:23:28<5:24:01,  3.23it/s]
 83%|████████▎ | 308591/371472 [2:23:28<5:08:27,  3.40it/s]
 83%|████████▎ | 308592/371472 [2:23:28<5:01:05,  3.48it/s]
 83%|████████▎ | 308593/371472 [2:23:28<4:44:46,  3.68it/s]
 83%|████████▎ | 308594/371472 [2:23:29<4:40:37,  3.73it/s]
 83%|████████▎ | 308595/371472 [2:23:29<5:01:47,  3.47it/s]
 83%|████████▎ | 308596/371472 [2:23:29<4:56:58,  3.53it/s]
 83%|████████▎ | 308597/371472 [2:23:29<4:52:28,  3.58it/s]
 83%|████████▎ | 308598/371472 [2:23:30<5:00:07,  3.49it/s]
 83%|████████▎ | 308599/371472 [2:23:30<4:59:07,  3.50it/s]
 83%|████████▎ | 308600/371472 [2:23:30<5:17:34,  3.30it/s]
                                                           
{'loss': 2.4266, 'learning_rate': 2.5240793811545176e-07, 'epoch': 13.29}

 83%|████████▎ | 308600/371472 [2:23:30<5:17:34,  3.30it/s]
 83%|████████▎ | 308601/371472 [2:23:31<5:02:11,  3.47it/s]
 83%|████████▎ | 308602/371472 [2:23:31<4:53:35,  3.57it/s]
 83%|████████▎ | 308603/371472 [2:23:31<4:53:37,  3.57it/s]
 83%|████████▎ | 308604/371472 [2:23:32<5:02:59,  3.46it/s]
 83%|████████▎ | 308605/371472 [2:23:32<5:03:04,  3.46it/s]
 83%|████████▎ | 308606/371472 [2:23:32<4:58:17,  3.51it/s]
 83%|████████▎ | 308607/371472 [2:23:32<4:54:49,  3.55it/s]
 83%|████████▎ | 308608/371472 [2:23:33<5:01:59,  3.47it/s]
 83%|████████▎ | 308609/371472 [2:23:33<4:52:44,  3.58it/s]
 83%|████████▎ | 308610/371472 [2:23:33<4:43:32,  3.69it/s]
 83%|████████▎ | 308611/371472 [2:23:33<4:36:40,  3.79it/s]
 83%|████████▎ | 308612/371472 [2:23:34<4:59:08,  3.50it/s]
 83%|████████▎ | 308613/371472 [2:23:34<4:56:40,  3.53it/s]
 83%|████████▎ | 308614/371472 [2:23:34<4:52:14,  3.58it/s]
 83%|████████▎ | 308615/371472 [2:23:35<4:44:39,  3.68it/s]
 83%|████████▎ | 308616/371472 [2:23:35<4:44:53,  3.68it/s]
 83%|████████▎ | 308617/371472 [2:23:35<4:51:39,  3.59it/s]
 83%|████████▎ | 308618/371472 [2:23:35<4:48:31,  3.63it/s]
 83%|████████▎ | 308619/371472 [2:23:36<4:49:31,  3.62it/s]
 83%|████████▎ | 308620/371472 [2:23:36<4:42:42,  3.71it/s]
                                                           
{'loss': 2.5653, 'learning_rate': 2.5235945613997283e-07, 'epoch': 13.29}

 83%|████████▎ | 308620/371472 [2:23:36<4:42:42,  3.71it/s]
 83%|████████▎ | 308621/371472 [2:23:36<4:53:53,  3.56it/s]
 83%|████████▎ | 308622/371472 [2:23:37<5:04:35,  3.44it/s]
 83%|████████▎ | 308623/371472 [2:23:37<4:45:32,  3.67it/s]
 83%|████████▎ | 308624/371472 [2:23:37<4:44:11,  3.69it/s]
 83%|████████▎ | 308625/371472 [2:23:37<4:34:59,  3.81it/s]
 83%|████████▎ | 308626/371472 [2:23:38<4:39:13,  3.75it/s]
 83%|████████▎ | 308627/371472 [2:23:38<4:31:51,  3.85it/s]
 83%|████████▎ | 308628/371472 [2:23:38<4:37:10,  3.78it/s]
 83%|████████▎ | 308629/371472 [2:23:38<4:42:50,  3.70it/s]
 83%|████████▎ | 308630/371472 [2:23:39<4:39:54,  3.74it/s]
 83%|████████▎ | 308631/371472 [2:23:39<4:36:51,  3.78it/s]
 83%|████████▎ | 308632/371472 [2:23:39<4:35:40,  3.80it/s]
 83%|████████▎ | 308633/371472 [2:23:39<4:54:20,  3.56it/s]
 83%|████████▎ | 308634/371472 [2:23:40<4:47:09,  3.65it/s]
 83%|████████▎ | 308635/371472 [2:23:40<4:54:12,  3.56it/s]
 83%|████████▎ | 308636/371472 [2:23:40<4:51:13,  3.60it/s]
 83%|████████▎ | 308637/371472 [2:23:41<4:51:44,  3.59it/s]
 83%|████████▎ | 308638/371472 [2:23:41<4:51:59,  3.59it/s]
 83%|████████▎ | 308639/371472 [2:23:41<5:02:14,  3.46it/s]
 83%|████████▎ | 308640/371472 [2:23:41<5:01:22,  3.47it/s]
                                                           
{'loss': 2.7127, 'learning_rate': 2.5231097416449396e-07, 'epoch': 13.29}

 83%|████████▎ | 308640/371472 [2:23:41<5:01:22,  3.47it/s]
 83%|████████▎ | 308641/371472 [2:23:42<4:51:14,  3.60it/s]
 83%|████████▎ | 308642/371472 [2:23:42<4:49:57,  3.61it/s]
 83%|████████▎ | 308643/371472 [2:23:42<4:42:10,  3.71it/s]
 83%|████████▎ | 308644/371472 [2:23:42<4:33:43,  3.83it/s]
 83%|████████▎ | 308645/371472 [2:23:43<4:36:58,  3.78it/s]
 83%|████████▎ | 308646/371472 [2:23:43<4:58:24,  3.51it/s]
 83%|████████▎ | 308647/371472 [2:23:43<4:51:17,  3.59it/s]
 83%|████████▎ | 308648/371472 [2:23:44<5:00:31,  3.48it/s]
 83%|████████▎ | 308649/371472 [2:23:44<4:47:37,  3.64it/s]
 83%|████████▎ | 308650/371472 [2:23:44<4:46:04,  3.66it/s]
 83%|████████▎ | 308651/371472 [2:23:44<4:37:57,  3.77it/s]
 83%|████████▎ | 308652/371472 [2:23:45<4:46:17,  3.66it/s]
 83%|████████▎ | 308653/371472 [2:23:45<4:50:35,  3.60it/s]
 83%|████████▎ | 308654/371472 [2:23:45<4:42:53,  3.70it/s]
 83%|████████▎ | 308655/371472 [2:23:46<4:43:59,  3.69it/s]
 83%|████████▎ | 308656/371472 [2:23:46<4:36:11,  3.79it/s]
 83%|████████▎ | 308657/371472 [2:23:46<4:48:30,  3.63it/s]
 83%|████████▎ | 308658/371472 [2:23:46<4:45:36,  3.67it/s]
 83%|████████▎ | 308659/371472 [2:23:47<4:35:21,  3.80it/s]
 83%|████████▎ | 308660/371472 [2:23:47<4:35:02,  3.81it/s]
                                                           
{'loss': 2.5315, 'learning_rate': 2.5226249218901503e-07, 'epoch': 13.29}

 83%|████████▎ | 308660/371472 [2:23:47<4:35:02,  3.81it/s]
 83%|████████▎ | 308661/371472 [2:23:47<4:44:08,  3.68it/s]
 83%|████████▎ | 308662/371472 [2:23:47<4:46:30,  3.65it/s]
 83%|████████▎ | 308663/371472 [2:23:48<4:39:52,  3.74it/s]
 83%|████████▎ | 308664/371472 [2:23:48<4:31:03,  3.86it/s]
 83%|████████▎ | 308665/371472 [2:23:48<4:41:02,  3.72it/s]
 83%|████████▎ | 308666/371472 [2:23:48<4:39:17,  3.75it/s]
 83%|████████▎ | 308667/371472 [2:23:49<4:37:19,  3.77it/s]
 83%|████████▎ | 308668/371472 [2:23:49<4:35:27,  3.80it/s]
 83%|████████▎ | 308669/371472 [2:23:49<4:33:16,  3.83it/s]
 83%|████████▎ | 308670/371472 [2:23:50<4:42:41,  3.70it/s]
 83%|████████▎ | 308671/371472 [2:23:50<4:52:43,  3.58it/s]
 83%|████████▎ | 308672/371472 [2:23:50<4:44:50,  3.67it/s]
 83%|████████▎ | 308673/371472 [2:23:50<4:48:59,  3.62it/s]
 83%|████████▎ | 308674/371472 [2:23:51<4:49:20,  3.62it/s]
 83%|████████▎ | 308675/371472 [2:23:51<4:48:06,  3.63it/s]
 83%|████████▎ | 308676/371472 [2:23:51<5:23:16,  3.24it/s]
 83%|████████▎ | 308677/371472 [2:23:52<4:56:45,  3.53it/s]
 83%|████████▎ | 308678/371472 [2:23:52<4:49:56,  3.61it/s]
 83%|████████▎ | 308679/371472 [2:23:52<4:49:09,  3.62it/s]
 83%|████████▎ | 308680/371472 [2:23:52<4:40:36,  3.73it/s]
                                                           
{'loss': 2.6033, 'learning_rate': 2.5221401021353615e-07, 'epoch': 13.3}

 83%|████████▎ | 308680/371472 [2:23:52<4:40:36,  3.73it/s]
 83%|████████▎ | 308681/371472 [2:23:53<4:35:28,  3.80it/s]
 83%|████████▎ | 308682/371472 [2:23:53<5:00:06,  3.49it/s]
 83%|████████▎ | 308683/371472 [2:23:53<4:50:02,  3.61it/s]
 83%|████████▎ | 308684/371472 [2:23:53<4:48:49,  3.62it/s]
 83%|████████▎ | 308685/371472 [2:23:54<4:47:56,  3.63it/s]
 83%|████████▎ | 308686/371472 [2:23:54<4:48:24,  3.63it/s]
 83%|████████▎ | 308687/371472 [2:23:54<4:45:49,  3.66it/s]
 83%|████████▎ | 308688/371472 [2:23:55<5:22:11,  3.25it/s]
 83%|████████▎ | 308689/371472 [2:23:55<5:07:40,  3.40it/s]
 83%|████████▎ | 308690/371472 [2:23:55<4:59:52,  3.49it/s]
 83%|████████▎ | 308691/371472 [2:23:55<5:08:17,  3.39it/s]
 83%|████████▎ | 308692/371472 [2:23:56<5:26:04,  3.21it/s]
 83%|████████▎ | 308693/371472 [2:23:56<5:06:52,  3.41it/s]
 83%|████████▎ | 308694/371472 [2:23:57<5:43:13,  3.05it/s]
 83%|████████▎ | 308695/371472 [2:23:57<5:33:55,  3.13it/s]
 83%|████████▎ | 308696/371472 [2:23:57<5:32:23,  3.15it/s]
 83%|████████▎ | 308697/371472 [2:23:57<5:19:34,  3.27it/s]
 83%|████████▎ | 308698/371472 [2:23:58<5:05:00,  3.43it/s]
 83%|████████▎ | 308699/371472 [2:23:58<4:52:09,  3.58it/s]
 83%|████████▎ | 308700/371472 [2:23:58<4:50:25,  3.60it/s]
                                                           
{'loss': 2.5222, 'learning_rate': 2.521655282380572e-07, 'epoch': 13.3}

 83%|████████▎ | 308700/371472 [2:23:58<4:50:25,  3.60it/s]
 83%|████████▎ | 308701/371472 [2:23:58<4:43:35,  3.69it/s]
 83%|████████▎ | 308702/371472 [2:23:59<4:32:08,  3.84it/s]
 83%|████████▎ | 308703/371472 [2:23:59<4:24:25,  3.96it/s]
 83%|████████▎ | 308704/371472 [2:23:59<4:31:27,  3.85it/s]
 83%|████████▎ | 308705/371472 [2:23:59<4:33:38,  3.82it/s]
 83%|████████▎ | 308706/371472 [2:24:00<4:45:14,  3.67it/s]
 83%|████████▎ | 308707/371472 [2:24:00<5:00:47,  3.48it/s]
 83%|████████▎ | 308708/371472 [2:24:00<4:47:04,  3.64it/s]
 83%|████████▎ | 308709/371472 [2:24:01<4:38:40,  3.75it/s]
 83%|████████▎ | 308710/371472 [2:24:01<4:44:49,  3.67it/s]
 83%|████████▎ | 308711/371472 [2:24:01<5:00:41,  3.48it/s]
 83%|████████▎ | 308712/371472 [2:24:01<4:54:02,  3.56it/s]
 83%|████████▎ | 308713/371472 [2:24:02<4:44:14,  3.68it/s]
 83%|████████▎ | 308714/371472 [2:24:02<4:44:44,  3.67it/s]
 83%|████████▎ | 308715/371472 [2:24:02<4:46:24,  3.65it/s]
 83%|████████▎ | 308716/371472 [2:24:03<4:45:27,  3.66it/s]
 83%|████████▎ | 308717/371472 [2:24:03<4:39:50,  3.74it/s]
 83%|████████▎ | 308718/371472 [2:24:03<4:43:35,  3.69it/s]
 83%|████████▎ | 308719/371472 [2:24:03<4:37:15,  3.77it/s]
 83%|████████▎ | 308720/371472 [2:24:04<4:52:37,  3.57it/s]
                                                           
{'loss': 2.5947, 'learning_rate': 2.521170462625784e-07, 'epoch': 13.3}

 83%|████████▎ | 308720/371472 [2:24:04<4:52:37,  3.57it/s]
 83%|████████▎ | 308721/371472 [2:24:04<4:45:23,  3.66it/s]
 83%|████████▎ | 308722/371472 [2:24:04<4:42:37,  3.70it/s]
 83%|████████▎ | 308723/371472 [2:24:04<4:38:46,  3.75it/s]
 83%|████████▎ | 308724/371472 [2:24:05<5:01:33,  3.47it/s]
 83%|████████▎ | 308725/371472 [2:24:05<4:55:00,  3.54it/s]
 83%|████████▎ | 308726/371472 [2:24:05<4:57:48,  3.51it/s]
 83%|████████▎ | 308727/371472 [2:24:06<4:57:11,  3.52it/s]
 83%|████████▎ | 308728/371472 [2:24:06<4:47:26,  3.64it/s]
 83%|████████▎ | 308729/371472 [2:24:06<4:44:40,  3.67it/s]
 83%|████████▎ | 308730/371472 [2:24:06<4:54:16,  3.55it/s]
 83%|████████▎ | 308731/371472 [2:24:07<4:53:09,  3.57it/s]
 83%|████████▎ | 308732/371472 [2:24:07<4:50:42,  3.60it/s]
 83%|████████▎ | 308733/371472 [2:24:07<4:40:59,  3.72it/s]
 83%|████████▎ | 308734/371472 [2:24:07<4:38:34,  3.75it/s]
 83%|████████▎ | 308735/371472 [2:24:08<4:56:41,  3.52it/s]
 83%|████████▎ | 308736/371472 [2:24:08<5:14:14,  3.33it/s]
 83%|████████▎ | 308737/371472 [2:24:08<5:00:48,  3.48it/s]
 83%|████████▎ | 308738/371472 [2:24:09<4:55:26,  3.54it/s]
 83%|████████▎ | 308739/371472 [2:24:09<5:02:30,  3.46it/s]
 83%|████████▎ | 308740/371472 [2:24:09<4:52:59,  3.57it/s]
                                                           
{'loss': 2.5283, 'learning_rate': 2.520685642870995e-07, 'epoch': 13.3}

 83%|████████▎ | 308740/371472 [2:24:09<4:52:59,  3.57it/s]
 83%|████████▎ | 308741/371472 [2:24:09<4:54:53,  3.55it/s]
 83%|████████▎ | 308742/371472 [2:24:10<4:48:58,  3.62it/s]
 83%|████████▎ | 308743/371472 [2:24:10<4:58:58,  3.50it/s]
 83%|████████▎ | 308744/371472 [2:24:10<4:53:39,  3.56it/s]
 83%|████████▎ | 308745/371472 [2:24:11<4:40:25,  3.73it/s]
 83%|████████▎ | 308746/371472 [2:24:11<5:03:45,  3.44it/s]
 83%|████████▎ | 308747/371472 [2:24:11<4:56:50,  3.52it/s]
 83%|████████▎ | 308748/371472 [2:24:11<4:58:23,  3.50it/s]
 83%|████████▎ | 308749/371472 [2:24:12<4:54:34,  3.55it/s]
 83%|████████▎ | 308750/371472 [2:24:12<5:20:48,  3.26it/s]
 83%|████████▎ | 308751/371472 [2:24:12<5:03:49,  3.44it/s]
 83%|████████▎ | 308752/371472 [2:24:13<4:50:43,  3.60it/s]
 83%|████████▎ | 308753/371472 [2:24:13<5:01:38,  3.47it/s]
 83%|████████▎ | 308754/371472 [2:24:13<5:02:12,  3.46it/s]
 83%|████████▎ | 308755/371472 [2:24:13<4:47:49,  3.63it/s]
 83%|████████▎ | 308756/371472 [2:24:14<4:46:57,  3.64it/s]
 83%|████████▎ | 308757/371472 [2:24:14<4:46:38,  3.65it/s]
 83%|████████▎ | 308758/371472 [2:24:14<5:05:18,  3.42it/s]
 83%|████████▎ | 308759/371472 [2:24:15<5:22:07,  3.24it/s]
 83%|████████▎ | 308760/371472 [2:24:15<5:10:17,  3.37it/s]
                                                           
{'loss': 2.7919, 'learning_rate': 2.5202008231162065e-07, 'epoch': 13.3}

 83%|████████▎ | 308760/371472 [2:24:15<5:10:17,  3.37it/s]
 83%|████████▎ | 308761/371472 [2:24:15<4:55:59,  3.53it/s]
 83%|████████▎ | 308762/371472 [2:24:15<4:41:46,  3.71it/s]
 83%|████████▎ | 308763/371472 [2:24:16<4:36:04,  3.79it/s]
 83%|████████▎ | 308764/371472 [2:24:16<4:37:58,  3.76it/s]
 83%|████████▎ | 308765/371472 [2:24:16<4:36:09,  3.78it/s]
 83%|████████▎ | 308766/371472 [2:24:16<4:35:17,  3.80it/s]
 83%|████████▎ | 308767/371472 [2:24:17<4:31:52,  3.84it/s]
 83%|████████▎ | 308768/371472 [2:24:17<4:29:00,  3.88it/s]
 83%|████████▎ | 308769/371472 [2:24:17<4:51:13,  3.59it/s]
 83%|████████▎ | 308770/371472 [2:24:18<4:48:32,  3.62it/s]
 83%|████████▎ | 308771/371472 [2:24:18<4:39:26,  3.74it/s]
 83%|████████▎ | 308772/371472 [2:24:18<5:20:29,  3.26it/s]
 83%|████████▎ | 308773/371472 [2:24:19<5:17:42,  3.29it/s]
 83%|████████▎ | 308774/371472 [2:24:19<5:04:01,  3.44it/s]
 83%|████████▎ | 308775/371472 [2:24:19<5:07:07,  3.40it/s]
 83%|████████▎ | 308776/371472 [2:24:20<5:45:19,  3.03it/s]
 83%|████████▎ | 308777/371472 [2:24:20<5:17:07,  3.30it/s]
 83%|████████▎ | 308778/371472 [2:24:20<5:00:25,  3.48it/s]
 83%|████████▎ | 308779/371472 [2:24:20<4:49:20,  3.61it/s]
 83%|████████▎ | 308780/371472 [2:24:20<4:41:14,  3.72it/s]
                                                           
{'loss': 2.5789, 'learning_rate': 2.5197160033614167e-07, 'epoch': 13.3}

 83%|████████▎ | 308780/371472 [2:24:20<4:41:14,  3.72it/s]
 83%|████████▎ | 308781/371472 [2:24:21<4:43:03,  3.69it/s]
 83%|████████▎ | 308782/371472 [2:24:21<4:54:00,  3.55it/s]
 83%|████████▎ | 308783/371472 [2:24:21<4:52:50,  3.57it/s]
 83%|████████▎ | 308784/371472 [2:24:22<4:46:09,  3.65it/s]
 83%|████████▎ | 308785/371472 [2:24:22<4:35:45,  3.79it/s]
 83%|████████▎ | 308786/371472 [2:24:22<4:35:39,  3.79it/s]
 83%|████████▎ | 308787/371472 [2:24:22<4:45:45,  3.66it/s]
 83%|████████▎ | 308788/371472 [2:24:23<4:35:39,  3.79it/s]
 83%|████████▎ | 308789/371472 [2:24:23<5:05:30,  3.42it/s]
 83%|████████▎ | 308790/371472 [2:24:23<4:58:55,  3.49it/s]
 83%|████████▎ | 308791/371472 [2:24:24<5:05:59,  3.41it/s]
 83%|████████▎ | 308792/371472 [2:24:24<4:56:26,  3.52it/s]
 83%|████████▎ | 308793/371472 [2:24:24<4:56:54,  3.52it/s]
 83%|████████▎ | 308794/371472 [2:24:24<5:00:04,  3.48it/s]
 83%|████████▎ | 308795/371472 [2:24:25<4:50:04,  3.60it/s]
 83%|████████▎ | 308796/371472 [2:24:25<4:42:06,  3.70it/s]
 83%|████████▎ | 308797/371472 [2:24:25<4:50:30,  3.60it/s]
 83%|████████▎ | 308798/371472 [2:24:26<4:45:41,  3.66it/s]
 83%|████████▎ | 308799/371472 [2:24:26<4:41:24,  3.71it/s]
 83%|████████▎ | 308800/371472 [2:24:26<4:40:22,  3.73it/s]
                                                           
{'loss': 2.55, 'learning_rate': 2.5192311836066285e-07, 'epoch': 13.3}

 83%|████████▎ | 308800/371472 [2:24:26<4:40:22,  3.73it/s]
 83%|████████▎ | 308801/371472 [2:24:26<4:58:51,  3.50it/s]
 83%|████████▎ | 308802/371472 [2:24:27<5:10:47,  3.36it/s]
 83%|████████▎ | 308803/371472 [2:24:27<4:55:25,  3.54it/s]
 83%|████████▎ | 308804/371472 [2:24:27<5:23:33,  3.23it/s]
 83%|████████▎ | 308805/371472 [2:24:28<5:33:54,  3.13it/s]
 83%|████████▎ | 308806/371472 [2:24:28<5:23:43,  3.23it/s]
 83%|████████▎ | 308807/371472 [2:24:28<5:06:14,  3.41it/s]
 83%|████████▎ | 308808/371472 [2:24:29<5:29:07,  3.17it/s]
 83%|████████▎ | 308809/371472 [2:24:29<5:22:06,  3.24it/s]
 83%|████████▎ | 308810/371472 [2:24:29<5:07:20,  3.40it/s]
 83%|████████▎ | 308811/371472 [2:24:29<4:50:51,  3.59it/s]
 83%|████████▎ | 308812/371472 [2:24:30<4:50:19,  3.60it/s]
 83%|████████▎ | 308813/371472 [2:24:30<4:47:36,  3.63it/s]
 83%|████████▎ | 308814/371472 [2:24:30<4:44:37,  3.67it/s]
 83%|████████▎ | 308815/371472 [2:24:30<4:42:04,  3.70it/s]
 83%|████████▎ | 308816/371472 [2:24:31<4:37:17,  3.77it/s]
 83%|████████▎ | 308817/371472 [2:24:31<4:40:15,  3.73it/s]
 83%|████████▎ | 308818/371472 [2:24:31<4:36:58,  3.77it/s]
 83%|████████▎ | 308819/371472 [2:24:32<4:46:54,  3.64it/s]
 83%|████████▎ | 308820/371472 [2:24:32<5:03:22,  3.44it/s]
                                                           
{'loss': 2.6373, 'learning_rate': 2.5187463638518387e-07, 'epoch': 13.3}

 83%|████████▎ | 308820/371472 [2:24:32<5:03:22,  3.44it/s]
 83%|████████▎ | 308821/371472 [2:24:32<5:19:37,  3.27it/s]
 83%|████████▎ | 308822/371472 [2:24:32<5:14:28,  3.32it/s]
 83%|████████▎ | 308823/371472 [2:24:33<5:12:01,  3.35it/s]
 83%|████████▎ | 308824/371472 [2:24:33<5:05:15,  3.42it/s]
 83%|████████▎ | 308825/371472 [2:24:33<4:53:38,  3.56it/s]
 83%|████████▎ | 308826/371472 [2:24:34<5:07:04,  3.40it/s]
 83%|████████▎ | 308827/371472 [2:24:34<4:59:38,  3.48it/s]
 83%|████████▎ | 308828/371472 [2:24:34<4:57:38,  3.51it/s]
 83%|████████▎ | 308829/371472 [2:24:34<4:59:13,  3.49it/s]
 83%|████████▎ | 308830/371472 [2:24:35<4:51:19,  3.58it/s]
 83%|████████▎ | 308831/371472 [2:24:35<4:44:34,  3.67it/s]
 83%|████████▎ | 308832/371472 [2:24:35<4:50:13,  3.60it/s]
 83%|████████▎ | 308833/371472 [2:24:36<4:53:42,  3.55it/s]
 83%|████████▎ | 308834/371472 [2:24:36<5:08:08,  3.39it/s]
 83%|████████▎ | 308835/371472 [2:24:36<5:11:20,  3.35it/s]
 83%|████████▎ | 308836/371472 [2:24:36<5:02:29,  3.45it/s]
 83%|████████▎ | 308837/371472 [2:24:37<5:21:17,  3.25it/s]
 83%|████████▎ | 308838/371472 [2:24:37<5:13:01,  3.33it/s]
 83%|████████▎ | 308839/371472 [2:24:37<4:55:04,  3.54it/s]
 83%|████████▎ | 308840/371472 [2:24:38<4:45:15,  3.66it/s]
                                                           
{'loss': 2.5767, 'learning_rate': 2.5182615440970504e-07, 'epoch': 13.3}

 83%|████████▎ | 308840/371472 [2:24:38<4:45:15,  3.66it/s]
 83%|████████▎ | 308841/371472 [2:24:38<4:36:53,  3.77it/s]
 83%|████████▎ | 308842/371472 [2:24:38<4:49:20,  3.61it/s]
 83%|████████▎ | 308843/371472 [2:24:38<4:42:48,  3.69it/s]
 83%|████████▎ | 308844/371472 [2:24:39<5:21:44,  3.24it/s]
 83%|████████▎ | 308845/371472 [2:24:39<5:00:30,  3.47it/s]
 83%|████████▎ | 308846/371472 [2:24:39<5:12:13,  3.34it/s]
 83%|████████▎ | 308847/371472 [2:24:40<4:55:04,  3.54it/s]
 83%|████████▎ | 308848/371472 [2:24:40<4:52:03,  3.57it/s]
 83%|████████▎ | 308849/371472 [2:24:40<4:52:46,  3.56it/s]
 83%|████████▎ | 308850/371472 [2:24:40<4:59:47,  3.48it/s]
 83%|████████▎ | 308851/371472 [2:24:41<4:52:35,  3.57it/s]
 83%|████████▎ | 308852/371472 [2:24:41<5:02:42,  3.45it/s]
 83%|████████▎ | 308853/371472 [2:24:41<4:47:30,  3.63it/s]
 83%|████████▎ | 308854/371472 [2:24:42<4:41:51,  3.70it/s]
 83%|████████▎ | 308855/371472 [2:24:42<4:50:25,  3.59it/s]
 83%|████████▎ | 308856/371472 [2:24:42<4:45:18,  3.66it/s]
 83%|████████▎ | 308857/371472 [2:24:42<4:49:22,  3.61it/s]
 83%|████████▎ | 308858/371472 [2:24:43<4:44:11,  3.67it/s]
 83%|████████▎ | 308859/371472 [2:24:43<4:41:55,  3.70it/s]
 83%|████████▎ | 308860/371472 [2:24:43<4:42:57,  3.69it/s]
                                                           
{'loss': 2.602, 'learning_rate': 2.517776724342261e-07, 'epoch': 13.3}

 83%|████████▎ | 308860/371472 [2:24:43<4:42:57,  3.69it/s]
 83%|████████▎ | 308861/371472 [2:24:43<4:38:13,  3.75it/s]
 83%|████████▎ | 308862/371472 [2:24:44<4:34:58,  3.79it/s]
 83%|████████▎ | 308863/371472 [2:24:44<4:35:43,  3.78it/s]
 83%|████████▎ | 308864/371472 [2:24:44<4:28:35,  3.88it/s]
 83%|████████▎ | 308865/371472 [2:24:44<4:27:05,  3.91it/s]
 83%|████████▎ | 308866/371472 [2:24:45<4:28:44,  3.88it/s]
 83%|████████▎ | 308867/371472 [2:24:45<4:52:03,  3.57it/s]
 83%|████████▎ | 308868/371472 [2:24:45<4:49:14,  3.61it/s]
 83%|████████▎ | 308869/371472 [2:24:46<4:40:12,  3.72it/s]
 83%|████████▎ | 308870/371472 [2:24:46<4:51:31,  3.58it/s]
 83%|████████▎ | 308871/371472 [2:24:46<5:02:08,  3.45it/s]
 83%|████████▎ | 308872/371472 [2:24:46<4:49:43,  3.60it/s]
 83%|████████▎ | 308873/371472 [2:24:47<4:51:20,  3.58it/s]
 83%|████████▎ | 308874/371472 [2:24:47<4:43:25,  3.68it/s]
 83%|████████▎ | 308875/371472 [2:24:47<4:43:29,  3.68it/s]
 83%|████████▎ | 308876/371472 [2:24:47<4:31:25,  3.84it/s]
 83%|████████▎ | 308877/371472 [2:24:48<4:25:32,  3.93it/s]
 83%|████████▎ | 308878/371472 [2:24:48<4:52:30,  3.57it/s]
 83%|████████▎ | 308879/371472 [2:24:48<4:57:33,  3.51it/s]
 83%|████████▎ | 308880/371472 [2:24:49<4:55:51,  3.53it/s]
                                                           
{'loss': 2.6467, 'learning_rate': 2.517291904587472e-07, 'epoch': 13.3}

 83%|████████▎ | 308880/371472 [2:24:49<4:55:51,  3.53it/s]
 83%|████████▎ | 308881/371472 [2:24:49<4:58:36,  3.49it/s]
 83%|████████▎ | 308882/371472 [2:24:49<4:52:31,  3.57it/s]
 83%|████████▎ | 308883/371472 [2:24:49<4:55:41,  3.53it/s]
 83%|████████▎ | 308884/371472 [2:24:50<4:56:12,  3.52it/s]
 83%|████████▎ | 308885/371472 [2:24:50<4:47:39,  3.63it/s]
 83%|████████▎ | 308886/371472 [2:24:50<4:39:25,  3.73it/s]
 83%|████████▎ | 308887/371472 [2:24:51<4:35:25,  3.79it/s]
 83%|████████▎ | 308888/371472 [2:24:51<4:30:46,  3.85it/s]
 83%|████████▎ | 308889/371472 [2:24:51<4:33:05,  3.82it/s]
 83%|████████▎ | 308890/371472 [2:24:51<5:00:05,  3.48it/s]
 83%|████████▎ | 308891/371472 [2:24:52<4:55:20,  3.53it/s]
 83%|████████▎ | 308892/371472 [2:24:52<5:08:57,  3.38it/s]
 83%|████████▎ | 308893/371472 [2:24:52<5:13:30,  3.33it/s]
 83%|████████▎ | 308894/371472 [2:24:53<5:04:23,  3.43it/s]
 83%|████████▎ | 308895/371472 [2:24:53<4:57:52,  3.50it/s]
 83%|████████▎ | 308896/371472 [2:24:53<4:50:43,  3.59it/s]
 83%|████████▎ | 308897/371472 [2:24:53<4:43:18,  3.68it/s]
 83%|████████▎ | 308898/371472 [2:24:54<4:39:55,  3.73it/s]
 83%|████████▎ | 308899/371472 [2:24:54<4:31:41,  3.84it/s]
 83%|████████▎ | 308900/371472 [2:24:54<4:29:39,  3.87it/s]
                                                           
{'loss': 2.6796, 'learning_rate': 2.516807084832683e-07, 'epoch': 13.3}

 83%|████████▎ | 308900/371472 [2:24:54<4:29:39,  3.87it/s]
 83%|████████▎ | 308901/371472 [2:24:55<5:17:26,  3.29it/s]
 83%|████████▎ | 308902/371472 [2:24:55<5:06:39,  3.40it/s]
 83%|████████▎ | 308903/371472 [2:24:55<5:16:39,  3.29it/s]
 83%|████████▎ | 308904/371472 [2:24:55<5:08:30,  3.38it/s]
 83%|████████▎ | 308905/371472 [2:24:56<5:05:55,  3.41it/s]
 83%|████████▎ | 308906/371472 [2:24:56<5:12:49,  3.33it/s]
 83%|████████▎ | 308907/371472 [2:24:56<5:14:32,  3.32it/s]
 83%|████████▎ | 308908/371472 [2:24:57<5:12:49,  3.33it/s]
 83%|████████▎ | 308909/371472 [2:24:57<5:06:53,  3.40it/s]
 83%|████████▎ | 308910/371472 [2:24:57<4:51:09,  3.58it/s]
 83%|████████▎ | 308911/371472 [2:24:57<4:44:07,  3.67it/s]
 83%|████████▎ | 308912/371472 [2:24:58<4:36:27,  3.77it/s]
 83%|████████▎ | 308913/371472 [2:24:58<4:54:17,  3.54it/s]
 83%|████████▎ | 308914/371472 [2:24:58<4:52:16,  3.57it/s]
 83%|████████▎ | 308915/371472 [2:24:58<4:44:05,  3.67it/s]
 83%|████████▎ | 308916/371472 [2:24:59<4:40:39,  3.71it/s]
 83%|████████▎ | 308917/371472 [2:24:59<4:38:48,  3.74it/s]
 83%|████████▎ | 308918/371472 [2:24:59<4:33:26,  3.81it/s]
 83%|████████▎ | 308919/371472 [2:25:00<4:36:16,  3.77it/s]
 83%|████████▎ | 308920/371472 [2:25:00<4:45:10,  3.66it/s]
                                                           
{'loss': 2.4592, 'learning_rate': 2.516322265077894e-07, 'epoch': 13.31}

 83%|████████▎ | 308920/371472 [2:25:00<4:45:10,  3.66it/s]
 83%|████████▎ | 308921/371472 [2:25:00<4:51:47,  3.57it/s]
 83%|████████▎ | 308922/371472 [2:25:00<4:49:26,  3.60it/s]
 83%|████████▎ | 308923/371472 [2:25:01<4:44:25,  3.67it/s]
 83%|████████▎ | 308924/371472 [2:25:01<4:55:54,  3.52it/s]
 83%|████████▎ | 308925/371472 [2:25:01<5:02:35,  3.45it/s]
 83%|████████▎ | 308926/371472 [2:25:02<4:55:30,  3.53it/s]
 83%|████████▎ | 308927/371472 [2:25:02<5:12:23,  3.34it/s]
 83%|████████▎ | 308928/371472 [2:25:02<5:34:21,  3.12it/s]
 83%|████████▎ | 308929/371472 [2:25:03<5:16:26,  3.29it/s]
 83%|████████▎ | 308930/371472 [2:25:03<5:00:42,  3.47it/s]
 83%|████████▎ | 308931/371472 [2:25:03<4:53:09,  3.56it/s]
 83%|████████▎ | 308932/371472 [2:25:03<4:58:15,  3.49it/s]
 83%|████████▎ | 308933/371472 [2:25:04<4:50:05,  3.59it/s]
 83%|████████▎ | 308934/371472 [2:25:04<5:00:07,  3.47it/s]
 83%|████████▎ | 308935/371472 [2:25:04<4:47:27,  3.63it/s]
 83%|████████▎ | 308936/371472 [2:25:04<4:51:11,  3.58it/s]
 83%|████████▎ | 308937/371472 [2:25:05<4:49:15,  3.60it/s]
 83%|████████▎ | 308938/371472 [2:25:05<4:46:33,  3.64it/s]
 83%|████████▎ | 308939/371472 [2:25:05<4:42:34,  3.69it/s]
 83%|████████▎ | 308940/371472 [2:25:05<4:37:16,  3.76it/s]
                                                           
{'loss': 2.5789, 'learning_rate': 2.515837445323105e-07, 'epoch': 13.31}

 83%|████████▎ | 308940/371472 [2:25:05<4:37:16,  3.76it/s]
 83%|████████▎ | 308941/371472 [2:25:06<4:26:44,  3.91it/s]
 83%|████████▎ | 308942/371472 [2:25:06<4:31:35,  3.84it/s]
 83%|████████▎ | 308943/371472 [2:25:06<4:49:51,  3.60it/s]
 83%|████████▎ | 308944/371472 [2:25:07<4:42:43,  3.69it/s]
 83%|████████▎ | 308945/371472 [2:25:07<4:35:16,  3.79it/s]
 83%|████████▎ | 308946/371472 [2:25:07<4:49:10,  3.60it/s]
 83%|████████▎ | 308947/371472 [2:25:07<4:52:08,  3.57it/s]
 83%|████████▎ | 308948/371472 [2:25:08<4:47:45,  3.62it/s]
 83%|████████▎ | 308949/371472 [2:25:08<4:45:47,  3.65it/s]
 83%|████████▎ | 308950/371472 [2:25:08<4:51:48,  3.57it/s]
 83%|████████▎ | 308951/371472 [2:25:08<4:43:02,  3.68it/s]
 83%|████████▎ | 308952/371472 [2:25:09<4:38:43,  3.74it/s]
 83%|████████▎ | 308953/371472 [2:25:09<4:55:19,  3.53it/s]
 83%|████████▎ | 308954/371472 [2:25:09<4:44:20,  3.66it/s]
 83%|████████▎ | 308955/371472 [2:25:10<4:39:22,  3.73it/s]
 83%|████████▎ | 308956/371472 [2:25:10<4:33:57,  3.80it/s]
 83%|████████▎ | 308957/371472 [2:25:10<5:07:00,  3.39it/s]
 83%|████████▎ | 308958/371472 [2:25:10<4:52:25,  3.56it/s]
 83%|████████▎ | 308959/371472 [2:25:11<4:53:14,  3.55it/s]
 83%|████████▎ | 308960/371472 [2:25:11<5:07:33,  3.39it/s]
                                                           
{'loss': 2.5778, 'learning_rate': 2.515352625568315e-07, 'epoch': 13.31}

 83%|████████▎ | 308960/371472 [2:25:11<5:07:33,  3.39it/s]
 83%|████████▎ | 308961/371472 [2:25:11<5:02:41,  3.44it/s]
 83%|████████▎ | 308962/371472 [2:25:12<4:47:25,  3.62it/s]
 83%|████████▎ | 308963/371472 [2:25:12<4:41:51,  3.70it/s]
 83%|████████▎ | 308964/371472 [2:25:12<4:50:03,  3.59it/s]
 83%|████████▎ | 308965/371472 [2:25:12<4:36:59,  3.76it/s]
 83%|████████▎ | 308966/371472 [2:25:13<4:31:34,  3.84it/s]
 83%|████████▎ | 308967/371472 [2:25:13<4:33:24,  3.81it/s]
 83%|████████▎ | 308968/371472 [2:25:13<4:30:25,  3.85it/s]
 83%|████████▎ | 308969/371472 [2:25:13<4:42:19,  3.69it/s]
 83%|████████▎ | 308970/371472 [2:25:14<4:46:14,  3.64it/s]
 83%|████████▎ | 308971/371472 [2:25:14<4:38:34,  3.74it/s]
 83%|████████▎ | 308972/371472 [2:25:14<4:32:51,  3.82it/s]
 83%|████████▎ | 308973/371472 [2:25:15<4:49:45,  3.59it/s]
 83%|████████▎ | 308974/371472 [2:25:15<5:07:37,  3.39it/s]
 83%|████████▎ | 308975/371472 [2:25:15<4:55:40,  3.52it/s]
 83%|████████▎ | 308976/371472 [2:25:15<4:49:27,  3.60it/s]
 83%|████████▎ | 308977/371472 [2:25:16<4:38:22,  3.74it/s]
 83%|████████▎ | 308978/371472 [2:25:16<4:47:24,  3.62it/s]
 83%|████████▎ | 308979/371472 [2:25:16<4:52:02,  3.57it/s]
 83%|████████▎ | 308980/371472 [2:25:16<4:40:07,  3.72it/s]
                                                           
{'loss': 2.6608, 'learning_rate': 2.5148678058135276e-07, 'epoch': 13.31}

 83%|████████▎ | 308980/371472 [2:25:16<4:40:07,  3.72it/s]
 83%|████████▎ | 308981/371472 [2:25:17<4:35:58,  3.77it/s]
 83%|████████▎ | 308982/371472 [2:25:17<4:26:46,  3.90it/s]
 83%|████████▎ | 308983/371472 [2:25:17<5:02:07,  3.45it/s]
 83%|████████▎ | 308984/371472 [2:25:18<5:17:33,  3.28it/s]
 83%|████████▎ | 308985/371472 [2:25:18<5:05:37,  3.41it/s]
 83%|████████▎ | 308986/371472 [2:25:18<5:18:28,  3.27it/s]
 83%|████████▎ | 308987/371472 [2:25:19<5:12:30,  3.33it/s]
 83%|████████▎ | 308988/371472 [2:25:19<4:56:16,  3.51it/s]
 83%|████████▎ | 308989/371472 [2:25:19<5:05:46,  3.41it/s]
 83%|████████▎ | 308990/371472 [2:25:19<5:03:49,  3.43it/s]
 83%|████████▎ | 308991/371472 [2:25:20<4:51:05,  3.58it/s]
 83%|████████▎ | 308992/371472 [2:25:20<4:58:26,  3.49it/s]
 83%|████████▎ | 308993/371472 [2:25:20<5:00:52,  3.46it/s]
 83%|████████▎ | 308994/371472 [2:25:21<5:01:03,  3.46it/s]
 83%|████████▎ | 308995/371472 [2:25:21<4:53:14,  3.55it/s]
 83%|████████▎ | 308996/371472 [2:25:21<4:57:33,  3.50it/s]
 83%|████████▎ | 308997/371472 [2:25:21<4:59:13,  3.48it/s]
 83%|████████▎ | 308998/371472 [2:25:22<4:59:03,  3.48it/s]
 83%|████████▎ | 308999/371472 [2:25:22<4:52:44,  3.56it/s]
 83%|████████▎ | 309000/371472 [2:25:22<4:55:01,  3.53it/s]
                                                           
{'loss': 2.6027, 'learning_rate': 2.5143829860587383e-07, 'epoch': 13.31}

 83%|████████▎ | 309000/371472 [2:25:22<4:55:01,  3.53it/s]
 83%|████████▎ | 309001/371472 [2:25:23<4:58:09,  3.49it/s]
 83%|████████▎ | 309002/371472 [2:25:23<5:07:23,  3.39it/s]
 83%|████████▎ | 309003/371472 [2:25:23<5:02:31,  3.44it/s]
 83%|████████▎ | 309004/371472 [2:25:23<5:15:25,  3.30it/s]
 83%|████████▎ | 309005/371472 [2:25:24<5:28:49,  3.17it/s]
 83%|████████▎ | 309006/371472 [2:25:24<5:25:31,  3.20it/s]
 83%|████████▎ | 309007/371472 [2:25:24<5:00:59,  3.46it/s]
 83%|████████▎ | 309008/371472 [2:25:25<5:27:14,  3.18it/s]
 83%|████████▎ | 309009/371472 [2:25:25<5:17:40,  3.28it/s]
 83%|████████▎ | 309010/371472 [2:25:25<5:08:37,  3.37it/s]
 83%|████████▎ | 309011/371472 [2:25:26<5:02:41,  3.44it/s]
 83%|████████▎ | 309012/371472 [2:25:26<4:58:23,  3.49it/s]
 83%|████████▎ | 309013/371472 [2:25:26<5:38:08,  3.08it/s]
 83%|████████▎ | 309014/371472 [2:25:26<5:16:22,  3.29it/s]
 83%|████████▎ | 309015/371472 [2:25:27<5:08:21,  3.38it/s]
 83%|████████▎ | 309016/371472 [2:25:27<4:57:45,  3.50it/s]
 83%|████████▎ | 309017/371472 [2:25:27<5:05:59,  3.40it/s]
 83%|████████▎ | 309018/371472 [2:25:28<5:07:00,  3.39it/s]
 83%|████████▎ | 309019/371472 [2:25:28<5:01:29,  3.45it/s]
 83%|████████▎ | 309020/371472 [2:25:28<4:51:02,  3.58it/s]
                                                           
{'loss': 2.6352, 'learning_rate': 2.51389816630395e-07, 'epoch': 13.31}

 83%|████████▎ | 309020/371472 [2:25:28<4:51:02,  3.58it/s]
 83%|████████▎ | 309021/371472 [2:25:28<4:50:48,  3.58it/s]
 83%|████████▎ | 309022/371472 [2:25:29<4:47:27,  3.62it/s]
 83%|████████▎ | 309023/371472 [2:25:29<4:47:09,  3.62it/s]
 83%|████████▎ | 309024/371472 [2:25:29<4:51:51,  3.57it/s]
 83%|████████▎ | 309025/371472 [2:25:30<5:07:00,  3.39it/s]
 83%|████████▎ | 309026/371472 [2:25:30<4:59:35,  3.47it/s]
 83%|████████▎ | 309027/371472 [2:25:30<5:27:16,  3.18it/s]
 83%|████████▎ | 309028/371472 [2:25:31<5:25:10,  3.20it/s]
 83%|████████▎ | 309029/371472 [2:25:31<5:34:10,  3.11it/s]
 83%|████████▎ | 309030/371472 [2:25:31<5:14:25,  3.31it/s]
 83%|████████▎ | 309031/371472 [2:25:32<5:25:20,  3.20it/s]
 83%|████████▎ | 309032/371472 [2:25:32<5:01:09,  3.46it/s]
 83%|████████▎ | 309033/371472 [2:25:32<5:04:23,  3.42it/s]
 83%|████████▎ | 309034/371472 [2:25:32<5:21:32,  3.24it/s]
 83%|████████▎ | 309035/371472 [2:25:33<5:24:12,  3.21it/s]
 83%|████████▎ | 309036/371472 [2:25:33<5:10:49,  3.35it/s]
 83%|████████▎ | 309037/371472 [2:25:33<5:03:22,  3.43it/s]
 83%|████████▎ | 309038/371472 [2:25:34<4:52:07,  3.56it/s]
 83%|████████▎ | 309039/371472 [2:25:34<4:49:12,  3.60it/s]
 83%|████████▎ | 309040/371472 [2:25:34<4:44:29,  3.66it/s]
                                                           
{'loss': 2.6092, 'learning_rate': 2.51341334654916e-07, 'epoch': 13.31}

 83%|████████▎ | 309040/371472 [2:25:34<4:44:29,  3.66it/s]
 83%|████████▎ | 309041/371472 [2:25:34<4:45:24,  3.65it/s]
 83%|████████▎ | 309042/371472 [2:25:35<4:46:03,  3.64it/s]
 83%|████████▎ | 309043/371472 [2:25:35<4:41:28,  3.70it/s]
 83%|████████▎ | 309044/371472 [2:25:35<4:57:02,  3.50it/s]
 83%|████████▎ | 309045/371472 [2:25:36<5:09:04,  3.37it/s]
 83%|████████▎ | 309046/371472 [2:25:36<5:14:53,  3.30it/s]
 83%|████████▎ | 309047/371472 [2:25:36<5:27:00,  3.18it/s]
 83%|████████▎ | 309048/371472 [2:25:36<5:32:33,  3.13it/s]
 83%|████████▎ | 309049/371472 [2:25:37<5:16:09,  3.29it/s]
 83%|████████▎ | 309050/371472 [2:25:37<4:59:58,  3.47it/s]
 83%|████████▎ | 309051/371472 [2:25:37<4:46:45,  3.63it/s]
 83%|████████▎ | 309052/371472 [2:25:38<4:44:45,  3.65it/s]
 83%|████████▎ | 309053/371472 [2:25:38<4:39:29,  3.72it/s]
 83%|████████▎ | 309054/371472 [2:25:38<4:35:26,  3.78it/s]
 83%|████████▎ | 309055/371472 [2:25:38<4:34:07,  3.80it/s]
 83%|████████▎ | 309056/371472 [2:25:39<4:41:54,  3.69it/s]
 83%|████████▎ | 309057/371472 [2:25:39<4:36:16,  3.77it/s]
 83%|████████▎ | 309058/371472 [2:25:39<4:45:45,  3.64it/s]
 83%|████████▎ | 309059/371472 [2:25:39<4:37:34,  3.75it/s]
 83%|████████▎ | 309060/371472 [2:25:40<4:50:15,  3.58it/s]
                                                           
{'loss': 2.6243, 'learning_rate': 2.5129285267943715e-07, 'epoch': 13.31}

 83%|████████▎ | 309060/371472 [2:25:40<4:50:15,  3.58it/s]
 83%|████████▎ | 309061/371472 [2:25:40<4:40:05,  3.71it/s]
 83%|████████▎ | 309062/371472 [2:25:40<4:42:15,  3.69it/s]
 83%|████████▎ | 309063/371472 [2:25:41<4:47:44,  3.61it/s]
 83%|████████▎ | 309064/371472 [2:25:41<4:46:34,  3.63it/s]
 83%|████████▎ | 309065/371472 [2:25:41<4:56:16,  3.51it/s]
 83%|████████▎ | 309066/371472 [2:25:41<5:01:08,  3.45it/s]
 83%|████████▎ | 309067/371472 [2:25:42<5:34:59,  3.10it/s]
 83%|████████▎ | 309068/371472 [2:25:42<5:12:05,  3.33it/s]
 83%|████████▎ | 309069/371472 [2:25:42<4:58:10,  3.49it/s]
 83%|████████▎ | 309070/371472 [2:25:43<4:50:34,  3.58it/s]
 83%|████████▎ | 309071/371472 [2:25:43<4:42:53,  3.68it/s]
 83%|████████▎ | 309072/371472 [2:25:43<4:39:10,  3.73it/s]
 83%|████████▎ | 309073/371472 [2:25:43<4:36:45,  3.76it/s]
 83%|████████▎ | 309074/371472 [2:25:44<4:32:32,  3.82it/s]
 83%|████████▎ | 309075/371472 [2:25:44<4:37:46,  3.74it/s]
 83%|████████▎ | 309076/371472 [2:25:44<4:41:57,  3.69it/s]
 83%|████████▎ | 309077/371472 [2:25:44<4:32:38,  3.81it/s]
 83%|████████▎ | 309078/371472 [2:25:45<4:32:01,  3.82it/s]
 83%|████████▎ | 309079/371472 [2:25:45<4:57:47,  3.49it/s]
 83%|████████▎ | 309080/371472 [2:25:45<4:56:54,  3.50it/s]
                                                           
{'loss': 2.7477, 'learning_rate': 2.512443707039582e-07, 'epoch': 13.31}

 83%|████████▎ | 309080/371472 [2:25:45<4:56:54,  3.50it/s]
 83%|████████▎ | 309081/371472 [2:25:46<5:00:25,  3.46it/s]
 83%|████████▎ | 309082/371472 [2:25:46<5:07:46,  3.38it/s]
 83%|████████▎ | 309083/371472 [2:25:46<5:59:03,  2.90it/s]
 83%|████████▎ | 309084/371472 [2:25:47<5:51:37,  2.96it/s]
 83%|████████▎ | 309085/371472 [2:25:47<5:23:12,  3.22it/s]
 83%|████████▎ | 309086/371472 [2:25:47<4:56:55,  3.50it/s]
 83%|████████▎ | 309087/371472 [2:25:47<4:58:19,  3.49it/s]
 83%|████████▎ | 309088/371472 [2:25:48<4:55:15,  3.52it/s]
 83%|████████▎ | 309089/371472 [2:25:48<5:00:36,  3.46it/s]
 83%|████████▎ | 309090/371472 [2:25:48<4:52:13,  3.56it/s]
 83%|████████▎ | 309091/371472 [2:25:49<4:42:55,  3.67it/s]
 83%|████████▎ | 309092/371472 [2:25:49<4:40:04,  3.71it/s]
 83%|████████▎ | 309093/371472 [2:25:49<4:34:06,  3.79it/s]
 83%|████████▎ | 309094/371472 [2:25:49<4:47:40,  3.61it/s]
 83%|████████▎ | 309095/371472 [2:25:50<4:41:35,  3.69it/s]
 83%|████████▎ | 309096/371472 [2:25:50<4:39:27,  3.72it/s]
 83%|████████▎ | 309097/371472 [2:25:50<4:40:08,  3.71it/s]
 83%|████████▎ | 309098/371472 [2:25:50<4:46:41,  3.63it/s]
 83%|████████▎ | 309099/371472 [2:25:51<4:41:34,  3.69it/s]
 83%|████████▎ | 309100/371472 [2:25:51<4:39:08,  3.72it/s]
                                                           
{'loss': 2.6252, 'learning_rate': 2.511958887284794e-07, 'epoch': 13.31}

 83%|████████▎ | 309100/371472 [2:25:51<4:39:08,  3.72it/s]
 83%|████████▎ | 309101/371472 [2:25:51<4:37:36,  3.74it/s]
 83%|████████▎ | 309102/371472 [2:25:51<4:42:47,  3.68it/s]
 83%|████████▎ | 309103/371472 [2:25:52<4:53:52,  3.54it/s]
 83%|████████▎ | 309104/371472 [2:25:52<4:55:50,  3.51it/s]
 83%|████████▎ | 309105/371472 [2:25:52<5:08:22,  3.37it/s]
 83%|████████▎ | 309106/371472 [2:25:53<5:28:44,  3.16it/s]
 83%|████████▎ | 309107/371472 [2:25:53<5:11:05,  3.34it/s]
 83%|████████▎ | 309108/371472 [2:25:53<5:18:09,  3.27it/s]
 83%|████████▎ | 309109/371472 [2:25:54<5:24:10,  3.21it/s]
 83%|████████▎ | 309110/371472 [2:25:54<5:06:18,  3.39it/s]
 83%|████████▎ | 309111/371472 [2:25:54<5:02:19,  3.44it/s]
 83%|████████▎ | 309112/371472 [2:25:54<4:54:34,  3.53it/s]
 83%|████████▎ | 309113/371472 [2:25:55<4:50:19,  3.58it/s]
 83%|████████▎ | 309114/371472 [2:25:55<5:03:32,  3.42it/s]
 83%|████████▎ | 309115/371472 [2:25:55<5:01:06,  3.45it/s]
 83%|████████▎ | 309116/371472 [2:25:56<4:51:16,  3.57it/s]
 83%|████████▎ | 309117/371472 [2:25:56<4:55:42,  3.51it/s]
 83%|████████▎ | 309118/371472 [2:25:56<4:56:41,  3.50it/s]
 83%|████████▎ | 309119/371472 [2:25:57<5:36:59,  3.08it/s]
 83%|████████▎ | 309120/371472 [2:25:57<5:25:01,  3.20it/s]
                                                           
{'loss': 2.6107, 'learning_rate': 2.5114740675300047e-07, 'epoch': 13.31}

 83%|████████▎ | 309120/371472 [2:25:57<5:25:01,  3.20it/s]
 83%|████████▎ | 309121/371472 [2:25:57<5:04:28,  3.41it/s]
 83%|████████▎ | 309122/371472 [2:25:57<5:09:41,  3.36it/s]
 83%|████████▎ | 309123/371472 [2:25:58<5:09:29,  3.36it/s]
 83%|████████▎ | 309124/371472 [2:25:58<5:04:57,  3.41it/s]
 83%|████████▎ | 309125/371472 [2:25:58<4:52:16,  3.56it/s]
 83%|████████▎ | 309126/371472 [2:25:59<4:43:54,  3.66it/s]
 83%|████████▎ | 309127/371472 [2:25:59<4:40:14,  3.71it/s]
 83%|████████▎ | 309128/371472 [2:25:59<4:37:25,  3.75it/s]
 83%|████████▎ | 309129/371472 [2:25:59<4:52:12,  3.56it/s]
 83%|████████▎ | 309130/371472 [2:26:00<4:51:54,  3.56it/s]
 83%|████████▎ | 309131/371472 [2:26:00<4:57:23,  3.49it/s]
 83%|████████▎ | 309132/371472 [2:26:00<5:00:40,  3.46it/s]
 83%|████████▎ | 309133/371472 [2:26:01<4:49:22,  3.59it/s]
 83%|████████▎ | 309134/371472 [2:26:01<4:56:00,  3.51it/s]
 83%|████████▎ | 309135/371472 [2:26:01<5:05:11,  3.40it/s]
 83%|████████▎ | 309136/371472 [2:26:01<5:00:18,  3.46it/s]
 83%|████████▎ | 309137/371472 [2:26:02<4:50:43,  3.57it/s]
 83%|████████▎ | 309138/371472 [2:26:02<4:42:10,  3.68it/s]
 83%|████████▎ | 309139/371472 [2:26:02<5:09:30,  3.36it/s]
 83%|████████▎ | 309140/371472 [2:26:02<4:48:01,  3.61it/s]
                                                           
{'loss': 2.6659, 'learning_rate': 2.5109892477752164e-07, 'epoch': 13.32}

 83%|████████▎ | 309140/371472 [2:26:03<4:48:01,  3.61it/s]
 83%|████████▎ | 309141/371472 [2:26:03<4:57:32,  3.49it/s]
 83%|████████▎ | 309142/371472 [2:26:03<4:58:50,  3.48it/s]
 83%|████████▎ | 309143/371472 [2:26:03<4:48:49,  3.60it/s]
 83%|████████▎ | 309144/371472 [2:26:04<4:51:45,  3.56it/s]
 83%|████████▎ | 309145/371472 [2:26:04<5:12:11,  3.33it/s]
 83%|████████▎ | 309146/371472 [2:26:04<4:57:20,  3.49it/s]
 83%|████████▎ | 309147/371472 [2:26:05<5:00:41,  3.45it/s]
 83%|████████▎ | 309148/371472 [2:26:05<5:23:24,  3.21it/s]
 83%|████████▎ | 309149/371472 [2:26:05<5:16:48,  3.28it/s]
 83%|████████▎ | 309150/371472 [2:26:05<5:00:04,  3.46it/s]
 83%|████████▎ | 309151/371472 [2:26:06<4:57:30,  3.49it/s]
 83%|████████▎ | 309152/371472 [2:26:06<5:20:28,  3.24it/s]
 83%|████████▎ | 309153/371472 [2:26:07<6:02:24,  2.87it/s]
 83%|████████▎ | 309154/371472 [2:26:07<6:01:20,  2.87it/s]
 83%|████████▎ | 309155/371472 [2:26:07<5:56:47,  2.91it/s]
 83%|████████▎ | 309156/371472 [2:26:07<5:31:44,  3.13it/s]
 83%|████████▎ | 309157/371472 [2:26:08<5:14:06,  3.31it/s]
 83%|████████▎ | 309158/371472 [2:26:08<5:24:13,  3.20it/s]
 83%|████████▎ | 309159/371472 [2:26:08<5:12:36,  3.32it/s]
 83%|████████▎ | 309160/371472 [2:26:09<5:01:07,  3.45it/s]
                                                           
{'loss': 2.5502, 'learning_rate': 2.5105044280204266e-07, 'epoch': 13.32}

 83%|████████▎ | 309160/371472 [2:26:09<5:01:07,  3.45it/s]
 83%|████████▎ | 309161/371472 [2:26:09<4:48:33,  3.60it/s]
 83%|████████▎ | 309162/371472 [2:26:09<4:39:25,  3.72it/s]
 83%|████████▎ | 309163/371472 [2:26:09<4:39:48,  3.71it/s]
 83%|████████▎ | 309164/371472 [2:26:10<4:45:33,  3.64it/s]
 83%|████████▎ | 309165/371472 [2:26:10<4:47:03,  3.62it/s]
 83%|████████▎ | 309166/371472 [2:26:10<4:33:08,  3.80it/s]
 83%|████████▎ | 309167/371472 [2:26:10<4:42:07,  3.68it/s]
 83%|████████▎ | 309168/371472 [2:26:11<4:35:09,  3.77it/s]
 83%|████████▎ | 309169/371472 [2:26:11<4:34:42,  3.78it/s]
 83%|████████▎ | 309170/371472 [2:26:11<4:44:00,  3.66it/s]
 83%|████████▎ | 309171/371472 [2:26:12<4:42:17,  3.68it/s]
 83%|████████▎ | 309172/371472 [2:26:12<4:38:45,  3.72it/s]
 83%|████████▎ | 309173/371472 [2:26:12<4:49:17,  3.59it/s]
 83%|████████▎ | 309174/371472 [2:26:12<4:40:33,  3.70it/s]
 83%|████████▎ | 309175/371472 [2:26:13<4:30:20,  3.84it/s]
 83%|████████▎ | 309176/371472 [2:26:13<4:43:00,  3.67it/s]
 83%|████████▎ | 309177/371472 [2:26:13<4:38:24,  3.73it/s]
 83%|████████▎ | 309178/371472 [2:26:13<4:44:58,  3.64it/s]
 83%|████████▎ | 309179/371472 [2:26:14<4:39:02,  3.72it/s]
 83%|████████▎ | 309180/371472 [2:26:14<4:59:03,  3.47it/s]
                                                           
{'loss': 2.6917, 'learning_rate': 2.5100196082656384e-07, 'epoch': 13.32}

 83%|████████▎ | 309180/371472 [2:26:14<4:59:03,  3.47it/s]
 83%|████████▎ | 309181/371472 [2:26:14<4:56:12,  3.50it/s]
 83%|████████▎ | 309182/371472 [2:26:15<4:59:04,  3.47it/s]
 83%|████████▎ | 309183/371472 [2:26:15<5:00:26,  3.46it/s]
 83%|████████▎ | 309184/371472 [2:26:15<4:54:37,  3.52it/s]
 83%|████████▎ | 309185/371472 [2:26:15<5:06:02,  3.39it/s]
 83%|████████▎ | 309186/371472 [2:26:16<5:20:20,  3.24it/s]
 83%|████████▎ | 309187/371472 [2:26:16<5:11:04,  3.34it/s]
 83%|████████▎ | 309188/371472 [2:26:16<5:19:14,  3.25it/s]
 83%|████████▎ | 309189/371472 [2:26:17<5:12:39,  3.32it/s]
 83%|████████▎ | 309190/371472 [2:26:17<4:54:08,  3.53it/s]
 83%|████████▎ | 309191/371472 [2:26:17<5:11:40,  3.33it/s]
 83%|████████▎ | 309192/371472 [2:26:18<5:04:16,  3.41it/s]
 83%|████████▎ | 309193/371472 [2:26:18<5:07:43,  3.37it/s]
 83%|████████▎ | 309194/371472 [2:26:18<4:57:09,  3.49it/s]
 83%|████████▎ | 309195/371472 [2:26:19<5:34:52,  3.10it/s]
 83%|████████▎ | 309196/371472 [2:26:19<5:10:41,  3.34it/s]
 83%|████████▎ | 309197/371472 [2:26:19<5:14:37,  3.30it/s]
 83%|████████▎ | 309198/371472 [2:26:19<5:02:37,  3.43it/s]
 83%|████████▎ | 309199/371472 [2:26:20<5:19:14,  3.25it/s]
 83%|████████▎ | 309200/371472 [2:26:20<5:14:09,  3.30it/s]
                                                           
{'loss': 2.6354, 'learning_rate': 2.5095347885108486e-07, 'epoch': 13.32}

 83%|████████▎ | 309200/371472 [2:26:20<5:14:09,  3.30it/s]
 83%|████████▎ | 309201/371472 [2:26:20<5:01:53,  3.44it/s]
 83%|████████▎ | 309202/371472 [2:26:20<4:42:41,  3.67it/s]
 83%|████████▎ | 309203/371472 [2:26:21<4:37:47,  3.74it/s]
 83%|████████▎ | 309204/371472 [2:26:21<4:40:03,  3.71it/s]
 83%|████████▎ | 309205/371472 [2:26:21<4:37:38,  3.74it/s]
 83%|████████▎ | 309206/371472 [2:26:22<4:51:52,  3.56it/s]
 83%|████████▎ | 309207/371472 [2:26:22<5:08:51,  3.36it/s]
 83%|████████▎ | 309208/371472 [2:26:22<4:47:13,  3.61it/s]
 83%|████████▎ | 309209/371472 [2:26:22<4:38:06,  3.73it/s]
 83%|████████▎ | 309210/371472 [2:26:23<4:34:01,  3.79it/s]
 83%|████████▎ | 309211/371472 [2:26:23<4:27:57,  3.87it/s]
 83%|████████▎ | 309212/371472 [2:26:23<4:34:39,  3.78it/s]
 83%|████████▎ | 309213/371472 [2:26:23<4:34:45,  3.78it/s]
 83%|████████▎ | 309214/371472 [2:26:24<4:40:48,  3.70it/s]
 83%|████████▎ | 309215/371472 [2:26:24<4:35:12,  3.77it/s]
 83%|████████▎ | 309216/371472 [2:26:24<4:38:12,  3.73it/s]
 83%|████████▎ | 309217/371472 [2:26:25<4:39:27,  3.71it/s]
 83%|████████▎ | 309218/371472 [2:26:25<4:58:27,  3.48it/s]
 83%|████████▎ | 309219/371472 [2:26:25<4:43:51,  3.66it/s]
 83%|████████▎ | 309220/371472 [2:26:25<4:47:51,  3.60it/s]
                                                           
{'loss': 2.5776, 'learning_rate': 2.5090499687560604e-07, 'epoch': 13.32}

 83%|████████▎ | 309220/371472 [2:26:25<4:47:51,  3.60it/s]
 83%|████████▎ | 309221/371472 [2:26:26<4:51:48,  3.56it/s]
 83%|████████▎ | 309222/371472 [2:26:26<4:40:35,  3.70it/s]
 83%|████████▎ | 309223/371472 [2:26:26<5:02:31,  3.43it/s]
 83%|████████▎ | 309224/371472 [2:26:27<4:57:36,  3.49it/s]
 83%|████████▎ | 309225/371472 [2:26:27<5:09:55,  3.35it/s]
 83%|████████▎ | 309226/371472 [2:26:27<4:53:35,  3.53it/s]
 83%|████████▎ | 309227/371472 [2:26:27<5:07:18,  3.38it/s]
 83%|████████▎ | 309228/371472 [2:26:28<5:01:11,  3.44it/s]
 83%|████████▎ | 309229/371472 [2:26:28<4:48:55,  3.59it/s]
 83%|████████▎ | 309230/371472 [2:26:28<4:37:00,  3.74it/s]
 83%|████████▎ | 309231/371472 [2:26:28<4:35:50,  3.76it/s]
 83%|████████▎ | 309232/371472 [2:26:29<4:29:49,  3.84it/s]
 83%|████████▎ | 309233/371472 [2:26:29<4:30:14,  3.84it/s]
 83%|████████▎ | 309234/371472 [2:26:29<4:37:00,  3.74it/s]
 83%|████████▎ | 309235/371472 [2:26:30<4:35:04,  3.77it/s]
 83%|████████▎ | 309236/371472 [2:26:30<4:46:08,  3.63it/s]
 83%|████████▎ | 309237/371472 [2:26:30<4:47:33,  3.61it/s]
 83%|████████▎ | 309238/371472 [2:26:30<4:34:09,  3.78it/s]
 83%|████████▎ | 309239/371472 [2:26:31<4:27:01,  3.88it/s]
 83%|████████▎ | 309240/371472 [2:26:31<4:34:33,  3.78it/s]
                                                           
{'loss': 2.5769, 'learning_rate': 2.508565149001271e-07, 'epoch': 13.32}

 83%|████████▎ | 309240/371472 [2:26:31<4:34:33,  3.78it/s]
 83%|████████▎ | 309241/371472 [2:26:31<4:28:59,  3.86it/s]
 83%|████████▎ | 309242/371472 [2:26:31<4:30:09,  3.84it/s]
 83%|████████▎ | 309243/371472 [2:26:32<4:48:36,  3.59it/s]
 83%|████████▎ | 309244/371472 [2:26:32<4:41:13,  3.69it/s]
 83%|████████▎ | 309245/371472 [2:26:32<4:47:47,  3.60it/s]
 83%|████████▎ | 309246/371472 [2:26:32<4:37:51,  3.73it/s]
 83%|████████▎ | 309247/371472 [2:26:33<4:41:42,  3.68it/s]
 83%|████████▎ | 309248/371472 [2:26:33<4:32:12,  3.81it/s]
 83%|████████▎ | 309249/371472 [2:26:33<4:34:43,  3.77it/s]
 83%|████████▎ | 309250/371472 [2:26:34<4:33:04,  3.80it/s]
 83%|████████▎ | 309251/371472 [2:26:34<4:35:29,  3.76it/s]
 83%|████████▎ | 309252/371472 [2:26:34<4:27:57,  3.87it/s]
 83%|████████▎ | 309253/371472 [2:26:34<4:23:12,  3.94it/s]
 83%|████████▎ | 309254/371472 [2:26:35<4:28:33,  3.86it/s]
 83%|████████▎ | 309255/371472 [2:26:35<4:46:58,  3.61it/s]
 83%|████████▎ | 309256/371472 [2:26:35<4:52:33,  3.54it/s]
 83%|████████▎ | 309257/371472 [2:26:35<4:44:32,  3.64it/s]
 83%|████████▎ | 309258/371472 [2:26:36<4:42:24,  3.67it/s]
 83%|████████▎ | 309259/371472 [2:26:36<4:37:09,  3.74it/s]
 83%|████████▎ | 309260/371472 [2:26:36<4:56:44,  3.49it/s]
                                                           
{'loss': 2.6866, 'learning_rate': 2.508080329246483e-07, 'epoch': 13.32}

 83%|████████▎ | 309260/371472 [2:26:36<4:56:44,  3.49it/s]
 83%|████████▎ | 309261/371472 [2:26:37<5:21:02,  3.23it/s]
 83%|████████▎ | 309262/371472 [2:26:37<5:02:57,  3.42it/s]
 83%|████████▎ | 309263/371472 [2:26:37<4:50:42,  3.57it/s]
 83%|████████▎ | 309264/371472 [2:26:38<5:08:18,  3.36it/s]
 83%|████████▎ | 309265/371472 [2:26:38<4:52:26,  3.55it/s]
 83%|████████▎ | 309266/371472 [2:26:38<4:46:52,  3.61it/s]
 83%|████████▎ | 309267/371472 [2:26:38<4:52:26,  3.55it/s]
 83%|████████▎ | 309268/371472 [2:26:39<4:50:37,  3.57it/s]
 83%|████████▎ | 309269/371472 [2:26:39<4:59:03,  3.47it/s]
 83%|████████▎ | 309270/371472 [2:26:39<4:50:42,  3.57it/s]
 83%|████████▎ | 309271/371472 [2:26:39<4:48:40,  3.59it/s]
 83%|████████▎ | 309272/371472 [2:26:40<5:01:12,  3.44it/s]
 83%|████████▎ | 309273/371472 [2:26:40<4:53:30,  3.53it/s]
 83%|████████▎ | 309274/371472 [2:26:40<4:39:21,  3.71it/s]
 83%|████████▎ | 309275/371472 [2:26:41<4:40:20,  3.70it/s]
 83%|████████▎ | 309276/371472 [2:26:41<4:42:13,  3.67it/s]
 83%|████████▎ | 309277/371472 [2:26:41<4:48:28,  3.59it/s]
 83%|████████▎ | 309278/371472 [2:26:41<4:47:59,  3.60it/s]
 83%|████████▎ | 309279/371472 [2:26:42<4:48:21,  3.59it/s]
 83%|████████▎ | 309280/371472 [2:26:42<5:06:09,  3.39it/s]
                                                           
{'loss': 2.6129, 'learning_rate': 2.5075955094916936e-07, 'epoch': 13.32}

 83%|████████▎ | 309280/371472 [2:26:42<5:06:09,  3.39it/s]
 83%|████████▎ | 309281/371472 [2:26:42<4:59:04,  3.47it/s]
 83%|████████▎ | 309282/371472 [2:26:43<5:17:53,  3.26it/s]
 83%|████████▎ | 309283/371472 [2:26:43<5:26:39,  3.17it/s]
 83%|████████▎ | 309284/371472 [2:26:43<5:11:25,  3.33it/s]
 83%|████████▎ | 309285/371472 [2:26:44<5:26:00,  3.18it/s]
 83%|████████▎ | 309286/371472 [2:26:44<5:18:09,  3.26it/s]
 83%|████████▎ | 309287/371472 [2:26:44<5:01:47,  3.43it/s]
 83%|████████▎ | 309288/371472 [2:26:44<4:48:43,  3.59it/s]
 83%|████████▎ | 309289/371472 [2:26:45<4:50:44,  3.56it/s]
 83%|████████▎ | 309290/371472 [2:26:45<4:41:56,  3.68it/s]
 83%|████████▎ | 309291/371472 [2:26:45<4:59:40,  3.46it/s]
 83%|████████▎ | 309292/371472 [2:26:45<4:45:40,  3.63it/s]
 83%|████████▎ | 309293/371472 [2:26:46<4:46:27,  3.62it/s]
 83%|████████▎ | 309294/371472 [2:26:46<4:49:00,  3.59it/s]
 83%|████████▎ | 309295/371472 [2:26:46<4:50:44,  3.56it/s]
 83%|████████▎ | 309296/371472 [2:26:47<5:30:51,  3.13it/s]
 83%|████████▎ | 309297/371472 [2:26:47<5:28:42,  3.15it/s]
 83%|████████▎ | 309298/371472 [2:26:47<5:39:41,  3.05it/s]
 83%|████████▎ | 309299/371472 [2:26:48<5:17:34,  3.26it/s]
 83%|████████▎ | 309300/371472 [2:26:48<5:02:02,  3.43it/s]
                                                           
{'loss': 2.5801, 'learning_rate': 2.507110689736905e-07, 'epoch': 13.32}

 83%|████████▎ | 309300/371472 [2:26:48<5:02:02,  3.43it/s]
 83%|████████▎ | 309301/371472 [2:26:48<4:53:43,  3.53it/s]
 83%|████████▎ | 309302/371472 [2:26:48<4:46:06,  3.62it/s]
 83%|████████▎ | 309303/371472 [2:26:49<4:32:56,  3.80it/s]
 83%|████████▎ | 309304/371472 [2:26:49<4:32:41,  3.80it/s]
 83%|████████▎ | 309305/371472 [2:26:49<4:29:21,  3.85it/s]
 83%|████████▎ | 309306/371472 [2:26:49<4:33:48,  3.78it/s]
 83%|████████▎ | 309307/371472 [2:26:50<4:45:44,  3.63it/s]
 83%|████████▎ | 309308/371472 [2:26:50<4:51:53,  3.55it/s]
 83%|████████▎ | 309309/371472 [2:26:50<4:59:03,  3.46it/s]
 83%|████████▎ | 309310/371472 [2:26:51<4:55:32,  3.51it/s]
 83%|████████▎ | 309311/371472 [2:26:51<5:56:04,  2.91it/s]
 83%|████████▎ | 309312/371472 [2:26:51<6:04:21,  2.84it/s]
 83%|████████▎ | 309313/371472 [2:26:52<5:35:36,  3.09it/s]
 83%|████████▎ | 309314/371472 [2:26:52<5:11:22,  3.33it/s]
 83%|████████▎ | 309315/371472 [2:26:52<4:55:45,  3.50it/s]
 83%|████████▎ | 309316/371472 [2:26:53<5:12:52,  3.31it/s]
 83%|████████▎ | 309317/371472 [2:26:53<4:53:04,  3.53it/s]
 83%|████████▎ | 309318/371472 [2:26:53<4:52:24,  3.54it/s]
 83%|████████▎ | 309319/371472 [2:26:53<4:43:53,  3.65it/s]
 83%|████████▎ | 309320/371472 [2:26:54<4:42:55,  3.66it/s]
                                                           
{'loss': 2.6647, 'learning_rate': 2.506625869982115e-07, 'epoch': 13.32}

 83%|████████▎ | 309320/371472 [2:26:54<4:42:55,  3.66it/s]
 83%|████████▎ | 309321/371472 [2:26:54<4:46:48,  3.61it/s]
 83%|████████▎ | 309322/371472 [2:26:54<4:41:30,  3.68it/s]
 83%|████████▎ | 309323/371472 [2:26:55<5:08:21,  3.36it/s]
 83%|████████▎ | 309324/371472 [2:26:55<5:06:34,  3.38it/s]
 83%|████████▎ | 309325/371472 [2:26:55<5:02:20,  3.43it/s]
 83%|████████▎ | 309326/371472 [2:26:55<5:06:56,  3.37it/s]
 83%|████████▎ | 309327/371472 [2:26:56<5:10:29,  3.34it/s]
 83%|████████▎ | 309328/371472 [2:26:56<5:00:11,  3.45it/s]
 83%|████████▎ | 309329/371472 [2:26:56<5:00:06,  3.45it/s]
 83%|████████▎ | 309330/371472 [2:26:57<5:14:23,  3.29it/s]
 83%|████████▎ | 309331/371472 [2:26:57<5:02:40,  3.42it/s]
 83%|████████▎ | 309332/371472 [2:26:57<5:01:25,  3.44it/s]
 83%|████████▎ | 309333/371472 [2:26:57<4:47:55,  3.60it/s]
 83%|████████▎ | 309334/371472 [2:26:58<5:03:21,  3.41it/s]
 83%|████████▎ | 309335/371472 [2:26:58<5:05:56,  3.39it/s]
 83%|████████▎ | 309336/371472 [2:26:58<4:58:17,  3.47it/s]
 83%|████████▎ | 309337/371472 [2:26:59<4:45:49,  3.62it/s]
 83%|████████▎ | 309338/371472 [2:26:59<5:02:30,  3.42it/s]
 83%|████████▎ | 309339/371472 [2:26:59<5:03:22,  3.41it/s]
 83%|████████▎ | 309340/371472 [2:26:59<4:55:17,  3.51it/s]
                                                           
{'loss': 2.6922, 'learning_rate': 2.506141050227327e-07, 'epoch': 13.32}

 83%|████████▎ | 309340/371472 [2:26:59<4:55:17,  3.51it/s]
 83%|████████▎ | 309341/371472 [2:27:00<4:49:17,  3.58it/s]
 83%|████████▎ | 309342/371472 [2:27:00<4:38:21,  3.72it/s]
 83%|████████▎ | 309343/371472 [2:27:00<4:35:13,  3.76it/s]
 83%|████████▎ | 309344/371472 [2:27:01<4:45:43,  3.62it/s]
 83%|████████▎ | 309345/371472 [2:27:01<4:33:55,  3.78it/s]
 83%|████████▎ | 309346/371472 [2:27:01<5:04:37,  3.40it/s]
 83%|████████▎ | 309347/371472 [2:27:01<4:56:27,  3.49it/s]
 83%|████████▎ | 309348/371472 [2:27:02<4:51:32,  3.55it/s]
 83%|████████▎ | 309349/371472 [2:27:02<4:37:51,  3.73it/s]
 83%|████████▎ | 309350/371472 [2:27:02<4:34:20,  3.77it/s]
 83%|████████▎ | 309351/371472 [2:27:02<4:37:11,  3.74it/s]
 83%|████████▎ | 309352/371472 [2:27:03<4:42:20,  3.67it/s]
 83%|████████▎ | 309353/371472 [2:27:03<4:41:19,  3.68it/s]
 83%|████████▎ | 309354/371472 [2:27:03<4:37:56,  3.72it/s]
 83%|████████▎ | 309355/371472 [2:27:03<4:37:38,  3.73it/s]
 83%|████████▎ | 309356/371472 [2:27:04<4:45:03,  3.63it/s]
 83%|████████▎ | 309357/371472 [2:27:04<4:43:49,  3.65it/s]
 83%|████████▎ | 309358/371472 [2:27:04<4:39:34,  3.70it/s]
 83%|████████▎ | 309359/371472 [2:27:05<4:53:07,  3.53it/s]
 83%|████████▎ | 309360/371472 [2:27:05<4:54:03,  3.52it/s]
                                                           
{'loss': 2.5258, 'learning_rate': 2.5056562304725375e-07, 'epoch': 13.32}

 83%|████████▎ | 309360/371472 [2:27:05<4:54:03,  3.52it/s]
 83%|████████▎ | 309361/371472 [2:27:05<4:49:47,  3.57it/s]
 83%|████████▎ | 309362/371472 [2:27:05<4:53:06,  3.53it/s]
 83%|████████▎ | 309363/371472 [2:27:06<5:16:40,  3.27it/s]
 83%|████████▎ | 309364/371472 [2:27:06<5:13:58,  3.30it/s]
 83%|████████▎ | 309365/371472 [2:27:06<5:07:32,  3.37it/s]
 83%|████████▎ | 309366/371472 [2:27:07<5:01:14,  3.44it/s]
 83%|████████▎ | 309367/371472 [2:27:07<4:49:15,  3.58it/s]
 83%|████████▎ | 309368/371472 [2:27:07<4:46:33,  3.61it/s]
 83%|████████▎ | 309369/371472 [2:27:07<4:44:45,  3.63it/s]
 83%|████████▎ | 309370/371472 [2:27:08<4:34:08,  3.78it/s]
 83%|████████▎ | 309371/371472 [2:27:08<4:59:15,  3.46it/s]
 83%|████████▎ | 309372/371472 [2:27:08<4:54:47,  3.51it/s]
 83%|████████▎ | 309373/371472 [2:27:09<5:09:29,  3.34it/s]
 83%|████████▎ | 309374/371472 [2:27:09<4:56:02,  3.50it/s]
 83%|████████▎ | 309375/371472 [2:27:09<4:59:47,  3.45it/s]
 83%|████████▎ | 309376/371472 [2:27:10<5:00:28,  3.44it/s]
 83%|████████▎ | 309377/371472 [2:27:10<5:03:33,  3.41it/s]
 83%|████████▎ | 309378/371472 [2:27:10<5:14:48,  3.29it/s]
 83%|████████▎ | 309379/371472 [2:27:10<5:02:17,  3.42it/s]
 83%|████████▎ | 309380/371472 [2:27:11<5:05:22,  3.39it/s]
                                                           
{'loss': 2.5408, 'learning_rate': 2.505171410717749e-07, 'epoch': 13.33}

 83%|████████▎ | 309380/371472 [2:27:11<5:05:22,  3.39it/s]
 83%|████████▎ | 309381/371472 [2:27:11<4:57:10,  3.48it/s]
 83%|████████▎ | 309382/371472 [2:27:11<5:02:21,  3.42it/s]
 83%|████████▎ | 309383/371472 [2:27:12<4:46:30,  3.61it/s]
 83%|████████▎ | 309384/371472 [2:27:12<4:36:03,  3.75it/s]
 83%|████████▎ | 309385/371472 [2:27:12<4:29:06,  3.85it/s]
 83%|████████▎ | 309386/371472 [2:27:12<4:23:21,  3.93it/s]
 83%|████████▎ | 309387/371472 [2:27:13<4:27:49,  3.86it/s]
 83%|████████▎ | 309388/371472 [2:27:13<4:30:22,  3.83it/s]
 83%|████████▎ | 309389/371472 [2:27:13<4:26:37,  3.88it/s]
 83%|████████▎ | 309390/371472 [2:27:13<4:42:29,  3.66it/s]
 83%|████████▎ | 309391/371472 [2:27:14<4:46:50,  3.61it/s]
 83%|████████▎ | 309392/371472 [2:27:14<4:40:30,  3.69it/s]
 83%|████████▎ | 309393/371472 [2:27:14<4:45:00,  3.63it/s]
 83%|████████▎ | 309394/371472 [2:27:14<4:38:38,  3.71it/s]
 83%|████████▎ | 309395/371472 [2:27:15<4:46:41,  3.61it/s]
 83%|████████▎ | 309396/371472 [2:27:15<4:47:46,  3.60it/s]
 83%|████████▎ | 309397/371472 [2:27:15<4:42:24,  3.66it/s]
 83%|████████▎ | 309398/371472 [2:27:16<4:45:39,  3.62it/s]
 83%|████████▎ | 309399/371472 [2:27:16<4:38:29,  3.71it/s]
 83%|████████▎ | 309400/371472 [2:27:16<4:36:26,  3.74it/s]
                                                           
{'loss': 2.7358, 'learning_rate': 2.50468659096296e-07, 'epoch': 13.33}

 83%|████████▎ | 309400/371472 [2:27:16<4:36:26,  3.74it/s]
 83%|████████▎ | 309401/371472 [2:27:16<4:28:35,  3.85it/s]
 83%|████████▎ | 309402/371472 [2:27:17<4:27:41,  3.86it/s]
 83%|████████▎ | 309403/371472 [2:27:17<4:31:59,  3.80it/s]
 83%|████████▎ | 309404/371472 [2:27:17<4:23:12,  3.93it/s]
 83%|████████▎ | 309405/371472 [2:27:17<4:30:38,  3.82it/s]
 83%|████████▎ | 309406/371472 [2:27:18<4:39:58,  3.69it/s]
 83%|████████▎ | 309407/371472 [2:27:18<4:36:04,  3.75it/s]
 83%|████████▎ | 309408/371472 [2:27:18<4:41:41,  3.67it/s]
 83%|████████▎ | 309409/371472 [2:27:18<4:37:29,  3.73it/s]
 83%|████████▎ | 309410/371472 [2:27:19<5:07:46,  3.36it/s]
 83%|████████▎ | 309411/371472 [2:27:19<5:19:06,  3.24it/s]
 83%|████████▎ | 309412/371472 [2:27:19<5:04:20,  3.40it/s]
 83%|████████▎ | 309413/371472 [2:27:20<4:57:26,  3.48it/s]
 83%|████████▎ | 309414/371472 [2:27:20<4:52:49,  3.53it/s]
 83%|████████▎ | 309415/371472 [2:27:20<4:56:04,  3.49it/s]
 83%|████████▎ | 309416/371472 [2:27:21<4:43:47,  3.64it/s]
 83%|████████▎ | 309417/371472 [2:27:21<4:44:47,  3.63it/s]
 83%|████████▎ | 309418/371472 [2:27:21<4:32:31,  3.79it/s]
 83%|████████▎ | 309419/371472 [2:27:21<4:31:27,  3.81it/s]
 83%|████████▎ | 309420/371472 [2:27:22<4:31:51,  3.80it/s]
                                                           
{'loss': 2.8785, 'learning_rate': 2.50420177120817e-07, 'epoch': 13.33}

 83%|████████▎ | 309420/371472 [2:27:22<4:31:51,  3.80it/s]
 83%|████████▎ | 309421/371472 [2:27:22<4:37:48,  3.72it/s]
 83%|████████▎ | 309422/371472 [2:27:22<4:58:57,  3.46it/s]
 83%|████████▎ | 309423/371472 [2:27:22<4:55:09,  3.50it/s]
 83%|████████▎ | 309424/371472 [2:27:23<5:08:23,  3.35it/s]
 83%|████████▎ | 309425/371472 [2:27:23<5:00:23,  3.44it/s]
 83%|████████▎ | 309426/371472 [2:27:23<4:58:54,  3.46it/s]
 83%|████████▎ | 309427/371472 [2:27:24<5:09:33,  3.34it/s]
 83%|████████▎ | 309428/371472 [2:27:24<4:55:45,  3.50it/s]
 83%|████████▎ | 309429/371472 [2:27:24<4:52:27,  3.54it/s]
 83%|████████▎ | 309430/371472 [2:27:24<4:43:56,  3.64it/s]
 83%|████████▎ | 309431/371472 [2:27:25<4:43:47,  3.64it/s]
 83%|████████▎ | 309432/371472 [2:27:25<4:49:10,  3.58it/s]
 83%|████████▎ | 309433/371472 [2:27:25<4:45:36,  3.62it/s]
 83%|████████▎ | 309434/371472 [2:27:26<4:46:15,  3.61it/s]
 83%|████████▎ | 309435/371472 [2:27:26<4:45:40,  3.62it/s]
 83%|████████▎ | 309436/371472 [2:27:26<5:08:09,  3.36it/s]
 83%|████████▎ | 309437/371472 [2:27:26<5:10:21,  3.33it/s]
 83%|████████▎ | 309438/371472 [2:27:27<5:14:41,  3.29it/s]
 83%|████████▎ | 309439/371472 [2:27:27<5:04:01,  3.40it/s]
 83%|████████▎ | 309440/371472 [2:27:27<5:18:41,  3.24it/s]
                                                           
{'loss': 2.5786, 'learning_rate': 2.5037169514533814e-07, 'epoch': 13.33}

 83%|████████▎ | 309440/371472 [2:27:27<5:18:41,  3.24it/s]
 83%|████████▎ | 309441/371472 [2:27:28<5:00:28,  3.44it/s]
 83%|████████▎ | 309442/371472 [2:27:28<4:52:10,  3.54it/s]
 83%|████████▎ | 309443/371472 [2:27:28<4:49:36,  3.57it/s]
 83%|████████▎ | 309444/371472 [2:27:28<4:48:49,  3.58it/s]
 83%|████████▎ | 309445/371472 [2:27:29<5:17:48,  3.25it/s]
 83%|████████▎ | 309446/371472 [2:27:29<5:06:28,  3.37it/s]
 83%|████████▎ | 309447/371472 [2:27:29<5:08:23,  3.35it/s]
 83%|████████▎ | 309448/371472 [2:27:30<4:55:08,  3.50it/s]
 83%|████████▎ | 309449/371472 [2:27:30<5:03:27,  3.41it/s]
 83%|████████▎ | 309450/371472 [2:27:30<4:57:56,  3.47it/s]
 83%|████████▎ | 309451/371472 [2:27:31<4:45:40,  3.62it/s]
 83%|████████▎ | 309452/371472 [2:27:31<4:54:36,  3.51it/s]
 83%|████████▎ | 309453/371472 [2:27:31<6:06:43,  2.82it/s]
 83%|████████▎ | 309454/371472 [2:27:32<5:44:17,  3.00it/s]
 83%|████████▎ | 309455/371472 [2:27:32<5:16:37,  3.26it/s]
 83%|████████▎ | 309456/371472 [2:27:32<5:06:33,  3.37it/s]
 83%|████████▎ | 309457/371472 [2:27:32<4:56:02,  3.49it/s]
 83%|████████▎ | 309458/371472 [2:27:33<4:48:18,  3.58it/s]
 83%|████████▎ | 309459/371472 [2:27:33<4:43:28,  3.65it/s]
 83%|████████▎ | 309460/371472 [2:27:33<4:40:25,  3.69it/s]
                                                           
{'loss': 2.5491, 'learning_rate': 2.503232131698592e-07, 'epoch': 13.33}

 83%|████████▎ | 309460/371472 [2:27:33<4:40:25,  3.69it/s]
 83%|████████▎ | 309461/371472 [2:27:33<4:47:29,  3.59it/s]
 83%|████████▎ | 309462/371472 [2:27:34<4:48:09,  3.59it/s]
 83%|████████▎ | 309463/371472 [2:27:34<4:43:00,  3.65it/s]
 83%|████████▎ | 309464/371472 [2:27:34<4:45:18,  3.62it/s]
 83%|████████▎ | 309465/371472 [2:27:35<5:20:21,  3.23it/s]
 83%|████████▎ | 309466/371472 [2:27:35<5:09:26,  3.34it/s]
 83%|████████▎ | 309467/371472 [2:27:35<5:20:22,  3.23it/s]
 83%|████████▎ | 309468/371472 [2:27:36<5:20:26,  3.22it/s]
 83%|████████▎ | 309469/371472 [2:27:36<5:05:59,  3.38it/s]
 83%|████████▎ | 309470/371472 [2:27:36<5:11:03,  3.32it/s]
 83%|████████▎ | 309471/371472 [2:27:36<4:52:01,  3.54it/s]
 83%|████████▎ | 309472/371472 [2:27:37<4:35:43,  3.75it/s]
 83%|████████▎ | 309473/371472 [2:27:37<4:37:05,  3.73it/s]
 83%|████████▎ | 309474/371472 [2:27:37<4:35:12,  3.75it/s]
 83%|████████▎ | 309475/371472 [2:27:37<4:27:55,  3.86it/s]
 83%|████████▎ | 309476/371472 [2:27:38<4:40:44,  3.68it/s]
 83%|████████▎ | 309477/371472 [2:27:38<4:48:27,  3.58it/s]
 83%|████████▎ | 309478/371472 [2:27:38<5:14:32,  3.28it/s]
 83%|████████▎ | 309479/371472 [2:27:39<4:58:10,  3.47it/s]
 83%|████████▎ | 309480/371472 [2:27:39<4:39:57,  3.69it/s]
                                                           
{'loss': 2.7053, 'learning_rate': 2.5027473119438034e-07, 'epoch': 13.33}

 83%|████████▎ | 309480/371472 [2:27:39<4:39:57,  3.69it/s]
 83%|████████▎ | 309481/371472 [2:27:39<5:20:20,  3.23it/s]
 83%|████████▎ | 309482/371472 [2:27:40<5:20:15,  3.23it/s]
 83%|████████▎ | 309483/371472 [2:27:40<5:18:04,  3.25it/s]
 83%|████████▎ | 309484/371472 [2:27:40<5:00:43,  3.44it/s]
 83%|████████▎ | 309485/371472 [2:27:40<4:53:16,  3.52it/s]
 83%|████████▎ | 309486/371472 [2:27:41<4:41:15,  3.67it/s]
 83%|████████▎ | 309487/371472 [2:27:41<4:53:05,  3.52it/s]
 83%|████████▎ | 309488/371472 [2:27:41<5:38:12,  3.05it/s]
 83%|████████▎ | 309489/371472 [2:27:42<5:18:51,  3.24it/s]
 83%|████████▎ | 309490/371472 [2:27:42<4:56:23,  3.49it/s]
 83%|████████▎ | 309491/371472 [2:27:42<4:47:20,  3.60it/s]
 83%|████████▎ | 309492/371472 [2:27:42<4:46:17,  3.61it/s]
 83%|████████▎ | 309493/371472 [2:27:43<4:42:16,  3.66it/s]
 83%|████████▎ | 309494/371472 [2:27:43<4:28:16,  3.85it/s]
 83%|████████▎ | 309495/371472 [2:27:43<4:36:15,  3.74it/s]
 83%|████████▎ | 309496/371472 [2:27:44<4:47:42,  3.59it/s]
 83%|████████▎ | 309497/371472 [2:27:44<4:42:33,  3.66it/s]
 83%|████████▎ | 309498/371472 [2:27:44<4:47:14,  3.60it/s]
 83%|████████▎ | 309499/371472 [2:27:44<4:38:45,  3.71it/s]
 83%|████████▎ | 309500/371472 [2:27:45<4:37:47,  3.72it/s]
                                                           
{'loss': 2.7644, 'learning_rate': 2.5022624921890146e-07, 'epoch': 13.33}

 83%|████████▎ | 309500/371472 [2:27:45<4:37:47,  3.72it/s]
 83%|████████▎ | 309501/371472 [2:27:45<4:32:23,  3.79it/s]
 83%|████████▎ | 309502/371472 [2:27:45<4:33:56,  3.77it/s]
 83%|████████▎ | 309503/371472 [2:27:45<4:44:06,  3.64it/s]
 83%|████████▎ | 309504/371472 [2:27:46<4:48:09,  3.58it/s]
 83%|████████▎ | 309505/371472 [2:27:46<4:42:30,  3.66it/s]
 83%|████████▎ | 309506/371472 [2:27:46<4:44:48,  3.63it/s]
 83%|████████▎ | 309507/371472 [2:27:47<4:48:00,  3.59it/s]
 83%|████████▎ | 309508/371472 [2:27:47<4:37:26,  3.72it/s]
 83%|████████▎ | 309509/371472 [2:27:47<4:37:07,  3.73it/s]
 83%|████████▎ | 309510/371472 [2:27:47<4:40:06,  3.69it/s]
 83%|████████▎ | 309511/371472 [2:27:48<4:35:20,  3.75it/s]
 83%|████████▎ | 309512/371472 [2:27:48<5:13:04,  3.30it/s]
 83%|████████▎ | 309513/371472 [2:27:48<5:27:23,  3.15it/s]
 83%|████████▎ | 309514/371472 [2:27:49<5:18:01,  3.25it/s]
 83%|████████▎ | 309515/371472 [2:27:49<5:08:34,  3.35it/s]
 83%|████████▎ | 309516/371472 [2:27:49<5:12:41,  3.30it/s]
 83%|████████▎ | 309517/371472 [2:27:49<5:08:37,  3.35it/s]
 83%|████████▎ | 309518/371472 [2:27:50<5:02:43,  3.41it/s]
 83%|████████▎ | 309519/371472 [2:27:50<4:49:19,  3.57it/s]
 83%|████████▎ | 309520/371472 [2:27:50<5:07:25,  3.36it/s]
                                                           
{'loss': 2.5879, 'learning_rate': 2.5017776724342264e-07, 'epoch': 13.33}

 83%|████████▎ | 309520/371472 [2:27:50<5:07:25,  3.36it/s]
 83%|████████▎ | 309521/371472 [2:27:51<5:00:32,  3.44it/s]
 83%|████████▎ | 309522/371472 [2:27:51<4:51:34,  3.54it/s]
 83%|████████▎ | 309523/371472 [2:27:51<4:44:26,  3.63it/s]
 83%|████████▎ | 309524/371472 [2:27:51<4:33:52,  3.77it/s]
 83%|████████▎ | 309525/371472 [2:27:52<4:33:45,  3.77it/s]
 83%|████████▎ | 309526/371472 [2:27:52<4:40:00,  3.69it/s]
 83%|████████▎ | 309527/371472 [2:27:52<4:41:48,  3.66it/s]
 83%|████████▎ | 309528/371472 [2:27:52<4:36:11,  3.74it/s]
 83%|████████▎ | 309529/371472 [2:27:53<4:53:33,  3.52it/s]
 83%|████████▎ | 309530/371472 [2:27:53<4:47:34,  3.59it/s]
 83%|████████▎ | 309531/371472 [2:27:53<4:44:29,  3.63it/s]
 83%|████████▎ | 309532/371472 [2:27:54<4:45:11,  3.62it/s]
 83%|████████▎ | 309533/371472 [2:27:54<4:36:36,  3.73it/s]
 83%|████████▎ | 309534/371472 [2:27:54<5:04:56,  3.39it/s]
 83%|████████▎ | 309535/371472 [2:27:54<4:59:44,  3.44it/s]
 83%|████████▎ | 309536/371472 [2:27:55<5:08:27,  3.35it/s]
 83%|████████▎ | 309537/371472 [2:27:55<5:00:05,  3.44it/s]
 83%|████████▎ | 309538/371472 [2:27:55<4:55:14,  3.50it/s]
 83%|████████▎ | 309539/371472 [2:27:56<4:42:16,  3.66it/s]
 83%|████████▎ | 309540/371472 [2:27:56<4:40:22,  3.68it/s]
                                                           
{'loss': 2.6265, 'learning_rate': 2.5012928526794366e-07, 'epoch': 13.33}

 83%|████████▎ | 309540/371472 [2:27:56<4:40:22,  3.68it/s]
 83%|████████▎ | 309541/371472 [2:27:56<4:35:59,  3.74it/s]
 83%|████████▎ | 309542/371472 [2:27:56<4:35:38,  3.74it/s]
 83%|████████▎ | 309543/371472 [2:27:57<4:30:17,  3.82it/s]
 83%|████████▎ | 309544/371472 [2:27:57<5:00:32,  3.43it/s]
 83%|████████▎ | 309545/371472 [2:27:57<4:48:38,  3.58it/s]
 83%|████████▎ | 309546/371472 [2:27:57<4:39:28,  3.69it/s]
 83%|████████▎ | 309547/371472 [2:27:58<4:33:50,  3.77it/s]
 83%|████████▎ | 309548/371472 [2:27:58<4:32:56,  3.78it/s]
 83%|████████▎ | 309549/371472 [2:27:58<4:47:24,  3.59it/s]
 83%|████████▎ | 309550/371472 [2:27:59<4:35:00,  3.75it/s]
 83%|████████▎ | 309551/371472 [2:27:59<4:34:31,  3.76it/s]
 83%|████████▎ | 309552/371472 [2:27:59<4:39:33,  3.69it/s]
 83%|████████▎ | 309553/371472 [2:27:59<4:39:13,  3.70it/s]
 83%|████████▎ | 309554/371472 [2:28:00<4:34:03,  3.77it/s]
 83%|████████▎ | 309555/371472 [2:28:00<4:30:59,  3.81it/s]
 83%|████████▎ | 309556/371472 [2:28:00<4:32:42,  3.78it/s]
 83%|████████▎ | 309557/371472 [2:28:00<4:34:58,  3.75it/s]
 83%|████████▎ | 309558/371472 [2:28:01<4:34:25,  3.76it/s]
 83%|████████▎ | 309559/371472 [2:28:01<4:43:15,  3.64it/s]
 83%|████████▎ | 309560/371472 [2:28:01<4:50:05,  3.56it/s]
                                                           
{'loss': 2.8365, 'learning_rate': 2.5008080329246483e-07, 'epoch': 13.33}

 83%|████████▎ | 309560/371472 [2:28:01<4:50:05,  3.56it/s]
 83%|████████▎ | 309561/371472 [2:28:02<4:37:36,  3.72it/s]
 83%|████████▎ | 309562/371472 [2:28:02<4:55:08,  3.50it/s]
 83%|████████▎ | 309563/371472 [2:28:02<4:45:08,  3.62it/s]
 83%|████████▎ | 309564/371472 [2:28:02<4:40:10,  3.68it/s]
 83%|████████▎ | 309565/371472 [2:28:03<4:59:02,  3.45it/s]
 83%|████████▎ | 309566/371472 [2:28:03<4:57:52,  3.46it/s]
 83%|████████▎ | 309567/371472 [2:28:03<4:47:05,  3.59it/s]
 83%|████████▎ | 309568/371472 [2:28:03<4:44:14,  3.63it/s]
 83%|████████▎ | 309569/371472 [2:28:04<4:56:24,  3.48it/s]
 83%|████████▎ | 309570/371472 [2:28:04<5:04:26,  3.39it/s]
 83%|████████▎ | 309571/371472 [2:28:04<5:01:51,  3.42it/s]
 83%|████████▎ | 309572/371472 [2:28:05<4:45:34,  3.61it/s]
 83%|████████▎ | 309573/371472 [2:28:05<4:48:00,  3.58it/s]
 83%|████████▎ | 309574/371472 [2:28:05<5:05:14,  3.38it/s]
 83%|████████▎ | 309575/371472 [2:28:06<4:57:12,  3.47it/s]
 83%|████████▎ | 309576/371472 [2:28:06<4:44:52,  3.62it/s]
 83%|████████▎ | 309577/371472 [2:28:06<4:40:52,  3.67it/s]
 83%|████████▎ | 309578/371472 [2:28:06<4:34:57,  3.75it/s]
 83%|████████▎ | 309579/371472 [2:28:07<4:59:41,  3.44it/s]
 83%|████████▎ | 309580/371472 [2:28:07<5:02:43,  3.41it/s]
                                                           
{'loss': 2.6719, 'learning_rate': 2.5003232131698585e-07, 'epoch': 13.33}

 83%|████████▎ | 309580/371472 [2:28:07<5:02:43,  3.41it/s]
 83%|████████▎ | 309581/371472 [2:28:07<4:51:55,  3.53it/s]
 83%|████████▎ | 309582/371472 [2:28:08<4:56:32,  3.48it/s]
 83%|████████▎ | 309583/371472 [2:28:08<4:48:33,  3.57it/s]
 83%|████████▎ | 309584/371472 [2:28:08<4:48:03,  3.58it/s]
 83%|████████▎ | 309585/371472 [2:28:08<4:42:54,  3.65it/s]
 83%|████████▎ | 309586/371472 [2:28:09<4:41:17,  3.67it/s]
 83%|████████▎ | 309587/371472 [2:28:09<4:43:56,  3.63it/s]
 83%|████████▎ | 309588/371472 [2:28:09<4:39:56,  3.68it/s]
 83%|████████▎ | 309589/371472 [2:28:09<4:41:18,  3.67it/s]
 83%|████████▎ | 309590/371472 [2:28:10<4:52:03,  3.53it/s]
 83%|████████▎ | 309591/371472 [2:28:10<4:42:36,  3.65it/s]
 83%|████████▎ | 309592/371472 [2:28:10<4:52:24,  3.53it/s]
 83%|████████▎ | 309593/371472 [2:28:11<4:44:01,  3.63it/s]
 83%|████████▎ | 309594/371472 [2:28:11<4:48:54,  3.57it/s]
 83%|████████▎ | 309595/371472 [2:28:11<4:46:24,  3.60it/s]
 83%|████████▎ | 309596/371472 [2:28:11<4:46:14,  3.60it/s]
 83%|████████▎ | 309597/371472 [2:28:12<4:44:18,  3.63it/s]
 83%|████████▎ | 309598/371472 [2:28:12<4:36:44,  3.73it/s]
 83%|████████▎ | 309599/371472 [2:28:12<4:54:22,  3.50it/s]
 83%|████████▎ | 309600/371472 [2:28:12<4:44:58,  3.62it/s]
                                                           
{'loss': 2.6803, 'learning_rate': 2.4998383934150703e-07, 'epoch': 13.34}

 83%|████████▎ | 309600/371472 [2:28:12<4:44:58,  3.62it/s]
 83%|████████▎ | 309601/371472 [2:28:13<5:39:24,  3.04it/s]
 83%|████████▎ | 309602/371472 [2:28:13<5:16:45,  3.26it/s]
 83%|████████▎ | 309603/371472 [2:28:13<5:09:41,  3.33it/s]
 83%|████████▎ | 309604/371472 [2:28:14<4:59:34,  3.44it/s]
 83%|████████▎ | 309605/371472 [2:28:14<5:02:49,  3.40it/s]
 83%|████████▎ | 309606/371472 [2:28:14<5:12:22,  3.30it/s]
 83%|████████▎ | 309607/371472 [2:28:15<5:03:40,  3.40it/s]
 83%|████████▎ | 309608/371472 [2:28:15<5:11:06,  3.31it/s]
 83%|████████▎ | 309609/371472 [2:28:15<5:05:20,  3.38it/s]
 83%|████████▎ | 309610/371472 [2:28:16<5:29:04,  3.13it/s]
 83%|████████▎ | 309611/371472 [2:28:16<5:11:04,  3.31it/s]
 83%|████████▎ | 309612/371472 [2:28:16<5:16:10,  3.26it/s]
 83%|████████▎ | 309613/371472 [2:28:16<5:06:09,  3.37it/s]
 83%|████████▎ | 309614/371472 [2:28:17<5:08:04,  3.35it/s]
 83%|████████▎ | 309615/371472 [2:28:17<5:04:32,  3.39it/s]
 83%|████████▎ | 309616/371472 [2:28:17<4:55:13,  3.49it/s]
 83%|████████▎ | 309617/371472 [2:28:18<4:49:23,  3.56it/s]
 83%|████████▎ | 309618/371472 [2:28:18<4:37:54,  3.71it/s]
 83%|████████▎ | 309619/371472 [2:28:18<4:53:20,  3.51it/s]
 83%|████████▎ | 309620/371472 [2:28:18<4:46:23,  3.60it/s]
                                                           
{'loss': 2.6457, 'learning_rate': 2.499353573660281e-07, 'epoch': 13.34}

 83%|████████▎ | 309620/371472 [2:28:18<4:46:23,  3.60it/s]
 83%|████████▎ | 309621/371472 [2:28:19<4:43:44,  3.63it/s]
 83%|████████▎ | 309622/371472 [2:28:19<4:50:10,  3.55it/s]
 83%|████████▎ | 309623/371472 [2:28:19<4:47:57,  3.58it/s]
 83%|████████▎ | 309624/371472 [2:28:20<4:43:46,  3.63it/s]
 83%|████████▎ | 309625/371472 [2:28:20<4:30:11,  3.81it/s]
 83%|████████▎ | 309626/371472 [2:28:20<4:28:38,  3.84it/s]
 83%|████████▎ | 309627/371472 [2:28:20<4:26:01,  3.87it/s]
 83%|████████▎ | 309628/371472 [2:28:21<4:51:06,  3.54it/s]
 83%|████████▎ | 309629/371472 [2:28:21<4:48:17,  3.58it/s]
 83%|████████▎ | 309630/371472 [2:28:21<5:03:41,  3.39it/s]
 83%|████████▎ | 309631/371472 [2:28:21<4:48:19,  3.57it/s]
 83%|████████▎ | 309632/371472 [2:28:22<4:42:14,  3.65it/s]
 83%|████████▎ | 309633/371472 [2:28:22<4:32:28,  3.78it/s]
 83%|████████▎ | 309634/371472 [2:28:22<4:34:34,  3.75it/s]
 83%|████████▎ | 309635/371472 [2:28:22<4:26:27,  3.87it/s]
 83%|████████▎ | 309636/371472 [2:28:23<4:23:12,  3.92it/s]
 83%|████████▎ | 309637/371472 [2:28:23<4:19:00,  3.98it/s]
 83%|████████▎ | 309638/371472 [2:28:23<4:20:31,  3.96it/s]
 83%|████████▎ | 309639/371472 [2:28:23<4:30:04,  3.82it/s]
 83%|████████▎ | 309640/371472 [2:28:24<4:40:29,  3.67it/s]
                                                           
{'loss': 2.8114, 'learning_rate': 2.498868753905493e-07, 'epoch': 13.34}

 83%|████████▎ | 309640/371472 [2:28:24<4:40:29,  3.67it/s]
 83%|████████▎ | 309641/371472 [2:28:24<4:36:31,  3.73it/s]
 83%|████████▎ | 309642/371472 [2:28:24<4:31:45,  3.79it/s]
 83%|████████▎ | 309643/371472 [2:28:25<4:29:52,  3.82it/s]
 83%|████████▎ | 309644/371472 [2:28:25<4:25:33,  3.88it/s]
 83%|████████▎ | 309645/371472 [2:28:25<4:30:18,  3.81it/s]
 83%|████████▎ | 309646/371472 [2:28:25<4:24:33,  3.89it/s]
 83%|████████▎ | 309647/371472 [2:28:26<4:26:54,  3.86it/s]
 83%|████████▎ | 309648/371472 [2:28:26<4:21:47,  3.94it/s]
 83%|████████▎ | 309649/371472 [2:28:26<4:28:29,  3.84it/s]
 83%|████████▎ | 309650/371472 [2:28:26<4:26:23,  3.87it/s]
 83%|████████▎ | 309651/371472 [2:28:27<4:26:29,  3.87it/s]
 83%|████████▎ | 309652/371472 [2:28:27<4:22:42,  3.92it/s]
 83%|████████▎ | 309653/371472 [2:28:27<4:35:56,  3.73it/s]
 83%|████████▎ | 309654/371472 [2:28:27<4:44:48,  3.62it/s]
 83%|████████▎ | 309655/371472 [2:28:28<4:34:11,  3.76it/s]
 83%|████████▎ | 309656/371472 [2:28:28<4:35:51,  3.73it/s]
 83%|████████▎ | 309657/371472 [2:28:28<4:35:08,  3.74it/s]
 83%|████████▎ | 309658/371472 [2:28:29<4:40:03,  3.68it/s]
 83%|████████▎ | 309659/371472 [2:28:29<4:46:34,  3.60it/s]
 83%|████████▎ | 309660/371472 [2:28:29<4:32:56,  3.77it/s]
                                                           
{'loss': 2.8209, 'learning_rate': 2.4983839341507035e-07, 'epoch': 13.34}

 83%|████████▎ | 309660/371472 [2:28:29<4:32:56,  3.77it/s]
 83%|████████▎ | 309661/371472 [2:28:29<4:29:59,  3.82it/s]
 83%|████████▎ | 309662/371472 [2:28:30<4:34:36,  3.75it/s]
 83%|████████▎ | 309663/371472 [2:28:30<4:28:31,  3.84it/s]
 83%|████████▎ | 309664/371472 [2:28:30<4:32:24,  3.78it/s]
 83%|████████▎ | 309665/371472 [2:28:30<4:29:00,  3.83it/s]
 83%|████████▎ | 309666/371472 [2:28:31<4:32:26,  3.78it/s]
 83%|████████▎ | 309667/371472 [2:28:31<5:04:08,  3.39it/s]
 83%|████████▎ | 309668/371472 [2:28:31<5:09:53,  3.32it/s]
 83%|████████▎ | 309669/371472 [2:28:32<5:04:02,  3.39it/s]
 83%|████████▎ | 309670/371472 [2:28:32<4:49:55,  3.55it/s]
 83%|████████▎ | 309671/371472 [2:28:32<4:45:36,  3.61it/s]
 83%|████████▎ | 309672/371472 [2:28:32<5:07:55,  3.34it/s]
 83%|████████▎ | 309673/371472 [2:28:33<5:02:54,  3.40it/s]
 83%|████████▎ | 309674/371472 [2:28:33<4:48:04,  3.58it/s]
 83%|████████▎ | 309675/371472 [2:28:33<4:59:28,  3.44it/s]
 83%|████████▎ | 309676/371472 [2:28:34<5:10:27,  3.32it/s]
 83%|████████▎ | 309677/371472 [2:28:34<5:15:22,  3.27it/s]
 83%|████████▎ | 309678/371472 [2:28:34<5:03:30,  3.39it/s]
 83%|████████▎ | 309679/371472 [2:28:34<5:04:02,  3.39it/s]
 83%|████████▎ | 309680/371472 [2:28:35<5:12:42,  3.29it/s]
                                                           
{'loss': 2.7457, 'learning_rate': 2.497899114395915e-07, 'epoch': 13.34}

 83%|████████▎ | 309680/371472 [2:28:35<5:12:42,  3.29it/s]
 83%|████████▎ | 309681/371472 [2:28:35<5:13:08,  3.29it/s]
 83%|████████▎ | 309682/371472 [2:28:35<5:06:17,  3.36it/s]
 83%|████████▎ | 309683/371472 [2:28:36<5:17:49,  3.24it/s]
 83%|████████▎ | 309684/371472 [2:28:36<5:18:33,  3.23it/s]
 83%|████████▎ | 309685/371472 [2:28:36<5:19:19,  3.22it/s]
 83%|████████▎ | 309686/371472 [2:28:37<5:04:13,  3.38it/s]
 83%|████████▎ | 309687/371472 [2:28:37<4:59:03,  3.44it/s]
 83%|████████▎ | 309688/371472 [2:28:37<4:57:32,  3.46it/s]
 83%|████████▎ | 309689/371472 [2:28:38<5:06:33,  3.36it/s]
 83%|████████▎ | 309690/371472 [2:28:38<5:14:31,  3.27it/s]
 83%|████████▎ | 309691/371472 [2:28:38<4:56:10,  3.48it/s]
 83%|████████▎ | 309692/371472 [2:28:38<4:43:53,  3.63it/s]
 83%|████████▎ | 309693/371472 [2:28:39<4:35:07,  3.74it/s]
 83%|████████▎ | 309694/371472 [2:28:39<4:31:39,  3.79it/s]
 83%|████████▎ | 309695/371472 [2:28:39<4:40:53,  3.67it/s]
 83%|████████▎ | 309696/371472 [2:28:39<4:44:49,  3.61it/s]
 83%|████████▎ | 309697/371472 [2:28:40<4:48:09,  3.57it/s]
 83%|████████▎ | 309698/371472 [2:28:40<4:54:15,  3.50it/s]
 83%|████████▎ | 309699/371472 [2:28:40<4:54:12,  3.50it/s]
 83%|████████▎ | 309700/371472 [2:28:41<5:01:02,  3.42it/s]
                                                           
{'loss': 2.6467, 'learning_rate': 2.497414294641125e-07, 'epoch': 13.34}

 83%|████████▎ | 309700/371472 [2:28:41<5:01:02,  3.42it/s]
 83%|████████▎ | 309701/371472 [2:28:41<4:55:46,  3.48it/s]
 83%|████████▎ | 309702/371472 [2:28:41<5:13:07,  3.29it/s]
 83%|████████▎ | 309703/371472 [2:28:41<4:55:01,  3.49it/s]
 83%|████████▎ | 309704/371472 [2:28:42<4:55:09,  3.49it/s]
 83%|████████▎ | 309705/371472 [2:28:42<4:47:39,  3.58it/s]
 83%|████████▎ | 309706/371472 [2:28:42<5:05:01,  3.37it/s]
 83%|████████▎ | 309707/371472 [2:28:43<4:56:54,  3.47it/s]
 83%|████████▎ | 309708/371472 [2:28:43<4:46:24,  3.59it/s]
 83%|████████▎ | 309709/371472 [2:28:43<4:40:16,  3.67it/s]
 83%|████████▎ | 309710/371472 [2:28:43<4:32:52,  3.77it/s]
 83%|████████▎ | 309711/371472 [2:28:44<4:30:24,  3.81it/s]
 83%|████████▎ | 309712/371472 [2:28:44<4:39:46,  3.68it/s]
 83%|████████▎ | 309713/371472 [2:28:44<4:41:54,  3.65it/s]
 83%|████████▎ | 309714/371472 [2:28:45<5:09:28,  3.33it/s]
 83%|████████▎ | 309715/371472 [2:28:45<4:59:14,  3.44it/s]
 83%|████████▎ | 309716/371472 [2:28:45<5:12:03,  3.30it/s]
 83%|████████▎ | 309717/371472 [2:28:45<5:23:53,  3.18it/s]
 83%|████████▎ | 309718/371472 [2:28:46<5:07:25,  3.35it/s]
 83%|████████▎ | 309719/371472 [2:28:46<5:03:47,  3.39it/s]
 83%|████████▎ | 309720/371472 [2:28:46<5:15:45,  3.26it/s]
                                                           
{'loss': 2.5921, 'learning_rate': 2.4969294748863367e-07, 'epoch': 13.34}

 83%|████████▎ | 309720/371472 [2:28:46<5:15:45,  3.26it/s]
 83%|████████▎ | 309721/371472 [2:28:47<5:04:51,  3.38it/s]
 83%|████████▎ | 309722/371472 [2:28:47<5:17:52,  3.24it/s]
 83%|████████▎ | 309723/371472 [2:28:47<4:55:05,  3.49it/s]
 83%|████████▎ | 309724/371472 [2:28:48<4:53:36,  3.51it/s]
 83%|████████▎ | 309725/371472 [2:28:48<4:38:34,  3.69it/s]
 83%|████████▎ | 309726/371472 [2:28:48<4:38:17,  3.70it/s]
 83%|████████▎ | 309727/371472 [2:28:48<5:01:14,  3.42it/s]
 83%|████████▎ | 309728/371472 [2:28:49<5:21:53,  3.20it/s]
 83%|████████▎ | 309729/371472 [2:28:49<5:02:51,  3.40it/s]
 83%|████████▎ | 309730/371472 [2:28:49<4:58:15,  3.45it/s]
 83%|████████▎ | 309731/371472 [2:28:50<4:50:31,  3.54it/s]
 83%|████████▎ | 309732/371472 [2:28:50<4:50:55,  3.54it/s]
 83%|████████▎ | 309733/371472 [2:28:50<4:45:30,  3.60it/s]
 83%|████████▎ | 309734/371472 [2:28:50<4:34:14,  3.75it/s]
 83%|████████▎ | 309735/371472 [2:28:51<4:23:59,  3.90it/s]
 83%|████████▎ | 309736/371472 [2:28:51<4:34:34,  3.75it/s]
 83%|████████▎ | 309737/371472 [2:28:51<4:43:05,  3.63it/s]
 83%|████████▎ | 309738/371472 [2:28:51<4:35:57,  3.73it/s]
 83%|████████▎ | 309739/371472 [2:28:52<4:28:25,  3.83it/s]
 83%|████████▎ | 309740/371472 [2:28:52<4:40:20,  3.67it/s]
                                                           
{'loss': 2.6578, 'learning_rate': 2.4964446551315474e-07, 'epoch': 13.34}

 83%|████████▎ | 309740/371472 [2:28:52<4:40:20,  3.67it/s]
 83%|████████▎ | 309741/371472 [2:28:52<4:41:49,  3.65it/s]
 83%|████████▎ | 309742/371472 [2:28:52<4:49:46,  3.55it/s]
 83%|████████▎ | 309743/371472 [2:28:53<5:09:26,  3.32it/s]
 83%|████████▎ | 309744/371472 [2:28:53<5:27:30,  3.14it/s]
 83%|████████▎ | 309745/371472 [2:28:53<5:17:20,  3.24it/s]
 83%|████████▎ | 309746/371472 [2:28:54<5:14:56,  3.27it/s]
 83%|████████▎ | 309747/371472 [2:28:54<5:13:04,  3.29it/s]
 83%|████████▎ | 309748/371472 [2:28:54<4:59:00,  3.44it/s]
 83%|████████▎ | 309749/371472 [2:28:55<5:09:30,  3.32it/s]
 83%|████████▎ | 309750/371472 [2:28:55<5:30:04,  3.12it/s]
 83%|████████▎ | 309751/371472 [2:28:55<5:11:18,  3.30it/s]
 83%|████████▎ | 309752/371472 [2:28:56<4:56:34,  3.47it/s]
 83%|████████▎ | 309753/371472 [2:28:56<4:47:38,  3.58it/s]
 83%|████████▎ | 309754/371472 [2:28:56<4:42:27,  3.64it/s]
 83%|████████▎ | 309755/371472 [2:28:56<4:40:33,  3.67it/s]
 83%|████████▎ | 309756/371472 [2:28:57<4:42:25,  3.64it/s]
 83%|████████▎ | 309757/371472 [2:28:57<5:01:29,  3.41it/s]
 83%|████████▎ | 309758/371472 [2:28:57<4:46:25,  3.59it/s]
 83%|████████▎ | 309759/371472 [2:28:58<5:07:53,  3.34it/s]
 83%|████████▎ | 309760/371472 [2:28:58<4:50:12,  3.54it/s]
                                                           
{'loss': 2.5365, 'learning_rate': 2.495959835376759e-07, 'epoch': 13.34}

 83%|████████▎ | 309760/371472 [2:28:58<4:50:12,  3.54it/s]
 83%|████████▎ | 309761/371472 [2:28:58<4:55:25,  3.48it/s]
 83%|████████▎ | 309762/371472 [2:28:58<5:03:49,  3.39it/s]
 83%|████████▎ | 309763/371472 [2:28:59<4:50:48,  3.54it/s]
 83%|████████▎ | 309764/371472 [2:28:59<4:46:06,  3.59it/s]
 83%|████████▎ | 309765/371472 [2:28:59<4:45:40,  3.60it/s]
 83%|████████▎ | 309766/371472 [2:28:59<4:35:07,  3.74it/s]
 83%|████████▎ | 309767/371472 [2:29:00<4:33:10,  3.76it/s]
 83%|████████▎ | 309768/371472 [2:29:00<4:52:18,  3.52it/s]
 83%|████████▎ | 309769/371472 [2:29:00<4:49:01,  3.56it/s]
 83%|████████▎ | 309770/371472 [2:29:01<4:42:23,  3.64it/s]
 83%|████████▎ | 309771/371472 [2:29:01<4:41:20,  3.66it/s]
 83%|████████▎ | 309772/371472 [2:29:01<4:59:35,  3.43it/s]
 83%|████████▎ | 309773/371472 [2:29:01<4:51:14,  3.53it/s]
 83%|████████▎ | 309774/371472 [2:29:02<4:43:57,  3.62it/s]
 83%|████████▎ | 309775/371472 [2:29:02<5:02:40,  3.40it/s]
 83%|████████▎ | 309776/371472 [2:29:02<5:34:55,  3.07it/s]
 83%|████████▎ | 309777/371472 [2:29:03<5:15:03,  3.26it/s]
 83%|████████▎ | 309778/371472 [2:29:03<5:08:24,  3.33it/s]
 83%|████████▎ | 309779/371472 [2:29:03<4:55:14,  3.48it/s]
 83%|████████▎ | 309780/371472 [2:29:04<4:54:18,  3.49it/s]
                                                           
{'loss': 2.5924, 'learning_rate': 2.49547501562197e-07, 'epoch': 13.34}

 83%|████████▎ | 309780/371472 [2:29:04<4:54:18,  3.49it/s]
 83%|████████▎ | 309781/371472 [2:29:04<4:45:35,  3.60it/s]
 83%|████████▎ | 309782/371472 [2:29:04<4:52:05,  3.52it/s]
 83%|████████▎ | 309783/371472 [2:29:04<4:57:58,  3.45it/s]
 83%|████████▎ | 309784/371472 [2:29:05<4:52:27,  3.52it/s]
 83%|████████▎ | 309785/371472 [2:29:05<4:56:14,  3.47it/s]
 83%|████████▎ | 309786/371472 [2:29:05<4:52:54,  3.51it/s]
 83%|████████▎ | 309787/371472 [2:29:06<4:51:13,  3.53it/s]
 83%|████████▎ | 309788/371472 [2:29:06<4:45:46,  3.60it/s]
 83%|████████▎ | 309789/371472 [2:29:06<4:45:56,  3.60it/s]
 83%|████████▎ | 309790/371472 [2:29:06<4:43:34,  3.63it/s]
 83%|████████▎ | 309791/371472 [2:29:07<4:46:13,  3.59it/s]
 83%|████████▎ | 309792/371472 [2:29:07<4:45:57,  3.59it/s]
 83%|████████▎ | 309793/371472 [2:29:07<4:53:08,  3.51it/s]
 83%|████████▎ | 309794/371472 [2:29:07<4:39:30,  3.68it/s]
 83%|████████▎ | 309795/371472 [2:29:08<4:36:17,  3.72it/s]
 83%|████████▎ | 309796/371472 [2:29:08<4:35:40,  3.73it/s]
 83%|████████▎ | 309797/371472 [2:29:08<4:53:19,  3.50it/s]
 83%|████████▎ | 309798/371472 [2:29:09<5:14:41,  3.27it/s]
 83%|████████▎ | 309799/371472 [2:29:09<5:00:14,  3.42it/s]
 83%|████████▎ | 309800/371472 [2:29:09<4:51:24,  3.53it/s]
                                                           
{'loss': 2.6519, 'learning_rate': 2.494990195867181e-07, 'epoch': 13.34}

 83%|████████▎ | 309800/371472 [2:29:09<4:51:24,  3.53it/s]
 83%|████████▎ | 309801/371472 [2:29:09<4:43:58,  3.62it/s]
 83%|████████▎ | 309802/371472 [2:29:10<4:42:07,  3.64it/s]
 83%|████████▎ | 309803/371472 [2:29:10<4:50:50,  3.53it/s]
 83%|████████▎ | 309804/371472 [2:29:10<4:51:02,  3.53it/s]
 83%|████████▎ | 309805/371472 [2:29:11<4:44:21,  3.61it/s]
 83%|████████▎ | 309806/371472 [2:29:11<4:42:24,  3.64it/s]
 83%|████████▎ | 309807/371472 [2:29:11<4:36:01,  3.72it/s]
 83%|████████▎ | 309808/371472 [2:29:11<4:33:13,  3.76it/s]
 83%|████████▎ | 309809/371472 [2:29:12<4:27:59,  3.83it/s]
 83%|████████▎ | 309810/371472 [2:29:12<5:03:20,  3.39it/s]
 83%|████████▎ | 309811/371472 [2:29:12<4:56:53,  3.46it/s]
 83%|████████▎ | 309812/371472 [2:29:12<4:47:38,  3.57it/s]
 83%|████████▎ | 309813/371472 [2:29:13<4:58:09,  3.45it/s]
 83%|████████▎ | 309814/371472 [2:29:13<5:04:42,  3.37it/s]
 83%|████████▎ | 309815/371472 [2:29:13<4:47:38,  3.57it/s]
 83%|████████▎ | 309816/371472 [2:29:14<4:49:06,  3.55it/s]
 83%|████████▎ | 309817/371472 [2:29:14<4:51:21,  3.53it/s]
 83%|████████▎ | 309818/371472 [2:29:14<5:03:30,  3.39it/s]
 83%|████████▎ | 309819/371472 [2:29:15<4:53:32,  3.50it/s]
 83%|████████▎ | 309820/371472 [2:29:15<5:12:32,  3.29it/s]
                                                           
{'loss': 2.4883, 'learning_rate': 2.494505376112392e-07, 'epoch': 13.34}

 83%|████████▎ | 309820/371472 [2:29:15<5:12:32,  3.29it/s]
 83%|████████▎ | 309821/371472 [2:29:15<5:02:15,  3.40it/s]
 83%|████████▎ | 309822/371472 [2:29:15<4:54:13,  3.49it/s]
 83%|████████▎ | 309823/371472 [2:29:16<5:47:46,  2.95it/s]
 83%|████████▎ | 309824/371472 [2:29:16<5:37:02,  3.05it/s]
 83%|████████▎ | 309825/371472 [2:29:16<5:32:22,  3.09it/s]
 83%|████████▎ | 309826/371472 [2:29:17<5:14:32,  3.27it/s]
 83%|████████▎ | 309827/371472 [2:29:17<5:13:58,  3.27it/s]
 83%|████████▎ | 309828/371472 [2:29:17<4:57:41,  3.45it/s]
 83%|████████▎ | 309829/371472 [2:29:18<4:59:53,  3.43it/s]
 83%|████████▎ | 309830/371472 [2:29:18<4:52:50,  3.51it/s]
 83%|████████▎ | 309831/371472 [2:29:18<4:47:05,  3.58it/s]
 83%|████████▎ | 309832/371472 [2:29:18<4:53:36,  3.50it/s]
 83%|████████▎ | 309833/371472 [2:29:19<4:44:14,  3.61it/s]
 83%|████████▎ | 309834/371472 [2:29:19<4:54:51,  3.48it/s]
 83%|████████▎ | 309835/371472 [2:29:19<4:53:02,  3.51it/s]
 83%|████████▎ | 309836/371472 [2:29:20<4:47:05,  3.58it/s]
 83%|████████▎ | 309837/371472 [2:29:20<4:39:55,  3.67it/s]
 83%|████████▎ | 309838/371472 [2:29:20<4:40:42,  3.66it/s]
 83%|████████▎ | 309839/371472 [2:29:20<4:42:14,  3.64it/s]
 83%|████████▎ | 309840/371472 [2:29:21<4:39:35,  3.67it/s]
                                                           
{'loss': 2.5973, 'learning_rate': 2.494020556357603e-07, 'epoch': 13.35}

 83%|████████▎ | 309840/371472 [2:29:21<4:39:35,  3.67it/s]
 83%|████████▎ | 309841/371472 [2:29:21<4:34:27,  3.74it/s]
 83%|████████▎ | 309842/371472 [2:29:21<4:40:20,  3.66it/s]
 83%|████████▎ | 309843/371472 [2:29:21<4:43:45,  3.62it/s]
 83%|████████▎ | 309844/371472 [2:29:22<4:54:29,  3.49it/s]
 83%|████████▎ | 309845/371472 [2:29:22<4:35:27,  3.73it/s]
 83%|████████▎ | 309846/371472 [2:29:22<4:37:25,  3.70it/s]
 83%|████████▎ | 309847/371472 [2:29:23<4:52:13,  3.51it/s]
 83%|████████▎ | 309848/371472 [2:29:23<5:15:39,  3.25it/s]
 83%|████████▎ | 309849/371472 [2:29:23<5:13:44,  3.27it/s]
 83%|████████▎ | 309850/371472 [2:29:23<5:03:47,  3.38it/s]
 83%|████████▎ | 309851/371472 [2:29:24<5:08:41,  3.33it/s]
 83%|████████▎ | 309852/371472 [2:29:24<5:12:52,  3.28it/s]
 83%|████████▎ | 309853/371472 [2:29:24<4:59:15,  3.43it/s]
 83%|████████▎ | 309854/371472 [2:29:25<5:30:16,  3.11it/s]
 83%|████████▎ | 309855/371472 [2:29:25<5:18:33,  3.22it/s]
 83%|████████▎ | 309856/371472 [2:29:25<5:12:35,  3.29it/s]
 83%|████████▎ | 309857/371472 [2:29:26<5:14:38,  3.26it/s]
 83%|████████▎ | 309858/371472 [2:29:26<5:04:36,  3.37it/s]
 83%|████████▎ | 309859/371472 [2:29:26<5:04:36,  3.37it/s]
 83%|████████▎ | 309860/371472 [2:29:27<5:07:23,  3.34it/s]
                                                           
{'loss': 2.4793, 'learning_rate': 2.493535736602814e-07, 'epoch': 13.35}

 83%|████████▎ | 309860/371472 [2:29:27<5:07:23,  3.34it/s]
 83%|████████▎ | 309861/371472 [2:29:27<5:04:26,  3.37it/s]
 83%|████████▎ | 309862/371472 [2:29:27<5:17:57,  3.23it/s]
 83%|████████▎ | 309863/371472 [2:29:28<5:27:58,  3.13it/s]
 83%|████████▎ | 309864/371472 [2:29:28<5:12:18,  3.29it/s]
 83%|████████▎ | 309865/371472 [2:29:28<4:58:33,  3.44it/s]
 83%|████████▎ | 309866/371472 [2:29:28<4:48:23,  3.56it/s]
 83%|████████▎ | 309867/371472 [2:29:29<4:42:26,  3.64it/s]
 83%|████████▎ | 309868/371472 [2:29:29<5:02:15,  3.40it/s]
 83%|████████▎ | 309869/371472 [2:29:29<4:53:16,  3.50it/s]
 83%|████████▎ | 309870/371472 [2:29:29<4:41:00,  3.65it/s]
 83%|████████▎ | 309871/371472 [2:29:30<4:51:24,  3.52it/s]
 83%|████████▎ | 309872/371472 [2:29:30<4:44:47,  3.61it/s]
 83%|████████▎ | 309873/371472 [2:29:30<4:41:05,  3.65it/s]
 83%|████████▎ | 309874/371472 [2:29:31<4:41:59,  3.64it/s]
 83%|████████▎ | 309875/371472 [2:29:31<4:34:38,  3.74it/s]
 83%|████████▎ | 309876/371472 [2:29:31<4:37:06,  3.70it/s]
 83%|████████▎ | 309877/371472 [2:29:31<4:29:59,  3.80it/s]
 83%|████████▎ | 309878/371472 [2:29:32<4:32:11,  3.77it/s]
 83%|████████▎ | 309879/371472 [2:29:32<4:44:35,  3.61it/s]
 83%|████████▎ | 309880/371472 [2:29:32<4:51:10,  3.53it/s]
                                                           
{'loss': 2.5769, 'learning_rate': 2.4930509168480256e-07, 'epoch': 13.35}

 83%|████████▎ | 309880/371472 [2:29:32<4:51:10,  3.53it/s]
 83%|████████▎ | 309881/371472 [2:29:32<4:44:06,  3.61it/s]
 83%|████████▎ | 309882/371472 [2:29:33<4:43:02,  3.63it/s]
 83%|████████▎ | 309883/371472 [2:29:33<4:29:28,  3.81it/s]
 83%|████████▎ | 309884/371472 [2:29:33<4:31:37,  3.78it/s]
 83%|████████▎ | 309885/371472 [2:29:33<4:27:19,  3.84it/s]
 83%|████████▎ | 309886/371472 [2:29:34<4:39:38,  3.67it/s]
 83%|████████▎ | 309887/371472 [2:29:34<4:36:46,  3.71it/s]
 83%|████████▎ | 309888/371472 [2:29:34<4:27:51,  3.83it/s]
 83%|████████▎ | 309889/371472 [2:29:35<4:28:11,  3.83it/s]
 83%|████████▎ | 309890/371472 [2:29:35<4:52:54,  3.50it/s]
 83%|████████▎ | 309891/371472 [2:29:35<4:39:24,  3.67it/s]
 83%|████████▎ | 309892/371472 [2:29:35<4:35:47,  3.72it/s]
 83%|████████▎ | 309893/371472 [2:29:36<4:36:21,  3.71it/s]
 83%|████████▎ | 309894/371472 [2:29:36<4:35:20,  3.73it/s]
 83%|████████▎ | 309895/371472 [2:29:36<4:42:42,  3.63it/s]
 83%|████████▎ | 309896/371472 [2:29:36<4:46:12,  3.59it/s]
 83%|████████▎ | 309897/371472 [2:29:37<4:38:13,  3.69it/s]
 83%|████████▎ | 309898/371472 [2:29:37<4:36:34,  3.71it/s]
 83%|████████▎ | 309899/371472 [2:29:37<4:32:37,  3.76it/s]
 83%|████████▎ | 309900/371472 [2:29:38<4:38:16,  3.69it/s]
                                                           
{'loss': 2.6924, 'learning_rate': 2.4925660970932363e-07, 'epoch': 13.35}

 83%|████████▎ | 309900/371472 [2:29:38<4:38:16,  3.69it/s]
 83%|████████▎ | 309901/371472 [2:29:38<4:48:54,  3.55it/s]
 83%|████████▎ | 309902/371472 [2:29:38<4:36:52,  3.71it/s]
 83%|████████▎ | 309903/371472 [2:29:38<4:30:43,  3.79it/s]
 83%|████████▎ | 309904/371472 [2:29:39<4:24:58,  3.87it/s]
 83%|████████▎ | 309905/371472 [2:29:39<4:18:52,  3.96it/s]
 83%|████████▎ | 309906/371472 [2:29:39<4:21:04,  3.93it/s]
 83%|████████▎ | 309907/371472 [2:29:39<4:18:45,  3.97it/s]
 83%|████████▎ | 309908/371472 [2:29:40<4:15:53,  4.01it/s]
 83%|████████▎ | 309909/371472 [2:29:40<4:26:58,  3.84it/s]
 83%|████████▎ | 309910/371472 [2:29:40<4:25:55,  3.86it/s]
 83%|████████▎ | 309911/371472 [2:29:40<4:44:38,  3.60it/s]
 83%|████████▎ | 309912/371472 [2:29:41<4:35:45,  3.72it/s]
 83%|████████▎ | 309913/371472 [2:29:41<4:27:46,  3.83it/s]
 83%|████████▎ | 309914/371472 [2:29:41<4:19:29,  3.95it/s]
 83%|████████▎ | 309915/371472 [2:29:42<4:59:54,  3.42it/s]
 83%|████████▎ | 309916/371472 [2:29:42<4:49:05,  3.55it/s]
 83%|████████▎ | 309917/371472 [2:29:42<4:57:14,  3.45it/s]
 83%|████████▎ | 309918/371472 [2:29:42<5:03:13,  3.38it/s]
 83%|████████▎ | 309919/371472 [2:29:43<5:07:27,  3.34it/s]
 83%|████████▎ | 309920/371472 [2:29:43<5:07:36,  3.33it/s]
                                                           
{'loss': 2.5114, 'learning_rate': 2.4920812773384476e-07, 'epoch': 13.35}

 83%|████████▎ | 309920/371472 [2:29:43<5:07:36,  3.33it/s]
 83%|████████▎ | 309921/371472 [2:29:43<4:48:58,  3.55it/s]
 83%|████████▎ | 309922/371472 [2:29:44<4:44:31,  3.61it/s]
 83%|████████▎ | 309923/371472 [2:29:44<4:51:00,  3.53it/s]
 83%|████████▎ | 309924/371472 [2:29:44<4:43:06,  3.62it/s]
 83%|████████▎ | 309925/371472 [2:29:44<4:42:20,  3.63it/s]
 83%|████████▎ | 309926/371472 [2:29:45<4:54:43,  3.48it/s]
 83%|████████▎ | 309927/371472 [2:29:45<4:41:44,  3.64it/s]
 83%|████████▎ | 309928/371472 [2:29:45<4:41:33,  3.64it/s]
 83%|████████▎ | 309929/371472 [2:29:45<4:37:36,  3.69it/s]
 83%|████████▎ | 309930/371472 [2:29:46<4:57:14,  3.45it/s]
 83%|████████▎ | 309931/371472 [2:29:46<4:58:39,  3.43it/s]
 83%|████████▎ | 309932/371472 [2:29:46<4:53:22,  3.50it/s]
 83%|████████▎ | 309933/371472 [2:29:47<4:56:39,  3.46it/s]
 83%|████████▎ | 309934/371472 [2:29:47<4:47:19,  3.57it/s]
 83%|████████▎ | 309935/371472 [2:29:47<5:04:44,  3.37it/s]
 83%|████████▎ | 309936/371472 [2:29:48<5:05:43,  3.35it/s]
 83%|████████▎ | 309937/371472 [2:29:48<5:17:17,  3.23it/s]
 83%|████████▎ | 309938/371472 [2:29:48<5:21:13,  3.19it/s]
 83%|████████▎ | 309939/371472 [2:29:49<5:15:16,  3.25it/s]
 83%|████████▎ | 309940/371472 [2:29:49<5:21:14,  3.19it/s]
                                                           
{'loss': 2.4798, 'learning_rate': 2.4915964575836583e-07, 'epoch': 13.35}

 83%|████████▎ | 309940/371472 [2:29:49<5:21:14,  3.19it/s]
 83%|████████▎ | 309941/371472 [2:29:49<5:21:42,  3.19it/s]
 83%|████████▎ | 309942/371472 [2:29:50<5:40:51,  3.01it/s]
 83%|████████▎ | 309943/371472 [2:29:50<5:23:28,  3.17it/s]
 83%|████████▎ | 309944/371472 [2:29:50<4:59:27,  3.42it/s]
 83%|████████▎ | 309945/371472 [2:29:50<4:42:18,  3.63it/s]
 83%|████████▎ | 309946/371472 [2:29:51<4:50:15,  3.53it/s]
 83%|████████▎ | 309947/371472 [2:29:51<4:58:49,  3.43it/s]
 83%|████████▎ | 309948/371472 [2:29:51<4:55:00,  3.48it/s]
 83%|████████▎ | 309949/371472 [2:29:51<4:47:44,  3.56it/s]
 83%|████████▎ | 309950/371472 [2:29:52<4:52:51,  3.50it/s]
 83%|████████▎ | 309951/371472 [2:29:52<4:44:23,  3.61it/s]
 83%|████████▎ | 309952/371472 [2:29:52<4:49:20,  3.54it/s]
 83%|████████▎ | 309953/371472 [2:29:53<4:48:30,  3.55it/s]
 83%|████████▎ | 309954/371472 [2:29:53<4:44:55,  3.60it/s]
 83%|████████▎ | 309955/371472 [2:29:53<4:33:19,  3.75it/s]
 83%|████████▎ | 309956/371472 [2:29:53<4:45:09,  3.60it/s]
 83%|████████▎ | 309957/371472 [2:29:54<4:45:23,  3.59it/s]
 83%|████████▎ | 309958/371472 [2:29:54<4:41:40,  3.64it/s]
 83%|████████▎ | 309959/371472 [2:29:54<4:37:02,  3.70it/s]
 83%|████████▎ | 309960/371472 [2:29:54<4:35:25,  3.72it/s]
                                                           
{'loss': 2.6611, 'learning_rate': 2.4911116378288685e-07, 'epoch': 13.35}

 83%|████████▎ | 309960/371472 [2:29:54<4:35:25,  3.72it/s]
 83%|████████▎ | 309961/371472 [2:29:55<4:37:10,  3.70it/s]
 83%|████████▎ | 309962/371472 [2:29:55<4:38:58,  3.67it/s]
 83%|████████▎ | 309963/371472 [2:29:55<4:57:02,  3.45it/s]
 83%|████████▎ | 309964/371472 [2:29:56<5:02:29,  3.39it/s]
 83%|████████▎ | 309965/371472 [2:29:56<4:48:16,  3.56it/s]
 83%|████████▎ | 309966/371472 [2:29:56<4:49:16,  3.54it/s]
 83%|████████▎ | 309967/371472 [2:29:56<4:40:22,  3.66it/s]
 83%|████████▎ | 309968/371472 [2:29:57<4:46:22,  3.58it/s]
 83%|████████▎ | 309969/371472 [2:29:57<4:47:54,  3.56it/s]
 83%|████████▎ | 309970/371472 [2:29:57<4:48:45,  3.55it/s]
 83%|████████▎ | 309971/371472 [2:29:58<4:56:39,  3.46it/s]
 83%|████████▎ | 309972/371472 [2:29:58<5:09:35,  3.31it/s]
 83%|████████▎ | 309973/371472 [2:29:58<5:04:09,  3.37it/s]
 83%|████████▎ | 309974/371472 [2:29:59<5:06:13,  3.35it/s]
 83%|████████▎ | 309975/371472 [2:29:59<5:05:50,  3.35it/s]
 83%|████████▎ | 309976/371472 [2:29:59<4:55:53,  3.46it/s]
 83%|████████▎ | 309977/371472 [2:29:59<4:50:33,  3.53it/s]
 83%|████████▎ | 309978/371472 [2:30:00<4:50:29,  3.53it/s]
 83%|████████▎ | 309979/371472 [2:30:00<4:36:21,  3.71it/s]
 83%|████████▎ | 309980/371472 [2:30:00<4:34:42,  3.73it/s]
                                                           
{'loss': 2.7054, 'learning_rate': 2.49062681807408e-07, 'epoch': 13.35}

 83%|████████▎ | 309980/371472 [2:30:00<4:34:42,  3.73it/s]
 83%|████████▎ | 309981/371472 [2:30:00<4:36:12,  3.71it/s]
 83%|████████▎ | 309982/371472 [2:30:01<4:37:43,  3.69it/s]
 83%|████████▎ | 309983/371472 [2:30:01<4:28:10,  3.82it/s]
 83%|████████▎ | 309984/371472 [2:30:01<4:30:22,  3.79it/s]
 83%|████████▎ | 309985/371472 [2:30:01<4:42:15,  3.63it/s]
 83%|████████▎ | 309986/371472 [2:30:02<4:47:54,  3.56it/s]
 83%|████████▎ | 309987/371472 [2:30:02<4:40:46,  3.65it/s]
 83%|████████▎ | 309988/371472 [2:30:02<4:40:35,  3.65it/s]
 83%|████████▎ | 309989/371472 [2:30:03<4:39:04,  3.67it/s]
 83%|████████▎ | 309990/371472 [2:30:03<4:37:23,  3.69it/s]
 83%|████████▎ | 309991/371472 [2:30:03<4:47:36,  3.56it/s]
 83%|████████▎ | 309992/371472 [2:30:03<4:51:42,  3.51it/s]
 83%|████████▎ | 309993/371472 [2:30:04<5:00:04,  3.41it/s]
 83%|████████▎ | 309994/371472 [2:30:04<4:44:26,  3.60it/s]
 83%|████████▎ | 309995/371472 [2:30:04<4:55:22,  3.47it/s]
 83%|████████▎ | 309996/371472 [2:30:05<4:46:27,  3.58it/s]
 83%|████████▎ | 309997/371472 [2:30:05<4:40:54,  3.65it/s]
 83%|████████▎ | 309998/371472 [2:30:05<4:50:04,  3.53it/s]
 83%|████████▎ | 309999/371472 [2:30:05<4:54:33,  3.48it/s]
 83%|████████▎ | 310000/371472 [2:30:06<4:44:23,  3.60it/s]
                                                           
{'loss': 2.5479, 'learning_rate': 2.490141998319291e-07, 'epoch': 13.35}

 83%|████████▎ | 310000/371472 [2:30:06<4:44:23,  3.60it/s]
 83%|████████▎ | 310001/371472 [2:30:06<4:43:04,  3.62it/s]
 83%|████████▎ | 310002/371472 [2:30:06<5:11:18,  3.29it/s]
 83%|████████▎ | 310003/371472 [2:30:07<4:54:29,  3.48it/s]
 83%|████████▎ | 310004/371472 [2:30:07<4:52:07,  3.51it/s]
 83%|████████▎ | 310005/371472 [2:30:07<4:57:12,  3.45it/s]
 83%|████████▎ | 310006/371472 [2:30:07<5:01:34,  3.40it/s]
 83%|████████▎ | 310007/371472 [2:30:08<4:48:42,  3.55it/s]
 83%|████████▎ | 310008/371472 [2:30:08<4:34:11,  3.74it/s]
 83%|████████▎ | 310009/371472 [2:30:08<4:35:13,  3.72it/s]
 83%|████████▎ | 310010/371472 [2:30:08<4:32:00,  3.77it/s]
 83%|████████▎ | 310011/371472 [2:30:09<4:30:13,  3.79it/s]
 83%|████████▎ | 310012/371472 [2:30:09<4:30:26,  3.79it/s]
 83%|████████▎ | 310013/371472 [2:30:09<4:24:18,  3.88it/s]
 83%|████████▎ | 310014/371472 [2:30:10<4:51:01,  3.52it/s]
 83%|████████▎ | 310015/371472 [2:30:10<4:39:39,  3.66it/s]
 83%|████████▎ | 310016/371472 [2:30:10<4:51:17,  3.52it/s]
 83%|████████▎ | 310017/371472 [2:30:10<4:47:14,  3.57it/s]
 83%|████████▎ | 310018/371472 [2:30:11<4:43:30,  3.61it/s]
 83%|████████▎ | 310019/371472 [2:30:11<4:45:04,  3.59it/s]
 83%|████████▎ | 310020/371472 [2:30:11<4:51:12,  3.52it/s]
                                                           
{'loss': 2.7308, 'learning_rate': 2.4896571785645027e-07, 'epoch': 13.35}

 83%|████████▎ | 310020/371472 [2:30:11<4:51:12,  3.52it/s]
 83%|████████▎ | 310021/371472 [2:30:12<4:45:37,  3.59it/s]
 83%|████████▎ | 310022/371472 [2:30:12<4:46:23,  3.58it/s]
 83%|████████▎ | 310023/371472 [2:30:12<4:45:56,  3.58it/s]
 83%|████████▎ | 310024/371472 [2:30:12<4:47:19,  3.56it/s]
 83%|████████▎ | 310025/371472 [2:30:13<4:32:47,  3.75it/s]
 83%|████████▎ | 310026/371472 [2:30:13<4:35:45,  3.71it/s]
 83%|████████▎ | 310027/371472 [2:30:13<4:37:33,  3.69it/s]
 83%|████████▎ | 310028/371472 [2:30:13<4:34:36,  3.73it/s]
 83%|████████▎ | 310029/371472 [2:30:14<4:39:07,  3.67it/s]
 83%|████████▎ | 310030/371472 [2:30:14<4:35:52,  3.71it/s]
 83%|████████▎ | 310031/371472 [2:30:14<4:41:35,  3.64it/s]
 83%|████████▎ | 310032/371472 [2:30:15<4:34:42,  3.73it/s]
 83%|████████▎ | 310033/371472 [2:30:15<4:28:15,  3.82it/s]
 83%|████████▎ | 310034/371472 [2:30:15<4:29:43,  3.80it/s]
 83%|████████▎ | 310035/371472 [2:30:15<4:49:21,  3.54it/s]
 83%|████████▎ | 310036/371472 [2:30:16<5:09:40,  3.31it/s]
 83%|████████▎ | 310037/371472 [2:30:16<5:07:16,  3.33it/s]
 83%|████████▎ | 310038/371472 [2:30:16<5:00:48,  3.40it/s]
 83%|████████▎ | 310039/371472 [2:30:17<4:55:01,  3.47it/s]
 83%|████████▎ | 310040/371472 [2:30:17<4:48:29,  3.55it/s]
                                                           
{'loss': 2.6109, 'learning_rate': 2.4891723588097134e-07, 'epoch': 13.35}

 83%|████████▎ | 310040/371472 [2:30:17<4:48:29,  3.55it/s]
 83%|████████▎ | 310041/371472 [2:30:17<4:42:22,  3.63it/s]
 83%|████████▎ | 310042/371472 [2:30:17<4:33:20,  3.75it/s]
 83%|████████▎ | 310043/371472 [2:30:18<4:36:59,  3.70it/s]
 83%|████████▎ | 310044/371472 [2:30:18<5:00:23,  3.41it/s]
 83%|████████▎ | 310045/371472 [2:30:18<5:12:47,  3.27it/s]
 83%|████████▎ | 310046/371472 [2:30:19<5:09:53,  3.30it/s]
 83%|████████▎ | 310047/371472 [2:30:19<4:49:58,  3.53it/s]
 83%|████████▎ | 310048/371472 [2:30:19<4:43:45,  3.61it/s]
 83%|████████▎ | 310049/371472 [2:30:19<4:41:17,  3.64it/s]
 83%|████████▎ | 310050/371472 [2:30:20<4:35:53,  3.71it/s]
 83%|████████▎ | 310051/371472 [2:30:20<4:51:00,  3.52it/s]
 83%|████████▎ | 310052/371472 [2:30:20<4:42:37,  3.62it/s]
 83%|████████▎ | 310053/371472 [2:30:20<4:37:52,  3.68it/s]
 83%|████████▎ | 310054/371472 [2:30:21<4:42:19,  3.63it/s]
 83%|████████▎ | 310055/371472 [2:30:21<4:43:02,  3.62it/s]
 83%|████████▎ | 310056/371472 [2:30:21<4:35:15,  3.72it/s]
 83%|████████▎ | 310057/371472 [2:30:22<4:32:05,  3.76it/s]
 83%|████████▎ | 310058/371472 [2:30:22<4:50:06,  3.53it/s]
 83%|████████▎ | 310059/371472 [2:30:22<4:55:09,  3.47it/s]
 83%|████████▎ | 310060/371472 [2:30:22<5:09:11,  3.31it/s]
                                                           
{'loss': 2.5903, 'learning_rate': 2.4886875390549247e-07, 'epoch': 13.35}

 83%|████████▎ | 310060/371472 [2:30:22<5:09:11,  3.31it/s]
 83%|████████▎ | 310061/371472 [2:30:23<5:01:59,  3.39it/s]
 83%|████████▎ | 310062/371472 [2:30:23<5:14:21,  3.26it/s]
 83%|████████▎ | 310063/371472 [2:30:23<5:11:54,  3.28it/s]
 83%|████████▎ | 310064/371472 [2:30:24<4:52:42,  3.50it/s]
 83%|████████▎ | 310065/371472 [2:30:24<4:50:30,  3.52it/s]
 83%|████████▎ | 310066/371472 [2:30:24<4:51:24,  3.51it/s]
 83%|████████▎ | 310067/371472 [2:30:24<4:41:49,  3.63it/s]
 83%|████████▎ | 310068/371472 [2:30:25<4:50:34,  3.52it/s]
 83%|████████▎ | 310069/371472 [2:30:25<4:44:58,  3.59it/s]
 83%|████████▎ | 310070/371472 [2:30:25<4:48:53,  3.54it/s]
 83%|████████▎ | 310071/371472 [2:30:26<4:42:53,  3.62it/s]
 83%|████████▎ | 310072/371472 [2:30:26<4:40:26,  3.65it/s]
 83%|████████▎ | 310073/371472 [2:30:26<4:41:06,  3.64it/s]
 83%|████████▎ | 310074/371472 [2:30:26<4:42:12,  3.63it/s]
 83%|████████▎ | 310075/371472 [2:30:27<4:49:29,  3.53it/s]
 83%|████████▎ | 310076/371472 [2:30:27<4:59:13,  3.42it/s]
 83%|████████▎ | 310077/371472 [2:30:27<4:53:45,  3.48it/s]
 83%|████████▎ | 310078/371472 [2:30:28<5:10:09,  3.30it/s]
 83%|████████▎ | 310079/371472 [2:30:28<4:56:02,  3.46it/s]
 83%|████████▎ | 310080/371472 [2:30:28<5:07:18,  3.33it/s]
                                                           
{'loss': 2.6304, 'learning_rate': 2.488202719300135e-07, 'epoch': 13.36}

 83%|████████▎ | 310080/371472 [2:30:28<5:07:18,  3.33it/s]
 83%|████████▎ | 310081/371472 [2:30:28<4:55:43,  3.46it/s]
 83%|████████▎ | 310082/371472 [2:30:29<5:04:12,  3.36it/s]
 83%|████████▎ | 310083/371472 [2:30:29<5:15:56,  3.24it/s]
 83%|████████▎ | 310084/371472 [2:30:29<5:09:31,  3.31it/s]
 83%|████████▎ | 310085/371472 [2:30:30<5:25:31,  3.14it/s]
 83%|████████▎ | 310086/371472 [2:30:30<5:07:04,  3.33it/s]
 83%|████████▎ | 310087/371472 [2:30:30<4:57:47,  3.44it/s]
 83%|████████▎ | 310088/371472 [2:30:31<4:42:15,  3.62it/s]
 83%|████████▎ | 310089/371472 [2:30:31<4:37:33,  3.69it/s]
 83%|████████▎ | 310090/371472 [2:30:31<4:41:28,  3.63it/s]
 83%|████████▎ | 310091/371472 [2:30:31<4:43:18,  3.61it/s]
 83%|████████▎ | 310092/371472 [2:30:32<4:40:43,  3.64it/s]
 83%|████████▎ | 310093/371472 [2:30:32<4:55:57,  3.46it/s]
 83%|████████▎ | 310094/371472 [2:30:32<4:57:34,  3.44it/s]
 83%|████████▎ | 310095/371472 [2:30:33<4:51:53,  3.50it/s]
 83%|████████▎ | 310096/371472 [2:30:33<5:06:02,  3.34it/s]
 83%|████████▎ | 310097/371472 [2:30:33<5:01:50,  3.39it/s]
 83%|████████▎ | 310098/371472 [2:30:33<4:55:56,  3.46it/s]
 83%|████████▎ | 310099/371472 [2:30:34<4:53:41,  3.48it/s]
 83%|████████▎ | 310100/371472 [2:30:34<4:37:14,  3.69it/s]
                                                           
{'loss': 2.6033, 'learning_rate': 2.4877178995453466e-07, 'epoch': 13.36}

 83%|████████▎ | 310100/371472 [2:30:34<4:37:14,  3.69it/s]
 83%|████████▎ | 310101/371472 [2:30:34<4:31:21,  3.77it/s]
 83%|████████▎ | 310102/371472 [2:30:34<4:40:33,  3.65it/s]
 83%|████████▎ | 310103/371472 [2:30:35<4:38:31,  3.67it/s]
 83%|████████▎ | 310104/371472 [2:30:35<4:48:21,  3.55it/s]
 83%|████████▎ | 310105/371472 [2:30:35<4:40:31,  3.65it/s]
 83%|████████▎ | 310106/371472 [2:30:36<4:36:02,  3.71it/s]
 83%|████████▎ | 310107/371472 [2:30:36<4:44:46,  3.59it/s]
 83%|████████▎ | 310108/371472 [2:30:36<5:17:44,  3.22it/s]
 83%|████████▎ | 310109/371472 [2:30:37<5:14:48,  3.25it/s]
 83%|████████▎ | 310110/371472 [2:30:37<5:04:46,  3.36it/s]
 83%|████████▎ | 310111/371472 [2:30:37<4:50:13,  3.52it/s]
 83%|████████▎ | 310112/371472 [2:30:37<4:35:55,  3.71it/s]
 83%|████████▎ | 310113/371472 [2:30:38<4:31:08,  3.77it/s]
 83%|████████▎ | 310114/371472 [2:30:38<4:35:30,  3.71it/s]
 83%|████████▎ | 310115/371472 [2:30:38<4:34:45,  3.72it/s]
 83%|████████▎ | 310116/371472 [2:30:38<4:32:50,  3.75it/s]
 83%|████████▎ | 310117/371472 [2:30:39<4:35:50,  3.71it/s]
 83%|████████▎ | 310118/371472 [2:30:39<4:30:14,  3.78it/s]
 83%|████████▎ | 310119/371472 [2:30:39<4:23:55,  3.87it/s]
 83%|████████▎ | 310120/371472 [2:30:39<4:18:09,  3.96it/s]
                                                           
{'loss': 2.6583, 'learning_rate': 2.4872330797905574e-07, 'epoch': 13.36}

 83%|████████▎ | 310120/371472 [2:30:39<4:18:09,  3.96it/s]
 83%|████████▎ | 310121/371472 [2:30:40<4:21:17,  3.91it/s]
 83%|████████▎ | 310122/371472 [2:30:40<4:26:37,  3.84it/s]
 83%|████████▎ | 310123/371472 [2:30:40<4:42:44,  3.62it/s]
 83%|████████▎ | 310124/371472 [2:30:41<4:57:09,  3.44it/s]
 83%|████████▎ | 310125/371472 [2:30:41<4:47:46,  3.55it/s]
 83%|████████▎ | 310126/371472 [2:30:41<5:05:36,  3.35it/s]
 83%|████████▎ | 310127/371472 [2:30:41<5:06:40,  3.33it/s]
 83%|████████▎ | 310128/371472 [2:30:42<4:53:45,  3.48it/s]
 83%|████████▎ | 310129/371472 [2:30:42<4:42:22,  3.62it/s]
 83%|████████▎ | 310130/371472 [2:30:42<5:21:01,  3.18it/s]
 83%|████████▎ | 310131/371472 [2:30:43<5:14:59,  3.25it/s]
 83%|████████▎ | 310132/371472 [2:30:43<5:11:21,  3.28it/s]
 83%|████████▎ | 310133/371472 [2:30:43<5:10:45,  3.29it/s]
 83%|████████▎ | 310134/371472 [2:30:44<4:56:59,  3.44it/s]
 83%|████████▎ | 310135/371472 [2:30:44<4:47:31,  3.56it/s]
 83%|████████▎ | 310136/371472 [2:30:44<4:59:22,  3.41it/s]
 83%|████████▎ | 310137/371472 [2:30:44<4:47:41,  3.55it/s]
 83%|████████▎ | 310138/371472 [2:30:45<4:41:39,  3.63it/s]
 83%|████████▎ | 310139/371472 [2:30:45<5:04:48,  3.35it/s]
 83%|████████▎ | 310140/371472 [2:30:45<4:53:15,  3.49it/s]
                                                           
{'loss': 2.5792, 'learning_rate': 2.486748260035769e-07, 'epoch': 13.36}

 83%|████████▎ | 310140/371472 [2:30:45<4:53:15,  3.49it/s]
 83%|████████▎ | 310141/371472 [2:30:45<4:46:33,  3.57it/s]
 83%|████████▎ | 310142/371472 [2:30:46<4:42:28,  3.62it/s]
 83%|████████▎ | 310143/371472 [2:30:46<4:43:56,  3.60it/s]
 83%|████████▎ | 310144/371472 [2:30:46<4:59:52,  3.41it/s]
 83%|████████▎ | 310145/371472 [2:30:47<4:59:50,  3.41it/s]
 83%|████████▎ | 310146/371472 [2:30:47<4:54:57,  3.47it/s]
 83%|████████▎ | 310147/371472 [2:30:47<4:58:27,  3.42it/s]
 83%|████████▎ | 310148/371472 [2:30:48<4:57:03,  3.44it/s]
 83%|████████▎ | 310149/371472 [2:30:48<4:43:22,  3.61it/s]
 83%|████████▎ | 310150/371472 [2:30:48<4:57:45,  3.43it/s]
 83%|████████▎ | 310151/371472 [2:30:48<4:55:50,  3.45it/s]
 83%|████████▎ | 310152/371472 [2:30:49<4:53:42,  3.48it/s]
 83%|████████▎ | 310153/371472 [2:30:49<4:47:14,  3.56it/s]
 83%|████████▎ | 310154/371472 [2:30:49<4:41:36,  3.63it/s]
 83%|████████▎ | 310155/371472 [2:30:50<4:51:28,  3.51it/s]
 83%|████████▎ | 310156/371472 [2:30:50<4:47:05,  3.56it/s]
 83%|████████▎ | 310157/371472 [2:30:50<4:56:16,  3.45it/s]
 83%|████████▎ | 310158/371472 [2:30:50<4:59:51,  3.41it/s]
 83%|████████▎ | 310159/371472 [2:30:51<5:00:03,  3.41it/s]
 83%|████████▎ | 310160/371472 [2:30:51<4:49:44,  3.53it/s]
                                                           
{'loss': 2.3862, 'learning_rate': 2.48626344028098e-07, 'epoch': 13.36}

 83%|████████▎ | 310160/371472 [2:30:51<4:49:44,  3.53it/s]
 83%|████████▎ | 310161/371472 [2:30:51<4:48:38,  3.54it/s]
 83%|████████▎ | 310162/371472 [2:30:52<4:55:35,  3.46it/s]
 83%|████████▎ | 310163/371472 [2:30:52<4:50:41,  3.52it/s]
 83%|████████▎ | 310164/371472 [2:30:52<4:50:40,  3.52it/s]
 83%|████████▎ | 310165/371472 [2:30:52<4:44:38,  3.59it/s]
 83%|████████▎ | 310166/371472 [2:30:53<4:40:04,  3.65it/s]
 83%|████████▎ | 310167/371472 [2:30:53<4:29:13,  3.80it/s]
 83%|████████▎ | 310168/371472 [2:30:53<4:30:08,  3.78it/s]
 83%|████████▎ | 310169/371472 [2:30:53<4:35:47,  3.70it/s]
 83%|████████▎ | 310170/371472 [2:30:54<4:50:59,  3.51it/s]
 83%|████████▎ | 310171/371472 [2:30:54<4:53:29,  3.48it/s]
 83%|████████▎ | 310172/371472 [2:30:54<4:57:17,  3.44it/s]
 83%|████████▎ | 310173/371472 [2:30:55<5:16:04,  3.23it/s]
 83%|████████▎ | 310174/371472 [2:30:55<5:25:22,  3.14it/s]
 83%|████████▎ | 310175/371472 [2:30:55<5:13:45,  3.26it/s]
 83%|████████▎ | 310176/371472 [2:30:56<5:02:49,  3.37it/s]
 83%|████████▎ | 310177/371472 [2:30:56<5:05:02,  3.35it/s]
 83%|████████▎ | 310178/371472 [2:30:56<5:03:35,  3.36it/s]
 83%|████████▎ | 310179/371472 [2:30:56<5:05:00,  3.35it/s]
 84%|████████▎ | 310180/371472 [2:30:57<4:58:53,  3.42it/s]
                                                           
{'loss': 2.6694, 'learning_rate': 2.485778620526191e-07, 'epoch': 13.36}

 84%|████████▎ | 310180/371472 [2:30:57<4:58:53,  3.42it/s]
 84%|████████▎ | 310181/371472 [2:30:57<4:58:29,  3.42it/s]
 84%|████████▎ | 310182/371472 [2:30:57<4:57:28,  3.43it/s]
 84%|████████▎ | 310183/371472 [2:30:58<4:46:01,  3.57it/s]
 84%|████████▎ | 310184/371472 [2:30:58<4:34:32,  3.72it/s]
 84%|████████▎ | 310185/371472 [2:30:58<4:32:21,  3.75it/s]
 84%|████████▎ | 310186/371472 [2:30:58<4:42:56,  3.61it/s]
 84%|████████▎ | 310187/371472 [2:30:59<4:36:28,  3.69it/s]
 84%|████████▎ | 310188/371472 [2:30:59<4:39:47,  3.65it/s]
 84%|████████▎ | 310189/371472 [2:30:59<4:36:28,  3.69it/s]
 84%|████████▎ | 310190/371472 [2:30:59<4:33:14,  3.74it/s]
 84%|████████▎ | 310191/371472 [2:31:00<4:38:39,  3.67it/s]
 84%|████████▎ | 310192/371472 [2:31:00<4:41:26,  3.63it/s]
 84%|████████▎ | 310193/371472 [2:31:00<4:37:40,  3.68it/s]
 84%|████████▎ | 310194/371472 [2:31:01<4:28:38,  3.80it/s]
 84%|████████▎ | 310195/371472 [2:31:01<4:32:32,  3.75it/s]
 84%|████████▎ | 310196/371472 [2:31:01<4:34:28,  3.72it/s]
 84%|████████▎ | 310197/371472 [2:31:01<4:34:40,  3.72it/s]
 84%|████████▎ | 310198/371472 [2:31:02<4:57:12,  3.44it/s]
 84%|████████▎ | 310199/371472 [2:31:02<4:42:20,  3.62it/s]
 84%|████████▎ | 310200/371472 [2:31:02<4:35:33,  3.71it/s]
                                                           
{'loss': 2.6157, 'learning_rate': 2.485293800771402e-07, 'epoch': 13.36}

 84%|████████▎ | 310200/371472 [2:31:02<4:35:33,  3.71it/s]
 84%|████████▎ | 310201/371472 [2:31:02<4:38:06,  3.67it/s]
 84%|████████▎ | 310202/371472 [2:31:03<4:35:20,  3.71it/s]
 84%|████████▎ | 310203/371472 [2:31:03<4:34:06,  3.73it/s]
 84%|████████▎ | 310204/371472 [2:31:03<4:34:41,  3.72it/s]
 84%|████████▎ | 310205/371472 [2:31:04<4:37:57,  3.67it/s]
 84%|████████▎ | 310206/371472 [2:31:04<4:28:59,  3.80it/s]
 84%|████████▎ | 310207/371472 [2:31:04<4:50:15,  3.52it/s]
 84%|████████▎ | 310208/371472 [2:31:04<4:51:26,  3.50it/s]
 84%|████████▎ | 310209/371472 [2:31:05<4:46:34,  3.56it/s]
 84%|████████▎ | 310210/371472 [2:31:05<4:40:20,  3.64it/s]
 84%|████████▎ | 310211/371472 [2:31:05<4:39:01,  3.66it/s]
 84%|████████▎ | 310212/371472 [2:31:05<4:38:01,  3.67it/s]
 84%|████████▎ | 310213/371472 [2:31:06<4:44:57,  3.58it/s]
 84%|████████▎ | 310214/371472 [2:31:06<4:44:20,  3.59it/s]
 84%|████████▎ | 310215/371472 [2:31:06<4:44:36,  3.59it/s]
 84%|████████▎ | 310216/371472 [2:31:07<5:10:22,  3.29it/s]
 84%|████████▎ | 310217/371472 [2:31:07<5:06:55,  3.33it/s]
 84%|████████▎ | 310218/371472 [2:31:07<4:53:07,  3.48it/s]
 84%|████████▎ | 310219/371472 [2:31:07<4:42:08,  3.62it/s]
 84%|████████▎ | 310220/371472 [2:31:08<4:53:30,  3.48it/s]
                                                           
{'loss': 2.5402, 'learning_rate': 2.484808981016613e-07, 'epoch': 13.36}

 84%|████████▎ | 310220/371472 [2:31:08<4:53:30,  3.48it/s]
 84%|████████▎ | 310221/371472 [2:31:08<4:42:18,  3.62it/s]
 84%|████████▎ | 310222/371472 [2:31:08<5:05:55,  3.34it/s]
 84%|████████▎ | 310223/371472 [2:31:09<4:58:01,  3.43it/s]
 84%|████████▎ | 310224/371472 [2:31:09<4:44:17,  3.59it/s]
 84%|████████▎ | 310225/371472 [2:31:09<4:39:57,  3.65it/s]
 84%|████████▎ | 310226/371472 [2:31:09<4:39:42,  3.65it/s]
 84%|████████▎ | 310227/371472 [2:31:10<4:40:57,  3.63it/s]
 84%|████████▎ | 310228/371472 [2:31:10<4:39:55,  3.65it/s]
 84%|████████▎ | 310229/371472 [2:31:10<4:28:53,  3.80it/s]
 84%|████████▎ | 310230/371472 [2:31:11<4:44:42,  3.59it/s]
 84%|████████▎ | 310231/371472 [2:31:11<4:51:14,  3.50it/s]
 84%|████████▎ | 310232/371472 [2:31:11<5:12:16,  3.27it/s]
 84%|████████▎ | 310233/371472 [2:31:11<5:03:27,  3.36it/s]
 84%|████████▎ | 310234/371472 [2:31:12<4:54:37,  3.46it/s]
 84%|████████▎ | 310235/371472 [2:31:12<4:50:44,  3.51it/s]
 84%|████████▎ | 310236/371472 [2:31:13<5:50:18,  2.91it/s]
 84%|████████▎ | 310237/371472 [2:31:13<5:20:06,  3.19it/s]
 84%|████████▎ | 310238/371472 [2:31:13<4:56:58,  3.44it/s]
 84%|████████▎ | 310239/371472 [2:31:13<4:49:35,  3.52it/s]
 84%|████████▎ | 310240/371472 [2:31:14<4:47:47,  3.55it/s]
                                                           
{'loss': 2.755, 'learning_rate': 2.484324161261824e-07, 'epoch': 13.36}

 84%|████████▎ | 310240/371472 [2:31:14<4:47:47,  3.55it/s]
 84%|████████▎ | 310241/371472 [2:31:14<4:38:27,  3.66it/s]
 84%|████████▎ | 310242/371472 [2:31:14<4:57:00,  3.44it/s]
 84%|████████▎ | 310243/371472 [2:31:14<4:46:35,  3.56it/s]
 84%|████████▎ | 310244/371472 [2:31:15<4:59:11,  3.41it/s]
 84%|████████▎ | 310245/371472 [2:31:15<5:23:55,  3.15it/s]
 84%|████████▎ | 310246/371472 [2:31:15<5:02:32,  3.37it/s]
 84%|████████▎ | 310247/371472 [2:31:16<4:44:29,  3.59it/s]
 84%|████████▎ | 310248/371472 [2:31:16<4:32:52,  3.74it/s]
 84%|████████▎ | 310249/371472 [2:31:16<4:52:54,  3.48it/s]
 84%|████████▎ | 310250/371472 [2:31:16<4:54:51,  3.46it/s]
 84%|████████▎ | 310251/371472 [2:31:17<4:49:33,  3.52it/s]
 84%|████████▎ | 310252/371472 [2:31:17<4:49:12,  3.53it/s]
 84%|████████▎ | 310253/371472 [2:31:17<4:41:32,  3.62it/s]
 84%|████████▎ | 310254/371472 [2:31:18<4:41:32,  3.62it/s]
 84%|████████▎ | 310255/371472 [2:31:18<4:45:19,  3.58it/s]
 84%|████████▎ | 310256/371472 [2:31:18<4:42:58,  3.61it/s]
 84%|████████▎ | 310257/371472 [2:31:18<4:44:21,  3.59it/s]
 84%|████████▎ | 310258/371472 [2:31:19<5:01:28,  3.38it/s]
 84%|████████▎ | 310259/371472 [2:31:19<4:56:18,  3.44it/s]
 84%|████████▎ | 310260/371472 [2:31:19<4:57:55,  3.42it/s]
                                                           
{'loss': 2.6288, 'learning_rate': 2.4838393415070355e-07, 'epoch': 13.36}

 84%|████████▎ | 310260/371472 [2:31:19<4:57:55,  3.42it/s]
 84%|████████▎ | 310261/371472 [2:31:20<4:40:32,  3.64it/s]
 84%|████████▎ | 310262/371472 [2:31:20<4:59:23,  3.41it/s]
 84%|████████▎ | 310263/371472 [2:31:20<5:04:33,  3.35it/s]
 84%|████████▎ | 310264/371472 [2:31:20<5:06:59,  3.32it/s]
 84%|████████▎ | 310265/371472 [2:31:21<4:58:05,  3.42it/s]
 84%|████████▎ | 310266/371472 [2:31:21<4:55:17,  3.45it/s]
 84%|████████▎ | 310267/371472 [2:31:21<5:04:45,  3.35it/s]
 84%|████████▎ | 310268/371472 [2:31:22<4:54:44,  3.46it/s]
 84%|████████▎ | 310269/371472 [2:31:22<4:55:26,  3.45it/s]
 84%|████████▎ | 310270/371472 [2:31:22<4:46:29,  3.56it/s]
 84%|████████▎ | 310271/371472 [2:31:23<5:10:18,  3.29it/s]
 84%|████████▎ | 310272/371472 [2:31:23<5:29:42,  3.09it/s]
 84%|████████▎ | 310273/371472 [2:31:23<5:19:59,  3.19it/s]
 84%|████████▎ | 310274/371472 [2:31:23<5:04:54,  3.35it/s]
 84%|████████▎ | 310275/371472 [2:31:24<5:00:13,  3.40it/s]
 84%|████████▎ | 310276/371472 [2:31:24<4:55:15,  3.45it/s]
 84%|████████▎ | 310277/371472 [2:31:24<4:39:59,  3.64it/s]
 84%|████████▎ | 310278/371472 [2:31:25<5:01:47,  3.38it/s]
 84%|████████▎ | 310279/371472 [2:31:25<4:56:55,  3.43it/s]
 84%|████████▎ | 310280/371472 [2:31:25<4:54:17,  3.47it/s]
                                                           
{'loss': 2.7295, 'learning_rate': 2.483354521752246e-07, 'epoch': 13.36}

 84%|████████▎ | 310280/371472 [2:31:25<4:54:17,  3.47it/s]
 84%|████████▎ | 310281/371472 [2:31:25<4:48:47,  3.53it/s]
 84%|████████▎ | 310282/371472 [2:31:26<4:47:24,  3.55it/s]
 84%|████████▎ | 310283/371472 [2:31:26<4:46:26,  3.56it/s]
 84%|████████▎ | 310284/371472 [2:31:26<4:43:53,  3.59it/s]
 84%|████████▎ | 310285/371472 [2:31:27<4:39:16,  3.65it/s]
 84%|████████▎ | 310286/371472 [2:31:27<4:37:51,  3.67it/s]
 84%|████████▎ | 310287/371472 [2:31:27<4:49:13,  3.53it/s]
 84%|████████▎ | 310288/371472 [2:31:27<4:59:22,  3.41it/s]
 84%|████████▎ | 310289/371472 [2:31:28<4:49:12,  3.53it/s]
 84%|████████▎ | 310290/371472 [2:31:28<5:22:25,  3.16it/s]
 84%|████████▎ | 310291/371472 [2:31:28<5:27:52,  3.11it/s]
 84%|████████▎ | 310292/371472 [2:31:29<5:07:16,  3.32it/s]
 84%|████████▎ | 310293/371472 [2:31:29<5:07:10,  3.32it/s]
 84%|████████▎ | 310294/371472 [2:31:29<4:53:12,  3.48it/s]
 84%|████████▎ | 310295/371472 [2:31:29<4:50:01,  3.52it/s]
 84%|████████▎ | 310296/371472 [2:31:30<4:49:21,  3.52it/s]
 84%|████████▎ | 310297/371472 [2:31:30<4:50:23,  3.51it/s]
 84%|████████▎ | 310298/371472 [2:31:30<4:46:00,  3.56it/s]
 84%|████████▎ | 310299/371472 [2:31:31<4:35:00,  3.71it/s]
 84%|████████▎ | 310300/371472 [2:31:31<4:39:17,  3.65it/s]
                                                           
{'loss': 2.5844, 'learning_rate': 2.4828697019974575e-07, 'epoch': 13.37}

 84%|████████▎ | 310300/371472 [2:31:31<4:39:17,  3.65it/s]
 84%|████████▎ | 310301/371472 [2:31:31<4:42:43,  3.61it/s]
 84%|████████▎ | 310302/371472 [2:31:31<4:44:19,  3.59it/s]
 84%|████████▎ | 310303/371472 [2:31:32<4:47:30,  3.55it/s]
 84%|████████▎ | 310304/371472 [2:31:32<4:41:51,  3.62it/s]
 84%|████████▎ | 310305/371472 [2:31:32<5:05:12,  3.34it/s]
 84%|████████▎ | 310306/371472 [2:31:33<4:48:01,  3.54it/s]
 84%|████████▎ | 310307/371472 [2:31:33<4:36:03,  3.69it/s]
 84%|████████▎ | 310308/371472 [2:31:33<4:36:04,  3.69it/s]
 84%|████████▎ | 310309/371472 [2:31:33<4:46:28,  3.56it/s]
 84%|████████▎ | 310310/371472 [2:31:34<4:37:41,  3.67it/s]
 84%|████████▎ | 310311/371472 [2:31:34<4:30:49,  3.76it/s]
 84%|████████▎ | 310312/371472 [2:31:34<4:22:55,  3.88it/s]
 84%|████████▎ | 310313/371472 [2:31:34<4:20:41,  3.91it/s]
 84%|████████▎ | 310314/371472 [2:31:35<4:21:06,  3.90it/s]
 84%|████████▎ | 310315/371472 [2:31:35<4:16:02,  3.98it/s]
 84%|████████▎ | 310316/371472 [2:31:35<4:41:10,  3.63it/s]
 84%|████████▎ | 310317/371472 [2:31:35<4:43:06,  3.60it/s]
 84%|████████▎ | 310318/371472 [2:31:36<4:54:11,  3.46it/s]
 84%|████████▎ | 310319/371472 [2:31:36<4:52:32,  3.48it/s]
 84%|████████▎ | 310320/371472 [2:31:36<4:55:22,  3.45it/s]
                                                           
{'loss': 2.7444, 'learning_rate': 2.482384882242668e-07, 'epoch': 13.37}

 84%|████████▎ | 310320/371472 [2:31:36<4:55:22,  3.45it/s]
 84%|████████▎ | 310321/371472 [2:31:37<4:48:13,  3.54it/s]
 84%|████████▎ | 310322/371472 [2:31:37<4:48:51,  3.53it/s]
 84%|████████▎ | 310323/371472 [2:31:37<4:39:18,  3.65it/s]
 84%|████████▎ | 310324/371472 [2:31:37<4:46:15,  3.56it/s]
 84%|████████▎ | 310325/371472 [2:31:38<4:50:39,  3.51it/s]
 84%|████████▎ | 310326/371472 [2:31:38<4:49:41,  3.52it/s]
 84%|████████▎ | 310327/371472 [2:31:38<4:40:14,  3.64it/s]
 84%|████████▎ | 310328/371472 [2:31:39<4:33:19,  3.73it/s]
 84%|████████▎ | 310329/371472 [2:31:39<4:34:54,  3.71it/s]
 84%|████████▎ | 310330/371472 [2:31:39<4:36:58,  3.68it/s]
 84%|████████▎ | 310331/371472 [2:31:39<4:38:16,  3.66it/s]
 84%|████████▎ | 310332/371472 [2:31:40<4:30:53,  3.76it/s]
 84%|████████▎ | 310333/371472 [2:31:40<4:37:12,  3.68it/s]
 84%|████████▎ | 310334/371472 [2:31:40<4:31:44,  3.75it/s]
 84%|████████▎ | 310335/371472 [2:31:40<4:33:27,  3.73it/s]
 84%|████████▎ | 310336/371472 [2:31:41<4:47:35,  3.54it/s]
 84%|████████▎ | 310337/371472 [2:31:41<4:53:35,  3.47it/s]
 84%|████████▎ | 310338/371472 [2:31:41<4:49:25,  3.52it/s]
 84%|████████▎ | 310339/371472 [2:31:42<5:01:41,  3.38it/s]
 84%|████████▎ | 310340/371472 [2:31:42<5:03:01,  3.36it/s]
                                                           
{'loss': 2.6125, 'learning_rate': 2.4819000624878795e-07, 'epoch': 13.37}

 84%|████████▎ | 310340/371472 [2:31:42<5:03:01,  3.36it/s]
 84%|████████▎ | 310341/371472 [2:31:42<5:06:22,  3.33it/s]
 84%|████████▎ | 310342/371472 [2:31:43<4:56:41,  3.43it/s]
 84%|████████▎ | 310343/371472 [2:31:43<4:47:07,  3.55it/s]
 84%|████████▎ | 310344/371472 [2:31:43<4:43:20,  3.60it/s]
 84%|████████▎ | 310345/371472 [2:31:43<4:47:38,  3.54it/s]
 84%|████████▎ | 310346/371472 [2:31:44<4:54:48,  3.46it/s]
 84%|████████▎ | 310347/371472 [2:31:44<4:36:59,  3.68it/s]
 84%|████████▎ | 310348/371472 [2:31:44<4:26:45,  3.82it/s]
 84%|████████▎ | 310349/371472 [2:31:44<4:23:48,  3.86it/s]
 84%|████████▎ | 310350/371472 [2:31:45<4:26:13,  3.83it/s]
 84%|████████▎ | 310351/371472 [2:31:45<4:20:42,  3.91it/s]
 84%|████████▎ | 310352/371472 [2:31:45<4:42:52,  3.60it/s]
 84%|████████▎ | 310353/371472 [2:31:45<4:36:44,  3.68it/s]
 84%|████████▎ | 310354/371472 [2:31:46<4:36:27,  3.68it/s]
 84%|████████▎ | 310355/371472 [2:31:46<4:37:44,  3.67it/s]
 84%|████████▎ | 310356/371472 [2:31:46<4:47:56,  3.54it/s]
 84%|████████▎ | 310357/371472 [2:31:47<4:38:17,  3.66it/s]
 84%|████████▎ | 310358/371472 [2:31:47<4:31:40,  3.75it/s]
 84%|████████▎ | 310359/371472 [2:31:47<4:34:59,  3.70it/s]
 84%|████████▎ | 310360/371472 [2:31:47<4:37:48,  3.67it/s]
                                                           
{'loss': 2.6339, 'learning_rate': 2.48141524273309e-07, 'epoch': 13.37}

 84%|████████▎ | 310360/371472 [2:31:47<4:37:48,  3.67it/s]
 84%|████████▎ | 310361/371472 [2:31:48<4:34:39,  3.71it/s]
 84%|████████▎ | 310362/371472 [2:31:48<4:31:38,  3.75it/s]
 84%|████████▎ | 310363/371472 [2:31:48<4:24:41,  3.85it/s]
 84%|████████▎ | 310364/371472 [2:31:48<4:21:27,  3.90it/s]
 84%|████████▎ | 310365/371472 [2:31:49<4:25:27,  3.84it/s]
 84%|████████▎ | 310366/371472 [2:31:49<4:27:09,  3.81it/s]
 84%|████████▎ | 310367/371472 [2:31:49<4:30:25,  3.77it/s]
 84%|████████▎ | 310368/371472 [2:31:50<5:00:57,  3.38it/s]
 84%|████████▎ | 310369/371472 [2:31:50<4:46:07,  3.56it/s]
 84%|████████▎ | 310370/371472 [2:31:50<4:51:06,  3.50it/s]
 84%|████████▎ | 310371/371472 [2:31:50<4:47:53,  3.54it/s]
 84%|████████▎ | 310372/371472 [2:31:51<4:41:57,  3.61it/s]
 84%|████████▎ | 310373/371472 [2:31:51<4:37:51,  3.66it/s]
 84%|████████▎ | 310374/371472 [2:31:51<4:30:28,  3.76it/s]
 84%|████████▎ | 310375/371472 [2:31:52<5:07:31,  3.31it/s]
 84%|████████▎ | 310376/371472 [2:31:52<5:01:10,  3.38it/s]
 84%|████████▎ | 310377/371472 [2:31:52<5:00:24,  3.39it/s]
 84%|████████▎ | 310378/371472 [2:31:52<4:52:58,  3.48it/s]
 84%|████████▎ | 310379/371472 [2:31:53<4:51:25,  3.49it/s]
 84%|████████▎ | 310380/371472 [2:31:53<5:14:30,  3.24it/s]
                                                           
{'loss': 2.7418, 'learning_rate': 2.480930422978302e-07, 'epoch': 13.37}

 84%|████████▎ | 310380/371472 [2:31:53<5:14:30,  3.24it/s]
 84%|████████▎ | 310381/371472 [2:31:53<5:07:26,  3.31it/s]
 84%|████████▎ | 310382/371472 [2:31:54<5:01:29,  3.38it/s]
 84%|████████▎ | 310383/371472 [2:31:54<4:50:42,  3.50it/s]
 84%|████████▎ | 310384/371472 [2:31:54<4:40:24,  3.63it/s]
 84%|████████▎ | 310385/371472 [2:31:54<4:38:59,  3.65it/s]
 84%|████████▎ | 310386/371472 [2:31:55<4:58:40,  3.41it/s]
 84%|████████▎ | 310387/371472 [2:31:55<4:51:23,  3.49it/s]
 84%|████████▎ | 310388/371472 [2:31:55<4:42:37,  3.60it/s]
 84%|████████▎ | 310389/371472 [2:31:56<4:42:09,  3.61it/s]
 84%|████████▎ | 310390/371472 [2:31:56<4:49:40,  3.51it/s]
 84%|████████▎ | 310391/371472 [2:31:56<4:42:58,  3.60it/s]
 84%|████████▎ | 310392/371472 [2:31:56<4:34:02,  3.71it/s]
 84%|████████▎ | 310393/371472 [2:31:57<4:38:29,  3.66it/s]
 84%|████████▎ | 310394/371472 [2:31:57<4:48:57,  3.52it/s]
 84%|████████▎ | 310395/371472 [2:31:57<4:42:07,  3.61it/s]
 84%|████████▎ | 310396/371472 [2:31:57<4:34:59,  3.70it/s]
 84%|████████▎ | 310397/371472 [2:31:58<4:32:37,  3.73it/s]
 84%|████████▎ | 310398/371472 [2:31:58<4:40:30,  3.63it/s]
 84%|████████▎ | 310399/371472 [2:31:58<4:44:19,  3.58it/s]
 84%|████████▎ | 310400/371472 [2:31:59<4:44:24,  3.58it/s]
                                                           
{'loss': 2.6589, 'learning_rate': 2.4804456032235127e-07, 'epoch': 13.37}

 84%|████████▎ | 310400/371472 [2:31:59<4:44:24,  3.58it/s]
 84%|████████▎ | 310401/371472 [2:31:59<4:37:08,  3.67it/s]
 84%|████████▎ | 310402/371472 [2:31:59<4:42:49,  3.60it/s]
 84%|████████▎ | 310403/371472 [2:31:59<4:35:12,  3.70it/s]
 84%|████████▎ | 310404/371472 [2:32:00<4:33:37,  3.72it/s]
 84%|████████▎ | 310405/371472 [2:32:00<4:28:44,  3.79it/s]
 84%|████████▎ | 310406/371472 [2:32:00<4:25:46,  3.83it/s]
 84%|████████▎ | 310407/371472 [2:32:00<4:39:30,  3.64it/s]
 84%|████████▎ | 310408/371472 [2:32:01<4:29:24,  3.78it/s]
 84%|████████▎ | 310409/371472 [2:32:01<4:25:30,  3.83it/s]
 84%|████████▎ | 310410/371472 [2:32:01<4:46:20,  3.55it/s]
 84%|████████▎ | 310411/371472 [2:32:02<4:36:32,  3.68it/s]
 84%|████████▎ | 310412/371472 [2:32:02<4:37:33,  3.67it/s]
 84%|████████▎ | 310413/371472 [2:32:02<4:29:55,  3.77it/s]
 84%|████████▎ | 310414/371472 [2:32:02<4:40:25,  3.63it/s]
 84%|████████▎ | 310415/371472 [2:32:03<4:38:06,  3.66it/s]
 84%|████████▎ | 310416/371472 [2:32:03<4:40:06,  3.63it/s]
 84%|████████▎ | 310417/371472 [2:32:03<4:58:23,  3.41it/s]
 84%|████████▎ | 310418/371472 [2:32:04<4:44:45,  3.57it/s]
 84%|████████▎ | 310419/371472 [2:32:04<4:38:27,  3.65it/s]
 84%|████████▎ | 310420/371472 [2:32:04<4:48:06,  3.53it/s]
                                                           
{'loss': 2.5761, 'learning_rate': 2.4799607834687244e-07, 'epoch': 13.37}

 84%|████████▎ | 310420/371472 [2:32:04<4:48:06,  3.53it/s]
 84%|████████▎ | 310421/371472 [2:32:04<4:48:37,  3.53it/s]
 84%|████████▎ | 310422/371472 [2:32:05<4:36:05,  3.69it/s]
 84%|████████▎ | 310423/371472 [2:32:05<4:51:05,  3.50it/s]
 84%|████████▎ | 310424/371472 [2:32:05<4:42:59,  3.60it/s]
 84%|████████▎ | 310425/371472 [2:32:05<4:36:11,  3.68it/s]
 84%|████████▎ | 310426/371472 [2:32:06<4:41:18,  3.62it/s]
 84%|████████▎ | 310427/371472 [2:32:06<5:02:16,  3.37it/s]
 84%|████████▎ | 310428/371472 [2:32:06<4:54:00,  3.46it/s]
 84%|████████▎ | 310429/371472 [2:32:07<4:45:31,  3.56it/s]
 84%|████████▎ | 310430/371472 [2:32:07<4:36:17,  3.68it/s]
 84%|████████▎ | 310431/371472 [2:32:07<4:34:33,  3.71it/s]
 84%|████████▎ | 310432/371472 [2:32:07<4:49:59,  3.51it/s]
 84%|████████▎ | 310433/371472 [2:32:08<4:37:30,  3.67it/s]
 84%|████████▎ | 310434/371472 [2:32:08<4:35:38,  3.69it/s]
 84%|████████▎ | 310435/371472 [2:32:08<4:28:43,  3.79it/s]
 84%|████████▎ | 310436/371472 [2:32:09<4:41:20,  3.62it/s]
 84%|████████▎ | 310437/371472 [2:32:09<4:38:25,  3.65it/s]
 84%|████████▎ | 310438/371472 [2:32:09<4:41:06,  3.62it/s]
 84%|████████▎ | 310439/371472 [2:32:09<4:44:21,  3.58it/s]
 84%|████████▎ | 310440/371472 [2:32:10<4:45:17,  3.57it/s]
                                                           
{'loss': 2.5038, 'learning_rate': 2.4794759637139346e-07, 'epoch': 13.37}

 84%|████████▎ | 310440/371472 [2:32:10<4:45:17,  3.57it/s]
 84%|████████▎ | 310441/371472 [2:32:10<4:39:43,  3.64it/s]
 84%|████████▎ | 310442/371472 [2:32:10<4:43:02,  3.59it/s]
 84%|████████▎ | 310443/371472 [2:32:10<4:39:54,  3.63it/s]
 84%|████████▎ | 310444/371472 [2:32:11<4:30:31,  3.76it/s]
 84%|████████▎ | 310445/371472 [2:32:11<4:39:11,  3.64it/s]
 84%|████████▎ | 310446/371472 [2:32:11<4:54:38,  3.45it/s]
 84%|████████▎ | 310447/371472 [2:32:12<4:54:58,  3.45it/s]
 84%|████████▎ | 310448/371472 [2:32:12<4:58:32,  3.41it/s]
 84%|████████▎ | 310449/371472 [2:32:12<5:06:32,  3.32it/s]
 84%|████████▎ | 310450/371472 [2:32:13<5:56:36,  2.85it/s]
 84%|████████▎ | 310451/371472 [2:32:13<5:34:52,  3.04it/s]
 84%|████████▎ | 310452/371472 [2:32:13<5:10:09,  3.28it/s]
 84%|████████▎ | 310453/371472 [2:32:14<5:12:18,  3.26it/s]
 84%|████████▎ | 310454/371472 [2:32:14<4:59:57,  3.39it/s]
 84%|████████▎ | 310455/371472 [2:32:14<5:05:44,  3.33it/s]
 84%|████████▎ | 310456/371472 [2:32:14<5:00:13,  3.39it/s]
 84%|████████▎ | 310457/371472 [2:32:15<4:48:32,  3.52it/s]
 84%|████████▎ | 310458/371472 [2:32:15<4:50:35,  3.50it/s]
 84%|████████▎ | 310459/371472 [2:32:15<4:49:36,  3.51it/s]
 84%|████████▎ | 310460/371472 [2:32:16<4:52:40,  3.47it/s]
                                                           
{'loss': 2.5175, 'learning_rate': 2.478991143959146e-07, 'epoch': 13.37}

 84%|████████▎ | 310460/371472 [2:32:16<4:52:40,  3.47it/s]
 84%|████████▎ | 310461/371472 [2:32:16<4:42:59,  3.59it/s]
 84%|████████▎ | 310462/371472 [2:32:16<5:16:54,  3.21it/s]
 84%|████████▎ | 310463/371472 [2:32:16<5:05:38,  3.33it/s]
 84%|████████▎ | 310464/371472 [2:32:17<4:54:50,  3.45it/s]
 84%|████████▎ | 310465/371472 [2:32:17<4:53:56,  3.46it/s]
 84%|████████▎ | 310466/371472 [2:32:17<4:43:40,  3.58it/s]
 84%|████████▎ | 310467/371472 [2:32:17<4:33:48,  3.71it/s]
 84%|████████▎ | 310468/371472 [2:32:18<4:26:25,  3.82it/s]
 84%|████████▎ | 310469/371472 [2:32:18<4:37:48,  3.66it/s]
 84%|████████▎ | 310470/371472 [2:32:18<4:40:26,  3.63it/s]
 84%|████████▎ | 310471/371472 [2:32:19<4:40:04,  3.63it/s]
 84%|████████▎ | 310472/371472 [2:32:19<4:50:53,  3.50it/s]
 84%|████████▎ | 310473/371472 [2:32:19<4:41:13,  3.62it/s]
 84%|████████▎ | 310474/371472 [2:32:19<4:37:21,  3.67it/s]
 84%|████████▎ | 310475/371472 [2:32:20<5:05:45,  3.32it/s]
 84%|████████▎ | 310476/371472 [2:32:20<5:16:13,  3.21it/s]
 84%|████████▎ | 310477/371472 [2:32:20<5:21:46,  3.16it/s]
 84%|████████▎ | 310478/371472 [2:32:21<5:21:01,  3.17it/s]
 84%|████████▎ | 310479/371472 [2:32:21<5:01:46,  3.37it/s]
 84%|████████▎ | 310480/371472 [2:32:21<4:45:48,  3.56it/s]
                                                           
{'loss': 2.6397, 'learning_rate': 2.4785063242043566e-07, 'epoch': 13.37}

 84%|████████▎ | 310480/371472 [2:32:21<4:45:48,  3.56it/s]
 84%|████████▎ | 310481/371472 [2:32:22<4:51:14,  3.49it/s]
 84%|████████▎ | 310482/371472 [2:32:22<4:44:10,  3.58it/s]
 84%|████████▎ | 310483/371472 [2:32:22<4:35:12,  3.69it/s]
 84%|████████▎ | 310484/371472 [2:32:22<4:35:45,  3.69it/s]
 84%|████████▎ | 310485/371472 [2:32:23<4:39:34,  3.64it/s]
 84%|████████▎ | 310486/371472 [2:32:23<4:34:14,  3.71it/s]
 84%|████████▎ | 310487/371472 [2:32:23<4:35:25,  3.69it/s]
 84%|████████▎ | 310488/371472 [2:32:23<4:39:14,  3.64it/s]
 84%|████████▎ | 310489/371472 [2:32:24<4:34:15,  3.71it/s]
 84%|████████▎ | 310490/371472 [2:32:24<4:29:58,  3.76it/s]
 84%|████████▎ | 310491/371472 [2:32:24<4:36:37,  3.67it/s]
 84%|████████▎ | 310492/371472 [2:32:25<4:34:46,  3.70it/s]
 84%|████████▎ | 310493/371472 [2:32:25<4:28:00,  3.79it/s]
 84%|████████▎ | 310494/371472 [2:32:25<4:39:25,  3.64it/s]
 84%|████████▎ | 310495/371472 [2:32:25<4:35:28,  3.69it/s]
 84%|████████▎ | 310496/371472 [2:32:26<4:46:02,  3.55it/s]
 84%|████████▎ | 310497/371472 [2:32:26<5:11:30,  3.26it/s]
 84%|████████▎ | 310498/371472 [2:32:26<5:01:00,  3.38it/s]
 84%|████████▎ | 310499/371472 [2:32:27<4:48:24,  3.52it/s]
 84%|████████▎ | 310500/371472 [2:32:27<5:04:54,  3.33it/s]
                                                           
{'loss': 2.5658, 'learning_rate': 2.4780215044495673e-07, 'epoch': 13.37}

 84%|████████▎ | 310500/371472 [2:32:27<5:04:54,  3.33it/s]
 84%|████████▎ | 310501/371472 [2:32:27<4:52:23,  3.48it/s]
 84%|████████▎ | 310502/371472 [2:32:27<5:16:33,  3.21it/s]
 84%|████████▎ | 310503/371472 [2:32:28<5:10:42,  3.27it/s]
 84%|████████▎ | 310504/371472 [2:32:28<5:01:19,  3.37it/s]
 84%|████████▎ | 310505/371472 [2:32:28<4:54:57,  3.45it/s]
 84%|████████▎ | 310506/371472 [2:32:29<4:45:22,  3.56it/s]
 84%|████████▎ | 310507/371472 [2:32:29<4:43:39,  3.58it/s]
 84%|████████▎ | 310508/371472 [2:32:29<4:50:53,  3.49it/s]
 84%|████████▎ | 310509/371472 [2:32:29<5:06:36,  3.31it/s]
 84%|████████▎ | 310510/371472 [2:32:30<5:01:03,  3.37it/s]
 84%|████████▎ | 310511/371472 [2:32:30<4:55:15,  3.44it/s]
 84%|████████▎ | 310512/371472 [2:32:30<4:50:46,  3.49it/s]
 84%|████████▎ | 310513/371472 [2:32:31<4:43:04,  3.59it/s]
 84%|████████▎ | 310514/371472 [2:32:31<5:09:01,  3.29it/s]
 84%|████████▎ | 310515/371472 [2:32:31<5:12:02,  3.26it/s]
 84%|████████▎ | 310516/371472 [2:32:32<4:56:20,  3.43it/s]
 84%|████████▎ | 310517/371472 [2:32:32<4:51:47,  3.48it/s]
 84%|████████▎ | 310518/371472 [2:32:32<4:50:01,  3.50it/s]
 84%|████████▎ | 310519/371472 [2:32:32<4:51:07,  3.49it/s]
 84%|████████▎ | 310520/371472 [2:32:33<4:49:48,  3.51it/s]
                                                           
{'loss': 2.6733, 'learning_rate': 2.477536684694779e-07, 'epoch': 13.37}

 84%|████████▎ | 310520/371472 [2:32:33<4:49:48,  3.51it/s]
 84%|████████▎ | 310521/371472 [2:32:33<4:43:48,  3.58it/s]
 84%|████████▎ | 310522/371472 [2:32:33<5:01:20,  3.37it/s]
 84%|████████▎ | 310523/371472 [2:32:34<5:06:51,  3.31it/s]
 84%|████████▎ | 310524/371472 [2:32:34<4:55:12,  3.44it/s]
 84%|████████▎ | 310525/371472 [2:32:34<5:01:51,  3.37it/s]
 84%|████████▎ | 310526/371472 [2:32:34<4:51:03,  3.49it/s]
 84%|████████▎ | 310527/371472 [2:32:35<4:47:44,  3.53it/s]
 84%|████████▎ | 310528/371472 [2:32:35<4:35:13,  3.69it/s]
 84%|████████▎ | 310529/371472 [2:32:35<4:31:02,  3.75it/s]
 84%|████████▎ | 310530/371472 [2:32:35<4:31:03,  3.75it/s]
 84%|████████▎ | 310531/371472 [2:32:36<4:23:45,  3.85it/s]
 84%|████████▎ | 310532/371472 [2:32:36<4:26:00,  3.82it/s]
 84%|████████▎ | 310533/371472 [2:32:36<4:31:23,  3.74it/s]
 84%|████████▎ | 310534/371472 [2:32:37<4:30:58,  3.75it/s]
 84%|████████▎ | 310535/371472 [2:32:37<4:35:44,  3.68it/s]
 84%|████████▎ | 310536/371472 [2:32:37<4:23:36,  3.85it/s]
 84%|████████▎ | 310537/371472 [2:32:37<4:16:45,  3.96it/s]
 84%|████████▎ | 310538/371472 [2:32:38<4:15:36,  3.97it/s]
 84%|████████▎ | 310539/371472 [2:32:38<4:22:31,  3.87it/s]
 84%|████████▎ | 310540/371472 [2:32:38<4:21:03,  3.89it/s]
                                                           
{'loss': 2.5706, 'learning_rate': 2.47705186493999e-07, 'epoch': 13.38}

 84%|████████▎ | 310540/371472 [2:32:38<4:21:03,  3.89it/s]
 84%|████████▎ | 310541/371472 [2:32:38<4:37:51,  3.65it/s]
 84%|████████▎ | 310542/371472 [2:32:39<4:30:51,  3.75it/s]
 84%|████████▎ | 310543/371472 [2:32:39<4:24:55,  3.83it/s]
 84%|████████▎ | 310544/371472 [2:32:39<4:57:29,  3.41it/s]
 84%|████████▎ | 310545/371472 [2:32:40<4:57:05,  3.42it/s]
 84%|████████▎ | 310546/371472 [2:32:40<4:55:53,  3.43it/s]
 84%|████████▎ | 310547/371472 [2:32:40<4:46:03,  3.55it/s]
 84%|████████▎ | 310548/371472 [2:32:40<4:42:18,  3.60it/s]
 84%|████████▎ | 310549/371472 [2:32:41<4:41:29,  3.61it/s]
 84%|████████▎ | 310550/371472 [2:32:41<4:48:59,  3.51it/s]
 84%|████████▎ | 310551/371472 [2:32:41<4:54:44,  3.44it/s]
 84%|████████▎ | 310552/371472 [2:32:42<5:05:14,  3.33it/s]
 84%|████████▎ | 310553/371472 [2:32:42<4:59:02,  3.40it/s]
 84%|████████▎ | 310554/371472 [2:32:42<5:02:35,  3.36it/s]
 84%|████████▎ | 310555/371472 [2:32:42<5:07:28,  3.30it/s]
 84%|████████▎ | 310556/371472 [2:32:43<4:53:38,  3.46it/s]
 84%|████████▎ | 310557/371472 [2:32:43<4:44:47,  3.56it/s]
 84%|████████▎ | 310558/371472 [2:32:43<4:39:02,  3.64it/s]
 84%|████████▎ | 310559/371472 [2:32:43<4:39:45,  3.63it/s]
 84%|████████▎ | 310560/371472 [2:32:44<4:37:14,  3.66it/s]
                                                           
{'loss': 2.8008, 'learning_rate': 2.476567045185201e-07, 'epoch': 13.38}

 84%|████████▎ | 310560/371472 [2:32:44<4:37:14,  3.66it/s]
 84%|████████▎ | 310561/371472 [2:32:44<4:49:10,  3.51it/s]
 84%|████████▎ | 310562/371472 [2:32:44<4:42:13,  3.60it/s]
 84%|████████▎ | 310563/371472 [2:32:45<4:34:44,  3.70it/s]
 84%|████████▎ | 310564/371472 [2:32:45<4:38:02,  3.65it/s]
 84%|████████▎ | 310565/371472 [2:32:45<4:37:58,  3.65it/s]
 84%|████████▎ | 310566/371472 [2:32:45<4:33:06,  3.72it/s]
 84%|████████▎ | 310567/371472 [2:32:46<4:35:50,  3.68it/s]
 84%|████████▎ | 310568/371472 [2:32:46<4:42:58,  3.59it/s]
 84%|████████▎ | 310569/371472 [2:32:46<4:40:19,  3.62it/s]
 84%|████████▎ | 310570/371472 [2:32:47<4:42:42,  3.59it/s]
 84%|████████▎ | 310571/371472 [2:32:47<4:48:39,  3.52it/s]
 84%|████████▎ | 310572/371472 [2:32:47<4:51:19,  3.48it/s]
 84%|████████▎ | 310573/371472 [2:32:47<4:52:09,  3.47it/s]
 84%|████████▎ | 310574/371472 [2:32:48<4:49:23,  3.51it/s]
 84%|████████▎ | 310575/371472 [2:32:48<4:46:46,  3.54it/s]
 84%|████████▎ | 310576/371472 [2:32:48<4:53:38,  3.46it/s]
 84%|████████▎ | 310577/371472 [2:32:49<4:40:21,  3.62it/s]
 84%|████████▎ | 310578/371472 [2:32:49<4:40:33,  3.62it/s]
 84%|████████▎ | 310579/371472 [2:32:49<4:43:15,  3.58it/s]
 84%|████████▎ | 310580/371472 [2:32:49<4:48:48,  3.51it/s]
                                                           
{'loss': 2.4957, 'learning_rate': 2.476082225430412e-07, 'epoch': 13.38}

 84%|████████▎ | 310580/371472 [2:32:49<4:48:48,  3.51it/s]
 84%|████████▎ | 310581/371472 [2:32:50<4:37:32,  3.66it/s]
 84%|████████▎ | 310582/371472 [2:32:50<4:31:04,  3.74it/s]
 84%|████████▎ | 310583/371472 [2:32:50<4:26:36,  3.81it/s]
 84%|████████▎ | 310584/371472 [2:32:50<4:34:00,  3.70it/s]
 84%|████████▎ | 310585/371472 [2:32:51<4:34:18,  3.70it/s]
 84%|████████▎ | 310586/371472 [2:32:51<4:34:01,  3.70it/s]
 84%|████████▎ | 310587/371472 [2:32:51<4:36:48,  3.67it/s]
 84%|████████▎ | 310588/371472 [2:32:51<4:34:58,  3.69it/s]
 84%|████████▎ | 310589/371472 [2:32:52<4:30:01,  3.76it/s]
 84%|████████▎ | 310590/371472 [2:32:52<4:32:11,  3.73it/s]
 84%|████████▎ | 310591/371472 [2:32:52<4:34:33,  3.70it/s]
 84%|████████▎ | 310592/371472 [2:32:53<4:47:47,  3.53it/s]
 84%|████████▎ | 310593/371472 [2:32:53<4:39:31,  3.63it/s]
 84%|████████▎ | 310594/371472 [2:32:53<4:34:45,  3.69it/s]
 84%|████████▎ | 310595/371472 [2:32:53<4:44:04,  3.57it/s]
 84%|████████▎ | 310596/371472 [2:32:54<4:33:45,  3.71it/s]
 84%|████████▎ | 310597/371472 [2:32:54<4:31:09,  3.74it/s]
 84%|████████▎ | 310598/371472 [2:32:54<4:28:04,  3.78it/s]
 84%|████████▎ | 310599/371472 [2:32:54<4:23:35,  3.85it/s]
 84%|████████▎ | 310600/371472 [2:32:55<4:32:03,  3.73it/s]
                                                           
{'loss': 2.7782, 'learning_rate': 2.475597405675623e-07, 'epoch': 13.38}

 84%|████████▎ | 310600/371472 [2:32:55<4:32:03,  3.73it/s]
 84%|████████▎ | 310601/371472 [2:32:55<4:57:27,  3.41it/s]
 84%|████████▎ | 310602/371472 [2:32:55<5:07:11,  3.30it/s]
 84%|████████▎ | 310603/371472 [2:32:56<5:09:04,  3.28it/s]
 84%|████████▎ | 310604/371472 [2:32:56<4:55:28,  3.43it/s]
 84%|████████▎ | 310605/371472 [2:32:56<4:54:39,  3.44it/s]
 84%|████████▎ | 310606/371472 [2:32:57<4:52:47,  3.46it/s]
 84%|████████▎ | 310607/371472 [2:32:57<4:41:57,  3.60it/s]
 84%|████████▎ | 310608/371472 [2:32:57<4:39:11,  3.63it/s]
 84%|████████▎ | 310609/371472 [2:32:57<4:46:00,  3.55it/s]
 84%|████████▎ | 310610/371472 [2:32:58<4:43:05,  3.58it/s]
 84%|████████▎ | 310611/371472 [2:32:58<4:37:24,  3.66it/s]
 84%|████████▎ | 310612/371472 [2:32:58<4:34:14,  3.70it/s]
 84%|████████▎ | 310613/371472 [2:32:58<4:23:21,  3.85it/s]
 84%|████████▎ | 310614/371472 [2:32:59<4:35:39,  3.68it/s]
 84%|████████▎ | 310615/371472 [2:32:59<4:40:25,  3.62it/s]
 84%|████████▎ | 310616/371472 [2:32:59<4:37:27,  3.66it/s]
 84%|████████▎ | 310617/371472 [2:33:00<4:29:50,  3.76it/s]
 84%|████████▎ | 310618/371472 [2:33:00<4:43:37,  3.58it/s]
 84%|████████▎ | 310619/371472 [2:33:00<4:51:44,  3.48it/s]
 84%|████████▎ | 310620/371472 [2:33:00<4:55:34,  3.43it/s]
                                                           
{'loss': 2.7666, 'learning_rate': 2.4751125859208337e-07, 'epoch': 13.38}

 84%|████████▎ | 310620/371472 [2:33:00<4:55:34,  3.43it/s]
 84%|████████▎ | 310621/371472 [2:33:01<4:47:42,  3.52it/s]
 84%|████████▎ | 310622/371472 [2:33:01<4:48:56,  3.51it/s]
 84%|████████▎ | 310623/371472 [2:33:01<4:50:17,  3.49it/s]
 84%|████████▎ | 310624/371472 [2:33:02<4:40:07,  3.62it/s]
 84%|████████▎ | 310625/371472 [2:33:02<4:48:43,  3.51it/s]
 84%|████████▎ | 310626/371472 [2:33:02<4:48:05,  3.52it/s]
 84%|████████▎ | 310627/371472 [2:33:02<5:12:36,  3.24it/s]
 84%|████████▎ | 310628/371472 [2:33:03<5:32:15,  3.05it/s]
 84%|████████▎ | 310629/371472 [2:33:03<5:11:02,  3.26it/s]
 84%|████████▎ | 310630/371472 [2:33:03<4:55:18,  3.43it/s]
 84%|████████▎ | 310631/371472 [2:33:04<4:43:38,  3.58it/s]
 84%|████████▎ | 310632/371472 [2:33:04<4:54:34,  3.44it/s]
 84%|████████▎ | 310633/371472 [2:33:04<4:50:29,  3.49it/s]
 84%|████████▎ | 310634/371472 [2:33:04<4:47:41,  3.52it/s]
 84%|████████▎ | 310635/371472 [2:33:05<4:50:58,  3.48it/s]
 84%|████████▎ | 310636/371472 [2:33:05<4:36:49,  3.66it/s]
 84%|████████▎ | 310637/371472 [2:33:05<4:29:36,  3.76it/s]
 84%|████████▎ | 310638/371472 [2:33:06<4:59:40,  3.38it/s]
 84%|████████▎ | 310639/371472 [2:33:06<5:03:12,  3.34it/s]
 84%|████████▎ | 310640/371472 [2:33:06<4:57:21,  3.41it/s]
                                                           
{'loss': 2.5153, 'learning_rate': 2.4746277661660455e-07, 'epoch': 13.38}

 84%|████████▎ | 310640/371472 [2:33:06<4:57:21,  3.41it/s]
 84%|████████▎ | 310641/371472 [2:33:06<4:42:48,  3.58it/s]
 84%|████████▎ | 310642/371472 [2:33:07<4:32:27,  3.72it/s]
 84%|████████▎ | 310643/371472 [2:33:07<4:27:19,  3.79it/s]
 84%|████████▎ | 310644/371472 [2:33:07<4:28:38,  3.77it/s]
 84%|████████▎ | 310645/371472 [2:33:08<4:55:27,  3.43it/s]
 84%|████████▎ | 310646/371472 [2:33:08<5:00:33,  3.37it/s]
 84%|████████▎ | 310647/371472 [2:33:08<5:01:53,  3.36it/s]
 84%|████████▎ | 310648/371472 [2:33:08<4:51:29,  3.48it/s]
 84%|████████▎ | 310649/371472 [2:33:09<4:39:11,  3.63it/s]
 84%|████████▎ | 310650/371472 [2:33:09<4:36:38,  3.66it/s]
 84%|████████▎ | 310651/371472 [2:33:09<4:28:36,  3.77it/s]
 84%|████████▎ | 310652/371472 [2:33:09<4:27:29,  3.79it/s]
 84%|████████▎ | 310653/371472 [2:33:10<4:28:14,  3.78it/s]
 84%|████████▎ | 310654/371472 [2:33:10<4:31:07,  3.74it/s]
 84%|████████▎ | 310655/371472 [2:33:10<4:29:22,  3.76it/s]
 84%|████████▎ | 310656/371472 [2:33:11<4:26:04,  3.81it/s]
 84%|████████▎ | 310657/371472 [2:33:11<4:40:25,  3.61it/s]
 84%|████████▎ | 310658/371472 [2:33:11<4:48:59,  3.51it/s]
 84%|████████▎ | 310659/371472 [2:33:11<5:07:07,  3.30it/s]
 84%|████████▎ | 310660/371472 [2:33:12<5:02:51,  3.35it/s]
                                                           
{'loss': 2.6852, 'learning_rate': 2.474142946411256e-07, 'epoch': 13.38}

 84%|████████▎ | 310660/371472 [2:33:12<5:02:51,  3.35it/s]
 84%|████████▎ | 310661/371472 [2:33:12<4:50:01,  3.49it/s]
 84%|████████▎ | 310662/371472 [2:33:12<4:40:29,  3.61it/s]
 84%|████████▎ | 310663/371472 [2:33:13<4:40:46,  3.61it/s]
 84%|████████▎ | 310664/371472 [2:33:13<5:18:31,  3.18it/s]
 84%|████████▎ | 310665/371472 [2:33:13<5:16:41,  3.20it/s]
 84%|████████▎ | 310666/371472 [2:33:14<4:55:38,  3.43it/s]
 84%|████████▎ | 310667/371472 [2:33:14<4:47:04,  3.53it/s]
 84%|████████▎ | 310668/371472 [2:33:14<4:34:22,  3.69it/s]
 84%|████████▎ | 310669/371472 [2:33:14<4:57:28,  3.41it/s]
 84%|████████▎ | 310670/371472 [2:33:15<4:58:47,  3.39it/s]
 84%|████████▎ | 310671/371472 [2:33:15<4:56:56,  3.41it/s]
 84%|████████▎ | 310672/371472 [2:33:15<4:50:40,  3.49it/s]
 84%|████████▎ | 310673/371472 [2:33:16<4:51:43,  3.47it/s]
 84%|████████▎ | 310674/371472 [2:33:16<4:37:57,  3.65it/s]
 84%|████████▎ | 310675/371472 [2:33:16<4:29:32,  3.76it/s]
 84%|████████▎ | 310676/371472 [2:33:16<4:41:32,  3.60it/s]
 84%|████████▎ | 310677/371472 [2:33:17<4:49:14,  3.50it/s]
 84%|████████▎ | 310678/371472 [2:33:17<4:48:25,  3.51it/s]
 84%|████████▎ | 310679/371472 [2:33:17<4:42:21,  3.59it/s]
 84%|████████▎ | 310680/371472 [2:33:17<4:37:50,  3.65it/s]
                                                           
{'loss': 2.4995, 'learning_rate': 2.4736581266564674e-07, 'epoch': 13.38}

 84%|████████▎ | 310680/371472 [2:33:17<4:37:50,  3.65it/s]
 84%|████████▎ | 310681/371472 [2:33:18<4:29:34,  3.76it/s]
 84%|████████▎ | 310682/371472 [2:33:18<4:41:43,  3.60it/s]
 84%|████████▎ | 310683/371472 [2:33:18<4:51:32,  3.48it/s]
 84%|████████▎ | 310684/371472 [2:33:19<4:58:57,  3.39it/s]
 84%|████████▎ | 310685/371472 [2:33:19<5:13:38,  3.23it/s]
 84%|████████▎ | 310686/371472 [2:33:19<5:02:24,  3.35it/s]
 84%|████████▎ | 310687/371472 [2:33:20<5:00:13,  3.37it/s]
 84%|████████▎ | 310688/371472 [2:33:20<4:50:29,  3.49it/s]
 84%|████████▎ | 310689/371472 [2:33:20<4:38:44,  3.63it/s]
 84%|████████▎ | 310690/371472 [2:33:20<4:36:42,  3.66it/s]
 84%|████████▎ | 310691/371472 [2:33:21<4:34:11,  3.69it/s]
 84%|████████▎ | 310692/371472 [2:33:21<4:34:14,  3.69it/s]
 84%|████████▎ | 310693/371472 [2:33:21<4:59:03,  3.39it/s]
 84%|████████▎ | 310694/371472 [2:33:22<5:16:37,  3.20it/s]
 84%|████████▎ | 310695/371472 [2:33:22<4:51:11,  3.48it/s]
 84%|████████▎ | 310696/371472 [2:33:22<4:50:55,  3.48it/s]
 84%|████████▎ | 310697/371472 [2:33:22<4:49:58,  3.49it/s]
 84%|████████▎ | 310698/371472 [2:33:23<4:44:06,  3.57it/s]
 84%|████████▎ | 310699/371472 [2:33:23<4:52:42,  3.46it/s]
 84%|████████▎ | 310700/371472 [2:33:23<4:43:51,  3.57it/s]
                                                           
{'loss': 2.5206, 'learning_rate': 2.473173306901678e-07, 'epoch': 13.38}

 84%|████████▎ | 310700/371472 [2:33:23<4:43:51,  3.57it/s]
 84%|████████▎ | 310701/371472 [2:33:23<4:49:11,  3.50it/s]
 84%|████████▎ | 310702/371472 [2:33:24<4:42:24,  3.59it/s]
 84%|████████▎ | 310703/371472 [2:33:24<4:59:15,  3.38it/s]
 84%|████████▎ | 310704/371472 [2:33:24<4:57:46,  3.40it/s]
 84%|████████▎ | 310705/371472 [2:33:25<4:51:49,  3.47it/s]
 84%|████████▎ | 310706/371472 [2:33:25<4:45:16,  3.55it/s]
 84%|████████▎ | 310707/371472 [2:33:25<4:43:25,  3.57it/s]
 84%|████████▎ | 310708/371472 [2:33:25<4:39:41,  3.62it/s]
 84%|████████▎ | 310709/371472 [2:33:26<4:49:05,  3.50it/s]
 84%|████████▎ | 310710/371472 [2:33:26<4:56:56,  3.41it/s]
 84%|████████▎ | 310711/371472 [2:33:26<4:57:09,  3.41it/s]
 84%|████████▎ | 310712/371472 [2:33:27<5:04:02,  3.33it/s]
 84%|████████▎ | 310713/371472 [2:33:27<4:54:28,  3.44it/s]
 84%|████████▎ | 310714/371472 [2:33:27<4:45:31,  3.55it/s]
 84%|████████▎ | 310715/371472 [2:33:28<5:19:54,  3.17it/s]
 84%|████████▎ | 310716/371472 [2:33:28<5:04:42,  3.32it/s]
 84%|████████▎ | 310717/371472 [2:33:28<5:10:58,  3.26it/s]
 84%|████████▎ | 310718/371472 [2:33:29<5:14:35,  3.22it/s]
 84%|████████▎ | 310719/371472 [2:33:29<5:05:46,  3.31it/s]
 84%|████████▎ | 310720/371472 [2:33:29<5:03:46,  3.33it/s]
                                                           
{'loss': 2.549, 'learning_rate': 2.4726884871468894e-07, 'epoch': 13.38}

 84%|████████▎ | 310720/371472 [2:33:29<5:03:46,  3.33it/s]
 84%|████████▎ | 310721/371472 [2:33:29<4:52:05,  3.47it/s]
 84%|████████▎ | 310722/371472 [2:33:30<4:57:30,  3.40it/s]
 84%|████████▎ | 310723/371472 [2:33:30<4:49:54,  3.49it/s]
 84%|████████▎ | 310724/371472 [2:33:30<4:48:32,  3.51it/s]
 84%|████████▎ | 310725/371472 [2:33:30<4:48:30,  3.51it/s]
 84%|████████▎ | 310726/371472 [2:33:31<4:40:37,  3.61it/s]
 84%|████████▎ | 310727/371472 [2:33:31<4:33:51,  3.70it/s]
 84%|████████▎ | 310728/371472 [2:33:31<4:29:43,  3.75it/s]
 84%|████████▎ | 310729/371472 [2:33:32<4:53:12,  3.45it/s]
 84%|████████▎ | 310730/371472 [2:33:32<4:53:48,  3.45it/s]
 84%|████████▎ | 310731/371472 [2:33:32<4:46:47,  3.53it/s]
 84%|████████▎ | 310732/371472 [2:33:32<4:50:12,  3.49it/s]
 84%|████████▎ | 310733/371472 [2:33:33<4:51:20,  3.47it/s]
 84%|████████▎ | 310734/371472 [2:33:33<4:40:30,  3.61it/s]
 84%|████████▎ | 310735/371472 [2:33:33<4:39:25,  3.62it/s]
 84%|████████▎ | 310736/371472 [2:33:34<4:37:40,  3.65it/s]
 84%|████████▎ | 310737/371472 [2:33:34<4:50:31,  3.48it/s]
 84%|████████▎ | 310738/371472 [2:33:34<4:49:44,  3.49it/s]
 84%|████████▎ | 310739/371472 [2:33:34<5:03:58,  3.33it/s]
 84%|████████▎ | 310740/371472 [2:33:35<4:47:27,  3.52it/s]
                                                           
{'loss': 2.5346, 'learning_rate': 2.4722036673921e-07, 'epoch': 13.38}

 84%|████████▎ | 310740/371472 [2:33:35<4:47:27,  3.52it/s]
 84%|████████▎ | 310741/371472 [2:33:35<4:38:47,  3.63it/s]
 84%|████████▎ | 310742/371472 [2:33:35<4:35:57,  3.67it/s]
 84%|████████▎ | 310743/371472 [2:33:36<4:41:06,  3.60it/s]
 84%|████████▎ | 310744/371472 [2:33:36<4:37:52,  3.64it/s]
 84%|████████▎ | 310745/371472 [2:33:36<4:31:28,  3.73it/s]
 84%|████████▎ | 310746/371472 [2:33:36<4:35:27,  3.67it/s]
 84%|████████▎ | 310747/371472 [2:33:37<4:31:05,  3.73it/s]
 84%|████████▎ | 310748/371472 [2:33:37<4:23:33,  3.84it/s]
 84%|████████▎ | 310749/371472 [2:33:37<4:23:17,  3.84it/s]
 84%|████████▎ | 310750/371472 [2:33:37<4:32:12,  3.72it/s]
 84%|████████▎ | 310751/371472 [2:33:38<4:34:19,  3.69it/s]
 84%|████████▎ | 310752/371472 [2:33:38<4:40:47,  3.60it/s]
 84%|████████▎ | 310753/371472 [2:33:38<5:00:13,  3.37it/s]
 84%|████████▎ | 310754/371472 [2:33:39<4:50:43,  3.48it/s]
 84%|████████▎ | 310755/371472 [2:33:39<4:46:47,  3.53it/s]
 84%|████████▎ | 310756/371472 [2:33:39<4:51:08,  3.48it/s]
 84%|████████▎ | 310757/371472 [2:33:39<4:39:36,  3.62it/s]
 84%|████████▎ | 310758/371472 [2:33:40<4:57:19,  3.40it/s]
 84%|████████▎ | 310759/371472 [2:33:40<5:13:06,  3.23it/s]
 84%|████████▎ | 310760/371472 [2:33:40<5:08:09,  3.28it/s]
                                                           
{'loss': 2.6787, 'learning_rate': 2.471718847637312e-07, 'epoch': 13.39}

 84%|████████▎ | 310760/371472 [2:33:40<5:08:09,  3.28it/s]
 84%|████████▎ | 310761/371472 [2:33:41<4:56:11,  3.42it/s]
 84%|████████▎ | 310762/371472 [2:33:41<4:52:18,  3.46it/s]
 84%|████████▎ | 310763/371472 [2:33:41<4:54:16,  3.44it/s]
 84%|████████▎ | 310764/371472 [2:33:41<4:53:44,  3.44it/s]
 84%|████████▎ | 310765/371472 [2:33:42<4:59:36,  3.38it/s]
 84%|████████▎ | 310766/371472 [2:33:42<4:54:54,  3.43it/s]
 84%|████████▎ | 310767/371472 [2:33:42<4:40:39,  3.60it/s]
 84%|████████▎ | 310768/371472 [2:33:43<4:41:07,  3.60it/s]
 84%|████████▎ | 310769/371472 [2:33:43<5:03:16,  3.34it/s]
 84%|████████▎ | 310770/371472 [2:33:43<5:10:37,  3.26it/s]
 84%|████████▎ | 310771/371472 [2:33:44<5:03:50,  3.33it/s]
 84%|████████▎ | 310772/371472 [2:33:44<4:48:01,  3.51it/s]
 84%|████████▎ | 310773/371472 [2:33:44<4:52:40,  3.46it/s]
 84%|████████▎ | 310774/371472 [2:33:44<4:43:34,  3.57it/s]
 84%|████████▎ | 310775/371472 [2:33:45<4:46:32,  3.53it/s]
 84%|████████▎ | 310776/371472 [2:33:45<4:40:35,  3.61it/s]
 84%|████████▎ | 310777/371472 [2:33:45<4:44:21,  3.56it/s]
 84%|████████▎ | 310778/371472 [2:33:45<4:41:14,  3.60it/s]
 84%|████████▎ | 310779/371472 [2:33:46<4:52:02,  3.46it/s]
 84%|████████▎ | 310780/371472 [2:33:46<4:45:17,  3.55it/s]
                                                           
{'loss': 2.5822, 'learning_rate': 2.4712340278825226e-07, 'epoch': 13.39}

 84%|████████▎ | 310780/371472 [2:33:46<4:45:17,  3.55it/s]
 84%|████████▎ | 310781/371472 [2:33:46<4:35:12,  3.68it/s]
 84%|████████▎ | 310782/371472 [2:33:47<4:43:40,  3.57it/s]
 84%|████████▎ | 310783/371472 [2:33:47<4:48:29,  3.51it/s]
 84%|████████▎ | 310784/371472 [2:33:47<4:44:47,  3.55it/s]
 84%|████████▎ | 310785/371472 [2:33:47<4:44:58,  3.55it/s]
 84%|████████▎ | 310786/371472 [2:33:48<5:12:16,  3.24it/s]
 84%|████████▎ | 310787/371472 [2:33:48<5:00:14,  3.37it/s]
 84%|████████▎ | 310788/371472 [2:33:48<4:53:02,  3.45it/s]
 84%|████████▎ | 310789/371472 [2:33:49<4:45:19,  3.54it/s]
 84%|████████▎ | 310790/371472 [2:33:49<4:57:33,  3.40it/s]
 84%|████████▎ | 310791/371472 [2:33:49<4:49:32,  3.49it/s]
 84%|████████▎ | 310792/371472 [2:33:49<4:38:00,  3.64it/s]
 84%|████████▎ | 310793/371472 [2:33:50<4:29:31,  3.75it/s]
 84%|████████▎ | 310794/371472 [2:33:50<4:31:32,  3.72it/s]
 84%|████████▎ | 310795/371472 [2:33:50<4:29:26,  3.75it/s]
 84%|████████▎ | 310796/371472 [2:33:51<4:37:17,  3.65it/s]
 84%|████████▎ | 310797/371472 [2:33:51<4:33:16,  3.70it/s]
 84%|████████▎ | 310798/371472 [2:33:51<4:38:01,  3.64it/s]
 84%|████████▎ | 310799/371472 [2:33:51<4:36:53,  3.65it/s]
 84%|████████▎ | 310800/371472 [2:33:52<4:34:07,  3.69it/s]
                                                           
{'loss': 2.6649, 'learning_rate': 2.4707492081277344e-07, 'epoch': 13.39}

 84%|████████▎ | 310800/371472 [2:33:52<4:34:07,  3.69it/s]
 84%|████████▎ | 310801/371472 [2:33:52<4:40:22,  3.61it/s]
 84%|████████▎ | 310802/371472 [2:33:52<4:28:34,  3.76it/s]
 84%|████████▎ | 310803/371472 [2:33:52<4:30:42,  3.74it/s]
 84%|████████▎ | 310804/371472 [2:33:53<5:01:10,  3.36it/s]
 84%|████████▎ | 310805/371472 [2:33:53<4:52:02,  3.46it/s]
 84%|████████▎ | 310806/371472 [2:33:53<4:47:29,  3.52it/s]
 84%|████████▎ | 310807/371472 [2:33:54<4:42:59,  3.57it/s]
 84%|████████▎ | 310808/371472 [2:33:54<4:34:38,  3.68it/s]
 84%|████████▎ | 310809/371472 [2:33:54<4:26:27,  3.79it/s]
 84%|████████▎ | 310810/371472 [2:33:54<4:37:42,  3.64it/s]
 84%|████████▎ | 310811/371472 [2:33:55<4:34:21,  3.69it/s]
 84%|████████▎ | 310812/371472 [2:33:55<4:29:08,  3.76it/s]
 84%|████████▎ | 310813/371472 [2:33:55<4:26:24,  3.79it/s]
 84%|████████▎ | 310814/371472 [2:33:55<4:32:31,  3.71it/s]
 84%|████████▎ | 310815/371472 [2:33:56<4:47:16,  3.52it/s]
 84%|████████▎ | 310816/371472 [2:33:56<4:41:38,  3.59it/s]
 84%|████████▎ | 310817/371472 [2:33:56<4:30:32,  3.74it/s]
 84%|████████▎ | 310818/371472 [2:33:57<4:31:08,  3.73it/s]
 84%|████████▎ | 310819/371472 [2:33:57<4:29:46,  3.75it/s]
 84%|████████▎ | 310820/371472 [2:33:57<4:28:03,  3.77it/s]
                                                           
{'loss': 2.688, 'learning_rate': 2.4702643883729446e-07, 'epoch': 13.39}

 84%|████████▎ | 310820/371472 [2:33:57<4:28:03,  3.77it/s]
 84%|████████▎ | 310821/371472 [2:33:57<4:45:37,  3.54it/s]
 84%|████████▎ | 310822/371472 [2:33:58<4:39:03,  3.62it/s]
 84%|████████▎ | 310823/371472 [2:33:58<4:40:27,  3.60it/s]
 84%|████████▎ | 310824/371472 [2:33:58<4:40:16,  3.61it/s]
 84%|████████▎ | 310825/371472 [2:33:59<5:05:35,  3.31it/s]
 84%|████████▎ | 310826/371472 [2:33:59<5:05:15,  3.31it/s]
 84%|████████▎ | 310827/371472 [2:33:59<5:00:15,  3.37it/s]
 84%|████████▎ | 310828/371472 [2:33:59<5:02:11,  3.34it/s]
 84%|████████▎ | 310829/371472 [2:34:00<5:18:19,  3.18it/s]
 84%|████████▎ | 310830/371472 [2:34:00<5:08:50,  3.27it/s]
 84%|████████▎ | 310831/371472 [2:34:00<4:54:52,  3.43it/s]
 84%|████████▎ | 310832/371472 [2:34:01<4:45:52,  3.54it/s]
 84%|████████▎ | 310833/371472 [2:34:01<4:38:34,  3.63it/s]
 84%|████████▎ | 310834/371472 [2:34:01<4:32:35,  3.71it/s]
 84%|████████▎ | 310835/371472 [2:34:01<4:29:01,  3.76it/s]
 84%|████████▎ | 310836/371472 [2:34:02<4:30:56,  3.73it/s]
 84%|████████▎ | 310837/371472 [2:34:02<4:31:09,  3.73it/s]
 84%|████████▎ | 310838/371472 [2:34:02<4:31:38,  3.72it/s]
 84%|████████▎ | 310839/371472 [2:34:02<4:26:28,  3.79it/s]
 84%|████████▎ | 310840/371472 [2:34:03<4:26:50,  3.79it/s]
                                                           
{'loss': 2.582, 'learning_rate': 2.469779568618156e-07, 'epoch': 13.39}

 84%|████████▎ | 310840/371472 [2:34:03<4:26:50,  3.79it/s]
 84%|████████▎ | 310841/371472 [2:34:03<4:30:41,  3.73it/s]
 84%|████████▎ | 310842/371472 [2:34:03<4:37:21,  3.64it/s]
 84%|████████▎ | 310843/371472 [2:34:04<4:26:27,  3.79it/s]
 84%|████████▎ | 310844/371472 [2:34:04<4:32:22,  3.71it/s]
 84%|████████▎ | 310845/371472 [2:34:04<4:51:25,  3.47it/s]
 84%|████████▎ | 310846/371472 [2:34:04<4:48:30,  3.50it/s]
 84%|████████▎ | 310847/371472 [2:34:05<4:40:07,  3.61it/s]
 84%|████████▎ | 310848/371472 [2:34:05<4:36:19,  3.66it/s]
 84%|████████▎ | 310849/371472 [2:34:05<4:57:32,  3.40it/s]
 84%|████████▎ | 310850/371472 [2:34:06<4:40:40,  3.60it/s]
 84%|████████▎ | 310851/371472 [2:34:06<4:57:39,  3.39it/s]
 84%|████████▎ | 310852/371472 [2:34:06<4:57:23,  3.40it/s]
 84%|████████▎ | 310853/371472 [2:34:06<4:56:46,  3.40it/s]
 84%|████████▎ | 310854/371472 [2:34:07<4:47:33,  3.51it/s]
 84%|████████▎ | 310855/371472 [2:34:07<4:52:01,  3.46it/s]
 84%|████████▎ | 310856/371472 [2:34:07<4:41:12,  3.59it/s]
 84%|████████▎ | 310857/371472 [2:34:08<4:41:31,  3.59it/s]
 84%|████████▎ | 310858/371472 [2:34:08<4:32:27,  3.71it/s]
 84%|████████▎ | 310859/371472 [2:34:08<4:33:47,  3.69it/s]
 84%|████████▎ | 310860/371472 [2:34:08<4:31:36,  3.72it/s]
                                                           
{'loss': 2.656, 'learning_rate': 2.4692947488633665e-07, 'epoch': 13.39}

 84%|████████▎ | 310860/371472 [2:34:08<4:31:36,  3.72it/s]
 84%|████████▎ | 310861/371472 [2:34:09<4:32:58,  3.70it/s]
 84%|████████▎ | 310862/371472 [2:34:09<4:34:24,  3.68it/s]
 84%|████████▎ | 310863/371472 [2:34:09<4:47:04,  3.52it/s]
 84%|████████▎ | 310864/371472 [2:34:09<4:49:13,  3.49it/s]
 84%|████████▎ | 310865/371472 [2:34:10<4:41:28,  3.59it/s]
 84%|████████▎ | 310866/371472 [2:34:10<4:37:12,  3.64it/s]
 84%|████████▎ | 310867/371472 [2:34:10<4:36:38,  3.65it/s]
 84%|████████▎ | 310868/371472 [2:34:11<4:33:15,  3.70it/s]
 84%|████████▎ | 310869/371472 [2:34:11<4:44:45,  3.55it/s]
 84%|████████▎ | 310870/371472 [2:34:11<4:34:10,  3.68it/s]
 84%|████████▎ | 310871/371472 [2:34:11<4:45:43,  3.53it/s]
 84%|████████▎ | 310872/371472 [2:34:12<4:37:13,  3.64it/s]
 84%|████████▎ | 310873/371472 [2:34:12<4:32:50,  3.70it/s]
 84%|████████▎ | 310874/371472 [2:34:12<4:28:08,  3.77it/s]
 84%|████████▎ | 310875/371472 [2:34:13<4:42:04,  3.58it/s]
 84%|████████▎ | 310876/371472 [2:34:13<4:47:30,  3.51it/s]
 84%|████████▎ | 310877/371472 [2:34:13<4:55:08,  3.42it/s]
 84%|████████▎ | 310878/371472 [2:34:13<4:46:36,  3.52it/s]
 84%|████████▎ | 310879/371472 [2:34:14<4:36:13,  3.66it/s]
 84%|████████▎ | 310880/371472 [2:34:14<4:26:28,  3.79it/s]
                                                           
{'loss': 2.5511, 'learning_rate': 2.4688099291085783e-07, 'epoch': 13.39}

 84%|████████▎ | 310880/371472 [2:34:14<4:26:28,  3.79it/s]
 84%|████████▎ | 310881/371472 [2:34:14<4:39:32,  3.61it/s]
 84%|████████▎ | 310882/371472 [2:34:14<4:40:22,  3.60it/s]
 84%|████████▎ | 310883/371472 [2:34:15<4:36:01,  3.66it/s]
 84%|████████▎ | 310884/371472 [2:34:15<4:37:46,  3.64it/s]
 84%|████████▎ | 310885/371472 [2:34:15<4:54:15,  3.43it/s]
 84%|████████▎ | 310886/371472 [2:34:16<4:45:58,  3.53it/s]
 84%|████████▎ | 310887/371472 [2:34:16<4:56:12,  3.41it/s]
 84%|████████▎ | 310888/371472 [2:34:16<4:50:33,  3.48it/s]
 84%|████████▎ | 310889/371472 [2:34:16<4:43:38,  3.56it/s]
 84%|████████▎ | 310890/371472 [2:34:17<4:51:52,  3.46it/s]
 84%|████████▎ | 310891/371472 [2:34:17<4:57:40,  3.39it/s]
 84%|████████▎ | 310892/371472 [2:34:17<4:48:06,  3.50it/s]
 84%|████████▎ | 310893/371472 [2:34:18<4:39:59,  3.61it/s]
 84%|████████▎ | 310894/371472 [2:34:18<4:29:38,  3.74it/s]
 84%|████████▎ | 310895/371472 [2:34:18<4:43:28,  3.56it/s]
 84%|████████▎ | 310896/371472 [2:34:18<4:37:58,  3.63it/s]
 84%|████████▎ | 310897/371472 [2:34:19<4:36:14,  3.65it/s]
 84%|████████▎ | 310898/371472 [2:34:19<4:42:27,  3.57it/s]
 84%|████████▎ | 310899/371472 [2:34:19<4:40:08,  3.60it/s]
 84%|████████▎ | 310900/371472 [2:34:20<4:48:12,  3.50it/s]
                                                           
{'loss': 2.5403, 'learning_rate': 2.468325109353789e-07, 'epoch': 13.39}

 84%|████████▎ | 310900/371472 [2:34:20<4:48:12,  3.50it/s]
 84%|████████▎ | 310901/371472 [2:34:20<4:40:29,  3.60it/s]
 84%|████████▎ | 310902/371472 [2:34:20<4:47:37,  3.51it/s]
 84%|████████▎ | 310903/371472 [2:34:20<5:11:33,  3.24it/s]
 84%|████████▎ | 310904/371472 [2:34:21<4:59:10,  3.37it/s]
 84%|████████▎ | 310905/371472 [2:34:21<4:53:42,  3.44it/s]
 84%|████████▎ | 310906/371472 [2:34:21<4:55:49,  3.41it/s]
 84%|████████▎ | 310907/371472 [2:34:22<4:58:04,  3.39it/s]
 84%|████████▎ | 310908/371472 [2:34:22<5:03:14,  3.33it/s]
 84%|████████▎ | 310909/371472 [2:34:22<4:52:24,  3.45it/s]
 84%|████████▎ | 310910/371472 [2:34:22<4:47:18,  3.51it/s]
 84%|████████▎ | 310911/371472 [2:34:23<4:58:53,  3.38it/s]
 84%|████████▎ | 310912/371472 [2:34:23<4:46:53,  3.52it/s]
 84%|████████▎ | 310913/371472 [2:34:23<4:48:00,  3.50it/s]
 84%|████████▎ | 310914/371472 [2:34:24<4:40:46,  3.59it/s]
 84%|████████▎ | 310915/371472 [2:34:24<5:20:17,  3.15it/s]
 84%|████████▎ | 310916/371472 [2:34:24<5:22:41,  3.13it/s]
 84%|████████▎ | 310917/371472 [2:34:25<5:33:27,  3.03it/s]
 84%|████████▎ | 310918/371472 [2:34:25<5:14:20,  3.21it/s]
 84%|████████▎ | 310919/371472 [2:34:25<5:06:41,  3.29it/s]
 84%|████████▎ | 310920/371472 [2:34:26<5:02:18,  3.34it/s]
                                                           
{'loss': 2.7293, 'learning_rate': 2.467840289599001e-07, 'epoch': 13.39}

 84%|████████▎ | 310920/371472 [2:34:26<5:02:18,  3.34it/s]
 84%|████████▎ | 310921/371472 [2:34:26<4:54:52,  3.42it/s]
 84%|████████▎ | 310922/371472 [2:34:26<4:59:37,  3.37it/s]
 84%|████████▎ | 310923/371472 [2:34:26<5:00:34,  3.36it/s]
 84%|████████▎ | 310924/371472 [2:34:27<4:54:11,  3.43it/s]
 84%|████████▎ | 310925/371472 [2:34:27<4:49:20,  3.49it/s]
 84%|████████▎ | 310926/371472 [2:34:27<5:08:49,  3.27it/s]
 84%|████████▎ | 310927/371472 [2:34:28<4:59:16,  3.37it/s]
 84%|████████▎ | 310928/371472 [2:34:28<5:18:31,  3.17it/s]
 84%|████████▎ | 310929/371472 [2:34:28<5:05:14,  3.31it/s]
 84%|████████▎ | 310930/371472 [2:34:28<4:54:55,  3.42it/s]
 84%|████████▎ | 310931/371472 [2:34:29<5:00:30,  3.36it/s]
 84%|████████▎ | 310932/371472 [2:34:29<5:14:02,  3.21it/s]
 84%|████████▎ | 310933/371472 [2:34:29<5:03:32,  3.32it/s]
 84%|████████▎ | 310934/371472 [2:34:30<5:03:50,  3.32it/s]
 84%|████████▎ | 310935/371472 [2:34:30<4:53:47,  3.43it/s]
 84%|████████▎ | 310936/371472 [2:34:30<4:44:53,  3.54it/s]
 84%|████████▎ | 310937/371472 [2:34:31<4:37:24,  3.64it/s]
 84%|████████▎ | 310938/371472 [2:34:31<5:01:48,  3.34it/s]
 84%|████████▎ | 310939/371472 [2:34:31<5:40:31,  2.96it/s]
 84%|████████▎ | 310940/371472 [2:34:32<5:13:58,  3.21it/s]
                                                           
{'loss': 2.6078, 'learning_rate': 2.467355469844211e-07, 'epoch': 13.39}

 84%|████████▎ | 310940/371472 [2:34:32<5:13:58,  3.21it/s]
 84%|████████▎ | 310941/371472 [2:34:32<4:57:44,  3.39it/s]
 84%|████████▎ | 310942/371472 [2:34:32<4:49:41,  3.48it/s]
 84%|████████▎ | 310943/371472 [2:34:32<4:35:18,  3.66it/s]
 84%|████████▎ | 310944/371472 [2:34:33<4:43:15,  3.56it/s]
 84%|████████▎ | 310945/371472 [2:34:33<4:38:00,  3.63it/s]
 84%|████████▎ | 310946/371472 [2:34:33<4:44:36,  3.54it/s]
 84%|████████▎ | 310947/371472 [2:34:33<4:39:33,  3.61it/s]
 84%|████████▎ | 310948/371472 [2:34:34<4:31:21,  3.72it/s]
 84%|████████▎ | 310949/371472 [2:34:34<4:25:17,  3.80it/s]
 84%|████████▎ | 310950/371472 [2:34:34<4:25:07,  3.80it/s]
 84%|████████▎ | 310951/371472 [2:34:34<4:23:07,  3.83it/s]
 84%|████████▎ | 310952/371472 [2:34:35<4:23:19,  3.83it/s]
 84%|████████▎ | 310953/371472 [2:34:35<4:35:35,  3.66it/s]
 84%|████████▎ | 310954/371472 [2:34:35<4:33:04,  3.69it/s]
 84%|████████▎ | 310955/371472 [2:34:36<4:31:45,  3.71it/s]
 84%|████████▎ | 310956/371472 [2:34:36<4:39:38,  3.61it/s]
 84%|████████▎ | 310957/371472 [2:34:36<4:38:35,  3.62it/s]
 84%|████████▎ | 310958/371472 [2:34:36<4:38:53,  3.62it/s]
 84%|████████▎ | 310959/371472 [2:34:37<4:45:48,  3.53it/s]
 84%|████████▎ | 310960/371472 [2:34:37<4:37:14,  3.64it/s]
                                                           
{'loss': 2.5595, 'learning_rate': 2.466870650089423e-07, 'epoch': 13.39}

 84%|████████▎ | 310960/371472 [2:34:37<4:37:14,  3.64it/s]
 84%|████████▎ | 310961/371472 [2:34:37<4:59:15,  3.37it/s]
 84%|████████▎ | 310962/371472 [2:34:38<4:44:56,  3.54it/s]
 84%|████████▎ | 310963/371472 [2:34:38<4:36:31,  3.65it/s]
 84%|████████▎ | 310964/371472 [2:34:38<4:26:52,  3.78it/s]
 84%|████████▎ | 310965/371472 [2:34:38<4:26:04,  3.79it/s]
 84%|████████▎ | 310966/371472 [2:34:39<4:30:46,  3.72it/s]
 84%|████████▎ | 310967/371472 [2:34:39<4:24:40,  3.81it/s]
 84%|████████▎ | 310968/371472 [2:34:39<4:32:55,  3.69it/s]
 84%|████████▎ | 310969/371472 [2:34:39<4:23:57,  3.82it/s]
 84%|████████▎ | 310970/371472 [2:34:40<4:19:44,  3.88it/s]
 84%|████████▎ | 310971/371472 [2:34:40<4:30:08,  3.73it/s]
 84%|████████▎ | 310972/371472 [2:34:40<4:44:20,  3.55it/s]
 84%|████████▎ | 310973/371472 [2:34:40<4:35:20,  3.66it/s]
 84%|████████▎ | 310974/371472 [2:34:41<4:29:20,  3.74it/s]
 84%|████████▎ | 310975/371472 [2:34:41<4:34:56,  3.67it/s]
 84%|████████▎ | 310976/371472 [2:34:41<4:28:33,  3.75it/s]
 84%|████████▎ | 310977/371472 [2:34:42<4:23:13,  3.83it/s]
 84%|████████▎ | 310978/371472 [2:34:42<4:29:26,  3.74it/s]
 84%|████████▎ | 310979/371472 [2:34:42<4:28:09,  3.76it/s]
 84%|████████▎ | 310980/371472 [2:34:42<4:31:53,  3.71it/s]
                                                           
{'loss': 2.5329, 'learning_rate': 2.466385830334633e-07, 'epoch': 13.39}

 84%|████████▎ | 310980/371472 [2:34:42<4:31:53,  3.71it/s]
 84%|████████▎ | 310981/371472 [2:34:43<4:55:28,  3.41it/s]
 84%|████████▎ | 310982/371472 [2:34:43<5:06:25,  3.29it/s]
 84%|████████▎ | 310983/371472 [2:34:43<4:49:17,  3.48it/s]
 84%|████████▎ | 310984/371472 [2:34:43<4:36:54,  3.64it/s]
 84%|████████▎ | 310985/371472 [2:34:44<4:58:27,  3.38it/s]
 84%|████████▎ | 310986/371472 [2:34:44<4:56:42,  3.40it/s]
 84%|████████▎ | 310987/371472 [2:34:44<4:52:02,  3.45it/s]
 84%|████████▎ | 310988/371472 [2:34:45<4:58:21,  3.38it/s]
 84%|████████▎ | 310989/371472 [2:34:45<4:53:05,  3.44it/s]
 84%|████████▎ | 310990/371472 [2:34:45<5:08:08,  3.27it/s]
 84%|████████▎ | 310991/371472 [2:34:46<4:52:13,  3.45it/s]
 84%|████████▎ | 310992/371472 [2:34:46<4:46:17,  3.52it/s]
 84%|████████▎ | 310993/371472 [2:34:46<4:42:38,  3.57it/s]
 84%|████████▎ | 310994/371472 [2:34:47<5:25:26,  3.10it/s]
 84%|████████▎ | 310995/371472 [2:34:47<5:09:08,  3.26it/s]
 84%|████████▎ | 310996/371472 [2:34:47<4:58:09,  3.38it/s]
 84%|████████▎ | 310997/371472 [2:34:47<4:45:49,  3.53it/s]
 84%|████████▎ | 310998/371472 [2:34:48<4:44:27,  3.54it/s]
 84%|████████▎ | 310999/371472 [2:34:48<4:54:51,  3.42it/s]
 84%|████████▎ | 311000/371472 [2:34:48<4:45:01,  3.54it/s]
                                                           
{'loss': 2.5606, 'learning_rate': 2.4659010105798447e-07, 'epoch': 13.4}

 84%|████████▎ | 311000/371472 [2:34:48<4:45:01,  3.54it/s]
 84%|████████▎ | 311001/371472 [2:34:48<4:47:24,  3.51it/s]
 84%|████████▎ | 311002/371472 [2:34:49<4:50:10,  3.47it/s]
 84%|████████▎ | 311003/371472 [2:34:49<4:36:05,  3.65it/s]
 84%|████████▎ | 311004/371472 [2:34:49<4:37:51,  3.63it/s]
 84%|████████▎ | 311005/371472 [2:34:50<4:38:13,  3.62it/s]
 84%|████████▎ | 311006/371472 [2:34:50<4:36:01,  3.65it/s]
 84%|████████▎ | 311007/371472 [2:34:50<4:40:53,  3.59it/s]
 84%|████████▎ | 311008/371472 [2:34:51<5:33:15,  3.02it/s]
 84%|████████▎ | 311009/371472 [2:34:51<5:07:10,  3.28it/s]
 84%|████████▎ | 311010/371472 [2:34:51<5:10:13,  3.25it/s]
 84%|████████▎ | 311011/371472 [2:34:51<5:04:10,  3.31it/s]
 84%|████████▎ | 311012/371472 [2:34:52<4:59:53,  3.36it/s]
 84%|████████▎ | 311013/371472 [2:34:52<4:46:00,  3.52it/s]
 84%|████████▎ | 311014/371472 [2:34:52<4:38:34,  3.62it/s]
 84%|████████▎ | 311015/371472 [2:34:52<4:28:13,  3.76it/s]
 84%|████████▎ | 311016/371472 [2:34:53<4:28:37,  3.75it/s]
 84%|████████▎ | 311017/371472 [2:34:53<4:27:02,  3.77it/s]
 84%|████████▎ | 311018/371472 [2:34:53<4:21:08,  3.86it/s]
 84%|████████▎ | 311019/371472 [2:34:54<4:25:28,  3.80it/s]
 84%|████████▎ | 311020/371472 [2:34:54<4:29:01,  3.75it/s]
                                                           
{'loss': 2.4948, 'learning_rate': 2.4654161908250554e-07, 'epoch': 13.4}

 84%|████████▎ | 311020/371472 [2:34:54<4:29:01,  3.75it/s]
 84%|████████▎ | 311021/371472 [2:34:54<4:46:48,  3.51it/s]
 84%|████████▎ | 311022/371472 [2:34:54<4:39:32,  3.60it/s]
 84%|████████▎ | 311023/371472 [2:34:55<4:47:27,  3.50it/s]
 84%|████████▎ | 311024/371472 [2:34:55<5:01:18,  3.34it/s]
 84%|████████▎ | 311025/371472 [2:34:55<4:45:59,  3.52it/s]
 84%|████████▎ | 311026/371472 [2:34:56<4:56:28,  3.40it/s]
 84%|████████▎ | 311027/371472 [2:34:56<4:55:14,  3.41it/s]
 84%|████████▎ | 311028/371472 [2:34:56<5:15:00,  3.20it/s]
 84%|████████▎ | 311029/371472 [2:34:57<4:59:19,  3.37it/s]
 84%|████████▎ | 311030/371472 [2:34:57<4:57:57,  3.38it/s]
 84%|████████▎ | 311031/371472 [2:34:57<4:45:43,  3.53it/s]
 84%|████████▎ | 311032/371472 [2:34:57<4:37:48,  3.63it/s]
 84%|████████▎ | 311033/371472 [2:34:58<4:54:31,  3.42it/s]
 84%|████████▎ | 311034/371472 [2:34:58<4:49:25,  3.48it/s]
 84%|████████▎ | 311035/371472 [2:34:58<4:55:03,  3.41it/s]
 84%|████████▎ | 311036/371472 [2:34:59<4:48:26,  3.49it/s]
 84%|████████▎ | 311037/371472 [2:34:59<4:42:48,  3.56it/s]
 84%|████████▎ | 311038/371472 [2:34:59<5:13:21,  3.21it/s]
 84%|████████▎ | 311039/371472 [2:34:59<5:13:02,  3.22it/s]
 84%|████████▎ | 311040/371472 [2:35:00<5:11:30,  3.23it/s]
                                                           
{'loss': 2.6074, 'learning_rate': 2.464931371070266e-07, 'epoch': 13.4}

 84%|████████▎ | 311040/371472 [2:35:00<5:11:30,  3.23it/s]
 84%|████████▎ | 311041/371472 [2:35:00<5:14:10,  3.21it/s]
 84%|████████▎ | 311042/371472 [2:35:00<4:58:36,  3.37it/s]
 84%|████████▎ | 311043/371472 [2:35:01<4:59:27,  3.36it/s]
 84%|████████▎ | 311044/371472 [2:35:01<5:03:41,  3.32it/s]
 84%|████████▎ | 311045/371472 [2:35:01<5:02:46,  3.33it/s]
 84%|████████▎ | 311046/371472 [2:35:02<4:55:54,  3.40it/s]
 84%|████████▎ | 311047/371472 [2:35:02<4:53:27,  3.43it/s]
 84%|████████▎ | 311048/371472 [2:35:02<5:04:05,  3.31it/s]
 84%|████████▎ | 311049/371472 [2:35:02<5:04:40,  3.31it/s]
 84%|████████▎ | 311050/371472 [2:35:03<5:00:48,  3.35it/s]
 84%|████████▎ | 311051/371472 [2:35:03<4:54:33,  3.42it/s]
 84%|████████▎ | 311052/371472 [2:35:03<4:54:25,  3.42it/s]
 84%|████████▎ | 311053/371472 [2:35:04<4:50:24,  3.47it/s]
 84%|████████▎ | 311054/371472 [2:35:04<4:43:54,  3.55it/s]
 84%|████████▎ | 311055/371472 [2:35:04<4:56:57,  3.39it/s]
 84%|████████▎ | 311056/371472 [2:35:04<4:48:55,  3.49it/s]
 84%|████████▎ | 311057/371472 [2:35:05<4:49:33,  3.48it/s]
 84%|████████▎ | 311058/371472 [2:35:05<4:44:14,  3.54it/s]
 84%|████████▎ | 311059/371472 [2:35:05<4:44:52,  3.53it/s]
 84%|████████▎ | 311060/371472 [2:35:06<4:46:24,  3.52it/s]
                                                           
{'loss': 2.6243, 'learning_rate': 2.464446551315478e-07, 'epoch': 13.4}

 84%|████████▎ | 311060/371472 [2:35:06<4:46:24,  3.52it/s]
 84%|████████▎ | 311061/371472 [2:35:06<5:11:08,  3.24it/s]
 84%|████████▎ | 311062/371472 [2:35:06<5:10:14,  3.25it/s]
 84%|████████▎ | 311063/371472 [2:35:07<4:53:35,  3.43it/s]
 84%|████████▎ | 311064/371472 [2:35:07<4:57:40,  3.38it/s]
 84%|████████▎ | 311065/371472 [2:35:07<4:42:25,  3.56it/s]
 84%|████████▎ | 311066/371472 [2:35:07<4:35:35,  3.65it/s]
 84%|████████▎ | 311067/371472 [2:35:08<4:39:37,  3.60it/s]
 84%|████████▎ | 311068/371472 [2:35:08<4:50:20,  3.47it/s]
 84%|████████▎ | 311069/371472 [2:35:08<5:24:37,  3.10it/s]
 84%|████████▎ | 311070/371472 [2:35:09<5:06:36,  3.28it/s]
 84%|████████▎ | 311071/371472 [2:35:09<5:31:29,  3.04it/s]
 84%|████████▎ | 311072/371472 [2:35:09<5:07:47,  3.27it/s]
 84%|████████▎ | 311073/371472 [2:35:09<5:00:32,  3.35it/s]
 84%|████████▎ | 311074/371472 [2:35:10<4:58:47,  3.37it/s]
 84%|████████▎ | 311075/371472 [2:35:10<5:00:40,  3.35it/s]
 84%|████████▎ | 311076/371472 [2:35:10<4:45:35,  3.52it/s]
 84%|████████▎ | 311077/371472 [2:35:11<4:47:20,  3.50it/s]
 84%|████████▎ | 311078/371472 [2:35:11<4:46:49,  3.51it/s]
 84%|████████▎ | 311079/371472 [2:35:11<5:18:58,  3.16it/s]
 84%|████████▎ | 311080/371472 [2:35:12<5:03:35,  3.32it/s]
                                                           
{'loss': 2.7304, 'learning_rate': 2.463961731560688e-07, 'epoch': 13.4}

 84%|████████▎ | 311080/371472 [2:35:12<5:03:35,  3.32it/s]
 84%|████████▎ | 311081/371472 [2:35:12<4:57:21,  3.38it/s]
 84%|████████▎ | 311082/371472 [2:35:12<5:02:56,  3.32it/s]
 84%|████████▎ | 311083/371472 [2:35:12<4:54:49,  3.41it/s]
 84%|████████▎ | 311084/371472 [2:35:13<4:45:12,  3.53it/s]
 84%|████████▎ | 311085/371472 [2:35:13<4:35:14,  3.66it/s]
 84%|████████▎ | 311086/371472 [2:35:13<4:34:15,  3.67it/s]
 84%|████████▎ | 311087/371472 [2:35:13<4:29:57,  3.73it/s]
 84%|████████▎ | 311088/371472 [2:35:14<4:29:28,  3.73it/s]
 84%|████████▎ | 311089/371472 [2:35:14<4:23:57,  3.81it/s]
 84%|████████▎ | 311090/371472 [2:35:14<4:18:30,  3.89it/s]
 84%|████████▎ | 311091/371472 [2:35:15<4:35:20,  3.66it/s]
 84%|████████▎ | 311092/371472 [2:35:15<4:37:09,  3.63it/s]
 84%|████████▎ | 311093/371472 [2:35:15<4:26:02,  3.78it/s]
 84%|████████▎ | 311094/371472 [2:35:15<4:33:34,  3.68it/s]
 84%|████████▎ | 311095/371472 [2:35:16<4:53:55,  3.42it/s]
 84%|████████▎ | 311096/371472 [2:35:16<4:49:10,  3.48it/s]
 84%|████████▎ | 311097/371472 [2:35:16<4:45:46,  3.52it/s]
 84%|████████▎ | 311098/371472 [2:35:17<4:46:13,  3.52it/s]
 84%|████████▎ | 311099/371472 [2:35:17<4:43:40,  3.55it/s]
 84%|████████▎ | 311100/371472 [2:35:17<4:43:35,  3.55it/s]
                                                           
{'loss': 2.6246, 'learning_rate': 2.4634769118058993e-07, 'epoch': 13.4}

 84%|████████▎ | 311100/371472 [2:35:17<4:43:35,  3.55it/s]
 84%|████████▎ | 311101/371472 [2:35:17<4:40:09,  3.59it/s]
 84%|████████▎ | 311102/371472 [2:35:18<4:48:04,  3.49it/s]
 84%|████████▎ | 311103/371472 [2:35:18<4:43:40,  3.55it/s]
 84%|████████▎ | 311104/371472 [2:35:18<4:40:23,  3.59it/s]
 84%|████████▎ | 311105/371472 [2:35:19<4:43:53,  3.54it/s]
 84%|████████▎ | 311106/371472 [2:35:19<4:43:18,  3.55it/s]
 84%|████████▎ | 311107/371472 [2:35:19<5:25:00,  3.10it/s]
 84%|████████▍ | 311108/371472 [2:35:19<5:09:02,  3.26it/s]
 84%|████████▍ | 311109/371472 [2:35:20<4:57:22,  3.38it/s]
 84%|████████▍ | 311110/371472 [2:35:20<4:41:27,  3.57it/s]
 84%|████████▍ | 311111/371472 [2:35:20<4:38:50,  3.61it/s]
 84%|████████▍ | 311112/371472 [2:35:21<4:37:21,  3.63it/s]
 84%|████████▍ | 311113/371472 [2:35:21<4:26:05,  3.78it/s]
 84%|████████▍ | 311114/371472 [2:35:21<4:29:22,  3.73it/s]
 84%|████████▍ | 311115/371472 [2:35:21<4:28:32,  3.75it/s]
 84%|████████▍ | 311116/371472 [2:35:22<4:52:05,  3.44it/s]
 84%|████████▍ | 311117/371472 [2:35:22<4:45:36,  3.52it/s]
 84%|████████▍ | 311118/371472 [2:35:22<4:50:39,  3.46it/s]
 84%|████████▍ | 311119/371472 [2:35:22<4:43:33,  3.55it/s]
 84%|████████▍ | 311120/371472 [2:35:23<4:37:02,  3.63it/s]
                                                           
{'loss': 2.6427, 'learning_rate': 2.46299209205111e-07, 'epoch': 13.4}

 84%|████████▍ | 311120/371472 [2:35:23<4:37:02,  3.63it/s]
 84%|████████▍ | 311121/371472 [2:35:23<4:28:13,  3.75it/s]
 84%|████████▍ | 311122/371472 [2:35:23<4:26:09,  3.78it/s]
 84%|████████▍ | 311123/371472 [2:35:24<4:30:18,  3.72it/s]
 84%|████████▍ | 311124/371472 [2:35:24<4:32:54,  3.69it/s]
 84%|████████▍ | 311125/371472 [2:35:24<4:37:16,  3.63it/s]
 84%|████████▍ | 311126/371472 [2:35:24<4:34:15,  3.67it/s]
 84%|████████▍ | 311127/371472 [2:35:25<4:29:31,  3.73it/s]
 84%|████████▍ | 311128/371472 [2:35:25<4:22:51,  3.83it/s]
 84%|████████▍ | 311129/371472 [2:35:25<4:24:54,  3.80it/s]
 84%|████████▍ | 311130/371472 [2:35:25<4:18:16,  3.89it/s]
 84%|████████▍ | 311131/371472 [2:35:26<4:25:23,  3.79it/s]
 84%|████████▍ | 311132/371472 [2:35:26<4:20:00,  3.87it/s]
 84%|████████▍ | 311133/371472 [2:35:26<4:33:53,  3.67it/s]
 84%|████████▍ | 311134/371472 [2:35:26<4:34:49,  3.66it/s]
 84%|████████▍ | 311135/371472 [2:35:27<4:29:47,  3.73it/s]
 84%|████████▍ | 311136/371472 [2:35:27<4:27:11,  3.76it/s]
 84%|████████▍ | 311137/371472 [2:35:27<4:19:13,  3.88it/s]
 84%|████████▍ | 311138/371472 [2:35:28<4:53:09,  3.43it/s]
 84%|████████▍ | 311139/371472 [2:35:28<4:41:10,  3.58it/s]
 84%|████████▍ | 311140/371472 [2:35:28<4:33:09,  3.68it/s]
                                                           
{'loss': 2.7194, 'learning_rate': 2.462507272296322e-07, 'epoch': 13.4}

 84%|████████▍ | 311140/371472 [2:35:28<4:33:09,  3.68it/s]
 84%|████████▍ | 311141/371472 [2:35:28<4:43:44,  3.54it/s]
 84%|████████▍ | 311142/371472 [2:35:29<4:39:03,  3.60it/s]
 84%|████████▍ | 311143/371472 [2:35:29<4:43:35,  3.55it/s]
 84%|████████▍ | 311144/371472 [2:35:29<4:42:49,  3.56it/s]
 84%|████████▍ | 311145/371472 [2:35:30<4:37:33,  3.62it/s]
 84%|████████▍ | 311146/371472 [2:35:30<4:35:00,  3.66it/s]
 84%|████████▍ | 311147/371472 [2:35:30<4:31:01,  3.71it/s]
 84%|████████▍ | 311148/371472 [2:35:30<4:33:15,  3.68it/s]
 84%|████████▍ | 311149/371472 [2:35:31<4:58:41,  3.37it/s]
 84%|████████▍ | 311150/371472 [2:35:31<4:45:10,  3.53it/s]
 84%|████████▍ | 311151/371472 [2:35:31<4:42:55,  3.55it/s]
 84%|████████▍ | 311152/371472 [2:35:32<4:56:52,  3.39it/s]
 84%|████████▍ | 311153/371472 [2:35:32<4:52:58,  3.43it/s]
 84%|████████▍ | 311154/371472 [2:35:32<4:52:01,  3.44it/s]
 84%|████████▍ | 311155/371472 [2:35:32<5:09:36,  3.25it/s]
 84%|████████▍ | 311156/371472 [2:35:33<5:18:47,  3.15it/s]
 84%|████████▍ | 311157/371472 [2:35:33<5:11:09,  3.23it/s]
 84%|████████▍ | 311158/371472 [2:35:33<4:55:27,  3.40it/s]
 84%|████████▍ | 311159/371472 [2:35:34<5:13:58,  3.20it/s]
 84%|████████▍ | 311160/371472 [2:35:34<4:59:11,  3.36it/s]
                                                           
{'loss': 2.6458, 'learning_rate': 2.4620224525415325e-07, 'epoch': 13.4}

 84%|████████▍ | 311160/371472 [2:35:34<4:59:11,  3.36it/s]
 84%|████████▍ | 311161/371472 [2:35:34<4:46:30,  3.51it/s]
 84%|████████▍ | 311162/371472 [2:35:34<4:34:27,  3.66it/s]
 84%|████████▍ | 311163/371472 [2:35:35<4:30:04,  3.72it/s]
 84%|████████▍ | 311164/371472 [2:35:35<4:35:22,  3.65it/s]
 84%|████████▍ | 311165/371472 [2:35:35<4:25:22,  3.79it/s]
 84%|████████▍ | 311166/371472 [2:35:36<4:37:32,  3.62it/s]
 84%|████████▍ | 311167/371472 [2:35:36<4:31:32,  3.70it/s]
 84%|████████▍ | 311168/371472 [2:35:36<4:39:55,  3.59it/s]
 84%|████████▍ | 311169/371472 [2:35:36<4:46:29,  3.51it/s]
 84%|████████▍ | 311170/371472 [2:35:37<4:37:54,  3.62it/s]
 84%|████████▍ | 311171/371472 [2:35:37<4:39:48,  3.59it/s]
 84%|████████▍ | 311172/371472 [2:35:37<4:38:38,  3.61it/s]
 84%|████████▍ | 311173/371472 [2:35:37<4:36:58,  3.63it/s]
 84%|████████▍ | 311174/371472 [2:35:38<4:57:44,  3.38it/s]
 84%|████████▍ | 311175/371472 [2:35:38<4:46:46,  3.50it/s]
 84%|████████▍ | 311176/371472 [2:35:38<4:39:06,  3.60it/s]
 84%|████████▍ | 311177/371472 [2:35:39<4:26:08,  3.78it/s]
 84%|████████▍ | 311178/371472 [2:35:39<4:34:52,  3.66it/s]
 84%|████████▍ | 311179/371472 [2:35:39<4:44:08,  3.54it/s]
 84%|████████▍ | 311180/371472 [2:35:39<4:44:43,  3.53it/s]
                                                           
{'loss': 2.6192, 'learning_rate': 2.4615376327867443e-07, 'epoch': 13.4}

 84%|████████▍ | 311180/371472 [2:35:39<4:44:43,  3.53it/s]
 84%|████████▍ | 311181/371472 [2:35:40<4:35:43,  3.64it/s]
 84%|████████▍ | 311182/371472 [2:35:40<5:04:06,  3.30it/s]
 84%|████████▍ | 311183/371472 [2:35:40<4:54:51,  3.41it/s]
 84%|████████▍ | 311184/371472 [2:35:41<5:01:42,  3.33it/s]
 84%|████████▍ | 311185/371472 [2:35:41<4:51:56,  3.44it/s]
 84%|████████▍ | 311186/371472 [2:35:41<4:39:08,  3.60it/s]
 84%|████████▍ | 311187/371472 [2:35:41<4:40:06,  3.59it/s]
 84%|████████▍ | 311188/371472 [2:35:42<4:30:18,  3.72it/s]
 84%|████████▍ | 311189/371472 [2:35:42<4:26:13,  3.77it/s]
 84%|████████▍ | 311190/371472 [2:35:42<4:33:18,  3.68it/s]
 84%|████████▍ | 311191/371472 [2:35:43<4:41:31,  3.57it/s]
 84%|████████▍ | 311192/371472 [2:35:43<4:50:16,  3.46it/s]
 84%|████████▍ | 311193/371472 [2:35:43<4:40:23,  3.58it/s]
 84%|████████▍ | 311194/371472 [2:35:43<4:27:33,  3.75it/s]
 84%|████████▍ | 311195/371472 [2:35:44<4:26:41,  3.77it/s]
 84%|████████▍ | 311196/371472 [2:35:44<4:18:21,  3.89it/s]
 84%|████████▍ | 311197/371472 [2:35:44<4:12:22,  3.98it/s]
 84%|████████▍ | 311198/371472 [2:35:44<4:12:20,  3.98it/s]
 84%|████████▍ | 311199/371472 [2:35:45<4:22:29,  3.83it/s]
 84%|████████▍ | 311200/371472 [2:35:45<4:23:56,  3.81it/s]
                                                           
{'loss': 2.743, 'learning_rate': 2.4610528130319545e-07, 'epoch': 13.4}

 84%|████████▍ | 311200/371472 [2:35:45<4:23:56,  3.81it/s]
 84%|████████▍ | 311201/371472 [2:35:45<4:28:30,  3.74it/s]
 84%|████████▍ | 311202/371472 [2:35:45<4:21:46,  3.84it/s]
 84%|████████▍ | 311203/371472 [2:35:46<4:27:18,  3.76it/s]
 84%|████████▍ | 311204/371472 [2:35:46<4:30:13,  3.72it/s]
 84%|████████▍ | 311205/371472 [2:35:46<4:38:02,  3.61it/s]
 84%|████████▍ | 311206/371472 [2:35:47<4:24:45,  3.79it/s]
 84%|████████▍ | 311207/371472 [2:35:47<4:27:25,  3.76it/s]
 84%|████████▍ | 311208/371472 [2:35:47<4:26:18,  3.77it/s]
 84%|████████▍ | 311209/371472 [2:35:47<4:39:32,  3.59it/s]
 84%|████████▍ | 311210/371472 [2:35:48<4:53:49,  3.42it/s]
 84%|████████▍ | 311211/371472 [2:35:48<4:55:54,  3.39it/s]
 84%|████████▍ | 311212/371472 [2:35:48<4:56:47,  3.38it/s]
 84%|████████▍ | 311213/371472 [2:35:49<4:47:19,  3.50it/s]
 84%|████████▍ | 311214/371472 [2:35:49<4:53:40,  3.42it/s]
 84%|████████▍ | 311215/371472 [2:35:49<4:39:45,  3.59it/s]
 84%|████████▍ | 311216/371472 [2:35:49<4:39:23,  3.59it/s]
 84%|████████▍ | 311217/371472 [2:35:50<4:29:53,  3.72it/s]
 84%|████████▍ | 311218/371472 [2:35:50<4:28:25,  3.74it/s]
 84%|████████▍ | 311219/371472 [2:35:50<4:37:15,  3.62it/s]
 84%|████████▍ | 311220/371472 [2:35:50<4:32:37,  3.68it/s]
                                                           
{'loss': 2.5398, 'learning_rate': 2.460567993277166e-07, 'epoch': 13.4}

 84%|████████▍ | 311220/371472 [2:35:50<4:32:37,  3.68it/s]
 84%|████████▍ | 311221/371472 [2:35:51<4:30:45,  3.71it/s]
 84%|████████▍ | 311222/371472 [2:35:51<4:29:42,  3.72it/s]
 84%|████████▍ | 311223/371472 [2:35:51<4:38:34,  3.60it/s]
 84%|████████▍ | 311224/371472 [2:35:52<4:42:07,  3.56it/s]
 84%|████████▍ | 311225/371472 [2:35:52<5:10:51,  3.23it/s]
 84%|████████▍ | 311226/371472 [2:35:52<5:07:19,  3.27it/s]
 84%|████████▍ | 311227/371472 [2:35:53<4:53:43,  3.42it/s]
 84%|████████▍ | 311228/371472 [2:35:53<4:58:18,  3.37it/s]
 84%|████████▍ | 311229/371472 [2:35:53<4:45:40,  3.51it/s]
 84%|████████▍ | 311230/371472 [2:35:53<4:39:25,  3.59it/s]
 84%|████████▍ | 311231/371472 [2:35:54<4:28:20,  3.74it/s]
 84%|████████▍ | 311232/371472 [2:35:54<4:46:49,  3.50it/s]
 84%|████████▍ | 311233/371472 [2:35:54<4:55:07,  3.40it/s]
 84%|████████▍ | 311234/371472 [2:35:54<4:39:05,  3.60it/s]
 84%|████████▍ | 311235/371472 [2:35:55<4:36:59,  3.62it/s]
 84%|████████▍ | 311236/371472 [2:35:55<4:27:07,  3.76it/s]
 84%|████████▍ | 311237/371472 [2:35:55<4:22:54,  3.82it/s]
 84%|████████▍ | 311238/371472 [2:35:56<4:40:19,  3.58it/s]
 84%|████████▍ | 311239/371472 [2:35:56<4:27:56,  3.75it/s]
 84%|████████▍ | 311240/371472 [2:35:56<4:59:25,  3.35it/s]
                                                           
{'loss': 2.7562, 'learning_rate': 2.4600831735223765e-07, 'epoch': 13.41}

 84%|████████▍ | 311240/371472 [2:35:56<4:59:25,  3.35it/s]
 84%|████████▍ | 311241/371472 [2:35:56<4:57:53,  3.37it/s]
 84%|████████▍ | 311242/371472 [2:35:57<4:51:09,  3.45it/s]
 84%|████████▍ | 311243/371472 [2:35:57<4:47:10,  3.50it/s]
 84%|████████▍ | 311244/371472 [2:35:57<4:44:21,  3.53it/s]
 84%|████████▍ | 311245/371472 [2:35:58<4:45:36,  3.51it/s]
 84%|████████▍ | 311246/371472 [2:35:58<4:55:41,  3.39it/s]
 84%|████████▍ | 311247/371472 [2:35:58<5:13:44,  3.20it/s]
 84%|████████▍ | 311248/371472 [2:35:59<5:12:20,  3.21it/s]
 84%|████████▍ | 311249/371472 [2:35:59<5:02:57,  3.31it/s]
 84%|████████▍ | 311250/371472 [2:35:59<4:51:51,  3.44it/s]
 84%|████████▍ | 311251/371472 [2:35:59<4:42:26,  3.55it/s]
 84%|████████▍ | 311252/371472 [2:36:00<5:06:31,  3.27it/s]
 84%|████████▍ | 311253/371472 [2:36:00<5:10:44,  3.23it/s]
 84%|████████▍ | 311254/371472 [2:36:00<5:16:48,  3.17it/s]
 84%|████████▍ | 311255/371472 [2:36:01<5:07:33,  3.26it/s]
 84%|████████▍ | 311256/371472 [2:36:01<4:57:17,  3.38it/s]
 84%|████████▍ | 311257/371472 [2:36:01<5:04:07,  3.30it/s]
 84%|████████▍ | 311258/371472 [2:36:02<4:55:04,  3.40it/s]
 84%|████████▍ | 311259/371472 [2:36:02<4:47:15,  3.49it/s]
 84%|████████▍ | 311260/371472 [2:36:02<5:05:59,  3.28it/s]
                                                           
{'loss': 2.5712, 'learning_rate': 2.459598353767588e-07, 'epoch': 13.41}

 84%|████████▍ | 311260/371472 [2:36:02<5:05:59,  3.28it/s]
 84%|████████▍ | 311261/371472 [2:36:02<4:58:33,  3.36it/s]
 84%|████████▍ | 311262/371472 [2:36:03<5:10:53,  3.23it/s]
 84%|████████▍ | 311263/371472 [2:36:03<5:00:07,  3.34it/s]
 84%|████████▍ | 311264/371472 [2:36:03<5:00:25,  3.34it/s]
 84%|████████▍ | 311265/371472 [2:36:04<4:53:12,  3.42it/s]
 84%|████████▍ | 311266/371472 [2:36:04<5:01:55,  3.32it/s]
 84%|████████▍ | 311267/371472 [2:36:04<4:45:42,  3.51it/s]
 84%|████████▍ | 311268/371472 [2:36:04<4:33:41,  3.67it/s]
 84%|████████▍ | 311269/371472 [2:36:05<4:49:42,  3.46it/s]
 84%|████████▍ | 311270/371472 [2:36:05<4:41:53,  3.56it/s]
 84%|████████▍ | 311271/371472 [2:36:05<5:00:39,  3.34it/s]
 84%|████████▍ | 311272/371472 [2:36:06<5:32:29,  3.02it/s]
 84%|████████▍ | 311273/371472 [2:36:06<5:21:19,  3.12it/s]
 84%|████████▍ | 311274/371472 [2:36:06<5:15:57,  3.18it/s]
 84%|████████▍ | 311275/371472 [2:36:07<4:57:49,  3.37it/s]
 84%|████████▍ | 311276/371472 [2:36:07<5:16:07,  3.17it/s]
 84%|████████▍ | 311277/371472 [2:36:07<5:07:26,  3.26it/s]
 84%|████████▍ | 311278/371472 [2:36:08<5:32:24,  3.02it/s]
 84%|████████▍ | 311279/371472 [2:36:08<5:07:46,  3.26it/s]
 84%|████████▍ | 311280/371472 [2:36:08<4:49:39,  3.46it/s]
                                                           
{'loss': 2.6123, 'learning_rate': 2.459113534012799e-07, 'epoch': 13.41}

 84%|████████▍ | 311280/371472 [2:36:08<4:49:39,  3.46it/s]
 84%|████████▍ | 311281/371472 [2:36:08<5:14:31,  3.19it/s]
 84%|████████▍ | 311282/371472 [2:36:09<5:07:11,  3.27it/s]
 84%|████████▍ | 311283/371472 [2:36:09<4:59:35,  3.35it/s]
 84%|████████▍ | 311284/371472 [2:36:09<5:02:11,  3.32it/s]
 84%|████████▍ | 311285/371472 [2:36:10<4:59:35,  3.35it/s]
 84%|████████▍ | 311286/371472 [2:36:10<5:02:07,  3.32it/s]
 84%|████████▍ | 311287/371472 [2:36:10<4:43:34,  3.54it/s]
 84%|████████▍ | 311288/371472 [2:36:10<4:38:38,  3.60it/s]
 84%|████████▍ | 311289/371472 [2:36:11<4:26:41,  3.76it/s]
 84%|████████▍ | 311290/371472 [2:36:11<4:33:18,  3.67it/s]
 84%|████████▍ | 311291/371472 [2:36:11<4:34:06,  3.66it/s]
 84%|████████▍ | 311292/371472 [2:36:12<4:29:51,  3.72it/s]
 84%|████████▍ | 311293/371472 [2:36:12<4:31:04,  3.70it/s]
 84%|████████▍ | 311294/371472 [2:36:12<4:40:45,  3.57it/s]
 84%|████████▍ | 311295/371472 [2:36:12<5:01:23,  3.33it/s]
 84%|████████▍ | 311296/371472 [2:36:13<5:09:32,  3.24it/s]
 84%|████████▍ | 311297/371472 [2:36:13<5:10:51,  3.23it/s]
 84%|████████▍ | 311298/371472 [2:36:13<5:10:15,  3.23it/s]
 84%|████████▍ | 311299/371472 [2:36:14<5:03:35,  3.30it/s]
 84%|████████▍ | 311300/371472 [2:36:14<4:49:56,  3.46it/s]
                                                           
{'loss': 2.6448, 'learning_rate': 2.4586287142580107e-07, 'epoch': 13.41}

 84%|████████▍ | 311300/371472 [2:36:14<4:49:56,  3.46it/s]
 84%|████████▍ | 311301/371472 [2:36:14<4:45:34,  3.51it/s]
 84%|████████▍ | 311302/371472 [2:36:15<4:41:48,  3.56it/s]
 84%|████████▍ | 311303/371472 [2:36:15<4:48:30,  3.48it/s]
 84%|████████▍ | 311304/371472 [2:36:15<4:35:07,  3.64it/s]
 84%|████████▍ | 311305/371472 [2:36:15<4:46:28,  3.50it/s]
 84%|████████▍ | 311306/371472 [2:36:16<4:39:19,  3.59it/s]
 84%|████████▍ | 311307/371472 [2:36:16<4:37:12,  3.62it/s]
 84%|████████▍ | 311308/371472 [2:36:16<4:33:11,  3.67it/s]
 84%|████████▍ | 311309/371472 [2:36:16<4:37:01,  3.62it/s]
 84%|████████▍ | 311310/371472 [2:36:17<4:41:28,  3.56it/s]
 84%|████████▍ | 311311/371472 [2:36:17<4:28:37,  3.73it/s]
 84%|████████▍ | 311312/371472 [2:36:17<5:08:26,  3.25it/s]
 84%|████████▍ | 311313/371472 [2:36:18<4:53:01,  3.42it/s]
 84%|████████▍ | 311314/371472 [2:36:18<4:41:52,  3.56it/s]
 84%|████████▍ | 311315/371472 [2:36:18<4:39:00,  3.59it/s]
 84%|████████▍ | 311316/371472 [2:36:18<4:38:56,  3.59it/s]
 84%|████████▍ | 311317/371472 [2:36:19<4:35:13,  3.64it/s]
 84%|████████▍ | 311318/371472 [2:36:19<4:31:16,  3.70it/s]
 84%|████████▍ | 311319/371472 [2:36:19<4:28:20,  3.74it/s]
 84%|████████▍ | 311320/371472 [2:36:19<4:30:47,  3.70it/s]
                                                           
{'loss': 2.6371, 'learning_rate': 2.458143894503221e-07, 'epoch': 13.41}

 84%|████████▍ | 311320/371472 [2:36:19<4:30:47,  3.70it/s]
 84%|████████▍ | 311321/371472 [2:36:20<4:26:20,  3.76it/s]
 84%|████████▍ | 311322/371472 [2:36:20<4:29:11,  3.72it/s]
 84%|████████▍ | 311323/371472 [2:36:20<4:29:49,  3.72it/s]
 84%|████████▍ | 311324/371472 [2:36:21<4:43:24,  3.54it/s]
 84%|████████▍ | 311325/371472 [2:36:21<4:40:02,  3.58it/s]
 84%|████████▍ | 311326/371472 [2:36:21<4:49:39,  3.46it/s]
 84%|████████▍ | 311327/371472 [2:36:22<5:13:11,  3.20it/s]
 84%|████████▍ | 311328/371472 [2:36:22<5:03:25,  3.30it/s]
 84%|████████▍ | 311329/371472 [2:36:22<4:53:38,  3.41it/s]
 84%|████████▍ | 311330/371472 [2:36:22<4:42:17,  3.55it/s]
 84%|████████▍ | 311331/371472 [2:36:23<4:40:19,  3.58it/s]
 84%|████████▍ | 311332/371472 [2:36:23<4:30:41,  3.70it/s]
 84%|████████▍ | 311333/371472 [2:36:23<4:25:16,  3.78it/s]
 84%|████████▍ | 311334/371472 [2:36:23<4:22:19,  3.82it/s]
 84%|████████▍ | 311335/371472 [2:36:24<4:30:58,  3.70it/s]
 84%|████████▍ | 311336/371472 [2:36:24<4:29:01,  3.73it/s]
 84%|████████▍ | 311337/371472 [2:36:24<4:29:44,  3.72it/s]
 84%|████████▍ | 311338/371472 [2:36:25<4:48:32,  3.47it/s]
 84%|████████▍ | 311339/371472 [2:36:25<4:42:05,  3.55it/s]
 84%|████████▍ | 311340/371472 [2:36:25<4:29:41,  3.72it/s]
                                                           
{'loss': 2.6925, 'learning_rate': 2.4576590747484327e-07, 'epoch': 13.41}

 84%|████████▍ | 311340/371472 [2:36:25<4:29:41,  3.72it/s]
 84%|████████▍ | 311341/371472 [2:36:25<4:29:09,  3.72it/s]
 84%|████████▍ | 311342/371472 [2:36:26<4:18:05,  3.88it/s]
 84%|████████▍ | 311343/371472 [2:36:26<4:19:25,  3.86it/s]
 84%|████████▍ | 311344/371472 [2:36:26<4:37:25,  3.61it/s]
 84%|████████▍ | 311345/371472 [2:36:26<4:27:53,  3.74it/s]
 84%|████████▍ | 311346/371472 [2:36:27<4:28:51,  3.73it/s]
 84%|████████▍ | 311347/371472 [2:36:27<4:55:54,  3.39it/s]
 84%|████████▍ | 311348/371472 [2:36:27<5:02:31,  3.31it/s]
 84%|████████▍ | 311349/371472 [2:36:28<5:20:35,  3.13it/s]
 84%|████████▍ | 311350/371472 [2:36:28<5:00:27,  3.34it/s]
 84%|████████▍ | 311351/371472 [2:36:28<4:45:58,  3.50it/s]
 84%|████████▍ | 311352/371472 [2:36:28<4:39:37,  3.58it/s]
 84%|████████▍ | 311353/371472 [2:36:29<4:42:34,  3.55it/s]
 84%|████████▍ | 311354/371472 [2:36:29<4:50:57,  3.44it/s]
 84%|████████▍ | 311355/371472 [2:36:29<4:46:46,  3.49it/s]
 84%|████████▍ | 311356/371472 [2:36:30<4:44:21,  3.52it/s]
 84%|████████▍ | 311357/371472 [2:36:30<4:55:02,  3.40it/s]
 84%|████████▍ | 311358/371472 [2:36:30<4:54:41,  3.40it/s]
 84%|████████▍ | 311359/371472 [2:36:30<4:45:26,  3.51it/s]
 84%|████████▍ | 311360/371472 [2:36:31<4:34:13,  3.65it/s]
                                                           
{'loss': 2.5064, 'learning_rate': 2.457174254993643e-07, 'epoch': 13.41}

 84%|████████▍ | 311360/371472 [2:36:31<4:34:13,  3.65it/s]
 84%|████████▍ | 311361/371472 [2:36:31<4:33:12,  3.67it/s]
 84%|████████▍ | 311362/371472 [2:36:31<4:44:05,  3.53it/s]
 84%|████████▍ | 311363/371472 [2:36:32<4:35:05,  3.64it/s]
 84%|████████▍ | 311364/371472 [2:36:32<4:34:11,  3.65it/s]
 84%|████████▍ | 311365/371472 [2:36:32<4:30:09,  3.71it/s]
 84%|████████▍ | 311366/371472 [2:36:32<4:34:53,  3.64it/s]
 84%|████████▍ | 311367/371472 [2:36:33<5:08:07,  3.25it/s]
 84%|████████▍ | 311368/371472 [2:36:33<4:57:05,  3.37it/s]
 84%|████████▍ | 311369/371472 [2:36:33<4:49:15,  3.46it/s]
 84%|████████▍ | 311370/371472 [2:36:34<5:08:14,  3.25it/s]
 84%|████████▍ | 311371/371472 [2:36:34<5:06:50,  3.26it/s]
 84%|████████▍ | 311372/371472 [2:36:34<4:58:18,  3.36it/s]
 84%|████████▍ | 311373/371472 [2:36:35<5:06:15,  3.27it/s]
 84%|████████▍ | 311374/371472 [2:36:35<5:14:50,  3.18it/s]
 84%|████████▍ | 311375/371472 [2:36:35<5:23:25,  3.10it/s]
 84%|████████▍ | 311376/371472 [2:36:36<5:19:16,  3.14it/s]
 84%|████████▍ | 311377/371472 [2:36:36<5:00:34,  3.33it/s]
 84%|████████▍ | 311378/371472 [2:36:36<4:55:10,  3.39it/s]
 84%|████████▍ | 311379/371472 [2:36:36<4:48:40,  3.47it/s]
 84%|████████▍ | 311380/371472 [2:36:37<4:51:09,  3.44it/s]
                                                           
{'loss': 2.4588, 'learning_rate': 2.4566894352388546e-07, 'epoch': 13.41}

 84%|████████▍ | 311380/371472 [2:36:37<4:51:09,  3.44it/s]
 84%|████████▍ | 311381/371472 [2:36:37<4:54:04,  3.41it/s]
 84%|████████▍ | 311382/371472 [2:36:37<4:47:34,  3.48it/s]
 84%|████████▍ | 311383/371472 [2:36:37<4:38:43,  3.59it/s]
 84%|████████▍ | 311384/371472 [2:36:38<4:38:50,  3.59it/s]
 84%|████████▍ | 311385/371472 [2:36:38<4:38:13,  3.60it/s]
 84%|████████▍ | 311386/371472 [2:36:38<4:49:40,  3.46it/s]
 84%|████████▍ | 311387/371472 [2:36:39<4:51:57,  3.43it/s]
 84%|████████▍ | 311388/371472 [2:36:39<4:50:21,  3.45it/s]
 84%|████████▍ | 311389/371472 [2:36:39<4:42:25,  3.55it/s]
 84%|████████▍ | 311390/371472 [2:36:40<4:51:20,  3.44it/s]
 84%|████████▍ | 311391/371472 [2:36:40<4:41:22,  3.56it/s]
 84%|████████▍ | 311392/371472 [2:36:40<4:40:42,  3.57it/s]
 84%|████████▍ | 311393/371472 [2:36:40<4:31:14,  3.69it/s]
 84%|████████▍ | 311394/371472 [2:36:41<4:40:31,  3.57it/s]
 84%|████████▍ | 311395/371472 [2:36:41<4:41:41,  3.55it/s]
 84%|████████▍ | 311396/371472 [2:36:41<4:30:12,  3.71it/s]
 84%|████████▍ | 311397/371472 [2:36:41<4:29:56,  3.71it/s]
 84%|████████▍ | 311398/371472 [2:36:42<4:36:45,  3.62it/s]
 84%|████████▍ | 311399/371472 [2:36:42<4:29:16,  3.72it/s]
 84%|████████▍ | 311400/371472 [2:36:42<4:44:55,  3.51it/s]
                                                           
{'loss': 2.522, 'learning_rate': 2.4562046154840653e-07, 'epoch': 13.41}

 84%|████████▍ | 311400/371472 [2:36:42<4:44:55,  3.51it/s]
 84%|████████▍ | 311401/371472 [2:36:43<4:50:30,  3.45it/s]
 84%|████████▍ | 311402/371472 [2:36:43<4:40:26,  3.57it/s]
 84%|████████▍ | 311403/371472 [2:36:43<4:34:09,  3.65it/s]
 84%|████████▍ | 311404/371472 [2:36:43<4:38:22,  3.60it/s]
 84%|████████▍ | 311405/371472 [2:36:44<4:28:39,  3.73it/s]
 84%|████████▍ | 311406/371472 [2:36:44<4:22:55,  3.81it/s]
 84%|████████▍ | 311407/371472 [2:36:44<4:25:31,  3.77it/s]
 84%|████████▍ | 311408/371472 [2:36:44<4:22:14,  3.82it/s]
 84%|████████▍ | 311409/371472 [2:36:45<4:41:29,  3.56it/s]
 84%|████████▍ | 311410/371472 [2:36:45<4:31:13,  3.69it/s]
 84%|████████▍ | 311411/371472 [2:36:45<4:35:17,  3.64it/s]
 84%|████████▍ | 311412/371472 [2:36:46<4:29:58,  3.71it/s]
 84%|████████▍ | 311413/371472 [2:36:46<4:24:46,  3.78it/s]
 84%|████████▍ | 311414/371472 [2:36:46<4:20:11,  3.85it/s]
 84%|████████▍ | 311415/371472 [2:36:46<4:28:02,  3.73it/s]
 84%|████████▍ | 311416/371472 [2:36:47<4:32:23,  3.67it/s]
 84%|████████▍ | 311417/371472 [2:36:47<4:57:08,  3.37it/s]
 84%|████████▍ | 311418/371472 [2:36:47<4:52:32,  3.42it/s]
 84%|████████▍ | 311419/371472 [2:36:48<4:55:02,  3.39it/s]
 84%|████████▍ | 311420/371472 [2:36:48<4:59:05,  3.35it/s]
                                                           
{'loss': 2.7448, 'learning_rate': 2.455719795729277e-07, 'epoch': 13.41}

 84%|████████▍ | 311420/371472 [2:36:48<4:59:05,  3.35it/s]
 84%|████████▍ | 311421/371472 [2:36:48<4:58:16,  3.36it/s]
 84%|████████▍ | 311422/371472 [2:36:49<5:23:08,  3.10it/s]
 84%|████████▍ | 311423/371472 [2:36:49<4:57:26,  3.36it/s]
 84%|████████▍ | 311424/371472 [2:36:49<4:46:32,  3.49it/s]
 84%|████████▍ | 311425/371472 [2:36:49<5:00:41,  3.33it/s]
 84%|████████▍ | 311426/371472 [2:36:50<4:45:21,  3.51it/s]
 84%|████████▍ | 311427/371472 [2:36:50<4:48:28,  3.47it/s]
 84%|████████▍ | 311428/371472 [2:36:50<4:38:29,  3.59it/s]
 84%|████████▍ | 311429/371472 [2:36:51<5:07:21,  3.26it/s]
 84%|████████▍ | 311430/371472 [2:36:51<4:51:34,  3.43it/s]
 84%|████████▍ | 311431/371472 [2:36:51<4:46:04,  3.50it/s]
 84%|████████▍ | 311432/371472 [2:36:51<4:56:54,  3.37it/s]
 84%|████████▍ | 311433/371472 [2:36:52<5:01:23,  3.32it/s]
 84%|████████▍ | 311434/371472 [2:36:52<4:48:21,  3.47it/s]
 84%|████████▍ | 311435/371472 [2:36:52<4:49:59,  3.45it/s]
 84%|████████▍ | 311436/371472 [2:36:53<4:54:04,  3.40it/s]
 84%|████████▍ | 311437/371472 [2:36:53<4:32:54,  3.67it/s]
 84%|████████▍ | 311438/371472 [2:36:53<4:25:02,  3.78it/s]
 84%|████████▍ | 311439/371472 [2:36:53<4:25:10,  3.77it/s]
 84%|████████▍ | 311440/371472 [2:36:54<4:56:42,  3.37it/s]
                                                           
{'loss': 2.6814, 'learning_rate': 2.455234975974488e-07, 'epoch': 13.41}

 84%|████████▍ | 311440/371472 [2:36:54<4:56:42,  3.37it/s]
 84%|████████▍ | 311441/371472 [2:36:54<4:56:49,  3.37it/s]
 84%|████████▍ | 311442/371472 [2:36:54<4:38:32,  3.59it/s]
 84%|████████▍ | 311443/371472 [2:36:54<4:43:40,  3.53it/s]
 84%|████████▍ | 311444/371472 [2:36:55<4:51:33,  3.43it/s]
 84%|████████▍ | 311445/371472 [2:36:55<4:43:46,  3.53it/s]
 84%|████████▍ | 311446/371472 [2:36:55<4:34:46,  3.64it/s]
 84%|████████▍ | 311447/371472 [2:36:56<4:30:40,  3.70it/s]
 84%|████████▍ | 311448/371472 [2:36:56<4:35:36,  3.63it/s]
 84%|████████▍ | 311449/371472 [2:36:56<4:51:23,  3.43it/s]
 84%|████████▍ | 311450/371472 [2:36:56<4:40:30,  3.57it/s]
 84%|████████▍ | 311451/371472 [2:36:57<4:41:02,  3.56it/s]
 84%|████████▍ | 311452/371472 [2:36:57<4:33:37,  3.66it/s]
 84%|████████▍ | 311453/371472 [2:36:57<4:29:49,  3.71it/s]
 84%|████████▍ | 311454/371472 [2:36:57<4:24:09,  3.79it/s]
 84%|████████▍ | 311455/371472 [2:36:58<4:21:32,  3.82it/s]
 84%|████████▍ | 311456/371472 [2:36:58<4:20:55,  3.83it/s]
 84%|████████▍ | 311457/371472 [2:36:58<5:00:14,  3.33it/s]
 84%|████████▍ | 311458/371472 [2:36:59<4:53:40,  3.41it/s]
 84%|████████▍ | 311459/371472 [2:36:59<4:43:13,  3.53it/s]
 84%|████████▍ | 311460/371472 [2:36:59<4:54:28,  3.40it/s]
                                                           
{'loss': 2.5064, 'learning_rate': 2.454750156219699e-07, 'epoch': 13.42}

 84%|████████▍ | 311460/371472 [2:36:59<4:54:28,  3.40it/s]
 84%|████████▍ | 311461/371472 [2:37:00<4:56:57,  3.37it/s]
 84%|████████▍ | 311462/371472 [2:37:00<4:40:04,  3.57it/s]
 84%|████████▍ | 311463/371472 [2:37:00<4:40:01,  3.57it/s]
 84%|████████▍ | 311464/371472 [2:37:00<4:35:28,  3.63it/s]
 84%|████████▍ | 311465/371472 [2:37:01<4:34:22,  3.64it/s]
 84%|████████▍ | 311466/371472 [2:37:01<4:49:20,  3.46it/s]
 84%|████████▍ | 311467/371472 [2:37:01<4:40:01,  3.57it/s]
 84%|████████▍ | 311468/371472 [2:37:01<4:36:15,  3.62it/s]
 84%|████████▍ | 311469/371472 [2:37:02<4:29:55,  3.70it/s]
 84%|████████▍ | 311470/371472 [2:37:02<4:24:00,  3.79it/s]
 84%|████████▍ | 311471/371472 [2:37:02<4:34:20,  3.65it/s]
 84%|████████▍ | 311472/371472 [2:37:03<4:33:58,  3.65it/s]
 84%|████████▍ | 311473/371472 [2:37:03<4:58:53,  3.35it/s]
 84%|████████▍ | 311474/371472 [2:37:03<5:00:24,  3.33it/s]
 84%|████████▍ | 311475/371472 [2:37:03<4:56:52,  3.37it/s]
 84%|████████▍ | 311476/371472 [2:37:04<5:21:24,  3.11it/s]
 84%|████████▍ | 311477/371472 [2:37:04<5:19:24,  3.13it/s]
 84%|████████▍ | 311478/371472 [2:37:04<5:12:33,  3.20it/s]
 84%|████████▍ | 311479/371472 [2:37:05<5:05:50,  3.27it/s]
 84%|████████▍ | 311480/371472 [2:37:05<4:47:08,  3.48it/s]
                                                           
{'loss': 2.764, 'learning_rate': 2.4542653364649093e-07, 'epoch': 13.42}

 84%|████████▍ | 311480/371472 [2:37:05<4:47:08,  3.48it/s]
 84%|████████▍ | 311481/371472 [2:37:05<4:40:32,  3.56it/s]
 84%|████████▍ | 311482/371472 [2:37:06<4:31:01,  3.69it/s]
 84%|████████▍ | 311483/371472 [2:37:06<4:53:52,  3.40it/s]
 84%|████████▍ | 311484/371472 [2:37:06<5:13:37,  3.19it/s]
 84%|████████▍ | 311485/371472 [2:37:07<5:16:08,  3.16it/s]
 84%|████████▍ | 311486/371472 [2:37:07<5:07:45,  3.25it/s]
 84%|████████▍ | 311487/371472 [2:37:07<4:51:07,  3.43it/s]
 84%|████████▍ | 311488/371472 [2:37:07<4:44:31,  3.51it/s]
 84%|████████▍ | 311489/371472 [2:37:08<4:45:50,  3.50it/s]
 84%|████████▍ | 311490/371472 [2:37:08<4:56:46,  3.37it/s]
 84%|████████▍ | 311491/371472 [2:37:08<4:48:50,  3.46it/s]
 84%|████████▍ | 311492/371472 [2:37:09<5:09:48,  3.23it/s]
 84%|████████▍ | 311493/371472 [2:37:09<4:53:41,  3.40it/s]
 84%|████████▍ | 311494/371472 [2:37:09<4:42:26,  3.54it/s]
 84%|████████▍ | 311495/371472 [2:37:09<4:34:41,  3.64it/s]
 84%|████████▍ | 311496/371472 [2:37:10<4:35:01,  3.63it/s]
 84%|████████▍ | 311497/371472 [2:37:10<4:35:34,  3.63it/s]
 84%|████████▍ | 311498/371472 [2:37:10<4:41:48,  3.55it/s]
 84%|████████▍ | 311499/371472 [2:37:10<4:26:33,  3.75it/s]
 84%|████████▍ | 311500/371472 [2:37:11<5:01:20,  3.32it/s]
                                                           
{'loss': 2.6298, 'learning_rate': 2.453780516710121e-07, 'epoch': 13.42}

 84%|████████▍ | 311500/371472 [2:37:11<5:01:20,  3.32it/s]
 84%|████████▍ | 311501/371472 [2:37:11<4:49:23,  3.45it/s]
 84%|████████▍ | 311502/371472 [2:37:11<4:37:28,  3.60it/s]
 84%|████████▍ | 311503/371472 [2:37:12<4:33:29,  3.65it/s]
 84%|████████▍ | 311504/371472 [2:37:12<4:24:49,  3.77it/s]
 84%|████████▍ | 311505/371472 [2:37:12<4:18:09,  3.87it/s]
 84%|████████▍ | 311506/371472 [2:37:12<4:25:07,  3.77it/s]
 84%|████████▍ | 311507/371472 [2:37:13<4:30:02,  3.70it/s]
 84%|████████▍ | 311508/371472 [2:37:13<4:26:33,  3.75it/s]
 84%|████████▍ | 311509/371472 [2:37:13<4:22:25,  3.81it/s]
 84%|████████▍ | 311510/371472 [2:37:13<4:20:58,  3.83it/s]
 84%|████████▍ | 311511/371472 [2:37:14<4:22:48,  3.80it/s]
 84%|████████▍ | 311512/371472 [2:37:14<4:31:56,  3.67it/s]
 84%|████████▍ | 311513/371472 [2:37:14<4:49:41,  3.45it/s]
 84%|████████▍ | 311514/371472 [2:37:15<4:41:18,  3.55it/s]
 84%|████████▍ | 311515/371472 [2:37:15<4:33:13,  3.66it/s]
 84%|████████▍ | 311516/371472 [2:37:15<4:28:20,  3.72it/s]
 84%|████████▍ | 311517/371472 [2:37:15<4:25:28,  3.76it/s]
 84%|████████▍ | 311518/371472 [2:37:16<4:24:39,  3.78it/s]
 84%|████████▍ | 311519/371472 [2:37:16<4:22:46,  3.80it/s]
 84%|████████▍ | 311520/371472 [2:37:16<4:20:34,  3.83it/s]
                                                           
{'loss': 2.7895, 'learning_rate': 2.453295696955332e-07, 'epoch': 13.42}

 84%|████████▍ | 311520/371472 [2:37:16<4:20:34,  3.83it/s]
 84%|████████▍ | 311521/371472 [2:37:16<4:22:16,  3.81it/s]
 84%|████████▍ | 311522/371472 [2:37:17<4:34:10,  3.64it/s]
 84%|████████▍ | 311523/371472 [2:37:17<4:39:22,  3.58it/s]
 84%|████████▍ | 311524/371472 [2:37:17<4:30:46,  3.69it/s]
 84%|████████▍ | 311525/371472 [2:37:17<4:25:20,  3.77it/s]
 84%|████████▍ | 311526/371472 [2:37:18<4:17:30,  3.88it/s]
 84%|████████▍ | 311527/371472 [2:37:18<4:22:47,  3.80it/s]
 84%|████████▍ | 311528/371472 [2:37:18<4:19:14,  3.85it/s]
 84%|████████▍ | 311529/371472 [2:37:19<4:18:48,  3.86it/s]
 84%|████████▍ | 311530/371472 [2:37:19<4:32:55,  3.66it/s]
 84%|████████▍ | 311531/371472 [2:37:19<4:52:18,  3.42it/s]
 84%|████████▍ | 311532/371472 [2:37:19<4:38:44,  3.58it/s]
 84%|████████▍ | 311533/371472 [2:37:20<4:29:19,  3.71it/s]
 84%|████████▍ | 311534/371472 [2:37:20<4:27:43,  3.73it/s]
 84%|████████▍ | 311535/371472 [2:37:20<4:25:09,  3.77it/s]
 84%|████████▍ | 311536/371472 [2:37:20<4:23:09,  3.80it/s]
 84%|████████▍ | 311537/371472 [2:37:21<4:18:10,  3.87it/s]
 84%|████████▍ | 311538/371472 [2:37:21<4:28:28,  3.72it/s]
 84%|████████▍ | 311539/371472 [2:37:21<4:43:35,  3.52it/s]
 84%|████████▍ | 311540/371472 [2:37:22<4:37:32,  3.60it/s]
                                                           
{'loss': 2.8188, 'learning_rate': 2.4528108772005435e-07, 'epoch': 13.42}

 84%|████████▍ | 311540/371472 [2:37:22<4:37:32,  3.60it/s]
 84%|████████▍ | 311541/371472 [2:37:22<4:30:32,  3.69it/s]
 84%|████████▍ | 311542/371472 [2:37:22<4:22:20,  3.81it/s]
 84%|████████▍ | 311543/371472 [2:37:22<4:27:51,  3.73it/s]
 84%|████████▍ | 311544/371472 [2:37:23<4:19:21,  3.85it/s]
 84%|████████▍ | 311545/371472 [2:37:23<4:14:08,  3.93it/s]
 84%|████████▍ | 311546/371472 [2:37:23<4:24:20,  3.78it/s]
 84%|████████▍ | 311547/371472 [2:37:23<4:28:35,  3.72it/s]
 84%|████████▍ | 311548/371472 [2:37:24<4:19:36,  3.85it/s]
 84%|████████▍ | 311549/371472 [2:37:24<4:25:21,  3.76it/s]
 84%|████████▍ | 311550/371472 [2:37:24<5:08:00,  3.24it/s]
 84%|████████▍ | 311551/371472 [2:37:25<5:06:25,  3.26it/s]
 84%|████████▍ | 311552/371472 [2:37:25<5:12:01,  3.20it/s]
 84%|████████▍ | 311553/371472 [2:37:25<5:01:25,  3.31it/s]
 84%|████████▍ | 311554/371472 [2:37:25<4:48:37,  3.46it/s]
 84%|████████▍ | 311555/371472 [2:37:26<4:46:46,  3.48it/s]
 84%|████████▍ | 311556/371472 [2:37:26<4:42:17,  3.54it/s]
 84%|████████▍ | 311557/371472 [2:37:26<4:47:16,  3.48it/s]
 84%|████████▍ | 311558/371472 [2:37:27<5:21:25,  3.11it/s]
 84%|████████▍ | 311559/371472 [2:37:27<5:14:19,  3.18it/s]
 84%|████████▍ | 311560/371472 [2:37:27<5:06:20,  3.26it/s]
                                                           
{'loss': 2.5353, 'learning_rate': 2.452326057445754e-07, 'epoch': 13.42}

 84%|████████▍ | 311560/371472 [2:37:27<5:06:20,  3.26it/s]
 84%|████████▍ | 311561/371472 [2:37:28<4:54:51,  3.39it/s]
 84%|████████▍ | 311562/371472 [2:37:28<4:42:50,  3.53it/s]
 84%|████████▍ | 311563/371472 [2:37:28<4:35:36,  3.62it/s]
 84%|████████▍ | 311564/371472 [2:37:28<4:39:50,  3.57it/s]
 84%|████████▍ | 311565/371472 [2:37:29<4:31:38,  3.68it/s]
 84%|████████▍ | 311566/371472 [2:37:29<4:49:23,  3.45it/s]
 84%|████████▍ | 311567/371472 [2:37:29<4:37:01,  3.60it/s]
 84%|████████▍ | 311568/371472 [2:37:29<4:26:43,  3.74it/s]
 84%|████████▍ | 311569/371472 [2:37:30<4:37:06,  3.60it/s]
 84%|████████▍ | 311570/371472 [2:37:30<4:37:01,  3.60it/s]
 84%|████████▍ | 311571/371472 [2:37:30<4:28:44,  3.71it/s]
 84%|████████▍ | 311572/371472 [2:37:31<4:37:31,  3.60it/s]
 84%|████████▍ | 311573/371472 [2:37:31<4:25:12,  3.76it/s]
 84%|████████▍ | 311574/371472 [2:37:31<4:22:34,  3.80it/s]
 84%|████████▍ | 311575/371472 [2:37:31<4:41:24,  3.55it/s]
 84%|████████▍ | 311576/371472 [2:37:32<5:08:16,  3.24it/s]
 84%|████████▍ | 311577/371472 [2:37:32<5:03:58,  3.28it/s]
 84%|████████▍ | 311578/371472 [2:37:32<5:13:42,  3.18it/s]
 84%|████████▍ | 311579/371472 [2:37:33<4:57:13,  3.36it/s]
 84%|████████▍ | 311580/371472 [2:37:33<4:53:37,  3.40it/s]
                                                           
{'loss': 2.7352, 'learning_rate': 2.4518412376909644e-07, 'epoch': 13.42}

 84%|████████▍ | 311580/371472 [2:37:33<4:53:37,  3.40it/s]
 84%|████████▍ | 311581/371472 [2:37:33<4:44:44,  3.51it/s]
 84%|████████▍ | 311582/371472 [2:37:34<4:49:47,  3.44it/s]
 84%|████████▍ | 311583/371472 [2:37:34<4:42:05,  3.54it/s]
 84%|████████▍ | 311584/371472 [2:37:34<4:37:11,  3.60it/s]
 84%|████████▍ | 311585/371472 [2:37:34<4:32:52,  3.66it/s]
 84%|████████▍ | 311586/371472 [2:37:35<4:51:43,  3.42it/s]
 84%|████████▍ | 311587/371472 [2:37:35<4:38:56,  3.58it/s]
 84%|████████▍ | 311588/371472 [2:37:35<4:36:46,  3.61it/s]
 84%|████████▍ | 311589/371472 [2:37:35<4:30:03,  3.70it/s]
 84%|████████▍ | 311590/371472 [2:37:36<4:22:24,  3.80it/s]
 84%|████████▍ | 311591/371472 [2:37:36<4:25:17,  3.76it/s]
 84%|████████▍ | 311592/371472 [2:37:36<4:23:29,  3.79it/s]
 84%|████████▍ | 311593/371472 [2:37:37<4:34:06,  3.64it/s]
 84%|████████▍ | 311594/371472 [2:37:37<4:37:57,  3.59it/s]
 84%|████████▍ | 311595/371472 [2:37:37<4:50:02,  3.44it/s]
 84%|████████▍ | 311596/371472 [2:37:37<4:53:59,  3.39it/s]
 84%|████████▍ | 311597/371472 [2:37:38<4:51:32,  3.42it/s]
 84%|████████▍ | 311598/371472 [2:37:38<5:06:50,  3.25it/s]
 84%|████████▍ | 311599/371472 [2:37:38<4:51:12,  3.43it/s]
 84%|████████▍ | 311600/371472 [2:37:39<4:44:21,  3.51it/s]
                                                           
{'loss': 2.6017, 'learning_rate': 2.451356417936176e-07, 'epoch': 13.42}

 84%|████████▍ | 311600/371472 [2:37:39<4:44:21,  3.51it/s]
 84%|████████▍ | 311601/371472 [2:37:39<4:36:37,  3.61it/s]
 84%|████████▍ | 311602/371472 [2:37:39<4:32:41,  3.66it/s]
 84%|████████▍ | 311603/371472 [2:37:39<4:48:31,  3.46it/s]
 84%|████████▍ | 311604/371472 [2:37:40<4:52:19,  3.41it/s]
 84%|████████▍ | 311605/371472 [2:37:40<4:46:38,  3.48it/s]
 84%|████████▍ | 311606/371472 [2:37:40<4:31:45,  3.67it/s]
 84%|████████▍ | 311607/371472 [2:37:40<4:25:00,  3.76it/s]
 84%|████████▍ | 311608/371472 [2:37:41<4:27:43,  3.73it/s]
 84%|████████▍ | 311609/371472 [2:37:41<4:36:09,  3.61it/s]
 84%|████████▍ | 311610/371472 [2:37:41<4:32:38,  3.66it/s]
 84%|████████▍ | 311611/371472 [2:37:42<4:25:13,  3.76it/s]
 84%|████████▍ | 311612/371472 [2:37:42<4:25:42,  3.75it/s]
 84%|████████▍ | 311613/371472 [2:37:42<4:29:49,  3.70it/s]
 84%|████████▍ | 311614/371472 [2:37:42<4:57:32,  3.35it/s]
 84%|████████▍ | 311615/371472 [2:37:43<4:46:59,  3.48it/s]
 84%|████████▍ | 311616/371472 [2:37:43<4:39:14,  3.57it/s]
 84%|████████▍ | 311617/371472 [2:37:43<4:43:57,  3.51it/s]
 84%|████████▍ | 311618/371472 [2:37:44<4:34:08,  3.64it/s]
 84%|████████▍ | 311619/371472 [2:37:44<4:24:57,  3.76it/s]
 84%|████████▍ | 311620/371472 [2:37:44<4:31:25,  3.68it/s]
                                                           
{'loss': 2.6726, 'learning_rate': 2.4508715981813864e-07, 'epoch': 13.42}

 84%|████████▍ | 311620/371472 [2:37:44<4:31:25,  3.68it/s]
 84%|████████▍ | 311621/371472 [2:37:44<4:24:25,  3.77it/s]
 84%|████████▍ | 311622/371472 [2:37:45<4:20:10,  3.83it/s]
 84%|████████▍ | 311623/371472 [2:37:45<4:39:48,  3.56it/s]
 84%|████████▍ | 311624/371472 [2:37:45<4:29:19,  3.70it/s]
 84%|████████▍ | 311625/371472 [2:37:45<4:33:18,  3.65it/s]
 84%|████████▍ | 311626/371472 [2:37:46<4:23:24,  3.79it/s]
 84%|████████▍ | 311627/371472 [2:37:46<4:20:18,  3.83it/s]
 84%|████████▍ | 311628/371472 [2:37:46<4:24:28,  3.77it/s]
 84%|████████▍ | 311629/371472 [2:37:46<4:25:35,  3.76it/s]
 84%|████████▍ | 311630/371472 [2:37:47<4:32:11,  3.66it/s]
 84%|████████▍ | 311631/371472 [2:37:47<4:54:56,  3.38it/s]
 84%|████████▍ | 311632/371472 [2:37:47<5:15:18,  3.16it/s]
 84%|████████▍ | 311633/371472 [2:37:48<4:54:00,  3.39it/s]
 84%|████████▍ | 311634/371472 [2:37:48<4:44:13,  3.51it/s]
 84%|████████▍ | 311635/371472 [2:37:48<4:49:12,  3.45it/s]
 84%|████████▍ | 311636/371472 [2:37:49<4:36:37,  3.61it/s]
 84%|████████▍ | 311637/371472 [2:37:49<4:29:03,  3.71it/s]
 84%|████████▍ | 311638/371472 [2:37:49<4:29:29,  3.70it/s]
 84%|████████▍ | 311639/371472 [2:37:49<4:33:14,  3.65it/s]
 84%|████████▍ | 311640/371472 [2:37:50<4:49:10,  3.45it/s]
                                                           
{'loss': 2.5684, 'learning_rate': 2.450386778426598e-07, 'epoch': 13.42}

 84%|████████▍ | 311640/371472 [2:37:50<4:49:10,  3.45it/s]
 84%|████████▍ | 311641/371472 [2:37:50<4:46:49,  3.48it/s]
 84%|████████▍ | 311642/371472 [2:37:50<4:34:16,  3.64it/s]
 84%|████████▍ | 311643/371472 [2:37:50<4:37:47,  3.59it/s]
 84%|████████▍ | 311644/371472 [2:37:51<4:38:04,  3.59it/s]
 84%|████████▍ | 311645/371472 [2:37:51<4:34:55,  3.63it/s]
 84%|████████▍ | 311646/371472 [2:37:51<4:36:41,  3.60it/s]
 84%|████████▍ | 311647/371472 [2:37:52<4:45:26,  3.49it/s]
 84%|████████▍ | 311648/371472 [2:37:52<4:41:45,  3.54it/s]
 84%|████████▍ | 311649/371472 [2:37:52<4:29:15,  3.70it/s]
 84%|████████▍ | 311650/371472 [2:37:52<4:33:27,  3.65it/s]
 84%|████████▍ | 311651/371472 [2:37:53<4:34:15,  3.64it/s]
 84%|████████▍ | 311652/371472 [2:37:53<4:29:49,  3.70it/s]
 84%|████████▍ | 311653/371472 [2:37:53<4:19:57,  3.84it/s]
 84%|████████▍ | 311654/371472 [2:37:54<4:31:37,  3.67it/s]
 84%|████████▍ | 311655/371472 [2:37:54<4:39:22,  3.57it/s]
 84%|████████▍ | 311656/371472 [2:37:54<4:37:58,  3.59it/s]
 84%|████████▍ | 311657/371472 [2:37:54<5:05:24,  3.26it/s]
 84%|████████▍ | 311658/371472 [2:37:55<4:46:00,  3.49it/s]
 84%|████████▍ | 311659/371472 [2:37:55<4:34:05,  3.64it/s]
 84%|████████▍ | 311660/371472 [2:37:55<4:32:48,  3.65it/s]
                                                           
{'loss': 2.6366, 'learning_rate': 2.449901958671809e-07, 'epoch': 13.42}

 84%|████████▍ | 311660/371472 [2:37:55<4:32:48,  3.65it/s]
 84%|████████▍ | 311661/371472 [2:37:55<4:35:26,  3.62it/s]
 84%|████████▍ | 311662/371472 [2:37:56<4:38:43,  3.58it/s]
 84%|████████▍ | 311663/371472 [2:37:56<4:39:54,  3.56it/s]
 84%|████████▍ | 311664/371472 [2:37:56<4:33:46,  3.64it/s]
 84%|████████▍ | 311665/371472 [2:37:57<4:26:05,  3.75it/s]
 84%|████████▍ | 311666/371472 [2:37:57<4:31:07,  3.68it/s]
 84%|████████▍ | 311667/371472 [2:37:57<4:32:49,  3.65it/s]
 84%|████████▍ | 311668/371472 [2:37:57<4:42:40,  3.53it/s]
 84%|████████▍ | 311669/371472 [2:37:58<4:38:05,  3.58it/s]
 84%|████████▍ | 311670/371472 [2:37:58<4:48:26,  3.46it/s]
 84%|████████▍ | 311671/371472 [2:37:58<4:45:58,  3.49it/s]
 84%|████████▍ | 311672/371472 [2:37:59<4:41:21,  3.54it/s]
 84%|████████▍ | 311673/371472 [2:37:59<4:33:03,  3.65it/s]
 84%|████████▍ | 311674/371472 [2:37:59<4:43:45,  3.51it/s]
 84%|████████▍ | 311675/371472 [2:37:59<4:44:20,  3.50it/s]
 84%|████████▍ | 311676/371472 [2:38:00<4:40:06,  3.56it/s]
 84%|████████▍ | 311677/371472 [2:38:00<4:32:30,  3.66it/s]
 84%|████████▍ | 311678/371472 [2:38:00<4:39:20,  3.57it/s]
 84%|████████▍ | 311679/371472 [2:38:01<5:02:33,  3.29it/s]
 84%|████████▍ | 311680/371472 [2:38:01<4:46:11,  3.48it/s]
                                                           
{'loss': 2.5527, 'learning_rate': 2.4494171389170207e-07, 'epoch': 13.42}

 84%|████████▍ | 311680/371472 [2:38:01<4:46:11,  3.48it/s]
 84%|████████▍ | 311681/371472 [2:38:01<4:53:41,  3.39it/s]
 84%|████████▍ | 311682/371472 [2:38:01<4:38:30,  3.58it/s]
 84%|████████▍ | 311683/371472 [2:38:02<4:40:50,  3.55it/s]
 84%|████████▍ | 311684/371472 [2:38:02<4:38:42,  3.58it/s]
 84%|████████▍ | 311685/371472 [2:38:02<4:32:36,  3.66it/s]
 84%|████████▍ | 311686/371472 [2:38:03<4:38:39,  3.58it/s]
 84%|████████▍ | 311687/371472 [2:38:03<4:32:01,  3.66it/s]
 84%|████████▍ | 311688/371472 [2:38:03<4:25:23,  3.75it/s]
 84%|████████▍ | 311689/371472 [2:38:03<4:23:59,  3.77it/s]
 84%|████████▍ | 311690/371472 [2:38:04<4:20:47,  3.82it/s]
 84%|████████▍ | 311691/371472 [2:38:04<4:39:41,  3.56it/s]
 84%|████████▍ | 311692/371472 [2:38:04<4:36:10,  3.61it/s]
 84%|████████▍ | 311693/371472 [2:38:04<4:32:13,  3.66it/s]
 84%|████████▍ | 311694/371472 [2:38:05<4:28:38,  3.71it/s]
 84%|████████▍ | 311695/371472 [2:38:05<4:55:21,  3.37it/s]
 84%|████████▍ | 311696/371472 [2:38:05<4:49:18,  3.44it/s]
 84%|████████▍ | 311697/371472 [2:38:06<4:46:57,  3.47it/s]
 84%|████████▍ | 311698/371472 [2:38:06<4:34:50,  3.62it/s]
 84%|████████▍ | 311699/371472 [2:38:06<5:01:13,  3.31it/s]
 84%|████████▍ | 311700/371472 [2:38:07<5:17:00,  3.14it/s]
                                                           
{'loss': 2.6648, 'learning_rate': 2.4489323191622314e-07, 'epoch': 13.43}

 84%|████████▍ | 311700/371472 [2:38:07<5:17:00,  3.14it/s]
 84%|████████▍ | 311701/371472 [2:38:07<4:59:27,  3.33it/s]
 84%|████████▍ | 311702/371472 [2:38:07<4:51:34,  3.42it/s]
 84%|████████▍ | 311703/371472 [2:38:07<4:44:41,  3.50it/s]
 84%|████████▍ | 311704/371472 [2:38:08<4:47:36,  3.46it/s]
 84%|████████▍ | 311705/371472 [2:38:08<4:41:08,  3.54it/s]
 84%|████████▍ | 311706/371472 [2:38:08<4:51:22,  3.42it/s]
 84%|████████▍ | 311707/371472 [2:38:08<4:42:36,  3.52it/s]
 84%|████████▍ | 311708/371472 [2:38:09<4:54:31,  3.38it/s]
 84%|████████▍ | 311709/371472 [2:38:09<4:56:47,  3.36it/s]
 84%|████████▍ | 311710/371472 [2:38:09<5:06:40,  3.25it/s]
 84%|████████▍ | 311711/371472 [2:38:10<4:48:54,  3.45it/s]
 84%|████████▍ | 311712/371472 [2:38:10<4:38:07,  3.58it/s]
 84%|████████▍ | 311713/371472 [2:38:10<4:36:37,  3.60it/s]
 84%|████████▍ | 311714/371472 [2:38:11<4:37:53,  3.58it/s]
 84%|████████▍ | 311715/371472 [2:38:11<4:44:38,  3.50it/s]
 84%|████████▍ | 311716/371472 [2:38:11<4:39:38,  3.56it/s]
 84%|████████▍ | 311717/371472 [2:38:11<4:33:53,  3.64it/s]
 84%|████████▍ | 311718/371472 [2:38:12<4:42:59,  3.52it/s]
 84%|████████▍ | 311719/371472 [2:38:12<4:50:45,  3.43it/s]
 84%|████████▍ | 311720/371472 [2:38:12<4:42:10,  3.53it/s]
                                                           
{'loss': 2.6971, 'learning_rate': 2.4484474994074426e-07, 'epoch': 13.43}

 84%|████████▍ | 311720/371472 [2:38:12<4:42:10,  3.53it/s]
 84%|████████▍ | 311721/371472 [2:38:13<4:42:29,  3.53it/s]
 84%|████████▍ | 311722/371472 [2:38:13<4:37:17,  3.59it/s]
 84%|████████▍ | 311723/371472 [2:38:13<4:38:23,  3.58it/s]
 84%|████████▍ | 311724/371472 [2:38:13<4:43:56,  3.51it/s]
 84%|████████▍ | 311725/371472 [2:38:14<4:58:35,  3.34it/s]
 84%|████████▍ | 311726/371472 [2:38:14<4:52:31,  3.40it/s]
 84%|████████▍ | 311727/371472 [2:38:14<4:48:07,  3.46it/s]
 84%|████████▍ | 311728/371472 [2:38:15<4:42:14,  3.53it/s]
 84%|████████▍ | 311729/371472 [2:38:15<4:39:51,  3.56it/s]
 84%|████████▍ | 311730/371472 [2:38:15<4:34:51,  3.62it/s]
 84%|████████▍ | 311731/371472 [2:38:15<4:32:28,  3.65it/s]
 84%|████████▍ | 311732/371472 [2:38:16<4:25:19,  3.75it/s]
 84%|████████▍ | 311733/371472 [2:38:16<4:38:18,  3.58it/s]
 84%|████████▍ | 311734/371472 [2:38:16<4:39:22,  3.56it/s]
 84%|████████▍ | 311735/371472 [2:38:16<4:32:04,  3.66it/s]
 84%|████████▍ | 311736/371472 [2:38:17<4:34:56,  3.62it/s]
 84%|████████▍ | 311737/371472 [2:38:17<4:41:48,  3.53it/s]
 84%|████████▍ | 311738/371472 [2:38:17<4:44:22,  3.50it/s]
 84%|████████▍ | 311739/371472 [2:38:18<4:41:50,  3.53it/s]
 84%|████████▍ | 311740/371472 [2:38:18<4:38:34,  3.57it/s]
                                                           
{'loss': 2.5396, 'learning_rate': 2.447962679652653e-07, 'epoch': 13.43}

 84%|████████▍ | 311740/371472 [2:38:18<4:38:34,  3.57it/s]
 84%|████████▍ | 311741/371472 [2:38:18<4:42:05,  3.53it/s]
 84%|████████▍ | 311742/371472 [2:38:18<4:35:56,  3.61it/s]
 84%|████████▍ | 311743/371472 [2:38:19<4:33:19,  3.64it/s]
 84%|████████▍ | 311744/371472 [2:38:19<4:29:31,  3.69it/s]
 84%|████████▍ | 311745/371472 [2:38:19<4:20:43,  3.82it/s]
 84%|████████▍ | 311746/371472 [2:38:19<4:32:12,  3.66it/s]
 84%|████████▍ | 311747/371472 [2:38:20<4:41:35,  3.53it/s]
 84%|████████▍ | 311748/371472 [2:38:20<4:39:10,  3.57it/s]
 84%|████████▍ | 311749/371472 [2:38:20<4:36:35,  3.60it/s]
 84%|████████▍ | 311750/371472 [2:38:21<4:25:02,  3.76it/s]
 84%|████████▍ | 311751/371472 [2:38:21<4:27:44,  3.72it/s]
 84%|████████▍ | 311752/371472 [2:38:21<4:31:56,  3.66it/s]
 84%|████████▍ | 311753/371472 [2:38:21<4:33:05,  3.64it/s]
 84%|████████▍ | 311754/371472 [2:38:22<4:20:57,  3.81it/s]
 84%|████████▍ | 311755/371472 [2:38:22<4:31:09,  3.67it/s]
 84%|████████▍ | 311756/371472 [2:38:22<4:25:56,  3.74it/s]
 84%|████████▍ | 311757/371472 [2:38:22<4:32:15,  3.66it/s]
 84%|████████▍ | 311758/371472 [2:38:23<4:36:13,  3.60it/s]
 84%|████████▍ | 311759/371472 [2:38:23<4:34:22,  3.63it/s]
 84%|████████▍ | 311760/371472 [2:38:23<4:25:08,  3.75it/s]
                                                           
{'loss': 2.7001, 'learning_rate': 2.4474778598978646e-07, 'epoch': 13.43}

 84%|████████▍ | 311760/371472 [2:38:23<4:25:08,  3.75it/s]
 84%|████████▍ | 311761/371472 [2:38:24<4:19:10,  3.84it/s]
 84%|████████▍ | 311762/371472 [2:38:24<4:31:46,  3.66it/s]
 84%|████████▍ | 311763/371472 [2:38:24<4:28:39,  3.70it/s]
 84%|████████▍ | 311764/371472 [2:38:24<4:43:15,  3.51it/s]
 84%|████████▍ | 311765/371472 [2:38:25<4:29:53,  3.69it/s]
 84%|████████▍ | 311766/371472 [2:38:25<4:23:17,  3.78it/s]
 84%|████████▍ | 311767/371472 [2:38:25<4:39:05,  3.57it/s]
 84%|████████▍ | 311768/371472 [2:38:26<4:47:24,  3.46it/s]
 84%|████████▍ | 311769/371472 [2:38:26<4:48:40,  3.45it/s]
 84%|████████▍ | 311770/371472 [2:38:26<4:42:06,  3.53it/s]
 84%|████████▍ | 311771/371472 [2:38:26<4:51:20,  3.42it/s]
 84%|████████▍ | 311772/371472 [2:38:27<5:06:27,  3.25it/s]
 84%|████████▍ | 311773/371472 [2:38:27<4:56:44,  3.35it/s]
 84%|████████▍ | 311774/371472 [2:38:27<4:49:31,  3.44it/s]
 84%|████████▍ | 311775/371472 [2:38:28<4:45:56,  3.48it/s]
 84%|████████▍ | 311776/371472 [2:38:28<4:46:25,  3.47it/s]
 84%|████████▍ | 311777/371472 [2:38:28<4:31:06,  3.67it/s]
 84%|████████▍ | 311778/371472 [2:38:28<4:40:15,  3.55it/s]
 84%|████████▍ | 311779/371472 [2:38:29<4:41:25,  3.54it/s]
 84%|████████▍ | 311780/371472 [2:38:29<4:55:33,  3.37it/s]
                                                           
{'loss': 2.5513, 'learning_rate': 2.4469930401430753e-07, 'epoch': 13.43}

 84%|████████▍ | 311780/371472 [2:38:29<4:55:33,  3.37it/s]
 84%|████████▍ | 311781/371472 [2:38:29<4:49:23,  3.44it/s]
 84%|████████▍ | 311782/371472 [2:38:30<4:48:48,  3.44it/s]
 84%|████████▍ | 311783/371472 [2:38:30<4:50:27,  3.43it/s]
 84%|████████▍ | 311784/371472 [2:38:30<5:07:07,  3.24it/s]
 84%|████████▍ | 311785/371472 [2:38:31<5:11:21,  3.19it/s]
 84%|████████▍ | 311786/371472 [2:38:31<5:12:43,  3.18it/s]
 84%|████████▍ | 311787/371472 [2:38:31<4:54:36,  3.38it/s]
 84%|████████▍ | 311788/371472 [2:38:31<4:46:20,  3.47it/s]
 84%|████████▍ | 311789/371472 [2:38:32<4:43:50,  3.50it/s]
 84%|████████▍ | 311790/371472 [2:38:32<5:06:09,  3.25it/s]
 84%|████████▍ | 311791/371472 [2:38:32<4:50:12,  3.43it/s]
 84%|████████▍ | 311792/371472 [2:38:33<4:55:54,  3.36it/s]
 84%|████████▍ | 311793/371472 [2:38:33<4:46:54,  3.47it/s]
 84%|████████▍ | 311794/371472 [2:38:33<4:44:04,  3.50it/s]
 84%|████████▍ | 311795/371472 [2:38:33<4:44:36,  3.49it/s]
 84%|████████▍ | 311796/371472 [2:38:34<4:39:29,  3.56it/s]
 84%|████████▍ | 311797/371472 [2:38:34<4:43:53,  3.50it/s]
 84%|████████▍ | 311798/371472 [2:38:34<4:38:46,  3.57it/s]
 84%|████████▍ | 311799/371472 [2:38:35<4:37:39,  3.58it/s]
 84%|████████▍ | 311800/371472 [2:38:35<4:31:19,  3.67it/s]
                                                           
{'loss': 2.6997, 'learning_rate': 2.446508220388287e-07, 'epoch': 13.43}

 84%|████████▍ | 311800/371472 [2:38:35<4:31:19,  3.67it/s]
 84%|████████▍ | 311801/371472 [2:38:35<4:28:56,  3.70it/s]
 84%|████████▍ | 311802/371472 [2:38:35<4:27:53,  3.71it/s]
 84%|████████▍ | 311803/371472 [2:38:36<4:27:37,  3.72it/s]
 84%|████████▍ | 311804/371472 [2:38:36<4:39:21,  3.56it/s]
 84%|████████▍ | 311805/371472 [2:38:36<4:49:06,  3.44it/s]
 84%|████████▍ | 311806/371472 [2:38:37<4:50:22,  3.42it/s]
 84%|████████▍ | 311807/371472 [2:38:37<4:45:19,  3.49it/s]
 84%|████████▍ | 311808/371472 [2:38:37<4:45:29,  3.48it/s]
 84%|████████▍ | 311809/371472 [2:38:37<4:42:34,  3.52it/s]
 84%|████████▍ | 311810/371472 [2:38:38<4:45:36,  3.48it/s]
 84%|████████▍ | 311811/371472 [2:38:38<4:35:35,  3.61it/s]
 84%|████████▍ | 311812/371472 [2:38:38<5:11:48,  3.19it/s]
 84%|████████▍ | 311813/371472 [2:38:39<4:56:40,  3.35it/s]
 84%|████████▍ | 311814/371472 [2:38:39<4:48:54,  3.44it/s]
 84%|████████▍ | 311815/371472 [2:38:39<4:37:11,  3.59it/s]
 84%|████████▍ | 311816/371472 [2:38:39<4:27:35,  3.72it/s]
 84%|████████▍ | 311817/371472 [2:38:40<4:28:52,  3.70it/s]
 84%|████████▍ | 311818/371472 [2:38:40<4:19:14,  3.84it/s]
 84%|████████▍ | 311819/371472 [2:38:40<4:23:47,  3.77it/s]
 84%|████████▍ | 311820/371472 [2:38:40<4:42:14,  3.52it/s]
                                                           
{'loss': 2.6252, 'learning_rate': 2.446023400633498e-07, 'epoch': 13.43}

 84%|████████▍ | 311820/371472 [2:38:40<4:42:14,  3.52it/s]
 84%|████████▍ | 311821/371472 [2:38:41<4:33:34,  3.63it/s]
 84%|████████▍ | 311822/371472 [2:38:41<4:31:33,  3.66it/s]
 84%|████████▍ | 311823/371472 [2:38:41<4:26:56,  3.72it/s]
 84%|████████▍ | 311824/371472 [2:38:41<4:24:07,  3.76it/s]
 84%|████████▍ | 311825/371472 [2:38:42<4:34:04,  3.63it/s]
 84%|████████▍ | 311826/371472 [2:38:42<4:33:44,  3.63it/s]
 84%|████████▍ | 311827/371472 [2:38:42<4:36:14,  3.60it/s]
 84%|████████▍ | 311828/371472 [2:38:43<4:40:08,  3.55it/s]
 84%|████████▍ | 311829/371472 [2:38:43<4:42:31,  3.52it/s]
 84%|████████▍ | 311830/371472 [2:38:43<4:36:25,  3.60it/s]
 84%|████████▍ | 311831/371472 [2:38:43<4:44:14,  3.50it/s]
 84%|████████▍ | 311832/371472 [2:38:44<4:32:55,  3.64it/s]
 84%|████████▍ | 311833/371472 [2:38:44<4:50:05,  3.43it/s]
 84%|████████▍ | 311834/371472 [2:38:44<4:37:55,  3.58it/s]
 84%|████████▍ | 311835/371472 [2:38:45<4:59:30,  3.32it/s]
 84%|████████▍ | 311836/371472 [2:38:45<4:47:50,  3.45it/s]
 84%|████████▍ | 311837/371472 [2:38:45<4:39:00,  3.56it/s]
 84%|████████▍ | 311838/371472 [2:38:45<4:34:20,  3.62it/s]
 84%|████████▍ | 311839/371472 [2:38:46<4:36:04,  3.60it/s]
 84%|████████▍ | 311840/371472 [2:38:46<4:30:08,  3.68it/s]
                                                           
{'loss': 2.5889, 'learning_rate': 2.445538580878709e-07, 'epoch': 13.43}

 84%|████████▍ | 311840/371472 [2:38:46<4:30:08,  3.68it/s]
 84%|████████▍ | 311841/371472 [2:38:46<4:39:46,  3.55it/s]
 84%|████████▍ | 311842/371472 [2:38:47<4:34:31,  3.62it/s]
 84%|████████▍ | 311843/371472 [2:38:47<4:36:20,  3.60it/s]
 84%|████████▍ | 311844/371472 [2:38:47<4:38:21,  3.57it/s]
 84%|████████▍ | 311845/371472 [2:38:47<4:49:25,  3.43it/s]
 84%|████████▍ | 311846/371472 [2:38:48<4:43:50,  3.50it/s]
 84%|████████▍ | 311847/371472 [2:38:48<4:33:52,  3.63it/s]
 84%|████████▍ | 311848/371472 [2:38:48<4:30:55,  3.67it/s]
 84%|████████▍ | 311849/371472 [2:38:49<4:35:13,  3.61it/s]
 84%|████████▍ | 311850/371472 [2:38:49<4:30:06,  3.68it/s]
 84%|████████▍ | 311851/371472 [2:38:49<4:49:09,  3.44it/s]
 84%|████████▍ | 311852/371472 [2:38:49<4:46:29,  3.47it/s]
 84%|████████▍ | 311853/371472 [2:38:50<4:57:47,  3.34it/s]
 84%|████████▍ | 311854/371472 [2:38:50<4:49:49,  3.43it/s]
 84%|████████▍ | 311855/371472 [2:38:50<4:57:56,  3.33it/s]
 84%|████████▍ | 311856/371472 [2:38:51<4:47:42,  3.45it/s]
 84%|████████▍ | 311857/371472 [2:38:51<4:35:56,  3.60it/s]
 84%|████████▍ | 311858/371472 [2:38:51<4:50:51,  3.42it/s]
 84%|████████▍ | 311859/371472 [2:38:51<4:59:41,  3.32it/s]
 84%|████████▍ | 311860/371472 [2:38:52<4:51:16,  3.41it/s]
                                                           
{'loss': 2.48, 'learning_rate': 2.445053761123919e-07, 'epoch': 13.43}

 84%|████████▍ | 311860/371472 [2:38:52<4:51:16,  3.41it/s]
 84%|████████▍ | 311861/371472 [2:38:52<4:39:24,  3.56it/s]
 84%|████████▍ | 311862/371472 [2:38:52<4:29:13,  3.69it/s]
 84%|████████▍ | 311863/371472 [2:38:53<4:28:08,  3.71it/s]
 84%|████████▍ | 311864/371472 [2:38:53<4:27:37,  3.71it/s]
 84%|████████▍ | 311865/371472 [2:38:53<4:44:55,  3.49it/s]
 84%|████████▍ | 311866/371472 [2:38:53<4:35:29,  3.61it/s]
 84%|████████▍ | 311867/371472 [2:38:54<5:04:11,  3.27it/s]
 84%|████████▍ | 311868/371472 [2:38:54<5:14:57,  3.15it/s]
 84%|████████▍ | 311869/371472 [2:38:54<5:06:29,  3.24it/s]
 84%|████████▍ | 311870/371472 [2:38:55<5:01:31,  3.29it/s]
 84%|████████▍ | 311871/371472 [2:38:55<4:55:33,  3.36it/s]
 84%|████████▍ | 311872/371472 [2:38:55<4:34:00,  3.63it/s]
 84%|████████▍ | 311873/371472 [2:38:56<4:48:47,  3.44it/s]
 84%|████████▍ | 311874/371472 [2:38:56<4:38:05,  3.57it/s]
 84%|████████▍ | 311875/371472 [2:38:56<4:52:13,  3.40it/s]
 84%|████████▍ | 311876/371472 [2:38:56<4:41:33,  3.53it/s]
 84%|████████▍ | 311877/371472 [2:38:57<4:32:23,  3.65it/s]
 84%|████████▍ | 311878/371472 [2:38:57<4:23:51,  3.76it/s]
 84%|████████▍ | 311879/371472 [2:38:57<4:17:29,  3.86it/s]
 84%|████████▍ | 311880/371472 [2:38:57<4:10:32,  3.96it/s]
                                                           
{'loss': 2.5923, 'learning_rate': 2.444568941369131e-07, 'epoch': 13.43}

 84%|████████▍ | 311880/371472 [2:38:57<4:10:32,  3.96it/s]
 84%|████████▍ | 311881/371472 [2:38:58<4:09:32,  3.98it/s]
 84%|████████▍ | 311882/371472 [2:38:58<4:22:36,  3.78it/s]
 84%|████████▍ | 311883/371472 [2:38:58<4:13:22,  3.92it/s]
 84%|████████▍ | 311884/371472 [2:38:58<4:14:45,  3.90it/s]
 84%|████████▍ | 311885/371472 [2:38:59<4:34:23,  3.62it/s]
 84%|████████▍ | 311886/371472 [2:38:59<5:14:08,  3.16it/s]
 84%|████████▍ | 311887/371472 [2:38:59<5:17:36,  3.13it/s]
 84%|████████▍ | 311888/371472 [2:39:00<5:39:55,  2.92it/s]
 84%|████████▍ | 311889/371472 [2:39:00<5:18:43,  3.12it/s]
 84%|████████▍ | 311890/371472 [2:39:00<4:58:23,  3.33it/s]
 84%|████████▍ | 311891/371472 [2:39:01<4:49:34,  3.43it/s]
 84%|████████▍ | 311892/371472 [2:39:01<5:01:12,  3.30it/s]
 84%|████████▍ | 311893/371472 [2:39:01<5:08:16,  3.22it/s]
 84%|████████▍ | 311894/371472 [2:39:02<4:53:08,  3.39it/s]
 84%|████████▍ | 311895/371472 [2:39:02<4:40:37,  3.54it/s]
 84%|████████▍ | 311896/371472 [2:39:02<5:00:44,  3.30it/s]
 84%|████████▍ | 311897/371472 [2:39:03<5:18:51,  3.11it/s]
 84%|████████▍ | 311898/371472 [2:39:03<5:12:20,  3.18it/s]
 84%|████████▍ | 311899/371472 [2:39:03<4:56:21,  3.35it/s]
 84%|████████▍ | 311900/371472 [2:39:03<5:03:32,  3.27it/s]
                                                           
{'loss': 2.6949, 'learning_rate': 2.4440841216143417e-07, 'epoch': 13.43}

 84%|████████▍ | 311900/371472 [2:39:03<5:03:32,  3.27it/s]
 84%|████████▍ | 311901/371472 [2:39:04<4:48:55,  3.44it/s]
 84%|████████▍ | 311902/371472 [2:39:04<4:45:47,  3.47it/s]
 84%|████████▍ | 311903/371472 [2:39:04<4:29:24,  3.69it/s]
 84%|████████▍ | 311904/371472 [2:39:04<4:19:17,  3.83it/s]
 84%|████████▍ | 311905/371472 [2:39:05<4:18:40,  3.84it/s]
 84%|████████▍ | 311906/371472 [2:39:05<4:11:06,  3.95it/s]
 84%|████████▍ | 311907/371472 [2:39:05<4:41:04,  3.53it/s]
 84%|████████▍ | 311908/371472 [2:39:06<4:43:02,  3.51it/s]
 84%|████████▍ | 311909/371472 [2:39:06<4:43:19,  3.50it/s]
 84%|████████▍ | 311910/371472 [2:39:06<4:39:38,  3.55it/s]
 84%|████████▍ | 311911/371472 [2:39:06<4:31:56,  3.65it/s]
 84%|████████▍ | 311912/371472 [2:39:07<4:23:18,  3.77it/s]
 84%|████████▍ | 311913/371472 [2:39:07<4:20:29,  3.81it/s]
 84%|████████▍ | 311914/371472 [2:39:07<4:50:59,  3.41it/s]
 84%|████████▍ | 311915/371472 [2:39:08<4:53:28,  3.38it/s]
 84%|████████▍ | 311916/371472 [2:39:08<4:48:11,  3.44it/s]
 84%|████████▍ | 311917/371472 [2:39:08<4:42:32,  3.51it/s]
 84%|████████▍ | 311918/371472 [2:39:08<4:34:46,  3.61it/s]
 84%|████████▍ | 311919/371472 [2:39:09<4:36:59,  3.58it/s]
 84%|████████▍ | 311920/371472 [2:39:09<4:33:24,  3.63it/s]
                                                           
{'loss': 2.5442, 'learning_rate': 2.4435993018595535e-07, 'epoch': 13.43}

 84%|████████▍ | 311920/371472 [2:39:09<4:33:24,  3.63it/s]
 84%|████████▍ | 311921/371472 [2:39:09<4:30:09,  3.67it/s]
 84%|████████▍ | 311922/371472 [2:39:09<4:28:48,  3.69it/s]
 84%|████████▍ | 311923/371472 [2:39:10<4:25:52,  3.73it/s]
 84%|████████▍ | 311924/371472 [2:39:10<4:31:11,  3.66it/s]
 84%|████████▍ | 311925/371472 [2:39:10<4:31:25,  3.66it/s]
 84%|████████▍ | 311926/371472 [2:39:10<4:27:47,  3.71it/s]
 84%|████████▍ | 311927/371472 [2:39:11<4:20:29,  3.81it/s]
 84%|████████▍ | 311928/371472 [2:39:11<4:18:08,  3.84it/s]
 84%|████████▍ | 311929/371472 [2:39:11<4:13:29,  3.91it/s]
 84%|████████▍ | 311930/371472 [2:39:12<4:22:18,  3.78it/s]
 84%|████████▍ | 311931/371472 [2:39:12<4:24:27,  3.75it/s]
 84%|████████▍ | 311932/371472 [2:39:12<4:19:35,  3.82it/s]
 84%|████████▍ | 311933/371472 [2:39:12<4:17:07,  3.86it/s]
 84%|████████▍ | 311934/371472 [2:39:13<4:23:25,  3.77it/s]
 84%|████████▍ | 311935/371472 [2:39:13<4:28:24,  3.70it/s]
 84%|████████▍ | 311936/371472 [2:39:13<4:23:26,  3.77it/s]
 84%|████████▍ | 311937/371472 [2:39:13<4:22:04,  3.79it/s]
 84%|████████▍ | 311938/371472 [2:39:14<4:45:55,  3.47it/s]
 84%|████████▍ | 311939/371472 [2:39:14<4:46:59,  3.46it/s]
 84%|████████▍ | 311940/371472 [2:39:14<4:36:03,  3.59it/s]
                                                           
{'loss': 2.684, 'learning_rate': 2.443114482104764e-07, 'epoch': 13.44}

 84%|████████▍ | 311940/371472 [2:39:14<4:36:03,  3.59it/s]
 84%|████████▍ | 311941/371472 [2:39:15<5:19:22,  3.11it/s]
 84%|████████▍ | 311942/371472 [2:39:15<5:00:11,  3.31it/s]
 84%|████████▍ | 311943/371472 [2:39:15<4:48:55,  3.43it/s]
 84%|████████▍ | 311944/371472 [2:39:15<4:43:47,  3.50it/s]
 84%|████████▍ | 311945/371472 [2:39:16<4:39:42,  3.55it/s]
 84%|████████▍ | 311946/371472 [2:39:16<4:33:48,  3.62it/s]
 84%|████████▍ | 311947/371472 [2:39:16<4:38:36,  3.56it/s]
 84%|████████▍ | 311948/371472 [2:39:17<4:31:49,  3.65it/s]
 84%|████████▍ | 311949/371472 [2:39:17<4:32:18,  3.64it/s]
 84%|████████▍ | 311950/371472 [2:39:17<4:39:49,  3.55it/s]
 84%|████████▍ | 311951/371472 [2:39:17<4:44:58,  3.48it/s]
 84%|████████▍ | 311952/371472 [2:39:18<4:50:06,  3.42it/s]
 84%|████████▍ | 311953/371472 [2:39:18<4:39:11,  3.55it/s]
 84%|████████▍ | 311954/371472 [2:39:18<4:31:02,  3.66it/s]
 84%|████████▍ | 311955/371472 [2:39:19<4:29:53,  3.68it/s]
 84%|████████▍ | 311956/371472 [2:39:19<4:41:45,  3.52it/s]
 84%|████████▍ | 311957/371472 [2:39:19<4:46:11,  3.47it/s]
 84%|████████▍ | 311958/371472 [2:39:19<4:31:13,  3.66it/s]
 84%|████████▍ | 311959/371472 [2:39:20<4:49:15,  3.43it/s]
 84%|████████▍ | 311960/371472 [2:39:20<5:10:06,  3.20it/s]
                                                           
{'loss': 2.6743, 'learning_rate': 2.4426296623499754e-07, 'epoch': 13.44}

 84%|████████▍ | 311960/371472 [2:39:20<5:10:06,  3.20it/s]
 84%|████████▍ | 311961/371472 [2:39:20<5:34:45,  2.96it/s]
 84%|████████▍ | 311962/371472 [2:39:21<5:49:20,  2.84it/s]
 84%|████████▍ | 311963/371472 [2:39:21<5:39:30,  2.92it/s]
 84%|████████▍ | 311964/371472 [2:39:21<5:15:03,  3.15it/s]
 84%|████████▍ | 311965/371472 [2:39:22<5:07:02,  3.23it/s]
 84%|████████▍ | 311966/371472 [2:39:22<4:56:39,  3.34it/s]
 84%|████████▍ | 311967/371472 [2:39:22<5:22:41,  3.07it/s]
 84%|████████▍ | 311968/371472 [2:39:23<5:09:41,  3.20it/s]
 84%|████████▍ | 311969/371472 [2:39:23<4:46:40,  3.46it/s]
 84%|████████▍ | 311970/371472 [2:39:23<4:35:25,  3.60it/s]
 84%|████████▍ | 311971/371472 [2:39:23<4:36:56,  3.58it/s]
 84%|████████▍ | 311972/371472 [2:39:24<4:24:15,  3.75it/s]
 84%|████████▍ | 311973/371472 [2:39:24<4:18:46,  3.83it/s]
 84%|████████▍ | 311974/371472 [2:39:24<4:14:55,  3.89it/s]
 84%|████████▍ | 311975/371472 [2:39:24<4:15:48,  3.88it/s]
 84%|████████▍ | 311976/371472 [2:39:25<4:31:51,  3.65it/s]
 84%|████████▍ | 311977/371472 [2:39:25<4:27:23,  3.71it/s]
 84%|████████▍ | 311978/371472 [2:39:25<4:47:07,  3.45it/s]
 84%|████████▍ | 311979/371472 [2:39:26<4:35:56,  3.59it/s]
 84%|████████▍ | 311980/371472 [2:39:26<4:29:33,  3.68it/s]
                                                           
{'loss': 2.6552, 'learning_rate': 2.442144842595186e-07, 'epoch': 13.44}

 84%|████████▍ | 311980/371472 [2:39:26<4:29:33,  3.68it/s]
 84%|████████▍ | 311981/371472 [2:39:26<4:33:19,  3.63it/s]
 84%|████████▍ | 311982/371472 [2:39:26<4:29:58,  3.67it/s]
 84%|████████▍ | 311983/371472 [2:39:27<4:26:27,  3.72it/s]
 84%|████████▍ | 311984/371472 [2:39:27<4:29:09,  3.68it/s]
 84%|████████▍ | 311985/371472 [2:39:27<4:18:10,  3.84it/s]
 84%|████████▍ | 311986/371472 [2:39:27<4:17:07,  3.86it/s]
 84%|████████▍ | 311987/371472 [2:39:28<4:22:12,  3.78it/s]
 84%|████████▍ | 311988/371472 [2:39:28<4:20:02,  3.81it/s]
 84%|████████▍ | 311989/371472 [2:39:28<4:39:36,  3.55it/s]
 84%|████████▍ | 311990/371472 [2:39:29<4:38:20,  3.56it/s]
 84%|████████▍ | 311991/371472 [2:39:29<4:42:38,  3.51it/s]
 84%|████████▍ | 311992/371472 [2:39:29<4:32:38,  3.64it/s]
 84%|████████▍ | 311993/371472 [2:39:29<4:25:50,  3.73it/s]
 84%|████████▍ | 311994/371472 [2:39:30<4:19:30,  3.82it/s]
 84%|████████▍ | 311995/371472 [2:39:30<4:19:54,  3.81it/s]
 84%|████████▍ | 311996/371472 [2:39:30<4:22:32,  3.78it/s]
 84%|████████▍ | 311997/371472 [2:39:30<4:46:40,  3.46it/s]
 84%|████████▍ | 311998/371472 [2:39:31<4:39:00,  3.55it/s]
 84%|████████▍ | 311999/371472 [2:39:31<4:26:54,  3.71it/s]
 84%|████████▍ | 312000/371472 [2:39:31<4:28:14,  3.70it/s]
                                                           
{'loss': 2.5452, 'learning_rate': 2.4416600228403974e-07, 'epoch': 13.44}

 84%|████████▍ | 312000/371472 [2:39:31<4:28:14,  3.70it/s]
 84%|████████▍ | 312001/371472 [2:39:32<4:24:59,  3.74it/s]
 84%|████████▍ | 312002/371472 [2:39:32<4:18:11,  3.84it/s]
 84%|████████▍ | 312003/371472 [2:39:32<4:15:43,  3.88it/s]
 84%|████████▍ | 312004/371472 [2:39:32<4:20:28,  3.81it/s]
 84%|████████▍ | 312005/371472 [2:39:33<4:28:52,  3.69it/s]
 84%|████████▍ | 312006/371472 [2:39:33<4:33:40,  3.62it/s]
 84%|████████▍ | 312007/371472 [2:39:33<4:24:11,  3.75it/s]
 84%|████████▍ | 312008/371472 [2:39:33<4:22:30,  3.78it/s]
 84%|████████▍ | 312009/371472 [2:39:34<4:25:43,  3.73it/s]
 84%|████████▍ | 312010/371472 [2:39:34<4:29:16,  3.68it/s]
 84%|████████▍ | 312011/371472 [2:39:34<4:44:14,  3.49it/s]
 84%|████████▍ | 312012/371472 [2:39:35<4:45:25,  3.47it/s]
 84%|████████▍ | 312013/371472 [2:39:35<4:38:16,  3.56it/s]
 84%|████████▍ | 312014/371472 [2:39:35<4:56:16,  3.34it/s]
 84%|████████▍ | 312015/371472 [2:39:35<4:58:40,  3.32it/s]
 84%|████████▍ | 312016/371472 [2:39:36<4:58:53,  3.32it/s]
 84%|████████▍ | 312017/371472 [2:39:36<4:50:15,  3.41it/s]
 84%|████████▍ | 312018/371472 [2:39:36<4:54:57,  3.36it/s]
 84%|████████▍ | 312019/371472 [2:39:37<4:42:42,  3.50it/s]
 84%|████████▍ | 312020/371472 [2:39:37<4:33:55,  3.62it/s]
                                                           
{'loss': 2.6209, 'learning_rate': 2.441175203085608e-07, 'epoch': 13.44}

 84%|████████▍ | 312020/371472 [2:39:37<4:33:55,  3.62it/s]
 84%|████████▍ | 312021/371472 [2:39:37<4:40:24,  3.53it/s]
 84%|████████▍ | 312022/371472 [2:39:38<4:59:52,  3.30it/s]
 84%|████████▍ | 312023/371472 [2:39:38<4:56:19,  3.34it/s]
 84%|████████▍ | 312024/371472 [2:39:38<4:49:55,  3.42it/s]
 84%|████████▍ | 312025/371472 [2:39:38<4:40:07,  3.54it/s]
 84%|████████▍ | 312026/371472 [2:39:39<4:28:15,  3.69it/s]
 84%|████████▍ | 312027/371472 [2:39:39<4:39:24,  3.55it/s]
 84%|████████▍ | 312028/371472 [2:39:39<4:25:36,  3.73it/s]
 84%|████████▍ | 312029/371472 [2:39:39<4:24:01,  3.75it/s]
 84%|████████▍ | 312030/371472 [2:39:40<4:15:52,  3.87it/s]
 84%|████████▍ | 312031/371472 [2:39:40<4:16:45,  3.86it/s]
 84%|████████▍ | 312032/371472 [2:39:40<5:05:20,  3.24it/s]
 84%|████████▍ | 312033/371472 [2:39:41<4:46:13,  3.46it/s]
 84%|████████▍ | 312034/371472 [2:39:41<4:33:13,  3.63it/s]
 84%|████████▍ | 312035/371472 [2:39:41<4:30:43,  3.66it/s]
 84%|████████▍ | 312036/371472 [2:39:41<4:52:24,  3.39it/s]
 84%|████████▍ | 312037/371472 [2:39:42<4:43:35,  3.49it/s]
 84%|████████▍ | 312038/371472 [2:39:42<4:47:47,  3.44it/s]
 84%|████████▍ | 312039/371472 [2:39:42<4:36:48,  3.58it/s]
 84%|████████▍ | 312040/371472 [2:39:42<4:34:40,  3.61it/s]
                                                           
{'loss': 2.5455, 'learning_rate': 2.44069038333082e-07, 'epoch': 13.44}

 84%|████████▍ | 312040/371472 [2:39:43<4:34:40,  3.61it/s]
 84%|████████▍ | 312041/371472 [2:39:43<4:40:51,  3.53it/s]
 84%|████████▍ | 312042/371472 [2:39:43<4:49:18,  3.42it/s]
 84%|████████▍ | 312043/371472 [2:39:43<4:42:03,  3.51it/s]
 84%|████████▍ | 312044/371472 [2:39:44<4:29:52,  3.67it/s]
 84%|████████▍ | 312045/371472 [2:39:44<4:40:32,  3.53it/s]
 84%|████████▍ | 312046/371472 [2:39:44<4:36:10,  3.59it/s]
 84%|████████▍ | 312047/371472 [2:39:44<4:33:22,  3.62it/s]
 84%|████████▍ | 312048/371472 [2:39:45<4:37:02,  3.58it/s]
 84%|████████▍ | 312049/371472 [2:39:45<4:28:51,  3.68it/s]
 84%|████████▍ | 312050/371472 [2:39:45<4:29:44,  3.67it/s]
 84%|████████▍ | 312051/371472 [2:39:46<4:49:11,  3.42it/s]
 84%|████████▍ | 312052/371472 [2:39:46<4:48:36,  3.43it/s]
 84%|████████▍ | 312053/371472 [2:39:46<4:45:56,  3.46it/s]
 84%|████████▍ | 312054/371472 [2:39:46<4:33:50,  3.62it/s]
 84%|████████▍ | 312055/371472 [2:39:47<4:24:11,  3.75it/s]
 84%|████████▍ | 312056/371472 [2:39:47<4:44:02,  3.49it/s]
 84%|████████▍ | 312057/371472 [2:39:47<4:52:05,  3.39it/s]
 84%|████████▍ | 312058/371472 [2:39:48<4:41:05,  3.52it/s]
 84%|████████▍ | 312059/371472 [2:39:48<4:42:29,  3.51it/s]
 84%|████████▍ | 312060/371472 [2:39:48<4:39:10,  3.55it/s]
                                                           
{'loss': 2.6212, 'learning_rate': 2.4402055635760306e-07, 'epoch': 13.44}

 84%|████████▍ | 312060/371472 [2:39:48<4:39:10,  3.55it/s]
 84%|████████▍ | 312061/371472 [2:39:48<4:30:22,  3.66it/s]
 84%|████████▍ | 312062/371472 [2:39:49<4:27:16,  3.70it/s]
 84%|████████▍ | 312063/371472 [2:39:49<4:53:06,  3.38it/s]
 84%|████████▍ | 312064/371472 [2:39:49<4:41:36,  3.52it/s]
 84%|████████▍ | 312065/371472 [2:39:50<4:28:23,  3.69it/s]
 84%|████████▍ | 312066/371472 [2:39:50<4:22:50,  3.77it/s]
 84%|████████▍ | 312067/371472 [2:39:50<4:19:35,  3.81it/s]
 84%|████████▍ | 312068/371472 [2:39:50<4:17:22,  3.85it/s]
 84%|████████▍ | 312069/371472 [2:39:51<4:19:10,  3.82it/s]
 84%|████████▍ | 312070/371472 [2:39:51<4:18:45,  3.83it/s]
 84%|████████▍ | 312071/371472 [2:39:51<4:39:05,  3.55it/s]
 84%|████████▍ | 312072/371472 [2:39:51<4:33:26,  3.62it/s]
 84%|████████▍ | 312073/371472 [2:39:52<4:24:07,  3.75it/s]
 84%|████████▍ | 312074/371472 [2:39:52<4:23:40,  3.75it/s]
 84%|████████▍ | 312075/371472 [2:39:52<4:32:03,  3.64it/s]
 84%|████████▍ | 312076/371472 [2:39:53<5:04:07,  3.26it/s]
 84%|████████▍ | 312077/371472 [2:39:53<5:04:13,  3.25it/s]
 84%|████████▍ | 312078/371472 [2:39:53<4:50:26,  3.41it/s]
 84%|████████▍ | 312079/371472 [2:39:53<4:50:57,  3.40it/s]
 84%|████████▍ | 312080/371472 [2:39:54<5:01:27,  3.28it/s]
                                                           
{'loss': 2.7076, 'learning_rate': 2.439720743821242e-07, 'epoch': 13.44}

 84%|████████▍ | 312080/371472 [2:39:54<5:01:27,  3.28it/s]
 84%|████████▍ | 312081/371472 [2:39:54<5:00:56,  3.29it/s]
 84%|████████▍ | 312082/371472 [2:39:54<4:52:49,  3.38it/s]
 84%|████████▍ | 312083/371472 [2:39:55<4:39:36,  3.54it/s]
 84%|████████▍ | 312084/371472 [2:39:55<5:07:48,  3.22it/s]
 84%|████████▍ | 312085/371472 [2:39:55<4:50:27,  3.41it/s]
 84%|████████▍ | 312086/371472 [2:39:55<4:37:49,  3.56it/s]
 84%|████████▍ | 312087/371472 [2:39:56<4:49:37,  3.42it/s]
 84%|████████▍ | 312088/371472 [2:39:56<4:52:19,  3.39it/s]
 84%|████████▍ | 312089/371472 [2:39:57<5:28:30,  3.01it/s]
 84%|████████▍ | 312090/371472 [2:39:57<5:22:17,  3.07it/s]
 84%|████████▍ | 312091/371472 [2:39:57<5:07:49,  3.22it/s]
 84%|████████▍ | 312092/371472 [2:39:57<5:18:15,  3.11it/s]
 84%|████████▍ | 312093/371472 [2:39:58<5:28:32,  3.01it/s]
 84%|████████▍ | 312094/371472 [2:39:58<5:10:57,  3.18it/s]
 84%|████████▍ | 312095/371472 [2:39:58<5:02:10,  3.27it/s]
 84%|████████▍ | 312096/371472 [2:39:59<5:00:34,  3.29it/s]
 84%|████████▍ | 312097/371472 [2:39:59<4:42:23,  3.50it/s]
 84%|████████▍ | 312098/371472 [2:39:59<4:40:51,  3.52it/s]
 84%|████████▍ | 312099/371472 [2:39:59<4:30:36,  3.66it/s]
 84%|████████▍ | 312100/371472 [2:40:00<4:23:46,  3.75it/s]
                                                           
{'loss': 2.5035, 'learning_rate': 2.4392359240664525e-07, 'epoch': 13.44}

 84%|████████▍ | 312100/371472 [2:40:00<4:23:46,  3.75it/s]
 84%|████████▍ | 312101/371472 [2:40:00<4:26:19,  3.72it/s]
 84%|████████▍ | 312102/371472 [2:40:00<4:27:33,  3.70it/s]
 84%|████████▍ | 312103/371472 [2:40:01<4:26:29,  3.71it/s]
 84%|████████▍ | 312104/371472 [2:40:01<4:37:34,  3.56it/s]
 84%|████████▍ | 312105/371472 [2:40:01<4:30:36,  3.66it/s]
 84%|████████▍ | 312106/371472 [2:40:01<4:29:02,  3.68it/s]
 84%|████████▍ | 312107/371472 [2:40:02<4:25:10,  3.73it/s]
 84%|████████▍ | 312108/371472 [2:40:02<4:24:51,  3.74it/s]
 84%|████████▍ | 312109/371472 [2:40:02<4:34:33,  3.60it/s]
 84%|████████▍ | 312110/371472 [2:40:02<4:26:10,  3.72it/s]
 84%|████████▍ | 312111/371472 [2:40:03<4:16:06,  3.86it/s]
 84%|████████▍ | 312112/371472 [2:40:03<4:08:33,  3.98it/s]
 84%|████████▍ | 312113/371472 [2:40:03<4:15:01,  3.88it/s]
 84%|████████▍ | 312114/371472 [2:40:03<4:16:34,  3.86it/s]
 84%|████████▍ | 312115/371472 [2:40:04<4:26:30,  3.71it/s]
 84%|████████▍ | 312116/371472 [2:40:04<4:23:01,  3.76it/s]
 84%|████████▍ | 312117/371472 [2:40:04<4:24:38,  3.74it/s]
 84%|████████▍ | 312118/371472 [2:40:05<4:20:09,  3.80it/s]
 84%|████████▍ | 312119/371472 [2:40:05<4:22:35,  3.77it/s]
 84%|████████▍ | 312120/371472 [2:40:05<4:18:47,  3.82it/s]
                                                           
{'loss': 2.7596, 'learning_rate': 2.4387511043116627e-07, 'epoch': 13.44}

 84%|████████▍ | 312120/371472 [2:40:05<4:18:47,  3.82it/s]
 84%|████████▍ | 312121/371472 [2:40:05<4:29:26,  3.67it/s]
 84%|████████▍ | 312122/371472 [2:40:06<4:40:22,  3.53it/s]
 84%|████████▍ | 312123/371472 [2:40:06<4:37:01,  3.57it/s]
 84%|████████▍ | 312124/371472 [2:40:06<4:43:20,  3.49it/s]
 84%|████████▍ | 312125/371472 [2:40:06<4:37:27,  3.56it/s]
 84%|████████▍ | 312126/371472 [2:40:07<4:57:23,  3.33it/s]
 84%|████████▍ | 312127/371472 [2:40:07<4:50:57,  3.40it/s]
 84%|████████▍ | 312128/371472 [2:40:07<4:53:56,  3.36it/s]
 84%|████████▍ | 312129/371472 [2:40:08<5:03:25,  3.26it/s]
 84%|████████▍ | 312130/371472 [2:40:08<4:59:03,  3.31it/s]
 84%|████████▍ | 312131/371472 [2:40:08<5:09:56,  3.19it/s]
 84%|████████▍ | 312132/371472 [2:40:09<4:57:20,  3.33it/s]
 84%|████████▍ | 312133/371472 [2:40:09<4:42:46,  3.50it/s]
 84%|████████▍ | 312134/371472 [2:40:09<4:31:39,  3.64it/s]
 84%|████████▍ | 312135/371472 [2:40:09<4:22:50,  3.76it/s]
 84%|████████▍ | 312136/371472 [2:40:10<4:40:27,  3.53it/s]
 84%|████████▍ | 312137/371472 [2:40:10<4:32:48,  3.62it/s]
 84%|████████▍ | 312138/371472 [2:40:10<4:22:13,  3.77it/s]
 84%|████████▍ | 312139/371472 [2:40:10<4:16:39,  3.85it/s]
 84%|████████▍ | 312140/371472 [2:40:11<4:33:22,  3.62it/s]
                                                           
{'loss': 2.6602, 'learning_rate': 2.4382662845568745e-07, 'epoch': 13.44}

 84%|████████▍ | 312140/371472 [2:40:11<4:33:22,  3.62it/s]
 84%|████████▍ | 312141/371472 [2:40:11<4:37:10,  3.57it/s]
 84%|████████▍ | 312142/371472 [2:40:11<4:27:17,  3.70it/s]
 84%|████████▍ | 312143/371472 [2:40:12<4:41:17,  3.52it/s]
 84%|████████▍ | 312144/371472 [2:40:12<4:45:39,  3.46it/s]
 84%|████████▍ | 312145/371472 [2:40:12<4:36:57,  3.57it/s]
 84%|████████▍ | 312146/371472 [2:40:13<4:50:41,  3.40it/s]
 84%|████████▍ | 312147/371472 [2:40:13<4:41:40,  3.51it/s]
 84%|████████▍ | 312148/371472 [2:40:13<4:27:19,  3.70it/s]
 84%|████████▍ | 312149/371472 [2:40:13<4:31:31,  3.64it/s]
 84%|████████▍ | 312150/371472 [2:40:14<4:30:59,  3.65it/s]
 84%|████████▍ | 312151/371472 [2:40:14<4:41:07,  3.52it/s]
 84%|████████▍ | 312152/371472 [2:40:14<4:39:32,  3.54it/s]
 84%|████████▍ | 312153/371472 [2:40:14<4:35:49,  3.58it/s]
 84%|████████▍ | 312154/371472 [2:40:15<4:29:45,  3.66it/s]
 84%|████████▍ | 312155/371472 [2:40:15<4:29:28,  3.67it/s]
 84%|████████▍ | 312156/371472 [2:40:15<4:31:40,  3.64it/s]
 84%|████████▍ | 312157/371472 [2:40:16<4:44:26,  3.48it/s]
 84%|████████▍ | 312158/371472 [2:40:16<4:29:39,  3.67it/s]
 84%|████████▍ | 312159/371472 [2:40:16<4:24:52,  3.73it/s]
 84%|████████▍ | 312160/371472 [2:40:16<4:28:34,  3.68it/s]
                                                           
{'loss': 2.5853, 'learning_rate': 2.437781464802085e-07, 'epoch': 13.45}

 84%|████████▍ | 312160/371472 [2:40:16<4:28:34,  3.68it/s]
 84%|████████▍ | 312161/371472 [2:40:17<4:28:27,  3.68it/s]
 84%|████████▍ | 312162/371472 [2:40:17<4:25:25,  3.72it/s]
 84%|████████▍ | 312163/371472 [2:40:17<4:27:14,  3.70it/s]
 84%|████████▍ | 312164/371472 [2:40:17<4:32:55,  3.62it/s]
 84%|████████▍ | 312165/371472 [2:40:18<4:43:59,  3.48it/s]
 84%|████████▍ | 312166/371472 [2:40:18<4:42:53,  3.49it/s]
 84%|████████▍ | 312167/371472 [2:40:18<4:40:00,  3.53it/s]
 84%|████████▍ | 312168/371472 [2:40:19<4:45:43,  3.46it/s]
 84%|████████▍ | 312169/371472 [2:40:19<4:34:07,  3.61it/s]
 84%|████████▍ | 312170/371472 [2:40:19<4:29:14,  3.67it/s]
 84%|████████▍ | 312171/371472 [2:40:19<4:24:54,  3.73it/s]
 84%|████████▍ | 312172/371472 [2:40:20<4:42:33,  3.50it/s]
 84%|████████▍ | 312173/371472 [2:40:20<4:35:44,  3.58it/s]
 84%|████████▍ | 312174/371472 [2:40:20<4:57:32,  3.32it/s]
 84%|████████▍ | 312175/371472 [2:40:21<4:43:51,  3.48it/s]
 84%|████████▍ | 312176/371472 [2:40:21<4:36:07,  3.58it/s]
 84%|████████▍ | 312177/371472 [2:40:21<4:41:13,  3.51it/s]
 84%|████████▍ | 312178/371472 [2:40:21<4:44:05,  3.48it/s]
 84%|████████▍ | 312179/371472 [2:40:22<4:31:00,  3.65it/s]
 84%|████████▍ | 312180/371472 [2:40:22<4:33:33,  3.61it/s]
                                                           
{'loss': 2.627, 'learning_rate': 2.437296645047297e-07, 'epoch': 13.45}

 84%|████████▍ | 312180/371472 [2:40:22<4:33:33,  3.61it/s]
 84%|████████▍ | 312181/371472 [2:40:22<4:29:22,  3.67it/s]
 84%|████████▍ | 312182/371472 [2:40:22<4:25:26,  3.72it/s]
 84%|████████▍ | 312183/371472 [2:40:23<4:21:51,  3.77it/s]
 84%|████████▍ | 312184/371472 [2:40:23<4:45:02,  3.47it/s]
 84%|████████▍ | 312185/371472 [2:40:23<4:32:15,  3.63it/s]
 84%|████████▍ | 312186/371472 [2:40:24<4:23:44,  3.75it/s]
 84%|████████▍ | 312187/371472 [2:40:24<4:25:25,  3.72it/s]
 84%|████████▍ | 312188/371472 [2:40:24<4:18:50,  3.82it/s]
 84%|████████▍ | 312189/371472 [2:40:24<4:22:30,  3.76it/s]
 84%|████████▍ | 312190/371472 [2:40:25<4:21:50,  3.77it/s]
 84%|████████▍ | 312191/371472 [2:40:25<4:18:33,  3.82it/s]
 84%|████████▍ | 312192/371472 [2:40:25<4:11:29,  3.93it/s]
 84%|████████▍ | 312193/371472 [2:40:25<4:15:35,  3.87it/s]
 84%|████████▍ | 312194/371472 [2:40:26<4:35:39,  3.58it/s]
 84%|████████▍ | 312195/371472 [2:40:26<4:28:43,  3.68it/s]
 84%|████████▍ | 312196/371472 [2:40:26<4:43:07,  3.49it/s]
 84%|████████▍ | 312197/371472 [2:40:27<4:52:58,  3.37it/s]
 84%|████████▍ | 312198/371472 [2:40:27<4:48:16,  3.43it/s]
 84%|████████▍ | 312199/371472 [2:40:27<4:52:14,  3.38it/s]
 84%|████████▍ | 312200/371472 [2:40:27<4:54:32,  3.35it/s]
                                                           
{'loss': 2.7397, 'learning_rate': 2.4368118252925077e-07, 'epoch': 13.45}

 84%|████████▍ | 312200/371472 [2:40:27<4:54:32,  3.35it/s]
 84%|████████▍ | 312201/371472 [2:40:28<4:56:56,  3.33it/s]
 84%|████████▍ | 312202/371472 [2:40:28<4:58:55,  3.30it/s]
 84%|████████▍ | 312203/371472 [2:40:28<4:50:25,  3.40it/s]
 84%|████████▍ | 312204/371472 [2:40:29<4:35:06,  3.59it/s]
 84%|████████▍ | 312205/371472 [2:40:29<4:32:52,  3.62it/s]
 84%|████████▍ | 312206/371472 [2:40:29<4:32:24,  3.63it/s]
 84%|████████▍ | 312207/371472 [2:40:30<4:52:17,  3.38it/s]
 84%|████████▍ | 312208/371472 [2:40:30<4:53:07,  3.37it/s]
 84%|████████▍ | 312209/371472 [2:40:30<4:39:40,  3.53it/s]
 84%|████████▍ | 312210/371472 [2:40:30<4:29:16,  3.67it/s]
 84%|████████▍ | 312211/371472 [2:40:31<4:32:14,  3.63it/s]
 84%|████████▍ | 312212/371472 [2:40:31<4:34:25,  3.60it/s]
 84%|████████▍ | 312213/371472 [2:40:31<4:41:15,  3.51it/s]
 84%|████████▍ | 312214/371472 [2:40:31<4:25:00,  3.73it/s]
 84%|████████▍ | 312215/371472 [2:40:32<4:26:50,  3.70it/s]
 84%|████████▍ | 312216/371472 [2:40:32<4:37:03,  3.56it/s]
 84%|████████▍ | 312217/371472 [2:40:32<4:32:30,  3.62it/s]
 84%|████████▍ | 312218/371472 [2:40:33<4:29:30,  3.66it/s]
 84%|████████▍ | 312219/371472 [2:40:33<4:30:47,  3.65it/s]
 84%|████████▍ | 312220/371472 [2:40:33<4:56:33,  3.33it/s]
                                                           
{'loss': 2.6324, 'learning_rate': 2.436327005537719e-07, 'epoch': 13.45}

 84%|████████▍ | 312220/371472 [2:40:33<4:56:33,  3.33it/s]
 84%|████████▍ | 312221/371472 [2:40:33<4:45:06,  3.46it/s]
 84%|████████▍ | 312222/371472 [2:40:34<4:36:17,  3.57it/s]
 84%|████████▍ | 312223/371472 [2:40:34<4:28:33,  3.68it/s]
 84%|████████▍ | 312224/371472 [2:40:34<4:34:34,  3.60it/s]
 84%|████████▍ | 312225/371472 [2:40:34<4:26:41,  3.70it/s]
 84%|████████▍ | 312226/371472 [2:40:35<4:24:11,  3.74it/s]
 84%|████████▍ | 312227/371472 [2:40:35<4:41:20,  3.51it/s]
 84%|████████▍ | 312228/371472 [2:40:35<4:37:01,  3.56it/s]
 84%|████████▍ | 312229/371472 [2:40:36<4:39:36,  3.53it/s]
 84%|████████▍ | 312230/371472 [2:40:36<4:40:48,  3.52it/s]
 84%|████████▍ | 312231/371472 [2:40:36<4:55:23,  3.34it/s]
 84%|████████▍ | 312232/371472 [2:40:36<4:43:43,  3.48it/s]
 84%|████████▍ | 312233/371472 [2:40:37<4:47:53,  3.43it/s]
 84%|████████▍ | 312234/371472 [2:40:37<4:42:49,  3.49it/s]
 84%|████████▍ | 312235/371472 [2:40:37<4:42:01,  3.50it/s]
 84%|████████▍ | 312236/371472 [2:40:38<4:40:38,  3.52it/s]
 84%|████████▍ | 312237/371472 [2:40:38<4:47:08,  3.44it/s]
 84%|████████▍ | 312238/371472 [2:40:38<4:36:31,  3.57it/s]
 84%|████████▍ | 312239/371472 [2:40:38<4:26:31,  3.70it/s]
 84%|████████▍ | 312240/371472 [2:40:39<4:21:59,  3.77it/s]
                                                           
{'loss': 2.5756, 'learning_rate': 2.4358421857829297e-07, 'epoch': 13.45}

 84%|████████▍ | 312240/371472 [2:40:39<4:21:59,  3.77it/s]
 84%|████████▍ | 312241/371472 [2:40:39<4:18:22,  3.82it/s]
 84%|████████▍ | 312242/371472 [2:40:39<4:23:45,  3.74it/s]
 84%|████████▍ | 312243/371472 [2:40:39<4:17:07,  3.84it/s]
 84%|████████▍ | 312244/371472 [2:40:40<4:18:39,  3.82it/s]
 84%|████████▍ | 312245/371472 [2:40:40<4:25:36,  3.72it/s]
 84%|████████▍ | 312246/371472 [2:40:40<4:41:41,  3.50it/s]
 84%|████████▍ | 312247/371472 [2:40:41<4:28:32,  3.68it/s]
 84%|████████▍ | 312248/371472 [2:40:41<4:26:00,  3.71it/s]
 84%|████████▍ | 312249/371472 [2:40:41<4:23:50,  3.74it/s]
 84%|████████▍ | 312250/371472 [2:40:41<4:23:31,  3.75it/s]
 84%|████████▍ | 312251/371472 [2:40:42<4:18:19,  3.82it/s]
 84%|████████▍ | 312252/371472 [2:40:42<4:53:00,  3.37it/s]
 84%|████████▍ | 312253/371472 [2:40:42<4:40:03,  3.52it/s]
 84%|████████▍ | 312254/371472 [2:40:43<5:05:01,  3.24it/s]
 84%|████████▍ | 312255/371472 [2:40:43<4:57:05,  3.32it/s]
 84%|████████▍ | 312256/371472 [2:40:43<4:41:26,  3.51it/s]
 84%|████████▍ | 312257/371472 [2:40:43<4:37:41,  3.55it/s]
 84%|████████▍ | 312258/371472 [2:40:44<4:40:34,  3.52it/s]
 84%|████████▍ | 312259/371472 [2:40:44<4:28:40,  3.67it/s]
 84%|████████▍ | 312260/371472 [2:40:44<4:30:11,  3.65it/s]
                                                           
{'loss': 2.761, 'learning_rate': 2.435357366028141e-07, 'epoch': 13.45}

 84%|████████▍ | 312260/371472 [2:40:44<4:30:11,  3.65it/s]
 84%|████████▍ | 312261/371472 [2:40:45<4:33:13,  3.61it/s]
 84%|████████▍ | 312262/371472 [2:40:45<4:46:10,  3.45it/s]
 84%|████████▍ | 312263/371472 [2:40:45<4:40:19,  3.52it/s]
 84%|████████▍ | 312264/371472 [2:40:45<4:31:42,  3.63it/s]
 84%|████████▍ | 312265/371472 [2:40:46<4:29:48,  3.66it/s]
 84%|████████▍ | 312266/371472 [2:40:46<4:31:00,  3.64it/s]
 84%|████████▍ | 312267/371472 [2:40:46<4:33:46,  3.60it/s]
 84%|████████▍ | 312268/371472 [2:40:46<4:29:36,  3.66it/s]
 84%|████████▍ | 312269/371472 [2:40:47<4:21:52,  3.77it/s]
 84%|████████▍ | 312270/371472 [2:40:47<4:31:00,  3.64it/s]
 84%|████████▍ | 312271/371472 [2:40:47<4:47:19,  3.43it/s]
 84%|████████▍ | 312272/371472 [2:40:48<4:34:02,  3.60it/s]
 84%|████████▍ | 312273/371472 [2:40:48<4:34:18,  3.60it/s]
 84%|████████▍ | 312274/371472 [2:40:48<4:35:10,  3.59it/s]
 84%|████████▍ | 312275/371472 [2:40:48<4:34:35,  3.59it/s]
 84%|████████▍ | 312276/371472 [2:40:49<5:04:00,  3.25it/s]
 84%|████████▍ | 312277/371472 [2:40:49<4:58:11,  3.31it/s]
 84%|████████▍ | 312278/371472 [2:40:49<4:43:56,  3.47it/s]
 84%|████████▍ | 312279/371472 [2:40:50<4:29:23,  3.66it/s]
 84%|████████▍ | 312280/371472 [2:40:50<4:28:46,  3.67it/s]
                                                           
{'loss': 2.5825, 'learning_rate': 2.4348725462733516e-07, 'epoch': 13.45}

 84%|████████▍ | 312280/371472 [2:40:50<4:28:46,  3.67it/s]
 84%|████████▍ | 312281/371472 [2:40:50<4:30:58,  3.64it/s]
 84%|████████▍ | 312282/371472 [2:40:50<4:40:21,  3.52it/s]
 84%|████████▍ | 312283/371472 [2:40:51<4:33:34,  3.61it/s]
 84%|████████▍ | 312284/371472 [2:40:51<4:36:36,  3.57it/s]
 84%|████████▍ | 312285/371472 [2:40:51<4:34:48,  3.59it/s]
 84%|████████▍ | 312286/371472 [2:40:52<4:27:23,  3.69it/s]
 84%|████████▍ | 312287/371472 [2:40:52<4:27:52,  3.68it/s]
 84%|████████▍ | 312288/371472 [2:40:52<4:32:53,  3.61it/s]
 84%|████████▍ | 312289/371472 [2:40:52<4:28:51,  3.67it/s]
 84%|████████▍ | 312290/371472 [2:40:53<4:38:41,  3.54it/s]
 84%|████████▍ | 312291/371472 [2:40:53<4:56:06,  3.33it/s]
 84%|████████▍ | 312292/371472 [2:40:53<4:53:27,  3.36it/s]
 84%|████████▍ | 312293/371472 [2:40:54<5:01:29,  3.27it/s]
 84%|████████▍ | 312294/371472 [2:40:54<5:17:20,  3.11it/s]
 84%|████████▍ | 312295/371472 [2:40:54<4:52:58,  3.37it/s]
 84%|████████▍ | 312296/371472 [2:40:54<4:48:24,  3.42it/s]
 84%|████████▍ | 312297/371472 [2:40:55<4:45:50,  3.45it/s]
 84%|████████▍ | 312298/371472 [2:40:55<4:57:41,  3.31it/s]
 84%|████████▍ | 312299/371472 [2:40:55<5:11:47,  3.16it/s]
 84%|████████▍ | 312300/371472 [2:40:56<4:50:05,  3.40it/s]
                                                           
{'loss': 2.5376, 'learning_rate': 2.4343877265185634e-07, 'epoch': 13.45}

 84%|████████▍ | 312300/371472 [2:40:56<4:50:05,  3.40it/s]
 84%|████████▍ | 312301/371472 [2:40:56<4:43:41,  3.48it/s]
 84%|████████▍ | 312302/371472 [2:40:56<4:42:23,  3.49it/s]
 84%|████████▍ | 312303/371472 [2:40:57<4:45:47,  3.45it/s]
 84%|████████▍ | 312304/371472 [2:40:57<4:37:46,  3.55it/s]
 84%|████████▍ | 312305/371472 [2:40:57<4:43:32,  3.48it/s]
 84%|████████▍ | 312306/371472 [2:40:57<4:34:15,  3.60it/s]
 84%|████████▍ | 312307/371472 [2:40:58<4:39:43,  3.53it/s]
 84%|████████▍ | 312308/371472 [2:40:58<4:30:04,  3.65it/s]
 84%|████████▍ | 312309/371472 [2:40:58<4:40:23,  3.52it/s]
 84%|████████▍ | 312310/371472 [2:40:58<4:34:27,  3.59it/s]
 84%|████████▍ | 312311/371472 [2:40:59<4:30:50,  3.64it/s]
 84%|████████▍ | 312312/371472 [2:40:59<4:24:37,  3.73it/s]
 84%|████████▍ | 312313/371472 [2:40:59<4:46:08,  3.45it/s]
 84%|████████▍ | 312314/371472 [2:41:00<4:43:06,  3.48it/s]
 84%|████████▍ | 312315/371472 [2:41:00<4:50:31,  3.39it/s]
 84%|████████▍ | 312316/371472 [2:41:00<4:42:01,  3.50it/s]
 84%|████████▍ | 312317/371472 [2:41:01<4:48:19,  3.42it/s]
 84%|████████▍ | 312318/371472 [2:41:01<4:53:07,  3.36it/s]
 84%|████████▍ | 312319/371472 [2:41:01<4:36:21,  3.57it/s]
 84%|████████▍ | 312320/371472 [2:41:01<4:49:02,  3.41it/s]
                                                           
{'loss': 2.5674, 'learning_rate': 2.433902906763774e-07, 'epoch': 13.45}

 84%|████████▍ | 312320/371472 [2:41:01<4:49:02,  3.41it/s]
 84%|████████▍ | 312321/371472 [2:41:02<4:44:16,  3.47it/s]
 84%|████████▍ | 312322/371472 [2:41:02<4:38:09,  3.54it/s]
 84%|████████▍ | 312323/371472 [2:41:02<4:32:14,  3.62it/s]
 84%|████████▍ | 312324/371472 [2:41:02<4:20:53,  3.78it/s]
 84%|████████▍ | 312325/371472 [2:41:03<4:25:26,  3.71it/s]
 84%|████████▍ | 312326/371472 [2:41:03<4:15:47,  3.85it/s]
 84%|████████▍ | 312327/371472 [2:41:03<4:10:07,  3.94it/s]
 84%|████████▍ | 312328/371472 [2:41:03<4:24:49,  3.72it/s]
 84%|████████▍ | 312329/371472 [2:41:04<4:25:07,  3.72it/s]
 84%|████████▍ | 312330/371472 [2:41:04<4:18:05,  3.82it/s]
 84%|████████▍ | 312331/371472 [2:41:04<4:12:39,  3.90it/s]
 84%|████████▍ | 312332/371472 [2:41:04<4:08:32,  3.97it/s]
 84%|████████▍ | 312333/371472 [2:41:05<4:15:25,  3.86it/s]
 84%|████████▍ | 312334/371472 [2:41:05<4:17:11,  3.83it/s]
 84%|████████▍ | 312335/371472 [2:41:05<4:26:09,  3.70it/s]
 84%|████████▍ | 312336/371472 [2:41:06<4:41:24,  3.50it/s]
 84%|████████▍ | 312337/371472 [2:41:06<4:58:14,  3.30it/s]
 84%|████████▍ | 312338/371472 [2:41:06<4:49:10,  3.41it/s]
 84%|████████▍ | 312339/371472 [2:41:07<4:59:10,  3.29it/s]
 84%|████████▍ | 312340/371472 [2:41:07<4:59:55,  3.29it/s]
                                                           
{'loss': 2.5509, 'learning_rate': 2.4334180870089854e-07, 'epoch': 13.45}

 84%|████████▍ | 312340/371472 [2:41:07<4:59:55,  3.29it/s]
 84%|████████▍ | 312341/371472 [2:41:07<4:45:54,  3.45it/s]
 84%|████████▍ | 312342/371472 [2:41:07<4:41:43,  3.50it/s]
 84%|████████▍ | 312343/371472 [2:41:08<4:42:32,  3.49it/s]
 84%|████████▍ | 312344/371472 [2:41:08<4:39:56,  3.52it/s]
 84%|████████▍ | 312345/371472 [2:41:08<4:28:00,  3.68it/s]
 84%|████████▍ | 312346/371472 [2:41:09<4:32:28,  3.62it/s]
 84%|████████▍ | 312347/371472 [2:41:09<4:26:31,  3.70it/s]
 84%|████████▍ | 312348/371472 [2:41:09<4:25:55,  3.71it/s]
 84%|████████▍ | 312349/371472 [2:41:09<4:42:25,  3.49it/s]
 84%|████████▍ | 312350/371472 [2:41:10<4:32:20,  3.62it/s]
 84%|████████▍ | 312351/371472 [2:41:10<4:26:08,  3.70it/s]
 84%|████████▍ | 312352/371472 [2:41:10<5:00:48,  3.28it/s]
 84%|████████▍ | 312353/371472 [2:41:11<4:56:24,  3.32it/s]
 84%|████████▍ | 312354/371472 [2:41:11<4:42:30,  3.49it/s]
 84%|████████▍ | 312355/371472 [2:41:11<4:28:33,  3.67it/s]
 84%|████████▍ | 312356/371472 [2:41:11<4:19:21,  3.80it/s]
 84%|████████▍ | 312357/371472 [2:41:12<4:20:51,  3.78it/s]
 84%|████████▍ | 312358/371472 [2:41:12<4:13:33,  3.89it/s]
 84%|████████▍ | 312359/371472 [2:41:12<4:17:59,  3.82it/s]
 84%|████████▍ | 312360/371472 [2:41:12<4:19:12,  3.80it/s]
                                                           
{'loss': 2.5194, 'learning_rate': 2.432933267254196e-07, 'epoch': 13.45}

 84%|████████▍ | 312360/371472 [2:41:12<4:19:12,  3.80it/s]
 84%|████████▍ | 312361/371472 [2:41:13<4:26:41,  3.69it/s]
 84%|████████▍ | 312362/371472 [2:41:13<4:39:00,  3.53it/s]
 84%|████████▍ | 312363/371472 [2:41:13<4:26:47,  3.69it/s]
 84%|████████▍ | 312364/371472 [2:41:13<4:36:34,  3.56it/s]
 84%|████████▍ | 312365/371472 [2:41:14<4:26:29,  3.70it/s]
 84%|████████▍ | 312366/371472 [2:41:14<4:21:04,  3.77it/s]
 84%|████████▍ | 312367/371472 [2:41:14<4:21:49,  3.76it/s]
 84%|████████▍ | 312368/371472 [2:41:15<4:30:39,  3.64it/s]
 84%|████████▍ | 312369/371472 [2:41:15<4:27:17,  3.69it/s]
 84%|████████▍ | 312370/371472 [2:41:15<4:29:03,  3.66it/s]
 84%|████████▍ | 312371/371472 [2:41:15<4:29:03,  3.66it/s]
 84%|████████▍ | 312372/371472 [2:41:16<4:35:30,  3.58it/s]
 84%|████████▍ | 312373/371472 [2:41:16<4:31:10,  3.63it/s]
 84%|████████▍ | 312374/371472 [2:41:16<4:46:49,  3.43it/s]
 84%|████████▍ | 312375/371472 [2:41:17<5:00:15,  3.28it/s]
 84%|████████▍ | 312376/371472 [2:41:17<4:56:21,  3.32it/s]
 84%|████████▍ | 312377/371472 [2:41:17<5:00:39,  3.28it/s]
 84%|████████▍ | 312378/371472 [2:41:17<4:55:46,  3.33it/s]
 84%|████████▍ | 312379/371472 [2:41:18<4:43:50,  3.47it/s]
 84%|████████▍ | 312380/371472 [2:41:18<4:33:15,  3.60it/s]
                                                           
{'loss': 2.46, 'learning_rate': 2.4324484474994073e-07, 'epoch': 13.45}

 84%|████████▍ | 312380/371472 [2:41:18<4:33:15,  3.60it/s]
 84%|████████▍ | 312381/371472 [2:41:18<4:29:32,  3.65it/s]
 84%|████████▍ | 312382/371472 [2:41:19<4:42:18,  3.49it/s]
 84%|████████▍ | 312383/371472 [2:41:19<4:48:43,  3.41it/s]
 84%|████████▍ | 312384/371472 [2:41:19<4:36:45,  3.56it/s]
 84%|████████▍ | 312385/371472 [2:41:19<4:38:42,  3.53it/s]
 84%|████████▍ | 312386/371472 [2:41:20<4:28:20,  3.67it/s]
 84%|████████▍ | 312387/371472 [2:41:20<4:27:19,  3.68it/s]
 84%|████████▍ | 312388/371472 [2:41:20<4:18:29,  3.81it/s]
 84%|████████▍ | 312389/371472 [2:41:20<4:19:17,  3.80it/s]
 84%|████████▍ | 312390/371472 [2:41:21<4:18:45,  3.81it/s]
 84%|████████▍ | 312391/371472 [2:41:21<4:13:33,  3.88it/s]
 84%|████████▍ | 312392/371472 [2:41:21<4:24:09,  3.73it/s]
 84%|████████▍ | 312393/371472 [2:41:22<4:26:28,  3.70it/s]
 84%|████████▍ | 312394/371472 [2:41:22<4:48:39,  3.41it/s]
 84%|████████▍ | 312395/371472 [2:41:22<4:45:48,  3.44it/s]
 84%|████████▍ | 312396/371472 [2:41:22<4:39:56,  3.52it/s]
 84%|████████▍ | 312397/371472 [2:41:23<5:00:50,  3.27it/s]
 84%|████████▍ | 312398/371472 [2:41:23<4:46:20,  3.44it/s]
 84%|████████▍ | 312399/371472 [2:41:23<4:40:17,  3.51it/s]
 84%|████████▍ | 312400/371472 [2:41:24<4:28:02,  3.67it/s]
                                                           
{'loss': 2.5683, 'learning_rate': 2.431963627744618e-07, 'epoch': 13.46}

 84%|████████▍ | 312400/371472 [2:41:24<4:28:02,  3.67it/s]
 84%|████████▍ | 312401/371472 [2:41:24<4:22:01,  3.76it/s]
 84%|████████▍ | 312402/371472 [2:41:24<4:31:16,  3.63it/s]
 84%|████████▍ | 312403/371472 [2:41:24<4:40:35,  3.51it/s]
 84%|████████▍ | 312404/371472 [2:41:25<4:35:37,  3.57it/s]
 84%|████████▍ | 312405/371472 [2:41:25<5:00:49,  3.27it/s]
 84%|████████▍ | 312406/371472 [2:41:25<4:48:27,  3.41it/s]
 84%|████████▍ | 312407/371472 [2:41:26<4:44:51,  3.46it/s]
 84%|████████▍ | 312408/371472 [2:41:26<4:58:03,  3.30it/s]
 84%|████████▍ | 312409/371472 [2:41:26<4:54:45,  3.34it/s]
 84%|████████▍ | 312410/371472 [2:41:26<4:45:12,  3.45it/s]
 84%|████████▍ | 312411/371472 [2:41:27<4:31:12,  3.63it/s]
 84%|████████▍ | 312412/371472 [2:41:27<4:58:54,  3.29it/s]
 84%|████████▍ | 312413/371472 [2:41:27<4:48:14,  3.41it/s]
 84%|████████▍ | 312414/371472 [2:41:28<4:40:05,  3.51it/s]
 84%|████████▍ | 312415/371472 [2:41:28<4:28:42,  3.66it/s]
 84%|████████▍ | 312416/371472 [2:41:28<4:32:19,  3.61it/s]
 84%|████████▍ | 312417/371472 [2:41:28<4:27:32,  3.68it/s]
 84%|████████▍ | 312418/371472 [2:41:29<4:46:05,  3.44it/s]
 84%|████████▍ | 312419/371472 [2:41:29<4:36:09,  3.56it/s]
 84%|████████▍ | 312420/371472 [2:41:29<4:41:53,  3.49it/s]
                                                           
{'loss': 2.6261, 'learning_rate': 2.43147880798983e-07, 'epoch': 13.46}

 84%|████████▍ | 312420/371472 [2:41:29<4:41:53,  3.49it/s]
 84%|████████▍ | 312421/371472 [2:41:30<4:55:18,  3.33it/s]
 84%|████████▍ | 312422/371472 [2:41:30<4:45:11,  3.45it/s]
 84%|████████▍ | 312423/371472 [2:41:30<5:30:56,  2.97it/s]
 84%|████████▍ | 312424/371472 [2:41:31<5:00:14,  3.28it/s]
 84%|████████▍ | 312425/371472 [2:41:31<4:47:43,  3.42it/s]
 84%|████████▍ | 312426/371472 [2:41:31<4:52:50,  3.36it/s]
 84%|████████▍ | 312427/371472 [2:41:31<4:58:46,  3.29it/s]
 84%|████████▍ | 312428/371472 [2:41:32<4:44:36,  3.46it/s]
 84%|████████▍ | 312429/371472 [2:41:32<4:29:32,  3.65it/s]
 84%|████████▍ | 312430/371472 [2:41:32<4:28:41,  3.66it/s]
 84%|████████▍ | 312431/371472 [2:41:33<4:43:54,  3.47it/s]
 84%|████████▍ | 312432/371472 [2:41:33<4:36:58,  3.55it/s]
 84%|████████▍ | 312433/371472 [2:41:33<4:26:37,  3.69it/s]
 84%|████████▍ | 312434/371472 [2:41:33<4:23:01,  3.74it/s]
 84%|████████▍ | 312435/371472 [2:41:34<4:18:15,  3.81it/s]
 84%|████████▍ | 312436/371472 [2:41:34<4:26:28,  3.69it/s]
 84%|████████▍ | 312437/371472 [2:41:34<4:21:58,  3.76it/s]
 84%|████████▍ | 312438/371472 [2:41:34<4:18:14,  3.81it/s]
 84%|████████▍ | 312439/371472 [2:41:35<4:32:49,  3.61it/s]
 84%|████████▍ | 312440/371472 [2:41:35<4:32:58,  3.60it/s]
                                                           
{'loss': 2.5832, 'learning_rate': 2.4309939882350405e-07, 'epoch': 13.46}

 84%|████████▍ | 312440/371472 [2:41:35<4:32:58,  3.60it/s]
 84%|████████▍ | 312441/371472 [2:41:35<4:42:37,  3.48it/s]
 84%|████████▍ | 312442/371472 [2:41:36<4:38:37,  3.53it/s]
 84%|████████▍ | 312443/371472 [2:41:36<4:27:52,  3.67it/s]
 84%|████████▍ | 312444/371472 [2:41:36<4:25:33,  3.70it/s]
 84%|████████▍ | 312445/371472 [2:41:36<4:28:12,  3.67it/s]
 84%|████████▍ | 312446/371472 [2:41:37<4:18:21,  3.81it/s]
 84%|████████▍ | 312447/371472 [2:41:37<4:25:51,  3.70it/s]
 84%|████████▍ | 312448/371472 [2:41:37<4:45:16,  3.45it/s]
 84%|████████▍ | 312449/371472 [2:41:37<4:41:05,  3.50it/s]
 84%|████████▍ | 312450/371472 [2:41:38<4:47:06,  3.43it/s]
 84%|████████▍ | 312451/371472 [2:41:38<4:46:22,  3.43it/s]
 84%|████████▍ | 312452/371472 [2:41:38<4:30:45,  3.63it/s]
 84%|████████▍ | 312453/371472 [2:41:39<4:32:22,  3.61it/s]
 84%|████████▍ | 312454/371472 [2:41:39<4:34:48,  3.58it/s]
 84%|████████▍ | 312455/371472 [2:41:39<4:29:29,  3.65it/s]
 84%|████████▍ | 312456/371472 [2:41:39<4:36:47,  3.55it/s]
 84%|████████▍ | 312457/371472 [2:41:40<4:36:33,  3.56it/s]
 84%|████████▍ | 312458/371472 [2:41:40<4:54:57,  3.33it/s]
 84%|████████▍ | 312459/371472 [2:41:40<4:38:22,  3.53it/s]
 84%|████████▍ | 312460/371472 [2:41:41<4:39:48,  3.51it/s]
                                                           
{'loss': 2.798, 'learning_rate': 2.430509168480252e-07, 'epoch': 13.46}

 84%|████████▍ | 312460/371472 [2:41:41<4:39:48,  3.51it/s]
 84%|████████▍ | 312461/371472 [2:41:41<4:27:39,  3.67it/s]
 84%|████████▍ | 312462/371472 [2:41:41<4:38:54,  3.53it/s]
 84%|████████▍ | 312463/371472 [2:41:41<4:29:25,  3.65it/s]
 84%|████████▍ | 312464/371472 [2:41:42<4:31:56,  3.62it/s]
 84%|████████▍ | 312465/371472 [2:41:42<4:36:58,  3.55it/s]
 84%|████████▍ | 312466/371472 [2:41:42<4:28:54,  3.66it/s]
 84%|████████▍ | 312467/371472 [2:41:43<4:50:41,  3.38it/s]
 84%|████████▍ | 312468/371472 [2:41:43<4:49:00,  3.40it/s]
 84%|████████▍ | 312469/371472 [2:41:43<4:44:38,  3.45it/s]
 84%|████████▍ | 312470/371472 [2:41:43<4:29:13,  3.65it/s]
 84%|████████▍ | 312471/371472 [2:41:44<4:30:59,  3.63it/s]
 84%|████████▍ | 312472/371472 [2:41:44<4:28:04,  3.67it/s]
 84%|████████▍ | 312473/371472 [2:41:44<4:24:46,  3.71it/s]
 84%|████████▍ | 312474/371472 [2:41:44<4:23:12,  3.74it/s]
 84%|████████▍ | 312475/371472 [2:41:45<4:51:14,  3.38it/s]
 84%|████████▍ | 312476/371472 [2:41:45<4:41:53,  3.49it/s]
 84%|████████▍ | 312477/371472 [2:41:45<4:39:17,  3.52it/s]
 84%|████████▍ | 312478/371472 [2:41:46<4:50:39,  3.38it/s]
 84%|████████▍ | 312479/371472 [2:41:46<4:52:54,  3.36it/s]
 84%|████████▍ | 312480/371472 [2:41:46<4:51:27,  3.37it/s]
                                                           
{'loss': 2.5235, 'learning_rate': 2.4300243487254625e-07, 'epoch': 13.46}

 84%|████████▍ | 312480/371472 [2:41:46<4:51:27,  3.37it/s]
 84%|████████▍ | 312481/371472 [2:41:47<4:56:30,  3.32it/s]
 84%|████████▍ | 312482/371472 [2:41:47<4:46:33,  3.43it/s]
 84%|████████▍ | 312483/371472 [2:41:47<5:00:45,  3.27it/s]
 84%|████████▍ | 312484/371472 [2:41:47<4:41:20,  3.49it/s]
 84%|████████▍ | 312485/371472 [2:41:48<4:32:44,  3.60it/s]
 84%|████████▍ | 312486/371472 [2:41:48<4:39:06,  3.52it/s]
 84%|████████▍ | 312487/371472 [2:41:48<4:53:45,  3.35it/s]
 84%|████████▍ | 312488/371472 [2:41:49<4:56:00,  3.32it/s]
 84%|████████▍ | 312489/371472 [2:41:49<4:40:04,  3.51it/s]
 84%|████████▍ | 312490/371472 [2:41:49<4:43:19,  3.47it/s]
 84%|████████▍ | 312491/371472 [2:41:49<4:44:08,  3.46it/s]
 84%|████████▍ | 312492/371472 [2:41:50<4:37:32,  3.54it/s]
 84%|████████▍ | 312493/371472 [2:41:50<4:30:32,  3.63it/s]
 84%|████████▍ | 312494/371472 [2:41:50<4:35:02,  3.57it/s]
 84%|████████▍ | 312495/371472 [2:41:51<4:54:36,  3.34it/s]
 84%|████████▍ | 312496/371472 [2:41:51<4:46:54,  3.43it/s]
 84%|████████▍ | 312497/371472 [2:41:51<4:43:46,  3.46it/s]
 84%|████████▍ | 312498/371472 [2:41:51<4:41:10,  3.50it/s]
 84%|████████▍ | 312499/371472 [2:41:52<4:48:23,  3.41it/s]
 84%|████████▍ | 312500/371472 [2:41:52<4:40:51,  3.50it/s]
                                                           
{'loss': 2.5215, 'learning_rate': 2.4295395289706737e-07, 'epoch': 13.46}

 84%|████████▍ | 312500/371472 [2:41:52<4:40:51,  3.50it/s]
 84%|████████▍ | 312501/371472 [2:41:52<4:29:58,  3.64it/s]
 84%|████████▍ | 312502/371472 [2:41:53<4:30:40,  3.63it/s]
 84%|████████▍ | 312503/371472 [2:41:53<4:31:02,  3.63it/s]
 84%|████████▍ | 312504/371472 [2:41:53<4:22:04,  3.75it/s]
 84%|████████▍ | 312505/371472 [2:41:53<4:24:01,  3.72it/s]
 84%|████████▍ | 312506/371472 [2:41:54<4:17:21,  3.82it/s]
 84%|████████▍ | 312507/371472 [2:41:54<4:17:01,  3.82it/s]
 84%|████████▍ | 312508/371472 [2:41:54<4:24:25,  3.72it/s]
 84%|████████▍ | 312509/371472 [2:41:54<4:38:49,  3.52it/s]
 84%|████████▍ | 312510/371472 [2:41:55<4:31:14,  3.62it/s]
 84%|████████▍ | 312511/371472 [2:41:55<4:48:45,  3.40it/s]
 84%|████████▍ | 312512/371472 [2:41:55<4:39:14,  3.52it/s]
 84%|████████▍ | 312513/371472 [2:41:56<4:43:40,  3.46it/s]
 84%|████████▍ | 312514/371472 [2:41:56<4:37:25,  3.54it/s]
 84%|████████▍ | 312515/371472 [2:41:56<4:33:23,  3.59it/s]
 84%|████████▍ | 312516/371472 [2:41:56<4:30:04,  3.64it/s]
 84%|████████▍ | 312517/371472 [2:41:57<4:25:49,  3.70it/s]
 84%|████████▍ | 312518/371472 [2:41:57<4:22:49,  3.74it/s]
 84%|████████▍ | 312519/371472 [2:41:57<4:17:28,  3.82it/s]
 84%|████████▍ | 312520/371472 [2:41:57<4:20:02,  3.78it/s]
                                                           
{'loss': 2.6091, 'learning_rate': 2.4290547092158844e-07, 'epoch': 13.46}

 84%|████████▍ | 312520/371472 [2:41:57<4:20:02,  3.78it/s]
 84%|████████▍ | 312521/371472 [2:41:58<4:20:27,  3.77it/s]
 84%|████████▍ | 312522/371472 [2:41:58<4:38:32,  3.53it/s]
 84%|████████▍ | 312523/371472 [2:41:58<4:47:56,  3.41it/s]
 84%|████████▍ | 312524/371472 [2:41:59<4:39:11,  3.52it/s]
 84%|████████▍ | 312525/371472 [2:41:59<4:33:27,  3.59it/s]
 84%|████████▍ | 312526/371472 [2:41:59<4:33:19,  3.59it/s]
 84%|████████▍ | 312527/371472 [2:41:59<4:31:05,  3.62it/s]
 84%|████████▍ | 312528/371472 [2:42:00<4:32:26,  3.61it/s]
 84%|████████▍ | 312529/371472 [2:42:00<4:43:17,  3.47it/s]
 84%|████████▍ | 312530/371472 [2:42:00<4:32:06,  3.61it/s]
 84%|████████▍ | 312531/371472 [2:42:01<4:41:38,  3.49it/s]
 84%|████████▍ | 312532/371472 [2:42:01<4:37:14,  3.54it/s]
 84%|████████▍ | 312533/371472 [2:42:01<4:34:32,  3.58it/s]
 84%|████████▍ | 312534/371472 [2:42:02<4:59:14,  3.28it/s]
 84%|████████▍ | 312535/371472 [2:42:02<4:51:45,  3.37it/s]
 84%|████████▍ | 312536/371472 [2:42:02<4:58:10,  3.29it/s]
 84%|████████▍ | 312537/371472 [2:42:02<4:41:47,  3.49it/s]
 84%|████████▍ | 312538/371472 [2:42:03<4:39:14,  3.52it/s]
 84%|████████▍ | 312539/371472 [2:42:03<4:39:49,  3.51it/s]
 84%|████████▍ | 312540/371472 [2:42:03<4:45:06,  3.45it/s]
                                                           
{'loss': 2.6526, 'learning_rate': 2.428569889461096e-07, 'epoch': 13.46}

 84%|████████▍ | 312540/371472 [2:42:03<4:45:06,  3.45it/s]
 84%|████████▍ | 312541/371472 [2:42:04<4:44:48,  3.45it/s]
 84%|████████▍ | 312542/371472 [2:42:04<4:36:44,  3.55it/s]
 84%|████████▍ | 312543/371472 [2:42:04<4:34:21,  3.58it/s]
 84%|████████▍ | 312544/371472 [2:42:04<4:26:47,  3.68it/s]
 84%|████████▍ | 312545/371472 [2:42:05<4:28:43,  3.65it/s]
 84%|████████▍ | 312546/371472 [2:42:05<4:27:54,  3.67it/s]
 84%|████████▍ | 312547/371472 [2:42:05<4:40:43,  3.50it/s]
 84%|████████▍ | 312548/371472 [2:42:05<4:34:01,  3.58it/s]
 84%|████████▍ | 312549/371472 [2:42:06<4:48:00,  3.41it/s]
 84%|████████▍ | 312550/371472 [2:42:06<4:42:08,  3.48it/s]
 84%|████████▍ | 312551/371472 [2:42:06<4:58:32,  3.29it/s]
 84%|████████▍ | 312552/371472 [2:42:07<4:55:00,  3.33it/s]
 84%|████████▍ | 312553/371472 [2:42:07<5:03:02,  3.24it/s]
 84%|████████▍ | 312554/371472 [2:42:07<5:04:34,  3.22it/s]
 84%|████████▍ | 312555/371472 [2:42:08<5:03:20,  3.24it/s]
 84%|████████▍ | 312556/371472 [2:42:08<4:57:11,  3.30it/s]
 84%|████████▍ | 312557/371472 [2:42:08<4:42:48,  3.47it/s]
 84%|████████▍ | 312558/371472 [2:42:08<4:30:40,  3.63it/s]
 84%|████████▍ | 312559/371472 [2:42:09<4:40:59,  3.49it/s]
 84%|████████▍ | 312560/371472 [2:42:09<4:27:34,  3.67it/s]
                                                           
{'loss': 2.6182, 'learning_rate': 2.428085069706307e-07, 'epoch': 13.46}

 84%|████████▍ | 312560/371472 [2:42:09<4:27:34,  3.67it/s]
 84%|████████▍ | 312561/371472 [2:42:09<4:35:31,  3.56it/s]
 84%|████████▍ | 312562/371472 [2:42:10<4:38:02,  3.53it/s]
 84%|████████▍ | 312563/371472 [2:42:10<4:41:08,  3.49it/s]
 84%|████████▍ | 312564/371472 [2:42:10<4:55:44,  3.32it/s]
 84%|████████▍ | 312565/371472 [2:42:11<4:58:14,  3.29it/s]
 84%|████████▍ | 312566/371472 [2:42:11<4:52:10,  3.36it/s]
 84%|████████▍ | 312567/371472 [2:42:11<4:42:31,  3.47it/s]
 84%|████████▍ | 312568/371472 [2:42:11<4:30:58,  3.62it/s]
 84%|████████▍ | 312569/371472 [2:42:12<4:20:45,  3.76it/s]
 84%|████████▍ | 312570/371472 [2:42:12<4:19:41,  3.78it/s]
 84%|████████▍ | 312571/371472 [2:42:12<4:18:27,  3.80it/s]
 84%|████████▍ | 312572/371472 [2:42:12<4:32:32,  3.60it/s]
 84%|████████▍ | 312573/371472 [2:42:13<4:47:17,  3.42it/s]
 84%|████████▍ | 312574/371472 [2:42:13<4:38:50,  3.52it/s]
 84%|████████▍ | 312575/371472 [2:42:13<4:29:09,  3.65it/s]
 84%|████████▍ | 312576/371472 [2:42:13<4:24:01,  3.72it/s]
 84%|████████▍ | 312577/371472 [2:42:14<4:25:34,  3.70it/s]
 84%|████████▍ | 312578/371472 [2:42:14<4:26:52,  3.68it/s]
 84%|████████▍ | 312579/371472 [2:42:14<4:15:07,  3.85it/s]
 84%|████████▍ | 312580/371472 [2:42:15<4:15:33,  3.84it/s]
                                                           
{'loss': 2.687, 'learning_rate': 2.4276002499515187e-07, 'epoch': 13.46}

 84%|████████▍ | 312580/371472 [2:42:15<4:15:33,  3.84it/s]
 84%|████████▍ | 312581/371472 [2:42:15<4:06:52,  3.98it/s]
 84%|████████▍ | 312582/371472 [2:42:15<4:20:11,  3.77it/s]
 84%|████████▍ | 312583/371472 [2:42:15<4:17:08,  3.82it/s]
 84%|████████▍ | 312584/371472 [2:42:16<4:20:29,  3.77it/s]
 84%|████████▍ | 312585/371472 [2:42:16<4:23:11,  3.73it/s]
 84%|████████▍ | 312586/371472 [2:42:16<4:54:43,  3.33it/s]
 84%|████████▍ | 312587/371472 [2:42:17<4:48:34,  3.40it/s]
 84%|████████▍ | 312588/371472 [2:42:17<4:34:00,  3.58it/s]
 84%|████████▍ | 312589/371472 [2:42:17<4:47:00,  3.42it/s]
 84%|████████▍ | 312590/371472 [2:42:17<4:55:53,  3.32it/s]
 84%|████████▍ | 312591/371472 [2:42:18<4:52:05,  3.36it/s]
 84%|████████▍ | 312592/371472 [2:42:18<4:41:28,  3.49it/s]
 84%|████████▍ | 312593/371472 [2:42:18<4:49:03,  3.39it/s]
 84%|████████▍ | 312594/371472 [2:42:19<4:42:16,  3.48it/s]
 84%|████████▍ | 312595/371472 [2:42:19<4:47:49,  3.41it/s]
 84%|████████▍ | 312596/371472 [2:42:19<4:54:49,  3.33it/s]
 84%|████████▍ | 312597/371472 [2:42:19<4:50:26,  3.38it/s]
 84%|████████▍ | 312598/371472 [2:42:20<4:56:41,  3.31it/s]
 84%|████████▍ | 312599/371472 [2:42:20<5:10:56,  3.16it/s]
 84%|████████▍ | 312600/371472 [2:42:20<4:54:12,  3.34it/s]
                                                           
{'loss': 2.6361, 'learning_rate': 2.427115430196729e-07, 'epoch': 13.46}

 84%|████████▍ | 312600/371472 [2:42:20<4:54:12,  3.34it/s]
 84%|████████▍ | 312601/371472 [2:42:21<4:44:12,  3.45it/s]
 84%|████████▍ | 312602/371472 [2:42:21<4:47:37,  3.41it/s]
 84%|████████▍ | 312603/371472 [2:42:21<4:45:30,  3.44it/s]
 84%|████████▍ | 312604/371472 [2:42:21<4:28:21,  3.66it/s]
 84%|████████▍ | 312605/371472 [2:42:22<4:24:31,  3.71it/s]
 84%|████████▍ | 312606/371472 [2:42:22<4:43:37,  3.46it/s]
 84%|████████▍ | 312607/371472 [2:42:22<4:33:30,  3.59it/s]
 84%|████████▍ | 312608/371472 [2:42:23<4:48:43,  3.40it/s]
 84%|████████▍ | 312609/371472 [2:42:23<4:34:30,  3.57it/s]
 84%|████████▍ | 312610/371472 [2:42:23<4:25:03,  3.70it/s]
 84%|████████▍ | 312611/371472 [2:42:23<4:17:21,  3.81it/s]
 84%|████████▍ | 312612/371472 [2:42:24<4:27:33,  3.67it/s]
 84%|████████▍ | 312613/371472 [2:42:24<4:31:35,  3.61it/s]
 84%|████████▍ | 312614/371472 [2:42:24<4:29:16,  3.64it/s]
 84%|████████▍ | 312615/371472 [2:42:25<4:41:03,  3.49it/s]
 84%|████████▍ | 312616/371472 [2:42:25<4:49:01,  3.39it/s]
 84%|████████▍ | 312617/371472 [2:42:25<4:42:00,  3.48it/s]
 84%|████████▍ | 312618/371472 [2:42:25<4:44:44,  3.44it/s]
 84%|████████▍ | 312619/371472 [2:42:26<4:36:04,  3.55it/s]
 84%|████████▍ | 312620/371472 [2:42:26<4:29:03,  3.65it/s]
                                                           
{'loss': 2.6645, 'learning_rate': 2.42663061044194e-07, 'epoch': 13.47}

 84%|████████▍ | 312620/371472 [2:42:26<4:29:03,  3.65it/s]
 84%|████████▍ | 312621/371472 [2:42:26<4:39:32,  3.51it/s]
 84%|████████▍ | 312622/371472 [2:42:27<4:31:06,  3.62it/s]
 84%|████████▍ | 312623/371472 [2:42:27<4:20:04,  3.77it/s]
 84%|████████▍ | 312624/371472 [2:42:27<4:47:29,  3.41it/s]
 84%|████████▍ | 312625/371472 [2:42:27<4:40:40,  3.49it/s]
 84%|████████▍ | 312626/371472 [2:42:28<4:37:25,  3.54it/s]
 84%|████████▍ | 312627/371472 [2:42:28<4:33:29,  3.59it/s]
 84%|████████▍ | 312628/371472 [2:42:28<4:36:09,  3.55it/s]
 84%|████████▍ | 312629/371472 [2:42:29<4:58:44,  3.28it/s]
 84%|████████▍ | 312630/371472 [2:42:29<4:35:24,  3.56it/s]
 84%|████████▍ | 312631/371472 [2:42:29<4:28:42,  3.65it/s]
 84%|████████▍ | 312632/371472 [2:42:29<4:30:54,  3.62it/s]
 84%|████████▍ | 312633/371472 [2:42:30<4:27:47,  3.66it/s]
 84%|████████▍ | 312634/371472 [2:42:30<4:19:01,  3.79it/s]
 84%|████████▍ | 312635/371472 [2:42:30<4:14:03,  3.86it/s]
 84%|████████▍ | 312636/371472 [2:42:30<4:14:27,  3.85it/s]
 84%|████████▍ | 312637/371472 [2:42:31<4:19:41,  3.78it/s]
 84%|████████▍ | 312638/371472 [2:42:31<4:34:00,  3.58it/s]
 84%|████████▍ | 312639/371472 [2:42:31<4:48:55,  3.39it/s]
 84%|████████▍ | 312640/371472 [2:42:32<4:35:46,  3.56it/s]
                                                           
{'loss': 2.7155, 'learning_rate': 2.426145790687151e-07, 'epoch': 13.47}

 84%|████████▍ | 312640/371472 [2:42:32<4:35:46,  3.56it/s]
 84%|████████▍ | 312641/371472 [2:42:32<4:40:24,  3.50it/s]
 84%|████████▍ | 312642/371472 [2:42:32<4:49:06,  3.39it/s]
 84%|████████▍ | 312643/371472 [2:42:32<4:43:16,  3.46it/s]
 84%|████████▍ | 312644/371472 [2:42:33<4:49:06,  3.39it/s]
 84%|████████▍ | 312645/371472 [2:42:33<4:42:00,  3.48it/s]
 84%|████████▍ | 312646/371472 [2:42:33<5:16:12,  3.10it/s]
 84%|████████▍ | 312647/371472 [2:42:34<5:13:53,  3.12it/s]
 84%|████████▍ | 312648/371472 [2:42:34<4:51:37,  3.36it/s]
 84%|████████▍ | 312649/371472 [2:42:34<4:55:50,  3.31it/s]
 84%|████████▍ | 312650/371472 [2:42:34<4:33:38,  3.58it/s]
 84%|████████▍ | 312651/371472 [2:42:35<4:37:28,  3.53it/s]
 84%|████████▍ | 312652/371472 [2:42:35<4:29:15,  3.64it/s]
 84%|████████▍ | 312653/371472 [2:42:35<4:25:39,  3.69it/s]
 84%|████████▍ | 312654/371472 [2:42:36<4:24:43,  3.70it/s]
 84%|████████▍ | 312655/371472 [2:42:36<4:18:39,  3.79it/s]
 84%|████████▍ | 312656/371472 [2:42:36<4:15:01,  3.84it/s]
 84%|████████▍ | 312657/371472 [2:42:36<4:21:57,  3.74it/s]
 84%|████████▍ | 312658/371472 [2:42:37<4:23:13,  3.72it/s]
 84%|████████▍ | 312659/371472 [2:42:37<5:23:19,  3.03it/s]
 84%|████████▍ | 312660/371472 [2:42:37<5:15:49,  3.10it/s]
                                                           
{'loss': 2.5914, 'learning_rate': 2.4256609709323616e-07, 'epoch': 13.47}

 84%|████████▍ | 312660/371472 [2:42:37<5:15:49,  3.10it/s]
 84%|████████▍ | 312661/371472 [2:42:38<5:07:32,  3.19it/s]
 84%|████████▍ | 312662/371472 [2:42:38<4:49:18,  3.39it/s]
 84%|████████▍ | 312663/371472 [2:42:38<5:10:07,  3.16it/s]
 84%|████████▍ | 312664/371472 [2:42:39<5:09:37,  3.17it/s]
 84%|████████▍ | 312665/371472 [2:42:39<4:53:31,  3.34it/s]
 84%|████████▍ | 312666/371472 [2:42:39<4:44:06,  3.45it/s]
 84%|████████▍ | 312667/371472 [2:42:40<5:28:24,  2.98it/s]
 84%|████████▍ | 312668/371472 [2:42:40<4:58:10,  3.29it/s]
 84%|████████▍ | 312669/371472 [2:42:40<4:49:34,  3.38it/s]
 84%|████████▍ | 312670/371472 [2:42:40<4:58:35,  3.28it/s]
 84%|████████▍ | 312671/371472 [2:42:41<4:46:19,  3.42it/s]
 84%|████████▍ | 312672/371472 [2:42:41<4:32:40,  3.59it/s]
 84%|████████▍ | 312673/371472 [2:42:41<4:29:40,  3.63it/s]
 84%|████████▍ | 312674/371472 [2:42:41<4:32:32,  3.60it/s]
 84%|████████▍ | 312675/371472 [2:42:42<4:53:21,  3.34it/s]
 84%|████████▍ | 312676/371472 [2:42:42<4:43:12,  3.46it/s]
 84%|████████▍ | 312677/371472 [2:42:42<4:37:00,  3.54it/s]
 84%|████████▍ | 312678/371472 [2:42:43<4:24:58,  3.70it/s]
 84%|████████▍ | 312679/371472 [2:42:43<4:35:52,  3.55it/s]
 84%|████████▍ | 312680/371472 [2:42:43<4:41:55,  3.48it/s]
                                                           
{'loss': 2.4742, 'learning_rate': 2.4251761511775733e-07, 'epoch': 13.47}

 84%|████████▍ | 312680/371472 [2:42:43<4:41:55,  3.48it/s]
 84%|████████▍ | 312681/371472 [2:42:44<4:41:12,  3.48it/s]
 84%|████████▍ | 312682/371472 [2:42:44<4:36:50,  3.54it/s]
 84%|████████▍ | 312683/371472 [2:42:44<4:39:10,  3.51it/s]
 84%|████████▍ | 312684/371472 [2:42:44<4:37:58,  3.52it/s]
 84%|████████▍ | 312685/371472 [2:42:45<4:44:07,  3.45it/s]
 84%|████████▍ | 312686/371472 [2:42:45<4:34:54,  3.56it/s]
 84%|████████▍ | 312687/371472 [2:42:45<4:30:38,  3.62it/s]
 84%|████████▍ | 312688/371472 [2:42:45<4:32:13,  3.60it/s]
 84%|████████▍ | 312689/371472 [2:42:46<4:38:39,  3.52it/s]
 84%|████████▍ | 312690/371472 [2:42:46<4:28:23,  3.65it/s]
 84%|████████▍ | 312691/371472 [2:42:46<4:40:06,  3.50it/s]
 84%|████████▍ | 312692/371472 [2:42:47<4:33:59,  3.58it/s]
 84%|████████▍ | 312693/371472 [2:42:47<4:24:57,  3.70it/s]
 84%|████████▍ | 312694/371472 [2:42:47<4:32:06,  3.60it/s]
 84%|████████▍ | 312695/371472 [2:42:47<4:54:25,  3.33it/s]
 84%|████████▍ | 312696/371472 [2:42:48<4:47:03,  3.41it/s]
 84%|████████▍ | 312697/371472 [2:42:48<4:36:17,  3.55it/s]
 84%|████████▍ | 312698/371472 [2:42:48<4:51:05,  3.37it/s]
 84%|████████▍ | 312699/371472 [2:42:49<4:34:41,  3.57it/s]
 84%|████████▍ | 312700/371472 [2:42:49<4:26:52,  3.67it/s]
                                                           
{'loss': 2.6718, 'learning_rate': 2.424691331422784e-07, 'epoch': 13.47}

 84%|████████▍ | 312700/371472 [2:42:49<4:26:52,  3.67it/s]
 84%|████████▍ | 312701/371472 [2:42:49<4:30:53,  3.62it/s]
 84%|████████▍ | 312702/371472 [2:42:49<4:38:00,  3.52it/s]
 84%|████████▍ | 312703/371472 [2:42:50<4:25:39,  3.69it/s]
 84%|████████▍ | 312704/371472 [2:42:50<4:20:55,  3.75it/s]
 84%|████████▍ | 312705/371472 [2:42:50<4:26:16,  3.68it/s]
 84%|████████▍ | 312706/371472 [2:42:51<4:42:09,  3.47it/s]
 84%|████████▍ | 312707/371472 [2:42:51<4:57:54,  3.29it/s]
 84%|████████▍ | 312708/371472 [2:42:51<4:52:20,  3.35it/s]
 84%|████████▍ | 312709/371472 [2:42:51<4:47:48,  3.40it/s]
 84%|████████▍ | 312710/371472 [2:42:52<5:03:04,  3.23it/s]
 84%|████████▍ | 312711/371472 [2:42:52<4:47:50,  3.40it/s]
 84%|████████▍ | 312712/371472 [2:42:52<4:43:16,  3.46it/s]
 84%|████████▍ | 312713/371472 [2:42:53<4:40:05,  3.50it/s]
 84%|████████▍ | 312714/371472 [2:42:53<4:50:52,  3.37it/s]
 84%|████████▍ | 312715/371472 [2:42:53<4:47:42,  3.40it/s]
 84%|████████▍ | 312716/371472 [2:42:53<4:36:14,  3.54it/s]
 84%|████████▍ | 312717/371472 [2:42:54<4:29:56,  3.63it/s]
 84%|████████▍ | 312718/371472 [2:42:54<4:33:34,  3.58it/s]
 84%|████████▍ | 312719/371472 [2:42:54<4:35:14,  3.56it/s]
 84%|████████▍ | 312720/371472 [2:42:55<4:58:39,  3.28it/s]
                                                           
{'loss': 2.6461, 'learning_rate': 2.4242065116679953e-07, 'epoch': 13.47}

 84%|████████▍ | 312720/371472 [2:42:55<4:58:39,  3.28it/s]
 84%|████████▍ | 312721/371472 [2:42:55<4:56:16,  3.30it/s]
 84%|████████▍ | 312722/371472 [2:42:55<4:46:53,  3.41it/s]
 84%|████████▍ | 312723/371472 [2:42:56<4:44:17,  3.44it/s]
 84%|████████▍ | 312724/371472 [2:42:56<5:10:30,  3.15it/s]
 84%|████████▍ | 312725/371472 [2:42:56<5:14:37,  3.11it/s]
 84%|████████▍ | 312726/371472 [2:42:57<5:18:59,  3.07it/s]
 84%|████████▍ | 312727/371472 [2:42:57<5:06:34,  3.19it/s]
 84%|████████▍ | 312728/371472 [2:42:57<4:49:31,  3.38it/s]
 84%|████████▍ | 312729/371472 [2:42:57<4:41:14,  3.48it/s]
 84%|████████▍ | 312730/371472 [2:42:58<4:30:45,  3.62it/s]
 84%|████████▍ | 312731/371472 [2:42:58<4:41:37,  3.48it/s]
 84%|████████▍ | 312732/371472 [2:42:58<4:29:39,  3.63it/s]
 84%|████████▍ | 312733/371472 [2:42:58<4:26:00,  3.68it/s]
 84%|████████▍ | 312734/371472 [2:42:59<4:54:15,  3.33it/s]
 84%|████████▍ | 312735/371472 [2:42:59<4:38:08,  3.52it/s]
 84%|████████▍ | 312736/371472 [2:42:59<4:34:07,  3.57it/s]
 84%|████████▍ | 312737/371472 [2:43:00<4:25:29,  3.69it/s]
 84%|████████▍ | 312738/371472 [2:43:00<4:19:03,  3.78it/s]
 84%|████████▍ | 312739/371472 [2:43:00<4:18:18,  3.79it/s]
 84%|████████▍ | 312740/371472 [2:43:00<4:35:54,  3.55it/s]
                                                           
{'loss': 2.6569, 'learning_rate': 2.423721691913206e-07, 'epoch': 13.47}

 84%|████████▍ | 312740/371472 [2:43:00<4:35:54,  3.55it/s]
 84%|████████▍ | 312741/371472 [2:43:01<4:33:56,  3.57it/s]
 84%|████████▍ | 312742/371472 [2:43:01<4:39:19,  3.50it/s]
 84%|████████▍ | 312743/371472 [2:43:01<4:28:27,  3.65it/s]
 84%|████████▍ | 312744/371472 [2:43:01<4:23:27,  3.72it/s]
 84%|████████▍ | 312745/371472 [2:43:02<4:17:09,  3.81it/s]
 84%|████████▍ | 312746/371472 [2:43:02<4:31:13,  3.61it/s]
 84%|████████▍ | 312747/371472 [2:43:02<4:23:52,  3.71it/s]
 84%|████████▍ | 312748/371472 [2:43:03<4:18:28,  3.79it/s]
 84%|████████▍ | 312749/371472 [2:43:03<4:20:03,  3.76it/s]
 84%|████████▍ | 312750/371472 [2:43:03<4:34:59,  3.56it/s]
 84%|████████▍ | 312751/371472 [2:43:03<4:41:06,  3.48it/s]
 84%|████████▍ | 312752/371472 [2:43:04<4:41:41,  3.47it/s]
 84%|████████▍ | 312753/371472 [2:43:04<4:29:22,  3.63it/s]
 84%|████████▍ | 312754/371472 [2:43:04<4:24:52,  3.69it/s]
 84%|████████▍ | 312755/371472 [2:43:05<4:23:09,  3.72it/s]
 84%|████████▍ | 312756/371472 [2:43:05<4:22:12,  3.73it/s]
 84%|████████▍ | 312757/371472 [2:43:05<4:25:59,  3.68it/s]
 84%|████████▍ | 312758/371472 [2:43:05<4:35:58,  3.55it/s]
 84%|████████▍ | 312759/371472 [2:43:06<4:32:15,  3.59it/s]
 84%|████████▍ | 312760/371472 [2:43:06<4:30:14,  3.62it/s]
                                                           
{'loss': 2.609, 'learning_rate': 2.423236872158417e-07, 'epoch': 13.47}

 84%|████████▍ | 312760/371472 [2:43:06<4:30:14,  3.62it/s]
 84%|████████▍ | 312761/371472 [2:43:06<4:34:22,  3.57it/s]
 84%|████████▍ | 312762/371472 [2:43:06<4:39:01,  3.51it/s]
 84%|████████▍ | 312763/371472 [2:43:07<4:37:32,  3.53it/s]
 84%|████████▍ | 312764/371472 [2:43:07<4:34:41,  3.56it/s]
 84%|████████▍ | 312765/371472 [2:43:07<4:22:23,  3.73it/s]
 84%|████████▍ | 312766/371472 [2:43:08<4:24:26,  3.70it/s]
 84%|████████▍ | 312767/371472 [2:43:08<4:21:52,  3.74it/s]
 84%|████████▍ | 312768/371472 [2:43:08<4:20:21,  3.76it/s]
 84%|████████▍ | 312769/371472 [2:43:08<4:18:09,  3.79it/s]
 84%|████████▍ | 312770/371472 [2:43:09<4:15:54,  3.82it/s]
 84%|████████▍ | 312771/371472 [2:43:09<4:29:06,  3.64it/s]
 84%|████████▍ | 312772/371472 [2:43:09<4:49:40,  3.38it/s]
 84%|████████▍ | 312773/371472 [2:43:10<4:43:21,  3.45it/s]
 84%|████████▍ | 312774/371472 [2:43:10<4:45:05,  3.43it/s]
 84%|████████▍ | 312775/371472 [2:43:10<4:44:36,  3.44it/s]
 84%|████████▍ | 312776/371472 [2:43:10<4:51:38,  3.35it/s]
 84%|████████▍ | 312777/371472 [2:43:11<4:43:28,  3.45it/s]
 84%|████████▍ | 312778/371472 [2:43:11<4:58:45,  3.27it/s]
 84%|████████▍ | 312779/371472 [2:43:11<5:15:51,  3.10it/s]
 84%|████████▍ | 312780/371472 [2:43:12<4:57:32,  3.29it/s]
                                                           
{'loss': 2.5955, 'learning_rate': 2.422752052403628e-07, 'epoch': 13.47}

 84%|████████▍ | 312780/371472 [2:43:12<4:57:32,  3.29it/s]
 84%|████████▍ | 312781/371472 [2:43:12<4:55:25,  3.31it/s]
 84%|████████▍ | 312782/371472 [2:43:12<4:51:43,  3.35it/s]
 84%|████████▍ | 312783/371472 [2:43:13<5:01:55,  3.24it/s]
 84%|████████▍ | 312784/371472 [2:43:13<4:46:27,  3.41it/s]
 84%|████████▍ | 312785/371472 [2:43:13<4:29:48,  3.63it/s]
 84%|████████▍ | 312786/371472 [2:43:13<4:23:51,  3.71it/s]
 84%|████████▍ | 312787/371472 [2:43:14<4:19:07,  3.77it/s]
 84%|████████▍ | 312788/371472 [2:43:14<4:11:29,  3.89it/s]
 84%|████████▍ | 312789/371472 [2:43:14<4:27:20,  3.66it/s]
 84%|████████▍ | 312790/371472 [2:43:14<4:23:32,  3.71it/s]
 84%|████████▍ | 312791/371472 [2:43:15<4:19:38,  3.77it/s]
 84%|████████▍ | 312792/371472 [2:43:15<4:13:33,  3.86it/s]
 84%|████████▍ | 312793/371472 [2:43:15<4:17:19,  3.80it/s]
 84%|████████▍ | 312794/371472 [2:43:15<4:17:50,  3.79it/s]
 84%|████████▍ | 312795/371472 [2:43:16<4:31:22,  3.60it/s]
 84%|████████▍ | 312796/371472 [2:43:16<4:32:41,  3.59it/s]
 84%|████████▍ | 312797/371472 [2:43:16<4:34:41,  3.56it/s]
 84%|████████▍ | 312798/371472 [2:43:17<4:30:45,  3.61it/s]
 84%|████████▍ | 312799/371472 [2:43:17<4:42:02,  3.47it/s]
 84%|████████▍ | 312800/371472 [2:43:17<4:43:28,  3.45it/s]
                                                           
{'loss': 2.7272, 'learning_rate': 2.42226723264884e-07, 'epoch': 13.47}

 84%|████████▍ | 312800/371472 [2:43:17<4:43:28,  3.45it/s]
 84%|████████▍ | 312801/371472 [2:43:17<4:38:50,  3.51it/s]
 84%|████████▍ | 312802/371472 [2:43:18<4:27:21,  3.66it/s]
 84%|████████▍ | 312803/371472 [2:43:18<4:28:30,  3.64it/s]
 84%|████████▍ | 312804/371472 [2:43:18<4:27:24,  3.66it/s]
 84%|████████▍ | 312805/371472 [2:43:19<4:36:20,  3.54it/s]
 84%|████████▍ | 312806/371472 [2:43:19<4:39:15,  3.50it/s]
 84%|████████▍ | 312807/371472 [2:43:19<4:28:23,  3.64it/s]
 84%|████████▍ | 312808/371472 [2:43:19<4:32:38,  3.59it/s]
 84%|████████▍ | 312809/371472 [2:43:20<4:37:35,  3.52it/s]
 84%|████████▍ | 312810/371472 [2:43:20<4:30:32,  3.61it/s]
 84%|████████▍ | 312811/371472 [2:43:20<4:48:24,  3.39it/s]
 84%|████████▍ | 312812/371472 [2:43:21<4:45:36,  3.42it/s]
 84%|████████▍ | 312813/371472 [2:43:21<5:09:34,  3.16it/s]
 84%|████████▍ | 312814/371472 [2:43:21<5:01:10,  3.25it/s]
 84%|████████▍ | 312815/371472 [2:43:21<4:49:43,  3.37it/s]
 84%|████████▍ | 312816/371472 [2:43:22<4:40:21,  3.49it/s]
 84%|████████▍ | 312817/371472 [2:43:22<4:37:44,  3.52it/s]
 84%|████████▍ | 312818/371472 [2:43:22<4:38:44,  3.51it/s]
 84%|████████▍ | 312819/371472 [2:43:23<4:35:54,  3.54it/s]
 84%|████████▍ | 312820/371472 [2:43:23<4:30:11,  3.62it/s]
                                                           
{'loss': 2.6852, 'learning_rate': 2.4217824128940505e-07, 'epoch': 13.47}

 84%|████████▍ | 312820/371472 [2:43:23<4:30:11,  3.62it/s]
 84%|████████▍ | 312821/371472 [2:43:23<4:29:17,  3.63it/s]
 84%|████████▍ | 312822/371472 [2:43:23<4:27:16,  3.66it/s]
 84%|████████▍ | 312823/371472 [2:43:24<4:37:40,  3.52it/s]
 84%|████████▍ | 312824/371472 [2:43:24<4:46:54,  3.41it/s]
 84%|████████▍ | 312825/371472 [2:43:24<4:42:26,  3.46it/s]
 84%|████████▍ | 312826/371472 [2:43:25<4:41:58,  3.47it/s]
 84%|████████▍ | 312827/371472 [2:43:25<4:29:41,  3.62it/s]
 84%|████████▍ | 312828/371472 [2:43:25<4:30:32,  3.61it/s]
 84%|████████▍ | 312829/371472 [2:43:25<4:35:18,  3.55it/s]
 84%|████████▍ | 312830/371472 [2:43:26<4:41:06,  3.48it/s]
 84%|████████▍ | 312831/371472 [2:43:26<5:00:53,  3.25it/s]
 84%|████████▍ | 312832/371472 [2:43:26<4:53:09,  3.33it/s]
 84%|████████▍ | 312833/371472 [2:43:27<4:37:36,  3.52it/s]
 84%|████████▍ | 312834/371472 [2:43:27<4:44:55,  3.43it/s]
 84%|████████▍ | 312835/371472 [2:43:27<4:42:17,  3.46it/s]
 84%|████████▍ | 312836/371472 [2:43:27<4:36:55,  3.53it/s]
 84%|████████▍ | 312837/371472 [2:43:28<4:23:36,  3.71it/s]
 84%|████████▍ | 312838/371472 [2:43:28<4:17:37,  3.79it/s]
 84%|████████▍ | 312839/371472 [2:43:28<4:23:55,  3.70it/s]
 84%|████████▍ | 312840/371472 [2:43:29<4:29:55,  3.62it/s]
                                                           
{'loss': 2.5584, 'learning_rate': 2.421297593139262e-07, 'epoch': 13.47}

 84%|████████▍ | 312840/371472 [2:43:29<4:29:55,  3.62it/s]
 84%|████████▍ | 312841/371472 [2:43:29<4:26:06,  3.67it/s]
 84%|████████▍ | 312842/371472 [2:43:29<4:25:41,  3.68it/s]
 84%|████████▍ | 312843/371472 [2:43:29<4:21:58,  3.73it/s]
 84%|████████▍ | 312844/371472 [2:43:30<4:27:46,  3.65it/s]
 84%|████████▍ | 312845/371472 [2:43:30<4:26:21,  3.67it/s]
 84%|████████▍ | 312846/371472 [2:43:30<4:18:17,  3.78it/s]
 84%|████████▍ | 312847/371472 [2:43:30<4:45:00,  3.43it/s]
 84%|████████▍ | 312848/371472 [2:43:31<4:55:07,  3.31it/s]
 84%|████████▍ | 312849/371472 [2:43:31<4:50:07,  3.37it/s]
 84%|████████▍ | 312850/371472 [2:43:31<4:59:09,  3.27it/s]
 84%|████████▍ | 312851/371472 [2:43:32<4:47:45,  3.40it/s]
 84%|████████▍ | 312852/371472 [2:43:32<4:41:00,  3.48it/s]
 84%|████████▍ | 312853/371472 [2:43:32<4:43:33,  3.45it/s]
 84%|████████▍ | 312854/371472 [2:43:32<4:26:40,  3.66it/s]
 84%|████████▍ | 312855/371472 [2:43:33<4:31:15,  3.60it/s]
 84%|████████▍ | 312856/371472 [2:43:33<4:44:24,  3.43it/s]
 84%|████████▍ | 312857/371472 [2:43:33<4:46:08,  3.41it/s]
 84%|████████▍ | 312858/371472 [2:43:34<4:29:36,  3.62it/s]
 84%|████████▍ | 312859/371472 [2:43:34<4:35:52,  3.54it/s]
 84%|████████▍ | 312860/371472 [2:43:34<4:41:25,  3.47it/s]
                                                           
{'loss': 2.6021, 'learning_rate': 2.4208127733844724e-07, 'epoch': 13.48}

 84%|████████▍ | 312860/371472 [2:43:34<4:41:25,  3.47it/s]
 84%|████████▍ | 312861/371472 [2:43:34<4:34:20,  3.56it/s]
 84%|████████▍ | 312862/371472 [2:43:35<4:52:55,  3.33it/s]
 84%|████████▍ | 312863/371472 [2:43:35<4:38:11,  3.51it/s]
 84%|████████▍ | 312864/371472 [2:43:35<4:38:49,  3.50it/s]
 84%|████████▍ | 312865/371472 [2:43:36<4:36:51,  3.53it/s]
 84%|████████▍ | 312866/371472 [2:43:36<4:44:15,  3.44it/s]
 84%|████████▍ | 312867/371472 [2:43:36<4:42:46,  3.45it/s]
 84%|████████▍ | 312868/371472 [2:43:36<4:29:02,  3.63it/s]
 84%|████████▍ | 312869/371472 [2:43:37<4:37:43,  3.52it/s]
 84%|████████▍ | 312870/371472 [2:43:37<4:48:55,  3.38it/s]
 84%|████████▍ | 312871/371472 [2:43:37<4:32:13,  3.59it/s]
 84%|████████▍ | 312872/371472 [2:43:38<4:27:41,  3.65it/s]
 84%|████████▍ | 312873/371472 [2:43:38<4:27:39,  3.65it/s]
 84%|████████▍ | 312874/371472 [2:43:38<4:21:20,  3.74it/s]
 84%|████████▍ | 312875/371472 [2:43:38<4:21:38,  3.73it/s]
 84%|████████▍ | 312876/371472 [2:43:39<4:19:01,  3.77it/s]
 84%|████████▍ | 312877/371472 [2:43:39<4:12:31,  3.87it/s]
 84%|████████▍ | 312878/371472 [2:43:39<4:10:41,  3.90it/s]
 84%|████████▍ | 312879/371472 [2:43:39<4:11:14,  3.89it/s]
 84%|████████▍ | 312880/371472 [2:43:40<4:40:39,  3.48it/s]
                                                           
{'loss': 2.5985, 'learning_rate': 2.4203279536296837e-07, 'epoch': 13.48}

 84%|████████▍ | 312880/371472 [2:43:40<4:40:39,  3.48it/s]
 84%|████████▍ | 312881/371472 [2:43:40<4:39:32,  3.49it/s]
 84%|████████▍ | 312882/371472 [2:43:40<4:35:45,  3.54it/s]
 84%|████████▍ | 312883/371472 [2:43:41<4:34:05,  3.56it/s]
 84%|████████▍ | 312884/371472 [2:43:41<4:24:14,  3.70it/s]
 84%|████████▍ | 312885/371472 [2:43:41<4:54:41,  3.31it/s]
 84%|████████▍ | 312886/371472 [2:43:41<4:43:24,  3.45it/s]
 84%|████████▍ | 312887/371472 [2:43:42<4:40:44,  3.48it/s]
 84%|████████▍ | 312888/371472 [2:43:42<4:35:51,  3.54it/s]
 84%|████████▍ | 312889/371472 [2:43:42<4:36:34,  3.53it/s]
 84%|████████▍ | 312890/371472 [2:43:43<4:31:29,  3.60it/s]
 84%|████████▍ | 312891/371472 [2:43:43<4:32:39,  3.58it/s]
 84%|████████▍ | 312892/371472 [2:43:43<4:39:42,  3.49it/s]
 84%|████████▍ | 312893/371472 [2:43:44<4:51:00,  3.35it/s]
 84%|████████▍ | 312894/371472 [2:43:44<4:48:56,  3.38it/s]
 84%|████████▍ | 312895/371472 [2:43:44<5:03:21,  3.22it/s]
 84%|████████▍ | 312896/371472 [2:43:44<5:02:13,  3.23it/s]
 84%|████████▍ | 312897/371472 [2:43:45<4:46:19,  3.41it/s]
 84%|████████▍ | 312898/371472 [2:43:45<4:54:30,  3.31it/s]
 84%|████████▍ | 312899/371472 [2:43:45<4:59:22,  3.26it/s]
 84%|████████▍ | 312900/371472 [2:43:46<4:48:53,  3.38it/s]
                                                           
{'loss': 2.697, 'learning_rate': 2.4198431338748944e-07, 'epoch': 13.48}

 84%|████████▍ | 312900/371472 [2:43:46<4:48:53,  3.38it/s]
 84%|████████▍ | 312901/371472 [2:43:46<4:45:22,  3.42it/s]
 84%|████████▍ | 312902/371472 [2:43:46<4:51:16,  3.35it/s]
 84%|████████▍ | 312903/371472 [2:43:46<4:43:31,  3.44it/s]
 84%|████████▍ | 312904/371472 [2:43:47<4:48:32,  3.38it/s]
 84%|████████▍ | 312905/371472 [2:43:47<4:31:19,  3.60it/s]
 84%|████████▍ | 312906/371472 [2:43:47<4:30:10,  3.61it/s]
 84%|████████▍ | 312907/371472 [2:43:48<4:33:30,  3.57it/s]
 84%|████████▍ | 312908/371472 [2:43:48<4:19:38,  3.76it/s]
 84%|████████▍ | 312909/371472 [2:43:48<4:17:36,  3.79it/s]
 84%|████████▍ | 312910/371472 [2:43:48<4:18:39,  3.77it/s]
 84%|████████▍ | 312911/371472 [2:43:49<4:12:12,  3.87it/s]
 84%|████████▍ | 312912/371472 [2:43:49<4:30:44,  3.60it/s]
 84%|████████▍ | 312913/371472 [2:43:49<4:34:56,  3.55it/s]
 84%|████████▍ | 312914/371472 [2:43:49<4:29:27,  3.62it/s]
 84%|████████▍ | 312915/371472 [2:43:50<4:18:51,  3.77it/s]
 84%|████████▍ | 312916/371472 [2:43:50<4:22:22,  3.72it/s]
 84%|████████▍ | 312917/371472 [2:43:50<4:21:49,  3.73it/s]
 84%|████████▍ | 312918/371472 [2:43:51<4:20:01,  3.75it/s]
 84%|████████▍ | 312919/371472 [2:43:51<4:44:52,  3.43it/s]
 84%|████████▍ | 312920/371472 [2:43:51<4:26:46,  3.66it/s]
                                                           
{'loss': 2.8035, 'learning_rate': 2.419358314120106e-07, 'epoch': 13.48}

 84%|████████▍ | 312920/371472 [2:43:51<4:26:46,  3.66it/s]
 84%|████████▍ | 312921/371472 [2:43:51<4:22:53,  3.71it/s]
 84%|████████▍ | 312922/371472 [2:43:52<4:21:46,  3.73it/s]
 84%|████████▍ | 312923/371472 [2:43:52<4:31:27,  3.59it/s]
 84%|████████▍ | 312924/371472 [2:43:52<4:28:17,  3.64it/s]
 84%|████████▍ | 312925/371472 [2:43:52<4:34:16,  3.56it/s]
 84%|████████▍ | 312926/371472 [2:43:53<4:56:55,  3.29it/s]
 84%|████████▍ | 312927/371472 [2:43:53<4:41:13,  3.47it/s]
 84%|████████▍ | 312928/371472 [2:43:53<4:32:39,  3.58it/s]
 84%|████████▍ | 312929/371472 [2:43:54<4:31:55,  3.59it/s]
 84%|████████▍ | 312930/371472 [2:43:54<4:30:44,  3.60it/s]
 84%|████████▍ | 312931/371472 [2:43:54<4:22:11,  3.72it/s]
 84%|████████▍ | 312932/371472 [2:43:54<4:21:27,  3.73it/s]
 84%|████████▍ | 312933/371472 [2:43:55<4:24:49,  3.68it/s]
 84%|████████▍ | 312934/371472 [2:43:55<4:20:30,  3.75it/s]
 84%|████████▍ | 312935/371472 [2:43:55<4:14:07,  3.84it/s]
 84%|████████▍ | 312936/371472 [2:43:56<4:29:30,  3.62it/s]
 84%|████████▍ | 312937/371472 [2:43:56<4:28:33,  3.63it/s]
 84%|████████▍ | 312938/371472 [2:43:56<4:37:40,  3.51it/s]
 84%|████████▍ | 312939/371472 [2:43:56<4:32:45,  3.58it/s]
 84%|████████▍ | 312940/371472 [2:43:57<4:29:37,  3.62it/s]
                                                           
{'loss': 2.6354, 'learning_rate': 2.418873494365317e-07, 'epoch': 13.48}

 84%|████████▍ | 312940/371472 [2:43:57<4:29:37,  3.62it/s]
 84%|████████▍ | 312941/371472 [2:43:57<4:34:21,  3.56it/s]
 84%|████████▍ | 312942/371472 [2:43:57<4:28:10,  3.64it/s]
 84%|████████▍ | 312943/371472 [2:43:57<4:36:20,  3.53it/s]
 84%|████████▍ | 312944/371472 [2:43:58<4:30:39,  3.60it/s]
 84%|████████▍ | 312945/371472 [2:43:58<4:33:49,  3.56it/s]
 84%|████████▍ | 312946/371472 [2:43:58<4:41:51,  3.46it/s]
 84%|████████▍ | 312947/371472 [2:43:59<4:43:55,  3.44it/s]
 84%|████████▍ | 312948/371472 [2:43:59<4:47:02,  3.40it/s]
 84%|████████▍ | 312949/371472 [2:43:59<4:33:57,  3.56it/s]
 84%|████████▍ | 312950/371472 [2:44:00<4:42:15,  3.46it/s]
 84%|████████▍ | 312951/371472 [2:44:00<4:31:29,  3.59it/s]
 84%|████████▍ | 312952/371472 [2:44:00<4:21:16,  3.73it/s]
 84%|████████▍ | 312953/371472 [2:44:00<4:22:21,  3.72it/s]
 84%|████████▍ | 312954/371472 [2:44:01<4:22:37,  3.71it/s]
 84%|████████▍ | 312955/371472 [2:44:01<4:19:57,  3.75it/s]
 84%|████████▍ | 312956/371472 [2:44:01<4:36:26,  3.53it/s]
 84%|████████▍ | 312957/371472 [2:44:01<4:37:10,  3.52it/s]
 84%|████████▍ | 312958/371472 [2:44:02<4:49:37,  3.37it/s]
 84%|████████▍ | 312959/371472 [2:44:02<4:51:00,  3.35it/s]
 84%|████████▍ | 312960/371472 [2:44:02<4:55:14,  3.30it/s]
                                                           
{'loss': 2.6125, 'learning_rate': 2.4183886746105286e-07, 'epoch': 13.48}

 84%|████████▍ | 312960/371472 [2:44:02<4:55:14,  3.30it/s]
 84%|████████▍ | 312961/371472 [2:44:03<4:56:06,  3.29it/s]
 84%|████████▍ | 312962/371472 [2:44:03<5:03:00,  3.22it/s]
 84%|████████▍ | 312963/371472 [2:44:03<4:49:58,  3.36it/s]
 84%|████████▍ | 312964/371472 [2:44:04<4:50:23,  3.36it/s]
 84%|████████▍ | 312965/371472 [2:44:04<4:42:42,  3.45it/s]
 84%|████████▍ | 312966/371472 [2:44:04<4:43:20,  3.44it/s]
 84%|████████▍ | 312967/371472 [2:44:04<4:42:05,  3.46it/s]
 84%|████████▍ | 312968/371472 [2:44:05<4:32:32,  3.58it/s]
 84%|████████▍ | 312969/371472 [2:44:05<4:26:08,  3.66it/s]
 84%|████████▍ | 312970/371472 [2:44:05<4:24:30,  3.69it/s]
 84%|████████▍ | 312971/371472 [2:44:05<4:37:03,  3.52it/s]
 84%|████████▍ | 312972/371472 [2:44:06<5:05:14,  3.19it/s]
 84%|████████▍ | 312973/371472 [2:44:06<4:56:01,  3.29it/s]
 84%|████████▍ | 312974/371472 [2:44:06<4:51:07,  3.35it/s]
 84%|████████▍ | 312975/371472 [2:44:07<4:39:45,  3.48it/s]
 84%|████████▍ | 312976/371472 [2:44:07<4:33:56,  3.56it/s]
 84%|████████▍ | 312977/371472 [2:44:07<4:24:49,  3.68it/s]
 84%|████████▍ | 312978/371472 [2:44:07<4:17:39,  3.78it/s]
 84%|████████▍ | 312979/371472 [2:44:08<4:25:59,  3.67it/s]
 84%|████████▍ | 312980/371472 [2:44:08<4:18:13,  3.78it/s]
                                                           
{'loss': 2.5651, 'learning_rate': 2.417903854855739e-07, 'epoch': 13.48}

 84%|████████▍ | 312980/371472 [2:44:08<4:18:13,  3.78it/s]
 84%|████████▍ | 312981/371472 [2:44:08<4:29:56,  3.61it/s]
 84%|████████▍ | 312982/371472 [2:44:09<4:26:25,  3.66it/s]
 84%|████████▍ | 312983/371472 [2:44:09<4:37:30,  3.51it/s]
 84%|████████▍ | 312984/371472 [2:44:09<4:35:43,  3.54it/s]
 84%|████████▍ | 312985/371472 [2:44:09<4:27:19,  3.65it/s]
 84%|████████▍ | 312986/371472 [2:44:10<4:23:00,  3.71it/s]
 84%|████████▍ | 312987/371472 [2:44:10<4:20:11,  3.75it/s]
 84%|████████▍ | 312988/371472 [2:44:10<4:29:03,  3.62it/s]
 84%|████████▍ | 312989/371472 [2:44:10<4:18:57,  3.76it/s]
 84%|████████▍ | 312990/371472 [2:44:11<4:19:00,  3.76it/s]
 84%|████████▍ | 312991/371472 [2:44:11<4:33:35,  3.56it/s]
 84%|████████▍ | 312992/371472 [2:44:11<4:34:51,  3.55it/s]
 84%|████████▍ | 312993/371472 [2:44:12<4:33:17,  3.57it/s]
 84%|████████▍ | 312994/371472 [2:44:12<4:26:37,  3.66it/s]
 84%|████████▍ | 312995/371472 [2:44:12<4:19:09,  3.76it/s]
 84%|████████▍ | 312996/371472 [2:44:12<4:15:42,  3.81it/s]
 84%|████████▍ | 312997/371472 [2:44:13<4:18:49,  3.77it/s]
 84%|████████▍ | 312998/371472 [2:44:13<4:22:34,  3.71it/s]
 84%|████████▍ | 312999/371472 [2:44:13<4:29:47,  3.61it/s]
 84%|████████▍ | 313000/371472 [2:44:14<5:09:30,  3.15it/s]
                                                           
{'loss': 2.546, 'learning_rate': 2.41741903510095e-07, 'epoch': 13.48}

 84%|████████▍ | 313000/371472 [2:44:14<5:09:30,  3.15it/s]
 84%|████████▍ | 313001/371472 [2:44:14<5:18:54,  3.06it/s]
 84%|████████▍ | 313002/371472 [2:44:14<5:06:06,  3.18it/s]
 84%|████████▍ | 313003/371472 [2:44:15<5:01:46,  3.23it/s]
 84%|████████▍ | 313004/371472 [2:44:15<4:53:41,  3.32it/s]
 84%|████████▍ | 313005/371472 [2:44:15<5:08:39,  3.16it/s]
 84%|████████▍ | 313006/371472 [2:44:15<4:51:26,  3.34it/s]
 84%|████████▍ | 313007/371472 [2:44:16<4:51:16,  3.35it/s]
 84%|████████▍ | 313008/371472 [2:44:16<4:46:16,  3.40it/s]
 84%|████████▍ | 313009/371472 [2:44:16<4:43:37,  3.44it/s]
 84%|████████▍ | 313010/371472 [2:44:17<4:36:04,  3.53it/s]
 84%|████████▍ | 313011/371472 [2:44:17<4:47:26,  3.39it/s]
 84%|████████▍ | 313012/371472 [2:44:17<4:38:08,  3.50it/s]
 84%|████████▍ | 313013/371472 [2:44:17<4:32:30,  3.58it/s]
 84%|████████▍ | 313014/371472 [2:44:18<4:43:11,  3.44it/s]
 84%|████████▍ | 313015/371472 [2:44:18<4:59:55,  3.25it/s]
 84%|████████▍ | 313016/371472 [2:44:18<4:54:33,  3.31it/s]
 84%|████████▍ | 313017/371472 [2:44:19<4:41:26,  3.46it/s]
 84%|████████▍ | 313018/371472 [2:44:19<4:38:57,  3.49it/s]
 84%|████████▍ | 313019/371472 [2:44:19<4:44:26,  3.42it/s]
 84%|████████▍ | 313020/371472 [2:44:20<4:36:40,  3.52it/s]
                                                           
{'loss': 2.6106, 'learning_rate': 2.416934215346161e-07, 'epoch': 13.48}

 84%|████████▍ | 313020/371472 [2:44:20<4:36:40,  3.52it/s]
 84%|████████▍ | 313021/371472 [2:44:20<4:35:18,  3.54it/s]
 84%|████████▍ | 313022/371472 [2:44:20<4:31:38,  3.59it/s]
 84%|████████▍ | 313023/371472 [2:44:20<5:12:01,  3.12it/s]
 84%|████████▍ | 313024/371472 [2:44:21<5:08:33,  3.16it/s]
 84%|████████▍ | 313025/371472 [2:44:21<4:53:38,  3.32it/s]
 84%|████████▍ | 313026/371472 [2:44:22<5:35:53,  2.90it/s]
 84%|████████▍ | 313027/371472 [2:44:22<5:13:32,  3.11it/s]
 84%|████████▍ | 313028/371472 [2:44:22<5:12:11,  3.12it/s]
 84%|████████▍ | 313029/371472 [2:44:22<5:38:19,  2.88it/s]
 84%|████████▍ | 313030/371472 [2:44:23<5:13:40,  3.11it/s]
 84%|████████▍ | 313031/371472 [2:44:23<4:59:39,  3.25it/s]
 84%|████████▍ | 313032/371472 [2:44:23<5:02:56,  3.22it/s]
 84%|████████▍ | 313033/371472 [2:44:24<4:48:56,  3.37it/s]
 84%|████████▍ | 313034/371472 [2:44:24<4:38:47,  3.49it/s]
 84%|████████▍ | 313035/371472 [2:44:24<4:32:09,  3.58it/s]
 84%|████████▍ | 313036/371472 [2:44:24<4:26:46,  3.65it/s]
 84%|████████▍ | 313037/371472 [2:44:25<4:23:26,  3.70it/s]
 84%|████████▍ | 313038/371472 [2:44:25<4:39:49,  3.48it/s]
 84%|████████▍ | 313039/371472 [2:44:25<4:50:00,  3.36it/s]
 84%|████████▍ | 313040/371472 [2:44:26<4:51:27,  3.34it/s]
                                                           
{'loss': 2.6122, 'learning_rate': 2.4164493955913726e-07, 'epoch': 13.48}

 84%|████████▍ | 313040/371472 [2:44:26<4:51:27,  3.34it/s]
 84%|████████▍ | 313041/371472 [2:44:26<4:45:54,  3.41it/s]
 84%|████████▍ | 313042/371472 [2:44:26<4:43:14,  3.44it/s]
 84%|████████▍ | 313043/371472 [2:44:27<4:55:46,  3.29it/s]
 84%|████████▍ | 313044/371472 [2:44:27<4:41:25,  3.46it/s]
 84%|████████▍ | 313045/371472 [2:44:27<4:40:12,  3.48it/s]
 84%|████████▍ | 313046/371472 [2:44:27<4:31:15,  3.59it/s]
 84%|████████▍ | 313047/371472 [2:44:28<4:27:33,  3.64it/s]
 84%|████████▍ | 313048/371472 [2:44:28<4:32:48,  3.57it/s]
 84%|████████▍ | 313049/371472 [2:44:28<4:45:30,  3.41it/s]
 84%|████████▍ | 313050/371472 [2:44:29<5:02:46,  3.22it/s]
 84%|████████▍ | 313051/371472 [2:44:29<5:13:25,  3.11it/s]
 84%|████████▍ | 313052/371472 [2:44:29<5:00:31,  3.24it/s]
 84%|████████▍ | 313053/371472 [2:44:29<4:50:04,  3.36it/s]
 84%|████████▍ | 313054/371472 [2:44:30<5:01:29,  3.23it/s]
 84%|████████▍ | 313055/371472 [2:44:30<4:45:39,  3.41it/s]
 84%|████████▍ | 313056/371472 [2:44:30<4:32:13,  3.58it/s]
 84%|████████▍ | 313057/371472 [2:44:31<4:31:41,  3.58it/s]
 84%|████████▍ | 313058/371472 [2:44:31<4:26:24,  3.65it/s]
 84%|████████▍ | 313059/371472 [2:44:31<4:15:48,  3.81it/s]
 84%|████████▍ | 313060/371472 [2:44:31<4:25:42,  3.66it/s]
                                                           
{'loss': 2.5376, 'learning_rate': 2.4159645758365833e-07, 'epoch': 13.48}

 84%|████████▍ | 313060/371472 [2:44:31<4:25:42,  3.66it/s]
 84%|████████▍ | 313061/371472 [2:44:32<4:22:47,  3.70it/s]
 84%|████████▍ | 313062/371472 [2:44:32<4:14:48,  3.82it/s]
 84%|████████▍ | 313063/371472 [2:44:32<4:41:53,  3.45it/s]
 84%|████████▍ | 313064/371472 [2:44:32<4:36:21,  3.52it/s]
 84%|████████▍ | 313065/371472 [2:44:33<4:41:16,  3.46it/s]
 84%|████████▍ | 313066/371472 [2:44:33<4:37:50,  3.50it/s]
 84%|████████▍ | 313067/371472 [2:44:33<4:53:08,  3.32it/s]
 84%|████████▍ | 313068/371472 [2:44:34<4:45:27,  3.41it/s]
 84%|████████▍ | 313069/371472 [2:44:34<4:35:32,  3.53it/s]
 84%|████████▍ | 313070/371472 [2:44:34<4:27:58,  3.63it/s]
 84%|████████▍ | 313071/371472 [2:44:34<4:28:05,  3.63it/s]
 84%|████████▍ | 313072/371472 [2:44:35<4:35:26,  3.53it/s]
 84%|████████▍ | 313073/371472 [2:44:35<4:30:20,  3.60it/s]
 84%|████████▍ | 313074/371472 [2:44:35<4:46:50,  3.39it/s]
 84%|████████▍ | 313075/371472 [2:44:36<4:36:01,  3.53it/s]
 84%|████████▍ | 313076/371472 [2:44:36<4:24:45,  3.68it/s]
 84%|████████▍ | 313077/371472 [2:44:36<4:30:36,  3.60it/s]
 84%|████████▍ | 313078/371472 [2:44:36<4:39:51,  3.48it/s]
 84%|████████▍ | 313079/371472 [2:44:37<4:33:58,  3.55it/s]
 84%|████████▍ | 313080/371472 [2:44:37<4:24:48,  3.68it/s]
                                                           
{'loss': 2.708, 'learning_rate': 2.415479756081795e-07, 'epoch': 13.48}

 84%|████████▍ | 313080/371472 [2:44:37<4:24:48,  3.68it/s]
 84%|████████▍ | 313081/371472 [2:44:37<4:29:08,  3.62it/s]
 84%|████████▍ | 313082/371472 [2:44:38<4:36:56,  3.51it/s]
 84%|████████▍ | 313083/371472 [2:44:38<4:35:10,  3.54it/s]
 84%|████████▍ | 313084/371472 [2:44:38<4:46:00,  3.40it/s]
 84%|████████▍ | 313085/371472 [2:44:38<4:33:41,  3.56it/s]
 84%|████████▍ | 313086/371472 [2:44:39<4:41:08,  3.46it/s]
 84%|████████▍ | 313087/371472 [2:44:39<4:34:51,  3.54it/s]
 84%|████████▍ | 313088/371472 [2:44:39<4:39:36,  3.48it/s]
 84%|████████▍ | 313089/371472 [2:44:40<4:40:57,  3.46it/s]
 84%|████████▍ | 313090/371472 [2:44:40<4:53:49,  3.31it/s]
 84%|████████▍ | 313091/371472 [2:44:40<4:52:35,  3.33it/s]
 84%|████████▍ | 313092/371472 [2:44:40<4:41:03,  3.46it/s]
 84%|████████▍ | 313093/371472 [2:44:41<4:39:09,  3.49it/s]
 84%|████████▍ | 313094/371472 [2:44:41<4:39:02,  3.49it/s]
 84%|████████▍ | 313095/371472 [2:44:41<4:34:55,  3.54it/s]
 84%|████████▍ | 313096/371472 [2:44:42<4:35:29,  3.53it/s]
 84%|████████▍ | 313097/371472 [2:44:42<4:28:40,  3.62it/s]
 84%|████████▍ | 313098/371472 [2:44:42<4:30:12,  3.60it/s]
 84%|████████▍ | 313099/371472 [2:44:42<4:31:23,  3.58it/s]
 84%|████████▍ | 313100/371472 [2:44:43<4:31:23,  3.58it/s]
                                                           
{'loss': 2.5406, 'learning_rate': 2.414994936327005e-07, 'epoch': 13.49}

 84%|████████▍ | 313100/371472 [2:44:43<4:31:23,  3.58it/s]
 84%|████████▍ | 313101/371472 [2:44:43<4:26:39,  3.65it/s]
 84%|████████▍ | 313102/371472 [2:44:43<4:26:57,  3.64it/s]
 84%|████████▍ | 313103/371472 [2:44:44<4:50:28,  3.35it/s]
 84%|████████▍ | 313104/371472 [2:44:44<4:33:21,  3.56it/s]
 84%|████████▍ | 313105/371472 [2:44:44<4:49:00,  3.37it/s]
 84%|████████▍ | 313106/371472 [2:44:44<4:32:00,  3.58it/s]
 84%|████████▍ | 313107/371472 [2:44:45<4:42:44,  3.44it/s]
 84%|████████▍ | 313108/371472 [2:44:45<4:42:48,  3.44it/s]
 84%|████████▍ | 313109/371472 [2:44:45<4:36:44,  3.51it/s]
 84%|████████▍ | 313110/371472 [2:44:46<4:31:27,  3.58it/s]
 84%|████████▍ | 313111/371472 [2:44:46<4:39:48,  3.48it/s]
 84%|████████▍ | 313112/371472 [2:44:46<4:39:47,  3.48it/s]
 84%|████████▍ | 313113/371472 [2:44:46<4:44:38,  3.42it/s]
 84%|████████▍ | 313114/371472 [2:44:47<4:37:39,  3.50it/s]
 84%|████████▍ | 313115/371472 [2:44:47<4:28:58,  3.62it/s]
 84%|████████▍ | 313116/371472 [2:44:47<5:15:35,  3.08it/s]
 84%|████████▍ | 313117/371472 [2:44:48<4:57:59,  3.26it/s]
 84%|████████▍ | 313118/371472 [2:44:48<4:45:57,  3.40it/s]
 84%|████████▍ | 313119/371472 [2:44:48<4:40:19,  3.47it/s]
 84%|████████▍ | 313120/371472 [2:44:48<4:29:09,  3.61it/s]
                                                           
{'loss': 2.5614, 'learning_rate': 2.414510116572217e-07, 'epoch': 13.49}

 84%|████████▍ | 313120/371472 [2:44:48<4:29:09,  3.61it/s]
 84%|████████▍ | 313121/371472 [2:44:49<4:42:08,  3.45it/s]
 84%|████████▍ | 313122/371472 [2:44:49<4:33:02,  3.56it/s]
 84%|████████▍ | 313123/371472 [2:44:49<4:26:38,  3.65it/s]
 84%|████████▍ | 313124/371472 [2:44:50<4:46:11,  3.40it/s]
 84%|████████▍ | 313125/371472 [2:44:50<5:00:06,  3.24it/s]
 84%|████████▍ | 313126/371472 [2:44:50<4:54:43,  3.30it/s]
 84%|████████▍ | 313127/371472 [2:44:51<4:34:51,  3.54it/s]
 84%|████████▍ | 313128/371472 [2:44:51<4:33:17,  3.56it/s]
 84%|████████▍ | 313129/371472 [2:44:51<4:35:39,  3.53it/s]
 84%|████████▍ | 313130/371472 [2:44:51<4:29:19,  3.61it/s]
 84%|████████▍ | 313131/371472 [2:44:52<4:43:41,  3.43it/s]
 84%|████████▍ | 313132/371472 [2:44:52<4:38:49,  3.49it/s]
 84%|████████▍ | 313133/371472 [2:44:52<4:40:46,  3.46it/s]
 84%|████████▍ | 313134/371472 [2:44:53<4:40:59,  3.46it/s]
 84%|████████▍ | 313135/371472 [2:44:53<4:30:54,  3.59it/s]
 84%|████████▍ | 313136/371472 [2:44:53<4:36:13,  3.52it/s]
 84%|████████▍ | 313137/371472 [2:44:53<4:36:18,  3.52it/s]
 84%|████████▍ | 313138/371472 [2:44:54<4:29:35,  3.61it/s]
 84%|████████▍ | 313139/371472 [2:44:54<4:26:24,  3.65it/s]
 84%|████████▍ | 313140/371472 [2:44:54<4:38:14,  3.49it/s]
                                                           
{'loss': 2.4992, 'learning_rate': 2.414025296817427e-07, 'epoch': 13.49}

 84%|████████▍ | 313140/371472 [2:44:54<4:38:14,  3.49it/s]
 84%|████████▍ | 313141/371472 [2:44:55<4:45:31,  3.40it/s]
 84%|████████▍ | 313142/371472 [2:44:55<4:37:52,  3.50it/s]
 84%|████████▍ | 313143/371472 [2:44:55<4:37:36,  3.50it/s]
 84%|████████▍ | 313144/371472 [2:44:55<4:33:19,  3.56it/s]
 84%|████████▍ | 313145/371472 [2:44:56<4:39:36,  3.48it/s]
 84%|████████▍ | 313146/371472 [2:44:56<4:28:19,  3.62it/s]
 84%|████████▍ | 313147/371472 [2:44:56<4:43:09,  3.43it/s]
 84%|████████▍ | 313148/371472 [2:44:57<4:50:35,  3.35it/s]
 84%|████████▍ | 313149/371472 [2:44:57<4:39:02,  3.48it/s]
 84%|████████▍ | 313150/371472 [2:44:57<4:39:15,  3.48it/s]
 84%|████████▍ | 313151/371472 [2:44:57<4:35:56,  3.52it/s]
 84%|████████▍ | 313152/371472 [2:44:58<4:26:28,  3.65it/s]
 84%|████████▍ | 313153/371472 [2:44:58<4:20:54,  3.73it/s]
 84%|████████▍ | 313154/371472 [2:44:58<4:26:18,  3.65it/s]
 84%|████████▍ | 313155/371472 [2:44:58<4:20:32,  3.73it/s]
 84%|████████▍ | 313156/371472 [2:44:59<4:24:43,  3.67it/s]
 84%|████████▍ | 313157/371472 [2:44:59<4:18:31,  3.76it/s]
 84%|████████▍ | 313158/371472 [2:44:59<4:40:32,  3.46it/s]
 84%|████████▍ | 313159/371472 [2:45:00<4:39:15,  3.48it/s]
 84%|████████▍ | 313160/371472 [2:45:00<4:26:17,  3.65it/s]
                                                           
{'loss': 2.664, 'learning_rate': 2.413540477062639e-07, 'epoch': 13.49}

 84%|████████▍ | 313160/371472 [2:45:00<4:26:17,  3.65it/s]
 84%|████████▍ | 313161/371472 [2:45:00<4:18:30,  3.76it/s]
 84%|████████▍ | 313162/371472 [2:45:00<4:19:30,  3.75it/s]
 84%|████████▍ | 313163/371472 [2:45:01<4:18:16,  3.76it/s]
 84%|████████▍ | 313164/371472 [2:45:01<4:09:59,  3.89it/s]
 84%|████████▍ | 313165/371472 [2:45:01<4:21:30,  3.72it/s]
 84%|████████▍ | 313166/371472 [2:45:01<4:14:02,  3.83it/s]
 84%|████████▍ | 313167/371472 [2:45:02<4:20:04,  3.74it/s]
 84%|████████▍ | 313168/371472 [2:45:02<4:18:06,  3.76it/s]
 84%|████████▍ | 313169/371472 [2:45:02<4:22:59,  3.69it/s]
 84%|████████▍ | 313170/371472 [2:45:03<4:46:01,  3.40it/s]
 84%|████████▍ | 313171/371472 [2:45:03<4:38:18,  3.49it/s]
 84%|████████▍ | 313172/371472 [2:45:03<4:40:47,  3.46it/s]
 84%|████████▍ | 313173/371472 [2:45:03<4:30:58,  3.59it/s]
 84%|████████▍ | 313174/371472 [2:45:04<4:35:53,  3.52it/s]
 84%|████████▍ | 313175/371472 [2:45:04<4:37:14,  3.50it/s]
 84%|████████▍ | 313176/371472 [2:45:04<4:31:41,  3.58it/s]
 84%|████████▍ | 313177/371472 [2:45:05<4:44:22,  3.42it/s]
 84%|████████▍ | 313178/371472 [2:45:05<4:28:31,  3.62it/s]
 84%|████████▍ | 313179/371472 [2:45:05<4:31:46,  3.57it/s]
 84%|████████▍ | 313180/371472 [2:45:05<4:27:45,  3.63it/s]
                                                           
{'loss': 2.6009, 'learning_rate': 2.4130556573078497e-07, 'epoch': 13.49}

 84%|████████▍ | 313180/371472 [2:45:05<4:27:45,  3.63it/s]
 84%|████████▍ | 313181/371472 [2:45:06<4:38:19,  3.49it/s]
 84%|████████▍ | 313182/371472 [2:45:06<4:34:14,  3.54it/s]
 84%|████████▍ | 313183/371472 [2:45:06<4:30:09,  3.60it/s]
 84%|████████▍ | 313184/371472 [2:45:07<4:59:59,  3.24it/s]
 84%|████████▍ | 313185/371472 [2:45:07<5:01:53,  3.22it/s]
 84%|████████▍ | 313186/371472 [2:45:07<4:46:46,  3.39it/s]
 84%|████████▍ | 313187/371472 [2:45:07<4:41:32,  3.45it/s]
 84%|████████▍ | 313188/371472 [2:45:08<4:35:03,  3.53it/s]
 84%|████████▍ | 313189/371472 [2:45:08<4:33:03,  3.56it/s]
 84%|████████▍ | 313190/371472 [2:45:08<4:27:41,  3.63it/s]
 84%|████████▍ | 313191/371472 [2:45:09<4:31:20,  3.58it/s]
 84%|████████▍ | 313192/371472 [2:45:09<4:25:56,  3.65it/s]
 84%|████████▍ | 313193/371472 [2:45:09<4:18:33,  3.76it/s]
 84%|████████▍ | 313194/371472 [2:45:09<4:29:38,  3.60it/s]
 84%|████████▍ | 313195/371472 [2:45:10<4:34:01,  3.54it/s]
 84%|████████▍ | 313196/371472 [2:45:10<4:42:33,  3.44it/s]
 84%|████████▍ | 313197/371472 [2:45:10<4:37:16,  3.50it/s]
 84%|████████▍ | 313198/371472 [2:45:10<4:36:56,  3.51it/s]
 84%|████████▍ | 313199/371472 [2:45:11<4:30:27,  3.59it/s]
 84%|████████▍ | 313200/371472 [2:45:11<4:28:51,  3.61it/s]
                                                           
{'loss': 2.6323, 'learning_rate': 2.4125708375530604e-07, 'epoch': 13.49}

 84%|████████▍ | 313200/371472 [2:45:11<4:28:51,  3.61it/s]
 84%|████████▍ | 313201/371472 [2:45:11<5:06:56,  3.16it/s]
 84%|████████▍ | 313202/371472 [2:45:12<4:53:28,  3.31it/s]
 84%|████████▍ | 313203/371472 [2:45:12<4:38:40,  3.48it/s]
 84%|████████▍ | 313204/371472 [2:45:12<4:28:55,  3.61it/s]
 84%|████████▍ | 313205/371472 [2:45:12<4:22:34,  3.70it/s]
 84%|████████▍ | 313206/371472 [2:45:13<4:16:12,  3.79it/s]
 84%|████████▍ | 313207/371472 [2:45:13<4:28:49,  3.61it/s]
 84%|████████▍ | 313208/371472 [2:45:13<4:37:03,  3.50it/s]
 84%|████████▍ | 313209/371472 [2:45:14<4:36:23,  3.51it/s]
 84%|████████▍ | 313210/371472 [2:45:14<4:31:33,  3.58it/s]
 84%|████████▍ | 313211/371472 [2:45:14<4:26:41,  3.64it/s]
 84%|████████▍ | 313212/371472 [2:45:14<4:43:33,  3.42it/s]
 84%|████████▍ | 313213/371472 [2:45:15<4:40:16,  3.46it/s]
 84%|████████▍ | 313214/371472 [2:45:15<5:08:46,  3.14it/s]
 84%|████████▍ | 313215/371472 [2:45:15<4:50:26,  3.34it/s]
 84%|████████▍ | 313216/371472 [2:45:16<4:58:17,  3.25it/s]
 84%|████████▍ | 313217/371472 [2:45:16<4:44:48,  3.41it/s]
 84%|████████▍ | 313218/371472 [2:45:16<4:45:16,  3.40it/s]
 84%|████████▍ | 313219/371472 [2:45:17<4:42:25,  3.44it/s]
 84%|████████▍ | 313220/371472 [2:45:17<4:48:08,  3.37it/s]
                                                           
{'loss': 2.427, 'learning_rate': 2.412086017798272e-07, 'epoch': 13.49}

 84%|████████▍ | 313220/371472 [2:45:17<4:48:08,  3.37it/s]
 84%|████████▍ | 313221/371472 [2:45:17<4:49:57,  3.35it/s]
 84%|████████▍ | 313222/371472 [2:45:17<4:45:15,  3.40it/s]
 84%|████████▍ | 313223/371472 [2:45:18<4:39:49,  3.47it/s]
 84%|████████▍ | 313224/371472 [2:45:18<4:25:59,  3.65it/s]
 84%|████████▍ | 313225/371472 [2:45:18<4:17:14,  3.77it/s]
 84%|████████▍ | 313226/371472 [2:45:19<4:21:52,  3.71it/s]
 84%|████████▍ | 313227/371472 [2:45:19<4:19:11,  3.75it/s]
 84%|████████▍ | 313228/371472 [2:45:19<4:15:38,  3.80it/s]
 84%|████████▍ | 313229/371472 [2:45:19<4:11:39,  3.86it/s]
 84%|████████▍ | 313230/371472 [2:45:20<4:17:44,  3.77it/s]
 84%|████████▍ | 313231/371472 [2:45:20<4:17:23,  3.77it/s]
 84%|████████▍ | 313232/371472 [2:45:20<4:10:02,  3.88it/s]
 84%|████████▍ | 313233/371472 [2:45:20<4:03:51,  3.98it/s]
 84%|████████▍ | 313234/371472 [2:45:21<4:13:29,  3.83it/s]
 84%|████████▍ | 313235/371472 [2:45:21<4:09:46,  3.89it/s]
 84%|████████▍ | 313236/371472 [2:45:21<4:14:41,  3.81it/s]
 84%|████████▍ | 313237/371472 [2:45:21<4:47:23,  3.38it/s]
 84%|████████▍ | 313238/371472 [2:45:22<4:35:51,  3.52it/s]
 84%|████████▍ | 313239/371472 [2:45:22<4:32:10,  3.57it/s]
 84%|████████▍ | 313240/371472 [2:45:22<4:40:46,  3.46it/s]
                                                           
{'loss': 2.6683, 'learning_rate': 2.4116011980434824e-07, 'epoch': 13.49}

 84%|████████▍ | 313240/371472 [2:45:22<4:40:46,  3.46it/s]
 84%|████████▍ | 313241/371472 [2:45:23<4:49:42,  3.35it/s]
 84%|████████▍ | 313242/371472 [2:45:23<4:38:26,  3.49it/s]
 84%|████████▍ | 313243/371472 [2:45:23<4:31:52,  3.57it/s]
 84%|████████▍ | 313244/371472 [2:45:23<4:21:35,  3.71it/s]
 84%|████████▍ | 313245/371472 [2:45:24<4:18:00,  3.76it/s]
 84%|████████▍ | 313246/371472 [2:45:24<4:22:49,  3.69it/s]
 84%|████████▍ | 313247/371472 [2:45:24<4:23:32,  3.68it/s]
 84%|████████▍ | 313248/371472 [2:45:24<4:26:42,  3.64it/s]
 84%|████████▍ | 313249/371472 [2:45:25<4:38:00,  3.49it/s]
 84%|████████▍ | 313250/371472 [2:45:25<4:50:31,  3.34it/s]
 84%|████████▍ | 313251/371472 [2:45:25<4:44:07,  3.42it/s]
 84%|████████▍ | 313252/371472 [2:45:26<4:34:25,  3.54it/s]
 84%|████████▍ | 313253/371472 [2:45:26<4:27:55,  3.62it/s]
 84%|████████▍ | 313254/371472 [2:45:26<4:31:33,  3.57it/s]
 84%|████████▍ | 313255/371472 [2:45:27<4:35:07,  3.53it/s]
 84%|████████▍ | 313256/371472 [2:45:27<4:47:12,  3.38it/s]
 84%|████████▍ | 313257/371472 [2:45:27<4:40:53,  3.45it/s]
 84%|████████▍ | 313258/371472 [2:45:27<5:03:32,  3.20it/s]
 84%|████████▍ | 313259/371472 [2:45:28<5:08:24,  3.15it/s]
 84%|████████▍ | 313260/371472 [2:45:28<4:59:06,  3.24it/s]
                                                           
{'loss': 2.666, 'learning_rate': 2.4111163782886936e-07, 'epoch': 13.49}

 84%|████████▍ | 313260/371472 [2:45:28<4:59:06,  3.24it/s]
 84%|████████▍ | 313261/371472 [2:45:28<4:59:43,  3.24it/s]
 84%|████████▍ | 313262/371472 [2:45:29<4:52:28,  3.32it/s]
 84%|████████▍ | 313263/371472 [2:45:29<4:46:24,  3.39it/s]
 84%|████████▍ | 313264/371472 [2:45:29<4:48:11,  3.37it/s]
 84%|████████▍ | 313265/371472 [2:45:30<4:30:57,  3.58it/s]
 84%|████████▍ | 313266/371472 [2:45:30<4:29:35,  3.60it/s]
 84%|████████▍ | 313267/371472 [2:45:30<4:53:57,  3.30it/s]
 84%|████████▍ | 313268/371472 [2:45:30<4:40:55,  3.45it/s]
 84%|████████▍ | 313269/371472 [2:45:31<4:33:41,  3.54it/s]
 84%|████████▍ | 313270/371472 [2:45:31<4:26:03,  3.65it/s]
 84%|████████▍ | 313271/371472 [2:45:31<4:36:41,  3.51it/s]
 84%|████████▍ | 313272/371472 [2:45:32<5:01:25,  3.22it/s]
 84%|████████▍ | 313273/371472 [2:45:32<4:58:26,  3.25it/s]
 84%|████████▍ | 313274/371472 [2:45:32<4:47:33,  3.37it/s]
 84%|████████▍ | 313275/371472 [2:45:32<4:45:48,  3.39it/s]
 84%|████████▍ | 313276/371472 [2:45:33<4:35:52,  3.52it/s]
 84%|████████▍ | 313277/371472 [2:45:33<4:37:50,  3.49it/s]
 84%|████████▍ | 313278/371472 [2:45:33<4:38:27,  3.48it/s]
 84%|████████▍ | 313279/371472 [2:45:34<4:38:15,  3.49it/s]
 84%|████████▍ | 313280/371472 [2:45:34<4:30:01,  3.59it/s]
                                                           
{'loss': 2.5848, 'learning_rate': 2.4106315585339043e-07, 'epoch': 13.49}

 84%|████████▍ | 313280/371472 [2:45:34<4:30:01,  3.59it/s]
 84%|████████▍ | 313281/371472 [2:45:34<4:35:37,  3.52it/s]
 84%|████████▍ | 313282/371472 [2:45:34<4:23:56,  3.67it/s]
 84%|████████▍ | 313283/371472 [2:45:35<4:24:00,  3.67it/s]
 84%|████████▍ | 313284/371472 [2:45:35<5:09:04,  3.14it/s]
 84%|████████▍ | 313285/371472 [2:45:35<4:49:26,  3.35it/s]
 84%|████████▍ | 313286/371472 [2:45:36<4:34:18,  3.54it/s]
 84%|████████▍ | 313287/371472 [2:45:36<4:27:46,  3.62it/s]
 84%|████████▍ | 313288/371472 [2:45:36<4:29:00,  3.60it/s]
 84%|████████▍ | 313289/371472 [2:45:36<4:25:18,  3.66it/s]
 84%|████████▍ | 313290/371472 [2:45:37<4:24:22,  3.67it/s]
 84%|████████▍ | 313291/371472 [2:45:37<4:22:15,  3.70it/s]
 84%|████████▍ | 313292/371472 [2:45:37<4:21:38,  3.71it/s]
 84%|████████▍ | 313293/371472 [2:45:37<4:14:39,  3.81it/s]
 84%|████████▍ | 313294/371472 [2:45:38<4:21:23,  3.71it/s]
 84%|████████▍ | 313295/371472 [2:45:38<4:23:43,  3.68it/s]
 84%|████████▍ | 313296/371472 [2:45:38<4:18:18,  3.75it/s]
 84%|████████▍ | 313297/371472 [2:45:39<4:10:51,  3.86it/s]
 84%|████████▍ | 313298/371472 [2:45:39<4:18:30,  3.75it/s]
 84%|████████▍ | 313299/371472 [2:45:39<4:17:41,  3.76it/s]
 84%|████████▍ | 313300/371472 [2:45:39<4:12:00,  3.85it/s]
                                                           
{'loss': 2.585, 'learning_rate': 2.410146738779116e-07, 'epoch': 13.49}

 84%|████████▍ | 313300/371472 [2:45:39<4:12:00,  3.85it/s]
 84%|████████▍ | 313301/371472 [2:45:40<4:16:26,  3.78it/s]
 84%|████████▍ | 313302/371472 [2:45:40<4:27:57,  3.62it/s]
 84%|████████▍ | 313303/371472 [2:45:40<4:33:05,  3.55it/s]
 84%|████████▍ | 313304/371472 [2:45:40<4:27:37,  3.62it/s]
 84%|████████▍ | 313305/371472 [2:45:41<4:31:40,  3.57it/s]
 84%|████████▍ | 313306/371472 [2:45:41<4:20:57,  3.71it/s]
 84%|████████▍ | 313307/371472 [2:45:41<4:48:49,  3.36it/s]
 84%|████████▍ | 313308/371472 [2:45:42<4:55:09,  3.28it/s]
 84%|████████▍ | 313309/371472 [2:45:42<4:44:03,  3.41it/s]
 84%|████████▍ | 313310/371472 [2:45:42<4:37:37,  3.49it/s]
 84%|████████▍ | 313311/371472 [2:45:42<4:34:58,  3.53it/s]
 84%|████████▍ | 313312/371472 [2:45:43<4:25:31,  3.65it/s]
 84%|████████▍ | 313313/371472 [2:45:43<4:45:01,  3.40it/s]
 84%|████████▍ | 313314/371472 [2:45:43<4:37:02,  3.50it/s]
 84%|████████▍ | 313315/371472 [2:45:44<4:34:00,  3.54it/s]
 84%|████████▍ | 313316/371472 [2:45:44<4:35:16,  3.52it/s]
 84%|████████▍ | 313317/371472 [2:45:44<4:29:40,  3.59it/s]
 84%|████████▍ | 313318/371472 [2:45:45<4:55:40,  3.28it/s]
 84%|████████▍ | 313319/371472 [2:45:45<4:47:12,  3.37it/s]
 84%|████████▍ | 313320/371472 [2:45:45<4:40:37,  3.45it/s]
                                                           
{'loss': 2.6915, 'learning_rate': 2.409661919024327e-07, 'epoch': 13.5}

 84%|████████▍ | 313320/371472 [2:45:45<4:40:37,  3.45it/s]
 84%|████████▍ | 313321/371472 [2:45:45<4:43:18,  3.42it/s]
 84%|████████▍ | 313322/371472 [2:45:46<4:34:30,  3.53it/s]
 84%|████████▍ | 313323/371472 [2:45:46<4:30:20,  3.58it/s]
 84%|████████▍ | 313324/371472 [2:45:46<4:28:13,  3.61it/s]
 84%|████████▍ | 313325/371472 [2:45:46<4:21:06,  3.71it/s]
 84%|████████▍ | 313326/371472 [2:45:47<4:25:15,  3.65it/s]
 84%|████████▍ | 313327/371472 [2:45:47<4:18:47,  3.74it/s]
 84%|████████▍ | 313328/371472 [2:45:47<4:16:07,  3.78it/s]
 84%|████████▍ | 313329/371472 [2:45:47<4:12:48,  3.83it/s]
 84%|████████▍ | 313330/371472 [2:45:48<4:13:10,  3.83it/s]
 84%|████████▍ | 313331/371472 [2:45:48<4:24:14,  3.67it/s]
 84%|████████▍ | 313332/371472 [2:45:48<4:26:52,  3.63it/s]
 84%|████████▍ | 313333/371472 [2:45:49<4:29:02,  3.60it/s]
 84%|████████▍ | 313334/371472 [2:45:49<4:22:53,  3.69it/s]
 84%|████████▍ | 313335/371472 [2:45:49<4:25:24,  3.65it/s]
 84%|████████▍ | 313336/371472 [2:45:49<4:27:54,  3.62it/s]
 84%|████████▍ | 313337/371472 [2:45:50<4:20:57,  3.71it/s]
 84%|████████▍ | 313338/371472 [2:45:50<4:19:08,  3.74it/s]
 84%|████████▍ | 313339/371472 [2:45:50<5:13:18,  3.09it/s]
 84%|████████▍ | 313340/371472 [2:45:51<5:00:34,  3.22it/s]
                                                           
{'loss': 2.6742, 'learning_rate': 2.4091770992695386e-07, 'epoch': 13.5}

 84%|████████▍ | 313340/371472 [2:45:51<5:00:34,  3.22it/s]
 84%|████████▍ | 313341/371472 [2:45:51<5:03:46,  3.19it/s]
 84%|████████▍ | 313342/371472 [2:45:51<4:53:56,  3.30it/s]
 84%|████████▍ | 313343/371472 [2:45:52<4:47:03,  3.38it/s]
 84%|████████▍ | 313344/371472 [2:45:52<4:59:28,  3.23it/s]
 84%|████████▍ | 313345/371472 [2:45:52<5:00:20,  3.23it/s]
 84%|████████▍ | 313346/371472 [2:45:52<4:51:41,  3.32it/s]
 84%|████████▍ | 313347/371472 [2:45:53<4:44:45,  3.40it/s]
 84%|████████▍ | 313348/371472 [2:45:53<4:35:43,  3.51it/s]
 84%|████████▍ | 313349/371472 [2:45:53<4:36:30,  3.50it/s]
 84%|████████▍ | 313350/371472 [2:45:54<4:25:35,  3.65it/s]
 84%|████████▍ | 313351/371472 [2:45:54<4:21:03,  3.71it/s]
 84%|████████▍ | 313352/371472 [2:45:54<4:22:42,  3.69it/s]
 84%|████████▍ | 313353/371472 [2:45:54<4:23:35,  3.67it/s]
 84%|████████▍ | 313354/371472 [2:45:55<4:34:34,  3.53it/s]
 84%|████████▍ | 313355/371472 [2:45:55<4:29:55,  3.59it/s]
 84%|████████▍ | 313356/371472 [2:45:55<4:20:04,  3.72it/s]
 84%|████████▍ | 313357/371472 [2:45:55<4:13:10,  3.83it/s]
 84%|████████▍ | 313358/371472 [2:45:56<4:15:16,  3.79it/s]
 84%|████████▍ | 313359/371472 [2:45:56<4:18:53,  3.74it/s]
 84%|████████▍ | 313360/371472 [2:45:56<4:21:04,  3.71it/s]
                                                           
{'loss': 2.6662, 'learning_rate': 2.408692279514749e-07, 'epoch': 13.5}

 84%|████████▍ | 313360/371472 [2:45:56<4:21:04,  3.71it/s]
 84%|████████▍ | 313361/371472 [2:45:57<4:20:57,  3.71it/s]
 84%|████████▍ | 313362/371472 [2:45:57<4:26:22,  3.64it/s]
 84%|████████▍ | 313363/371472 [2:45:57<4:30:51,  3.58it/s]
 84%|████████▍ | 313364/371472 [2:45:57<5:03:24,  3.19it/s]
 84%|████████▍ | 313365/371472 [2:45:58<5:00:02,  3.23it/s]
 84%|████████▍ | 313366/371472 [2:45:58<5:18:07,  3.04it/s]
 84%|████████▍ | 313367/371472 [2:45:58<4:53:42,  3.30it/s]
 84%|████████▍ | 313368/371472 [2:45:59<5:08:42,  3.14it/s]
 84%|████████▍ | 313369/371472 [2:45:59<4:47:20,  3.37it/s]
 84%|████████▍ | 313370/371472 [2:45:59<4:42:44,  3.42it/s]
 84%|████████▍ | 313371/371472 [2:46:00<4:35:39,  3.51it/s]
 84%|████████▍ | 313372/371472 [2:46:00<4:31:49,  3.56it/s]
 84%|████████▍ | 313373/371472 [2:46:00<4:30:22,  3.58it/s]
 84%|████████▍ | 313374/371472 [2:46:00<4:28:00,  3.61it/s]
 84%|████████▍ | 313375/371472 [2:46:01<4:19:24,  3.73it/s]
 84%|████████▍ | 313376/371472 [2:46:01<4:22:59,  3.68it/s]
 84%|████████▍ | 313377/371472 [2:46:01<4:20:59,  3.71it/s]
 84%|████████▍ | 313378/371472 [2:46:01<4:12:23,  3.84it/s]
 84%|████████▍ | 313379/371472 [2:46:02<4:12:20,  3.84it/s]
 84%|████████▍ | 313380/371472 [2:46:02<4:17:26,  3.76it/s]
                                                           
{'loss': 2.6417, 'learning_rate': 2.4082074597599605e-07, 'epoch': 13.5}

 84%|████████▍ | 313380/371472 [2:46:02<4:17:26,  3.76it/s]
 84%|████████▍ | 313381/371472 [2:46:02<4:14:53,  3.80it/s]
 84%|████████▍ | 313382/371472 [2:46:02<4:18:56,  3.74it/s]
 84%|████████▍ | 313383/371472 [2:46:03<4:25:40,  3.64it/s]
 84%|████████▍ | 313384/371472 [2:46:03<4:29:46,  3.59it/s]
 84%|████████▍ | 313385/371472 [2:46:03<4:27:08,  3.62it/s]
 84%|████████▍ | 313386/371472 [2:46:04<4:21:31,  3.70it/s]
 84%|████████▍ | 313387/371472 [2:46:04<4:18:53,  3.74it/s]
 84%|████████▍ | 313388/371472 [2:46:04<4:12:31,  3.83it/s]
 84%|████████▍ | 313389/371472 [2:46:04<4:17:03,  3.77it/s]
 84%|████████▍ | 313390/371472 [2:46:05<4:15:13,  3.79it/s]
 84%|████████▍ | 313391/371472 [2:46:05<4:26:33,  3.63it/s]
 84%|████████▍ | 313392/371472 [2:46:05<4:20:08,  3.72it/s]
 84%|████████▍ | 313393/371472 [2:46:05<4:30:47,  3.57it/s]
 84%|████████▍ | 313394/371472 [2:46:06<4:24:48,  3.66it/s]
 84%|████████▍ | 313395/371472 [2:46:06<4:30:32,  3.58it/s]
 84%|████████▍ | 313396/371472 [2:46:06<4:34:33,  3.53it/s]
 84%|████████▍ | 313397/371472 [2:46:07<4:41:06,  3.44it/s]
 84%|████████▍ | 313398/371472 [2:46:07<4:29:07,  3.60it/s]
 84%|████████▍ | 313399/371472 [2:46:07<4:25:45,  3.64it/s]
 84%|████████▍ | 313400/371472 [2:46:07<4:19:35,  3.73it/s]
                                                           
{'loss': 2.7282, 'learning_rate': 2.4077226400051707e-07, 'epoch': 13.5}

 84%|████████▍ | 313400/371472 [2:46:07<4:19:35,  3.73it/s]
 84%|████████▍ | 313401/371472 [2:46:08<4:27:11,  3.62it/s]
 84%|████████▍ | 313402/371472 [2:46:08<4:41:08,  3.44it/s]
 84%|████████▍ | 313403/371472 [2:46:08<4:36:31,  3.50it/s]
 84%|████████▍ | 313404/371472 [2:46:09<4:36:08,  3.50it/s]
 84%|████████▍ | 313405/371472 [2:46:09<4:30:23,  3.58it/s]
 84%|████████▍ | 313406/371472 [2:46:09<4:24:29,  3.66it/s]
 84%|████████▍ | 313407/371472 [2:46:09<4:17:33,  3.76it/s]
 84%|████████▍ | 313408/371472 [2:46:10<4:17:48,  3.75it/s]
 84%|████████▍ | 313409/371472 [2:46:10<4:25:17,  3.65it/s]
 84%|████████▍ | 313410/371472 [2:46:10<4:24:09,  3.66it/s]
 84%|████████▍ | 313411/371472 [2:46:10<4:30:38,  3.58it/s]
 84%|████████▍ | 313412/371472 [2:46:11<4:22:00,  3.69it/s]
 84%|████████▍ | 313413/371472 [2:46:11<4:29:01,  3.60it/s]
 84%|████████▍ | 313414/371472 [2:46:11<4:36:42,  3.50it/s]
 84%|████████▍ | 313415/371472 [2:46:12<4:28:30,  3.60it/s]
 84%|████████▍ | 313416/371472 [2:46:12<4:21:41,  3.70it/s]
 84%|████████▍ | 313417/371472 [2:46:12<4:16:57,  3.77it/s]
 84%|████████▍ | 313418/371472 [2:46:12<4:18:57,  3.74it/s]
 84%|████████▍ | 313419/371472 [2:46:13<4:35:27,  3.51it/s]
 84%|████████▍ | 313420/371472 [2:46:13<4:28:59,  3.60it/s]
                                                           
{'loss': 2.4319, 'learning_rate': 2.4072378202503825e-07, 'epoch': 13.5}

 84%|████████▍ | 313420/371472 [2:46:13<4:28:59,  3.60it/s]
 84%|████████▍ | 313421/371472 [2:46:13<4:24:52,  3.65it/s]
 84%|████████▍ | 313422/371472 [2:46:13<4:16:29,  3.77it/s]
 84%|████████▍ | 313423/371472 [2:46:14<4:11:13,  3.85it/s]
 84%|████████▍ | 313424/371472 [2:46:14<4:18:18,  3.75it/s]
 84%|████████▍ | 313425/371472 [2:46:14<4:29:49,  3.59it/s]
 84%|████████▍ | 313426/371472 [2:46:15<4:34:15,  3.53it/s]
 84%|████████▍ | 313427/371472 [2:46:15<4:38:47,  3.47it/s]
 84%|████████▍ | 313428/371472 [2:46:15<4:45:11,  3.39it/s]
 84%|████████▍ | 313429/371472 [2:46:15<4:34:53,  3.52it/s]
 84%|████████▍ | 313430/371472 [2:46:16<4:47:57,  3.36it/s]
 84%|████████▍ | 313431/371472 [2:46:16<4:43:32,  3.41it/s]
 84%|████████▍ | 313432/371472 [2:46:16<4:33:57,  3.53it/s]
 84%|████████▍ | 313433/371472 [2:46:17<4:19:31,  3.73it/s]
 84%|████████▍ | 313434/371472 [2:46:17<4:09:52,  3.87it/s]
 84%|████████▍ | 313435/371472 [2:46:17<4:30:05,  3.58it/s]
 84%|████████▍ | 313436/371472 [2:46:17<4:30:46,  3.57it/s]
 84%|████████▍ | 313437/371472 [2:46:18<4:26:51,  3.62it/s]
 84%|████████▍ | 313438/371472 [2:46:18<4:37:21,  3.49it/s]
 84%|████████▍ | 313439/371472 [2:46:18<4:41:25,  3.44it/s]
 84%|████████▍ | 313440/371472 [2:46:19<4:28:14,  3.61it/s]
                                                           
{'loss': 2.7033, 'learning_rate': 2.406753000495593e-07, 'epoch': 13.5}

 84%|████████▍ | 313440/371472 [2:46:19<4:28:14,  3.61it/s]
 84%|████████▍ | 313441/371472 [2:46:19<4:31:12,  3.57it/s]
 84%|████████▍ | 313442/371472 [2:46:19<4:41:37,  3.43it/s]
 84%|████████▍ | 313443/371472 [2:46:19<4:29:18,  3.59it/s]
 84%|████████▍ | 313444/371472 [2:46:20<4:22:45,  3.68it/s]
 84%|████████▍ | 313445/371472 [2:46:20<4:18:38,  3.74it/s]
 84%|████████▍ | 313446/371472 [2:46:20<4:18:07,  3.75it/s]
 84%|████████▍ | 313447/371472 [2:46:20<4:24:26,  3.66it/s]
 84%|████████▍ | 313448/371472 [2:46:21<4:13:15,  3.82it/s]
 84%|████████▍ | 313449/371472 [2:46:21<4:16:06,  3.78it/s]
 84%|████████▍ | 313450/371472 [2:46:21<4:35:12,  3.51it/s]
 84%|████████▍ | 313451/371472 [2:46:22<4:24:56,  3.65it/s]
 84%|████████▍ | 313452/371472 [2:46:22<4:20:01,  3.72it/s]
 84%|████████▍ | 313453/371472 [2:46:22<4:19:37,  3.72it/s]
 84%|████████▍ | 313454/371472 [2:46:22<4:16:45,  3.77it/s]
 84%|████████▍ | 313455/371472 [2:46:23<4:14:41,  3.80it/s]
 84%|████████▍ | 313456/371472 [2:46:23<4:44:47,  3.40it/s]
 84%|████████▍ | 313457/371472 [2:46:23<4:39:25,  3.46it/s]
 84%|████████▍ | 313458/371472 [2:46:24<4:40:49,  3.44it/s]
 84%|████████▍ | 313459/371472 [2:46:24<4:36:10,  3.50it/s]
 84%|████████▍ | 313460/371472 [2:46:24<4:29:33,  3.59it/s]
                                                           
{'loss': 2.5156, 'learning_rate': 2.406268180740805e-07, 'epoch': 13.5}

 84%|████████▍ | 313460/371472 [2:46:24<4:29:33,  3.59it/s]
 84%|████████▍ | 313461/371472 [2:46:24<4:24:54,  3.65it/s]
 84%|████████▍ | 313462/371472 [2:46:25<4:23:21,  3.67it/s]
 84%|████████▍ | 313463/371472 [2:46:25<4:24:05,  3.66it/s]
 84%|████████▍ | 313464/371472 [2:46:25<4:34:59,  3.52it/s]
 84%|████████▍ | 313465/371472 [2:46:26<5:03:35,  3.18it/s]
 84%|████████▍ | 313466/371472 [2:46:26<4:47:26,  3.36it/s]
 84%|████████▍ | 313467/371472 [2:46:26<4:39:50,  3.45it/s]
 84%|████████▍ | 313468/371472 [2:46:26<4:50:56,  3.32it/s]
 84%|████████▍ | 313469/371472 [2:46:27<4:33:55,  3.53it/s]
 84%|████████▍ | 313470/371472 [2:46:27<4:46:21,  3.38it/s]
 84%|████████▍ | 313471/371472 [2:46:27<4:31:14,  3.56it/s]
 84%|████████▍ | 313472/371472 [2:46:27<4:23:56,  3.66it/s]
 84%|████████▍ | 313473/371472 [2:46:28<4:23:18,  3.67it/s]
 84%|████████▍ | 313474/371472 [2:46:28<4:19:20,  3.73it/s]
 84%|████████▍ | 313475/371472 [2:46:28<4:21:59,  3.69it/s]
 84%|████████▍ | 313476/371472 [2:46:29<4:20:36,  3.71it/s]
 84%|████████▍ | 313477/371472 [2:46:29<4:21:13,  3.70it/s]
 84%|████████▍ | 313478/371472 [2:46:29<4:20:06,  3.72it/s]
 84%|████████▍ | 313479/371472 [2:46:29<4:16:00,  3.78it/s]
 84%|████████▍ | 313480/371472 [2:46:30<4:21:34,  3.69it/s]
                                                           
{'loss': 2.6789, 'learning_rate': 2.4057833609860157e-07, 'epoch': 13.5}

 84%|████████▍ | 313480/371472 [2:46:30<4:21:34,  3.69it/s]
 84%|████████▍ | 313481/371472 [2:46:30<4:17:58,  3.75it/s]
 84%|████████▍ | 313482/371472 [2:46:30<4:20:23,  3.71it/s]
 84%|████████▍ | 313483/371472 [2:46:30<4:28:02,  3.61it/s]
 84%|████████▍ | 313484/371472 [2:46:31<4:54:21,  3.28it/s]
 84%|████████▍ | 313485/371472 [2:46:31<4:56:03,  3.26it/s]
 84%|████████▍ | 313486/371472 [2:46:32<5:11:31,  3.10it/s]
 84%|████████▍ | 313487/371472 [2:46:32<4:54:57,  3.28it/s]
 84%|████████▍ | 313488/371472 [2:46:32<4:48:10,  3.35it/s]
 84%|████████▍ | 313489/371472 [2:46:32<4:41:59,  3.43it/s]
 84%|████████▍ | 313490/371472 [2:46:33<4:47:30,  3.36it/s]
 84%|████████▍ | 313491/371472 [2:46:33<5:04:39,  3.17it/s]
 84%|████████▍ | 313492/371472 [2:46:33<4:53:42,  3.29it/s]
 84%|████████▍ | 313493/371472 [2:46:34<4:39:03,  3.46it/s]
 84%|████████▍ | 313494/371472 [2:46:34<4:35:13,  3.51it/s]
 84%|████████▍ | 313495/371472 [2:46:34<4:21:28,  3.70it/s]
 84%|████████▍ | 313496/371472 [2:46:34<4:23:10,  3.67it/s]
 84%|████████▍ | 313497/371472 [2:46:35<4:41:23,  3.43it/s]
 84%|████████▍ | 313498/371472 [2:46:35<4:35:40,  3.51it/s]
 84%|████████▍ | 313499/371472 [2:46:35<4:26:57,  3.62it/s]
 84%|████████▍ | 313500/371472 [2:46:35<4:26:50,  3.62it/s]
                                                           
{'loss': 2.6506, 'learning_rate': 2.405298541231227e-07, 'epoch': 13.5}

 84%|████████▍ | 313500/371472 [2:46:35<4:26:50,  3.62it/s]
 84%|████████▍ | 313501/371472 [2:46:36<4:41:35,  3.43it/s]
 84%|████████▍ | 313502/371472 [2:46:36<4:41:00,  3.44it/s]
 84%|████████▍ | 313503/371472 [2:46:36<4:53:00,  3.30it/s]
 84%|████████▍ | 313504/371472 [2:46:37<4:45:54,  3.38it/s]
 84%|████████▍ | 313505/371472 [2:46:37<4:35:23,  3.51it/s]
 84%|████████▍ | 313506/371472 [2:46:37<4:27:30,  3.61it/s]
 84%|████████▍ | 313507/371472 [2:46:37<4:25:20,  3.64it/s]
 84%|████████▍ | 313508/371472 [2:46:38<4:17:22,  3.75it/s]
 84%|████████▍ | 313509/371472 [2:46:38<4:26:10,  3.63it/s]
 84%|████████▍ | 313510/371472 [2:46:38<4:16:09,  3.77it/s]
 84%|████████▍ | 313511/371472 [2:46:39<4:16:14,  3.77it/s]
 84%|████████▍ | 313512/371472 [2:46:39<4:24:24,  3.65it/s]
 84%|████████▍ | 313513/371472 [2:46:39<4:20:15,  3.71it/s]
 84%|████████▍ | 313514/371472 [2:46:39<4:45:29,  3.38it/s]
 84%|████████▍ | 313515/371472 [2:46:40<5:00:14,  3.22it/s]
 84%|████████▍ | 313516/371472 [2:46:40<4:51:26,  3.31it/s]
 84%|████████▍ | 313517/371472 [2:46:40<4:43:44,  3.40it/s]
 84%|████████▍ | 313518/371472 [2:46:41<4:48:07,  3.35it/s]
 84%|████████▍ | 313519/371472 [2:46:41<4:40:53,  3.44it/s]
 84%|████████▍ | 313520/371472 [2:46:41<4:35:52,  3.50it/s]
                                                           
{'loss': 2.6087, 'learning_rate': 2.404813721476437e-07, 'epoch': 13.5}

 84%|████████▍ | 313520/371472 [2:46:41<4:35:52,  3.50it/s]
 84%|████████▍ | 313521/371472 [2:46:41<4:38:58,  3.46it/s]
 84%|████████▍ | 313522/371472 [2:46:42<4:37:35,  3.48it/s]
 84%|████████▍ | 313523/371472 [2:46:42<4:34:23,  3.52it/s]
 84%|████████▍ | 313524/371472 [2:46:42<4:23:47,  3.66it/s]
 84%|████████▍ | 313525/371472 [2:46:43<4:55:45,  3.27it/s]
 84%|████████▍ | 313526/371472 [2:46:43<4:57:56,  3.24it/s]
 84%|████████▍ | 313527/371472 [2:46:43<4:47:26,  3.36it/s]
 84%|████████▍ | 313528/371472 [2:46:44<4:40:57,  3.44it/s]
 84%|████████▍ | 313529/371472 [2:46:44<5:13:03,  3.08it/s]
 84%|████████▍ | 313530/371472 [2:46:44<4:51:32,  3.31it/s]
 84%|████████▍ | 313531/371472 [2:46:44<4:42:00,  3.42it/s]
 84%|████████▍ | 313532/371472 [2:46:45<4:31:59,  3.55it/s]
 84%|████████▍ | 313533/371472 [2:46:45<4:21:56,  3.69it/s]
 84%|████████▍ | 313534/371472 [2:46:45<4:15:58,  3.77it/s]
 84%|████████▍ | 313535/371472 [2:46:45<4:13:04,  3.82it/s]
 84%|████████▍ | 313536/371472 [2:46:46<4:29:19,  3.59it/s]
 84%|████████▍ | 313537/371472 [2:46:46<4:27:45,  3.61it/s]
 84%|████████▍ | 313538/371472 [2:46:46<4:30:29,  3.57it/s]
 84%|████████▍ | 313539/371472 [2:46:47<4:32:12,  3.55it/s]
 84%|████████▍ | 313540/371472 [2:46:47<4:34:32,  3.52it/s]
                                                           
{'loss': 2.491, 'learning_rate': 2.404328901721649e-07, 'epoch': 13.5}

 84%|████████▍ | 313540/371472 [2:46:47<4:34:32,  3.52it/s]
 84%|████████▍ | 313541/371472 [2:46:47<4:31:05,  3.56it/s]
 84%|████████▍ | 313542/371472 [2:46:48<4:43:56,  3.40it/s]
 84%|████████▍ | 313543/371472 [2:46:48<4:24:54,  3.64it/s]
 84%|████████▍ | 313544/371472 [2:46:48<4:17:00,  3.76it/s]
 84%|████████▍ | 313545/371472 [2:46:48<4:27:28,  3.61it/s]
 84%|████████▍ | 313546/371472 [2:46:49<4:38:05,  3.47it/s]
 84%|████████▍ | 313547/371472 [2:46:49<4:23:11,  3.67it/s]
 84%|████████▍ | 313548/371472 [2:46:49<4:23:19,  3.67it/s]
 84%|████████▍ | 313549/371472 [2:46:49<4:32:55,  3.54it/s]
 84%|████████▍ | 313550/371472 [2:46:50<4:41:26,  3.43it/s]
 84%|████████▍ | 313551/371472 [2:46:50<4:33:00,  3.54it/s]
 84%|████████▍ | 313552/371472 [2:46:50<4:48:13,  3.35it/s]
 84%|████████▍ | 313553/371472 [2:46:51<4:34:16,  3.52it/s]
 84%|████████▍ | 313554/371472 [2:46:51<4:35:13,  3.51it/s]
 84%|████████▍ | 313555/371472 [2:46:51<4:23:29,  3.66it/s]
 84%|████████▍ | 313556/371472 [2:46:51<4:22:53,  3.67it/s]
 84%|████████▍ | 313557/371472 [2:46:52<4:24:41,  3.65it/s]
 84%|████████▍ | 313558/371472 [2:46:52<4:20:47,  3.70it/s]
 84%|████████▍ | 313559/371472 [2:46:52<4:22:55,  3.67it/s]
 84%|████████▍ | 313560/371472 [2:46:52<4:20:48,  3.70it/s]
                                                           
{'loss': 2.689, 'learning_rate': 2.4038440819668596e-07, 'epoch': 13.51}

 84%|████████▍ | 313560/371472 [2:46:52<4:20:48,  3.70it/s]
 84%|████████▍ | 313561/371472 [2:46:53<4:14:14,  3.80it/s]
 84%|████████▍ | 313562/371472 [2:46:53<4:18:42,  3.73it/s]
 84%|████████▍ | 313563/371472 [2:46:53<4:15:40,  3.78it/s]
 84%|████████▍ | 313564/371472 [2:46:54<4:09:57,  3.86it/s]
 84%|████████▍ | 313565/371472 [2:46:54<4:14:42,  3.79it/s]
 84%|████████▍ | 313566/371472 [2:46:54<4:13:25,  3.81it/s]
 84%|████████▍ | 313567/371472 [2:46:54<4:27:01,  3.61it/s]
 84%|████████▍ | 313568/371472 [2:46:55<4:17:08,  3.75it/s]
 84%|████████▍ | 313569/371472 [2:46:55<4:48:45,  3.34it/s]
 84%|████████▍ | 313570/371472 [2:46:55<4:29:16,  3.58it/s]
 84%|████████▍ | 313571/371472 [2:46:56<4:57:26,  3.24it/s]
 84%|████████▍ | 313572/371472 [2:46:56<4:42:24,  3.42it/s]
 84%|████████▍ | 313573/371472 [2:46:56<4:51:12,  3.31it/s]
 84%|████████▍ | 313574/371472 [2:46:56<4:51:38,  3.31it/s]
 84%|████████▍ | 313575/371472 [2:46:57<4:34:42,  3.51it/s]
 84%|████████▍ | 313576/371472 [2:46:57<4:55:42,  3.26it/s]
 84%|████████▍ | 313577/371472 [2:46:57<4:44:36,  3.39it/s]
 84%|████████▍ | 313578/371472 [2:46:58<4:34:27,  3.52it/s]
 84%|████████▍ | 313579/371472 [2:46:58<4:22:00,  3.68it/s]
 84%|████████▍ | 313580/371472 [2:46:58<4:18:38,  3.73it/s]
                                                           
{'loss': 2.6423, 'learning_rate': 2.4033592622120714e-07, 'epoch': 13.51}

 84%|████████▍ | 313580/371472 [2:46:58<4:18:38,  3.73it/s]
 84%|████████▍ | 313581/371472 [2:46:58<4:41:03,  3.43it/s]
 84%|████████▍ | 313582/371472 [2:46:59<4:46:11,  3.37it/s]
 84%|████████▍ | 313583/371472 [2:46:59<4:41:06,  3.43it/s]
 84%|████████▍ | 313584/371472 [2:46:59<4:48:02,  3.35it/s]
 84%|████████▍ | 313585/371472 [2:47:00<4:35:32,  3.50it/s]
 84%|████████▍ | 313586/371472 [2:47:00<4:40:49,  3.44it/s]
 84%|████████▍ | 313587/371472 [2:47:00<4:56:21,  3.26it/s]
 84%|████████▍ | 313588/371472 [2:47:01<4:46:12,  3.37it/s]
 84%|████████▍ | 313589/371472 [2:47:01<4:29:08,  3.58it/s]
 84%|████████▍ | 313590/371472 [2:47:01<4:33:05,  3.53it/s]
 84%|████████▍ | 313591/371472 [2:47:01<4:36:12,  3.49it/s]
 84%|████████▍ | 313592/371472 [2:47:02<4:25:28,  3.63it/s]
 84%|████████▍ | 313593/371472 [2:47:02<4:19:19,  3.72it/s]
 84%|████████▍ | 313594/371472 [2:47:02<4:29:20,  3.58it/s]
 84%|████████▍ | 313595/371472 [2:47:03<4:51:47,  3.31it/s]
 84%|████████▍ | 313596/371472 [2:47:03<4:56:06,  3.26it/s]
 84%|████████▍ | 313597/371472 [2:47:03<4:56:40,  3.25it/s]
 84%|████████▍ | 313598/371472 [2:47:03<4:46:29,  3.37it/s]
 84%|████████▍ | 313599/371472 [2:47:04<4:39:52,  3.45it/s]
 84%|████████▍ | 313600/371472 [2:47:04<4:30:47,  3.56it/s]
                                                           
{'loss': 2.6292, 'learning_rate': 2.402874442457282e-07, 'epoch': 13.51}

 84%|████████▍ | 313600/371472 [2:47:04<4:30:47,  3.56it/s]
 84%|████████▍ | 313601/371472 [2:47:04<4:29:55,  3.57it/s]
 84%|████████▍ | 313602/371472 [2:47:04<4:18:24,  3.73it/s]
 84%|████████▍ | 313603/371472 [2:47:05<4:14:49,  3.78it/s]
 84%|████████▍ | 313604/371472 [2:47:05<4:34:31,  3.51it/s]
 84%|████████▍ | 313605/371472 [2:47:05<4:30:04,  3.57it/s]
 84%|████████▍ | 313606/371472 [2:47:06<4:16:44,  3.76it/s]
 84%|████████▍ | 313607/371472 [2:47:06<4:16:00,  3.77it/s]
 84%|████████▍ | 313608/371472 [2:47:06<4:46:38,  3.36it/s]
 84%|████████▍ | 313609/371472 [2:47:06<4:36:28,  3.49it/s]
 84%|████████▍ | 313610/371472 [2:47:07<4:42:40,  3.41it/s]
 84%|████████▍ | 313611/371472 [2:47:07<4:45:13,  3.38it/s]
 84%|████████▍ | 313612/371472 [2:47:07<4:34:50,  3.51it/s]
 84%|████████▍ | 313613/371472 [2:47:08<4:30:50,  3.56it/s]
 84%|████████▍ | 313614/371472 [2:47:08<4:27:54,  3.60it/s]
 84%|████████▍ | 313615/371472 [2:47:08<4:22:26,  3.67it/s]
 84%|████████▍ | 313616/371472 [2:47:08<4:15:49,  3.77it/s]
 84%|████████▍ | 313617/371472 [2:47:09<4:23:09,  3.66it/s]
 84%|████████▍ | 313618/371472 [2:47:09<4:20:18,  3.70it/s]
 84%|████████▍ | 313619/371472 [2:47:09<4:23:45,  3.66it/s]
 84%|████████▍ | 313620/371472 [2:47:09<4:15:14,  3.78it/s]
                                                           
{'loss': 2.734, 'learning_rate': 2.4023896227024934e-07, 'epoch': 13.51}

 84%|████████▍ | 313620/371472 [2:47:09<4:15:14,  3.78it/s]
 84%|████████▍ | 313621/371472 [2:47:10<4:32:25,  3.54it/s]
 84%|████████▍ | 313622/371472 [2:47:10<4:30:40,  3.56it/s]
 84%|████████▍ | 313623/371472 [2:47:10<4:24:14,  3.65it/s]
 84%|████████▍ | 313624/371472 [2:47:11<4:15:20,  3.78it/s]
 84%|████████▍ | 313625/371472 [2:47:11<4:28:28,  3.59it/s]
 84%|████████▍ | 313626/371472 [2:47:11<4:23:32,  3.66it/s]
 84%|████████▍ | 313627/371472 [2:47:11<4:32:02,  3.54it/s]
 84%|████████▍ | 313628/371472 [2:47:12<4:36:41,  3.48it/s]
 84%|████████▍ | 313629/371472 [2:47:12<4:49:57,  3.32it/s]
 84%|████████▍ | 313630/371472 [2:47:12<4:34:32,  3.51it/s]
 84%|████████▍ | 313631/371472 [2:47:13<4:22:57,  3.67it/s]
 84%|████████▍ | 313632/371472 [2:47:13<4:24:27,  3.65it/s]
 84%|████████▍ | 313633/371472 [2:47:13<4:21:01,  3.69it/s]
 84%|████████▍ | 313634/371472 [2:47:13<4:20:35,  3.70it/s]
 84%|████████▍ | 313635/371472 [2:47:14<4:17:01,  3.75it/s]
 84%|████████▍ | 313636/371472 [2:47:14<4:14:53,  3.78it/s]
 84%|████████▍ | 313637/371472 [2:47:14<4:46:25,  3.37it/s]
 84%|████████▍ | 313638/371472 [2:47:15<4:46:58,  3.36it/s]
 84%|████████▍ | 313639/371472 [2:47:15<4:42:50,  3.41it/s]
 84%|████████▍ | 313640/371472 [2:47:15<4:47:39,  3.35it/s]
                                                           
{'loss': 2.6066, 'learning_rate': 2.4019048029477035e-07, 'epoch': 13.51}

 84%|████████▍ | 313640/371472 [2:47:15<4:47:39,  3.35it/s]
 84%|████████▍ | 313641/371472 [2:47:15<4:34:20,  3.51it/s]
 84%|████████▍ | 313642/371472 [2:47:16<4:31:24,  3.55it/s]
 84%|████████▍ | 313643/371472 [2:47:16<4:24:41,  3.64it/s]
 84%|████████▍ | 313644/371472 [2:47:16<4:37:23,  3.47it/s]
 84%|████████▍ | 313645/371472 [2:47:17<4:30:14,  3.57it/s]
 84%|████████▍ | 313646/371472 [2:47:17<5:07:06,  3.14it/s]
 84%|████████▍ | 313647/371472 [2:47:17<5:10:55,  3.10it/s]
 84%|████████▍ | 313648/371472 [2:47:18<5:00:41,  3.21it/s]
 84%|████████▍ | 313649/371472 [2:47:18<5:24:02,  2.97it/s]
 84%|████████▍ | 313650/371472 [2:47:18<5:12:44,  3.08it/s]
 84%|████████▍ | 313651/371472 [2:47:18<4:48:08,  3.34it/s]
 84%|████████▍ | 313652/371472 [2:47:19<4:48:11,  3.34it/s]
 84%|████████▍ | 313653/371472 [2:47:19<4:36:30,  3.48it/s]
 84%|████████▍ | 313654/371472 [2:47:19<4:40:17,  3.44it/s]
 84%|████████▍ | 313655/371472 [2:47:20<4:38:00,  3.47it/s]
 84%|████████▍ | 313656/371472 [2:47:20<4:30:18,  3.56it/s]
 84%|████████▍ | 313657/371472 [2:47:20<4:30:01,  3.57it/s]
 84%|████████▍ | 313658/371472 [2:47:20<4:28:59,  3.58it/s]
 84%|████████▍ | 313659/371472 [2:47:21<4:35:47,  3.49it/s]
 84%|████████▍ | 313660/371472 [2:47:21<4:29:47,  3.57it/s]
                                                           
{'loss': 2.5064, 'learning_rate': 2.4014199831929153e-07, 'epoch': 13.51}

 84%|████████▍ | 313660/371472 [2:47:21<4:29:47,  3.57it/s]
 84%|████████▍ | 313661/371472 [2:47:21<4:35:33,  3.50it/s]
 84%|████████▍ | 313662/371472 [2:47:22<4:37:16,  3.47it/s]
 84%|████████▍ | 313663/371472 [2:47:22<4:54:02,  3.28it/s]
 84%|████████▍ | 313664/371472 [2:47:22<4:41:55,  3.42it/s]
 84%|████████▍ | 313665/371472 [2:47:22<4:33:19,  3.52it/s]
 84%|████████▍ | 313666/371472 [2:47:23<4:34:58,  3.50it/s]
 84%|████████▍ | 313667/371472 [2:47:23<4:26:12,  3.62it/s]
 84%|████████▍ | 313668/371472 [2:47:23<4:42:56,  3.40it/s]
 84%|████████▍ | 313669/371472 [2:47:24<4:36:06,  3.49it/s]
 84%|████████▍ | 313670/371472 [2:47:24<4:30:18,  3.56it/s]
 84%|████████▍ | 313671/371472 [2:47:24<4:20:21,  3.70it/s]
 84%|████████▍ | 313672/371472 [2:47:24<4:16:04,  3.76it/s]
 84%|████████▍ | 313673/371472 [2:47:25<4:15:57,  3.76it/s]
 84%|████████▍ | 313674/371472 [2:47:25<4:16:15,  3.76it/s]
 84%|████████▍ | 313675/371472 [2:47:25<4:34:22,  3.51it/s]
 84%|████████▍ | 313676/371472 [2:47:26<4:39:40,  3.44it/s]
 84%|████████▍ | 313677/371472 [2:47:26<4:34:25,  3.51it/s]
 84%|████████▍ | 313678/371472 [2:47:26<4:26:29,  3.61it/s]
 84%|████████▍ | 313679/371472 [2:47:26<4:31:34,  3.55it/s]
 84%|████████▍ | 313680/371472 [2:47:27<4:26:59,  3.61it/s]
                                                           
{'loss': 2.6212, 'learning_rate': 2.400935163438126e-07, 'epoch': 13.51}

 84%|████████▍ | 313680/371472 [2:47:27<4:26:59,  3.61it/s]
 84%|████████▍ | 313681/371472 [2:47:27<4:19:40,  3.71it/s]
 84%|████████▍ | 313682/371472 [2:47:27<4:14:22,  3.79it/s]
 84%|████████▍ | 313683/371472 [2:47:27<4:12:40,  3.81it/s]
 84%|████████▍ | 313684/371472 [2:47:28<4:12:19,  3.82it/s]
 84%|████████▍ | 313685/371472 [2:47:28<4:10:24,  3.85it/s]
 84%|████████▍ | 313686/371472 [2:47:28<4:15:38,  3.77it/s]
 84%|████████▍ | 313687/371472 [2:47:28<4:17:17,  3.74it/s]
 84%|████████▍ | 313688/371472 [2:47:29<4:17:36,  3.74it/s]
 84%|████████▍ | 313689/371472 [2:47:29<4:35:29,  3.50it/s]
 84%|████████▍ | 313690/371472 [2:47:29<4:27:41,  3.60it/s]
 84%|████████▍ | 313691/371472 [2:47:30<4:23:10,  3.66it/s]
 84%|████████▍ | 313692/371472 [2:47:30<4:42:33,  3.41it/s]
 84%|████████▍ | 313693/371472 [2:47:30<4:41:08,  3.43it/s]
 84%|████████▍ | 313694/371472 [2:47:30<4:41:13,  3.42it/s]
 84%|████████▍ | 313695/371472 [2:47:31<5:11:15,  3.09it/s]
 84%|████████▍ | 313696/371472 [2:47:31<4:56:32,  3.25it/s]
 84%|████████▍ | 313697/371472 [2:47:31<4:51:24,  3.30it/s]
 84%|████████▍ | 313698/371472 [2:47:32<4:40:04,  3.44it/s]
 84%|████████▍ | 313699/371472 [2:47:32<4:35:25,  3.50it/s]
 84%|████████▍ | 313700/371472 [2:47:32<4:32:55,  3.53it/s]
                                                           
{'loss': 2.4765, 'learning_rate': 2.400450343683338e-07, 'epoch': 13.51}

 84%|████████▍ | 313700/371472 [2:47:32<4:32:55,  3.53it/s]
 84%|████████▍ | 313701/371472 [2:47:33<4:28:24,  3.59it/s]
 84%|████████▍ | 313702/371472 [2:47:33<4:30:21,  3.56it/s]
 84%|████████▍ | 313703/371472 [2:47:33<4:23:03,  3.66it/s]
 84%|████████▍ | 313704/371472 [2:47:33<4:25:29,  3.63it/s]
 84%|████████▍ | 313705/371472 [2:47:34<4:31:10,  3.55it/s]
 84%|████████▍ | 313706/371472 [2:47:34<4:31:09,  3.55it/s]
 84%|████████▍ | 313707/371472 [2:47:34<4:23:05,  3.66it/s]
 84%|████████▍ | 313708/371472 [2:47:34<4:23:25,  3.65it/s]
 84%|████████▍ | 313709/371472 [2:47:35<4:41:33,  3.42it/s]
 84%|████████▍ | 313710/371472 [2:47:35<4:36:26,  3.48it/s]
 84%|████████▍ | 313711/371472 [2:47:35<5:01:02,  3.20it/s]
 84%|████████▍ | 313712/371472 [2:47:36<4:46:49,  3.36it/s]
 84%|████████▍ | 313713/371472 [2:47:36<4:38:39,  3.45it/s]
 84%|████████▍ | 313714/371472 [2:47:36<4:47:31,  3.35it/s]
 84%|████████▍ | 313715/371472 [2:47:37<4:42:09,  3.41it/s]
 84%|████████▍ | 313716/371472 [2:47:37<4:53:48,  3.28it/s]
 84%|████████▍ | 313717/371472 [2:47:37<4:39:03,  3.45it/s]
 84%|████████▍ | 313718/371472 [2:47:37<4:26:22,  3.61it/s]
 84%|████████▍ | 313719/371472 [2:47:38<4:16:04,  3.76it/s]
 84%|████████▍ | 313720/371472 [2:47:38<4:08:19,  3.88it/s]
                                                           
{'loss': 2.6867, 'learning_rate': 2.3999655239285485e-07, 'epoch': 13.51}

 84%|████████▍ | 313720/371472 [2:47:38<4:08:19,  3.88it/s]
 84%|████████▍ | 313721/371472 [2:47:38<4:22:00,  3.67it/s]
 84%|████████▍ | 313722/371472 [2:47:38<4:20:34,  3.69it/s]
 84%|████████▍ | 313723/371472 [2:47:39<4:17:02,  3.74it/s]
 84%|████████▍ | 313724/371472 [2:47:39<4:33:39,  3.52it/s]
 84%|████████▍ | 313725/371472 [2:47:39<4:25:08,  3.63it/s]
 84%|████████▍ | 313726/371472 [2:47:40<4:20:14,  3.70it/s]
 84%|████████▍ | 313727/371472 [2:47:40<4:16:19,  3.75it/s]
 84%|████████▍ | 313728/371472 [2:47:40<4:17:28,  3.74it/s]
 84%|████████▍ | 313729/371472 [2:47:40<4:21:29,  3.68it/s]
 84%|████████▍ | 313730/371472 [2:47:41<4:18:12,  3.73it/s]
 84%|████████▍ | 313731/371472 [2:47:41<4:12:54,  3.81it/s]
 84%|████████▍ | 313732/371472 [2:47:41<4:09:45,  3.85it/s]
 84%|████████▍ | 313733/371472 [2:47:41<4:20:09,  3.70it/s]
 84%|████████▍ | 313734/371472 [2:47:42<4:15:40,  3.76it/s]
 84%|████████▍ | 313735/371472 [2:47:42<4:29:07,  3.58it/s]
 84%|████████▍ | 313736/371472 [2:47:42<4:15:37,  3.76it/s]
 84%|████████▍ | 313737/371472 [2:47:42<4:11:49,  3.82it/s]
 84%|████████▍ | 313738/371472 [2:47:43<4:13:51,  3.79it/s]
 84%|████████▍ | 313739/371472 [2:47:43<4:09:04,  3.86it/s]
 84%|████████▍ | 313740/371472 [2:47:43<4:23:28,  3.65it/s]
                                                           
{'loss': 2.5274, 'learning_rate': 2.3994807041737587e-07, 'epoch': 13.51}

 84%|████████▍ | 313740/371472 [2:47:43<4:23:28,  3.65it/s]
 84%|████████▍ | 313741/371472 [2:47:44<4:24:44,  3.63it/s]
 84%|████████▍ | 313742/371472 [2:47:44<4:45:56,  3.36it/s]
 84%|████████▍ | 313743/371472 [2:47:44<4:42:27,  3.41it/s]
 84%|████████▍ | 313744/371472 [2:47:45<4:52:41,  3.29it/s]
 84%|████████▍ | 313745/371472 [2:47:45<4:49:14,  3.33it/s]
 84%|████████▍ | 313746/371472 [2:47:45<4:40:58,  3.42it/s]
 84%|████████▍ | 313747/371472 [2:47:45<4:52:55,  3.28it/s]
 84%|████████▍ | 313748/371472 [2:47:46<4:36:24,  3.48it/s]
 84%|████████▍ | 313749/371472 [2:47:46<4:40:36,  3.43it/s]
 84%|████████▍ | 313750/371472 [2:47:46<4:40:05,  3.43it/s]
 84%|████████▍ | 313751/371472 [2:47:47<4:27:32,  3.60it/s]
 84%|████████▍ | 313752/371472 [2:47:47<4:24:23,  3.64it/s]
 84%|████████▍ | 313753/371472 [2:47:47<4:35:26,  3.49it/s]
 84%|████████▍ | 313754/371472 [2:47:47<4:48:05,  3.34it/s]
 84%|████████▍ | 313755/371472 [2:47:48<4:42:29,  3.41it/s]
 84%|████████▍ | 313756/371472 [2:47:48<5:08:39,  3.12it/s]
 84%|████████▍ | 313757/371472 [2:47:48<4:51:03,  3.30it/s]
 84%|████████▍ | 313758/371472 [2:47:49<4:35:44,  3.49it/s]
 84%|████████▍ | 313759/371472 [2:47:49<4:35:28,  3.49it/s]
 84%|████████▍ | 313760/371472 [2:47:49<4:31:24,  3.54it/s]
                                                           
{'loss': 2.5631, 'learning_rate': 2.3989958844189705e-07, 'epoch': 13.51}

 84%|████████▍ | 313760/371472 [2:47:49<4:31:24,  3.54it/s]
 84%|████████▍ | 313761/371472 [2:47:49<4:29:16,  3.57it/s]
 84%|████████▍ | 313762/371472 [2:47:50<4:42:09,  3.41it/s]
 84%|████████▍ | 313763/371472 [2:47:50<4:48:07,  3.34it/s]
 84%|████████▍ | 313764/371472 [2:47:50<4:34:32,  3.50it/s]
 84%|████████▍ | 313765/371472 [2:47:51<4:29:29,  3.57it/s]
 84%|████████▍ | 313766/371472 [2:47:51<4:24:49,  3.63it/s]
 84%|████████▍ | 313767/371472 [2:47:51<4:28:48,  3.58it/s]
 84%|████████▍ | 313768/371472 [2:47:51<4:26:04,  3.61it/s]
 84%|████████▍ | 313769/371472 [2:47:52<4:42:32,  3.40it/s]
 84%|████████▍ | 313770/371472 [2:47:52<4:30:16,  3.56it/s]
 84%|████████▍ | 313771/371472 [2:47:52<4:28:46,  3.58it/s]
 84%|████████▍ | 313772/371472 [2:47:53<4:18:20,  3.72it/s]
 84%|████████▍ | 313773/371472 [2:47:53<4:25:41,  3.62it/s]
 84%|████████▍ | 313774/371472 [2:47:53<4:15:40,  3.76it/s]
 84%|████████▍ | 313775/371472 [2:47:53<4:14:20,  3.78it/s]
 84%|████████▍ | 313776/371472 [2:47:54<4:12:38,  3.81it/s]
 84%|████████▍ | 313777/371472 [2:47:54<4:12:03,  3.81it/s]
 84%|████████▍ | 313778/371472 [2:47:54<4:13:48,  3.79it/s]
 84%|████████▍ | 313779/371472 [2:47:54<4:19:30,  3.71it/s]
 84%|████████▍ | 313780/371472 [2:47:55<4:08:18,  3.87it/s]
                                                           
{'loss': 2.7278, 'learning_rate': 2.3985110646641807e-07, 'epoch': 13.52}

 84%|████████▍ | 313780/371472 [2:47:55<4:08:18,  3.87it/s]
 84%|████████▍ | 313781/371472 [2:47:55<4:23:02,  3.66it/s]
 84%|████████▍ | 313782/371472 [2:47:55<4:20:15,  3.69it/s]
 84%|████████▍ | 313783/371472 [2:47:55<4:19:04,  3.71it/s]
 84%|████████▍ | 313784/371472 [2:47:56<4:11:58,  3.82it/s]
 84%|████████▍ | 313785/371472 [2:47:56<4:20:24,  3.69it/s]
 84%|████████▍ | 313786/371472 [2:47:56<4:24:57,  3.63it/s]
 84%|████████▍ | 313787/371472 [2:47:57<4:46:25,  3.36it/s]
 84%|████████▍ | 313788/371472 [2:47:57<4:32:56,  3.52it/s]
 84%|████████▍ | 313789/371472 [2:47:57<4:31:22,  3.54it/s]
 84%|████████▍ | 313790/371472 [2:47:58<5:15:58,  3.04it/s]
 84%|████████▍ | 313791/371472 [2:47:58<4:55:45,  3.25it/s]
 84%|████████▍ | 313792/371472 [2:47:58<4:37:45,  3.46it/s]
 84%|████████▍ | 313793/371472 [2:47:58<4:33:17,  3.52it/s]
 84%|████████▍ | 313794/371472 [2:47:59<4:25:49,  3.62it/s]
 84%|████████▍ | 313795/371472 [2:47:59<4:27:48,  3.59it/s]
 84%|████████▍ | 313796/371472 [2:47:59<4:16:45,  3.74it/s]
 84%|████████▍ | 313797/371472 [2:47:59<4:08:32,  3.87it/s]
 84%|████████▍ | 313798/371472 [2:48:00<4:41:19,  3.42it/s]
 84%|████████▍ | 313799/371472 [2:48:00<4:39:47,  3.44it/s]
 84%|████████▍ | 313800/371472 [2:48:00<4:31:06,  3.55it/s]
                                                           
{'loss': 2.5514, 'learning_rate': 2.3980262449093924e-07, 'epoch': 13.52}

 84%|████████▍ | 313800/371472 [2:48:00<4:31:06,  3.55it/s]
 84%|████████▍ | 313801/371472 [2:48:01<4:27:42,  3.59it/s]
 84%|████████▍ | 313802/371472 [2:48:01<4:38:55,  3.45it/s]
 84%|████████▍ | 313803/371472 [2:48:01<4:26:20,  3.61it/s]
 84%|████████▍ | 313804/371472 [2:48:01<4:19:35,  3.70it/s]
 84%|████████▍ | 313805/371472 [2:48:02<4:21:52,  3.67it/s]
 84%|████████▍ | 313806/371472 [2:48:02<4:29:10,  3.57it/s]
 84%|████████▍ | 313807/371472 [2:48:02<4:26:33,  3.61it/s]
 84%|████████▍ | 313808/371472 [2:48:03<4:21:18,  3.68it/s]
 84%|████████▍ | 313809/371472 [2:48:03<4:11:01,  3.83it/s]
 84%|████████▍ | 313810/371472 [2:48:03<4:26:01,  3.61it/s]
 84%|████████▍ | 313811/371472 [2:48:03<4:27:45,  3.59it/s]
 84%|████████▍ | 313812/371472 [2:48:04<4:16:15,  3.75it/s]
 84%|████████▍ | 313813/371472 [2:48:04<4:26:52,  3.60it/s]
 84%|████████▍ | 313814/371472 [2:48:04<4:16:30,  3.75it/s]
 84%|████████▍ | 313815/371472 [2:48:04<4:12:58,  3.80it/s]
 84%|████████▍ | 313816/371472 [2:48:05<4:38:59,  3.44it/s]
 84%|████████▍ | 313817/371472 [2:48:05<4:39:32,  3.44it/s]
 84%|████████▍ | 313818/371472 [2:48:05<4:40:44,  3.42it/s]
 84%|████████▍ | 313819/371472 [2:48:06<4:33:47,  3.51it/s]
 84%|████████▍ | 313820/371472 [2:48:06<4:25:27,  3.62it/s]
                                                           
{'loss': 2.6512, 'learning_rate': 2.397541425154603e-07, 'epoch': 13.52}

 84%|████████▍ | 313820/371472 [2:48:06<4:25:27,  3.62it/s]
 84%|████████▍ | 313821/371472 [2:48:06<4:31:22,  3.54it/s]
 84%|████████▍ | 313822/371472 [2:48:06<4:20:23,  3.69it/s]
 84%|████████▍ | 313823/371472 [2:48:07<4:08:35,  3.87it/s]
 84%|████████▍ | 313824/371472 [2:48:07<4:13:26,  3.79it/s]
 84%|████████▍ | 313825/371472 [2:48:07<4:36:07,  3.48it/s]
 84%|████████▍ | 313826/371472 [2:48:08<4:53:03,  3.28it/s]
 84%|████████▍ | 313827/371472 [2:48:08<4:54:05,  3.27it/s]
 84%|████████▍ | 313828/371472 [2:48:08<4:42:47,  3.40it/s]
 84%|████████▍ | 313829/371472 [2:48:08<4:29:17,  3.57it/s]
 84%|████████▍ | 313830/371472 [2:48:09<4:22:45,  3.66it/s]
 84%|████████▍ | 313831/371472 [2:48:09<4:25:10,  3.62it/s]
 84%|████████▍ | 313832/371472 [2:48:09<4:16:35,  3.74it/s]
 84%|████████▍ | 313833/371472 [2:48:09<4:12:13,  3.81it/s]
 84%|████████▍ | 313834/371472 [2:48:10<4:19:36,  3.70it/s]
 84%|████████▍ | 313835/371472 [2:48:10<4:22:33,  3.66it/s]
 84%|████████▍ | 313836/371472 [2:48:10<4:21:56,  3.67it/s]
 84%|████████▍ | 313837/371472 [2:48:11<4:17:20,  3.73it/s]
 84%|████████▍ | 313838/371472 [2:48:11<4:17:33,  3.73it/s]
 84%|████████▍ | 313839/371472 [2:48:11<4:24:39,  3.63it/s]
 84%|████████▍ | 313840/371472 [2:48:11<4:33:39,  3.51it/s]
                                                           
{'loss': 2.7746, 'learning_rate': 2.397056605399815e-07, 'epoch': 13.52}

 84%|████████▍ | 313840/371472 [2:48:11<4:33:39,  3.51it/s]
 84%|████████▍ | 313841/371472 [2:48:12<4:28:46,  3.57it/s]
 84%|████████▍ | 313842/371472 [2:48:12<4:26:18,  3.61it/s]
 84%|████████▍ | 313843/371472 [2:48:12<4:26:56,  3.60it/s]
 84%|████████▍ | 313844/371472 [2:48:13<5:04:57,  3.15it/s]
 84%|████████▍ | 313845/371472 [2:48:13<4:43:52,  3.38it/s]
 84%|████████▍ | 313846/371472 [2:48:13<5:08:14,  3.12it/s]
 84%|████████▍ | 313847/371472 [2:48:14<5:18:48,  3.01it/s]
 84%|████████▍ | 313848/371472 [2:48:14<4:59:47,  3.20it/s]
 84%|████████▍ | 313849/371472 [2:48:14<4:52:59,  3.28it/s]
 84%|████████▍ | 313850/371472 [2:48:14<4:39:10,  3.44it/s]
 84%|████████▍ | 313851/371472 [2:48:15<4:58:21,  3.22it/s]
 84%|████████▍ | 313852/371472 [2:48:15<4:46:38,  3.35it/s]
 84%|████████▍ | 313853/371472 [2:48:15<4:37:20,  3.46it/s]
 84%|████████▍ | 313854/371472 [2:48:16<4:33:10,  3.52it/s]
 84%|████████▍ | 313855/371472 [2:48:16<4:32:52,  3.52it/s]
 84%|████████▍ | 313856/371472 [2:48:16<4:46:03,  3.36it/s]
 84%|████████▍ | 313857/371472 [2:48:16<4:38:04,  3.45it/s]
 84%|████████▍ | 313858/371472 [2:48:17<4:43:26,  3.39it/s]
 84%|████████▍ | 313859/371472 [2:48:17<4:27:41,  3.59it/s]
 84%|████████▍ | 313860/371472 [2:48:17<4:28:54,  3.57it/s]
                                                           
{'loss': 2.4491, 'learning_rate': 2.3965717856450256e-07, 'epoch': 13.52}

 84%|████████▍ | 313860/371472 [2:48:17<4:28:54,  3.57it/s]
 84%|████████▍ | 313861/371472 [2:48:18<4:29:05,  3.57it/s]
 84%|████████▍ | 313862/371472 [2:48:18<4:25:44,  3.61it/s]
 84%|████████▍ | 313863/371472 [2:48:18<4:54:47,  3.26it/s]
 84%|████████▍ | 313864/371472 [2:48:19<4:39:41,  3.43it/s]
 84%|████████▍ | 313865/371472 [2:48:19<4:22:10,  3.66it/s]
 84%|████████▍ | 313866/371472 [2:48:19<4:14:13,  3.78it/s]
 84%|████████▍ | 313867/371472 [2:48:19<4:11:56,  3.81it/s]
 84%|████████▍ | 313868/371472 [2:48:20<4:19:10,  3.70it/s]
 84%|████████▍ | 313869/371472 [2:48:20<4:23:10,  3.65it/s]
 84%|████████▍ | 313870/371472 [2:48:20<4:22:05,  3.66it/s]
 84%|████████▍ | 313871/371472 [2:48:20<4:22:24,  3.66it/s]
 84%|████████▍ | 313872/371472 [2:48:21<4:23:18,  3.65it/s]
 84%|████████▍ | 313873/371472 [2:48:21<4:30:17,  3.55it/s]
 84%|████████▍ | 313874/371472 [2:48:21<4:24:24,  3.63it/s]
 84%|████████▍ | 313875/371472 [2:48:21<4:28:57,  3.57it/s]
 84%|████████▍ | 313876/371472 [2:48:22<4:34:23,  3.50it/s]
 84%|████████▍ | 313877/371472 [2:48:22<4:41:47,  3.41it/s]
 84%|████████▍ | 313878/371472 [2:48:22<4:41:27,  3.41it/s]
 84%|████████▍ | 313879/371472 [2:48:23<4:31:27,  3.54it/s]
 84%|████████▍ | 313880/371472 [2:48:23<4:43:14,  3.39it/s]
                                                           
{'loss': 2.6522, 'learning_rate': 2.396086965890237e-07, 'epoch': 13.52}

 84%|████████▍ | 313880/371472 [2:48:23<4:43:14,  3.39it/s]
 84%|████████▍ | 313881/371472 [2:48:23<5:29:35,  2.91it/s]
 84%|████████▍ | 313882/371472 [2:48:24<5:01:23,  3.18it/s]
 84%|████████▍ | 313883/371472 [2:48:24<4:56:09,  3.24it/s]
 84%|████████▍ | 313884/371472 [2:48:24<4:42:49,  3.39it/s]
 84%|████████▍ | 313885/371472 [2:48:24<4:33:15,  3.51it/s]
 84%|████████▍ | 313886/371472 [2:48:25<4:33:31,  3.51it/s]
 84%|████████▍ | 313887/371472 [2:48:25<4:19:49,  3.69it/s]
 84%|████████▍ | 313888/371472 [2:48:25<4:13:18,  3.79it/s]
 84%|████████▍ | 313889/371472 [2:48:26<4:15:18,  3.76it/s]
 84%|████████▍ | 313890/371472 [2:48:26<4:10:52,  3.83it/s]
 84%|████████▍ | 313891/371472 [2:48:26<4:11:45,  3.81it/s]
 84%|████████▍ | 313892/371472 [2:48:26<4:15:21,  3.76it/s]
 84%|████████▍ | 313893/371472 [2:48:27<4:26:14,  3.60it/s]
 85%|████████▍ | 313894/371472 [2:48:27<4:28:33,  3.57it/s]
 85%|████████▍ | 313895/371472 [2:48:27<4:13:36,  3.78it/s]
 85%|████████▍ | 313896/371472 [2:48:27<4:41:39,  3.41it/s]
 85%|████████▍ | 313897/371472 [2:48:28<4:49:12,  3.32it/s]
 85%|████████▍ | 313898/371472 [2:48:28<4:38:52,  3.44it/s]
 85%|████████▍ | 313899/371472 [2:48:28<4:34:07,  3.50it/s]
 85%|████████▍ | 313900/371472 [2:48:29<4:21:42,  3.67it/s]
                                                           
{'loss': 2.6163, 'learning_rate': 2.395602146135447e-07, 'epoch': 13.52}

 85%|████████▍ | 313900/371472 [2:48:29<4:21:42,  3.67it/s]
 85%|████████▍ | 313901/371472 [2:48:29<4:12:38,  3.80it/s]
 85%|████████▍ | 313902/371472 [2:48:29<4:34:54,  3.49it/s]
 85%|████████▍ | 313903/371472 [2:48:29<4:24:24,  3.63it/s]
 85%|████████▍ | 313904/371472 [2:48:30<4:12:58,  3.79it/s]
 85%|████████▍ | 313905/371472 [2:48:30<4:13:04,  3.79it/s]
 85%|████████▍ | 313906/371472 [2:48:30<4:11:42,  3.81it/s]
 85%|████████▍ | 313907/371472 [2:48:30<4:13:05,  3.79it/s]
 85%|████████▍ | 313908/371472 [2:48:31<4:20:12,  3.69it/s]
 85%|████████▍ | 313909/371472 [2:48:31<4:11:42,  3.81it/s]
 85%|████████▍ | 313910/371472 [2:48:31<4:18:16,  3.71it/s]
 85%|████████▍ | 313911/371472 [2:48:32<4:20:55,  3.68it/s]
 85%|████████▍ | 313912/371472 [2:48:32<4:18:41,  3.71it/s]
 85%|████████▍ | 313913/371472 [2:48:32<4:14:00,  3.78it/s]
 85%|████████▍ | 313914/371472 [2:48:32<4:14:06,  3.78it/s]
 85%|████████▍ | 313915/371472 [2:48:33<4:07:44,  3.87it/s]
 85%|████████▍ | 313916/371472 [2:48:33<4:23:15,  3.64it/s]
 85%|████████▍ | 313917/371472 [2:48:33<4:16:35,  3.74it/s]
 85%|████████▍ | 313918/371472 [2:48:33<4:14:15,  3.77it/s]
 85%|████████▍ | 313919/371472 [2:48:34<4:19:03,  3.70it/s]
 85%|████████▍ | 313920/371472 [2:48:34<4:21:29,  3.67it/s]
                                                           
{'loss': 2.5492, 'learning_rate': 2.395117326380659e-07, 'epoch': 13.52}

 85%|████████▍ | 313920/371472 [2:48:34<4:21:29,  3.67it/s]
 85%|████████▍ | 313921/371472 [2:48:34<4:22:22,  3.66it/s]
 85%|████████▍ | 313922/371472 [2:48:34<4:11:15,  3.82it/s]
 85%|████████▍ | 313923/371472 [2:48:35<4:12:17,  3.80it/s]
 85%|████████▍ | 313924/371472 [2:48:35<4:04:57,  3.92it/s]
 85%|████████▍ | 313925/371472 [2:48:35<4:32:26,  3.52it/s]
 85%|████████▍ | 313926/371472 [2:48:36<4:35:57,  3.48it/s]
 85%|████████▍ | 313927/371472 [2:48:36<4:28:08,  3.58it/s]
 85%|████████▍ | 313928/371472 [2:48:36<4:33:39,  3.50it/s]
 85%|████████▍ | 313929/371472 [2:48:36<4:40:37,  3.42it/s]
 85%|████████▍ | 313930/371472 [2:48:37<4:25:46,  3.61it/s]
 85%|████████▍ | 313931/371472 [2:48:37<4:18:13,  3.71it/s]
 85%|████████▍ | 313932/371472 [2:48:37<4:08:13,  3.86it/s]
 85%|████████▍ | 313933/371472 [2:48:37<4:10:09,  3.83it/s]
 85%|████████▍ | 313934/371472 [2:48:38<4:15:00,  3.76it/s]
 85%|████████▍ | 313935/371472 [2:48:38<4:09:12,  3.85it/s]
 85%|████████▍ | 313936/371472 [2:48:38<4:09:01,  3.85it/s]
 85%|████████▍ | 313937/371472 [2:48:39<4:38:41,  3.44it/s]
 85%|████████▍ | 313938/371472 [2:48:39<4:47:10,  3.34it/s]
 85%|████████▍ | 313939/371472 [2:48:39<4:30:45,  3.54it/s]
 85%|████████▍ | 313940/371472 [2:48:39<4:26:32,  3.60it/s]
                                                           
{'loss': 2.6224, 'learning_rate': 2.3946325066258696e-07, 'epoch': 13.52}

 85%|████████▍ | 313940/371472 [2:48:39<4:26:32,  3.60it/s]
 85%|████████▍ | 313941/371472 [2:48:40<4:30:41,  3.54it/s]
 85%|████████▍ | 313942/371472 [2:48:40<4:40:59,  3.41it/s]
 85%|████████▍ | 313943/371472 [2:48:40<4:36:59,  3.46it/s]
 85%|████████▍ | 313944/371472 [2:48:41<4:29:49,  3.55it/s]
 85%|████████▍ | 313945/371472 [2:48:41<4:30:11,  3.55it/s]
 85%|████████▍ | 313946/371472 [2:48:41<4:28:48,  3.57it/s]
 85%|████████▍ | 313947/371472 [2:48:41<4:23:41,  3.64it/s]
 85%|████████▍ | 313948/371472 [2:48:42<4:45:23,  3.36it/s]
 85%|████████▍ | 313949/371472 [2:48:42<4:29:06,  3.56it/s]
 85%|████████▍ | 313950/371472 [2:48:42<4:49:36,  3.31it/s]
 85%|████████▍ | 313951/371472 [2:48:43<4:30:00,  3.55it/s]
 85%|████████▍ | 313952/371472 [2:48:43<4:18:33,  3.71it/s]
 85%|████████▍ | 313953/371472 [2:48:43<4:35:14,  3.48it/s]
 85%|████████▍ | 313954/371472 [2:48:43<4:28:12,  3.57it/s]
 85%|████████▍ | 313955/371472 [2:48:44<4:21:54,  3.66it/s]
 85%|████████▍ | 313956/371472 [2:48:44<4:14:32,  3.77it/s]
 85%|████████▍ | 313957/371472 [2:48:44<4:40:33,  3.42it/s]
 85%|████████▍ | 313958/371472 [2:48:45<4:41:19,  3.41it/s]
 85%|████████▍ | 313959/371472 [2:48:45<5:11:50,  3.07it/s]
 85%|████████▍ | 313960/371472 [2:48:45<5:06:17,  3.13it/s]
                                                           
{'loss': 2.674, 'learning_rate': 2.3941476868710813e-07, 'epoch': 13.52}

 85%|████████▍ | 313960/371472 [2:48:45<5:06:17,  3.13it/s]
 85%|████████▍ | 313961/371472 [2:48:46<4:48:52,  3.32it/s]
 85%|████████▍ | 313962/371472 [2:48:46<4:53:34,  3.26it/s]
 85%|████████▍ | 313963/371472 [2:48:46<4:37:50,  3.45it/s]
 85%|████████▍ | 313964/371472 [2:48:46<4:48:16,  3.32it/s]
 85%|████████▍ | 313965/371472 [2:48:47<4:38:20,  3.44it/s]
 85%|████████▍ | 313966/371472 [2:48:47<4:24:18,  3.63it/s]
 85%|████████▍ | 313967/371472 [2:48:47<4:32:07,  3.52it/s]
 85%|████████▍ | 313968/371472 [2:48:48<4:20:17,  3.68it/s]
 85%|████████▍ | 313969/371472 [2:48:48<4:17:36,  3.72it/s]
 85%|████████▍ | 313970/371472 [2:48:48<4:13:27,  3.78it/s]
 85%|████████▍ | 313971/371472 [2:48:48<4:08:00,  3.86it/s]
 85%|████████▍ | 313972/371472 [2:48:49<4:15:26,  3.75it/s]
 85%|████████▍ | 313973/371472 [2:48:49<4:14:48,  3.76it/s]
 85%|████████▍ | 313974/371472 [2:48:49<4:15:06,  3.76it/s]
 85%|████████▍ | 313975/371472 [2:48:49<4:23:35,  3.64it/s]
 85%|████████▍ | 313976/371472 [2:48:50<4:43:48,  3.38it/s]
 85%|████████▍ | 313977/371472 [2:48:50<4:30:12,  3.55it/s]
 85%|████████▍ | 313978/371472 [2:48:50<4:24:43,  3.62it/s]
 85%|████████▍ | 313979/371472 [2:48:51<4:30:50,  3.54it/s]
 85%|████████▍ | 313980/371472 [2:48:51<4:18:56,  3.70it/s]
                                                           
{'loss': 2.5871, 'learning_rate': 2.393662867116292e-07, 'epoch': 13.52}

 85%|████████▍ | 313980/371472 [2:48:51<4:18:56,  3.70it/s]
 85%|████████▍ | 313981/371472 [2:48:51<4:14:27,  3.77it/s]
 85%|████████▍ | 313982/371472 [2:48:51<4:15:34,  3.75it/s]
 85%|████████▍ | 313983/371472 [2:48:52<4:18:51,  3.70it/s]
 85%|████████▍ | 313984/371472 [2:48:52<4:20:01,  3.68it/s]
 85%|████████▍ | 313985/371472 [2:48:52<4:27:52,  3.58it/s]
 85%|████████▍ | 313986/371472 [2:48:52<4:33:55,  3.50it/s]
 85%|████████▍ | 313987/371472 [2:48:53<4:44:47,  3.36it/s]
 85%|████████▍ | 313988/371472 [2:48:53<4:33:37,  3.50it/s]
 85%|████████▍ | 313989/371472 [2:48:53<4:25:56,  3.60it/s]
 85%|████████▍ | 313990/371472 [2:48:54<4:31:43,  3.53it/s]
 85%|████████▍ | 313991/371472 [2:48:54<4:30:53,  3.54it/s]
 85%|████████▍ | 313992/371472 [2:48:55<6:21:14,  2.51it/s]
 85%|████████▍ | 313993/371472 [2:48:55<5:37:40,  2.84it/s]
 85%|████████▍ | 313994/371472 [2:48:55<5:15:21,  3.04it/s]
 85%|████████▍ | 313995/371472 [2:48:55<5:06:11,  3.13it/s]
 85%|████████▍ | 313996/371472 [2:48:56<4:55:51,  3.24it/s]
 85%|████████▍ | 313997/371472 [2:48:56<4:40:18,  3.42it/s]
 85%|████████▍ | 313998/371472 [2:48:56<4:39:55,  3.42it/s]
 85%|████████▍ | 313999/371472 [2:48:57<4:46:18,  3.35it/s]
 85%|████████▍ | 314000/371472 [2:48:57<4:35:05,  3.48it/s]
                                                           
{'loss': 2.5395, 'learning_rate': 2.3931780473615033e-07, 'epoch': 13.52}

 85%|████████▍ | 314000/371472 [2:48:57<4:35:05,  3.48it/s]
 85%|████████▍ | 314001/371472 [2:48:57<4:32:28,  3.52it/s]
 85%|████████▍ | 314002/371472 [2:48:57<4:37:09,  3.46it/s]
 85%|████████▍ | 314003/371472 [2:48:58<4:35:57,  3.47it/s]
 85%|████████▍ | 314004/371472 [2:48:58<4:48:13,  3.32it/s]
 85%|████████▍ | 314005/371472 [2:48:58<4:39:46,  3.42it/s]
 85%|████████▍ | 314006/371472 [2:48:58<4:28:09,  3.57it/s]
 85%|████████▍ | 314007/371472 [2:48:59<4:25:41,  3.60it/s]
 85%|████████▍ | 314008/371472 [2:48:59<4:16:18,  3.74it/s]
 85%|████████▍ | 314009/371472 [2:48:59<4:10:39,  3.82it/s]
 85%|████████▍ | 314010/371472 [2:49:00<4:06:21,  3.89it/s]
 85%|████████▍ | 314011/371472 [2:49:00<4:17:30,  3.72it/s]
 85%|████████▍ | 314012/371472 [2:49:00<4:22:30,  3.65it/s]
 85%|████████▍ | 314013/371472 [2:49:01<5:18:37,  3.01it/s]
 85%|████████▍ | 314014/371472 [2:49:01<4:52:46,  3.27it/s]
 85%|████████▍ | 314015/371472 [2:49:01<4:51:30,  3.29it/s]
 85%|████████▍ | 314016/371472 [2:49:01<4:56:32,  3.23it/s]
 85%|████████▍ | 314017/371472 [2:49:02<4:55:30,  3.24it/s]
 85%|████████▍ | 314018/371472 [2:49:02<4:41:47,  3.40it/s]
 85%|████████▍ | 314019/371472 [2:49:02<4:27:37,  3.58it/s]
 85%|████████▍ | 314020/371472 [2:49:02<4:19:49,  3.69it/s]
                                                           
{'loss': 2.5009, 'learning_rate': 2.392693227606714e-07, 'epoch': 13.53}

 85%|████████▍ | 314020/371472 [2:49:02<4:19:49,  3.69it/s]
 85%|████████▍ | 314021/371472 [2:49:03<4:26:37,  3.59it/s]
 85%|████████▍ | 314022/371472 [2:49:03<4:16:30,  3.73it/s]
 85%|████████▍ | 314023/371472 [2:49:03<4:07:05,  3.87it/s]
 85%|████████▍ | 314024/371472 [2:49:04<4:06:55,  3.88it/s]
 85%|████████▍ | 314025/371472 [2:49:04<4:06:49,  3.88it/s]
 85%|████████▍ | 314026/371472 [2:49:04<4:42:13,  3.39it/s]
 85%|████████▍ | 314027/371472 [2:49:04<4:32:00,  3.52it/s]
 85%|████████▍ | 314028/371472 [2:49:05<4:35:19,  3.48it/s]
 85%|████████▍ | 314029/371472 [2:49:05<4:46:40,  3.34it/s]
 85%|████████▍ | 314030/371472 [2:49:05<5:03:39,  3.15it/s]
 85%|████████▍ | 314031/371472 [2:49:06<4:45:09,  3.36it/s]
 85%|████████▍ | 314032/371472 [2:49:06<4:42:46,  3.39it/s]
 85%|████████▍ | 314033/371472 [2:49:06<4:34:33,  3.49it/s]
 85%|████████▍ | 314034/371472 [2:49:07<4:39:08,  3.43it/s]
 85%|████████▍ | 314035/371472 [2:49:07<4:32:58,  3.51it/s]
 85%|████████▍ | 314036/371472 [2:49:07<4:42:29,  3.39it/s]
 85%|████████▍ | 314037/371472 [2:49:07<4:32:48,  3.51it/s]
 85%|████████▍ | 314038/371472 [2:49:08<4:24:45,  3.62it/s]
 85%|████████▍ | 314039/371472 [2:49:08<4:22:12,  3.65it/s]
 85%|████████▍ | 314040/371472 [2:49:08<4:19:56,  3.68it/s]
                                                           
{'loss': 2.7574, 'learning_rate': 2.392208407851925e-07, 'epoch': 13.53}

 85%|████████▍ | 314040/371472 [2:49:08<4:19:56,  3.68it/s]
 85%|████████▍ | 314041/371472 [2:49:08<4:17:55,  3.71it/s]
 85%|████████▍ | 314042/371472 [2:49:09<4:13:27,  3.78it/s]
 85%|████████▍ | 314043/371472 [2:49:09<4:21:02,  3.67it/s]
 85%|████████▍ | 314044/371472 [2:49:09<4:16:20,  3.73it/s]
 85%|████████▍ | 314045/371472 [2:49:10<4:27:42,  3.58it/s]
 85%|████████▍ | 314046/371472 [2:49:10<4:22:07,  3.65it/s]
 85%|████████▍ | 314047/371472 [2:49:10<4:15:13,  3.75it/s]
 85%|████████▍ | 314048/371472 [2:49:10<4:13:50,  3.77it/s]
 85%|████████▍ | 314049/371472 [2:49:11<4:28:26,  3.57it/s]
 85%|████████▍ | 314050/371472 [2:49:11<4:34:15,  3.49it/s]
 85%|████████▍ | 314051/371472 [2:49:11<4:38:17,  3.44it/s]
 85%|████████▍ | 314052/371472 [2:49:12<5:33:57,  2.87it/s]
 85%|████████▍ | 314053/371472 [2:49:12<5:45:05,  2.77it/s]
 85%|████████▍ | 314054/371472 [2:49:12<5:25:04,  2.94it/s]
 85%|████████▍ | 314055/371472 [2:49:13<5:21:59,  2.97it/s]
 85%|████████▍ | 314056/371472 [2:49:13<5:05:25,  3.13it/s]
 85%|████████▍ | 314057/371472 [2:49:13<4:49:50,  3.30it/s]
 85%|████████▍ | 314058/371472 [2:49:14<4:51:12,  3.29it/s]
 85%|████████▍ | 314059/371472 [2:49:14<4:53:15,  3.26it/s]
 85%|████████▍ | 314060/371472 [2:49:14<4:41:43,  3.40it/s]
                                                           
{'loss': 2.7873, 'learning_rate': 2.391723588097136e-07, 'epoch': 13.53}

 85%|████████▍ | 314060/371472 [2:49:14<4:41:43,  3.40it/s]
 85%|████████▍ | 314061/371472 [2:49:14<4:31:49,  3.52it/s]
 85%|████████▍ | 314062/371472 [2:49:15<4:36:12,  3.46it/s]
 85%|████████▍ | 314063/371472 [2:49:15<4:28:10,  3.57it/s]
 85%|████████▍ | 314064/371472 [2:49:15<4:31:32,  3.52it/s]
 85%|████████▍ | 314065/371472 [2:49:16<4:36:10,  3.46it/s]
 85%|████████▍ | 314066/371472 [2:49:16<4:36:17,  3.46it/s]
 85%|████████▍ | 314067/371472 [2:49:16<4:28:12,  3.57it/s]
 85%|████████▍ | 314068/371472 [2:49:16<4:24:47,  3.61it/s]
 85%|████████▍ | 314069/371472 [2:49:17<4:47:16,  3.33it/s]
 85%|████████▍ | 314070/371472 [2:49:17<4:35:48,  3.47it/s]
 85%|████████▍ | 314071/371472 [2:49:17<4:43:04,  3.38it/s]
 85%|████████▍ | 314072/371472 [2:49:18<4:34:46,  3.48it/s]
 85%|████████▍ | 314073/371472 [2:49:18<4:40:59,  3.40it/s]
 85%|████████▍ | 314074/371472 [2:49:18<4:29:26,  3.55it/s]
 85%|████████▍ | 314075/371472 [2:49:18<4:34:28,  3.49it/s]
 85%|████████▍ | 314076/371472 [2:49:19<4:54:38,  3.25it/s]
 85%|████████▍ | 314077/371472 [2:49:19<4:49:22,  3.31it/s]
 85%|████████▍ | 314078/371472 [2:49:19<4:37:03,  3.45it/s]
 85%|████████▍ | 314079/371472 [2:49:20<4:53:29,  3.26it/s]
 85%|████████▍ | 314080/371472 [2:49:20<4:41:49,  3.39it/s]
                                                           
{'loss': 2.6678, 'learning_rate': 2.391238768342348e-07, 'epoch': 13.53}

 85%|████████▍ | 314080/371472 [2:49:20<4:41:49,  3.39it/s]
 85%|████████▍ | 314081/371472 [2:49:20<4:44:03,  3.37it/s]
 85%|████████▍ | 314082/371472 [2:49:21<4:43:04,  3.38it/s]
 85%|████████▍ | 314083/371472 [2:49:21<4:55:42,  3.23it/s]
 85%|████████▍ | 314084/371472 [2:49:21<4:42:37,  3.38it/s]
 85%|████████▍ | 314085/371472 [2:49:21<4:38:40,  3.43it/s]
 85%|████████▍ | 314086/371472 [2:49:22<4:35:20,  3.47it/s]
 85%|████████▍ | 314087/371472 [2:49:22<4:22:29,  3.64it/s]
 85%|████████▍ | 314088/371472 [2:49:22<4:14:55,  3.75it/s]
 85%|████████▍ | 314089/371472 [2:49:22<4:18:09,  3.70it/s]
 85%|████████▍ | 314090/371472 [2:49:23<4:10:15,  3.82it/s]
 85%|████████▍ | 314091/371472 [2:49:23<4:13:00,  3.78it/s]
 85%|████████▍ | 314092/371472 [2:49:23<4:23:14,  3.63it/s]
 85%|████████▍ | 314093/371472 [2:49:24<4:29:36,  3.55it/s]
 85%|████████▍ | 314094/371472 [2:49:24<4:32:09,  3.51it/s]
 85%|████████▍ | 314095/371472 [2:49:24<4:27:57,  3.57it/s]
 85%|████████▍ | 314096/371472 [2:49:24<4:22:50,  3.64it/s]
 85%|████████▍ | 314097/371472 [2:49:25<4:16:23,  3.73it/s]
 85%|████████▍ | 314098/371472 [2:49:25<4:23:23,  3.63it/s]
 85%|████████▍ | 314099/371472 [2:49:25<4:22:05,  3.65it/s]
 85%|████████▍ | 314100/371472 [2:49:25<4:12:50,  3.78it/s]
                                                           
{'loss': 2.5549, 'learning_rate': 2.3907539485875585e-07, 'epoch': 13.53}

 85%|████████▍ | 314100/371472 [2:49:25<4:12:50,  3.78it/s]
 85%|████████▍ | 314101/371472 [2:49:26<4:15:37,  3.74it/s]
 85%|████████▍ | 314102/371472 [2:49:26<4:18:45,  3.70it/s]
 85%|████████▍ | 314103/371472 [2:49:26<4:34:18,  3.49it/s]
 85%|████████▍ | 314104/371472 [2:49:27<4:24:10,  3.62it/s]
 85%|████████▍ | 314105/371472 [2:49:27<4:28:34,  3.56it/s]
 85%|████████▍ | 314106/371472 [2:49:27<4:41:30,  3.40it/s]
 85%|████████▍ | 314107/371472 [2:49:27<4:39:12,  3.42it/s]
 85%|████████▍ | 314108/371472 [2:49:28<4:28:50,  3.56it/s]
 85%|████████▍ | 314109/371472 [2:49:28<4:25:18,  3.60it/s]
 85%|████████▍ | 314110/371472 [2:49:28<4:30:13,  3.54it/s]
 85%|████████▍ | 314111/371472 [2:49:29<4:51:53,  3.28it/s]
 85%|████████▍ | 314112/371472 [2:49:29<4:35:20,  3.47it/s]
 85%|████████▍ | 314113/371472 [2:49:29<4:30:13,  3.54it/s]
 85%|████████▍ | 314114/371472 [2:49:30<4:49:38,  3.30it/s]
 85%|████████▍ | 314115/371472 [2:49:30<4:38:52,  3.43it/s]
 85%|████████▍ | 314116/371472 [2:49:30<4:26:25,  3.59it/s]
 85%|████████▍ | 314117/371472 [2:49:30<4:22:44,  3.64it/s]
 85%|████████▍ | 314118/371472 [2:49:31<4:33:53,  3.49it/s]
 85%|████████▍ | 314119/371472 [2:49:31<4:46:11,  3.34it/s]
 85%|████████▍ | 314120/371472 [2:49:31<4:36:00,  3.46it/s]
                                                           
{'loss': 2.5577, 'learning_rate': 2.3902691288327697e-07, 'epoch': 13.53}

 85%|████████▍ | 314120/371472 [2:49:31<4:36:00,  3.46it/s]
 85%|████████▍ | 314121/371472 [2:49:31<4:31:01,  3.53it/s]
 85%|████████▍ | 314122/371472 [2:49:32<4:23:09,  3.63it/s]
 85%|████████▍ | 314123/371472 [2:49:32<4:27:19,  3.58it/s]
 85%|████████▍ | 314124/371472 [2:49:32<4:33:02,  3.50it/s]
 85%|████████▍ | 314125/371472 [2:49:33<4:25:21,  3.60it/s]
 85%|████████▍ | 314126/371472 [2:49:33<4:43:54,  3.37it/s]
 85%|████████▍ | 314127/371472 [2:49:33<4:33:37,  3.49it/s]
 85%|████████▍ | 314128/371472 [2:49:33<4:17:26,  3.71it/s]
 85%|████████▍ | 314129/371472 [2:49:34<4:11:18,  3.80it/s]
 85%|████████▍ | 314130/371472 [2:49:34<4:41:25,  3.40it/s]
 85%|████████▍ | 314131/371472 [2:49:34<4:29:02,  3.55it/s]
 85%|████████▍ | 314132/371472 [2:49:35<4:22:45,  3.64it/s]
 85%|████████▍ | 314133/371472 [2:49:35<4:19:51,  3.68it/s]
 85%|████████▍ | 314134/371472 [2:49:35<4:30:02,  3.54it/s]
 85%|████████▍ | 314135/371472 [2:49:35<4:19:50,  3.68it/s]
 85%|████████▍ | 314136/371472 [2:49:36<4:13:46,  3.77it/s]
 85%|████████▍ | 314137/371472 [2:49:36<4:18:07,  3.70it/s]
 85%|████████▍ | 314138/371472 [2:49:36<4:23:25,  3.63it/s]
 85%|████████▍ | 314139/371472 [2:49:36<4:26:17,  3.59it/s]
 85%|████████▍ | 314140/371472 [2:49:37<4:28:20,  3.56it/s]
                                                           
{'loss': 2.6593, 'learning_rate': 2.3897843090779804e-07, 'epoch': 13.53}

 85%|████████▍ | 314140/371472 [2:49:37<4:28:20,  3.56it/s]
 85%|████████▍ | 314141/371472 [2:49:37<4:23:25,  3.63it/s]
 85%|████████▍ | 314142/371472 [2:49:37<4:25:09,  3.60it/s]
 85%|████████▍ | 314143/371472 [2:49:38<4:39:01,  3.42it/s]
 85%|████████▍ | 314144/371472 [2:49:38<4:24:19,  3.61it/s]
 85%|████████▍ | 314145/371472 [2:49:38<4:27:21,  3.57it/s]
 85%|████████▍ | 314146/371472 [2:49:39<4:54:01,  3.25it/s]
 85%|████████▍ | 314147/371472 [2:49:39<4:50:47,  3.29it/s]
 85%|████████▍ | 314148/371472 [2:49:39<4:44:16,  3.36it/s]
 85%|████████▍ | 314149/371472 [2:49:39<4:38:23,  3.43it/s]
 85%|████████▍ | 314150/371472 [2:49:40<4:27:45,  3.57it/s]
 85%|████████▍ | 314151/371472 [2:49:40<4:31:58,  3.51it/s]
 85%|████████▍ | 314152/371472 [2:49:40<4:21:16,  3.66it/s]
 85%|████████▍ | 314153/371472 [2:49:40<4:20:38,  3.67it/s]
 85%|████████▍ | 314154/371472 [2:49:41<4:15:36,  3.74it/s]
 85%|████████▍ | 314155/371472 [2:49:41<4:13:49,  3.76it/s]
 85%|████████▍ | 314156/371472 [2:49:41<4:25:56,  3.59it/s]
 85%|████████▍ | 314157/371472 [2:49:42<4:24:04,  3.62it/s]
 85%|████████▍ | 314158/371472 [2:49:42<4:25:56,  3.59it/s]
 85%|████████▍ | 314159/371472 [2:49:42<4:36:39,  3.45it/s]
 85%|████████▍ | 314160/371472 [2:49:42<4:40:21,  3.41it/s]
                                                           
{'loss': 2.6085, 'learning_rate': 2.3892994893231917e-07, 'epoch': 13.53}

 85%|████████▍ | 314160/371472 [2:49:42<4:40:21,  3.41it/s]
 85%|████████▍ | 314161/371472 [2:49:43<4:29:05,  3.55it/s]
 85%|████████▍ | 314162/371472 [2:49:43<4:30:43,  3.53it/s]
 85%|████████▍ | 314163/371472 [2:49:43<4:26:45,  3.58it/s]
 85%|████████▍ | 314164/371472 [2:49:44<4:12:25,  3.78it/s]
 85%|████████▍ | 314165/371472 [2:49:44<4:06:26,  3.88it/s]
 85%|████████▍ | 314166/371472 [2:49:44<4:04:50,  3.90it/s]
 85%|████████▍ | 314167/371472 [2:49:44<4:07:42,  3.86it/s]
 85%|████████▍ | 314168/371472 [2:49:45<4:20:11,  3.67it/s]
 85%|████████▍ | 314169/371472 [2:49:45<4:18:59,  3.69it/s]
 85%|████████▍ | 314170/371472 [2:49:45<4:25:19,  3.60it/s]
 85%|████████▍ | 314171/371472 [2:49:45<4:18:25,  3.70it/s]
 85%|████████▍ | 314172/371472 [2:49:46<4:34:13,  3.48it/s]
 85%|████████▍ | 314173/371472 [2:49:46<4:28:37,  3.56it/s]
 85%|████████▍ | 314174/371472 [2:49:46<4:29:38,  3.54it/s]
 85%|████████▍ | 314175/371472 [2:49:47<4:27:17,  3.57it/s]
 85%|████████▍ | 314176/371472 [2:49:47<4:45:47,  3.34it/s]
 85%|████████▍ | 314177/371472 [2:49:47<4:55:28,  3.23it/s]
 85%|████████▍ | 314178/371472 [2:49:47<4:42:11,  3.38it/s]
 85%|████████▍ | 314179/371472 [2:49:48<4:36:21,  3.46it/s]
 85%|████████▍ | 314180/371472 [2:49:48<4:37:00,  3.45it/s]
                                                           
{'loss': 2.6282, 'learning_rate': 2.3888146695684024e-07, 'epoch': 13.53}

 85%|████████▍ | 314180/371472 [2:49:48<4:37:00,  3.45it/s]
 85%|████████▍ | 314181/371472 [2:49:48<4:34:04,  3.48it/s]
 85%|████████▍ | 314182/371472 [2:49:49<4:26:00,  3.59it/s]
 85%|████████▍ | 314183/371472 [2:49:49<4:34:26,  3.48it/s]
 85%|████████▍ | 314184/371472 [2:49:49<4:24:09,  3.61it/s]
 85%|████████▍ | 314185/371472 [2:49:49<4:29:37,  3.54it/s]
 85%|████████▍ | 314186/371472 [2:49:50<4:19:29,  3.68it/s]
 85%|████████▍ | 314187/371472 [2:49:50<4:13:05,  3.77it/s]
 85%|████████▍ | 314188/371472 [2:49:50<4:24:45,  3.61it/s]
 85%|████████▍ | 314189/371472 [2:49:51<4:36:10,  3.46it/s]
 85%|████████▍ | 314190/371472 [2:49:51<4:38:54,  3.42it/s]
 85%|████████▍ | 314191/371472 [2:49:51<4:35:25,  3.47it/s]
 85%|████████▍ | 314192/371472 [2:49:51<4:32:33,  3.50it/s]
 85%|████████▍ | 314193/371472 [2:49:52<4:34:14,  3.48it/s]
 85%|████████▍ | 314194/371472 [2:49:52<4:34:17,  3.48it/s]
 85%|████████▍ | 314195/371472 [2:49:52<4:26:12,  3.59it/s]
 85%|████████▍ | 314196/371472 [2:49:53<4:30:47,  3.53it/s]
 85%|████████▍ | 314197/371472 [2:49:53<4:23:24,  3.62it/s]
 85%|████████▍ | 314198/371472 [2:49:53<4:28:45,  3.55it/s]
 85%|████████▍ | 314199/371472 [2:49:53<4:17:08,  3.71it/s]
 85%|████████▍ | 314200/371472 [2:49:54<4:41:55,  3.39it/s]
                                                           
{'loss': 2.6215, 'learning_rate': 2.388329849813614e-07, 'epoch': 13.53}

 85%|████████▍ | 314200/371472 [2:49:54<4:41:55,  3.39it/s]
 85%|████████▍ | 314201/371472 [2:49:54<4:34:04,  3.48it/s]
 85%|████████▍ | 314202/371472 [2:49:54<4:42:55,  3.37it/s]
 85%|████████▍ | 314203/371472 [2:49:55<4:44:50,  3.35it/s]
 85%|████████▍ | 314204/371472 [2:49:55<4:36:10,  3.46it/s]
 85%|████████▍ | 314205/371472 [2:49:55<4:29:01,  3.55it/s]
 85%|████████▍ | 314206/371472 [2:49:55<4:35:03,  3.47it/s]
 85%|████████▍ | 314207/371472 [2:49:56<4:32:54,  3.50it/s]
 85%|████████▍ | 314208/371472 [2:49:56<4:30:17,  3.53it/s]
 85%|████████▍ | 314209/371472 [2:49:56<4:30:19,  3.53it/s]
 85%|████████▍ | 314210/371472 [2:49:57<4:30:29,  3.53it/s]
 85%|████████▍ | 314211/371472 [2:49:57<4:26:30,  3.58it/s]
 85%|████████▍ | 314212/371472 [2:49:57<4:19:17,  3.68it/s]
 85%|████████▍ | 314213/371472 [2:49:57<4:14:54,  3.74it/s]
 85%|████████▍ | 314214/371472 [2:49:58<4:16:39,  3.72it/s]
 85%|████████▍ | 314215/371472 [2:49:58<4:08:34,  3.84it/s]
 85%|████████▍ | 314216/371472 [2:49:58<4:04:53,  3.90it/s]
 85%|████████▍ | 314217/371472 [2:49:58<4:10:36,  3.81it/s]
 85%|████████▍ | 314218/371472 [2:49:59<4:12:51,  3.77it/s]
 85%|████████▍ | 314219/371472 [2:49:59<4:14:07,  3.75it/s]
 85%|████████▍ | 314220/371472 [2:49:59<4:16:38,  3.72it/s]
                                                           
{'loss': 2.7215, 'learning_rate': 2.387845030058825e-07, 'epoch': 13.53}

 85%|████████▍ | 314220/371472 [2:49:59<4:16:38,  3.72it/s]
 85%|████████▍ | 314221/371472 [2:49:59<4:17:42,  3.70it/s]
 85%|████████▍ | 314222/371472 [2:50:00<4:34:27,  3.48it/s]
 85%|████████▍ | 314223/371472 [2:50:00<4:26:13,  3.58it/s]
 85%|████████▍ | 314224/371472 [2:50:00<5:03:37,  3.14it/s]
 85%|████████▍ | 314225/371472 [2:50:01<4:52:37,  3.26it/s]
 85%|████████▍ | 314226/371472 [2:50:01<4:47:05,  3.32it/s]
 85%|████████▍ | 314227/371472 [2:50:01<4:36:57,  3.44it/s]
 85%|████████▍ | 314228/371472 [2:50:02<4:27:29,  3.57it/s]
 85%|████████▍ | 314229/371472 [2:50:02<4:23:38,  3.62it/s]
 85%|████████▍ | 314230/371472 [2:50:02<4:33:38,  3.49it/s]
 85%|████████▍ | 314231/371472 [2:50:02<4:24:26,  3.61it/s]
 85%|████████▍ | 314232/371472 [2:50:03<4:40:15,  3.40it/s]
 85%|████████▍ | 314233/371472 [2:50:03<4:26:39,  3.58it/s]
 85%|████████▍ | 314234/371472 [2:50:03<4:16:35,  3.72it/s]
 85%|████████▍ | 314235/371472 [2:50:03<4:21:08,  3.65it/s]
 85%|████████▍ | 314236/371472 [2:50:04<4:16:23,  3.72it/s]
 85%|████████▍ | 314237/371472 [2:50:04<4:25:51,  3.59it/s]
 85%|████████▍ | 314238/371472 [2:50:04<4:16:00,  3.73it/s]
 85%|████████▍ | 314239/371472 [2:50:05<4:29:02,  3.55it/s]
 85%|████████▍ | 314240/371472 [2:50:05<4:22:36,  3.63it/s]
                                                           
{'loss': 2.6837, 'learning_rate': 2.387360210304036e-07, 'epoch': 13.53}

 85%|████████▍ | 314240/371472 [2:50:05<4:22:36,  3.63it/s]
 85%|████████▍ | 314241/371472 [2:50:05<4:29:34,  3.54it/s]
 85%|████████▍ | 314242/371472 [2:50:05<4:22:15,  3.64it/s]
 85%|████████▍ | 314243/371472 [2:50:06<4:25:50,  3.59it/s]
 85%|████████▍ | 314244/371472 [2:50:06<4:30:42,  3.52it/s]
 85%|████████▍ | 314245/371472 [2:50:06<4:34:26,  3.48it/s]
 85%|████████▍ | 314246/371472 [2:50:07<4:36:09,  3.45it/s]
 85%|████████▍ | 314247/371472 [2:50:07<4:20:33,  3.66it/s]
 85%|████████▍ | 314248/371472 [2:50:07<4:20:51,  3.66it/s]
 85%|████████▍ | 314249/371472 [2:50:07<4:13:07,  3.77it/s]
 85%|████████▍ | 314250/371472 [2:50:08<4:10:31,  3.81it/s]
 85%|████████▍ | 314251/371472 [2:50:08<4:24:09,  3.61it/s]
 85%|████████▍ | 314252/371472 [2:50:08<4:11:53,  3.79it/s]
 85%|████████▍ | 314253/371472 [2:50:08<4:14:44,  3.74it/s]
 85%|████████▍ | 314254/371472 [2:50:09<4:24:08,  3.61it/s]
 85%|████████▍ | 314255/371472 [2:50:09<4:17:07,  3.71it/s]
 85%|████████▍ | 314256/371472 [2:50:09<4:22:32,  3.63it/s]
 85%|████████▍ | 314257/371472 [2:50:10<4:21:48,  3.64it/s]
 85%|████████▍ | 314258/371472 [2:50:10<4:47:23,  3.32it/s]
 85%|████████▍ | 314259/371472 [2:50:10<4:43:21,  3.37it/s]
 85%|████████▍ | 314260/371472 [2:50:10<4:34:11,  3.48it/s]
                                                           
{'loss': 2.3899, 'learning_rate': 2.386875390549247e-07, 'epoch': 13.54}

 85%|████████▍ | 314260/371472 [2:50:10<4:34:11,  3.48it/s]
 85%|████████▍ | 314261/371472 [2:50:11<4:32:19,  3.50it/s]
 85%|████████▍ | 314262/371472 [2:50:11<4:24:04,  3.61it/s]
 85%|████████▍ | 314263/371472 [2:50:11<4:22:45,  3.63it/s]
 85%|████████▍ | 314264/371472 [2:50:12<4:14:43,  3.74it/s]
 85%|████████▍ | 314265/371472 [2:50:12<4:22:30,  3.63it/s]
 85%|████████▍ | 314266/371472 [2:50:12<4:21:44,  3.64it/s]
 85%|████████▍ | 314267/371472 [2:50:12<4:29:53,  3.53it/s]
 85%|████████▍ | 314268/371472 [2:50:13<4:15:54,  3.73it/s]
 85%|████████▍ | 314269/371472 [2:50:13<4:08:10,  3.84it/s]
 85%|████████▍ | 314270/371472 [2:50:13<4:10:47,  3.80it/s]
 85%|████████▍ | 314271/371472 [2:50:13<4:05:33,  3.88it/s]
 85%|████████▍ | 314272/371472 [2:50:14<4:01:35,  3.95it/s]
 85%|████████▍ | 314273/371472 [2:50:14<4:07:14,  3.86it/s]
 85%|████████▍ | 314274/371472 [2:50:14<4:31:58,  3.51it/s]
 85%|████████▍ | 314275/371472 [2:50:15<4:52:13,  3.26it/s]
 85%|████████▍ | 314276/371472 [2:50:15<4:47:37,  3.31it/s]
 85%|████████▍ | 314277/371472 [2:50:15<4:46:18,  3.33it/s]
 85%|████████▍ | 314278/371472 [2:50:16<5:03:58,  3.14it/s]
 85%|████████▍ | 314279/371472 [2:50:16<4:47:16,  3.32it/s]
 85%|████████▍ | 314280/371472 [2:50:16<4:40:53,  3.39it/s]
                                                           
{'loss': 2.6089, 'learning_rate': 2.386390570794457e-07, 'epoch': 13.54}

 85%|████████▍ | 314280/371472 [2:50:16<4:40:53,  3.39it/s]
 85%|████████▍ | 314281/371472 [2:50:16<4:34:02,  3.48it/s]
 85%|████████▍ | 314282/371472 [2:50:17<4:45:01,  3.34it/s]
 85%|████████▍ | 314283/371472 [2:50:17<4:27:20,  3.57it/s]
 85%|████████▍ | 314284/371472 [2:50:17<4:19:53,  3.67it/s]
 85%|████████▍ | 314285/371472 [2:50:17<4:27:12,  3.57it/s]
 85%|████████▍ | 314286/371472 [2:50:18<4:19:22,  3.67it/s]
 85%|████████▍ | 314287/371472 [2:50:18<4:19:52,  3.67it/s]
 85%|████████▍ | 314288/371472 [2:50:18<4:26:00,  3.58it/s]
 85%|████████▍ | 314289/371472 [2:50:19<4:47:06,  3.32it/s]
 85%|████████▍ | 314290/371472 [2:50:19<4:34:12,  3.48it/s]
 85%|████████▍ | 314291/371472 [2:50:19<4:29:40,  3.53it/s]
 85%|████████▍ | 314292/371472 [2:50:19<4:35:41,  3.46it/s]
 85%|████████▍ | 314293/371472 [2:50:20<4:29:30,  3.54it/s]
 85%|████████▍ | 314294/371472 [2:50:20<4:22:14,  3.63it/s]
 85%|████████▍ | 314295/371472 [2:50:20<4:44:07,  3.35it/s]
 85%|████████▍ | 314296/371472 [2:50:21<5:04:18,  3.13it/s]
 85%|████████▍ | 314297/371472 [2:50:21<4:49:21,  3.29it/s]
 85%|████████▍ | 314298/371472 [2:50:21<4:48:13,  3.31it/s]
 85%|████████▍ | 314299/371472 [2:50:22<4:43:31,  3.36it/s]
 85%|████████▍ | 314300/371472 [2:50:22<4:29:12,  3.54it/s]
                                                           
{'loss': 2.5468, 'learning_rate': 2.385905751039669e-07, 'epoch': 13.54}

 85%|████████▍ | 314300/371472 [2:50:22<4:29:12,  3.54it/s]
 85%|████████▍ | 314301/371472 [2:50:22<4:27:42,  3.56it/s]
 85%|████████▍ | 314302/371472 [2:50:22<4:27:52,  3.56it/s]
 85%|████████▍ | 314303/371472 [2:50:23<4:24:15,  3.61it/s]
 85%|████████▍ | 314304/371472 [2:50:23<4:17:58,  3.69it/s]
 85%|████████▍ | 314305/371472 [2:50:23<4:10:11,  3.81it/s]
 85%|████████▍ | 314306/371472 [2:50:23<4:17:31,  3.70it/s]
 85%|████████▍ | 314307/371472 [2:50:24<4:12:16,  3.78it/s]
 85%|████████▍ | 314308/371472 [2:50:24<4:16:09,  3.72it/s]
 85%|████████▍ | 314309/371472 [2:50:24<4:25:44,  3.59it/s]
 85%|████████▍ | 314310/371472 [2:50:25<4:34:31,  3.47it/s]
 85%|████████▍ | 314311/371472 [2:50:25<4:30:44,  3.52it/s]
 85%|████████▍ | 314312/371472 [2:50:25<4:33:34,  3.48it/s]
 85%|████████▍ | 314313/371472 [2:50:25<4:22:54,  3.62it/s]
 85%|████████▍ | 314314/371472 [2:50:26<4:21:35,  3.64it/s]
 85%|████████▍ | 314315/371472 [2:50:26<4:31:24,  3.51it/s]
 85%|████████▍ | 314316/371472 [2:50:26<4:38:00,  3.43it/s]
 85%|████████▍ | 314317/371472 [2:50:27<4:33:37,  3.48it/s]
 85%|████████▍ | 314318/371472 [2:50:27<4:23:20,  3.62it/s]
 85%|████████▍ | 314319/371472 [2:50:27<4:20:05,  3.66it/s]
 85%|████████▍ | 314320/371472 [2:50:27<4:45:45,  3.33it/s]
                                                           
{'loss': 2.4438, 'learning_rate': 2.3854209312848795e-07, 'epoch': 13.54}

 85%|████████▍ | 314320/371472 [2:50:27<4:45:45,  3.33it/s]
 85%|████████▍ | 314321/371472 [2:50:28<4:30:43,  3.52it/s]
 85%|████████▍ | 314322/371472 [2:50:28<4:23:49,  3.61it/s]
 85%|████████▍ | 314323/371472 [2:50:28<4:29:28,  3.53it/s]
 85%|████████▍ | 314324/371472 [2:50:29<4:25:13,  3.59it/s]
 85%|████████▍ | 314325/371472 [2:50:29<4:20:04,  3.66it/s]
 85%|████████▍ | 314326/371472 [2:50:29<4:13:16,  3.76it/s]
 85%|████████▍ | 314327/371472 [2:50:29<4:12:55,  3.77it/s]
 85%|████████▍ | 314328/371472 [2:50:30<4:07:32,  3.85it/s]
 85%|████████▍ | 314329/371472 [2:50:30<4:43:51,  3.36it/s]
 85%|████████▍ | 314330/371472 [2:50:30<4:44:37,  3.35it/s]
 85%|████████▍ | 314331/371472 [2:50:31<5:07:31,  3.10it/s]
 85%|████████▍ | 314332/371472 [2:50:31<4:44:12,  3.35it/s]
 85%|████████▍ | 314333/371472 [2:50:31<4:45:05,  3.34it/s]
 85%|████████▍ | 314334/371472 [2:50:31<4:46:15,  3.33it/s]
 85%|████████▍ | 314335/371472 [2:50:32<4:40:30,  3.39it/s]
 85%|████████▍ | 314336/371472 [2:50:32<4:26:54,  3.57it/s]
 85%|████████▍ | 314337/371472 [2:50:32<4:19:25,  3.67it/s]
 85%|████████▍ | 314338/371472 [2:50:32<4:14:55,  3.74it/s]
 85%|████████▍ | 314339/371472 [2:50:33<4:25:35,  3.59it/s]
 85%|████████▍ | 314340/371472 [2:50:33<4:32:01,  3.50it/s]
                                                           
{'loss': 2.6862, 'learning_rate': 2.3849361115300913e-07, 'epoch': 13.54}

 85%|████████▍ | 314340/371472 [2:50:33<4:32:01,  3.50it/s]
 85%|████████▍ | 314341/371472 [2:50:33<4:32:25,  3.50it/s]
 85%|████████▍ | 314342/371472 [2:50:34<4:23:21,  3.62it/s]
 85%|████████▍ | 314343/371472 [2:50:34<4:18:48,  3.68it/s]
 85%|████████▍ | 314344/371472 [2:50:34<4:20:47,  3.65it/s]
 85%|████████▍ | 314345/371472 [2:50:35<4:49:03,  3.29it/s]
 85%|████████▍ | 314346/371472 [2:50:35<4:40:10,  3.40it/s]
 85%|████████▍ | 314347/371472 [2:50:35<4:45:01,  3.34it/s]
 85%|████████▍ | 314348/371472 [2:50:35<4:36:29,  3.44it/s]
 85%|████████▍ | 314349/371472 [2:50:36<4:50:09,  3.28it/s]
 85%|████████▍ | 314350/371472 [2:50:36<4:45:26,  3.34it/s]
 85%|████████▍ | 314351/371472 [2:50:36<4:35:45,  3.45it/s]
 85%|████████▍ | 314352/371472 [2:50:37<4:45:37,  3.33it/s]
 85%|████████▍ | 314353/371472 [2:50:37<4:50:40,  3.28it/s]
 85%|████████▍ | 314354/371472 [2:50:37<4:42:23,  3.37it/s]
 85%|████████▍ | 314355/371472 [2:50:37<4:34:41,  3.47it/s]
 85%|████████▍ | 314356/371472 [2:50:38<4:22:49,  3.62it/s]
 85%|████████▍ | 314357/371472 [2:50:38<4:35:14,  3.46it/s]
 85%|████████▍ | 314358/371472 [2:50:38<4:20:31,  3.65it/s]
 85%|████████▍ | 314359/371472 [2:50:39<4:15:10,  3.73it/s]
 85%|████████▍ | 314360/371472 [2:50:39<4:32:08,  3.50it/s]
                                                           
{'loss': 2.5344, 'learning_rate': 2.384451291775302e-07, 'epoch': 13.54}

 85%|████████▍ | 314360/371472 [2:50:39<4:32:08,  3.50it/s]
 85%|████████▍ | 314361/371472 [2:50:39<4:23:19,  3.61it/s]
 85%|████████▍ | 314362/371472 [2:50:39<4:19:24,  3.67it/s]
 85%|████████▍ | 314363/371472 [2:50:40<4:34:26,  3.47it/s]
 85%|████████▍ | 314364/371472 [2:50:40<4:28:48,  3.54it/s]
 85%|████████▍ | 314365/371472 [2:50:40<5:00:20,  3.17it/s]
 85%|████████▍ | 314366/371472 [2:50:41<4:57:12,  3.20it/s]
 85%|████████▍ | 314367/371472 [2:50:41<4:59:14,  3.18it/s]
 85%|████████▍ | 314368/371472 [2:50:41<4:43:43,  3.35it/s]
 85%|████████▍ | 314369/371472 [2:50:42<5:08:46,  3.08it/s]
 85%|████████▍ | 314370/371472 [2:50:42<4:57:09,  3.20it/s]
 85%|████████▍ | 314371/371472 [2:50:42<4:47:38,  3.31it/s]
 85%|████████▍ | 314372/371472 [2:50:42<4:31:21,  3.51it/s]
 85%|████████▍ | 314373/371472 [2:50:43<4:31:07,  3.51it/s]
 85%|████████▍ | 314374/371472 [2:50:43<4:24:20,  3.60it/s]
 85%|████████▍ | 314375/371472 [2:50:43<4:26:29,  3.57it/s]
 85%|████████▍ | 314376/371472 [2:50:44<4:20:16,  3.66it/s]
 85%|████████▍ | 314377/371472 [2:50:44<4:14:49,  3.73it/s]
 85%|████████▍ | 314378/371472 [2:50:44<4:18:44,  3.68it/s]
 85%|████████▍ | 314379/371472 [2:50:44<4:11:03,  3.79it/s]
 85%|████████▍ | 314380/371472 [2:50:45<4:25:19,  3.59it/s]
                                                           
{'loss': 2.5829, 'learning_rate': 2.3839664720205132e-07, 'epoch': 13.54}

 85%|████████▍ | 314380/371472 [2:50:45<4:25:19,  3.59it/s]
 85%|████████▍ | 314381/371472 [2:50:45<4:26:42,  3.57it/s]
 85%|████████▍ | 314382/371472 [2:50:45<4:21:25,  3.64it/s]
 85%|████████▍ | 314383/371472 [2:50:45<4:16:38,  3.71it/s]
 85%|████████▍ | 314384/371472 [2:50:46<4:30:58,  3.51it/s]
 85%|████████▍ | 314385/371472 [2:50:46<4:36:00,  3.45it/s]
 85%|████████▍ | 314386/371472 [2:50:46<4:39:05,  3.41it/s]
 85%|████████▍ | 314387/371472 [2:50:47<4:26:21,  3.57it/s]
 85%|████████▍ | 314388/371472 [2:50:47<4:17:25,  3.70it/s]
 85%|████████▍ | 314389/371472 [2:50:47<4:31:56,  3.50it/s]
 85%|████████▍ | 314390/371472 [2:50:48<4:52:12,  3.26it/s]
 85%|████████▍ | 314391/371472 [2:50:48<4:43:16,  3.36it/s]
 85%|████████▍ | 314392/371472 [2:50:48<4:41:49,  3.38it/s]
 85%|████████▍ | 314393/371472 [2:50:48<4:35:33,  3.45it/s]
 85%|████████▍ | 314394/371472 [2:50:49<4:21:32,  3.64it/s]
 85%|████████▍ | 314395/371472 [2:50:49<4:12:36,  3.77it/s]
 85%|████████▍ | 314396/371472 [2:50:49<4:09:25,  3.81it/s]
 85%|████████▍ | 314397/371472 [2:50:49<4:12:28,  3.77it/s]
 85%|████████▍ | 314398/371472 [2:50:50<4:16:06,  3.71it/s]
 85%|████████▍ | 314399/371472 [2:50:50<4:14:49,  3.73it/s]
 85%|████████▍ | 314400/371472 [2:50:50<4:13:13,  3.76it/s]
                                                           
{'loss': 2.7122, 'learning_rate': 2.383481652265724e-07, 'epoch': 13.54}

 85%|████████▍ | 314400/371472 [2:50:50<4:13:13,  3.76it/s]
 85%|████████▍ | 314401/371472 [2:50:51<4:33:34,  3.48it/s]
 85%|████████▍ | 314402/371472 [2:50:51<4:29:08,  3.53it/s]
 85%|████████▍ | 314403/371472 [2:50:51<4:19:31,  3.66it/s]
 85%|████████▍ | 314404/371472 [2:50:51<4:17:23,  3.70it/s]
 85%|████████▍ | 314405/371472 [2:50:52<4:09:04,  3.82it/s]
 85%|████████▍ | 314406/371472 [2:50:52<4:16:32,  3.71it/s]
 85%|████████▍ | 314407/371472 [2:50:52<4:09:04,  3.82it/s]
 85%|████████▍ | 314408/371472 [2:50:52<4:08:16,  3.83it/s]
 85%|████████▍ | 314409/371472 [2:50:53<4:03:08,  3.91it/s]
 85%|████████▍ | 314410/371472 [2:50:53<4:00:27,  3.96it/s]
 85%|████████▍ | 314411/371472 [2:50:53<4:11:46,  3.78it/s]
 85%|████████▍ | 314412/371472 [2:50:53<4:13:45,  3.75it/s]
 85%|████████▍ | 314413/371472 [2:50:54<4:11:01,  3.79it/s]
 85%|████████▍ | 314414/371472 [2:50:54<4:16:00,  3.71it/s]
 85%|████████▍ | 314415/371472 [2:50:54<4:11:44,  3.78it/s]
 85%|████████▍ | 314416/371472 [2:50:54<4:09:48,  3.81it/s]
 85%|████████▍ | 314417/371472 [2:50:55<4:11:05,  3.79it/s]
 85%|████████▍ | 314418/371472 [2:50:55<4:14:23,  3.74it/s]
 85%|████████▍ | 314419/371472 [2:50:55<4:12:44,  3.76it/s]
 85%|████████▍ | 314420/371472 [2:50:56<4:11:20,  3.78it/s]
                                                           
{'loss': 2.5506, 'learning_rate': 2.3829968325109354e-07, 'epoch': 13.54}

 85%|████████▍ | 314420/371472 [2:50:56<4:11:20,  3.78it/s]
 85%|████████▍ | 314421/371472 [2:50:56<4:17:09,  3.70it/s]
 85%|████████▍ | 314422/371472 [2:50:56<4:22:00,  3.63it/s]
 85%|████████▍ | 314423/371472 [2:50:56<4:16:20,  3.71it/s]
 85%|████████▍ | 314424/371472 [2:50:57<4:16:51,  3.70it/s]
 85%|████████▍ | 314425/371472 [2:50:57<4:34:49,  3.46it/s]
 85%|████████▍ | 314426/371472 [2:50:57<4:46:47,  3.32it/s]
 85%|████████▍ | 314427/371472 [2:50:58<4:31:32,  3.50it/s]
 85%|████████▍ | 314428/371472 [2:50:58<4:41:04,  3.38it/s]
 85%|████████▍ | 314429/371472 [2:50:58<5:05:53,  3.11it/s]
 85%|████████▍ | 314430/371472 [2:50:59<4:55:20,  3.22it/s]
 85%|████████▍ | 314431/371472 [2:50:59<4:49:51,  3.28it/s]
 85%|████████▍ | 314432/371472 [2:50:59<4:35:39,  3.45it/s]
 85%|████████▍ | 314433/371472 [2:51:00<5:18:16,  2.99it/s]
 85%|████████▍ | 314434/371472 [2:51:00<4:53:34,  3.24it/s]
 85%|████████▍ | 314435/371472 [2:51:00<4:42:59,  3.36it/s]
 85%|████████▍ | 314436/371472 [2:51:00<4:27:44,  3.55it/s]
 85%|████████▍ | 314437/371472 [2:51:01<4:30:43,  3.51it/s]
 85%|████████▍ | 314438/371472 [2:51:01<4:25:49,  3.58it/s]
 85%|████████▍ | 314439/371472 [2:51:01<4:17:16,  3.69it/s]
 85%|████████▍ | 314440/371472 [2:51:01<4:19:18,  3.67it/s]
                                                           
{'loss': 2.5889, 'learning_rate': 2.382512012756146e-07, 'epoch': 13.54}

 85%|████████▍ | 314440/371472 [2:51:01<4:19:18,  3.67it/s]
 85%|████████▍ | 314441/371472 [2:51:02<4:11:48,  3.77it/s]
 85%|████████▍ | 314442/371472 [2:51:02<4:28:52,  3.54it/s]
 85%|████████▍ | 314443/371472 [2:51:02<4:26:03,  3.57it/s]
 85%|████████▍ | 314444/371472 [2:51:02<4:22:48,  3.62it/s]
 85%|████████▍ | 314445/371472 [2:51:03<4:13:13,  3.75it/s]
 85%|████████▍ | 314446/371472 [2:51:03<4:11:53,  3.77it/s]
 85%|████████▍ | 314447/371472 [2:51:03<4:14:29,  3.73it/s]
 85%|████████▍ | 314448/371472 [2:51:04<4:19:02,  3.67it/s]
 85%|████████▍ | 314449/371472 [2:51:04<4:40:06,  3.39it/s]
 85%|████████▍ | 314450/371472 [2:51:04<4:38:31,  3.41it/s]
 85%|████████▍ | 314451/371472 [2:51:04<4:35:18,  3.45it/s]
 85%|████████▍ | 314452/371472 [2:51:05<4:23:01,  3.61it/s]
 85%|████████▍ | 314453/371472 [2:51:05<4:12:43,  3.76it/s]
 85%|████████▍ | 314454/371472 [2:51:05<4:06:09,  3.86it/s]
 85%|████████▍ | 314455/371472 [2:51:05<4:16:49,  3.70it/s]
 85%|████████▍ | 314456/371472 [2:51:06<4:12:06,  3.77it/s]
 85%|████████▍ | 314457/371472 [2:51:06<4:23:20,  3.61it/s]
 85%|████████▍ | 314458/371472 [2:51:06<4:52:23,  3.25it/s]
 85%|████████▍ | 314459/371472 [2:51:07<4:41:55,  3.37it/s]
 85%|████████▍ | 314460/371472 [2:51:07<4:39:01,  3.41it/s]
                                                           
{'loss': 2.5591, 'learning_rate': 2.3820271930013577e-07, 'epoch': 13.54}

 85%|████████▍ | 314460/371472 [2:51:07<4:39:01,  3.41it/s]
 85%|████████▍ | 314461/371472 [2:51:07<4:32:28,  3.49it/s]
 85%|████████▍ | 314462/371472 [2:51:07<4:22:28,  3.62it/s]
 85%|████████▍ | 314463/371472 [2:51:08<4:19:46,  3.66it/s]
 85%|████████▍ | 314464/371472 [2:51:08<4:25:16,  3.58it/s]
 85%|████████▍ | 314465/371472 [2:51:08<4:30:46,  3.51it/s]
 85%|████████▍ | 314466/371472 [2:51:09<4:22:28,  3.62it/s]
 85%|████████▍ | 314467/371472 [2:51:09<4:14:38,  3.73it/s]
 85%|████████▍ | 314468/371472 [2:51:09<4:09:30,  3.81it/s]
 85%|████████▍ | 314469/371472 [2:51:09<4:00:22,  3.95it/s]
 85%|████████▍ | 314470/371472 [2:51:10<4:08:34,  3.82it/s]
 85%|████████▍ | 314471/371472 [2:51:10<4:05:58,  3.86it/s]
 85%|████████▍ | 314472/371472 [2:51:10<4:05:41,  3.87it/s]
 85%|████████▍ | 314473/371472 [2:51:10<4:12:05,  3.77it/s]
 85%|████████▍ | 314474/371472 [2:51:11<4:35:31,  3.45it/s]
 85%|████████▍ | 314475/371472 [2:51:11<4:27:03,  3.56it/s]
 85%|████████▍ | 314476/371472 [2:51:11<4:14:31,  3.73it/s]
 85%|████████▍ | 314477/371472 [2:51:12<4:12:28,  3.76it/s]
 85%|████████▍ | 314478/371472 [2:51:12<4:12:45,  3.76it/s]
 85%|████████▍ | 314479/371472 [2:51:12<4:05:59,  3.86it/s]
 85%|████████▍ | 314480/371472 [2:51:12<4:10:45,  3.79it/s]
                                                           
{'loss': 2.5539, 'learning_rate': 2.381542373246568e-07, 'epoch': 13.55}

 85%|████████▍ | 314480/371472 [2:51:12<4:10:45,  3.79it/s]
 85%|████████▍ | 314481/371472 [2:51:13<4:29:05,  3.53it/s]
 85%|████████▍ | 314482/371472 [2:51:13<4:31:08,  3.50it/s]
 85%|████████▍ | 314483/371472 [2:51:13<4:32:53,  3.48it/s]
 85%|████████▍ | 314484/371472 [2:51:13<4:22:59,  3.61it/s]
 85%|████████▍ | 314485/371472 [2:51:14<4:24:40,  3.59it/s]
 85%|████████▍ | 314486/371472 [2:51:14<4:19:10,  3.66it/s]
 85%|████████▍ | 314487/371472 [2:51:14<4:14:05,  3.74it/s]
 85%|████████▍ | 314488/371472 [2:51:15<4:29:47,  3.52it/s]
 85%|████████▍ | 314489/371472 [2:51:15<4:20:00,  3.65it/s]
 85%|████████▍ | 314490/371472 [2:51:15<4:10:07,  3.80it/s]
 85%|████████▍ | 314491/371472 [2:51:15<4:25:51,  3.57it/s]
 85%|████████▍ | 314492/371472 [2:51:16<4:16:52,  3.70it/s]
 85%|████████▍ | 314493/371472 [2:51:16<4:11:56,  3.77it/s]
 85%|████████▍ | 314494/371472 [2:51:16<4:17:31,  3.69it/s]
 85%|████████▍ | 314495/371472 [2:51:16<4:21:05,  3.64it/s]
 85%|████████▍ | 314496/371472 [2:51:17<4:18:41,  3.67it/s]
 85%|████████▍ | 314497/371472 [2:51:17<4:17:27,  3.69it/s]
 85%|████████▍ | 314498/371472 [2:51:17<4:20:44,  3.64it/s]
 85%|████████▍ | 314499/371472 [2:51:18<4:14:30,  3.73it/s]
 85%|████████▍ | 314500/371472 [2:51:18<4:09:15,  3.81it/s]
                                                           
{'loss': 2.6354, 'learning_rate': 2.3810575534917796e-07, 'epoch': 13.55}

 85%|████████▍ | 314500/371472 [2:51:18<4:09:15,  3.81it/s]
 85%|████████▍ | 314501/371472 [2:51:18<4:11:20,  3.78it/s]
 85%|████████▍ | 314502/371472 [2:51:18<4:07:25,  3.84it/s]
 85%|████████▍ | 314503/371472 [2:51:19<4:25:21,  3.58it/s]
 85%|████████▍ | 314504/371472 [2:51:19<4:33:34,  3.47it/s]
 85%|████████▍ | 314505/371472 [2:51:19<4:24:58,  3.58it/s]
 85%|████████▍ | 314506/371472 [2:51:19<4:21:32,  3.63it/s]
 85%|████████▍ | 314507/371472 [2:51:20<4:30:23,  3.51it/s]
 85%|████████▍ | 314508/371472 [2:51:20<4:42:36,  3.36it/s]
 85%|████████▍ | 314509/371472 [2:51:20<4:33:39,  3.47it/s]
 85%|████████▍ | 314510/371472 [2:51:21<4:26:58,  3.56it/s]
 85%|████████▍ | 314511/371472 [2:51:21<4:44:22,  3.34it/s]
 85%|████████▍ | 314512/371472 [2:51:21<4:39:33,  3.40it/s]
 85%|████████▍ | 314513/371472 [2:51:22<4:34:53,  3.45it/s]
 85%|████████▍ | 314514/371472 [2:51:22<4:27:55,  3.54it/s]
 85%|████████▍ | 314515/371472 [2:51:22<4:27:55,  3.54it/s]
 85%|████████▍ | 314516/371472 [2:51:22<4:23:22,  3.60it/s]
 85%|████████▍ | 314517/371472 [2:51:23<4:14:24,  3.73it/s]
 85%|████████▍ | 314518/371472 [2:51:23<4:07:47,  3.83it/s]
 85%|████████▍ | 314519/371472 [2:51:23<4:07:35,  3.83it/s]
 85%|████████▍ | 314520/371472 [2:51:23<4:05:18,  3.87it/s]
                                                           
{'loss': 2.6145, 'learning_rate': 2.3805727337369903e-07, 'epoch': 13.55}

 85%|████████▍ | 314520/371472 [2:51:23<4:05:18,  3.87it/s]
 85%|████████▍ | 314521/371472 [2:51:24<4:20:26,  3.64it/s]
 85%|████████▍ | 314522/371472 [2:51:24<4:30:05,  3.51it/s]
 85%|████████▍ | 314523/371472 [2:51:24<4:34:23,  3.46it/s]
 85%|████████▍ | 314524/371472 [2:51:25<4:26:43,  3.56it/s]
 85%|████████▍ | 314525/371472 [2:51:25<4:29:46,  3.52it/s]
 85%|████████▍ | 314526/371472 [2:51:25<4:23:26,  3.60it/s]
 85%|████████▍ | 314527/371472 [2:51:25<4:14:14,  3.73it/s]
 85%|████████▍ | 314528/371472 [2:51:26<4:07:48,  3.83it/s]
 85%|████████▍ | 314529/371472 [2:51:26<4:09:41,  3.80it/s]
 85%|████████▍ | 314530/371472 [2:51:26<4:20:43,  3.64it/s]
 85%|████████▍ | 314531/371472 [2:51:26<4:29:39,  3.52it/s]
 85%|████████▍ | 314532/371472 [2:51:27<4:34:51,  3.45it/s]
 85%|████████▍ | 314533/371472 [2:51:27<4:27:24,  3.55it/s]
 85%|████████▍ | 314534/371472 [2:51:27<4:21:37,  3.63it/s]
 85%|████████▍ | 314535/371472 [2:51:28<4:17:41,  3.68it/s]
 85%|████████▍ | 314536/371472 [2:51:28<4:22:17,  3.62it/s]
 85%|████████▍ | 314537/371472 [2:51:28<4:18:24,  3.67it/s]
 85%|████████▍ | 314538/371472 [2:51:28<4:12:50,  3.75it/s]
 85%|████████▍ | 314539/371472 [2:51:29<4:34:34,  3.46it/s]
 85%|████████▍ | 314540/371472 [2:51:29<4:54:29,  3.22it/s]
                                                           
{'loss': 2.6656, 'learning_rate': 2.3800879139822019e-07, 'epoch': 13.55}

 85%|████████▍ | 314540/371472 [2:51:29<4:54:29,  3.22it/s]
 85%|████████▍ | 314541/371472 [2:51:29<4:50:54,  3.26it/s]
 85%|████████▍ | 314542/371472 [2:51:30<4:41:05,  3.38it/s]
 85%|████████▍ | 314543/371472 [2:51:30<4:37:53,  3.41it/s]
 85%|████████▍ | 314544/371472 [2:51:30<4:32:20,  3.48it/s]
 85%|████████▍ | 314545/371472 [2:51:30<4:33:27,  3.47it/s]
 85%|████████▍ | 314546/371472 [2:51:31<4:37:21,  3.42it/s]
 85%|████████▍ | 314547/371472 [2:51:31<4:22:00,  3.62it/s]
 85%|████████▍ | 314548/371472 [2:51:31<4:21:23,  3.63it/s]
 85%|████████▍ | 314549/371472 [2:51:32<4:27:26,  3.55it/s]
 85%|████████▍ | 314550/371472 [2:51:32<4:31:03,  3.50it/s]
 85%|████████▍ | 314551/371472 [2:51:32<4:29:55,  3.51it/s]
 85%|████████▍ | 314552/371472 [2:51:32<4:25:27,  3.57it/s]
 85%|████████▍ | 314553/371472 [2:51:33<4:38:32,  3.41it/s]
 85%|████████▍ | 314554/371472 [2:51:33<4:31:25,  3.50it/s]
 85%|████████▍ | 314555/371472 [2:51:33<4:21:39,  3.63it/s]
 85%|████████▍ | 314556/371472 [2:51:34<4:20:07,  3.65it/s]
 85%|████████▍ | 314557/371472 [2:51:34<4:29:10,  3.52it/s]
 85%|████████▍ | 314558/371472 [2:51:34<4:31:54,  3.49it/s]
 85%|████████▍ | 314559/371472 [2:51:34<4:34:35,  3.45it/s]
 85%|████████▍ | 314560/371472 [2:51:35<4:27:32,  3.55it/s]
                                                           
{'loss': 2.6923, 'learning_rate': 2.3796030942274126e-07, 'epoch': 13.55}

 85%|████████▍ | 314560/371472 [2:51:35<4:27:32,  3.55it/s]
 85%|████████▍ | 314561/371472 [2:51:35<4:42:26,  3.36it/s]
 85%|████████▍ | 314562/371472 [2:51:35<4:45:49,  3.32it/s]
 85%|████████▍ | 314563/371472 [2:51:36<4:31:10,  3.50it/s]
 85%|████████▍ | 314564/371472 [2:51:36<4:44:36,  3.33it/s]
 85%|████████▍ | 314565/371472 [2:51:36<4:35:12,  3.45it/s]
 85%|████████▍ | 314566/371472 [2:51:36<4:21:52,  3.62it/s]
 85%|████████▍ | 314567/371472 [2:51:37<4:29:53,  3.51it/s]
 85%|████████▍ | 314568/371472 [2:51:37<4:24:04,  3.59it/s]
 85%|████████▍ | 314569/371472 [2:51:37<4:24:22,  3.59it/s]
 85%|████████▍ | 314570/371472 [2:51:38<4:22:07,  3.62it/s]
 85%|████████▍ | 314571/371472 [2:51:38<4:36:48,  3.43it/s]
 85%|████████▍ | 314572/371472 [2:51:38<4:53:30,  3.23it/s]
 85%|████████▍ | 314573/371472 [2:51:39<4:48:19,  3.29it/s]
 85%|████████▍ | 314574/371472 [2:51:39<5:01:01,  3.15it/s]
 85%|████████▍ | 314575/371472 [2:51:39<4:44:31,  3.33it/s]
 85%|████████▍ | 314576/371472 [2:51:39<4:32:04,  3.49it/s]
 85%|████████▍ | 314577/371472 [2:51:40<4:33:13,  3.47it/s]
 85%|████████▍ | 314578/371472 [2:51:40<4:17:52,  3.68it/s]
 85%|████████▍ | 314579/371472 [2:51:40<4:12:22,  3.76it/s]
 85%|████████▍ | 314580/371472 [2:51:40<4:07:47,  3.83it/s]
                                                           
{'loss': 2.5696, 'learning_rate': 2.379118274472624e-07, 'epoch': 13.55}

 85%|████████▍ | 314580/371472 [2:51:40<4:07:47,  3.83it/s]
 85%|████████▍ | 314581/371472 [2:51:41<4:19:55,  3.65it/s]
 85%|████████▍ | 314582/371472 [2:51:41<4:22:54,  3.61it/s]
 85%|████████▍ | 314583/371472 [2:51:41<4:13:01,  3.75it/s]
 85%|████████▍ | 314584/371472 [2:51:42<4:23:08,  3.60it/s]
 85%|████████▍ | 314585/371472 [2:51:42<4:48:09,  3.29it/s]
 85%|████████▍ | 314586/371472 [2:51:42<4:35:20,  3.44it/s]
 85%|████████▍ | 314587/371472 [2:51:42<4:29:38,  3.52it/s]
 85%|████████▍ | 314588/371472 [2:51:43<4:20:43,  3.64it/s]
 85%|████████▍ | 314589/371472 [2:51:43<4:15:59,  3.70it/s]
 85%|████████▍ | 314590/371472 [2:51:43<4:38:18,  3.41it/s]
 85%|████████▍ | 314591/371472 [2:51:44<4:30:28,  3.51it/s]
 85%|████████▍ | 314592/371472 [2:51:44<4:39:37,  3.39it/s]
 85%|████████▍ | 314593/371472 [2:51:44<4:41:20,  3.37it/s]
 85%|████████▍ | 314594/371472 [2:51:45<4:53:01,  3.24it/s]
 85%|████████▍ | 314595/371472 [2:51:45<4:37:37,  3.41it/s]
 85%|████████▍ | 314596/371472 [2:51:45<4:44:11,  3.34it/s]
 85%|████████▍ | 314597/371472 [2:51:45<4:33:34,  3.47it/s]
 85%|████████▍ | 314598/371472 [2:51:46<4:35:07,  3.45it/s]
 85%|████████▍ | 314599/371472 [2:51:46<4:35:02,  3.45it/s]
 85%|████████▍ | 314600/371472 [2:51:46<4:48:04,  3.29it/s]
                                                           
{'loss': 2.5214, 'learning_rate': 2.3786334547178348e-07, 'epoch': 13.55}

 85%|████████▍ | 314600/371472 [2:51:46<4:48:04,  3.29it/s]
 85%|████████▍ | 314601/371472 [2:51:47<4:51:23,  3.25it/s]
 85%|████████▍ | 314602/371472 [2:51:47<4:51:32,  3.25it/s]
 85%|████████▍ | 314603/371472 [2:51:47<4:46:47,  3.30it/s]
 85%|████████▍ | 314604/371472 [2:51:47<4:28:25,  3.53it/s]
 85%|████████▍ | 314605/371472 [2:51:48<4:13:13,  3.74it/s]
 85%|████████▍ | 314606/371472 [2:51:48<4:21:53,  3.62it/s]
 85%|████████▍ | 314607/371472 [2:51:48<4:25:56,  3.56it/s]
 85%|████████▍ | 314608/371472 [2:51:49<4:34:03,  3.46it/s]
 85%|████████▍ | 314609/371472 [2:51:49<4:46:50,  3.30it/s]
 85%|████████▍ | 314610/371472 [2:51:49<4:37:20,  3.42it/s]
 85%|████████▍ | 314611/371472 [2:51:49<4:24:47,  3.58it/s]
 85%|████████▍ | 314612/371472 [2:51:50<4:28:17,  3.53it/s]
 85%|████████▍ | 314613/371472 [2:51:50<4:23:50,  3.59it/s]
 85%|████████▍ | 314614/371472 [2:51:50<4:15:30,  3.71it/s]
 85%|████████▍ | 314615/371472 [2:51:51<4:36:22,  3.43it/s]
 85%|████████▍ | 314616/371472 [2:51:51<4:30:38,  3.50it/s]
 85%|████████▍ | 314617/371472 [2:51:51<4:30:10,  3.51it/s]
 85%|████████▍ | 314618/371472 [2:51:51<4:35:27,  3.44it/s]
 85%|████████▍ | 314619/371472 [2:51:52<4:29:37,  3.51it/s]
 85%|████████▍ | 314620/371472 [2:51:52<4:23:50,  3.59it/s]
                                                           
{'loss': 2.6726, 'learning_rate': 2.3781486349630463e-07, 'epoch': 13.55}

 85%|████████▍ | 314620/371472 [2:51:52<4:23:50,  3.59it/s]
 85%|████████▍ | 314621/371472 [2:51:52<4:30:41,  3.50it/s]
 85%|████████▍ | 314622/371472 [2:51:53<4:24:07,  3.59it/s]
 85%|████████▍ | 314623/371472 [2:51:53<4:18:44,  3.66it/s]
 85%|████████▍ | 314624/371472 [2:51:53<4:40:02,  3.38it/s]
 85%|████████▍ | 314625/371472 [2:51:53<4:45:21,  3.32it/s]
 85%|████████▍ | 314626/371472 [2:51:54<4:57:26,  3.19it/s]
 85%|████████▍ | 314627/371472 [2:51:54<4:40:55,  3.37it/s]
 85%|████████▍ | 314628/371472 [2:51:54<4:29:14,  3.52it/s]
 85%|████████▍ | 314629/371472 [2:51:55<4:22:34,  3.61it/s]
 85%|████████▍ | 314630/371472 [2:51:55<4:11:05,  3.77it/s]
 85%|████████▍ | 314631/371472 [2:51:55<4:02:47,  3.90it/s]
 85%|████████▍ | 314632/371472 [2:51:55<4:02:39,  3.90it/s]
 85%|████████▍ | 314633/371472 [2:51:56<3:59:19,  3.96it/s]
 85%|████████▍ | 314634/371472 [2:51:56<4:15:29,  3.71it/s]
 85%|████████▍ | 314635/371472 [2:51:56<4:27:01,  3.55it/s]
 85%|████████▍ | 314636/371472 [2:51:56<4:23:11,  3.60it/s]
 85%|████████▍ | 314637/371472 [2:51:57<4:26:01,  3.56it/s]
 85%|████████▍ | 314638/371472 [2:51:57<4:19:17,  3.65it/s]
 85%|████████▍ | 314639/371472 [2:51:57<4:24:01,  3.59it/s]
 85%|████████▍ | 314640/371472 [2:51:58<4:16:11,  3.70it/s]
                                                           
{'loss': 2.7103, 'learning_rate': 2.3776638152082568e-07, 'epoch': 13.55}

 85%|████████▍ | 314640/371472 [2:51:58<4:16:11,  3.70it/s]
 85%|████████▍ | 314641/371472 [2:51:58<4:16:26,  3.69it/s]
 85%|████████▍ | 314642/371472 [2:51:58<4:23:20,  3.60it/s]
 85%|████████▍ | 314643/371472 [2:51:58<4:15:00,  3.71it/s]
 85%|████████▍ | 314644/371472 [2:51:59<4:29:59,  3.51it/s]
 85%|████████▍ | 314645/371472 [2:51:59<4:23:29,  3.59it/s]
 85%|████████▍ | 314646/371472 [2:51:59<4:29:35,  3.51it/s]
 85%|████████▍ | 314647/371472 [2:51:59<4:14:01,  3.73it/s]
 85%|████████▍ | 314648/371472 [2:52:00<4:21:25,  3.62it/s]
 85%|████████▍ | 314649/371472 [2:52:00<4:08:40,  3.81it/s]
 85%|████████▍ | 314650/371472 [2:52:00<4:15:38,  3.70it/s]
 85%|████████▍ | 314651/371472 [2:52:01<4:20:47,  3.63it/s]
 85%|████████▍ | 314652/371472 [2:52:01<4:21:54,  3.62it/s]
 85%|████████▍ | 314653/371472 [2:52:01<4:20:31,  3.64it/s]
 85%|████████▍ | 314654/371472 [2:52:01<4:17:09,  3.68it/s]
 85%|████████▍ | 314655/371472 [2:52:02<4:15:23,  3.71it/s]
 85%|████████▍ | 314656/371472 [2:52:02<4:10:59,  3.77it/s]
 85%|████████▍ | 314657/371472 [2:52:02<4:06:53,  3.84it/s]
 85%|████████▍ | 314658/371472 [2:52:02<4:04:26,  3.87it/s]
 85%|████████▍ | 314659/371472 [2:52:03<4:03:42,  3.89it/s]
 85%|████████▍ | 314660/371472 [2:52:03<4:16:58,  3.68it/s]
                                                           
{'loss': 2.5352, 'learning_rate': 2.3771789954534683e-07, 'epoch': 13.55}

 85%|████████▍ | 314660/371472 [2:52:03<4:16:58,  3.68it/s]
 85%|████████▍ | 314661/371472 [2:52:03<4:27:37,  3.54it/s]
 85%|████████▍ | 314662/371472 [2:52:04<4:34:12,  3.45it/s]
 85%|████████▍ | 314663/371472 [2:52:04<4:39:37,  3.39it/s]
 85%|████████▍ | 314664/371472 [2:52:04<4:35:44,  3.43it/s]
 85%|████████▍ | 314665/371472 [2:52:04<4:34:05,  3.45it/s]
 85%|████████▍ | 314666/371472 [2:52:05<4:43:38,  3.34it/s]
 85%|████████▍ | 314667/371472 [2:52:05<4:37:00,  3.42it/s]
 85%|████████▍ | 314668/371472 [2:52:05<4:33:28,  3.46it/s]
 85%|████████▍ | 314669/371472 [2:52:06<4:19:59,  3.64it/s]
 85%|████████▍ | 314670/371472 [2:52:06<4:15:28,  3.71it/s]
 85%|████████▍ | 314671/371472 [2:52:06<4:12:46,  3.75it/s]
 85%|████████▍ | 314672/371472 [2:52:06<4:17:00,  3.68it/s]
 85%|████████▍ | 314673/371472 [2:52:07<4:19:03,  3.65it/s]
 85%|████████▍ | 314674/371472 [2:52:07<4:28:25,  3.53it/s]
 85%|████████▍ | 314675/371472 [2:52:07<4:22:26,  3.61it/s]
 85%|████████▍ | 314676/371472 [2:52:07<4:24:44,  3.58it/s]
 85%|████████▍ | 314677/371472 [2:52:08<4:27:01,  3.54it/s]
 85%|████████▍ | 314678/371472 [2:52:08<4:46:46,  3.30it/s]
 85%|████████▍ | 314679/371472 [2:52:08<4:35:24,  3.44it/s]
 85%|████████▍ | 314680/371472 [2:52:09<4:22:55,  3.60it/s]
                                                           
{'loss': 2.4609, 'learning_rate': 2.376694175698679e-07, 'epoch': 13.55}

 85%|████████▍ | 314680/371472 [2:52:09<4:22:55,  3.60it/s]
 85%|████████▍ | 314681/371472 [2:52:09<4:12:14,  3.75it/s]
 85%|████████▍ | 314682/371472 [2:52:09<4:25:42,  3.56it/s]
 85%|████████▍ | 314683/371472 [2:52:09<4:29:53,  3.51it/s]
 85%|████████▍ | 314684/371472 [2:52:10<4:31:02,  3.49it/s]
 85%|████████▍ | 314685/371472 [2:52:10<4:34:23,  3.45it/s]
 85%|████████▍ | 314686/371472 [2:52:10<4:52:13,  3.24it/s]
 85%|████████▍ | 314687/371472 [2:52:11<4:47:48,  3.29it/s]
 85%|████████▍ | 314688/371472 [2:52:11<4:29:52,  3.51it/s]
 85%|████████▍ | 314689/371472 [2:52:11<4:21:22,  3.62it/s]
 85%|████████▍ | 314690/371472 [2:52:11<4:26:10,  3.56it/s]
 85%|████████▍ | 314691/371472 [2:52:12<4:45:50,  3.31it/s]
 85%|████████▍ | 314692/371472 [2:52:12<4:47:18,  3.29it/s]
 85%|████████▍ | 314693/371472 [2:52:12<4:39:58,  3.38it/s]
 85%|████████▍ | 314694/371472 [2:52:13<4:29:15,  3.51it/s]
 85%|████████▍ | 314695/371472 [2:52:13<4:29:26,  3.51it/s]
 85%|████████▍ | 314696/371472 [2:52:13<4:40:17,  3.38it/s]
 85%|████████▍ | 314697/371472 [2:52:14<4:47:46,  3.29it/s]
 85%|████████▍ | 314698/371472 [2:52:14<4:33:17,  3.46it/s]
 85%|████████▍ | 314699/371472 [2:52:14<4:37:17,  3.41it/s]
 85%|████████▍ | 314700/371472 [2:52:14<4:26:58,  3.54it/s]
                                                           
{'loss': 2.7057, 'learning_rate': 2.3762093559438905e-07, 'epoch': 13.55}

 85%|████████▍ | 314700/371472 [2:52:14<4:26:58,  3.54it/s]
 85%|████████▍ | 314701/371472 [2:52:15<4:40:42,  3.37it/s]
 85%|████████▍ | 314702/371472 [2:52:15<4:23:50,  3.59it/s]
 85%|████████▍ | 314703/371472 [2:52:15<4:39:23,  3.39it/s]
 85%|████████▍ | 314704/371472 [2:52:16<4:41:40,  3.36it/s]
 85%|████████▍ | 314705/371472 [2:52:16<4:33:35,  3.46it/s]
 85%|████████▍ | 314706/371472 [2:52:16<4:38:26,  3.40it/s]
 85%|████████▍ | 314707/371472 [2:52:17<4:43:11,  3.34it/s]
 85%|████████▍ | 314708/371472 [2:52:17<4:26:51,  3.55it/s]
 85%|████████▍ | 314709/371472 [2:52:17<4:33:35,  3.46it/s]
 85%|████████▍ | 314710/371472 [2:52:17<4:31:13,  3.49it/s]
 85%|████████▍ | 314711/371472 [2:52:18<4:34:24,  3.45it/s]
 85%|████████▍ | 314712/371472 [2:52:18<4:19:13,  3.65it/s]
 85%|████████▍ | 314713/371472 [2:52:18<4:22:22,  3.61it/s]
 85%|████████▍ | 314714/371472 [2:52:18<4:16:25,  3.69it/s]
 85%|████████▍ | 314715/371472 [2:52:19<4:21:29,  3.62it/s]
 85%|████████▍ | 314716/371472 [2:52:19<4:15:08,  3.71it/s]
 85%|████████▍ | 314717/371472 [2:52:19<4:31:55,  3.48it/s]
 85%|████████▍ | 314718/371472 [2:52:20<4:30:44,  3.49it/s]
 85%|████████▍ | 314719/371472 [2:52:20<4:24:07,  3.58it/s]
 85%|████████▍ | 314720/371472 [2:52:20<4:48:18,  3.28it/s]
                                                           
{'loss': 2.7537, 'learning_rate': 2.3757245361891012e-07, 'epoch': 13.56}

 85%|████████▍ | 314720/371472 [2:52:20<4:48:18,  3.28it/s]
 85%|████████▍ | 314721/371472 [2:52:20<4:28:39,  3.52it/s]
 85%|████████▍ | 314722/371472 [2:52:21<4:48:56,  3.27it/s]
 85%|████████▍ | 314723/371472 [2:52:21<4:37:57,  3.40it/s]
 85%|████████▍ | 314724/371472 [2:52:21<4:28:35,  3.52it/s]
 85%|████████▍ | 314725/371472 [2:52:22<4:13:09,  3.74it/s]
 85%|████████▍ | 314726/371472 [2:52:22<4:17:29,  3.67it/s]
 85%|████████▍ | 314727/371472 [2:52:22<4:18:13,  3.66it/s]
 85%|████████▍ | 314728/371472 [2:52:22<4:12:37,  3.74it/s]
 85%|████████▍ | 314729/371472 [2:52:23<4:27:50,  3.53it/s]
 85%|████████▍ | 314730/371472 [2:52:23<4:34:12,  3.45it/s]
 85%|████████▍ | 314731/371472 [2:52:23<4:41:23,  3.36it/s]
 85%|████████▍ | 314732/371472 [2:52:24<4:36:23,  3.42it/s]
 85%|████████▍ | 314733/371472 [2:52:24<4:26:13,  3.55it/s]
 85%|████████▍ | 314734/371472 [2:52:24<4:18:53,  3.65it/s]
 85%|████████▍ | 314735/371472 [2:52:24<4:23:59,  3.58it/s]
 85%|████████▍ | 314736/371472 [2:52:25<4:21:38,  3.61it/s]
 85%|████████▍ | 314737/371472 [2:52:25<4:29:33,  3.51it/s]
 85%|████████▍ | 314738/371472 [2:52:25<4:23:48,  3.58it/s]
 85%|████████▍ | 314739/371472 [2:52:25<4:13:17,  3.73it/s]
 85%|████████▍ | 314740/371472 [2:52:26<4:04:58,  3.86it/s]
                                                           
{'loss': 2.5772, 'learning_rate': 2.3752397164343127e-07, 'epoch': 13.56}

 85%|████████▍ | 314740/371472 [2:52:26<4:04:58,  3.86it/s]
 85%|████████▍ | 314741/371472 [2:52:26<4:16:14,  3.69it/s]
 85%|████████▍ | 314742/371472 [2:52:26<4:20:10,  3.63it/s]
 85%|████████▍ | 314743/371472 [2:52:27<4:15:42,  3.70it/s]
 85%|████████▍ | 314744/371472 [2:52:27<4:18:34,  3.66it/s]
 85%|████████▍ | 314745/371472 [2:52:27<4:17:21,  3.67it/s]
 85%|████████▍ | 314746/371472 [2:52:27<4:27:11,  3.54it/s]
 85%|████████▍ | 314747/371472 [2:52:28<4:47:11,  3.29it/s]
 85%|████████▍ | 314748/371472 [2:52:28<4:41:10,  3.36it/s]
 85%|████████▍ | 314749/371472 [2:52:28<4:34:19,  3.45it/s]
 85%|████████▍ | 314750/371472 [2:52:29<4:17:15,  3.67it/s]
 85%|████████▍ | 314751/371472 [2:52:29<4:16:17,  3.69it/s]
 85%|████████▍ | 314752/371472 [2:52:29<4:15:28,  3.70it/s]
 85%|████████▍ | 314753/371472 [2:52:29<4:29:52,  3.50it/s]
 85%|████████▍ | 314754/371472 [2:52:30<4:29:17,  3.51it/s]
 85%|████████▍ | 314755/371472 [2:52:30<4:41:28,  3.36it/s]
 85%|████████▍ | 314756/371472 [2:52:30<4:40:19,  3.37it/s]
 85%|████████▍ | 314757/371472 [2:52:31<4:38:34,  3.39it/s]
 85%|████████▍ | 314758/371472 [2:52:31<4:21:48,  3.61it/s]
 85%|████████▍ | 314759/371472 [2:52:31<4:08:58,  3.80it/s]
 85%|████████▍ | 314760/371472 [2:52:31<4:16:31,  3.68it/s]
                                                           
{'loss': 2.8235, 'learning_rate': 2.3747548966795232e-07, 'epoch': 13.56}

 85%|████████▍ | 314760/371472 [2:52:31<4:16:31,  3.68it/s]
 85%|████████▍ | 314761/371472 [2:52:32<4:30:18,  3.50it/s]
 85%|████████▍ | 314762/371472 [2:52:32<4:24:01,  3.58it/s]
 85%|████████▍ | 314763/371472 [2:52:32<5:06:28,  3.08it/s]
 85%|████████▍ | 314764/371472 [2:52:33<4:58:51,  3.16it/s]
 85%|████████▍ | 314765/371472 [2:52:33<4:44:03,  3.33it/s]
 85%|████████▍ | 314766/371472 [2:52:33<4:35:52,  3.43it/s]
 85%|████████▍ | 314767/371472 [2:52:33<4:28:43,  3.52it/s]
 85%|████████▍ | 314768/371472 [2:52:34<4:27:02,  3.54it/s]
 85%|████████▍ | 314769/371472 [2:52:34<4:41:39,  3.36it/s]
 85%|████████▍ | 314770/371472 [2:52:34<5:09:20,  3.05it/s]
 85%|████████▍ | 314771/371472 [2:52:35<5:06:18,  3.09it/s]
 85%|████████▍ | 314772/371472 [2:52:35<4:56:05,  3.19it/s]
 85%|████████▍ | 314773/371472 [2:52:35<4:47:52,  3.28it/s]
 85%|████████▍ | 314774/371472 [2:52:36<4:36:28,  3.42it/s]
 85%|████████▍ | 314775/371472 [2:52:36<4:27:49,  3.53it/s]
 85%|████████▍ | 314776/371472 [2:52:36<4:38:41,  3.39it/s]
 85%|████████▍ | 314777/371472 [2:52:37<4:36:49,  3.41it/s]
 85%|████████▍ | 314778/371472 [2:52:37<4:27:44,  3.53it/s]
 85%|████████▍ | 314779/371472 [2:52:37<4:45:41,  3.31it/s]
 85%|████████▍ | 314780/371472 [2:52:38<5:07:50,  3.07it/s]
                                                           
{'loss': 2.6092, 'learning_rate': 2.3742700769247347e-07, 'epoch': 13.56}

 85%|████████▍ | 314780/371472 [2:52:38<5:07:50,  3.07it/s]
 85%|████████▍ | 314781/371472 [2:52:38<4:55:54,  3.19it/s]
 85%|████████▍ | 314782/371472 [2:52:38<4:46:05,  3.30it/s]
 85%|████████▍ | 314783/371472 [2:52:38<4:42:38,  3.34it/s]
 85%|████████▍ | 314784/371472 [2:52:39<4:35:46,  3.43it/s]
 85%|████████▍ | 314785/371472 [2:52:39<4:34:15,  3.44it/s]
 85%|████████▍ | 314786/371472 [2:52:39<4:19:09,  3.65it/s]
 85%|████████▍ | 314787/371472 [2:52:39<4:16:44,  3.68it/s]
 85%|████████▍ | 314788/371472 [2:52:40<4:03:39,  3.88it/s]
 85%|████████▍ | 314789/371472 [2:52:40<4:01:34,  3.91it/s]
 85%|████████▍ | 314790/371472 [2:52:40<4:02:24,  3.90it/s]
 85%|████████▍ | 314791/371472 [2:52:40<3:58:52,  3.95it/s]
 85%|████████▍ | 314792/371472 [2:52:41<4:11:02,  3.76it/s]
 85%|████████▍ | 314793/371472 [2:52:41<4:27:31,  3.53it/s]
 85%|████████▍ | 314794/371472 [2:52:41<4:15:37,  3.70it/s]
 85%|████████▍ | 314795/371472 [2:52:42<4:21:25,  3.61it/s]
 85%|████████▍ | 314796/371472 [2:52:42<4:28:14,  3.52it/s]
 85%|████████▍ | 314797/371472 [2:52:42<4:14:11,  3.72it/s]
 85%|████████▍ | 314798/371472 [2:52:42<4:35:25,  3.43it/s]
 85%|████████▍ | 314799/371472 [2:52:43<4:20:37,  3.62it/s]
 85%|████████▍ | 314800/371472 [2:52:43<4:17:32,  3.67it/s]
                                                           
{'loss': 2.6274, 'learning_rate': 2.3737852571699454e-07, 'epoch': 13.56}

 85%|████████▍ | 314800/371472 [2:52:43<4:17:32,  3.67it/s]
 85%|████████▍ | 314801/371472 [2:52:43<4:06:43,  3.83it/s]
 85%|████████▍ | 314802/371472 [2:52:43<4:06:45,  3.83it/s]
 85%|████████▍ | 314803/371472 [2:52:44<4:07:43,  3.81it/s]
 85%|████████▍ | 314804/371472 [2:52:44<4:09:38,  3.78it/s]
 85%|████████▍ | 314805/371472 [2:52:44<4:11:36,  3.75it/s]
 85%|████████▍ | 314806/371472 [2:52:45<4:12:08,  3.75it/s]
 85%|████████▍ | 314807/371472 [2:52:45<4:14:45,  3.71it/s]
 85%|████████▍ | 314808/371472 [2:52:45<4:25:23,  3.56it/s]
 85%|████████▍ | 314809/371472 [2:52:45<4:17:32,  3.67it/s]
 85%|████████▍ | 314810/371472 [2:52:46<4:37:18,  3.41it/s]
 85%|████████▍ | 314811/371472 [2:52:46<4:24:23,  3.57it/s]
 85%|████████▍ | 314812/371472 [2:52:46<4:31:50,  3.47it/s]
 85%|████████▍ | 314813/371472 [2:52:47<4:27:04,  3.54it/s]
 85%|████████▍ | 314814/371472 [2:52:47<4:33:35,  3.45it/s]
 85%|████████▍ | 314815/371472 [2:52:47<4:33:33,  3.45it/s]
 85%|████████▍ | 314816/371472 [2:52:47<4:23:34,  3.58it/s]
 85%|████████▍ | 314817/371472 [2:52:48<4:47:15,  3.29it/s]
 85%|████████▍ | 314818/371472 [2:52:48<4:37:18,  3.40it/s]
 85%|████████▍ | 314819/371472 [2:52:48<4:40:00,  3.37it/s]
 85%|████████▍ | 314820/371472 [2:52:49<4:49:50,  3.26it/s]
                                                           
{'loss': 2.6005, 'learning_rate': 2.3733004374151558e-07, 'epoch': 13.56}

 85%|████████▍ | 314820/371472 [2:52:49<4:49:50,  3.26it/s]
 85%|████████▍ | 314821/371472 [2:52:49<4:31:57,  3.47it/s]
 85%|████████▍ | 314822/371472 [2:52:49<4:23:26,  3.58it/s]
 85%|████████▍ | 314823/371472 [2:52:50<5:00:00,  3.15it/s]
 85%|████████▍ | 314824/371472 [2:52:50<4:46:31,  3.30it/s]
 85%|████████▍ | 314825/371472 [2:52:50<4:50:43,  3.25it/s]
 85%|████████▍ | 314826/371472 [2:52:50<4:35:36,  3.43it/s]
 85%|████████▍ | 314827/371472 [2:52:51<4:34:00,  3.45it/s]
 85%|████████▍ | 314828/371472 [2:52:51<4:33:40,  3.45it/s]
 85%|████████▍ | 314829/371472 [2:52:51<4:25:30,  3.56it/s]
 85%|████████▍ | 314830/371472 [2:52:51<4:20:02,  3.63it/s]
 85%|████████▍ | 314831/371472 [2:52:52<4:21:31,  3.61it/s]
 85%|████████▍ | 314832/371472 [2:52:52<4:25:44,  3.55it/s]
 85%|████████▍ | 314833/371472 [2:52:52<4:20:05,  3.63it/s]
 85%|████████▍ | 314834/371472 [2:52:53<4:13:41,  3.72it/s]
 85%|████████▍ | 314835/371472 [2:52:53<4:23:18,  3.59it/s]
 85%|████████▍ | 314836/371472 [2:52:53<4:27:08,  3.53it/s]
 85%|████████▍ | 314837/371472 [2:52:54<4:48:47,  3.27it/s]
 85%|████████▍ | 314838/371472 [2:52:54<4:41:19,  3.36it/s]
 85%|████████▍ | 314839/371472 [2:52:54<4:27:32,  3.53it/s]
 85%|████████▍ | 314840/371472 [2:52:54<4:30:15,  3.49it/s]
                                                           
{'loss': 2.5692, 'learning_rate': 2.3728156176603676e-07, 'epoch': 13.56}

 85%|████████▍ | 314840/371472 [2:52:54<4:30:15,  3.49it/s]
 85%|████████▍ | 314841/371472 [2:52:55<4:32:49,  3.46it/s]
 85%|████████▍ | 314842/371472 [2:52:55<4:34:43,  3.44it/s]
 85%|████████▍ | 314843/371472 [2:52:55<4:36:52,  3.41it/s]
 85%|████████▍ | 314844/371472 [2:52:56<4:32:00,  3.47it/s]
 85%|████████▍ | 314845/371472 [2:52:56<4:36:06,  3.42it/s]
 85%|████████▍ | 314846/371472 [2:52:56<4:26:01,  3.55it/s]
 85%|████████▍ | 314847/371472 [2:52:56<4:34:18,  3.44it/s]
 85%|████████▍ | 314848/371472 [2:52:57<4:35:26,  3.43it/s]
 85%|████████▍ | 314849/371472 [2:52:57<4:30:48,  3.48it/s]
 85%|████████▍ | 314850/371472 [2:52:57<4:53:00,  3.22it/s]
 85%|████████▍ | 314851/371472 [2:52:58<4:45:24,  3.31it/s]
 85%|████████▍ | 314852/371472 [2:52:58<4:35:16,  3.43it/s]
 85%|████████▍ | 314853/371472 [2:52:58<4:34:45,  3.43it/s]
 85%|████████▍ | 314854/371472 [2:52:58<4:21:34,  3.61it/s]
 85%|████████▍ | 314855/371472 [2:52:59<4:16:11,  3.68it/s]
 85%|████████▍ | 314856/371472 [2:52:59<4:12:20,  3.74it/s]
 85%|████████▍ | 314857/371472 [2:52:59<4:11:48,  3.75it/s]
 85%|████████▍ | 314858/371472 [2:52:59<4:25:45,  3.55it/s]
 85%|████████▍ | 314859/371472 [2:53:00<4:37:19,  3.40it/s]
 85%|████████▍ | 314860/371472 [2:53:00<4:58:14,  3.16it/s]
                                                           
{'loss': 2.558, 'learning_rate': 2.372330797905578e-07, 'epoch': 13.56}

 85%|████████▍ | 314860/371472 [2:53:00<4:58:14,  3.16it/s]
 85%|████████▍ | 314861/371472 [2:53:00<4:45:17,  3.31it/s]
 85%|████████▍ | 314862/371472 [2:53:01<4:40:14,  3.37it/s]
 85%|████████▍ | 314863/371472 [2:53:01<4:29:06,  3.51it/s]
 85%|████████▍ | 314864/371472 [2:53:01<4:35:28,  3.42it/s]
 85%|████████▍ | 314865/371472 [2:53:02<4:24:50,  3.56it/s]
 85%|████████▍ | 314866/371472 [2:53:02<4:18:55,  3.64it/s]
 85%|████████▍ | 314867/371472 [2:53:02<4:23:58,  3.57it/s]
 85%|████████▍ | 314868/371472 [2:53:02<4:18:08,  3.65it/s]
 85%|████████▍ | 314869/371472 [2:53:03<4:15:05,  3.70it/s]
 85%|████████▍ | 314870/371472 [2:53:03<4:22:28,  3.59it/s]
 85%|████████▍ | 314871/371472 [2:53:03<4:28:28,  3.51it/s]
 85%|████████▍ | 314872/371472 [2:53:04<4:29:00,  3.51it/s]
 85%|████████▍ | 314873/371472 [2:53:04<5:16:36,  2.98it/s]
 85%|████████▍ | 314874/371472 [2:53:04<4:57:51,  3.17it/s]
 85%|████████▍ | 314875/371472 [2:53:04<4:39:51,  3.37it/s]
 85%|████████▍ | 314876/371472 [2:53:05<4:38:53,  3.38it/s]
 85%|████████▍ | 314877/371472 [2:53:05<4:29:03,  3.51it/s]
 85%|████████▍ | 314878/371472 [2:53:05<4:17:49,  3.66it/s]
 85%|████████▍ | 314879/371472 [2:53:06<4:10:55,  3.76it/s]
 85%|████████▍ | 314880/371472 [2:53:06<4:15:28,  3.69it/s]
                                                           
{'loss': 2.6597, 'learning_rate': 2.3718459781507896e-07, 'epoch': 13.56}

 85%|████████▍ | 314880/371472 [2:53:06<4:15:28,  3.69it/s]
 85%|████████▍ | 314881/371472 [2:53:06<4:17:09,  3.67it/s]
 85%|████████▍ | 314882/371472 [2:53:06<4:19:37,  3.63it/s]
 85%|████████▍ | 314883/371472 [2:53:07<4:25:55,  3.55it/s]
 85%|████████▍ | 314884/371472 [2:53:07<4:12:31,  3.73it/s]
 85%|████████▍ | 314885/371472 [2:53:07<4:19:55,  3.63it/s]
 85%|████████▍ | 314886/371472 [2:53:08<4:26:56,  3.53it/s]
 85%|████████▍ | 314887/371472 [2:53:08<4:32:04,  3.47it/s]
 85%|████████▍ | 314888/371472 [2:53:08<4:19:21,  3.64it/s]
 85%|████████▍ | 314889/371472 [2:53:08<4:20:11,  3.62it/s]
 85%|████████▍ | 314890/371472 [2:53:09<4:23:52,  3.57it/s]
 85%|████████▍ | 314891/371472 [2:53:09<4:20:29,  3.62it/s]
 85%|████████▍ | 314892/371472 [2:53:09<4:26:31,  3.54it/s]
 85%|████████▍ | 314893/371472 [2:53:09<4:32:15,  3.46it/s]
 85%|████████▍ | 314894/371472 [2:53:10<4:21:23,  3.61it/s]
 85%|████████▍ | 314895/371472 [2:53:10<4:17:21,  3.66it/s]
 85%|████████▍ | 314896/371472 [2:53:10<4:23:35,  3.58it/s]
 85%|████████▍ | 314897/371472 [2:53:11<4:11:07,  3.75it/s]
 85%|████████▍ | 314898/371472 [2:53:11<4:10:12,  3.77it/s]
 85%|████████▍ | 314899/371472 [2:53:11<4:04:49,  3.85it/s]
 85%|████████▍ | 314900/371472 [2:53:11<3:57:23,  3.97it/s]
                                                           
{'loss': 2.5809, 'learning_rate': 2.3713611583960003e-07, 'epoch': 13.56}

 85%|████████▍ | 314900/371472 [2:53:11<3:57:23,  3.97it/s]
 85%|████████▍ | 314901/371472 [2:53:12<3:52:55,  4.05it/s]
 85%|████████▍ | 314902/371472 [2:53:12<3:57:14,  3.97it/s]
 85%|████████▍ | 314903/371472 [2:53:12<4:01:45,  3.90it/s]
 85%|████████▍ | 314904/371472 [2:53:12<4:06:29,  3.82it/s]
 85%|████████▍ | 314905/371472 [2:53:13<4:03:48,  3.87it/s]
 85%|████████▍ | 314906/371472 [2:53:13<4:03:34,  3.87it/s]
 85%|████████▍ | 314907/371472 [2:53:13<4:27:52,  3.52it/s]
 85%|████████▍ | 314908/371472 [2:53:13<4:13:00,  3.73it/s]
 85%|████████▍ | 314909/371472 [2:53:14<4:09:49,  3.77it/s]
 85%|████████▍ | 314910/371472 [2:53:14<4:20:23,  3.62it/s]
 85%|████████▍ | 314911/371472 [2:53:14<4:11:46,  3.74it/s]
 85%|████████▍ | 314912/371472 [2:53:14<4:10:54,  3.76it/s]
 85%|████████▍ | 314913/371472 [2:53:15<4:36:56,  3.40it/s]
 85%|████████▍ | 314914/371472 [2:53:15<4:30:25,  3.49it/s]
 85%|████████▍ | 314915/371472 [2:53:15<4:20:31,  3.62it/s]
 85%|████████▍ | 314916/371472 [2:53:16<4:24:03,  3.57it/s]
 85%|████████▍ | 314917/371472 [2:53:16<4:48:42,  3.26it/s]
 85%|████████▍ | 314918/371472 [2:53:16<4:44:31,  3.31it/s]
 85%|████████▍ | 314919/371472 [2:53:17<4:36:47,  3.41it/s]
 85%|████████▍ | 314920/371472 [2:53:17<5:03:50,  3.10it/s]
                                                           
{'loss': 2.5523, 'learning_rate': 2.3708763386412118e-07, 'epoch': 13.56}

 85%|████████▍ | 314920/371472 [2:53:17<5:03:50,  3.10it/s]
 85%|████████▍ | 314921/371472 [2:53:17<4:52:27,  3.22it/s]
 85%|████████▍ | 314922/371472 [2:53:18<4:49:28,  3.26it/s]
 85%|████████▍ | 314923/371472 [2:53:18<4:36:24,  3.41it/s]
 85%|████████▍ | 314924/371472 [2:53:18<4:39:45,  3.37it/s]
 85%|████████▍ | 314925/371472 [2:53:18<4:33:39,  3.44it/s]
 85%|████████▍ | 314926/371472 [2:53:19<4:36:19,  3.41it/s]
 85%|████████▍ | 314927/371472 [2:53:19<4:55:30,  3.19it/s]
 85%|████████▍ | 314928/371472 [2:53:19<4:36:52,  3.40it/s]
 85%|████████▍ | 314929/371472 [2:53:20<4:41:26,  3.35it/s]
 85%|████████▍ | 314930/371472 [2:53:20<4:28:35,  3.51it/s]
 85%|████████▍ | 314931/371472 [2:53:20<4:29:53,  3.49it/s]
 85%|████████▍ | 314932/371472 [2:53:20<4:24:17,  3.57it/s]
 85%|████████▍ | 314933/371472 [2:53:21<4:26:17,  3.54it/s]
 85%|████████▍ | 314934/371472 [2:53:21<4:18:42,  3.64it/s]
 85%|████████▍ | 314935/371472 [2:53:21<4:14:07,  3.71it/s]
 85%|████████▍ | 314936/371472 [2:53:21<4:07:38,  3.80it/s]
 85%|████████▍ | 314937/371472 [2:53:22<4:11:27,  3.75it/s]
 85%|████████▍ | 314938/371472 [2:53:22<4:25:36,  3.55it/s]
 85%|████████▍ | 314939/371472 [2:53:22<4:29:07,  3.50it/s]
 85%|████████▍ | 314940/371472 [2:53:23<4:22:57,  3.58it/s]
                                                           
{'loss': 2.6379, 'learning_rate': 2.3703915188864225e-07, 'epoch': 13.57}

 85%|████████▍ | 314940/371472 [2:53:23<4:22:57,  3.58it/s]
 85%|████████▍ | 314941/371472 [2:53:23<4:16:06,  3.68it/s]
 85%|████████▍ | 314942/371472 [2:53:23<4:12:36,  3.73it/s]
 85%|████████▍ | 314943/371472 [2:53:23<4:10:34,  3.76it/s]
 85%|████████▍ | 314944/371472 [2:53:24<4:11:23,  3.75it/s]
 85%|████████▍ | 314945/371472 [2:53:24<4:25:12,  3.55it/s]
 85%|████████▍ | 314946/371472 [2:53:24<4:28:46,  3.51it/s]
 85%|████████▍ | 314947/371472 [2:53:25<4:17:13,  3.66it/s]
 85%|████████▍ | 314948/371472 [2:53:25<4:13:09,  3.72it/s]
 85%|████████▍ | 314949/371472 [2:53:25<4:18:01,  3.65it/s]
 85%|████████▍ | 314950/371472 [2:53:25<4:11:59,  3.74it/s]
 85%|████████▍ | 314951/371472 [2:53:26<4:09:30,  3.78it/s]
 85%|████████▍ | 314952/371472 [2:53:26<4:02:41,  3.88it/s]
 85%|████████▍ | 314953/371472 [2:53:26<4:02:37,  3.88it/s]
 85%|████████▍ | 314954/371472 [2:53:26<4:07:16,  3.81it/s]
 85%|████████▍ | 314955/371472 [2:53:27<4:02:56,  3.88it/s]
 85%|████████▍ | 314956/371472 [2:53:27<4:06:04,  3.83it/s]
 85%|████████▍ | 314957/371472 [2:53:27<4:13:52,  3.71it/s]
 85%|████████▍ | 314958/371472 [2:53:27<4:22:04,  3.59it/s]
 85%|████████▍ | 314959/371472 [2:53:28<4:21:18,  3.60it/s]
 85%|████████▍ | 314960/371472 [2:53:28<4:33:42,  3.44it/s]
                                                           
{'loss': 2.708, 'learning_rate': 2.369906699131634e-07, 'epoch': 13.57}

 85%|████████▍ | 314960/371472 [2:53:28<4:33:42,  3.44it/s]
 85%|████████▍ | 314961/371472 [2:53:28<4:29:17,  3.50it/s]
 85%|████████▍ | 314962/371472 [2:53:29<4:22:35,  3.59it/s]
 85%|████████▍ | 314963/371472 [2:53:29<4:20:38,  3.61it/s]
 85%|████████▍ | 314964/371472 [2:53:29<4:15:48,  3.68it/s]
 85%|████████▍ | 314965/371472 [2:53:29<4:05:26,  3.84it/s]
 85%|████████▍ | 314966/371472 [2:53:30<4:07:13,  3.81it/s]
 85%|████████▍ | 314967/371472 [2:53:30<4:09:34,  3.77it/s]
 85%|████████▍ | 314968/371472 [2:53:30<4:11:25,  3.75it/s]
 85%|████████▍ | 314969/371472 [2:53:30<4:21:43,  3.60it/s]
 85%|████████▍ | 314970/371472 [2:53:31<4:10:17,  3.76it/s]
 85%|████████▍ | 314971/371472 [2:53:31<4:14:09,  3.71it/s]
 85%|████████▍ | 314972/371472 [2:53:31<4:06:51,  3.81it/s]
 85%|████████▍ | 314973/371472 [2:53:31<4:05:48,  3.83it/s]
 85%|████████▍ | 314974/371472 [2:53:32<4:42:37,  3.33it/s]
 85%|████████▍ | 314975/371472 [2:53:32<4:35:52,  3.41it/s]
 85%|████████▍ | 314976/371472 [2:53:32<4:35:00,  3.42it/s]
 85%|████████▍ | 314977/371472 [2:53:33<4:43:25,  3.32it/s]
 85%|████████▍ | 314978/371472 [2:53:33<4:51:59,  3.22it/s]
 85%|████████▍ | 314979/371472 [2:53:33<4:42:20,  3.33it/s]
 85%|████████▍ | 314980/371472 [2:53:34<4:31:28,  3.47it/s]
                                                           
{'loss': 2.4451, 'learning_rate': 2.3694218793768445e-07, 'epoch': 13.57}

 85%|████████▍ | 314980/371472 [2:53:34<4:31:28,  3.47it/s]
 85%|████████▍ | 314981/371472 [2:53:34<4:19:33,  3.63it/s]
 85%|████████▍ | 314982/371472 [2:53:34<4:11:33,  3.74it/s]
 85%|████████▍ | 314983/371472 [2:53:34<4:18:20,  3.64it/s]
 85%|████████▍ | 314984/371472 [2:53:35<4:16:18,  3.67it/s]
 85%|████████▍ | 314985/371472 [2:53:35<4:26:18,  3.54it/s]
 85%|████████▍ | 314986/371472 [2:53:35<4:16:52,  3.67it/s]
 85%|████████▍ | 314987/371472 [2:53:35<4:11:17,  3.75it/s]
 85%|████████▍ | 314988/371472 [2:53:36<4:25:28,  3.55it/s]
 85%|████████▍ | 314989/371472 [2:53:36<4:42:05,  3.34it/s]
 85%|████████▍ | 314990/371472 [2:53:36<4:27:48,  3.52it/s]
 85%|████████▍ | 314991/371472 [2:53:37<4:27:15,  3.52it/s]
 85%|████████▍ | 314992/371472 [2:53:37<4:21:23,  3.60it/s]
 85%|████████▍ | 314993/371472 [2:53:37<4:35:55,  3.41it/s]
 85%|████████▍ | 314994/371472 [2:53:38<4:34:40,  3.43it/s]
 85%|████████▍ | 314995/371472 [2:53:38<4:58:00,  3.16it/s]
 85%|████████▍ | 314996/371472 [2:53:38<4:42:53,  3.33it/s]
 85%|████████▍ | 314997/371472 [2:53:39<4:46:25,  3.29it/s]
 85%|████████▍ | 314998/371472 [2:53:39<4:36:46,  3.40it/s]
 85%|████████▍ | 314999/371472 [2:53:39<4:40:06,  3.36it/s]
 85%|████████▍ | 315000/371472 [2:53:39<4:30:24,  3.48it/s]
                                                           
{'loss': 2.6896, 'learning_rate': 2.3689370596220562e-07, 'epoch': 13.57}

 85%|████████▍ | 315000/371472 [2:53:39<4:30:24,  3.48it/s]
 85%|████████▍ | 315001/371472 [2:53:40<4:35:03,  3.42it/s]
 85%|████████▍ | 315002/371472 [2:53:40<4:22:36,  3.58it/s]
 85%|████████▍ | 315003/371472 [2:53:40<4:17:18,  3.66it/s]
 85%|████████▍ | 315004/371472 [2:53:40<4:28:18,  3.51it/s]
 85%|████████▍ | 315005/371472 [2:53:41<4:18:47,  3.64it/s]
 85%|████████▍ | 315006/371472 [2:53:41<4:41:19,  3.35it/s]
 85%|████████▍ | 315007/371472 [2:53:41<4:25:52,  3.54it/s]
 85%|████████▍ | 315008/371472 [2:53:42<4:23:11,  3.58it/s]
 85%|████████▍ | 315009/371472 [2:53:42<4:31:49,  3.46it/s]
 85%|████████▍ | 315010/371472 [2:53:42<4:35:58,  3.41it/s]
 85%|████████▍ | 315011/371472 [2:53:43<4:45:45,  3.29it/s]
 85%|████████▍ | 315012/371472 [2:53:43<4:47:07,  3.28it/s]
 85%|████████▍ | 315013/371472 [2:53:43<4:32:13,  3.46it/s]
 85%|████████▍ | 315014/371472 [2:53:43<4:33:21,  3.44it/s]
 85%|████████▍ | 315015/371472 [2:53:44<4:22:23,  3.59it/s]
 85%|████████▍ | 315016/371472 [2:53:44<4:20:58,  3.61it/s]
 85%|████████▍ | 315017/371472 [2:53:44<4:14:15,  3.70it/s]
 85%|████████▍ | 315018/371472 [2:53:44<4:19:09,  3.63it/s]
 85%|████████▍ | 315019/371472 [2:53:45<4:28:39,  3.50it/s]
 85%|████████▍ | 315020/371472 [2:53:45<4:16:57,  3.66it/s]
                                                           
{'loss': 2.642, 'learning_rate': 2.3684522398672664e-07, 'epoch': 13.57}

 85%|████████▍ | 315020/371472 [2:53:45<4:16:57,  3.66it/s]
 85%|████████▍ | 315021/371472 [2:53:45<4:13:40,  3.71it/s]
 85%|████████▍ | 315022/371472 [2:53:46<4:08:28,  3.79it/s]
 85%|████████▍ | 315023/371472 [2:53:46<4:20:01,  3.62it/s]
 85%|████████▍ | 315024/371472 [2:53:46<4:21:03,  3.60it/s]
 85%|████████▍ | 315025/371472 [2:53:46<4:17:11,  3.66it/s]
 85%|████████▍ | 315026/371472 [2:53:47<4:21:23,  3.60it/s]
 85%|████████▍ | 315027/371472 [2:53:47<4:17:51,  3.65it/s]
 85%|████████▍ | 315028/371472 [2:53:47<4:43:19,  3.32it/s]
 85%|████████▍ | 315029/371472 [2:53:48<4:33:32,  3.44it/s]
 85%|████████▍ | 315030/371472 [2:53:48<4:22:44,  3.58it/s]
 85%|████████▍ | 315031/371472 [2:53:48<4:23:17,  3.57it/s]
 85%|████████▍ | 315032/371472 [2:53:48<4:26:51,  3.52it/s]
 85%|████████▍ | 315033/371472 [2:53:49<4:16:54,  3.66it/s]
 85%|████████▍ | 315034/371472 [2:53:49<4:09:53,  3.76it/s]
 85%|████████▍ | 315035/371472 [2:53:49<4:17:53,  3.65it/s]
 85%|████████▍ | 315036/371472 [2:53:49<4:18:18,  3.64it/s]
 85%|████████▍ | 315037/371472 [2:53:50<4:21:00,  3.60it/s]
 85%|████████▍ | 315038/371472 [2:53:50<4:12:55,  3.72it/s]
 85%|████████▍ | 315039/371472 [2:53:50<4:37:40,  3.39it/s]
 85%|████████▍ | 315040/371472 [2:53:51<4:26:49,  3.52it/s]
                                                           
{'loss': 2.6705, 'learning_rate': 2.3679674201124782e-07, 'epoch': 13.57}

 85%|████████▍ | 315040/371472 [2:53:51<4:26:49,  3.52it/s]
 85%|████████▍ | 315041/371472 [2:53:51<4:40:33,  3.35it/s]
 85%|████████▍ | 315042/371472 [2:53:51<4:29:34,  3.49it/s]
 85%|████████▍ | 315043/371472 [2:53:51<4:31:59,  3.46it/s]
 85%|████████▍ | 315044/371472 [2:53:52<4:24:36,  3.55it/s]
 85%|████████▍ | 315045/371472 [2:53:52<4:19:07,  3.63it/s]
 85%|████████▍ | 315046/371472 [2:53:52<4:15:54,  3.67it/s]
 85%|████████▍ | 315047/371472 [2:53:53<4:12:32,  3.72it/s]
 85%|████████▍ | 315048/371472 [2:53:53<4:16:54,  3.66it/s]
 85%|████████▍ | 315049/371472 [2:53:53<4:23:43,  3.57it/s]
 85%|████████▍ | 315050/371472 [2:53:53<4:21:20,  3.60it/s]
 85%|████████▍ | 315051/371472 [2:53:54<4:13:33,  3.71it/s]
 85%|████████▍ | 315052/371472 [2:53:54<4:40:02,  3.36it/s]
 85%|████████▍ | 315053/371472 [2:53:54<4:32:39,  3.45it/s]
 85%|████████▍ | 315054/371472 [2:53:55<4:37:07,  3.39it/s]
 85%|████████▍ | 315055/371472 [2:53:55<4:35:58,  3.41it/s]
 85%|████████▍ | 315056/371472 [2:53:55<4:22:14,  3.59it/s]
 85%|████████▍ | 315057/371472 [2:53:55<4:18:20,  3.64it/s]
 85%|████████▍ | 315058/371472 [2:53:56<4:21:08,  3.60it/s]
 85%|████████▍ | 315059/371472 [2:53:56<4:20:49,  3.60it/s]
 85%|████████▍ | 315060/371472 [2:53:56<4:21:57,  3.59it/s]
                                                           
{'loss': 2.6188, 'learning_rate': 2.367482600357689e-07, 'epoch': 13.57}

 85%|████████▍ | 315060/371472 [2:53:56<4:21:57,  3.59it/s]
 85%|████████▍ | 315061/371472 [2:53:57<4:27:40,  3.51it/s]
 85%|████████▍ | 315062/371472 [2:53:57<4:39:20,  3.37it/s]
 85%|████████▍ | 315063/371472 [2:53:57<4:43:37,  3.31it/s]
 85%|████████▍ | 315064/371472 [2:53:57<4:39:50,  3.36it/s]
 85%|████████▍ | 315065/371472 [2:53:58<4:33:54,  3.43it/s]
 85%|████████▍ | 315066/371472 [2:53:58<4:26:53,  3.52it/s]
 85%|████████▍ | 315067/371472 [2:53:58<4:21:04,  3.60it/s]
 85%|████████▍ | 315068/371472 [2:53:58<4:12:39,  3.72it/s]
 85%|████████▍ | 315069/371472 [2:53:59<4:05:39,  3.83it/s]
 85%|████████▍ | 315070/371472 [2:53:59<4:13:42,  3.71it/s]
 85%|████████▍ | 315071/371472 [2:53:59<4:04:23,  3.85it/s]
 85%|████████▍ | 315072/371472 [2:54:00<4:02:37,  3.87it/s]
 85%|████████▍ | 315073/371472 [2:54:00<4:02:58,  3.87it/s]
 85%|████████▍ | 315074/371472 [2:54:00<4:00:33,  3.91it/s]
 85%|████████▍ | 315075/371472 [2:54:00<3:58:12,  3.95it/s]
 85%|████████▍ | 315076/371472 [2:54:01<4:03:27,  3.86it/s]
 85%|████████▍ | 315077/371472 [2:54:01<4:05:29,  3.83it/s]
 85%|████████▍ | 315078/371472 [2:54:01<4:07:40,  3.79it/s]
 85%|████████▍ | 315079/371472 [2:54:01<4:13:13,  3.71it/s]
 85%|████████▍ | 315080/371472 [2:54:02<4:09:31,  3.77it/s]
                                                           
{'loss': 2.5622, 'learning_rate': 2.3669977806029004e-07, 'epoch': 13.57}

 85%|████████▍ | 315080/371472 [2:54:02<4:09:31,  3.77it/s]
 85%|████████▍ | 315081/371472 [2:54:02<4:10:11,  3.76it/s]
 85%|████████▍ | 315082/371472 [2:54:02<4:37:19,  3.39it/s]
 85%|████████▍ | 315083/371472 [2:54:03<4:34:20,  3.43it/s]
 85%|████████▍ | 315084/371472 [2:54:03<4:43:14,  3.32it/s]
 85%|████████▍ | 315085/371472 [2:54:03<4:25:46,  3.54it/s]
 85%|████████▍ | 315086/371472 [2:54:03<4:17:32,  3.65it/s]
 85%|████████▍ | 315087/371472 [2:54:04<4:36:19,  3.40it/s]
 85%|████████▍ | 315088/371472 [2:54:04<4:29:11,  3.49it/s]
 85%|████████▍ | 315089/371472 [2:54:04<4:51:33,  3.22it/s]
 85%|████████▍ | 315090/371472 [2:54:05<4:53:17,  3.20it/s]
 85%|████████▍ | 315091/371472 [2:54:05<4:40:26,  3.35it/s]
 85%|████████▍ | 315092/371472 [2:54:05<4:39:33,  3.36it/s]
 85%|████████▍ | 315093/371472 [2:54:06<4:59:36,  3.14it/s]
 85%|████████▍ | 315094/371472 [2:54:06<4:50:09,  3.24it/s]
 85%|████████▍ | 315095/371472 [2:54:06<4:36:48,  3.39it/s]
 85%|████████▍ | 315096/371472 [2:54:06<4:22:01,  3.59it/s]
 85%|████████▍ | 315097/371472 [2:54:07<5:30:09,  2.85it/s]
 85%|████████▍ | 315098/371472 [2:54:07<5:13:36,  3.00it/s]
 85%|████████▍ | 315099/371472 [2:54:07<4:48:35,  3.26it/s]
 85%|████████▍ | 315100/371472 [2:54:08<4:44:39,  3.30it/s]
                                                           
{'loss': 2.6521, 'learning_rate': 2.3665129608481111e-07, 'epoch': 13.57}

 85%|████████▍ | 315100/371472 [2:54:08<4:44:39,  3.30it/s]
 85%|████████▍ | 315101/371472 [2:54:08<4:37:07,  3.39it/s]
 85%|████████▍ | 315102/371472 [2:54:08<4:36:11,  3.40it/s]
 85%|████████▍ | 315103/371472 [2:54:09<4:29:26,  3.49it/s]
 85%|████████▍ | 315104/371472 [2:54:09<4:54:23,  3.19it/s]
 85%|████████▍ | 315105/371472 [2:54:09<5:12:29,  3.01it/s]
 85%|████████▍ | 315106/371472 [2:54:10<4:50:59,  3.23it/s]
 85%|████████▍ | 315107/371472 [2:54:10<4:34:47,  3.42it/s]
 85%|████████▍ | 315108/371472 [2:54:10<4:24:53,  3.55it/s]
 85%|████████▍ | 315109/371472 [2:54:10<4:14:38,  3.69it/s]
 85%|████████▍ | 315110/371472 [2:54:11<4:14:42,  3.69it/s]
 85%|████████▍ | 315111/371472 [2:54:11<4:07:46,  3.79it/s]
 85%|████████▍ | 315112/371472 [2:54:11<3:57:45,  3.95it/s]
 85%|████████▍ | 315113/371472 [2:54:11<3:58:43,  3.93it/s]
 85%|████████▍ | 315114/371472 [2:54:12<4:10:16,  3.75it/s]
 85%|████████▍ | 315115/371472 [2:54:12<4:04:22,  3.84it/s]
 85%|████████▍ | 315116/371472 [2:54:12<3:57:33,  3.95it/s]
 85%|████████▍ | 315117/371472 [2:54:12<3:54:53,  4.00it/s]
 85%|████████▍ | 315118/371472 [2:54:13<3:51:36,  4.06it/s]
 85%|████████▍ | 315119/371472 [2:54:13<4:04:05,  3.85it/s]
 85%|████████▍ | 315120/371472 [2:54:13<4:11:06,  3.74it/s]
                                                           
{'loss': 2.6237, 'learning_rate': 2.3660281410933226e-07, 'epoch': 13.57}

 85%|████████▍ | 315120/371472 [2:54:13<4:11:06,  3.74it/s]
 85%|████████▍ | 315121/371472 [2:54:13<4:25:30,  3.54it/s]
 85%|████████▍ | 315122/371472 [2:54:14<4:22:44,  3.57it/s]
 85%|████████▍ | 315123/371472 [2:54:14<4:17:59,  3.64it/s]
 85%|████████▍ | 315124/371472 [2:54:14<4:26:45,  3.52it/s]
 85%|████████▍ | 315125/371472 [2:54:15<4:24:25,  3.55it/s]
 85%|████████▍ | 315126/371472 [2:54:15<4:31:27,  3.46it/s]
 85%|████████▍ | 315127/371472 [2:54:15<4:19:16,  3.62it/s]
 85%|████████▍ | 315128/371472 [2:54:15<4:25:18,  3.54it/s]
 85%|████████▍ | 315129/371472 [2:54:16<4:24:26,  3.55it/s]
 85%|████████▍ | 315130/371472 [2:54:16<4:36:23,  3.40it/s]
 85%|████████▍ | 315131/371472 [2:54:16<4:28:45,  3.49it/s]
 85%|████████▍ | 315132/371472 [2:54:17<4:23:47,  3.56it/s]
 85%|████████▍ | 315133/371472 [2:54:17<4:18:19,  3.63it/s]
 85%|████████▍ | 315134/371472 [2:54:17<4:22:29,  3.58it/s]
 85%|████████▍ | 315135/371472 [2:54:17<4:13:52,  3.70it/s]
 85%|████████▍ | 315136/371472 [2:54:18<4:27:54,  3.50it/s]
 85%|████████▍ | 315137/371472 [2:54:18<4:30:25,  3.47it/s]
 85%|████████▍ | 315138/371472 [2:54:18<4:34:15,  3.42it/s]
 85%|████████▍ | 315139/371472 [2:54:19<4:37:01,  3.39it/s]
 85%|████████▍ | 315140/371472 [2:54:19<4:32:02,  3.45it/s]
                                                           
{'loss': 2.7317, 'learning_rate': 2.365543321338533e-07, 'epoch': 13.57}

 85%|████████▍ | 315140/371472 [2:54:19<4:32:02,  3.45it/s]
 85%|████████▍ | 315141/371472 [2:54:19<4:23:09,  3.57it/s]
 85%|████████▍ | 315142/371472 [2:54:19<4:42:23,  3.32it/s]
 85%|████████▍ | 315143/371472 [2:54:20<4:30:06,  3.48it/s]
 85%|████████▍ | 315144/371472 [2:54:20<4:57:32,  3.16it/s]
 85%|████████▍ | 315145/371472 [2:54:20<5:04:30,  3.08it/s]
 85%|████████▍ | 315146/371472 [2:54:21<4:51:57,  3.22it/s]
 85%|████████▍ | 315147/371472 [2:54:21<4:39:00,  3.36it/s]
 85%|████████▍ | 315148/371472 [2:54:21<4:36:04,  3.40it/s]
 85%|████████▍ | 315149/371472 [2:54:22<4:32:41,  3.44it/s]
 85%|████████▍ | 315150/371472 [2:54:22<4:29:19,  3.49it/s]
 85%|████████▍ | 315151/371472 [2:54:22<4:44:41,  3.30it/s]
 85%|████████▍ | 315152/371472 [2:54:22<4:30:17,  3.47it/s]
 85%|████████▍ | 315153/371472 [2:54:23<4:22:12,  3.58it/s]
 85%|████████▍ | 315154/371472 [2:54:23<4:37:46,  3.38it/s]
 85%|████████▍ | 315155/371472 [2:54:23<4:38:59,  3.36it/s]
 85%|████████▍ | 315156/371472 [2:54:24<4:26:22,  3.52it/s]
 85%|████████▍ | 315157/371472 [2:54:24<5:23:31,  2.90it/s]
 85%|████████▍ | 315158/371472 [2:54:24<5:00:47,  3.12it/s]
 85%|████████▍ | 315159/371472 [2:54:25<4:42:58,  3.32it/s]
 85%|████████▍ | 315160/371472 [2:54:25<4:47:39,  3.26it/s]
                                                           
{'loss': 2.5398, 'learning_rate': 2.365058501583745e-07, 'epoch': 13.57}

 85%|████████▍ | 315160/371472 [2:54:25<4:47:39,  3.26it/s]
 85%|████████▍ | 315161/371472 [2:54:25<4:33:38,  3.43it/s]
 85%|████████▍ | 315162/371472 [2:54:25<4:38:39,  3.37it/s]
 85%|████████▍ | 315163/371472 [2:54:26<4:24:43,  3.55it/s]
 85%|████████▍ | 315164/371472 [2:54:26<4:16:32,  3.66it/s]
 85%|████████▍ | 315165/371472 [2:54:26<4:17:51,  3.64it/s]
 85%|████████▍ | 315166/371472 [2:54:27<4:21:07,  3.59it/s]
 85%|████████▍ | 315167/371472 [2:54:27<4:13:19,  3.70it/s]
 85%|████████▍ | 315168/371472 [2:54:27<4:11:37,  3.73it/s]
 85%|████████▍ | 315169/371472 [2:54:27<4:06:04,  3.81it/s]
 85%|████████▍ | 315170/371472 [2:54:28<4:21:50,  3.58it/s]
 85%|████████▍ | 315171/371472 [2:54:28<4:27:16,  3.51it/s]
 85%|████████▍ | 315172/371472 [2:54:28<4:26:24,  3.52it/s]
 85%|████████▍ | 315173/371472 [2:54:29<4:28:20,  3.50it/s]
 85%|████████▍ | 315174/371472 [2:54:29<4:24:29,  3.55it/s]
 85%|████████▍ | 315175/371472 [2:54:29<4:26:54,  3.52it/s]
 85%|████████▍ | 315176/371472 [2:54:29<4:17:38,  3.64it/s]
 85%|████████▍ | 315177/371472 [2:54:30<4:17:27,  3.64it/s]
 85%|████████▍ | 315178/371472 [2:54:30<4:10:28,  3.75it/s]
 85%|████████▍ | 315179/371472 [2:54:30<4:13:37,  3.70it/s]
 85%|████████▍ | 315180/371472 [2:54:30<4:14:08,  3.69it/s]
                                                           
{'loss': 2.734, 'learning_rate': 2.3645736818289553e-07, 'epoch': 13.58}

 85%|████████▍ | 315180/371472 [2:54:30<4:14:08,  3.69it/s]
 85%|████████▍ | 315181/371472 [2:54:31<4:09:58,  3.75it/s]
 85%|████████▍ | 315182/371472 [2:54:31<4:07:54,  3.78it/s]
 85%|████████▍ | 315183/371472 [2:54:31<4:32:41,  3.44it/s]
 85%|████████▍ | 315184/371472 [2:54:32<4:49:03,  3.25it/s]
 85%|████████▍ | 315185/371472 [2:54:32<4:30:21,  3.47it/s]
 85%|████████▍ | 315186/371472 [2:54:32<4:22:58,  3.57it/s]
 85%|████████▍ | 315187/371472 [2:54:32<4:22:38,  3.57it/s]
 85%|████████▍ | 315188/371472 [2:54:33<4:24:09,  3.55it/s]
 85%|████████▍ | 315189/371472 [2:54:33<4:35:53,  3.40it/s]
 85%|████████▍ | 315190/371472 [2:54:33<4:26:19,  3.52it/s]
 85%|████████▍ | 315191/371472 [2:54:34<4:19:24,  3.62it/s]
 85%|████████▍ | 315192/371472 [2:54:34<4:40:58,  3.34it/s]
 85%|████████▍ | 315193/371472 [2:54:34<4:35:13,  3.41it/s]
 85%|████████▍ | 315194/371472 [2:54:34<4:31:33,  3.45it/s]
 85%|████████▍ | 315195/371472 [2:54:35<4:29:23,  3.48it/s]
 85%|████████▍ | 315196/371472 [2:54:35<4:24:33,  3.55it/s]
 85%|████████▍ | 315197/371472 [2:54:35<4:20:29,  3.60it/s]
 85%|████████▍ | 315198/371472 [2:54:36<4:35:44,  3.40it/s]
 85%|████████▍ | 315199/371472 [2:54:36<4:23:41,  3.56it/s]
 85%|████████▍ | 315200/371472 [2:54:36<4:20:19,  3.60it/s]
                                                           
{'loss': 2.4298, 'learning_rate': 2.364088862074167e-07, 'epoch': 13.58}

 85%|████████▍ | 315200/371472 [2:54:36<4:20:19,  3.60it/s]
 85%|████████▍ | 315201/371472 [2:54:36<4:14:44,  3.68it/s]
 85%|████████▍ | 315202/371472 [2:54:37<4:12:50,  3.71it/s]
 85%|████████▍ | 315203/371472 [2:54:37<4:08:01,  3.78it/s]
 85%|████████▍ | 315204/371472 [2:54:37<4:03:47,  3.85it/s]
 85%|████████▍ | 315205/371472 [2:54:37<3:59:39,  3.91it/s]
 85%|████████▍ | 315206/371472 [2:54:38<4:09:41,  3.76it/s]
 85%|████████▍ | 315207/371472 [2:54:38<4:27:17,  3.51it/s]
 85%|████████▍ | 315208/371472 [2:54:38<4:16:25,  3.66it/s]
 85%|████████▍ | 315209/371472 [2:54:39<4:13:31,  3.70it/s]
 85%|████████▍ | 315210/371472 [2:54:39<4:13:42,  3.70it/s]
 85%|████████▍ | 315211/371472 [2:54:39<4:11:08,  3.73it/s]
 85%|████████▍ | 315212/371472 [2:54:39<4:08:25,  3.77it/s]
 85%|████████▍ | 315213/371472 [2:54:40<4:05:29,  3.82it/s]
 85%|████████▍ | 315214/371472 [2:54:40<4:13:26,  3.70it/s]
 85%|████████▍ | 315215/371472 [2:54:40<4:08:04,  3.78it/s]
 85%|████████▍ | 315216/371472 [2:54:40<4:02:44,  3.86it/s]
 85%|████████▍ | 315217/371472 [2:54:41<4:04:53,  3.83it/s]
 85%|████████▍ | 315218/371472 [2:54:41<4:04:21,  3.84it/s]
 85%|████████▍ | 315219/371472 [2:54:41<4:08:27,  3.77it/s]
 85%|████████▍ | 315220/371472 [2:54:41<4:12:58,  3.71it/s]
                                                           
{'loss': 2.7553, 'learning_rate': 2.3636040423193775e-07, 'epoch': 13.58}

 85%|████████▍ | 315220/371472 [2:54:41<4:12:58,  3.71it/s]
 85%|████████▍ | 315221/371472 [2:54:42<4:19:51,  3.61it/s]
 85%|████████▍ | 315222/371472 [2:54:42<4:14:03,  3.69it/s]
 85%|████████▍ | 315223/371472 [2:54:42<4:16:15,  3.66it/s]
 85%|████████▍ | 315224/371472 [2:54:43<4:14:22,  3.69it/s]
 85%|████████▍ | 315225/371472 [2:54:43<4:06:09,  3.81it/s]
 85%|████████▍ | 315226/371472 [2:54:43<4:15:07,  3.67it/s]
 85%|████████▍ | 315227/371472 [2:54:43<4:35:36,  3.40it/s]
 85%|████████▍ | 315228/371472 [2:54:44<4:30:37,  3.46it/s]
 85%|████████▍ | 315229/371472 [2:54:44<4:41:21,  3.33it/s]
 85%|████████▍ | 315230/371472 [2:54:44<4:27:48,  3.50it/s]
 85%|████████▍ | 315231/371472 [2:54:45<4:21:55,  3.58it/s]
 85%|████████▍ | 315232/371472 [2:54:45<4:16:07,  3.66it/s]
 85%|████████▍ | 315233/371472 [2:54:45<4:17:07,  3.65it/s]
 85%|████████▍ | 315234/371472 [2:54:45<4:15:12,  3.67it/s]
 85%|████████▍ | 315235/371472 [2:54:46<4:20:35,  3.60it/s]
 85%|████████▍ | 315236/371472 [2:54:46<4:29:21,  3.48it/s]
 85%|████████▍ | 315237/371472 [2:54:46<4:29:41,  3.48it/s]
 85%|████████▍ | 315238/371472 [2:54:46<4:20:21,  3.60it/s]
 85%|████████▍ | 315239/371472 [2:54:47<4:43:30,  3.31it/s]
 85%|████████▍ | 315240/371472 [2:54:47<4:38:32,  3.36it/s]
                                                           
{'loss': 2.5988, 'learning_rate': 2.363119222564589e-07, 'epoch': 13.58}

 85%|████████▍ | 315240/371472 [2:54:47<4:38:32,  3.36it/s]
 85%|████████▍ | 315241/371472 [2:54:47<4:37:38,  3.38it/s]
 85%|████████▍ | 315242/371472 [2:54:48<4:39:55,  3.35it/s]
 85%|████████▍ | 315243/371472 [2:54:48<4:27:45,  3.50it/s]
 85%|████████▍ | 315244/371472 [2:54:48<4:11:51,  3.72it/s]
 85%|████████▍ | 315245/371472 [2:54:48<4:19:20,  3.61it/s]
 85%|████████▍ | 315246/371472 [2:54:49<4:21:00,  3.59it/s]
 85%|████████▍ | 315247/371472 [2:54:49<4:21:13,  3.59it/s]
 85%|████████▍ | 315248/371472 [2:54:49<4:16:57,  3.65it/s]
 85%|████████▍ | 315249/371472 [2:54:50<4:22:28,  3.57it/s]
 85%|████████▍ | 315250/371472 [2:54:50<4:21:28,  3.58it/s]
 85%|████████▍ | 315251/371472 [2:54:50<4:22:55,  3.56it/s]
 85%|████████▍ | 315252/371472 [2:54:50<4:23:16,  3.56it/s]
 85%|████████▍ | 315253/371472 [2:54:51<4:27:36,  3.50it/s]
 85%|████████▍ | 315254/371472 [2:54:51<4:54:59,  3.18it/s]
 85%|████████▍ | 315255/371472 [2:54:51<4:35:35,  3.40it/s]
 85%|████████▍ | 315256/371472 [2:54:52<4:41:46,  3.33it/s]
 85%|████████▍ | 315257/371472 [2:54:52<4:33:01,  3.43it/s]
 85%|████████▍ | 315258/371472 [2:54:52<4:29:41,  3.47it/s]
 85%|████████▍ | 315259/371472 [2:54:53<4:32:18,  3.44it/s]
 85%|████████▍ | 315260/371472 [2:54:53<4:24:45,  3.54it/s]
                                                           
{'loss': 2.7544, 'learning_rate': 2.3626344028097998e-07, 'epoch': 13.58}

 85%|████████▍ | 315260/371472 [2:54:53<4:24:45,  3.54it/s]
 85%|████████▍ | 315261/371472 [2:54:53<4:31:32,  3.45it/s]
 85%|████████▍ | 315262/371472 [2:54:53<4:38:24,  3.36it/s]
 85%|████████▍ | 315263/371472 [2:54:54<4:25:35,  3.53it/s]
 85%|████████▍ | 315264/371472 [2:54:54<4:12:06,  3.72it/s]
 85%|████████▍ | 315265/371472 [2:54:54<4:07:49,  3.78it/s]
 85%|████████▍ | 315266/371472 [2:54:54<4:05:59,  3.81it/s]
 85%|████████▍ | 315267/371472 [2:54:55<4:16:21,  3.65it/s]
 85%|████████▍ | 315268/371472 [2:54:55<4:07:24,  3.79it/s]
 85%|████████▍ | 315269/371472 [2:54:55<4:11:28,  3.72it/s]
 85%|████████▍ | 315270/371472 [2:54:56<4:23:06,  3.56it/s]
 85%|████████▍ | 315271/371472 [2:54:56<4:12:40,  3.71it/s]
 85%|████████▍ | 315272/371472 [2:54:56<4:13:12,  3.70it/s]
 85%|████████▍ | 315273/371472 [2:54:56<4:10:26,  3.74it/s]
 85%|████████▍ | 315274/371472 [2:54:57<4:11:56,  3.72it/s]
 85%|████████▍ | 315275/371472 [2:54:57<4:24:40,  3.54it/s]
 85%|████████▍ | 315276/371472 [2:54:57<4:17:04,  3.64it/s]
 85%|████████▍ | 315277/371472 [2:54:57<4:18:46,  3.62it/s]
 85%|████████▍ | 315278/371472 [2:54:58<4:18:13,  3.63it/s]
 85%|████████▍ | 315279/371472 [2:54:58<4:36:35,  3.39it/s]
 85%|████████▍ | 315280/371472 [2:54:58<4:33:28,  3.42it/s]
                                                           
{'loss': 2.7165, 'learning_rate': 2.3621495830550113e-07, 'epoch': 13.58}

 85%|████████▍ | 315280/371472 [2:54:58<4:33:28,  3.42it/s]
 85%|████████▍ | 315281/371472 [2:54:59<4:24:45,  3.54it/s]
 85%|████████▍ | 315282/371472 [2:54:59<4:23:49,  3.55it/s]
 85%|████████▍ | 315283/371472 [2:54:59<4:13:10,  3.70it/s]
 85%|████████▍ | 315284/371472 [2:54:59<4:06:02,  3.81it/s]
 85%|████████▍ | 315285/371472 [2:55:00<4:04:44,  3.83it/s]
 85%|████████▍ | 315286/371472 [2:55:00<3:59:34,  3.91it/s]
 85%|████████▍ | 315287/371472 [2:55:00<3:57:39,  3.94it/s]
 85%|████████▍ | 315288/371472 [2:55:00<3:59:56,  3.90it/s]
 85%|████████▍ | 315289/371472 [2:55:01<4:08:05,  3.77it/s]
 85%|████████▍ | 315290/371472 [2:55:01<4:22:54,  3.56it/s]
 85%|████████▍ | 315291/371472 [2:55:01<4:44:35,  3.29it/s]
 85%|████████▍ | 315292/371472 [2:55:02<4:28:12,  3.49it/s]
 85%|████████▍ | 315293/371472 [2:55:02<4:15:50,  3.66it/s]
 85%|████████▍ | 315294/371472 [2:55:02<4:36:28,  3.39it/s]
 85%|████████▍ | 315295/371472 [2:55:02<4:28:46,  3.48it/s]
 85%|████████▍ | 315296/371472 [2:55:03<4:46:20,  3.27it/s]
 85%|████████▍ | 315297/371472 [2:55:03<4:43:07,  3.31it/s]
 85%|████████▍ | 315298/371472 [2:55:03<4:42:11,  3.32it/s]
 85%|████████▍ | 315299/371472 [2:55:04<4:43:10,  3.31it/s]
 85%|████████▍ | 315300/371472 [2:55:04<4:32:04,  3.44it/s]
                                                           
{'loss': 2.789, 'learning_rate': 2.3616647633002217e-07, 'epoch': 13.58}

 85%|████████▍ | 315300/371472 [2:55:04<4:32:04,  3.44it/s]
 85%|████████▍ | 315301/371472 [2:55:04<4:29:26,  3.47it/s]
 85%|████████▍ | 315302/371472 [2:55:05<4:19:14,  3.61it/s]
 85%|████████▍ | 315303/371472 [2:55:05<4:17:26,  3.64it/s]
 85%|████████▍ | 315304/371472 [2:55:05<4:22:47,  3.56it/s]
 85%|████████▍ | 315305/371472 [2:55:05<4:29:41,  3.47it/s]
 85%|████████▍ | 315306/371472 [2:55:06<4:39:44,  3.35it/s]
 85%|████████▍ | 315307/371472 [2:55:06<5:01:10,  3.11it/s]
 85%|████████▍ | 315308/371472 [2:55:06<4:47:14,  3.26it/s]
 85%|████████▍ | 315309/371472 [2:55:07<4:39:41,  3.35it/s]
 85%|████████▍ | 315310/371472 [2:55:07<4:46:21,  3.27it/s]
 85%|████████▍ | 315311/371472 [2:55:07<4:38:01,  3.37it/s]
 85%|████████▍ | 315312/371472 [2:55:08<4:35:07,  3.40it/s]
 85%|████████▍ | 315313/371472 [2:55:08<4:39:29,  3.35it/s]
 85%|████████▍ | 315314/371472 [2:55:08<4:28:45,  3.48it/s]
 85%|████████▍ | 315315/371472 [2:55:08<4:21:48,  3.58it/s]
 85%|████████▍ | 315316/371472 [2:55:09<4:13:28,  3.69it/s]
 85%|████████▍ | 315317/371472 [2:55:09<4:09:29,  3.75it/s]
 85%|████████▍ | 315318/371472 [2:55:09<4:22:26,  3.57it/s]
 85%|████████▍ | 315319/371472 [2:55:09<4:08:03,  3.77it/s]
 85%|████████▍ | 315320/371472 [2:55:10<4:11:48,  3.72it/s]
                                                           
{'loss': 2.6278, 'learning_rate': 2.3611799435454335e-07, 'epoch': 13.58}

 85%|████████▍ | 315320/371472 [2:55:10<4:11:48,  3.72it/s]
 85%|████████▍ | 315321/371472 [2:55:10<4:07:15,  3.78it/s]
 85%|████████▍ | 315322/371472 [2:55:10<4:11:40,  3.72it/s]
 85%|████████▍ | 315323/371472 [2:55:10<4:10:14,  3.74it/s]
 85%|████████▍ | 315324/371472 [2:55:11<4:09:10,  3.76it/s]
 85%|████████▍ | 315325/371472 [2:55:11<4:04:30,  3.83it/s]
 85%|████████▍ | 315326/371472 [2:55:11<3:59:17,  3.91it/s]
 85%|████████▍ | 315327/371472 [2:55:11<4:00:50,  3.89it/s]
 85%|████████▍ | 315328/371472 [2:55:12<4:02:51,  3.85it/s]
 85%|████████▍ | 315329/371472 [2:55:12<4:10:49,  3.73it/s]
 85%|████████▍ | 315330/371472 [2:55:12<4:06:10,  3.80it/s]
 85%|████████▍ | 315331/371472 [2:55:13<3:58:56,  3.92it/s]
 85%|████████▍ | 315332/371472 [2:55:13<4:09:27,  3.75it/s]
 85%|████████▍ | 315333/371472 [2:55:13<4:21:50,  3.57it/s]
 85%|████████▍ | 315334/371472 [2:55:13<4:18:10,  3.62it/s]
 85%|████████▍ | 315335/371472 [2:55:14<4:13:50,  3.69it/s]
 85%|████████▍ | 315336/371472 [2:55:14<4:03:45,  3.84it/s]
 85%|████████▍ | 315337/371472 [2:55:14<4:04:29,  3.83it/s]
 85%|████████▍ | 315338/371472 [2:55:14<3:57:08,  3.95it/s]
 85%|████████▍ | 315339/371472 [2:55:15<3:57:45,  3.93it/s]
 85%|████████▍ | 315340/371472 [2:55:15<4:37:55,  3.37it/s]
                                                           
{'loss': 2.739, 'learning_rate': 2.360695123790644e-07, 'epoch': 13.58}

 85%|████████▍ | 315340/371472 [2:55:15<4:37:55,  3.37it/s]
 85%|████████▍ | 315341/371472 [2:55:15<4:49:51,  3.23it/s]
 85%|████████▍ | 315342/371472 [2:55:16<4:34:54,  3.40it/s]
 85%|████████▍ | 315343/371472 [2:55:16<4:25:45,  3.52it/s]
 85%|████████▍ | 315344/371472 [2:55:16<4:23:02,  3.56it/s]
 85%|████████▍ | 315345/371472 [2:55:16<4:13:55,  3.68it/s]
 85%|████████▍ | 315346/371472 [2:55:17<4:26:15,  3.51it/s]
 85%|████████▍ | 315347/371472 [2:55:17<4:31:36,  3.44it/s]
 85%|████████▍ | 315348/371472 [2:55:17<4:49:50,  3.23it/s]
 85%|████████▍ | 315349/371472 [2:55:18<4:50:39,  3.22it/s]
 85%|████████▍ | 315350/371472 [2:55:18<4:35:34,  3.39it/s]
 85%|████████▍ | 315351/371472 [2:55:18<4:24:36,  3.53it/s]
 85%|████████▍ | 315352/371472 [2:55:19<4:23:59,  3.54it/s]
 85%|████████▍ | 315353/371472 [2:55:19<4:15:03,  3.67it/s]
 85%|████████▍ | 315354/371472 [2:55:19<4:06:52,  3.79it/s]
 85%|████████▍ | 315355/371472 [2:55:19<4:14:02,  3.68it/s]
 85%|████████▍ | 315356/371472 [2:55:20<4:18:23,  3.62it/s]
 85%|████████▍ | 315357/371472 [2:55:20<4:12:04,  3.71it/s]
 85%|████████▍ | 315358/371472 [2:55:20<4:07:40,  3.78it/s]
 85%|████████▍ | 315359/371472 [2:55:20<4:04:36,  3.82it/s]
 85%|████████▍ | 315360/371472 [2:55:21<4:17:15,  3.64it/s]
                                                           
{'loss': 2.5887, 'learning_rate': 2.3602103040358544e-07, 'epoch': 13.58}

 85%|████████▍ | 315360/371472 [2:55:21<4:17:15,  3.64it/s]
 85%|████████▍ | 315361/371472 [2:55:21<4:36:32,  3.38it/s]
 85%|████████▍ | 315362/371472 [2:55:21<4:29:10,  3.47it/s]
 85%|████████▍ | 315363/371472 [2:55:22<4:45:26,  3.28it/s]
 85%|████████▍ | 315364/371472 [2:55:22<4:46:17,  3.27it/s]
 85%|████████▍ | 315365/371472 [2:55:22<4:41:24,  3.32it/s]
 85%|████████▍ | 315366/371472 [2:55:23<4:54:29,  3.18it/s]
 85%|████████▍ | 315367/371472 [2:55:23<4:41:42,  3.32it/s]
 85%|████████▍ | 315368/371472 [2:55:23<4:42:43,  3.31it/s]
 85%|████████▍ | 315369/371472 [2:55:23<4:36:02,  3.39it/s]
 85%|████████▍ | 315370/371472 [2:55:24<4:44:42,  3.28it/s]
 85%|████████▍ | 315371/371472 [2:55:24<4:53:55,  3.18it/s]
 85%|████████▍ | 315372/371472 [2:55:24<4:52:22,  3.20it/s]
 85%|████████▍ | 315373/371472 [2:55:25<4:55:00,  3.17it/s]
 85%|████████▍ | 315374/371472 [2:55:25<4:36:57,  3.38it/s]
 85%|████████▍ | 315375/371472 [2:55:25<4:33:53,  3.41it/s]
 85%|████████▍ | 315376/371472 [2:55:26<4:50:12,  3.22it/s]
 85%|████████▍ | 315377/371472 [2:55:26<4:40:47,  3.33it/s]
 85%|████████▍ | 315378/371472 [2:55:26<4:34:49,  3.40it/s]
 85%|████████▍ | 315379/371472 [2:55:26<4:32:16,  3.43it/s]
 85%|████████▍ | 315380/371472 [2:55:27<4:20:02,  3.60it/s]
                                                           
{'loss': 2.5674, 'learning_rate': 2.3597254842810662e-07, 'epoch': 13.58}

 85%|████████▍ | 315380/371472 [2:55:27<4:20:02,  3.60it/s]
 85%|████████▍ | 315381/371472 [2:55:27<4:19:14,  3.61it/s]
 85%|████████▍ | 315382/371472 [2:55:27<4:09:36,  3.75it/s]
 85%|████████▍ | 315383/371472 [2:55:27<4:12:54,  3.70it/s]
 85%|████████▍ | 315384/371472 [2:55:28<4:21:04,  3.58it/s]
 85%|████████▍ | 315385/371472 [2:55:28<4:33:11,  3.42it/s]
 85%|████████▍ | 315386/371472 [2:55:28<4:32:43,  3.43it/s]
 85%|████████▍ | 315387/371472 [2:55:29<4:40:55,  3.33it/s]
 85%|████████▍ | 315388/371472 [2:55:29<4:49:00,  3.23it/s]
 85%|████████▍ | 315389/371472 [2:55:29<4:33:33,  3.42it/s]
 85%|████████▍ | 315390/371472 [2:55:30<4:22:15,  3.56it/s]
 85%|████████▍ | 315391/371472 [2:55:30<4:23:58,  3.54it/s]
 85%|████████▍ | 315392/371472 [2:55:30<4:43:49,  3.29it/s]
 85%|████████▍ | 315393/371472 [2:55:30<4:32:41,  3.43it/s]
 85%|████████▍ | 315394/371472 [2:55:31<4:38:23,  3.36it/s]
 85%|████████▍ | 315395/371472 [2:55:31<4:26:00,  3.51it/s]
 85%|████████▍ | 315396/371472 [2:55:31<4:30:17,  3.46it/s]
 85%|████████▍ | 315397/371472 [2:55:32<4:27:38,  3.49it/s]
 85%|████████▍ | 315398/371472 [2:55:32<4:24:13,  3.54it/s]
 85%|████████▍ | 315399/371472 [2:55:32<5:09:01,  3.02it/s]
 85%|████████▍ | 315400/371472 [2:55:33<5:08:11,  3.03it/s]
                                                           
{'loss': 2.4476, 'learning_rate': 2.3592406645262766e-07, 'epoch': 13.58}

 85%|████████▍ | 315400/371472 [2:55:33<5:08:11,  3.03it/s]
 85%|████████▍ | 315401/371472 [2:55:33<5:05:43,  3.06it/s]
 85%|████████▍ | 315402/371472 [2:55:33<4:51:14,  3.21it/s]
 85%|████████▍ | 315403/371472 [2:55:33<4:38:29,  3.36it/s]
 85%|████████▍ | 315404/371472 [2:55:34<4:27:02,  3.50it/s]
 85%|████████▍ | 315405/371472 [2:55:34<4:20:26,  3.59it/s]
 85%|████████▍ | 315406/371472 [2:55:34<4:14:20,  3.67it/s]
 85%|████████▍ | 315407/371472 [2:55:35<4:14:29,  3.67it/s]
 85%|████████▍ | 315408/371472 [2:55:35<4:19:04,  3.61it/s]
 85%|████████▍ | 315409/371472 [2:55:35<4:19:30,  3.60it/s]
 85%|████████▍ | 315410/371472 [2:55:35<4:17:57,  3.62it/s]
 85%|████████▍ | 315411/371472 [2:55:36<4:16:19,  3.65it/s]
 85%|████████▍ | 315412/371472 [2:55:36<4:47:26,  3.25it/s]
 85%|████████▍ | 315413/371472 [2:55:36<4:37:44,  3.36it/s]
 85%|████████▍ | 315414/371472 [2:55:37<4:28:55,  3.47it/s]
 85%|████████▍ | 315415/371472 [2:55:37<4:35:42,  3.39it/s]
 85%|████████▍ | 315416/371472 [2:55:37<4:36:37,  3.38it/s]
 85%|████████▍ | 315417/371472 [2:55:37<4:17:25,  3.63it/s]
 85%|████████▍ | 315418/371472 [2:55:38<4:16:31,  3.64it/s]
 85%|████████▍ | 315419/371472 [2:55:38<4:08:08,  3.76it/s]
 85%|████████▍ | 315420/371472 [2:55:38<4:08:22,  3.76it/s]
                                                           
{'loss': 2.6411, 'learning_rate': 2.3587558447714881e-07, 'epoch': 13.59}

 85%|████████▍ | 315420/371472 [2:55:38<4:08:22,  3.76it/s]
 85%|████████▍ | 315421/371472 [2:55:38<4:05:40,  3.80it/s]
 85%|████████▍ | 315422/371472 [2:55:39<4:12:35,  3.70it/s]
 85%|████████▍ | 315423/371472 [2:55:39<4:17:54,  3.62it/s]
 85%|████████▍ | 315424/371472 [2:55:39<4:23:16,  3.55it/s]
 85%|████████▍ | 315425/371472 [2:55:40<4:16:32,  3.64it/s]
 85%|████████▍ | 315426/371472 [2:55:40<4:20:35,  3.58it/s]
 85%|████████▍ | 315427/371472 [2:55:40<4:22:20,  3.56it/s]
 85%|████████▍ | 315428/371472 [2:55:40<4:36:03,  3.38it/s]
 85%|████████▍ | 315429/371472 [2:55:41<4:23:42,  3.54it/s]
 85%|████████▍ | 315430/371472 [2:55:41<4:26:39,  3.50it/s]
 85%|████████▍ | 315431/371472 [2:55:41<4:20:10,  3.59it/s]
 85%|████████▍ | 315432/371472 [2:55:42<4:08:34,  3.76it/s]
 85%|████████▍ | 315433/371472 [2:55:42<4:16:31,  3.64it/s]
 85%|████████▍ | 315434/371472 [2:55:42<4:23:43,  3.54it/s]
 85%|████████▍ | 315435/371472 [2:55:42<4:26:32,  3.50it/s]
 85%|████████▍ | 315436/371472 [2:55:43<4:31:29,  3.44it/s]
 85%|████████▍ | 315437/371472 [2:55:43<4:17:52,  3.62it/s]
 85%|████████▍ | 315438/371472 [2:55:43<4:24:48,  3.53it/s]
 85%|████████▍ | 315439/371472 [2:55:44<4:23:55,  3.54it/s]
 85%|████████▍ | 315440/371472 [2:55:44<4:28:26,  3.48it/s]
                                                           
{'loss': 2.6268, 'learning_rate': 2.3582710250166989e-07, 'epoch': 13.59}

 85%|████████▍ | 315440/371472 [2:55:44<4:28:26,  3.48it/s]
 85%|████████▍ | 315441/371472 [2:55:44<4:32:50,  3.42it/s]
 85%|████████▍ | 315442/371472 [2:55:44<4:29:30,  3.46it/s]
 85%|████████▍ | 315443/371472 [2:55:45<4:16:05,  3.65it/s]
 85%|████████▍ | 315444/371472 [2:55:45<4:12:07,  3.70it/s]
 85%|████████▍ | 315445/371472 [2:55:45<4:09:43,  3.74it/s]
 85%|████████▍ | 315446/371472 [2:55:45<4:04:50,  3.81it/s]
 85%|████████▍ | 315447/371472 [2:55:46<4:13:37,  3.68it/s]
 85%|████████▍ | 315448/371472 [2:55:46<4:24:56,  3.52it/s]
 85%|████████▍ | 315449/371472 [2:55:46<4:38:04,  3.36it/s]
 85%|████████▍ | 315450/371472 [2:55:47<4:29:46,  3.46it/s]
 85%|████████▍ | 315451/371472 [2:55:47<4:26:36,  3.50it/s]
 85%|████████▍ | 315452/371472 [2:55:47<4:57:40,  3.14it/s]
 85%|████████▍ | 315453/371472 [2:55:48<4:45:56,  3.27it/s]
 85%|████████▍ | 315454/371472 [2:55:48<4:30:37,  3.45it/s]
 85%|████████▍ | 315455/371472 [2:55:48<4:39:03,  3.35it/s]
 85%|████████▍ | 315456/371472 [2:55:48<4:33:09,  3.42it/s]
 85%|████████▍ | 315457/371472 [2:55:49<4:36:51,  3.37it/s]
 85%|████████▍ | 315458/371472 [2:55:49<4:31:45,  3.44it/s]
 85%|████████▍ | 315459/371472 [2:55:49<4:21:14,  3.57it/s]
 85%|████████▍ | 315460/371472 [2:55:50<4:15:38,  3.65it/s]
                                                           
{'loss': 2.5505, 'learning_rate': 2.3577862052619104e-07, 'epoch': 13.59}

 85%|████████▍ | 315460/371472 [2:55:50<4:15:38,  3.65it/s]
 85%|████████▍ | 315461/371472 [2:55:50<4:19:01,  3.60it/s]
 85%|████████▍ | 315462/371472 [2:55:50<4:16:03,  3.65it/s]
 85%|████████▍ | 315463/371472 [2:55:50<4:11:10,  3.72it/s]
 85%|████████▍ | 315464/371472 [2:55:51<4:09:10,  3.75it/s]
 85%|████████▍ | 315465/371472 [2:55:51<4:17:59,  3.62it/s]
 85%|████████▍ | 315466/371472 [2:55:51<4:28:22,  3.48it/s]
 85%|████████▍ | 315467/371472 [2:55:52<4:25:09,  3.52it/s]
 85%|████████▍ | 315468/371472 [2:55:52<4:17:52,  3.62it/s]
 85%|████████▍ | 315469/371472 [2:55:52<4:14:47,  3.66it/s]
 85%|████████▍ | 315470/371472 [2:55:52<4:10:58,  3.72it/s]
 85%|████████▍ | 315471/371472 [2:55:53<4:16:27,  3.64it/s]
 85%|████████▍ | 315472/371472 [2:55:53<4:22:55,  3.55it/s]
 85%|████████▍ | 315473/371472 [2:55:53<4:22:59,  3.55it/s]
 85%|████████▍ | 315474/371472 [2:55:54<4:39:32,  3.34it/s]
 85%|████████▍ | 315475/371472 [2:55:54<4:53:14,  3.18it/s]
 85%|████████▍ | 315476/371472 [2:55:54<4:38:19,  3.35it/s]
 85%|████████▍ | 315477/371472 [2:55:54<4:31:30,  3.44it/s]
 85%|████████▍ | 315478/371472 [2:55:55<4:20:47,  3.58it/s]
 85%|████████▍ | 315479/371472 [2:55:55<4:28:43,  3.47it/s]
 85%|████████▍ | 315480/371472 [2:55:55<5:16:01,  2.95it/s]
                                                           
{'loss': 2.5561, 'learning_rate': 2.357301385507121e-07, 'epoch': 13.59}

 85%|████████▍ | 315480/371472 [2:55:55<5:16:01,  2.95it/s]
 85%|████████▍ | 315481/371472 [2:55:56<5:27:38,  2.85it/s]
 85%|████████▍ | 315482/371472 [2:55:56<5:20:09,  2.91it/s]
 85%|████████▍ | 315483/371472 [2:55:56<5:00:53,  3.10it/s]
 85%|████████▍ | 315484/371472 [2:55:57<5:17:45,  2.94it/s]
 85%|████████▍ | 315485/371472 [2:55:57<5:04:54,  3.06it/s]
 85%|████████▍ | 315486/371472 [2:55:57<4:59:07,  3.12it/s]
 85%|████████▍ | 315487/371472 [2:55:58<5:03:01,  3.08it/s]
 85%|████████▍ | 315488/371472 [2:55:58<4:45:21,  3.27it/s]
 85%|████████▍ | 315489/371472 [2:55:58<4:35:00,  3.39it/s]
 85%|████████▍ | 315490/371472 [2:55:59<4:46:57,  3.25it/s]
 85%|████████▍ | 315491/371472 [2:55:59<4:32:19,  3.43it/s]
 85%|████████▍ | 315492/371472 [2:55:59<4:22:37,  3.55it/s]
 85%|████████▍ | 315493/371472 [2:55:59<4:10:48,  3.72it/s]
 85%|████████▍ | 315494/371472 [2:56:00<4:23:45,  3.54it/s]
 85%|████████▍ | 315495/371472 [2:56:00<4:16:10,  3.64it/s]
 85%|████████▍ | 315496/371472 [2:56:00<4:19:46,  3.59it/s]
 85%|████████▍ | 315497/371472 [2:56:01<5:05:26,  3.05it/s]
 85%|████████▍ | 315498/371472 [2:56:01<4:46:42,  3.25it/s]
 85%|████████▍ | 315499/371472 [2:56:01<4:42:28,  3.30it/s]
 85%|████████▍ | 315500/371472 [2:56:01<4:27:36,  3.49it/s]
                                                           
{'loss': 2.5035, 'learning_rate': 2.3568165657523326e-07, 'epoch': 13.59}

 85%|████████▍ | 315500/371472 [2:56:01<4:27:36,  3.49it/s]
 85%|████████▍ | 315501/371472 [2:56:02<4:16:55,  3.63it/s]
 85%|████████▍ | 315502/371472 [2:56:02<4:18:07,  3.61it/s]
 85%|████████▍ | 315503/371472 [2:56:02<4:32:10,  3.43it/s]
 85%|████████▍ | 315504/371472 [2:56:03<5:24:01,  2.88it/s]
 85%|████████▍ | 315505/371472 [2:56:03<4:56:31,  3.15it/s]
 85%|████████▍ | 315506/371472 [2:56:03<4:33:55,  3.41it/s]
 85%|████████▍ | 315507/371472 [2:56:04<4:47:44,  3.24it/s]
 85%|████████▍ | 315508/371472 [2:56:04<4:33:44,  3.41it/s]
 85%|████████▍ | 315509/371472 [2:56:04<4:33:29,  3.41it/s]
 85%|████████▍ | 315510/371472 [2:56:04<4:29:14,  3.46it/s]
 85%|████████▍ | 315511/371472 [2:56:05<4:39:36,  3.34it/s]
 85%|████████▍ | 315512/371472 [2:56:05<4:34:16,  3.40it/s]
 85%|████████▍ | 315513/371472 [2:56:05<4:23:26,  3.54it/s]
 85%|████████▍ | 315514/371472 [2:56:06<4:15:58,  3.64it/s]
 85%|████████▍ | 315515/371472 [2:56:06<4:16:43,  3.63it/s]
 85%|████████▍ | 315516/371472 [2:56:06<4:16:38,  3.63it/s]
 85%|████████▍ | 315517/371472 [2:56:06<4:30:43,  3.44it/s]
 85%|████████▍ | 315518/371472 [2:56:07<4:23:26,  3.54it/s]
 85%|████████▍ | 315519/371472 [2:56:07<4:16:13,  3.64it/s]
 85%|████████▍ | 315520/371472 [2:56:07<4:15:15,  3.65it/s]
                                                           
{'loss': 2.6064, 'learning_rate': 2.356331745997543e-07, 'epoch': 13.59}

 85%|████████▍ | 315520/371472 [2:56:07<4:15:15,  3.65it/s]
 85%|████████▍ | 315521/371472 [2:56:07<4:12:46,  3.69it/s]
 85%|████████▍ | 315522/371472 [2:56:08<4:06:39,  3.78it/s]
 85%|████████▍ | 315523/371472 [2:56:08<4:03:26,  3.83it/s]
 85%|████████▍ | 315524/371472 [2:56:08<3:57:10,  3.93it/s]
 85%|████████▍ | 315525/371472 [2:56:08<4:00:01,  3.88it/s]
 85%|████████▍ | 315526/371472 [2:56:09<4:09:07,  3.74it/s]
 85%|████████▍ | 315527/371472 [2:56:09<4:20:36,  3.58it/s]
 85%|████████▍ | 315528/371472 [2:56:09<4:22:16,  3.55it/s]
 85%|████████▍ | 315529/371472 [2:56:10<4:28:32,  3.47it/s]
 85%|████████▍ | 315530/371472 [2:56:10<4:22:45,  3.55it/s]
 85%|████████▍ | 315531/371472 [2:56:10<4:19:48,  3.59it/s]
 85%|████████▍ | 315532/371472 [2:56:10<4:17:53,  3.62it/s]
 85%|████████▍ | 315533/371472 [2:56:11<4:12:24,  3.69it/s]
 85%|████████▍ | 315534/371472 [2:56:11<4:37:14,  3.36it/s]
 85%|████████▍ | 315535/371472 [2:56:11<4:27:22,  3.49it/s]
 85%|████████▍ | 315536/371472 [2:56:12<4:23:13,  3.54it/s]
 85%|████████▍ | 315537/371472 [2:56:12<4:21:00,  3.57it/s]
 85%|████████▍ | 315538/371472 [2:56:12<4:53:37,  3.17it/s]
 85%|████████▍ | 315539/371472 [2:56:13<4:42:09,  3.30it/s]
 85%|████████▍ | 315540/371472 [2:56:13<4:50:02,  3.21it/s]
                                                           
{'loss': 2.5732, 'learning_rate': 2.355846926242755e-07, 'epoch': 13.59}

 85%|████████▍ | 315540/371472 [2:56:13<4:50:02,  3.21it/s]
 85%|████████▍ | 315541/371472 [2:56:13<4:40:01,  3.33it/s]
 85%|████████▍ | 315542/371472 [2:56:13<4:30:20,  3.45it/s]
 85%|████████▍ | 315543/371472 [2:56:14<4:34:14,  3.40it/s]
 85%|████████▍ | 315544/371472 [2:56:14<4:26:39,  3.50it/s]
 85%|████████▍ | 315545/371472 [2:56:14<4:28:48,  3.47it/s]
 85%|████████▍ | 315546/371472 [2:56:15<4:21:28,  3.56it/s]
 85%|████████▍ | 315547/371472 [2:56:15<4:19:29,  3.59it/s]
 85%|████████▍ | 315548/371472 [2:56:15<4:43:16,  3.29it/s]
 85%|████████▍ | 315549/371472 [2:56:16<4:51:21,  3.20it/s]
 85%|████████▍ | 315550/371472 [2:56:16<4:35:24,  3.38it/s]
 85%|████████▍ | 315551/371472 [2:56:16<4:24:33,  3.52it/s]
 85%|████████▍ | 315552/371472 [2:56:16<4:21:38,  3.56it/s]
 85%|████████▍ | 315553/371472 [2:56:17<4:30:11,  3.45it/s]
 85%|████████▍ | 315554/371472 [2:56:17<4:18:35,  3.60it/s]
 85%|████████▍ | 315555/371472 [2:56:17<4:14:04,  3.67it/s]
 85%|████████▍ | 315556/371472 [2:56:17<4:04:26,  3.81it/s]
 85%|████████▍ | 315557/371472 [2:56:18<4:25:38,  3.51it/s]
 85%|████████▍ | 315558/371472 [2:56:18<4:16:57,  3.63it/s]
 85%|████████▍ | 315559/371472 [2:56:18<4:12:27,  3.69it/s]
 85%|████████▍ | 315560/371472 [2:56:19<4:22:29,  3.55it/s]
                                                           
{'loss': 2.5613, 'learning_rate': 2.3553621064879653e-07, 'epoch': 13.59}

 85%|████████▍ | 315560/371472 [2:56:19<4:22:29,  3.55it/s]
 85%|████████▍ | 315561/371472 [2:56:19<4:16:21,  3.63it/s]
 85%|████████▍ | 315562/371472 [2:56:19<4:14:52,  3.66it/s]
 85%|████████▍ | 315563/371472 [2:56:19<4:20:39,  3.57it/s]
 85%|████████▍ | 315564/371472 [2:56:20<4:11:45,  3.70it/s]
 85%|████████▍ | 315565/371472 [2:56:20<4:05:12,  3.80it/s]
 85%|████████▍ | 315566/371472 [2:56:20<4:07:24,  3.77it/s]
 85%|████████▍ | 315567/371472 [2:56:20<4:03:01,  3.83it/s]
 85%|████████▍ | 315568/371472 [2:56:21<3:55:45,  3.95it/s]
 85%|████████▍ | 315569/371472 [2:56:21<4:11:25,  3.71it/s]
 85%|████████▍ | 315570/371472 [2:56:21<4:21:07,  3.57it/s]
 85%|████████▍ | 315571/371472 [2:56:21<4:16:06,  3.64it/s]
 85%|████████▍ | 315572/371472 [2:56:22<4:17:06,  3.62it/s]
 85%|████████▍ | 315573/371472 [2:56:22<4:16:47,  3.63it/s]
 85%|████████▍ | 315574/371472 [2:56:22<4:17:41,  3.62it/s]
 85%|████████▍ | 315575/371472 [2:56:23<4:07:58,  3.76it/s]
 85%|████████▍ | 315576/371472 [2:56:23<4:14:53,  3.65it/s]
 85%|████████▍ | 315577/371472 [2:56:23<4:13:44,  3.67it/s]
 85%|████████▍ | 315578/371472 [2:56:23<4:23:35,  3.53it/s]
 85%|████████▍ | 315579/371472 [2:56:24<4:34:09,  3.40it/s]
 85%|████████▍ | 315580/371472 [2:56:24<4:27:19,  3.48it/s]
                                                           
{'loss': 2.5786, 'learning_rate': 2.3548772867331768e-07, 'epoch': 13.59}

 85%|████████▍ | 315580/371472 [2:56:24<4:27:19,  3.48it/s]
 85%|████████▍ | 315581/371472 [2:56:24<4:17:00,  3.62it/s]
 85%|████████▍ | 315582/371472 [2:56:25<4:20:39,  3.57it/s]
 85%|████████▍ | 315583/371472 [2:56:25<4:15:57,  3.64it/s]
 85%|████████▍ | 315584/371472 [2:56:25<4:20:01,  3.58it/s]
 85%|████████▍ | 315585/371472 [2:56:25<4:14:25,  3.66it/s]
 85%|████████▍ | 315586/371472 [2:56:26<4:14:44,  3.66it/s]
 85%|████████▍ | 315587/371472 [2:56:26<4:39:37,  3.33it/s]
 85%|████████▍ | 315588/371472 [2:56:26<4:34:41,  3.39it/s]
 85%|████████▍ | 315589/371472 [2:56:27<4:31:50,  3.43it/s]
 85%|████████▍ | 315590/371472 [2:56:27<4:33:45,  3.40it/s]
 85%|████████▍ | 315591/371472 [2:56:27<4:27:02,  3.49it/s]
 85%|████████▍ | 315592/371472 [2:56:27<4:18:27,  3.60it/s]
 85%|████████▍ | 315593/371472 [2:56:28<4:14:26,  3.66it/s]
 85%|████████▍ | 315594/371472 [2:56:28<4:21:42,  3.56it/s]
 85%|████████▍ | 315595/371472 [2:56:28<4:13:05,  3.68it/s]
 85%|████████▍ | 315596/371472 [2:56:29<4:53:01,  3.18it/s]
 85%|████████▍ | 315597/371472 [2:56:29<4:55:12,  3.15it/s]
 85%|████████▍ | 315598/371472 [2:56:29<4:49:09,  3.22it/s]
 85%|████████▍ | 315599/371472 [2:56:29<4:33:39,  3.40it/s]
 85%|████████▍ | 315600/371472 [2:56:30<4:49:05,  3.22it/s]
                                                           
{'loss': 2.4646, 'learning_rate': 2.3543924669783875e-07, 'epoch': 13.59}

 85%|████████▍ | 315600/371472 [2:56:30<4:49:05,  3.22it/s]
 85%|████████▍ | 315601/371472 [2:56:30<4:45:45,  3.26it/s]
 85%|████████▍ | 315602/371472 [2:56:30<4:41:53,  3.30it/s]
 85%|████████▍ | 315603/371472 [2:56:31<4:31:40,  3.43it/s]
 85%|████████▍ | 315604/371472 [2:56:31<4:19:53,  3.58it/s]
 85%|████████▍ | 315605/371472 [2:56:31<4:13:58,  3.67it/s]
 85%|████████▍ | 315606/371472 [2:56:31<4:17:54,  3.61it/s]
 85%|████████▍ | 315607/371472 [2:56:32<4:14:41,  3.66it/s]
 85%|████████▍ | 315608/371472 [2:56:32<4:28:10,  3.47it/s]
 85%|████████▍ | 315609/371472 [2:56:32<4:30:32,  3.44it/s]
 85%|████████▍ | 315610/371472 [2:56:33<4:24:39,  3.52it/s]
 85%|████████▍ | 315611/371472 [2:56:33<4:23:16,  3.54it/s]
 85%|████████▍ | 315612/371472 [2:56:33<4:22:24,  3.55it/s]
 85%|████████▍ | 315613/371472 [2:56:33<4:18:07,  3.61it/s]
 85%|████████▍ | 315614/371472 [2:56:34<4:17:19,  3.62it/s]
 85%|████████▍ | 315615/371472 [2:56:34<4:24:02,  3.53it/s]
 85%|████████▍ | 315616/371472 [2:56:34<4:13:42,  3.67it/s]
 85%|████████▍ | 315617/371472 [2:56:35<4:10:30,  3.72it/s]
 85%|████████▍ | 315618/371472 [2:56:35<4:00:00,  3.88it/s]
 85%|████████▍ | 315619/371472 [2:56:35<4:18:29,  3.60it/s]
 85%|████████▍ | 315620/371472 [2:56:35<4:17:31,  3.61it/s]
                                                           
{'loss': 2.8069, 'learning_rate': 2.353907647223599e-07, 'epoch': 13.59}

 85%|████████▍ | 315620/371472 [2:56:35<4:17:31,  3.61it/s]
 85%|████████▍ | 315621/371472 [2:56:36<4:17:15,  3.62it/s]
 85%|████████▍ | 315622/371472 [2:56:36<4:49:26,  3.22it/s]
 85%|████████▍ | 315623/371472 [2:56:36<4:45:10,  3.26it/s]
 85%|████████▍ | 315624/371472 [2:56:37<4:39:18,  3.33it/s]
 85%|████████▍ | 315625/371472 [2:56:37<4:49:42,  3.21it/s]
 85%|████████▍ | 315626/371472 [2:56:37<4:49:39,  3.21it/s]
 85%|████████▍ | 315627/371472 [2:56:38<4:27:26,  3.48it/s]
 85%|████████▍ | 315628/371472 [2:56:38<4:17:40,  3.61it/s]
 85%|████████▍ | 315629/371472 [2:56:38<4:32:45,  3.41it/s]
 85%|████████▍ | 315630/371472 [2:56:38<4:46:49,  3.24it/s]
 85%|████████▍ | 315631/371472 [2:56:39<4:28:59,  3.46it/s]
 85%|████████▍ | 315632/371472 [2:56:39<4:18:25,  3.60it/s]
 85%|████████▍ | 315633/371472 [2:56:39<4:12:19,  3.69it/s]
 85%|████████▍ | 315634/371472 [2:56:40<4:29:42,  3.45it/s]
 85%|████████▍ | 315635/371472 [2:56:40<4:27:29,  3.48it/s]
 85%|████████▍ | 315636/371472 [2:56:40<4:31:08,  3.43it/s]
 85%|████████▍ | 315637/371472 [2:56:40<4:20:39,  3.57it/s]
 85%|████████▍ | 315638/371472 [2:56:41<4:12:49,  3.68it/s]
 85%|████████▍ | 315639/371472 [2:56:41<4:04:51,  3.80it/s]
 85%|████████▍ | 315640/371472 [2:56:41<4:15:33,  3.64it/s]
                                                           
{'loss': 2.6569, 'learning_rate': 2.3534228274688097e-07, 'epoch': 13.6}

 85%|████████▍ | 315640/371472 [2:56:41<4:15:33,  3.64it/s]
 85%|████████▍ | 315641/371472 [2:56:41<4:05:31,  3.79it/s]
 85%|████████▍ | 315642/371472 [2:56:42<4:09:54,  3.72it/s]
 85%|████████▍ | 315643/371472 [2:56:42<4:13:33,  3.67it/s]
 85%|████████▍ | 315644/371472 [2:56:42<4:28:41,  3.46it/s]
 85%|████████▍ | 315645/371472 [2:56:43<4:42:29,  3.29it/s]
 85%|████████▍ | 315646/371472 [2:56:43<4:43:50,  3.28it/s]
 85%|████████▍ | 315647/371472 [2:56:43<4:32:21,  3.42it/s]
 85%|████████▍ | 315648/371472 [2:56:43<4:28:14,  3.47it/s]
 85%|████████▍ | 315649/371472 [2:56:44<4:25:04,  3.51it/s]
 85%|████████▍ | 315650/371472 [2:56:44<4:36:36,  3.36it/s]
 85%|████████▍ | 315651/371472 [2:56:44<4:48:42,  3.22it/s]
 85%|████████▍ | 315652/371472 [2:56:45<4:37:16,  3.36it/s]
 85%|████████▍ | 315653/371472 [2:56:45<4:25:52,  3.50it/s]
 85%|████████▍ | 315654/371472 [2:56:45<4:17:22,  3.61it/s]
 85%|████████▍ | 315655/371472 [2:56:46<4:41:01,  3.31it/s]
 85%|████████▍ | 315656/371472 [2:56:46<4:24:26,  3.52it/s]
 85%|████████▍ | 315657/371472 [2:56:46<4:32:20,  3.42it/s]
 85%|████████▍ | 315658/371472 [2:56:46<4:31:35,  3.43it/s]
 85%|████████▍ | 315659/371472 [2:56:47<4:23:26,  3.53it/s]
 85%|████████▍ | 315660/371472 [2:56:47<4:15:26,  3.64it/s]
                                                           
{'loss': 2.417, 'learning_rate': 2.3529380077140212e-07, 'epoch': 13.6}

 85%|████████▍ | 315660/371472 [2:56:47<4:15:26,  3.64it/s]
 85%|████████▍ | 315661/371472 [2:56:47<4:08:47,  3.74it/s]
 85%|████████▍ | 315662/371472 [2:56:47<4:10:06,  3.72it/s]
 85%|████████▍ | 315663/371472 [2:56:48<4:29:30,  3.45it/s]
 85%|████████▍ | 315664/371472 [2:56:48<4:28:13,  3.47it/s]
 85%|████████▍ | 315665/371472 [2:56:48<4:12:22,  3.69it/s]
 85%|████████▍ | 315666/371472 [2:56:49<4:03:51,  3.81it/s]
 85%|████████▍ | 315667/371472 [2:56:49<4:30:02,  3.44it/s]
 85%|████████▍ | 315668/371472 [2:56:49<4:37:20,  3.35it/s]
 85%|████████▍ | 315669/371472 [2:56:50<4:32:25,  3.41it/s]
 85%|████████▍ | 315670/371472 [2:56:50<4:56:12,  3.14it/s]
 85%|████████▍ | 315671/371472 [2:56:50<4:39:33,  3.33it/s]
 85%|████████▍ | 315672/371472 [2:56:50<4:46:09,  3.25it/s]
 85%|████████▍ | 315673/371472 [2:56:51<4:55:38,  3.15it/s]
 85%|████████▍ | 315674/371472 [2:56:51<4:37:44,  3.35it/s]
 85%|████████▍ | 315675/371472 [2:56:51<4:24:24,  3.52it/s]
 85%|████████▍ | 315676/371472 [2:56:52<4:24:36,  3.51it/s]
 85%|████████▍ | 315677/371472 [2:56:52<4:12:37,  3.68it/s]
 85%|████████▍ | 315678/371472 [2:56:52<4:07:14,  3.76it/s]
 85%|████████▍ | 315679/371472 [2:56:52<4:01:52,  3.84it/s]
 85%|████████▍ | 315680/371472 [2:56:53<4:32:09,  3.42it/s]
                                                           
{'loss': 2.6935, 'learning_rate': 2.3524531879592317e-07, 'epoch': 13.6}

 85%|████████▍ | 315680/371472 [2:56:53<4:32:09,  3.42it/s]
 85%|████████▍ | 315681/371472 [2:56:53<4:29:19,  3.45it/s]
 85%|████████▍ | 315682/371472 [2:56:53<4:17:41,  3.61it/s]
 85%|████████▍ | 315683/371472 [2:56:53<4:07:28,  3.76it/s]
 85%|████████▍ | 315684/371472 [2:56:54<4:19:56,  3.58it/s]
 85%|████████▍ | 315685/371472 [2:56:54<4:15:05,  3.64it/s]
 85%|████████▍ | 315686/371472 [2:56:54<4:15:41,  3.64it/s]
 85%|████████▍ | 315687/371472 [2:56:55<4:32:32,  3.41it/s]
 85%|████████▍ | 315688/371472 [2:56:55<4:32:33,  3.41it/s]
 85%|████████▍ | 315689/371472 [2:56:55<5:25:51,  2.85it/s]
 85%|████████▍ | 315690/371472 [2:56:56<5:25:13,  2.86it/s]
 85%|████████▍ | 315691/371472 [2:56:56<4:59:43,  3.10it/s]
 85%|████████▍ | 315692/371472 [2:56:56<4:56:13,  3.14it/s]
 85%|████████▍ | 315693/371472 [2:56:57<4:38:12,  3.34it/s]
 85%|████████▍ | 315694/371472 [2:56:57<4:27:48,  3.47it/s]
 85%|████████▍ | 315695/371472 [2:56:57<4:32:57,  3.41it/s]
 85%|████████▍ | 315696/371472 [2:56:57<4:25:20,  3.50it/s]
 85%|████████▍ | 315697/371472 [2:56:58<4:28:23,  3.46it/s]
 85%|████████▍ | 315698/371472 [2:56:58<4:35:07,  3.38it/s]
 85%|████████▍ | 315699/371472 [2:56:58<4:25:47,  3.50it/s]
 85%|████████▍ | 315700/371472 [2:56:59<4:29:48,  3.45it/s]
                                                           
{'loss': 2.5445, 'learning_rate': 2.3519683682044434e-07, 'epoch': 13.6}

 85%|████████▍ | 315700/371472 [2:56:59<4:29:48,  3.45it/s]
 85%|████████▍ | 315701/371472 [2:56:59<4:17:41,  3.61it/s]
 85%|████████▍ | 315702/371472 [2:56:59<4:27:45,  3.47it/s]
 85%|████████▍ | 315703/371472 [2:56:59<4:37:31,  3.35it/s]
 85%|████████▍ | 315704/371472 [2:57:00<4:40:01,  3.32it/s]
 85%|████████▍ | 315705/371472 [2:57:00<4:30:15,  3.44it/s]
 85%|████████▍ | 315706/371472 [2:57:00<4:34:41,  3.38it/s]
 85%|████████▍ | 315707/371472 [2:57:01<4:35:16,  3.38it/s]
 85%|████████▍ | 315708/371472 [2:57:01<4:27:49,  3.47it/s]
 85%|████████▍ | 315709/371472 [2:57:01<4:21:58,  3.55it/s]
 85%|████████▍ | 315710/371472 [2:57:01<4:18:02,  3.60it/s]
 85%|████████▍ | 315711/371472 [2:57:02<4:50:17,  3.20it/s]
 85%|████████▍ | 315712/371472 [2:57:02<4:37:23,  3.35it/s]
 85%|████████▍ | 315713/371472 [2:57:02<4:45:12,  3.26it/s]
 85%|████████▍ | 315714/371472 [2:57:03<4:44:55,  3.26it/s]
 85%|████████▍ | 315715/371472 [2:57:03<4:51:47,  3.18it/s]
 85%|████████▍ | 315716/371472 [2:57:03<4:39:14,  3.33it/s]
 85%|████████▍ | 315717/371472 [2:57:04<4:19:11,  3.59it/s]
 85%|████████▍ | 315718/371472 [2:57:04<4:20:21,  3.57it/s]
 85%|████████▍ | 315719/371472 [2:57:04<4:21:00,  3.56it/s]
 85%|████████▍ | 315720/371472 [2:57:04<4:17:30,  3.61it/s]
                                                           
{'loss': 2.7263, 'learning_rate': 2.351483548449654e-07, 'epoch': 13.6}

 85%|████████▍ | 315720/371472 [2:57:04<4:17:30,  3.61it/s]
 85%|████████▍ | 315721/371472 [2:57:05<4:20:05,  3.57it/s]
 85%|████████▍ | 315722/371472 [2:57:05<4:42:34,  3.29it/s]
 85%|████████▍ | 315723/371472 [2:57:05<4:53:38,  3.16it/s]
 85%|████████▍ | 315724/371472 [2:57:06<4:55:40,  3.14it/s]
 85%|████████▍ | 315725/371472 [2:57:06<4:51:11,  3.19it/s]
 85%|████████▍ | 315726/371472 [2:57:06<4:47:50,  3.23it/s]
 85%|████████▍ | 315727/371472 [2:57:07<4:54:22,  3.16it/s]
 85%|████████▍ | 315728/371472 [2:57:07<4:40:30,  3.31it/s]
 85%|████████▍ | 315729/371472 [2:57:07<4:35:54,  3.37it/s]
 85%|████████▍ | 315730/371472 [2:57:08<5:02:43,  3.07it/s]
 85%|████████▍ | 315731/371472 [2:57:08<5:06:57,  3.03it/s]
 85%|████████▍ | 315732/371472 [2:57:08<4:50:34,  3.20it/s]
 85%|████████▍ | 315733/371472 [2:57:09<4:56:53,  3.13it/s]
 85%|████████▍ | 315734/371472 [2:57:09<4:44:42,  3.26it/s]
 85%|████████▍ | 315735/371472 [2:57:09<4:22:54,  3.53it/s]
 85%|████████▍ | 315736/371472 [2:57:09<4:22:49,  3.53it/s]
 85%|████████▍ | 315737/371472 [2:57:10<4:09:06,  3.73it/s]
 85%|████████▍ | 315738/371472 [2:57:10<4:14:14,  3.65it/s]
 85%|████████▍ | 315739/371472 [2:57:10<4:13:44,  3.66it/s]
 85%|████████▍ | 315740/371472 [2:57:10<4:13:04,  3.67it/s]
                                                           
{'loss': 2.5559, 'learning_rate': 2.3509987286948654e-07, 'epoch': 13.6}

 85%|████████▍ | 315740/371472 [2:57:10<4:13:04,  3.67it/s]
 85%|████████▍ | 315741/371472 [2:57:11<4:05:57,  3.78it/s]
 85%|████████▍ | 315742/371472 [2:57:11<4:14:05,  3.66it/s]
 85%|████████▍ | 315743/371472 [2:57:11<4:07:06,  3.76it/s]
 85%|████████▍ | 315744/371472 [2:57:11<4:08:44,  3.73it/s]
 85%|████████▍ | 315745/371472 [2:57:12<4:09:30,  3.72it/s]
 85%|████████▍ | 315746/371472 [2:57:12<4:15:27,  3.64it/s]
 85%|████████▍ | 315747/371472 [2:57:12<4:10:21,  3.71it/s]
 85%|████████▍ | 315748/371472 [2:57:13<4:20:30,  3.57it/s]
 85%|████████▍ | 315749/371472 [2:57:13<4:47:19,  3.23it/s]
 85%|████████▍ | 315750/371472 [2:57:13<4:48:14,  3.22it/s]
 85%|████████▍ | 315751/371472 [2:57:14<4:30:03,  3.44it/s]
 85%|████████▌ | 315752/371472 [2:57:14<4:25:44,  3.49it/s]
 85%|████████▌ | 315753/371472 [2:57:14<4:34:46,  3.38it/s]
 85%|████████▌ | 315754/371472 [2:57:14<4:24:57,  3.50it/s]
 85%|████████▌ | 315755/371472 [2:57:15<4:27:09,  3.48it/s]
 85%|████████▌ | 315756/371472 [2:57:15<4:21:30,  3.55it/s]
 85%|████████▌ | 315757/371472 [2:57:15<4:11:41,  3.69it/s]
 85%|████████▌ | 315758/371472 [2:57:15<4:10:55,  3.70it/s]
 85%|████████▌ | 315759/371472 [2:57:16<4:08:02,  3.74it/s]
 85%|████████▌ | 315760/371472 [2:57:16<4:01:53,  3.84it/s]
                                                           
{'loss': 2.5486, 'learning_rate': 2.350513908940076e-07, 'epoch': 13.6}

 85%|████████▌ | 315760/371472 [2:57:16<4:01:53,  3.84it/s]
 85%|████████▌ | 315761/371472 [2:57:16<4:10:34,  3.71it/s]
 85%|████████▌ | 315762/371472 [2:57:17<4:23:10,  3.53it/s]
 85%|████████▌ | 315763/371472 [2:57:17<4:29:51,  3.44it/s]
 85%|████████▌ | 315764/371472 [2:57:17<4:33:11,  3.40it/s]
 85%|████████▌ | 315765/371472 [2:57:17<4:17:53,  3.60it/s]
 85%|████████▌ | 315766/371472 [2:57:18<4:12:35,  3.68it/s]
 85%|████████▌ | 315767/371472 [2:57:18<4:10:06,  3.71it/s]
 85%|████████▌ | 315768/371472 [2:57:18<4:06:11,  3.77it/s]
 85%|████████▌ | 315769/371472 [2:57:18<4:04:18,  3.80it/s]
 85%|████████▌ | 315770/371472 [2:57:19<4:15:15,  3.64it/s]
 85%|████████▌ | 315771/371472 [2:57:19<4:10:06,  3.71it/s]
 85%|████████▌ | 315772/371472 [2:57:19<4:12:38,  3.67it/s]
 85%|████████▌ | 315773/371472 [2:57:20<4:11:30,  3.69it/s]
 85%|████████▌ | 315774/371472 [2:57:20<4:07:05,  3.76it/s]
 85%|████████▌ | 315775/371472 [2:57:20<4:31:40,  3.42it/s]
 85%|████████▌ | 315776/371472 [2:57:20<4:26:07,  3.49it/s]
 85%|████████▌ | 315777/371472 [2:57:21<4:19:53,  3.57it/s]
 85%|████████▌ | 315778/371472 [2:57:21<4:45:12,  3.25it/s]
 85%|████████▌ | 315779/371472 [2:57:21<4:34:29,  3.38it/s]
 85%|████████▌ | 315780/371472 [2:57:22<4:31:48,  3.41it/s]
                                                           
{'loss': 2.5204, 'learning_rate': 2.3500290891852876e-07, 'epoch': 13.6}

 85%|████████▌ | 315780/371472 [2:57:22<4:31:48,  3.41it/s]
 85%|████████▌ | 315781/371472 [2:57:22<4:21:33,  3.55it/s]
 85%|████████▌ | 315782/371472 [2:57:22<4:38:55,  3.33it/s]
 85%|████████▌ | 315783/371472 [2:57:23<4:38:21,  3.33it/s]
 85%|████████▌ | 315784/371472 [2:57:23<4:26:46,  3.48it/s]
 85%|████████▌ | 315785/371472 [2:57:23<4:31:48,  3.41it/s]
 85%|████████▌ | 315786/371472 [2:57:23<4:27:17,  3.47it/s]
 85%|████████▌ | 315787/371472 [2:57:24<4:19:52,  3.57it/s]
 85%|████████▌ | 315788/371472 [2:57:24<4:23:50,  3.52it/s]
 85%|████████▌ | 315789/371472 [2:57:24<4:32:00,  3.41it/s]
 85%|████████▌ | 315790/371472 [2:57:25<4:22:35,  3.53it/s]
 85%|████████▌ | 315791/371472 [2:57:25<4:15:40,  3.63it/s]
 85%|████████▌ | 315792/371472 [2:57:25<4:18:06,  3.60it/s]
 85%|████████▌ | 315793/371472 [2:57:25<4:11:55,  3.68it/s]
 85%|████████▌ | 315794/371472 [2:57:26<4:25:31,  3.49it/s]
 85%|████████▌ | 315795/371472 [2:57:26<4:21:38,  3.55it/s]
 85%|████████▌ | 315796/371472 [2:57:26<4:18:52,  3.58it/s]
 85%|████████▌ | 315797/371472 [2:57:27<4:35:40,  3.37it/s]
 85%|████████▌ | 315798/371472 [2:57:27<4:30:40,  3.43it/s]
 85%|████████▌ | 315799/371472 [2:57:27<4:31:27,  3.42it/s]
 85%|████████▌ | 315800/371472 [2:57:27<4:27:33,  3.47it/s]
                                                           
{'loss': 2.7117, 'learning_rate': 2.3495442694304983e-07, 'epoch': 13.6}

 85%|████████▌ | 315800/371472 [2:57:27<4:27:33,  3.47it/s]
 85%|████████▌ | 315801/371472 [2:57:28<4:38:24,  3.33it/s]
 85%|████████▌ | 315802/371472 [2:57:28<4:28:04,  3.46it/s]
 85%|████████▌ | 315803/371472 [2:57:28<4:24:02,  3.51it/s]
 85%|████████▌ | 315804/371472 [2:57:29<4:56:14,  3.13it/s]
 85%|████████▌ | 315805/371472 [2:57:29<4:33:47,  3.39it/s]
 85%|████████▌ | 315806/371472 [2:57:29<4:18:13,  3.59it/s]
 85%|████████▌ | 315807/371472 [2:57:29<4:33:13,  3.40it/s]
 85%|████████▌ | 315808/371472 [2:57:30<4:33:42,  3.39it/s]
 85%|████████▌ | 315809/371472 [2:57:30<4:16:50,  3.61it/s]
 85%|████████▌ | 315810/371472 [2:57:30<5:05:02,  3.04it/s]
 85%|████████▌ | 315811/371472 [2:57:31<5:19:07,  2.91it/s]
 85%|████████▌ | 315812/371472 [2:57:31<4:58:54,  3.10it/s]
 85%|████████▌ | 315813/371472 [2:57:31<4:37:12,  3.35it/s]
 85%|████████▌ | 315814/371472 [2:57:32<4:26:21,  3.48it/s]
 85%|████████▌ | 315815/371472 [2:57:32<4:13:30,  3.66it/s]
 85%|████████▌ | 315816/371472 [2:57:32<4:11:52,  3.68it/s]
 85%|████████▌ | 315817/371472 [2:57:32<4:35:25,  3.37it/s]
 85%|████████▌ | 315818/371472 [2:57:33<4:31:48,  3.41it/s]
 85%|████████▌ | 315819/371472 [2:57:33<4:26:30,  3.48it/s]
 85%|████████▌ | 315820/371472 [2:57:33<4:26:04,  3.49it/s]
                                                           
{'loss': 2.6245, 'learning_rate': 2.3490594496757098e-07, 'epoch': 13.6}

 85%|████████▌ | 315820/371472 [2:57:33<4:26:04,  3.49it/s]
 85%|████████▌ | 315821/371472 [2:57:34<4:18:51,  3.58it/s]
 85%|████████▌ | 315822/371472 [2:57:34<4:18:15,  3.59it/s]
 85%|████████▌ | 315823/371472 [2:57:34<4:32:29,  3.40it/s]
 85%|████████▌ | 315824/371472 [2:57:34<4:25:37,  3.49it/s]
 85%|████████▌ | 315825/371472 [2:57:35<4:30:03,  3.43it/s]
 85%|████████▌ | 315826/371472 [2:57:35<4:21:04,  3.55it/s]
 85%|████████▌ | 315827/371472 [2:57:35<4:12:27,  3.67it/s]
 85%|████████▌ | 315828/371472 [2:57:36<4:10:47,  3.70it/s]
 85%|████████▌ | 315829/371472 [2:57:36<4:15:38,  3.63it/s]
 85%|████████▌ | 315830/371472 [2:57:36<4:15:37,  3.63it/s]
 85%|████████▌ | 315831/371472 [2:57:36<4:10:48,  3.70it/s]
 85%|████████▌ | 315832/371472 [2:57:37<4:07:46,  3.74it/s]
 85%|████████▌ | 315833/371472 [2:57:37<4:18:59,  3.58it/s]
 85%|████████▌ | 315834/371472 [2:57:37<4:35:21,  3.37it/s]
 85%|████████▌ | 315835/371472 [2:57:38<4:32:26,  3.40it/s]
 85%|████████▌ | 315836/371472 [2:57:38<4:43:00,  3.28it/s]
 85%|████████▌ | 315837/371472 [2:57:38<4:51:23,  3.18it/s]
 85%|████████▌ | 315838/371472 [2:57:38<4:33:56,  3.38it/s]
 85%|████████▌ | 315839/371472 [2:57:39<4:30:24,  3.43it/s]
 85%|████████▌ | 315840/371472 [2:57:39<4:15:38,  3.63it/s]
                                                           
{'loss': 2.6393, 'learning_rate': 2.3485746299209203e-07, 'epoch': 13.6}

 85%|████████▌ | 315840/371472 [2:57:39<4:15:38,  3.63it/s]
 85%|████████▌ | 315841/371472 [2:57:39<4:32:30,  3.40it/s]
 85%|████████▌ | 315842/371472 [2:57:40<4:26:20,  3.48it/s]
 85%|████████▌ | 315843/371472 [2:57:40<4:31:45,  3.41it/s]
 85%|████████▌ | 315844/371472 [2:57:40<4:21:33,  3.54it/s]
 85%|████████▌ | 315845/371472 [2:57:40<4:26:03,  3.48it/s]
 85%|████████▌ | 315846/371472 [2:57:41<4:25:53,  3.49it/s]
 85%|████████▌ | 315847/371472 [2:57:41<4:16:20,  3.62it/s]
 85%|████████▌ | 315848/371472 [2:57:41<4:06:50,  3.76it/s]
 85%|████████▌ | 315849/371472 [2:57:41<4:07:38,  3.74it/s]
 85%|████████▌ | 315850/371472 [2:57:42<4:37:19,  3.34it/s]
 85%|████████▌ | 315851/371472 [2:57:42<4:32:08,  3.41it/s]
 85%|████████▌ | 315852/371472 [2:57:42<4:25:47,  3.49it/s]
 85%|████████▌ | 315853/371472 [2:57:43<4:16:27,  3.61it/s]
 85%|████████▌ | 315854/371472 [2:57:43<4:21:53,  3.54it/s]
 85%|████████▌ | 315855/371472 [2:57:43<4:22:11,  3.54it/s]
 85%|████████▌ | 315856/371472 [2:57:44<4:24:11,  3.51it/s]
 85%|████████▌ | 315857/371472 [2:57:44<4:49:43,  3.20it/s]
 85%|████████▌ | 315858/371472 [2:57:44<4:40:10,  3.31it/s]
 85%|████████▌ | 315859/371472 [2:57:44<4:33:48,  3.39it/s]
 85%|████████▌ | 315860/371472 [2:57:45<4:18:42,  3.58it/s]
                                                           
{'loss': 2.7073, 'learning_rate': 2.348089810166132e-07, 'epoch': 13.6}

 85%|████████▌ | 315860/371472 [2:57:45<4:18:42,  3.58it/s]
 85%|████████▌ | 315861/371472 [2:57:45<4:26:18,  3.48it/s]
 85%|████████▌ | 315862/371472 [2:57:45<4:37:10,  3.34it/s]
 85%|████████▌ | 315863/371472 [2:57:46<4:20:17,  3.56it/s]
 85%|████████▌ | 315864/371472 [2:57:46<4:14:39,  3.64it/s]
 85%|████████▌ | 315865/371472 [2:57:46<4:20:11,  3.56it/s]
 85%|████████▌ | 315866/371472 [2:57:47<4:57:06,  3.12it/s]
 85%|████████▌ | 315867/371472 [2:57:47<4:39:06,  3.32it/s]
 85%|████████▌ | 315868/371472 [2:57:47<4:37:58,  3.33it/s]
 85%|████████▌ | 315869/371472 [2:57:47<4:40:44,  3.30it/s]
 85%|████████▌ | 315870/371472 [2:57:48<4:27:05,  3.47it/s]
 85%|████████▌ | 315871/371472 [2:57:48<4:22:54,  3.52it/s]
 85%|████████▌ | 315872/371472 [2:57:48<4:13:29,  3.66it/s]
 85%|████████▌ | 315873/371472 [2:57:48<4:12:24,  3.67it/s]
 85%|████████▌ | 315874/371472 [2:57:49<4:14:04,  3.65it/s]
 85%|████████▌ | 315875/371472 [2:57:49<4:25:03,  3.50it/s]
 85%|████████▌ | 315876/371472 [2:57:49<4:11:25,  3.69it/s]
 85%|████████▌ | 315877/371472 [2:57:50<4:02:51,  3.82it/s]
 85%|████████▌ | 315878/371472 [2:57:50<3:56:00,  3.93it/s]
 85%|████████▌ | 315879/371472 [2:57:50<4:00:39,  3.85it/s]
 85%|████████▌ | 315880/371472 [2:57:50<4:09:24,  3.71it/s]
                                                           
{'loss': 2.4753, 'learning_rate': 2.3476049904113425e-07, 'epoch': 13.61}

 85%|████████▌ | 315880/371472 [2:57:50<4:09:24,  3.71it/s]
 85%|████████▌ | 315881/371472 [2:57:51<4:17:13,  3.60it/s]
 85%|████████▌ | 315882/371472 [2:57:51<4:28:14,  3.45it/s]
 85%|████████▌ | 315883/371472 [2:57:51<4:18:47,  3.58it/s]
 85%|████████▌ | 315884/371472 [2:57:51<4:22:12,  3.53it/s]
 85%|████████▌ | 315885/371472 [2:57:52<4:11:12,  3.69it/s]
 85%|████████▌ | 315886/371472 [2:57:52<4:13:50,  3.65it/s]
 85%|████████▌ | 315887/371472 [2:57:52<4:07:01,  3.75it/s]
 85%|████████▌ | 315888/371472 [2:57:53<4:12:44,  3.67it/s]
 85%|████████▌ | 315889/371472 [2:57:53<4:06:37,  3.76it/s]
 85%|████████▌ | 315890/371472 [2:57:53<4:09:59,  3.71it/s]
 85%|████████▌ | 315891/371472 [2:57:53<4:10:00,  3.71it/s]
 85%|████████▌ | 315892/371472 [2:57:54<4:15:50,  3.62it/s]
 85%|████████▌ | 315893/371472 [2:57:54<4:14:40,  3.64it/s]
 85%|████████▌ | 315894/371472 [2:57:54<4:07:08,  3.75it/s]
 85%|████████▌ | 315895/371472 [2:57:54<4:08:17,  3.73it/s]
 85%|████████▌ | 315896/371472 [2:57:55<4:09:01,  3.72it/s]
 85%|████████▌ | 315897/371472 [2:57:55<4:07:39,  3.74it/s]
 85%|████████▌ | 315898/371472 [2:57:55<4:06:41,  3.75it/s]
 85%|████████▌ | 315899/371472 [2:57:56<4:27:32,  3.46it/s]
 85%|████████▌ | 315900/371472 [2:57:56<4:26:49,  3.47it/s]
                                                           
{'loss': 2.5205, 'learning_rate': 2.347120170656553e-07, 'epoch': 13.61}

 85%|████████▌ | 315900/371472 [2:57:56<4:26:49,  3.47it/s]
 85%|████████▌ | 315901/371472 [2:57:56<4:37:47,  3.33it/s]
 85%|████████▌ | 315902/371472 [2:57:56<4:33:04,  3.39it/s]
 85%|████████▌ | 315903/371472 [2:57:57<4:41:22,  3.29it/s]
 85%|████████▌ | 315904/371472 [2:57:57<4:32:01,  3.40it/s]
 85%|████████▌ | 315905/371472 [2:57:57<4:24:26,  3.50it/s]
 85%|████████▌ | 315906/371472 [2:57:58<4:21:13,  3.55it/s]
 85%|████████▌ | 315907/371472 [2:57:58<4:22:30,  3.53it/s]
 85%|████████▌ | 315908/371472 [2:57:58<4:27:14,  3.47it/s]
 85%|████████▌ | 315909/371472 [2:57:58<4:14:20,  3.64it/s]
 85%|████████▌ | 315910/371472 [2:57:59<4:26:16,  3.48it/s]
 85%|████████▌ | 315911/371472 [2:57:59<4:22:23,  3.53it/s]
 85%|████████▌ | 315912/371472 [2:57:59<4:33:45,  3.38it/s]
 85%|████████▌ | 315913/371472 [2:58:00<4:28:25,  3.45it/s]
 85%|████████▌ | 315914/371472 [2:58:00<4:22:54,  3.52it/s]
 85%|████████▌ | 315915/371472 [2:58:00<4:21:36,  3.54it/s]
 85%|████████▌ | 315916/371472 [2:58:00<4:21:07,  3.55it/s]
 85%|████████▌ | 315917/371472 [2:58:01<4:33:17,  3.39it/s]
 85%|████████▌ | 315918/371472 [2:58:01<4:35:51,  3.36it/s]
 85%|████████▌ | 315919/371472 [2:58:01<4:24:56,  3.49it/s]
 85%|████████▌ | 315920/371472 [2:58:02<4:34:16,  3.38it/s]
                                                           
{'loss': 2.519, 'learning_rate': 2.3466353509017647e-07, 'epoch': 13.61}

 85%|████████▌ | 315920/371472 [2:58:02<4:34:16,  3.38it/s]
 85%|████████▌ | 315921/371472 [2:58:02<4:24:57,  3.49it/s]
 85%|████████▌ | 315922/371472 [2:58:02<4:19:22,  3.57it/s]
 85%|████████▌ | 315923/371472 [2:58:03<4:37:07,  3.34it/s]
 85%|████████▌ | 315924/371472 [2:58:03<4:32:57,  3.39it/s]
 85%|████████▌ | 315925/371472 [2:58:03<4:20:30,  3.55it/s]
 85%|████████▌ | 315926/371472 [2:58:03<4:18:18,  3.58it/s]
 85%|████████▌ | 315927/371472 [2:58:04<4:30:23,  3.42it/s]
 85%|████████▌ | 315928/371472 [2:58:04<4:19:26,  3.57it/s]
 85%|████████▌ | 315929/371472 [2:58:04<4:32:55,  3.39it/s]
 85%|████████▌ | 315930/371472 [2:58:05<4:39:49,  3.31it/s]
 85%|████████▌ | 315931/371472 [2:58:05<4:26:33,  3.47it/s]
 85%|████████▌ | 315932/371472 [2:58:05<4:22:09,  3.53it/s]
 85%|████████▌ | 315933/371472 [2:58:05<4:40:34,  3.30it/s]
 85%|████████▌ | 315934/371472 [2:58:06<4:27:47,  3.46it/s]
 85%|████████▌ | 315935/371472 [2:58:06<4:13:12,  3.66it/s]
 85%|████████▌ | 315936/371472 [2:58:06<4:16:33,  3.61it/s]
 85%|████████▌ | 315937/371472 [2:58:07<4:22:00,  3.53it/s]
 85%|████████▌ | 315938/371472 [2:58:07<4:14:59,  3.63it/s]
 85%|████████▌ | 315939/371472 [2:58:07<4:23:51,  3.51it/s]
 85%|████████▌ | 315940/371472 [2:58:07<4:19:51,  3.56it/s]
                                                           
{'loss': 2.801, 'learning_rate': 2.3461505311469752e-07, 'epoch': 13.61}

 85%|████████▌ | 315940/371472 [2:58:07<4:19:51,  3.56it/s]
 85%|████████▌ | 315941/371472 [2:58:08<4:11:10,  3.68it/s]
 85%|████████▌ | 315942/371472 [2:58:08<4:12:37,  3.66it/s]
 85%|████████▌ | 315943/371472 [2:58:08<4:01:34,  3.83it/s]
 85%|████████▌ | 315944/371472 [2:58:08<4:12:01,  3.67it/s]
 85%|████████▌ | 315945/371472 [2:58:09<4:14:40,  3.63it/s]
 85%|████████▌ | 315946/371472 [2:58:09<4:27:29,  3.46it/s]
 85%|████████▌ | 315947/371472 [2:58:09<4:22:12,  3.53it/s]
 85%|████████▌ | 315948/371472 [2:58:10<4:18:35,  3.58it/s]
 85%|████████▌ | 315949/371472 [2:58:10<4:07:45,  3.74it/s]
 85%|████████▌ | 315950/371472 [2:58:10<4:17:58,  3.59it/s]
 85%|████████▌ | 315951/371472 [2:58:10<4:09:28,  3.71it/s]
 85%|████████▌ | 315952/371472 [2:58:11<4:05:22,  3.77it/s]
 85%|████████▌ | 315953/371472 [2:58:11<4:11:57,  3.67it/s]
 85%|████████▌ | 315954/371472 [2:58:11<4:12:58,  3.66it/s]
 85%|████████▌ | 315955/371472 [2:58:11<4:08:40,  3.72it/s]
 85%|████████▌ | 315956/371472 [2:58:12<4:02:33,  3.81it/s]
 85%|████████▌ | 315957/371472 [2:58:12<4:13:22,  3.65it/s]
 85%|████████▌ | 315958/371472 [2:58:12<4:03:32,  3.80it/s]
 85%|████████▌ | 315959/371472 [2:58:12<4:08:53,  3.72it/s]
 85%|████████▌ | 315960/371472 [2:58:13<4:27:53,  3.45it/s]
                                                           
{'loss': 2.6765, 'learning_rate': 2.3456657113921867e-07, 'epoch': 13.61}

 85%|████████▌ | 315960/371472 [2:58:13<4:27:53,  3.45it/s]
 85%|████████▌ | 315961/371472 [2:58:13<4:26:42,  3.47it/s]
 85%|████████▌ | 315962/371472 [2:58:13<4:16:55,  3.60it/s]
 85%|████████▌ | 315963/371472 [2:58:14<4:09:38,  3.71it/s]
 85%|████████▌ | 315964/371472 [2:58:14<4:12:33,  3.66it/s]
 85%|████████▌ | 315965/371472 [2:58:14<4:24:33,  3.50it/s]
 85%|████████▌ | 315966/371472 [2:58:14<4:22:25,  3.53it/s]
 85%|████████▌ | 315967/371472 [2:58:15<4:22:32,  3.52it/s]
 85%|████████▌ | 315968/371472 [2:58:15<4:21:05,  3.54it/s]
 85%|████████▌ | 315969/371472 [2:58:15<4:13:13,  3.65it/s]
 85%|████████▌ | 315970/371472 [2:58:16<4:04:07,  3.79it/s]
 85%|████████▌ | 315971/371472 [2:58:16<4:05:48,  3.76it/s]
 85%|████████▌ | 315972/371472 [2:58:16<4:12:22,  3.67it/s]
 85%|████████▌ | 315973/371472 [2:58:16<4:21:54,  3.53it/s]
 85%|████████▌ | 315974/371472 [2:58:17<4:21:07,  3.54it/s]
 85%|████████▌ | 315975/371472 [2:58:17<4:16:10,  3.61it/s]
 85%|████████▌ | 315976/371472 [2:58:17<4:50:50,  3.18it/s]
 85%|████████▌ | 315977/371472 [2:58:18<4:34:52,  3.36it/s]
 85%|████████▌ | 315978/371472 [2:58:18<4:40:12,  3.30it/s]
 85%|████████▌ | 315979/371472 [2:58:18<4:25:21,  3.49it/s]
 85%|████████▌ | 315980/371472 [2:58:18<4:20:50,  3.55it/s]
                                                           
{'loss': 2.711, 'learning_rate': 2.3451808916373974e-07, 'epoch': 13.61}

 85%|████████▌ | 315980/371472 [2:58:18<4:20:50,  3.55it/s]
 85%|████████▌ | 315981/371472 [2:58:19<4:17:46,  3.59it/s]
 85%|████████▌ | 315982/371472 [2:58:19<4:29:46,  3.43it/s]
 85%|████████▌ | 315983/371472 [2:58:19<4:18:09,  3.58it/s]
 85%|████████▌ | 315984/371472 [2:58:20<4:21:31,  3.54it/s]
 85%|████████▌ | 315985/371472 [2:58:20<4:09:31,  3.71it/s]
 85%|████████▌ | 315986/371472 [2:58:20<4:23:55,  3.50it/s]
 85%|████████▌ | 315987/371472 [2:58:20<4:23:27,  3.51it/s]
 85%|████████▌ | 315988/371472 [2:58:21<4:14:15,  3.64it/s]
 85%|████████▌ | 315989/371472 [2:58:21<4:14:56,  3.63it/s]
 85%|████████▌ | 315990/371472 [2:58:21<4:11:15,  3.68it/s]
 85%|████████▌ | 315991/371472 [2:58:22<4:10:04,  3.70it/s]
 85%|████████▌ | 315992/371472 [2:58:22<4:11:10,  3.68it/s]
 85%|████████▌ | 315993/371472 [2:58:22<4:12:58,  3.66it/s]
 85%|████████▌ | 315994/371472 [2:58:22<4:17:26,  3.59it/s]
 85%|████████▌ | 315995/371472 [2:58:23<4:12:54,  3.66it/s]
 85%|████████▌ | 315996/371472 [2:58:23<4:16:21,  3.61it/s]
 85%|████████▌ | 315997/371472 [2:58:23<4:12:34,  3.66it/s]
 85%|████████▌ | 315998/371472 [2:58:23<4:12:54,  3.66it/s]
 85%|████████▌ | 315999/371472 [2:58:24<4:07:20,  3.74it/s]
 85%|████████▌ | 316000/371472 [2:58:24<4:10:51,  3.69it/s]
                                                           
{'loss': 2.5411, 'learning_rate': 2.344696071882609e-07, 'epoch': 13.61}

 85%|████████▌ | 316000/371472 [2:58:24<4:10:51,  3.69it/s]
 85%|████████▌ | 316001/371472 [2:58:24<4:27:13,  3.46it/s]
 85%|████████▌ | 316002/371472 [2:58:25<4:20:30,  3.55it/s]
 85%|████████▌ | 316003/371472 [2:58:25<4:13:05,  3.65it/s]
 85%|████████▌ | 316004/371472 [2:58:25<4:27:07,  3.46it/s]
 85%|████████▌ | 316005/371472 [2:58:25<4:18:42,  3.57it/s]
 85%|████████▌ | 316006/371472 [2:58:26<4:36:59,  3.34it/s]
 85%|████████▌ | 316007/371472 [2:58:26<4:18:28,  3.58it/s]
 85%|████████▌ | 316008/371472 [2:58:26<4:35:39,  3.35it/s]
 85%|████████▌ | 316009/371472 [2:58:27<4:31:30,  3.40it/s]
 85%|████████▌ | 316010/371472 [2:58:27<4:25:11,  3.49it/s]
 85%|████████▌ | 316011/371472 [2:58:27<4:16:39,  3.60it/s]
 85%|████████▌ | 316012/371472 [2:58:27<4:19:11,  3.57it/s]
 85%|████████▌ | 316013/371472 [2:58:28<4:13:23,  3.65it/s]
 85%|████████▌ | 316014/371472 [2:58:28<4:28:54,  3.44it/s]
 85%|████████▌ | 316015/371472 [2:58:28<4:47:46,  3.21it/s]
 85%|████████▌ | 316016/371472 [2:58:29<4:30:24,  3.42it/s]
 85%|████████▌ | 316017/371472 [2:58:29<4:18:04,  3.58it/s]
 85%|████████▌ | 316018/371472 [2:58:29<4:16:23,  3.60it/s]
 85%|████████▌ | 316019/371472 [2:58:29<4:08:59,  3.71it/s]
 85%|████████▌ | 316020/371472 [2:58:30<4:20:10,  3.55it/s]
                                                           
{'loss': 2.5969, 'learning_rate': 2.3442112521278196e-07, 'epoch': 13.61}

 85%|████████▌ | 316020/371472 [2:58:30<4:20:10,  3.55it/s]
 85%|████████▌ | 316021/371472 [2:58:30<4:20:42,  3.54it/s]
 85%|████████▌ | 316022/371472 [2:58:30<4:33:50,  3.37it/s]
 85%|████████▌ | 316023/371472 [2:58:31<4:18:56,  3.57it/s]
 85%|████████▌ | 316024/371472 [2:58:31<4:24:24,  3.50it/s]
 85%|████████▌ | 316025/371472 [2:58:31<4:24:26,  3.49it/s]
 85%|████████▌ | 316026/371472 [2:58:31<4:24:51,  3.49it/s]
 85%|████████▌ | 316027/371472 [2:58:32<4:21:12,  3.54it/s]
 85%|████████▌ | 316028/371472 [2:58:32<4:25:32,  3.48it/s]
 85%|████████▌ | 316029/371472 [2:58:32<4:20:47,  3.54it/s]
 85%|████████▌ | 316030/371472 [2:58:33<4:25:36,  3.48it/s]
 85%|████████▌ | 316031/371472 [2:58:33<4:23:31,  3.51it/s]
 85%|████████▌ | 316032/371472 [2:58:33<4:13:58,  3.64it/s]
 85%|████████▌ | 316033/371472 [2:58:33<4:09:37,  3.70it/s]
 85%|████████▌ | 316034/371472 [2:58:34<4:08:50,  3.71it/s]
 85%|████████▌ | 316035/371472 [2:58:34<4:07:36,  3.73it/s]
 85%|████████▌ | 316036/371472 [2:58:34<4:17:04,  3.59it/s]
 85%|████████▌ | 316037/371472 [2:58:34<4:25:19,  3.48it/s]
 85%|████████▌ | 316038/371472 [2:58:35<4:32:50,  3.39it/s]
 85%|████████▌ | 316039/371472 [2:58:35<4:23:18,  3.51it/s]
 85%|████████▌ | 316040/371472 [2:58:35<4:12:57,  3.65it/s]
                                                           
{'loss': 2.6818, 'learning_rate': 2.3437264323730312e-07, 'epoch': 13.61}

 85%|████████▌ | 316040/371472 [2:58:35<4:12:57,  3.65it/s]
 85%|████████▌ | 316041/371472 [2:58:36<4:07:09,  3.74it/s]
 85%|████████▌ | 316042/371472 [2:58:36<4:03:14,  3.80it/s]
 85%|████████▌ | 316043/371472 [2:58:36<4:05:09,  3.77it/s]
 85%|████████▌ | 316044/371472 [2:58:36<4:06:31,  3.75it/s]
 85%|████████▌ | 316045/371472 [2:58:37<4:06:13,  3.75it/s]
 85%|████████▌ | 316046/371472 [2:58:37<4:19:26,  3.56it/s]
 85%|████████▌ | 316047/371472 [2:58:37<4:25:47,  3.48it/s]
 85%|████████▌ | 316048/371472 [2:58:38<4:16:06,  3.61it/s]
 85%|████████▌ | 316049/371472 [2:58:38<4:20:59,  3.54it/s]
 85%|████████▌ | 316050/371472 [2:58:38<4:18:44,  3.57it/s]
 85%|████████▌ | 316051/371472 [2:58:38<4:15:55,  3.61it/s]
 85%|████████▌ | 316052/371472 [2:58:39<4:17:13,  3.59it/s]
 85%|████████▌ | 316053/371472 [2:58:39<4:20:10,  3.55it/s]
 85%|████████▌ | 316054/371472 [2:58:39<4:21:31,  3.53it/s]
 85%|████████▌ | 316055/371472 [2:58:39<4:22:15,  3.52it/s]
 85%|████████▌ | 316056/371472 [2:58:40<4:16:03,  3.61it/s]
 85%|████████▌ | 316057/371472 [2:58:40<4:19:42,  3.56it/s]
 85%|████████▌ | 316058/371472 [2:58:40<4:17:15,  3.59it/s]
 85%|████████▌ | 316059/371472 [2:58:41<4:15:00,  3.62it/s]
 85%|████████▌ | 316060/371472 [2:58:41<4:06:09,  3.75it/s]
                                                           
{'loss': 2.6649, 'learning_rate': 2.3432416126182416e-07, 'epoch': 13.61}

 85%|████████▌ | 316060/371472 [2:58:41<4:06:09,  3.75it/s]
 85%|████████▌ | 316061/371472 [2:58:41<4:05:25,  3.76it/s]
 85%|████████▌ | 316062/371472 [2:58:41<4:03:24,  3.79it/s]
 85%|████████▌ | 316063/371472 [2:58:42<3:55:53,  3.91it/s]
 85%|████████▌ | 316064/371472 [2:58:42<3:55:14,  3.93it/s]
 85%|████████▌ | 316065/371472 [2:58:42<3:59:40,  3.85it/s]
 85%|████████▌ | 316066/371472 [2:58:42<4:00:11,  3.84it/s]
 85%|████████▌ | 316067/371472 [2:58:43<3:53:45,  3.95it/s]
 85%|████████▌ | 316068/371472 [2:58:43<3:56:59,  3.90it/s]
 85%|████████▌ | 316069/371472 [2:58:43<3:53:51,  3.95it/s]
 85%|████████▌ | 316070/371472 [2:58:43<4:00:11,  3.84it/s]
 85%|████████▌ | 316071/371472 [2:58:44<4:20:57,  3.54it/s]
 85%|████████▌ | 316072/371472 [2:58:44<4:18:32,  3.57it/s]
 85%|████████▌ | 316073/371472 [2:58:44<4:19:35,  3.56it/s]
 85%|████████▌ | 316074/371472 [2:58:45<4:17:24,  3.59it/s]
 85%|████████▌ | 316075/371472 [2:58:45<4:10:36,  3.68it/s]
 85%|████████▌ | 316076/371472 [2:58:45<4:07:46,  3.73it/s]
 85%|████████▌ | 316077/371472 [2:58:45<4:31:23,  3.40it/s]
 85%|████████▌ | 316078/371472 [2:58:46<4:22:00,  3.52it/s]
 85%|████████▌ | 316079/371472 [2:58:46<4:24:18,  3.49it/s]
 85%|████████▌ | 316080/371472 [2:58:46<4:20:29,  3.54it/s]
                                                           
{'loss': 2.4477, 'learning_rate': 2.3427567928634534e-07, 'epoch': 13.61}

 85%|████████▌ | 316080/371472 [2:58:46<4:20:29,  3.54it/s]
 85%|████████▌ | 316081/371472 [2:58:47<4:13:10,  3.65it/s]
 85%|████████▌ | 316082/371472 [2:58:47<4:25:42,  3.47it/s]
 85%|████████▌ | 316083/371472 [2:58:47<4:24:47,  3.49it/s]
 85%|████████▌ | 316084/371472 [2:58:47<4:38:17,  3.32it/s]
 85%|████████▌ | 316085/371472 [2:58:48<4:30:05,  3.42it/s]
 85%|████████▌ | 316086/371472 [2:58:48<4:21:31,  3.53it/s]
 85%|████████▌ | 316087/371472 [2:58:48<4:26:17,  3.47it/s]
 85%|████████▌ | 316088/371472 [2:58:49<4:17:23,  3.59it/s]
 85%|████████▌ | 316089/371472 [2:58:49<4:13:12,  3.65it/s]
 85%|████████▌ | 316090/371472 [2:58:49<4:22:26,  3.52it/s]
 85%|████████▌ | 316091/371472 [2:58:49<4:22:33,  3.52it/s]
 85%|████████▌ | 316092/371472 [2:58:50<4:25:42,  3.47it/s]
 85%|████████▌ | 316093/371472 [2:58:50<4:12:37,  3.65it/s]
 85%|████████▌ | 316094/371472 [2:58:50<4:15:35,  3.61it/s]
 85%|████████▌ | 316095/371472 [2:58:50<4:16:15,  3.60it/s]
 85%|████████▌ | 316096/371472 [2:58:51<4:08:56,  3.71it/s]
 85%|████████▌ | 316097/371472 [2:58:51<4:04:37,  3.77it/s]
 85%|████████▌ | 316098/371472 [2:58:51<4:02:31,  3.81it/s]
 85%|████████▌ | 316099/371472 [2:58:52<4:06:53,  3.74it/s]
 85%|████████▌ | 316100/371472 [2:58:52<4:02:14,  3.81it/s]
                                                           
{'loss': 2.6765, 'learning_rate': 2.3422719731086638e-07, 'epoch': 13.62}

 85%|████████▌ | 316100/371472 [2:58:52<4:02:14,  3.81it/s]
 85%|████████▌ | 316101/371472 [2:58:52<4:22:21,  3.52it/s]
 85%|████████▌ | 316102/371472 [2:58:52<4:28:56,  3.43it/s]
 85%|████████▌ | 316103/371472 [2:58:53<4:22:15,  3.52it/s]
 85%|████████▌ | 316104/371472 [2:58:53<4:15:19,  3.61it/s]
 85%|████████▌ | 316105/371472 [2:58:53<4:02:48,  3.80it/s]
 85%|████████▌ | 316106/371472 [2:58:54<4:20:56,  3.54it/s]
 85%|████████▌ | 316107/371472 [2:58:54<4:11:45,  3.67it/s]
 85%|████████▌ | 316108/371472 [2:58:54<4:18:42,  3.57it/s]
 85%|████████▌ | 316109/371472 [2:58:54<4:12:51,  3.65it/s]
 85%|████████▌ | 316110/371472 [2:58:55<4:19:55,  3.55it/s]
 85%|████████▌ | 316111/371472 [2:58:55<4:32:24,  3.39it/s]
 85%|████████▌ | 316112/371472 [2:58:55<4:15:44,  3.61it/s]
 85%|████████▌ | 316113/371472 [2:58:56<4:30:25,  3.41it/s]
 85%|████████▌ | 316114/371472 [2:58:56<4:14:35,  3.62it/s]
 85%|████████▌ | 316115/371472 [2:58:56<4:11:52,  3.66it/s]
 85%|████████▌ | 316116/371472 [2:58:56<4:12:01,  3.66it/s]
 85%|████████▌ | 316117/371472 [2:58:57<4:13:04,  3.65it/s]
 85%|████████▌ | 316118/371472 [2:58:57<4:07:54,  3.72it/s]
 85%|████████▌ | 316119/371472 [2:58:57<4:06:41,  3.74it/s]
 85%|████████▌ | 316120/371472 [2:58:57<3:59:15,  3.86it/s]
                                                           
{'loss': 2.5705, 'learning_rate': 2.3417871533538753e-07, 'epoch': 13.62}

 85%|████████▌ | 316120/371472 [2:58:57<3:59:15,  3.86it/s]
 85%|████████▌ | 316121/371472 [2:58:58<4:02:47,  3.80it/s]
 85%|████████▌ | 316122/371472 [2:58:58<4:19:36,  3.55it/s]
 85%|████████▌ | 316123/371472 [2:58:58<4:08:55,  3.71it/s]
 85%|████████▌ | 316124/371472 [2:58:58<4:21:26,  3.53it/s]
 85%|████████▌ | 316125/371472 [2:58:59<4:13:50,  3.63it/s]
 85%|████████▌ | 316126/371472 [2:58:59<4:12:22,  3.65it/s]
 85%|████████▌ | 316127/371472 [2:58:59<4:18:37,  3.57it/s]
 85%|████████▌ | 316128/371472 [2:59:00<4:27:08,  3.45it/s]
 85%|████████▌ | 316129/371472 [2:59:00<4:15:10,  3.61it/s]
 85%|████████▌ | 316130/371472 [2:59:00<4:28:33,  3.43it/s]
 85%|████████▌ | 316131/371472 [2:59:00<4:31:48,  3.39it/s]
 85%|████████▌ | 316132/371472 [2:59:01<4:19:07,  3.56it/s]
 85%|████████▌ | 316133/371472 [2:59:01<4:15:57,  3.60it/s]
 85%|████████▌ | 316134/371472 [2:59:01<4:19:53,  3.55it/s]
 85%|████████▌ | 316135/371472 [2:59:02<4:25:29,  3.47it/s]
 85%|████████▌ | 316136/371472 [2:59:02<4:35:23,  3.35it/s]
 85%|████████▌ | 316137/371472 [2:59:02<4:21:25,  3.53it/s]
 85%|████████▌ | 316138/371472 [2:59:02<4:23:45,  3.50it/s]
 85%|████████▌ | 316139/371472 [2:59:03<4:22:39,  3.51it/s]
 85%|████████▌ | 316140/371472 [2:59:03<4:49:48,  3.18it/s]
                                                           
{'loss': 2.5967, 'learning_rate': 2.341302333599086e-07, 'epoch': 13.62}

 85%|████████▌ | 316140/371472 [2:59:03<4:49:48,  3.18it/s]
 85%|████████▌ | 316141/371472 [2:59:03<4:43:54,  3.25it/s]
 85%|████████▌ | 316142/371472 [2:59:04<4:32:38,  3.38it/s]
 85%|████████▌ | 316143/371472 [2:59:04<4:26:00,  3.47it/s]
 85%|████████▌ | 316144/371472 [2:59:04<4:29:38,  3.42it/s]
 85%|████████▌ | 316145/371472 [2:59:05<4:19:23,  3.55it/s]
 85%|████████▌ | 316146/371472 [2:59:05<4:20:32,  3.54it/s]
 85%|████████▌ | 316147/371472 [2:59:05<4:14:49,  3.62it/s]
 85%|████████▌ | 316148/371472 [2:59:05<4:24:52,  3.48it/s]
 85%|████████▌ | 316149/371472 [2:59:06<4:42:47,  3.26it/s]
 85%|████████▌ | 316150/371472 [2:59:06<4:37:51,  3.32it/s]
 85%|████████▌ | 316151/371472 [2:59:06<4:31:43,  3.39it/s]
 85%|████████▌ | 316152/371472 [2:59:07<4:29:14,  3.42it/s]
 85%|████████▌ | 316153/371472 [2:59:07<4:25:19,  3.47it/s]
 85%|████████▌ | 316154/371472 [2:59:07<4:11:33,  3.66it/s]
 85%|████████▌ | 316155/371472 [2:59:07<4:08:12,  3.71it/s]
 85%|████████▌ | 316156/371472 [2:59:08<4:17:53,  3.57it/s]
 85%|████████▌ | 316157/371472 [2:59:08<4:20:11,  3.54it/s]
 85%|████████▌ | 316158/371472 [2:59:08<4:25:59,  3.47it/s]
 85%|████████▌ | 316159/371472 [2:59:09<4:29:05,  3.43it/s]
 85%|████████▌ | 316160/371472 [2:59:09<4:25:12,  3.48it/s]
                                                           
{'loss': 2.6771, 'learning_rate': 2.3408175138442976e-07, 'epoch': 13.62}

 85%|████████▌ | 316160/371472 [2:59:09<4:25:12,  3.48it/s]
 85%|████████▌ | 316161/371472 [2:59:09<4:14:27,  3.62it/s]
 85%|████████▌ | 316162/371472 [2:59:09<4:17:01,  3.59it/s]
 85%|████████▌ | 316163/371472 [2:59:10<4:09:51,  3.69it/s]
 85%|████████▌ | 316164/371472 [2:59:10<4:06:14,  3.74it/s]
 85%|████████▌ | 316165/371472 [2:59:10<4:25:05,  3.48it/s]
 85%|████████▌ | 316166/371472 [2:59:11<4:24:14,  3.49it/s]
 85%|████████▌ | 316167/371472 [2:59:11<4:22:24,  3.51it/s]
 85%|████████▌ | 316168/371472 [2:59:11<4:25:30,  3.47it/s]
 85%|████████▌ | 316169/371472 [2:59:11<4:24:01,  3.49it/s]
 85%|████████▌ | 316170/371472 [2:59:12<4:14:03,  3.63it/s]
 85%|████████▌ | 316171/371472 [2:59:12<4:27:13,  3.45it/s]
 85%|████████▌ | 316172/371472 [2:59:12<4:12:36,  3.65it/s]
 85%|████████▌ | 316173/371472 [2:59:13<4:44:18,  3.24it/s]
 85%|████████▌ | 316174/371472 [2:59:13<4:41:26,  3.27it/s]
 85%|████████▌ | 316175/371472 [2:59:13<4:26:57,  3.45it/s]
 85%|████████▌ | 316176/371472 [2:59:13<4:14:34,  3.62it/s]
 85%|████████▌ | 316177/371472 [2:59:14<4:10:03,  3.69it/s]
 85%|████████▌ | 316178/371472 [2:59:14<4:03:13,  3.79it/s]
 85%|████████▌ | 316179/371472 [2:59:14<4:03:28,  3.78it/s]
 85%|████████▌ | 316180/371472 [2:59:14<4:08:57,  3.70it/s]
                                                           
{'loss': 2.7426, 'learning_rate': 2.3403326940895083e-07, 'epoch': 13.62}

 85%|████████▌ | 316180/371472 [2:59:14<4:08:57,  3.70it/s]
 85%|████████▌ | 316181/371472 [2:59:15<4:10:50,  3.67it/s]
 85%|████████▌ | 316182/371472 [2:59:15<4:21:34,  3.52it/s]
 85%|████████▌ | 316183/371472 [2:59:15<4:16:47,  3.59it/s]
 85%|████████▌ | 316184/371472 [2:59:16<4:15:35,  3.61it/s]
 85%|████████▌ | 316185/371472 [2:59:16<4:09:18,  3.70it/s]
 85%|████████▌ | 316186/371472 [2:59:16<4:19:41,  3.55it/s]
 85%|████████▌ | 316187/371472 [2:59:16<4:37:44,  3.32it/s]
 85%|████████▌ | 316188/371472 [2:59:17<4:24:09,  3.49it/s]
 85%|████████▌ | 316189/371472 [2:59:17<4:20:13,  3.54it/s]
 85%|████████▌ | 316190/371472 [2:59:17<4:31:05,  3.40it/s]
 85%|████████▌ | 316191/371472 [2:59:18<4:26:22,  3.46it/s]
 85%|████████▌ | 316192/371472 [2:59:18<4:20:16,  3.54it/s]
 85%|████████▌ | 316193/371472 [2:59:18<4:29:23,  3.42it/s]
 85%|████████▌ | 316194/371472 [2:59:18<4:37:06,  3.32it/s]
 85%|████████▌ | 316195/371472 [2:59:19<4:28:52,  3.43it/s]
 85%|████████▌ | 316196/371472 [2:59:19<4:24:09,  3.49it/s]
 85%|████████▌ | 316197/371472 [2:59:19<4:17:35,  3.58it/s]
 85%|████████▌ | 316198/371472 [2:59:20<4:10:31,  3.68it/s]
 85%|████████▌ | 316199/371472 [2:59:20<4:43:09,  3.25it/s]
 85%|████████▌ | 316200/371472 [2:59:20<4:35:38,  3.34it/s]
                                                           
{'loss': 2.6629, 'learning_rate': 2.3398478743347198e-07, 'epoch': 13.62}

 85%|████████▌ | 316200/371472 [2:59:20<4:35:38,  3.34it/s]
 85%|████████▌ | 316201/371472 [2:59:20<4:22:08,  3.51it/s]
 85%|████████▌ | 316202/371472 [2:59:21<4:21:19,  3.52it/s]
 85%|████████▌ | 316203/371472 [2:59:21<4:09:50,  3.69it/s]
 85%|████████▌ | 316204/371472 [2:59:21<4:03:54,  3.78it/s]
 85%|████████▌ | 316205/371472 [2:59:22<4:15:30,  3.61it/s]
 85%|████████▌ | 316206/371472 [2:59:22<4:08:36,  3.71it/s]
 85%|████████▌ | 316207/371472 [2:59:22<4:13:43,  3.63it/s]
 85%|████████▌ | 316208/371472 [2:59:22<4:12:17,  3.65it/s]
 85%|████████▌ | 316209/371472 [2:59:23<4:30:05,  3.41it/s]
 85%|████████▌ | 316210/371472 [2:59:23<4:19:49,  3.54it/s]
 85%|████████▌ | 316211/371472 [2:59:23<4:20:44,  3.53it/s]
 85%|████████▌ | 316212/371472 [2:59:24<4:17:16,  3.58it/s]
 85%|████████▌ | 316213/371472 [2:59:24<4:11:17,  3.66it/s]
 85%|████████▌ | 316214/371472 [2:59:24<4:06:04,  3.74it/s]
 85%|████████▌ | 316215/371472 [2:59:24<4:00:49,  3.82it/s]
 85%|████████▌ | 316216/371472 [2:59:25<4:10:12,  3.68it/s]
 85%|████████▌ | 316217/371472 [2:59:25<4:04:37,  3.76it/s]
 85%|████████▌ | 316218/371472 [2:59:25<4:06:54,  3.73it/s]
 85%|████████▌ | 316219/371472 [2:59:25<4:10:44,  3.67it/s]
 85%|████████▌ | 316220/371472 [2:59:26<4:15:47,  3.60it/s]
                                                           
{'loss': 2.6219, 'learning_rate': 2.3393630545799302e-07, 'epoch': 13.62}

 85%|████████▌ | 316220/371472 [2:59:26<4:15:47,  3.60it/s]
 85%|████████▌ | 316221/371472 [2:59:26<4:13:26,  3.63it/s]
 85%|████████▌ | 316222/371472 [2:59:26<4:18:43,  3.56it/s]
 85%|████████▌ | 316223/371472 [2:59:27<4:19:58,  3.54it/s]
 85%|████████▌ | 316224/371472 [2:59:27<4:19:38,  3.55it/s]
 85%|████████▌ | 316225/371472 [2:59:27<4:12:43,  3.64it/s]
 85%|████████▌ | 316226/371472 [2:59:27<4:13:56,  3.63it/s]
 85%|████████▌ | 316227/371472 [2:59:28<4:16:51,  3.58it/s]
 85%|████████▌ | 316228/371472 [2:59:28<4:21:41,  3.52it/s]
 85%|████████▌ | 316229/371472 [2:59:28<4:10:19,  3.68it/s]
 85%|████████▌ | 316230/371472 [2:59:28<4:12:28,  3.65it/s]
 85%|████████▌ | 316231/371472 [2:59:29<4:14:29,  3.62it/s]
 85%|████████▌ | 316232/371472 [2:59:29<4:14:50,  3.61it/s]
 85%|████████▌ | 316233/371472 [2:59:29<4:11:15,  3.66it/s]
 85%|████████▌ | 316234/371472 [2:59:30<4:08:35,  3.70it/s]
 85%|████████▌ | 316235/371472 [2:59:30<4:39:31,  3.29it/s]
 85%|████████▌ | 316236/371472 [2:59:30<4:34:42,  3.35it/s]
 85%|████████▌ | 316237/371472 [2:59:31<4:44:53,  3.23it/s]
 85%|████████▌ | 316238/371472 [2:59:31<4:29:26,  3.42it/s]
 85%|████████▌ | 316239/371472 [2:59:31<4:25:58,  3.46it/s]
 85%|████████▌ | 316240/371472 [2:59:31<4:28:42,  3.43it/s]
                                                           
{'loss': 2.6313, 'learning_rate': 2.338878234825142e-07, 'epoch': 13.62}

 85%|████████▌ | 316240/371472 [2:59:31<4:28:42,  3.43it/s]
 85%|████████▌ | 316241/371472 [2:59:32<4:38:27,  3.31it/s]
 85%|████████▌ | 316242/371472 [2:59:32<4:32:25,  3.38it/s]
 85%|████████▌ | 316243/371472 [2:59:32<4:43:30,  3.25it/s]
 85%|████████▌ | 316244/371472 [2:59:33<4:27:29,  3.44it/s]
 85%|████████▌ | 316245/371472 [2:59:33<4:15:35,  3.60it/s]
 85%|████████▌ | 316246/371472 [2:59:33<4:18:17,  3.56it/s]
 85%|████████▌ | 316247/371472 [2:59:33<4:09:17,  3.69it/s]
 85%|████████▌ | 316248/371472 [2:59:34<4:08:37,  3.70it/s]
 85%|████████▌ | 316249/371472 [2:59:34<4:05:12,  3.75it/s]
 85%|████████▌ | 316250/371472 [2:59:34<4:02:58,  3.79it/s]
 85%|████████▌ | 316251/371472 [2:59:34<4:13:18,  3.63it/s]
 85%|████████▌ | 316252/371472 [2:59:35<4:32:30,  3.38it/s]
 85%|████████▌ | 316253/371472 [2:59:35<4:53:39,  3.13it/s]
 85%|████████▌ | 316254/371472 [2:59:35<4:43:58,  3.24it/s]
 85%|████████▌ | 316255/371472 [2:59:36<4:32:29,  3.38it/s]
 85%|████████▌ | 316256/371472 [2:59:36<4:27:03,  3.45it/s]
 85%|████████▌ | 316257/371472 [2:59:36<4:19:40,  3.54it/s]
 85%|████████▌ | 316258/371472 [2:59:36<4:17:15,  3.58it/s]
 85%|████████▌ | 316259/371472 [2:59:37<4:16:05,  3.59it/s]
 85%|████████▌ | 316260/371472 [2:59:37<4:17:38,  3.57it/s]
                                                           
{'loss': 2.6503, 'learning_rate': 2.3383934150703525e-07, 'epoch': 13.62}

 85%|████████▌ | 316260/371472 [2:59:37<4:17:38,  3.57it/s]
 85%|████████▌ | 316261/371472 [2:59:37<4:20:22,  3.53it/s]
 85%|████████▌ | 316262/371472 [2:59:38<4:09:12,  3.69it/s]
 85%|████████▌ | 316263/371472 [2:59:38<4:05:42,  3.74it/s]
 85%|████████▌ | 316264/371472 [2:59:38<3:57:11,  3.88it/s]
 85%|████████▌ | 316265/371472 [2:59:38<3:54:15,  3.93it/s]
 85%|████████▌ | 316266/371472 [2:59:39<3:51:53,  3.97it/s]
 85%|████████▌ | 316267/371472 [2:59:39<4:04:52,  3.76it/s]
 85%|████████▌ | 316268/371472 [2:59:39<4:20:25,  3.53it/s]
 85%|████████▌ | 316269/371472 [2:59:39<4:11:10,  3.66it/s]
 85%|████████▌ | 316270/371472 [2:59:40<4:22:24,  3.51it/s]
 85%|████████▌ | 316271/371472 [2:59:40<4:51:28,  3.16it/s]
 85%|████████▌ | 316272/371472 [2:59:40<4:34:34,  3.35it/s]
 85%|████████▌ | 316273/371472 [2:59:41<4:28:51,  3.42it/s]
 85%|████████▌ | 316274/371472 [2:59:41<4:24:10,  3.48it/s]
 85%|████████▌ | 316275/371472 [2:59:41<4:32:45,  3.37it/s]
 85%|████████▌ | 316276/371472 [2:59:42<4:24:22,  3.48it/s]
 85%|████████▌ | 316277/371472 [2:59:42<4:16:12,  3.59it/s]
 85%|████████▌ | 316278/371472 [2:59:42<4:04:11,  3.77it/s]
 85%|████████▌ | 316279/371472 [2:59:42<4:03:45,  3.77it/s]
 85%|████████▌ | 316280/371472 [2:59:43<4:01:11,  3.81it/s]
                                                           
{'loss': 2.5146, 'learning_rate': 2.337908595315564e-07, 'epoch': 13.62}

 85%|████████▌ | 316280/371472 [2:59:43<4:01:11,  3.81it/s]
 85%|████████▌ | 316281/371472 [2:59:43<4:18:50,  3.55it/s]
 85%|████████▌ | 316282/371472 [2:59:43<4:23:12,  3.49it/s]
 85%|████████▌ | 316283/371472 [2:59:43<4:25:28,  3.46it/s]
 85%|████████▌ | 316284/371472 [2:59:44<4:20:20,  3.53it/s]
 85%|████████▌ | 316285/371472 [2:59:44<4:19:40,  3.54it/s]
 85%|████████▌ | 316286/371472 [2:59:44<4:22:44,  3.50it/s]
 85%|████████▌ | 316287/371472 [2:59:45<4:24:17,  3.48it/s]
 85%|████████▌ | 316288/371472 [2:59:45<4:20:37,  3.53it/s]
 85%|████████▌ | 316289/371472 [2:59:45<4:41:57,  3.26it/s]
 85%|████████▌ | 316290/371472 [2:59:46<4:46:04,  3.21it/s]
 85%|████████▌ | 316291/371472 [2:59:46<4:44:09,  3.24it/s]
 85%|████████▌ | 316292/371472 [2:59:46<4:36:54,  3.32it/s]
 85%|████████▌ | 316293/371472 [2:59:46<4:35:45,  3.34it/s]
 85%|████████▌ | 316294/371472 [2:59:47<4:38:00,  3.31it/s]
 85%|████████▌ | 316295/371472 [2:59:47<4:22:41,  3.50it/s]
 85%|████████▌ | 316296/371472 [2:59:47<4:17:54,  3.57it/s]
 85%|████████▌ | 316297/371472 [2:59:48<4:24:57,  3.47it/s]
 85%|████████▌ | 316298/371472 [2:59:48<4:14:32,  3.61it/s]
 85%|████████▌ | 316299/371472 [2:59:48<4:07:30,  3.72it/s]
 85%|████████▌ | 316300/371472 [2:59:48<4:32:23,  3.38it/s]
                                                           
{'loss': 2.7663, 'learning_rate': 2.3374237755607747e-07, 'epoch': 13.62}

 85%|████████▌ | 316300/371472 [2:59:48<4:32:23,  3.38it/s]
 85%|████████▌ | 316301/371472 [2:59:49<4:28:52,  3.42it/s]
 85%|████████▌ | 316302/371472 [2:59:49<4:17:45,  3.57it/s]
 85%|████████▌ | 316303/371472 [2:59:49<4:15:21,  3.60it/s]
 85%|████████▌ | 316304/371472 [2:59:50<4:11:53,  3.65it/s]
 85%|████████▌ | 316305/371472 [2:59:50<4:12:07,  3.65it/s]
 85%|████████▌ | 316306/371472 [2:59:50<4:24:34,  3.48it/s]
 85%|████████▌ | 316307/371472 [2:59:50<4:17:27,  3.57it/s]
 85%|████████▌ | 316308/371472 [2:59:51<4:17:56,  3.56it/s]
 85%|████████▌ | 316309/371472 [2:59:51<4:24:02,  3.48it/s]
 85%|████████▌ | 316310/371472 [2:59:51<4:37:21,  3.31it/s]
 85%|████████▌ | 316311/371472 [2:59:52<4:36:26,  3.33it/s]
 85%|████████▌ | 316312/371472 [2:59:52<4:33:12,  3.36it/s]
 85%|████████▌ | 316313/371472 [2:59:52<4:31:51,  3.38it/s]
 85%|████████▌ | 316314/371472 [2:59:52<4:20:15,  3.53it/s]
 85%|████████▌ | 316315/371472 [2:59:53<4:14:43,  3.61it/s]
 85%|████████▌ | 316316/371472 [2:59:53<4:24:28,  3.48it/s]
 85%|████████▌ | 316317/371472 [2:59:53<4:21:42,  3.51it/s]
 85%|████████▌ | 316318/371472 [2:59:54<4:12:25,  3.64it/s]
 85%|████████▌ | 316319/371472 [2:59:54<4:09:55,  3.68it/s]
 85%|████████▌ | 316320/371472 [2:59:54<4:12:13,  3.64it/s]
                                                           
{'loss': 2.6365, 'learning_rate': 2.3369389558059862e-07, 'epoch': 13.62}

 85%|████████▌ | 316320/371472 [2:59:54<4:12:13,  3.64it/s]
 85%|████████▌ | 316321/371472 [2:59:54<4:01:57,  3.80it/s]
 85%|████████▌ | 316322/371472 [2:59:55<4:11:30,  3.65it/s]
 85%|████████▌ | 316323/371472 [2:59:55<4:07:52,  3.71it/s]
 85%|████████▌ | 316324/371472 [2:59:55<4:07:13,  3.72it/s]
 85%|████████▌ | 316325/371472 [2:59:55<4:01:06,  3.81it/s]
 85%|████████▌ | 316326/371472 [2:59:56<4:10:16,  3.67it/s]
 85%|████████▌ | 316327/371472 [2:59:56<4:13:07,  3.63it/s]
 85%|████████▌ | 316328/371472 [2:59:56<4:18:50,  3.55it/s]
 85%|████████▌ | 316329/371472 [2:59:57<4:26:44,  3.45it/s]
 85%|████████▌ | 316330/371472 [2:59:57<4:18:23,  3.56it/s]
 85%|████████▌ | 316331/371472 [2:59:57<4:16:16,  3.59it/s]
 85%|████████▌ | 316332/371472 [2:59:57<4:15:38,  3.59it/s]
 85%|████████▌ | 316333/371472 [2:59:58<4:14:56,  3.60it/s]
 85%|████████▌ | 316334/371472 [2:59:58<4:23:52,  3.48it/s]
 85%|████████▌ | 316335/371472 [2:59:58<4:33:18,  3.36it/s]
 85%|████████▌ | 316336/371472 [2:59:59<4:35:28,  3.34it/s]
 85%|████████▌ | 316337/371472 [2:59:59<4:32:00,  3.38it/s]
 85%|████████▌ | 316338/371472 [2:59:59<4:19:44,  3.54it/s]
 85%|████████▌ | 316339/371472 [2:59:59<4:12:01,  3.65it/s]
 85%|████████▌ | 316340/371472 [3:00:00<4:12:07,  3.64it/s]
                                                           
{'loss': 2.4983, 'learning_rate': 2.336454136051197e-07, 'epoch': 13.63}

 85%|████████▌ | 316340/371472 [3:00:00<4:12:07,  3.64it/s]
 85%|████████▌ | 316341/371472 [3:00:00<4:13:47,  3.62it/s]
 85%|████████▌ | 316342/371472 [3:00:00<4:15:02,  3.60it/s]
 85%|████████▌ | 316343/371472 [3:00:01<4:16:59,  3.58it/s]
 85%|████████▌ | 316344/371472 [3:00:01<4:15:10,  3.60it/s]
 85%|████████▌ | 316345/371472 [3:00:01<4:52:45,  3.14it/s]
 85%|████████▌ | 316346/371472 [3:00:01<4:45:20,  3.22it/s]
 85%|████████▌ | 316347/371472 [3:00:02<4:52:18,  3.14it/s]
 85%|████████▌ | 316348/371472 [3:00:02<4:44:14,  3.23it/s]
 85%|████████▌ | 316349/371472 [3:00:02<4:27:38,  3.43it/s]
 85%|████████▌ | 316350/371472 [3:00:03<4:17:05,  3.57it/s]
 85%|████████▌ | 316351/371472 [3:00:03<4:08:10,  3.70it/s]
 85%|████████▌ | 316352/371472 [3:00:03<4:06:47,  3.72it/s]
 85%|████████▌ | 316353/371472 [3:00:03<4:26:09,  3.45it/s]
 85%|████████▌ | 316354/371472 [3:00:04<4:20:38,  3.52it/s]
 85%|████████▌ | 316355/371472 [3:00:04<4:14:11,  3.61it/s]
 85%|████████▌ | 316356/371472 [3:00:04<4:12:19,  3.64it/s]
 85%|████████▌ | 316357/371472 [3:00:05<4:23:40,  3.48it/s]
 85%|████████▌ | 316358/371472 [3:00:05<4:30:11,  3.40it/s]
 85%|████████▌ | 316359/371472 [3:00:05<4:25:07,  3.46it/s]
 85%|████████▌ | 316360/371472 [3:00:05<4:27:49,  3.43it/s]
                                                           
{'loss': 2.6188, 'learning_rate': 2.3359693162964084e-07, 'epoch': 13.63}

 85%|████████▌ | 316360/371472 [3:00:05<4:27:49,  3.43it/s]
 85%|████████▌ | 316361/371472 [3:00:06<4:20:57,  3.52it/s]
 85%|████████▌ | 316362/371472 [3:00:06<4:28:30,  3.42it/s]
 85%|████████▌ | 316363/371472 [3:00:06<4:29:18,  3.41it/s]
 85%|████████▌ | 316364/371472 [3:00:07<4:24:36,  3.47it/s]
 85%|████████▌ | 316365/371472 [3:00:07<4:27:46,  3.43it/s]
 85%|████████▌ | 316366/371472 [3:00:07<4:20:28,  3.53it/s]
 85%|████████▌ | 316367/371472 [3:00:07<4:09:02,  3.69it/s]
 85%|████████▌ | 316368/371472 [3:00:08<4:09:21,  3.68it/s]
 85%|████████▌ | 316369/371472 [3:00:08<4:03:32,  3.77it/s]
 85%|████████▌ | 316370/371472 [3:00:08<4:12:48,  3.63it/s]
 85%|████████▌ | 316371/371472 [3:00:08<4:07:04,  3.72it/s]
 85%|████████▌ | 316372/371472 [3:00:09<4:02:35,  3.79it/s]
 85%|████████▌ | 316373/371472 [3:00:09<4:04:08,  3.76it/s]
 85%|████████▌ | 316374/371472 [3:00:09<4:07:53,  3.70it/s]
 85%|████████▌ | 316375/371472 [3:00:10<4:03:28,  3.77it/s]
 85%|████████▌ | 316376/371472 [3:00:10<4:10:14,  3.67it/s]
 85%|████████▌ | 316377/371472 [3:00:10<4:15:31,  3.59it/s]
 85%|████████▌ | 316378/371472 [3:00:10<4:19:44,  3.54it/s]
 85%|████████▌ | 316379/371472 [3:00:11<4:11:52,  3.65it/s]
 85%|████████▌ | 316380/371472 [3:00:11<4:17:36,  3.56it/s]
                                                           
{'loss': 2.627, 'learning_rate': 2.335484496541619e-07, 'epoch': 13.63}

 85%|████████▌ | 316380/371472 [3:00:11<4:17:36,  3.56it/s]
 85%|████████▌ | 316381/371472 [3:00:11<4:20:07,  3.53it/s]
 85%|████████▌ | 316382/371472 [3:00:12<4:34:40,  3.34it/s]
 85%|████████▌ | 316383/371472 [3:00:12<4:20:29,  3.52it/s]
 85%|████████▌ | 316384/371472 [3:00:12<4:15:47,  3.59it/s]
 85%|████████▌ | 316385/371472 [3:00:12<4:24:17,  3.47it/s]
 85%|████████▌ | 316386/371472 [3:00:13<4:23:44,  3.48it/s]
 85%|████████▌ | 316387/371472 [3:00:13<4:48:24,  3.18it/s]
 85%|████████▌ | 316388/371472 [3:00:13<4:38:58,  3.29it/s]
 85%|████████▌ | 316389/371472 [3:00:14<4:35:45,  3.33it/s]
 85%|████████▌ | 316390/371472 [3:00:14<4:32:21,  3.37it/s]
 85%|████████▌ | 316391/371472 [3:00:14<4:25:55,  3.45it/s]
 85%|████████▌ | 316392/371472 [3:00:15<4:31:02,  3.39it/s]
 85%|████████▌ | 316393/371472 [3:00:15<4:17:02,  3.57it/s]
 85%|████████▌ | 316394/371472 [3:00:15<4:19:08,  3.54it/s]
 85%|████████▌ | 316395/371472 [3:00:15<4:20:05,  3.53it/s]
 85%|████████▌ | 316396/371472 [3:00:16<4:16:11,  3.58it/s]
 85%|████████▌ | 316397/371472 [3:00:16<4:12:21,  3.64it/s]
 85%|████████▌ | 316398/371472 [3:00:16<4:11:12,  3.65it/s]
 85%|████████▌ | 316399/371472 [3:00:17<4:39:56,  3.28it/s]
 85%|████████▌ | 316400/371472 [3:00:17<4:40:53,  3.27it/s]
                                                           
{'loss': 2.6724, 'learning_rate': 2.3349996767868306e-07, 'epoch': 13.63}

 85%|████████▌ | 316400/371472 [3:00:17<4:40:53,  3.27it/s]
 85%|████████▌ | 316401/371472 [3:00:17<4:40:32,  3.27it/s]
 85%|████████▌ | 316402/371472 [3:00:17<4:26:38,  3.44it/s]
 85%|████████▌ | 316403/371472 [3:00:18<4:57:50,  3.08it/s]
 85%|████████▌ | 316404/371472 [3:00:18<4:37:31,  3.31it/s]
 85%|████████▌ | 316405/371472 [3:00:18<4:18:19,  3.55it/s]
 85%|████████▌ | 316406/371472 [3:00:19<4:10:27,  3.66it/s]
 85%|████████▌ | 316407/371472 [3:00:19<4:21:35,  3.51it/s]
 85%|████████▌ | 316408/371472 [3:00:19<4:22:22,  3.50it/s]
 85%|████████▌ | 316409/371472 [3:00:19<4:21:16,  3.51it/s]
 85%|████████▌ | 316410/371472 [3:00:20<4:14:28,  3.61it/s]
 85%|████████▌ | 316411/371472 [3:00:20<4:45:57,  3.21it/s]
 85%|████████▌ | 316412/371472 [3:00:20<4:29:08,  3.41it/s]
 85%|████████▌ | 316413/371472 [3:00:21<4:17:02,  3.57it/s]
 85%|████████▌ | 316414/371472 [3:00:21<4:13:44,  3.62it/s]
 85%|████████▌ | 316415/371472 [3:00:21<4:07:55,  3.70it/s]
 85%|████████▌ | 316416/371472 [3:00:21<4:00:30,  3.82it/s]
 85%|████████▌ | 316417/371472 [3:00:22<4:18:38,  3.55it/s]
 85%|████████▌ | 316418/371472 [3:00:22<4:10:33,  3.66it/s]
 85%|████████▌ | 316419/371472 [3:00:22<4:09:16,  3.68it/s]
 85%|████████▌ | 316420/371472 [3:00:22<4:10:38,  3.66it/s]
                                                           
{'loss': 2.5563, 'learning_rate': 2.334514857032041e-07, 'epoch': 13.63}

 85%|████████▌ | 316420/371472 [3:00:22<4:10:38,  3.66it/s]
 85%|████████▌ | 316421/371472 [3:00:23<4:00:55,  3.81it/s]
 85%|████████▌ | 316422/371472 [3:00:23<4:11:43,  3.64it/s]
 85%|████████▌ | 316423/371472 [3:00:23<4:11:27,  3.65it/s]
 85%|████████▌ | 316424/371472 [3:00:24<4:18:51,  3.54it/s]
 85%|████████▌ | 316425/371472 [3:00:24<4:20:43,  3.52it/s]
 85%|████████▌ | 316426/371472 [3:00:24<4:26:16,  3.45it/s]
 85%|████████▌ | 316427/371472 [3:00:24<4:33:28,  3.35it/s]
 85%|████████▌ | 316428/371472 [3:00:25<5:21:50,  2.85it/s]
 85%|████████▌ | 316429/371472 [3:00:25<5:00:54,  3.05it/s]
 85%|████████▌ | 316430/371472 [3:00:26<5:10:38,  2.95it/s]
 85%|████████▌ | 316431/371472 [3:00:26<4:50:20,  3.16it/s]
 85%|████████▌ | 316432/371472 [3:00:26<4:37:28,  3.31it/s]
 85%|████████▌ | 316433/371472 [3:00:26<4:33:35,  3.35it/s]
 85%|████████▌ | 316434/371472 [3:00:27<4:29:08,  3.41it/s]
 85%|████████▌ | 316435/371472 [3:00:27<4:19:00,  3.54it/s]
 85%|████████▌ | 316436/371472 [3:00:27<4:31:48,  3.37it/s]
 85%|████████▌ | 316437/371472 [3:00:28<4:26:56,  3.44it/s]
 85%|████████▌ | 316438/371472 [3:00:28<4:37:05,  3.31it/s]
 85%|████████▌ | 316439/371472 [3:00:28<4:27:54,  3.42it/s]
 85%|████████▌ | 316440/371472 [3:00:28<4:26:26,  3.44it/s]
                                                           
{'loss': 2.6905, 'learning_rate': 2.3340300372772518e-07, 'epoch': 13.63}

 85%|████████▌ | 316440/371472 [3:00:28<4:26:26,  3.44it/s]
 85%|████████▌ | 316441/371472 [3:00:29<4:21:53,  3.50it/s]
 85%|████████▌ | 316442/371472 [3:00:29<4:21:51,  3.50it/s]
 85%|████████▌ | 316443/371472 [3:00:29<4:15:59,  3.58it/s]
 85%|████████▌ | 316444/371472 [3:00:30<4:16:33,  3.57it/s]
 85%|████████▌ | 316445/371472 [3:00:30<4:09:32,  3.68it/s]
 85%|████████▌ | 316446/371472 [3:00:30<4:19:54,  3.53it/s]
 85%|████████▌ | 316447/371472 [3:00:30<4:11:32,  3.65it/s]
 85%|████████▌ | 316448/371472 [3:00:31<4:07:56,  3.70it/s]
 85%|████████▌ | 316449/371472 [3:00:31<4:00:47,  3.81it/s]
 85%|████████▌ | 316450/371472 [3:00:31<4:09:32,  3.67it/s]
 85%|████████▌ | 316451/371472 [3:00:31<4:16:17,  3.58it/s]
 85%|████████▌ | 316452/371472 [3:00:32<4:17:24,  3.56it/s]
 85%|████████▌ | 316453/371472 [3:00:32<4:20:19,  3.52it/s]
 85%|████████▌ | 316454/371472 [3:00:32<4:13:11,  3.62it/s]
 85%|████████▌ | 316455/371472 [3:00:33<4:07:21,  3.71it/s]
 85%|████████▌ | 316456/371472 [3:00:33<4:07:33,  3.70it/s]
 85%|████████▌ | 316457/371472 [3:00:33<4:11:30,  3.65it/s]
 85%|████████▌ | 316458/371472 [3:00:33<4:05:41,  3.73it/s]
 85%|████████▌ | 316459/371472 [3:00:34<4:05:39,  3.73it/s]
 85%|████████▌ | 316460/371472 [3:00:34<4:12:36,  3.63it/s]
                                                           
{'loss': 2.6448, 'learning_rate': 2.3335452175224633e-07, 'epoch': 13.63}

 85%|████████▌ | 316460/371472 [3:00:34<4:12:36,  3.63it/s]
 85%|████████▌ | 316461/371472 [3:00:34<4:12:10,  3.64it/s]
 85%|████████▌ | 316462/371472 [3:00:34<4:12:27,  3.63it/s]
 85%|████████▌ | 316463/371472 [3:00:35<4:15:00,  3.60it/s]
 85%|████████▌ | 316464/371472 [3:00:35<4:17:51,  3.56it/s]
 85%|████████▌ | 316465/371472 [3:00:35<4:29:16,  3.40it/s]
 85%|████████▌ | 316466/371472 [3:00:36<4:28:03,  3.42it/s]
 85%|████████▌ | 316467/371472 [3:00:36<4:38:35,  3.29it/s]
 85%|████████▌ | 316468/371472 [3:00:36<4:47:45,  3.19it/s]
 85%|████████▌ | 316469/371472 [3:00:37<4:32:01,  3.37it/s]
 85%|████████▌ | 316470/371472 [3:00:37<5:16:12,  2.90it/s]
 85%|████████▌ | 316471/371472 [3:00:37<5:12:06,  2.94it/s]
 85%|████████▌ | 316472/371472 [3:00:38<5:15:17,  2.91it/s]
 85%|████████▌ | 316473/371472 [3:00:38<4:57:49,  3.08it/s]
 85%|████████▌ | 316474/371472 [3:00:38<4:43:24,  3.23it/s]
 85%|████████▌ | 316475/371472 [3:00:39<4:33:25,  3.35it/s]
 85%|████████▌ | 316476/371472 [3:00:39<4:27:17,  3.43it/s]
 85%|████████▌ | 316477/371472 [3:00:39<4:40:52,  3.26it/s]
 85%|████████▌ | 316478/371472 [3:00:39<4:25:18,  3.45it/s]
 85%|████████▌ | 316479/371472 [3:00:40<4:56:30,  3.09it/s]
 85%|████████▌ | 316480/371472 [3:00:40<4:51:55,  3.14it/s]
                                                           
{'loss': 2.6148, 'learning_rate': 2.3330603977676738e-07, 'epoch': 13.63}

 85%|████████▌ | 316480/371472 [3:00:40<4:51:55,  3.14it/s]
 85%|████████▌ | 316481/371472 [3:00:40<4:51:58,  3.14it/s]
 85%|████████▌ | 316482/371472 [3:00:41<4:38:15,  3.29it/s]
 85%|████████▌ | 316483/371472 [3:00:41<4:29:21,  3.40it/s]
 85%|████████▌ | 316484/371472 [3:00:41<4:28:51,  3.41it/s]
 85%|████████▌ | 316485/371472 [3:00:42<4:24:57,  3.46it/s]
 85%|████████▌ | 316486/371472 [3:00:42<4:27:50,  3.42it/s]
 85%|████████▌ | 316487/371472 [3:00:42<4:19:25,  3.53it/s]
 85%|████████▌ | 316488/371472 [3:00:42<4:26:55,  3.43it/s]
 85%|████████▌ | 316489/371472 [3:00:43<4:57:51,  3.08it/s]
 85%|████████▌ | 316490/371472 [3:00:43<4:41:06,  3.26it/s]
 85%|████████▌ | 316491/371472 [3:00:43<4:27:36,  3.42it/s]
 85%|████████▌ | 316492/371472 [3:00:44<4:38:07,  3.29it/s]
 85%|████████▌ | 316493/371472 [3:00:44<4:55:53,  3.10it/s]
 85%|████████▌ | 316494/371472 [3:00:44<4:41:12,  3.26it/s]
 85%|████████▌ | 316495/371472 [3:00:45<4:21:10,  3.51it/s]
 85%|████████▌ | 316496/371472 [3:00:45<4:24:38,  3.46it/s]
 85%|████████▌ | 316497/371472 [3:00:45<4:32:00,  3.37it/s]
 85%|████████▌ | 316498/371472 [3:00:45<4:22:27,  3.49it/s]
 85%|████████▌ | 316499/371472 [3:00:46<4:25:20,  3.45it/s]
 85%|████████▌ | 316500/371472 [3:00:46<4:13:27,  3.61it/s]
                                                           
{'loss': 2.5684, 'learning_rate': 2.3325755780128855e-07, 'epoch': 13.63}

 85%|████████▌ | 316500/371472 [3:00:46<4:13:27,  3.61it/s]
 85%|████████▌ | 316501/371472 [3:00:46<4:17:51,  3.55it/s]
 85%|████████▌ | 316502/371472 [3:00:47<4:12:10,  3.63it/s]
 85%|████████▌ | 316503/371472 [3:00:47<4:01:57,  3.79it/s]
 85%|████████▌ | 316504/371472 [3:00:47<4:05:19,  3.73it/s]
 85%|████████▌ | 316505/371472 [3:00:47<4:06:41,  3.71it/s]
 85%|████████▌ | 316506/371472 [3:00:48<4:18:00,  3.55it/s]
 85%|████████▌ | 316507/371472 [3:00:48<4:27:10,  3.43it/s]
 85%|████████▌ | 316508/371472 [3:00:48<4:19:33,  3.53it/s]
 85%|████████▌ | 316509/371472 [3:00:48<4:17:13,  3.56it/s]
 85%|████████▌ | 316510/371472 [3:00:49<4:12:43,  3.62it/s]
 85%|████████▌ | 316511/371472 [3:00:49<4:22:18,  3.49it/s]
 85%|████████▌ | 316512/371472 [3:00:49<4:16:43,  3.57it/s]
 85%|████████▌ | 316513/371472 [3:00:50<4:22:18,  3.49it/s]
 85%|████████▌ | 316514/371472 [3:00:50<4:10:46,  3.65it/s]
 85%|████████▌ | 316515/371472 [3:00:50<4:04:14,  3.75it/s]
 85%|████████▌ | 316516/371472 [3:00:50<3:59:47,  3.82it/s]
 85%|████████▌ | 316517/371472 [3:00:51<3:50:24,  3.98it/s]
 85%|████████▌ | 316518/371472 [3:00:51<3:54:18,  3.91it/s]
 85%|████████▌ | 316519/371472 [3:00:51<3:52:29,  3.94it/s]
 85%|████████▌ | 316520/371472 [3:00:51<3:55:10,  3.89it/s]
                                                           
{'loss': 2.8535, 'learning_rate': 2.332090758258096e-07, 'epoch': 13.63}

 85%|████████▌ | 316520/371472 [3:00:51<3:55:10,  3.89it/s]
 85%|████████▌ | 316521/371472 [3:00:52<3:53:40,  3.92it/s]
 85%|████████▌ | 316522/371472 [3:00:52<3:58:13,  3.84it/s]
 85%|████████▌ | 316523/371472 [3:00:52<3:56:12,  3.88it/s]
 85%|████████▌ | 316524/371472 [3:00:52<4:14:33,  3.60it/s]
 85%|████████▌ | 316525/371472 [3:00:53<4:08:26,  3.69it/s]
 85%|████████▌ | 316526/371472 [3:00:53<4:01:15,  3.80it/s]
 85%|████████▌ | 316527/371472 [3:00:53<3:58:45,  3.84it/s]
 85%|████████▌ | 316528/371472 [3:00:54<4:06:20,  3.72it/s]
 85%|████████▌ | 316529/371472 [3:00:54<4:06:34,  3.71it/s]
 85%|████████▌ | 316530/371472 [3:00:54<4:01:02,  3.80it/s]
 85%|████████▌ | 316531/371472 [3:00:54<4:08:36,  3.68it/s]
 85%|████████▌ | 316532/371472 [3:00:55<3:59:05,  3.83it/s]
 85%|████████▌ | 316533/371472 [3:00:55<4:18:49,  3.54it/s]
 85%|████████▌ | 316534/371472 [3:00:55<4:28:35,  3.41it/s]
 85%|████████▌ | 316535/371472 [3:00:56<4:39:23,  3.28it/s]
 85%|████████▌ | 316536/371472 [3:00:56<4:30:23,  3.39it/s]
 85%|████████▌ | 316537/371472 [3:00:56<4:31:24,  3.37it/s]
 85%|████████▌ | 316538/371472 [3:00:56<4:36:59,  3.31it/s]
 85%|████████▌ | 316539/371472 [3:00:57<4:29:08,  3.40it/s]
 85%|████████▌ | 316540/371472 [3:00:57<4:27:17,  3.43it/s]
                                                           
{'loss': 2.6163, 'learning_rate': 2.3316059385033075e-07, 'epoch': 13.63}

 85%|████████▌ | 316540/371472 [3:00:57<4:27:17,  3.43it/s]
 85%|████████▌ | 316541/371472 [3:00:57<4:23:10,  3.48it/s]
 85%|████████▌ | 316542/371472 [3:00:58<4:16:36,  3.57it/s]
 85%|████████▌ | 316543/371472 [3:00:58<4:26:25,  3.44it/s]
 85%|████████▌ | 316544/371472 [3:00:58<4:22:14,  3.49it/s]
 85%|████████▌ | 316545/371472 [3:00:58<4:25:26,  3.45it/s]
 85%|████████▌ | 316546/371472 [3:00:59<4:22:18,  3.49it/s]
 85%|████████▌ | 316547/371472 [3:00:59<4:13:43,  3.61it/s]
 85%|████████▌ | 316548/371472 [3:00:59<4:10:12,  3.66it/s]
 85%|████████▌ | 316549/371472 [3:01:00<4:11:51,  3.63it/s]
 85%|████████▌ | 316550/371472 [3:01:00<4:15:14,  3.59it/s]
 85%|████████▌ | 316551/371472 [3:01:00<4:13:28,  3.61it/s]
 85%|████████▌ | 316552/371472 [3:01:00<4:07:25,  3.70it/s]
 85%|████████▌ | 316553/371472 [3:01:01<4:00:04,  3.81it/s]
 85%|████████▌ | 316554/371472 [3:01:01<4:05:09,  3.73it/s]
 85%|████████▌ | 316555/371472 [3:01:01<4:02:22,  3.78it/s]
 85%|████████▌ | 316556/371472 [3:01:01<4:03:32,  3.76it/s]
 85%|████████▌ | 316557/371472 [3:01:02<4:04:53,  3.74it/s]
 85%|████████▌ | 316558/371472 [3:01:02<4:11:38,  3.64it/s]
 85%|████████▌ | 316559/371472 [3:01:02<4:22:04,  3.49it/s]
 85%|████████▌ | 316560/371472 [3:01:02<4:10:33,  3.65it/s]
                                                           
{'loss': 2.5554, 'learning_rate': 2.3311211187485182e-07, 'epoch': 13.63}

 85%|████████▌ | 316560/371472 [3:01:02<4:10:33,  3.65it/s]
 85%|████████▌ | 316561/371472 [3:01:03<4:38:07,  3.29it/s]
 85%|████████▌ | 316562/371472 [3:01:03<4:22:24,  3.49it/s]
 85%|████████▌ | 316563/371472 [3:01:03<4:24:10,  3.46it/s]
 85%|████████▌ | 316564/371472 [3:01:04<4:15:55,  3.58it/s]
 85%|████████▌ | 316565/371472 [3:01:04<4:12:05,  3.63it/s]
 85%|████████▌ | 316566/371472 [3:01:04<4:17:40,  3.55it/s]
 85%|████████▌ | 316567/371472 [3:01:04<4:10:09,  3.66it/s]
 85%|████████▌ | 316568/371472 [3:01:05<4:08:25,  3.68it/s]
 85%|████████▌ | 316569/371472 [3:01:05<4:05:16,  3.73it/s]
 85%|████████▌ | 316570/371472 [3:01:05<4:05:02,  3.73it/s]
 85%|████████▌ | 316571/371472 [3:01:06<4:02:05,  3.78it/s]
 85%|████████▌ | 316572/371472 [3:01:06<4:06:45,  3.71it/s]
 85%|████████▌ | 316573/371472 [3:01:06<4:25:30,  3.45it/s]
 85%|████████▌ | 316574/371472 [3:01:06<4:23:02,  3.48it/s]
 85%|████████▌ | 316575/371472 [3:01:07<4:09:16,  3.67it/s]
 85%|████████▌ | 316576/371472 [3:01:07<4:14:54,  3.59it/s]
 85%|████████▌ | 316577/371472 [3:01:07<4:02:56,  3.77it/s]
 85%|████████▌ | 316578/371472 [3:01:07<4:00:39,  3.80it/s]
 85%|████████▌ | 316579/371472 [3:01:08<3:59:19,  3.82it/s]
 85%|████████▌ | 316580/371472 [3:01:08<4:04:57,  3.73it/s]
                                                           
{'loss': 2.6172, 'learning_rate': 2.3306362989937297e-07, 'epoch': 13.64}

 85%|████████▌ | 316580/371472 [3:01:08<4:04:57,  3.73it/s]
 85%|████████▌ | 316581/371472 [3:01:08<3:58:03,  3.84it/s]
 85%|████████▌ | 316582/371472 [3:01:09<4:06:47,  3.71it/s]
 85%|████████▌ | 316583/371472 [3:01:09<4:10:13,  3.66it/s]
 85%|████████▌ | 316584/371472 [3:01:09<4:12:10,  3.63it/s]
 85%|████████▌ | 316585/371472 [3:01:09<4:22:05,  3.49it/s]
 85%|████████▌ | 316586/371472 [3:01:10<4:21:44,  3.49it/s]
 85%|████████▌ | 316587/371472 [3:01:10<4:24:40,  3.46it/s]
 85%|████████▌ | 316588/371472 [3:01:10<4:16:57,  3.56it/s]
 85%|████████▌ | 316589/371472 [3:01:11<4:25:48,  3.44it/s]
 85%|████████▌ | 316590/371472 [3:01:11<4:16:56,  3.56it/s]
 85%|████████▌ | 316591/371472 [3:01:11<4:13:37,  3.61it/s]
 85%|████████▌ | 316592/371472 [3:01:11<4:12:47,  3.62it/s]
 85%|████████▌ | 316593/371472 [3:01:12<4:07:55,  3.69it/s]
 85%|████████▌ | 316594/371472 [3:01:12<4:07:32,  3.69it/s]
 85%|████████▌ | 316595/371472 [3:01:12<4:02:33,  3.77it/s]
 85%|████████▌ | 316596/371472 [3:01:12<4:11:00,  3.64it/s]
 85%|████████▌ | 316597/371472 [3:01:13<4:10:09,  3.66it/s]
 85%|████████▌ | 316598/371472 [3:01:13<4:07:14,  3.70it/s]
 85%|████████▌ | 316599/371472 [3:01:13<4:04:13,  3.74it/s]
 85%|████████▌ | 316600/371472 [3:01:14<4:15:13,  3.58it/s]
                                                           
{'loss': 2.4438, 'learning_rate': 2.3301514792389402e-07, 'epoch': 13.64}

 85%|████████▌ | 316600/371472 [3:01:14<4:15:13,  3.58it/s]
 85%|████████▌ | 316601/371472 [3:01:14<4:06:25,  3.71it/s]
 85%|████████▌ | 316602/371472 [3:01:14<4:10:48,  3.65it/s]
 85%|████████▌ | 316603/371472 [3:01:14<4:04:56,  3.73it/s]
 85%|████████▌ | 316604/371472 [3:01:15<4:10:43,  3.65it/s]
 85%|████████▌ | 316605/371472 [3:01:15<4:13:32,  3.61it/s]
 85%|████████▌ | 316606/371472 [3:01:15<4:06:32,  3.71it/s]
 85%|████████▌ | 316607/371472 [3:01:15<4:12:54,  3.62it/s]
 85%|████████▌ | 316608/371472 [3:01:16<4:13:46,  3.60it/s]
 85%|████████▌ | 316609/371472 [3:01:16<4:16:23,  3.57it/s]
 85%|████████▌ | 316610/371472 [3:01:16<4:27:45,  3.41it/s]
 85%|████████▌ | 316611/371472 [3:01:17<4:18:03,  3.54it/s]
 85%|████████▌ | 316612/371472 [3:01:17<4:19:42,  3.52it/s]
 85%|████████▌ | 316613/371472 [3:01:17<4:21:41,  3.49it/s]
 85%|████████▌ | 316614/371472 [3:01:17<4:15:32,  3.58it/s]
 85%|████████▌ | 316615/371472 [3:01:18<4:11:56,  3.63it/s]
 85%|████████▌ | 316616/371472 [3:01:18<4:05:46,  3.72it/s]
 85%|████████▌ | 316617/371472 [3:01:18<3:59:28,  3.82it/s]
 85%|████████▌ | 316618/371472 [3:01:18<4:05:27,  3.72it/s]
 85%|████████▌ | 316619/371472 [3:01:19<4:04:14,  3.74it/s]
 85%|████████▌ | 316620/371472 [3:01:19<4:04:46,  3.73it/s]
                                                           
{'loss': 2.6679, 'learning_rate': 2.329666659484152e-07, 'epoch': 13.64}

 85%|████████▌ | 316620/371472 [3:01:19<4:04:46,  3.73it/s]
 85%|████████▌ | 316621/371472 [3:01:19<4:03:03,  3.76it/s]
 85%|████████▌ | 316622/371472 [3:01:20<4:03:49,  3.75it/s]
 85%|████████▌ | 316623/371472 [3:01:20<4:57:58,  3.07it/s]
 85%|████████▌ | 316624/371472 [3:01:20<4:45:02,  3.21it/s]
 85%|████████▌ | 316625/371472 [3:01:21<4:30:44,  3.38it/s]
 85%|████████▌ | 316626/371472 [3:01:21<4:20:27,  3.51it/s]
 85%|████████▌ | 316627/371472 [3:01:21<4:12:45,  3.62it/s]
 85%|████████▌ | 316628/371472 [3:01:21<4:09:26,  3.66it/s]
 85%|████████▌ | 316629/371472 [3:01:22<4:07:21,  3.70it/s]
 85%|████████▌ | 316630/371472 [3:01:22<4:16:55,  3.56it/s]
 85%|████████▌ | 316631/371472 [3:01:22<4:22:24,  3.48it/s]
 85%|████████▌ | 316632/371472 [3:01:22<4:22:40,  3.48it/s]
 85%|████████▌ | 316633/371472 [3:01:23<4:13:50,  3.60it/s]
 85%|████████▌ | 316634/371472 [3:01:23<4:16:54,  3.56it/s]
 85%|████████▌ | 316635/371472 [3:01:23<4:24:02,  3.46it/s]
 85%|████████▌ | 316636/371472 [3:01:24<4:15:31,  3.58it/s]
 85%|████████▌ | 316637/371472 [3:01:24<4:13:25,  3.61it/s]
 85%|████████▌ | 316638/371472 [3:01:24<4:12:26,  3.62it/s]
 85%|████████▌ | 316639/371472 [3:01:24<4:16:09,  3.57it/s]
 85%|████████▌ | 316640/371472 [3:01:25<4:26:32,  3.43it/s]
                                                           
{'loss': 2.6042, 'learning_rate': 2.3291818397293624e-07, 'epoch': 13.64}

 85%|████████▌ | 316640/371472 [3:01:25<4:26:32,  3.43it/s]
 85%|████████▌ | 316641/371472 [3:01:25<4:21:35,  3.49it/s]
 85%|████████▌ | 316642/371472 [3:01:25<4:23:04,  3.47it/s]
 85%|████████▌ | 316643/371472 [3:01:26<4:13:59,  3.60it/s]
 85%|████████▌ | 316644/371472 [3:01:26<4:24:45,  3.45it/s]
 85%|████████▌ | 316645/371472 [3:01:26<4:37:23,  3.29it/s]
 85%|████████▌ | 316646/371472 [3:01:26<4:23:30,  3.47it/s]
 85%|████████▌ | 316647/371472 [3:01:27<4:25:19,  3.44it/s]
 85%|████████▌ | 316648/371472 [3:01:27<4:40:29,  3.26it/s]
 85%|████████▌ | 316649/371472 [3:01:27<4:30:13,  3.38it/s]
 85%|████████▌ | 316650/371472 [3:01:28<4:22:15,  3.48it/s]
 85%|████████▌ | 316651/371472 [3:01:28<4:22:28,  3.48it/s]
 85%|████████▌ | 316652/371472 [3:01:28<4:24:10,  3.46it/s]
 85%|████████▌ | 316653/371472 [3:01:28<4:15:27,  3.58it/s]
 85%|████████▌ | 316654/371472 [3:01:29<4:05:54,  3.72it/s]
 85%|████████▌ | 316655/371472 [3:01:29<4:06:40,  3.70it/s]
 85%|████████▌ | 316656/371472 [3:01:29<4:04:59,  3.73it/s]
 85%|████████▌ | 316657/371472 [3:01:30<4:20:33,  3.51it/s]
 85%|████████▌ | 316658/371472 [3:01:30<4:35:51,  3.31it/s]
 85%|████████▌ | 316659/371472 [3:01:30<4:34:53,  3.32it/s]
 85%|████████▌ | 316660/371472 [3:01:31<4:33:34,  3.34it/s]
                                                           
{'loss': 2.5169, 'learning_rate': 2.328697019974574e-07, 'epoch': 13.64}

 85%|████████▌ | 316660/371472 [3:01:31<4:33:34,  3.34it/s]
 85%|████████▌ | 316661/371472 [3:01:31<4:17:36,  3.55it/s]
 85%|████████▌ | 316662/371472 [3:01:31<4:15:03,  3.58it/s]
 85%|████████▌ | 316663/371472 [3:01:31<4:15:41,  3.57it/s]
 85%|████████▌ | 316664/371472 [3:01:32<4:35:08,  3.32it/s]
 85%|████████▌ | 316665/371472 [3:01:32<4:58:17,  3.06it/s]
 85%|████████▌ | 316666/371472 [3:01:32<4:50:25,  3.15it/s]
 85%|████████▌ | 316667/371472 [3:01:33<4:50:26,  3.14it/s]
 85%|████████▌ | 316668/371472 [3:01:33<4:35:38,  3.31it/s]
 85%|████████▌ | 316669/371472 [3:01:33<4:24:58,  3.45it/s]
 85%|████████▌ | 316670/371472 [3:01:33<4:14:33,  3.59it/s]
 85%|████████▌ | 316671/371472 [3:01:34<4:11:25,  3.63it/s]
 85%|████████▌ | 316672/371472 [3:01:34<4:01:40,  3.78it/s]
 85%|████████▌ | 316673/371472 [3:01:34<4:09:31,  3.66it/s]
 85%|████████▌ | 316674/371472 [3:01:35<4:12:01,  3.62it/s]
 85%|████████▌ | 316675/371472 [3:01:35<4:08:05,  3.68it/s]
 85%|████████▌ | 316676/371472 [3:01:35<4:00:24,  3.80it/s]
 85%|████████▌ | 316677/371472 [3:01:35<4:06:47,  3.70it/s]
 85%|████████▌ | 316678/371472 [3:01:36<4:04:32,  3.73it/s]
 85%|████████▌ | 316679/371472 [3:01:36<4:04:11,  3.74it/s]
 85%|████████▌ | 316680/371472 [3:01:36<4:11:03,  3.64it/s]
                                                           
{'loss': 2.5609, 'learning_rate': 2.3282122002197846e-07, 'epoch': 13.64}

 85%|████████▌ | 316680/371472 [3:01:36<4:11:03,  3.64it/s]
 85%|████████▌ | 316681/371472 [3:01:37<4:29:31,  3.39it/s]
 85%|████████▌ | 316682/371472 [3:01:37<4:21:34,  3.49it/s]
 85%|████████▌ | 316683/371472 [3:01:37<4:17:15,  3.55it/s]
 85%|████████▌ | 316684/371472 [3:01:37<4:19:40,  3.52it/s]
 85%|████████▌ | 316685/371472 [3:01:38<4:08:17,  3.68it/s]
 85%|████████▌ | 316686/371472 [3:01:38<4:07:46,  3.69it/s]
 85%|████████▌ | 316687/371472 [3:01:38<4:05:57,  3.71it/s]
 85%|████████▌ | 316688/371472 [3:01:38<4:02:07,  3.77it/s]
 85%|████████▌ | 316689/371472 [3:01:39<4:08:15,  3.68it/s]
 85%|████████▌ | 316690/371472 [3:01:39<4:10:05,  3.65it/s]
 85%|████████▌ | 316691/371472 [3:01:39<4:03:31,  3.75it/s]
 85%|████████▌ | 316692/371472 [3:01:39<3:59:48,  3.81it/s]
 85%|████████▌ | 316693/371472 [3:01:40<4:06:43,  3.70it/s]
 85%|████████▌ | 316694/371472 [3:01:40<4:33:01,  3.34it/s]
 85%|████████▌ | 316695/371472 [3:01:40<4:26:47,  3.42it/s]
 85%|████████▌ | 316696/371472 [3:01:41<4:24:24,  3.45it/s]
 85%|████████▌ | 316697/371472 [3:01:41<4:27:44,  3.41it/s]
 85%|████████▌ | 316698/371472 [3:01:41<4:37:33,  3.29it/s]
 85%|████████▌ | 316699/371472 [3:01:42<4:26:01,  3.43it/s]
 85%|████████▌ | 316700/371472 [3:01:42<4:27:49,  3.41it/s]
                                                           
{'loss': 2.6411, 'learning_rate': 2.327727380464996e-07, 'epoch': 13.64}

 85%|████████▌ | 316700/371472 [3:01:42<4:27:49,  3.41it/s]
 85%|████████▌ | 316701/371472 [3:01:42<4:25:11,  3.44it/s]
 85%|████████▌ | 316702/371472 [3:01:42<4:22:37,  3.48it/s]
 85%|████████▌ | 316703/371472 [3:01:43<4:25:20,  3.44it/s]
 85%|████████▌ | 316704/371472 [3:01:43<4:20:23,  3.51it/s]
 85%|████████▌ | 316705/371472 [3:01:43<4:28:44,  3.40it/s]
 85%|████████▌ | 316706/371472 [3:01:44<4:25:53,  3.43it/s]
 85%|████████▌ | 316707/371472 [3:01:44<4:17:17,  3.55it/s]
 85%|████████▌ | 316708/371472 [3:01:44<4:19:02,  3.52it/s]
 85%|████████▌ | 316709/371472 [3:01:44<4:24:14,  3.45it/s]
 85%|████████▌ | 316710/371472 [3:01:45<4:12:02,  3.62it/s]
 85%|████████▌ | 316711/371472 [3:01:45<4:13:39,  3.60it/s]
 85%|████████▌ | 316712/371472 [3:01:45<4:14:41,  3.58it/s]
 85%|████████▌ | 316713/371472 [3:01:45<4:03:14,  3.75it/s]
 85%|████████▌ | 316714/371472 [3:01:46<4:17:27,  3.54it/s]
 85%|████████▌ | 316715/371472 [3:01:46<4:22:05,  3.48it/s]
 85%|████████▌ | 316716/371472 [3:01:46<4:25:18,  3.44it/s]
 85%|████████▌ | 316717/371472 [3:01:47<4:41:47,  3.24it/s]
 85%|████████▌ | 316718/371472 [3:01:47<4:32:38,  3.35it/s]
 85%|████████▌ | 316719/371472 [3:01:47<4:20:26,  3.50it/s]
 85%|████████▌ | 316720/371472 [3:01:48<4:20:31,  3.50it/s]
                                                           
{'loss': 2.5535, 'learning_rate': 2.3272425607102068e-07, 'epoch': 13.64}

 85%|████████▌ | 316720/371472 [3:01:48<4:20:31,  3.50it/s]
 85%|████████▌ | 316721/371472 [3:01:48<4:18:32,  3.53it/s]
 85%|████████▌ | 316722/371472 [3:01:48<4:20:47,  3.50it/s]
 85%|████████▌ | 316723/371472 [3:01:48<4:12:02,  3.62it/s]
 85%|████████▌ | 316724/371472 [3:01:49<4:04:59,  3.72it/s]
 85%|████████▌ | 316725/371472 [3:01:49<4:11:59,  3.62it/s]
 85%|████████▌ | 316726/371472 [3:01:49<4:13:00,  3.61it/s]
 85%|████████▌ | 316727/371472 [3:01:49<4:16:40,  3.55it/s]
 85%|████████▌ | 316728/371472 [3:01:50<4:21:40,  3.49it/s]
 85%|████████▌ | 316729/371472 [3:01:50<4:17:20,  3.55it/s]
 85%|████████▌ | 316730/371472 [3:01:50<4:04:03,  3.74it/s]
 85%|████████▌ | 316731/371472 [3:01:51<3:56:13,  3.86it/s]
 85%|████████▌ | 316732/371472 [3:01:51<4:00:07,  3.80it/s]
 85%|████████▌ | 316733/371472 [3:01:51<4:07:01,  3.69it/s]
 85%|████████▌ | 316734/371472 [3:01:51<4:01:35,  3.78it/s]
 85%|████████▌ | 316735/371472 [3:01:52<4:09:37,  3.65it/s]
 85%|████████▌ | 316736/371472 [3:01:52<4:07:18,  3.69it/s]
 85%|████████▌ | 316737/371472 [3:01:52<4:02:15,  3.77it/s]
 85%|████████▌ | 316738/371472 [3:01:52<4:13:46,  3.59it/s]
 85%|████████▌ | 316739/371472 [3:01:53<4:05:52,  3.71it/s]
 85%|████████▌ | 316740/371472 [3:01:53<4:07:50,  3.68it/s]
                                                           
{'loss': 2.6541, 'learning_rate': 2.3267577409554183e-07, 'epoch': 13.64}

 85%|████████▌ | 316740/371472 [3:01:53<4:07:50,  3.68it/s]
 85%|████████▌ | 316741/371472 [3:01:53<4:05:13,  3.72it/s]
 85%|████████▌ | 316742/371472 [3:01:54<4:06:32,  3.70it/s]
 85%|████████▌ | 316743/371472 [3:01:54<4:19:25,  3.52it/s]
 85%|████████▌ | 316744/371472 [3:01:54<4:22:07,  3.48it/s]
 85%|████████▌ | 316745/371472 [3:01:54<4:11:28,  3.63it/s]
 85%|████████▌ | 316746/371472 [3:01:55<4:10:00,  3.65it/s]
 85%|████████▌ | 316747/371472 [3:01:55<3:58:18,  3.83it/s]
 85%|████████▌ | 316748/371472 [3:01:55<4:01:43,  3.77it/s]
 85%|████████▌ | 316749/371472 [3:01:55<4:00:00,  3.80it/s]
 85%|████████▌ | 316750/371472 [3:01:56<4:08:49,  3.67it/s]
 85%|████████▌ | 316751/371472 [3:01:56<4:04:45,  3.73it/s]
 85%|████████▌ | 316752/371472 [3:01:56<4:10:32,  3.64it/s]
 85%|████████▌ | 316753/371472 [3:01:57<4:24:42,  3.45it/s]
 85%|████████▌ | 316754/371472 [3:01:57<4:16:52,  3.55it/s]
 85%|████████▌ | 316755/371472 [3:01:57<4:23:05,  3.47it/s]
 85%|████████▌ | 316756/371472 [3:01:57<4:12:01,  3.62it/s]
 85%|████████▌ | 316757/371472 [3:01:58<4:06:35,  3.70it/s]
 85%|████████▌ | 316758/371472 [3:01:58<4:19:36,  3.51it/s]
 85%|████████▌ | 316759/371472 [3:01:58<4:12:10,  3.62it/s]
 85%|████████▌ | 316760/371472 [3:01:59<4:11:14,  3.63it/s]
                                                           
{'loss': 2.6037, 'learning_rate': 2.3262729212006288e-07, 'epoch': 13.64}

 85%|████████▌ | 316760/371472 [3:01:59<4:11:14,  3.63it/s]
 85%|████████▌ | 316761/371472 [3:01:59<4:02:09,  3.77it/s]
 85%|████████▌ | 316762/371472 [3:01:59<4:17:52,  3.54it/s]
 85%|████████▌ | 316763/371472 [3:01:59<4:27:47,  3.40it/s]
 85%|████████▌ | 316764/371472 [3:02:00<4:20:06,  3.51it/s]
 85%|████████▌ | 316765/371472 [3:02:00<4:17:40,  3.54it/s]
 85%|████████▌ | 316766/371472 [3:02:00<4:14:50,  3.58it/s]
 85%|████████▌ | 316767/371472 [3:02:01<4:58:36,  3.05it/s]
 85%|████████▌ | 316768/371472 [3:02:01<4:39:08,  3.27it/s]
 85%|████████▌ | 316769/371472 [3:02:01<4:35:35,  3.31it/s]
 85%|████████▌ | 316770/371472 [3:02:01<4:23:57,  3.45it/s]
 85%|████████▌ | 316771/371472 [3:02:02<4:21:27,  3.49it/s]
 85%|████████▌ | 316772/371472 [3:02:02<4:14:08,  3.59it/s]
 85%|████████▌ | 316773/371472 [3:02:02<4:05:55,  3.71it/s]
 85%|████████▌ | 316774/371472 [3:02:03<4:09:08,  3.66it/s]
 85%|████████▌ | 316775/371472 [3:02:03<4:12:20,  3.61it/s]
 85%|████████▌ | 316776/371472 [3:02:03<4:06:55,  3.69it/s]
 85%|████████▌ | 316777/371472 [3:02:03<4:02:32,  3.76it/s]
 85%|████████▌ | 316778/371472 [3:02:04<4:05:33,  3.71it/s]
 85%|████████▌ | 316779/371472 [3:02:04<4:11:07,  3.63it/s]
 85%|████████▌ | 316780/371472 [3:02:04<4:08:03,  3.67it/s]
                                                           
{'loss': 2.7162, 'learning_rate': 2.3257881014458406e-07, 'epoch': 13.64}

 85%|████████▌ | 316780/371472 [3:02:04<4:08:03,  3.67it/s]
 85%|████████▌ | 316781/371472 [3:02:04<4:10:35,  3.64it/s]
 85%|████████▌ | 316782/371472 [3:02:05<4:20:19,  3.50it/s]
 85%|████████▌ | 316783/371472 [3:02:05<4:33:55,  3.33it/s]
 85%|████████▌ | 316784/371472 [3:02:05<4:35:49,  3.30it/s]
 85%|████████▌ | 316785/371472 [3:02:06<4:41:25,  3.24it/s]
 85%|████████▌ | 316786/371472 [3:02:06<4:35:05,  3.31it/s]
 85%|████████▌ | 316787/371472 [3:02:06<4:37:00,  3.29it/s]
 85%|████████▌ | 316788/371472 [3:02:07<4:22:22,  3.47it/s]
 85%|████████▌ | 316789/371472 [3:02:07<4:11:02,  3.63it/s]
 85%|████████▌ | 316790/371472 [3:02:07<4:38:43,  3.27it/s]
 85%|████████▌ | 316791/371472 [3:02:07<4:33:22,  3.33it/s]
 85%|████████▌ | 316792/371472 [3:02:08<4:31:22,  3.36it/s]
 85%|████████▌ | 316793/371472 [3:02:08<4:21:19,  3.49it/s]
 85%|████████▌ | 316794/371472 [3:02:08<4:22:25,  3.47it/s]
 85%|████████▌ | 316795/371472 [3:02:09<4:11:26,  3.62it/s]
 85%|████████▌ | 316796/371472 [3:02:09<4:05:54,  3.71it/s]
 85%|████████▌ | 316797/371472 [3:02:09<4:26:29,  3.42it/s]
 85%|████████▌ | 316798/371472 [3:02:09<4:15:56,  3.56it/s]
 85%|████████▌ | 316799/371472 [3:02:10<4:31:02,  3.36it/s]
 85%|████████▌ | 316800/371472 [3:02:10<4:20:24,  3.50it/s]
                                                           
{'loss': 2.5152, 'learning_rate': 2.3253032816910508e-07, 'epoch': 13.65}

 85%|████████▌ | 316800/371472 [3:02:10<4:20:24,  3.50it/s]
 85%|████████▌ | 316801/371472 [3:02:10<4:36:26,  3.30it/s]
 85%|████████▌ | 316802/371472 [3:02:11<4:29:13,  3.38it/s]
 85%|████████▌ | 316803/371472 [3:02:11<4:22:03,  3.48it/s]
 85%|████████▌ | 316804/371472 [3:02:11<4:47:03,  3.17it/s]
 85%|████████▌ | 316805/371472 [3:02:12<4:37:54,  3.28it/s]
 85%|████████▌ | 316806/371472 [3:02:12<4:35:04,  3.31it/s]
 85%|████████▌ | 316807/371472 [3:02:12<4:21:36,  3.48it/s]
 85%|████████▌ | 316808/371472 [3:02:12<4:12:43,  3.60it/s]
 85%|████████▌ | 316809/371472 [3:02:13<4:17:41,  3.54it/s]
 85%|████████▌ | 316810/371472 [3:02:13<4:20:06,  3.50it/s]
 85%|████████▌ | 316811/371472 [3:02:13<4:14:10,  3.58it/s]
 85%|████████▌ | 316812/371472 [3:02:13<4:03:27,  3.74it/s]
 85%|████████▌ | 316813/371472 [3:02:14<4:29:22,  3.38it/s]
 85%|████████▌ | 316814/371472 [3:02:14<4:22:21,  3.47it/s]
 85%|████████▌ | 316815/371472 [3:02:14<4:34:00,  3.32it/s]
 85%|████████▌ | 316816/371472 [3:02:15<4:26:30,  3.42it/s]
 85%|████████▌ | 316817/371472 [3:02:15<4:10:48,  3.63it/s]
 85%|████████▌ | 316818/371472 [3:02:15<4:13:40,  3.59it/s]
 85%|████████▌ | 316819/371472 [3:02:15<4:15:35,  3.56it/s]
 85%|████████▌ | 316820/371472 [3:02:16<4:24:14,  3.45it/s]
                                                           
{'loss': 2.6035, 'learning_rate': 2.3248184619362625e-07, 'epoch': 13.65}

 85%|████████▌ | 316820/371472 [3:02:16<4:24:14,  3.45it/s]
 85%|████████▌ | 316821/371472 [3:02:16<4:25:14,  3.43it/s]
 85%|████████▌ | 316822/371472 [3:02:16<4:16:15,  3.55it/s]
 85%|████████▌ | 316823/371472 [3:02:17<4:17:36,  3.54it/s]
 85%|████████▌ | 316824/371472 [3:02:17<4:13:02,  3.60it/s]
 85%|████████▌ | 316825/371472 [3:02:17<4:12:28,  3.61it/s]
 85%|████████▌ | 316826/371472 [3:02:17<4:17:01,  3.54it/s]
 85%|████████▌ | 316827/371472 [3:02:18<4:05:34,  3.71it/s]
 85%|████████▌ | 316828/371472 [3:02:18<4:06:21,  3.70it/s]
 85%|████████▌ | 316829/371472 [3:02:18<4:14:54,  3.57it/s]
 85%|████████▌ | 316830/371472 [3:02:19<4:16:48,  3.55it/s]
 85%|████████▌ | 316831/371472 [3:02:19<4:30:04,  3.37it/s]
 85%|████████▌ | 316832/371472 [3:02:19<4:16:18,  3.55it/s]
 85%|████████▌ | 316833/371472 [3:02:20<4:46:25,  3.18it/s]
 85%|████████▌ | 316834/371472 [3:02:20<4:33:29,  3.33it/s]
 85%|████████▌ | 316835/371472 [3:02:20<4:19:41,  3.51it/s]
 85%|████████▌ | 316836/371472 [3:02:20<4:09:02,  3.66it/s]
 85%|████████▌ | 316837/371472 [3:02:21<4:04:46,  3.72it/s]
 85%|████████▌ | 316838/371472 [3:02:21<3:58:45,  3.81it/s]
 85%|████████▌ | 316839/371472 [3:02:21<3:59:49,  3.80it/s]
 85%|████████▌ | 316840/371472 [3:02:21<4:29:52,  3.37it/s]
                                                           
{'loss': 2.705, 'learning_rate': 2.3243336421814732e-07, 'epoch': 13.65}

 85%|████████▌ | 316840/371472 [3:02:21<4:29:52,  3.37it/s]
 85%|████████▌ | 316841/371472 [3:02:22<4:22:57,  3.46it/s]
 85%|████████▌ | 316842/371472 [3:02:22<4:09:02,  3.66it/s]
 85%|████████▌ | 316843/371472 [3:02:22<3:59:40,  3.80it/s]
 85%|████████▌ | 316844/371472 [3:02:22<3:58:30,  3.82it/s]
 85%|████████▌ | 316845/371472 [3:02:23<4:01:38,  3.77it/s]
 85%|████████▌ | 316846/371472 [3:02:23<4:04:32,  3.72it/s]
 85%|████████▌ | 316847/371472 [3:02:23<4:09:39,  3.65it/s]
 85%|████████▌ | 316848/371472 [3:02:24<4:08:45,  3.66it/s]
 85%|████████▌ | 316849/371472 [3:02:24<4:16:27,  3.55it/s]
 85%|████████▌ | 316850/371472 [3:02:24<4:09:27,  3.65it/s]
 85%|████████▌ | 316851/371472 [3:02:24<4:07:25,  3.68it/s]
 85%|████████▌ | 316852/371472 [3:02:25<4:06:15,  3.70it/s]
 85%|████████▌ | 316853/371472 [3:02:25<4:09:31,  3.65it/s]
 85%|████████▌ | 316854/371472 [3:02:25<4:11:36,  3.62it/s]
 85%|████████▌ | 316855/371472 [3:02:26<4:12:51,  3.60it/s]
 85%|████████▌ | 316856/371472 [3:02:26<4:05:34,  3.71it/s]
 85%|████████▌ | 316857/371472 [3:02:26<4:24:27,  3.44it/s]
 85%|████████▌ | 316858/371472 [3:02:26<4:29:17,  3.38it/s]
 85%|████████▌ | 316859/371472 [3:02:27<4:54:02,  3.10it/s]
 85%|████████▌ | 316860/371472 [3:02:27<4:46:23,  3.18it/s]
                                                           
{'loss': 2.6841, 'learning_rate': 2.3238488224266848e-07, 'epoch': 13.65}

 85%|████████▌ | 316860/371472 [3:02:27<4:46:23,  3.18it/s]
 85%|████████▌ | 316861/371472 [3:02:27<4:38:47,  3.26it/s]
 85%|████████▌ | 316862/371472 [3:02:28<4:29:46,  3.37it/s]
 85%|████████▌ | 316863/371472 [3:02:28<4:38:18,  3.27it/s]
 85%|████████▌ | 316864/371472 [3:02:28<4:26:51,  3.41it/s]
 85%|████████▌ | 316865/371472 [3:02:29<4:19:08,  3.51it/s]
 85%|████████▌ | 316866/371472 [3:02:29<4:16:45,  3.54it/s]
 85%|████████▌ | 316867/371472 [3:02:29<4:11:00,  3.63it/s]
 85%|████████▌ | 316868/371472 [3:02:29<4:17:21,  3.54it/s]
 85%|████████▌ | 316869/371472 [3:02:30<4:08:29,  3.66it/s]
 85%|████████▌ | 316870/371472 [3:02:30<3:59:24,  3.80it/s]
 85%|████████▌ | 316871/371472 [3:02:30<4:10:24,  3.63it/s]
 85%|████████▌ | 316872/371472 [3:02:30<4:16:23,  3.55it/s]
 85%|████████▌ | 316873/371472 [3:02:31<4:42:05,  3.23it/s]
 85%|████████▌ | 316874/371472 [3:02:31<4:42:23,  3.22it/s]
 85%|████████▌ | 316875/371472 [3:02:31<4:35:04,  3.31it/s]
 85%|████████▌ | 316876/371472 [3:02:32<4:29:44,  3.37it/s]
 85%|████████▌ | 316877/371472 [3:02:32<4:25:35,  3.43it/s]
 85%|████████▌ | 316878/371472 [3:02:32<4:24:34,  3.44it/s]
 85%|████████▌ | 316879/371472 [3:02:33<4:25:31,  3.43it/s]
 85%|████████▌ | 316880/371472 [3:02:33<4:22:40,  3.46it/s]
                                                           
{'loss': 2.6903, 'learning_rate': 2.3233640026718955e-07, 'epoch': 13.65}

 85%|████████▌ | 316880/371472 [3:02:33<4:22:40,  3.46it/s]
 85%|████████▌ | 316881/371472 [3:02:33<4:12:31,  3.60it/s]
 85%|████████▌ | 316882/371472 [3:02:33<4:04:17,  3.72it/s]
 85%|████████▌ | 316883/371472 [3:02:34<3:55:57,  3.86it/s]
 85%|████████▌ | 316884/371472 [3:02:34<4:07:40,  3.67it/s]
 85%|████████▌ | 316885/371472 [3:02:34<4:11:40,  3.61it/s]
 85%|████████▌ | 316886/371472 [3:02:35<4:36:03,  3.30it/s]
 85%|████████▌ | 316887/371472 [3:02:35<4:30:20,  3.37it/s]
 85%|████████▌ | 316888/371472 [3:02:35<4:18:22,  3.52it/s]
 85%|████████▌ | 316889/371472 [3:02:35<4:20:08,  3.50it/s]
 85%|████████▌ | 316890/371472 [3:02:36<4:19:40,  3.50it/s]
 85%|████████▌ | 316891/371472 [3:02:36<4:16:05,  3.55it/s]
 85%|████████▌ | 316892/371472 [3:02:36<4:49:00,  3.15it/s]
 85%|████████▌ | 316893/371472 [3:02:37<4:28:20,  3.39it/s]
 85%|████████▌ | 316894/371472 [3:02:37<4:18:32,  3.52it/s]
 85%|████████▌ | 316895/371472 [3:02:37<4:13:06,  3.59it/s]
 85%|████████▌ | 316896/371472 [3:02:37<4:10:32,  3.63it/s]
 85%|████████▌ | 316897/371472 [3:02:38<4:10:07,  3.64it/s]
 85%|████████▌ | 316898/371472 [3:02:38<4:10:51,  3.63it/s]
 85%|████████▌ | 316899/371472 [3:02:38<4:21:33,  3.48it/s]
 85%|████████▌ | 316900/371472 [3:02:38<4:12:13,  3.61it/s]
                                                           
{'loss': 2.5961, 'learning_rate': 2.322879182917107e-07, 'epoch': 13.65}

 85%|████████▌ | 316900/371472 [3:02:38<4:12:13,  3.61it/s]
 85%|████████▌ | 316901/371472 [3:02:39<4:07:00,  3.68it/s]
 85%|████████▌ | 316902/371472 [3:02:39<4:05:27,  3.71it/s]
 85%|████████▌ | 316903/371472 [3:02:39<4:06:16,  3.69it/s]
 85%|████████▌ | 316904/371472 [3:02:40<4:05:15,  3.71it/s]
 85%|████████▌ | 316905/371472 [3:02:40<4:14:16,  3.58it/s]
 85%|████████▌ | 316906/371472 [3:02:40<4:06:29,  3.69it/s]
 85%|████████▌ | 316907/371472 [3:02:40<4:28:19,  3.39it/s]
 85%|████████▌ | 316908/371472 [3:02:41<4:41:52,  3.23it/s]
 85%|████████▌ | 316909/371472 [3:02:41<4:27:44,  3.40it/s]
 85%|████████▌ | 316910/371472 [3:02:41<4:26:27,  3.41it/s]
 85%|████████▌ | 316911/371472 [3:02:42<4:25:16,  3.43it/s]
 85%|████████▌ | 316912/371472 [3:02:42<4:17:05,  3.54it/s]
 85%|████████▌ | 316913/371472 [3:02:42<4:08:54,  3.65it/s]
 85%|████████▌ | 316914/371472 [3:02:42<4:14:16,  3.58it/s]
 85%|████████▌ | 316915/371472 [3:02:43<4:26:09,  3.42it/s]
 85%|████████▌ | 316916/371472 [3:02:43<4:20:57,  3.48it/s]
 85%|████████▌ | 316917/371472 [3:02:43<4:18:46,  3.51it/s]
 85%|████████▌ | 316918/371472 [3:02:44<4:11:05,  3.62it/s]
 85%|████████▌ | 316919/371472 [3:02:44<4:17:15,  3.53it/s]
 85%|████████▌ | 316920/371472 [3:02:44<4:12:18,  3.60it/s]
                                                           
{'loss': 2.5962, 'learning_rate': 2.3223943631623174e-07, 'epoch': 13.65}

 85%|████████▌ | 316920/371472 [3:02:44<4:12:18,  3.60it/s]
 85%|████████▌ | 316921/371472 [3:02:44<4:38:49,  3.26it/s]
 85%|████████▌ | 316922/371472 [3:02:45<4:26:52,  3.41it/s]
 85%|████████▌ | 316923/371472 [3:02:45<4:35:23,  3.30it/s]
 85%|████████▌ | 316924/371472 [3:02:45<4:32:14,  3.34it/s]
 85%|████████▌ | 316925/371472 [3:02:46<4:18:39,  3.51it/s]
 85%|████████▌ | 316926/371472 [3:02:46<4:16:55,  3.54it/s]
 85%|████████▌ | 316927/371472 [3:02:46<4:18:33,  3.52it/s]
 85%|████████▌ | 316928/371472 [3:02:47<4:26:07,  3.42it/s]
 85%|████████▌ | 316929/371472 [3:02:47<4:15:23,  3.56it/s]
 85%|████████▌ | 316930/371472 [3:02:47<4:05:30,  3.70it/s]
 85%|████████▌ | 316931/371472 [3:02:47<4:08:40,  3.66it/s]
 85%|████████▌ | 316932/371472 [3:02:48<4:10:50,  3.62it/s]
 85%|████████▌ | 316933/371472 [3:02:48<4:04:08,  3.72it/s]
 85%|████████▌ | 316934/371472 [3:02:48<4:13:22,  3.59it/s]
 85%|████████▌ | 316935/371472 [3:02:48<4:06:04,  3.69it/s]
 85%|████████▌ | 316936/371472 [3:02:49<3:59:11,  3.80it/s]
 85%|████████▌ | 316937/371472 [3:02:49<4:05:40,  3.70it/s]
 85%|████████▌ | 316938/371472 [3:02:49<4:17:26,  3.53it/s]
 85%|████████▌ | 316939/371472 [3:02:49<4:15:37,  3.56it/s]
 85%|████████▌ | 316940/371472 [3:02:50<4:09:06,  3.65it/s]
                                                           
{'loss': 2.6654, 'learning_rate': 2.3219095434075292e-07, 'epoch': 13.65}

 85%|████████▌ | 316940/371472 [3:02:50<4:09:06,  3.65it/s]
 85%|████████▌ | 316941/371472 [3:02:50<4:04:05,  3.72it/s]
 85%|████████▌ | 316942/371472 [3:02:50<4:00:19,  3.78it/s]
 85%|████████▌ | 316943/371472 [3:02:51<3:59:27,  3.80it/s]
 85%|████████▌ | 316944/371472 [3:02:51<4:16:47,  3.54it/s]
 85%|████████▌ | 316945/371472 [3:02:51<4:17:20,  3.53it/s]
 85%|████████▌ | 316946/371472 [3:02:51<4:15:08,  3.56it/s]
 85%|████████▌ | 316947/371472 [3:02:52<4:11:08,  3.62it/s]
 85%|████████▌ | 316948/371472 [3:02:52<4:04:26,  3.72it/s]
 85%|████████▌ | 316949/371472 [3:02:52<4:12:25,  3.60it/s]
 85%|████████▌ | 316950/371472 [3:02:52<4:02:22,  3.75it/s]
 85%|████████▌ | 316951/371472 [3:02:53<4:12:35,  3.60it/s]
 85%|████████▌ | 316952/371472 [3:02:53<4:04:53,  3.71it/s]
 85%|████████▌ | 316953/371472 [3:02:53<4:00:33,  3.78it/s]
 85%|████████▌ | 316954/371472 [3:02:54<3:55:47,  3.85it/s]
 85%|████████▌ | 316955/371472 [3:02:54<3:59:45,  3.79it/s]
 85%|████████▌ | 316956/371472 [3:02:54<3:56:55,  3.83it/s]
 85%|████████▌ | 316957/371472 [3:02:54<4:35:15,  3.30it/s]
 85%|████████▌ | 316958/371472 [3:02:55<4:26:05,  3.41it/s]
 85%|████████▌ | 316959/371472 [3:02:55<4:34:56,  3.30it/s]
 85%|████████▌ | 316960/371472 [3:02:55<4:20:55,  3.48it/s]
                                                           
{'loss': 2.4737, 'learning_rate': 2.3214247236527397e-07, 'epoch': 13.65}

 85%|████████▌ | 316960/371472 [3:02:55<4:20:55,  3.48it/s]
 85%|████████▌ | 316961/371472 [3:02:56<4:37:14,  3.28it/s]
 85%|████████▌ | 316962/371472 [3:02:56<4:37:20,  3.28it/s]
 85%|████████▌ | 316963/371472 [3:02:56<4:32:28,  3.33it/s]
 85%|████████▌ | 316964/371472 [3:02:57<4:32:17,  3.34it/s]
 85%|████████▌ | 316965/371472 [3:02:57<4:37:00,  3.28it/s]
 85%|████████▌ | 316966/371472 [3:02:57<4:32:32,  3.33it/s]
 85%|████████▌ | 316967/371472 [3:02:57<4:29:11,  3.37it/s]
 85%|████████▌ | 316968/371472 [3:02:58<4:27:04,  3.40it/s]
 85%|████████▌ | 316969/371472 [3:02:58<4:13:47,  3.58it/s]
 85%|████████▌ | 316970/371472 [3:02:58<4:30:10,  3.36it/s]
 85%|████████▌ | 316971/371472 [3:02:59<4:17:07,  3.53it/s]
 85%|████████▌ | 316972/371472 [3:02:59<4:25:00,  3.43it/s]
 85%|████████▌ | 316973/371472 [3:02:59<4:13:43,  3.58it/s]
 85%|████████▌ | 316974/371472 [3:02:59<4:07:41,  3.67it/s]
 85%|████████▌ | 316975/371472 [3:03:00<3:57:11,  3.83it/s]
 85%|████████▌ | 316976/371472 [3:03:00<4:02:10,  3.75it/s]
 85%|████████▌ | 316977/371472 [3:03:00<4:00:03,  3.78it/s]
 85%|████████▌ | 316978/371472 [3:03:01<4:30:53,  3.35it/s]
 85%|████████▌ | 316979/371472 [3:03:01<4:18:07,  3.52it/s]
 85%|████████▌ | 316980/371472 [3:03:01<4:15:19,  3.56it/s]
                                                           
{'loss': 2.6016, 'learning_rate': 2.3209399038979504e-07, 'epoch': 13.65}

 85%|████████▌ | 316980/371472 [3:03:01<4:15:19,  3.56it/s]
 85%|████████▌ | 316981/371472 [3:03:01<4:40:59,  3.23it/s]
 85%|████████▌ | 316982/371472 [3:03:02<4:26:43,  3.40it/s]
 85%|████████▌ | 316983/371472 [3:03:02<4:25:04,  3.43it/s]
 85%|████████▌ | 316984/371472 [3:03:02<4:29:22,  3.37it/s]
 85%|████████▌ | 316985/371472 [3:03:03<4:23:46,  3.44it/s]
 85%|████████▌ | 316986/371472 [3:03:03<4:21:12,  3.48it/s]
 85%|████████▌ | 316987/371472 [3:03:03<4:10:17,  3.63it/s]
 85%|████████▌ | 316988/371472 [3:03:03<4:17:54,  3.52it/s]
 85%|████████▌ | 316989/371472 [3:03:04<4:40:22,  3.24it/s]
 85%|████████▌ | 316990/371472 [3:03:04<4:34:23,  3.31it/s]
 85%|████████▌ | 316991/371472 [3:03:04<4:29:30,  3.37it/s]
 85%|████████▌ | 316992/371472 [3:03:05<4:21:44,  3.47it/s]
 85%|████████▌ | 316993/371472 [3:03:05<4:11:58,  3.60it/s]
 85%|████████▌ | 316994/371472 [3:03:05<4:14:03,  3.57it/s]
 85%|████████▌ | 316995/371472 [3:03:05<4:09:44,  3.64it/s]
 85%|████████▌ | 316996/371472 [3:03:06<4:13:50,  3.58it/s]
 85%|████████▌ | 316997/371472 [3:03:06<4:04:53,  3.71it/s]
 85%|████████▌ | 316998/371472 [3:03:06<4:10:07,  3.63it/s]
 85%|████████▌ | 316999/371472 [3:03:06<4:06:32,  3.68it/s]
 85%|████████▌ | 317000/371472 [3:03:07<4:08:54,  3.65it/s]
                                                           
{'loss': 2.534, 'learning_rate': 2.320455084143162e-07, 'epoch': 13.65}

 85%|████████▌ | 317000/371472 [3:03:07<4:08:54,  3.65it/s]
 85%|████████▌ | 317001/371472 [3:03:07<4:04:56,  3.71it/s]
 85%|████████▌ | 317002/371472 [3:03:07<3:58:11,  3.81it/s]
 85%|████████▌ | 317003/371472 [3:03:08<3:59:26,  3.79it/s]
 85%|████████▌ | 317004/371472 [3:03:08<5:02:11,  3.00it/s]
 85%|████████▌ | 317005/371472 [3:03:08<4:42:01,  3.22it/s]
 85%|████████▌ | 317006/371472 [3:03:09<4:27:05,  3.40it/s]
 85%|████████▌ | 317007/371472 [3:03:09<4:28:12,  3.38it/s]
 85%|████████▌ | 317008/371472 [3:03:09<4:45:02,  3.18it/s]
 85%|████████▌ | 317009/371472 [3:03:10<4:46:41,  3.17it/s]
 85%|████████▌ | 317010/371472 [3:03:10<4:48:12,  3.15it/s]
 85%|████████▌ | 317011/371472 [3:03:10<4:54:13,  3.08it/s]
 85%|████████▌ | 317012/371472 [3:03:10<4:40:50,  3.23it/s]
 85%|████████▌ | 317013/371472 [3:03:11<4:30:21,  3.36it/s]
 85%|████████▌ | 317014/371472 [3:03:11<4:19:18,  3.50it/s]
 85%|████████▌ | 317015/371472 [3:03:11<4:35:26,  3.30it/s]
 85%|████████▌ | 317016/371472 [3:03:12<4:26:39,  3.40it/s]
 85%|████████▌ | 317017/371472 [3:03:12<4:15:21,  3.55it/s]
 85%|████████▌ | 317018/371472 [3:03:12<4:26:54,  3.40it/s]
 85%|████████▌ | 317019/371472 [3:03:12<4:20:00,  3.49it/s]
 85%|████████▌ | 317020/371472 [3:03:13<4:11:18,  3.61it/s]
                                                           
{'loss': 2.5667, 'learning_rate': 2.3199702643883723e-07, 'epoch': 13.65}

 85%|████████▌ | 317020/371472 [3:03:13<4:11:18,  3.61it/s]
 85%|████████▌ | 317021/371472 [3:03:13<4:11:59,  3.60it/s]
 85%|████████▌ | 317022/371472 [3:03:13<4:48:45,  3.14it/s]
 85%|████████▌ | 317023/371472 [3:03:14<4:34:03,  3.31it/s]
 85%|████████▌ | 317024/371472 [3:03:14<4:32:25,  3.33it/s]
 85%|████████▌ | 317025/371472 [3:03:14<4:29:20,  3.37it/s]
 85%|████████▌ | 317026/371472 [3:03:15<4:27:11,  3.40it/s]
 85%|████████▌ | 317027/371472 [3:03:15<4:24:27,  3.43it/s]
 85%|████████▌ | 317028/371472 [3:03:15<4:20:15,  3.49it/s]
 85%|████████▌ | 317029/371472 [3:03:15<4:16:51,  3.53it/s]
 85%|████████▌ | 317030/371472 [3:03:16<4:06:50,  3.68it/s]
 85%|████████▌ | 317031/371472 [3:03:16<4:15:44,  3.55it/s]
 85%|████████▌ | 317032/371472 [3:03:16<4:10:53,  3.62it/s]
 85%|████████▌ | 317033/371472 [3:03:16<4:04:40,  3.71it/s]
 85%|████████▌ | 317034/371472 [3:03:17<4:08:10,  3.66it/s]
 85%|████████▌ | 317035/371472 [3:03:17<4:03:10,  3.73it/s]
 85%|████████▌ | 317036/371472 [3:03:17<3:54:23,  3.87it/s]
 85%|████████▌ | 317037/371472 [3:03:17<3:56:43,  3.83it/s]
 85%|████████▌ | 317038/371472 [3:03:18<4:07:45,  3.66it/s]
 85%|████████▌ | 317039/371472 [3:03:18<4:04:17,  3.71it/s]
 85%|████████▌ | 317040/371472 [3:03:18<4:13:46,  3.57it/s]
                                                           
{'loss': 2.6442, 'learning_rate': 2.319485444633584e-07, 'epoch': 13.66}

 85%|████████▌ | 317040/371472 [3:03:18<4:13:46,  3.57it/s]
 85%|████████▌ | 317041/371472 [3:03:19<4:11:13,  3.61it/s]
 85%|████████▌ | 317042/371472 [3:03:19<4:03:32,  3.72it/s]
 85%|████████▌ | 317043/371472 [3:03:19<3:57:04,  3.83it/s]
 85%|████████▌ | 317044/371472 [3:03:19<3:52:09,  3.91it/s]
 85%|████████▌ | 317045/371472 [3:03:20<3:52:53,  3.89it/s]
 85%|████████▌ | 317046/371472 [3:03:20<3:48:53,  3.96it/s]
 85%|████████▌ | 317047/371472 [3:03:20<4:05:18,  3.70it/s]
 85%|████████▌ | 317048/371472 [3:03:20<4:02:54,  3.73it/s]
 85%|████████▌ | 317049/371472 [3:03:21<4:11:58,  3.60it/s]
 85%|████████▌ | 317050/371472 [3:03:21<4:01:33,  3.75it/s]
 85%|████████▌ | 317051/371472 [3:03:21<4:04:12,  3.71it/s]
 85%|████████▌ | 317052/371472 [3:03:21<4:01:50,  3.75it/s]
 85%|████████▌ | 317053/371472 [3:03:22<4:03:10,  3.73it/s]
 85%|████████▌ | 317054/371472 [3:03:22<4:01:20,  3.76it/s]
 85%|████████▌ | 317055/371472 [3:03:22<4:04:34,  3.71it/s]
 85%|████████▌ | 317056/371472 [3:03:23<4:15:56,  3.54it/s]
 85%|████████▌ | 317057/371472 [3:03:23<4:12:22,  3.59it/s]
 85%|████████▌ | 317058/371472 [3:03:23<4:24:50,  3.42it/s]
 85%|████████▌ | 317059/371472 [3:03:24<4:30:48,  3.35it/s]
 85%|████████▌ | 317060/371472 [3:03:24<4:35:01,  3.30it/s]
                                                           
{'loss': 2.4701, 'learning_rate': 2.3190006248787946e-07, 'epoch': 13.66}

 85%|████████▌ | 317060/371472 [3:03:24<4:35:01,  3.30it/s]
 85%|████████▌ | 317061/371472 [3:03:24<4:27:14,  3.39it/s]
 85%|████████▌ | 317062/371472 [3:03:24<4:16:20,  3.54it/s]
 85%|████████▌ | 317063/371472 [3:03:25<4:27:05,  3.40it/s]
 85%|████████▌ | 317064/371472 [3:03:25<4:21:02,  3.47it/s]
 85%|████████▌ | 317065/371472 [3:03:25<4:20:38,  3.48it/s]
 85%|████████▌ | 317066/371472 [3:03:26<4:15:59,  3.54it/s]
 85%|████████▌ | 317067/371472 [3:03:26<4:18:15,  3.51it/s]
 85%|████████▌ | 317068/371472 [3:03:26<4:41:32,  3.22it/s]
 85%|████████▌ | 317069/371472 [3:03:26<4:35:12,  3.29it/s]
 85%|████████▌ | 317070/371472 [3:03:27<4:49:17,  3.13it/s]
 85%|████████▌ | 317071/371472 [3:03:27<4:30:58,  3.35it/s]
 85%|████████▌ | 317072/371472 [3:03:27<4:31:08,  3.34it/s]
 85%|████████▌ | 317073/371472 [3:03:28<4:24:50,  3.42it/s]
 85%|████████▌ | 317074/371472 [3:03:28<4:18:49,  3.50it/s]
 85%|████████▌ | 317075/371472 [3:03:28<4:26:09,  3.41it/s]
 85%|████████▌ | 317076/371472 [3:03:29<4:31:03,  3.34it/s]
 85%|████████▌ | 317077/371472 [3:03:29<4:43:39,  3.20it/s]
 85%|████████▌ | 317078/371472 [3:03:29<4:36:41,  3.28it/s]
 85%|████████▌ | 317079/371472 [3:03:29<4:19:04,  3.50it/s]
 85%|████████▌ | 317080/371472 [3:03:30<4:12:53,  3.58it/s]
                                                           
{'loss': 2.5644, 'learning_rate': 2.318515805124006e-07, 'epoch': 13.66}

 85%|████████▌ | 317080/371472 [3:03:30<4:12:53,  3.58it/s]
 85%|████████▌ | 317081/371472 [3:03:30<4:07:17,  3.67it/s]
 85%|████████▌ | 317082/371472 [3:03:30<4:15:39,  3.55it/s]
 85%|████████▌ | 317083/371472 [3:03:31<4:10:48,  3.61it/s]
 85%|████████▌ | 317084/371472 [3:03:31<4:18:33,  3.51it/s]
 85%|████████▌ | 317085/371472 [3:03:31<4:18:00,  3.51it/s]
 85%|████████▌ | 317086/371472 [3:03:31<4:18:00,  3.51it/s]
 85%|████████▌ | 317087/371472 [3:03:32<4:20:16,  3.48it/s]
 85%|████████▌ | 317088/371472 [3:03:32<4:13:42,  3.57it/s]
 85%|████████▌ | 317089/371472 [3:03:32<4:04:08,  3.71it/s]
 85%|████████▌ | 317090/371472 [3:03:32<4:10:28,  3.62it/s]
 85%|████████▌ | 317091/371472 [3:03:33<4:04:32,  3.71it/s]
 85%|████████▌ | 317092/371472 [3:03:33<4:00:47,  3.76it/s]
 85%|████████▌ | 317093/371472 [3:03:33<4:18:57,  3.50it/s]
 85%|████████▌ | 317094/371472 [3:03:34<4:19:47,  3.49it/s]
 85%|████████▌ | 317095/371472 [3:03:34<4:17:14,  3.52it/s]
 85%|████████▌ | 317096/371472 [3:03:34<4:10:15,  3.62it/s]
 85%|████████▌ | 317097/371472 [3:03:34<4:02:05,  3.74it/s]
 85%|████████▌ | 317098/371472 [3:03:35<4:05:01,  3.70it/s]
 85%|████████▌ | 317099/371472 [3:03:35<4:02:36,  3.74it/s]
 85%|████████▌ | 317100/371472 [3:03:35<4:03:27,  3.72it/s]
                                                           
{'loss': 2.5641, 'learning_rate': 2.3180309853692168e-07, 'epoch': 13.66}

 85%|████████▌ | 317100/371472 [3:03:35<4:03:27,  3.72it/s]
 85%|████████▌ | 317101/371472 [3:03:36<4:19:13,  3.50it/s]
 85%|████████▌ | 317102/371472 [3:03:36<4:19:04,  3.50it/s]
 85%|████████▌ | 317103/371472 [3:03:36<4:20:38,  3.48it/s]
 85%|████████▌ | 317104/371472 [3:03:36<4:18:56,  3.50it/s]
 85%|████████▌ | 317105/371472 [3:03:37<4:21:33,  3.46it/s]
 85%|████████▌ | 317106/371472 [3:03:37<4:12:36,  3.59it/s]
 85%|████████▌ | 317107/371472 [3:03:37<4:20:32,  3.48it/s]
 85%|████████▌ | 317108/371472 [3:03:38<4:30:38,  3.35it/s]
 85%|████████▌ | 317109/371472 [3:03:38<4:22:00,  3.46it/s]
 85%|████████▌ | 317110/371472 [3:03:38<4:20:51,  3.47it/s]
 85%|████████▌ | 317111/371472 [3:03:38<4:30:41,  3.35it/s]
 85%|████████▌ | 317112/371472 [3:03:39<4:36:08,  3.28it/s]
 85%|████████▌ | 317113/371472 [3:03:39<4:24:35,  3.42it/s]
 85%|████████▌ | 317114/371472 [3:03:39<4:31:12,  3.34it/s]
 85%|████████▌ | 317115/371472 [3:03:40<4:35:30,  3.29it/s]
 85%|████████▌ | 317116/371472 [3:03:40<4:23:11,  3.44it/s]
 85%|████████▌ | 317117/371472 [3:03:40<4:19:38,  3.49it/s]
 85%|████████▌ | 317118/371472 [3:03:40<4:12:37,  3.59it/s]
 85%|████████▌ | 317119/371472 [3:03:41<4:12:13,  3.59it/s]
 85%|████████▌ | 317120/371472 [3:03:41<4:42:13,  3.21it/s]
                                                           
{'loss': 2.58, 'learning_rate': 2.3175461656144283e-07, 'epoch': 13.66}

 85%|████████▌ | 317120/371472 [3:03:41<4:42:13,  3.21it/s]
 85%|████████▌ | 317121/371472 [3:03:41<4:25:45,  3.41it/s]
 85%|████████▌ | 317122/371472 [3:03:42<4:18:51,  3.50it/s]
 85%|████████▌ | 317123/371472 [3:03:42<4:12:14,  3.59it/s]
 85%|████████▌ | 317124/371472 [3:03:42<4:14:22,  3.56it/s]
 85%|████████▌ | 317125/371472 [3:03:42<4:11:01,  3.61it/s]
 85%|████████▌ | 317126/371472 [3:03:43<4:10:02,  3.62it/s]
 85%|████████▌ | 317127/371472 [3:03:43<4:06:55,  3.67it/s]
 85%|████████▌ | 317128/371472 [3:03:43<4:07:33,  3.66it/s]
 85%|████████▌ | 317129/371472 [3:03:44<4:18:41,  3.50it/s]
 85%|████████▌ | 317130/371472 [3:03:44<4:19:05,  3.50it/s]
 85%|████████▌ | 317131/371472 [3:03:44<4:20:37,  3.48it/s]
 85%|████████▌ | 317132/371472 [3:03:44<4:18:05,  3.51it/s]
 85%|████████▌ | 317133/371472 [3:03:45<4:15:04,  3.55it/s]
 85%|████████▌ | 317134/371472 [3:03:45<4:09:42,  3.63it/s]
 85%|████████▌ | 317135/371472 [3:03:45<4:16:09,  3.54it/s]
 85%|████████▌ | 317136/371472 [3:03:46<4:22:53,  3.44it/s]
 85%|████████▌ | 317137/371472 [3:03:46<4:41:57,  3.21it/s]
 85%|████████▌ | 317138/371472 [3:03:46<4:45:17,  3.17it/s]
 85%|████████▌ | 317139/371472 [3:03:47<4:50:02,  3.12it/s]
 85%|████████▌ | 317140/371472 [3:03:47<4:52:01,  3.10it/s]
                                                           
{'loss': 2.3708, 'learning_rate': 2.3170613458596387e-07, 'epoch': 13.66}

 85%|████████▌ | 317140/371472 [3:03:47<4:52:01,  3.10it/s]
 85%|████████▌ | 317141/371472 [3:03:47<4:44:15,  3.19it/s]
 85%|████████▌ | 317142/371472 [3:03:48<4:47:11,  3.15it/s]
 85%|████████▌ | 317143/371472 [3:03:48<5:01:27,  3.00it/s]
 85%|████████▌ | 317144/371472 [3:03:48<4:39:35,  3.24it/s]
 85%|████████▌ | 317145/371472 [3:03:48<4:32:15,  3.33it/s]
 85%|████████▌ | 317146/371472 [3:03:49<4:33:00,  3.32it/s]
 85%|████████▌ | 317147/371472 [3:03:49<4:34:47,  3.29it/s]
 85%|████████▌ | 317148/371472 [3:03:49<4:22:56,  3.44it/s]
 85%|████████▌ | 317149/371472 [3:03:50<4:19:01,  3.50it/s]
 85%|████████▌ | 317150/371472 [3:03:50<4:19:42,  3.49it/s]
 85%|████████▌ | 317151/371472 [3:03:50<4:14:11,  3.56it/s]
 85%|████████▌ | 317152/371472 [3:03:50<4:16:49,  3.53it/s]
 85%|████████▌ | 317153/371472 [3:03:51<4:12:05,  3.59it/s]
 85%|████████▌ | 317154/371472 [3:03:51<4:05:14,  3.69it/s]
 85%|████████▌ | 317155/371472 [3:03:51<4:18:54,  3.50it/s]
 85%|████████▌ | 317156/371472 [3:03:52<4:22:39,  3.45it/s]
 85%|████████▌ | 317157/371472 [3:03:52<4:36:57,  3.27it/s]
 85%|████████▌ | 317158/371472 [3:03:52<4:38:41,  3.25it/s]
 85%|████████▌ | 317159/371472 [3:03:53<4:34:44,  3.29it/s]
 85%|████████▌ | 317160/371472 [3:03:53<4:18:42,  3.50it/s]
                                                           
{'loss': 2.5548, 'learning_rate': 2.3165765261048505e-07, 'epoch': 13.66}

 85%|████████▌ | 317160/371472 [3:03:53<4:18:42,  3.50it/s]
 85%|████████▌ | 317161/371472 [3:03:53<4:15:59,  3.54it/s]
 85%|████████▌ | 317162/371472 [3:03:53<4:14:08,  3.56it/s]
 85%|████████▌ | 317163/371472 [3:03:54<4:20:10,  3.48it/s]
 85%|████████▌ | 317164/371472 [3:03:54<4:16:48,  3.52it/s]
 85%|████████▌ | 317165/371472 [3:03:54<4:30:30,  3.35it/s]
 85%|████████▌ | 317166/371472 [3:03:55<4:35:30,  3.29it/s]
 85%|████████▌ | 317167/371472 [3:03:55<4:28:52,  3.37it/s]
 85%|████████▌ | 317168/371472 [3:03:55<4:11:31,  3.60it/s]
 85%|████████▌ | 317169/371472 [3:03:55<4:08:52,  3.64it/s]
 85%|████████▌ | 317170/371472 [3:03:56<4:11:24,  3.60it/s]
 85%|████████▌ | 317171/371472 [3:03:56<4:19:33,  3.49it/s]
 85%|████████▌ | 317172/371472 [3:03:56<4:14:15,  3.56it/s]
 85%|████████▌ | 317173/371472 [3:03:57<4:26:27,  3.40it/s]
 85%|████████▌ | 317174/371472 [3:03:57<4:22:17,  3.45it/s]
 85%|████████▌ | 317175/371472 [3:03:57<4:22:38,  3.45it/s]
 85%|████████▌ | 317176/371472 [3:03:57<4:36:55,  3.27it/s]
 85%|████████▌ | 317177/371472 [3:03:58<4:29:41,  3.36it/s]
 85%|████████▌ | 317178/371472 [3:03:58<4:18:34,  3.50it/s]
 85%|████████▌ | 317179/371472 [3:03:58<4:11:55,  3.59it/s]
 85%|████████▌ | 317180/371472 [3:03:59<4:09:56,  3.62it/s]
                                                           
{'loss': 2.5728, 'learning_rate': 2.316091706350061e-07, 'epoch': 13.66}

 85%|████████▌ | 317180/371472 [3:03:59<4:09:56,  3.62it/s]
 85%|████████▌ | 317181/371472 [3:03:59<4:20:40,  3.47it/s]
 85%|████████▌ | 317182/371472 [3:03:59<4:23:24,  3.44it/s]
 85%|████████▌ | 317183/371472 [3:03:59<4:09:51,  3.62it/s]
 85%|████████▌ | 317184/371472 [3:04:00<4:07:10,  3.66it/s]
 85%|████████▌ | 317185/371472 [3:04:00<4:05:27,  3.69it/s]
 85%|████████▌ | 317186/371472 [3:04:00<3:58:50,  3.79it/s]
 85%|████████▌ | 317187/371472 [3:04:00<4:02:37,  3.73it/s]
 85%|████████▌ | 317188/371472 [3:04:01<3:56:43,  3.82it/s]
 85%|████████▌ | 317189/371472 [3:04:01<4:01:26,  3.75it/s]
 85%|████████▌ | 317190/371472 [3:04:01<4:08:08,  3.65it/s]
 85%|████████▌ | 317191/371472 [3:04:02<4:06:21,  3.67it/s]
 85%|████████▌ | 317192/371472 [3:04:02<4:00:28,  3.76it/s]
 85%|████████▌ | 317193/371472 [3:04:02<3:52:31,  3.89it/s]
 85%|████████▌ | 317194/371472 [3:04:02<3:50:10,  3.93it/s]
 85%|████████▌ | 317195/371472 [3:04:03<4:13:34,  3.57it/s]
 85%|████████▌ | 317196/371472 [3:04:03<4:03:23,  3.72it/s]
 85%|████████▌ | 317197/371472 [3:04:03<4:21:16,  3.46it/s]
 85%|████████▌ | 317198/371472 [3:04:03<4:23:30,  3.43it/s]
 85%|████████▌ | 317199/371472 [3:04:04<4:19:08,  3.49it/s]
 85%|████████▌ | 317200/371472 [3:04:04<4:34:24,  3.30it/s]
                                                           
{'loss': 2.7305, 'learning_rate': 2.3156068865952725e-07, 'epoch': 13.66}

 85%|████████▌ | 317200/371472 [3:04:04<4:34:24,  3.30it/s]
 85%|████████▌ | 317201/371472 [3:04:04<4:22:05,  3.45it/s]
 85%|████████▌ | 317202/371472 [3:04:05<4:14:23,  3.56it/s]
 85%|████████▌ | 317203/371472 [3:04:05<4:19:51,  3.48it/s]
 85%|████████▌ | 317204/371472 [3:04:05<4:07:36,  3.65it/s]
 85%|████████▌ | 317205/371472 [3:04:05<4:08:43,  3.64it/s]
 85%|████████▌ | 317206/371472 [3:04:06<4:04:13,  3.70it/s]
 85%|████████▌ | 317207/371472 [3:04:06<4:08:38,  3.64it/s]
 85%|████████▌ | 317208/371472 [3:04:06<4:26:27,  3.39it/s]
 85%|████████▌ | 317209/371472 [3:04:07<4:32:05,  3.32it/s]
 85%|████████▌ | 317210/371472 [3:04:07<4:14:31,  3.55it/s]
 85%|████████▌ | 317211/371472 [3:04:07<4:23:38,  3.43it/s]
 85%|████████▌ | 317212/371472 [3:04:07<4:35:10,  3.29it/s]
 85%|████████▌ | 317213/371472 [3:04:08<4:37:57,  3.25it/s]
 85%|████████▌ | 317214/371472 [3:04:08<4:21:48,  3.45it/s]
 85%|████████▌ | 317215/371472 [3:04:08<4:11:58,  3.59it/s]
 85%|████████▌ | 317216/371472 [3:04:09<4:05:41,  3.68it/s]
 85%|████████▌ | 317217/371472 [3:04:09<4:17:07,  3.52it/s]
 85%|████████▌ | 317218/371472 [3:04:09<4:16:31,  3.52it/s]
 85%|████████▌ | 317219/371472 [3:04:09<4:09:39,  3.62it/s]
 85%|████████▌ | 317220/371472 [3:04:10<4:05:23,  3.68it/s]
                                                           
{'loss': 2.8196, 'learning_rate': 2.3151220668404832e-07, 'epoch': 13.66}

 85%|████████▌ | 317220/371472 [3:04:10<4:05:23,  3.68it/s]
 85%|████████▌ | 317221/371472 [3:04:10<4:05:26,  3.68it/s]
 85%|████████▌ | 317222/371472 [3:04:10<4:03:36,  3.71it/s]
 85%|████████▌ | 317223/371472 [3:04:10<4:00:45,  3.76it/s]
 85%|████████▌ | 317224/371472 [3:04:11<3:54:46,  3.85it/s]
 85%|████████▌ | 317225/371472 [3:04:11<3:53:19,  3.88it/s]
 85%|████████▌ | 317226/371472 [3:04:11<3:50:52,  3.92it/s]
 85%|████████▌ | 317227/371472 [3:04:11<3:51:52,  3.90it/s]
 85%|████████▌ | 317228/371472 [3:04:12<4:03:47,  3.71it/s]
 85%|████████▌ | 317229/371472 [3:04:12<4:09:04,  3.63it/s]
 85%|████████▌ | 317230/371472 [3:04:12<4:14:33,  3.55it/s]
 85%|████████▌ | 317231/371472 [3:04:13<4:12:49,  3.58it/s]
 85%|████████▌ | 317232/371472 [3:04:13<4:17:28,  3.51it/s]
 85%|████████▌ | 317233/371472 [3:04:13<4:16:49,  3.52it/s]
 85%|████████▌ | 317234/371472 [3:04:14<4:22:26,  3.44it/s]
 85%|████████▌ | 317235/371472 [3:04:14<4:12:38,  3.58it/s]
 85%|████████▌ | 317236/371472 [3:04:14<4:14:52,  3.55it/s]
 85%|████████▌ | 317237/371472 [3:04:14<4:11:18,  3.60it/s]
 85%|████████▌ | 317238/371472 [3:04:15<4:15:38,  3.54it/s]
 85%|████████▌ | 317239/371472 [3:04:15<4:15:39,  3.54it/s]
 85%|████████▌ | 317240/371472 [3:04:15<4:04:47,  3.69it/s]
                                                           
{'loss': 2.6515, 'learning_rate': 2.3146372470856947e-07, 'epoch': 13.66}

 85%|████████▌ | 317240/371472 [3:04:15<4:04:47,  3.69it/s]
 85%|████████▌ | 317241/371472 [3:04:15<4:03:30,  3.71it/s]
 85%|████████▌ | 317242/371472 [3:04:16<4:15:37,  3.54it/s]
 85%|████████▌ | 317243/371472 [3:04:16<4:06:31,  3.67it/s]
 85%|████████▌ | 317244/371472 [3:04:16<4:14:46,  3.55it/s]
 85%|████████▌ | 317245/371472 [3:04:17<4:07:38,  3.65it/s]
 85%|████████▌ | 317246/371472 [3:04:17<4:10:25,  3.61it/s]
 85%|████████▌ | 317247/371472 [3:04:17<4:01:09,  3.75it/s]
 85%|████████▌ | 317248/371472 [3:04:17<4:10:55,  3.60it/s]
 85%|████████▌ | 317249/371472 [3:04:18<4:21:53,  3.45it/s]
 85%|████████▌ | 317250/371472 [3:04:18<4:14:27,  3.55it/s]
 85%|████████▌ | 317251/371472 [3:04:18<4:21:28,  3.46it/s]
 85%|████████▌ | 317252/371472 [3:04:19<4:31:07,  3.33it/s]
 85%|████████▌ | 317253/371472 [3:04:19<4:35:41,  3.28it/s]
 85%|████████▌ | 317254/371472 [3:04:19<4:30:46,  3.34it/s]
 85%|████████▌ | 317255/371472 [3:04:20<5:16:33,  2.85it/s]
 85%|████████▌ | 317256/371472 [3:04:20<4:52:27,  3.09it/s]
 85%|████████▌ | 317257/371472 [3:04:20<4:34:01,  3.30it/s]
 85%|████████▌ | 317258/371472 [3:04:20<4:26:10,  3.39it/s]
 85%|████████▌ | 317259/371472 [3:04:21<4:42:18,  3.20it/s]
 85%|████████▌ | 317260/371472 [3:04:21<4:34:55,  3.29it/s]
                                                           
{'loss': 2.5495, 'learning_rate': 2.3141524273309054e-07, 'epoch': 13.66}

 85%|████████▌ | 317260/371472 [3:04:21<4:34:55,  3.29it/s]
 85%|████████▌ | 317261/371472 [3:04:21<4:38:27,  3.24it/s]
 85%|████████▌ | 317262/371472 [3:04:22<4:37:42,  3.25it/s]
 85%|████████▌ | 317263/371472 [3:04:22<4:42:58,  3.19it/s]
 85%|████████▌ | 317264/371472 [3:04:22<4:45:23,  3.17it/s]
 85%|████████▌ | 317265/371472 [3:04:23<4:33:53,  3.30it/s]
 85%|████████▌ | 317266/371472 [3:04:23<4:25:07,  3.41it/s]
 85%|████████▌ | 317267/371472 [3:04:23<4:21:37,  3.45it/s]
 85%|████████▌ | 317268/371472 [3:04:23<4:18:09,  3.50it/s]
 85%|████████▌ | 317269/371472 [3:04:24<4:19:54,  3.48it/s]
 85%|████████▌ | 317270/371472 [3:04:24<4:16:53,  3.52it/s]
 85%|████████▌ | 317271/371472 [3:04:24<4:34:32,  3.29it/s]
 85%|████████▌ | 317272/371472 [3:04:25<4:33:41,  3.30it/s]
 85%|████████▌ | 317273/371472 [3:04:25<4:21:36,  3.45it/s]
 85%|████████▌ | 317274/371472 [3:04:25<4:39:16,  3.23it/s]
 85%|████████▌ | 317275/371472 [3:04:26<4:27:40,  3.37it/s]
 85%|████████▌ | 317276/371472 [3:04:26<4:30:08,  3.34it/s]
 85%|████████▌ | 317277/371472 [3:04:26<4:26:47,  3.39it/s]
 85%|████████▌ | 317278/371472 [3:04:27<4:44:34,  3.17it/s]
 85%|████████▌ | 317279/371472 [3:04:27<4:28:39,  3.36it/s]
 85%|████████▌ | 317280/371472 [3:04:27<4:22:23,  3.44it/s]
                                                           
{'loss': 2.6552, 'learning_rate': 2.313667607576117e-07, 'epoch': 13.67}

 85%|████████▌ | 317280/371472 [3:04:27<4:22:23,  3.44it/s]
 85%|████████▌ | 317281/371472 [3:04:27<4:52:35,  3.09it/s]
 85%|████████▌ | 317282/371472 [3:04:28<4:33:04,  3.31it/s]
 85%|████████▌ | 317283/371472 [3:04:28<4:25:16,  3.40it/s]
 85%|████████▌ | 317284/371472 [3:04:28<4:24:22,  3.42it/s]
 85%|████████▌ | 317285/371472 [3:04:29<4:15:52,  3.53it/s]
 85%|████████▌ | 317286/371472 [3:04:29<4:24:58,  3.41it/s]
 85%|████████▌ | 317287/371472 [3:04:29<4:31:45,  3.32it/s]
 85%|████████▌ | 317288/371472 [3:04:29<4:22:17,  3.44it/s]
 85%|████████▌ | 317289/371472 [3:04:30<4:23:29,  3.43it/s]
 85%|████████▌ | 317290/371472 [3:04:30<4:14:07,  3.55it/s]
 85%|████████▌ | 317291/371472 [3:04:30<4:10:52,  3.60it/s]
 85%|████████▌ | 317292/371472 [3:04:31<4:11:20,  3.59it/s]
 85%|████████▌ | 317293/371472 [3:04:31<4:11:08,  3.60it/s]
 85%|████████▌ | 317294/371472 [3:04:31<4:15:16,  3.54it/s]
 85%|████████▌ | 317295/371472 [3:04:31<4:13:05,  3.57it/s]
 85%|████████▌ | 317296/371472 [3:04:32<4:04:40,  3.69it/s]
 85%|████████▌ | 317297/371472 [3:04:32<4:24:24,  3.41it/s]
 85%|████████▌ | 317298/371472 [3:04:32<4:15:20,  3.54it/s]
 85%|████████▌ | 317299/371472 [3:04:33<4:15:25,  3.53it/s]
 85%|████████▌ | 317300/371472 [3:04:33<4:03:22,  3.71it/s]
                                                           
{'loss': 2.6458, 'learning_rate': 2.3131827878213274e-07, 'epoch': 13.67}

 85%|████████▌ | 317300/371472 [3:04:33<4:03:22,  3.71it/s]
 85%|████████▌ | 317301/371472 [3:04:33<4:11:30,  3.59it/s]
 85%|████████▌ | 317302/371472 [3:04:33<4:27:58,  3.37it/s]
 85%|████████▌ | 317303/371472 [3:04:34<4:24:24,  3.41it/s]
 85%|████████▌ | 317304/371472 [3:04:34<4:16:37,  3.52it/s]
 85%|████████▌ | 317305/371472 [3:04:34<4:10:02,  3.61it/s]
 85%|████████▌ | 317306/371472 [3:04:34<4:13:24,  3.56it/s]
 85%|████████▌ | 317307/371472 [3:04:35<4:07:23,  3.65it/s]
 85%|████████▌ | 317308/371472 [3:04:35<4:00:36,  3.75it/s]
 85%|████████▌ | 317309/371472 [3:04:35<4:11:01,  3.60it/s]
 85%|████████▌ | 317310/371472 [3:04:36<4:03:16,  3.71it/s]
 85%|████████▌ | 317311/371472 [3:04:36<4:10:19,  3.61it/s]
 85%|████████▌ | 317312/371472 [3:04:36<4:10:24,  3.60it/s]
 85%|████████▌ | 317313/371472 [3:04:36<4:16:47,  3.52it/s]
 85%|████████▌ | 317314/371472 [3:04:37<4:19:36,  3.48it/s]
 85%|████████▌ | 317315/371472 [3:04:37<4:29:08,  3.35it/s]
 85%|████████▌ | 317316/371472 [3:04:37<4:25:35,  3.40it/s]
 85%|████████▌ | 317317/371472 [3:04:38<4:49:33,  3.12it/s]
 85%|████████▌ | 317318/371472 [3:04:38<4:33:08,  3.30it/s]
 85%|████████▌ | 317319/371472 [3:04:38<4:24:34,  3.41it/s]
 85%|████████▌ | 317320/371472 [3:04:39<4:25:11,  3.40it/s]
                                                           
{'loss': 2.74, 'learning_rate': 2.3126979680665394e-07, 'epoch': 13.67}

 85%|████████▌ | 317320/371472 [3:04:39<4:25:11,  3.40it/s]
 85%|████████▌ | 317321/371472 [3:04:39<4:18:42,  3.49it/s]
 85%|████████▌ | 317322/371472 [3:04:39<4:31:41,  3.32it/s]
 85%|████████▌ | 317323/371472 [3:04:39<4:22:15,  3.44it/s]
 85%|████████▌ | 317324/371472 [3:04:40<4:29:55,  3.34it/s]
 85%|████████▌ | 317325/371472 [3:04:40<4:34:32,  3.29it/s]
 85%|████████▌ | 317326/371472 [3:04:40<4:37:48,  3.25it/s]
 85%|████████▌ | 317327/371472 [3:04:41<4:36:19,  3.27it/s]
 85%|████████▌ | 317328/371472 [3:04:41<4:51:33,  3.10it/s]
 85%|████████▌ | 317329/371472 [3:04:41<4:33:13,  3.30it/s]
 85%|████████▌ | 317330/371472 [3:04:42<4:20:47,  3.46it/s]
 85%|████████▌ | 317331/371472 [3:04:42<4:04:19,  3.69it/s]
 85%|████████▌ | 317332/371472 [3:04:42<4:03:43,  3.70it/s]
 85%|████████▌ | 317333/371472 [3:04:42<4:03:51,  3.70it/s]
 85%|████████▌ | 317334/371472 [3:04:43<3:57:20,  3.80it/s]
 85%|████████▌ | 317335/371472 [3:04:43<3:52:49,  3.88it/s]
 85%|████████▌ | 317336/371472 [3:04:43<3:54:59,  3.84it/s]
 85%|████████▌ | 317337/371472 [3:04:43<3:49:59,  3.92it/s]
 85%|████████▌ | 317338/371472 [3:04:44<3:53:15,  3.87it/s]
 85%|████████▌ | 317339/371472 [3:04:44<3:52:52,  3.87it/s]
 85%|████████▌ | 317340/371472 [3:04:44<3:48:45,  3.94it/s]
                                                           
{'loss': 2.716, 'learning_rate': 2.3122131483117496e-07, 'epoch': 13.67}

 85%|████████▌ | 317340/371472 [3:04:44<3:48:45,  3.94it/s]
 85%|████████▌ | 317341/371472 [3:04:44<3:47:45,  3.96it/s]
 85%|████████▌ | 317342/371472 [3:04:45<3:44:57,  4.01it/s]
 85%|████████▌ | 317343/371472 [3:04:45<3:49:10,  3.94it/s]
 85%|████████▌ | 317344/371472 [3:04:45<4:12:03,  3.58it/s]
 85%|████████▌ | 317345/371472 [3:04:45<4:05:28,  3.68it/s]
 85%|████████▌ | 317346/371472 [3:04:46<3:55:31,  3.83it/s]
 85%|████████▌ | 317347/371472 [3:04:46<3:59:40,  3.76it/s]
 85%|████████▌ | 317348/371472 [3:04:46<4:03:10,  3.71it/s]
 85%|████████▌ | 317349/371472 [3:04:46<3:56:55,  3.81it/s]
 85%|████████▌ | 317350/371472 [3:04:47<3:55:37,  3.83it/s]
 85%|████████▌ | 317351/371472 [3:04:47<3:54:04,  3.85it/s]
 85%|████████▌ | 317352/371472 [3:04:47<3:55:25,  3.83it/s]
 85%|████████▌ | 317353/371472 [3:04:47<3:47:27,  3.97it/s]
 85%|████████▌ | 317354/371472 [3:04:48<3:55:10,  3.84it/s]
 85%|████████▌ | 317355/371472 [3:04:48<3:51:10,  3.90it/s]
 85%|████████▌ | 317356/371472 [3:04:48<3:48:23,  3.95it/s]
 85%|████████▌ | 317357/371472 [3:04:49<3:50:59,  3.90it/s]
 85%|████████▌ | 317358/371472 [3:04:49<3:59:00,  3.77it/s]
 85%|████████▌ | 317359/371472 [3:04:49<4:02:08,  3.72it/s]
 85%|████████▌ | 317360/371472 [3:04:49<4:09:06,  3.62it/s]
                                                           
{'loss': 2.7629, 'learning_rate': 2.311728328556961e-07, 'epoch': 13.67}

 85%|████████▌ | 317360/371472 [3:04:49<4:09:06,  3.62it/s]
 85%|████████▌ | 317361/371472 [3:04:50<4:03:45,  3.70it/s]
 85%|████████▌ | 317362/371472 [3:04:50<4:02:29,  3.72it/s]
 85%|████████▌ | 317363/371472 [3:04:50<4:13:20,  3.56it/s]
 85%|████████▌ | 317364/371472 [3:04:50<4:07:56,  3.64it/s]
 85%|████████▌ | 317365/371472 [3:04:51<4:03:17,  3.71it/s]
 85%|████████▌ | 317366/371472 [3:04:51<4:02:43,  3.72it/s]
 85%|████████▌ | 317367/371472 [3:04:51<4:09:06,  3.62it/s]
 85%|████████▌ | 317368/371472 [3:04:52<4:07:20,  3.65it/s]
 85%|████████▌ | 317369/371472 [3:04:52<4:13:57,  3.55it/s]
 85%|████████▌ | 317370/371472 [3:04:52<4:11:10,  3.59it/s]
 85%|████████▌ | 317371/371472 [3:04:52<4:32:19,  3.31it/s]
 85%|████████▌ | 317372/371472 [3:04:53<4:21:49,  3.44it/s]
 85%|████████▌ | 317373/371472 [3:04:53<4:19:46,  3.47it/s]
 85%|████████▌ | 317374/371472 [3:04:53<4:34:26,  3.29it/s]
 85%|████████▌ | 317375/371472 [3:04:54<4:24:09,  3.41it/s]
 85%|████████▌ | 317376/371472 [3:04:54<4:17:36,  3.50it/s]
 85%|████████▌ | 317377/371472 [3:04:54<4:14:16,  3.55it/s]
 85%|████████▌ | 317378/371472 [3:04:54<4:10:08,  3.60it/s]
 85%|████████▌ | 317379/371472 [3:04:55<4:06:59,  3.65it/s]
 85%|████████▌ | 317380/371472 [3:04:55<4:09:37,  3.61it/s]
                                                           
{'loss': 2.4614, 'learning_rate': 2.3112435088021718e-07, 'epoch': 13.67}

 85%|████████▌ | 317380/371472 [3:04:55<4:09:37,  3.61it/s]
 85%|████████▌ | 317381/371472 [3:04:55<4:34:44,  3.28it/s]
 85%|████████▌ | 317382/371472 [3:04:56<4:19:41,  3.47it/s]
 85%|████████▌ | 317383/371472 [3:04:56<4:13:27,  3.56it/s]
 85%|████████▌ | 317384/371472 [3:04:56<4:06:17,  3.66it/s]
 85%|████████▌ | 317385/371472 [3:04:56<4:04:23,  3.69it/s]
 85%|████████▌ | 317386/371472 [3:04:57<3:58:19,  3.78it/s]
 85%|████████▌ | 317387/371472 [3:04:57<3:50:24,  3.91it/s]
 85%|████████▌ | 317388/371472 [3:04:57<4:14:37,  3.54it/s]
 85%|████████▌ | 317389/371472 [3:04:58<4:16:55,  3.51it/s]
 85%|████████▌ | 317390/371472 [3:04:58<4:16:39,  3.51it/s]
 85%|████████▌ | 317391/371472 [3:04:58<4:18:09,  3.49it/s]
 85%|████████▌ | 317392/371472 [3:04:58<4:16:44,  3.51it/s]
 85%|████████▌ | 317393/371472 [3:04:59<4:05:44,  3.67it/s]
 85%|████████▌ | 317394/371472 [3:04:59<4:18:17,  3.49it/s]
 85%|████████▌ | 317395/371472 [3:04:59<4:16:52,  3.51it/s]
 85%|████████▌ | 317396/371472 [3:05:00<4:52:14,  3.08it/s]
 85%|████████▌ | 317397/371472 [3:05:00<4:34:19,  3.29it/s]
 85%|████████▌ | 317398/371472 [3:05:00<4:19:20,  3.48it/s]
 85%|████████▌ | 317399/371472 [3:05:00<4:10:07,  3.60it/s]
 85%|████████▌ | 317400/371472 [3:05:01<4:11:23,  3.58it/s]
                                                           
{'loss': 2.6294, 'learning_rate': 2.3107586890473833e-07, 'epoch': 13.67}

 85%|████████▌ | 317400/371472 [3:05:01<4:11:23,  3.58it/s]
 85%|████████▌ | 317401/371472 [3:05:01<4:03:22,  3.70it/s]
 85%|████████▌ | 317402/371472 [3:05:01<4:06:09,  3.66it/s]
 85%|████████▌ | 317403/371472 [3:05:01<3:56:39,  3.81it/s]
 85%|████████▌ | 317404/371472 [3:05:02<4:31:25,  3.32it/s]
 85%|████████▌ | 317405/371472 [3:05:02<4:18:38,  3.48it/s]
 85%|████████▌ | 317406/371472 [3:05:02<4:17:30,  3.50it/s]
 85%|████████▌ | 317407/371472 [3:05:03<4:32:39,  3.30it/s]
 85%|████████▌ | 317408/371472 [3:05:03<4:26:09,  3.39it/s]
 85%|████████▌ | 317409/371472 [3:05:03<4:25:57,  3.39it/s]
 85%|████████▌ | 317410/371472 [3:05:04<4:22:08,  3.44it/s]
 85%|████████▌ | 317411/371472 [3:05:04<4:33:01,  3.30it/s]
 85%|████████▌ | 317412/371472 [3:05:04<4:24:33,  3.41it/s]
 85%|████████▌ | 317413/371472 [3:05:04<4:13:30,  3.55it/s]
 85%|████████▌ | 317414/371472 [3:05:05<4:00:34,  3.75it/s]
 85%|████████▌ | 317415/371472 [3:05:05<3:53:21,  3.86it/s]
 85%|████████▌ | 317416/371472 [3:05:05<3:55:11,  3.83it/s]
 85%|████████▌ | 317417/371472 [3:05:05<3:55:24,  3.83it/s]
 85%|████████▌ | 317418/371472 [3:05:06<4:00:33,  3.75it/s]
 85%|████████▌ | 317419/371472 [3:05:06<4:01:18,  3.73it/s]
 85%|████████▌ | 317420/371472 [3:05:06<4:06:38,  3.65it/s]
                                                           
{'loss': 2.6722, 'learning_rate': 2.310273869292594e-07, 'epoch': 13.67}

 85%|████████▌ | 317420/371472 [3:05:06<4:06:38,  3.65it/s]
 85%|████████▌ | 317421/371472 [3:05:06<3:57:41,  3.79it/s]
 85%|████████▌ | 317422/371472 [3:05:07<4:39:58,  3.22it/s]
 85%|████████▌ | 317423/371472 [3:05:07<4:54:01,  3.06it/s]
 85%|████████▌ | 317424/371472 [3:05:08<4:32:22,  3.31it/s]
 85%|████████▌ | 317425/371472 [3:05:08<4:19:55,  3.47it/s]
 85%|████████▌ | 317426/371472 [3:05:08<4:19:47,  3.47it/s]
 85%|████████▌ | 317427/371472 [3:05:08<4:12:17,  3.57it/s]
 85%|████████▌ | 317428/371472 [3:05:09<4:03:23,  3.70it/s]
 85%|████████▌ | 317429/371472 [3:05:09<4:04:10,  3.69it/s]
 85%|████████▌ | 317430/371472 [3:05:09<4:08:59,  3.62it/s]
 85%|████████▌ | 317431/371472 [3:05:09<4:24:40,  3.40it/s]
 85%|████████▌ | 317432/371472 [3:05:10<4:18:07,  3.49it/s]
 85%|████████▌ | 317433/371472 [3:05:10<4:43:12,  3.18it/s]
 85%|████████▌ | 317434/371472 [3:05:10<4:25:46,  3.39it/s]
 85%|████████▌ | 317435/371472 [3:05:11<4:11:35,  3.58it/s]
 85%|████████▌ | 317436/371472 [3:05:11<4:08:12,  3.63it/s]
 85%|████████▌ | 317437/371472 [3:05:11<4:08:41,  3.62it/s]
 85%|████████▌ | 317438/371472 [3:05:11<4:04:52,  3.68it/s]
 85%|████████▌ | 317439/371472 [3:05:12<3:57:27,  3.79it/s]
 85%|████████▌ | 317440/371472 [3:05:12<4:09:03,  3.62it/s]
                                                           
{'loss': 2.6999, 'learning_rate': 2.3097890495378055e-07, 'epoch': 13.67}

 85%|████████▌ | 317440/371472 [3:05:12<4:09:03,  3.62it/s]
 85%|████████▌ | 317441/371472 [3:05:12<4:09:48,  3.60it/s]
 85%|████████▌ | 317442/371472 [3:05:13<4:04:59,  3.68it/s]
 85%|████████▌ | 317443/371472 [3:05:13<4:07:57,  3.63it/s]
 85%|████████▌ | 317444/371472 [3:05:13<4:04:34,  3.68it/s]
 85%|████████▌ | 317445/371472 [3:05:13<4:07:24,  3.64it/s]
 85%|████████▌ | 317446/371472 [3:05:14<4:01:52,  3.72it/s]
 85%|████████▌ | 317447/371472 [3:05:14<4:13:48,  3.55it/s]
 85%|████████▌ | 317448/371472 [3:05:14<4:12:31,  3.57it/s]
 85%|████████▌ | 317449/371472 [3:05:14<4:10:56,  3.59it/s]
 85%|████████▌ | 317450/371472 [3:05:15<4:04:10,  3.69it/s]
 85%|████████▌ | 317451/371472 [3:05:15<4:09:31,  3.61it/s]
 85%|████████▌ | 317452/371472 [3:05:15<4:03:13,  3.70it/s]
 85%|████████▌ | 317453/371472 [3:05:16<4:11:47,  3.58it/s]
 85%|████████▌ | 317454/371472 [3:05:16<4:00:09,  3.75it/s]
 85%|████████▌ | 317455/371472 [3:05:16<3:56:44,  3.80it/s]
 85%|████████▌ | 317456/371472 [3:05:16<4:02:25,  3.71it/s]
 85%|████████▌ | 317457/371472 [3:05:17<4:03:08,  3.70it/s]
 85%|████████▌ | 317458/371472 [3:05:17<4:04:14,  3.69it/s]
 85%|████████▌ | 317459/371472 [3:05:17<3:59:42,  3.76it/s]
 85%|████████▌ | 317460/371472 [3:05:17<4:15:00,  3.53it/s]
                                                           
{'loss': 2.4168, 'learning_rate': 2.309304229783016e-07, 'epoch': 13.67}

 85%|████████▌ | 317460/371472 [3:05:17<4:15:00,  3.53it/s]
 85%|████████▌ | 317461/371472 [3:05:18<4:04:37,  3.68it/s]
 85%|████████▌ | 317462/371472 [3:05:18<3:57:55,  3.78it/s]
 85%|████████▌ | 317463/371472 [3:05:18<3:50:51,  3.90it/s]
 85%|████████▌ | 317464/371472 [3:05:18<3:56:05,  3.81it/s]
 85%|████████▌ | 317465/371472 [3:05:19<4:01:16,  3.73it/s]
 85%|████████▌ | 317466/371472 [3:05:19<3:59:27,  3.76it/s]
 85%|████████▌ | 317467/371472 [3:05:19<3:56:55,  3.80it/s]
 85%|████████▌ | 317468/371472 [3:05:20<3:52:09,  3.88it/s]
 85%|████████▌ | 317469/371472 [3:05:20<4:35:44,  3.26it/s]
 85%|████████▌ | 317470/371472 [3:05:20<4:27:04,  3.37it/s]
 85%|████████▌ | 317471/371472 [3:05:21<4:49:05,  3.11it/s]
 85%|████████▌ | 317472/371472 [3:05:21<4:41:58,  3.19it/s]
 85%|████████▌ | 317473/371472 [3:05:21<4:29:08,  3.34it/s]
 85%|████████▌ | 317474/371472 [3:05:21<4:21:26,  3.44it/s]
 85%|████████▌ | 317475/371472 [3:05:22<4:11:45,  3.57it/s]
 85%|████████▌ | 317476/371472 [3:05:22<4:06:04,  3.66it/s]
 85%|████████▌ | 317477/371472 [3:05:22<4:06:36,  3.65it/s]
 85%|████████▌ | 317478/371472 [3:05:22<4:04:48,  3.68it/s]
 85%|████████▌ | 317479/371472 [3:05:23<4:04:35,  3.68it/s]
 85%|████████▌ | 317480/371472 [3:05:23<4:05:02,  3.67it/s]
                                                           
{'loss': 2.6829, 'learning_rate': 2.3088194100282278e-07, 'epoch': 13.67}

 85%|████████▌ | 317480/371472 [3:05:23<4:05:02,  3.67it/s]
 85%|████████▌ | 317481/371472 [3:05:23<3:59:10,  3.76it/s]
 85%|████████▌ | 317482/371472 [3:05:24<4:01:11,  3.73it/s]
 85%|████████▌ | 317483/371472 [3:05:24<4:13:42,  3.55it/s]
 85%|████████▌ | 317484/371472 [3:05:24<4:11:48,  3.57it/s]
 85%|████████▌ | 317485/371472 [3:05:24<4:07:42,  3.63it/s]
 85%|████████▌ | 317486/371472 [3:05:25<4:04:37,  3.68it/s]
 85%|████████▌ | 317487/371472 [3:05:25<4:14:31,  3.54it/s]
 85%|████████▌ | 317488/371472 [3:05:25<4:14:55,  3.53it/s]
 85%|████████▌ | 317489/371472 [3:05:26<4:21:14,  3.44it/s]
 85%|████████▌ | 317490/371472 [3:05:26<4:18:22,  3.48it/s]
 85%|████████▌ | 317491/371472 [3:05:26<4:21:20,  3.44it/s]
 85%|████████▌ | 317492/371472 [3:05:26<4:36:59,  3.25it/s]
 85%|████████▌ | 317493/371472 [3:05:27<4:34:48,  3.27it/s]
 85%|████████▌ | 317494/371472 [3:05:27<4:32:18,  3.30it/s]
 85%|████████▌ | 317495/371472 [3:05:27<4:26:15,  3.38it/s]
 85%|████████▌ | 317496/371472 [3:05:28<4:17:48,  3.49it/s]
 85%|████████▌ | 317497/371472 [3:05:28<4:26:19,  3.38it/s]
 85%|████████▌ | 317498/371472 [3:05:28<4:14:44,  3.53it/s]
 85%|████████▌ | 317499/371472 [3:05:28<4:20:07,  3.46it/s]
 85%|████████▌ | 317500/371472 [3:05:29<4:23:11,  3.42it/s]
                                                           
{'loss': 2.7317, 'learning_rate': 2.3083345902734382e-07, 'epoch': 13.68}

 85%|████████▌ | 317500/371472 [3:05:29<4:23:11,  3.42it/s]
 85%|████████▌ | 317501/371472 [3:05:29<4:45:52,  3.15it/s]
 85%|████████▌ | 317502/371472 [3:05:29<4:43:15,  3.18it/s]
 85%|████████▌ | 317503/371472 [3:05:30<4:38:59,  3.22it/s]
 85%|████████▌ | 317504/371472 [3:05:30<4:32:06,  3.31it/s]
 85%|████████▌ | 317505/371472 [3:05:30<4:19:40,  3.46it/s]
 85%|████████▌ | 317506/371472 [3:05:31<4:30:27,  3.33it/s]
 85%|████████▌ | 317507/371472 [3:05:31<4:38:38,  3.23it/s]
 85%|████████▌ | 317508/371472 [3:05:31<4:35:20,  3.27it/s]
 85%|████████▌ | 317509/371472 [3:05:32<4:35:38,  3.26it/s]
 85%|████████▌ | 317510/371472 [3:05:32<4:19:17,  3.47it/s]
 85%|████████▌ | 317511/371472 [3:05:32<4:28:36,  3.35it/s]
 85%|████████▌ | 317512/371472 [3:05:32<4:18:01,  3.49it/s]
 85%|████████▌ | 317513/371472 [3:05:33<4:31:27,  3.31it/s]
 85%|████████▌ | 317514/371472 [3:05:33<4:42:36,  3.18it/s]
 85%|████████▌ | 317515/371472 [3:05:33<4:43:54,  3.17it/s]
 85%|████████▌ | 317516/371472 [3:05:34<4:47:26,  3.13it/s]
 85%|████████▌ | 317517/371472 [3:05:34<4:35:07,  3.27it/s]
 85%|████████▌ | 317518/371472 [3:05:34<4:34:53,  3.27it/s]
 85%|████████▌ | 317519/371472 [3:05:35<4:21:15,  3.44it/s]
 85%|████████▌ | 317520/371472 [3:05:35<4:53:35,  3.06it/s]
                                                           
{'loss': 2.3154, 'learning_rate': 2.307849770518649e-07, 'epoch': 13.68}

 85%|████████▌ | 317520/371472 [3:05:35<4:53:35,  3.06it/s]
 85%|████████▌ | 317521/371472 [3:05:35<4:55:48,  3.04it/s]
 85%|████████▌ | 317522/371472 [3:05:36<4:39:32,  3.22it/s]
 85%|████████▌ | 317523/371472 [3:05:36<4:22:36,  3.42it/s]
 85%|████████▌ | 317524/371472 [3:05:36<4:19:19,  3.47it/s]
 85%|████████▌ | 317525/371472 [3:05:36<4:11:03,  3.58it/s]
 85%|████████▌ | 317526/371472 [3:05:37<4:09:05,  3.61it/s]
 85%|████████▌ | 317527/371472 [3:05:37<4:05:26,  3.66it/s]
 85%|████████▌ | 317528/371472 [3:05:37<4:03:31,  3.69it/s]
 85%|████████▌ | 317529/371472 [3:05:37<4:09:01,  3.61it/s]
 85%|████████▌ | 317530/371472 [3:05:38<4:08:07,  3.62it/s]
 85%|████████▌ | 317531/371472 [3:05:38<4:02:12,  3.71it/s]
 85%|████████▌ | 317532/371472 [3:05:38<4:09:05,  3.61it/s]
 85%|████████▌ | 317533/371472 [3:05:39<4:01:31,  3.72it/s]
 85%|████████▌ | 317534/371472 [3:05:39<3:56:16,  3.80it/s]
 85%|████████▌ | 317535/371472 [3:05:39<4:07:48,  3.63it/s]
 85%|████████▌ | 317536/371472 [3:05:39<4:05:15,  3.67it/s]
 85%|████████▌ | 317537/371472 [3:05:40<4:23:48,  3.41it/s]
 85%|████████▌ | 317538/371472 [3:05:40<4:15:47,  3.51it/s]
 85%|████████▌ | 317539/371472 [3:05:40<4:05:49,  3.66it/s]
 85%|████████▌ | 317540/371472 [3:05:41<4:13:15,  3.55it/s]
                                                           
{'loss': 2.6433, 'learning_rate': 2.3073649507638604e-07, 'epoch': 13.68}

 85%|████████▌ | 317540/371472 [3:05:41<4:13:15,  3.55it/s]
 85%|████████▌ | 317541/371472 [3:05:41<4:21:48,  3.43it/s]
 85%|████████▌ | 317542/371472 [3:05:41<4:31:33,  3.31it/s]
 85%|████████▌ | 317543/371472 [3:05:41<4:18:02,  3.48it/s]
 85%|████████▌ | 317544/371472 [3:05:42<4:12:39,  3.56it/s]
 85%|████████▌ | 317545/371472 [3:05:42<4:07:09,  3.64it/s]
 85%|████████▌ | 317546/371472 [3:05:42<4:28:33,  3.35it/s]
 85%|████████▌ | 317547/371472 [3:05:43<4:19:39,  3.46it/s]
 85%|████████▌ | 317548/371472 [3:05:43<4:18:16,  3.48it/s]
 85%|████████▌ | 317549/371472 [3:05:43<4:11:08,  3.58it/s]
 85%|████████▌ | 317550/371472 [3:05:43<4:02:39,  3.70it/s]
 85%|████████▌ | 317551/371472 [3:05:44<3:59:00,  3.76it/s]
 85%|████████▌ | 317552/371472 [3:05:44<4:05:49,  3.66it/s]
 85%|████████▌ | 317553/371472 [3:05:44<4:04:33,  3.67it/s]
 85%|████████▌ | 317554/371472 [3:05:44<4:00:26,  3.74it/s]
 85%|████████▌ | 317555/371472 [3:05:45<4:01:16,  3.72it/s]
 85%|████████▌ | 317556/371472 [3:05:45<4:00:59,  3.73it/s]
 85%|████████▌ | 317557/371472 [3:05:45<3:55:46,  3.81it/s]
 85%|████████▌ | 317558/371472 [3:05:45<4:02:57,  3.70it/s]
 85%|████████▌ | 317559/371472 [3:05:46<3:59:56,  3.74it/s]
 85%|████████▌ | 317560/371472 [3:05:46<4:07:54,  3.62it/s]
                                                           
{'loss': 2.4515, 'learning_rate': 2.3068801310090712e-07, 'epoch': 13.68}

 85%|████████▌ | 317560/371472 [3:05:46<4:07:54,  3.62it/s]
 85%|████████▌ | 317561/371472 [3:05:46<4:08:12,  3.62it/s]
 85%|████████▌ | 317562/371472 [3:05:47<4:13:43,  3.54it/s]
 85%|████████▌ | 317563/371472 [3:05:47<4:09:08,  3.61it/s]
 85%|████████▌ | 317564/371472 [3:05:47<4:07:33,  3.63it/s]
 85%|████████▌ | 317565/371472 [3:05:47<4:13:57,  3.54it/s]
 85%|████████▌ | 317566/371472 [3:05:48<4:18:08,  3.48it/s]
 85%|████████▌ | 317567/371472 [3:05:48<4:10:47,  3.58it/s]
 85%|████████▌ | 317568/371472 [3:05:48<4:05:45,  3.66it/s]
 85%|████████▌ | 317569/371472 [3:05:49<4:04:51,  3.67it/s]
 85%|████████▌ | 317570/371472 [3:05:49<4:00:33,  3.73it/s]
 85%|████████▌ | 317571/371472 [3:05:49<3:53:16,  3.85it/s]
 85%|████████▌ | 317572/371472 [3:05:49<4:08:09,  3.62it/s]
 85%|████████▌ | 317573/371472 [3:05:50<4:06:05,  3.65it/s]
 85%|████████▌ | 317574/371472 [3:05:50<4:02:08,  3.71it/s]
 85%|████████▌ | 317575/371472 [3:05:50<3:57:41,  3.78it/s]
 85%|████████▌ | 317576/371472 [3:05:50<3:53:17,  3.85it/s]
 85%|████████▌ | 317577/371472 [3:05:51<3:51:28,  3.88it/s]
 85%|████████▌ | 317578/371472 [3:05:51<3:55:51,  3.81it/s]
 85%|████████▌ | 317579/371472 [3:05:51<3:56:24,  3.80it/s]
 85%|████████▌ | 317580/371472 [3:05:51<3:59:44,  3.75it/s]
                                                           
{'loss': 2.6021, 'learning_rate': 2.3063953112542827e-07, 'epoch': 13.68}

 85%|████████▌ | 317580/371472 [3:05:51<3:59:44,  3.75it/s]
 85%|████████▌ | 317581/371472 [3:05:52<4:06:27,  3.64it/s]
 85%|████████▌ | 317582/371472 [3:05:52<4:06:24,  3.65it/s]
 85%|████████▌ | 317583/371472 [3:05:52<4:12:20,  3.56it/s]
 85%|████████▌ | 317584/371472 [3:05:53<4:16:15,  3.50it/s]
 85%|████████▌ | 317585/371472 [3:05:53<4:10:32,  3.58it/s]
 85%|████████▌ | 317586/371472 [3:05:53<4:09:35,  3.60it/s]
 85%|████████▌ | 317587/371472 [3:05:53<4:01:12,  3.72it/s]
 85%|████████▌ | 317588/371472 [3:05:54<4:10:21,  3.59it/s]
 85%|████████▌ | 317589/371472 [3:05:54<4:07:23,  3.63it/s]
 85%|████████▌ | 317590/371472 [3:05:54<4:09:49,  3.59it/s]
 85%|████████▌ | 317591/371472 [3:05:55<4:08:05,  3.62it/s]
 85%|████████▌ | 317592/371472 [3:05:55<4:03:22,  3.69it/s]
 85%|████████▌ | 317593/371472 [3:05:55<3:58:28,  3.77it/s]
 85%|████████▌ | 317594/371472 [3:05:55<3:59:06,  3.76it/s]
 85%|████████▌ | 317595/371472 [3:05:56<3:54:42,  3.83it/s]
 85%|████████▌ | 317596/371472 [3:05:56<4:07:10,  3.63it/s]
 85%|████████▌ | 317597/371472 [3:05:56<4:08:17,  3.62it/s]
 85%|████████▌ | 317598/371472 [3:05:56<4:03:45,  3.68it/s]
 85%|████████▌ | 317599/371472 [3:05:57<4:10:55,  3.58it/s]
 85%|████████▌ | 317600/371472 [3:05:57<3:58:54,  3.76it/s]
                                                           
{'loss': 2.7584, 'learning_rate': 2.305910491499493e-07, 'epoch': 13.68}

 85%|████████▌ | 317600/371472 [3:05:57<3:58:54,  3.76it/s]
 85%|████████▌ | 317601/371472 [3:05:57<4:02:41,  3.70it/s]
 85%|████████▌ | 317602/371472 [3:05:58<4:16:10,  3.50it/s]
 85%|████████▌ | 317603/371472 [3:05:58<4:06:50,  3.64it/s]
 85%|████████▌ | 317604/371472 [3:05:58<4:05:41,  3.65it/s]
 85%|████████▌ | 317605/371472 [3:05:58<4:18:03,  3.48it/s]
 85%|████████▌ | 317606/371472 [3:05:59<4:04:37,  3.67it/s]
 85%|████████▌ | 317607/371472 [3:05:59<4:20:53,  3.44it/s]
 85%|████████▌ | 317608/371472 [3:05:59<4:30:41,  3.32it/s]
 86%|████████▌ | 317609/371472 [3:06:00<4:19:20,  3.46it/s]
 86%|████████▌ | 317610/371472 [3:06:00<4:05:15,  3.66it/s]
 86%|████████▌ | 317611/371472 [3:06:00<4:07:29,  3.63it/s]
 86%|████████▌ | 317612/371472 [3:06:00<4:08:29,  3.61it/s]
 86%|████████▌ | 317613/371472 [3:06:01<4:06:37,  3.64it/s]
 86%|████████▌ | 317614/371472 [3:06:01<4:04:38,  3.67it/s]
 86%|████████▌ | 317615/371472 [3:06:01<3:56:57,  3.79it/s]
 86%|████████▌ | 317616/371472 [3:06:01<4:03:00,  3.69it/s]
 86%|████████▌ | 317617/371472 [3:06:02<4:08:38,  3.61it/s]
 86%|████████▌ | 317618/371472 [3:06:02<4:03:23,  3.69it/s]
 86%|████████▌ | 317619/371472 [3:06:02<4:04:23,  3.67it/s]
 86%|████████▌ | 317620/371472 [3:06:03<4:07:59,  3.62it/s]
                                                           
{'loss': 2.6365, 'learning_rate': 2.3054256717447046e-07, 'epoch': 13.68}

 86%|████████▌ | 317620/371472 [3:06:03<4:07:59,  3.62it/s]
 86%|████████▌ | 317621/371472 [3:06:03<4:16:33,  3.50it/s]
 86%|████████▌ | 317622/371472 [3:06:03<4:07:30,  3.63it/s]
 86%|████████▌ | 317623/371472 [3:06:03<4:09:35,  3.60it/s]
 86%|████████▌ | 317624/371472 [3:06:04<4:19:13,  3.46it/s]
 86%|████████▌ | 317625/371472 [3:06:04<4:13:34,  3.54it/s]
 86%|████████▌ | 317626/371472 [3:06:04<4:23:10,  3.41it/s]
 86%|████████▌ | 317627/371472 [3:06:05<4:26:14,  3.37it/s]
 86%|████████▌ | 317628/371472 [3:06:05<4:16:09,  3.50it/s]
 86%|████████▌ | 317629/371472 [3:06:05<4:09:36,  3.60it/s]
 86%|████████▌ | 317630/371472 [3:06:05<4:31:54,  3.30it/s]
 86%|████████▌ | 317631/371472 [3:06:06<4:21:22,  3.43it/s]
 86%|████████▌ | 317632/371472 [3:06:06<4:33:11,  3.28it/s]
 86%|████████▌ | 317633/371472 [3:06:06<4:18:42,  3.47it/s]
 86%|████████▌ | 317634/371472 [3:06:07<4:11:15,  3.57it/s]
 86%|████████▌ | 317635/371472 [3:06:07<4:18:03,  3.48it/s]
 86%|████████▌ | 317636/371472 [3:06:07<4:16:48,  3.49it/s]
 86%|████████▌ | 317637/371472 [3:06:07<4:26:17,  3.37it/s]
 86%|████████▌ | 317638/371472 [3:06:08<4:17:46,  3.48it/s]
 86%|████████▌ | 317639/371472 [3:06:08<4:13:41,  3.54it/s]
 86%|████████▌ | 317640/371472 [3:06:08<4:08:13,  3.61it/s]
                                                           
{'loss': 2.6376, 'learning_rate': 2.3049408519899153e-07, 'epoch': 13.68}

 86%|████████▌ | 317640/371472 [3:06:08<4:08:13,  3.61it/s]
 86%|████████▌ | 317641/371472 [3:06:09<3:57:51,  3.77it/s]
 86%|████████▌ | 317642/371472 [3:06:09<4:01:23,  3.72it/s]
 86%|████████▌ | 317643/371472 [3:06:09<4:32:36,  3.29it/s]
 86%|████████▌ | 317644/371472 [3:06:09<4:32:47,  3.29it/s]
 86%|████████▌ | 317645/371472 [3:06:10<4:30:02,  3.32it/s]
 86%|████████▌ | 317646/371472 [3:06:10<4:14:43,  3.52it/s]
 86%|████████▌ | 317647/371472 [3:06:10<4:03:09,  3.69it/s]
 86%|████████▌ | 317648/371472 [3:06:11<4:04:03,  3.68it/s]
 86%|████████▌ | 317649/371472 [3:06:11<3:56:18,  3.80it/s]
 86%|████████▌ | 317650/371472 [3:06:11<4:09:59,  3.59it/s]
 86%|████████▌ | 317651/371472 [3:06:11<4:11:12,  3.57it/s]
 86%|████████▌ | 317652/371472 [3:06:12<4:15:10,  3.52it/s]
 86%|████████▌ | 317653/371472 [3:06:12<4:05:00,  3.66it/s]
 86%|████████▌ | 317654/371472 [3:06:12<3:59:00,  3.75it/s]
 86%|████████▌ | 317655/371472 [3:06:12<4:02:37,  3.70it/s]
 86%|████████▌ | 317656/371472 [3:06:13<4:09:34,  3.59it/s]
 86%|████████▌ | 317657/371472 [3:06:13<4:05:18,  3.66it/s]
 86%|████████▌ | 317658/371472 [3:06:13<4:00:23,  3.73it/s]
 86%|████████▌ | 317659/371472 [3:06:14<3:57:50,  3.77it/s]
 86%|████████▌ | 317660/371472 [3:06:14<4:19:08,  3.46it/s]
                                                           
{'loss': 2.5223, 'learning_rate': 2.3044560322351269e-07, 'epoch': 13.68}

 86%|████████▌ | 317660/371472 [3:06:14<4:19:08,  3.46it/s]
 86%|████████▌ | 317661/371472 [3:06:14<4:13:32,  3.54it/s]
 86%|████████▌ | 317662/371472 [3:06:14<4:15:35,  3.51it/s]
 86%|████████▌ | 317663/371472 [3:06:15<4:22:31,  3.42it/s]
 86%|████████▌ | 317664/371472 [3:06:15<4:13:57,  3.53it/s]
 86%|████████▌ | 317665/371472 [3:06:15<4:03:02,  3.69it/s]
 86%|████████▌ | 317666/371472 [3:06:15<4:03:06,  3.69it/s]
 86%|████████▌ | 317667/371472 [3:06:16<4:10:11,  3.58it/s]
 86%|████████▌ | 317668/371472 [3:06:16<4:10:00,  3.59it/s]
 86%|████████▌ | 317669/371472 [3:06:16<4:05:00,  3.66it/s]
 86%|████████▌ | 317670/371472 [3:06:17<4:10:12,  3.58it/s]
 86%|████████▌ | 317671/371472 [3:06:17<3:59:21,  3.75it/s]
 86%|████████▌ | 317672/371472 [3:06:17<3:59:03,  3.75it/s]
 86%|████████▌ | 317673/371472 [3:06:17<3:57:01,  3.78it/s]
 86%|████████▌ | 317674/371472 [3:06:18<3:56:09,  3.80it/s]
 86%|████████▌ | 317675/371472 [3:06:18<4:01:55,  3.71it/s]
 86%|████████▌ | 317676/371472 [3:06:18<4:23:52,  3.40it/s]
 86%|████████▌ | 317677/371472 [3:06:19<4:47:41,  3.12it/s]
 86%|████████▌ | 317678/371472 [3:06:19<4:44:38,  3.15it/s]
 86%|████████▌ | 317679/371472 [3:06:19<4:26:53,  3.36it/s]
 86%|████████▌ | 317680/371472 [3:06:19<4:17:47,  3.48it/s]
                                                           
{'loss': 2.4847, 'learning_rate': 2.3039712124803373e-07, 'epoch': 13.68}

 86%|████████▌ | 317680/371472 [3:06:19<4:17:47,  3.48it/s]
 86%|████████▌ | 317681/371472 [3:06:20<4:18:34,  3.47it/s]
 86%|████████▌ | 317682/371472 [3:06:20<4:13:39,  3.53it/s]
 86%|████████▌ | 317683/371472 [3:06:20<4:03:14,  3.69it/s]
 86%|████████▌ | 317684/371472 [3:06:21<4:02:32,  3.70it/s]
 86%|████████▌ | 317685/371472 [3:06:21<3:56:13,  3.79it/s]
 86%|████████▌ | 317686/371472 [3:06:21<3:59:14,  3.75it/s]
 86%|████████▌ | 317687/371472 [3:06:21<4:12:00,  3.56it/s]
 86%|████████▌ | 317688/371472 [3:06:22<4:07:33,  3.62it/s]
 86%|████████▌ | 317689/371472 [3:06:22<4:04:51,  3.66it/s]
 86%|████████▌ | 317690/371472 [3:06:22<4:05:57,  3.64it/s]
 86%|████████▌ | 317691/371472 [3:06:22<4:05:40,  3.65it/s]
 86%|████████▌ | 317692/371472 [3:06:23<4:05:25,  3.65it/s]
 86%|████████▌ | 317693/371472 [3:06:23<4:02:29,  3.70it/s]
 86%|████████▌ | 317694/371472 [3:06:23<4:08:02,  3.61it/s]
 86%|████████▌ | 317695/371472 [3:06:24<4:16:50,  3.49it/s]
 86%|████████▌ | 317696/371472 [3:06:24<4:08:54,  3.60it/s]
 86%|████████▌ | 317697/371472 [3:06:24<4:10:38,  3.58it/s]
 86%|████████▌ | 317698/371472 [3:06:24<4:09:35,  3.59it/s]
 86%|████████▌ | 317699/371472 [3:06:25<4:04:45,  3.66it/s]
 86%|████████▌ | 317700/371472 [3:06:25<4:01:57,  3.70it/s]
                                                           
{'loss': 2.5939, 'learning_rate': 2.303486392725549e-07, 'epoch': 13.68}

 86%|████████▌ | 317700/371472 [3:06:25<4:01:57,  3.70it/s]
 86%|████████▌ | 317701/371472 [3:06:25<4:02:17,  3.70it/s]
 86%|████████▌ | 317702/371472 [3:06:26<4:03:23,  3.68it/s]
 86%|████████▌ | 317703/371472 [3:06:26<4:13:58,  3.53it/s]
 86%|████████▌ | 317704/371472 [3:06:26<4:12:24,  3.55it/s]
 86%|████████▌ | 317705/371472 [3:06:26<4:13:17,  3.54it/s]
 86%|████████▌ | 317706/371472 [3:06:27<4:22:28,  3.41it/s]
 86%|████████▌ | 317707/371472 [3:06:27<4:27:51,  3.35it/s]
 86%|████████▌ | 317708/371472 [3:06:27<4:11:54,  3.56it/s]
 86%|████████▌ | 317709/371472 [3:06:28<4:46:43,  3.13it/s]
 86%|████████▌ | 317710/371472 [3:06:28<4:47:07,  3.12it/s]
 86%|████████▌ | 317711/371472 [3:06:28<4:28:59,  3.33it/s]
 86%|████████▌ | 317712/371472 [3:06:29<4:20:46,  3.44it/s]
 86%|████████▌ | 317713/371472 [3:06:29<4:21:42,  3.42it/s]
 86%|████████▌ | 317714/371472 [3:06:29<4:14:25,  3.52it/s]
 86%|████████▌ | 317715/371472 [3:06:29<4:05:39,  3.65it/s]
 86%|████████▌ | 317716/371472 [3:06:30<4:18:41,  3.46it/s]
 86%|████████▌ | 317717/371472 [3:06:30<4:10:53,  3.57it/s]
 86%|████████▌ | 317718/371472 [3:06:30<4:07:03,  3.63it/s]
 86%|████████▌ | 317719/371472 [3:06:30<4:11:38,  3.56it/s]
 86%|████████▌ | 317720/371472 [3:06:31<4:05:28,  3.65it/s]
                                                           
{'loss': 2.6626, 'learning_rate': 2.3030015729707595e-07, 'epoch': 13.68}

 86%|████████▌ | 317720/371472 [3:06:31<4:05:28,  3.65it/s]
 86%|████████▌ | 317721/371472 [3:06:31<4:07:54,  3.61it/s]
 86%|████████▌ | 317722/371472 [3:06:31<4:02:08,  3.70it/s]
 86%|████████▌ | 317723/371472 [3:06:32<4:03:11,  3.68it/s]
 86%|████████▌ | 317724/371472 [3:06:32<4:03:38,  3.68it/s]
 86%|████████▌ | 317725/371472 [3:06:32<4:09:01,  3.60it/s]
 86%|████████▌ | 317726/371472 [3:06:32<4:18:18,  3.47it/s]
 86%|████████▌ | 317727/371472 [3:06:33<4:06:25,  3.64it/s]
 86%|████████▌ | 317728/371472 [3:06:33<4:04:24,  3.66it/s]
 86%|████████▌ | 317729/371472 [3:06:33<4:03:55,  3.67it/s]
 86%|████████▌ | 317730/371472 [3:06:33<3:57:32,  3.77it/s]
 86%|████████▌ | 317731/371472 [3:06:34<3:58:04,  3.76it/s]
 86%|████████▌ | 317732/371472 [3:06:34<3:53:01,  3.84it/s]
 86%|████████▌ | 317733/371472 [3:06:34<4:03:28,  3.68it/s]
 86%|████████▌ | 317734/371472 [3:06:35<4:08:47,  3.60it/s]
 86%|████████▌ | 317735/371472 [3:06:35<4:19:52,  3.45it/s]
 86%|████████▌ | 317736/371472 [3:06:35<4:10:10,  3.58it/s]
 86%|████████▌ | 317737/371472 [3:06:35<4:28:51,  3.33it/s]
 86%|████████▌ | 317738/371472 [3:06:36<4:14:07,  3.52it/s]
 86%|████████▌ | 317739/371472 [3:06:36<4:17:15,  3.48it/s]
 86%|████████▌ | 317740/371472 [3:06:36<4:15:13,  3.51it/s]
                                                           
{'loss': 2.5535, 'learning_rate': 2.302516753215971e-07, 'epoch': 13.69}

 86%|████████▌ | 317740/371472 [3:06:36<4:15:13,  3.51it/s]
 86%|████████▌ | 317741/371472 [3:06:37<4:45:37,  3.14it/s]
 86%|████████▌ | 317742/371472 [3:06:37<4:28:53,  3.33it/s]
 86%|████████▌ | 317743/371472 [3:06:37<4:25:54,  3.37it/s]
 86%|████████▌ | 317744/371472 [3:06:38<4:21:31,  3.42it/s]
 86%|████████▌ | 317745/371472 [3:06:38<4:26:48,  3.36it/s]
 86%|████████▌ | 317746/371472 [3:06:38<4:17:45,  3.47it/s]
 86%|████████▌ | 317747/371472 [3:06:38<4:20:20,  3.44it/s]
 86%|████████▌ | 317748/371472 [3:06:39<4:22:53,  3.41it/s]
 86%|████████▌ | 317749/371472 [3:06:39<4:15:04,  3.51it/s]
 86%|████████▌ | 317750/371472 [3:06:39<4:10:33,  3.57it/s]
 86%|████████▌ | 317751/371472 [3:06:40<4:24:52,  3.38it/s]
 86%|████████▌ | 317752/371472 [3:06:40<4:10:06,  3.58it/s]
 86%|████████▌ | 317753/371472 [3:06:40<4:01:54,  3.70it/s]
 86%|████████▌ | 317754/371472 [3:06:40<4:01:31,  3.71it/s]
 86%|████████▌ | 317755/371472 [3:06:41<4:09:56,  3.58it/s]
 86%|████████▌ | 317756/371472 [3:06:41<4:00:17,  3.73it/s]
 86%|████████▌ | 317757/371472 [3:06:41<3:59:38,  3.74it/s]
 86%|████████▌ | 317758/371472 [3:06:41<3:59:19,  3.74it/s]
 86%|████████▌ | 317759/371472 [3:06:42<3:56:25,  3.79it/s]
 86%|████████▌ | 317760/371472 [3:06:42<3:56:19,  3.79it/s]
                                                           
{'loss': 2.598, 'learning_rate': 2.3020319334611818e-07, 'epoch': 13.69}

 86%|████████▌ | 317760/371472 [3:06:42<3:56:19,  3.79it/s]
 86%|████████▌ | 317761/371472 [3:06:42<4:03:16,  3.68it/s]
 86%|████████▌ | 317762/371472 [3:06:42<3:59:32,  3.74it/s]
 86%|████████▌ | 317763/371472 [3:06:43<3:59:34,  3.74it/s]
 86%|████████▌ | 317764/371472 [3:06:43<3:56:41,  3.78it/s]
 86%|████████▌ | 317765/371472 [3:06:43<3:55:17,  3.80it/s]
 86%|████████▌ | 317766/371472 [3:06:44<4:01:29,  3.71it/s]
 86%|████████▌ | 317767/371472 [3:06:44<3:50:29,  3.88it/s]
 86%|████████▌ | 317768/371472 [3:06:44<3:58:03,  3.76it/s]
 86%|████████▌ | 317769/371472 [3:06:44<4:01:59,  3.70it/s]
 86%|████████▌ | 317770/371472 [3:06:45<4:07:47,  3.61it/s]
 86%|████████▌ | 317771/371472 [3:06:45<4:22:52,  3.40it/s]
 86%|████████▌ | 317772/371472 [3:06:45<4:09:53,  3.58it/s]
 86%|████████▌ | 317773/371472 [3:06:45<4:03:20,  3.68it/s]
 86%|████████▌ | 317774/371472 [3:06:46<4:47:31,  3.11it/s]
 86%|████████▌ | 317775/371472 [3:06:46<4:47:24,  3.11it/s]
 86%|████████▌ | 317776/371472 [3:06:46<4:40:10,  3.19it/s]
 86%|████████▌ | 317777/371472 [3:06:47<4:29:32,  3.32it/s]
 86%|████████▌ | 317778/371472 [3:06:47<4:19:25,  3.45it/s]
 86%|████████▌ | 317779/371472 [3:06:47<4:24:28,  3.38it/s]
 86%|████████▌ | 317780/371472 [3:06:48<4:30:10,  3.31it/s]
                                                           
{'loss': 2.5754, 'learning_rate': 2.3015471137063933e-07, 'epoch': 13.69}

 86%|████████▌ | 317780/371472 [3:06:48<4:30:10,  3.31it/s]
 86%|████████▌ | 317781/371472 [3:06:48<4:41:41,  3.18it/s]
 86%|████████▌ | 317782/371472 [3:06:48<4:30:16,  3.31it/s]
 86%|████████▌ | 317783/371472 [3:06:49<4:35:37,  3.25it/s]
 86%|████████▌ | 317784/371472 [3:06:49<4:16:44,  3.49it/s]
 86%|████████▌ | 317785/371472 [3:06:49<4:12:48,  3.54it/s]
 86%|████████▌ | 317786/371472 [3:06:49<4:24:34,  3.38it/s]
 86%|████████▌ | 317787/371472 [3:06:50<4:21:24,  3.42it/s]
 86%|████████▌ | 317788/371472 [3:06:50<4:09:27,  3.59it/s]
 86%|████████▌ | 317789/371472 [3:06:50<4:16:31,  3.49it/s]
 86%|████████▌ | 317790/371472 [3:06:51<4:03:52,  3.67it/s]
 86%|████████▌ | 317791/371472 [3:06:51<3:56:55,  3.78it/s]
 86%|████████▌ | 317792/371472 [3:06:51<3:59:04,  3.74it/s]
 86%|████████▌ | 317793/371472 [3:06:51<3:51:18,  3.87it/s]
 86%|████████▌ | 317794/371472 [3:06:52<3:47:30,  3.93it/s]
 86%|████████▌ | 317795/371472 [3:06:52<3:58:42,  3.75it/s]
 86%|████████▌ | 317796/371472 [3:06:52<4:05:34,  3.64it/s]
 86%|████████▌ | 317797/371472 [3:06:52<4:07:31,  3.61it/s]
 86%|████████▌ | 317798/371472 [3:06:53<4:10:43,  3.57it/s]
 86%|████████▌ | 317799/371472 [3:06:53<3:58:08,  3.76it/s]
 86%|████████▌ | 317800/371472 [3:06:53<4:02:45,  3.68it/s]
                                                           
{'loss': 2.6186, 'learning_rate': 2.301062293951604e-07, 'epoch': 13.69}

 86%|████████▌ | 317800/371472 [3:06:53<4:02:45,  3.68it/s]
 86%|████████▌ | 317801/371472 [3:06:53<3:57:06,  3.77it/s]
 86%|████████▌ | 317802/371472 [3:06:54<3:52:33,  3.85it/s]
 86%|████████▌ | 317803/371472 [3:06:54<3:47:31,  3.93it/s]
 86%|████████▌ | 317804/371472 [3:06:54<3:48:34,  3.91it/s]
 86%|████████▌ | 317805/371472 [3:06:54<4:00:04,  3.73it/s]
 86%|████████▌ | 317806/371472 [3:06:55<4:07:43,  3.61it/s]
 86%|████████▌ | 317807/371472 [3:06:55<4:14:59,  3.51it/s]
 86%|████████▌ | 317808/371472 [3:06:55<4:10:38,  3.57it/s]
 86%|████████▌ | 317809/371472 [3:06:56<4:08:21,  3.60it/s]
 86%|████████▌ | 317810/371472 [3:06:56<3:57:28,  3.77it/s]
 86%|████████▌ | 317811/371472 [3:06:56<3:52:02,  3.85it/s]
 86%|████████▌ | 317812/371472 [3:06:56<4:08:12,  3.60it/s]
 86%|████████▌ | 317813/371472 [3:06:57<4:02:57,  3.68it/s]
 86%|████████▌ | 317814/371472 [3:06:57<3:58:24,  3.75it/s]
 86%|████████▌ | 317815/371472 [3:06:57<4:04:16,  3.66it/s]
 86%|████████▌ | 317816/371472 [3:06:57<4:01:15,  3.71it/s]
 86%|████████▌ | 317817/371472 [3:06:58<3:56:15,  3.79it/s]
 86%|████████▌ | 317818/371472 [3:06:58<4:02:27,  3.69it/s]
 86%|████████▌ | 317819/371472 [3:06:58<4:02:13,  3.69it/s]
 86%|████████▌ | 317820/371472 [3:06:59<4:06:08,  3.63it/s]
                                                           
{'loss': 2.6983, 'learning_rate': 2.3005774741968155e-07, 'epoch': 13.69}

 86%|████████▌ | 317820/371472 [3:06:59<4:06:08,  3.63it/s]
 86%|████████▌ | 317821/371472 [3:06:59<3:55:13,  3.80it/s]
 86%|████████▌ | 317822/371472 [3:06:59<4:10:09,  3.57it/s]
 86%|████████▌ | 317823/371472 [3:06:59<4:03:40,  3.67it/s]
 86%|████████▌ | 317824/371472 [3:07:00<4:10:34,  3.57it/s]
 86%|████████▌ | 317825/371472 [3:07:00<4:02:16,  3.69it/s]
 86%|████████▌ | 317826/371472 [3:07:00<3:52:39,  3.84it/s]
 86%|████████▌ | 317827/371472 [3:07:00<3:55:47,  3.79it/s]
 86%|████████▌ | 317828/371472 [3:07:01<4:22:25,  3.41it/s]
 86%|████████▌ | 317829/371472 [3:07:01<4:31:15,  3.30it/s]
 86%|████████▌ | 317830/371472 [3:07:01<4:22:16,  3.41it/s]
 86%|████████▌ | 317831/371472 [3:07:02<4:12:45,  3.54it/s]
 86%|████████▌ | 317832/371472 [3:07:02<4:02:04,  3.69it/s]
 86%|████████▌ | 317833/371472 [3:07:02<4:03:09,  3.68it/s]
 86%|████████▌ | 317834/371472 [3:07:02<4:10:19,  3.57it/s]
 86%|████████▌ | 317835/371472 [3:07:03<4:02:13,  3.69it/s]
 86%|████████▌ | 317836/371472 [3:07:03<4:10:30,  3.57it/s]
 86%|████████▌ | 317837/371472 [3:07:03<4:00:58,  3.71it/s]
 86%|████████▌ | 317838/371472 [3:07:04<4:05:41,  3.64it/s]
 86%|████████▌ | 317839/371472 [3:07:04<4:03:04,  3.68it/s]
 86%|████████▌ | 317840/371472 [3:07:04<4:05:16,  3.64it/s]
                                                           
{'loss': 2.6068, 'learning_rate': 2.300092654442026e-07, 'epoch': 13.69}

 86%|████████▌ | 317840/371472 [3:07:04<4:05:16,  3.64it/s]
 86%|████████▌ | 317841/371472 [3:07:04<4:18:33,  3.46it/s]
 86%|████████▌ | 317842/371472 [3:07:05<4:13:10,  3.53it/s]
 86%|████████▌ | 317843/371472 [3:07:05<4:05:28,  3.64it/s]
 86%|████████▌ | 317844/371472 [3:07:05<3:57:35,  3.76it/s]
 86%|████████▌ | 317845/371472 [3:07:06<4:09:06,  3.59it/s]
 86%|████████▌ | 317846/371472 [3:07:06<4:10:01,  3.57it/s]
 86%|████████▌ | 317847/371472 [3:07:06<4:14:17,  3.51it/s]
 86%|████████▌ | 317848/371472 [3:07:06<4:10:08,  3.57it/s]
 86%|████████▌ | 317849/371472 [3:07:07<4:19:38,  3.44it/s]
 86%|████████▌ | 317850/371472 [3:07:07<4:32:19,  3.28it/s]
 86%|████████▌ | 317851/371472 [3:07:07<4:26:04,  3.36it/s]
 86%|████████▌ | 317852/371472 [3:07:08<4:29:29,  3.32it/s]
 86%|████████▌ | 317853/371472 [3:07:08<4:14:03,  3.52it/s]
 86%|████████▌ | 317854/371472 [3:07:08<4:09:13,  3.59it/s]
 86%|████████▌ | 317855/371472 [3:07:08<4:06:52,  3.62it/s]
 86%|████████▌ | 317856/371472 [3:07:09<4:05:06,  3.65it/s]
 86%|████████▌ | 317857/371472 [3:07:09<4:05:45,  3.64it/s]
 86%|████████▌ | 317858/371472 [3:07:09<3:59:27,  3.73it/s]
 86%|████████▌ | 317859/371472 [3:07:09<3:55:55,  3.79it/s]
 86%|████████▌ | 317860/371472 [3:07:10<3:56:44,  3.77it/s]
                                                           
{'loss': 2.5399, 'learning_rate': 2.2996078346872377e-07, 'epoch': 13.69}

 86%|████████▌ | 317860/371472 [3:07:10<3:56:44,  3.77it/s]
 86%|████████▌ | 317861/371472 [3:07:10<3:57:47,  3.76it/s]
 86%|████████▌ | 317862/371472 [3:07:10<3:52:05,  3.85it/s]
 86%|████████▌ | 317863/371472 [3:07:10<3:55:07,  3.80it/s]
 86%|████████▌ | 317864/371472 [3:07:11<4:01:57,  3.69it/s]
 86%|████████▌ | 317865/371472 [3:07:11<3:59:03,  3.74it/s]
 86%|████████▌ | 317866/371472 [3:07:11<3:57:37,  3.76it/s]
 86%|████████▌ | 317867/371472 [3:07:12<3:52:16,  3.85it/s]
 86%|████████▌ | 317868/371472 [3:07:12<4:07:54,  3.60it/s]
 86%|████████▌ | 317869/371472 [3:07:12<4:01:07,  3.70it/s]
 86%|████████▌ | 317870/371472 [3:07:12<4:12:17,  3.54it/s]
 86%|████████▌ | 317871/371472 [3:07:13<4:26:27,  3.35it/s]
 86%|████████▌ | 317872/371472 [3:07:13<4:12:44,  3.53it/s]
 86%|████████▌ | 317873/371472 [3:07:13<4:33:58,  3.26it/s]
 86%|████████▌ | 317874/371472 [3:07:14<4:22:33,  3.40it/s]
 86%|████████▌ | 317875/371472 [3:07:14<4:32:32,  3.28it/s]
 86%|████████▌ | 317876/371472 [3:07:14<4:26:47,  3.35it/s]
 86%|████████▌ | 317877/371472 [3:07:15<4:28:39,  3.32it/s]
 86%|████████▌ | 317878/371472 [3:07:15<4:57:13,  3.01it/s]
 86%|████████▌ | 317879/371472 [3:07:15<4:37:19,  3.22it/s]
 86%|████████▌ | 317880/371472 [3:07:16<4:40:27,  3.18it/s]
                                                           
{'loss': 2.649, 'learning_rate': 2.2991230149324482e-07, 'epoch': 13.69}

 86%|████████▌ | 317880/371472 [3:07:16<4:40:27,  3.18it/s]
 86%|████████▌ | 317881/371472 [3:07:16<4:39:39,  3.19it/s]
 86%|████████▌ | 317882/371472 [3:07:16<4:37:50,  3.21it/s]
 86%|████████▌ | 317883/371472 [3:07:16<4:30:00,  3.31it/s]
 86%|████████▌ | 317884/371472 [3:07:17<5:39:43,  2.63it/s]
 86%|████████▌ | 317885/371472 [3:07:17<5:06:06,  2.92it/s]
 86%|████████▌ | 317886/371472 [3:07:18<4:58:14,  2.99it/s]
 86%|████████▌ | 317887/371472 [3:07:18<4:34:39,  3.25it/s]
 86%|████████▌ | 317888/371472 [3:07:18<4:17:35,  3.47it/s]
 86%|████████▌ | 317889/371472 [3:07:18<4:09:50,  3.57it/s]
 86%|████████▌ | 317890/371472 [3:07:19<4:07:02,  3.61it/s]
 86%|████████▌ | 317891/371472 [3:07:19<4:01:08,  3.70it/s]
 86%|████████▌ | 317892/371472 [3:07:19<3:55:47,  3.79it/s]
 86%|████████▌ | 317893/371472 [3:07:19<4:08:44,  3.59it/s]
 86%|████████▌ | 317894/371472 [3:07:20<4:02:20,  3.68it/s]
 86%|████████▌ | 317895/371472 [3:07:20<4:07:52,  3.60it/s]
 86%|████████▌ | 317896/371472 [3:07:20<3:55:16,  3.80it/s]
 86%|████████▌ | 317897/371472 [3:07:20<4:05:19,  3.64it/s]
 86%|████████▌ | 317898/371472 [3:07:21<4:05:19,  3.64it/s]
 86%|████████▌ | 317899/371472 [3:07:21<4:03:58,  3.66it/s]
 86%|████████▌ | 317900/371472 [3:07:21<4:15:32,  3.49it/s]
                                                           
{'loss': 2.767, 'learning_rate': 2.2986381951776597e-07, 'epoch': 13.69}

 86%|████████▌ | 317900/371472 [3:07:21<4:15:32,  3.49it/s]
 86%|████████▌ | 317901/371472 [3:07:22<4:05:57,  3.63it/s]
 86%|████████▌ | 317902/371472 [3:07:22<4:04:04,  3.66it/s]
 86%|████████▌ | 317903/371472 [3:07:22<4:09:51,  3.57it/s]
 86%|████████▌ | 317904/371472 [3:07:22<4:06:50,  3.62it/s]
 86%|████████▌ | 317905/371472 [3:07:23<4:05:13,  3.64it/s]
 86%|████████▌ | 317906/371472 [3:07:23<3:58:40,  3.74it/s]
 86%|████████▌ | 317907/371472 [3:07:23<4:01:14,  3.70it/s]
 86%|████████▌ | 317908/371472 [3:07:23<3:56:59,  3.77it/s]
 86%|████████▌ | 317909/371472 [3:07:24<3:52:24,  3.84it/s]
 86%|████████▌ | 317910/371472 [3:07:24<3:49:15,  3.89it/s]
 86%|████████▌ | 317911/371472 [3:07:24<3:47:10,  3.93it/s]
 86%|████████▌ | 317912/371472 [3:07:25<3:51:14,  3.86it/s]
 86%|████████▌ | 317913/371472 [3:07:25<4:04:32,  3.65it/s]
 86%|████████▌ | 317914/371472 [3:07:25<3:59:45,  3.72it/s]
 86%|████████▌ | 317915/371472 [3:07:25<3:56:54,  3.77it/s]
 86%|████████▌ | 317916/371472 [3:07:26<3:47:25,  3.92it/s]
 86%|████████▌ | 317917/371472 [3:07:26<4:04:26,  3.65it/s]
 86%|████████▌ | 317918/371472 [3:07:26<4:16:06,  3.49it/s]
 86%|████████▌ | 317919/371472 [3:07:26<4:16:59,  3.47it/s]
 86%|████████▌ | 317920/371472 [3:07:27<4:08:49,  3.59it/s]
                                                           
{'loss': 2.8701, 'learning_rate': 2.2981533754228704e-07, 'epoch': 13.69}

 86%|████████▌ | 317920/371472 [3:07:27<4:08:49,  3.59it/s]
 86%|████████▌ | 317921/371472 [3:07:27<4:10:17,  3.57it/s]
 86%|████████▌ | 317922/371472 [3:07:27<4:14:23,  3.51it/s]
 86%|████████▌ | 317923/371472 [3:07:28<4:05:50,  3.63it/s]
 86%|████████▌ | 317924/371472 [3:07:28<4:01:51,  3.69it/s]
 86%|████████▌ | 317925/371472 [3:07:28<3:58:20,  3.74it/s]
 86%|████████▌ | 317926/371472 [3:07:28<3:53:32,  3.82it/s]
 86%|████████▌ | 317927/371472 [3:07:29<3:51:06,  3.86it/s]
 86%|████████▌ | 317928/371472 [3:07:29<4:01:38,  3.69it/s]
 86%|████████▌ | 317929/371472 [3:07:29<3:57:06,  3.76it/s]
 86%|████████▌ | 317930/371472 [3:07:29<4:00:31,  3.71it/s]
 86%|████████▌ | 317931/371472 [3:07:30<4:32:15,  3.28it/s]
 86%|████████▌ | 317932/371472 [3:07:30<4:35:40,  3.24it/s]
 86%|████████▌ | 317933/371472 [3:07:30<4:20:09,  3.43it/s]
 86%|████████▌ | 317934/371472 [3:07:31<4:18:31,  3.45it/s]
 86%|████████▌ | 317935/371472 [3:07:31<4:07:23,  3.61it/s]
 86%|████████▌ | 317936/371472 [3:07:31<4:03:37,  3.66it/s]
 86%|████████▌ | 317937/371472 [3:07:31<3:54:56,  3.80it/s]
 86%|████████▌ | 317938/371472 [3:07:32<3:51:57,  3.85it/s]
 86%|████████▌ | 317939/371472 [3:07:32<3:50:39,  3.87it/s]
 86%|████████▌ | 317940/371472 [3:07:32<4:02:53,  3.67it/s]
                                                           
{'loss': 2.6435, 'learning_rate': 2.297668555668082e-07, 'epoch': 13.69}

 86%|████████▌ | 317940/371472 [3:07:32<4:02:53,  3.67it/s]
 86%|████████▌ | 317941/371472 [3:07:32<3:52:37,  3.84it/s]
 86%|████████▌ | 317942/371472 [3:07:33<3:52:41,  3.83it/s]
 86%|████████▌ | 317943/371472 [3:07:33<4:03:33,  3.66it/s]
 86%|████████▌ | 317944/371472 [3:07:33<4:06:26,  3.62it/s]
 86%|████████▌ | 317945/371472 [3:07:34<4:15:41,  3.49it/s]
 86%|████████▌ | 317946/371472 [3:07:34<4:08:30,  3.59it/s]
 86%|████████▌ | 317947/371472 [3:07:34<4:26:44,  3.34it/s]
 86%|████████▌ | 317948/371472 [3:07:34<4:19:02,  3.44it/s]
 86%|████████▌ | 317949/371472 [3:07:35<4:28:24,  3.32it/s]
 86%|████████▌ | 317950/371472 [3:07:35<4:23:09,  3.39it/s]
 86%|████████▌ | 317951/371472 [3:07:35<4:20:01,  3.43it/s]
 86%|████████▌ | 317952/371472 [3:07:36<4:04:49,  3.64it/s]
 86%|████████▌ | 317953/371472 [3:07:36<4:13:40,  3.52it/s]
 86%|████████▌ | 317954/371472 [3:07:36<4:16:11,  3.48it/s]
 86%|████████▌ | 317955/371472 [3:07:37<4:24:44,  3.37it/s]
 86%|████████▌ | 317956/371472 [3:07:37<4:20:13,  3.43it/s]
 86%|████████▌ | 317957/371472 [3:07:37<4:04:23,  3.65it/s]
 86%|████████▌ | 317958/371472 [3:07:37<4:11:47,  3.54it/s]
 86%|████████▌ | 317959/371472 [3:07:38<4:19:34,  3.44it/s]
 86%|████████▌ | 317960/371472 [3:07:38<4:06:19,  3.62it/s]
                                                           
{'loss': 2.5623, 'learning_rate': 2.2971837359132926e-07, 'epoch': 13.7}

 86%|████████▌ | 317960/371472 [3:07:38<4:06:19,  3.62it/s]
 86%|████████▌ | 317961/371472 [3:07:38<4:05:30,  3.63it/s]
 86%|████████▌ | 317962/371472 [3:07:38<3:57:01,  3.76it/s]
 86%|████████▌ | 317963/371472 [3:07:39<3:55:47,  3.78it/s]
 86%|████████▌ | 317964/371472 [3:07:39<3:56:54,  3.76it/s]
 86%|████████▌ | 317965/371472 [3:07:39<4:14:37,  3.50it/s]
 86%|████████▌ | 317966/371472 [3:07:40<4:13:10,  3.52it/s]
 86%|████████▌ | 317967/371472 [3:07:40<4:08:16,  3.59it/s]
 86%|████████▌ | 317968/371472 [3:07:40<4:01:42,  3.69it/s]
 86%|████████▌ | 317969/371472 [3:07:40<4:23:20,  3.39it/s]
 86%|████████▌ | 317970/371472 [3:07:41<4:15:39,  3.49it/s]
 86%|████████▌ | 317971/371472 [3:07:41<4:21:38,  3.41it/s]
 86%|████████▌ | 317972/371472 [3:07:41<4:14:15,  3.51it/s]
 86%|████████▌ | 317973/371472 [3:07:42<4:03:41,  3.66it/s]
 86%|████████▌ | 317974/371472 [3:07:42<4:10:16,  3.56it/s]
 86%|████████▌ | 317975/371472 [3:07:42<4:12:41,  3.53it/s]
 86%|████████▌ | 317976/371472 [3:07:42<4:10:04,  3.57it/s]
 86%|████████▌ | 317977/371472 [3:07:43<4:08:20,  3.59it/s]
 86%|████████▌ | 317978/371472 [3:07:43<4:00:48,  3.70it/s]
 86%|████████▌ | 317979/371472 [3:07:43<3:53:28,  3.82it/s]
 86%|████████▌ | 317980/371472 [3:07:43<4:00:30,  3.71it/s]
                                                           
{'loss': 2.6595, 'learning_rate': 2.296698916158504e-07, 'epoch': 13.7}

 86%|████████▌ | 317980/371472 [3:07:43<4:00:30,  3.71it/s]
 86%|████████▌ | 317981/371472 [3:07:44<3:56:19,  3.77it/s]
 86%|████████▌ | 317982/371472 [3:07:44<3:51:34,  3.85it/s]
 86%|████████▌ | 317983/371472 [3:07:44<4:02:27,  3.68it/s]
 86%|████████▌ | 317984/371472 [3:07:44<3:56:05,  3.78it/s]
 86%|████████▌ | 317985/371472 [3:07:45<3:56:27,  3.77it/s]
 86%|████████▌ | 317986/371472 [3:07:45<4:23:16,  3.39it/s]
 86%|████████▌ | 317987/371472 [3:07:45<4:18:22,  3.45it/s]
 86%|████████▌ | 317988/371472 [3:07:46<4:03:12,  3.67it/s]
 86%|████████▌ | 317989/371472 [3:07:46<4:07:02,  3.61it/s]
 86%|████████▌ | 317990/371472 [3:07:46<4:17:03,  3.47it/s]
 86%|████████▌ | 317991/371472 [3:07:46<4:10:15,  3.56it/s]
 86%|████████▌ | 317992/371472 [3:07:47<4:25:01,  3.36it/s]
 86%|████████▌ | 317993/371472 [3:07:47<4:20:25,  3.42it/s]
 86%|████████▌ | 317994/371472 [3:07:47<4:23:08,  3.39it/s]
 86%|████████▌ | 317995/371472 [3:07:48<4:25:36,  3.36it/s]
 86%|████████▌ | 317996/371472 [3:07:48<4:21:04,  3.41it/s]
 86%|████████▌ | 317997/371472 [3:07:48<4:12:06,  3.54it/s]
 86%|████████▌ | 317998/371472 [3:07:49<4:26:44,  3.34it/s]
 86%|████████▌ | 317999/371472 [3:07:49<4:12:47,  3.53it/s]
 86%|████████▌ | 318000/371472 [3:07:49<4:09:08,  3.58it/s]
                                                           
{'loss': 2.5111, 'learning_rate': 2.2962140964037146e-07, 'epoch': 13.7}

 86%|████████▌ | 318000/371472 [3:07:49<4:09:08,  3.58it/s]
 86%|████████▌ | 318001/371472 [3:07:49<4:02:46,  3.67it/s]
 86%|████████▌ | 318002/371472 [3:07:50<4:13:45,  3.51it/s]
 86%|████████▌ | 318003/371472 [3:07:50<4:09:07,  3.58it/s]
 86%|████████▌ | 318004/371472 [3:07:50<4:09:42,  3.57it/s]
 86%|████████▌ | 318005/371472 [3:07:50<3:58:18,  3.74it/s]
 86%|████████▌ | 318006/371472 [3:07:51<4:16:58,  3.47it/s]
 86%|████████▌ | 318007/371472 [3:07:51<4:28:23,  3.32it/s]
 86%|████████▌ | 318008/371472 [3:07:51<4:13:41,  3.51it/s]
 86%|████████▌ | 318009/371472 [3:07:52<4:18:35,  3.45it/s]
 86%|████████▌ | 318010/371472 [3:07:52<4:21:53,  3.40it/s]
 86%|████████▌ | 318011/371472 [3:07:52<4:21:04,  3.41it/s]
 86%|████████▌ | 318012/371472 [3:07:53<4:09:22,  3.57it/s]
 86%|████████▌ | 318013/371472 [3:07:53<4:12:03,  3.53it/s]
 86%|████████▌ | 318014/371472 [3:07:53<4:01:55,  3.68it/s]
 86%|████████▌ | 318015/371472 [3:07:53<3:56:37,  3.77it/s]
 86%|████████▌ | 318016/371472 [3:07:54<3:59:42,  3.72it/s]
 86%|████████▌ | 318017/371472 [3:07:54<3:59:06,  3.73it/s]
 86%|████████▌ | 318018/371472 [3:07:54<3:56:03,  3.77it/s]
 86%|████████▌ | 318019/371472 [3:07:54<4:09:24,  3.57it/s]
 86%|████████▌ | 318020/371472 [3:07:55<4:07:30,  3.60it/s]
                                                           
{'loss': 2.5726, 'learning_rate': 2.2957292766489263e-07, 'epoch': 13.7}

 86%|████████▌ | 318020/371472 [3:07:55<4:07:30,  3.60it/s]
 86%|████████▌ | 318021/371472 [3:07:55<4:07:34,  3.60it/s]
 86%|████████▌ | 318022/371472 [3:07:55<4:04:58,  3.64it/s]
 86%|████████▌ | 318023/371472 [3:07:56<3:59:22,  3.72it/s]
 86%|████████▌ | 318024/371472 [3:07:56<4:10:39,  3.55it/s]
 86%|████████▌ | 318025/371472 [3:07:56<4:04:02,  3.65it/s]
 86%|████████▌ | 318026/371472 [3:07:56<4:03:39,  3.66it/s]
 86%|████████▌ | 318027/371472 [3:07:57<4:02:50,  3.67it/s]
 86%|████████▌ | 318028/371472 [3:07:57<4:12:36,  3.53it/s]
 86%|████████▌ | 318029/371472 [3:07:57<4:15:45,  3.48it/s]
 86%|████████▌ | 318030/371472 [3:07:58<4:39:03,  3.19it/s]
 86%|████████▌ | 318031/371472 [3:07:58<4:35:10,  3.24it/s]
 86%|████████▌ | 318032/371472 [3:07:58<4:23:26,  3.38it/s]
 86%|████████▌ | 318033/371472 [3:07:58<4:12:43,  3.52it/s]
 86%|████████▌ | 318034/371472 [3:07:59<4:05:38,  3.63it/s]
 86%|████████▌ | 318035/371472 [3:07:59<4:10:09,  3.56it/s]
 86%|████████▌ | 318036/371472 [3:07:59<3:59:13,  3.72it/s]
 86%|████████▌ | 318037/371472 [3:08:00<4:36:48,  3.22it/s]
 86%|████████▌ | 318038/371472 [3:08:00<4:23:49,  3.38it/s]
 86%|████████▌ | 318039/371472 [3:08:00<4:13:13,  3.52it/s]
 86%|████████▌ | 318040/371472 [3:08:00<4:15:12,  3.49it/s]
                                                           
{'loss': 2.653, 'learning_rate': 2.2952444568941368e-07, 'epoch': 13.7}

 86%|████████▌ | 318040/371472 [3:08:00<4:15:12,  3.49it/s]
 86%|████████▌ | 318041/371472 [3:08:01<4:18:56,  3.44it/s]
 86%|████████▌ | 318042/371472 [3:08:01<4:13:14,  3.52it/s]
 86%|████████▌ | 318043/371472 [3:08:01<4:07:32,  3.60it/s]
 86%|████████▌ | 318044/371472 [3:08:02<4:01:43,  3.68it/s]
 86%|████████▌ | 318045/371472 [3:08:02<4:08:29,  3.58it/s]
 86%|████████▌ | 318046/371472 [3:08:02<4:03:29,  3.66it/s]
 86%|████████▌ | 318047/371472 [3:08:02<3:59:12,  3.72it/s]
 86%|████████▌ | 318048/371472 [3:08:03<4:03:48,  3.65it/s]
 86%|████████▌ | 318049/371472 [3:08:03<3:53:49,  3.81it/s]
 86%|████████▌ | 318050/371472 [3:08:03<4:07:06,  3.60it/s]
 86%|████████▌ | 318051/371472 [3:08:03<4:12:23,  3.53it/s]
 86%|████████▌ | 318052/371472 [3:08:04<4:12:06,  3.53it/s]
 86%|████████▌ | 318053/371472 [3:08:04<4:21:57,  3.40it/s]
 86%|████████▌ | 318054/371472 [3:08:04<4:08:30,  3.58it/s]
 86%|████████▌ | 318055/371472 [3:08:05<4:33:26,  3.26it/s]
 86%|████████▌ | 318056/371472 [3:08:05<4:26:59,  3.33it/s]
 86%|████████▌ | 318057/371472 [3:08:05<4:17:31,  3.46it/s]
 86%|████████▌ | 318058/371472 [3:08:06<4:15:31,  3.48it/s]
 86%|████████▌ | 318059/371472 [3:08:06<4:13:27,  3.51it/s]
 86%|████████▌ | 318060/371472 [3:08:06<4:32:45,  3.26it/s]
                                                           
{'loss': 2.6211, 'learning_rate': 2.2947596371393475e-07, 'epoch': 13.7}

 86%|████████▌ | 318060/371472 [3:08:06<4:32:45,  3.26it/s]
 86%|████████▌ | 318061/371472 [3:08:06<4:20:36,  3.42it/s]
 86%|████████▌ | 318062/371472 [3:08:07<4:30:25,  3.29it/s]
 86%|████████▌ | 318063/371472 [3:08:07<4:29:37,  3.30it/s]
 86%|████████▌ | 318064/371472 [3:08:07<4:22:24,  3.39it/s]
 86%|████████▌ | 318065/371472 [3:08:08<4:05:43,  3.62it/s]
 86%|████████▌ | 318066/371472 [3:08:08<4:10:38,  3.55it/s]
 86%|████████▌ | 318067/371472 [3:08:08<4:07:41,  3.59it/s]
 86%|████████▌ | 318068/371472 [3:08:08<4:08:33,  3.58it/s]
 86%|████████▌ | 318069/371472 [3:08:09<4:00:39,  3.70it/s]
 86%|████████▌ | 318070/371472 [3:08:09<4:03:25,  3.66it/s]
 86%|████████▌ | 318071/371472 [3:08:09<3:59:25,  3.72it/s]
 86%|████████▌ | 318072/371472 [3:08:09<3:55:57,  3.77it/s]
 86%|████████▌ | 318073/371472 [3:08:10<4:11:08,  3.54it/s]
 86%|████████▌ | 318074/371472 [3:08:10<4:03:24,  3.66it/s]
 86%|████████▌ | 318075/371472 [3:08:10<3:54:23,  3.80it/s]
 86%|████████▌ | 318076/371472 [3:08:11<3:57:01,  3.75it/s]
 86%|████████▌ | 318077/371472 [3:08:11<4:04:56,  3.63it/s]
 86%|████████▌ | 318078/371472 [3:08:11<4:30:25,  3.29it/s]
 86%|████████▌ | 318079/371472 [3:08:12<4:33:24,  3.25it/s]
 86%|████████▌ | 318080/371472 [3:08:12<4:31:44,  3.27it/s]
                                                           
{'loss': 2.74, 'learning_rate': 2.294274817384559e-07, 'epoch': 13.7}

 86%|████████▌ | 318080/371472 [3:08:12<4:31:44,  3.27it/s]
 86%|████████▌ | 318081/371472 [3:08:12<4:17:11,  3.46it/s]
 86%|████████▌ | 318082/371472 [3:08:12<4:19:12,  3.43it/s]
 86%|████████▌ | 318083/371472 [3:08:13<4:18:12,  3.45it/s]
 86%|████████▌ | 318084/371472 [3:08:13<4:14:19,  3.50it/s]
 86%|████████▌ | 318085/371472 [3:08:13<4:12:40,  3.52it/s]
 86%|████████▌ | 318086/371472 [3:08:13<4:05:17,  3.63it/s]
 86%|████████▌ | 318087/371472 [3:08:14<4:17:53,  3.45it/s]
 86%|████████▌ | 318088/371472 [3:08:14<4:08:28,  3.58it/s]
 86%|████████▌ | 318089/371472 [3:08:14<3:55:09,  3.78it/s]
 86%|████████▌ | 318090/371472 [3:08:15<3:52:36,  3.82it/s]
 86%|████████▌ | 318091/371472 [3:08:15<4:04:52,  3.63it/s]
 86%|████████▌ | 318092/371472 [3:08:15<4:08:52,  3.57it/s]
 86%|████████▌ | 318093/371472 [3:08:15<4:09:04,  3.57it/s]
 86%|████████▌ | 318094/371472 [3:08:16<4:39:46,  3.18it/s]
 86%|████████▌ | 318095/371472 [3:08:16<4:49:50,  3.07it/s]
 86%|████████▌ | 318096/371472 [3:08:17<4:58:42,  2.98it/s]
 86%|████████▌ | 318097/371472 [3:08:17<4:42:20,  3.15it/s]
 86%|████████▌ | 318098/371472 [3:08:17<4:24:04,  3.37it/s]
 86%|████████▌ | 318099/371472 [3:08:17<4:11:32,  3.54it/s]
 86%|████████▌ | 318100/371472 [3:08:18<4:09:52,  3.56it/s]
                                                           
{'loss': 2.6846, 'learning_rate': 2.2937899976297695e-07, 'epoch': 13.7}

 86%|████████▌ | 318100/371472 [3:08:18<4:09:52,  3.56it/s]
 86%|████████▌ | 318101/371472 [3:08:18<4:27:47,  3.32it/s]
 86%|████████▌ | 318102/371472 [3:08:18<4:36:44,  3.21it/s]
 86%|████████▌ | 318103/371472 [3:08:19<4:36:26,  3.22it/s]
 86%|████████▌ | 318104/371472 [3:08:19<4:14:18,  3.50it/s]
 86%|████████▌ | 318105/371472 [3:08:19<4:12:17,  3.53it/s]
 86%|████████▌ | 318106/371472 [3:08:19<4:04:54,  3.63it/s]
 86%|████████▌ | 318107/371472 [3:08:20<3:58:03,  3.74it/s]
 86%|████████▌ | 318108/371472 [3:08:20<4:09:16,  3.57it/s]
 86%|████████▌ | 318109/371472 [3:08:20<4:12:50,  3.52it/s]
 86%|████████▌ | 318110/371472 [3:08:20<4:10:11,  3.55it/s]
 86%|████████▌ | 318111/371472 [3:08:21<4:12:14,  3.53it/s]
 86%|████████▌ | 318112/371472 [3:08:21<4:08:52,  3.57it/s]
 86%|████████▌ | 318113/371472 [3:08:21<4:07:46,  3.59it/s]
 86%|████████▌ | 318114/371472 [3:08:22<4:06:42,  3.60it/s]
 86%|████████▌ | 318115/371472 [3:08:22<3:56:20,  3.76it/s]
 86%|████████▌ | 318116/371472 [3:08:22<3:59:04,  3.72it/s]
 86%|████████▌ | 318117/371472 [3:08:22<4:13:19,  3.51it/s]
 86%|████████▌ | 318118/371472 [3:08:23<4:15:54,  3.47it/s]
 86%|████████▌ | 318119/371472 [3:08:23<4:15:01,  3.49it/s]
 86%|████████▌ | 318120/371472 [3:08:23<4:14:17,  3.50it/s]
                                                           
{'loss': 2.5525, 'learning_rate': 2.2933051778749812e-07, 'epoch': 13.7}

 86%|████████▌ | 318120/371472 [3:08:23<4:14:17,  3.50it/s]
 86%|████████▌ | 318121/371472 [3:08:24<4:25:00,  3.36it/s]
 86%|████████▌ | 318122/371472 [3:08:24<4:21:46,  3.40it/s]
 86%|████████▌ | 318123/371472 [3:08:24<4:10:07,  3.55it/s]
 86%|████████▌ | 318124/371472 [3:08:24<4:16:28,  3.47it/s]
 86%|████████▌ | 318125/371472 [3:08:25<4:13:30,  3.51it/s]
 86%|████████▌ | 318126/371472 [3:08:25<4:06:17,  3.61it/s]
 86%|████████▌ | 318127/371472 [3:08:25<3:56:42,  3.76it/s]
 86%|████████▌ | 318128/371472 [3:08:25<4:01:29,  3.68it/s]
 86%|████████▌ | 318129/371472 [3:08:26<4:01:09,  3.69it/s]
 86%|████████▌ | 318130/371472 [3:08:26<3:54:54,  3.78it/s]
 86%|████████▌ | 318131/371472 [3:08:26<4:09:11,  3.57it/s]
 86%|████████▌ | 318132/371472 [3:08:27<4:10:39,  3.55it/s]
 86%|████████▌ | 318133/371472 [3:08:27<4:21:27,  3.40it/s]
 86%|████████▌ | 318134/371472 [3:08:27<4:13:08,  3.51it/s]
 86%|████████▌ | 318135/371472 [3:08:27<4:09:39,  3.56it/s]
 86%|████████▌ | 318136/371472 [3:08:28<4:03:03,  3.66it/s]
 86%|████████▌ | 318137/371472 [3:08:28<3:59:37,  3.71it/s]
 86%|████████▌ | 318138/371472 [3:08:28<4:35:43,  3.22it/s]
 86%|████████▌ | 318139/371472 [3:08:29<4:29:03,  3.30it/s]
 86%|████████▌ | 318140/371472 [3:08:29<4:26:21,  3.34it/s]
                                                           
{'loss': 2.5077, 'learning_rate': 2.2928203581201917e-07, 'epoch': 13.7}

 86%|████████▌ | 318140/371472 [3:08:29<4:26:21,  3.34it/s]
 86%|████████▌ | 318141/371472 [3:08:29<4:37:44,  3.20it/s]
 86%|████████▌ | 318142/371472 [3:08:30<4:31:40,  3.27it/s]
 86%|████████▌ | 318143/371472 [3:08:30<4:25:55,  3.34it/s]
 86%|████████▌ | 318144/371472 [3:08:30<4:13:41,  3.50it/s]
 86%|████████▌ | 318145/371472 [3:08:30<4:30:08,  3.29it/s]
 86%|████████▌ | 318146/371472 [3:08:31<4:19:08,  3.43it/s]
 86%|████████▌ | 318147/371472 [3:08:31<4:09:49,  3.56it/s]
 86%|████████▌ | 318148/371472 [3:08:31<4:02:53,  3.66it/s]
 86%|████████▌ | 318149/371472 [3:08:32<4:09:34,  3.56it/s]
 86%|████████▌ | 318150/371472 [3:08:32<4:09:17,  3.56it/s]
 86%|████████▌ | 318151/371472 [3:08:32<4:07:45,  3.59it/s]
 86%|████████▌ | 318152/371472 [3:08:32<4:02:20,  3.67it/s]
 86%|████████▌ | 318153/371472 [3:08:33<3:58:34,  3.72it/s]
 86%|████████▌ | 318154/371472 [3:08:33<3:59:49,  3.71it/s]
 86%|████████▌ | 318155/371472 [3:08:33<3:55:07,  3.78it/s]
 86%|████████▌ | 318156/371472 [3:08:33<3:57:20,  3.74it/s]
 86%|████████▌ | 318157/371472 [3:08:34<3:58:23,  3.73it/s]
 86%|████████▌ | 318158/371472 [3:08:34<3:58:37,  3.72it/s]
 86%|████████▌ | 318159/371472 [3:08:34<4:05:57,  3.61it/s]
 86%|████████▌ | 318160/371472 [3:08:35<4:18:30,  3.44it/s]
                                                           
{'loss': 2.7061, 'learning_rate': 2.2923355383654035e-07, 'epoch': 13.7}

 86%|████████▌ | 318160/371472 [3:08:35<4:18:30,  3.44it/s]
 86%|████████▌ | 318161/371472 [3:08:35<4:18:51,  3.43it/s]
 86%|████████▌ | 318162/371472 [3:08:35<4:39:30,  3.18it/s]
 86%|████████▌ | 318163/371472 [3:08:35<4:26:02,  3.34it/s]
 86%|████████▌ | 318164/371472 [3:08:36<4:12:51,  3.51it/s]
 86%|████████▌ | 318165/371472 [3:08:36<4:16:12,  3.47it/s]
 86%|████████▌ | 318166/371472 [3:08:36<4:46:15,  3.10it/s]
 86%|████████▌ | 318167/371472 [3:08:37<4:29:35,  3.30it/s]
 86%|████████▌ | 318168/371472 [3:08:37<4:26:23,  3.33it/s]
 86%|████████▌ | 318169/371472 [3:08:37<4:13:30,  3.50it/s]
 86%|████████▌ | 318170/371472 [3:08:38<4:09:52,  3.56it/s]
 86%|████████▌ | 318171/371472 [3:08:38<4:08:29,  3.57it/s]
 86%|████████▌ | 318172/371472 [3:08:38<4:04:29,  3.63it/s]
 86%|████████▌ | 318173/371472 [3:08:38<4:06:57,  3.60it/s]
 86%|████████▌ | 318174/371472 [3:08:39<3:58:25,  3.73it/s]
 86%|████████▌ | 318175/371472 [3:08:39<3:59:40,  3.71it/s]
 86%|████████▌ | 318176/371472 [3:08:39<4:32:16,  3.26it/s]
 86%|████████▌ | 318177/371472 [3:08:40<4:27:47,  3.32it/s]
 86%|████████▌ | 318178/371472 [3:08:40<4:16:35,  3.46it/s]
 86%|████████▌ | 318179/371472 [3:08:40<4:25:14,  3.35it/s]
 86%|████████▌ | 318180/371472 [3:08:40<4:29:08,  3.30it/s]
                                                           
{'loss': 2.5372, 'learning_rate': 2.291850718610614e-07, 'epoch': 13.7}

 86%|████████▌ | 318180/371472 [3:08:40<4:29:08,  3.30it/s]
 86%|████████▌ | 318181/371472 [3:08:41<4:17:40,  3.45it/s]
 86%|████████▌ | 318182/371472 [3:08:41<4:14:04,  3.50it/s]
 86%|████████▌ | 318183/371472 [3:08:41<4:01:26,  3.68it/s]
 86%|████████▌ | 318184/371472 [3:08:41<4:00:54,  3.69it/s]
 86%|████████▌ | 318185/371472 [3:08:42<4:02:20,  3.66it/s]
 86%|████████▌ | 318186/371472 [3:08:42<4:04:47,  3.63it/s]
 86%|████████▌ | 318187/371472 [3:08:42<4:02:17,  3.67it/s]
 86%|████████▌ | 318188/371472 [3:08:43<4:22:32,  3.38it/s]
 86%|████████▌ | 318189/371472 [3:08:43<4:24:09,  3.36it/s]
 86%|████████▌ | 318190/371472 [3:08:43<4:17:14,  3.45it/s]
 86%|████████▌ | 318191/371472 [3:08:43<4:08:13,  3.58it/s]
 86%|████████▌ | 318192/371472 [3:08:44<4:04:11,  3.64it/s]
 86%|████████▌ | 318193/371472 [3:08:44<3:57:19,  3.74it/s]
 86%|████████▌ | 318194/371472 [3:08:44<3:57:23,  3.74it/s]
 86%|████████▌ | 318195/371472 [3:08:45<3:55:55,  3.76it/s]
 86%|████████▌ | 318196/371472 [3:08:45<4:01:00,  3.68it/s]
 86%|████████▌ | 318197/371472 [3:08:45<3:58:52,  3.72it/s]
 86%|████████▌ | 318198/371472 [3:08:45<3:57:43,  3.73it/s]
 86%|████████▌ | 318199/371472 [3:08:46<4:05:04,  3.62it/s]
 86%|████████▌ | 318200/371472 [3:08:46<4:07:09,  3.59it/s]
                                                           
{'loss': 2.5398, 'learning_rate': 2.2913658988558254e-07, 'epoch': 13.71}

 86%|████████▌ | 318200/371472 [3:08:46<4:07:09,  3.59it/s]
 86%|████████▌ | 318201/371472 [3:08:46<4:14:08,  3.49it/s]
 86%|████████▌ | 318202/371472 [3:08:47<4:17:36,  3.45it/s]
 86%|████████▌ | 318203/371472 [3:08:47<4:08:18,  3.58it/s]
 86%|████████▌ | 318204/371472 [3:08:47<4:05:44,  3.61it/s]
 86%|████████▌ | 318205/371472 [3:08:47<4:07:00,  3.59it/s]
 86%|████████▌ | 318206/371472 [3:08:48<4:10:41,  3.54it/s]
 86%|████████▌ | 318207/371472 [3:08:48<5:04:49,  2.91it/s]
 86%|████████▌ | 318208/371472 [3:08:48<4:50:36,  3.05it/s]
 86%|████████▌ | 318209/371472 [3:08:49<4:37:39,  3.20it/s]
 86%|████████▌ | 318210/371472 [3:08:49<4:56:01,  3.00it/s]
 86%|████████▌ | 318211/371472 [3:08:49<4:38:31,  3.19it/s]
 86%|████████▌ | 318212/371472 [3:08:50<4:27:56,  3.31it/s]
 86%|████████▌ | 318213/371472 [3:08:50<4:10:56,  3.54it/s]
 86%|████████▌ | 318214/371472 [3:08:50<4:16:46,  3.46it/s]
 86%|████████▌ | 318215/371472 [3:08:50<4:11:15,  3.53it/s]
 86%|████████▌ | 318216/371472 [3:08:51<4:01:25,  3.68it/s]
 86%|████████▌ | 318217/371472 [3:08:51<4:00:27,  3.69it/s]
 86%|████████▌ | 318218/371472 [3:08:51<4:00:22,  3.69it/s]
 86%|████████▌ | 318219/371472 [3:08:51<3:55:19,  3.77it/s]
 86%|████████▌ | 318220/371472 [3:08:52<4:03:39,  3.64it/s]
                                                           
{'loss': 2.7135, 'learning_rate': 2.2908810791010361e-07, 'epoch': 13.71}

 86%|████████▌ | 318220/371472 [3:08:52<4:03:39,  3.64it/s]
 86%|████████▌ | 318221/371472 [3:08:52<3:56:06,  3.76it/s]
 86%|████████▌ | 318222/371472 [3:08:52<3:59:43,  3.70it/s]
 86%|████████▌ | 318223/371472 [3:08:53<4:11:35,  3.53it/s]
 86%|████████▌ | 318224/371472 [3:08:53<4:09:53,  3.55it/s]
 86%|████████▌ | 318225/371472 [3:08:53<4:03:40,  3.64it/s]
 86%|████████▌ | 318226/371472 [3:08:53<4:08:41,  3.57it/s]
 86%|████████▌ | 318227/371472 [3:08:54<4:28:14,  3.31it/s]
 86%|████████▌ | 318228/371472 [3:08:54<4:09:47,  3.55it/s]
 86%|████████▌ | 318229/371472 [3:08:54<4:07:33,  3.58it/s]
 86%|████████▌ | 318230/371472 [3:08:55<4:04:40,  3.63it/s]
 86%|████████▌ | 318231/371472 [3:08:55<4:32:35,  3.26it/s]
 86%|████████▌ | 318232/371472 [3:08:55<4:24:46,  3.35it/s]
 86%|████████▌ | 318233/371472 [3:08:55<4:08:41,  3.57it/s]
 86%|████████▌ | 318234/371472 [3:08:56<4:12:59,  3.51it/s]
 86%|████████▌ | 318235/371472 [3:08:56<4:03:16,  3.65it/s]
 86%|████████▌ | 318236/371472 [3:08:56<4:04:44,  3.63it/s]
 86%|████████▌ | 318237/371472 [3:08:57<4:05:18,  3.62it/s]
 86%|████████▌ | 318238/371472 [3:08:57<4:06:38,  3.60it/s]
 86%|████████▌ | 318239/371472 [3:08:57<4:56:58,  2.99it/s]
 86%|████████▌ | 318240/371472 [3:08:58<4:36:52,  3.20it/s]
                                                           
{'loss': 2.76, 'learning_rate': 2.2903962593462476e-07, 'epoch': 13.71}

 86%|████████▌ | 318240/371472 [3:08:58<4:36:52,  3.20it/s]
 86%|████████▌ | 318241/371472 [3:08:58<4:26:06,  3.33it/s]
 86%|████████▌ | 318242/371472 [3:08:58<4:20:44,  3.40it/s]
 86%|████████▌ | 318243/371472 [3:08:58<4:12:43,  3.51it/s]
 86%|████████▌ | 318244/371472 [3:08:59<4:14:37,  3.48it/s]
 86%|████████▌ | 318245/371472 [3:08:59<4:13:20,  3.50it/s]
 86%|████████▌ | 318246/371472 [3:08:59<4:07:40,  3.58it/s]
 86%|████████▌ | 318247/371472 [3:08:59<4:00:54,  3.68it/s]
 86%|████████▌ | 318248/371472 [3:09:00<4:17:04,  3.45it/s]
 86%|████████▌ | 318249/371472 [3:09:00<4:18:43,  3.43it/s]
 86%|████████▌ | 318250/371472 [3:09:00<4:13:42,  3.50it/s]
 86%|████████▌ | 318251/371472 [3:09:01<4:15:20,  3.47it/s]
 86%|████████▌ | 318252/371472 [3:09:01<4:03:53,  3.64it/s]
 86%|████████▌ | 318253/371472 [3:09:01<4:10:34,  3.54it/s]
 86%|████████▌ | 318254/371472 [3:09:02<4:21:35,  3.39it/s]
 86%|████████▌ | 318255/371472 [3:09:02<4:16:55,  3.45it/s]
 86%|████████▌ | 318256/371472 [3:09:02<4:07:25,  3.58it/s]
 86%|████████▌ | 318257/371472 [3:09:02<4:02:13,  3.66it/s]
 86%|████████▌ | 318258/371472 [3:09:03<4:11:12,  3.53it/s]
 86%|████████▌ | 318259/371472 [3:09:03<4:08:13,  3.57it/s]
 86%|████████▌ | 318260/371472 [3:09:03<3:59:36,  3.70it/s]
                                                           
{'loss': 2.6263, 'learning_rate': 2.289911439591458e-07, 'epoch': 13.71}

 86%|████████▌ | 318260/371472 [3:09:03<3:59:36,  3.70it/s]
 86%|████████▌ | 318261/371472 [3:09:03<4:11:40,  3.52it/s]
 86%|████████▌ | 318262/371472 [3:09:04<4:05:08,  3.62it/s]
 86%|████████▌ | 318263/371472 [3:09:04<4:29:52,  3.29it/s]
 86%|████████▌ | 318264/371472 [3:09:04<4:19:19,  3.42it/s]
 86%|████████▌ | 318265/371472 [3:09:05<4:20:15,  3.41it/s]
 86%|████████▌ | 318266/371472 [3:09:05<4:27:55,  3.31it/s]
 86%|████████▌ | 318267/371472 [3:09:05<4:50:50,  3.05it/s]
 86%|████████▌ | 318268/371472 [3:09:06<4:29:43,  3.29it/s]
 86%|████████▌ | 318269/371472 [3:09:06<4:27:53,  3.31it/s]
 86%|████████▌ | 318270/371472 [3:09:06<4:22:22,  3.38it/s]
 86%|████████▌ | 318271/371472 [3:09:06<4:17:14,  3.45it/s]
 86%|████████▌ | 318272/371472 [3:09:07<4:12:29,  3.51it/s]
 86%|████████▌ | 318273/371472 [3:09:07<4:00:58,  3.68it/s]
 86%|████████▌ | 318274/371472 [3:09:07<3:48:48,  3.88it/s]
 86%|████████▌ | 318275/371472 [3:09:07<3:54:04,  3.79it/s]
 86%|████████▌ | 318276/371472 [3:09:08<4:04:17,  3.63it/s]
 86%|████████▌ | 318277/371472 [3:09:08<4:03:36,  3.64it/s]
 86%|████████▌ | 318278/371472 [3:09:08<3:54:08,  3.79it/s]
 86%|████████▌ | 318279/371472 [3:09:09<3:57:21,  3.74it/s]
 86%|████████▌ | 318280/371472 [3:09:09<3:53:48,  3.79it/s]
                                                           
{'loss': 2.5812, 'learning_rate': 2.28942661983667e-07, 'epoch': 13.71}

 86%|████████▌ | 318280/371472 [3:09:09<3:53:48,  3.79it/s]
 86%|████████▌ | 318281/371472 [3:09:09<5:21:16,  2.76it/s]
 86%|████████▌ | 318282/371472 [3:09:10<5:15:04,  2.81it/s]
 86%|████████▌ | 318283/371472 [3:09:10<4:44:33,  3.12it/s]
 86%|████████▌ | 318284/371472 [3:09:10<4:58:59,  2.96it/s]
 86%|████████▌ | 318285/371472 [3:09:11<4:39:37,  3.17it/s]
 86%|████████▌ | 318286/371472 [3:09:11<4:30:58,  3.27it/s]
 86%|████████▌ | 318287/371472 [3:09:11<4:27:28,  3.31it/s]
 86%|████████▌ | 318288/371472 [3:09:11<4:17:05,  3.45it/s]
 86%|████████▌ | 318289/371472 [3:09:12<4:03:53,  3.63it/s]
 86%|████████▌ | 318290/371472 [3:09:12<4:03:06,  3.65it/s]
 86%|████████▌ | 318291/371472 [3:09:12<4:07:42,  3.58it/s]
 86%|████████▌ | 318292/371472 [3:09:13<4:21:23,  3.39it/s]
 86%|████████▌ | 318293/371472 [3:09:13<4:23:13,  3.37it/s]
 86%|████████▌ | 318294/371472 [3:09:13<4:22:39,  3.37it/s]
 86%|████████▌ | 318295/371472 [3:09:13<4:06:38,  3.59it/s]
 86%|████████▌ | 318296/371472 [3:09:14<4:12:05,  3.52it/s]
 86%|████████▌ | 318297/371472 [3:09:14<4:02:54,  3.65it/s]
 86%|████████▌ | 318298/371472 [3:09:14<3:57:20,  3.73it/s]
 86%|████████▌ | 318299/371472 [3:09:15<4:13:49,  3.49it/s]
 86%|████████▌ | 318300/371472 [3:09:15<4:26:15,  3.33it/s]
                                                           
{'loss': 2.6673, 'learning_rate': 2.2889418000818803e-07, 'epoch': 13.71}

 86%|████████▌ | 318300/371472 [3:09:15<4:26:15,  3.33it/s]
 86%|████████▌ | 318301/371472 [3:09:15<4:25:27,  3.34it/s]
 86%|████████▌ | 318302/371472 [3:09:15<4:16:23,  3.46it/s]
 86%|████████▌ | 318303/371472 [3:09:16<4:16:51,  3.45it/s]
 86%|████████▌ | 318304/371472 [3:09:16<4:13:04,  3.50it/s]
 86%|████████▌ | 318305/371472 [3:09:16<4:06:57,  3.59it/s]
 86%|████████▌ | 318306/371472 [3:09:17<3:55:46,  3.76it/s]
 86%|████████▌ | 318307/371472 [3:09:17<4:00:39,  3.68it/s]
 86%|████████▌ | 318308/371472 [3:09:17<3:58:33,  3.71it/s]
 86%|████████▌ | 318309/371472 [3:09:17<3:50:51,  3.84it/s]
 86%|████████▌ | 318310/371472 [3:09:18<3:47:15,  3.90it/s]
 86%|████████▌ | 318311/371472 [3:09:18<3:50:58,  3.84it/s]
 86%|████████▌ | 318312/371472 [3:09:18<3:51:17,  3.83it/s]
 86%|████████▌ | 318313/371472 [3:09:18<3:59:15,  3.70it/s]
 86%|████████▌ | 318314/371472 [3:09:19<4:03:19,  3.64it/s]
 86%|████████▌ | 318315/371472 [3:09:19<4:07:41,  3.58it/s]
 86%|████████▌ | 318316/371472 [3:09:19<4:02:07,  3.66it/s]
 86%|████████▌ | 318317/371472 [3:09:20<4:01:30,  3.67it/s]
 86%|████████▌ | 318318/371472 [3:09:20<4:13:23,  3.50it/s]
 86%|████████▌ | 318319/371472 [3:09:20<4:28:15,  3.30it/s]
 86%|████████▌ | 318320/371472 [3:09:20<4:21:15,  3.39it/s]
                                                           
{'loss': 2.7558, 'learning_rate': 2.2884569803270918e-07, 'epoch': 13.71}

 86%|████████▌ | 318320/371472 [3:09:20<4:21:15,  3.39it/s]
 86%|████████▌ | 318321/371472 [3:09:21<4:20:45,  3.40it/s]
 86%|████████▌ | 318322/371472 [3:09:21<4:11:27,  3.52it/s]
 86%|████████▌ | 318323/371472 [3:09:21<4:10:54,  3.53it/s]
 86%|████████▌ | 318324/371472 [3:09:22<4:48:46,  3.07it/s]
 86%|████████▌ | 318325/371472 [3:09:22<4:36:26,  3.20it/s]
 86%|████████▌ | 318326/371472 [3:09:22<4:30:14,  3.28it/s]
 86%|████████▌ | 318327/371472 [3:09:23<4:43:42,  3.12it/s]
 86%|████████▌ | 318328/371472 [3:09:23<4:30:51,  3.27it/s]
 86%|████████▌ | 318329/371472 [3:09:23<4:14:53,  3.47it/s]
 86%|████████▌ | 318330/371472 [3:09:23<4:08:49,  3.56it/s]
 86%|████████▌ | 318331/371472 [3:09:24<4:16:02,  3.46it/s]
 86%|████████▌ | 318332/371472 [3:09:24<4:34:48,  3.22it/s]
 86%|████████▌ | 318333/371472 [3:09:24<4:17:24,  3.44it/s]
 86%|████████▌ | 318334/371472 [3:09:25<4:22:44,  3.37it/s]
 86%|████████▌ | 318335/371472 [3:09:25<4:13:45,  3.49it/s]
 86%|████████▌ | 318336/371472 [3:09:25<4:18:42,  3.42it/s]
 86%|████████▌ | 318337/371472 [3:09:25<4:06:47,  3.59it/s]
 86%|████████▌ | 318338/371472 [3:09:26<4:02:01,  3.66it/s]
 86%|████████▌ | 318339/371472 [3:09:26<3:59:17,  3.70it/s]
 86%|████████▌ | 318340/371472 [3:09:26<4:05:47,  3.60it/s]
                                                           
{'loss': 2.7093, 'learning_rate': 2.2879721605723025e-07, 'epoch': 13.71}

 86%|████████▌ | 318340/371472 [3:09:26<4:05:47,  3.60it/s]
 86%|████████▌ | 318341/371472 [3:09:27<4:03:00,  3.64it/s]
 86%|████████▌ | 318342/371472 [3:09:27<3:55:21,  3.76it/s]
 86%|████████▌ | 318343/371472 [3:09:27<3:56:56,  3.74it/s]
 86%|████████▌ | 318344/371472 [3:09:27<3:53:31,  3.79it/s]
 86%|████████▌ | 318345/371472 [3:09:28<4:00:22,  3.68it/s]
 86%|████████▌ | 318346/371472 [3:09:28<4:13:17,  3.50it/s]
 86%|████████▌ | 318347/371472 [3:09:28<4:38:39,  3.18it/s]
 86%|████████▌ | 318348/371472 [3:09:29<4:49:51,  3.05it/s]
 86%|████████▌ | 318349/371472 [3:09:29<4:28:43,  3.29it/s]
 86%|████████▌ | 318350/371472 [3:09:29<4:20:42,  3.40it/s]
 86%|████████▌ | 318351/371472 [3:09:30<4:34:54,  3.22it/s]
 86%|████████▌ | 318352/371472 [3:09:30<4:23:45,  3.36it/s]
 86%|████████▌ | 318353/371472 [3:09:30<4:17:37,  3.44it/s]
 86%|████████▌ | 318354/371472 [3:09:31<5:04:30,  2.91it/s]
 86%|████████▌ | 318355/371472 [3:09:31<5:10:11,  2.85it/s]
 86%|████████▌ | 318356/371472 [3:09:31<4:48:04,  3.07it/s]
 86%|████████▌ | 318357/371472 [3:09:31<4:39:26,  3.17it/s]
 86%|████████▌ | 318358/371472 [3:09:32<4:44:12,  3.11it/s]
 86%|████████▌ | 318359/371472 [3:09:32<4:57:52,  2.97it/s]
 86%|████████▌ | 318360/371472 [3:09:32<4:38:26,  3.18it/s]
                                                           
{'loss': 2.6226, 'learning_rate': 2.287487340817514e-07, 'epoch': 13.71}

 86%|████████▌ | 318360/371472 [3:09:32<4:38:26,  3.18it/s]
 86%|████████▌ | 318361/371472 [3:09:33<4:35:40,  3.21it/s]
 86%|████████▌ | 318362/371472 [3:09:33<4:23:37,  3.36it/s]
 86%|████████▌ | 318363/371472 [3:09:33<4:07:55,  3.57it/s]
 86%|████████▌ | 318364/371472 [3:09:33<4:01:46,  3.66it/s]
 86%|████████▌ | 318365/371472 [3:09:34<4:07:25,  3.58it/s]
 86%|████████▌ | 318366/371472 [3:09:34<4:04:24,  3.62it/s]
 86%|████████▌ | 318367/371472 [3:09:34<4:15:04,  3.47it/s]
 86%|████████▌ | 318368/371472 [3:09:35<4:23:13,  3.36it/s]
 86%|████████▌ | 318369/371472 [3:09:35<4:17:53,  3.43it/s]
 86%|████████▌ | 318370/371472 [3:09:35<4:31:01,  3.27it/s]
 86%|████████▌ | 318371/371472 [3:09:36<4:22:38,  3.37it/s]
 86%|████████▌ | 318372/371472 [3:09:36<4:17:17,  3.44it/s]
 86%|████████▌ | 318373/371472 [3:09:36<4:34:42,  3.22it/s]
 86%|████████▌ | 318374/371472 [3:09:37<4:30:42,  3.27it/s]
 86%|████████▌ | 318375/371472 [3:09:37<5:07:56,  2.87it/s]
 86%|████████▌ | 318376/371472 [3:09:37<4:43:44,  3.12it/s]
 86%|████████▌ | 318377/371472 [3:09:38<5:04:16,  2.91it/s]
 86%|████████▌ | 318378/371472 [3:09:38<4:50:08,  3.05it/s]
 86%|████████▌ | 318379/371472 [3:09:38<4:41:32,  3.14it/s]
 86%|████████▌ | 318380/371472 [3:09:38<4:23:03,  3.36it/s]
                                                           
{'loss': 2.691, 'learning_rate': 2.2870025210627245e-07, 'epoch': 13.71}

 86%|████████▌ | 318380/371472 [3:09:38<4:23:03,  3.36it/s]
 86%|████████▌ | 318381/371472 [3:09:39<4:12:53,  3.50it/s]
 86%|████████▌ | 318382/371472 [3:09:39<4:03:40,  3.63it/s]
 86%|████████▌ | 318383/371472 [3:09:39<4:01:00,  3.67it/s]
 86%|████████▌ | 318384/371472 [3:09:40<4:28:28,  3.30it/s]
 86%|████████▌ | 318385/371472 [3:09:40<4:26:52,  3.32it/s]
 86%|████████▌ | 318386/371472 [3:09:40<4:25:22,  3.33it/s]
 86%|████████▌ | 318387/371472 [3:09:40<4:15:09,  3.47it/s]
 86%|████████▌ | 318388/371472 [3:09:41<4:14:08,  3.48it/s]
 86%|████████▌ | 318389/371472 [3:09:41<4:13:28,  3.49it/s]
 86%|████████▌ | 318390/371472 [3:09:41<4:14:20,  3.48it/s]
 86%|████████▌ | 318391/371472 [3:09:42<4:21:27,  3.38it/s]
 86%|████████▌ | 318392/371472 [3:09:42<4:34:27,  3.22it/s]
 86%|████████▌ | 318393/371472 [3:09:42<4:20:15,  3.40it/s]
 86%|████████▌ | 318394/371472 [3:09:43<4:42:45,  3.13it/s]
 86%|████████▌ | 318395/371472 [3:09:43<4:30:11,  3.27it/s]
 86%|████████▌ | 318396/371472 [3:09:43<4:20:58,  3.39it/s]
 86%|████████▌ | 318397/371472 [3:09:43<4:19:34,  3.41it/s]
 86%|████████▌ | 318398/371472 [3:09:44<4:15:25,  3.46it/s]
 86%|████████▌ | 318399/371472 [3:09:44<4:10:45,  3.53it/s]
 86%|████████▌ | 318400/371472 [3:09:44<4:08:25,  3.56it/s]
                                                           
{'loss': 2.6256, 'learning_rate': 2.2865177013079363e-07, 'epoch': 13.71}

 86%|████████▌ | 318400/371472 [3:09:44<4:08:25,  3.56it/s]
 86%|████████▌ | 318401/371472 [3:09:45<4:07:03,  3.58it/s]
 86%|████████▌ | 318402/371472 [3:09:45<4:24:52,  3.34it/s]
 86%|████████▌ | 318403/371472 [3:09:45<4:22:28,  3.37it/s]
 86%|████████▌ | 318404/371472 [3:09:45<4:18:15,  3.42it/s]
 86%|████████▌ | 318405/371472 [3:09:46<4:17:34,  3.43it/s]
 86%|████████▌ | 318406/371472 [3:09:46<4:25:06,  3.34it/s]
 86%|████████▌ | 318407/371472 [3:09:46<4:14:35,  3.47it/s]
 86%|████████▌ | 318408/371472 [3:09:47<4:09:52,  3.54it/s]
 86%|████████▌ | 318409/371472 [3:09:47<4:23:07,  3.36it/s]
 86%|████████▌ | 318410/371472 [3:09:47<4:04:31,  3.62it/s]
 86%|████████▌ | 318411/371472 [3:09:47<4:04:09,  3.62it/s]
 86%|████████▌ | 318412/371472 [3:09:48<4:08:24,  3.56it/s]
 86%|████████▌ | 318413/371472 [3:09:48<4:40:25,  3.15it/s]
 86%|████████▌ | 318414/371472 [3:09:48<4:26:01,  3.32it/s]
 86%|████████▌ | 318415/371472 [3:09:49<4:10:50,  3.53it/s]
 86%|████████▌ | 318416/371472 [3:09:49<4:01:35,  3.66it/s]
 86%|████████▌ | 318417/371472 [3:09:49<3:54:10,  3.78it/s]
 86%|████████▌ | 318418/371472 [3:09:49<3:52:34,  3.80it/s]
 86%|████████▌ | 318419/371472 [3:09:50<3:54:35,  3.77it/s]
 86%|████████▌ | 318420/371472 [3:09:50<3:57:57,  3.72it/s]
                                                           
{'loss': 2.6553, 'learning_rate': 2.2860328815531467e-07, 'epoch': 13.71}

 86%|████████▌ | 318420/371472 [3:09:50<3:57:57,  3.72it/s]
 86%|████████▌ | 318421/371472 [3:09:50<4:03:59,  3.62it/s]
 86%|████████▌ | 318422/371472 [3:09:50<3:59:52,  3.69it/s]
 86%|████████▌ | 318423/371472 [3:09:51<4:23:48,  3.35it/s]
 86%|████████▌ | 318424/371472 [3:09:51<4:13:23,  3.49it/s]
 86%|████████▌ | 318425/371472 [3:09:51<4:23:28,  3.36it/s]
 86%|████████▌ | 318426/371472 [3:09:52<4:19:24,  3.41it/s]
 86%|████████▌ | 318427/371472 [3:09:52<4:44:52,  3.10it/s]
 86%|████████▌ | 318428/371472 [3:09:52<4:26:42,  3.31it/s]
 86%|████████▌ | 318429/371472 [3:09:53<4:22:32,  3.37it/s]
 86%|████████▌ | 318430/371472 [3:09:53<4:10:29,  3.53it/s]
 86%|████████▌ | 318431/371472 [3:09:53<4:19:42,  3.40it/s]
 86%|████████▌ | 318432/371472 [3:09:54<4:20:44,  3.39it/s]
 86%|████████▌ | 318433/371472 [3:09:54<4:12:00,  3.51it/s]
 86%|████████▌ | 318434/371472 [3:09:54<4:06:52,  3.58it/s]
 86%|████████▌ | 318435/371472 [3:09:54<4:06:26,  3.59it/s]
 86%|████████▌ | 318436/371472 [3:09:55<4:06:55,  3.58it/s]
 86%|████████▌ | 318437/371472 [3:09:55<4:02:30,  3.64it/s]
 86%|████████▌ | 318438/371472 [3:09:55<4:11:58,  3.51it/s]
 86%|████████▌ | 318439/371472 [3:09:55<4:13:05,  3.49it/s]
 86%|████████▌ | 318440/371472 [3:09:56<4:12:31,  3.50it/s]
                                                           
{'loss': 2.4524, 'learning_rate': 2.2855480617983582e-07, 'epoch': 13.72}

 86%|████████▌ | 318440/371472 [3:09:56<4:12:31,  3.50it/s]
 86%|████████▌ | 318441/371472 [3:09:56<4:09:36,  3.54it/s]
 86%|████████▌ | 318442/371472 [3:09:56<4:13:01,  3.49it/s]
 86%|████████▌ | 318443/371472 [3:09:57<4:21:10,  3.38it/s]
 86%|████████▌ | 318444/371472 [3:09:57<4:59:57,  2.95it/s]
 86%|████████▌ | 318445/371472 [3:09:57<4:37:49,  3.18it/s]
 86%|████████▌ | 318446/371472 [3:09:58<4:18:40,  3.42it/s]
 86%|████████▌ | 318447/371472 [3:09:58<4:09:43,  3.54it/s]
 86%|████████▌ | 318448/371472 [3:09:58<4:01:20,  3.66it/s]
 86%|████████▌ | 318449/371472 [3:09:58<4:08:25,  3.56it/s]
 86%|████████▌ | 318450/371472 [3:09:59<4:02:43,  3.64it/s]
 86%|████████▌ | 318451/371472 [3:09:59<3:57:11,  3.73it/s]
 86%|████████▌ | 318452/371472 [3:09:59<3:50:25,  3.83it/s]
 86%|████████▌ | 318453/371472 [3:09:59<4:03:35,  3.63it/s]
 86%|████████▌ | 318454/371472 [3:10:00<4:09:07,  3.55it/s]
 86%|████████▌ | 318455/371472 [3:10:00<4:01:34,  3.66it/s]
 86%|████████▌ | 318456/371472 [3:10:00<4:03:25,  3.63it/s]
 86%|████████▌ | 318457/371472 [3:10:01<3:58:22,  3.71it/s]
 86%|████████▌ | 318458/371472 [3:10:01<3:49:34,  3.85it/s]
 86%|████████▌ | 318459/371472 [3:10:01<3:51:10,  3.82it/s]
 86%|████████▌ | 318460/371472 [3:10:01<3:56:55,  3.73it/s]
                                                           
{'loss': 2.7421, 'learning_rate': 2.285063242043569e-07, 'epoch': 13.72}

 86%|████████▌ | 318460/371472 [3:10:01<3:56:55,  3.73it/s]
 86%|████████▌ | 318461/371472 [3:10:02<4:13:31,  3.48it/s]
 86%|████████▌ | 318462/371472 [3:10:02<3:59:27,  3.69it/s]
 86%|████████▌ | 318463/371472 [3:10:02<3:56:24,  3.74it/s]
 86%|████████▌ | 318464/371472 [3:10:02<3:58:33,  3.70it/s]
 86%|████████▌ | 318465/371472 [3:10:03<4:11:34,  3.51it/s]
 86%|████████▌ | 318466/371472 [3:10:03<4:16:00,  3.45it/s]
 86%|████████▌ | 318467/371472 [3:10:03<4:29:45,  3.27it/s]
 86%|████████▌ | 318468/371472 [3:10:04<4:43:07,  3.12it/s]
 86%|████████▌ | 318469/371472 [3:10:04<4:25:31,  3.33it/s]
 86%|████████▌ | 318470/371472 [3:10:04<4:16:15,  3.45it/s]
 86%|████████▌ | 318471/371472 [3:10:05<4:12:10,  3.50it/s]
 86%|████████▌ | 318472/371472 [3:10:05<4:01:31,  3.66it/s]
 86%|████████▌ | 318473/371472 [3:10:05<4:10:38,  3.52it/s]
 86%|████████▌ | 318474/371472 [3:10:05<4:16:38,  3.44it/s]
 86%|████████▌ | 318475/371472 [3:10:06<4:18:15,  3.42it/s]
 86%|████████▌ | 318476/371472 [3:10:06<4:18:29,  3.42it/s]
 86%|████████▌ | 318477/371472 [3:10:06<4:20:27,  3.39it/s]
 86%|████████▌ | 318478/371472 [3:10:07<4:19:49,  3.40it/s]
 86%|████████▌ | 318479/371472 [3:10:07<4:15:19,  3.46it/s]
 86%|████████▌ | 318480/371472 [3:10:07<4:15:03,  3.46it/s]
                                                           
{'loss': 2.7151, 'learning_rate': 2.2845784222887805e-07, 'epoch': 13.72}

 86%|████████▌ | 318480/371472 [3:10:07<4:15:03,  3.46it/s]
 86%|████████▌ | 318481/371472 [3:10:07<4:34:07,  3.22it/s]
 86%|████████▌ | 318482/371472 [3:10:08<4:35:21,  3.21it/s]
 86%|████████▌ | 318483/371472 [3:10:08<4:21:12,  3.38it/s]
 86%|████████▌ | 318484/371472 [3:10:08<4:20:46,  3.39it/s]
 86%|████████▌ | 318485/371472 [3:10:09<4:07:08,  3.57it/s]
 86%|████████▌ | 318486/371472 [3:10:09<4:03:06,  3.63it/s]
 86%|████████▌ | 318487/371472 [3:10:09<4:01:41,  3.65it/s]
 86%|████████▌ | 318488/371472 [3:10:09<3:51:54,  3.81it/s]
 86%|████████▌ | 318489/371472 [3:10:10<3:45:55,  3.91it/s]
 86%|████████▌ | 318490/371472 [3:10:10<3:43:01,  3.96it/s]
 86%|████████▌ | 318491/371472 [3:10:10<3:53:09,  3.79it/s]
 86%|████████▌ | 318492/371472 [3:10:10<3:59:18,  3.69it/s]
 86%|████████▌ | 318493/371472 [3:10:11<3:54:33,  3.76it/s]
 86%|████████▌ | 318494/371472 [3:10:11<3:53:26,  3.78it/s]
 86%|████████▌ | 318495/371472 [3:10:11<3:56:01,  3.74it/s]
 86%|████████▌ | 318496/371472 [3:10:11<3:49:41,  3.84it/s]
 86%|████████▌ | 318497/371472 [3:10:12<3:50:20,  3.83it/s]
 86%|████████▌ | 318498/371472 [3:10:12<3:55:52,  3.74it/s]
 86%|████████▌ | 318499/371472 [3:10:12<4:00:40,  3.67it/s]
 86%|████████▌ | 318500/371472 [3:10:13<3:53:36,  3.78it/s]
                                                           
{'loss': 2.6132, 'learning_rate': 2.2840936025339912e-07, 'epoch': 13.72}

 86%|████████▌ | 318500/371472 [3:10:13<3:53:36,  3.78it/s]
 86%|████████▌ | 318501/371472 [3:10:13<4:07:44,  3.56it/s]
 86%|████████▌ | 318502/371472 [3:10:13<3:59:31,  3.69it/s]
 86%|████████▌ | 318503/371472 [3:10:13<3:59:35,  3.68it/s]
 86%|████████▌ | 318504/371472 [3:10:14<4:20:23,  3.39it/s]
 86%|████████▌ | 318505/371472 [3:10:14<4:16:36,  3.44it/s]
 86%|████████▌ | 318506/371472 [3:10:14<4:44:53,  3.10it/s]
 86%|████████▌ | 318507/371472 [3:10:15<4:45:41,  3.09it/s]
 86%|████████▌ | 318508/371472 [3:10:15<4:33:36,  3.23it/s]
 86%|████████▌ | 318509/371472 [3:10:15<4:24:00,  3.34it/s]
 86%|████████▌ | 318510/371472 [3:10:16<4:24:37,  3.34it/s]
 86%|████████▌ | 318511/371472 [3:10:16<4:17:13,  3.43it/s]
 86%|████████▌ | 318512/371472 [3:10:16<4:27:57,  3.29it/s]
 86%|████████▌ | 318513/371472 [3:10:16<4:21:25,  3.38it/s]
 86%|████████▌ | 318514/371472 [3:10:17<4:07:46,  3.56it/s]
 86%|████████▌ | 318515/371472 [3:10:17<4:04:26,  3.61it/s]
 86%|████████▌ | 318516/371472 [3:10:17<4:08:43,  3.55it/s]
 86%|████████▌ | 318517/371472 [3:10:18<4:04:33,  3.61it/s]
 86%|████████▌ | 318518/371472 [3:10:18<3:57:30,  3.72it/s]
 86%|████████▌ | 318519/371472 [3:10:18<3:59:09,  3.69it/s]
 86%|████████▌ | 318520/371472 [3:10:18<4:05:35,  3.59it/s]
                                                           
{'loss': 2.6578, 'learning_rate': 2.2836087827792027e-07, 'epoch': 13.72}

 86%|████████▌ | 318520/371472 [3:10:18<4:05:35,  3.59it/s]
 86%|████████▌ | 318521/371472 [3:10:19<4:09:26,  3.54it/s]
 86%|████████▌ | 318522/371472 [3:10:19<3:59:19,  3.69it/s]
 86%|████████▌ | 318523/371472 [3:10:19<3:51:15,  3.82it/s]
 86%|████████▌ | 318524/371472 [3:10:19<4:03:06,  3.63it/s]
 86%|████████▌ | 318525/371472 [3:10:20<3:59:04,  3.69it/s]
 86%|████████▌ | 318526/371472 [3:10:20<3:59:33,  3.68it/s]
 86%|████████▌ | 318527/371472 [3:10:20<3:50:16,  3.83it/s]
 86%|████████▌ | 318528/371472 [3:10:21<3:58:59,  3.69it/s]
 86%|████████▌ | 318529/371472 [3:10:21<3:59:05,  3.69it/s]
 86%|████████▌ | 318530/371472 [3:10:21<3:47:36,  3.88it/s]
 86%|████████▌ | 318531/371472 [3:10:21<3:52:11,  3.80it/s]
 86%|████████▌ | 318532/371472 [3:10:22<4:07:19,  3.57it/s]
 86%|████████▌ | 318533/371472 [3:10:22<3:54:49,  3.76it/s]
 86%|████████▌ | 318534/371472 [3:10:22<3:50:40,  3.82it/s]
 86%|████████▌ | 318535/371472 [3:10:22<3:56:30,  3.73it/s]
 86%|████████▌ | 318536/371472 [3:10:23<3:53:11,  3.78it/s]
 86%|████████▌ | 318537/371472 [3:10:23<3:52:55,  3.79it/s]
 86%|████████▌ | 318538/371472 [3:10:23<4:05:08,  3.60it/s]
 86%|████████▌ | 318539/371472 [3:10:23<4:05:24,  3.59it/s]
 86%|████████▌ | 318540/371472 [3:10:24<4:04:09,  3.61it/s]
                                                           
{'loss': 2.7232, 'learning_rate': 2.283123963024413e-07, 'epoch': 13.72}

 86%|████████▌ | 318540/371472 [3:10:24<4:04:09,  3.61it/s]
 86%|████████▌ | 318541/371472 [3:10:24<4:05:25,  3.59it/s]
 86%|████████▌ | 318542/371472 [3:10:24<4:14:20,  3.47it/s]
 86%|████████▌ | 318543/371472 [3:10:25<4:11:15,  3.51it/s]
 86%|████████▌ | 318544/371472 [3:10:25<4:06:58,  3.57it/s]
 86%|████████▌ | 318545/371472 [3:10:25<4:07:15,  3.57it/s]
 86%|████████▌ | 318546/371472 [3:10:25<4:07:55,  3.56it/s]
 86%|████████▌ | 318547/371472 [3:10:26<4:09:45,  3.53it/s]
 86%|████████▌ | 318548/371472 [3:10:26<4:02:52,  3.63it/s]
 86%|████████▌ | 318549/371472 [3:10:26<4:12:09,  3.50it/s]
 86%|████████▌ | 318550/371472 [3:10:27<4:09:10,  3.54it/s]
 86%|████████▌ | 318551/371472 [3:10:27<4:11:32,  3.51it/s]
 86%|████████▌ | 318552/371472 [3:10:27<4:05:04,  3.60it/s]
 86%|████████▌ | 318553/371472 [3:10:27<4:06:15,  3.58it/s]
 86%|████████▌ | 318554/371472 [3:10:28<4:02:19,  3.64it/s]
 86%|████████▌ | 318555/371472 [3:10:28<3:56:45,  3.73it/s]
 86%|████████▌ | 318556/371472 [3:10:28<4:22:00,  3.37it/s]
 86%|████████▌ | 318557/371472 [3:10:29<4:12:29,  3.49it/s]
 86%|████████▌ | 318558/371472 [3:10:29<4:17:05,  3.43it/s]
 86%|████████▌ | 318559/371472 [3:10:29<4:08:39,  3.55it/s]
 86%|████████▌ | 318560/371472 [3:10:29<4:22:15,  3.36it/s]
                                                           
{'loss': 2.5221, 'learning_rate': 2.282639143269625e-07, 'epoch': 13.72}

 86%|████████▌ | 318560/371472 [3:10:29<4:22:15,  3.36it/s]
 86%|████████▌ | 318561/371472 [3:10:30<4:15:48,  3.45it/s]
 86%|████████▌ | 318562/371472 [3:10:30<4:11:29,  3.51it/s]
 86%|████████▌ | 318563/371472 [3:10:30<4:04:52,  3.60it/s]
 86%|████████▌ | 318564/371472 [3:10:31<3:52:57,  3.79it/s]
 86%|████████▌ | 318565/371472 [3:10:31<3:54:40,  3.76it/s]
 86%|████████▌ | 318566/371472 [3:10:31<3:58:46,  3.69it/s]
 86%|████████▌ | 318567/371472 [3:10:31<4:00:23,  3.67it/s]
 86%|████████▌ | 318568/371472 [3:10:32<3:59:56,  3.67it/s]
 86%|████████▌ | 318569/371472 [3:10:32<3:54:35,  3.76it/s]
 86%|████████▌ | 318570/371472 [3:10:32<3:57:00,  3.72it/s]
 86%|████████▌ | 318571/371472 [3:10:32<3:58:43,  3.69it/s]
 86%|████████▌ | 318572/371472 [3:10:33<4:02:04,  3.64it/s]
 86%|████████▌ | 318573/371472 [3:10:33<3:58:17,  3.70it/s]
 86%|████████▌ | 318574/371472 [3:10:33<4:01:13,  3.65it/s]
 86%|████████▌ | 318575/371472 [3:10:34<4:02:47,  3.63it/s]
 86%|████████▌ | 318576/371472 [3:10:34<4:01:15,  3.65it/s]
 86%|████████▌ | 318577/371472 [3:10:34<4:04:19,  3.61it/s]
 86%|████████▌ | 318578/371472 [3:10:34<4:02:13,  3.64it/s]
 86%|████████▌ | 318579/371472 [3:10:35<4:00:59,  3.66it/s]
 86%|████████▌ | 318580/371472 [3:10:35<3:59:09,  3.69it/s]
                                                           
{'loss': 2.7649, 'learning_rate': 2.282154323514835e-07, 'epoch': 13.72}

 86%|████████▌ | 318580/371472 [3:10:35<3:59:09,  3.69it/s]
 86%|████████▌ | 318581/371472 [3:10:35<4:03:51,  3.61it/s]
 86%|████████▌ | 318582/371472 [3:10:35<4:05:38,  3.59it/s]
 86%|████████▌ | 318583/371472 [3:10:36<4:00:28,  3.67it/s]
 86%|████████▌ | 318584/371472 [3:10:36<4:09:24,  3.53it/s]
 86%|████████▌ | 318585/371472 [3:10:36<4:21:52,  3.37it/s]
 86%|████████▌ | 318586/371472 [3:10:37<4:10:12,  3.52it/s]
 86%|████████▌ | 318587/371472 [3:10:37<4:02:57,  3.63it/s]
 86%|████████▌ | 318588/371472 [3:10:37<4:04:39,  3.60it/s]
 86%|████████▌ | 318589/371472 [3:10:37<4:07:44,  3.56it/s]
 86%|████████▌ | 318590/371472 [3:10:38<4:15:52,  3.44it/s]
 86%|████████▌ | 318591/371472 [3:10:38<4:12:11,  3.49it/s]
 86%|████████▌ | 318592/371472 [3:10:38<4:07:36,  3.56it/s]
 86%|████████▌ | 318593/371472 [3:10:39<4:02:44,  3.63it/s]
 86%|████████▌ | 318594/371472 [3:10:39<4:04:52,  3.60it/s]
 86%|████████▌ | 318595/371472 [3:10:39<4:16:47,  3.43it/s]
 86%|████████▌ | 318596/371472 [3:10:39<4:21:04,  3.38it/s]
 86%|████████▌ | 318597/371472 [3:10:40<4:15:12,  3.45it/s]
 86%|████████▌ | 318598/371472 [3:10:40<4:18:15,  3.41it/s]
 86%|████████▌ | 318599/371472 [3:10:40<4:19:47,  3.39it/s]
 86%|████████▌ | 318600/371472 [3:10:41<4:27:15,  3.30it/s]
                                                           
{'loss': 2.5224, 'learning_rate': 2.281669503760046e-07, 'epoch': 13.72}

 86%|████████▌ | 318600/371472 [3:10:41<4:27:15,  3.30it/s]
 86%|████████▌ | 318601/371472 [3:10:41<4:20:30,  3.38it/s]
 86%|████████▌ | 318602/371472 [3:10:41<4:23:21,  3.35it/s]
 86%|████████▌ | 318603/371472 [3:10:42<4:28:17,  3.28it/s]
 86%|████████▌ | 318604/371472 [3:10:42<4:19:49,  3.39it/s]
 86%|████████▌ | 318605/371472 [3:10:42<4:15:29,  3.45it/s]
 86%|████████▌ | 318606/371472 [3:10:42<4:08:20,  3.55it/s]
 86%|████████▌ | 318607/371472 [3:10:43<4:00:46,  3.66it/s]
 86%|████████▌ | 318608/371472 [3:10:43<4:01:08,  3.65it/s]
 86%|████████▌ | 318609/371472 [3:10:43<4:02:37,  3.63it/s]
 86%|████████▌ | 318610/371472 [3:10:43<4:00:08,  3.67it/s]
 86%|████████▌ | 318611/371472 [3:10:44<4:14:11,  3.47it/s]
 86%|████████▌ | 318612/371472 [3:10:44<4:06:14,  3.58it/s]
 86%|████████▌ | 318613/371472 [3:10:44<4:14:15,  3.46it/s]
 86%|████████▌ | 318614/371472 [3:10:45<4:08:15,  3.55it/s]
 86%|████████▌ | 318615/371472 [3:10:45<4:07:29,  3.56it/s]
 86%|████████▌ | 318616/371472 [3:10:45<4:09:37,  3.53it/s]
 86%|████████▌ | 318617/371472 [3:10:46<4:29:33,  3.27it/s]
 86%|████████▌ | 318618/371472 [3:10:46<4:18:08,  3.41it/s]
 86%|████████▌ | 318619/371472 [3:10:46<4:30:12,  3.26it/s]
 86%|████████▌ | 318620/371472 [3:10:46<4:18:40,  3.41it/s]
                                                           
{'loss': 2.5875, 'learning_rate': 2.2811846840052576e-07, 'epoch': 13.72}

 86%|████████▌ | 318620/371472 [3:10:46<4:18:40,  3.41it/s]
 86%|████████▌ | 318621/371472 [3:10:47<4:12:34,  3.49it/s]
 86%|████████▌ | 318622/371472 [3:10:47<4:06:50,  3.57it/s]
 86%|████████▌ | 318623/371472 [3:10:47<4:00:21,  3.66it/s]
 86%|████████▌ | 318624/371472 [3:10:47<3:54:42,  3.75it/s]
 86%|████████▌ | 318625/371472 [3:10:48<3:50:24,  3.82it/s]
 86%|████████▌ | 318626/371472 [3:10:48<3:59:27,  3.68it/s]
 86%|████████▌ | 318627/371472 [3:10:48<4:33:32,  3.22it/s]
 86%|████████▌ | 318628/371472 [3:10:49<4:22:05,  3.36it/s]
 86%|████████▌ | 318629/371472 [3:10:49<4:12:03,  3.49it/s]
 86%|████████▌ | 318630/371472 [3:10:49<4:11:30,  3.50it/s]
 86%|████████▌ | 318631/371472 [3:10:50<4:25:54,  3.31it/s]
 86%|████████▌ | 318632/371472 [3:10:50<4:15:09,  3.45it/s]
 86%|████████▌ | 318633/371472 [3:10:50<4:12:21,  3.49it/s]
 86%|████████▌ | 318634/371472 [3:10:50<4:08:24,  3.55it/s]
 86%|████████▌ | 318635/371472 [3:10:51<4:01:26,  3.65it/s]
 86%|████████▌ | 318636/371472 [3:10:51<4:21:50,  3.36it/s]
 86%|████████▌ | 318637/371472 [3:10:51<4:10:50,  3.51it/s]
 86%|████████▌ | 318638/371472 [3:10:52<4:10:41,  3.51it/s]
 86%|████████▌ | 318639/371472 [3:10:52<4:02:30,  3.63it/s]
 86%|████████▌ | 318640/371472 [3:10:52<4:03:01,  3.62it/s]
                                                           
{'loss': 2.6593, 'learning_rate': 2.280699864250468e-07, 'epoch': 13.72}

 86%|████████▌ | 318640/371472 [3:10:52<4:03:01,  3.62it/s]
 86%|████████▌ | 318641/371472 [3:10:52<4:01:34,  3.64it/s]
 86%|████████▌ | 318642/371472 [3:10:53<4:00:46,  3.66it/s]
 86%|████████▌ | 318643/371472 [3:10:53<3:56:32,  3.72it/s]
 86%|████████▌ | 318644/371472 [3:10:53<3:49:56,  3.83it/s]
 86%|████████▌ | 318645/371472 [3:10:53<3:54:08,  3.76it/s]
 86%|████████▌ | 318646/371472 [3:10:54<3:56:33,  3.72it/s]
 86%|████████▌ | 318647/371472 [3:10:54<4:00:05,  3.67it/s]
 86%|████████▌ | 318648/371472 [3:10:54<4:20:15,  3.38it/s]
 86%|████████▌ | 318649/371472 [3:10:55<4:12:30,  3.49it/s]
 86%|████████▌ | 318650/371472 [3:10:55<4:37:36,  3.17it/s]
 86%|████████▌ | 318651/371472 [3:10:55<4:20:50,  3.37it/s]
 86%|████████▌ | 318652/371472 [3:10:55<4:19:22,  3.39it/s]
 86%|████████▌ | 318653/371472 [3:10:56<4:14:03,  3.47it/s]
 86%|████████▌ | 318654/371472 [3:10:56<4:04:54,  3.59it/s]
 86%|████████▌ | 318655/371472 [3:10:56<4:12:32,  3.49it/s]
 86%|████████▌ | 318656/371472 [3:10:57<4:09:32,  3.53it/s]
 86%|████████▌ | 318657/371472 [3:10:57<4:17:18,  3.42it/s]
 86%|████████▌ | 318658/371472 [3:10:57<4:15:13,  3.45it/s]
 86%|████████▌ | 318659/371472 [3:10:57<4:20:57,  3.37it/s]
 86%|████████▌ | 318660/371472 [3:10:58<4:10:59,  3.51it/s]
                                                           
{'loss': 2.5634, 'learning_rate': 2.2802150444956798e-07, 'epoch': 13.73}

 86%|████████▌ | 318660/371472 [3:10:58<4:10:59,  3.51it/s]
 86%|████████▌ | 318661/371472 [3:10:58<4:17:42,  3.42it/s]
 86%|████████▌ | 318662/371472 [3:10:58<4:48:37,  3.05it/s]
 86%|████████▌ | 318663/371472 [3:10:59<4:33:44,  3.22it/s]
 86%|████████▌ | 318664/371472 [3:10:59<4:47:56,  3.06it/s]
 86%|████████▌ | 318665/371472 [3:10:59<4:29:25,  3.27it/s]
 86%|████████▌ | 318666/371472 [3:11:00<4:22:32,  3.35it/s]
 86%|████████▌ | 318667/371472 [3:11:00<4:21:41,  3.36it/s]
 86%|████████▌ | 318668/371472 [3:11:00<4:13:58,  3.47it/s]
 86%|████████▌ | 318669/371472 [3:11:00<4:17:12,  3.42it/s]
 86%|████████▌ | 318670/371472 [3:11:01<4:07:56,  3.55it/s]
 86%|████████▌ | 318671/371472 [3:11:01<4:04:37,  3.60it/s]
 86%|████████▌ | 318672/371472 [3:11:01<4:12:40,  3.48it/s]
 86%|████████▌ | 318673/371472 [3:11:02<4:13:11,  3.48it/s]
 86%|████████▌ | 318674/371472 [3:11:02<4:15:21,  3.45it/s]
 86%|████████▌ | 318675/371472 [3:11:02<4:15:51,  3.44it/s]
 86%|████████▌ | 318676/371472 [3:11:03<4:23:33,  3.34it/s]
 86%|████████▌ | 318677/371472 [3:11:03<4:16:09,  3.44it/s]
 86%|████████▌ | 318678/371472 [3:11:03<4:19:55,  3.39it/s]
 86%|████████▌ | 318679/371472 [3:11:03<4:12:18,  3.49it/s]
 86%|████████▌ | 318680/371472 [3:11:04<4:27:00,  3.30it/s]
                                                           
{'loss': 2.5581, 'learning_rate': 2.2797302247408903e-07, 'epoch': 13.73}

 86%|████████▌ | 318680/371472 [3:11:04<4:27:00,  3.30it/s]
 86%|████████▌ | 318681/371472 [3:11:04<4:44:43,  3.09it/s]
 86%|████████▌ | 318682/371472 [3:11:04<4:45:39,  3.08it/s]
 86%|████████▌ | 318683/371472 [3:11:05<4:47:14,  3.06it/s]
 86%|████████▌ | 318684/371472 [3:11:05<4:29:49,  3.26it/s]
 86%|████████▌ | 318685/371472 [3:11:05<4:25:21,  3.32it/s]
 86%|████████▌ | 318686/371472 [3:11:06<4:28:39,  3.27it/s]
 86%|████████▌ | 318687/371472 [3:11:06<4:18:45,  3.40it/s]
 86%|████████▌ | 318688/371472 [3:11:06<4:29:52,  3.26it/s]
 86%|████████▌ | 318689/371472 [3:11:06<4:16:33,  3.43it/s]
 86%|████████▌ | 318690/371472 [3:11:07<4:02:48,  3.62it/s]
 86%|████████▌ | 318691/371472 [3:11:07<4:16:26,  3.43it/s]
 86%|████████▌ | 318692/371472 [3:11:07<4:14:21,  3.46it/s]
 86%|████████▌ | 318693/371472 [3:11:08<4:05:20,  3.59it/s]
 86%|████████▌ | 318694/371472 [3:11:08<4:11:22,  3.50it/s]
 86%|████████▌ | 318695/371472 [3:11:08<4:11:21,  3.50it/s]
 86%|████████▌ | 318696/371472 [3:11:09<4:35:39,  3.19it/s]
 86%|████████▌ | 318697/371472 [3:11:09<4:19:19,  3.39it/s]
 86%|████████▌ | 318698/371472 [3:11:09<4:30:00,  3.26it/s]
 86%|████████▌ | 318699/371472 [3:11:09<4:36:31,  3.18it/s]
 86%|████████▌ | 318700/371472 [3:11:10<4:30:03,  3.26it/s]
                                                           
{'loss': 2.5185, 'learning_rate': 2.2792454049861018e-07, 'epoch': 13.73}

 86%|████████▌ | 318700/371472 [3:11:10<4:30:03,  3.26it/s]
 86%|████████▌ | 318701/371472 [3:11:10<4:27:16,  3.29it/s]
 86%|████████▌ | 318702/371472 [3:11:10<4:15:06,  3.45it/s]
 86%|████████▌ | 318703/371472 [3:11:11<4:08:20,  3.54it/s]
 86%|████████▌ | 318704/371472 [3:11:11<3:55:50,  3.73it/s]
 86%|████████▌ | 318705/371472 [3:11:11<4:01:30,  3.64it/s]
 86%|████████▌ | 318706/371472 [3:11:11<4:02:07,  3.63it/s]
 86%|████████▌ | 318707/371472 [3:11:12<4:16:42,  3.43it/s]
 86%|████████▌ | 318708/371472 [3:11:12<4:12:34,  3.48it/s]
 86%|████████▌ | 318709/371472 [3:11:12<4:05:39,  3.58it/s]
 86%|████████▌ | 318710/371472 [3:11:12<4:03:03,  3.62it/s]
 86%|████████▌ | 318711/371472 [3:11:13<4:06:20,  3.57it/s]
 86%|████████▌ | 318712/371472 [3:11:13<4:00:25,  3.66it/s]
 86%|████████▌ | 318713/371472 [3:11:13<4:02:20,  3.63it/s]
 86%|████████▌ | 318714/371472 [3:11:14<3:58:54,  3.68it/s]
 86%|████████▌ | 318715/371472 [3:11:14<4:01:05,  3.65it/s]
 86%|████████▌ | 318716/371472 [3:11:14<4:13:53,  3.46it/s]
 86%|████████▌ | 318717/371472 [3:11:14<4:14:18,  3.46it/s]
 86%|████████▌ | 318718/371472 [3:11:15<4:23:29,  3.34it/s]
 86%|████████▌ | 318719/371472 [3:11:15<4:11:17,  3.50it/s]
 86%|████████▌ | 318720/371472 [3:11:15<4:03:45,  3.61it/s]
                                                           
{'loss': 2.5307, 'learning_rate': 2.2787605852313125e-07, 'epoch': 13.73}

 86%|████████▌ | 318720/371472 [3:11:15<4:03:45,  3.61it/s]
 86%|████████▌ | 318721/371472 [3:11:16<3:55:53,  3.73it/s]
 86%|████████▌ | 318722/371472 [3:11:16<4:02:47,  3.62it/s]
 86%|████████▌ | 318723/371472 [3:11:16<3:56:05,  3.72it/s]
 86%|████████▌ | 318724/371472 [3:11:16<3:49:54,  3.82it/s]
 86%|████████▌ | 318725/371472 [3:11:17<3:55:02,  3.74it/s]
 86%|████████▌ | 318726/371472 [3:11:17<4:01:17,  3.64it/s]
 86%|████████▌ | 318727/371472 [3:11:17<4:02:22,  3.63it/s]
 86%|████████▌ | 318728/371472 [3:11:17<3:56:14,  3.72it/s]
 86%|████████▌ | 318729/371472 [3:11:18<3:52:26,  3.78it/s]
 86%|████████▌ | 318730/371472 [3:11:18<3:56:04,  3.72it/s]
 86%|████████▌ | 318731/371472 [3:11:18<4:00:41,  3.65it/s]
 86%|████████▌ | 318732/371472 [3:11:19<3:52:23,  3.78it/s]
 86%|████████▌ | 318733/371472 [3:11:19<3:57:44,  3.70it/s]
 86%|████████▌ | 318734/371472 [3:11:19<4:10:50,  3.50it/s]
 86%|████████▌ | 318735/371472 [3:11:19<4:21:40,  3.36it/s]
 86%|████████▌ | 318736/371472 [3:11:20<4:18:12,  3.40it/s]
 86%|████████▌ | 318737/371472 [3:11:20<4:18:10,  3.40it/s]
 86%|████████▌ | 318738/371472 [3:11:20<4:07:51,  3.55it/s]
 86%|████████▌ | 318739/371472 [3:11:21<4:17:17,  3.42it/s]
 86%|████████▌ | 318740/371472 [3:11:21<4:28:06,  3.28it/s]
                                                           
{'loss': 2.6528, 'learning_rate': 2.278275765476524e-07, 'epoch': 13.73}

 86%|████████▌ | 318740/371472 [3:11:21<4:28:06,  3.28it/s]
 86%|████████▌ | 318741/371472 [3:11:21<4:24:20,  3.32it/s]
 86%|████████▌ | 318742/371472 [3:11:22<4:28:49,  3.27it/s]
 86%|████████▌ | 318743/371472 [3:11:22<4:22:53,  3.34it/s]
 86%|████████▌ | 318744/371472 [3:11:22<4:35:38,  3.19it/s]
 86%|████████▌ | 318745/371472 [3:11:22<4:20:18,  3.38it/s]
 86%|████████▌ | 318746/371472 [3:11:23<4:13:29,  3.47it/s]
 86%|████████▌ | 318747/371472 [3:11:23<4:00:02,  3.66it/s]
 86%|████████▌ | 318748/371472 [3:11:23<4:01:24,  3.64it/s]
 86%|████████▌ | 318749/371472 [3:11:24<4:16:51,  3.42it/s]
 86%|████████▌ | 318750/371472 [3:11:24<4:12:04,  3.49it/s]
 86%|████████▌ | 318751/371472 [3:11:24<4:01:23,  3.64it/s]
 86%|████████▌ | 318752/371472 [3:11:24<4:00:49,  3.65it/s]
 86%|████████▌ | 318753/371472 [3:11:25<3:57:26,  3.70it/s]
 86%|████████▌ | 318754/371472 [3:11:25<4:01:08,  3.64it/s]
 86%|████████▌ | 318755/371472 [3:11:25<4:05:38,  3.58it/s]
 86%|████████▌ | 318756/371472 [3:11:25<4:13:55,  3.46it/s]
 86%|████████▌ | 318757/371472 [3:11:26<4:10:03,  3.51it/s]
 86%|████████▌ | 318758/371472 [3:11:26<4:18:36,  3.40it/s]
 86%|████████▌ | 318759/371472 [3:11:26<4:10:06,  3.51it/s]
 86%|████████▌ | 318760/371472 [3:11:27<4:09:54,  3.52it/s]
                                                           
{'loss': 2.6903, 'learning_rate': 2.2777909457217347e-07, 'epoch': 13.73}

 86%|████████▌ | 318760/371472 [3:11:27<4:09:54,  3.52it/s]
 86%|████████▌ | 318761/371472 [3:11:27<4:11:59,  3.49it/s]
 86%|████████▌ | 318762/371472 [3:11:27<4:15:50,  3.43it/s]
 86%|████████▌ | 318763/371472 [3:11:27<4:07:19,  3.55it/s]
 86%|████████▌ | 318764/371472 [3:11:28<3:59:46,  3.66it/s]
 86%|████████▌ | 318765/371472 [3:11:28<3:53:59,  3.75it/s]
 86%|████████▌ | 318766/371472 [3:11:28<3:54:11,  3.75it/s]
 86%|████████▌ | 318767/371472 [3:11:29<4:00:56,  3.65it/s]
 86%|████████▌ | 318768/371472 [3:11:29<4:13:29,  3.47it/s]
 86%|████████▌ | 318769/371472 [3:11:29<4:12:15,  3.48it/s]
 86%|████████▌ | 318770/371472 [3:11:29<4:18:34,  3.40it/s]
 86%|████████▌ | 318771/371472 [3:11:30<4:13:48,  3.46it/s]
 86%|████████▌ | 318772/371472 [3:11:30<4:05:26,  3.58it/s]
 86%|████████▌ | 318773/371472 [3:11:30<4:18:16,  3.40it/s]
 86%|████████▌ | 318774/371472 [3:11:31<4:05:26,  3.58it/s]
 86%|████████▌ | 318775/371472 [3:11:31<4:09:39,  3.52it/s]
 86%|████████▌ | 318776/371472 [3:11:31<4:04:03,  3.60it/s]
 86%|████████▌ | 318777/371472 [3:11:31<3:59:40,  3.66it/s]
 86%|████████▌ | 318778/371472 [3:11:32<4:08:37,  3.53it/s]
 86%|████████▌ | 318779/371472 [3:11:32<4:11:55,  3.49it/s]
 86%|████████▌ | 318780/371472 [3:11:32<4:09:27,  3.52it/s]
                                                           
{'loss': 2.5633, 'learning_rate': 2.2773061259669462e-07, 'epoch': 13.73}

 86%|████████▌ | 318780/371472 [3:11:32<4:09:27,  3.52it/s]
 86%|████████▌ | 318781/371472 [3:11:33<4:24:06,  3.33it/s]
 86%|████████▌ | 318782/371472 [3:11:33<4:10:41,  3.50it/s]
 86%|████████▌ | 318783/371472 [3:11:33<4:14:33,  3.45it/s]
 86%|████████▌ | 318784/371472 [3:11:33<4:04:37,  3.59it/s]
 86%|████████▌ | 318785/371472 [3:11:34<4:08:35,  3.53it/s]
 86%|████████▌ | 318786/371472 [3:11:34<4:31:59,  3.23it/s]
 86%|████████▌ | 318787/371472 [3:11:34<4:22:40,  3.34it/s]
 86%|████████▌ | 318788/371472 [3:11:35<4:15:48,  3.43it/s]
 86%|████████▌ | 318789/371472 [3:11:35<4:14:35,  3.45it/s]
 86%|████████▌ | 318790/371472 [3:11:35<4:13:24,  3.47it/s]
 86%|████████▌ | 318791/371472 [3:11:35<4:06:31,  3.56it/s]
 86%|████████▌ | 318792/371472 [3:11:36<4:05:34,  3.58it/s]
 86%|████████▌ | 318793/371472 [3:11:36<4:09:49,  3.51it/s]
 86%|████████▌ | 318794/371472 [3:11:36<4:11:21,  3.49it/s]
 86%|████████▌ | 318795/371472 [3:11:37<4:04:31,  3.59it/s]
 86%|████████▌ | 318796/371472 [3:11:37<4:15:19,  3.44it/s]
 86%|████████▌ | 318797/371472 [3:11:37<4:23:54,  3.33it/s]
 86%|████████▌ | 318798/371472 [3:11:38<4:26:44,  3.29it/s]
 86%|████████▌ | 318799/371472 [3:11:38<4:31:55,  3.23it/s]
 86%|████████▌ | 318800/371472 [3:11:38<4:19:29,  3.38it/s]
                                                           
{'loss': 2.6005, 'learning_rate': 2.2768213062121567e-07, 'epoch': 13.73}

 86%|████████▌ | 318800/371472 [3:11:38<4:19:29,  3.38it/s]
 86%|████████▌ | 318801/371472 [3:11:38<4:16:57,  3.42it/s]
 86%|████████▌ | 318802/371472 [3:11:39<4:21:24,  3.36it/s]
 86%|████████▌ | 318803/371472 [3:11:39<4:19:48,  3.38it/s]
 86%|████████▌ | 318804/371472 [3:11:39<4:10:41,  3.50it/s]
 86%|████████▌ | 318805/371472 [3:11:40<4:05:27,  3.58it/s]
 86%|████████▌ | 318806/371472 [3:11:40<3:59:16,  3.67it/s]
 86%|████████▌ | 318807/371472 [3:11:40<4:09:08,  3.52it/s]
 86%|████████▌ | 318808/371472 [3:11:40<3:58:59,  3.67it/s]
 86%|████████▌ | 318809/371472 [3:11:41<3:53:18,  3.76it/s]
 86%|████████▌ | 318810/371472 [3:11:41<3:46:28,  3.88it/s]
 86%|████████▌ | 318811/371472 [3:11:41<3:42:57,  3.94it/s]
 86%|████████▌ | 318812/371472 [3:11:41<3:47:47,  3.85it/s]
 86%|████████▌ | 318813/371472 [3:11:42<3:50:59,  3.80it/s]
 86%|████████▌ | 318814/371472 [3:11:42<3:58:28,  3.68it/s]
 86%|████████▌ | 318815/371472 [3:11:42<3:52:31,  3.77it/s]
 86%|████████▌ | 318816/371472 [3:11:42<3:47:53,  3.85it/s]
 86%|████████▌ | 318817/371472 [3:11:43<3:58:01,  3.69it/s]
 86%|████████▌ | 318818/371472 [3:11:43<4:06:10,  3.56it/s]
 86%|████████▌ | 318819/371472 [3:11:43<4:16:10,  3.43it/s]
 86%|████████▌ | 318820/371472 [3:11:44<4:14:08,  3.45it/s]
                                                           
{'loss': 2.6099, 'learning_rate': 2.2763364864573684e-07, 'epoch': 13.73}

 86%|████████▌ | 318820/371472 [3:11:44<4:14:08,  3.45it/s]
 86%|████████▌ | 318821/371472 [3:11:44<4:06:03,  3.57it/s]
 86%|████████▌ | 318822/371472 [3:11:44<3:57:48,  3.69it/s]
 86%|████████▌ | 318823/371472 [3:11:44<4:05:15,  3.58it/s]
 86%|████████▌ | 318824/371472 [3:11:45<4:04:03,  3.60it/s]
 86%|████████▌ | 318825/371472 [3:11:45<4:28:59,  3.26it/s]
 86%|████████▌ | 318826/371472 [3:11:45<4:14:19,  3.45it/s]
 86%|████████▌ | 318827/371472 [3:11:46<4:12:31,  3.47it/s]
 86%|████████▌ | 318828/371472 [3:11:46<4:15:17,  3.44it/s]
 86%|████████▌ | 318829/371472 [3:11:46<4:15:30,  3.43it/s]
 86%|████████▌ | 318830/371472 [3:11:46<4:05:13,  3.58it/s]
 86%|████████▌ | 318831/371472 [3:11:47<3:55:40,  3.72it/s]
 86%|████████▌ | 318832/371472 [3:11:47<4:27:44,  3.28it/s]
 86%|████████▌ | 318833/371472 [3:11:47<4:24:33,  3.32it/s]
 86%|████████▌ | 318834/371472 [3:11:48<4:33:32,  3.21it/s]
 86%|████████▌ | 318835/371472 [3:11:48<4:23:01,  3.34it/s]
 86%|████████▌ | 318836/371472 [3:11:48<4:17:33,  3.41it/s]
 86%|████████▌ | 318837/371472 [3:11:49<4:13:41,  3.46it/s]
 86%|████████▌ | 318838/371472 [3:11:49<4:13:30,  3.46it/s]
 86%|████████▌ | 318839/371472 [3:11:49<3:59:18,  3.67it/s]
 86%|████████▌ | 318840/371472 [3:11:49<3:57:03,  3.70it/s]
                                                           
{'loss': 2.6526, 'learning_rate': 2.275851666702579e-07, 'epoch': 13.73}

 86%|████████▌ | 318840/371472 [3:11:49<3:57:03,  3.70it/s]
 86%|████████▌ | 318841/371472 [3:11:50<4:04:05,  3.59it/s]
 86%|████████▌ | 318842/371472 [3:11:50<4:15:39,  3.43it/s]
 86%|████████▌ | 318843/371472 [3:11:50<4:02:47,  3.61it/s]
 86%|████████▌ | 318844/371472 [3:11:50<3:59:17,  3.67it/s]
 86%|████████▌ | 318845/371472 [3:11:51<4:10:38,  3.50it/s]
 86%|████████▌ | 318846/371472 [3:11:51<3:58:50,  3.67it/s]
 86%|████████▌ | 318847/371472 [3:11:51<4:07:58,  3.54it/s]
 86%|████████▌ | 318848/371472 [3:11:52<4:22:54,  3.34it/s]
 86%|████████▌ | 318849/371472 [3:11:52<4:22:05,  3.35it/s]
 86%|████████▌ | 318850/371472 [3:11:52<4:23:04,  3.33it/s]
 86%|████████▌ | 318851/371472 [3:11:53<4:16:46,  3.42it/s]
 86%|████████▌ | 318852/371472 [3:11:53<4:01:34,  3.63it/s]
 86%|████████▌ | 318853/371472 [3:11:53<3:54:26,  3.74it/s]
 86%|████████▌ | 318854/371472 [3:11:53<3:57:54,  3.69it/s]
 86%|████████▌ | 318855/371472 [3:11:54<3:54:26,  3.74it/s]
 86%|████████▌ | 318856/371472 [3:11:54<3:49:06,  3.83it/s]
 86%|████████▌ | 318857/371472 [3:11:54<3:44:17,  3.91it/s]
 86%|████████▌ | 318858/371472 [3:11:54<4:13:33,  3.46it/s]
 86%|████████▌ | 318859/371472 [3:11:55<4:31:23,  3.23it/s]
 86%|████████▌ | 318860/371472 [3:11:55<4:25:37,  3.30it/s]
                                                           
{'loss': 2.675, 'learning_rate': 2.2753668469477904e-07, 'epoch': 13.73}

 86%|████████▌ | 318860/371472 [3:11:55<4:25:37,  3.30it/s]
 86%|████████▌ | 318861/371472 [3:11:55<4:11:13,  3.49it/s]
 86%|████████▌ | 318862/371472 [3:11:56<4:00:50,  3.64it/s]
 86%|████████▌ | 318863/371472 [3:11:56<3:53:29,  3.76it/s]
 86%|████████▌ | 318864/371472 [3:11:56<3:49:54,  3.81it/s]
 86%|████████▌ | 318865/371472 [3:11:56<3:47:43,  3.85it/s]
 86%|████████▌ | 318866/371472 [3:11:57<3:44:10,  3.91it/s]
 86%|████████▌ | 318867/371472 [3:11:57<3:37:46,  4.03it/s]
 86%|████████▌ | 318868/371472 [3:11:57<3:44:30,  3.91it/s]
 86%|████████▌ | 318869/371472 [3:11:57<3:44:17,  3.91it/s]
 86%|████████▌ | 318870/371472 [3:11:58<3:49:25,  3.82it/s]
 86%|████████▌ | 318871/371472 [3:11:58<4:00:17,  3.65it/s]
 86%|████████▌ | 318872/371472 [3:11:58<4:11:06,  3.49it/s]
 86%|████████▌ | 318873/371472 [3:11:59<4:18:14,  3.39it/s]
 86%|████████▌ | 318874/371472 [3:11:59<4:15:42,  3.43it/s]
 86%|████████▌ | 318875/371472 [3:11:59<4:06:10,  3.56it/s]
 86%|████████▌ | 318876/371472 [3:11:59<4:00:37,  3.64it/s]
 86%|████████▌ | 318877/371472 [3:12:00<3:54:36,  3.74it/s]
 86%|████████▌ | 318878/371472 [3:12:00<3:50:16,  3.81it/s]
 86%|████████▌ | 318879/371472 [3:12:00<3:41:19,  3.96it/s]
 86%|████████▌ | 318880/371472 [3:12:00<3:57:09,  3.70it/s]
                                                           
{'loss': 2.5057, 'learning_rate': 2.274882027193001e-07, 'epoch': 13.73}

 86%|████████▌ | 318880/371472 [3:12:00<3:57:09,  3.70it/s]
 86%|████████▌ | 318881/371472 [3:12:01<3:53:46,  3.75it/s]
 86%|████████▌ | 318882/371472 [3:12:01<3:54:38,  3.74it/s]
 86%|████████▌ | 318883/371472 [3:12:01<3:48:48,  3.83it/s]
 86%|████████▌ | 318884/371472 [3:12:01<3:47:56,  3.85it/s]
 86%|████████▌ | 318885/371472 [3:12:02<3:44:13,  3.91it/s]
 86%|████████▌ | 318886/371472 [3:12:02<3:40:46,  3.97it/s]
 86%|████████▌ | 318887/371472 [3:12:02<3:54:21,  3.74it/s]
 86%|████████▌ | 318888/371472 [3:12:02<3:59:35,  3.66it/s]
 86%|████████▌ | 318889/371472 [3:12:03<4:01:24,  3.63it/s]
 86%|████████▌ | 318890/371472 [3:12:03<4:02:31,  3.61it/s]
 86%|████████▌ | 318891/371472 [3:12:03<3:57:25,  3.69it/s]
 86%|████████▌ | 318892/371472 [3:12:04<4:02:39,  3.61it/s]
 86%|████████▌ | 318893/371472 [3:12:04<4:11:26,  3.49it/s]
 86%|████████▌ | 318894/371472 [3:12:04<4:04:44,  3.58it/s]
 86%|████████▌ | 318895/371472 [3:12:04<4:19:34,  3.38it/s]
 86%|████████▌ | 318896/371472 [3:12:05<4:16:59,  3.41it/s]
 86%|████████▌ | 318897/371472 [3:12:05<4:11:59,  3.48it/s]
 86%|████████▌ | 318898/371472 [3:12:05<4:13:44,  3.45it/s]
 86%|████████▌ | 318899/371472 [3:12:06<3:59:45,  3.65it/s]
 86%|████████▌ | 318900/371472 [3:12:06<4:07:03,  3.55it/s]
                                                           
{'loss': 2.5883, 'learning_rate': 2.2743972074382126e-07, 'epoch': 13.74}

 86%|████████▌ | 318900/371472 [3:12:06<4:07:03,  3.55it/s]
 86%|████████▌ | 318901/371472 [3:12:06<4:17:34,  3.40it/s]
 86%|████████▌ | 318902/371472 [3:12:06<4:16:29,  3.42it/s]
 86%|████████▌ | 318903/371472 [3:12:07<4:16:43,  3.41it/s]
 86%|████████▌ | 318904/371472 [3:12:07<4:20:29,  3.36it/s]
 86%|████████▌ | 318905/371472 [3:12:07<4:17:54,  3.40it/s]
 86%|████████▌ | 318906/371472 [3:12:08<4:16:13,  3.42it/s]
 86%|████████▌ | 318907/371472 [3:12:08<4:03:31,  3.60it/s]
 86%|████████▌ | 318908/371472 [3:12:08<4:07:39,  3.54it/s]
 86%|████████▌ | 318909/371472 [3:12:09<4:15:15,  3.43it/s]
 86%|████████▌ | 318910/371472 [3:12:09<4:09:01,  3.52it/s]
 86%|████████▌ | 318911/371472 [3:12:09<4:24:57,  3.31it/s]
 86%|████████▌ | 318912/371472 [3:12:09<4:38:41,  3.14it/s]
 86%|████████▌ | 318913/371472 [3:12:10<4:26:59,  3.28it/s]
 86%|████████▌ | 318914/371472 [3:12:10<4:18:49,  3.38it/s]
 86%|████████▌ | 318915/371472 [3:12:10<4:17:27,  3.40it/s]
 86%|████████▌ | 318916/371472 [3:12:11<4:02:32,  3.61it/s]
 86%|████████▌ | 318917/371472 [3:12:11<3:57:35,  3.69it/s]
 86%|████████▌ | 318918/371472 [3:12:11<3:55:44,  3.72it/s]
 86%|████████▌ | 318919/371472 [3:12:11<3:54:57,  3.73it/s]
 86%|████████▌ | 318920/371472 [3:12:12<3:50:54,  3.79it/s]
                                                           
{'loss': 2.7093, 'learning_rate': 2.273912387683423e-07, 'epoch': 13.74}

 86%|████████▌ | 318920/371472 [3:12:12<3:50:54,  3.79it/s]
 86%|████████▌ | 318921/371472 [3:12:12<4:00:25,  3.64it/s]
 86%|████████▌ | 318922/371472 [3:12:12<3:59:15,  3.66it/s]
 86%|████████▌ | 318923/371472 [3:12:12<3:57:15,  3.69it/s]
 86%|████████▌ | 318924/371472 [3:12:13<3:51:34,  3.78it/s]
 86%|████████▌ | 318925/371472 [3:12:13<4:01:48,  3.62it/s]
 86%|████████▌ | 318926/371472 [3:12:13<3:54:04,  3.74it/s]
 86%|████████▌ | 318927/371472 [3:12:14<3:57:07,  3.69it/s]
 86%|████████▌ | 318928/371472 [3:12:14<3:47:07,  3.86it/s]
 86%|████████▌ | 318929/371472 [3:12:14<3:40:56,  3.96it/s]
 86%|████████▌ | 318930/371472 [3:12:14<3:54:53,  3.73it/s]
 86%|████████▌ | 318931/371472 [3:12:15<4:05:53,  3.56it/s]
 86%|████████▌ | 318932/371472 [3:12:15<4:11:37,  3.48it/s]
 86%|████████▌ | 318933/371472 [3:12:15<4:29:02,  3.25it/s]
 86%|████████▌ | 318934/371472 [3:12:16<4:25:30,  3.30it/s]
 86%|████████▌ | 318935/371472 [3:12:16<4:09:38,  3.51it/s]
 86%|████████▌ | 318936/371472 [3:12:16<4:01:26,  3.63it/s]
 86%|████████▌ | 318937/371472 [3:12:16<4:11:33,  3.48it/s]
 86%|████████▌ | 318938/371472 [3:12:17<4:12:03,  3.47it/s]
 86%|████████▌ | 318939/371472 [3:12:17<4:18:39,  3.38it/s]
 86%|████████▌ | 318940/371472 [3:12:17<4:08:59,  3.52it/s]
                                                           
{'loss': 2.522, 'learning_rate': 2.2734275679286348e-07, 'epoch': 13.74}

 86%|████████▌ | 318940/371472 [3:12:17<4:08:59,  3.52it/s]
 86%|████████▌ | 318941/371472 [3:12:17<4:00:55,  3.63it/s]
 86%|████████▌ | 318942/371472 [3:12:18<3:58:07,  3.68it/s]
 86%|████████▌ | 318943/371472 [3:12:18<4:10:00,  3.50it/s]
 86%|████████▌ | 318944/371472 [3:12:18<4:20:46,  3.36it/s]
 86%|████████▌ | 318945/371472 [3:12:19<4:04:35,  3.58it/s]
 86%|████████▌ | 318946/371472 [3:12:19<3:52:01,  3.77it/s]
 86%|████████▌ | 318947/371472 [3:12:19<3:45:39,  3.88it/s]
 86%|████████▌ | 318948/371472 [3:12:19<3:40:43,  3.97it/s]
 86%|████████▌ | 318949/371472 [3:12:20<3:45:46,  3.88it/s]
 86%|████████▌ | 318950/371472 [3:12:20<3:50:00,  3.81it/s]
 86%|████████▌ | 318951/371472 [3:12:20<3:59:38,  3.65it/s]
 86%|████████▌ | 318952/371472 [3:12:20<4:03:15,  3.60it/s]
 86%|████████▌ | 318953/371472 [3:12:21<4:01:35,  3.62it/s]
 86%|████████▌ | 318954/371472 [3:12:21<4:12:22,  3.47it/s]
 86%|████████▌ | 318955/371472 [3:12:21<4:09:05,  3.51it/s]
 86%|████████▌ | 318956/371472 [3:12:22<4:14:56,  3.43it/s]
 86%|████████▌ | 318957/371472 [3:12:22<4:17:44,  3.40it/s]
 86%|████████▌ | 318958/371472 [3:12:22<4:06:14,  3.55it/s]
 86%|████████▌ | 318959/371472 [3:12:23<4:29:59,  3.24it/s]
 86%|████████▌ | 318960/371472 [3:12:23<4:13:25,  3.45it/s]
                                                           
{'loss': 2.6332, 'learning_rate': 2.2729427481738453e-07, 'epoch': 13.74}

 86%|████████▌ | 318960/371472 [3:12:23<4:13:25,  3.45it/s]
 86%|████████▌ | 318961/371472 [3:12:23<4:05:07,  3.57it/s]
 86%|████████▌ | 318962/371472 [3:12:23<4:14:13,  3.44it/s]
 86%|████████▌ | 318963/371472 [3:12:24<4:03:55,  3.59it/s]
 86%|████████▌ | 318964/371472 [3:12:24<3:59:47,  3.65it/s]
 86%|████████▌ | 318965/371472 [3:12:24<4:17:57,  3.39it/s]
 86%|████████▌ | 318966/371472 [3:12:24<4:07:24,  3.54it/s]
 86%|████████▌ | 318967/371472 [3:12:25<3:57:38,  3.68it/s]
 86%|████████▌ | 318968/371472 [3:12:25<4:02:15,  3.61it/s]
 86%|████████▌ | 318969/371472 [3:12:25<4:02:05,  3.61it/s]
 86%|████████▌ | 318970/371472 [3:12:26<4:15:13,  3.43it/s]
 86%|████████▌ | 318971/371472 [3:12:26<4:02:57,  3.60it/s]
 86%|████████▌ | 318972/371472 [3:12:26<4:13:53,  3.45it/s]
 86%|████████▌ | 318973/371472 [3:12:26<4:10:45,  3.49it/s]
 86%|████████▌ | 318974/371472 [3:12:27<4:17:52,  3.39it/s]
 86%|████████▌ | 318975/371472 [3:12:27<4:09:55,  3.50it/s]
 86%|████████▌ | 318976/371472 [3:12:27<4:12:32,  3.46it/s]
 86%|████████▌ | 318977/371472 [3:12:28<4:03:42,  3.59it/s]
 86%|████████▌ | 318978/371472 [3:12:28<4:04:39,  3.58it/s]
 86%|████████▌ | 318979/371472 [3:12:28<4:10:21,  3.49it/s]
 86%|████████▌ | 318980/371472 [3:12:28<4:02:12,  3.61it/s]
                                                           
{'loss': 2.6915, 'learning_rate': 2.2724579284190568e-07, 'epoch': 13.74}

 86%|████████▌ | 318980/371472 [3:12:28<4:02:12,  3.61it/s]
 86%|████████▌ | 318981/371472 [3:12:29<4:10:56,  3.49it/s]
 86%|████████▌ | 318982/371472 [3:12:29<4:00:35,  3.64it/s]
 86%|████████▌ | 318983/371472 [3:12:29<3:55:05,  3.72it/s]
 86%|████████▌ | 318984/371472 [3:12:30<3:53:25,  3.75it/s]
 86%|████████▌ | 318985/371472 [3:12:30<3:48:26,  3.83it/s]
 86%|████████▌ | 318986/371472 [3:12:30<4:02:52,  3.60it/s]
 86%|████████▌ | 318987/371472 [3:12:30<4:07:07,  3.54it/s]
 86%|████████▌ | 318988/371472 [3:12:31<3:54:43,  3.73it/s]
 86%|████████▌ | 318989/371472 [3:12:31<4:11:58,  3.47it/s]
 86%|████████▌ | 318990/371472 [3:12:31<4:08:09,  3.52it/s]
 86%|████████▌ | 318991/371472 [3:12:31<4:01:38,  3.62it/s]
 86%|████████▌ | 318992/371472 [3:12:32<4:02:53,  3.60it/s]
 86%|████████▌ | 318993/371472 [3:12:32<4:09:11,  3.51it/s]
 86%|████████▌ | 318994/371472 [3:12:32<3:57:05,  3.69it/s]
 86%|████████▌ | 318995/371472 [3:12:33<4:01:54,  3.62it/s]
 86%|████████▌ | 318996/371472 [3:12:33<3:58:31,  3.67it/s]
 86%|████████▌ | 318997/371472 [3:12:33<4:05:08,  3.57it/s]
 86%|████████▌ | 318998/371472 [3:12:33<3:59:26,  3.65it/s]
 86%|████████▌ | 318999/371472 [3:12:34<3:49:17,  3.81it/s]
 86%|████████▌ | 319000/371472 [3:12:34<3:45:01,  3.89it/s]
                                                           
{'loss': 2.7708, 'learning_rate': 2.2719731086642675e-07, 'epoch': 13.74}

 86%|████████▌ | 319000/371472 [3:12:34<3:45:01,  3.89it/s]
 86%|████████▌ | 319001/371472 [3:12:34<3:45:09,  3.88it/s]
 86%|████████▌ | 319002/371472 [3:12:34<3:59:41,  3.65it/s]
 86%|████████▌ | 319003/371472 [3:12:35<3:55:04,  3.72it/s]
 86%|████████▌ | 319004/371472 [3:12:35<4:06:55,  3.54it/s]
 86%|████████▌ | 319005/371472 [3:12:35<4:30:30,  3.23it/s]
 86%|████████▌ | 319006/371472 [3:12:36<4:44:33,  3.07it/s]
 86%|████████▌ | 319007/371472 [3:12:36<4:30:05,  3.24it/s]
 86%|████████▌ | 319008/371472 [3:12:36<4:27:16,  3.27it/s]
 86%|████████▌ | 319009/371472 [3:12:37<4:12:20,  3.47it/s]
 86%|████████▌ | 319010/371472 [3:12:37<4:32:33,  3.21it/s]
 86%|████████▌ | 319011/371472 [3:12:37<4:20:28,  3.36it/s]
 86%|████████▌ | 319012/371472 [3:12:37<4:12:40,  3.46it/s]
 86%|████████▌ | 319013/371472 [3:12:38<4:08:16,  3.52it/s]
 86%|████████▌ | 319014/371472 [3:12:38<3:56:02,  3.70it/s]
 86%|████████▌ | 319015/371472 [3:12:38<3:55:46,  3.71it/s]
 86%|████████▌ | 319016/371472 [3:12:39<3:57:21,  3.68it/s]
 86%|████████▌ | 319017/371472 [3:12:39<3:55:57,  3.70it/s]
 86%|████████▌ | 319018/371472 [3:12:39<4:14:41,  3.43it/s]
 86%|████████▌ | 319019/371472 [3:12:39<4:09:39,  3.50it/s]
 86%|████████▌ | 319020/371472 [3:12:40<4:01:13,  3.62it/s]
                                                           
{'loss': 2.5651, 'learning_rate': 2.271488288909479e-07, 'epoch': 13.74}

 86%|████████▌ | 319020/371472 [3:12:40<4:01:13,  3.62it/s]
 86%|████████▌ | 319021/371472 [3:12:40<3:59:25,  3.65it/s]
 86%|████████▌ | 319022/371472 [3:12:40<4:00:41,  3.63it/s]
 86%|████████▌ | 319023/371472 [3:12:41<4:20:06,  3.36it/s]
 86%|████████▌ | 319024/371472 [3:12:41<4:13:52,  3.44it/s]
 86%|████████▌ | 319025/371472 [3:12:41<4:11:43,  3.47it/s]
 86%|████████▌ | 319026/371472 [3:12:41<4:23:39,  3.32it/s]
 86%|████████▌ | 319027/371472 [3:12:42<4:09:29,  3.50it/s]
 86%|████████▌ | 319028/371472 [3:12:42<4:22:37,  3.33it/s]
 86%|████████▌ | 319029/371472 [3:12:42<4:11:35,  3.47it/s]
 86%|████████▌ | 319030/371472 [3:12:43<4:14:06,  3.44it/s]
 86%|████████▌ | 319031/371472 [3:12:43<4:17:03,  3.40it/s]
 86%|████████▌ | 319032/371472 [3:12:43<4:13:25,  3.45it/s]
 86%|████████▌ | 319033/371472 [3:12:43<4:11:22,  3.48it/s]
 86%|████████▌ | 319034/371472 [3:12:44<4:27:03,  3.27it/s]
 86%|████████▌ | 319035/371472 [3:12:44<4:19:22,  3.37it/s]
 86%|████████▌ | 319036/371472 [3:12:44<4:09:35,  3.50it/s]
 86%|████████▌ | 319037/371472 [3:12:45<4:04:36,  3.57it/s]
 86%|████████▌ | 319038/371472 [3:12:45<4:11:34,  3.47it/s]
 86%|████████▌ | 319039/371472 [3:12:45<4:10:12,  3.49it/s]
 86%|████████▌ | 319040/371472 [3:12:45<4:09:59,  3.50it/s]
                                                           
{'loss': 2.6959, 'learning_rate': 2.2710034691546897e-07, 'epoch': 13.74}

 86%|████████▌ | 319040/371472 [3:12:45<4:09:59,  3.50it/s]
 86%|████████▌ | 319041/371472 [3:12:46<4:05:19,  3.56it/s]
 86%|████████▌ | 319042/371472 [3:12:46<4:15:24,  3.42it/s]
 86%|████████▌ | 319043/371472 [3:12:46<4:05:41,  3.56it/s]
 86%|████████▌ | 319044/371472 [3:12:47<4:11:13,  3.48it/s]
 86%|████████▌ | 319045/371472 [3:12:47<4:13:18,  3.45it/s]
 86%|████████▌ | 319046/371472 [3:12:47<4:00:14,  3.64it/s]
 86%|████████▌ | 319047/371472 [3:12:47<3:53:19,  3.74it/s]
 86%|████████▌ | 319048/371472 [3:12:48<3:51:28,  3.77it/s]
 86%|████████▌ | 319049/371472 [3:12:48<4:01:19,  3.62it/s]
 86%|████████▌ | 319050/371472 [3:12:48<3:56:37,  3.69it/s]
 86%|████████▌ | 319051/371472 [3:12:48<3:52:09,  3.76it/s]
 86%|████████▌ | 319052/371472 [3:12:49<3:46:19,  3.86it/s]
 86%|████████▌ | 319053/371472 [3:12:49<3:53:06,  3.75it/s]
 86%|████████▌ | 319054/371472 [3:12:49<3:57:25,  3.68it/s]
 86%|████████▌ | 319055/371472 [3:12:50<3:53:14,  3.75it/s]
 86%|████████▌ | 319056/371472 [3:12:50<3:52:35,  3.76it/s]
 86%|████████▌ | 319057/371472 [3:12:50<3:55:22,  3.71it/s]
 86%|████████▌ | 319058/371472 [3:12:50<4:00:03,  3.64it/s]
 86%|████████▌ | 319059/371472 [3:12:51<4:08:06,  3.52it/s]
 86%|████████▌ | 319060/371472 [3:12:51<4:06:56,  3.54it/s]
                                                           
{'loss': 2.6764, 'learning_rate': 2.2705186493999012e-07, 'epoch': 13.74}

 86%|████████▌ | 319060/371472 [3:12:51<4:06:56,  3.54it/s]
 86%|████████▌ | 319061/371472 [3:12:51<3:57:35,  3.68it/s]
 86%|████████▌ | 319062/371472 [3:12:52<4:12:29,  3.46it/s]
 86%|████████▌ | 319063/371472 [3:12:52<4:05:33,  3.56it/s]
 86%|████████▌ | 319064/371472 [3:12:52<4:02:06,  3.61it/s]
 86%|████████▌ | 319065/371472 [3:12:52<3:53:38,  3.74it/s]
 86%|████████▌ | 319066/371472 [3:12:53<3:53:54,  3.73it/s]
 86%|████████▌ | 319067/371472 [3:12:53<3:53:47,  3.74it/s]
 86%|████████▌ | 319068/371472 [3:12:53<3:48:38,  3.82it/s]
 86%|████████▌ | 319069/371472 [3:12:53<3:56:56,  3.69it/s]
 86%|████████▌ | 319070/371472 [3:12:54<4:11:25,  3.47it/s]
 86%|████████▌ | 319071/371472 [3:12:54<4:09:13,  3.50it/s]
 86%|████████▌ | 319072/371472 [3:12:54<4:05:07,  3.56it/s]
 86%|████████▌ | 319073/371472 [3:12:55<4:00:57,  3.62it/s]
 86%|████████▌ | 319074/371472 [3:12:55<3:58:17,  3.66it/s]
 86%|████████▌ | 319075/371472 [3:12:55<4:01:56,  3.61it/s]
 86%|████████▌ | 319076/371472 [3:12:55<3:58:30,  3.66it/s]
 86%|████████▌ | 319077/371472 [3:12:56<4:01:31,  3.62it/s]
 86%|████████▌ | 319078/371472 [3:12:56<4:05:36,  3.56it/s]
 86%|████████▌ | 319079/371472 [3:12:56<4:04:08,  3.58it/s]
 86%|████████▌ | 319080/371472 [3:12:57<4:20:47,  3.35it/s]
                                                           
{'loss': 2.5679, 'learning_rate': 2.2700338296451117e-07, 'epoch': 13.74}

 86%|████████▌ | 319080/371472 [3:12:57<4:20:47,  3.35it/s]
 86%|████████▌ | 319081/371472 [3:12:57<4:14:36,  3.43it/s]
 86%|████████▌ | 319082/371472 [3:12:57<4:14:20,  3.43it/s]
 86%|████████▌ | 319083/371472 [3:12:57<4:07:23,  3.53it/s]
 86%|████████▌ | 319084/371472 [3:12:58<4:09:42,  3.50it/s]
 86%|████████▌ | 319085/371472 [3:12:58<4:39:29,  3.12it/s]
 86%|████████▌ | 319086/371472 [3:12:58<4:22:13,  3.33it/s]
 86%|████████▌ | 319087/371472 [3:12:59<4:06:14,  3.55it/s]
 86%|████████▌ | 319088/371472 [3:12:59<4:20:57,  3.35it/s]
 86%|████████▌ | 319089/371472 [3:12:59<4:11:07,  3.48it/s]
 86%|████████▌ | 319090/371472 [3:13:00<4:34:24,  3.18it/s]
 86%|████████▌ | 319091/371472 [3:13:00<4:33:52,  3.19it/s]
 86%|████████▌ | 319092/371472 [3:13:00<4:25:16,  3.29it/s]
 86%|████████▌ | 319093/371472 [3:13:00<4:08:54,  3.51it/s]
 86%|████████▌ | 319094/371472 [3:13:01<4:09:05,  3.50it/s]
 86%|████████▌ | 319095/371472 [3:13:01<4:08:38,  3.51it/s]
 86%|████████▌ | 319096/371472 [3:13:01<4:22:49,  3.32it/s]
 86%|████████▌ | 319097/371472 [3:13:02<4:30:18,  3.23it/s]
 86%|████████▌ | 319098/371472 [3:13:02<4:30:50,  3.22it/s]
 86%|████████▌ | 319099/371472 [3:13:02<4:25:02,  3.29it/s]
 86%|████████▌ | 319100/371472 [3:13:02<4:08:57,  3.51it/s]
                                                           
{'loss': 2.5923, 'learning_rate': 2.2695490098903237e-07, 'epoch': 13.74}

 86%|████████▌ | 319100/371472 [3:13:02<4:08:57,  3.51it/s]
 86%|████████▌ | 319101/371472 [3:13:03<4:12:45,  3.45it/s]
 86%|████████▌ | 319102/371472 [3:13:03<4:14:49,  3.43it/s]
 86%|████████▌ | 319103/371472 [3:13:03<4:09:40,  3.50it/s]
 86%|████████▌ | 319104/371472 [3:13:04<4:41:24,  3.10it/s]
 86%|████████▌ | 319105/371472 [3:13:04<4:30:18,  3.23it/s]
 86%|████████▌ | 319106/371472 [3:13:04<4:19:07,  3.37it/s]
 86%|████████▌ | 319107/371472 [3:13:05<4:22:45,  3.32it/s]
 86%|████████▌ | 319108/371472 [3:13:05<4:11:16,  3.47it/s]
 86%|████████▌ | 319109/371472 [3:13:05<4:01:31,  3.61it/s]
 86%|████████▌ | 319110/371472 [3:13:05<4:04:36,  3.57it/s]
 86%|████████▌ | 319111/371472 [3:13:06<3:56:38,  3.69it/s]
 86%|████████▌ | 319112/371472 [3:13:06<3:49:23,  3.80it/s]
 86%|████████▌ | 319113/371472 [3:13:06<3:57:56,  3.67it/s]
 86%|████████▌ | 319114/371472 [3:13:06<3:49:04,  3.81it/s]
 86%|████████▌ | 319115/371472 [3:13:07<3:49:11,  3.81it/s]
 86%|████████▌ | 319116/371472 [3:13:07<3:44:46,  3.88it/s]
 86%|████████▌ | 319117/371472 [3:13:07<3:41:05,  3.95it/s]
 86%|████████▌ | 319118/371472 [3:13:07<3:42:51,  3.92it/s]
 86%|████████▌ | 319119/371472 [3:13:08<4:00:44,  3.62it/s]
 86%|████████▌ | 319120/371472 [3:13:08<4:02:20,  3.60it/s]
                                                           
{'loss': 2.6913, 'learning_rate': 2.269064190135534e-07, 'epoch': 13.75}

 86%|████████▌ | 319120/371472 [3:13:08<4:02:20,  3.60it/s]
 86%|████████▌ | 319121/371472 [3:13:08<4:15:08,  3.42it/s]
 86%|████████▌ | 319122/371472 [3:13:09<4:03:58,  3.58it/s]
 86%|████████▌ | 319123/371472 [3:13:09<4:06:30,  3.54it/s]
 86%|████████▌ | 319124/371472 [3:13:09<4:10:37,  3.48it/s]
 86%|████████▌ | 319125/371472 [3:13:09<4:08:58,  3.50it/s]
 86%|████████▌ | 319126/371472 [3:13:10<4:06:39,  3.54it/s]
 86%|████████▌ | 319127/371472 [3:13:10<3:57:20,  3.68it/s]
 86%|████████▌ | 319128/371472 [3:13:10<4:09:21,  3.50it/s]
 86%|████████▌ | 319129/371472 [3:13:11<4:04:04,  3.57it/s]
 86%|████████▌ | 319130/371472 [3:13:11<4:10:37,  3.48it/s]
 86%|████████▌ | 319131/371472 [3:13:11<4:03:32,  3.58it/s]
 86%|████████▌ | 319132/371472 [3:13:12<4:29:00,  3.24it/s]
 86%|████████▌ | 319133/371472 [3:13:12<4:24:48,  3.29it/s]
 86%|████████▌ | 319134/371472 [3:13:12<4:20:17,  3.35it/s]
 86%|████████▌ | 319135/371472 [3:13:12<4:13:54,  3.44it/s]
 86%|████████▌ | 319136/371472 [3:13:13<4:22:11,  3.33it/s]
 86%|████████▌ | 319137/371472 [3:13:13<4:15:21,  3.42it/s]
 86%|████████▌ | 319138/371472 [3:13:13<4:02:23,  3.60it/s]
 86%|████████▌ | 319139/371472 [3:13:13<4:02:27,  3.60it/s]
 86%|████████▌ | 319140/371472 [3:13:14<4:19:41,  3.36it/s]
                                                           
{'loss': 2.4856, 'learning_rate': 2.2685793703807446e-07, 'epoch': 13.75}

 86%|████████▌ | 319140/371472 [3:13:14<4:19:41,  3.36it/s]
 86%|████████▌ | 319141/371472 [3:13:14<4:19:26,  3.36it/s]
 86%|████████▌ | 319142/371472 [3:13:14<4:11:19,  3.47it/s]
 86%|████████▌ | 319143/371472 [3:13:15<4:07:27,  3.52it/s]
 86%|████████▌ | 319144/371472 [3:13:15<3:56:48,  3.68it/s]
 86%|████████▌ | 319145/371472 [3:13:15<3:57:09,  3.68it/s]
 86%|████████▌ | 319146/371472 [3:13:15<4:01:24,  3.61it/s]
 86%|████████▌ | 319147/371472 [3:13:16<4:03:52,  3.58it/s]
 86%|████████▌ | 319148/371472 [3:13:16<4:12:32,  3.45it/s]
 86%|████████▌ | 319149/371472 [3:13:16<4:14:39,  3.42it/s]
 86%|████████▌ | 319150/371472 [3:13:17<4:08:11,  3.51it/s]
 86%|████████▌ | 319151/371472 [3:13:17<4:25:19,  3.29it/s]
 86%|████████▌ | 319152/371472 [3:13:17<4:10:59,  3.47it/s]
 86%|████████▌ | 319153/371472 [3:13:18<4:10:17,  3.48it/s]
 86%|████████▌ | 319154/371472 [3:13:18<4:04:21,  3.57it/s]
 86%|████████▌ | 319155/371472 [3:13:18<4:09:48,  3.49it/s]
 86%|████████▌ | 319156/371472 [3:13:18<4:13:51,  3.43it/s]
 86%|████████▌ | 319157/371472 [3:13:19<4:07:57,  3.52it/s]
 86%|████████▌ | 319158/371472 [3:13:19<4:03:04,  3.59it/s]
 86%|████████▌ | 319159/371472 [3:13:19<3:58:26,  3.66it/s]
 86%|████████▌ | 319160/371472 [3:13:19<3:51:47,  3.76it/s]
                                                           
{'loss': 2.6485, 'learning_rate': 2.2680945506259561e-07, 'epoch': 13.75}

 86%|████████▌ | 319160/371472 [3:13:19<3:51:47,  3.76it/s]
 86%|████████▌ | 319161/371472 [3:13:20<3:55:11,  3.71it/s]
 86%|████████▌ | 319162/371472 [3:13:20<3:55:11,  3.71it/s]
 86%|████████▌ | 319163/371472 [3:13:20<3:52:43,  3.75it/s]
 86%|████████▌ | 319164/371472 [3:13:20<3:47:44,  3.83it/s]
 86%|████████▌ | 319165/371472 [3:13:21<3:47:22,  3.83it/s]
 86%|████████▌ | 319166/371472 [3:13:21<3:53:42,  3.73it/s]
 86%|████████▌ | 319167/371472 [3:13:21<3:51:37,  3.76it/s]
 86%|████████▌ | 319168/371472 [3:13:22<3:44:36,  3.88it/s]
 86%|████████▌ | 319169/371472 [3:13:22<3:37:45,  4.00it/s]
 86%|████████▌ | 319170/371472 [3:13:22<3:31:32,  4.12it/s]
 86%|████████▌ | 319171/371472 [3:13:22<3:51:42,  3.76it/s]
 86%|████████▌ | 319172/371472 [3:13:23<3:49:41,  3.79it/s]
 86%|████████▌ | 319173/371472 [3:13:23<4:04:45,  3.56it/s]
 86%|████████▌ | 319174/371472 [3:13:23<4:12:07,  3.46it/s]
 86%|████████▌ | 319175/371472 [3:13:24<4:24:58,  3.29it/s]
 86%|████████▌ | 319176/371472 [3:13:24<4:07:15,  3.52it/s]
 86%|████████▌ | 319177/371472 [3:13:24<4:22:59,  3.31it/s]
 86%|████████▌ | 319178/371472 [3:13:24<4:23:12,  3.31it/s]
 86%|████████▌ | 319179/371472 [3:13:25<4:27:04,  3.26it/s]
 86%|████████▌ | 319180/371472 [3:13:25<4:20:38,  3.34it/s]
                                                           
{'loss': 2.6885, 'learning_rate': 2.2676097308711666e-07, 'epoch': 13.75}

 86%|████████▌ | 319180/371472 [3:13:25<4:20:38,  3.34it/s]
 86%|████████▌ | 319181/371472 [3:13:25<4:34:28,  3.18it/s]
 86%|████████▌ | 319182/371472 [3:13:26<4:22:22,  3.32it/s]
 86%|████████▌ | 319183/371472 [3:13:26<4:09:18,  3.50it/s]
 86%|████████▌ | 319184/371472 [3:13:26<4:17:11,  3.39it/s]
 86%|████████▌ | 319185/371472 [3:13:27<4:35:09,  3.17it/s]
 86%|████████▌ | 319186/371472 [3:13:27<4:32:53,  3.19it/s]
 86%|████████▌ | 319187/371472 [3:13:27<4:17:12,  3.39it/s]
 86%|████████▌ | 319188/371472 [3:13:27<4:18:12,  3.37it/s]
 86%|████████▌ | 319189/371472 [3:13:28<4:14:16,  3.43it/s]
 86%|████████▌ | 319190/371472 [3:13:28<4:02:55,  3.59it/s]
 86%|████████▌ | 319191/371472 [3:13:28<3:57:23,  3.67it/s]
 86%|████████▌ | 319192/371472 [3:13:29<4:08:48,  3.50it/s]
 86%|████████▌ | 319193/371472 [3:13:29<3:55:18,  3.70it/s]
 86%|████████▌ | 319194/371472 [3:13:29<3:59:53,  3.63it/s]
 86%|████████▌ | 319195/371472 [3:13:29<3:58:52,  3.65it/s]
 86%|████████▌ | 319196/371472 [3:13:30<4:01:12,  3.61it/s]
 86%|████████▌ | 319197/371472 [3:13:30<3:58:37,  3.65it/s]
 86%|████████▌ | 319198/371472 [3:13:30<3:57:32,  3.67it/s]
 86%|████████▌ | 319199/371472 [3:13:30<3:53:56,  3.72it/s]
 86%|████████▌ | 319200/371472 [3:13:31<4:03:52,  3.57it/s]
                                                           
{'loss': 2.6691, 'learning_rate': 2.2671249111163784e-07, 'epoch': 13.75}

 86%|████████▌ | 319200/371472 [3:13:31<4:03:52,  3.57it/s]
 86%|████████▌ | 319201/371472 [3:13:31<3:57:07,  3.67it/s]
 86%|████████▌ | 319202/371472 [3:13:31<3:52:05,  3.75it/s]
 86%|████████▌ | 319203/371472 [3:13:32<3:59:15,  3.64it/s]
 86%|████████▌ | 319204/371472 [3:13:32<3:49:43,  3.79it/s]
 86%|████████▌ | 319205/371472 [3:13:32<3:56:22,  3.69it/s]
 86%|████████▌ | 319206/371472 [3:13:32<3:51:48,  3.76it/s]
 86%|████████▌ | 319207/371472 [3:13:33<3:46:57,  3.84it/s]
 86%|████████▌ | 319208/371472 [3:13:33<4:16:27,  3.40it/s]
 86%|████████▌ | 319209/371472 [3:13:33<4:39:24,  3.12it/s]
 86%|████████▌ | 319210/371472 [3:13:34<4:21:02,  3.34it/s]
 86%|████████▌ | 319211/371472 [3:13:34<4:09:03,  3.50it/s]
 86%|████████▌ | 319212/371472 [3:13:34<4:26:24,  3.27it/s]
 86%|████████▌ | 319213/371472 [3:13:34<4:26:53,  3.26it/s]
 86%|████████▌ | 319214/371472 [3:13:35<4:21:33,  3.33it/s]
 86%|████████▌ | 319215/371472 [3:13:35<4:06:09,  3.54it/s]
 86%|████████▌ | 319216/371472 [3:13:35<4:11:56,  3.46it/s]
 86%|████████▌ | 319217/371472 [3:13:36<4:12:21,  3.45it/s]
 86%|████████▌ | 319218/371472 [3:13:36<4:07:03,  3.53it/s]
 86%|████████▌ | 319219/371472 [3:13:36<3:55:21,  3.70it/s]
 86%|████████▌ | 319220/371472 [3:13:36<3:57:15,  3.67it/s]
                                                           
{'loss': 2.6242, 'learning_rate': 2.2666400913615888e-07, 'epoch': 13.75}

 86%|████████▌ | 319220/371472 [3:13:36<3:57:15,  3.67it/s]
 86%|████████▌ | 319221/371472 [3:13:37<3:59:53,  3.63it/s]
 86%|████████▌ | 319222/371472 [3:13:37<4:17:06,  3.39it/s]
 86%|████████▌ | 319223/371472 [3:13:37<4:16:42,  3.39it/s]
 86%|████████▌ | 319224/371472 [3:13:38<4:16:58,  3.39it/s]
 86%|████████▌ | 319225/371472 [3:13:38<4:11:48,  3.46it/s]
 86%|████████▌ | 319226/371472 [3:13:38<4:10:14,  3.48it/s]
 86%|████████▌ | 319227/371472 [3:13:38<4:05:54,  3.54it/s]
 86%|████████▌ | 319228/371472 [3:13:39<3:54:12,  3.72it/s]
 86%|████████▌ | 319229/371472 [3:13:39<3:52:41,  3.74it/s]
 86%|████████▌ | 319230/371472 [3:13:39<3:42:30,  3.91it/s]
 86%|████████▌ | 319231/371472 [3:13:39<3:39:29,  3.97it/s]
 86%|████████▌ | 319232/371472 [3:13:40<3:47:57,  3.82it/s]
 86%|████████▌ | 319233/371472 [3:13:40<3:47:59,  3.82it/s]
 86%|████████▌ | 319234/371472 [3:13:40<3:47:08,  3.83it/s]
 86%|████████▌ | 319235/371472 [3:13:40<3:44:02,  3.89it/s]
 86%|████████▌ | 319236/371472 [3:13:41<3:38:45,  3.98it/s]
 86%|████████▌ | 319237/371472 [3:13:41<3:43:02,  3.90it/s]
 86%|████████▌ | 319238/371472 [3:13:41<3:42:44,  3.91it/s]
 86%|████████▌ | 319239/371472 [3:13:41<3:49:25,  3.79it/s]
 86%|████████▌ | 319240/371472 [3:13:42<3:53:39,  3.73it/s]
                                                           
{'loss': 2.6539, 'learning_rate': 2.2661552716068003e-07, 'epoch': 13.75}

 86%|████████▌ | 319240/371472 [3:13:42<3:53:39,  3.73it/s]
 86%|████████▌ | 319241/371472 [3:13:42<3:53:01,  3.74it/s]
 86%|████████▌ | 319242/371472 [3:13:42<3:47:21,  3.83it/s]
 86%|████████▌ | 319243/371472 [3:13:43<3:41:11,  3.94it/s]
 86%|████████▌ | 319244/371472 [3:13:43<3:50:47,  3.77it/s]
 86%|████████▌ | 319245/371472 [3:13:43<3:50:23,  3.78it/s]
 86%|████████▌ | 319246/371472 [3:13:43<4:01:06,  3.61it/s]
 86%|████████▌ | 319247/371472 [3:13:44<4:04:06,  3.57it/s]
 86%|████████▌ | 319248/371472 [3:13:44<4:00:04,  3.63it/s]
 86%|████████▌ | 319249/371472 [3:13:44<3:59:36,  3.63it/s]
 86%|████████▌ | 319250/371472 [3:13:44<3:55:29,  3.70it/s]
 86%|████████▌ | 319251/371472 [3:13:45<3:52:58,  3.74it/s]
 86%|████████▌ | 319252/371472 [3:13:45<3:54:51,  3.71it/s]
 86%|████████▌ | 319253/371472 [3:13:45<3:56:21,  3.68it/s]
 86%|████████▌ | 319254/371472 [3:13:46<3:58:19,  3.65it/s]
 86%|████████▌ | 319255/371472 [3:13:46<3:47:36,  3.82it/s]
 86%|████████▌ | 319256/371472 [3:13:46<3:46:20,  3.84it/s]
 86%|████████▌ | 319257/371472 [3:13:46<4:02:55,  3.58it/s]
 86%|████████▌ | 319258/371472 [3:13:47<3:53:01,  3.73it/s]
 86%|████████▌ | 319259/371472 [3:13:47<4:00:12,  3.62it/s]
 86%|████████▌ | 319260/371472 [3:13:47<4:15:19,  3.41it/s]
                                                           
{'loss': 2.7113, 'learning_rate': 2.265670451852011e-07, 'epoch': 13.75}

 86%|████████▌ | 319260/371472 [3:13:47<4:15:19,  3.41it/s]
 86%|████████▌ | 319261/371472 [3:13:48<4:15:33,  3.41it/s]
 86%|████████▌ | 319262/371472 [3:13:48<4:03:54,  3.57it/s]
 86%|████████▌ | 319263/371472 [3:13:48<4:08:50,  3.50it/s]
 86%|████████▌ | 319264/371472 [3:13:48<4:19:34,  3.35it/s]
 86%|████████▌ | 319265/371472 [3:13:49<4:21:10,  3.33it/s]
 86%|████████▌ | 319266/371472 [3:13:49<4:06:28,  3.53it/s]
 86%|████████▌ | 319267/371472 [3:13:49<4:06:24,  3.53it/s]
 86%|████████▌ | 319268/371472 [3:13:50<4:02:23,  3.59it/s]
 86%|████████▌ | 319269/371472 [3:13:50<3:57:32,  3.66it/s]
 86%|████████▌ | 319270/371472 [3:13:50<3:51:28,  3.76it/s]
 86%|████████▌ | 319271/371472 [3:13:50<3:49:18,  3.79it/s]
 86%|████████▌ | 319272/371472 [3:13:51<4:21:07,  3.33it/s]
 86%|████████▌ | 319273/371472 [3:13:51<4:17:43,  3.38it/s]
 86%|████████▌ | 319274/371472 [3:13:51<4:07:25,  3.52it/s]
 86%|████████▌ | 319275/371472 [3:13:51<4:07:06,  3.52it/s]
 86%|████████▌ | 319276/371472 [3:13:52<4:05:55,  3.54it/s]
 86%|████████▌ | 319277/371472 [3:13:52<4:02:38,  3.59it/s]
 86%|████████▌ | 319278/371472 [3:13:52<4:11:09,  3.46it/s]
 86%|████████▌ | 319279/371472 [3:13:53<4:03:55,  3.57it/s]
 86%|████████▌ | 319280/371472 [3:13:53<4:00:07,  3.62it/s]
                                                           
{'loss': 2.6786, 'learning_rate': 2.2651856320972226e-07, 'epoch': 13.75}

 86%|████████▌ | 319280/371472 [3:13:53<4:00:07,  3.62it/s]
 86%|████████▌ | 319281/371472 [3:13:53<3:56:21,  3.68it/s]
 86%|████████▌ | 319282/371472 [3:13:53<4:12:53,  3.44it/s]
 86%|████████▌ | 319283/371472 [3:13:54<4:11:20,  3.46it/s]
 86%|████████▌ | 319284/371472 [3:13:54<4:13:22,  3.43it/s]
 86%|████████▌ | 319285/371472 [3:13:54<4:07:01,  3.52it/s]
 86%|████████▌ | 319286/371472 [3:13:55<4:17:00,  3.38it/s]
 86%|████████▌ | 319287/371472 [3:13:55<4:08:17,  3.50it/s]
 86%|████████▌ | 319288/371472 [3:13:55<4:04:21,  3.56it/s]
 86%|████████▌ | 319289/371472 [3:13:55<3:57:40,  3.66it/s]
 86%|████████▌ | 319290/371472 [3:13:56<4:12:54,  3.44it/s]
 86%|████████▌ | 319291/371472 [3:13:56<4:08:08,  3.50it/s]
 86%|████████▌ | 319292/371472 [3:13:56<3:58:28,  3.65it/s]
 86%|████████▌ | 319293/371472 [3:13:57<4:10:40,  3.47it/s]
 86%|████████▌ | 319294/371472 [3:13:57<4:02:09,  3.59it/s]
 86%|████████▌ | 319295/371472 [3:13:57<4:01:50,  3.60it/s]
 86%|████████▌ | 319296/371472 [3:13:57<4:09:38,  3.48it/s]
 86%|████████▌ | 319297/371472 [3:13:58<4:09:05,  3.49it/s]
 86%|████████▌ | 319298/371472 [3:13:58<4:04:25,  3.56it/s]
 86%|████████▌ | 319299/371472 [3:13:58<4:07:22,  3.51it/s]
 86%|████████▌ | 319300/371472 [3:13:59<3:58:56,  3.64it/s]
                                                           
{'loss': 2.465, 'learning_rate': 2.2647008123424333e-07, 'epoch': 13.75}

 86%|████████▌ | 319300/371472 [3:13:59<3:58:56,  3.64it/s]
 86%|████████▌ | 319301/371472 [3:13:59<4:04:07,  3.56it/s]
 86%|████████▌ | 319302/371472 [3:13:59<4:31:56,  3.20it/s]
 86%|████████▌ | 319303/371472 [3:14:00<4:28:37,  3.24it/s]
 86%|████████▌ | 319304/371472 [3:14:00<4:20:47,  3.33it/s]
 86%|████████▌ | 319305/371472 [3:14:00<4:08:49,  3.49it/s]
 86%|████████▌ | 319306/371472 [3:14:00<4:09:38,  3.48it/s]
 86%|████████▌ | 319307/371472 [3:14:01<4:01:21,  3.60it/s]
 86%|████████▌ | 319308/371472 [3:14:01<4:01:01,  3.61it/s]
 86%|████████▌ | 319309/371472 [3:14:01<4:00:06,  3.62it/s]
 86%|████████▌ | 319310/371472 [3:14:02<4:22:39,  3.31it/s]
 86%|████████▌ | 319311/371472 [3:14:02<4:15:14,  3.41it/s]
 86%|████████▌ | 319312/371472 [3:14:02<4:29:19,  3.23it/s]
 86%|████████▌ | 319313/371472 [3:14:02<4:11:10,  3.46it/s]
 86%|████████▌ | 319314/371472 [3:14:03<4:23:36,  3.30it/s]
 86%|████████▌ | 319315/371472 [3:14:03<4:07:50,  3.51it/s]
 86%|████████▌ | 319316/371472 [3:14:03<3:59:26,  3.63it/s]
 86%|████████▌ | 319317/371472 [3:14:04<4:03:35,  3.57it/s]
 86%|████████▌ | 319318/371472 [3:14:04<3:52:58,  3.73it/s]
 86%|████████▌ | 319319/371472 [3:14:04<3:53:01,  3.73it/s]
 86%|████████▌ | 319320/371472 [3:14:04<4:01:56,  3.59it/s]
                                                           
{'loss': 2.626, 'learning_rate': 2.2642159925876448e-07, 'epoch': 13.75}

 86%|████████▌ | 319320/371472 [3:14:04<4:01:56,  3.59it/s]
 86%|████████▌ | 319321/371472 [3:14:05<3:57:25,  3.66it/s]
 86%|████████▌ | 319322/371472 [3:14:05<3:53:12,  3.73it/s]
 86%|████████▌ | 319323/371472 [3:14:05<3:48:54,  3.80it/s]
 86%|████████▌ | 319324/371472 [3:14:05<4:04:51,  3.55it/s]
 86%|████████▌ | 319325/371472 [3:14:06<4:15:06,  3.41it/s]
 86%|████████▌ | 319326/371472 [3:14:06<4:13:00,  3.44it/s]
 86%|████████▌ | 319327/371472 [3:14:06<4:08:43,  3.49it/s]
 86%|████████▌ | 319328/371472 [3:14:07<4:04:53,  3.55it/s]
 86%|████████▌ | 319329/371472 [3:14:07<4:05:14,  3.54it/s]
 86%|████████▌ | 319330/371472 [3:14:07<3:57:51,  3.65it/s]
 86%|████████▌ | 319331/371472 [3:14:07<3:56:32,  3.67it/s]
 86%|████████▌ | 319332/371472 [3:14:08<3:57:19,  3.66it/s]
 86%|████████▌ | 319333/371472 [3:14:08<3:57:42,  3.66it/s]
 86%|████████▌ | 319334/371472 [3:14:08<3:54:42,  3.70it/s]
 86%|████████▌ | 319335/371472 [3:14:08<3:53:17,  3.72it/s]
 86%|████████▌ | 319336/371472 [3:14:09<3:54:45,  3.70it/s]
 86%|████████▌ | 319337/371472 [3:14:09<3:59:26,  3.63it/s]
 86%|████████▌ | 319338/371472 [3:14:09<3:53:03,  3.73it/s]
 86%|████████▌ | 319339/371472 [3:14:10<3:59:27,  3.63it/s]
 86%|████████▌ | 319340/371472 [3:14:10<3:53:26,  3.72it/s]
                                                           
{'loss': 2.6505, 'learning_rate': 2.2637311728328555e-07, 'epoch': 13.75}

 86%|████████▌ | 319340/371472 [3:14:10<3:53:26,  3.72it/s]
 86%|████████▌ | 319341/371472 [3:14:10<3:51:40,  3.75it/s]
 86%|████████▌ | 319342/371472 [3:14:10<3:56:49,  3.67it/s]
 86%|████████▌ | 319343/371472 [3:14:11<4:01:24,  3.60it/s]
 86%|████████▌ | 319344/371472 [3:14:11<3:59:43,  3.62it/s]
 86%|████████▌ | 319345/371472 [3:14:11<3:52:45,  3.73it/s]
 86%|████████▌ | 319346/371472 [3:14:11<3:47:08,  3.82it/s]
 86%|████████▌ | 319347/371472 [3:14:12<4:00:01,  3.62it/s]
 86%|████████▌ | 319348/371472 [3:14:12<4:12:28,  3.44it/s]
 86%|████████▌ | 319349/371472 [3:14:13<5:01:19,  2.88it/s]
 86%|████████▌ | 319350/371472 [3:14:13<4:40:23,  3.10it/s]
 86%|████████▌ | 319351/371472 [3:14:13<4:34:39,  3.16it/s]
 86%|████████▌ | 319352/371472 [3:14:13<4:48:48,  3.01it/s]
 86%|████████▌ | 319353/371472 [3:14:14<4:26:56,  3.25it/s]
 86%|████████▌ | 319354/371472 [3:14:14<4:11:01,  3.46it/s]
 86%|████████▌ | 319355/371472 [3:14:14<4:22:35,  3.31it/s]
 86%|████████▌ | 319356/371472 [3:14:15<4:14:41,  3.41it/s]
 86%|████████▌ | 319357/371472 [3:14:15<4:08:56,  3.49it/s]
 86%|████████▌ | 319358/371472 [3:14:15<4:07:28,  3.51it/s]
 86%|████████▌ | 319359/371472 [3:14:15<4:08:11,  3.50it/s]
 86%|████████▌ | 319360/371472 [3:14:16<4:04:29,  3.55it/s]
                                                           
{'loss': 2.6773, 'learning_rate': 2.263246353078067e-07, 'epoch': 13.76}

 86%|████████▌ | 319360/371472 [3:14:16<4:04:29,  3.55it/s]
 86%|████████▌ | 319361/371472 [3:14:16<4:01:34,  3.60it/s]
 86%|████████▌ | 319362/371472 [3:14:16<4:02:37,  3.58it/s]
 86%|████████▌ | 319363/371472 [3:14:17<4:01:58,  3.59it/s]
 86%|████████▌ | 319364/371472 [3:14:17<4:11:33,  3.45it/s]
 86%|████████▌ | 319365/371472 [3:14:17<4:17:04,  3.38it/s]
 86%|████████▌ | 319366/371472 [3:14:17<4:07:17,  3.51it/s]
 86%|████████▌ | 319367/371472 [3:14:18<4:00:38,  3.61it/s]
 86%|████████▌ | 319368/371472 [3:14:18<3:54:15,  3.71it/s]
 86%|████████▌ | 319369/371472 [3:14:18<3:59:23,  3.63it/s]
 86%|████████▌ | 319370/371472 [3:14:18<4:01:43,  3.59it/s]
 86%|████████▌ | 319371/371472 [3:14:19<4:06:49,  3.52it/s]
 86%|████████▌ | 319372/371472 [3:14:19<4:06:38,  3.52it/s]
 86%|████████▌ | 319373/371472 [3:14:19<4:10:05,  3.47it/s]
 86%|████████▌ | 319374/371472 [3:14:20<4:16:31,  3.38it/s]
 86%|████████▌ | 319375/371472 [3:14:20<4:12:09,  3.44it/s]
 86%|████████▌ | 319376/371472 [3:14:20<4:40:45,  3.09it/s]
 86%|████████▌ | 319377/371472 [3:14:21<4:22:22,  3.31it/s]
 86%|████████▌ | 319378/371472 [3:14:21<4:17:37,  3.37it/s]
 86%|████████▌ | 319379/371472 [3:14:21<4:05:01,  3.54it/s]
 86%|████████▌ | 319380/371472 [3:14:21<4:07:53,  3.50it/s]
                                                           
{'loss': 2.7319, 'learning_rate': 2.2627615333232775e-07, 'epoch': 13.76}

 86%|████████▌ | 319380/371472 [3:14:21<4:07:53,  3.50it/s]
 86%|████████▌ | 319381/371472 [3:14:22<4:06:14,  3.53it/s]
 86%|████████▌ | 319382/371472 [3:14:22<4:17:01,  3.38it/s]
 86%|████████▌ | 319383/371472 [3:14:22<4:09:02,  3.49it/s]
 86%|████████▌ | 319384/371472 [3:14:23<4:16:26,  3.39it/s]
 86%|████████▌ | 319385/371472 [3:14:23<4:32:29,  3.19it/s]
 86%|████████▌ | 319386/371472 [3:14:23<4:19:48,  3.34it/s]
 86%|████████▌ | 319387/371472 [3:14:24<4:16:15,  3.39it/s]
 86%|████████▌ | 319388/371472 [3:14:24<4:29:05,  3.23it/s]
 86%|████████▌ | 319389/371472 [3:14:24<4:10:06,  3.47it/s]
 86%|████████▌ | 319390/371472 [3:14:24<4:01:32,  3.59it/s]
 86%|████████▌ | 319391/371472 [3:14:25<4:08:43,  3.49it/s]
 86%|████████▌ | 319392/371472 [3:14:25<4:01:55,  3.59it/s]
 86%|████████▌ | 319393/371472 [3:14:25<3:54:15,  3.71it/s]
 86%|████████▌ | 319394/371472 [3:14:25<3:47:40,  3.81it/s]
 86%|████████▌ | 319395/371472 [3:14:26<3:49:50,  3.78it/s]
 86%|████████▌ | 319396/371472 [3:14:26<3:52:45,  3.73it/s]
 86%|████████▌ | 319397/371472 [3:14:26<3:56:52,  3.66it/s]
 86%|████████▌ | 319398/371472 [3:14:26<3:51:42,  3.75it/s]
 86%|████████▌ | 319399/371472 [3:14:27<3:44:16,  3.87it/s]
 86%|████████▌ | 319400/371472 [3:14:27<3:46:39,  3.83it/s]
                                                           
{'loss': 2.6238, 'learning_rate': 2.262276713568489e-07, 'epoch': 13.76}

 86%|████████▌ | 319400/371472 [3:14:27<3:46:39,  3.83it/s]
 86%|████████▌ | 319401/371472 [3:14:27<3:40:30,  3.94it/s]
 86%|████████▌ | 319402/371472 [3:14:27<3:38:20,  3.97it/s]
 86%|████████▌ | 319403/371472 [3:14:28<3:56:33,  3.67it/s]
 86%|████████▌ | 319404/371472 [3:14:28<4:00:01,  3.62it/s]
 86%|████████▌ | 319405/371472 [3:14:28<4:01:07,  3.60it/s]
 86%|████████▌ | 319406/371472 [3:14:29<4:15:54,  3.39it/s]
 86%|████████▌ | 319407/371472 [3:14:29<4:07:45,  3.50it/s]
 86%|████████▌ | 319408/371472 [3:14:29<3:59:40,  3.62it/s]
 86%|████████▌ | 319409/371472 [3:14:29<3:47:27,  3.81it/s]
 86%|████████▌ | 319410/371472 [3:14:30<3:38:57,  3.96it/s]
 86%|████████▌ | 319411/371472 [3:14:30<3:51:00,  3.76it/s]
 86%|████████▌ | 319412/371472 [3:14:30<3:52:19,  3.73it/s]
 86%|████████▌ | 319413/371472 [3:14:31<3:48:31,  3.80it/s]
 86%|████████▌ | 319414/371472 [3:14:31<3:58:49,  3.63it/s]
 86%|████████▌ | 319415/371472 [3:14:31<4:02:17,  3.58it/s]
 86%|████████▌ | 319416/371472 [3:14:31<3:59:57,  3.62it/s]
 86%|████████▌ | 319417/371472 [3:14:32<3:54:37,  3.70it/s]
 86%|████████▌ | 319418/371472 [3:14:32<3:54:18,  3.70it/s]
 86%|████████▌ | 319419/371472 [3:14:32<4:15:24,  3.40it/s]
 86%|████████▌ | 319420/371472 [3:14:32<4:02:54,  3.57it/s]
                                                           
{'loss': 2.688, 'learning_rate': 2.2617918938136997e-07, 'epoch': 13.76}

 86%|████████▌ | 319420/371472 [3:14:32<4:02:54,  3.57it/s]
 86%|████████▌ | 319421/371472 [3:14:33<4:02:41,  3.57it/s]
 86%|████████▌ | 319422/371472 [3:14:33<3:51:13,  3.75it/s]
 86%|████████▌ | 319423/371472 [3:14:33<4:03:30,  3.56it/s]
 86%|████████▌ | 319424/371472 [3:14:34<3:56:18,  3.67it/s]
 86%|████████▌ | 319425/371472 [3:14:34<3:55:26,  3.68it/s]
 86%|████████▌ | 319426/371472 [3:14:34<3:51:47,  3.74it/s]
 86%|████████▌ | 319427/371472 [3:14:34<3:52:38,  3.73it/s]
 86%|████████▌ | 319428/371472 [3:14:35<3:51:50,  3.74it/s]
 86%|████████▌ | 319429/371472 [3:14:35<4:02:05,  3.58it/s]
 86%|████████▌ | 319430/371472 [3:14:35<3:58:08,  3.64it/s]
 86%|████████▌ | 319431/371472 [3:14:36<4:07:34,  3.50it/s]
 86%|████████▌ | 319432/371472 [3:14:36<3:58:04,  3.64it/s]
 86%|████████▌ | 319433/371472 [3:14:36<4:06:01,  3.53it/s]
 86%|████████▌ | 319434/371472 [3:14:36<4:04:40,  3.54it/s]
 86%|████████▌ | 319435/371472 [3:14:37<4:03:05,  3.57it/s]
 86%|████████▌ | 319436/371472 [3:14:37<3:53:52,  3.71it/s]
 86%|████████▌ | 319437/371472 [3:14:37<4:00:19,  3.61it/s]
 86%|████████▌ | 319438/371472 [3:14:38<4:21:02,  3.32it/s]
 86%|████████▌ | 319439/371472 [3:14:38<4:08:39,  3.49it/s]
 86%|████████▌ | 319440/371472 [3:14:38<3:57:51,  3.65it/s]
                                                           
{'loss': 2.5783, 'learning_rate': 2.2613070740589112e-07, 'epoch': 13.76}

 86%|████████▌ | 319440/371472 [3:14:38<3:57:51,  3.65it/s]
 86%|████████▌ | 319441/371472 [3:14:38<3:47:29,  3.81it/s]
 86%|████████▌ | 319442/371472 [3:14:39<3:45:29,  3.85it/s]
 86%|████████▌ | 319443/371472 [3:14:39<3:51:34,  3.74it/s]
 86%|████████▌ | 319444/371472 [3:14:39<3:42:28,  3.90it/s]
 86%|████████▌ | 319445/371472 [3:14:39<3:37:45,  3.98it/s]
 86%|████████▌ | 319446/371472 [3:14:40<3:36:52,  4.00it/s]
 86%|████████▌ | 319447/371472 [3:14:40<3:40:57,  3.92it/s]
 86%|████████▌ | 319448/371472 [3:14:40<3:41:48,  3.91it/s]
 86%|████████▌ | 319449/371472 [3:14:40<3:59:48,  3.62it/s]
 86%|████████▌ | 319450/371472 [3:14:41<4:04:25,  3.55it/s]
 86%|████████▌ | 319451/371472 [3:14:41<4:01:44,  3.59it/s]
 86%|████████▌ | 319452/371472 [3:14:41<3:51:52,  3.74it/s]
 86%|████████▌ | 319453/371472 [3:14:41<3:55:07,  3.69it/s]
 86%|████████▌ | 319454/371472 [3:14:42<4:11:03,  3.45it/s]
 86%|████████▌ | 319455/371472 [3:14:42<4:09:53,  3.47it/s]
 86%|████████▌ | 319456/371472 [3:14:42<4:07:26,  3.50it/s]
 86%|████████▌ | 319457/371472 [3:14:43<4:03:47,  3.56it/s]
 86%|████████▌ | 319458/371472 [3:14:43<3:52:55,  3.72it/s]
 86%|████████▌ | 319459/371472 [3:14:43<4:14:32,  3.41it/s]
 86%|████████▌ | 319460/371472 [3:14:44<4:21:11,  3.32it/s]
                                                           
{'loss': 2.7362, 'learning_rate': 2.2608222543041216e-07, 'epoch': 13.76}

 86%|████████▌ | 319460/371472 [3:14:44<4:21:11,  3.32it/s]
 86%|████████▌ | 319461/371472 [3:14:44<4:06:21,  3.52it/s]
 86%|████████▌ | 319462/371472 [3:14:44<3:55:29,  3.68it/s]
 86%|████████▌ | 319463/371472 [3:14:44<3:56:58,  3.66it/s]
 86%|████████▌ | 319464/371472 [3:14:45<4:11:24,  3.45it/s]
 86%|████████▌ | 319465/371472 [3:14:45<4:05:56,  3.52it/s]
 86%|████████▌ | 319466/371472 [3:14:45<3:56:17,  3.67it/s]
 86%|████████▌ | 319467/371472 [3:14:45<3:51:17,  3.75it/s]
 86%|████████▌ | 319468/371472 [3:14:46<3:54:35,  3.69it/s]
 86%|████████▌ | 319469/371472 [3:14:46<4:13:24,  3.42it/s]
 86%|████████▌ | 319470/371472 [3:14:46<4:47:57,  3.01it/s]
 86%|████████▌ | 319471/371472 [3:14:47<4:43:55,  3.05it/s]
 86%|████████▌ | 319472/371472 [3:14:47<4:38:33,  3.11it/s]
 86%|████████▌ | 319473/371472 [3:14:47<4:27:14,  3.24it/s]
 86%|████████▌ | 319474/371472 [3:14:48<4:23:15,  3.29it/s]
 86%|████████▌ | 319475/371472 [3:14:48<4:26:47,  3.25it/s]
 86%|████████▌ | 319476/371472 [3:14:48<4:26:47,  3.25it/s]
 86%|████████▌ | 319477/371472 [3:14:49<4:48:02,  3.01it/s]
 86%|████████▌ | 319478/371472 [3:14:49<5:12:17,  2.77it/s]
 86%|████████▌ | 319479/371472 [3:14:49<5:10:36,  2.79it/s]
 86%|████████▌ | 319480/371472 [3:14:50<4:46:17,  3.03it/s]
                                                           
{'loss': 2.5784, 'learning_rate': 2.2603374345493334e-07, 'epoch': 13.76}

 86%|████████▌ | 319480/371472 [3:14:50<4:46:17,  3.03it/s]
 86%|████████▌ | 319481/371472 [3:14:50<4:29:02,  3.22it/s]
 86%|████████▌ | 319482/371472 [3:14:50<4:46:21,  3.03it/s]
 86%|████████▌ | 319483/371472 [3:14:51<4:37:09,  3.13it/s]
 86%|████████▌ | 319484/371472 [3:14:51<4:19:43,  3.34it/s]
 86%|████████▌ | 319485/371472 [3:14:51<4:19:10,  3.34it/s]
 86%|████████▌ | 319486/371472 [3:14:51<4:13:19,  3.42it/s]
 86%|████████▌ | 319487/371472 [3:14:52<4:03:17,  3.56it/s]
 86%|████████▌ | 319488/371472 [3:14:52<4:19:29,  3.34it/s]
 86%|████████▌ | 319489/371472 [3:14:52<4:10:35,  3.46it/s]
 86%|████████▌ | 319490/371472 [3:14:53<4:25:16,  3.27it/s]
 86%|████████▌ | 319491/371472 [3:14:53<4:10:26,  3.46it/s]
 86%|████████▌ | 319492/371472 [3:14:53<4:15:37,  3.39it/s]
 86%|████████▌ | 319493/371472 [3:14:53<4:08:04,  3.49it/s]
 86%|████████▌ | 319494/371472 [3:14:54<4:03:43,  3.55it/s]
 86%|████████▌ | 319495/371472 [3:14:54<4:03:50,  3.55it/s]
 86%|████████▌ | 319496/371472 [3:14:54<4:14:21,  3.41it/s]
 86%|████████▌ | 319497/371472 [3:14:55<4:04:16,  3.55it/s]
 86%|████████▌ | 319498/371472 [3:14:55<4:19:54,  3.33it/s]
 86%|████████▌ | 319499/371472 [3:14:55<4:23:34,  3.29it/s]
 86%|████████▌ | 319500/371472 [3:14:56<4:15:38,  3.39it/s]
                                                           
{'loss': 2.6707, 'learning_rate': 2.2598526147945439e-07, 'epoch': 13.76}

 86%|████████▌ | 319500/371472 [3:14:56<4:15:38,  3.39it/s]
 86%|████████▌ | 319501/371472 [3:14:56<4:09:02,  3.48it/s]
 86%|████████▌ | 319502/371472 [3:14:56<4:27:10,  3.24it/s]
 86%|████████▌ | 319503/371472 [3:14:56<4:13:41,  3.41it/s]
 86%|████████▌ | 319504/371472 [3:14:57<4:25:18,  3.26it/s]
 86%|████████▌ | 319505/371472 [3:14:57<4:14:34,  3.40it/s]
 86%|████████▌ | 319506/371472 [3:14:57<4:18:31,  3.35it/s]
 86%|████████▌ | 319507/371472 [3:14:58<4:24:28,  3.27it/s]
 86%|████████▌ | 319508/371472 [3:14:58<4:20:02,  3.33it/s]
 86%|████████▌ | 319509/371472 [3:14:58<4:13:36,  3.41it/s]
 86%|████████▌ | 319510/371472 [3:14:59<4:15:25,  3.39it/s]
 86%|████████▌ | 319511/371472 [3:14:59<4:04:26,  3.54it/s]
 86%|████████▌ | 319512/371472 [3:14:59<3:53:38,  3.71it/s]
 86%|████████▌ | 319513/371472 [3:14:59<4:06:36,  3.51it/s]
 86%|████████▌ | 319514/371472 [3:15:00<4:01:49,  3.58it/s]
 86%|████████▌ | 319515/371472 [3:15:00<4:04:33,  3.54it/s]
 86%|████████▌ | 319516/371472 [3:15:00<4:08:54,  3.48it/s]
 86%|████████▌ | 319517/371472 [3:15:01<4:15:01,  3.40it/s]
 86%|████████▌ | 319518/371472 [3:15:01<4:27:07,  3.24it/s]
 86%|████████▌ | 319519/371472 [3:15:01<5:07:02,  2.82it/s]
 86%|████████▌ | 319520/371472 [3:15:02<4:46:26,  3.02it/s]
                                                           
{'loss': 2.5952, 'learning_rate': 2.2593677950397554e-07, 'epoch': 13.76}

 86%|████████▌ | 319520/371472 [3:15:02<4:46:26,  3.02it/s]
 86%|████████▌ | 319521/371472 [3:15:02<4:34:08,  3.16it/s]
 86%|████████▌ | 319522/371472 [3:15:02<4:28:32,  3.22it/s]
 86%|████████▌ | 319523/371472 [3:15:02<4:17:28,  3.36it/s]
 86%|████████▌ | 319524/371472 [3:15:03<4:09:58,  3.46it/s]
 86%|████████▌ | 319525/371472 [3:15:03<4:06:27,  3.51it/s]
 86%|████████▌ | 319526/371472 [3:15:03<3:55:54,  3.67it/s]
 86%|████████▌ | 319527/371472 [3:15:03<3:52:43,  3.72it/s]
 86%|████████▌ | 319528/371472 [3:15:04<3:59:02,  3.62it/s]
 86%|████████▌ | 319529/371472 [3:15:04<4:01:24,  3.59it/s]
 86%|████████▌ | 319530/371472 [3:15:04<4:01:31,  3.58it/s]
 86%|████████▌ | 319531/371472 [3:15:05<3:54:48,  3.69it/s]
 86%|████████▌ | 319532/371472 [3:15:05<3:57:07,  3.65it/s]
 86%|████████▌ | 319533/371472 [3:15:05<3:57:14,  3.65it/s]
 86%|████████▌ | 319534/371472 [3:15:05<3:55:26,  3.68it/s]
 86%|████████▌ | 319535/371472 [3:15:06<4:04:40,  3.54it/s]
 86%|████████▌ | 319536/371472 [3:15:06<4:11:42,  3.44it/s]
 86%|████████▌ | 319537/371472 [3:15:06<4:05:43,  3.52it/s]
 86%|████████▌ | 319538/371472 [3:15:07<3:58:56,  3.62it/s]
 86%|████████▌ | 319539/371472 [3:15:07<4:24:21,  3.27it/s]
 86%|████████▌ | 319540/371472 [3:15:07<4:24:59,  3.27it/s]
                                                           
{'loss': 2.6801, 'learning_rate': 2.258882975284966e-07, 'epoch': 13.76}

 86%|████████▌ | 319540/371472 [3:15:07<4:24:59,  3.27it/s]
 86%|████████▌ | 319541/371472 [3:15:08<4:16:10,  3.38it/s]
 86%|████████▌ | 319542/371472 [3:15:08<4:09:10,  3.47it/s]
 86%|████████▌ | 319543/371472 [3:15:08<4:03:08,  3.56it/s]
 86%|████████▌ | 319544/371472 [3:15:09<5:11:19,  2.78it/s]
 86%|████████▌ | 319545/371472 [3:15:09<4:52:15,  2.96it/s]
 86%|████████▌ | 319546/371472 [3:15:09<4:36:00,  3.14it/s]
 86%|████████▌ | 319547/371472 [3:15:09<4:32:30,  3.18it/s]
 86%|████████▌ | 319548/371472 [3:15:10<4:22:27,  3.30it/s]
 86%|████████▌ | 319549/371472 [3:15:10<4:04:57,  3.53it/s]
 86%|████████▌ | 319550/371472 [3:15:10<3:56:38,  3.66it/s]
 86%|████████▌ | 319551/371472 [3:15:11<4:13:14,  3.42it/s]
 86%|████████▌ | 319552/371472 [3:15:11<4:07:02,  3.50it/s]
 86%|████████▌ | 319553/371472 [3:15:11<4:08:22,  3.48it/s]
 86%|████████▌ | 319554/371472 [3:15:11<4:01:44,  3.58it/s]
 86%|████████▌ | 319555/371472 [3:15:12<4:15:38,  3.38it/s]
 86%|████████▌ | 319556/371472 [3:15:12<4:06:20,  3.51it/s]
 86%|████████▌ | 319557/371472 [3:15:12<4:05:20,  3.53it/s]
 86%|████████▌ | 319558/371472 [3:15:13<4:05:29,  3.52it/s]
 86%|████████▌ | 319559/371472 [3:15:13<4:08:28,  3.48it/s]
 86%|████████▌ | 319560/371472 [3:15:13<4:02:13,  3.57it/s]
                                                           
{'loss': 2.5862, 'learning_rate': 2.2583981555301776e-07, 'epoch': 13.76}

 86%|████████▌ | 319560/371472 [3:15:13<4:02:13,  3.57it/s]
 86%|████████▌ | 319561/371472 [3:15:13<4:17:50,  3.36it/s]
 86%|████████▌ | 319562/371472 [3:15:14<4:16:07,  3.38it/s]
 86%|████████▌ | 319563/371472 [3:15:14<4:15:32,  3.39it/s]
 86%|████████▌ | 319564/371472 [3:15:14<4:16:32,  3.37it/s]
 86%|████████▌ | 319565/371472 [3:15:15<4:07:58,  3.49it/s]
 86%|████████▌ | 319566/371472 [3:15:15<4:01:58,  3.58it/s]
 86%|████████▌ | 319567/371472 [3:15:15<4:07:04,  3.50it/s]
 86%|████████▌ | 319568/371472 [3:15:15<4:00:47,  3.59it/s]
 86%|████████▌ | 319569/371472 [3:15:16<3:58:25,  3.63it/s]
 86%|████████▌ | 319570/371472 [3:15:16<3:53:48,  3.70it/s]
 86%|████████▌ | 319571/371472 [3:15:16<3:59:57,  3.60it/s]
 86%|████████▌ | 319572/371472 [3:15:16<3:56:46,  3.65it/s]
 86%|████████▌ | 319573/371472 [3:15:17<3:54:54,  3.68it/s]
 86%|████████▌ | 319574/371472 [3:15:17<4:02:39,  3.56it/s]
 86%|████████▌ | 319575/371472 [3:15:17<3:56:54,  3.65it/s]
 86%|████████▌ | 319576/371472 [3:15:18<3:54:00,  3.70it/s]
 86%|████████▌ | 319577/371472 [3:15:18<3:48:54,  3.78it/s]
 86%|████████▌ | 319578/371472 [3:15:18<3:48:40,  3.78it/s]
 86%|████████▌ | 319579/371472 [3:15:18<3:55:21,  3.67it/s]
 86%|████████▌ | 319580/371472 [3:15:19<3:57:11,  3.65it/s]
                                                           
{'loss': 2.6318, 'learning_rate': 2.2579133357753883e-07, 'epoch': 13.76}

 86%|████████▌ | 319580/371472 [3:15:19<3:57:11,  3.65it/s]
 86%|████████▌ | 319581/371472 [3:15:19<3:53:19,  3.71it/s]
 86%|████████▌ | 319582/371472 [3:15:19<4:01:44,  3.58it/s]
 86%|████████▌ | 319583/371472 [3:15:19<3:55:18,  3.68it/s]
 86%|████████▌ | 319584/371472 [3:15:20<3:49:16,  3.77it/s]
 86%|████████▌ | 319585/371472 [3:15:20<4:14:32,  3.40it/s]
 86%|████████▌ | 319586/371472 [3:15:20<4:08:01,  3.49it/s]
 86%|████████▌ | 319587/371472 [3:15:21<4:13:07,  3.42it/s]
 86%|████████▌ | 319588/371472 [3:15:21<4:07:16,  3.50it/s]
 86%|████████▌ | 319589/371472 [3:15:21<4:06:51,  3.50it/s]
 86%|████████▌ | 319590/371472 [3:15:21<3:59:25,  3.61it/s]
 86%|████████▌ | 319591/371472 [3:15:22<3:58:04,  3.63it/s]
 86%|████████▌ | 319592/371472 [3:15:22<4:09:08,  3.47it/s]
 86%|████████▌ | 319593/371472 [3:15:22<4:25:32,  3.26it/s]
 86%|████████▌ | 319594/371472 [3:15:23<4:20:45,  3.32it/s]
 86%|████████▌ | 319595/371472 [3:15:23<4:14:43,  3.39it/s]
 86%|████████▌ | 319596/371472 [3:15:23<4:01:44,  3.58it/s]
 86%|████████▌ | 319597/371472 [3:15:24<4:03:32,  3.55it/s]
 86%|████████▌ | 319598/371472 [3:15:24<4:26:53,  3.24it/s]
 86%|████████▌ | 319599/371472 [3:15:24<4:25:47,  3.25it/s]
 86%|████████▌ | 319600/371472 [3:15:24<4:10:58,  3.44it/s]
                                                           
{'loss': 2.743, 'learning_rate': 2.2574285160205998e-07, 'epoch': 13.77}

 86%|████████▌ | 319600/371472 [3:15:24<4:10:58,  3.44it/s]
 86%|████████▌ | 319601/371472 [3:15:25<4:01:48,  3.58it/s]
 86%|████████▌ | 319602/371472 [3:15:25<3:59:08,  3.62it/s]
 86%|████████▌ | 319603/371472 [3:15:25<3:57:00,  3.65it/s]
 86%|████████▌ | 319604/371472 [3:15:25<3:51:33,  3.73it/s]
 86%|████████▌ | 319605/371472 [3:15:26<3:47:42,  3.80it/s]
 86%|████████▌ | 319606/371472 [3:15:26<3:46:07,  3.82it/s]
 86%|████████▌ | 319607/371472 [3:15:26<4:01:16,  3.58it/s]
 86%|████████▌ | 319608/371472 [3:15:27<3:54:45,  3.68it/s]
 86%|████████▌ | 319609/371472 [3:15:27<3:59:21,  3.61it/s]
 86%|████████▌ | 319610/371472 [3:15:27<3:57:28,  3.64it/s]
 86%|████████▌ | 319611/371472 [3:15:27<4:08:29,  3.48it/s]
 86%|████████▌ | 319612/371472 [3:15:28<4:04:08,  3.54it/s]
 86%|████████▌ | 319613/371472 [3:15:28<3:59:05,  3.62it/s]
 86%|████████▌ | 319614/371472 [3:15:28<4:16:20,  3.37it/s]
 86%|████████▌ | 319615/371472 [3:15:29<4:08:53,  3.47it/s]
 86%|████████▌ | 319616/371472 [3:15:29<4:07:23,  3.49it/s]
 86%|████████▌ | 319617/371472 [3:15:29<4:13:42,  3.41it/s]
 86%|████████▌ | 319618/371472 [3:15:30<4:25:08,  3.26it/s]
 86%|████████▌ | 319619/371472 [3:15:30<4:21:20,  3.31it/s]
 86%|████████▌ | 319620/371472 [3:15:30<4:14:43,  3.39it/s]
                                                           
{'loss': 2.5896, 'learning_rate': 2.2569436962658103e-07, 'epoch': 13.77}

 86%|████████▌ | 319620/371472 [3:15:30<4:14:43,  3.39it/s]
 86%|████████▌ | 319621/371472 [3:15:30<4:01:08,  3.58it/s]
 86%|████████▌ | 319622/371472 [3:15:31<4:09:32,  3.46it/s]
 86%|████████▌ | 319623/371472 [3:15:31<4:06:57,  3.50it/s]
 86%|████████▌ | 319624/371472 [3:15:31<3:56:07,  3.66it/s]
 86%|████████▌ | 319625/371472 [3:15:31<4:05:20,  3.52it/s]
 86%|████████▌ | 319626/371472 [3:15:32<4:12:40,  3.42it/s]
 86%|████████▌ | 319627/371472 [3:15:32<4:27:04,  3.24it/s]
 86%|████████▌ | 319628/371472 [3:15:32<4:21:08,  3.31it/s]
 86%|████████▌ | 319629/371472 [3:15:33<4:12:20,  3.42it/s]
 86%|████████▌ | 319630/371472 [3:15:33<4:01:43,  3.57it/s]
 86%|████████▌ | 319631/371472 [3:15:33<4:17:54,  3.35it/s]
 86%|████████▌ | 319632/371472 [3:15:34<4:14:07,  3.40it/s]
 86%|████████▌ | 319633/371472 [3:15:34<4:13:53,  3.40it/s]
 86%|████████▌ | 319634/371472 [3:15:34<4:06:38,  3.50it/s]
 86%|████████▌ | 319635/371472 [3:15:34<4:17:28,  3.36it/s]
 86%|████████▌ | 319636/371472 [3:15:35<4:24:53,  3.26it/s]
 86%|████████▌ | 319637/371472 [3:15:35<4:07:08,  3.50it/s]
 86%|████████▌ | 319638/371472 [3:15:35<3:55:15,  3.67it/s]
 86%|████████▌ | 319639/371472 [3:15:36<3:57:37,  3.64it/s]
 86%|████████▌ | 319640/371472 [3:15:36<3:54:48,  3.68it/s]
                                                           
{'loss': 2.7296, 'learning_rate': 2.256458876511022e-07, 'epoch': 13.77}

 86%|████████▌ | 319640/371472 [3:15:36<3:54:48,  3.68it/s]
 86%|████████▌ | 319641/371472 [3:15:36<3:50:27,  3.75it/s]
 86%|████████▌ | 319642/371472 [3:15:36<4:10:51,  3.44it/s]
 86%|████████▌ | 319643/371472 [3:15:37<4:01:32,  3.58it/s]
 86%|████████▌ | 319644/371472 [3:15:37<4:21:22,  3.30it/s]
 86%|████████▌ | 319645/371472 [3:15:37<4:15:45,  3.38it/s]
 86%|████████▌ | 319646/371472 [3:15:38<4:30:13,  3.20it/s]
 86%|████████▌ | 319647/371472 [3:15:38<4:12:47,  3.42it/s]
 86%|████████▌ | 319648/371472 [3:15:38<4:19:44,  3.33it/s]
 86%|████████▌ | 319649/371472 [3:15:38<4:12:50,  3.42it/s]
 86%|████████▌ | 319650/371472 [3:15:39<4:09:46,  3.46it/s]
 86%|████████▌ | 319651/371472 [3:15:39<4:25:19,  3.26it/s]
 86%|████████▌ | 319652/371472 [3:15:39<4:11:57,  3.43it/s]
 86%|████████▌ | 319653/371472 [3:15:40<4:09:30,  3.46it/s]
 86%|████████▌ | 319654/371472 [3:15:40<4:03:15,  3.55it/s]
 86%|████████▌ | 319655/371472 [3:15:40<3:55:53,  3.66it/s]
 86%|████████▌ | 319656/371472 [3:15:40<3:53:41,  3.70it/s]
 86%|████████▌ | 319657/371472 [3:15:41<3:58:49,  3.62it/s]
 86%|████████▌ | 319658/371472 [3:15:41<3:53:03,  3.71it/s]
 86%|████████▌ | 319659/371472 [3:15:41<3:56:02,  3.66it/s]
 86%|████████▌ | 319660/371472 [3:15:42<3:53:47,  3.69it/s]
                                                           
{'loss': 2.6488, 'learning_rate': 2.2559740567562325e-07, 'epoch': 13.77}

 86%|████████▌ | 319660/371472 [3:15:42<3:53:47,  3.69it/s]
 86%|████████▌ | 319661/371472 [3:15:42<4:09:15,  3.46it/s]
 86%|████████▌ | 319662/371472 [3:15:42<4:15:03,  3.39it/s]
 86%|████████▌ | 319663/371472 [3:15:43<4:38:00,  3.11it/s]
 86%|████████▌ | 319664/371472 [3:15:43<4:40:56,  3.07it/s]
 86%|████████▌ | 319665/371472 [3:15:43<4:23:45,  3.27it/s]
 86%|████████▌ | 319666/371472 [3:15:43<4:07:47,  3.48it/s]
 86%|████████▌ | 319667/371472 [3:15:44<4:02:52,  3.55it/s]
 86%|████████▌ | 319668/371472 [3:15:44<4:10:21,  3.45it/s]
 86%|████████▌ | 319669/371472 [3:15:44<3:58:26,  3.62it/s]
 86%|████████▌ | 319670/371472 [3:15:44<4:00:47,  3.59it/s]
 86%|████████▌ | 319671/371472 [3:15:45<4:05:08,  3.52it/s]
 86%|████████▌ | 319672/371472 [3:15:45<3:58:28,  3.62it/s]
 86%|████████▌ | 319673/371472 [3:15:45<4:19:22,  3.33it/s]
 86%|████████▌ | 319674/371472 [3:15:46<4:17:25,  3.35it/s]
 86%|████████▌ | 319675/371472 [3:15:46<4:09:42,  3.46it/s]
 86%|████████▌ | 319676/371472 [3:15:46<4:15:53,  3.37it/s]
 86%|████████▌ | 319677/371472 [3:15:47<4:11:06,  3.44it/s]
 86%|████████▌ | 319678/371472 [3:15:47<3:57:02,  3.64it/s]
 86%|████████▌ | 319679/371472 [3:15:47<3:47:32,  3.79it/s]
 86%|████████▌ | 319680/371472 [3:15:47<3:44:52,  3.84it/s]
                                                           
{'loss': 2.6161, 'learning_rate': 2.2554892370014432e-07, 'epoch': 13.77}

 86%|████████▌ | 319680/371472 [3:15:47<3:44:52,  3.84it/s]
 86%|████████▌ | 319681/371472 [3:15:48<3:42:06,  3.89it/s]
 86%|████████▌ | 319682/371472 [3:15:48<4:09:54,  3.45it/s]
 86%|████████▌ | 319683/371472 [3:15:48<4:18:39,  3.34it/s]
 86%|████████▌ | 319684/371472 [3:15:49<4:15:03,  3.38it/s]
 86%|████████▌ | 319685/371472 [3:15:49<4:17:42,  3.35it/s]
 86%|████████▌ | 319686/371472 [3:15:49<4:20:36,  3.31it/s]
 86%|████████▌ | 319687/371472 [3:15:49<4:11:47,  3.43it/s]
 86%|████████▌ | 319688/371472 [3:15:50<4:06:08,  3.51it/s]
 86%|████████▌ | 319689/371472 [3:15:50<4:07:03,  3.49it/s]
 86%|████████▌ | 319690/371472 [3:15:50<4:02:33,  3.56it/s]
 86%|████████▌ | 319691/371472 [3:15:50<3:50:24,  3.75it/s]
 86%|████████▌ | 319692/371472 [3:15:51<3:50:01,  3.75it/s]
 86%|████████▌ | 319693/371472 [3:15:51<4:09:22,  3.46it/s]
 86%|████████▌ | 319694/371472 [3:15:51<4:12:35,  3.42it/s]
 86%|████████▌ | 319695/371472 [3:15:52<4:10:04,  3.45it/s]
 86%|████████▌ | 319696/371472 [3:15:52<4:11:55,  3.43it/s]
 86%|████████▌ | 319697/371472 [3:15:52<4:05:27,  3.52it/s]
 86%|████████▌ | 319698/371472 [3:15:52<3:59:57,  3.60it/s]
 86%|████████▌ | 319699/371472 [3:15:53<4:12:06,  3.42it/s]
 86%|████████▌ | 319700/371472 [3:15:53<4:01:05,  3.58it/s]
                                                           
{'loss': 2.6331, 'learning_rate': 2.2550044172466547e-07, 'epoch': 13.77}

 86%|████████▌ | 319700/371472 [3:15:53<4:01:05,  3.58it/s]
 86%|████████▌ | 319701/371472 [3:15:53<4:10:51,  3.44it/s]
 86%|████████▌ | 319702/371472 [3:15:54<4:10:25,  3.45it/s]
 86%|████████▌ | 319703/371472 [3:15:54<4:03:25,  3.54it/s]
 86%|████████▌ | 319704/371472 [3:15:54<3:58:38,  3.62it/s]
 86%|████████▌ | 319705/371472 [3:15:54<3:56:32,  3.65it/s]
 86%|████████▌ | 319706/371472 [3:15:55<4:04:20,  3.53it/s]
 86%|████████▌ | 319707/371472 [3:15:55<3:55:19,  3.67it/s]
 86%|████████▌ | 319708/371472 [3:15:55<4:05:32,  3.51it/s]
 86%|████████▌ | 319709/371472 [3:15:56<4:18:52,  3.33it/s]
 86%|████████▌ | 319710/371472 [3:15:56<4:09:24,  3.46it/s]
 86%|████████▌ | 319711/371472 [3:15:56<4:18:38,  3.34it/s]
 86%|████████▌ | 319712/371472 [3:15:56<4:07:04,  3.49it/s]
 86%|████████▌ | 319713/371472 [3:15:57<3:58:06,  3.62it/s]
 86%|████████▌ | 319714/371472 [3:15:57<4:03:46,  3.54it/s]
 86%|████████▌ | 319715/371472 [3:15:57<3:54:51,  3.67it/s]
 86%|████████▌ | 319716/371472 [3:15:58<4:17:47,  3.35it/s]
 86%|████████▌ | 319717/371472 [3:15:58<4:03:21,  3.54it/s]
 86%|████████▌ | 319718/371472 [3:15:58<4:34:43,  3.14it/s]
 86%|████████▌ | 319719/371472 [3:15:59<4:17:46,  3.35it/s]
 86%|████████▌ | 319720/371472 [3:15:59<4:12:37,  3.41it/s]
                                                           
{'loss': 2.5998, 'learning_rate': 2.2545195974918652e-07, 'epoch': 13.77}

 86%|████████▌ | 319720/371472 [3:15:59<4:12:37,  3.41it/s]
 86%|████████▌ | 319721/371472 [3:15:59<4:03:53,  3.54it/s]
 86%|████████▌ | 319722/371472 [3:15:59<4:02:46,  3.55it/s]
 86%|████████▌ | 319723/371472 [3:16:00<4:05:21,  3.52it/s]
 86%|████████▌ | 319724/371472 [3:16:00<4:01:19,  3.57it/s]
 86%|████████▌ | 319725/371472 [3:16:00<4:01:14,  3.58it/s]
 86%|████████▌ | 319726/371472 [3:16:00<3:52:18,  3.71it/s]
 86%|████████▌ | 319727/371472 [3:16:01<3:51:37,  3.72it/s]
 86%|████████▌ | 319728/371472 [3:16:01<3:59:48,  3.60it/s]
 86%|████████▌ | 319729/371472 [3:16:01<4:24:40,  3.26it/s]
 86%|████████▌ | 319730/371472 [3:16:02<4:15:14,  3.38it/s]
 86%|████████▌ | 319731/371472 [3:16:02<4:00:31,  3.59it/s]
 86%|████████▌ | 319732/371472 [3:16:02<3:57:00,  3.64it/s]
 86%|████████▌ | 319733/371472 [3:16:03<4:16:19,  3.36it/s]
 86%|████████▌ | 319734/371472 [3:16:03<4:16:53,  3.36it/s]
 86%|████████▌ | 319735/371472 [3:16:03<4:18:47,  3.33it/s]
 86%|████████▌ | 319736/371472 [3:16:03<4:04:35,  3.53it/s]
 86%|████████▌ | 319737/371472 [3:16:04<4:02:34,  3.55it/s]
 86%|████████▌ | 319738/371472 [3:16:04<4:02:29,  3.56it/s]
 86%|████████▌ | 319739/371472 [3:16:04<3:50:53,  3.73it/s]
 86%|████████▌ | 319740/371472 [3:16:04<3:52:59,  3.70it/s]
                                                           
{'loss': 2.6264, 'learning_rate': 2.254034777737077e-07, 'epoch': 13.77}

 86%|████████▌ | 319740/371472 [3:16:04<3:52:59,  3.70it/s]
 86%|████████▌ | 319741/371472 [3:16:05<3:54:39,  3.67it/s]
 86%|████████▌ | 319742/371472 [3:16:05<3:54:57,  3.67it/s]
 86%|████████▌ | 319743/371472 [3:16:05<3:55:59,  3.65it/s]
 86%|████████▌ | 319744/371472 [3:16:06<3:56:00,  3.65it/s]
 86%|████████▌ | 319745/371472 [3:16:06<3:59:52,  3.59it/s]
 86%|████████▌ | 319746/371472 [3:16:06<4:10:50,  3.44it/s]
 86%|████████▌ | 319747/371472 [3:16:06<4:12:01,  3.42it/s]
 86%|████████▌ | 319748/371472 [3:16:07<4:05:14,  3.52it/s]
 86%|████████▌ | 319749/371472 [3:16:07<3:56:23,  3.65it/s]
 86%|████████▌ | 319750/371472 [3:16:07<4:09:31,  3.45it/s]
 86%|████████▌ | 319751/371472 [3:16:08<4:22:34,  3.28it/s]
 86%|████████▌ | 319752/371472 [3:16:08<4:08:11,  3.47it/s]
 86%|████████▌ | 319753/371472 [3:16:08<4:02:34,  3.55it/s]
 86%|████████▌ | 319754/371472 [3:16:08<3:56:57,  3.64it/s]
 86%|████████▌ | 319755/371472 [3:16:09<4:14:28,  3.39it/s]
 86%|████████▌ | 319756/371472 [3:16:09<4:05:34,  3.51it/s]
 86%|████████▌ | 319757/371472 [3:16:09<4:01:10,  3.57it/s]
 86%|████████▌ | 319758/371472 [3:16:10<4:02:09,  3.56it/s]
 86%|████████▌ | 319759/371472 [3:16:10<4:00:06,  3.59it/s]
 86%|████████▌ | 319760/371472 [3:16:10<3:54:59,  3.67it/s]
                                                           
{'loss': 2.595, 'learning_rate': 2.253549957982287e-07, 'epoch': 13.77}

 86%|████████▌ | 319760/371472 [3:16:10<3:54:59,  3.67it/s]
 86%|████████▌ | 319761/371472 [3:16:10<3:48:55,  3.76it/s]
 86%|████████▌ | 319762/371472 [3:16:11<3:48:55,  3.76it/s]
 86%|████████▌ | 319763/371472 [3:16:11<4:02:54,  3.55it/s]
 86%|████████▌ | 319764/371472 [3:16:11<3:58:20,  3.62it/s]
 86%|████████▌ | 319765/371472 [3:16:12<4:47:17,  3.00it/s]
 86%|████████▌ | 319766/371472 [3:16:12<4:37:29,  3.11it/s]
 86%|████████▌ | 319767/371472 [3:16:12<4:34:08,  3.14it/s]
 86%|████████▌ | 319768/371472 [3:16:13<4:20:15,  3.31it/s]
 86%|████████▌ | 319769/371472 [3:16:13<4:16:55,  3.35it/s]
 86%|████████▌ | 319770/371472 [3:16:13<4:12:40,  3.41it/s]
 86%|████████▌ | 319771/371472 [3:16:13<4:15:02,  3.38it/s]
 86%|████████▌ | 319772/371472 [3:16:14<4:21:33,  3.29it/s]
 86%|████████▌ | 319773/371472 [3:16:14<4:10:37,  3.44it/s]
 86%|████████▌ | 319774/371472 [3:16:14<4:01:42,  3.56it/s]
 86%|████████▌ | 319775/371472 [3:16:15<4:02:49,  3.55it/s]
 86%|████████▌ | 319776/371472 [3:16:15<4:04:08,  3.53it/s]
 86%|████████▌ | 319777/371472 [3:16:15<3:58:11,  3.62it/s]
 86%|████████▌ | 319778/371472 [3:16:15<4:00:35,  3.58it/s]
 86%|████████▌ | 319779/371472 [3:16:16<3:55:45,  3.65it/s]
 86%|████████▌ | 319780/371472 [3:16:16<3:52:34,  3.70it/s]
                                                           
{'loss': 2.5949, 'learning_rate': 2.253065138227499e-07, 'epoch': 13.77}

 86%|████████▌ | 319780/371472 [3:16:16<3:52:34,  3.70it/s]
 86%|████████▌ | 319781/371472 [3:16:16<4:03:14,  3.54it/s]
 86%|████████▌ | 319782/371472 [3:16:16<4:04:47,  3.52it/s]
 86%|████████▌ | 319783/371472 [3:16:17<4:10:47,  3.44it/s]
 86%|████████▌ | 319784/371472 [3:16:17<4:26:38,  3.23it/s]
 86%|████████▌ | 319785/371472 [3:16:17<4:23:19,  3.27it/s]
 86%|████████▌ | 319786/371472 [3:16:18<4:08:28,  3.47it/s]
 86%|████████▌ | 319787/371472 [3:16:18<4:02:58,  3.55it/s]
 86%|████████▌ | 319788/371472 [3:16:18<4:05:01,  3.52it/s]
 86%|████████▌ | 319789/371472 [3:16:19<4:15:02,  3.38it/s]
 86%|████████▌ | 319790/371472 [3:16:19<4:08:25,  3.47it/s]
 86%|████████▌ | 319791/371472 [3:16:19<4:10:23,  3.44it/s]
 86%|████████▌ | 319792/371472 [3:16:19<4:01:21,  3.57it/s]
 86%|████████▌ | 319793/371472 [3:16:20<4:51:09,  2.96it/s]
 86%|████████▌ | 319794/371472 [3:16:20<4:34:56,  3.13it/s]
 86%|████████▌ | 319795/371472 [3:16:20<4:19:39,  3.32it/s]
 86%|████████▌ | 319796/371472 [3:16:21<4:11:22,  3.43it/s]
 86%|████████▌ | 319797/371472 [3:16:21<4:05:15,  3.51it/s]
 86%|████████▌ | 319798/371472 [3:16:21<3:53:34,  3.69it/s]
 86%|████████▌ | 319799/371472 [3:16:21<4:07:17,  3.48it/s]
 86%|████████▌ | 319800/371472 [3:16:22<3:56:35,  3.64it/s]
                                                           
{'loss': 2.5239, 'learning_rate': 2.2525803184727096e-07, 'epoch': 13.77}

 86%|████████▌ | 319800/371472 [3:16:22<3:56:35,  3.64it/s]
 86%|████████▌ | 319801/371472 [3:16:22<3:54:36,  3.67it/s]
 86%|████████▌ | 319802/371472 [3:16:22<3:49:50,  3.75it/s]
 86%|████████▌ | 319803/371472 [3:16:23<3:48:24,  3.77it/s]
 86%|████████▌ | 319804/371472 [3:16:23<4:00:29,  3.58it/s]
 86%|████████▌ | 319805/371472 [3:16:23<3:53:50,  3.68it/s]
 86%|████████▌ | 319806/371472 [3:16:23<3:57:41,  3.62it/s]
 86%|████████▌ | 319807/371472 [3:16:24<3:54:22,  3.67it/s]
 86%|████████▌ | 319808/371472 [3:16:24<4:10:15,  3.44it/s]
 86%|████████▌ | 319809/371472 [3:16:24<3:59:06,  3.60it/s]
 86%|████████▌ | 319810/371472 [3:16:25<4:01:32,  3.56it/s]
 86%|████████▌ | 319811/371472 [3:16:25<4:17:05,  3.35it/s]
 86%|████████▌ | 319812/371472 [3:16:25<4:10:09,  3.44it/s]
 86%|████████▌ | 319813/371472 [3:16:25<4:09:11,  3.46it/s]
 86%|████████▌ | 319814/371472 [3:16:26<4:03:49,  3.53it/s]
 86%|████████▌ | 319815/371472 [3:16:26<4:08:09,  3.47it/s]
 86%|████████▌ | 319816/371472 [3:16:26<4:33:22,  3.15it/s]
 86%|████████▌ | 319817/371472 [3:16:27<4:18:41,  3.33it/s]
 86%|████████▌ | 319818/371472 [3:16:27<4:08:08,  3.47it/s]
 86%|████████▌ | 319819/371472 [3:16:27<4:00:24,  3.58it/s]
 86%|████████▌ | 319820/371472 [3:16:27<4:19:50,  3.31it/s]
                                                           
{'loss': 2.5965, 'learning_rate': 2.252095498717921e-07, 'epoch': 13.78}

 86%|████████▌ | 319820/371472 [3:16:27<4:19:50,  3.31it/s]
 86%|████████▌ | 319821/371472 [3:16:28<4:23:32,  3.27it/s]
 86%|████████▌ | 319822/371472 [3:16:28<4:09:37,  3.45it/s]
 86%|████████▌ | 319823/371472 [3:16:28<4:00:05,  3.59it/s]
 86%|████████▌ | 319824/371472 [3:16:29<4:01:52,  3.56it/s]
 86%|████████▌ | 319825/371472 [3:16:29<3:59:58,  3.59it/s]
 86%|████████▌ | 319826/371472 [3:16:29<3:55:54,  3.65it/s]
 86%|████████▌ | 319827/371472 [3:16:29<3:49:57,  3.74it/s]
 86%|████████▌ | 319828/371472 [3:16:30<3:52:42,  3.70it/s]
 86%|████████▌ | 319829/371472 [3:16:30<3:52:24,  3.70it/s]
 86%|████████▌ | 319830/371472 [3:16:30<3:52:33,  3.70it/s]
 86%|████████▌ | 319831/371472 [3:16:30<3:55:23,  3.66it/s]
 86%|████████▌ | 319832/371472 [3:16:31<3:58:56,  3.60it/s]
 86%|████████▌ | 319833/371472 [3:16:31<3:54:35,  3.67it/s]
 86%|████████▌ | 319834/371472 [3:16:31<3:57:26,  3.62it/s]
 86%|████████▌ | 319835/371472 [3:16:32<3:56:19,  3.64it/s]
 86%|████████▌ | 319836/371472 [3:16:32<4:00:15,  3.58it/s]
 86%|████████▌ | 319837/371472 [3:16:32<3:53:34,  3.68it/s]
 86%|████████▌ | 319838/371472 [3:16:32<3:53:37,  3.68it/s]
 86%|████████▌ | 319839/371472 [3:16:33<3:50:10,  3.74it/s]
 86%|████████▌ | 319840/371472 [3:16:33<3:49:06,  3.76it/s]
                                                           
{'loss': 2.6621, 'learning_rate': 2.2516106789631318e-07, 'epoch': 13.78}

 86%|████████▌ | 319840/371472 [3:16:33<3:49:06,  3.76it/s]
 86%|████████▌ | 319841/371472 [3:16:33<3:46:19,  3.80it/s]
 86%|████████▌ | 319842/371472 [3:16:33<3:46:34,  3.80it/s]
 86%|████████▌ | 319843/371472 [3:16:34<3:59:08,  3.60it/s]
 86%|████████▌ | 319844/371472 [3:16:34<4:06:43,  3.49it/s]
 86%|████████▌ | 319845/371472 [3:16:34<3:57:00,  3.63it/s]
 86%|████████▌ | 319846/371472 [3:16:35<3:58:12,  3.61it/s]
 86%|████████▌ | 319847/371472 [3:16:35<3:49:24,  3.75it/s]
 86%|████████▌ | 319848/371472 [3:16:35<3:45:07,  3.82it/s]
 86%|████████▌ | 319849/371472 [3:16:35<3:42:10,  3.87it/s]
 86%|████████▌ | 319850/371472 [3:16:36<3:58:37,  3.61it/s]
 86%|████████▌ | 319851/371472 [3:16:36<3:59:09,  3.60it/s]
 86%|████████▌ | 319852/371472 [3:16:36<3:59:50,  3.59it/s]
 86%|████████▌ | 319853/371472 [3:16:36<3:49:41,  3.75it/s]
 86%|████████▌ | 319854/371472 [3:16:37<3:45:51,  3.81it/s]
 86%|████████▌ | 319855/371472 [3:16:37<3:45:32,  3.81it/s]
 86%|████████▌ | 319856/371472 [3:16:37<4:07:05,  3.48it/s]
 86%|████████▌ | 319857/371472 [3:16:38<3:59:30,  3.59it/s]
 86%|████████▌ | 319858/371472 [3:16:38<3:51:10,  3.72it/s]
 86%|████████▌ | 319859/371472 [3:16:38<3:44:34,  3.83it/s]
 86%|████████▌ | 319860/371472 [3:16:38<3:47:45,  3.78it/s]
                                                           
{'loss': 2.6317, 'learning_rate': 2.2511258592083433e-07, 'epoch': 13.78}

 86%|████████▌ | 319860/371472 [3:16:38<3:47:45,  3.78it/s]
 86%|████████▌ | 319861/371472 [3:16:39<3:48:59,  3.76it/s]
 86%|████████▌ | 319862/371472 [3:16:39<4:11:04,  3.43it/s]
 86%|████████▌ | 319863/371472 [3:16:39<4:21:56,  3.28it/s]
 86%|████████▌ | 319864/371472 [3:16:40<4:13:44,  3.39it/s]
 86%|████████▌ | 319865/371472 [3:16:40<4:01:05,  3.57it/s]
 86%|████████▌ | 319866/371472 [3:16:40<4:05:52,  3.50it/s]
 86%|████████▌ | 319867/371472 [3:16:40<4:08:13,  3.46it/s]
 86%|████████▌ | 319868/371472 [3:16:41<4:03:47,  3.53it/s]
 86%|████████▌ | 319869/371472 [3:16:41<4:15:54,  3.36it/s]
 86%|████████▌ | 319870/371472 [3:16:41<4:13:51,  3.39it/s]
 86%|████████▌ | 319871/371472 [3:16:42<4:08:36,  3.46it/s]
 86%|████████▌ | 319872/371472 [3:16:42<4:02:54,  3.54it/s]
 86%|████████▌ | 319873/371472 [3:16:42<3:51:59,  3.71it/s]
 86%|████████▌ | 319874/371472 [3:16:42<4:17:01,  3.35it/s]
 86%|████████▌ | 319875/371472 [3:16:43<4:02:09,  3.55it/s]
 86%|████████▌ | 319876/371472 [3:16:43<3:54:18,  3.67it/s]
 86%|████████▌ | 319877/371472 [3:16:43<3:51:31,  3.71it/s]
 86%|████████▌ | 319878/371472 [3:16:44<3:59:05,  3.60it/s]
 86%|████████▌ | 319879/371472 [3:16:44<4:03:55,  3.53it/s]
 86%|████████▌ | 319880/371472 [3:16:44<4:06:30,  3.49it/s]
                                                           
{'loss': 2.5931, 'learning_rate': 2.2506410394535538e-07, 'epoch': 13.78}

 86%|████████▌ | 319880/371472 [3:16:44<4:06:30,  3.49it/s]
 86%|████████▌ | 319881/371472 [3:16:44<4:04:54,  3.51it/s]
 86%|████████▌ | 319882/371472 [3:16:45<3:55:50,  3.65it/s]
 86%|████████▌ | 319883/371472 [3:16:45<4:13:24,  3.39it/s]
 86%|████████▌ | 319884/371472 [3:16:45<4:35:10,  3.12it/s]
 86%|████████▌ | 319885/371472 [3:16:46<4:39:14,  3.08it/s]
 86%|████████▌ | 319886/371472 [3:16:46<4:35:55,  3.12it/s]
 86%|████████▌ | 319887/371472 [3:16:46<4:34:50,  3.13it/s]
 86%|████████▌ | 319888/371472 [3:16:47<4:20:28,  3.30it/s]
 86%|████████▌ | 319889/371472 [3:16:47<4:08:18,  3.46it/s]
 86%|████████▌ | 319890/371472 [3:16:47<4:21:08,  3.29it/s]
 86%|████████▌ | 319891/371472 [3:16:47<4:04:32,  3.52it/s]
 86%|████████▌ | 319892/371472 [3:16:48<3:54:44,  3.66it/s]
 86%|████████▌ | 319893/371472 [3:16:48<3:53:19,  3.68it/s]
 86%|████████▌ | 319894/371472 [3:16:48<3:45:04,  3.82it/s]
 86%|████████▌ | 319895/371472 [3:16:48<3:39:51,  3.91it/s]
 86%|████████▌ | 319896/371472 [3:16:49<3:35:28,  3.99it/s]
 86%|████████▌ | 319897/371472 [3:16:49<3:38:41,  3.93it/s]
 86%|████████▌ | 319898/371472 [3:16:49<3:42:29,  3.86it/s]
 86%|████████▌ | 319899/371472 [3:16:49<3:44:03,  3.84it/s]
 86%|████████▌ | 319900/371472 [3:16:50<3:41:51,  3.87it/s]
                                                           
{'loss': 2.5865, 'learning_rate': 2.2501562196987656e-07, 'epoch': 13.78}

 86%|████████▌ | 319900/371472 [3:16:50<3:41:51,  3.87it/s]
 86%|████████▌ | 319901/371472 [3:16:50<3:50:46,  3.72it/s]
 86%|████████▌ | 319902/371472 [3:16:50<4:03:07,  3.54it/s]
 86%|████████▌ | 319903/371472 [3:16:51<4:03:15,  3.53it/s]
 86%|████████▌ | 319904/371472 [3:16:51<4:13:09,  3.39it/s]
 86%|████████▌ | 319905/371472 [3:16:51<4:15:19,  3.37it/s]
 86%|████████▌ | 319906/371472 [3:16:52<4:18:20,  3.33it/s]
 86%|████████▌ | 319907/371472 [3:16:52<4:17:31,  3.34it/s]
 86%|████████▌ | 319908/371472 [3:16:52<4:05:47,  3.50it/s]
 86%|████████▌ | 319909/371472 [3:16:52<4:16:11,  3.35it/s]
 86%|████████▌ | 319910/371472 [3:16:53<4:07:54,  3.47it/s]
 86%|████████▌ | 319911/371472 [3:16:53<3:59:30,  3.59it/s]
 86%|████████▌ | 319912/371472 [3:16:53<4:26:46,  3.22it/s]
 86%|████████▌ | 319913/371472 [3:16:54<4:20:55,  3.29it/s]
 86%|████████▌ | 319914/371472 [3:16:54<4:25:40,  3.23it/s]
 86%|████████▌ | 319915/371472 [3:16:54<4:11:05,  3.42it/s]
 86%|████████▌ | 319916/371472 [3:16:54<4:05:30,  3.50it/s]
 86%|████████▌ | 319917/371472 [3:16:55<4:15:16,  3.37it/s]
 86%|████████▌ | 319918/371472 [3:16:55<4:07:48,  3.47it/s]
 86%|████████▌ | 319919/371472 [3:16:55<3:55:07,  3.65it/s]
 86%|████████▌ | 319920/371472 [3:16:56<3:56:49,  3.63it/s]
                                                           
{'loss': 2.6264, 'learning_rate': 2.249671399943976e-07, 'epoch': 13.78}

 86%|████████▌ | 319920/371472 [3:16:56<3:56:49,  3.63it/s]
 86%|████████▌ | 319921/371472 [3:16:56<3:51:28,  3.71it/s]
 86%|████████▌ | 319922/371472 [3:16:56<3:47:12,  3.78it/s]
 86%|████████▌ | 319923/371472 [3:16:56<3:43:13,  3.85it/s]
 86%|████████▌ | 319924/371472 [3:16:57<3:58:51,  3.60it/s]
 86%|████████▌ | 319925/371472 [3:16:57<3:58:40,  3.60it/s]
 86%|████████▌ | 319926/371472 [3:16:57<3:55:15,  3.65it/s]
 86%|████████▌ | 319927/371472 [3:16:57<3:56:06,  3.64it/s]
 86%|████████▌ | 319928/371472 [3:16:58<4:01:20,  3.56it/s]
 86%|████████▌ | 319929/371472 [3:16:58<3:53:03,  3.69it/s]
 86%|████████▌ | 319930/371472 [3:16:58<3:52:21,  3.70it/s]
 86%|████████▌ | 319931/371472 [3:16:58<3:46:09,  3.80it/s]
 86%|████████▌ | 319932/371472 [3:16:59<3:44:25,  3.83it/s]
 86%|████████▌ | 319933/371472 [3:16:59<3:51:46,  3.71it/s]
 86%|████████▌ | 319934/371472 [3:16:59<3:49:41,  3.74it/s]
 86%|████████▌ | 319935/371472 [3:17:00<3:52:20,  3.70it/s]
 86%|████████▌ | 319936/371472 [3:17:00<4:03:22,  3.53it/s]
 86%|████████▌ | 319937/371472 [3:17:00<3:51:53,  3.70it/s]
 86%|████████▌ | 319938/371472 [3:17:00<3:57:23,  3.62it/s]
 86%|████████▌ | 319939/371472 [3:17:01<3:49:53,  3.74it/s]
 86%|████████▌ | 319940/371472 [3:17:01<3:49:54,  3.74it/s]
                                                           
{'loss': 2.7847, 'learning_rate': 2.2491865801891878e-07, 'epoch': 13.78}

 86%|████████▌ | 319940/371472 [3:17:01<3:49:54,  3.74it/s]
 86%|████████▌ | 319941/371472 [3:17:01<3:53:31,  3.68it/s]
 86%|████████▌ | 319942/371472 [3:17:01<3:52:39,  3.69it/s]
 86%|████████▌ | 319943/371472 [3:17:02<4:02:05,  3.55it/s]
 86%|████████▌ | 319944/371472 [3:17:02<4:11:37,  3.41it/s]
 86%|████████▌ | 319945/371472 [3:17:02<3:57:46,  3.61it/s]
 86%|████████▌ | 319946/371472 [3:17:03<4:00:57,  3.56it/s]
 86%|████████▌ | 319947/371472 [3:17:03<3:54:31,  3.66it/s]
 86%|████████▌ | 319948/371472 [3:17:03<3:50:41,  3.72it/s]
 86%|████████▌ | 319949/371472 [3:17:03<3:53:37,  3.68it/s]
 86%|████████▌ | 319950/371472 [3:17:04<3:47:48,  3.77it/s]
 86%|████████▌ | 319951/371472 [3:17:04<3:48:46,  3.75it/s]
 86%|████████▌ | 319952/371472 [3:17:04<4:11:23,  3.42it/s]
 86%|████████▌ | 319953/371472 [3:17:05<4:25:47,  3.23it/s]
 86%|████████▌ | 319954/371472 [3:17:05<4:18:31,  3.32it/s]
 86%|████████▌ | 319955/371472 [3:17:05<4:10:20,  3.43it/s]
 86%|████████▌ | 319956/371472 [3:17:05<4:04:14,  3.52it/s]
 86%|████████▌ | 319957/371472 [3:17:06<4:00:07,  3.58it/s]
 86%|████████▌ | 319958/371472 [3:17:06<4:02:50,  3.54it/s]
 86%|████████▌ | 319959/371472 [3:17:06<3:58:47,  3.60it/s]
 86%|████████▌ | 319960/371472 [3:17:07<3:56:39,  3.63it/s]
                                                           
{'loss': 2.6362, 'learning_rate': 2.2487017604343982e-07, 'epoch': 13.78}

 86%|████████▌ | 319960/371472 [3:17:07<3:56:39,  3.63it/s]
 86%|████████▌ | 319961/371472 [3:17:07<3:50:48,  3.72it/s]
 86%|████████▌ | 319962/371472 [3:17:07<3:47:39,  3.77it/s]
 86%|████████▌ | 319963/371472 [3:17:07<3:50:48,  3.72it/s]
 86%|████████▌ | 319964/371472 [3:17:08<3:53:46,  3.67it/s]
 86%|████████▌ | 319965/371472 [3:17:08<4:10:14,  3.43it/s]
 86%|████████▌ | 319966/371472 [3:17:08<4:06:51,  3.48it/s]
 86%|████████▌ | 319967/371472 [3:17:09<4:14:57,  3.37it/s]
 86%|████████▌ | 319968/371472 [3:17:09<4:05:42,  3.49it/s]
 86%|████████▌ | 319969/371472 [3:17:09<3:56:38,  3.63it/s]
 86%|████████▌ | 319970/371472 [3:17:09<4:06:18,  3.48it/s]
 86%|████████▌ | 319971/371472 [3:17:10<3:57:44,  3.61it/s]
 86%|████████▌ | 319972/371472 [3:17:10<3:53:02,  3.68it/s]
 86%|████████▌ | 319973/371472 [3:17:10<3:49:42,  3.74it/s]
 86%|████████▌ | 319974/371472 [3:17:10<3:44:13,  3.83it/s]
 86%|████████▌ | 319975/371472 [3:17:11<3:39:52,  3.90it/s]
 86%|████████▌ | 319976/371472 [3:17:11<3:52:33,  3.69it/s]
 86%|████████▌ | 319977/371472 [3:17:11<3:55:24,  3.65it/s]
 86%|████████▌ | 319978/371472 [3:17:12<4:12:14,  3.40it/s]
 86%|████████▌ | 319979/371472 [3:17:12<4:06:52,  3.48it/s]
 86%|████████▌ | 319980/371472 [3:17:12<4:04:35,  3.51it/s]
                                                           
{'loss': 2.6725, 'learning_rate': 2.2482169406796098e-07, 'epoch': 13.78}

 86%|████████▌ | 319980/371472 [3:17:12<4:04:35,  3.51it/s]
 86%|████████▌ | 319981/371472 [3:17:12<4:18:36,  3.32it/s]
 86%|████████▌ | 319982/371472 [3:17:13<4:14:03,  3.38it/s]
 86%|████████▌ | 319983/371472 [3:17:13<4:06:10,  3.49it/s]
 86%|████████▌ | 319984/371472 [3:17:13<4:15:06,  3.36it/s]
 86%|████████▌ | 319985/371472 [3:17:14<4:11:33,  3.41it/s]
 86%|████████▌ | 319986/371472 [3:17:14<4:07:16,  3.47it/s]
 86%|████████▌ | 319987/371472 [3:17:14<3:56:30,  3.63it/s]
 86%|████████▌ | 319988/371472 [3:17:14<4:00:37,  3.57it/s]
 86%|████████▌ | 319989/371472 [3:17:15<4:17:05,  3.34it/s]
 86%|████████▌ | 319990/371472 [3:17:15<4:17:27,  3.33it/s]
 86%|████████▌ | 319991/371472 [3:17:15<4:14:10,  3.38it/s]
 86%|████████▌ | 319992/371472 [3:17:16<4:08:38,  3.45it/s]
 86%|████████▌ | 319993/371472 [3:17:16<4:06:30,  3.48it/s]
 86%|████████▌ | 319994/371472 [3:17:16<4:05:07,  3.50it/s]
 86%|████████▌ | 319995/371472 [3:17:17<4:33:54,  3.13it/s]
 86%|████████▌ | 319996/371472 [3:17:17<4:20:00,  3.30it/s]
 86%|████████▌ | 319997/371472 [3:17:17<4:09:02,  3.44it/s]
 86%|████████▌ | 319998/371472 [3:17:17<4:12:50,  3.39it/s]
 86%|████████▌ | 319999/371472 [3:17:18<4:09:01,  3.44it/s]
 86%|████████▌ | 320000/371472 [3:17:18<4:06:43,  3.48it/s]
                                                           
{'loss': 2.6421, 'learning_rate': 2.2477321209248205e-07, 'epoch': 13.78}

 86%|████████▌ | 320000/371472 [3:17:18<4:06:43,  3.48it/s]
 86%|████████▌ | 320001/371472 [3:17:18<3:56:58,  3.62it/s]
 86%|████████▌ | 320002/371472 [3:17:19<4:05:02,  3.50it/s]
 86%|████████▌ | 320003/371472 [3:17:19<4:07:02,  3.47it/s]
 86%|████████▌ | 320004/371472 [3:17:19<3:52:04,  3.70it/s]
 86%|████████▌ | 320005/371472 [3:17:19<3:45:05,  3.81it/s]
 86%|████████▌ | 320006/371472 [3:17:20<4:01:11,  3.56it/s]
 86%|████████▌ | 320007/371472 [3:17:20<3:58:50,  3.59it/s]
 86%|████████▌ | 320008/371472 [3:17:20<3:56:24,  3.63it/s]
 86%|████████▌ | 320009/371472 [3:17:20<3:52:19,  3.69it/s]
 86%|████████▌ | 320010/371472 [3:17:21<3:57:06,  3.62it/s]
 86%|████████▌ | 320011/371472 [3:17:21<3:48:26,  3.75it/s]
 86%|████████▌ | 320012/371472 [3:17:21<3:46:59,  3.78it/s]
 86%|████████▌ | 320013/371472 [3:17:22<3:58:07,  3.60it/s]
 86%|████████▌ | 320014/371472 [3:17:22<3:51:30,  3.70it/s]
 86%|████████▌ | 320015/371472 [3:17:22<3:47:00,  3.78it/s]
 86%|████████▌ | 320016/371472 [3:17:22<4:01:54,  3.55it/s]
 86%|████████▌ | 320017/371472 [3:17:23<4:04:38,  3.51it/s]
 86%|████████▌ | 320018/371472 [3:17:23<4:03:53,  3.52it/s]
 86%|████████▌ | 320019/371472 [3:17:23<4:02:11,  3.54it/s]
 86%|████████▌ | 320020/371472 [3:17:24<4:06:08,  3.48it/s]
                                                           
{'loss': 2.5763, 'learning_rate': 2.247247301170032e-07, 'epoch': 13.78}

 86%|████████▌ | 320020/371472 [3:17:24<4:06:08,  3.48it/s]
 86%|████████▌ | 320021/371472 [3:17:24<4:01:42,  3.55it/s]
 86%|████████▌ | 320022/371472 [3:17:24<4:01:52,  3.55it/s]
 86%|████████▌ | 320023/371472 [3:17:24<3:55:23,  3.64it/s]
 86%|████████▌ | 320024/371472 [3:17:25<4:05:49,  3.49it/s]
 86%|████████▌ | 320025/371472 [3:17:25<4:08:11,  3.45it/s]
 86%|████████▌ | 320026/371472 [3:17:25<4:19:07,  3.31it/s]
 86%|████████▌ | 320027/371472 [3:17:26<4:08:48,  3.45it/s]
 86%|████████▌ | 320028/371472 [3:17:26<3:59:21,  3.58it/s]
 86%|████████▌ | 320029/371472 [3:17:26<4:10:08,  3.43it/s]
 86%|████████▌ | 320030/371472 [3:17:26<4:18:07,  3.32it/s]
 86%|████████▌ | 320031/371472 [3:17:27<4:08:42,  3.45it/s]
 86%|████████▌ | 320032/371472 [3:17:27<4:05:09,  3.50it/s]
 86%|████████▌ | 320033/371472 [3:17:27<3:59:50,  3.57it/s]
 86%|████████▌ | 320034/371472 [3:17:28<3:53:53,  3.67it/s]
 86%|████████▌ | 320035/371472 [3:17:28<4:00:13,  3.57it/s]
 86%|████████▌ | 320036/371472 [3:17:28<4:23:48,  3.25it/s]
 86%|████████▌ | 320037/371472 [3:17:28<4:18:07,  3.32it/s]
 86%|████████▌ | 320038/371472 [3:17:29<4:13:27,  3.38it/s]
 86%|████████▌ | 320039/371472 [3:17:29<4:11:38,  3.41it/s]
 86%|████████▌ | 320040/371472 [3:17:29<4:19:42,  3.30it/s]
                                                           
{'loss': 2.6003, 'learning_rate': 2.2467624814152424e-07, 'epoch': 13.78}

 86%|████████▌ | 320040/371472 [3:17:29<4:19:42,  3.30it/s]
 86%|████████▌ | 320041/371472 [3:17:30<4:07:43,  3.46it/s]
 86%|████████▌ | 320042/371472 [3:17:30<4:04:28,  3.51it/s]
 86%|████████▌ | 320043/371472 [3:17:30<4:05:42,  3.49it/s]
 86%|████████▌ | 320044/371472 [3:17:30<3:57:45,  3.61it/s]
 86%|████████▌ | 320045/371472 [3:17:31<3:57:48,  3.60it/s]
 86%|████████▌ | 320046/371472 [3:17:31<4:07:39,  3.46it/s]
 86%|████████▌ | 320047/371472 [3:17:31<4:03:44,  3.52it/s]
 86%|████████▌ | 320048/371472 [3:17:32<3:52:48,  3.68it/s]
 86%|████████▌ | 320049/371472 [3:17:32<4:00:48,  3.56it/s]
 86%|████████▌ | 320050/371472 [3:17:32<3:52:13,  3.69it/s]
 86%|████████▌ | 320051/371472 [3:17:32<3:47:08,  3.77it/s]
 86%|████████▌ | 320052/371472 [3:17:33<3:39:18,  3.91it/s]
 86%|████████▌ | 320053/371472 [3:17:33<3:50:31,  3.72it/s]
 86%|████████▌ | 320054/371472 [3:17:33<4:09:17,  3.44it/s]
 86%|████████▌ | 320055/371472 [3:17:34<4:08:06,  3.45it/s]
 86%|████████▌ | 320056/371472 [3:17:34<4:35:03,  3.12it/s]
 86%|████████▌ | 320057/371472 [3:17:34<4:28:33,  3.19it/s]
 86%|████████▌ | 320058/371472 [3:17:34<4:13:52,  3.38it/s]
 86%|████████▌ | 320059/371472 [3:17:35<4:08:18,  3.45it/s]
 86%|████████▌ | 320060/371472 [3:17:35<4:04:45,  3.50it/s]
                                                           
{'loss': 2.5253, 'learning_rate': 2.2462776616604542e-07, 'epoch': 13.79}

 86%|████████▌ | 320060/371472 [3:17:35<4:04:45,  3.50it/s]
 86%|████████▌ | 320061/371472 [3:17:35<4:10:56,  3.41it/s]
 86%|████████▌ | 320062/371472 [3:17:36<3:55:46,  3.63it/s]
 86%|████████▌ | 320063/371472 [3:17:36<4:01:00,  3.56it/s]
 86%|████████▌ | 320064/371472 [3:17:36<4:05:01,  3.50it/s]
 86%|████████▌ | 320065/371472 [3:17:36<4:05:17,  3.49it/s]
 86%|████████▌ | 320066/371472 [3:17:37<4:08:08,  3.45it/s]
 86%|████████▌ | 320067/371472 [3:17:37<4:02:27,  3.53it/s]
 86%|████████▌ | 320068/371472 [3:17:37<4:00:56,  3.56it/s]
 86%|████████▌ | 320069/371472 [3:17:38<3:57:05,  3.61it/s]
 86%|████████▌ | 320070/371472 [3:17:38<4:40:06,  3.06it/s]
 86%|████████▌ | 320071/371472 [3:17:38<4:19:21,  3.30it/s]
 86%|████████▌ | 320072/371472 [3:17:39<4:29:51,  3.17it/s]
 86%|████████▌ | 320073/371472 [3:17:39<4:13:26,  3.38it/s]
 86%|████████▌ | 320074/371472 [3:17:39<4:01:49,  3.54it/s]
 86%|████████▌ | 320075/371472 [3:17:39<3:53:33,  3.67it/s]
 86%|████████▌ | 320076/371472 [3:17:40<4:07:46,  3.46it/s]
 86%|████████▌ | 320077/371472 [3:17:40<3:56:35,  3.62it/s]
 86%|████████▌ | 320078/371472 [3:17:40<3:53:55,  3.66it/s]
 86%|████████▌ | 320079/371472 [3:17:41<4:13:18,  3.38it/s]
 86%|████████▌ | 320080/371472 [3:17:41<4:04:24,  3.50it/s]
                                                           
{'loss': 2.5502, 'learning_rate': 2.2457928419056647e-07, 'epoch': 13.79}

 86%|████████▌ | 320080/371472 [3:17:41<4:04:24,  3.50it/s]
 86%|████████▌ | 320081/371472 [3:17:41<3:54:28,  3.65it/s]
 86%|████████▌ | 320082/371472 [3:17:41<4:12:44,  3.39it/s]
 86%|████████▌ | 320083/371472 [3:17:42<4:25:15,  3.23it/s]
 86%|████████▌ | 320084/371472 [3:17:42<4:18:08,  3.32it/s]
 86%|████████▌ | 320085/371472 [3:17:42<4:04:02,  3.51it/s]
 86%|████████▌ | 320086/371472 [3:17:43<4:13:56,  3.37it/s]
 86%|████████▌ | 320087/371472 [3:17:43<4:17:38,  3.32it/s]
 86%|████████▌ | 320088/371472 [3:17:43<4:19:17,  3.30it/s]
 86%|████████▌ | 320089/371472 [3:17:43<4:07:09,  3.46it/s]
 86%|████████▌ | 320090/371472 [3:17:44<3:52:24,  3.68it/s]
 86%|████████▌ | 320091/371472 [3:17:44<3:45:32,  3.80it/s]
 86%|████████▌ | 320092/371472 [3:17:44<3:45:51,  3.79it/s]
 86%|████████▌ | 320093/371472 [3:17:44<3:52:17,  3.69it/s]
 86%|████████▌ | 320094/371472 [3:17:45<3:55:14,  3.64it/s]
 86%|████████▌ | 320095/371472 [3:17:45<3:52:27,  3.68it/s]
 86%|████████▌ | 320096/371472 [3:17:45<3:49:12,  3.74it/s]
 86%|████████▌ | 320097/371472 [3:17:46<3:47:38,  3.76it/s]
 86%|████████▌ | 320098/371472 [3:17:46<4:15:58,  3.34it/s]
 86%|████████▌ | 320099/371472 [3:17:46<4:17:51,  3.32it/s]
 86%|████████▌ | 320100/371472 [3:17:47<4:14:23,  3.37it/s]
                                                           
{'loss': 2.5013, 'learning_rate': 2.2453080221508762e-07, 'epoch': 13.79}

 86%|████████▌ | 320100/371472 [3:17:47<4:14:23,  3.37it/s]
 86%|████████▌ | 320101/371472 [3:17:47<4:07:43,  3.46it/s]
 86%|████████▌ | 320102/371472 [3:17:47<4:05:40,  3.48it/s]
 86%|████████▌ | 320103/371472 [3:17:47<4:03:11,  3.52it/s]
 86%|████████▌ | 320104/371472 [3:17:48<4:22:52,  3.26it/s]
 86%|████████▌ | 320105/371472 [3:17:48<4:11:13,  3.41it/s]
 86%|████████▌ | 320106/371472 [3:17:48<4:15:13,  3.35it/s]
 86%|████████▌ | 320107/371472 [3:17:49<4:11:39,  3.40it/s]
 86%|████████▌ | 320108/371472 [3:17:49<4:04:18,  3.50it/s]
 86%|████████▌ | 320109/371472 [3:17:49<4:07:17,  3.46it/s]
 86%|████████▌ | 320110/371472 [3:17:49<4:08:59,  3.44it/s]
 86%|████████▌ | 320111/371472 [3:17:50<4:19:08,  3.30it/s]
 86%|████████▌ | 320112/371472 [3:17:50<4:09:52,  3.43it/s]
 86%|████████▌ | 320113/371472 [3:17:50<4:22:34,  3.26it/s]
 86%|████████▌ | 320114/371472 [3:17:51<4:16:47,  3.33it/s]
 86%|████████▌ | 320115/371472 [3:17:51<4:08:12,  3.45it/s]
 86%|████████▌ | 320116/371472 [3:17:51<4:15:56,  3.34it/s]
 86%|████████▌ | 320117/371472 [3:17:52<4:10:01,  3.42it/s]
 86%|████████▌ | 320118/371472 [3:17:52<4:03:33,  3.51it/s]
 86%|████████▌ | 320119/371472 [3:17:52<4:02:07,  3.53it/s]
 86%|████████▌ | 320120/371472 [3:17:52<4:02:36,  3.53it/s]
                                                           
{'loss': 2.3231, 'learning_rate': 2.244823202396087e-07, 'epoch': 13.79}

 86%|████████▌ | 320120/371472 [3:17:52<4:02:36,  3.53it/s]
 86%|████████▌ | 320121/371472 [3:17:53<3:57:05,  3.61it/s]
 86%|████████▌ | 320122/371472 [3:17:53<4:08:39,  3.44it/s]
 86%|████████▌ | 320123/371472 [3:17:53<4:03:37,  3.51it/s]
 86%|████████▌ | 320124/371472 [3:17:53<3:57:31,  3.60it/s]
 86%|████████▌ | 320125/371472 [3:17:54<3:56:53,  3.61it/s]
 86%|████████▌ | 320126/371472 [3:17:54<3:58:21,  3.59it/s]
 86%|████████▌ | 320127/371472 [3:17:54<3:57:32,  3.60it/s]
 86%|████████▌ | 320128/371472 [3:17:55<3:55:53,  3.63it/s]
 86%|████████▌ | 320129/371472 [3:17:55<4:02:02,  3.54it/s]
 86%|████████▌ | 320130/371472 [3:17:55<3:57:15,  3.61it/s]
 86%|████████▌ | 320131/371472 [3:17:55<4:11:25,  3.40it/s]
 86%|████████▌ | 320132/371472 [3:17:56<4:05:08,  3.49it/s]
 86%|████████▌ | 320133/371472 [3:17:56<3:56:55,  3.61it/s]
 86%|████████▌ | 320134/371472 [3:17:56<3:57:47,  3.60it/s]
 86%|████████▌ | 320135/371472 [3:17:57<4:01:43,  3.54it/s]
 86%|████████▌ | 320136/371472 [3:17:57<3:59:06,  3.58it/s]
 86%|████████▌ | 320137/371472 [3:17:57<3:56:44,  3.61it/s]
 86%|████████▌ | 320138/371472 [3:17:57<4:00:04,  3.56it/s]
 86%|████████▌ | 320139/371472 [3:17:58<3:58:51,  3.58it/s]
 86%|████████▌ | 320140/371472 [3:17:58<4:13:34,  3.37it/s]
                                                           
{'loss': 2.4768, 'learning_rate': 2.2443383826412984e-07, 'epoch': 13.79}

 86%|████████▌ | 320140/371472 [3:17:58<4:13:34,  3.37it/s]
 86%|████████▌ | 320141/371472 [3:17:58<4:06:51,  3.47it/s]
 86%|████████▌ | 320142/371472 [3:17:59<4:30:26,  3.16it/s]
 86%|████████▌ | 320143/371472 [3:17:59<4:10:35,  3.41it/s]
 86%|████████▌ | 320144/371472 [3:17:59<4:00:23,  3.56it/s]
 86%|████████▌ | 320145/371472 [3:17:59<3:55:32,  3.63it/s]
 86%|████████▌ | 320146/371472 [3:18:00<4:25:27,  3.22it/s]
 86%|████████▌ | 320147/371472 [3:18:00<4:27:42,  3.20it/s]
 86%|████████▌ | 320148/371472 [3:18:00<4:29:59,  3.17it/s]
 86%|████████▌ | 320149/371472 [3:18:01<4:25:22,  3.22it/s]
 86%|████████▌ | 320150/371472 [3:18:01<4:17:40,  3.32it/s]
 86%|████████▌ | 320151/371472 [3:18:01<4:03:48,  3.51it/s]
 86%|████████▌ | 320152/371472 [3:18:02<4:34:21,  3.12it/s]
 86%|████████▌ | 320153/371472 [3:18:02<4:35:50,  3.10it/s]
 86%|████████▌ | 320154/371472 [3:18:02<4:27:34,  3.20it/s]
 86%|████████▌ | 320155/371472 [3:18:03<4:17:01,  3.33it/s]
 86%|████████▌ | 320156/371472 [3:18:03<4:14:32,  3.36it/s]
 86%|████████▌ | 320157/371472 [3:18:03<4:09:09,  3.43it/s]
 86%|████████▌ | 320158/371472 [3:18:03<4:15:10,  3.35it/s]
 86%|████████▌ | 320159/371472 [3:18:04<4:03:17,  3.52it/s]
 86%|████████▌ | 320160/371472 [3:18:04<3:55:50,  3.63it/s]
                                                           
{'loss': 2.5472, 'learning_rate': 2.2438535628865088e-07, 'epoch': 13.79}

 86%|████████▌ | 320160/371472 [3:18:04<3:55:50,  3.63it/s]
 86%|████████▌ | 320161/371472 [3:18:04<3:58:54,  3.58it/s]
 86%|████████▌ | 320162/371472 [3:18:04<3:57:16,  3.60it/s]
 86%|████████▌ | 320163/371472 [3:18:05<3:58:13,  3.59it/s]
 86%|████████▌ | 320164/371472 [3:18:05<3:56:56,  3.61it/s]
 86%|████████▌ | 320165/371472 [3:18:05<3:57:27,  3.60it/s]
 86%|████████▌ | 320166/371472 [3:18:06<4:21:37,  3.27it/s]
 86%|████████▌ | 320167/371472 [3:18:06<4:09:55,  3.42it/s]
 86%|████████▌ | 320168/371472 [3:18:06<4:08:48,  3.44it/s]
 86%|████████▌ | 320169/371472 [3:18:07<4:11:58,  3.39it/s]
 86%|████████▌ | 320170/371472 [3:18:07<4:16:53,  3.33it/s]
 86%|████████▌ | 320171/371472 [3:18:07<3:58:01,  3.59it/s]
 86%|████████▌ | 320172/371472 [3:18:07<4:10:23,  3.41it/s]
 86%|████████▌ | 320173/371472 [3:18:08<4:18:50,  3.30it/s]
 86%|████████▌ | 320174/371472 [3:18:08<4:02:50,  3.52it/s]
 86%|████████▌ | 320175/371472 [3:18:08<3:54:43,  3.64it/s]
 86%|████████▌ | 320176/371472 [3:18:09<3:54:59,  3.64it/s]
 86%|████████▌ | 320177/371472 [3:18:09<3:47:16,  3.76it/s]
 86%|████████▌ | 320178/371472 [3:18:09<3:47:32,  3.76it/s]
 86%|████████▌ | 320179/371472 [3:18:09<3:44:12,  3.81it/s]
 86%|████████▌ | 320180/371472 [3:18:10<3:43:19,  3.83it/s]
                                                           
{'loss': 2.7108, 'learning_rate': 2.2433687431317206e-07, 'epoch': 13.79}

 86%|████████▌ | 320180/371472 [3:18:10<3:43:19,  3.83it/s]
 86%|████████▌ | 320181/371472 [3:18:10<3:53:05,  3.67it/s]
 86%|████████▌ | 320182/371472 [3:18:10<3:52:22,  3.68it/s]
 86%|████████▌ | 320183/371472 [3:18:10<3:49:54,  3.72it/s]
 86%|████████▌ | 320184/371472 [3:18:11<4:03:34,  3.51it/s]
 86%|████████▌ | 320185/371472 [3:18:11<3:58:51,  3.58it/s]
 86%|████████▌ | 320186/371472 [3:18:11<3:54:59,  3.64it/s]
 86%|████████▌ | 320187/371472 [3:18:11<3:54:10,  3.65it/s]
 86%|████████▌ | 320188/371472 [3:18:12<3:53:36,  3.66it/s]
 86%|████████▌ | 320189/371472 [3:18:12<3:46:38,  3.77it/s]
 86%|████████▌ | 320190/371472 [3:18:12<3:51:14,  3.70it/s]
 86%|████████▌ | 320191/371472 [3:18:13<3:45:01,  3.80it/s]
 86%|████████▌ | 320192/371472 [3:18:13<3:44:08,  3.81it/s]
 86%|████████▌ | 320193/371472 [3:18:13<4:00:50,  3.55it/s]
 86%|████████▌ | 320194/371472 [3:18:13<4:00:47,  3.55it/s]
 86%|████████▌ | 320195/371472 [3:18:14<3:53:49,  3.66it/s]
 86%|████████▌ | 320196/371472 [3:18:14<3:48:20,  3.74it/s]
 86%|████████▌ | 320197/371472 [3:18:14<3:45:58,  3.78it/s]
 86%|████████▌ | 320198/371472 [3:18:14<3:44:03,  3.81it/s]
 86%|████████▌ | 320199/371472 [3:18:15<3:43:37,  3.82it/s]
 86%|████████▌ | 320200/371472 [3:18:15<4:01:34,  3.54it/s]
                                                           
{'loss': 2.6205, 'learning_rate': 2.242883923376931e-07, 'epoch': 13.79}

 86%|████████▌ | 320200/371472 [3:18:15<4:01:34,  3.54it/s]
 86%|████████▌ | 320201/371472 [3:18:15<3:58:35,  3.58it/s]
 86%|████████▌ | 320202/371472 [3:18:16<3:57:49,  3.59it/s]
 86%|████████▌ | 320203/371472 [3:18:16<4:01:16,  3.54it/s]
 86%|████████▌ | 320204/371472 [3:18:16<4:01:18,  3.54it/s]
 86%|████████▌ | 320205/371472 [3:18:16<3:57:17,  3.60it/s]
 86%|████████▌ | 320206/371472 [3:18:17<3:59:46,  3.56it/s]
 86%|████████▌ | 320207/371472 [3:18:17<3:52:08,  3.68it/s]
 86%|████████▌ | 320208/371472 [3:18:17<4:01:17,  3.54it/s]
 86%|████████▌ | 320209/371472 [3:18:18<3:50:55,  3.70it/s]
 86%|████████▌ | 320210/371472 [3:18:18<4:14:15,  3.36it/s]
 86%|████████▌ | 320211/371472 [3:18:18<3:59:54,  3.56it/s]
 86%|████████▌ | 320212/371472 [3:18:18<4:03:38,  3.51it/s]
 86%|████████▌ | 320213/371472 [3:18:19<4:05:59,  3.47it/s]
 86%|████████▌ | 320214/371472 [3:18:19<4:04:53,  3.49it/s]
 86%|████████▌ | 320215/371472 [3:18:19<3:56:30,  3.61it/s]
 86%|████████▌ | 320216/371472 [3:18:19<3:51:35,  3.69it/s]
 86%|████████▌ | 320217/371472 [3:18:20<3:52:15,  3.68it/s]
 86%|████████▌ | 320218/371472 [3:18:20<3:53:40,  3.66it/s]
 86%|████████▌ | 320219/371472 [3:18:20<3:54:19,  3.65it/s]
 86%|████████▌ | 320220/371472 [3:18:21<3:58:03,  3.59it/s]
                                                           
{'loss': 2.6425, 'learning_rate': 2.2423991036221418e-07, 'epoch': 13.79}

 86%|████████▌ | 320220/371472 [3:18:21<3:58:03,  3.59it/s]
 86%|████████▌ | 320221/371472 [3:18:21<3:54:18,  3.65it/s]
 86%|████████▌ | 320222/371472 [3:18:21<4:12:04,  3.39it/s]
 86%|████████▌ | 320223/371472 [3:18:21<4:06:18,  3.47it/s]
 86%|████████▌ | 320224/371472 [3:18:22<3:54:31,  3.64it/s]
 86%|████████▌ | 320225/371472 [3:18:22<4:05:18,  3.48it/s]
 86%|████████▌ | 320226/371472 [3:18:22<4:12:58,  3.38it/s]
 86%|████████▌ | 320227/371472 [3:18:23<4:07:38,  3.45it/s]
 86%|████████▌ | 320228/371472 [3:18:23<4:11:30,  3.40it/s]
 86%|████████▌ | 320229/371472 [3:18:23<4:07:15,  3.45it/s]
 86%|████████▌ | 320230/371472 [3:18:23<3:58:58,  3.57it/s]
 86%|████████▌ | 320231/371472 [3:18:24<4:02:29,  3.52it/s]
 86%|████████▌ | 320232/371472 [3:18:24<4:10:47,  3.41it/s]
 86%|████████▌ | 320233/371472 [3:18:24<4:11:15,  3.40it/s]
 86%|████████▌ | 320234/371472 [3:18:25<4:04:38,  3.49it/s]
 86%|████████▌ | 320235/371472 [3:18:25<4:05:02,  3.48it/s]
 86%|████████▌ | 320236/371472 [3:18:25<4:19:37,  3.29it/s]
 86%|████████▌ | 320237/371472 [3:18:26<4:14:10,  3.36it/s]
 86%|████████▌ | 320238/371472 [3:18:26<4:01:55,  3.53it/s]
 86%|████████▌ | 320239/371472 [3:18:26<4:01:39,  3.53it/s]
 86%|████████▌ | 320240/371472 [3:18:26<3:56:38,  3.61it/s]
                                                           
{'loss': 2.5645, 'learning_rate': 2.2419142838673533e-07, 'epoch': 13.79}

 86%|████████▌ | 320240/371472 [3:18:26<3:56:38,  3.61it/s]
 86%|████████▌ | 320241/371472 [3:18:27<3:47:35,  3.75it/s]
 86%|████████▌ | 320242/371472 [3:18:27<4:06:58,  3.46it/s]
 86%|████████▌ | 320243/371472 [3:18:27<4:05:04,  3.48it/s]
 86%|████████▌ | 320244/371472 [3:18:27<3:57:29,  3.60it/s]
 86%|████████▌ | 320245/371472 [3:18:28<3:59:09,  3.57it/s]
 86%|████████▌ | 320246/371472 [3:18:28<3:59:39,  3.56it/s]
 86%|████████▌ | 320247/371472 [3:18:28<4:13:42,  3.37it/s]
 86%|████████▌ | 320248/371472 [3:18:29<4:00:58,  3.54it/s]
 86%|████████▌ | 320249/371472 [3:18:29<4:00:47,  3.55it/s]
 86%|████████▌ | 320250/371472 [3:18:29<3:54:14,  3.64it/s]
 86%|████████▌ | 320251/371472 [3:18:30<4:27:37,  3.19it/s]
 86%|████████▌ | 320252/371472 [3:18:30<4:13:25,  3.37it/s]
 86%|████████▌ | 320253/371472 [3:18:30<4:24:09,  3.23it/s]
 86%|████████▌ | 320254/371472 [3:18:30<4:23:32,  3.24it/s]
 86%|████████▌ | 320255/371472 [3:18:31<4:30:26,  3.16it/s]
 86%|████████▌ | 320256/371472 [3:18:31<4:29:50,  3.16it/s]
 86%|████████▌ | 320257/371472 [3:18:31<4:15:12,  3.34it/s]
 86%|████████▌ | 320258/371472 [3:18:32<4:05:41,  3.47it/s]
 86%|████████▌ | 320259/371472 [3:18:32<4:07:18,  3.45it/s]
 86%|████████▌ | 320260/371472 [3:18:32<4:01:06,  3.54it/s]
                                                           
{'loss': 2.4753, 'learning_rate': 2.2414294641125637e-07, 'epoch': 13.79}

 86%|████████▌ | 320260/371472 [3:18:32<4:01:06,  3.54it/s]
 86%|████████▌ | 320261/371472 [3:18:33<4:14:52,  3.35it/s]
 86%|████████▌ | 320262/371472 [3:18:33<4:05:35,  3.48it/s]
 86%|████████▌ | 320263/371472 [3:18:33<4:04:09,  3.50it/s]
 86%|████████▌ | 320264/371472 [3:18:34<5:00:01,  2.84it/s]
 86%|████████▌ | 320265/371472 [3:18:34<4:46:41,  2.98it/s]
 86%|████████▌ | 320266/371472 [3:18:34<4:34:56,  3.10it/s]
 86%|████████▌ | 320267/371472 [3:18:35<4:38:37,  3.06it/s]
 86%|████████▌ | 320268/371472 [3:18:35<4:27:27,  3.19it/s]
 86%|████████▌ | 320269/371472 [3:18:35<4:25:38,  3.21it/s]
 86%|████████▌ | 320270/371472 [3:18:35<4:10:58,  3.40it/s]
 86%|████████▌ | 320271/371472 [3:18:36<4:13:38,  3.36it/s]
 86%|████████▌ | 320272/371472 [3:18:36<4:06:18,  3.46it/s]
 86%|████████▌ | 320273/371472 [3:18:36<4:01:51,  3.53it/s]
 86%|████████▌ | 320274/371472 [3:18:36<3:57:16,  3.60it/s]
 86%|████████▌ | 320275/371472 [3:18:37<4:13:49,  3.36it/s]
 86%|████████▌ | 320276/371472 [3:18:37<4:34:40,  3.11it/s]
 86%|████████▌ | 320277/371472 [3:18:37<4:20:51,  3.27it/s]
 86%|████████▌ | 320278/371472 [3:18:38<4:07:42,  3.44it/s]
 86%|████████▌ | 320279/371472 [3:18:38<4:45:15,  2.99it/s]
 86%|████████▌ | 320280/371472 [3:18:38<4:33:17,  3.12it/s]
                                                           
{'loss': 2.5966, 'learning_rate': 2.2409446443577755e-07, 'epoch': 13.8}

 86%|████████▌ | 320280/371472 [3:18:38<4:33:17,  3.12it/s]
 86%|████████▌ | 320281/371472 [3:18:39<4:26:10,  3.21it/s]
 86%|████████▌ | 320282/371472 [3:18:39<4:12:42,  3.38it/s]
 86%|████████▌ | 320283/371472 [3:18:39<4:11:50,  3.39it/s]
 86%|████████▌ | 320284/371472 [3:18:40<3:58:42,  3.57it/s]
 86%|████████▌ | 320285/371472 [3:18:40<3:56:09,  3.61it/s]
 86%|████████▌ | 320286/371472 [3:18:40<3:54:01,  3.65it/s]
 86%|████████▌ | 320287/371472 [3:18:40<3:50:57,  3.69it/s]
 86%|████████▌ | 320288/371472 [3:18:41<3:56:50,  3.60it/s]
 86%|████████▌ | 320289/371472 [3:18:41<3:45:10,  3.79it/s]
 86%|████████▌ | 320290/371472 [3:18:41<3:41:09,  3.86it/s]
 86%|████████▌ | 320291/371472 [3:18:41<3:46:05,  3.77it/s]
 86%|████████▌ | 320292/371472 [3:18:42<3:58:45,  3.57it/s]
 86%|████████▌ | 320293/371472 [3:18:42<3:53:14,  3.66it/s]
 86%|████████▌ | 320294/371472 [3:18:42<3:57:20,  3.59it/s]
 86%|████████▌ | 320295/371472 [3:18:43<3:52:56,  3.66it/s]
 86%|████████▌ | 320296/371472 [3:18:43<3:53:04,  3.66it/s]
 86%|████████▌ | 320297/371472 [3:18:43<3:52:43,  3.66it/s]
 86%|████████▌ | 320298/371472 [3:18:43<3:56:24,  3.61it/s]
 86%|████████▌ | 320299/371472 [3:18:44<3:52:37,  3.67it/s]
 86%|████████▌ | 320300/371472 [3:18:44<3:50:46,  3.70it/s]
                                                           
{'loss': 2.5655, 'learning_rate': 2.240459824602986e-07, 'epoch': 13.8}

 86%|████████▌ | 320300/371472 [3:18:44<3:50:46,  3.70it/s]
 86%|████████▌ | 320301/371472 [3:18:44<3:57:43,  3.59it/s]
 86%|████████▌ | 320302/371472 [3:18:44<3:59:25,  3.56it/s]
 86%|████████▌ | 320303/371472 [3:18:45<3:51:44,  3.68it/s]
 86%|████████▌ | 320304/371472 [3:18:45<3:55:24,  3.62it/s]
 86%|████████▌ | 320305/371472 [3:18:45<3:45:47,  3.78it/s]
 86%|████████▌ | 320306/371472 [3:18:45<3:41:21,  3.85it/s]
 86%|████████▌ | 320307/371472 [3:18:46<3:41:09,  3.86it/s]
 86%|████████▌ | 320308/371472 [3:18:46<3:51:55,  3.68it/s]
 86%|████████▌ | 320309/371472 [3:18:46<3:53:22,  3.65it/s]
 86%|████████▌ | 320310/371472 [3:18:47<3:47:17,  3.75it/s]
 86%|████████▌ | 320311/371472 [3:18:47<3:42:52,  3.83it/s]
 86%|████████▌ | 320312/371472 [3:18:47<3:56:20,  3.61it/s]
 86%|████████▌ | 320313/371472 [3:18:47<4:11:29,  3.39it/s]
 86%|████████▌ | 320314/371472 [3:18:48<4:18:02,  3.30it/s]
 86%|████████▌ | 320315/371472 [3:18:48<4:34:01,  3.11it/s]
 86%|████████▌ | 320316/371472 [3:18:48<4:13:05,  3.37it/s]
 86%|████████▌ | 320317/371472 [3:18:49<4:11:09,  3.39it/s]
 86%|████████▌ | 320318/371472 [3:18:49<4:02:19,  3.52it/s]
 86%|████████▌ | 320319/371472 [3:18:49<3:52:06,  3.67it/s]
 86%|████████▌ | 320320/371472 [3:18:49<4:01:01,  3.54it/s]
                                                           
{'loss': 2.5414, 'learning_rate': 2.2399750048481975e-07, 'epoch': 13.8}

 86%|████████▌ | 320320/371472 [3:18:49<4:01:01,  3.54it/s]
 86%|████████▌ | 320321/371472 [3:18:50<3:58:07,  3.58it/s]
 86%|████████▌ | 320322/371472 [3:18:50<3:59:18,  3.56it/s]
 86%|████████▌ | 320323/371472 [3:18:50<3:53:05,  3.66it/s]
 86%|████████▌ | 320324/371472 [3:18:51<3:58:49,  3.57it/s]
 86%|████████▌ | 320325/371472 [3:18:51<3:56:41,  3.60it/s]
 86%|████████▌ | 320326/371472 [3:18:51<3:51:44,  3.68it/s]
 86%|████████▌ | 320327/371472 [3:18:51<3:51:58,  3.67it/s]
 86%|████████▌ | 320328/371472 [3:18:52<3:44:16,  3.80it/s]
 86%|████████▌ | 320329/371472 [3:18:52<3:38:27,  3.90it/s]
 86%|████████▌ | 320330/371472 [3:18:52<3:41:53,  3.84it/s]
 86%|████████▌ | 320331/371472 [3:18:52<4:00:19,  3.55it/s]
 86%|████████▌ | 320332/371472 [3:18:53<4:03:57,  3.49it/s]
 86%|████████▌ | 320333/371472 [3:18:53<3:57:08,  3.59it/s]
 86%|████████▌ | 320334/371472 [3:18:53<4:09:33,  3.42it/s]
 86%|████████▌ | 320335/371472 [3:18:54<4:03:24,  3.50it/s]
 86%|████████▌ | 320336/371472 [3:18:54<4:08:18,  3.43it/s]
 86%|████████▌ | 320337/371472 [3:18:54<3:54:22,  3.64it/s]
 86%|████████▌ | 320338/371472 [3:18:54<4:00:49,  3.54it/s]
 86%|████████▌ | 320339/371472 [3:18:55<3:59:56,  3.55it/s]
 86%|████████▌ | 320340/371472 [3:18:55<4:00:51,  3.54it/s]
                                                           
{'loss': 2.4954, 'learning_rate': 2.2394901850934082e-07, 'epoch': 13.8}

 86%|████████▌ | 320340/371472 [3:18:55<4:00:51,  3.54it/s]
 86%|████████▌ | 320341/371472 [3:18:55<3:49:58,  3.71it/s]
 86%|████████▌ | 320342/371472 [3:18:56<4:05:46,  3.47it/s]
 86%|████████▌ | 320343/371472 [3:18:56<3:56:05,  3.61it/s]
 86%|████████▌ | 320344/371472 [3:18:56<4:03:16,  3.50it/s]
 86%|████████▌ | 320345/371472 [3:18:57<4:20:13,  3.27it/s]
 86%|████████▌ | 320346/371472 [3:18:57<4:21:01,  3.26it/s]
 86%|████████▌ | 320347/371472 [3:18:57<4:27:25,  3.19it/s]
 86%|████████▌ | 320348/371472 [3:18:57<4:13:26,  3.36it/s]
 86%|████████▌ | 320349/371472 [3:18:58<4:06:58,  3.45it/s]
 86%|████████▌ | 320350/371472 [3:18:58<4:03:56,  3.49it/s]
 86%|████████▌ | 320351/371472 [3:18:58<4:08:11,  3.43it/s]
 86%|████████▌ | 320352/371472 [3:18:59<4:07:09,  3.45it/s]
 86%|████████▌ | 320353/371472 [3:18:59<4:12:08,  3.38it/s]
 86%|████████▌ | 320354/371472 [3:18:59<4:00:55,  3.54it/s]
 86%|████████▌ | 320355/371472 [3:18:59<3:54:10,  3.64it/s]
 86%|████████▌ | 320356/371472 [3:19:00<4:01:29,  3.53it/s]
 86%|████████▌ | 320357/371472 [3:19:00<4:05:30,  3.47it/s]
 86%|████████▌ | 320358/371472 [3:19:00<4:01:21,  3.53it/s]
 86%|████████▌ | 320359/371472 [3:19:01<4:06:20,  3.46it/s]
 86%|████████▌ | 320360/371472 [3:19:01<3:56:39,  3.60it/s]
                                                           
{'loss': 2.7249, 'learning_rate': 2.2390053653386194e-07, 'epoch': 13.8}

 86%|████████▌ | 320360/371472 [3:19:01<3:56:39,  3.60it/s]
 86%|████████▌ | 320361/371472 [3:19:01<4:12:52,  3.37it/s]
 86%|████████▌ | 320362/371472 [3:19:01<4:05:28,  3.47it/s]
 86%|████████▌ | 320363/371472 [3:19:02<4:09:52,  3.41it/s]
 86%|████████▌ | 320364/371472 [3:19:02<3:56:11,  3.61it/s]
 86%|████████▌ | 320365/371472 [3:19:02<3:59:49,  3.55it/s]
 86%|████████▌ | 320366/371472 [3:19:03<4:00:18,  3.54it/s]
 86%|████████▌ | 320367/371472 [3:19:03<4:00:38,  3.54it/s]
 86%|████████▌ | 320368/371472 [3:19:03<4:26:57,  3.19it/s]
 86%|████████▌ | 320369/371472 [3:19:03<4:20:44,  3.27it/s]
 86%|████████▌ | 320370/371472 [3:19:04<4:06:53,  3.45it/s]
 86%|████████▌ | 320371/371472 [3:19:04<4:07:55,  3.44it/s]
 86%|████████▌ | 320372/371472 [3:19:04<4:18:02,  3.30it/s]
 86%|████████▌ | 320373/371472 [3:19:05<4:04:59,  3.48it/s]
 86%|████████▌ | 320374/371472 [3:19:05<4:20:21,  3.27it/s]
 86%|████████▌ | 320375/371472 [3:19:05<4:04:48,  3.48it/s]
 86%|████████▌ | 320376/371472 [3:19:05<3:57:31,  3.59it/s]
 86%|████████▌ | 320377/371472 [3:19:06<4:10:44,  3.40it/s]
 86%|████████▌ | 320378/371472 [3:19:06<4:15:59,  3.33it/s]
 86%|████████▌ | 320379/371472 [3:19:06<4:06:58,  3.45it/s]
 86%|████████▌ | 320380/371472 [3:19:07<3:56:43,  3.60it/s]
                                                           
{'loss': 2.586, 'learning_rate': 2.2385205455838304e-07, 'epoch': 13.8}

 86%|████████▌ | 320380/371472 [3:19:07<3:56:43,  3.60it/s]
 86%|████████▌ | 320381/371472 [3:19:07<4:03:41,  3.49it/s]
 86%|████████▌ | 320382/371472 [3:19:07<4:11:00,  3.39it/s]
 86%|████████▌ | 320383/371472 [3:19:08<4:27:22,  3.18it/s]
 86%|████████▌ | 320384/371472 [3:19:08<4:10:21,  3.40it/s]
 86%|████████▌ | 320385/371472 [3:19:08<4:07:19,  3.44it/s]
 86%|████████▌ | 320386/371472 [3:19:08<4:01:57,  3.52it/s]
 86%|████████▌ | 320387/371472 [3:19:09<4:09:26,  3.41it/s]
 86%|████████▌ | 320388/371472 [3:19:09<4:06:10,  3.46it/s]
 86%|████████▌ | 320389/371472 [3:19:09<4:05:43,  3.46it/s]
 86%|████████▌ | 320390/371472 [3:19:10<3:58:43,  3.57it/s]
 86%|████████▌ | 320391/371472 [3:19:10<3:53:33,  3.65it/s]
 86%|████████▌ | 320392/371472 [3:19:10<3:45:15,  3.78it/s]
 86%|████████▌ | 320393/371472 [3:19:10<3:45:48,  3.77it/s]
 86%|████████▌ | 320394/371472 [3:19:11<3:48:45,  3.72it/s]
 86%|████████▋ | 320395/371472 [3:19:11<3:41:53,  3.84it/s]
 86%|████████▋ | 320396/371472 [3:19:11<3:51:11,  3.68it/s]
 86%|████████▋ | 320397/371472 [3:19:11<3:47:47,  3.74it/s]
 86%|████████▋ | 320398/371472 [3:19:12<3:43:35,  3.81it/s]
 86%|████████▋ | 320399/371472 [3:19:12<3:44:34,  3.79it/s]
 86%|████████▋ | 320400/371472 [3:19:12<3:40:50,  3.85it/s]
                                                           
{'loss': 2.5719, 'learning_rate': 2.238035725829042e-07, 'epoch': 13.8}

 86%|████████▋ | 320400/371472 [3:19:12<3:40:50,  3.85it/s]
 86%|████████▋ | 320401/371472 [3:19:12<3:36:45,  3.93it/s]
 86%|████████▋ | 320402/371472 [3:19:13<3:35:43,  3.95it/s]
 86%|████████▋ | 320403/371472 [3:19:13<3:44:01,  3.80it/s]
 86%|████████▋ | 320404/371472 [3:19:13<3:46:42,  3.75it/s]
 86%|████████▋ | 320405/371472 [3:19:14<4:06:16,  3.46it/s]
 86%|████████▋ | 320406/371472 [3:19:14<3:55:22,  3.62it/s]
 86%|████████▋ | 320407/371472 [3:19:14<4:03:04,  3.50it/s]
 86%|████████▋ | 320408/371472 [3:19:14<4:05:31,  3.47it/s]
 86%|████████▋ | 320409/371472 [3:19:15<4:01:56,  3.52it/s]
 86%|████████▋ | 320410/371472 [3:19:15<3:56:40,  3.60it/s]
 86%|████████▋ | 320411/371472 [3:19:15<3:46:10,  3.76it/s]
 86%|████████▋ | 320412/371472 [3:19:16<4:02:31,  3.51it/s]
 86%|████████▋ | 320413/371472 [3:19:16<4:03:01,  3.50it/s]
 86%|████████▋ | 320414/371472 [3:19:16<4:07:36,  3.44it/s]
 86%|████████▋ | 320415/371472 [3:19:16<3:58:41,  3.56it/s]
 86%|████████▋ | 320416/371472 [3:19:17<4:08:04,  3.43it/s]
 86%|████████▋ | 320417/371472 [3:19:17<4:10:28,  3.40it/s]
 86%|████████▋ | 320418/371472 [3:19:17<4:09:44,  3.41it/s]
 86%|████████▋ | 320419/371472 [3:19:18<4:00:24,  3.54it/s]
 86%|████████▋ | 320420/371472 [3:19:18<4:03:16,  3.50it/s]
                                                           
{'loss': 2.6848, 'learning_rate': 2.2375509060742524e-07, 'epoch': 13.8}

 86%|████████▋ | 320420/371472 [3:19:18<4:03:16,  3.50it/s]
 86%|████████▋ | 320421/371472 [3:19:18<3:55:59,  3.61it/s]
 86%|████████▋ | 320422/371472 [3:19:18<3:49:58,  3.70it/s]
 86%|████████▋ | 320423/371472 [3:19:19<4:11:03,  3.39it/s]
 86%|████████▋ | 320424/371472 [3:19:19<3:59:44,  3.55it/s]
 86%|████████▋ | 320425/371472 [3:19:19<3:53:12,  3.65it/s]
 86%|████████▋ | 320426/371472 [3:19:19<3:51:55,  3.67it/s]
 86%|████████▋ | 320427/371472 [3:19:20<3:57:42,  3.58it/s]
 86%|████████▋ | 320428/371472 [3:19:20<4:09:12,  3.41it/s]
 86%|████████▋ | 320429/371472 [3:19:20<4:10:10,  3.40it/s]
 86%|████████▋ | 320430/371472 [3:19:21<4:03:29,  3.49it/s]
 86%|████████▋ | 320431/371472 [3:19:21<4:15:16,  3.33it/s]
 86%|████████▋ | 320432/371472 [3:19:21<4:04:30,  3.48it/s]
 86%|████████▋ | 320433/371472 [3:19:22<4:07:56,  3.43it/s]
 86%|████████▋ | 320434/371472 [3:19:22<4:06:24,  3.45it/s]
 86%|████████▋ | 320435/371472 [3:19:22<4:04:47,  3.47it/s]
 86%|████████▋ | 320436/371472 [3:19:22<4:04:08,  3.48it/s]
 86%|████████▋ | 320437/371472 [3:19:23<3:56:25,  3.60it/s]
 86%|████████▋ | 320438/371472 [3:19:23<3:54:23,  3.63it/s]
 86%|████████▋ | 320439/371472 [3:19:23<3:51:26,  3.67it/s]
 86%|████████▋ | 320440/371472 [3:19:23<3:57:15,  3.58it/s]
                                                           
{'loss': 2.6738, 'learning_rate': 2.2370660863194641e-07, 'epoch': 13.8}

 86%|████████▋ | 320440/371472 [3:19:23<3:57:15,  3.58it/s]
 86%|████████▋ | 320441/371472 [3:19:24<3:49:39,  3.70it/s]
 86%|████████▋ | 320442/371472 [3:19:24<3:46:03,  3.76it/s]
 86%|████████▋ | 320443/371472 [3:19:24<3:54:46,  3.62it/s]
 86%|████████▋ | 320444/371472 [3:19:25<3:49:40,  3.70it/s]
 86%|████████▋ | 320445/371472 [3:19:25<3:44:28,  3.79it/s]
 86%|████████▋ | 320446/371472 [3:19:25<3:47:17,  3.74it/s]
 86%|████████▋ | 320447/371472 [3:19:25<4:08:01,  3.43it/s]
 86%|████████▋ | 320448/371472 [3:19:26<4:07:59,  3.43it/s]
 86%|████████▋ | 320449/371472 [3:19:26<4:35:34,  3.09it/s]
 86%|████████▋ | 320450/371472 [3:19:26<4:40:48,  3.03it/s]
 86%|████████▋ | 320451/371472 [3:19:27<4:23:47,  3.22it/s]
 86%|████████▋ | 320452/371472 [3:19:27<4:20:55,  3.26it/s]
 86%|████████▋ | 320453/371472 [3:19:27<4:11:26,  3.38it/s]
 86%|████████▋ | 320454/371472 [3:19:28<4:09:01,  3.41it/s]
 86%|████████▋ | 320455/371472 [3:19:28<4:06:42,  3.45it/s]
 86%|████████▋ | 320456/371472 [3:19:28<4:00:59,  3.53it/s]
 86%|████████▋ | 320457/371472 [3:19:28<3:56:58,  3.59it/s]
 86%|████████▋ | 320458/371472 [3:19:29<4:02:33,  3.51it/s]
 86%|████████▋ | 320459/371472 [3:19:29<4:09:28,  3.41it/s]
 86%|████████▋ | 320460/371472 [3:19:29<4:07:44,  3.43it/s]
                                                           
{'loss': 2.5619, 'learning_rate': 2.2365812665646746e-07, 'epoch': 13.8}

 86%|████████▋ | 320460/371472 [3:19:29<4:07:44,  3.43it/s]
 86%|████████▋ | 320461/371472 [3:19:30<4:00:11,  3.54it/s]
 86%|████████▋ | 320462/371472 [3:19:30<4:02:46,  3.50it/s]
 86%|████████▋ | 320463/371472 [3:19:30<4:06:32,  3.45it/s]
 86%|████████▋ | 320464/371472 [3:19:30<4:10:38,  3.39it/s]
 86%|████████▋ | 320465/371472 [3:19:31<4:04:54,  3.47it/s]
 86%|████████▋ | 320466/371472 [3:19:31<4:02:33,  3.50it/s]
 86%|████████▋ | 320467/371472 [3:19:31<3:51:38,  3.67it/s]
 86%|████████▋ | 320468/371472 [3:19:32<3:51:52,  3.67it/s]
 86%|████████▋ | 320469/371472 [3:19:32<3:55:02,  3.62it/s]
 86%|████████▋ | 320470/371472 [3:19:32<3:56:38,  3.59it/s]
 86%|████████▋ | 320471/371472 [3:19:32<3:48:01,  3.73it/s]
 86%|████████▋ | 320472/371472 [3:19:33<3:44:49,  3.78it/s]
 86%|████████▋ | 320473/371472 [3:19:33<3:47:23,  3.74it/s]
 86%|████████▋ | 320474/371472 [3:19:33<3:45:34,  3.77it/s]
 86%|████████▋ | 320475/371472 [3:19:33<3:58:56,  3.56it/s]
 86%|████████▋ | 320476/371472 [3:19:34<3:48:19,  3.72it/s]
 86%|████████▋ | 320477/371472 [3:19:34<3:50:52,  3.68it/s]
 86%|████████▋ | 320478/371472 [3:19:34<3:49:54,  3.70it/s]
 86%|████████▋ | 320479/371472 [3:19:35<3:52:31,  3.66it/s]
 86%|████████▋ | 320480/371472 [3:19:35<4:00:28,  3.53it/s]
                                                           
{'loss': 2.5595, 'learning_rate': 2.236096446809886e-07, 'epoch': 13.8}

 86%|████████▋ | 320480/371472 [3:19:35<4:00:28,  3.53it/s]
 86%|████████▋ | 320481/371472 [3:19:35<4:00:40,  3.53it/s]
 86%|████████▋ | 320482/371472 [3:19:35<4:12:37,  3.36it/s]
 86%|████████▋ | 320483/371472 [3:19:36<4:02:02,  3.51it/s]
 86%|████████▋ | 320484/371472 [3:19:36<4:01:33,  3.52it/s]
 86%|████████▋ | 320485/371472 [3:19:36<4:01:59,  3.51it/s]
 86%|████████▋ | 320486/371472 [3:19:37<3:58:46,  3.56it/s]
 86%|████████▋ | 320487/371472 [3:19:37<3:50:25,  3.69it/s]
 86%|████████▋ | 320488/371472 [3:19:37<3:56:05,  3.60it/s]
 86%|████████▋ | 320489/371472 [3:19:37<3:47:02,  3.74it/s]
 86%|████████▋ | 320490/371472 [3:19:38<3:42:48,  3.81it/s]
 86%|████████▋ | 320491/371472 [3:19:38<3:50:17,  3.69it/s]
 86%|████████▋ | 320492/371472 [3:19:38<4:22:46,  3.23it/s]
 86%|████████▋ | 320493/371472 [3:19:39<4:17:49,  3.30it/s]
 86%|████████▋ | 320494/371472 [3:19:39<4:22:29,  3.24it/s]
 86%|████████▋ | 320495/371472 [3:19:39<4:14:36,  3.34it/s]
 86%|████████▋ | 320496/371472 [3:19:39<4:03:12,  3.49it/s]
 86%|████████▋ | 320497/371472 [3:19:40<4:01:08,  3.52it/s]
 86%|████████▋ | 320498/371472 [3:19:40<4:00:50,  3.53it/s]
 86%|████████▋ | 320499/371472 [3:19:40<3:50:07,  3.69it/s]
 86%|████████▋ | 320500/371472 [3:19:40<3:50:00,  3.69it/s]
                                                           
{'loss': 2.6241, 'learning_rate': 2.2356116270550968e-07, 'epoch': 13.8}

 86%|████████▋ | 320500/371472 [3:19:40<3:50:00,  3.69it/s]
 86%|████████▋ | 320501/371472 [3:19:41<3:47:58,  3.73it/s]
 86%|████████▋ | 320502/371472 [3:19:41<3:57:32,  3.58it/s]
 86%|████████▋ | 320503/371472 [3:19:41<3:54:44,  3.62it/s]
 86%|████████▋ | 320504/371472 [3:19:42<3:50:17,  3.69it/s]
 86%|████████▋ | 320505/371472 [3:19:42<3:48:21,  3.72it/s]
 86%|████████▋ | 320506/371472 [3:19:42<3:44:41,  3.78it/s]
 86%|████████▋ | 320507/371472 [3:19:42<3:40:04,  3.86it/s]
 86%|████████▋ | 320508/371472 [3:19:43<3:39:23,  3.87it/s]
 86%|████████▋ | 320509/371472 [3:19:43<3:45:03,  3.77it/s]
 86%|████████▋ | 320510/371472 [3:19:43<3:45:04,  3.77it/s]
 86%|████████▋ | 320511/371472 [3:19:43<3:48:57,  3.71it/s]
 86%|████████▋ | 320512/371472 [3:19:44<3:48:07,  3.72it/s]
 86%|████████▋ | 320513/371472 [3:19:44<3:50:09,  3.69it/s]
 86%|████████▋ | 320514/371472 [3:19:44<3:47:23,  3.74it/s]
 86%|████████▋ | 320515/371472 [3:19:44<3:45:08,  3.77it/s]
 86%|████████▋ | 320516/371472 [3:19:45<3:47:54,  3.73it/s]
 86%|████████▋ | 320517/371472 [3:19:45<3:42:50,  3.81it/s]
 86%|████████▋ | 320518/371472 [3:19:45<3:45:38,  3.76it/s]
 86%|████████▋ | 320519/371472 [3:19:46<3:42:42,  3.81it/s]
 86%|████████▋ | 320520/371472 [3:19:46<4:03:23,  3.49it/s]
                                                           
{'loss': 2.6352, 'learning_rate': 2.2351268073003083e-07, 'epoch': 13.81}

 86%|████████▋ | 320520/371472 [3:19:46<4:03:23,  3.49it/s]
 86%|████████▋ | 320521/371472 [3:19:46<4:08:14,  3.42it/s]
 86%|████████▋ | 320522/371472 [3:19:46<3:52:51,  3.65it/s]
 86%|████████▋ | 320523/371472 [3:19:47<4:06:46,  3.44it/s]
 86%|████████▋ | 320524/371472 [3:19:47<4:05:56,  3.45it/s]
 86%|████████▋ | 320525/371472 [3:19:47<4:04:52,  3.47it/s]
 86%|████████▋ | 320526/371472 [3:19:48<3:56:50,  3.59it/s]
 86%|████████▋ | 320527/371472 [3:19:48<4:23:29,  3.22it/s]
 86%|████████▋ | 320528/371472 [3:19:48<4:43:27,  3.00it/s]
 86%|████████▋ | 320529/371472 [3:19:49<4:41:55,  3.01it/s]
 86%|████████▋ | 320530/371472 [3:19:49<4:53:32,  2.89it/s]
 86%|████████▋ | 320531/371472 [3:19:49<4:44:43,  2.98it/s]
 86%|████████▋ | 320532/371472 [3:19:50<4:27:12,  3.18it/s]
 86%|████████▋ | 320533/371472 [3:19:50<4:11:42,  3.37it/s]
 86%|████████▋ | 320534/371472 [3:19:50<4:03:25,  3.49it/s]
 86%|████████▋ | 320535/371472 [3:19:50<3:59:41,  3.54it/s]
 86%|████████▋ | 320536/371472 [3:19:51<3:51:51,  3.66it/s]
 86%|████████▋ | 320537/371472 [3:19:51<3:47:14,  3.74it/s]
 86%|████████▋ | 320538/371472 [3:19:51<4:05:35,  3.46it/s]
 86%|████████▋ | 320539/371472 [3:19:52<3:56:32,  3.59it/s]
 86%|████████▋ | 320540/371472 [3:19:52<3:48:59,  3.71it/s]
                                                           
{'loss': 2.7458, 'learning_rate': 2.234641987545519e-07, 'epoch': 13.81}

 86%|████████▋ | 320540/371472 [3:19:52<3:48:59,  3.71it/s]
 86%|████████▋ | 320541/371472 [3:19:52<3:55:59,  3.60it/s]
 86%|████████▋ | 320542/371472 [3:19:52<4:06:20,  3.45it/s]
 86%|████████▋ | 320543/371472 [3:19:53<3:58:17,  3.56it/s]
 86%|████████▋ | 320544/371472 [3:19:53<4:04:41,  3.47it/s]
 86%|████████▋ | 320545/371472 [3:19:53<4:01:18,  3.52it/s]
 86%|████████▋ | 320546/371472 [3:19:53<3:52:14,  3.65it/s]
 86%|████████▋ | 320547/371472 [3:19:54<4:14:15,  3.34it/s]
 86%|████████▋ | 320548/371472 [3:19:54<4:04:16,  3.47it/s]
 86%|████████▋ | 320549/371472 [3:19:54<3:54:46,  3.62it/s]
 86%|████████▋ | 320550/371472 [3:19:55<3:46:27,  3.75it/s]
 86%|████████▋ | 320551/371472 [3:19:55<4:17:19,  3.30it/s]
 86%|████████▋ | 320552/371472 [3:19:55<4:06:18,  3.45it/s]
 86%|████████▋ | 320553/371472 [3:19:55<3:59:52,  3.54it/s]
 86%|████████▋ | 320554/371472 [3:19:56<3:48:49,  3.71it/s]
 86%|████████▋ | 320555/371472 [3:19:56<3:52:19,  3.65it/s]
 86%|████████▋ | 320556/371472 [3:19:56<3:54:13,  3.62it/s]
 86%|████████▋ | 320557/371472 [3:19:57<3:54:09,  3.62it/s]
 86%|████████▋ | 320558/371472 [3:19:57<3:46:54,  3.74it/s]
 86%|████████▋ | 320559/371472 [3:19:57<4:01:53,  3.51it/s]
 86%|████████▋ | 320560/371472 [3:19:57<3:52:34,  3.65it/s]
                                                           
{'loss': 2.6644, 'learning_rate': 2.2341571677907305e-07, 'epoch': 13.81}

 86%|████████▋ | 320560/371472 [3:19:57<3:52:34,  3.65it/s]
 86%|████████▋ | 320561/371472 [3:19:58<3:46:02,  3.75it/s]
 86%|████████▋ | 320562/371472 [3:19:58<3:42:30,  3.81it/s]
 86%|████████▋ | 320563/371472 [3:19:58<4:00:36,  3.53it/s]
 86%|████████▋ | 320564/371472 [3:19:58<3:55:04,  3.61it/s]
 86%|████████▋ | 320565/371472 [3:19:59<3:57:12,  3.58it/s]
 86%|████████▋ | 320566/371472 [3:19:59<4:06:35,  3.44it/s]
 86%|████████▋ | 320567/371472 [3:19:59<4:13:39,  3.34it/s]
 86%|████████▋ | 320568/371472 [3:20:00<4:28:42,  3.16it/s]
 86%|████████▋ | 320569/371472 [3:20:00<4:18:00,  3.29it/s]
 86%|████████▋ | 320570/371472 [3:20:00<4:03:41,  3.48it/s]
 86%|████████▋ | 320571/371472 [3:20:01<3:56:50,  3.58it/s]
 86%|████████▋ | 320572/371472 [3:20:01<3:50:56,  3.67it/s]
 86%|████████▋ | 320573/371472 [3:20:01<3:54:47,  3.61it/s]
 86%|████████▋ | 320574/371472 [3:20:01<4:06:08,  3.45it/s]
 86%|████████▋ | 320575/371472 [3:20:02<4:01:36,  3.51it/s]
 86%|████████▋ | 320576/371472 [3:20:02<4:07:22,  3.43it/s]
 86%|████████▋ | 320577/371472 [3:20:02<4:00:53,  3.52it/s]
 86%|████████▋ | 320578/371472 [3:20:03<4:04:19,  3.47it/s]
 86%|████████▋ | 320579/371472 [3:20:03<4:01:09,  3.52it/s]
 86%|████████▋ | 320580/371472 [3:20:03<3:58:36,  3.55it/s]
                                                           
{'loss': 2.591, 'learning_rate': 2.233672348035941e-07, 'epoch': 13.81}

 86%|████████▋ | 320580/371472 [3:20:03<3:58:36,  3.55it/s]
 86%|████████▋ | 320581/371472 [3:20:03<4:03:25,  3.48it/s]
 86%|████████▋ | 320582/371472 [3:20:04<4:04:08,  3.47it/s]
 86%|████████▋ | 320583/371472 [3:20:04<4:22:26,  3.23it/s]
 86%|████████▋ | 320584/371472 [3:20:04<4:15:38,  3.32it/s]
 86%|████████▋ | 320585/371472 [3:20:05<4:07:14,  3.43it/s]
 86%|████████▋ | 320586/371472 [3:20:05<4:10:23,  3.39it/s]
 86%|████████▋ | 320587/371472 [3:20:05<4:01:41,  3.51it/s]
 86%|████████▋ | 320588/371472 [3:20:05<4:09:40,  3.40it/s]
 86%|████████▋ | 320589/371472 [3:20:06<3:58:23,  3.56it/s]
 86%|████████▋ | 320590/371472 [3:20:06<4:03:28,  3.48it/s]
 86%|████████▋ | 320591/371472 [3:20:06<4:08:03,  3.42it/s]
 86%|████████▋ | 320592/371472 [3:20:07<4:00:58,  3.52it/s]
 86%|████████▋ | 320593/371472 [3:20:07<4:08:31,  3.41it/s]
 86%|████████▋ | 320594/371472 [3:20:07<3:57:52,  3.56it/s]
 86%|████████▋ | 320595/371472 [3:20:07<4:06:40,  3.44it/s]
 86%|████████▋ | 320596/371472 [3:20:08<4:10:30,  3.38it/s]
 86%|████████▋ | 320597/371472 [3:20:08<4:16:21,  3.31it/s]
 86%|████████▋ | 320598/371472 [3:20:08<4:06:39,  3.44it/s]
 86%|████████▋ | 320599/371472 [3:20:09<4:06:41,  3.44it/s]
 86%|████████▋ | 320600/371472 [3:20:09<3:59:29,  3.54it/s]
                                                           
{'loss': 2.5078, 'learning_rate': 2.2331875282811528e-07, 'epoch': 13.81}

 86%|████████▋ | 320600/371472 [3:20:09<3:59:29,  3.54it/s]
 86%|████████▋ | 320601/371472 [3:20:09<4:07:32,  3.43it/s]
 86%|████████▋ | 320602/371472 [3:20:10<4:20:07,  3.26it/s]
 86%|████████▋ | 320603/371472 [3:20:10<4:19:18,  3.27it/s]
 86%|████████▋ | 320604/371472 [3:20:10<4:15:50,  3.31it/s]
 86%|████████▋ | 320605/371472 [3:20:10<4:01:54,  3.50it/s]
 86%|████████▋ | 320606/371472 [3:20:11<4:03:06,  3.49it/s]
 86%|████████▋ | 320607/371472 [3:20:11<3:55:49,  3.59it/s]
 86%|████████▋ | 320608/371472 [3:20:11<4:09:04,  3.40it/s]
 86%|████████▋ | 320609/371472 [3:20:12<4:09:59,  3.39it/s]
 86%|████████▋ | 320610/371472 [3:20:12<3:56:52,  3.58it/s]
 86%|████████▋ | 320611/371472 [3:20:12<4:02:53,  3.49it/s]
 86%|████████▋ | 320612/371472 [3:20:12<3:54:13,  3.62it/s]
 86%|████████▋ | 320613/371472 [3:20:13<4:22:37,  3.23it/s]
 86%|████████▋ | 320614/371472 [3:20:13<4:11:08,  3.38it/s]
 86%|████████▋ | 320615/371472 [3:20:13<3:59:59,  3.53it/s]
 86%|████████▋ | 320616/371472 [3:20:14<3:54:24,  3.62it/s]
 86%|████████▋ | 320617/371472 [3:20:14<3:57:17,  3.57it/s]
 86%|████████▋ | 320618/371472 [3:20:14<3:50:39,  3.67it/s]
 86%|████████▋ | 320619/371472 [3:20:14<3:45:56,  3.75it/s]
 86%|████████▋ | 320620/371472 [3:20:15<3:44:34,  3.77it/s]
                                                           
{'loss': 2.6281, 'learning_rate': 2.2327027085263632e-07, 'epoch': 13.81}

 86%|████████▋ | 320620/371472 [3:20:15<3:44:34,  3.77it/s]
 86%|████████▋ | 320621/371472 [3:20:15<3:46:07,  3.75it/s]
 86%|████████▋ | 320622/371472 [3:20:15<3:50:54,  3.67it/s]
 86%|████████▋ | 320623/371472 [3:20:16<4:02:15,  3.50it/s]
 86%|████████▋ | 320624/371472 [3:20:16<4:10:43,  3.38it/s]
 86%|████████▋ | 320625/371472 [3:20:16<4:09:10,  3.40it/s]
 86%|████████▋ | 320626/371472 [3:20:16<3:59:30,  3.54it/s]
 86%|████████▋ | 320627/371472 [3:20:17<4:01:26,  3.51it/s]
 86%|████████▋ | 320628/371472 [3:20:17<4:01:02,  3.52it/s]
 86%|████████▋ | 320629/371472 [3:20:17<3:57:10,  3.57it/s]
 86%|████████▋ | 320630/371472 [3:20:18<4:04:31,  3.47it/s]
 86%|████████▋ | 320631/371472 [3:20:18<3:59:02,  3.54it/s]
 86%|████████▋ | 320632/371472 [3:20:18<3:57:15,  3.57it/s]
 86%|████████▋ | 320633/371472 [3:20:18<3:55:56,  3.59it/s]
 86%|████████▋ | 320634/371472 [3:20:19<4:13:55,  3.34it/s]
 86%|████████▋ | 320635/371472 [3:20:19<4:06:28,  3.44it/s]
 86%|████████▋ | 320636/371472 [3:20:19<4:11:33,  3.37it/s]
 86%|████████▋ | 320637/371472 [3:20:20<4:14:50,  3.32it/s]
 86%|████████▋ | 320638/371472 [3:20:20<4:38:57,  3.04it/s]
 86%|████████▋ | 320639/371472 [3:20:20<4:24:13,  3.21it/s]
 86%|████████▋ | 320640/371472 [3:20:21<4:27:44,  3.16it/s]
                                                           
{'loss': 2.6036, 'learning_rate': 2.2322178887715747e-07, 'epoch': 13.81}

 86%|████████▋ | 320640/371472 [3:20:21<4:27:44,  3.16it/s]
 86%|████████▋ | 320641/371472 [3:20:21<4:27:26,  3.17it/s]
 86%|████████▋ | 320642/371472 [3:20:21<4:18:02,  3.28it/s]
 86%|████████▋ | 320643/371472 [3:20:21<4:03:37,  3.48it/s]
 86%|████████▋ | 320644/371472 [3:20:22<3:55:38,  3.60it/s]
 86%|████████▋ | 320645/371472 [3:20:22<3:51:50,  3.65it/s]
 86%|████████▋ | 320646/371472 [3:20:22<3:54:43,  3.61it/s]
 86%|████████▋ | 320647/371472 [3:20:22<3:56:19,  3.58it/s]
 86%|████████▋ | 320648/371472 [3:20:23<4:01:06,  3.51it/s]
 86%|████████▋ | 320649/371472 [3:20:23<4:10:59,  3.37it/s]
 86%|████████▋ | 320650/371472 [3:20:23<4:00:02,  3.53it/s]
 86%|████████▋ | 320651/371472 [3:20:24<3:54:19,  3.61it/s]
 86%|████████▋ | 320652/371472 [3:20:24<4:01:38,  3.51it/s]
 86%|████████▋ | 320653/371472 [3:20:24<3:53:12,  3.63it/s]
 86%|████████▋ | 320654/371472 [3:20:25<4:15:51,  3.31it/s]
 86%|████████▋ | 320655/371472 [3:20:25<4:01:54,  3.50it/s]
 86%|████████▋ | 320656/371472 [3:20:25<4:04:40,  3.46it/s]
 86%|████████▋ | 320657/371472 [3:20:25<4:09:24,  3.40it/s]
 86%|████████▋ | 320658/371472 [3:20:26<3:57:21,  3.57it/s]
 86%|████████▋ | 320659/371472 [3:20:26<3:54:33,  3.61it/s]
 86%|████████▋ | 320660/371472 [3:20:26<4:10:01,  3.39it/s]
                                                           
{'loss': 2.5645, 'learning_rate': 2.2317330690167854e-07, 'epoch': 13.81}

 86%|████████▋ | 320660/371472 [3:20:26<4:10:01,  3.39it/s]
 86%|████████▋ | 320661/371472 [3:20:27<4:06:29,  3.44it/s]
 86%|████████▋ | 320662/371472 [3:20:27<4:07:29,  3.42it/s]
 86%|████████▋ | 320663/371472 [3:20:27<4:04:05,  3.47it/s]
 86%|████████▋ | 320664/371472 [3:20:27<4:01:38,  3.50it/s]
 86%|████████▋ | 320665/371472 [3:20:28<4:20:48,  3.25it/s]
 86%|████████▋ | 320666/371472 [3:20:28<4:05:35,  3.45it/s]
 86%|████████▋ | 320667/371472 [3:20:28<3:57:08,  3.57it/s]
 86%|████████▋ | 320668/371472 [3:20:29<3:57:37,  3.56it/s]
 86%|████████▋ | 320669/371472 [3:20:29<4:01:00,  3.51it/s]
 86%|████████▋ | 320670/371472 [3:20:29<3:51:17,  3.66it/s]
 86%|████████▋ | 320671/371472 [3:20:29<3:48:05,  3.71it/s]
 86%|████████▋ | 320672/371472 [3:20:30<3:53:45,  3.62it/s]
 86%|████████▋ | 320673/371472 [3:20:30<3:50:20,  3.68it/s]
 86%|████████▋ | 320674/371472 [3:20:30<3:59:40,  3.53it/s]
 86%|████████▋ | 320675/371472 [3:20:30<3:54:52,  3.60it/s]
 86%|████████▋ | 320676/371472 [3:20:31<3:53:36,  3.62it/s]
 86%|████████▋ | 320677/371472 [3:20:31<4:01:47,  3.50it/s]
 86%|████████▋ | 320678/371472 [3:20:32<4:44:48,  2.97it/s]
 86%|████████▋ | 320679/371472 [3:20:32<4:22:40,  3.22it/s]
 86%|████████▋ | 320680/371472 [3:20:32<4:22:32,  3.22it/s]
                                                           
{'loss': 2.5442, 'learning_rate': 2.231248249261997e-07, 'epoch': 13.81}

 86%|████████▋ | 320680/371472 [3:20:32<4:22:32,  3.22it/s]
 86%|████████▋ | 320681/371472 [3:20:32<4:22:03,  3.23it/s]
 86%|████████▋ | 320682/371472 [3:20:33<4:18:53,  3.27it/s]
 86%|████████▋ | 320683/371472 [3:20:33<4:00:07,  3.53it/s]
 86%|████████▋ | 320684/371472 [3:20:33<4:07:01,  3.43it/s]
 86%|████████▋ | 320685/371472 [3:20:34<4:06:19,  3.44it/s]
 86%|████████▋ | 320686/371472 [3:20:34<3:54:14,  3.61it/s]
 86%|████████▋ | 320687/371472 [3:20:34<4:34:37,  3.08it/s]
 86%|████████▋ | 320688/371472 [3:20:35<4:41:20,  3.01it/s]
 86%|████████▋ | 320689/371472 [3:20:35<4:22:26,  3.23it/s]
 86%|████████▋ | 320690/371472 [3:20:35<4:17:45,  3.28it/s]
 86%|████████▋ | 320691/371472 [3:20:35<4:20:09,  3.25it/s]
 86%|████████▋ | 320692/371472 [3:20:36<4:16:51,  3.29it/s]
 86%|████████▋ | 320693/371472 [3:20:36<4:09:31,  3.39it/s]
 86%|████████▋ | 320694/371472 [3:20:36<4:17:02,  3.29it/s]
 86%|████████▋ | 320695/371472 [3:20:37<4:32:22,  3.11it/s]
 86%|████████▋ | 320696/371472 [3:20:37<4:28:33,  3.15it/s]
 86%|████████▋ | 320697/371472 [3:20:37<4:58:38,  2.83it/s]
 86%|████████▋ | 320698/371472 [3:20:38<4:43:59,  2.98it/s]
 86%|████████▋ | 320699/371472 [3:20:38<4:28:31,  3.15it/s]
 86%|████████▋ | 320700/371472 [3:20:38<4:19:08,  3.27it/s]
                                                           
{'loss': 2.636, 'learning_rate': 2.2307634295072074e-07, 'epoch': 13.81}

 86%|████████▋ | 320700/371472 [3:20:38<4:19:08,  3.27it/s]
 86%|████████▋ | 320701/371472 [3:20:39<4:13:07,  3.34it/s]
 86%|████████▋ | 320702/371472 [3:20:39<4:45:39,  2.96it/s]
 86%|████████▋ | 320703/371472 [3:20:39<4:29:51,  3.14it/s]
 86%|████████▋ | 320704/371472 [3:20:40<4:20:57,  3.24it/s]
 86%|████████▋ | 320705/371472 [3:20:40<4:19:30,  3.26it/s]
 86%|████████▋ | 320706/371472 [3:20:40<4:02:11,  3.49it/s]
 86%|████████▋ | 320707/371472 [3:20:40<4:09:37,  3.39it/s]
 86%|████████▋ | 320708/371472 [3:20:41<4:05:00,  3.45it/s]
 86%|████████▋ | 320709/371472 [3:20:41<3:59:13,  3.54it/s]
 86%|████████▋ | 320710/371472 [3:20:41<3:57:05,  3.57it/s]
 86%|████████▋ | 320711/371472 [3:20:41<3:50:06,  3.68it/s]
 86%|████████▋ | 320712/371472 [3:20:42<3:49:31,  3.69it/s]
 86%|████████▋ | 320713/371472 [3:20:42<3:52:48,  3.63it/s]
 86%|████████▋ | 320714/371472 [3:20:42<3:54:30,  3.61it/s]
 86%|████████▋ | 320715/371472 [3:20:43<3:42:13,  3.81it/s]
 86%|████████▋ | 320716/371472 [3:20:43<3:42:34,  3.80it/s]
 86%|████████▋ | 320717/371472 [3:20:43<3:54:14,  3.61it/s]
 86%|████████▋ | 320718/371472 [3:20:43<3:52:24,  3.64it/s]
 86%|████████▋ | 320719/371472 [3:20:44<3:41:43,  3.82it/s]
 86%|████████▋ | 320720/371472 [3:20:44<3:48:00,  3.71it/s]
                                                           
{'loss': 2.5238, 'learning_rate': 2.2302786097524192e-07, 'epoch': 13.81}

 86%|████████▋ | 320720/371472 [3:20:44<3:48:00,  3.71it/s]
 86%|████████▋ | 320721/371472 [3:20:44<3:44:20,  3.77it/s]
 86%|████████▋ | 320722/371472 [3:20:44<3:42:14,  3.81it/s]
 86%|████████▋ | 320723/371472 [3:20:45<3:43:47,  3.78it/s]
 86%|████████▋ | 320724/371472 [3:20:45<3:44:05,  3.77it/s]
 86%|████████▋ | 320725/371472 [3:20:45<3:40:37,  3.83it/s]
 86%|████████▋ | 320726/371472 [3:20:46<4:02:41,  3.48it/s]
 86%|████████▋ | 320727/371472 [3:20:46<4:06:53,  3.43it/s]
 86%|████████▋ | 320728/371472 [3:20:46<3:57:13,  3.57it/s]
 86%|████████▋ | 320729/371472 [3:20:46<4:08:34,  3.40it/s]
 86%|████████▋ | 320730/371472 [3:20:47<3:59:52,  3.53it/s]
 86%|████████▋ | 320731/371472 [3:20:47<4:00:38,  3.51it/s]
 86%|████████▋ | 320732/371472 [3:20:47<3:50:55,  3.66it/s]
 86%|████████▋ | 320733/371472 [3:20:47<3:48:23,  3.70it/s]
 86%|████████▋ | 320734/371472 [3:20:48<4:05:09,  3.45it/s]
 86%|████████▋ | 320735/371472 [3:20:48<3:58:00,  3.55it/s]
 86%|████████▋ | 320736/371472 [3:20:48<3:53:23,  3.62it/s]
 86%|████████▋ | 320737/371472 [3:20:49<4:15:52,  3.30it/s]
 86%|████████▋ | 320738/371472 [3:20:49<4:06:10,  3.43it/s]
 86%|████████▋ | 320739/371472 [3:20:49<3:59:40,  3.53it/s]
 86%|████████▋ | 320740/371472 [3:20:49<3:56:39,  3.57it/s]
                                                           
{'loss': 2.6757, 'learning_rate': 2.2297937899976296e-07, 'epoch': 13.81}

 86%|████████▋ | 320740/371472 [3:20:49<3:56:39,  3.57it/s]
 86%|████████▋ | 320741/371472 [3:20:50<3:49:51,  3.68it/s]
 86%|████████▋ | 320742/371472 [3:20:50<3:45:53,  3.74it/s]
 86%|████████▋ | 320743/371472 [3:20:50<3:56:50,  3.57it/s]
 86%|████████▋ | 320744/371472 [3:20:51<3:49:23,  3.69it/s]
 86%|████████▋ | 320745/371472 [3:20:51<3:52:48,  3.63it/s]
 86%|████████▋ | 320746/371472 [3:20:51<4:00:12,  3.52it/s]
 86%|████████▋ | 320747/371472 [3:20:51<3:50:49,  3.66it/s]
 86%|████████▋ | 320748/371472 [3:20:52<3:47:36,  3.71it/s]
 86%|████████▋ | 320749/371472 [3:20:52<3:51:28,  3.65it/s]
 86%|████████▋ | 320750/371472 [3:20:52<3:55:29,  3.59it/s]
 86%|████████▋ | 320751/371472 [3:20:52<3:51:28,  3.65it/s]
 86%|████████▋ | 320752/371472 [3:20:53<3:50:23,  3.67it/s]
 86%|████████▋ | 320753/371472 [3:20:53<3:50:17,  3.67it/s]
 86%|████████▋ | 320754/371472 [3:20:53<3:56:54,  3.57it/s]
 86%|████████▋ | 320755/371472 [3:20:54<3:56:10,  3.58it/s]
 86%|████████▋ | 320756/371472 [3:20:54<3:56:48,  3.57it/s]
 86%|████████▋ | 320757/371472 [3:20:54<3:51:07,  3.66it/s]
 86%|████████▋ | 320758/371472 [3:20:54<3:46:00,  3.74it/s]
 86%|████████▋ | 320759/371472 [3:20:55<4:31:52,  3.11it/s]
 86%|████████▋ | 320760/371472 [3:20:55<4:19:30,  3.26it/s]
                                                           
{'loss': 2.6606, 'learning_rate': 2.2293089702428403e-07, 'epoch': 13.82}

 86%|████████▋ | 320760/371472 [3:20:55<4:19:30,  3.26it/s]
 86%|████████▋ | 320761/371472 [3:20:55<4:09:00,  3.39it/s]
 86%|████████▋ | 320762/371472 [3:20:56<4:01:11,  3.50it/s]
 86%|████████▋ | 320763/371472 [3:20:56<4:04:20,  3.46it/s]
 86%|████████▋ | 320764/371472 [3:20:56<4:10:16,  3.38it/s]
 86%|████████▋ | 320765/371472 [3:20:57<4:03:56,  3.46it/s]
 86%|████████▋ | 320766/371472 [3:20:57<4:05:56,  3.44it/s]
 86%|████████▋ | 320767/371472 [3:20:57<3:54:45,  3.60it/s]
 86%|████████▋ | 320768/371472 [3:20:57<3:56:59,  3.57it/s]
 86%|████████▋ | 320769/371472 [3:20:58<3:48:30,  3.70it/s]
 86%|████████▋ | 320770/371472 [3:20:58<3:48:30,  3.70it/s]
 86%|████████▋ | 320771/371472 [3:20:58<3:44:25,  3.77it/s]
 86%|████████▋ | 320772/371472 [3:20:58<3:55:12,  3.59it/s]
 86%|████████▋ | 320773/371472 [3:20:59<3:55:17,  3.59it/s]
 86%|████████▋ | 320774/371472 [3:20:59<3:51:25,  3.65it/s]
 86%|████████▋ | 320775/371472 [3:20:59<4:26:21,  3.17it/s]
 86%|████████▋ | 320776/371472 [3:21:00<4:18:53,  3.26it/s]
 86%|████████▋ | 320777/371472 [3:21:00<4:18:39,  3.27it/s]
 86%|████████▋ | 320778/371472 [3:21:00<4:02:50,  3.48it/s]
 86%|████████▋ | 320779/371472 [3:21:00<3:52:25,  3.64it/s]
 86%|████████▋ | 320780/371472 [3:21:01<3:48:26,  3.70it/s]
                                                           
{'loss': 2.5454, 'learning_rate': 2.2288241504880518e-07, 'epoch': 13.82}

 86%|████████▋ | 320780/371472 [3:21:01<3:48:26,  3.70it/s]
 86%|████████▋ | 320781/371472 [3:21:01<4:41:36,  3.00it/s]
 86%|████████▋ | 320782/371472 [3:21:01<4:27:51,  3.15it/s]
 86%|████████▋ | 320783/371472 [3:21:02<4:22:11,  3.22it/s]
 86%|████████▋ | 320784/371472 [3:21:02<4:04:22,  3.46it/s]
 86%|████████▋ | 320785/371472 [3:21:02<3:59:03,  3.53it/s]
 86%|████████▋ | 320786/371472 [3:21:03<3:56:20,  3.57it/s]
 86%|████████▋ | 320787/371472 [3:21:03<3:53:09,  3.62it/s]
 86%|████████▋ | 320788/371472 [3:21:03<3:55:18,  3.59it/s]
 86%|████████▋ | 320789/371472 [3:21:03<4:01:27,  3.50it/s]
 86%|████████▋ | 320790/371472 [3:21:04<4:14:39,  3.32it/s]
 86%|████████▋ | 320791/371472 [3:21:04<4:02:09,  3.49it/s]
 86%|████████▋ | 320792/371472 [3:21:04<3:56:23,  3.57it/s]
 86%|████████▋ | 320793/371472 [3:21:05<3:53:35,  3.62it/s]
 86%|████████▋ | 320794/371472 [3:21:05<3:58:25,  3.54it/s]
 86%|████████▋ | 320795/371472 [3:21:05<3:52:17,  3.64it/s]
 86%|████████▋ | 320796/371472 [3:21:05<4:01:31,  3.50it/s]
 86%|████████▋ | 320797/371472 [3:21:06<3:52:50,  3.63it/s]
 86%|████████▋ | 320798/371472 [3:21:06<3:53:46,  3.61it/s]
 86%|████████▋ | 320799/371472 [3:21:06<4:04:01,  3.46it/s]
 86%|████████▋ | 320800/371472 [3:21:07<4:00:41,  3.51it/s]
                                                           
{'loss': 2.4819, 'learning_rate': 2.2283393307332623e-07, 'epoch': 13.82}

 86%|████████▋ | 320800/371472 [3:21:07<4:00:41,  3.51it/s]
 86%|████████▋ | 320801/371472 [3:21:07<4:00:31,  3.51it/s]
 86%|████████▋ | 320802/371472 [3:21:07<3:50:21,  3.67it/s]
 86%|████████▋ | 320803/371472 [3:21:07<3:41:58,  3.80it/s]
 86%|████████▋ | 320804/371472 [3:21:08<3:38:13,  3.87it/s]
 86%|████████▋ | 320805/371472 [3:21:08<3:33:29,  3.96it/s]
 86%|████████▋ | 320806/371472 [3:21:08<3:45:13,  3.75it/s]
 86%|████████▋ | 320807/371472 [3:21:08<3:46:15,  3.73it/s]
 86%|████████▋ | 320808/371472 [3:21:09<3:48:12,  3.70it/s]
 86%|████████▋ | 320809/371472 [3:21:09<3:40:15,  3.83it/s]
 86%|████████▋ | 320810/371472 [3:21:09<3:37:39,  3.88it/s]
 86%|████████▋ | 320811/371472 [3:21:09<3:47:55,  3.70it/s]
 86%|████████▋ | 320812/371472 [3:21:10<3:42:29,  3.79it/s]
 86%|████████▋ | 320813/371472 [3:21:10<3:40:48,  3.82it/s]
 86%|████████▋ | 320814/371472 [3:21:10<3:46:09,  3.73it/s]
 86%|████████▋ | 320815/371472 [3:21:11<4:01:45,  3.49it/s]
 86%|████████▋ | 320816/371472 [3:21:11<4:07:27,  3.41it/s]
 86%|████████▋ | 320817/371472 [3:21:11<4:07:30,  3.41it/s]
 86%|████████▋ | 320818/371472 [3:21:12<4:23:44,  3.20it/s]
 86%|████████▋ | 320819/371472 [3:21:12<4:23:45,  3.20it/s]
 86%|████████▋ | 320820/371472 [3:21:12<4:20:36,  3.24it/s]
                                                           
{'loss': 2.624, 'learning_rate': 2.227854510978474e-07, 'epoch': 13.82}

 86%|████████▋ | 320820/371472 [3:21:12<4:20:36,  3.24it/s]
 86%|████████▋ | 320821/371472 [3:21:12<4:08:34,  3.40it/s]
 86%|████████▋ | 320822/371472 [3:21:13<3:53:45,  3.61it/s]
 86%|████████▋ | 320823/371472 [3:21:13<3:51:58,  3.64it/s]
 86%|████████▋ | 320824/371472 [3:21:13<3:44:38,  3.76it/s]
 86%|████████▋ | 320825/371472 [3:21:13<3:46:32,  3.73it/s]
 86%|████████▋ | 320826/371472 [3:21:14<4:11:12,  3.36it/s]
 86%|████████▋ | 320827/371472 [3:21:14<4:02:33,  3.48it/s]
 86%|████████▋ | 320828/371472 [3:21:14<3:54:49,  3.59it/s]
 86%|████████▋ | 320829/371472 [3:21:15<3:58:13,  3.54it/s]
 86%|████████▋ | 320830/371472 [3:21:15<4:13:40,  3.33it/s]
 86%|████████▋ | 320831/371472 [3:21:15<4:14:02,  3.32it/s]
 86%|████████▋ | 320832/371472 [3:21:15<4:01:52,  3.49it/s]
 86%|████████▋ | 320833/371472 [3:21:16<3:53:45,  3.61it/s]
 86%|████████▋ | 320834/371472 [3:21:16<3:52:26,  3.63it/s]
 86%|████████▋ | 320835/371472 [3:21:16<4:06:25,  3.42it/s]
 86%|████████▋ | 320836/371472 [3:21:17<3:59:39,  3.52it/s]
 86%|████████▋ | 320837/371472 [3:21:17<4:00:46,  3.51it/s]
 86%|████████▋ | 320838/371472 [3:21:17<3:53:27,  3.61it/s]
 86%|████████▋ | 320839/371472 [3:21:17<3:54:43,  3.60it/s]
 86%|████████▋ | 320840/371472 [3:21:18<4:04:41,  3.45it/s]
                                                           
{'loss': 2.5421, 'learning_rate': 2.2273696912236845e-07, 'epoch': 13.82}

 86%|████████▋ | 320840/371472 [3:21:18<4:04:41,  3.45it/s]
 86%|████████▋ | 320841/371472 [3:21:18<4:04:10,  3.46it/s]
 86%|████████▋ | 320842/371472 [3:21:18<4:15:45,  3.30it/s]
 86%|████████▋ | 320843/371472 [3:21:19<3:59:39,  3.52it/s]
 86%|████████▋ | 320844/371472 [3:21:19<4:01:56,  3.49it/s]
 86%|████████▋ | 320845/371472 [3:21:19<4:03:34,  3.46it/s]
 86%|████████▋ | 320846/371472 [3:21:19<3:53:50,  3.61it/s]
 86%|████████▋ | 320847/371472 [3:21:20<4:35:32,  3.06it/s]
 86%|████████▋ | 320848/371472 [3:21:20<4:14:52,  3.31it/s]
 86%|████████▋ | 320849/371472 [3:21:20<4:09:10,  3.39it/s]
 86%|████████▋ | 320850/371472 [3:21:21<4:01:40,  3.49it/s]
 86%|████████▋ | 320851/371472 [3:21:21<3:48:24,  3.69it/s]
 86%|████████▋ | 320852/371472 [3:21:21<3:45:52,  3.74it/s]
 86%|████████▋ | 320853/371472 [3:21:21<3:45:06,  3.75it/s]
 86%|████████▋ | 320854/371472 [3:21:22<4:00:54,  3.50it/s]
 86%|████████▋ | 320855/371472 [3:21:22<4:04:48,  3.45it/s]
 86%|████████▋ | 320856/371472 [3:21:22<4:15:05,  3.31it/s]
 86%|████████▋ | 320857/371472 [3:21:23<4:14:24,  3.32it/s]
 86%|████████▋ | 320858/371472 [3:21:23<4:11:12,  3.36it/s]
 86%|████████▋ | 320859/371472 [3:21:23<4:02:14,  3.48it/s]
 86%|████████▋ | 320860/371472 [3:21:24<4:00:56,  3.50it/s]
                                                           
{'loss': 2.5411, 'learning_rate': 2.226884871468896e-07, 'epoch': 13.82}

 86%|████████▋ | 320860/371472 [3:21:24<4:00:56,  3.50it/s]
 86%|████████▋ | 320861/371472 [3:21:24<3:57:51,  3.55it/s]
 86%|████████▋ | 320862/371472 [3:21:24<3:47:30,  3.71it/s]
 86%|████████▋ | 320863/371472 [3:21:24<3:47:25,  3.71it/s]
 86%|████████▋ | 320864/371472 [3:21:25<3:50:51,  3.65it/s]
 86%|████████▋ | 320865/371472 [3:21:25<4:03:20,  3.47it/s]
 86%|████████▋ | 320866/371472 [3:21:25<4:04:06,  3.46it/s]
 86%|████████▋ | 320867/371472 [3:21:25<3:53:13,  3.62it/s]
 86%|████████▋ | 320868/371472 [3:21:26<4:09:07,  3.39it/s]
 86%|████████▋ | 320869/371472 [3:21:26<3:56:42,  3.56it/s]
 86%|████████▋ | 320870/371472 [3:21:26<3:53:38,  3.61it/s]
 86%|████████▋ | 320871/371472 [3:21:27<3:50:12,  3.66it/s]
 86%|████████▋ | 320872/371472 [3:21:27<3:48:12,  3.70it/s]
 86%|████████▋ | 320873/371472 [3:21:27<3:41:23,  3.81it/s]
 86%|████████▋ | 320874/371472 [3:21:27<3:38:40,  3.86it/s]
 86%|████████▋ | 320875/371472 [3:21:28<4:46:56,  2.94it/s]
 86%|████████▋ | 320876/371472 [3:21:28<4:28:17,  3.14it/s]
 86%|████████▋ | 320877/371472 [3:21:28<4:24:39,  3.19it/s]
 86%|████████▋ | 320878/371472 [3:21:29<4:04:07,  3.45it/s]
 86%|████████▋ | 320879/371472 [3:21:29<4:14:45,  3.31it/s]
 86%|████████▋ | 320880/371472 [3:21:29<4:04:08,  3.45it/s]
                                                           
{'loss': 2.518, 'learning_rate': 2.2264000517141067e-07, 'epoch': 13.82}

 86%|████████▋ | 320880/371472 [3:21:29<4:04:08,  3.45it/s]
 86%|████████▋ | 320881/371472 [3:21:30<3:56:35,  3.56it/s]
 86%|████████▋ | 320882/371472 [3:21:30<3:58:55,  3.53it/s]
 86%|████████▋ | 320883/371472 [3:21:30<4:04:17,  3.45it/s]
 86%|████████▋ | 320884/371472 [3:21:30<3:59:22,  3.52it/s]
 86%|████████▋ | 320885/371472 [3:21:31<4:00:20,  3.51it/s]
 86%|████████▋ | 320886/371472 [3:21:31<3:53:16,  3.61it/s]
 86%|████████▋ | 320887/371472 [3:21:31<3:47:06,  3.71it/s]
 86%|████████▋ | 320888/371472 [3:21:31<3:46:56,  3.71it/s]
 86%|████████▋ | 320889/371472 [3:21:32<3:39:32,  3.84it/s]
 86%|████████▋ | 320890/371472 [3:21:32<3:50:10,  3.66it/s]
 86%|████████▋ | 320891/371472 [3:21:32<3:56:16,  3.57it/s]
 86%|████████▋ | 320892/371472 [3:21:33<3:49:03,  3.68it/s]
 86%|████████▋ | 320893/371472 [3:21:33<3:42:35,  3.79it/s]
 86%|████████▋ | 320894/371472 [3:21:33<3:45:51,  3.73it/s]
 86%|████████▋ | 320895/371472 [3:21:33<4:16:21,  3.29it/s]
 86%|████████▋ | 320896/371472 [3:21:34<4:14:29,  3.31it/s]
 86%|████████▋ | 320897/371472 [3:21:34<4:04:30,  3.45it/s]
 86%|████████▋ | 320898/371472 [3:21:34<3:56:38,  3.56it/s]
 86%|████████▋ | 320899/371472 [3:21:35<3:51:09,  3.65it/s]
 86%|████████▋ | 320900/371472 [3:21:35<3:49:14,  3.68it/s]
                                                           
{'loss': 2.7473, 'learning_rate': 2.2259152319593183e-07, 'epoch': 13.82}

 86%|████████▋ | 320900/371472 [3:21:35<3:49:14,  3.68it/s]
 86%|████████▋ | 320901/371472 [3:21:35<4:04:15,  3.45it/s]
 86%|████████▋ | 320902/371472 [3:21:35<3:57:21,  3.55it/s]
 86%|████████▋ | 320903/371472 [3:21:36<3:51:44,  3.64it/s]
 86%|████████▋ | 320904/371472 [3:21:36<3:50:43,  3.65it/s]
 86%|████████▋ | 320905/371472 [3:21:36<3:50:24,  3.66it/s]
 86%|████████▋ | 320906/371472 [3:21:36<3:39:03,  3.85it/s]
 86%|████████▋ | 320907/371472 [3:21:37<3:56:27,  3.56it/s]
 86%|████████▋ | 320908/371472 [3:21:37<3:52:13,  3.63it/s]
 86%|████████▋ | 320909/371472 [3:21:37<3:51:39,  3.64it/s]
 86%|████████▋ | 320910/371472 [3:21:38<3:57:22,  3.55it/s]
 86%|████████▋ | 320911/371472 [3:21:38<3:56:56,  3.56it/s]
 86%|████████▋ | 320912/371472 [3:21:38<4:01:16,  3.49it/s]
 86%|████████▋ | 320913/371472 [3:21:38<3:57:32,  3.55it/s]
 86%|████████▋ | 320914/371472 [3:21:39<3:55:56,  3.57it/s]
 86%|████████▋ | 320915/371472 [3:21:39<3:50:20,  3.66it/s]
 86%|████████▋ | 320916/371472 [3:21:39<3:44:49,  3.75it/s]
 86%|████████▋ | 320917/371472 [3:21:39<3:45:00,  3.74it/s]
 86%|████████▋ | 320918/371472 [3:21:40<3:40:10,  3.83it/s]
 86%|████████▋ | 320919/371472 [3:21:40<3:34:02,  3.94it/s]
 86%|████████▋ | 320920/371472 [3:21:40<3:42:26,  3.79it/s]
                                                           
{'loss': 2.7069, 'learning_rate': 2.225430412204529e-07, 'epoch': 13.82}

 86%|████████▋ | 320920/371472 [3:21:40<3:42:26,  3.79it/s]
 86%|████████▋ | 320921/371472 [3:21:41<3:44:53,  3.75it/s]
 86%|████████▋ | 320922/371472 [3:21:41<3:53:06,  3.61it/s]
 86%|████████▋ | 320923/371472 [3:21:41<3:45:43,  3.73it/s]
 86%|████████▋ | 320924/371472 [3:21:41<3:43:52,  3.76it/s]
 86%|████████▋ | 320925/371472 [3:21:42<3:45:42,  3.73it/s]
 86%|████████▋ | 320926/371472 [3:21:42<3:43:27,  3.77it/s]
 86%|████████▋ | 320927/371472 [3:21:42<3:40:22,  3.82it/s]
 86%|████████▋ | 320928/371472 [3:21:42<3:49:30,  3.67it/s]
 86%|████████▋ | 320929/371472 [3:21:43<3:59:50,  3.51it/s]
 86%|████████▋ | 320930/371472 [3:21:43<4:09:57,  3.37it/s]
 86%|████████▋ | 320931/371472 [3:21:43<4:05:34,  3.43it/s]
 86%|████████▋ | 320932/371472 [3:21:44<3:54:49,  3.59it/s]
 86%|████████▋ | 320933/371472 [3:21:44<3:46:44,  3.71it/s]
 86%|████████▋ | 320934/371472 [3:21:44<3:48:07,  3.69it/s]
 86%|████████▋ | 320935/371472 [3:21:44<3:51:33,  3.64it/s]
 86%|████████▋ | 320936/371472 [3:21:45<4:03:56,  3.45it/s]
 86%|████████▋ | 320937/371472 [3:21:45<4:04:18,  3.45it/s]
 86%|████████▋ | 320938/371472 [3:21:45<4:06:46,  3.41it/s]
 86%|████████▋ | 320939/371472 [3:21:46<4:05:57,  3.42it/s]
 86%|████████▋ | 320940/371472 [3:21:46<4:36:08,  3.05it/s]
                                                           
{'loss': 2.6028, 'learning_rate': 2.2249455924497405e-07, 'epoch': 13.82}

 86%|████████▋ | 320940/371472 [3:21:46<4:36:08,  3.05it/s]
 86%|████████▋ | 320941/371472 [3:21:46<4:26:58,  3.15it/s]
 86%|████████▋ | 320942/371472 [3:21:47<4:30:04,  3.12it/s]
 86%|████████▋ | 320943/371472 [3:21:47<4:22:27,  3.21it/s]
 86%|████████▋ | 320944/371472 [3:21:47<4:06:48,  3.41it/s]
 86%|████████▋ | 320945/371472 [3:21:47<4:10:44,  3.36it/s]
 86%|████████▋ | 320946/371472 [3:21:48<3:56:57,  3.55it/s]
 86%|████████▋ | 320947/371472 [3:21:48<3:52:45,  3.62it/s]
 86%|████████▋ | 320948/371472 [3:21:48<3:55:18,  3.58it/s]
 86%|████████▋ | 320949/371472 [3:21:49<4:03:05,  3.46it/s]
 86%|████████▋ | 320950/371472 [3:21:49<3:50:27,  3.65it/s]
 86%|████████▋ | 320951/371472 [3:21:49<3:42:00,  3.79it/s]
 86%|████████▋ | 320952/371472 [3:21:49<3:50:39,  3.65it/s]
 86%|████████▋ | 320953/371472 [3:21:50<3:39:43,  3.83it/s]
 86%|████████▋ | 320954/371472 [3:21:50<3:35:40,  3.90it/s]
 86%|████████▋ | 320955/371472 [3:21:50<3:54:57,  3.58it/s]
 86%|████████▋ | 320956/371472 [3:21:50<3:52:38,  3.62it/s]
 86%|████████▋ | 320957/371472 [3:21:51<4:02:29,  3.47it/s]
 86%|████████▋ | 320958/371472 [3:21:51<3:55:22,  3.58it/s]
 86%|████████▋ | 320959/371472 [3:21:51<4:07:31,  3.40it/s]
 86%|████████▋ | 320960/371472 [3:21:52<5:44:17,  2.45it/s]
                                                           
{'loss': 2.6889, 'learning_rate': 2.224460772694951e-07, 'epoch': 13.82}

 86%|████████▋ | 320960/371472 [3:21:52<5:44:17,  2.45it/s]
 86%|████████▋ | 320961/371472 [3:21:52<5:18:22,  2.64it/s]
 86%|████████▋ | 320962/371472 [3:21:53<4:53:12,  2.87it/s]
 86%|████████▋ | 320963/371472 [3:21:53<4:27:55,  3.14it/s]
 86%|████████▋ | 320964/371472 [3:21:53<4:21:06,  3.22it/s]
 86%|████████▋ | 320965/371472 [3:21:53<4:04:45,  3.44it/s]
 86%|████████▋ | 320966/371472 [3:21:54<3:53:18,  3.61it/s]
 86%|████████▋ | 320967/371472 [3:21:54<4:11:58,  3.34it/s]
 86%|████████▋ | 320968/371472 [3:21:54<4:19:59,  3.24it/s]
 86%|████████▋ | 320969/371472 [3:21:55<4:05:36,  3.43it/s]
 86%|████████▋ | 320970/371472 [3:21:55<4:02:50,  3.47it/s]
 86%|████████▋ | 320971/371472 [3:21:55<3:54:52,  3.58it/s]
 86%|████████▋ | 320972/371472 [3:21:55<3:47:26,  3.70it/s]
 86%|████████▋ | 320973/371472 [3:21:56<3:44:10,  3.75it/s]
 86%|████████▋ | 320974/371472 [3:21:56<3:45:30,  3.73it/s]
 86%|████████▋ | 320975/371472 [3:21:56<3:52:47,  3.62it/s]
 86%|████████▋ | 320976/371472 [3:21:57<4:20:24,  3.23it/s]
 86%|████████▋ | 320977/371472 [3:21:57<4:09:49,  3.37it/s]
 86%|████████▋ | 320978/371472 [3:21:57<4:02:12,  3.47it/s]
 86%|████████▋ | 320979/371472 [3:21:57<3:55:29,  3.57it/s]
 86%|████████▋ | 320980/371472 [3:21:58<3:46:05,  3.72it/s]
                                                           
{'loss': 2.551, 'learning_rate': 2.2239759529401627e-07, 'epoch': 13.83}

 86%|████████▋ | 320980/371472 [3:21:58<3:46:05,  3.72it/s]
 86%|████████▋ | 320981/371472 [3:21:58<3:54:35,  3.59it/s]
 86%|████████▋ | 320982/371472 [3:21:58<4:01:51,  3.48it/s]
 86%|████████▋ | 320983/371472 [3:21:59<4:17:01,  3.27it/s]
 86%|████████▋ | 320984/371472 [3:21:59<4:12:47,  3.33it/s]
 86%|████████▋ | 320985/371472 [3:21:59<4:04:09,  3.45it/s]
 86%|████████▋ | 320986/371472 [3:21:59<3:52:07,  3.62it/s]
 86%|████████▋ | 320987/371472 [3:22:00<3:50:39,  3.65it/s]
 86%|████████▋ | 320988/371472 [3:22:00<3:46:51,  3.71it/s]
 86%|████████▋ | 320989/371472 [3:22:00<4:17:23,  3.27it/s]
 86%|████████▋ | 320990/371472 [3:22:01<4:02:45,  3.47it/s]
 86%|████████▋ | 320991/371472 [3:22:01<4:05:42,  3.42it/s]
 86%|████████▋ | 320992/371472 [3:22:01<3:54:36,  3.59it/s]
 86%|████████▋ | 320993/371472 [3:22:01<4:08:04,  3.39it/s]
 86%|████████▋ | 320994/371472 [3:22:02<3:53:06,  3.61it/s]
 86%|████████▋ | 320995/371472 [3:22:02<3:47:19,  3.70it/s]
 86%|████████▋ | 320996/371472 [3:22:02<3:50:13,  3.65it/s]
 86%|████████▋ | 320997/371472 [3:22:02<3:48:39,  3.68it/s]
 86%|████████▋ | 320998/371472 [3:22:03<3:42:50,  3.77it/s]
 86%|████████▋ | 320999/371472 [3:22:03<4:03:55,  3.45it/s]
 86%|████████▋ | 321000/371472 [3:22:03<4:15:24,  3.29it/s]
                                                           
{'loss': 2.6268, 'learning_rate': 2.2234911331853732e-07, 'epoch': 13.83}

 86%|████████▋ | 321000/371472 [3:22:03<4:15:24,  3.29it/s]
 86%|████████▋ | 321001/371472 [3:22:04<4:03:51,  3.45it/s]
 86%|████████▋ | 321002/371472 [3:22:04<3:49:14,  3.67it/s]
 86%|████████▋ | 321003/371472 [3:22:04<3:54:21,  3.59it/s]
 86%|████████▋ | 321004/371472 [3:22:04<3:54:05,  3.59it/s]
 86%|████████▋ | 321005/371472 [3:22:05<3:49:46,  3.66it/s]
 86%|████████▋ | 321006/371472 [3:22:05<4:01:03,  3.49it/s]
 86%|████████▋ | 321007/371472 [3:22:05<3:50:50,  3.64it/s]
 86%|████████▋ | 321008/371472 [3:22:06<3:51:17,  3.64it/s]
 86%|████████▋ | 321009/371472 [3:22:06<3:51:02,  3.64it/s]
 86%|████████▋ | 321010/371472 [3:22:06<3:46:57,  3.71it/s]
 86%|████████▋ | 321011/371472 [3:22:06<3:59:52,  3.51it/s]
 86%|████████▋ | 321012/371472 [3:22:07<3:55:32,  3.57it/s]
 86%|████████▋ | 321013/371472 [3:22:07<3:49:28,  3.66it/s]
 86%|████████▋ | 321014/371472 [3:22:07<4:20:15,  3.23it/s]
 86%|████████▋ | 321015/371472 [3:22:08<4:05:55,  3.42it/s]
 86%|████████▋ | 321016/371472 [3:22:08<4:01:26,  3.48it/s]
 86%|████████▋ | 321017/371472 [3:22:08<3:50:23,  3.65it/s]
 86%|████████▋ | 321018/371472 [3:22:08<4:03:10,  3.46it/s]
 86%|████████▋ | 321019/371472 [3:22:09<4:02:24,  3.47it/s]
 86%|████████▋ | 321020/371472 [3:22:09<3:57:25,  3.54it/s]
                                                           
{'loss': 2.6163, 'learning_rate': 2.2230063134305847e-07, 'epoch': 13.83}

 86%|████████▋ | 321020/371472 [3:22:09<3:57:25,  3.54it/s]
 86%|████████▋ | 321021/371472 [3:22:09<3:49:32,  3.66it/s]
 86%|████████▋ | 321022/371472 [3:22:09<3:42:33,  3.78it/s]
 86%|████████▋ | 321023/371472 [3:22:10<3:56:01,  3.56it/s]
 86%|████████▋ | 321024/371472 [3:22:10<4:14:34,  3.30it/s]
 86%|████████▋ | 321025/371472 [3:22:10<4:15:58,  3.28it/s]
 86%|████████▋ | 321026/371472 [3:22:11<4:06:35,  3.41it/s]
 86%|████████▋ | 321027/371472 [3:22:11<3:54:14,  3.59it/s]
 86%|████████▋ | 321028/371472 [3:22:11<3:53:43,  3.60it/s]
 86%|████████▋ | 321029/371472 [3:22:12<3:54:59,  3.58it/s]
 86%|████████▋ | 321030/371472 [3:22:12<3:45:09,  3.73it/s]
 86%|████████▋ | 321031/371472 [3:22:12<3:39:05,  3.84it/s]
 86%|████████▋ | 321032/371472 [3:22:12<3:36:00,  3.89it/s]
 86%|████████▋ | 321033/371472 [3:22:13<3:42:10,  3.78it/s]
 86%|████████▋ | 321034/371472 [3:22:13<3:33:02,  3.95it/s]
 86%|████████▋ | 321035/371472 [3:22:13<3:54:59,  3.58it/s]
 86%|████████▋ | 321036/371472 [3:22:13<3:52:00,  3.62it/s]
 86%|████████▋ | 321037/371472 [3:22:14<3:43:45,  3.76it/s]
 86%|████████▋ | 321038/371472 [3:22:14<3:47:18,  3.70it/s]
 86%|████████▋ | 321039/371472 [3:22:14<3:51:06,  3.64it/s]
 86%|████████▋ | 321040/371472 [3:22:14<3:57:12,  3.54it/s]
                                                           
{'loss': 2.5761, 'learning_rate': 2.2225214936757954e-07, 'epoch': 13.83}

 86%|████████▋ | 321040/371472 [3:22:14<3:57:12,  3.54it/s]
 86%|████████▋ | 321041/371472 [3:22:15<3:57:45,  3.54it/s]
 86%|████████▋ | 321042/371472 [3:22:15<4:02:48,  3.46it/s]
 86%|████████▋ | 321043/371472 [3:22:15<3:53:30,  3.60it/s]
 86%|████████▋ | 321044/371472 [3:22:16<3:46:01,  3.72it/s]
 86%|████████▋ | 321045/371472 [3:22:16<3:50:42,  3.64it/s]
 86%|████████▋ | 321046/371472 [3:22:16<4:02:36,  3.46it/s]
 86%|████████▋ | 321047/371472 [3:22:16<3:55:57,  3.56it/s]
 86%|████████▋ | 321048/371472 [3:22:17<3:50:38,  3.64it/s]
 86%|████████▋ | 321049/371472 [3:22:17<3:45:23,  3.73it/s]
 86%|████████▋ | 321050/371472 [3:22:17<3:53:18,  3.60it/s]
 86%|████████▋ | 321051/371472 [3:22:18<4:05:10,  3.43it/s]
 86%|████████▋ | 321052/371472 [3:22:18<4:11:53,  3.34it/s]
 86%|████████▋ | 321053/371472 [3:22:18<3:59:45,  3.50it/s]
 86%|████████▋ | 321054/371472 [3:22:18<4:07:46,  3.39it/s]
 86%|████████▋ | 321055/371472 [3:22:19<3:56:10,  3.56it/s]
 86%|████████▋ | 321056/371472 [3:22:19<3:59:29,  3.51it/s]
 86%|████████▋ | 321057/371472 [3:22:19<3:51:35,  3.63it/s]
 86%|████████▋ | 321058/371472 [3:22:20<3:46:21,  3.71it/s]
 86%|████████▋ | 321059/371472 [3:22:20<3:47:01,  3.70it/s]
 86%|████████▋ | 321060/371472 [3:22:20<3:49:46,  3.66it/s]
                                                           
{'loss': 2.8215, 'learning_rate': 2.222036673921007e-07, 'epoch': 13.83}

 86%|████████▋ | 321060/371472 [3:22:20<3:49:46,  3.66it/s]
 86%|████████▋ | 321061/371472 [3:22:20<3:47:46,  3.69it/s]
 86%|████████▋ | 321062/371472 [3:22:21<3:45:54,  3.72it/s]
 86%|████████▋ | 321063/371472 [3:22:21<3:45:25,  3.73it/s]
 86%|████████▋ | 321064/371472 [3:22:21<4:07:42,  3.39it/s]
 86%|████████▋ | 321065/371472 [3:22:22<4:13:45,  3.31it/s]
 86%|████████▋ | 321066/371472 [3:22:22<4:01:26,  3.48it/s]
 86%|████████▋ | 321067/371472 [3:22:22<4:02:18,  3.47it/s]
 86%|████████▋ | 321068/371472 [3:22:22<3:51:09,  3.63it/s]
 86%|████████▋ | 321069/371472 [3:22:23<3:50:07,  3.65it/s]
 86%|████████▋ | 321070/371472 [3:22:23<3:48:22,  3.68it/s]
 86%|████████▋ | 321071/371472 [3:22:23<3:58:21,  3.52it/s]
 86%|████████▋ | 321072/371472 [3:22:23<3:49:31,  3.66it/s]
 86%|████████▋ | 321073/371472 [3:22:24<3:42:23,  3.78it/s]
 86%|████████▋ | 321074/371472 [3:22:24<4:01:37,  3.48it/s]
 86%|████████▋ | 321075/371472 [3:22:24<3:59:27,  3.51it/s]
 86%|████████▋ | 321076/371472 [3:22:25<3:56:02,  3.56it/s]
 86%|████████▋ | 321077/371472 [3:22:25<3:47:20,  3.69it/s]
 86%|████████▋ | 321078/371472 [3:22:25<3:53:16,  3.60it/s]
 86%|████████▋ | 321079/371472 [3:22:25<3:53:24,  3.60it/s]
 86%|████████▋ | 321080/371472 [3:22:26<3:54:37,  3.58it/s]
                                                           
{'loss': 2.646, 'learning_rate': 2.2215518541662176e-07, 'epoch': 13.83}

 86%|████████▋ | 321080/371472 [3:22:26<3:54:37,  3.58it/s]
 86%|████████▋ | 321081/371472 [3:22:26<4:00:33,  3.49it/s]
 86%|████████▋ | 321082/371472 [3:22:26<3:58:11,  3.53it/s]
 86%|████████▋ | 321083/371472 [3:22:26<3:50:08,  3.65it/s]
 86%|████████▋ | 321084/371472 [3:22:27<3:50:24,  3.64it/s]
 86%|████████▋ | 321085/371472 [3:22:27<4:13:24,  3.31it/s]
 86%|████████▋ | 321086/371472 [3:22:27<3:59:55,  3.50it/s]
 86%|████████▋ | 321087/371472 [3:22:28<4:07:37,  3.39it/s]
 86%|████████▋ | 321088/371472 [3:22:28<4:22:51,  3.19it/s]
 86%|████████▋ | 321089/371472 [3:22:28<4:22:41,  3.20it/s]
 86%|████████▋ | 321090/371472 [3:22:29<4:22:35,  3.20it/s]
 86%|████████▋ | 321091/371472 [3:22:29<4:05:02,  3.43it/s]
 86%|████████▋ | 321092/371472 [3:22:29<4:03:20,  3.45it/s]
 86%|████████▋ | 321093/371472 [3:22:29<4:00:31,  3.49it/s]
 86%|████████▋ | 321094/371472 [3:22:30<3:58:24,  3.52it/s]
 86%|████████▋ | 321095/371472 [3:22:30<3:51:14,  3.63it/s]
 86%|████████▋ | 321096/371472 [3:22:30<3:52:16,  3.61it/s]
 86%|████████▋ | 321097/371472 [3:22:31<4:10:41,  3.35it/s]
 86%|████████▋ | 321098/371472 [3:22:31<4:01:12,  3.48it/s]
 86%|████████▋ | 321099/371472 [3:22:31<3:53:24,  3.60it/s]
 86%|████████▋ | 321100/371472 [3:22:31<3:47:33,  3.69it/s]
                                                           
{'loss': 2.7141, 'learning_rate': 2.221067034411429e-07, 'epoch': 13.83}

 86%|████████▋ | 321100/371472 [3:22:31<3:47:33,  3.69it/s]
 86%|████████▋ | 321101/371472 [3:22:32<4:03:17,  3.45it/s]
 86%|████████▋ | 321102/371472 [3:22:32<3:56:55,  3.54it/s]
 86%|████████▋ | 321103/371472 [3:22:32<4:00:41,  3.49it/s]
 86%|████████▋ | 321104/371472 [3:22:33<3:56:07,  3.56it/s]
 86%|████████▋ | 321105/371472 [3:22:33<3:52:22,  3.61it/s]
 86%|████████▋ | 321106/371472 [3:22:33<3:58:08,  3.52it/s]
 86%|████████▋ | 321107/371472 [3:22:33<3:55:23,  3.57it/s]
 86%|████████▋ | 321108/371472 [3:22:34<3:48:44,  3.67it/s]
 86%|████████▋ | 321109/371472 [3:22:34<3:47:40,  3.69it/s]
 86%|████████▋ | 321110/371472 [3:22:34<3:50:36,  3.64it/s]
 86%|████████▋ | 321111/371472 [3:22:34<3:49:00,  3.67it/s]
 86%|████████▋ | 321112/371472 [3:22:35<3:46:12,  3.71it/s]
 86%|████████▋ | 321113/371472 [3:22:35<3:46:58,  3.70it/s]
 86%|████████▋ | 321114/371472 [3:22:35<4:03:45,  3.44it/s]
 86%|████████▋ | 321115/371472 [3:22:36<3:57:21,  3.54it/s]
 86%|████████▋ | 321116/371472 [3:22:36<3:58:50,  3.51it/s]
 86%|████████▋ | 321117/371472 [3:22:36<4:05:02,  3.42it/s]
 86%|████████▋ | 321118/371472 [3:22:37<4:03:02,  3.45it/s]
 86%|████████▋ | 321119/371472 [3:22:37<3:55:02,  3.57it/s]
 86%|████████▋ | 321120/371472 [3:22:37<4:00:48,  3.48it/s]
                                                           
{'loss': 2.684, 'learning_rate': 2.2205822146566398e-07, 'epoch': 13.83}

 86%|████████▋ | 321120/371472 [3:22:37<4:00:48,  3.48it/s]
 86%|████████▋ | 321121/371472 [3:22:37<3:51:58,  3.62it/s]
 86%|████████▋ | 321122/371472 [3:22:38<3:43:55,  3.75it/s]
 86%|████████▋ | 321123/371472 [3:22:38<3:56:24,  3.55it/s]
 86%|████████▋ | 321124/371472 [3:22:38<3:53:33,  3.59it/s]
 86%|████████▋ | 321125/371472 [3:22:38<3:43:30,  3.75it/s]
 86%|████████▋ | 321126/371472 [3:22:39<3:52:18,  3.61it/s]
 86%|████████▋ | 321127/371472 [3:22:39<4:03:45,  3.44it/s]
 86%|████████▋ | 321128/371472 [3:22:39<3:54:57,  3.57it/s]
 86%|████████▋ | 321129/371472 [3:22:40<3:56:43,  3.54it/s]
 86%|████████▋ | 321130/371472 [3:22:40<3:49:49,  3.65it/s]
 86%|████████▋ | 321131/371472 [3:22:40<3:38:22,  3.84it/s]
 86%|████████▋ | 321132/371472 [3:22:40<4:10:37,  3.35it/s]
 86%|████████▋ | 321133/371472 [3:22:41<4:13:03,  3.32it/s]
 86%|████████▋ | 321134/371472 [3:22:41<4:05:17,  3.42it/s]
 86%|████████▋ | 321135/371472 [3:22:41<3:54:50,  3.57it/s]
 86%|████████▋ | 321136/371472 [3:22:42<3:54:25,  3.58it/s]
 86%|████████▋ | 321137/371472 [3:22:42<4:10:03,  3.35it/s]
 86%|████████▋ | 321138/371472 [3:22:42<4:07:30,  3.39it/s]
 86%|████████▋ | 321139/371472 [3:22:42<3:51:56,  3.62it/s]
 86%|████████▋ | 321140/371472 [3:22:43<3:43:27,  3.75it/s]
                                                           
{'loss': 2.7284, 'learning_rate': 2.2200973949018513e-07, 'epoch': 13.83}

 86%|████████▋ | 321140/371472 [3:22:43<3:43:27,  3.75it/s]
 86%|████████▋ | 321141/371472 [3:22:43<3:46:58,  3.70it/s]
 86%|████████▋ | 321142/371472 [3:22:43<3:43:52,  3.75it/s]
 86%|████████▋ | 321143/371472 [3:22:43<3:47:06,  3.69it/s]
 86%|████████▋ | 321144/371472 [3:22:44<3:39:47,  3.82it/s]
 86%|████████▋ | 321145/371472 [3:22:44<3:44:20,  3.74it/s]
 86%|████████▋ | 321146/371472 [3:22:44<3:41:21,  3.79it/s]
 86%|████████▋ | 321147/371472 [3:22:45<3:45:25,  3.72it/s]
 86%|████████▋ | 321148/371472 [3:22:45<3:44:13,  3.74it/s]
 86%|████████▋ | 321149/371472 [3:22:45<3:51:13,  3.63it/s]
 86%|████████▋ | 321150/371472 [3:22:45<3:46:10,  3.71it/s]
 86%|████████▋ | 321151/371472 [3:22:46<3:43:27,  3.75it/s]
 86%|████████▋ | 321152/371472 [3:22:46<3:58:52,  3.51it/s]
 86%|████████▋ | 321153/371472 [3:22:46<3:58:27,  3.52it/s]
 86%|████████▋ | 321154/371472 [3:22:47<4:05:21,  3.42it/s]
 86%|████████▋ | 321155/371472 [3:22:47<4:07:12,  3.39it/s]
 86%|████████▋ | 321156/371472 [3:22:47<4:07:29,  3.39it/s]
 86%|████████▋ | 321157/371472 [3:22:47<4:00:20,  3.49it/s]
 86%|████████▋ | 321158/371472 [3:22:48<4:09:56,  3.36it/s]
 86%|████████▋ | 321159/371472 [3:22:48<4:04:40,  3.43it/s]
 86%|████████▋ | 321160/371472 [3:22:48<3:57:55,  3.52it/s]
                                                           
{'loss': 2.5299, 'learning_rate': 2.2196125751470618e-07, 'epoch': 13.83}

 86%|████████▋ | 321160/371472 [3:22:48<3:57:55,  3.52it/s]
 86%|████████▋ | 321161/371472 [3:22:49<3:51:01,  3.63it/s]
 86%|████████▋ | 321162/371472 [3:22:49<3:49:03,  3.66it/s]
 86%|████████▋ | 321163/371472 [3:22:49<3:52:23,  3.61it/s]
 86%|████████▋ | 321164/371472 [3:22:49<3:44:43,  3.73it/s]
 86%|████████▋ | 321165/371472 [3:22:50<3:36:05,  3.88it/s]
 86%|████████▋ | 321166/371472 [3:22:50<3:31:15,  3.97it/s]
 86%|████████▋ | 321167/371472 [3:22:50<3:30:10,  3.99it/s]
 86%|████████▋ | 321168/371472 [3:22:50<3:27:25,  4.04it/s]
 86%|████████▋ | 321169/371472 [3:22:51<3:28:00,  4.03it/s]
 86%|████████▋ | 321170/371472 [3:22:51<4:28:36,  3.12it/s]
 86%|████████▋ | 321171/371472 [3:22:51<4:39:43,  3.00it/s]
 86%|████████▋ | 321172/371472 [3:22:52<4:26:08,  3.15it/s]
 86%|████████▋ | 321173/371472 [3:22:52<4:12:15,  3.32it/s]
 86%|████████▋ | 321174/371472 [3:22:52<3:56:19,  3.55it/s]
 86%|████████▋ | 321175/371472 [3:22:52<3:46:12,  3.71it/s]
 86%|████████▋ | 321176/371472 [3:22:53<4:00:36,  3.48it/s]
 86%|████████▋ | 321177/371472 [3:22:53<3:50:19,  3.64it/s]
 86%|████████▋ | 321178/371472 [3:22:53<4:15:48,  3.28it/s]
 86%|████████▋ | 321179/371472 [3:22:54<4:11:50,  3.33it/s]
 86%|████████▋ | 321180/371472 [3:22:54<4:07:14,  3.39it/s]
                                                           
{'loss': 2.5704, 'learning_rate': 2.2191277553922733e-07, 'epoch': 13.83}

 86%|████████▋ | 321180/371472 [3:22:54<4:07:14,  3.39it/s]
 86%|████████▋ | 321181/371472 [3:22:54<3:57:49,  3.52it/s]
 86%|████████▋ | 321182/371472 [3:22:54<3:53:40,  3.59it/s]
 86%|████████▋ | 321183/371472 [3:22:55<3:57:46,  3.52it/s]
 86%|████████▋ | 321184/371472 [3:22:55<4:00:28,  3.49it/s]
 86%|████████▋ | 321185/371472 [3:22:55<4:14:10,  3.30it/s]
 86%|████████▋ | 321186/371472 [3:22:56<4:12:35,  3.32it/s]
 86%|████████▋ | 321187/371472 [3:22:56<3:59:22,  3.50it/s]
 86%|████████▋ | 321188/371472 [3:22:56<4:01:09,  3.48it/s]
 86%|████████▋ | 321189/371472 [3:22:57<4:07:32,  3.39it/s]
 86%|████████▋ | 321190/371472 [3:22:57<4:07:38,  3.38it/s]
 86%|████████▋ | 321191/371472 [3:22:57<4:04:29,  3.43it/s]
 86%|████████▋ | 321192/371472 [3:22:58<4:37:40,  3.02it/s]
 86%|████████▋ | 321193/371472 [3:22:58<4:18:22,  3.24it/s]
 86%|████████▋ | 321194/371472 [3:22:58<4:03:26,  3.44it/s]
 86%|████████▋ | 321195/371472 [3:22:58<4:02:01,  3.46it/s]
 86%|████████▋ | 321196/371472 [3:22:59<4:07:39,  3.38it/s]
 86%|████████▋ | 321197/371472 [3:22:59<4:28:15,  3.12it/s]
 86%|████████▋ | 321198/371472 [3:22:59<4:25:50,  3.15it/s]
 86%|████████▋ | 321199/371472 [3:23:00<4:09:45,  3.35it/s]
 86%|████████▋ | 321200/371472 [3:23:00<4:05:17,  3.42it/s]
                                                           
{'loss': 2.5667, 'learning_rate': 2.218642935637484e-07, 'epoch': 13.83}

 86%|████████▋ | 321200/371472 [3:23:00<4:05:17,  3.42it/s]
 86%|████████▋ | 321201/371472 [3:23:00<4:02:24,  3.46it/s]
 86%|████████▋ | 321202/371472 [3:23:00<4:00:38,  3.48it/s]
 86%|████████▋ | 321203/371472 [3:23:01<4:05:09,  3.42it/s]
 86%|████████▋ | 321204/371472 [3:23:01<4:01:53,  3.46it/s]
 86%|████████▋ | 321205/371472 [3:23:01<4:06:39,  3.40it/s]
 86%|████████▋ | 321206/371472 [3:23:02<4:12:46,  3.31it/s]
 86%|████████▋ | 321207/371472 [3:23:02<4:26:38,  3.14it/s]
 86%|████████▋ | 321208/371472 [3:23:02<4:08:08,  3.38it/s]
 86%|████████▋ | 321209/371472 [3:23:02<3:51:48,  3.61it/s]
 86%|████████▋ | 321210/371472 [3:23:03<3:46:47,  3.69it/s]
 86%|████████▋ | 321211/371472 [3:23:03<4:05:43,  3.41it/s]
 86%|████████▋ | 321212/371472 [3:23:03<4:09:57,  3.35it/s]
 86%|████████▋ | 321213/371472 [3:23:04<3:55:31,  3.56it/s]
 86%|████████▋ | 321214/371472 [3:23:04<3:59:34,  3.50it/s]
 86%|████████▋ | 321215/371472 [3:23:04<4:20:31,  3.22it/s]
 86%|████████▋ | 321216/371472 [3:23:05<4:17:50,  3.25it/s]
 86%|████████▋ | 321217/371472 [3:23:05<4:02:43,  3.45it/s]
 86%|████████▋ | 321218/371472 [3:23:05<3:54:37,  3.57it/s]
 86%|████████▋ | 321219/371472 [3:23:05<4:09:56,  3.35it/s]
 86%|████████▋ | 321220/371472 [3:23:06<4:12:16,  3.32it/s]
                                                           
{'loss': 2.4441, 'learning_rate': 2.2181581158826955e-07, 'epoch': 13.84}

 86%|████████▋ | 321220/371472 [3:23:06<4:12:16,  3.32it/s]
 86%|████████▋ | 321221/371472 [3:23:06<4:18:35,  3.24it/s]
 86%|████████▋ | 321222/371472 [3:23:06<4:17:36,  3.25it/s]
 86%|████████▋ | 321223/371472 [3:23:07<4:11:00,  3.34it/s]
 86%|████████▋ | 321224/371472 [3:23:07<4:07:22,  3.39it/s]
 86%|████████▋ | 321225/371472 [3:23:07<4:22:22,  3.19it/s]
 86%|████████▋ | 321226/371472 [3:23:08<4:17:19,  3.25it/s]
 86%|████████▋ | 321227/371472 [3:23:08<4:22:38,  3.19it/s]
 86%|████████▋ | 321228/371472 [3:23:08<4:17:38,  3.25it/s]
 86%|████████▋ | 321229/371472 [3:23:09<4:31:09,  3.09it/s]
 86%|████████▋ | 321230/371472 [3:23:09<4:14:04,  3.30it/s]
 86%|████████▋ | 321231/371472 [3:23:09<4:04:54,  3.42it/s]
 86%|████████▋ | 321232/371472 [3:23:09<3:51:35,  3.62it/s]
 86%|████████▋ | 321233/371472 [3:23:10<3:38:40,  3.83it/s]
 86%|████████▋ | 321234/371472 [3:23:10<3:49:20,  3.65it/s]
 86%|████████▋ | 321235/371472 [3:23:10<3:42:12,  3.77it/s]
 86%|████████▋ | 321236/371472 [3:23:10<3:35:55,  3.88it/s]
 86%|████████▋ | 321237/371472 [3:23:11<3:33:45,  3.92it/s]
 86%|████████▋ | 321238/371472 [3:23:11<3:33:48,  3.92it/s]
 86%|████████▋ | 321239/371472 [3:23:11<3:29:22,  4.00it/s]
 86%|████████▋ | 321240/371472 [3:23:11<3:31:55,  3.95it/s]
                                                           
{'loss': 2.542, 'learning_rate': 2.2176732961279062e-07, 'epoch': 13.84}

 86%|████████▋ | 321240/371472 [3:23:11<3:31:55,  3.95it/s]
 86%|████████▋ | 321241/371472 [3:23:12<3:49:05,  3.65it/s]
 86%|████████▋ | 321242/371472 [3:23:12<3:55:30,  3.55it/s]
 86%|████████▋ | 321243/371472 [3:23:12<3:50:35,  3.63it/s]
 86%|████████▋ | 321244/371472 [3:23:12<3:46:44,  3.69it/s]
 86%|████████▋ | 321245/371472 [3:23:13<4:14:52,  3.28it/s]
 86%|████████▋ | 321246/371472 [3:23:13<4:21:23,  3.20it/s]
 86%|████████▋ | 321247/371472 [3:23:14<4:28:02,  3.12it/s]
 86%|████████▋ | 321248/371472 [3:23:14<4:20:45,  3.21it/s]
 86%|████████▋ | 321249/371472 [3:23:14<4:09:42,  3.35it/s]
 86%|████████▋ | 321250/371472 [3:23:14<3:59:53,  3.49it/s]
 86%|████████▋ | 321251/371472 [3:23:15<3:55:41,  3.55it/s]
 86%|████████▋ | 321252/371472 [3:23:15<3:51:53,  3.61it/s]
 86%|████████▋ | 321253/371472 [3:23:15<3:54:01,  3.58it/s]
 86%|████████▋ | 321254/371472 [3:23:15<3:51:38,  3.61it/s]
 86%|████████▋ | 321255/371472 [3:23:16<3:49:31,  3.65it/s]
 86%|████████▋ | 321256/371472 [3:23:16<3:49:00,  3.65it/s]
 86%|████████▋ | 321257/371472 [3:23:16<3:54:18,  3.57it/s]
 86%|████████▋ | 321258/371472 [3:23:17<3:59:00,  3.50it/s]
 86%|████████▋ | 321259/371472 [3:23:17<3:53:34,  3.58it/s]
 86%|████████▋ | 321260/371472 [3:23:17<3:52:23,  3.60it/s]
                                                           
{'loss': 2.6281, 'learning_rate': 2.2171884763731177e-07, 'epoch': 13.84}

 86%|████████▋ | 321260/371472 [3:23:17<3:52:23,  3.60it/s]
 86%|████████▋ | 321261/371472 [3:23:17<3:44:25,  3.73it/s]
 86%|████████▋ | 321262/371472 [3:23:18<3:51:37,  3.61it/s]
 86%|████████▋ | 321263/371472 [3:23:18<3:51:05,  3.62it/s]
 86%|████████▋ | 321264/371472 [3:23:18<3:52:52,  3.59it/s]
 86%|████████▋ | 321265/371472 [3:23:19<3:58:56,  3.50it/s]
 86%|████████▋ | 321266/371472 [3:23:19<3:56:29,  3.54it/s]
 86%|████████▋ | 321267/371472 [3:23:19<3:55:55,  3.55it/s]
 86%|████████▋ | 321268/371472 [3:23:19<4:02:13,  3.45it/s]
 86%|████████▋ | 321269/371472 [3:23:20<4:04:51,  3.42it/s]
 86%|████████▋ | 321270/371472 [3:23:20<3:55:12,  3.56it/s]
 86%|████████▋ | 321271/371472 [3:23:20<4:04:48,  3.42it/s]
 86%|████████▋ | 321272/371472 [3:23:21<4:07:07,  3.39it/s]
 86%|████████▋ | 321273/371472 [3:23:21<4:01:45,  3.46it/s]
 86%|████████▋ | 321274/371472 [3:23:21<3:59:31,  3.49it/s]
 86%|████████▋ | 321275/371472 [3:23:21<4:03:15,  3.44it/s]
 86%|████████▋ | 321276/371472 [3:23:22<4:04:21,  3.42it/s]
 86%|████████▋ | 321277/371472 [3:23:22<3:53:26,  3.58it/s]
 86%|████████▋ | 321278/371472 [3:23:22<3:52:58,  3.59it/s]
 86%|████████▋ | 321279/371472 [3:23:22<3:49:06,  3.65it/s]
 86%|████████▋ | 321280/371472 [3:23:23<3:56:07,  3.54it/s]
                                                           
{'loss': 2.5904, 'learning_rate': 2.2167036566183282e-07, 'epoch': 13.84}

 86%|████████▋ | 321280/371472 [3:23:23<3:56:07,  3.54it/s]
 86%|████████▋ | 321281/371472 [3:23:23<4:00:41,  3.48it/s]
 86%|████████▋ | 321282/371472 [3:23:23<3:55:02,  3.56it/s]
 86%|████████▋ | 321283/371472 [3:23:24<3:56:10,  3.54it/s]
 86%|████████▋ | 321284/371472 [3:23:24<3:57:23,  3.52it/s]
 86%|████████▋ | 321285/371472 [3:23:24<3:54:40,  3.56it/s]
 86%|████████▋ | 321286/371472 [3:23:24<3:52:28,  3.60it/s]
 86%|████████▋ | 321287/371472 [3:23:25<3:51:12,  3.62it/s]
 86%|████████▋ | 321288/371472 [3:23:25<4:20:04,  3.22it/s]
 86%|████████▋ | 321289/371472 [3:23:25<4:06:11,  3.40it/s]
 86%|████████▋ | 321290/371472 [3:23:26<4:25:06,  3.15it/s]
 86%|████████▋ | 321291/371472 [3:23:26<4:36:19,  3.03it/s]
 86%|████████▋ | 321292/371472 [3:23:26<4:23:18,  3.18it/s]
 86%|████████▋ | 321293/371472 [3:23:27<4:21:45,  3.20it/s]
 86%|████████▋ | 321294/371472 [3:23:27<4:06:08,  3.40it/s]
 86%|████████▋ | 321295/371472 [3:23:27<4:18:13,  3.24it/s]
 86%|████████▋ | 321296/371472 [3:23:28<4:09:27,  3.35it/s]
 86%|████████▋ | 321297/371472 [3:23:28<4:00:43,  3.47it/s]
 86%|████████▋ | 321298/371472 [3:23:28<3:59:42,  3.49it/s]
 86%|████████▋ | 321299/371472 [3:23:28<3:53:01,  3.59it/s]
 86%|████████▋ | 321300/371472 [3:23:29<3:59:12,  3.50it/s]
                                                           
{'loss': 2.7963, 'learning_rate': 2.216218836863539e-07, 'epoch': 13.84}

 86%|████████▋ | 321300/371472 [3:23:29<3:59:12,  3.50it/s]
 86%|████████▋ | 321301/371472 [3:23:29<3:52:46,  3.59it/s]
 86%|████████▋ | 321302/371472 [3:23:29<3:51:32,  3.61it/s]
 86%|████████▋ | 321303/371472 [3:23:30<3:56:14,  3.54it/s]
 86%|████████▋ | 321304/371472 [3:23:30<3:49:26,  3.64it/s]
 86%|████████▋ | 321305/371472 [3:23:30<3:52:37,  3.59it/s]
 86%|████████▋ | 321306/371472 [3:23:30<4:00:26,  3.48it/s]
 86%|████████▋ | 321307/371472 [3:23:31<3:49:17,  3.65it/s]
 86%|████████▋ | 321308/371472 [3:23:31<3:51:15,  3.62it/s]
 86%|████████▋ | 321309/371472 [3:23:31<3:48:37,  3.66it/s]
 86%|████████▋ | 321310/371472 [3:23:31<3:45:28,  3.71it/s]
 86%|████████▋ | 321311/371472 [3:23:32<3:37:34,  3.84it/s]
 86%|████████▋ | 321312/371472 [3:23:32<3:39:09,  3.81it/s]
 86%|████████▋ | 321313/371472 [3:23:32<3:43:40,  3.74it/s]
 86%|████████▋ | 321314/371472 [3:23:33<3:48:11,  3.66it/s]
 86%|████████▋ | 321315/371472 [3:23:33<3:42:43,  3.75it/s]
 86%|████████▋ | 321316/371472 [3:23:33<3:40:08,  3.80it/s]
 86%|████████▋ | 321317/371472 [3:23:33<3:36:33,  3.86it/s]
 86%|████████▋ | 321318/371472 [3:23:34<3:39:39,  3.81it/s]
 86%|████████▋ | 321319/371472 [3:23:34<3:49:30,  3.64it/s]
 86%|████████▋ | 321320/371472 [3:23:34<3:44:19,  3.73it/s]
                                                           
{'loss': 2.5814, 'learning_rate': 2.2157340171087504e-07, 'epoch': 13.84}

 86%|████████▋ | 321320/371472 [3:23:34<3:44:19,  3.73it/s]
 86%|████████▋ | 321321/371472 [3:23:34<3:53:04,  3.59it/s]
 86%|████████▋ | 321322/371472 [3:23:35<3:44:21,  3.73it/s]
 86%|████████▋ | 321323/371472 [3:23:35<3:52:12,  3.60it/s]
 87%|████████▋ | 321324/371472 [3:23:35<3:55:57,  3.54it/s]
 87%|████████▋ | 321325/371472 [3:23:35<3:46:56,  3.68it/s]
 87%|████████▋ | 321326/371472 [3:23:36<3:46:57,  3.68it/s]
 87%|████████▋ | 321327/371472 [3:23:36<3:41:16,  3.78it/s]
 87%|████████▋ | 321328/371472 [3:23:36<3:46:41,  3.69it/s]
 87%|████████▋ | 321329/371472 [3:23:37<3:45:13,  3.71it/s]
 87%|████████▋ | 321330/371472 [3:23:37<3:39:56,  3.80it/s]
 87%|████████▋ | 321331/371472 [3:23:37<3:53:50,  3.57it/s]
 87%|████████▋ | 321332/371472 [3:23:37<3:54:56,  3.56it/s]
 87%|████████▋ | 321333/371472 [3:23:38<3:56:31,  3.53it/s]
 87%|████████▋ | 321334/371472 [3:23:38<4:05:05,  3.41it/s]
 87%|████████▋ | 321335/371472 [3:23:38<3:52:43,  3.59it/s]
 87%|████████▋ | 321336/371472 [3:23:38<3:42:18,  3.76it/s]
 87%|████████▋ | 321337/371472 [3:23:39<3:45:47,  3.70it/s]
 87%|████████▋ | 321338/371472 [3:23:39<3:55:34,  3.55it/s]
 87%|████████▋ | 321339/371472 [3:23:39<3:57:48,  3.51it/s]
 87%|████████▋ | 321340/371472 [3:23:40<3:50:52,  3.62it/s]
                                                           
{'loss': 2.6498, 'learning_rate': 2.2152491973539609e-07, 'epoch': 13.84}

 87%|████████▋ | 321340/371472 [3:23:40<3:50:52,  3.62it/s]
 87%|████████▋ | 321341/371472 [3:23:40<3:48:17,  3.66it/s]
 87%|████████▋ | 321342/371472 [3:23:40<4:00:08,  3.48it/s]
 87%|████████▋ | 321343/371472 [3:23:40<3:53:46,  3.57it/s]
 87%|████████▋ | 321344/371472 [3:23:41<4:34:03,  3.05it/s]
 87%|████████▋ | 321345/371472 [3:23:41<4:15:04,  3.28it/s]
 87%|████████▋ | 321346/371472 [3:23:41<4:04:56,  3.41it/s]
 87%|████████▋ | 321347/371472 [3:23:42<4:12:30,  3.31it/s]
 87%|████████▋ | 321348/371472 [3:23:42<4:27:59,  3.12it/s]
 87%|████████▋ | 321349/371472 [3:23:42<4:11:04,  3.33it/s]
 87%|████████▋ | 321350/371472 [3:23:43<4:13:07,  3.30it/s]
 87%|████████▋ | 321351/371472 [3:23:43<4:09:37,  3.35it/s]
 87%|████████▋ | 321352/371472 [3:23:43<4:07:15,  3.38it/s]
 87%|████████▋ | 321353/371472 [3:23:44<3:59:55,  3.48it/s]
 87%|████████▋ | 321354/371472 [3:23:44<3:50:01,  3.63it/s]
 87%|████████▋ | 321355/371472 [3:23:44<3:39:25,  3.81it/s]
 87%|████████▋ | 321356/371472 [3:23:44<3:55:07,  3.55it/s]
 87%|████████▋ | 321357/371472 [3:23:45<3:45:29,  3.70it/s]
 87%|████████▋ | 321358/371472 [3:23:45<4:05:00,  3.41it/s]
 87%|████████▋ | 321359/371472 [3:23:45<3:59:50,  3.48it/s]
 87%|████████▋ | 321360/371472 [3:23:45<3:56:57,  3.52it/s]
                                                           
{'loss': 2.5499, 'learning_rate': 2.2147643775991726e-07, 'epoch': 13.84}

 87%|████████▋ | 321360/371472 [3:23:45<3:56:57,  3.52it/s]
 87%|████████▋ | 321361/371472 [3:23:46<3:53:32,  3.58it/s]
 87%|████████▋ | 321362/371472 [3:23:46<4:11:34,  3.32it/s]
 87%|████████▋ | 321363/371472 [3:23:46<4:04:37,  3.41it/s]
 87%|████████▋ | 321364/371472 [3:23:47<3:58:11,  3.51it/s]
 87%|████████▋ | 321365/371472 [3:23:47<4:15:51,  3.26it/s]
 87%|████████▋ | 321366/371472 [3:23:47<4:11:36,  3.32it/s]
 87%|████████▋ | 321367/371472 [3:23:48<4:06:48,  3.38it/s]
 87%|████████▋ | 321368/371472 [3:23:48<4:00:58,  3.47it/s]
 87%|████████▋ | 321369/371472 [3:23:48<3:54:57,  3.55it/s]
 87%|████████▋ | 321370/371472 [3:23:48<3:50:19,  3.63it/s]
 87%|████████▋ | 321371/371472 [3:23:49<3:40:25,  3.79it/s]
 87%|████████▋ | 321372/371472 [3:23:49<3:59:55,  3.48it/s]
 87%|████████▋ | 321373/371472 [3:23:49<3:56:58,  3.52it/s]
 87%|████████▋ | 321374/371472 [3:23:49<3:55:10,  3.55it/s]
 87%|████████▋ | 321375/371472 [3:23:50<3:59:26,  3.49it/s]
 87%|████████▋ | 321376/371472 [3:23:50<3:55:38,  3.54it/s]
 87%|████████▋ | 321377/371472 [3:23:50<3:53:15,  3.58it/s]
 87%|████████▋ | 321378/371472 [3:23:51<3:56:35,  3.53it/s]
 87%|████████▋ | 321379/371472 [3:23:51<3:55:14,  3.55it/s]
 87%|████████▋ | 321380/371472 [3:23:51<3:48:03,  3.66it/s]
                                                           
{'loss': 2.5968, 'learning_rate': 2.214279557844383e-07, 'epoch': 13.84}

 87%|████████▋ | 321380/371472 [3:23:51<3:48:03,  3.66it/s]
 87%|████████▋ | 321381/371472 [3:23:51<3:43:21,  3.74it/s]
 87%|████████▋ | 321382/371472 [3:23:52<3:42:50,  3.75it/s]
 87%|████████▋ | 321383/371472 [3:23:52<3:51:56,  3.60it/s]
 87%|████████▋ | 321384/371472 [3:23:52<4:13:06,  3.30it/s]
 87%|████████▋ | 321385/371472 [3:23:53<4:05:46,  3.40it/s]
 87%|████████▋ | 321386/371472 [3:23:53<3:59:38,  3.48it/s]
 87%|████████▋ | 321387/371472 [3:23:53<3:53:09,  3.58it/s]
 87%|████████▋ | 321388/371472 [3:23:53<4:10:08,  3.34it/s]
 87%|████████▋ | 321389/371472 [3:23:54<4:04:28,  3.41it/s]
 87%|████████▋ | 321390/371472 [3:23:54<3:56:18,  3.53it/s]
 87%|████████▋ | 321391/371472 [3:23:54<4:13:31,  3.29it/s]
 87%|████████▋ | 321392/371472 [3:23:55<4:41:01,  2.97it/s]
 87%|████████▋ | 321393/371472 [3:23:55<4:26:10,  3.14it/s]
 87%|████████▋ | 321394/371472 [3:23:55<4:07:52,  3.37it/s]
 87%|████████▋ | 321395/371472 [3:23:56<3:52:19,  3.59it/s]
 87%|████████▋ | 321396/371472 [3:23:56<3:57:39,  3.51it/s]
 87%|████████▋ | 321397/371472 [3:23:56<3:54:34,  3.56it/s]
 87%|████████▋ | 321398/371472 [3:23:56<3:49:01,  3.64it/s]
 87%|████████▋ | 321399/371472 [3:23:57<4:09:37,  3.34it/s]
 87%|████████▋ | 321400/371472 [3:23:57<4:08:09,  3.36it/s]
                                                           
{'loss': 2.6682, 'learning_rate': 2.2137947380895946e-07, 'epoch': 13.84}

 87%|████████▋ | 321400/371472 [3:23:57<4:08:09,  3.36it/s]
 87%|████████▋ | 321401/371472 [3:23:57<4:06:12,  3.39it/s]
 87%|████████▋ | 321402/371472 [3:23:58<4:05:32,  3.40it/s]
 87%|████████▋ | 321403/371472 [3:23:58<3:49:39,  3.63it/s]
 87%|████████▋ | 321404/371472 [3:23:58<3:56:49,  3.52it/s]
 87%|████████▋ | 321405/371472 [3:23:58<3:59:34,  3.48it/s]
 87%|████████▋ | 321406/371472 [3:23:59<4:08:19,  3.36it/s]
 87%|████████▋ | 321407/371472 [3:23:59<3:56:06,  3.53it/s]
 87%|████████▋ | 321408/371472 [3:23:59<4:03:19,  3.43it/s]
 87%|████████▋ | 321409/371472 [3:24:00<4:13:55,  3.29it/s]
 87%|████████▋ | 321410/371472 [3:24:00<4:08:46,  3.35it/s]
 87%|████████▋ | 321411/371472 [3:24:00<3:59:45,  3.48it/s]
 87%|████████▋ | 321412/371472 [3:24:00<3:49:51,  3.63it/s]
 87%|████████▋ | 321413/371472 [3:24:01<3:49:23,  3.64it/s]
 87%|████████▋ | 321414/371472 [3:24:01<3:46:57,  3.68it/s]
 87%|████████▋ | 321415/371472 [3:24:01<3:54:01,  3.56it/s]
 87%|████████▋ | 321416/371472 [3:24:02<4:00:23,  3.47it/s]
 87%|████████▋ | 321417/371472 [3:24:02<4:02:26,  3.44it/s]
 87%|████████▋ | 321418/371472 [3:24:02<4:03:24,  3.43it/s]
 87%|████████▋ | 321419/371472 [3:24:02<3:54:31,  3.56it/s]
 87%|████████▋ | 321420/371472 [3:24:03<3:53:18,  3.58it/s]
                                                           
{'loss': 2.6776, 'learning_rate': 2.2133099183348053e-07, 'epoch': 13.84}

 87%|████████▋ | 321420/371472 [3:24:03<3:53:18,  3.58it/s]
 87%|████████▋ | 321421/371472 [3:24:03<3:57:39,  3.51it/s]
 87%|████████▋ | 321422/371472 [3:24:03<3:51:49,  3.60it/s]
 87%|████████▋ | 321423/371472 [3:24:04<3:54:31,  3.56it/s]
 87%|████████▋ | 321424/371472 [3:24:04<3:44:13,  3.72it/s]
 87%|████████▋ | 321425/371472 [3:24:04<3:46:47,  3.68it/s]
 87%|████████▋ | 321426/371472 [3:24:04<3:45:16,  3.70it/s]
 87%|████████▋ | 321427/371472 [3:24:05<4:56:05,  2.82it/s]
 87%|████████▋ | 321428/371472 [3:24:05<4:57:39,  2.80it/s]
 87%|████████▋ | 321429/371472 [3:24:06<4:32:39,  3.06it/s]
 87%|████████▋ | 321430/371472 [3:24:06<4:33:38,  3.05it/s]
 87%|████████▋ | 321431/371472 [3:24:06<4:27:01,  3.12it/s]
 87%|████████▋ | 321432/371472 [3:24:06<4:11:21,  3.32it/s]
 87%|████████▋ | 321433/371472 [3:24:07<4:25:37,  3.14it/s]
 87%|████████▋ | 321434/371472 [3:24:07<4:08:44,  3.35it/s]
 87%|████████▋ | 321435/371472 [3:24:07<3:57:45,  3.51it/s]
 87%|████████▋ | 321436/371472 [3:24:08<3:53:44,  3.57it/s]
 87%|████████▋ | 321437/371472 [3:24:08<3:52:47,  3.58it/s]
 87%|████████▋ | 321438/371472 [3:24:08<3:51:55,  3.60it/s]
 87%|████████▋ | 321439/371472 [3:24:08<3:49:44,  3.63it/s]
 87%|████████▋ | 321440/371472 [3:24:09<4:00:43,  3.46it/s]
                                                           
{'loss': 2.5416, 'learning_rate': 2.2128250985800168e-07, 'epoch': 13.85}

 87%|████████▋ | 321440/371472 [3:24:09<4:00:43,  3.46it/s]
 87%|████████▋ | 321441/371472 [3:24:09<3:53:26,  3.57it/s]
 87%|████████▋ | 321442/371472 [3:24:09<3:49:59,  3.63it/s]
 87%|████████▋ | 321443/371472 [3:24:10<3:54:08,  3.56it/s]
 87%|████████▋ | 321444/371472 [3:24:10<4:03:25,  3.43it/s]
 87%|████████▋ | 321445/371472 [3:24:10<4:10:54,  3.32it/s]
 87%|████████▋ | 321446/371472 [3:24:10<4:10:32,  3.33it/s]
 87%|████████▋ | 321447/371472 [3:24:11<4:10:32,  3.33it/s]
 87%|████████▋ | 321448/371472 [3:24:11<4:02:23,  3.44it/s]
 87%|████████▋ | 321449/371472 [3:24:11<4:02:38,  3.44it/s]
 87%|████████▋ | 321450/371472 [3:24:12<4:21:56,  3.18it/s]
 87%|████████▋ | 321451/371472 [3:24:12<4:03:12,  3.43it/s]
 87%|████████▋ | 321452/371472 [3:24:12<3:55:04,  3.55it/s]
 87%|████████▋ | 321453/371472 [3:24:12<3:56:20,  3.53it/s]
 87%|████████▋ | 321454/371472 [3:24:13<4:02:02,  3.44it/s]
 87%|████████▋ | 321455/371472 [3:24:13<3:59:20,  3.48it/s]
 87%|████████▋ | 321456/371472 [3:24:13<3:52:09,  3.59it/s]
 87%|████████▋ | 321457/371472 [3:24:14<3:41:43,  3.76it/s]
 87%|████████▋ | 321458/371472 [3:24:14<3:46:19,  3.68it/s]
 87%|████████▋ | 321459/371472 [3:24:14<3:49:36,  3.63it/s]
 87%|████████▋ | 321460/371472 [3:24:14<4:01:19,  3.45it/s]
                                                           
{'loss': 2.5542, 'learning_rate': 2.2123402788252275e-07, 'epoch': 13.85}

 87%|████████▋ | 321460/371472 [3:24:14<4:01:19,  3.45it/s]
 87%|████████▋ | 321461/371472 [3:24:15<3:59:43,  3.48it/s]
 87%|████████▋ | 321462/371472 [3:24:15<3:49:49,  3.63it/s]
 87%|████████▋ | 321463/371472 [3:24:15<3:38:10,  3.82it/s]
 87%|████████▋ | 321464/371472 [3:24:15<3:37:09,  3.84it/s]
 87%|████████▋ | 321465/371472 [3:24:16<3:33:05,  3.91it/s]
 87%|████████▋ | 321466/371472 [3:24:16<3:46:21,  3.68it/s]
 87%|████████▋ | 321467/371472 [3:24:16<4:07:58,  3.36it/s]
 87%|████████▋ | 321468/371472 [3:24:17<4:03:03,  3.43it/s]
 87%|████████▋ | 321469/371472 [3:24:17<3:53:43,  3.57it/s]
 87%|████████▋ | 321470/371472 [3:24:17<3:49:57,  3.62it/s]
 87%|████████▋ | 321471/371472 [3:24:17<3:47:25,  3.66it/s]
 87%|████████▋ | 321472/371472 [3:24:18<3:55:33,  3.54it/s]
 87%|████████▋ | 321473/371472 [3:24:18<3:56:46,  3.52it/s]
 87%|████████▋ | 321474/371472 [3:24:18<4:01:33,  3.45it/s]
 87%|████████▋ | 321475/371472 [3:24:19<4:11:44,  3.31it/s]
 87%|████████▋ | 321476/371472 [3:24:19<4:05:01,  3.40it/s]
 87%|████████▋ | 321477/371472 [3:24:19<3:51:12,  3.60it/s]
 87%|████████▋ | 321478/371472 [3:24:20<4:16:04,  3.25it/s]
 87%|████████▋ | 321479/371472 [3:24:20<4:03:04,  3.43it/s]
 87%|████████▋ | 321480/371472 [3:24:20<4:01:10,  3.45it/s]
                                                           
{'loss': 2.4092, 'learning_rate': 2.211855459070439e-07, 'epoch': 13.85}

 87%|████████▋ | 321480/371472 [3:24:20<4:01:10,  3.45it/s]
 87%|████████▋ | 321481/371472 [3:24:20<3:58:26,  3.49it/s]
 87%|████████▋ | 321482/371472 [3:24:21<3:58:09,  3.50it/s]
 87%|████████▋ | 321483/371472 [3:24:21<4:13:53,  3.28it/s]
 87%|████████▋ | 321484/371472 [3:24:21<4:06:49,  3.38it/s]
 87%|████████▋ | 321485/371472 [3:24:22<3:53:18,  3.57it/s]
 87%|████████▋ | 321486/371472 [3:24:22<3:57:31,  3.51it/s]
 87%|████████▋ | 321487/371472 [3:24:22<4:01:10,  3.45it/s]
 87%|████████▋ | 321488/371472 [3:24:22<3:51:16,  3.60it/s]
 87%|████████▋ | 321489/371472 [3:24:23<3:40:23,  3.78it/s]
 87%|████████▋ | 321490/371472 [3:24:23<3:42:00,  3.75it/s]
 87%|████████▋ | 321491/371472 [3:24:23<3:35:43,  3.86it/s]
 87%|████████▋ | 321492/371472 [3:24:23<3:34:25,  3.88it/s]
 87%|████████▋ | 321493/371472 [3:24:24<3:48:18,  3.65it/s]
 87%|████████▋ | 321494/371472 [3:24:24<3:43:25,  3.73it/s]
 87%|████████▋ | 321495/371472 [3:24:24<3:55:08,  3.54it/s]
 87%|████████▋ | 321496/371472 [3:24:25<3:59:00,  3.48it/s]
 87%|████████▋ | 321497/371472 [3:24:25<4:00:20,  3.47it/s]
 87%|████████▋ | 321498/371472 [3:24:25<4:11:41,  3.31it/s]
 87%|████████▋ | 321499/371472 [3:24:25<4:08:16,  3.35it/s]
 87%|████████▋ | 321500/371472 [3:24:26<4:13:25,  3.29it/s]
                                                           
{'loss': 2.5509, 'learning_rate': 2.2113706393156495e-07, 'epoch': 13.85}

 87%|████████▋ | 321500/371472 [3:24:26<4:13:25,  3.29it/s]
 87%|████████▋ | 321501/371472 [3:24:26<4:04:49,  3.40it/s]
 87%|████████▋ | 321502/371472 [3:24:26<4:04:26,  3.41it/s]
 87%|████████▋ | 321503/371472 [3:24:27<4:05:25,  3.39it/s]
 87%|████████▋ | 321504/371472 [3:24:27<3:59:30,  3.48it/s]
 87%|████████▋ | 321505/371472 [3:24:27<3:57:28,  3.51it/s]
 87%|████████▋ | 321506/371472 [3:24:27<3:51:48,  3.59it/s]
 87%|████████▋ | 321507/371472 [3:24:28<3:50:44,  3.61it/s]
 87%|████████▋ | 321508/371472 [3:24:28<3:57:14,  3.51it/s]
 87%|████████▋ | 321509/371472 [3:24:28<3:51:19,  3.60it/s]
 87%|████████▋ | 321510/371472 [3:24:29<3:41:58,  3.75it/s]
 87%|████████▋ | 321511/371472 [3:24:29<3:43:25,  3.73it/s]
 87%|████████▋ | 321512/371472 [3:24:29<4:11:53,  3.31it/s]
 87%|████████▋ | 321513/371472 [3:24:29<4:05:28,  3.39it/s]
 87%|████████▋ | 321514/371472 [3:24:30<4:28:36,  3.10it/s]
 87%|████████▋ | 321515/371472 [3:24:30<4:15:04,  3.26it/s]
 87%|████████▋ | 321516/371472 [3:24:30<4:04:39,  3.40it/s]
 87%|████████▋ | 321517/371472 [3:24:31<4:00:02,  3.47it/s]
 87%|████████▋ | 321518/371472 [3:24:31<3:52:33,  3.58it/s]
 87%|████████▋ | 321519/371472 [3:24:31<3:51:49,  3.59it/s]
 87%|████████▋ | 321520/371472 [3:24:31<3:48:50,  3.64it/s]
                                                           
{'loss': 2.6794, 'learning_rate': 2.2108858195608613e-07, 'epoch': 13.85}

 87%|████████▋ | 321520/371472 [3:24:31<3:48:50,  3.64it/s]
 87%|████████▋ | 321521/371472 [3:24:32<3:42:19,  3.74it/s]
 87%|████████▋ | 321522/371472 [3:24:32<3:46:25,  3.68it/s]
 87%|████████▋ | 321523/371472 [3:24:32<3:48:10,  3.65it/s]
 87%|████████▋ | 321524/371472 [3:24:33<3:45:30,  3.69it/s]
 87%|████████▋ | 321525/371472 [3:24:33<3:55:40,  3.53it/s]
 87%|████████▋ | 321526/371472 [3:24:33<3:51:54,  3.59it/s]
 87%|████████▋ | 321527/371472 [3:24:33<3:42:34,  3.74it/s]
 87%|████████▋ | 321528/371472 [3:24:34<3:50:26,  3.61it/s]
 87%|████████▋ | 321529/371472 [3:24:34<3:41:46,  3.75it/s]
 87%|████████▋ | 321530/371472 [3:24:34<3:39:39,  3.79it/s]
 87%|████████▋ | 321531/371472 [3:24:34<3:44:22,  3.71it/s]
 87%|████████▋ | 321532/371472 [3:24:35<3:39:04,  3.80it/s]
 87%|████████▋ | 321533/371472 [3:24:35<4:04:55,  3.40it/s]
 87%|████████▋ | 321534/371472 [3:24:35<3:53:08,  3.57it/s]
 87%|████████▋ | 321535/371472 [3:24:36<4:06:42,  3.37it/s]
 87%|████████▋ | 321536/371472 [3:24:36<4:03:49,  3.41it/s]
 87%|████████▋ | 321537/371472 [3:24:36<4:03:48,  3.41it/s]
 87%|████████▋ | 321538/371472 [3:24:36<3:53:56,  3.56it/s]
 87%|████████▋ | 321539/371472 [3:24:37<3:45:10,  3.70it/s]
 87%|████████▋ | 321540/371472 [3:24:37<3:49:19,  3.63it/s]
                                                           
{'loss': 2.7076, 'learning_rate': 2.2104009998060715e-07, 'epoch': 13.85}

 87%|████████▋ | 321540/371472 [3:24:37<3:49:19,  3.63it/s]
 87%|████████▋ | 321541/371472 [3:24:37<3:55:54,  3.53it/s]
 87%|████████▋ | 321542/371472 [3:24:38<3:48:24,  3.64it/s]
 87%|████████▋ | 321543/371472 [3:24:38<3:52:43,  3.58it/s]
 87%|████████▋ | 321544/371472 [3:24:38<3:59:17,  3.48it/s]
 87%|████████▋ | 321545/371472 [3:24:38<3:57:28,  3.50it/s]
 87%|████████▋ | 321546/371472 [3:24:39<3:53:31,  3.56it/s]
 87%|████████▋ | 321547/371472 [3:24:39<3:58:30,  3.49it/s]
 87%|████████▋ | 321548/371472 [3:24:39<4:06:09,  3.38it/s]
 87%|████████▋ | 321549/371472 [3:24:40<4:00:26,  3.46it/s]
 87%|████████▋ | 321550/371472 [3:24:40<4:41:56,  2.95it/s]
 87%|████████▋ | 321551/371472 [3:24:40<4:40:55,  2.96it/s]
 87%|████████▋ | 321552/371472 [3:24:41<4:29:28,  3.09it/s]
 87%|████████▋ | 321553/371472 [3:24:41<4:11:02,  3.31it/s]
 87%|████████▋ | 321554/371472 [3:24:41<4:12:55,  3.29it/s]
 87%|████████▋ | 321555/371472 [3:24:41<4:02:21,  3.43it/s]
 87%|████████▋ | 321556/371472 [3:24:42<3:59:59,  3.47it/s]
 87%|████████▋ | 321557/371472 [3:24:42<4:02:25,  3.43it/s]
 87%|████████▋ | 321558/371472 [3:24:42<4:13:24,  3.28it/s]
 87%|████████▋ | 321559/371472 [3:24:43<4:21:24,  3.18it/s]
 87%|████████▋ | 321560/371472 [3:24:43<4:03:32,  3.42it/s]
                                                           
{'loss': 2.6216, 'learning_rate': 2.2099161800512832e-07, 'epoch': 13.85}

 87%|████████▋ | 321560/371472 [3:24:43<4:03:32,  3.42it/s]
 87%|████████▋ | 321561/371472 [3:24:43<4:02:08,  3.44it/s]
 87%|████████▋ | 321562/371472 [3:24:44<3:51:26,  3.59it/s]
 87%|████████▋ | 321563/371472 [3:24:44<3:47:00,  3.66it/s]
 87%|████████▋ | 321564/371472 [3:24:44<4:02:32,  3.43it/s]
 87%|████████▋ | 321565/371472 [3:24:44<3:50:29,  3.61it/s]
 87%|████████▋ | 321566/371472 [3:24:45<3:51:30,  3.59it/s]
 87%|████████▋ | 321567/371472 [3:24:45<3:41:14,  3.76it/s]
 87%|████████▋ | 321568/371472 [3:24:45<3:37:48,  3.82it/s]
 87%|████████▋ | 321569/371472 [3:24:45<3:32:29,  3.91it/s]
 87%|████████▋ | 321570/371472 [3:24:46<3:35:34,  3.86it/s]
 87%|████████▋ | 321571/371472 [3:24:46<3:46:53,  3.67it/s]
 87%|████████▋ | 321572/371472 [3:24:46<3:46:57,  3.66it/s]
 87%|████████▋ | 321573/371472 [3:24:46<3:39:04,  3.80it/s]
 87%|████████▋ | 321574/371472 [3:24:47<3:51:19,  3.60it/s]
 87%|████████▋ | 321575/371472 [3:24:47<3:41:47,  3.75it/s]
 87%|████████▋ | 321576/371472 [3:24:47<3:40:43,  3.77it/s]
 87%|████████▋ | 321577/371472 [3:24:48<3:45:48,  3.68it/s]
 87%|████████▋ | 321578/371472 [3:24:48<4:18:18,  3.22it/s]
 87%|████████▋ | 321579/371472 [3:24:48<4:05:02,  3.39it/s]
 87%|████████▋ | 321580/371472 [3:24:48<4:00:31,  3.46it/s]
                                                           
{'loss': 2.5382, 'learning_rate': 2.209431360296494e-07, 'epoch': 13.85}

 87%|████████▋ | 321580/371472 [3:24:49<4:00:31,  3.46it/s]
 87%|████████▋ | 321581/371472 [3:24:49<3:51:12,  3.60it/s]
 87%|████████▋ | 321582/371472 [3:24:49<3:40:56,  3.76it/s]
 87%|████████▋ | 321583/371472 [3:24:49<3:36:45,  3.84it/s]
 87%|████████▋ | 321584/371472 [3:24:50<3:49:40,  3.62it/s]
 87%|████████▋ | 321585/371472 [3:24:50<3:51:43,  3.59it/s]
 87%|████████▋ | 321586/371472 [3:24:50<3:45:07,  3.69it/s]
 87%|████████▋ | 321587/371472 [3:24:50<3:46:40,  3.67it/s]
 87%|████████▋ | 321588/371472 [3:24:51<3:44:25,  3.70it/s]
 87%|████████▋ | 321589/371472 [3:24:51<3:51:13,  3.60it/s]
 87%|████████▋ | 321590/371472 [3:24:51<3:53:40,  3.56it/s]
 87%|████████▋ | 321591/371472 [3:24:51<3:49:15,  3.63it/s]
 87%|████████▋ | 321592/371472 [3:24:52<4:05:39,  3.38it/s]
 87%|████████▋ | 321593/371472 [3:24:52<3:59:36,  3.47it/s]
 87%|████████▋ | 321594/371472 [3:24:52<3:55:31,  3.53it/s]
 87%|████████▋ | 321595/371472 [3:24:53<3:47:52,  3.65it/s]
 87%|████████▋ | 321596/371472 [3:24:53<3:44:22,  3.70it/s]
 87%|████████▋ | 321597/371472 [3:24:53<3:37:32,  3.82it/s]
 87%|████████▋ | 321598/371472 [3:24:53<3:43:02,  3.73it/s]
 87%|████████▋ | 321599/371472 [3:24:54<3:43:50,  3.71it/s]
 87%|████████▋ | 321600/371472 [3:24:54<3:36:28,  3.84it/s]
                                                           
{'loss': 2.6434, 'learning_rate': 2.2089465405417055e-07, 'epoch': 13.85}

 87%|████████▋ | 321600/371472 [3:24:54<3:36:28,  3.84it/s]
 87%|████████▋ | 321601/371472 [3:24:54<3:43:08,  3.72it/s]
 87%|████████▋ | 321602/371472 [3:24:54<3:35:01,  3.87it/s]
 87%|████████▋ | 321603/371472 [3:24:55<3:32:42,  3.91it/s]
 87%|████████▋ | 321604/371472 [3:24:55<3:38:37,  3.80it/s]
 87%|████████▋ | 321605/371472 [3:24:55<3:44:54,  3.70it/s]
 87%|████████▋ | 321606/371472 [3:24:56<3:40:32,  3.77it/s]
 87%|████████▋ | 321607/371472 [3:24:56<3:58:09,  3.49it/s]
 87%|████████▋ | 321608/371472 [3:24:56<4:02:07,  3.43it/s]
 87%|████████▋ | 321609/371472 [3:24:56<3:54:00,  3.55it/s]
 87%|████████▋ | 321610/371472 [3:24:57<3:56:20,  3.52it/s]
 87%|████████▋ | 321611/371472 [3:24:57<3:47:36,  3.65it/s]
 87%|████████▋ | 321612/371472 [3:24:57<3:50:35,  3.60it/s]
 87%|████████▋ | 321613/371472 [3:24:58<3:51:54,  3.58it/s]
 87%|████████▋ | 321614/371472 [3:24:58<4:18:42,  3.21it/s]
 87%|████████▋ | 321615/371472 [3:24:58<4:02:59,  3.42it/s]
 87%|████████▋ | 321616/371472 [3:24:58<3:59:18,  3.47it/s]
 87%|████████▋ | 321617/371472 [3:24:59<3:50:14,  3.61it/s]
 87%|████████▋ | 321618/371472 [3:24:59<3:44:23,  3.70it/s]
 87%|████████▋ | 321619/371472 [3:24:59<3:41:21,  3.75it/s]
 87%|████████▋ | 321620/371472 [3:24:59<3:40:46,  3.76it/s]
                                                           
{'loss': 2.6113, 'learning_rate': 2.2084617207869162e-07, 'epoch': 13.85}

 87%|████████▋ | 321620/371472 [3:24:59<3:40:46,  3.76it/s]
 87%|████████▋ | 321621/371472 [3:25:00<3:44:27,  3.70it/s]
 87%|████████▋ | 321622/371472 [3:25:00<4:04:12,  3.40it/s]
 87%|████████▋ | 321623/371472 [3:25:00<3:57:01,  3.51it/s]
 87%|████████▋ | 321624/371472 [3:25:01<4:04:51,  3.39it/s]
 87%|████████▋ | 321625/371472 [3:25:01<3:58:11,  3.49it/s]
 87%|████████▋ | 321626/371472 [3:25:01<3:54:29,  3.54it/s]
 87%|████████▋ | 321627/371472 [3:25:01<3:54:45,  3.54it/s]
 87%|████████▋ | 321628/371472 [3:25:02<3:48:23,  3.64it/s]
 87%|████████▋ | 321629/371472 [3:25:02<3:49:50,  3.61it/s]
 87%|████████▋ | 321630/371472 [3:25:02<3:58:02,  3.49it/s]
 87%|████████▋ | 321631/371472 [3:25:03<4:05:38,  3.38it/s]
 87%|████████▋ | 321632/371472 [3:25:03<4:02:51,  3.42it/s]
 87%|████████▋ | 321633/371472 [3:25:03<3:50:46,  3.60it/s]
 87%|████████▋ | 321634/371472 [3:25:03<3:46:55,  3.66it/s]
 87%|████████▋ | 321635/371472 [3:25:04<3:49:42,  3.62it/s]
 87%|████████▋ | 321636/371472 [3:25:04<3:44:28,  3.70it/s]
 87%|████████▋ | 321637/371472 [3:25:04<3:55:49,  3.52it/s]
 87%|████████▋ | 321638/371472 [3:25:05<3:48:05,  3.64it/s]
 87%|████████▋ | 321639/371472 [3:25:05<3:59:13,  3.47it/s]
 87%|████████▋ | 321640/371472 [3:25:05<3:58:16,  3.49it/s]
                                                           
{'loss': 2.6422, 'learning_rate': 2.2079769010321277e-07, 'epoch': 13.85}

 87%|████████▋ | 321640/371472 [3:25:05<3:58:16,  3.49it/s]
 87%|████████▋ | 321641/371472 [3:25:05<4:07:45,  3.35it/s]
 87%|████████▋ | 321642/371472 [3:25:06<3:54:57,  3.53it/s]
 87%|████████▋ | 321643/371472 [3:25:06<3:56:15,  3.52it/s]
 87%|████████▋ | 321644/371472 [3:25:06<4:01:29,  3.44it/s]
 87%|████████▋ | 321645/371472 [3:25:07<3:51:46,  3.58it/s]
 87%|████████▋ | 321646/371472 [3:25:07<3:41:01,  3.76it/s]
 87%|████████▋ | 321647/371472 [3:25:07<3:36:27,  3.84it/s]
 87%|████████▋ | 321648/371472 [3:25:07<3:47:18,  3.65it/s]
 87%|████████▋ | 321649/371472 [3:25:08<3:43:05,  3.72it/s]
 87%|████████▋ | 321650/371472 [3:25:08<3:42:41,  3.73it/s]
 87%|████████▋ | 321651/371472 [3:25:08<3:43:15,  3.72it/s]
 87%|████████▋ | 321652/371472 [3:25:08<3:47:26,  3.65it/s]
 87%|████████▋ | 321653/371472 [3:25:09<3:48:22,  3.64it/s]
 87%|████████▋ | 321654/371472 [3:25:09<3:49:09,  3.62it/s]
 87%|████████▋ | 321655/371472 [3:25:09<4:00:23,  3.45it/s]
 87%|████████▋ | 321656/371472 [3:25:10<3:55:56,  3.52it/s]
 87%|████████▋ | 321657/371472 [3:25:10<3:46:59,  3.66it/s]
 87%|████████▋ | 321658/371472 [3:25:10<3:58:48,  3.48it/s]
 87%|████████▋ | 321659/371472 [3:25:10<4:00:04,  3.46it/s]
 87%|████████▋ | 321660/371472 [3:25:11<4:13:30,  3.27it/s]
                                                           
{'loss': 2.697, 'learning_rate': 2.207492081277338e-07, 'epoch': 13.85}

 87%|████████▋ | 321660/371472 [3:25:11<4:13:30,  3.27it/s]
 87%|████████▋ | 321661/371472 [3:25:11<4:05:20,  3.38it/s]
 87%|████████▋ | 321662/371472 [3:25:11<3:55:26,  3.53it/s]
 87%|████████▋ | 321663/371472 [3:25:12<3:52:18,  3.57it/s]
 87%|████████▋ | 321664/371472 [3:25:12<3:47:08,  3.65it/s]
 87%|████████▋ | 321665/371472 [3:25:12<3:41:28,  3.75it/s]
 87%|████████▋ | 321666/371472 [3:25:12<3:39:36,  3.78it/s]
 87%|████████▋ | 321667/371472 [3:25:13<3:40:57,  3.76it/s]
 87%|████████▋ | 321668/371472 [3:25:13<4:06:21,  3.37it/s]
 87%|████████▋ | 321669/371472 [3:25:13<4:18:55,  3.21it/s]
 87%|████████▋ | 321670/371472 [3:25:14<4:05:58,  3.37it/s]
 87%|████████▋ | 321671/371472 [3:25:14<4:17:17,  3.23it/s]
 87%|████████▋ | 321672/371472 [3:25:14<4:09:06,  3.33it/s]
 87%|████████▋ | 321673/371472 [3:25:14<3:58:20,  3.48it/s]
 87%|████████▋ | 321674/371472 [3:25:15<4:03:59,  3.40it/s]
 87%|████████▋ | 321675/371472 [3:25:15<3:49:39,  3.61it/s]
 87%|████████▋ | 321676/371472 [3:25:15<3:54:16,  3.54it/s]
 87%|████████▋ | 321677/371472 [3:25:16<3:44:30,  3.70it/s]
 87%|████████▋ | 321678/371472 [3:25:16<4:00:03,  3.46it/s]
 87%|████████▋ | 321679/371472 [3:25:16<4:05:35,  3.38it/s]
 87%|████████▋ | 321680/371472 [3:25:17<4:13:48,  3.27it/s]
                                                           
{'loss': 2.5194, 'learning_rate': 2.20700726152255e-07, 'epoch': 13.86}

 87%|████████▋ | 321680/371472 [3:25:17<4:13:48,  3.27it/s]
 87%|████████▋ | 321681/371472 [3:25:17<4:45:53,  2.90it/s]
 87%|████████▋ | 321682/371472 [3:25:17<5:16:42,  2.62it/s]
 87%|████████▋ | 321683/371472 [3:25:18<4:45:02,  2.91it/s]
 87%|████████▋ | 321684/371472 [3:25:18<4:29:04,  3.08it/s]
 87%|████████▋ | 321685/371472 [3:25:18<4:10:52,  3.31it/s]
 87%|████████▋ | 321686/371472 [3:25:19<4:10:52,  3.31it/s]
 87%|████████▋ | 321687/371472 [3:25:19<4:06:45,  3.36it/s]
 87%|████████▋ | 321688/371472 [3:25:19<3:56:20,  3.51it/s]
 87%|████████▋ | 321689/371472 [3:25:19<3:46:02,  3.67it/s]
 87%|████████▋ | 321690/371472 [3:25:20<3:38:51,  3.79it/s]
 87%|████████▋ | 321691/371472 [3:25:20<3:35:59,  3.84it/s]
 87%|████████▋ | 321692/371472 [3:25:20<3:35:13,  3.85it/s]
 87%|████████▋ | 321693/371472 [3:25:20<3:40:36,  3.76it/s]
 87%|████████▋ | 321694/371472 [3:25:21<3:32:37,  3.90it/s]
 87%|████████▋ | 321695/371472 [3:25:21<3:35:18,  3.85it/s]
 87%|████████▋ | 321696/371472 [3:25:21<3:37:31,  3.81it/s]
 87%|████████▋ | 321697/371472 [3:25:21<3:32:11,  3.91it/s]
 87%|████████▋ | 321698/371472 [3:25:22<3:41:02,  3.75it/s]
 87%|████████▋ | 321699/371472 [3:25:22<3:40:26,  3.76it/s]
 87%|████████▋ | 321700/371472 [3:25:22<3:46:15,  3.67it/s]
                                                           
{'loss': 2.6975, 'learning_rate': 2.2065224417677604e-07, 'epoch': 13.86}

 87%|████████▋ | 321700/371472 [3:25:22<3:46:15,  3.67it/s]
 87%|████████▋ | 321701/371472 [3:25:23<3:58:47,  3.47it/s]
 87%|████████▋ | 321702/371472 [3:25:23<4:26:33,  3.11it/s]
 87%|████████▋ | 321703/371472 [3:25:23<4:17:30,  3.22it/s]
 87%|████████▋ | 321704/371472 [3:25:23<4:07:30,  3.35it/s]
 87%|████████▋ | 321705/371472 [3:25:24<3:56:20,  3.51it/s]
 87%|████████▋ | 321706/371472 [3:25:24<4:15:36,  3.24it/s]
 87%|████████▋ | 321707/371472 [3:25:24<4:09:44,  3.32it/s]
 87%|████████▋ | 321708/371472 [3:25:25<4:10:04,  3.32it/s]
 87%|████████▋ | 321709/371472 [3:25:25<4:12:32,  3.28it/s]
 87%|████████▋ | 321710/371472 [3:25:25<3:57:40,  3.49it/s]
 87%|████████▋ | 321711/371472 [3:25:26<4:02:42,  3.42it/s]
 87%|████████▋ | 321712/371472 [3:25:26<3:51:25,  3.58it/s]
 87%|████████▋ | 321713/371472 [3:25:26<3:52:44,  3.56it/s]
 87%|████████▋ | 321714/371472 [3:25:26<3:54:15,  3.54it/s]
 87%|████████▋ | 321715/371472 [3:25:27<4:17:51,  3.22it/s]
 87%|████████▋ | 321716/371472 [3:25:27<4:06:11,  3.37it/s]
 87%|████████▋ | 321717/371472 [3:25:27<4:09:23,  3.33it/s]
 87%|████████▋ | 321718/371472 [3:25:28<3:57:34,  3.49it/s]
 87%|████████▋ | 321719/371472 [3:25:28<4:27:58,  3.09it/s]
 87%|████████▋ | 321720/371472 [3:25:28<4:15:36,  3.24it/s]
                                                           
{'loss': 2.681, 'learning_rate': 2.206037622012972e-07, 'epoch': 13.86}

 87%|████████▋ | 321720/371472 [3:25:28<4:15:36,  3.24it/s]
 87%|████████▋ | 321721/371472 [3:25:29<4:04:30,  3.39it/s]
 87%|████████▋ | 321722/371472 [3:25:29<4:09:18,  3.33it/s]
 87%|████████▋ | 321723/371472 [3:25:29<3:59:28,  3.46it/s]
 87%|████████▋ | 321724/371472 [3:25:29<4:02:38,  3.42it/s]
 87%|████████▋ | 321725/371472 [3:25:30<3:59:37,  3.46it/s]
 87%|████████▋ | 321726/371472 [3:25:30<3:46:44,  3.66it/s]
 87%|████████▋ | 321727/371472 [3:25:30<3:39:14,  3.78it/s]
 87%|████████▋ | 321728/371472 [3:25:30<3:41:58,  3.74it/s]
 87%|████████▋ | 321729/371472 [3:25:31<3:55:57,  3.51it/s]
 87%|████████▋ | 321730/371472 [3:25:31<3:49:06,  3.62it/s]
 87%|████████▋ | 321731/371472 [3:25:31<3:54:12,  3.54it/s]
 87%|████████▋ | 321732/371472 [3:25:32<4:10:43,  3.31it/s]
 87%|████████▋ | 321733/371472 [3:25:32<4:09:50,  3.32it/s]
 87%|████████▋ | 321734/371472 [3:25:32<4:00:14,  3.45it/s]
 87%|████████▋ | 321735/371472 [3:25:33<4:20:54,  3.18it/s]
 87%|████████▋ | 321736/371472 [3:25:33<4:11:41,  3.29it/s]
 87%|████████▋ | 321737/371472 [3:25:33<4:08:43,  3.33it/s]
 87%|████████▋ | 321738/371472 [3:25:33<4:00:26,  3.45it/s]
 87%|████████▋ | 321739/371472 [3:25:34<3:53:52,  3.54it/s]
 87%|████████▋ | 321740/371472 [3:25:34<3:48:18,  3.63it/s]
                                                           
{'loss': 2.5351, 'learning_rate': 2.2055528022581826e-07, 'epoch': 13.86}

 87%|████████▋ | 321740/371472 [3:25:34<3:48:18,  3.63it/s]
 87%|████████▋ | 321741/371472 [3:25:34<3:55:43,  3.52it/s]
 87%|████████▋ | 321742/371472 [3:25:35<3:56:51,  3.50it/s]
 87%|████████▋ | 321743/371472 [3:25:35<3:51:31,  3.58it/s]
 87%|████████▋ | 321744/371472 [3:25:35<3:53:58,  3.54it/s]
 87%|████████▋ | 321745/371472 [3:25:35<3:46:19,  3.66it/s]
 87%|████████▋ | 321746/371472 [3:25:36<3:53:03,  3.56it/s]
 87%|████████▋ | 321747/371472 [3:25:36<3:48:36,  3.63it/s]
 87%|████████▋ | 321748/371472 [3:25:36<4:09:14,  3.33it/s]
 87%|████████▋ | 321749/371472 [3:25:37<3:54:42,  3.53it/s]
 87%|████████▋ | 321750/371472 [3:25:37<3:50:24,  3.60it/s]
 87%|████████▋ | 321751/371472 [3:25:37<3:46:29,  3.66it/s]
 87%|████████▋ | 321752/371472 [3:25:37<3:49:35,  3.61it/s]
 87%|████████▋ | 321753/371472 [3:25:38<3:51:54,  3.57it/s]
 87%|████████▋ | 321754/371472 [3:25:38<3:45:33,  3.67it/s]
 87%|████████▋ | 321755/371472 [3:25:38<3:38:40,  3.79it/s]
 87%|████████▋ | 321756/371472 [3:25:38<3:36:26,  3.83it/s]
 87%|████████▋ | 321757/371472 [3:25:39<3:33:52,  3.87it/s]
 87%|████████▋ | 321758/371472 [3:25:39<4:01:42,  3.43it/s]
 87%|████████▋ | 321759/371472 [3:25:39<4:06:26,  3.36it/s]
 87%|████████▋ | 321760/371472 [3:25:40<3:52:37,  3.56it/s]
                                                           
{'loss': 2.6119, 'learning_rate': 2.205067982503394e-07, 'epoch': 13.86}

 87%|████████▋ | 321760/371472 [3:25:40<3:52:37,  3.56it/s]
 87%|████████▋ | 321761/371472 [3:25:40<4:41:07,  2.95it/s]
 87%|████████▋ | 321762/371472 [3:25:40<4:24:08,  3.14it/s]
 87%|████████▋ | 321763/371472 [3:25:41<4:27:27,  3.10it/s]
 87%|████████▋ | 321764/371472 [3:25:41<4:48:28,  2.87it/s]
 87%|████████▋ | 321765/371472 [3:25:41<4:23:54,  3.14it/s]
 87%|████████▋ | 321766/371472 [3:25:42<4:12:51,  3.28it/s]
 87%|████████▋ | 321767/371472 [3:25:42<4:06:50,  3.36it/s]
 87%|████████▋ | 321768/371472 [3:25:42<3:58:11,  3.48it/s]
 87%|████████▋ | 321769/371472 [3:25:42<4:09:51,  3.32it/s]
 87%|████████▋ | 321770/371472 [3:25:43<3:58:37,  3.47it/s]
 87%|████████▋ | 321771/371472 [3:25:43<3:53:07,  3.55it/s]
 87%|████████▋ | 321772/371472 [3:25:43<4:09:17,  3.32it/s]
 87%|████████▋ | 321773/371472 [3:25:44<4:00:26,  3.45it/s]
 87%|████████▋ | 321774/371472 [3:25:44<3:58:04,  3.48it/s]
 87%|████████▋ | 321775/371472 [3:25:44<3:49:20,  3.61it/s]
 87%|████████▋ | 321776/371472 [3:25:44<3:50:25,  3.59it/s]
 87%|████████▋ | 321777/371472 [3:25:45<3:52:33,  3.56it/s]
 87%|████████▋ | 321778/371472 [3:25:45<3:53:43,  3.54it/s]
 87%|████████▋ | 321779/371472 [3:25:45<3:53:39,  3.54it/s]
 87%|████████▋ | 321780/371472 [3:25:46<3:55:19,  3.52it/s]
                                                           
{'loss': 2.7103, 'learning_rate': 2.2045831627486048e-07, 'epoch': 13.86}

 87%|████████▋ | 321780/371472 [3:25:46<3:55:19,  3.52it/s]
 87%|████████▋ | 321781/371472 [3:25:46<3:50:59,  3.59it/s]
 87%|████████▋ | 321782/371472 [3:25:46<3:45:42,  3.67it/s]
 87%|████████▋ | 321783/371472 [3:25:46<3:46:28,  3.66it/s]
 87%|████████▋ | 321784/371472 [3:25:47<3:56:47,  3.50it/s]
 87%|████████▋ | 321785/371472 [3:25:47<3:50:10,  3.60it/s]
 87%|████████▋ | 321786/371472 [3:25:47<3:47:44,  3.64it/s]
 87%|████████▋ | 321787/371472 [3:25:47<3:53:45,  3.54it/s]
 87%|████████▋ | 321788/371472 [3:25:48<3:45:07,  3.68it/s]
 87%|████████▋ | 321789/371472 [3:25:48<3:49:09,  3.61it/s]
 87%|████████▋ | 321790/371472 [3:25:48<3:38:01,  3.80it/s]
 87%|████████▋ | 321791/371472 [3:25:48<3:32:50,  3.89it/s]
 87%|████████▋ | 321792/371472 [3:25:49<3:36:19,  3.83it/s]
 87%|████████▋ | 321793/371472 [3:25:49<4:07:01,  3.35it/s]
 87%|████████▋ | 321794/371472 [3:25:49<3:55:21,  3.52it/s]
 87%|████████▋ | 321795/371472 [3:25:50<3:46:21,  3.66it/s]
 87%|████████▋ | 321796/371472 [3:25:50<3:41:01,  3.75it/s]
 87%|████████▋ | 321797/371472 [3:25:50<4:20:51,  3.17it/s]
 87%|████████▋ | 321798/371472 [3:25:51<4:28:13,  3.09it/s]
 87%|████████▋ | 321799/371472 [3:25:51<4:08:54,  3.33it/s]
 87%|████████▋ | 321800/371472 [3:25:51<4:19:08,  3.19it/s]
                                                           
{'loss': 2.4373, 'learning_rate': 2.2040983429938163e-07, 'epoch': 13.86}

 87%|████████▋ | 321800/371472 [3:25:51<4:19:08,  3.19it/s]
 87%|████████▋ | 321801/371472 [3:25:52<4:09:43,  3.31it/s]
 87%|████████▋ | 321802/371472 [3:25:52<4:07:03,  3.35it/s]
 87%|████████▋ | 321803/371472 [3:25:52<4:02:43,  3.41it/s]
 87%|████████▋ | 321804/371472 [3:25:52<4:03:06,  3.41it/s]
 87%|████████▋ | 321805/371472 [3:25:53<3:54:09,  3.54it/s]
 87%|████████▋ | 321806/371472 [3:25:53<3:52:50,  3.55it/s]
 87%|████████▋ | 321807/371472 [3:25:53<4:05:59,  3.36it/s]
 87%|████████▋ | 321808/371472 [3:25:54<4:02:22,  3.42it/s]
 87%|████████▋ | 321809/371472 [3:25:54<3:57:01,  3.49it/s]
 87%|████████▋ | 321810/371472 [3:25:54<3:56:17,  3.50it/s]
 87%|████████▋ | 321811/371472 [3:25:54<4:22:10,  3.16it/s]
 87%|████████▋ | 321812/371472 [3:25:55<4:05:28,  3.37it/s]
 87%|████████▋ | 321813/371472 [3:25:55<3:57:47,  3.48it/s]
 87%|████████▋ | 321814/371472 [3:25:55<3:51:34,  3.57it/s]
 87%|████████▋ | 321815/371472 [3:25:56<3:49:48,  3.60it/s]
 87%|████████▋ | 321816/371472 [3:25:56<3:44:10,  3.69it/s]
 87%|████████▋ | 321817/371472 [3:25:56<3:51:24,  3.58it/s]
 87%|████████▋ | 321818/371472 [3:25:56<3:47:40,  3.63it/s]
 87%|████████▋ | 321819/371472 [3:25:57<3:58:09,  3.47it/s]
 87%|████████▋ | 321820/371472 [3:25:57<4:01:42,  3.42it/s]
                                                           
{'loss': 2.6565, 'learning_rate': 2.2036135232390268e-07, 'epoch': 13.86}

 87%|████████▋ | 321820/371472 [3:25:57<4:01:42,  3.42it/s]
 87%|████████▋ | 321821/371472 [3:25:57<3:55:40,  3.51it/s]
 87%|████████▋ | 321822/371472 [3:25:58<3:49:48,  3.60it/s]
 87%|████████▋ | 321823/371472 [3:25:58<3:47:11,  3.64it/s]
 87%|████████▋ | 321824/371472 [3:25:58<3:54:35,  3.53it/s]
 87%|████████▋ | 321825/371472 [3:25:58<3:46:14,  3.66it/s]
 87%|████████▋ | 321826/371472 [3:25:59<3:43:07,  3.71it/s]
 87%|████████▋ | 321827/371472 [3:25:59<4:02:51,  3.41it/s]
 87%|████████▋ | 321828/371472 [3:25:59<3:50:42,  3.59it/s]
 87%|████████▋ | 321829/371472 [3:25:59<3:45:48,  3.66it/s]
 87%|████████▋ | 321830/371472 [3:26:00<4:18:18,  3.20it/s]
 87%|████████▋ | 321831/371472 [3:26:00<3:58:16,  3.47it/s]
 87%|████████▋ | 321832/371472 [3:26:00<3:54:09,  3.53it/s]
 87%|████████▋ | 321833/371472 [3:26:01<3:57:06,  3.49it/s]
 87%|████████▋ | 321834/371472 [3:26:01<4:11:41,  3.29it/s]
 87%|████████▋ | 321835/371472 [3:26:01<4:21:51,  3.16it/s]
 87%|████████▋ | 321836/371472 [3:26:02<4:09:30,  3.32it/s]
 87%|████████▋ | 321837/371472 [3:26:02<4:09:08,  3.32it/s]
 87%|████████▋ | 321838/371472 [3:26:02<4:06:57,  3.35it/s]
 87%|████████▋ | 321839/371472 [3:26:02<3:52:53,  3.55it/s]
 87%|████████▋ | 321840/371472 [3:26:03<4:03:16,  3.40it/s]
                                                           
{'loss': 2.5698, 'learning_rate': 2.2031287034842375e-07, 'epoch': 13.86}

 87%|████████▋ | 321840/371472 [3:26:03<4:03:16,  3.40it/s]
 87%|████████▋ | 321841/371472 [3:26:03<3:48:17,  3.62it/s]
 87%|████████▋ | 321842/371472 [3:26:03<3:44:12,  3.69it/s]
 87%|████████▋ | 321843/371472 [3:26:03<3:39:18,  3.77it/s]
 87%|████████▋ | 321844/371472 [3:26:04<3:55:05,  3.52it/s]
 87%|████████▋ | 321845/371472 [3:26:04<3:50:55,  3.58it/s]
 87%|████████▋ | 321846/371472 [3:26:04<3:40:37,  3.75it/s]
 87%|████████▋ | 321847/371472 [3:26:05<3:55:42,  3.51it/s]
 87%|████████▋ | 321848/371472 [3:26:05<3:50:51,  3.58it/s]
 87%|████████▋ | 321849/371472 [3:26:05<3:53:55,  3.54it/s]
 87%|████████▋ | 321850/371472 [3:26:06<3:55:11,  3.52it/s]
 87%|████████▋ | 321851/371472 [3:26:06<3:45:26,  3.67it/s]
 87%|████████▋ | 321852/371472 [3:26:06<3:45:16,  3.67it/s]
 87%|████████▋ | 321853/371472 [3:26:06<3:53:29,  3.54it/s]
 87%|████████▋ | 321854/371472 [3:26:07<4:05:34,  3.37it/s]
 87%|████████▋ | 321855/371472 [3:26:07<4:18:09,  3.20it/s]
 87%|████████▋ | 321856/371472 [3:26:07<4:11:57,  3.28it/s]
 87%|████████▋ | 321857/371472 [3:26:08<4:00:05,  3.44it/s]
 87%|████████▋ | 321858/371472 [3:26:08<3:52:32,  3.56it/s]
 87%|████████▋ | 321859/371472 [3:26:08<3:50:50,  3.58it/s]
 87%|████████▋ | 321860/371472 [3:26:08<3:55:01,  3.52it/s]
                                                           
{'loss': 2.6076, 'learning_rate': 2.202643883729449e-07, 'epoch': 13.86}

 87%|████████▋ | 321860/371472 [3:26:08<3:55:01,  3.52it/s]
 87%|████████▋ | 321861/371472 [3:26:09<3:47:22,  3.64it/s]
 87%|████████▋ | 321862/371472 [3:26:09<3:49:05,  3.61it/s]
 87%|████████▋ | 321863/371472 [3:26:09<4:17:58,  3.20it/s]
 87%|████████▋ | 321864/371472 [3:26:10<4:02:19,  3.41it/s]
 87%|████████▋ | 321865/371472 [3:26:10<3:54:36,  3.52it/s]
 87%|████████▋ | 321866/371472 [3:26:10<4:06:42,  3.35it/s]
 87%|████████▋ | 321867/371472 [3:26:10<4:16:05,  3.23it/s]
 87%|████████▋ | 321868/371472 [3:26:11<4:11:02,  3.29it/s]
 87%|████████▋ | 321869/371472 [3:26:11<4:12:43,  3.27it/s]
 87%|████████▋ | 321870/371472 [3:26:11<4:04:28,  3.38it/s]
 87%|████████▋ | 321871/371472 [3:26:12<3:56:49,  3.49it/s]
 87%|████████▋ | 321872/371472 [3:26:12<4:15:04,  3.24it/s]
 87%|████████▋ | 321873/371472 [3:26:12<3:59:51,  3.45it/s]
 87%|████████▋ | 321874/371472 [3:26:13<3:58:24,  3.47it/s]
 87%|████████▋ | 321875/371472 [3:26:13<3:45:10,  3.67it/s]
 87%|████████▋ | 321876/371472 [3:26:13<3:39:08,  3.77it/s]
 87%|████████▋ | 321877/371472 [3:26:13<3:40:23,  3.75it/s]
 87%|████████▋ | 321878/371472 [3:26:14<3:50:02,  3.59it/s]
 87%|████████▋ | 321879/371472 [3:26:14<3:52:20,  3.56it/s]
 87%|████████▋ | 321880/371472 [3:26:14<3:56:50,  3.49it/s]
                                                           
{'loss': 2.497, 'learning_rate': 2.2021590639746594e-07, 'epoch': 13.86}

 87%|████████▋ | 321880/371472 [3:26:14<3:56:50,  3.49it/s]
 87%|████████▋ | 321881/371472 [3:26:15<4:22:18,  3.15it/s]
 87%|████████▋ | 321882/371472 [3:26:15<4:17:34,  3.21it/s]
 87%|████████▋ | 321883/371472 [3:26:15<4:01:22,  3.42it/s]
 87%|████████▋ | 321884/371472 [3:26:15<3:58:02,  3.47it/s]
 87%|████████▋ | 321885/371472 [3:26:16<4:08:32,  3.33it/s]
 87%|████████▋ | 321886/371472 [3:26:16<4:03:27,  3.39it/s]
 87%|████████▋ | 321887/371472 [3:26:16<4:21:48,  3.16it/s]
 87%|████████▋ | 321888/371472 [3:26:17<4:21:50,  3.16it/s]
 87%|████████▋ | 321889/371472 [3:26:17<4:40:43,  2.94it/s]
 87%|████████▋ | 321890/371472 [3:26:17<4:22:09,  3.15it/s]
 87%|████████▋ | 321891/371472 [3:26:18<4:44:12,  2.91it/s]
 87%|████████▋ | 321892/371472 [3:26:18<4:25:53,  3.11it/s]
 87%|████████▋ | 321893/371472 [3:26:18<4:14:18,  3.25it/s]
 87%|████████▋ | 321894/371472 [3:26:19<4:46:38,  2.88it/s]
 87%|████████▋ | 321895/371472 [3:26:19<4:26:31,  3.10it/s]
 87%|████████▋ | 321896/371472 [3:26:19<4:04:40,  3.38it/s]
 87%|████████▋ | 321897/371472 [3:26:20<4:06:31,  3.35it/s]
 87%|████████▋ | 321898/371472 [3:26:20<3:56:48,  3.49it/s]
 87%|████████▋ | 321899/371472 [3:26:20<3:53:36,  3.54it/s]
 87%|████████▋ | 321900/371472 [3:26:20<3:49:13,  3.60it/s]
                                                           
{'loss': 2.578, 'learning_rate': 2.2016742442198712e-07, 'epoch': 13.86}

 87%|████████▋ | 321900/371472 [3:26:20<3:49:13,  3.60it/s]
 87%|████████▋ | 321901/371472 [3:26:21<3:53:11,  3.54it/s]
 87%|████████▋ | 321902/371472 [3:26:21<3:43:45,  3.69it/s]
 87%|████████▋ | 321903/371472 [3:26:21<3:49:12,  3.60it/s]
 87%|████████▋ | 321904/371472 [3:26:21<3:48:37,  3.61it/s]
 87%|████████▋ | 321905/371472 [3:26:22<3:52:03,  3.56it/s]
 87%|████████▋ | 321906/371472 [3:26:22<3:50:56,  3.58it/s]
 87%|████████▋ | 321907/371472 [3:26:22<3:56:28,  3.49it/s]
 87%|████████▋ | 321908/371472 [3:26:23<3:51:21,  3.57it/s]
 87%|████████▋ | 321909/371472 [3:26:23<3:44:49,  3.67it/s]
 87%|████████▋ | 321910/371472 [3:26:23<3:44:00,  3.69it/s]
 87%|████████▋ | 321911/371472 [3:26:23<3:47:09,  3.64it/s]
 87%|████████▋ | 321912/371472 [3:26:24<3:59:50,  3.44it/s]
 87%|████████▋ | 321913/371472 [3:26:24<3:51:09,  3.57it/s]
 87%|████████▋ | 321914/371472 [3:26:24<3:44:14,  3.68it/s]
 87%|████████▋ | 321915/371472 [3:26:24<3:45:26,  3.66it/s]
 87%|████████▋ | 321916/371472 [3:26:25<3:47:45,  3.63it/s]
 87%|████████▋ | 321917/371472 [3:26:25<3:49:58,  3.59it/s]
 87%|████████▋ | 321918/371472 [3:26:25<3:40:31,  3.75it/s]
 87%|████████▋ | 321919/371472 [3:26:26<3:48:51,  3.61it/s]
 87%|████████▋ | 321920/371472 [3:26:26<3:43:44,  3.69it/s]
                                                           
{'loss': 2.69, 'learning_rate': 2.2011894244650817e-07, 'epoch': 13.87}

 87%|████████▋ | 321920/371472 [3:26:26<3:43:44,  3.69it/s]
 87%|████████▋ | 321921/371472 [3:26:26<4:00:09,  3.44it/s]
 87%|████████▋ | 321922/371472 [3:26:26<3:47:37,  3.63it/s]
 87%|████████▋ | 321923/371472 [3:26:27<3:44:14,  3.68it/s]
 87%|████████▋ | 321924/371472 [3:26:27<3:46:21,  3.65it/s]
 87%|████████▋ | 321925/371472 [3:26:27<4:10:30,  3.30it/s]
 87%|████████▋ | 321926/371472 [3:26:28<4:00:46,  3.43it/s]
 87%|████████▋ | 321927/371472 [3:26:28<4:03:40,  3.39it/s]
 87%|████████▋ | 321928/371472 [3:26:28<4:02:31,  3.40it/s]
 87%|████████▋ | 321929/371472 [3:26:28<3:54:22,  3.52it/s]
 87%|████████▋ | 321930/371472 [3:26:29<3:45:42,  3.66it/s]
 87%|████████▋ | 321931/371472 [3:26:29<3:37:02,  3.80it/s]
 87%|████████▋ | 321932/371472 [3:26:29<3:42:33,  3.71it/s]
 87%|████████▋ | 321933/371472 [3:26:29<3:38:58,  3.77it/s]
 87%|████████▋ | 321934/371472 [3:26:30<3:44:10,  3.68it/s]
 87%|████████▋ | 321935/371472 [3:26:30<3:40:39,  3.74it/s]
 87%|████████▋ | 321936/371472 [3:26:30<3:50:44,  3.58it/s]
 87%|████████▋ | 321937/371472 [3:26:31<3:48:01,  3.62it/s]
 87%|████████▋ | 321938/371472 [3:26:31<3:42:11,  3.72it/s]
 87%|████████▋ | 321939/371472 [3:26:31<3:45:06,  3.67it/s]
 87%|████████▋ | 321940/371472 [3:26:31<3:50:54,  3.58it/s]
                                                           
{'loss': 2.683, 'learning_rate': 2.2007046047102932e-07, 'epoch': 13.87}

 87%|████████▋ | 321940/371472 [3:26:31<3:50:54,  3.58it/s]
 87%|████████▋ | 321941/371472 [3:26:32<3:54:59,  3.51it/s]
 87%|████████▋ | 321942/371472 [3:26:32<3:47:32,  3.63it/s]
 87%|████████▋ | 321943/371472 [3:26:32<3:50:40,  3.58it/s]
 87%|████████▋ | 321944/371472 [3:26:33<3:48:09,  3.62it/s]
 87%|████████▋ | 321945/371472 [3:26:33<3:41:42,  3.72it/s]
 87%|████████▋ | 321946/371472 [3:26:33<3:46:25,  3.65it/s]
 87%|████████▋ | 321947/371472 [3:26:33<3:46:43,  3.64it/s]
 87%|████████▋ | 321948/371472 [3:26:34<3:43:26,  3.69it/s]
 87%|████████▋ | 321949/371472 [3:26:34<3:38:03,  3.79it/s]
 87%|████████▋ | 321950/371472 [3:26:34<3:44:34,  3.68it/s]
 87%|████████▋ | 321951/371472 [3:26:34<3:56:33,  3.49it/s]
 87%|████████▋ | 321952/371472 [3:26:35<3:52:09,  3.56it/s]
 87%|████████▋ | 321953/371472 [3:26:35<3:59:10,  3.45it/s]
 87%|████████▋ | 321954/371472 [3:26:35<4:18:18,  3.19it/s]
 87%|████████▋ | 321955/371472 [3:26:36<4:01:37,  3.42it/s]
 87%|████████▋ | 321956/371472 [3:26:36<4:03:03,  3.40it/s]
 87%|████████▋ | 321957/371472 [3:26:36<4:20:46,  3.16it/s]
 87%|████████▋ | 321958/371472 [3:26:37<4:19:24,  3.18it/s]
 87%|████████▋ | 321959/371472 [3:26:37<4:16:32,  3.22it/s]
 87%|████████▋ | 321960/371472 [3:26:37<4:15:02,  3.24it/s]
                                                           
{'loss': 2.5411, 'learning_rate': 2.200219784955504e-07, 'epoch': 13.87}

 87%|████████▋ | 321960/371472 [3:26:37<4:15:02,  3.24it/s]
 87%|████████▋ | 321961/371472 [3:26:38<4:26:48,  3.09it/s]
 87%|████████▋ | 321962/371472 [3:26:38<4:07:55,  3.33it/s]
 87%|████████▋ | 321963/371472 [3:26:38<3:56:08,  3.49it/s]
 87%|████████▋ | 321964/371472 [3:26:38<3:51:27,  3.57it/s]
 87%|████████▋ | 321965/371472 [3:26:39<4:14:27,  3.24it/s]
 87%|████████▋ | 321966/371472 [3:26:39<4:04:38,  3.37it/s]
 87%|████████▋ | 321967/371472 [3:26:39<4:03:54,  3.38it/s]
 87%|████████▋ | 321968/371472 [3:26:40<3:56:02,  3.50it/s]
 87%|████████▋ | 321969/371472 [3:26:40<3:46:16,  3.65it/s]
 87%|████████▋ | 321970/371472 [3:26:40<3:50:29,  3.58it/s]
 87%|████████▋ | 321971/371472 [3:26:40<3:42:09,  3.71it/s]
 87%|████████▋ | 321972/371472 [3:26:41<3:52:50,  3.54it/s]
 87%|████████▋ | 321973/371472 [3:26:41<3:51:52,  3.56it/s]
 87%|████████▋ | 321974/371472 [3:26:41<4:12:57,  3.26it/s]
 87%|████████▋ | 321975/371472 [3:26:42<4:16:32,  3.22it/s]
 87%|████████▋ | 321976/371472 [3:26:42<4:00:19,  3.43it/s]
 87%|████████▋ | 321977/371472 [3:26:42<4:06:58,  3.34it/s]
 87%|████████▋ | 321978/371472 [3:26:42<3:55:34,  3.50it/s]
 87%|████████▋ | 321979/371472 [3:26:43<3:53:04,  3.54it/s]
 87%|████████▋ | 321980/371472 [3:26:43<4:01:53,  3.41it/s]
                                                           
{'loss': 2.6286, 'learning_rate': 2.1997349652007154e-07, 'epoch': 13.87}

 87%|████████▋ | 321980/371472 [3:26:43<4:01:53,  3.41it/s]
 87%|████████▋ | 321981/371472 [3:26:43<3:54:27,  3.52it/s]
 87%|████████▋ | 321982/371472 [3:26:44<3:45:37,  3.66it/s]
 87%|████████▋ | 321983/371472 [3:26:44<3:46:59,  3.63it/s]
 87%|████████▋ | 321984/371472 [3:26:44<3:49:39,  3.59it/s]
 87%|████████▋ | 321985/371472 [3:26:44<3:50:16,  3.58it/s]
 87%|████████▋ | 321986/371472 [3:26:45<3:40:42,  3.74it/s]
 87%|████████▋ | 321987/371472 [3:26:45<3:39:43,  3.75it/s]
 87%|████████▋ | 321988/371472 [3:26:45<3:55:34,  3.50it/s]
 87%|████████▋ | 321989/371472 [3:26:45<3:47:05,  3.63it/s]
 87%|████████▋ | 321990/371472 [3:26:46<3:51:12,  3.57it/s]
 87%|████████▋ | 321991/371472 [3:26:46<3:55:12,  3.51it/s]
 87%|████████▋ | 321992/371472 [3:26:46<4:03:06,  3.39it/s]
 87%|████████▋ | 321993/371472 [3:26:47<4:06:00,  3.35it/s]
 87%|████████▋ | 321994/371472 [3:26:47<3:59:31,  3.44it/s]
 87%|████████▋ | 321995/371472 [3:26:47<4:07:00,  3.34it/s]
 87%|████████▋ | 321996/371472 [3:26:48<4:15:29,  3.23it/s]
 87%|████████▋ | 321997/371472 [3:26:48<4:18:12,  3.19it/s]
 87%|████████▋ | 321998/371472 [3:26:48<4:31:39,  3.04it/s]
 87%|████████▋ | 321999/371472 [3:26:49<4:15:59,  3.22it/s]
 87%|████████▋ | 322000/371472 [3:26:49<4:07:16,  3.33it/s]
                                                           
{'loss': 2.6917, 'learning_rate': 2.199250145445926e-07, 'epoch': 13.87}

 87%|████████▋ | 322000/371472 [3:26:49<4:07:16,  3.33it/s]
 87%|████████▋ | 322001/371472 [3:26:49<3:57:35,  3.47it/s]
 87%|████████▋ | 322002/371472 [3:26:49<4:00:46,  3.42it/s]
 87%|████████▋ | 322003/371472 [3:26:50<3:55:39,  3.50it/s]
 87%|████████▋ | 322004/371472 [3:26:50<3:56:01,  3.49it/s]
 87%|████████▋ | 322005/371472 [3:26:50<3:58:35,  3.46it/s]
 87%|████████▋ | 322006/371472 [3:26:51<3:55:52,  3.50it/s]
 87%|████████▋ | 322007/371472 [3:26:51<3:51:28,  3.56it/s]
 87%|████████▋ | 322008/371472 [3:26:51<3:47:30,  3.62it/s]
 87%|████████▋ | 322009/371472 [3:26:51<3:41:44,  3.72it/s]
 87%|████████▋ | 322010/371472 [3:26:52<3:36:32,  3.81it/s]
 87%|████████▋ | 322011/371472 [3:26:52<3:49:04,  3.60it/s]
 87%|████████▋ | 322012/371472 [3:26:52<3:39:16,  3.76it/s]
 87%|████████▋ | 322013/371472 [3:26:52<3:50:59,  3.57it/s]
 87%|████████▋ | 322014/371472 [3:26:53<3:45:12,  3.66it/s]
 87%|████████▋ | 322015/371472 [3:26:53<3:40:30,  3.74it/s]
 87%|████████▋ | 322016/371472 [3:26:53<3:42:40,  3.70it/s]
 87%|████████▋ | 322017/371472 [3:26:53<3:38:49,  3.77it/s]
 87%|████████▋ | 322018/371472 [3:26:54<3:36:22,  3.81it/s]
 87%|████████▋ | 322019/371472 [3:26:54<3:34:36,  3.84it/s]
 87%|████████▋ | 322020/371472 [3:26:54<3:30:46,  3.91it/s]
                                                           
{'loss': 2.8502, 'learning_rate': 2.1987653256911376e-07, 'epoch': 13.87}

 87%|████████▋ | 322020/371472 [3:26:54<3:30:46,  3.91it/s]
 87%|████████▋ | 322021/371472 [3:26:54<3:25:46,  4.01it/s]
 87%|████████▋ | 322022/371472 [3:26:55<3:32:31,  3.88it/s]
 87%|████████▋ | 322023/371472 [3:26:55<3:31:37,  3.89it/s]
 87%|████████▋ | 322024/371472 [3:26:55<3:29:14,  3.94it/s]
 87%|████████▋ | 322025/371472 [3:26:56<3:32:08,  3.88it/s]
 87%|████████▋ | 322026/371472 [3:26:56<3:41:44,  3.72it/s]
 87%|████████▋ | 322027/371472 [3:26:56<3:40:52,  3.73it/s]
 87%|████████▋ | 322028/371472 [3:26:56<3:35:50,  3.82it/s]
 87%|████████▋ | 322029/371472 [3:26:57<3:35:40,  3.82it/s]
 87%|████████▋ | 322030/371472 [3:26:57<3:34:00,  3.85it/s]
 87%|████████▋ | 322031/371472 [3:26:57<3:39:20,  3.76it/s]
 87%|████████▋ | 322032/371472 [3:26:57<3:42:54,  3.70it/s]
 87%|████████▋ | 322033/371472 [3:26:58<3:40:33,  3.74it/s]
 87%|████████▋ | 322034/371472 [3:26:58<3:43:41,  3.68it/s]
 87%|████████▋ | 322035/371472 [3:26:58<4:04:02,  3.38it/s]
 87%|████████▋ | 322036/371472 [3:26:59<4:11:02,  3.28it/s]
 87%|████████▋ | 322037/371472 [3:26:59<4:00:57,  3.42it/s]
 87%|████████▋ | 322038/371472 [3:26:59<4:05:32,  3.36it/s]
 87%|████████▋ | 322039/371472 [3:27:00<4:04:45,  3.37it/s]
 87%|████████▋ | 322040/371472 [3:27:00<4:01:05,  3.42it/s]
                                                           
{'loss': 2.7536, 'learning_rate': 2.198280505936348e-07, 'epoch': 13.87}

 87%|████████▋ | 322040/371472 [3:27:00<4:01:05,  3.42it/s]
 87%|████████▋ | 322041/371472 [3:27:00<4:07:13,  3.33it/s]
 87%|████████▋ | 322042/371472 [3:27:00<3:54:10,  3.52it/s]
 87%|████████▋ | 322043/371472 [3:27:01<4:09:55,  3.30it/s]
 87%|████████▋ | 322044/371472 [3:27:01<4:11:43,  3.27it/s]
 87%|████████▋ | 322045/371472 [3:27:01<3:57:35,  3.47it/s]
 87%|████████▋ | 322046/371472 [3:27:02<3:55:02,  3.50it/s]
 87%|████████▋ | 322047/371472 [3:27:02<3:47:41,  3.62it/s]
 87%|████████▋ | 322048/371472 [3:27:02<3:54:03,  3.52it/s]
 87%|████████▋ | 322049/371472 [3:27:02<3:45:57,  3.65it/s]
 87%|████████▋ | 322050/371472 [3:27:03<4:00:26,  3.43it/s]
 87%|████████▋ | 322051/371472 [3:27:03<3:53:58,  3.52it/s]
 87%|████████▋ | 322052/371472 [3:27:03<3:49:48,  3.58it/s]
 87%|████████▋ | 322053/371472 [3:27:04<3:53:08,  3.53it/s]
 87%|████████▋ | 322054/371472 [3:27:04<3:50:35,  3.57it/s]
 87%|████████▋ | 322055/371472 [3:27:04<3:44:09,  3.67it/s]
 87%|████████▋ | 322056/371472 [3:27:04<3:45:22,  3.65it/s]
 87%|████████▋ | 322057/371472 [3:27:05<3:51:15,  3.56it/s]
 87%|████████▋ | 322058/371472 [3:27:05<4:08:53,  3.31it/s]
 87%|████████▋ | 322059/371472 [3:27:05<4:09:59,  3.29it/s]
 87%|████████▋ | 322060/371472 [3:27:05<3:53:00,  3.53it/s]
                                                           
{'loss': 2.568, 'learning_rate': 2.1977956861815598e-07, 'epoch': 13.87}

 87%|████████▋ | 322060/371472 [3:27:06<3:53:00,  3.53it/s]
 87%|████████▋ | 322061/371472 [3:27:06<3:47:04,  3.63it/s]
 87%|████████▋ | 322062/371472 [3:27:06<3:48:20,  3.61it/s]
 87%|████████▋ | 322063/371472 [3:27:06<3:45:48,  3.65it/s]
 87%|████████▋ | 322064/371472 [3:27:07<3:38:49,  3.76it/s]
 87%|████████▋ | 322065/371472 [3:27:07<3:59:03,  3.44it/s]
 87%|████████▋ | 322066/371472 [3:27:07<3:52:06,  3.55it/s]
 87%|████████▋ | 322067/371472 [3:27:07<3:49:10,  3.59it/s]
 87%|████████▋ | 322068/371472 [3:27:08<3:51:47,  3.55it/s]
 87%|████████▋ | 322069/371472 [3:27:08<3:46:12,  3.64it/s]
 87%|████████▋ | 322070/371472 [3:27:08<4:01:05,  3.42it/s]
 87%|████████▋ | 322071/371472 [3:27:09<4:03:10,  3.39it/s]
 87%|████████▋ | 322072/371472 [3:27:09<4:00:46,  3.42it/s]
 87%|████████▋ | 322073/371472 [3:27:09<3:56:45,  3.48it/s]
 87%|████████▋ | 322074/371472 [3:27:10<4:08:07,  3.32it/s]
 87%|████████▋ | 322075/371472 [3:27:10<4:06:06,  3.35it/s]
 87%|████████▋ | 322076/371472 [3:27:10<4:03:09,  3.39it/s]
 87%|████████▋ | 322077/371472 [3:27:10<3:55:54,  3.49it/s]
 87%|████████▋ | 322078/371472 [3:27:11<3:49:17,  3.59it/s]
 87%|████████▋ | 322079/371472 [3:27:11<3:48:03,  3.61it/s]
 87%|████████▋ | 322080/371472 [3:27:11<3:58:32,  3.45it/s]
                                                           
{'loss': 2.668, 'learning_rate': 2.1973108664267703e-07, 'epoch': 13.87}

 87%|████████▋ | 322080/371472 [3:27:11<3:58:32,  3.45it/s]
 87%|████████▋ | 322081/371472 [3:27:12<4:12:35,  3.26it/s]
 87%|████████▋ | 322082/371472 [3:27:12<4:20:47,  3.16it/s]
 87%|████████▋ | 322083/371472 [3:27:12<4:03:52,  3.38it/s]
 87%|████████▋ | 322084/371472 [3:27:12<3:57:38,  3.46it/s]
 87%|████████▋ | 322085/371472 [3:27:13<3:43:49,  3.68it/s]
 87%|████████▋ | 322086/371472 [3:27:13<3:41:20,  3.72it/s]
 87%|████████▋ | 322087/371472 [3:27:13<3:36:11,  3.81it/s]
 87%|████████▋ | 322088/371472 [3:27:13<3:44:54,  3.66it/s]
 87%|████████▋ | 322089/371472 [3:27:14<3:56:32,  3.48it/s]
 87%|████████▋ | 322090/371472 [3:27:14<3:48:51,  3.60it/s]
 87%|████████▋ | 322091/371472 [3:27:14<3:57:36,  3.46it/s]
 87%|████████▋ | 322092/371472 [3:27:15<3:47:00,  3.63it/s]
 87%|████████▋ | 322093/371472 [3:27:15<3:43:55,  3.68it/s]
 87%|████████▋ | 322094/371472 [3:27:15<3:43:37,  3.68it/s]
 87%|████████▋ | 322095/371472 [3:27:15<3:50:36,  3.57it/s]
 87%|████████▋ | 322096/371472 [3:27:16<3:44:11,  3.67it/s]
 87%|████████▋ | 322097/371472 [3:27:16<3:45:45,  3.65it/s]
 87%|████████▋ | 322098/371472 [3:27:16<3:49:08,  3.59it/s]
 87%|████████▋ | 322099/371472 [3:27:17<4:05:39,  3.35it/s]
 87%|████████▋ | 322100/371472 [3:27:17<3:51:47,  3.55it/s]
                                                           
{'loss': 2.4933, 'learning_rate': 2.1968260466719818e-07, 'epoch': 13.87}

 87%|████████▋ | 322100/371472 [3:27:17<3:51:47,  3.55it/s]
 87%|████████▋ | 322101/371472 [3:27:17<3:44:20,  3.67it/s]
 87%|████████▋ | 322102/371472 [3:27:17<3:41:05,  3.72it/s]
 87%|████████▋ | 322103/371472 [3:27:18<3:40:00,  3.74it/s]
 87%|████████▋ | 322104/371472 [3:27:18<3:33:41,  3.85it/s]
 87%|████████▋ | 322105/371472 [3:27:18<3:52:11,  3.54it/s]
 87%|████████▋ | 322106/371472 [3:27:18<3:49:27,  3.59it/s]
 87%|████████▋ | 322107/371472 [3:27:19<4:01:35,  3.41it/s]
 87%|████████▋ | 322108/371472 [3:27:19<4:04:00,  3.37it/s]
 87%|████████▋ | 322109/371472 [3:27:19<3:56:09,  3.48it/s]
 87%|████████▋ | 322110/371472 [3:27:20<4:06:21,  3.34it/s]
 87%|████████▋ | 322111/371472 [3:27:20<4:00:33,  3.42it/s]
 87%|████████▋ | 322112/371472 [3:27:20<4:03:39,  3.38it/s]
 87%|████████▋ | 322113/371472 [3:27:21<3:59:28,  3.44it/s]
 87%|████████▋ | 322114/371472 [3:27:21<3:51:37,  3.55it/s]
 87%|████████▋ | 322115/371472 [3:27:21<3:48:01,  3.61it/s]
 87%|████████▋ | 322116/371472 [3:27:21<3:42:23,  3.70it/s]
 87%|████████▋ | 322117/371472 [3:27:22<3:48:41,  3.60it/s]
 87%|████████▋ | 322118/371472 [3:27:22<3:42:45,  3.69it/s]
 87%|████████▋ | 322119/371472 [3:27:22<3:47:49,  3.61it/s]
 87%|████████▋ | 322120/371472 [3:27:22<3:51:47,  3.55it/s]
                                                           
{'loss': 2.6142, 'learning_rate': 2.1963412269171925e-07, 'epoch': 13.87}

 87%|████████▋ | 322120/371472 [3:27:22<3:51:47,  3.55it/s]
 87%|████████▋ | 322121/371472 [3:27:23<3:49:51,  3.58it/s]
 87%|████████▋ | 322122/371472 [3:27:23<3:57:04,  3.47it/s]
 87%|████████▋ | 322123/371472 [3:27:23<4:04:05,  3.37it/s]
 87%|████████▋ | 322124/371472 [3:27:24<3:58:36,  3.45it/s]
 87%|████████▋ | 322125/371472 [3:27:24<3:55:06,  3.50it/s]
 87%|████████▋ | 322126/371472 [3:27:24<3:51:50,  3.55it/s]
 87%|████████▋ | 322127/371472 [3:27:24<3:48:32,  3.60it/s]
 87%|████████▋ | 322128/371472 [3:27:25<3:54:04,  3.51it/s]
 87%|████████▋ | 322129/371472 [3:27:25<3:55:27,  3.49it/s]
 87%|████████▋ | 322130/371472 [3:27:25<4:06:26,  3.34it/s]
 87%|████████▋ | 322131/371472 [3:27:26<4:00:57,  3.41it/s]
 87%|████████▋ | 322132/371472 [3:27:26<4:00:12,  3.42it/s]
 87%|████████▋ | 322133/371472 [3:27:26<3:56:43,  3.47it/s]
 87%|████████▋ | 322134/371472 [3:27:26<3:53:40,  3.52it/s]
 87%|████████▋ | 322135/371472 [3:27:27<3:52:52,  3.53it/s]
 87%|████████▋ | 322136/371472 [3:27:27<3:58:35,  3.45it/s]
 87%|████████▋ | 322137/371472 [3:27:27<3:49:05,  3.59it/s]
 87%|████████▋ | 322138/371472 [3:27:28<3:49:43,  3.58it/s]
 87%|████████▋ | 322139/371472 [3:27:28<3:44:15,  3.67it/s]
 87%|████████▋ | 322140/371472 [3:27:28<3:44:44,  3.66it/s]
                                                           
{'loss': 2.5315, 'learning_rate': 2.1958564071624038e-07, 'epoch': 13.88}

 87%|████████▋ | 322140/371472 [3:27:28<3:44:44,  3.66it/s]
 87%|████████▋ | 322141/371472 [3:27:28<3:44:55,  3.66it/s]
 87%|████████▋ | 322142/371472 [3:27:29<3:47:42,  3.61it/s]
 87%|████████▋ | 322143/371472 [3:27:29<3:42:46,  3.69it/s]
 87%|████████▋ | 322144/371472 [3:27:29<3:48:37,  3.60it/s]
 87%|████████▋ | 322145/371472 [3:27:30<3:45:54,  3.64it/s]
 87%|████████▋ | 322146/371472 [3:27:30<4:01:20,  3.41it/s]
 87%|████████▋ | 322147/371472 [3:27:30<3:49:11,  3.59it/s]
 87%|████████▋ | 322148/371472 [3:27:30<3:48:10,  3.60it/s]
 87%|████████▋ | 322149/371472 [3:27:31<3:45:53,  3.64it/s]
 87%|████████▋ | 322150/371472 [3:27:31<3:48:19,  3.60it/s]
 87%|████████▋ | 322151/371472 [3:27:31<3:47:22,  3.62it/s]
 87%|████████▋ | 322152/371472 [3:27:31<3:43:28,  3.68it/s]
 87%|████████▋ | 322153/371472 [3:27:32<3:48:53,  3.59it/s]
 87%|████████▋ | 322154/371472 [3:27:32<3:40:58,  3.72it/s]
 87%|████████▋ | 322155/371472 [3:27:32<3:48:30,  3.60it/s]
 87%|████████▋ | 322156/371472 [3:27:33<3:37:18,  3.78it/s]
 87%|████████▋ | 322157/371472 [3:27:33<3:46:16,  3.63it/s]
 87%|████████▋ | 322158/371472 [3:27:33<3:42:35,  3.69it/s]
 87%|████████▋ | 322159/371472 [3:27:33<3:59:11,  3.44it/s]
 87%|████████▋ | 322160/371472 [3:27:34<3:49:56,  3.57it/s]
                                                           
{'loss': 2.6767, 'learning_rate': 2.1953715874076147e-07, 'epoch': 13.88}

 87%|████████▋ | 322160/371472 [3:27:34<3:49:56,  3.57it/s]
 87%|████████▋ | 322161/371472 [3:27:34<3:44:11,  3.67it/s]
 87%|████████▋ | 322162/371472 [3:27:34<3:37:58,  3.77it/s]
 87%|████████▋ | 322163/371472 [3:27:34<3:46:26,  3.63it/s]
 87%|████████▋ | 322164/371472 [3:27:35<3:40:33,  3.73it/s]
 87%|████████▋ | 322165/371472 [3:27:35<3:40:14,  3.73it/s]
 87%|████████▋ | 322166/371472 [3:27:35<3:55:40,  3.49it/s]
 87%|████████▋ | 322167/371472 [3:27:36<3:47:50,  3.61it/s]
 87%|████████▋ | 322168/371472 [3:27:36<3:44:42,  3.66it/s]
 87%|████████▋ | 322169/371472 [3:27:36<3:49:50,  3.58it/s]
 87%|████████▋ | 322170/371472 [3:27:36<3:44:45,  3.66it/s]
 87%|████████▋ | 322171/371472 [3:27:37<3:41:41,  3.71it/s]
 87%|████████▋ | 322172/371472 [3:27:37<3:47:51,  3.61it/s]
 87%|████████▋ | 322173/371472 [3:27:37<3:51:42,  3.55it/s]
 87%|████████▋ | 322174/371472 [3:27:37<3:37:55,  3.77it/s]
 87%|████████▋ | 322175/371472 [3:27:38<3:52:18,  3.54it/s]
 87%|████████▋ | 322176/371472 [3:27:38<3:49:19,  3.58it/s]
 87%|████████▋ | 322177/371472 [3:27:38<4:03:04,  3.38it/s]
 87%|████████▋ | 322178/371472 [3:27:39<3:56:03,  3.48it/s]
 87%|████████▋ | 322179/371472 [3:27:39<3:51:06,  3.55it/s]
 87%|████████▋ | 322180/371472 [3:27:39<3:53:31,  3.52it/s]
                                                           
{'loss': 2.6996, 'learning_rate': 2.1948867676528262e-07, 'epoch': 13.88}

 87%|████████▋ | 322180/371472 [3:27:39<3:53:31,  3.52it/s]
 87%|████████▋ | 322181/371472 [3:27:40<3:58:39,  3.44it/s]
 87%|████████▋ | 322182/371472 [3:27:40<3:52:10,  3.54it/s]
 87%|████████▋ | 322183/371472 [3:27:40<3:43:42,  3.67it/s]
 87%|████████▋ | 322184/371472 [3:27:40<3:37:04,  3.78it/s]
 87%|████████▋ | 322185/371472 [3:27:41<3:40:58,  3.72it/s]
 87%|████████▋ | 322186/371472 [3:27:41<3:39:08,  3.75it/s]
 87%|████████▋ | 322187/371472 [3:27:41<3:39:33,  3.74it/s]
 87%|████████▋ | 322188/371472 [3:27:41<4:06:34,  3.33it/s]
 87%|████████▋ | 322189/371472 [3:27:42<3:58:31,  3.44it/s]
 87%|████████▋ | 322190/371472 [3:27:42<3:58:17,  3.45it/s]
 87%|████████▋ | 322191/371472 [3:27:42<3:54:34,  3.50it/s]
 87%|████████▋ | 322192/371472 [3:27:43<3:49:12,  3.58it/s]
 87%|████████▋ | 322193/371472 [3:27:43<3:51:27,  3.55it/s]
 87%|████████▋ | 322194/371472 [3:27:43<3:55:30,  3.49it/s]
 87%|████████▋ | 322195/371472 [3:27:43<3:55:25,  3.49it/s]
 87%|████████▋ | 322196/371472 [3:27:44<3:45:51,  3.64it/s]
 87%|████████▋ | 322197/371472 [3:27:44<3:50:05,  3.57it/s]
 87%|████████▋ | 322198/371472 [3:27:44<3:49:47,  3.57it/s]
 87%|████████▋ | 322199/371472 [3:27:45<3:39:07,  3.75it/s]
 87%|████████▋ | 322200/371472 [3:27:45<3:51:58,  3.54it/s]
                                                           
{'loss': 2.6149, 'learning_rate': 2.1944019478980367e-07, 'epoch': 13.88}

 87%|████████▋ | 322200/371472 [3:27:45<3:51:58,  3.54it/s]
 87%|████████▋ | 322201/371472 [3:27:45<3:46:26,  3.63it/s]
 87%|████████▋ | 322202/371472 [3:27:45<3:48:57,  3.59it/s]
 87%|████████▋ | 322203/371472 [3:27:46<3:37:24,  3.78it/s]
 87%|████████▋ | 322204/371472 [3:27:46<3:35:15,  3.81it/s]
 87%|████████▋ | 322205/371472 [3:27:46<3:39:52,  3.73it/s]
 87%|████████▋ | 322206/371472 [3:27:46<3:34:00,  3.84it/s]
 87%|████████▋ | 322207/371472 [3:27:47<3:34:27,  3.83it/s]
 87%|████████▋ | 322208/371472 [3:27:47<3:31:37,  3.88it/s]
 87%|████████▋ | 322209/371472 [3:27:47<3:42:39,  3.69it/s]
 87%|████████▋ | 322210/371472 [3:27:48<3:47:27,  3.61it/s]
 87%|████████▋ | 322211/371472 [3:27:48<3:43:41,  3.67it/s]
 87%|████████▋ | 322212/371472 [3:27:48<3:44:28,  3.66it/s]
 87%|████████▋ | 322213/371472 [3:27:48<3:42:09,  3.70it/s]
 87%|████████▋ | 322214/371472 [3:27:49<3:39:18,  3.74it/s]
 87%|████████▋ | 322215/371472 [3:27:49<3:46:37,  3.62it/s]
 87%|████████▋ | 322216/371472 [3:27:49<3:42:00,  3.70it/s]
 87%|████████▋ | 322217/371472 [3:27:49<3:44:32,  3.66it/s]
 87%|████████▋ | 322218/371472 [3:27:50<4:00:10,  3.42it/s]
 87%|████████▋ | 322219/371472 [3:27:50<4:00:24,  3.41it/s]
 87%|████████▋ | 322220/371472 [3:27:50<3:58:33,  3.44it/s]
                                                           
{'loss': 2.4441, 'learning_rate': 2.1939171281432485e-07, 'epoch': 13.88}

 87%|████████▋ | 322220/371472 [3:27:50<3:58:33,  3.44it/s]
 87%|████████▋ | 322221/371472 [3:27:51<4:09:57,  3.28it/s]
 87%|████████▋ | 322222/371472 [3:27:51<4:00:44,  3.41it/s]
 87%|████████▋ | 322223/371472 [3:27:51<4:02:01,  3.39it/s]
 87%|████████▋ | 322224/371472 [3:27:51<3:56:10,  3.48it/s]
 87%|████████▋ | 322225/371472 [3:27:52<3:50:13,  3.57it/s]
 87%|████████▋ | 322226/371472 [3:27:52<3:48:11,  3.60it/s]
 87%|████████▋ | 322227/371472 [3:27:52<3:55:00,  3.49it/s]
 87%|████████▋ | 322228/371472 [3:27:53<4:03:39,  3.37it/s]
 87%|████████▋ | 322229/371472 [3:27:53<3:58:51,  3.44it/s]
 87%|████████▋ | 322230/371472 [3:27:53<3:46:16,  3.63it/s]
 87%|████████▋ | 322231/371472 [3:27:53<3:48:09,  3.60it/s]
 87%|████████▋ | 322232/371472 [3:27:54<3:56:35,  3.47it/s]
 87%|████████▋ | 322233/371472 [3:27:54<3:45:59,  3.63it/s]
 87%|████████▋ | 322234/371472 [3:27:54<3:57:06,  3.46it/s]
 87%|████████▋ | 322235/371472 [3:27:55<3:44:48,  3.65it/s]
 87%|████████▋ | 322236/371472 [3:27:55<3:45:13,  3.64it/s]
 87%|████████▋ | 322237/371472 [3:27:55<3:49:11,  3.58it/s]
 87%|████████▋ | 322238/371472 [3:27:55<3:52:24,  3.53it/s]
 87%|████████▋ | 322239/371472 [3:27:56<3:47:40,  3.60it/s]
 87%|████████▋ | 322240/371472 [3:27:56<3:48:48,  3.59it/s]
                                                           
{'loss': 2.6143, 'learning_rate': 2.193432308388459e-07, 'epoch': 13.88}

 87%|████████▋ | 322240/371472 [3:27:56<3:48:48,  3.59it/s]
 87%|████████▋ | 322241/371472 [3:27:56<4:04:42,  3.35it/s]
 87%|████████▋ | 322242/371472 [3:27:57<4:15:29,  3.21it/s]
 87%|████████▋ | 322243/371472 [3:27:57<4:08:44,  3.30it/s]
 87%|████████▋ | 322244/371472 [3:27:57<3:56:24,  3.47it/s]
 87%|████████▋ | 322245/371472 [3:27:57<3:45:53,  3.63it/s]
 87%|████████▋ | 322246/371472 [3:27:58<3:43:15,  3.67it/s]
 87%|████████▋ | 322247/371472 [3:27:58<3:44:11,  3.66it/s]
 87%|████████▋ | 322248/371472 [3:27:58<3:42:23,  3.69it/s]
 87%|████████▋ | 322249/371472 [3:27:59<3:51:31,  3.54it/s]
 87%|████████▋ | 322250/371472 [3:27:59<3:44:42,  3.65it/s]
 87%|████████▋ | 322251/371472 [3:27:59<3:40:25,  3.72it/s]
 87%|████████▋ | 322252/371472 [3:27:59<3:38:02,  3.76it/s]
 87%|████████▋ | 322253/371472 [3:28:00<3:36:12,  3.79it/s]
 87%|████████▋ | 322254/371472 [3:28:00<3:37:53,  3.76it/s]
 87%|████████▋ | 322255/371472 [3:28:00<3:36:34,  3.79it/s]
 87%|████████▋ | 322256/371472 [3:28:00<3:59:25,  3.43it/s]
 87%|████████▋ | 322257/371472 [3:28:01<3:49:54,  3.57it/s]
 87%|████████▋ | 322258/371472 [3:28:01<3:42:29,  3.69it/s]
 87%|████████▋ | 322259/371472 [3:28:01<4:00:49,  3.41it/s]
 87%|████████▋ | 322260/371472 [3:28:02<3:51:19,  3.55it/s]
                                                           
{'loss': 2.5947, 'learning_rate': 2.1929474886336704e-07, 'epoch': 13.88}

 87%|████████▋ | 322260/371472 [3:28:02<3:51:19,  3.55it/s]
 87%|████████▋ | 322261/371472 [3:28:02<3:44:05,  3.66it/s]
 87%|████████▋ | 322262/371472 [3:28:02<3:41:24,  3.70it/s]
 87%|████████▋ | 322263/371472 [3:28:02<3:53:00,  3.52it/s]
 87%|████████▋ | 322264/371472 [3:28:03<3:44:26,  3.65it/s]
 87%|████████▋ | 322265/371472 [3:28:03<3:43:36,  3.67it/s]
 87%|████████▋ | 322266/371472 [3:28:03<3:37:48,  3.77it/s]
 87%|████████▋ | 322267/371472 [3:28:03<3:37:01,  3.78it/s]
 87%|████████▋ | 322268/371472 [3:28:04<3:37:12,  3.78it/s]
 87%|████████▋ | 322269/371472 [3:28:04<4:06:11,  3.33it/s]
 87%|████████▋ | 322270/371472 [3:28:04<3:49:55,  3.57it/s]
 87%|████████▋ | 322271/371472 [3:28:05<3:53:45,  3.51it/s]
 87%|████████▋ | 322272/371472 [3:28:05<3:44:14,  3.66it/s]
 87%|████████▋ | 322273/371472 [3:28:05<4:01:04,  3.40it/s]
 87%|████████▋ | 322274/371472 [3:28:06<4:17:39,  3.18it/s]
 87%|████████▋ | 322275/371472 [3:28:06<4:04:26,  3.35it/s]
 87%|████████▋ | 322276/371472 [3:28:06<3:58:31,  3.44it/s]
 87%|████████▋ | 322277/371472 [3:28:06<3:58:14,  3.44it/s]
 87%|████████▋ | 322278/371472 [3:28:07<4:16:19,  3.20it/s]
 87%|████████▋ | 322279/371472 [3:28:07<4:11:12,  3.26it/s]
 87%|████████▋ | 322280/371472 [3:28:07<3:51:36,  3.54it/s]
                                                           
{'loss': 2.6258, 'learning_rate': 2.1924626688788811e-07, 'epoch': 13.88}

 87%|████████▋ | 322280/371472 [3:28:07<3:51:36,  3.54it/s]
 87%|████████▋ | 322281/371472 [3:28:08<3:47:11,  3.61it/s]
 87%|████████▋ | 322282/371472 [3:28:08<3:44:55,  3.65it/s]
 87%|████████▋ | 322283/371472 [3:28:08<3:52:49,  3.52it/s]
 87%|████████▋ | 322284/371472 [3:28:08<4:07:57,  3.31it/s]
 87%|████████▋ | 322285/371472 [3:28:09<4:06:11,  3.33it/s]
 87%|████████▋ | 322286/371472 [3:28:09<4:04:24,  3.35it/s]
 87%|████████▋ | 322287/371472 [3:28:09<4:00:50,  3.40it/s]
 87%|████████▋ | 322288/371472 [3:28:10<3:54:34,  3.49it/s]
 87%|████████▋ | 322289/371472 [3:28:10<3:52:55,  3.52it/s]
 87%|████████▋ | 322290/371472 [3:28:10<3:59:13,  3.43it/s]
 87%|████████▋ | 322291/371472 [3:28:10<3:51:50,  3.54it/s]
 87%|████████▋ | 322292/371472 [3:28:11<3:56:32,  3.47it/s]
 87%|████████▋ | 322293/371472 [3:28:11<3:52:46,  3.52it/s]
 87%|████████▋ | 322294/371472 [3:28:11<3:57:03,  3.46it/s]
 87%|████████▋ | 322295/371472 [3:28:12<4:00:58,  3.40it/s]
 87%|████████▋ | 322296/371472 [3:28:12<3:55:23,  3.48it/s]
 87%|████████▋ | 322297/371472 [3:28:12<3:55:06,  3.49it/s]
 87%|████████▋ | 322298/371472 [3:28:12<3:53:22,  3.51it/s]
 87%|████████▋ | 322299/371472 [3:28:13<3:53:08,  3.52it/s]
 87%|████████▋ | 322300/371472 [3:28:13<3:58:32,  3.44it/s]
                                                           
{'loss': 2.6899, 'learning_rate': 2.1919778491240927e-07, 'epoch': 13.88}

 87%|████████▋ | 322300/371472 [3:28:13<3:58:32,  3.44it/s]
 87%|████████▋ | 322301/371472 [3:28:13<3:46:48,  3.61it/s]
 87%|████████▋ | 322302/371472 [3:28:14<3:45:47,  3.63it/s]
 87%|████████▋ | 322303/371472 [3:28:14<3:42:39,  3.68it/s]
 87%|████████▋ | 322304/371472 [3:28:14<3:37:14,  3.77it/s]
 87%|████████▋ | 322305/371472 [3:28:14<3:44:48,  3.65it/s]
 87%|████████▋ | 322306/371472 [3:28:15<3:37:15,  3.77it/s]
 87%|████████▋ | 322307/371472 [3:28:15<3:59:00,  3.43it/s]
 87%|████████▋ | 322308/371472 [3:28:15<3:54:26,  3.50it/s]
 87%|████████▋ | 322309/371472 [3:28:16<3:57:51,  3.44it/s]
 87%|████████▋ | 322310/371472 [3:28:16<3:47:59,  3.59it/s]
 87%|████████▋ | 322311/371472 [3:28:16<3:46:26,  3.62it/s]
 87%|████████▋ | 322312/371472 [3:28:16<3:48:32,  3.59it/s]
 87%|████████▋ | 322313/371472 [3:28:17<3:36:53,  3.78it/s]
 87%|████████▋ | 322314/371472 [3:28:17<3:34:57,  3.81it/s]
 87%|████████▋ | 322315/371472 [3:28:17<4:03:58,  3.36it/s]
 87%|████████▋ | 322316/371472 [3:28:17<3:54:05,  3.50it/s]
 87%|████████▋ | 322317/371472 [3:28:18<3:54:41,  3.49it/s]
 87%|████████▋ | 322318/371472 [3:28:18<3:44:30,  3.65it/s]
 87%|████████▋ | 322319/371472 [3:28:18<3:41:55,  3.69it/s]
 87%|████████▋ | 322320/371472 [3:28:19<3:41:00,  3.71it/s]
                                                           
{'loss': 2.5773, 'learning_rate': 2.191493029369303e-07, 'epoch': 13.88}

 87%|████████▋ | 322320/371472 [3:28:19<3:41:00,  3.71it/s]
 87%|████████▋ | 322321/371472 [3:28:19<3:51:52,  3.53it/s]
 87%|████████▋ | 322322/371472 [3:28:19<3:54:18,  3.50it/s]
 87%|████████▋ | 322323/371472 [3:28:19<3:45:45,  3.63it/s]
 87%|████████▋ | 322324/371472 [3:28:20<3:39:28,  3.73it/s]
 87%|████████▋ | 322325/371472 [3:28:20<3:36:56,  3.78it/s]
 87%|████████▋ | 322326/371472 [3:28:20<3:35:32,  3.80it/s]
 87%|████████▋ | 322327/371472 [3:28:20<3:36:14,  3.79it/s]
 87%|████████▋ | 322328/371472 [3:28:21<3:39:05,  3.74it/s]
 87%|████████▋ | 322329/371472 [3:28:21<3:44:18,  3.65it/s]
 87%|████████▋ | 322330/371472 [3:28:21<3:46:53,  3.61it/s]
 87%|████████▋ | 322331/371472 [3:28:22<3:55:56,  3.47it/s]
 87%|████████▋ | 322332/371472 [3:28:22<3:58:19,  3.44it/s]
 87%|████████▋ | 322333/371472 [3:28:22<3:47:45,  3.60it/s]
 87%|████████▋ | 322334/371472 [3:28:22<3:44:34,  3.65it/s]
 87%|████████▋ | 322335/371472 [3:28:23<3:51:32,  3.54it/s]
 87%|████████▋ | 322336/371472 [3:28:23<3:54:27,  3.49it/s]
 87%|████████▋ | 322337/371472 [3:28:23<3:49:55,  3.56it/s]
 87%|████████▋ | 322338/371472 [3:28:24<3:46:03,  3.62it/s]
 87%|████████▋ | 322339/371472 [3:28:24<3:40:48,  3.71it/s]
 87%|████████▋ | 322340/371472 [3:28:24<3:35:50,  3.79it/s]
                                                           
{'loss': 2.6042, 'learning_rate': 2.191008209614515e-07, 'epoch': 13.88}

 87%|████████▋ | 322340/371472 [3:28:24<3:35:50,  3.79it/s]
 87%|████████▋ | 322341/371472 [3:28:24<3:28:07,  3.93it/s]
 87%|████████▋ | 322342/371472 [3:28:25<3:28:34,  3.93it/s]
 87%|████████▋ | 322343/371472 [3:28:25<3:28:26,  3.93it/s]
 87%|████████▋ | 322344/371472 [3:28:25<3:46:07,  3.62it/s]
 87%|████████▋ | 322345/371472 [3:28:25<3:41:52,  3.69it/s]
 87%|████████▋ | 322346/371472 [3:28:26<3:37:42,  3.76it/s]
 87%|████████▋ | 322347/371472 [3:28:26<3:42:14,  3.68it/s]
 87%|████████▋ | 322348/371472 [3:28:26<3:43:12,  3.67it/s]
 87%|████████▋ | 322349/371472 [3:28:26<3:44:45,  3.64it/s]
 87%|████████▋ | 322350/371472 [3:28:27<3:47:56,  3.59it/s]
 87%|████████▋ | 322351/371472 [3:28:27<3:43:00,  3.67it/s]
 87%|████████▋ | 322352/371472 [3:28:27<3:36:12,  3.79it/s]
 87%|████████▋ | 322353/371472 [3:28:28<3:35:36,  3.80it/s]
 87%|████████▋ | 322354/371472 [3:28:28<3:48:04,  3.59it/s]
 87%|████████▋ | 322355/371472 [3:28:28<3:46:09,  3.62it/s]
 87%|████████▋ | 322356/371472 [3:28:28<3:55:30,  3.48it/s]
 87%|████████▋ | 322357/371472 [3:28:29<3:48:17,  3.59it/s]
 87%|████████▋ | 322358/371472 [3:28:29<3:48:49,  3.58it/s]
 87%|████████▋ | 322359/371472 [3:28:29<3:46:41,  3.61it/s]
 87%|████████▋ | 322360/371472 [3:28:30<3:48:12,  3.59it/s]
                                                           
{'loss': 2.7045, 'learning_rate': 2.1905233898597256e-07, 'epoch': 13.88}

 87%|████████▋ | 322360/371472 [3:28:30<3:48:12,  3.59it/s]
 87%|████████▋ | 322361/371472 [3:28:30<4:06:00,  3.33it/s]
 87%|████████▋ | 322362/371472 [3:28:30<4:01:45,  3.39it/s]
 87%|████████▋ | 322363/371472 [3:28:30<3:51:54,  3.53it/s]
 87%|████████▋ | 322364/371472 [3:28:31<3:56:04,  3.47it/s]
 87%|████████▋ | 322365/371472 [3:28:31<3:57:33,  3.45it/s]
 87%|████████▋ | 322366/371472 [3:28:31<3:51:38,  3.53it/s]
 87%|████████▋ | 322367/371472 [3:28:32<4:23:26,  3.11it/s]
 87%|████████▋ | 322368/371472 [3:28:32<4:17:11,  3.18it/s]
 87%|████████▋ | 322369/371472 [3:28:32<4:01:05,  3.39it/s]
 87%|████████▋ | 322370/371472 [3:28:32<3:50:44,  3.55it/s]
 87%|████████▋ | 322371/371472 [3:28:33<3:45:40,  3.63it/s]
 87%|████████▋ | 322372/371472 [3:28:33<3:46:17,  3.62it/s]
 87%|████████▋ | 322373/371472 [3:28:33<3:44:55,  3.64it/s]
 87%|████████▋ | 322374/371472 [3:28:34<3:54:48,  3.49it/s]
 87%|████████▋ | 322375/371472 [3:28:34<4:05:04,  3.34it/s]
 87%|████████▋ | 322376/371472 [3:28:34<3:58:08,  3.44it/s]
 87%|████████▋ | 322377/371472 [3:28:34<3:51:59,  3.53it/s]
 87%|████████▋ | 322378/371472 [3:28:35<3:49:43,  3.56it/s]
 87%|████████▋ | 322379/371472 [3:28:35<3:46:18,  3.62it/s]
 87%|████████▋ | 322380/371472 [3:28:35<3:49:15,  3.57it/s]
                                                           
{'loss': 2.8539, 'learning_rate': 2.190038570104936e-07, 'epoch': 13.89}

 87%|████████▋ | 322380/371472 [3:28:35<3:49:15,  3.57it/s]
 87%|████████▋ | 322381/371472 [3:28:36<3:45:10,  3.63it/s]
 87%|████████▋ | 322382/371472 [3:28:36<4:03:03,  3.37it/s]
 87%|████████▋ | 322383/371472 [3:28:36<4:01:48,  3.38it/s]
 87%|████████▋ | 322384/371472 [3:28:36<3:53:39,  3.50it/s]
 87%|████████▋ | 322385/371472 [3:28:37<3:58:42,  3.43it/s]
 87%|████████▋ | 322386/371472 [3:28:37<3:46:28,  3.61it/s]
 87%|████████▋ | 322387/371472 [3:28:37<3:46:20,  3.61it/s]
 87%|████████▋ | 322388/371472 [3:28:38<3:57:58,  3.44it/s]
 87%|████████▋ | 322389/371472 [3:28:38<3:46:50,  3.61it/s]
 87%|████████▋ | 322390/371472 [3:28:38<3:55:37,  3.47it/s]
 87%|████████▋ | 322391/371472 [3:28:38<3:52:23,  3.52it/s]
 87%|████████▋ | 322392/371472 [3:28:39<4:03:05,  3.36it/s]
 87%|████████▋ | 322393/371472 [3:28:39<3:58:54,  3.42it/s]
 87%|████████▋ | 322394/371472 [3:28:39<3:51:03,  3.54it/s]
 87%|████████▋ | 322395/371472 [3:28:40<3:46:38,  3.61it/s]
 87%|████████▋ | 322396/371472 [3:28:40<3:46:24,  3.61it/s]
 87%|████████▋ | 322397/371472 [3:28:40<3:57:36,  3.44it/s]
 87%|████████▋ | 322398/371472 [3:28:40<3:58:13,  3.43it/s]
 87%|████████▋ | 322399/371472 [3:28:41<3:46:30,  3.61it/s]
 87%|████████▋ | 322400/371472 [3:28:41<3:58:39,  3.43it/s]
                                                           
{'loss': 2.4505, 'learning_rate': 2.1895537503501476e-07, 'epoch': 13.89}

 87%|████████▋ | 322400/371472 [3:28:41<3:58:39,  3.43it/s]
 87%|████████▋ | 322401/371472 [3:28:41<4:02:57,  3.37it/s]
 87%|████████▋ | 322402/371472 [3:28:42<4:01:06,  3.39it/s]
 87%|████████▋ | 322403/371472 [3:28:42<4:03:25,  3.36it/s]
 87%|████████▋ | 322404/371472 [3:28:42<3:56:43,  3.45it/s]
 87%|████████▋ | 322405/371472 [3:28:42<3:49:26,  3.56it/s]
 87%|████████▋ | 322406/371472 [3:28:43<3:43:47,  3.65it/s]
 87%|████████▋ | 322407/371472 [3:28:43<3:42:05,  3.68it/s]
 87%|████████▋ | 322408/371472 [3:28:43<3:49:33,  3.56it/s]
 87%|████████▋ | 322409/371472 [3:28:44<3:44:51,  3.64it/s]
 87%|████████▋ | 322410/371472 [3:28:44<3:55:42,  3.47it/s]
 87%|████████▋ | 322411/371472 [3:28:44<4:01:18,  3.39it/s]
 87%|████████▋ | 322412/371472 [3:28:44<3:57:24,  3.44it/s]
 87%|████████▋ | 322413/371472 [3:28:45<3:45:33,  3.63it/s]
 87%|████████▋ | 322414/371472 [3:28:45<3:43:14,  3.66it/s]
 87%|████████▋ | 322415/371472 [3:28:45<3:35:54,  3.79it/s]
 87%|████████▋ | 322416/371472 [3:28:45<3:31:57,  3.86it/s]
 87%|████████▋ | 322417/371472 [3:28:46<3:32:32,  3.85it/s]
 87%|████████▋ | 322418/371472 [3:28:46<3:34:32,  3.81it/s]
 87%|████████▋ | 322419/371472 [3:28:46<3:38:06,  3.75it/s]
 87%|████████▋ | 322420/371472 [3:28:47<3:34:26,  3.81it/s]
                                                           
{'loss': 2.8214, 'learning_rate': 2.1890689305953583e-07, 'epoch': 13.89}

 87%|████████▋ | 322420/371472 [3:28:47<3:34:26,  3.81it/s]
 87%|████████▋ | 322421/371472 [3:28:47<3:30:25,  3.89it/s]
 87%|████████▋ | 322422/371472 [3:28:47<3:30:29,  3.88it/s]
 87%|████████▋ | 322423/371472 [3:28:47<3:32:37,  3.84it/s]
 87%|████████▋ | 322424/371472 [3:28:48<3:34:19,  3.81it/s]
 87%|████████▋ | 322425/371472 [3:28:48<3:39:30,  3.72it/s]
 87%|████████▋ | 322426/371472 [3:28:48<3:46:03,  3.62it/s]
 87%|████████▋ | 322427/371472 [3:28:48<3:42:24,  3.68it/s]
 87%|████████▋ | 322428/371472 [3:28:49<3:39:20,  3.73it/s]
 87%|████████▋ | 322429/371472 [3:28:49<4:21:52,  3.12it/s]
 87%|████████▋ | 322430/371472 [3:28:49<4:17:15,  3.18it/s]
 87%|████████▋ | 322431/371472 [3:28:50<4:02:14,  3.37it/s]
 87%|████████▋ | 322432/371472 [3:28:50<4:03:30,  3.36it/s]
 87%|████████▋ | 322433/371472 [3:28:50<3:59:52,  3.41it/s]
 87%|████████▋ | 322434/371472 [3:28:51<3:59:40,  3.41it/s]
 87%|████████▋ | 322435/371472 [3:28:51<3:49:38,  3.56it/s]
 87%|████████▋ | 322436/371472 [3:28:51<3:46:32,  3.61it/s]
 87%|████████▋ | 322437/371472 [3:28:51<3:44:56,  3.63it/s]
 87%|████████▋ | 322438/371472 [3:28:52<3:40:50,  3.70it/s]
 87%|████████▋ | 322439/371472 [3:28:52<3:36:09,  3.78it/s]
 87%|████████▋ | 322440/371472 [3:28:52<3:42:39,  3.67it/s]
                                                           
{'loss': 2.6117, 'learning_rate': 2.1885841108405695e-07, 'epoch': 13.89}

 87%|████████▋ | 322440/371472 [3:28:52<3:42:39,  3.67it/s]
 87%|████████▋ | 322441/371472 [3:28:52<3:43:23,  3.66it/s]
 87%|████████▋ | 322442/371472 [3:28:53<3:41:38,  3.69it/s]
 87%|████████▋ | 322443/371472 [3:28:53<3:48:44,  3.57it/s]
 87%|████████▋ | 322444/371472 [3:28:53<3:53:04,  3.51it/s]
 87%|████████▋ | 322445/371472 [3:28:54<3:54:56,  3.48it/s]
 87%|████████▋ | 322446/371472 [3:28:54<3:54:16,  3.49it/s]
 87%|████████▋ | 322447/371472 [3:28:54<3:45:16,  3.63it/s]
 87%|████████▋ | 322448/371472 [3:28:54<4:03:15,  3.36it/s]
 87%|████████▋ | 322449/371472 [3:28:55<4:00:15,  3.40it/s]
 87%|████████▋ | 322450/371472 [3:28:55<4:00:48,  3.39it/s]
 87%|████████▋ | 322451/371472 [3:28:55<3:54:17,  3.49it/s]
 87%|████████▋ | 322452/371472 [3:28:56<3:55:54,  3.46it/s]
 87%|████████▋ | 322453/371472 [3:28:56<3:50:36,  3.54it/s]
 87%|████████▋ | 322454/371472 [3:28:56<3:48:10,  3.58it/s]
 87%|████████▋ | 322455/371472 [3:28:57<4:11:27,  3.25it/s]
 87%|████████▋ | 322456/371472 [3:28:57<4:13:41,  3.22it/s]
 87%|████████▋ | 322457/371472 [3:28:57<3:57:34,  3.44it/s]
 87%|████████▋ | 322458/371472 [3:28:57<3:46:21,  3.61it/s]
 87%|████████▋ | 322459/371472 [3:28:58<3:54:55,  3.48it/s]
 87%|████████▋ | 322460/371472 [3:28:58<3:51:04,  3.54it/s]
                                                           
{'loss': 2.5984, 'learning_rate': 2.1880992910857802e-07, 'epoch': 13.89}

 87%|████████▋ | 322460/371472 [3:28:58<3:51:04,  3.54it/s]
 87%|████████▋ | 322461/371472 [3:28:58<3:47:42,  3.59it/s]
 87%|████████▋ | 322462/371472 [3:28:58<3:41:50,  3.68it/s]
 87%|████████▋ | 322463/371472 [3:28:59<3:42:29,  3.67it/s]
 87%|████████▋ | 322464/371472 [3:28:59<3:36:55,  3.77it/s]
 87%|████████▋ | 322465/371472 [3:28:59<3:37:52,  3.75it/s]
 87%|████████▋ | 322466/371472 [3:29:00<3:59:05,  3.42it/s]
 87%|████████▋ | 322467/371472 [3:29:00<3:55:11,  3.47it/s]
 87%|████████▋ | 322468/371472 [3:29:00<3:51:31,  3.53it/s]
 87%|████████▋ | 322469/371472 [3:29:00<3:44:48,  3.63it/s]
 87%|████████▋ | 322470/371472 [3:29:01<3:46:34,  3.60it/s]
 87%|████████▋ | 322471/371472 [3:29:01<3:53:39,  3.50it/s]
 87%|████████▋ | 322472/371472 [3:29:01<3:46:51,  3.60it/s]
 87%|████████▋ | 322473/371472 [3:29:02<3:56:02,  3.46it/s]
 87%|████████▋ | 322474/371472 [3:29:02<3:44:32,  3.64it/s]
 87%|████████▋ | 322475/371472 [3:29:02<3:40:22,  3.71it/s]
 87%|████████▋ | 322476/371472 [3:29:02<3:46:53,  3.60it/s]
 87%|████████▋ | 322477/371472 [3:29:03<3:48:36,  3.57it/s]
 87%|████████▋ | 322478/371472 [3:29:03<3:43:17,  3.66it/s]
 87%|████████▋ | 322479/371472 [3:29:03<4:05:38,  3.32it/s]
 87%|████████▋ | 322480/371472 [3:29:04<4:05:54,  3.32it/s]
                                                           
{'loss': 2.6814, 'learning_rate': 2.1876144713309917e-07, 'epoch': 13.89}

 87%|████████▋ | 322480/371472 [3:29:04<4:05:54,  3.32it/s]
 87%|████████▋ | 322481/371472 [3:29:04<3:56:57,  3.45it/s]
 87%|████████▋ | 322482/371472 [3:29:04<4:00:32,  3.39it/s]
 87%|████████▋ | 322483/371472 [3:29:04<3:53:46,  3.49it/s]
 87%|████████▋ | 322484/371472 [3:29:05<3:53:51,  3.49it/s]
 87%|████████▋ | 322485/371472 [3:29:05<3:41:32,  3.69it/s]
 87%|████████▋ | 322486/371472 [3:29:05<3:40:32,  3.70it/s]
 87%|████████▋ | 322487/371472 [3:29:05<3:46:52,  3.60it/s]
 87%|████████▋ | 322488/371472 [3:29:06<3:43:04,  3.66it/s]
 87%|████████▋ | 322489/371472 [3:29:06<3:47:22,  3.59it/s]
 87%|████████▋ | 322490/371472 [3:29:06<3:57:52,  3.43it/s]
 87%|████████▋ | 322491/371472 [3:29:07<3:45:43,  3.62it/s]
 87%|████████▋ | 322492/371472 [3:29:07<3:45:01,  3.63it/s]
 87%|████████▋ | 322493/371472 [3:29:07<3:43:27,  3.65it/s]
 87%|████████▋ | 322494/371472 [3:29:07<3:40:58,  3.69it/s]
 87%|████████▋ | 322495/371472 [3:29:08<4:02:41,  3.36it/s]
 87%|████████▋ | 322496/371472 [3:29:08<4:00:17,  3.40it/s]
 87%|████████▋ | 322497/371472 [3:29:08<3:49:12,  3.56it/s]
 87%|████████▋ | 322498/371472 [3:29:09<3:51:01,  3.53it/s]
 87%|████████▋ | 322499/371472 [3:29:09<3:43:57,  3.64it/s]
 87%|████████▋ | 322500/371472 [3:29:09<3:42:29,  3.67it/s]
                                                           
{'loss': 2.6011, 'learning_rate': 2.1871296515762024e-07, 'epoch': 13.89}

 87%|████████▋ | 322500/371472 [3:29:09<3:42:29,  3.67it/s]
 87%|████████▋ | 322501/371472 [3:29:09<3:58:50,  3.42it/s]
 87%|████████▋ | 322502/371472 [3:29:10<3:47:29,  3.59it/s]
 87%|████████▋ | 322503/371472 [3:29:10<3:38:04,  3.74it/s]
 87%|████████▋ | 322504/371472 [3:29:10<3:41:44,  3.68it/s]
 87%|████████▋ | 322505/371472 [3:29:10<3:35:35,  3.79it/s]
 87%|████████▋ | 322506/371472 [3:29:11<3:54:28,  3.48it/s]
 87%|████████▋ | 322507/371472 [3:29:11<3:55:23,  3.47it/s]
 87%|████████▋ | 322508/371472 [3:29:11<3:44:08,  3.64it/s]
 87%|████████▋ | 322509/371472 [3:29:12<3:59:19,  3.41it/s]
 87%|████████▋ | 322510/371472 [3:29:12<3:49:02,  3.56it/s]
 87%|████████▋ | 322511/371472 [3:29:12<3:55:03,  3.47it/s]
 87%|████████▋ | 322512/371472 [3:29:13<3:53:50,  3.49it/s]
 87%|████████▋ | 322513/371472 [3:29:13<3:50:39,  3.54it/s]
 87%|████████▋ | 322514/371472 [3:29:13<3:51:12,  3.53it/s]
 87%|████████▋ | 322515/371472 [3:29:13<3:46:51,  3.60it/s]
 87%|████████▋ | 322516/371472 [3:29:14<3:38:14,  3.74it/s]
 87%|████████▋ | 322517/371472 [3:29:14<3:37:13,  3.76it/s]
 87%|████████▋ | 322518/371472 [3:29:14<3:38:22,  3.74it/s]
 87%|████████▋ | 322519/371472 [3:29:14<3:33:07,  3.83it/s]
 87%|████████▋ | 322520/371472 [3:29:15<3:32:51,  3.83it/s]
                                                           
{'loss': 2.5855, 'learning_rate': 2.186644831821414e-07, 'epoch': 13.89}

 87%|████████▋ | 322520/371472 [3:29:15<3:32:51,  3.83it/s]
 87%|████████▋ | 322521/371472 [3:29:15<3:37:49,  3.75it/s]
 87%|████████▋ | 322522/371472 [3:29:15<3:36:47,  3.76it/s]
 87%|████████▋ | 322523/371472 [3:29:15<3:44:49,  3.63it/s]
 87%|████████▋ | 322524/371472 [3:29:16<4:01:35,  3.38it/s]
 87%|████████▋ | 322525/371472 [3:29:16<3:51:26,  3.52it/s]
 87%|████████▋ | 322526/371472 [3:29:16<3:41:36,  3.68it/s]
 87%|████████▋ | 322527/371472 [3:29:17<3:47:18,  3.59it/s]
 87%|████████▋ | 322528/371472 [3:29:17<3:41:26,  3.68it/s]
 87%|████████▋ | 322529/371472 [3:29:17<3:47:56,  3.58it/s]
 87%|████████▋ | 322530/371472 [3:29:17<3:42:46,  3.66it/s]
 87%|████████▋ | 322531/371472 [3:29:18<3:42:34,  3.66it/s]
 87%|████████▋ | 322532/371472 [3:29:18<3:45:51,  3.61it/s]
 87%|████████▋ | 322533/371472 [3:29:18<3:55:22,  3.47it/s]
 87%|████████▋ | 322534/371472 [3:29:19<3:45:40,  3.61it/s]
 87%|████████▋ | 322535/371472 [3:29:19<3:49:54,  3.55it/s]
 87%|████████▋ | 322536/371472 [3:29:19<4:04:55,  3.33it/s]
 87%|████████▋ | 322537/371472 [3:29:20<4:14:44,  3.20it/s]
 87%|████████▋ | 322538/371472 [3:29:20<4:04:30,  3.34it/s]
 87%|████████▋ | 322539/371472 [3:29:20<4:12:59,  3.22it/s]
 87%|████████▋ | 322540/371472 [3:29:20<3:56:39,  3.45it/s]
                                                           
{'loss': 2.7869, 'learning_rate': 2.1861600120666247e-07, 'epoch': 13.89}

 87%|████████▋ | 322540/371472 [3:29:20<3:56:39,  3.45it/s]
 87%|████████▋ | 322541/371472 [3:29:21<3:53:20,  3.50it/s]
 87%|████████▋ | 322542/371472 [3:29:21<4:17:22,  3.17it/s]
 87%|████████▋ | 322543/371472 [3:29:21<4:32:13,  3.00it/s]
 87%|████████▋ | 322544/371472 [3:29:22<4:11:01,  3.25it/s]
 87%|████████▋ | 322545/371472 [3:29:22<3:57:43,  3.43it/s]
 87%|████████▋ | 322546/371472 [3:29:22<4:07:38,  3.29it/s]
 87%|████████▋ | 322547/371472 [3:29:23<4:14:42,  3.20it/s]
 87%|████████▋ | 322548/371472 [3:29:23<4:17:52,  3.16it/s]
 87%|████████▋ | 322549/371472 [3:29:23<3:59:57,  3.40it/s]
 87%|████████▋ | 322550/371472 [3:29:23<4:11:35,  3.24it/s]
 87%|████████▋ | 322551/371472 [3:29:24<3:58:11,  3.42it/s]
 87%|████████▋ | 322552/371472 [3:29:24<4:00:27,  3.39it/s]
 87%|████████▋ | 322553/371472 [3:29:24<3:58:25,  3.42it/s]
 87%|████████▋ | 322554/371472 [3:29:25<3:59:52,  3.40it/s]
 87%|████████▋ | 322555/371472 [3:29:25<4:28:00,  3.04it/s]
 87%|████████▋ | 322556/371472 [3:29:25<4:17:41,  3.16it/s]
 87%|████████▋ | 322557/371472 [3:29:26<4:18:06,  3.16it/s]
 87%|████████▋ | 322558/371472 [3:29:26<4:11:26,  3.24it/s]
 87%|████████▋ | 322559/371472 [3:29:26<4:06:21,  3.31it/s]
 87%|████████▋ | 322560/371472 [3:29:26<3:55:16,  3.46it/s]
                                                           
{'loss': 2.5851, 'learning_rate': 2.1856751923118362e-07, 'epoch': 13.89}

 87%|████████▋ | 322560/371472 [3:29:26<3:55:16,  3.46it/s]
 87%|████████▋ | 322561/371472 [3:29:27<3:53:29,  3.49it/s]
 87%|████████▋ | 322562/371472 [3:29:27<3:45:25,  3.62it/s]
 87%|████████▋ | 322563/371472 [3:29:27<3:52:29,  3.51it/s]
 87%|████████▋ | 322564/371472 [3:29:28<3:56:44,  3.44it/s]
 87%|████████▋ | 322565/371472 [3:29:28<4:04:47,  3.33it/s]
 87%|████████▋ | 322566/371472 [3:29:28<4:09:10,  3.27it/s]
 87%|████████▋ | 322567/371472 [3:29:28<3:57:38,  3.43it/s]
 87%|████████▋ | 322568/371472 [3:29:29<4:01:28,  3.38it/s]
 87%|████████▋ | 322569/371472 [3:29:29<3:57:23,  3.43it/s]
 87%|████████▋ | 322570/371472 [3:29:29<3:44:37,  3.63it/s]
 87%|████████▋ | 322571/371472 [3:29:30<3:54:35,  3.47it/s]
 87%|████████▋ | 322572/371472 [3:29:30<3:45:35,  3.61it/s]
 87%|████████▋ | 322573/371472 [3:29:30<3:46:00,  3.61it/s]
 87%|████████▋ | 322574/371472 [3:29:30<3:41:40,  3.68it/s]
 87%|████████▋ | 322575/371472 [3:29:31<3:45:47,  3.61it/s]
 87%|████████▋ | 322576/371472 [3:29:31<3:39:34,  3.71it/s]
 87%|████████▋ | 322577/371472 [3:29:31<3:47:08,  3.59it/s]
 87%|████████▋ | 322578/371472 [3:29:32<3:48:04,  3.57it/s]
 87%|████████▋ | 322579/371472 [3:29:32<4:05:19,  3.32it/s]
 87%|████████▋ | 322580/371472 [3:29:32<3:58:37,  3.41it/s]
                                                           
{'loss': 2.6016, 'learning_rate': 2.1851903725570466e-07, 'epoch': 13.89}

 87%|████████▋ | 322580/371472 [3:29:32<3:58:37,  3.41it/s]
 87%|████████▋ | 322581/371472 [3:29:32<4:04:59,  3.33it/s]
 87%|████████▋ | 322582/371472 [3:29:33<4:23:13,  3.10it/s]
 87%|████████▋ | 322583/371472 [3:29:33<4:13:22,  3.22it/s]
 87%|████████▋ | 322584/371472 [3:29:33<4:05:05,  3.32it/s]
 87%|████████▋ | 322585/371472 [3:29:34<3:55:19,  3.46it/s]
 87%|████████▋ | 322586/371472 [3:29:34<4:00:38,  3.39it/s]
 87%|████████▋ | 322587/371472 [3:29:34<3:46:05,  3.60it/s]
 87%|████████▋ | 322588/371472 [3:29:34<3:41:20,  3.68it/s]
 87%|████████▋ | 322589/371472 [3:29:35<3:45:42,  3.61it/s]
 87%|████████▋ | 322590/371472 [3:29:35<3:44:22,  3.63it/s]
 87%|████████▋ | 322591/371472 [3:29:35<3:39:20,  3.71it/s]
 87%|████████▋ | 322592/371472 [3:29:36<3:37:20,  3.75it/s]
 87%|████████▋ | 322593/371472 [3:29:36<3:37:00,  3.75it/s]
 87%|████████▋ | 322594/371472 [3:29:36<3:37:30,  3.75it/s]
 87%|████████▋ | 322595/371472 [3:29:36<3:40:04,  3.70it/s]
 87%|████████▋ | 322596/371472 [3:29:37<3:36:24,  3.76it/s]
 87%|████████▋ | 322597/371472 [3:29:37<3:38:44,  3.72it/s]
 87%|████████▋ | 322598/371472 [3:29:37<3:35:44,  3.78it/s]
 87%|████████▋ | 322599/371472 [3:29:37<3:29:31,  3.89it/s]
 87%|████████▋ | 322600/371472 [3:29:38<3:32:05,  3.84it/s]
                                                           
{'loss': 2.5534, 'learning_rate': 2.1847055528022584e-07, 'epoch': 13.89}

 87%|████████▋ | 322600/371472 [3:29:38<3:32:05,  3.84it/s]
 87%|████████▋ | 322601/371472 [3:29:38<3:50:27,  3.53it/s]
 87%|████████▋ | 322602/371472 [3:29:38<3:50:03,  3.54it/s]
 87%|████████▋ | 322603/371472 [3:29:39<4:07:26,  3.29it/s]
 87%|████████▋ | 322604/371472 [3:29:39<3:57:52,  3.42it/s]
 87%|████████▋ | 322605/371472 [3:29:39<3:54:17,  3.48it/s]
 87%|████████▋ | 322606/371472 [3:29:39<3:49:48,  3.54it/s]
 87%|████████▋ | 322607/371472 [3:29:40<3:54:21,  3.48it/s]
 87%|████████▋ | 322608/371472 [3:29:40<3:41:04,  3.68it/s]
 87%|████████▋ | 322609/371472 [3:29:40<3:47:00,  3.59it/s]
 87%|████████▋ | 322610/371472 [3:29:41<3:55:11,  3.46it/s]
 87%|████████▋ | 322611/371472 [3:29:41<3:48:21,  3.57it/s]
 87%|████████▋ | 322612/371472 [3:29:41<3:47:24,  3.58it/s]
 87%|████████▋ | 322613/371472 [3:29:41<3:39:17,  3.71it/s]
 87%|████████▋ | 322614/371472 [3:29:42<3:54:39,  3.47it/s]
 87%|████████▋ | 322615/371472 [3:29:42<4:09:23,  3.27it/s]
 87%|████████▋ | 322616/371472 [3:29:42<4:30:03,  3.02it/s]
 87%|████████▋ | 322617/371472 [3:29:43<4:09:26,  3.26it/s]
 87%|████████▋ | 322618/371472 [3:29:43<3:55:24,  3.46it/s]
 87%|████████▋ | 322619/371472 [3:29:43<3:44:18,  3.63it/s]
 87%|████████▋ | 322620/371472 [3:29:43<3:45:22,  3.61it/s]
                                                           
{'loss': 2.641, 'learning_rate': 2.1842207330474689e-07, 'epoch': 13.9}

 87%|████████▋ | 322620/371472 [3:29:43<3:45:22,  3.61it/s]
 87%|████████▋ | 322621/371472 [3:29:44<3:45:36,  3.61it/s]
 87%|████████▋ | 322622/371472 [3:29:44<3:44:58,  3.62it/s]
 87%|████████▋ | 322623/371472 [3:29:44<3:39:51,  3.70it/s]
 87%|████████▋ | 322624/371472 [3:29:45<3:41:56,  3.67it/s]
 87%|████████▋ | 322625/371472 [3:29:45<3:53:27,  3.49it/s]
 87%|████████▋ | 322626/371472 [3:29:45<4:02:50,  3.35it/s]
 87%|████████▋ | 322627/371472 [3:29:45<3:50:28,  3.53it/s]
 87%|████████▋ | 322628/371472 [3:29:46<4:07:15,  3.29it/s]
 87%|████████▋ | 322629/371472 [3:29:46<3:57:49,  3.42it/s]
 87%|████████▋ | 322630/371472 [3:29:46<3:52:46,  3.50it/s]
 87%|████████▋ | 322631/371472 [3:29:47<3:45:10,  3.62it/s]
 87%|████████▋ | 322632/371472 [3:29:47<3:48:23,  3.56it/s]
 87%|████████▋ | 322633/371472 [3:29:47<4:12:32,  3.22it/s]
 87%|████████▋ | 322634/371472 [3:29:48<4:06:52,  3.30it/s]
 87%|████████▋ | 322635/371472 [3:29:48<4:03:14,  3.35it/s]
 87%|████████▋ | 322636/371472 [3:29:48<3:58:19,  3.42it/s]
 87%|████████▋ | 322637/371472 [3:29:48<4:05:26,  3.32it/s]
 87%|████████▋ | 322638/371472 [3:29:49<3:58:06,  3.42it/s]
 87%|████████▋ | 322639/371472 [3:29:49<4:02:34,  3.36it/s]
 87%|████████▋ | 322640/371472 [3:29:49<3:50:55,  3.52it/s]
                                                           
{'loss': 2.6462, 'learning_rate': 2.1837359132926804e-07, 'epoch': 13.9}

 87%|████████▋ | 322640/371472 [3:29:49<3:50:55,  3.52it/s]
 87%|████████▋ | 322641/371472 [3:29:50<3:48:28,  3.56it/s]
 87%|████████▋ | 322642/371472 [3:29:50<3:49:53,  3.54it/s]
 87%|████████▋ | 322643/371472 [3:29:50<3:45:38,  3.61it/s]
 87%|████████▋ | 322644/371472 [3:29:50<4:01:17,  3.37it/s]
 87%|████████▋ | 322645/371472 [3:29:51<3:56:37,  3.44it/s]
 87%|████████▋ | 322646/371472 [3:29:51<4:02:26,  3.36it/s]
 87%|████████▋ | 322647/371472 [3:29:51<3:52:32,  3.50it/s]
 87%|████████▋ | 322648/371472 [3:29:52<3:46:11,  3.60it/s]
 87%|████████▋ | 322649/371472 [3:29:52<3:48:07,  3.57it/s]
 87%|████████▋ | 322650/371472 [3:29:52<3:53:30,  3.48it/s]
 87%|████████▋ | 322651/371472 [3:29:52<4:04:39,  3.33it/s]
 87%|████████▋ | 322652/371472 [3:29:53<3:54:33,  3.47it/s]
 87%|████████▋ | 322653/371472 [3:29:53<4:06:21,  3.30it/s]
 87%|████████▋ | 322654/371472 [3:29:53<4:09:35,  3.26it/s]
 87%|████████▋ | 322655/371472 [3:29:54<3:56:41,  3.44it/s]
 87%|████████▋ | 322656/371472 [3:29:54<3:58:55,  3.41it/s]
 87%|████████▋ | 322657/371472 [3:29:54<4:08:07,  3.28it/s]
 87%|████████▋ | 322658/371472 [3:29:55<4:18:35,  3.15it/s]
 87%|████████▋ | 322659/371472 [3:29:55<4:02:25,  3.36it/s]
 87%|████████▋ | 322660/371472 [3:29:55<3:52:25,  3.50it/s]
                                                           
{'loss': 2.413, 'learning_rate': 2.183251093537891e-07, 'epoch': 13.9}

 87%|████████▋ | 322660/371472 [3:29:55<3:52:25,  3.50it/s]
 87%|████████▋ | 322661/371472 [3:29:55<3:56:13,  3.44it/s]
 87%|████████▋ | 322662/371472 [3:29:56<4:04:49,  3.32it/s]
 87%|████████▋ | 322663/371472 [3:29:56<4:01:26,  3.37it/s]
 87%|████████▋ | 322664/371472 [3:29:56<3:58:34,  3.41it/s]
 87%|████████▋ | 322665/371472 [3:29:57<3:50:05,  3.54it/s]
 87%|████████▋ | 322666/371472 [3:29:57<4:20:13,  3.13it/s]
 87%|████████▋ | 322667/371472 [3:29:57<4:13:21,  3.21it/s]
 87%|████████▋ | 322668/371472 [3:29:58<4:13:28,  3.21it/s]
 87%|████████▋ | 322669/371472 [3:29:58<4:22:42,  3.10it/s]
 87%|████████▋ | 322670/371472 [3:29:58<4:07:29,  3.29it/s]
 87%|████████▋ | 322671/371472 [3:29:58<3:57:17,  3.43it/s]
 87%|████████▋ | 322672/371472 [3:29:59<3:57:15,  3.43it/s]
 87%|████████▋ | 322673/371472 [3:29:59<4:06:16,  3.30it/s]
 87%|████████▋ | 322674/371472 [3:29:59<4:17:28,  3.16it/s]
 87%|████████▋ | 322675/371472 [3:30:00<4:03:20,  3.34it/s]
 87%|████████▋ | 322676/371472 [3:30:00<4:03:51,  3.34it/s]
 87%|████████▋ | 322677/371472 [3:30:00<4:11:20,  3.24it/s]
 87%|████████▋ | 322678/371472 [3:30:01<4:03:56,  3.33it/s]
 87%|████████▋ | 322679/371472 [3:30:01<3:59:26,  3.40it/s]
 87%|████████▋ | 322680/371472 [3:30:01<3:49:35,  3.54it/s]
                                                           
{'loss': 2.4732, 'learning_rate': 2.1827662737831026e-07, 'epoch': 13.9}

 87%|████████▋ | 322680/371472 [3:30:01<3:49:35,  3.54it/s]
 87%|████████▋ | 322681/371472 [3:30:01<3:43:23,  3.64it/s]
 87%|████████▋ | 322682/371472 [3:30:02<3:40:03,  3.70it/s]
 87%|████████▋ | 322683/371472 [3:30:02<3:41:12,  3.68it/s]
 87%|████████▋ | 322684/371472 [3:30:02<3:40:43,  3.68it/s]
 87%|████████▋ | 322685/371472 [3:30:03<3:54:44,  3.46it/s]
 87%|████████▋ | 322686/371472 [3:30:03<3:44:30,  3.62it/s]
 87%|████████▋ | 322687/371472 [3:30:03<3:50:06,  3.53it/s]
 87%|████████▋ | 322688/371472 [3:30:03<3:46:10,  3.59it/s]
 87%|████████▋ | 322689/371472 [3:30:04<3:57:46,  3.42it/s]
 87%|████████▋ | 322690/371472 [3:30:04<3:52:36,  3.50it/s]
 87%|████████▋ | 322691/371472 [3:30:04<3:45:06,  3.61it/s]
 87%|████████▋ | 322692/371472 [3:30:05<4:00:56,  3.37it/s]
 87%|████████▋ | 322693/371472 [3:30:05<3:51:47,  3.51it/s]
 87%|████████▋ | 322694/371472 [3:30:05<3:56:18,  3.44it/s]
 87%|████████▋ | 322695/371472 [3:30:05<3:44:19,  3.62it/s]
 87%|████████▋ | 322696/371472 [3:30:06<3:41:22,  3.67it/s]
 87%|████████▋ | 322697/371472 [3:30:06<3:46:32,  3.59it/s]
 87%|████████▋ | 322698/371472 [3:30:06<3:50:28,  3.53it/s]
 87%|████████▋ | 322699/371472 [3:30:06<3:43:40,  3.63it/s]
 87%|████████▋ | 322700/371472 [3:30:07<3:47:45,  3.57it/s]
                                                           
{'loss': 2.6885, 'learning_rate': 2.182281454028313e-07, 'epoch': 13.9}

 87%|████████▋ | 322700/371472 [3:30:07<3:47:45,  3.57it/s]
 87%|████████▋ | 322701/371472 [3:30:07<3:53:05,  3.49it/s]
 87%|████████▋ | 322702/371472 [3:30:07<3:46:29,  3.59it/s]
 87%|████████▋ | 322703/371472 [3:30:08<3:43:07,  3.64it/s]
 87%|████████▋ | 322704/371472 [3:30:08<3:49:54,  3.54it/s]
 87%|████████▋ | 322705/371472 [3:30:08<3:56:06,  3.44it/s]
 87%|████████▋ | 322706/371472 [3:30:08<3:55:14,  3.46it/s]
 87%|████████▋ | 322707/371472 [3:30:09<4:07:16,  3.29it/s]
 87%|████████▋ | 322708/371472 [3:30:09<4:05:33,  3.31it/s]
 87%|████████▋ | 322709/371472 [3:30:09<3:55:34,  3.45it/s]
 87%|████████▋ | 322710/371472 [3:30:10<3:51:55,  3.50it/s]
 87%|████████▋ | 322711/371472 [3:30:10<3:47:08,  3.58it/s]
 87%|████████▋ | 322712/371472 [3:30:10<3:50:44,  3.52it/s]
 87%|████████▋ | 322713/371472 [3:30:10<3:53:06,  3.49it/s]
 87%|████████▋ | 322714/371472 [3:30:11<3:54:44,  3.46it/s]
 87%|████████▋ | 322715/371472 [3:30:11<3:54:47,  3.46it/s]
 87%|████████▋ | 322716/371472 [3:30:11<3:44:56,  3.61it/s]
 87%|████████▋ | 322717/371472 [3:30:12<3:44:03,  3.63it/s]
 87%|████████▋ | 322718/371472 [3:30:12<3:37:08,  3.74it/s]
 87%|████████▋ | 322719/371472 [3:30:12<3:45:59,  3.60it/s]
 87%|████████▋ | 322720/371472 [3:30:12<3:44:38,  3.62it/s]
                                                           
{'loss': 2.5188, 'learning_rate': 2.1817966342735248e-07, 'epoch': 13.9}

 87%|████████▋ | 322720/371472 [3:30:12<3:44:38,  3.62it/s]
 87%|████████▋ | 322721/371472 [3:30:13<3:43:13,  3.64it/s]
 87%|████████▋ | 322722/371472 [3:30:13<3:40:23,  3.69it/s]
 87%|████████▋ | 322723/371472 [3:30:13<3:33:45,  3.80it/s]
 87%|████████▋ | 322724/371472 [3:30:13<3:27:27,  3.92it/s]
 87%|████████▋ | 322725/371472 [3:30:14<3:41:20,  3.67it/s]
 87%|████████▋ | 322726/371472 [3:30:14<3:58:16,  3.41it/s]
 87%|████████▋ | 322727/371472 [3:30:14<3:48:39,  3.55it/s]
 87%|████████▋ | 322728/371472 [3:30:15<3:45:08,  3.61it/s]
 87%|████████▋ | 322729/371472 [3:30:15<3:37:59,  3.73it/s]
 87%|████████▋ | 322730/371472 [3:30:15<4:07:03,  3.29it/s]
 87%|████████▋ | 322731/371472 [3:30:16<4:03:45,  3.33it/s]
 87%|████████▋ | 322732/371472 [3:30:16<3:51:14,  3.51it/s]
 87%|████████▋ | 322733/371472 [3:30:16<4:05:10,  3.31it/s]
 87%|████████▋ | 322734/371472 [3:30:16<3:53:35,  3.48it/s]
 87%|████████▋ | 322735/371472 [3:30:17<3:52:53,  3.49it/s]
 87%|████████▋ | 322736/371472 [3:30:17<3:55:04,  3.46it/s]
 87%|████████▋ | 322737/371472 [3:30:17<3:50:48,  3.52it/s]
 87%|████████▋ | 322738/371472 [3:30:18<4:02:31,  3.35it/s]
 87%|████████▋ | 322739/371472 [3:30:18<3:51:25,  3.51it/s]
 87%|████████▋ | 322740/371472 [3:30:18<4:16:37,  3.16it/s]
                                                           
{'loss': 2.5134, 'learning_rate': 2.1813118145187355e-07, 'epoch': 13.9}

 87%|████████▋ | 322740/371472 [3:30:18<4:16:37,  3.16it/s]
 87%|████████▋ | 322741/371472 [3:30:18<4:02:43,  3.35it/s]
 87%|████████▋ | 322742/371472 [3:30:19<3:58:08,  3.41it/s]
 87%|████████▋ | 322743/371472 [3:30:19<3:53:26,  3.48it/s]
 87%|████████▋ | 322744/371472 [3:30:19<3:53:34,  3.48it/s]
 87%|████████▋ | 322745/371472 [3:30:20<3:56:06,  3.44it/s]
 87%|████████▋ | 322746/371472 [3:30:20<3:45:15,  3.61it/s]
 87%|████████▋ | 322747/371472 [3:30:20<3:50:06,  3.53it/s]
 87%|████████▋ | 322748/371472 [3:30:20<3:48:43,  3.55it/s]
 87%|████████▋ | 322749/371472 [3:30:21<3:55:06,  3.45it/s]
 87%|████████▋ | 322750/371472 [3:30:21<3:43:18,  3.64it/s]
 87%|████████▋ | 322751/371472 [3:30:21<3:54:49,  3.46it/s]
 87%|████████▋ | 322752/371472 [3:30:22<3:46:17,  3.59it/s]
 87%|████████▋ | 322753/371472 [3:30:22<3:46:27,  3.59it/s]
 87%|████████▋ | 322754/371472 [3:30:22<3:58:00,  3.41it/s]
 87%|████████▋ | 322755/371472 [3:30:22<3:49:25,  3.54it/s]
 87%|████████▋ | 322756/371472 [3:30:23<4:05:19,  3.31it/s]
 87%|████████▋ | 322757/371472 [3:30:23<3:59:24,  3.39it/s]
 87%|████████▋ | 322758/371472 [3:30:23<4:05:53,  3.30it/s]
 87%|████████▋ | 322759/371472 [3:30:24<4:01:40,  3.36it/s]
 87%|████████▋ | 322760/371472 [3:30:24<3:57:32,  3.42it/s]
                                                           
{'loss': 2.5268, 'learning_rate': 2.1808269947639468e-07, 'epoch': 13.9}

 87%|████████▋ | 322760/371472 [3:30:24<3:57:32,  3.42it/s]
 87%|████████▋ | 322761/371472 [3:30:24<3:51:21,  3.51it/s]
 87%|████████▋ | 322762/371472 [3:30:24<3:46:37,  3.58it/s]
 87%|████████▋ | 322763/371472 [3:30:25<3:52:00,  3.50it/s]
 87%|████████▋ | 322764/371472 [3:30:25<3:51:08,  3.51it/s]
 87%|████████▋ | 322765/371472 [3:30:25<3:41:42,  3.66it/s]
 87%|████████▋ | 322766/371472 [3:30:26<3:35:31,  3.77it/s]
 87%|████████▋ | 322767/371472 [3:30:26<3:37:28,  3.73it/s]
 87%|████████▋ | 322768/371472 [3:30:26<3:49:52,  3.53it/s]
 87%|████████▋ | 322769/371472 [3:30:26<3:53:08,  3.48it/s]
 87%|████████▋ | 322770/371472 [3:30:27<3:58:29,  3.40it/s]
 87%|████████▋ | 322771/371472 [3:30:27<4:01:10,  3.37it/s]
 87%|████████▋ | 322772/371472 [3:30:27<4:14:16,  3.19it/s]
 87%|████████▋ | 322773/371472 [3:30:28<4:04:31,  3.32it/s]
 87%|████████▋ | 322774/371472 [3:30:28<4:01:35,  3.36it/s]
 87%|████████▋ | 322775/371472 [3:30:28<3:51:33,  3.51it/s]
 87%|████████▋ | 322776/371472 [3:30:29<3:52:18,  3.49it/s]
 87%|████████▋ | 322777/371472 [3:30:29<3:49:57,  3.53it/s]
 87%|████████▋ | 322778/371472 [3:30:29<3:43:41,  3.63it/s]
 87%|████████▋ | 322779/371472 [3:30:29<3:40:34,  3.68it/s]
 87%|████████▋ | 322780/371472 [3:30:30<3:37:26,  3.73it/s]
                                                           
{'loss': 2.5177, 'learning_rate': 2.1803421750091575e-07, 'epoch': 13.9}

 87%|████████▋ | 322780/371472 [3:30:30<3:37:26,  3.73it/s]
 87%|████████▋ | 322781/371472 [3:30:30<3:41:46,  3.66it/s]
 87%|████████▋ | 322782/371472 [3:30:30<3:36:50,  3.74it/s]
 87%|████████▋ | 322783/371472 [3:30:30<3:38:11,  3.72it/s]
 87%|████████▋ | 322784/371472 [3:30:31<3:45:53,  3.59it/s]
 87%|████████▋ | 322785/371472 [3:30:31<3:47:11,  3.57it/s]
 87%|████████▋ | 322786/371472 [3:30:31<4:01:55,  3.35it/s]
 87%|████████▋ | 322787/371472 [3:30:32<3:51:48,  3.50it/s]
 87%|████████▋ | 322788/371472 [3:30:32<4:04:02,  3.32it/s]
 87%|████████▋ | 322789/371472 [3:30:32<3:53:33,  3.47it/s]
 87%|████████▋ | 322790/371472 [3:30:32<4:03:58,  3.33it/s]
 87%|████████▋ | 322791/371472 [3:30:33<3:52:35,  3.49it/s]
 87%|████████▋ | 322792/371472 [3:30:33<3:56:34,  3.43it/s]
 87%|████████▋ | 322793/371472 [3:30:33<3:59:40,  3.38it/s]
 87%|████████▋ | 322794/371472 [3:30:34<3:48:49,  3.55it/s]
 87%|████████▋ | 322795/371472 [3:30:34<3:42:28,  3.65it/s]
 87%|████████▋ | 322796/371472 [3:30:34<3:46:11,  3.59it/s]
 87%|████████▋ | 322797/371472 [3:30:35<4:12:36,  3.21it/s]
 87%|████████▋ | 322798/371472 [3:30:35<3:58:11,  3.41it/s]
 87%|████████▋ | 322799/371472 [3:30:35<3:57:14,  3.42it/s]
 87%|████████▋ | 322800/371472 [3:30:35<3:49:01,  3.54it/s]
                                                           
{'loss': 2.7694, 'learning_rate': 2.1798573552543693e-07, 'epoch': 13.9}

 87%|████████▋ | 322800/371472 [3:30:35<3:49:01,  3.54it/s]
 87%|████████▋ | 322801/371472 [3:30:36<4:04:56,  3.31it/s]
 87%|████████▋ | 322802/371472 [3:30:36<3:52:54,  3.48it/s]
 87%|████████▋ | 322803/371472 [3:30:36<3:55:20,  3.45it/s]
 87%|████████▋ | 322804/371472 [3:30:37<3:56:54,  3.42it/s]
 87%|████████▋ | 322805/371472 [3:30:37<3:54:45,  3.46it/s]
 87%|████████▋ | 322806/371472 [3:30:37<3:51:12,  3.51it/s]
 87%|████████▋ | 322807/371472 [3:30:37<3:59:31,  3.39it/s]
 87%|████████▋ | 322808/371472 [3:30:38<3:42:57,  3.64it/s]
 87%|████████▋ | 322809/371472 [3:30:38<3:37:34,  3.73it/s]
 87%|████████▋ | 322810/371472 [3:30:38<3:40:15,  3.68it/s]
 87%|████████▋ | 322811/371472 [3:30:38<3:38:05,  3.72it/s]
 87%|████████▋ | 322812/371472 [3:30:39<3:42:10,  3.65it/s]
 87%|████████▋ | 322813/371472 [3:30:39<3:49:14,  3.54it/s]
 87%|████████▋ | 322814/371472 [3:30:39<3:58:07,  3.41it/s]
 87%|████████▋ | 322815/371472 [3:30:40<3:52:21,  3.49it/s]
 87%|████████▋ | 322816/371472 [3:30:40<4:03:31,  3.33it/s]
 87%|████████▋ | 322817/371472 [3:30:40<3:53:32,  3.47it/s]
 87%|████████▋ | 322818/371472 [3:30:40<3:43:52,  3.62it/s]
 87%|████████▋ | 322819/371472 [3:30:41<3:39:33,  3.69it/s]
 87%|████████▋ | 322820/371472 [3:30:41<4:05:26,  3.30it/s]
                                                           
{'loss': 2.463, 'learning_rate': 2.1793725354995797e-07, 'epoch': 13.9}

 87%|████████▋ | 322820/371472 [3:30:41<4:05:26,  3.30it/s]
 87%|████████▋ | 322821/371472 [3:30:41<4:04:14,  3.32it/s]
 87%|████████▋ | 322822/371472 [3:30:42<3:54:09,  3.46it/s]
 87%|████████▋ | 322823/371472 [3:30:42<4:13:36,  3.20it/s]
 87%|████████▋ | 322824/371472 [3:30:42<4:13:36,  3.20it/s]
 87%|████████▋ | 322825/371472 [3:30:43<4:02:32,  3.34it/s]
 87%|████████▋ | 322826/371472 [3:30:43<3:53:13,  3.48it/s]
 87%|████████▋ | 322827/371472 [3:30:43<3:54:35,  3.46it/s]
 87%|████████▋ | 322828/371472 [3:30:43<3:44:41,  3.61it/s]
 87%|████████▋ | 322829/371472 [3:30:44<3:43:44,  3.62it/s]
 87%|████████▋ | 322830/371472 [3:30:44<3:38:15,  3.71it/s]
 87%|████████▋ | 322831/371472 [3:30:44<3:52:55,  3.48it/s]
 87%|████████▋ | 322832/371472 [3:30:45<3:49:20,  3.53it/s]
 87%|████████▋ | 322833/371472 [3:30:45<3:40:04,  3.68it/s]
 87%|████████▋ | 322834/371472 [3:30:45<3:43:37,  3.63it/s]
 87%|████████▋ | 322835/371472 [3:30:45<3:43:44,  3.62it/s]
 87%|████████▋ | 322836/371472 [3:30:46<3:43:02,  3.63it/s]
 87%|████████▋ | 322837/371472 [3:30:46<3:44:56,  3.60it/s]
 87%|████████▋ | 322838/371472 [3:30:46<3:48:54,  3.54it/s]
 87%|████████▋ | 322839/371472 [3:30:46<3:51:52,  3.50it/s]
 87%|████████▋ | 322840/371472 [3:30:47<3:53:16,  3.47it/s]
                                                           
{'loss': 2.6157, 'learning_rate': 2.1788877157447912e-07, 'epoch': 13.91}

 87%|████████▋ | 322840/371472 [3:30:47<3:53:16,  3.47it/s]
 87%|████████▋ | 322841/371472 [3:30:47<3:58:36,  3.40it/s]
 87%|████████▋ | 322842/371472 [3:30:47<3:50:58,  3.51it/s]
 87%|████████▋ | 322843/371472 [3:30:48<3:39:24,  3.69it/s]
 87%|████████▋ | 322844/371472 [3:30:48<3:45:28,  3.59it/s]
 87%|████████▋ | 322845/371472 [3:30:48<3:47:05,  3.57it/s]
 87%|████████▋ | 322846/371472 [3:30:48<3:50:12,  3.52it/s]
 87%|████████▋ | 322847/371472 [3:30:49<3:54:19,  3.46it/s]
 87%|████████▋ | 322848/371472 [3:30:49<3:53:03,  3.48it/s]
 87%|████████▋ | 322849/371472 [3:30:49<3:45:50,  3.59it/s]
 87%|████████▋ | 322850/371472 [3:30:50<3:39:40,  3.69it/s]
 87%|████████▋ | 322851/371472 [3:30:50<3:34:14,  3.78it/s]
 87%|████████▋ | 322852/371472 [3:30:50<3:31:50,  3.83it/s]
 87%|████████▋ | 322853/371472 [3:30:50<3:37:48,  3.72it/s]
 87%|████████▋ | 322854/371472 [3:30:51<3:41:26,  3.66it/s]
 87%|████████▋ | 322855/371472 [3:30:51<3:42:38,  3.64it/s]
 87%|████████▋ | 322856/371472 [3:30:51<3:36:21,  3.75it/s]
 87%|████████▋ | 322857/371472 [3:30:51<3:50:36,  3.51it/s]
 87%|████████▋ | 322858/371472 [3:30:52<3:51:44,  3.50it/s]
 87%|████████▋ | 322859/371472 [3:30:52<3:45:10,  3.60it/s]
 87%|████████▋ | 322860/371472 [3:30:52<3:38:39,  3.71it/s]
                                                           
{'loss': 2.657, 'learning_rate': 2.178402895990002e-07, 'epoch': 13.91}

 87%|████████▋ | 322860/371472 [3:30:52<3:38:39,  3.71it/s]
 87%|████████▋ | 322861/371472 [3:30:53<4:00:29,  3.37it/s]
 87%|████████▋ | 322862/371472 [3:30:53<3:50:59,  3.51it/s]
 87%|████████▋ | 322863/371472 [3:30:53<3:43:34,  3.62it/s]
 87%|████████▋ | 322864/371472 [3:30:53<3:37:32,  3.72it/s]
 87%|████████▋ | 322865/371472 [3:30:54<4:02:20,  3.34it/s]
 87%|████████▋ | 322866/371472 [3:30:54<4:06:21,  3.29it/s]
 87%|████████▋ | 322867/371472 [3:30:54<3:56:49,  3.42it/s]
 87%|████████▋ | 322868/371472 [3:30:55<3:53:38,  3.47it/s]
 87%|████████▋ | 322869/371472 [3:30:55<3:46:45,  3.57it/s]
 87%|████████▋ | 322870/371472 [3:30:55<3:50:20,  3.52it/s]
 87%|████████▋ | 322871/371472 [3:30:55<3:54:14,  3.46it/s]
 87%|████████▋ | 322872/371472 [3:30:56<3:49:21,  3.53it/s]
 87%|████████▋ | 322873/371472 [3:30:56<3:45:29,  3.59it/s]
 87%|████████▋ | 322874/371472 [3:30:56<3:50:06,  3.52it/s]
 87%|████████▋ | 322875/371472 [3:30:57<3:49:27,  3.53it/s]
 87%|████████▋ | 322876/371472 [3:30:57<3:49:36,  3.53it/s]
 87%|████████▋ | 322877/371472 [3:30:57<3:51:36,  3.50it/s]
 87%|████████▋ | 322878/371472 [3:30:57<3:51:40,  3.50it/s]
 87%|████████▋ | 322879/371472 [3:30:58<3:52:56,  3.48it/s]
 87%|████████▋ | 322880/371472 [3:30:58<3:51:09,  3.50it/s]
                                                           
{'loss': 2.5717, 'learning_rate': 2.1779180762352134e-07, 'epoch': 13.91}

 87%|████████▋ | 322880/371472 [3:30:58<3:51:09,  3.50it/s]
 87%|████████▋ | 322881/371472 [3:30:58<4:05:28,  3.30it/s]
 87%|████████▋ | 322882/371472 [3:30:59<4:05:02,  3.30it/s]
 87%|████████▋ | 322883/371472 [3:30:59<4:02:13,  3.34it/s]
 87%|████████▋ | 322884/371472 [3:30:59<4:00:39,  3.37it/s]
 87%|████████▋ | 322885/371472 [3:31:00<3:49:50,  3.52it/s]
 87%|████████▋ | 322886/371472 [3:31:00<3:49:41,  3.53it/s]
 87%|████████▋ | 322887/371472 [3:31:00<3:47:50,  3.55it/s]
 87%|████████▋ | 322888/371472 [3:31:00<3:39:25,  3.69it/s]
 87%|████████▋ | 322889/371472 [3:31:01<3:40:19,  3.68it/s]
 87%|████████▋ | 322890/371472 [3:31:01<3:45:44,  3.59it/s]
 87%|████████▋ | 322891/371472 [3:31:01<3:46:35,  3.57it/s]
 87%|████████▋ | 322892/371472 [3:31:01<3:45:43,  3.59it/s]
 87%|████████▋ | 322893/371472 [3:31:02<3:49:37,  3.53it/s]
 87%|████████▋ | 322894/371472 [3:31:02<3:43:03,  3.63it/s]
 87%|████████▋ | 322895/371472 [3:31:02<3:55:26,  3.44it/s]
 87%|████████▋ | 322896/371472 [3:31:03<3:56:08,  3.43it/s]
 87%|████████▋ | 322897/371472 [3:31:03<3:47:11,  3.56it/s]
 87%|████████▋ | 322898/371472 [3:31:03<3:47:17,  3.56it/s]
 87%|████████▋ | 322899/371472 [3:31:03<3:58:27,  3.39it/s]
 87%|████████▋ | 322900/371472 [3:31:04<3:48:26,  3.54it/s]
                                                           
{'loss': 2.6992, 'learning_rate': 2.1774332564804242e-07, 'epoch': 13.91}

 87%|████████▋ | 322900/371472 [3:31:04<3:48:26,  3.54it/s]
 87%|████████▋ | 322901/371472 [3:31:04<4:02:55,  3.33it/s]
 87%|████████▋ | 322902/371472 [3:31:04<3:54:32,  3.45it/s]
 87%|████████▋ | 322903/371472 [3:31:05<3:44:58,  3.60it/s]
 87%|████████▋ | 322904/371472 [3:31:05<3:34:03,  3.78it/s]
 87%|████████▋ | 322905/371472 [3:31:05<3:32:33,  3.81it/s]
 87%|████████▋ | 322906/371472 [3:31:05<3:29:32,  3.86it/s]
 87%|████████▋ | 322907/371472 [3:31:06<3:24:01,  3.97it/s]
 87%|████████▋ | 322908/371472 [3:31:06<3:30:28,  3.85it/s]
 87%|████████▋ | 322909/371472 [3:31:06<3:45:41,  3.59it/s]
 87%|████████▋ | 322910/371472 [3:31:06<3:41:34,  3.65it/s]
 87%|████████▋ | 322911/371472 [3:31:07<3:37:41,  3.72it/s]
 87%|████████▋ | 322912/371472 [3:31:07<3:54:05,  3.46it/s]
 87%|████████▋ | 322913/371472 [3:31:07<3:48:43,  3.54it/s]
 87%|████████▋ | 322914/371472 [3:31:08<3:40:41,  3.67it/s]
 87%|████████▋ | 322915/371472 [3:31:08<3:43:25,  3.62it/s]
 87%|████████▋ | 322916/371472 [3:31:08<3:50:48,  3.51it/s]
 87%|████████▋ | 322917/371472 [3:31:08<3:54:53,  3.45it/s]
 87%|████████▋ | 322918/371472 [3:31:09<3:57:54,  3.40it/s]
 87%|████████▋ | 322919/371472 [3:31:09<3:47:54,  3.55it/s]
 87%|████████▋ | 322920/371472 [3:31:09<3:47:00,  3.56it/s]
                                                           
{'loss': 2.6036, 'learning_rate': 2.1769484367256346e-07, 'epoch': 13.91}

 87%|████████▋ | 322920/371472 [3:31:09<3:47:00,  3.56it/s]
 87%|████████▋ | 322921/371472 [3:31:10<3:41:04,  3.66it/s]
 87%|████████▋ | 322922/371472 [3:31:10<3:36:25,  3.74it/s]
 87%|████████▋ | 322923/371472 [3:31:10<3:59:08,  3.38it/s]
 87%|████████▋ | 322924/371472 [3:31:10<3:51:19,  3.50it/s]
 87%|████████▋ | 322925/371472 [3:31:11<3:55:34,  3.43it/s]
 87%|████████▋ | 322926/371472 [3:31:11<3:49:26,  3.53it/s]
 87%|████████▋ | 322927/371472 [3:31:11<3:50:14,  3.51it/s]
 87%|████████▋ | 322928/371472 [3:31:12<3:46:55,  3.57it/s]
 87%|████████▋ | 322929/371472 [3:31:12<3:46:11,  3.58it/s]
 87%|████████▋ | 322930/371472 [3:31:12<3:56:07,  3.43it/s]
 87%|████████▋ | 322931/371472 [3:31:12<3:52:15,  3.48it/s]
 87%|████████▋ | 322932/371472 [3:31:13<3:47:22,  3.56it/s]
 87%|████████▋ | 322933/371472 [3:31:13<3:43:29,  3.62it/s]
 87%|████████▋ | 322934/371472 [3:31:13<3:38:17,  3.71it/s]
 87%|████████▋ | 322935/371472 [3:31:13<3:39:16,  3.69it/s]
 87%|████████▋ | 322936/371472 [3:31:14<3:38:45,  3.70it/s]
 87%|████████▋ | 322937/371472 [3:31:14<3:56:15,  3.42it/s]
 87%|████████▋ | 322938/371472 [3:31:14<3:58:46,  3.39it/s]
 87%|████████▋ | 322939/371472 [3:31:15<3:51:30,  3.49it/s]
 87%|████████▋ | 322940/371472 [3:31:15<3:52:37,  3.48it/s]
                                                           
{'loss': 2.5744, 'learning_rate': 2.176463616970846e-07, 'epoch': 13.91}

 87%|████████▋ | 322940/371472 [3:31:15<3:52:37,  3.48it/s]
 87%|████████▋ | 322941/371472 [3:31:15<3:45:13,  3.59it/s]
 87%|████████▋ | 322942/371472 [3:31:15<3:42:42,  3.63it/s]
 87%|████████▋ | 322943/371472 [3:31:16<3:47:41,  3.55it/s]
 87%|████████▋ | 322944/371472 [3:31:16<4:00:41,  3.36it/s]
 87%|████████▋ | 322945/371472 [3:31:16<4:01:01,  3.36it/s]
 87%|████████▋ | 322946/371472 [3:31:17<4:07:04,  3.27it/s]
 87%|████████▋ | 322947/371472 [3:31:17<3:59:43,  3.37it/s]
 87%|████████▋ | 322948/371472 [3:31:17<3:57:43,  3.40it/s]
 87%|████████▋ | 322949/371472 [3:31:18<4:01:09,  3.35it/s]
 87%|████████▋ | 322950/371472 [3:31:18<4:02:38,  3.33it/s]
 87%|████████▋ | 322951/371472 [3:31:18<3:51:37,  3.49it/s]
 87%|████████▋ | 322952/371472 [3:31:18<3:47:55,  3.55it/s]
 87%|████████▋ | 322953/371472 [3:31:19<3:51:39,  3.49it/s]
 87%|████████▋ | 322954/371472 [3:31:19<3:53:24,  3.46it/s]
 87%|████████▋ | 322955/371472 [3:31:19<3:52:02,  3.48it/s]
 87%|████████▋ | 322956/371472 [3:31:20<3:41:49,  3.65it/s]
 87%|████████▋ | 322957/371472 [3:31:20<3:58:54,  3.38it/s]
 87%|████████▋ | 322958/371472 [3:31:20<3:51:56,  3.49it/s]
 87%|████████▋ | 322959/371472 [3:31:20<3:42:18,  3.64it/s]
 87%|████████▋ | 322960/371472 [3:31:21<3:48:48,  3.53it/s]
                                                           
{'loss': 2.5247, 'learning_rate': 2.1759787972160566e-07, 'epoch': 13.91}

 87%|████████▋ | 322960/371472 [3:31:21<3:48:48,  3.53it/s]
 87%|████████▋ | 322961/371472 [3:31:21<3:42:27,  3.63it/s]
 87%|████████▋ | 322962/371472 [3:31:21<3:48:01,  3.55it/s]
 87%|████████▋ | 322963/371472 [3:31:22<3:55:28,  3.43it/s]
 87%|████████▋ | 322964/371472 [3:31:22<3:44:42,  3.60it/s]
 87%|████████▋ | 322965/371472 [3:31:22<3:39:42,  3.68it/s]
 87%|████████▋ | 322966/371472 [3:31:22<3:38:59,  3.69it/s]
 87%|████████▋ | 322967/371472 [3:31:23<3:34:09,  3.77it/s]
 87%|████████▋ | 322968/371472 [3:31:23<3:36:54,  3.73it/s]
 87%|████████▋ | 322969/371472 [3:31:23<3:28:57,  3.87it/s]
 87%|████████▋ | 322970/371472 [3:31:23<3:28:42,  3.87it/s]
 87%|████████▋ | 322971/371472 [3:31:24<3:29:02,  3.87it/s]
 87%|████████▋ | 322972/371472 [3:31:24<3:37:18,  3.72it/s]
 87%|████████▋ | 322973/371472 [3:31:24<3:31:52,  3.82it/s]
 87%|████████▋ | 322974/371472 [3:31:24<3:38:39,  3.70it/s]
 87%|████████▋ | 322975/371472 [3:31:25<3:42:41,  3.63it/s]
 87%|████████▋ | 322976/371472 [3:31:25<3:42:47,  3.63it/s]
 87%|████████▋ | 322977/371472 [3:31:25<3:49:01,  3.53it/s]
 87%|████████▋ | 322978/371472 [3:31:26<3:44:24,  3.60it/s]
 87%|████████▋ | 322979/371472 [3:31:26<3:41:25,  3.65it/s]
 87%|████████▋ | 322980/371472 [3:31:26<3:43:35,  3.61it/s]
                                                           
{'loss': 2.6865, 'learning_rate': 2.1754939774612683e-07, 'epoch': 13.91}

 87%|████████▋ | 322980/371472 [3:31:26<3:43:35,  3.61it/s]
 87%|████████▋ | 322981/371472 [3:31:26<3:43:52,  3.61it/s]
 87%|████████▋ | 322982/371472 [3:31:27<3:37:39,  3.71it/s]
 87%|████████▋ | 322983/371472 [3:31:27<3:30:18,  3.84it/s]
 87%|████████▋ | 322984/371472 [3:31:27<4:24:18,  3.06it/s]
 87%|████████▋ | 322985/371472 [3:31:28<4:09:08,  3.24it/s]
 87%|████████▋ | 322986/371472 [3:31:28<3:59:17,  3.38it/s]
 87%|████████▋ | 322987/371472 [3:31:28<3:53:44,  3.46it/s]
 87%|████████▋ | 322988/371472 [3:31:28<3:49:23,  3.52it/s]
 87%|████████▋ | 322989/371472 [3:31:29<3:45:20,  3.59it/s]
 87%|████████▋ | 322990/371472 [3:31:29<3:53:39,  3.46it/s]
 87%|████████▋ | 322991/371472 [3:31:29<3:49:34,  3.52it/s]
 87%|████████▋ | 322992/371472 [3:31:30<4:05:29,  3.29it/s]
 87%|████████▋ | 322993/371472 [3:31:30<4:00:13,  3.36it/s]
 87%|████████▋ | 322994/371472 [3:31:30<3:52:38,  3.47it/s]
 87%|████████▋ | 322995/371472 [3:31:31<4:14:35,  3.17it/s]
 87%|████████▋ | 322996/371472 [3:31:31<4:02:27,  3.33it/s]
 87%|████████▋ | 322997/371472 [3:31:31<3:53:58,  3.45it/s]
 87%|████████▋ | 322998/371472 [3:31:31<3:42:34,  3.63it/s]
 87%|████████▋ | 322999/371472 [3:31:32<4:19:19,  3.12it/s]
 87%|████████▋ | 323000/371472 [3:31:32<4:02:49,  3.33it/s]
                                                           
{'loss': 2.5961, 'learning_rate': 2.1750091577064788e-07, 'epoch': 13.91}

 87%|████████▋ | 323000/371472 [3:31:32<4:02:49,  3.33it/s]
 87%|████████▋ | 323001/371472 [3:31:33<4:48:27,  2.80it/s]
 87%|████████▋ | 323002/371472 [3:31:33<4:22:14,  3.08it/s]
 87%|████████▋ | 323003/371472 [3:31:33<4:05:57,  3.28it/s]
 87%|████████▋ | 323004/371472 [3:31:33<3:56:07,  3.42it/s]
 87%|████████▋ | 323005/371472 [3:31:34<3:47:22,  3.55it/s]
 87%|████████▋ | 323006/371472 [3:31:34<3:45:24,  3.58it/s]
 87%|████████▋ | 323007/371472 [3:31:34<3:47:09,  3.56it/s]
 87%|████████▋ | 323008/371472 [3:31:34<3:53:04,  3.47it/s]
 87%|████████▋ | 323009/371472 [3:31:35<4:12:21,  3.20it/s]
 87%|████████▋ | 323010/371472 [3:31:35<3:55:24,  3.43it/s]
 87%|████████▋ | 323011/371472 [3:31:35<3:42:56,  3.62it/s]
 87%|████████▋ | 323012/371472 [3:31:36<3:37:32,  3.71it/s]
 87%|████████▋ | 323013/371472 [3:31:36<3:47:10,  3.56it/s]
 87%|████████▋ | 323014/371472 [3:31:36<3:38:53,  3.69it/s]
 87%|████████▋ | 323015/371472 [3:31:36<3:35:51,  3.74it/s]
 87%|████████▋ | 323016/371472 [3:31:37<3:36:22,  3.73it/s]
 87%|████████▋ | 323017/371472 [3:31:37<3:35:17,  3.75it/s]
 87%|████████▋ | 323018/371472 [3:31:37<3:32:12,  3.81it/s]
 87%|████████▋ | 323019/371472 [3:31:37<3:50:53,  3.50it/s]
 87%|████████▋ | 323020/371472 [3:31:38<4:06:26,  3.28it/s]
                                                           
{'loss': 2.5787, 'learning_rate': 2.1745243379516903e-07, 'epoch': 13.91}

 87%|████████▋ | 323020/371472 [3:31:38<4:06:26,  3.28it/s]
 87%|████████▋ | 323021/371472 [3:31:38<3:59:29,  3.37it/s]
 87%|████████▋ | 323022/371472 [3:31:38<3:54:25,  3.44it/s]
 87%|████████▋ | 323023/371472 [3:31:39<4:05:47,  3.29it/s]
 87%|████████▋ | 323024/371472 [3:31:39<3:58:39,  3.38it/s]
 87%|████████▋ | 323025/371472 [3:31:39<3:50:08,  3.51it/s]
 87%|████████▋ | 323026/371472 [3:31:39<3:48:03,  3.54it/s]
 87%|████████▋ | 323027/371472 [3:31:40<3:43:45,  3.61it/s]
 87%|████████▋ | 323028/371472 [3:31:40<3:39:54,  3.67it/s]
 87%|████████▋ | 323029/371472 [3:31:40<3:40:11,  3.67it/s]
 87%|████████▋ | 323030/371472 [3:31:41<3:33:55,  3.77it/s]
 87%|████████▋ | 323031/371472 [3:31:41<3:30:07,  3.84it/s]
 87%|████████▋ | 323032/371472 [3:31:41<3:32:33,  3.80it/s]
 87%|████████▋ | 323033/371472 [3:31:41<3:37:02,  3.72it/s]
 87%|████████▋ | 323034/371472 [3:31:42<3:43:40,  3.61it/s]
 87%|████████▋ | 323035/371472 [3:31:42<3:39:30,  3.68it/s]
 87%|████████▋ | 323036/371472 [3:31:42<3:45:58,  3.57it/s]
 87%|████████▋ | 323037/371472 [3:31:42<3:46:12,  3.57it/s]
 87%|████████▋ | 323038/371472 [3:31:43<3:41:41,  3.64it/s]
 87%|████████▋ | 323039/371472 [3:31:43<3:38:41,  3.69it/s]
 87%|████████▋ | 323040/371472 [3:31:43<3:52:22,  3.47it/s]
                                                           
{'loss': 2.6522, 'learning_rate': 2.174039518196901e-07, 'epoch': 13.91}

 87%|████████▋ | 323040/371472 [3:31:43<3:52:22,  3.47it/s]
 87%|████████▋ | 323041/371472 [3:31:44<4:19:52,  3.11it/s]
 87%|████████▋ | 323042/371472 [3:31:44<4:19:02,  3.12it/s]
 87%|████████▋ | 323043/371472 [3:31:44<4:03:34,  3.31it/s]
 87%|████████▋ | 323044/371472 [3:31:45<4:51:14,  2.77it/s]
 87%|████████▋ | 323045/371472 [3:31:45<4:35:56,  2.93it/s]
 87%|████████▋ | 323046/371472 [3:31:45<4:32:05,  2.97it/s]
 87%|████████▋ | 323047/371472 [3:31:46<4:18:10,  3.13it/s]
 87%|████████▋ | 323048/371472 [3:31:46<4:14:31,  3.17it/s]
 87%|████████▋ | 323049/371472 [3:31:46<4:23:41,  3.06it/s]
 87%|████████▋ | 323050/371472 [3:31:47<4:22:21,  3.08it/s]
 87%|████████▋ | 323051/371472 [3:31:47<4:07:37,  3.26it/s]
 87%|████████▋ | 323052/371472 [3:31:47<3:56:56,  3.41it/s]
 87%|████████▋ | 323053/371472 [3:31:47<3:52:06,  3.48it/s]
 87%|████████▋ | 323054/371472 [3:31:48<3:46:39,  3.56it/s]
 87%|████████▋ | 323055/371472 [3:31:48<3:51:34,  3.48it/s]
 87%|████████▋ | 323056/371472 [3:31:48<3:58:55,  3.38it/s]
 87%|████████▋ | 323057/371472 [3:31:49<3:57:48,  3.39it/s]
 87%|████████▋ | 323058/371472 [3:31:49<4:15:59,  3.15it/s]
 87%|████████▋ | 323059/371472 [3:31:49<4:15:36,  3.16it/s]
 87%|████████▋ | 323060/371472 [3:31:50<4:00:22,  3.36it/s]
                                                           
{'loss': 2.4898, 'learning_rate': 2.1735546984421125e-07, 'epoch': 13.91}

 87%|████████▋ | 323060/371472 [3:31:50<4:00:22,  3.36it/s]
 87%|████████▋ | 323061/371472 [3:31:50<4:01:47,  3.34it/s]
 87%|████████▋ | 323062/371472 [3:31:50<3:49:08,  3.52it/s]
 87%|████████▋ | 323063/371472 [3:31:50<3:53:12,  3.46it/s]
 87%|████████▋ | 323064/371472 [3:31:51<3:42:10,  3.63it/s]
 87%|████████▋ | 323065/371472 [3:31:51<3:44:57,  3.59it/s]
 87%|████████▋ | 323066/371472 [3:31:51<3:41:55,  3.64it/s]
 87%|████████▋ | 323067/371472 [3:31:51<3:32:14,  3.80it/s]
 87%|████████▋ | 323068/371472 [3:31:52<3:46:26,  3.56it/s]
 87%|████████▋ | 323069/371472 [3:31:52<3:57:09,  3.40it/s]
 87%|████████▋ | 323070/371472 [3:31:52<3:53:16,  3.46it/s]
 87%|████████▋ | 323071/371472 [3:31:53<3:57:55,  3.39it/s]
 87%|████████▋ | 323072/371472 [3:31:53<3:52:10,  3.47it/s]
 87%|████████▋ | 323073/371472 [3:31:53<4:05:02,  3.29it/s]
 87%|████████▋ | 323074/371472 [3:31:54<4:14:24,  3.17it/s]
 87%|████████▋ | 323075/371472 [3:31:54<4:09:58,  3.23it/s]
 87%|████████▋ | 323076/371472 [3:31:54<3:59:36,  3.37it/s]
 87%|████████▋ | 323077/371472 [3:31:55<3:52:49,  3.46it/s]
 87%|████████▋ | 323078/371472 [3:31:55<3:48:03,  3.54it/s]
 87%|████████▋ | 323079/371472 [3:31:55<3:54:03,  3.45it/s]
 87%|████████▋ | 323080/371472 [3:31:55<3:52:33,  3.47it/s]
                                                           
{'loss': 2.6025, 'learning_rate': 2.173069878687323e-07, 'epoch': 13.92}

 87%|████████▋ | 323080/371472 [3:31:55<3:52:33,  3.47it/s]
 87%|████████▋ | 323081/371472 [3:31:56<3:49:59,  3.51it/s]
 87%|████████▋ | 323082/371472 [3:31:56<3:48:08,  3.54it/s]
 87%|████████▋ | 323083/371472 [3:31:56<3:52:01,  3.48it/s]
 87%|████████▋ | 323084/371472 [3:31:57<3:48:45,  3.53it/s]
 87%|████████▋ | 323085/371472 [3:31:57<4:03:29,  3.31it/s]
 87%|████████▋ | 323086/371472 [3:31:57<3:54:37,  3.44it/s]
 87%|████████▋ | 323087/371472 [3:31:57<3:52:10,  3.47it/s]
 87%|████████▋ | 323088/371472 [3:31:58<3:45:00,  3.58it/s]
 87%|████████▋ | 323089/371472 [3:31:58<3:52:48,  3.46it/s]
 87%|████████▋ | 323090/371472 [3:31:58<3:43:59,  3.60it/s]
 87%|████████▋ | 323091/371472 [3:31:59<3:49:00,  3.52it/s]
 87%|████████▋ | 323092/371472 [3:31:59<3:44:46,  3.59it/s]
 87%|████████▋ | 323093/371472 [3:31:59<3:37:31,  3.71it/s]
 87%|████████▋ | 323094/371472 [3:31:59<3:38:02,  3.70it/s]
 87%|████████▋ | 323095/371472 [3:32:00<3:37:14,  3.71it/s]
 87%|████████▋ | 323096/371472 [3:32:00<4:01:29,  3.34it/s]
 87%|████████▋ | 323097/371472 [3:32:00<3:56:48,  3.40it/s]
 87%|████████▋ | 323098/371472 [3:32:01<4:09:05,  3.24it/s]
 87%|████████▋ | 323099/371472 [3:32:01<4:01:31,  3.34it/s]
 87%|████████▋ | 323100/371472 [3:32:01<3:53:26,  3.45it/s]
                                                           
{'loss': 2.5855, 'learning_rate': 2.1725850589325347e-07, 'epoch': 13.92}

 87%|████████▋ | 323100/371472 [3:32:01<3:53:26,  3.45it/s]
 87%|████████▋ | 323101/371472 [3:32:01<3:51:36,  3.48it/s]
 87%|████████▋ | 323102/371472 [3:32:02<3:59:41,  3.36it/s]
 87%|████████▋ | 323103/371472 [3:32:02<4:02:46,  3.32it/s]
 87%|████████▋ | 323104/371472 [3:32:02<3:54:13,  3.44it/s]
 87%|████████▋ | 323105/371472 [3:32:03<3:47:03,  3.55it/s]
 87%|████████▋ | 323106/371472 [3:32:03<3:37:59,  3.70it/s]
 87%|████████▋ | 323107/371472 [3:32:03<3:30:03,  3.84it/s]
 87%|████████▋ | 323108/371472 [3:32:03<3:38:52,  3.68it/s]
 87%|████████▋ | 323109/371472 [3:32:04<3:38:21,  3.69it/s]
 87%|████████▋ | 323110/371472 [3:32:04<3:41:30,  3.64it/s]
 87%|████████▋ | 323111/371472 [3:32:04<3:42:51,  3.62it/s]
 87%|████████▋ | 323112/371472 [3:32:04<3:43:19,  3.61it/s]
 87%|████████▋ | 323113/371472 [3:32:05<3:47:56,  3.54it/s]
 87%|████████▋ | 323114/371472 [3:32:05<3:57:47,  3.39it/s]
 87%|████████▋ | 323115/371472 [3:32:05<3:50:22,  3.50it/s]
 87%|████████▋ | 323116/371472 [3:32:06<3:35:57,  3.73it/s]
 87%|████████▋ | 323117/371472 [3:32:06<3:48:11,  3.53it/s]
 87%|████████▋ | 323118/371472 [3:32:06<3:57:50,  3.39it/s]
 87%|████████▋ | 323119/371472 [3:32:06<3:48:04,  3.53it/s]
 87%|████████▋ | 323120/371472 [3:32:07<3:48:41,  3.52it/s]
                                                           
{'loss': 2.7232, 'learning_rate': 2.1721002391777455e-07, 'epoch': 13.92}

 87%|████████▋ | 323120/371472 [3:32:07<3:48:41,  3.52it/s]
 87%|████████▋ | 323121/371472 [3:32:07<3:48:36,  3.52it/s]
 87%|████████▋ | 323122/371472 [3:32:07<3:46:13,  3.56it/s]
 87%|████████▋ | 323123/371472 [3:32:08<3:46:49,  3.55it/s]
 87%|████████▋ | 323124/371472 [3:32:08<3:47:43,  3.54it/s]
 87%|████████▋ | 323125/371472 [3:32:08<3:45:35,  3.57it/s]
 87%|████████▋ | 323126/371472 [3:32:08<3:36:15,  3.73it/s]
 87%|████████▋ | 323127/371472 [3:32:09<3:31:58,  3.80it/s]
 87%|████████▋ | 323128/371472 [3:32:09<3:33:56,  3.77it/s]
 87%|████████▋ | 323129/371472 [3:32:09<3:31:48,  3.80it/s]
 87%|████████▋ | 323130/371472 [3:32:09<3:30:41,  3.82it/s]
 87%|████████▋ | 323131/371472 [3:32:10<3:53:20,  3.45it/s]
 87%|████████▋ | 323132/371472 [3:32:10<3:55:27,  3.42it/s]
 87%|████████▋ | 323133/371472 [3:32:10<3:57:26,  3.39it/s]
 87%|████████▋ | 323134/371472 [3:32:11<4:10:19,  3.22it/s]
 87%|████████▋ | 323135/371472 [3:32:11<4:03:30,  3.31it/s]
 87%|████████▋ | 323136/371472 [3:32:11<3:56:41,  3.40it/s]
 87%|████████▋ | 323137/371472 [3:32:12<3:54:01,  3.44it/s]
 87%|████████▋ | 323138/371472 [3:32:12<4:09:43,  3.23it/s]
 87%|████████▋ | 323139/371472 [3:32:12<4:11:29,  3.20it/s]
 87%|████████▋ | 323140/371472 [3:32:13<4:04:46,  3.29it/s]
                                                           
{'loss': 2.6064, 'learning_rate': 2.1716154194229567e-07, 'epoch': 13.92}

 87%|████████▋ | 323140/371472 [3:32:13<4:04:46,  3.29it/s]
 87%|████████▋ | 323141/371472 [3:32:13<3:53:07,  3.46it/s]
 87%|████████▋ | 323142/371472 [3:32:13<3:53:50,  3.44it/s]
 87%|████████▋ | 323143/371472 [3:32:13<3:46:34,  3.56it/s]
 87%|████████▋ | 323144/371472 [3:32:14<3:54:00,  3.44it/s]
 87%|████████▋ | 323145/371472 [3:32:14<4:13:16,  3.18it/s]
 87%|████████▋ | 323146/371472 [3:32:14<3:58:27,  3.38it/s]
 87%|████████▋ | 323147/371472 [3:32:15<3:59:04,  3.37it/s]
 87%|████████▋ | 323148/371472 [3:32:15<4:09:36,  3.23it/s]
 87%|████████▋ | 323149/371472 [3:32:15<4:11:02,  3.21it/s]
 87%|████████▋ | 323150/371472 [3:32:16<4:49:06,  2.79it/s]
 87%|████████▋ | 323151/371472 [3:32:16<4:32:21,  2.96it/s]
 87%|████████▋ | 323152/371472 [3:32:16<4:19:04,  3.11it/s]
 87%|████████▋ | 323153/371472 [3:32:17<4:03:07,  3.31it/s]
 87%|████████▋ | 323154/371472 [3:32:17<3:50:10,  3.50it/s]
 87%|████████▋ | 323155/371472 [3:32:17<3:40:28,  3.65it/s]
 87%|████████▋ | 323156/371472 [3:32:17<3:44:47,  3.58it/s]
 87%|████████▋ | 323157/371472 [3:32:18<3:47:53,  3.53it/s]
 87%|████████▋ | 323158/371472 [3:32:18<3:38:12,  3.69it/s]
 87%|████████▋ | 323159/371472 [3:32:18<3:33:49,  3.77it/s]
 87%|████████▋ | 323160/371472 [3:32:18<3:27:34,  3.88it/s]
                                                           
{'loss': 2.5532, 'learning_rate': 2.1711305996681674e-07, 'epoch': 13.92}

 87%|████████▋ | 323160/371472 [3:32:18<3:27:34,  3.88it/s]
 87%|████████▋ | 323161/371472 [3:32:19<3:25:13,  3.92it/s]
 87%|████████▋ | 323162/371472 [3:32:19<3:51:38,  3.48it/s]
 87%|████████▋ | 323163/371472 [3:32:19<3:48:04,  3.53it/s]
 87%|████████▋ | 323164/371472 [3:32:20<3:54:50,  3.43it/s]
 87%|████████▋ | 323165/371472 [3:32:20<3:48:53,  3.52it/s]
 87%|████████▋ | 323166/371472 [3:32:20<3:42:53,  3.61it/s]
 87%|████████▋ | 323167/371472 [3:32:20<3:49:20,  3.51it/s]
 87%|████████▋ | 323168/371472 [3:32:21<3:39:43,  3.66it/s]
 87%|████████▋ | 323169/371472 [3:32:21<3:41:54,  3.63it/s]
 87%|████████▋ | 323170/371472 [3:32:21<3:35:12,  3.74it/s]
 87%|████████▋ | 323171/371472 [3:32:21<3:32:47,  3.78it/s]
 87%|████████▋ | 323172/371472 [3:32:22<3:44:06,  3.59it/s]
 87%|████████▋ | 323173/371472 [3:32:22<3:36:58,  3.71it/s]
 87%|████████▋ | 323174/371472 [3:32:22<3:51:41,  3.47it/s]
 87%|████████▋ | 323175/371472 [3:32:23<3:50:30,  3.49it/s]
 87%|████████▋ | 323176/371472 [3:32:23<3:53:58,  3.44it/s]
 87%|████████▋ | 323177/371472 [3:32:23<3:55:12,  3.42it/s]
 87%|████████▋ | 323178/371472 [3:32:23<4:04:37,  3.29it/s]
 87%|████████▋ | 323179/371472 [3:32:24<3:53:17,  3.45it/s]
 87%|████████▋ | 323180/371472 [3:32:24<3:52:42,  3.46it/s]
                                                           
{'loss': 2.5995, 'learning_rate': 2.1706457799133792e-07, 'epoch': 13.92}

 87%|████████▋ | 323180/371472 [3:32:24<3:52:42,  3.46it/s]
 87%|████████▋ | 323181/371472 [3:32:24<3:41:31,  3.63it/s]
 87%|████████▋ | 323182/371472 [3:32:25<3:37:44,  3.70it/s]
 87%|████████▋ | 323183/371472 [3:32:25<3:59:15,  3.36it/s]
 87%|████████▋ | 323184/371472 [3:32:25<3:53:06,  3.45it/s]
 87%|████████▋ | 323185/371472 [3:32:25<3:40:43,  3.65it/s]
 87%|████████▋ | 323186/371472 [3:32:26<3:50:26,  3.49it/s]
 87%|████████▋ | 323187/371472 [3:32:26<3:46:23,  3.55it/s]
 87%|████████▋ | 323188/371472 [3:32:26<3:46:18,  3.56it/s]
 87%|████████▋ | 323189/371472 [3:32:27<3:46:36,  3.55it/s]
 87%|████████▋ | 323190/371472 [3:32:27<3:41:12,  3.64it/s]
 87%|████████▋ | 323191/371472 [3:32:27<3:43:46,  3.60it/s]
 87%|████████▋ | 323192/371472 [3:32:27<3:36:27,  3.72it/s]
 87%|████████▋ | 323193/371472 [3:32:28<3:49:10,  3.51it/s]
 87%|████████▋ | 323194/371472 [3:32:28<3:40:59,  3.64it/s]
 87%|████████▋ | 323195/371472 [3:32:28<3:49:10,  3.51it/s]
 87%|████████▋ | 323196/371472 [3:32:29<3:53:06,  3.45it/s]
 87%|████████▋ | 323197/371472 [3:32:29<4:02:11,  3.32it/s]
 87%|████████▋ | 323198/371472 [3:32:29<3:53:17,  3.45it/s]
 87%|████████▋ | 323199/371472 [3:32:29<3:55:28,  3.42it/s]
 87%|████████▋ | 323200/371472 [3:32:30<4:09:27,  3.23it/s]
                                                           
{'loss': 2.7889, 'learning_rate': 2.1701609601585896e-07, 'epoch': 13.92}

 87%|████████▋ | 323200/371472 [3:32:30<4:09:27,  3.23it/s]
 87%|████████▋ | 323201/371472 [3:32:30<3:56:46,  3.40it/s]
 87%|████████▋ | 323202/371472 [3:32:30<3:49:04,  3.51it/s]
 87%|████████▋ | 323203/371472 [3:32:31<3:56:36,  3.40it/s]
 87%|████████▋ | 323204/371472 [3:32:31<3:49:56,  3.50it/s]
 87%|████████▋ | 323205/371472 [3:32:31<3:46:51,  3.55it/s]
 87%|████████▋ | 323206/371472 [3:32:31<3:40:06,  3.65it/s]
 87%|████████▋ | 323207/371472 [3:32:32<3:39:37,  3.66it/s]
 87%|████████▋ | 323208/371472 [3:32:32<3:32:01,  3.79it/s]
 87%|████████▋ | 323209/371472 [3:32:32<3:41:24,  3.63it/s]
 87%|████████▋ | 323210/371472 [3:32:33<4:08:39,  3.23it/s]
 87%|████████▋ | 323211/371472 [3:32:33<4:11:11,  3.20it/s]
 87%|████████▋ | 323212/371472 [3:32:33<4:04:27,  3.29it/s]
 87%|████████▋ | 323213/371472 [3:32:33<4:01:28,  3.33it/s]
 87%|████████▋ | 323214/371472 [3:32:34<3:51:29,  3.47it/s]
 87%|████████▋ | 323215/371472 [3:32:34<4:34:43,  2.93it/s]
 87%|████████▋ | 323216/371472 [3:32:34<4:15:10,  3.15it/s]
 87%|████████▋ | 323217/371472 [3:32:35<3:59:00,  3.36it/s]
 87%|████████▋ | 323218/371472 [3:32:35<3:52:12,  3.46it/s]
 87%|████████▋ | 323219/371472 [3:32:35<3:55:02,  3.42it/s]
 87%|████████▋ | 323220/371472 [3:32:36<3:53:00,  3.45it/s]
                                                           
{'loss': 2.5003, 'learning_rate': 2.1696761404038012e-07, 'epoch': 13.92}

 87%|████████▋ | 323220/371472 [3:32:36<3:53:00,  3.45it/s]
 87%|████████▋ | 323221/371472 [3:32:36<3:46:43,  3.55it/s]
 87%|████████▋ | 323222/371472 [3:32:36<3:48:03,  3.53it/s]
 87%|████████▋ | 323223/371472 [3:32:36<4:07:25,  3.25it/s]
 87%|████████▋ | 323224/371472 [3:32:37<4:03:38,  3.30it/s]
 87%|████████▋ | 323225/371472 [3:32:37<4:04:49,  3.28it/s]
 87%|████████▋ | 323226/371472 [3:32:37<3:53:10,  3.45it/s]
 87%|████████▋ | 323227/371472 [3:32:38<4:01:12,  3.33it/s]
 87%|████████▋ | 323228/371472 [3:32:38<3:55:28,  3.41it/s]
 87%|████████▋ | 323229/371472 [3:32:38<3:50:10,  3.49it/s]
 87%|████████▋ | 323230/371472 [3:32:39<3:56:17,  3.40it/s]
 87%|████████▋ | 323231/371472 [3:32:39<4:00:30,  3.34it/s]
 87%|████████▋ | 323232/371472 [3:32:39<3:50:07,  3.49it/s]
 87%|████████▋ | 323233/371472 [3:32:39<3:44:48,  3.58it/s]
 87%|████████▋ | 323234/371472 [3:32:40<3:43:38,  3.59it/s]
 87%|████████▋ | 323235/371472 [3:32:40<3:43:32,  3.60it/s]
 87%|████████▋ | 323236/371472 [3:32:40<3:38:04,  3.69it/s]
 87%|████████▋ | 323237/371472 [3:32:40<3:35:27,  3.73it/s]
 87%|████████▋ | 323238/371472 [3:32:41<3:34:11,  3.75it/s]
 87%|████████▋ | 323239/371472 [3:32:41<3:36:23,  3.71it/s]
 87%|████████▋ | 323240/371472 [3:32:41<3:27:35,  3.87it/s]
                                                           
{'loss': 2.6985, 'learning_rate': 2.169191320649012e-07, 'epoch': 13.92}

 87%|████████▋ | 323240/371472 [3:32:41<3:27:35,  3.87it/s]
 87%|████████▋ | 323241/371472 [3:32:42<3:39:48,  3.66it/s]
 87%|████████▋ | 323242/371472 [3:32:42<3:47:43,  3.53it/s]
 87%|████████▋ | 323243/371472 [3:32:42<3:54:30,  3.43it/s]
 87%|████████▋ | 323244/371472 [3:32:42<4:02:15,  3.32it/s]
 87%|████████▋ | 323245/371472 [3:32:43<3:53:20,  3.44it/s]
 87%|████████▋ | 323246/371472 [3:32:43<3:50:11,  3.49it/s]
 87%|████████▋ | 323247/371472 [3:32:43<3:43:27,  3.60it/s]
 87%|████████▋ | 323248/371472 [3:32:43<3:31:55,  3.79it/s]
 87%|████████▋ | 323249/371472 [3:32:44<3:36:05,  3.72it/s]
 87%|████████▋ | 323250/371472 [3:32:44<3:26:37,  3.89it/s]
 87%|████████▋ | 323251/371472 [3:32:44<3:25:38,  3.91it/s]
 87%|████████▋ | 323252/371472 [3:32:45<3:51:34,  3.47it/s]
 87%|████████▋ | 323253/371472 [3:32:45<3:50:47,  3.48it/s]
 87%|████████▋ | 323254/371472 [3:32:45<3:42:32,  3.61it/s]
 87%|████████▋ | 323255/371472 [3:32:45<3:43:01,  3.60it/s]
 87%|████████▋ | 323256/371472 [3:32:46<3:57:24,  3.38it/s]
 87%|████████▋ | 323257/371472 [3:32:46<4:04:14,  3.29it/s]
 87%|████████▋ | 323258/371472 [3:32:46<4:18:37,  3.11it/s]
 87%|████████▋ | 323259/371472 [3:32:47<4:04:27,  3.29it/s]
 87%|████████▋ | 323260/371472 [3:32:47<4:13:09,  3.17it/s]
                                                           
{'loss': 2.6339, 'learning_rate': 2.1687065008942234e-07, 'epoch': 13.92}

 87%|████████▋ | 323260/371472 [3:32:47<4:13:09,  3.17it/s]
 87%|████████▋ | 323261/371472 [3:32:47<4:25:55,  3.02it/s]
 87%|████████▋ | 323262/371472 [3:32:48<4:11:32,  3.19it/s]
 87%|████████▋ | 323263/371472 [3:32:48<4:04:15,  3.29it/s]
 87%|████████▋ | 323264/371472 [3:32:48<4:08:57,  3.23it/s]
 87%|████████▋ | 323265/371472 [3:32:49<3:57:58,  3.38it/s]
 87%|████████▋ | 323266/371472 [3:32:49<5:22:56,  2.49it/s]
 87%|████████▋ | 323267/371472 [3:32:49<4:52:53,  2.74it/s]
 87%|████████▋ | 323268/371472 [3:32:50<4:32:40,  2.95it/s]
 87%|████████▋ | 323269/371472 [3:32:50<4:17:33,  3.12it/s]
 87%|████████▋ | 323270/371472 [3:32:50<4:28:41,  2.99it/s]
 87%|████████▋ | 323271/371472 [3:32:51<4:31:29,  2.96it/s]
 87%|████████▋ | 323272/371472 [3:32:51<4:17:29,  3.12it/s]
 87%|████████▋ | 323273/371472 [3:32:51<4:06:54,  3.25it/s]
 87%|████████▋ | 323274/371472 [3:32:52<3:50:11,  3.49it/s]
 87%|████████▋ | 323275/371472 [3:32:52<3:45:25,  3.56it/s]
 87%|████████▋ | 323276/371472 [3:32:52<3:46:43,  3.54it/s]
 87%|████████▋ | 323277/371472 [3:32:52<3:45:54,  3.56it/s]
 87%|████████▋ | 323278/371472 [3:32:53<3:40:55,  3.64it/s]
 87%|████████▋ | 323279/371472 [3:32:53<3:36:13,  3.71it/s]
 87%|████████▋ | 323280/371472 [3:32:53<3:43:22,  3.60it/s]
                                                           
{'loss': 2.5724, 'learning_rate': 2.1682216811394338e-07, 'epoch': 13.92}

 87%|████████▋ | 323280/371472 [3:32:53<3:43:22,  3.60it/s]
 87%|████████▋ | 323281/371472 [3:32:54<3:49:09,  3.50it/s]
 87%|████████▋ | 323282/371472 [3:32:54<3:42:18,  3.61it/s]
 87%|████████▋ | 323283/371472 [3:32:54<3:39:48,  3.65it/s]
 87%|████████▋ | 323284/371472 [3:32:54<3:47:29,  3.53it/s]
 87%|████████▋ | 323285/371472 [3:32:55<3:40:07,  3.65it/s]
 87%|████████▋ | 323286/371472 [3:32:55<3:34:11,  3.75it/s]
 87%|████████▋ | 323287/371472 [3:32:55<3:42:53,  3.60it/s]
 87%|████████▋ | 323288/371472 [3:32:55<3:35:06,  3.73it/s]
 87%|████████▋ | 323289/371472 [3:32:56<3:38:00,  3.68it/s]
 87%|████████▋ | 323290/371472 [3:32:56<3:35:28,  3.73it/s]
 87%|████████▋ | 323291/371472 [3:32:56<3:34:11,  3.75it/s]
 87%|████████▋ | 323292/371472 [3:32:57<3:56:21,  3.40it/s]
 87%|████████▋ | 323293/371472 [3:32:57<3:51:03,  3.48it/s]
 87%|████████▋ | 323294/371472 [3:32:57<3:51:02,  3.48it/s]
 87%|████████▋ | 323295/371472 [3:32:57<3:50:46,  3.48it/s]
 87%|████████▋ | 323296/371472 [3:32:58<3:38:36,  3.67it/s]
 87%|████████▋ | 323297/371472 [3:32:58<3:43:05,  3.60it/s]
 87%|████████▋ | 323298/371472 [3:32:58<3:38:12,  3.68it/s]
 87%|████████▋ | 323299/371472 [3:32:58<3:39:39,  3.66it/s]
 87%|████████▋ | 323300/371472 [3:32:59<3:38:03,  3.68it/s]
                                                           
{'loss': 2.7949, 'learning_rate': 2.1677368613846456e-07, 'epoch': 13.93}

 87%|████████▋ | 323300/371472 [3:32:59<3:38:03,  3.68it/s]
 87%|████████▋ | 323301/371472 [3:32:59<3:43:08,  3.60it/s]
 87%|████████▋ | 323302/371472 [3:32:59<3:54:02,  3.43it/s]
 87%|████████▋ | 323303/371472 [3:33:00<3:41:27,  3.63it/s]
 87%|████████▋ | 323304/371472 [3:33:00<3:40:30,  3.64it/s]
 87%|████████▋ | 323305/371472 [3:33:00<3:51:18,  3.47it/s]
 87%|████████▋ | 323306/371472 [3:33:00<3:48:14,  3.52it/s]
 87%|████████▋ | 323307/371472 [3:33:01<3:41:49,  3.62it/s]
 87%|████████▋ | 323308/371472 [3:33:01<3:47:39,  3.53it/s]
 87%|████████▋ | 323309/371472 [3:33:01<3:46:33,  3.54it/s]
 87%|████████▋ | 323310/371472 [3:33:02<3:39:02,  3.66it/s]
 87%|████████▋ | 323311/371472 [3:33:02<3:47:46,  3.52it/s]
 87%|████████▋ | 323312/371472 [3:33:02<3:52:55,  3.45it/s]
 87%|████████▋ | 323313/371472 [3:33:02<3:56:47,  3.39it/s]
 87%|████████▋ | 323314/371472 [3:33:03<4:00:10,  3.34it/s]
 87%|████████▋ | 323315/371472 [3:33:03<4:04:31,  3.28it/s]
 87%|████████▋ | 323316/371472 [3:33:03<3:55:56,  3.40it/s]
 87%|████████▋ | 323317/371472 [3:33:04<4:01:16,  3.33it/s]
 87%|████████▋ | 323318/371472 [3:33:04<4:11:25,  3.19it/s]
 87%|████████▋ | 323319/371472 [3:33:04<4:13:42,  3.16it/s]
 87%|████████▋ | 323320/371472 [3:33:05<4:19:01,  3.10it/s]
                                                           
{'loss': 2.4169, 'learning_rate': 2.1672520416298558e-07, 'epoch': 13.93}

 87%|████████▋ | 323320/371472 [3:33:05<4:19:01,  3.10it/s]
 87%|████████▋ | 323321/371472 [3:33:05<4:07:23,  3.24it/s]
 87%|████████▋ | 323322/371472 [3:33:05<4:06:13,  3.26it/s]
 87%|████████▋ | 323323/371472 [3:33:06<3:58:49,  3.36it/s]
 87%|████████▋ | 323324/371472 [3:33:06<3:57:39,  3.38it/s]
 87%|████████▋ | 323325/371472 [3:33:06<4:00:31,  3.34it/s]
 87%|████████▋ | 323326/371472 [3:33:06<3:58:49,  3.36it/s]
 87%|████████▋ | 323327/371472 [3:33:07<3:56:38,  3.39it/s]
 87%|████████▋ | 323328/371472 [3:33:07<3:47:51,  3.52it/s]
 87%|████████▋ | 323329/371472 [3:33:07<3:39:30,  3.66it/s]
 87%|████████▋ | 323330/371472 [3:33:07<3:40:17,  3.64it/s]
 87%|████████▋ | 323331/371472 [3:33:08<3:52:20,  3.45it/s]
 87%|████████▋ | 323332/371472 [3:33:08<3:44:29,  3.57it/s]
 87%|████████▋ | 323333/371472 [3:33:08<3:55:16,  3.41it/s]
 87%|████████▋ | 323334/371472 [3:33:09<3:52:14,  3.45it/s]
 87%|████████▋ | 323335/371472 [3:33:09<3:46:25,  3.54it/s]
 87%|████████▋ | 323336/371472 [3:33:09<3:42:08,  3.61it/s]
 87%|████████▋ | 323337/371472 [3:33:10<3:46:47,  3.54it/s]
 87%|████████▋ | 323338/371472 [3:33:10<3:43:01,  3.60it/s]
 87%|████████▋ | 323339/371472 [3:33:10<3:43:09,  3.59it/s]
 87%|████████▋ | 323340/371472 [3:33:10<3:43:49,  3.58it/s]
                                                           
{'loss': 2.6352, 'learning_rate': 2.1667672218750676e-07, 'epoch': 13.93}

 87%|████████▋ | 323340/371472 [3:33:10<3:43:49,  3.58it/s]
 87%|████████▋ | 323341/371472 [3:33:11<3:40:19,  3.64it/s]
 87%|████████▋ | 323342/371472 [3:33:11<3:31:11,  3.80it/s]
 87%|████████▋ | 323343/371472 [3:33:11<3:48:22,  3.51it/s]
 87%|████████▋ | 323344/371472 [3:33:11<3:44:57,  3.57it/s]
 87%|████████▋ | 323345/371472 [3:33:12<3:44:26,  3.57it/s]
 87%|████████▋ | 323346/371472 [3:33:12<3:37:47,  3.68it/s]
 87%|████████▋ | 323347/371472 [3:33:12<3:50:02,  3.49it/s]
 87%|████████▋ | 323348/371472 [3:33:13<3:52:38,  3.45it/s]
 87%|████████▋ | 323349/371472 [3:33:13<3:59:48,  3.34it/s]
 87%|████████▋ | 323350/371472 [3:33:13<4:07:08,  3.25it/s]
 87%|████████▋ | 323351/371472 [3:33:13<3:56:40,  3.39it/s]
 87%|████████▋ | 323352/371472 [3:33:14<4:05:12,  3.27it/s]
 87%|████████▋ | 323353/371472 [3:33:14<3:59:58,  3.34it/s]
 87%|████████▋ | 323354/371472 [3:33:14<3:48:40,  3.51it/s]
 87%|████████▋ | 323355/371472 [3:33:15<3:48:12,  3.51it/s]
 87%|████████▋ | 323356/371472 [3:33:15<3:46:22,  3.54it/s]
 87%|████████▋ | 323357/371472 [3:33:15<3:44:33,  3.57it/s]
 87%|████████▋ | 323358/371472 [3:33:15<3:47:11,  3.53it/s]
 87%|████████▋ | 323359/371472 [3:33:16<3:49:37,  3.49it/s]
 87%|████████▋ | 323360/371472 [3:33:16<3:57:18,  3.38it/s]
                                                           
{'loss': 2.6807, 'learning_rate': 2.1662824021202783e-07, 'epoch': 13.93}

 87%|████████▋ | 323360/371472 [3:33:16<3:57:18,  3.38it/s]
 87%|████████▋ | 323361/371472 [3:33:16<3:47:42,  3.52it/s]
 87%|████████▋ | 323362/371472 [3:33:17<3:43:42,  3.58it/s]
 87%|████████▋ | 323363/371472 [3:33:17<3:50:02,  3.49it/s]
 87%|████████▋ | 323364/371472 [3:33:17<3:46:58,  3.53it/s]
 87%|████████▋ | 323365/371472 [3:33:17<3:45:47,  3.55it/s]
 87%|████████▋ | 323366/371472 [3:33:18<3:40:03,  3.64it/s]
 87%|████████▋ | 323367/371472 [3:33:18<3:39:45,  3.65it/s]
 87%|████████▋ | 323368/371472 [3:33:18<3:36:32,  3.70it/s]
 87%|████████▋ | 323369/371472 [3:33:19<3:39:44,  3.65it/s]
 87%|████████▋ | 323370/371472 [3:33:19<3:42:04,  3.61it/s]
 87%|████████▋ | 323371/371472 [3:33:19<3:41:38,  3.62it/s]
 87%|████████▋ | 323372/371472 [3:33:19<3:39:34,  3.65it/s]
 87%|████████▋ | 323373/371472 [3:33:20<3:56:13,  3.39it/s]
 87%|████████▋ | 323374/371472 [3:33:20<3:46:29,  3.54it/s]
 87%|████████▋ | 323375/371472 [3:33:20<3:43:55,  3.58it/s]
 87%|████████▋ | 323376/371472 [3:33:21<3:56:03,  3.40it/s]
 87%|████████▋ | 323377/371472 [3:33:21<3:48:34,  3.51it/s]
 87%|████████▋ | 323378/371472 [3:33:21<3:44:56,  3.56it/s]
 87%|████████▋ | 323379/371472 [3:33:21<3:38:56,  3.66it/s]
 87%|████████▋ | 323380/371472 [3:33:22<3:37:29,  3.69it/s]
                                                           
{'loss': 2.6023, 'learning_rate': 2.1657975823654898e-07, 'epoch': 13.93}

 87%|████████▋ | 323380/371472 [3:33:22<3:37:29,  3.69it/s]
 87%|████████▋ | 323381/371472 [3:33:22<3:36:50,  3.70it/s]
 87%|████████▋ | 323382/371472 [3:33:22<3:40:54,  3.63it/s]
 87%|████████▋ | 323383/371472 [3:33:22<3:43:46,  3.58it/s]
 87%|████████▋ | 323384/371472 [3:33:23<3:39:59,  3.64it/s]
 87%|████████▋ | 323385/371472 [3:33:23<3:41:09,  3.62it/s]
 87%|████████▋ | 323386/371472 [3:33:23<3:35:14,  3.72it/s]
 87%|████████▋ | 323387/371472 [3:33:24<3:29:24,  3.83it/s]
 87%|████████▋ | 323388/371472 [3:33:24<3:27:14,  3.87it/s]
 87%|████████▋ | 323389/371472 [3:33:24<3:51:55,  3.46it/s]
 87%|████████▋ | 323390/371472 [3:33:24<3:45:51,  3.55it/s]
 87%|████████▋ | 323391/371472 [3:33:25<3:44:09,  3.57it/s]
 87%|████████▋ | 323392/371472 [3:33:25<3:44:43,  3.57it/s]
 87%|████████▋ | 323393/371472 [3:33:25<3:33:45,  3.75it/s]
 87%|████████▋ | 323394/371472 [3:33:26<3:47:52,  3.52it/s]
 87%|████████▋ | 323395/371472 [3:33:26<3:44:48,  3.56it/s]
 87%|████████▋ | 323396/371472 [3:33:26<3:41:24,  3.62it/s]
 87%|████████▋ | 323397/371472 [3:33:26<3:41:13,  3.62it/s]
 87%|████████▋ | 323398/371472 [3:33:27<3:42:21,  3.60it/s]
 87%|████████▋ | 323399/371472 [3:33:27<3:43:02,  3.59it/s]
 87%|████████▋ | 323400/371472 [3:33:27<3:56:12,  3.39it/s]
                                                           
{'loss': 2.5101, 'learning_rate': 2.1653127626107002e-07, 'epoch': 13.93}

 87%|████████▋ | 323400/371472 [3:33:27<3:56:12,  3.39it/s]
 87%|████████▋ | 323401/371472 [3:33:27<3:46:41,  3.53it/s]
 87%|████████▋ | 323402/371472 [3:33:28<3:40:51,  3.63it/s]
 87%|████████▋ | 323403/371472 [3:33:28<3:51:04,  3.47it/s]
 87%|████████▋ | 323404/371472 [3:33:28<3:52:08,  3.45it/s]
 87%|████████▋ | 323405/371472 [3:33:29<3:46:12,  3.54it/s]
 87%|████████▋ | 323406/371472 [3:33:29<3:58:11,  3.36it/s]
 87%|████████▋ | 323407/371472 [3:33:29<3:59:35,  3.34it/s]
 87%|████████▋ | 323408/371472 [3:33:29<3:45:58,  3.55it/s]
 87%|████████▋ | 323409/371472 [3:33:30<3:55:50,  3.40it/s]
 87%|████████▋ | 323410/371472 [3:33:30<3:44:42,  3.56it/s]
 87%|████████▋ | 323411/371472 [3:33:30<3:36:51,  3.69it/s]
 87%|████████▋ | 323412/371472 [3:33:31<3:34:10,  3.74it/s]
 87%|████████▋ | 323413/371472 [3:33:31<3:29:02,  3.83it/s]
 87%|████████▋ | 323414/371472 [3:33:31<3:41:05,  3.62it/s]
 87%|████████▋ | 323415/371472 [3:33:31<3:44:43,  3.56it/s]
 87%|████████▋ | 323416/371472 [3:33:32<3:57:33,  3.37it/s]
 87%|████████▋ | 323417/371472 [3:33:32<3:50:16,  3.48it/s]
 87%|████████▋ | 323418/371472 [3:33:32<3:47:23,  3.52it/s]
 87%|████████▋ | 323419/371472 [3:33:33<3:38:57,  3.66it/s]
 87%|████████▋ | 323420/371472 [3:33:33<3:47:34,  3.52it/s]
                                                           
{'loss': 2.5595, 'learning_rate': 2.164827942855911e-07, 'epoch': 13.93}

 87%|████████▋ | 323420/371472 [3:33:33<3:47:34,  3.52it/s]
 87%|████████▋ | 323421/371472 [3:33:33<3:45:40,  3.55it/s]
 87%|████████▋ | 323422/371472 [3:33:33<3:44:20,  3.57it/s]
 87%|████████▋ | 323423/371472 [3:33:34<3:47:35,  3.52it/s]
 87%|████████▋ | 323424/371472 [3:33:34<3:59:57,  3.34it/s]
 87%|████████▋ | 323425/371472 [3:33:34<4:15:53,  3.13it/s]
 87%|████████▋ | 323426/371472 [3:33:35<3:59:52,  3.34it/s]
 87%|████████▋ | 323427/371472 [3:33:35<3:44:33,  3.57it/s]
 87%|████████▋ | 323428/371472 [3:33:35<3:58:36,  3.36it/s]
 87%|████████▋ | 323429/371472 [3:33:36<3:53:41,  3.43it/s]
 87%|████████▋ | 323430/371472 [3:33:36<3:48:53,  3.50it/s]
 87%|████████▋ | 323431/371472 [3:33:36<3:50:49,  3.47it/s]
 87%|████████▋ | 323432/371472 [3:33:36<3:50:40,  3.47it/s]
 87%|████████▋ | 323433/371472 [3:33:37<3:40:35,  3.63it/s]
 87%|████████▋ | 323434/371472 [3:33:37<3:47:01,  3.53it/s]
 87%|████████▋ | 323435/371472 [3:33:37<3:49:56,  3.48it/s]
 87%|████████▋ | 323436/371472 [3:33:37<3:46:59,  3.53it/s]
 87%|████████▋ | 323437/371472 [3:33:38<3:44:02,  3.57it/s]
 87%|████████▋ | 323438/371472 [3:33:38<3:56:26,  3.39it/s]
 87%|████████▋ | 323439/371472 [3:33:38<3:52:54,  3.44it/s]
 87%|████████▋ | 323440/371472 [3:33:39<4:04:59,  3.27it/s]
                                                           
{'loss': 2.6221, 'learning_rate': 2.1643431231011227e-07, 'epoch': 13.93}

 87%|████████▋ | 323440/371472 [3:33:39<4:04:59,  3.27it/s]
 87%|████████▋ | 323441/371472 [3:33:39<4:08:36,  3.22it/s]
 87%|████████▋ | 323442/371472 [3:33:39<4:00:51,  3.32it/s]
 87%|████████▋ | 323443/371472 [3:33:40<3:55:42,  3.40it/s]
 87%|████████▋ | 323444/371472 [3:33:40<3:52:30,  3.44it/s]
 87%|████████▋ | 323445/371472 [3:33:40<3:45:07,  3.56it/s]
 87%|████████▋ | 323446/371472 [3:33:40<3:38:19,  3.67it/s]
 87%|████████▋ | 323447/371472 [3:33:41<3:47:25,  3.52it/s]
 87%|████████▋ | 323448/371472 [3:33:41<3:52:34,  3.44it/s]
 87%|████████▋ | 323449/371472 [3:33:41<3:40:36,  3.63it/s]
 87%|████████▋ | 323450/371472 [3:33:42<3:38:37,  3.66it/s]
 87%|████████▋ | 323451/371472 [3:33:42<3:41:48,  3.61it/s]
 87%|████████▋ | 323452/371472 [3:33:42<3:32:27,  3.77it/s]
 87%|████████▋ | 323453/371472 [3:33:42<3:53:22,  3.43it/s]
 87%|████████▋ | 323454/371472 [3:33:43<4:17:39,  3.11it/s]
 87%|████████▋ | 323455/371472 [3:33:43<4:22:23,  3.05it/s]
 87%|████████▋ | 323456/371472 [3:33:43<4:21:32,  3.06it/s]
 87%|████████▋ | 323457/371472 [3:33:44<4:14:18,  3.15it/s]
 87%|████████▋ | 323458/371472 [3:33:44<4:12:47,  3.17it/s]
 87%|████████▋ | 323459/371472 [3:33:44<3:57:38,  3.37it/s]
 87%|████████▋ | 323460/371472 [3:33:45<4:00:42,  3.32it/s]
                                                           
{'loss': 2.5337, 'learning_rate': 2.1638583033463332e-07, 'epoch': 13.93}

 87%|████████▋ | 323460/371472 [3:33:45<4:00:42,  3.32it/s]
 87%|████████▋ | 323461/371472 [3:33:45<4:05:40,  3.26it/s]
 87%|████████▋ | 323462/371472 [3:33:45<3:54:57,  3.41it/s]
 87%|████████▋ | 323463/371472 [3:33:45<3:55:15,  3.40it/s]
 87%|████████▋ | 323464/371472 [3:33:46<3:48:29,  3.50it/s]
 87%|████████▋ | 323465/371472 [3:33:46<3:48:28,  3.50it/s]
 87%|████████▋ | 323466/371472 [3:33:46<3:54:37,  3.41it/s]
 87%|████████▋ | 323467/371472 [3:33:47<3:54:23,  3.41it/s]
 87%|████████▋ | 323468/371472 [3:33:47<3:50:29,  3.47it/s]
 87%|████████▋ | 323469/371472 [3:33:47<3:43:13,  3.58it/s]
 87%|████████▋ | 323470/371472 [3:33:47<3:36:50,  3.69it/s]
 87%|████████▋ | 323471/371472 [3:33:48<3:47:31,  3.52it/s]
 87%|████████▋ | 323472/371472 [3:33:48<3:48:37,  3.50it/s]
 87%|████████▋ | 323473/371472 [3:33:48<3:50:04,  3.48it/s]
 87%|████████▋ | 323474/371472 [3:33:49<3:50:40,  3.47it/s]
 87%|████████▋ | 323475/371472 [3:33:49<3:45:04,  3.55it/s]
 87%|████████▋ | 323476/371472 [3:33:49<3:50:19,  3.47it/s]
 87%|████████▋ | 323477/371472 [3:33:50<4:17:38,  3.10it/s]
 87%|████████▋ | 323478/371472 [3:33:50<4:11:48,  3.18it/s]
 87%|████████▋ | 323479/371472 [3:33:50<4:03:10,  3.29it/s]
 87%|████████▋ | 323480/371472 [3:33:50<4:04:44,  3.27it/s]
                                                           
{'loss': 2.5301, 'learning_rate': 2.1633734835915447e-07, 'epoch': 13.93}

 87%|████████▋ | 323480/371472 [3:33:50<4:04:44,  3.27it/s]
 87%|████████▋ | 323481/371472 [3:33:51<3:55:47,  3.39it/s]
 87%|████████▋ | 323482/371472 [3:33:51<3:50:20,  3.47it/s]
 87%|████████▋ | 323483/371472 [3:33:51<3:51:40,  3.45it/s]
 87%|████████▋ | 323484/371472 [3:33:52<3:53:56,  3.42it/s]
 87%|████████▋ | 323485/371472 [3:33:52<3:46:36,  3.53it/s]
 87%|████████▋ | 323486/371472 [3:33:52<3:50:05,  3.48it/s]
 87%|████████▋ | 323487/371472 [3:33:52<3:39:33,  3.64it/s]
 87%|████████▋ | 323488/371472 [3:33:53<3:43:20,  3.58it/s]
 87%|████████▋ | 323489/371472 [3:33:53<3:45:54,  3.54it/s]
 87%|████████▋ | 323490/371472 [3:33:53<3:38:53,  3.65it/s]
 87%|████████▋ | 323491/371472 [3:33:54<3:44:32,  3.56it/s]
 87%|████████▋ | 323492/371472 [3:33:54<3:37:21,  3.68it/s]
 87%|████████▋ | 323493/371472 [3:33:54<3:33:33,  3.74it/s]
 87%|████████▋ | 323494/371472 [3:33:54<3:49:01,  3.49it/s]
 87%|████████▋ | 323495/371472 [3:33:55<4:16:09,  3.12it/s]
 87%|████████▋ | 323496/371472 [3:33:55<4:00:49,  3.32it/s]
 87%|████████▋ | 323497/371472 [3:33:55<3:51:29,  3.45it/s]
 87%|████████▋ | 323498/371472 [3:33:56<3:40:05,  3.63it/s]
 87%|████████▋ | 323499/371472 [3:33:56<3:54:28,  3.41it/s]
 87%|████████▋ | 323500/371472 [3:33:56<3:59:19,  3.34it/s]
                                                           
{'loss': 2.6193, 'learning_rate': 2.1628886638367554e-07, 'epoch': 13.93}

 87%|████████▋ | 323500/371472 [3:33:56<3:59:19,  3.34it/s]
 87%|████████▋ | 323501/371472 [3:33:57<4:05:50,  3.25it/s]
 87%|████████▋ | 323502/371472 [3:33:57<3:59:03,  3.34it/s]
 87%|████████▋ | 323503/371472 [3:33:57<3:45:29,  3.55it/s]
 87%|████████▋ | 323504/371472 [3:33:57<3:42:22,  3.60it/s]
 87%|████████▋ | 323505/371472 [3:33:58<3:33:27,  3.75it/s]
 87%|████████▋ | 323506/371472 [3:33:58<3:29:01,  3.82it/s]
 87%|████████▋ | 323507/371472 [3:33:58<3:45:04,  3.55it/s]
 87%|████████▋ | 323508/371472 [3:33:58<3:44:22,  3.56it/s]
 87%|████████▋ | 323509/371472 [3:33:59<3:54:38,  3.41it/s]
 87%|████████▋ | 323510/371472 [3:33:59<3:44:17,  3.56it/s]
 87%|████████▋ | 323511/371472 [3:33:59<3:40:24,  3.63it/s]
 87%|████████▋ | 323512/371472 [3:34:00<3:48:03,  3.50it/s]
 87%|████████▋ | 323513/371472 [3:34:00<3:48:06,  3.50it/s]
 87%|████████▋ | 323514/371472 [3:34:00<3:45:01,  3.55it/s]
 87%|████████▋ | 323515/371472 [3:34:00<3:39:01,  3.65it/s]
 87%|████████▋ | 323516/371472 [3:34:01<3:42:11,  3.60it/s]
 87%|████████▋ | 323517/371472 [3:34:01<3:43:55,  3.57it/s]
 87%|████████▋ | 323518/371472 [3:34:01<3:41:04,  3.62it/s]
 87%|████████▋ | 323519/371472 [3:34:01<3:36:07,  3.70it/s]
 87%|████████▋ | 323520/371472 [3:34:02<3:40:09,  3.63it/s]
                                                           
{'loss': 2.5914, 'learning_rate': 2.162403844081967e-07, 'epoch': 13.93}

 87%|████████▋ | 323520/371472 [3:34:02<3:40:09,  3.63it/s]
 87%|████████▋ | 323521/371472 [3:34:02<3:40:35,  3.62it/s]
 87%|████████▋ | 323522/371472 [3:34:02<3:33:35,  3.74it/s]
 87%|████████▋ | 323523/371472 [3:34:03<3:43:35,  3.57it/s]
 87%|████████▋ | 323524/371472 [3:34:03<3:35:17,  3.71it/s]
 87%|████████▋ | 323525/371472 [3:34:03<3:37:22,  3.68it/s]
 87%|████████▋ | 323526/371472 [3:34:03<3:30:16,  3.80it/s]
 87%|████████▋ | 323527/371472 [3:34:04<3:35:43,  3.70it/s]
 87%|████████▋ | 323528/371472 [3:34:04<3:32:33,  3.76it/s]
 87%|████████▋ | 323529/371472 [3:34:04<3:31:12,  3.78it/s]
 87%|████████▋ | 323530/371472 [3:34:04<3:27:57,  3.84it/s]
 87%|████████▋ | 323531/371472 [3:34:05<3:28:06,  3.84it/s]
 87%|████████▋ | 323532/371472 [3:34:05<3:36:33,  3.69it/s]
 87%|████████▋ | 323533/371472 [3:34:05<3:48:53,  3.49it/s]
 87%|████████▋ | 323534/371472 [3:34:06<3:59:40,  3.33it/s]
 87%|████████▋ | 323535/371472 [3:34:06<3:57:41,  3.36it/s]
 87%|████████▋ | 323536/371472 [3:34:06<4:00:46,  3.32it/s]
 87%|████████▋ | 323537/371472 [3:34:07<4:06:26,  3.24it/s]
 87%|████████▋ | 323538/371472 [3:34:07<3:59:22,  3.34it/s]
 87%|████████▋ | 323539/371472 [3:34:07<3:54:21,  3.41it/s]
 87%|████████▋ | 323540/371472 [3:34:07<3:48:38,  3.49it/s]
                                                           
{'loss': 2.7129, 'learning_rate': 2.1619190243271774e-07, 'epoch': 13.94}

 87%|████████▋ | 323540/371472 [3:34:07<3:48:38,  3.49it/s]
 87%|████████▋ | 323541/371472 [3:34:08<3:37:08,  3.68it/s]
 87%|████████▋ | 323542/371472 [3:34:08<3:42:21,  3.59it/s]
 87%|████████▋ | 323543/371472 [3:34:08<3:40:53,  3.62it/s]
 87%|████████▋ | 323544/371472 [3:34:08<3:46:58,  3.52it/s]
 87%|████████▋ | 323545/371472 [3:34:09<3:45:56,  3.54it/s]
 87%|████████▋ | 323546/371472 [3:34:09<3:44:04,  3.56it/s]
 87%|████████▋ | 323547/371472 [3:34:09<3:46:51,  3.52it/s]
 87%|████████▋ | 323548/371472 [3:34:10<3:41:53,  3.60it/s]
 87%|████████▋ | 323549/371472 [3:34:10<3:39:39,  3.64it/s]
 87%|████████▋ | 323550/371472 [3:34:10<3:35:42,  3.70it/s]
 87%|████████▋ | 323551/371472 [3:34:10<3:43:33,  3.57it/s]
 87%|████████▋ | 323552/371472 [3:34:11<3:38:44,  3.65it/s]
 87%|████████▋ | 323553/371472 [3:34:11<3:36:11,  3.69it/s]
 87%|████████▋ | 323554/371472 [3:34:11<3:36:59,  3.68it/s]
 87%|████████▋ | 323555/371472 [3:34:12<3:43:07,  3.58it/s]
 87%|████████▋ | 323556/371472 [3:34:12<3:39:23,  3.64it/s]
 87%|████████▋ | 323557/371472 [3:34:12<3:50:01,  3.47it/s]
 87%|████████▋ | 323558/371472 [3:34:12<3:39:33,  3.64it/s]
 87%|████████▋ | 323559/371472 [3:34:13<3:37:46,  3.67it/s]
 87%|████████▋ | 323560/371472 [3:34:13<3:45:43,  3.54it/s]
                                                           
{'loss': 2.6284, 'learning_rate': 2.1614342045723891e-07, 'epoch': 13.94}

 87%|████████▋ | 323560/371472 [3:34:13<3:45:43,  3.54it/s]
 87%|████████▋ | 323561/371472 [3:34:13<4:02:33,  3.29it/s]
 87%|████████▋ | 323562/371472 [3:34:14<3:57:52,  3.36it/s]
 87%|████████▋ | 323563/371472 [3:34:14<4:02:51,  3.29it/s]
 87%|████████▋ | 323564/371472 [3:34:14<3:56:17,  3.38it/s]
 87%|████████▋ | 323565/371472 [3:34:14<3:52:53,  3.43it/s]
 87%|████████▋ | 323566/371472 [3:34:15<3:56:09,  3.38it/s]
 87%|████████▋ | 323567/371472 [3:34:15<4:04:01,  3.27it/s]
 87%|████████▋ | 323568/371472 [3:34:15<3:51:37,  3.45it/s]
 87%|████████▋ | 323569/371472 [3:34:16<3:45:28,  3.54it/s]
 87%|████████▋ | 323570/371472 [3:34:16<3:38:57,  3.65it/s]
 87%|████████▋ | 323571/371472 [3:34:16<3:39:02,  3.64it/s]
 87%|████████▋ | 323572/371472 [3:34:16<3:31:47,  3.77it/s]
 87%|████████▋ | 323573/371472 [3:34:17<3:32:31,  3.76it/s]
 87%|████████▋ | 323574/371472 [3:34:17<3:38:40,  3.65it/s]
 87%|████████▋ | 323575/371472 [3:34:17<3:42:03,  3.59it/s]
 87%|████████▋ | 323576/371472 [3:34:17<3:42:16,  3.59it/s]
 87%|████████▋ | 323577/371472 [3:34:18<3:35:23,  3.71it/s]
 87%|████████▋ | 323578/371472 [3:34:18<3:41:12,  3.61it/s]
 87%|████████▋ | 323579/371472 [3:34:18<3:44:54,  3.55it/s]
 87%|████████▋ | 323580/371472 [3:34:19<3:44:47,  3.55it/s]
                                                           
{'loss': 2.6072, 'learning_rate': 2.1609493848175996e-07, 'epoch': 13.94}

 87%|████████▋ | 323580/371472 [3:34:19<3:44:47,  3.55it/s]
 87%|████████▋ | 323581/371472 [3:34:19<3:53:37,  3.42it/s]
 87%|████████▋ | 323582/371472 [3:34:19<3:41:44,  3.60it/s]
 87%|████████▋ | 323583/371472 [3:34:19<3:38:55,  3.65it/s]
 87%|████████▋ | 323584/371472 [3:34:20<3:46:12,  3.53it/s]
 87%|████████▋ | 323585/371472 [3:34:20<3:52:16,  3.44it/s]
 87%|████████▋ | 323586/371472 [3:34:20<3:54:31,  3.40it/s]
 87%|████████▋ | 323587/371472 [3:34:21<3:49:05,  3.48it/s]
 87%|████████▋ | 323588/371472 [3:34:21<3:51:02,  3.45it/s]
 87%|████████▋ | 323589/371472 [3:34:21<3:53:30,  3.42it/s]
 87%|████████▋ | 323590/371472 [3:34:22<3:55:57,  3.38it/s]
 87%|████████▋ | 323591/371472 [3:34:22<4:07:15,  3.23it/s]
 87%|████████▋ | 323592/371472 [3:34:22<4:07:51,  3.22it/s]
 87%|████████▋ | 323593/371472 [3:34:22<3:55:31,  3.39it/s]
 87%|████████▋ | 323594/371472 [3:34:23<4:01:33,  3.30it/s]
 87%|████████▋ | 323595/371472 [3:34:23<3:50:44,  3.46it/s]
 87%|████████▋ | 323596/371472 [3:34:23<3:50:45,  3.46it/s]
 87%|████████▋ | 323597/371472 [3:34:24<4:02:02,  3.30it/s]
 87%|████████▋ | 323598/371472 [3:34:24<3:48:17,  3.50it/s]
 87%|████████▋ | 323599/371472 [3:34:24<3:36:48,  3.68it/s]
 87%|████████▋ | 323600/371472 [3:34:24<3:30:16,  3.79it/s]
                                                           
{'loss': 2.5625, 'learning_rate': 2.160464565062811e-07, 'epoch': 13.94}

 87%|████████▋ | 323600/371472 [3:34:24<3:30:16,  3.79it/s]
 87%|████████▋ | 323601/371472 [3:34:25<3:34:38,  3.72it/s]
 87%|████████▋ | 323602/371472 [3:34:25<3:48:11,  3.50it/s]
 87%|████████▋ | 323603/371472 [3:34:25<3:43:41,  3.57it/s]
 87%|████████▋ | 323604/371472 [3:34:26<3:46:23,  3.52it/s]
 87%|████████▋ | 323605/371472 [3:34:26<3:46:26,  3.52it/s]
 87%|████████▋ | 323606/371472 [3:34:26<3:51:17,  3.45it/s]
 87%|████████▋ | 323607/371472 [3:34:26<3:44:49,  3.55it/s]
 87%|████████▋ | 323608/371472 [3:34:27<3:56:42,  3.37it/s]
 87%|████████▋ | 323609/371472 [3:34:27<3:52:18,  3.43it/s]
 87%|████████▋ | 323610/371472 [3:34:27<3:47:12,  3.51it/s]
 87%|████████▋ | 323611/371472 [3:34:28<3:47:24,  3.51it/s]
 87%|████████▋ | 323612/371472 [3:34:28<3:38:13,  3.66it/s]
 87%|████████▋ | 323613/371472 [3:34:28<3:41:46,  3.60it/s]
 87%|████████▋ | 323614/371472 [3:34:28<3:47:18,  3.51it/s]
 87%|████████▋ | 323615/371472 [3:34:29<3:46:28,  3.52it/s]
 87%|████████▋ | 323616/371472 [3:34:29<3:45:49,  3.53it/s]
 87%|████████▋ | 323617/371472 [3:34:29<3:39:38,  3.63it/s]
 87%|████████▋ | 323618/371472 [3:34:29<3:37:13,  3.67it/s]
 87%|████████▋ | 323619/371472 [3:34:30<3:42:20,  3.59it/s]
 87%|████████▋ | 323620/371472 [3:34:30<4:02:04,  3.29it/s]
                                                           
{'loss': 2.595, 'learning_rate': 2.1599797453080218e-07, 'epoch': 13.94}

 87%|████████▋ | 323620/371472 [3:34:30<4:02:04,  3.29it/s]
 87%|████████▋ | 323621/371472 [3:34:30<3:50:10,  3.46it/s]
 87%|████████▋ | 323622/371472 [3:34:31<3:42:50,  3.58it/s]
 87%|████████▋ | 323623/371472 [3:34:31<3:51:23,  3.45it/s]
 87%|████████▋ | 323624/371472 [3:34:31<3:46:09,  3.53it/s]
 87%|████████▋ | 323625/371472 [3:34:32<3:51:05,  3.45it/s]
 87%|████████▋ | 323626/371472 [3:34:32<3:36:38,  3.68it/s]
 87%|████████▋ | 323627/371472 [3:34:32<3:36:53,  3.68it/s]
 87%|████████▋ | 323628/371472 [3:34:32<3:38:02,  3.66it/s]
 87%|████████▋ | 323629/371472 [3:34:33<3:34:55,  3.71it/s]
 87%|████████▋ | 323630/371472 [3:34:33<3:40:19,  3.62it/s]
 87%|████████▋ | 323631/371472 [3:34:33<3:38:03,  3.66it/s]
 87%|████████▋ | 323632/371472 [3:34:33<3:36:56,  3.68it/s]
 87%|████████▋ | 323633/371472 [3:34:34<3:34:48,  3.71it/s]
 87%|████████▋ | 323634/371472 [3:34:34<3:32:00,  3.76it/s]
 87%|████████▋ | 323635/371472 [3:34:34<3:33:35,  3.73it/s]
 87%|████████▋ | 323636/371472 [3:34:34<3:33:20,  3.74it/s]
 87%|████████▋ | 323637/371472 [3:34:35<3:40:58,  3.61it/s]
 87%|████████▋ | 323638/371472 [3:34:35<3:34:12,  3.72it/s]
 87%|████████▋ | 323639/371472 [3:34:35<4:05:26,  3.25it/s]
 87%|████████▋ | 323640/371472 [3:34:36<3:49:28,  3.47it/s]
                                                           
{'loss': 2.619, 'learning_rate': 2.1594949255532333e-07, 'epoch': 13.94}

 87%|████████▋ | 323640/371472 [3:34:36<3:49:28,  3.47it/s]
 87%|████████▋ | 323641/371472 [3:34:36<3:37:46,  3.66it/s]
 87%|████████▋ | 323642/371472 [3:34:36<3:56:08,  3.38it/s]
 87%|████████▋ | 323643/371472 [3:34:36<3:45:59,  3.53it/s]
 87%|████████▋ | 323644/371472 [3:34:37<3:42:33,  3.58it/s]
 87%|████████▋ | 323645/371472 [3:34:37<3:39:02,  3.64it/s]
 87%|████████▋ | 323646/371472 [3:34:37<3:33:28,  3.73it/s]
 87%|████████▋ | 323647/371472 [3:34:38<3:29:25,  3.81it/s]
 87%|████████▋ | 323648/371472 [3:34:38<3:43:42,  3.56it/s]
 87%|████████▋ | 323649/371472 [3:34:38<3:43:59,  3.56it/s]
 87%|████████▋ | 323650/371472 [3:34:38<3:43:15,  3.57it/s]
 87%|████████▋ | 323651/371472 [3:34:39<3:39:30,  3.63it/s]
 87%|████████▋ | 323652/371472 [3:34:39<3:35:38,  3.70it/s]
 87%|████████▋ | 323653/371472 [3:34:39<3:36:27,  3.68it/s]
 87%|████████▋ | 323654/371472 [3:34:39<3:32:46,  3.75it/s]
 87%|████████▋ | 323655/371472 [3:34:40<3:53:23,  3.41it/s]
 87%|████████▋ | 323656/371472 [3:34:40<3:44:47,  3.55it/s]
 87%|████████▋ | 323657/371472 [3:34:40<3:46:25,  3.52it/s]
 87%|████████▋ | 323658/371472 [3:34:41<3:40:15,  3.62it/s]
 87%|████████▋ | 323659/371472 [3:34:41<3:41:15,  3.60it/s]
 87%|████████▋ | 323660/371472 [3:34:41<3:51:34,  3.44it/s]
                                                           
{'loss': 2.7397, 'learning_rate': 2.1590101057984438e-07, 'epoch': 13.94}

 87%|████████▋ | 323660/371472 [3:34:41<3:51:34,  3.44it/s]
 87%|████████▋ | 323661/371472 [3:34:41<3:45:35,  3.53it/s]
 87%|████████▋ | 323662/371472 [3:34:42<3:37:42,  3.66it/s]
 87%|████████▋ | 323663/371472 [3:34:42<3:39:58,  3.62it/s]
 87%|████████▋ | 323664/371472 [3:34:42<3:37:37,  3.66it/s]
 87%|████████▋ | 323665/371472 [3:34:43<3:34:16,  3.72it/s]
 87%|████████▋ | 323666/371472 [3:34:43<3:47:05,  3.51it/s]
 87%|████████▋ | 323667/371472 [3:34:43<3:41:24,  3.60it/s]
 87%|████████▋ | 323668/371472 [3:34:43<3:54:19,  3.40it/s]
 87%|████████▋ | 323669/371472 [3:34:44<3:55:42,  3.38it/s]
 87%|████████▋ | 323670/371472 [3:34:44<4:07:25,  3.22it/s]
 87%|████████▋ | 323671/371472 [3:34:44<4:00:54,  3.31it/s]
 87%|████████▋ | 323672/371472 [3:34:45<4:05:20,  3.25it/s]
 87%|████████▋ | 323673/371472 [3:34:45<4:12:30,  3.15it/s]
 87%|████████▋ | 323674/371472 [3:34:45<4:08:31,  3.21it/s]
 87%|████████▋ | 323675/371472 [3:34:46<4:01:51,  3.29it/s]
 87%|████████▋ | 323676/371472 [3:34:46<3:59:55,  3.32it/s]
 87%|████████▋ | 323677/371472 [3:34:46<4:06:40,  3.23it/s]
 87%|████████▋ | 323678/371472 [3:34:47<4:06:59,  3.23it/s]
 87%|████████▋ | 323679/371472 [3:34:47<3:56:04,  3.37it/s]
 87%|████████▋ | 323680/371472 [3:34:47<3:51:10,  3.45it/s]
                                                           
{'loss': 2.6035, 'learning_rate': 2.1585252860436555e-07, 'epoch': 13.94}

 87%|████████▋ | 323680/371472 [3:34:47<3:51:10,  3.45it/s]
 87%|████████▋ | 323681/371472 [3:34:47<3:53:52,  3.41it/s]
 87%|████████▋ | 323682/371472 [3:34:48<3:43:12,  3.57it/s]
 87%|████████▋ | 323683/371472 [3:34:48<3:36:28,  3.68it/s]
 87%|████████▋ | 323684/371472 [3:34:48<3:40:29,  3.61it/s]
 87%|████████▋ | 323685/371472 [3:34:48<3:44:34,  3.55it/s]
 87%|████████▋ | 323686/371472 [3:34:49<4:00:11,  3.32it/s]
 87%|████████▋ | 323687/371472 [3:34:49<3:47:05,  3.51it/s]
 87%|████████▋ | 323688/371472 [3:34:49<3:52:44,  3.42it/s]
 87%|████████▋ | 323689/371472 [3:34:50<3:54:05,  3.40it/s]
 87%|████████▋ | 323690/371472 [3:34:50<3:48:32,  3.48it/s]
 87%|████████▋ | 323691/371472 [3:34:50<3:43:12,  3.57it/s]
 87%|████████▋ | 323692/371472 [3:34:50<3:37:47,  3.66it/s]
 87%|████████▋ | 323693/371472 [3:34:51<3:33:53,  3.72it/s]
 87%|████████▋ | 323694/371472 [3:34:51<3:37:33,  3.66it/s]
 87%|████████▋ | 323695/371472 [3:34:51<3:38:33,  3.64it/s]
 87%|████████▋ | 323696/371472 [3:34:52<4:43:51,  2.81it/s]
 87%|████████▋ | 323697/371472 [3:34:52<4:19:01,  3.07it/s]
 87%|████████▋ | 323698/371472 [3:34:52<4:01:41,  3.29it/s]
 87%|████████▋ | 323699/371472 [3:34:53<3:54:24,  3.40it/s]
 87%|████████▋ | 323700/371472 [3:34:53<3:50:29,  3.45it/s]
                                                           
{'loss': 2.5558, 'learning_rate': 2.158040466288866e-07, 'epoch': 13.94}

 87%|████████▋ | 323700/371472 [3:34:53<3:50:29,  3.45it/s]
 87%|████████▋ | 323701/371472 [3:34:53<3:56:43,  3.36it/s]
 87%|████████▋ | 323702/371472 [3:34:53<3:47:41,  3.50it/s]
 87%|████████▋ | 323703/371472 [3:34:54<3:45:01,  3.54it/s]
 87%|████████▋ | 323704/371472 [3:34:54<3:42:39,  3.58it/s]
 87%|████████▋ | 323705/371472 [3:34:54<3:41:34,  3.59it/s]
 87%|████████▋ | 323706/371472 [3:34:55<3:36:24,  3.68it/s]
 87%|████████▋ | 323707/371472 [3:34:55<3:41:24,  3.60it/s]
 87%|████████▋ | 323708/371472 [3:34:55<3:42:02,  3.59it/s]
 87%|████████▋ | 323709/371472 [3:34:55<3:39:47,  3.62it/s]
 87%|████████▋ | 323710/371472 [3:34:56<3:38:14,  3.65it/s]
 87%|████████▋ | 323711/371472 [3:34:56<4:07:21,  3.22it/s]
 87%|████████▋ | 323712/371472 [3:34:56<4:09:56,  3.18it/s]
 87%|████████▋ | 323713/371472 [3:34:57<4:17:11,  3.09it/s]
 87%|████████▋ | 323714/371472 [3:34:57<4:04:12,  3.26it/s]
 87%|████████▋ | 323715/371472 [3:34:57<4:05:22,  3.24it/s]
 87%|████████▋ | 323716/371472 [3:34:58<3:50:20,  3.46it/s]
 87%|████████▋ | 323717/371472 [3:34:58<3:44:46,  3.54it/s]
 87%|████████▋ | 323718/371472 [3:34:58<3:46:17,  3.52it/s]
 87%|████████▋ | 323719/371472 [3:34:58<3:55:28,  3.38it/s]
 87%|████████▋ | 323720/371472 [3:34:59<3:47:37,  3.50it/s]
                                                           
{'loss': 2.676, 'learning_rate': 2.1575556465340775e-07, 'epoch': 13.94}

 87%|████████▋ | 323720/371472 [3:34:59<3:47:37,  3.50it/s]
 87%|████████▋ | 323721/371472 [3:34:59<3:37:39,  3.66it/s]
 87%|████████▋ | 323722/371472 [3:34:59<3:38:38,  3.64it/s]
 87%|████████▋ | 323723/371472 [3:34:59<3:38:08,  3.65it/s]
 87%|████████▋ | 323724/371472 [3:35:00<3:55:46,  3.38it/s]
 87%|████████▋ | 323725/371472 [3:35:00<4:04:09,  3.26it/s]
 87%|████████▋ | 323726/371472 [3:35:00<3:50:11,  3.46it/s]
 87%|████████▋ | 323727/371472 [3:35:01<3:51:39,  3.44it/s]
 87%|████████▋ | 323728/371472 [3:35:01<3:59:53,  3.32it/s]
 87%|████████▋ | 323729/371472 [3:35:01<3:52:33,  3.42it/s]
 87%|████████▋ | 323730/371472 [3:35:02<3:43:06,  3.57it/s]
 87%|████████▋ | 323731/371472 [3:35:02<3:33:29,  3.73it/s]
 87%|████████▋ | 323732/371472 [3:35:02<3:58:23,  3.34it/s]
 87%|████████▋ | 323733/371472 [3:35:02<3:50:07,  3.46it/s]
 87%|████████▋ | 323734/371472 [3:35:03<3:49:33,  3.47it/s]
 87%|████████▋ | 323735/371472 [3:35:03<3:45:44,  3.52it/s]
 87%|████████▋ | 323736/371472 [3:35:03<4:01:15,  3.30it/s]
 87%|████████▋ | 323737/371472 [3:35:04<4:05:00,  3.25it/s]
 87%|████████▋ | 323738/371472 [3:35:04<3:50:40,  3.45it/s]
 87%|████████▋ | 323739/371472 [3:35:04<3:52:03,  3.43it/s]
 87%|████████▋ | 323740/371472 [3:35:05<3:54:55,  3.39it/s]
                                                           
{'loss': 2.6293, 'learning_rate': 2.1570708267792882e-07, 'epoch': 13.94}

 87%|████████▋ | 323740/371472 [3:35:05<3:54:55,  3.39it/s]
 87%|████████▋ | 323741/371472 [3:35:05<4:00:19,  3.31it/s]
 87%|████████▋ | 323742/371472 [3:35:05<4:02:05,  3.29it/s]
 87%|████████▋ | 323743/371472 [3:35:05<3:58:14,  3.34it/s]
 87%|████████▋ | 323744/371472 [3:35:06<3:57:15,  3.35it/s]
 87%|████████▋ | 323745/371472 [3:35:06<4:00:03,  3.31it/s]
 87%|████████▋ | 323746/371472 [3:35:06<3:56:51,  3.36it/s]
 87%|████████▋ | 323747/371472 [3:35:07<3:47:32,  3.50it/s]
 87%|████████▋ | 323748/371472 [3:35:07<3:43:57,  3.55it/s]
 87%|████████▋ | 323749/371472 [3:35:07<3:35:03,  3.70it/s]
 87%|████████▋ | 323750/371472 [3:35:07<3:34:59,  3.70it/s]
 87%|████████▋ | 323751/371472 [3:35:08<3:44:36,  3.54it/s]
 87%|████████▋ | 323752/371472 [3:35:08<3:41:37,  3.59it/s]
 87%|████████▋ | 323753/371472 [3:35:08<3:34:21,  3.71it/s]
 87%|████████▋ | 323754/371472 [3:35:09<3:54:46,  3.39it/s]
 87%|████████▋ | 323755/371472 [3:35:09<3:54:15,  3.39it/s]
 87%|████████▋ | 323756/371472 [3:35:09<4:03:14,  3.27it/s]
 87%|████████▋ | 323757/371472 [3:35:09<3:53:51,  3.40it/s]
 87%|████████▋ | 323758/371472 [3:35:10<3:58:31,  3.33it/s]
 87%|████████▋ | 323759/371472 [3:35:10<3:50:19,  3.45it/s]
 87%|████████▋ | 323760/371472 [3:35:10<4:07:32,  3.21it/s]
                                                           
{'loss': 2.5457, 'learning_rate': 2.1565860070244997e-07, 'epoch': 13.94}

 87%|████████▋ | 323760/371472 [3:35:10<4:07:32,  3.21it/s]
 87%|████████▋ | 323761/371472 [3:35:11<3:59:31,  3.32it/s]
 87%|████████▋ | 323762/371472 [3:35:11<3:57:43,  3.34it/s]
 87%|████████▋ | 323763/371472 [3:35:11<3:43:36,  3.56it/s]
 87%|████████▋ | 323764/371472 [3:35:11<3:47:11,  3.50it/s]
 87%|████████▋ | 323765/371472 [3:35:12<3:35:49,  3.68it/s]
 87%|████████▋ | 323766/371472 [3:35:12<3:31:16,  3.76it/s]
 87%|████████▋ | 323767/371472 [3:35:12<3:27:22,  3.83it/s]
 87%|████████▋ | 323768/371472 [3:35:12<3:27:10,  3.84it/s]
 87%|████████▋ | 323769/371472 [3:35:13<3:33:51,  3.72it/s]
 87%|████████▋ | 323770/371472 [3:35:13<3:37:45,  3.65it/s]
 87%|████████▋ | 323771/371472 [3:35:13<3:33:21,  3.73it/s]
 87%|████████▋ | 323772/371472 [3:35:14<3:59:45,  3.32it/s]
 87%|████████▋ | 323773/371472 [3:35:14<4:22:07,  3.03it/s]
 87%|████████▋ | 323774/371472 [3:35:14<4:13:15,  3.14it/s]
 87%|████████▋ | 323775/371472 [3:35:15<4:14:28,  3.12it/s]
 87%|████████▋ | 323776/371472 [3:35:15<4:06:07,  3.23it/s]
 87%|████████▋ | 323777/371472 [3:35:15<3:52:07,  3.42it/s]
 87%|████████▋ | 323778/371472 [3:35:16<3:49:45,  3.46it/s]
 87%|████████▋ | 323779/371472 [3:35:16<3:48:04,  3.49it/s]
 87%|████████▋ | 323780/371472 [3:35:16<3:47:38,  3.49it/s]
                                                           
{'loss': 2.387, 'learning_rate': 2.1561011872697102e-07, 'epoch': 13.95}

 87%|████████▋ | 323780/371472 [3:35:16<3:47:38,  3.49it/s]
 87%|████████▋ | 323781/371472 [3:35:16<3:40:14,  3.61it/s]
 87%|████████▋ | 323782/371472 [3:35:17<3:38:05,  3.64it/s]
 87%|████████▋ | 323783/371472 [3:35:17<3:31:31,  3.76it/s]
 87%|████████▋ | 323784/371472 [3:35:17<3:26:43,  3.84it/s]
 87%|████████▋ | 323785/371472 [3:35:17<3:38:29,  3.64it/s]
 87%|████████▋ | 323786/371472 [3:35:18<3:42:50,  3.57it/s]
 87%|████████▋ | 323787/371472 [3:35:18<3:46:46,  3.50it/s]
 87%|████████▋ | 323788/371472 [3:35:18<3:42:15,  3.58it/s]
 87%|████████▋ | 323789/371472 [3:35:19<4:02:14,  3.28it/s]
 87%|████████▋ | 323790/371472 [3:35:19<4:07:25,  3.21it/s]
 87%|████████▋ | 323791/371472 [3:35:19<4:05:59,  3.23it/s]
 87%|████████▋ | 323792/371472 [3:35:20<4:03:54,  3.26it/s]
 87%|████████▋ | 323793/371472 [3:35:20<3:56:41,  3.36it/s]
 87%|████████▋ | 323794/371472 [3:35:20<3:41:49,  3.58it/s]
 87%|████████▋ | 323795/371472 [3:35:20<3:43:15,  3.56it/s]
 87%|████████▋ | 323796/371472 [3:35:21<3:45:17,  3.53it/s]
 87%|████████▋ | 323797/371472 [3:35:21<3:41:04,  3.59it/s]
 87%|████████▋ | 323798/371472 [3:35:21<3:47:06,  3.50it/s]
 87%|████████▋ | 323799/371472 [3:35:22<3:59:42,  3.31it/s]
 87%|████████▋ | 323800/371472 [3:35:22<3:49:51,  3.46it/s]
                                                           
{'loss': 2.7181, 'learning_rate': 2.155616367514922e-07, 'epoch': 13.95}

 87%|████████▋ | 323800/371472 [3:35:22<3:49:51,  3.46it/s]
 87%|████████▋ | 323801/371472 [3:35:22<3:42:59,  3.56it/s]
 87%|████████▋ | 323802/371472 [3:35:22<3:38:55,  3.63it/s]
 87%|████████▋ | 323803/371472 [3:35:23<3:41:00,  3.59it/s]
 87%|████████▋ | 323804/371472 [3:35:23<3:39:48,  3.61it/s]
 87%|████████▋ | 323805/371472 [3:35:23<3:38:37,  3.63it/s]
 87%|████████▋ | 323806/371472 [3:35:23<3:30:59,  3.77it/s]
 87%|████████▋ | 323807/371472 [3:35:24<3:38:20,  3.64it/s]
 87%|████████▋ | 323808/371472 [3:35:24<3:48:14,  3.48it/s]
 87%|████████▋ | 323809/371472 [3:35:24<3:52:38,  3.41it/s]
 87%|████████▋ | 323810/371472 [3:35:25<3:50:24,  3.45it/s]
 87%|████████▋ | 323811/371472 [3:35:25<3:58:18,  3.33it/s]
 87%|████████▋ | 323812/371472 [3:35:25<3:45:48,  3.52it/s]
 87%|████████▋ | 323813/371472 [3:35:26<4:06:55,  3.22it/s]
 87%|████████▋ | 323814/371472 [3:35:26<3:52:42,  3.41it/s]
 87%|████████▋ | 323815/371472 [3:35:26<3:44:39,  3.54it/s]
 87%|████████▋ | 323816/371472 [3:35:26<3:36:57,  3.66it/s]
 87%|████████▋ | 323817/371472 [3:35:27<3:39:08,  3.62it/s]
 87%|████████▋ | 323818/371472 [3:35:27<3:33:03,  3.73it/s]
 87%|████████▋ | 323819/371472 [3:35:27<3:57:15,  3.35it/s]
 87%|████████▋ | 323820/371472 [3:35:28<3:52:27,  3.42it/s]
                                                           
{'loss': 2.5838, 'learning_rate': 2.1551315477601327e-07, 'epoch': 13.95}

 87%|████████▋ | 323820/371472 [3:35:28<3:52:27,  3.42it/s]
 87%|████████▋ | 323821/371472 [3:35:28<3:45:44,  3.52it/s]
 87%|████████▋ | 323822/371472 [3:35:28<3:44:58,  3.53it/s]
 87%|████████▋ | 323823/371472 [3:35:28<3:38:18,  3.64it/s]
 87%|████████▋ | 323824/371472 [3:35:29<3:39:55,  3.61it/s]
 87%|████████▋ | 323825/371472 [3:35:29<3:37:06,  3.66it/s]
 87%|████████▋ | 323826/371472 [3:35:29<3:37:03,  3.66it/s]
 87%|████████▋ | 323827/371472 [3:35:29<3:33:35,  3.72it/s]
 87%|████████▋ | 323828/371472 [3:35:30<3:34:37,  3.70it/s]
 87%|████████▋ | 323829/371472 [3:35:30<3:41:38,  3.58it/s]
 87%|████████▋ | 323830/371472 [3:35:30<3:37:11,  3.66it/s]
 87%|████████▋ | 323831/371472 [3:35:30<3:38:20,  3.64it/s]
 87%|████████▋ | 323832/371472 [3:35:31<3:33:51,  3.71it/s]
 87%|████████▋ | 323833/371472 [3:35:31<3:30:23,  3.77it/s]
 87%|████████▋ | 323834/371472 [3:35:31<3:29:08,  3.80it/s]
 87%|████████▋ | 323835/371472 [3:35:32<3:29:09,  3.80it/s]
 87%|████████▋ | 323836/371472 [3:35:32<3:29:57,  3.78it/s]
 87%|████████▋ | 323837/371472 [3:35:32<3:42:23,  3.57it/s]
 87%|████████▋ | 323838/371472 [3:35:32<3:36:23,  3.67it/s]
 87%|████████▋ | 323839/371472 [3:35:33<3:33:18,  3.72it/s]
 87%|████████▋ | 323840/371472 [3:35:33<3:33:52,  3.71it/s]
                                                           
{'loss': 2.6781, 'learning_rate': 2.154646728005344e-07, 'epoch': 13.95}

 87%|████████▋ | 323840/371472 [3:35:33<3:33:52,  3.71it/s]
 87%|████████▋ | 323841/371472 [3:35:33<3:37:21,  3.65it/s]
 87%|████████▋ | 323842/371472 [3:35:33<3:32:11,  3.74it/s]
 87%|████████▋ | 323843/371472 [3:35:34<3:32:52,  3.73it/s]
 87%|████████▋ | 323844/371472 [3:35:34<3:29:49,  3.78it/s]
 87%|████████▋ | 323845/371472 [3:35:34<3:28:37,  3.80it/s]
 87%|████████▋ | 323846/371472 [3:35:34<3:25:19,  3.87it/s]
 87%|████████▋ | 323847/371472 [3:35:35<3:39:24,  3.62it/s]
 87%|████████▋ | 323848/371472 [3:35:35<3:35:26,  3.68it/s]
 87%|████████▋ | 323849/371472 [3:35:35<3:33:10,  3.72it/s]
 87%|████████▋ | 323850/371472 [3:35:36<3:31:59,  3.74it/s]
 87%|████████▋ | 323851/371472 [3:35:36<3:38:32,  3.63it/s]
 87%|████████▋ | 323852/371472 [3:35:36<3:42:55,  3.56it/s]
 87%|████████▋ | 323853/371472 [3:35:36<3:37:08,  3.66it/s]
 87%|████████▋ | 323854/371472 [3:35:37<3:51:33,  3.43it/s]
 87%|████████▋ | 323855/371472 [3:35:37<3:38:55,  3.63it/s]
 87%|████████▋ | 323856/371472 [3:35:37<3:49:03,  3.46it/s]
 87%|████████▋ | 323857/371472 [3:35:38<3:49:47,  3.45it/s]
 87%|████████▋ | 323858/371472 [3:35:38<3:47:38,  3.49it/s]
 87%|████████▋ | 323859/371472 [3:35:38<3:46:59,  3.50it/s]
 87%|████████▋ | 323860/371472 [3:35:38<3:43:13,  3.55it/s]
                                                           
{'loss': 2.6391, 'learning_rate': 2.1541619082505546e-07, 'epoch': 13.95}

 87%|████████▋ | 323860/371472 [3:35:38<3:43:13,  3.55it/s]
 87%|████████▋ | 323861/371472 [3:35:39<3:42:46,  3.56it/s]
 87%|████████▋ | 323862/371472 [3:35:39<3:38:00,  3.64it/s]
 87%|████████▋ | 323863/371472 [3:35:39<3:35:27,  3.68it/s]
 87%|████████▋ | 323864/371472 [3:35:39<3:27:46,  3.82it/s]
 87%|████████▋ | 323865/371472 [3:35:40<3:40:38,  3.60it/s]
 87%|████████▋ | 323866/371472 [3:35:40<3:39:35,  3.61it/s]
 87%|████████▋ | 323867/371472 [3:35:40<3:35:44,  3.68it/s]
 87%|████████▋ | 323868/371472 [3:35:41<3:37:46,  3.64it/s]
 87%|████████▋ | 323869/371472 [3:35:41<3:39:02,  3.62it/s]
 87%|████████▋ | 323870/371472 [3:35:41<3:38:07,  3.64it/s]
 87%|████████▋ | 323871/371472 [3:35:41<3:32:54,  3.73it/s]
 87%|████████▋ | 323872/371472 [3:35:42<3:30:23,  3.77it/s]
 87%|████████▋ | 323873/371472 [3:35:42<3:41:39,  3.58it/s]
 87%|████████▋ | 323874/371472 [3:35:42<3:36:00,  3.67it/s]
 87%|████████▋ | 323875/371472 [3:35:43<3:44:29,  3.53it/s]
 87%|████████▋ | 323876/371472 [3:35:43<3:51:48,  3.42it/s]
 87%|████████▋ | 323877/371472 [3:35:43<3:53:08,  3.40it/s]
 87%|████████▋ | 323878/371472 [3:35:43<3:45:23,  3.52it/s]
 87%|████████▋ | 323879/371472 [3:35:44<3:42:57,  3.56it/s]
 87%|████████▋ | 323880/371472 [3:35:44<3:33:56,  3.71it/s]
                                                           
{'loss': 2.6496, 'learning_rate': 2.1536770884957664e-07, 'epoch': 13.95}

 87%|████████▋ | 323880/371472 [3:35:44<3:33:56,  3.71it/s]
 87%|████████▋ | 323881/371472 [3:35:44<4:15:24,  3.11it/s]
 87%|████████▋ | 323882/371472 [3:35:45<4:06:13,  3.22it/s]
 87%|████████▋ | 323883/371472 [3:35:45<4:18:52,  3.06it/s]
 87%|████████▋ | 323884/371472 [3:35:45<4:44:50,  2.78it/s]
 87%|████████▋ | 323885/371472 [3:35:46<4:41:56,  2.81it/s]
 87%|████████▋ | 323886/371472 [3:35:46<4:39:39,  2.84it/s]
 87%|████████▋ | 323887/371472 [3:35:46<4:28:13,  2.96it/s]
 87%|████████▋ | 323888/371472 [3:35:47<4:07:10,  3.21it/s]
 87%|████████▋ | 323889/371472 [3:35:47<4:00:03,  3.30it/s]
 87%|████████▋ | 323890/371472 [3:35:47<3:52:31,  3.41it/s]
 87%|████████▋ | 323891/371472 [3:35:48<4:00:03,  3.30it/s]
 87%|████████▋ | 323892/371472 [3:35:48<3:57:23,  3.34it/s]
 87%|████████▋ | 323893/371472 [3:35:48<3:47:26,  3.49it/s]
 87%|████████▋ | 323894/371472 [3:35:49<4:07:05,  3.21it/s]
 87%|████████▋ | 323895/371472 [3:35:49<4:00:44,  3.29it/s]
 87%|████████▋ | 323896/371472 [3:35:49<3:56:14,  3.36it/s]
 87%|████████▋ | 323897/371472 [3:35:49<3:52:16,  3.41it/s]
 87%|████████▋ | 323898/371472 [3:35:50<3:44:12,  3.54it/s]
 87%|████████▋ | 323899/371472 [3:35:50<3:33:09,  3.72it/s]
 87%|████████▋ | 323900/371472 [3:35:50<3:37:11,  3.65it/s]
                                                           
{'loss': 2.5362, 'learning_rate': 2.1531922687409768e-07, 'epoch': 13.95}

 87%|████████▋ | 323900/371472 [3:35:50<3:37:11,  3.65it/s]
 87%|████████▋ | 323901/371472 [3:35:50<3:36:29,  3.66it/s]
 87%|████████▋ | 323902/371472 [3:35:51<3:30:01,  3.77it/s]
 87%|████████▋ | 323903/371472 [3:35:51<3:45:50,  3.51it/s]
 87%|████████▋ | 323904/371472 [3:35:51<4:05:25,  3.23it/s]
 87%|████████▋ | 323905/371472 [3:35:52<4:16:06,  3.10it/s]
 87%|████████▋ | 323906/371472 [3:35:52<3:59:28,  3.31it/s]
 87%|████████▋ | 323907/371472 [3:35:52<3:53:40,  3.39it/s]
 87%|████████▋ | 323908/371472 [3:35:53<3:46:38,  3.50it/s]
 87%|████████▋ | 323909/371472 [3:35:53<3:47:16,  3.49it/s]
 87%|████████▋ | 323910/371472 [3:35:53<3:44:57,  3.52it/s]
 87%|████████▋ | 323911/371472 [3:35:53<3:46:41,  3.50it/s]
 87%|████████▋ | 323912/371472 [3:35:54<3:50:10,  3.44it/s]
 87%|████████▋ | 323913/371472 [3:35:54<3:48:29,  3.47it/s]
 87%|████████▋ | 323914/371472 [3:35:54<3:40:35,  3.59it/s]
 87%|████████▋ | 323915/371472 [3:35:55<3:57:30,  3.34it/s]
 87%|████████▋ | 323916/371472 [3:35:55<3:49:22,  3.46it/s]
 87%|████████▋ | 323917/371472 [3:35:55<3:41:26,  3.58it/s]
 87%|████████▋ | 323918/371472 [3:35:55<3:42:31,  3.56it/s]
 87%|████████▋ | 323919/371472 [3:35:56<3:34:41,  3.69it/s]
 87%|████████▋ | 323920/371472 [3:35:56<3:35:10,  3.68it/s]
                                                           
{'loss': 2.5785, 'learning_rate': 2.1527074489861884e-07, 'epoch': 13.95}

 87%|████████▋ | 323920/371472 [3:35:56<3:35:10,  3.68it/s]
 87%|████████▋ | 323921/371472 [3:35:56<3:42:54,  3.56it/s]
 87%|████████▋ | 323922/371472 [3:35:56<3:49:49,  3.45it/s]
 87%|████████▋ | 323923/371472 [3:35:57<3:41:02,  3.59it/s]
 87%|████████▋ | 323924/371472 [3:35:57<3:43:14,  3.55it/s]
 87%|████████▋ | 323925/371472 [3:35:57<3:44:20,  3.53it/s]
 87%|████████▋ | 323926/371472 [3:35:58<3:44:55,  3.52it/s]
 87%|████████▋ | 323927/371472 [3:35:58<4:05:14,  3.23it/s]
 87%|████████▋ | 323928/371472 [3:35:58<4:01:56,  3.28it/s]
 87%|████████▋ | 323929/371472 [3:35:59<4:08:26,  3.19it/s]
 87%|████████▋ | 323930/371472 [3:35:59<3:56:33,  3.35it/s]
 87%|████████▋ | 323931/371472 [3:35:59<3:48:45,  3.46it/s]
 87%|████████▋ | 323932/371472 [3:35:59<3:44:52,  3.52it/s]
 87%|████████▋ | 323933/371472 [3:36:00<3:50:17,  3.44it/s]
 87%|████████▋ | 323934/371472 [3:36:00<3:39:06,  3.62it/s]
 87%|████████▋ | 323935/371472 [3:36:00<3:33:59,  3.70it/s]
 87%|████████▋ | 323936/371472 [3:36:01<3:38:56,  3.62it/s]
 87%|████████▋ | 323937/371472 [3:36:01<3:43:27,  3.55it/s]
 87%|████████▋ | 323938/371472 [3:36:01<3:43:56,  3.54it/s]
 87%|████████▋ | 323939/371472 [3:36:01<3:38:33,  3.62it/s]
 87%|████████▋ | 323940/371472 [3:36:02<3:40:33,  3.59it/s]
                                                           
{'loss': 2.7744, 'learning_rate': 2.152222629231399e-07, 'epoch': 13.95}

 87%|████████▋ | 323940/371472 [3:36:02<3:40:33,  3.59it/s]
 87%|████████▋ | 323941/371472 [3:36:02<3:41:52,  3.57it/s]
 87%|████████▋ | 323942/371472 [3:36:02<3:32:50,  3.72it/s]
 87%|████████▋ | 323943/371472 [3:36:02<3:34:17,  3.70it/s]
 87%|████████▋ | 323944/371472 [3:36:03<3:44:37,  3.53it/s]
 87%|████████▋ | 323945/371472 [3:36:03<3:34:33,  3.69it/s]
 87%|████████▋ | 323946/371472 [3:36:03<3:55:33,  3.36it/s]
 87%|████████▋ | 323947/371472 [3:36:04<3:53:39,  3.39it/s]
 87%|████████▋ | 323948/371472 [3:36:04<3:52:47,  3.40it/s]
 87%|████████▋ | 323949/371472 [3:36:04<3:51:01,  3.43it/s]
 87%|████████▋ | 323950/371472 [3:36:05<3:50:01,  3.44it/s]
 87%|████████▋ | 323951/371472 [3:36:05<3:50:17,  3.44it/s]
 87%|████████▋ | 323952/371472 [3:36:05<3:53:27,  3.39it/s]
 87%|████████▋ | 323953/371472 [3:36:05<3:42:10,  3.56it/s]
 87%|████████▋ | 323954/371472 [3:36:06<3:51:00,  3.43it/s]
 87%|████████▋ | 323955/371472 [3:36:06<3:57:40,  3.33it/s]
 87%|████████▋ | 323956/371472 [3:36:06<3:59:48,  3.30it/s]
 87%|████████▋ | 323957/371472 [3:36:07<3:48:14,  3.47it/s]
 87%|████████▋ | 323958/371472 [3:36:07<3:36:44,  3.65it/s]
 87%|████████▋ | 323959/371472 [3:36:07<3:49:08,  3.46it/s]
 87%|████████▋ | 323960/371472 [3:36:07<4:02:24,  3.27it/s]
                                                           
{'loss': 2.6227, 'learning_rate': 2.1517378094766095e-07, 'epoch': 13.95}

 87%|████████▋ | 323960/371472 [3:36:07<4:02:24,  3.27it/s]
 87%|████████▋ | 323961/371472 [3:36:08<3:54:13,  3.38it/s]
 87%|████████▋ | 323962/371472 [3:36:08<3:54:17,  3.38it/s]
 87%|████████▋ | 323963/371472 [3:36:08<4:05:45,  3.22it/s]
 87%|████████▋ | 323964/371472 [3:36:09<4:07:31,  3.20it/s]
 87%|████████▋ | 323965/371472 [3:36:09<4:00:49,  3.29it/s]
 87%|████████▋ | 323966/371472 [3:36:09<3:49:55,  3.44it/s]
 87%|████████▋ | 323967/371472 [3:36:09<3:39:21,  3.61it/s]
 87%|████████▋ | 323968/371472 [3:36:10<3:39:34,  3.61it/s]
 87%|████████▋ | 323969/371472 [3:36:10<3:46:02,  3.50it/s]
 87%|████████▋ | 323970/371472 [3:36:10<3:46:33,  3.49it/s]
 87%|████████▋ | 323971/371472 [3:36:11<3:53:36,  3.39it/s]
 87%|████████▋ | 323972/371472 [3:36:11<3:50:48,  3.43it/s]
 87%|████████▋ | 323973/371472 [3:36:11<3:44:42,  3.52it/s]
 87%|████████▋ | 323974/371472 [3:36:11<3:40:31,  3.59it/s]
 87%|████████▋ | 323975/371472 [3:36:12<3:45:22,  3.51it/s]
 87%|████████▋ | 323976/371472 [3:36:12<3:41:53,  3.57it/s]
 87%|████████▋ | 323977/371472 [3:36:12<3:41:18,  3.58it/s]
 87%|████████▋ | 323978/371472 [3:36:13<3:45:26,  3.51it/s]
 87%|████████▋ | 323979/371472 [3:36:13<4:02:18,  3.27it/s]
 87%|████████▋ | 323980/371472 [3:36:13<3:48:51,  3.46it/s]
                                                           
{'loss': 2.6485, 'learning_rate': 2.151252989721821e-07, 'epoch': 13.95}

 87%|████████▋ | 323980/371472 [3:36:13<3:48:51,  3.46it/s]
 87%|████████▋ | 323981/371472 [3:36:14<3:48:46,  3.46it/s]
 87%|████████▋ | 323982/371472 [3:36:14<3:54:57,  3.37it/s]
 87%|████████▋ | 323983/371472 [3:36:14<3:53:29,  3.39it/s]
 87%|████████▋ | 323984/371472 [3:36:14<3:43:42,  3.54it/s]
 87%|████████▋ | 323985/371472 [3:36:15<3:42:39,  3.55it/s]
 87%|████████▋ | 323986/371472 [3:36:15<3:47:50,  3.47it/s]
 87%|████████▋ | 323987/371472 [3:36:15<3:38:11,  3.63it/s]
 87%|████████▋ | 323988/371472 [3:36:16<3:46:43,  3.49it/s]
 87%|████████▋ | 323989/371472 [3:36:16<3:42:04,  3.56it/s]
 87%|████████▋ | 323990/371472 [3:36:16<3:58:57,  3.31it/s]
 87%|████████▋ | 323991/371472 [3:36:16<4:12:26,  3.13it/s]
 87%|████████▋ | 323992/371472 [3:36:17<4:00:01,  3.30it/s]
 87%|████████▋ | 323993/371472 [3:36:17<4:10:30,  3.16it/s]
 87%|████████▋ | 323994/371472 [3:36:17<3:55:44,  3.36it/s]
 87%|████████▋ | 323995/371472 [3:36:18<3:47:06,  3.48it/s]
 87%|████████▋ | 323996/371472 [3:36:18<3:44:56,  3.52it/s]
 87%|████████▋ | 323997/371472 [3:36:18<3:47:19,  3.48it/s]
 87%|████████▋ | 323998/371472 [3:36:18<3:50:30,  3.43it/s]
 87%|████████▋ | 323999/371472 [3:36:19<3:47:27,  3.48it/s]
 87%|████████▋ | 324000/371472 [3:36:19<3:47:44,  3.47it/s]
                                                           
{'loss': 2.6624, 'learning_rate': 2.1507681699670317e-07, 'epoch': 13.96}

 87%|████████▋ | 324000/371472 [3:36:19<3:47:44,  3.47it/s]
 87%|████████▋ | 324001/371472 [3:36:19<3:48:42,  3.46it/s]
 87%|████████▋ | 324002/371472 [3:36:20<3:40:49,  3.58it/s]
 87%|████████▋ | 324003/371472 [3:36:20<3:37:35,  3.64it/s]
 87%|████████▋ | 324004/371472 [3:36:20<3:52:39,  3.40it/s]
 87%|████████▋ | 324005/371472 [3:36:21<3:56:38,  3.34it/s]
 87%|████████▋ | 324006/371472 [3:36:21<4:00:35,  3.29it/s]
 87%|████████▋ | 324007/371472 [3:36:21<3:59:11,  3.31it/s]
 87%|████████▋ | 324008/371472 [3:36:21<3:58:45,  3.31it/s]
 87%|████████▋ | 324009/371472 [3:36:22<3:47:08,  3.48it/s]
 87%|████████▋ | 324010/371472 [3:36:22<3:41:23,  3.57it/s]
 87%|████████▋ | 324011/371472 [3:36:22<3:39:03,  3.61it/s]
 87%|████████▋ | 324012/371472 [3:36:23<3:40:49,  3.58it/s]
 87%|████████▋ | 324013/371472 [3:36:23<3:40:09,  3.59it/s]
 87%|████████▋ | 324014/371472 [3:36:23<4:02:24,  3.26it/s]
 87%|████████▋ | 324015/371472 [3:36:23<3:58:11,  3.32it/s]
 87%|████████▋ | 324016/371472 [3:36:24<3:55:34,  3.36it/s]
 87%|████████▋ | 324017/371472 [3:36:24<3:51:36,  3.41it/s]
 87%|████████▋ | 324018/371472 [3:36:24<3:57:44,  3.33it/s]
 87%|████████▋ | 324019/371472 [3:36:25<3:52:28,  3.40it/s]
 87%|████████▋ | 324020/371472 [3:36:25<4:12:37,  3.13it/s]
                                                           
{'loss': 2.5742, 'learning_rate': 2.1502833502122433e-07, 'epoch': 13.96}

 87%|████████▋ | 324020/371472 [3:36:25<4:12:37,  3.13it/s]
 87%|████████▋ | 324021/371472 [3:36:25<3:58:50,  3.31it/s]
 87%|████████▋ | 324022/371472 [3:36:26<3:57:09,  3.33it/s]
 87%|████████▋ | 324023/371472 [3:36:26<3:48:16,  3.46it/s]
 87%|████████▋ | 324024/371472 [3:36:26<3:47:56,  3.47it/s]
 87%|████████▋ | 324025/371472 [3:36:26<3:38:09,  3.62it/s]
 87%|████████▋ | 324026/371472 [3:36:27<3:34:51,  3.68it/s]
 87%|████████▋ | 324027/371472 [3:36:27<3:42:55,  3.55it/s]
 87%|████████▋ | 324028/371472 [3:36:27<3:44:56,  3.52it/s]
 87%|████████▋ | 324029/371472 [3:36:28<3:55:01,  3.36it/s]
 87%|████████▋ | 324030/371472 [3:36:28<4:00:17,  3.29it/s]
 87%|████████▋ | 324031/371472 [3:36:28<3:56:52,  3.34it/s]
 87%|████████▋ | 324032/371472 [3:36:28<4:07:07,  3.20it/s]
 87%|████████▋ | 324033/371472 [3:36:29<4:15:13,  3.10it/s]
 87%|████████▋ | 324034/371472 [3:36:29<3:59:22,  3.30it/s]
 87%|████████▋ | 324035/371472 [3:36:29<4:11:06,  3.15it/s]
 87%|████████▋ | 324036/371472 [3:36:30<4:00:25,  3.29it/s]
 87%|████████▋ | 324037/371472 [3:36:30<3:53:58,  3.38it/s]
 87%|████████▋ | 324038/371472 [3:36:30<4:10:27,  3.16it/s]
 87%|████████▋ | 324039/371472 [3:36:31<4:03:48,  3.24it/s]
 87%|████████▋ | 324040/371472 [3:36:31<4:10:32,  3.16it/s]
                                                           
{'loss': 2.563, 'learning_rate': 2.1497985304574537e-07, 'epoch': 13.96}

 87%|████████▋ | 324040/371472 [3:36:31<4:10:32,  3.16it/s]
 87%|████████▋ | 324041/371472 [3:36:31<4:05:22,  3.22it/s]
 87%|████████▋ | 324042/371472 [3:36:32<4:08:16,  3.18it/s]
 87%|████████▋ | 324043/371472 [3:36:32<4:00:16,  3.29it/s]
 87%|████████▋ | 324044/371472 [3:36:32<3:58:09,  3.32it/s]
 87%|████████▋ | 324045/371472 [3:36:32<3:45:02,  3.51it/s]
 87%|████████▋ | 324046/371472 [3:36:33<3:37:31,  3.63it/s]
 87%|████████▋ | 324047/371472 [3:36:33<3:35:36,  3.67it/s]
 87%|████████▋ | 324048/371472 [3:36:33<3:37:23,  3.64it/s]
 87%|████████▋ | 324049/371472 [3:36:33<3:34:23,  3.69it/s]
 87%|████████▋ | 324050/371472 [3:36:34<3:34:05,  3.69it/s]
 87%|████████▋ | 324051/371472 [3:36:34<3:32:11,  3.72it/s]
 87%|████████▋ | 324052/371472 [3:36:34<3:37:08,  3.64it/s]
 87%|████████▋ | 324053/371472 [3:36:35<3:48:14,  3.46it/s]
 87%|████████▋ | 324054/371472 [3:36:35<3:52:28,  3.40it/s]
 87%|████████▋ | 324055/371472 [3:36:35<3:50:13,  3.43it/s]
 87%|████████▋ | 324056/371472 [3:36:35<3:41:17,  3.57it/s]
 87%|████████▋ | 324057/371472 [3:36:36<3:46:26,  3.49it/s]
 87%|████████▋ | 324058/371472 [3:36:36<3:49:23,  3.44it/s]
 87%|████████▋ | 324059/371472 [3:36:36<3:41:08,  3.57it/s]
 87%|████████▋ | 324060/371472 [3:36:37<3:32:26,  3.72it/s]
                                                           
{'loss': 2.5564, 'learning_rate': 2.1493137107026655e-07, 'epoch': 13.96}

 87%|████████▋ | 324060/371472 [3:36:37<3:32:26,  3.72it/s]
 87%|████████▋ | 324061/371472 [3:36:37<3:41:08,  3.57it/s]
 87%|████████▋ | 324062/371472 [3:36:37<3:36:50,  3.64it/s]
 87%|████████▋ | 324063/371472 [3:36:38<4:06:38,  3.20it/s]
 87%|████████▋ | 324064/371472 [3:36:38<3:52:09,  3.40it/s]
 87%|████████▋ | 324065/371472 [3:36:38<3:57:17,  3.33it/s]
 87%|████████▋ | 324066/371472 [3:36:38<3:40:04,  3.59it/s]
 87%|████████▋ | 324067/371472 [3:36:39<3:35:21,  3.67it/s]
 87%|████████▋ | 324068/371472 [3:36:39<3:43:58,  3.53it/s]
 87%|████████▋ | 324069/371472 [3:36:39<3:48:13,  3.46it/s]
 87%|████████▋ | 324070/371472 [3:36:39<3:48:48,  3.45it/s]
 87%|████████▋ | 324071/371472 [3:36:40<3:51:38,  3.41it/s]
 87%|████████▋ | 324072/371472 [3:36:40<3:54:19,  3.37it/s]
 87%|████████▋ | 324073/371472 [3:36:40<3:54:22,  3.37it/s]
 87%|████████▋ | 324074/371472 [3:36:41<3:43:41,  3.53it/s]
 87%|████████▋ | 324075/371472 [3:36:41<3:36:46,  3.64it/s]
 87%|████████▋ | 324076/371472 [3:36:41<3:43:28,  3.53it/s]
 87%|████████▋ | 324077/371472 [3:36:41<3:32:52,  3.71it/s]
 87%|████████▋ | 324078/371472 [3:36:42<3:41:46,  3.56it/s]
 87%|████████▋ | 324079/371472 [3:36:42<3:42:50,  3.54it/s]
 87%|████████▋ | 324080/371472 [3:36:42<3:43:29,  3.53it/s]
                                                           
{'loss': 2.7031, 'learning_rate': 2.1488288909478762e-07, 'epoch': 13.96}

 87%|████████▋ | 324080/371472 [3:36:42<3:43:29,  3.53it/s]
 87%|████████▋ | 324081/371472 [3:36:43<3:35:07,  3.67it/s]
 87%|████████▋ | 324082/371472 [3:36:43<3:38:52,  3.61it/s]
 87%|████████▋ | 324083/371472 [3:36:43<3:44:00,  3.53it/s]
 87%|████████▋ | 324084/371472 [3:36:43<3:51:53,  3.41it/s]
 87%|████████▋ | 324085/371472 [3:36:44<3:43:33,  3.53it/s]
 87%|████████▋ | 324086/371472 [3:36:44<3:43:08,  3.54it/s]
 87%|████████▋ | 324087/371472 [3:36:44<3:39:36,  3.60it/s]
 87%|████████▋ | 324088/371472 [3:36:45<3:42:42,  3.55it/s]
 87%|████████▋ | 324089/371472 [3:36:45<3:52:35,  3.40it/s]
 87%|████████▋ | 324090/371472 [3:36:45<3:50:46,  3.42it/s]
 87%|████████▋ | 324091/371472 [3:36:45<3:48:26,  3.46it/s]
 87%|████████▋ | 324092/371472 [3:36:46<3:46:10,  3.49it/s]
 87%|████████▋ | 324093/371472 [3:36:46<3:40:54,  3.57it/s]
 87%|████████▋ | 324094/371472 [3:36:46<3:42:46,  3.54it/s]
 87%|████████▋ | 324095/371472 [3:36:47<3:40:27,  3.58it/s]
 87%|████████▋ | 324096/371472 [3:36:47<3:35:01,  3.67it/s]
 87%|████████▋ | 324097/371472 [3:36:47<3:37:07,  3.64it/s]
 87%|████████▋ | 324098/371472 [3:36:47<3:51:13,  3.41it/s]
 87%|████████▋ | 324099/371472 [3:36:48<3:59:43,  3.29it/s]
 87%|████████▋ | 324100/371472 [3:36:48<3:45:19,  3.50it/s]
                                                           
{'loss': 2.5054, 'learning_rate': 2.1483440711930874e-07, 'epoch': 13.96}

 87%|████████▋ | 324100/371472 [3:36:48<3:45:19,  3.50it/s]
 87%|████████▋ | 324101/371472 [3:36:48<3:44:50,  3.51it/s]
 87%|████████▋ | 324102/371472 [3:36:49<3:41:48,  3.56it/s]
 87%|████████▋ | 324103/371472 [3:36:49<3:31:48,  3.73it/s]
 87%|████████▋ | 324104/371472 [3:36:49<3:30:42,  3.75it/s]
 87%|████████▋ | 324105/371472 [3:36:49<3:50:50,  3.42it/s]
 87%|████████▋ | 324106/371472 [3:36:50<3:38:18,  3.62it/s]
 87%|████████▋ | 324107/371472 [3:36:50<3:34:57,  3.67it/s]
 87%|████████▋ | 324108/371472 [3:36:50<3:37:45,  3.63it/s]
 87%|████████▋ | 324109/371472 [3:36:50<3:41:24,  3.57it/s]
 87%|████████▋ | 324110/371472 [3:36:51<3:35:09,  3.67it/s]
 87%|████████▋ | 324111/371472 [3:36:51<3:33:18,  3.70it/s]
 87%|████████▋ | 324112/371472 [3:36:51<3:38:35,  3.61it/s]
 87%|████████▋ | 324113/371472 [3:36:52<3:41:25,  3.56it/s]
 87%|████████▋ | 324114/371472 [3:36:52<3:36:16,  3.65it/s]
 87%|████████▋ | 324115/371472 [3:36:52<3:35:06,  3.67it/s]
 87%|████████▋ | 324116/371472 [3:36:52<3:28:37,  3.78it/s]
 87%|████████▋ | 324117/371472 [3:36:53<3:30:51,  3.74it/s]
 87%|████████▋ | 324118/371472 [3:36:53<3:31:14,  3.74it/s]
 87%|████████▋ | 324119/371472 [3:36:53<3:26:36,  3.82it/s]
 87%|████████▋ | 324120/371472 [3:36:54<3:48:38,  3.45it/s]
                                                           
{'loss': 2.5471, 'learning_rate': 2.1478592514382982e-07, 'epoch': 13.96}

 87%|████████▋ | 324120/371472 [3:36:54<3:48:38,  3.45it/s]
 87%|████████▋ | 324121/371472 [3:36:54<3:38:47,  3.61it/s]
 87%|████████▋ | 324122/371472 [3:36:54<3:46:45,  3.48it/s]
 87%|████████▋ | 324123/371472 [3:36:54<3:44:22,  3.52it/s]
 87%|████████▋ | 324124/371472 [3:36:55<3:39:59,  3.59it/s]
 87%|████████▋ | 324125/371472 [3:36:55<3:38:04,  3.62it/s]
 87%|████████▋ | 324126/371472 [3:36:55<3:34:19,  3.68it/s]
 87%|████████▋ | 324127/371472 [3:36:55<3:33:07,  3.70it/s]
 87%|████████▋ | 324128/371472 [3:36:56<3:51:14,  3.41it/s]
 87%|████████▋ | 324129/371472 [3:36:56<3:56:20,  3.34it/s]
 87%|████████▋ | 324130/371472 [3:36:56<4:00:25,  3.28it/s]
 87%|████████▋ | 324131/371472 [3:36:57<3:54:51,  3.36it/s]
 87%|████████▋ | 324132/371472 [3:36:57<3:45:51,  3.49it/s]
 87%|████████▋ | 324133/371472 [3:36:57<3:49:21,  3.44it/s]
 87%|████████▋ | 324134/371472 [3:36:58<3:43:23,  3.53it/s]
 87%|████████▋ | 324135/371472 [3:36:58<3:52:45,  3.39it/s]
 87%|████████▋ | 324136/371472 [3:36:58<3:49:39,  3.44it/s]
 87%|████████▋ | 324137/371472 [3:36:58<3:39:11,  3.60it/s]
 87%|████████▋ | 324138/371472 [3:36:59<3:39:56,  3.59it/s]
 87%|████████▋ | 324139/371472 [3:36:59<3:32:09,  3.72it/s]
 87%|████████▋ | 324140/371472 [3:36:59<3:35:25,  3.66it/s]
                                                           
{'loss': 2.6381, 'learning_rate': 2.14737443168351e-07, 'epoch': 13.96}

 87%|████████▋ | 324140/371472 [3:36:59<3:35:25,  3.66it/s]
 87%|████████▋ | 324141/371472 [3:36:59<3:36:47,  3.64it/s]
 87%|████████▋ | 324142/371472 [3:37:00<3:39:20,  3.60it/s]
 87%|████████▋ | 324143/371472 [3:37:00<3:55:47,  3.35it/s]
 87%|████████▋ | 324144/371472 [3:37:00<3:47:04,  3.47it/s]
 87%|████████▋ | 324145/371472 [3:37:01<3:36:44,  3.64it/s]
 87%|████████▋ | 324146/371472 [3:37:01<3:58:29,  3.31it/s]
 87%|████████▋ | 324147/371472 [3:37:01<4:14:20,  3.10it/s]
 87%|████████▋ | 324148/371472 [3:37:02<4:03:09,  3.24it/s]
 87%|████████▋ | 324149/371472 [3:37:02<4:14:12,  3.10it/s]
 87%|████████▋ | 324150/371472 [3:37:02<3:58:47,  3.30it/s]
 87%|████████▋ | 324151/371472 [3:37:02<3:56:44,  3.33it/s]
 87%|████████▋ | 324152/371472 [3:37:03<3:47:34,  3.47it/s]
 87%|████████▋ | 324153/371472 [3:37:03<3:55:13,  3.35it/s]
 87%|████████▋ | 324154/371472 [3:37:03<3:49:55,  3.43it/s]
 87%|████████▋ | 324155/371472 [3:37:04<3:43:35,  3.53it/s]
 87%|████████▋ | 324156/371472 [3:37:04<3:43:03,  3.54it/s]
 87%|████████▋ | 324157/371472 [3:37:04<3:55:49,  3.34it/s]
 87%|████████▋ | 324158/371472 [3:37:05<4:02:10,  3.26it/s]
 87%|████████▋ | 324159/371472 [3:37:05<4:00:38,  3.28it/s]
 87%|████████▋ | 324160/371472 [3:37:05<4:07:13,  3.19it/s]
                                                           
{'loss': 2.6618, 'learning_rate': 2.1468896119287204e-07, 'epoch': 13.96}

 87%|████████▋ | 324160/371472 [3:37:05<4:07:13,  3.19it/s]
 87%|████████▋ | 324161/371472 [3:37:05<4:00:53,  3.27it/s]
 87%|████████▋ | 324162/371472 [3:37:06<3:52:39,  3.39it/s]
 87%|████████▋ | 324163/371472 [3:37:06<3:55:41,  3.35it/s]
 87%|████████▋ | 324164/371472 [3:37:06<3:49:36,  3.43it/s]
 87%|████████▋ | 324165/371472 [3:37:07<3:51:52,  3.40it/s]
 87%|████████▋ | 324166/371472 [3:37:07<3:57:04,  3.33it/s]
 87%|████████▋ | 324167/371472 [3:37:07<3:46:00,  3.49it/s]
 87%|████████▋ | 324168/371472 [3:37:08<3:57:03,  3.33it/s]
 87%|████████▋ | 324169/371472 [3:37:08<4:01:59,  3.26it/s]
 87%|████████▋ | 324170/371472 [3:37:08<3:52:49,  3.39it/s]
 87%|████████▋ | 324171/371472 [3:37:08<3:44:06,  3.52it/s]
 87%|████████▋ | 324172/371472 [3:37:09<3:40:47,  3.57it/s]
 87%|████████▋ | 324173/371472 [3:37:09<3:42:44,  3.54it/s]
 87%|████████▋ | 324174/371472 [3:37:09<3:46:26,  3.48it/s]
 87%|████████▋ | 324175/371472 [3:37:10<3:47:33,  3.46it/s]
 87%|████████▋ | 324176/371472 [3:37:10<3:45:47,  3.49it/s]
 87%|████████▋ | 324177/371472 [3:37:10<4:03:57,  3.23it/s]
 87%|████████▋ | 324178/371472 [3:37:11<4:12:11,  3.13it/s]
 87%|████████▋ | 324179/371472 [3:37:11<4:11:57,  3.13it/s]
 87%|████████▋ | 324180/371472 [3:37:11<3:55:30,  3.35it/s]
                                                           
{'loss': 2.4785, 'learning_rate': 2.146404792173932e-07, 'epoch': 13.96}

 87%|████████▋ | 324180/371472 [3:37:11<3:55:30,  3.35it/s]
 87%|████████▋ | 324181/371472 [3:37:11<3:47:14,  3.47it/s]
 87%|████████▋ | 324182/371472 [3:37:12<3:39:20,  3.59it/s]
 87%|████████▋ | 324183/371472 [3:37:12<3:32:11,  3.71it/s]
 87%|████████▋ | 324184/371472 [3:37:12<3:35:32,  3.66it/s]
 87%|████████▋ | 324185/371472 [3:37:12<3:51:04,  3.41it/s]
 87%|████████▋ | 324186/371472 [3:37:13<3:58:36,  3.30it/s]
 87%|████████▋ | 324187/371472 [3:37:13<4:03:52,  3.23it/s]
 87%|████████▋ | 324188/371472 [3:37:13<4:07:10,  3.19it/s]
 87%|████████▋ | 324189/371472 [3:37:14<3:53:14,  3.38it/s]
 87%|████████▋ | 324190/371472 [3:37:14<3:47:05,  3.47it/s]
 87%|████████▋ | 324191/371472 [3:37:14<3:40:21,  3.58it/s]
 87%|████████▋ | 324192/371472 [3:37:14<3:32:30,  3.71it/s]
 87%|████████▋ | 324193/371472 [3:37:15<3:38:35,  3.60it/s]
 87%|████████▋ | 324194/371472 [3:37:15<3:39:17,  3.59it/s]
 87%|████████▋ | 324195/371472 [3:37:15<3:50:05,  3.42it/s]
 87%|████████▋ | 324196/371472 [3:37:16<3:40:54,  3.57it/s]
 87%|████████▋ | 324197/371472 [3:37:16<3:35:59,  3.65it/s]
 87%|████████▋ | 324198/371472 [3:37:16<3:54:44,  3.36it/s]
 87%|████████▋ | 324199/371472 [3:37:16<3:41:46,  3.55it/s]
 87%|████████▋ | 324200/371472 [3:37:17<3:50:55,  3.41it/s]
                                                           
{'loss': 2.7402, 'learning_rate': 2.1459199724191426e-07, 'epoch': 13.96}

 87%|████████▋ | 324200/371472 [3:37:17<3:50:55,  3.41it/s]
 87%|████████▋ | 324201/371472 [3:37:17<3:41:18,  3.56it/s]
 87%|████████▋ | 324202/371472 [3:37:17<3:43:21,  3.53it/s]
 87%|████████▋ | 324203/371472 [3:37:18<3:41:02,  3.56it/s]
 87%|████████▋ | 324204/371472 [3:37:18<3:34:45,  3.67it/s]
 87%|████████▋ | 324205/371472 [3:37:18<3:44:07,  3.51it/s]
 87%|████████▋ | 324206/371472 [3:37:18<3:31:02,  3.73it/s]
 87%|████████▋ | 324207/371472 [3:37:19<3:49:21,  3.43it/s]
 87%|████████▋ | 324208/371472 [3:37:19<3:59:23,  3.29it/s]
 87%|████████▋ | 324209/371472 [3:37:19<3:46:50,  3.47it/s]
 87%|████████▋ | 324210/371472 [3:37:20<3:38:47,  3.60it/s]
 87%|████████▋ | 324211/371472 [3:37:20<3:52:19,  3.39it/s]
 87%|████████▋ | 324212/371472 [3:37:20<3:44:26,  3.51it/s]
 87%|████████▋ | 324213/371472 [3:37:20<3:36:29,  3.64it/s]
 87%|████████▋ | 324214/371472 [3:37:21<3:34:41,  3.67it/s]
 87%|████████▋ | 324215/371472 [3:37:21<3:56:28,  3.33it/s]
 87%|████████▋ | 324216/371472 [3:37:21<4:05:18,  3.21it/s]
 87%|████████▋ | 324217/371472 [3:37:22<3:52:03,  3.39it/s]
 87%|████████▋ | 324218/371472 [3:37:22<3:43:43,  3.52it/s]
 87%|████████▋ | 324219/371472 [3:37:22<3:38:00,  3.61it/s]
 87%|████████▋ | 324220/371472 [3:37:22<3:38:24,  3.61it/s]
                                                           
{'loss': 2.666, 'learning_rate': 2.1454351526643538e-07, 'epoch': 13.96}

 87%|████████▋ | 324220/371472 [3:37:22<3:38:24,  3.61it/s]
 87%|████████▋ | 324221/371472 [3:37:23<3:40:47,  3.57it/s]
 87%|████████▋ | 324222/371472 [3:37:23<3:36:36,  3.64it/s]
 87%|████████▋ | 324223/371472 [3:37:23<3:42:03,  3.55it/s]
 87%|████████▋ | 324224/371472 [3:37:24<3:42:34,  3.54it/s]
 87%|████████▋ | 324225/371472 [3:37:24<3:37:58,  3.61it/s]
 87%|████████▋ | 324226/371472 [3:37:24<3:39:50,  3.58it/s]
 87%|████████▋ | 324227/371472 [3:37:24<3:32:47,  3.70it/s]
 87%|████████▋ | 324228/371472 [3:37:25<3:36:03,  3.64it/s]
 87%|████████▋ | 324229/371472 [3:37:25<3:36:19,  3.64it/s]
 87%|████████▋ | 324230/371472 [3:37:25<3:42:20,  3.54it/s]
 87%|████████▋ | 324231/371472 [3:37:26<3:32:14,  3.71it/s]
 87%|████████▋ | 324232/371472 [3:37:26<3:41:40,  3.55it/s]
 87%|████████▋ | 324233/371472 [3:37:26<3:34:18,  3.67it/s]
 87%|████████▋ | 324234/371472 [3:37:26<3:37:29,  3.62it/s]
 87%|████████▋ | 324235/371472 [3:37:27<3:38:10,  3.61it/s]
 87%|████████▋ | 324236/371472 [3:37:27<3:33:14,  3.69it/s]
 87%|████████▋ | 324237/371472 [3:37:27<3:58:53,  3.30it/s]
 87%|████████▋ | 324238/371472 [3:37:28<4:00:43,  3.27it/s]
 87%|████████▋ | 324239/371472 [3:37:28<3:52:37,  3.38it/s]
 87%|████████▋ | 324240/371472 [3:37:28<3:39:56,  3.58it/s]
                                                           
{'loss': 2.6239, 'learning_rate': 2.1449503329095646e-07, 'epoch': 13.97}

 87%|████████▋ | 324240/371472 [3:37:28<3:39:56,  3.58it/s]
 87%|████████▋ | 324241/371472 [3:37:28<3:31:01,  3.73it/s]
 87%|████████▋ | 324242/371472 [3:37:29<3:30:49,  3.73it/s]
 87%|████████▋ | 324243/371472 [3:37:29<3:31:30,  3.72it/s]
 87%|████████▋ | 324244/371472 [3:37:29<3:28:27,  3.78it/s]
 87%|████████▋ | 324245/371472 [3:37:29<3:27:04,  3.80it/s]
 87%|████████▋ | 324246/371472 [3:37:30<3:35:14,  3.66it/s]
 87%|████████▋ | 324247/371472 [3:37:30<3:38:03,  3.61it/s]
 87%|████████▋ | 324248/371472 [3:37:30<3:28:52,  3.77it/s]
 87%|████████▋ | 324249/371472 [3:37:30<3:25:04,  3.84it/s]
 87%|████████▋ | 324250/371472 [3:37:31<3:27:34,  3.79it/s]
 87%|████████▋ | 324251/371472 [3:37:31<3:36:41,  3.63it/s]
 87%|████████▋ | 324252/371472 [3:37:31<3:39:50,  3.58it/s]
 87%|████████▋ | 324253/371472 [3:37:32<4:04:37,  3.22it/s]
 87%|████████▋ | 324254/371472 [3:37:32<4:00:20,  3.27it/s]
 87%|████████▋ | 324255/371472 [3:37:32<3:53:31,  3.37it/s]
 87%|████████▋ | 324256/371472 [3:37:33<3:47:08,  3.46it/s]
 87%|████████▋ | 324257/371472 [3:37:33<3:47:24,  3.46it/s]
 87%|████████▋ | 324258/371472 [3:37:33<4:01:14,  3.26it/s]
 87%|████████▋ | 324259/371472 [3:37:34<4:02:55,  3.24it/s]
 87%|████████▋ | 324260/371472 [3:37:34<3:47:41,  3.46it/s]
                                                           
{'loss': 2.6809, 'learning_rate': 2.144465513154776e-07, 'epoch': 13.97}

 87%|████████▋ | 324260/371472 [3:37:34<3:47:41,  3.46it/s]
 87%|████████▋ | 324261/371472 [3:37:34<3:42:05,  3.54it/s]
 87%|████████▋ | 324262/371472 [3:37:34<3:42:24,  3.54it/s]
 87%|████████▋ | 324263/371472 [3:37:35<3:36:23,  3.64it/s]
 87%|████████▋ | 324264/371472 [3:37:35<3:47:36,  3.46it/s]
 87%|████████▋ | 324265/371472 [3:37:35<3:40:44,  3.56it/s]
 87%|████████▋ | 324266/371472 [3:37:35<3:35:02,  3.66it/s]
 87%|████████▋ | 324267/371472 [3:37:36<3:32:20,  3.71it/s]
 87%|████████▋ | 324268/371472 [3:37:36<3:27:43,  3.79it/s]
 87%|████████▋ | 324269/371472 [3:37:36<3:33:01,  3.69it/s]
 87%|████████▋ | 324270/371472 [3:37:36<3:29:49,  3.75it/s]
 87%|████████▋ | 324271/371472 [3:37:37<3:43:46,  3.52it/s]
 87%|████████▋ | 324272/371472 [3:37:37<3:43:35,  3.52it/s]
 87%|████████▋ | 324273/371472 [3:37:37<3:48:31,  3.44it/s]
 87%|████████▋ | 324274/371472 [3:37:38<3:58:16,  3.30it/s]
 87%|████████▋ | 324275/371472 [3:37:38<3:56:13,  3.33it/s]
 87%|████████▋ | 324276/371472 [3:37:38<3:56:28,  3.33it/s]
 87%|████████▋ | 324277/371472 [3:37:39<3:57:31,  3.31it/s]
 87%|████████▋ | 324278/371472 [3:37:39<4:04:36,  3.22it/s]
 87%|████████▋ | 324279/371472 [3:37:39<4:00:22,  3.27it/s]
 87%|████████▋ | 324280/371472 [3:37:40<3:58:12,  3.30it/s]
                                                           
{'loss': 2.6778, 'learning_rate': 2.1439806933999868e-07, 'epoch': 13.97}

 87%|████████▋ | 324280/371472 [3:37:40<3:58:12,  3.30it/s]
 87%|████████▋ | 324281/371472 [3:37:40<3:57:01,  3.32it/s]
 87%|████████▋ | 324282/371472 [3:37:40<3:46:53,  3.47it/s]
 87%|████████▋ | 324283/371472 [3:37:40<3:39:59,  3.58it/s]
 87%|████████▋ | 324284/371472 [3:37:41<3:39:24,  3.58it/s]
 87%|████████▋ | 324285/371472 [3:37:41<3:39:04,  3.59it/s]
 87%|████████▋ | 324286/371472 [3:37:41<3:32:22,  3.70it/s]
 87%|████████▋ | 324287/371472 [3:37:41<3:44:47,  3.50it/s]
 87%|████████▋ | 324288/371472 [3:37:42<3:47:31,  3.46it/s]
 87%|████████▋ | 324289/371472 [3:37:42<3:41:08,  3.56it/s]
 87%|████████▋ | 324290/371472 [3:37:42<3:56:00,  3.33it/s]
 87%|████████▋ | 324291/371472 [3:37:43<3:56:45,  3.32it/s]
 87%|████████▋ | 324292/371472 [3:37:43<3:53:18,  3.37it/s]
 87%|████████▋ | 324293/371472 [3:37:43<3:51:56,  3.39it/s]
 87%|████████▋ | 324294/371472 [3:37:44<3:44:10,  3.51it/s]
 87%|████████▋ | 324295/371472 [3:37:44<3:42:06,  3.54it/s]
 87%|████████▋ | 324296/371472 [3:37:44<3:44:55,  3.50it/s]
 87%|████████▋ | 324297/371472 [3:37:44<3:40:43,  3.56it/s]
 87%|████████▋ | 324298/371472 [3:37:45<3:31:13,  3.72it/s]
 87%|████████▋ | 324299/371472 [3:37:45<3:31:00,  3.73it/s]
 87%|████████▋ | 324300/371472 [3:37:45<3:44:17,  3.51it/s]
                                                           
{'loss': 2.7316, 'learning_rate': 2.1434958736451983e-07, 'epoch': 13.97}

 87%|████████▋ | 324300/371472 [3:37:45<3:44:17,  3.51it/s]
 87%|████████▋ | 324301/371472 [3:37:45<3:47:48,  3.45it/s]
 87%|████████▋ | 324302/371472 [3:37:46<3:48:27,  3.44it/s]
 87%|████████▋ | 324303/371472 [3:37:46<3:57:46,  3.31it/s]
 87%|████████▋ | 324304/371472 [3:37:46<3:57:08,  3.32it/s]
 87%|████████▋ | 324305/371472 [3:37:47<4:02:20,  3.24it/s]
 87%|████████▋ | 324306/371472 [3:37:47<4:04:42,  3.21it/s]
 87%|████████▋ | 324307/371472 [3:37:47<4:00:48,  3.26it/s]
 87%|████████▋ | 324308/371472 [3:37:48<4:18:15,  3.04it/s]
 87%|████████▋ | 324309/371472 [3:37:48<4:09:39,  3.15it/s]
 87%|████████▋ | 324310/371472 [3:37:48<4:10:01,  3.14it/s]
 87%|████████▋ | 324311/371472 [3:37:49<4:00:36,  3.27it/s]
 87%|████████▋ | 324312/371472 [3:37:49<3:48:06,  3.45it/s]
 87%|████████▋ | 324313/371472 [3:37:49<3:43:19,  3.52it/s]
 87%|████████▋ | 324314/371472 [3:37:49<3:43:21,  3.52it/s]
 87%|████████▋ | 324315/371472 [3:37:50<3:48:18,  3.44it/s]
 87%|████████▋ | 324316/371472 [3:37:50<3:53:20,  3.37it/s]
 87%|████████▋ | 324317/371472 [3:37:50<3:51:30,  3.39it/s]
 87%|████████▋ | 324318/371472 [3:37:51<3:50:30,  3.41it/s]
 87%|████████▋ | 324319/371472 [3:37:51<3:50:30,  3.41it/s]
 87%|████████▋ | 324320/371472 [3:37:51<3:46:51,  3.46it/s]
                                                           
{'loss': 2.4663, 'learning_rate': 2.143011053890409e-07, 'epoch': 13.97}

 87%|████████▋ | 324320/371472 [3:37:51<3:46:51,  3.46it/s]
 87%|████████▋ | 324321/371472 [3:37:51<3:38:29,  3.60it/s]
 87%|████████▋ | 324322/371472 [3:37:52<3:41:46,  3.54it/s]
 87%|████████▋ | 324323/371472 [3:37:52<3:39:09,  3.59it/s]
 87%|████████▋ | 324324/371472 [3:37:52<3:44:16,  3.50it/s]
 87%|████████▋ | 324325/371472 [3:37:53<4:05:48,  3.20it/s]
 87%|████████▋ | 324326/371472 [3:37:53<4:13:40,  3.10it/s]
 87%|████████▋ | 324327/371472 [3:37:53<4:01:01,  3.26it/s]
 87%|████████▋ | 324328/371472 [3:37:54<3:55:46,  3.33it/s]
 87%|████████▋ | 324329/371472 [3:37:54<3:49:23,  3.43it/s]
 87%|████████▋ | 324330/371472 [3:37:54<3:41:48,  3.54it/s]
 87%|████████▋ | 324331/371472 [3:37:54<3:57:58,  3.30it/s]
 87%|████████▋ | 324332/371472 [3:37:55<4:12:34,  3.11it/s]
 87%|████████▋ | 324333/371472 [3:37:55<4:03:00,  3.23it/s]
 87%|████████▋ | 324334/371472 [3:37:55<3:51:30,  3.39it/s]
 87%|████████▋ | 324335/371472 [3:37:56<4:06:03,  3.19it/s]
 87%|████████▋ | 324336/371472 [3:37:56<4:00:00,  3.27it/s]
 87%|████████▋ | 324337/371472 [3:37:56<3:56:09,  3.33it/s]
 87%|████████▋ | 324338/371472 [3:37:57<3:49:53,  3.42it/s]
 87%|████████▋ | 324339/371472 [3:37:57<3:43:48,  3.51it/s]
 87%|████████▋ | 324340/371472 [3:37:57<4:30:25,  2.90it/s]
                                                           
{'loss': 2.3857, 'learning_rate': 2.1425262341356205e-07, 'epoch': 13.97}

 87%|████████▋ | 324340/371472 [3:37:57<4:30:25,  2.90it/s]
 87%|████████▋ | 324341/371472 [3:37:58<4:20:51,  3.01it/s]
 87%|████████▋ | 324342/371472 [3:37:58<4:07:37,  3.17it/s]
 87%|████████▋ | 324343/371472 [3:37:58<4:01:56,  3.25it/s]
 87%|████████▋ | 324344/371472 [3:37:58<3:59:11,  3.28it/s]
 87%|████████▋ | 324345/371472 [3:37:59<3:52:11,  3.38it/s]
 87%|████████▋ | 324346/371472 [3:37:59<3:40:33,  3.56it/s]
 87%|████████▋ | 324347/371472 [3:37:59<3:38:52,  3.59it/s]
 87%|████████▋ | 324348/371472 [3:38:00<3:36:50,  3.62it/s]
 87%|████████▋ | 324349/371472 [3:38:00<3:42:48,  3.52it/s]
 87%|████████▋ | 324350/371472 [3:38:00<3:44:41,  3.50it/s]
 87%|████████▋ | 324351/371472 [3:38:00<3:37:57,  3.60it/s]
 87%|████████▋ | 324352/371472 [3:38:01<3:43:43,  3.51it/s]
 87%|████████▋ | 324353/371472 [3:38:01<3:39:33,  3.58it/s]
 87%|████████▋ | 324354/371472 [3:38:01<3:38:16,  3.60it/s]
 87%|████████▋ | 324355/371472 [3:38:02<3:59:56,  3.27it/s]
 87%|████████▋ | 324356/371472 [3:38:02<4:00:32,  3.26it/s]
 87%|████████▋ | 324357/371472 [3:38:02<3:54:04,  3.35it/s]
 87%|████████▋ | 324358/371472 [3:38:02<3:48:44,  3.43it/s]
 87%|████████▋ | 324359/371472 [3:38:03<3:45:49,  3.48it/s]
 87%|████████▋ | 324360/371472 [3:38:03<3:56:38,  3.32it/s]
                                                           
{'loss': 2.5109, 'learning_rate': 2.142041414380831e-07, 'epoch': 13.97}

 87%|████████▋ | 324360/371472 [3:38:03<3:56:38,  3.32it/s]
 87%|████████▋ | 324361/371472 [3:38:03<3:49:52,  3.42it/s]
 87%|████████▋ | 324362/371472 [3:38:04<3:55:36,  3.33it/s]
 87%|████████▋ | 324363/371472 [3:38:04<3:55:11,  3.34it/s]
 87%|████████▋ | 324364/371472 [3:38:04<3:49:42,  3.42it/s]
 87%|████████▋ | 324365/371472 [3:38:05<3:54:38,  3.35it/s]
 87%|████████▋ | 324366/371472 [3:38:05<3:53:05,  3.37it/s]
 87%|████████▋ | 324367/371472 [3:38:05<3:46:36,  3.46it/s]
 87%|████████▋ | 324368/371472 [3:38:05<3:58:23,  3.29it/s]
 87%|████████▋ | 324369/371472 [3:38:06<3:43:07,  3.52it/s]
 87%|████████▋ | 324370/371472 [3:38:06<4:18:20,  3.04it/s]
 87%|████████▋ | 324371/371472 [3:38:06<4:00:55,  3.26it/s]
 87%|████████▋ | 324372/371472 [3:38:07<4:12:04,  3.11it/s]
 87%|████████▋ | 324373/371472 [3:38:07<3:54:57,  3.34it/s]
 87%|████████▋ | 324374/371472 [3:38:07<3:50:38,  3.40it/s]
 87%|████████▋ | 324375/371472 [3:38:08<3:48:11,  3.44it/s]
 87%|████████▋ | 324376/371472 [3:38:08<3:59:58,  3.27it/s]
 87%|████████▋ | 324377/371472 [3:38:08<4:02:56,  3.23it/s]
 87%|████████▋ | 324378/371472 [3:38:09<3:54:28,  3.35it/s]
 87%|████████▋ | 324379/371472 [3:38:09<3:51:31,  3.39it/s]
 87%|████████▋ | 324380/371472 [3:38:09<3:44:34,  3.49it/s]
                                                           
{'loss': 2.519, 'learning_rate': 2.1415565946260427e-07, 'epoch': 13.97}

 87%|████████▋ | 324380/371472 [3:38:09<3:44:34,  3.49it/s]
 87%|████████▋ | 324381/371472 [3:38:09<3:38:30,  3.59it/s]
 87%|████████▋ | 324382/371472 [3:38:10<3:43:53,  3.51it/s]
 87%|████████▋ | 324383/371472 [3:38:10<3:35:54,  3.63it/s]
 87%|████████▋ | 324384/371472 [3:38:10<3:30:12,  3.73it/s]
 87%|████████▋ | 324385/371472 [3:38:10<3:28:29,  3.76it/s]
 87%|████████▋ | 324386/371472 [3:38:11<3:37:42,  3.60it/s]
 87%|████████▋ | 324387/371472 [3:38:11<3:35:42,  3.64it/s]
 87%|████████▋ | 324388/371472 [3:38:11<3:37:05,  3.61it/s]
 87%|████████▋ | 324389/371472 [3:38:12<3:39:23,  3.58it/s]
 87%|████████▋ | 324390/371472 [3:38:12<4:06:43,  3.18it/s]
 87%|████████▋ | 324391/371472 [3:38:12<3:56:37,  3.32it/s]
 87%|████████▋ | 324392/371472 [3:38:12<3:47:27,  3.45it/s]
 87%|████████▋ | 324393/371472 [3:38:13<3:56:35,  3.32it/s]
 87%|████████▋ | 324394/371472 [3:38:13<3:55:26,  3.33it/s]
 87%|████████▋ | 324395/371472 [3:38:13<3:45:11,  3.48it/s]
 87%|████████▋ | 324396/371472 [3:38:14<3:49:09,  3.42it/s]
 87%|████████▋ | 324397/371472 [3:38:14<3:47:22,  3.45it/s]
 87%|████████▋ | 324398/371472 [3:38:14<4:07:30,  3.17it/s]
 87%|████████▋ | 324399/371472 [3:38:15<4:09:11,  3.15it/s]
 87%|████████▋ | 324400/371472 [3:38:15<4:03:25,  3.22it/s]
                                                           
{'loss': 2.604, 'learning_rate': 2.1410717748712532e-07, 'epoch': 13.97}

 87%|████████▋ | 324400/371472 [3:38:15<4:03:25,  3.22it/s]
 87%|████████▋ | 324401/371472 [3:38:15<3:55:41,  3.33it/s]
 87%|████████▋ | 324402/371472 [3:38:15<3:51:57,  3.38it/s]
 87%|████████▋ | 324403/371472 [3:38:16<3:50:32,  3.40it/s]
 87%|████████▋ | 324404/371472 [3:38:16<3:46:49,  3.46it/s]
 87%|████████▋ | 324405/371472 [3:38:16<3:50:31,  3.40it/s]
 87%|████████▋ | 324406/371472 [3:38:17<3:57:18,  3.31it/s]
 87%|████████▋ | 324407/371472 [3:38:17<3:49:50,  3.41it/s]
 87%|████████▋ | 324408/371472 [3:38:17<3:47:27,  3.45it/s]
 87%|████████▋ | 324409/371472 [3:38:18<3:48:33,  3.43it/s]
 87%|████████▋ | 324410/371472 [3:38:18<3:47:48,  3.44it/s]
 87%|████████▋ | 324411/371472 [3:38:18<3:59:17,  3.28it/s]
 87%|████████▋ | 324412/371472 [3:38:18<4:01:24,  3.25it/s]
 87%|████████▋ | 324413/371472 [3:38:19<3:56:30,  3.32it/s]
 87%|████████▋ | 324414/371472 [3:38:19<3:52:04,  3.38it/s]
 87%|████████▋ | 324415/371472 [3:38:19<3:43:45,  3.51it/s]
 87%|████████▋ | 324416/371472 [3:38:20<3:47:16,  3.45it/s]
 87%|████████▋ | 324417/371472 [3:38:20<3:43:26,  3.51it/s]
 87%|████████▋ | 324418/371472 [3:38:20<3:49:14,  3.42it/s]
 87%|████████▋ | 324419/371472 [3:38:20<3:42:13,  3.53it/s]
 87%|████████▋ | 324420/371472 [3:38:21<3:41:59,  3.53it/s]
                                                           
{'loss': 2.7339, 'learning_rate': 2.1405869551164647e-07, 'epoch': 13.97}

 87%|████████▋ | 324420/371472 [3:38:21<3:41:59,  3.53it/s]
 87%|████████▋ | 324421/371472 [3:38:21<3:43:28,  3.51it/s]
 87%|████████▋ | 324422/371472 [3:38:21<3:31:05,  3.71it/s]
 87%|████████▋ | 324423/371472 [3:38:22<3:29:40,  3.74it/s]
 87%|████████▋ | 324424/371472 [3:38:22<3:32:52,  3.68it/s]
 87%|████████▋ | 324425/371472 [3:38:22<3:48:39,  3.43it/s]
 87%|████████▋ | 324426/371472 [3:38:22<3:46:20,  3.46it/s]
 87%|████████▋ | 324427/371472 [3:38:23<3:38:13,  3.59it/s]
 87%|████████▋ | 324428/371472 [3:38:23<3:37:12,  3.61it/s]
 87%|████████▋ | 324429/371472 [3:38:23<3:34:09,  3.66it/s]
 87%|████████▋ | 324430/371472 [3:38:23<3:32:27,  3.69it/s]
 87%|████████▋ | 324431/371472 [3:38:24<3:32:27,  3.69it/s]
 87%|████████▋ | 324432/371472 [3:38:24<3:35:45,  3.63it/s]
 87%|████████▋ | 324433/371472 [3:38:24<3:44:10,  3.50it/s]
 87%|████████▋ | 324434/371472 [3:38:25<3:41:38,  3.54it/s]
 87%|████████▋ | 324435/371472 [3:38:25<3:38:20,  3.59it/s]
 87%|████████▋ | 324436/371472 [3:38:25<3:58:29,  3.29it/s]
 87%|████████▋ | 324437/371472 [3:38:26<3:51:30,  3.39it/s]
 87%|████████▋ | 324438/371472 [3:38:26<3:52:09,  3.38it/s]
 87%|████████▋ | 324439/371472 [3:38:26<3:46:41,  3.46it/s]
 87%|████████▋ | 324440/371472 [3:38:26<3:43:20,  3.51it/s]
                                                           
{'loss': 2.6048, 'learning_rate': 2.1401021353616754e-07, 'epoch': 13.97}

 87%|████████▋ | 324440/371472 [3:38:26<3:43:20,  3.51it/s]
 87%|████████▋ | 324441/371472 [3:38:27<3:35:39,  3.63it/s]
 87%|████████▋ | 324442/371472 [3:38:27<3:52:01,  3.38it/s]
 87%|████████▋ | 324443/371472 [3:38:27<4:11:09,  3.12it/s]
 87%|████████▋ | 324444/371472 [3:38:28<4:19:35,  3.02it/s]
 87%|████████▋ | 324445/371472 [3:38:28<4:05:18,  3.20it/s]
 87%|████████▋ | 324446/371472 [3:38:28<4:19:09,  3.02it/s]
 87%|████████▋ | 324447/371472 [3:38:29<4:30:12,  2.90it/s]
 87%|████████▋ | 324448/371472 [3:38:29<4:11:08,  3.12it/s]
 87%|████████▋ | 324449/371472 [3:38:29<4:03:37,  3.22it/s]
 87%|████████▋ | 324450/371472 [3:38:30<4:21:25,  3.00it/s]
 87%|████████▋ | 324451/371472 [3:38:30<4:17:48,  3.04it/s]
 87%|████████▋ | 324452/371472 [3:38:30<4:08:22,  3.16it/s]
 87%|████████▋ | 324453/371472 [3:38:31<4:04:11,  3.21it/s]
 87%|████████▋ | 324454/371472 [3:38:31<3:52:37,  3.37it/s]
 87%|████████▋ | 324455/371472 [3:38:31<3:53:37,  3.35it/s]
 87%|████████▋ | 324456/371472 [3:38:31<3:40:32,  3.55it/s]
 87%|████████▋ | 324457/371472 [3:38:32<3:57:11,  3.30it/s]
 87%|████████▋ | 324458/371472 [3:38:32<4:02:37,  3.23it/s]
 87%|████████▋ | 324459/371472 [3:38:32<3:58:29,  3.29it/s]
 87%|████████▋ | 324460/371472 [3:38:33<3:53:36,  3.35it/s]
                                                           
{'loss': 2.5451, 'learning_rate': 2.139617315606887e-07, 'epoch': 13.98}

 87%|████████▋ | 324460/371472 [3:38:33<3:53:36,  3.35it/s]
 87%|████████▋ | 324461/371472 [3:38:33<3:46:17,  3.46it/s]
 87%|████████▋ | 324462/371472 [3:38:33<3:40:56,  3.55it/s]
 87%|████████▋ | 324463/371472 [3:38:33<3:34:19,  3.66it/s]
 87%|████████▋ | 324464/371472 [3:38:34<3:37:06,  3.61it/s]
 87%|████████▋ | 324465/371472 [3:38:34<3:33:34,  3.67it/s]
 87%|████████▋ | 324466/371472 [3:38:34<3:40:10,  3.56it/s]
 87%|████████▋ | 324467/371472 [3:38:34<3:31:58,  3.70it/s]
 87%|████████▋ | 324468/371472 [3:38:35<3:23:49,  3.84it/s]
 87%|████████▋ | 324469/371472 [3:38:35<3:21:31,  3.89it/s]
 87%|████████▋ | 324470/371472 [3:38:35<3:29:09,  3.75it/s]
 87%|████████▋ | 324471/371472 [3:38:36<3:29:30,  3.74it/s]
 87%|████████▋ | 324472/371472 [3:38:36<3:33:22,  3.67it/s]
 87%|████████▋ | 324473/371472 [3:38:36<3:40:03,  3.56it/s]
 87%|████████▋ | 324474/371472 [3:38:36<3:37:50,  3.60it/s]
 87%|████████▋ | 324475/371472 [3:38:37<3:49:57,  3.41it/s]
 87%|████████▋ | 324476/371472 [3:38:37<3:41:44,  3.53it/s]
 87%|████████▋ | 324477/371472 [3:38:37<3:34:28,  3.65it/s]
 87%|████████▋ | 324478/371472 [3:38:38<3:33:57,  3.66it/s]
 87%|████████▋ | 324479/371472 [3:38:38<3:32:59,  3.68it/s]
 87%|████████▋ | 324480/371472 [3:38:38<3:23:21,  3.85it/s]
                                                           
{'loss': 2.5748, 'learning_rate': 2.1391324958520974e-07, 'epoch': 13.98}

 87%|████████▋ | 324480/371472 [3:38:38<3:23:21,  3.85it/s]
 87%|████████▋ | 324481/371472 [3:38:38<3:27:38,  3.77it/s]
 87%|████████▋ | 324482/371472 [3:38:39<3:32:43,  3.68it/s]
 87%|████████▋ | 324483/371472 [3:38:39<3:31:58,  3.69it/s]
 87%|████████▋ | 324484/371472 [3:38:39<3:29:47,  3.73it/s]
 87%|████████▋ | 324485/371472 [3:38:40<4:01:17,  3.25it/s]
 87%|████████▋ | 324486/371472 [3:38:40<4:04:56,  3.20it/s]
 87%|████████▋ | 324487/371472 [3:38:40<3:52:27,  3.37it/s]
 87%|████████▋ | 324488/371472 [3:38:40<3:48:01,  3.43it/s]
 87%|████████▋ | 324489/371472 [3:38:41<3:55:18,  3.33it/s]
 87%|████████▋ | 324490/371472 [3:38:41<3:40:44,  3.55it/s]
 87%|████████▋ | 324491/371472 [3:38:41<3:36:04,  3.62it/s]
 87%|████████▋ | 324492/371472 [3:38:41<3:35:03,  3.64it/s]
 87%|████████▋ | 324493/371472 [3:38:42<3:30:58,  3.71it/s]
 87%|████████▋ | 324494/371472 [3:38:42<3:36:30,  3.62it/s]
 87%|████████▋ | 324495/371472 [3:38:42<3:31:24,  3.70it/s]
 87%|████████▋ | 324496/371472 [3:38:43<3:30:49,  3.71it/s]
 87%|████████▋ | 324497/371472 [3:38:43<3:35:22,  3.64it/s]
 87%|████████▋ | 324498/371472 [3:38:43<3:54:55,  3.33it/s]
 87%|████████▋ | 324499/371472 [3:38:43<3:47:34,  3.44it/s]
 87%|████████▋ | 324500/371472 [3:38:44<3:46:15,  3.46it/s]
                                                           
{'loss': 2.7825, 'learning_rate': 2.1386476760973078e-07, 'epoch': 13.98}

 87%|████████▋ | 324500/371472 [3:38:44<3:46:15,  3.46it/s]
 87%|████████▋ | 324501/371472 [3:38:44<3:45:14,  3.48it/s]
 87%|████████▋ | 324502/371472 [3:38:44<3:43:34,  3.50it/s]
 87%|████████▋ | 324503/371472 [3:38:45<3:49:09,  3.42it/s]
 87%|████████▋ | 324504/371472 [3:38:45<4:03:46,  3.21it/s]
 87%|████████▋ | 324505/371472 [3:38:45<4:15:44,  3.06it/s]
 87%|████████▋ | 324506/371472 [3:38:46<4:15:04,  3.07it/s]
 87%|████████▋ | 324507/371472 [3:38:46<4:04:23,  3.20it/s]
 87%|████████▋ | 324508/371472 [3:38:46<4:02:23,  3.23it/s]
 87%|████████▋ | 324509/371472 [3:38:46<3:52:34,  3.37it/s]
 87%|████████▋ | 324510/371472 [3:38:47<3:45:09,  3.48it/s]
 87%|████████▋ | 324511/371472 [3:38:47<3:43:17,  3.51it/s]
 87%|████████▋ | 324512/371472 [3:38:47<3:34:24,  3.65it/s]
 87%|████████▋ | 324513/371472 [3:38:48<3:29:09,  3.74it/s]
 87%|████████▋ | 324514/371472 [3:38:48<3:27:59,  3.76it/s]
 87%|████████▋ | 324515/371472 [3:38:48<3:30:59,  3.71it/s]
 87%|████████▋ | 324516/371472 [3:38:48<3:36:53,  3.61it/s]
 87%|████████▋ | 324517/371472 [3:38:49<3:33:54,  3.66it/s]
 87%|████████▋ | 324518/371472 [3:38:49<3:47:56,  3.43it/s]
 87%|████████▋ | 324519/371472 [3:38:49<3:59:28,  3.27it/s]
 87%|████████▋ | 324520/371472 [3:38:50<4:06:11,  3.18it/s]
                                                           
{'loss': 2.5972, 'learning_rate': 2.1381628563425199e-07, 'epoch': 13.98}

 87%|████████▋ | 324520/371472 [3:38:50<4:06:11,  3.18it/s]
 87%|████████▋ | 324521/371472 [3:38:50<4:02:27,  3.23it/s]
 87%|████████▋ | 324522/371472 [3:38:50<3:55:59,  3.32it/s]
 87%|████████▋ | 324523/371472 [3:38:51<3:54:07,  3.34it/s]
 87%|████████▋ | 324524/371472 [3:38:51<3:47:47,  3.44it/s]
 87%|████████▋ | 324525/371472 [3:38:51<3:55:43,  3.32it/s]
 87%|████████▋ | 324526/371472 [3:38:51<3:42:21,  3.52it/s]
 87%|████████▋ | 324527/371472 [3:38:52<3:36:01,  3.62it/s]
 87%|████████▋ | 324528/371472 [3:38:52<3:32:21,  3.68it/s]
 87%|████████▋ | 324529/371472 [3:38:52<3:29:40,  3.73it/s]
 87%|████████▋ | 324530/371472 [3:38:52<3:25:24,  3.81it/s]
 87%|████████▋ | 324531/371472 [3:38:53<3:22:01,  3.87it/s]
 87%|████████▋ | 324532/371472 [3:38:53<3:34:26,  3.65it/s]
 87%|████████▋ | 324533/371472 [3:38:53<3:34:37,  3.64it/s]
 87%|████████▋ | 324534/371472 [3:38:54<3:39:14,  3.57it/s]
 87%|████████▋ | 324535/371472 [3:38:54<3:32:42,  3.68it/s]
 87%|████████▋ | 324536/371472 [3:38:54<3:28:48,  3.75it/s]
 87%|████████▋ | 324537/371472 [3:38:54<3:28:30,  3.75it/s]
 87%|████████▋ | 324538/371472 [3:38:55<3:28:56,  3.74it/s]
 87%|████████▋ | 324539/371472 [3:38:55<3:26:50,  3.78it/s]
 87%|████████▋ | 324540/371472 [3:38:55<3:26:51,  3.78it/s]
                                                           
{'loss': 2.7476, 'learning_rate': 2.1376780365877303e-07, 'epoch': 13.98}

 87%|████████▋ | 324540/371472 [3:38:55<3:26:51,  3.78it/s]
 87%|████████▋ | 324541/371472 [3:38:55<3:25:36,  3.80it/s]
 87%|████████▋ | 324542/371472 [3:38:56<3:31:38,  3.70it/s]
 87%|████████▋ | 324543/371472 [3:38:56<3:50:59,  3.39it/s]
 87%|████████▋ | 324544/371472 [3:38:56<3:48:46,  3.42it/s]
 87%|████████▋ | 324545/371472 [3:38:57<3:53:49,  3.34it/s]
 87%|████████▋ | 324546/371472 [3:38:57<3:51:20,  3.38it/s]
 87%|████████▋ | 324547/371472 [3:38:57<3:47:56,  3.43it/s]
 87%|████████▋ | 324548/371472 [3:38:57<3:44:46,  3.48it/s]
 87%|████████▋ | 324549/371472 [3:38:58<3:37:44,  3.59it/s]
 87%|████████▋ | 324550/371472 [3:38:58<3:41:32,  3.53it/s]
 87%|████████▋ | 324551/371472 [3:38:58<3:33:19,  3.67it/s]
 87%|████████▋ | 324552/371472 [3:38:59<3:40:22,  3.55it/s]
 87%|████████▋ | 324553/371472 [3:38:59<3:38:37,  3.58it/s]
 87%|████████▋ | 324554/371472 [3:38:59<3:42:32,  3.51it/s]
 87%|████████▋ | 324555/371472 [3:38:59<3:44:14,  3.49it/s]
 87%|████████▋ | 324556/371472 [3:39:00<3:43:38,  3.50it/s]
 87%|████████▋ | 324557/371472 [3:39:00<3:46:34,  3.45it/s]
 87%|████████▋ | 324558/371472 [3:39:00<3:41:23,  3.53it/s]
 87%|████████▋ | 324559/371472 [3:39:01<3:40:30,  3.55it/s]
 87%|████████▋ | 324560/371472 [3:39:01<3:32:47,  3.67it/s]
                                                           
{'loss': 2.6723, 'learning_rate': 2.1371932168329418e-07, 'epoch': 13.98}

 87%|████████▋ | 324560/371472 [3:39:01<3:32:47,  3.67it/s]
 87%|████████▋ | 324561/371472 [3:39:01<3:38:46,  3.57it/s]
 87%|████████▋ | 324562/371472 [3:39:01<3:51:59,  3.37it/s]
 87%|████████▋ | 324563/371472 [3:39:02<3:40:03,  3.55it/s]
 87%|████████▋ | 324564/371472 [3:39:02<3:44:36,  3.48it/s]
 87%|████████▋ | 324565/371472 [3:39:02<3:37:57,  3.59it/s]
 87%|████████▋ | 324566/371472 [3:39:03<3:51:20,  3.38it/s]
 87%|████████▋ | 324567/371472 [3:39:03<3:40:50,  3.54it/s]
 87%|████████▋ | 324568/371472 [3:39:03<3:44:22,  3.48it/s]
 87%|████████▋ | 324569/371472 [3:39:03<3:38:53,  3.57it/s]
 87%|████████▋ | 324570/371472 [3:39:04<3:35:55,  3.62it/s]
 87%|████████▋ | 324571/371472 [3:39:04<3:30:53,  3.71it/s]
 87%|████████▋ | 324572/371472 [3:39:04<3:32:32,  3.68it/s]
 87%|████████▋ | 324573/371472 [3:39:04<3:24:15,  3.83it/s]
 87%|████████▋ | 324574/371472 [3:39:05<3:18:55,  3.93it/s]
 87%|████████▋ | 324575/371472 [3:39:05<3:22:20,  3.86it/s]
 87%|████████▋ | 324576/371472 [3:39:05<3:32:47,  3.67it/s]
 87%|████████▋ | 324577/371472 [3:39:05<3:30:10,  3.72it/s]
 87%|████████▋ | 324578/371472 [3:39:06<4:09:01,  3.14it/s]
 87%|████████▋ | 324579/371472 [3:39:06<4:08:05,  3.15it/s]
 87%|████████▋ | 324580/371472 [3:39:07<4:03:18,  3.21it/s]
                                                           
{'loss': 2.5598, 'learning_rate': 2.1367083970781525e-07, 'epoch': 13.98}

 87%|████████▋ | 324580/371472 [3:39:07<4:03:18,  3.21it/s]
 87%|████████▋ | 324581/371472 [3:39:07<4:05:55,  3.18it/s]
 87%|████████▋ | 324582/371472 [3:39:07<4:00:21,  3.25it/s]
 87%|████████▋ | 324583/371472 [3:39:07<3:47:07,  3.44it/s]
 87%|████████▋ | 324584/371472 [3:39:08<3:44:54,  3.47it/s]
 87%|████████▋ | 324585/371472 [3:39:08<3:55:30,  3.32it/s]
 87%|████████▋ | 324586/371472 [3:39:08<3:47:55,  3.43it/s]
 87%|████████▋ | 324587/371472 [3:39:09<3:44:50,  3.48it/s]
 87%|████████▋ | 324588/371472 [3:39:09<3:35:46,  3.62it/s]
 87%|████████▋ | 324589/371472 [3:39:09<3:46:24,  3.45it/s]
 87%|████████▋ | 324590/371472 [3:39:09<3:38:46,  3.57it/s]
 87%|████████▋ | 324591/371472 [3:39:10<3:31:23,  3.70it/s]
 87%|████████▋ | 324592/371472 [3:39:10<3:48:41,  3.42it/s]
 87%|████████▋ | 324593/371472 [3:39:10<3:52:38,  3.36it/s]
 87%|████████▋ | 324594/371472 [3:39:11<3:46:08,  3.46it/s]
 87%|████████▋ | 324595/371472 [3:39:11<3:54:20,  3.33it/s]
 87%|████████▋ | 324596/371472 [3:39:11<4:02:44,  3.22it/s]
 87%|████████▋ | 324597/371472 [3:39:11<3:50:38,  3.39it/s]
 87%|████████▋ | 324598/371472 [3:39:12<3:36:02,  3.62it/s]
 87%|████████▋ | 324599/371472 [3:39:12<3:47:51,  3.43it/s]
 87%|████████▋ | 324600/371472 [3:39:12<3:36:33,  3.61it/s]
                                                           
{'loss': 2.5914, 'learning_rate': 2.136223577323364e-07, 'epoch': 13.98}

 87%|████████▋ | 324600/371472 [3:39:12<3:36:33,  3.61it/s]
 87%|████████▋ | 324601/371472 [3:39:13<3:29:22,  3.73it/s]
 87%|████████▋ | 324602/371472 [3:39:13<3:30:15,  3.72it/s]
 87%|████████▋ | 324603/371472 [3:39:13<3:37:09,  3.60it/s]
 87%|████████▋ | 324604/371472 [3:39:13<3:32:15,  3.68it/s]
 87%|████████▋ | 324605/371472 [3:39:14<3:38:13,  3.58it/s]
 87%|████████▋ | 324606/371472 [3:39:14<3:41:49,  3.52it/s]
 87%|████████▋ | 324607/371472 [3:39:14<3:54:50,  3.33it/s]
 87%|████████▋ | 324608/371472 [3:39:15<3:45:45,  3.46it/s]
 87%|████████▋ | 324609/371472 [3:39:15<3:38:02,  3.58it/s]
 87%|████████▋ | 324610/371472 [3:39:15<3:43:49,  3.49it/s]
 87%|████████▋ | 324611/371472 [3:39:15<3:55:41,  3.31it/s]
 87%|████████▋ | 324612/371472 [3:39:16<3:58:22,  3.28it/s]
 87%|████████▋ | 324613/371472 [3:39:16<3:53:30,  3.34it/s]
 87%|████████▋ | 324614/371472 [3:39:16<3:49:39,  3.40it/s]
 87%|████████▋ | 324615/371472 [3:39:17<3:38:14,  3.58it/s]
 87%|████████▋ | 324616/371472 [3:39:17<3:37:26,  3.59it/s]
 87%|████████▋ | 324617/371472 [3:39:17<3:36:50,  3.60it/s]
 87%|████████▋ | 324618/371472 [3:39:17<3:39:15,  3.56it/s]
 87%|████████▋ | 324619/371472 [3:39:18<3:38:39,  3.57it/s]
 87%|████████▋ | 324620/371472 [3:39:18<3:28:10,  3.75it/s]
                                                           
{'loss': 2.694, 'learning_rate': 2.1357387575685745e-07, 'epoch': 13.98}

 87%|████████▋ | 324620/371472 [3:39:18<3:28:10,  3.75it/s]
 87%|████████▋ | 324621/371472 [3:39:18<3:46:40,  3.44it/s]
 87%|████████▋ | 324622/371472 [3:39:19<3:56:57,  3.30it/s]
 87%|████████▋ | 324623/371472 [3:39:19<4:01:26,  3.23it/s]
 87%|████████▋ | 324624/371472 [3:39:19<3:51:49,  3.37it/s]
 87%|████████▋ | 324625/371472 [3:39:19<3:41:10,  3.53it/s]
 87%|████████▋ | 324626/371472 [3:39:20<3:38:01,  3.58it/s]
 87%|████████▋ | 324627/371472 [3:39:20<3:35:13,  3.63it/s]
 87%|████████▋ | 324628/371472 [3:39:20<3:40:25,  3.54it/s]
 87%|████████▋ | 324629/371472 [3:39:21<3:47:16,  3.44it/s]
 87%|████████▋ | 324630/371472 [3:39:21<3:51:13,  3.38it/s]
 87%|████████▋ | 324631/371472 [3:39:21<3:57:51,  3.28it/s]
 87%|████████▋ | 324632/371472 [3:39:22<4:00:47,  3.24it/s]
 87%|████████▋ | 324633/371472 [3:39:22<3:47:58,  3.42it/s]
 87%|████████▋ | 324634/371472 [3:39:22<3:45:37,  3.46it/s]
 87%|████████▋ | 324635/371472 [3:39:22<3:46:17,  3.45it/s]
 87%|████████▋ | 324636/371472 [3:39:23<3:43:29,  3.49it/s]
 87%|████████▋ | 324637/371472 [3:39:23<3:36:46,  3.60it/s]
 87%|████████▋ | 324638/371472 [3:39:23<3:30:44,  3.70it/s]
 87%|████████▋ | 324639/371472 [3:39:23<3:32:19,  3.68it/s]
 87%|████████▋ | 324640/371472 [3:39:24<3:37:38,  3.59it/s]
                                                           
{'loss': 2.6578, 'learning_rate': 2.1352539378137863e-07, 'epoch': 13.98}

 87%|████████▋ | 324640/371472 [3:39:24<3:37:38,  3.59it/s]
 87%|████████▋ | 324641/371472 [3:39:24<3:43:55,  3.49it/s]
 87%|████████▋ | 324642/371472 [3:39:24<3:37:44,  3.58it/s]
 87%|████████▋ | 324643/371472 [3:39:25<3:33:44,  3.65it/s]
 87%|████████▋ | 324644/371472 [3:39:25<3:41:59,  3.52it/s]
 87%|████████▋ | 324645/371472 [3:39:25<3:33:54,  3.65it/s]
 87%|████████▋ | 324646/371472 [3:39:25<3:34:41,  3.64it/s]
 87%|████████▋ | 324647/371472 [3:39:26<3:32:21,  3.68it/s]
 87%|████████▋ | 324648/371472 [3:39:26<3:30:18,  3.71it/s]
 87%|████████▋ | 324649/371472 [3:39:26<3:30:43,  3.70it/s]
 87%|████████▋ | 324650/371472 [3:39:27<3:47:20,  3.43it/s]
 87%|████████▋ | 324651/371472 [3:39:27<3:44:05,  3.48it/s]
 87%|████████▋ | 324652/371472 [3:39:27<3:40:19,  3.54it/s]
 87%|████████▋ | 324653/371472 [3:39:27<3:37:27,  3.59it/s]
 87%|████████▋ | 324654/371472 [3:39:28<3:53:11,  3.35it/s]
 87%|████████▋ | 324655/371472 [3:39:28<3:48:37,  3.41it/s]
 87%|████████▋ | 324656/371472 [3:39:28<4:10:19,  3.12it/s]
 87%|████████▋ | 324657/371472 [3:39:29<4:01:24,  3.23it/s]
 87%|████████▋ | 324658/371472 [3:39:29<3:51:11,  3.37it/s]
 87%|████████▋ | 324659/371472 [3:39:29<3:44:48,  3.47it/s]
 87%|████████▋ | 324660/371472 [3:39:30<4:11:30,  3.10it/s]
                                                           
{'loss': 2.6574, 'learning_rate': 2.1347691180589967e-07, 'epoch': 13.98}

 87%|████████▋ | 324660/371472 [3:39:30<4:11:30,  3.10it/s]
 87%|████████▋ | 324661/371472 [3:39:30<4:10:15,  3.12it/s]
 87%|████████▋ | 324662/371472 [3:39:30<4:16:41,  3.04it/s]
 87%|████████▋ | 324663/371472 [3:39:30<3:58:19,  3.27it/s]
 87%|████████▋ | 324664/371472 [3:39:31<3:51:55,  3.36it/s]
 87%|████████▋ | 324665/371472 [3:39:31<3:42:43,  3.50it/s]
 87%|████████▋ | 324666/371472 [3:39:31<4:01:38,  3.23it/s]
 87%|████████▋ | 324667/371472 [3:39:32<3:48:00,  3.42it/s]
 87%|████████▋ | 324668/371472 [3:39:32<3:36:38,  3.60it/s]
 87%|████████▋ | 324669/371472 [3:39:32<3:30:16,  3.71it/s]
 87%|████████▋ | 324670/371472 [3:39:32<3:39:02,  3.56it/s]
 87%|████████▋ | 324671/371472 [3:39:33<3:47:45,  3.42it/s]
 87%|████████▋ | 324672/371472 [3:39:33<3:42:05,  3.51it/s]
 87%|████████▋ | 324673/371472 [3:39:33<3:52:09,  3.36it/s]
 87%|████████▋ | 324674/371472 [3:39:34<3:45:22,  3.46it/s]
 87%|████████▋ | 324675/371472 [3:39:34<3:42:25,  3.51it/s]
 87%|████████▋ | 324676/371472 [3:39:34<3:42:24,  3.51it/s]
 87%|████████▋ | 324677/371472 [3:39:34<3:38:27,  3.57it/s]
 87%|████████▋ | 324678/371472 [3:39:35<3:34:57,  3.63it/s]
 87%|████████▋ | 324679/371472 [3:39:35<3:32:44,  3.67it/s]
 87%|████████▋ | 324680/371472 [3:39:35<3:37:53,  3.58it/s]
                                                           
{'loss': 2.6636, 'learning_rate': 2.1342842983042085e-07, 'epoch': 13.98}

 87%|████████▋ | 324680/371472 [3:39:35<3:37:53,  3.58it/s]
 87%|████████▋ | 324681/371472 [3:39:36<3:37:35,  3.58it/s]
 87%|████████▋ | 324682/371472 [3:39:36<3:33:01,  3.66it/s]
 87%|████████▋ | 324683/371472 [3:39:36<3:41:40,  3.52it/s]
 87%|████████▋ | 324684/371472 [3:39:36<3:43:36,  3.49it/s]
 87%|████████▋ | 324685/371472 [3:39:37<3:43:18,  3.49it/s]
 87%|████████▋ | 324686/371472 [3:39:37<3:38:46,  3.56it/s]
 87%|████████▋ | 324687/371472 [3:39:37<3:48:24,  3.41it/s]
 87%|████████▋ | 324688/371472 [3:39:38<3:45:42,  3.45it/s]
 87%|████████▋ | 324689/371472 [3:39:38<3:39:38,  3.55it/s]
 87%|████████▋ | 324690/371472 [3:39:38<3:38:57,  3.56it/s]
 87%|████████▋ | 324691/371472 [3:39:38<3:32:54,  3.66it/s]
 87%|████████▋ | 324692/371472 [3:39:39<3:30:15,  3.71it/s]
 87%|████████▋ | 324693/371472 [3:39:39<3:28:52,  3.73it/s]
 87%|████████▋ | 324694/371472 [3:39:39<3:32:59,  3.66it/s]
 87%|████████▋ | 324695/371472 [3:39:39<3:35:55,  3.61it/s]
 87%|████████▋ | 324696/371472 [3:39:40<3:35:40,  3.61it/s]
 87%|████████▋ | 324697/371472 [3:39:40<3:44:57,  3.47it/s]
 87%|████████▋ | 324698/371472 [3:39:40<3:31:45,  3.68it/s]
 87%|████████▋ | 324699/371472 [3:39:41<3:31:59,  3.68it/s]
 87%|████████▋ | 324700/371472 [3:39:41<3:27:40,  3.75it/s]
                                                           
{'loss': 2.5429, 'learning_rate': 2.133799478549419e-07, 'epoch': 13.99}

 87%|████████▋ | 324700/371472 [3:39:41<3:27:40,  3.75it/s]
 87%|████████▋ | 324701/371472 [3:39:41<3:27:22,  3.76it/s]
 87%|████████▋ | 324702/371472 [3:39:41<3:27:06,  3.76it/s]
 87%|████████▋ | 324703/371472 [3:39:42<3:28:34,  3.74it/s]
 87%|████████▋ | 324704/371472 [3:39:42<3:28:12,  3.74it/s]
 87%|████████▋ | 324705/371472 [3:39:42<3:36:25,  3.60it/s]
 87%|████████▋ | 324706/371472 [3:39:42<3:35:01,  3.62it/s]
 87%|████████▋ | 324707/371472 [3:39:43<3:40:19,  3.54it/s]
 87%|████████▋ | 324708/371472 [3:39:43<3:48:49,  3.41it/s]
 87%|████████▋ | 324709/371472 [3:39:43<3:41:26,  3.52it/s]
 87%|████████▋ | 324710/371472 [3:39:44<3:38:55,  3.56it/s]
 87%|████████▋ | 324711/371472 [3:39:44<3:32:21,  3.67it/s]
 87%|████████▋ | 324712/371472 [3:39:44<3:34:09,  3.64it/s]
 87%|████████▋ | 324713/371472 [3:39:45<3:52:16,  3.36it/s]
 87%|████████▋ | 324714/371472 [3:39:45<3:37:24,  3.58it/s]
 87%|████████▋ | 324715/371472 [3:39:45<3:45:08,  3.46it/s]
 87%|████████▋ | 324716/371472 [3:39:45<3:51:16,  3.37it/s]
 87%|████████▋ | 324717/371472 [3:39:46<3:49:23,  3.40it/s]
 87%|████████▋ | 324718/371472 [3:39:46<3:53:32,  3.34it/s]
 87%|████████▋ | 324719/371472 [3:39:46<4:02:10,  3.22it/s]
 87%|████████▋ | 324720/371472 [3:39:47<4:01:57,  3.22it/s]
                                                           
{'loss': 2.6734, 'learning_rate': 2.1333146587946305e-07, 'epoch': 13.99}

 87%|████████▋ | 324720/371472 [3:39:47<4:01:57,  3.22it/s]
 87%|████████▋ | 324721/371472 [3:39:47<4:02:45,  3.21it/s]
 87%|████████▋ | 324722/371472 [3:39:47<3:59:23,  3.25it/s]
 87%|████████▋ | 324723/371472 [3:39:47<3:43:16,  3.49it/s]
 87%|████████▋ | 324724/371472 [3:39:48<3:36:28,  3.60it/s]
 87%|████████▋ | 324725/371472 [3:39:48<3:33:11,  3.65it/s]
 87%|████████▋ | 324726/371472 [3:39:48<3:30:59,  3.69it/s]
 87%|████████▋ | 324727/371472 [3:39:49<3:29:29,  3.72it/s]
 87%|████████▋ | 324728/371472 [3:39:49<3:37:33,  3.58it/s]
 87%|████████▋ | 324729/371472 [3:39:49<3:35:04,  3.62it/s]
 87%|████████▋ | 324730/371472 [3:39:49<3:35:45,  3.61it/s]
 87%|████████▋ | 324731/371472 [3:39:50<3:34:37,  3.63it/s]
 87%|████████▋ | 324732/371472 [3:39:50<3:39:55,  3.54it/s]
 87%|████████▋ | 324733/371472 [3:39:50<3:33:16,  3.65it/s]
 87%|████████▋ | 324734/371472 [3:39:50<3:39:37,  3.55it/s]
 87%|████████▋ | 324735/371472 [3:39:51<3:39:28,  3.55it/s]
 87%|████████▋ | 324736/371472 [3:39:51<3:35:44,  3.61it/s]
 87%|████████▋ | 324737/371472 [3:39:51<3:39:25,  3.55it/s]
 87%|████████▋ | 324738/371472 [3:39:52<3:33:59,  3.64it/s]
 87%|████████▋ | 324739/371472 [3:39:52<3:39:33,  3.55it/s]
 87%|████████▋ | 324740/371472 [3:39:52<3:41:34,  3.52it/s]
                                                           
{'loss': 2.7199, 'learning_rate': 2.132829839039841e-07, 'epoch': 13.99}

 87%|████████▋ | 324740/371472 [3:39:52<3:41:34,  3.52it/s]
 87%|████████▋ | 324741/371472 [3:39:52<3:47:29,  3.42it/s]
 87%|████████▋ | 324742/371472 [3:39:53<3:50:32,  3.38it/s]
 87%|████████▋ | 324743/371472 [3:39:53<3:45:50,  3.45it/s]
 87%|████████▋ | 324744/371472 [3:39:53<3:49:29,  3.39it/s]
 87%|████████▋ | 324745/371472 [3:39:54<3:36:39,  3.59it/s]
 87%|████████▋ | 324746/371472 [3:39:54<3:38:06,  3.57it/s]
 87%|████████▋ | 324747/371472 [3:39:54<3:29:42,  3.71it/s]
 87%|████████▋ | 324748/371472 [3:39:54<3:28:51,  3.73it/s]
 87%|████████▋ | 324749/371472 [3:39:55<3:29:31,  3.72it/s]
 87%|████████▋ | 324750/371472 [3:39:55<3:35:00,  3.62it/s]
 87%|████████▋ | 324751/371472 [3:39:55<3:43:01,  3.49it/s]
 87%|████████▋ | 324752/371472 [3:39:56<3:47:03,  3.43it/s]
 87%|████████▋ | 324753/371472 [3:39:56<3:45:30,  3.45it/s]
 87%|████████▋ | 324754/371472 [3:39:56<3:55:28,  3.31it/s]
 87%|████████▋ | 324755/371472 [3:39:56<3:52:31,  3.35it/s]
 87%|████████▋ | 324756/371472 [3:39:57<3:55:14,  3.31it/s]
 87%|████████▋ | 324757/371472 [3:39:57<3:51:30,  3.36it/s]
 87%|████████▋ | 324758/371472 [3:39:57<3:43:39,  3.48it/s]
 87%|████████▋ | 324759/371472 [3:39:58<3:38:53,  3.56it/s]
 87%|████████▋ | 324760/371472 [3:39:58<3:42:17,  3.50it/s]
                                                           
{'loss': 2.7304, 'learning_rate': 2.1323450192850527e-07, 'epoch': 13.99}

 87%|████████▋ | 324760/371472 [3:39:58<3:42:17,  3.50it/s]
 87%|████████▋ | 324761/371472 [3:39:58<3:53:01,  3.34it/s]
 87%|████████▋ | 324762/371472 [3:39:59<3:46:06,  3.44it/s]
 87%|████████▋ | 324763/371472 [3:39:59<3:49:46,  3.39it/s]
 87%|████████▋ | 324764/371472 [3:39:59<3:44:34,  3.47it/s]
 87%|████████▋ | 324765/371472 [3:39:59<3:36:43,  3.59it/s]
 87%|████████▋ | 324766/371472 [3:40:00<3:39:20,  3.55it/s]
 87%|████████▋ | 324767/371472 [3:40:00<3:39:37,  3.54it/s]
 87%|████████▋ | 324768/371472 [3:40:00<3:41:59,  3.51it/s]
 87%|████████▋ | 324769/371472 [3:40:00<3:36:50,  3.59it/s]
 87%|████████▋ | 324770/371472 [3:40:01<3:39:57,  3.54it/s]
 87%|████████▋ | 324771/371472 [3:40:01<3:35:31,  3.61it/s]
 87%|████████▋ | 324772/371472 [3:40:01<3:31:55,  3.67it/s]
 87%|████████▋ | 324773/371472 [3:40:02<3:30:26,  3.70it/s]
 87%|████████▋ | 324774/371472 [3:40:02<3:26:09,  3.78it/s]
 87%|████████▋ | 324775/371472 [3:40:02<3:25:03,  3.80it/s]
 87%|████████▋ | 324776/371472 [3:40:02<3:21:19,  3.87it/s]
 87%|████████▋ | 324777/371472 [3:40:03<3:28:12,  3.74it/s]
 87%|████████▋ | 324778/371472 [3:40:03<3:27:54,  3.74it/s]
 87%|████████▋ | 324779/371472 [3:40:03<3:55:26,  3.31it/s]
 87%|████████▋ | 324780/371472 [3:40:04<3:51:51,  3.36it/s]
                                                           
{'loss': 2.6436, 'learning_rate': 2.1318601995302634e-07, 'epoch': 13.99}

 87%|████████▋ | 324780/371472 [3:40:04<3:51:51,  3.36it/s]
 87%|████████▋ | 324781/371472 [3:40:04<3:57:16,  3.28it/s]
 87%|████████▋ | 324782/371472 [3:40:04<3:50:57,  3.37it/s]
 87%|████████▋ | 324783/371472 [3:40:04<3:47:58,  3.41it/s]
 87%|████████▋ | 324784/371472 [3:40:05<3:34:37,  3.63it/s]
 87%|████████▋ | 324785/371472 [3:40:05<3:36:31,  3.59it/s]
 87%|████████▋ | 324786/371472 [3:40:05<3:46:14,  3.44it/s]
 87%|████████▋ | 324787/371472 [3:40:06<3:48:52,  3.40it/s]
 87%|████████▋ | 324788/371472 [3:40:06<3:35:37,  3.61it/s]
 87%|████████▋ | 324789/371472 [3:40:06<3:42:54,  3.49it/s]
 87%|████████▋ | 324790/371472 [3:40:06<3:42:46,  3.49it/s]
 87%|████████▋ | 324791/371472 [3:40:07<3:33:25,  3.65it/s]
 87%|████████▋ | 324792/371472 [3:40:07<3:38:08,  3.57it/s]
 87%|████████▋ | 324793/371472 [3:40:07<3:39:28,  3.54it/s]
 87%|████████▋ | 324794/371472 [3:40:08<3:37:01,  3.58it/s]
 87%|████████▋ | 324795/371472 [3:40:08<3:44:04,  3.47it/s]
 87%|████████▋ | 324796/371472 [3:40:08<3:36:31,  3.59it/s]
 87%|████████▋ | 324797/371472 [3:40:08<3:46:23,  3.44it/s]
 87%|████████▋ | 324798/371472 [3:40:09<3:53:46,  3.33it/s]
 87%|████████▋ | 324799/371472 [3:40:09<3:45:19,  3.45it/s]
 87%|████████▋ | 324800/371472 [3:40:09<3:52:12,  3.35it/s]
                                                           
{'loss': 2.5286, 'learning_rate': 2.1313753797754746e-07, 'epoch': 13.99}

 87%|████████▋ | 324800/371472 [3:40:09<3:52:12,  3.35it/s]
 87%|████████▋ | 324801/371472 [3:40:10<3:53:17,  3.33it/s]
 87%|████████▋ | 324802/371472 [3:40:10<3:44:58,  3.46it/s]
 87%|████████▋ | 324803/371472 [3:40:10<3:58:19,  3.26it/s]
 87%|████████▋ | 324804/371472 [3:40:10<3:46:05,  3.44it/s]
 87%|████████▋ | 324805/371472 [3:40:11<3:40:44,  3.52it/s]
 87%|████████▋ | 324806/371472 [3:40:11<3:35:31,  3.61it/s]
 87%|████████▋ | 324807/371472 [3:40:11<3:46:39,  3.43it/s]
 87%|████████▋ | 324808/371472 [3:40:12<3:48:52,  3.40it/s]
 87%|████████▋ | 324809/371472 [3:40:12<3:44:21,  3.47it/s]
 87%|████████▋ | 324810/371472 [3:40:12<3:35:56,  3.60it/s]
 87%|████████▋ | 324811/371472 [3:40:12<3:33:32,  3.64it/s]
 87%|████████▋ | 324812/371472 [3:40:13<3:32:53,  3.65it/s]
 87%|████████▋ | 324813/371472 [3:40:13<3:28:40,  3.73it/s]
 87%|████████▋ | 324814/371472 [3:40:13<3:20:23,  3.88it/s]
 87%|████████▋ | 324815/371472 [3:40:13<3:22:48,  3.83it/s]
 87%|████████▋ | 324816/371472 [3:40:14<3:24:39,  3.80it/s]
 87%|████████▋ | 324817/371472 [3:40:14<3:25:14,  3.79it/s]
 87%|████████▋ | 324818/371472 [3:40:14<3:22:45,  3.83it/s]
 87%|████████▋ | 324819/371472 [3:40:15<3:30:39,  3.69it/s]
 87%|████████▋ | 324820/371472 [3:40:15<3:23:50,  3.81it/s]
                                                           
{'loss': 2.6289, 'learning_rate': 2.1308905600206854e-07, 'epoch': 13.99}

 87%|████████▋ | 324820/371472 [3:40:15<3:23:50,  3.81it/s]
 87%|████████▋ | 324821/371472 [3:40:15<3:44:50,  3.46it/s]
 87%|████████▋ | 324822/371472 [3:40:15<3:41:41,  3.51it/s]
 87%|████████▋ | 324823/371472 [3:40:16<3:33:47,  3.64it/s]
 87%|████████▋ | 324824/371472 [3:40:16<3:28:42,  3.73it/s]
 87%|████████▋ | 324825/371472 [3:40:16<3:34:11,  3.63it/s]
 87%|████████▋ | 324826/371472 [3:40:16<3:30:29,  3.69it/s]
 87%|████████▋ | 324827/371472 [3:40:17<3:26:21,  3.77it/s]
 87%|████████▋ | 324828/371472 [3:40:17<3:34:18,  3.63it/s]
 87%|████████▋ | 324829/371472 [3:40:17<3:34:01,  3.63it/s]
 87%|████████▋ | 324830/371472 [3:40:18<3:29:20,  3.71it/s]
 87%|████████▋ | 324831/371472 [3:40:18<3:28:49,  3.72it/s]
 87%|████████▋ | 324832/371472 [3:40:18<3:27:42,  3.74it/s]
 87%|████████▋ | 324833/371472 [3:40:18<3:30:44,  3.69it/s]
 87%|████████▋ | 324834/371472 [3:40:19<3:28:17,  3.73it/s]
 87%|████████▋ | 324835/371472 [3:40:19<3:32:37,  3.66it/s]
 87%|████████▋ | 324836/371472 [3:40:19<3:36:10,  3.60it/s]
 87%|████████▋ | 324837/371472 [3:40:20<3:45:56,  3.44it/s]
 87%|████████▋ | 324838/371472 [3:40:20<3:55:46,  3.30it/s]
 87%|████████▋ | 324839/371472 [3:40:20<3:55:44,  3.30it/s]
 87%|████████▋ | 324840/371472 [3:40:20<3:59:10,  3.25it/s]
                                                           
{'loss': 2.6956, 'learning_rate': 2.1304057402658969e-07, 'epoch': 13.99}

 87%|████████▋ | 324840/371472 [3:40:20<3:59:10,  3.25it/s]
 87%|████████▋ | 324841/371472 [3:40:21<3:46:17,  3.43it/s]
 87%|████████▋ | 324842/371472 [3:40:21<3:42:06,  3.50it/s]
 87%|████████▋ | 324843/371472 [3:40:21<3:48:22,  3.40it/s]
 87%|████████▋ | 324844/371472 [3:40:22<3:38:27,  3.56it/s]
 87%|████████▋ | 324845/371472 [3:40:22<3:32:32,  3.66it/s]
 87%|████████▋ | 324846/371472 [3:40:22<3:42:38,  3.49it/s]
 87%|████████▋ | 324847/371472 [3:40:22<3:42:30,  3.49it/s]
 87%|████████▋ | 324848/371472 [3:40:23<3:38:42,  3.55it/s]
 87%|████████▋ | 324849/371472 [3:40:23<4:07:17,  3.14it/s]
 87%|████████▋ | 324850/371472 [3:40:23<4:04:23,  3.18it/s]
 87%|████████▋ | 324851/371472 [3:40:24<3:55:13,  3.30it/s]
 87%|████████▋ | 324852/371472 [3:40:24<3:50:50,  3.37it/s]
 87%|████████▋ | 324853/371472 [3:40:24<3:44:16,  3.46it/s]
 87%|████████▋ | 324854/371472 [3:40:24<3:40:05,  3.53it/s]
 87%|████████▋ | 324855/371472 [3:40:25<3:32:20,  3.66it/s]
 87%|████████▋ | 324856/371472 [3:40:25<3:46:23,  3.43it/s]
 87%|████████▋ | 324857/371472 [3:40:25<3:32:35,  3.65it/s]
 87%|████████▋ | 324858/371472 [3:40:26<3:31:31,  3.67it/s]
 87%|████████▋ | 324859/371472 [3:40:26<3:30:03,  3.70it/s]
 87%|████████▋ | 324860/371472 [3:40:26<3:55:22,  3.30it/s]
                                                           
{'loss': 2.6838, 'learning_rate': 2.1299209205111073e-07, 'epoch': 13.99}

 87%|████████▋ | 324860/371472 [3:40:26<3:55:22,  3.30it/s]
 87%|████████▋ | 324861/371472 [3:40:26<3:47:24,  3.42it/s]
 87%|████████▋ | 324862/371472 [3:40:27<3:37:39,  3.57it/s]
 87%|████████▋ | 324863/371472 [3:40:27<3:38:51,  3.55it/s]
 87%|████████▋ | 324864/371472 [3:40:27<3:33:41,  3.64it/s]
 87%|████████▋ | 324865/371472 [3:40:28<3:30:17,  3.69it/s]
 87%|████████▋ | 324866/371472 [3:40:28<3:34:14,  3.63it/s]
 87%|████████▋ | 324867/371472 [3:40:28<3:39:11,  3.54it/s]
 87%|████████▋ | 324868/371472 [3:40:28<3:39:20,  3.54it/s]
 87%|████████▋ | 324869/371472 [3:40:29<3:36:49,  3.58it/s]
 87%|████████▋ | 324870/371472 [3:40:29<3:31:27,  3.67it/s]
 87%|████████▋ | 324871/371472 [3:40:29<3:28:36,  3.72it/s]
 87%|████████▋ | 324872/371472 [3:40:30<3:47:34,  3.41it/s]
 87%|████████▋ | 324873/371472 [3:40:30<3:46:15,  3.43it/s]
 87%|████████▋ | 324874/371472 [3:40:30<3:45:27,  3.44it/s]
 87%|████████▋ | 324875/371472 [3:40:30<3:40:34,  3.52it/s]
 87%|████████▋ | 324876/371472 [3:40:31<3:39:32,  3.54it/s]
 87%|████████▋ | 324877/371472 [3:40:31<3:36:45,  3.58it/s]
 87%|████████▋ | 324878/371472 [3:40:31<3:37:21,  3.57it/s]
 87%|████████▋ | 324879/371472 [3:40:31<3:34:55,  3.61it/s]
 87%|████████▋ | 324880/371472 [3:40:32<3:34:42,  3.62it/s]
                                                           
{'loss': 2.5407, 'learning_rate': 2.129436100756319e-07, 'epoch': 13.99}

 87%|████████▋ | 324880/371472 [3:40:32<3:34:42,  3.62it/s]
 87%|████████▋ | 324881/371472 [3:40:32<3:38:02,  3.56it/s]
 87%|████████▋ | 324882/371472 [3:40:32<3:40:50,  3.52it/s]
 87%|████████▋ | 324883/371472 [3:40:33<3:38:49,  3.55it/s]
 87%|████████▋ | 324884/371472 [3:40:33<3:37:32,  3.57it/s]
 87%|████████▋ | 324885/371472 [3:40:33<3:39:50,  3.53it/s]
 87%|████████▋ | 324886/371472 [3:40:33<3:40:33,  3.52it/s]
 87%|████████▋ | 324887/371472 [3:40:34<3:36:20,  3.59it/s]
 87%|████████▋ | 324888/371472 [3:40:34<3:37:05,  3.58it/s]
 87%|████████▋ | 324889/371472 [3:40:34<3:29:19,  3.71it/s]
 87%|████████▋ | 324890/371472 [3:40:35<3:26:54,  3.75it/s]
 87%|████████▋ | 324891/371472 [3:40:35<3:27:42,  3.74it/s]
 87%|████████▋ | 324892/371472 [3:40:35<3:29:38,  3.70it/s]
 87%|████████▋ | 324893/371472 [3:40:35<3:22:43,  3.83it/s]
 87%|████████▋ | 324894/371472 [3:40:36<3:29:01,  3.71it/s]
 87%|████████▋ | 324895/371472 [3:40:36<3:28:28,  3.72it/s]
 87%|████████▋ | 324896/371472 [3:40:36<3:40:18,  3.52it/s]
 87%|████████▋ | 324897/371472 [3:40:36<3:29:44,  3.70it/s]
 87%|████████▋ | 324898/371472 [3:40:37<3:37:51,  3.56it/s]
 87%|████████▋ | 324899/371472 [3:40:37<3:36:27,  3.59it/s]
 87%|████████▋ | 324900/371472 [3:40:37<3:32:20,  3.66it/s]
                                                           
{'loss': 2.6206, 'learning_rate': 2.1289512810015298e-07, 'epoch': 13.99}

 87%|████████▋ | 324900/371472 [3:40:37<3:32:20,  3.66it/s]
 87%|████████▋ | 324901/371472 [3:40:38<3:38:49,  3.55it/s]
 87%|████████▋ | 324902/371472 [3:40:38<3:30:48,  3.68it/s]
 87%|████████▋ | 324903/371472 [3:40:38<3:44:31,  3.46it/s]
 87%|████████▋ | 324904/371472 [3:40:38<3:35:34,  3.60it/s]
 87%|████████▋ | 324905/371472 [3:40:39<3:32:58,  3.64it/s]
 87%|████████▋ | 324906/371472 [3:40:39<3:37:24,  3.57it/s]
 87%|████████▋ | 324907/371472 [3:40:39<3:38:08,  3.56it/s]
 87%|████████▋ | 324908/371472 [3:40:40<3:33:19,  3.64it/s]
 87%|████████▋ | 324909/371472 [3:40:40<3:41:42,  3.50it/s]
 87%|████████▋ | 324910/371472 [3:40:40<3:41:41,  3.50it/s]
 87%|████████▋ | 324911/371472 [3:40:40<3:46:41,  3.42it/s]
 87%|████████▋ | 324912/371472 [3:40:41<3:49:54,  3.38it/s]
 87%|████████▋ | 324913/371472 [3:40:41<4:03:06,  3.19it/s]
 87%|████████▋ | 324914/371472 [3:40:41<3:55:35,  3.29it/s]
 87%|████████▋ | 324915/371472 [3:40:42<3:44:32,  3.46it/s]
 87%|████████▋ | 324916/371472 [3:40:42<3:37:11,  3.57it/s]
 87%|████████▋ | 324917/371472 [3:40:42<3:33:22,  3.64it/s]
 87%|████████▋ | 324918/371472 [3:40:42<3:33:53,  3.63it/s]
 87%|████████▋ | 324919/371472 [3:40:43<3:40:10,  3.52it/s]
 87%|████████▋ | 324920/371472 [3:40:43<3:38:47,  3.55it/s]
                                                           
{'loss': 2.574, 'learning_rate': 2.128466461246741e-07, 'epoch': 13.99}

 87%|████████▋ | 324920/371472 [3:40:43<3:38:47,  3.55it/s]
 87%|████████▋ | 324921/371472 [3:40:43<3:39:56,  3.53it/s]
 87%|████████▋ | 324922/371472 [3:40:44<3:45:41,  3.44it/s]
 87%|████████▋ | 324923/371472 [3:40:44<3:59:03,  3.25it/s]
 87%|████████▋ | 324924/371472 [3:40:44<3:45:52,  3.43it/s]
 87%|████████▋ | 324925/371472 [3:40:44<3:42:02,  3.49it/s]
 87%|████████▋ | 324926/371472 [3:40:45<3:38:47,  3.55it/s]
 87%|████████▋ | 324927/371472 [3:40:45<3:44:08,  3.46it/s]
 87%|████████▋ | 324928/371472 [3:40:45<3:34:45,  3.61it/s]
 87%|████████▋ | 324929/371472 [3:40:46<3:34:06,  3.62it/s]
 87%|████████▋ | 324930/371472 [3:40:46<3:40:44,  3.51it/s]
 87%|████████▋ | 324931/371472 [3:40:46<3:45:59,  3.43it/s]
 87%|████████▋ | 324932/371472 [3:40:46<3:50:03,  3.37it/s]
 87%|████████▋ | 324933/371472 [3:40:47<4:00:16,  3.23it/s]
 87%|████████▋ | 324934/371472 [3:40:47<3:56:49,  3.28it/s]
 87%|████████▋ | 324935/371472 [3:40:47<3:47:22,  3.41it/s]
 87%|████████▋ | 324936/371472 [3:40:48<3:38:24,  3.55it/s]
 87%|████████▋ | 324937/371472 [3:40:48<3:36:00,  3.59it/s]
 87%|████████▋ | 324938/371472 [3:40:48<3:38:34,  3.55it/s]
 87%|████████▋ | 324939/371472 [3:40:48<3:32:47,  3.64it/s]
 87%|████████▋ | 324940/371472 [3:40:49<3:29:15,  3.71it/s]
                                                           
{'loss': 2.553, 'learning_rate': 2.1279816414919518e-07, 'epoch': 14.0}

 87%|████████▋ | 324940/371472 [3:40:49<3:29:15,  3.71it/s]
 87%|████████▋ | 324941/371472 [3:40:49<3:33:48,  3.63it/s]
 87%|████████▋ | 324942/371472 [3:40:49<3:35:07,  3.60it/s]
 87%|████████▋ | 324943/371472 [3:40:50<3:29:17,  3.71it/s]
 87%|████████▋ | 324944/371472 [3:40:50<3:27:24,  3.74it/s]
 87%|████████▋ | 324945/371472 [3:40:50<3:36:01,  3.59it/s]
 87%|████████▋ | 324946/371472 [3:40:50<3:35:47,  3.59it/s]
 87%|████████▋ | 324947/371472 [3:40:51<3:37:37,  3.56it/s]
 87%|████████▋ | 324948/371472 [3:40:51<3:50:51,  3.36it/s]
 87%|████████▋ | 324949/371472 [3:40:51<3:42:03,  3.49it/s]
 87%|████████▋ | 324950/371472 [3:40:52<3:43:02,  3.48it/s]
 87%|████████▋ | 324951/371472 [3:40:52<3:36:01,  3.59it/s]
 87%|████████▋ | 324952/371472 [3:40:52<3:44:03,  3.46it/s]
 87%|████████▋ | 324953/371472 [3:40:52<3:41:42,  3.50it/s]
 87%|████████▋ | 324954/371472 [3:40:53<3:33:57,  3.62it/s]
 87%|████████▋ | 324955/371472 [3:40:53<3:47:18,  3.41it/s]
 87%|████████▋ | 324956/371472 [3:40:53<3:45:13,  3.44it/s]
 87%|████████▋ | 324957/371472 [3:40:54<3:37:41,  3.56it/s]
 87%|████████▋ | 324958/371472 [3:40:54<3:45:38,  3.44it/s]
 87%|████████▋ | 324959/371472 [3:40:54<3:58:01,  3.26it/s]
 87%|████████▋ | 324960/371472 [3:40:54<3:49:15,  3.38it/s]
                                                           
{'loss': 2.662, 'learning_rate': 2.1274968217371635e-07, 'epoch': 14.0}

 87%|████████▋ | 324960/371472 [3:40:54<3:49:15,  3.38it/s]
 87%|████████▋ | 324961/371472 [3:40:55<3:57:16,  3.27it/s]
 87%|████████▋ | 324962/371472 [3:40:55<3:46:05,  3.43it/s]
 87%|████████▋ | 324963/371472 [3:40:55<3:41:02,  3.51it/s]
 87%|████████▋ | 324964/371472 [3:40:56<3:33:16,  3.63it/s]
 87%|████████▋ | 324965/371472 [3:40:56<3:27:34,  3.73it/s]
 87%|████████▋ | 324966/371472 [3:40:56<3:35:25,  3.60it/s]
 87%|████████▋ | 324967/371472 [3:40:56<3:35:48,  3.59it/s]
 87%|████████▋ | 324968/371472 [3:40:57<3:47:42,  3.40it/s]
 87%|████████▋ | 324969/371472 [3:40:57<3:46:44,  3.42it/s]
 87%|████████▋ | 324970/371472 [3:40:57<3:42:11,  3.49it/s]
 87%|████████▋ | 324971/371472 [3:40:58<3:37:17,  3.57it/s]
 87%|████████▋ | 324972/371472 [3:40:58<3:39:21,  3.53it/s]
 87%|████████▋ | 324973/371472 [3:40:58<3:41:51,  3.49it/s]
 87%|████████▋ | 324974/371472 [3:40:58<3:36:21,  3.58it/s]
 87%|████████▋ | 324975/371472 [3:40:59<3:30:58,  3.67it/s]
 87%|████████▋ | 324976/371472 [3:40:59<3:37:44,  3.56it/s]
 87%|████████▋ | 324977/371472 [3:40:59<3:34:02,  3.62it/s]
 87%|████████▋ | 324978/371472 [3:40:59<3:29:11,  3.70it/s]
 87%|████████▋ | 324979/371472 [3:41:00<3:30:54,  3.67it/s]
 87%|████████▋ | 324980/371472 [3:41:00<3:32:18,  3.65it/s]
                                                           
{'loss': 2.6917, 'learning_rate': 2.127012001982374e-07, 'epoch': 14.0}

 87%|████████▋ | 324980/371472 [3:41:00<3:32:18,  3.65it/s]
 87%|████████▋ | 324981/371472 [3:41:00<3:36:19,  3.58it/s]
 87%|████████▋ | 324982/371472 [3:41:01<3:32:56,  3.64it/s]
 87%|████████▋ | 324983/371472 [3:41:01<3:34:30,  3.61it/s]
 87%|████████▋ | 324984/371472 [3:41:01<3:33:59,  3.62it/s]
 87%|████████▋ | 324985/371472 [3:41:01<3:36:05,  3.59it/s]
 87%|████████▋ | 324986/371472 [3:41:02<3:39:58,  3.52it/s]
 87%|████████▋ | 324987/371472 [3:41:02<3:37:39,  3.56it/s]
 87%|████████▋ | 324988/371472 [3:41:02<4:12:06,  3.07it/s]
 87%|████████▋ | 324989/371472 [3:41:03<4:21:32,  2.96it/s]
 87%|████████▋ | 324990/371472 [3:41:03<4:07:13,  3.13it/s]
 87%|████████▋ | 324991/371472 [3:41:03<3:54:35,  3.30it/s]
 87%|████████▋ | 324992/371472 [3:41:04<3:44:09,  3.46it/s]
 87%|████████▋ | 324993/371472 [3:41:04<3:50:36,  3.36it/s]
 87%|████████▋ | 324994/371472 [3:41:04<3:43:41,  3.46it/s]
 87%|████████▋ | 324995/371472 [3:41:04<3:49:20,  3.38it/s]
 87%|████████▋ | 324996/371472 [3:41:05<3:45:10,  3.44it/s]
 87%|████████▋ | 324997/371472 [3:41:05<3:45:53,  3.43it/s]
 87%|████████▋ | 324998/371472 [3:41:05<3:46:03,  3.43it/s]
 87%|████████▋ | 324999/371472 [3:41:06<3:51:59,  3.34it/s]
 87%|████████▋ | 325000/371472 [3:41:06<3:53:59,  3.31it/s]
                                                           
{'loss': 2.5112, 'learning_rate': 2.1265271822275855e-07, 'epoch': 14.0}

 87%|████████▋ | 325000/371472 [3:41:06<3:53:59,  3.31it/s]
 87%|████████▋ | 325001/371472 [3:41:06<3:52:20,  3.33it/s]
 87%|████████▋ | 325002/371472 [3:41:07<3:47:14,  3.41it/s]
 87%|████████▋ | 325003/371472 [3:41:07<3:38:18,  3.55it/s]
 87%|████████▋ | 325004/371472 [3:41:07<3:38:11,  3.55it/s]
 87%|████████▋ | 325005/371472 [3:41:07<3:35:48,  3.59it/s]
 87%|████████▋ | 325006/371472 [3:41:08<3:42:44,  3.48it/s]
 87%|████████▋ | 325007/371472 [3:41:08<3:45:36,  3.43it/s]
 87%|████████▋ | 325008/371472 [3:41:08<3:46:24,  3.42it/s]
 87%|████████▋ | 325009/371472 [3:41:09<3:37:58,  3.55it/s]
 87%|████████▋ | 325010/371472 [3:41:09<3:31:54,  3.65it/s]
 87%|████████▋ | 325011/371472 [3:41:09<3:29:00,  3.70it/s]
 87%|████████▋ | 325012/371472 [3:41:09<3:31:22,  3.66it/s]
 87%|████████▋ | 325013/371472 [3:41:10<3:38:13,  3.55it/s]
 87%|████████▋ | 325014/371472 [3:41:10<3:34:25,  3.61it/s]
 87%|████████▋ | 325015/371472 [3:41:10<3:32:02,  3.65it/s]
 87%|████████▋ | 325016/371472 [3:41:10<3:30:04,  3.69it/s]
 87%|████████▋ | 325017/371472 [3:41:11<3:34:14,  3.61it/s]
 87%|████████▋ | 325018/371472 [3:41:11<3:25:51,  3.76it/s]
 87%|████████▋ | 325019/371472 [3:41:11<3:28:32,  3.71it/s]
 87%|████████▋ | 325020/371472 [3:41:12<3:29:49,  3.69it/s]
                                                           
{'loss': 2.6875, 'learning_rate': 2.1260423624727962e-07, 'epoch': 14.0}

 87%|████████▋ | 325020/371472 [3:41:12<3:29:49,  3.69it/s]
 87%|████████▋ | 325021/371472 [3:41:12<3:35:33,  3.59it/s]
 87%|████████▋ | 325022/371472 [3:41:12<3:37:37,  3.56it/s]
 87%|████████▋ | 325023/371472 [3:41:12<3:40:46,  3.51it/s]
 87%|████████▋ | 325024/371472 [3:41:13<3:43:24,  3.46it/s]
 87%|████████▋ | 325025/371472 [3:41:13<3:53:57,  3.31it/s]
 87%|████████▋ | 325026/371472 [3:41:13<3:48:31,  3.39it/s]
 87%|████████▋ | 325027/371472 [3:41:14<3:56:40,  3.27it/s]
 87%|████████▋ | 325028/371472 [3:41:14<3:50:55,  3.35it/s]
 87%|████████▋ | 325029/371472 [3:41:14<3:45:39,  3.43it/s]
 87%|████████▋ | 325030/371472 [3:41:15<4:07:25,  3.13it/s]
 87%|████████▋ | 325031/371472 [3:41:15<3:56:36,  3.27it/s]
 87%|████████▋ | 325032/371472 [3:41:15<3:53:43,  3.31it/s]
 87%|████████▋ | 325033/371472 [3:41:15<3:48:54,  3.38it/s]
 87%|████████▋ | 325034/371472 [3:41:16<3:49:55,  3.37it/s]
 87%|████████▋ | 325035/371472 [3:41:16<3:57:45,  3.26it/s]
 87%|████████▋ | 325036/371472 [3:41:16<3:46:39,  3.41it/s]
 87%|████████▋ | 325037/371472 [3:41:17<3:35:22,  3.59it/s]
 88%|████████▊ | 325038/371472 [3:41:17<3:49:25,  3.37it/s]Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
Non-default generation parameters: {'max_length': 200, 'early_stopping': True, 'num_beams': 5, 'forced_eos_token_id': 2}
/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

 88%|████████▊ | 325039/371472 [3:41:42<101:04:43,  7.84s/it]
 88%|████████▊ | 325040/371472 [3:41:43<71:55:24,  5.58s/it] 
                                                            
{'loss': 2.6461, 'learning_rate': 2.1255575427180067e-07, 'epoch': 14.0}

 88%|████████▊ | 325040/371472 [3:41:43<71:55:24,  5.58s/it]
 88%|████████▊ | 325041/371472 [3:41:43<51:35:24,  4.00s/it]
 88%|████████▊ | 325042/371472 [3:41:43<37:20:48,  2.90s/it]
 88%|████████▊ | 325043/371472 [3:41:44<27:29:22,  2.13s/it]
 88%|████████▊ | 325044/371472 [3:41:44<20:28:35,  1.59s/it]
 88%|████████▊ | 325045/371472 [3:41:44<15:36:10,  1.21s/it]
 88%|████████▊ | 325046/371472 [3:41:45<12:15:15,  1.05it/s]
 88%|████████▊ | 325047/371472 [3:41:45<9:52:29,  1.31it/s] 
 88%|████████▊ | 325048/371472 [3:41:45<8:10:31,  1.58it/s]
 88%|████████▊ | 325049/371472 [3:41:46<7:03:03,  1.83it/s]
 88%|████████▊ | 325050/371472 [3:41:46<6:12:56,  2.07it/s]
 88%|████████▊ | 325051/371472 [3:41:46<5:48:04,  2.22it/s]
 88%|████████▊ | 325052/371472 [3:41:47<5:22:40,  2.40it/s]
 88%|████████▊ | 325053/371472 [3:41:47<4:57:52,  2.60it/s]
 88%|████████▊ | 325054/371472 [3:41:47<4:47:50,  2.69it/s]
 88%|████████▊ | 325055/371472 [3:41:48<4:29:32,  2.87it/s]
 88%|████████▊ | 325056/371472 [3:41:48<4:27:39,  2.89it/s]
 88%|████████▊ | 325057/371472 [3:41:48<4:14:43,  3.04it/s]
 88%|████████▊ | 325058/371472 [3:41:48<3:59:30,  3.23it/s]
 88%|████████▊ | 325059/371472 [3:41:49<3:58:28,  3.24it/s]
 88%|████████▊ | 325060/371472 [3:41:49<3:46:31,  3.41it/s]
                                                           
{'loss': 2.5776, 'learning_rate': 2.1250727229632182e-07, 'epoch': 14.0}

 88%|████████▊ | 325060/371472 [3:41:49<3:46:31,  3.41it/s]
 88%|████████▊ | 325061/371472 [3:41:49<4:14:24,  3.04it/s]
 88%|████████▊ | 325062/371472 [3:41:50<4:03:49,  3.17it/s]
 88%|████████▊ | 325063/371472 [3:41:50<4:09:21,  3.10it/s]
 88%|████████▊ | 325064/371472 [3:41:50<4:01:46,  3.20it/s]
 88%|████████▊ | 325065/371472 [3:41:51<3:52:03,  3.33it/s]
 88%|████████▊ | 325066/371472 [3:41:51<3:46:40,  3.41it/s]
 88%|████████▊ | 325067/371472 [3:41:51<3:42:06,  3.48it/s]
 88%|████████▊ | 325068/371472 [3:41:51<3:41:36,  3.49it/s]
 88%|████████▊ | 325069/371472 [3:41:52<3:34:42,  3.60it/s]
 88%|████████▊ | 325070/371472 [3:41:52<3:27:06,  3.73it/s]
 88%|████████▊ | 325071/371472 [3:41:52<3:50:03,  3.36it/s]
 88%|████████▊ | 325072/371472 [3:41:53<3:47:32,  3.40it/s]
 88%|████████▊ | 325073/371472 [3:41:53<3:57:27,  3.26it/s]
 88%|████████▊ | 325074/371472 [3:41:53<3:49:41,  3.37it/s]
 88%|████████▊ | 325075/371472 [3:41:53<3:37:55,  3.55it/s]
 88%|████████▊ | 325076/371472 [3:41:54<3:35:57,  3.58it/s]
 88%|████████▊ | 325077/371472 [3:41:54<3:34:14,  3.61it/s]
 88%|████████▊ | 325078/371472 [3:41:54<3:39:28,  3.52it/s]
 88%|████████▊ | 325079/371472 [3:41:55<3:31:14,  3.66it/s]
 88%|████████▊ | 325080/371472 [3:41:55<3:28:35,  3.71it/s]
                                                           
{'loss': 2.7902, 'learning_rate': 2.124587903208429e-07, 'epoch': 14.0}

 88%|████████▊ | 325080/371472 [3:41:55<3:28:35,  3.71it/s]
 88%|████████▊ | 325081/371472 [3:41:55<3:33:34,  3.62it/s]
 88%|████████▊ | 325082/371472 [3:41:55<3:33:37,  3.62it/s]
 88%|████████▊ | 325083/371472 [3:41:56<3:35:07,  3.59it/s]
 88%|████████▊ | 325084/371472 [3:41:56<3:35:13,  3.59it/s]
 88%|████████▊ | 325085/371472 [3:41:56<3:41:13,  3.49it/s]
 88%|████████▊ | 325086/371472 [3:41:57<3:39:09,  3.53it/s]
 88%|████████▊ | 325087/371472 [3:41:57<3:38:01,  3.55it/s]
 88%|████████▊ | 325088/371472 [3:41:57<3:38:20,  3.54it/s]
 88%|████████▊ | 325089/371472 [3:41:57<3:47:23,  3.40it/s]
 88%|████████▊ | 325090/371472 [3:41:58<3:48:01,  3.39it/s]
 88%|████████▊ | 325091/371472 [3:41:58<4:03:10,  3.18it/s]
 88%|████████▊ | 325092/371472 [3:41:58<4:00:26,  3.21it/s]
 88%|████████▊ | 325093/371472 [3:41:59<3:45:16,  3.43it/s]
 88%|████████▊ | 325094/371472 [3:41:59<3:51:12,  3.34it/s]
 88%|████████▊ | 325095/371472 [3:41:59<3:42:39,  3.47it/s]
 88%|████████▊ | 325096/371472 [3:42:00<4:00:38,  3.21it/s]
 88%|████████▊ | 325097/371472 [3:42:00<3:57:35,  3.25it/s]
 88%|████████▊ | 325098/371472 [3:42:00<3:49:39,  3.37it/s]
 88%|████████▊ | 325099/371472 [3:42:00<3:42:19,  3.48it/s]
 88%|████████▊ | 325100/371472 [3:42:01<3:41:29,  3.49it/s]
                                                           
{'loss': 2.6683, 'learning_rate': 2.12410308345364e-07, 'epoch': 14.0}

 88%|████████▊ | 325100/371472 [3:42:01<3:41:29,  3.49it/s]
 88%|████████▊ | 325101/371472 [3:42:01<3:52:05,  3.33it/s]
 88%|████████▊ | 325102/371472 [3:42:01<3:46:24,  3.41it/s]
 88%|████████▊ | 325103/371472 [3:42:02<3:48:31,  3.38it/s]
 88%|████████▊ | 325104/371472 [3:42:02<3:49:43,  3.36it/s]
 88%|████████▊ | 325105/371472 [3:42:02<3:54:45,  3.29it/s]
 88%|████████▊ | 325106/371472 [3:42:03<3:45:06,  3.43it/s]
 88%|████████▊ | 325107/371472 [3:42:03<3:56:52,  3.26it/s]
 88%|████████▊ | 325108/371472 [3:42:03<4:18:26,  2.99it/s]
 88%|████████▊ | 325109/371472 [3:42:04<4:29:57,  2.86it/s]
 88%|████████▊ | 325110/371472 [3:42:04<4:22:30,  2.94it/s]
 88%|████████▊ | 325111/371472 [3:42:04<4:22:55,  2.94it/s]
 88%|████████▊ | 325112/371472 [3:42:05<4:13:14,  3.05it/s]
 88%|████████▊ | 325113/371472 [3:42:05<4:26:50,  2.90it/s]
 88%|████████▊ | 325114/371472 [3:42:05<4:15:03,  3.03it/s]
 88%|████████▊ | 325115/371472 [3:42:06<4:05:07,  3.15it/s]
 88%|████████▊ | 325116/371472 [3:42:06<4:07:56,  3.12it/s]
 88%|████████▊ | 325117/371472 [3:42:06<4:10:09,  3.09it/s]
 88%|████████▊ | 325118/371472 [3:42:07<4:06:14,  3.14it/s]
 88%|████████▊ | 325119/371472 [3:42:07<4:02:02,  3.19it/s]
 88%|████████▊ | 325120/371472 [3:42:07<4:00:08,  3.22it/s]
                                                           
{'loss': 2.6083, 'learning_rate': 2.1236182636988508e-07, 'epoch': 14.0}

 88%|████████▊ | 325120/371472 [3:42:07<4:00:08,  3.22it/s]
 88%|████████▊ | 325121/371472 [3:42:07<4:03:19,  3.17it/s]
 88%|████████▊ | 325122/371472 [3:42:08<3:57:29,  3.25it/s]
 88%|████████▊ | 325123/371472 [3:42:08<4:01:03,  3.20it/s]
 88%|████████▊ | 325124/371472 [3:42:08<3:47:31,  3.40it/s]
 88%|████████▊ | 325125/371472 [3:42:09<3:41:22,  3.49it/s]
 88%|████████▊ | 325126/371472 [3:42:09<3:40:10,  3.51it/s]
 88%|████████▊ | 325127/371472 [3:42:09<3:36:49,  3.56it/s]
 88%|████████▊ | 325128/371472 [3:42:09<3:40:22,  3.50it/s]
 88%|████████▊ | 325129/371472 [3:42:10<3:41:51,  3.48it/s]
 88%|████████▊ | 325130/371472 [3:42:10<3:51:21,  3.34it/s]
 88%|████████▊ | 325131/371472 [3:42:10<3:49:59,  3.36it/s]
 88%|████████▊ | 325132/371472 [3:42:11<4:10:19,  3.09it/s]
 88%|████████▊ | 325133/371472 [3:42:11<4:42:44,  2.73it/s]
 88%|████████▊ | 325134/371472 [3:42:11<4:20:16,  2.97it/s]
 88%|████████▊ | 325135/371472 [3:42:12<4:00:59,  3.20it/s]
 88%|████████▊ | 325136/371472 [3:42:12<4:10:43,  3.08it/s]
 88%|████████▊ | 325137/371472 [3:42:12<4:03:49,  3.17it/s]
 88%|████████▊ | 325138/371472 [3:42:13<3:58:15,  3.24it/s]
 88%|████████▊ | 325139/371472 [3:42:13<4:06:31,  3.13it/s]
 88%|████████▊ | 325140/371472 [3:42:13<3:50:53,  3.34it/s]
                                                           
{'loss': 2.6165, 'learning_rate': 2.1231334439440626e-07, 'epoch': 14.0}

 88%|████████▊ | 325140/371472 [3:42:13<3:50:53,  3.34it/s]
 88%|████████▊ | 325141/371472 [3:42:14<4:02:59,  3.18it/s]
 88%|████████▊ | 325142/371472 [3:42:14<3:59:29,  3.22it/s]
 88%|████████▊ | 325143/371472 [3:42:14<4:02:56,  3.18it/s]
 88%|████████▊ | 325144/371472 [3:42:15<4:09:21,  3.10it/s]
 88%|████████▊ | 325145/371472 [3:42:15<4:10:24,  3.08it/s]
 88%|████████▊ | 325146/371472 [3:42:15<4:02:13,  3.19it/s]
 88%|████████▊ | 325147/371472 [3:42:15<3:50:11,  3.35it/s]
 88%|████████▊ | 325148/371472 [3:42:16<3:47:48,  3.39it/s]
 88%|████████▊ | 325149/371472 [3:42:16<3:57:54,  3.25it/s]
 88%|████████▊ | 325150/371472 [3:42:16<4:00:11,  3.21it/s]
 88%|████████▊ | 325151/371472 [3:42:17<3:53:50,  3.30it/s]
 88%|████████▊ | 325152/371472 [3:42:17<3:57:24,  3.25it/s]
 88%|████████▊ | 325153/371472 [3:42:17<3:56:26,  3.27it/s]
 88%|████████▊ | 325154/371472 [3:42:18<3:54:35,  3.29it/s]
 88%|████████▊ | 325155/371472 [3:42:18<3:51:49,  3.33it/s]
 88%|████████▊ | 325156/371472 [3:42:18<3:45:18,  3.43it/s]
 88%|████████▊ | 325157/371472 [3:42:18<3:52:11,  3.32it/s]
 88%|████████▊ | 325158/371472 [3:42:19<3:47:04,  3.40it/s]
 88%|████████▊ | 325159/371472 [3:42:19<3:38:22,  3.53it/s]
 88%|████████▊ | 325160/371472 [3:42:19<3:50:55,  3.34it/s]
                                                           
{'loss': 2.5899, 'learning_rate': 2.1226486241892733e-07, 'epoch': 14.01}

 88%|████████▊ | 325160/371472 [3:42:19<3:50:55,  3.34it/s]
 88%|████████▊ | 325161/371472 [3:42:20<3:46:44,  3.40it/s]
 88%|████████▊ | 325162/371472 [3:42:20<3:46:28,  3.41it/s]
 88%|████████▊ | 325163/371472 [3:42:20<3:45:52,  3.42it/s]
 88%|████████▊ | 325164/371472 [3:42:21<3:48:07,  3.38it/s]
 88%|████████▊ | 325165/371472 [3:42:21<3:48:42,  3.37it/s]
 88%|████████▊ | 325166/371472 [3:42:21<3:48:46,  3.37it/s]
 88%|████████▊ | 325167/371472 [3:42:21<4:02:27,  3.18it/s]
 88%|████████▊ | 325168/371472 [3:42:22<3:59:00,  3.23it/s]
 88%|████████▊ | 325169/371472 [3:42:22<4:55:31,  2.61it/s]
 88%|████████▊ | 325170/371472 [3:42:23<4:31:56,  2.84it/s]
 88%|████████▊ | 325171/371472 [3:42:23<4:26:20,  2.90it/s]
 88%|████████▊ | 325172/371472 [3:42:23<4:06:08,  3.14it/s]
 88%|████████▊ | 325173/371472 [3:42:24<4:13:40,  3.04it/s]
 88%|████████▊ | 325174/371472 [3:42:24<4:02:03,  3.19it/s]
 88%|████████▊ | 325175/371472 [3:42:24<4:00:16,  3.21it/s]
 88%|████████▊ | 325176/371472 [3:42:24<3:50:54,  3.34it/s]
 88%|████████▊ | 325177/371472 [3:42:25<3:52:46,  3.31it/s]
 88%|████████▊ | 325178/371472 [3:42:25<3:52:16,  3.32it/s]
 88%|████████▊ | 325179/371472 [3:42:25<3:49:00,  3.37it/s]
 88%|████████▊ | 325180/371472 [3:42:26<3:39:49,  3.51it/s]
                                                           
{'loss': 2.6185, 'learning_rate': 2.1221638044344846e-07, 'epoch': 14.01}

 88%|████████▊ | 325180/371472 [3:42:26<3:39:49,  3.51it/s]
 88%|████████▊ | 325181/371472 [3:42:26<3:36:29,  3.56it/s]
 88%|████████▊ | 325182/371472 [3:42:26<3:36:41,  3.56it/s]
 88%|████████▊ | 325183/371472 [3:42:26<3:48:57,  3.37it/s]
 88%|████████▊ | 325184/371472 [3:42:27<3:44:54,  3.43it/s]
 88%|████████▊ | 325185/371472 [3:42:27<3:36:46,  3.56it/s]
 88%|████████▊ | 325186/371472 [3:42:27<3:33:04,  3.62it/s]
 88%|████████▊ | 325187/371472 [3:42:28<3:41:13,  3.49it/s]
 88%|████████▊ | 325188/371472 [3:42:28<3:41:47,  3.48it/s]
 88%|████████▊ | 325189/371472 [3:42:28<3:55:18,  3.28it/s]
 88%|████████▊ | 325190/371472 [3:42:28<3:41:36,  3.48it/s]
 88%|████████▊ | 325191/371472 [3:42:29<3:48:46,  3.37it/s]
 88%|████████▊ | 325192/371472 [3:42:29<3:50:09,  3.35it/s]
 88%|████████▊ | 325193/371472 [3:42:29<4:02:39,  3.18it/s]
 88%|████████▊ | 325194/371472 [3:42:30<3:53:14,  3.31it/s]
 88%|████████▊ | 325195/371472 [3:42:30<3:55:08,  3.28it/s]
 88%|████████▊ | 325196/371472 [3:42:30<3:54:39,  3.29it/s]
 88%|████████▊ | 325197/371472 [3:42:31<3:50:52,  3.34it/s]
 88%|████████▊ | 325198/371472 [3:42:31<3:58:33,  3.23it/s]
 88%|████████▊ | 325199/371472 [3:42:31<3:46:14,  3.41it/s]
 88%|████████▊ | 325200/371472 [3:42:31<3:36:41,  3.56it/s]
                                                           
{'loss': 2.548, 'learning_rate': 2.1216789846796953e-07, 'epoch': 14.01}

 88%|████████▊ | 325200/371472 [3:42:31<3:36:41,  3.56it/s]
 88%|████████▊ | 325201/371472 [3:42:32<3:40:34,  3.50it/s]
 88%|████████▊ | 325202/371472 [3:42:32<3:42:39,  3.46it/s]
 88%|████████▊ | 325203/371472 [3:42:32<3:48:29,  3.37it/s]
 88%|████████▊ | 325204/371472 [3:42:33<3:44:28,  3.44it/s]
 88%|████████▊ | 325205/371472 [3:42:33<4:10:24,  3.08it/s]
 88%|████████▊ | 325206/371472 [3:42:33<3:57:49,  3.24it/s]
 88%|████████▊ | 325207/371472 [3:42:34<3:59:07,  3.22it/s]
 88%|████████▊ | 325208/371472 [3:42:34<3:50:15,  3.35it/s]
 88%|████████▊ | 325209/371472 [3:42:34<4:24:24,  2.92it/s]
 88%|████████▊ | 325210/371472 [3:42:35<4:26:47,  2.89it/s]
 88%|████████▊ | 325211/371472 [3:42:35<4:10:45,  3.07it/s]
 88%|████████▊ | 325212/371472 [3:42:35<4:18:23,  2.98it/s]
 88%|████████▊ | 325213/371472 [3:42:36<4:13:00,  3.05it/s]
 88%|████████▊ | 325214/371472 [3:42:36<4:02:58,  3.17it/s]
 88%|████████▊ | 325215/371472 [3:42:36<4:03:54,  3.16it/s]
 88%|████████▊ | 325216/371472 [3:42:37<3:56:43,  3.26it/s]
 88%|████████▊ | 325217/371472 [3:42:37<3:56:13,  3.26it/s]
 88%|████████▊ | 325218/371472 [3:42:37<3:58:03,  3.24it/s]
 88%|████████▊ | 325219/371472 [3:42:37<3:51:59,  3.32it/s]
 88%|████████▊ | 325220/371472 [3:42:38<3:41:07,  3.49it/s]
                                                           
{'loss': 2.6094, 'learning_rate': 2.121194164924907e-07, 'epoch': 14.01}

 88%|████████▊ | 325220/371472 [3:42:38<3:41:07,  3.49it/s]
 88%|████████▊ | 325221/371472 [3:42:38<3:38:22,  3.53it/s]
 88%|████████▊ | 325222/371472 [3:42:38<3:51:29,  3.33it/s]
 88%|████████▊ | 325223/371472 [3:42:39<3:38:11,  3.53it/s]
 88%|████████▊ | 325224/371472 [3:42:39<3:31:31,  3.64it/s]
 88%|████████▊ | 325225/371472 [3:42:39<3:28:24,  3.70it/s]
 88%|████████▊ | 325226/371472 [3:42:39<3:22:16,  3.81it/s]
 88%|████████▊ | 325227/371472 [3:42:40<3:27:10,  3.72it/s]
 88%|████████▊ | 325228/371472 [3:42:40<3:27:27,  3.72it/s]
 88%|████████▊ | 325229/371472 [3:42:40<3:44:41,  3.43it/s]
 88%|████████▊ | 325230/371472 [3:42:40<3:40:46,  3.49it/s]
 88%|████████▊ | 325231/371472 [3:42:41<3:36:26,  3.56it/s]
 88%|████████▊ | 325232/371472 [3:42:41<3:34:31,  3.59it/s]
 88%|████████▊ | 325233/371472 [3:42:41<3:47:27,  3.39it/s]
 88%|████████▊ | 325234/371472 [3:42:42<3:38:28,  3.53it/s]
 88%|████████▊ | 325235/371472 [3:42:42<3:32:02,  3.63it/s]
 88%|████████▊ | 325236/371472 [3:42:42<3:39:05,  3.52it/s]
 88%|████████▊ | 325237/371472 [3:42:42<3:40:00,  3.50it/s]
 88%|████████▊ | 325238/371472 [3:42:43<3:49:38,  3.36it/s]
 88%|████████▊ | 325239/371472 [3:42:43<3:47:09,  3.39it/s]
 88%|████████▊ | 325240/371472 [3:42:43<3:43:32,  3.45it/s]
                                                           
{'loss': 2.7087, 'learning_rate': 2.1207093451701175e-07, 'epoch': 14.01}

 88%|████████▊ | 325240/371472 [3:42:43<3:43:32,  3.45it/s]
 88%|████████▊ | 325241/371472 [3:42:44<3:34:23,  3.59it/s]
 88%|████████▊ | 325242/371472 [3:42:44<3:37:41,  3.54it/s]
 88%|████████▊ | 325243/371472 [3:42:44<3:32:56,  3.62it/s]
 88%|████████▊ | 325244/371472 [3:42:44<3:36:08,  3.56it/s]
 88%|████████▊ | 325245/371472 [3:42:45<3:38:46,  3.52it/s]
 88%|████████▊ | 325246/371472 [3:42:45<3:37:57,  3.53it/s]
 88%|████████▊ | 325247/371472 [3:42:45<3:49:40,  3.35it/s]
 88%|████████▊ | 325248/371472 [3:42:46<3:44:14,  3.44it/s]
 88%|████████▊ | 325249/371472 [3:42:46<3:38:58,  3.52it/s]
 88%|████████▊ | 325250/371472 [3:42:46<3:38:16,  3.53it/s]
 88%|████████▊ | 325251/371472 [3:42:46<3:34:07,  3.60it/s]
 88%|████████▊ | 325252/371472 [3:42:47<3:43:21,  3.45it/s]
 88%|████████▊ | 325253/371472 [3:42:47<3:42:22,  3.46it/s]
 88%|████████▊ | 325254/371472 [3:42:47<3:43:33,  3.45it/s]
 88%|████████▊ | 325255/371472 [3:42:48<3:59:12,  3.22it/s]
 88%|████████▊ | 325256/371472 [3:42:48<3:47:43,  3.38it/s]
 88%|████████▊ | 325257/371472 [3:42:48<4:08:39,  3.10it/s]
 88%|████████▊ | 325258/371472 [3:42:49<4:03:23,  3.16it/s]
 88%|████████▊ | 325259/371472 [3:42:49<3:59:05,  3.22it/s]
 88%|████████▊ | 325260/371472 [3:42:49<3:45:46,  3.41it/s]
                                                           
{'loss': 2.6854, 'learning_rate': 2.120224525415329e-07, 'epoch': 14.01}

 88%|████████▊ | 325260/371472 [3:42:49<3:45:46,  3.41it/s]
 88%|████████▊ | 325261/371472 [3:42:50<4:22:10,  2.94it/s]
 88%|████████▊ | 325262/371472 [3:42:50<4:02:59,  3.17it/s]
 88%|████████▊ | 325263/371472 [3:42:50<4:08:35,  3.10it/s]
 88%|████████▊ | 325264/371472 [3:42:50<3:55:36,  3.27it/s]
 88%|████████▊ | 325265/371472 [3:42:51<3:51:16,  3.33it/s]
 88%|████████▊ | 325266/371472 [3:42:51<3:39:47,  3.50it/s]
 88%|████████▊ | 325267/371472 [3:42:51<3:34:46,  3.59it/s]
 88%|████████▊ | 325268/371472 [3:42:52<3:26:15,  3.73it/s]
 88%|████████▊ | 325269/371472 [3:42:52<3:39:59,  3.50it/s]
 88%|████████▊ | 325270/371472 [3:42:52<3:40:32,  3.49it/s]
 88%|████████▊ | 325271/371472 [3:42:53<3:59:34,  3.21it/s]
 88%|████████▊ | 325272/371472 [3:42:53<4:08:52,  3.09it/s]
 88%|████████▊ | 325273/371472 [3:42:53<3:57:11,  3.25it/s]
 88%|████████▊ | 325274/371472 [3:42:53<3:48:56,  3.36it/s]
 88%|████████▊ | 325275/371472 [3:42:54<3:44:37,  3.43it/s]
 88%|████████▊ | 325276/371472 [3:42:54<3:49:57,  3.35it/s]
 88%|████████▊ | 325277/371472 [3:42:54<3:52:03,  3.32it/s]
 88%|████████▊ | 325278/371472 [3:42:55<3:56:15,  3.26it/s]
 88%|████████▊ | 325279/371472 [3:42:55<3:51:56,  3.32it/s]
 88%|████████▊ | 325280/371472 [3:42:55<3:51:21,  3.33it/s]
                                                           
{'loss': 2.5596, 'learning_rate': 2.1197397056605397e-07, 'epoch': 14.01}

 88%|████████▊ | 325280/371472 [3:42:55<3:51:21,  3.33it/s]
 88%|████████▊ | 325281/371472 [3:42:56<3:55:55,  3.26it/s]
 88%|████████▊ | 325282/371472 [3:42:56<3:47:38,  3.38it/s]
 88%|████████▊ | 325283/371472 [3:42:56<3:47:49,  3.38it/s]
 88%|████████▊ | 325284/371472 [3:42:56<3:45:32,  3.41it/s]
 88%|████████▊ | 325285/371472 [3:42:57<3:54:21,  3.28it/s]
 88%|████████▊ | 325286/371472 [3:42:57<4:07:08,  3.11it/s]
 88%|████████▊ | 325287/371472 [3:42:57<4:03:26,  3.16it/s]
 88%|████████▊ | 325288/371472 [3:42:58<4:07:52,  3.11it/s]
 88%|████████▊ | 325289/371472 [3:42:58<4:16:35,  3.00it/s]
 88%|████████▊ | 325290/371472 [3:42:58<4:02:45,  3.17it/s]
 88%|████████▊ | 325291/371472 [3:42:59<3:57:04,  3.25it/s]
 88%|████████▊ | 325292/371472 [3:42:59<3:58:09,  3.23it/s]
 88%|████████▊ | 325293/371472 [3:42:59<3:50:05,  3.34it/s]
 88%|████████▊ | 325294/371472 [3:42:59<3:40:44,  3.49it/s]
 88%|████████▊ | 325295/371472 [3:43:00<3:50:29,  3.34it/s]
 88%|████████▊ | 325296/371472 [3:43:00<3:37:48,  3.53it/s]
 88%|████████▊ | 325297/371472 [3:43:00<3:53:19,  3.30it/s]
 88%|████████▊ | 325298/371472 [3:43:01<3:59:10,  3.22it/s]
 88%|████████▊ | 325299/371472 [3:43:01<4:00:02,  3.21it/s]
 88%|████████▊ | 325300/371472 [3:43:01<3:57:19,  3.24it/s]
                                                           
{'loss': 2.6496, 'learning_rate': 2.1192548859057512e-07, 'epoch': 14.01}

 88%|████████▊ | 325300/371472 [3:43:01<3:57:19,  3.24it/s]
 88%|████████▊ | 325301/371472 [3:43:02<4:08:48,  3.09it/s]
 88%|████████▊ | 325302/371472 [3:43:02<3:55:25,  3.27it/s]
 88%|████████▊ | 325303/371472 [3:43:02<3:52:32,  3.31it/s]
 88%|████████▊ | 325304/371472 [3:43:03<3:52:33,  3.31it/s]
 88%|████████▊ | 325305/371472 [3:43:03<3:57:29,  3.24it/s]
 88%|████████▊ | 325306/371472 [3:43:03<3:57:41,  3.24it/s]
 88%|████████▊ | 325307/371472 [3:43:04<4:01:21,  3.19it/s]
 88%|████████▊ | 325308/371472 [3:43:04<4:02:31,  3.17it/s]
 88%|████████▊ | 325309/371472 [3:43:04<3:53:38,  3.29it/s]
 88%|████████▊ | 325310/371472 [3:43:04<3:43:31,  3.44it/s]
 88%|████████▊ | 325311/371472 [3:43:05<3:35:34,  3.57it/s]
 88%|████████▊ | 325312/371472 [3:43:05<3:44:36,  3.43it/s]
 88%|████████▊ | 325313/371472 [3:43:05<3:39:30,  3.50it/s]
 88%|████████▊ | 325314/371472 [3:43:05<3:33:34,  3.60it/s]
 88%|████████▊ | 325315/371472 [3:43:06<3:48:36,  3.37it/s]
 88%|████████▊ | 325316/371472 [3:43:06<3:56:08,  3.26it/s]
 88%|████████▊ | 325317/371472 [3:43:06<3:52:03,  3.31it/s]
 88%|████████▊ | 325318/371472 [3:43:07<3:53:20,  3.30it/s]
 88%|████████▊ | 325319/371472 [3:43:07<3:51:25,  3.32it/s]
 88%|████████▊ | 325320/371472 [3:43:07<3:50:24,  3.34it/s]
                                                           
{'loss': 2.6619, 'learning_rate': 2.1187700661509617e-07, 'epoch': 14.01}

 88%|████████▊ | 325320/371472 [3:43:07<3:50:24,  3.34it/s]
 88%|████████▊ | 325321/371472 [3:43:08<3:45:24,  3.41it/s]
 88%|████████▊ | 325322/371472 [3:43:08<3:37:25,  3.54it/s]
 88%|████████▊ | 325323/371472 [3:43:08<3:52:53,  3.30it/s]
 88%|████████▊ | 325324/371472 [3:43:09<3:43:53,  3.44it/s]
 88%|████████▊ | 325325/371472 [3:43:09<3:50:41,  3.33it/s]
 88%|████████▊ | 325326/371472 [3:43:09<3:43:14,  3.45it/s]
 88%|████████▊ | 325327/371472 [3:43:09<3:44:29,  3.43it/s]
 88%|████████▊ | 325328/371472 [3:43:10<3:42:02,  3.46it/s]
 88%|████████▊ | 325329/371472 [3:43:10<3:45:32,  3.41it/s]
 88%|████████▊ | 325330/371472 [3:43:10<3:42:39,  3.45it/s]
 88%|████████▊ | 325331/371472 [3:43:11<3:54:06,  3.28it/s]
 88%|████████▊ | 325332/371472 [3:43:11<3:47:29,  3.38it/s]
 88%|████████▊ | 325333/371472 [3:43:11<3:52:21,  3.31it/s]
 88%|████████▊ | 325334/371472 [3:43:11<3:52:46,  3.30it/s]
 88%|████████▊ | 325335/371472 [3:43:12<3:46:09,  3.40it/s]
 88%|████████▊ | 325336/371472 [3:43:12<3:55:44,  3.26it/s]
 88%|████████▊ | 325337/371472 [3:43:12<3:57:12,  3.24it/s]
 88%|████████▊ | 325338/371472 [3:43:13<3:57:41,  3.23it/s]
 88%|████████▊ | 325339/371472 [3:43:13<3:47:38,  3.38it/s]
 88%|████████▊ | 325340/371472 [3:43:13<4:09:27,  3.08it/s]
                                                           
{'loss': 2.5829, 'learning_rate': 2.1182852463961735e-07, 'epoch': 14.01}

 88%|████████▊ | 325340/371472 [3:43:13<4:09:27,  3.08it/s]
 88%|████████▊ | 325341/371472 [3:43:14<3:56:33,  3.25it/s]
 88%|████████▊ | 325342/371472 [3:43:14<3:47:54,  3.37it/s]
 88%|████████▊ | 325343/371472 [3:43:14<3:44:01,  3.43it/s]
 88%|████████▊ | 325344/371472 [3:43:14<3:41:36,  3.47it/s]
 88%|████████▊ | 325345/371472 [3:43:15<3:51:00,  3.33it/s]
 88%|████████▊ | 325346/371472 [3:43:15<4:04:34,  3.14it/s]
 88%|████████▊ | 325347/371472 [3:43:16<4:22:04,  2.93it/s]
 88%|████████▊ | 325348/371472 [3:43:16<4:08:18,  3.10it/s]
 88%|████████▊ | 325349/371472 [3:43:16<4:10:03,  3.07it/s]
 88%|████████▊ | 325350/371472 [3:43:16<4:06:41,  3.12it/s]
 88%|████████▊ | 325351/371472 [3:43:17<4:02:18,  3.17it/s]
 88%|████████▊ | 325352/371472 [3:43:17<4:06:57,  3.11it/s]
 88%|████████▊ | 325353/371472 [3:43:17<4:04:58,  3.14it/s]
 88%|████████▊ | 325354/371472 [3:43:18<3:49:31,  3.35it/s]
 88%|████████▊ | 325355/371472 [3:43:18<3:48:24,  3.37it/s]
 88%|████████▊ | 325356/371472 [3:43:18<3:37:27,  3.53it/s]
 88%|████████▊ | 325357/371472 [3:43:19<3:33:55,  3.59it/s]
 88%|████████▊ | 325358/371472 [3:43:19<3:30:05,  3.66it/s]
 88%|████████▊ | 325359/371472 [3:43:19<3:56:07,  3.25it/s]
 88%|████████▊ | 325360/371472 [3:43:19<3:51:18,  3.32it/s]
                                                           
{'loss': 2.5924, 'learning_rate': 2.117800426641384e-07, 'epoch': 14.01}

 88%|████████▊ | 325360/371472 [3:43:19<3:51:18,  3.32it/s]
 88%|████████▊ | 325361/371472 [3:43:20<3:45:21,  3.41it/s]
 88%|████████▊ | 325362/371472 [3:43:20<3:38:10,  3.52it/s]
 88%|████████▊ | 325363/371472 [3:43:20<3:30:52,  3.64it/s]
 88%|████████▊ | 325364/371472 [3:43:20<3:27:19,  3.71it/s]
 88%|████████▊ | 325365/371472 [3:43:21<3:35:41,  3.56it/s]
 88%|████████▊ | 325366/371472 [3:43:21<3:32:12,  3.62it/s]
 88%|████████▊ | 325367/371472 [3:43:21<3:34:21,  3.58it/s]
 88%|████████▊ | 325368/371472 [3:43:22<3:40:09,  3.49it/s]
 88%|████████▊ | 325369/371472 [3:43:22<3:54:25,  3.28it/s]
 88%|████████▊ | 325370/371472 [3:43:22<3:56:23,  3.25it/s]
 88%|████████▊ | 325371/371472 [3:43:23<3:52:41,  3.30it/s]
 88%|████████▊ | 325372/371472 [3:43:23<3:44:26,  3.42it/s]
 88%|████████▊ | 325373/371472 [3:43:23<3:36:16,  3.55it/s]
 88%|████████▊ | 325374/371472 [3:43:23<3:43:28,  3.44it/s]
 88%|████████▊ | 325375/371472 [3:43:24<3:37:03,  3.54it/s]
 88%|████████▊ | 325376/371472 [3:43:24<3:39:26,  3.50it/s]
 88%|████████▊ | 325377/371472 [3:43:24<3:36:09,  3.55it/s]
 88%|████████▊ | 325378/371472 [3:43:25<3:34:37,  3.58it/s]
 88%|████████▊ | 325379/371472 [3:43:25<3:27:55,  3.69it/s]
 88%|████████▊ | 325380/371472 [3:43:25<3:36:15,  3.55it/s]
                                                           
{'loss': 2.6212, 'learning_rate': 2.1173156068865954e-07, 'epoch': 14.01}

 88%|████████▊ | 325380/371472 [3:43:25<3:36:15,  3.55it/s]
 88%|████████▊ | 325381/371472 [3:43:25<3:44:28,  3.42it/s]
 88%|████████▊ | 325382/371472 [3:43:26<3:43:14,  3.44it/s]
 88%|████████▊ | 325383/371472 [3:43:26<3:39:05,  3.51it/s]
 88%|████████▊ | 325384/371472 [3:43:26<3:56:52,  3.24it/s]
 88%|████████▊ | 325385/371472 [3:43:27<4:01:51,  3.18it/s]
 88%|████████▊ | 325386/371472 [3:43:27<3:52:05,  3.31it/s]
 88%|████████▊ | 325387/371472 [3:43:27<3:49:31,  3.35it/s]
 88%|████████▊ | 325388/371472 [3:43:28<3:57:21,  3.24it/s]
 88%|████████▊ | 325389/371472 [3:43:28<3:48:41,  3.36it/s]
 88%|████████▊ | 325390/371472 [3:43:28<3:48:46,  3.36it/s]
 88%|████████▊ | 325391/371472 [3:43:28<3:44:49,  3.42it/s]
 88%|████████▊ | 325392/371472 [3:43:29<3:46:18,  3.39it/s]
 88%|████████▊ | 325393/371472 [3:43:29<3:36:40,  3.54it/s]
 88%|████████▊ | 325394/371472 [3:43:29<3:29:56,  3.66it/s]
 88%|████████▊ | 325395/371472 [3:43:29<3:24:30,  3.76it/s]
 88%|████████▊ | 325396/371472 [3:43:30<3:20:56,  3.82it/s]
 88%|████████▊ | 325397/371472 [3:43:30<3:19:47,  3.84it/s]
 88%|████████▊ | 325398/371472 [3:43:30<3:24:35,  3.75it/s]
 88%|████████▊ | 325399/371472 [3:43:31<3:21:16,  3.81it/s]
 88%|████████▊ | 325400/371472 [3:43:31<3:36:48,  3.54it/s]
                                                           
{'loss': 2.705, 'learning_rate': 2.1168307871318061e-07, 'epoch': 14.02}

 88%|████████▊ | 325400/371472 [3:43:31<3:36:48,  3.54it/s]
 88%|████████▊ | 325401/371472 [3:43:31<3:33:27,  3.60it/s]
 88%|████████▊ | 325402/371472 [3:43:31<3:24:29,  3.75it/s]
 88%|████████▊ | 325403/371472 [3:43:32<3:26:44,  3.71it/s]
 88%|████████▊ | 325404/371472 [3:43:32<3:29:22,  3.67it/s]
 88%|████████▊ | 325405/371472 [3:43:32<3:34:07,  3.59it/s]
 88%|████████▊ | 325406/371472 [3:43:32<3:35:47,  3.56it/s]
 88%|████████▊ | 325407/371472 [3:43:33<3:40:24,  3.48it/s]
 88%|████████▊ | 325408/371472 [3:43:33<3:35:07,  3.57it/s]
 88%|████████▊ | 325409/371472 [3:43:33<3:41:32,  3.47it/s]
 88%|████████▊ | 325410/371472 [3:43:34<3:41:19,  3.47it/s]
 88%|████████▊ | 325411/371472 [3:43:34<3:56:48,  3.24it/s]
 88%|████████▊ | 325412/371472 [3:43:34<3:51:11,  3.32it/s]
 88%|████████▊ | 325413/371472 [3:43:35<3:44:58,  3.41it/s]
 88%|████████▊ | 325414/371472 [3:43:35<3:36:47,  3.54it/s]
 88%|████████▊ | 325415/371472 [3:43:35<3:50:05,  3.34it/s]
 88%|████████▊ | 325416/371472 [3:43:35<3:55:42,  3.26it/s]
 88%|████████▊ | 325417/371472 [3:43:36<3:46:38,  3.39it/s]
 88%|████████▊ | 325418/371472 [3:43:36<3:52:43,  3.30it/s]
 88%|████████▊ | 325419/371472 [3:43:36<3:42:04,  3.46it/s]
 88%|████████▊ | 325420/371472 [3:43:37<3:46:45,  3.38it/s]
                                                           
{'loss': 2.862, 'learning_rate': 2.1163459673770177e-07, 'epoch': 14.02}

 88%|████████▊ | 325420/371472 [3:43:37<3:46:45,  3.38it/s]
 88%|████████▊ | 325421/371472 [3:43:37<3:52:18,  3.30it/s]
 88%|████████▊ | 325422/371472 [3:43:37<3:45:40,  3.40it/s]
 88%|████████▊ | 325423/371472 [3:43:38<3:54:57,  3.27it/s]
 88%|████████▊ | 325424/371472 [3:43:38<3:44:38,  3.42it/s]
 88%|████████▊ | 325425/371472 [3:43:38<3:36:25,  3.55it/s]
 88%|████████▊ | 325426/371472 [3:43:38<3:46:38,  3.39it/s]
 88%|████████▊ | 325427/371472 [3:43:39<3:46:49,  3.38it/s]
 88%|████████▊ | 325428/371472 [3:43:39<3:38:48,  3.51it/s]
 88%|████████▊ | 325429/371472 [3:43:39<3:36:12,  3.55it/s]
 88%|████████▊ | 325430/371472 [3:43:39<3:31:34,  3.63it/s]
 88%|████████▊ | 325431/371472 [3:43:40<3:27:20,  3.70it/s]
 88%|████████▊ | 325432/371472 [3:43:40<3:26:31,  3.72it/s]
 88%|████████▊ | 325433/371472 [3:43:40<4:02:14,  3.17it/s]
 88%|████████▊ | 325434/371472 [3:43:41<3:56:50,  3.24it/s]
 88%|████████▊ | 325435/371472 [3:43:41<3:57:35,  3.23it/s]
 88%|████████▊ | 325436/371472 [3:43:41<4:02:24,  3.17it/s]
 88%|████████▊ | 325437/371472 [3:43:42<3:59:37,  3.20it/s]
 88%|████████▊ | 325438/371472 [3:43:42<3:48:04,  3.36it/s]
 88%|████████▊ | 325439/371472 [3:43:42<3:39:26,  3.50it/s]
 88%|████████▊ | 325440/371472 [3:43:43<3:47:05,  3.38it/s]
                                                           
{'loss': 2.6015, 'learning_rate': 2.115861147622228e-07, 'epoch': 14.02}

 88%|████████▊ | 325440/371472 [3:43:43<3:47:05,  3.38it/s]
 88%|████████▊ | 325441/371472 [3:43:43<3:52:01,  3.31it/s]
 88%|████████▊ | 325442/371472 [3:43:43<3:51:12,  3.32it/s]
 88%|████████▊ | 325443/371472 [3:43:44<4:05:15,  3.13it/s]
 88%|████████▊ | 325444/371472 [3:43:44<4:07:38,  3.10it/s]
 88%|████████▊ | 325445/371472 [3:43:44<4:11:34,  3.05it/s]
 88%|████████▊ | 325446/371472 [3:43:44<4:05:12,  3.13it/s]
 88%|████████▊ | 325447/371472 [3:43:45<3:54:08,  3.28it/s]
 88%|████████▊ | 325448/371472 [3:43:45<4:22:37,  2.92it/s]
 88%|████████▊ | 325449/371472 [3:43:45<4:11:22,  3.05it/s]
 88%|████████▊ | 325450/371472 [3:43:46<3:55:47,  3.25it/s]
 88%|████████▊ | 325451/371472 [3:43:46<3:55:43,  3.25it/s]
 88%|████████▊ | 325452/371472 [3:43:46<3:55:23,  3.26it/s]
 88%|████████▊ | 325453/371472 [3:43:47<3:49:17,  3.35it/s]
 88%|████████▊ | 325454/371472 [3:43:47<3:47:00,  3.38it/s]
 88%|████████▊ | 325455/371472 [3:43:47<3:46:38,  3.38it/s]
 88%|████████▊ | 325456/371472 [3:43:47<3:43:57,  3.42it/s]
 88%|████████▊ | 325457/371472 [3:43:48<3:32:31,  3.61it/s]
 88%|████████▊ | 325458/371472 [3:43:48<3:30:22,  3.65it/s]
 88%|████████▊ | 325459/371472 [3:43:48<3:33:28,  3.59it/s]
 88%|████████▊ | 325460/371472 [3:43:49<3:30:14,  3.65it/s]
                                                           
{'loss': 2.5867, 'learning_rate': 2.11537632786744e-07, 'epoch': 14.02}

 88%|████████▊ | 325460/371472 [3:43:49<3:30:14,  3.65it/s]
 88%|████████▊ | 325461/371472 [3:43:49<3:30:27,  3.64it/s]
 88%|████████▊ | 325462/371472 [3:43:49<3:22:11,  3.79it/s]
 88%|████████▊ | 325463/371472 [3:43:49<3:27:32,  3.69it/s]
 88%|████████▊ | 325464/371472 [3:43:50<3:24:11,  3.76it/s]
 88%|████████▊ | 325465/371472 [3:43:50<3:18:57,  3.85it/s]
 88%|████████▊ | 325466/371472 [3:43:50<3:19:47,  3.84it/s]
 88%|████████▊ | 325467/371472 [3:43:50<3:19:09,  3.85it/s]
 88%|████████▊ | 325468/371472 [3:43:51<3:16:51,  3.89it/s]
 88%|████████▊ | 325469/371472 [3:43:51<3:32:43,  3.60it/s]
 88%|████████▊ | 325470/371472 [3:43:51<3:26:05,  3.72it/s]
 88%|████████▊ | 325471/371472 [3:43:51<3:25:48,  3.73it/s]
 88%|████████▊ | 325472/371472 [3:43:52<3:28:49,  3.67it/s]
 88%|████████▊ | 325473/371472 [3:43:52<3:29:33,  3.66it/s]
 88%|████████▊ | 325474/371472 [3:43:52<3:27:16,  3.70it/s]
 88%|████████▊ | 325475/371472 [3:43:53<3:28:19,  3.68it/s]
 88%|████████▊ | 325476/371472 [3:43:53<3:48:39,  3.35it/s]
 88%|████████▊ | 325477/371472 [3:43:53<3:44:42,  3.41it/s]
 88%|████████▊ | 325478/371472 [3:43:54<4:05:06,  3.13it/s]
 88%|████████▊ | 325479/371472 [3:43:54<3:45:14,  3.40it/s]
 88%|████████▊ | 325480/371472 [3:43:54<3:45:01,  3.41it/s]
                                                           
{'loss': 2.7102, 'learning_rate': 2.1148915081126503e-07, 'epoch': 14.02}

 88%|████████▊ | 325480/371472 [3:43:54<3:45:01,  3.41it/s]
 88%|████████▊ | 325481/371472 [3:43:54<3:43:11,  3.43it/s]
 88%|████████▊ | 325482/371472 [3:43:55<3:39:13,  3.50it/s]
 88%|████████▊ | 325483/371472 [3:43:55<3:28:42,  3.67it/s]
 88%|████████▊ | 325484/371472 [3:43:55<3:53:00,  3.29it/s]
 88%|████████▊ | 325485/371472 [3:43:56<3:46:01,  3.39it/s]
 88%|████████▊ | 325486/371472 [3:43:56<3:35:28,  3.56it/s]
 88%|████████▊ | 325487/371472 [3:43:56<3:35:26,  3.56it/s]
 88%|████████▊ | 325488/371472 [3:43:56<3:32:21,  3.61it/s]
 88%|████████▊ | 325489/371472 [3:43:57<3:46:05,  3.39it/s]
 88%|████████▊ | 325490/371472 [3:43:57<3:40:03,  3.48it/s]
 88%|████████▊ | 325491/371472 [3:43:57<3:49:27,  3.34it/s]
 88%|████████▊ | 325492/371472 [3:43:58<3:53:45,  3.28it/s]
 88%|████████▊ | 325493/371472 [3:43:58<3:44:02,  3.42it/s]
 88%|████████▊ | 325494/371472 [3:43:58<3:37:33,  3.52it/s]
 88%|████████▊ | 325495/371472 [3:43:58<3:26:38,  3.71it/s]
 88%|████████▊ | 325496/371472 [3:43:59<3:40:33,  3.47it/s]
 88%|████████▊ | 325497/371472 [3:43:59<3:42:10,  3.45it/s]
 88%|████████▊ | 325498/371472 [3:43:59<3:33:46,  3.58it/s]
 88%|████████▊ | 325499/371472 [3:43:59<3:26:00,  3.72it/s]
 88%|████████▊ | 325500/371472 [3:44:00<3:18:44,  3.86it/s]
                                                           
{'loss': 2.4939, 'learning_rate': 2.1144066883578618e-07, 'epoch': 14.02}

 88%|████████▊ | 325500/371472 [3:44:00<3:18:44,  3.86it/s]
 88%|████████▊ | 325501/371472 [3:44:00<3:17:47,  3.87it/s]
 88%|████████▊ | 325502/371472 [3:44:00<3:27:33,  3.69it/s]
 88%|████████▊ | 325503/371472 [3:44:01<3:44:26,  3.41it/s]
 88%|████████▊ | 325504/371472 [3:44:01<3:42:39,  3.44it/s]
 88%|████████▊ | 325505/371472 [3:44:01<3:34:26,  3.57it/s]
 88%|████████▊ | 325506/371472 [3:44:01<3:28:11,  3.68it/s]
 88%|████████▊ | 325507/371472 [3:44:02<3:22:32,  3.78it/s]
 88%|████████▊ | 325508/371472 [3:44:02<3:18:57,  3.85it/s]
 88%|████████▊ | 325509/371472 [3:44:02<3:16:57,  3.89it/s]
 88%|████████▊ | 325510/371472 [3:44:03<3:32:39,  3.60it/s]
 88%|████████▊ | 325511/371472 [3:44:03<3:27:26,  3.69it/s]
 88%|████████▊ | 325512/371472 [3:44:03<3:23:31,  3.76it/s]
 88%|████████▊ | 325513/371472 [3:44:03<3:24:15,  3.75it/s]
 88%|████████▊ | 325514/371472 [3:44:04<3:49:18,  3.34it/s]
 88%|████████▊ | 325515/371472 [3:44:04<3:46:46,  3.38it/s]
 88%|████████▊ | 325516/371472 [3:44:04<3:33:22,  3.59it/s]
 88%|████████▊ | 325517/371472 [3:44:04<3:41:07,  3.46it/s]
 88%|████████▊ | 325518/371472 [3:44:05<3:59:37,  3.20it/s]
 88%|████████▊ | 325519/371472 [3:44:05<4:06:11,  3.11it/s]
 88%|████████▊ | 325520/371472 [3:44:05<3:58:52,  3.21it/s]
                                                           
{'loss': 2.577, 'learning_rate': 2.1139218686030725e-07, 'epoch': 14.02}

 88%|████████▊ | 325520/371472 [3:44:05<3:58:52,  3.21it/s]
 88%|████████▊ | 325521/371472 [3:44:06<3:41:56,  3.45it/s]
 88%|████████▊ | 325522/371472 [3:44:06<3:41:37,  3.46it/s]
 88%|████████▊ | 325523/371472 [3:44:06<3:36:26,  3.54it/s]
 88%|████████▊ | 325524/371472 [3:44:07<3:31:56,  3.61it/s]
 88%|████████▊ | 325525/371472 [3:44:07<3:40:22,  3.47it/s]
 88%|████████▊ | 325526/371472 [3:44:07<3:32:27,  3.60it/s]
 88%|████████▊ | 325527/371472 [3:44:07<3:25:15,  3.73it/s]
 88%|████████▊ | 325528/371472 [3:44:08<3:22:23,  3.78it/s]
 88%|████████▊ | 325529/371472 [3:44:08<3:28:42,  3.67it/s]
 88%|████████▊ | 325530/371472 [3:44:08<3:20:27,  3.82it/s]
 88%|████████▊ | 325531/371472 [3:44:08<3:18:00,  3.87it/s]
 88%|████████▊ | 325532/371472 [3:44:09<3:17:09,  3.88it/s]
 88%|████████▊ | 325533/371472 [3:44:09<3:21:32,  3.80it/s]
 88%|████████▊ | 325534/371472 [3:44:09<3:24:27,  3.74it/s]
 88%|████████▊ | 325535/371472 [3:44:09<3:24:52,  3.74it/s]
 88%|████████▊ | 325536/371472 [3:44:10<3:26:44,  3.70it/s]
 88%|████████▊ | 325537/371472 [3:44:10<3:22:22,  3.78it/s]
 88%|████████▊ | 325538/371472 [3:44:10<3:33:05,  3.59it/s]
 88%|████████▊ | 325539/371472 [3:44:11<3:29:39,  3.65it/s]
 88%|████████▊ | 325540/371472 [3:44:11<3:30:24,  3.64it/s]
                                                           
{'loss': 2.5337, 'learning_rate': 2.113437048848284e-07, 'epoch': 14.02}

 88%|████████▊ | 325540/371472 [3:44:11<3:30:24,  3.64it/s]
 88%|████████▊ | 325541/371472 [3:44:11<3:32:58,  3.59it/s]
 88%|████████▊ | 325542/371472 [3:44:11<3:26:26,  3.71it/s]
 88%|████████▊ | 325543/371472 [3:44:12<3:19:05,  3.84it/s]
 88%|████████▊ | 325544/371472 [3:44:12<3:15:29,  3.92it/s]
 88%|████████▊ | 325545/371472 [3:44:12<3:20:18,  3.82it/s]
 88%|████████▊ | 325546/371472 [3:44:12<3:27:45,  3.68it/s]
 88%|████████▊ | 325547/371472 [3:44:13<3:22:05,  3.79it/s]
 88%|████████▊ | 325548/371472 [3:44:13<3:16:46,  3.89it/s]
 88%|████████▊ | 325549/371472 [3:44:13<3:23:49,  3.76it/s]
 88%|████████▊ | 325550/371472 [3:44:14<3:28:42,  3.67it/s]
 88%|████████▊ | 325551/371472 [3:44:14<3:19:12,  3.84it/s]
 88%|████████▊ | 325552/371472 [3:44:14<3:27:57,  3.68it/s]
 88%|████████▊ | 325553/371472 [3:44:14<3:28:37,  3.67it/s]
 88%|████████▊ | 325554/371472 [3:44:15<3:34:26,  3.57it/s]
 88%|████████▊ | 325555/371472 [3:44:15<3:41:59,  3.45it/s]
 88%|████████▊ | 325556/371472 [3:44:15<3:39:53,  3.48it/s]
 88%|████████▊ | 325557/371472 [3:44:15<3:32:26,  3.60it/s]
 88%|████████▊ | 325558/371472 [3:44:16<3:31:00,  3.63it/s]
 88%|████████▊ | 325559/371472 [3:44:16<3:42:24,  3.44it/s]
 88%|████████▊ | 325560/371472 [3:44:16<3:35:57,  3.54it/s]
                                                           
{'loss': 2.657, 'learning_rate': 2.1129522290934945e-07, 'epoch': 14.02}

 88%|████████▊ | 325560/371472 [3:44:16<3:35:57,  3.54it/s]
 88%|████████▊ | 325561/371472 [3:44:17<3:31:43,  3.61it/s]
 88%|████████▊ | 325562/371472 [3:44:17<3:40:45,  3.47it/s]
 88%|████████▊ | 325563/371472 [3:44:17<3:57:37,  3.22it/s]
 88%|████████▊ | 325564/371472 [3:44:18<3:45:08,  3.40it/s]
 88%|████████▊ | 325565/371472 [3:44:18<3:47:59,  3.36it/s]
 88%|████████▊ | 325566/371472 [3:44:18<3:51:41,  3.30it/s]
 88%|████████▊ | 325567/371472 [3:44:18<3:46:43,  3.37it/s]
 88%|████████▊ | 325568/371472 [3:44:19<3:39:06,  3.49it/s]
 88%|████████▊ | 325569/371472 [3:44:19<3:35:19,  3.55it/s]
 88%|████████▊ | 325570/371472 [3:44:19<3:40:09,  3.47it/s]
 88%|████████▊ | 325571/371472 [3:44:19<3:30:08,  3.64it/s]
 88%|████████▊ | 325572/371472 [3:44:20<3:43:27,  3.42it/s]
 88%|████████▊ | 325573/371472 [3:44:20<3:35:29,  3.55it/s]
 88%|████████▊ | 325574/371472 [3:44:20<3:31:52,  3.61it/s]
 88%|████████▊ | 325575/371472 [3:44:21<3:25:13,  3.73it/s]
 88%|████████▊ | 325576/371472 [3:44:21<3:26:19,  3.71it/s]
 88%|████████▊ | 325577/371472 [3:44:21<3:34:16,  3.57it/s]
 88%|████████▊ | 325578/371472 [3:44:21<3:35:37,  3.55it/s]
 88%|████████▊ | 325579/371472 [3:44:22<3:28:26,  3.67it/s]
 88%|████████▊ | 325580/371472 [3:44:22<3:27:04,  3.69it/s]
                                                           
{'loss': 2.7199, 'learning_rate': 2.1124674093387052e-07, 'epoch': 14.02}

 88%|████████▊ | 325580/371472 [3:44:22<3:27:04,  3.69it/s]
 88%|████████▊ | 325581/371472 [3:44:22<3:29:50,  3.64it/s]
 88%|████████▊ | 325582/371472 [3:44:23<3:24:35,  3.74it/s]
 88%|████████▊ | 325583/371472 [3:44:23<3:33:39,  3.58it/s]
 88%|████████▊ | 325584/371472 [3:44:23<3:30:19,  3.64it/s]
 88%|████████▊ | 325585/371472 [3:44:23<3:56:44,  3.23it/s]
 88%|████████▊ | 325586/371472 [3:44:24<3:44:37,  3.40it/s]
 88%|████████▊ | 325587/371472 [3:44:24<3:45:48,  3.39it/s]
 88%|████████▊ | 325588/371472 [3:44:24<4:04:32,  3.13it/s]
 88%|████████▊ | 325589/371472 [3:44:25<3:52:48,  3.28it/s]
 88%|████████▊ | 325590/371472 [3:44:25<3:41:29,  3.45it/s]
 88%|████████▊ | 325591/371472 [3:44:25<3:45:56,  3.38it/s]
 88%|████████▊ | 325592/371472 [3:44:26<3:40:20,  3.47it/s]
 88%|████████▊ | 325593/371472 [3:44:26<3:30:27,  3.63it/s]
 88%|████████▊ | 325594/371472 [3:44:26<3:30:11,  3.64it/s]
 88%|████████▊ | 325595/371472 [3:44:26<3:38:33,  3.50it/s]
 88%|████████▊ | 325596/371472 [3:44:27<3:30:55,  3.62it/s]
 88%|████████▊ | 325597/371472 [3:44:27<3:25:23,  3.72it/s]
 88%|████████▊ | 325598/371472 [3:44:27<3:25:46,  3.72it/s]
 88%|████████▊ | 325599/371472 [3:44:27<3:21:13,  3.80it/s]
 88%|████████▊ | 325600/371472 [3:44:28<3:25:45,  3.72it/s]
                                                           
{'loss': 2.5682, 'learning_rate': 2.111982589583917e-07, 'epoch': 14.02}

 88%|████████▊ | 325600/371472 [3:44:28<3:25:45,  3.72it/s]
 88%|████████▊ | 325601/371472 [3:44:28<3:20:23,  3.82it/s]
 88%|████████▊ | 325602/371472 [3:44:28<3:22:18,  3.78it/s]
 88%|████████▊ | 325603/371472 [3:44:28<3:24:47,  3.73it/s]
 88%|████████▊ | 325604/371472 [3:44:29<3:22:06,  3.78it/s]
 88%|████████▊ | 325605/371472 [3:44:29<3:35:01,  3.56it/s]
 88%|████████▊ | 325606/371472 [3:44:29<3:27:11,  3.69it/s]
 88%|████████▊ | 325607/371472 [3:44:30<3:46:24,  3.38it/s]
 88%|████████▊ | 325608/371472 [3:44:30<3:43:15,  3.42it/s]
 88%|████████▊ | 325609/371472 [3:44:30<3:39:58,  3.47it/s]
 88%|████████▊ | 325610/371472 [3:44:30<3:43:47,  3.42it/s]
 88%|████████▊ | 325611/371472 [3:44:31<3:35:36,  3.55it/s]
 88%|████████▊ | 325612/371472 [3:44:31<3:30:13,  3.64it/s]
 88%|████████▊ | 325613/371472 [3:44:31<3:36:23,  3.53it/s]
 88%|████████▊ | 325614/371472 [3:44:32<3:26:07,  3.71it/s]
 88%|████████▊ | 325615/371472 [3:44:32<3:24:40,  3.73it/s]
 88%|████████▊ | 325616/371472 [3:44:32<3:25:12,  3.72it/s]
 88%|████████▊ | 325617/371472 [3:44:32<3:28:45,  3.66it/s]
 88%|████████▊ | 325618/371472 [3:44:33<3:27:05,  3.69it/s]
 88%|████████▊ | 325619/371472 [3:44:33<3:23:43,  3.75it/s]
 88%|████████▊ | 325620/371472 [3:44:33<3:22:11,  3.78it/s]
                                                           
{'loss': 2.5102, 'learning_rate': 2.1114977698291274e-07, 'epoch': 14.03}

 88%|████████▊ | 325620/371472 [3:44:33<3:22:11,  3.78it/s]
 88%|████████▊ | 325621/371472 [3:44:33<3:18:04,  3.86it/s]
 88%|████████▊ | 325622/371472 [3:44:34<3:19:30,  3.83it/s]
 88%|████████▊ | 325623/371472 [3:44:34<3:30:44,  3.63it/s]
 88%|████████▊ | 325624/371472 [3:44:34<3:34:27,  3.56it/s]
 88%|████████▊ | 325625/371472 [3:44:35<3:29:28,  3.65it/s]
 88%|████████▊ | 325626/371472 [3:44:35<3:46:23,  3.38it/s]
 88%|████████▊ | 325627/371472 [3:44:35<3:40:24,  3.47it/s]
 88%|████████▊ | 325628/371472 [3:44:35<3:45:49,  3.38it/s]
 88%|████████▊ | 325629/371472 [3:44:36<3:56:38,  3.23it/s]
 88%|████████▊ | 325630/371472 [3:44:36<3:41:34,  3.45it/s]
 88%|████████▊ | 325631/371472 [3:44:36<3:52:12,  3.29it/s]
 88%|████████▊ | 325632/371472 [3:44:37<3:42:12,  3.44it/s]
 88%|████████▊ | 325633/371472 [3:44:37<3:32:11,  3.60it/s]
 88%|████████▊ | 325634/371472 [3:44:37<3:28:30,  3.66it/s]
 88%|████████▊ | 325635/371472 [3:44:37<3:41:12,  3.45it/s]
 88%|████████▊ | 325636/371472 [3:44:38<3:55:59,  3.24it/s]
 88%|████████▊ | 325637/371472 [3:44:38<4:04:07,  3.13it/s]
 88%|████████▊ | 325638/371472 [3:44:38<3:58:23,  3.20it/s]
 88%|████████▊ | 325639/371472 [3:44:39<3:44:46,  3.40it/s]
 88%|████████▊ | 325640/371472 [3:44:39<3:35:17,  3.55it/s]
                                                           
{'loss': 2.5134, 'learning_rate': 2.111012950074339e-07, 'epoch': 14.03}

 88%|████████▊ | 325640/371472 [3:44:39<3:35:17,  3.55it/s]
 88%|████████▊ | 325641/371472 [3:44:39<3:33:42,  3.57it/s]
 88%|████████▊ | 325642/371472 [3:44:40<3:33:40,  3.57it/s]
 88%|████████▊ | 325643/371472 [3:44:40<3:39:25,  3.48it/s]
 88%|████████▊ | 325644/371472 [3:44:40<3:28:07,  3.67it/s]
 88%|████████▊ | 325645/371472 [3:44:40<3:40:15,  3.47it/s]
 88%|████████▊ | 325646/371472 [3:44:41<3:31:20,  3.61it/s]
 88%|████████▊ | 325647/371472 [3:44:41<3:29:06,  3.65it/s]
 88%|████████▊ | 325648/371472 [3:44:41<3:40:45,  3.46it/s]
 88%|████████▊ | 325649/371472 [3:44:41<3:35:22,  3.55it/s]
 88%|████████▊ | 325650/371472 [3:44:42<3:32:15,  3.60it/s]
 88%|████████▊ | 325651/371472 [3:44:42<3:28:29,  3.66it/s]
 88%|████████▊ | 325652/371472 [3:44:42<3:24:51,  3.73it/s]
 88%|████████▊ | 325653/371472 [3:44:43<3:28:06,  3.67it/s]
 88%|████████▊ | 325654/371472 [3:44:43<3:28:13,  3.67it/s]
 88%|████████▊ | 325655/371472 [3:44:43<3:21:21,  3.79it/s]
 88%|████████▊ | 325656/371472 [3:44:43<3:48:27,  3.34it/s]
 88%|████████▊ | 325657/371472 [3:44:44<3:37:22,  3.51it/s]
 88%|████████▊ | 325658/371472 [3:44:44<3:30:00,  3.64it/s]
 88%|████████▊ | 325659/371472 [3:44:44<3:29:54,  3.64it/s]
 88%|████████▊ | 325660/371472 [3:44:44<3:26:12,  3.70it/s]
                                                           
{'loss': 2.7421, 'learning_rate': 2.1105281303195497e-07, 'epoch': 14.03}

 88%|████████▊ | 325660/371472 [3:44:45<3:26:12,  3.70it/s]
 88%|████████▊ | 325661/371472 [3:44:45<3:44:39,  3.40it/s]
 88%|████████▊ | 325662/371472 [3:44:45<3:40:06,  3.47it/s]
 88%|████████▊ | 325663/371472 [3:44:45<3:27:33,  3.68it/s]
 88%|████████▊ | 325664/371472 [3:44:46<3:19:25,  3.83it/s]
 88%|████████▊ | 325665/371472 [3:44:46<3:25:01,  3.72it/s]
 88%|████████▊ | 325666/371472 [3:44:46<3:32:50,  3.59it/s]
 88%|████████▊ | 325667/371472 [3:44:46<3:31:17,  3.61it/s]
 88%|████████▊ | 325668/371472 [3:44:47<3:38:05,  3.50it/s]
 88%|████████▊ | 325669/371472 [3:44:47<3:37:30,  3.51it/s]
 88%|████████▊ | 325670/371472 [3:44:47<3:29:50,  3.64it/s]
 88%|████████▊ | 325671/371472 [3:44:48<3:25:44,  3.71it/s]
 88%|████████▊ | 325672/371472 [3:44:48<3:19:56,  3.82it/s]
 88%|████████▊ | 325673/371472 [3:44:48<3:23:39,  3.75it/s]
 88%|████████▊ | 325674/371472 [3:44:48<3:14:32,  3.92it/s]
 88%|████████▊ | 325675/371472 [3:44:49<3:42:10,  3.44it/s]
 88%|████████▊ | 325676/371472 [3:44:49<3:35:58,  3.53it/s]
 88%|████████▊ | 325677/371472 [3:44:49<3:41:12,  3.45it/s]
 88%|████████▊ | 325678/371472 [3:44:49<3:31:23,  3.61it/s]
 88%|████████▊ | 325679/371472 [3:44:50<3:36:30,  3.53it/s]
 88%|████████▊ | 325680/371472 [3:44:50<3:29:29,  3.64it/s]
                                                           
{'loss': 2.6455, 'learning_rate': 2.1100433105647612e-07, 'epoch': 14.03}

 88%|████████▊ | 325680/371472 [3:44:50<3:29:29,  3.64it/s]
 88%|████████▊ | 325681/371472 [3:44:50<3:27:16,  3.68it/s]
 88%|████████▊ | 325682/371472 [3:44:51<3:27:19,  3.68it/s]
 88%|████████▊ | 325683/371472 [3:44:51<3:23:02,  3.76it/s]
 88%|████████▊ | 325684/371472 [3:44:51<3:26:47,  3.69it/s]
 88%|████████▊ | 325685/371472 [3:44:51<3:34:22,  3.56it/s]
 88%|████████▊ | 325686/371472 [3:44:52<3:36:29,  3.52it/s]
 88%|████████▊ | 325687/371472 [3:44:52<3:33:07,  3.58it/s]
 88%|████████▊ | 325688/371472 [3:44:52<3:34:21,  3.56it/s]
 88%|████████▊ | 325689/371472 [3:44:53<3:31:36,  3.61it/s]
 88%|████████▊ | 325690/371472 [3:44:53<3:24:33,  3.73it/s]
 88%|████████▊ | 325691/371472 [3:44:53<3:21:52,  3.78it/s]
 88%|████████▊ | 325692/371472 [3:44:53<3:24:02,  3.74it/s]
 88%|████████▊ | 325693/371472 [3:44:54<3:23:15,  3.75it/s]
 88%|████████▊ | 325694/371472 [3:44:54<3:26:42,  3.69it/s]
 88%|████████▊ | 325695/371472 [3:44:54<3:27:11,  3.68it/s]
 88%|████████▊ | 325696/371472 [3:44:54<3:29:05,  3.65it/s]
 88%|████████▊ | 325697/371472 [3:44:55<3:37:38,  3.51it/s]
 88%|████████▊ | 325698/371472 [3:44:55<3:31:57,  3.60it/s]
 88%|████████▊ | 325699/371472 [3:44:55<3:33:05,  3.58it/s]
 88%|████████▊ | 325700/371472 [3:44:56<3:37:07,  3.51it/s]
                                                           
{'loss': 2.6902, 'learning_rate': 2.1095584908099716e-07, 'epoch': 14.03}

 88%|████████▊ | 325700/371472 [3:44:56<3:37:07,  3.51it/s]
 88%|████████▊ | 325701/371472 [3:44:56<3:49:34,  3.32it/s]
 88%|████████▊ | 325702/371472 [3:44:56<3:58:24,  3.20it/s]
 88%|████████▊ | 325703/371472 [3:44:57<3:53:34,  3.27it/s]
 88%|████████▊ | 325704/371472 [3:44:57<3:40:29,  3.46it/s]
 88%|████████▊ | 325705/371472 [3:44:57<3:33:26,  3.57it/s]
 88%|████████▊ | 325706/371472 [3:44:57<3:36:42,  3.52it/s]
 88%|████████▊ | 325707/371472 [3:44:58<3:36:36,  3.52it/s]
 88%|████████▊ | 325708/371472 [3:44:58<3:27:07,  3.68it/s]
 88%|████████▊ | 325709/371472 [3:44:58<3:21:52,  3.78it/s]
 88%|████████▊ | 325710/371472 [3:44:58<3:22:41,  3.76it/s]
 88%|████████▊ | 325711/371472 [3:44:59<3:49:26,  3.32it/s]
 88%|████████▊ | 325712/371472 [3:44:59<3:53:17,  3.27it/s]
 88%|████████▊ | 325713/371472 [3:44:59<3:56:46,  3.22it/s]
 88%|████████▊ | 325714/371472 [3:45:00<3:54:09,  3.26it/s]
 88%|████████▊ | 325715/371472 [3:45:00<3:53:48,  3.26it/s]
 88%|████████▊ | 325716/371472 [3:45:00<3:50:21,  3.31it/s]
 88%|████████▊ | 325717/371472 [3:45:01<3:44:48,  3.39it/s]
 88%|████████▊ | 325718/371472 [3:45:01<3:37:55,  3.50it/s]
 88%|████████▊ | 325719/371472 [3:45:01<3:37:07,  3.51it/s]
 88%|████████▊ | 325720/371472 [3:45:01<3:37:29,  3.51it/s]
                                                           
{'loss': 2.6748, 'learning_rate': 2.1090736710551834e-07, 'epoch': 14.03}

 88%|████████▊ | 325720/371472 [3:45:01<3:37:29,  3.51it/s]
 88%|████████▊ | 325721/371472 [3:45:02<3:35:57,  3.53it/s]
 88%|████████▊ | 325722/371472 [3:45:02<3:33:09,  3.58it/s]
 88%|████████▊ | 325723/371472 [3:45:02<3:30:54,  3.62it/s]
 88%|████████▊ | 325724/371472 [3:45:03<3:45:37,  3.38it/s]
 88%|████████▊ | 325725/371472 [3:45:03<3:39:00,  3.48it/s]
 88%|████████▊ | 325726/371472 [3:45:03<3:30:12,  3.63it/s]
 88%|████████▊ | 325727/371472 [3:45:03<3:25:05,  3.72it/s]
 88%|████████▊ | 325728/371472 [3:45:04<3:24:56,  3.72it/s]
 88%|████████▊ | 325729/371472 [3:45:04<3:32:45,  3.58it/s]
 88%|████████▊ | 325730/371472 [3:45:04<3:36:33,  3.52it/s]
 88%|████████▊ | 325731/371472 [3:45:04<3:30:34,  3.62it/s]
 88%|████████▊ | 325732/371472 [3:45:05<3:24:20,  3.73it/s]
 88%|████████▊ | 325733/371472 [3:45:05<3:18:47,  3.83it/s]
 88%|████████▊ | 325734/371472 [3:45:05<3:23:56,  3.74it/s]
 88%|████████▊ | 325735/371472 [3:45:06<3:25:08,  3.72it/s]
 88%|████████▊ | 325736/371472 [3:45:06<3:22:02,  3.77it/s]
 88%|████████▊ | 325737/371472 [3:45:06<3:36:30,  3.52it/s]
 88%|████████▊ | 325738/371472 [3:45:06<3:58:46,  3.19it/s]
 88%|████████▊ | 325739/371472 [3:45:07<3:54:21,  3.25it/s]
 88%|████████▊ | 325740/371472 [3:45:07<3:42:33,  3.42it/s]
                                                           
{'loss': 2.5247, 'learning_rate': 2.1085888513003939e-07, 'epoch': 14.03}

 88%|████████▊ | 325740/371472 [3:45:07<3:42:33,  3.42it/s]
 88%|████████▊ | 325741/371472 [3:45:07<3:36:41,  3.52it/s]
 88%|████████▊ | 325742/371472 [3:45:08<3:38:47,  3.48it/s]
 88%|████████▊ | 325743/371472 [3:45:08<3:32:52,  3.58it/s]
 88%|████████▊ | 325744/371472 [3:45:08<3:32:29,  3.59it/s]
 88%|████████▊ | 325745/371472 [3:45:08<3:38:35,  3.49it/s]
 88%|████████▊ | 325746/371472 [3:45:09<3:31:14,  3.61it/s]
 88%|████████▊ | 325747/371472 [3:45:09<3:27:33,  3.67it/s]
 88%|████████▊ | 325748/371472 [3:45:09<3:31:15,  3.61it/s]
 88%|████████▊ | 325749/371472 [3:45:10<3:36:06,  3.53it/s]
 88%|████████▊ | 325750/371472 [3:45:10<3:36:23,  3.52it/s]
 88%|████████▊ | 325751/371472 [3:45:10<3:30:20,  3.62it/s]
 88%|████████▊ | 325752/371472 [3:45:10<3:22:20,  3.77it/s]
 88%|████████▊ | 325753/371472 [3:45:11<3:30:08,  3.63it/s]
 88%|████████▊ | 325754/371472 [3:45:11<3:34:56,  3.54it/s]
 88%|████████▊ | 325755/371472 [3:45:11<3:48:16,  3.34it/s]
 88%|████████▊ | 325756/371472 [3:45:12<3:38:56,  3.48it/s]
 88%|████████▊ | 325757/371472 [3:45:12<3:32:01,  3.59it/s]
 88%|████████▊ | 325758/371472 [3:45:12<3:33:20,  3.57it/s]
 88%|████████▊ | 325759/371472 [3:45:12<3:28:49,  3.65it/s]
 88%|████████▊ | 325760/371472 [3:45:13<3:32:13,  3.59it/s]
                                                           
{'loss': 2.7505, 'learning_rate': 2.1081040315456054e-07, 'epoch': 14.03}

 88%|████████▊ | 325760/371472 [3:45:13<3:32:13,  3.59it/s]
 88%|████████▊ | 325761/371472 [3:45:13<3:54:09,  3.25it/s]
 88%|████████▊ | 325762/371472 [3:45:13<3:48:28,  3.33it/s]
 88%|████████▊ | 325763/371472 [3:45:14<3:54:13,  3.25it/s]
 88%|████████▊ | 325764/371472 [3:45:14<3:47:11,  3.35it/s]
 88%|████████▊ | 325765/371472 [3:45:14<3:39:38,  3.47it/s]
 88%|████████▊ | 325766/371472 [3:45:14<3:34:56,  3.54it/s]
 88%|████████▊ | 325767/371472 [3:45:15<3:39:01,  3.48it/s]
 88%|████████▊ | 325768/371472 [3:45:15<3:31:52,  3.60it/s]
 88%|████████▊ | 325769/371472 [3:45:15<3:25:50,  3.70it/s]
 88%|████████▊ | 325770/371472 [3:45:15<3:24:11,  3.73it/s]
 88%|████████▊ | 325771/371472 [3:45:16<3:49:03,  3.33it/s]
 88%|████████▊ | 325772/371472 [3:45:16<3:41:39,  3.44it/s]
 88%|████████▊ | 325773/371472 [3:45:16<3:34:23,  3.55it/s]
 88%|████████▊ | 325774/371472 [3:45:17<3:32:31,  3.58it/s]
 88%|████████▊ | 325775/371472 [3:45:17<3:27:39,  3.67it/s]
 88%|████████▊ | 325776/371472 [3:45:17<3:19:12,  3.82it/s]
 88%|████████▊ | 325777/371472 [3:45:17<3:24:19,  3.73it/s]
 88%|████████▊ | 325778/371472 [3:45:18<3:26:44,  3.68it/s]
 88%|████████▊ | 325779/371472 [3:45:18<3:26:24,  3.69it/s]
 88%|████████▊ | 325780/371472 [3:45:18<3:31:20,  3.60it/s]
                                                           
{'loss': 2.5805, 'learning_rate': 2.107619211790816e-07, 'epoch': 14.03}

 88%|████████▊ | 325780/371472 [3:45:18<3:31:20,  3.60it/s]
 88%|████████▊ | 325781/371472 [3:45:19<3:35:16,  3.54it/s]
 88%|████████▊ | 325782/371472 [3:45:19<3:34:36,  3.55it/s]
 88%|████████▊ | 325783/371472 [3:45:19<3:33:22,  3.57it/s]
 88%|████████▊ | 325784/371472 [3:45:19<3:26:57,  3.68it/s]
 88%|████████▊ | 325785/371472 [3:45:20<3:35:12,  3.54it/s]
 88%|████████▊ | 325786/371472 [3:45:20<3:27:34,  3.67it/s]
 88%|████████▊ | 325787/371472 [3:45:20<3:34:27,  3.55it/s]
 88%|████████▊ | 325788/371472 [3:45:20<3:30:07,  3.62it/s]
 88%|████████▊ | 325789/371472 [3:45:21<3:32:28,  3.58it/s]
 88%|████████▊ | 325790/371472 [3:45:21<3:38:41,  3.48it/s]
 88%|████████▊ | 325791/371472 [3:45:21<3:50:03,  3.31it/s]
 88%|████████▊ | 325792/371472 [3:45:22<3:39:20,  3.47it/s]
 88%|████████▊ | 325793/371472 [3:45:22<3:29:58,  3.63it/s]
 88%|████████▊ | 325794/371472 [3:45:22<3:30:56,  3.61it/s]
 88%|████████▊ | 325795/371472 [3:45:22<3:29:31,  3.63it/s]
 88%|████████▊ | 325796/371472 [3:45:23<3:25:12,  3.71it/s]
 88%|████████▊ | 325797/371472 [3:45:23<3:23:54,  3.73it/s]
 88%|████████▊ | 325798/371472 [3:45:23<3:17:50,  3.85it/s]
 88%|████████▊ | 325799/371472 [3:45:24<3:32:50,  3.58it/s]
 88%|████████▊ | 325800/371472 [3:45:24<3:27:36,  3.67it/s]
                                                           
{'loss': 2.6958, 'learning_rate': 2.1071343920360276e-07, 'epoch': 14.03}

 88%|████████▊ | 325800/371472 [3:45:24<3:27:36,  3.67it/s]
 88%|████████▊ | 325801/371472 [3:45:24<3:42:28,  3.42it/s]
 88%|████████▊ | 325802/371472 [3:45:24<3:52:43,  3.27it/s]
 88%|████████▊ | 325803/371472 [3:45:25<3:48:02,  3.34it/s]
 88%|████████▊ | 325804/371472 [3:45:25<3:51:07,  3.29it/s]
 88%|████████▊ | 325805/371472 [3:45:25<3:53:29,  3.26it/s]
 88%|████████▊ | 325806/371472 [3:45:26<3:42:11,  3.43it/s]
 88%|████████▊ | 325807/371472 [3:45:26<3:52:49,  3.27it/s]
 88%|████████▊ | 325808/371472 [3:45:26<3:58:28,  3.19it/s]
 88%|████████▊ | 325809/371472 [3:45:27<3:41:44,  3.43it/s]
 88%|████████▊ | 325810/371472 [3:45:27<3:38:08,  3.49it/s]
 88%|████████▊ | 325811/371472 [3:45:27<3:38:13,  3.49it/s]
 88%|████████▊ | 325812/371472 [3:45:27<3:30:06,  3.62it/s]
 88%|████████▊ | 325813/371472 [3:45:28<3:30:12,  3.62it/s]
 88%|████████▊ | 325814/371472 [3:45:28<3:31:50,  3.59it/s]
 88%|████████▊ | 325815/371472 [3:45:28<3:39:38,  3.46it/s]
 88%|████████▊ | 325816/371472 [3:45:29<3:49:45,  3.31it/s]
 88%|████████▊ | 325817/371472 [3:45:29<3:32:49,  3.58it/s]
 88%|████████▊ | 325818/371472 [3:45:29<3:31:46,  3.59it/s]
 88%|████████▊ | 325819/371472 [3:45:29<3:29:17,  3.64it/s]
 88%|████████▊ | 325820/371472 [3:45:30<3:21:24,  3.78it/s]
                                                           
{'loss': 2.5002, 'learning_rate': 2.106649572281238e-07, 'epoch': 14.03}

 88%|████████▊ | 325820/371472 [3:45:30<3:21:24,  3.78it/s]
 88%|████████▊ | 325821/371472 [3:45:30<3:18:57,  3.82it/s]
 88%|████████▊ | 325822/371472 [3:45:30<3:19:37,  3.81it/s]
 88%|████████▊ | 325823/371472 [3:45:30<3:19:17,  3.82it/s]
 88%|████████▊ | 325824/371472 [3:45:31<3:26:13,  3.69it/s]
 88%|████████▊ | 325825/371472 [3:45:31<3:24:14,  3.73it/s]
 88%|████████▊ | 325826/371472 [3:45:31<3:25:00,  3.71it/s]
 88%|████████▊ | 325827/371472 [3:45:31<3:23:38,  3.74it/s]
 88%|████████▊ | 325828/371472 [3:45:32<3:19:56,  3.80it/s]
 88%|████████▊ | 325829/371472 [3:45:32<3:31:43,  3.59it/s]
 88%|████████▊ | 325830/371472 [3:45:32<3:30:47,  3.61it/s]
 88%|████████▊ | 325831/371472 [3:45:33<3:36:10,  3.52it/s]
 88%|████████▊ | 325832/371472 [3:45:33<3:51:42,  3.28it/s]
 88%|████████▊ | 325833/371472 [3:45:33<3:40:15,  3.45it/s]
 88%|████████▊ | 325834/371472 [3:45:33<3:36:20,  3.52it/s]
 88%|████████▊ | 325835/371472 [3:45:34<3:27:42,  3.66it/s]
 88%|████████▊ | 325836/371472 [3:45:34<3:21:24,  3.78it/s]
 88%|████████▊ | 325837/371472 [3:45:34<3:32:10,  3.58it/s]
 88%|████████▊ | 325838/371472 [3:45:35<3:28:30,  3.65it/s]
 88%|████████▊ | 325839/371472 [3:45:35<3:23:04,  3.75it/s]
 88%|████████▊ | 325840/371472 [3:45:35<3:30:54,  3.61it/s]
                                                           
{'loss': 2.5137, 'learning_rate': 2.1061647525264498e-07, 'epoch': 14.03}

 88%|████████▊ | 325840/371472 [3:45:35<3:30:54,  3.61it/s]
 88%|████████▊ | 325841/371472 [3:45:35<3:25:17,  3.70it/s]
 88%|████████▊ | 325842/371472 [3:45:36<3:28:45,  3.64it/s]
 88%|████████▊ | 325843/371472 [3:45:36<3:30:19,  3.62it/s]
 88%|████████▊ | 325844/371472 [3:45:36<3:36:11,  3.52it/s]
 88%|████████▊ | 325845/371472 [3:45:37<3:41:27,  3.43it/s]
 88%|████████▊ | 325846/371472 [3:45:37<3:41:57,  3.43it/s]
 88%|████████▊ | 325847/371472 [3:45:37<3:36:30,  3.51it/s]
 88%|████████▊ | 325848/371472 [3:45:37<3:36:01,  3.52it/s]
 88%|████████▊ | 325849/371472 [3:45:38<3:31:18,  3.60it/s]
 88%|████████▊ | 325850/371472 [3:45:38<3:35:42,  3.53it/s]
 88%|████████▊ | 325851/371472 [3:45:38<3:25:47,  3.69it/s]
 88%|████████▊ | 325852/371472 [3:45:38<3:26:44,  3.68it/s]
 88%|████████▊ | 325853/371472 [3:45:39<3:24:54,  3.71it/s]
 88%|████████▊ | 325854/371472 [3:45:39<3:20:33,  3.79it/s]
 88%|████████▊ | 325855/371472 [3:45:39<3:18:55,  3.82it/s]
 88%|████████▊ | 325856/371472 [3:45:39<3:18:31,  3.83it/s]
 88%|████████▊ | 325857/371472 [3:45:40<3:24:15,  3.72it/s]
 88%|████████▊ | 325858/371472 [3:45:40<3:32:09,  3.58it/s]
 88%|████████▊ | 325859/371472 [3:45:40<3:34:34,  3.54it/s]
 88%|████████▊ | 325860/371472 [3:45:41<3:30:53,  3.60it/s]
                                                           
{'loss': 2.6137, 'learning_rate': 2.1056799327716605e-07, 'epoch': 14.04}

 88%|████████▊ | 325860/371472 [3:45:41<3:30:53,  3.60it/s]
 88%|████████▊ | 325861/371472 [3:45:41<3:25:40,  3.70it/s]
 88%|████████▊ | 325862/371472 [3:45:41<3:22:23,  3.76it/s]
 88%|████████▊ | 325863/371472 [3:45:41<3:30:30,  3.61it/s]
 88%|████████▊ | 325864/371472 [3:45:42<3:23:10,  3.74it/s]
 88%|████████▊ | 325865/371472 [3:45:42<3:37:23,  3.50it/s]
 88%|████████▊ | 325866/371472 [3:45:42<3:29:42,  3.62it/s]
 88%|████████▊ | 325867/371472 [3:45:43<3:35:10,  3.53it/s]
 88%|████████▊ | 325868/371472 [3:45:43<3:26:39,  3.68it/s]
 88%|████████▊ | 325869/371472 [3:45:43<3:20:43,  3.79it/s]
 88%|████████▊ | 325870/371472 [3:45:43<3:17:17,  3.85it/s]
 88%|████████▊ | 325871/371472 [3:45:44<3:14:12,  3.91it/s]
 88%|████████▊ | 325872/371472 [3:45:44<3:20:25,  3.79it/s]
 88%|████████▊ | 325873/371472 [3:45:44<3:21:23,  3.77it/s]
 88%|████████▊ | 325874/371472 [3:45:44<3:19:25,  3.81it/s]
 88%|████████▊ | 325875/371472 [3:45:45<3:18:50,  3.82it/s]
 88%|████████▊ | 325876/371472 [3:45:45<3:19:15,  3.81it/s]
 88%|████████▊ | 325877/371472 [3:45:45<3:15:49,  3.88it/s]
 88%|████████▊ | 325878/371472 [3:45:45<3:24:09,  3.72it/s]
 88%|████████▊ | 325879/371472 [3:45:46<3:20:04,  3.80it/s]
 88%|████████▊ | 325880/371472 [3:45:46<3:29:53,  3.62it/s]
                                                           
{'loss': 2.8274, 'learning_rate': 2.1051951130168718e-07, 'epoch': 14.04}

 88%|████████▊ | 325880/371472 [3:45:46<3:29:53,  3.62it/s]
 88%|████████▊ | 325881/371472 [3:45:46<3:31:00,  3.60it/s]
 88%|████████▊ | 325882/371472 [3:45:47<3:26:15,  3.68it/s]
 88%|████████▊ | 325883/371472 [3:45:47<3:23:46,  3.73it/s]
 88%|████████▊ | 325884/371472 [3:45:47<3:23:34,  3.73it/s]
 88%|████████▊ | 325885/371472 [3:45:47<3:24:45,  3.71it/s]
 88%|████████▊ | 325886/371472 [3:45:48<3:26:15,  3.68it/s]
 88%|████████▊ | 325887/371472 [3:45:48<3:31:25,  3.59it/s]
 88%|████████▊ | 325888/371472 [3:45:48<3:49:43,  3.31it/s]
 88%|████████▊ | 325889/371472 [3:45:49<3:41:43,  3.43it/s]
 88%|████████▊ | 325890/371472 [3:45:49<3:38:02,  3.48it/s]
 88%|████████▊ | 325891/371472 [3:45:49<3:33:43,  3.55it/s]
 88%|████████▊ | 325892/371472 [3:45:49<3:31:15,  3.60it/s]
 88%|████████▊ | 325893/371472 [3:45:50<3:36:26,  3.51it/s]
 88%|████████▊ | 325894/371472 [3:45:50<3:36:52,  3.50it/s]
 88%|████████▊ | 325895/371472 [3:45:50<3:28:10,  3.65it/s]
 88%|████████▊ | 325896/371472 [3:45:50<3:22:26,  3.75it/s]
 88%|████████▊ | 325897/371472 [3:45:51<3:21:22,  3.77it/s]
 88%|████████▊ | 325898/371472 [3:45:51<3:30:22,  3.61it/s]
 88%|████████▊ | 325899/371472 [3:45:51<3:26:38,  3.68it/s]
 88%|████████▊ | 325900/371472 [3:45:51<3:18:51,  3.82it/s]
                                                           
{'loss': 2.5865, 'learning_rate': 2.1047102932620825e-07, 'epoch': 14.04}

 88%|████████▊ | 325900/371472 [3:45:51<3:18:51,  3.82it/s]
 88%|████████▊ | 325901/371472 [3:45:52<3:23:17,  3.74it/s]
 88%|████████▊ | 325902/371472 [3:45:52<3:19:03,  3.82it/s]
 88%|████████▊ | 325903/371472 [3:45:52<3:17:40,  3.84it/s]
 88%|████████▊ | 325904/371472 [3:45:53<3:40:08,  3.45it/s]
 88%|████████▊ | 325905/371472 [3:45:53<3:49:21,  3.31it/s]
 88%|████████▊ | 325906/371472 [3:45:53<3:48:45,  3.32it/s]
 88%|████████▊ | 325907/371472 [3:45:54<4:18:37,  2.94it/s]
 88%|████████▊ | 325908/371472 [3:45:54<4:18:03,  2.94it/s]
 88%|████████▊ | 325909/371472 [3:45:54<4:02:32,  3.13it/s]
 88%|████████▊ | 325910/371472 [3:45:55<3:47:21,  3.34it/s]
 88%|████████▊ | 325911/371472 [3:45:55<3:37:23,  3.49it/s]
 88%|████████▊ | 325912/371472 [3:45:55<3:30:06,  3.61it/s]
 88%|████████▊ | 325913/371472 [3:45:55<3:33:06,  3.56it/s]
 88%|████████▊ | 325914/371472 [3:45:56<3:38:35,  3.47it/s]
 88%|████████▊ | 325915/371472 [3:45:56<3:28:33,  3.64it/s]
 88%|████████▊ | 325916/371472 [3:45:56<3:31:09,  3.60it/s]
 88%|████████▊ | 325917/371472 [3:45:57<3:46:04,  3.36it/s]
 88%|████████▊ | 325918/371472 [3:45:57<3:35:00,  3.53it/s]
 88%|████████▊ | 325919/371472 [3:45:57<3:25:28,  3.69it/s]
 88%|████████▊ | 325920/371472 [3:45:57<3:29:42,  3.62it/s]
                                                           
{'loss': 2.6856, 'learning_rate': 2.1042254735072943e-07, 'epoch': 14.04}

 88%|████████▊ | 325920/371472 [3:45:57<3:29:42,  3.62it/s]
 88%|████████▊ | 325921/371472 [3:45:58<3:23:47,  3.73it/s]
 88%|████████▊ | 325922/371472 [3:45:58<3:25:46,  3.69it/s]
 88%|████████▊ | 325923/371472 [3:45:58<3:36:58,  3.50it/s]
 88%|████████▊ | 325924/371472 [3:45:59<4:14:53,  2.98it/s]
 88%|████████▊ | 325925/371472 [3:45:59<4:08:28,  3.06it/s]
 88%|████████▊ | 325926/371472 [3:45:59<3:50:05,  3.30it/s]
 88%|████████▊ | 325927/371472 [3:46:00<3:57:43,  3.19it/s]
 88%|████████▊ | 325928/371472 [3:46:00<3:45:29,  3.37it/s]
 88%|████████▊ | 325929/371472 [3:46:00<3:49:30,  3.31it/s]
 88%|████████▊ | 325930/371472 [3:46:00<4:04:44,  3.10it/s]
 88%|████████▊ | 325931/371472 [3:46:01<3:49:55,  3.30it/s]
 88%|████████▊ | 325932/371472 [3:46:01<3:51:11,  3.28it/s]
 88%|████████▊ | 325933/371472 [3:46:01<3:45:45,  3.36it/s]
 88%|████████▊ | 325934/371472 [3:46:02<3:35:29,  3.52it/s]
 88%|████████▊ | 325935/371472 [3:46:02<3:32:18,  3.57it/s]
 88%|████████▊ | 325936/371472 [3:46:02<3:32:15,  3.58it/s]
 88%|████████▊ | 325937/371472 [3:46:02<3:28:10,  3.65it/s]
 88%|████████▊ | 325938/371472 [3:46:03<3:19:58,  3.80it/s]
 88%|████████▊ | 325939/371472 [3:46:03<3:46:25,  3.35it/s]
 88%|████████▊ | 325940/371472 [3:46:03<3:32:59,  3.56it/s]
                                                           
{'loss': 2.6057, 'learning_rate': 2.1037406537525047e-07, 'epoch': 14.04}

 88%|████████▊ | 325940/371472 [3:46:03<3:32:59,  3.56it/s]
 88%|████████▊ | 325941/371472 [3:46:03<3:22:50,  3.74it/s]
 88%|████████▊ | 325942/371472 [3:46:04<3:26:28,  3.68it/s]
 88%|████████▊ | 325943/371472 [3:46:04<3:32:40,  3.57it/s]
 88%|████████▊ | 325944/371472 [3:46:04<3:39:20,  3.46it/s]
 88%|████████▊ | 325945/371472 [3:46:05<3:35:03,  3.53it/s]
 88%|████████▊ | 325946/371472 [3:46:05<4:37:55,  2.73it/s]
 88%|████████▊ | 325947/371472 [3:46:05<4:19:50,  2.92it/s]
 88%|████████▊ | 325948/371472 [3:46:06<4:04:56,  3.10it/s]
 88%|████████▊ | 325949/371472 [3:46:06<4:15:38,  2.97it/s]
 88%|████████▊ | 325950/371472 [3:46:06<4:25:42,  2.86it/s]
 88%|████████▊ | 325951/371472 [3:46:07<4:08:13,  3.06it/s]
 88%|████████▊ | 325952/371472 [3:46:07<4:01:05,  3.15it/s]
 88%|████████▊ | 325953/371472 [3:46:07<3:54:50,  3.23it/s]
 88%|████████▊ | 325954/371472 [3:46:08<3:43:29,  3.39it/s]
 88%|████████▊ | 325955/371472 [3:46:08<4:00:32,  3.15it/s]
 88%|████████▊ | 325956/371472 [3:46:08<3:47:48,  3.33it/s]
 88%|████████▊ | 325957/371472 [3:46:08<3:34:49,  3.53it/s]
 88%|████████▊ | 325958/371472 [3:46:09<3:49:44,  3.30it/s]
 88%|████████▊ | 325959/371472 [3:46:09<3:42:37,  3.41it/s]
 88%|████████▊ | 325960/371472 [3:46:09<3:38:34,  3.47it/s]
                                                           
{'loss': 2.4845, 'learning_rate': 2.1032558339977162e-07, 'epoch': 14.04}

 88%|████████▊ | 325960/371472 [3:46:09<3:38:34,  3.47it/s]
 88%|████████▊ | 325961/371472 [3:46:10<3:34:22,  3.54it/s]
 88%|████████▊ | 325962/371472 [3:46:10<3:33:21,  3.55it/s]
 88%|████████▊ | 325963/371472 [3:46:10<3:29:29,  3.62it/s]
 88%|████████▊ | 325964/371472 [3:46:10<3:21:24,  3.77it/s]
 88%|████████▊ | 325965/371472 [3:46:11<3:17:20,  3.84it/s]
 88%|████████▊ | 325966/371472 [3:46:11<3:20:22,  3.79it/s]
 88%|████████▊ | 325967/371472 [3:46:11<3:16:29,  3.86it/s]
 88%|████████▊ | 325968/371472 [3:46:11<3:23:32,  3.73it/s]
 88%|████████▊ | 325969/371472 [3:46:12<3:35:35,  3.52it/s]
 88%|████████▊ | 325970/371472 [3:46:12<3:29:04,  3.63it/s]
 88%|████████▊ | 325971/371472 [3:46:12<3:44:07,  3.38it/s]
 88%|████████▊ | 325972/371472 [3:46:13<3:47:22,  3.34it/s]
 88%|████████▊ | 325973/371472 [3:46:13<3:42:20,  3.41it/s]
 88%|████████▊ | 325974/371472 [3:46:13<3:38:41,  3.47it/s]
 88%|████████▊ | 325975/371472 [3:46:14<3:35:13,  3.52it/s]
 88%|████████▊ | 325976/371472 [3:46:14<3:34:55,  3.53it/s]
 88%|████████▊ | 325977/371472 [3:46:14<3:33:06,  3.56it/s]
 88%|████████▊ | 325978/371472 [3:46:14<3:50:17,  3.29it/s]
 88%|████████▊ | 325979/371472 [3:46:15<3:42:39,  3.41it/s]
 88%|████████▊ | 325980/371472 [3:46:15<3:39:02,  3.46it/s]
                                                           
{'loss': 2.5936, 'learning_rate': 2.102771014242927e-07, 'epoch': 14.04}

 88%|████████▊ | 325980/371472 [3:46:15<3:39:02,  3.46it/s]
 88%|████████▊ | 325981/371472 [3:46:15<3:28:49,  3.63it/s]
 88%|████████▊ | 325982/371472 [3:46:16<3:26:55,  3.66it/s]
 88%|████████▊ | 325983/371472 [3:46:16<3:17:54,  3.83it/s]
 88%|████████▊ | 325984/371472 [3:46:16<3:32:45,  3.56it/s]
 88%|████████▊ | 325985/371472 [3:46:16<3:40:55,  3.43it/s]
 88%|████████▊ | 325986/371472 [3:46:17<3:37:33,  3.48it/s]
 88%|████████▊ | 325987/371472 [3:46:17<3:40:34,  3.44it/s]
 88%|████████▊ | 325988/371472 [3:46:17<3:30:45,  3.60it/s]
 88%|████████▊ | 325989/371472 [3:46:17<3:22:46,  3.74it/s]
 88%|████████▊ | 325990/371472 [3:46:18<3:26:06,  3.68it/s]
 88%|████████▊ | 325991/371472 [3:46:18<3:28:09,  3.64it/s]
 88%|████████▊ | 325992/371472 [3:46:18<3:30:31,  3.60it/s]
 88%|████████▊ | 325993/371472 [3:46:19<3:33:25,  3.55it/s]
 88%|████████▊ | 325994/371472 [3:46:19<3:46:56,  3.34it/s]
 88%|████████▊ | 325995/371472 [3:46:19<3:37:09,  3.49it/s]
 88%|████████▊ | 325996/371472 [3:46:19<3:23:24,  3.73it/s]
 88%|████████▊ | 325997/371472 [3:46:20<3:23:13,  3.73it/s]
 88%|████████▊ | 325998/371472 [3:46:20<3:18:43,  3.81it/s]
 88%|████████▊ | 325999/371472 [3:46:20<3:19:58,  3.79it/s]
 88%|████████▊ | 326000/371472 [3:46:20<3:17:23,  3.84it/s]
                                                           
{'loss': 2.6098, 'learning_rate': 2.1022861944881384e-07, 'epoch': 14.04}

 88%|████████▊ | 326000/371472 [3:46:20<3:17:23,  3.84it/s]
 88%|████████▊ | 326001/371472 [3:46:21<3:29:18,  3.62it/s]
 88%|████████▊ | 326002/371472 [3:46:21<3:34:41,  3.53it/s]
 88%|████████▊ | 326003/371472 [3:46:21<3:53:04,  3.25it/s]
 88%|████████▊ | 326004/371472 [3:46:22<3:42:50,  3.40it/s]
 88%|████████▊ | 326005/371472 [3:46:22<3:38:38,  3.47it/s]
 88%|████████▊ | 326006/371472 [3:46:22<3:24:20,  3.71it/s]
 88%|████████▊ | 326007/371472 [3:46:23<3:30:25,  3.60it/s]
 88%|████████▊ | 326008/371472 [3:46:23<3:26:43,  3.67it/s]
 88%|████████▊ | 326009/371472 [3:46:23<3:43:07,  3.40it/s]
 88%|████████▊ | 326010/371472 [3:46:23<3:50:38,  3.29it/s]
 88%|████████▊ | 326011/371472 [3:46:24<3:36:50,  3.49it/s]
 88%|████████▊ | 326012/371472 [3:46:24<3:38:01,  3.48it/s]
 88%|████████▊ | 326013/371472 [3:46:24<3:28:51,  3.63it/s]
 88%|████████▊ | 326014/371472 [3:46:24<3:23:55,  3.72it/s]
 88%|████████▊ | 326015/371472 [3:46:25<3:31:21,  3.58it/s]
 88%|████████▊ | 326016/371472 [3:46:25<3:25:32,  3.69it/s]
 88%|████████▊ | 326017/371472 [3:46:25<3:21:45,  3.75it/s]
 88%|████████▊ | 326018/371472 [3:46:26<3:23:10,  3.73it/s]
 88%|████████▊ | 326019/371472 [3:46:26<3:27:01,  3.66it/s]
 88%|████████▊ | 326020/371472 [3:46:26<3:24:41,  3.70it/s]
                                                           
{'loss': 2.6872, 'learning_rate': 2.101801374733349e-07, 'epoch': 14.04}

 88%|████████▊ | 326020/371472 [3:46:26<3:24:41,  3.70it/s]
 88%|████████▊ | 326021/371472 [3:46:26<3:28:02,  3.64it/s]
 88%|████████▊ | 326022/371472 [3:46:27<3:30:11,  3.60it/s]
 88%|████████▊ | 326023/371472 [3:46:27<3:32:48,  3.56it/s]
 88%|████████▊ | 326024/371472 [3:46:27<3:30:13,  3.60it/s]
 88%|████████▊ | 326025/371472 [3:46:27<3:22:06,  3.75it/s]
 88%|████████▊ | 326026/371472 [3:46:28<3:26:51,  3.66it/s]
 88%|████████▊ | 326027/371472 [3:46:28<3:20:58,  3.77it/s]
 88%|████████▊ | 326028/371472 [3:46:28<3:25:44,  3.68it/s]
 88%|████████▊ | 326029/371472 [3:46:29<3:26:29,  3.67it/s]
 88%|████████▊ | 326030/371472 [3:46:29<3:31:05,  3.59it/s]
 88%|████████▊ | 326031/371472 [3:46:29<3:28:07,  3.64it/s]
 88%|████████▊ | 326032/371472 [3:46:29<3:40:09,  3.44it/s]
 88%|████████▊ | 326033/371472 [3:46:30<3:36:37,  3.50it/s]
 88%|████████▊ | 326034/371472 [3:46:30<3:38:18,  3.47it/s]
 88%|████████▊ | 326035/371472 [3:46:30<3:34:52,  3.52it/s]
 88%|████████▊ | 326036/371472 [3:46:31<3:39:17,  3.45it/s]
 88%|████████▊ | 326037/371472 [3:46:31<3:31:56,  3.57it/s]
 88%|████████▊ | 326038/371472 [3:46:31<3:22:34,  3.74it/s]
 88%|████████▊ | 326039/371472 [3:46:31<3:17:57,  3.83it/s]
 88%|████████▊ | 326040/371472 [3:46:32<3:25:14,  3.69it/s]
                                                           
{'loss': 2.6471, 'learning_rate': 2.1013165549785604e-07, 'epoch': 14.04}

 88%|████████▊ | 326040/371472 [3:46:32<3:25:14,  3.69it/s]
 88%|████████▊ | 326041/371472 [3:46:32<3:19:44,  3.79it/s]
 88%|████████▊ | 326042/371472 [3:46:32<3:19:28,  3.80it/s]
 88%|████████▊ | 326043/371472 [3:46:32<3:18:41,  3.81it/s]
 88%|████████▊ | 326044/371472 [3:46:33<3:29:09,  3.62it/s]
 88%|████████▊ | 326045/371472 [3:46:33<3:33:03,  3.55it/s]
 88%|████████▊ | 326046/371472 [3:46:33<3:26:59,  3.66it/s]
 88%|████████▊ | 326047/371472 [3:46:34<3:23:20,  3.72it/s]
 88%|████████▊ | 326048/371472 [3:46:34<3:23:08,  3.73it/s]
 88%|████████▊ | 326049/371472 [3:46:34<3:19:36,  3.79it/s]
 88%|████████▊ | 326050/371472 [3:46:34<3:37:26,  3.48it/s]
 88%|████████▊ | 326051/371472 [3:46:35<3:30:20,  3.60it/s]
 88%|████████▊ | 326052/371472 [3:46:35<3:27:26,  3.65it/s]
 88%|████████▊ | 326053/371472 [3:46:35<3:27:35,  3.65it/s]
 88%|████████▊ | 326054/371472 [3:46:36<3:42:53,  3.40it/s]
 88%|████████▊ | 326055/371472 [3:46:36<3:37:15,  3.48it/s]
 88%|████████▊ | 326056/371472 [3:46:36<3:38:45,  3.46it/s]
 88%|████████▊ | 326057/371472 [3:46:36<3:31:00,  3.59it/s]
 88%|████████▊ | 326058/371472 [3:46:37<3:25:59,  3.67it/s]
 88%|████████▊ | 326059/371472 [3:46:37<3:27:19,  3.65it/s]
 88%|████████▊ | 326060/371472 [3:46:37<3:24:55,  3.69it/s]
                                                           
{'loss': 2.6495, 'learning_rate': 2.100831735223771e-07, 'epoch': 14.04}

 88%|████████▊ | 326060/371472 [3:46:37<3:24:55,  3.69it/s]
 88%|████████▊ | 326061/371472 [3:46:37<3:21:23,  3.76it/s]
 88%|████████▊ | 326062/371472 [3:46:38<3:26:13,  3.67it/s]
 88%|████████▊ | 326063/371472 [3:46:38<3:23:51,  3.71it/s]
 88%|████████▊ | 326064/371472 [3:46:38<3:21:20,  3.76it/s]
 88%|████████▊ | 326065/371472 [3:46:38<3:24:22,  3.70it/s]
 88%|████████▊ | 326066/371472 [3:46:39<3:28:22,  3.63it/s]
 88%|████████▊ | 326067/371472 [3:46:39<3:28:03,  3.64it/s]
 88%|████████▊ | 326068/371472 [3:46:39<3:36:28,  3.50it/s]
 88%|████████▊ | 326069/371472 [3:46:40<3:29:32,  3.61it/s]
 88%|████████▊ | 326070/371472 [3:46:40<3:26:49,  3.66it/s]
 88%|████████▊ | 326071/371472 [3:46:40<3:29:49,  3.61it/s]
 88%|████████▊ | 326072/371472 [3:46:40<3:28:48,  3.62it/s]
 88%|████████▊ | 326073/371472 [3:46:41<3:22:54,  3.73it/s]
 88%|████████▊ | 326074/371472 [3:46:41<3:22:39,  3.73it/s]
 88%|████████▊ | 326075/371472 [3:46:41<3:26:23,  3.67it/s]
 88%|████████▊ | 326076/371472 [3:46:41<3:21:50,  3.75it/s]
 88%|████████▊ | 326077/371472 [3:46:42<3:15:23,  3.87it/s]
 88%|████████▊ | 326078/371472 [3:46:42<3:17:20,  3.83it/s]
 88%|████████▊ | 326079/371472 [3:46:42<3:28:36,  3.63it/s]
 88%|████████▊ | 326080/371472 [3:46:43<3:21:34,  3.75it/s]
                                                           
{'loss': 2.5127, 'learning_rate': 2.1003469154689826e-07, 'epoch': 14.04}

 88%|████████▊ | 326080/371472 [3:46:43<3:21:34,  3.75it/s]
 88%|████████▊ | 326081/371472 [3:46:43<3:25:44,  3.68it/s]
 88%|████████▊ | 326082/371472 [3:46:43<3:25:04,  3.69it/s]
 88%|████████▊ | 326083/371472 [3:46:43<3:36:14,  3.50it/s]
 88%|████████▊ | 326084/371472 [3:46:44<3:44:57,  3.36it/s]
 88%|████████▊ | 326085/371472 [3:46:44<3:53:07,  3.24it/s]
 88%|████████▊ | 326086/371472 [3:46:44<3:41:50,  3.41it/s]
 88%|████████▊ | 326087/371472 [3:46:45<3:32:14,  3.56it/s]
 88%|████████▊ | 326088/371472 [3:46:45<3:35:33,  3.51it/s]
 88%|████████▊ | 326089/371472 [3:46:45<3:25:39,  3.68it/s]
 88%|████████▊ | 326090/371472 [3:46:45<3:18:24,  3.81it/s]
 88%|████████▊ | 326091/371472 [3:46:46<3:21:09,  3.76it/s]
 88%|████████▊ | 326092/371472 [3:46:46<3:21:24,  3.76it/s]
 88%|████████▊ | 326093/371472 [3:46:46<3:37:22,  3.48it/s]
 88%|████████▊ | 326094/371472 [3:46:46<3:26:47,  3.66it/s]
 88%|████████▊ | 326095/371472 [3:46:47<3:26:32,  3.66it/s]
 88%|████████▊ | 326096/371472 [3:46:47<3:22:47,  3.73it/s]
 88%|████████▊ | 326097/371472 [3:46:47<3:23:19,  3.72it/s]
 88%|████████▊ | 326098/371472 [3:46:48<3:20:52,  3.76it/s]
 88%|████████▊ | 326099/371472 [3:46:48<3:23:49,  3.71it/s]
 88%|████████▊ | 326100/371472 [3:46:48<4:31:20,  2.79it/s]
                                                           
{'loss': 2.5968, 'learning_rate': 2.0998620957141933e-07, 'epoch': 14.05}

 88%|████████▊ | 326100/371472 [3:46:48<4:31:20,  2.79it/s]
 88%|████████▊ | 326101/371472 [3:46:49<4:24:15,  2.86it/s]
 88%|████████▊ | 326102/371472 [3:46:49<4:22:39,  2.88it/s]
 88%|████████▊ | 326103/371472 [3:46:49<4:04:26,  3.09it/s]
 88%|████████▊ | 326104/371472 [3:46:50<3:47:58,  3.32it/s]
 88%|████████▊ | 326105/371472 [3:46:50<3:37:09,  3.48it/s]
 88%|████████▊ | 326106/371472 [3:46:50<3:30:06,  3.60it/s]
 88%|████████▊ | 326107/371472 [3:46:50<3:25:22,  3.68it/s]
 88%|████████▊ | 326108/371472 [3:46:51<3:22:59,  3.72it/s]
 88%|████████▊ | 326109/371472 [3:46:51<3:21:12,  3.76it/s]
 88%|████████▊ | 326110/371472 [3:46:51<3:22:09,  3.74it/s]
 88%|████████▊ | 326111/371472 [3:46:51<3:30:58,  3.58it/s]
 88%|████████▊ | 326112/371472 [3:46:52<3:27:30,  3.64it/s]
 88%|████████▊ | 326113/371472 [3:46:52<3:34:26,  3.53it/s]
 88%|████████▊ | 326114/371472 [3:46:52<3:37:03,  3.48it/s]
 88%|████████▊ | 326115/371472 [3:46:53<3:34:18,  3.53it/s]
 88%|████████▊ | 326116/371472 [3:46:53<3:32:11,  3.56it/s]
 88%|████████▊ | 326117/371472 [3:46:53<3:42:08,  3.40it/s]
 88%|████████▊ | 326118/371472 [3:46:53<3:37:49,  3.47it/s]
 88%|████████▊ | 326119/371472 [3:46:54<3:39:16,  3.45it/s]
 88%|████████▊ | 326120/371472 [3:46:54<3:27:29,  3.64it/s]
                                                           
{'loss': 2.7458, 'learning_rate': 2.0993772759594038e-07, 'epoch': 14.05}

 88%|████████▊ | 326120/371472 [3:46:54<3:27:29,  3.64it/s]
 88%|████████▊ | 326121/371472 [3:46:54<3:21:53,  3.74it/s]
 88%|████████▊ | 326122/371472 [3:46:55<3:24:15,  3.70it/s]
 88%|████████▊ | 326123/371472 [3:46:55<3:20:33,  3.77it/s]
 88%|████████▊ | 326124/371472 [3:46:55<3:43:41,  3.38it/s]
 88%|████████▊ | 326125/371472 [3:46:55<3:56:10,  3.20it/s]
 88%|████████▊ | 326126/371472 [3:46:56<3:45:23,  3.35it/s]
 88%|████████▊ | 326127/371472 [3:46:56<3:36:48,  3.49it/s]
 88%|████████▊ | 326128/371472 [3:46:56<3:52:53,  3.24it/s]
 88%|████████▊ | 326129/371472 [3:46:57<3:45:03,  3.36it/s]
 88%|████████▊ | 326130/371472 [3:46:57<3:38:23,  3.46it/s]
 88%|████████▊ | 326131/371472 [3:46:57<3:28:49,  3.62it/s]
 88%|████████▊ | 326132/371472 [3:46:57<3:38:09,  3.46it/s]
 88%|████████▊ | 326133/371472 [3:46:58<3:28:26,  3.63it/s]
 88%|████████▊ | 326134/371472 [3:46:58<3:26:12,  3.66it/s]
 88%|████████▊ | 326135/371472 [3:46:58<3:18:53,  3.80it/s]
 88%|████████▊ | 326136/371472 [3:46:58<3:13:58,  3.90it/s]
 88%|████████▊ | 326137/371472 [3:46:59<3:15:41,  3.86it/s]
 88%|████████▊ | 326138/371472 [3:46:59<3:29:03,  3.61it/s]
 88%|████████▊ | 326139/371472 [3:46:59<3:33:29,  3.54it/s]
 88%|████████▊ | 326140/371472 [3:47:00<3:24:29,  3.69it/s]
                                                           
{'loss': 2.5864, 'learning_rate': 2.0988924562046153e-07, 'epoch': 14.05}

 88%|████████▊ | 326140/371472 [3:47:00<3:24:29,  3.69it/s]
 88%|████████▊ | 326141/371472 [3:47:00<3:21:17,  3.75it/s]
 88%|████████▊ | 326142/371472 [3:47:00<3:25:36,  3.67it/s]
 88%|████████▊ | 326143/371472 [3:47:00<3:26:06,  3.67it/s]
 88%|████████▊ | 326144/371472 [3:47:01<3:49:32,  3.29it/s]
 88%|████████▊ | 326145/371472 [3:47:01<3:37:29,  3.47it/s]
 88%|████████▊ | 326146/371472 [3:47:01<3:38:21,  3.46it/s]
 88%|████████▊ | 326147/371472 [3:47:02<3:37:51,  3.47it/s]
 88%|████████▊ | 326148/371472 [3:47:02<3:48:51,  3.30it/s]
 88%|████████▊ | 326149/371472 [3:47:02<3:39:57,  3.43it/s]
 88%|████████▊ | 326150/371472 [3:47:02<3:34:23,  3.52it/s]
 88%|████████▊ | 326151/371472 [3:47:03<3:34:30,  3.52it/s]
 88%|████████▊ | 326152/371472 [3:47:03<3:26:35,  3.66it/s]
 88%|████████▊ | 326153/371472 [3:47:03<3:31:43,  3.57it/s]
 88%|████████▊ | 326154/371472 [3:47:04<3:30:02,  3.60it/s]
 88%|████████▊ | 326155/371472 [3:47:04<3:36:20,  3.49it/s]
 88%|████████▊ | 326156/371472 [3:47:04<3:47:34,  3.32it/s]
 88%|████████▊ | 326157/371472 [3:47:04<3:34:36,  3.52it/s]
 88%|████████▊ | 326158/371472 [3:47:05<3:29:55,  3.60it/s]
 88%|████████▊ | 326159/371472 [3:47:05<3:27:29,  3.64it/s]
 88%|████████▊ | 326160/371472 [3:47:05<3:28:26,  3.62it/s]
                                                           
{'loss': 2.6283, 'learning_rate': 2.098407636449826e-07, 'epoch': 14.05}

 88%|████████▊ | 326160/371472 [3:47:05<3:28:26,  3.62it/s]
 88%|████████▊ | 326161/371472 [3:47:06<3:38:40,  3.45it/s]
 88%|████████▊ | 326162/371472 [3:47:06<3:37:08,  3.48it/s]
 88%|████████▊ | 326163/371472 [3:47:06<3:39:20,  3.44it/s]
 88%|████████▊ | 326164/371472 [3:47:06<3:42:41,  3.39it/s]
 88%|████████▊ | 326165/371472 [3:47:07<3:44:35,  3.36it/s]
 88%|████████▊ | 326166/371472 [3:47:07<3:44:18,  3.37it/s]
 88%|████████▊ | 326167/371472 [3:47:07<3:31:50,  3.56it/s]
 88%|████████▊ | 326168/371472 [3:47:08<3:26:59,  3.65it/s]
 88%|████████▊ | 326169/371472 [3:47:08<3:32:18,  3.56it/s]
 88%|████████▊ | 326170/371472 [3:47:08<3:22:10,  3.73it/s]
 88%|████████▊ | 326171/371472 [3:47:08<3:16:03,  3.85it/s]
 88%|████████▊ | 326172/371472 [3:47:09<3:15:42,  3.86it/s]
 88%|████████▊ | 326173/371472 [3:47:09<3:09:53,  3.98it/s]
 88%|████████▊ | 326174/371472 [3:47:09<3:10:40,  3.96it/s]
 88%|████████▊ | 326175/371472 [3:47:09<3:22:29,  3.73it/s]
 88%|████████▊ | 326176/371472 [3:47:10<3:28:21,  3.62it/s]
 88%|████████▊ | 326177/371472 [3:47:10<3:28:23,  3.62it/s]
 88%|████████▊ | 326178/371472 [3:47:10<3:23:50,  3.70it/s]
 88%|████████▊ | 326179/371472 [3:47:11<3:26:01,  3.66it/s]
 88%|████████▊ | 326180/371472 [3:47:11<3:24:41,  3.69it/s]
                                                           
{'loss': 2.514, 'learning_rate': 2.0979228166950375e-07, 'epoch': 14.05}

 88%|████████▊ | 326180/371472 [3:47:11<3:24:41,  3.69it/s]
 88%|████████▊ | 326181/371472 [3:47:11<3:19:45,  3.78it/s]
 88%|████████▊ | 326182/371472 [3:47:11<3:19:42,  3.78it/s]
 88%|████████▊ | 326183/371472 [3:47:12<3:28:14,  3.62it/s]
 88%|████████▊ | 326184/371472 [3:47:12<3:44:24,  3.36it/s]
 88%|████████▊ | 326185/371472 [3:47:12<3:48:44,  3.30it/s]
 88%|████████▊ | 326186/371472 [3:47:13<3:52:09,  3.25it/s]
 88%|████████▊ | 326187/371472 [3:47:13<3:40:55,  3.42it/s]
 88%|████████▊ | 326188/371472 [3:47:13<3:33:44,  3.53it/s]
 88%|████████▊ | 326189/371472 [3:47:13<3:32:57,  3.54it/s]
 88%|████████▊ | 326190/371472 [3:47:14<3:32:45,  3.55it/s]
 88%|████████▊ | 326191/371472 [3:47:14<3:34:39,  3.52it/s]
 88%|████████▊ | 326192/371472 [3:47:14<3:25:33,  3.67it/s]
 88%|████████▊ | 326193/371472 [3:47:14<3:20:40,  3.76it/s]
 88%|████████▊ | 326194/371472 [3:47:15<3:20:48,  3.76it/s]
 88%|████████▊ | 326195/371472 [3:47:15<3:21:32,  3.74it/s]
 88%|████████▊ | 326196/371472 [3:47:15<3:26:44,  3.65it/s]
 88%|████████▊ | 326197/371472 [3:47:16<3:33:03,  3.54it/s]
 88%|████████▊ | 326198/371472 [3:47:16<3:33:27,  3.53it/s]
 88%|████████▊ | 326199/371472 [3:47:16<3:36:24,  3.49it/s]
 88%|████████▊ | 326200/371472 [3:47:16<3:36:26,  3.49it/s]
                                                           
{'loss': 2.5769, 'learning_rate': 2.097437996940248e-07, 'epoch': 14.05}

 88%|████████▊ | 326200/371472 [3:47:16<3:36:26,  3.49it/s]
 88%|████████▊ | 326201/371472 [3:47:17<3:40:05,  3.43it/s]
 88%|████████▊ | 326202/371472 [3:47:17<3:35:45,  3.50it/s]
 88%|████████▊ | 326203/371472 [3:47:17<3:31:08,  3.57it/s]
 88%|████████▊ | 326204/371472 [3:47:18<3:23:44,  3.70it/s]
 88%|████████▊ | 326205/371472 [3:47:18<3:18:29,  3.80it/s]
 88%|████████▊ | 326206/371472 [3:47:18<3:34:19,  3.52it/s]
 88%|████████▊ | 326207/371472 [3:47:18<3:30:48,  3.58it/s]
 88%|████████▊ | 326208/371472 [3:47:19<3:25:14,  3.68it/s]
 88%|████████▊ | 326209/371472 [3:47:19<3:28:50,  3.61it/s]
 88%|████████▊ | 326210/371472 [3:47:19<3:26:13,  3.66it/s]
 88%|████████▊ | 326211/371472 [3:47:19<3:32:09,  3.56it/s]
 88%|████████▊ | 326212/371472 [3:47:20<3:30:52,  3.58it/s]
 88%|████████▊ | 326213/371472 [3:47:20<3:28:42,  3.61it/s]
 88%|████████▊ | 326214/371472 [3:47:20<3:23:15,  3.71it/s]
 88%|████████▊ | 326215/371472 [3:47:21<3:25:26,  3.67it/s]
 88%|████████▊ | 326216/371472 [3:47:21<3:33:39,  3.53it/s]
 88%|████████▊ | 326217/371472 [3:47:21<3:28:19,  3.62it/s]
 88%|████████▊ | 326218/371472 [3:47:21<3:23:00,  3.72it/s]
 88%|████████▊ | 326219/371472 [3:47:22<3:18:09,  3.81it/s]
 88%|████████▊ | 326220/371472 [3:47:22<3:16:42,  3.83it/s]
                                                           
{'loss': 2.5135, 'learning_rate': 2.0969531771854597e-07, 'epoch': 14.05}

 88%|████████▊ | 326220/371472 [3:47:22<3:16:42,  3.83it/s]
 88%|████████▊ | 326221/371472 [3:47:22<3:14:52,  3.87it/s]
 88%|████████▊ | 326222/371472 [3:47:22<3:21:01,  3.75it/s]
 88%|████████▊ | 326223/371472 [3:47:23<3:17:24,  3.82it/s]
 88%|████████▊ | 326224/371472 [3:47:23<3:22:27,  3.72it/s]
 88%|████████▊ | 326225/371472 [3:47:23<3:30:07,  3.59it/s]
 88%|████████▊ | 326226/371472 [3:47:24<3:48:22,  3.30it/s]
 88%|████████▊ | 326227/371472 [3:47:24<3:42:14,  3.39it/s]
 88%|████████▊ | 326228/371472 [3:47:24<3:45:42,  3.34it/s]
 88%|████████▊ | 326229/371472 [3:47:25<3:51:56,  3.25it/s]
 88%|████████▊ | 326230/371472 [3:47:25<3:39:19,  3.44it/s]
 88%|████████▊ | 326231/371472 [3:47:25<3:28:55,  3.61it/s]
 88%|████████▊ | 326232/371472 [3:47:25<3:24:42,  3.68it/s]
 88%|████████▊ | 326233/371472 [3:47:26<3:19:59,  3.77it/s]
 88%|████████▊ | 326234/371472 [3:47:26<3:30:25,  3.58it/s]
 88%|████████▊ | 326235/371472 [3:47:26<3:24:16,  3.69it/s]
 88%|████████▊ | 326236/371472 [3:47:26<3:23:49,  3.70it/s]
 88%|████████▊ | 326237/371472 [3:47:27<3:19:06,  3.79it/s]
 88%|████████▊ | 326238/371472 [3:47:27<3:18:42,  3.79it/s]
 88%|████████▊ | 326239/371472 [3:47:27<3:56:38,  3.19it/s]
 88%|████████▊ | 326240/371472 [3:47:28<3:39:23,  3.44it/s]
                                                           
{'loss': 2.649, 'learning_rate': 2.0964683574306705e-07, 'epoch': 14.05}

 88%|████████▊ | 326240/371472 [3:47:28<3:39:23,  3.44it/s]
 88%|████████▊ | 326241/371472 [3:47:28<3:36:02,  3.49it/s]
 88%|████████▊ | 326242/371472 [3:47:28<3:29:40,  3.60it/s]
 88%|████████▊ | 326243/371472 [3:47:28<3:30:47,  3.58it/s]
 88%|████████▊ | 326244/371472 [3:47:29<3:33:32,  3.53it/s]
 88%|████████▊ | 326245/371472 [3:47:29<3:28:57,  3.61it/s]
 88%|████████▊ | 326246/371472 [3:47:29<3:21:53,  3.73it/s]
 88%|████████▊ | 326247/371472 [3:47:29<3:15:15,  3.86it/s]
 88%|████████▊ | 326248/371472 [3:47:30<3:26:47,  3.65it/s]
 88%|████████▊ | 326249/371472 [3:47:30<3:22:25,  3.72it/s]
 88%|████████▊ | 326250/371472 [3:47:30<3:21:19,  3.74it/s]
 88%|████████▊ | 326251/371472 [3:47:31<3:30:05,  3.59it/s]
 88%|████████▊ | 326252/371472 [3:47:31<3:25:00,  3.68it/s]
 88%|████████▊ | 326253/371472 [3:47:31<3:37:08,  3.47it/s]
 88%|████████▊ | 326254/371472 [3:47:31<3:35:52,  3.49it/s]
 88%|████████▊ | 326255/371472 [3:47:32<3:41:52,  3.40it/s]
 88%|████████▊ | 326256/371472 [3:47:32<3:29:48,  3.59it/s]
 88%|████████▊ | 326257/371472 [3:47:32<3:23:31,  3.70it/s]
 88%|████████▊ | 326258/371472 [3:47:32<3:17:50,  3.81it/s]
 88%|████████▊ | 326259/371472 [3:47:33<3:14:14,  3.88it/s]
 88%|████████▊ | 326260/371472 [3:47:33<3:20:23,  3.76it/s]
                                                           
{'loss': 2.7837, 'learning_rate': 2.0959835376758817e-07, 'epoch': 14.05}

 88%|████████▊ | 326260/371472 [3:47:33<3:20:23,  3.76it/s]
 88%|████████▊ | 326261/371472 [3:47:33<3:18:12,  3.80it/s]
 88%|████████▊ | 326262/371472 [3:47:34<3:17:00,  3.82it/s]
 88%|████████▊ | 326263/371472 [3:47:34<3:19:31,  3.78it/s]
 88%|████████▊ | 326264/371472 [3:47:34<3:20:50,  3.75it/s]
 88%|████████▊ | 326265/371472 [3:47:34<3:30:44,  3.58it/s]
 88%|████████▊ | 326266/371472 [3:47:35<3:33:43,  3.53it/s]
 88%|████████▊ | 326267/371472 [3:47:35<3:49:09,  3.29it/s]
 88%|████████▊ | 326268/371472 [3:47:35<3:54:21,  3.21it/s]
 88%|████████▊ | 326269/371472 [3:47:36<3:48:30,  3.30it/s]
 88%|████████▊ | 326270/371472 [3:47:36<3:43:18,  3.37it/s]
 88%|████████▊ | 326271/371472 [3:47:36<3:38:56,  3.44it/s]
 88%|████████▊ | 326272/371472 [3:47:36<3:27:55,  3.62it/s]
 88%|████████▊ | 326273/371472 [3:47:37<3:28:03,  3.62it/s]
 88%|████████▊ | 326274/371472 [3:47:37<3:25:57,  3.66it/s]
 88%|████████▊ | 326275/371472 [3:47:37<3:41:27,  3.40it/s]
 88%|████████▊ | 326276/371472 [3:47:38<3:30:35,  3.58it/s]
 88%|████████▊ | 326277/371472 [3:47:38<3:34:15,  3.52it/s]
 88%|████████▊ | 326278/371472 [3:47:38<3:44:34,  3.35it/s]
 88%|████████▊ | 326279/371472 [3:47:38<3:49:44,  3.28it/s]
 88%|████████▊ | 326280/371472 [3:47:39<3:43:35,  3.37it/s]
                                                           
{'loss': 2.4911, 'learning_rate': 2.0954987179210922e-07, 'epoch': 14.05}

 88%|████████▊ | 326280/371472 [3:47:39<3:43:35,  3.37it/s]
 88%|████████▊ | 326281/371472 [3:47:39<3:41:15,  3.40it/s]
 88%|████████▊ | 326282/371472 [3:47:39<3:48:43,  3.29it/s]
 88%|████████▊ | 326283/371472 [3:47:40<4:02:30,  3.11it/s]
 88%|████████▊ | 326284/371472 [3:47:40<3:53:36,  3.22it/s]
 88%|████████▊ | 326285/371472 [3:47:40<3:58:38,  3.16it/s]
 88%|████████▊ | 326286/371472 [3:47:41<3:39:24,  3.43it/s]
 88%|████████▊ | 326287/371472 [3:47:41<3:34:42,  3.51it/s]
 88%|████████▊ | 326288/371472 [3:47:41<3:46:57,  3.32it/s]
 88%|████████▊ | 326289/371472 [3:47:42<3:49:33,  3.28it/s]
 88%|████████▊ | 326290/371472 [3:47:42<3:48:19,  3.30it/s]
 88%|████████▊ | 326291/371472 [3:47:42<3:44:25,  3.36it/s]
 88%|████████▊ | 326292/371472 [3:47:42<3:40:26,  3.42it/s]
 88%|████████▊ | 326293/371472 [3:47:43<3:39:43,  3.43it/s]
 88%|████████▊ | 326294/371472 [3:47:43<3:32:18,  3.55it/s]
 88%|████████▊ | 326295/371472 [3:47:43<3:37:23,  3.46it/s]
 88%|████████▊ | 326296/371472 [3:47:44<3:40:31,  3.41it/s]
 88%|████████▊ | 326297/371472 [3:47:44<3:32:59,  3.54it/s]
 88%|████████▊ | 326298/371472 [3:47:44<3:33:13,  3.53it/s]
 88%|████████▊ | 326299/371472 [3:47:44<3:23:54,  3.69it/s]
 88%|████████▊ | 326300/371472 [3:47:45<3:18:11,  3.80it/s]
                                                           
{'loss': 2.6214, 'learning_rate': 2.0950138981663042e-07, 'epoch': 14.05}

 88%|████████▊ | 326300/371472 [3:47:45<3:18:11,  3.80it/s]
 88%|████████▊ | 326301/371472 [3:47:45<3:48:06,  3.30it/s]
 88%|████████▊ | 326302/371472 [3:47:45<3:35:17,  3.50it/s]
 88%|████████▊ | 326303/371472 [3:47:46<3:36:48,  3.47it/s]
 88%|████████▊ | 326304/371472 [3:47:46<3:30:19,  3.58it/s]
 88%|████████▊ | 326305/371472 [3:47:46<3:34:37,  3.51it/s]
 88%|████████▊ | 326306/371472 [3:47:46<3:27:41,  3.62it/s]
 88%|████████▊ | 326307/371472 [3:47:47<3:24:05,  3.69it/s]
 88%|████████▊ | 326308/371472 [3:47:47<3:23:38,  3.70it/s]
 88%|████████▊ | 326309/371472 [3:47:47<3:18:08,  3.80it/s]
 88%|████████▊ | 326310/371472 [3:47:47<3:20:28,  3.75it/s]
 88%|████████▊ | 326311/371472 [3:47:48<3:29:38,  3.59it/s]
 88%|████████▊ | 326312/371472 [3:47:48<3:37:31,  3.46it/s]
 88%|████████▊ | 326313/371472 [3:47:48<3:51:32,  3.25it/s]
 88%|████████▊ | 326314/371472 [3:47:49<3:40:07,  3.42it/s]
 88%|████████▊ | 326315/371472 [3:47:49<3:31:40,  3.56it/s]
 88%|████████▊ | 326316/371472 [3:47:49<3:24:55,  3.67it/s]
 88%|████████▊ | 326317/371472 [3:47:49<3:21:56,  3.73it/s]
 88%|████████▊ | 326318/371472 [3:47:50<3:20:24,  3.76it/s]
 88%|████████▊ | 326319/371472 [3:47:50<3:59:28,  3.14it/s]
 88%|████████▊ | 326320/371472 [3:47:50<3:54:37,  3.21it/s]
                                                           
{'loss': 2.6214, 'learning_rate': 2.0945290784115146e-07, 'epoch': 14.06}

 88%|████████▊ | 326320/371472 [3:47:50<3:54:37,  3.21it/s]
 88%|████████▊ | 326321/371472 [3:47:51<3:51:44,  3.25it/s]
 88%|████████▊ | 326322/371472 [3:47:51<3:58:50,  3.15it/s]
 88%|████████▊ | 326323/371472 [3:47:51<3:57:01,  3.17it/s]
 88%|████████▊ | 326324/371472 [3:47:52<3:44:44,  3.35it/s]
 88%|████████▊ | 326325/371472 [3:47:52<3:46:06,  3.33it/s]
 88%|████████▊ | 326326/371472 [3:47:52<3:38:48,  3.44it/s]
 88%|████████▊ | 326327/371472 [3:47:52<3:33:36,  3.52it/s]
 88%|████████▊ | 326328/371472 [3:47:53<3:43:43,  3.36it/s]
 88%|████████▊ | 326329/371472 [3:47:53<3:46:26,  3.32it/s]
 88%|████████▊ | 326330/371472 [3:47:53<3:33:20,  3.53it/s]
 88%|████████▊ | 326331/371472 [3:47:54<3:29:17,  3.59it/s]
 88%|████████▊ | 326332/371472 [3:47:54<3:24:48,  3.67it/s]
 88%|████████▊ | 326333/371472 [3:47:54<3:54:22,  3.21it/s]
 88%|████████▊ | 326334/371472 [3:47:55<3:50:42,  3.26it/s]
 88%|████████▊ | 326335/371472 [3:47:55<3:54:30,  3.21it/s]
 88%|████████▊ | 326336/371472 [3:47:55<3:50:52,  3.26it/s]
 88%|████████▊ | 326337/371472 [3:47:55<3:46:49,  3.32it/s]
 88%|████████▊ | 326338/371472 [3:47:56<3:38:31,  3.44it/s]
 88%|████████▊ | 326339/371472 [3:47:56<3:37:31,  3.46it/s]
 88%|████████▊ | 326340/371472 [3:47:56<3:40:25,  3.41it/s]
                                                           
{'loss': 2.6949, 'learning_rate': 2.0940442586567262e-07, 'epoch': 14.06}

 88%|████████▊ | 326340/371472 [3:47:56<3:40:25,  3.41it/s]
 88%|████████▊ | 326341/371472 [3:47:57<3:34:09,  3.51it/s]
 88%|████████▊ | 326342/371472 [3:47:57<3:28:51,  3.60it/s]
 88%|████████▊ | 326343/371472 [3:47:57<3:43:34,  3.36it/s]
 88%|████████▊ | 326344/371472 [3:47:57<3:36:14,  3.48it/s]
 88%|████████▊ | 326345/371472 [3:47:58<3:31:40,  3.55it/s]
 88%|████████▊ | 326346/371472 [3:47:58<3:27:37,  3.62it/s]
 88%|████████▊ | 326347/371472 [3:47:58<3:39:59,  3.42it/s]
 88%|████████▊ | 326348/371472 [3:47:59<3:26:18,  3.65it/s]
 88%|████████▊ | 326349/371472 [3:47:59<3:35:08,  3.50it/s]
 88%|████████▊ | 326350/371472 [3:47:59<3:30:38,  3.57it/s]
 88%|████████▊ | 326351/371472 [3:47:59<3:26:26,  3.64it/s]
 88%|████████▊ | 326352/371472 [3:48:00<3:22:05,  3.72it/s]
 88%|████████▊ | 326353/371472 [3:48:00<3:31:22,  3.56it/s]
 88%|████████▊ | 326354/371472 [3:48:00<3:35:04,  3.50it/s]
 88%|████████▊ | 326355/371472 [3:48:01<3:38:02,  3.45it/s]
 88%|████████▊ | 326356/371472 [3:48:01<3:44:39,  3.35it/s]
 88%|████████▊ | 326357/371472 [3:48:01<3:42:40,  3.38it/s]
 88%|████████▊ | 326358/371472 [3:48:01<3:49:26,  3.28it/s]
 88%|████████▊ | 326359/371472 [3:48:02<3:41:45,  3.39it/s]
 88%|████████▊ | 326360/371472 [3:48:02<3:42:57,  3.37it/s]
                                                           
{'loss': 2.5636, 'learning_rate': 2.093559438901937e-07, 'epoch': 14.06}

 88%|████████▊ | 326360/371472 [3:48:02<3:42:57,  3.37it/s]
 88%|████████▊ | 326361/371472 [3:48:02<3:35:25,  3.49it/s]
 88%|████████▊ | 326362/371472 [3:48:03<3:30:23,  3.57it/s]
 88%|████████▊ | 326363/371472 [3:48:03<3:32:00,  3.55it/s]
 88%|████████▊ | 326364/371472 [3:48:03<3:28:25,  3.61it/s]
 88%|████████▊ | 326365/371472 [3:48:03<3:39:08,  3.43it/s]
 88%|████████▊ | 326366/371472 [3:48:04<3:44:11,  3.35it/s]
 88%|████████▊ | 326367/371472 [3:48:04<3:33:55,  3.51it/s]
 88%|████████▊ | 326368/371472 [3:48:04<3:38:06,  3.45it/s]
 88%|████████▊ | 326369/371472 [3:48:05<3:25:50,  3.65it/s]
 88%|████████▊ | 326370/371472 [3:48:05<3:29:49,  3.58it/s]
 88%|████████▊ | 326371/371472 [3:48:05<3:28:43,  3.60it/s]
 88%|████████▊ | 326372/371472 [3:48:05<3:35:58,  3.48it/s]
 88%|████████▊ | 326373/371472 [3:48:06<3:30:53,  3.56it/s]
 88%|████████▊ | 326374/371472 [3:48:06<3:47:59,  3.30it/s]
 88%|████████▊ | 326375/371472 [3:48:06<3:40:54,  3.40it/s]
 88%|████████▊ | 326376/371472 [3:48:07<3:36:24,  3.47it/s]
 88%|████████▊ | 326377/371472 [3:48:07<3:35:26,  3.49it/s]
 88%|████████▊ | 326378/371472 [3:48:07<3:35:23,  3.49it/s]
 88%|████████▊ | 326379/371472 [3:48:07<3:29:13,  3.59it/s]
 88%|████████▊ | 326380/371472 [3:48:08<3:30:11,  3.58it/s]
                                                           
{'loss': 2.5917, 'learning_rate': 2.0930746191471484e-07, 'epoch': 14.06}

 88%|████████▊ | 326380/371472 [3:48:08<3:30:11,  3.58it/s]
 88%|████████▊ | 326381/371472 [3:48:08<3:26:14,  3.64it/s]
 88%|████████▊ | 326382/371472 [3:48:08<3:50:41,  3.26it/s]
 88%|████████▊ | 326383/371472 [3:48:09<3:43:09,  3.37it/s]
 88%|████████▊ | 326384/371472 [3:48:09<3:35:34,  3.49it/s]
 88%|████████▊ | 326385/371472 [3:48:09<3:31:34,  3.55it/s]
 88%|████████▊ | 326386/371472 [3:48:09<3:30:16,  3.57it/s]
 88%|████████▊ | 326387/371472 [3:48:10<3:45:43,  3.33it/s]
 88%|████████▊ | 326388/371472 [3:48:10<3:38:44,  3.44it/s]
 88%|████████▊ | 326389/371472 [3:48:10<3:35:09,  3.49it/s]
 88%|████████▊ | 326390/371472 [3:48:11<3:26:17,  3.64it/s]
 88%|████████▊ | 326391/371472 [3:48:11<3:25:29,  3.66it/s]
 88%|████████▊ | 326392/371472 [3:48:11<3:22:30,  3.71it/s]
 88%|████████▊ | 326393/371472 [3:48:11<3:21:20,  3.73it/s]
 88%|████████▊ | 326394/371472 [3:48:12<3:25:31,  3.66it/s]
 88%|████████▊ | 326395/371472 [3:48:12<3:20:44,  3.74it/s]
 88%|████████▊ | 326396/371472 [3:48:12<3:23:12,  3.70it/s]
 88%|████████▊ | 326397/371472 [3:48:13<3:43:26,  3.36it/s]
 88%|████████▊ | 326398/371472 [3:48:13<3:46:51,  3.31it/s]
 88%|████████▊ | 326399/371472 [3:48:13<3:34:36,  3.50it/s]
 88%|████████▊ | 326400/371472 [3:48:13<3:32:41,  3.53it/s]
                                                           
{'loss': 2.5601, 'learning_rate': 2.0925897993923588e-07, 'epoch': 14.06}

 88%|████████▊ | 326400/371472 [3:48:13<3:32:41,  3.53it/s]
 88%|████████▊ | 326401/371472 [3:48:14<4:12:28,  2.98it/s]
 88%|████████▊ | 326402/371472 [3:48:14<4:10:32,  3.00it/s]
 88%|████████▊ | 326403/371472 [3:48:14<4:13:31,  2.96it/s]
 88%|████████▊ | 326404/371472 [3:48:15<4:21:07,  2.88it/s]
 88%|████████▊ | 326405/371472 [3:48:15<4:15:50,  2.94it/s]
 88%|████████▊ | 326406/371472 [3:48:16<4:29:14,  2.79it/s]
 88%|████████▊ | 326407/371472 [3:48:16<4:12:51,  2.97it/s]
 88%|████████▊ | 326408/371472 [3:48:16<4:05:24,  3.06it/s]
 88%|████████▊ | 326409/371472 [3:48:16<3:49:12,  3.28it/s]
 88%|████████▊ | 326410/371472 [3:48:17<3:35:54,  3.48it/s]
 88%|████████▊ | 326411/371472 [3:48:17<3:31:50,  3.55it/s]
 88%|████████▊ | 326412/371472 [3:48:17<3:27:22,  3.62it/s]
 88%|████████▊ | 326413/371472 [3:48:17<3:18:41,  3.78it/s]
 88%|████████▊ | 326414/371472 [3:48:18<4:09:44,  3.01it/s]
 88%|████████▊ | 326415/371472 [3:48:18<4:08:02,  3.03it/s]
 88%|████████▊ | 326416/371472 [3:48:19<4:05:52,  3.05it/s]
 88%|████████▊ | 326417/371472 [3:48:19<4:02:01,  3.10it/s]
 88%|████████▊ | 326418/371472 [3:48:19<3:47:03,  3.31it/s]
 88%|████████▊ | 326419/371472 [3:48:19<3:43:11,  3.36it/s]
 88%|████████▊ | 326420/371472 [3:48:20<3:44:59,  3.34it/s]
                                                           
{'loss': 2.6498, 'learning_rate': 2.0921049796375706e-07, 'epoch': 14.06}

 88%|████████▊ | 326420/371472 [3:48:20<3:44:59,  3.34it/s]
 88%|████████▊ | 326421/371472 [3:48:20<3:45:18,  3.33it/s]
 88%|████████▊ | 326422/371472 [3:48:20<3:38:30,  3.44it/s]
 88%|████████▊ | 326423/371472 [3:48:21<3:27:01,  3.63it/s]
 88%|████████▊ | 326424/371472 [3:48:21<3:29:11,  3.59it/s]
 88%|████████▊ | 326425/371472 [3:48:21<3:25:11,  3.66it/s]
 88%|████████▊ | 326426/371472 [3:48:21<3:34:53,  3.49it/s]
 88%|████████▊ | 326427/371472 [3:48:22<3:29:35,  3.58it/s]
 88%|████████▊ | 326428/371472 [3:48:22<3:26:23,  3.64it/s]
 88%|████████▊ | 326429/371472 [3:48:22<3:30:38,  3.56it/s]
 88%|████████▊ | 326430/371472 [3:48:22<3:26:07,  3.64it/s]
 88%|████████▊ | 326431/371472 [3:48:23<3:24:08,  3.68it/s]
 88%|████████▊ | 326432/371472 [3:48:23<3:15:46,  3.83it/s]
 88%|████████▊ | 326433/371472 [3:48:23<3:18:54,  3.77it/s]
 88%|████████▊ | 326434/371472 [3:48:24<3:38:05,  3.44it/s]
 88%|████████▊ | 326435/371472 [3:48:24<3:31:48,  3.54it/s]
 88%|████████▊ | 326436/371472 [3:48:24<3:38:08,  3.44it/s]
 88%|████████▊ | 326437/371472 [3:48:24<3:27:35,  3.62it/s]
 88%|████████▊ | 326438/371472 [3:48:25<3:44:47,  3.34it/s]
 88%|████████▊ | 326439/371472 [3:48:25<3:39:07,  3.43it/s]
 88%|████████▊ | 326440/371472 [3:48:25<3:30:02,  3.57it/s]
                                                           
{'loss': 2.6198, 'learning_rate': 2.091620159882781e-07, 'epoch': 14.06}

 88%|████████▊ | 326440/371472 [3:48:25<3:30:02,  3.57it/s]
 88%|████████▊ | 326441/371472 [3:48:26<3:24:47,  3.66it/s]
 88%|████████▊ | 326442/371472 [3:48:26<3:26:44,  3.63it/s]
 88%|████████▊ | 326443/371472 [3:48:26<3:23:46,  3.68it/s]
 88%|████████▊ | 326444/371472 [3:48:26<3:24:18,  3.67it/s]
 88%|████████▊ | 326445/371472 [3:48:27<3:31:50,  3.54it/s]
 88%|████████▊ | 326446/371472 [3:48:27<3:20:28,  3.74it/s]
 88%|████████▊ | 326447/371472 [3:48:27<3:20:10,  3.75it/s]
 88%|████████▊ | 326448/371472 [3:48:27<3:14:25,  3.86it/s]
 88%|████████▊ | 326449/371472 [3:48:28<3:13:16,  3.88it/s]
 88%|████████▊ | 326450/371472 [3:48:28<3:14:46,  3.85it/s]
 88%|████████▊ | 326451/371472 [3:48:28<3:14:50,  3.85it/s]
 88%|████████▊ | 326452/371472 [3:48:29<3:21:57,  3.72it/s]
 88%|████████▊ | 326453/371472 [3:48:29<3:22:49,  3.70it/s]
 88%|████████▊ | 326454/371472 [3:48:29<3:19:16,  3.77it/s]
 88%|████████▊ | 326455/371472 [3:48:29<3:31:41,  3.54it/s]
 88%|████████▊ | 326456/371472 [3:48:30<3:24:41,  3.67it/s]
 88%|████████▊ | 326457/371472 [3:48:30<3:24:11,  3.67it/s]
 88%|████████▊ | 326458/371472 [3:48:30<3:25:46,  3.65it/s]
 88%|████████▊ | 326459/371472 [3:48:30<3:19:04,  3.77it/s]
 88%|████████▊ | 326460/371472 [3:48:31<3:26:05,  3.64it/s]
                                                           
{'loss': 2.5998, 'learning_rate': 2.0911353401279928e-07, 'epoch': 14.06}

 88%|████████▊ | 326460/371472 [3:48:31<3:26:05,  3.64it/s]
 88%|████████▊ | 326461/371472 [3:48:31<3:21:23,  3.72it/s]
 88%|████████▊ | 326462/371472 [3:48:31<3:22:11,  3.71it/s]
 88%|████████▊ | 326463/371472 [3:48:32<3:27:02,  3.62it/s]
 88%|████████▊ | 326464/371472 [3:48:32<3:30:52,  3.56it/s]
 88%|████████▊ | 326465/371472 [3:48:32<3:22:29,  3.70it/s]
 88%|████████▊ | 326466/371472 [3:48:32<3:57:11,  3.16it/s]
 88%|████████▊ | 326467/371472 [3:48:33<3:50:51,  3.25it/s]
 88%|████████▊ | 326468/371472 [3:48:33<3:40:17,  3.40it/s]
 88%|████████▊ | 326469/371472 [3:48:33<3:30:02,  3.57it/s]
 88%|████████▊ | 326470/371472 [3:48:34<3:21:45,  3.72it/s]
 88%|████████▊ | 326471/371472 [3:48:34<3:22:17,  3.71it/s]
 88%|████████▊ | 326472/371472 [3:48:34<3:22:42,  3.70it/s]
 88%|████████▊ | 326473/371472 [3:48:34<3:23:23,  3.69it/s]
 88%|████████▊ | 326474/371472 [3:48:35<3:21:03,  3.73it/s]
 88%|████████▊ | 326475/371472 [3:48:35<3:21:37,  3.72it/s]
 88%|████████▊ | 326476/371472 [3:48:35<3:25:51,  3.64it/s]
 88%|████████▊ | 326477/371472 [3:48:35<3:27:04,  3.62it/s]
 88%|████████▊ | 326478/371472 [3:48:36<3:24:47,  3.66it/s]
 88%|████████▊ | 326479/371472 [3:48:36<3:34:05,  3.50it/s]
 88%|████████▊ | 326480/371472 [3:48:36<3:34:46,  3.49it/s]
                                                           
{'loss': 2.6851, 'learning_rate': 2.0906505203732033e-07, 'epoch': 14.06}

 88%|████████▊ | 326480/371472 [3:48:36<3:34:46,  3.49it/s]
 88%|████████▊ | 326481/371472 [3:48:37<3:38:40,  3.43it/s]
 88%|████████▊ | 326482/371472 [3:48:37<3:34:58,  3.49it/s]
 88%|████████▊ | 326483/371472 [3:48:37<3:23:56,  3.68it/s]
 88%|████████▊ | 326484/371472 [3:48:37<3:26:55,  3.62it/s]
 88%|████████▊ | 326485/371472 [3:48:38<3:20:19,  3.74it/s]
 88%|████████▊ | 326486/371472 [3:48:38<3:34:30,  3.50it/s]
 88%|████████▊ | 326487/371472 [3:48:38<3:36:10,  3.47it/s]
 88%|████████▊ | 326488/371472 [3:48:39<3:40:19,  3.40it/s]
 88%|████████▊ | 326489/371472 [3:48:39<3:30:52,  3.56it/s]
 88%|████████▊ | 326490/371472 [3:48:39<3:53:02,  3.22it/s]
 88%|████████▊ | 326491/371472 [3:48:39<3:46:41,  3.31it/s]
 88%|████████▊ | 326492/371472 [3:48:40<3:44:45,  3.34it/s]
 88%|████████▊ | 326493/371472 [3:48:40<3:32:43,  3.52it/s]
 88%|████████▊ | 326494/371472 [3:48:40<3:30:55,  3.55it/s]
 88%|████████▊ | 326495/371472 [3:48:41<3:35:20,  3.48it/s]
 88%|████████▊ | 326496/371472 [3:48:41<3:27:49,  3.61it/s]
 88%|████████▊ | 326497/371472 [3:48:41<3:23:38,  3.68it/s]
 88%|████████▊ | 326498/371472 [3:48:41<3:18:51,  3.77it/s]
 88%|████████▊ | 326499/371472 [3:48:42<3:28:49,  3.59it/s]
 88%|████████▊ | 326500/371472 [3:48:42<3:46:51,  3.30it/s]
                                                           
{'loss': 2.5409, 'learning_rate': 2.0901657006184148e-07, 'epoch': 14.06}

 88%|████████▊ | 326500/371472 [3:48:42<3:46:51,  3.30it/s]
 88%|████████▊ | 326501/371472 [3:48:42<3:35:14,  3.48it/s]
 88%|████████▊ | 326502/371472 [3:48:43<3:38:52,  3.42it/s]
 88%|████████▊ | 326503/371472 [3:48:43<3:43:26,  3.35it/s]
 88%|████████▊ | 326504/371472 [3:48:43<3:44:57,  3.33it/s]
 88%|████████▊ | 326505/371472 [3:48:43<3:34:26,  3.49it/s]
 88%|████████▊ | 326506/371472 [3:48:44<3:35:40,  3.47it/s]
 88%|████████▊ | 326507/371472 [3:48:44<3:34:25,  3.50it/s]
 88%|████████▊ | 326508/371472 [3:48:44<3:27:26,  3.61it/s]
 88%|████████▊ | 326509/371472 [3:48:45<3:24:02,  3.67it/s]
 88%|████████▊ | 326510/371472 [3:48:45<3:18:59,  3.77it/s]
 88%|████████▊ | 326511/371472 [3:48:45<3:20:35,  3.74it/s]
 88%|████████▊ | 326512/371472 [3:48:45<3:28:41,  3.59it/s]
 88%|████████▊ | 326513/371472 [3:48:46<3:24:28,  3.66it/s]
 88%|████████▊ | 326514/371472 [3:48:46<3:25:10,  3.65it/s]
 88%|████████▊ | 326515/371472 [3:48:46<3:32:54,  3.52it/s]
 88%|████████▊ | 326516/371472 [3:48:47<3:35:29,  3.48it/s]
 88%|████████▊ | 326517/371472 [3:48:47<3:44:43,  3.33it/s]
 88%|████████▊ | 326518/371472 [3:48:47<3:41:00,  3.39it/s]
 88%|████████▊ | 326519/371472 [3:48:47<3:30:38,  3.56it/s]
 88%|████████▊ | 326520/371472 [3:48:48<3:29:02,  3.58it/s]
                                                           
{'loss': 2.6197, 'learning_rate': 2.0896808808636252e-07, 'epoch': 14.06}

 88%|████████▊ | 326520/371472 [3:48:48<3:29:02,  3.58it/s]
 88%|████████▊ | 326521/371472 [3:48:48<3:27:07,  3.62it/s]
 88%|████████▊ | 326522/371472 [3:48:48<3:34:46,  3.49it/s]
 88%|████████▊ | 326523/371472 [3:48:49<3:34:08,  3.50it/s]
 88%|████████▊ | 326524/371472 [3:48:49<3:26:11,  3.63it/s]
 88%|████████▊ | 326525/371472 [3:48:49<3:45:07,  3.33it/s]
 88%|████████▊ | 326526/371472 [3:48:49<3:34:01,  3.50it/s]
 88%|████████▊ | 326527/371472 [3:48:50<3:44:40,  3.33it/s]
 88%|████████▊ | 326528/371472 [3:48:50<3:36:30,  3.46it/s]
 88%|████████▊ | 326529/371472 [3:48:50<3:39:34,  3.41it/s]
 88%|████████▊ | 326530/371472 [3:48:51<3:34:04,  3.50it/s]
 88%|████████▊ | 326531/371472 [3:48:51<3:24:48,  3.66it/s]
 88%|████████▊ | 326532/371472 [3:48:51<3:34:04,  3.50it/s]
 88%|████████▊ | 326533/371472 [3:48:51<3:32:21,  3.53it/s]
 88%|████████▊ | 326534/371472 [3:48:52<3:38:46,  3.42it/s]
 88%|████████▊ | 326535/371472 [3:48:52<3:35:19,  3.48it/s]
 88%|████████▊ | 326536/371472 [3:48:52<3:23:39,  3.68it/s]
 88%|████████▊ | 326537/371472 [3:48:52<3:22:26,  3.70it/s]
 88%|████████▊ | 326538/371472 [3:48:53<3:21:48,  3.71it/s]
 88%|████████▊ | 326539/371472 [3:48:53<3:25:23,  3.65it/s]
 88%|████████▊ | 326540/371472 [3:48:53<3:24:32,  3.66it/s]
                                                           
{'loss': 2.602, 'learning_rate': 2.089196061108837e-07, 'epoch': 14.06}

 88%|████████▊ | 326540/371472 [3:48:53<3:24:32,  3.66it/s]
 88%|████████▊ | 326541/371472 [3:48:54<3:21:50,  3.71it/s]
 88%|████████▊ | 326542/371472 [3:48:54<3:42:04,  3.37it/s]
 88%|████████▊ | 326543/371472 [3:48:54<3:34:56,  3.48it/s]
 88%|████████▊ | 326544/371472 [3:48:54<3:28:17,  3.59it/s]
 88%|████████▊ | 326545/371472 [3:48:55<3:20:22,  3.74it/s]
 88%|████████▊ | 326546/371472 [3:48:55<3:21:36,  3.71it/s]
 88%|████████▊ | 326547/371472 [3:48:55<3:21:49,  3.71it/s]
 88%|████████▊ | 326548/371472 [3:48:56<3:21:15,  3.72it/s]
 88%|████████▊ | 326549/371472 [3:48:56<3:34:49,  3.49it/s]
 88%|████████▊ | 326550/371472 [3:48:56<3:34:50,  3.48it/s]
 88%|████████▊ | 326551/371472 [3:48:56<3:23:55,  3.67it/s]
 88%|████████▊ | 326552/371472 [3:48:57<3:37:17,  3.45it/s]
 88%|████████▊ | 326553/371472 [3:48:57<3:28:29,  3.59it/s]
 88%|████████▊ | 326554/371472 [3:48:57<3:26:18,  3.63it/s]
 88%|████████▊ | 326555/371472 [3:48:58<3:32:42,  3.52it/s]
 88%|████████▊ | 326556/371472 [3:48:58<3:28:07,  3.60it/s]
 88%|████████▊ | 326557/371472 [3:48:58<3:33:12,  3.51it/s]
 88%|████████▊ | 326558/371472 [3:48:58<3:39:51,  3.40it/s]
 88%|████████▊ | 326559/371472 [3:48:59<3:29:17,  3.58it/s]
 88%|████████▊ | 326560/371472 [3:48:59<3:43:29,  3.35it/s]
                                                           
{'loss': 2.6465, 'learning_rate': 2.0887112413540477e-07, 'epoch': 14.07}

 88%|████████▊ | 326560/371472 [3:48:59<3:43:29,  3.35it/s]
 88%|████████▊ | 326561/371472 [3:48:59<3:34:46,  3.49it/s]
 88%|████████▊ | 326562/371472 [3:49:00<3:50:39,  3.24it/s]
 88%|████████▊ | 326563/371472 [3:49:00<3:39:21,  3.41it/s]
 88%|████████▊ | 326564/371472 [3:49:00<3:46:53,  3.30it/s]
 88%|████████▊ | 326565/371472 [3:49:00<3:33:32,  3.50it/s]
 88%|████████▊ | 326566/371472 [3:49:01<3:30:07,  3.56it/s]
 88%|████████▊ | 326567/371472 [3:49:01<3:27:32,  3.61it/s]
 88%|████████▊ | 326568/371472 [3:49:01<3:27:42,  3.60it/s]
 88%|████████▊ | 326569/371472 [3:49:02<3:33:58,  3.50it/s]
 88%|████████▊ | 326570/371472 [3:49:02<3:24:44,  3.66it/s]
 88%|████████▊ | 326571/371472 [3:49:02<3:36:04,  3.46it/s]
 88%|████████▊ | 326572/371472 [3:49:02<3:49:23,  3.26it/s]
 88%|████████▊ | 326573/371472 [3:49:03<3:35:23,  3.47it/s]
 88%|████████▊ | 326574/371472 [3:49:03<3:28:56,  3.58it/s]
 88%|████████▊ | 326575/371472 [3:49:03<3:36:11,  3.46it/s]
 88%|████████▊ | 326576/371472 [3:49:04<3:54:39,  3.19it/s]
 88%|████████▊ | 326577/371472 [3:49:04<3:56:30,  3.16it/s]
 88%|████████▊ | 326578/371472 [3:49:04<3:57:05,  3.16it/s]
 88%|████████▊ | 326579/371472 [3:49:05<3:43:46,  3.34it/s]
 88%|████████▊ | 326580/371472 [3:49:05<3:46:23,  3.31it/s]
                                                           
{'loss': 2.5901, 'learning_rate': 2.088226421599259e-07, 'epoch': 14.07}

 88%|████████▊ | 326580/371472 [3:49:05<3:46:23,  3.31it/s]
 88%|████████▊ | 326581/371472 [3:49:05<3:36:37,  3.45it/s]
 88%|████████▊ | 326582/371472 [3:49:05<3:25:32,  3.64it/s]
 88%|████████▊ | 326583/371472 [3:49:06<3:17:45,  3.78it/s]
 88%|████████▊ | 326584/371472 [3:49:06<3:18:45,  3.76it/s]
 88%|████████▊ | 326585/371472 [3:49:06<3:25:33,  3.64it/s]
 88%|████████▊ | 326586/371472 [3:49:06<3:19:55,  3.74it/s]
 88%|████████▊ | 326587/371472 [3:49:07<3:25:17,  3.64it/s]
 88%|████████▊ | 326588/371472 [3:49:07<3:28:47,  3.58it/s]
 88%|████████▊ | 326589/371472 [3:49:07<3:35:07,  3.48it/s]
 88%|████████▊ | 326590/371472 [3:49:08<3:31:26,  3.54it/s]
 88%|████████▊ | 326591/371472 [3:49:08<3:29:55,  3.56it/s]
 88%|████████▊ | 326592/371472 [3:49:08<3:26:02,  3.63it/s]
 88%|████████▊ | 326593/371472 [3:49:08<3:28:20,  3.59it/s]
 88%|████████▊ | 326594/371472 [3:49:09<3:24:44,  3.65it/s]
 88%|████████▊ | 326595/371472 [3:49:09<3:29:49,  3.56it/s]
 88%|████████▊ | 326596/371472 [3:49:09<3:45:54,  3.31it/s]
 88%|████████▊ | 326597/371472 [3:49:10<3:34:43,  3.48it/s]
 88%|████████▊ | 326598/371472 [3:49:10<3:29:14,  3.57it/s]
 88%|████████▊ | 326599/371472 [3:49:10<3:30:51,  3.55it/s]
 88%|████████▊ | 326600/371472 [3:49:10<3:29:09,  3.58it/s]
                                                           
{'loss': 2.629, 'learning_rate': 2.0877416018444697e-07, 'epoch': 14.07}

 88%|████████▊ | 326600/371472 [3:49:10<3:29:09,  3.58it/s]
 88%|████████▊ | 326601/371472 [3:49:11<3:25:18,  3.64it/s]
 88%|████████▊ | 326602/371472 [3:49:11<3:24:11,  3.66it/s]
 88%|████████▊ | 326603/371472 [3:49:11<3:16:14,  3.81it/s]
 88%|████████▊ | 326604/371472 [3:49:11<3:22:11,  3.70it/s]
 88%|████████▊ | 326605/371472 [3:49:12<3:19:01,  3.76it/s]
 88%|████████▊ | 326606/371472 [3:49:12<3:41:14,  3.38it/s]
 88%|████████▊ | 326607/371472 [3:49:12<3:29:36,  3.57it/s]
 88%|████████▊ | 326608/371472 [3:49:13<3:22:12,  3.70it/s]
 88%|████████▊ | 326609/371472 [3:49:13<3:23:52,  3.67it/s]
 88%|████████▊ | 326610/371472 [3:49:13<3:32:01,  3.53it/s]
 88%|████████▊ | 326611/371472 [3:49:13<3:47:32,  3.29it/s]
 88%|████████▊ | 326612/371472 [3:49:14<3:42:34,  3.36it/s]
 88%|████████▊ | 326613/371472 [3:49:14<3:51:08,  3.23it/s]
 88%|████████▊ | 326614/371472 [3:49:14<3:39:59,  3.40it/s]
 88%|████████▊ | 326615/371472 [3:49:15<3:37:36,  3.44it/s]
 88%|████████▊ | 326616/371472 [3:49:15<3:40:08,  3.40it/s]
 88%|████████▊ | 326617/371472 [3:49:15<3:27:14,  3.61it/s]
 88%|████████▊ | 326618/371472 [3:49:15<3:25:37,  3.64it/s]
 88%|████████▊ | 326619/371472 [3:49:16<3:24:52,  3.65it/s]
 88%|████████▊ | 326620/371472 [3:49:16<3:28:15,  3.59it/s]
                                                           
{'loss': 2.7136, 'learning_rate': 2.0872567820896812e-07, 'epoch': 14.07}

 88%|████████▊ | 326620/371472 [3:49:16<3:28:15,  3.59it/s]
 88%|████████▊ | 326621/371472 [3:49:16<3:34:56,  3.48it/s]
 88%|████████▊ | 326622/371472 [3:49:17<3:27:49,  3.60it/s]
 88%|████████▊ | 326623/371472 [3:49:17<3:23:20,  3.68it/s]
 88%|████████▊ | 326624/371472 [3:49:17<3:23:17,  3.68it/s]
 88%|████████▊ | 326625/371472 [3:49:17<3:44:52,  3.32it/s]
 88%|████████▊ | 326626/371472 [3:49:18<3:39:37,  3.40it/s]
 88%|████████▊ | 326627/371472 [3:49:18<3:59:33,  3.12it/s]
 88%|████████▊ | 326628/371472 [3:49:18<4:02:52,  3.08it/s]
 88%|████████▊ | 326629/371472 [3:49:19<3:54:33,  3.19it/s]
 88%|████████▊ | 326630/371472 [3:49:19<4:01:56,  3.09it/s]
 88%|████████▊ | 326631/371472 [3:49:19<3:55:31,  3.17it/s]
 88%|████████▊ | 326632/371472 [3:49:20<4:00:56,  3.10it/s]
 88%|████████▊ | 326633/371472 [3:49:20<3:45:00,  3.32it/s]
 88%|████████▊ | 326634/371472 [3:49:20<3:47:46,  3.28it/s]
 88%|████████▊ | 326635/371472 [3:49:21<3:34:34,  3.48it/s]
 88%|████████▊ | 326636/371472 [3:49:21<3:37:33,  3.43it/s]
 88%|████████▊ | 326637/371472 [3:49:21<3:25:53,  3.63it/s]
 88%|████████▊ | 326638/371472 [3:49:21<3:28:51,  3.58it/s]
 88%|████████▊ | 326639/371472 [3:49:22<3:33:43,  3.50it/s]
 88%|████████▊ | 326640/371472 [3:49:22<3:29:11,  3.57it/s]
                                                           
{'loss': 2.5696, 'learning_rate': 2.0867719623348916e-07, 'epoch': 14.07}

 88%|████████▊ | 326640/371472 [3:49:22<3:29:11,  3.57it/s]
 88%|████████▊ | 326641/371472 [3:49:22<3:25:00,  3.64it/s]
 88%|████████▊ | 326642/371472 [3:49:22<3:21:55,  3.70it/s]
 88%|████████▊ | 326643/371472 [3:49:23<3:17:51,  3.78it/s]
 88%|████████▊ | 326644/371472 [3:49:23<3:18:59,  3.75it/s]
 88%|████████▊ | 326645/371472 [3:49:23<3:21:39,  3.70it/s]
 88%|████████▊ | 326646/371472 [3:49:24<3:33:03,  3.51it/s]
 88%|████████▊ | 326647/371472 [3:49:24<3:26:29,  3.62it/s]
 88%|████████▊ | 326648/371472 [3:49:24<3:23:59,  3.66it/s]
 88%|████████▊ | 326649/371472 [3:49:24<3:30:49,  3.54it/s]
 88%|████████▊ | 326650/371472 [3:49:25<3:25:44,  3.63it/s]
 88%|████████▊ | 326651/371472 [3:49:25<3:19:51,  3.74it/s]
 88%|████████▊ | 326652/371472 [3:49:25<3:25:12,  3.64it/s]
 88%|████████▊ | 326653/371472 [3:49:26<3:31:40,  3.53it/s]
 88%|████████▊ | 326654/371472 [3:49:26<3:28:26,  3.58it/s]
 88%|████████▊ | 326655/371472 [3:49:26<3:28:05,  3.59it/s]
 88%|████████▊ | 326656/371472 [3:49:26<3:25:22,  3.64it/s]
 88%|████████▊ | 326657/371472 [3:49:27<3:22:18,  3.69it/s]
 88%|████████▊ | 326658/371472 [3:49:27<3:28:52,  3.58it/s]
 88%|████████▊ | 326659/371472 [3:49:27<3:47:24,  3.28it/s]
 88%|████████▊ | 326660/371472 [3:49:28<3:54:41,  3.18it/s]
                                                           
{'loss': 2.8239, 'learning_rate': 2.0862871425801024e-07, 'epoch': 14.07}

 88%|████████▊ | 326660/371472 [3:49:28<3:54:41,  3.18it/s]
 88%|████████▊ | 326661/371472 [3:49:28<3:42:55,  3.35it/s]
 88%|████████▊ | 326662/371472 [3:49:28<3:34:02,  3.49it/s]
 88%|████████▊ | 326663/371472 [3:49:28<3:26:29,  3.62it/s]
 88%|████████▊ | 326664/371472 [3:49:29<3:34:22,  3.48it/s]
 88%|████████▊ | 326665/371472 [3:49:29<3:29:29,  3.56it/s]
 88%|████████▊ | 326666/371472 [3:49:29<3:30:20,  3.55it/s]
 88%|████████▊ | 326667/371472 [3:49:30<3:27:27,  3.60it/s]
 88%|████████▊ | 326668/371472 [3:49:30<3:29:15,  3.57it/s]
 88%|████████▊ | 326669/371472 [3:49:30<3:33:23,  3.50it/s]
 88%|████████▊ | 326670/371472 [3:49:30<3:43:50,  3.34it/s]
 88%|████████▊ | 326671/371472 [3:49:31<3:56:02,  3.16it/s]
 88%|████████▊ | 326672/371472 [3:49:31<3:45:46,  3.31it/s]
 88%|████████▊ | 326673/371472 [3:49:31<3:49:18,  3.26it/s]
 88%|████████▊ | 326674/371472 [3:49:32<3:48:14,  3.27it/s]
 88%|████████▊ | 326675/371472 [3:49:32<3:39:35,  3.40it/s]
 88%|████████▊ | 326676/371472 [3:49:32<3:30:28,  3.55it/s]
 88%|████████▊ | 326677/371472 [3:49:33<3:40:28,  3.39it/s]
 88%|████████▊ | 326678/371472 [3:49:33<3:38:01,  3.42it/s]
 88%|████████▊ | 326679/371472 [3:49:33<3:38:03,  3.42it/s]
 88%|████████▊ | 326680/371472 [3:49:33<3:47:58,  3.27it/s]
                                                           
{'loss': 2.6161, 'learning_rate': 2.085802322825314e-07, 'epoch': 14.07}

 88%|████████▊ | 326680/371472 [3:49:33<3:47:58,  3.27it/s]
 88%|████████▊ | 326681/371472 [3:49:34<3:47:11,  3.29it/s]
 88%|████████▊ | 326682/371472 [3:49:34<3:37:41,  3.43it/s]
 88%|████████▊ | 326683/371472 [3:49:34<3:46:46,  3.29it/s]
 88%|████████▊ | 326684/371472 [3:49:35<3:38:39,  3.41it/s]
 88%|████████▊ | 326685/371472 [3:49:35<3:33:23,  3.50it/s]
 88%|████████▊ | 326686/371472 [3:49:35<3:38:17,  3.42it/s]
 88%|████████▊ | 326687/371472 [3:49:35<3:28:08,  3.59it/s]
 88%|████████▊ | 326688/371472 [3:49:36<3:21:53,  3.70it/s]
 88%|████████▊ | 326689/371472 [3:49:36<3:25:05,  3.64it/s]
 88%|████████▊ | 326690/371472 [3:49:36<3:26:58,  3.61it/s]
 88%|████████▊ | 326691/371472 [3:49:37<3:27:37,  3.59it/s]
 88%|████████▊ | 326692/371472 [3:49:37<3:22:30,  3.69it/s]
 88%|████████▊ | 326693/371472 [3:49:37<3:26:50,  3.61it/s]
 88%|████████▊ | 326694/371472 [3:49:37<3:33:51,  3.49it/s]
 88%|████████▊ | 326695/371472 [3:49:38<3:29:30,  3.56it/s]
 88%|████████▊ | 326696/371472 [3:49:38<3:32:34,  3.51it/s]
 88%|████████▊ | 326697/371472 [3:49:38<4:32:27,  2.74it/s]
 88%|████████▊ | 326698/371472 [3:49:39<4:11:28,  2.97it/s]
 88%|████████▊ | 326699/371472 [3:49:39<3:50:02,  3.24it/s]
 88%|████████▊ | 326700/371472 [3:49:39<3:55:22,  3.17it/s]
                                                           
{'loss': 2.6433, 'learning_rate': 2.0853175030705246e-07, 'epoch': 14.07}

 88%|████████▊ | 326700/371472 [3:49:39<3:55:22,  3.17it/s]
 88%|████████▊ | 326701/371472 [3:49:40<3:46:24,  3.30it/s]
 88%|████████▊ | 326702/371472 [3:49:40<3:45:28,  3.31it/s]
 88%|████████▊ | 326703/371472 [3:49:40<3:39:42,  3.40it/s]
 88%|████████▊ | 326704/371472 [3:49:40<3:26:18,  3.62it/s]
 88%|████████▊ | 326705/371472 [3:49:41<3:21:41,  3.70it/s]
 88%|████████▊ | 326706/371472 [3:49:41<3:21:14,  3.71it/s]
 88%|████████▊ | 326707/371472 [3:49:41<3:21:54,  3.70it/s]
 88%|████████▊ | 326708/371472 [3:49:41<3:22:35,  3.68it/s]
 88%|████████▊ | 326709/371472 [3:49:42<3:28:30,  3.58it/s]
 88%|████████▊ | 326710/371472 [3:49:42<3:29:42,  3.56it/s]
 88%|████████▊ | 326711/371472 [3:49:42<3:43:19,  3.34it/s]
 88%|████████▊ | 326712/371472 [3:49:43<3:36:59,  3.44it/s]
 88%|████████▊ | 326713/371472 [3:49:43<3:26:35,  3.61it/s]
 88%|████████▊ | 326714/371472 [3:49:43<3:35:28,  3.46it/s]
 88%|████████▊ | 326715/371472 [3:49:44<3:40:49,  3.38it/s]
 88%|████████▊ | 326716/371472 [3:49:44<3:40:19,  3.39it/s]
 88%|████████▊ | 326717/371472 [3:49:44<3:34:17,  3.48it/s]
 88%|████████▊ | 326718/371472 [3:49:44<3:21:31,  3.70it/s]
 88%|████████▊ | 326719/371472 [3:49:45<3:24:53,  3.64it/s]
 88%|████████▊ | 326720/371472 [3:49:45<3:48:32,  3.26it/s]
                                                           
{'loss': 2.6542, 'learning_rate': 2.084832683315736e-07, 'epoch': 14.07}

 88%|████████▊ | 326720/371472 [3:49:45<3:48:32,  3.26it/s]
 88%|████████▊ | 326721/371472 [3:49:45<3:38:11,  3.42it/s]
 88%|████████▊ | 326722/371472 [3:49:46<3:41:21,  3.37it/s]
 88%|████████▊ | 326723/371472 [3:49:46<3:30:46,  3.54it/s]
 88%|████████▊ | 326724/371472 [3:49:46<3:29:10,  3.57it/s]
 88%|████████▊ | 326725/371472 [3:49:46<3:31:47,  3.52it/s]
 88%|████████▊ | 326726/371472 [3:49:47<3:32:36,  3.51it/s]
 88%|████████▊ | 326727/371472 [3:49:47<3:37:06,  3.43it/s]
 88%|████████▊ | 326728/371472 [3:49:47<3:46:09,  3.30it/s]
 88%|████████▊ | 326729/371472 [3:49:48<3:37:02,  3.44it/s]
 88%|████████▊ | 326730/371472 [3:49:48<3:28:13,  3.58it/s]
 88%|████████▊ | 326731/371472 [3:49:48<3:26:21,  3.61it/s]
 88%|████████▊ | 326732/371472 [3:49:48<3:21:45,  3.70it/s]
 88%|████████▊ | 326733/371472 [3:49:49<3:26:51,  3.60it/s]
 88%|████████▊ | 326734/371472 [3:49:49<3:33:19,  3.50it/s]
 88%|████████▊ | 326735/371472 [3:49:49<3:30:19,  3.55it/s]
 88%|████████▊ | 326736/371472 [3:49:50<3:40:24,  3.38it/s]
 88%|████████▊ | 326737/371472 [3:49:50<3:35:19,  3.46it/s]
 88%|████████▊ | 326738/371472 [3:49:50<3:35:31,  3.46it/s]
 88%|████████▊ | 326739/371472 [3:49:50<3:29:53,  3.55it/s]
 88%|████████▊ | 326740/371472 [3:49:51<3:29:26,  3.56it/s]
                                                           
{'loss': 2.552, 'learning_rate': 2.0843478635609468e-07, 'epoch': 14.07}

 88%|████████▊ | 326740/371472 [3:49:51<3:29:26,  3.56it/s]
 88%|████████▊ | 326741/371472 [3:49:51<3:24:14,  3.65it/s]
 88%|████████▊ | 326742/371472 [3:49:51<3:23:36,  3.66it/s]
 88%|████████▊ | 326743/371472 [3:49:51<3:21:39,  3.70it/s]
 88%|████████▊ | 326744/371472 [3:49:52<3:30:49,  3.54it/s]
 88%|████████▊ | 326745/371472 [3:49:52<3:22:47,  3.68it/s]
 88%|████████▊ | 326746/371472 [3:49:52<3:19:47,  3.73it/s]
 88%|████████▊ | 326747/371472 [3:49:53<3:16:14,  3.80it/s]
 88%|████████▊ | 326748/371472 [3:49:53<3:18:49,  3.75it/s]
 88%|████████▊ | 326749/371472 [3:49:53<3:27:04,  3.60it/s]
 88%|████████▊ | 326750/371472 [3:49:53<3:27:21,  3.59it/s]
 88%|████████▊ | 326751/371472 [3:49:54<3:41:27,  3.37it/s]
 88%|████████▊ | 326752/371472 [3:49:54<3:33:49,  3.49it/s]
 88%|████████▊ | 326753/371472 [3:49:54<3:33:20,  3.49it/s]
 88%|████████▊ | 326754/371472 [3:49:55<3:37:45,  3.42it/s]
 88%|████████▊ | 326755/371472 [3:49:55<3:29:51,  3.55it/s]
 88%|████████▊ | 326756/371472 [3:49:55<3:20:19,  3.72it/s]
 88%|████████▊ | 326757/371472 [3:49:55<3:20:10,  3.72it/s]
 88%|████████▊ | 326758/371472 [3:49:56<3:17:46,  3.77it/s]
 88%|████████▊ | 326759/371472 [3:49:56<3:16:50,  3.79it/s]
 88%|████████▊ | 326760/371472 [3:49:56<3:25:56,  3.62it/s]
                                                           
{'loss': 2.4334, 'learning_rate': 2.0838630438061583e-07, 'epoch': 14.07}

 88%|████████▊ | 326760/371472 [3:49:56<3:25:56,  3.62it/s]
 88%|████████▊ | 326761/371472 [3:49:57<3:40:11,  3.38it/s]
 88%|████████▊ | 326762/371472 [3:49:57<3:38:20,  3.41it/s]
 88%|████████▊ | 326763/371472 [3:49:57<3:34:10,  3.48it/s]
 88%|████████▊ | 326764/371472 [3:49:57<3:30:38,  3.54it/s]
 88%|████████▊ | 326765/371472 [3:49:58<3:20:22,  3.72it/s]
 88%|████████▊ | 326766/371472 [3:49:58<3:23:56,  3.65it/s]
 88%|████████▊ | 326767/371472 [3:49:58<3:21:31,  3.70it/s]
 88%|████████▊ | 326768/371472 [3:49:58<3:20:43,  3.71it/s]
 88%|████████▊ | 326769/371472 [3:49:59<3:27:53,  3.58it/s]
 88%|████████▊ | 326770/371472 [3:49:59<3:17:36,  3.77it/s]
 88%|████████▊ | 326771/371472 [3:49:59<3:20:35,  3.71it/s]
 88%|████████▊ | 326772/371472 [3:49:59<3:18:24,  3.75it/s]
 88%|████████▊ | 326773/371472 [3:50:00<3:13:40,  3.85it/s]
 88%|████████▊ | 326774/371472 [3:50:00<3:14:56,  3.82it/s]
 88%|████████▊ | 326775/371472 [3:50:00<3:14:18,  3.83it/s]
 88%|████████▊ | 326776/371472 [3:50:00<3:13:03,  3.86it/s]
 88%|████████▊ | 326777/371472 [3:50:01<3:09:24,  3.93it/s]
 88%|████████▊ | 326778/371472 [3:50:01<3:07:44,  3.97it/s]
 88%|████████▊ | 326779/371472 [3:50:01<3:08:07,  3.96it/s]
 88%|████████▊ | 326780/371472 [3:50:01<3:07:50,  3.97it/s]
                                                           
{'loss': 2.6701, 'learning_rate': 2.0833782240513688e-07, 'epoch': 14.08}

 88%|████████▊ | 326780/371472 [3:50:01<3:07:50,  3.97it/s]
 88%|████████▊ | 326781/371472 [3:50:02<3:11:33,  3.89it/s]
 88%|████████▊ | 326782/371472 [3:50:02<3:09:57,  3.92it/s]
 88%|████████▊ | 326783/371472 [3:50:02<3:29:03,  3.56it/s]
 88%|████████▊ | 326784/371472 [3:50:03<3:27:46,  3.58it/s]
 88%|████████▊ | 326785/371472 [3:50:03<3:28:24,  3.57it/s]
 88%|████████▊ | 326786/371472 [3:50:03<3:29:34,  3.55it/s]
 88%|████████▊ | 326787/371472 [3:50:03<3:26:56,  3.60it/s]
 88%|████████▊ | 326788/371472 [3:50:04<3:21:26,  3.70it/s]
 88%|████████▊ | 326789/371472 [3:50:04<3:27:25,  3.59it/s]
 88%|████████▊ | 326790/371472 [3:50:04<3:22:32,  3.68it/s]
 88%|████████▊ | 326791/371472 [3:50:05<3:34:38,  3.47it/s]
 88%|████████▊ | 326792/371472 [3:50:05<3:33:20,  3.49it/s]
 88%|████████▊ | 326793/371472 [3:50:05<3:41:40,  3.36it/s]
 88%|████████▊ | 326794/371472 [3:50:05<3:39:47,  3.39it/s]
 88%|████████▊ | 326795/371472 [3:50:06<3:39:55,  3.39it/s]
 88%|████████▊ | 326796/371472 [3:50:06<3:30:21,  3.54it/s]
 88%|████████▊ | 326797/371472 [3:50:06<3:29:12,  3.56it/s]
 88%|████████▊ | 326798/371472 [3:50:07<3:24:20,  3.64it/s]
 88%|████████▊ | 326799/371472 [3:50:07<3:27:52,  3.58it/s]
 88%|████████▊ | 326800/371472 [3:50:07<3:28:07,  3.58it/s]
                                                           
{'loss': 2.5073, 'learning_rate': 2.0828934042965805e-07, 'epoch': 14.08}

 88%|████████▊ | 326800/371472 [3:50:07<3:28:07,  3.58it/s]
 88%|████████▊ | 326801/371472 [3:50:07<3:28:00,  3.58it/s]
 88%|████████▊ | 326802/371472 [3:50:08<3:22:31,  3.68it/s]
 88%|████████▊ | 326803/371472 [3:50:08<3:24:13,  3.65it/s]
 88%|████████▊ | 326804/371472 [3:50:08<3:20:34,  3.71it/s]
 88%|████████▊ | 326805/371472 [3:50:08<3:16:40,  3.79it/s]
 88%|████████▊ | 326806/371472 [3:50:09<3:11:55,  3.88it/s]
 88%|████████▊ | 326807/371472 [3:50:09<3:14:35,  3.83it/s]
 88%|████████▊ | 326808/371472 [3:50:09<3:13:20,  3.85it/s]
 88%|████████▊ | 326809/371472 [3:50:10<3:23:22,  3.66it/s]
 88%|████████▊ | 326810/371472 [3:50:10<3:18:33,  3.75it/s]
 88%|████████▊ | 326811/371472 [3:50:10<3:24:24,  3.64it/s]
 88%|████████▊ | 326812/371472 [3:50:10<3:27:11,  3.59it/s]
 88%|████████▊ | 326813/371472 [3:50:11<3:25:10,  3.63it/s]
 88%|████████▊ | 326814/371472 [3:50:11<3:22:11,  3.68it/s]
 88%|████████▊ | 326815/371472 [3:50:11<3:28:50,  3.56it/s]
 88%|████████▊ | 326816/371472 [3:50:12<3:43:29,  3.33it/s]
 88%|████████▊ | 326817/371472 [3:50:12<3:43:35,  3.33it/s]
 88%|████████▊ | 326818/371472 [3:50:12<3:38:22,  3.41it/s]
 88%|████████▊ | 326819/371472 [3:50:12<3:45:33,  3.30it/s]
 88%|████████▊ | 326820/371472 [3:50:13<3:40:33,  3.37it/s]
                                                           
{'loss': 2.6875, 'learning_rate': 2.082408584541791e-07, 'epoch': 14.08}

 88%|████████▊ | 326820/371472 [3:50:13<3:40:33,  3.37it/s]
 88%|████████▊ | 326821/371472 [3:50:13<3:47:40,  3.27it/s]
 88%|████████▊ | 326822/371472 [3:50:13<3:39:13,  3.39it/s]
 88%|████████▊ | 326823/371472 [3:50:14<3:34:45,  3.47it/s]
 88%|████████▊ | 326824/371472 [3:50:14<3:24:35,  3.64it/s]
 88%|████████▊ | 326825/371472 [3:50:14<3:27:03,  3.59it/s]
 88%|████████▊ | 326826/371472 [3:50:14<3:29:20,  3.55it/s]
 88%|████████▊ | 326827/371472 [3:50:15<3:29:03,  3.56it/s]
 88%|████████▊ | 326828/371472 [3:50:15<3:20:55,  3.70it/s]
 88%|████████▊ | 326829/371472 [3:50:15<3:28:34,  3.57it/s]
 88%|████████▊ | 326830/371472 [3:50:16<3:21:59,  3.68it/s]
 88%|████████▊ | 326831/371472 [3:50:16<3:16:58,  3.78it/s]
 88%|████████▊ | 326832/371472 [3:50:16<3:12:47,  3.86it/s]
 88%|████████▊ | 326833/371472 [3:50:16<3:18:55,  3.74it/s]
 88%|████████▊ | 326834/371472 [3:50:17<3:17:10,  3.77it/s]
 88%|████████▊ | 326835/371472 [3:50:17<3:13:15,  3.85it/s]
 88%|████████▊ | 326836/371472 [3:50:17<3:11:50,  3.88it/s]
 88%|████████▊ | 326837/371472 [3:50:17<3:11:26,  3.89it/s]
 88%|████████▊ | 326838/371472 [3:50:18<3:12:08,  3.87it/s]
 88%|████████▊ | 326839/371472 [3:50:18<3:28:14,  3.57it/s]
 88%|████████▊ | 326840/371472 [3:50:18<3:27:20,  3.59it/s]
                                                           
{'loss': 2.6327, 'learning_rate': 2.0819237647870025e-07, 'epoch': 14.08}

 88%|████████▊ | 326840/371472 [3:50:18<3:27:20,  3.59it/s]
 88%|████████▊ | 326841/371472 [3:50:18<3:25:00,  3.63it/s]
 88%|████████▊ | 326842/371472 [3:50:19<3:29:16,  3.55it/s]
 88%|████████▊ | 326843/371472 [3:50:19<3:25:39,  3.62it/s]
 88%|████████▊ | 326844/371472 [3:50:19<3:20:00,  3.72it/s]
 88%|████████▊ | 326845/371472 [3:50:20<3:20:50,  3.70it/s]
 88%|████████▊ | 326846/371472 [3:50:20<3:24:49,  3.63it/s]
 88%|████████▊ | 326847/371472 [3:50:20<3:33:48,  3.48it/s]
 88%|████████▊ | 326848/371472 [3:50:20<3:35:10,  3.46it/s]
 88%|████████▊ | 326849/371472 [3:50:21<4:04:54,  3.04it/s]
 88%|████████▊ | 326850/371472 [3:50:21<3:46:10,  3.29it/s]
 88%|████████▊ | 326851/371472 [3:50:21<3:39:33,  3.39it/s]
 88%|████████▊ | 326852/371472 [3:50:22<3:43:00,  3.33it/s]
 88%|████████▊ | 326853/371472 [3:50:22<3:36:57,  3.43it/s]
 88%|████████▊ | 326854/371472 [3:50:22<3:31:47,  3.51it/s]
 88%|████████▊ | 326855/371472 [3:50:22<3:25:11,  3.62it/s]
 88%|████████▊ | 326856/371472 [3:50:23<3:26:19,  3.60it/s]
 88%|████████▊ | 326857/371472 [3:50:23<3:23:11,  3.66it/s]
 88%|████████▊ | 326858/371472 [3:50:23<3:54:27,  3.17it/s]
 88%|████████▊ | 326859/371472 [3:50:24<3:46:39,  3.28it/s]
 88%|████████▊ | 326860/371472 [3:50:24<3:36:37,  3.43it/s]
                                                           
{'loss': 2.5871, 'learning_rate': 2.0814389450322132e-07, 'epoch': 14.08}

 88%|████████▊ | 326860/371472 [3:50:24<3:36:37,  3.43it/s]
 88%|████████▊ | 326861/371472 [3:50:24<3:29:15,  3.55it/s]
 88%|████████▊ | 326862/371472 [3:50:25<3:27:20,  3.59it/s]
 88%|████████▊ | 326863/371472 [3:50:25<3:24:51,  3.63it/s]
 88%|████████▊ | 326864/371472 [3:50:25<3:37:13,  3.42it/s]
 88%|████████▊ | 326865/371472 [3:50:25<3:33:49,  3.48it/s]
 88%|████████▊ | 326866/371472 [3:50:26<3:29:20,  3.55it/s]
 88%|████████▊ | 326867/371472 [3:50:26<3:26:55,  3.59it/s]
 88%|████████▊ | 326868/371472 [3:50:26<3:27:37,  3.58it/s]
 88%|████████▊ | 326869/371472 [3:50:27<3:36:53,  3.43it/s]
 88%|████████▊ | 326870/371472 [3:50:27<3:30:04,  3.54it/s]
 88%|████████▊ | 326871/371472 [3:50:27<3:26:51,  3.59it/s]
 88%|████████▊ | 326872/371472 [3:50:27<3:23:28,  3.65it/s]
 88%|████████▊ | 326873/371472 [3:50:28<3:21:21,  3.69it/s]
 88%|████████▊ | 326874/371472 [3:50:28<3:21:13,  3.69it/s]
 88%|████████▊ | 326875/371472 [3:50:28<3:12:43,  3.86it/s]
 88%|████████▊ | 326876/371472 [3:50:28<3:15:55,  3.79it/s]
 88%|████████▊ | 326877/371472 [3:50:29<3:11:10,  3.89it/s]
 88%|████████▊ | 326878/371472 [3:50:29<3:09:03,  3.93it/s]
 88%|████████▊ | 326879/371472 [3:50:29<3:08:47,  3.94it/s]
 88%|████████▊ | 326880/371472 [3:50:29<3:36:59,  3.42it/s]
                                                           
{'loss': 2.5354, 'learning_rate': 2.0809541252774245e-07, 'epoch': 14.08}

 88%|████████▊ | 326880/371472 [3:50:29<3:36:59,  3.42it/s]
 88%|████████▊ | 326881/371472 [3:50:30<3:35:49,  3.44it/s]
 88%|████████▊ | 326882/371472 [3:50:30<3:29:19,  3.55it/s]
 88%|████████▊ | 326883/371472 [3:50:30<3:25:07,  3.62it/s]
 88%|████████▊ | 326884/371472 [3:50:31<3:21:24,  3.69it/s]
 88%|████████▊ | 326885/371472 [3:50:31<3:15:53,  3.79it/s]
 88%|████████▊ | 326886/371472 [3:50:31<3:17:47,  3.76it/s]
 88%|████████▊ | 326887/371472 [3:50:31<3:22:57,  3.66it/s]
 88%|████████▊ | 326888/371472 [3:50:32<3:22:36,  3.67it/s]
 88%|████████▊ | 326889/371472 [3:50:32<3:24:03,  3.64it/s]
 88%|████████▊ | 326890/371472 [3:50:32<3:22:26,  3.67it/s]
 88%|████████▊ | 326891/371472 [3:50:32<3:25:16,  3.62it/s]
 88%|████████▊ | 326892/371472 [3:50:33<3:23:18,  3.65it/s]
 88%|████████▊ | 326893/371472 [3:50:33<3:21:31,  3.69it/s]
 88%|████████▊ | 326894/371472 [3:50:33<3:46:32,  3.28it/s]
 88%|████████▊ | 326895/371472 [3:50:34<3:40:49,  3.36it/s]
 88%|████████▊ | 326896/371472 [3:50:34<3:40:35,  3.37it/s]
 88%|████████▊ | 326897/371472 [3:50:34<3:56:31,  3.14it/s]
 88%|████████▊ | 326898/371472 [3:50:35<3:44:25,  3.31it/s]
 88%|████████▊ | 326899/371472 [3:50:35<3:41:02,  3.36it/s]
 88%|████████▊ | 326900/371472 [3:50:35<3:43:29,  3.32it/s]
                                                           
{'loss': 2.6025, 'learning_rate': 2.0804693055226352e-07, 'epoch': 14.08}

 88%|████████▊ | 326900/371472 [3:50:35<3:43:29,  3.32it/s]
 88%|████████▊ | 326901/371472 [3:50:35<3:36:26,  3.43it/s]
 88%|████████▊ | 326902/371472 [3:50:36<3:25:39,  3.61it/s]
 88%|████████▊ | 326903/371472 [3:50:36<3:41:12,  3.36it/s]
 88%|████████▊ | 326904/371472 [3:50:36<3:32:19,  3.50it/s]
 88%|████████▊ | 326905/371472 [3:50:37<3:22:19,  3.67it/s]
 88%|████████▊ | 326906/371472 [3:50:37<3:17:57,  3.75it/s]
 88%|████████▊ | 326907/371472 [3:50:37<3:24:13,  3.64it/s]
 88%|████████▊ | 326908/371472 [3:50:37<3:19:37,  3.72it/s]
 88%|████████▊ | 326909/371472 [3:50:38<3:16:57,  3.77it/s]
 88%|████████▊ | 326910/371472 [3:50:38<3:19:47,  3.72it/s]
 88%|████████▊ | 326911/371472 [3:50:38<3:26:23,  3.60it/s]
 88%|████████▊ | 326912/371472 [3:50:38<3:28:33,  3.56it/s]
 88%|████████▊ | 326913/371472 [3:50:39<3:25:16,  3.62it/s]
 88%|████████▊ | 326914/371472 [3:50:39<3:22:09,  3.67it/s]
 88%|████████▊ | 326915/371472 [3:50:39<3:15:57,  3.79it/s]
 88%|████████▊ | 326916/371472 [3:50:39<3:07:29,  3.96it/s]
 88%|████████▊ | 326917/371472 [3:50:40<3:09:18,  3.92it/s]
 88%|████████▊ | 326918/371472 [3:50:40<3:21:34,  3.68it/s]
 88%|████████▊ | 326919/371472 [3:50:40<3:15:54,  3.79it/s]
 88%|████████▊ | 326920/371472 [3:50:41<3:15:15,  3.80it/s]
                                                           
{'loss': 2.602, 'learning_rate': 2.079984485767847e-07, 'epoch': 14.08}

 88%|████████▊ | 326920/371472 [3:50:41<3:15:15,  3.80it/s]
 88%|████████▊ | 326921/371472 [3:50:41<3:50:48,  3.22it/s]
 88%|████████▊ | 326922/371472 [3:50:41<3:36:37,  3.43it/s]
 88%|████████▊ | 326923/371472 [3:50:41<3:33:29,  3.48it/s]
 88%|████████▊ | 326924/371472 [3:50:42<3:30:40,  3.52it/s]
 88%|████████▊ | 326925/371472 [3:50:42<3:21:26,  3.69it/s]
 88%|████████▊ | 326926/371472 [3:50:42<3:28:28,  3.56it/s]
 88%|████████▊ | 326927/371472 [3:50:43<3:24:15,  3.63it/s]
 88%|████████▊ | 326928/371472 [3:50:43<3:34:02,  3.47it/s]
 88%|████████▊ | 326929/371472 [3:50:43<3:48:45,  3.25it/s]
 88%|████████▊ | 326930/371472 [3:50:44<3:40:32,  3.37it/s]
 88%|████████▊ | 326931/371472 [3:50:44<3:33:52,  3.47it/s]
 88%|████████▊ | 326932/371472 [3:50:44<3:21:27,  3.68it/s]
 88%|████████▊ | 326933/371472 [3:50:44<3:24:08,  3.64it/s]
 88%|████████▊ | 326934/371472 [3:50:45<3:24:18,  3.63it/s]
 88%|████████▊ | 326935/371472 [3:50:45<3:28:30,  3.56it/s]
 88%|████████▊ | 326936/371472 [3:50:45<3:18:03,  3.75it/s]
 88%|████████▊ | 326937/371472 [3:50:45<3:33:59,  3.47it/s]
 88%|████████▊ | 326938/371472 [3:50:46<3:46:07,  3.28it/s]
 88%|████████▊ | 326939/371472 [3:50:46<3:38:47,  3.39it/s]
 88%|████████▊ | 326940/371472 [3:50:46<3:35:47,  3.44it/s]
                                                           
{'loss': 2.6622, 'learning_rate': 2.0794996660130577e-07, 'epoch': 14.08}

 88%|████████▊ | 326940/371472 [3:50:46<3:35:47,  3.44it/s]
 88%|████████▊ | 326941/371472 [3:50:47<3:44:32,  3.31it/s]
 88%|████████▊ | 326942/371472 [3:50:47<3:37:30,  3.41it/s]
 88%|████████▊ | 326943/371472 [3:50:47<3:31:08,  3.51it/s]
 88%|████████▊ | 326944/371472 [3:50:47<3:25:34,  3.61it/s]
 88%|████████▊ | 326945/371472 [3:50:48<3:20:46,  3.70it/s]
 88%|████████▊ | 326946/371472 [3:50:48<3:16:34,  3.78it/s]
 88%|████████▊ | 326947/371472 [3:50:48<3:25:16,  3.61it/s]
 88%|████████▊ | 326948/371472 [3:50:49<3:32:30,  3.49it/s]
 88%|████████▊ | 326949/371472 [3:50:49<3:46:49,  3.27it/s]
 88%|████████▊ | 326950/371472 [3:50:49<3:36:16,  3.43it/s]
 88%|████████▊ | 326951/371472 [3:50:50<3:47:03,  3.27it/s]
 88%|████████▊ | 326952/371472 [3:50:50<3:37:02,  3.42it/s]
 88%|████████▊ | 326953/371472 [3:50:50<3:45:48,  3.29it/s]
 88%|████████▊ | 326954/371472 [3:50:50<3:35:32,  3.44it/s]
 88%|████████▊ | 326955/371472 [3:50:51<3:39:13,  3.38it/s]
 88%|████████▊ | 326956/371472 [3:50:51<3:28:25,  3.56it/s]
 88%|████████▊ | 326957/371472 [3:50:51<3:25:39,  3.61it/s]
 88%|████████▊ | 326958/371472 [3:50:52<3:30:47,  3.52it/s]
 88%|████████▊ | 326959/371472 [3:50:52<3:28:42,  3.55it/s]
 88%|████████▊ | 326960/371472 [3:50:52<3:20:23,  3.70it/s]
                                                           
{'loss': 2.6982, 'learning_rate': 2.079014846258269e-07, 'epoch': 14.08}

 88%|████████▊ | 326960/371472 [3:50:52<3:20:23,  3.70it/s]
 88%|████████▊ | 326961/371472 [3:50:52<3:17:51,  3.75it/s]
 88%|████████▊ | 326962/371472 [3:50:53<3:20:19,  3.70it/s]
 88%|████████▊ | 326963/371472 [3:50:53<3:24:59,  3.62it/s]
 88%|████████▊ | 326964/371472 [3:50:53<3:22:07,  3.67it/s]
 88%|████████▊ | 326965/371472 [3:50:53<3:28:54,  3.55it/s]
 88%|████████▊ | 326966/371472 [3:50:54<3:32:24,  3.49it/s]
 88%|████████▊ | 326967/371472 [3:50:54<3:34:35,  3.46it/s]
 88%|████████▊ | 326968/371472 [3:50:54<3:26:29,  3.59it/s]
 88%|████████▊ | 326969/371472 [3:50:55<3:21:20,  3.68it/s]
 88%|████████▊ | 326970/371472 [3:50:55<3:14:20,  3.82it/s]
 88%|████████▊ | 326971/371472 [3:50:55<3:20:52,  3.69it/s]
 88%|████████▊ | 326972/371472 [3:50:55<3:23:04,  3.65it/s]
 88%|████████▊ | 326973/371472 [3:50:56<3:23:37,  3.64it/s]
 88%|████████▊ | 326974/371472 [3:50:56<3:23:57,  3.64it/s]
 88%|████████▊ | 326975/371472 [3:50:56<3:27:35,  3.57it/s]
 88%|████████▊ | 326976/371472 [3:50:56<3:22:27,  3.66it/s]
 88%|████████▊ | 326977/371472 [3:50:57<3:16:04,  3.78it/s]
 88%|████████▊ | 326978/371472 [3:50:57<3:16:25,  3.78it/s]
 88%|████████▊ | 326979/371472 [3:50:57<3:20:21,  3.70it/s]
 88%|████████▊ | 326980/371472 [3:50:57<3:22:22,  3.66it/s]
                                                           
{'loss': 2.5206, 'learning_rate': 2.0785300265034796e-07, 'epoch': 14.08}

 88%|████████▊ | 326980/371472 [3:50:58<3:22:22,  3.66it/s]
 88%|████████▊ | 326981/371472 [3:50:58<3:25:28,  3.61it/s]
 88%|████████▊ | 326982/371472 [3:50:58<3:19:51,  3.71it/s]
 88%|████████▊ | 326983/371472 [3:50:58<3:18:39,  3.73it/s]
 88%|████████▊ | 326984/371472 [3:50:59<3:33:03,  3.48it/s]
 88%|████████▊ | 326985/371472 [3:50:59<3:38:20,  3.40it/s]
 88%|████████▊ | 326986/371472 [3:50:59<3:35:44,  3.44it/s]
 88%|████████▊ | 326987/371472 [3:51:00<3:39:33,  3.38it/s]
 88%|████████▊ | 326988/371472 [3:51:00<3:37:26,  3.41it/s]
 88%|████████▊ | 326989/371472 [3:51:00<3:31:58,  3.50it/s]
 88%|████████▊ | 326990/371472 [3:51:00<3:37:39,  3.41it/s]
 88%|████████▊ | 326991/371472 [3:51:01<3:32:13,  3.49it/s]
 88%|████████▊ | 326992/371472 [3:51:01<3:28:09,  3.56it/s]
 88%|████████▊ | 326993/371472 [3:51:01<3:53:06,  3.18it/s]
 88%|████████▊ | 326994/371472 [3:51:02<3:39:03,  3.38it/s]
 88%|████████▊ | 326995/371472 [3:51:02<3:31:12,  3.51it/s]
 88%|████████▊ | 326996/371472 [3:51:02<3:20:24,  3.70it/s]
 88%|████████▊ | 326997/371472 [3:51:02<3:18:58,  3.73it/s]
 88%|████████▊ | 326998/371472 [3:51:03<3:18:42,  3.73it/s]
 88%|████████▊ | 326999/371472 [3:51:03<3:26:46,  3.58it/s]
 88%|████████▊ | 327000/371472 [3:51:03<3:19:17,  3.72it/s]
                                                           
{'loss': 2.5749, 'learning_rate': 2.0780452067486914e-07, 'epoch': 14.08}

 88%|████████▊ | 327000/371472 [3:51:03<3:19:17,  3.72it/s]
 88%|████████▊ | 327001/371472 [3:51:03<3:17:32,  3.75it/s]
 88%|████████▊ | 327002/371472 [3:51:04<3:13:44,  3.83it/s]
 88%|████████▊ | 327003/371472 [3:51:04<3:24:36,  3.62it/s]
 88%|████████▊ | 327004/371472 [3:51:04<3:25:11,  3.61it/s]
 88%|████████▊ | 327005/371472 [3:51:05<3:20:22,  3.70it/s]
 88%|████████▊ | 327006/371472 [3:51:05<3:15:52,  3.78it/s]
 88%|████████▊ | 327007/371472 [3:51:05<3:19:58,  3.71it/s]
 88%|████████▊ | 327008/371472 [3:51:05<3:21:45,  3.67it/s]
 88%|████████▊ | 327009/371472 [3:51:06<3:15:18,  3.79it/s]
 88%|████████▊ | 327010/371472 [3:51:06<3:14:26,  3.81it/s]
 88%|████████▊ | 327011/371472 [3:51:06<3:22:01,  3.67it/s]
 88%|████████▊ | 327012/371472 [3:51:06<3:23:50,  3.64it/s]
 88%|████████▊ | 327013/371472 [3:51:07<3:22:36,  3.66it/s]
 88%|████████▊ | 327014/371472 [3:51:07<3:26:10,  3.59it/s]
 88%|████████▊ | 327015/371472 [3:51:07<3:25:11,  3.61it/s]
 88%|████████▊ | 327016/371472 [3:51:08<3:26:19,  3.59it/s]
 88%|████████▊ | 327017/371472 [3:51:08<3:20:46,  3.69it/s]
 88%|████████▊ | 327018/371472 [3:51:08<3:28:28,  3.55it/s]
 88%|████████▊ | 327019/371472 [3:51:08<3:19:22,  3.72it/s]
 88%|████████▊ | 327020/371472 [3:51:09<3:19:17,  3.72it/s]
                                                           
{'loss': 2.509, 'learning_rate': 2.0775603869939018e-07, 'epoch': 14.09}

 88%|████████▊ | 327020/371472 [3:51:09<3:19:17,  3.72it/s]
 88%|████████▊ | 327021/371472 [3:51:09<3:17:37,  3.75it/s]
 88%|████████▊ | 327022/371472 [3:51:09<3:17:44,  3.75it/s]
 88%|████████▊ | 327023/371472 [3:51:09<3:14:45,  3.80it/s]
 88%|████████▊ | 327024/371472 [3:51:10<3:16:26,  3.77it/s]
 88%|████████▊ | 327025/371472 [3:51:10<3:29:20,  3.54it/s]
 88%|████████▊ | 327026/371472 [3:51:10<3:28:33,  3.55it/s]
 88%|████████▊ | 327027/371472 [3:51:11<3:23:03,  3.65it/s]
 88%|████████▊ | 327028/371472 [3:51:11<3:16:37,  3.77it/s]
 88%|████████▊ | 327029/371472 [3:51:11<3:08:15,  3.93it/s]
 88%|████████▊ | 327030/371472 [3:51:11<3:07:53,  3.94it/s]
 88%|████████▊ | 327031/371472 [3:51:12<3:15:47,  3.78it/s]
 88%|████████▊ | 327032/371472 [3:51:12<3:16:06,  3.78it/s]
 88%|████████▊ | 327033/371472 [3:51:12<3:24:59,  3.61it/s]
 88%|████████▊ | 327034/371472 [3:51:12<3:15:15,  3.79it/s]
 88%|████████▊ | 327035/371472 [3:51:13<3:14:08,  3.81it/s]
 88%|████████▊ | 327036/371472 [3:51:13<3:40:29,  3.36it/s]
 88%|████████▊ | 327037/371472 [3:51:13<3:32:21,  3.49it/s]
 88%|████████▊ | 327038/371472 [3:51:13<3:23:00,  3.65it/s]
 88%|████████▊ | 327039/371472 [3:51:14<3:20:59,  3.68it/s]
 88%|████████▊ | 327040/371472 [3:51:14<3:33:35,  3.47it/s]
                                                           
{'loss': 2.6565, 'learning_rate': 2.0770755672391134e-07, 'epoch': 14.09}

 88%|████████▊ | 327040/371472 [3:51:14<3:33:35,  3.47it/s]
 88%|████████▊ | 327041/371472 [3:51:14<3:35:39,  3.43it/s]
 88%|████████▊ | 327042/371472 [3:51:15<3:23:38,  3.64it/s]
 88%|████████▊ | 327043/371472 [3:51:15<3:21:10,  3.68it/s]
 88%|████████▊ | 327044/371472 [3:51:15<3:33:38,  3.47it/s]
 88%|████████▊ | 327045/371472 [3:51:15<3:23:05,  3.65it/s]
 88%|████████▊ | 327046/371472 [3:51:16<3:15:58,  3.78it/s]
 88%|████████▊ | 327047/371472 [3:51:16<3:15:52,  3.78it/s]
 88%|████████▊ | 327048/371472 [3:51:16<3:17:46,  3.74it/s]
 88%|████████▊ | 327049/371472 [3:51:17<3:23:40,  3.64it/s]
 88%|████████▊ | 327050/371472 [3:51:17<3:23:01,  3.65it/s]
 88%|████████▊ | 327051/371472 [3:51:17<3:27:29,  3.57it/s]
 88%|████████▊ | 327052/371472 [3:51:17<3:24:34,  3.62it/s]
 88%|████████▊ | 327053/371472 [3:51:18<3:29:02,  3.54it/s]
 88%|████████▊ | 327054/371472 [3:51:18<3:19:34,  3.71it/s]
 88%|████████▊ | 327055/371472 [3:51:18<3:26:22,  3.59it/s]
 88%|████████▊ | 327056/371472 [3:51:18<3:21:32,  3.67it/s]
 88%|████████▊ | 327057/371472 [3:51:19<3:29:31,  3.53it/s]
 88%|████████▊ | 327058/371472 [3:51:19<3:20:51,  3.69it/s]
 88%|████████▊ | 327059/371472 [3:51:19<3:18:36,  3.73it/s]
 88%|████████▊ | 327060/371472 [3:51:20<3:23:01,  3.65it/s]
                                                           
{'loss': 2.4305, 'learning_rate': 2.076590747484324e-07, 'epoch': 14.09}

 88%|████████▊ | 327060/371472 [3:51:20<3:23:01,  3.65it/s]
 88%|████████▊ | 327061/371472 [3:51:20<3:17:08,  3.75it/s]
 88%|████████▊ | 327062/371472 [3:51:20<3:14:42,  3.80it/s]
 88%|████████▊ | 327063/371472 [3:51:20<3:12:58,  3.84it/s]
 88%|████████▊ | 327064/371472 [3:51:21<3:10:25,  3.89it/s]
 88%|████████▊ | 327065/371472 [3:51:21<3:11:16,  3.87it/s]
 88%|████████▊ | 327066/371472 [3:51:21<3:12:07,  3.85it/s]
 88%|████████▊ | 327067/371472 [3:51:21<3:15:00,  3.80it/s]
 88%|████████▊ | 327068/371472 [3:51:22<3:23:37,  3.63it/s]
 88%|████████▊ | 327069/371472 [3:51:22<3:27:47,  3.56it/s]
 88%|████████▊ | 327070/371472 [3:51:22<3:33:23,  3.47it/s]
 88%|████████▊ | 327071/371472 [3:51:22<3:24:13,  3.62it/s]
 88%|████████▊ | 327072/371472 [3:51:23<3:27:07,  3.57it/s]
 88%|████████▊ | 327073/371472 [3:51:23<3:27:01,  3.57it/s]
 88%|████████▊ | 327074/371472 [3:51:23<3:31:55,  3.49it/s]
 88%|████████▊ | 327075/371472 [3:51:24<3:23:33,  3.63it/s]
 88%|████████▊ | 327076/371472 [3:51:24<3:17:40,  3.74it/s]
 88%|████████▊ | 327077/371472 [3:51:24<3:28:25,  3.55it/s]
 88%|████████▊ | 327078/371472 [3:51:24<3:21:07,  3.68it/s]
 88%|████████▊ | 327079/371472 [3:51:25<3:21:51,  3.67it/s]
 88%|████████▊ | 327080/371472 [3:51:25<3:17:03,  3.75it/s]
                                                           
{'loss': 2.6392, 'learning_rate': 2.0761059277295356e-07, 'epoch': 14.09}

 88%|████████▊ | 327080/371472 [3:51:25<3:17:03,  3.75it/s]
 88%|████████▊ | 327081/371472 [3:51:25<3:14:25,  3.81it/s]
 88%|████████▊ | 327082/371472 [3:51:25<3:19:32,  3.71it/s]
 88%|████████▊ | 327083/371472 [3:51:26<3:22:03,  3.66it/s]
 88%|████████▊ | 327084/371472 [3:51:26<3:22:57,  3.64it/s]
 88%|████████▊ | 327085/371472 [3:51:26<3:44:04,  3.30it/s]
 88%|████████▊ | 327086/371472 [3:51:27<3:36:27,  3.42it/s]
 88%|████████▊ | 327087/371472 [3:51:27<3:30:46,  3.51it/s]
 88%|████████▊ | 327088/371472 [3:51:27<3:34:11,  3.45it/s]
 88%|████████▊ | 327089/371472 [3:51:28<3:40:24,  3.36it/s]
 88%|████████▊ | 327090/371472 [3:51:28<3:42:41,  3.32it/s]
 88%|████████▊ | 327091/371472 [3:51:28<3:46:25,  3.27it/s]
 88%|████████▊ | 327092/371472 [3:51:28<3:38:58,  3.38it/s]
 88%|████████▊ | 327093/371472 [3:51:29<3:34:52,  3.44it/s]
 88%|████████▊ | 327094/371472 [3:51:29<3:40:23,  3.36it/s]
 88%|████████▊ | 327095/371472 [3:51:29<3:31:04,  3.50it/s]
 88%|████████▊ | 327096/371472 [3:51:30<3:28:30,  3.55it/s]
 88%|████████▊ | 327097/371472 [3:51:30<3:34:21,  3.45it/s]
 88%|████████▊ | 327098/371472 [3:51:30<3:52:28,  3.18it/s]
 88%|████████▊ | 327099/371472 [3:51:31<3:40:17,  3.36it/s]
 88%|████████▊ | 327100/371472 [3:51:31<3:49:44,  3.22it/s]
                                                           
{'loss': 2.5178, 'learning_rate': 2.075621107974746e-07, 'epoch': 14.09}

 88%|████████▊ | 327100/371472 [3:51:31<3:49:44,  3.22it/s]
 88%|████████▊ | 327101/371472 [3:51:31<3:43:33,  3.31it/s]
 88%|████████▊ | 327102/371472 [3:51:31<3:31:36,  3.49it/s]
 88%|████████▊ | 327103/371472 [3:51:32<3:27:00,  3.57it/s]
 88%|████████▊ | 327104/371472 [3:51:32<3:24:23,  3.62it/s]
 88%|████████▊ | 327105/371472 [3:51:32<3:19:12,  3.71it/s]
 88%|████████▊ | 327106/371472 [3:51:32<3:16:40,  3.76it/s]
 88%|████████▊ | 327107/371472 [3:51:33<3:27:50,  3.56it/s]
 88%|████████▊ | 327108/371472 [3:51:33<3:21:51,  3.66it/s]
 88%|████████▊ | 327109/371472 [3:51:33<3:31:24,  3.50it/s]
 88%|████████▊ | 327110/371472 [3:51:34<3:25:19,  3.60it/s]
 88%|████████▊ | 327111/371472 [3:51:34<3:21:55,  3.66it/s]
 88%|████████▊ | 327112/371472 [3:51:34<3:26:05,  3.59it/s]
 88%|████████▊ | 327113/371472 [3:51:34<3:27:22,  3.57it/s]
 88%|████████▊ | 327114/371472 [3:51:35<3:29:50,  3.52it/s]
 88%|████████▊ | 327115/371472 [3:51:35<3:21:11,  3.67it/s]
 88%|████████▊ | 327116/371472 [3:51:35<3:21:32,  3.67it/s]
 88%|████████▊ | 327117/371472 [3:51:36<3:24:45,  3.61it/s]
 88%|████████▊ | 327118/371472 [3:51:36<3:18:50,  3.72it/s]
 88%|████████▊ | 327119/371472 [3:51:36<3:28:25,  3.55it/s]
 88%|████████▊ | 327120/371472 [3:51:36<3:28:10,  3.55it/s]
                                                           
{'loss': 2.5122, 'learning_rate': 2.0751362882199578e-07, 'epoch': 14.09}

 88%|████████▊ | 327120/371472 [3:51:36<3:28:10,  3.55it/s]
 88%|████████▊ | 327121/371472 [3:51:37<3:26:05,  3.59it/s]
 88%|████████▊ | 327122/371472 [3:51:37<3:20:29,  3.69it/s]
 88%|████████▊ | 327123/371472 [3:51:37<3:29:12,  3.53it/s]
 88%|████████▊ | 327124/371472 [3:51:38<3:50:10,  3.21it/s]
 88%|████████▊ | 327125/371472 [3:51:38<3:40:39,  3.35it/s]
 88%|████████▊ | 327126/371472 [3:51:38<3:27:42,  3.56it/s]
 88%|████████▊ | 327127/371472 [3:51:38<3:23:54,  3.62it/s]
 88%|████████▊ | 327128/371472 [3:51:39<3:20:22,  3.69it/s]
 88%|████████▊ | 327129/371472 [3:51:39<3:19:40,  3.70it/s]
 88%|████████▊ | 327130/371472 [3:51:39<3:26:31,  3.58it/s]
 88%|████████▊ | 327131/371472 [3:51:39<3:22:44,  3.65it/s]
 88%|████████▊ | 327132/371472 [3:51:40<3:19:17,  3.71it/s]
 88%|████████▊ | 327133/371472 [3:51:40<3:18:50,  3.72it/s]
 88%|████████▊ | 327134/371472 [3:51:40<3:25:28,  3.60it/s]
 88%|████████▊ | 327135/371472 [3:51:41<3:25:22,  3.60it/s]
 88%|████████▊ | 327136/371472 [3:51:41<3:20:52,  3.68it/s]
 88%|████████▊ | 327137/371472 [3:51:41<3:16:50,  3.75it/s]
 88%|████████▊ | 327138/371472 [3:51:41<3:38:59,  3.37it/s]
 88%|████████▊ | 327139/371472 [3:51:42<3:39:54,  3.36it/s]
 88%|████████▊ | 327140/371472 [3:51:42<3:43:34,  3.30it/s]
                                                           
{'loss': 2.574, 'learning_rate': 2.0746514684651683e-07, 'epoch': 14.09}

 88%|████████▊ | 327140/371472 [3:51:42<3:43:34,  3.30it/s]
 88%|████████▊ | 327141/371472 [3:51:42<3:41:18,  3.34it/s]
 88%|████████▊ | 327142/371472 [3:51:43<3:34:45,  3.44it/s]
 88%|████████▊ | 327143/371472 [3:51:43<3:31:56,  3.49it/s]
 88%|████████▊ | 327144/371472 [3:51:43<3:39:57,  3.36it/s]
 88%|████████▊ | 327145/371472 [3:51:43<3:33:54,  3.45it/s]
 88%|████████▊ | 327146/371472 [3:51:44<3:31:03,  3.50it/s]
 88%|████████▊ | 327147/371472 [3:51:44<3:31:47,  3.49it/s]
 88%|████████▊ | 327148/371472 [3:51:44<3:26:57,  3.57it/s]
 88%|████████▊ | 327149/371472 [3:51:45<3:17:42,  3.74it/s]
 88%|████████▊ | 327150/371472 [3:51:45<3:13:27,  3.82it/s]
 88%|████████▊ | 327151/371472 [3:51:45<3:11:09,  3.86it/s]
 88%|████████▊ | 327152/371472 [3:51:46<4:09:01,  2.97it/s]
 88%|████████▊ | 327153/371472 [3:51:46<3:52:59,  3.17it/s]
 88%|████████▊ | 327154/371472 [3:51:46<3:42:49,  3.31it/s]
 88%|████████▊ | 327155/371472 [3:51:46<3:30:02,  3.52it/s]
 88%|████████▊ | 327156/371472 [3:51:47<3:31:42,  3.49it/s]
 88%|████████▊ | 327157/371472 [3:51:47<3:33:00,  3.47it/s]
 88%|████████▊ | 327158/371472 [3:51:47<3:24:30,  3.61it/s]
 88%|████████▊ | 327159/371472 [3:51:48<3:36:19,  3.41it/s]
 88%|████████▊ | 327160/371472 [3:51:48<3:27:42,  3.56it/s]
                                                           
{'loss': 2.643, 'learning_rate': 2.0741666487103798e-07, 'epoch': 14.09}

 88%|████████▊ | 327160/371472 [3:51:48<3:27:42,  3.56it/s]
 88%|████████▊ | 327161/371472 [3:51:48<3:20:27,  3.68it/s]
 88%|████████▊ | 327162/371472 [3:51:48<3:19:01,  3.71it/s]
 88%|████████▊ | 327163/371472 [3:51:49<3:12:20,  3.84it/s]
 88%|████████▊ | 327164/371472 [3:51:49<3:13:18,  3.82it/s]
 88%|████████▊ | 327165/371472 [3:51:49<3:16:16,  3.76it/s]
 88%|████████▊ | 327166/371472 [3:51:49<3:12:27,  3.84it/s]
 88%|████████▊ | 327167/371472 [3:51:50<3:31:34,  3.49it/s]
 88%|████████▊ | 327168/371472 [3:51:50<3:19:28,  3.70it/s]
 88%|████████▊ | 327169/371472 [3:51:50<3:50:59,  3.20it/s]
 88%|████████▊ | 327170/371472 [3:51:51<4:21:05,  2.83it/s]
 88%|████████▊ | 327171/371472 [3:51:51<4:16:31,  2.88it/s]
 88%|████████▊ | 327172/371472 [3:51:51<4:04:43,  3.02it/s]
 88%|████████▊ | 327173/371472 [3:51:52<3:54:56,  3.14it/s]
 88%|████████▊ | 327174/371472 [3:51:52<3:48:06,  3.24it/s]
 88%|████████▊ | 327175/371472 [3:51:52<3:36:56,  3.40it/s]
 88%|████████▊ | 327176/371472 [3:51:52<3:33:54,  3.45it/s]
 88%|████████▊ | 327177/371472 [3:51:53<3:39:51,  3.36it/s]
 88%|████████▊ | 327178/371472 [3:51:53<3:36:17,  3.41it/s]
 88%|████████▊ | 327179/371472 [3:51:53<3:36:46,  3.41it/s]
 88%|████████▊ | 327180/371472 [3:51:54<3:29:07,  3.53it/s]
                                                           
{'loss': 2.5705, 'learning_rate': 2.0736818289555905e-07, 'epoch': 14.09}

 88%|████████▊ | 327180/371472 [3:51:54<3:29:07,  3.53it/s]
 88%|████████▊ | 327181/371472 [3:51:54<3:19:47,  3.69it/s]
 88%|████████▊ | 327182/371472 [3:51:54<3:21:47,  3.66it/s]
 88%|████████▊ | 327183/371472 [3:51:54<3:19:36,  3.70it/s]
 88%|████████▊ | 327184/371472 [3:51:55<3:15:59,  3.77it/s]
 88%|████████▊ | 327185/371472 [3:51:55<3:17:10,  3.74it/s]
 88%|████████▊ | 327186/371472 [3:51:55<3:15:28,  3.78it/s]
 88%|████████▊ | 327187/371472 [3:51:55<3:12:06,  3.84it/s]
 88%|████████▊ | 327188/371472 [3:51:56<3:20:51,  3.67it/s]
 88%|████████▊ | 327189/371472 [3:51:56<3:27:06,  3.56it/s]
 88%|████████▊ | 327190/371472 [3:51:56<3:46:15,  3.26it/s]
 88%|████████▊ | 327191/371472 [3:51:57<3:39:12,  3.37it/s]
 88%|████████▊ | 327192/371472 [3:51:57<3:37:37,  3.39it/s]
 88%|████████▊ | 327193/371472 [3:51:57<3:54:32,  3.15it/s]
 88%|████████▊ | 327194/371472 [3:51:58<3:39:22,  3.36it/s]
 88%|████████▊ | 327195/371472 [3:51:58<3:31:11,  3.49it/s]
 88%|████████▊ | 327196/371472 [3:51:58<3:24:55,  3.60it/s]
 88%|████████▊ | 327197/371472 [3:51:58<3:43:34,  3.30it/s]
 88%|████████▊ | 327198/371472 [3:51:59<3:41:06,  3.34it/s]
 88%|████████▊ | 327199/371472 [3:51:59<3:28:22,  3.54it/s]
 88%|████████▊ | 327200/371472 [3:51:59<3:35:12,  3.43it/s]
                                                           
{'loss': 2.5766, 'learning_rate': 2.073197009200801e-07, 'epoch': 14.09}

 88%|████████▊ | 327200/371472 [3:51:59<3:35:12,  3.43it/s]
 88%|████████▊ | 327201/371472 [3:52:00<3:25:10,  3.60it/s]
 88%|████████▊ | 327202/371472 [3:52:00<3:22:07,  3.65it/s]
 88%|████████▊ | 327203/371472 [3:52:00<3:21:50,  3.66it/s]
 88%|████████▊ | 327204/371472 [3:52:00<3:16:57,  3.75it/s]
 88%|████████▊ | 327205/371472 [3:52:01<3:15:17,  3.78it/s]
 88%|████████▊ | 327206/371472 [3:52:01<3:19:17,  3.70it/s]
 88%|████████▊ | 327207/371472 [3:52:01<3:13:17,  3.82it/s]
 88%|████████▊ | 327208/371472 [3:52:01<3:23:28,  3.63it/s]
 88%|████████▊ | 327209/371472 [3:52:02<3:21:04,  3.67it/s]
 88%|████████▊ | 327210/371472 [3:52:02<3:26:32,  3.57it/s]
 88%|████████▊ | 327211/371472 [3:52:02<3:30:35,  3.50it/s]
 88%|████████▊ | 327212/371472 [3:52:03<3:27:17,  3.56it/s]
 88%|████████▊ | 327213/371472 [3:52:03<3:40:42,  3.34it/s]
 88%|████████▊ | 327214/371472 [3:52:03<3:31:58,  3.48it/s]
 88%|████████▊ | 327215/371472 [3:52:03<3:23:23,  3.63it/s]
 88%|████████▊ | 327216/371472 [3:52:04<3:25:57,  3.58it/s]
 88%|████████▊ | 327217/371472 [3:52:04<3:24:37,  3.60it/s]
 88%|████████▊ | 327218/371472 [3:52:04<3:18:30,  3.72it/s]
 88%|████████▊ | 327219/371472 [3:52:05<3:16:01,  3.76it/s]
 88%|████████▊ | 327220/371472 [3:52:05<3:12:35,  3.83it/s]
                                                           
{'loss': 2.6371, 'learning_rate': 2.0727121894460124e-07, 'epoch': 14.09}

 88%|████████▊ | 327220/371472 [3:52:05<3:12:35,  3.83it/s]
 88%|████████▊ | 327221/371472 [3:52:05<3:16:59,  3.74it/s]
 88%|████████▊ | 327222/371472 [3:52:05<3:21:47,  3.65it/s]
 88%|████████▊ | 327223/371472 [3:52:06<3:27:03,  3.56it/s]
 88%|████████▊ | 327224/371472 [3:52:06<3:22:19,  3.65it/s]
 88%|████████▊ | 327225/371472 [3:52:06<3:26:40,  3.57it/s]
 88%|████████▊ | 327226/371472 [3:52:06<3:34:11,  3.44it/s]
 88%|████████▊ | 327227/371472 [3:52:07<3:29:30,  3.52it/s]
 88%|████████▊ | 327228/371472 [3:52:07<3:26:11,  3.58it/s]
 88%|████████▊ | 327229/371472 [3:52:07<3:21:40,  3.66it/s]
 88%|████████▊ | 327230/371472 [3:52:08<3:29:12,  3.52it/s]
 88%|████████▊ | 327231/371472 [3:52:08<3:37:20,  3.39it/s]
 88%|████████▊ | 327232/371472 [3:52:08<3:24:08,  3.61it/s]
 88%|████████▊ | 327233/371472 [3:52:08<3:31:33,  3.49it/s]
 88%|████████▊ | 327234/371472 [3:52:09<3:26:19,  3.57it/s]
 88%|████████▊ | 327235/371472 [3:52:09<3:22:42,  3.64it/s]
 88%|████████▊ | 327236/371472 [3:52:09<3:19:50,  3.69it/s]
 88%|████████▊ | 327237/371472 [3:52:09<3:10:41,  3.87it/s]
 88%|████████▊ | 327238/371472 [3:52:10<3:06:12,  3.96it/s]
 88%|████████▊ | 327239/371472 [3:52:10<3:02:04,  4.05it/s]
 88%|████████▊ | 327240/371472 [3:52:10<3:03:51,  4.01it/s]
                                                           
{'loss': 2.6091, 'learning_rate': 2.0722273696912231e-07, 'epoch': 14.09}

 88%|████████▊ | 327240/371472 [3:52:10<3:03:51,  4.01it/s]
 88%|████████▊ | 327241/371472 [3:52:11<3:22:01,  3.65it/s]
 88%|████████▊ | 327242/371472 [3:52:11<3:18:27,  3.71it/s]
 88%|████████▊ | 327243/371472 [3:52:11<3:28:12,  3.54it/s]
 88%|████████▊ | 327244/371472 [3:52:11<3:28:21,  3.54it/s]
 88%|████████▊ | 327245/371472 [3:52:12<3:24:45,  3.60it/s]
 88%|████████▊ | 327246/371472 [3:52:12<3:24:07,  3.61it/s]
 88%|████████▊ | 327247/371472 [3:52:12<3:15:51,  3.76it/s]
 88%|████████▊ | 327248/371472 [3:52:12<3:14:10,  3.80it/s]
 88%|████████▊ | 327249/371472 [3:52:13<3:13:52,  3.80it/s]
 88%|████████▊ | 327250/371472 [3:52:13<3:17:13,  3.74it/s]
 88%|████████▊ | 327251/371472 [3:52:13<3:18:51,  3.71it/s]
 88%|████████▊ | 327252/371472 [3:52:14<3:16:29,  3.75it/s]
 88%|████████▊ | 327253/371472 [3:52:14<3:14:25,  3.79it/s]
 88%|████████▊ | 327254/371472 [3:52:14<3:17:03,  3.74it/s]
 88%|████████▊ | 327255/371472 [3:52:15<3:58:48,  3.09it/s]
 88%|████████▊ | 327256/371472 [3:52:15<3:45:45,  3.26it/s]
 88%|████████▊ | 327257/371472 [3:52:15<3:41:20,  3.33it/s]
 88%|████████▊ | 327258/371472 [3:52:15<3:34:29,  3.44it/s]
 88%|████████▊ | 327259/371472 [3:52:16<3:30:22,  3.50it/s]
 88%|████████▊ | 327260/371472 [3:52:16<3:27:05,  3.56it/s]
                                                           
{'loss': 2.6952, 'learning_rate': 2.0717425499364347e-07, 'epoch': 14.1}

 88%|████████▊ | 327260/371472 [3:52:16<3:27:05,  3.56it/s]
 88%|████████▊ | 327261/371472 [3:52:16<3:27:18,  3.55it/s]
 88%|████████▊ | 327262/371472 [3:52:16<3:19:11,  3.70it/s]
 88%|████████▊ | 327263/371472 [3:52:17<3:25:29,  3.59it/s]
 88%|████████▊ | 327264/371472 [3:52:17<3:21:33,  3.66it/s]
 88%|████████▊ | 327265/371472 [3:52:17<3:18:31,  3.71it/s]
 88%|████████▊ | 327266/371472 [3:52:17<3:16:49,  3.74it/s]
 88%|████████▊ | 327267/371472 [3:52:18<3:14:22,  3.79it/s]
 88%|████████▊ | 327268/371472 [3:52:18<3:12:38,  3.82it/s]
 88%|████████▊ | 327269/371472 [3:52:18<3:24:47,  3.60it/s]
 88%|████████▊ | 327270/371472 [3:52:19<3:19:05,  3.70it/s]
 88%|████████▊ | 327271/371472 [3:52:19<3:18:02,  3.72it/s]
 88%|████████▊ | 327272/371472 [3:52:19<3:35:57,  3.41it/s]
 88%|████████▊ | 327273/371472 [3:52:19<3:33:55,  3.44it/s]
 88%|████████▊ | 327274/371472 [3:52:20<3:29:36,  3.51it/s]
 88%|████████▊ | 327275/371472 [3:52:20<3:36:01,  3.41it/s]
 88%|████████▊ | 327276/371472 [3:52:20<3:25:55,  3.58it/s]
 88%|████████▊ | 327277/371472 [3:52:21<3:15:20,  3.77it/s]
 88%|████████▊ | 327278/371472 [3:52:21<3:19:32,  3.69it/s]
 88%|████████▊ | 327279/371472 [3:52:21<3:34:52,  3.43it/s]
 88%|████████▊ | 327280/371472 [3:52:21<3:28:02,  3.54it/s]
                                                           
{'loss': 2.5807, 'learning_rate': 2.071257730181645e-07, 'epoch': 14.1}

 88%|████████▊ | 327280/371472 [3:52:21<3:28:02,  3.54it/s]
 88%|████████▊ | 327281/371472 [3:52:22<3:31:08,  3.49it/s]
 88%|████████▊ | 327282/371472 [3:52:22<3:36:01,  3.41it/s]
 88%|████████▊ | 327283/371472 [3:52:22<3:28:33,  3.53it/s]
 88%|████████▊ | 327284/371472 [3:52:23<3:23:03,  3.63it/s]
 88%|████████▊ | 327285/371472 [3:52:23<3:18:53,  3.70it/s]
 88%|████████▊ | 327286/371472 [3:52:23<3:20:00,  3.68it/s]
 88%|████████▊ | 327287/371472 [3:52:23<3:19:21,  3.69it/s]
 88%|████████▊ | 327288/371472 [3:52:24<3:24:39,  3.60it/s]
 88%|████████▊ | 327289/371472 [3:52:24<3:44:01,  3.29it/s]
 88%|████████▊ | 327290/371472 [3:52:24<3:34:52,  3.43it/s]
 88%|████████▊ | 327291/371472 [3:52:25<3:36:00,  3.41it/s]
 88%|████████▊ | 327292/371472 [3:52:25<3:34:44,  3.43it/s]
 88%|████████▊ | 327293/371472 [3:52:25<3:28:20,  3.53it/s]
 88%|████████▊ | 327294/371472 [3:52:25<3:31:30,  3.48it/s]
 88%|████████▊ | 327295/371472 [3:52:26<3:38:13,  3.37it/s]
 88%|████████▊ | 327296/371472 [3:52:26<3:35:18,  3.42it/s]
 88%|████████▊ | 327297/371472 [3:52:26<3:39:22,  3.36it/s]
 88%|████████▊ | 327298/371472 [3:52:27<3:35:14,  3.42it/s]
 88%|████████▊ | 327299/371472 [3:52:27<3:28:19,  3.53it/s]
 88%|████████▊ | 327300/371472 [3:52:27<3:20:20,  3.67it/s]
                                                           
{'loss': 2.6771, 'learning_rate': 2.070772910426857e-07, 'epoch': 14.1}

 88%|████████▊ | 327300/371472 [3:52:27<3:20:20,  3.67it/s]
 88%|████████▊ | 327301/371472 [3:52:27<3:17:00,  3.74it/s]
 88%|████████▊ | 327302/371472 [3:52:28<3:11:31,  3.84it/s]
 88%|████████▊ | 327303/371472 [3:52:28<3:11:05,  3.85it/s]
 88%|████████▊ | 327304/371472 [3:52:28<3:11:11,  3.85it/s]
 88%|████████▊ | 327305/371472 [3:52:28<3:27:02,  3.56it/s]
 88%|████████▊ | 327306/371472 [3:52:29<3:25:39,  3.58it/s]
 88%|████████▊ | 327307/371472 [3:52:29<3:35:08,  3.42it/s]
 88%|████████▊ | 327308/371472 [3:52:29<3:41:45,  3.32it/s]
 88%|████████▊ | 327309/371472 [3:52:30<3:34:01,  3.44it/s]
 88%|████████▊ | 327310/371472 [3:52:30<3:31:07,  3.49it/s]
 88%|████████▊ | 327311/371472 [3:52:30<3:21:54,  3.65it/s]
 88%|████████▊ | 327312/371472 [3:52:30<3:20:36,  3.67it/s]
 88%|████████▊ | 327313/371472 [3:52:31<3:18:44,  3.70it/s]
 88%|████████▊ | 327314/371472 [3:52:31<3:16:46,  3.74it/s]
 88%|████████▊ | 327315/371472 [3:52:31<3:13:55,  3.79it/s]
 88%|████████▊ | 327316/371472 [3:52:31<3:14:52,  3.78it/s]
 88%|████████▊ | 327317/371472 [3:52:32<3:13:19,  3.81it/s]
 88%|████████▊ | 327318/371472 [3:52:32<3:21:11,  3.66it/s]
 88%|████████▊ | 327319/371472 [3:52:32<3:20:14,  3.68it/s]
 88%|████████▊ | 327320/371472 [3:52:33<3:16:37,  3.74it/s]
                                                           
{'loss': 2.5527, 'learning_rate': 2.0702880906720676e-07, 'epoch': 14.1}

 88%|████████▊ | 327320/371472 [3:52:33<3:16:37,  3.74it/s]
 88%|████████▊ | 327321/371472 [3:52:33<3:16:05,  3.75it/s]
 88%|████████▊ | 327322/371472 [3:52:33<3:17:40,  3.72it/s]
 88%|████████▊ | 327323/371472 [3:52:33<3:22:38,  3.63it/s]
 88%|████████▊ | 327324/371472 [3:52:34<3:23:46,  3.61it/s]
 88%|████████▊ | 327325/371472 [3:52:34<3:18:48,  3.70it/s]
 88%|████████▊ | 327326/371472 [3:52:34<3:30:39,  3.49it/s]
 88%|████████▊ | 327327/371472 [3:52:35<3:25:18,  3.58it/s]
 88%|████████▊ | 327328/371472 [3:52:35<3:18:23,  3.71it/s]
 88%|████████▊ | 327329/371472 [3:52:35<3:15:04,  3.77it/s]
 88%|████████▊ | 327330/371472 [3:52:35<3:15:37,  3.76it/s]
 88%|████████▊ | 327331/371472 [3:52:36<3:21:43,  3.65it/s]
 88%|████████▊ | 327332/371472 [3:52:36<3:19:20,  3.69it/s]
 88%|████████▊ | 327333/371472 [3:52:36<3:20:01,  3.68it/s]
 88%|████████▊ | 327334/371472 [3:52:36<3:30:40,  3.49it/s]
 88%|████████▊ | 327335/371472 [3:52:37<3:37:16,  3.39it/s]
 88%|████████▊ | 327336/371472 [3:52:37<3:27:44,  3.54it/s]
 88%|████████▊ | 327337/371472 [3:52:37<3:22:40,  3.63it/s]
 88%|████████▊ | 327338/371472 [3:52:38<3:35:08,  3.42it/s]
 88%|████████▊ | 327339/371472 [3:52:38<3:48:32,  3.22it/s]
 88%|████████▊ | 327340/371472 [3:52:38<4:05:08,  3.00it/s]
                                                           
{'loss': 2.5488, 'learning_rate': 2.0698032709172788e-07, 'epoch': 14.1}

 88%|████████▊ | 327340/371472 [3:52:38<4:05:08,  3.00it/s]
 88%|████████▊ | 327341/371472 [3:52:39<3:48:24,  3.22it/s]
 88%|████████▊ | 327342/371472 [3:52:39<3:37:00,  3.39it/s]
 88%|████████▊ | 327343/371472 [3:52:39<3:37:58,  3.37it/s]
 88%|████████▊ | 327344/371472 [3:52:39<3:31:10,  3.48it/s]
 88%|████████▊ | 327345/371472 [3:52:40<3:31:46,  3.47it/s]
 88%|████████▊ | 327346/371472 [3:52:40<3:23:23,  3.62it/s]
 88%|████████▊ | 327347/371472 [3:52:40<3:21:34,  3.65it/s]
 88%|████████▊ | 327348/371472 [3:52:40<3:22:53,  3.62it/s]
 88%|████████▊ | 327349/371472 [3:52:41<3:26:08,  3.57it/s]
 88%|████████▊ | 327350/371472 [3:52:41<3:34:20,  3.43it/s]
 88%|████████▊ | 327351/371472 [3:52:41<3:52:43,  3.16it/s]
 88%|████████▊ | 327352/371472 [3:52:42<3:55:38,  3.12it/s]
 88%|████████▊ | 327353/371472 [3:52:42<3:42:52,  3.30it/s]
 88%|████████▊ | 327354/371472 [3:52:42<3:46:57,  3.24it/s]
 88%|████████▊ | 327355/371472 [3:52:43<3:44:01,  3.28it/s]
 88%|████████▊ | 327356/371472 [3:52:43<3:32:14,  3.46it/s]
 88%|████████▊ | 327357/371472 [3:52:43<3:26:37,  3.56it/s]
 88%|████████▊ | 327358/371472 [3:52:43<3:30:33,  3.49it/s]
 88%|████████▊ | 327359/371472 [3:52:44<3:38:15,  3.37it/s]
 88%|████████▊ | 327360/371472 [3:52:44<3:33:36,  3.44it/s]
                                                           
{'loss': 2.6285, 'learning_rate': 2.0693184511624896e-07, 'epoch': 14.1}

 88%|████████▊ | 327360/371472 [3:52:44<3:33:36,  3.44it/s]
 88%|████████▊ | 327361/371472 [3:52:44<3:37:50,  3.37it/s]
 88%|████████▊ | 327362/371472 [3:52:45<3:39:15,  3.35it/s]
 88%|████████▊ | 327363/371472 [3:52:45<3:37:43,  3.38it/s]
 88%|████████▊ | 327364/371472 [3:52:45<3:31:25,  3.48it/s]
 88%|████████▊ | 327365/371472 [3:52:46<3:27:07,  3.55it/s]
 88%|████████▊ | 327366/371472 [3:52:46<3:38:51,  3.36it/s]
 88%|████████▊ | 327367/371472 [3:52:46<3:34:08,  3.43it/s]
 88%|████████▊ | 327368/371472 [3:52:46<3:25:12,  3.58it/s]
 88%|████████▊ | 327369/371472 [3:52:47<3:32:39,  3.46it/s]
 88%|████████▊ | 327370/371472 [3:52:47<3:36:39,  3.39it/s]
 88%|████████▊ | 327371/371472 [3:52:47<3:29:59,  3.50it/s]
 88%|████████▊ | 327372/371472 [3:52:48<3:24:53,  3.59it/s]
 88%|████████▊ | 327373/371472 [3:52:48<3:53:00,  3.15it/s]
 88%|████████▊ | 327374/371472 [3:52:48<3:41:28,  3.32it/s]
 88%|████████▊ | 327375/371472 [3:52:49<3:38:35,  3.36it/s]
 88%|████████▊ | 327376/371472 [3:52:49<3:32:16,  3.46it/s]
 88%|████████▊ | 327377/371472 [3:52:49<3:27:00,  3.55it/s]
 88%|████████▊ | 327378/371472 [3:52:49<3:23:28,  3.61it/s]
 88%|████████▊ | 327379/371472 [3:52:50<3:31:18,  3.48it/s]
 88%|████████▊ | 327380/371472 [3:52:50<3:27:04,  3.55it/s]
                                                           
{'loss': 2.504, 'learning_rate': 2.0688336314077013e-07, 'epoch': 14.1}

 88%|████████▊ | 327380/371472 [3:52:50<3:27:04,  3.55it/s]
 88%|████████▊ | 327381/371472 [3:52:50<3:33:49,  3.44it/s]
 88%|████████▊ | 327382/371472 [3:52:50<3:24:48,  3.59it/s]
 88%|████████▊ | 327383/371472 [3:52:51<3:35:53,  3.40it/s]
 88%|████████▊ | 327384/371472 [3:52:51<3:29:57,  3.50it/s]
 88%|████████▊ | 327385/371472 [3:52:51<3:36:47,  3.39it/s]
 88%|████████▊ | 327386/371472 [3:52:52<3:25:01,  3.58it/s]
 88%|████████▊ | 327387/371472 [3:52:52<3:39:35,  3.35it/s]
 88%|████████▊ | 327388/371472 [3:52:52<3:44:34,  3.27it/s]
 88%|████████▊ | 327389/371472 [3:52:53<3:37:02,  3.39it/s]
 88%|████████▊ | 327390/371472 [3:52:53<3:25:41,  3.57it/s]
 88%|████████▊ | 327391/371472 [3:52:53<3:42:08,  3.31it/s]
 88%|████████▊ | 327392/371472 [3:52:53<3:30:39,  3.49it/s]
 88%|████████▊ | 327393/371472 [3:52:54<3:33:06,  3.45it/s]
 88%|████████▊ | 327394/371472 [3:52:54<3:33:31,  3.44it/s]
 88%|████████▊ | 327395/371472 [3:52:54<3:31:58,  3.47it/s]
 88%|████████▊ | 327396/371472 [3:52:55<3:49:20,  3.20it/s]
 88%|████████▊ | 327397/371472 [3:52:55<4:09:50,  2.94it/s]
 88%|████████▊ | 327398/371472 [3:52:55<3:52:07,  3.16it/s]
 88%|████████▊ | 327399/371472 [3:52:56<3:41:05,  3.32it/s]
 88%|████████▊ | 327400/371472 [3:52:56<3:40:40,  3.33it/s]
                                                           
{'loss': 2.5926, 'learning_rate': 2.0683488116529118e-07, 'epoch': 14.1}

 88%|████████▊ | 327400/371472 [3:52:56<3:40:40,  3.33it/s]
 88%|████████▊ | 327401/371472 [3:52:56<3:42:39,  3.30it/s]
 88%|████████▊ | 327402/371472 [3:52:56<3:40:48,  3.33it/s]
 88%|████████▊ | 327403/371472 [3:52:57<3:49:17,  3.20it/s]
 88%|████████▊ | 327404/371472 [3:52:57<3:48:27,  3.21it/s]
 88%|████████▊ | 327405/371472 [3:52:57<3:52:23,  3.16it/s]
 88%|████████▊ | 327406/371472 [3:52:58<3:43:01,  3.29it/s]
 88%|████████▊ | 327407/371472 [3:52:58<3:35:29,  3.41it/s]
 88%|████████▊ | 327408/371472 [3:52:58<3:33:10,  3.44it/s]
 88%|████████▊ | 327409/371472 [3:52:59<3:43:31,  3.29it/s]
 88%|████████▊ | 327410/371472 [3:52:59<3:57:01,  3.10it/s]
 88%|████████▊ | 327411/371472 [3:52:59<3:37:55,  3.37it/s]
 88%|████████▊ | 327412/371472 [3:52:59<3:28:00,  3.53it/s]
 88%|████████▊ | 327413/371472 [3:53:00<3:27:15,  3.54it/s]
 88%|████████▊ | 327414/371472 [3:53:00<3:33:55,  3.43it/s]
 88%|████████▊ | 327415/371472 [3:53:00<3:53:43,  3.14it/s]
 88%|████████▊ | 327416/371472 [3:53:01<3:45:37,  3.25it/s]
 88%|████████▊ | 327417/371472 [3:53:01<3:38:43,  3.36it/s]
 88%|████████▊ | 327418/371472 [3:53:01<3:27:37,  3.54it/s]
 88%|████████▊ | 327419/371472 [3:53:02<3:40:45,  3.33it/s]
 88%|████████▊ | 327420/371472 [3:53:02<3:36:07,  3.40it/s]
                                                           
{'loss': 2.4549, 'learning_rate': 2.0678639918981233e-07, 'epoch': 14.1}

 88%|████████▊ | 327420/371472 [3:53:02<3:36:07,  3.40it/s]
 88%|████████▊ | 327421/371472 [3:53:02<3:29:06,  3.51it/s]
 88%|████████▊ | 327422/371472 [3:53:02<3:26:52,  3.55it/s]
 88%|████████▊ | 327423/371472 [3:53:03<3:26:09,  3.56it/s]
 88%|████████▊ | 327424/371472 [3:53:03<3:20:53,  3.65it/s]
 88%|████████▊ | 327425/371472 [3:53:03<3:30:30,  3.49it/s]
 88%|████████▊ | 327426/371472 [3:53:04<3:24:10,  3.60it/s]
 88%|████████▊ | 327427/371472 [3:53:04<3:26:31,  3.55it/s]
 88%|████████▊ | 327428/371472 [3:53:04<3:21:39,  3.64it/s]
 88%|████████▊ | 327429/371472 [3:53:04<3:17:50,  3.71it/s]
 88%|████████▊ | 327430/371472 [3:53:05<3:22:27,  3.63it/s]
 88%|████████▊ | 327431/371472 [3:53:05<3:20:55,  3.65it/s]
 88%|████████▊ | 327432/371472 [3:53:05<3:17:07,  3.72it/s]
 88%|████████▊ | 327433/371472 [3:53:05<3:18:48,  3.69it/s]
 88%|████████▊ | 327434/371472 [3:53:06<3:22:13,  3.63it/s]
 88%|████████▊ | 327435/371472 [3:53:06<3:46:45,  3.24it/s]
 88%|████████▊ | 327436/371472 [3:53:06<3:43:43,  3.28it/s]
 88%|████████▊ | 327437/371472 [3:53:07<3:36:50,  3.38it/s]
 88%|████████▊ | 327438/371472 [3:53:07<3:32:34,  3.45it/s]
 88%|████████▊ | 327439/371472 [3:53:07<3:34:33,  3.42it/s]
 88%|████████▊ | 327440/371472 [3:53:08<3:35:45,  3.40it/s]
                                                           
{'loss': 2.5193, 'learning_rate': 2.067379172143334e-07, 'epoch': 14.1}

 88%|████████▊ | 327440/371472 [3:53:08<3:35:45,  3.40it/s]
 88%|████████▊ | 327441/371472 [3:53:08<3:46:10,  3.24it/s]
 88%|████████▊ | 327442/371472 [3:53:08<3:35:56,  3.40it/s]
 88%|████████▊ | 327443/371472 [3:53:08<3:43:42,  3.28it/s]
 88%|████████▊ | 327444/371472 [3:53:09<3:30:58,  3.48it/s]
 88%|████████▊ | 327445/371472 [3:53:09<3:24:17,  3.59it/s]
 88%|████████▊ | 327446/371472 [3:53:09<3:19:10,  3.68it/s]
 88%|████████▊ | 327447/371472 [3:53:10<3:32:37,  3.45it/s]
 88%|████████▊ | 327448/371472 [3:53:10<3:21:59,  3.63it/s]
 88%|████████▊ | 327449/371472 [3:53:10<3:24:19,  3.59it/s]
 88%|████████▊ | 327450/371472 [3:53:10<3:19:38,  3.68it/s]
 88%|████████▊ | 327451/371472 [3:53:11<3:30:04,  3.49it/s]
 88%|████████▊ | 327452/371472 [3:53:11<3:35:42,  3.40it/s]
 88%|████████▊ | 327453/371472 [3:53:11<3:29:35,  3.50it/s]
 88%|████████▊ | 327454/371472 [3:53:12<3:28:20,  3.52it/s]
 88%|████████▊ | 327455/371472 [3:53:12<3:28:44,  3.51it/s]
 88%|████████▊ | 327456/371472 [3:53:12<3:30:14,  3.49it/s]
 88%|████████▊ | 327457/371472 [3:53:12<3:20:21,  3.66it/s]
 88%|████████▊ | 327458/371472 [3:53:13<3:17:17,  3.72it/s]
 88%|████████▊ | 327459/371472 [3:53:13<3:21:58,  3.63it/s]
 88%|████████▊ | 327460/371472 [3:53:13<3:23:35,  3.60it/s]
                                                           
{'loss': 2.7701, 'learning_rate': 2.0668943523885455e-07, 'epoch': 14.1}

 88%|████████▊ | 327460/371472 [3:53:13<3:23:35,  3.60it/s]
 88%|████████▊ | 327461/371472 [3:53:13<3:19:27,  3.68it/s]
 88%|████████▊ | 327462/371472 [3:53:14<3:21:52,  3.63it/s]
 88%|████████▊ | 327463/371472 [3:53:14<3:13:36,  3.79it/s]
 88%|████████▊ | 327464/371472 [3:53:14<3:23:50,  3.60it/s]
 88%|████████▊ | 327465/371472 [3:53:15<3:21:20,  3.64it/s]
 88%|████████▊ | 327466/371472 [3:53:15<3:17:36,  3.71it/s]
 88%|████████▊ | 327467/371472 [3:53:15<3:19:43,  3.67it/s]
 88%|████████▊ | 327468/371472 [3:53:15<3:28:28,  3.52it/s]
 88%|████████▊ | 327469/371472 [3:53:16<3:23:04,  3.61it/s]
 88%|████████▊ | 327470/371472 [3:53:16<3:22:53,  3.61it/s]
 88%|████████▊ | 327471/371472 [3:53:16<3:29:58,  3.49it/s]
 88%|████████▊ | 327472/371472 [3:53:17<3:33:59,  3.43it/s]
 88%|████████▊ | 327473/371472 [3:53:17<3:43:11,  3.29it/s]
 88%|████████▊ | 327474/371472 [3:53:17<3:30:16,  3.49it/s]
 88%|████████▊ | 327475/371472 [3:53:17<3:28:06,  3.52it/s]
 88%|████████▊ | 327476/371472 [3:53:18<3:32:13,  3.46it/s]
 88%|████████▊ | 327477/371472 [3:53:18<3:37:50,  3.37it/s]
 88%|████████▊ | 327478/371472 [3:53:18<3:31:40,  3.46it/s]
 88%|████████▊ | 327479/371472 [3:53:19<3:23:07,  3.61it/s]
 88%|████████▊ | 327480/371472 [3:53:19<3:24:49,  3.58it/s]
                                                           
{'loss': 2.5079, 'learning_rate': 2.066409532633756e-07, 'epoch': 14.11}

 88%|████████▊ | 327480/371472 [3:53:19<3:24:49,  3.58it/s]
 88%|████████▊ | 327481/371472 [3:53:19<3:17:30,  3.71it/s]
 88%|████████▊ | 327482/371472 [3:53:19<3:12:47,  3.80it/s]
 88%|████████▊ | 327483/371472 [3:53:20<3:18:42,  3.69it/s]
 88%|████████▊ | 327484/371472 [3:53:20<3:14:20,  3.77it/s]
 88%|████████▊ | 327485/371472 [3:53:20<3:19:07,  3.68it/s]
 88%|████████▊ | 327486/371472 [3:53:20<3:21:37,  3.64it/s]
 88%|████████▊ | 327487/371472 [3:53:21<3:15:29,  3.75it/s]
 88%|████████▊ | 327488/371472 [3:53:21<3:31:48,  3.46it/s]
 88%|████████▊ | 327489/371472 [3:53:21<3:25:51,  3.56it/s]
 88%|████████▊ | 327490/371472 [3:53:22<3:26:24,  3.55it/s]
 88%|████████▊ | 327491/371472 [3:53:22<3:18:22,  3.70it/s]
 88%|████████▊ | 327492/371472 [3:53:22<3:23:51,  3.60it/s]
 88%|████████▊ | 327493/371472 [3:53:22<3:27:08,  3.54it/s]
 88%|████████▊ | 327494/371472 [3:53:23<3:30:28,  3.48it/s]
 88%|████████▊ | 327495/371472 [3:53:23<3:22:08,  3.63it/s]
 88%|████████▊ | 327496/371472 [3:53:23<3:22:01,  3.63it/s]
 88%|████████▊ | 327497/371472 [3:53:23<3:30:09,  3.49it/s]
 88%|████████▊ | 327498/371472 [3:53:24<3:29:25,  3.50it/s]
 88%|████████▊ | 327499/371472 [3:53:24<3:25:53,  3.56it/s]
 88%|████████▊ | 327500/371472 [3:53:24<3:30:04,  3.49it/s]
                                                           
{'loss': 2.4918, 'learning_rate': 2.0659247128789677e-07, 'epoch': 14.11}

 88%|████████▊ | 327500/371472 [3:53:24<3:30:04,  3.49it/s]
 88%|████████▊ | 327501/371472 [3:53:25<3:37:18,  3.37it/s]
 88%|████████▊ | 327502/371472 [3:53:25<3:27:23,  3.53it/s]
 88%|████████▊ | 327503/371472 [3:53:25<3:28:56,  3.51it/s]
 88%|████████▊ | 327504/371472 [3:53:26<3:37:54,  3.36it/s]
 88%|████████▊ | 327505/371472 [3:53:26<3:24:37,  3.58it/s]
 88%|████████▊ | 327506/371472 [3:53:26<3:35:27,  3.40it/s]
 88%|████████▊ | 327507/371472 [3:53:26<3:48:57,  3.20it/s]
 88%|████████▊ | 327508/371472 [3:53:27<3:34:33,  3.42it/s]
 88%|████████▊ | 327509/371472 [3:53:27<3:26:43,  3.54it/s]
 88%|████████▊ | 327510/371472 [3:53:27<3:27:37,  3.53it/s]
 88%|████████▊ | 327511/371472 [3:53:28<3:23:56,  3.59it/s]
 88%|████████▊ | 327512/371472 [3:53:28<3:28:17,  3.52it/s]
 88%|████████▊ | 327513/371472 [3:53:28<3:27:37,  3.53it/s]
 88%|████████▊ | 327514/371472 [3:53:28<3:35:05,  3.41it/s]
 88%|████████▊ | 327515/371472 [3:53:29<3:29:06,  3.50it/s]
 88%|████████▊ | 327516/371472 [3:53:29<3:28:31,  3.51it/s]
 88%|████████▊ | 327517/371472 [3:53:29<3:26:56,  3.54it/s]
 88%|████████▊ | 327518/371472 [3:53:29<3:22:24,  3.62it/s]
 88%|████████▊ | 327519/371472 [3:53:30<3:25:22,  3.57it/s]
 88%|████████▊ | 327520/371472 [3:53:30<3:15:12,  3.75it/s]
                                                           
{'loss': 2.5357, 'learning_rate': 2.0654398931241782e-07, 'epoch': 14.11}

 88%|████████▊ | 327520/371472 [3:53:30<3:15:12,  3.75it/s]
 88%|████████▊ | 327521/371472 [3:53:30<3:12:18,  3.81it/s]
 88%|████████▊ | 327522/371472 [3:53:31<3:26:49,  3.54it/s]
 88%|████████▊ | 327523/371472 [3:53:31<3:22:13,  3.62it/s]
 88%|████████▊ | 327524/371472 [3:53:31<3:24:26,  3.58it/s]
 88%|████████▊ | 327525/371472 [3:53:31<3:15:09,  3.75it/s]
 88%|████████▊ | 327526/371472 [3:53:32<3:12:58,  3.80it/s]
 88%|████████▊ | 327527/371472 [3:53:32<3:34:52,  3.41it/s]
 88%|████████▊ | 327528/371472 [3:53:32<3:27:21,  3.53it/s]
 88%|████████▊ | 327529/371472 [3:53:33<3:21:04,  3.64it/s]
 88%|████████▊ | 327530/371472 [3:53:33<3:21:21,  3.64it/s]
 88%|████████▊ | 327531/371472 [3:53:33<3:21:11,  3.64it/s]
 88%|████████▊ | 327532/371472 [3:53:33<3:22:35,  3.61it/s]
 88%|████████▊ | 327533/371472 [3:53:34<3:23:39,  3.60it/s]
 88%|████████▊ | 327534/371472 [3:53:34<3:14:34,  3.76it/s]
 88%|████████▊ | 327535/371472 [3:53:34<3:16:55,  3.72it/s]
 88%|████████▊ | 327536/371472 [3:53:34<3:18:40,  3.69it/s]
 88%|████████▊ | 327537/371472 [3:53:35<3:20:30,  3.65it/s]
 88%|████████▊ | 327538/371472 [3:53:35<3:16:11,  3.73it/s]
 88%|████████▊ | 327539/371472 [3:53:35<3:10:08,  3.85it/s]
 88%|████████▊ | 327540/371472 [3:53:35<3:08:13,  3.89it/s]
                                                           
{'loss': 2.6307, 'learning_rate': 2.0649550733693897e-07, 'epoch': 14.11}

 88%|████████▊ | 327540/371472 [3:53:35<3:08:13,  3.89it/s]
 88%|████████▊ | 327541/371472 [3:53:36<3:28:09,  3.52it/s]
 88%|████████▊ | 327542/371472 [3:53:36<3:25:45,  3.56it/s]
 88%|████████▊ | 327543/371472 [3:53:36<3:15:59,  3.74it/s]
 88%|████████▊ | 327544/371472 [3:53:37<3:13:39,  3.78it/s]
 88%|████████▊ | 327545/371472 [3:53:37<3:14:21,  3.77it/s]
 88%|████████▊ | 327546/371472 [3:53:37<3:16:24,  3.73it/s]
 88%|████████▊ | 327547/371472 [3:53:37<3:22:06,  3.62it/s]
 88%|████████▊ | 327548/371472 [3:53:38<3:17:17,  3.71it/s]
 88%|████████▊ | 327549/371472 [3:53:38<3:21:30,  3.63it/s]
 88%|████████▊ | 327550/371472 [3:53:38<3:32:39,  3.44it/s]
 88%|████████▊ | 327551/371472 [3:53:39<3:36:14,  3.39it/s]
 88%|████████▊ | 327552/371472 [3:53:39<3:27:57,  3.52it/s]
 88%|████████▊ | 327553/371472 [3:53:39<3:42:21,  3.29it/s]
 88%|████████▊ | 327554/371472 [3:53:39<3:32:51,  3.44it/s]
 88%|████████▊ | 327555/371472 [3:53:40<3:26:57,  3.54it/s]
 88%|████████▊ | 327556/371472 [3:53:40<3:23:45,  3.59it/s]
 88%|████████▊ | 327557/371472 [3:53:40<3:28:14,  3.51it/s]
 88%|████████▊ | 327558/371472 [3:53:41<3:30:16,  3.48it/s]
 88%|████████▊ | 327559/371472 [3:53:41<3:37:40,  3.36it/s]
 88%|████████▊ | 327560/371472 [3:53:41<3:28:45,  3.51it/s]
                                                           
{'loss': 2.4225, 'learning_rate': 2.0644702536146004e-07, 'epoch': 14.11}

 88%|████████▊ | 327560/371472 [3:53:41<3:28:45,  3.51it/s]
 88%|████████▊ | 327561/371472 [3:53:41<3:36:55,  3.37it/s]
 88%|████████▊ | 327562/371472 [3:53:42<3:28:20,  3.51it/s]
 88%|████████▊ | 327563/371472 [3:53:42<3:31:01,  3.47it/s]
 88%|████████▊ | 327564/371472 [3:53:42<3:28:44,  3.51it/s]
 88%|████████▊ | 327565/371472 [3:53:43<3:42:55,  3.28it/s]
 88%|████████▊ | 327566/371472 [3:53:43<3:33:35,  3.43it/s]
 88%|████████▊ | 327567/371472 [3:53:43<3:30:23,  3.48it/s]
 88%|████████▊ | 327568/371472 [3:53:44<3:37:51,  3.36it/s]
 88%|████████▊ | 327569/371472 [3:53:44<3:26:02,  3.55it/s]
 88%|████████▊ | 327570/371472 [3:53:44<3:20:30,  3.65it/s]
 88%|████████▊ | 327571/371472 [3:53:44<3:19:42,  3.66it/s]
 88%|████████▊ | 327572/371472 [3:53:45<3:19:28,  3.67it/s]
 88%|████████▊ | 327573/371472 [3:53:45<3:13:46,  3.78it/s]
 88%|████████▊ | 327574/371472 [3:53:45<3:14:15,  3.77it/s]
 88%|████████▊ | 327575/371472 [3:53:45<3:14:23,  3.76it/s]
 88%|████████▊ | 327576/371472 [3:53:46<3:08:34,  3.88it/s]
 88%|████████▊ | 327577/371472 [3:53:46<3:09:19,  3.86it/s]
 88%|████████▊ | 327578/371472 [3:53:46<3:29:46,  3.49it/s]
 88%|████████▊ | 327579/371472 [3:53:46<3:19:42,  3.66it/s]
 88%|████████▊ | 327580/371472 [3:53:47<3:15:19,  3.75it/s]
                                                           
{'loss': 2.6836, 'learning_rate': 2.063985433859812e-07, 'epoch': 14.11}

 88%|████████▊ | 327580/371472 [3:53:47<3:15:19,  3.75it/s]
 88%|████████▊ | 327581/371472 [3:53:47<3:25:16,  3.56it/s]
 88%|████████▊ | 327582/371472 [3:53:47<3:16:50,  3.72it/s]
 88%|████████▊ | 327583/371472 [3:53:48<3:18:34,  3.68it/s]
 88%|████████▊ | 327584/371472 [3:53:48<3:18:57,  3.68it/s]
 88%|████████▊ | 327585/371472 [3:53:48<3:17:29,  3.70it/s]
 88%|████████▊ | 327586/371472 [3:53:48<3:18:25,  3.69it/s]
 88%|████████▊ | 327587/371472 [3:53:49<3:19:39,  3.66it/s]
 88%|████████▊ | 327588/371472 [3:53:49<3:21:35,  3.63it/s]
 88%|████████▊ | 327589/371472 [3:53:49<3:18:01,  3.69it/s]
 88%|████████▊ | 327590/371472 [3:53:49<3:35:24,  3.40it/s]
 88%|████████▊ | 327591/371472 [3:53:50<3:33:37,  3.42it/s]
 88%|████████▊ | 327592/371472 [3:53:50<3:25:02,  3.57it/s]
 88%|████████▊ | 327593/371472 [3:53:50<3:14:45,  3.76it/s]
 88%|████████▊ | 327594/371472 [3:53:51<3:08:25,  3.88it/s]
 88%|████████▊ | 327595/371472 [3:53:51<3:08:29,  3.88it/s]
 88%|████████▊ | 327596/371472 [3:53:51<3:14:40,  3.76it/s]
 88%|████████▊ | 327597/371472 [3:53:51<3:12:44,  3.79it/s]
 88%|████████▊ | 327598/371472 [3:53:52<3:17:18,  3.71it/s]
 88%|████████▊ | 327599/371472 [3:53:52<3:20:20,  3.65it/s]
 88%|████████▊ | 327600/371472 [3:53:52<3:17:11,  3.71it/s]
                                                           
{'loss': 2.4589, 'learning_rate': 2.0635006141050224e-07, 'epoch': 14.11}

 88%|████████▊ | 327600/371472 [3:53:52<3:17:11,  3.71it/s]
 88%|████████▊ | 327601/371472 [3:53:52<3:18:07,  3.69it/s]
 88%|████████▊ | 327602/371472 [3:53:53<3:13:27,  3.78it/s]
 88%|████████▊ | 327603/371472 [3:53:53<3:43:58,  3.26it/s]
 88%|████████▊ | 327604/371472 [3:53:53<3:44:21,  3.26it/s]
 88%|████████▊ | 327605/371472 [3:53:54<3:29:17,  3.49it/s]
 88%|████████▊ | 327606/371472 [3:53:54<3:26:23,  3.54it/s]
 88%|████████▊ | 327607/371472 [3:53:54<3:26:32,  3.54it/s]
 88%|████████▊ | 327608/371472 [3:53:54<3:31:23,  3.46it/s]
 88%|████████▊ | 327609/371472 [3:53:55<3:27:38,  3.52it/s]
 88%|████████▊ | 327610/371472 [3:53:55<3:23:52,  3.59it/s]
 88%|████████▊ | 327611/371472 [3:53:55<3:17:59,  3.69it/s]
 88%|████████▊ | 327612/371472 [3:53:56<3:25:25,  3.56it/s]
 88%|████████▊ | 327613/371472 [3:53:56<3:22:33,  3.61it/s]
 88%|████████▊ | 327614/371472 [3:53:56<3:19:04,  3.67it/s]
 88%|████████▊ | 327615/371472 [3:53:56<3:17:07,  3.71it/s]
 88%|████████▊ | 327616/371472 [3:53:57<3:11:53,  3.81it/s]
 88%|████████▊ | 327617/371472 [3:53:57<3:19:33,  3.66it/s]
 88%|████████▊ | 327618/371472 [3:53:57<3:28:19,  3.51it/s]
 88%|████████▊ | 327619/371472 [3:53:57<3:25:49,  3.55it/s]
 88%|████████▊ | 327620/371472 [3:53:58<3:21:18,  3.63it/s]
                                                           
{'loss': 2.6186, 'learning_rate': 2.0630157943502341e-07, 'epoch': 14.11}

 88%|████████▊ | 327620/371472 [3:53:58<3:21:18,  3.63it/s]
 88%|████████▊ | 327621/371472 [3:53:58<3:16:12,  3.72it/s]
 88%|████████▊ | 327622/371472 [3:53:58<3:27:05,  3.53it/s]
 88%|████████▊ | 327623/371472 [3:53:59<3:24:11,  3.58it/s]
 88%|████████▊ | 327624/371472 [3:53:59<3:21:14,  3.63it/s]
 88%|████████▊ | 327625/371472 [3:53:59<3:25:26,  3.56it/s]
 88%|████████▊ | 327626/371472 [3:53:59<3:31:11,  3.46it/s]
 88%|████████▊ | 327627/371472 [3:54:00<3:30:59,  3.46it/s]
 88%|████████▊ | 327628/371472 [3:54:00<3:28:39,  3.50it/s]
 88%|████████▊ | 327629/371472 [3:54:00<3:46:05,  3.23it/s]
 88%|████████▊ | 327630/371472 [3:54:01<3:35:17,  3.39it/s]
 88%|████████▊ | 327631/371472 [3:54:01<3:33:11,  3.43it/s]
 88%|████████▊ | 327632/371472 [3:54:01<3:28:13,  3.51it/s]
 88%|████████▊ | 327633/371472 [3:54:02<3:43:46,  3.27it/s]
 88%|████████▊ | 327634/371472 [3:54:02<3:47:17,  3.21it/s]
 88%|████████▊ | 327635/371472 [3:54:02<3:45:07,  3.25it/s]
 88%|████████▊ | 327636/371472 [3:54:02<3:35:02,  3.40it/s]
 88%|████████▊ | 327637/371472 [3:54:03<3:36:01,  3.38it/s]
 88%|████████▊ | 327638/371472 [3:54:03<3:31:22,  3.46it/s]
 88%|████████▊ | 327639/371472 [3:54:03<3:38:57,  3.34it/s]
 88%|████████▊ | 327640/371472 [3:54:04<3:27:53,  3.51it/s]
                                                           
{'loss': 2.5458, 'learning_rate': 2.0625309745954449e-07, 'epoch': 14.11}

 88%|████████▊ | 327640/371472 [3:54:04<3:27:53,  3.51it/s]
 88%|████████▊ | 327641/371472 [3:54:04<3:19:06,  3.67it/s]
 88%|████████▊ | 327642/371472 [3:54:04<3:21:15,  3.63it/s]
 88%|████████▊ | 327643/371472 [3:54:04<3:17:47,  3.69it/s]
 88%|████████▊ | 327644/371472 [3:54:05<3:14:35,  3.75it/s]
 88%|████████▊ | 327645/371472 [3:54:05<3:16:11,  3.72it/s]
 88%|████████▊ | 327646/371472 [3:54:05<3:15:11,  3.74it/s]
 88%|████████▊ | 327647/371472 [3:54:05<3:21:48,  3.62it/s]
 88%|████████▊ | 327648/371472 [3:54:06<3:25:57,  3.55it/s]
 88%|████████▊ | 327649/371472 [3:54:06<3:26:18,  3.54it/s]
 88%|████████▊ | 327650/371472 [3:54:06<3:20:55,  3.64it/s]
 88%|████████▊ | 327651/371472 [3:54:07<3:29:28,  3.49it/s]
 88%|████████▊ | 327652/371472 [3:54:07<3:24:53,  3.56it/s]
 88%|████████▊ | 327653/371472 [3:54:07<3:21:07,  3.63it/s]
 88%|████████▊ | 327654/371472 [3:54:07<3:20:41,  3.64it/s]
 88%|████████▊ | 327655/371472 [3:54:08<3:22:55,  3.60it/s]
 88%|████████▊ | 327656/371472 [3:54:08<3:29:15,  3.49it/s]
 88%|████████▊ | 327657/371472 [3:54:08<3:35:02,  3.40it/s]
 88%|████████▊ | 327658/371472 [3:54:09<3:44:01,  3.26it/s]
 88%|████████▊ | 327659/371472 [3:54:09<3:42:01,  3.29it/s]
 88%|████████▊ | 327660/371472 [3:54:09<3:43:32,  3.27it/s]
                                                           
{'loss': 2.5726, 'learning_rate': 2.062046154840656e-07, 'epoch': 14.11}

 88%|████████▊ | 327660/371472 [3:54:09<3:43:32,  3.27it/s]
 88%|████████▊ | 327661/371472 [3:54:10<3:32:15,  3.44it/s]
 88%|████████▊ | 327662/371472 [3:54:10<3:29:47,  3.48it/s]
 88%|████████▊ | 327663/371472 [3:54:10<3:30:39,  3.47it/s]
 88%|████████▊ | 327664/371472 [3:54:10<3:35:16,  3.39it/s]
 88%|████████▊ | 327665/371472 [3:54:11<3:39:36,  3.32it/s]
 88%|████████▊ | 327666/371472 [3:54:11<3:51:55,  3.15it/s]
 88%|████████▊ | 327667/371472 [3:54:11<3:52:09,  3.14it/s]
 88%|████████▊ | 327668/371472 [3:54:12<3:46:32,  3.22it/s]
 88%|████████▊ | 327669/371472 [3:54:12<3:33:58,  3.41it/s]
 88%|████████▊ | 327670/371472 [3:54:12<3:38:20,  3.34it/s]
 88%|████████▊ | 327671/371472 [3:54:13<3:40:44,  3.31it/s]
 88%|████████▊ | 327672/371472 [3:54:13<3:46:50,  3.22it/s]
 88%|████████▊ | 327673/371472 [3:54:13<3:36:28,  3.37it/s]
 88%|████████▊ | 327674/371472 [3:54:13<3:26:49,  3.53it/s]
 88%|████████▊ | 327675/371472 [3:54:14<3:33:02,  3.43it/s]
 88%|████████▊ | 327676/371472 [3:54:14<3:47:52,  3.20it/s]
 88%|████████▊ | 327677/371472 [3:54:14<3:33:56,  3.41it/s]
 88%|████████▊ | 327678/371472 [3:54:15<3:28:41,  3.50it/s]
 88%|████████▊ | 327679/371472 [3:54:15<3:20:01,  3.65it/s]
 88%|████████▊ | 327680/371472 [3:54:15<3:20:14,  3.65it/s]
                                                           
{'loss': 2.449, 'learning_rate': 2.0615613350858668e-07, 'epoch': 14.11}

 88%|████████▊ | 327680/371472 [3:54:15<3:20:14,  3.65it/s]
 88%|████████▊ | 327681/371472 [3:54:15<3:18:14,  3.68it/s]
 88%|████████▊ | 327682/371472 [3:54:16<3:10:46,  3.83it/s]
 88%|████████▊ | 327683/371472 [3:54:16<3:16:23,  3.72it/s]
 88%|████████▊ | 327684/371472 [3:54:16<3:17:58,  3.69it/s]
 88%|████████▊ | 327685/371472 [3:54:16<3:18:17,  3.68it/s]
 88%|████████▊ | 327686/371472 [3:54:17<3:23:35,  3.58it/s]
 88%|████████▊ | 327687/371472 [3:54:17<3:18:51,  3.67it/s]
 88%|████████▊ | 327688/371472 [3:54:17<3:12:11,  3.80it/s]
 88%|████████▊ | 327689/371472 [3:54:18<3:09:42,  3.85it/s]
 88%|████████▊ | 327690/371472 [3:54:18<3:10:51,  3.82it/s]
 88%|████████▊ | 327691/371472 [3:54:18<3:14:07,  3.76it/s]
 88%|████████▊ | 327692/371472 [3:54:18<3:15:08,  3.74it/s]
 88%|████████▊ | 327693/371472 [3:54:19<3:13:03,  3.78it/s]
 88%|████████▊ | 327694/371472 [3:54:19<3:17:00,  3.70it/s]
 88%|████████▊ | 327695/371472 [3:54:19<3:11:30,  3.81it/s]
 88%|████████▊ | 327696/371472 [3:54:19<3:16:16,  3.72it/s]
 88%|████████▊ | 327697/371472 [3:54:20<3:41:25,  3.29it/s]
 88%|████████▊ | 327698/371472 [3:54:20<3:37:18,  3.36it/s]
 88%|████████▊ | 327699/371472 [3:54:20<3:33:10,  3.42it/s]
 88%|████████▊ | 327700/371472 [3:54:21<3:39:43,  3.32it/s]
                                                           
{'loss': 2.6367, 'learning_rate': 2.0610765153310786e-07, 'epoch': 14.11}

 88%|████████▊ | 327700/371472 [3:54:21<3:39:43,  3.32it/s]
 88%|████████▊ | 327701/371472 [3:54:21<3:32:25,  3.43it/s]
 88%|████████▊ | 327702/371472 [3:54:21<3:31:21,  3.45it/s]
 88%|████████▊ | 327703/371472 [3:54:22<3:32:20,  3.44it/s]
 88%|████████▊ | 327704/371472 [3:54:22<3:29:14,  3.49it/s]
 88%|████████▊ | 327705/371472 [3:54:22<3:31:30,  3.45it/s]
 88%|████████▊ | 327706/371472 [3:54:22<3:39:19,  3.33it/s]
 88%|████████▊ | 327707/371472 [3:54:23<3:37:20,  3.36it/s]
 88%|████████▊ | 327708/371472 [3:54:23<3:30:33,  3.46it/s]
 88%|████████▊ | 327709/371472 [3:54:23<3:29:46,  3.48it/s]
 88%|████████▊ | 327710/371472 [3:54:24<3:32:44,  3.43it/s]
 88%|████████▊ | 327711/371472 [3:54:24<3:37:33,  3.35it/s]
 88%|████████▊ | 327712/371472 [3:54:24<3:32:46,  3.43it/s]
 88%|████████▊ | 327713/371472 [3:54:24<3:24:41,  3.56it/s]
 88%|████████▊ | 327714/371472 [3:54:25<3:27:28,  3.52it/s]
 88%|████████▊ | 327715/371472 [3:54:25<3:19:15,  3.66it/s]
 88%|████████▊ | 327716/371472 [3:54:25<3:19:23,  3.66it/s]
 88%|████████▊ | 327717/371472 [3:54:25<3:18:53,  3.67it/s]
 88%|████████▊ | 327718/371472 [3:54:26<3:19:10,  3.66it/s]
 88%|████████▊ | 327719/371472 [3:54:26<3:19:23,  3.66it/s]
 88%|████████▊ | 327720/371472 [3:54:26<3:22:14,  3.61it/s]
                                                           
{'loss': 2.5798, 'learning_rate': 2.060591695576289e-07, 'epoch': 14.12}

 88%|████████▊ | 327720/371472 [3:54:26<3:22:14,  3.61it/s]
 88%|████████▊ | 327721/371472 [3:54:27<3:15:25,  3.73it/s]
 88%|████████▊ | 327722/371472 [3:54:27<3:16:37,  3.71it/s]
 88%|████████▊ | 327723/371472 [3:54:27<3:09:41,  3.84it/s]
 88%|████████▊ | 327724/371472 [3:54:27<3:08:18,  3.87it/s]
 88%|████████▊ | 327725/371472 [3:54:28<3:13:28,  3.77it/s]
 88%|████████▊ | 327726/371472 [3:54:28<3:10:16,  3.83it/s]
 88%|████████▊ | 327727/371472 [3:54:28<3:13:19,  3.77it/s]
 88%|████████▊ | 327728/371472 [3:54:28<3:24:36,  3.56it/s]
 88%|████████▊ | 327729/371472 [3:54:29<3:16:07,  3.72it/s]
 88%|████████▊ | 327730/371472 [3:54:29<3:22:46,  3.60it/s]
 88%|████████▊ | 327731/371472 [3:54:29<3:20:49,  3.63it/s]
 88%|████████▊ | 327732/371472 [3:54:30<3:22:47,  3.59it/s]
 88%|████████▊ | 327733/371472 [3:54:30<3:16:29,  3.71it/s]
 88%|████████▊ | 327734/371472 [3:54:30<3:18:40,  3.67it/s]
 88%|████████▊ | 327735/371472 [3:54:30<3:44:54,  3.24it/s]
 88%|████████▊ | 327736/371472 [3:54:31<3:41:18,  3.29it/s]
 88%|████████▊ | 327737/371472 [3:54:31<3:36:02,  3.37it/s]
 88%|████████▊ | 327738/371472 [3:54:31<3:30:53,  3.46it/s]
 88%|████████▊ | 327739/371472 [3:54:32<3:32:17,  3.43it/s]
 88%|████████▊ | 327740/371472 [3:54:32<3:31:08,  3.45it/s]
                                                           
{'loss': 2.6088, 'learning_rate': 2.0601068758214995e-07, 'epoch': 14.12}

 88%|████████▊ | 327740/371472 [3:54:32<3:31:08,  3.45it/s]
 88%|████████▊ | 327741/371472 [3:54:32<3:29:07,  3.49it/s]
 88%|████████▊ | 327742/371472 [3:54:32<3:22:41,  3.60it/s]
 88%|████████▊ | 327743/371472 [3:54:33<3:20:10,  3.64it/s]
 88%|████████▊ | 327744/371472 [3:54:33<3:22:50,  3.59it/s]
 88%|████████▊ | 327745/371472 [3:54:33<3:17:56,  3.68it/s]
 88%|████████▊ | 327746/371472 [3:54:33<3:11:11,  3.81it/s]
 88%|████████▊ | 327747/371472 [3:54:34<3:15:43,  3.72it/s]
 88%|████████▊ | 327748/371472 [3:54:34<3:14:25,  3.75it/s]
 88%|████████▊ | 327749/371472 [3:54:34<3:13:13,  3.77it/s]
 88%|████████▊ | 327750/371472 [3:54:35<3:08:57,  3.86it/s]
 88%|████████▊ | 327751/371472 [3:54:35<3:14:20,  3.75it/s]
 88%|████████▊ | 327752/371472 [3:54:35<3:13:02,  3.77it/s]
 88%|████████▊ | 327753/371472 [3:54:35<3:21:18,  3.62it/s]
 88%|████████▊ | 327754/371472 [3:54:36<3:28:35,  3.49it/s]
 88%|████████▊ | 327755/371472 [3:54:36<3:24:01,  3.57it/s]
 88%|████████▊ | 327756/371472 [3:54:36<3:47:12,  3.21it/s]
 88%|████████▊ | 327757/371472 [3:54:37<3:47:23,  3.20it/s]
 88%|████████▊ | 327758/371472 [3:54:37<3:43:02,  3.27it/s]
 88%|████████▊ | 327759/371472 [3:54:37<3:39:08,  3.32it/s]
 88%|████████▊ | 327760/371472 [3:54:38<3:34:57,  3.39it/s]
                                                           
{'loss': 2.7447, 'learning_rate': 2.0596220560667113e-07, 'epoch': 14.12}

 88%|████████▊ | 327760/371472 [3:54:38<3:34:57,  3.39it/s]
 88%|████████▊ | 327761/371472 [3:54:38<3:38:32,  3.33it/s]
 88%|████████▊ | 327762/371472 [3:54:38<3:47:06,  3.21it/s]
 88%|████████▊ | 327763/371472 [3:54:38<3:46:35,  3.21it/s]
 88%|████████▊ | 327764/371472 [3:54:39<3:41:52,  3.28it/s]
 88%|████████▊ | 327765/371472 [3:54:39<3:35:09,  3.39it/s]
 88%|████████▊ | 327766/371472 [3:54:39<3:31:24,  3.45it/s]
 88%|████████▊ | 327767/371472 [3:54:40<3:29:06,  3.48it/s]
 88%|████████▊ | 327768/371472 [3:54:40<3:28:42,  3.49it/s]
 88%|████████▊ | 327769/371472 [3:54:40<3:34:13,  3.40it/s]
 88%|████████▊ | 327770/371472 [3:54:40<3:33:45,  3.41it/s]
 88%|████████▊ | 327771/371472 [3:54:41<3:38:32,  3.33it/s]
 88%|████████▊ | 327772/371472 [3:54:41<3:36:15,  3.37it/s]
 88%|████████▊ | 327773/371472 [3:54:41<3:36:57,  3.36it/s]
 88%|████████▊ | 327774/371472 [3:54:42<3:34:32,  3.39it/s]
 88%|████████▊ | 327775/371472 [3:54:42<3:33:55,  3.40it/s]
 88%|████████▊ | 327776/371472 [3:54:42<3:32:44,  3.42it/s]
 88%|████████▊ | 327777/371472 [3:54:43<3:42:58,  3.27it/s]
 88%|████████▊ | 327778/371472 [3:54:43<3:36:28,  3.36it/s]
 88%|████████▊ | 327779/371472 [3:54:43<3:32:38,  3.42it/s]
 88%|████████▊ | 327780/371472 [3:54:44<3:52:44,  3.13it/s]
                                                           
{'loss': 2.4584, 'learning_rate': 2.0591372363119217e-07, 'epoch': 14.12}

 88%|████████▊ | 327780/371472 [3:54:44<3:52:44,  3.13it/s]
 88%|████████▊ | 327781/371472 [3:54:44<3:48:18,  3.19it/s]
 88%|████████▊ | 327782/371472 [3:54:44<3:41:33,  3.29it/s]
 88%|████████▊ | 327783/371472 [3:54:44<3:37:21,  3.35it/s]
 88%|████████▊ | 327784/371472 [3:54:45<3:40:24,  3.30it/s]
 88%|████████▊ | 327785/371472 [3:54:45<3:46:27,  3.22it/s]
 88%|████████▊ | 327786/371472 [3:54:45<3:30:59,  3.45it/s]
 88%|████████▊ | 327787/371472 [3:54:46<3:32:05,  3.43it/s]
 88%|████████▊ | 327788/371472 [3:54:46<3:29:03,  3.48it/s]
 88%|████████▊ | 327789/371472 [3:54:46<3:34:27,  3.39it/s]
 88%|████████▊ | 327790/371472 [3:54:46<3:32:25,  3.43it/s]
 88%|████████▊ | 327791/371472 [3:54:47<3:27:49,  3.50it/s]
 88%|████████▊ | 327792/371472 [3:54:47<3:21:03,  3.62it/s]
 88%|████████▊ | 327793/371472 [3:54:47<3:15:05,  3.73it/s]
 88%|████████▊ | 327794/371472 [3:54:47<3:11:52,  3.79it/s]
 88%|████████▊ | 327795/371472 [3:54:48<4:20:33,  2.79it/s]
 88%|████████▊ | 327796/371472 [3:54:48<4:05:59,  2.96it/s]
 88%|████████▊ | 327797/371472 [3:54:49<4:00:18,  3.03it/s]
 88%|████████▊ | 327798/371472 [3:54:49<3:41:53,  3.28it/s]
 88%|████████▊ | 327799/371472 [3:54:49<3:46:35,  3.21it/s]
 88%|████████▊ | 327800/371472 [3:54:50<3:36:10,  3.37it/s]
                                                           
{'loss': 2.6853, 'learning_rate': 2.0586524165571332e-07, 'epoch': 14.12}

 88%|████████▊ | 327800/371472 [3:54:50<3:36:10,  3.37it/s]
 88%|████████▊ | 327801/371472 [3:54:50<3:29:15,  3.48it/s]
 88%|████████▊ | 327802/371472 [3:54:50<3:30:08,  3.46it/s]
 88%|████████▊ | 327803/371472 [3:54:50<3:28:42,  3.49it/s]
 88%|████████▊ | 327804/371472 [3:54:51<3:55:43,  3.09it/s]
 88%|████████▊ | 327805/371472 [3:54:51<3:42:42,  3.27it/s]
 88%|████████▊ | 327806/371472 [3:54:51<3:36:28,  3.36it/s]
 88%|████████▊ | 327807/371472 [3:54:52<3:28:05,  3.50it/s]
 88%|████████▊ | 327808/371472 [3:54:52<3:34:23,  3.39it/s]
 88%|████████▊ | 327809/371472 [3:54:52<3:51:51,  3.14it/s]
 88%|████████▊ | 327810/371472 [3:54:53<3:41:03,  3.29it/s]
 88%|████████▊ | 327811/371472 [3:54:53<3:32:16,  3.43it/s]
 88%|████████▊ | 327812/371472 [3:54:53<3:57:06,  3.07it/s]
 88%|████████▊ | 327813/371472 [3:54:54<4:20:06,  2.80it/s]
 88%|████████▊ | 327814/371472 [3:54:54<3:57:32,  3.06it/s]
 88%|████████▊ | 327815/371472 [3:54:54<3:55:54,  3.08it/s]
 88%|████████▊ | 327816/371472 [3:54:54<3:42:06,  3.28it/s]
 88%|████████▊ | 327817/371472 [3:54:55<3:36:03,  3.37it/s]
 88%|████████▊ | 327818/371472 [3:54:55<3:28:40,  3.49it/s]
 88%|████████▊ | 327819/371472 [3:54:55<3:25:57,  3.53it/s]
 88%|████████▊ | 327820/371472 [3:54:56<3:31:13,  3.44it/s]
                                                           
{'loss': 2.4444, 'learning_rate': 2.058167596802344e-07, 'epoch': 14.12}

 88%|████████▊ | 327820/371472 [3:54:56<3:31:13,  3.44it/s]
 88%|████████▊ | 327821/371472 [3:54:56<3:18:46,  3.66it/s]
 88%|████████▊ | 327822/371472 [3:54:56<3:28:50,  3.48it/s]
 88%|████████▊ | 327823/371472 [3:54:56<3:26:55,  3.52it/s]
 88%|████████▊ | 327824/371472 [3:54:57<3:22:29,  3.59it/s]
 88%|████████▊ | 327825/371472 [3:54:57<3:30:49,  3.45it/s]
 88%|████████▊ | 327826/371472 [3:54:57<3:26:08,  3.53it/s]
 88%|████████▊ | 327827/371472 [3:54:58<3:36:57,  3.35it/s]
 88%|████████▊ | 327828/371472 [3:54:58<3:33:51,  3.40it/s]
 88%|████████▊ | 327829/371472 [3:54:58<3:32:27,  3.42it/s]
 88%|████████▊ | 327830/371472 [3:54:58<3:25:31,  3.54it/s]
 88%|████████▊ | 327831/371472 [3:54:59<3:17:22,  3.68it/s]
 88%|████████▊ | 327832/371472 [3:54:59<3:24:32,  3.56it/s]
 88%|████████▊ | 327833/371472 [3:54:59<3:22:44,  3.59it/s]
 88%|████████▊ | 327834/371472 [3:55:00<3:22:00,  3.60it/s]
 88%|████████▊ | 327835/371472 [3:55:00<3:30:25,  3.46it/s]
 88%|████████▊ | 327836/371472 [3:55:00<3:30:56,  3.45it/s]
 88%|████████▊ | 327837/371472 [3:55:00<3:24:51,  3.55it/s]
 88%|████████▊ | 327838/371472 [3:55:01<3:38:51,  3.32it/s]
 88%|████████▊ | 327839/371472 [3:55:01<3:39:11,  3.32it/s]
 88%|████████▊ | 327840/371472 [3:55:01<3:29:52,  3.46it/s]
                                                           
{'loss': 2.4476, 'learning_rate': 2.0576827770475554e-07, 'epoch': 14.12}

 88%|████████▊ | 327840/371472 [3:55:01<3:29:52,  3.46it/s]
 88%|████████▊ | 327841/371472 [3:55:02<3:29:30,  3.47it/s]
 88%|████████▊ | 327842/371472 [3:55:02<3:24:48,  3.55it/s]
 88%|████████▊ | 327843/371472 [3:55:02<3:27:22,  3.51it/s]
 88%|████████▊ | 327844/371472 [3:55:02<3:25:43,  3.53it/s]
 88%|████████▊ | 327845/371472 [3:55:03<3:26:17,  3.52it/s]
 88%|████████▊ | 327846/371472 [3:55:03<3:26:54,  3.51it/s]
 88%|████████▊ | 327847/371472 [3:55:03<3:39:02,  3.32it/s]
 88%|████████▊ | 327848/371472 [3:55:04<3:32:30,  3.42it/s]
 88%|████████▊ | 327849/371472 [3:55:04<3:40:02,  3.30it/s]
 88%|████████▊ | 327850/371472 [3:55:04<3:27:01,  3.51it/s]
 88%|████████▊ | 327851/371472 [3:55:04<3:21:10,  3.61it/s]
 88%|████████▊ | 327852/371472 [3:55:05<3:16:13,  3.70it/s]
 88%|████████▊ | 327853/371472 [3:55:05<3:17:27,  3.68it/s]
 88%|████████▊ | 327854/371472 [3:55:05<3:18:12,  3.67it/s]
 88%|████████▊ | 327855/371472 [3:55:06<3:18:26,  3.66it/s]
 88%|████████▊ | 327856/371472 [3:55:06<3:18:16,  3.67it/s]
 88%|████████▊ | 327857/371472 [3:55:06<3:34:22,  3.39it/s]
 88%|████████▊ | 327858/371472 [3:55:06<3:35:21,  3.38it/s]
 88%|████████▊ | 327859/371472 [3:55:07<3:31:58,  3.43it/s]
 88%|████████▊ | 327860/371472 [3:55:07<3:23:45,  3.57it/s]
                                                           
{'loss': 2.7241, 'learning_rate': 2.057197957292766e-07, 'epoch': 14.12}

 88%|████████▊ | 327860/371472 [3:55:07<3:23:45,  3.57it/s]
 88%|████████▊ | 327861/371472 [3:55:07<3:17:04,  3.69it/s]
 88%|████████▊ | 327862/371472 [3:55:08<3:31:49,  3.43it/s]
 88%|████████▊ | 327863/371472 [3:55:08<3:27:42,  3.50it/s]
 88%|████████▊ | 327864/371472 [3:55:08<3:22:43,  3.59it/s]
 88%|████████▊ | 327865/371472 [3:55:08<3:22:13,  3.59it/s]
 88%|████████▊ | 327866/371472 [3:55:09<3:20:00,  3.63it/s]
 88%|████████▊ | 327867/371472 [3:55:09<3:30:58,  3.44it/s]
 88%|████████▊ | 327868/371472 [3:55:09<3:30:29,  3.45it/s]
 88%|████████▊ | 327869/371472 [3:55:10<3:55:11,  3.09it/s]
 88%|████████▊ | 327870/371472 [3:55:10<3:44:01,  3.24it/s]
 88%|████████▊ | 327871/371472 [3:55:10<3:47:10,  3.20it/s]
 88%|████████▊ | 327872/371472 [3:55:11<3:35:52,  3.37it/s]
 88%|████████▊ | 327873/371472 [3:55:11<4:00:43,  3.02it/s]
 88%|████████▊ | 327874/371472 [3:55:11<3:44:14,  3.24it/s]
 88%|████████▊ | 327875/371472 [3:55:11<3:40:05,  3.30it/s]
 88%|████████▊ | 327876/371472 [3:55:12<3:33:51,  3.40it/s]
 88%|████████▊ | 327877/371472 [3:55:12<3:39:37,  3.31it/s]
 88%|████████▊ | 327878/371472 [3:55:12<3:28:13,  3.49it/s]
 88%|████████▊ | 327879/371472 [3:55:13<3:18:17,  3.66it/s]
 88%|████████▊ | 327880/371472 [3:55:13<3:17:46,  3.67it/s]
                                                           
{'loss': 2.5864, 'learning_rate': 2.0567131375379777e-07, 'epoch': 14.12}

 88%|████████▊ | 327880/371472 [3:55:13<3:17:46,  3.67it/s]
 88%|████████▊ | 327881/371472 [3:55:13<3:21:25,  3.61it/s]
 88%|████████▊ | 327882/371472 [3:55:13<3:22:29,  3.59it/s]
 88%|████████▊ | 327883/371472 [3:55:14<3:15:17,  3.72it/s]
 88%|████████▊ | 327884/371472 [3:55:14<3:14:56,  3.73it/s]
 88%|████████▊ | 327885/371472 [3:55:14<3:13:48,  3.75it/s]
 88%|████████▊ | 327886/371472 [3:55:14<3:14:31,  3.73it/s]
 88%|████████▊ | 327887/371472 [3:55:15<3:14:58,  3.73it/s]
 88%|████████▊ | 327888/371472 [3:55:15<3:26:24,  3.52it/s]
 88%|████████▊ | 327889/371472 [3:55:15<3:26:11,  3.52it/s]
 88%|████████▊ | 327890/371472 [3:55:16<3:25:52,  3.53it/s]
 88%|████████▊ | 327891/371472 [3:55:16<3:45:49,  3.22it/s]
 88%|████████▊ | 327892/371472 [3:55:16<3:46:37,  3.21it/s]
 88%|████████▊ | 327893/371472 [3:55:17<3:49:30,  3.16it/s]
 88%|████████▊ | 327894/371472 [3:55:17<3:39:50,  3.30it/s]
 88%|████████▊ | 327895/371472 [3:55:17<3:29:51,  3.46it/s]
 88%|████████▊ | 327896/371472 [3:55:17<3:21:37,  3.60it/s]
 88%|████████▊ | 327897/371472 [3:55:18<3:29:36,  3.46it/s]
 88%|████████▊ | 327898/371472 [3:55:18<3:23:59,  3.56it/s]
 88%|████████▊ | 327899/371472 [3:55:18<3:21:14,  3.61it/s]
 88%|████████▊ | 327900/371472 [3:55:19<3:30:40,  3.45it/s]
                                                           
{'loss': 2.5999, 'learning_rate': 2.056228317783188e-07, 'epoch': 14.12}

 88%|████████▊ | 327900/371472 [3:55:19<3:30:40,  3.45it/s]
 88%|████████▊ | 327901/371472 [3:55:19<3:20:40,  3.62it/s]
 88%|████████▊ | 327902/371472 [3:55:19<3:19:33,  3.64it/s]
 88%|████████▊ | 327903/371472 [3:55:19<3:14:51,  3.73it/s]
 88%|████████▊ | 327904/371472 [3:55:20<3:13:55,  3.74it/s]
 88%|████████▊ | 327905/371472 [3:55:20<3:11:57,  3.78it/s]
 88%|████████▊ | 327906/371472 [3:55:20<3:28:46,  3.48it/s]
 88%|████████▊ | 327907/371472 [3:55:20<3:20:20,  3.62it/s]
 88%|████████▊ | 327908/371472 [3:55:21<3:16:38,  3.69it/s]
 88%|████████▊ | 327909/371472 [3:55:21<3:18:46,  3.65it/s]
 88%|████████▊ | 327910/371472 [3:55:21<3:16:22,  3.70it/s]
 88%|████████▊ | 327911/371472 [3:55:22<3:18:16,  3.66it/s]
 88%|████████▊ | 327912/371472 [3:55:22<3:17:40,  3.67it/s]
 88%|████████▊ | 327913/371472 [3:55:22<3:23:33,  3.57it/s]
 88%|████████▊ | 327914/371472 [3:55:22<3:37:36,  3.34it/s]
 88%|████████▊ | 327915/371472 [3:55:23<3:35:04,  3.38it/s]
 88%|████████▊ | 327916/371472 [3:55:23<3:29:22,  3.47it/s]
 88%|████████▊ | 327917/371472 [3:55:23<3:37:08,  3.34it/s]
 88%|████████▊ | 327918/371472 [3:55:24<3:39:22,  3.31it/s]
 88%|████████▊ | 327919/371472 [3:55:24<3:29:10,  3.47it/s]
 88%|████████▊ | 327920/371472 [3:55:24<3:25:47,  3.53it/s]
                                                           
{'loss': 2.5752, 'learning_rate': 2.0557434980283996e-07, 'epoch': 14.12}

 88%|████████▊ | 327920/371472 [3:55:24<3:25:47,  3.53it/s]
 88%|████████▊ | 327921/371472 [3:55:25<3:42:02,  3.27it/s]
 88%|████████▊ | 327922/371472 [3:55:25<3:36:14,  3.36it/s]
 88%|████████▊ | 327923/371472 [3:55:25<3:34:24,  3.39it/s]
 88%|████████▊ | 327924/371472 [3:55:25<3:29:03,  3.47it/s]
 88%|████████▊ | 327925/371472 [3:55:26<3:35:09,  3.37it/s]
 88%|████████▊ | 327926/371472 [3:55:26<3:33:56,  3.39it/s]
 88%|████████▊ | 327927/371472 [3:55:26<3:33:31,  3.40it/s]
 88%|████████▊ | 327928/371472 [3:55:27<3:37:59,  3.33it/s]
 88%|████████▊ | 327929/371472 [3:55:27<3:34:23,  3.39it/s]
 88%|████████▊ | 327930/371472 [3:55:27<3:27:40,  3.49it/s]
 88%|████████▊ | 327931/371472 [3:55:27<3:21:44,  3.60it/s]
 88%|████████▊ | 327932/371472 [3:55:28<3:18:17,  3.66it/s]
 88%|████████▊ | 327933/371472 [3:55:28<3:19:27,  3.64it/s]
 88%|████████▊ | 327934/371472 [3:55:28<3:11:39,  3.79it/s]
 88%|████████▊ | 327935/371472 [3:55:28<3:12:38,  3.77it/s]
 88%|████████▊ | 327936/371472 [3:55:29<3:16:20,  3.70it/s]
 88%|████████▊ | 327937/371472 [3:55:29<3:21:27,  3.60it/s]
 88%|████████▊ | 327938/371472 [3:55:29<3:33:08,  3.40it/s]
 88%|████████▊ | 327939/371472 [3:55:30<3:25:38,  3.53it/s]
 88%|████████▊ | 327940/371472 [3:55:30<3:27:48,  3.49it/s]
                                                           
{'loss': 2.6883, 'learning_rate': 2.0552586782736103e-07, 'epoch': 14.12}

 88%|████████▊ | 327940/371472 [3:55:30<3:27:48,  3.49it/s]
 88%|████████▊ | 327941/371472 [3:55:30<3:34:24,  3.38it/s]
 88%|████████▊ | 327942/371472 [3:55:31<3:51:40,  3.13it/s]
 88%|████████▊ | 327943/371472 [3:55:31<4:01:00,  3.01it/s]
 88%|████████▊ | 327944/371472 [3:55:31<3:54:22,  3.10it/s]
 88%|████████▊ | 327945/371472 [3:55:32<3:54:31,  3.09it/s]
 88%|████████▊ | 327946/371472 [3:55:32<3:41:50,  3.27it/s]
 88%|████████▊ | 327947/371472 [3:55:32<3:34:37,  3.38it/s]
 88%|████████▊ | 327948/371472 [3:55:32<3:36:46,  3.35it/s]
 88%|████████▊ | 327949/371472 [3:55:33<3:31:57,  3.42it/s]
 88%|████████▊ | 327950/371472 [3:55:33<3:22:50,  3.58it/s]
 88%|████████▊ | 327951/371472 [3:55:33<3:29:00,  3.47it/s]
 88%|████████▊ | 327952/371472 [3:55:33<3:20:08,  3.62it/s]
 88%|████████▊ | 327953/371472 [3:55:34<3:19:49,  3.63it/s]
 88%|████████▊ | 327954/371472 [3:55:34<3:19:55,  3.63it/s]
 88%|████████▊ | 327955/371472 [3:55:34<3:23:14,  3.57it/s]
 88%|████████▊ | 327956/371472 [3:55:35<3:37:06,  3.34it/s]
 88%|████████▊ | 327957/371472 [3:55:35<3:47:59,  3.18it/s]
 88%|████████▊ | 327958/371472 [3:55:35<3:43:53,  3.24it/s]
 88%|████████▊ | 327959/371472 [3:55:36<3:43:27,  3.25it/s]
 88%|████████▊ | 327960/371472 [3:55:36<3:34:46,  3.38it/s]
                                                           
{'loss': 2.5918, 'learning_rate': 2.0547738585188219e-07, 'epoch': 14.13}

 88%|████████▊ | 327960/371472 [3:55:36<3:34:46,  3.38it/s]
 88%|████████▊ | 327961/371472 [3:55:36<3:42:20,  3.26it/s]
 88%|████████▊ | 327962/371472 [3:55:37<3:42:09,  3.26it/s]
 88%|████████▊ | 327963/371472 [3:55:37<3:38:26,  3.32it/s]
 88%|████████▊ | 327964/371472 [3:55:37<3:36:24,  3.35it/s]
 88%|████████▊ | 327965/371472 [3:55:37<3:28:41,  3.47it/s]
 88%|████████▊ | 327966/371472 [3:55:38<3:28:35,  3.48it/s]
 88%|████████▊ | 327967/371472 [3:55:38<3:25:33,  3.53it/s]
 88%|████████▊ | 327968/371472 [3:55:38<3:27:04,  3.50it/s]
 88%|████████▊ | 327969/371472 [3:55:38<3:21:36,  3.60it/s]
 88%|████████▊ | 327970/371472 [3:55:39<3:19:56,  3.63it/s]
 88%|████████▊ | 327971/371472 [3:55:39<3:16:01,  3.70it/s]
 88%|████████▊ | 327972/371472 [3:55:39<3:10:54,  3.80it/s]
 88%|████████▊ | 327973/371472 [3:55:40<3:10:45,  3.80it/s]
 88%|████████▊ | 327974/371472 [3:55:40<3:10:08,  3.81it/s]
 88%|████████▊ | 327975/371472 [3:55:40<3:21:58,  3.59it/s]
 88%|████████▊ | 327976/371472 [3:55:40<3:20:32,  3.61it/s]
 88%|████████▊ | 327977/371472 [3:55:41<3:27:08,  3.50it/s]
 88%|████████▊ | 327978/371472 [3:55:41<3:20:43,  3.61it/s]
 88%|████████▊ | 327979/371472 [3:55:41<3:16:48,  3.68it/s]
 88%|████████▊ | 327980/371472 [3:55:42<3:34:16,  3.38it/s]
                                                           
{'loss': 2.5221, 'learning_rate': 2.0542890387640323e-07, 'epoch': 14.13}

 88%|████████▊ | 327980/371472 [3:55:42<3:34:16,  3.38it/s]
 88%|████████▊ | 327981/371472 [3:55:42<3:33:39,  3.39it/s]
 88%|████████▊ | 327982/371472 [3:55:42<3:25:09,  3.53it/s]
 88%|████████▊ | 327983/371472 [3:55:42<3:23:18,  3.57it/s]
 88%|████████▊ | 327984/371472 [3:55:43<3:17:51,  3.66it/s]
 88%|████████▊ | 327985/371472 [3:55:43<3:15:35,  3.71it/s]
 88%|████████▊ | 327986/371472 [3:55:43<3:25:46,  3.52it/s]
 88%|████████▊ | 327987/371472 [3:55:43<3:27:24,  3.49it/s]
 88%|████████▊ | 327988/371472 [3:55:44<3:24:52,  3.54it/s]
 88%|████████▊ | 327989/371472 [3:55:44<3:38:24,  3.32it/s]
 88%|████████▊ | 327990/371472 [3:55:44<3:35:09,  3.37it/s]
 88%|████████▊ | 327991/371472 [3:55:45<3:51:26,  3.13it/s]
 88%|████████▊ | 327992/371472 [3:55:45<3:42:02,  3.26it/s]
 88%|████████▊ | 327993/371472 [3:55:45<3:44:25,  3.23it/s]
 88%|████████▊ | 327994/371472 [3:55:46<3:38:20,  3.32it/s]
 88%|████████▊ | 327995/371472 [3:55:46<3:35:18,  3.37it/s]
 88%|████████▊ | 327996/371472 [3:55:46<3:32:17,  3.41it/s]
 88%|████████▊ | 327997/371472 [3:55:47<3:35:16,  3.37it/s]
 88%|████████▊ | 327998/371472 [3:55:47<3:29:57,  3.45it/s]
 88%|████████▊ | 327999/371472 [3:55:47<3:29:08,  3.46it/s]
 88%|████████▊ | 328000/371472 [3:55:47<3:28:56,  3.47it/s]
                                                           
{'loss': 2.6786, 'learning_rate': 2.053804219009244e-07, 'epoch': 14.13}

 88%|████████▊ | 328000/371472 [3:55:47<3:28:56,  3.47it/s]
 88%|████████▊ | 328001/371472 [3:55:48<3:28:40,  3.47it/s]
 88%|████████▊ | 328002/371472 [3:55:48<3:28:30,  3.47it/s]
 88%|████████▊ | 328003/371472 [3:55:48<3:28:12,  3.48it/s]
 88%|████████▊ | 328004/371472 [3:55:49<3:29:16,  3.46it/s]
 88%|████████▊ | 328005/371472 [3:55:49<3:27:01,  3.50it/s]
 88%|████████▊ | 328006/371472 [3:55:49<3:21:45,  3.59it/s]
 88%|████████▊ | 328007/371472 [3:55:49<3:22:19,  3.58it/s]
 88%|████████▊ | 328008/371472 [3:55:50<3:19:34,  3.63it/s]
 88%|████████▊ | 328009/371472 [3:55:50<3:17:28,  3.67it/s]
 88%|████████▊ | 328010/371472 [3:55:50<3:16:32,  3.69it/s]
 88%|████████▊ | 328011/371472 [3:55:50<3:27:21,  3.49it/s]
 88%|████████▊ | 328012/371472 [3:55:51<3:18:33,  3.65it/s]
 88%|████████▊ | 328013/371472 [3:55:51<3:17:32,  3.67it/s]
 88%|████████▊ | 328014/371472 [3:55:51<3:29:23,  3.46it/s]
 88%|████████▊ | 328015/371472 [3:55:52<3:26:09,  3.51it/s]
 88%|████████▊ | 328016/371472 [3:55:52<3:24:35,  3.54it/s]
 88%|████████▊ | 328017/371472 [3:55:52<3:36:09,  3.35it/s]
 88%|████████▊ | 328018/371472 [3:55:52<3:30:24,  3.44it/s]
 88%|████████▊ | 328019/371472 [3:55:53<3:34:06,  3.38it/s]
 88%|████████▊ | 328020/371472 [3:55:53<3:27:14,  3.49it/s]
                                                           
{'loss': 2.4778, 'learning_rate': 2.0533193992544548e-07, 'epoch': 14.13}

 88%|████████▊ | 328020/371472 [3:55:53<3:27:14,  3.49it/s]
 88%|████████▊ | 328021/371472 [3:55:53<3:21:41,  3.59it/s]
 88%|████████▊ | 328022/371472 [3:55:54<3:19:58,  3.62it/s]
 88%|████████▊ | 328023/371472 [3:55:54<3:21:10,  3.60it/s]
 88%|████████▊ | 328024/371472 [3:55:54<3:27:58,  3.48it/s]
 88%|████████▊ | 328025/371472 [3:55:54<3:27:55,  3.48it/s]
 88%|████████▊ | 328026/371472 [3:55:55<3:26:59,  3.50it/s]
 88%|████████▊ | 328027/371472 [3:55:55<3:25:53,  3.52it/s]
 88%|████████▊ | 328028/371472 [3:55:55<3:22:07,  3.58it/s]
 88%|████████▊ | 328029/371472 [3:55:56<3:22:27,  3.58it/s]
 88%|████████▊ | 328030/371472 [3:55:56<3:17:07,  3.67it/s]
 88%|████████▊ | 328031/371472 [3:55:56<3:20:06,  3.62it/s]
 88%|████████▊ | 328032/371472 [3:55:56<3:12:06,  3.77it/s]
 88%|████████▊ | 328033/371472 [3:55:57<3:17:44,  3.66it/s]
 88%|████████▊ | 328034/371472 [3:55:57<3:16:56,  3.68it/s]
 88%|████████▊ | 328035/371472 [3:55:57<3:24:17,  3.54it/s]
 88%|████████▊ | 328036/371472 [3:55:57<3:18:28,  3.65it/s]
 88%|████████▊ | 328037/371472 [3:55:58<3:25:22,  3.52it/s]
 88%|████████▊ | 328038/371472 [3:55:58<3:29:31,  3.45it/s]
 88%|████████▊ | 328039/371472 [3:55:58<3:26:24,  3.51it/s]
 88%|████████▊ | 328040/371472 [3:55:59<3:27:55,  3.48it/s]
                                                           
{'loss': 2.5681, 'learning_rate': 2.052834579499666e-07, 'epoch': 14.13}

 88%|████████▊ | 328040/371472 [3:55:59<3:27:55,  3.48it/s]
 88%|████████▊ | 328041/371472 [3:55:59<3:38:33,  3.31it/s]
 88%|████████▊ | 328042/371472 [3:55:59<3:45:59,  3.20it/s]
 88%|████████▊ | 328043/371472 [3:56:00<3:42:31,  3.25it/s]
 88%|████████▊ | 328044/371472 [3:56:00<3:45:24,  3.21it/s]
 88%|████████▊ | 328045/371472 [3:56:00<3:43:56,  3.23it/s]
 88%|████████▊ | 328046/371472 [3:56:01<3:35:52,  3.35it/s]
 88%|████████▊ | 328047/371472 [3:56:01<3:30:35,  3.44it/s]
 88%|████████▊ | 328048/371472 [3:56:01<3:23:53,  3.55it/s]
 88%|████████▊ | 328049/371472 [3:56:01<3:21:39,  3.59it/s]
 88%|████████▊ | 328050/371472 [3:56:02<3:28:20,  3.47it/s]
 88%|████████▊ | 328051/371472 [3:56:02<3:30:33,  3.44it/s]
 88%|████████▊ | 328052/371472 [3:56:02<3:31:02,  3.43it/s]
 88%|████████▊ | 328053/371472 [3:56:03<3:54:15,  3.09it/s]
 88%|████████▊ | 328054/371472 [3:56:03<3:49:36,  3.15it/s]
 88%|████████▊ | 328055/371472 [3:56:03<4:24:28,  2.74it/s]
 88%|████████▊ | 328056/371472 [3:56:04<3:59:31,  3.02it/s]
 88%|████████▊ | 328057/371472 [3:56:04<3:50:20,  3.14it/s]
 88%|████████▊ | 328058/371472 [3:56:04<3:43:47,  3.23it/s]
 88%|████████▊ | 328059/371472 [3:56:05<3:45:56,  3.20it/s]
 88%|████████▊ | 328060/371472 [3:56:05<3:35:12,  3.36it/s]
                                                           
{'loss': 2.5637, 'learning_rate': 2.0523497597448765e-07, 'epoch': 14.13}

 88%|████████▊ | 328060/371472 [3:56:05<3:35:12,  3.36it/s]
 88%|████████▊ | 328061/371472 [3:56:05<3:34:44,  3.37it/s]
 88%|████████▊ | 328062/371472 [3:56:05<3:33:44,  3.38it/s]
 88%|████████▊ | 328063/371472 [3:56:06<3:34:44,  3.37it/s]
 88%|████████▊ | 328064/371472 [3:56:06<3:27:35,  3.49it/s]
 88%|████████▊ | 328065/371472 [3:56:06<3:28:20,  3.47it/s]
 88%|████████▊ | 328066/371472 [3:56:07<3:27:09,  3.49it/s]
 88%|████████▊ | 328067/371472 [3:56:07<3:25:41,  3.52it/s]
 88%|████████▊ | 328068/371472 [3:56:07<3:23:23,  3.56it/s]
 88%|████████▊ | 328069/371472 [3:56:07<3:27:51,  3.48it/s]
 88%|████████▊ | 328070/371472 [3:56:08<3:33:25,  3.39it/s]
 88%|████████▊ | 328071/371472 [3:56:08<3:33:01,  3.40it/s]
 88%|████████▊ | 328072/371472 [3:56:08<3:38:09,  3.32it/s]
 88%|████████▊ | 328073/371472 [3:56:09<3:33:47,  3.38it/s]
 88%|████████▊ | 328074/371472 [3:56:09<3:32:46,  3.40it/s]
 88%|████████▊ | 328075/371472 [3:56:09<3:26:54,  3.50it/s]
 88%|████████▊ | 328076/371472 [3:56:09<3:23:12,  3.56it/s]
 88%|████████▊ | 328077/371472 [3:56:10<3:31:10,  3.42it/s]
 88%|████████▊ | 328078/371472 [3:56:10<3:53:09,  3.10it/s]
 88%|████████▊ | 328079/371472 [3:56:10<3:54:19,  3.09it/s]
 88%|████████▊ | 328080/371472 [3:56:11<3:48:28,  3.17it/s]
                                                           
{'loss': 2.5302, 'learning_rate': 2.0518649399900885e-07, 'epoch': 14.13}

 88%|████████▊ | 328080/371472 [3:56:11<3:48:28,  3.17it/s]
 88%|████████▊ | 328081/371472 [3:56:11<3:38:53,  3.30it/s]
 88%|████████▊ | 328082/371472 [3:56:11<3:33:23,  3.39it/s]
 88%|████████▊ | 328083/371472 [3:56:12<3:33:29,  3.39it/s]
 88%|████████▊ | 328084/371472 [3:56:12<3:36:18,  3.34it/s]
 88%|████████▊ | 328085/371472 [3:56:12<3:37:20,  3.33it/s]
 88%|████████▊ | 328086/371472 [3:56:12<3:30:57,  3.43it/s]
 88%|████████▊ | 328087/371472 [3:56:13<3:31:07,  3.42it/s]
 88%|████████▊ | 328088/371472 [3:56:13<3:28:53,  3.46it/s]
 88%|████████▊ | 328089/371472 [3:56:13<3:27:24,  3.49it/s]
 88%|████████▊ | 328090/371472 [3:56:14<3:32:42,  3.40it/s]
 88%|████████▊ | 328091/371472 [3:56:14<3:29:34,  3.45it/s]
 88%|████████▊ | 328092/371472 [3:56:14<3:39:50,  3.29it/s]
 88%|████████▊ | 328093/371472 [3:56:15<3:36:19,  3.34it/s]
 88%|████████▊ | 328094/371472 [3:56:15<3:23:32,  3.55it/s]
 88%|████████▊ | 328095/371472 [3:56:15<3:22:39,  3.57it/s]
 88%|████████▊ | 328096/371472 [3:56:15<3:20:55,  3.60it/s]
 88%|████████▊ | 328097/371472 [3:56:16<3:21:53,  3.58it/s]
 88%|████████▊ | 328098/371472 [3:56:16<3:22:11,  3.58it/s]
 88%|████████▊ | 328099/371472 [3:56:16<3:22:08,  3.58it/s]
 88%|████████▊ | 328100/371472 [3:56:16<3:19:59,  3.61it/s]
                                                           
{'loss': 2.7689, 'learning_rate': 2.051380120235299e-07, 'epoch': 14.13}

 88%|████████▊ | 328100/371472 [3:56:16<3:19:59,  3.61it/s]
 88%|████████▊ | 328101/371472 [3:56:17<3:18:58,  3.63it/s]
 88%|████████▊ | 328102/371472 [3:56:17<3:29:58,  3.44it/s]
 88%|████████▊ | 328103/371472 [3:56:17<3:29:11,  3.46it/s]
 88%|████████▊ | 328104/371472 [3:56:18<3:22:35,  3.57it/s]
 88%|████████▊ | 328105/371472 [3:56:18<3:21:12,  3.59it/s]
 88%|████████▊ | 328106/371472 [3:56:18<3:19:42,  3.62it/s]
 88%|████████▊ | 328107/371472 [3:56:18<3:17:48,  3.65it/s]
 88%|████████▊ | 328108/371472 [3:56:19<3:23:23,  3.55it/s]
 88%|████████▊ | 328109/371472 [3:56:19<3:52:37,  3.11it/s]
 88%|████████▊ | 328110/371472 [3:56:19<3:47:02,  3.18it/s]
 88%|████████▊ | 328111/371472 [3:56:20<3:40:39,  3.28it/s]
 88%|████████▊ | 328112/371472 [3:56:20<3:32:32,  3.40it/s]
 88%|████████▊ | 328113/371472 [3:56:20<3:22:03,  3.58it/s]
 88%|████████▊ | 328114/371472 [3:56:20<3:18:55,  3.63it/s]
 88%|████████▊ | 328115/371472 [3:56:21<3:26:31,  3.50it/s]
 88%|████████▊ | 328116/371472 [3:56:21<3:22:47,  3.56it/s]
 88%|████████▊ | 328117/371472 [3:56:21<3:30:51,  3.43it/s]
 88%|████████▊ | 328118/371472 [3:56:22<3:24:40,  3.53it/s]
 88%|████████▊ | 328119/371472 [3:56:22<3:17:49,  3.65it/s]
 88%|████████▊ | 328120/371472 [3:56:22<3:23:23,  3.55it/s]
                                                           
{'loss': 2.5556, 'learning_rate': 2.0508953004805105e-07, 'epoch': 14.13}

 88%|████████▊ | 328120/371472 [3:56:22<3:23:23,  3.55it/s]
 88%|████████▊ | 328121/371472 [3:56:23<3:38:06,  3.31it/s]
 88%|████████▊ | 328122/371472 [3:56:23<3:28:49,  3.46it/s]
 88%|████████▊ | 328123/371472 [3:56:23<3:24:52,  3.53it/s]
 88%|████████▊ | 328124/371472 [3:56:23<3:18:51,  3.63it/s]
 88%|████████▊ | 328125/371472 [3:56:24<3:13:57,  3.72it/s]
 88%|████████▊ | 328126/371472 [3:56:24<3:10:41,  3.79it/s]
 88%|████████▊ | 328127/371472 [3:56:24<3:09:36,  3.81it/s]
 88%|████████▊ | 328128/371472 [3:56:24<3:23:57,  3.54it/s]
 88%|████████▊ | 328129/371472 [3:56:25<3:20:15,  3.61it/s]
 88%|████████▊ | 328130/371472 [3:56:25<3:11:37,  3.77it/s]
 88%|████████▊ | 328131/371472 [3:56:25<3:20:27,  3.60it/s]
 88%|████████▊ | 328132/371472 [3:56:26<3:23:39,  3.55it/s]
 88%|████████▊ | 328133/371472 [3:56:26<3:25:05,  3.52it/s]
 88%|████████▊ | 328134/371472 [3:56:26<3:34:10,  3.37it/s]
 88%|████████▊ | 328135/371472 [3:56:27<3:49:41,  3.14it/s]
 88%|████████▊ | 328136/371472 [3:56:27<3:50:18,  3.14it/s]
 88%|████████▊ | 328137/371472 [3:56:27<3:56:44,  3.05it/s]
 88%|████████▊ | 328138/371472 [3:56:27<3:54:08,  3.08it/s]
 88%|████████▊ | 328139/371472 [3:56:28<3:37:10,  3.33it/s]
 88%|████████▊ | 328140/371472 [3:56:28<3:33:45,  3.38it/s]
                                                           
{'loss': 2.6551, 'learning_rate': 2.0504104807257212e-07, 'epoch': 14.13}

 88%|████████▊ | 328140/371472 [3:56:28<3:33:45,  3.38it/s]
 88%|████████▊ | 328141/371472 [3:56:28<3:25:28,  3.51it/s]
 88%|████████▊ | 328142/371472 [3:56:29<3:23:00,  3.56it/s]
 88%|████████▊ | 328143/371472 [3:56:29<3:21:00,  3.59it/s]
 88%|████████▊ | 328144/371472 [3:56:29<3:20:01,  3.61it/s]
 88%|████████▊ | 328145/371472 [3:56:29<3:17:07,  3.66it/s]
 88%|████████▊ | 328146/371472 [3:56:30<3:28:31,  3.46it/s]
 88%|████████▊ | 328147/371472 [3:56:30<3:26:44,  3.49it/s]
 88%|████████▊ | 328148/371472 [3:56:30<3:34:07,  3.37it/s]
 88%|████████▊ | 328149/371472 [3:56:31<3:27:38,  3.48it/s]
 88%|████████▊ | 328150/371472 [3:56:31<3:25:32,  3.51it/s]
 88%|████████▊ | 328151/371472 [3:56:31<3:37:17,  3.32it/s]
 88%|████████▊ | 328152/371472 [3:56:32<3:50:13,  3.14it/s]
 88%|████████▊ | 328153/371472 [3:56:32<3:42:58,  3.24it/s]
 88%|████████▊ | 328154/371472 [3:56:32<3:38:22,  3.31it/s]
 88%|████████▊ | 328155/371472 [3:56:32<3:48:12,  3.16it/s]
 88%|████████▊ | 328156/371472 [3:56:33<3:36:51,  3.33it/s]
 88%|████████▊ | 328157/371472 [3:56:33<3:39:33,  3.29it/s]
 88%|████████▊ | 328158/371472 [3:56:33<3:36:41,  3.33it/s]
 88%|████████▊ | 328159/371472 [3:56:34<3:26:45,  3.49it/s]
 88%|████████▊ | 328160/371472 [3:56:34<3:19:44,  3.61it/s]
                                                           
{'loss': 2.5965, 'learning_rate': 2.0499256609709327e-07, 'epoch': 14.13}

 88%|████████▊ | 328160/371472 [3:56:34<3:19:44,  3.61it/s]
 88%|████████▊ | 328161/371472 [3:56:34<3:24:24,  3.53it/s]
 88%|████████▊ | 328162/371472 [3:56:34<3:28:52,  3.46it/s]
 88%|████████▊ | 328163/371472 [3:56:35<3:32:06,  3.40it/s]
 88%|████████▊ | 328164/371472 [3:56:35<3:28:45,  3.46it/s]
 88%|████████▊ | 328165/371472 [3:56:35<3:25:09,  3.52it/s]
 88%|████████▊ | 328166/371472 [3:56:36<3:28:51,  3.46it/s]
 88%|████████▊ | 328167/371472 [3:56:36<3:22:43,  3.56it/s]
 88%|████████▊ | 328168/371472 [3:56:36<3:28:37,  3.46it/s]
 88%|████████▊ | 328169/371472 [3:56:36<3:23:30,  3.55it/s]
 88%|████████▊ | 328170/371472 [3:56:37<3:48:25,  3.16it/s]
 88%|████████▊ | 328171/371472 [3:56:37<3:42:39,  3.24it/s]
 88%|████████▊ | 328172/371472 [3:56:37<3:44:47,  3.21it/s]
 88%|████████▊ | 328173/371472 [3:56:38<3:50:16,  3.13it/s]
 88%|████████▊ | 328174/371472 [3:56:38<3:36:09,  3.34it/s]
 88%|████████▊ | 328175/371472 [3:56:38<3:24:57,  3.52it/s]
 88%|████████▊ | 328176/371472 [3:56:39<3:29:55,  3.44it/s]
 88%|████████▊ | 328177/371472 [3:56:39<3:20:28,  3.60it/s]
 88%|████████▊ | 328178/371472 [3:56:39<3:15:58,  3.68it/s]
 88%|████████▊ | 328179/371472 [3:56:39<3:24:15,  3.53it/s]
 88%|████████▊ | 328180/371472 [3:56:40<3:23:11,  3.55it/s]
                                                           
{'loss': 2.692, 'learning_rate': 2.0494408412161432e-07, 'epoch': 14.14}

 88%|████████▊ | 328180/371472 [3:56:40<3:23:11,  3.55it/s]
 88%|████████▊ | 328181/371472 [3:56:40<3:23:08,  3.55it/s]
 88%|████████▊ | 328182/371472 [3:56:40<3:20:13,  3.60it/s]
 88%|████████▊ | 328183/371472 [3:56:40<3:15:53,  3.68it/s]
 88%|████████▊ | 328184/371472 [3:56:41<3:15:24,  3.69it/s]
 88%|████████▊ | 328185/371472 [3:56:41<3:13:25,  3.73it/s]
 88%|████████▊ | 328186/371472 [3:56:41<3:12:09,  3.75it/s]
 88%|████████▊ | 328187/371472 [3:56:42<3:18:15,  3.64it/s]
 88%|████████▊ | 328188/371472 [3:56:42<3:20:17,  3.60it/s]
 88%|████████▊ | 328189/371472 [3:56:42<3:23:56,  3.54it/s]
 88%|████████▊ | 328190/371472 [3:56:42<3:27:02,  3.48it/s]
 88%|████████▊ | 328191/371472 [3:56:43<3:19:55,  3.61it/s]
 88%|████████▊ | 328192/371472 [3:56:43<3:18:16,  3.64it/s]
 88%|████████▊ | 328193/371472 [3:56:43<3:15:44,  3.69it/s]
 88%|████████▊ | 328194/371472 [3:56:44<3:26:10,  3.50it/s]
 88%|████████▊ | 328195/371472 [3:56:44<3:38:43,  3.30it/s]
 88%|████████▊ | 328196/371472 [3:56:44<3:34:58,  3.35it/s]
 88%|████████▊ | 328197/371472 [3:56:44<3:24:45,  3.52it/s]
 88%|████████▊ | 328198/371472 [3:56:45<3:24:08,  3.53it/s]
 88%|████████▊ | 328199/371472 [3:56:45<3:19:09,  3.62it/s]
 88%|████████▊ | 328200/371472 [3:56:45<3:17:12,  3.66it/s]
                                                           
{'loss': 2.5998, 'learning_rate': 2.048956021461355e-07, 'epoch': 14.14}

 88%|████████▊ | 328200/371472 [3:56:45<3:17:12,  3.66it/s]
 88%|████████▊ | 328201/371472 [3:56:46<3:22:30,  3.56it/s]
 88%|████████▊ | 328202/371472 [3:56:46<3:22:11,  3.57it/s]
 88%|████████▊ | 328203/371472 [3:56:46<3:16:15,  3.67it/s]
 88%|████████▊ | 328204/371472 [3:56:46<3:14:28,  3.71it/s]
 88%|████████▊ | 328205/371472 [3:56:47<3:14:37,  3.71it/s]
 88%|████████▊ | 328206/371472 [3:56:47<3:08:12,  3.83it/s]
 88%|████████▊ | 328207/371472 [3:56:47<3:11:06,  3.77it/s]
 88%|████████▊ | 328208/371472 [3:56:47<3:07:59,  3.84it/s]
 88%|████████▊ | 328209/371472 [3:56:48<3:16:10,  3.68it/s]
 88%|████████▊ | 328210/371472 [3:56:48<3:11:52,  3.76it/s]
 88%|████████▊ | 328211/371472 [3:56:48<3:12:56,  3.74it/s]
 88%|████████▊ | 328212/371472 [3:56:48<3:12:00,  3.75it/s]
 88%|████████▊ | 328213/371472 [3:56:49<3:08:45,  3.82it/s]
 88%|████████▊ | 328214/371472 [3:56:49<3:12:58,  3.74it/s]
 88%|████████▊ | 328215/371472 [3:56:49<3:30:02,  3.43it/s]
 88%|████████▊ | 328216/371472 [3:56:50<3:31:59,  3.40it/s]
 88%|████████▊ | 328217/371472 [3:56:50<3:30:11,  3.43it/s]
 88%|████████▊ | 328218/371472 [3:56:50<3:39:09,  3.29it/s]
 88%|████████▊ | 328219/371472 [3:56:51<4:01:12,  2.99it/s]
 88%|████████▊ | 328220/371472 [3:56:51<3:50:37,  3.13it/s]
                                                           
{'loss': 2.5066, 'learning_rate': 2.0484712017065654e-07, 'epoch': 14.14}

 88%|████████▊ | 328220/371472 [3:56:51<3:50:37,  3.13it/s]
 88%|████████▊ | 328221/371472 [3:56:51<3:40:15,  3.27it/s]
 88%|████████▊ | 328222/371472 [3:56:52<3:41:41,  3.25it/s]
 88%|████████▊ | 328223/371472 [3:56:52<3:30:25,  3.43it/s]
 88%|████████▊ | 328224/371472 [3:56:52<3:41:59,  3.25it/s]
 88%|████████▊ | 328225/371472 [3:56:52<3:45:11,  3.20it/s]
 88%|████████▊ | 328226/371472 [3:56:53<3:42:46,  3.24it/s]
 88%|████████▊ | 328227/371472 [3:56:53<3:33:21,  3.38it/s]
 88%|████████▊ | 328228/371472 [3:56:53<3:32:57,  3.38it/s]
 88%|████████▊ | 328229/371472 [3:56:54<3:27:56,  3.47it/s]
 88%|████████▊ | 328230/371472 [3:56:54<3:23:35,  3.54it/s]
 88%|████████▊ | 328231/371472 [3:56:54<3:26:11,  3.50it/s]
 88%|████████▊ | 328232/371472 [3:56:54<3:19:57,  3.60it/s]
 88%|████████▊ | 328233/371472 [3:56:55<3:37:24,  3.31it/s]
 88%|████████▊ | 328234/371472 [3:56:55<3:49:25,  3.14it/s]
 88%|████████▊ | 328235/371472 [3:56:55<3:35:01,  3.35it/s]
 88%|████████▊ | 328236/371472 [3:56:56<3:39:07,  3.29it/s]
 88%|████████▊ | 328237/371472 [3:56:56<3:28:25,  3.46it/s]
 88%|████████▊ | 328238/371472 [3:56:56<3:27:10,  3.48it/s]
 88%|████████▊ | 328239/371472 [3:56:56<3:22:14,  3.56it/s]
 88%|████████▊ | 328240/371472 [3:56:57<3:12:53,  3.74it/s]
                                                           
{'loss': 2.5264, 'learning_rate': 2.0479863819517772e-07, 'epoch': 14.14}

 88%|████████▊ | 328240/371472 [3:56:57<3:12:53,  3.74it/s]
 88%|████████▊ | 328241/371472 [3:56:57<3:26:52,  3.48it/s]
 88%|████████▊ | 328242/371472 [3:56:57<3:26:21,  3.49it/s]
 88%|████████▊ | 328243/371472 [3:56:58<3:21:26,  3.58it/s]
 88%|████████▊ | 328244/371472 [3:56:58<3:35:13,  3.35it/s]
 88%|████████▊ | 328245/371472 [3:56:58<3:29:35,  3.44it/s]
 88%|████████▊ | 328246/371472 [3:56:58<3:23:49,  3.53it/s]
 88%|████████▊ | 328247/371472 [3:56:59<3:21:35,  3.57it/s]
 88%|████████▊ | 328248/371472 [3:56:59<3:41:38,  3.25it/s]
 88%|████████▊ | 328249/371472 [3:56:59<3:30:59,  3.41it/s]
 88%|████████▊ | 328250/371472 [3:57:00<3:44:22,  3.21it/s]
 88%|████████▊ | 328251/371472 [3:57:00<3:33:55,  3.37it/s]
 88%|████████▊ | 328252/371472 [3:57:00<3:29:17,  3.44it/s]
 88%|████████▊ | 328253/371472 [3:57:01<3:25:01,  3.51it/s]
 88%|████████▊ | 328254/371472 [3:57:01<3:20:02,  3.60it/s]
 88%|████████▊ | 328255/371472 [3:57:01<3:28:07,  3.46it/s]
 88%|████████▊ | 328256/371472 [3:57:01<3:21:47,  3.57it/s]
 88%|████████▊ | 328257/371472 [3:57:02<3:18:55,  3.62it/s]
 88%|████████▊ | 328258/371472 [3:57:02<3:22:44,  3.55it/s]
 88%|████████▊ | 328259/371472 [3:57:02<3:28:22,  3.46it/s]
 88%|████████▊ | 328260/371472 [3:57:03<3:22:28,  3.56it/s]
                                                           
{'loss': 2.5356, 'learning_rate': 2.0475015621969876e-07, 'epoch': 14.14}

 88%|████████▊ | 328260/371472 [3:57:03<3:22:28,  3.56it/s]
 88%|████████▊ | 328261/371472 [3:57:03<3:19:26,  3.61it/s]
 88%|████████▊ | 328262/371472 [3:57:03<3:16:55,  3.66it/s]
 88%|████████▊ | 328263/371472 [3:57:03<3:30:41,  3.42it/s]
 88%|████████▊ | 328264/371472 [3:57:04<3:31:44,  3.40it/s]
 88%|████████▊ | 328265/371472 [3:57:04<3:25:02,  3.51it/s]
 88%|████████▊ | 328266/371472 [3:57:04<3:23:21,  3.54it/s]
 88%|████████▊ | 328267/371472 [3:57:05<3:21:43,  3.57it/s]
 88%|████████▊ | 328268/371472 [3:57:05<3:34:27,  3.36it/s]
 88%|████████▊ | 328269/371472 [3:57:05<3:28:02,  3.46it/s]
 88%|████████▊ | 328270/371472 [3:57:05<3:23:52,  3.53it/s]
 88%|████████▊ | 328271/371472 [3:57:06<3:33:21,  3.37it/s]
 88%|████████▊ | 328272/371472 [3:57:06<3:35:55,  3.33it/s]
 88%|████████▊ | 328273/371472 [3:57:06<3:32:56,  3.38it/s]
 88%|████████▊ | 328274/371472 [3:57:07<3:24:48,  3.52it/s]
 88%|████████▊ | 328275/371472 [3:57:07<3:25:37,  3.50it/s]
 88%|████████▊ | 328276/371472 [3:57:07<3:16:41,  3.66it/s]
 88%|████████▊ | 328277/371472 [3:57:07<3:15:55,  3.67it/s]
 88%|████████▊ | 328278/371472 [3:57:08<3:20:04,  3.60it/s]
 88%|████████▊ | 328279/371472 [3:57:08<3:30:04,  3.43it/s]
 88%|████████▊ | 328280/371472 [3:57:08<3:28:54,  3.45it/s]
                                                           
{'loss': 2.7004, 'learning_rate': 2.0470167424421983e-07, 'epoch': 14.14}

 88%|████████▊ | 328280/371472 [3:57:08<3:28:54,  3.45it/s]
 88%|████████▊ | 328281/371472 [3:57:09<3:31:45,  3.40it/s]
 88%|████████▊ | 328282/371472 [3:57:09<3:23:02,  3.55it/s]
 88%|████████▊ | 328283/371472 [3:57:09<3:20:23,  3.59it/s]
 88%|████████▊ | 328284/371472 [3:57:09<3:32:41,  3.38it/s]
 88%|████████▊ | 328285/371472 [3:57:10<3:41:12,  3.25it/s]
 88%|████████▊ | 328286/371472 [3:57:10<3:32:54,  3.38it/s]
 88%|████████▊ | 328287/371472 [3:57:10<3:34:12,  3.36it/s]
 88%|████████▊ | 328288/371472 [3:57:11<3:22:12,  3.56it/s]
 88%|████████▊ | 328289/371472 [3:57:11<3:17:08,  3.65it/s]
 88%|████████▊ | 328290/371472 [3:57:11<3:33:12,  3.38it/s]
 88%|████████▊ | 328291/371472 [3:57:11<3:29:49,  3.43it/s]
 88%|████████▊ | 328292/371472 [3:57:12<3:26:24,  3.49it/s]
 88%|████████▊ | 328293/371472 [3:57:12<3:47:16,  3.17it/s]
 88%|████████▊ | 328294/371472 [3:57:12<3:41:20,  3.25it/s]
 88%|████████▊ | 328295/371472 [3:57:13<3:29:15,  3.44it/s]
 88%|████████▊ | 328296/371472 [3:57:13<3:29:18,  3.44it/s]
 88%|████████▊ | 328297/371472 [3:57:13<3:29:06,  3.44it/s]
 88%|████████▊ | 328298/371472 [3:57:13<3:19:48,  3.60it/s]
 88%|████████▊ | 328299/371472 [3:57:14<3:13:14,  3.72it/s]
 88%|████████▊ | 328300/371472 [3:57:14<3:20:19,  3.59it/s]
                                                           
{'loss': 2.6231, 'learning_rate': 2.0465319226874096e-07, 'epoch': 14.14}

 88%|████████▊ | 328300/371472 [3:57:14<3:20:19,  3.59it/s]
 88%|████████▊ | 328301/371472 [3:57:14<3:31:24,  3.40it/s]
 88%|████████▊ | 328302/371472 [3:57:15<3:35:43,  3.34it/s]
 88%|████████▊ | 328303/371472 [3:57:15<3:31:44,  3.40it/s]
 88%|████████▊ | 328304/371472 [3:57:15<3:23:40,  3.53it/s]
 88%|████████▊ | 328305/371472 [3:57:16<3:24:02,  3.53it/s]
 88%|████████▊ | 328306/371472 [3:57:16<3:29:00,  3.44it/s]
 88%|████████▊ | 328307/371472 [3:57:16<3:25:15,  3.50it/s]
 88%|████████▊ | 328308/371472 [3:57:16<3:21:34,  3.57it/s]
 88%|████████▊ | 328309/371472 [3:57:17<3:20:52,  3.58it/s]
 88%|████████▊ | 328310/371472 [3:57:17<3:24:18,  3.52it/s]
 88%|████████▊ | 328311/371472 [3:57:17<3:24:30,  3.52it/s]
 88%|████████▊ | 328312/371472 [3:57:18<3:32:36,  3.38it/s]
 88%|████████▊ | 328313/371472 [3:57:18<3:24:07,  3.52it/s]
 88%|████████▊ | 328314/371472 [3:57:18<3:19:41,  3.60it/s]
 88%|████████▊ | 328315/371472 [3:57:18<3:14:25,  3.70it/s]
 88%|████████▊ | 328316/371472 [3:57:19<3:33:58,  3.36it/s]
 88%|████████▊ | 328317/371472 [3:57:19<3:36:57,  3.32it/s]
 88%|████████▊ | 328318/371472 [3:57:19<3:45:17,  3.19it/s]
 88%|████████▊ | 328319/371472 [3:57:20<3:42:30,  3.23it/s]
 88%|████████▊ | 328320/371472 [3:57:20<3:30:51,  3.41it/s]
                                                           
{'loss': 2.6344, 'learning_rate': 2.0460471029326203e-07, 'epoch': 14.14}

 88%|████████▊ | 328320/371472 [3:57:20<3:30:51,  3.41it/s]
 88%|████████▊ | 328321/371472 [3:57:20<3:31:03,  3.41it/s]
 88%|████████▊ | 328322/371472 [3:57:20<3:20:34,  3.59it/s]
 88%|████████▊ | 328323/371472 [3:57:21<3:14:18,  3.70it/s]
 88%|████████▊ | 328324/371472 [3:57:21<3:20:47,  3.58it/s]
 88%|████████▊ | 328325/371472 [3:57:21<3:21:24,  3.57it/s]
 88%|████████▊ | 328326/371472 [3:57:22<3:33:10,  3.37it/s]
 88%|████████▊ | 328327/371472 [3:57:22<3:52:22,  3.09it/s]
 88%|████████▊ | 328328/371472 [3:57:22<3:36:11,  3.33it/s]
 88%|████████▊ | 328329/371472 [3:57:22<3:33:46,  3.36it/s]
 88%|████████▊ | 328330/371472 [3:57:23<3:27:20,  3.47it/s]
 88%|████████▊ | 328331/371472 [3:57:23<3:34:51,  3.35it/s]
 88%|████████▊ | 328332/371472 [3:57:23<3:25:54,  3.49it/s]
 88%|████████▊ | 328333/371472 [3:57:24<3:33:59,  3.36it/s]
 88%|████████▊ | 328334/371472 [3:57:24<3:20:47,  3.58it/s]
 88%|████████▊ | 328335/371472 [3:57:24<3:17:54,  3.63it/s]
 88%|████████▊ | 328336/371472 [3:57:24<3:18:12,  3.63it/s]
 88%|████████▊ | 328337/371472 [3:57:25<3:14:04,  3.70it/s]
 88%|████████▊ | 328338/371472 [3:57:25<3:20:26,  3.59it/s]
 88%|████████▊ | 328339/371472 [3:57:25<3:19:33,  3.60it/s]
 88%|████████▊ | 328340/371472 [3:57:26<3:18:50,  3.62it/s]
                                                           
{'loss': 2.6045, 'learning_rate': 2.045562283177832e-07, 'epoch': 14.14}

 88%|████████▊ | 328340/371472 [3:57:26<3:18:50,  3.62it/s]
 88%|████████▊ | 328341/371472 [3:57:26<3:24:36,  3.51it/s]
 88%|████████▊ | 328342/371472 [3:57:26<3:24:39,  3.51it/s]
 88%|████████▊ | 328343/371472 [3:57:26<3:22:07,  3.56it/s]
 88%|████████▊ | 328344/371472 [3:57:27<3:24:23,  3.52it/s]
 88%|████████▊ | 328345/371472 [3:57:27<3:20:29,  3.59it/s]
 88%|████████▊ | 328346/371472 [3:57:27<3:12:44,  3.73it/s]
 88%|████████▊ | 328347/371472 [3:57:27<3:13:25,  3.72it/s]
 88%|████████▊ | 328348/371472 [3:57:28<3:13:16,  3.72it/s]
 88%|████████▊ | 328349/371472 [3:57:28<3:07:43,  3.83it/s]
 88%|████████▊ | 328350/371472 [3:57:28<3:09:54,  3.78it/s]
 88%|████████▊ | 328351/371472 [3:57:29<3:16:03,  3.67it/s]
 88%|████████▊ | 328352/371472 [3:57:29<3:15:28,  3.68it/s]
 88%|████████▊ | 328353/371472 [3:57:29<3:21:45,  3.56it/s]
 88%|████████▊ | 328354/371472 [3:57:29<3:24:21,  3.52it/s]
 88%|████████▊ | 328355/371472 [3:57:30<3:16:21,  3.66it/s]
 88%|████████▊ | 328356/371472 [3:57:30<3:09:48,  3.79it/s]
 88%|████████▊ | 328357/371472 [3:57:30<3:15:17,  3.68it/s]
 88%|████████▊ | 328358/371472 [3:57:30<3:16:35,  3.66it/s]
 88%|████████▊ | 328359/371472 [3:57:31<3:20:27,  3.58it/s]
 88%|████████▊ | 328360/371472 [3:57:31<3:13:45,  3.71it/s]
                                                           
{'loss': 2.7304, 'learning_rate': 2.0450774634230422e-07, 'epoch': 14.14}

 88%|████████▊ | 328360/371472 [3:57:31<3:13:45,  3.71it/s]
 88%|████████▊ | 328361/371472 [3:57:31<3:09:26,  3.79it/s]
 88%|████████▊ | 328362/371472 [3:57:32<3:15:53,  3.67it/s]
 88%|████████▊ | 328363/371472 [3:57:32<3:24:09,  3.52it/s]
 88%|████████▊ | 328364/371472 [3:57:32<3:22:31,  3.55it/s]
 88%|████████▊ | 328365/371472 [3:57:32<3:14:52,  3.69it/s]
 88%|████████▊ | 328366/371472 [3:57:33<3:19:41,  3.60it/s]
 88%|████████▊ | 328367/371472 [3:57:33<3:28:21,  3.45it/s]
 88%|████████▊ | 328368/371472 [3:57:33<3:27:04,  3.47it/s]
 88%|████████▊ | 328369/371472 [3:57:34<3:21:22,  3.57it/s]
 88%|████████▊ | 328370/371472 [3:57:34<3:20:34,  3.58it/s]
 88%|████████▊ | 328371/371472 [3:57:34<3:16:29,  3.66it/s]
 88%|████████▊ | 328372/371472 [3:57:34<3:09:29,  3.79it/s]
 88%|████████▊ | 328373/371472 [3:57:35<3:06:04,  3.86it/s]
 88%|████████▊ | 328374/371472 [3:57:35<3:17:52,  3.63it/s]
 88%|████████▊ | 328375/371472 [3:57:35<3:20:01,  3.59it/s]
 88%|████████▊ | 328376/371472 [3:57:35<3:26:21,  3.48it/s]
 88%|████████▊ | 328377/371472 [3:57:36<3:25:09,  3.50it/s]
 88%|████████▊ | 328378/371472 [3:57:36<3:19:59,  3.59it/s]
 88%|████████▊ | 328379/371472 [3:57:36<3:16:01,  3.66it/s]
 88%|████████▊ | 328380/371472 [3:57:37<3:15:08,  3.68it/s]
                                                           
{'loss': 2.7115, 'learning_rate': 2.044592643668254e-07, 'epoch': 14.14}

 88%|████████▊ | 328380/371472 [3:57:37<3:15:08,  3.68it/s]
 88%|████████▊ | 328381/371472 [3:57:37<3:33:48,  3.36it/s]
 88%|████████▊ | 328382/371472 [3:57:37<3:28:30,  3.44it/s]
 88%|████████▊ | 328383/371472 [3:57:37<3:18:52,  3.61it/s]
 88%|████████▊ | 328384/371472 [3:57:38<3:15:52,  3.67it/s]
 88%|████████▊ | 328385/371472 [3:57:38<3:12:42,  3.73it/s]
 88%|████████▊ | 328386/371472 [3:57:38<3:16:35,  3.65it/s]
 88%|████████▊ | 328387/371472 [3:57:39<3:25:55,  3.49it/s]
 88%|████████▊ | 328388/371472 [3:57:39<3:24:30,  3.51it/s]
 88%|████████▊ | 328389/371472 [3:57:39<3:24:22,  3.51it/s]
 88%|████████▊ | 328390/371472 [3:57:39<3:20:37,  3.58it/s]
 88%|████████▊ | 328391/371472 [3:57:40<3:23:38,  3.53it/s]
 88%|████████▊ | 328392/371472 [3:57:40<3:17:53,  3.63it/s]
 88%|████████▊ | 328393/371472 [3:57:40<3:13:16,  3.71it/s]
 88%|████████▊ | 328394/371472 [3:57:40<3:17:54,  3.63it/s]
 88%|████████▊ | 328395/371472 [3:57:41<3:32:37,  3.38it/s]
 88%|████████▊ | 328396/371472 [3:57:41<3:27:00,  3.47it/s]
 88%|████████▊ | 328397/371472 [3:57:41<3:34:15,  3.35it/s]
 88%|████████▊ | 328398/371472 [3:57:42<3:57:36,  3.02it/s]
 88%|████████▊ | 328399/371472 [3:57:42<3:40:01,  3.26it/s]
 88%|████████▊ | 328400/371472 [3:57:42<3:39:27,  3.27it/s]
                                                           
{'loss': 2.6907, 'learning_rate': 2.044107823913465e-07, 'epoch': 14.14}

 88%|████████▊ | 328400/371472 [3:57:42<3:39:27,  3.27it/s]
 88%|████████▊ | 328401/371472 [3:57:43<3:34:45,  3.34it/s]
 88%|████████▊ | 328402/371472 [3:57:43<3:32:54,  3.37it/s]
 88%|████████▊ | 328403/371472 [3:57:43<3:56:05,  3.04it/s]
 88%|████████▊ | 328404/371472 [3:57:44<3:39:23,  3.27it/s]
 88%|████████▊ | 328405/371472 [3:57:44<3:30:47,  3.41it/s]
 88%|████████▊ | 328406/371472 [3:57:44<3:28:24,  3.44it/s]
 88%|████████▊ | 328407/371472 [3:57:44<3:24:34,  3.51it/s]
 88%|████████▊ | 328408/371472 [3:57:45<3:22:03,  3.55it/s]
 88%|████████▊ | 328409/371472 [3:57:45<3:23:17,  3.53it/s]
 88%|████████▊ | 328410/371472 [3:57:45<3:20:23,  3.58it/s]
 88%|████████▊ | 328411/371472 [3:57:46<3:32:39,  3.37it/s]
 88%|████████▊ | 328412/371472 [3:57:46<3:37:47,  3.30it/s]
 88%|████████▊ | 328413/371472 [3:57:46<3:31:14,  3.40it/s]
 88%|████████▊ | 328414/371472 [3:57:46<3:27:47,  3.45it/s]
 88%|████████▊ | 328415/371472 [3:57:47<3:21:46,  3.56it/s]
 88%|████████▊ | 328416/371472 [3:57:47<3:20:53,  3.57it/s]
 88%|████████▊ | 328417/371472 [3:57:47<3:25:27,  3.49it/s]
 88%|████████▊ | 328418/371472 [3:57:48<3:17:43,  3.63it/s]
 88%|████████▊ | 328419/371472 [3:57:48<3:14:55,  3.68it/s]
 88%|████████▊ | 328420/371472 [3:57:48<3:15:09,  3.68it/s]
                                                           
{'loss': 2.4737, 'learning_rate': 2.043623004158676e-07, 'epoch': 14.15}

 88%|████████▊ | 328420/371472 [3:57:48<3:15:09,  3.68it/s]
 88%|████████▊ | 328421/371472 [3:57:48<3:26:04,  3.48it/s]
 88%|████████▊ | 328422/371472 [3:57:49<3:16:29,  3.65it/s]
 88%|████████▊ | 328423/371472 [3:57:49<3:11:12,  3.75it/s]
 88%|████████▊ | 328424/371472 [3:57:49<3:19:21,  3.60it/s]
 88%|████████▊ | 328425/371472 [3:57:49<3:11:17,  3.75it/s]
 88%|████████▊ | 328426/371472 [3:57:50<3:13:31,  3.71it/s]
 88%|████████▊ | 328427/371472 [3:57:50<3:18:37,  3.61it/s]
 88%|████████▊ | 328428/371472 [3:57:50<3:20:31,  3.58it/s]
 88%|████████▊ | 328429/371472 [3:57:51<3:21:56,  3.55it/s]
 88%|████████▊ | 328430/371472 [3:57:51<3:16:30,  3.65it/s]
 88%|████████▊ | 328431/371472 [3:57:51<3:09:28,  3.79it/s]
 88%|████████▊ | 328432/371472 [3:57:51<3:08:49,  3.80it/s]
 88%|████████▊ | 328433/371472 [3:57:52<3:22:01,  3.55it/s]
 88%|████████▊ | 328434/371472 [3:57:52<3:16:16,  3.65it/s]
 88%|████████▊ | 328435/371472 [3:57:52<3:26:11,  3.48it/s]
 88%|████████▊ | 328436/371472 [3:57:53<3:20:00,  3.59it/s]
 88%|████████▊ | 328437/371472 [3:57:53<3:14:16,  3.69it/s]
 88%|████████▊ | 328438/371472 [3:57:53<3:27:17,  3.46it/s]
 88%|████████▊ | 328439/371472 [3:57:53<3:22:40,  3.54it/s]
 88%|████████▊ | 328440/371472 [3:57:54<3:30:59,  3.40it/s]
                                                           
{'loss': 2.6369, 'learning_rate': 2.0431381844038867e-07, 'epoch': 14.15}

 88%|████████▊ | 328440/371472 [3:57:54<3:30:59,  3.40it/s]
 88%|████████▊ | 328441/371472 [3:57:54<3:28:21,  3.44it/s]
 88%|████████▊ | 328442/371472 [3:57:54<3:27:51,  3.45it/s]
 88%|████████▊ | 328443/371472 [3:57:55<3:27:25,  3.46it/s]
 88%|████████▊ | 328444/371472 [3:57:55<3:31:58,  3.38it/s]
 88%|████████▊ | 328445/371472 [3:57:55<3:22:18,  3.54it/s]
 88%|████████▊ | 328446/371472 [3:57:55<3:22:01,  3.55it/s]
 88%|████████▊ | 328447/371472 [3:57:56<4:06:15,  2.91it/s]
 88%|████████▊ | 328448/371472 [3:57:56<4:01:14,  2.97it/s]
 88%|████████▊ | 328449/371472 [3:57:57<3:53:00,  3.08it/s]
 88%|████████▊ | 328450/371472 [3:57:57<3:48:17,  3.14it/s]
 88%|████████▊ | 328451/371472 [3:57:57<3:43:04,  3.21it/s]
 88%|████████▊ | 328452/371472 [3:57:57<3:38:48,  3.28it/s]
 88%|████████▊ | 328453/371472 [3:57:58<3:53:27,  3.07it/s]
 88%|████████▊ | 328454/371472 [3:57:58<3:48:46,  3.13it/s]
 88%|████████▊ | 328455/371472 [3:57:58<3:58:37,  3.00it/s]
 88%|████████▊ | 328456/371472 [3:57:59<3:45:17,  3.18it/s]
 88%|████████▊ | 328457/371472 [3:57:59<3:38:25,  3.28it/s]
 88%|████████▊ | 328458/371472 [3:57:59<3:31:37,  3.39it/s]
 88%|████████▊ | 328459/371472 [3:58:00<3:26:51,  3.47it/s]
 88%|████████▊ | 328460/371472 [3:58:00<3:16:57,  3.64it/s]
                                                           
{'loss': 2.6047, 'learning_rate': 2.0426533646490985e-07, 'epoch': 14.15}

 88%|████████▊ | 328460/371472 [3:58:00<3:16:57,  3.64it/s]
 88%|████████▊ | 328461/371472 [3:58:00<3:18:35,  3.61it/s]
 88%|████████▊ | 328462/371472 [3:58:00<3:16:05,  3.66it/s]
 88%|████████▊ | 328463/371472 [3:58:01<3:16:19,  3.65it/s]
 88%|████████▊ | 328464/371472 [3:58:01<3:29:09,  3.43it/s]
 88%|████████▊ | 328465/371472 [3:58:01<3:20:58,  3.57it/s]
 88%|████████▊ | 328466/371472 [3:58:02<3:34:04,  3.35it/s]
 88%|████████▊ | 328467/371472 [3:58:02<3:22:40,  3.54it/s]
 88%|████████▊ | 328468/371472 [3:58:02<3:18:57,  3.60it/s]
 88%|████████▊ | 328469/371472 [3:58:02<3:22:47,  3.53it/s]
 88%|████████▊ | 328470/371472 [3:58:03<3:28:38,  3.44it/s]
 88%|████████▊ | 328471/371472 [3:58:03<3:40:15,  3.25it/s]
 88%|████████▊ | 328472/371472 [3:58:03<3:32:09,  3.38it/s]
 88%|████████▊ | 328473/371472 [3:58:04<3:25:39,  3.48it/s]
 88%|████████▊ | 328474/371472 [3:58:04<3:43:37,  3.20it/s]
 88%|████████▊ | 328475/371472 [3:58:04<3:41:20,  3.24it/s]
 88%|████████▊ | 328476/371472 [3:58:04<3:30:28,  3.40it/s]
 88%|████████▊ | 328477/371472 [3:58:05<3:22:52,  3.53it/s]
 88%|████████▊ | 328478/371472 [3:58:05<3:52:00,  3.09it/s]
 88%|████████▊ | 328479/371472 [3:58:05<3:48:19,  3.14it/s]
 88%|████████▊ | 328480/371472 [3:58:06<3:36:33,  3.31it/s]
                                                           
{'loss': 2.5723, 'learning_rate': 2.042168544894309e-07, 'epoch': 14.15}

 88%|████████▊ | 328480/371472 [3:58:06<3:36:33,  3.31it/s]
 88%|████████▊ | 328481/371472 [3:58:06<3:39:31,  3.26it/s]
 88%|████████▊ | 328482/371472 [3:58:06<3:30:53,  3.40it/s]
 88%|████████▊ | 328483/371472 [3:58:07<3:24:47,  3.50it/s]
 88%|████████▊ | 328484/371472 [3:58:07<3:19:39,  3.59it/s]
 88%|████████▊ | 328485/371472 [3:58:07<3:20:08,  3.58it/s]
 88%|████████▊ | 328486/371472 [3:58:07<3:32:44,  3.37it/s]
 88%|████████▊ | 328487/371472 [3:58:08<3:36:42,  3.31it/s]
 88%|████████▊ | 328488/371472 [3:58:08<3:36:28,  3.31it/s]
 88%|████████▊ | 328489/371472 [3:58:08<3:32:45,  3.37it/s]
 88%|████████▊ | 328490/371472 [3:58:09<3:36:32,  3.31it/s]
 88%|████████▊ | 328491/371472 [3:58:09<3:24:48,  3.50it/s]
 88%|████████▊ | 328492/371472 [3:58:09<3:19:53,  3.58it/s]
 88%|████████▊ | 328493/371472 [3:58:09<3:20:08,  3.58it/s]
 88%|████████▊ | 328494/371472 [3:58:10<3:16:08,  3.65it/s]
 88%|████████▊ | 328495/371472 [3:58:10<3:14:24,  3.68it/s]
 88%|████████▊ | 328496/371472 [3:58:10<3:14:05,  3.69it/s]
 88%|████████▊ | 328497/371472 [3:58:11<3:30:51,  3.40it/s]
 88%|████████▊ | 328498/371472 [3:58:11<3:27:49,  3.45it/s]
 88%|████████▊ | 328499/371472 [3:58:11<3:28:17,  3.44it/s]
 88%|████████▊ | 328500/371472 [3:58:11<3:38:08,  3.28it/s]
                                                           
{'loss': 2.584, 'learning_rate': 2.0416837251395204e-07, 'epoch': 14.15}

 88%|████████▊ | 328500/371472 [3:58:11<3:38:08,  3.28it/s]
 88%|████████▊ | 328501/371472 [3:58:12<3:31:45,  3.38it/s]
 88%|████████▊ | 328502/371472 [3:58:12<3:35:50,  3.32it/s]
 88%|████████▊ | 328503/371472 [3:58:12<3:26:47,  3.46it/s]
 88%|████████▊ | 328504/371472 [3:58:13<3:28:58,  3.43it/s]
 88%|████████▊ | 328505/371472 [3:58:13<3:24:01,  3.51it/s]
 88%|████████▊ | 328506/371472 [3:58:13<3:23:22,  3.52it/s]
 88%|████████▊ | 328507/371472 [3:58:13<3:21:35,  3.55it/s]
 88%|████████▊ | 328508/371472 [3:58:14<3:16:38,  3.64it/s]
 88%|████████▊ | 328509/371472 [3:58:14<3:20:40,  3.57it/s]
 88%|████████▊ | 328510/371472 [3:58:14<3:18:41,  3.60it/s]
 88%|████████▊ | 328511/371472 [3:58:15<3:20:20,  3.57it/s]
 88%|████████▊ | 328512/371472 [3:58:15<3:21:50,  3.55it/s]
 88%|████████▊ | 328513/371472 [3:58:15<3:26:44,  3.46it/s]
 88%|████████▊ | 328514/371472 [3:58:15<3:18:29,  3.61it/s]
 88%|████████▊ | 328515/371472 [3:58:16<3:27:57,  3.44it/s]
 88%|████████▊ | 328516/371472 [3:58:16<3:29:24,  3.42it/s]
 88%|████████▊ | 328517/371472 [3:58:16<3:32:11,  3.37it/s]
 88%|████████▊ | 328518/371472 [3:58:17<3:24:35,  3.50it/s]
 88%|████████▊ | 328519/371472 [3:58:17<3:18:17,  3.61it/s]
 88%|████████▊ | 328520/371472 [3:58:17<3:22:23,  3.54it/s]
                                                           
{'loss': 2.6698, 'learning_rate': 2.0411989053847311e-07, 'epoch': 14.15}

 88%|████████▊ | 328520/371472 [3:58:17<3:22:23,  3.54it/s]
 88%|████████▊ | 328521/371472 [3:58:17<3:24:15,  3.50it/s]
 88%|████████▊ | 328522/371472 [3:58:18<3:46:42,  3.16it/s]
 88%|████████▊ | 328523/371472 [3:58:18<3:39:45,  3.26it/s]
 88%|████████▊ | 328524/371472 [3:58:18<3:46:41,  3.16it/s]
 88%|████████▊ | 328525/371472 [3:58:19<3:37:05,  3.30it/s]
 88%|████████▊ | 328526/371472 [3:58:19<3:28:09,  3.44it/s]
 88%|████████▊ | 328527/371472 [3:58:19<3:24:33,  3.50it/s]
 88%|████████▊ | 328528/371472 [3:58:20<3:24:06,  3.51it/s]
 88%|████████▊ | 328529/371472 [3:58:20<3:41:44,  3.23it/s]
 88%|████████▊ | 328530/371472 [3:58:20<3:40:05,  3.25it/s]
 88%|████████▊ | 328531/371472 [3:58:20<3:30:25,  3.40it/s]
 88%|████████▊ | 328532/371472 [3:58:21<3:20:55,  3.56it/s]
 88%|████████▊ | 328533/371472 [3:58:21<3:23:44,  3.51it/s]
 88%|████████▊ | 328534/371472 [3:58:21<3:33:31,  3.35it/s]
 88%|████████▊ | 328535/371472 [3:58:22<3:26:30,  3.47it/s]
 88%|████████▊ | 328536/371472 [3:58:22<3:18:51,  3.60it/s]
 88%|████████▊ | 328537/371472 [3:58:22<3:13:04,  3.71it/s]
 88%|████████▊ | 328538/371472 [3:58:23<3:36:11,  3.31it/s]
 88%|████████▊ | 328539/371472 [3:58:23<3:28:43,  3.43it/s]
 88%|████████▊ | 328540/371472 [3:58:23<3:23:18,  3.52it/s]
                                                           
{'loss': 2.5686, 'learning_rate': 2.0407140856299426e-07, 'epoch': 14.15}

 88%|████████▊ | 328540/371472 [3:58:23<3:23:18,  3.52it/s]
 88%|████████▊ | 328541/371472 [3:58:23<3:21:07,  3.56it/s]
 88%|████████▊ | 328542/371472 [3:58:24<3:23:10,  3.52it/s]
 88%|████████▊ | 328543/371472 [3:58:24<3:32:26,  3.37it/s]
 88%|████████▊ | 328544/371472 [3:58:24<3:31:47,  3.38it/s]
 88%|████████▊ | 328545/371472 [3:58:25<3:38:32,  3.27it/s]
 88%|████████▊ | 328546/371472 [3:58:25<3:42:37,  3.21it/s]
 88%|████████▊ | 328547/371472 [3:58:25<3:33:02,  3.36it/s]
 88%|████████▊ | 328548/371472 [3:58:25<3:30:32,  3.40it/s]
 88%|████████▊ | 328549/371472 [3:58:26<3:27:31,  3.45it/s]
 88%|████████▊ | 328550/371472 [3:58:26<3:30:11,  3.40it/s]
 88%|████████▊ | 328551/371472 [3:58:26<3:29:08,  3.42it/s]
 88%|████████▊ | 328552/371472 [3:58:27<3:30:29,  3.40it/s]
 88%|████████▊ | 328553/371472 [3:58:27<3:27:57,  3.44it/s]
 88%|████████▊ | 328554/371472 [3:58:27<3:24:59,  3.49it/s]
 88%|████████▊ | 328555/371472 [3:58:28<3:46:56,  3.15it/s]
 88%|████████▊ | 328556/371472 [3:58:28<3:40:01,  3.25it/s]
 88%|████████▊ | 328557/371472 [3:58:28<3:30:40,  3.40it/s]
 88%|████████▊ | 328558/371472 [3:58:28<3:25:26,  3.48it/s]
 88%|████████▊ | 328559/371472 [3:58:29<3:19:46,  3.58it/s]
 88%|████████▊ | 328560/371472 [3:58:29<3:30:03,  3.40it/s]
                                                           
{'loss': 2.6313, 'learning_rate': 2.040229265875153e-07, 'epoch': 14.15}

 88%|████████▊ | 328560/371472 [3:58:29<3:30:03,  3.40it/s]
 88%|████████▊ | 328561/371472 [3:58:29<3:25:42,  3.48it/s]
 88%|████████▊ | 328562/371472 [3:58:30<3:30:16,  3.40it/s]
 88%|████████▊ | 328563/371472 [3:58:30<3:32:24,  3.37it/s]
 88%|████████▊ | 328564/371472 [3:58:30<3:26:21,  3.47it/s]
 88%|████████▊ | 328565/371472 [3:58:30<3:21:16,  3.55it/s]
 88%|████████▊ | 328566/371472 [3:58:31<3:22:06,  3.54it/s]
 88%|████████▊ | 328567/371472 [3:58:31<3:24:58,  3.49it/s]
 88%|████████▊ | 328568/371472 [3:58:31<3:25:00,  3.49it/s]
 88%|████████▊ | 328569/371472 [3:58:32<3:37:54,  3.28it/s]
 88%|████████▊ | 328570/371472 [3:58:32<3:32:50,  3.36it/s]
 88%|████████▊ | 328571/371472 [3:58:32<3:31:44,  3.38it/s]
 88%|████████▊ | 328572/371472 [3:58:32<3:21:50,  3.54it/s]
 88%|████████▊ | 328573/371472 [3:58:33<3:14:12,  3.68it/s]
 88%|████████▊ | 328574/371472 [3:58:33<3:30:08,  3.40it/s]
 88%|████████▊ | 328575/371472 [3:58:33<3:50:44,  3.10it/s]
 88%|████████▊ | 328576/371472 [3:58:34<4:00:45,  2.97it/s]
 88%|████████▊ | 328577/371472 [3:58:34<3:47:10,  3.15it/s]
 88%|████████▊ | 328578/371472 [3:58:34<3:44:32,  3.18it/s]
 88%|████████▊ | 328579/371472 [3:58:35<3:35:10,  3.32it/s]
 88%|████████▊ | 328580/371472 [3:58:35<3:29:16,  3.42it/s]
                                                           
{'loss': 2.4553, 'learning_rate': 2.039744446120365e-07, 'epoch': 14.15}

 88%|████████▊ | 328580/371472 [3:58:35<3:29:16,  3.42it/s]
 88%|████████▊ | 328581/371472 [3:58:35<3:24:13,  3.50it/s]
 88%|████████▊ | 328582/371472 [3:58:35<3:20:52,  3.56it/s]
 88%|████████▊ | 328583/371472 [3:58:36<3:25:51,  3.47it/s]
 88%|████████▊ | 328584/371472 [3:58:36<3:30:40,  3.39it/s]
 88%|████████▊ | 328585/371472 [3:58:36<3:37:02,  3.29it/s]
 88%|████████▊ | 328586/371472 [3:58:37<3:43:29,  3.20it/s]
 88%|████████▊ | 328587/371472 [3:58:37<3:35:23,  3.32it/s]
 88%|████████▊ | 328588/371472 [3:58:37<3:40:19,  3.24it/s]
 88%|████████▊ | 328589/371472 [3:58:38<4:12:49,  2.83it/s]
 88%|████████▊ | 328590/371472 [3:58:38<3:59:09,  2.99it/s]
 88%|████████▊ | 328591/371472 [3:58:38<3:57:53,  3.00it/s]
 88%|████████▊ | 328592/371472 [3:58:39<3:37:34,  3.28it/s]
 88%|████████▊ | 328593/371472 [3:58:39<3:42:59,  3.20it/s]
 88%|████████▊ | 328594/371472 [3:58:39<3:46:15,  3.16it/s]
 88%|████████▊ | 328595/371472 [3:58:40<3:36:12,  3.31it/s]
 88%|████████▊ | 328596/371472 [3:58:40<3:37:17,  3.29it/s]
 88%|████████▊ | 328597/371472 [3:58:40<3:41:54,  3.22it/s]
 88%|████████▊ | 328598/371472 [3:58:41<3:52:27,  3.07it/s]
 88%|████████▊ | 328599/371472 [3:58:41<3:47:16,  3.14it/s]
 88%|████████▊ | 328600/371472 [3:58:41<3:41:55,  3.22it/s]
                                                           
{'loss': 2.5679, 'learning_rate': 2.0392596263655753e-07, 'epoch': 14.15}

 88%|████████▊ | 328600/371472 [3:58:41<3:41:55,  3.22it/s]
 88%|████████▊ | 328601/371472 [3:58:41<3:29:48,  3.41it/s]
 88%|████████▊ | 328602/371472 [3:58:42<3:29:38,  3.41it/s]
 88%|████████▊ | 328603/371472 [3:58:42<3:38:35,  3.27it/s]
 88%|████████▊ | 328604/371472 [3:58:42<3:29:45,  3.41it/s]
 88%|████████▊ | 328605/371472 [3:58:43<3:35:23,  3.32it/s]
 88%|████████▊ | 328606/371472 [3:58:43<3:35:50,  3.31it/s]
 88%|████████▊ | 328607/371472 [3:58:43<3:41:43,  3.22it/s]
 88%|████████▊ | 328608/371472 [3:58:43<3:32:22,  3.36it/s]
 88%|████████▊ | 328609/371472 [3:58:44<3:31:56,  3.37it/s]
 88%|████████▊ | 328610/371472 [3:58:44<3:24:07,  3.50it/s]
 88%|████████▊ | 328611/371472 [3:58:44<3:22:05,  3.53it/s]
 88%|████████▊ | 328612/371472 [3:58:45<3:21:36,  3.54it/s]
 88%|████████▊ | 328613/371472 [3:58:45<3:21:51,  3.54it/s]
 88%|████████▊ | 328614/371472 [3:58:45<3:21:09,  3.55it/s]
 88%|████████▊ | 328615/371472 [3:58:45<3:16:12,  3.64it/s]
 88%|████████▊ | 328616/371472 [3:58:46<3:26:45,  3.45it/s]
 88%|████████▊ | 328617/371472 [3:58:46<3:25:05,  3.48it/s]
 88%|████████▊ | 328618/371472 [3:58:46<3:25:44,  3.47it/s]
 88%|████████▊ | 328619/371472 [3:58:47<3:34:45,  3.33it/s]
 88%|████████▊ | 328620/371472 [3:58:47<3:32:38,  3.36it/s]
                                                           
{'loss': 2.6164, 'learning_rate': 2.0387748066107868e-07, 'epoch': 14.15}

 88%|████████▊ | 328620/371472 [3:58:47<3:32:38,  3.36it/s]
 88%|████████▊ | 328621/371472 [3:58:47<3:23:14,  3.51it/s]
 88%|████████▊ | 328622/371472 [3:58:48<3:41:30,  3.22it/s]
 88%|████████▊ | 328623/371472 [3:58:48<3:41:22,  3.23it/s]
 88%|████████▊ | 328624/371472 [3:58:48<3:38:32,  3.27it/s]
 88%|████████▊ | 328625/371472 [3:58:48<3:27:34,  3.44it/s]
 88%|████████▊ | 328626/371472 [3:58:49<3:21:29,  3.54it/s]
 88%|████████▊ | 328627/371472 [3:58:49<3:29:29,  3.41it/s]
 88%|████████▊ | 328628/371472 [3:58:49<3:23:14,  3.51it/s]
 88%|████████▊ | 328629/371472 [3:58:50<3:20:57,  3.55it/s]
 88%|████████▊ | 328630/371472 [3:58:50<3:25:02,  3.48it/s]
 88%|████████▊ | 328631/371472 [3:58:50<3:25:15,  3.48it/s]
 88%|████████▊ | 328632/371472 [3:58:50<3:29:14,  3.41it/s]
 88%|████████▊ | 328633/371472 [3:58:51<3:28:37,  3.42it/s]
 88%|████████▊ | 328634/371472 [3:58:51<3:29:34,  3.41it/s]
 88%|████████▊ | 328635/371472 [3:58:51<3:24:47,  3.49it/s]
 88%|████████▊ | 328636/371472 [3:58:52<3:26:01,  3.47it/s]
 88%|████████▊ | 328637/371472 [3:58:52<3:23:30,  3.51it/s]
 88%|████████▊ | 328638/371472 [3:58:52<3:16:33,  3.63it/s]
 88%|████████▊ | 328639/371472 [3:58:52<3:22:48,  3.52it/s]
 88%|████████▊ | 328640/371472 [3:58:53<3:14:20,  3.67it/s]
                                                           
{'loss': 2.6186, 'learning_rate': 2.0382899868559975e-07, 'epoch': 14.16}

 88%|████████▊ | 328640/371472 [3:58:53<3:14:20,  3.67it/s]
 88%|████████▊ | 328641/371472 [3:58:53<3:10:34,  3.75it/s]
 88%|████████▊ | 328642/371472 [3:58:53<3:04:15,  3.87it/s]
 88%|████████▊ | 328643/371472 [3:58:54<3:26:29,  3.46it/s]
 88%|████████▊ | 328644/371472 [3:58:54<3:16:43,  3.63it/s]
 88%|████████▊ | 328645/371472 [3:58:54<3:15:56,  3.64it/s]
 88%|████████▊ | 328646/371472 [3:58:54<3:24:24,  3.49it/s]
 88%|████████▊ | 328647/371472 [3:58:55<3:22:23,  3.53it/s]
 88%|████████▊ | 328648/371472 [3:58:55<3:18:25,  3.60it/s]
 88%|████████▊ | 328649/371472 [3:58:55<3:23:29,  3.51it/s]
 88%|████████▊ | 328650/371472 [3:58:56<3:29:02,  3.41it/s]
 88%|████████▊ | 328651/371472 [3:58:56<3:19:02,  3.59it/s]
 88%|████████▊ | 328652/371472 [3:58:56<3:27:17,  3.44it/s]
 88%|████████▊ | 328653/371472 [3:58:56<3:18:52,  3.59it/s]
 88%|████████▊ | 328654/371472 [3:58:57<3:14:35,  3.67it/s]
 88%|████████▊ | 328655/371472 [3:58:57<3:25:12,  3.48it/s]
 88%|████████▊ | 328656/371472 [3:58:57<3:33:58,  3.33it/s]
 88%|████████▊ | 328657/371472 [3:58:58<3:41:11,  3.23it/s]
 88%|████████▊ | 328658/371472 [3:58:58<3:31:28,  3.37it/s]
 88%|████████▊ | 328659/371472 [3:58:58<3:20:45,  3.55it/s]
 88%|████████▊ | 328660/371472 [3:58:58<3:31:56,  3.37it/s]
                                                           
{'loss': 2.5828, 'learning_rate': 2.0378051671012088e-07, 'epoch': 14.16}

 88%|████████▊ | 328660/371472 [3:58:58<3:31:56,  3.37it/s]
 88%|████████▊ | 328661/371472 [3:58:59<3:29:28,  3.41it/s]
 88%|████████▊ | 328662/371472 [3:58:59<3:24:46,  3.48it/s]
 88%|████████▊ | 328663/371472 [3:58:59<3:16:19,  3.63it/s]
 88%|████████▊ | 328664/371472 [3:59:00<3:19:06,  3.58it/s]
 88%|████████▊ | 328665/371472 [3:59:00<3:12:56,  3.70it/s]
 88%|████████▊ | 328666/371472 [3:59:00<3:13:05,  3.69it/s]
 88%|████████▊ | 328667/371472 [3:59:00<3:11:30,  3.73it/s]
 88%|████████▊ | 328668/371472 [3:59:01<3:09:53,  3.76it/s]
 88%|████████▊ | 328669/371472 [3:59:01<3:17:58,  3.60it/s]
 88%|████████▊ | 328670/371472 [3:59:01<3:16:04,  3.64it/s]
 88%|████████▊ | 328671/371472 [3:59:01<3:20:59,  3.55it/s]
 88%|████████▊ | 328672/371472 [3:59:02<3:20:28,  3.56it/s]
 88%|████████▊ | 328673/371472 [3:59:02<3:26:10,  3.46it/s]
 88%|████████▊ | 328674/371472 [3:59:02<3:32:04,  3.36it/s]
 88%|████████▊ | 328675/371472 [3:59:03<3:37:38,  3.28it/s]
 88%|████████▊ | 328676/371472 [3:59:03<3:29:52,  3.40it/s]
 88%|████████▊ | 328677/371472 [3:59:03<3:28:50,  3.42it/s]
 88%|████████▊ | 328678/371472 [3:59:03<3:22:36,  3.52it/s]
 88%|████████▊ | 328679/371472 [3:59:04<3:34:04,  3.33it/s]
 88%|████████▊ | 328680/371472 [3:59:04<3:24:53,  3.48it/s]
                                                           
{'loss': 2.6503, 'learning_rate': 2.0373203473464195e-07, 'epoch': 14.16}

 88%|████████▊ | 328680/371472 [3:59:04<3:24:53,  3.48it/s]
 88%|████████▊ | 328681/371472 [3:59:04<3:22:18,  3.53it/s]
 88%|████████▊ | 328682/371472 [3:59:05<3:28:05,  3.43it/s]
 88%|████████▊ | 328683/371472 [3:59:05<3:20:01,  3.57it/s]
 88%|████████▊ | 328684/371472 [3:59:05<3:25:08,  3.48it/s]
 88%|████████▊ | 328685/371472 [3:59:05<3:19:03,  3.58it/s]
 88%|████████▊ | 328686/371472 [3:59:06<3:16:51,  3.62it/s]
 88%|████████▊ | 328687/371472 [3:59:06<3:21:17,  3.54it/s]
 88%|████████▊ | 328688/371472 [3:59:06<3:21:12,  3.54it/s]
 88%|████████▊ | 328689/371472 [3:59:07<3:15:45,  3.64it/s]
 88%|████████▊ | 328690/371472 [3:59:07<3:22:25,  3.52it/s]
 88%|████████▊ | 328691/371472 [3:59:07<3:13:37,  3.68it/s]
 88%|████████▊ | 328692/371472 [3:59:07<3:11:19,  3.73it/s]
 88%|████████▊ | 328693/371472 [3:59:08<3:11:11,  3.73it/s]
 88%|████████▊ | 328694/371472 [3:59:08<3:20:52,  3.55it/s]
 88%|████████▊ | 328695/371472 [3:59:08<3:18:02,  3.60it/s]
 88%|████████▊ | 328696/371472 [3:59:09<3:21:07,  3.54it/s]
 88%|████████▊ | 328697/371472 [3:59:09<3:29:33,  3.40it/s]
 88%|████████▊ | 328698/371472 [3:59:09<3:32:06,  3.36it/s]
 88%|████████▊ | 328699/371472 [3:59:09<3:25:35,  3.47it/s]
 88%|████████▊ | 328700/371472 [3:59:10<3:23:47,  3.50it/s]
                                                           
{'loss': 2.5059, 'learning_rate': 2.0368355275916313e-07, 'epoch': 14.16}

 88%|████████▊ | 328700/371472 [3:59:10<3:23:47,  3.50it/s]
 88%|████████▊ | 328701/371472 [3:59:10<3:24:18,  3.49it/s]
 88%|████████▊ | 328702/371472 [3:59:10<3:16:44,  3.62it/s]
 88%|████████▊ | 328703/371472 [3:59:11<3:12:07,  3.71it/s]
 88%|████████▊ | 328704/371472 [3:59:11<3:11:00,  3.73it/s]
 88%|████████▊ | 328705/371472 [3:59:11<3:14:05,  3.67it/s]
 88%|████████▊ | 328706/371472 [3:59:11<3:12:37,  3.70it/s]
 88%|████████▊ | 328707/371472 [3:59:12<3:06:53,  3.81it/s]
 88%|████████▊ | 328708/371472 [3:59:12<3:02:42,  3.90it/s]
 88%|████████▊ | 328709/371472 [3:59:12<3:27:05,  3.44it/s]
 88%|████████▊ | 328710/371472 [3:59:13<3:37:34,  3.28it/s]
 88%|████████▊ | 328711/371472 [3:59:13<3:31:17,  3.37it/s]
 88%|████████▊ | 328712/371472 [3:59:13<3:26:06,  3.46it/s]
 88%|████████▊ | 328713/371472 [3:59:13<3:25:44,  3.46it/s]
 88%|████████▊ | 328714/371472 [3:59:14<3:26:23,  3.45it/s]
 88%|████████▊ | 328715/371472 [3:59:14<3:39:27,  3.25it/s]
 88%|████████▊ | 328716/371472 [3:59:14<3:32:21,  3.36it/s]
 88%|████████▊ | 328717/371472 [3:59:15<3:37:40,  3.27it/s]
 88%|████████▊ | 328718/371472 [3:59:15<3:31:45,  3.36it/s]
 88%|████████▊ | 328719/371472 [3:59:15<3:22:12,  3.52it/s]
 88%|████████▊ | 328720/371472 [3:59:15<3:19:17,  3.58it/s]
                                                           
{'loss': 2.6934, 'learning_rate': 2.036350707836842e-07, 'epoch': 14.16}

 88%|████████▊ | 328720/371472 [3:59:15<3:19:17,  3.58it/s]
 88%|████████▊ | 328721/371472 [3:59:16<3:16:28,  3.63it/s]
 88%|████████▊ | 328722/371472 [3:59:16<3:13:19,  3.69it/s]
 88%|████████▊ | 328723/371472 [3:59:16<3:41:33,  3.22it/s]
 88%|████████▊ | 328724/371472 [3:59:17<3:31:00,  3.38it/s]
 88%|████████▊ | 328725/371472 [3:59:17<3:18:45,  3.58it/s]
 88%|████████▊ | 328726/371472 [3:59:17<3:27:04,  3.44it/s]
 88%|████████▊ | 328727/371472 [3:59:18<3:48:53,  3.11it/s]
 88%|████████▊ | 328728/371472 [3:59:18<3:47:55,  3.13it/s]
 88%|████████▊ | 328729/371472 [3:59:18<3:52:11,  3.07it/s]
 88%|████████▊ | 328730/371472 [3:59:18<3:36:38,  3.29it/s]
 88%|████████▊ | 328731/371472 [3:59:19<3:33:43,  3.33it/s]
 88%|████████▊ | 328732/371472 [3:59:19<3:26:01,  3.46it/s]
 88%|████████▊ | 328733/371472 [3:59:19<3:17:33,  3.61it/s]
 88%|████████▊ | 328734/371472 [3:59:20<3:16:01,  3.63it/s]
 88%|████████▊ | 328735/371472 [3:59:20<3:13:17,  3.69it/s]
 88%|████████▊ | 328736/371472 [3:59:20<3:06:54,  3.81it/s]
 88%|████████▊ | 328737/371472 [3:59:20<3:08:20,  3.78it/s]
 88%|████████▊ | 328738/371472 [3:59:21<3:05:13,  3.85it/s]
 88%|████████▊ | 328739/371472 [3:59:21<3:13:08,  3.69it/s]
 88%|████████▊ | 328740/371472 [3:59:21<3:17:40,  3.60it/s]
                                                           
{'loss': 2.5057, 'learning_rate': 2.0358658880820532e-07, 'epoch': 14.16}

 88%|████████▊ | 328740/371472 [3:59:21<3:17:40,  3.60it/s]
 88%|████████▊ | 328741/371472 [3:59:21<3:13:20,  3.68it/s]
 88%|████████▊ | 328742/371472 [3:59:22<3:25:34,  3.46it/s]
 88%|████████▊ | 328743/371472 [3:59:22<3:29:40,  3.40it/s]
 88%|████████▊ | 328744/371472 [3:59:22<3:25:32,  3.46it/s]
 88%|████████▊ | 328745/371472 [3:59:23<3:26:28,  3.45it/s]
 88%|████████▊ | 328746/371472 [3:59:23<3:22:42,  3.51it/s]
 88%|████████▊ | 328747/371472 [3:59:23<3:28:30,  3.42it/s]
 88%|████████▊ | 328748/371472 [3:59:23<3:23:00,  3.51it/s]
 88%|████████▊ | 328749/371472 [3:59:24<3:22:22,  3.52it/s]
 88%|████████▊ | 328750/371472 [3:59:24<3:17:17,  3.61it/s]
 88%|████████▊ | 328751/371472 [3:59:24<3:14:23,  3.66it/s]
 88%|████████▊ | 328752/371472 [3:59:25<3:17:27,  3.61it/s]
 89%|████████▊ | 328753/371472 [3:59:25<3:20:44,  3.55it/s]
 89%|████████▊ | 328754/371472 [3:59:25<3:20:20,  3.55it/s]
 89%|████████▊ | 328755/371472 [3:59:25<3:17:33,  3.60it/s]
 89%|████████▊ | 328756/371472 [3:59:26<3:15:24,  3.64it/s]
 89%|████████▊ | 328757/371472 [3:59:26<3:13:43,  3.67it/s]
 89%|████████▊ | 328758/371472 [3:59:26<3:19:56,  3.56it/s]
 89%|████████▊ | 328759/371472 [3:59:27<3:22:55,  3.51it/s]
 89%|████████▊ | 328760/371472 [3:59:27<3:23:16,  3.50it/s]
                                                           
{'loss': 2.57, 'learning_rate': 2.035381068327264e-07, 'epoch': 14.16}

 89%|████████▊ | 328760/371472 [3:59:27<3:23:16,  3.50it/s]
 89%|████████▊ | 328761/371472 [3:59:27<3:21:14,  3.54it/s]
 89%|████████▊ | 328762/371472 [3:59:27<3:14:05,  3.67it/s]
 89%|████████▊ | 328763/371472 [3:59:28<3:10:59,  3.73it/s]
 89%|████████▊ | 328764/371472 [3:59:28<3:17:43,  3.60it/s]
 89%|████████▊ | 328765/371472 [3:59:28<3:25:55,  3.46it/s]
 89%|████████▊ | 328766/371472 [3:59:29<3:30:50,  3.38it/s]
 89%|████████▊ | 328767/371472 [3:59:29<3:25:40,  3.46it/s]
 89%|████████▊ | 328768/371472 [3:59:29<3:33:35,  3.33it/s]
 89%|████████▊ | 328769/371472 [3:59:29<3:27:59,  3.42it/s]
 89%|████████▊ | 328770/371472 [3:59:30<3:46:26,  3.14it/s]
 89%|████████▊ | 328771/371472 [3:59:30<3:42:28,  3.20it/s]
 89%|████████▊ | 328772/371472 [3:59:30<3:33:53,  3.33it/s]
 89%|████████▊ | 328773/371472 [3:59:31<3:45:10,  3.16it/s]
 89%|████████▊ | 328774/371472 [3:59:31<3:36:37,  3.29it/s]
 89%|████████▊ | 328775/371472 [3:59:31<3:31:47,  3.36it/s]
 89%|████████▊ | 328776/371472 [3:59:31<3:23:34,  3.50it/s]
 89%|████████▊ | 328777/371472 [3:59:32<3:28:42,  3.41it/s]
 89%|████████▊ | 328778/371472 [3:59:32<3:35:00,  3.31it/s]
 89%|████████▊ | 328779/371472 [3:59:32<3:28:13,  3.42it/s]
 89%|████████▊ | 328780/371472 [3:59:33<3:21:01,  3.54it/s]
                                                           
{'loss': 2.5908, 'learning_rate': 2.0348962485724757e-07, 'epoch': 14.16}

 89%|████████▊ | 328780/371472 [3:59:33<3:21:01,  3.54it/s]
 89%|████████▊ | 328781/371472 [3:59:33<3:14:01,  3.67it/s]
 89%|████████▊ | 328782/371472 [3:59:33<3:13:59,  3.67it/s]
 89%|████████▊ | 328783/371472 [3:59:33<3:09:23,  3.76it/s]
 89%|████████▊ | 328784/371472 [3:59:34<3:09:24,  3.76it/s]
 89%|████████▊ | 328785/371472 [3:59:34<3:09:36,  3.75it/s]
 89%|████████▊ | 328786/371472 [3:59:34<3:21:57,  3.52it/s]
 89%|████████▊ | 328787/371472 [3:59:35<3:24:13,  3.48it/s]
 89%|████████▊ | 328788/371472 [3:59:35<3:24:27,  3.48it/s]
 89%|████████▊ | 328789/371472 [3:59:35<3:21:46,  3.53it/s]
 89%|████████▊ | 328790/371472 [3:59:35<3:19:58,  3.56it/s]
 89%|████████▊ | 328791/371472 [3:59:36<3:14:52,  3.65it/s]
 89%|████████▊ | 328792/371472 [3:59:36<3:22:21,  3.52it/s]
 89%|████████▊ | 328793/371472 [3:59:36<3:25:11,  3.47it/s]
 89%|████████▊ | 328794/371472 [3:59:37<3:25:36,  3.46it/s]
 89%|████████▊ | 328795/371472 [3:59:37<3:17:35,  3.60it/s]
 89%|████████▊ | 328796/371472 [3:59:37<3:14:25,  3.66it/s]
 89%|████████▊ | 328797/371472 [3:59:37<3:10:36,  3.73it/s]
 89%|████████▊ | 328798/371472 [3:59:38<3:11:21,  3.72it/s]
 89%|████████▊ | 328799/371472 [3:59:38<3:10:37,  3.73it/s]
 89%|████████▊ | 328800/371472 [3:59:38<3:35:44,  3.30it/s]
                                                           
{'loss': 2.6793, 'learning_rate': 2.0344114288176862e-07, 'epoch': 14.16}

 89%|████████▊ | 328800/371472 [3:59:38<3:35:44,  3.30it/s]
 89%|████████▊ | 328801/371472 [3:59:39<3:27:46,  3.42it/s]
 89%|████████▊ | 328802/371472 [3:59:39<3:24:23,  3.48it/s]
 89%|████████▊ | 328803/371472 [3:59:39<3:37:09,  3.27it/s]
 89%|████████▊ | 328804/371472 [3:59:39<3:29:15,  3.40it/s]
 89%|████████▊ | 328805/371472 [3:59:40<3:17:46,  3.60it/s]
 89%|████████▊ | 328806/371472 [3:59:40<3:25:22,  3.46it/s]
 89%|████████▊ | 328807/371472 [3:59:40<3:33:32,  3.33it/s]
 89%|████████▊ | 328808/371472 [3:59:41<3:25:20,  3.46it/s]
 89%|████████▊ | 328809/371472 [3:59:41<3:26:35,  3.44it/s]
 89%|████████▊ | 328810/371472 [3:59:41<3:39:09,  3.24it/s]
 89%|████████▊ | 328811/371472 [3:59:41<3:31:14,  3.37it/s]
 89%|████████▊ | 328812/371472 [3:59:42<3:30:52,  3.37it/s]
 89%|████████▊ | 328813/371472 [3:59:42<3:35:52,  3.29it/s]
 89%|████████▊ | 328814/371472 [3:59:42<3:29:38,  3.39it/s]
 89%|████████▊ | 328815/371472 [3:59:43<3:25:35,  3.46it/s]
 89%|████████▊ | 328816/371472 [3:59:43<3:24:29,  3.48it/s]
 89%|████████▊ | 328817/371472 [3:59:43<3:16:31,  3.62it/s]
 89%|████████▊ | 328818/371472 [3:59:44<3:33:20,  3.33it/s]
 89%|████████▊ | 328819/371472 [3:59:44<3:33:45,  3.33it/s]
 89%|████████▊ | 328820/371472 [3:59:44<3:26:04,  3.45it/s]
                                                           
{'loss': 2.6085, 'learning_rate': 2.0339266090628966e-07, 'epoch': 14.16}

 89%|████████▊ | 328820/371472 [3:59:44<3:26:04,  3.45it/s]
 89%|████████▊ | 328821/371472 [3:59:44<3:25:52,  3.45it/s]
 89%|████████▊ | 328822/371472 [3:59:45<3:23:51,  3.49it/s]
 89%|████████▊ | 328823/371472 [3:59:45<3:25:51,  3.45it/s]
 89%|████████▊ | 328824/371472 [3:59:45<3:22:58,  3.50it/s]
 89%|████████▊ | 328825/371472 [3:59:46<3:23:54,  3.49it/s]
 89%|████████▊ | 328826/371472 [3:59:46<3:25:55,  3.45it/s]
 89%|████████▊ | 328827/371472 [3:59:46<3:21:18,  3.53it/s]
 89%|████████▊ | 328828/371472 [3:59:46<3:14:27,  3.66it/s]
 89%|████████▊ | 328829/371472 [3:59:47<3:21:13,  3.53it/s]
 89%|████████▊ | 328830/371472 [3:59:47<3:41:41,  3.21it/s]
 89%|████████▊ | 328831/371472 [3:59:47<3:36:07,  3.29it/s]
 89%|████████▊ | 328832/371472 [3:59:48<3:29:56,  3.39it/s]
 89%|████████▊ | 328833/371472 [3:59:48<3:33:01,  3.34it/s]
 89%|████████▊ | 328834/371472 [3:59:48<3:35:56,  3.29it/s]
 89%|████████▊ | 328835/371472 [3:59:49<3:37:40,  3.26it/s]
 89%|████████▊ | 328836/371472 [3:59:49<3:35:22,  3.30it/s]
 89%|████████▊ | 328837/371472 [3:59:49<3:26:37,  3.44it/s]
 89%|████████▊ | 328838/371472 [3:59:49<3:29:48,  3.39it/s]
 89%|████████▊ | 328839/371472 [3:59:50<3:26:37,  3.44it/s]
 89%|████████▊ | 328840/371472 [3:59:50<3:19:44,  3.56it/s]
                                                           
{'loss': 2.5505, 'learning_rate': 2.0334417893081084e-07, 'epoch': 14.16}

 89%|████████▊ | 328840/371472 [3:59:50<3:19:44,  3.56it/s]
 89%|████████▊ | 328841/371472 [3:59:50<3:20:47,  3.54it/s]
 89%|████████▊ | 328842/371472 [3:59:51<3:22:11,  3.51it/s]
 89%|████████▊ | 328843/371472 [3:59:51<3:18:54,  3.57it/s]
 89%|████████▊ | 328844/371472 [3:59:51<3:18:22,  3.58it/s]
 89%|████████▊ | 328845/371472 [3:59:51<3:18:40,  3.58it/s]
 89%|████████▊ | 328846/371472 [3:59:52<3:13:37,  3.67it/s]
 89%|████████▊ | 328847/371472 [3:59:52<3:18:19,  3.58it/s]
 89%|████████▊ | 328848/371472 [3:59:52<3:33:04,  3.33it/s]
 89%|████████▊ | 328849/371472 [3:59:53<3:32:28,  3.34it/s]
 89%|████████▊ | 328850/371472 [3:59:53<3:27:16,  3.43it/s]
 89%|████████▊ | 328851/371472 [3:59:53<3:25:39,  3.45it/s]
 89%|████████▊ | 328852/371472 [3:59:53<3:23:24,  3.49it/s]
 89%|████████▊ | 328853/371472 [3:59:54<3:26:48,  3.43it/s]
 89%|████████▊ | 328854/371472 [3:59:54<3:37:51,  3.26it/s]
 89%|████████▊ | 328855/371472 [3:59:54<3:26:04,  3.45it/s]
 89%|████████▊ | 328856/371472 [3:59:55<3:19:17,  3.56it/s]
 89%|████████▊ | 328857/371472 [3:59:55<3:18:37,  3.58it/s]
 89%|████████▊ | 328858/371472 [3:59:55<3:17:40,  3.59it/s]
 89%|████████▊ | 328859/371472 [3:59:55<3:18:32,  3.58it/s]
 89%|████████▊ | 328860/371472 [3:59:56<3:12:20,  3.69it/s]
                                                           
{'loss': 2.7867, 'learning_rate': 2.0329569695533189e-07, 'epoch': 14.16}

 89%|████████▊ | 328860/371472 [3:59:56<3:12:20,  3.69it/s]
 89%|████████▊ | 328861/371472 [3:59:56<3:16:48,  3.61it/s]
 89%|████████▊ | 328862/371472 [3:59:56<3:16:47,  3.61it/s]
 89%|████████▊ | 328863/371472 [3:59:57<3:25:45,  3.45it/s]
 89%|████████▊ | 328864/371472 [3:59:57<3:21:13,  3.53it/s]
 89%|████████▊ | 328865/371472 [3:59:57<3:29:00,  3.40it/s]
 89%|████████▊ | 328866/371472 [3:59:57<3:25:35,  3.45it/s]
 89%|████████▊ | 328867/371472 [3:59:58<3:26:18,  3.44it/s]
 89%|████████▊ | 328868/371472 [3:59:58<3:33:09,  3.33it/s]
 89%|████████▊ | 328869/371472 [3:59:58<3:26:02,  3.45it/s]
 89%|████████▊ | 328870/371472 [3:59:59<3:19:23,  3.56it/s]
 89%|████████▊ | 328871/371472 [3:59:59<3:32:57,  3.33it/s]
 89%|████████▊ | 328872/371472 [3:59:59<3:35:09,  3.30it/s]
 89%|████████▊ | 328873/371472 [3:59:59<3:37:35,  3.26it/s]
 89%|████████▊ | 328874/371472 [4:00:00<3:29:19,  3.39it/s]
 89%|████████▊ | 328875/371472 [4:00:00<3:41:32,  3.20it/s]
 89%|████████▊ | 328876/371472 [4:00:00<3:30:36,  3.37it/s]
 89%|████████▊ | 328877/371472 [4:00:01<3:27:26,  3.42it/s]
 89%|████████▊ | 328878/371472 [4:00:01<3:26:58,  3.43it/s]
 89%|████████▊ | 328879/371472 [4:00:01<3:19:25,  3.56it/s]
 89%|████████▊ | 328880/371472 [4:00:02<3:29:42,  3.39it/s]
                                                           
{'loss': 2.7212, 'learning_rate': 2.0324721497985304e-07, 'epoch': 14.17}

 89%|████████▊ | 328880/371472 [4:00:02<3:29:42,  3.39it/s]
 89%|████████▊ | 328881/371472 [4:00:02<3:21:01,  3.53it/s]
 89%|████████▊ | 328882/371472 [4:00:02<3:26:49,  3.43it/s]
 89%|████████▊ | 328883/371472 [4:00:02<3:19:37,  3.56it/s]
 89%|████████▊ | 328884/371472 [4:00:03<3:14:43,  3.65it/s]
 89%|████████▊ | 328885/371472 [4:00:03<3:24:40,  3.47it/s]
 89%|████████▊ | 328886/371472 [4:00:03<3:15:28,  3.63it/s]
 89%|████████▊ | 328887/371472 [4:00:04<3:31:40,  3.35it/s]
 89%|████████▊ | 328888/371472 [4:00:04<3:33:26,  3.33it/s]
 89%|████████▊ | 328889/371472 [4:00:04<3:32:00,  3.35it/s]
 89%|████████▊ | 328890/371472 [4:00:04<3:29:16,  3.39it/s]
 89%|████████▊ | 328891/371472 [4:00:05<3:25:26,  3.45it/s]
 89%|████████▊ | 328892/371472 [4:00:05<3:19:58,  3.55it/s]
 89%|████████▊ | 328893/371472 [4:00:05<3:20:20,  3.54it/s]
 89%|████████▊ | 328894/371472 [4:00:06<3:22:06,  3.51it/s]
 89%|████████▊ | 328895/371472 [4:00:06<3:27:24,  3.42it/s]
 89%|████████▊ | 328896/371472 [4:00:06<3:42:42,  3.19it/s]
 89%|████████▊ | 328897/371472 [4:00:06<3:34:30,  3.31it/s]
 89%|████████▊ | 328898/371472 [4:00:07<3:33:11,  3.33it/s]
 89%|████████▊ | 328899/371472 [4:00:07<3:28:33,  3.40it/s]
 89%|████████▊ | 328900/371472 [4:00:07<3:45:26,  3.15it/s]
                                                           
{'loss': 2.5915, 'learning_rate': 2.031987330043741e-07, 'epoch': 14.17}

 89%|████████▊ | 328900/371472 [4:00:07<3:45:26,  3.15it/s]
 89%|████████▊ | 328901/371472 [4:00:08<3:35:43,  3.29it/s]
 89%|████████▊ | 328902/371472 [4:00:08<3:35:07,  3.30it/s]
 89%|████████▊ | 328903/371472 [4:00:08<3:31:52,  3.35it/s]
 89%|████████▊ | 328904/371472 [4:00:09<3:22:36,  3.50it/s]
 89%|████████▊ | 328905/371472 [4:00:09<3:35:13,  3.30it/s]
 89%|████████▊ | 328906/371472 [4:00:09<3:31:54,  3.35it/s]
 89%|████████▊ | 328907/371472 [4:00:10<3:42:05,  3.19it/s]
 89%|████████▊ | 328908/371472 [4:00:10<3:33:45,  3.32it/s]
 89%|████████▊ | 328909/371472 [4:00:10<3:36:09,  3.28it/s]
 89%|████████▊ | 328910/371472 [4:00:10<3:30:27,  3.37it/s]
 89%|████████▊ | 328911/371472 [4:00:11<3:24:36,  3.47it/s]
 89%|████████▊ | 328912/371472 [4:00:11<3:17:33,  3.59it/s]
 89%|████████▊ | 328913/371472 [4:00:11<3:22:38,  3.50it/s]
 89%|████████▊ | 328914/371472 [4:00:11<3:18:08,  3.58it/s]
 89%|████████▊ | 328915/371472 [4:00:12<3:22:14,  3.51it/s]
 89%|████████▊ | 328916/371472 [4:00:12<3:15:56,  3.62it/s]
 89%|████████▊ | 328917/371472 [4:00:12<3:14:46,  3.64it/s]
 89%|████████▊ | 328918/371472 [4:00:13<3:14:24,  3.65it/s]
 89%|████████▊ | 328919/371472 [4:00:13<3:16:17,  3.61it/s]
 89%|████████▊ | 328920/371472 [4:00:13<3:13:19,  3.67it/s]
                                                           
{'loss': 2.5987, 'learning_rate': 2.0315025102889526e-07, 'epoch': 14.17}

 89%|████████▊ | 328920/371472 [4:00:13<3:13:19,  3.67it/s]
 89%|████████▊ | 328921/371472 [4:00:13<3:16:44,  3.60it/s]
 89%|████████▊ | 328922/371472 [4:00:14<3:13:31,  3.66it/s]
 89%|████████▊ | 328923/371472 [4:00:14<3:08:54,  3.75it/s]
 89%|████████▊ | 328924/371472 [4:00:14<3:07:25,  3.78it/s]
 89%|████████▊ | 328925/371472 [4:00:14<3:14:48,  3.64it/s]
 89%|████████▊ | 328926/371472 [4:00:15<3:10:22,  3.72it/s]
 89%|████████▊ | 328927/371472 [4:00:15<3:05:56,  3.81it/s]
 89%|████████▊ | 328928/371472 [4:00:15<3:05:21,  3.83it/s]
 89%|████████▊ | 328929/371472 [4:00:16<3:06:37,  3.80it/s]
 89%|████████▊ | 328930/371472 [4:00:16<3:04:39,  3.84it/s]
 89%|████████▊ | 328931/371472 [4:00:16<3:11:32,  3.70it/s]
 89%|████████▊ | 328932/371472 [4:00:16<3:16:36,  3.61it/s]
 89%|████████▊ | 328933/371472 [4:00:17<3:14:19,  3.65it/s]
 89%|████████▊ | 328934/371472 [4:00:17<3:23:55,  3.48it/s]
 89%|████████▊ | 328935/371472 [4:00:17<3:25:22,  3.45it/s]
 89%|████████▊ | 328936/371472 [4:00:18<3:23:00,  3.49it/s]
 89%|████████▊ | 328937/371472 [4:00:18<3:26:32,  3.43it/s]
 89%|████████▊ | 328938/371472 [4:00:18<3:31:50,  3.35it/s]
 89%|████████▊ | 328939/371472 [4:00:18<3:17:53,  3.58it/s]
 89%|████████▊ | 328940/371472 [4:00:19<3:14:12,  3.65it/s]
                                                           
{'loss': 2.5591, 'learning_rate': 2.031017690534163e-07, 'epoch': 14.17}

 89%|████████▊ | 328940/371472 [4:00:19<3:14:12,  3.65it/s]
 89%|████████▊ | 328941/371472 [4:00:19<3:14:07,  3.65it/s]
 89%|████████▊ | 328942/371472 [4:00:19<3:16:32,  3.61it/s]
 89%|████████▊ | 328943/371472 [4:00:19<3:13:17,  3.67it/s]
 89%|████████▊ | 328944/371472 [4:00:20<3:19:20,  3.56it/s]
 89%|████████▊ | 328945/371472 [4:00:20<3:14:23,  3.65it/s]
 89%|████████▊ | 328946/371472 [4:00:20<3:14:06,  3.65it/s]
 89%|████████▊ | 328947/371472 [4:00:21<3:11:04,  3.71it/s]
 89%|████████▊ | 328948/371472 [4:00:21<3:09:44,  3.74it/s]
 89%|████████▊ | 328949/371472 [4:00:21<3:07:13,  3.79it/s]
 89%|████████▊ | 328950/371472 [4:00:21<3:25:37,  3.45it/s]
 89%|████████▊ | 328951/371472 [4:00:22<3:22:38,  3.50it/s]
 89%|████████▊ | 328952/371472 [4:00:22<3:28:06,  3.41it/s]
 89%|████████▊ | 328953/371472 [4:00:22<3:27:38,  3.41it/s]
 89%|████████▊ | 328954/371472 [4:00:23<3:21:55,  3.51it/s]
 89%|████████▊ | 328955/371472 [4:00:23<3:38:04,  3.25it/s]
 89%|████████▊ | 328956/371472 [4:00:23<3:29:47,  3.38it/s]
 89%|████████▊ | 328957/371472 [4:00:23<3:25:00,  3.46it/s]
 89%|████████▊ | 328958/371472 [4:00:24<3:20:39,  3.53it/s]
 89%|████████▊ | 328959/371472 [4:00:24<3:17:24,  3.59it/s]
 89%|████████▊ | 328960/371472 [4:00:24<3:18:44,  3.57it/s]
                                                           
{'loss': 2.5458, 'learning_rate': 2.0305328707793748e-07, 'epoch': 14.17}

 89%|████████▊ | 328960/371472 [4:00:24<3:18:44,  3.57it/s]
 89%|████████▊ | 328961/371472 [4:00:25<3:20:25,  3.53it/s]
 89%|████████▊ | 328962/371472 [4:00:25<3:26:09,  3.44it/s]
 89%|████████▊ | 328963/371472 [4:00:25<3:38:39,  3.24it/s]
 89%|████████▊ | 328964/371472 [4:00:25<3:26:39,  3.43it/s]
 89%|████████▊ | 328965/371472 [4:00:26<3:18:21,  3.57it/s]
 89%|████████▊ | 328966/371472 [4:00:26<3:16:12,  3.61it/s]
 89%|████████▊ | 328967/371472 [4:00:26<3:28:49,  3.39it/s]
 89%|████████▊ | 328968/371472 [4:00:27<3:27:50,  3.41it/s]
 89%|████████▊ | 328969/371472 [4:00:27<3:25:56,  3.44it/s]
 89%|████████▊ | 328970/371472 [4:00:27<3:40:57,  3.21it/s]
 89%|████████▊ | 328971/371472 [4:00:28<3:29:05,  3.39it/s]
 89%|████████▊ | 328972/371472 [4:00:28<3:36:37,  3.27it/s]
 89%|████████▊ | 328973/371472 [4:00:28<3:30:30,  3.36it/s]
 89%|████████▊ | 328974/371472 [4:00:28<3:24:26,  3.46it/s]
 89%|████████▊ | 328975/371472 [4:00:29<3:16:22,  3.61it/s]
 89%|████████▊ | 328976/371472 [4:00:29<3:29:16,  3.38it/s]
 89%|████████▊ | 328977/371472 [4:00:29<3:20:35,  3.53it/s]
 89%|████████▊ | 328978/371472 [4:00:30<3:21:50,  3.51it/s]
 89%|████████▊ | 328979/371472 [4:00:30<3:12:09,  3.69it/s]
 89%|████████▊ | 328980/371472 [4:00:30<3:13:45,  3.66it/s]
                                                           
{'loss': 2.6632, 'learning_rate': 2.0300480510245853e-07, 'epoch': 14.17}

 89%|████████▊ | 328980/371472 [4:00:30<3:13:45,  3.66it/s]
 89%|████████▊ | 328981/371472 [4:00:30<3:15:04,  3.63it/s]
 89%|████████▊ | 328982/371472 [4:00:31<3:07:00,  3.79it/s]
 89%|████████▊ | 328983/371472 [4:00:31<3:09:25,  3.74it/s]
 89%|████████▊ | 328984/371472 [4:00:31<3:15:10,  3.63it/s]
 89%|████████▊ | 328985/371472 [4:00:31<3:20:21,  3.53it/s]
 89%|████████▊ | 328986/371472 [4:00:32<3:24:56,  3.46it/s]
 89%|████████▊ | 328987/371472 [4:00:32<3:19:30,  3.55it/s]
 89%|████████▊ | 328988/371472 [4:00:32<3:12:14,  3.68it/s]
 89%|████████▊ | 328989/371472 [4:00:33<3:12:13,  3.68it/s]
 89%|████████▊ | 328990/371472 [4:00:33<3:10:36,  3.71it/s]
 89%|████████▊ | 328991/371472 [4:00:33<3:10:57,  3.71it/s]
 89%|████████▊ | 328992/371472 [4:00:33<3:09:11,  3.74it/s]
 89%|████████▊ | 328993/371472 [4:00:34<3:12:53,  3.67it/s]
 89%|████████▊ | 328994/371472 [4:00:34<3:23:05,  3.49it/s]
 89%|████████▊ | 328995/371472 [4:00:34<3:34:37,  3.30it/s]
 89%|████████▊ | 328996/371472 [4:00:35<3:27:09,  3.42it/s]
 89%|████████▊ | 328997/371472 [4:00:35<3:28:03,  3.40it/s]
 89%|████████▊ | 328998/371472 [4:00:35<3:19:17,  3.55it/s]
 89%|████████▊ | 328999/371472 [4:00:35<3:32:55,  3.32it/s]
 89%|████████▊ | 329000/371472 [4:00:36<3:31:52,  3.34it/s]
                                                           
{'loss': 2.6286, 'learning_rate': 2.0295632312697968e-07, 'epoch': 14.17}

 89%|████████▊ | 329000/371472 [4:00:36<3:31:52,  3.34it/s]
 89%|████████▊ | 329001/371472 [4:00:36<3:26:06,  3.43it/s]
 89%|████████▊ | 329002/371472 [4:00:36<3:24:20,  3.46it/s]
 89%|████████▊ | 329003/371472 [4:00:37<3:34:28,  3.30it/s]
 89%|████████▊ | 329004/371472 [4:00:37<3:38:49,  3.23it/s]
 89%|████████▊ | 329005/371472 [4:00:37<3:28:52,  3.39it/s]
 89%|████████▊ | 329006/371472 [4:00:37<3:20:09,  3.54it/s]
 89%|████████▊ | 329007/371472 [4:00:38<3:21:06,  3.52it/s]
 89%|████████▊ | 329008/371472 [4:00:38<3:19:55,  3.54it/s]
 89%|████████▊ | 329009/371472 [4:00:38<3:21:12,  3.52it/s]
 89%|████████▊ | 329010/371472 [4:00:39<3:15:58,  3.61it/s]
 89%|████████▊ | 329011/371472 [4:00:39<3:19:13,  3.55it/s]
 89%|████████▊ | 329012/371472 [4:00:39<3:14:18,  3.64it/s]
 89%|████████▊ | 329013/371472 [4:00:39<3:17:09,  3.59it/s]
 89%|████████▊ | 329014/371472 [4:00:40<3:19:06,  3.55it/s]
 89%|████████▊ | 329015/371472 [4:00:40<3:20:36,  3.53it/s]
 89%|████████▊ | 329016/371472 [4:00:40<3:14:03,  3.65it/s]
 89%|████████▊ | 329017/371472 [4:00:41<3:22:03,  3.50it/s]
 89%|████████▊ | 329018/371472 [4:00:41<3:27:00,  3.42it/s]
 89%|████████▊ | 329019/371472 [4:00:41<3:30:30,  3.36it/s]
 89%|████████▊ | 329020/371472 [4:00:41<3:30:18,  3.36it/s]
                                                           
{'loss': 2.4723, 'learning_rate': 2.0290784115150075e-07, 'epoch': 14.17}

 89%|████████▊ | 329020/371472 [4:00:41<3:30:18,  3.36it/s]
 89%|████████▊ | 329021/371472 [4:00:42<3:24:49,  3.45it/s]
 89%|████████▊ | 329022/371472 [4:00:42<3:23:19,  3.48it/s]
 89%|████████▊ | 329023/371472 [4:00:42<3:26:20,  3.43it/s]
 89%|████████▊ | 329024/371472 [4:00:43<3:23:02,  3.48it/s]
 89%|████████▊ | 329025/371472 [4:00:43<3:16:47,  3.59it/s]
 89%|████████▊ | 329026/371472 [4:00:43<3:10:20,  3.72it/s]
 89%|████████▊ | 329027/371472 [4:00:43<3:08:16,  3.76it/s]
 89%|████████▊ | 329028/371472 [4:00:44<3:19:43,  3.54it/s]
 89%|████████▊ | 329029/371472 [4:00:44<3:19:48,  3.54it/s]
 89%|████████▊ | 329030/371472 [4:00:44<3:26:48,  3.42it/s]
 89%|████████▊ | 329031/371472 [4:00:45<3:17:31,  3.58it/s]
 89%|████████▊ | 329032/371472 [4:00:45<3:19:22,  3.55it/s]
 89%|████████▊ | 329033/371472 [4:00:45<3:19:36,  3.54it/s]
 89%|████████▊ | 329034/371472 [4:00:45<3:25:14,  3.45it/s]
 89%|████████▊ | 329035/371472 [4:00:46<3:19:48,  3.54it/s]
 89%|████████▊ | 329036/371472 [4:00:46<3:15:34,  3.62it/s]
 89%|████████▊ | 329037/371472 [4:00:46<3:17:00,  3.59it/s]
 89%|████████▊ | 329038/371472 [4:00:47<3:19:13,  3.55it/s]
 89%|████████▊ | 329039/371472 [4:00:47<3:13:42,  3.65it/s]
 89%|████████▊ | 329040/371472 [4:00:47<3:36:20,  3.27it/s]
                                                           
{'loss': 2.6061, 'learning_rate': 2.028593591760219e-07, 'epoch': 14.17}

 89%|████████▊ | 329040/371472 [4:00:47<3:36:20,  3.27it/s]
 89%|████████▊ | 329041/371472 [4:00:48<3:55:01,  3.01it/s]
 89%|████████▊ | 329042/371472 [4:00:48<3:39:23,  3.22it/s]
 89%|████████▊ | 329043/371472 [4:00:48<3:36:48,  3.26it/s]
 89%|████████▊ | 329044/371472 [4:00:48<3:27:39,  3.41it/s]
 89%|████████▊ | 329045/371472 [4:00:49<3:30:31,  3.36it/s]
 89%|████████▊ | 329046/371472 [4:00:49<3:21:17,  3.51it/s]
 89%|████████▊ | 329047/371472 [4:00:49<3:18:11,  3.57it/s]
 89%|████████▊ | 329048/371472 [4:00:49<3:13:55,  3.65it/s]
 89%|████████▊ | 329049/371472 [4:00:50<3:31:15,  3.35it/s]
 89%|████████▊ | 329050/371472 [4:00:50<3:24:21,  3.46it/s]
 89%|████████▊ | 329051/371472 [4:00:50<3:16:32,  3.60it/s]
 89%|████████▊ | 329052/371472 [4:00:51<3:12:05,  3.68it/s]
 89%|████████▊ | 329053/371472 [4:00:51<3:08:50,  3.74it/s]
 89%|████████▊ | 329054/371472 [4:00:51<3:08:17,  3.75it/s]
 89%|████████▊ | 329055/371472 [4:00:51<3:09:58,  3.72it/s]
 89%|████████▊ | 329056/371472 [4:00:52<3:13:14,  3.66it/s]
 89%|████████▊ | 329057/371472 [4:00:52<3:23:54,  3.47it/s]
 89%|████████▊ | 329058/371472 [4:00:52<3:28:56,  3.38it/s]
 89%|████████▊ | 329059/371472 [4:00:53<3:39:16,  3.22it/s]
 89%|████████▊ | 329060/371472 [4:00:53<3:26:38,  3.42it/s]
                                                           
{'loss': 2.5959, 'learning_rate': 2.0281087720054294e-07, 'epoch': 14.17}

 89%|████████▊ | 329060/371472 [4:00:53<3:26:38,  3.42it/s]
 89%|████████▊ | 329061/371472 [4:00:53<3:22:19,  3.49it/s]
 89%|████████▊ | 329062/371472 [4:00:54<3:39:42,  3.22it/s]
 89%|████████▊ | 329063/371472 [4:00:54<3:27:31,  3.41it/s]
 89%|████████▊ | 329064/371472 [4:00:54<3:38:15,  3.24it/s]
 89%|████████▊ | 329065/371472 [4:00:54<3:28:54,  3.38it/s]
 89%|████████▊ | 329066/371472 [4:00:55<3:24:32,  3.46it/s]
 89%|████████▊ | 329067/371472 [4:00:55<3:35:01,  3.29it/s]
 89%|████████▊ | 329068/371472 [4:00:55<3:36:20,  3.27it/s]
 89%|████████▊ | 329069/371472 [4:00:56<3:30:03,  3.36it/s]
 89%|████████▊ | 329070/371472 [4:00:56<3:26:46,  3.42it/s]
 89%|████████▊ | 329071/371472 [4:00:56<3:28:37,  3.39it/s]
 89%|████████▊ | 329072/371472 [4:00:56<3:21:48,  3.50it/s]
 89%|████████▊ | 329073/371472 [4:00:57<3:16:12,  3.60it/s]
 89%|████████▊ | 329074/371472 [4:00:57<3:26:58,  3.41it/s]
 89%|████████▊ | 329075/371472 [4:00:57<3:43:50,  3.16it/s]
 89%|████████▊ | 329076/371472 [4:00:58<3:44:11,  3.15it/s]
 89%|████████▊ | 329077/371472 [4:00:58<3:38:04,  3.24it/s]
 89%|████████▊ | 329078/371472 [4:00:58<3:29:12,  3.38it/s]
 89%|████████▊ | 329079/371472 [4:00:59<3:19:24,  3.54it/s]
 89%|████████▊ | 329080/371472 [4:00:59<3:19:59,  3.53it/s]
                                                           
{'loss': 2.6348, 'learning_rate': 2.0276239522506412e-07, 'epoch': 14.17}

 89%|████████▊ | 329080/371472 [4:00:59<3:19:59,  3.53it/s]
 89%|████████▊ | 329081/371472 [4:00:59<3:19:57,  3.53it/s]
 89%|████████▊ | 329082/371472 [4:00:59<3:14:42,  3.63it/s]
 89%|████████▊ | 329083/371472 [4:01:00<3:12:02,  3.68it/s]
 89%|████████▊ | 329084/371472 [4:01:00<3:25:53,  3.43it/s]
 89%|████████▊ | 329085/371472 [4:01:00<3:22:31,  3.49it/s]
 89%|████████▊ | 329086/371472 [4:01:00<3:17:12,  3.58it/s]
 89%|████████▊ | 329087/371472 [4:01:01<3:13:23,  3.65it/s]
 89%|████████▊ | 329088/371472 [4:01:01<3:13:08,  3.66it/s]
 89%|████████▊ | 329089/371472 [4:01:01<3:16:46,  3.59it/s]
 89%|████████▊ | 329090/371472 [4:01:02<3:14:01,  3.64it/s]
 89%|████████▊ | 329091/371472 [4:01:02<3:11:40,  3.69it/s]
 89%|████████▊ | 329092/371472 [4:01:02<3:15:52,  3.61it/s]
 89%|████████▊ | 329093/371472 [4:01:02<3:17:01,  3.59it/s]
 89%|████████▊ | 329094/371472 [4:01:03<3:11:46,  3.68it/s]
 89%|████████▊ | 329095/371472 [4:01:03<3:15:28,  3.61it/s]
 89%|████████▊ | 329096/371472 [4:01:03<3:15:32,  3.61it/s]
 89%|████████▊ | 329097/371472 [4:01:03<3:12:43,  3.66it/s]
 89%|████████▊ | 329098/371472 [4:01:04<3:28:25,  3.39it/s]
 89%|████████▊ | 329099/371472 [4:01:04<3:23:19,  3.47it/s]
 89%|████████▊ | 329100/371472 [4:01:04<3:21:41,  3.50it/s]
                                                           
{'loss': 2.5327, 'learning_rate': 2.027139132495852e-07, 'epoch': 14.17}

 89%|████████▊ | 329100/371472 [4:01:04<3:21:41,  3.50it/s]
 89%|████████▊ | 329101/371472 [4:01:05<3:14:33,  3.63it/s]
 89%|████████▊ | 329102/371472 [4:01:05<3:11:28,  3.69it/s]
 89%|████████▊ | 329103/371472 [4:01:05<3:08:51,  3.74it/s]
 89%|████████▊ | 329104/371472 [4:01:05<3:13:25,  3.65it/s]
 89%|████████▊ | 329105/371472 [4:01:06<3:16:17,  3.60it/s]
 89%|████████▊ | 329106/371472 [4:01:06<3:32:38,  3.32it/s]
 89%|████████▊ | 329107/371472 [4:01:06<3:38:06,  3.24it/s]
 89%|████████▊ | 329108/371472 [4:01:07<3:29:26,  3.37it/s]
 89%|████████▊ | 329109/371472 [4:01:07<3:20:11,  3.53it/s]
 89%|████████▊ | 329110/371472 [4:01:07<3:14:46,  3.62it/s]
 89%|████████▊ | 329111/371472 [4:01:07<3:13:31,  3.65it/s]
 89%|████████▊ | 329112/371472 [4:01:08<3:11:01,  3.70it/s]
 89%|████████▊ | 329113/371472 [4:01:08<3:13:33,  3.65it/s]
 89%|████████▊ | 329114/371472 [4:01:08<3:11:11,  3.69it/s]
 89%|████████▊ | 329115/371472 [4:01:09<3:21:24,  3.51it/s]
 89%|████████▊ | 329116/371472 [4:01:09<3:17:44,  3.57it/s]
 89%|████████▊ | 329117/371472 [4:01:09<3:17:32,  3.57it/s]
 89%|████████▊ | 329118/371472 [4:01:09<3:15:22,  3.61it/s]
 89%|████████▊ | 329119/371472 [4:01:10<3:19:05,  3.55it/s]
 89%|████████▊ | 329120/371472 [4:01:10<3:25:02,  3.44it/s]
                                                           
{'loss': 2.738, 'learning_rate': 2.0266543127410632e-07, 'epoch': 14.18}

 89%|████████▊ | 329120/371472 [4:01:10<3:25:02,  3.44it/s]
 89%|████████▊ | 329121/371472 [4:01:10<3:26:02,  3.43it/s]
 89%|████████▊ | 329122/371472 [4:01:11<3:15:55,  3.60it/s]
 89%|████████▊ | 329123/371472 [4:01:11<3:43:52,  3.15it/s]
 89%|████████▊ | 329124/371472 [4:01:11<3:34:47,  3.29it/s]
 89%|████████▊ | 329125/371472 [4:01:12<3:28:59,  3.38it/s]
 89%|████████▊ | 329126/371472 [4:01:12<3:28:00,  3.39it/s]
 89%|████████▊ | 329127/371472 [4:01:12<3:28:46,  3.38it/s]
 89%|████████▊ | 329128/371472 [4:01:12<3:21:24,  3.50it/s]
 89%|████████▊ | 329129/371472 [4:01:13<3:33:41,  3.30it/s]
 89%|████████▊ | 329130/371472 [4:01:13<3:21:55,  3.49it/s]
 89%|████████▊ | 329131/371472 [4:01:13<3:19:13,  3.54it/s]
 89%|████████▊ | 329132/371472 [4:01:13<3:12:47,  3.66it/s]
 89%|████████▊ | 329133/371472 [4:01:14<3:13:16,  3.65it/s]
 89%|████████▊ | 329134/371472 [4:01:14<3:08:05,  3.75it/s]
 89%|████████▊ | 329135/371472 [4:01:14<3:04:42,  3.82it/s]
 89%|████████▊ | 329136/371472 [4:01:15<3:10:49,  3.70it/s]
 89%|████████▊ | 329137/371472 [4:01:15<3:25:43,  3.43it/s]
 89%|████████▊ | 329138/371472 [4:01:15<3:20:42,  3.52it/s]
 89%|████████▊ | 329139/371472 [4:01:15<3:25:16,  3.44it/s]
 89%|████████▊ | 329140/371472 [4:01:16<3:22:07,  3.49it/s]
                                                           
{'loss': 2.6292, 'learning_rate': 2.026169492986274e-07, 'epoch': 14.18}

 89%|████████▊ | 329140/371472 [4:01:16<3:22:07,  3.49it/s]
 89%|████████▊ | 329141/371472 [4:01:16<3:23:04,  3.47it/s]
 89%|████████▊ | 329142/371472 [4:01:16<3:21:14,  3.51it/s]
 89%|████████▊ | 329143/371472 [4:01:17<3:18:47,  3.55it/s]
 89%|████████▊ | 329144/371472 [4:01:17<3:14:33,  3.63it/s]
 89%|████████▊ | 329145/371472 [4:01:17<3:19:51,  3.53it/s]
 89%|████████▊ | 329146/371472 [4:01:17<3:10:44,  3.70it/s]
 89%|████████▊ | 329147/371472 [4:01:18<3:09:36,  3.72it/s]
 89%|████████▊ | 329148/371472 [4:01:18<3:18:42,  3.55it/s]
 89%|████████▊ | 329149/371472 [4:01:18<3:17:02,  3.58it/s]
 89%|████████▊ | 329150/371472 [4:01:19<3:22:20,  3.49it/s]
 89%|████████▊ | 329151/371472 [4:01:19<3:21:44,  3.50it/s]
 89%|████████▊ | 329152/371472 [4:01:19<3:16:28,  3.59it/s]
 89%|████████▊ | 329153/371472 [4:01:19<3:24:42,  3.45it/s]
 89%|████████▊ | 329154/371472 [4:01:20<3:26:43,  3.41it/s]
 89%|████████▊ | 329155/371472 [4:01:20<3:40:38,  3.20it/s]
 89%|████████▊ | 329156/371472 [4:01:20<3:27:45,  3.39it/s]
 89%|████████▊ | 329157/371472 [4:01:21<3:28:20,  3.39it/s]
 89%|████████▊ | 329158/371472 [4:01:21<3:31:34,  3.33it/s]
 89%|████████▊ | 329159/371472 [4:01:21<3:25:52,  3.43it/s]
 89%|████████▊ | 329160/371472 [4:01:21<3:14:32,  3.63it/s]
                                                           
{'loss': 2.7782, 'learning_rate': 2.0256846732314857e-07, 'epoch': 14.18}

 89%|████████▊ | 329160/371472 [4:01:21<3:14:32,  3.63it/s]
 89%|████████▊ | 329161/371472 [4:01:22<3:21:21,  3.50it/s]
 89%|████████▊ | 329162/371472 [4:01:22<3:19:17,  3.54it/s]
 89%|████████▊ | 329163/371472 [4:01:22<3:30:42,  3.35it/s]
 89%|████████▊ | 329164/371472 [4:01:23<3:31:51,  3.33it/s]
 89%|████████▊ | 329165/371472 [4:01:23<3:37:21,  3.24it/s]
 89%|████████▊ | 329166/371472 [4:01:23<3:33:57,  3.30it/s]
 89%|████████▊ | 329167/371472 [4:01:24<3:23:58,  3.46it/s]
 89%|████████▊ | 329168/371472 [4:01:24<3:25:40,  3.43it/s]
 89%|████████▊ | 329169/371472 [4:01:24<3:24:04,  3.45it/s]
 89%|████████▊ | 329170/371472 [4:01:24<3:15:57,  3.60it/s]
 89%|████████▊ | 329171/371472 [4:01:25<3:23:45,  3.46it/s]
 89%|████████▊ | 329172/371472 [4:01:25<3:18:19,  3.55it/s]
 89%|████████▊ | 329173/371472 [4:01:25<3:17:23,  3.57it/s]
 89%|████████▊ | 329174/371472 [4:01:26<3:20:15,  3.52it/s]
 89%|████████▊ | 329175/371472 [4:01:26<3:23:44,  3.46it/s]
 89%|████████▊ | 329176/371472 [4:01:26<3:39:41,  3.21it/s]
 89%|████████▊ | 329177/371472 [4:01:26<3:29:04,  3.37it/s]
 89%|████████▊ | 329178/371472 [4:01:27<3:26:57,  3.41it/s]
 89%|████████▊ | 329179/371472 [4:01:27<3:31:42,  3.33it/s]
 89%|████████▊ | 329180/371472 [4:01:27<3:25:28,  3.43it/s]
                                                           
{'loss': 2.6756, 'learning_rate': 2.025199853476696e-07, 'epoch': 14.18}

 89%|████████▊ | 329180/371472 [4:01:27<3:25:28,  3.43it/s]
 89%|████████▊ | 329181/371472 [4:01:28<3:15:43,  3.60it/s]
 89%|████████▊ | 329182/371472 [4:01:28<3:12:04,  3.67it/s]
 89%|████████▊ | 329183/371472 [4:01:28<3:08:22,  3.74it/s]
 89%|████████▊ | 329184/371472 [4:01:28<3:01:34,  3.88it/s]
 89%|████████▊ | 329185/371472 [4:01:29<3:04:58,  3.81it/s]
 89%|████████▊ | 329186/371472 [4:01:29<3:09:28,  3.72it/s]
 89%|████████▊ | 329187/371472 [4:01:29<3:13:45,  3.64it/s]
 89%|████████▊ | 329188/371472 [4:01:29<3:17:28,  3.57it/s]
 89%|████████▊ | 329189/371472 [4:01:30<3:16:46,  3.58it/s]
 89%|████████▊ | 329190/371472 [4:01:30<3:19:02,  3.54it/s]
 89%|████████▊ | 329191/371472 [4:01:30<3:18:39,  3.55it/s]
 89%|████████▊ | 329192/371472 [4:01:31<3:28:36,  3.38it/s]
 89%|████████▊ | 329193/371472 [4:01:31<4:47:25,  2.45it/s]
 89%|████████▊ | 329194/371472 [4:01:32<4:15:24,  2.76it/s]
 89%|████████▊ | 329195/371472 [4:01:32<3:57:24,  2.97it/s]
 89%|████████▊ | 329196/371472 [4:01:32<3:47:20,  3.10it/s]
 89%|████████▊ | 329197/371472 [4:01:32<3:36:00,  3.26it/s]
 89%|████████▊ | 329198/371472 [4:01:33<3:29:31,  3.36it/s]
 89%|████████▊ | 329199/371472 [4:01:33<3:23:37,  3.46it/s]
 89%|████████▊ | 329200/371472 [4:01:33<3:38:29,  3.22it/s]
                                                           
{'loss': 2.5928, 'learning_rate': 2.0247150337219076e-07, 'epoch': 14.18}

 89%|████████▊ | 329200/371472 [4:01:33<3:38:29,  3.22it/s]
 89%|████████▊ | 329201/371472 [4:01:34<3:41:18,  3.18it/s]
 89%|████████▊ | 329202/371472 [4:01:34<3:28:33,  3.38it/s]
 89%|████████▊ | 329203/371472 [4:01:34<3:44:13,  3.14it/s]
 89%|████████▊ | 329204/371472 [4:01:34<3:29:53,  3.36it/s]
 89%|████████▊ | 329205/371472 [4:01:35<3:30:38,  3.34it/s]
 89%|████████▊ | 329206/371472 [4:01:35<3:34:27,  3.28it/s]
 89%|████████▊ | 329207/371472 [4:01:35<3:22:25,  3.48it/s]
 89%|████████▊ | 329208/371472 [4:01:36<3:19:56,  3.52it/s]
 89%|████████▊ | 329209/371472 [4:01:36<3:21:12,  3.50it/s]
 89%|████████▊ | 329210/371472 [4:01:36<3:19:38,  3.53it/s]
 89%|████████▊ | 329211/371472 [4:01:36<3:17:25,  3.57it/s]
 89%|████████▊ | 329212/371472 [4:01:37<3:12:58,  3.65it/s]
 89%|████████▊ | 329213/371472 [4:01:37<3:20:24,  3.51it/s]
 89%|████████▊ | 329214/371472 [4:01:37<3:18:47,  3.54it/s]
 89%|████████▊ | 329215/371472 [4:01:38<3:21:06,  3.50it/s]
 89%|████████▊ | 329216/371472 [4:01:38<3:17:13,  3.57it/s]
 89%|████████▊ | 329217/371472 [4:01:38<3:20:01,  3.52it/s]
 89%|████████▊ | 329218/371472 [4:01:39<3:30:22,  3.35it/s]
 89%|████████▊ | 329219/371472 [4:01:39<3:32:45,  3.31it/s]
 89%|████████▊ | 329220/371472 [4:01:39<3:29:33,  3.36it/s]
                                                           
{'loss': 2.6703, 'learning_rate': 2.0242302139671183e-07, 'epoch': 14.18}

 89%|████████▊ | 329220/371472 [4:01:39<3:29:33,  3.36it/s]
 89%|████████▊ | 329221/371472 [4:01:39<3:28:39,  3.37it/s]
 89%|████████▊ | 329222/371472 [4:01:40<3:18:18,  3.55it/s]
 89%|████████▊ | 329223/371472 [4:01:40<3:14:12,  3.63it/s]
 89%|████████▊ | 329224/371472 [4:01:40<3:11:52,  3.67it/s]
 89%|████████▊ | 329225/371472 [4:01:40<3:18:48,  3.54it/s]
 89%|████████▊ | 329226/371472 [4:01:41<3:15:15,  3.61it/s]
 89%|████████▊ | 329227/371472 [4:01:41<3:19:35,  3.53it/s]
 89%|████████▊ | 329228/371472 [4:01:41<3:19:54,  3.52it/s]
 89%|████████▊ | 329229/371472 [4:01:42<3:13:20,  3.64it/s]
 89%|████████▊ | 329230/371472 [4:01:42<3:10:46,  3.69it/s]
 89%|████████▊ | 329231/371472 [4:01:42<3:11:18,  3.68it/s]
 89%|████████▊ | 329232/371472 [4:01:42<3:17:24,  3.57it/s]
 89%|████████▊ | 329233/371472 [4:01:43<3:12:38,  3.65it/s]
 89%|████████▊ | 329234/371472 [4:01:43<3:15:04,  3.61it/s]
 89%|████████▊ | 329235/371472 [4:01:43<3:12:08,  3.66it/s]
 89%|████████▊ | 329236/371472 [4:01:44<3:14:37,  3.62it/s]
 89%|████████▊ | 329237/371472 [4:01:44<3:14:31,  3.62it/s]
 89%|████████▊ | 329238/371472 [4:01:44<3:13:09,  3.64it/s]
 89%|████████▊ | 329239/371472 [4:01:44<3:14:53,  3.61it/s]
 89%|████████▊ | 329240/371472 [4:01:45<3:18:03,  3.55it/s]
                                                           
{'loss': 2.5994, 'learning_rate': 2.0237453942123298e-07, 'epoch': 14.18}

 89%|████████▊ | 329240/371472 [4:01:45<3:18:03,  3.55it/s]
 89%|████████▊ | 329241/371472 [4:01:45<3:28:38,  3.37it/s]
 89%|████████▊ | 329242/371472 [4:01:45<3:20:17,  3.51it/s]
 89%|████████▊ | 329243/371472 [4:01:45<3:15:04,  3.61it/s]
 89%|████████▊ | 329244/371472 [4:01:46<3:12:31,  3.66it/s]
 89%|████████▊ | 329245/371472 [4:01:46<3:11:17,  3.68it/s]
 89%|████████▊ | 329246/371472 [4:01:46<3:35:24,  3.27it/s]
 89%|████████▊ | 329247/371472 [4:01:47<3:33:41,  3.29it/s]
 89%|████████▊ | 329248/371472 [4:01:47<3:39:56,  3.20it/s]
 89%|████████▊ | 329249/371472 [4:01:47<3:33:49,  3.29it/s]
 89%|████████▊ | 329250/371472 [4:01:48<3:33:49,  3.29it/s]
 89%|████████▊ | 329251/371472 [4:01:48<3:33:26,  3.30it/s]
 89%|████████▊ | 329252/371472 [4:01:48<3:29:43,  3.36it/s]
 89%|████████▊ | 329253/371472 [4:01:48<3:18:46,  3.54it/s]
 89%|████████▊ | 329254/371472 [4:01:49<3:14:01,  3.63it/s]
 89%|████████▊ | 329255/371472 [4:01:49<3:11:49,  3.67it/s]
 89%|████████▊ | 329256/371472 [4:01:49<3:14:48,  3.61it/s]
 89%|████████▊ | 329257/371472 [4:01:50<3:23:09,  3.46it/s]
 89%|████████▊ | 329258/371472 [4:01:50<3:13:44,  3.63it/s]
 89%|████████▊ | 329259/371472 [4:01:50<3:21:36,  3.49it/s]
 89%|████████▊ | 329260/371472 [4:01:50<3:19:56,  3.52it/s]
                                                           
{'loss': 2.4292, 'learning_rate': 2.0232605744575403e-07, 'epoch': 14.18}

 89%|████████▊ | 329260/371472 [4:01:50<3:19:56,  3.52it/s]
 89%|████████▊ | 329261/371472 [4:01:51<3:17:46,  3.56it/s]
 89%|████████▊ | 329262/371472 [4:01:51<3:42:25,  3.16it/s]
 89%|████████▊ | 329263/371472 [4:01:51<3:30:41,  3.34it/s]
 89%|████████▊ | 329264/371472 [4:01:52<3:29:52,  3.35it/s]
 89%|████████▊ | 329265/371472 [4:01:52<3:39:19,  3.21it/s]
 89%|████████▊ | 329266/371472 [4:01:52<3:28:26,  3.37it/s]
 89%|████████▊ | 329267/371472 [4:01:53<3:26:56,  3.40it/s]
 89%|████████▊ | 329268/371472 [4:01:53<3:22:14,  3.48it/s]
 89%|████████▊ | 329269/371472 [4:01:53<3:33:05,  3.30it/s]
 89%|████████▊ | 329270/371472 [4:01:53<3:22:19,  3.48it/s]
 89%|████████▊ | 329271/371472 [4:01:54<3:33:48,  3.29it/s]
 89%|████████▊ | 329272/371472 [4:01:54<3:37:54,  3.23it/s]
 89%|████████▊ | 329273/371472 [4:01:54<3:31:03,  3.33it/s]
 89%|████████▊ | 329274/371472 [4:01:55<3:32:07,  3.32it/s]
 89%|████████▊ | 329275/371472 [4:01:55<3:25:26,  3.42it/s]
 89%|████████▊ | 329276/371472 [4:01:55<3:18:06,  3.55it/s]
 89%|████████▊ | 329277/371472 [4:01:55<3:11:10,  3.68it/s]
 89%|████████▊ | 329278/371472 [4:01:56<3:10:03,  3.70it/s]
 89%|████████▊ | 329279/371472 [4:01:56<3:14:38,  3.61it/s]
 89%|████████▊ | 329280/371472 [4:01:56<3:23:42,  3.45it/s]
                                                           
{'loss': 2.512, 'learning_rate': 2.022775754702752e-07, 'epoch': 14.18}

 89%|████████▊ | 329280/371472 [4:01:56<3:23:42,  3.45it/s]
 89%|████████▊ | 329281/371472 [4:01:57<3:23:23,  3.46it/s]
 89%|████████▊ | 329282/371472 [4:01:57<3:23:16,  3.46it/s]
 89%|████████▊ | 329283/371472 [4:01:57<3:52:25,  3.03it/s]
 89%|████████▊ | 329284/371472 [4:01:58<3:35:59,  3.26it/s]
 89%|████████▊ | 329285/371472 [4:01:58<3:26:15,  3.41it/s]
 89%|████████▊ | 329286/371472 [4:01:58<3:32:25,  3.31it/s]
 89%|████████▊ | 329287/371472 [4:01:58<3:24:47,  3.43it/s]
 89%|████████▊ | 329288/371472 [4:01:59<3:18:09,  3.55it/s]
 89%|████████▊ | 329289/371472 [4:01:59<3:21:54,  3.48it/s]
 89%|████████▊ | 329290/371472 [4:01:59<3:28:29,  3.37it/s]
 89%|████████▊ | 329291/371472 [4:02:00<3:26:37,  3.40it/s]
 89%|████████▊ | 329292/371472 [4:02:00<3:20:59,  3.50it/s]
 89%|████████▊ | 329293/371472 [4:02:00<3:28:36,  3.37it/s]
 89%|████████▊ | 329294/371472 [4:02:00<3:21:22,  3.49it/s]
 89%|████████▊ | 329295/371472 [4:02:01<3:18:56,  3.53it/s]
 89%|████████▊ | 329296/371472 [4:02:01<3:33:53,  3.29it/s]
 89%|████████▊ | 329297/371472 [4:02:01<3:25:59,  3.41it/s]
 89%|████████▊ | 329298/371472 [4:02:02<3:27:34,  3.39it/s]
 89%|████████▊ | 329299/371472 [4:02:02<3:26:23,  3.41it/s]
 89%|████████▊ | 329300/371472 [4:02:02<3:40:27,  3.19it/s]
                                                           
{'loss': 2.5576, 'learning_rate': 2.0222909349479625e-07, 'epoch': 14.18}

 89%|████████▊ | 329300/371472 [4:02:02<3:40:27,  3.19it/s]
 89%|████████▊ | 329301/371472 [4:02:03<3:30:01,  3.35it/s]
 89%|████████▊ | 329302/371472 [4:02:03<3:23:58,  3.45it/s]
 89%|████████▊ | 329303/371472 [4:02:03<3:14:42,  3.61it/s]
 89%|████████▊ | 329304/371472 [4:02:03<3:20:34,  3.50it/s]
 89%|████████▊ | 329305/371472 [4:02:04<3:23:25,  3.45it/s]
 89%|████████▊ | 329306/371472 [4:02:04<3:27:39,  3.38it/s]
 89%|████████▊ | 329307/371472 [4:02:04<3:18:35,  3.54it/s]
 89%|████████▊ | 329308/371472 [4:02:05<3:31:23,  3.32it/s]
 89%|████████▊ | 329309/371472 [4:02:05<3:21:52,  3.48it/s]
 89%|████████▊ | 329310/371472 [4:02:05<3:18:06,  3.55it/s]
 89%|████████▊ | 329311/371472 [4:02:05<3:23:12,  3.46it/s]
 89%|████████▊ | 329312/371472 [4:02:06<3:14:43,  3.61it/s]
 89%|████████▊ | 329313/371472 [4:02:06<3:14:26,  3.61it/s]
 89%|████████▊ | 329314/371472 [4:02:06<3:39:08,  3.21it/s]
 89%|████████▊ | 329315/371472 [4:02:07<3:30:39,  3.34it/s]
 89%|████████▊ | 329316/371472 [4:02:07<3:21:56,  3.48it/s]
 89%|████████▊ | 329317/371472 [4:02:07<3:23:57,  3.44it/s]
 89%|████████▊ | 329318/371472 [4:02:07<3:20:55,  3.50it/s]
 89%|████████▊ | 329319/371472 [4:02:08<3:22:25,  3.47it/s]
 89%|████████▊ | 329320/371472 [4:02:08<3:17:41,  3.55it/s]
                                                           
{'loss': 2.6813, 'learning_rate': 2.021806115193174e-07, 'epoch': 14.18}

 89%|████████▊ | 329320/371472 [4:02:08<3:17:41,  3.55it/s]
 89%|████████▊ | 329321/371472 [4:02:08<3:15:42,  3.59it/s]
 89%|████████▊ | 329322/371472 [4:02:09<3:14:04,  3.62it/s]
 89%|████████▊ | 329323/371472 [4:02:09<3:12:09,  3.66it/s]
 89%|████████▊ | 329324/371472 [4:02:09<3:20:32,  3.50it/s]
 89%|████████▊ | 329325/371472 [4:02:09<3:16:09,  3.58it/s]
 89%|████████▊ | 329326/371472 [4:02:10<3:15:46,  3.59it/s]
 89%|████████▊ | 329327/371472 [4:02:10<3:08:45,  3.72it/s]
 89%|████████▊ | 329328/371472 [4:02:10<3:10:13,  3.69it/s]
 89%|████████▊ | 329329/371472 [4:02:10<3:10:19,  3.69it/s]
 89%|████████▊ | 329330/371472 [4:02:11<3:28:46,  3.36it/s]
 89%|████████▊ | 329331/371472 [4:02:11<3:34:13,  3.28it/s]
 89%|████████▊ | 329332/371472 [4:02:11<3:23:10,  3.46it/s]
 89%|████████▊ | 329333/371472 [4:02:12<3:12:30,  3.65it/s]
 89%|████████▊ | 329334/371472 [4:02:12<3:16:57,  3.57it/s]
 89%|████████▊ | 329335/371472 [4:02:12<3:12:54,  3.64it/s]
 89%|████████▊ | 329336/371472 [4:02:12<3:10:53,  3.68it/s]
 89%|████████▊ | 329337/371472 [4:02:13<3:05:52,  3.78it/s]
 89%|████████▊ | 329338/371472 [4:02:13<3:17:24,  3.56it/s]
 89%|████████▊ | 329339/371472 [4:02:13<3:15:20,  3.59it/s]
 89%|████████▊ | 329340/371472 [4:02:14<3:18:46,  3.53it/s]
                                                           
{'loss': 2.5658, 'learning_rate': 2.0213212954383847e-07, 'epoch': 14.19}

 89%|████████▊ | 329340/371472 [4:02:14<3:18:46,  3.53it/s]
 89%|████████▊ | 329341/371472 [4:02:14<3:37:30,  3.23it/s]
 89%|████████▊ | 329342/371472 [4:02:14<3:43:29,  3.14it/s]
 89%|████████▊ | 329343/371472 [4:02:15<3:28:58,  3.36it/s]
 89%|████████▊ | 329344/371472 [4:02:15<3:18:17,  3.54it/s]
 89%|████████▊ | 329345/371472 [4:02:15<3:59:35,  2.93it/s]
 89%|████████▊ | 329346/371472 [4:02:16<3:54:30,  2.99it/s]
 89%|████████▊ | 329347/371472 [4:02:16<3:49:00,  3.07it/s]
 89%|████████▊ | 329348/371472 [4:02:16<3:41:12,  3.17it/s]
 89%|████████▊ | 329349/371472 [4:02:16<3:37:43,  3.22it/s]
 89%|████████▊ | 329350/371472 [4:02:17<3:28:32,  3.37it/s]
 89%|████████▊ | 329351/371472 [4:02:17<3:23:17,  3.45it/s]
 89%|████████▊ | 329352/371472 [4:02:17<3:17:22,  3.56it/s]
 89%|████████▊ | 329353/371472 [4:02:18<3:16:37,  3.57it/s]
 89%|████████▊ | 329354/371472 [4:02:18<3:22:34,  3.47it/s]
 89%|████████▊ | 329355/371472 [4:02:18<3:19:02,  3.53it/s]
 89%|████████▊ | 329356/371472 [4:02:18<3:21:57,  3.48it/s]
 89%|████████▊ | 329357/371472 [4:02:19<3:24:04,  3.44it/s]
 89%|████████▊ | 329358/371472 [4:02:19<3:23:25,  3.45it/s]
 89%|████████▊ | 329359/371472 [4:02:19<3:29:55,  3.34it/s]
 89%|████████▊ | 329360/371472 [4:02:20<3:18:56,  3.53it/s]
                                                           
{'loss': 2.6545, 'learning_rate': 2.0208364756835955e-07, 'epoch': 14.19}

 89%|████████▊ | 329360/371472 [4:02:20<3:18:56,  3.53it/s]
 89%|████████▊ | 329361/371472 [4:02:20<3:21:06,  3.49it/s]
 89%|████████▊ | 329362/371472 [4:02:20<3:18:46,  3.53it/s]
 89%|████████▊ | 329363/371472 [4:02:20<3:12:05,  3.65it/s]
 89%|████████▊ | 329364/371472 [4:02:21<3:07:52,  3.74it/s]
 89%|████████▊ | 329365/371472 [4:02:21<3:01:30,  3.87it/s]
 89%|████████▊ | 329366/371472 [4:02:21<3:05:13,  3.79it/s]
 89%|████████▊ | 329367/371472 [4:02:21<3:13:27,  3.63it/s]
 89%|████████▊ | 329368/371472 [4:02:22<3:21:36,  3.48it/s]
 89%|████████▊ | 329369/371472 [4:02:22<3:19:18,  3.52it/s]
 89%|████████▊ | 329370/371472 [4:02:22<3:20:51,  3.49it/s]
 89%|████████▊ | 329371/371472 [4:02:23<3:13:55,  3.62it/s]
 89%|████████▊ | 329372/371472 [4:02:23<3:21:36,  3.48it/s]
 89%|████████▊ | 329373/371472 [4:02:23<3:25:33,  3.41it/s]
 89%|████████▊ | 329374/371472 [4:02:24<3:32:28,  3.30it/s]
 89%|████████▊ | 329375/371472 [4:02:24<3:23:12,  3.45it/s]
 89%|████████▊ | 329376/371472 [4:02:24<3:17:05,  3.56it/s]
 89%|████████▊ | 329377/371472 [4:02:24<3:19:54,  3.51it/s]
 89%|████████▊ | 329378/371472 [4:02:25<3:22:51,  3.46it/s]
 89%|████████▊ | 329379/371472 [4:02:25<3:29:12,  3.35it/s]
 89%|████████▊ | 329380/371472 [4:02:25<3:32:01,  3.31it/s]
                                                           
{'loss': 2.5554, 'learning_rate': 2.0203516559288067e-07, 'epoch': 14.19}

 89%|████████▊ | 329380/371472 [4:02:25<3:32:01,  3.31it/s]
 89%|████████▊ | 329381/371472 [4:02:26<3:24:05,  3.44it/s]
 89%|████████▊ | 329382/371472 [4:02:26<3:17:52,  3.55it/s]
 89%|████████▊ | 329383/371472 [4:02:26<3:22:42,  3.46it/s]
 89%|████████▊ | 329384/371472 [4:02:26<3:23:11,  3.45it/s]
 89%|████████▊ | 329385/371472 [4:02:27<3:17:16,  3.56it/s]
 89%|████████▊ | 329386/371472 [4:02:27<3:26:57,  3.39it/s]
 89%|████████▊ | 329387/371472 [4:02:27<3:18:36,  3.53it/s]
 89%|████████▊ | 329388/371472 [4:02:27<3:08:25,  3.72it/s]
 89%|████████▊ | 329389/371472 [4:02:28<3:15:12,  3.59it/s]
 89%|████████▊ | 329390/371472 [4:02:28<3:17:52,  3.54it/s]
 89%|████████▊ | 329391/371472 [4:02:28<3:29:36,  3.35it/s]
 89%|████████▊ | 329392/371472 [4:02:29<3:28:27,  3.36it/s]
 89%|████████▊ | 329393/371472 [4:02:29<3:21:56,  3.47it/s]
 89%|████████▊ | 329394/371472 [4:02:29<3:19:01,  3.52it/s]
 89%|████████▊ | 329395/371472 [4:02:30<3:16:12,  3.57it/s]
 89%|████████▊ | 329396/371472 [4:02:30<3:14:20,  3.61it/s]
 89%|████████▊ | 329397/371472 [4:02:30<3:12:51,  3.64it/s]
 89%|████████▊ | 329398/371472 [4:02:30<3:39:57,  3.19it/s]
 89%|████████▊ | 329399/371472 [4:02:31<3:27:56,  3.37it/s]
 89%|████████▊ | 329400/371472 [4:02:31<3:27:34,  3.38it/s]
                                                           
{'loss': 2.6162, 'learning_rate': 2.0198668361740174e-07, 'epoch': 14.19}

 89%|████████▊ | 329400/371472 [4:02:31<3:27:34,  3.38it/s]
 89%|████████▊ | 329401/371472 [4:02:31<3:20:06,  3.50it/s]
 89%|████████▊ | 329402/371472 [4:02:32<3:25:48,  3.41it/s]
 89%|████████▊ | 329403/371472 [4:02:32<3:22:53,  3.46it/s]
 89%|████████▊ | 329404/371472 [4:02:32<3:32:20,  3.30it/s]
 89%|████████▊ | 329405/371472 [4:02:32<3:29:25,  3.35it/s]
 89%|████████▊ | 329406/371472 [4:02:33<3:25:16,  3.42it/s]
 89%|████████▊ | 329407/371472 [4:02:33<3:29:05,  3.35it/s]
 89%|████████▊ | 329408/371472 [4:02:33<3:45:52,  3.10it/s]
 89%|████████▊ | 329409/371472 [4:02:34<3:31:50,  3.31it/s]
 89%|████████▊ | 329410/371472 [4:02:34<3:24:37,  3.43it/s]
 89%|████████▊ | 329411/371472 [4:02:34<3:28:55,  3.36it/s]
 89%|████████▊ | 329412/371472 [4:02:35<3:22:57,  3.45it/s]
 89%|████████▊ | 329413/371472 [4:02:35<3:18:43,  3.53it/s]
 89%|████████▊ | 329414/371472 [4:02:35<3:13:06,  3.63it/s]
 89%|████████▊ | 329415/371472 [4:02:35<3:13:17,  3.63it/s]
 89%|████████▊ | 329416/371472 [4:02:36<3:12:02,  3.65it/s]
 89%|████████▊ | 329417/371472 [4:02:36<3:16:35,  3.57it/s]
 89%|████████▊ | 329418/371472 [4:02:36<3:36:16,  3.24it/s]
 89%|████████▊ | 329419/371472 [4:02:37<3:28:57,  3.35it/s]
 89%|████████▊ | 329420/371472 [4:02:37<3:18:49,  3.53it/s]
                                                           
{'loss': 2.5343, 'learning_rate': 2.0193820164192292e-07, 'epoch': 14.19}

 89%|████████▊ | 329420/371472 [4:02:37<3:18:49,  3.53it/s]
 89%|████████▊ | 329421/371472 [4:02:37<3:11:45,  3.65it/s]
 89%|████████▊ | 329422/371472 [4:02:37<3:10:14,  3.68it/s]
 89%|████████▊ | 329423/371472 [4:02:38<3:10:00,  3.69it/s]
 89%|████████▊ | 329424/371472 [4:02:38<3:05:31,  3.78it/s]
 89%|████████▊ | 329425/371472 [4:02:38<3:13:05,  3.63it/s]
 89%|████████▊ | 329426/371472 [4:02:38<3:11:38,  3.66it/s]
 89%|████████▊ | 329427/371472 [4:02:39<3:27:08,  3.38it/s]
 89%|████████▊ | 329428/371472 [4:02:39<3:25:54,  3.40it/s]
 89%|████████▊ | 329429/371472 [4:02:39<3:18:01,  3.54it/s]
 89%|████████▊ | 329430/371472 [4:02:40<3:14:42,  3.60it/s]
 89%|████████▊ | 329431/371472 [4:02:40<3:11:54,  3.65it/s]
 89%|████████▊ | 329432/371472 [4:02:40<3:14:40,  3.60it/s]
 89%|████████▊ | 329433/371472 [4:02:40<3:12:38,  3.64it/s]
 89%|████████▊ | 329434/371472 [4:02:41<3:11:04,  3.67it/s]
 89%|████████▊ | 329435/371472 [4:02:41<3:20:31,  3.49it/s]
 89%|████████▊ | 329436/371472 [4:02:41<3:19:29,  3.51it/s]
 89%|████████▊ | 329437/371472 [4:02:42<3:23:42,  3.44it/s]
 89%|████████▊ | 329438/371472 [4:02:42<3:28:39,  3.36it/s]
 89%|████████▊ | 329439/371472 [4:02:42<3:27:11,  3.38it/s]
 89%|████████▊ | 329440/371472 [4:02:42<3:25:31,  3.41it/s]
                                                           
{'loss': 2.5276, 'learning_rate': 2.0188971966644396e-07, 'epoch': 14.19}

 89%|████████▊ | 329440/371472 [4:02:42<3:25:31,  3.41it/s]
 89%|████████▊ | 329441/371472 [4:02:43<3:25:31,  3.41it/s]
 89%|████████▊ | 329442/371472 [4:02:43<3:20:34,  3.49it/s]
 89%|████████▊ | 329443/371472 [4:02:43<3:22:09,  3.47it/s]
 89%|████████▊ | 329444/371472 [4:02:44<3:57:59,  2.94it/s]
 89%|████████▊ | 329445/371472 [4:02:44<3:41:37,  3.16it/s]
 89%|████████▊ | 329446/371472 [4:02:44<3:28:54,  3.35it/s]
 89%|████████▊ | 329447/371472 [4:02:45<3:41:37,  3.16it/s]
 89%|████████▊ | 329448/371472 [4:02:45<3:41:11,  3.17it/s]
 89%|████████▊ | 329449/371472 [4:02:45<3:34:09,  3.27it/s]
 89%|████████▊ | 329450/371472 [4:02:46<3:23:48,  3.44it/s]
 89%|████████▊ | 329451/371472 [4:02:46<3:43:07,  3.14it/s]
 89%|████████▊ | 329452/371472 [4:02:46<3:36:10,  3.24it/s]
 89%|████████▊ | 329453/371472 [4:02:46<3:34:01,  3.27it/s]
 89%|████████▊ | 329454/371472 [4:02:47<3:23:16,  3.45it/s]
 89%|████████▊ | 329455/371472 [4:02:47<3:16:33,  3.56it/s]
 89%|████████▊ | 329456/371472 [4:02:47<3:16:03,  3.57it/s]
 89%|████████▊ | 329457/371472 [4:02:48<3:17:29,  3.55it/s]
 89%|████████▊ | 329458/371472 [4:02:48<3:15:04,  3.59it/s]
 89%|████████▊ | 329459/371472 [4:02:48<3:24:28,  3.42it/s]
 89%|████████▊ | 329460/371472 [4:02:48<3:19:22,  3.51it/s]
                                                           
{'loss': 2.6356, 'learning_rate': 2.0184123769096512e-07, 'epoch': 14.19}

 89%|████████▊ | 329460/371472 [4:02:48<3:19:22,  3.51it/s]
 89%|████████▊ | 329461/371472 [4:02:49<3:29:43,  3.34it/s]
 89%|████████▊ | 329462/371472 [4:02:49<3:17:52,  3.54it/s]
 89%|████████▊ | 329463/371472 [4:02:49<3:26:17,  3.39it/s]
 89%|████████▊ | 329464/371472 [4:02:50<3:18:22,  3.53it/s]
 89%|████████▊ | 329465/371472 [4:02:50<3:10:26,  3.68it/s]
 89%|████████▊ | 329466/371472 [4:02:50<3:19:04,  3.52it/s]
 89%|████████▊ | 329467/371472 [4:02:51<3:34:23,  3.27it/s]
 89%|████████▊ | 329468/371472 [4:02:51<3:30:27,  3.33it/s]
 89%|████████▊ | 329469/371472 [4:02:51<3:19:56,  3.50it/s]
 89%|████████▊ | 329470/371472 [4:02:51<3:18:25,  3.53it/s]
 89%|████████▊ | 329471/371472 [4:02:52<3:10:57,  3.67it/s]
 89%|████████▊ | 329472/371472 [4:02:52<3:16:30,  3.56it/s]
 89%|████████▊ | 329473/371472 [4:02:52<3:14:11,  3.60it/s]
 89%|████████▊ | 329474/371472 [4:02:52<3:08:26,  3.71it/s]
 89%|████████▊ | 329475/371472 [4:02:53<3:19:20,  3.51it/s]
 89%|████████▊ | 329476/371472 [4:02:53<3:19:12,  3.51it/s]
 89%|████████▊ | 329477/371472 [4:02:53<3:23:35,  3.44it/s]
 89%|████████▊ | 329478/371472 [4:02:54<3:15:30,  3.58it/s]
 89%|████████▊ | 329479/371472 [4:02:54<3:08:38,  3.71it/s]
 89%|████████▊ | 329480/371472 [4:02:54<3:20:50,  3.48it/s]
                                                           
{'loss': 2.6236, 'learning_rate': 2.0179275571548619e-07, 'epoch': 14.19}

 89%|████████▊ | 329480/371472 [4:02:54<3:20:50,  3.48it/s]
 89%|████████▊ | 329481/371472 [4:02:54<3:18:15,  3.53it/s]
 89%|████████▊ | 329482/371472 [4:02:55<3:11:37,  3.65it/s]
 89%|████████▊ | 329483/371472 [4:02:55<3:16:24,  3.56it/s]
 89%|████████▊ | 329484/371472 [4:02:55<3:27:58,  3.36it/s]
 89%|████████▊ | 329485/371472 [4:02:56<3:19:55,  3.50it/s]
 89%|████████▊ | 329486/371472 [4:02:56<3:29:17,  3.34it/s]
 89%|████████▊ | 329487/371472 [4:02:56<3:27:53,  3.37it/s]
 89%|████████▊ | 329488/371472 [4:02:56<3:21:39,  3.47it/s]
 89%|████████▊ | 329489/371472 [4:02:57<3:31:42,  3.31it/s]
 89%|████████▊ | 329490/371472 [4:02:57<3:25:59,  3.40it/s]
 89%|████████▊ | 329491/371472 [4:02:57<3:22:34,  3.45it/s]
 89%|████████▊ | 329492/371472 [4:02:58<3:18:41,  3.52it/s]
 89%|████████▊ | 329493/371472 [4:02:58<3:31:48,  3.30it/s]
 89%|████████▊ | 329494/371472 [4:02:58<3:31:48,  3.30it/s]
 89%|████████▊ | 329495/371472 [4:02:59<3:26:14,  3.39it/s]
 89%|████████▊ | 329496/371472 [4:02:59<3:21:08,  3.48it/s]
 89%|████████▊ | 329497/371472 [4:02:59<3:16:56,  3.55it/s]
 89%|████████▊ | 329498/371472 [4:02:59<3:22:42,  3.45it/s]
 89%|████████▊ | 329499/371472 [4:03:00<3:25:58,  3.40it/s]
 89%|████████▊ | 329500/371472 [4:03:00<3:25:04,  3.41it/s]
                                                           
{'loss': 2.526, 'learning_rate': 2.0174427374000734e-07, 'epoch': 14.19}

 89%|████████▊ | 329500/371472 [4:03:00<3:25:04,  3.41it/s]
 89%|████████▊ | 329501/371472 [4:03:00<3:19:00,  3.52it/s]
 89%|████████▊ | 329502/371472 [4:03:01<3:16:14,  3.56it/s]
 89%|████████▊ | 329503/371472 [4:03:01<3:16:12,  3.57it/s]
 89%|████████▊ | 329504/371472 [4:03:01<3:20:29,  3.49it/s]
 89%|████████▊ | 329505/371472 [4:03:01<3:24:44,  3.42it/s]
 89%|████████▊ | 329506/371472 [4:03:02<3:28:16,  3.36it/s]
 89%|████████▊ | 329507/371472 [4:03:02<3:22:33,  3.45it/s]
 89%|████████▊ | 329508/371472 [4:03:02<3:16:38,  3.56it/s]
 89%|████████▊ | 329509/371472 [4:03:03<3:15:41,  3.57it/s]
 89%|████████▊ | 329510/371472 [4:03:03<3:09:25,  3.69it/s]
 89%|████████▊ | 329511/371472 [4:03:03<3:05:21,  3.77it/s]
 89%|████████▊ | 329512/371472 [4:03:03<3:14:01,  3.60it/s]
 89%|████████▊ | 329513/371472 [4:03:04<3:11:35,  3.65it/s]
 89%|████████▊ | 329514/371472 [4:03:04<3:20:41,  3.48it/s]
 89%|████████▊ | 329515/371472 [4:03:04<3:17:26,  3.54it/s]
 89%|████████▊ | 329516/371472 [4:03:04<3:13:13,  3.62it/s]
 89%|████████▊ | 329517/371472 [4:03:05<3:21:06,  3.48it/s]
 89%|████████▊ | 329518/371472 [4:03:05<3:10:38,  3.67it/s]
 89%|████████▊ | 329519/371472 [4:03:05<3:02:56,  3.82it/s]
 89%|████████▊ | 329520/371472 [4:03:06<3:20:18,  3.49it/s]
                                                           
{'loss': 2.5021, 'learning_rate': 2.0169579176452838e-07, 'epoch': 14.19}

 89%|████████▊ | 329520/371472 [4:03:06<3:20:18,  3.49it/s]
 89%|████████▊ | 329521/371472 [4:03:06<3:15:35,  3.57it/s]
 89%|████████▊ | 329522/371472 [4:03:06<3:31:39,  3.30it/s]
 89%|████████▊ | 329523/371472 [4:03:06<3:19:54,  3.50it/s]
 89%|████████▊ | 329524/371472 [4:03:07<3:34:39,  3.26it/s]
 89%|████████▊ | 329525/371472 [4:03:07<3:25:17,  3.41it/s]
 89%|████████▊ | 329526/371472 [4:03:07<3:21:49,  3.46it/s]
 89%|████████▊ | 329527/371472 [4:03:08<3:27:03,  3.38it/s]
 89%|████████▊ | 329528/371472 [4:03:08<3:31:31,  3.30it/s]
 89%|████████▊ | 329529/371472 [4:03:08<3:26:14,  3.39it/s]
 89%|████████▊ | 329530/371472 [4:03:09<3:20:08,  3.49it/s]
 89%|████████▊ | 329531/371472 [4:03:09<3:17:51,  3.53it/s]
 89%|████████▊ | 329532/371472 [4:03:09<3:14:40,  3.59it/s]
 89%|████████▊ | 329533/371472 [4:03:09<3:24:00,  3.43it/s]
 89%|████████▊ | 329534/371472 [4:03:10<3:24:05,  3.42it/s]
 89%|████████▊ | 329535/371472 [4:03:10<3:23:46,  3.43it/s]
 89%|████████▊ | 329536/371472 [4:03:10<3:21:03,  3.48it/s]
 89%|████████▊ | 329537/371472 [4:03:11<3:56:55,  2.95it/s]
 89%|████████▊ | 329538/371472 [4:03:11<3:38:24,  3.20it/s]
 89%|████████▊ | 329539/371472 [4:03:11<3:29:45,  3.33it/s]
 89%|████████▊ | 329540/371472 [4:03:12<3:31:50,  3.30it/s]
                                                           
{'loss': 2.5861, 'learning_rate': 2.0164730978904956e-07, 'epoch': 14.19}

 89%|████████▊ | 329540/371472 [4:03:12<3:31:50,  3.30it/s]
 89%|████████▊ | 329541/371472 [4:03:12<3:19:34,  3.50it/s]
 89%|████████▊ | 329542/371472 [4:03:12<3:17:09,  3.54it/s]
 89%|████████▊ | 329543/371472 [4:03:12<3:19:58,  3.49it/s]
 89%|████████▊ | 329544/371472 [4:03:13<3:17:35,  3.54it/s]
 89%|████████▊ | 329545/371472 [4:03:13<3:11:17,  3.65it/s]
 89%|████████▊ | 329546/371472 [4:03:13<3:14:09,  3.60it/s]
 89%|████████▊ | 329547/371472 [4:03:13<3:13:43,  3.61it/s]
 89%|████████▊ | 329548/371472 [4:03:14<3:10:53,  3.66it/s]
 89%|████████▊ | 329549/371472 [4:03:14<3:25:25,  3.40it/s]
 89%|████████▊ | 329550/371472 [4:03:14<3:17:29,  3.54it/s]
 89%|████████▊ | 329551/371472 [4:03:15<3:12:12,  3.64it/s]
 89%|████████▊ | 329552/371472 [4:03:15<3:07:01,  3.74it/s]
 89%|████████▊ | 329553/371472 [4:03:15<3:37:19,  3.21it/s]
 89%|████████▊ | 329554/371472 [4:03:15<3:26:07,  3.39it/s]
 89%|████████▊ | 329555/371472 [4:03:16<3:19:53,  3.49it/s]
 89%|████████▊ | 329556/371472 [4:03:16<3:24:54,  3.41it/s]
 89%|████████▊ | 329557/371472 [4:03:16<3:21:50,  3.46it/s]
 89%|████████▊ | 329558/371472 [4:03:17<3:14:42,  3.59it/s]
 89%|████████▊ | 329559/371472 [4:03:17<3:07:26,  3.73it/s]
 89%|████████▊ | 329560/371472 [4:03:17<3:06:34,  3.74it/s]
                                                           
{'loss': 2.5766, 'learning_rate': 2.015988278135706e-07, 'epoch': 14.19}

 89%|████████▊ | 329560/371472 [4:03:17<3:06:34,  3.74it/s]
 89%|████████▊ | 329561/371472 [4:03:17<3:04:34,  3.78it/s]
 89%|████████▊ | 329562/371472 [4:03:18<3:08:31,  3.71it/s]
 89%|████████▊ | 329563/371472 [4:03:18<3:09:31,  3.69it/s]
 89%|████████▊ | 329564/371472 [4:03:18<3:13:35,  3.61it/s]
 89%|████████▊ | 329565/371472 [4:03:18<3:04:09,  3.79it/s]
 89%|████████▊ | 329566/371472 [4:03:19<3:17:31,  3.54it/s]
 89%|████████▊ | 329567/371472 [4:03:19<3:09:35,  3.68it/s]
 89%|████████▊ | 329568/371472 [4:03:19<3:05:08,  3.77it/s]
 89%|████████▊ | 329569/371472 [4:03:20<3:06:51,  3.74it/s]
 89%|████████▊ | 329570/371472 [4:03:20<3:00:11,  3.88it/s]
 89%|████████▊ | 329571/371472 [4:03:20<3:01:34,  3.85it/s]
 89%|████████▊ | 329572/371472 [4:03:20<3:00:13,  3.87it/s]
 89%|████████▊ | 329573/371472 [4:03:21<3:16:16,  3.56it/s]
 89%|████████▊ | 329574/371472 [4:03:21<3:18:10,  3.52it/s]
 89%|████████▊ | 329575/371472 [4:03:21<3:23:08,  3.44it/s]
 89%|████████▊ | 329576/371472 [4:03:21<3:16:15,  3.56it/s]
 89%|████████▊ | 329577/371472 [4:03:22<3:20:22,  3.48it/s]
 89%|████████▊ | 329578/371472 [4:03:22<3:24:21,  3.42it/s]
 89%|████████▊ | 329579/371472 [4:03:22<3:20:34,  3.48it/s]
 89%|████████▊ | 329580/371472 [4:03:23<3:17:23,  3.54it/s]
                                                           
{'loss': 2.5968, 'learning_rate': 2.0155034583809176e-07, 'epoch': 14.2}

 89%|████████▊ | 329580/371472 [4:03:23<3:17:23,  3.54it/s]
 89%|████████▊ | 329581/371472 [4:03:23<3:21:08,  3.47it/s]
 89%|████████▊ | 329582/371472 [4:03:23<3:16:09,  3.56it/s]
 89%|████████▊ | 329583/371472 [4:03:24<3:28:04,  3.36it/s]
 89%|████████▊ | 329584/371472 [4:03:24<3:25:15,  3.40it/s]
 89%|████████▊ | 329585/371472 [4:03:24<3:34:07,  3.26it/s]
 89%|████████▊ | 329586/371472 [4:03:24<3:24:34,  3.41it/s]
 89%|████████▊ | 329587/371472 [4:03:25<3:35:07,  3.24it/s]
 89%|████████▊ | 329588/371472 [4:03:25<3:34:03,  3.26it/s]
 89%|████████▊ | 329589/371472 [4:03:25<3:26:05,  3.39it/s]
 89%|████████▊ | 329590/371472 [4:03:26<3:35:56,  3.23it/s]
 89%|████████▊ | 329591/371472 [4:03:26<3:30:54,  3.31it/s]
 89%|████████▊ | 329592/371472 [4:03:26<3:26:03,  3.39it/s]
 89%|████████▊ | 329593/371472 [4:03:27<3:27:19,  3.37it/s]
 89%|████████▊ | 329594/371472 [4:03:27<3:29:48,  3.33it/s]
 89%|████████▊ | 329595/371472 [4:03:27<3:32:21,  3.29it/s]
 89%|████████▊ | 329596/371472 [4:03:27<3:26:25,  3.38it/s]
 89%|████████▊ | 329597/371472 [4:03:28<3:23:45,  3.43it/s]
 89%|████████▊ | 329598/371472 [4:03:28<3:32:19,  3.29it/s]
 89%|████████▊ | 329599/371472 [4:03:28<3:38:13,  3.20it/s]
 89%|████████▊ | 329600/371472 [4:03:29<3:24:08,  3.42it/s]
                                                           
{'loss': 2.5368, 'learning_rate': 2.0150186386261283e-07, 'epoch': 14.2}

 89%|████████▊ | 329600/371472 [4:03:29<3:24:08,  3.42it/s]
 89%|████████▊ | 329601/371472 [4:03:29<3:19:12,  3.50it/s]
 89%|████████▊ | 329602/371472 [4:03:29<3:23:21,  3.43it/s]
 89%|████████▊ | 329603/371472 [4:03:29<3:24:01,  3.42it/s]
 89%|████████▊ | 329604/371472 [4:03:30<3:21:45,  3.46it/s]
 89%|████████▊ | 329605/371472 [4:03:30<3:18:23,  3.52it/s]
 89%|████████▊ | 329606/371472 [4:03:30<3:23:34,  3.43it/s]
 89%|████████▊ | 329607/371472 [4:03:31<3:19:11,  3.50it/s]
 89%|████████▊ | 329608/371472 [4:03:31<3:13:53,  3.60it/s]
 89%|████████▊ | 329609/371472 [4:03:31<3:16:50,  3.54it/s]
 89%|████████▊ | 329610/371472 [4:03:31<3:10:26,  3.66it/s]
 89%|████████▊ | 329611/371472 [4:03:32<3:18:24,  3.52it/s]
 89%|████████▊ | 329612/371472 [4:03:32<3:09:45,  3.68it/s]
 89%|████████▊ | 329613/371472 [4:03:32<3:14:18,  3.59it/s]
 89%|████████▊ | 329614/371472 [4:03:33<3:14:45,  3.58it/s]
 89%|████████▊ | 329615/371472 [4:03:33<3:16:21,  3.55it/s]
 89%|████████▊ | 329616/371472 [4:03:33<4:04:54,  2.85it/s]
 89%|████████▊ | 329617/371472 [4:03:34<3:54:13,  2.98it/s]
 89%|████████▊ | 329618/371472 [4:03:34<3:38:56,  3.19it/s]
 89%|████████▊ | 329619/371472 [4:03:34<3:27:59,  3.35it/s]
 89%|████████▊ | 329620/371472 [4:03:34<3:17:09,  3.54it/s]
                                                           
{'loss': 2.5951, 'learning_rate': 2.0145338188713398e-07, 'epoch': 14.2}

 89%|████████▊ | 329620/371472 [4:03:34<3:17:09,  3.54it/s]
 89%|████████▊ | 329621/371472 [4:03:35<3:14:52,  3.58it/s]
 89%|████████▊ | 329622/371472 [4:03:35<3:26:12,  3.38it/s]
 89%|████████▊ | 329623/371472 [4:03:35<3:20:32,  3.48it/s]
 89%|████████▊ | 329624/371472 [4:03:36<3:26:44,  3.37it/s]
 89%|████████▊ | 329625/371472 [4:03:36<3:21:47,  3.46it/s]
 89%|████████▊ | 329626/371472 [4:03:36<3:20:45,  3.47it/s]
 89%|████████▊ | 329627/371472 [4:03:36<3:12:13,  3.63it/s]
 89%|████████▊ | 329628/371472 [4:03:37<3:05:45,  3.75it/s]
 89%|████████▊ | 329629/371472 [4:03:37<3:04:39,  3.78it/s]
 89%|████████▊ | 329630/371472 [4:03:37<3:03:36,  3.80it/s]
 89%|████████▊ | 329631/371472 [4:03:37<3:02:03,  3.83it/s]
 89%|████████▊ | 329632/371472 [4:03:38<2:56:24,  3.95it/s]
 89%|████████▊ | 329633/371472 [4:03:38<2:55:10,  3.98it/s]
 89%|████████▊ | 329634/371472 [4:03:38<3:37:14,  3.21it/s]
 89%|████████▊ | 329635/371472 [4:03:39<3:23:51,  3.42it/s]
 89%|████████▊ | 329636/371472 [4:03:39<3:14:22,  3.59it/s]
 89%|████████▊ | 329637/371472 [4:03:39<3:17:24,  3.53it/s]
 89%|████████▊ | 329638/371472 [4:03:39<3:14:47,  3.58it/s]
 89%|████████▊ | 329639/371472 [4:03:40<3:23:01,  3.43it/s]
 89%|████████▊ | 329640/371472 [4:03:40<3:25:43,  3.39it/s]
                                                           
{'loss': 2.6412, 'learning_rate': 2.0140489991165502e-07, 'epoch': 14.2}

 89%|████████▊ | 329640/371472 [4:03:40<3:25:43,  3.39it/s]
 89%|████████▊ | 329641/371472 [4:03:40<3:27:12,  3.36it/s]
 89%|████████▊ | 329642/371472 [4:03:41<3:20:12,  3.48it/s]
 89%|████████▊ | 329643/371472 [4:03:41<3:17:46,  3.52it/s]
 89%|████████▊ | 329644/371472 [4:03:41<3:23:25,  3.43it/s]
 89%|████████▊ | 329645/371472 [4:03:41<3:17:39,  3.53it/s]
 89%|████████▊ | 329646/371472 [4:03:42<3:23:42,  3.42it/s]
 89%|████████▊ | 329647/371472 [4:03:42<3:27:23,  3.36it/s]
 89%|████████▊ | 329648/371472 [4:03:42<3:16:02,  3.56it/s]
 89%|████████▊ | 329649/371472 [4:03:43<3:11:51,  3.63it/s]
 89%|████████▊ | 329650/371472 [4:03:43<3:11:53,  3.63it/s]
 89%|████████▊ | 329651/371472 [4:03:43<3:14:20,  3.59it/s]
 89%|████████▊ | 329652/371472 [4:03:43<3:13:56,  3.59it/s]
 89%|████████▊ | 329653/371472 [4:03:44<3:14:54,  3.58it/s]
 89%|████████▊ | 329654/371472 [4:03:44<3:14:37,  3.58it/s]
 89%|████████▊ | 329655/371472 [4:03:44<3:13:09,  3.61it/s]
 89%|████████▊ | 329656/371472 [4:03:45<3:06:20,  3.74it/s]
 89%|████████▊ | 329657/371472 [4:03:45<3:06:10,  3.74it/s]
 89%|████████▊ | 329658/371472 [4:03:45<3:00:51,  3.85it/s]
 89%|████████▊ | 329659/371472 [4:03:45<3:06:20,  3.74it/s]
 89%|████████▊ | 329660/371472 [4:03:46<3:08:36,  3.69it/s]
                                                           
{'loss': 2.682, 'learning_rate': 2.013564179361762e-07, 'epoch': 14.2}

 89%|████████▊ | 329660/371472 [4:03:46<3:08:36,  3.69it/s]
 89%|████████▊ | 329661/371472 [4:03:46<3:03:11,  3.80it/s]
 89%|████████▊ | 329662/371472 [4:03:46<3:20:23,  3.48it/s]
 89%|████████▊ | 329663/371472 [4:03:46<3:19:55,  3.49it/s]
 89%|████████▊ | 329664/371472 [4:03:47<3:28:45,  3.34it/s]
 89%|████████▊ | 329665/371472 [4:03:47<3:28:42,  3.34it/s]
 89%|████████▊ | 329666/371472 [4:03:47<3:16:54,  3.54it/s]
 89%|████████▊ | 329667/371472 [4:03:48<3:19:36,  3.49it/s]
 89%|████████▊ | 329668/371472 [4:03:48<3:14:13,  3.59it/s]
 89%|████████▊ | 329669/371472 [4:03:48<3:18:02,  3.52it/s]
 89%|████████▊ | 329670/371472 [4:03:48<3:14:06,  3.59it/s]
 89%|████████▊ | 329671/371472 [4:03:49<3:08:39,  3.69it/s]
 89%|████████▊ | 329672/371472 [4:03:49<3:09:23,  3.68it/s]
 89%|████████▊ | 329673/371472 [4:03:49<3:15:42,  3.56it/s]
 89%|████████▊ | 329674/371472 [4:03:50<3:17:48,  3.52it/s]
 89%|████████▊ | 329675/371472 [4:03:50<3:33:40,  3.26it/s]
 89%|████████▊ | 329676/371472 [4:03:50<3:25:00,  3.40it/s]
 89%|████████▊ | 329677/371472 [4:03:50<3:19:54,  3.48it/s]
 89%|████████▊ | 329678/371472 [4:03:51<3:18:40,  3.51it/s]
 89%|████████▊ | 329679/371472 [4:03:51<3:13:19,  3.60it/s]
 89%|████████▊ | 329680/371472 [4:03:51<3:07:15,  3.72it/s]
                                                           
{'loss': 2.6015, 'learning_rate': 2.0130793596069725e-07, 'epoch': 14.2}

 89%|████████▊ | 329680/371472 [4:03:51<3:07:15,  3.72it/s]
 89%|████████▊ | 329681/371472 [4:03:52<3:03:24,  3.80it/s]
 89%|████████▉ | 329682/371472 [4:03:52<3:06:17,  3.74it/s]
 89%|████████▉ | 329683/371472 [4:03:52<2:59:19,  3.88it/s]
 89%|████████▉ | 329684/371472 [4:03:52<3:01:04,  3.85it/s]
 89%|████████▉ | 329685/371472 [4:03:53<3:27:50,  3.35it/s]
 89%|████████▉ | 329686/371472 [4:03:53<3:19:17,  3.49it/s]
 89%|████████▉ | 329687/371472 [4:03:53<3:09:53,  3.67it/s]
 89%|████████▉ | 329688/371472 [4:03:53<3:06:30,  3.73it/s]
 89%|████████▉ | 329689/371472 [4:03:54<3:03:12,  3.80it/s]
 89%|████████▉ | 329690/371472 [4:03:54<3:02:06,  3.82it/s]
 89%|████████▉ | 329691/371472 [4:03:54<3:02:38,  3.81it/s]
 89%|████████▉ | 329692/371472 [4:03:54<3:00:52,  3.85it/s]
 89%|████████▉ | 329693/371472 [4:03:55<3:05:21,  3.76it/s]
 89%|████████▉ | 329694/371472 [4:03:55<3:06:41,  3.73it/s]
 89%|████████▉ | 329695/371472 [4:03:55<3:21:45,  3.45it/s]
 89%|████████▉ | 329696/371472 [4:03:56<3:20:29,  3.47it/s]
 89%|████████▉ | 329697/371472 [4:03:56<3:13:32,  3.60it/s]
 89%|████████▉ | 329698/371472 [4:03:56<3:31:19,  3.29it/s]
 89%|████████▉ | 329699/371472 [4:03:56<3:17:46,  3.52it/s]
 89%|████████▉ | 329700/371472 [4:03:57<3:34:10,  3.25it/s]
                                                           
{'loss': 2.8202, 'learning_rate': 2.012594539852184e-07, 'epoch': 14.2}

 89%|████████▉ | 329700/371472 [4:03:57<3:34:10,  3.25it/s]
 89%|████████▉ | 329701/371472 [4:03:57<3:21:54,  3.45it/s]
 89%|████████▉ | 329702/371472 [4:03:57<3:24:28,  3.40it/s]
 89%|████████▉ | 329703/371472 [4:03:58<3:33:33,  3.26it/s]
 89%|████████▉ | 329704/371472 [4:03:58<3:29:16,  3.33it/s]
 89%|████████▉ | 329705/371472 [4:03:58<3:25:21,  3.39it/s]
 89%|████████▉ | 329706/371472 [4:03:59<3:24:46,  3.40it/s]
 89%|████████▉ | 329707/371472 [4:03:59<3:30:30,  3.31it/s]
 89%|████████▉ | 329708/371472 [4:03:59<3:28:50,  3.33it/s]
 89%|████████▉ | 329709/371472 [4:04:00<3:31:20,  3.29it/s]
 89%|████████▉ | 329710/371472 [4:04:00<3:37:51,  3.19it/s]
 89%|████████▉ | 329711/371472 [4:04:00<3:31:29,  3.29it/s]
 89%|████████▉ | 329712/371472 [4:04:00<3:17:10,  3.53it/s]
 89%|████████▉ | 329713/371472 [4:04:01<3:13:03,  3.61it/s]
 89%|████████▉ | 329714/371472 [4:04:01<3:10:27,  3.65it/s]
 89%|████████▉ | 329715/371472 [4:04:01<3:05:07,  3.76it/s]
 89%|████████▉ | 329716/371472 [4:04:01<3:03:18,  3.80it/s]
 89%|████████▉ | 329717/371472 [4:04:02<3:09:56,  3.66it/s]
 89%|████████▉ | 329718/371472 [4:04:02<3:06:03,  3.74it/s]
 89%|████████▉ | 329719/371472 [4:04:02<3:04:45,  3.77it/s]
 89%|████████▉ | 329720/371472 [4:04:02<3:01:52,  3.83it/s]
                                                           
{'loss': 2.6653, 'learning_rate': 2.0121097200973947e-07, 'epoch': 14.2}

 89%|████████▉ | 329720/371472 [4:04:02<3:01:52,  3.83it/s]
 89%|████████▉ | 329721/371472 [4:04:03<3:03:52,  3.78it/s]
 89%|████████▉ | 329722/371472 [4:04:03<2:57:59,  3.91it/s]
 89%|████████▉ | 329723/371472 [4:04:03<3:01:02,  3.84it/s]
 89%|████████▉ | 329724/371472 [4:04:04<3:13:39,  3.59it/s]
 89%|████████▉ | 329725/371472 [4:04:04<3:25:11,  3.39it/s]
 89%|████████▉ | 329726/371472 [4:04:04<3:20:16,  3.47it/s]
 89%|████████▉ | 329727/371472 [4:04:04<3:18:44,  3.50it/s]
 89%|████████▉ | 329728/371472 [4:04:05<3:18:49,  3.50it/s]
 89%|████████▉ | 329729/371472 [4:04:05<3:16:58,  3.53it/s]
 89%|████████▉ | 329730/371472 [4:04:05<3:17:42,  3.52it/s]
 89%|████████▉ | 329731/371472 [4:04:06<3:25:43,  3.38it/s]
 89%|████████▉ | 329732/371472 [4:04:06<3:16:05,  3.55it/s]
 89%|████████▉ | 329733/371472 [4:04:06<3:16:37,  3.54it/s]
 89%|████████▉ | 329734/371472 [4:04:06<3:15:04,  3.57it/s]
 89%|████████▉ | 329735/371472 [4:04:07<3:13:06,  3.60it/s]
 89%|████████▉ | 329736/371472 [4:04:07<3:17:08,  3.53it/s]
 89%|████████▉ | 329737/371472 [4:04:07<3:14:25,  3.58it/s]
 89%|████████▉ | 329738/371472 [4:04:08<3:18:42,  3.50it/s]
 89%|████████▉ | 329739/371472 [4:04:08<3:09:24,  3.67it/s]
 89%|████████▉ | 329740/371472 [4:04:08<3:05:18,  3.75it/s]
                                                           
{'loss': 2.558, 'learning_rate': 2.0116249003426062e-07, 'epoch': 14.2}

 89%|████████▉ | 329740/371472 [4:04:08<3:05:18,  3.75it/s]
 89%|████████▉ | 329741/371472 [4:04:08<3:06:25,  3.73it/s]
 89%|████████▉ | 329742/371472 [4:04:09<3:01:36,  3.83it/s]
 89%|████████▉ | 329743/371472 [4:04:09<3:02:53,  3.80it/s]
 89%|████████▉ | 329744/371472 [4:04:09<3:02:39,  3.81it/s]
 89%|████████▉ | 329745/371472 [4:04:09<3:04:11,  3.78it/s]
 89%|████████▉ | 329746/371472 [4:04:10<3:51:51,  3.00it/s]
 89%|████████▉ | 329747/371472 [4:04:10<3:38:30,  3.18it/s]
 89%|████████▉ | 329748/371472 [4:04:10<3:37:42,  3.19it/s]
 89%|████████▉ | 329749/371472 [4:04:11<3:37:31,  3.20it/s]
 89%|████████▉ | 329750/371472 [4:04:11<3:36:35,  3.21it/s]
 89%|████████▉ | 329751/371472 [4:04:11<3:31:25,  3.29it/s]
 89%|████████▉ | 329752/371472 [4:04:12<3:25:22,  3.39it/s]
 89%|████████▉ | 329753/371472 [4:04:12<3:14:06,  3.58it/s]
 89%|████████▉ | 329754/371472 [4:04:12<3:25:51,  3.38it/s]
 89%|████████▉ | 329755/371472 [4:04:12<3:20:29,  3.47it/s]
 89%|████████▉ | 329756/371472 [4:04:13<3:16:11,  3.54it/s]
 89%|████████▉ | 329757/371472 [4:04:13<3:11:25,  3.63it/s]
 89%|████████▉ | 329758/371472 [4:04:13<3:20:24,  3.47it/s]
 89%|████████▉ | 329759/371472 [4:04:14<3:12:59,  3.60it/s]
 89%|████████▉ | 329760/371472 [4:04:14<3:11:44,  3.63it/s]
                                                           
{'loss': 2.7746, 'learning_rate': 2.0111400805878166e-07, 'epoch': 14.2}

 89%|████████▉ | 329760/371472 [4:04:14<3:11:44,  3.63it/s]
 89%|████████▉ | 329761/371472 [4:04:14<3:13:07,  3.60it/s]
 89%|████████▉ | 329762/371472 [4:04:15<3:30:41,  3.30it/s]
 89%|████████▉ | 329763/371472 [4:04:15<3:24:13,  3.40it/s]
 89%|████████▉ | 329764/371472 [4:04:15<3:20:22,  3.47it/s]
 89%|████████▉ | 329765/371472 [4:04:15<3:30:07,  3.31it/s]
 89%|████████▉ | 329766/371472 [4:04:16<3:23:30,  3.42it/s]
 89%|████████▉ | 329767/371472 [4:04:16<3:24:44,  3.40it/s]
 89%|████████▉ | 329768/371472 [4:04:16<3:29:13,  3.32it/s]
 89%|████████▉ | 329769/371472 [4:04:17<3:24:43,  3.40it/s]
 89%|████████▉ | 329770/371472 [4:04:17<3:16:55,  3.53it/s]
 89%|████████▉ | 329771/371472 [4:04:17<3:09:53,  3.66it/s]
 89%|████████▉ | 329772/371472 [4:04:17<3:07:23,  3.71it/s]
 89%|████████▉ | 329773/371472 [4:04:18<3:04:13,  3.77it/s]
 89%|████████▉ | 329774/371472 [4:04:18<3:04:19,  3.77it/s]
 89%|████████▉ | 329775/371472 [4:04:18<3:00:47,  3.84it/s]
 89%|████████▉ | 329776/371472 [4:04:18<3:04:11,  3.77it/s]
 89%|████████▉ | 329777/371472 [4:04:19<3:23:52,  3.41it/s]
 89%|████████▉ | 329778/371472 [4:04:19<3:27:16,  3.35it/s]
 89%|████████▉ | 329779/371472 [4:04:19<3:16:21,  3.54it/s]
 89%|████████▉ | 329780/371472 [4:04:20<3:20:36,  3.46it/s]
                                                           
{'loss': 2.5992, 'learning_rate': 2.0106552608330284e-07, 'epoch': 14.2}

 89%|████████▉ | 329780/371472 [4:04:20<3:20:36,  3.46it/s]
 89%|████████▉ | 329781/371472 [4:04:20<3:43:21,  3.11it/s]
 89%|████████▉ | 329782/371472 [4:04:20<3:32:28,  3.27it/s]
 89%|████████▉ | 329783/371472 [4:04:21<3:26:41,  3.36it/s]
 89%|████████▉ | 329784/371472 [4:04:21<3:28:03,  3.34it/s]
 89%|████████▉ | 329785/371472 [4:04:21<3:14:35,  3.57it/s]
 89%|████████▉ | 329786/371472 [4:04:21<3:14:05,  3.58it/s]
 89%|████████▉ | 329787/371472 [4:04:22<3:17:50,  3.51it/s]
 89%|████████▉ | 329788/371472 [4:04:22<3:13:40,  3.59it/s]
 89%|████████▉ | 329789/371472 [4:04:22<3:10:51,  3.64it/s]
 89%|████████▉ | 329790/371472 [4:04:22<3:08:10,  3.69it/s]
 89%|████████▉ | 329791/371472 [4:04:23<3:07:20,  3.71it/s]
 89%|████████▉ | 329792/371472 [4:04:23<3:09:13,  3.67it/s]
 89%|████████▉ | 329793/371472 [4:04:23<3:30:47,  3.30it/s]
 89%|████████▉ | 329794/371472 [4:04:24<3:31:57,  3.28it/s]
 89%|████████▉ | 329795/371472 [4:04:24<3:27:07,  3.35it/s]
 89%|████████▉ | 329796/371472 [4:04:24<3:29:02,  3.32it/s]
 89%|████████▉ | 329797/371472 [4:04:25<3:34:57,  3.23it/s]
 89%|████████▉ | 329798/371472 [4:04:25<3:32:28,  3.27it/s]
 89%|████████▉ | 329799/371472 [4:04:25<3:27:13,  3.35it/s]
 89%|████████▉ | 329800/371472 [4:04:25<3:24:37,  3.39it/s]
                                                           
{'loss': 2.4453, 'learning_rate': 2.010170441078239e-07, 'epoch': 14.21}

 89%|████████▉ | 329800/371472 [4:04:25<3:24:37,  3.39it/s]
 89%|████████▉ | 329801/371472 [4:04:26<3:32:22,  3.27it/s]
 89%|████████▉ | 329802/371472 [4:04:26<3:25:09,  3.39it/s]
 89%|████████▉ | 329803/371472 [4:04:26<3:18:19,  3.50it/s]
 89%|████████▉ | 329804/371472 [4:04:27<3:18:30,  3.50it/s]
 89%|████████▉ | 329805/371472 [4:04:27<3:16:59,  3.53it/s]
 89%|████████▉ | 329806/371472 [4:04:27<3:20:50,  3.46it/s]
 89%|████████▉ | 329807/371472 [4:04:27<3:21:16,  3.45it/s]
 89%|████████▉ | 329808/371472 [4:04:28<3:22:42,  3.43it/s]
 89%|████████▉ | 329809/371472 [4:04:28<3:17:10,  3.52it/s]
 89%|████████▉ | 329810/371472 [4:04:28<3:14:41,  3.57it/s]
 89%|████████▉ | 329811/371472 [4:04:29<3:06:56,  3.71it/s]
 89%|████████▉ | 329812/371472 [4:04:29<3:12:09,  3.61it/s]
 89%|████████▉ | 329813/371472 [4:04:29<3:11:44,  3.62it/s]
 89%|████████▉ | 329814/371472 [4:04:29<3:09:10,  3.67it/s]
 89%|████████▉ | 329815/371472 [4:04:30<3:08:40,  3.68it/s]
 89%|████████▉ | 329816/371472 [4:04:30<3:05:08,  3.75it/s]
 89%|████████▉ | 329817/371472 [4:04:30<3:08:14,  3.69it/s]
 89%|████████▉ | 329818/371472 [4:04:30<3:06:39,  3.72it/s]
 89%|████████▉ | 329819/371472 [4:04:31<3:13:23,  3.59it/s]
 89%|████████▉ | 329820/371472 [4:04:31<3:14:38,  3.57it/s]
                                                           
{'loss': 2.6176, 'learning_rate': 2.0096856213234504e-07, 'epoch': 14.21}

 89%|████████▉ | 329820/371472 [4:04:31<3:14:38,  3.57it/s]
 89%|████████▉ | 329821/371472 [4:04:31<3:13:09,  3.59it/s]
 89%|████████▉ | 329822/371472 [4:04:32<3:13:36,  3.59it/s]
 89%|████████▉ | 329823/371472 [4:04:32<3:11:03,  3.63it/s]
 89%|████████▉ | 329824/371472 [4:04:32<3:14:27,  3.57it/s]
 89%|████████▉ | 329825/371472 [4:04:32<3:08:03,  3.69it/s]
 89%|████████▉ | 329826/371472 [4:04:33<3:12:09,  3.61it/s]
 89%|████████▉ | 329827/371472 [4:04:33<3:08:13,  3.69it/s]
 89%|████████▉ | 329828/371472 [4:04:33<3:10:54,  3.64it/s]
 89%|████████▉ | 329829/371472 [4:04:33<3:06:56,  3.71it/s]
 89%|████████▉ | 329830/371472 [4:04:34<3:12:16,  3.61it/s]
 89%|████████▉ | 329831/371472 [4:04:34<3:08:07,  3.69it/s]
 89%|████████▉ | 329832/371472 [4:04:34<3:08:38,  3.68it/s]
 89%|████████▉ | 329833/371472 [4:04:35<3:12:38,  3.60it/s]
 89%|████████▉ | 329834/371472 [4:04:35<3:08:45,  3.68it/s]
 89%|████████▉ | 329835/371472 [4:04:35<3:02:40,  3.80it/s]
 89%|████████▉ | 329836/371472 [4:04:35<3:05:24,  3.74it/s]
 89%|████████▉ | 329837/371472 [4:04:36<3:13:56,  3.58it/s]
 89%|████████▉ | 329838/371472 [4:04:36<3:10:15,  3.65it/s]
 89%|████████▉ | 329839/371472 [4:04:36<3:12:33,  3.60it/s]
 89%|████████▉ | 329840/371472 [4:04:37<3:27:18,  3.35it/s]
                                                           
{'loss': 2.5654, 'learning_rate': 2.0092008015686608e-07, 'epoch': 14.21}

 89%|████████▉ | 329840/371472 [4:04:37<3:27:18,  3.35it/s]
 89%|████████▉ | 329841/371472 [4:04:37<3:16:12,  3.54it/s]
 89%|████████▉ | 329842/371472 [4:04:37<3:36:20,  3.21it/s]
 89%|████████▉ | 329843/371472 [4:04:38<3:50:22,  3.01it/s]
 89%|████████▉ | 329844/371472 [4:04:38<3:46:14,  3.07it/s]
 89%|████████▉ | 329845/371472 [4:04:38<3:43:16,  3.11it/s]
 89%|████████▉ | 329846/371472 [4:04:38<3:32:31,  3.26it/s]
 89%|████████▉ | 329847/371472 [4:04:39<3:20:17,  3.46it/s]
 89%|████████▉ | 329848/371472 [4:04:39<3:32:25,  3.27it/s]
 89%|████████▉ | 329849/371472 [4:04:39<3:44:39,  3.09it/s]
 89%|████████▉ | 329850/371472 [4:04:40<3:47:39,  3.05it/s]
 89%|████████▉ | 329851/371472 [4:04:40<3:37:30,  3.19it/s]
 89%|████████▉ | 329852/371472 [4:04:40<3:46:30,  3.06it/s]
 89%|████████▉ | 329853/371472 [4:04:41<3:31:31,  3.28it/s]
 89%|████████▉ | 329854/371472 [4:04:41<3:26:07,  3.37it/s]
 89%|████████▉ | 329855/371472 [4:04:41<3:18:21,  3.50it/s]
 89%|████████▉ | 329856/371472 [4:04:42<3:25:36,  3.37it/s]
 89%|████████▉ | 329857/371472 [4:04:42<3:21:01,  3.45it/s]
 89%|████████▉ | 329858/371472 [4:04:42<3:19:19,  3.48it/s]
 89%|████████▉ | 329859/371472 [4:04:42<3:23:02,  3.42it/s]
 89%|████████▉ | 329860/371472 [4:04:43<3:16:31,  3.53it/s]
                                                           
{'loss': 2.5254, 'learning_rate': 2.0087159818138729e-07, 'epoch': 14.21}

 89%|████████▉ | 329860/371472 [4:04:43<3:16:31,  3.53it/s]
 89%|████████▉ | 329861/371472 [4:04:43<3:25:03,  3.38it/s]
 89%|████████▉ | 329862/371472 [4:04:43<3:21:51,  3.44it/s]
 89%|████████▉ | 329863/371472 [4:04:44<3:24:06,  3.40it/s]
 89%|████████▉ | 329864/371472 [4:04:44<3:20:50,  3.45it/s]
 89%|████████▉ | 329865/371472 [4:04:44<3:14:50,  3.56it/s]
 89%|████████▉ | 329866/371472 [4:04:44<3:15:11,  3.55it/s]
 89%|████████▉ | 329867/371472 [4:04:45<3:11:12,  3.63it/s]
 89%|████████▉ | 329868/371472 [4:04:45<3:07:50,  3.69it/s]
 89%|████████▉ | 329869/371472 [4:04:45<3:19:44,  3.47it/s]
 89%|████████▉ | 329870/371472 [4:04:46<3:26:01,  3.37it/s]
 89%|████████▉ | 329871/371472 [4:04:46<3:17:00,  3.52it/s]
 89%|████████▉ | 329872/371472 [4:04:46<3:13:00,  3.59it/s]
 89%|████████▉ | 329873/371472 [4:04:46<3:13:27,  3.58it/s]
 89%|████████▉ | 329874/371472 [4:04:47<3:13:46,  3.58it/s]
 89%|████████▉ | 329875/371472 [4:04:47<3:18:11,  3.50it/s]
 89%|████████▉ | 329876/371472 [4:04:47<3:17:45,  3.51it/s]
 89%|████████▉ | 329877/371472 [4:04:47<3:09:33,  3.66it/s]
 89%|████████▉ | 329878/371472 [4:04:48<3:18:34,  3.49it/s]
 89%|████████▉ | 329879/371472 [4:04:48<3:16:19,  3.53it/s]
 89%|████████▉ | 329880/371472 [4:04:48<3:17:24,  3.51it/s]
                                                           
{'loss': 2.6811, 'learning_rate': 2.0082311620590833e-07, 'epoch': 14.21}

 89%|████████▉ | 329880/371472 [4:04:48<3:17:24,  3.51it/s]
 89%|████████▉ | 329881/371472 [4:04:49<3:24:02,  3.40it/s]
 89%|████████▉ | 329882/371472 [4:04:49<3:25:55,  3.37it/s]
 89%|████████▉ | 329883/371472 [4:04:49<3:32:08,  3.27it/s]
 89%|████████▉ | 329884/371472 [4:04:50<3:23:51,  3.40it/s]
 89%|████████▉ | 329885/371472 [4:04:50<3:32:31,  3.26it/s]
 89%|████████▉ | 329886/371472 [4:04:50<3:21:45,  3.44it/s]
 89%|████████▉ | 329887/371472 [4:04:50<3:23:43,  3.40it/s]
 89%|████████▉ | 329888/371472 [4:04:51<3:15:09,  3.55it/s]
 89%|████████▉ | 329889/371472 [4:04:51<3:21:48,  3.43it/s]
 89%|████████▉ | 329890/371472 [4:04:51<3:22:17,  3.43it/s]
 89%|████████▉ | 329891/371472 [4:04:52<3:17:25,  3.51it/s]
 89%|████████▉ | 329892/371472 [4:04:52<3:17:18,  3.51it/s]
 89%|████████▉ | 329893/371472 [4:04:52<3:17:18,  3.51it/s]
 89%|████████▉ | 329894/371472 [4:04:52<3:29:03,  3.31it/s]
 89%|████████▉ | 329895/371472 [4:04:53<3:18:26,  3.49it/s]
 89%|████████▉ | 329896/371472 [4:04:53<3:36:31,  3.20it/s]
 89%|████████▉ | 329897/371472 [4:04:53<3:31:55,  3.27it/s]
 89%|████████▉ | 329898/371472 [4:04:54<3:22:32,  3.42it/s]
 89%|████████▉ | 329899/371472 [4:04:54<3:19:46,  3.47it/s]
 89%|████████▉ | 329900/371472 [4:04:54<3:10:02,  3.65it/s]
                                                           
{'loss': 2.4981, 'learning_rate': 2.0077463423042938e-07, 'epoch': 14.21}

 89%|████████▉ | 329900/371472 [4:04:54<3:10:02,  3.65it/s]
 89%|████████▉ | 329901/371472 [4:04:55<3:29:18,  3.31it/s]
 89%|████████▉ | 329902/371472 [4:04:55<3:18:20,  3.49it/s]
 89%|████████▉ | 329903/371472 [4:04:55<3:24:21,  3.39it/s]
 89%|████████▉ | 329904/371472 [4:04:55<3:25:59,  3.36it/s]
 89%|████████▉ | 329905/371472 [4:04:56<3:24:13,  3.39it/s]
 89%|████████▉ | 329906/371472 [4:04:56<3:28:36,  3.32it/s]
 89%|████████▉ | 329907/371472 [4:04:56<3:36:27,  3.20it/s]
 89%|████████▉ | 329908/371472 [4:04:57<3:27:58,  3.33it/s]
 89%|████████▉ | 329909/371472 [4:04:57<3:22:22,  3.42it/s]
 89%|████████▉ | 329910/371472 [4:04:57<3:13:56,  3.57it/s]
 89%|████████▉ | 329911/371472 [4:04:57<3:17:13,  3.51it/s]
 89%|████████▉ | 329912/371472 [4:04:58<3:10:14,  3.64it/s]
 89%|████████▉ | 329913/371472 [4:04:58<3:15:08,  3.55it/s]
 89%|████████▉ | 329914/371472 [4:04:58<3:19:27,  3.47it/s]
 89%|████████▉ | 329915/371472 [4:04:59<3:15:32,  3.54it/s]
 89%|████████▉ | 329916/371472 [4:04:59<3:12:47,  3.59it/s]
 89%|████████▉ | 329917/371472 [4:04:59<3:07:43,  3.69it/s]
 89%|████████▉ | 329918/371472 [4:04:59<3:13:01,  3.59it/s]
 89%|████████▉ | 329919/371472 [4:05:00<3:11:25,  3.62it/s]
 89%|████████▉ | 329920/371472 [4:05:00<3:10:28,  3.64it/s]
                                                           
{'loss': 2.8439, 'learning_rate': 2.0072615225495055e-07, 'epoch': 14.21}

 89%|████████▉ | 329920/371472 [4:05:00<3:10:28,  3.64it/s]
 89%|████████▉ | 329921/371472 [4:05:00<3:05:39,  3.73it/s]
 89%|████████▉ | 329922/371472 [4:05:00<3:04:36,  3.75it/s]
 89%|████████▉ | 329923/371472 [4:05:01<2:58:48,  3.87it/s]
 89%|████████▉ | 329924/371472 [4:05:01<3:06:15,  3.72it/s]
 89%|████████▉ | 329925/371472 [4:05:01<3:12:48,  3.59it/s]
 89%|████████▉ | 329926/371472 [4:05:02<3:09:38,  3.65it/s]
 89%|████████▉ | 329927/371472 [4:05:02<3:14:53,  3.55it/s]
 89%|████████▉ | 329928/371472 [4:05:02<3:06:57,  3.70it/s]
 89%|████████▉ | 329929/371472 [4:05:02<3:03:03,  3.78it/s]
 89%|████████▉ | 329930/371472 [4:05:03<2:55:53,  3.94it/s]
 89%|████████▉ | 329931/371472 [4:05:03<2:58:16,  3.88it/s]
 89%|████████▉ | 329932/371472 [4:05:03<2:55:59,  3.93it/s]
 89%|████████▉ | 329933/371472 [4:05:03<2:57:54,  3.89it/s]
 89%|████████▉ | 329934/371472 [4:05:04<3:03:06,  3.78it/s]
 89%|████████▉ | 329935/371472 [4:05:04<3:00:10,  3.84it/s]
 89%|████████▉ | 329936/371472 [4:05:04<3:04:14,  3.76it/s]
 89%|████████▉ | 329937/371472 [4:05:04<3:02:02,  3.80it/s]
 89%|████████▉ | 329938/371472 [4:05:05<3:04:30,  3.75it/s]
 89%|████████▉ | 329939/371472 [4:05:05<3:13:32,  3.58it/s]
 89%|████████▉ | 329940/371472 [4:05:05<3:23:19,  3.40it/s]
                                                           
{'loss': 2.6659, 'learning_rate': 2.006776702794716e-07, 'epoch': 14.21}

 89%|████████▉ | 329940/371472 [4:05:05<3:23:19,  3.40it/s]
 89%|████████▉ | 329941/371472 [4:05:06<3:25:43,  3.36it/s]
 89%|████████▉ | 329942/371472 [4:05:06<3:26:51,  3.35it/s]
 89%|████████▉ | 329943/371472 [4:05:06<3:31:28,  3.27it/s]
 89%|████████▉ | 329944/371472 [4:05:07<3:25:15,  3.37it/s]
 89%|████████▉ | 329945/371472 [4:05:07<3:23:46,  3.40it/s]
 89%|████████▉ | 329946/371472 [4:05:07<3:13:57,  3.57it/s]
 89%|████████▉ | 329947/371472 [4:05:07<3:07:23,  3.69it/s]
 89%|████████▉ | 329948/371472 [4:05:08<3:06:15,  3.72it/s]
 89%|████████▉ | 329949/371472 [4:05:08<3:12:32,  3.59it/s]
 89%|████████▉ | 329950/371472 [4:05:08<3:23:28,  3.40it/s]
 89%|████████▉ | 329951/371472 [4:05:09<3:25:23,  3.37it/s]
 89%|████████▉ | 329952/371472 [4:05:09<3:33:11,  3.25it/s]
 89%|████████▉ | 329953/371472 [4:05:09<3:40:10,  3.14it/s]
 89%|████████▉ | 329954/371472 [4:05:09<3:36:11,  3.20it/s]
 89%|████████▉ | 329955/371472 [4:05:10<3:25:45,  3.36it/s]
 89%|████████▉ | 329956/371472 [4:05:10<3:19:37,  3.47it/s]
 89%|████████▉ | 329957/371472 [4:05:10<3:09:17,  3.66it/s]
 89%|████████▉ | 329958/371472 [4:05:11<3:09:04,  3.66it/s]
 89%|████████▉ | 329959/371472 [4:05:11<3:14:13,  3.56it/s]
 89%|████████▉ | 329960/371472 [4:05:11<3:27:09,  3.34it/s]
                                                           
{'loss': 2.454, 'learning_rate': 2.0062918830399275e-07, 'epoch': 14.21}

 89%|████████▉ | 329960/371472 [4:05:11<3:27:09,  3.34it/s]
 89%|████████▉ | 329961/371472 [4:05:12<3:32:07,  3.26it/s]
 89%|████████▉ | 329962/371472 [4:05:12<3:37:00,  3.19it/s]
 89%|████████▉ | 329963/371472 [4:05:12<3:32:28,  3.26it/s]
 89%|████████▉ | 329964/371472 [4:05:12<3:28:59,  3.31it/s]
 89%|████████▉ | 329965/371472 [4:05:13<3:31:08,  3.28it/s]
 89%|████████▉ | 329966/371472 [4:05:13<3:23:12,  3.40it/s]
 89%|████████▉ | 329967/371472 [4:05:13<3:13:02,  3.58it/s]
 89%|████████▉ | 329968/371472 [4:05:14<3:10:22,  3.63it/s]
 89%|████████▉ | 329969/371472 [4:05:14<3:05:11,  3.74it/s]
 89%|████████▉ | 329970/371472 [4:05:14<3:13:20,  3.58it/s]
 89%|████████▉ | 329971/371472 [4:05:14<3:21:34,  3.43it/s]
 89%|████████▉ | 329972/371472 [4:05:15<3:12:47,  3.59it/s]
 89%|████████▉ | 329973/371472 [4:05:15<3:18:42,  3.48it/s]
 89%|████████▉ | 329974/371472 [4:05:15<3:24:00,  3.39it/s]
 89%|████████▉ | 329975/371472 [4:05:16<3:24:41,  3.38it/s]
 89%|████████▉ | 329976/371472 [4:05:16<3:25:05,  3.37it/s]
 89%|████████▉ | 329977/371472 [4:05:16<3:28:55,  3.31it/s]
 89%|████████▉ | 329978/371472 [4:05:17<3:55:20,  2.94it/s]
 89%|████████▉ | 329979/371472 [4:05:17<4:01:59,  2.86it/s]
 89%|████████▉ | 329980/371472 [4:05:17<4:01:38,  2.86it/s]
                                                           
{'loss': 2.594, 'learning_rate': 2.0058070632851382e-07, 'epoch': 14.21}

 89%|████████▉ | 329980/371472 [4:05:17<4:01:38,  2.86it/s]
 89%|████████▉ | 329981/371472 [4:05:18<3:46:45,  3.05it/s]
 89%|████████▉ | 329982/371472 [4:05:18<3:41:02,  3.13it/s]
 89%|████████▉ | 329983/371472 [4:05:18<3:54:36,  2.95it/s]
 89%|████████▉ | 329984/371472 [4:05:19<3:34:09,  3.23it/s]
 89%|████████▉ | 329985/371472 [4:05:19<3:29:23,  3.30it/s]
 89%|████████▉ | 329986/371472 [4:05:19<3:23:27,  3.40it/s]
 89%|████████▉ | 329987/371472 [4:05:19<3:27:40,  3.33it/s]
 89%|████████▉ | 329988/371472 [4:05:20<3:18:29,  3.48it/s]
 89%|████████▉ | 329989/371472 [4:05:20<3:12:06,  3.60it/s]
 89%|████████▉ | 329990/371472 [4:05:20<3:16:14,  3.52it/s]
 89%|████████▉ | 329991/371472 [4:05:20<3:11:25,  3.61it/s]
 89%|████████▉ | 329992/371472 [4:05:21<3:11:26,  3.61it/s]
 89%|████████▉ | 329993/371472 [4:05:21<3:08:20,  3.67it/s]
 89%|████████▉ | 329994/371472 [4:05:21<3:10:38,  3.63it/s]
 89%|████████▉ | 329995/371472 [4:05:22<3:23:19,  3.40it/s]
 89%|████████▉ | 329996/371472 [4:05:22<3:14:02,  3.56it/s]
 89%|████████▉ | 329997/371472 [4:05:22<3:19:51,  3.46it/s]
 89%|████████▉ | 329998/371472 [4:05:22<3:14:48,  3.55it/s]
 89%|████████▉ | 329999/371472 [4:05:23<3:13:11,  3.58it/s]
 89%|████████▉ | 330000/371472 [4:05:23<3:10:43,  3.62it/s]
                                                           
{'loss': 2.4966, 'learning_rate': 2.0053222435303497e-07, 'epoch': 14.21}

 89%|████████▉ | 330000/371472 [4:05:23<3:10:43,  3.62it/s]
 89%|████████▉ | 330001/371472 [4:05:23<3:03:36,  3.76it/s]
 89%|████████▉ | 330002/371472 [4:05:24<3:12:05,  3.60it/s]
 89%|████████▉ | 330003/371472 [4:05:24<3:32:24,  3.25it/s]
 89%|████████▉ | 330004/371472 [4:05:24<3:24:26,  3.38it/s]
 89%|████████▉ | 330005/371472 [4:05:24<3:17:27,  3.50it/s]
 89%|████████▉ | 330006/371472 [4:05:25<3:16:59,  3.51it/s]
 89%|████████▉ | 330007/371472 [4:05:25<3:15:15,  3.54it/s]
 89%|████████▉ | 330008/371472 [4:05:25<3:10:40,  3.62it/s]
 89%|████████▉ | 330009/371472 [4:05:26<3:09:14,  3.65it/s]
 89%|████████▉ | 330010/371472 [4:05:26<3:02:04,  3.80it/s]
 89%|████████▉ | 330011/371472 [4:05:26<3:01:44,  3.80it/s]
 89%|████████▉ | 330012/371472 [4:05:26<3:07:45,  3.68it/s]
 89%|████████▉ | 330013/371472 [4:05:27<3:08:36,  3.66it/s]
 89%|████████▉ | 330014/371472 [4:05:27<3:12:24,  3.59it/s]
 89%|████████▉ | 330015/371472 [4:05:27<3:11:46,  3.60it/s]
 89%|████████▉ | 330016/371472 [4:05:27<3:11:23,  3.61it/s]
 89%|████████▉ | 330017/371472 [4:05:28<3:11:23,  3.61it/s]
 89%|████████▉ | 330018/371472 [4:05:28<3:08:26,  3.67it/s]
 89%|████████▉ | 330019/371472 [4:05:28<3:16:31,  3.52it/s]
 89%|████████▉ | 330020/371472 [4:05:29<3:14:33,  3.55it/s]
                                                           
{'loss': 2.6551, 'learning_rate': 2.0048374237755602e-07, 'epoch': 14.21}

 89%|████████▉ | 330020/371472 [4:05:29<3:14:33,  3.55it/s]
 89%|████████▉ | 330021/371472 [4:05:29<3:13:08,  3.58it/s]
 89%|████████▉ | 330022/371472 [4:05:29<3:19:24,  3.46it/s]
 89%|████████▉ | 330023/371472 [4:05:29<3:28:54,  3.31it/s]
 89%|████████▉ | 330024/371472 [4:05:30<3:42:03,  3.11it/s]
 89%|████████▉ | 330025/371472 [4:05:30<3:51:54,  2.98it/s]
 89%|████████▉ | 330026/371472 [4:05:31<3:45:53,  3.06it/s]
 89%|████████▉ | 330027/371472 [4:05:31<3:34:16,  3.22it/s]
 89%|████████▉ | 330028/371472 [4:05:31<3:29:18,  3.30it/s]
 89%|████████▉ | 330029/371472 [4:05:31<3:20:46,  3.44it/s]
 89%|████████▉ | 330030/371472 [4:05:32<3:18:34,  3.48it/s]
 89%|████████▉ | 330031/371472 [4:05:32<3:38:32,  3.16it/s]
 89%|████████▉ | 330032/371472 [4:05:32<3:23:57,  3.39it/s]
 89%|████████▉ | 330033/371472 [4:05:33<3:20:19,  3.45it/s]
 89%|████████▉ | 330034/371472 [4:05:33<3:16:35,  3.51it/s]
 89%|████████▉ | 330035/371472 [4:05:33<3:06:51,  3.70it/s]
 89%|████████▉ | 330036/371472 [4:05:33<3:02:39,  3.78it/s]
 89%|████████▉ | 330037/371472 [4:05:34<2:58:34,  3.87it/s]
 89%|████████▉ | 330038/371472 [4:05:34<2:59:33,  3.85it/s]
 89%|████████▉ | 330039/371472 [4:05:34<3:01:12,  3.81it/s]
 89%|████████▉ | 330040/371472 [4:05:34<3:03:09,  3.77it/s]
                                                           
{'loss': 2.4553, 'learning_rate': 2.004352604020772e-07, 'epoch': 14.22}

 89%|████████▉ | 330040/371472 [4:05:34<3:03:09,  3.77it/s]
 89%|████████▉ | 330041/371472 [4:05:35<3:00:11,  3.83it/s]
 89%|████████▉ | 330042/371472 [4:05:35<3:15:41,  3.53it/s]
 89%|████████▉ | 330043/371472 [4:05:35<3:13:01,  3.58it/s]
 89%|████████▉ | 330044/371472 [4:05:35<3:11:05,  3.61it/s]
 89%|████████▉ | 330045/371472 [4:05:36<3:13:18,  3.57it/s]
 89%|████████▉ | 330046/371472 [4:05:36<3:13:49,  3.56it/s]
 89%|████████▉ | 330047/371472 [4:05:36<3:12:49,  3.58it/s]
 89%|████████▉ | 330048/371472 [4:05:37<3:08:42,  3.66it/s]
 89%|████████▉ | 330049/371472 [4:05:37<3:02:37,  3.78it/s]
 89%|████████▉ | 330050/371472 [4:05:37<2:57:13,  3.90it/s]
 89%|████████▉ | 330051/371472 [4:05:37<3:08:10,  3.67it/s]
 89%|████████▉ | 330052/371472 [4:05:38<3:05:26,  3.72it/s]
 89%|████████▉ | 330053/371472 [4:05:38<3:05:16,  3.73it/s]
 89%|████████▉ | 330054/371472 [4:05:38<3:07:10,  3.69it/s]
 89%|████████▉ | 330055/371472 [4:05:38<3:14:53,  3.54it/s]
 89%|████████▉ | 330056/371472 [4:05:39<3:12:32,  3.58it/s]
 89%|████████▉ | 330057/371472 [4:05:39<3:10:11,  3.63it/s]
 89%|████████▉ | 330058/371472 [4:05:39<3:34:26,  3.22it/s]
 89%|████████▉ | 330059/371472 [4:05:40<3:31:03,  3.27it/s]
 89%|████████▉ | 330060/371472 [4:05:40<3:19:18,  3.46it/s]
                                                           
{'loss': 2.7358, 'learning_rate': 2.0038677842659827e-07, 'epoch': 14.22}

 89%|████████▉ | 330060/371472 [4:05:40<3:19:18,  3.46it/s]
 89%|████████▉ | 330061/371472 [4:05:40<3:15:22,  3.53it/s]
 89%|████████▉ | 330062/371472 [4:05:40<3:07:33,  3.68it/s]
 89%|████████▉ | 330063/371472 [4:05:41<3:08:59,  3.65it/s]
 89%|████████▉ | 330064/371472 [4:05:41<3:10:40,  3.62it/s]
 89%|████████▉ | 330065/371472 [4:05:41<3:09:47,  3.64it/s]
 89%|████████▉ | 330066/371472 [4:05:42<3:09:27,  3.64it/s]
 89%|████████▉ | 330067/371472 [4:05:42<3:13:00,  3.58it/s]
 89%|████████▉ | 330068/371472 [4:05:42<3:11:30,  3.60it/s]
 89%|████████▉ | 330069/371472 [4:05:42<3:23:19,  3.39it/s]
 89%|████████▉ | 330070/371472 [4:05:43<3:20:02,  3.45it/s]
 89%|████████▉ | 330071/371472 [4:05:43<3:11:51,  3.60it/s]
 89%|████████▉ | 330072/371472 [4:05:43<3:15:30,  3.53it/s]
 89%|████████▉ | 330073/371472 [4:05:44<3:12:34,  3.58it/s]
 89%|████████▉ | 330074/371472 [4:05:44<3:03:05,  3.77it/s]
 89%|████████▉ | 330075/371472 [4:05:44<3:03:16,  3.76it/s]
 89%|████████▉ | 330076/371472 [4:05:44<3:04:40,  3.74it/s]
 89%|████████▉ | 330077/371472 [4:05:45<3:15:17,  3.53it/s]
 89%|████████▉ | 330078/371472 [4:05:45<3:32:48,  3.24it/s]
 89%|████████▉ | 330079/371472 [4:05:45<3:23:05,  3.40it/s]
 89%|████████▉ | 330080/371472 [4:05:46<3:15:52,  3.52it/s]
                                                           
{'loss': 2.7593, 'learning_rate': 2.003382964511194e-07, 'epoch': 14.22}

 89%|████████▉ | 330080/371472 [4:05:46<3:15:52,  3.52it/s]
 89%|████████▉ | 330081/371472 [4:05:46<3:09:40,  3.64it/s]
 89%|████████▉ | 330082/371472 [4:05:46<3:07:00,  3.69it/s]
 89%|████████▉ | 330083/371472 [4:05:46<3:07:58,  3.67it/s]
 89%|████████▉ | 330084/371472 [4:05:47<3:05:01,  3.73it/s]
 89%|████████▉ | 330085/371472 [4:05:47<3:22:01,  3.41it/s]
 89%|████████▉ | 330086/371472 [4:05:47<3:12:03,  3.59it/s]
 89%|████████▉ | 330087/371472 [4:05:47<3:05:06,  3.73it/s]
 89%|████████▉ | 330088/371472 [4:05:48<3:05:29,  3.72it/s]
 89%|████████▉ | 330089/371472 [4:05:48<3:24:36,  3.37it/s]
 89%|████████▉ | 330090/371472 [4:05:48<3:18:02,  3.48it/s]
 89%|████████▉ | 330091/371472 [4:05:49<3:14:38,  3.54it/s]
 89%|████████▉ | 330092/371472 [4:05:49<3:12:32,  3.58it/s]
 89%|████████▉ | 330093/371472 [4:05:49<3:04:48,  3.73it/s]
 89%|████████▉ | 330094/371472 [4:05:49<3:07:53,  3.67it/s]
 89%|████████▉ | 330095/371472 [4:05:50<3:02:35,  3.78it/s]
 89%|████████▉ | 330096/371472 [4:05:50<2:59:56,  3.83it/s]
 89%|████████▉ | 330097/371472 [4:05:50<3:02:41,  3.77it/s]
 89%|████████▉ | 330098/371472 [4:05:50<3:08:57,  3.65it/s]
 89%|████████▉ | 330099/371472 [4:05:51<3:08:22,  3.66it/s]
 89%|████████▉ | 330100/371472 [4:05:51<3:11:11,  3.61it/s]
                                                           
{'loss': 2.6432, 'learning_rate': 2.0028981447564046e-07, 'epoch': 14.22}

 89%|████████▉ | 330100/371472 [4:05:51<3:11:11,  3.61it/s]
 89%|████████▉ | 330101/371472 [4:05:51<3:05:23,  3.72it/s]
 89%|████████▉ | 330102/371472 [4:05:52<3:05:56,  3.71it/s]
 89%|████████▉ | 330103/371472 [4:05:52<3:08:41,  3.65it/s]
 89%|████████▉ | 330104/371472 [4:05:52<3:09:08,  3.65it/s]
 89%|████████▉ | 330105/371472 [4:05:52<3:23:42,  3.38it/s]
 89%|████████▉ | 330106/371472 [4:05:53<3:18:18,  3.48it/s]
 89%|████████▉ | 330107/371472 [4:05:53<3:29:31,  3.29it/s]
 89%|████████▉ | 330108/371472 [4:05:53<3:36:27,  3.18it/s]
 89%|████████▉ | 330109/371472 [4:05:54<3:51:47,  2.97it/s]
 89%|████████▉ | 330110/371472 [4:05:54<3:50:18,  2.99it/s]
 89%|████████▉ | 330111/371472 [4:05:54<3:44:55,  3.06it/s]
 89%|████████▉ | 330112/371472 [4:05:55<3:31:03,  3.27it/s]
 89%|████████▉ | 330113/371472 [4:05:55<3:21:59,  3.41it/s]
 89%|████████▉ | 330114/371472 [4:05:55<3:12:18,  3.58it/s]
 89%|████████▉ | 330115/371472 [4:05:55<3:07:46,  3.67it/s]
 89%|████████▉ | 330116/371472 [4:05:56<3:17:03,  3.50it/s]
 89%|████████▉ | 330117/371472 [4:05:56<3:14:30,  3.54it/s]
 89%|████████▉ | 330118/371472 [4:05:56<3:12:38,  3.58it/s]
 89%|████████▉ | 330119/371472 [4:05:57<3:22:04,  3.41it/s]
 89%|████████▉ | 330120/371472 [4:05:57<3:11:12,  3.60it/s]
                                                           
{'loss': 2.5327, 'learning_rate': 2.0024133250016164e-07, 'epoch': 14.22}

 89%|████████▉ | 330120/371472 [4:05:57<3:11:12,  3.60it/s]
 89%|████████▉ | 330121/371472 [4:05:57<3:08:14,  3.66it/s]
 89%|████████▉ | 330122/371472 [4:05:57<3:08:31,  3.66it/s]
 89%|████████▉ | 330123/371472 [4:05:58<3:12:01,  3.59it/s]
 89%|████████▉ | 330124/371472 [4:05:58<3:05:03,  3.72it/s]
 89%|████████▉ | 330125/371472 [4:05:58<3:07:55,  3.67it/s]
 89%|████████▉ | 330126/371472 [4:05:59<3:11:55,  3.59it/s]
 89%|████████▉ | 330127/371472 [4:05:59<3:09:05,  3.64it/s]
 89%|████████▉ | 330128/371472 [4:05:59<3:13:48,  3.56it/s]
 89%|████████▉ | 330129/371472 [4:05:59<3:12:49,  3.57it/s]
 89%|████████▉ | 330130/371472 [4:06:00<3:08:57,  3.65it/s]
 89%|████████▉ | 330131/371472 [4:06:00<3:10:58,  3.61it/s]
 89%|████████▉ | 330132/371472 [4:06:00<3:14:37,  3.54it/s]
 89%|████████▉ | 330133/371472 [4:06:00<3:10:00,  3.63it/s]
 89%|████████▉ | 330134/371472 [4:06:01<3:54:07,  2.94it/s]
 89%|████████▉ | 330135/371472 [4:06:01<3:44:08,  3.07it/s]
 89%|████████▉ | 330136/371472 [4:06:01<3:24:40,  3.37it/s]
 89%|████████▉ | 330137/371472 [4:06:02<3:13:23,  3.56it/s]
 89%|████████▉ | 330138/371472 [4:06:02<3:17:48,  3.48it/s]
 89%|████████▉ | 330139/371472 [4:06:02<3:31:59,  3.25it/s]
 89%|████████▉ | 330140/371472 [4:06:03<3:38:23,  3.15it/s]
                                                           
{'loss': 2.4931, 'learning_rate': 2.0019285052468266e-07, 'epoch': 14.22}

 89%|████████▉ | 330140/371472 [4:06:03<3:38:23,  3.15it/s]
 89%|████████▉ | 330141/371472 [4:06:03<3:31:56,  3.25it/s]
 89%|████████▉ | 330142/371472 [4:06:03<3:18:55,  3.46it/s]
 89%|████████▉ | 330143/371472 [4:06:04<3:14:55,  3.53it/s]
 89%|████████▉ | 330144/371472 [4:06:04<3:14:51,  3.53it/s]
 89%|████████▉ | 330145/371472 [4:06:04<3:15:05,  3.53it/s]
 89%|████████▉ | 330146/371472 [4:06:04<3:11:23,  3.60it/s]
 89%|████████▉ | 330147/371472 [4:06:05<3:13:16,  3.56it/s]
 89%|████████▉ | 330148/371472 [4:06:05<3:27:25,  3.32it/s]
 89%|████████▉ | 330149/371472 [4:06:05<3:17:40,  3.48it/s]
 89%|████████▉ | 330150/371472 [4:06:06<3:15:36,  3.52it/s]
 89%|████████▉ | 330151/371472 [4:06:06<3:17:54,  3.48it/s]
 89%|████████▉ | 330152/371472 [4:06:06<3:13:28,  3.56it/s]
 89%|████████▉ | 330153/371472 [4:06:06<3:07:22,  3.68it/s]
 89%|████████▉ | 330154/371472 [4:06:07<3:18:36,  3.47it/s]
 89%|████████▉ | 330155/371472 [4:06:07<3:30:34,  3.27it/s]
 89%|████████▉ | 330156/371472 [4:06:07<3:32:04,  3.25it/s]
 89%|████████▉ | 330157/371472 [4:06:08<3:21:46,  3.41it/s]
 89%|████████▉ | 330158/371472 [4:06:08<3:25:38,  3.35it/s]
 89%|████████▉ | 330159/371472 [4:06:08<3:22:25,  3.40it/s]
 89%|████████▉ | 330160/371472 [4:06:08<3:23:59,  3.38it/s]
                                                           
{'loss': 2.5199, 'learning_rate': 2.0014436854920383e-07, 'epoch': 14.22}

 89%|████████▉ | 330160/371472 [4:06:08<3:23:59,  3.38it/s]
 89%|████████▉ | 330161/371472 [4:06:09<3:24:07,  3.37it/s]
 89%|████████▉ | 330162/371472 [4:06:09<3:26:28,  3.33it/s]
 89%|████████▉ | 330163/371472 [4:06:09<3:21:21,  3.42it/s]
 89%|████████▉ | 330164/371472 [4:06:10<3:11:37,  3.59it/s]
 89%|████████▉ | 330165/371472 [4:06:10<3:09:31,  3.63it/s]
 89%|████████▉ | 330166/371472 [4:06:10<3:08:03,  3.66it/s]
 89%|████████▉ | 330167/371472 [4:06:10<3:05:46,  3.71it/s]
 89%|████████▉ | 330168/371472 [4:06:11<3:08:41,  3.65it/s]
 89%|████████▉ | 330169/371472 [4:06:11<3:07:06,  3.68it/s]
 89%|████████▉ | 330170/371472 [4:06:11<3:15:15,  3.53it/s]
 89%|████████▉ | 330171/371472 [4:06:12<3:10:17,  3.62it/s]
 89%|████████▉ | 330172/371472 [4:06:12<3:15:13,  3.53it/s]
 89%|████████▉ | 330173/371472 [4:06:12<3:08:00,  3.66it/s]
 89%|████████▉ | 330174/371472 [4:06:12<3:12:06,  3.58it/s]
 89%|████████▉ | 330175/371472 [4:06:13<3:06:33,  3.69it/s]
 89%|████████▉ | 330176/371472 [4:06:13<3:11:36,  3.59it/s]
 89%|████████▉ | 330177/371472 [4:06:13<3:10:18,  3.62it/s]
 89%|████████▉ | 330178/371472 [4:06:13<3:05:02,  3.72it/s]
 89%|████████▉ | 330179/371472 [4:06:14<3:08:40,  3.65it/s]
 89%|████████▉ | 330180/371472 [4:06:14<3:10:50,  3.61it/s]
                                                           
{'loss': 2.6703, 'learning_rate': 2.0009588657372493e-07, 'epoch': 14.22}

 89%|████████▉ | 330180/371472 [4:06:14<3:10:50,  3.61it/s]
 89%|████████▉ | 330181/371472 [4:06:14<3:10:26,  3.61it/s]
 89%|████████▉ | 330182/371472 [4:06:15<3:07:39,  3.67it/s]
 89%|████████▉ | 330183/371472 [4:06:15<3:06:03,  3.70it/s]
 89%|████████▉ | 330184/371472 [4:06:15<3:01:10,  3.80it/s]
 89%|████████▉ | 330185/371472 [4:06:15<3:09:57,  3.62it/s]
 89%|████████▉ | 330186/371472 [4:06:16<3:25:27,  3.35it/s]
 89%|████████▉ | 330187/371472 [4:06:16<3:25:13,  3.35it/s]
 89%|████████▉ | 330188/371472 [4:06:16<3:30:40,  3.27it/s]
 89%|████████▉ | 330189/371472 [4:06:17<3:36:01,  3.19it/s]
 89%|████████▉ | 330190/371472 [4:06:17<3:35:01,  3.20it/s]
 89%|████████▉ | 330191/371472 [4:06:17<3:25:24,  3.35it/s]
 89%|████████▉ | 330192/371472 [4:06:18<3:20:52,  3.43it/s]
 89%|████████▉ | 330193/371472 [4:06:18<3:34:48,  3.20it/s]
 89%|████████▉ | 330194/371472 [4:06:18<3:21:47,  3.41it/s]
 89%|████████▉ | 330195/371472 [4:06:18<3:17:20,  3.49it/s]
 89%|████████▉ | 330196/371472 [4:06:19<3:28:07,  3.31it/s]
 89%|████████▉ | 330197/371472 [4:06:19<3:16:40,  3.50it/s]
 89%|████████▉ | 330198/371472 [4:06:19<3:17:14,  3.49it/s]
 89%|████████▉ | 330199/371472 [4:06:20<3:29:33,  3.28it/s]
 89%|████████▉ | 330200/371472 [4:06:20<3:33:33,  3.22it/s]
                                                           
{'loss': 2.5269, 'learning_rate': 2.0004740459824603e-07, 'epoch': 14.22}

 89%|████████▉ | 330200/371472 [4:06:20<3:33:33,  3.22it/s]
 89%|████████▉ | 330201/371472 [4:06:20<3:23:47,  3.38it/s]
 89%|████████▉ | 330202/371472 [4:06:20<3:18:21,  3.47it/s]
 89%|████████▉ | 330203/371472 [4:06:21<3:11:59,  3.58it/s]
 89%|████████▉ | 330204/371472 [4:06:21<3:28:06,  3.30it/s]
 89%|████████▉ | 330205/371472 [4:06:21<3:25:39,  3.34it/s]
 89%|████████▉ | 330206/371472 [4:06:22<3:17:25,  3.48it/s]
 89%|████████▉ | 330207/371472 [4:06:22<3:11:49,  3.59it/s]
 89%|████████▉ | 330208/371472 [4:06:22<3:28:53,  3.29it/s]
 89%|████████▉ | 330209/371472 [4:06:23<3:27:35,  3.31it/s]
 89%|████████▉ | 330210/371472 [4:06:23<3:21:03,  3.42it/s]
 89%|████████▉ | 330211/371472 [4:06:23<3:09:55,  3.62it/s]
 89%|████████▉ | 330212/371472 [4:06:23<3:14:28,  3.54it/s]
 89%|████████▉ | 330213/371472 [4:06:24<3:14:46,  3.53it/s]
 89%|████████▉ | 330214/371472 [4:06:24<3:14:05,  3.54it/s]
 89%|████████▉ | 330215/371472 [4:06:24<3:16:54,  3.49it/s]
 89%|████████▉ | 330216/371472 [4:06:24<3:12:29,  3.57it/s]
 89%|████████▉ | 330217/371472 [4:06:25<3:21:30,  3.41it/s]
 89%|████████▉ | 330218/371472 [4:06:25<3:15:30,  3.52it/s]
 89%|████████▉ | 330219/371472 [4:06:25<3:13:05,  3.56it/s]
 89%|████████▉ | 330220/371472 [4:06:26<3:09:07,  3.64it/s]
                                                           
{'loss': 2.6215, 'learning_rate': 1.999989226227671e-07, 'epoch': 14.22}

 89%|████████▉ | 330220/371472 [4:06:26<3:09:07,  3.64it/s]
 89%|████████▉ | 330221/371472 [4:06:26<3:10:25,  3.61it/s]
 89%|████████▉ | 330222/371472 [4:06:26<3:11:32,  3.59it/s]
 89%|████████▉ | 330223/371472 [4:06:26<3:08:19,  3.65it/s]
 89%|████████▉ | 330224/371472 [4:06:27<3:08:32,  3.65it/s]
 89%|████████▉ | 330225/371472 [4:06:27<3:06:57,  3.68it/s]
 89%|████████▉ | 330226/371472 [4:06:27<3:06:37,  3.68it/s]
 89%|████████▉ | 330227/371472 [4:06:28<3:05:39,  3.70it/s]
 89%|████████▉ | 330228/371472 [4:06:28<3:03:46,  3.74it/s]
 89%|████████▉ | 330229/371472 [4:06:28<3:00:59,  3.80it/s]
 89%|████████▉ | 330230/371472 [4:06:28<3:04:54,  3.72it/s]
 89%|████████▉ | 330231/371472 [4:06:29<3:21:28,  3.41it/s]
 89%|████████▉ | 330232/371472 [4:06:29<3:49:50,  2.99it/s]
 89%|████████▉ | 330233/371472 [4:06:29<3:45:40,  3.05it/s]
 89%|████████▉ | 330234/371472 [4:06:30<3:30:36,  3.26it/s]
 89%|████████▉ | 330235/371472 [4:06:30<3:16:32,  3.50it/s]
 89%|████████▉ | 330236/371472 [4:06:30<3:20:19,  3.43it/s]
 89%|████████▉ | 330237/371472 [4:06:30<3:15:04,  3.52it/s]
 89%|████████▉ | 330238/371472 [4:06:31<3:12:12,  3.58it/s]
 89%|████████▉ | 330239/371472 [4:06:31<3:04:36,  3.72it/s]
 89%|████████▉ | 330240/371472 [4:06:31<3:17:27,  3.48it/s]
                                                           
{'loss': 2.5763, 'learning_rate': 1.9995044064728828e-07, 'epoch': 14.22}

 89%|████████▉ | 330240/371472 [4:06:31<3:17:27,  3.48it/s]
 89%|████████▉ | 330241/371472 [4:06:32<3:14:33,  3.53it/s]
 89%|████████▉ | 330242/371472 [4:06:32<3:08:09,  3.65it/s]
 89%|████████▉ | 330243/371472 [4:06:32<3:14:17,  3.54it/s]
 89%|████████▉ | 330244/371472 [4:06:32<3:14:31,  3.53it/s]
 89%|████████▉ | 330245/371472 [4:06:33<3:22:43,  3.39it/s]
 89%|████████▉ | 330246/371472 [4:06:33<3:33:51,  3.21it/s]
 89%|████████▉ | 330247/371472 [4:06:33<3:37:04,  3.17it/s]
 89%|████████▉ | 330248/371472 [4:06:34<3:25:07,  3.35it/s]
 89%|████████▉ | 330249/371472 [4:06:34<3:34:41,  3.20it/s]
 89%|████████▉ | 330250/371472 [4:06:34<3:25:36,  3.34it/s]
 89%|████████▉ | 330251/371472 [4:06:35<3:16:51,  3.49it/s]
 89%|████████▉ | 330252/371472 [4:06:35<3:20:57,  3.42it/s]
 89%|████████▉ | 330253/371472 [4:06:35<3:28:18,  3.30it/s]
 89%|████████▉ | 330254/371472 [4:06:35<3:24:16,  3.36it/s]
 89%|████████▉ | 330255/371472 [4:06:36<3:18:43,  3.46it/s]
 89%|████████▉ | 330256/371472 [4:06:36<3:17:20,  3.48it/s]
 89%|████████▉ | 330257/371472 [4:06:36<3:17:23,  3.48it/s]
 89%|████████▉ | 330258/371472 [4:06:37<3:15:29,  3.51it/s]
 89%|████████▉ | 330259/371472 [4:06:37<3:04:37,  3.72it/s]
 89%|████████▉ | 330260/371472 [4:06:37<3:03:30,  3.74it/s]
                                                           
{'loss': 2.7285, 'learning_rate': 1.9990195867180932e-07, 'epoch': 14.22}

 89%|████████▉ | 330260/371472 [4:06:37<3:03:30,  3.74it/s]
 89%|████████▉ | 330261/371472 [4:06:37<3:24:45,  3.35it/s]
 89%|████████▉ | 330262/371472 [4:06:38<3:31:01,  3.25it/s]
 89%|████████▉ | 330263/371472 [4:06:38<3:20:45,  3.42it/s]
 89%|████████▉ | 330264/371472 [4:06:38<3:12:47,  3.56it/s]
 89%|████████▉ | 330265/371472 [4:06:39<3:36:04,  3.18it/s]
 89%|████████▉ | 330266/371472 [4:06:39<3:37:00,  3.16it/s]
 89%|████████▉ | 330267/371472 [4:06:39<3:23:12,  3.38it/s]
 89%|████████▉ | 330268/371472 [4:06:40<3:16:59,  3.49it/s]
 89%|████████▉ | 330269/371472 [4:06:40<3:18:09,  3.47it/s]
 89%|████████▉ | 330270/371472 [4:06:40<3:13:52,  3.54it/s]
 89%|████████▉ | 330271/371472 [4:06:40<3:11:49,  3.58it/s]
 89%|████████▉ | 330272/371472 [4:06:41<3:15:51,  3.51it/s]
 89%|████████▉ | 330273/371472 [4:06:41<3:11:21,  3.59it/s]
 89%|████████▉ | 330274/371472 [4:06:41<3:09:05,  3.63it/s]
 89%|████████▉ | 330275/371472 [4:06:41<3:07:55,  3.65it/s]
 89%|████████▉ | 330276/371472 [4:06:42<3:02:40,  3.76it/s]
 89%|████████▉ | 330277/371472 [4:06:42<2:55:16,  3.92it/s]
 89%|████████▉ | 330278/371472 [4:06:42<3:06:28,  3.68it/s]
 89%|████████▉ | 330279/371472 [4:06:43<3:05:30,  3.70it/s]
 89%|████████▉ | 330280/371472 [4:06:43<3:05:20,  3.70it/s]
                                                           
{'loss': 2.523, 'learning_rate': 1.9985347669633048e-07, 'epoch': 14.23}

 89%|████████▉ | 330280/371472 [4:06:43<3:05:20,  3.70it/s]
 89%|████████▉ | 330281/371472 [4:06:43<3:00:18,  3.81it/s]
 89%|████████▉ | 330282/371472 [4:06:43<3:08:18,  3.65it/s]
 89%|████████▉ | 330283/371472 [4:06:44<3:10:03,  3.61it/s]
 89%|████████▉ | 330284/371472 [4:06:44<3:13:28,  3.55it/s]
 89%|████████▉ | 330285/371472 [4:06:44<3:06:49,  3.67it/s]
 89%|████████▉ | 330286/371472 [4:06:44<3:05:39,  3.70it/s]
 89%|████████▉ | 330287/371472 [4:06:45<3:00:50,  3.80it/s]
 89%|████████▉ | 330288/371472 [4:06:45<3:14:32,  3.53it/s]
 89%|████████▉ | 330289/371472 [4:06:45<3:25:40,  3.34it/s]
 89%|████████▉ | 330290/371472 [4:06:46<3:23:18,  3.38it/s]
 89%|████████▉ | 330291/371472 [4:06:46<3:19:03,  3.45it/s]
 89%|████████▉ | 330292/371472 [4:06:46<3:29:04,  3.28it/s]
 89%|████████▉ | 330293/371472 [4:06:47<3:24:58,  3.35it/s]
 89%|████████▉ | 330294/371472 [4:06:47<3:23:58,  3.36it/s]
 89%|████████▉ | 330295/371472 [4:06:47<3:31:29,  3.24it/s]
 89%|████████▉ | 330296/371472 [4:06:47<3:37:13,  3.16it/s]
 89%|████████▉ | 330297/371472 [4:06:48<3:23:41,  3.37it/s]
 89%|████████▉ | 330298/371472 [4:06:48<3:24:51,  3.35it/s]
 89%|████████▉ | 330299/371472 [4:06:48<3:30:42,  3.26it/s]
 89%|████████▉ | 330300/371472 [4:06:49<3:30:50,  3.25it/s]
                                                           
{'loss': 2.5758, 'learning_rate': 1.9980499472085155e-07, 'epoch': 14.23}

 89%|████████▉ | 330300/371472 [4:06:49<3:30:50,  3.25it/s]
 89%|████████▉ | 330301/371472 [4:06:49<3:32:56,  3.22it/s]
 89%|████████▉ | 330302/371472 [4:06:49<3:22:40,  3.39it/s]
 89%|████████▉ | 330303/371472 [4:06:50<3:18:43,  3.45it/s]
 89%|████████▉ | 330304/371472 [4:06:50<3:14:47,  3.52it/s]
 89%|████████▉ | 330305/371472 [4:06:50<3:15:23,  3.51it/s]
 89%|████████▉ | 330306/371472 [4:06:50<3:10:32,  3.60it/s]
 89%|████████▉ | 330307/371472 [4:06:51<3:21:39,  3.40it/s]
 89%|████████▉ | 330308/371472 [4:06:51<3:22:32,  3.39it/s]
 89%|████████▉ | 330309/371472 [4:06:51<3:13:09,  3.55it/s]
 89%|████████▉ | 330310/371472 [4:06:51<3:04:59,  3.71it/s]
 89%|████████▉ | 330311/371472 [4:06:52<3:11:39,  3.58it/s]
 89%|████████▉ | 330312/371472 [4:06:52<3:08:26,  3.64it/s]
 89%|████████▉ | 330313/371472 [4:06:52<3:09:42,  3.62it/s]
 89%|████████▉ | 330314/371472 [4:06:53<3:03:11,  3.74it/s]
 89%|████████▉ | 330315/371472 [4:06:53<2:59:50,  3.81it/s]
 89%|████████▉ | 330316/371472 [4:06:53<3:03:39,  3.73it/s]
 89%|████████▉ | 330317/371472 [4:06:53<3:28:46,  3.29it/s]
 89%|████████▉ | 330318/371472 [4:06:54<3:21:24,  3.41it/s]
 89%|████████▉ | 330319/371472 [4:06:54<3:17:56,  3.47it/s]
 89%|████████▉ | 330320/371472 [4:06:54<3:16:13,  3.50it/s]
                                                           
{'loss': 2.4564, 'learning_rate': 1.997565127453727e-07, 'epoch': 14.23}

 89%|████████▉ | 330320/371472 [4:06:54<3:16:13,  3.50it/s]
 89%|████████▉ | 330321/371472 [4:06:55<3:16:26,  3.49it/s]
 89%|████████▉ | 330322/371472 [4:06:55<3:36:19,  3.17it/s]
 89%|████████▉ | 330323/371472 [4:06:55<3:26:17,  3.32it/s]
 89%|████████▉ | 330324/371472 [4:06:56<3:21:32,  3.40it/s]
 89%|████████▉ | 330325/371472 [4:06:56<3:26:33,  3.32it/s]
 89%|████████▉ | 330326/371472 [4:06:56<3:25:32,  3.34it/s]
 89%|████████▉ | 330327/371472 [4:06:56<3:17:07,  3.48it/s]
 89%|████████▉ | 330328/371472 [4:06:57<3:15:48,  3.50it/s]
 89%|████████▉ | 330329/371472 [4:06:57<3:25:58,  3.33it/s]
 89%|████████▉ | 330330/371472 [4:06:57<3:33:28,  3.21it/s]
 89%|████████▉ | 330331/371472 [4:06:58<3:23:56,  3.36it/s]
 89%|████████▉ | 330332/371472 [4:06:58<3:27:21,  3.31it/s]
 89%|████████▉ | 330333/371472 [4:06:58<3:20:51,  3.41it/s]
 89%|████████▉ | 330334/371472 [4:06:58<3:16:50,  3.48it/s]
 89%|████████▉ | 330335/371472 [4:06:59<3:07:46,  3.65it/s]
 89%|████████▉ | 330336/371472 [4:06:59<3:07:27,  3.66it/s]
 89%|████████▉ | 330337/371472 [4:06:59<3:01:35,  3.78it/s]
 89%|████████▉ | 330338/371472 [4:06:59<2:57:28,  3.86it/s]
 89%|████████▉ | 330339/371472 [4:07:00<2:57:18,  3.87it/s]
 89%|████████▉ | 330340/371472 [4:07:00<3:00:00,  3.81it/s]
                                                           
{'loss': 2.5022, 'learning_rate': 1.9970803076989374e-07, 'epoch': 14.23}

 89%|████████▉ | 330340/371472 [4:07:00<3:00:00,  3.81it/s]
 89%|████████▉ | 330341/371472 [4:07:00<3:00:21,  3.80it/s]
 89%|████████▉ | 330342/371472 [4:07:01<3:11:52,  3.57it/s]
 89%|████████▉ | 330343/371472 [4:07:01<3:07:31,  3.66it/s]
 89%|████████▉ | 330344/371472 [4:07:01<3:04:40,  3.71it/s]
 89%|████████▉ | 330345/371472 [4:07:01<3:03:25,  3.74it/s]
 89%|████████▉ | 330346/371472 [4:07:02<3:04:20,  3.72it/s]
 89%|████████▉ | 330347/371472 [4:07:02<3:23:27,  3.37it/s]
 89%|████████▉ | 330348/371472 [4:07:02<3:39:41,  3.12it/s]
 89%|████████▉ | 330349/371472 [4:07:03<3:28:43,  3.28it/s]
 89%|████████▉ | 330350/371472 [4:07:03<3:17:56,  3.46it/s]
 89%|████████▉ | 330351/371472 [4:07:03<3:12:16,  3.56it/s]
 89%|████████▉ | 330352/371472 [4:07:03<3:15:50,  3.50it/s]
 89%|████████▉ | 330353/371472 [4:07:04<3:13:16,  3.55it/s]
 89%|████████▉ | 330354/371472 [4:07:04<3:22:23,  3.39it/s]
 89%|████████▉ | 330355/371472 [4:07:04<3:17:59,  3.46it/s]
 89%|████████▉ | 330356/371472 [4:07:05<3:20:40,  3.41it/s]
 89%|████████▉ | 330357/371472 [4:07:05<3:11:54,  3.57it/s]
 89%|████████▉ | 330358/371472 [4:07:05<3:20:03,  3.43it/s]
 89%|████████▉ | 330359/371472 [4:07:05<3:18:35,  3.45it/s]
 89%|████████▉ | 330360/371472 [4:07:06<3:10:26,  3.60it/s]
                                                           
{'loss': 2.6425, 'learning_rate': 1.9965954879441495e-07, 'epoch': 14.23}

 89%|████████▉ | 330360/371472 [4:07:06<3:10:26,  3.60it/s]
 89%|████████▉ | 330361/371472 [4:07:06<3:11:47,  3.57it/s]
 89%|████████▉ | 330362/371472 [4:07:06<3:14:14,  3.53it/s]
 89%|████████▉ | 330363/371472 [4:07:07<3:20:06,  3.42it/s]
 89%|████████▉ | 330364/371472 [4:07:07<3:08:36,  3.63it/s]
 89%|████████▉ | 330365/371472 [4:07:07<3:10:21,  3.60it/s]
 89%|████████▉ | 330366/371472 [4:07:07<3:19:50,  3.43it/s]
 89%|████████▉ | 330367/371472 [4:07:08<3:15:10,  3.51it/s]
 89%|████████▉ | 330368/371472 [4:07:08<3:25:26,  3.33it/s]
 89%|████████▉ | 330369/371472 [4:07:08<3:22:04,  3.39it/s]
 89%|████████▉ | 330370/371472 [4:07:09<3:16:18,  3.49it/s]
 89%|████████▉ | 330371/371472 [4:07:09<3:11:15,  3.58it/s]
 89%|████████▉ | 330372/371472 [4:07:09<3:09:26,  3.62it/s]
 89%|████████▉ | 330373/371472 [4:07:09<3:04:26,  3.71it/s]
 89%|████████▉ | 330374/371472 [4:07:10<3:13:05,  3.55it/s]
 89%|████████▉ | 330375/371472 [4:07:10<3:13:14,  3.54it/s]
 89%|████████▉ | 330376/371472 [4:07:10<3:15:23,  3.51it/s]
 89%|████████▉ | 330377/371472 [4:07:11<3:19:02,  3.44it/s]
 89%|████████▉ | 330378/371472 [4:07:11<3:27:49,  3.30it/s]
 89%|████████▉ | 330379/371472 [4:07:11<3:25:37,  3.33it/s]
 89%|████████▉ | 330380/371472 [4:07:12<3:25:19,  3.34it/s]
                                                           
{'loss': 2.5238, 'learning_rate': 1.9961106681893597e-07, 'epoch': 14.23}

 89%|████████▉ | 330380/371472 [4:07:12<3:25:19,  3.34it/s]
 89%|████████▉ | 330381/371472 [4:07:12<3:17:41,  3.46it/s]
 89%|████████▉ | 330382/371472 [4:07:12<3:21:59,  3.39it/s]
 89%|████████▉ | 330383/371472 [4:07:12<3:12:37,  3.56it/s]
 89%|████████▉ | 330384/371472 [4:07:13<3:10:17,  3.60it/s]
 89%|████████▉ | 330385/371472 [4:07:13<3:01:10,  3.78it/s]
 89%|████████▉ | 330386/371472 [4:07:13<3:00:01,  3.80it/s]
 89%|████████▉ | 330387/371472 [4:07:13<2:58:13,  3.84it/s]
 89%|████████▉ | 330388/371472 [4:07:14<3:03:41,  3.73it/s]
 89%|████████▉ | 330389/371472 [4:07:14<3:03:11,  3.74it/s]
 89%|████████▉ | 330390/371472 [4:07:14<3:02:42,  3.75it/s]
 89%|████████▉ | 330391/371472 [4:07:14<2:59:07,  3.82it/s]
 89%|████████▉ | 330392/371472 [4:07:15<3:08:08,  3.64it/s]
 89%|████████▉ | 330393/371472 [4:07:15<3:09:24,  3.61it/s]
 89%|████████▉ | 330394/371472 [4:07:15<3:08:37,  3.63it/s]
 89%|████████▉ | 330395/371472 [4:07:16<3:07:24,  3.65it/s]
 89%|████████▉ | 330396/371472 [4:07:16<3:10:51,  3.59it/s]
 89%|████████▉ | 330397/371472 [4:07:16<3:04:49,  3.70it/s]
 89%|████████▉ | 330398/371472 [4:07:16<3:07:10,  3.66it/s]
 89%|████████▉ | 330399/371472 [4:07:17<3:06:57,  3.66it/s]
 89%|████████▉ | 330400/371472 [4:07:17<3:08:26,  3.63it/s]
                                                           
{'loss': 2.6752, 'learning_rate': 1.9956258484345712e-07, 'epoch': 14.23}

 89%|████████▉ | 330400/371472 [4:07:17<3:08:26,  3.63it/s]
 89%|████████▉ | 330401/371472 [4:07:17<3:04:41,  3.71it/s]
 89%|████████▉ | 330402/371472 [4:07:17<3:05:14,  3.70it/s]
 89%|████████▉ | 330403/371472 [4:07:18<3:04:18,  3.71it/s]
 89%|████████▉ | 330404/371472 [4:07:18<3:11:38,  3.57it/s]
 89%|████████▉ | 330405/371472 [4:07:18<3:05:35,  3.69it/s]
 89%|████████▉ | 330406/371472 [4:07:19<3:09:12,  3.62it/s]
 89%|████████▉ | 330407/371472 [4:07:19<3:12:19,  3.56it/s]
 89%|████████▉ | 330408/371472 [4:07:19<3:09:27,  3.61it/s]
 89%|████████▉ | 330409/371472 [4:07:19<3:14:06,  3.53it/s]
 89%|████████▉ | 330410/371472 [4:07:20<3:09:43,  3.61it/s]
 89%|████████▉ | 330411/371472 [4:07:20<3:09:04,  3.62it/s]
 89%|████████▉ | 330412/371472 [4:07:20<3:09:57,  3.60it/s]
 89%|████████▉ | 330413/371472 [4:07:21<3:10:47,  3.59it/s]
 89%|████████▉ | 330414/371472 [4:07:21<3:21:51,  3.39it/s]
 89%|████████▉ | 330415/371472 [4:07:21<3:13:20,  3.54it/s]
 89%|████████▉ | 330416/371472 [4:07:21<3:18:03,  3.45it/s]
 89%|████████▉ | 330417/371472 [4:07:22<3:11:28,  3.57it/s]
 89%|████████▉ | 330418/371472 [4:07:22<3:10:50,  3.59it/s]
 89%|████████▉ | 330419/371472 [4:07:22<3:04:32,  3.71it/s]
 89%|████████▉ | 330420/371472 [4:07:22<3:04:54,  3.70it/s]
                                                           
{'loss': 2.4676, 'learning_rate': 1.995141028679782e-07, 'epoch': 14.23}

 89%|████████▉ | 330420/371472 [4:07:22<3:04:54,  3.70it/s]
 89%|████████▉ | 330421/371472 [4:07:23<3:05:37,  3.69it/s]
 89%|████████▉ | 330422/371472 [4:07:23<3:27:37,  3.30it/s]
 89%|████████▉ | 330423/371472 [4:07:23<3:19:11,  3.43it/s]
 89%|████████▉ | 330424/371472 [4:07:24<3:18:43,  3.44it/s]
 89%|████████▉ | 330425/371472 [4:07:24<3:16:07,  3.49it/s]
 89%|████████▉ | 330426/371472 [4:07:24<3:08:15,  3.63it/s]
 89%|████████▉ | 330427/371472 [4:07:25<3:19:06,  3.44it/s]
 89%|████████▉ | 330428/371472 [4:07:25<3:16:20,  3.48it/s]
 89%|████████▉ | 330429/371472 [4:07:25<3:17:06,  3.47it/s]
 89%|████████▉ | 330430/371472 [4:07:25<3:10:10,  3.60it/s]
 89%|████████▉ | 330431/371472 [4:07:26<3:07:27,  3.65it/s]
 89%|████████▉ | 330432/371472 [4:07:26<3:09:23,  3.61it/s]
 89%|████████▉ | 330433/371472 [4:07:26<3:08:20,  3.63it/s]
 89%|████████▉ | 330434/371472 [4:07:26<3:05:55,  3.68it/s]
 89%|████████▉ | 330435/371472 [4:07:27<3:13:50,  3.53it/s]
 89%|████████▉ | 330436/371472 [4:07:27<3:09:31,  3.61it/s]
 89%|████████▉ | 330437/371472 [4:07:27<3:08:33,  3.63it/s]
 89%|████████▉ | 330438/371472 [4:07:28<3:08:59,  3.62it/s]
 89%|████████▉ | 330439/371472 [4:07:28<3:07:17,  3.65it/s]
 89%|████████▉ | 330440/371472 [4:07:28<3:10:07,  3.60it/s]
                                                           
{'loss': 2.504, 'learning_rate': 1.9946562089249926e-07, 'epoch': 14.23}

 89%|████████▉ | 330440/371472 [4:07:28<3:10:07,  3.60it/s]
 89%|████████▉ | 330441/371472 [4:07:28<3:20:16,  3.41it/s]
 89%|████████▉ | 330442/371472 [4:07:29<3:16:52,  3.47it/s]
 89%|████████▉ | 330443/371472 [4:07:29<3:14:59,  3.51it/s]
 89%|████████▉ | 330444/371472 [4:07:29<3:09:29,  3.61it/s]
 89%|████████▉ | 330445/371472 [4:07:30<3:14:24,  3.52it/s]
 89%|████████▉ | 330446/371472 [4:07:30<3:11:50,  3.56it/s]
 89%|████████▉ | 330447/371472 [4:07:30<3:09:08,  3.61it/s]
 89%|████████▉ | 330448/371472 [4:07:30<3:03:13,  3.73it/s]
 89%|████████▉ | 330449/371472 [4:07:31<3:01:41,  3.76it/s]
 89%|████████▉ | 330450/371472 [4:07:31<3:02:24,  3.75it/s]
 89%|████████▉ | 330451/371472 [4:07:31<3:13:22,  3.54it/s]
 89%|████████▉ | 330452/371472 [4:07:31<3:11:06,  3.58it/s]
 89%|████████▉ | 330453/371472 [4:07:32<3:20:11,  3.41it/s]
 89%|████████▉ | 330454/371472 [4:07:32<3:13:11,  3.54it/s]
 89%|████████▉ | 330455/371472 [4:07:32<3:12:36,  3.55it/s]
 89%|████████▉ | 330456/371472 [4:07:33<3:20:47,  3.40it/s]
 89%|████████▉ | 330457/371472 [4:07:33<3:17:37,  3.46it/s]
 89%|████████▉ | 330458/371472 [4:07:33<3:08:48,  3.62it/s]
 89%|████████▉ | 330459/371472 [4:07:33<3:03:00,  3.73it/s]
 89%|████████▉ | 330460/371472 [4:07:34<3:02:19,  3.75it/s]
                                                           
{'loss': 2.664, 'learning_rate': 1.9941713891702038e-07, 'epoch': 14.23}

 89%|████████▉ | 330460/371472 [4:07:34<3:02:19,  3.75it/s]
 89%|████████▉ | 330461/371472 [4:07:34<3:08:09,  3.63it/s]
 89%|████████▉ | 330462/371472 [4:07:34<3:06:12,  3.67it/s]
 89%|████████▉ | 330463/371472 [4:07:35<3:01:40,  3.76it/s]
 89%|████████▉ | 330464/371472 [4:07:35<3:02:42,  3.74it/s]
 89%|████████▉ | 330465/371472 [4:07:35<3:02:06,  3.75it/s]
 89%|████████▉ | 330466/371472 [4:07:35<3:15:49,  3.49it/s]
 89%|████████▉ | 330467/371472 [4:07:36<3:34:26,  3.19it/s]
 89%|████████▉ | 330468/371472 [4:07:36<3:35:26,  3.17it/s]
 89%|████████▉ | 330469/371472 [4:07:36<3:32:45,  3.21it/s]
 89%|████████▉ | 330470/371472 [4:07:37<3:31:25,  3.23it/s]
 89%|████████▉ | 330471/371472 [4:07:37<3:25:42,  3.32it/s]
 89%|████████▉ | 330472/371472 [4:07:37<3:16:51,  3.47it/s]
 89%|████████▉ | 330473/371472 [4:07:38<3:21:31,  3.39it/s]
 89%|████████▉ | 330474/371472 [4:07:38<3:15:38,  3.49it/s]
 89%|████████▉ | 330475/371472 [4:07:38<3:34:02,  3.19it/s]
 89%|████████▉ | 330476/371472 [4:07:38<3:23:08,  3.36it/s]
 89%|████████▉ | 330477/371472 [4:07:39<3:11:33,  3.57it/s]
 89%|████████▉ | 330478/371472 [4:07:39<3:11:28,  3.57it/s]
 89%|████████▉ | 330479/371472 [4:07:39<3:14:30,  3.51it/s]
 89%|████████▉ | 330480/371472 [4:07:40<3:11:30,  3.57it/s]
                                                           
{'loss': 2.59, 'learning_rate': 1.9936865694154146e-07, 'epoch': 14.23}

 89%|████████▉ | 330480/371472 [4:07:40<3:11:30,  3.57it/s]
 89%|████████▉ | 330481/371472 [4:07:40<3:14:22,  3.51it/s]
 89%|████████▉ | 330482/371472 [4:07:40<3:12:37,  3.55it/s]
 89%|████████▉ | 330483/371472 [4:07:40<3:07:50,  3.64it/s]
 89%|████████▉ | 330484/371472 [4:07:41<3:02:50,  3.74it/s]
 89%|████████▉ | 330485/371472 [4:07:41<3:23:12,  3.36it/s]
 89%|████████▉ | 330486/371472 [4:07:41<3:16:13,  3.48it/s]
 89%|████████▉ | 330487/371472 [4:07:41<3:08:38,  3.62it/s]
 89%|████████▉ | 330488/371472 [4:07:42<3:15:29,  3.49it/s]
 89%|████████▉ | 330489/371472 [4:07:42<3:11:09,  3.57it/s]
 89%|████████▉ | 330490/371472 [4:07:42<3:10:41,  3.58it/s]
 89%|████████▉ | 330491/371472 [4:07:43<3:21:58,  3.38it/s]
 89%|████████▉ | 330492/371472 [4:07:43<3:13:30,  3.53it/s]
 89%|████████▉ | 330493/371472 [4:07:43<3:06:33,  3.66it/s]
 89%|████████▉ | 330494/371472 [4:07:43<3:02:34,  3.74it/s]
 89%|████████▉ | 330495/371472 [4:07:44<3:06:49,  3.66it/s]
 89%|████████▉ | 330496/371472 [4:07:44<3:05:32,  3.68it/s]
 89%|████████▉ | 330497/371472 [4:07:44<3:04:03,  3.71it/s]
 89%|████████▉ | 330498/371472 [4:07:45<3:10:54,  3.58it/s]
 89%|████████▉ | 330499/371472 [4:07:45<3:12:42,  3.54it/s]
 89%|████████▉ | 330500/371472 [4:07:45<3:11:58,  3.56it/s]
                                                           
{'loss': 2.5515, 'learning_rate': 1.9932017496606263e-07, 'epoch': 14.24}

 89%|████████▉ | 330500/371472 [4:07:45<3:11:58,  3.56it/s]
 89%|████████▉ | 330501/371472 [4:07:45<3:03:17,  3.73it/s]
 89%|████████▉ | 330502/371472 [4:07:46<3:01:06,  3.77it/s]
 89%|████████▉ | 330503/371472 [4:07:46<3:04:18,  3.70it/s]
 89%|████████▉ | 330504/371472 [4:07:46<3:04:59,  3.69it/s]
 89%|████████▉ | 330505/371472 [4:07:46<3:05:17,  3.68it/s]
 89%|████████▉ | 330506/371472 [4:07:47<3:02:52,  3.73it/s]
 89%|████████▉ | 330507/371472 [4:07:47<3:01:59,  3.75it/s]
 89%|████████▉ | 330508/371472 [4:07:47<3:15:44,  3.49it/s]
 89%|████████▉ | 330509/371472 [4:07:48<3:11:48,  3.56it/s]
 89%|████████▉ | 330510/371472 [4:07:48<3:23:52,  3.35it/s]
 89%|████████▉ | 330511/371472 [4:07:48<3:30:40,  3.24it/s]
 89%|████████▉ | 330512/371472 [4:07:48<3:20:28,  3.41it/s]
 89%|████████▉ | 330513/371472 [4:07:49<3:36:44,  3.15it/s]
 89%|████████▉ | 330514/371472 [4:07:49<3:44:50,  3.04it/s]
 89%|████████▉ | 330515/371472 [4:07:50<3:35:26,  3.17it/s]
 89%|████████▉ | 330516/371472 [4:07:50<3:31:18,  3.23it/s]
 89%|████████▉ | 330517/371472 [4:07:50<3:22:55,  3.36it/s]
 89%|████████▉ | 330518/371472 [4:07:50<3:11:51,  3.56it/s]
 89%|████████▉ | 330519/371472 [4:07:51<3:14:57,  3.50it/s]
 89%|████████▉ | 330520/371472 [4:07:51<3:12:11,  3.55it/s]
                                                           
{'loss': 2.48, 'learning_rate': 1.9927169299058368e-07, 'epoch': 14.24}

 89%|████████▉ | 330520/371472 [4:07:51<3:12:11,  3.55it/s]
 89%|████████▉ | 330521/371472 [4:07:51<3:08:47,  3.62it/s]
 89%|████████▉ | 330522/371472 [4:07:51<3:05:52,  3.67it/s]
 89%|████████▉ | 330523/371472 [4:07:52<2:59:56,  3.79it/s]
 89%|████████▉ | 330524/371472 [4:07:52<2:56:57,  3.86it/s]
 89%|████████▉ | 330525/371472 [4:07:52<2:57:10,  3.85it/s]
 89%|████████▉ | 330526/371472 [4:07:52<2:58:42,  3.82it/s]
 89%|████████▉ | 330527/371472 [4:07:53<3:03:29,  3.72it/s]
 89%|████████▉ | 330528/371472 [4:07:53<3:10:40,  3.58it/s]
 89%|████████▉ | 330529/371472 [4:07:54<5:01:37,  2.26it/s]
 89%|████████▉ | 330530/371472 [4:07:54<4:22:15,  2.60it/s]
 89%|████████▉ | 330531/371472 [4:07:54<4:01:58,  2.82it/s]
 89%|████████▉ | 330532/371472 [4:07:55<3:43:27,  3.05it/s]
 89%|████████▉ | 330533/371472 [4:07:55<3:40:58,  3.09it/s]
 89%|████████▉ | 330534/371472 [4:07:55<3:36:15,  3.16it/s]
 89%|████████▉ | 330535/371472 [4:07:56<3:25:58,  3.31it/s]
 89%|████████▉ | 330536/371472 [4:07:56<3:13:34,  3.52it/s]
 89%|████████▉ | 330537/371472 [4:07:56<3:17:08,  3.46it/s]
 89%|████████▉ | 330538/371472 [4:07:56<3:15:46,  3.48it/s]
 89%|████████▉ | 330539/371472 [4:07:57<3:11:53,  3.56it/s]
 89%|████████▉ | 330540/371472 [4:07:57<3:13:26,  3.53it/s]
                                                           
{'loss': 2.4761, 'learning_rate': 1.9922321101510483e-07, 'epoch': 14.24}

 89%|████████▉ | 330540/371472 [4:07:57<3:13:26,  3.53it/s]
 89%|████████▉ | 330541/371472 [4:07:57<3:13:20,  3.53it/s]
 89%|████████▉ | 330542/371472 [4:07:57<3:06:36,  3.66it/s]
 89%|████████▉ | 330543/371472 [4:07:58<3:18:50,  3.43it/s]
 89%|████████▉ | 330544/371472 [4:07:58<3:23:04,  3.36it/s]
 89%|████████▉ | 330545/371472 [4:07:58<3:22:47,  3.36it/s]
 89%|████████▉ | 330546/371472 [4:07:59<3:23:49,  3.35it/s]
 89%|████████▉ | 330547/371472 [4:07:59<3:17:15,  3.46it/s]
 89%|████████▉ | 330548/371472 [4:07:59<3:10:49,  3.57it/s]
 89%|████████▉ | 330549/371472 [4:08:00<3:26:20,  3.31it/s]
 89%|████████▉ | 330550/371472 [4:08:00<3:24:35,  3.33it/s]
 89%|████████▉ | 330551/371472 [4:08:00<3:23:44,  3.35it/s]
 89%|████████▉ | 330552/371472 [4:08:00<3:32:01,  3.22it/s]
 89%|████████▉ | 330553/371472 [4:08:01<3:36:34,  3.15it/s]
 89%|████████▉ | 330554/371472 [4:08:01<3:19:34,  3.42it/s]
 89%|████████▉ | 330555/371472 [4:08:01<3:14:31,  3.51it/s]
 89%|████████▉ | 330556/371472 [4:08:02<3:08:15,  3.62it/s]
 89%|████████▉ | 330557/371472 [4:08:02<4:04:31,  2.79it/s]
 89%|████████▉ | 330558/371472 [4:08:02<3:40:02,  3.10it/s]
 89%|████████▉ | 330559/371472 [4:08:03<3:23:19,  3.35it/s]
 89%|████████▉ | 330560/371472 [4:08:03<3:12:27,  3.54it/s]
                                                           
{'loss': 2.6843, 'learning_rate': 1.991747290396259e-07, 'epoch': 14.24}

 89%|████████▉ | 330560/371472 [4:08:03<3:12:27,  3.54it/s]
 89%|████████▉ | 330561/371472 [4:08:03<3:07:27,  3.64it/s]
 89%|████████▉ | 330562/371472 [4:08:03<3:16:36,  3.47it/s]
 89%|████████▉ | 330563/371472 [4:08:04<3:16:16,  3.47it/s]
 89%|████████▉ | 330564/371472 [4:08:04<3:28:16,  3.27it/s]
 89%|████████▉ | 330565/371472 [4:08:04<3:25:39,  3.32it/s]
 89%|████████▉ | 330566/371472 [4:08:05<3:14:45,  3.50it/s]
 89%|████████▉ | 330567/371472 [4:08:05<3:09:31,  3.60it/s]
 89%|████████▉ | 330568/371472 [4:08:05<3:01:24,  3.76it/s]
 89%|████████▉ | 330569/371472 [4:08:05<2:59:30,  3.80it/s]
 89%|████████▉ | 330570/371472 [4:08:06<2:56:13,  3.87it/s]
 89%|████████▉ | 330571/371472 [4:08:06<2:56:33,  3.86it/s]
 89%|████████▉ | 330572/371472 [4:08:06<3:05:40,  3.67it/s]
 89%|████████▉ | 330573/371472 [4:08:06<3:07:04,  3.64it/s]
 89%|████████▉ | 330574/371472 [4:08:07<3:10:41,  3.57it/s]
 89%|████████▉ | 330575/371472 [4:08:07<3:12:15,  3.55it/s]
 89%|████████▉ | 330576/371472 [4:08:07<3:07:27,  3.64it/s]
 89%|████████▉ | 330577/371472 [4:08:08<3:20:59,  3.39it/s]
 89%|████████▉ | 330578/371472 [4:08:08<3:13:41,  3.52it/s]
 89%|████████▉ | 330579/371472 [4:08:08<3:09:42,  3.59it/s]
 89%|████████▉ | 330580/371472 [4:08:08<3:07:12,  3.64it/s]
                                                           
{'loss': 2.5665, 'learning_rate': 1.9912624706414705e-07, 'epoch': 14.24}

 89%|████████▉ | 330580/371472 [4:08:08<3:07:12,  3.64it/s]
 89%|████████▉ | 330581/371472 [4:08:09<3:13:00,  3.53it/s]
 89%|████████▉ | 330582/371472 [4:08:09<3:09:23,  3.60it/s]
 89%|████████▉ | 330583/371472 [4:08:09<3:08:53,  3.61it/s]
 89%|████████▉ | 330584/371472 [4:08:10<3:01:50,  3.75it/s]
 89%|████████▉ | 330585/371472 [4:08:10<3:16:57,  3.46it/s]
 89%|████████▉ | 330586/371472 [4:08:10<3:10:39,  3.57it/s]
 89%|████████▉ | 330587/371472 [4:08:10<3:05:54,  3.67it/s]
 89%|████████▉ | 330588/371472 [4:08:11<3:06:28,  3.65it/s]
 89%|████████▉ | 330589/371472 [4:08:11<3:25:09,  3.32it/s]
 89%|████████▉ | 330590/371472 [4:08:11<3:34:17,  3.18it/s]
 89%|████████▉ | 330591/371472 [4:08:12<3:32:38,  3.20it/s]
 89%|████████▉ | 330592/371472 [4:08:12<3:20:19,  3.40it/s]
 89%|████████▉ | 330593/371472 [4:08:12<3:16:00,  3.48it/s]
 89%|████████▉ | 330594/371472 [4:08:12<3:13:49,  3.52it/s]
 89%|████████▉ | 330595/371472 [4:08:13<3:17:42,  3.45it/s]
 89%|████████▉ | 330596/371472 [4:08:13<3:47:43,  2.99it/s]
 89%|████████▉ | 330597/371472 [4:08:13<3:35:05,  3.17it/s]
 89%|████████▉ | 330598/371472 [4:08:14<3:26:51,  3.29it/s]
 89%|████████▉ | 330599/371472 [4:08:14<3:18:30,  3.43it/s]
 89%|████████▉ | 330600/371472 [4:08:14<3:08:00,  3.62it/s]
                                                           
{'loss': 2.5285, 'learning_rate': 1.9907776508866812e-07, 'epoch': 14.24}

 89%|████████▉ | 330600/371472 [4:08:14<3:08:00,  3.62it/s]
 89%|████████▉ | 330601/371472 [4:08:15<3:02:53,  3.72it/s]
 89%|████████▉ | 330602/371472 [4:08:15<3:02:28,  3.73it/s]
 89%|████████▉ | 330603/371472 [4:08:15<3:08:53,  3.61it/s]
 89%|████████▉ | 330604/371472 [4:08:15<3:10:11,  3.58it/s]
 89%|████████▉ | 330605/371472 [4:08:16<3:09:08,  3.60it/s]
 89%|████████▉ | 330606/371472 [4:08:16<3:22:12,  3.37it/s]
 89%|████████▉ | 330607/371472 [4:08:16<3:24:01,  3.34it/s]
 89%|████████▉ | 330608/371472 [4:08:17<3:21:21,  3.38it/s]
 89%|████████▉ | 330609/371472 [4:08:17<3:15:28,  3.48it/s]
 89%|████████▉ | 330610/371472 [4:08:17<3:08:42,  3.61it/s]
 89%|████████▉ | 330611/371472 [4:08:17<3:05:43,  3.67it/s]
 89%|████████▉ | 330612/371472 [4:08:18<3:02:39,  3.73it/s]
 89%|████████▉ | 330613/371472 [4:08:18<3:00:03,  3.78it/s]
 89%|████████▉ | 330614/371472 [4:08:18<3:08:56,  3.60it/s]
 89%|████████▉ | 330615/371472 [4:08:18<3:09:57,  3.58it/s]
 89%|████████▉ | 330616/371472 [4:08:19<3:09:29,  3.59it/s]
 89%|████████▉ | 330617/371472 [4:08:19<3:12:02,  3.55it/s]
 89%|████████▉ | 330618/371472 [4:08:19<3:08:44,  3.61it/s]
 89%|████████▉ | 330619/371472 [4:08:20<3:03:42,  3.71it/s]
 89%|████████▉ | 330620/371472 [4:08:20<3:04:12,  3.70it/s]
                                                           
{'loss': 2.6818, 'learning_rate': 1.9902928311318927e-07, 'epoch': 14.24}

 89%|████████▉ | 330620/371472 [4:08:20<3:04:12,  3.70it/s]
 89%|████████▉ | 330621/371472 [4:08:20<3:21:07,  3.39it/s]
 89%|████████▉ | 330622/371472 [4:08:21<3:33:12,  3.19it/s]
 89%|████████▉ | 330623/371472 [4:08:21<3:19:10,  3.42it/s]
 89%|████████▉ | 330624/371472 [4:08:21<3:11:14,  3.56it/s]
 89%|████████▉ | 330625/371472 [4:08:21<3:14:36,  3.50it/s]
 89%|████████▉ | 330626/371472 [4:08:22<3:07:45,  3.63it/s]
 89%|████████▉ | 330627/371472 [4:08:22<3:08:48,  3.61it/s]
 89%|████████▉ | 330628/371472 [4:08:22<3:16:47,  3.46it/s]
 89%|████████▉ | 330629/371472 [4:08:22<3:08:12,  3.62it/s]
 89%|████████▉ | 330630/371472 [4:08:23<3:09:24,  3.59it/s]
 89%|████████▉ | 330631/371472 [4:08:23<3:05:50,  3.66it/s]
 89%|████████▉ | 330632/371472 [4:08:23<3:00:51,  3.76it/s]
 89%|████████▉ | 330633/371472 [4:08:23<3:01:52,  3.74it/s]
 89%|████████▉ | 330634/371472 [4:08:24<2:57:31,  3.83it/s]
 89%|████████▉ | 330635/371472 [4:08:24<2:56:07,  3.86it/s]
 89%|████████▉ | 330636/371472 [4:08:24<3:03:52,  3.70it/s]
 89%|████████▉ | 330637/371472 [4:08:25<3:03:50,  3.70it/s]
 89%|████████▉ | 330638/371472 [4:08:25<3:06:05,  3.66it/s]
 89%|████████▉ | 330639/371472 [4:08:25<3:28:17,  3.27it/s]
 89%|████████▉ | 330640/371472 [4:08:25<3:23:39,  3.34it/s]
                                                           
{'loss': 2.6861, 'learning_rate': 1.9898080113771032e-07, 'epoch': 14.24}

 89%|████████▉ | 330640/371472 [4:08:25<3:23:39,  3.34it/s]
 89%|████████▉ | 330641/371472 [4:08:26<3:19:07,  3.42it/s]
 89%|████████▉ | 330642/371472 [4:08:26<3:23:48,  3.34it/s]
 89%|████████▉ | 330643/371472 [4:08:26<3:31:24,  3.22it/s]
 89%|████████▉ | 330644/371472 [4:08:27<3:20:36,  3.39it/s]
 89%|████████▉ | 330645/371472 [4:08:27<3:12:03,  3.54it/s]
 89%|████████▉ | 330646/371472 [4:08:27<3:11:22,  3.56it/s]
 89%|████████▉ | 330647/371472 [4:08:28<3:18:36,  3.43it/s]
 89%|████████▉ | 330648/371472 [4:08:28<3:33:01,  3.19it/s]
 89%|████████▉ | 330649/371472 [4:08:28<3:28:47,  3.26it/s]
 89%|████████▉ | 330650/371472 [4:08:28<3:17:55,  3.44it/s]
 89%|████████▉ | 330651/371472 [4:08:29<3:26:16,  3.30it/s]
 89%|████████▉ | 330652/371472 [4:08:29<3:15:21,  3.48it/s]
 89%|████████▉ | 330653/371472 [4:08:29<3:19:44,  3.41it/s]
 89%|████████▉ | 330654/371472 [4:08:30<3:12:59,  3.52it/s]
 89%|████████▉ | 330655/371472 [4:08:30<3:13:51,  3.51it/s]
 89%|████████▉ | 330656/371472 [4:08:30<3:11:46,  3.55it/s]
 89%|████████▉ | 330657/371472 [4:08:30<3:22:17,  3.36it/s]
 89%|████████▉ | 330658/371472 [4:08:31<3:22:17,  3.36it/s]
 89%|████████▉ | 330659/371472 [4:08:31<3:44:00,  3.04it/s]
 89%|████████▉ | 330660/371472 [4:08:31<3:40:31,  3.08it/s]
                                                           
{'loss': 2.6274, 'learning_rate': 1.9893231916223147e-07, 'epoch': 14.24}

 89%|████████▉ | 330660/371472 [4:08:31<3:40:31,  3.08it/s]
 89%|████████▉ | 330661/371472 [4:08:32<3:44:56,  3.02it/s]
 89%|████████▉ | 330662/371472 [4:08:32<3:28:07,  3.27it/s]
 89%|████████▉ | 330663/371472 [4:08:32<3:32:46,  3.20it/s]
 89%|████████▉ | 330664/371472 [4:08:33<3:41:19,  3.07it/s]
 89%|████████▉ | 330665/371472 [4:08:33<3:33:45,  3.18it/s]
 89%|████████▉ | 330666/371472 [4:08:33<3:26:52,  3.29it/s]
 89%|████████▉ | 330667/371472 [4:08:34<3:19:52,  3.40it/s]
 89%|████████▉ | 330668/371472 [4:08:34<3:17:48,  3.44it/s]
 89%|████████▉ | 330669/371472 [4:08:34<3:12:13,  3.54it/s]
 89%|████████▉ | 330670/371472 [4:08:34<3:22:15,  3.36it/s]
 89%|████████▉ | 330671/371472 [4:08:35<3:13:05,  3.52it/s]
 89%|████████▉ | 330672/371472 [4:08:35<3:06:44,  3.64it/s]
 89%|████████▉ | 330673/371472 [4:08:35<3:02:41,  3.72it/s]
 89%|████████▉ | 330674/371472 [4:08:36<3:21:44,  3.37it/s]
 89%|████████▉ | 330675/371472 [4:08:36<3:43:26,  3.04it/s]
 89%|████████▉ | 330676/371472 [4:08:36<3:39:21,  3.10it/s]
 89%|████████▉ | 330677/371472 [4:08:37<3:51:26,  2.94it/s]
 89%|████████▉ | 330678/371472 [4:08:37<3:34:06,  3.18it/s]
 89%|████████▉ | 330679/371472 [4:08:37<3:23:12,  3.35it/s]
 89%|████████▉ | 330680/371472 [4:08:37<3:17:40,  3.44it/s]
                                                           
{'loss': 2.6109, 'learning_rate': 1.9888383718675254e-07, 'epoch': 14.24}

 89%|████████▉ | 330680/371472 [4:08:37<3:17:40,  3.44it/s]
 89%|████████▉ | 330681/371472 [4:08:38<3:18:19,  3.43it/s]
 89%|████████▉ | 330682/371472 [4:08:38<3:18:41,  3.42it/s]
 89%|████████▉ | 330683/371472 [4:08:38<3:20:42,  3.39it/s]
 89%|████████▉ | 330684/371472 [4:08:39<3:20:22,  3.39it/s]
 89%|████████▉ | 330685/371472 [4:08:39<3:41:14,  3.07it/s]
 89%|████████▉ | 330686/371472 [4:08:39<3:48:26,  2.98it/s]
 89%|████████▉ | 330687/371472 [4:08:40<3:36:19,  3.14it/s]
 89%|████████▉ | 330688/371472 [4:08:40<3:28:03,  3.27it/s]
 89%|████████▉ | 330689/371472 [4:08:40<3:18:46,  3.42it/s]
 89%|████████▉ | 330690/371472 [4:08:41<3:14:01,  3.50it/s]
 89%|████████▉ | 330691/371472 [4:08:41<3:07:25,  3.63it/s]
 89%|████████▉ | 330692/371472 [4:08:41<3:13:44,  3.51it/s]
 89%|████████▉ | 330693/371472 [4:08:41<3:13:43,  3.51it/s]
 89%|████████▉ | 330694/371472 [4:08:42<3:06:22,  3.65it/s]
 89%|████████▉ | 330695/371472 [4:08:42<3:02:06,  3.73it/s]
 89%|████████▉ | 330696/371472 [4:08:42<3:08:26,  3.61it/s]
 89%|████████▉ | 330697/371472 [4:08:42<3:05:57,  3.65it/s]
 89%|████████▉ | 330698/371472 [4:08:43<3:06:52,  3.64it/s]
 89%|████████▉ | 330699/371472 [4:08:43<3:09:03,  3.59it/s]
 89%|████████▉ | 330700/371472 [4:08:43<3:17:52,  3.43it/s]
                                                           
{'loss': 2.5062, 'learning_rate': 1.988353552112737e-07, 'epoch': 14.24}

 89%|████████▉ | 330700/371472 [4:08:43<3:17:52,  3.43it/s]
 89%|████████▉ | 330701/371472 [4:08:44<3:11:43,  3.54it/s]
 89%|████████▉ | 330702/371472 [4:08:44<3:05:44,  3.66it/s]
 89%|████████▉ | 330703/371472 [4:08:44<3:16:03,  3.47it/s]
 89%|████████▉ | 330704/371472 [4:08:44<3:14:16,  3.50it/s]
 89%|████████▉ | 330705/371472 [4:08:45<3:10:29,  3.57it/s]
 89%|████████▉ | 330706/371472 [4:08:45<3:17:26,  3.44it/s]
 89%|████████▉ | 330707/371472 [4:08:45<3:13:38,  3.51it/s]
 89%|████████▉ | 330708/371472 [4:08:46<3:20:03,  3.40it/s]
 89%|████████▉ | 330709/371472 [4:08:46<3:19:36,  3.40it/s]
 89%|████████▉ | 330710/371472 [4:08:46<3:15:04,  3.48it/s]
 89%|████████▉ | 330711/371472 [4:08:46<3:23:14,  3.34it/s]
 89%|████████▉ | 330712/371472 [4:08:47<3:12:14,  3.53it/s]
 89%|████████▉ | 330713/371472 [4:08:47<3:34:45,  3.16it/s]
 89%|████████▉ | 330714/371472 [4:08:47<3:23:14,  3.34it/s]
 89%|████████▉ | 330715/371472 [4:08:48<3:14:02,  3.50it/s]
 89%|████████▉ | 330716/371472 [4:08:48<3:07:29,  3.62it/s]
 89%|████████▉ | 330717/371472 [4:08:48<3:07:42,  3.62it/s]
 89%|████████▉ | 330718/371472 [4:08:48<3:13:32,  3.51it/s]
 89%|████████▉ | 330719/371472 [4:08:49<3:20:00,  3.40it/s]
 89%|████████▉ | 330720/371472 [4:08:49<3:16:57,  3.45it/s]
                                                           
{'loss': 2.5264, 'learning_rate': 1.9878687323579474e-07, 'epoch': 14.24}

 89%|████████▉ | 330720/371472 [4:08:49<3:16:57,  3.45it/s]
 89%|████████▉ | 330721/371472 [4:08:49<3:14:09,  3.50it/s]
 89%|████████▉ | 330722/371472 [4:08:50<3:19:23,  3.41it/s]
 89%|████████▉ | 330723/371472 [4:08:50<3:21:34,  3.37it/s]
 89%|████████▉ | 330724/371472 [4:08:50<3:18:09,  3.43it/s]
 89%|████████▉ | 330725/371472 [4:08:51<3:11:32,  3.55it/s]
 89%|████████▉ | 330726/371472 [4:08:51<3:40:02,  3.09it/s]
 89%|████████▉ | 330727/371472 [4:08:51<3:33:04,  3.19it/s]
 89%|████████▉ | 330728/371472 [4:08:52<3:27:42,  3.27it/s]
 89%|████████▉ | 330729/371472 [4:08:52<3:23:48,  3.33it/s]
 89%|████████▉ | 330730/371472 [4:08:52<3:13:20,  3.51it/s]
 89%|████████▉ | 330731/371472 [4:08:52<3:13:24,  3.51it/s]
 89%|████████▉ | 330732/371472 [4:08:53<3:04:20,  3.68it/s]
 89%|████████▉ | 330733/371472 [4:08:53<3:06:16,  3.65it/s]
 89%|████████▉ | 330734/371472 [4:08:53<3:09:09,  3.59it/s]
 89%|████████▉ | 330735/371472 [4:08:53<3:02:58,  3.71it/s]
 89%|████████▉ | 330736/371472 [4:08:54<3:06:34,  3.64it/s]
 89%|████████▉ | 330737/371472 [4:08:54<3:18:15,  3.42it/s]
 89%|████████▉ | 330738/371472 [4:08:54<3:10:27,  3.56it/s]
 89%|████████▉ | 330739/371472 [4:08:55<3:04:38,  3.68it/s]
 89%|████████▉ | 330740/371472 [4:08:55<3:15:10,  3.48it/s]
                                                           
{'loss': 2.7055, 'learning_rate': 1.9873839126031591e-07, 'epoch': 14.25}

 89%|████████▉ | 330740/371472 [4:08:55<3:15:10,  3.48it/s]
 89%|████████▉ | 330741/371472 [4:08:55<3:12:47,  3.52it/s]
 89%|████████▉ | 330742/371472 [4:08:55<3:14:37,  3.49it/s]
 89%|████████▉ | 330743/371472 [4:08:56<3:16:48,  3.45it/s]
 89%|████████▉ | 330744/371472 [4:08:56<3:19:28,  3.40it/s]
 89%|████████▉ | 330745/371472 [4:08:56<3:31:52,  3.20it/s]
 89%|████████▉ | 330746/371472 [4:08:57<3:29:43,  3.24it/s]
 89%|████████▉ | 330747/371472 [4:08:57<3:20:52,  3.38it/s]
 89%|████████▉ | 330748/371472 [4:08:57<3:16:22,  3.46it/s]
 89%|████████▉ | 330749/371472 [4:08:58<3:28:44,  3.25it/s]
 89%|████████▉ | 330750/371472 [4:08:58<3:20:23,  3.39it/s]
 89%|████████▉ | 330751/371472 [4:08:58<3:15:11,  3.48it/s]
 89%|████████▉ | 330752/371472 [4:08:58<3:16:18,  3.46it/s]
 89%|████████▉ | 330753/371472 [4:08:59<3:20:03,  3.39it/s]
 89%|████████▉ | 330754/371472 [4:08:59<3:24:09,  3.32it/s]
 89%|████████▉ | 330755/371472 [4:08:59<3:16:49,  3.45it/s]
 89%|████████▉ | 330756/371472 [4:09:00<3:16:23,  3.46it/s]
 89%|████████▉ | 330757/371472 [4:09:00<3:16:59,  3.44it/s]
 89%|████████▉ | 330758/371472 [4:09:00<3:14:15,  3.49it/s]
 89%|████████▉ | 330759/371472 [4:09:00<3:20:25,  3.39it/s]
 89%|████████▉ | 330760/371472 [4:09:01<3:14:35,  3.49it/s]
                                                           
{'loss': 2.5887, 'learning_rate': 1.9868990928483696e-07, 'epoch': 14.25}

 89%|████████▉ | 330760/371472 [4:09:01<3:14:35,  3.49it/s]
 89%|████████▉ | 330761/371472 [4:09:01<3:20:26,  3.39it/s]
 89%|████████▉ | 330762/371472 [4:09:01<3:10:24,  3.56it/s]
 89%|████████▉ | 330763/371472 [4:09:02<3:12:15,  3.53it/s]
 89%|████████▉ | 330764/371472 [4:09:02<3:12:07,  3.53it/s]
 89%|████████▉ | 330765/371472 [4:09:02<3:08:22,  3.60it/s]
 89%|████████▉ | 330766/371472 [4:09:02<3:03:28,  3.70it/s]
 89%|████████▉ | 330767/371472 [4:09:03<3:04:31,  3.68it/s]
 89%|████████▉ | 330768/371472 [4:09:03<3:05:28,  3.66it/s]
 89%|████████▉ | 330769/371472 [4:09:03<3:01:26,  3.74it/s]
 89%|████████▉ | 330770/371472 [4:09:03<3:00:14,  3.76it/s]
 89%|████████▉ | 330771/371472 [4:09:04<2:58:31,  3.80it/s]
 89%|████████▉ | 330772/371472 [4:09:04<2:58:34,  3.80it/s]
 89%|████████▉ | 330773/371472 [4:09:04<3:02:58,  3.71it/s]
 89%|████████▉ | 330774/371472 [4:09:05<3:08:21,  3.60it/s]
 89%|████████▉ | 330775/371472 [4:09:05<3:16:46,  3.45it/s]
 89%|████████▉ | 330776/371472 [4:09:05<3:23:53,  3.33it/s]
 89%|████████▉ | 330777/371472 [4:09:05<3:23:09,  3.34it/s]
 89%|████████▉ | 330778/371472 [4:09:06<3:28:40,  3.25it/s]
 89%|████████▉ | 330779/371472 [4:09:06<3:25:29,  3.30it/s]
 89%|████████▉ | 330780/371472 [4:09:06<3:16:29,  3.45it/s]
                                                           
{'loss': 2.5158, 'learning_rate': 1.986414273093581e-07, 'epoch': 14.25}

 89%|████████▉ | 330780/371472 [4:09:06<3:16:29,  3.45it/s]
 89%|████████▉ | 330781/371472 [4:09:07<3:30:09,  3.23it/s]
 89%|████████▉ | 330782/371472 [4:09:07<3:34:38,  3.16it/s]
 89%|████████▉ | 330783/371472 [4:09:07<3:32:36,  3.19it/s]
 89%|████████▉ | 330784/371472 [4:09:08<3:23:05,  3.34it/s]
 89%|████████▉ | 330785/371472 [4:09:08<3:14:57,  3.48it/s]
 89%|████████▉ | 330786/371472 [4:09:08<3:19:39,  3.40it/s]
 89%|████████▉ | 330787/371472 [4:09:08<3:20:23,  3.38it/s]
 89%|████████▉ | 330788/371472 [4:09:09<3:14:56,  3.48it/s]
 89%|████████▉ | 330789/371472 [4:09:09<3:09:57,  3.57it/s]
 89%|████████▉ | 330790/371472 [4:09:09<3:10:57,  3.55it/s]
 89%|████████▉ | 330791/371472 [4:09:10<3:08:45,  3.59it/s]
 89%|████████▉ | 330792/371472 [4:09:10<3:16:11,  3.46it/s]
 89%|████████▉ | 330793/371472 [4:09:10<3:10:39,  3.56it/s]
 89%|████████▉ | 330794/371472 [4:09:10<3:13:44,  3.50it/s]
 89%|████████▉ | 330795/371472 [4:09:11<3:15:18,  3.47it/s]
 89%|████████▉ | 330796/371472 [4:09:11<3:10:31,  3.56it/s]
 89%|████████▉ | 330797/371472 [4:09:11<3:16:30,  3.45it/s]
 89%|████████▉ | 330798/371472 [4:09:12<3:05:08,  3.66it/s]
 89%|████████▉ | 330799/371472 [4:09:12<3:00:34,  3.75it/s]
 89%|████████▉ | 330800/371472 [4:09:12<2:58:35,  3.80it/s]
                                                           
{'loss': 2.6444, 'learning_rate': 1.9859294533387918e-07, 'epoch': 14.25}

 89%|████████▉ | 330800/371472 [4:09:12<2:58:35,  3.80it/s]
 89%|████████▉ | 330801/371472 [4:09:12<3:12:49,  3.52it/s]
 89%|████████▉ | 330802/371472 [4:09:13<3:13:23,  3.50it/s]
 89%|████████▉ | 330803/371472 [4:09:13<3:03:33,  3.69it/s]
 89%|████████▉ | 330804/371472 [4:09:13<2:59:57,  3.77it/s]
 89%|████████▉ | 330805/371472 [4:09:13<2:56:06,  3.85it/s]
 89%|████████▉ | 330806/371472 [4:09:14<3:21:46,  3.36it/s]
 89%|████████▉ | 330807/371472 [4:09:14<3:14:10,  3.49it/s]
 89%|████████▉ | 330808/371472 [4:09:14<3:08:26,  3.60it/s]
 89%|████████▉ | 330809/371472 [4:09:15<3:03:36,  3.69it/s]
 89%|████████▉ | 330810/371472 [4:09:15<3:19:17,  3.40it/s]
 89%|████████▉ | 330811/371472 [4:09:15<3:15:48,  3.46it/s]
 89%|████████▉ | 330812/371472 [4:09:15<3:10:25,  3.56it/s]
 89%|████████▉ | 330813/371472 [4:09:16<3:17:28,  3.43it/s]
 89%|████████▉ | 330814/371472 [4:09:16<3:34:56,  3.15it/s]
 89%|████████▉ | 330815/371472 [4:09:16<3:25:50,  3.29it/s]
 89%|████████▉ | 330816/371472 [4:09:17<3:15:18,  3.47it/s]
 89%|████████▉ | 330817/371472 [4:09:17<3:31:48,  3.20it/s]
 89%|████████▉ | 330818/371472 [4:09:17<3:22:57,  3.34it/s]
 89%|████████▉ | 330819/371472 [4:09:18<3:16:31,  3.45it/s]
 89%|████████▉ | 330820/371472 [4:09:18<3:22:57,  3.34it/s]
                                                           
{'loss': 2.5475, 'learning_rate': 1.9854446335840033e-07, 'epoch': 14.25}

 89%|████████▉ | 330820/371472 [4:09:18<3:22:57,  3.34it/s]
 89%|████████▉ | 330821/371472 [4:09:18<3:21:33,  3.36it/s]
 89%|████████▉ | 330822/371472 [4:09:19<3:33:53,  3.17it/s]
 89%|████████▉ | 330823/371472 [4:09:19<3:22:58,  3.34it/s]
 89%|████████▉ | 330824/371472 [4:09:19<3:34:35,  3.16it/s]
 89%|████████▉ | 330825/371472 [4:09:20<3:45:30,  3.00it/s]
 89%|████████▉ | 330826/371472 [4:09:20<3:32:22,  3.19it/s]
 89%|████████▉ | 330827/371472 [4:09:20<3:28:29,  3.25it/s]
 89%|████████▉ | 330828/371472 [4:09:20<3:22:18,  3.35it/s]
 89%|████████▉ | 330829/371472 [4:09:21<3:14:34,  3.48it/s]
 89%|████████▉ | 330830/371472 [4:09:21<3:09:17,  3.58it/s]
 89%|████████▉ | 330831/371472 [4:09:21<3:09:02,  3.58it/s]
 89%|████████▉ | 330832/371472 [4:09:22<3:19:14,  3.40it/s]
 89%|████████▉ | 330833/371472 [4:09:22<3:20:42,  3.37it/s]
 89%|████████▉ | 330834/371472 [4:09:22<3:26:58,  3.27it/s]
 89%|████████▉ | 330835/371472 [4:09:22<3:22:44,  3.34it/s]
 89%|████████▉ | 330836/371472 [4:09:23<3:25:57,  3.29it/s]
 89%|████████▉ | 330837/371472 [4:09:23<3:19:36,  3.39it/s]
 89%|████████▉ | 330838/371472 [4:09:23<3:38:59,  3.09it/s]
 89%|████████▉ | 330839/371472 [4:09:24<3:26:57,  3.27it/s]
 89%|████████▉ | 330840/371472 [4:09:24<3:14:41,  3.48it/s]
                                                           
{'loss': 2.6158, 'learning_rate': 1.9849598138292138e-07, 'epoch': 14.25}

 89%|████████▉ | 330840/371472 [4:09:24<3:14:41,  3.48it/s]
 89%|████████▉ | 330841/371472 [4:09:24<3:06:31,  3.63it/s]
 89%|████████▉ | 330842/371472 [4:09:24<3:03:50,  3.68it/s]
 89%|████████▉ | 330843/371472 [4:09:25<3:03:41,  3.69it/s]
 89%|████████▉ | 330844/371472 [4:09:25<3:04:44,  3.67it/s]
 89%|████████▉ | 330845/371472 [4:09:25<3:01:34,  3.73it/s]
 89%|████████▉ | 330846/371472 [4:09:26<3:07:30,  3.61it/s]
 89%|████████▉ | 330847/371472 [4:09:26<3:23:46,  3.32it/s]
 89%|████████▉ | 330848/371472 [4:09:26<3:24:45,  3.31it/s]
 89%|████████▉ | 330849/371472 [4:09:26<3:15:45,  3.46it/s]
 89%|████████▉ | 330850/371472 [4:09:27<3:15:58,  3.45it/s]
 89%|████████▉ | 330851/371472 [4:09:27<3:09:34,  3.57it/s]
 89%|████████▉ | 330852/371472 [4:09:27<3:11:11,  3.54it/s]
 89%|████████▉ | 330853/371472 [4:09:28<3:05:51,  3.64it/s]
 89%|████████▉ | 330854/371472 [4:09:28<3:02:20,  3.71it/s]
 89%|████████▉ | 330855/371472 [4:09:28<2:57:17,  3.82it/s]
 89%|████████▉ | 330856/371472 [4:09:28<2:59:31,  3.77it/s]
 89%|████████▉ | 330857/371472 [4:09:29<3:16:44,  3.44it/s]
 89%|████████▉ | 330858/371472 [4:09:29<3:10:12,  3.56it/s]
 89%|████████▉ | 330859/371472 [4:09:29<3:04:38,  3.67it/s]
 89%|████████▉ | 330860/371472 [4:09:30<3:16:29,  3.44it/s]
                                                           
{'loss': 2.441, 'learning_rate': 1.9844749940744255e-07, 'epoch': 14.25}

 89%|████████▉ | 330860/371472 [4:09:30<3:16:29,  3.44it/s]
 89%|████████▉ | 330861/371472 [4:09:30<3:08:44,  3.59it/s]
 89%|████████▉ | 330862/371472 [4:09:30<3:13:15,  3.50it/s]
 89%|████████▉ | 330863/371472 [4:09:30<3:25:53,  3.29it/s]
 89%|████████▉ | 330864/371472 [4:09:31<3:21:52,  3.35it/s]
 89%|████████▉ | 330865/371472 [4:09:31<3:16:48,  3.44it/s]
 89%|████████▉ | 330866/371472 [4:09:31<3:12:02,  3.52it/s]
 89%|████████▉ | 330867/371472 [4:09:31<3:04:53,  3.66it/s]
 89%|████████▉ | 330868/371472 [4:09:32<3:05:51,  3.64it/s]
 89%|████████▉ | 330869/371472 [4:09:32<3:09:05,  3.58it/s]
 89%|████████▉ | 330870/371472 [4:09:32<3:12:11,  3.52it/s]
 89%|████████▉ | 330871/371472 [4:09:33<3:10:06,  3.56it/s]
 89%|████████▉ | 330872/371472 [4:09:33<3:10:31,  3.55it/s]
 89%|████████▉ | 330873/371472 [4:09:33<3:19:24,  3.39it/s]
 89%|████████▉ | 330874/371472 [4:09:33<3:09:34,  3.57it/s]
 89%|████████▉ | 330875/371472 [4:09:34<3:06:17,  3.63it/s]
 89%|████████▉ | 330876/371472 [4:09:34<3:17:21,  3.43it/s]
 89%|████████▉ | 330877/371472 [4:09:34<3:20:12,  3.38it/s]
 89%|████████▉ | 330878/371472 [4:09:35<3:22:14,  3.35it/s]
 89%|████████▉ | 330879/371472 [4:09:35<3:24:37,  3.31it/s]
 89%|████████▉ | 330880/371472 [4:09:35<3:18:05,  3.42it/s]
                                                           
{'loss': 2.6782, 'learning_rate': 1.9839901743196363e-07, 'epoch': 14.25}

 89%|████████▉ | 330880/371472 [4:09:35<3:18:05,  3.42it/s]
 89%|████████▉ | 330881/371472 [4:09:36<3:11:21,  3.54it/s]
 89%|████████▉ | 330882/371472 [4:09:36<3:09:03,  3.58it/s]
 89%|████████▉ | 330883/371472 [4:09:36<3:06:30,  3.63it/s]
 89%|████████▉ | 330884/371472 [4:09:36<3:06:44,  3.62it/s]
 89%|████████▉ | 330885/371472 [4:09:37<3:10:33,  3.55it/s]
 89%|████████▉ | 330886/371472 [4:09:37<3:37:12,  3.11it/s]
 89%|████████▉ | 330887/371472 [4:09:37<3:34:54,  3.15it/s]
 89%|████████▉ | 330888/371472 [4:09:38<3:27:28,  3.26it/s]
 89%|████████▉ | 330889/371472 [4:09:38<3:23:34,  3.32it/s]
 89%|████████▉ | 330890/371472 [4:09:38<3:22:02,  3.35it/s]
 89%|████████▉ | 330891/371472 [4:09:38<3:09:36,  3.57it/s]
 89%|████████▉ | 330892/371472 [4:09:39<3:25:16,  3.29it/s]
 89%|████████▉ | 330893/371472 [4:09:39<3:26:39,  3.27it/s]
 89%|████████▉ | 330894/371472 [4:09:39<3:15:52,  3.45it/s]
 89%|████████▉ | 330895/371472 [4:09:40<3:22:57,  3.33it/s]
 89%|████████▉ | 330896/371472 [4:09:40<3:16:47,  3.44it/s]
 89%|████████▉ | 330897/371472 [4:09:40<3:13:39,  3.49it/s]
 89%|████████▉ | 330898/371472 [4:09:41<3:15:41,  3.46it/s]
 89%|████████▉ | 330899/371472 [4:09:41<3:15:14,  3.46it/s]
 89%|████████▉ | 330900/371472 [4:09:41<3:15:53,  3.45it/s]
                                                           
{'loss': 2.6698, 'learning_rate': 1.9835053545648475e-07, 'epoch': 14.25}

 89%|████████▉ | 330900/371472 [4:09:41<3:15:53,  3.45it/s]
 89%|████████▉ | 330901/371472 [4:09:41<3:17:24,  3.43it/s]
 89%|████████▉ | 330902/371472 [4:09:42<3:15:12,  3.46it/s]
 89%|████████▉ | 330903/371472 [4:09:42<3:17:26,  3.42it/s]
 89%|████████▉ | 330904/371472 [4:09:42<3:25:41,  3.29it/s]
 89%|████████▉ | 330905/371472 [4:09:43<3:17:03,  3.43it/s]
 89%|████████▉ | 330906/371472 [4:09:43<3:09:29,  3.57it/s]
 89%|████████▉ | 330907/371472 [4:09:43<3:09:27,  3.57it/s]
 89%|████████▉ | 330908/371472 [4:09:43<3:04:17,  3.67it/s]
 89%|████████▉ | 330909/371472 [4:09:44<3:01:09,  3.73it/s]
 89%|████████▉ | 330910/371472 [4:09:44<3:01:34,  3.72it/s]
 89%|████████▉ | 330911/371472 [4:09:44<3:07:20,  3.61it/s]
 89%|████████▉ | 330912/371472 [4:09:45<3:12:25,  3.51it/s]
 89%|████████▉ | 330913/371472 [4:09:45<3:23:17,  3.33it/s]
 89%|████████▉ | 330914/371472 [4:09:45<3:17:08,  3.43it/s]
 89%|████████▉ | 330915/371472 [4:09:45<3:09:48,  3.56it/s]
 89%|████████▉ | 330916/371472 [4:09:46<3:12:08,  3.52it/s]
 89%|████████▉ | 330917/371472 [4:09:46<3:16:13,  3.44it/s]
 89%|████████▉ | 330918/371472 [4:09:46<3:18:17,  3.41it/s]
 89%|████████▉ | 330919/371472 [4:09:47<3:15:57,  3.45it/s]
 89%|████████▉ | 330920/371472 [4:09:47<3:17:03,  3.43it/s]
                                                           
{'loss': 2.6545, 'learning_rate': 1.9830205348100582e-07, 'epoch': 14.25}

 89%|████████▉ | 330920/371472 [4:09:47<3:17:03,  3.43it/s]
 89%|████████▉ | 330921/371472 [4:09:47<3:15:39,  3.45it/s]
 89%|████████▉ | 330922/371472 [4:09:47<3:11:41,  3.53it/s]
 89%|████████▉ | 330923/371472 [4:09:48<3:07:27,  3.61it/s]
 89%|████████▉ | 330924/371472 [4:09:48<3:07:43,  3.60it/s]
 89%|████████▉ | 330925/371472 [4:09:48<3:12:12,  3.52it/s]
 89%|████████▉ | 330926/371472 [4:09:48<3:07:21,  3.61it/s]
 89%|████████▉ | 330927/371472 [4:09:49<3:03:02,  3.69it/s]
 89%|████████▉ | 330928/371472 [4:09:49<3:02:11,  3.71it/s]
 89%|████████▉ | 330929/371472 [4:09:49<3:11:24,  3.53it/s]
 89%|████████▉ | 330930/371472 [4:09:50<3:14:54,  3.47it/s]
 89%|████████▉ | 330931/371472 [4:09:50<3:13:06,  3.50it/s]
 89%|████████▉ | 330932/371472 [4:09:50<3:17:09,  3.43it/s]
 89%|████████▉ | 330933/371472 [4:09:50<3:14:08,  3.48it/s]
 89%|████████▉ | 330934/371472 [4:09:51<3:12:26,  3.51it/s]
 89%|████████▉ | 330935/371472 [4:09:51<3:11:30,  3.53it/s]
 89%|████████▉ | 330936/371472 [4:09:51<3:11:43,  3.52it/s]
 89%|████████▉ | 330937/371472 [4:09:52<3:04:40,  3.66it/s]
 89%|████████▉ | 330938/371472 [4:09:52<3:19:39,  3.38it/s]
 89%|████████▉ | 330939/371472 [4:09:52<3:14:54,  3.47it/s]
 89%|████████▉ | 330940/371472 [4:09:53<3:21:28,  3.35it/s]
                                                           
{'loss': 2.5486, 'learning_rate': 1.98253571505527e-07, 'epoch': 14.25}

 89%|████████▉ | 330940/371472 [4:09:53<3:21:28,  3.35it/s]
 89%|████████▉ | 330941/371472 [4:09:53<3:16:29,  3.44it/s]
 89%|████████▉ | 330942/371472 [4:09:53<3:16:06,  3.44it/s]
 89%|████████▉ | 330943/371472 [4:09:53<3:13:25,  3.49it/s]
 89%|████████▉ | 330944/371472 [4:09:54<3:15:07,  3.46it/s]
 89%|████████▉ | 330945/371472 [4:09:54<3:13:12,  3.50it/s]
 89%|████████▉ | 330946/371472 [4:09:54<3:11:49,  3.52it/s]
 89%|████████▉ | 330947/371472 [4:09:54<3:09:03,  3.57it/s]
 89%|████████▉ | 330948/371472 [4:09:55<3:05:19,  3.64it/s]
 89%|████████▉ | 330949/371472 [4:09:55<3:15:06,  3.46it/s]
 89%|████████▉ | 330950/371472 [4:09:55<3:26:40,  3.27it/s]
 89%|████████▉ | 330951/371472 [4:09:56<3:15:45,  3.45it/s]
 89%|████████▉ | 330952/371472 [4:09:56<3:13:54,  3.48it/s]
 89%|████████▉ | 330953/371472 [4:09:56<3:12:25,  3.51it/s]
 89%|████████▉ | 330954/371472 [4:09:57<3:15:15,  3.46it/s]
 89%|████████▉ | 330955/371472 [4:09:57<3:14:48,  3.47it/s]
 89%|████████▉ | 330956/371472 [4:09:57<3:14:12,  3.48it/s]
 89%|████████▉ | 330957/371472 [4:09:57<3:11:54,  3.52it/s]
 89%|████████▉ | 330958/371472 [4:09:58<3:10:45,  3.54it/s]
 89%|████████▉ | 330959/371472 [4:09:58<3:10:54,  3.54it/s]
 89%|████████▉ | 330960/371472 [4:09:58<3:14:18,  3.47it/s]
                                                           
{'loss': 2.5391, 'learning_rate': 1.9820508953004804e-07, 'epoch': 14.26}

 89%|████████▉ | 330960/371472 [4:09:58<3:14:18,  3.47it/s]
 89%|████████▉ | 330961/371472 [4:09:59<3:24:38,  3.30it/s]
 89%|████████▉ | 330962/371472 [4:09:59<3:16:16,  3.44it/s]
 89%|████████▉ | 330963/371472 [4:09:59<3:19:42,  3.38it/s]
 89%|████████▉ | 330964/371472 [4:09:59<3:11:04,  3.53it/s]
 89%|████████▉ | 330965/371472 [4:10:00<3:10:17,  3.55it/s]
 89%|████████▉ | 330966/371472 [4:10:00<3:13:46,  3.48it/s]
 89%|████████▉ | 330967/371472 [4:10:00<3:29:13,  3.23it/s]
 89%|████████▉ | 330968/371472 [4:10:01<3:17:39,  3.42it/s]
 89%|████████▉ | 330969/371472 [4:10:01<3:12:30,  3.51it/s]
 89%|████████▉ | 330970/371472 [4:10:01<3:09:01,  3.57it/s]
 89%|████████▉ | 330971/371472 [4:10:01<3:08:43,  3.58it/s]
 89%|████████▉ | 330972/371472 [4:10:02<3:20:12,  3.37it/s]
 89%|████████▉ | 330973/371472 [4:10:02<3:27:46,  3.25it/s]
 89%|████████▉ | 330974/371472 [4:10:02<3:22:05,  3.34it/s]
 89%|████████▉ | 330975/371472 [4:10:03<3:29:43,  3.22it/s]
 89%|████████▉ | 330976/371472 [4:10:03<3:26:33,  3.27it/s]
 89%|████████▉ | 330977/371472 [4:10:03<3:19:07,  3.39it/s]
 89%|████████▉ | 330978/371472 [4:10:04<3:08:26,  3.58it/s]
 89%|████████▉ | 330979/371472 [4:10:04<3:10:13,  3.55it/s]
 89%|████████▉ | 330980/371472 [4:10:04<3:04:37,  3.66it/s]
                                                           
{'loss': 2.6845, 'learning_rate': 1.981566075545691e-07, 'epoch': 14.26}

 89%|████████▉ | 330980/371472 [4:10:04<3:04:37,  3.66it/s]
 89%|████████▉ | 330981/371472 [4:10:04<3:18:31,  3.40it/s]
 89%|████████▉ | 330982/371472 [4:10:05<3:37:36,  3.10it/s]
 89%|████████▉ | 330983/371472 [4:10:05<3:37:49,  3.10it/s]
 89%|████████▉ | 330984/371472 [4:10:05<3:33:13,  3.16it/s]
 89%|████████▉ | 330985/371472 [4:10:06<3:27:51,  3.25it/s]
 89%|████████▉ | 330986/371472 [4:10:06<3:22:58,  3.32it/s]
 89%|████████▉ | 330987/371472 [4:10:06<3:27:35,  3.25it/s]
 89%|████████▉ | 330988/371472 [4:10:07<3:17:08,  3.42it/s]
 89%|████████▉ | 330989/371472 [4:10:07<3:14:20,  3.47it/s]
 89%|████████▉ | 330990/371472 [4:10:07<3:08:29,  3.58it/s]
 89%|████████▉ | 330991/371472 [4:10:07<3:18:20,  3.40it/s]
 89%|████████▉ | 330992/371472 [4:10:08<3:08:36,  3.58it/s]
 89%|████████▉ | 330993/371472 [4:10:08<3:14:00,  3.48it/s]
 89%|████████▉ | 330994/371472 [4:10:08<3:06:17,  3.62it/s]
 89%|████████▉ | 330995/371472 [4:10:09<3:22:27,  3.33it/s]
 89%|████████▉ | 330996/371472 [4:10:09<3:20:12,  3.37it/s]
 89%|████████▉ | 330997/371472 [4:10:09<3:20:23,  3.37it/s]
 89%|████████▉ | 330998/371472 [4:10:09<3:23:44,  3.31it/s]
 89%|████████▉ | 330999/371472 [4:10:10<3:25:26,  3.28it/s]
 89%|████████▉ | 331000/371472 [4:10:10<3:29:42,  3.22it/s]
                                                           
{'loss': 2.3916, 'learning_rate': 1.9810812557909027e-07, 'epoch': 14.26}

 89%|████████▉ | 331000/371472 [4:10:10<3:29:42,  3.22it/s]
 89%|████████▉ | 331001/371472 [4:10:10<3:23:16,  3.32it/s]
 89%|████████▉ | 331002/371472 [4:10:11<3:11:24,  3.52it/s]
 89%|████████▉ | 331003/371472 [4:10:11<3:19:03,  3.39it/s]
 89%|████████▉ | 331004/371472 [4:10:11<3:15:41,  3.45it/s]
 89%|████████▉ | 331005/371472 [4:10:12<3:11:46,  3.52it/s]
 89%|████████▉ | 331006/371472 [4:10:12<3:24:07,  3.30it/s]
 89%|████████▉ | 331007/371472 [4:10:12<3:24:09,  3.30it/s]
 89%|████████▉ | 331008/371472 [4:10:12<3:19:44,  3.38it/s]
 89%|████████▉ | 331009/371472 [4:10:13<3:13:11,  3.49it/s]
 89%|████████▉ | 331010/371472 [4:10:13<3:18:50,  3.39it/s]
 89%|████████▉ | 331011/371472 [4:10:13<3:12:57,  3.49it/s]
 89%|████████▉ | 331012/371472 [4:10:14<3:14:38,  3.46it/s]
 89%|████████▉ | 331013/371472 [4:10:14<3:14:20,  3.47it/s]
 89%|████████▉ | 331014/371472 [4:10:14<3:18:24,  3.40it/s]
 89%|████████▉ | 331015/371472 [4:10:14<3:12:02,  3.51it/s]
 89%|████████▉ | 331016/371472 [4:10:15<3:12:48,  3.50it/s]
 89%|████████▉ | 331017/371472 [4:10:15<3:04:36,  3.65it/s]
 89%|████████▉ | 331018/371472 [4:10:15<3:01:40,  3.71it/s]
 89%|████████▉ | 331019/371472 [4:10:16<3:07:44,  3.59it/s]
 89%|████████▉ | 331020/371472 [4:10:16<3:09:19,  3.56it/s]
                                                           
{'loss': 2.6396, 'learning_rate': 1.9805964360361129e-07, 'epoch': 14.26}

 89%|████████▉ | 331020/371472 [4:10:16<3:09:19,  3.56it/s]
 89%|████████▉ | 331021/371472 [4:10:16<3:10:58,  3.53it/s]
 89%|████████▉ | 331022/371472 [4:10:16<3:18:25,  3.40it/s]
 89%|████████▉ | 331023/371472 [4:10:17<3:08:00,  3.59it/s]
 89%|████████▉ | 331024/371472 [4:10:17<3:06:03,  3.62it/s]
 89%|████████▉ | 331025/371472 [4:10:17<3:07:05,  3.60it/s]
 89%|████████▉ | 331026/371472 [4:10:17<3:05:20,  3.64it/s]
 89%|████████▉ | 331027/371472 [4:10:18<3:15:34,  3.45it/s]
 89%|████████▉ | 331028/371472 [4:10:18<3:22:51,  3.32it/s]
 89%|████████▉ | 331029/371472 [4:10:18<3:15:44,  3.44it/s]
 89%|████████▉ | 331030/371472 [4:10:19<3:09:17,  3.56it/s]
 89%|████████▉ | 331031/371472 [4:10:19<3:15:05,  3.45it/s]
 89%|████████▉ | 331032/371472 [4:10:19<3:08:24,  3.58it/s]
 89%|████████▉ | 331033/371472 [4:10:20<3:18:26,  3.40it/s]
 89%|████████▉ | 331034/371472 [4:10:20<3:21:21,  3.35it/s]
 89%|████████▉ | 331035/371472 [4:10:20<3:14:29,  3.47it/s]
 89%|████████▉ | 331036/371472 [4:10:20<3:09:41,  3.55it/s]
 89%|████████▉ | 331037/371472 [4:10:21<3:09:22,  3.56it/s]
 89%|████████▉ | 331038/371472 [4:10:21<3:19:41,  3.37it/s]
 89%|████████▉ | 331039/371472 [4:10:21<3:32:49,  3.17it/s]
 89%|████████▉ | 331040/371472 [4:10:22<3:33:01,  3.16it/s]
                                                           
{'loss': 2.6673, 'learning_rate': 1.9801116162813246e-07, 'epoch': 14.26}

 89%|████████▉ | 331040/371472 [4:10:22<3:33:01,  3.16it/s]
 89%|████████▉ | 331041/371472 [4:10:22<3:29:01,  3.22it/s]
 89%|████████▉ | 331042/371472 [4:10:22<3:15:11,  3.45it/s]
 89%|████████▉ | 331043/371472 [4:10:22<3:09:57,  3.55it/s]
 89%|████████▉ | 331044/371472 [4:10:23<3:05:57,  3.62it/s]
 89%|████████▉ | 331045/371472 [4:10:23<3:03:43,  3.67it/s]
 89%|████████▉ | 331046/371472 [4:10:23<3:05:28,  3.63it/s]
 89%|████████▉ | 331047/371472 [4:10:24<3:05:43,  3.63it/s]
 89%|████████▉ | 331048/371472 [4:10:24<3:01:31,  3.71it/s]
 89%|████████▉ | 331049/371472 [4:10:24<3:04:56,  3.64it/s]
 89%|████████▉ | 331050/371472 [4:10:24<3:02:53,  3.68it/s]
 89%|████████▉ | 331051/371472 [4:10:25<3:08:07,  3.58it/s]
 89%|████████▉ | 331052/371472 [4:10:25<3:09:58,  3.55it/s]
 89%|████████▉ | 331053/371472 [4:10:25<3:23:54,  3.30it/s]
 89%|████████▉ | 331054/371472 [4:10:26<3:27:50,  3.24it/s]
 89%|████████▉ | 331055/371472 [4:10:26<3:28:22,  3.23it/s]
 89%|████████▉ | 331056/371472 [4:10:26<3:31:55,  3.18it/s]
 89%|████████▉ | 331057/371472 [4:10:27<3:23:52,  3.30it/s]
 89%|████████▉ | 331058/371472 [4:10:27<3:21:18,  3.35it/s]
 89%|████████▉ | 331059/371472 [4:10:27<3:16:09,  3.43it/s]
 89%|████████▉ | 331060/371472 [4:10:27<3:10:34,  3.53it/s]
                                                           
{'loss': 2.5822, 'learning_rate': 1.9796267965265353e-07, 'epoch': 14.26}

 89%|████████▉ | 331060/371472 [4:10:27<3:10:34,  3.53it/s]
 89%|████████▉ | 331061/371472 [4:10:28<3:09:52,  3.55it/s]
 89%|████████▉ | 331062/371472 [4:10:28<3:04:26,  3.65it/s]
 89%|████████▉ | 331063/371472 [4:10:28<3:13:46,  3.48it/s]
 89%|████████▉ | 331064/371472 [4:10:29<3:27:19,  3.25it/s]
 89%|████████▉ | 331065/371472 [4:10:29<3:29:20,  3.22it/s]
 89%|████████▉ | 331066/371472 [4:10:29<3:16:46,  3.42it/s]
 89%|████████▉ | 331067/371472 [4:10:29<3:12:46,  3.49it/s]
 89%|████████▉ | 331068/371472 [4:10:30<3:21:56,  3.33it/s]
 89%|████████▉ | 331069/371472 [4:10:30<3:20:09,  3.36it/s]
 89%|████████▉ | 331070/371472 [4:10:30<3:13:22,  3.48it/s]
 89%|████████▉ | 331071/371472 [4:10:31<3:25:15,  3.28it/s]
 89%|████████▉ | 331072/371472 [4:10:31<3:25:03,  3.28it/s]
 89%|████████▉ | 331073/371472 [4:10:31<3:23:35,  3.31it/s]
 89%|████████▉ | 331074/371472 [4:10:32<3:10:50,  3.53it/s]
 89%|████████▉ | 331075/371472 [4:10:32<3:08:05,  3.58it/s]
 89%|████████▉ | 331076/371472 [4:10:32<3:03:21,  3.67it/s]
 89%|████████▉ | 331077/371472 [4:10:32<3:07:54,  3.58it/s]
 89%|████████▉ | 331078/371472 [4:10:33<3:24:34,  3.29it/s]
 89%|████████▉ | 331079/371472 [4:10:33<3:19:23,  3.38it/s]
 89%|████████▉ | 331080/371472 [4:10:33<3:19:10,  3.38it/s]
                                                           
{'loss': 2.5869, 'learning_rate': 1.9791419767717469e-07, 'epoch': 14.26}

 89%|████████▉ | 331080/371472 [4:10:33<3:19:10,  3.38it/s]
 89%|████████▉ | 331081/371472 [4:10:34<3:27:44,  3.24it/s]
 89%|████████▉ | 331082/371472 [4:10:34<3:18:06,  3.40it/s]
 89%|████████▉ | 331083/371472 [4:10:34<3:15:06,  3.45it/s]
 89%|████████▉ | 331084/371472 [4:10:34<3:15:15,  3.45it/s]
 89%|████████▉ | 331085/371472 [4:10:35<3:07:17,  3.59it/s]
 89%|████████▉ | 331086/371472 [4:10:35<3:05:58,  3.62it/s]
 89%|████████▉ | 331087/371472 [4:10:35<3:05:22,  3.63it/s]
 89%|████████▉ | 331088/371472 [4:10:35<3:04:31,  3.65it/s]
 89%|████████▉ | 331089/371472 [4:10:36<3:02:32,  3.69it/s]
 89%|████████▉ | 331090/371472 [4:10:36<3:04:56,  3.64it/s]
 89%|████████▉ | 331091/371472 [4:10:36<2:58:38,  3.77it/s]
 89%|████████▉ | 331092/371472 [4:10:37<2:57:29,  3.79it/s]
 89%|████████▉ | 331093/371472 [4:10:37<2:57:33,  3.79it/s]
 89%|████████▉ | 331094/371472 [4:10:37<2:57:16,  3.80it/s]
 89%|████████▉ | 331095/371472 [4:10:37<3:07:00,  3.60it/s]
 89%|████████▉ | 331096/371472 [4:10:38<3:10:15,  3.54it/s]
 89%|████████▉ | 331097/371472 [4:10:38<3:10:15,  3.54it/s]
 89%|████████▉ | 331098/371472 [4:10:38<3:10:40,  3.53it/s]
 89%|████████▉ | 331099/371472 [4:10:39<3:15:32,  3.44it/s]
 89%|████████▉ | 331100/371472 [4:10:39<3:19:31,  3.37it/s]
                                                           
{'loss': 2.5835, 'learning_rate': 1.9786571570169573e-07, 'epoch': 14.26}

 89%|████████▉ | 331100/371472 [4:10:39<3:19:31,  3.37it/s]
 89%|████████▉ | 331101/371472 [4:10:39<3:23:31,  3.31it/s]
 89%|████████▉ | 331102/371472 [4:10:39<3:23:10,  3.31it/s]
 89%|████████▉ | 331103/371472 [4:10:40<3:18:19,  3.39it/s]
 89%|████████▉ | 331104/371472 [4:10:40<3:15:34,  3.44it/s]
 89%|████████▉ | 331105/371472 [4:10:40<3:22:54,  3.32it/s]
 89%|████████▉ | 331106/371472 [4:10:41<3:16:27,  3.42it/s]
 89%|████████▉ | 331107/371472 [4:10:41<3:11:38,  3.51it/s]
 89%|████████▉ | 331108/371472 [4:10:41<3:19:24,  3.37it/s]
 89%|████████▉ | 331109/371472 [4:10:41<3:10:55,  3.52it/s]
 89%|████████▉ | 331110/371472 [4:10:42<3:23:51,  3.30it/s]
 89%|████████▉ | 331111/371472 [4:10:42<3:17:06,  3.41it/s]
 89%|████████▉ | 331112/371472 [4:10:42<3:13:20,  3.48it/s]
 89%|████████▉ | 331113/371472 [4:10:43<3:09:26,  3.55it/s]
 89%|████████▉ | 331114/371472 [4:10:43<3:09:17,  3.55it/s]
 89%|████████▉ | 331115/371472 [4:10:43<3:07:41,  3.58it/s]
 89%|████████▉ | 331116/371472 [4:10:43<3:07:42,  3.58it/s]
 89%|████████▉ | 331117/371472 [4:10:44<3:27:36,  3.24it/s]
 89%|████████▉ | 331118/371472 [4:10:44<3:28:26,  3.23it/s]
 89%|████████▉ | 331119/371472 [4:10:44<3:27:15,  3.24it/s]
 89%|████████▉ | 331120/371472 [4:10:45<3:14:12,  3.46it/s]
                                                           
{'loss': 2.6657, 'learning_rate': 1.978172337262169e-07, 'epoch': 14.26}

 89%|████████▉ | 331120/371472 [4:10:45<3:14:12,  3.46it/s]
 89%|████████▉ | 331121/371472 [4:10:45<3:11:48,  3.51it/s]
 89%|████████▉ | 331122/371472 [4:10:45<3:11:15,  3.52it/s]
 89%|████████▉ | 331123/371472 [4:10:46<3:26:17,  3.26it/s]
 89%|████████▉ | 331124/371472 [4:10:46<3:17:19,  3.41it/s]
 89%|████████▉ | 331125/371472 [4:10:46<3:21:32,  3.34it/s]
 89%|████████▉ | 331126/371472 [4:10:47<3:30:34,  3.19it/s]
 89%|████████▉ | 331127/371472 [4:10:47<3:29:30,  3.21it/s]
 89%|████████▉ | 331128/371472 [4:10:47<3:20:03,  3.36it/s]
 89%|████████▉ | 331129/371472 [4:10:47<3:30:24,  3.20it/s]
 89%|████████▉ | 331130/371472 [4:10:48<3:20:00,  3.36it/s]
 89%|████████▉ | 331131/371472 [4:10:48<3:16:47,  3.42it/s]
 89%|████████▉ | 331132/371472 [4:10:48<3:36:17,  3.11it/s]
 89%|████████▉ | 331133/371472 [4:10:49<3:25:27,  3.27it/s]
 89%|████████▉ | 331134/371472 [4:10:49<3:25:29,  3.27it/s]
 89%|████████▉ | 331135/371472 [4:10:49<3:16:15,  3.43it/s]
 89%|████████▉ | 331136/371472 [4:10:50<3:09:18,  3.55it/s]
 89%|████████▉ | 331137/371472 [4:10:50<3:10:07,  3.54it/s]
 89%|████████▉ | 331138/371472 [4:10:50<3:07:01,  3.59it/s]
 89%|████████▉ | 331139/371472 [4:10:50<3:06:38,  3.60it/s]
 89%|████████▉ | 331140/371472 [4:10:51<3:00:51,  3.72it/s]
                                                           
{'loss': 2.6775, 'learning_rate': 1.9776875175073798e-07, 'epoch': 14.26}

 89%|████████▉ | 331140/371472 [4:10:51<3:00:51,  3.72it/s]
 89%|████████▉ | 331141/371472 [4:10:51<3:05:42,  3.62it/s]
 89%|████████▉ | 331142/371472 [4:10:51<3:11:26,  3.51it/s]
 89%|████████▉ | 331143/371472 [4:10:51<3:02:49,  3.68it/s]
 89%|████████▉ | 331144/371472 [4:10:52<3:10:51,  3.52it/s]
 89%|████████▉ | 331145/371472 [4:10:52<3:07:34,  3.58it/s]
 89%|████████▉ | 331146/371472 [4:10:52<3:06:26,  3.60it/s]
 89%|████████▉ | 331147/371472 [4:10:53<3:09:11,  3.55it/s]
 89%|████████▉ | 331148/371472 [4:10:53<3:06:31,  3.60it/s]
 89%|████████▉ | 331149/371472 [4:10:53<3:05:19,  3.63it/s]
 89%|████████▉ | 331150/371472 [4:10:53<3:02:33,  3.68it/s]
 89%|████████▉ | 331151/371472 [4:10:54<3:04:55,  3.63it/s]
 89%|████████▉ | 331152/371472 [4:10:54<3:00:48,  3.72it/s]
 89%|████████▉ | 331153/371472 [4:10:54<3:07:13,  3.59it/s]
 89%|████████▉ | 331154/371472 [4:10:54<3:08:52,  3.56it/s]
 89%|████████▉ | 331155/371472 [4:10:55<3:05:22,  3.62it/s]
 89%|████████▉ | 331156/371472 [4:10:55<3:06:46,  3.60it/s]
 89%|████████▉ | 331157/371472 [4:10:55<3:09:04,  3.55it/s]
 89%|████████▉ | 331158/371472 [4:10:56<3:09:32,  3.54it/s]
 89%|████████▉ | 331159/371472 [4:10:56<3:06:37,  3.60it/s]
 89%|████████▉ | 331160/371472 [4:10:56<3:14:37,  3.45it/s]
                                                           
{'loss': 2.5308, 'learning_rate': 1.977202697752591e-07, 'epoch': 14.26}

 89%|████████▉ | 331160/371472 [4:10:56<3:14:37,  3.45it/s]
 89%|████████▉ | 331161/371472 [4:10:56<3:11:34,  3.51it/s]
 89%|████████▉ | 331162/371472 [4:10:57<3:11:28,  3.51it/s]
 89%|████████▉ | 331163/371472 [4:10:57<3:22:31,  3.32it/s]
 89%|████████▉ | 331164/371472 [4:10:57<3:18:17,  3.39it/s]
 89%|████████▉ | 331165/371472 [4:10:58<3:17:26,  3.40it/s]
 89%|████████▉ | 331166/371472 [4:10:58<3:18:27,  3.39it/s]
 89%|████████▉ | 331167/371472 [4:10:58<3:22:07,  3.32it/s]
 89%|████████▉ | 331168/371472 [4:10:59<3:15:36,  3.43it/s]
 89%|████████▉ | 331169/371472 [4:10:59<3:13:26,  3.47it/s]
 89%|████████▉ | 331170/371472 [4:10:59<3:16:47,  3.41it/s]
 89%|████████▉ | 331171/371472 [4:10:59<3:07:42,  3.58it/s]
 89%|████████▉ | 331172/371472 [4:11:00<3:21:08,  3.34it/s]
 89%|████████▉ | 331173/371472 [4:11:00<3:13:17,  3.47it/s]
 89%|████████▉ | 331174/371472 [4:11:00<3:12:16,  3.49it/s]
 89%|████████▉ | 331175/371472 [4:11:01<3:03:08,  3.67it/s]
 89%|████████▉ | 331176/371472 [4:11:01<3:01:47,  3.69it/s]
 89%|████████▉ | 331177/371472 [4:11:01<3:02:16,  3.68it/s]
 89%|████████▉ | 331178/371472 [4:11:01<3:08:08,  3.57it/s]
 89%|████████▉ | 331179/371472 [4:11:02<3:04:51,  3.63it/s]
 89%|████████▉ | 331180/371472 [4:11:02<3:01:10,  3.71it/s]
                                                           
{'loss': 2.5507, 'learning_rate': 1.9767178779978018e-07, 'epoch': 14.26}

 89%|████████▉ | 331180/371472 [4:11:02<3:01:10,  3.71it/s]
 89%|████████▉ | 331181/371472 [4:11:02<2:56:41,  3.80it/s]
 89%|████████▉ | 331182/371472 [4:11:03<3:25:12,  3.27it/s]
 89%|████████▉ | 331183/371472 [4:11:03<3:25:45,  3.26it/s]
 89%|████████▉ | 331184/371472 [4:11:03<3:30:20,  3.19it/s]
 89%|████████▉ | 331185/371472 [4:11:03<3:25:34,  3.27it/s]
 89%|████████▉ | 331186/371472 [4:11:04<3:12:40,  3.48it/s]
 89%|████████▉ | 331187/371472 [4:11:04<3:14:37,  3.45it/s]
 89%|████████▉ | 331188/371472 [4:11:04<3:15:56,  3.43it/s]
 89%|████████▉ | 331189/371472 [4:11:05<3:10:11,  3.53it/s]
 89%|████████▉ | 331190/371472 [4:11:05<3:12:13,  3.49it/s]
 89%|████████▉ | 331191/371472 [4:11:05<3:11:23,  3.51it/s]
 89%|████████▉ | 331192/371472 [4:11:05<3:08:21,  3.56it/s]
 89%|████████▉ | 331193/371472 [4:11:06<3:04:14,  3.64it/s]
 89%|████████▉ | 331194/371472 [4:11:06<3:02:09,  3.69it/s]
 89%|████████▉ | 331195/371472 [4:11:06<3:06:12,  3.61it/s]
 89%|████████▉ | 331196/371472 [4:11:06<3:06:53,  3.59it/s]
 89%|████████▉ | 331197/371472 [4:11:07<3:22:58,  3.31it/s]
 89%|████████▉ | 331198/371472 [4:11:07<3:26:07,  3.26it/s]
 89%|████████▉ | 331199/371472 [4:11:08<3:31:59,  3.17it/s]
 89%|████████▉ | 331200/371472 [4:11:08<3:31:27,  3.17it/s]
                                                           
{'loss': 2.5392, 'learning_rate': 1.9762330582430135e-07, 'epoch': 14.27}

 89%|████████▉ | 331200/371472 [4:11:08<3:31:27,  3.17it/s]
 89%|████████▉ | 331201/371472 [4:11:08<3:28:55,  3.21it/s]
 89%|████████▉ | 331202/371472 [4:11:08<3:21:42,  3.33it/s]
 89%|████████▉ | 331203/371472 [4:11:09<3:18:47,  3.38it/s]
 89%|████████▉ | 331204/371472 [4:11:09<3:14:54,  3.44it/s]
 89%|████████▉ | 331205/371472 [4:11:09<3:07:09,  3.59it/s]
 89%|████████▉ | 331206/371472 [4:11:10<3:11:16,  3.51it/s]
 89%|████████▉ | 331207/371472 [4:11:10<3:12:56,  3.48it/s]
 89%|████████▉ | 331208/371472 [4:11:10<3:23:38,  3.30it/s]
 89%|████████▉ | 331209/371472 [4:11:10<3:12:20,  3.49it/s]
 89%|████████▉ | 331210/371472 [4:11:11<3:24:50,  3.28it/s]
 89%|████████▉ | 331211/371472 [4:11:11<3:19:09,  3.37it/s]
 89%|████████▉ | 331212/371472 [4:11:11<3:17:46,  3.39it/s]
 89%|████████▉ | 331213/371472 [4:11:12<3:09:54,  3.53it/s]
 89%|████████▉ | 331214/371472 [4:11:12<3:12:57,  3.48it/s]
 89%|████████▉ | 331215/371472 [4:11:12<3:07:18,  3.58it/s]
 89%|████████▉ | 331216/371472 [4:11:12<3:10:39,  3.52it/s]
 89%|████████▉ | 331217/371472 [4:11:13<3:01:23,  3.70it/s]
 89%|████████▉ | 331218/371472 [4:11:13<2:56:00,  3.81it/s]
 89%|████████▉ | 331219/371472 [4:11:13<2:55:56,  3.81it/s]
 89%|████████▉ | 331220/371472 [4:11:13<2:55:49,  3.82it/s]
                                                           
{'loss': 2.7014, 'learning_rate': 1.975748238488224e-07, 'epoch': 14.27}

 89%|████████▉ | 331220/371472 [4:11:13<2:55:49,  3.82it/s]
 89%|████████▉ | 331221/371472 [4:11:14<2:58:46,  3.75it/s]
 89%|████████▉ | 331222/371472 [4:11:14<3:04:01,  3.65it/s]
 89%|████████▉ | 331223/371472 [4:11:14<3:13:48,  3.46it/s]
 89%|████████▉ | 331224/371472 [4:11:15<3:16:02,  3.42it/s]
 89%|████████▉ | 331225/371472 [4:11:15<3:16:56,  3.41it/s]
 89%|████████▉ | 331226/371472 [4:11:15<3:17:40,  3.39it/s]
 89%|████████▉ | 331227/371472 [4:11:16<3:33:12,  3.15it/s]
 89%|████████▉ | 331228/371472 [4:11:16<3:28:02,  3.22it/s]
 89%|████████▉ | 331229/371472 [4:11:16<3:23:57,  3.29it/s]
 89%|████████▉ | 331230/371472 [4:11:16<3:22:35,  3.31it/s]
 89%|████████▉ | 331231/371472 [4:11:17<3:27:38,  3.23it/s]
 89%|████████▉ | 331232/371472 [4:11:17<3:27:13,  3.24it/s]
 89%|████████▉ | 331233/371472 [4:11:17<3:22:17,  3.32it/s]
 89%|████████▉ | 331234/371472 [4:11:18<3:16:52,  3.41it/s]
 89%|████████▉ | 331235/371472 [4:11:18<3:12:50,  3.48it/s]
 89%|████████▉ | 331236/371472 [4:11:18<3:11:13,  3.51it/s]
 89%|████████▉ | 331237/371472 [4:11:18<3:06:33,  3.59it/s]
 89%|████████▉ | 331238/371472 [4:11:19<3:03:58,  3.64it/s]
 89%|████████▉ | 331239/371472 [4:11:19<3:01:53,  3.69it/s]
 89%|████████▉ | 331240/371472 [4:11:19<3:16:58,  3.40it/s]
                                                           
{'loss': 2.7447, 'learning_rate': 1.9752634187334355e-07, 'epoch': 14.27}

 89%|████████▉ | 331240/371472 [4:11:19<3:16:58,  3.40it/s]
 89%|████████▉ | 331241/371472 [4:11:20<3:18:05,  3.38it/s]
 89%|████████▉ | 331242/371472 [4:11:20<3:09:26,  3.54it/s]
 89%|████████▉ | 331243/371472 [4:11:20<3:05:48,  3.61it/s]
 89%|████████▉ | 331244/371472 [4:11:20<3:09:03,  3.55it/s]
 89%|████████▉ | 331245/371472 [4:11:21<3:04:23,  3.64it/s]
 89%|████████▉ | 331246/371472 [4:11:21<3:06:37,  3.59it/s]
 89%|████████▉ | 331247/371472 [4:11:21<3:03:43,  3.65it/s]
 89%|████████▉ | 331248/371472 [4:11:22<3:02:20,  3.68it/s]
 89%|████████▉ | 331249/371472 [4:11:22<3:03:22,  3.66it/s]
 89%|████████▉ | 331250/371472 [4:11:22<3:05:25,  3.62it/s]
 89%|████████▉ | 331251/371472 [4:11:22<3:04:20,  3.64it/s]
 89%|████████▉ | 331252/371472 [4:11:23<3:04:40,  3.63it/s]
 89%|████████▉ | 331253/371472 [4:11:23<3:04:42,  3.63it/s]
 89%|████████▉ | 331254/371472 [4:11:23<3:04:02,  3.64it/s]
 89%|████████▉ | 331255/371472 [4:11:23<3:03:40,  3.65it/s]
 89%|████████▉ | 331256/371472 [4:11:24<3:00:40,  3.71it/s]
 89%|████████▉ | 331257/371472 [4:11:24<3:06:03,  3.60it/s]
 89%|████████▉ | 331258/371472 [4:11:24<3:14:05,  3.45it/s]
 89%|████████▉ | 331259/371472 [4:11:25<3:13:31,  3.46it/s]
 89%|████████▉ | 331260/371472 [4:11:25<3:17:07,  3.40it/s]
                                                           
{'loss': 2.7136, 'learning_rate': 1.9747785989786462e-07, 'epoch': 14.27}

 89%|████████▉ | 331260/371472 [4:11:25<3:17:07,  3.40it/s]
 89%|████████▉ | 331261/371472 [4:11:25<3:16:35,  3.41it/s]
 89%|████████▉ | 331262/371472 [4:11:26<3:19:23,  3.36it/s]
 89%|████████▉ | 331263/371472 [4:11:26<3:17:25,  3.39it/s]
 89%|████████▉ | 331264/371472 [4:11:26<3:12:59,  3.47it/s]
 89%|████████▉ | 331265/371472 [4:11:26<3:30:45,  3.18it/s]
 89%|████████▉ | 331266/371472 [4:11:27<3:22:40,  3.31it/s]
 89%|████████▉ | 331267/371472 [4:11:27<3:20:55,  3.33it/s]
 89%|████████▉ | 331268/371472 [4:11:27<3:17:48,  3.39it/s]
 89%|████████▉ | 331269/371472 [4:11:28<3:14:56,  3.44it/s]
 89%|████████▉ | 331270/371472 [4:11:28<3:07:49,  3.57it/s]
 89%|████████▉ | 331271/371472 [4:11:28<3:03:07,  3.66it/s]
 89%|████████▉ | 331272/371472 [4:11:28<2:59:51,  3.73it/s]
 89%|████████▉ | 331273/371472 [4:11:29<3:04:11,  3.64it/s]
 89%|████████▉ | 331274/371472 [4:11:29<3:06:28,  3.59it/s]
 89%|████████▉ | 331275/371472 [4:11:29<3:06:08,  3.60it/s]
 89%|████████▉ | 331276/371472 [4:11:30<3:24:55,  3.27it/s]
 89%|████████▉ | 331277/371472 [4:11:30<3:14:43,  3.44it/s]
 89%|████████▉ | 331278/371472 [4:11:30<3:18:58,  3.37it/s]
 89%|████████▉ | 331279/371472 [4:11:30<3:13:09,  3.47it/s]
 89%|████████▉ | 331280/371472 [4:11:31<3:12:18,  3.48it/s]
                                                           
{'loss': 2.5458, 'learning_rate': 1.9742937792238577e-07, 'epoch': 14.27}

 89%|████████▉ | 331280/371472 [4:11:31<3:12:18,  3.48it/s]
 89%|████████▉ | 331281/371472 [4:11:31<3:08:55,  3.55it/s]
 89%|████████▉ | 331282/371472 [4:11:31<3:06:48,  3.59it/s]
 89%|████████▉ | 331283/371472 [4:11:32<3:04:00,  3.64it/s]
 89%|████████▉ | 331284/371472 [4:11:32<3:15:16,  3.43it/s]
 89%|████████▉ | 331285/371472 [4:11:32<3:12:58,  3.47it/s]
 89%|████████▉ | 331286/371472 [4:11:32<3:17:56,  3.38it/s]
 89%|████████▉ | 331287/371472 [4:11:33<3:08:05,  3.56it/s]
 89%|████████▉ | 331288/371472 [4:11:33<3:05:56,  3.60it/s]
 89%|████████▉ | 331289/371472 [4:11:33<3:09:08,  3.54it/s]
 89%|████████▉ | 331290/371472 [4:11:34<3:04:44,  3.62it/s]
 89%|████████▉ | 331291/371472 [4:11:34<3:02:36,  3.67it/s]
 89%|████████▉ | 331292/371472 [4:11:34<3:04:05,  3.64it/s]
 89%|████████▉ | 331293/371472 [4:11:34<3:28:15,  3.22it/s]
 89%|████████▉ | 331294/371472 [4:11:35<3:29:44,  3.19it/s]
 89%|████████▉ | 331295/371472 [4:11:35<3:27:17,  3.23it/s]
 89%|████████▉ | 331296/371472 [4:11:35<3:16:40,  3.40it/s]
 89%|████████▉ | 331297/371472 [4:11:36<3:19:56,  3.35it/s]
 89%|████████▉ | 331298/371472 [4:11:36<3:17:33,  3.39it/s]
 89%|████████▉ | 331299/371472 [4:11:36<3:14:10,  3.45it/s]
 89%|████████▉ | 331300/371472 [4:11:36<3:12:03,  3.49it/s]
                                                           
{'loss': 2.565, 'learning_rate': 1.9738089594690682e-07, 'epoch': 14.27}

 89%|████████▉ | 331300/371472 [4:11:36<3:12:03,  3.49it/s]
 89%|████████▉ | 331301/371472 [4:11:37<3:14:00,  3.45it/s]
 89%|████████▉ | 331302/371472 [4:11:37<3:10:18,  3.52it/s]
 89%|████████▉ | 331303/371472 [4:11:37<3:01:55,  3.68it/s]
 89%|████████▉ | 331304/371472 [4:11:38<2:59:02,  3.74it/s]
 89%|████████▉ | 331305/371472 [4:11:38<2:57:56,  3.76it/s]
 89%|████████▉ | 331306/371472 [4:11:38<3:06:02,  3.60it/s]
 89%|████████▉ | 331307/371472 [4:11:38<3:06:16,  3.59it/s]
 89%|████████▉ | 331308/371472 [4:11:39<3:10:09,  3.52it/s]
 89%|████████▉ | 331309/371472 [4:11:39<3:23:33,  3.29it/s]
 89%|████████▉ | 331310/371472 [4:11:39<3:34:03,  3.13it/s]
 89%|████████▉ | 331311/371472 [4:11:40<3:40:32,  3.03it/s]
 89%|████████▉ | 331312/371472 [4:11:40<3:38:16,  3.07it/s]
 89%|████████▉ | 331313/371472 [4:11:40<3:30:38,  3.18it/s]
 89%|████████▉ | 331314/371472 [4:11:41<3:23:37,  3.29it/s]
 89%|████████▉ | 331315/371472 [4:11:41<3:17:30,  3.39it/s]
 89%|████████▉ | 331316/371472 [4:11:41<3:10:29,  3.51it/s]
 89%|████████▉ | 331317/371472 [4:11:41<3:09:25,  3.53it/s]
 89%|████████▉ | 331318/371472 [4:11:42<3:04:31,  3.63it/s]
 89%|████████▉ | 331319/371472 [4:11:42<3:08:20,  3.55it/s]
 89%|████████▉ | 331320/371472 [4:11:42<3:15:34,  3.42it/s]
                                                           
{'loss': 2.5227, 'learning_rate': 1.97332413971428e-07, 'epoch': 14.27}

 89%|████████▉ | 331320/371472 [4:11:42<3:15:34,  3.42it/s]
 89%|████████▉ | 331321/371472 [4:11:43<3:10:28,  3.51it/s]
 89%|████████▉ | 331322/371472 [4:11:43<3:08:57,  3.54it/s]
 89%|████████▉ | 331323/371472 [4:11:43<3:07:47,  3.56it/s]
 89%|████████▉ | 331324/371472 [4:11:43<3:10:43,  3.51it/s]
 89%|████████▉ | 331325/371472 [4:11:44<3:02:57,  3.66it/s]
 89%|████████▉ | 331326/371472 [4:11:44<3:16:55,  3.40it/s]
 89%|████████▉ | 331327/371472 [4:11:44<3:32:44,  3.14it/s]
 89%|████████▉ | 331328/371472 [4:11:45<3:37:55,  3.07it/s]
 89%|████████▉ | 331329/371472 [4:11:45<3:36:13,  3.09it/s]
 89%|████████▉ | 331330/371472 [4:11:45<3:25:05,  3.26it/s]
 89%|████████▉ | 331331/371472 [4:11:46<3:16:53,  3.40it/s]
 89%|████████▉ | 331332/371472 [4:11:46<3:06:36,  3.58it/s]
 89%|████████▉ | 331333/371472 [4:11:46<3:13:22,  3.46it/s]
 89%|████████▉ | 331334/371472 [4:11:46<3:14:40,  3.44it/s]
 89%|████████▉ | 331335/371472 [4:11:47<3:10:02,  3.52it/s]
 89%|████████▉ | 331336/371472 [4:11:47<3:12:14,  3.48it/s]
 89%|████████▉ | 331337/371472 [4:11:47<3:08:17,  3.55it/s]
 89%|████████▉ | 331338/371472 [4:11:48<3:33:09,  3.14it/s]
 89%|████████▉ | 331339/371472 [4:11:48<3:28:36,  3.21it/s]
 89%|████████▉ | 331340/371472 [4:11:48<3:20:13,  3.34it/s]
                                                           
{'loss': 2.5149, 'learning_rate': 1.9728393199594904e-07, 'epoch': 14.27}

 89%|████████▉ | 331340/371472 [4:11:48<3:20:13,  3.34it/s]
 89%|████████▉ | 331341/371472 [4:11:49<3:27:28,  3.22it/s]
 89%|████████▉ | 331342/371472 [4:11:49<3:15:50,  3.42it/s]
 89%|████████▉ | 331343/371472 [4:11:49<3:09:09,  3.54it/s]
 89%|████████▉ | 331344/371472 [4:11:49<3:05:41,  3.60it/s]
 89%|████████▉ | 331345/371472 [4:11:50<3:07:17,  3.57it/s]
 89%|████████▉ | 331346/371472 [4:11:50<3:06:08,  3.59it/s]
 89%|████████▉ | 331347/371472 [4:11:50<3:06:08,  3.59it/s]
 89%|████████▉ | 331348/371472 [4:11:50<3:07:53,  3.56it/s]
 89%|████████▉ | 331349/371472 [4:11:51<3:04:20,  3.63it/s]
 89%|████████▉ | 331350/371472 [4:11:51<3:13:09,  3.46it/s]
 89%|████████▉ | 331351/371472 [4:11:51<3:15:41,  3.42it/s]
 89%|████████▉ | 331352/371472 [4:11:52<3:09:47,  3.52it/s]
 89%|████████▉ | 331353/371472 [4:11:52<3:07:55,  3.56it/s]
 89%|████████▉ | 331354/371472 [4:11:52<3:16:54,  3.40it/s]
 89%|████████▉ | 331355/371472 [4:11:53<3:13:34,  3.45it/s]
 89%|████████▉ | 331356/371472 [4:11:53<3:10:34,  3.51it/s]
 89%|████████▉ | 331357/371472 [4:11:53<3:07:16,  3.57it/s]
 89%|████████▉ | 331358/371472 [4:11:53<3:04:59,  3.61it/s]
 89%|████████▉ | 331359/371472 [4:11:54<3:06:55,  3.58it/s]
 89%|████████▉ | 331360/371472 [4:11:54<3:01:48,  3.68it/s]
                                                           
{'loss': 2.6294, 'learning_rate': 1.972354500204702e-07, 'epoch': 14.27}

 89%|████████▉ | 331360/371472 [4:11:54<3:01:48,  3.68it/s]
 89%|████████▉ | 331361/371472 [4:11:54<3:04:07,  3.63it/s]
 89%|████████▉ | 331362/371472 [4:11:54<3:18:23,  3.37it/s]
 89%|████████▉ | 331363/371472 [4:11:55<3:23:42,  3.28it/s]
 89%|████████▉ | 331364/371472 [4:11:55<3:18:15,  3.37it/s]
 89%|████████▉ | 331365/371472 [4:11:55<3:10:46,  3.50it/s]
 89%|████████▉ | 331366/371472 [4:11:56<3:17:05,  3.39it/s]
 89%|████████▉ | 331367/371472 [4:11:56<3:20:16,  3.34it/s]
 89%|████████▉ | 331368/371472 [4:11:56<3:21:06,  3.32it/s]
 89%|████████▉ | 331369/371472 [4:11:57<3:16:08,  3.41it/s]
 89%|████████▉ | 331370/371472 [4:11:57<3:29:08,  3.20it/s]
 89%|████████▉ | 331371/371472 [4:11:57<3:35:49,  3.10it/s]
 89%|████████▉ | 331372/371472 [4:11:58<3:35:01,  3.11it/s]
 89%|████████▉ | 331373/371472 [4:11:58<3:40:13,  3.03it/s]
 89%|████████▉ | 331374/371472 [4:11:58<3:37:01,  3.08it/s]
 89%|████████▉ | 331375/371472 [4:11:59<3:31:49,  3.15it/s]
 89%|████████▉ | 331376/371472 [4:11:59<3:22:24,  3.30it/s]
 89%|████████▉ | 331377/371472 [4:11:59<3:25:56,  3.24it/s]
 89%|████████▉ | 331378/371472 [4:11:59<3:16:54,  3.39it/s]
 89%|████████▉ | 331379/371472 [4:12:00<3:19:14,  3.35it/s]
 89%|████████▉ | 331380/371472 [4:12:00<3:35:09,  3.11it/s]
                                                           
{'loss': 2.5741, 'learning_rate': 1.9718696804499126e-07, 'epoch': 14.27}

 89%|████████▉ | 331380/371472 [4:12:00<3:35:09,  3.11it/s]
 89%|████████▉ | 331381/371472 [4:12:00<3:25:28,  3.25it/s]
 89%|████████▉ | 331382/371472 [4:12:01<3:24:57,  3.26it/s]
 89%|████████▉ | 331383/371472 [4:12:01<3:15:43,  3.41it/s]
 89%|████████▉ | 331384/371472 [4:12:01<3:10:47,  3.50it/s]
 89%|████████▉ | 331385/371472 [4:12:01<3:09:56,  3.52it/s]
 89%|████████▉ | 331386/371472 [4:12:02<3:03:52,  3.63it/s]
 89%|████████▉ | 331387/371472 [4:12:02<3:07:02,  3.57it/s]
 89%|████████▉ | 331388/371472 [4:12:02<3:12:52,  3.46it/s]
 89%|████████▉ | 331389/371472 [4:12:03<3:08:51,  3.54it/s]
 89%|████████▉ | 331390/371472 [4:12:03<3:01:58,  3.67it/s]
 89%|████████▉ | 331391/371472 [4:12:03<3:01:10,  3.69it/s]
 89%|████████▉ | 331392/371472 [4:12:03<3:09:58,  3.52it/s]
 89%|████████▉ | 331393/371472 [4:12:04<3:11:57,  3.48it/s]
 89%|████████▉ | 331394/371472 [4:12:04<3:09:31,  3.52it/s]
 89%|████████▉ | 331395/371472 [4:12:04<3:10:56,  3.50it/s]
 89%|████████▉ | 331396/371472 [4:12:05<3:28:49,  3.20it/s]
 89%|████████▉ | 331397/371472 [4:12:05<3:36:42,  3.08it/s]
 89%|████████▉ | 331398/371472 [4:12:05<3:30:11,  3.18it/s]
 89%|████████▉ | 331399/371472 [4:12:06<3:21:16,  3.32it/s]
 89%|████████▉ | 331400/371472 [4:12:06<3:14:47,  3.43it/s]
                                                           
{'loss': 2.4625, 'learning_rate': 1.971384860695124e-07, 'epoch': 14.27}

 89%|████████▉ | 331400/371472 [4:12:06<3:14:47,  3.43it/s]
 89%|████████▉ | 331401/371472 [4:12:06<3:12:57,  3.46it/s]
 89%|████████▉ | 331402/371472 [4:12:06<3:05:53,  3.59it/s]
 89%|████████▉ | 331403/371472 [4:12:07<3:01:04,  3.69it/s]
 89%|████████▉ | 331404/371472 [4:12:07<2:59:56,  3.71it/s]
 89%|████████▉ | 331405/371472 [4:12:07<2:58:23,  3.74it/s]
 89%|████████▉ | 331406/371472 [4:12:07<3:00:03,  3.71it/s]
 89%|████████▉ | 331407/371472 [4:12:08<3:09:43,  3.52it/s]
 89%|████████▉ | 331408/371472 [4:12:08<3:05:00,  3.61it/s]
 89%|████████▉ | 331409/371472 [4:12:08<3:03:34,  3.64it/s]
 89%|████████▉ | 331410/371472 [4:12:09<3:01:57,  3.67it/s]
 89%|████████▉ | 331411/371472 [4:12:09<3:08:52,  3.54it/s]
 89%|████████▉ | 331412/371472 [4:12:09<3:13:03,  3.46it/s]
 89%|████████▉ | 331413/371472 [4:12:09<3:10:02,  3.51it/s]
 89%|████████▉ | 331414/371472 [4:12:10<3:05:30,  3.60it/s]
 89%|████████▉ | 331415/371472 [4:12:10<3:15:24,  3.42it/s]
 89%|████████▉ | 331416/371472 [4:12:10<3:10:53,  3.50it/s]
 89%|████████▉ | 331417/371472 [4:12:11<3:24:19,  3.27it/s]
 89%|████████▉ | 331418/371472 [4:12:11<3:16:10,  3.40it/s]
 89%|████████▉ | 331419/371472 [4:12:11<3:08:42,  3.54it/s]
 89%|████████▉ | 331420/371472 [4:12:11<3:08:30,  3.54it/s]
                                                           
{'loss': 2.7991, 'learning_rate': 1.9709000409403346e-07, 'epoch': 14.27}

 89%|████████▉ | 331420/371472 [4:12:11<3:08:30,  3.54it/s]
 89%|████████▉ | 331421/371472 [4:12:12<3:04:50,  3.61it/s]
 89%|████████▉ | 331422/371472 [4:12:12<3:04:46,  3.61it/s]
 89%|████████▉ | 331423/371472 [4:12:12<3:22:05,  3.30it/s]
 89%|████████▉ | 331424/371472 [4:12:13<3:17:18,  3.38it/s]
 89%|████████▉ | 331425/371472 [4:12:13<3:06:28,  3.58it/s]
 89%|████████▉ | 331426/371472 [4:12:13<3:21:47,  3.31it/s]
 89%|████████▉ | 331427/371472 [4:12:14<3:16:00,  3.41it/s]
 89%|████████▉ | 331428/371472 [4:12:14<3:09:38,  3.52it/s]
 89%|████████▉ | 331429/371472 [4:12:14<3:02:26,  3.66it/s]
 89%|████████▉ | 331430/371472 [4:12:14<3:07:27,  3.56it/s]
 89%|████████▉ | 331431/371472 [4:12:15<3:08:05,  3.55it/s]
 89%|████████▉ | 331432/371472 [4:12:15<3:04:00,  3.63it/s]
 89%|████████▉ | 331433/371472 [4:12:15<3:01:55,  3.67it/s]
 89%|████████▉ | 331434/371472 [4:12:15<3:00:51,  3.69it/s]
 89%|████████▉ | 331435/371472 [4:12:16<3:01:26,  3.68it/s]
 89%|████████▉ | 331436/371472 [4:12:16<3:10:55,  3.50it/s]
 89%|████████▉ | 331437/371472 [4:12:16<3:15:02,  3.42it/s]
 89%|████████▉ | 331438/371472 [4:12:17<3:13:54,  3.44it/s]
 89%|████████▉ | 331439/371472 [4:12:17<3:13:35,  3.45it/s]
 89%|████████▉ | 331440/371472 [4:12:17<3:18:09,  3.37it/s]
                                                           
{'loss': 2.5004, 'learning_rate': 1.9704152211855463e-07, 'epoch': 14.28}

 89%|████████▉ | 331440/371472 [4:12:17<3:18:09,  3.37it/s]
 89%|████████▉ | 331441/371472 [4:12:17<3:20:20,  3.33it/s]
 89%|████████▉ | 331442/371472 [4:12:18<3:18:20,  3.36it/s]
 89%|████████▉ | 331443/371472 [4:12:18<3:12:42,  3.46it/s]
 89%|████████▉ | 331444/371472 [4:12:18<3:05:43,  3.59it/s]
 89%|████████▉ | 331445/371472 [4:12:19<3:04:11,  3.62it/s]
 89%|████████▉ | 331446/371472 [4:12:19<3:07:54,  3.55it/s]
 89%|████████▉ | 331447/371472 [4:12:19<3:02:50,  3.65it/s]
 89%|████████▉ | 331448/371472 [4:12:19<3:17:08,  3.38it/s]
 89%|████████▉ | 331449/371472 [4:12:20<3:13:53,  3.44it/s]
 89%|████████▉ | 331450/371472 [4:12:20<3:07:30,  3.56it/s]
 89%|████████▉ | 331451/371472 [4:12:20<3:08:26,  3.54it/s]
 89%|████████▉ | 331452/371472 [4:12:21<3:12:34,  3.46it/s]
 89%|████████▉ | 331453/371472 [4:12:21<3:08:27,  3.54it/s]
 89%|████████▉ | 331454/371472 [4:12:21<3:01:17,  3.68it/s]
 89%|████████▉ | 331455/371472 [4:12:21<3:01:02,  3.68it/s]
 89%|████████▉ | 331456/371472 [4:12:22<3:03:58,  3.63it/s]
 89%|████████▉ | 331457/371472 [4:12:22<2:59:52,  3.71it/s]
 89%|████████▉ | 331458/371472 [4:12:22<3:05:38,  3.59it/s]
 89%|████████▉ | 331459/371472 [4:12:22<3:01:58,  3.66it/s]
 89%|████████▉ | 331460/371472 [4:12:23<3:09:39,  3.52it/s]
                                                           
{'loss': 2.5922, 'learning_rate': 1.9699304014307568e-07, 'epoch': 14.28}

 89%|████████▉ | 331460/371472 [4:12:23<3:09:39,  3.52it/s]
 89%|████████▉ | 331461/371472 [4:12:23<3:27:48,  3.21it/s]
 89%|████████▉ | 331462/371472 [4:12:23<3:21:16,  3.31it/s]
 89%|████████▉ | 331463/371472 [4:12:24<3:26:34,  3.23it/s]
 89%|████████▉ | 331464/371472 [4:12:24<3:18:01,  3.37it/s]
 89%|████████▉ | 331465/371472 [4:12:24<3:15:08,  3.42it/s]
 89%|████████▉ | 331466/371472 [4:12:25<3:07:02,  3.56it/s]
 89%|████████▉ | 331467/371472 [4:12:25<3:07:57,  3.55it/s]
 89%|████████▉ | 331468/371472 [4:12:25<3:06:26,  3.58it/s]
 89%|████████▉ | 331469/371472 [4:12:25<3:04:40,  3.61it/s]
 89%|████████▉ | 331470/371472 [4:12:26<3:10:42,  3.50it/s]
 89%|████████▉ | 331471/371472 [4:12:26<3:07:06,  3.56it/s]
 89%|████████▉ | 331472/371472 [4:12:26<3:07:18,  3.56it/s]
 89%|████████▉ | 331473/371472 [4:12:27<3:06:26,  3.58it/s]
 89%|████████▉ | 331474/371472 [4:12:27<3:00:45,  3.69it/s]
 89%|████████▉ | 331475/371472 [4:12:27<2:59:01,  3.72it/s]
 89%|████████▉ | 331476/371472 [4:12:27<3:03:23,  3.63it/s]
 89%|████████▉ | 331477/371472 [4:12:28<2:59:06,  3.72it/s]
 89%|████████▉ | 331478/371472 [4:12:28<3:03:05,  3.64it/s]
 89%|████████▉ | 331479/371472 [4:12:28<3:00:11,  3.70it/s]
 89%|████████▉ | 331480/371472 [4:12:28<2:59:59,  3.70it/s]
                                                           
{'loss': 2.7885, 'learning_rate': 1.9694455816759683e-07, 'epoch': 14.28}

 89%|████████▉ | 331480/371472 [4:12:28<2:59:59,  3.70it/s]
 89%|████████▉ | 331481/371472 [4:12:29<3:03:28,  3.63it/s]
 89%|████████▉ | 331482/371472 [4:12:29<3:04:06,  3.62it/s]
 89%|████████▉ | 331483/371472 [4:12:29<3:03:24,  3.63it/s]
 89%|████████▉ | 331484/371472 [4:12:30<3:01:06,  3.68it/s]
 89%|████████▉ | 331485/371472 [4:12:30<3:25:20,  3.25it/s]
 89%|████████▉ | 331486/371472 [4:12:30<3:16:07,  3.40it/s]
 89%|████████▉ | 331487/371472 [4:12:30<3:09:42,  3.51it/s]
 89%|████████▉ | 331488/371472 [4:12:31<3:12:39,  3.46it/s]
 89%|████████▉ | 331489/371472 [4:12:31<3:14:09,  3.43it/s]
 89%|████████▉ | 331490/371472 [4:12:31<3:11:44,  3.48it/s]
 89%|████████▉ | 331491/371472 [4:12:32<3:18:49,  3.35it/s]
 89%|████████▉ | 331492/371472 [4:12:32<3:23:11,  3.28it/s]
 89%|████████▉ | 331493/371472 [4:12:32<3:38:22,  3.05it/s]
 89%|████████▉ | 331494/371472 [4:12:33<3:25:25,  3.24it/s]
 89%|████████▉ | 331495/371472 [4:12:33<3:34:30,  3.11it/s]
 89%|████████▉ | 331496/371472 [4:12:33<3:21:44,  3.30it/s]
 89%|████████▉ | 331497/371472 [4:12:34<3:42:36,  2.99it/s]
 89%|████████▉ | 331498/371472 [4:12:34<3:37:09,  3.07it/s]
 89%|████████▉ | 331499/371472 [4:12:34<3:33:05,  3.13it/s]
 89%|████████▉ | 331500/371472 [4:12:35<3:24:21,  3.26it/s]
                                                           
{'loss': 2.412, 'learning_rate': 1.968960761921179e-07, 'epoch': 14.28}

 89%|████████▉ | 331500/371472 [4:12:35<3:24:21,  3.26it/s]
 89%|████████▉ | 331501/371472 [4:12:35<3:19:59,  3.33it/s]
 89%|████████▉ | 331502/371472 [4:12:35<3:17:58,  3.36it/s]
 89%|████████▉ | 331503/371472 [4:12:35<3:13:33,  3.44it/s]
 89%|████████▉ | 331504/371472 [4:12:36<3:14:50,  3.42it/s]
 89%|████████▉ | 331505/371472 [4:12:36<3:07:11,  3.56it/s]
 89%|████████▉ | 331506/371472 [4:12:36<3:16:52,  3.38it/s]
 89%|████████▉ | 331507/371472 [4:12:37<3:14:32,  3.42it/s]
 89%|████████▉ | 331508/371472 [4:12:37<3:08:52,  3.53it/s]
 89%|████████▉ | 331509/371472 [4:12:37<3:16:10,  3.40it/s]
 89%|████████▉ | 331510/371472 [4:12:37<3:15:47,  3.40it/s]
 89%|████████▉ | 331511/371472 [4:12:38<3:11:44,  3.47it/s]
 89%|████████▉ | 331512/371472 [4:12:38<3:03:27,  3.63it/s]
 89%|████████▉ | 331513/371472 [4:12:38<3:16:45,  3.38it/s]
 89%|████████▉ | 331514/371472 [4:12:39<3:13:35,  3.44it/s]
 89%|████████▉ | 331515/371472 [4:12:39<3:09:17,  3.52it/s]
 89%|████████▉ | 331516/371472 [4:12:39<3:09:04,  3.52it/s]
 89%|████████▉ | 331517/371472 [4:12:39<3:13:51,  3.43it/s]
 89%|████████▉ | 331518/371472 [4:12:40<3:08:39,  3.53it/s]
 89%|████████▉ | 331519/371472 [4:12:40<3:07:53,  3.54it/s]
 89%|████████▉ | 331520/371472 [4:12:40<3:03:58,  3.62it/s]
                                                           
{'loss': 2.6446, 'learning_rate': 1.9684759421663897e-07, 'epoch': 14.28}

 89%|████████▉ | 331520/371472 [4:12:40<3:03:58,  3.62it/s]
 89%|████████▉ | 331521/371472 [4:12:40<3:02:42,  3.64it/s]
 89%|████████▉ | 331522/371472 [4:12:41<2:58:53,  3.72it/s]
 89%|████████▉ | 331523/371472 [4:12:41<3:00:16,  3.69it/s]
 89%|████████▉ | 331524/371472 [4:12:41<3:02:05,  3.66it/s]
 89%|████████▉ | 331525/371472 [4:12:42<3:03:34,  3.63it/s]
 89%|████████▉ | 331526/371472 [4:12:42<3:08:45,  3.53it/s]
 89%|████████▉ | 331527/371472 [4:12:42<3:07:42,  3.55it/s]
 89%|████████▉ | 331528/371472 [4:12:42<3:01:15,  3.67it/s]
 89%|████████▉ | 331529/371472 [4:12:43<3:08:14,  3.54it/s]
 89%|████████▉ | 331530/371472 [4:12:43<3:09:54,  3.51it/s]
 89%|████████▉ | 331531/371472 [4:12:43<3:07:23,  3.55it/s]
 89%|████████▉ | 331532/371472 [4:12:44<3:05:13,  3.59it/s]
 89%|████████▉ | 331533/371472 [4:12:44<3:06:09,  3.58it/s]
 89%|████████▉ | 331534/371472 [4:12:44<3:28:39,  3.19it/s]
 89%|████████▉ | 331535/371472 [4:12:44<3:20:50,  3.31it/s]
 89%|████████▉ | 331536/371472 [4:12:45<3:17:09,  3.38it/s]
 89%|████████▉ | 331537/371472 [4:12:45<3:19:10,  3.34it/s]
 89%|████████▉ | 331538/371472 [4:12:45<3:15:04,  3.41it/s]
 89%|████████▉ | 331539/371472 [4:12:46<3:13:17,  3.44it/s]
 89%|████████▉ | 331540/371472 [4:12:46<3:19:52,  3.33it/s]
                                                           
{'loss': 2.5314, 'learning_rate': 1.967991122411601e-07, 'epoch': 14.28}

 89%|████████▉ | 331540/371472 [4:12:46<3:19:52,  3.33it/s]
 89%|████████▉ | 331541/371472 [4:12:46<3:26:44,  3.22it/s]
 89%|████████▉ | 331542/371472 [4:12:47<3:19:00,  3.34it/s]
 89%|████████▉ | 331543/371472 [4:12:47<3:15:51,  3.40it/s]
 89%|████████▉ | 331544/371472 [4:12:47<3:19:29,  3.34it/s]
 89%|████████▉ | 331545/371472 [4:12:47<3:18:26,  3.35it/s]
 89%|████████▉ | 331546/371472 [4:12:48<3:13:45,  3.43it/s]
 89%|████████▉ | 331547/371472 [4:12:48<3:08:15,  3.53it/s]
 89%|████████▉ | 331548/371472 [4:12:48<3:09:12,  3.52it/s]
 89%|████████▉ | 331549/371472 [4:12:49<3:09:15,  3.52it/s]
 89%|████████▉ | 331550/371472 [4:12:49<3:17:45,  3.36it/s]
 89%|████████▉ | 331551/371472 [4:12:49<3:21:45,  3.30it/s]
 89%|████████▉ | 331552/371472 [4:12:49<3:12:49,  3.45it/s]
 89%|████████▉ | 331553/371472 [4:12:50<3:14:55,  3.41it/s]
 89%|████████▉ | 331554/371472 [4:12:50<3:06:48,  3.56it/s]
 89%|████████▉ | 331555/371472 [4:12:50<3:02:53,  3.64it/s]
 89%|████████▉ | 331556/371472 [4:12:51<3:05:08,  3.59it/s]
 89%|████████▉ | 331557/371472 [4:12:51<3:05:48,  3.58it/s]
 89%|████████▉ | 331558/371472 [4:12:51<3:09:04,  3.52it/s]
 89%|████████▉ | 331559/371472 [4:12:51<2:59:39,  3.70it/s]
 89%|████████▉ | 331560/371472 [4:12:52<3:03:36,  3.62it/s]
                                                           
{'loss': 2.6604, 'learning_rate': 1.9675063026568117e-07, 'epoch': 14.28}

 89%|████████▉ | 331560/371472 [4:12:52<3:03:36,  3.62it/s]
 89%|████████▉ | 331561/371472 [4:12:52<3:01:55,  3.66it/s]
 89%|████████▉ | 331562/371472 [4:12:52<3:00:03,  3.69it/s]
 89%|████████▉ | 331563/371472 [4:12:53<3:03:38,  3.62it/s]
 89%|████████▉ | 331564/371472 [4:12:53<3:01:30,  3.66it/s]
 89%|████████▉ | 331565/371472 [4:12:53<3:02:09,  3.65it/s]
 89%|████████▉ | 331566/371472 [4:12:53<3:15:41,  3.40it/s]
 89%|████████▉ | 331567/371472 [4:12:54<3:12:25,  3.46it/s]
 89%|████████▉ | 331568/371472 [4:12:54<3:11:54,  3.47it/s]
 89%|████████▉ | 331569/371472 [4:12:54<3:07:51,  3.54it/s]
 89%|████████▉ | 331570/371472 [4:12:55<3:12:19,  3.46it/s]
 89%|████████▉ | 331571/371472 [4:12:55<3:15:00,  3.41it/s]
 89%|████████▉ | 331572/371472 [4:12:55<3:14:43,  3.42it/s]
 89%|████████▉ | 331573/371472 [4:12:55<3:17:58,  3.36it/s]
 89%|████████▉ | 331574/371472 [4:12:56<3:17:25,  3.37it/s]
 89%|████████▉ | 331575/371472 [4:12:56<3:28:25,  3.19it/s]
 89%|████████▉ | 331576/371472 [4:12:56<3:20:26,  3.32it/s]
 89%|████████▉ | 331577/371472 [4:12:57<3:41:12,  3.01it/s]
 89%|████████▉ | 331578/371472 [4:12:57<3:30:26,  3.16it/s]
 89%|████████▉ | 331579/371472 [4:12:57<3:27:29,  3.20it/s]
 89%|████████▉ | 331580/371472 [4:12:58<3:29:33,  3.17it/s]
                                                           
{'loss': 2.5079, 'learning_rate': 1.9670214829020235e-07, 'epoch': 14.28}

 89%|████████▉ | 331580/371472 [4:12:58<3:29:33,  3.17it/s]
 89%|████████▉ | 331581/371472 [4:12:58<3:23:18,  3.27it/s]
 89%|████████▉ | 331582/371472 [4:12:58<3:31:45,  3.14it/s]
 89%|████████▉ | 331583/371472 [4:12:59<3:28:31,  3.19it/s]
 89%|████████▉ | 331584/371472 [4:12:59<3:21:45,  3.29it/s]
 89%|████████▉ | 331585/371472 [4:12:59<3:34:07,  3.10it/s]
 89%|████████▉ | 331586/371472 [4:12:59<3:20:55,  3.31it/s]
 89%|████████▉ | 331587/371472 [4:13:00<3:10:33,  3.49it/s]
 89%|████████▉ | 331588/371472 [4:13:00<3:06:34,  3.56it/s]
 89%|████████▉ | 331589/371472 [4:13:00<3:04:18,  3.61it/s]
 89%|████████▉ | 331590/371472 [4:13:01<3:02:07,  3.65it/s]
 89%|████████▉ | 331591/371472 [4:13:01<3:06:56,  3.56it/s]
 89%|████████▉ | 331592/371472 [4:13:01<3:02:46,  3.64it/s]
 89%|████████▉ | 331593/371472 [4:13:01<3:04:00,  3.61it/s]
 89%|████████▉ | 331594/371472 [4:13:02<3:05:07,  3.59it/s]
 89%|████████▉ | 331595/371472 [4:13:02<3:10:23,  3.49it/s]
 89%|████████▉ | 331596/371472 [4:13:02<3:10:57,  3.48it/s]
 89%|████████▉ | 331597/371472 [4:13:03<3:13:07,  3.44it/s]
 89%|████████▉ | 331598/371472 [4:13:03<3:09:10,  3.51it/s]
 89%|████████▉ | 331599/371472 [4:13:03<3:07:48,  3.54it/s]
 89%|████████▉ | 331600/371472 [4:13:03<3:09:01,  3.52it/s]
                                                           
{'loss': 2.5743, 'learning_rate': 1.966536663147234e-07, 'epoch': 14.28}

 89%|████████▉ | 331600/371472 [4:13:03<3:09:01,  3.52it/s]
 89%|████████▉ | 331601/371472 [4:13:04<3:15:09,  3.40it/s]
 89%|████████▉ | 331602/371472 [4:13:04<3:13:40,  3.43it/s]
 89%|████████▉ | 331603/371472 [4:13:04<3:06:56,  3.55it/s]
 89%|████████▉ | 331604/371472 [4:13:05<3:03:44,  3.62it/s]
 89%|████████▉ | 331605/371472 [4:13:05<2:57:19,  3.75it/s]
 89%|████████▉ | 331606/371472 [4:13:05<2:57:34,  3.74it/s]
 89%|████████▉ | 331607/371472 [4:13:05<3:09:22,  3.51it/s]
 89%|████████▉ | 331608/371472 [4:13:06<3:15:07,  3.41it/s]
 89%|████████▉ | 331609/371472 [4:13:06<3:10:47,  3.48it/s]
 89%|████████▉ | 331610/371472 [4:13:06<3:13:01,  3.44it/s]
 89%|████████▉ | 331611/371472 [4:13:07<3:15:22,  3.40it/s]
 89%|████████▉ | 331612/371472 [4:13:07<3:12:45,  3.45it/s]
 89%|████████▉ | 331613/371472 [4:13:07<3:20:12,  3.32it/s]
 89%|████████▉ | 331614/371472 [4:13:07<3:08:37,  3.52it/s]
 89%|████████▉ | 331615/371472 [4:13:08<3:13:54,  3.43it/s]
 89%|████████▉ | 331616/371472 [4:13:08<3:10:40,  3.48it/s]
 89%|████████▉ | 331617/371472 [4:13:08<3:21:34,  3.30it/s]
 89%|████████▉ | 331618/371472 [4:13:09<3:11:47,  3.46it/s]
 89%|████████▉ | 331619/371472 [4:13:09<3:06:21,  3.56it/s]
 89%|████████▉ | 331620/371472 [4:13:09<3:01:00,  3.67it/s]
                                                           
{'loss': 2.7382, 'learning_rate': 1.9660518433924452e-07, 'epoch': 14.28}

 89%|████████▉ | 331620/371472 [4:13:09<3:01:00,  3.67it/s]
 89%|████████▉ | 331621/371472 [4:13:09<3:07:56,  3.53it/s]
 89%|████████▉ | 331622/371472 [4:13:10<3:00:02,  3.69it/s]
 89%|████████▉ | 331623/371472 [4:13:10<2:59:55,  3.69it/s]
 89%|████████▉ | 331624/371472 [4:13:10<3:03:36,  3.62it/s]
 89%|████████▉ | 331625/371472 [4:13:11<3:13:02,  3.44it/s]
 89%|████████▉ | 331626/371472 [4:13:11<3:12:12,  3.46it/s]
 89%|████████▉ | 331627/371472 [4:13:11<3:05:36,  3.58it/s]
 89%|████████▉ | 331628/371472 [4:13:11<3:06:38,  3.56it/s]
 89%|████████▉ | 331629/371472 [4:13:12<3:20:46,  3.31it/s]
 89%|████████▉ | 331630/371472 [4:13:12<3:15:28,  3.40it/s]
 89%|████████▉ | 331631/371472 [4:13:12<3:15:19,  3.40it/s]
 89%|████████▉ | 331632/371472 [4:13:13<3:15:23,  3.40it/s]
 89%|████████▉ | 331633/371472 [4:13:13<3:12:45,  3.44it/s]
 89%|████████▉ | 331634/371472 [4:13:13<3:06:46,  3.55it/s]
 89%|████████▉ | 331635/371472 [4:13:13<3:13:39,  3.43it/s]
 89%|████████▉ | 331636/371472 [4:13:14<3:12:05,  3.46it/s]
 89%|████████▉ | 331637/371472 [4:13:14<3:06:53,  3.55it/s]
 89%|████████▉ | 331638/371472 [4:13:14<3:05:48,  3.57it/s]
 89%|████████▉ | 331639/371472 [4:13:15<3:10:35,  3.48it/s]
 89%|████████▉ | 331640/371472 [4:13:15<3:21:27,  3.30it/s]
                                                           
{'loss': 2.7292, 'learning_rate': 1.9655670236376561e-07, 'epoch': 14.28}

 89%|████████▉ | 331640/371472 [4:13:15<3:21:27,  3.30it/s]
 89%|████████▉ | 331641/371472 [4:13:15<3:12:11,  3.45it/s]
 89%|████████▉ | 331642/371472 [4:13:15<3:08:15,  3.53it/s]
 89%|████████▉ | 331643/371472 [4:13:16<3:07:25,  3.54it/s]
 89%|████████▉ | 331644/371472 [4:13:16<3:05:53,  3.57it/s]
 89%|████████▉ | 331645/371472 [4:13:16<3:11:07,  3.47it/s]
 89%|████████▉ | 331646/371472 [4:13:17<3:06:44,  3.55it/s]
 89%|████████▉ | 331647/371472 [4:13:17<3:05:18,  3.58it/s]
 89%|████████▉ | 331648/371472 [4:13:17<3:06:26,  3.56it/s]
 89%|████████▉ | 331649/371472 [4:13:17<3:12:16,  3.45it/s]
 89%|████████▉ | 331650/371472 [4:13:18<3:04:51,  3.59it/s]
 89%|████████▉ | 331651/371472 [4:13:18<3:15:15,  3.40it/s]
 89%|████████▉ | 331652/371472 [4:13:18<3:20:42,  3.31it/s]
 89%|████████▉ | 331653/371472 [4:13:19<3:14:16,  3.42it/s]
 89%|████████▉ | 331654/371472 [4:13:19<3:09:58,  3.49it/s]
 89%|████████▉ | 331655/371472 [4:13:19<3:05:52,  3.57it/s]
 89%|████████▉ | 331656/371472 [4:13:19<3:02:15,  3.64it/s]
 89%|████████▉ | 331657/371472 [4:13:20<2:59:31,  3.70it/s]
 89%|████████▉ | 331658/371472 [4:13:20<3:02:46,  3.63it/s]
 89%|████████▉ | 331659/371472 [4:13:20<3:13:12,  3.43it/s]
 89%|████████▉ | 331660/371472 [4:13:21<3:12:39,  3.44it/s]
                                                           
{'loss': 2.5718, 'learning_rate': 1.9650822038828676e-07, 'epoch': 14.29}

 89%|████████▉ | 331660/371472 [4:13:21<3:12:39,  3.44it/s]
 89%|████████▉ | 331661/371472 [4:13:21<3:04:19,  3.60it/s]
 89%|████████▉ | 331662/371472 [4:13:21<3:09:04,  3.51it/s]
 89%|████████▉ | 331663/371472 [4:13:21<3:09:44,  3.50it/s]
 89%|████████▉ | 331664/371472 [4:13:22<3:04:28,  3.60it/s]
 89%|████████▉ | 331665/371472 [4:13:22<3:06:44,  3.55it/s]
 89%|████████▉ | 331666/371472 [4:13:22<3:05:44,  3.57it/s]
 89%|████████▉ | 331667/371472 [4:13:23<3:20:19,  3.31it/s]
 89%|████████▉ | 331668/371472 [4:13:23<3:30:15,  3.16it/s]
 89%|████████▉ | 331669/371472 [4:13:23<3:18:57,  3.33it/s]
 89%|████████▉ | 331670/371472 [4:13:23<3:15:34,  3.39it/s]
 89%|████████▉ | 331671/371472 [4:13:24<3:24:46,  3.24it/s]
 89%|████████▉ | 331672/371472 [4:13:24<3:26:36,  3.21it/s]
 89%|████████▉ | 331673/371472 [4:13:24<3:33:46,  3.10it/s]
 89%|████████▉ | 331674/371472 [4:13:25<3:23:32,  3.26it/s]
 89%|████████▉ | 331675/371472 [4:13:25<3:17:23,  3.36it/s]
 89%|████████▉ | 331676/371472 [4:13:25<3:09:20,  3.50it/s]
 89%|████████▉ | 331677/371472 [4:13:26<3:20:01,  3.32it/s]
 89%|████████▉ | 331678/371472 [4:13:26<3:36:28,  3.06it/s]
 89%|████████▉ | 331679/371472 [4:13:26<3:26:04,  3.22it/s]
 89%|████████▉ | 331680/371472 [4:13:27<3:24:54,  3.24it/s]
                                                           
{'loss': 2.4583, 'learning_rate': 1.964597384128078e-07, 'epoch': 14.29}

 89%|████████▉ | 331680/371472 [4:13:27<3:24:54,  3.24it/s]
 89%|████████▉ | 331681/371472 [4:13:27<3:23:30,  3.26it/s]
 89%|████████▉ | 331682/371472 [4:13:27<3:12:01,  3.45it/s]
 89%|████████▉ | 331683/371472 [4:13:28<3:36:07,  3.07it/s]
 89%|████████▉ | 331684/371472 [4:13:28<3:57:06,  2.80it/s]
 89%|████████▉ | 331685/371472 [4:13:28<3:36:47,  3.06it/s]
 89%|████████▉ | 331686/371472 [4:13:29<3:30:26,  3.15it/s]
 89%|████████▉ | 331687/371472 [4:13:29<3:38:40,  3.03it/s]
 89%|████████▉ | 331688/371472 [4:13:29<3:23:03,  3.27it/s]
 89%|████████▉ | 331689/371472 [4:13:29<3:15:42,  3.39it/s]
 89%|████████▉ | 331690/371472 [4:13:30<3:09:47,  3.49it/s]
 89%|████████▉ | 331691/371472 [4:13:30<3:13:52,  3.42it/s]
 89%|████████▉ | 331692/371472 [4:13:30<3:09:39,  3.50it/s]
 89%|████████▉ | 331693/371472 [4:13:31<3:03:50,  3.61it/s]
 89%|████████▉ | 331694/371472 [4:13:31<3:15:20,  3.39it/s]
 89%|████████▉ | 331695/371472 [4:13:31<3:15:01,  3.40it/s]
 89%|████████▉ | 331696/371472 [4:13:31<3:10:54,  3.47it/s]
 89%|████████▉ | 331697/371472 [4:13:32<3:08:47,  3.51it/s]
 89%|████████▉ | 331698/371472 [4:13:32<3:22:27,  3.27it/s]
 89%|████████▉ | 331699/371472 [4:13:32<3:19:13,  3.33it/s]
 89%|████████▉ | 331700/371472 [4:13:33<3:10:52,  3.47it/s]
                                                           
{'loss': 2.6099, 'learning_rate': 1.96411256437329e-07, 'epoch': 14.29}

 89%|████████▉ | 331700/371472 [4:13:33<3:10:52,  3.47it/s]
 89%|████████▉ | 331701/371472 [4:13:33<3:04:33,  3.59it/s]
 89%|████████▉ | 331702/371472 [4:13:33<3:04:31,  3.59it/s]
 89%|████████▉ | 331703/371472 [4:13:33<3:10:47,  3.47it/s]
 89%|████████▉ | 331704/371472 [4:13:34<3:06:55,  3.55it/s]
 89%|████████▉ | 331705/371472 [4:13:34<3:21:56,  3.28it/s]
 89%|████████▉ | 331706/371472 [4:13:34<3:18:21,  3.34it/s]
 89%|████████▉ | 331707/371472 [4:13:35<3:20:04,  3.31it/s]
 89%|████████▉ | 331708/371472 [4:13:35<3:21:09,  3.29it/s]
 89%|████████▉ | 331709/371472 [4:13:35<3:17:23,  3.36it/s]
 89%|████████▉ | 331710/371472 [4:13:36<3:20:17,  3.31it/s]
 89%|████████▉ | 331711/371472 [4:13:36<3:20:47,  3.30it/s]
 89%|████████▉ | 331712/371472 [4:13:36<3:19:59,  3.31it/s]
 89%|████████▉ | 331713/371472 [4:13:36<3:15:23,  3.39it/s]
 89%|████████▉ | 331714/371472 [4:13:37<3:07:58,  3.53it/s]
 89%|████████▉ | 331715/371472 [4:13:37<3:05:40,  3.57it/s]
 89%|████████▉ | 331716/371472 [4:13:37<3:00:25,  3.67it/s]
 89%|████████▉ | 331717/371472 [4:13:38<3:05:03,  3.58it/s]
 89%|████████▉ | 331718/371472 [4:13:38<3:03:47,  3.60it/s]
 89%|████████▉ | 331719/371472 [4:13:38<2:58:19,  3.72it/s]
 89%|████████▉ | 331720/371472 [4:13:38<2:57:32,  3.73it/s]
                                                           
{'loss': 2.519, 'learning_rate': 1.9636277446185003e-07, 'epoch': 14.29}

 89%|████████▉ | 331720/371472 [4:13:38<2:57:32,  3.73it/s]
 89%|████████▉ | 331721/371472 [4:13:39<3:10:51,  3.47it/s]
 89%|████████▉ | 331722/371472 [4:13:39<3:29:55,  3.16it/s]
 89%|████████▉ | 331723/371472 [4:13:39<3:24:27,  3.24it/s]
 89%|████████▉ | 331724/371472 [4:13:40<3:20:23,  3.31it/s]
 89%|████████▉ | 331725/371472 [4:13:40<3:17:07,  3.36it/s]
 89%|████████▉ | 331726/371472 [4:13:40<3:10:55,  3.47it/s]
 89%|████████▉ | 331727/371472 [4:13:40<3:15:58,  3.38it/s]
 89%|████████▉ | 331728/371472 [4:13:41<3:11:56,  3.45it/s]
 89%|████████▉ | 331729/371472 [4:13:41<3:07:10,  3.54it/s]
 89%|████████▉ | 331730/371472 [4:13:41<3:04:29,  3.59it/s]
 89%|████████▉ | 331731/371472 [4:13:42<2:59:42,  3.69it/s]
 89%|████████▉ | 331732/371472 [4:13:42<2:58:20,  3.71it/s]
 89%|████████▉ | 331733/371472 [4:13:42<2:55:26,  3.78it/s]
 89%|████████▉ | 331734/371472 [4:13:42<2:55:37,  3.77it/s]
 89%|████████▉ | 331735/371472 [4:13:43<2:58:53,  3.70it/s]
 89%|████████▉ | 331736/371472 [4:13:43<3:19:16,  3.32it/s]
 89%|████████▉ | 331737/371472 [4:13:43<3:13:39,  3.42it/s]
 89%|████████▉ | 331738/371472 [4:13:44<3:09:56,  3.49it/s]
 89%|████████▉ | 331739/371472 [4:13:44<3:23:58,  3.25it/s]
 89%|████████▉ | 331740/371472 [4:13:44<3:23:11,  3.26it/s]
                                                           
{'loss': 2.6473, 'learning_rate': 1.9631429248637118e-07, 'epoch': 14.29}

 89%|████████▉ | 331740/371472 [4:13:44<3:23:11,  3.26it/s]
 89%|████████▉ | 331741/371472 [4:13:44<3:12:46,  3.43it/s]
 89%|████████▉ | 331742/371472 [4:13:45<3:12:19,  3.44it/s]
 89%|████████▉ | 331743/371472 [4:13:45<3:17:57,  3.34it/s]
 89%|████████▉ | 331744/371472 [4:13:45<3:14:19,  3.41it/s]
 89%|████████▉ | 331745/371472 [4:13:46<3:18:24,  3.34it/s]
 89%|████████▉ | 331746/371472 [4:13:46<3:11:04,  3.47it/s]
 89%|████████▉ | 331747/371472 [4:13:46<3:23:48,  3.25it/s]
 89%|████████▉ | 331748/371472 [4:13:47<3:18:17,  3.34it/s]
 89%|████████▉ | 331749/371472 [4:13:47<3:14:33,  3.40it/s]
 89%|████████▉ | 331750/371472 [4:13:47<3:09:28,  3.49it/s]
 89%|████████▉ | 331751/371472 [4:13:47<3:03:40,  3.60it/s]
 89%|████████▉ | 331752/371472 [4:13:48<3:02:14,  3.63it/s]
 89%|████████▉ | 331753/371472 [4:13:48<3:08:43,  3.51it/s]
 89%|████████▉ | 331754/371472 [4:13:48<3:04:59,  3.58it/s]
 89%|████████▉ | 331755/371472 [4:13:48<2:58:26,  3.71it/s]
 89%|████████▉ | 331756/371472 [4:13:49<3:52:31,  2.85it/s]
 89%|████████▉ | 331757/371472 [4:13:49<3:52:56,  2.84it/s]
 89%|████████▉ | 331758/371472 [4:13:50<4:02:43,  2.73it/s]
 89%|████████▉ | 331759/371472 [4:13:50<3:45:59,  2.93it/s]
 89%|████████▉ | 331760/371472 [4:13:50<3:33:00,  3.11it/s]
                                                           
{'loss': 2.5738, 'learning_rate': 1.9626581051089225e-07, 'epoch': 14.29}

 89%|████████▉ | 331760/371472 [4:13:50<3:33:00,  3.11it/s]
 89%|████████▉ | 331761/371472 [4:13:51<3:17:36,  3.35it/s]
 89%|████████▉ | 331762/371472 [4:13:51<3:24:19,  3.24it/s]
 89%|████████▉ | 331763/371472 [4:13:51<3:14:18,  3.41it/s]
 89%|████████▉ | 331764/371472 [4:13:51<3:17:54,  3.34it/s]
 89%|████████▉ | 331765/371472 [4:13:52<3:21:09,  3.29it/s]
 89%|████████▉ | 331766/371472 [4:13:52<3:33:07,  3.11it/s]
 89%|████████▉ | 331767/371472 [4:13:52<3:26:11,  3.21it/s]
 89%|████████▉ | 331768/371472 [4:13:53<3:24:37,  3.23it/s]
 89%|████████▉ | 331769/371472 [4:13:53<3:17:02,  3.36it/s]
 89%|████████▉ | 331770/371472 [4:13:53<3:17:14,  3.35it/s]
 89%|████████▉ | 331771/371472 [4:13:54<3:14:33,  3.40it/s]
 89%|████████▉ | 331772/371472 [4:13:54<3:14:18,  3.41it/s]
 89%|████████▉ | 331773/371472 [4:13:54<3:16:09,  3.37it/s]
 89%|████████▉ | 331774/371472 [4:13:54<3:09:15,  3.50it/s]
 89%|████████▉ | 331775/371472 [4:13:55<3:02:32,  3.62it/s]
 89%|████████▉ | 331776/371472 [4:13:55<3:04:11,  3.59it/s]
 89%|████████▉ | 331777/371472 [4:13:55<3:02:41,  3.62it/s]
 89%|████████▉ | 331778/371472 [4:13:56<3:03:34,  3.60it/s]
 89%|████████▉ | 331779/371472 [4:13:56<3:21:44,  3.28it/s]
 89%|████████▉ | 331780/371472 [4:13:56<3:25:09,  3.22it/s]
                                                           
{'loss': 2.7053, 'learning_rate': 1.962173285354134e-07, 'epoch': 14.29}

 89%|████████▉ | 331780/371472 [4:13:56<3:25:09,  3.22it/s]
 89%|████████▉ | 331781/371472 [4:13:57<3:23:34,  3.25it/s]
 89%|████████▉ | 331782/371472 [4:13:57<3:30:48,  3.14it/s]
 89%|████████▉ | 331783/371472 [4:13:57<3:27:24,  3.19it/s]
 89%|████████▉ | 331784/371472 [4:13:57<3:20:43,  3.30it/s]
 89%|████████▉ | 331785/371472 [4:13:58<3:21:08,  3.29it/s]
 89%|████████▉ | 331786/371472 [4:13:58<3:21:28,  3.28it/s]
 89%|████████▉ | 331787/371472 [4:13:58<3:20:31,  3.30it/s]
 89%|████████▉ | 331788/371472 [4:13:59<3:18:19,  3.33it/s]
 89%|████████▉ | 331789/371472 [4:13:59<3:16:16,  3.37it/s]
 89%|████████▉ | 331790/371472 [4:13:59<3:13:07,  3.42it/s]
 89%|████████▉ | 331791/371472 [4:13:59<3:12:51,  3.43it/s]
 89%|████████▉ | 331792/371472 [4:14:00<3:06:20,  3.55it/s]
 89%|████████▉ | 331793/371472 [4:14:00<3:11:31,  3.45it/s]
 89%|████████▉ | 331794/371472 [4:14:00<3:11:25,  3.45it/s]
 89%|████████▉ | 331795/371472 [4:14:01<3:10:14,  3.48it/s]
 89%|████████▉ | 331796/371472 [4:14:01<3:06:55,  3.54it/s]
 89%|████████▉ | 331797/371472 [4:14:01<3:41:43,  2.98it/s]
 89%|████████▉ | 331798/371472 [4:14:02<3:46:14,  2.92it/s]
 89%|████████▉ | 331799/371472 [4:14:02<3:41:28,  2.99it/s]
 89%|████████▉ | 331800/371472 [4:14:02<3:38:20,  3.03it/s]
                                                           
{'loss': 2.5313, 'learning_rate': 1.9616884655993445e-07, 'epoch': 14.29}

 89%|████████▉ | 331800/371472 [4:14:02<3:38:20,  3.03it/s]
 89%|████████▉ | 331801/371472 [4:14:03<3:23:05,  3.26it/s]
 89%|████████▉ | 331802/371472 [4:14:03<3:19:53,  3.31it/s]
 89%|████████▉ | 331803/371472 [4:14:03<3:37:23,  3.04it/s]
 89%|████████▉ | 331804/371472 [4:14:04<3:36:52,  3.05it/s]
 89%|████████▉ | 331805/371472 [4:14:04<3:34:46,  3.08it/s]
 89%|████████▉ | 331806/371472 [4:14:04<3:24:15,  3.24it/s]
 89%|████████▉ | 331807/371472 [4:14:04<3:17:27,  3.35it/s]
 89%|████████▉ | 331808/371472 [4:14:05<3:11:39,  3.45it/s]
 89%|████████▉ | 331809/371472 [4:14:05<3:08:25,  3.51it/s]
 89%|████████▉ | 331810/371472 [4:14:05<2:59:54,  3.67it/s]
 89%|████████▉ | 331811/371472 [4:14:06<2:58:03,  3.71it/s]
 89%|████████▉ | 331812/371472 [4:14:06<2:59:34,  3.68it/s]
 89%|████████▉ | 331813/371472 [4:14:06<3:20:53,  3.29it/s]
 89%|████████▉ | 331814/371472 [4:14:06<3:20:38,  3.29it/s]
 89%|████████▉ | 331815/371472 [4:14:07<3:51:56,  2.85it/s]
 89%|████████▉ | 331816/371472 [4:14:07<3:36:54,  3.05it/s]
 89%|████████▉ | 331817/371472 [4:14:08<3:28:32,  3.17it/s]
 89%|████████▉ | 331818/371472 [4:14:08<3:23:15,  3.25it/s]
 89%|████████▉ | 331819/371472 [4:14:08<3:20:08,  3.30it/s]
 89%|████████▉ | 331820/371472 [4:14:08<3:12:00,  3.44it/s]
                                                           
{'loss': 2.5603, 'learning_rate': 1.9612036458445563e-07, 'epoch': 14.29}

 89%|████████▉ | 331820/371472 [4:14:08<3:12:00,  3.44it/s]
 89%|████████▉ | 331821/371472 [4:14:09<3:11:54,  3.44it/s]
 89%|████████▉ | 331822/371472 [4:14:09<3:13:07,  3.42it/s]
 89%|████████▉ | 331823/371472 [4:14:09<3:16:24,  3.36it/s]
 89%|████████▉ | 331824/371472 [4:14:10<3:12:51,  3.43it/s]
 89%|████████▉ | 331825/371472 [4:14:10<3:10:24,  3.47it/s]
 89%|████████▉ | 331826/371472 [4:14:10<3:09:49,  3.48it/s]
 89%|████████▉ | 331827/371472 [4:14:10<3:04:13,  3.59it/s]
 89%|████████▉ | 331828/371472 [4:14:11<3:02:52,  3.61it/s]
 89%|████████▉ | 331829/371472 [4:14:11<3:05:19,  3.57it/s]
 89%|████████▉ | 331830/371472 [4:14:11<3:07:06,  3.53it/s]
 89%|████████▉ | 331831/371472 [4:14:11<3:06:26,  3.54it/s]
 89%|████████▉ | 331832/371472 [4:14:12<3:03:56,  3.59it/s]
 89%|████████▉ | 331833/371472 [4:14:12<3:10:06,  3.48it/s]
 89%|████████▉ | 331834/371472 [4:14:12<3:08:09,  3.51it/s]
 89%|████████▉ | 331835/371472 [4:14:13<3:16:38,  3.36it/s]
 89%|████████▉ | 331836/371472 [4:14:13<3:22:34,  3.26it/s]
 89%|████████▉ | 331837/371472 [4:14:13<3:17:05,  3.35it/s]
 89%|████████▉ | 331838/371472 [4:14:14<3:07:11,  3.53it/s]
 89%|████████▉ | 331839/371472 [4:14:14<3:13:12,  3.42it/s]
 89%|████████▉ | 331840/371472 [4:14:14<3:06:42,  3.54it/s]
                                                           
{'loss': 2.6287, 'learning_rate': 1.960718826089767e-07, 'epoch': 14.29}

 89%|████████▉ | 331840/371472 [4:14:14<3:06:42,  3.54it/s]
 89%|████████▉ | 331841/371472 [4:14:14<3:05:41,  3.56it/s]
 89%|████████▉ | 331842/371472 [4:14:15<3:05:08,  3.57it/s]
 89%|████████▉ | 331843/371472 [4:14:15<3:05:45,  3.56it/s]
 89%|████████▉ | 331844/371472 [4:14:15<3:03:40,  3.60it/s]
 89%|████████▉ | 331845/371472 [4:14:16<3:09:55,  3.48it/s]
 89%|████████▉ | 331846/371472 [4:14:16<3:08:54,  3.50it/s]
 89%|████████▉ | 331847/371472 [4:14:16<3:15:34,  3.38it/s]
 89%|████████▉ | 331848/371472 [4:14:16<3:10:13,  3.47it/s]
 89%|████████▉ | 331849/371472 [4:14:17<3:15:44,  3.37it/s]
 89%|████████▉ | 331850/371472 [4:14:17<3:21:15,  3.28it/s]
 89%|████████▉ | 331851/371472 [4:14:17<3:35:12,  3.07it/s]
 89%|████████▉ | 331852/371472 [4:14:18<3:23:58,  3.24it/s]
 89%|████████▉ | 331853/371472 [4:14:18<3:17:12,  3.35it/s]
 89%|████████▉ | 331854/371472 [4:14:18<3:16:32,  3.36it/s]
 89%|████████▉ | 331855/371472 [4:14:18<3:06:25,  3.54it/s]
 89%|████████▉ | 331856/371472 [4:14:19<3:07:31,  3.52it/s]
 89%|████████▉ | 331857/371472 [4:14:19<3:03:19,  3.60it/s]
 89%|████████▉ | 331858/371472 [4:14:19<2:59:20,  3.68it/s]
 89%|████████▉ | 331859/371472 [4:14:20<3:04:15,  3.58it/s]
 89%|████████▉ | 331860/371472 [4:14:20<3:05:48,  3.55it/s]
                                                           
{'loss': 2.7383, 'learning_rate': 1.9602340063349782e-07, 'epoch': 14.29}

 89%|████████▉ | 331860/371472 [4:14:20<3:05:48,  3.55it/s]
 89%|████████▉ | 331861/371472 [4:14:20<3:05:44,  3.55it/s]
 89%|████████▉ | 331862/371472 [4:14:20<3:08:46,  3.50it/s]
 89%|████████▉ | 331863/371472 [4:14:21<3:04:49,  3.57it/s]
 89%|████████▉ | 331864/371472 [4:14:21<3:03:18,  3.60it/s]
 89%|████████▉ | 331865/371472 [4:14:21<3:07:41,  3.52it/s]
 89%|████████▉ | 331866/371472 [4:14:22<3:09:48,  3.48it/s]
 89%|████████▉ | 331867/371472 [4:14:22<3:03:07,  3.60it/s]
 89%|████████▉ | 331868/371472 [4:14:22<3:00:16,  3.66it/s]
 89%|████████▉ | 331869/371472 [4:14:22<3:06:48,  3.53it/s]
 89%|████████▉ | 331870/371472 [4:14:23<3:29:58,  3.14it/s]
 89%|████████▉ | 331871/371472 [4:14:23<3:22:56,  3.25it/s]
 89%|████████▉ | 331872/371472 [4:14:23<3:22:15,  3.26it/s]
 89%|████████▉ | 331873/371472 [4:14:24<3:16:34,  3.36it/s]
 89%|████████▉ | 331874/371472 [4:14:24<3:16:48,  3.35it/s]
 89%|████████▉ | 331875/371472 [4:14:24<3:12:48,  3.42it/s]
 89%|████████▉ | 331876/371472 [4:14:25<3:04:58,  3.57it/s]
 89%|████████▉ | 331877/371472 [4:14:25<3:03:29,  3.60it/s]
 89%|████████▉ | 331878/371472 [4:14:25<3:02:11,  3.62it/s]
 89%|████████▉ | 331879/371472 [4:14:25<3:05:02,  3.57it/s]
 89%|████████▉ | 331880/371472 [4:14:26<3:07:42,  3.52it/s]
                                                           
{'loss': 2.8386, 'learning_rate': 1.959749186580189e-07, 'epoch': 14.29}

 89%|████████▉ | 331880/371472 [4:14:26<3:07:42,  3.52it/s]
 89%|████████▉ | 331881/371472 [4:14:26<3:07:03,  3.53it/s]
 89%|████████▉ | 331882/371472 [4:14:26<3:23:29,  3.24it/s]
 89%|████████▉ | 331883/371472 [4:14:27<3:26:01,  3.20it/s]
 89%|████████▉ | 331884/371472 [4:14:27<3:22:42,  3.25it/s]
 89%|████████▉ | 331885/371472 [4:14:27<3:15:23,  3.38it/s]
 89%|████████▉ | 331886/371472 [4:14:27<3:11:26,  3.45it/s]
 89%|████████▉ | 331887/371472 [4:14:28<3:09:59,  3.47it/s]
 89%|████████▉ | 331888/371472 [4:14:28<3:06:05,  3.55it/s]
 89%|████████▉ | 331889/371472 [4:14:28<2:58:30,  3.70it/s]
 89%|████████▉ | 331890/371472 [4:14:29<3:23:21,  3.24it/s]
 89%|████████▉ | 331891/371472 [4:14:29<3:18:37,  3.32it/s]
 89%|████████▉ | 331892/371472 [4:14:29<3:27:55,  3.17it/s]
 89%|████████▉ | 331893/371472 [4:14:30<3:23:59,  3.23it/s]
 89%|████████▉ | 331894/371472 [4:14:30<3:30:54,  3.13it/s]
 89%|████████▉ | 331895/371472 [4:14:30<3:23:13,  3.25it/s]
 89%|████████▉ | 331896/371472 [4:14:30<3:13:29,  3.41it/s]
 89%|████████▉ | 331897/371472 [4:14:31<3:08:48,  3.49it/s]
 89%|████████▉ | 331898/371472 [4:14:31<3:07:03,  3.53it/s]
 89%|████████▉ | 331899/371472 [4:14:31<3:08:36,  3.50it/s]
 89%|████████▉ | 331900/371472 [4:14:32<3:04:34,  3.57it/s]
                                                           
{'loss': 2.4935, 'learning_rate': 1.9592643668254007e-07, 'epoch': 14.3}

 89%|████████▉ | 331900/371472 [4:14:32<3:04:34,  3.57it/s]
 89%|████████▉ | 331901/371472 [4:14:32<3:11:02,  3.45it/s]
 89%|████████▉ | 331902/371472 [4:14:32<3:07:42,  3.51it/s]
 89%|████████▉ | 331903/371472 [4:14:32<3:05:59,  3.55it/s]
 89%|████████▉ | 331904/371472 [4:14:33<3:04:34,  3.57it/s]
 89%|████████▉ | 331905/371472 [4:14:33<3:07:44,  3.51it/s]
 89%|████████▉ | 331906/371472 [4:14:33<3:02:41,  3.61it/s]
 89%|████████▉ | 331907/371472 [4:14:34<3:01:27,  3.63it/s]
 89%|████████▉ | 331908/371472 [4:14:34<2:59:24,  3.68it/s]
 89%|████████▉ | 331909/371472 [4:14:34<2:58:39,  3.69it/s]
 89%|████████▉ | 331910/371472 [4:14:34<3:12:41,  3.42it/s]
 89%|████████▉ | 331911/371472 [4:14:35<3:25:22,  3.21it/s]
 89%|████████▉ | 331912/371472 [4:14:35<3:09:47,  3.47it/s]
 89%|████████▉ | 331913/371472 [4:14:35<3:04:02,  3.58it/s]
 89%|████████▉ | 331914/371472 [4:14:36<3:08:39,  3.49it/s]
 89%|████████▉ | 331915/371472 [4:14:36<3:03:11,  3.60it/s]
 89%|████████▉ | 331916/371472 [4:14:36<3:02:47,  3.61it/s]
 89%|████████▉ | 331917/371472 [4:14:36<3:01:50,  3.63it/s]
 89%|████████▉ | 331918/371472 [4:14:37<3:10:47,  3.46it/s]
 89%|████████▉ | 331919/371472 [4:14:37<3:02:04,  3.62it/s]
 89%|████████▉ | 331920/371472 [4:14:37<2:59:21,  3.68it/s]
                                                           
{'loss': 2.6157, 'learning_rate': 1.958779547070611e-07, 'epoch': 14.3}

 89%|████████▉ | 331920/371472 [4:14:37<2:59:21,  3.68it/s]
 89%|████████▉ | 331921/371472 [4:14:37<3:04:53,  3.57it/s]
 89%|████████▉ | 331922/371472 [4:14:38<2:58:53,  3.68it/s]
 89%|████████▉ | 331923/371472 [4:14:38<3:08:12,  3.50it/s]
 89%|████████▉ | 331924/371472 [4:14:38<3:15:19,  3.37it/s]
 89%|████████▉ | 331925/371472 [4:14:39<3:12:28,  3.42it/s]
 89%|████████▉ | 331926/371472 [4:14:39<3:11:19,  3.44it/s]
 89%|████████▉ | 331927/371472 [4:14:39<3:04:26,  3.57it/s]
 89%|████████▉ | 331928/371472 [4:14:39<3:03:57,  3.58it/s]
 89%|████████▉ | 331929/371472 [4:14:40<3:14:33,  3.39it/s]
 89%|████████▉ | 331930/371472 [4:14:40<3:07:15,  3.52it/s]
 89%|████████▉ | 331931/371472 [4:14:40<3:05:31,  3.55it/s]
 89%|████████▉ | 331932/371472 [4:14:41<3:08:36,  3.49it/s]
 89%|████████▉ | 331933/371472 [4:14:41<3:07:03,  3.52it/s]
 89%|████████▉ | 331934/371472 [4:14:41<3:05:53,  3.54it/s]
 89%|████████▉ | 331935/371472 [4:14:41<3:03:53,  3.58it/s]
 89%|████████▉ | 331936/371472 [4:14:42<3:07:59,  3.51it/s]
 89%|████████▉ | 331937/371472 [4:14:42<3:06:28,  3.53it/s]
 89%|████████▉ | 331938/371472 [4:14:42<3:03:43,  3.59it/s]
 89%|████████▉ | 331939/371472 [4:14:43<3:04:08,  3.58it/s]
 89%|████████▉ | 331940/371472 [4:14:43<3:06:53,  3.53it/s]
                                                           
{'loss': 2.7505, 'learning_rate': 1.9582947273158227e-07, 'epoch': 14.3}

 89%|████████▉ | 331940/371472 [4:14:43<3:06:53,  3.53it/s]
 89%|████████▉ | 331941/371472 [4:14:43<3:13:29,  3.41it/s]
 89%|████████▉ | 331942/371472 [4:14:43<3:10:13,  3.46it/s]
 89%|████████▉ | 331943/371472 [4:14:44<3:02:57,  3.60it/s]
 89%|████████▉ | 331944/371472 [4:14:44<2:58:58,  3.68it/s]
 89%|████████▉ | 331945/371472 [4:14:44<3:01:25,  3.63it/s]
 89%|████████▉ | 331946/371472 [4:14:45<3:05:07,  3.56it/s]
 89%|████████▉ | 331947/371472 [4:14:45<3:08:58,  3.49it/s]
 89%|████████▉ | 331948/371472 [4:14:45<3:06:31,  3.53it/s]
 89%|████████▉ | 331949/371472 [4:14:45<2:59:21,  3.67it/s]
 89%|████████▉ | 331950/371472 [4:14:46<3:18:21,  3.32it/s]
 89%|████████▉ | 331951/371472 [4:14:46<3:18:19,  3.32it/s]
 89%|████████▉ | 331952/371472 [4:14:46<3:14:20,  3.39it/s]
 89%|████████▉ | 331953/371472 [4:14:47<3:06:49,  3.53it/s]
 89%|████████▉ | 331954/371472 [4:14:47<3:10:58,  3.45it/s]
 89%|████████▉ | 331955/371472 [4:14:47<3:03:59,  3.58it/s]
 89%|████████▉ | 331956/371472 [4:14:47<3:08:19,  3.50it/s]
 89%|████████▉ | 331957/371472 [4:14:48<3:06:43,  3.53it/s]
 89%|████████▉ | 331958/371472 [4:14:48<3:08:26,  3.49it/s]
 89%|████████▉ | 331959/371472 [4:14:48<3:01:05,  3.64it/s]
 89%|████████▉ | 331960/371472 [4:14:49<2:57:20,  3.71it/s]
                                                           
{'loss': 2.6382, 'learning_rate': 1.9578099075610337e-07, 'epoch': 14.3}

 89%|████████▉ | 331960/371472 [4:14:49<2:57:20,  3.71it/s]
 89%|████████▉ | 331961/371472 [4:14:49<3:07:20,  3.52it/s]
 89%|████████▉ | 331962/371472 [4:14:49<3:02:38,  3.61it/s]
 89%|████████▉ | 331963/371472 [4:14:49<3:07:04,  3.52it/s]
 89%|████████▉ | 331964/371472 [4:14:50<2:59:01,  3.68it/s]
 89%|████████▉ | 331965/371472 [4:14:50<3:20:25,  3.29it/s]
 89%|████████▉ | 331966/371472 [4:14:50<3:10:31,  3.46it/s]
 89%|████████▉ | 331967/371472 [4:14:51<3:02:51,  3.60it/s]
 89%|████████▉ | 331968/371472 [4:14:51<3:02:00,  3.62it/s]
 89%|████████▉ | 331969/371472 [4:14:51<3:05:29,  3.55it/s]
 89%|████████▉ | 331970/371472 [4:14:51<3:06:39,  3.53it/s]
 89%|████████▉ | 331971/371472 [4:14:52<3:08:35,  3.49it/s]
 89%|████████▉ | 331972/371472 [4:14:52<3:01:05,  3.64it/s]
 89%|████████▉ | 331973/371472 [4:14:52<3:12:54,  3.41it/s]
 89%|████████▉ | 331974/371472 [4:14:53<3:05:52,  3.54it/s]
 89%|████████▉ | 331975/371472 [4:14:53<2:59:43,  3.66it/s]
 89%|████████▉ | 331976/371472 [4:14:53<3:05:45,  3.54it/s]
 89%|████████▉ | 331977/371472 [4:14:53<3:01:06,  3.63it/s]
 89%|████████▉ | 331978/371472 [4:14:54<2:57:21,  3.71it/s]
 89%|████████▉ | 331979/371472 [4:14:54<2:53:58,  3.78it/s]
 89%|████████▉ | 331980/371472 [4:14:54<2:59:11,  3.67it/s]
                                                           
{'loss': 2.6148, 'learning_rate': 1.9573250878062446e-07, 'epoch': 14.3}

 89%|████████▉ | 331980/371472 [4:14:54<2:59:11,  3.67it/s]
 89%|████████▉ | 331981/371472 [4:14:54<3:04:06,  3.57it/s]
 89%|████████▉ | 331982/371472 [4:14:55<3:08:43,  3.49it/s]
 89%|████████▉ | 331983/371472 [4:14:55<3:06:25,  3.53it/s]
 89%|████████▉ | 331984/371472 [4:14:55<3:04:04,  3.58it/s]
 89%|████████▉ | 331985/371472 [4:14:56<3:11:42,  3.43it/s]
 89%|████████▉ | 331986/371472 [4:14:56<3:03:57,  3.58it/s]
 89%|████████▉ | 331987/371472 [4:14:56<3:04:25,  3.57it/s]
 89%|████████▉ | 331988/371472 [4:14:56<3:05:43,  3.54it/s]
 89%|████████▉ | 331989/371472 [4:14:57<3:11:07,  3.44it/s]
 89%|████████▉ | 331990/371472 [4:14:57<3:15:13,  3.37it/s]
 89%|████████▉ | 331991/371472 [4:14:57<3:15:01,  3.37it/s]
 89%|████████▉ | 331992/371472 [4:14:58<3:16:59,  3.34it/s]
 89%|████████▉ | 331993/371472 [4:14:58<3:16:15,  3.35it/s]
 89%|████████▉ | 331994/371472 [4:14:58<3:11:18,  3.44it/s]
 89%|████████▉ | 331995/371472 [4:14:59<3:23:42,  3.23it/s]
 89%|████████▉ | 331996/371472 [4:14:59<3:29:34,  3.14it/s]
 89%|████████▉ | 331997/371472 [4:14:59<3:23:08,  3.24it/s]
 89%|████████▉ | 331998/371472 [4:15:00<3:21:09,  3.27it/s]
 89%|████████▉ | 331999/371472 [4:15:00<3:16:25,  3.35it/s]
 89%|████████▉ | 332000/371472 [4:15:00<3:12:41,  3.41it/s]
                                                           
{'loss': 2.5819, 'learning_rate': 1.9568402680514554e-07, 'epoch': 14.3}

 89%|████████▉ | 332000/371472 [4:15:00<3:12:41,  3.41it/s]
 89%|████████▉ | 332001/371472 [4:15:00<3:07:49,  3.50it/s]
 89%|████████▉ | 332002/371472 [4:15:01<3:02:11,  3.61it/s]
 89%|████████▉ | 332003/371472 [4:15:01<3:04:09,  3.57it/s]
 89%|████████▉ | 332004/371472 [4:15:01<3:01:53,  3.62it/s]
 89%|████████▉ | 332005/371472 [4:15:01<3:12:50,  3.41it/s]
 89%|████████▉ | 332006/371472 [4:15:02<3:08:52,  3.48it/s]
 89%|████████▉ | 332007/371472 [4:15:02<3:02:39,  3.60it/s]
 89%|████████▉ | 332008/371472 [4:15:02<3:03:58,  3.58it/s]
 89%|████████▉ | 332009/371472 [4:15:03<3:03:46,  3.58it/s]
 89%|████████▉ | 332010/371472 [4:15:03<3:03:24,  3.59it/s]
 89%|████████▉ | 332011/371472 [4:15:03<3:02:47,  3.60it/s]
 89%|████████▉ | 332012/371472 [4:15:03<3:03:46,  3.58it/s]
 89%|████████▉ | 332013/371472 [4:15:04<3:15:17,  3.37it/s]
 89%|████████▉ | 332014/371472 [4:15:04<3:13:44,  3.39it/s]
 89%|████████▉ | 332015/371472 [4:15:04<3:11:59,  3.43it/s]
 89%|████████▉ | 332016/371472 [4:15:05<3:10:28,  3.45it/s]
 89%|████████▉ | 332017/371472 [4:15:05<3:05:55,  3.54it/s]
 89%|████████▉ | 332018/371472 [4:15:05<3:09:38,  3.47it/s]
 89%|████████▉ | 332019/371472 [4:15:05<3:04:43,  3.56it/s]
 89%|████████▉ | 332020/371472 [4:15:06<3:06:02,  3.53it/s]
                                                           
{'loss': 2.6886, 'learning_rate': 1.956355448296667e-07, 'epoch': 14.3}

 89%|████████▉ | 332020/371472 [4:15:06<3:06:02,  3.53it/s]
 89%|████████▉ | 332021/371472 [4:15:06<3:14:47,  3.38it/s]
 89%|████████▉ | 332022/371472 [4:15:06<3:13:43,  3.39it/s]
 89%|████████▉ | 332023/371472 [4:15:07<3:09:59,  3.46it/s]
 89%|████████▉ | 332024/371472 [4:15:07<3:09:06,  3.48it/s]
 89%|████████▉ | 332025/371472 [4:15:07<3:05:02,  3.55it/s]
 89%|████████▉ | 332026/371472 [4:15:07<3:15:08,  3.37it/s]
 89%|████████▉ | 332027/371472 [4:15:08<3:10:39,  3.45it/s]
 89%|████████▉ | 332028/371472 [4:15:08<3:05:46,  3.54it/s]
 89%|████████▉ | 332029/371472 [4:15:08<3:02:54,  3.59it/s]
 89%|████████▉ | 332030/371472 [4:15:09<3:04:08,  3.57it/s]
 89%|████████▉ | 332031/371472 [4:15:09<3:00:57,  3.63it/s]
 89%|████████▉ | 332032/371472 [4:15:09<3:02:35,  3.60it/s]
 89%|████████▉ | 332033/371472 [4:15:09<3:06:45,  3.52it/s]
 89%|████████▉ | 332034/371472 [4:15:10<3:05:40,  3.54it/s]
 89%|████████▉ | 332035/371472 [4:15:10<3:06:56,  3.52it/s]
 89%|████████▉ | 332036/371472 [4:15:10<3:05:35,  3.54it/s]
 89%|████████▉ | 332037/371472 [4:15:11<3:07:43,  3.50it/s]
 89%|████████▉ | 332038/371472 [4:15:11<3:06:33,  3.52it/s]
 89%|████████▉ | 332039/371472 [4:15:11<3:07:00,  3.51it/s]
 89%|████████▉ | 332040/371472 [4:15:11<3:04:15,  3.57it/s]
                                                           
{'loss': 2.5853, 'learning_rate': 1.9558706285418776e-07, 'epoch': 14.3}

 89%|████████▉ | 332040/371472 [4:15:11<3:04:15,  3.57it/s]
 89%|████████▉ | 332041/371472 [4:15:12<3:00:21,  3.64it/s]
 89%|████████▉ | 332042/371472 [4:15:12<2:58:55,  3.67it/s]
 89%|████████▉ | 332043/371472 [4:15:12<2:57:42,  3.70it/s]
 89%|████████▉ | 332044/371472 [4:15:12<2:59:30,  3.66it/s]
 89%|████████▉ | 332045/371472 [4:15:13<3:07:52,  3.50it/s]
 89%|████████▉ | 332046/371472 [4:15:13<3:09:31,  3.47it/s]
 89%|████████▉ | 332047/371472 [4:15:13<3:24:43,  3.21it/s]
 89%|████████▉ | 332048/371472 [4:15:14<3:28:33,  3.15it/s]
 89%|████████▉ | 332049/371472 [4:15:14<3:24:10,  3.22it/s]
 89%|████████▉ | 332050/371472 [4:15:14<3:21:11,  3.27it/s]
 89%|████████▉ | 332051/371472 [4:15:15<3:15:48,  3.36it/s]
 89%|████████▉ | 332052/371472 [4:15:15<3:08:25,  3.49it/s]
 89%|████████▉ | 332053/371472 [4:15:15<3:06:29,  3.52it/s]
 89%|████████▉ | 332054/371472 [4:15:16<3:13:14,  3.40it/s]
 89%|████████▉ | 332055/371472 [4:15:16<3:09:09,  3.47it/s]
 89%|████████▉ | 332056/371472 [4:15:16<3:11:32,  3.43it/s]
 89%|████████▉ | 332057/371472 [4:15:16<3:11:07,  3.44it/s]
 89%|████████▉ | 332058/371472 [4:15:17<3:05:45,  3.54it/s]
 89%|████████▉ | 332059/371472 [4:15:17<3:04:20,  3.56it/s]
 89%|████████▉ | 332060/371472 [4:15:17<2:59:20,  3.66it/s]
                                                           
{'loss': 2.5626, 'learning_rate': 1.955385808787088e-07, 'epoch': 14.3}

 89%|████████▉ | 332060/371472 [4:15:17<2:59:20,  3.66it/s]
 89%|████████▉ | 332061/371472 [4:15:17<3:00:12,  3.65it/s]
 89%|████████▉ | 332062/371472 [4:15:18<3:17:56,  3.32it/s]
 89%|████████▉ | 332063/371472 [4:15:18<3:09:51,  3.46it/s]
 89%|████████▉ | 332064/371472 [4:15:18<3:07:24,  3.50it/s]
 89%|████████▉ | 332065/371472 [4:15:19<3:03:11,  3.59it/s]
 89%|████████▉ | 332066/371472 [4:15:19<3:08:25,  3.49it/s]
 89%|████████▉ | 332067/371472 [4:15:19<3:05:52,  3.53it/s]
 89%|████████▉ | 332068/371472 [4:15:20<3:13:24,  3.40it/s]
 89%|████████▉ | 332069/371472 [4:15:20<3:10:14,  3.45it/s]
 89%|████████▉ | 332070/371472 [4:15:20<3:02:59,  3.59it/s]
 89%|████████▉ | 332071/371472 [4:15:20<3:01:29,  3.62it/s]
 89%|████████▉ | 332072/371472 [4:15:21<3:00:22,  3.64it/s]
 89%|████████▉ | 332073/371472 [4:15:21<2:57:09,  3.71it/s]
 89%|████████▉ | 332074/371472 [4:15:21<2:58:04,  3.69it/s]
 89%|████████▉ | 332075/371472 [4:15:21<3:04:13,  3.56it/s]
 89%|████████▉ | 332076/371472 [4:15:22<3:02:35,  3.60it/s]
 89%|████████▉ | 332077/371472 [4:15:22<2:58:06,  3.69it/s]
 89%|████████▉ | 332078/371472 [4:15:22<3:01:14,  3.62it/s]
 89%|████████▉ | 332079/371472 [4:15:23<3:00:23,  3.64it/s]
 89%|████████▉ | 332080/371472 [4:15:23<3:00:54,  3.63it/s]
                                                           
{'loss': 2.646, 'learning_rate': 1.9549009890322998e-07, 'epoch': 14.3}

 89%|████████▉ | 332080/371472 [4:15:23<3:00:54,  3.63it/s]
 89%|████████▉ | 332081/371472 [4:15:23<3:11:08,  3.43it/s]
 89%|████████▉ | 332082/371472 [4:15:23<3:01:24,  3.62it/s]
 89%|████████▉ | 332083/371472 [4:15:24<3:01:57,  3.61it/s]
 89%|████████▉ | 332084/371472 [4:15:24<3:09:16,  3.47it/s]
 89%|████████▉ | 332085/371472 [4:15:24<3:32:58,  3.08it/s]
 89%|████████▉ | 332086/371472 [4:15:25<3:19:38,  3.29it/s]
 89%|████████▉ | 332087/371472 [4:15:25<3:09:59,  3.45it/s]
 89%|████████▉ | 332088/371472 [4:15:25<3:04:30,  3.56it/s]
 89%|████████▉ | 332089/371472 [4:15:25<3:02:15,  3.60it/s]
 89%|████████▉ | 332090/371472 [4:15:26<3:06:19,  3.52it/s]
 89%|████████▉ | 332091/371472 [4:15:26<3:04:29,  3.56it/s]
 89%|████████▉ | 332092/371472 [4:15:26<3:16:08,  3.35it/s]
 89%|████████▉ | 332093/371472 [4:15:27<3:14:53,  3.37it/s]
 89%|████████▉ | 332094/371472 [4:15:27<3:11:21,  3.43it/s]
 89%|████████▉ | 332095/371472 [4:15:27<3:12:32,  3.41it/s]
 89%|████████▉ | 332096/371472 [4:15:28<3:20:04,  3.28it/s]
 89%|████████▉ | 332097/371472 [4:15:28<3:17:25,  3.32it/s]
 89%|████████▉ | 332098/371472 [4:15:28<3:16:03,  3.35it/s]
 89%|████████▉ | 332099/371472 [4:15:28<3:08:49,  3.48it/s]
 89%|████████▉ | 332100/371472 [4:15:29<3:09:03,  3.47it/s]
                                                           
{'loss': 2.5197, 'learning_rate': 1.9544161692775103e-07, 'epoch': 14.3}

 89%|████████▉ | 332100/371472 [4:15:29<3:09:03,  3.47it/s]
 89%|████████▉ | 332101/371472 [4:15:29<3:05:14,  3.54it/s]
 89%|████████▉ | 332102/371472 [4:15:29<3:02:40,  3.59it/s]
 89%|████████▉ | 332103/371472 [4:15:30<3:16:21,  3.34it/s]
 89%|████████▉ | 332104/371472 [4:15:30<3:19:42,  3.29it/s]
 89%|████████▉ | 332105/371472 [4:15:30<3:18:56,  3.30it/s]
 89%|████████▉ | 332106/371472 [4:15:31<3:35:38,  3.04it/s]
 89%|████████▉ | 332107/371472 [4:15:31<3:32:58,  3.08it/s]
 89%|████████▉ | 332108/371472 [4:15:31<3:23:48,  3.22it/s]
 89%|████████▉ | 332109/371472 [4:15:31<3:14:51,  3.37it/s]
 89%|████████▉ | 332110/371472 [4:15:32<3:09:56,  3.45it/s]
 89%|████████▉ | 332111/371472 [4:15:32<3:07:53,  3.49it/s]
 89%|████████▉ | 332112/371472 [4:15:32<3:09:40,  3.46it/s]
 89%|████████▉ | 332113/371472 [4:15:32<3:00:37,  3.63it/s]
 89%|████████▉ | 332114/371472 [4:15:33<3:11:41,  3.42it/s]
 89%|████████▉ | 332115/371472 [4:15:33<3:02:00,  3.60it/s]
 89%|████████▉ | 332116/371472 [4:15:33<3:07:08,  3.50it/s]
 89%|████████▉ | 332117/371472 [4:15:34<3:05:30,  3.54it/s]
 89%|████████▉ | 332118/371472 [4:15:34<3:00:15,  3.64it/s]
 89%|████████▉ | 332119/371472 [4:15:34<3:12:43,  3.40it/s]
 89%|████████▉ | 332120/371472 [4:15:35<3:10:26,  3.44it/s]
                                                           
{'loss': 2.5781, 'learning_rate': 1.9539313495227218e-07, 'epoch': 14.31}

 89%|████████▉ | 332120/371472 [4:15:35<3:10:26,  3.44it/s]
 89%|████████▉ | 332121/371472 [4:15:35<3:13:45,  3.39it/s]
 89%|████████▉ | 332122/371472 [4:15:35<3:08:47,  3.47it/s]
 89%|████████▉ | 332123/371472 [4:15:35<3:03:32,  3.57it/s]
 89%|████████▉ | 332124/371472 [4:15:36<3:14:40,  3.37it/s]
 89%|████████▉ | 332125/371472 [4:15:36<3:12:30,  3.41it/s]
 89%|████████▉ | 332126/371472 [4:15:36<3:25:31,  3.19it/s]
 89%|████████▉ | 332127/371472 [4:15:37<3:16:50,  3.33it/s]
 89%|████████▉ | 332128/371472 [4:15:37<3:06:56,  3.51it/s]
 89%|████████▉ | 332129/371472 [4:15:37<3:06:35,  3.51it/s]
 89%|████████▉ | 332130/371472 [4:15:37<3:09:21,  3.46it/s]
 89%|████████▉ | 332131/371472 [4:15:38<3:09:36,  3.46it/s]
 89%|████████▉ | 332132/371472 [4:15:38<3:08:15,  3.48it/s]
 89%|████████▉ | 332133/371472 [4:15:38<3:24:57,  3.20it/s]
 89%|████████▉ | 332134/371472 [4:15:39<3:21:55,  3.25it/s]
 89%|████████▉ | 332135/371472 [4:15:39<3:11:06,  3.43it/s]
 89%|████████▉ | 332136/371472 [4:15:39<3:18:17,  3.31it/s]
 89%|████████▉ | 332137/371472 [4:15:40<3:10:41,  3.44it/s]
 89%|████████▉ | 332138/371472 [4:15:40<3:07:13,  3.50it/s]
 89%|████████▉ | 332139/371472 [4:15:40<3:11:27,  3.42it/s]
 89%|████████▉ | 332140/371472 [4:15:40<3:23:22,  3.22it/s]
                                                           
{'loss': 2.6782, 'learning_rate': 1.9534465297679325e-07, 'epoch': 14.31}

 89%|████████▉ | 332140/371472 [4:15:40<3:23:22,  3.22it/s]
 89%|████████▉ | 332141/371472 [4:15:41<3:16:15,  3.34it/s]
 89%|████████▉ | 332142/371472 [4:15:41<3:08:13,  3.48it/s]
 89%|████████▉ | 332143/371472 [4:15:41<3:11:47,  3.42it/s]
 89%|████████▉ | 332144/371472 [4:15:42<3:13:10,  3.39it/s]
 89%|████████▉ | 332145/371472 [4:15:42<3:06:36,  3.51it/s]
 89%|████████▉ | 332146/371472 [4:15:42<3:04:19,  3.56it/s]
 89%|████████▉ | 332147/371472 [4:15:42<3:06:36,  3.51it/s]
 89%|████████▉ | 332148/371472 [4:15:43<3:02:52,  3.58it/s]
 89%|████████▉ | 332149/371472 [4:15:43<3:02:00,  3.60it/s]
 89%|████████▉ | 332150/371472 [4:15:43<3:00:56,  3.62it/s]
 89%|████████▉ | 332151/371472 [4:15:44<3:05:26,  3.53it/s]
 89%|████████▉ | 332152/371472 [4:15:44<3:18:12,  3.31it/s]
 89%|████████▉ | 332153/371472 [4:15:44<3:10:01,  3.45it/s]
 89%|████████▉ | 332154/371472 [4:15:44<3:08:03,  3.48it/s]
 89%|████████▉ | 332155/371472 [4:15:45<3:06:50,  3.51it/s]
 89%|████████▉ | 332156/371472 [4:15:45<2:59:49,  3.64it/s]
 89%|████████▉ | 332157/371472 [4:15:45<3:01:24,  3.61it/s]
 89%|████████▉ | 332158/371472 [4:15:46<3:00:57,  3.62it/s]
 89%|████████▉ | 332159/371472 [4:15:46<3:01:50,  3.60it/s]
 89%|████████▉ | 332160/371472 [4:15:46<2:57:21,  3.69it/s]
                                                           
{'loss': 2.5861, 'learning_rate': 1.952961710013144e-07, 'epoch': 14.31}

 89%|████████▉ | 332160/371472 [4:15:46<2:57:21,  3.69it/s]
 89%|████████▉ | 332161/371472 [4:15:46<3:06:55,  3.50it/s]
 89%|████████▉ | 332162/371472 [4:15:47<3:18:34,  3.30it/s]
 89%|████████▉ | 332163/371472 [4:15:47<3:08:48,  3.47it/s]
 89%|████████▉ | 332164/371472 [4:15:47<3:21:43,  3.25it/s]
 89%|████████▉ | 332165/371472 [4:15:48<3:15:22,  3.35it/s]
 89%|████████▉ | 332166/371472 [4:15:48<3:21:37,  3.25it/s]
 89%|████████▉ | 332167/371472 [4:15:48<3:22:02,  3.24it/s]
 89%|████████▉ | 332168/371472 [4:15:49<3:12:06,  3.41it/s]
 89%|████████▉ | 332169/371472 [4:15:49<3:35:41,  3.04it/s]
 89%|████████▉ | 332170/371472 [4:15:49<3:32:46,  3.08it/s]
 89%|████████▉ | 332171/371472 [4:15:50<3:40:31,  2.97it/s]
 89%|████████▉ | 332172/371472 [4:15:50<3:40:45,  2.97it/s]
 89%|████████▉ | 332173/371472 [4:15:50<3:24:46,  3.20it/s]
 89%|████████▉ | 332174/371472 [4:15:50<3:13:48,  3.38it/s]
 89%|████████▉ | 332175/371472 [4:15:51<3:08:55,  3.47it/s]
 89%|████████▉ | 332176/371472 [4:15:51<3:07:17,  3.50it/s]
 89%|████████▉ | 332177/371472 [4:15:51<3:02:55,  3.58it/s]
 89%|████████▉ | 332178/371472 [4:15:52<3:07:24,  3.49it/s]
 89%|████████▉ | 332179/371472 [4:15:52<3:01:51,  3.60it/s]
 89%|████████▉ | 332180/371472 [4:15:52<3:00:48,  3.62it/s]
                                                           
{'loss': 2.6391, 'learning_rate': 1.9524768902583544e-07, 'epoch': 14.31}

 89%|████████▉ | 332180/371472 [4:15:52<3:00:48,  3.62it/s]
 89%|████████▉ | 332181/371472 [4:15:52<2:58:51,  3.66it/s]
 89%|████████▉ | 332182/371472 [4:15:53<3:06:23,  3.51it/s]
 89%|████████▉ | 332183/371472 [4:15:53<3:02:51,  3.58it/s]
 89%|████████▉ | 332184/371472 [4:15:53<3:07:41,  3.49it/s]
 89%|████████▉ | 332185/371472 [4:15:54<3:12:16,  3.41it/s]
 89%|████████▉ | 332186/371472 [4:15:54<3:07:01,  3.50it/s]
 89%|████████▉ | 332187/371472 [4:15:54<3:03:36,  3.57it/s]
 89%|████████▉ | 332188/371472 [4:15:54<2:57:36,  3.69it/s]
 89%|████████▉ | 332189/371472 [4:15:55<2:57:19,  3.69it/s]
 89%|████████▉ | 332190/371472 [4:15:55<2:55:20,  3.73it/s]
 89%|████████▉ | 332191/371472 [4:15:55<2:54:37,  3.75it/s]
 89%|████████▉ | 332192/371472 [4:15:55<2:54:10,  3.76it/s]
 89%|████████▉ | 332193/371472 [4:15:56<3:04:12,  3.55it/s]
 89%|████████▉ | 332194/371472 [4:15:56<3:07:52,  3.48it/s]
 89%|████████▉ | 332195/371472 [4:15:56<3:10:47,  3.43it/s]
 89%|████████▉ | 332196/371472 [4:15:57<3:04:56,  3.54it/s]
 89%|████████▉ | 332197/371472 [4:15:57<3:07:34,  3.49it/s]
 89%|████████▉ | 332198/371472 [4:15:57<3:13:24,  3.38it/s]
 89%|████████▉ | 332199/371472 [4:15:57<3:05:54,  3.52it/s]
 89%|████████▉ | 332200/371472 [4:15:58<3:24:32,  3.20it/s]
                                                           
{'loss': 2.6668, 'learning_rate': 1.9519920705035662e-07, 'epoch': 14.31}

 89%|████████▉ | 332200/371472 [4:15:58<3:24:32,  3.20it/s]
 89%|████████▉ | 332201/371472 [4:15:58<3:21:18,  3.25it/s]
 89%|████████▉ | 332202/371472 [4:15:58<3:12:57,  3.39it/s]
 89%|████████▉ | 332203/371472 [4:15:59<3:28:09,  3.14it/s]
 89%|████████▉ | 332204/371472 [4:15:59<3:19:15,  3.28it/s]
 89%|████████▉ | 332205/371472 [4:15:59<3:13:41,  3.38it/s]
 89%|████████▉ | 332206/371472 [4:16:00<3:21:43,  3.24it/s]
 89%|████████▉ | 332207/371472 [4:16:00<3:12:59,  3.39it/s]
 89%|████████▉ | 332208/371472 [4:16:00<3:11:15,  3.42it/s]
 89%|████████▉ | 332209/371472 [4:16:00<3:07:29,  3.49it/s]
 89%|████████▉ | 332210/371472 [4:16:01<3:01:28,  3.61it/s]
 89%|████████▉ | 332211/371472 [4:16:01<3:01:45,  3.60it/s]
 89%|████████▉ | 332212/371472 [4:16:01<3:03:25,  3.57it/s]
 89%|████████▉ | 332213/371472 [4:16:02<2:55:55,  3.72it/s]
 89%|████████▉ | 332214/371472 [4:16:02<2:57:16,  3.69it/s]
 89%|████████▉ | 332215/371472 [4:16:02<2:50:28,  3.84it/s]
 89%|████████▉ | 332216/371472 [4:16:02<3:02:01,  3.59it/s]
 89%|████████▉ | 332217/371472 [4:16:03<3:11:06,  3.42it/s]
 89%|████████▉ | 332218/371472 [4:16:03<3:13:03,  3.39it/s]
 89%|████████▉ | 332219/371472 [4:16:03<3:15:15,  3.35it/s]
 89%|████████▉ | 332220/371472 [4:16:04<3:15:01,  3.35it/s]
                                                           
{'loss': 2.5859, 'learning_rate': 1.951507250748777e-07, 'epoch': 14.31}

 89%|████████▉ | 332220/371472 [4:16:04<3:15:01,  3.35it/s]
 89%|████████▉ | 332221/371472 [4:16:04<3:10:28,  3.43it/s]
 89%|████████▉ | 332222/371472 [4:16:04<3:07:59,  3.48it/s]
 89%|████████▉ | 332223/371472 [4:16:04<3:10:28,  3.43it/s]
 89%|████████▉ | 332224/371472 [4:16:05<3:10:16,  3.44it/s]
 89%|████████▉ | 332225/371472 [4:16:05<3:12:04,  3.41it/s]
 89%|████████▉ | 332226/371472 [4:16:05<3:08:00,  3.48it/s]
 89%|████████▉ | 332227/371472 [4:16:06<3:07:18,  3.49it/s]
 89%|████████▉ | 332228/371472 [4:16:06<3:07:06,  3.50it/s]
 89%|████████▉ | 332229/371472 [4:16:06<3:13:20,  3.38it/s]
 89%|████████▉ | 332230/371472 [4:16:07<3:17:12,  3.32it/s]
 89%|████████▉ | 332231/371472 [4:16:07<3:16:25,  3.33it/s]
 89%|████████▉ | 332232/371472 [4:16:07<3:11:10,  3.42it/s]
 89%|████████▉ | 332233/371472 [4:16:07<3:08:01,  3.48it/s]
 89%|████████▉ | 332234/371472 [4:16:08<3:18:29,  3.29it/s]
 89%|████████▉ | 332235/371472 [4:16:08<3:29:43,  3.12it/s]
 89%|████████▉ | 332236/371472 [4:16:08<3:22:24,  3.23it/s]
 89%|████████▉ | 332237/371472 [4:16:09<3:16:53,  3.32it/s]
 89%|████████▉ | 332238/371472 [4:16:09<3:22:47,  3.22it/s]
 89%|████████▉ | 332239/371472 [4:16:09<3:11:00,  3.42it/s]
 89%|████████▉ | 332240/371472 [4:16:09<3:09:06,  3.46it/s]
                                                           
{'loss': 2.5037, 'learning_rate': 1.9510224309939882e-07, 'epoch': 14.31}

 89%|████████▉ | 332240/371472 [4:16:09<3:09:06,  3.46it/s]
 89%|████████▉ | 332241/371472 [4:16:10<3:03:59,  3.55it/s]
 89%|████████▉ | 332242/371472 [4:16:10<3:00:57,  3.61it/s]
 89%|████████▉ | 332243/371472 [4:16:10<2:56:23,  3.71it/s]
 89%|████████▉ | 332244/371472 [4:16:11<2:56:58,  3.69it/s]
 89%|████████▉ | 332245/371472 [4:16:11<2:58:10,  3.67it/s]
 89%|████████▉ | 332246/371472 [4:16:11<2:56:12,  3.71it/s]
 89%|████████▉ | 332247/371472 [4:16:11<3:12:54,  3.39it/s]
 89%|████████▉ | 332248/371472 [4:16:12<3:20:01,  3.27it/s]
 89%|████████▉ | 332249/371472 [4:16:12<3:14:17,  3.36it/s]
 89%|████████▉ | 332250/371472 [4:16:12<3:31:08,  3.10it/s]
 89%|████████▉ | 332251/371472 [4:16:13<3:18:49,  3.29it/s]
 89%|████████▉ | 332252/371472 [4:16:13<3:22:24,  3.23it/s]
 89%|████████▉ | 332253/371472 [4:16:13<3:16:10,  3.33it/s]
 89%|████████▉ | 332254/371472 [4:16:14<3:07:36,  3.48it/s]
 89%|████████▉ | 332255/371472 [4:16:14<3:11:51,  3.41it/s]
 89%|████████▉ | 332256/371472 [4:16:14<3:04:48,  3.54it/s]
 89%|████████▉ | 332257/371472 [4:16:14<3:03:45,  3.56it/s]
 89%|████████▉ | 332258/371472 [4:16:15<3:01:19,  3.60it/s]
 89%|████████▉ | 332259/371472 [4:16:15<3:01:32,  3.60it/s]
 89%|████████▉ | 332260/371472 [4:16:15<3:07:28,  3.49it/s]
                                                           
{'loss': 2.764, 'learning_rate': 1.950537611239199e-07, 'epoch': 14.31}

 89%|████████▉ | 332260/371472 [4:16:15<3:07:28,  3.49it/s]
 89%|████████▉ | 332261/371472 [4:16:16<3:12:18,  3.40it/s]
 89%|████████▉ | 332262/371472 [4:16:16<3:20:07,  3.27it/s]
 89%|████████▉ | 332263/371472 [4:16:16<3:23:47,  3.21it/s]
 89%|████████▉ | 332264/371472 [4:16:16<3:17:35,  3.31it/s]
 89%|████████▉ | 332265/371472 [4:16:17<3:14:11,  3.37it/s]
 89%|████████▉ | 332266/371472 [4:16:17<3:09:55,  3.44it/s]
 89%|████████▉ | 332267/371472 [4:16:17<3:08:21,  3.47it/s]
 89%|████████▉ | 332268/371472 [4:16:18<3:05:09,  3.53it/s]
 89%|████████▉ | 332269/371472 [4:16:18<3:30:44,  3.10it/s]
 89%|████████▉ | 332270/371472 [4:16:18<3:25:12,  3.18it/s]
 89%|████████▉ | 332271/371472 [4:16:19<3:14:06,  3.37it/s]
 89%|████████▉ | 332272/371472 [4:16:19<3:24:21,  3.20it/s]
 89%|████████▉ | 332273/371472 [4:16:19<3:11:09,  3.42it/s]
 89%|████████▉ | 332274/371472 [4:16:19<3:08:57,  3.46it/s]
 89%|████████▉ | 332275/371472 [4:16:20<3:08:19,  3.47it/s]
 89%|████████▉ | 332276/371472 [4:16:20<3:10:45,  3.42it/s]
 89%|████████▉ | 332277/371472 [4:16:20<3:06:54,  3.50it/s]
 89%|████████▉ | 332278/371472 [4:16:21<3:08:10,  3.47it/s]
 89%|████████▉ | 332279/371472 [4:16:21<3:04:43,  3.54it/s]
 89%|████████▉ | 332280/371472 [4:16:21<3:22:00,  3.23it/s]
                                                           
{'loss': 2.4548, 'learning_rate': 1.9500527914844107e-07, 'epoch': 14.31}

 89%|████████▉ | 332280/371472 [4:16:21<3:22:00,  3.23it/s]
 89%|████████▉ | 332281/371472 [4:16:22<3:17:59,  3.30it/s]
 89%|████████▉ | 332282/371472 [4:16:22<3:24:46,  3.19it/s]
 89%|████████▉ | 332283/371472 [4:16:22<3:23:05,  3.22it/s]
 89%|████████▉ | 332284/371472 [4:16:22<3:13:39,  3.37it/s]
 89%|████████▉ | 332285/371472 [4:16:23<3:09:10,  3.45it/s]
 89%|████████▉ | 332286/371472 [4:16:23<3:04:47,  3.53it/s]
 89%|████████▉ | 332287/371472 [4:16:23<3:00:08,  3.63it/s]
 89%|████████▉ | 332288/371472 [4:16:24<3:02:46,  3.57it/s]
 89%|████████▉ | 332289/371472 [4:16:24<2:59:33,  3.64it/s]
 89%|████████▉ | 332290/371472 [4:16:24<3:05:17,  3.52it/s]
 89%|████████▉ | 332291/371472 [4:16:24<3:03:55,  3.55it/s]
 89%|████████▉ | 332292/371472 [4:16:25<3:11:33,  3.41it/s]
 89%|████████▉ | 332293/371472 [4:16:25<3:36:38,  3.01it/s]
 89%|████████▉ | 332294/371472 [4:16:25<3:23:36,  3.21it/s]
 89%|████████▉ | 332295/371472 [4:16:26<3:11:16,  3.41it/s]
 89%|████████▉ | 332296/371472 [4:16:26<3:16:33,  3.32it/s]
 89%|████████▉ | 332297/371472 [4:16:26<3:16:48,  3.32it/s]
 89%|████████▉ | 332298/371472 [4:16:27<3:13:35,  3.37it/s]
 89%|████████▉ | 332299/371472 [4:16:27<3:09:13,  3.45it/s]
 89%|████████▉ | 332300/371472 [4:16:27<3:15:31,  3.34it/s]
                                                           
{'loss': 2.6337, 'learning_rate': 1.949567971729621e-07, 'epoch': 14.31}

 89%|████████▉ | 332300/371472 [4:16:27<3:15:31,  3.34it/s]
 89%|████████▉ | 332301/371472 [4:16:27<3:16:16,  3.33it/s]
 89%|████████▉ | 332302/371472 [4:16:28<3:08:24,  3.46it/s]
 89%|████████▉ | 332303/371472 [4:16:28<3:03:58,  3.55it/s]
 89%|████████▉ | 332304/371472 [4:16:28<3:03:42,  3.55it/s]
 89%|████████▉ | 332305/371472 [4:16:29<3:16:28,  3.32it/s]
 89%|████████▉ | 332306/371472 [4:16:29<3:09:38,  3.44it/s]
 89%|████████▉ | 332307/371472 [4:16:29<3:13:27,  3.37it/s]
 89%|████████▉ | 332308/371472 [4:16:29<3:07:34,  3.48it/s]
 89%|████████▉ | 332309/371472 [4:16:30<3:00:50,  3.61it/s]
 89%|████████▉ | 332310/371472 [4:16:30<3:03:54,  3.55it/s]
 89%|████████▉ | 332311/371472 [4:16:30<3:17:52,  3.30it/s]
 89%|████████▉ | 332312/371472 [4:16:31<3:12:55,  3.38it/s]
 89%|████████▉ | 332313/371472 [4:16:31<3:08:47,  3.46it/s]
 89%|████████▉ | 332314/371472 [4:16:31<3:00:01,  3.63it/s]
 89%|████████▉ | 332315/371472 [4:16:32<3:19:47,  3.27it/s]
 89%|████████▉ | 332316/371472 [4:16:32<3:10:42,  3.42it/s]
 89%|████████▉ | 332317/371472 [4:16:32<3:16:24,  3.32it/s]
 89%|████████▉ | 332318/371472 [4:16:32<3:08:23,  3.46it/s]
 89%|████████▉ | 332319/371472 [4:16:33<3:07:52,  3.47it/s]
 89%|████████▉ | 332320/371472 [4:16:33<3:04:10,  3.54it/s]
                                                           
{'loss': 2.5539, 'learning_rate': 1.9490831519748326e-07, 'epoch': 14.31}

 89%|████████▉ | 332320/371472 [4:16:33<3:04:10,  3.54it/s]
 89%|████████▉ | 332321/371472 [4:16:33<3:07:16,  3.48it/s]
 89%|████████▉ | 332322/371472 [4:16:33<3:08:43,  3.46it/s]
 89%|████████▉ | 332323/371472 [4:16:34<3:08:23,  3.46it/s]
 89%|████████▉ | 332324/371472 [4:16:34<3:17:13,  3.31it/s]
 89%|████████▉ | 332325/371472 [4:16:34<3:10:59,  3.42it/s]
 89%|████████▉ | 332326/371472 [4:16:35<3:09:40,  3.44it/s]
 89%|████████▉ | 332327/371472 [4:16:35<3:16:21,  3.32it/s]
 89%|████████▉ | 332328/371472 [4:16:35<3:22:06,  3.23it/s]
 89%|████████▉ | 332329/371472 [4:16:36<3:14:30,  3.35it/s]
 89%|████████▉ | 332330/371472 [4:16:36<3:12:15,  3.39it/s]
 89%|████████▉ | 332331/371472 [4:16:36<3:09:55,  3.43it/s]
 89%|████████▉ | 332332/371472 [4:16:37<3:25:20,  3.18it/s]
 89%|████████▉ | 332333/371472 [4:16:37<3:20:20,  3.26it/s]
 89%|████████▉ | 332334/371472 [4:16:37<3:10:27,  3.42it/s]
 89%|████████▉ | 332335/371472 [4:16:37<3:25:47,  3.17it/s]
 89%|████████▉ | 332336/371472 [4:16:38<3:28:31,  3.13it/s]
 89%|████████▉ | 332337/371472 [4:16:38<3:23:46,  3.20it/s]
 89%|████████▉ | 332338/371472 [4:16:38<3:18:25,  3.29it/s]
 89%|████████▉ | 332339/371472 [4:16:39<3:23:13,  3.21it/s]
 89%|████████▉ | 332340/371472 [4:16:39<3:28:13,  3.13it/s]
                                                           
{'loss': 2.6331, 'learning_rate': 1.9485983322200433e-07, 'epoch': 14.31}

 89%|████████▉ | 332340/371472 [4:16:39<3:28:13,  3.13it/s]
 89%|████████▉ | 332341/371472 [4:16:39<3:31:32,  3.08it/s]
 89%|████████▉ | 332342/371472 [4:16:40<3:26:54,  3.15it/s]
 89%|████████▉ | 332343/371472 [4:16:40<3:15:00,  3.34it/s]
 89%|████████▉ | 332344/371472 [4:16:40<3:09:32,  3.44it/s]
 89%|████████▉ | 332345/371472 [4:16:40<3:04:17,  3.54it/s]
 89%|████████▉ | 332346/371472 [4:16:41<3:07:07,  3.48it/s]
 89%|████████▉ | 332347/371472 [4:16:41<3:00:26,  3.61it/s]
 89%|████████▉ | 332348/371472 [4:16:41<2:58:42,  3.65it/s]
 89%|████████▉ | 332349/371472 [4:16:42<2:54:19,  3.74it/s]
 89%|████████▉ | 332350/371472 [4:16:42<3:02:17,  3.58it/s]
 89%|████████▉ | 332351/371472 [4:16:42<3:05:29,  3.51it/s]
 89%|████████▉ | 332352/371472 [4:16:42<3:15:38,  3.33it/s]
 89%|████████▉ | 332353/371472 [4:16:43<3:15:40,  3.33it/s]
 89%|████████▉ | 332354/371472 [4:16:43<3:07:56,  3.47it/s]
 89%|████████▉ | 332355/371472 [4:16:43<3:03:19,  3.56it/s]
 89%|████████▉ | 332356/371472 [4:16:44<3:05:39,  3.51it/s]
 89%|████████▉ | 332357/371472 [4:16:44<2:58:54,  3.64it/s]
 89%|████████▉ | 332358/371472 [4:16:44<3:09:13,  3.45it/s]
 89%|████████▉ | 332359/371472 [4:16:44<3:02:01,  3.58it/s]
 89%|████████▉ | 332360/371472 [4:16:45<3:09:34,  3.44it/s]
                                                           
{'loss': 2.5254, 'learning_rate': 1.9481135124652548e-07, 'epoch': 14.32}

 89%|████████▉ | 332360/371472 [4:16:45<3:09:34,  3.44it/s]
 89%|████████▉ | 332361/371472 [4:16:45<3:05:46,  3.51it/s]
 89%|████████▉ | 332362/371472 [4:16:45<3:04:40,  3.53it/s]
 89%|████████▉ | 332363/371472 [4:16:46<2:58:09,  3.66it/s]
 89%|████████▉ | 332364/371472 [4:16:46<2:58:09,  3.66it/s]
 89%|████████▉ | 332365/371472 [4:16:46<2:58:37,  3.65it/s]
 89%|████████▉ | 332366/371472 [4:16:46<2:54:51,  3.73it/s]
 89%|████████▉ | 332367/371472 [4:16:47<2:59:10,  3.64it/s]
 89%|████████▉ | 332368/371472 [4:16:47<2:58:36,  3.65it/s]
 89%|████████▉ | 332369/371472 [4:16:47<2:59:49,  3.62it/s]
 89%|████████▉ | 332370/371472 [4:16:47<3:05:46,  3.51it/s]
 89%|████████▉ | 332371/371472 [4:16:48<3:04:28,  3.53it/s]
 89%|████████▉ | 332372/371472 [4:16:48<3:03:46,  3.55it/s]
 89%|████████▉ | 332373/371472 [4:16:48<3:02:49,  3.56it/s]
 89%|████████▉ | 332374/371472 [4:16:49<3:02:54,  3.56it/s]
 89%|████████▉ | 332375/371472 [4:16:49<2:59:07,  3.64it/s]
 89%|████████▉ | 332376/371472 [4:16:49<2:58:32,  3.65it/s]
 89%|████████▉ | 332377/371472 [4:16:49<3:00:32,  3.61it/s]
 89%|████████▉ | 332378/371472 [4:16:50<3:03:29,  3.55it/s]
 89%|████████▉ | 332379/371472 [4:16:50<3:00:12,  3.62it/s]
 89%|████████▉ | 332380/371472 [4:16:50<3:03:02,  3.56it/s]
                                                           
{'loss': 2.6452, 'learning_rate': 1.9476286927104656e-07, 'epoch': 14.32}

 89%|████████▉ | 332380/371472 [4:16:50<3:03:02,  3.56it/s]
 89%|████████▉ | 332381/371472 [4:16:51<3:05:31,  3.51it/s]
 89%|████████▉ | 332382/371472 [4:16:51<2:59:30,  3.63it/s]
 89%|████████▉ | 332383/371472 [4:16:51<3:20:27,  3.25it/s]
 89%|████████▉ | 332384/371472 [4:16:51<3:11:19,  3.41it/s]
 89%|████████▉ | 332385/371472 [4:16:52<3:11:11,  3.41it/s]
 89%|████████▉ | 332386/371472 [4:16:52<3:07:49,  3.47it/s]
 89%|████████▉ | 332387/371472 [4:16:52<3:06:06,  3.50it/s]
 89%|████████▉ | 332388/371472 [4:16:53<3:01:09,  3.60it/s]
 89%|████████▉ | 332389/371472 [4:16:53<3:11:57,  3.39it/s]
 89%|████████▉ | 332390/371472 [4:16:53<3:12:45,  3.38it/s]
 89%|████████▉ | 332391/371472 [4:16:53<3:08:13,  3.46it/s]
 89%|████████▉ | 332392/371472 [4:16:54<3:00:52,  3.60it/s]
 89%|████████▉ | 332393/371472 [4:16:54<3:05:24,  3.51it/s]
 89%|████████▉ | 332394/371472 [4:16:54<3:01:23,  3.59it/s]
 89%|████████▉ | 332395/371472 [4:16:55<3:14:21,  3.35it/s]
 89%|████████▉ | 332396/371472 [4:16:55<3:31:23,  3.08it/s]
 89%|████████▉ | 332397/371472 [4:16:55<3:26:54,  3.15it/s]
 89%|████████▉ | 332398/371472 [4:16:56<3:18:13,  3.29it/s]
 89%|████████▉ | 332399/371472 [4:16:56<3:11:26,  3.40it/s]
 89%|████████▉ | 332400/371472 [4:16:56<3:21:36,  3.23it/s]
                                                           
{'loss': 2.5895, 'learning_rate': 1.947143872955677e-07, 'epoch': 14.32}

 89%|████████▉ | 332400/371472 [4:16:56<3:21:36,  3.23it/s]
 89%|████████▉ | 332401/371472 [4:16:57<3:18:01,  3.29it/s]
 89%|████████▉ | 332402/371472 [4:16:57<3:28:28,  3.12it/s]
 89%|████████▉ | 332403/371472 [4:16:57<3:24:08,  3.19it/s]
 89%|████████▉ | 332404/371472 [4:16:57<3:15:39,  3.33it/s]
 89%|████████▉ | 332405/371472 [4:16:58<3:05:20,  3.51it/s]
 89%|████████▉ | 332406/371472 [4:16:58<2:58:41,  3.64it/s]
 89%|████████▉ | 332407/371472 [4:16:58<2:56:13,  3.69it/s]
 89%|████████▉ | 332408/371472 [4:16:58<3:02:47,  3.56it/s]
 89%|████████▉ | 332409/371472 [4:16:59<2:57:57,  3.66it/s]
 89%|████████▉ | 332410/371472 [4:16:59<2:48:42,  3.86it/s]
 89%|████████▉ | 332411/371472 [4:16:59<2:53:07,  3.76it/s]
 89%|████████▉ | 332412/371472 [4:17:00<2:52:37,  3.77it/s]
 89%|████████▉ | 332413/371472 [4:17:00<2:59:38,  3.62it/s]
 89%|████████▉ | 332414/371472 [4:17:00<3:04:03,  3.54it/s]
 89%|████████▉ | 332415/371472 [4:17:00<3:06:09,  3.50it/s]
 89%|████████▉ | 332416/371472 [4:17:01<3:05:56,  3.50it/s]
 89%|████████▉ | 332417/371472 [4:17:01<3:02:53,  3.56it/s]
 89%|████████▉ | 332418/371472 [4:17:01<2:56:11,  3.69it/s]
 89%|████████▉ | 332419/371472 [4:17:01<2:55:47,  3.70it/s]
 89%|████████▉ | 332420/371472 [4:17:02<2:56:16,  3.69it/s]
                                                           
{'loss': 2.6433, 'learning_rate': 1.9466590532008875e-07, 'epoch': 14.32}

 89%|████████▉ | 332420/371472 [4:17:02<2:56:16,  3.69it/s]
 89%|████████▉ | 332421/371472 [4:17:02<2:53:11,  3.76it/s]
 89%|████████▉ | 332422/371472 [4:17:02<2:53:16,  3.76it/s]
 89%|████████▉ | 332423/371472 [4:17:03<2:55:34,  3.71it/s]
 89%|████████▉ | 332424/371472 [4:17:03<2:50:39,  3.81it/s]
 89%|████████▉ | 332425/371472 [4:17:03<3:01:16,  3.59it/s]
 89%|████████▉ | 332426/371472 [4:17:03<2:56:45,  3.68it/s]
 89%|████████▉ | 332427/371472 [4:17:04<3:20:19,  3.25it/s]
 89%|████████▉ | 332428/371472 [4:17:04<3:08:32,  3.45it/s]
 89%|████████▉ | 332429/371472 [4:17:04<3:03:23,  3.55it/s]
 89%|████████▉ | 332430/371472 [4:17:05<3:08:21,  3.45it/s]
 89%|████████▉ | 332431/371472 [4:17:05<3:00:21,  3.61it/s]
 89%|████████▉ | 332432/371472 [4:17:05<2:59:25,  3.63it/s]
 89%|████████▉ | 332433/371472 [4:17:05<2:57:34,  3.66it/s]
 89%|████████▉ | 332434/371472 [4:17:06<2:56:26,  3.69it/s]
 89%|████████▉ | 332435/371472 [4:17:06<3:01:10,  3.59it/s]
 89%|████████▉ | 332436/371472 [4:17:06<3:10:41,  3.41it/s]
 89%|████████▉ | 332437/371472 [4:17:07<3:01:28,  3.58it/s]
 89%|████████▉ | 332438/371472 [4:17:07<3:13:35,  3.36it/s]
 89%|████████▉ | 332439/371472 [4:17:07<3:26:10,  3.16it/s]
 89%|████████▉ | 332440/371472 [4:17:07<3:13:06,  3.37it/s]
                                                           
{'loss': 2.6665, 'learning_rate': 1.946174233446099e-07, 'epoch': 14.32}

 89%|████████▉ | 332440/371472 [4:17:07<3:13:06,  3.37it/s]
 89%|████████▉ | 332441/371472 [4:17:08<3:09:40,  3.43it/s]
 89%|████████▉ | 332442/371472 [4:17:08<3:09:27,  3.43it/s]
 89%|████████▉ | 332443/371472 [4:17:08<3:14:19,  3.35it/s]
 89%|████████▉ | 332444/371472 [4:17:09<3:11:52,  3.39it/s]
 89%|████████▉ | 332445/371472 [4:17:09<3:02:53,  3.56it/s]
 89%|████████▉ | 332446/371472 [4:17:09<2:59:25,  3.63it/s]
 89%|████████▉ | 332447/371472 [4:17:09<2:55:55,  3.70it/s]
 89%|████████▉ | 332448/371472 [4:17:10<3:25:39,  3.16it/s]
 89%|████████▉ | 332449/371472 [4:17:10<3:50:29,  2.82it/s]
 89%|████████▉ | 332450/371472 [4:17:11<3:39:55,  2.96it/s]
 89%|████████▉ | 332451/371472 [4:17:11<3:24:58,  3.17it/s]
 89%|████████▉ | 332452/371472 [4:17:11<3:16:48,  3.30it/s]
 89%|████████▉ | 332453/371472 [4:17:11<3:06:26,  3.49it/s]
 89%|████████▉ | 332454/371472 [4:17:12<3:12:17,  3.38it/s]
 89%|████████▉ | 332455/371472 [4:17:12<3:15:26,  3.33it/s]
 89%|████████▉ | 332456/371472 [4:17:12<3:13:05,  3.37it/s]
 89%|████████▉ | 332457/371472 [4:17:13<3:17:30,  3.29it/s]
 89%|████████▉ | 332458/371472 [4:17:13<3:15:50,  3.32it/s]
 89%|████████▉ | 332459/371472 [4:17:13<3:10:14,  3.42it/s]
 89%|████████▉ | 332460/371472 [4:17:13<3:05:53,  3.50it/s]
                                                           
{'loss': 2.4366, 'learning_rate': 1.9456894136913097e-07, 'epoch': 14.32}

 89%|████████▉ | 332460/371472 [4:17:13<3:05:53,  3.50it/s]
 89%|████████▉ | 332461/371472 [4:17:14<3:11:55,  3.39it/s]
 89%|████████▉ | 332462/371472 [4:17:14<3:12:26,  3.38it/s]
 89%|████████▉ | 332463/371472 [4:17:14<3:25:19,  3.17it/s]
 89%|████████▉ | 332464/371472 [4:17:15<3:33:25,  3.05it/s]
 89%|████████▉ | 332465/371472 [4:17:15<3:20:41,  3.24it/s]
 89%|████████▉ | 332466/371472 [4:17:15<3:05:18,  3.51it/s]
 89%|████████▉ | 332467/371472 [4:17:16<3:05:09,  3.51it/s]
 90%|████████▉ | 332468/371472 [4:17:16<3:28:26,  3.12it/s]
 90%|████████▉ | 332469/371472 [4:17:16<3:20:47,  3.24it/s]
 90%|████████▉ | 332470/371472 [4:17:16<3:11:09,  3.40it/s]
 90%|████████▉ | 332471/371472 [4:17:17<3:13:56,  3.35it/s]
 90%|████████▉ | 332472/371472 [4:17:17<3:20:59,  3.23it/s]
 90%|████████▉ | 332473/371472 [4:17:17<3:08:44,  3.44it/s]
 90%|████████▉ | 332474/371472 [4:17:18<3:06:48,  3.48it/s]
 90%|████████▉ | 332475/371472 [4:17:18<3:14:22,  3.34it/s]
 90%|████████▉ | 332476/371472 [4:17:18<3:17:34,  3.29it/s]
 90%|████████▉ | 332477/371472 [4:17:19<3:12:34,  3.38it/s]
 90%|████████▉ | 332478/371472 [4:17:19<3:06:17,  3.49it/s]
 90%|████████▉ | 332479/371472 [4:17:19<3:03:49,  3.54it/s]
 90%|████████▉ | 332480/371472 [4:17:19<3:04:07,  3.53it/s]
                                                           
{'loss': 2.6425, 'learning_rate': 1.9452045939365212e-07, 'epoch': 14.32}

 90%|████████▉ | 332480/371472 [4:17:19<3:04:07,  3.53it/s]
 90%|████████▉ | 332481/371472 [4:17:20<3:16:21,  3.31it/s]
 90%|████████▉ | 332482/371472 [4:17:20<3:22:01,  3.22it/s]
 90%|████████▉ | 332483/371472 [4:17:20<3:09:56,  3.42it/s]
 90%|████████▉ | 332484/371472 [4:17:21<3:25:34,  3.16it/s]
 90%|████████▉ | 332485/371472 [4:17:21<3:16:01,  3.31it/s]
 90%|████████▉ | 332486/371472 [4:17:21<3:19:53,  3.25it/s]
 90%|████████▉ | 332487/371472 [4:17:22<3:14:49,  3.33it/s]
 90%|████████▉ | 332488/371472 [4:17:22<3:09:10,  3.43it/s]
 90%|████████▉ | 332489/371472 [4:17:22<3:18:48,  3.27it/s]
 90%|████████▉ | 332490/371472 [4:17:22<3:19:59,  3.25it/s]
 90%|████████▉ | 332491/371472 [4:17:23<3:14:38,  3.34it/s]
 90%|████████▉ | 332492/371472 [4:17:23<3:06:12,  3.49it/s]
 90%|████████▉ | 332493/371472 [4:17:23<3:08:42,  3.44it/s]
 90%|████████▉ | 332494/371472 [4:17:24<3:03:54,  3.53it/s]
 90%|████████▉ | 332495/371472 [4:17:24<2:54:38,  3.72it/s]
 90%|████████▉ | 332496/371472 [4:17:24<2:55:16,  3.71it/s]
 90%|████████▉ | 332497/371472 [4:17:24<3:09:55,  3.42it/s]
 90%|████████▉ | 332498/371472 [4:17:25<3:04:25,  3.52it/s]
 90%|████████▉ | 332499/371472 [4:17:25<2:58:30,  3.64it/s]
 90%|████████▉ | 332500/371472 [4:17:25<2:53:08,  3.75it/s]
                                                           
{'loss': 2.4537, 'learning_rate': 1.9447197741817317e-07, 'epoch': 14.32}

 90%|████████▉ | 332500/371472 [4:17:25<2:53:08,  3.75it/s]
 90%|████████▉ | 332501/371472 [4:17:25<2:50:35,  3.81it/s]
 90%|████████▉ | 332502/371472 [4:17:26<2:47:51,  3.87it/s]
 90%|████████▉ | 332503/371472 [4:17:26<2:55:24,  3.70it/s]
 90%|████████▉ | 332504/371472 [4:17:26<3:07:49,  3.46it/s]
 90%|████████▉ | 332505/371472 [4:17:27<3:04:06,  3.53it/s]
 90%|████████▉ | 332506/371472 [4:17:27<3:05:32,  3.50it/s]
 90%|████████▉ | 332507/371472 [4:17:27<2:59:50,  3.61it/s]
 90%|████████▉ | 332508/371472 [4:17:27<3:02:42,  3.55it/s]
 90%|████████▉ | 332509/371472 [4:17:28<2:56:11,  3.69it/s]
 90%|████████▉ | 332510/371472 [4:17:28<2:56:12,  3.69it/s]
 90%|████████▉ | 332511/371472 [4:17:28<2:57:18,  3.66it/s]
 90%|████████▉ | 332512/371472 [4:17:28<2:50:45,  3.80it/s]
 90%|████████▉ | 332513/371472 [4:17:29<2:50:15,  3.81it/s]
 90%|████████▉ | 332514/371472 [4:17:29<2:50:53,  3.80it/s]
 90%|████████▉ | 332515/371472 [4:17:29<2:47:02,  3.89it/s]
 90%|████████▉ | 332516/371472 [4:17:30<2:50:34,  3.81it/s]
 90%|████████▉ | 332517/371472 [4:17:30<2:55:16,  3.70it/s]
 90%|████████▉ | 332518/371472 [4:17:30<2:50:45,  3.80it/s]
 90%|████████▉ | 332519/371472 [4:17:30<2:54:51,  3.71it/s]
 90%|████████▉ | 332520/371472 [4:17:31<3:06:10,  3.49it/s]
                                                           
{'loss': 2.6706, 'learning_rate': 1.9442349544269435e-07, 'epoch': 14.32}

 90%|████████▉ | 332520/371472 [4:17:31<3:06:10,  3.49it/s]
 90%|████████▉ | 332521/371472 [4:17:31<3:06:22,  3.48it/s]
 90%|████████▉ | 332522/371472 [4:17:31<3:07:16,  3.47it/s]
 90%|████████▉ | 332523/371472 [4:17:32<3:05:13,  3.50it/s]
 90%|████████▉ | 332524/371472 [4:17:32<3:11:18,  3.39it/s]
 90%|████████▉ | 332525/371472 [4:17:32<3:14:52,  3.33it/s]
 90%|████████▉ | 332526/371472 [4:17:32<3:03:45,  3.53it/s]
 90%|████████▉ | 332527/371472 [4:17:33<3:12:25,  3.37it/s]
 90%|████████▉ | 332528/371472 [4:17:33<3:03:21,  3.54it/s]
 90%|████████▉ | 332529/371472 [4:17:33<3:11:20,  3.39it/s]
 90%|████████▉ | 332530/371472 [4:17:34<3:06:58,  3.47it/s]
 90%|████████▉ | 332531/371472 [4:17:34<3:01:31,  3.58it/s]
 90%|████████▉ | 332532/371472 [4:17:34<3:11:27,  3.39it/s]
 90%|████████▉ | 332533/371472 [4:17:34<3:08:59,  3.43it/s]
 90%|████████▉ | 332534/371472 [4:17:35<3:01:38,  3.57it/s]
 90%|████████▉ | 332535/371472 [4:17:35<3:06:54,  3.47it/s]
 90%|████████▉ | 332536/371472 [4:17:35<2:58:51,  3.63it/s]
 90%|████████▉ | 332537/371472 [4:17:36<2:56:42,  3.67it/s]
 90%|████████▉ | 332538/371472 [4:17:36<2:57:42,  3.65it/s]
 90%|████████▉ | 332539/371472 [4:17:36<2:56:21,  3.68it/s]
 90%|████████▉ | 332540/371472 [4:17:36<3:13:49,  3.35it/s]
                                                           
{'loss': 2.7051, 'learning_rate': 1.943750134672154e-07, 'epoch': 14.32}

 90%|████████▉ | 332540/371472 [4:17:36<3:13:49,  3.35it/s]
 90%|████████▉ | 332541/371472 [4:17:37<3:15:06,  3.33it/s]
 90%|████████▉ | 332542/371472 [4:17:37<3:03:57,  3.53it/s]
 90%|████████▉ | 332543/371472 [4:17:37<3:14:07,  3.34it/s]
 90%|████████▉ | 332544/371472 [4:17:38<3:04:55,  3.51it/s]
 90%|████████▉ | 332545/371472 [4:17:38<2:59:14,  3.62it/s]
 90%|████████▉ | 332546/371472 [4:17:38<2:57:03,  3.66it/s]
 90%|████████▉ | 332547/371472 [4:17:38<2:59:03,  3.62it/s]
 90%|████████▉ | 332548/371472 [4:17:39<3:00:49,  3.59it/s]
 90%|████████▉ | 332549/371472 [4:17:39<2:57:58,  3.64it/s]
 90%|████████▉ | 332550/371472 [4:17:39<2:51:43,  3.78it/s]
 90%|████████▉ | 332551/371472 [4:17:39<2:51:13,  3.79it/s]
 90%|████████▉ | 332552/371472 [4:17:40<2:54:29,  3.72it/s]
 90%|████████▉ | 332553/371472 [4:17:40<2:56:23,  3.68it/s]
 90%|████████▉ | 332554/371472 [4:17:40<2:51:56,  3.77it/s]
 90%|████████▉ | 332555/371472 [4:17:41<3:08:29,  3.44it/s]
 90%|████████▉ | 332556/371472 [4:17:41<3:03:29,  3.53it/s]
 90%|████████▉ | 332557/371472 [4:17:41<3:26:08,  3.15it/s]
 90%|████████▉ | 332558/371472 [4:17:42<3:21:33,  3.22it/s]
 90%|████████▉ | 332559/371472 [4:17:42<3:16:26,  3.30it/s]
 90%|████████▉ | 332560/371472 [4:17:42<3:07:34,  3.46it/s]
                                                           
{'loss': 2.523, 'learning_rate': 1.9432653149173654e-07, 'epoch': 14.32}

 90%|████████▉ | 332560/371472 [4:17:42<3:07:34,  3.46it/s]
 90%|████████▉ | 332561/371472 [4:17:42<3:03:50,  3.53it/s]
 90%|████████▉ | 332562/371472 [4:17:43<2:58:34,  3.63it/s]
 90%|████████▉ | 332563/371472 [4:17:43<2:53:44,  3.73it/s]
 90%|████████▉ | 332564/371472 [4:17:43<2:56:17,  3.68it/s]
 90%|████████▉ | 332565/371472 [4:17:43<3:05:21,  3.50it/s]
 90%|████████▉ | 332566/371472 [4:17:44<3:26:52,  3.13it/s]
 90%|████████▉ | 332567/371472 [4:17:44<3:14:51,  3.33it/s]
 90%|████████▉ | 332568/371472 [4:17:44<3:20:24,  3.24it/s]
 90%|████████▉ | 332569/371472 [4:17:45<3:27:04,  3.13it/s]
 90%|████████▉ | 332570/371472 [4:17:45<3:16:09,  3.31it/s]
 90%|████████▉ | 332571/371472 [4:17:45<3:09:14,  3.43it/s]
 90%|████████▉ | 332572/371472 [4:17:46<3:07:57,  3.45it/s]
 90%|████████▉ | 332573/371472 [4:17:46<3:05:32,  3.49it/s]
 90%|████████▉ | 332574/371472 [4:17:46<2:58:39,  3.63it/s]
 90%|████████▉ | 332575/371472 [4:17:46<3:07:15,  3.46it/s]
 90%|████████▉ | 332576/371472 [4:17:47<3:09:05,  3.43it/s]
 90%|████████▉ | 332577/371472 [4:17:47<3:15:00,  3.32it/s]
 90%|████████▉ | 332578/371472 [4:17:47<3:11:21,  3.39it/s]
 90%|████████▉ | 332579/371472 [4:17:48<3:09:37,  3.42it/s]
 90%|████████▉ | 332580/371472 [4:17:48<3:03:39,  3.53it/s]
                                                           
{'loss': 2.4584, 'learning_rate': 1.9427804951625761e-07, 'epoch': 14.32}

 90%|████████▉ | 332580/371472 [4:17:48<3:03:39,  3.53it/s]
 90%|████████▉ | 332581/371472 [4:17:48<2:58:17,  3.64it/s]
 90%|████████▉ | 332582/371472 [4:17:48<2:59:18,  3.61it/s]
 90%|████████▉ | 332583/371472 [4:17:49<3:03:55,  3.52it/s]
 90%|████████▉ | 332584/371472 [4:17:49<2:59:37,  3.61it/s]
 90%|████████▉ | 332585/371472 [4:17:49<3:16:02,  3.31it/s]
 90%|████████▉ | 332586/371472 [4:17:50<3:14:58,  3.32it/s]
 90%|████████▉ | 332587/371472 [4:17:50<3:07:44,  3.45it/s]
 90%|████████▉ | 332588/371472 [4:17:50<2:58:33,  3.63it/s]
 90%|████████▉ | 332589/371472 [4:17:50<2:57:38,  3.65it/s]
 90%|████████▉ | 332590/371472 [4:17:51<2:56:24,  3.67it/s]
 90%|████████▉ | 332591/371472 [4:17:51<2:52:50,  3.75it/s]
 90%|████████▉ | 332592/371472 [4:17:51<3:00:34,  3.59it/s]
 90%|████████▉ | 332593/371472 [4:17:52<3:02:11,  3.56it/s]
 90%|████████▉ | 332594/371472 [4:17:52<2:59:37,  3.61it/s]
 90%|████████▉ | 332595/371472 [4:17:52<2:56:34,  3.67it/s]
 90%|████████▉ | 332596/371472 [4:17:52<2:57:56,  3.64it/s]
 90%|████████▉ | 332597/371472 [4:17:53<3:04:39,  3.51it/s]
 90%|████████▉ | 332598/371472 [4:17:53<2:59:29,  3.61it/s]
 90%|████████▉ | 332599/371472 [4:17:53<2:51:50,  3.77it/s]
 90%|████████▉ | 332600/371472 [4:17:53<2:50:53,  3.79it/s]
                                                           
{'loss': 2.6631, 'learning_rate': 1.9422956754077869e-07, 'epoch': 14.33}

 90%|████████▉ | 332600/371472 [4:17:53<2:50:53,  3.79it/s]
 90%|████████▉ | 332601/371472 [4:17:54<2:53:09,  3.74it/s]
 90%|████████▉ | 332602/371472 [4:17:54<2:51:08,  3.79it/s]
 90%|████████▉ | 332603/371472 [4:17:54<2:48:14,  3.85it/s]
 90%|████████▉ | 332604/371472 [4:17:55<2:54:45,  3.71it/s]
 90%|████████▉ | 332605/371472 [4:17:55<2:48:49,  3.84it/s]
 90%|████████▉ | 332606/371472 [4:17:55<2:48:15,  3.85it/s]
 90%|████████▉ | 332607/371472 [4:17:55<2:48:46,  3.84it/s]
 90%|████████▉ | 332608/371472 [4:17:56<3:08:24,  3.44it/s]
 90%|████████▉ | 332609/371472 [4:17:56<3:01:38,  3.57it/s]
 90%|████████▉ | 332610/371472 [4:17:56<3:13:06,  3.35it/s]
 90%|████████▉ | 332611/371472 [4:17:56<3:05:05,  3.50it/s]
 90%|████████▉ | 332612/371472 [4:17:57<3:21:51,  3.21it/s]
 90%|████████▉ | 332613/371472 [4:17:57<3:16:21,  3.30it/s]
 90%|████████▉ | 332614/371472 [4:17:57<3:23:09,  3.19it/s]
 90%|████████▉ | 332615/371472 [4:17:58<3:12:37,  3.36it/s]
 90%|████████▉ | 332616/371472 [4:17:58<3:07:10,  3.46it/s]
 90%|████████▉ | 332617/371472 [4:17:58<3:06:30,  3.47it/s]
 90%|████████▉ | 332618/371472 [4:17:59<3:01:43,  3.56it/s]
 90%|████████▉ | 332619/371472 [4:17:59<3:09:05,  3.42it/s]
 90%|████████▉ | 332620/371472 [4:17:59<3:01:00,  3.58it/s]
                                                           
{'loss': 2.6835, 'learning_rate': 1.941810855652998e-07, 'epoch': 14.33}

 90%|████████▉ | 332620/371472 [4:17:59<3:01:00,  3.58it/s]
 90%|████████▉ | 332621/371472 [4:17:59<3:02:43,  3.54it/s]
 90%|████████▉ | 332622/371472 [4:18:00<3:08:48,  3.43it/s]
 90%|████████▉ | 332623/371472 [4:18:00<2:59:08,  3.61it/s]
 90%|████████▉ | 332624/371472 [4:18:00<3:06:50,  3.47it/s]
 90%|████████▉ | 332625/371472 [4:18:01<3:06:52,  3.46it/s]
 90%|████████▉ | 332626/371472 [4:18:01<2:59:12,  3.61it/s]
 90%|████████▉ | 332627/371472 [4:18:01<3:08:03,  3.44it/s]
 90%|████████▉ | 332628/371472 [4:18:01<3:01:31,  3.57it/s]
 90%|████████▉ | 332629/371472 [4:18:02<2:59:22,  3.61it/s]
 90%|████████▉ | 332630/371472 [4:18:02<2:58:07,  3.63it/s]
 90%|████████▉ | 332631/371472 [4:18:02<2:56:32,  3.67it/s]
 90%|████████▉ | 332632/371472 [4:18:02<3:00:12,  3.59it/s]
 90%|████████▉ | 332633/371472 [4:18:03<3:09:46,  3.41it/s]
 90%|████████▉ | 332634/371472 [4:18:03<3:03:20,  3.53it/s]
 90%|████████▉ | 332635/371472 [4:18:04<3:34:14,  3.02it/s]
 90%|████████▉ | 332636/371472 [4:18:04<3:31:01,  3.07it/s]
 90%|████████▉ | 332637/371472 [4:18:04<3:32:26,  3.05it/s]
 90%|████████▉ | 332638/371472 [4:18:04<3:19:19,  3.25it/s]
 90%|████████▉ | 332639/371472 [4:18:05<3:14:51,  3.32it/s]
 90%|████████▉ | 332640/371472 [4:18:05<3:05:53,  3.48it/s]
                                                           
{'loss': 2.8009, 'learning_rate': 1.9413260358982088e-07, 'epoch': 14.33}

 90%|████████▉ | 332640/371472 [4:18:05<3:05:53,  3.48it/s]
 90%|████████▉ | 332641/371472 [4:18:05<3:13:19,  3.35it/s]
 90%|████████▉ | 332642/371472 [4:18:06<3:05:22,  3.49it/s]
 90%|████████▉ | 332643/371472 [4:18:06<3:10:05,  3.40it/s]
 90%|████████▉ | 332644/371472 [4:18:06<3:14:13,  3.33it/s]
 90%|████████▉ | 332645/371472 [4:18:06<3:13:26,  3.35it/s]
 90%|████████▉ | 332646/371472 [4:18:07<3:12:19,  3.36it/s]
 90%|████████▉ | 332647/371472 [4:18:07<3:08:53,  3.43it/s]
 90%|████████▉ | 332648/371472 [4:18:07<3:02:13,  3.55it/s]
 90%|████████▉ | 332649/371472 [4:18:08<3:03:17,  3.53it/s]
 90%|████████▉ | 332650/371472 [4:18:08<3:07:07,  3.46it/s]
 90%|████████▉ | 332651/371472 [4:18:08<2:59:52,  3.60it/s]
 90%|████████▉ | 332652/371472 [4:18:08<2:58:07,  3.63it/s]
 90%|████████▉ | 332653/371472 [4:18:09<2:51:30,  3.77it/s]
 90%|████████▉ | 332654/371472 [4:18:09<2:47:26,  3.86it/s]
 90%|████████▉ | 332655/371472 [4:18:09<2:54:31,  3.71it/s]
 90%|████████▉ | 332656/371472 [4:18:09<2:58:50,  3.62it/s]
 90%|████████▉ | 332657/371472 [4:18:10<2:51:06,  3.78it/s]
 90%|████████▉ | 332658/371472 [4:18:10<3:01:27,  3.57it/s]
 90%|████████▉ | 332659/371472 [4:18:10<3:04:26,  3.51it/s]
 90%|████████▉ | 332660/371472 [4:18:11<2:59:17,  3.61it/s]
                                                           
{'loss': 2.5667, 'learning_rate': 1.9408412161434206e-07, 'epoch': 14.33}

 90%|████████▉ | 332660/371472 [4:18:11<2:59:17,  3.61it/s]
 90%|████████▉ | 332661/371472 [4:18:11<2:57:02,  3.65it/s]
 90%|████████▉ | 332662/371472 [4:18:11<2:52:22,  3.75it/s]
 90%|████████▉ | 332663/371472 [4:18:11<3:11:54,  3.37it/s]
 90%|████████▉ | 332664/371472 [4:18:12<3:05:55,  3.48it/s]
 90%|████████▉ | 332665/371472 [4:18:12<2:57:30,  3.64it/s]
 90%|████████▉ | 332666/371472 [4:18:12<2:59:57,  3.59it/s]
 90%|████████▉ | 332667/371472 [4:18:13<3:00:51,  3.58it/s]
 90%|████████▉ | 332668/371472 [4:18:13<3:03:22,  3.53it/s]
 90%|████████▉ | 332669/371472 [4:18:13<3:18:55,  3.25it/s]
 90%|████████▉ | 332670/371472 [4:18:13<3:11:07,  3.38it/s]
 90%|████████▉ | 332671/371472 [4:18:14<3:11:32,  3.38it/s]
 90%|████████▉ | 332672/371472 [4:18:14<3:18:09,  3.26it/s]
 90%|████████▉ | 332673/371472 [4:18:14<3:09:14,  3.42it/s]
 90%|████████▉ | 332674/371472 [4:18:15<3:04:14,  3.51it/s]
 90%|████████▉ | 332675/371472 [4:18:15<3:04:52,  3.50it/s]
 90%|████████▉ | 332676/371472 [4:18:15<2:54:38,  3.70it/s]
 90%|████████▉ | 332677/371472 [4:18:16<3:15:31,  3.31it/s]
 90%|████████▉ | 332678/371472 [4:18:16<3:30:35,  3.07it/s]
 90%|████████▉ | 332679/371472 [4:18:16<3:30:57,  3.06it/s]
 90%|████████▉ | 332680/371472 [4:18:17<3:18:25,  3.26it/s]
                                                           
{'loss': 2.6475, 'learning_rate': 1.940356396388631e-07, 'epoch': 14.33}

 90%|████████▉ | 332680/371472 [4:18:17<3:18:25,  3.26it/s]
 90%|████████▉ | 332681/371472 [4:18:17<3:11:36,  3.37it/s]
 90%|████████▉ | 332682/371472 [4:18:17<3:07:03,  3.46it/s]
 90%|████████▉ | 332683/371472 [4:18:17<3:10:59,  3.38it/s]
 90%|████████▉ | 332684/371472 [4:18:18<3:05:51,  3.48it/s]
 90%|████████▉ | 332685/371472 [4:18:18<3:00:13,  3.59it/s]
 90%|████████▉ | 332686/371472 [4:18:18<2:56:35,  3.66it/s]
 90%|████████▉ | 332687/371472 [4:18:18<2:50:38,  3.79it/s]
 90%|████████▉ | 332688/371472 [4:18:19<2:52:16,  3.75it/s]
 90%|████████▉ | 332689/371472 [4:18:19<2:49:19,  3.82it/s]
 90%|████████▉ | 332690/371472 [4:18:19<2:47:55,  3.85it/s]
 90%|████████▉ | 332691/371472 [4:18:19<2:46:55,  3.87it/s]
 90%|████████▉ | 332692/371472 [4:18:20<2:51:26,  3.77it/s]
 90%|████████▉ | 332693/371472 [4:18:20<2:56:43,  3.66it/s]
 90%|████████▉ | 332694/371472 [4:18:20<2:54:48,  3.70it/s]
 90%|████████▉ | 332695/371472 [4:18:21<2:55:32,  3.68it/s]
 90%|████████▉ | 332696/371472 [4:18:21<2:49:51,  3.80it/s]
 90%|████████▉ | 332697/371472 [4:18:21<2:55:19,  3.69it/s]
 90%|████████▉ | 332698/371472 [4:18:21<2:54:29,  3.70it/s]
 90%|████████▉ | 332699/371472 [4:18:22<3:12:32,  3.36it/s]
 90%|████████▉ | 332700/371472 [4:18:22<3:08:47,  3.42it/s]
                                                           
{'loss': 2.6094, 'learning_rate': 1.9398715766338426e-07, 'epoch': 14.33}

 90%|████████▉ | 332700/371472 [4:18:22<3:08:47,  3.42it/s]
 90%|████████▉ | 332701/371472 [4:18:22<3:23:00,  3.18it/s]
 90%|████████▉ | 332702/371472 [4:18:23<3:09:06,  3.42it/s]
 90%|████████▉ | 332703/371472 [4:18:23<3:06:50,  3.46it/s]
 90%|████████▉ | 332704/371472 [4:18:23<3:01:56,  3.55it/s]
 90%|████████▉ | 332705/371472 [4:18:23<2:54:18,  3.71it/s]
 90%|████████▉ | 332706/371472 [4:18:24<2:50:30,  3.79it/s]
 90%|████████▉ | 332707/371472 [4:18:24<2:46:05,  3.89it/s]
 90%|████████▉ | 332708/371472 [4:18:24<2:47:10,  3.86it/s]
 90%|████████▉ | 332709/371472 [4:18:24<2:46:54,  3.87it/s]
 90%|████████▉ | 332710/371472 [4:18:25<3:01:45,  3.55it/s]
 90%|████████▉ | 332711/371472 [4:18:25<3:05:39,  3.48it/s]
 90%|████████▉ | 332712/371472 [4:18:25<3:07:48,  3.44it/s]
 90%|████████▉ | 332713/371472 [4:18:26<3:03:47,  3.51it/s]
 90%|████████▉ | 332714/371472 [4:18:26<3:22:54,  3.18it/s]
 90%|████████▉ | 332715/371472 [4:18:26<3:24:59,  3.15it/s]
 90%|████████▉ | 332716/371472 [4:18:27<3:20:20,  3.22it/s]
 90%|████████▉ | 332717/371472 [4:18:27<3:13:55,  3.33it/s]
 90%|████████▉ | 332718/371472 [4:18:27<3:12:26,  3.36it/s]
 90%|████████▉ | 332719/371472 [4:18:27<3:16:03,  3.29it/s]
 90%|████████▉ | 332720/371472 [4:18:28<3:04:04,  3.51it/s]
                                                           
{'loss': 2.4633, 'learning_rate': 1.9393867568790533e-07, 'epoch': 14.33}

 90%|████████▉ | 332720/371472 [4:18:28<3:04:04,  3.51it/s]
 90%|████████▉ | 332721/371472 [4:18:28<3:02:09,  3.55it/s]
 90%|████████▉ | 332722/371472 [4:18:28<3:19:17,  3.24it/s]
 90%|████████▉ | 332723/371472 [4:18:29<3:12:13,  3.36it/s]
 90%|████████▉ | 332724/371472 [4:18:29<3:06:08,  3.47it/s]
 90%|████████▉ | 332725/371472 [4:18:29<3:10:59,  3.38it/s]
 90%|████████▉ | 332726/371472 [4:18:30<3:11:09,  3.38it/s]
 90%|████████▉ | 332727/371472 [4:18:30<3:24:43,  3.15it/s]
 90%|████████▉ | 332728/371472 [4:18:30<3:35:40,  2.99it/s]
 90%|████████▉ | 332729/371472 [4:18:31<3:18:05,  3.26it/s]
 90%|████████▉ | 332730/371472 [4:18:31<3:15:34,  3.30it/s]
 90%|████████▉ | 332731/371472 [4:18:31<3:03:14,  3.52it/s]
 90%|████████▉ | 332732/371472 [4:18:31<3:10:14,  3.39it/s]
 90%|████████▉ | 332733/371472 [4:18:32<3:04:13,  3.50it/s]
 90%|████████▉ | 332734/371472 [4:18:32<3:32:11,  3.04it/s]
 90%|████████▉ | 332735/371472 [4:18:32<3:17:57,  3.26it/s]
 90%|████████▉ | 332736/371472 [4:18:33<3:17:08,  3.27it/s]
 90%|████████▉ | 332737/371472 [4:18:33<3:12:12,  3.36it/s]
 90%|████████▉ | 332738/371472 [4:18:33<3:04:47,  3.49it/s]
 90%|████████▉ | 332739/371472 [4:18:33<3:02:49,  3.53it/s]
 90%|████████▉ | 332740/371472 [4:18:34<3:21:36,  3.20it/s]
                                                           
{'loss': 2.57, 'learning_rate': 1.9389019371242648e-07, 'epoch': 14.33}

 90%|████████▉ | 332740/371472 [4:18:34<3:21:36,  3.20it/s]
 90%|████████▉ | 332741/371472 [4:18:34<3:15:10,  3.31it/s]
 90%|████████▉ | 332742/371472 [4:18:34<3:17:26,  3.27it/s]
 90%|████████▉ | 332743/371472 [4:18:35<3:07:39,  3.44it/s]
 90%|████████▉ | 332744/371472 [4:18:35<3:15:43,  3.30it/s]
 90%|████████▉ | 332745/371472 [4:18:35<3:10:37,  3.39it/s]
 90%|████████▉ | 332746/371472 [4:18:36<3:02:44,  3.53it/s]
 90%|████████▉ | 332747/371472 [4:18:36<3:00:11,  3.58it/s]
 90%|████████▉ | 332748/371472 [4:18:36<3:06:27,  3.46it/s]
 90%|████████▉ | 332749/371472 [4:18:36<3:04:57,  3.49it/s]
 90%|████████▉ | 332750/371472 [4:18:37<3:19:58,  3.23it/s]
 90%|████████▉ | 332751/371472 [4:18:37<3:20:13,  3.22it/s]
 90%|████████▉ | 332752/371472 [4:18:37<3:11:33,  3.37it/s]
 90%|████████▉ | 332753/371472 [4:18:38<3:07:10,  3.45it/s]
 90%|████████▉ | 332754/371472 [4:18:38<2:59:47,  3.59it/s]
 90%|████████▉ | 332755/371472 [4:18:38<2:56:12,  3.66it/s]
 90%|████████▉ | 332756/371472 [4:18:38<2:49:58,  3.80it/s]
 90%|████████▉ | 332757/371472 [4:18:39<2:45:33,  3.90it/s]
 90%|████████▉ | 332758/371472 [4:18:39<2:49:24,  3.81it/s]
 90%|████████▉ | 332759/371472 [4:18:39<2:51:54,  3.75it/s]
 90%|████████▉ | 332760/371472 [4:18:39<2:53:11,  3.73it/s]
                                                           
{'loss': 2.5228, 'learning_rate': 1.9384171173694752e-07, 'epoch': 14.33}

 90%|████████▉ | 332760/371472 [4:18:39<2:53:11,  3.73it/s]
 90%|████████▉ | 332761/371472 [4:18:40<3:02:56,  3.53it/s]
 90%|████████▉ | 332762/371472 [4:18:40<2:57:35,  3.63it/s]
 90%|████████▉ | 332763/371472 [4:18:40<2:55:26,  3.68it/s]
 90%|████████▉ | 332764/371472 [4:18:41<2:56:30,  3.66it/s]
 90%|████████▉ | 332765/371472 [4:18:41<2:58:20,  3.62it/s]
 90%|████████▉ | 332766/371472 [4:18:41<2:55:46,  3.67it/s]
 90%|████████▉ | 332767/371472 [4:18:41<2:54:16,  3.70it/s]
 90%|████████▉ | 332768/371472 [4:18:42<2:53:04,  3.73it/s]
 90%|████████▉ | 332769/371472 [4:18:42<2:56:54,  3.65it/s]
 90%|████████▉ | 332770/371472 [4:18:42<2:54:14,  3.70it/s]
 90%|████████▉ | 332771/371472 [4:18:42<3:01:57,  3.54it/s]
 90%|████████▉ | 332772/371472 [4:18:43<2:58:49,  3.61it/s]
 90%|████████▉ | 332773/371472 [4:18:43<2:56:53,  3.65it/s]
 90%|████████▉ | 332774/371472 [4:18:43<2:59:45,  3.59it/s]
 90%|████████▉ | 332775/371472 [4:18:44<2:53:46,  3.71it/s]
 90%|████████▉ | 332776/371472 [4:18:44<2:55:57,  3.67it/s]
 90%|████████▉ | 332777/371472 [4:18:44<3:15:04,  3.31it/s]
 90%|████████▉ | 332778/371472 [4:18:44<3:07:52,  3.43it/s]
 90%|████████▉ | 332779/371472 [4:18:45<3:01:59,  3.54it/s]
 90%|████████▉ | 332780/371472 [4:18:45<3:00:24,  3.57it/s]
                                                           
{'loss': 2.5863, 'learning_rate': 1.937932297614687e-07, 'epoch': 14.33}

 90%|████████▉ | 332780/371472 [4:18:45<3:00:24,  3.57it/s]
 90%|████████▉ | 332781/371472 [4:18:45<2:57:51,  3.63it/s]
 90%|████████▉ | 332782/371472 [4:18:46<2:57:07,  3.64it/s]
 90%|████████▉ | 332783/371472 [4:18:46<3:03:17,  3.52it/s]
 90%|████████▉ | 332784/371472 [4:18:46<2:59:46,  3.59it/s]
 90%|████████▉ | 332785/371472 [4:18:46<2:53:27,  3.72it/s]
 90%|████████▉ | 332786/371472 [4:18:47<2:48:33,  3.83it/s]
 90%|████████▉ | 332787/371472 [4:18:47<2:53:08,  3.72it/s]
 90%|████████▉ | 332788/371472 [4:18:47<2:57:02,  3.64it/s]
 90%|████████▉ | 332789/371472 [4:18:47<2:51:51,  3.75it/s]
 90%|████████▉ | 332790/371472 [4:18:48<2:49:56,  3.79it/s]
 90%|████████▉ | 332791/371472 [4:18:48<3:00:46,  3.57it/s]
 90%|████████▉ | 332792/371472 [4:18:48<2:58:54,  3.60it/s]
 90%|████████▉ | 332793/371472 [4:18:49<2:58:36,  3.61it/s]
 90%|████████▉ | 332794/371472 [4:18:49<3:04:12,  3.50it/s]
 90%|████████▉ | 332795/371472 [4:18:49<3:06:28,  3.46it/s]
 90%|████████▉ | 332796/371472 [4:18:49<2:57:29,  3.63it/s]
 90%|████████▉ | 332797/371472 [4:18:50<3:02:31,  3.53it/s]
 90%|████████▉ | 332798/371472 [4:18:50<2:54:48,  3.69it/s]
 90%|████████▉ | 332799/371472 [4:18:50<3:05:07,  3.48it/s]
 90%|████████▉ | 332800/371472 [4:18:51<3:10:52,  3.38it/s]
                                                           
{'loss': 2.6231, 'learning_rate': 1.9374474778598972e-07, 'epoch': 14.33}

 90%|████████▉ | 332800/371472 [4:18:51<3:10:52,  3.38it/s]
 90%|████████▉ | 332801/371472 [4:18:51<3:13:54,  3.32it/s]
 90%|████████▉ | 332802/371472 [4:18:51<3:04:50,  3.49it/s]
 90%|████████▉ | 332803/371472 [4:18:51<3:02:54,  3.52it/s]
 90%|████████▉ | 332804/371472 [4:18:52<2:57:56,  3.62it/s]
 90%|████████▉ | 332805/371472 [4:18:52<2:58:04,  3.62it/s]
 90%|████████▉ | 332806/371472 [4:18:52<2:53:22,  3.72it/s]
 90%|████████▉ | 332807/371472 [4:18:52<2:57:58,  3.62it/s]
 90%|████████▉ | 332808/371472 [4:18:53<2:57:51,  3.62it/s]
 90%|████████▉ | 332809/371472 [4:18:53<3:03:44,  3.51it/s]
 90%|████████▉ | 332810/371472 [4:18:53<3:01:01,  3.56it/s]
 90%|████████▉ | 332811/371472 [4:18:54<2:56:54,  3.64it/s]
 90%|████████▉ | 332812/371472 [4:18:54<2:54:04,  3.70it/s]
 90%|████████▉ | 332813/371472 [4:18:54<2:53:34,  3.71it/s]
 90%|████████▉ | 332814/371472 [4:18:54<2:54:44,  3.69it/s]
 90%|████████▉ | 332815/371472 [4:18:55<2:51:51,  3.75it/s]
 90%|████████▉ | 332816/371472 [4:18:55<2:55:15,  3.68it/s]
 90%|████████▉ | 332817/371472 [4:18:55<2:53:18,  3.72it/s]
 90%|████████▉ | 332818/371472 [4:18:55<2:51:44,  3.75it/s]
 90%|████████▉ | 332819/371472 [4:18:56<2:52:39,  3.73it/s]
 90%|████████▉ | 332820/371472 [4:18:56<2:51:32,  3.76it/s]
                                                           
{'loss': 2.6002, 'learning_rate': 1.936962658105109e-07, 'epoch': 14.34}

 90%|████████▉ | 332820/371472 [4:18:56<2:51:32,  3.76it/s]
 90%|████████▉ | 332821/371472 [4:18:56<3:02:51,  3.52it/s]
 90%|████████▉ | 332822/371472 [4:18:57<3:18:38,  3.24it/s]
 90%|████████▉ | 332823/371472 [4:18:57<3:13:46,  3.32it/s]
 90%|████████▉ | 332824/371472 [4:18:57<3:06:12,  3.46it/s]
 90%|████████▉ | 332825/371472 [4:18:58<3:08:59,  3.41it/s]
 90%|████████▉ | 332826/371472 [4:18:58<3:13:00,  3.34it/s]
 90%|████████▉ | 332827/371472 [4:18:58<3:10:04,  3.39it/s]
 90%|████████▉ | 332828/371472 [4:18:58<3:08:54,  3.41it/s]
 90%|████████▉ | 332829/371472 [4:18:59<3:25:36,  3.13it/s]
 90%|████████▉ | 332830/371472 [4:18:59<3:13:45,  3.32it/s]
 90%|████████▉ | 332831/371472 [4:18:59<3:10:11,  3.39it/s]
 90%|████████▉ | 332832/371472 [4:19:00<3:07:40,  3.43it/s]
 90%|████████▉ | 332833/371472 [4:19:00<3:02:27,  3.53it/s]
 90%|████████▉ | 332834/371472 [4:19:00<2:58:17,  3.61it/s]
 90%|████████▉ | 332835/371472 [4:19:00<2:53:16,  3.72it/s]
 90%|████████▉ | 332836/371472 [4:19:01<3:03:15,  3.51it/s]
 90%|████████▉ | 332837/371472 [4:19:01<3:11:32,  3.36it/s]
 90%|████████▉ | 332838/371472 [4:19:01<3:06:56,  3.44it/s]
 90%|████████▉ | 332839/371472 [4:19:02<3:09:39,  3.39it/s]
 90%|████████▉ | 332840/371472 [4:19:02<3:01:13,  3.55it/s]
                                                           
{'loss': 2.5584, 'learning_rate': 1.9364778383503197e-07, 'epoch': 14.34}

 90%|████████▉ | 332840/371472 [4:19:02<3:01:13,  3.55it/s]
 90%|████████▉ | 332841/371472 [4:19:02<2:58:17,  3.61it/s]
 90%|████████▉ | 332842/371472 [4:19:03<3:14:43,  3.31it/s]
 90%|████████▉ | 332843/371472 [4:19:03<3:15:42,  3.29it/s]
 90%|████████▉ | 332844/371472 [4:19:03<3:08:10,  3.42it/s]
 90%|████████▉ | 332845/371472 [4:19:03<3:04:57,  3.48it/s]
 90%|████████▉ | 332846/371472 [4:19:04<3:05:19,  3.47it/s]
 90%|████████▉ | 332847/371472 [4:19:04<3:15:34,  3.29it/s]
 90%|████████▉ | 332848/371472 [4:19:04<3:06:54,  3.44it/s]
 90%|████████▉ | 332849/371472 [4:19:05<3:01:00,  3.56it/s]
 90%|████████▉ | 332850/371472 [4:19:05<2:59:40,  3.58it/s]
 90%|████████▉ | 332851/371472 [4:19:05<3:08:26,  3.42it/s]
 90%|████████▉ | 332852/371472 [4:19:05<3:19:39,  3.22it/s]
 90%|████████▉ | 332853/371472 [4:19:06<3:12:43,  3.34it/s]
 90%|████████▉ | 332854/371472 [4:19:06<3:09:32,  3.40it/s]
 90%|████████▉ | 332855/371472 [4:19:06<3:15:06,  3.30it/s]
 90%|████████▉ | 332856/371472 [4:19:07<3:10:00,  3.39it/s]
 90%|████████▉ | 332857/371472 [4:19:07<4:01:12,  2.67it/s]
 90%|████████▉ | 332858/371472 [4:19:07<3:42:01,  2.90it/s]
 90%|████████▉ | 332859/371472 [4:19:08<3:49:23,  2.81it/s]
 90%|████████▉ | 332860/371472 [4:19:08<3:46:58,  2.84it/s]
                                                           
{'loss': 2.4926, 'learning_rate': 1.9359930185955312e-07, 'epoch': 14.34}

 90%|████████▉ | 332860/371472 [4:19:08<3:46:58,  2.84it/s]
 90%|████████▉ | 332861/371472 [4:19:08<3:39:49,  2.93it/s]
 90%|████████▉ | 332862/371472 [4:19:09<3:35:22,  2.99it/s]
 90%|████████▉ | 332863/371472 [4:19:09<3:28:16,  3.09it/s]
 90%|████████▉ | 332864/371472 [4:19:09<3:18:48,  3.24it/s]
 90%|████████▉ | 332865/371472 [4:19:10<3:33:07,  3.02it/s]
 90%|████████▉ | 332866/371472 [4:19:10<3:21:35,  3.19it/s]
 90%|████████▉ | 332867/371472 [4:19:10<3:12:31,  3.34it/s]
 90%|████████▉ | 332868/371472 [4:19:11<3:04:27,  3.49it/s]
 90%|████████▉ | 332869/371472 [4:19:11<3:00:13,  3.57it/s]
 90%|████████▉ | 332870/371472 [4:19:11<3:06:01,  3.46it/s]
 90%|████████▉ | 332871/371472 [4:19:11<3:01:57,  3.54it/s]
 90%|████████▉ | 332872/371472 [4:19:12<3:06:10,  3.46it/s]
 90%|████████▉ | 332873/371472 [4:19:12<3:04:15,  3.49it/s]
 90%|████████▉ | 332874/371472 [4:19:12<3:04:00,  3.50it/s]
 90%|████████▉ | 332875/371472 [4:19:13<2:59:36,  3.58it/s]
 90%|████████▉ | 332876/371472 [4:19:13<2:53:59,  3.70it/s]
 90%|████████▉ | 332877/371472 [4:19:13<2:53:18,  3.71it/s]
 90%|████████▉ | 332878/371472 [4:19:13<2:50:21,  3.78it/s]
 90%|████████▉ | 332879/371472 [4:19:14<2:52:11,  3.74it/s]
 90%|████████▉ | 332880/371472 [4:19:14<3:01:17,  3.55it/s]
                                                           
{'loss': 2.595, 'learning_rate': 1.9355081988407416e-07, 'epoch': 14.34}

 90%|████████▉ | 332880/371472 [4:19:14<3:01:17,  3.55it/s]
 90%|████████▉ | 332881/371472 [4:19:14<2:57:05,  3.63it/s]
 90%|████████▉ | 332882/371472 [4:19:14<2:50:21,  3.78it/s]
 90%|████████▉ | 332883/371472 [4:19:15<2:55:17,  3.67it/s]
 90%|████████▉ | 332884/371472 [4:19:15<2:50:08,  3.78it/s]
 90%|████████▉ | 332885/371472 [4:19:15<2:52:12,  3.73it/s]
 90%|████████▉ | 332886/371472 [4:19:15<2:48:16,  3.82it/s]
 90%|████████▉ | 332887/371472 [4:19:16<2:48:03,  3.83it/s]
 90%|████████▉ | 332888/371472 [4:19:16<2:54:08,  3.69it/s]
 90%|████████▉ | 332889/371472 [4:19:16<2:58:01,  3.61it/s]
 90%|████████▉ | 332890/371472 [4:19:17<2:56:06,  3.65it/s]
 90%|████████▉ | 332891/371472 [4:19:17<2:54:08,  3.69it/s]
 90%|████████▉ | 332892/371472 [4:19:17<2:59:09,  3.59it/s]
 90%|████████▉ | 332893/371472 [4:19:17<3:10:59,  3.37it/s]
 90%|████████▉ | 332894/371472 [4:19:18<3:03:47,  3.50it/s]
 90%|████████▉ | 332895/371472 [4:19:18<3:00:29,  3.56it/s]
 90%|████████▉ | 332896/371472 [4:19:18<2:58:11,  3.61it/s]
 90%|████████▉ | 332897/371472 [4:19:19<3:01:20,  3.55it/s]
 90%|████████▉ | 332898/371472 [4:19:19<3:05:34,  3.46it/s]
 90%|████████▉ | 332899/371472 [4:19:19<3:03:21,  3.51it/s]
 90%|████████▉ | 332900/371472 [4:19:19<3:02:13,  3.53it/s]
                                                           
{'loss': 2.5737, 'learning_rate': 1.9350233790859534e-07, 'epoch': 14.34}

 90%|████████▉ | 332900/371472 [4:19:19<3:02:13,  3.53it/s]
 90%|████████▉ | 332901/371472 [4:19:20<2:57:12,  3.63it/s]
 90%|████████▉ | 332902/371472 [4:19:20<2:53:54,  3.70it/s]
 90%|████████▉ | 332903/371472 [4:19:20<2:56:49,  3.64it/s]
 90%|████████▉ | 332904/371472 [4:19:20<2:50:50,  3.76it/s]
 90%|████████▉ | 332905/371472 [4:19:21<2:54:26,  3.68it/s]
 90%|████████▉ | 332906/371472 [4:19:21<2:55:45,  3.66it/s]
 90%|████████▉ | 332907/371472 [4:19:21<3:08:17,  3.41it/s]
 90%|████████▉ | 332908/371472 [4:19:22<3:02:27,  3.52it/s]
 90%|████████▉ | 332909/371472 [4:19:22<3:04:18,  3.49it/s]
 90%|████████▉ | 332910/371472 [4:19:22<3:05:35,  3.46it/s]
 90%|████████▉ | 332911/371472 [4:19:22<2:58:20,  3.60it/s]
 90%|████████▉ | 332912/371472 [4:19:23<2:56:33,  3.64it/s]
 90%|████████▉ | 332913/371472 [4:19:23<2:53:42,  3.70it/s]
 90%|████████▉ | 332914/371472 [4:19:23<3:12:00,  3.35it/s]
 90%|████████▉ | 332915/371472 [4:19:24<3:04:29,  3.48it/s]
 90%|████████▉ | 332916/371472 [4:19:24<3:02:15,  3.53it/s]
 90%|████████▉ | 332917/371472 [4:19:24<3:06:52,  3.44it/s]
 90%|████████▉ | 332918/371472 [4:19:25<3:08:53,  3.40it/s]
 90%|████████▉ | 332919/371472 [4:19:25<3:02:29,  3.52it/s]
 90%|████████▉ | 332920/371472 [4:19:25<2:57:00,  3.63it/s]
                                                           
{'loss': 2.5501, 'learning_rate': 1.934538559331164e-07, 'epoch': 14.34}

 90%|████████▉ | 332920/371472 [4:19:25<2:57:00,  3.63it/s]
 90%|████████▉ | 332921/371472 [4:19:25<2:53:52,  3.70it/s]
 90%|████████▉ | 332922/371472 [4:19:26<2:51:40,  3.74it/s]
 90%|████████▉ | 332923/371472 [4:19:26<2:51:41,  3.74it/s]
 90%|████████▉ | 332924/371472 [4:19:26<3:00:43,  3.55it/s]
 90%|████████▉ | 332925/371472 [4:19:26<2:58:33,  3.60it/s]
 90%|████████▉ | 332926/371472 [4:19:27<2:58:22,  3.60it/s]
 90%|████████▉ | 332927/371472 [4:19:27<2:57:06,  3.63it/s]
 90%|████████▉ | 332928/371472 [4:19:27<2:58:46,  3.59it/s]
 90%|████████▉ | 332929/371472 [4:19:28<2:57:25,  3.62it/s]
 90%|████████▉ | 332930/371472 [4:19:28<3:07:33,  3.42it/s]
 90%|████████▉ | 332931/371472 [4:19:28<2:59:29,  3.58it/s]
 90%|████████▉ | 332932/371472 [4:19:28<2:59:54,  3.57it/s]
 90%|████████▉ | 332933/371472 [4:19:29<3:09:05,  3.40it/s]
 90%|████████▉ | 332934/371472 [4:19:29<3:03:06,  3.51it/s]
 90%|████████▉ | 332935/371472 [4:19:29<3:10:39,  3.37it/s]
 90%|████████▉ | 332936/371472 [4:19:30<3:18:39,  3.23it/s]
 90%|████████▉ | 332937/371472 [4:19:30<3:10:25,  3.37it/s]
 90%|████████▉ | 332938/371472 [4:19:30<3:07:02,  3.43it/s]
 90%|████████▉ | 332939/371472 [4:19:30<3:07:22,  3.43it/s]
 90%|████████▉ | 332940/371472 [4:19:31<3:01:35,  3.54it/s]
                                                           
{'loss': 2.7005, 'learning_rate': 1.9340537395763754e-07, 'epoch': 14.34}

 90%|████████▉ | 332940/371472 [4:19:31<3:01:35,  3.54it/s]
 90%|████████▉ | 332941/371472 [4:19:31<3:05:02,  3.47it/s]
 90%|████████▉ | 332942/371472 [4:19:31<3:05:16,  3.47it/s]
 90%|████████▉ | 332943/371472 [4:19:32<3:13:41,  3.32it/s]
 90%|████████▉ | 332944/371472 [4:19:32<3:05:40,  3.46it/s]
 90%|████████▉ | 332945/371472 [4:19:32<3:01:40,  3.53it/s]
 90%|████████▉ | 332946/371472 [4:19:32<2:57:16,  3.62it/s]
 90%|████████▉ | 332947/371472 [4:19:33<2:59:12,  3.58it/s]
 90%|████████▉ | 332948/371472 [4:19:33<3:01:52,  3.53it/s]
 90%|████████▉ | 332949/371472 [4:19:33<3:01:35,  3.54it/s]
 90%|████████▉ | 332950/371472 [4:19:34<3:09:04,  3.40it/s]
 90%|████████▉ | 332951/371472 [4:19:34<3:09:32,  3.39it/s]
 90%|████████▉ | 332952/371472 [4:19:34<3:16:34,  3.27it/s]
 90%|████████▉ | 332953/371472 [4:19:35<3:09:47,  3.38it/s]
 90%|████████▉ | 332954/371472 [4:19:35<3:17:21,  3.25it/s]
 90%|████████▉ | 332955/371472 [4:19:35<3:13:32,  3.32it/s]
 90%|████████▉ | 332956/371472 [4:19:35<3:07:57,  3.42it/s]
 90%|████████▉ | 332957/371472 [4:19:36<3:02:45,  3.51it/s]
 90%|████████▉ | 332958/371472 [4:19:36<2:58:45,  3.59it/s]
 90%|████████▉ | 332959/371472 [4:19:36<3:02:16,  3.52it/s]
 90%|████████▉ | 332960/371472 [4:19:37<3:02:25,  3.52it/s]
                                                           
{'loss': 2.6157, 'learning_rate': 1.933568919821586e-07, 'epoch': 14.34}

 90%|████████▉ | 332960/371472 [4:19:37<3:02:25,  3.52it/s]
 90%|████████▉ | 332961/371472 [4:19:37<3:13:55,  3.31it/s]
 90%|████████▉ | 332962/371472 [4:19:37<3:06:18,  3.44it/s]
 90%|████████▉ | 332963/371472 [4:19:37<3:09:38,  3.38it/s]
 90%|████████▉ | 332964/371472 [4:19:38<3:15:49,  3.28it/s]
 90%|████████▉ | 332965/371472 [4:19:38<3:11:38,  3.35it/s]
 90%|████████▉ | 332966/371472 [4:19:38<3:08:37,  3.40it/s]
 90%|████████▉ | 332967/371472 [4:19:39<3:06:47,  3.44it/s]
 90%|████████▉ | 332968/371472 [4:19:39<3:11:26,  3.35it/s]
 90%|████████▉ | 332969/371472 [4:19:39<3:10:36,  3.37it/s]
 90%|████████▉ | 332970/371472 [4:19:40<3:18:01,  3.24it/s]
 90%|████████▉ | 332971/371472 [4:19:40<3:26:44,  3.10it/s]
 90%|████████▉ | 332972/371472 [4:19:40<3:27:27,  3.09it/s]
 90%|████████▉ | 332973/371472 [4:19:40<3:16:40,  3.26it/s]
 90%|████████▉ | 332974/371472 [4:19:41<3:26:28,  3.11it/s]
 90%|████████▉ | 332975/371472 [4:19:41<3:26:25,  3.11it/s]
 90%|████████▉ | 332976/371472 [4:19:41<3:15:24,  3.28it/s]
 90%|████████▉ | 332977/371472 [4:19:42<3:13:45,  3.31it/s]
 90%|████████▉ | 332978/371472 [4:19:42<3:15:08,  3.29it/s]
 90%|████████▉ | 332979/371472 [4:19:42<3:05:17,  3.46it/s]
 90%|████████▉ | 332980/371472 [4:19:43<3:04:07,  3.48it/s]
                                                           
{'loss': 2.5972, 'learning_rate': 1.9330841000667979e-07, 'epoch': 14.34}

 90%|████████▉ | 332980/371472 [4:19:43<3:04:07,  3.48it/s]
 90%|████████▉ | 332981/371472 [4:19:43<2:59:41,  3.57it/s]
 90%|████████▉ | 332982/371472 [4:19:43<2:56:03,  3.64it/s]
 90%|████████▉ | 332983/371472 [4:19:43<2:50:08,  3.77it/s]
 90%|████████▉ | 332984/371472 [4:19:44<2:52:49,  3.71it/s]
 90%|████████▉ | 332985/371472 [4:19:44<2:57:25,  3.62it/s]
 90%|████████▉ | 332986/371472 [4:19:44<2:55:56,  3.65it/s]
 90%|████████▉ | 332987/371472 [4:19:44<2:56:38,  3.63it/s]
 90%|████████▉ | 332988/371472 [4:19:45<2:54:12,  3.68it/s]
 90%|████████▉ | 332989/371472 [4:19:45<2:48:56,  3.80it/s]
 90%|████████▉ | 332990/371472 [4:19:45<2:56:38,  3.63it/s]
 90%|████████▉ | 332991/371472 [4:19:46<2:57:26,  3.61it/s]
 90%|████████▉ | 332992/371472 [4:19:46<3:02:57,  3.51it/s]
 90%|████████▉ | 332993/371472 [4:19:46<3:05:00,  3.47it/s]
 90%|████████▉ | 332994/371472 [4:19:46<3:02:14,  3.52it/s]
 90%|████████▉ | 332995/371472 [4:19:47<2:56:14,  3.64it/s]
 90%|████████▉ | 332996/371472 [4:19:47<3:05:17,  3.46it/s]
 90%|████████▉ | 332997/371472 [4:19:47<3:04:45,  3.47it/s]
 90%|████████▉ | 332998/371472 [4:19:48<3:05:56,  3.45it/s]
 90%|████████▉ | 332999/371472 [4:19:48<3:06:17,  3.44it/s]
 90%|████████▉ | 333000/371472 [4:19:48<3:02:23,  3.52it/s]
                                                           
{'loss': 2.6967, 'learning_rate': 1.9325992803120083e-07, 'epoch': 14.34}

 90%|████████▉ | 333000/371472 [4:19:48<3:02:23,  3.52it/s]
 90%|████████▉ | 333001/371472 [4:19:48<3:05:40,  3.45it/s]
 90%|████████▉ | 333002/371472 [4:19:49<3:15:05,  3.29it/s]
 90%|████████▉ | 333003/371472 [4:19:49<3:19:08,  3.22it/s]
 90%|████████▉ | 333004/371472 [4:19:49<3:15:21,  3.28it/s]
 90%|████████▉ | 333005/371472 [4:19:50<3:11:47,  3.34it/s]
 90%|████████▉ | 333006/371472 [4:19:50<3:10:25,  3.37it/s]
 90%|████████▉ | 333007/371472 [4:19:50<3:04:40,  3.47it/s]
 90%|████████▉ | 333008/371472 [4:19:51<3:03:23,  3.50it/s]
 90%|████████▉ | 333009/371472 [4:19:51<2:56:09,  3.64it/s]
 90%|████████▉ | 333010/371472 [4:19:51<2:51:40,  3.73it/s]
 90%|████████▉ | 333011/371472 [4:19:51<2:49:56,  3.77it/s]
 90%|████████▉ | 333012/371472 [4:19:52<2:56:33,  3.63it/s]
 90%|████████▉ | 333013/371472 [4:19:52<2:54:08,  3.68it/s]
 90%|████████▉ | 333014/371472 [4:19:52<2:57:44,  3.61it/s]
 90%|████████▉ | 333015/371472 [4:19:52<2:57:48,  3.60it/s]
 90%|████████▉ | 333016/371472 [4:19:53<2:59:34,  3.57it/s]
 90%|████████▉ | 333017/371472 [4:19:53<3:03:59,  3.48it/s]
 90%|████████▉ | 333018/371472 [4:19:53<3:02:14,  3.52it/s]
 90%|████████▉ | 333019/371472 [4:19:54<2:59:35,  3.57it/s]
 90%|████████▉ | 333020/371472 [4:19:54<2:59:32,  3.57it/s]
                                                           
{'loss': 2.7307, 'learning_rate': 1.9321144605572198e-07, 'epoch': 14.34}

 90%|████████▉ | 333020/371472 [4:19:54<2:59:32,  3.57it/s]
 90%|████████▉ | 333021/371472 [4:19:54<3:02:40,  3.51it/s]
 90%|████████▉ | 333022/371472 [4:19:54<3:03:22,  3.49it/s]
 90%|████████▉ | 333023/371472 [4:19:55<2:59:48,  3.56it/s]
 90%|████████▉ | 333024/371472 [4:19:55<3:01:15,  3.54it/s]
 90%|████████▉ | 333025/371472 [4:19:55<3:03:58,  3.48it/s]
 90%|████████▉ | 333026/371472 [4:19:56<3:03:05,  3.50it/s]
 90%|████████▉ | 333027/371472 [4:19:56<3:03:34,  3.49it/s]
 90%|████████▉ | 333028/371472 [4:19:56<3:00:59,  3.54it/s]
 90%|████████▉ | 333029/371472 [4:19:56<3:03:20,  3.49it/s]
 90%|████████▉ | 333030/371472 [4:19:57<3:01:42,  3.53it/s]
 90%|████████▉ | 333031/371472 [4:19:57<3:04:16,  3.48it/s]
 90%|████████▉ | 333032/371472 [4:19:57<3:02:55,  3.50it/s]
 90%|████████▉ | 333033/371472 [4:19:58<3:04:42,  3.47it/s]
 90%|████████▉ | 333034/371472 [4:19:58<3:00:38,  3.55it/s]
 90%|████████▉ | 333035/371472 [4:19:58<3:03:36,  3.49it/s]
 90%|████████▉ | 333036/371472 [4:19:58<2:56:07,  3.64it/s]
 90%|████████▉ | 333037/371472 [4:19:59<2:54:34,  3.67it/s]
 90%|████████▉ | 333038/371472 [4:19:59<2:59:57,  3.56it/s]
 90%|████████▉ | 333039/371472 [4:19:59<2:58:55,  3.58it/s]
 90%|████████▉ | 333040/371472 [4:19:59<2:56:37,  3.63it/s]
                                                           
{'loss': 2.6198, 'learning_rate': 1.9316296408024305e-07, 'epoch': 14.34}

 90%|████████▉ | 333040/371472 [4:19:59<2:56:37,  3.63it/s]
 90%|████████▉ | 333041/371472 [4:20:00<3:01:23,  3.53it/s]
 90%|████████▉ | 333042/371472 [4:20:00<2:56:16,  3.63it/s]
 90%|████████▉ | 333043/371472 [4:20:00<2:55:28,  3.65it/s]
 90%|████████▉ | 333044/371472 [4:20:01<2:52:13,  3.72it/s]
 90%|████████▉ | 333045/371472 [4:20:01<2:58:06,  3.60it/s]
 90%|████████▉ | 333046/371472 [4:20:01<2:57:02,  3.62it/s]
 90%|████████▉ | 333047/371472 [4:20:01<2:56:40,  3.62it/s]
 90%|████████▉ | 333048/371472 [4:20:02<3:08:11,  3.40it/s]
 90%|████████▉ | 333049/371472 [4:20:02<3:03:32,  3.49it/s]
 90%|████████▉ | 333050/371472 [4:20:02<3:02:01,  3.52it/s]
 90%|████████▉ | 333051/371472 [4:20:03<2:56:17,  3.63it/s]
 90%|████████▉ | 333052/371472 [4:20:03<2:53:33,  3.69it/s]
 90%|████████▉ | 333053/371472 [4:20:03<2:50:47,  3.75it/s]
 90%|████████▉ | 333054/371472 [4:20:03<2:53:36,  3.69it/s]
 90%|████████▉ | 333055/371472 [4:20:04<2:51:39,  3.73it/s]
 90%|████████▉ | 333056/371472 [4:20:04<2:54:36,  3.67it/s]
 90%|████████▉ | 333057/371472 [4:20:04<2:55:08,  3.66it/s]
 90%|████████▉ | 333058/371472 [4:20:04<2:55:13,  3.65it/s]
 90%|████████▉ | 333059/371472 [4:20:05<2:51:18,  3.74it/s]
 90%|████████▉ | 333060/371472 [4:20:05<2:58:45,  3.58it/s]
                                                           
{'loss': 2.4553, 'learning_rate': 1.931144821047642e-07, 'epoch': 14.35}

 90%|████████▉ | 333060/371472 [4:20:05<2:58:45,  3.58it/s]
 90%|████████▉ | 333061/371472 [4:20:05<2:58:05,  3.59it/s]
 90%|████████▉ | 333062/371472 [4:20:06<2:59:50,  3.56it/s]
 90%|████████▉ | 333063/371472 [4:20:06<3:04:28,  3.47it/s]
 90%|████████▉ | 333064/371472 [4:20:06<3:05:22,  3.45it/s]
 90%|████████▉ | 333065/371472 [4:20:06<3:02:18,  3.51it/s]
 90%|████████▉ | 333066/371472 [4:20:07<2:53:54,  3.68it/s]
 90%|████████▉ | 333067/371472 [4:20:07<2:51:07,  3.74it/s]
 90%|████████▉ | 333068/371472 [4:20:07<2:51:03,  3.74it/s]
 90%|████████▉ | 333069/371472 [4:20:07<2:52:21,  3.71it/s]
 90%|████████▉ | 333070/371472 [4:20:08<2:59:26,  3.57it/s]
 90%|████████▉ | 333071/371472 [4:20:08<3:02:23,  3.51it/s]
 90%|████████▉ | 333072/371472 [4:20:08<3:06:28,  3.43it/s]
 90%|████████▉ | 333073/371472 [4:20:09<3:03:40,  3.48it/s]
 90%|████████▉ | 333074/371472 [4:20:09<3:04:56,  3.46it/s]
 90%|████████▉ | 333075/371472 [4:20:09<3:11:07,  3.35it/s]
 90%|████████▉ | 333076/371472 [4:20:10<3:05:12,  3.46it/s]
 90%|████████▉ | 333077/371472 [4:20:10<3:11:32,  3.34it/s]
 90%|████████▉ | 333078/371472 [4:20:10<3:07:19,  3.42it/s]
 90%|████████▉ | 333079/371472 [4:20:10<3:05:56,  3.44it/s]
 90%|████████▉ | 333080/371472 [4:20:11<3:00:43,  3.54it/s]
                                                           
{'loss': 2.6497, 'learning_rate': 1.9306600012928525e-07, 'epoch': 14.35}

 90%|████████▉ | 333080/371472 [4:20:11<3:00:43,  3.54it/s]
 90%|████████▉ | 333081/371472 [4:20:11<3:05:51,  3.44it/s]
 90%|████████▉ | 333082/371472 [4:20:11<3:02:06,  3.51it/s]
 90%|████████▉ | 333083/371472 [4:20:12<3:02:02,  3.51it/s]
 90%|████████▉ | 333084/371472 [4:20:12<2:58:26,  3.59it/s]
 90%|████████▉ | 333085/371472 [4:20:12<2:55:25,  3.65it/s]
 90%|████████▉ | 333086/371472 [4:20:12<2:56:50,  3.62it/s]
 90%|████████▉ | 333087/371472 [4:20:13<2:52:23,  3.71it/s]
 90%|████████▉ | 333088/371472 [4:20:13<2:50:53,  3.74it/s]
 90%|████████▉ | 333089/371472 [4:20:13<3:07:25,  3.41it/s]
 90%|████████▉ | 333090/371472 [4:20:13<2:58:00,  3.59it/s]
 90%|████████▉ | 333091/371472 [4:20:14<2:54:40,  3.66it/s]
 90%|████████▉ | 333092/371472 [4:20:14<2:54:43,  3.66it/s]
 90%|████████▉ | 333093/371472 [4:20:14<2:52:39,  3.70it/s]
 90%|████████▉ | 333094/371472 [4:20:15<2:57:28,  3.60it/s]
 90%|████████▉ | 333095/371472 [4:20:15<2:55:45,  3.64it/s]
 90%|████████▉ | 333096/371472 [4:20:15<3:02:30,  3.50it/s]
 90%|████████▉ | 333097/371472 [4:20:15<2:59:20,  3.57it/s]
 90%|████████▉ | 333098/371472 [4:20:16<3:00:22,  3.55it/s]
 90%|████████▉ | 333099/371472 [4:20:16<3:05:19,  3.45it/s]
 90%|████████▉ | 333100/371472 [4:20:16<3:04:33,  3.47it/s]
                                                           
{'loss': 2.6282, 'learning_rate': 1.9301751815380643e-07, 'epoch': 14.35}

 90%|████████▉ | 333100/371472 [4:20:16<3:04:33,  3.47it/s]
 90%|████████▉ | 333101/371472 [4:20:17<2:57:34,  3.60it/s]
 90%|████████▉ | 333102/371472 [4:20:17<2:57:50,  3.60it/s]
 90%|████████▉ | 333103/371472 [4:20:17<2:55:06,  3.65it/s]
 90%|████████▉ | 333104/371472 [4:20:17<2:53:44,  3.68it/s]
 90%|████████▉ | 333105/371472 [4:20:18<3:01:04,  3.53it/s]
 90%|████████▉ | 333106/371472 [4:20:18<2:59:02,  3.57it/s]
 90%|████████▉ | 333107/371472 [4:20:18<2:58:01,  3.59it/s]
 90%|████████▉ | 333108/371472 [4:20:18<2:53:20,  3.69it/s]
 90%|████████▉ | 333109/371472 [4:20:19<3:16:27,  3.25it/s]
 90%|████████▉ | 333110/371472 [4:20:19<3:11:36,  3.34it/s]
 90%|████████▉ | 333111/371472 [4:20:19<3:03:11,  3.49it/s]
 90%|████████▉ | 333112/371472 [4:20:20<2:56:30,  3.62it/s]
 90%|████████▉ | 333113/371472 [4:20:20<3:11:01,  3.35it/s]
 90%|████████▉ | 333114/371472 [4:20:20<3:01:52,  3.51it/s]
 90%|████████▉ | 333115/371472 [4:20:21<3:09:27,  3.37it/s]
 90%|████████▉ | 333116/371472 [4:20:21<3:07:34,  3.41it/s]
 90%|████████▉ | 333117/371472 [4:20:21<3:04:16,  3.47it/s]
 90%|████████▉ | 333118/371472 [4:20:21<3:10:01,  3.36it/s]
 90%|████████▉ | 333119/371472 [4:20:22<3:02:03,  3.51it/s]
 90%|████████▉ | 333120/371472 [4:20:22<3:00:45,  3.54it/s]
                                                           
{'loss': 2.638, 'learning_rate': 1.9296903617832747e-07, 'epoch': 14.35}

 90%|████████▉ | 333120/371472 [4:20:22<3:00:45,  3.54it/s]
 90%|████████▉ | 333121/371472 [4:20:22<3:04:24,  3.47it/s]
 90%|████████▉ | 333122/371472 [4:20:23<2:59:31,  3.56it/s]
 90%|████████▉ | 333123/371472 [4:20:23<2:58:02,  3.59it/s]
 90%|████████▉ | 333124/371472 [4:20:23<2:51:21,  3.73it/s]
 90%|████████▉ | 333125/371472 [4:20:23<3:01:48,  3.52it/s]
 90%|████████▉ | 333126/371472 [4:20:24<3:04:02,  3.47it/s]
 90%|████████▉ | 333127/371472 [4:20:24<2:58:37,  3.58it/s]
 90%|████████▉ | 333128/371472 [4:20:24<2:57:27,  3.60it/s]
 90%|████████▉ | 333129/371472 [4:20:25<3:02:14,  3.51it/s]
 90%|████████▉ | 333130/371472 [4:20:25<3:34:33,  2.98it/s]
 90%|████████▉ | 333131/371472 [4:20:25<3:23:46,  3.14it/s]
 90%|████████▉ | 333132/371472 [4:20:26<3:20:43,  3.18it/s]
 90%|████████▉ | 333133/371472 [4:20:26<3:20:59,  3.18it/s]
 90%|████████▉ | 333134/371472 [4:20:26<3:28:23,  3.07it/s]
 90%|████████▉ | 333135/371472 [4:20:27<3:16:15,  3.26it/s]
 90%|████████▉ | 333136/371472 [4:20:27<3:03:45,  3.48it/s]
 90%|████████▉ | 333137/371472 [4:20:27<3:17:46,  3.23it/s]
 90%|████████▉ | 333138/371472 [4:20:27<3:07:05,  3.41it/s]
 90%|████████▉ | 333139/371472 [4:20:28<3:32:54,  3.00it/s]
 90%|████████▉ | 333140/371472 [4:20:28<3:21:44,  3.17it/s]
                                                           
{'loss': 2.587, 'learning_rate': 1.9292055420284852e-07, 'epoch': 14.35}

 90%|████████▉ | 333140/371472 [4:20:28<3:21:44,  3.17it/s]
 90%|████████▉ | 333141/371472 [4:20:28<3:17:57,  3.23it/s]
 90%|████████▉ | 333142/371472 [4:20:29<3:10:08,  3.36it/s]
 90%|████████▉ | 333143/371472 [4:20:29<3:09:25,  3.37it/s]
 90%|████████▉ | 333144/371472 [4:20:29<3:02:56,  3.49it/s]
 90%|████████▉ | 333145/371472 [4:20:29<2:58:28,  3.58it/s]
 90%|████████▉ | 333146/371472 [4:20:30<2:51:59,  3.71it/s]
 90%|████████▉ | 333147/371472 [4:20:30<2:52:34,  3.70it/s]
 90%|████████▉ | 333148/371472 [4:20:30<3:15:15,  3.27it/s]
 90%|████████▉ | 333149/371472 [4:20:31<3:13:19,  3.30it/s]
 90%|████████▉ | 333150/371472 [4:20:31<3:11:59,  3.33it/s]
 90%|████████▉ | 333151/371472 [4:20:31<3:11:48,  3.33it/s]
 90%|████████▉ | 333152/371472 [4:20:32<3:08:12,  3.39it/s]
 90%|████████▉ | 333153/371472 [4:20:32<3:03:20,  3.48it/s]
 90%|████████▉ | 333154/371472 [4:20:32<3:05:50,  3.44it/s]
 90%|████████▉ | 333155/371472 [4:20:32<3:00:59,  3.53it/s]
 90%|████████▉ | 333156/371472 [4:20:33<3:08:23,  3.39it/s]
 90%|████████▉ | 333157/371472 [4:20:33<3:00:49,  3.53it/s]
 90%|████████▉ | 333158/371472 [4:20:33<2:58:34,  3.58it/s]
 90%|████████▉ | 333159/371472 [4:20:33<2:52:48,  3.70it/s]
 90%|████████▉ | 333160/371472 [4:20:34<2:56:12,  3.62it/s]
                                                           
{'loss': 2.5188, 'learning_rate': 1.928720722273697e-07, 'epoch': 14.35}

 90%|████████▉ | 333160/371472 [4:20:34<2:56:12,  3.62it/s]
 90%|████████▉ | 333161/371472 [4:20:34<2:52:35,  3.70it/s]
 90%|████████▉ | 333162/371472 [4:20:34<2:52:51,  3.69it/s]
 90%|████████▉ | 333163/371472 [4:20:35<2:53:23,  3.68it/s]
 90%|████████▉ | 333164/371472 [4:20:35<2:53:19,  3.68it/s]
 90%|████████▉ | 333165/371472 [4:20:35<2:53:30,  3.68it/s]
 90%|████████▉ | 333166/371472 [4:20:35<2:54:51,  3.65it/s]
 90%|████████▉ | 333167/371472 [4:20:36<2:53:00,  3.69it/s]
 90%|████████▉ | 333168/371472 [4:20:36<2:53:42,  3.68it/s]
 90%|████████▉ | 333169/371472 [4:20:36<3:04:23,  3.46it/s]
 90%|████████▉ | 333170/371472 [4:20:37<3:03:37,  3.48it/s]
 90%|████████▉ | 333171/371472 [4:20:37<3:03:52,  3.47it/s]
 90%|████████▉ | 333172/371472 [4:20:37<3:05:11,  3.45it/s]
 90%|████████▉ | 333173/371472 [4:20:37<3:08:21,  3.39it/s]
 90%|████████▉ | 333174/371472 [4:20:38<3:04:05,  3.47it/s]
 90%|████████▉ | 333175/371472 [4:20:38<3:04:30,  3.46it/s]
 90%|████████▉ | 333176/371472 [4:20:38<3:09:44,  3.36it/s]
 90%|████████▉ | 333177/371472 [4:20:39<3:21:25,  3.17it/s]
 90%|████████▉ | 333178/371472 [4:20:39<3:11:13,  3.34it/s]
 90%|████████▉ | 333179/371472 [4:20:39<3:22:03,  3.16it/s]
 90%|████████▉ | 333180/371472 [4:20:40<3:21:10,  3.17it/s]
                                                           
{'loss': 2.5317, 'learning_rate': 1.9282359025189074e-07, 'epoch': 14.35}

 90%|████████▉ | 333180/371472 [4:20:40<3:21:10,  3.17it/s]
 90%|████████▉ | 333181/371472 [4:20:40<3:21:34,  3.17it/s]
 90%|████████▉ | 333182/371472 [4:20:40<3:30:19,  3.03it/s]
 90%|████████▉ | 333183/371472 [4:20:41<3:20:02,  3.19it/s]
 90%|████████▉ | 333184/371472 [4:20:41<3:30:06,  3.04it/s]
 90%|████████▉ | 333185/371472 [4:20:41<3:18:59,  3.21it/s]
 90%|████████▉ | 333186/371472 [4:20:41<3:14:08,  3.29it/s]
 90%|████████▉ | 333187/371472 [4:20:42<3:08:10,  3.39it/s]
 90%|████████▉ | 333188/371472 [4:20:42<3:00:55,  3.53it/s]
 90%|████████▉ | 333189/371472 [4:20:42<2:59:04,  3.56it/s]
 90%|████████▉ | 333190/371472 [4:20:43<3:18:44,  3.21it/s]
 90%|████████▉ | 333191/371472 [4:20:43<3:16:04,  3.25it/s]
 90%|████████▉ | 333192/371472 [4:20:43<3:21:57,  3.16it/s]
 90%|████████▉ | 333193/371472 [4:20:44<3:14:23,  3.28it/s]
 90%|████████▉ | 333194/371472 [4:20:44<3:06:34,  3.42it/s]
 90%|████████▉ | 333195/371472 [4:20:44<3:21:39,  3.16it/s]
 90%|████████▉ | 333196/371472 [4:20:44<3:15:06,  3.27it/s]
 90%|████████▉ | 333197/371472 [4:20:45<3:11:55,  3.32it/s]
 90%|████████▉ | 333198/371472 [4:20:45<3:03:46,  3.47it/s]
 90%|████████▉ | 333199/371472 [4:20:45<3:01:32,  3.51it/s]
 90%|████████▉ | 333200/371472 [4:20:46<2:56:56,  3.60it/s]
                                                           
{'loss': 2.708, 'learning_rate': 1.927751082764119e-07, 'epoch': 14.35}

 90%|████████▉ | 333200/371472 [4:20:46<2:56:56,  3.60it/s]
 90%|████████▉ | 333201/371472 [4:20:46<2:58:41,  3.57it/s]
 90%|████████▉ | 333202/371472 [4:20:46<3:08:08,  3.39it/s]
 90%|████████▉ | 333203/371472 [4:20:46<3:01:05,  3.52it/s]
 90%|████████▉ | 333204/371472 [4:20:47<3:03:03,  3.48it/s]
 90%|████████▉ | 333205/371472 [4:20:47<3:08:05,  3.39it/s]
 90%|████████▉ | 333206/371472 [4:20:47<3:07:19,  3.40it/s]
 90%|████████▉ | 333207/371472 [4:20:48<3:09:55,  3.36it/s]
 90%|████████▉ | 333208/371472 [4:20:48<3:03:51,  3.47it/s]
 90%|████████▉ | 333209/371472 [4:20:48<3:15:14,  3.27it/s]
 90%|████████▉ | 333210/371472 [4:20:49<3:06:45,  3.41it/s]
 90%|████████▉ | 333211/371472 [4:20:49<3:05:59,  3.43it/s]
 90%|████████▉ | 333212/371472 [4:20:49<3:03:27,  3.48it/s]
 90%|████████▉ | 333213/371472 [4:20:49<3:05:09,  3.44it/s]
 90%|████████▉ | 333214/371472 [4:20:50<3:03:19,  3.48it/s]
 90%|████████▉ | 333215/371472 [4:20:50<3:26:52,  3.08it/s]
 90%|████████▉ | 333216/371472 [4:20:50<3:30:15,  3.03it/s]
 90%|████████▉ | 333217/371472 [4:20:51<3:16:00,  3.25it/s]
 90%|████████▉ | 333218/371472 [4:20:51<3:08:36,  3.38it/s]
 90%|████████▉ | 333219/371472 [4:20:51<3:04:39,  3.45it/s]
 90%|████████▉ | 333220/371472 [4:20:52<3:01:59,  3.50it/s]
                                                           
{'loss': 2.5211, 'learning_rate': 1.9272662630093296e-07, 'epoch': 14.35}

 90%|████████▉ | 333220/371472 [4:20:52<3:01:59,  3.50it/s]
 90%|████████▉ | 333221/371472 [4:20:52<2:58:05,  3.58it/s]
 90%|████████▉ | 333222/371472 [4:20:52<2:57:49,  3.59it/s]
 90%|████████▉ | 333223/371472 [4:20:52<2:57:42,  3.59it/s]
 90%|████████▉ | 333224/371472 [4:20:53<2:57:35,  3.59it/s]
 90%|████████▉ | 333225/371472 [4:20:53<2:55:08,  3.64it/s]
 90%|████████▉ | 333226/371472 [4:20:53<2:59:51,  3.54it/s]
 90%|████████▉ | 333227/371472 [4:20:54<3:24:31,  3.12it/s]
 90%|████████▉ | 333228/371472 [4:20:54<3:13:07,  3.30it/s]
 90%|████████▉ | 333229/371472 [4:20:54<3:03:01,  3.48it/s]
 90%|████████▉ | 333230/371472 [4:20:54<2:58:56,  3.56it/s]
 90%|████████▉ | 333231/371472 [4:20:55<2:58:56,  3.56it/s]
 90%|████████▉ | 333232/371472 [4:20:55<2:56:42,  3.61it/s]
 90%|████████▉ | 333233/371472 [4:20:55<3:04:15,  3.46it/s]
 90%|████████▉ | 333234/371472 [4:20:56<3:02:46,  3.49it/s]
 90%|████████▉ | 333235/371472 [4:20:56<3:18:03,  3.22it/s]
 90%|████████▉ | 333236/371472 [4:20:56<3:15:49,  3.25it/s]
 90%|████████▉ | 333237/371472 [4:20:56<3:11:43,  3.32it/s]
 90%|████████▉ | 333238/371472 [4:20:57<3:12:46,  3.31it/s]
 90%|████████▉ | 333239/371472 [4:20:57<3:15:08,  3.27it/s]
 90%|████████▉ | 333240/371472 [4:20:57<3:09:55,  3.35it/s]
                                                           
{'loss': 2.4548, 'learning_rate': 1.926781443254541e-07, 'epoch': 14.35}

 90%|████████▉ | 333240/371472 [4:20:57<3:09:55,  3.35it/s]
 90%|████████▉ | 333241/371472 [4:20:58<3:10:21,  3.35it/s]
 90%|████████▉ | 333242/371472 [4:20:58<3:09:38,  3.36it/s]
 90%|████████▉ | 333243/371472 [4:20:58<3:05:15,  3.44it/s]
 90%|████████▉ | 333244/371472 [4:20:59<3:01:29,  3.51it/s]
 90%|████████▉ | 333245/371472 [4:20:59<3:00:20,  3.53it/s]
 90%|████████▉ | 333246/371472 [4:20:59<3:01:34,  3.51it/s]
 90%|████████▉ | 333247/371472 [4:20:59<3:09:10,  3.37it/s]
 90%|████████▉ | 333248/371472 [4:21:00<3:10:57,  3.34it/s]
 90%|████████▉ | 333249/371472 [4:21:00<3:16:11,  3.25it/s]
 90%|████████▉ | 333250/371472 [4:21:00<3:10:08,  3.35it/s]
 90%|████████▉ | 333251/371472 [4:21:01<3:06:59,  3.41it/s]
 90%|████████▉ | 333252/371472 [4:21:01<3:17:31,  3.22it/s]
 90%|████████▉ | 333253/371472 [4:21:01<3:14:34,  3.27it/s]
 90%|████████▉ | 333254/371472 [4:21:02<3:13:43,  3.29it/s]
 90%|████████▉ | 333255/371472 [4:21:02<3:09:59,  3.35it/s]
 90%|████████▉ | 333256/371472 [4:21:02<3:05:02,  3.44it/s]
 90%|████████▉ | 333257/371472 [4:21:02<3:02:56,  3.48it/s]
 90%|████████▉ | 333258/371472 [4:21:03<3:16:16,  3.25it/s]
 90%|████████▉ | 333259/371472 [4:21:03<3:12:15,  3.31it/s]
 90%|████████▉ | 333260/371472 [4:21:03<3:10:59,  3.33it/s]
                                                           
{'loss': 2.5561, 'learning_rate': 1.9262966234997516e-07, 'epoch': 14.35}

 90%|████████▉ | 333260/371472 [4:21:03<3:10:59,  3.33it/s]
 90%|████████▉ | 333261/371472 [4:21:04<3:15:37,  3.26it/s]
 90%|████████▉ | 333262/371472 [4:21:04<3:05:42,  3.43it/s]
 90%|████████▉ | 333263/371472 [4:21:04<3:13:12,  3.30it/s]
 90%|████████▉ | 333264/371472 [4:21:04<3:06:18,  3.42it/s]
 90%|████████▉ | 333265/371472 [4:21:05<3:08:06,  3.39it/s]
 90%|████████▉ | 333266/371472 [4:21:05<3:09:50,  3.35it/s]
 90%|████████▉ | 333267/371472 [4:21:05<3:03:29,  3.47it/s]
 90%|████████▉ | 333268/371472 [4:21:06<3:05:43,  3.43it/s]
 90%|████████▉ | 333269/371472 [4:21:06<2:59:48,  3.54it/s]
 90%|████████▉ | 333270/371472 [4:21:06<2:58:36,  3.56it/s]
 90%|████████▉ | 333271/371472 [4:21:06<2:54:06,  3.66it/s]
 90%|████████▉ | 333272/371472 [4:21:07<2:51:57,  3.70it/s]
 90%|████████▉ | 333273/371472 [4:21:07<3:05:22,  3.43it/s]
 90%|████████▉ | 333274/371472 [4:21:07<3:00:52,  3.52it/s]
 90%|████████▉ | 333275/371472 [4:21:08<3:16:17,  3.24it/s]
 90%|████████▉ | 333276/371472 [4:21:08<3:11:23,  3.33it/s]
 90%|████████▉ | 333277/371472 [4:21:08<3:04:42,  3.45it/s]
 90%|████████▉ | 333278/371472 [4:21:09<3:01:02,  3.52it/s]
 90%|████████▉ | 333279/371472 [4:21:09<2:58:02,  3.58it/s]
 90%|████████▉ | 333280/371472 [4:21:09<3:00:41,  3.52it/s]
                                                           
{'loss': 2.5424, 'learning_rate': 1.9258118037449633e-07, 'epoch': 14.35}

 90%|████████▉ | 333280/371472 [4:21:09<3:00:41,  3.52it/s]
 90%|████████▉ | 333281/371472 [4:21:09<3:06:07,  3.42it/s]
 90%|████████▉ | 333282/371472 [4:21:10<3:01:20,  3.51it/s]
 90%|████████▉ | 333283/371472 [4:21:10<3:09:21,  3.36it/s]
 90%|████████▉ | 333284/371472 [4:21:10<3:13:48,  3.28it/s]
 90%|████████▉ | 333285/371472 [4:21:11<3:07:11,  3.40it/s]
 90%|████████▉ | 333286/371472 [4:21:11<3:18:35,  3.20it/s]
 90%|████████▉ | 333287/371472 [4:21:11<3:17:54,  3.22it/s]
 90%|████████▉ | 333288/371472 [4:21:11<3:08:42,  3.37it/s]
 90%|████████▉ | 333289/371472 [4:21:12<3:01:28,  3.51it/s]
 90%|████████▉ | 333290/371472 [4:21:12<3:21:07,  3.16it/s]
 90%|████████▉ | 333291/371472 [4:21:12<3:13:55,  3.28it/s]
 90%|████████▉ | 333292/371472 [4:21:13<3:11:19,  3.33it/s]
 90%|████████▉ | 333293/371472 [4:21:13<3:09:43,  3.35it/s]
 90%|████████▉ | 333294/371472 [4:21:13<3:09:35,  3.36it/s]
 90%|████████▉ | 333295/371472 [4:21:14<3:07:17,  3.40it/s]
 90%|████████▉ | 333296/371472 [4:21:14<3:07:34,  3.39it/s]
 90%|████████▉ | 333297/371472 [4:21:14<3:04:44,  3.44it/s]
 90%|████████▉ | 333298/371472 [4:21:15<3:17:54,  3.21it/s]
 90%|████████▉ | 333299/371472 [4:21:15<3:09:04,  3.36it/s]
 90%|████████▉ | 333300/371472 [4:21:15<3:12:07,  3.31it/s]
                                                           
{'loss': 2.5594, 'learning_rate': 1.925326983990174e-07, 'epoch': 14.36}

 90%|████████▉ | 333300/371472 [4:21:15<3:12:07,  3.31it/s]
 90%|████████▉ | 333301/371472 [4:21:15<3:12:15,  3.31it/s]
 90%|████████▉ | 333302/371472 [4:21:16<3:19:07,  3.19it/s]
 90%|████████▉ | 333303/371472 [4:21:16<3:16:39,  3.23it/s]
 90%|████████▉ | 333304/371472 [4:21:16<3:14:19,  3.27it/s]
 90%|████████▉ | 333305/371472 [4:21:17<3:10:54,  3.33it/s]
 90%|████████▉ | 333306/371472 [4:21:17<3:08:55,  3.37it/s]
 90%|████████▉ | 333307/371472 [4:21:17<3:02:13,  3.49it/s]
 90%|████████▉ | 333308/371472 [4:21:17<3:08:00,  3.38it/s]
 90%|████████▉ | 333309/371472 [4:21:18<3:02:39,  3.48it/s]
 90%|████████▉ | 333310/371472 [4:21:18<3:04:15,  3.45it/s]
 90%|████████▉ | 333311/371472 [4:21:18<3:01:06,  3.51it/s]
 90%|████████▉ | 333312/371472 [4:21:19<2:56:24,  3.61it/s]
 90%|████████▉ | 333313/371472 [4:21:19<3:10:08,  3.34it/s]
 90%|████████▉ | 333314/371472 [4:21:19<3:05:29,  3.43it/s]
 90%|████████▉ | 333315/371472 [4:21:20<3:06:43,  3.41it/s]
 90%|████████▉ | 333316/371472 [4:21:20<3:16:29,  3.24it/s]
 90%|████████▉ | 333317/371472 [4:21:20<3:13:47,  3.28it/s]
 90%|████████▉ | 333318/371472 [4:21:20<3:08:55,  3.37it/s]
 90%|████████▉ | 333319/371472 [4:21:21<3:02:34,  3.48it/s]
 90%|████████▉ | 333320/371472 [4:21:21<2:56:38,  3.60it/s]
                                                           
{'loss': 2.5578, 'learning_rate': 1.9248421642353853e-07, 'epoch': 14.36}

 90%|████████▉ | 333320/371472 [4:21:21<2:56:38,  3.60it/s]
 90%|████████▉ | 333321/371472 [4:21:21<2:55:31,  3.62it/s]
 90%|████████▉ | 333322/371472 [4:21:21<2:54:50,  3.64it/s]
 90%|████████▉ | 333323/371472 [4:21:22<2:52:01,  3.70it/s]
 90%|████████▉ | 333324/371472 [4:21:22<2:52:40,  3.68it/s]
 90%|████████▉ | 333325/371472 [4:21:22<2:50:13,  3.73it/s]
 90%|████████▉ | 333326/371472 [4:21:23<2:53:42,  3.66it/s]
 90%|████████▉ | 333327/371472 [4:21:23<2:54:29,  3.64it/s]
 90%|████████▉ | 333328/371472 [4:21:23<2:57:26,  3.58it/s]
 90%|████████▉ | 333329/371472 [4:21:23<3:02:35,  3.48it/s]
 90%|████████▉ | 333330/371472 [4:21:24<3:12:25,  3.30it/s]
 90%|████████▉ | 333331/371472 [4:21:24<3:09:47,  3.35it/s]
 90%|████████▉ | 333332/371472 [4:21:24<3:03:32,  3.46it/s]
 90%|████████▉ | 333333/371472 [4:21:25<2:56:57,  3.59it/s]
 90%|████████▉ | 333334/371472 [4:21:25<2:57:51,  3.57it/s]
 90%|████████▉ | 333335/371472 [4:21:25<2:58:40,  3.56it/s]
 90%|████████▉ | 333336/371472 [4:21:25<3:04:11,  3.45it/s]
 90%|████████▉ | 333337/371472 [4:21:26<3:05:41,  3.42it/s]
 90%|████████▉ | 333338/371472 [4:21:26<2:59:31,  3.54it/s]
 90%|████████▉ | 333339/371472 [4:21:26<3:00:49,  3.51it/s]
 90%|████████▉ | 333340/371472 [4:21:27<3:01:35,  3.50it/s]
                                                           
{'loss': 2.6253, 'learning_rate': 1.924357344480596e-07, 'epoch': 14.36}

 90%|████████▉ | 333340/371472 [4:21:27<3:01:35,  3.50it/s]
 90%|████████▉ | 333341/371472 [4:21:27<2:59:55,  3.53it/s]
 90%|████████▉ | 333342/371472 [4:21:27<3:10:00,  3.34it/s]
 90%|████████▉ | 333343/371472 [4:21:27<3:05:16,  3.43it/s]
 90%|████████▉ | 333344/371472 [4:21:28<2:56:43,  3.60it/s]
 90%|████████▉ | 333345/371472 [4:21:28<2:55:26,  3.62it/s]
 90%|████████▉ | 333346/371472 [4:21:28<2:58:23,  3.56it/s]
 90%|████████▉ | 333347/371472 [4:21:29<3:00:17,  3.52it/s]
 90%|████████▉ | 333348/371472 [4:21:29<3:00:50,  3.51it/s]
 90%|████████▉ | 333349/371472 [4:21:29<2:57:09,  3.59it/s]
 90%|████████▉ | 333350/371472 [4:21:29<2:55:53,  3.61it/s]
 90%|████████▉ | 333351/371472 [4:21:30<3:00:45,  3.51it/s]
 90%|████████▉ | 333352/371472 [4:21:30<2:55:20,  3.62it/s]
 90%|████████▉ | 333353/371472 [4:21:30<2:53:42,  3.66it/s]
 90%|████████▉ | 333354/371472 [4:21:30<2:50:35,  3.72it/s]
 90%|████████▉ | 333355/371472 [4:21:31<2:48:32,  3.77it/s]
 90%|████████▉ | 333356/371472 [4:21:31<2:51:50,  3.70it/s]
 90%|████████▉ | 333357/371472 [4:21:31<2:51:35,  3.70it/s]
 90%|████████▉ | 333358/371472 [4:21:32<2:50:40,  3.72it/s]
 90%|████████▉ | 333359/371472 [4:21:32<2:48:08,  3.78it/s]
 90%|████████▉ | 333360/371472 [4:21:32<2:55:31,  3.62it/s]
                                                           
{'loss': 2.7186, 'learning_rate': 1.9238725247258078e-07, 'epoch': 14.36}

 90%|████████▉ | 333360/371472 [4:21:32<2:55:31,  3.62it/s]
 90%|████████▉ | 333361/371472 [4:21:32<2:55:55,  3.61it/s]
 90%|████████▉ | 333362/371472 [4:21:33<2:55:49,  3.61it/s]
 90%|████████▉ | 333363/371472 [4:21:33<2:59:43,  3.53it/s]
 90%|████████▉ | 333364/371472 [4:21:33<2:57:37,  3.58it/s]
 90%|████████▉ | 333365/371472 [4:21:34<3:03:18,  3.46it/s]
 90%|████████▉ | 333366/371472 [4:21:34<2:59:44,  3.53it/s]
 90%|████████▉ | 333367/371472 [4:21:34<3:08:40,  3.37it/s]
 90%|████████▉ | 333368/371472 [4:21:34<3:07:43,  3.38it/s]
 90%|████████▉ | 333369/371472 [4:21:35<3:06:52,  3.40it/s]
 90%|████████▉ | 333370/371472 [4:21:35<3:05:41,  3.42it/s]
 90%|████████▉ | 333371/371472 [4:21:35<3:12:57,  3.29it/s]
 90%|████████▉ | 333372/371472 [4:21:36<3:11:06,  3.32it/s]
 90%|████████▉ | 333373/371472 [4:21:36<3:15:46,  3.24it/s]
 90%|████████▉ | 333374/371472 [4:21:36<3:16:49,  3.23it/s]
 90%|████████▉ | 333375/371472 [4:21:37<3:26:54,  3.07it/s]
 90%|████████▉ | 333376/371472 [4:21:37<3:21:10,  3.16it/s]
 90%|████████▉ | 333377/371472 [4:21:37<3:11:19,  3.32it/s]
 90%|████████▉ | 333378/371472 [4:21:38<3:13:47,  3.28it/s]
 90%|████████▉ | 333379/371472 [4:21:38<3:13:30,  3.28it/s]
 90%|████████▉ | 333380/371472 [4:21:38<3:02:31,  3.48it/s]
                                                           
{'loss': 2.579, 'learning_rate': 1.9233877049710182e-07, 'epoch': 14.36}

 90%|████████▉ | 333380/371472 [4:21:38<3:02:31,  3.48it/s]
 90%|████████▉ | 333381/371472 [4:21:38<2:59:52,  3.53it/s]
 90%|████████▉ | 333382/371472 [4:21:39<2:59:26,  3.54it/s]
 90%|████████▉ | 333383/371472 [4:21:39<2:52:55,  3.67it/s]
 90%|████████▉ | 333384/371472 [4:21:39<2:53:25,  3.66it/s]
 90%|████████▉ | 333385/371472 [4:21:39<2:51:34,  3.70it/s]
 90%|████████▉ | 333386/371472 [4:21:40<2:57:44,  3.57it/s]
 90%|████████▉ | 333387/371472 [4:21:40<2:51:08,  3.71it/s]
 90%|████████▉ | 333388/371472 [4:21:40<2:53:35,  3.66it/s]
 90%|████████▉ | 333389/371472 [4:21:41<2:59:51,  3.53it/s]
 90%|████████▉ | 333390/371472 [4:21:41<3:02:23,  3.48it/s]
 90%|████████▉ | 333391/371472 [4:21:41<3:07:59,  3.38it/s]
 90%|████████▉ | 333392/371472 [4:21:41<3:05:38,  3.42it/s]
 90%|████████▉ | 333393/371472 [4:21:42<3:01:59,  3.49it/s]
 90%|████████▉ | 333394/371472 [4:21:42<3:02:20,  3.48it/s]
 90%|████████▉ | 333395/371472 [4:21:42<3:08:13,  3.37it/s]
 90%|████████▉ | 333396/371472 [4:21:43<3:15:28,  3.25it/s]
 90%|████████▉ | 333397/371472 [4:21:43<3:10:40,  3.33it/s]
 90%|████████▉ | 333398/371472 [4:21:43<3:06:04,  3.41it/s]
 90%|████████▉ | 333399/371472 [4:21:44<3:27:22,  3.06it/s]
 90%|████████▉ | 333400/371472 [4:21:44<3:26:53,  3.07it/s]
                                                           
{'loss': 2.4764, 'learning_rate': 1.9229028852162295e-07, 'epoch': 14.36}

 90%|████████▉ | 333400/371472 [4:21:44<3:26:53,  3.07it/s]
 90%|████████▉ | 333401/371472 [4:21:44<3:12:37,  3.29it/s]
 90%|████████▉ | 333402/371472 [4:21:44<3:07:15,  3.39it/s]
 90%|████████▉ | 333403/371472 [4:21:45<3:03:20,  3.46it/s]
 90%|████████▉ | 333404/371472 [4:21:45<3:04:58,  3.43it/s]
 90%|████████▉ | 333405/371472 [4:21:45<3:02:25,  3.48it/s]
 90%|████████▉ | 333406/371472 [4:21:46<3:07:44,  3.38it/s]
 90%|████████▉ | 333407/371472 [4:21:46<3:30:42,  3.01it/s]
 90%|████████▉ | 333408/371472 [4:21:46<3:26:21,  3.07it/s]
 90%|████████▉ | 333409/371472 [4:21:47<3:15:04,  3.25it/s]
 90%|████████▉ | 333410/371472 [4:21:47<3:06:30,  3.40it/s]
 90%|████████▉ | 333411/371472 [4:21:47<3:01:05,  3.50it/s]
 90%|████████▉ | 333412/371472 [4:21:47<2:59:43,  3.53it/s]
 90%|████████▉ | 333413/371472 [4:21:48<2:56:46,  3.59it/s]
 90%|████████▉ | 333414/371472 [4:21:48<2:54:57,  3.63it/s]
 90%|████████▉ | 333415/371472 [4:21:48<2:58:06,  3.56it/s]
 90%|████████▉ | 333416/371472 [4:21:49<3:10:54,  3.32it/s]
 90%|████████▉ | 333417/371472 [4:21:49<3:18:34,  3.19it/s]
 90%|████████▉ | 333418/371472 [4:21:49<3:13:37,  3.28it/s]
 90%|████████▉ | 333419/371472 [4:21:50<3:11:04,  3.32it/s]
 90%|████████▉ | 333420/371472 [4:21:50<3:04:51,  3.43it/s]
                                                           
{'loss': 2.6434, 'learning_rate': 1.9224180654614405e-07, 'epoch': 14.36}

 90%|████████▉ | 333420/371472 [4:21:50<3:04:51,  3.43it/s]
 90%|████████▉ | 333421/371472 [4:21:50<3:11:03,  3.32it/s]
 90%|████████▉ | 333422/371472 [4:21:50<3:04:02,  3.45it/s]
 90%|████████▉ | 333423/371472 [4:21:51<3:06:32,  3.40it/s]
 90%|████████▉ | 333424/371472 [4:21:51<3:03:49,  3.45it/s]
 90%|████████▉ | 333425/371472 [4:21:51<2:57:48,  3.57it/s]
 90%|████████▉ | 333426/371472 [4:21:52<3:17:25,  3.21it/s]
 90%|████████▉ | 333427/371472 [4:21:52<3:19:32,  3.18it/s]
 90%|████████▉ | 333428/371472 [4:21:52<3:13:25,  3.28it/s]
 90%|████████▉ | 333429/371472 [4:21:53<3:05:32,  3.42it/s]
 90%|████████▉ | 333430/371472 [4:21:53<3:00:23,  3.51it/s]
 90%|████████▉ | 333431/371472 [4:21:53<2:56:19,  3.60it/s]
 90%|████████▉ | 333432/371472 [4:21:53<2:54:41,  3.63it/s]
 90%|████████▉ | 333433/371472 [4:21:54<2:53:14,  3.66it/s]
 90%|████████▉ | 333434/371472 [4:21:54<2:53:09,  3.66it/s]
 90%|████████▉ | 333435/371472 [4:21:54<2:52:24,  3.68it/s]
 90%|████████▉ | 333436/371472 [4:21:54<2:51:35,  3.69it/s]
 90%|████████▉ | 333437/371472 [4:21:55<2:54:42,  3.63it/s]
 90%|████████▉ | 333438/371472 [4:21:55<3:00:41,  3.51it/s]
 90%|████████▉ | 333439/371472 [4:21:55<2:56:49,  3.58it/s]
 90%|████████▉ | 333440/371472 [4:21:56<3:08:28,  3.36it/s]
                                                           
{'loss': 2.6498, 'learning_rate': 1.921933245706652e-07, 'epoch': 14.36}

 90%|████████▉ | 333440/371472 [4:21:56<3:08:28,  3.36it/s]
 90%|████████▉ | 333441/371472 [4:21:56<3:16:03,  3.23it/s]
 90%|████████▉ | 333442/371472 [4:21:56<3:22:06,  3.14it/s]
 90%|████████▉ | 333443/371472 [4:21:57<3:20:48,  3.16it/s]
 90%|████████▉ | 333444/371472 [4:21:57<3:12:22,  3.29it/s]
 90%|████████▉ | 333445/371472 [4:21:57<3:13:29,  3.28it/s]
 90%|████████▉ | 333446/371472 [4:21:57<3:07:08,  3.39it/s]
 90%|████████▉ | 333447/371472 [4:21:58<3:02:53,  3.47it/s]
 90%|████████▉ | 333448/371472 [4:21:58<3:03:52,  3.45it/s]
 90%|████████▉ | 333449/371472 [4:21:58<2:59:41,  3.53it/s]
 90%|████████▉ | 333450/371472 [4:21:59<2:53:16,  3.66it/s]
 90%|████████▉ | 333451/371472 [4:21:59<2:54:36,  3.63it/s]
 90%|████████▉ | 333452/371472 [4:21:59<2:58:23,  3.55it/s]
 90%|████████▉ | 333453/371472 [4:21:59<2:56:00,  3.60it/s]
 90%|████████▉ | 333454/371472 [4:22:00<3:00:33,  3.51it/s]
 90%|████████▉ | 333455/371472 [4:22:00<2:59:37,  3.53it/s]
 90%|████████▉ | 333456/371472 [4:22:00<2:56:24,  3.59it/s]
 90%|████████▉ | 333457/371472 [4:22:00<2:48:32,  3.76it/s]
 90%|████████▉ | 333458/371472 [4:22:01<2:57:51,  3.56it/s]
 90%|████████▉ | 333459/371472 [4:22:01<2:54:44,  3.63it/s]
 90%|████████▉ | 333460/371472 [4:22:01<2:49:31,  3.74it/s]
                                                           
{'loss': 2.5829, 'learning_rate': 1.9214484259518624e-07, 'epoch': 14.36}

 90%|████████▉ | 333460/371472 [4:22:01<2:49:31,  3.74it/s]
 90%|████████▉ | 333461/371472 [4:22:02<2:54:04,  3.64it/s]
 90%|████████▉ | 333462/371472 [4:22:02<2:49:38,  3.73it/s]
 90%|████████▉ | 333463/371472 [4:22:02<2:58:01,  3.56it/s]
 90%|████████▉ | 333464/371472 [4:22:02<2:53:45,  3.65it/s]
 90%|████████▉ | 333465/371472 [4:22:03<2:52:03,  3.68it/s]
 90%|████████▉ | 333466/371472 [4:22:03<2:48:59,  3.75it/s]
 90%|████████▉ | 333467/371472 [4:22:03<2:53:17,  3.66it/s]
 90%|████████▉ | 333468/371472 [4:22:03<2:52:04,  3.68it/s]
 90%|████████▉ | 333469/371472 [4:22:04<2:54:30,  3.63it/s]
 90%|████████▉ | 333470/371472 [4:22:04<2:58:17,  3.55it/s]
 90%|████████▉ | 333471/371472 [4:22:04<2:57:52,  3.56it/s]
 90%|████████▉ | 333472/371472 [4:22:05<2:57:34,  3.57it/s]
 90%|████████▉ | 333473/371472 [4:22:05<2:54:23,  3.63it/s]
 90%|████████▉ | 333474/371472 [4:22:05<3:00:43,  3.50it/s]
 90%|████████▉ | 333475/371472 [4:22:05<2:58:22,  3.55it/s]
 90%|████████▉ | 333476/371472 [4:22:06<2:57:30,  3.57it/s]
 90%|████████▉ | 333477/371472 [4:22:06<3:00:54,  3.50it/s]
 90%|████████▉ | 333478/371472 [4:22:06<3:04:43,  3.43it/s]
 90%|████████▉ | 333479/371472 [4:22:07<3:10:19,  3.33it/s]
 90%|████████▉ | 333480/371472 [4:22:07<3:03:50,  3.44it/s]
                                                           
{'loss': 2.5793, 'learning_rate': 1.9209636061970742e-07, 'epoch': 14.36}

 90%|████████▉ | 333480/371472 [4:22:07<3:03:50,  3.44it/s]
 90%|████████▉ | 333481/371472 [4:22:07<2:58:42,  3.54it/s]
 90%|████████▉ | 333482/371472 [4:22:07<2:56:17,  3.59it/s]
 90%|████████▉ | 333483/371472 [4:22:08<2:59:16,  3.53it/s]
 90%|████████▉ | 333484/371472 [4:22:08<2:57:56,  3.56it/s]
 90%|████████▉ | 333485/371472 [4:22:08<3:03:15,  3.45it/s]
 90%|████████▉ | 333486/371472 [4:22:09<3:01:09,  3.49it/s]
 90%|████████▉ | 333487/371472 [4:22:09<2:59:04,  3.54it/s]
 90%|████████▉ | 333488/371472 [4:22:09<2:53:47,  3.64it/s]
 90%|████████▉ | 333489/371472 [4:22:09<2:50:43,  3.71it/s]
 90%|████████▉ | 333490/371472 [4:22:10<2:51:10,  3.70it/s]
 90%|████████▉ | 333491/371472 [4:22:10<2:49:41,  3.73it/s]
 90%|████████▉ | 333492/371472 [4:22:10<2:56:37,  3.58it/s]
 90%|████████▉ | 333493/371472 [4:22:10<2:52:59,  3.66it/s]
 90%|████████▉ | 333494/371472 [4:22:11<2:56:08,  3.59it/s]
 90%|████████▉ | 333495/371472 [4:22:11<2:59:39,  3.52it/s]
 90%|████████▉ | 333496/371472 [4:22:11<3:01:12,  3.49it/s]
 90%|████████▉ | 333497/371472 [4:22:12<3:13:09,  3.28it/s]
 90%|████████▉ | 333498/371472 [4:22:12<3:07:28,  3.38it/s]
 90%|████████▉ | 333499/371472 [4:22:12<3:09:46,  3.33it/s]
 90%|████████▉ | 333500/371472 [4:22:13<3:16:00,  3.23it/s]
                                                           
{'loss': 2.5894, 'learning_rate': 1.9204787864422847e-07, 'epoch': 14.36}

 90%|████████▉ | 333500/371472 [4:22:13<3:16:00,  3.23it/s]
 90%|████████▉ | 333501/371472 [4:22:13<3:17:18,  3.21it/s]
 90%|████████▉ | 333502/371472 [4:22:13<3:07:52,  3.37it/s]
 90%|████████▉ | 333503/371472 [4:22:13<3:03:54,  3.44it/s]
 90%|████████▉ | 333504/371472 [4:22:14<2:55:01,  3.62it/s]
 90%|████████▉ | 333505/371472 [4:22:14<2:57:17,  3.57it/s]
 90%|████████▉ | 333506/371472 [4:22:14<3:04:27,  3.43it/s]
 90%|████████▉ | 333507/371472 [4:22:15<3:05:55,  3.40it/s]
 90%|████████▉ | 333508/371472 [4:22:15<3:03:26,  3.45it/s]
 90%|████████▉ | 333509/371472 [4:22:15<3:00:49,  3.50it/s]
 90%|████████▉ | 333510/371472 [4:22:15<2:57:24,  3.57it/s]
 90%|████████▉ | 333511/371472 [4:22:16<2:55:03,  3.61it/s]
 90%|████████▉ | 333512/371472 [4:22:16<3:01:16,  3.49it/s]
 90%|████████▉ | 333513/371472 [4:22:16<3:03:16,  3.45it/s]
 90%|████████▉ | 333514/371472 [4:22:17<3:00:27,  3.51it/s]
 90%|████████▉ | 333515/371472 [4:22:17<3:00:40,  3.50it/s]
 90%|████████▉ | 333516/371472 [4:22:17<3:01:08,  3.49it/s]
 90%|████████▉ | 333517/371472 [4:22:17<2:53:02,  3.66it/s]
 90%|████████▉ | 333518/371472 [4:22:18<2:53:06,  3.65it/s]
 90%|████████▉ | 333519/371472 [4:22:18<2:57:02,  3.57it/s]
 90%|████████▉ | 333520/371472 [4:22:18<2:55:48,  3.60it/s]
                                                           
{'loss': 2.3995, 'learning_rate': 1.9199939666874962e-07, 'epoch': 14.37}

 90%|████████▉ | 333520/371472 [4:22:18<2:55:48,  3.60it/s]
 90%|████████▉ | 333521/371472 [4:22:19<3:06:54,  3.38it/s]
 90%|████████▉ | 333522/371472 [4:22:19<3:06:19,  3.39it/s]
 90%|████████▉ | 333523/371472 [4:22:19<3:08:13,  3.36it/s]
 90%|████████▉ | 333524/371472 [4:22:20<3:15:20,  3.24it/s]
 90%|████████▉ | 333525/371472 [4:22:20<3:09:42,  3.33it/s]
 90%|████████▉ | 333526/371472 [4:22:20<3:01:06,  3.49it/s]
 90%|████████▉ | 333527/371472 [4:22:20<2:54:06,  3.63it/s]
 90%|████████▉ | 333528/371472 [4:22:21<3:03:11,  3.45it/s]
 90%|████████▉ | 333529/371472 [4:22:21<2:57:18,  3.57it/s]
 90%|████████▉ | 333530/371472 [4:22:21<2:54:01,  3.63it/s]
 90%|████████▉ | 333531/371472 [4:22:21<2:52:53,  3.66it/s]
 90%|████████▉ | 333532/371472 [4:22:22<2:52:01,  3.68it/s]
 90%|████████▉ | 333533/371472 [4:22:22<2:49:12,  3.74it/s]
 90%|████████▉ | 333534/371472 [4:22:22<2:45:51,  3.81it/s]
 90%|████████▉ | 333535/371472 [4:22:23<2:58:44,  3.54it/s]
 90%|████████▉ | 333536/371472 [4:22:23<2:55:38,  3.60it/s]
 90%|████████▉ | 333537/371472 [4:22:23<2:52:24,  3.67it/s]
 90%|████████▉ | 333538/371472 [4:22:23<2:50:16,  3.71it/s]
 90%|████████▉ | 333539/371472 [4:22:24<3:08:30,  3.35it/s]
 90%|████████▉ | 333540/371472 [4:22:24<3:10:54,  3.31it/s]
                                                           
{'loss': 2.7329, 'learning_rate': 1.919509146932707e-07, 'epoch': 14.37}

 90%|████████▉ | 333540/371472 [4:22:24<3:10:54,  3.31it/s]
 90%|████████▉ | 333541/371472 [4:22:24<3:05:39,  3.41it/s]
 90%|████████▉ | 333542/371472 [4:22:25<3:22:40,  3.12it/s]
 90%|████████▉ | 333543/371472 [4:22:25<3:11:03,  3.31it/s]
 90%|████████▉ | 333544/371472 [4:22:25<3:02:57,  3.45it/s]
 90%|████████▉ | 333545/371472 [4:22:25<2:58:08,  3.55it/s]
 90%|████████▉ | 333546/371472 [4:22:26<2:57:43,  3.56it/s]
 90%|████████▉ | 333547/371472 [4:22:26<2:53:53,  3.63it/s]
 90%|████████▉ | 333548/371472 [4:22:26<2:57:27,  3.56it/s]
 90%|████████▉ | 333549/371472 [4:22:27<2:59:54,  3.51it/s]
 90%|████████▉ | 333550/371472 [4:22:27<2:52:45,  3.66it/s]
 90%|████████▉ | 333551/371472 [4:22:27<2:54:24,  3.62it/s]
 90%|████████▉ | 333552/371472 [4:22:27<2:51:39,  3.68it/s]
 90%|████████▉ | 333553/371472 [4:22:28<2:53:04,  3.65it/s]
 90%|████████▉ | 333554/371472 [4:22:28<2:54:19,  3.63it/s]
 90%|████████▉ | 333555/371472 [4:22:28<3:04:34,  3.42it/s]
 90%|████████▉ | 333556/371472 [4:22:29<2:59:46,  3.51it/s]
 90%|████████▉ | 333557/371472 [4:22:29<3:01:02,  3.49it/s]
 90%|████████▉ | 333558/371472 [4:22:29<3:03:39,  3.44it/s]
 90%|████████▉ | 333559/371472 [4:22:29<2:56:17,  3.58it/s]
 90%|████████▉ | 333560/371472 [4:22:30<3:02:38,  3.46it/s]
                                                           
{'loss': 2.5861, 'learning_rate': 1.9190243271779184e-07, 'epoch': 14.37}

 90%|████████▉ | 333560/371472 [4:22:30<3:02:38,  3.46it/s]
 90%|████████▉ | 333561/371472 [4:22:30<3:00:41,  3.50it/s]
 90%|████████▉ | 333562/371472 [4:22:30<2:59:10,  3.53it/s]
 90%|████████▉ | 333563/371472 [4:22:31<3:06:45,  3.38it/s]
 90%|████████▉ | 333564/371472 [4:22:31<3:03:13,  3.45it/s]
 90%|████████▉ | 333565/371472 [4:22:31<3:05:07,  3.41it/s]
 90%|████████▉ | 333566/371472 [4:22:31<3:04:04,  3.43it/s]
 90%|████████▉ | 333567/371472 [4:22:32<3:04:20,  3.43it/s]
 90%|████████▉ | 333568/371472 [4:22:32<3:10:01,  3.32it/s]
 90%|████████▉ | 333569/371472 [4:22:32<3:03:27,  3.44it/s]
 90%|████████▉ | 333570/371472 [4:22:33<2:55:30,  3.60it/s]
 90%|████████▉ | 333571/371472 [4:22:33<3:04:20,  3.43it/s]
 90%|████████▉ | 333572/371472 [4:22:33<3:02:01,  3.47it/s]
 90%|████████▉ | 333573/371472 [4:22:33<3:06:00,  3.40it/s]
 90%|████████▉ | 333574/371472 [4:22:34<3:03:37,  3.44it/s]
 90%|████████▉ | 333575/371472 [4:22:34<3:28:11,  3.03it/s]
 90%|████████▉ | 333576/371472 [4:22:34<3:21:41,  3.13it/s]
 90%|████████▉ | 333577/371472 [4:22:35<3:14:53,  3.24it/s]
 90%|████████▉ | 333578/371472 [4:22:35<3:16:30,  3.21it/s]
 90%|████████▉ | 333579/371472 [4:22:35<3:23:24,  3.10it/s]
 90%|████████▉ | 333580/371472 [4:22:36<3:19:48,  3.16it/s]
                                                           
{'loss': 2.6629, 'learning_rate': 1.9185395074231288e-07, 'epoch': 14.37}

 90%|████████▉ | 333580/371472 [4:22:36<3:19:48,  3.16it/s]
 90%|████████▉ | 333581/371472 [4:22:36<3:16:12,  3.22it/s]
 90%|████████▉ | 333582/371472 [4:22:36<3:07:02,  3.38it/s]
 90%|████████▉ | 333583/371472 [4:22:37<2:59:57,  3.51it/s]
 90%|████████▉ | 333584/371472 [4:22:37<2:57:15,  3.56it/s]
 90%|████████▉ | 333585/371472 [4:22:37<3:02:49,  3.45it/s]
 90%|████████▉ | 333586/371472 [4:22:37<3:00:43,  3.49it/s]
 90%|████████▉ | 333587/371472 [4:22:38<2:56:31,  3.58it/s]
 90%|████████▉ | 333588/371472 [4:22:38<3:01:56,  3.47it/s]
 90%|████████▉ | 333589/371472 [4:22:38<3:00:21,  3.50it/s]
 90%|████████▉ | 333590/371472 [4:22:39<3:02:40,  3.46it/s]
 90%|████████▉ | 333591/371472 [4:22:39<2:59:12,  3.52it/s]
 90%|████████▉ | 333592/371472 [4:22:39<2:56:10,  3.58it/s]
 90%|████████▉ | 333593/371472 [4:22:39<3:15:04,  3.24it/s]
 90%|████████▉ | 333594/371472 [4:22:40<3:07:46,  3.36it/s]
 90%|████████▉ | 333595/371472 [4:22:40<3:07:26,  3.37it/s]
 90%|████████▉ | 333596/371472 [4:22:40<3:10:36,  3.31it/s]
 90%|████████▉ | 333597/371472 [4:22:41<3:05:54,  3.40it/s]
 90%|████████▉ | 333598/371472 [4:22:41<2:59:02,  3.53it/s]
 90%|████████▉ | 333599/371472 [4:22:41<2:57:52,  3.55it/s]
 90%|████████▉ | 333600/371472 [4:22:41<2:58:06,  3.54it/s]
                                                           
{'loss': 2.537, 'learning_rate': 1.9180546876683406e-07, 'epoch': 14.37}

 90%|████████▉ | 333600/371472 [4:22:41<2:58:06,  3.54it/s]
 90%|████████▉ | 333601/371472 [4:22:42<2:54:20,  3.62it/s]
 90%|████████▉ | 333602/371472 [4:22:42<3:09:45,  3.33it/s]
 90%|████████▉ | 333603/371472 [4:22:42<3:05:44,  3.40it/s]
 90%|████████▉ | 333604/371472 [4:22:43<2:56:58,  3.57it/s]
 90%|████████▉ | 333605/371472 [4:22:43<3:07:47,  3.36it/s]
 90%|████████▉ | 333606/371472 [4:22:43<3:07:14,  3.37it/s]
 90%|████████▉ | 333607/371472 [4:22:43<3:00:58,  3.49it/s]
 90%|████████▉ | 333608/371472 [4:22:44<3:04:55,  3.41it/s]
 90%|████████▉ | 333609/371472 [4:22:44<2:58:25,  3.54it/s]
 90%|████████▉ | 333610/371472 [4:22:44<2:51:53,  3.67it/s]
 90%|████████▉ | 333611/371472 [4:22:45<2:50:24,  3.70it/s]
 90%|████████▉ | 333612/371472 [4:22:45<2:55:33,  3.59it/s]
 90%|████████▉ | 333613/371472 [4:22:45<2:58:46,  3.53it/s]
 90%|████████▉ | 333614/371472 [4:22:45<3:05:40,  3.40it/s]
 90%|████████▉ | 333615/371472 [4:22:46<3:03:25,  3.44it/s]
 90%|████████▉ | 333616/371472 [4:22:46<3:05:12,  3.41it/s]
 90%|████████▉ | 333617/371472 [4:22:46<3:20:11,  3.15it/s]
 90%|████████▉ | 333618/371472 [4:22:47<3:16:12,  3.22it/s]
 90%|████████▉ | 333619/371472 [4:22:47<3:13:26,  3.26it/s]
 90%|████████▉ | 333620/371472 [4:22:47<3:24:16,  3.09it/s]
                                                           
{'loss': 2.6925, 'learning_rate': 1.9175698679135513e-07, 'epoch': 14.37}

 90%|████████▉ | 333620/371472 [4:22:47<3:24:16,  3.09it/s]
 90%|████████▉ | 333621/371472 [4:22:48<3:08:47,  3.34it/s]
 90%|████████▉ | 333622/371472 [4:22:48<3:00:54,  3.49it/s]
 90%|████████▉ | 333623/371472 [4:22:48<3:00:27,  3.50it/s]
 90%|████████▉ | 333624/371472 [4:22:48<3:04:33,  3.42it/s]
 90%|████████▉ | 333625/371472 [4:22:49<3:11:17,  3.30it/s]
 90%|████████▉ | 333626/371472 [4:22:49<3:16:50,  3.20it/s]
 90%|████████▉ | 333627/371472 [4:22:49<3:06:06,  3.39it/s]
 90%|████████▉ | 333628/371472 [4:22:50<3:00:41,  3.49it/s]
 90%|████████▉ | 333629/371472 [4:22:50<3:10:55,  3.30it/s]
 90%|████████▉ | 333630/371472 [4:22:50<3:11:27,  3.29it/s]
 90%|████████▉ | 333631/371472 [4:22:51<3:05:12,  3.41it/s]
 90%|████████▉ | 333632/371472 [4:22:51<3:14:30,  3.24it/s]
 90%|████████▉ | 333633/371472 [4:22:51<3:06:13,  3.39it/s]
 90%|████████▉ | 333634/371472 [4:22:52<3:20:02,  3.15it/s]
 90%|████████▉ | 333635/371472 [4:22:52<3:23:45,  3.09it/s]
 90%|████████▉ | 333636/371472 [4:22:52<3:30:19,  3.00it/s]
 90%|████████▉ | 333637/371472 [4:22:53<3:23:36,  3.10it/s]
 90%|████████▉ | 333638/371472 [4:22:53<3:26:36,  3.05it/s]
 90%|████████▉ | 333639/371472 [4:22:53<3:40:17,  2.86it/s]
 90%|████████▉ | 333640/371472 [4:22:54<3:22:44,  3.11it/s]
                                                           
{'loss': 2.6224, 'learning_rate': 1.9170850481587626e-07, 'epoch': 14.37}

 90%|████████▉ | 333640/371472 [4:22:54<3:22:44,  3.11it/s]
 90%|████████▉ | 333641/371472 [4:22:54<3:12:16,  3.28it/s]
 90%|████████▉ | 333642/371472 [4:22:54<3:13:31,  3.26it/s]
 90%|████████▉ | 333643/371472 [4:22:54<3:17:56,  3.19it/s]
 90%|████████▉ | 333644/371472 [4:22:55<3:10:21,  3.31it/s]
 90%|████████▉ | 333645/371472 [4:22:55<3:08:56,  3.34it/s]
 90%|████████▉ | 333646/371472 [4:22:55<3:40:13,  2.86it/s]
 90%|████████▉ | 333647/371472 [4:22:56<3:25:09,  3.07it/s]
 90%|████████▉ | 333648/371472 [4:22:56<3:16:48,  3.20it/s]
 90%|████████▉ | 333649/371472 [4:22:56<3:10:36,  3.31it/s]
 90%|████████▉ | 333650/371472 [4:22:57<3:05:46,  3.39it/s]
 90%|████████▉ | 333651/371472 [4:22:57<3:01:24,  3.47it/s]
 90%|████████▉ | 333652/371472 [4:22:57<3:13:28,  3.26it/s]
 90%|████████▉ | 333653/371472 [4:22:58<3:13:48,  3.25it/s]
 90%|████████▉ | 333654/371472 [4:22:58<3:10:28,  3.31it/s]
 90%|████████▉ | 333655/371472 [4:22:58<3:06:48,  3.37it/s]
 90%|████████▉ | 333656/371472 [4:22:58<3:00:52,  3.48it/s]
 90%|████████▉ | 333657/371472 [4:22:59<2:54:58,  3.60it/s]
 90%|████████▉ | 333658/371472 [4:22:59<2:55:46,  3.59it/s]
 90%|████████▉ | 333659/371472 [4:22:59<2:55:00,  3.60it/s]
 90%|████████▉ | 333660/371472 [4:22:59<2:59:47,  3.51it/s]
                                                           
{'loss': 2.5203, 'learning_rate': 1.9166002284039733e-07, 'epoch': 14.37}

 90%|████████▉ | 333660/371472 [4:22:59<2:59:47,  3.51it/s]
 90%|████████▉ | 333661/371472 [4:23:00<2:53:10,  3.64it/s]
 90%|████████▉ | 333662/371472 [4:23:00<2:59:14,  3.52it/s]
 90%|████████▉ | 333663/371472 [4:23:00<3:08:37,  3.34it/s]
 90%|████████▉ | 333664/371472 [4:23:01<3:07:16,  3.36it/s]
 90%|████████▉ | 333665/371472 [4:23:01<3:00:55,  3.48it/s]
 90%|████████▉ | 333666/371472 [4:23:01<3:02:35,  3.45it/s]
 90%|████████▉ | 333667/371472 [4:23:02<3:01:19,  3.47it/s]
 90%|████████▉ | 333668/371472 [4:23:02<3:12:16,  3.28it/s]
 90%|████████▉ | 333669/371472 [4:23:02<3:04:37,  3.41it/s]
 90%|████████▉ | 333670/371472 [4:23:02<3:03:50,  3.43it/s]
 90%|████████▉ | 333671/371472 [4:23:03<3:09:03,  3.33it/s]
 90%|████████▉ | 333672/371472 [4:23:03<3:03:18,  3.44it/s]
 90%|████████▉ | 333673/371472 [4:23:03<3:04:59,  3.41it/s]
 90%|████████▉ | 333674/371472 [4:23:04<3:03:02,  3.44it/s]
 90%|████████▉ | 333675/371472 [4:23:04<2:56:26,  3.57it/s]
 90%|████████▉ | 333676/371472 [4:23:04<2:57:47,  3.54it/s]
 90%|████████▉ | 333677/371472 [4:23:04<3:01:36,  3.47it/s]
 90%|████████▉ | 333678/371472 [4:23:05<2:59:42,  3.51it/s]
 90%|████████▉ | 333679/371472 [4:23:05<3:11:11,  3.29it/s]
 90%|████████▉ | 333680/371472 [4:23:05<3:01:33,  3.47it/s]
                                                           
{'loss': 2.4317, 'learning_rate': 1.916115408649184e-07, 'epoch': 14.37}

 90%|████████▉ | 333680/371472 [4:23:05<3:01:33,  3.47it/s]
 90%|████████▉ | 333681/371472 [4:23:06<3:18:57,  3.17it/s]
 90%|████████▉ | 333682/371472 [4:23:06<3:16:20,  3.21it/s]
 90%|████████▉ | 333683/371472 [4:23:06<3:17:39,  3.19it/s]
 90%|████████▉ | 333684/371472 [4:23:07<3:06:47,  3.37it/s]
 90%|████████▉ | 333685/371472 [4:23:07<3:15:10,  3.23it/s]
 90%|████████▉ | 333686/371472 [4:23:07<3:04:55,  3.41it/s]
 90%|████████▉ | 333687/371472 [4:23:07<3:10:31,  3.31it/s]
 90%|████████▉ | 333688/371472 [4:23:08<3:01:56,  3.46it/s]
 90%|████████▉ | 333689/371472 [4:23:08<2:57:56,  3.54it/s]
 90%|████████▉ | 333690/371472 [4:23:08<3:06:45,  3.37it/s]
 90%|████████▉ | 333691/371472 [4:23:09<3:09:35,  3.32it/s]
 90%|████████▉ | 333692/371472 [4:23:09<3:03:51,  3.42it/s]
 90%|████████▉ | 333693/371472 [4:23:09<3:04:03,  3.42it/s]
 90%|████████▉ | 333694/371472 [4:23:10<3:04:06,  3.42it/s]
 90%|████████▉ | 333695/371472 [4:23:10<2:57:38,  3.54it/s]
 90%|████████▉ | 333696/371472 [4:23:10<2:53:10,  3.64it/s]
 90%|████████▉ | 333697/371472 [4:23:10<2:51:31,  3.67it/s]
 90%|████████▉ | 333698/371472 [4:23:11<2:51:12,  3.68it/s]
 90%|████████▉ | 333699/371472 [4:23:11<2:53:05,  3.64it/s]
 90%|████████▉ | 333700/371472 [4:23:11<2:56:22,  3.57it/s]
                                                           
{'loss': 2.5561, 'learning_rate': 1.9156305888943952e-07, 'epoch': 14.37}

 90%|████████▉ | 333700/371472 [4:23:11<2:56:22,  3.57it/s]
 90%|████████▉ | 333701/371472 [4:23:11<2:53:30,  3.63it/s]
 90%|████████▉ | 333702/371472 [4:23:12<3:01:58,  3.46it/s]
 90%|████████▉ | 333703/371472 [4:23:12<2:51:55,  3.66it/s]
 90%|████████▉ | 333704/371472 [4:23:12<2:53:15,  3.63it/s]
 90%|████████▉ | 333705/371472 [4:23:12<2:51:10,  3.68it/s]
 90%|████████▉ | 333706/371472 [4:23:13<2:55:59,  3.58it/s]
 90%|████████▉ | 333707/371472 [4:23:13<3:06:43,  3.37it/s]
 90%|████████▉ | 333708/371472 [4:23:13<2:58:09,  3.53it/s]
 90%|████████▉ | 333709/371472 [4:23:14<3:06:46,  3.37it/s]
 90%|████████▉ | 333710/371472 [4:23:14<3:07:05,  3.36it/s]
 90%|████████▉ | 333711/371472 [4:23:14<2:59:45,  3.50it/s]
 90%|████████▉ | 333712/371472 [4:23:15<2:58:13,  3.53it/s]
 90%|████████▉ | 333713/371472 [4:23:15<2:51:52,  3.66it/s]
 90%|████████▉ | 333714/371472 [4:23:15<3:03:28,  3.43it/s]
 90%|████████▉ | 333715/371472 [4:23:15<3:12:23,  3.27it/s]
 90%|████████▉ | 333716/371472 [4:23:16<3:08:58,  3.33it/s]
 90%|████████▉ | 333717/371472 [4:23:16<3:11:16,  3.29it/s]
 90%|████████▉ | 333718/371472 [4:23:16<3:09:07,  3.33it/s]
 90%|████████▉ | 333719/371472 [4:23:17<3:07:15,  3.36it/s]
 90%|████████▉ | 333720/371472 [4:23:17<3:08:10,  3.34it/s]
                                                           
{'loss': 2.5688, 'learning_rate': 1.915145769139606e-07, 'epoch': 14.37}

 90%|████████▉ | 333720/371472 [4:23:17<3:08:10,  3.34it/s]
 90%|████████▉ | 333721/371472 [4:23:17<3:03:41,  3.43it/s]
 90%|████████▉ | 333722/371472 [4:23:18<3:01:01,  3.48it/s]
 90%|████████▉ | 333723/371472 [4:23:18<3:19:33,  3.15it/s]
 90%|████████▉ | 333724/371472 [4:23:18<3:14:28,  3.24it/s]
 90%|████████▉ | 333725/371472 [4:23:18<3:05:41,  3.39it/s]
 90%|████████▉ | 333726/371472 [4:23:19<3:05:05,  3.40it/s]
 90%|████████▉ | 333727/371472 [4:23:19<2:59:17,  3.51it/s]
 90%|████████▉ | 333728/371472 [4:23:19<3:08:56,  3.33it/s]
 90%|████████▉ | 333729/371472 [4:23:20<3:03:04,  3.44it/s]
 90%|████████▉ | 333730/371472 [4:23:20<3:05:30,  3.39it/s]
 90%|████████▉ | 333731/371472 [4:23:20<3:19:59,  3.15it/s]
 90%|████████▉ | 333732/371472 [4:23:21<3:05:56,  3.38it/s]
 90%|████████▉ | 333733/371472 [4:23:21<3:04:30,  3.41it/s]
 90%|████████▉ | 333734/371472 [4:23:21<3:03:57,  3.42it/s]
 90%|████████▉ | 333735/371472 [4:23:21<3:01:26,  3.47it/s]
 90%|████████▉ | 333736/371472 [4:23:22<2:59:09,  3.51it/s]
 90%|████████▉ | 333737/371472 [4:23:22<2:55:02,  3.59it/s]
 90%|████████▉ | 333738/371472 [4:23:22<2:51:58,  3.66it/s]
 90%|████████▉ | 333739/371472 [4:23:22<2:48:41,  3.73it/s]
 90%|████████▉ | 333740/371472 [4:23:23<2:46:00,  3.79it/s]
                                                           
{'loss': 2.5172, 'learning_rate': 1.9146609493848175e-07, 'epoch': 14.37}

 90%|████████▉ | 333740/371472 [4:23:23<2:46:00,  3.79it/s]
 90%|████████▉ | 333741/371472 [4:23:23<2:47:24,  3.76it/s]
 90%|████████▉ | 333742/371472 [4:23:23<2:49:35,  3.71it/s]
 90%|████████▉ | 333743/371472 [4:23:23<2:45:58,  3.79it/s]
 90%|████████▉ | 333744/371472 [4:23:24<2:49:18,  3.71it/s]
 90%|████████▉ | 333745/371472 [4:23:24<2:53:47,  3.62it/s]
 90%|████████▉ | 333746/371472 [4:23:24<2:53:29,  3.62it/s]
 90%|████████▉ | 333747/371472 [4:23:25<2:50:35,  3.69it/s]
 90%|████████▉ | 333748/371472 [4:23:25<3:01:48,  3.46it/s]
 90%|████████▉ | 333749/371472 [4:23:25<2:59:11,  3.51it/s]
 90%|████████▉ | 333750/371472 [4:23:26<3:03:17,  3.43it/s]
 90%|████████▉ | 333751/371472 [4:23:26<3:06:17,  3.37it/s]
 90%|████████▉ | 333752/371472 [4:23:26<3:08:55,  3.33it/s]
 90%|████████▉ | 333753/371472 [4:23:26<3:09:10,  3.32it/s]
 90%|████████▉ | 333754/371472 [4:23:27<3:10:35,  3.30it/s]
 90%|████████▉ | 333755/371472 [4:23:27<3:03:41,  3.42it/s]
 90%|████████▉ | 333756/371472 [4:23:27<2:55:33,  3.58it/s]
 90%|████████▉ | 333757/371472 [4:23:28<2:54:29,  3.60it/s]
 90%|████████▉ | 333758/371472 [4:23:28<2:51:44,  3.66it/s]
 90%|████████▉ | 333759/371472 [4:23:28<2:50:31,  3.69it/s]
 90%|████████▉ | 333760/371472 [4:23:28<3:00:19,  3.49it/s]
                                                           
{'loss': 2.6316, 'learning_rate': 1.9141761296300282e-07, 'epoch': 14.38}

 90%|████████▉ | 333760/371472 [4:23:28<3:00:19,  3.49it/s]
 90%|████████▉ | 333761/371472 [4:23:29<2:57:27,  3.54it/s]
 90%|████████▉ | 333762/371472 [4:23:29<2:55:31,  3.58it/s]
 90%|████████▉ | 333763/371472 [4:23:29<2:53:35,  3.62it/s]
 90%|████████▉ | 333764/371472 [4:23:29<2:49:15,  3.71it/s]
 90%|████████▉ | 333765/371472 [4:23:30<2:44:43,  3.82it/s]
 90%|████████▉ | 333766/371472 [4:23:30<2:43:12,  3.85it/s]
 90%|████████▉ | 333767/371472 [4:23:30<2:51:23,  3.67it/s]
 90%|████████▉ | 333768/371472 [4:23:31<2:47:39,  3.75it/s]
 90%|████████▉ | 333769/371472 [4:23:31<2:52:03,  3.65it/s]
 90%|████████▉ | 333770/371472 [4:23:31<2:56:21,  3.56it/s]
 90%|████████▉ | 333771/371472 [4:23:31<2:56:58,  3.55it/s]
 90%|████████▉ | 333772/371472 [4:23:32<3:03:47,  3.42it/s]
 90%|████████▉ | 333773/371472 [4:23:32<2:54:52,  3.59it/s]
 90%|████████▉ | 333774/371472 [4:23:32<2:48:59,  3.72it/s]
 90%|████████▉ | 333775/371472 [4:23:32<2:43:53,  3.83it/s]
 90%|████████▉ | 333776/371472 [4:23:33<2:47:43,  3.75it/s]
 90%|████████▉ | 333777/371472 [4:23:33<2:46:44,  3.77it/s]
 90%|████████▉ | 333778/371472 [4:23:33<2:58:23,  3.52it/s]
 90%|████████▉ | 333779/371472 [4:23:34<3:02:26,  3.44it/s]
 90%|████████▉ | 333780/371472 [4:23:34<3:11:19,  3.28it/s]
                                                           
{'loss': 2.6162, 'learning_rate': 1.9136913098752397e-07, 'epoch': 14.38}

 90%|████████▉ | 333780/371472 [4:23:34<3:11:19,  3.28it/s]
 90%|████████▉ | 333781/371472 [4:23:34<3:05:06,  3.39it/s]
 90%|████████▉ | 333782/371472 [4:23:35<3:09:13,  3.32it/s]
 90%|████████▉ | 333783/371472 [4:23:35<3:01:13,  3.47it/s]
 90%|████████▉ | 333784/371472 [4:23:35<2:57:39,  3.54it/s]
 90%|████████▉ | 333785/371472 [4:23:35<2:52:05,  3.65it/s]
 90%|████████▉ | 333786/371472 [4:23:36<2:47:58,  3.74it/s]
 90%|████████▉ | 333787/371472 [4:23:36<2:46:21,  3.78it/s]
 90%|████████▉ | 333788/371472 [4:23:36<2:56:21,  3.56it/s]
 90%|████████▉ | 333789/371472 [4:23:36<2:51:55,  3.65it/s]
 90%|████████▉ | 333790/371472 [4:23:37<2:50:36,  3.68it/s]
 90%|████████▉ | 333791/371472 [4:23:37<2:51:46,  3.66it/s]
 90%|████████▉ | 333792/371472 [4:23:37<2:57:43,  3.53it/s]
 90%|████████▉ | 333793/371472 [4:23:38<2:52:19,  3.64it/s]
 90%|████████▉ | 333794/371472 [4:23:38<2:54:03,  3.61it/s]
 90%|████████▉ | 333795/371472 [4:23:38<2:53:16,  3.62it/s]
 90%|████████▉ | 333796/371472 [4:23:38<2:54:07,  3.61it/s]
 90%|████████▉ | 333797/371472 [4:23:39<2:56:29,  3.56it/s]
 90%|████████▉ | 333798/371472 [4:23:39<2:59:04,  3.51it/s]
 90%|████████▉ | 333799/371472 [4:23:39<3:28:41,  3.01it/s]
 90%|████████▉ | 333800/371472 [4:23:40<3:20:55,  3.12it/s]
                                                           
{'loss': 2.6452, 'learning_rate': 1.9132064901204504e-07, 'epoch': 14.38}

 90%|████████▉ | 333800/371472 [4:23:40<3:20:55,  3.12it/s]
 90%|████████▉ | 333801/371472 [4:23:40<3:12:33,  3.26it/s]
 90%|████████▉ | 333802/371472 [4:23:40<3:10:44,  3.29it/s]
 90%|████████▉ | 333803/371472 [4:23:41<3:14:39,  3.23it/s]
 90%|████████▉ | 333804/371472 [4:23:41<3:11:40,  3.28it/s]
 90%|████████▉ | 333805/371472 [4:23:41<3:28:49,  3.01it/s]
 90%|████████▉ | 333806/371472 [4:23:42<3:27:07,  3.03it/s]
 90%|████████▉ | 333807/371472 [4:23:42<3:23:55,  3.08it/s]
 90%|████████▉ | 333808/371472 [4:23:42<3:11:13,  3.28it/s]
 90%|████████▉ | 333809/371472 [4:23:42<3:08:45,  3.33it/s]
 90%|████████▉ | 333810/371472 [4:23:43<3:03:01,  3.43it/s]
 90%|████████▉ | 333811/371472 [4:23:43<3:00:05,  3.49it/s]
 90%|████████▉ | 333812/371472 [4:23:43<3:05:48,  3.38it/s]
 90%|████████▉ | 333813/371472 [4:23:44<3:10:45,  3.29it/s]
 90%|████████▉ | 333814/371472 [4:23:44<3:05:52,  3.38it/s]
 90%|████████▉ | 333815/371472 [4:23:44<3:01:12,  3.46it/s]
 90%|████████▉ | 333816/371472 [4:23:44<2:54:24,  3.60it/s]
 90%|████████▉ | 333817/371472 [4:23:45<2:51:28,  3.66it/s]
 90%|████████▉ | 333818/371472 [4:23:45<2:52:21,  3.64it/s]
 90%|████████▉ | 333819/371472 [4:23:45<2:52:46,  3.63it/s]
 90%|████████▉ | 333820/371472 [4:23:45<2:49:32,  3.70it/s]
                                                           
{'loss': 2.7176, 'learning_rate': 1.912721670365662e-07, 'epoch': 14.38}

 90%|████████▉ | 333820/371472 [4:23:46<2:49:32,  3.70it/s]
 90%|████████▉ | 333821/371472 [4:23:46<2:54:57,  3.59it/s]
 90%|████████▉ | 333822/371472 [4:23:46<2:58:05,  3.52it/s]
 90%|████████▉ | 333823/371472 [4:23:46<3:03:22,  3.42it/s]
 90%|████████▉ | 333824/371472 [4:23:47<2:59:06,  3.50it/s]
 90%|████████▉ | 333825/371472 [4:23:47<2:55:26,  3.58it/s]
 90%|████████▉ | 333826/371472 [4:23:47<2:52:53,  3.63it/s]
 90%|████████▉ | 333827/371472 [4:23:47<2:49:09,  3.71it/s]
 90%|████████▉ | 333828/371472 [4:23:48<2:52:19,  3.64it/s]
 90%|████████▉ | 333829/371472 [4:23:48<2:54:45,  3.59it/s]
 90%|████████▉ | 333830/371472 [4:23:48<2:57:43,  3.53it/s]
 90%|████████▉ | 333831/371472 [4:23:49<2:58:07,  3.52it/s]
 90%|████████▉ | 333832/371472 [4:23:49<2:54:28,  3.60it/s]
 90%|████████▉ | 333833/371472 [4:23:49<2:52:52,  3.63it/s]
 90%|████████▉ | 333834/371472 [4:23:49<3:01:35,  3.45it/s]
 90%|████████▉ | 333835/371472 [4:23:50<2:58:57,  3.51it/s]
 90%|████████▉ | 333836/371472 [4:23:50<2:57:05,  3.54it/s]
 90%|████████▉ | 333837/371472 [4:23:50<2:57:10,  3.54it/s]
 90%|████████▉ | 333838/371472 [4:23:51<2:51:30,  3.66it/s]
 90%|████████▉ | 333839/371472 [4:23:51<2:56:52,  3.55it/s]
 90%|████████▉ | 333840/371472 [4:23:51<2:53:02,  3.62it/s]
                                                           
{'loss': 2.5501, 'learning_rate': 1.9122368506108724e-07, 'epoch': 14.38}

 90%|████████▉ | 333840/371472 [4:23:51<2:53:02,  3.62it/s]
 90%|████████▉ | 333841/371472 [4:23:51<2:50:53,  3.67it/s]
 90%|████████▉ | 333842/371472 [4:23:52<2:50:02,  3.69it/s]
 90%|████████▉ | 333843/371472 [4:23:52<3:01:00,  3.46it/s]
 90%|████████▉ | 333844/371472 [4:23:52<3:03:08,  3.42it/s]
 90%|████████▉ | 333845/371472 [4:23:53<2:59:52,  3.49it/s]
 90%|████████▉ | 333846/371472 [4:23:53<2:52:51,  3.63it/s]
 90%|████████▉ | 333847/371472 [4:23:53<2:50:48,  3.67it/s]
 90%|████████▉ | 333848/371472 [4:23:53<2:49:36,  3.70it/s]
 90%|████████▉ | 333849/371472 [4:23:54<2:49:31,  3.70it/s]
 90%|████████▉ | 333850/371472 [4:23:54<2:56:24,  3.55it/s]
 90%|████████▉ | 333851/371472 [4:23:54<2:49:40,  3.70it/s]
 90%|████████▉ | 333852/371472 [4:23:54<2:48:28,  3.72it/s]
 90%|████████▉ | 333853/371472 [4:23:55<2:52:17,  3.64it/s]
 90%|████████▉ | 333854/371472 [4:23:55<2:55:57,  3.56it/s]
 90%|████████▉ | 333855/371472 [4:23:55<2:52:27,  3.64it/s]
 90%|████████▉ | 333856/371472 [4:23:56<2:57:52,  3.52it/s]
 90%|████████▉ | 333857/371472 [4:23:56<3:03:50,  3.41it/s]
 90%|████████▉ | 333858/371472 [4:23:56<3:06:17,  3.37it/s]
 90%|████████▉ | 333859/371472 [4:23:56<3:01:29,  3.45it/s]
 90%|████████▉ | 333860/371472 [4:23:57<3:02:39,  3.43it/s]
                                                           
{'loss': 2.5236, 'learning_rate': 1.9117520308560841e-07, 'epoch': 14.38}

 90%|████████▉ | 333860/371472 [4:23:57<3:02:39,  3.43it/s]
 90%|████████▉ | 333861/371472 [4:23:57<3:05:46,  3.37it/s]
 90%|████████▉ | 333862/371472 [4:23:57<3:08:20,  3.33it/s]
 90%|████████▉ | 333863/371472 [4:23:58<3:05:27,  3.38it/s]
 90%|████████▉ | 333864/371472 [4:23:58<3:13:00,  3.25it/s]
 90%|████████▉ | 333865/371472 [4:23:58<3:12:09,  3.26it/s]
 90%|████████▉ | 333866/371472 [4:23:59<3:00:22,  3.47it/s]
 90%|████████▉ | 333867/371472 [4:23:59<3:13:09,  3.24it/s]
 90%|████████▉ | 333868/371472 [4:23:59<3:06:33,  3.36it/s]
 90%|████████▉ | 333869/371472 [4:23:59<2:59:47,  3.49it/s]
 90%|████████▉ | 333870/371472 [4:24:00<2:55:57,  3.56it/s]
 90%|████████▉ | 333871/371472 [4:24:00<2:55:02,  3.58it/s]
 90%|████████▉ | 333872/371472 [4:24:00<2:55:50,  3.56it/s]
 90%|████████▉ | 333873/371472 [4:24:01<3:01:41,  3.45it/s]
 90%|████████▉ | 333874/371472 [4:24:01<2:59:18,  3.49it/s]
 90%|████████▉ | 333875/371472 [4:24:01<3:00:24,  3.47it/s]
 90%|████████▉ | 333876/371472 [4:24:01<2:54:02,  3.60it/s]
 90%|████████▉ | 333877/371472 [4:24:02<2:50:55,  3.67it/s]
 90%|████████▉ | 333878/371472 [4:24:02<2:48:48,  3.71it/s]
 90%|████████▉ | 333879/371472 [4:24:02<2:54:13,  3.60it/s]
 90%|████████▉ | 333880/371472 [4:24:03<2:54:59,  3.58it/s]
                                                           
{'loss': 2.5268, 'learning_rate': 1.9112672111012946e-07, 'epoch': 14.38}

 90%|████████▉ | 333880/371472 [4:24:03<2:54:59,  3.58it/s]
 90%|████████▉ | 333881/371472 [4:24:03<2:50:19,  3.68it/s]
 90%|████████▉ | 333882/371472 [4:24:03<2:48:31,  3.72it/s]
 90%|████████▉ | 333883/371472 [4:24:03<2:52:11,  3.64it/s]
 90%|████████▉ | 333884/371472 [4:24:04<2:49:12,  3.70it/s]
 90%|████████▉ | 333885/371472 [4:24:04<3:15:00,  3.21it/s]
 90%|████████▉ | 333886/371472 [4:24:04<3:12:44,  3.25it/s]
 90%|████████▉ | 333887/371472 [4:24:05<3:04:30,  3.40it/s]
 90%|████████▉ | 333888/371472 [4:24:05<3:20:51,  3.12it/s]
 90%|████████▉ | 333889/371472 [4:24:05<3:13:10,  3.24it/s]
 90%|████████▉ | 333890/371472 [4:24:05<3:02:36,  3.43it/s]
 90%|████████▉ | 333891/371472 [4:24:06<2:54:24,  3.59it/s]
 90%|████████▉ | 333892/371472 [4:24:06<2:51:59,  3.64it/s]
 90%|████████▉ | 333893/371472 [4:24:06<2:53:25,  3.61it/s]
 90%|████████▉ | 333894/371472 [4:24:07<2:57:21,  3.53it/s]
 90%|████████▉ | 333895/371472 [4:24:07<3:10:34,  3.29it/s]
 90%|████████▉ | 333896/371472 [4:24:07<2:58:34,  3.51it/s]
 90%|████████▉ | 333897/371472 [4:24:07<2:57:16,  3.53it/s]
 90%|████████▉ | 333898/371472 [4:24:08<2:56:52,  3.54it/s]
 90%|████████▉ | 333899/371472 [4:24:08<2:55:07,  3.58it/s]
 90%|████████▉ | 333900/371472 [4:24:08<2:52:52,  3.62it/s]
                                                           
{'loss': 2.6182, 'learning_rate': 1.910782391346506e-07, 'epoch': 14.38}

 90%|████████▉ | 333900/371472 [4:24:08<2:52:52,  3.62it/s]
 90%|████████▉ | 333901/371472 [4:24:09<2:53:53,  3.60it/s]
 90%|████████▉ | 333902/371472 [4:24:09<2:49:48,  3.69it/s]
 90%|████████▉ | 333903/371472 [4:24:09<2:53:34,  3.61it/s]
 90%|████████▉ | 333904/371472 [4:24:09<3:08:10,  3.33it/s]
 90%|████████▉ | 333905/371472 [4:24:10<3:08:16,  3.33it/s]
 90%|████████▉ | 333906/371472 [4:24:10<3:01:49,  3.44it/s]
 90%|████████▉ | 333907/371472 [4:24:10<2:57:30,  3.53it/s]
 90%|████████▉ | 333908/371472 [4:24:11<2:56:15,  3.55it/s]
 90%|████████▉ | 333909/371472 [4:24:11<2:54:35,  3.59it/s]
 90%|████████▉ | 333910/371472 [4:24:11<2:52:35,  3.63it/s]
 90%|████████▉ | 333911/371472 [4:24:11<2:50:02,  3.68it/s]
 90%|████████▉ | 333912/371472 [4:24:12<2:51:29,  3.65it/s]
 90%|████████▉ | 333913/371472 [4:24:12<2:48:56,  3.71it/s]
 90%|████████▉ | 333914/371472 [4:24:12<2:49:39,  3.69it/s]
 90%|████████▉ | 333915/371472 [4:24:12<2:51:58,  3.64it/s]
 90%|████████▉ | 333916/371472 [4:24:13<3:01:29,  3.45it/s]
 90%|████████▉ | 333917/371472 [4:24:13<3:01:01,  3.46it/s]
 90%|████████▉ | 333918/371472 [4:24:13<2:57:30,  3.53it/s]
 90%|████████▉ | 333919/371472 [4:24:14<3:01:36,  3.45it/s]
 90%|████████▉ | 333920/371472 [4:24:14<2:59:08,  3.49it/s]
                                                           
{'loss': 2.6905, 'learning_rate': 1.9102975715917168e-07, 'epoch': 14.38}

 90%|████████▉ | 333920/371472 [4:24:14<2:59:08,  3.49it/s]
 90%|████████▉ | 333921/371472 [4:24:14<2:53:05,  3.62it/s]
 90%|████████▉ | 333922/371472 [4:24:14<2:58:37,  3.50it/s]
 90%|████████▉ | 333923/371472 [4:24:15<2:56:20,  3.55it/s]
 90%|████████▉ | 333924/371472 [4:24:15<2:53:05,  3.62it/s]
 90%|████████▉ | 333925/371472 [4:24:15<2:48:59,  3.70it/s]
 90%|████████▉ | 333926/371472 [4:24:16<2:54:15,  3.59it/s]
 90%|████████▉ | 333927/371472 [4:24:16<2:49:48,  3.68it/s]
 90%|████████▉ | 333928/371472 [4:24:16<2:49:47,  3.69it/s]
 90%|████████▉ | 333929/371472 [4:24:16<2:51:23,  3.65it/s]
 90%|████████▉ | 333930/371472 [4:24:17<2:45:22,  3.78it/s]
 90%|████████▉ | 333931/371472 [4:24:17<2:44:48,  3.80it/s]
 90%|████████▉ | 333932/371472 [4:24:17<2:48:03,  3.72it/s]
 90%|████████▉ | 333933/371472 [4:24:17<2:48:00,  3.72it/s]
 90%|████████▉ | 333934/371472 [4:24:18<2:47:25,  3.74it/s]
 90%|████████▉ | 333935/371472 [4:24:18<2:51:34,  3.65it/s]
 90%|████████▉ | 333936/371472 [4:24:18<2:44:37,  3.80it/s]
 90%|████████▉ | 333937/371472 [4:24:19<2:59:36,  3.48it/s]
 90%|████████▉ | 333938/371472 [4:24:19<2:51:47,  3.64it/s]
 90%|████████▉ | 333939/371472 [4:24:19<2:48:52,  3.70it/s]
 90%|████████▉ | 333940/371472 [4:24:19<2:46:58,  3.75it/s]
                                                           
{'loss': 2.5728, 'learning_rate': 1.9098127518369283e-07, 'epoch': 14.38}

 90%|████████▉ | 333940/371472 [4:24:19<2:46:58,  3.75it/s]
 90%|████████▉ | 333941/371472 [4:24:20<2:51:46,  3.64it/s]
 90%|████████▉ | 333942/371472 [4:24:20<2:55:23,  3.57it/s]
 90%|████████▉ | 333943/371472 [4:24:20<2:53:30,  3.60it/s]
 90%|████████▉ | 333944/371472 [4:24:20<2:54:23,  3.59it/s]
 90%|████████▉ | 333945/371472 [4:24:21<3:06:18,  3.36it/s]
 90%|████████▉ | 333946/371472 [4:24:21<3:00:48,  3.46it/s]
 90%|████████▉ | 333947/371472 [4:24:21<2:51:49,  3.64it/s]
 90%|████████▉ | 333948/371472 [4:24:22<2:58:48,  3.50it/s]
 90%|████████▉ | 333949/371472 [4:24:22<2:53:12,  3.61it/s]
 90%|████████▉ | 333950/371472 [4:24:22<2:48:32,  3.71it/s]
 90%|████████▉ | 333951/371472 [4:24:22<2:46:39,  3.75it/s]
 90%|████████▉ | 333952/371472 [4:24:23<2:58:05,  3.51it/s]
 90%|████████▉ | 333953/371472 [4:24:23<2:50:06,  3.68it/s]
 90%|████████▉ | 333954/371472 [4:24:23<2:46:48,  3.75it/s]
 90%|████████▉ | 333955/371472 [4:24:24<2:53:10,  3.61it/s]
 90%|████████▉ | 333956/371472 [4:24:24<2:51:12,  3.65it/s]
 90%|████████▉ | 333957/371472 [4:24:24<2:51:47,  3.64it/s]
 90%|████████▉ | 333958/371472 [4:24:24<3:02:50,  3.42it/s]
 90%|████████▉ | 333959/371472 [4:24:25<3:05:39,  3.37it/s]
 90%|████████▉ | 333960/371472 [4:24:25<2:55:46,  3.56it/s]
                                                           
{'loss': 2.6816, 'learning_rate': 1.9093279320821388e-07, 'epoch': 14.38}

 90%|████████▉ | 333960/371472 [4:24:25<2:55:46,  3.56it/s]
 90%|████████▉ | 333961/371472 [4:24:25<2:54:05,  3.59it/s]
 90%|████████▉ | 333962/371472 [4:24:26<3:12:57,  3.24it/s]
 90%|████████▉ | 333963/371472 [4:24:26<3:02:08,  3.43it/s]
 90%|████████▉ | 333964/371472 [4:24:26<2:59:49,  3.48it/s]
 90%|████████▉ | 333965/371472 [4:24:26<2:55:07,  3.57it/s]
 90%|████████▉ | 333966/371472 [4:24:27<3:00:43,  3.46it/s]
 90%|████████▉ | 333967/371472 [4:24:27<2:54:22,  3.58it/s]
 90%|████████▉ | 333968/371472 [4:24:27<2:46:21,  3.76it/s]
 90%|████████▉ | 333969/371472 [4:24:27<2:50:32,  3.67it/s]
 90%|████████▉ | 333970/371472 [4:24:28<2:45:03,  3.79it/s]
 90%|████████▉ | 333971/371472 [4:24:28<2:45:24,  3.78it/s]
 90%|████████▉ | 333972/371472 [4:24:28<2:47:06,  3.74it/s]
 90%|████████▉ | 333973/371472 [4:24:29<2:47:33,  3.73it/s]
 90%|████████▉ | 333974/371472 [4:24:29<2:45:49,  3.77it/s]
 90%|████████▉ | 333975/371472 [4:24:29<2:44:54,  3.79it/s]
 90%|████████▉ | 333976/371472 [4:24:29<2:44:48,  3.79it/s]
 90%|████████▉ | 333977/371472 [4:24:30<2:43:00,  3.83it/s]
 90%|████████▉ | 333978/371472 [4:24:30<2:54:29,  3.58it/s]
 90%|████████▉ | 333979/371472 [4:24:30<2:50:27,  3.67it/s]
 90%|████████▉ | 333980/371472 [4:24:30<2:44:53,  3.79it/s]
                                                           
{'loss': 2.5127, 'learning_rate': 1.9088431123273505e-07, 'epoch': 14.39}

 90%|████████▉ | 333980/371472 [4:24:30<2:44:53,  3.79it/s]
 90%|████████▉ | 333981/371472 [4:24:31<2:53:13,  3.61it/s]
 90%|████████▉ | 333982/371472 [4:24:31<2:49:20,  3.69it/s]
 90%|████████▉ | 333983/371472 [4:24:31<2:55:44,  3.56it/s]
 90%|████████▉ | 333984/371472 [4:24:32<3:02:09,  3.43it/s]
 90%|████████▉ | 333985/371472 [4:24:32<3:00:58,  3.45it/s]
 90%|████████▉ | 333986/371472 [4:24:32<2:53:34,  3.60it/s]
 90%|████████▉ | 333987/371472 [4:24:32<2:55:14,  3.56it/s]
 90%|████████▉ | 333988/371472 [4:24:33<2:50:38,  3.66it/s]
 90%|████████▉ | 333989/371472 [4:24:33<2:48:00,  3.72it/s]
 90%|████████▉ | 333990/371472 [4:24:33<2:52:03,  3.63it/s]
 90%|████████▉ | 333991/371472 [4:24:34<2:57:36,  3.52it/s]
 90%|████████▉ | 333992/371472 [4:24:34<2:53:10,  3.61it/s]
 90%|████████▉ | 333993/371472 [4:24:34<2:49:12,  3.69it/s]
 90%|████████▉ | 333994/371472 [4:24:34<2:53:42,  3.60it/s]
 90%|████████▉ | 333995/371472 [4:24:35<3:04:31,  3.38it/s]
 90%|████████▉ | 333996/371472 [4:24:35<2:54:50,  3.57it/s]
 90%|████████▉ | 333997/371472 [4:24:35<2:49:53,  3.68it/s]
 90%|████████▉ | 333998/371472 [4:24:35<2:45:03,  3.78it/s]
 90%|████████▉ | 333999/371472 [4:24:36<2:52:00,  3.63it/s]
 90%|████████▉ | 334000/371472 [4:24:36<3:00:18,  3.46it/s]
                                                           
{'loss': 2.657, 'learning_rate': 1.9083582925725613e-07, 'epoch': 14.39}

 90%|████████▉ | 334000/371472 [4:24:36<3:00:18,  3.46it/s]
 90%|████████▉ | 334001/371472 [4:24:36<3:07:37,  3.33it/s]
 90%|████████▉ | 334002/371472 [4:24:37<3:05:11,  3.37it/s]
 90%|████████▉ | 334003/371472 [4:24:37<3:02:07,  3.43it/s]
 90%|████████▉ | 334004/371472 [4:24:37<2:57:38,  3.52it/s]
 90%|████████▉ | 334005/371472 [4:24:37<2:59:30,  3.48it/s]
 90%|████████▉ | 334006/371472 [4:24:38<2:55:06,  3.57it/s]
 90%|████████▉ | 334007/371472 [4:24:38<2:52:25,  3.62it/s]
 90%|████████▉ | 334008/371472 [4:24:38<3:21:18,  3.10it/s]
 90%|████████▉ | 334009/371472 [4:24:39<3:05:27,  3.37it/s]
 90%|████████▉ | 334010/371472 [4:24:39<3:04:51,  3.38it/s]
 90%|████████▉ | 334011/371472 [4:24:39<3:03:20,  3.41it/s]
 90%|████████▉ | 334012/371472 [4:24:40<2:55:57,  3.55it/s]
 90%|████████▉ | 334013/371472 [4:24:40<2:49:24,  3.69it/s]
 90%|████████▉ | 334014/371472 [4:24:40<2:48:32,  3.70it/s]
 90%|████████▉ | 334015/371472 [4:24:40<2:50:59,  3.65it/s]
 90%|████████▉ | 334016/371472 [4:24:41<2:53:24,  3.60it/s]
 90%|████████▉ | 334017/371472 [4:24:41<3:06:17,  3.35it/s]
 90%|████████▉ | 334018/371472 [4:24:41<2:56:39,  3.53it/s]
 90%|████████▉ | 334019/371472 [4:24:41<2:53:37,  3.60it/s]
 90%|████████▉ | 334020/371472 [4:24:42<2:57:27,  3.52it/s]
                                                           
{'loss': 2.5883, 'learning_rate': 1.9078734728177725e-07, 'epoch': 14.39}

 90%|████████▉ | 334020/371472 [4:24:42<2:57:27,  3.52it/s]
 90%|████████▉ | 334021/371472 [4:24:42<2:56:09,  3.54it/s]
 90%|████████▉ | 334022/371472 [4:24:42<2:51:26,  3.64it/s]
 90%|████████▉ | 334023/371472 [4:24:43<3:03:38,  3.40it/s]
 90%|████████▉ | 334024/371472 [4:24:43<2:57:29,  3.52it/s]
 90%|████████▉ | 334025/371472 [4:24:43<3:06:08,  3.35it/s]
 90%|████████▉ | 334026/371472 [4:24:43<2:56:53,  3.53it/s]
 90%|████████▉ | 334027/371472 [4:24:44<2:57:13,  3.52it/s]
 90%|████████▉ | 334028/371472 [4:24:44<2:59:39,  3.47it/s]
 90%|████████▉ | 334029/371472 [4:24:44<2:56:37,  3.53it/s]
 90%|████████▉ | 334030/371472 [4:24:45<2:50:59,  3.65it/s]
 90%|████████▉ | 334031/371472 [4:24:45<2:50:42,  3.66it/s]
 90%|████████▉ | 334032/371472 [4:24:45<2:56:21,  3.54it/s]
 90%|████████▉ | 334033/371472 [4:24:45<2:49:36,  3.68it/s]
 90%|████████▉ | 334034/371472 [4:24:46<2:55:00,  3.57it/s]
 90%|████████▉ | 334035/371472 [4:24:46<2:52:22,  3.62it/s]
 90%|████████▉ | 334036/371472 [4:24:46<2:58:54,  3.49it/s]
 90%|████████▉ | 334037/371472 [4:24:47<2:53:10,  3.60it/s]
 90%|████████▉ | 334038/371472 [4:24:47<3:02:54,  3.41it/s]
 90%|████████▉ | 334039/371472 [4:24:47<2:54:17,  3.58it/s]
 90%|████████▉ | 334040/371472 [4:24:47<3:05:02,  3.37it/s]
                                                           
{'loss': 2.6041, 'learning_rate': 1.9073886530629832e-07, 'epoch': 14.39}

 90%|████████▉ | 334040/371472 [4:24:47<3:05:02,  3.37it/s]
 90%|████████▉ | 334041/371472 [4:24:48<2:56:15,  3.54it/s]
 90%|████████▉ | 334042/371472 [4:24:48<3:01:42,  3.43it/s]
 90%|████████▉ | 334043/371472 [4:24:48<2:53:11,  3.60it/s]
 90%|████████▉ | 334044/371472 [4:24:49<2:49:54,  3.67it/s]
 90%|████████▉ | 334045/371472 [4:24:49<2:51:08,  3.64it/s]
 90%|████████▉ | 334046/371472 [4:24:49<2:55:38,  3.55it/s]
 90%|████████▉ | 334047/371472 [4:24:49<2:55:23,  3.56it/s]
 90%|████████▉ | 334048/371472 [4:24:50<2:49:30,  3.68it/s]
 90%|████████▉ | 334049/371472 [4:24:50<2:54:05,  3.58it/s]
 90%|████████▉ | 334050/371472 [4:24:50<2:51:07,  3.64it/s]
 90%|████████▉ | 334051/371472 [4:24:50<2:58:34,  3.49it/s]
 90%|████████▉ | 334052/371472 [4:24:51<3:05:44,  3.36it/s]
 90%|████████▉ | 334053/371472 [4:24:51<3:05:44,  3.36it/s]
 90%|████████▉ | 334054/371472 [4:24:51<3:10:18,  3.28it/s]
 90%|████████▉ | 334055/371472 [4:24:52<3:03:26,  3.40it/s]
 90%|████████▉ | 334056/371472 [4:24:52<2:55:24,  3.56it/s]
 90%|████████▉ | 334057/371472 [4:24:52<2:56:17,  3.54it/s]
 90%|████████▉ | 334058/371472 [4:24:52<2:49:22,  3.68it/s]
 90%|████████▉ | 334059/371472 [4:24:53<3:03:39,  3.40it/s]
 90%|████████▉ | 334060/371472 [4:24:53<3:06:26,  3.34it/s]
                                                           
{'loss': 2.5847, 'learning_rate': 1.906903833308195e-07, 'epoch': 14.39}

 90%|████████▉ | 334060/371472 [4:24:53<3:06:26,  3.34it/s]
 90%|████████▉ | 334061/371472 [4:24:53<3:14:45,  3.20it/s]
 90%|████████▉ | 334062/371472 [4:24:54<3:06:57,  3.33it/s]
 90%|████████▉ | 334063/371472 [4:24:54<2:59:34,  3.47it/s]
 90%|████████▉ | 334064/371472 [4:24:54<2:54:17,  3.58it/s]
 90%|████████▉ | 334065/371472 [4:24:55<2:58:28,  3.49it/s]
 90%|████████▉ | 334066/371472 [4:24:55<3:03:40,  3.39it/s]
 90%|████████▉ | 334067/371472 [4:24:55<2:59:10,  3.48it/s]
 90%|████████▉ | 334068/371472 [4:24:55<3:02:21,  3.42it/s]
 90%|████████▉ | 334069/371472 [4:24:56<2:51:36,  3.63it/s]
 90%|████████▉ | 334070/371472 [4:24:56<2:48:30,  3.70it/s]
 90%|████████▉ | 334071/371472 [4:24:56<2:54:06,  3.58it/s]
 90%|████████▉ | 334072/371472 [4:24:57<2:54:16,  3.58it/s]
 90%|████████▉ | 334073/371472 [4:24:57<2:51:24,  3.64it/s]
 90%|████████▉ | 334074/371472 [4:24:57<2:49:25,  3.68it/s]
 90%|████████▉ | 334075/371472 [4:24:57<2:54:00,  3.58it/s]
 90%|████████▉ | 334076/371472 [4:24:58<2:49:03,  3.69it/s]
 90%|████████▉ | 334077/371472 [4:24:58<2:51:13,  3.64it/s]
 90%|████████▉ | 334078/371472 [4:24:58<2:49:48,  3.67it/s]
 90%|████████▉ | 334079/371472 [4:24:58<2:48:56,  3.69it/s]
 90%|████████▉ | 334080/371472 [4:24:59<2:50:28,  3.66it/s]
                                                           
{'loss': 2.6398, 'learning_rate': 1.9064190135534054e-07, 'epoch': 14.39}

 90%|████████▉ | 334080/371472 [4:24:59<2:50:28,  3.66it/s]
 90%|████████▉ | 334081/371472 [4:24:59<2:49:30,  3.68it/s]
 90%|████████▉ | 334082/371472 [4:24:59<2:52:44,  3.61it/s]
 90%|████████▉ | 334083/371472 [4:25:00<2:51:48,  3.63it/s]
 90%|████████▉ | 334084/371472 [4:25:00<2:47:08,  3.73it/s]
 90%|████████▉ | 334085/371472 [4:25:00<2:42:10,  3.84it/s]
 90%|████████▉ | 334086/371472 [4:25:00<2:40:22,  3.89it/s]
 90%|████████▉ | 334087/371472 [4:25:01<2:40:21,  3.89it/s]
 90%|████████▉ | 334088/371472 [4:25:01<2:52:15,  3.62it/s]
 90%|████████▉ | 334089/371472 [4:25:01<3:01:59,  3.42it/s]
 90%|████████▉ | 334090/371472 [4:25:01<2:54:56,  3.56it/s]
 90%|████████▉ | 334091/371472 [4:25:02<3:07:42,  3.32it/s]
 90%|████████▉ | 334092/371472 [4:25:02<3:05:00,  3.37it/s]
 90%|████████▉ | 334093/371472 [4:25:02<2:55:57,  3.54it/s]
 90%|████████▉ | 334094/371472 [4:25:03<2:50:23,  3.66it/s]
 90%|████████▉ | 334095/371472 [4:25:03<2:49:48,  3.67it/s]
 90%|████████▉ | 334096/371472 [4:25:03<2:49:31,  3.67it/s]
 90%|████████▉ | 334097/371472 [4:25:03<2:51:42,  3.63it/s]
 90%|████████▉ | 334098/371472 [4:25:04<2:56:03,  3.54it/s]
 90%|████████▉ | 334099/371472 [4:25:04<2:52:52,  3.60it/s]
 90%|████████▉ | 334100/371472 [4:25:04<2:49:45,  3.67it/s]
                                                           
{'loss': 2.8185, 'learning_rate': 1.905934193798617e-07, 'epoch': 14.39}

 90%|████████▉ | 334100/371472 [4:25:04<2:49:45,  3.67it/s]
 90%|████████▉ | 334101/371472 [4:25:05<2:55:42,  3.54it/s]
 90%|████████▉ | 334102/371472 [4:25:05<2:54:16,  3.57it/s]
 90%|████████▉ | 334103/371472 [4:25:05<2:55:21,  3.55it/s]
 90%|████████▉ | 334104/371472 [4:25:05<2:51:56,  3.62it/s]
 90%|████████▉ | 334105/371472 [4:25:06<2:50:29,  3.65it/s]
 90%|████████▉ | 334106/371472 [4:25:06<2:46:03,  3.75it/s]
 90%|████████▉ | 334107/371472 [4:25:06<2:48:43,  3.69it/s]
 90%|████████▉ | 334108/371472 [4:25:07<3:02:37,  3.41it/s]
 90%|████████▉ | 334109/371472 [4:25:07<3:04:15,  3.38it/s]
 90%|████████▉ | 334110/371472 [4:25:07<3:05:38,  3.35it/s]
 90%|████████▉ | 334111/371472 [4:25:07<2:53:31,  3.59it/s]
 90%|████████▉ | 334112/371472 [4:25:08<2:51:12,  3.64it/s]
 90%|████████▉ | 334113/371472 [4:25:08<2:58:23,  3.49it/s]
 90%|████████▉ | 334114/371472 [4:25:08<3:12:51,  3.23it/s]
 90%|████████▉ | 334115/371472 [4:25:09<3:00:36,  3.45it/s]
 90%|████████▉ | 334116/371472 [4:25:09<3:08:16,  3.31it/s]
 90%|████████▉ | 334117/371472 [4:25:09<3:00:59,  3.44it/s]
 90%|████████▉ | 334118/371472 [4:25:09<3:03:40,  3.39it/s]
 90%|████████▉ | 334119/371472 [4:25:10<3:02:19,  3.41it/s]
 90%|████████▉ | 334120/371472 [4:25:10<2:51:20,  3.63it/s]
                                                           
{'loss': 2.5429, 'learning_rate': 1.9054493740438277e-07, 'epoch': 14.39}

 90%|████████▉ | 334120/371472 [4:25:10<2:51:20,  3.63it/s]
 90%|████████▉ | 334121/371472 [4:25:10<2:49:18,  3.68it/s]
 90%|████████▉ | 334122/371472 [4:25:10<2:48:37,  3.69it/s]
 90%|████████▉ | 334123/371472 [4:25:11<2:58:20,  3.49it/s]
 90%|████████▉ | 334124/371472 [4:25:11<2:51:02,  3.64it/s]
 90%|████████▉ | 334125/371472 [4:25:11<2:46:23,  3.74it/s]
 90%|████████▉ | 334126/371472 [4:25:12<2:44:41,  3.78it/s]
 90%|████████▉ | 334127/371472 [4:25:12<2:46:14,  3.74it/s]
 90%|████████▉ | 334128/371472 [4:25:12<2:40:03,  3.89it/s]
 90%|████████▉ | 334129/371472 [4:25:12<2:43:25,  3.81it/s]
 90%|████████▉ | 334130/371472 [4:25:13<2:47:55,  3.71it/s]
 90%|████████▉ | 334131/371472 [4:25:13<2:47:56,  3.71it/s]
 90%|████████▉ | 334132/371472 [4:25:13<3:02:06,  3.42it/s]
 90%|████████▉ | 334133/371472 [4:25:14<2:56:04,  3.53it/s]
 90%|████████▉ | 334134/371472 [4:25:14<3:05:49,  3.35it/s]
 90%|████████▉ | 334135/371472 [4:25:14<3:03:02,  3.40it/s]
 90%|████████▉ | 334136/371472 [4:25:14<2:54:49,  3.56it/s]
 90%|████████▉ | 334137/371472 [4:25:15<2:49:05,  3.68it/s]
 90%|████████▉ | 334138/371472 [4:25:15<3:01:29,  3.43it/s]
 90%|████████▉ | 334139/371472 [4:25:15<3:01:18,  3.43it/s]
 90%|████████▉ | 334140/371472 [4:25:16<2:51:10,  3.63it/s]
                                                           
{'loss': 2.7483, 'learning_rate': 1.9049645542890392e-07, 'epoch': 14.39}

 90%|████████▉ | 334140/371472 [4:25:16<2:51:10,  3.63it/s]
 90%|████████▉ | 334141/371472 [4:25:16<3:08:45,  3.30it/s]
 90%|████████▉ | 334142/371472 [4:25:16<3:04:43,  3.37it/s]
 90%|████████▉ | 334143/371472 [4:25:16<3:08:13,  3.31it/s]
 90%|████████▉ | 334144/371472 [4:25:17<3:05:00,  3.36it/s]
 90%|████████▉ | 334145/371472 [4:25:17<3:13:31,  3.21it/s]
 90%|████████▉ | 334146/371472 [4:25:17<3:01:58,  3.42it/s]
 90%|████████▉ | 334147/371472 [4:25:18<3:00:13,  3.45it/s]
 90%|████████▉ | 334148/371472 [4:25:18<2:57:00,  3.51it/s]
 90%|████████▉ | 334149/371472 [4:25:18<2:51:27,  3.63it/s]
 90%|████████▉ | 334150/371472 [4:25:18<2:47:00,  3.72it/s]
 90%|████████▉ | 334151/371472 [4:25:19<2:47:30,  3.71it/s]
 90%|████████▉ | 334152/371472 [4:25:19<2:47:17,  3.72it/s]
 90%|████████▉ | 334153/371472 [4:25:19<2:57:04,  3.51it/s]
 90%|████████▉ | 334154/371472 [4:25:20<2:50:58,  3.64it/s]
 90%|████████▉ | 334155/371472 [4:25:20<2:45:11,  3.77it/s]
 90%|████████▉ | 334156/371472 [4:25:20<2:39:36,  3.90it/s]
 90%|████████▉ | 334157/371472 [4:25:20<2:38:14,  3.93it/s]
 90%|████████▉ | 334158/371472 [4:25:21<2:54:21,  3.57it/s]
 90%|████████▉ | 334159/371472 [4:25:21<3:01:54,  3.42it/s]
 90%|████████▉ | 334160/371472 [4:25:21<3:10:36,  3.26it/s]
                                                           
{'loss': 2.543, 'learning_rate': 1.90447973453425e-07, 'epoch': 14.39}

 90%|████████▉ | 334160/371472 [4:25:21<3:10:36,  3.26it/s]
 90%|████████▉ | 334161/371472 [4:25:22<3:06:58,  3.33it/s]
 90%|████████▉ | 334162/371472 [4:25:22<3:04:29,  3.37it/s]
 90%|████████▉ | 334163/371472 [4:25:22<3:04:23,  3.37it/s]
 90%|████████▉ | 334164/371472 [4:25:22<3:03:11,  3.39it/s]
 90%|████████▉ | 334165/371472 [4:25:23<3:10:16,  3.27it/s]
 90%|████████▉ | 334166/371472 [4:25:23<3:04:02,  3.38it/s]
 90%|████████▉ | 334167/371472 [4:25:23<2:56:40,  3.52it/s]
 90%|████████▉ | 334168/371472 [4:25:24<2:55:13,  3.55it/s]
 90%|████████▉ | 334169/371472 [4:25:24<2:49:23,  3.67it/s]
 90%|████████▉ | 334170/371472 [4:25:24<2:57:52,  3.50it/s]
 90%|████████▉ | 334171/371472 [4:25:24<2:51:55,  3.62it/s]
 90%|████████▉ | 334172/371472 [4:25:25<2:47:46,  3.71it/s]
 90%|████████▉ | 334173/371472 [4:25:25<2:55:28,  3.54it/s]
 90%|████████▉ | 334174/371472 [4:25:25<2:55:23,  3.54it/s]
 90%|████████▉ | 334175/371472 [4:25:25<2:51:57,  3.62it/s]
 90%|████████▉ | 334176/371472 [4:25:26<2:49:23,  3.67it/s]
 90%|████████▉ | 334177/371472 [4:25:26<2:54:29,  3.56it/s]
 90%|████████▉ | 334178/371472 [4:25:26<3:00:06,  3.45it/s]
 90%|████████▉ | 334179/371472 [4:25:27<3:06:40,  3.33it/s]
 90%|████████▉ | 334180/371472 [4:25:27<2:57:41,  3.50it/s]
                                                           
{'loss': 2.5561, 'learning_rate': 1.9039949147794614e-07, 'epoch': 14.39}

 90%|████████▉ | 334180/371472 [4:25:27<2:57:41,  3.50it/s]
 90%|████████▉ | 334181/371472 [4:25:27<2:51:55,  3.61it/s]
 90%|████████▉ | 334182/371472 [4:25:27<2:51:20,  3.63it/s]
 90%|████████▉ | 334183/371472 [4:25:28<2:54:22,  3.56it/s]
 90%|████████▉ | 334184/371472 [4:25:28<2:48:01,  3.70it/s]
 90%|████████▉ | 334185/371472 [4:25:28<2:46:44,  3.73it/s]
 90%|████████▉ | 334186/371472 [4:25:29<2:46:34,  3.73it/s]
 90%|████████▉ | 334187/371472 [4:25:29<3:29:14,  2.97it/s]
 90%|████████▉ | 334188/371472 [4:25:29<3:11:45,  3.24it/s]
 90%|████████▉ | 334189/371472 [4:25:30<2:58:24,  3.48it/s]
 90%|████████▉ | 334190/371472 [4:25:30<2:53:10,  3.59it/s]
 90%|████████▉ | 334191/371472 [4:25:30<2:56:44,  3.52it/s]
 90%|████████▉ | 334192/371472 [4:25:30<2:58:16,  3.49it/s]
 90%|████████▉ | 334193/371472 [4:25:31<3:04:38,  3.36it/s]
 90%|████████▉ | 334194/371472 [4:25:31<2:58:01,  3.49it/s]
 90%|████████▉ | 334195/371472 [4:25:31<3:00:00,  3.45it/s]
 90%|████████▉ | 334196/371472 [4:25:32<2:59:29,  3.46it/s]
 90%|████████▉ | 334197/371472 [4:25:32<2:57:54,  3.49it/s]
 90%|████████▉ | 334198/371472 [4:25:32<2:58:12,  3.49it/s]
 90%|████████▉ | 334199/371472 [4:25:32<2:58:48,  3.47it/s]
 90%|████████▉ | 334200/371472 [4:25:33<2:56:12,  3.53it/s]
                                                           
{'loss': 2.6713, 'learning_rate': 1.9035100950246718e-07, 'epoch': 14.39}

 90%|████████▉ | 334200/371472 [4:25:33<2:56:12,  3.53it/s]
 90%|████████▉ | 334201/371472 [4:25:33<3:04:24,  3.37it/s]
 90%|████████▉ | 334202/371472 [4:25:33<3:01:50,  3.42it/s]
 90%|████████▉ | 334203/371472 [4:25:34<2:54:41,  3.56it/s]
 90%|████████▉ | 334204/371472 [4:25:34<2:47:50,  3.70it/s]
 90%|████████▉ | 334205/371472 [4:25:34<2:41:41,  3.84it/s]
 90%|████████▉ | 334206/371472 [4:25:34<2:59:58,  3.45it/s]
 90%|████████▉ | 334207/371472 [4:25:35<2:57:35,  3.50it/s]
 90%|████████▉ | 334208/371472 [4:25:35<2:49:33,  3.66it/s]
 90%|████████▉ | 334209/371472 [4:25:35<2:45:44,  3.75it/s]
 90%|████████▉ | 334210/371472 [4:25:35<2:51:57,  3.61it/s]
 90%|████████▉ | 334211/371472 [4:25:36<2:46:25,  3.73it/s]
 90%|████████▉ | 334212/371472 [4:25:36<2:58:14,  3.48it/s]
 90%|████████▉ | 334213/371472 [4:25:36<3:03:04,  3.39it/s]
 90%|████████▉ | 334214/371472 [4:25:37<3:03:53,  3.38it/s]
 90%|████████▉ | 334215/371472 [4:25:37<3:02:28,  3.40it/s]
 90%|████████▉ | 334216/371472 [4:25:37<2:53:05,  3.59it/s]
 90%|████████▉ | 334217/371472 [4:25:37<2:45:39,  3.75it/s]
 90%|████████▉ | 334218/371472 [4:25:38<2:41:02,  3.86it/s]
 90%|████████▉ | 334219/371472 [4:25:38<3:02:34,  3.40it/s]
 90%|████████▉ | 334220/371472 [4:25:38<3:04:27,  3.37it/s]
                                                           
{'loss': 2.5461, 'learning_rate': 1.9030252752698823e-07, 'epoch': 14.4}

 90%|████████▉ | 334220/371472 [4:25:38<3:04:27,  3.37it/s]
 90%|████████▉ | 334221/371472 [4:25:39<3:13:46,  3.20it/s]
 90%|████████▉ | 334222/371472 [4:25:39<3:06:38,  3.33it/s]
 90%|████████▉ | 334223/371472 [4:25:39<3:06:57,  3.32it/s]
 90%|████████▉ | 334224/371472 [4:25:40<2:58:37,  3.48it/s]
 90%|████████▉ | 334225/371472 [4:25:40<2:54:44,  3.55it/s]
 90%|████████▉ | 334226/371472 [4:25:40<2:55:49,  3.53it/s]
 90%|████████▉ | 334227/371472 [4:25:40<2:50:10,  3.65it/s]
 90%|████████▉ | 334228/371472 [4:25:41<2:45:37,  3.75it/s]
 90%|████████▉ | 334229/371472 [4:25:41<2:50:40,  3.64it/s]
 90%|████████▉ | 334230/371472 [4:25:41<2:44:57,  3.76it/s]
 90%|████████▉ | 334231/371472 [4:25:41<2:47:11,  3.71it/s]
 90%|████████▉ | 334232/371472 [4:25:42<2:45:25,  3.75it/s]
 90%|████████▉ | 334233/371472 [4:25:42<2:41:33,  3.84it/s]
 90%|████████▉ | 334234/371472 [4:25:42<2:41:56,  3.83it/s]
 90%|████████▉ | 334235/371472 [4:25:42<2:44:59,  3.76it/s]
 90%|████████▉ | 334236/371472 [4:25:43<2:48:03,  3.69it/s]
 90%|████████▉ | 334237/371472 [4:25:43<2:47:29,  3.71it/s]
 90%|████████▉ | 334238/371472 [4:25:43<2:45:05,  3.76it/s]
 90%|████████▉ | 334239/371472 [4:25:44<2:52:40,  3.59it/s]
 90%|████████▉ | 334240/371472 [4:25:44<2:56:36,  3.51it/s]
                                                           
{'loss': 2.4818, 'learning_rate': 1.902540455515094e-07, 'epoch': 14.4}

 90%|████████▉ | 334240/371472 [4:25:44<2:56:36,  3.51it/s]
 90%|████████▉ | 334241/371472 [4:25:44<2:57:25,  3.50it/s]
 90%|████████▉ | 334242/371472 [4:25:44<3:06:27,  3.33it/s]
 90%|████████▉ | 334243/371472 [4:25:45<3:04:10,  3.37it/s]
 90%|████████▉ | 334244/371472 [4:25:45<2:54:01,  3.57it/s]
 90%|████████▉ | 334245/371472 [4:25:45<3:03:20,  3.38it/s]
 90%|████████▉ | 334246/371472 [4:25:46<2:54:50,  3.55it/s]
 90%|████████▉ | 334247/371472 [4:25:46<2:47:16,  3.71it/s]
 90%|████████▉ | 334248/371472 [4:25:46<2:56:24,  3.52it/s]
 90%|████████▉ | 334249/371472 [4:25:46<2:51:27,  3.62it/s]
 90%|████████▉ | 334250/371472 [4:25:47<2:46:48,  3.72it/s]
 90%|████████▉ | 334251/371472 [4:25:47<2:44:01,  3.78it/s]
 90%|████████▉ | 334252/371472 [4:25:47<2:55:20,  3.54it/s]
 90%|████████▉ | 334253/371472 [4:25:48<2:58:42,  3.47it/s]
 90%|████████▉ | 334254/371472 [4:25:48<3:06:16,  3.33it/s]
 90%|████████▉ | 334255/371472 [4:25:48<3:04:55,  3.35it/s]
 90%|████████▉ | 334256/371472 [4:25:48<3:05:36,  3.34it/s]
 90%|████████▉ | 334257/371472 [4:25:49<3:02:49,  3.39it/s]
 90%|████████▉ | 334258/371472 [4:25:49<3:10:11,  3.26it/s]
 90%|████████▉ | 334259/371472 [4:25:49<3:01:51,  3.41it/s]
 90%|████████▉ | 334260/371472 [4:25:50<2:55:31,  3.53it/s]
                                                           
{'loss': 2.6773, 'learning_rate': 1.9020556357603045e-07, 'epoch': 14.4}

 90%|████████▉ | 334260/371472 [4:25:50<2:55:31,  3.53it/s]
 90%|████████▉ | 334261/371472 [4:25:50<2:54:13,  3.56it/s]
 90%|████████▉ | 334262/371472 [4:25:50<2:54:51,  3.55it/s]
 90%|████████▉ | 334263/371472 [4:25:50<2:51:28,  3.62it/s]
 90%|████████▉ | 334264/371472 [4:25:51<2:43:33,  3.79it/s]
 90%|████████▉ | 334265/371472 [4:25:51<2:41:32,  3.84it/s]
 90%|████████▉ | 334266/371472 [4:25:51<2:41:53,  3.83it/s]
 90%|████████▉ | 334267/371472 [4:25:51<2:45:52,  3.74it/s]
 90%|████████▉ | 334268/371472 [4:25:52<2:46:08,  3.73it/s]
 90%|████████▉ | 334269/371472 [4:25:52<3:00:01,  3.44it/s]
 90%|████████▉ | 334270/371472 [4:25:52<3:03:56,  3.37it/s]
 90%|████████▉ | 334271/371472 [4:25:53<2:54:49,  3.55it/s]
 90%|████████▉ | 334272/371472 [4:25:53<2:48:39,  3.68it/s]
 90%|████████▉ | 334273/371472 [4:25:53<2:48:03,  3.69it/s]
 90%|████████▉ | 334274/371472 [4:25:53<2:46:19,  3.73it/s]
 90%|████████▉ | 334275/371472 [4:25:54<2:48:43,  3.67it/s]
 90%|████████▉ | 334276/371472 [4:25:54<2:49:34,  3.66it/s]
 90%|████████▉ | 334277/371472 [4:25:54<2:57:05,  3.50it/s]
 90%|████████▉ | 334278/371472 [4:25:55<3:02:35,  3.40it/s]
 90%|████████▉ | 334279/371472 [4:25:55<3:03:57,  3.37it/s]
 90%|████████▉ | 334280/371472 [4:25:55<2:59:38,  3.45it/s]
                                                           
{'loss': 2.7351, 'learning_rate': 1.901570816005516e-07, 'epoch': 14.4}

 90%|████████▉ | 334280/371472 [4:25:55<2:59:38,  3.45it/s]
 90%|████████▉ | 334281/371472 [4:25:55<2:50:54,  3.63it/s]
 90%|████████▉ | 334282/371472 [4:25:56<2:54:14,  3.56it/s]
 90%|████████▉ | 334283/371472 [4:25:56<2:50:32,  3.63it/s]
 90%|████████▉ | 334284/371472 [4:25:56<2:52:32,  3.59it/s]
 90%|████████▉ | 334285/371472 [4:25:56<2:49:43,  3.65it/s]
 90%|████████▉ | 334286/371472 [4:25:57<2:53:18,  3.58it/s]
 90%|████████▉ | 334287/371472 [4:25:57<2:50:58,  3.62it/s]
 90%|████████▉ | 334288/371472 [4:25:57<2:46:43,  3.72it/s]
 90%|████████▉ | 334289/371472 [4:25:58<2:56:48,  3.51it/s]
 90%|████████▉ | 334290/371472 [4:25:58<3:01:28,  3.41it/s]
 90%|████████▉ | 334291/371472 [4:25:58<3:32:19,  2.92it/s]
 90%|████████▉ | 334292/371472 [4:25:59<3:19:33,  3.11it/s]
 90%|████████▉ | 334293/371472 [4:25:59<3:15:02,  3.18it/s]
 90%|████████▉ | 334294/371472 [4:25:59<3:13:48,  3.20it/s]
 90%|████████▉ | 334295/371472 [4:26:00<3:03:36,  3.37it/s]
 90%|████████▉ | 334296/371472 [4:26:00<2:58:28,  3.47it/s]
 90%|████████▉ | 334297/371472 [4:26:00<2:58:40,  3.47it/s]
 90%|████████▉ | 334298/371472 [4:26:00<3:01:08,  3.42it/s]
 90%|████████▉ | 334299/371472 [4:26:01<2:56:32,  3.51it/s]
 90%|████████▉ | 334300/371472 [4:26:01<2:56:48,  3.50it/s]
                                                           
{'loss': 2.4528, 'learning_rate': 1.9010859962507267e-07, 'epoch': 14.4}

 90%|████████▉ | 334300/371472 [4:26:01<2:56:48,  3.50it/s]
 90%|████████▉ | 334301/371472 [4:26:01<3:04:17,  3.36it/s]
 90%|████████▉ | 334302/371472 [4:26:02<2:57:12,  3.50it/s]
 90%|████████▉ | 334303/371472 [4:26:02<2:51:04,  3.62it/s]
 90%|████████▉ | 334304/371472 [4:26:02<2:49:57,  3.64it/s]
 90%|████████▉ | 334305/371472 [4:26:02<2:59:24,  3.45it/s]
 90%|████████▉ | 334306/371472 [4:26:03<2:56:44,  3.50it/s]
 90%|████████▉ | 334307/371472 [4:26:03<2:52:10,  3.60it/s]
 90%|████████▉ | 334308/371472 [4:26:03<3:16:37,  3.15it/s]
 90%|████████▉ | 334309/371472 [4:26:04<3:13:37,  3.20it/s]
 90%|████████▉ | 334310/371472 [4:26:04<3:02:03,  3.40it/s]
 90%|████████▉ | 334311/371472 [4:26:04<2:58:07,  3.48it/s]
 90%|████████▉ | 334312/371472 [4:26:04<2:49:32,  3.65it/s]
 90%|████████▉ | 334313/371472 [4:26:05<2:47:12,  3.70it/s]
 90%|████████▉ | 334314/371472 [4:26:05<2:44:30,  3.76it/s]
 90%|████████▉ | 334315/371472 [4:26:05<2:42:44,  3.81it/s]
 90%|████████▉ | 334316/371472 [4:26:05<2:46:17,  3.72it/s]
 90%|████████▉ | 334317/371472 [4:26:06<2:43:55,  3.78it/s]
 90%|████████▉ | 334318/371472 [4:26:06<2:44:53,  3.76it/s]
 90%|████████▉ | 334319/371472 [4:26:06<2:46:35,  3.72it/s]
 90%|████████▉ | 334320/371472 [4:26:07<2:47:59,  3.69it/s]
                                                           
{'loss': 2.6231, 'learning_rate': 1.9006011764959383e-07, 'epoch': 14.4}

 90%|████████▉ | 334320/371472 [4:26:07<2:47:59,  3.69it/s]
 90%|████████▉ | 334321/371472 [4:26:07<2:44:42,  3.76it/s]
 90%|████████▉ | 334322/371472 [4:26:07<2:50:40,  3.63it/s]
 90%|████████▉ | 334323/371472 [4:26:07<2:57:09,  3.49it/s]
 90%|████████▉ | 334324/371472 [4:26:08<2:53:01,  3.58it/s]
 90%|█████████ | 334325/371472 [4:26:08<2:47:10,  3.70it/s]
 90%|█████████ | 334326/371472 [4:26:08<2:41:26,  3.83it/s]
 90%|█████████ | 334327/371472 [4:26:08<2:36:20,  3.96it/s]
 90%|█████████ | 334328/371472 [4:26:09<2:39:59,  3.87it/s]
 90%|█████████ | 334329/371472 [4:26:09<2:52:46,  3.58it/s]
 90%|█████████ | 334330/371472 [4:26:09<2:47:10,  3.70it/s]
 90%|█████████ | 334331/371472 [4:26:10<2:54:21,  3.55it/s]
 90%|█████████ | 334332/371472 [4:26:10<3:09:01,  3.27it/s]
 90%|█████████ | 334333/371472 [4:26:10<3:11:35,  3.23it/s]
 90%|█████████ | 334334/371472 [4:26:11<3:08:51,  3.28it/s]
 90%|█████████ | 334335/371472 [4:26:11<3:03:17,  3.38it/s]
 90%|█████████ | 334336/371472 [4:26:11<3:05:40,  3.33it/s]
 90%|█████████ | 334337/371472 [4:26:11<2:57:17,  3.49it/s]
 90%|█████████ | 334338/371472 [4:26:12<2:49:39,  3.65it/s]
 90%|█████████ | 334339/371472 [4:26:12<3:05:29,  3.34it/s]
 90%|█████████ | 334340/371472 [4:26:12<2:55:50,  3.52it/s]
                                                           
{'loss': 2.6343, 'learning_rate': 1.9001163567411487e-07, 'epoch': 14.4}

 90%|█████████ | 334340/371472 [4:26:12<2:55:50,  3.52it/s]
 90%|█████████ | 334341/371472 [4:26:12<2:57:39,  3.48it/s]
 90%|█████████ | 334342/371472 [4:26:13<2:52:17,  3.59it/s]
 90%|█████████ | 334343/371472 [4:26:13<2:47:50,  3.69it/s]
 90%|█████████ | 334344/371472 [4:26:13<2:55:53,  3.52it/s]
 90%|█████████ | 334345/371472 [4:26:14<2:55:46,  3.52it/s]
 90%|█████████ | 334346/371472 [4:26:14<3:12:17,  3.22it/s]
 90%|█████████ | 334347/371472 [4:26:14<3:20:43,  3.08it/s]
 90%|█████████ | 334348/371472 [4:26:15<3:06:43,  3.31it/s]
 90%|█████████ | 334349/371472 [4:26:15<2:58:40,  3.46it/s]
 90%|█████████ | 334350/371472 [4:26:15<3:03:54,  3.36it/s]
 90%|█████████ | 334351/371472 [4:26:15<2:59:21,  3.45it/s]
 90%|█████████ | 334352/371472 [4:26:16<2:59:17,  3.45it/s]
 90%|█████████ | 334353/371472 [4:26:16<3:00:57,  3.42it/s]
 90%|█████████ | 334354/371472 [4:26:16<3:18:18,  3.12it/s]
 90%|█████████ | 334355/371472 [4:26:17<3:15:54,  3.16it/s]
 90%|█████████ | 334356/371472 [4:26:17<3:13:11,  3.20it/s]
 90%|█████████ | 334357/371472 [4:26:17<3:18:26,  3.12it/s]
 90%|█████████ | 334358/371472 [4:26:18<3:05:32,  3.33it/s]
 90%|█████████ | 334359/371472 [4:26:18<3:05:16,  3.34it/s]
 90%|█████████ | 334360/371472 [4:26:18<2:54:34,  3.54it/s]
                                                           
{'loss': 2.7862, 'learning_rate': 1.8996315369863605e-07, 'epoch': 14.4}

 90%|█████████ | 334360/371472 [4:26:18<2:54:34,  3.54it/s]
 90%|█████████ | 334361/371472 [4:26:18<2:52:29,  3.59it/s]
 90%|█████████ | 334362/371472 [4:26:19<2:46:54,  3.71it/s]
 90%|█████████ | 334363/371472 [4:26:19<2:55:15,  3.53it/s]
 90%|█████████ | 334364/371472 [4:26:19<2:54:19,  3.55it/s]
 90%|█████████ | 334365/371472 [4:26:20<2:48:49,  3.66it/s]
 90%|█████████ | 334366/371472 [4:26:20<2:56:03,  3.51it/s]
 90%|█████████ | 334367/371472 [4:26:20<2:48:56,  3.66it/s]
 90%|█████████ | 334368/371472 [4:26:20<2:42:04,  3.82it/s]
 90%|█████████ | 334369/371472 [4:26:21<2:47:48,  3.69it/s]
 90%|█████████ | 334370/371472 [4:26:21<2:46:37,  3.71it/s]
 90%|█████████ | 334371/371472 [4:26:21<2:44:50,  3.75it/s]
 90%|█████████ | 334372/371472 [4:26:21<2:45:12,  3.74it/s]
 90%|█████████ | 334373/371472 [4:26:22<2:42:46,  3.80it/s]
 90%|█████████ | 334374/371472 [4:26:22<2:42:46,  3.80it/s]
 90%|█████████ | 334375/371472 [4:26:22<2:42:56,  3.79it/s]
 90%|█████████ | 334376/371472 [4:26:22<2:38:50,  3.89it/s]
 90%|█████████ | 334377/371472 [4:26:23<2:41:22,  3.83it/s]
 90%|█████████ | 334378/371472 [4:26:23<2:36:40,  3.95it/s]
 90%|█████████ | 334379/371472 [4:26:23<2:52:40,  3.58it/s]
 90%|█████████ | 334380/371472 [4:26:24<2:56:09,  3.51it/s]
                                                           
{'loss': 2.7393, 'learning_rate': 1.8991467172315712e-07, 'epoch': 14.4}

 90%|█████████ | 334380/371472 [4:26:24<2:56:09,  3.51it/s]
 90%|█████████ | 334381/371472 [4:26:24<3:00:57,  3.42it/s]
 90%|█████████ | 334382/371472 [4:26:24<2:53:46,  3.56it/s]
 90%|█████████ | 334383/371472 [4:26:24<2:52:09,  3.59it/s]
 90%|█████████ | 334384/371472 [4:26:25<2:44:38,  3.75it/s]
 90%|█████████ | 334385/371472 [4:26:25<2:47:21,  3.69it/s]
 90%|█████████ | 334386/371472 [4:26:25<2:51:50,  3.60it/s]
 90%|█████████ | 334387/371472 [4:26:26<2:55:17,  3.53it/s]
 90%|█████████ | 334388/371472 [4:26:26<3:00:42,  3.42it/s]
 90%|█████████ | 334389/371472 [4:26:26<2:54:34,  3.54it/s]
 90%|█████████ | 334390/371472 [4:26:26<2:51:44,  3.60it/s]
 90%|█████████ | 334391/371472 [4:26:27<2:48:31,  3.67it/s]
 90%|█████████ | 334392/371472 [4:26:27<2:47:03,  3.70it/s]
 90%|█████████ | 334393/371472 [4:26:27<2:58:32,  3.46it/s]
 90%|█████████ | 334394/371472 [4:26:27<2:50:36,  3.62it/s]
 90%|█████████ | 334395/371472 [4:26:28<2:48:46,  3.66it/s]
 90%|█████████ | 334396/371472 [4:26:28<2:50:40,  3.62it/s]
 90%|█████████ | 334397/371472 [4:26:28<2:42:48,  3.80it/s]
 90%|█████████ | 334398/371472 [4:26:29<2:50:20,  3.63it/s]
 90%|█████████ | 334399/371472 [4:26:29<2:49:09,  3.65it/s]
 90%|█████████ | 334400/371472 [4:26:29<2:53:05,  3.57it/s]
                                                           
{'loss': 2.6667, 'learning_rate': 1.8986618974767824e-07, 'epoch': 14.4}

 90%|█████████ | 334400/371472 [4:26:29<2:53:05,  3.57it/s]
 90%|█████████ | 334401/371472 [4:26:29<2:48:40,  3.66it/s]
 90%|█████████ | 334402/371472 [4:26:30<2:45:42,  3.73it/s]
 90%|█████████ | 334403/371472 [4:26:30<2:51:37,  3.60it/s]
 90%|█████████ | 334404/371472 [4:26:30<2:43:16,  3.78it/s]
 90%|█████████ | 334405/371472 [4:26:30<2:54:03,  3.55it/s]
 90%|█████████ | 334406/371472 [4:26:31<2:52:19,  3.58it/s]
 90%|█████████ | 334407/371472 [4:26:31<3:00:38,  3.42it/s]
 90%|█████████ | 334408/371472 [4:26:31<2:54:57,  3.53it/s]
 90%|█████████ | 334409/371472 [4:26:32<2:57:20,  3.48it/s]
 90%|█████████ | 334410/371472 [4:26:32<2:55:12,  3.53it/s]
 90%|█████████ | 334411/371472 [4:26:32<3:10:47,  3.24it/s]
 90%|█████████ | 334412/371472 [4:26:33<3:08:59,  3.27it/s]
 90%|█████████ | 334413/371472 [4:26:33<2:58:00,  3.47it/s]
 90%|█████████ | 334414/371472 [4:26:33<2:58:35,  3.46it/s]
 90%|█████████ | 334415/371472 [4:26:33<2:56:08,  3.51it/s]
 90%|█████████ | 334416/371472 [4:26:34<2:48:30,  3.67it/s]
 90%|█████████ | 334417/371472 [4:26:34<2:45:28,  3.73it/s]
 90%|█████████ | 334418/371472 [4:26:34<2:46:19,  3.71it/s]
 90%|█████████ | 334419/371472 [4:26:34<2:50:15,  3.63it/s]
 90%|█████████ | 334420/371472 [4:26:35<2:56:12,  3.50it/s]
                                                           
{'loss': 2.5224, 'learning_rate': 1.8981770777219932e-07, 'epoch': 14.4}

 90%|█████████ | 334420/371472 [4:26:35<2:56:12,  3.50it/s]
 90%|█████████ | 334421/371472 [4:26:35<2:51:36,  3.60it/s]
 90%|█████████ | 334422/371472 [4:26:35<2:44:14,  3.76it/s]
 90%|█████████ | 334423/371472 [4:26:36<2:58:46,  3.45it/s]
 90%|█████████ | 334424/371472 [4:26:36<2:53:41,  3.55it/s]
 90%|█████████ | 334425/371472 [4:26:36<2:57:02,  3.49it/s]
 90%|█████████ | 334426/371472 [4:26:36<3:03:15,  3.37it/s]
 90%|█████████ | 334427/371472 [4:26:37<2:56:43,  3.49it/s]
 90%|█████████ | 334428/371472 [4:26:37<2:54:30,  3.54it/s]
 90%|█████████ | 334429/371472 [4:26:37<2:48:31,  3.66it/s]
 90%|█████████ | 334430/371472 [4:26:38<2:48:53,  3.66it/s]
 90%|█████████ | 334431/371472 [4:26:38<2:45:06,  3.74it/s]
 90%|█████████ | 334432/371472 [4:26:38<2:48:30,  3.66it/s]
 90%|█████████ | 334433/371472 [4:26:38<2:57:36,  3.48it/s]
 90%|█████████ | 334434/371472 [4:26:39<2:55:56,  3.51it/s]
 90%|█████████ | 334435/371472 [4:26:39<2:51:51,  3.59it/s]
 90%|█████████ | 334436/371472 [4:26:39<2:53:21,  3.56it/s]
 90%|█████████ | 334437/371472 [4:26:40<3:01:11,  3.41it/s]
 90%|█████████ | 334438/371472 [4:26:40<2:55:44,  3.51it/s]
 90%|█████████ | 334439/371472 [4:26:40<2:54:56,  3.53it/s]
 90%|█████████ | 334440/371472 [4:26:40<2:46:21,  3.71it/s]
                                                           
{'loss': 2.6811, 'learning_rate': 1.897692257967205e-07, 'epoch': 14.4}

 90%|█████████ | 334440/371472 [4:26:40<2:46:21,  3.71it/s]
 90%|█████████ | 334441/371472 [4:26:41<2:49:34,  3.64it/s]
 90%|█████████ | 334442/371472 [4:26:41<2:49:41,  3.64it/s]
 90%|█████████ | 334443/371472 [4:26:41<2:45:56,  3.72it/s]
 90%|█████████ | 334444/371472 [4:26:41<2:45:31,  3.73it/s]
 90%|█████████ | 334445/371472 [4:26:42<2:42:49,  3.79it/s]
 90%|█████████ | 334446/371472 [4:26:42<2:40:01,  3.86it/s]
 90%|█████████ | 334447/371472 [4:26:42<2:37:34,  3.92it/s]
 90%|█████████ | 334448/371472 [4:26:42<2:40:43,  3.84it/s]
 90%|█████████ | 334449/371472 [4:26:43<2:41:17,  3.83it/s]
 90%|█████████ | 334450/371472 [4:26:43<2:44:47,  3.74it/s]
 90%|█████████ | 334451/371472 [4:26:43<2:50:17,  3.62it/s]
 90%|█████████ | 334452/371472 [4:26:44<2:50:46,  3.61it/s]
 90%|█████████ | 334453/371472 [4:26:44<3:07:36,  3.29it/s]
 90%|█████████ | 334454/371472 [4:26:44<3:11:47,  3.22it/s]
 90%|█████████ | 334455/371472 [4:26:45<3:02:21,  3.38it/s]
 90%|█████████ | 334456/371472 [4:26:45<3:01:31,  3.40it/s]
 90%|█████████ | 334457/371472 [4:26:45<2:57:17,  3.48it/s]
 90%|█████████ | 334458/371472 [4:26:45<3:01:13,  3.40it/s]
 90%|█████████ | 334459/371472 [4:26:46<3:05:10,  3.33it/s]
 90%|█████████ | 334460/371472 [4:26:46<2:54:00,  3.54it/s]
                                                           
{'loss': 2.4879, 'learning_rate': 1.8972074382124154e-07, 'epoch': 14.41}

 90%|█████████ | 334460/371472 [4:26:46<2:54:00,  3.54it/s]
 90%|█████████ | 334461/371472 [4:26:46<2:54:27,  3.54it/s]
 90%|█████████ | 334462/371472 [4:26:46<2:50:26,  3.62it/s]
 90%|█████████ | 334463/371472 [4:26:47<2:48:59,  3.65it/s]
 90%|█████████ | 334464/371472 [4:26:47<2:44:49,  3.74it/s]
 90%|█████████ | 334465/371472 [4:26:47<2:42:54,  3.79it/s]
 90%|█████████ | 334466/371472 [4:26:48<2:54:15,  3.54it/s]
 90%|█████████ | 334467/371472 [4:26:48<2:51:15,  3.60it/s]
 90%|█████████ | 334468/371472 [4:26:48<2:57:54,  3.47it/s]
 90%|█████████ | 334469/371472 [4:26:49<3:11:49,  3.21it/s]
 90%|█████████ | 334470/371472 [4:26:49<3:10:58,  3.23it/s]
 90%|█████████ | 334471/371472 [4:26:49<3:02:31,  3.38it/s]
 90%|█████████ | 334472/371472 [4:26:49<2:57:57,  3.47it/s]
 90%|█████████ | 334473/371472 [4:26:50<2:55:11,  3.52it/s]
 90%|█████████ | 334474/371472 [4:26:50<2:56:37,  3.49it/s]
 90%|█████████ | 334475/371472 [4:26:50<2:48:35,  3.66it/s]
 90%|█████████ | 334476/371472 [4:26:50<2:55:31,  3.51it/s]
 90%|█████████ | 334477/371472 [4:26:51<2:57:29,  3.47it/s]
 90%|█████████ | 334478/371472 [4:26:51<3:00:01,  3.42it/s]
 90%|█████████ | 334479/371472 [4:26:51<2:56:04,  3.50it/s]
 90%|█████████ | 334480/371472 [4:26:52<3:00:15,  3.42it/s]
                                                           
{'loss': 2.4633, 'learning_rate': 1.896722618457627e-07, 'epoch': 14.41}

 90%|█████████ | 334480/371472 [4:26:52<3:00:15,  3.42it/s]
 90%|█████████ | 334481/371472 [4:26:52<2:52:50,  3.57it/s]
 90%|█████████ | 334482/371472 [4:26:52<2:53:48,  3.55it/s]
 90%|█████████ | 334483/371472 [4:26:52<2:49:55,  3.63it/s]
 90%|█████████ | 334484/371472 [4:26:53<2:48:05,  3.67it/s]
 90%|█████████ | 334485/371472 [4:26:53<2:56:30,  3.49it/s]
 90%|█████████ | 334486/371472 [4:26:53<2:48:11,  3.66it/s]
 90%|█████████ | 334487/371472 [4:26:54<2:42:40,  3.79it/s]
 90%|█████████ | 334488/371472 [4:26:54<3:01:15,  3.40it/s]
 90%|█████████ | 334489/371472 [4:26:54<3:02:56,  3.37it/s]
 90%|█████████ | 334490/371472 [4:26:54<2:54:57,  3.52it/s]
 90%|█████████ | 334491/371472 [4:26:55<2:49:21,  3.64it/s]
 90%|█████████ | 334492/371472 [4:26:55<3:03:28,  3.36it/s]
 90%|█████████ | 334493/371472 [4:26:55<3:02:43,  3.37it/s]
 90%|█████████ | 334494/371472 [4:26:56<3:01:53,  3.39it/s]
 90%|█████████ | 334495/371472 [4:26:56<3:03:36,  3.36it/s]
 90%|█████████ | 334496/371472 [4:26:56<3:07:41,  3.28it/s]
 90%|█████████ | 334497/371472 [4:26:57<3:00:00,  3.42it/s]
 90%|█████████ | 334498/371472 [4:26:57<2:57:14,  3.48it/s]
 90%|█████████ | 334499/371472 [4:26:57<2:47:52,  3.67it/s]
 90%|█████████ | 334500/371472 [4:26:57<2:42:58,  3.78it/s]
                                                           
{'loss': 2.4411, 'learning_rate': 1.8962377987028376e-07, 'epoch': 14.41}

 90%|█████████ | 334500/371472 [4:26:57<2:42:58,  3.78it/s]
 90%|█████████ | 334501/371472 [4:26:58<2:49:30,  3.64it/s]
 90%|█████████ | 334502/371472 [4:26:58<2:44:38,  3.74it/s]
 90%|█████████ | 334503/371472 [4:26:58<2:43:53,  3.76it/s]
 90%|█████████ | 334504/371472 [4:26:58<2:47:10,  3.69it/s]
 90%|█████████ | 334505/371472 [4:26:59<2:44:35,  3.74it/s]
 90%|█████████ | 334506/371472 [4:26:59<2:41:06,  3.82it/s]
 90%|█████████ | 334507/371472 [4:26:59<2:50:19,  3.62it/s]
 90%|█████████ | 334508/371472 [4:27:00<2:57:08,  3.48it/s]
 90%|█████████ | 334509/371472 [4:27:00<2:50:17,  3.62it/s]
 90%|█████████ | 334510/371472 [4:27:00<2:47:32,  3.68it/s]
 90%|█████████ | 334511/371472 [4:27:00<2:49:49,  3.63it/s]
 90%|█████████ | 334512/371472 [4:27:01<2:57:23,  3.47it/s]
 90%|█████████ | 334513/371472 [4:27:01<3:01:50,  3.39it/s]
 90%|█████████ | 334514/371472 [4:27:01<2:50:56,  3.60it/s]
 90%|█████████ | 334515/371472 [4:27:01<2:52:47,  3.56it/s]
 90%|█████████ | 334516/371472 [4:27:02<2:54:45,  3.52it/s]
 90%|█████████ | 334517/371472 [4:27:02<2:50:01,  3.62it/s]
 90%|█████████ | 334518/371472 [4:27:02<2:59:07,  3.44it/s]
 90%|█████████ | 334519/371472 [4:27:03<2:55:12,  3.52it/s]
 90%|█████████ | 334520/371472 [4:27:03<2:50:22,  3.61it/s]
                                                           
{'loss': 2.6143, 'learning_rate': 1.895752978948049e-07, 'epoch': 14.41}

 90%|█████████ | 334520/371472 [4:27:03<2:50:22,  3.61it/s]
 90%|█████████ | 334521/371472 [4:27:03<2:43:58,  3.76it/s]
 90%|█████████ | 334522/371472 [4:27:03<2:46:12,  3.71it/s]
 90%|█████████ | 334523/371472 [4:27:04<2:44:43,  3.74it/s]
 90%|█████████ | 334524/371472 [4:27:04<2:43:11,  3.77it/s]
 90%|█████████ | 334525/371472 [4:27:04<2:50:08,  3.62it/s]
 90%|█████████ | 334526/371472 [4:27:04<2:45:03,  3.73it/s]
 90%|█████████ | 334527/371472 [4:27:05<2:47:31,  3.68it/s]
 90%|█████████ | 334528/371472 [4:27:05<2:47:43,  3.67it/s]
 90%|█████████ | 334529/371472 [4:27:05<2:51:35,  3.59it/s]
 90%|█████████ | 334530/371472 [4:27:06<2:55:13,  3.51it/s]
 90%|█████████ | 334531/371472 [4:27:06<2:56:05,  3.50it/s]
 90%|█████████ | 334532/371472 [4:27:06<3:09:00,  3.26it/s]
 90%|█████████ | 334533/371472 [4:27:06<2:55:56,  3.50it/s]
 90%|█████████ | 334534/371472 [4:27:07<2:53:12,  3.55it/s]
 90%|█████████ | 334535/371472 [4:27:07<2:46:14,  3.70it/s]
 90%|█████████ | 334536/371472 [4:27:07<2:41:17,  3.82it/s]
 90%|█████████ | 334537/371472 [4:27:08<2:42:39,  3.78it/s]
 90%|█████████ | 334538/371472 [4:27:08<2:50:36,  3.61it/s]
 90%|█████████ | 334539/371472 [4:27:08<2:53:39,  3.54it/s]
 90%|█████████ | 334540/371472 [4:27:08<2:45:56,  3.71it/s]
                                                           
{'loss': 2.494, 'learning_rate': 1.8952681591932596e-07, 'epoch': 14.41}

 90%|█████████ | 334540/371472 [4:27:08<2:45:56,  3.71it/s]
 90%|█████████ | 334541/371472 [4:27:09<2:54:55,  3.52it/s]
 90%|█████████ | 334542/371472 [4:27:09<2:50:13,  3.62it/s]
 90%|█████████ | 334543/371472 [4:27:09<2:44:18,  3.75it/s]
 90%|█████████ | 334544/371472 [4:27:10<3:05:47,  3.31it/s]
 90%|█████████ | 334545/371472 [4:27:10<2:57:29,  3.47it/s]
 90%|█████████ | 334546/371472 [4:27:10<2:54:54,  3.52it/s]
 90%|█████████ | 334547/371472 [4:27:10<2:56:01,  3.50it/s]
 90%|█████████ | 334548/371472 [4:27:11<3:12:30,  3.20it/s]
 90%|█████████ | 334549/371472 [4:27:11<3:02:07,  3.38it/s]
 90%|█████████ | 334550/371472 [4:27:11<3:05:32,  3.32it/s]
 90%|█████████ | 334551/371472 [4:27:12<3:01:48,  3.38it/s]
 90%|█████████ | 334552/371472 [4:27:12<3:12:09,  3.20it/s]
 90%|█████████ | 334553/371472 [4:27:12<3:02:15,  3.38it/s]
 90%|█████████ | 334554/371472 [4:27:13<3:00:39,  3.41it/s]
 90%|█████████ | 334555/371472 [4:27:13<2:59:52,  3.42it/s]
 90%|█████████ | 334556/371472 [4:27:13<2:53:45,  3.54it/s]
 90%|█████████ | 334557/371472 [4:27:13<3:05:15,  3.32it/s]
 90%|█████████ | 334558/371472 [4:27:14<3:08:50,  3.26it/s]
 90%|█████████ | 334559/371472 [4:27:14<2:58:41,  3.44it/s]
 90%|█████████ | 334560/371472 [4:27:14<3:00:37,  3.41it/s]
                                                           
{'loss': 2.4457, 'learning_rate': 1.8947833394384713e-07, 'epoch': 14.41}

 90%|█████████ | 334560/371472 [4:27:14<3:00:37,  3.41it/s]
 90%|█████████ | 334561/371472 [4:27:15<2:55:15,  3.51it/s]
 90%|█████████ | 334562/371472 [4:27:15<2:52:23,  3.57it/s]
 90%|█████████ | 334563/371472 [4:27:15<2:49:32,  3.63it/s]
 90%|█████████ | 334564/371472 [4:27:15<2:51:50,  3.58it/s]
 90%|█████████ | 334565/371472 [4:27:16<2:59:15,  3.43it/s]
 90%|█████████ | 334566/371472 [4:27:16<2:56:12,  3.49it/s]
 90%|█████████ | 334567/371472 [4:27:16<2:59:15,  3.43it/s]
 90%|█████████ | 334568/371472 [4:27:17<2:56:14,  3.49it/s]
 90%|█████████ | 334569/371472 [4:27:17<2:49:32,  3.63it/s]
 90%|█████████ | 334570/371472 [4:27:17<2:52:32,  3.56it/s]
 90%|█████████ | 334571/371472 [4:27:17<2:45:50,  3.71it/s]
 90%|█████████ | 334572/371472 [4:27:18<3:01:58,  3.38it/s]
 90%|█████████ | 334573/371472 [4:27:18<3:15:37,  3.14it/s]
 90%|█████████ | 334574/371472 [4:27:18<3:03:40,  3.35it/s]
 90%|█████████ | 334575/371472 [4:27:19<2:54:47,  3.52it/s]
 90%|█████████ | 334576/371472 [4:27:19<2:52:00,  3.57it/s]
 90%|█████████ | 334577/371472 [4:27:19<2:48:25,  3.65it/s]
 90%|█████████ | 334578/371472 [4:27:19<2:48:10,  3.66it/s]
 90%|█████████ | 334579/371472 [4:27:20<3:05:38,  3.31it/s]
 90%|█████████ | 334580/371472 [4:27:20<2:59:34,  3.42it/s]
                                                           
{'loss': 2.4504, 'learning_rate': 1.8942985196836815e-07, 'epoch': 14.41}

 90%|█████████ | 334580/371472 [4:27:20<2:59:34,  3.42it/s]
 90%|█████████ | 334581/371472 [4:27:20<2:56:51,  3.48it/s]
 90%|█████████ | 334582/371472 [4:27:21<3:03:24,  3.35it/s]
 90%|█████████ | 334583/371472 [4:27:21<2:56:41,  3.48it/s]
 90%|█████████ | 334584/371472 [4:27:21<2:48:47,  3.64it/s]
 90%|█████████ | 334585/371472 [4:27:21<2:55:03,  3.51it/s]
 90%|█████████ | 334586/371472 [4:27:22<2:51:59,  3.57it/s]
 90%|█████████ | 334587/371472 [4:27:22<2:45:45,  3.71it/s]
 90%|█████████ | 334588/371472 [4:27:22<2:46:34,  3.69it/s]
 90%|█████████ | 334589/371472 [4:27:22<2:39:36,  3.85it/s]
 90%|█████████ | 334590/371472 [4:27:23<2:38:00,  3.89it/s]
 90%|█████████ | 334591/371472 [4:27:23<2:36:48,  3.92it/s]
 90%|█████████ | 334592/371472 [4:27:23<2:39:28,  3.85it/s]
 90%|█████████ | 334593/371472 [4:27:23<2:41:18,  3.81it/s]
 90%|█████████ | 334594/371472 [4:27:24<2:40:38,  3.83it/s]
 90%|█████████ | 334595/371472 [4:27:24<2:45:55,  3.70it/s]
 90%|█████████ | 334596/371472 [4:27:24<2:48:32,  3.65it/s]
 90%|█████████ | 334597/371472 [4:27:25<3:04:05,  3.34it/s]
 90%|█████████ | 334598/371472 [4:27:25<3:07:56,  3.27it/s]
 90%|█████████ | 334599/371472 [4:27:25<3:08:49,  3.25it/s]
 90%|█████████ | 334600/371472 [4:27:26<3:04:05,  3.34it/s]
                                                           
{'loss': 2.7062, 'learning_rate': 1.8938136999288933e-07, 'epoch': 14.41}

 90%|█████████ | 334600/371472 [4:27:26<3:04:05,  3.34it/s]
 90%|█████████ | 334601/371472 [4:27:26<3:15:27,  3.14it/s]
 90%|█████████ | 334602/371472 [4:27:26<3:12:26,  3.19it/s]
 90%|█████████ | 334603/371472 [4:27:27<3:06:21,  3.30it/s]
 90%|█████████ | 334604/371472 [4:27:27<2:54:32,  3.52it/s]
 90%|█████████ | 334605/371472 [4:27:27<2:52:39,  3.56it/s]
 90%|█████████ | 334606/371472 [4:27:27<2:59:32,  3.42it/s]
 90%|█████████ | 334607/371472 [4:27:28<3:02:03,  3.37it/s]
 90%|█████████ | 334608/371472 [4:27:28<2:56:55,  3.47it/s]
 90%|█████████ | 334609/371472 [4:27:28<2:58:06,  3.45it/s]
 90%|█████████ | 334610/371472 [4:27:29<2:57:43,  3.46it/s]
 90%|█████████ | 334611/371472 [4:27:29<2:56:41,  3.48it/s]
 90%|█████████ | 334612/371472 [4:27:29<2:48:08,  3.65it/s]
 90%|█████████ | 334613/371472 [4:27:29<2:42:33,  3.78it/s]
 90%|█████████ | 334614/371472 [4:27:30<2:45:54,  3.70it/s]
 90%|█████████ | 334615/371472 [4:27:30<2:48:46,  3.64it/s]
 90%|█████████ | 334616/371472 [4:27:30<2:49:38,  3.62it/s]
 90%|█████████ | 334617/371472 [4:27:30<2:50:27,  3.60it/s]
 90%|█████████ | 334618/371472 [4:27:31<3:17:48,  3.11it/s]
 90%|█████████ | 334619/371472 [4:27:31<3:19:06,  3.08it/s]
 90%|█████████ | 334620/371472 [4:27:31<3:14:44,  3.15it/s]
                                                           
{'loss': 2.6154, 'learning_rate': 1.893328880174104e-07, 'epoch': 14.41}

 90%|█████████ | 334620/371472 [4:27:31<3:14:44,  3.15it/s]
 90%|█████████ | 334621/371472 [4:27:32<3:03:08,  3.35it/s]
 90%|█████████ | 334622/371472 [4:27:32<2:55:33,  3.50it/s]
 90%|█████████ | 334623/371472 [4:27:32<2:53:42,  3.54it/s]
 90%|█████████ | 334624/371472 [4:27:33<2:49:07,  3.63it/s]
 90%|█████████ | 334625/371472 [4:27:33<2:59:53,  3.41it/s]
 90%|█████████ | 334626/371472 [4:27:33<2:53:25,  3.54it/s]
 90%|█████████ | 334627/371472 [4:27:33<2:49:51,  3.62it/s]
 90%|█████████ | 334628/371472 [4:27:34<2:59:39,  3.42it/s]
 90%|█████████ | 334629/371472 [4:27:34<2:56:44,  3.47it/s]
 90%|█████████ | 334630/371472 [4:27:34<2:54:27,  3.52it/s]
 90%|█████████ | 334631/371472 [4:27:35<2:50:03,  3.61it/s]
 90%|█████████ | 334632/371472 [4:27:35<2:46:01,  3.70it/s]
 90%|█████████ | 334633/371472 [4:27:35<2:48:16,  3.65it/s]
 90%|█████████ | 334634/371472 [4:27:35<2:51:06,  3.59it/s]
 90%|█████████ | 334635/371472 [4:27:36<2:50:20,  3.60it/s]
 90%|█████████ | 334636/371472 [4:27:36<2:46:30,  3.69it/s]
 90%|█████████ | 334637/371472 [4:27:36<2:53:45,  3.53it/s]
 90%|█████████ | 334638/371472 [4:27:36<2:54:16,  3.52it/s]
 90%|█████████ | 334639/371472 [4:27:37<2:48:35,  3.64it/s]
 90%|█████████ | 334640/371472 [4:27:37<2:42:44,  3.77it/s]
                                                           
{'loss': 2.6459, 'learning_rate': 1.8928440604193155e-07, 'epoch': 14.41}

 90%|█████████ | 334640/371472 [4:27:37<2:42:44,  3.77it/s]
 90%|█████████ | 334641/371472 [4:27:37<2:42:43,  3.77it/s]
 90%|█████████ | 334642/371472 [4:27:37<2:36:01,  3.93it/s]
 90%|█████████ | 334643/371472 [4:27:38<2:38:45,  3.87it/s]
 90%|█████████ | 334644/371472 [4:27:38<2:50:25,  3.60it/s]
 90%|█████████ | 334645/371472 [4:27:38<2:44:05,  3.74it/s]
 90%|█████████ | 334646/371472 [4:27:39<2:43:32,  3.75it/s]
 90%|█████████ | 334647/371472 [4:27:39<2:41:05,  3.81it/s]
 90%|█████████ | 334648/371472 [4:27:39<2:43:25,  3.76it/s]
 90%|█████████ | 334649/371472 [4:27:39<2:44:48,  3.72it/s]
 90%|█████████ | 334650/371472 [4:27:40<2:43:57,  3.74it/s]
 90%|█████████ | 334651/371472 [4:27:40<2:42:10,  3.78it/s]
 90%|█████████ | 334652/371472 [4:27:40<2:42:39,  3.77it/s]
 90%|█████████ | 334653/371472 [4:27:40<2:40:39,  3.82it/s]
 90%|█████████ | 334654/371472 [4:27:41<2:38:22,  3.87it/s]
 90%|█████████ | 334655/371472 [4:27:41<2:40:30,  3.82it/s]
 90%|█████████ | 334656/371472 [4:27:41<2:37:10,  3.90it/s]
 90%|█████████ | 334657/371472 [4:27:42<2:56:43,  3.47it/s]
 90%|█████████ | 334658/371472 [4:27:42<2:48:53,  3.63it/s]
 90%|█████████ | 334659/371472 [4:27:42<2:42:37,  3.77it/s]
 90%|█████████ | 334660/371472 [4:27:42<2:42:36,  3.77it/s]
                                                           
{'loss': 2.7839, 'learning_rate': 1.892359240664526e-07, 'epoch': 14.41}

 90%|█████████ | 334660/371472 [4:27:42<2:42:36,  3.77it/s]
 90%|█████████ | 334661/371472 [4:27:43<2:44:18,  3.73it/s]
 90%|█████████ | 334662/371472 [4:27:43<2:44:17,  3.73it/s]
 90%|█████████ | 334663/371472 [4:27:43<2:42:52,  3.77it/s]
 90%|█████████ | 334664/371472 [4:27:43<2:44:48,  3.72it/s]
 90%|█████████ | 334665/371472 [4:27:44<2:56:14,  3.48it/s]
 90%|█████████ | 334666/371472 [4:27:44<2:54:43,  3.51it/s]
 90%|█████████ | 334667/371472 [4:27:44<3:00:39,  3.40it/s]
 90%|█████████ | 334668/371472 [4:27:45<2:52:16,  3.56it/s]
 90%|█████████ | 334669/371472 [4:27:45<2:45:48,  3.70it/s]
 90%|█████████ | 334670/371472 [4:27:45<2:43:29,  3.75it/s]
 90%|█████████ | 334671/371472 [4:27:45<2:43:29,  3.75it/s]
 90%|█████████ | 334672/371472 [4:27:46<2:45:21,  3.71it/s]
 90%|█████████ | 334673/371472 [4:27:46<2:46:58,  3.67it/s]
 90%|█████████ | 334674/371472 [4:27:46<3:05:10,  3.31it/s]
 90%|█████████ | 334675/371472 [4:27:47<3:05:52,  3.30it/s]
 90%|█████████ | 334676/371472 [4:27:47<3:03:37,  3.34it/s]
 90%|█████████ | 334677/371472 [4:27:47<2:56:28,  3.47it/s]
 90%|█████████ | 334678/371472 [4:27:47<2:57:33,  3.45it/s]
 90%|█████████ | 334679/371472 [4:27:48<2:52:38,  3.55it/s]
 90%|█████████ | 334680/371472 [4:27:48<2:52:28,  3.56it/s]
                                                           
{'loss': 2.5214, 'learning_rate': 1.8918744209097377e-07, 'epoch': 14.42}

 90%|█████████ | 334680/371472 [4:27:48<2:52:28,  3.56it/s]
 90%|█████████ | 334681/371472 [4:27:48<2:56:01,  3.48it/s]
 90%|█████████ | 334682/371472 [4:27:49<2:59:37,  3.41it/s]
 90%|█████████ | 334683/371472 [4:27:49<3:00:15,  3.40it/s]
 90%|█████████ | 334684/371472 [4:27:49<2:58:08,  3.44it/s]
 90%|█████████ | 334685/371472 [4:27:49<2:54:04,  3.52it/s]
 90%|█████████ | 334686/371472 [4:27:50<3:10:55,  3.21it/s]
 90%|█████████ | 334687/371472 [4:27:50<3:02:26,  3.36it/s]
 90%|█████████ | 334688/371472 [4:27:50<3:04:01,  3.33it/s]
 90%|█████████ | 334689/371472 [4:27:51<2:58:43,  3.43it/s]
 90%|█████████ | 334690/371472 [4:27:51<2:54:36,  3.51it/s]
 90%|█████████ | 334691/371472 [4:27:51<2:52:27,  3.55it/s]
 90%|█████████ | 334692/371472 [4:27:51<2:53:00,  3.54it/s]
 90%|█████████ | 334693/371472 [4:27:52<2:48:36,  3.64it/s]
 90%|█████████ | 334694/371472 [4:27:52<2:45:41,  3.70it/s]
 90%|█████████ | 334695/371472 [4:27:52<2:50:02,  3.60it/s]
 90%|█████████ | 334696/371472 [4:27:52<2:45:17,  3.71it/s]
 90%|█████████ | 334697/371472 [4:27:53<2:43:49,  3.74it/s]
 90%|█████████ | 334698/371472 [4:27:53<2:39:45,  3.84it/s]
 90%|█████████ | 334699/371472 [4:27:53<2:47:34,  3.66it/s]
 90%|█████████ | 334700/371472 [4:27:54<2:51:28,  3.57it/s]
                                                           
{'loss': 2.6788, 'learning_rate': 1.8913896011549485e-07, 'epoch': 14.42}

 90%|█████████ | 334700/371472 [4:27:54<2:51:28,  3.57it/s]
 90%|█████████ | 334701/371472 [4:27:54<3:01:41,  3.37it/s]
 90%|█████████ | 334702/371472 [4:27:54<2:53:52,  3.52it/s]
 90%|█████████ | 334703/371472 [4:27:54<2:49:48,  3.61it/s]
 90%|█████████ | 334704/371472 [4:27:55<2:57:01,  3.46it/s]
 90%|█████████ | 334705/371472 [4:27:55<2:50:55,  3.58it/s]
 90%|█████████ | 334706/371472 [4:27:55<3:03:05,  3.35it/s]
 90%|█████████ | 334707/371472 [4:27:56<2:59:03,  3.42it/s]
 90%|█████████ | 334708/371472 [4:27:56<2:55:24,  3.49it/s]
 90%|█████████ | 334709/371472 [4:27:56<2:54:33,  3.51it/s]
 90%|█████████ | 334710/371472 [4:27:57<3:10:12,  3.22it/s]
 90%|█████████ | 334711/371472 [4:27:57<3:07:24,  3.27it/s]
 90%|█████████ | 334712/371472 [4:27:57<3:09:12,  3.24it/s]
 90%|█████████ | 334713/371472 [4:27:57<3:04:34,  3.32it/s]
 90%|█████████ | 334714/371472 [4:27:58<2:54:49,  3.50it/s]
 90%|█████████ | 334715/371472 [4:27:58<3:03:01,  3.35it/s]
 90%|█████████ | 334716/371472 [4:27:58<2:57:04,  3.46it/s]
 90%|█████████ | 334717/371472 [4:27:59<3:05:44,  3.30it/s]
 90%|█████████ | 334718/371472 [4:27:59<3:08:46,  3.25it/s]
 90%|█████████ | 334719/371472 [4:27:59<3:14:37,  3.15it/s]
 90%|█████████ | 334720/371472 [4:28:00<3:06:49,  3.28it/s]
                                                           
{'loss': 2.657, 'learning_rate': 1.8909047814001597e-07, 'epoch': 14.42}

 90%|█████████ | 334720/371472 [4:28:00<3:06:49,  3.28it/s]
 90%|█████████ | 334721/371472 [4:28:00<3:13:09,  3.17it/s]
 90%|█████████ | 334722/371472 [4:28:00<3:06:27,  3.28it/s]
 90%|█████████ | 334723/371472 [4:28:00<2:58:21,  3.43it/s]
 90%|█████████ | 334724/371472 [4:28:01<2:51:30,  3.57it/s]
 90%|█████████ | 334725/371472 [4:28:01<2:46:53,  3.67it/s]
 90%|█████████ | 334726/371472 [4:28:01<2:43:31,  3.75it/s]
 90%|█████████ | 334727/371472 [4:28:01<2:42:35,  3.77it/s]
 90%|█████████ | 334728/371472 [4:28:02<2:41:13,  3.80it/s]
 90%|█████████ | 334729/371472 [4:28:02<2:43:27,  3.75it/s]
 90%|█████████ | 334730/371472 [4:28:02<2:48:35,  3.63it/s]
 90%|█████████ | 334731/371472 [4:28:03<2:53:33,  3.53it/s]
 90%|█████████ | 334732/371472 [4:28:03<2:54:39,  3.51it/s]
 90%|█████████ | 334733/371472 [4:28:03<2:56:15,  3.47it/s]
 90%|█████████ | 334734/371472 [4:28:03<2:57:38,  3.45it/s]
 90%|█████████ | 334735/371472 [4:28:04<2:51:58,  3.56it/s]
 90%|█████████ | 334736/371472 [4:28:04<2:45:42,  3.69it/s]
 90%|█████████ | 334737/371472 [4:28:04<2:58:10,  3.44it/s]
 90%|█████████ | 334738/371472 [4:28:05<2:50:23,  3.59it/s]
 90%|█████████ | 334739/371472 [4:28:05<3:01:14,  3.38it/s]
 90%|█████████ | 334740/371472 [4:28:05<2:51:46,  3.56it/s]
                                                           
{'loss': 2.5923, 'learning_rate': 1.8904199616453704e-07, 'epoch': 14.42}

 90%|█████████ | 334740/371472 [4:28:05<2:51:46,  3.56it/s]
 90%|█████████ | 334741/371472 [4:28:05<2:50:49,  3.58it/s]
 90%|█████████ | 334742/371472 [4:28:06<2:49:15,  3.62it/s]
 90%|█████████ | 334743/371472 [4:28:06<2:48:49,  3.63it/s]
 90%|█████████ | 334744/371472 [4:28:06<2:51:15,  3.57it/s]
 90%|█████████ | 334745/371472 [4:28:07<2:57:52,  3.44it/s]
 90%|█████████ | 334746/371472 [4:28:07<2:50:03,  3.60it/s]
 90%|█████████ | 334747/371472 [4:28:07<2:56:28,  3.47it/s]
 90%|█████████ | 334748/371472 [4:28:08<3:15:46,  3.13it/s]
 90%|█████████ | 334749/371472 [4:28:08<3:05:22,  3.30it/s]
 90%|█████████ | 334750/371472 [4:28:08<2:56:01,  3.48it/s]
 90%|█████████ | 334751/371472 [4:28:08<2:54:08,  3.51it/s]
 90%|█████████ | 334752/371472 [4:28:09<3:24:28,  2.99it/s]
 90%|█████████ | 334753/371472 [4:28:09<3:12:18,  3.18it/s]
 90%|█████████ | 334754/371472 [4:28:09<3:01:18,  3.38it/s]
 90%|█████████ | 334755/371472 [4:28:10<3:05:48,  3.29it/s]
 90%|█████████ | 334756/371472 [4:28:10<3:02:12,  3.36it/s]
 90%|█████████ | 334757/371472 [4:28:10<3:16:17,  3.12it/s]
 90%|█████████ | 334758/371472 [4:28:11<3:05:11,  3.30it/s]
 90%|█████████ | 334759/371472 [4:28:11<2:54:54,  3.50it/s]
 90%|█████████ | 334760/371472 [4:28:11<3:02:18,  3.36it/s]
                                                           
{'loss': 2.6079, 'learning_rate': 1.889935141890581e-07, 'epoch': 14.42}

 90%|█████████ | 334760/371472 [4:28:11<3:02:18,  3.36it/s]
 90%|█████████ | 334761/371472 [4:28:11<2:59:11,  3.41it/s]
 90%|█████████ | 334762/371472 [4:28:12<2:58:08,  3.43it/s]
 90%|█████████ | 334763/371472 [4:28:12<2:54:06,  3.51it/s]
 90%|█████████ | 334764/371472 [4:28:12<2:52:44,  3.54it/s]
 90%|█████████ | 334765/371472 [4:28:12<2:45:52,  3.69it/s]
 90%|█████████ | 334766/371472 [4:28:13<2:41:02,  3.80it/s]
 90%|█████████ | 334767/371472 [4:28:13<2:54:45,  3.50it/s]
 90%|█████████ | 334768/371472 [4:28:13<2:51:08,  3.57it/s]
 90%|█████████ | 334769/371472 [4:28:14<2:50:38,  3.58it/s]
 90%|█████████ | 334770/371472 [4:28:14<2:48:13,  3.64it/s]
 90%|█████████ | 334771/371472 [4:28:14<2:41:55,  3.78it/s]
 90%|█████████ | 334772/371472 [4:28:14<2:41:47,  3.78it/s]
 90%|█████████ | 334773/371472 [4:28:15<2:42:56,  3.75it/s]
 90%|█████████ | 334774/371472 [4:28:15<3:03:09,  3.34it/s]
 90%|█████████ | 334775/371472 [4:28:15<2:52:47,  3.54it/s]
 90%|█████████ | 334776/371472 [4:28:15<2:43:58,  3.73it/s]
 90%|█████████ | 334777/371472 [4:28:16<2:48:42,  3.63it/s]
 90%|█████████ | 334778/371472 [4:28:16<2:45:46,  3.69it/s]
 90%|█████████ | 334779/371472 [4:28:16<3:09:03,  3.23it/s]
 90%|█████████ | 334780/371472 [4:28:17<3:04:23,  3.32it/s]
                                                           
{'loss': 2.7267, 'learning_rate': 1.8894503221357926e-07, 'epoch': 14.42}

 90%|█████████ | 334780/371472 [4:28:17<3:04:23,  3.32it/s]
 90%|█████████ | 334781/371472 [4:28:17<3:06:00,  3.29it/s]
 90%|█████████ | 334782/371472 [4:28:17<3:04:12,  3.32it/s]
 90%|█████████ | 334783/371472 [4:28:18<2:59:11,  3.41it/s]
 90%|█████████ | 334784/371472 [4:28:18<2:58:34,  3.42it/s]
 90%|█████████ | 334785/371472 [4:28:18<2:56:07,  3.47it/s]
 90%|█████████ | 334786/371472 [4:28:18<2:49:49,  3.60it/s]
 90%|█████████ | 334787/371472 [4:28:19<3:07:20,  3.26it/s]
 90%|█████████ | 334788/371472 [4:28:19<3:08:12,  3.25it/s]
 90%|█████████ | 334789/371472 [4:28:19<3:13:58,  3.15it/s]
 90%|█████████ | 334790/371472 [4:28:20<3:22:00,  3.03it/s]
 90%|█████████ | 334791/371472 [4:28:20<3:08:58,  3.24it/s]
 90%|█████████ | 334792/371472 [4:28:20<3:08:12,  3.25it/s]
 90%|█████████ | 334793/371472 [4:28:21<3:10:12,  3.21it/s]
 90%|█████████ | 334794/371472 [4:28:21<3:28:52,  2.93it/s]
 90%|█████████ | 334795/371472 [4:28:21<3:26:17,  2.96it/s]
 90%|█████████ | 334796/371472 [4:28:22<3:19:15,  3.07it/s]
 90%|█████████ | 334797/371472 [4:28:22<3:07:50,  3.25it/s]
 90%|█████████ | 334798/371472 [4:28:22<3:01:23,  3.37it/s]
 90%|█████████ | 334799/371472 [4:28:23<3:00:37,  3.38it/s]
 90%|█████████ | 334800/371472 [4:28:23<2:57:35,  3.44it/s]
                                                           
{'loss': 2.6234, 'learning_rate': 1.888965502381003e-07, 'epoch': 14.42}

 90%|█████████ | 334800/371472 [4:28:23<2:57:35,  3.44it/s]
 90%|█████████ | 334801/371472 [4:28:23<2:51:46,  3.56it/s]
 90%|█████████ | 334802/371472 [4:28:23<2:48:10,  3.63it/s]
 90%|█████████ | 334803/371472 [4:28:24<2:44:03,  3.73it/s]
 90%|█████████ | 334804/371472 [4:28:24<2:41:08,  3.79it/s]
 90%|█████████ | 334805/371472 [4:28:24<2:39:20,  3.84it/s]
 90%|█████████ | 334806/371472 [4:28:24<2:41:45,  3.78it/s]
 90%|█████████ | 334807/371472 [4:28:25<2:52:06,  3.55it/s]
 90%|█████████ | 334808/371472 [4:28:25<2:47:01,  3.66it/s]
 90%|█████████ | 334809/371472 [4:28:25<2:43:55,  3.73it/s]
 90%|█████████ | 334810/371472 [4:28:26<2:53:48,  3.52it/s]
 90%|█████████ | 334811/371472 [4:28:26<2:47:59,  3.64it/s]
 90%|█████████ | 334812/371472 [4:28:26<2:52:00,  3.55it/s]
 90%|█████████ | 334813/371472 [4:28:26<3:03:30,  3.33it/s]
 90%|█████████ | 334814/371472 [4:28:27<2:58:19,  3.43it/s]
 90%|█████████ | 334815/371472 [4:28:27<2:59:54,  3.40it/s]
 90%|█████████ | 334816/371472 [4:28:27<2:51:11,  3.57it/s]
 90%|█████████ | 334817/371472 [4:28:28<2:45:39,  3.69it/s]
 90%|█████████ | 334818/371472 [4:28:28<2:46:53,  3.66it/s]
 90%|█████████ | 334819/371472 [4:28:28<2:46:08,  3.68it/s]
 90%|█████████ | 334820/371472 [4:28:28<2:42:06,  3.77it/s]
                                                           
{'loss': 2.5956, 'learning_rate': 1.8884806826262149e-07, 'epoch': 14.42}

 90%|█████████ | 334820/371472 [4:28:28<2:42:06,  3.77it/s]
 90%|█████████ | 334821/371472 [4:28:29<2:47:06,  3.66it/s]
 90%|█████████ | 334822/371472 [4:28:29<2:44:50,  3.71it/s]
 90%|█████████ | 334823/371472 [4:28:29<2:57:15,  3.45it/s]
 90%|█████████ | 334824/371472 [4:28:29<2:55:30,  3.48it/s]
 90%|█████████ | 334825/371472 [4:28:30<2:49:39,  3.60it/s]
 90%|█████████ | 334826/371472 [4:28:30<2:54:05,  3.51it/s]
 90%|█████████ | 334827/371472 [4:28:30<3:02:15,  3.35it/s]
 90%|█████████ | 334828/371472 [4:28:31<2:59:08,  3.41it/s]
 90%|█████████ | 334829/371472 [4:28:31<2:56:59,  3.45it/s]
 90%|█████████ | 334830/371472 [4:28:31<3:00:19,  3.39it/s]
 90%|█████████ | 334831/371472 [4:28:32<3:04:12,  3.32it/s]
 90%|█████████ | 334832/371472 [4:28:32<3:10:50,  3.20it/s]
 90%|█████████ | 334833/371472 [4:28:32<3:14:02,  3.15it/s]
 90%|█████████ | 334834/371472 [4:28:32<3:04:59,  3.30it/s]
 90%|█████████ | 334835/371472 [4:28:33<2:52:43,  3.54it/s]
 90%|█████████ | 334836/371472 [4:28:33<2:46:06,  3.68it/s]
 90%|█████████ | 334837/371472 [4:28:33<2:47:09,  3.65it/s]
 90%|█████████ | 334838/371472 [4:28:34<2:45:58,  3.68it/s]
 90%|█████████ | 334839/371472 [4:28:34<2:39:52,  3.82it/s]
 90%|█████████ | 334840/371472 [4:28:34<2:45:00,  3.70it/s]
                                                           
{'loss': 2.5753, 'learning_rate': 1.8879958628714253e-07, 'epoch': 14.42}

 90%|█████████ | 334840/371472 [4:28:34<2:45:00,  3.70it/s]
 90%|█████████ | 334841/371472 [4:28:34<2:41:03,  3.79it/s]
 90%|█████████ | 334842/371472 [4:28:35<2:55:36,  3.48it/s]
 90%|█████████ | 334843/371472 [4:28:35<2:49:11,  3.61it/s]
 90%|█████████ | 334844/371472 [4:28:35<2:43:32,  3.73it/s]
 90%|█████████ | 334845/371472 [4:28:35<2:36:31,  3.90it/s]
 90%|█████████ | 334846/371472 [4:28:36<2:46:17,  3.67it/s]
 90%|█████████ | 334847/371472 [4:28:36<2:43:06,  3.74it/s]
 90%|█████████ | 334848/371472 [4:28:36<2:47:52,  3.64it/s]
 90%|█████████ | 334849/371472 [4:28:37<2:53:30,  3.52it/s]
 90%|█████████ | 334850/371472 [4:28:37<2:53:18,  3.52it/s]
 90%|█████████ | 334851/371472 [4:28:37<2:47:29,  3.64it/s]
 90%|█████████ | 334852/371472 [4:28:37<2:50:28,  3.58it/s]
 90%|█████████ | 334853/371472 [4:28:38<2:42:58,  3.74it/s]
 90%|█████████ | 334854/371472 [4:28:38<3:17:53,  3.08it/s]
 90%|█████████ | 334855/371472 [4:28:38<3:22:17,  3.02it/s]
 90%|█████████ | 334856/371472 [4:28:39<3:08:18,  3.24it/s]
 90%|█████████ | 334857/371472 [4:28:39<3:02:53,  3.34it/s]
 90%|█████████ | 334858/371472 [4:28:39<2:57:04,  3.45it/s]
 90%|█████████ | 334859/371472 [4:28:40<3:11:55,  3.18it/s]
 90%|█████████ | 334860/371472 [4:28:40<3:01:34,  3.36it/s]
                                                           
{'loss': 2.5857, 'learning_rate': 1.8875110431166368e-07, 'epoch': 14.42}

 90%|█████████ | 334860/371472 [4:28:40<3:01:34,  3.36it/s]
 90%|█████████ | 334861/371472 [4:28:40<2:56:54,  3.45it/s]
 90%|█████████ | 334862/371472 [4:28:40<2:54:18,  3.50it/s]
 90%|█████████ | 334863/371472 [4:28:41<2:55:22,  3.48it/s]
 90%|█████████ | 334864/371472 [4:28:41<3:13:34,  3.15it/s]
 90%|█████████ | 334865/371472 [4:28:41<3:24:55,  2.98it/s]
 90%|█████████ | 334866/371472 [4:28:42<3:11:27,  3.19it/s]
 90%|█████████ | 334867/371472 [4:28:42<3:16:46,  3.10it/s]
 90%|█████████ | 334868/371472 [4:28:42<3:05:59,  3.28it/s]
 90%|█████████ | 334869/371472 [4:28:43<2:57:49,  3.43it/s]
 90%|█████████ | 334870/371472 [4:28:43<2:52:58,  3.53it/s]
 90%|█████████ | 334871/371472 [4:28:43<3:00:11,  3.39it/s]
 90%|█████████ | 334872/371472 [4:28:43<2:58:26,  3.42it/s]
 90%|█████████ | 334873/371472 [4:28:44<2:58:25,  3.42it/s]
 90%|█████████ | 334874/371472 [4:28:44<2:47:43,  3.64it/s]
 90%|█████████ | 334875/371472 [4:28:44<2:53:41,  3.51it/s]
 90%|█████████ | 334876/371472 [4:28:45<2:48:40,  3.62it/s]
 90%|█████████ | 334877/371472 [4:28:45<2:45:21,  3.69it/s]
 90%|█████████ | 334878/371472 [4:28:45<2:47:35,  3.64it/s]
 90%|█████████ | 334879/371472 [4:28:45<2:46:55,  3.65it/s]
 90%|█████████ | 334880/371472 [4:28:46<2:46:39,  3.66it/s]
                                                           
{'loss': 2.5525, 'learning_rate': 1.8870262233618475e-07, 'epoch': 14.42}

 90%|█████████ | 334880/371472 [4:28:46<2:46:39,  3.66it/s]
 90%|█████████ | 334881/371472 [4:28:46<2:57:08,  3.44it/s]
 90%|█████████ | 334882/371472 [4:28:46<2:56:07,  3.46it/s]
 90%|█████████ | 334883/371472 [4:28:47<3:13:06,  3.16it/s]
 90%|█████████ | 334884/371472 [4:28:47<3:05:28,  3.29it/s]
 90%|█████████ | 334885/371472 [4:28:47<2:57:48,  3.43it/s]
 90%|█████████ | 334886/371472 [4:28:47<3:03:37,  3.32it/s]
 90%|█████████ | 334887/371472 [4:28:48<2:57:02,  3.44it/s]
 90%|█████████ | 334888/371472 [4:28:48<2:53:29,  3.51it/s]
 90%|█████████ | 334889/371472 [4:28:48<2:51:08,  3.56it/s]
 90%|█████████ | 334890/371472 [4:28:49<2:55:08,  3.48it/s]
 90%|█████████ | 334891/371472 [4:28:49<2:56:49,  3.45it/s]
 90%|█████████ | 334892/371472 [4:28:49<2:53:08,  3.52it/s]
 90%|█████████ | 334893/371472 [4:28:49<2:48:00,  3.63it/s]
 90%|█████████ | 334894/371472 [4:28:50<2:44:08,  3.71it/s]
 90%|█████████ | 334895/371472 [4:28:50<2:52:13,  3.54it/s]
 90%|█████████ | 334896/371472 [4:28:50<3:07:19,  3.25it/s]
 90%|█████████ | 334897/371472 [4:28:51<2:56:04,  3.46it/s]
 90%|█████████ | 334898/371472 [4:28:51<2:50:06,  3.58it/s]
 90%|█████████ | 334899/371472 [4:28:51<2:56:05,  3.46it/s]
 90%|█████████ | 334900/371472 [4:28:52<3:05:55,  3.28it/s]
                                                           
{'loss': 2.5752, 'learning_rate': 1.886541403607059e-07, 'epoch': 14.42}

 90%|█████████ | 334900/371472 [4:28:52<3:05:55,  3.28it/s]
 90%|█████████ | 334901/371472 [4:28:52<3:00:14,  3.38it/s]
 90%|█████████ | 334902/371472 [4:28:52<2:56:50,  3.45it/s]
 90%|█████████ | 334903/371472 [4:28:52<2:58:42,  3.41it/s]
 90%|█████████ | 334904/371472 [4:28:53<2:55:03,  3.48it/s]
 90%|█████████ | 334905/371472 [4:28:53<3:01:53,  3.35it/s]
 90%|█████████ | 334906/371472 [4:28:53<2:56:28,  3.45it/s]
 90%|█████████ | 334907/371472 [4:28:54<3:13:28,  3.15it/s]
 90%|█████████ | 334908/371472 [4:28:54<3:09:29,  3.22it/s]
 90%|█████████ | 334909/371472 [4:28:54<3:02:53,  3.33it/s]
 90%|█████████ | 334910/371472 [4:28:54<2:57:53,  3.43it/s]
 90%|█████████ | 334911/371472 [4:28:55<2:53:21,  3.51it/s]
 90%|█████████ | 334912/371472 [4:28:55<2:55:22,  3.47it/s]
 90%|█████████ | 334913/371472 [4:28:55<3:08:58,  3.22it/s]
 90%|█████████ | 334914/371472 [4:28:56<3:16:29,  3.10it/s]
 90%|█████████ | 334915/371472 [4:28:56<3:15:11,  3.12it/s]
 90%|█████████ | 334916/371472 [4:28:56<3:07:13,  3.25it/s]
 90%|█████████ | 334917/371472 [4:28:57<3:03:35,  3.32it/s]
 90%|█████████ | 334918/371472 [4:28:57<3:00:00,  3.38it/s]
 90%|█████████ | 334919/371472 [4:28:57<2:57:42,  3.43it/s]
 90%|█████████ | 334920/371472 [4:28:58<3:08:00,  3.24it/s]
                                                           
{'loss': 2.5443, 'learning_rate': 1.8860565838522695e-07, 'epoch': 14.43}

 90%|█████████ | 334920/371472 [4:28:58<3:08:00,  3.24it/s]
 90%|█████████ | 334921/371472 [4:28:58<3:04:36,  3.30it/s]
 90%|█████████ | 334922/371472 [4:28:58<2:57:45,  3.43it/s]
 90%|█████████ | 334923/371472 [4:28:58<2:58:18,  3.42it/s]
 90%|█████████ | 334924/371472 [4:28:59<2:52:45,  3.53it/s]
 90%|█████████ | 334925/371472 [4:28:59<3:09:05,  3.22it/s]
 90%|█████████ | 334926/371472 [4:28:59<3:04:58,  3.29it/s]
 90%|█████████ | 334927/371472 [4:29:00<2:59:38,  3.39it/s]
 90%|█████████ | 334928/371472 [4:29:00<2:58:32,  3.41it/s]
 90%|█████████ | 334929/371472 [4:29:00<2:59:06,  3.40it/s]
 90%|█████████ | 334930/371472 [4:29:01<3:34:06,  2.84it/s]
 90%|█████████ | 334931/371472 [4:29:01<3:15:39,  3.11it/s]
 90%|█████████ | 334932/371472 [4:29:01<3:17:10,  3.09it/s]
 90%|█████████ | 334933/371472 [4:29:01<3:05:58,  3.27it/s]
 90%|█████████ | 334934/371472 [4:29:02<3:10:19,  3.20it/s]
 90%|█████████ | 334935/371472 [4:29:02<3:07:02,  3.26it/s]
 90%|█████████ | 334936/371472 [4:29:02<3:00:25,  3.37it/s]
 90%|█████████ | 334937/371472 [4:29:03<3:13:55,  3.14it/s]
 90%|█████████ | 334938/371472 [4:29:03<3:05:18,  3.29it/s]
 90%|█████████ | 334939/371472 [4:29:03<2:57:49,  3.42it/s]
 90%|█████████ | 334940/371472 [4:29:04<2:54:49,  3.48it/s]
                                                           
{'loss': 2.6076, 'learning_rate': 1.8855717640974813e-07, 'epoch': 14.43}

 90%|█████████ | 334940/371472 [4:29:04<2:54:49,  3.48it/s]
 90%|█████████ | 334941/371472 [4:29:04<2:47:41,  3.63it/s]
 90%|█████████ | 334942/371472 [4:29:04<2:45:14,  3.68it/s]
 90%|█████████ | 334943/371472 [4:29:04<2:49:24,  3.59it/s]
 90%|█████████ | 334944/371472 [4:29:05<2:43:32,  3.72it/s]
 90%|█████████ | 334945/371472 [4:29:05<2:46:37,  3.65it/s]
 90%|█████████ | 334946/371472 [4:29:05<2:41:13,  3.78it/s]
 90%|█████████ | 334947/371472 [4:29:05<2:53:54,  3.50it/s]
 90%|█████████ | 334948/371472 [4:29:06<2:57:37,  3.43it/s]
 90%|█████████ | 334949/371472 [4:29:06<2:54:31,  3.49it/s]
 90%|█████████ | 334950/371472 [4:29:06<2:48:32,  3.61it/s]
 90%|█████████ | 334951/371472 [4:29:07<2:45:33,  3.68it/s]
 90%|█████████ | 334952/371472 [4:29:07<2:51:10,  3.56it/s]
 90%|█████████ | 334953/371472 [4:29:07<2:56:27,  3.45it/s]
 90%|█████████ | 334954/371472 [4:29:07<2:51:23,  3.55it/s]
 90%|█████████ | 334955/371472 [4:29:08<2:53:05,  3.52it/s]
 90%|█████████ | 334956/371472 [4:29:08<2:48:03,  3.62it/s]
 90%|█████████ | 334957/371472 [4:29:08<2:56:52,  3.44it/s]
 90%|█████████ | 334958/371472 [4:29:09<2:50:35,  3.57it/s]
 90%|█████████ | 334959/371472 [4:29:09<2:48:14,  3.62it/s]
 90%|█████████ | 334960/371472 [4:29:09<2:47:38,  3.63it/s]
                                                           
{'loss': 2.6715, 'learning_rate': 1.8850869443426917e-07, 'epoch': 14.43}

 90%|█████████ | 334960/371472 [4:29:09<2:47:38,  3.63it/s]
 90%|█████████ | 334961/371472 [4:29:09<2:46:07,  3.66it/s]
 90%|█████████ | 334962/371472 [4:29:10<2:50:53,  3.56it/s]
 90%|█████████ | 334963/371472 [4:29:10<2:41:25,  3.77it/s]
 90%|█████████ | 334964/371472 [4:29:10<2:43:24,  3.72it/s]
 90%|█████████ | 334965/371472 [4:29:10<2:41:33,  3.77it/s]
 90%|█████████ | 334966/371472 [4:29:11<2:39:41,  3.81it/s]
 90%|█████████ | 334967/371472 [4:29:11<2:45:14,  3.68it/s]
 90%|█████████ | 334968/371472 [4:29:11<2:48:46,  3.60it/s]
 90%|█████████ | 334969/371472 [4:29:12<2:57:36,  3.43it/s]
 90%|█████████ | 334970/371472 [4:29:12<2:59:45,  3.38it/s]
 90%|█████████ | 334971/371472 [4:29:12<2:52:14,  3.53it/s]
 90%|█████████ | 334972/371472 [4:29:12<2:54:53,  3.48it/s]
 90%|█████████ | 334973/371472 [4:29:13<2:48:09,  3.62it/s]
 90%|█████████ | 334974/371472 [4:29:13<2:48:31,  3.61it/s]
 90%|█████████ | 334975/371472 [4:29:13<2:48:55,  3.60it/s]
 90%|█████████ | 334976/371472 [4:29:14<2:54:41,  3.48it/s]
 90%|█████████ | 334977/371472 [4:29:14<2:50:31,  3.57it/s]
 90%|█████████ | 334978/371472 [4:29:14<2:54:26,  3.49it/s]
 90%|█████████ | 334979/371472 [4:29:14<2:56:41,  3.44it/s]
 90%|█████████ | 334980/371472 [4:29:15<2:50:48,  3.56it/s]
                                                           
{'loss': 2.64, 'learning_rate': 1.8846021245879032e-07, 'epoch': 14.43}

 90%|█████████ | 334980/371472 [4:29:15<2:50:48,  3.56it/s]
 90%|█████████ | 334981/371472 [4:29:15<2:46:12,  3.66it/s]
 90%|█████████ | 334982/371472 [4:29:15<2:54:10,  3.49it/s]
 90%|█████████ | 334983/371472 [4:29:16<3:04:58,  3.29it/s]
 90%|█████████ | 334984/371472 [4:29:16<3:09:13,  3.21it/s]
 90%|█████████ | 334985/371472 [4:29:16<3:19:12,  3.05it/s]
 90%|█████████ | 334986/371472 [4:29:17<3:17:29,  3.08it/s]
 90%|█████████ | 334987/371472 [4:29:17<3:11:13,  3.18it/s]
 90%|█████████ | 334988/371472 [4:29:17<3:01:12,  3.36it/s]
 90%|█████████ | 334989/371472 [4:29:17<2:55:52,  3.46it/s]
 90%|█████████ | 334990/371472 [4:29:18<2:45:19,  3.68it/s]
 90%|█████████ | 334991/371472 [4:29:18<3:02:31,  3.33it/s]
 90%|█████████ | 334992/371472 [4:29:18<3:03:24,  3.32it/s]
 90%|█████████ | 334993/371472 [4:29:19<2:55:39,  3.46it/s]
 90%|█████████ | 334994/371472 [4:29:19<2:51:37,  3.54it/s]
 90%|█████████ | 334995/371472 [4:29:19<2:45:23,  3.68it/s]
 90%|█████████ | 334996/371472 [4:29:19<2:43:01,  3.73it/s]
 90%|█████████ | 334997/371472 [4:29:20<2:41:12,  3.77it/s]
 90%|█████████ | 334998/371472 [4:29:20<2:41:01,  3.78it/s]
 90%|█████████ | 334999/371472 [4:29:20<2:51:03,  3.55it/s]
 90%|█████████ | 335000/371472 [4:29:20<2:43:48,  3.71it/s]
                                                           
{'loss': 2.5165, 'learning_rate': 1.884117304833114e-07, 'epoch': 14.43}

 90%|█████████ | 335000/371472 [4:29:20<2:43:48,  3.71it/s]
 90%|█████████ | 335001/371472 [4:29:21<2:49:09,  3.59it/s]
 90%|█████████ | 335002/371472 [4:29:21<2:43:53,  3.71it/s]
 90%|█████████ | 335003/371472 [4:29:21<2:52:13,  3.53it/s]
 90%|█████████ | 335004/371472 [4:29:22<2:47:06,  3.64it/s]
 90%|█████████ | 335005/371472 [4:29:22<2:47:27,  3.63it/s]
 90%|█████████ | 335006/371472 [4:29:22<2:39:14,  3.82it/s]
 90%|█████████ | 335007/371472 [4:29:22<2:36:40,  3.88it/s]
 90%|█████████ | 335008/371472 [4:29:23<2:40:02,  3.80it/s]
 90%|█████████ | 335009/371472 [4:29:23<2:44:44,  3.69it/s]
 90%|█████████ | 335010/371472 [4:29:23<2:40:14,  3.79it/s]
 90%|█████████ | 335011/371472 [4:29:23<2:41:49,  3.76it/s]
 90%|█████████ | 335012/371472 [4:29:24<2:54:23,  3.48it/s]
 90%|█████████ | 335013/371472 [4:29:24<2:51:14,  3.55it/s]
 90%|█████████ | 335014/371472 [4:29:24<2:52:35,  3.52it/s]
 90%|█████████ | 335015/371472 [4:29:25<2:48:03,  3.62it/s]
 90%|█████████ | 335016/371472 [4:29:25<2:50:18,  3.57it/s]
 90%|█████████ | 335017/371472 [4:29:25<2:51:08,  3.55it/s]
 90%|█████████ | 335018/371472 [4:29:25<3:01:19,  3.35it/s]
 90%|█████████ | 335019/371472 [4:29:26<2:55:31,  3.46it/s]
 90%|█████████ | 335020/371472 [4:29:26<3:01:16,  3.35it/s]
                                                           
{'loss': 2.6189, 'learning_rate': 1.8836324850783255e-07, 'epoch': 14.43}

 90%|█████████ | 335020/371472 [4:29:26<3:01:16,  3.35it/s]
 90%|█████████ | 335021/371472 [4:29:26<3:03:12,  3.32it/s]
 90%|█████████ | 335022/371472 [4:29:27<2:55:32,  3.46it/s]
 90%|█████████ | 335023/371472 [4:29:27<2:49:37,  3.58it/s]
 90%|█████████ | 335024/371472 [4:29:27<3:03:32,  3.31it/s]
 90%|█████████ | 335025/371472 [4:29:28<2:58:16,  3.41it/s]
 90%|█████████ | 335026/371472 [4:29:28<2:57:04,  3.43it/s]
 90%|█████████ | 335027/371472 [4:29:28<2:54:32,  3.48it/s]
 90%|█████████ | 335028/371472 [4:29:28<3:06:21,  3.26it/s]
 90%|█████████ | 335029/371472 [4:29:29<2:56:54,  3.43it/s]
 90%|█████████ | 335030/371472 [4:29:29<2:59:04,  3.39it/s]
 90%|█████████ | 335031/371472 [4:29:29<2:59:10,  3.39it/s]
 90%|█████████ | 335032/371472 [4:29:30<2:55:33,  3.46it/s]
 90%|█████████ | 335033/371472 [4:29:30<2:49:45,  3.58it/s]
 90%|█████████ | 335034/371472 [4:29:30<2:54:07,  3.49it/s]
 90%|█████████ | 335035/371472 [4:29:30<2:53:54,  3.49it/s]
 90%|█████████ | 335036/371472 [4:29:31<2:49:13,  3.59it/s]
 90%|█████████ | 335037/371472 [4:29:31<2:59:24,  3.38it/s]
 90%|█████████ | 335038/371472 [4:29:31<3:03:11,  3.31it/s]
 90%|█████████ | 335039/371472 [4:29:32<2:59:14,  3.39it/s]
 90%|█████████ | 335040/371472 [4:29:32<2:54:52,  3.47it/s]
                                                           
{'loss': 2.6228, 'learning_rate': 1.883147665323536e-07, 'epoch': 14.43}

 90%|█████████ | 335040/371472 [4:29:32<2:54:52,  3.47it/s]
 90%|█████████ | 335041/371472 [4:29:32<3:00:43,  3.36it/s]
 90%|█████████ | 335042/371472 [4:29:32<2:54:57,  3.47it/s]
 90%|█████████ | 335043/371472 [4:29:33<2:48:35,  3.60it/s]
 90%|█████████ | 335044/371472 [4:29:33<2:53:25,  3.50it/s]
 90%|█████████ | 335045/371472 [4:29:33<2:53:56,  3.49it/s]
 90%|█████████ | 335046/371472 [4:29:34<2:56:23,  3.44it/s]
 90%|█████████ | 335047/371472 [4:29:34<3:00:05,  3.37it/s]
 90%|█████████ | 335048/371472 [4:29:34<3:06:10,  3.26it/s]
 90%|█████████ | 335049/371472 [4:29:35<3:02:46,  3.32it/s]
 90%|█████████ | 335050/371472 [4:29:35<3:09:16,  3.21it/s]
 90%|█████████ | 335051/371472 [4:29:35<2:59:05,  3.39it/s]
 90%|█████████ | 335052/371472 [4:29:35<2:51:57,  3.53it/s]
 90%|█████████ | 335053/371472 [4:29:36<2:43:59,  3.70it/s]
 90%|█████████ | 335054/371472 [4:29:36<2:44:01,  3.70it/s]
 90%|█████████ | 335055/371472 [4:29:36<2:47:24,  3.63it/s]
 90%|█████████ | 335056/371472 [4:29:36<2:40:19,  3.79it/s]
 90%|█████████ | 335057/371472 [4:29:37<2:41:11,  3.77it/s]
 90%|█████████ | 335058/371472 [4:29:37<2:41:56,  3.75it/s]
 90%|█████████ | 335059/371472 [4:29:37<2:42:21,  3.74it/s]
 90%|█████████ | 335060/371472 [4:29:38<2:41:41,  3.75it/s]
                                                           
{'loss': 2.6561, 'learning_rate': 1.8826628455687477e-07, 'epoch': 14.43}

 90%|█████████ | 335060/371472 [4:29:38<2:41:41,  3.75it/s]
 90%|█████████ | 335061/371472 [4:29:38<2:37:15,  3.86it/s]
 90%|█████████ | 335062/371472 [4:29:38<2:45:26,  3.67it/s]
 90%|█████████ | 335063/371472 [4:29:38<3:02:06,  3.33it/s]
 90%|█████████ | 335064/371472 [4:29:39<3:09:10,  3.21it/s]
 90%|█████████ | 335065/371472 [4:29:39<2:55:46,  3.45it/s]
 90%|█████████ | 335066/371472 [4:29:39<3:00:41,  3.36it/s]
 90%|█████████ | 335067/371472 [4:29:40<2:52:10,  3.52it/s]
 90%|█████████ | 335068/371472 [4:29:40<2:48:22,  3.60it/s]
 90%|█████████ | 335069/371472 [4:29:40<2:52:10,  3.52it/s]
 90%|█████████ | 335070/371472 [4:29:40<3:02:50,  3.32it/s]
 90%|█████████ | 335071/371472 [4:29:41<2:57:56,  3.41it/s]
 90%|█████████ | 335072/371472 [4:29:41<2:59:17,  3.38it/s]
 90%|█████████ | 335073/371472 [4:29:41<2:51:44,  3.53it/s]
 90%|█████████ | 335074/371472 [4:29:42<2:47:51,  3.61it/s]
 90%|█████████ | 335075/371472 [4:29:42<2:48:42,  3.60it/s]
 90%|█████████ | 335076/371472 [4:29:42<2:47:40,  3.62it/s]
 90%|█████████ | 335077/371472 [4:29:42<2:52:57,  3.51it/s]
 90%|█████████ | 335078/371472 [4:29:43<2:48:33,  3.60it/s]
 90%|█████████ | 335079/371472 [4:29:43<2:45:18,  3.67it/s]
 90%|█████████ | 335080/371472 [4:29:43<2:39:58,  3.79it/s]
                                                           
{'loss': 2.4965, 'learning_rate': 1.8821780258139584e-07, 'epoch': 14.43}

 90%|█████████ | 335080/371472 [4:29:43<2:39:58,  3.79it/s]
 90%|█████████ | 335081/371472 [4:29:43<2:48:16,  3.60it/s]
 90%|█████████ | 335082/371472 [4:29:44<2:47:34,  3.62it/s]
 90%|█████████ | 335083/371472 [4:29:44<2:55:13,  3.46it/s]
 90%|█████████ | 335084/371472 [4:29:44<2:58:55,  3.39it/s]
 90%|█████████ | 335085/371472 [4:29:45<2:51:52,  3.53it/s]
 90%|█████████ | 335086/371472 [4:29:45<2:53:54,  3.49it/s]
 90%|█████████ | 335087/371472 [4:29:45<2:59:15,  3.38it/s]
 90%|█████████ | 335088/371472 [4:29:46<2:50:11,  3.56it/s]
 90%|█████████ | 335089/371472 [4:29:46<3:01:07,  3.35it/s]
 90%|█████████ | 335090/371472 [4:29:46<2:59:41,  3.37it/s]
 90%|█████████ | 335091/371472 [4:29:46<2:52:41,  3.51it/s]
 90%|█████████ | 335092/371472 [4:29:47<3:00:15,  3.36it/s]
 90%|█████████ | 335093/371472 [4:29:47<2:59:46,  3.37it/s]
 90%|█████████ | 335094/371472 [4:29:47<2:53:58,  3.49it/s]
 90%|█████████ | 335095/371472 [4:29:48<2:56:46,  3.43it/s]
 90%|█████████ | 335096/371472 [4:29:48<2:58:50,  3.39it/s]
 90%|█████████ | 335097/371472 [4:29:48<3:00:29,  3.36it/s]
 90%|█████████ | 335098/371472 [4:29:48<2:51:45,  3.53it/s]
 90%|█████████ | 335099/371472 [4:29:49<2:46:38,  3.64it/s]
 90%|█████████ | 335100/371472 [4:29:49<2:49:35,  3.57it/s]
                                                           
{'loss': 2.7071, 'learning_rate': 1.8816932060591696e-07, 'epoch': 14.43}

 90%|█████████ | 335100/371472 [4:29:49<2:49:35,  3.57it/s]
 90%|█████████ | 335101/371472 [4:29:49<2:51:19,  3.54it/s]
 90%|█████████ | 335102/371472 [4:29:50<2:55:32,  3.45it/s]
 90%|█████████ | 335103/371472 [4:29:50<2:49:58,  3.57it/s]
 90%|█████████ | 335104/371472 [4:29:50<2:45:11,  3.67it/s]
 90%|█████████ | 335105/371472 [4:29:50<2:46:38,  3.64it/s]
 90%|█████████ | 335106/371472 [4:29:51<2:46:53,  3.63it/s]
 90%|█████████ | 335107/371472 [4:29:51<2:45:27,  3.66it/s]
 90%|█████████ | 335108/371472 [4:29:51<2:48:54,  3.59it/s]
 90%|█████████ | 335109/371472 [4:29:51<2:49:22,  3.58it/s]
 90%|█████████ | 335110/371472 [4:29:52<2:58:27,  3.40it/s]
 90%|█████████ | 335111/371472 [4:29:52<2:55:45,  3.45it/s]
 90%|█████████ | 335112/371472 [4:29:52<2:59:55,  3.37it/s]
 90%|█████████ | 335113/371472 [4:29:53<3:23:18,  2.98it/s]
 90%|█████████ | 335114/371472 [4:29:53<3:09:00,  3.21it/s]
 90%|█████████ | 335115/371472 [4:29:53<3:08:48,  3.21it/s]
 90%|█████████ | 335116/371472 [4:29:54<3:07:23,  3.23it/s]
 90%|█████████ | 335117/371472 [4:29:54<3:02:18,  3.32it/s]
 90%|█████████ | 335118/371472 [4:29:54<2:59:47,  3.37it/s]
 90%|█████████ | 335119/371472 [4:29:55<2:54:50,  3.47it/s]
 90%|█████████ | 335120/371472 [4:29:55<2:50:08,  3.56it/s]
                                                           
{'loss': 2.5633, 'learning_rate': 1.8812083863043804e-07, 'epoch': 14.43}

 90%|█████████ | 335120/371472 [4:29:55<2:50:08,  3.56it/s]
 90%|█████████ | 335121/371472 [4:29:55<2:56:01,  3.44it/s]
 90%|█████████ | 335122/371472 [4:29:55<2:49:39,  3.57it/s]
 90%|█████████ | 335123/371472 [4:29:56<3:03:48,  3.30it/s]
 90%|█████████ | 335124/371472 [4:29:56<2:58:31,  3.39it/s]
 90%|█████████ | 335125/371472 [4:29:56<2:57:02,  3.42it/s]
 90%|█████████ | 335126/371472 [4:29:57<3:04:56,  3.28it/s]
 90%|█████████ | 335127/371472 [4:29:57<2:58:03,  3.40it/s]
 90%|█████████ | 335128/371472 [4:29:57<2:49:02,  3.58it/s]
 90%|█████████ | 335129/371472 [4:29:57<2:49:19,  3.58it/s]
 90%|█████████ | 335130/371472 [4:29:58<2:50:50,  3.55it/s]
 90%|█████████ | 335131/371472 [4:29:58<2:45:14,  3.67it/s]
 90%|█████████ | 335132/371472 [4:29:58<2:46:28,  3.64it/s]
 90%|█████████ | 335133/371472 [4:29:59<2:47:00,  3.63it/s]
 90%|█████████ | 335134/371472 [4:29:59<2:45:08,  3.67it/s]
 90%|█████████ | 335135/371472 [4:29:59<2:48:01,  3.60it/s]
 90%|█████████ | 335136/371472 [4:29:59<2:45:53,  3.65it/s]
 90%|█████████ | 335137/371472 [4:30:00<2:50:33,  3.55it/s]
 90%|█████████ | 335138/371472 [4:30:00<2:44:27,  3.68it/s]
 90%|█████████ | 335139/371472 [4:30:00<2:43:43,  3.70it/s]
 90%|█████████ | 335140/371472 [4:30:00<2:41:49,  3.74it/s]
                                                           
{'loss': 2.5293, 'learning_rate': 1.880723566549592e-07, 'epoch': 14.44}

 90%|█████████ | 335140/371472 [4:30:00<2:41:49,  3.74it/s]
 90%|█████████ | 335141/371472 [4:30:01<3:49:51,  2.63it/s]
 90%|█████████ | 335142/371472 [4:30:01<3:32:11,  2.85it/s]
 90%|█████████ | 335143/371472 [4:30:02<3:11:53,  3.16it/s]
 90%|█████████ | 335144/371472 [4:30:02<3:03:16,  3.30it/s]
 90%|█████████ | 335145/371472 [4:30:02<3:11:55,  3.15it/s]
 90%|█████████ | 335146/371472 [4:30:02<3:02:05,  3.32it/s]
 90%|█████████ | 335147/371472 [4:30:03<3:00:02,  3.36it/s]
 90%|█████████ | 335148/371472 [4:30:03<3:04:21,  3.28it/s]
 90%|█████████ | 335149/371472 [4:30:03<2:54:04,  3.48it/s]
 90%|█████████ | 335150/371472 [4:30:04<2:49:43,  3.57it/s]
 90%|█████████ | 335151/371472 [4:30:04<2:45:49,  3.65it/s]
 90%|█████████ | 335152/371472 [4:30:04<2:43:53,  3.69it/s]
 90%|█████████ | 335153/371472 [4:30:04<2:48:08,  3.60it/s]
 90%|█████████ | 335154/371472 [4:30:05<2:54:08,  3.48it/s]
 90%|█████████ | 335155/371472 [4:30:05<2:51:27,  3.53it/s]
 90%|█████████ | 335156/371472 [4:30:05<2:49:26,  3.57it/s]
 90%|█████████ | 335157/371472 [4:30:06<2:46:39,  3.63it/s]
 90%|█████████ | 335158/371472 [4:30:06<2:39:50,  3.79it/s]
 90%|█████████ | 335159/371472 [4:30:06<2:48:22,  3.59it/s]
 90%|█████████ | 335160/371472 [4:30:06<2:50:24,  3.55it/s]
                                                           
{'loss': 2.7117, 'learning_rate': 1.8802387467948026e-07, 'epoch': 14.44}

 90%|█████████ | 335160/371472 [4:30:06<2:50:24,  3.55it/s]
 90%|█████████ | 335161/371472 [4:30:07<2:56:15,  3.43it/s]
 90%|█████████ | 335162/371472 [4:30:07<2:57:20,  3.41it/s]
 90%|█████████ | 335163/371472 [4:30:07<3:04:08,  3.29it/s]
 90%|█████████ | 335164/371472 [4:30:08<2:55:12,  3.45it/s]
 90%|█████████ | 335165/371472 [4:30:08<2:49:42,  3.57it/s]
 90%|█████████ | 335166/371472 [4:30:08<2:45:13,  3.66it/s]
 90%|█████████ | 335167/371472 [4:30:08<2:46:00,  3.65it/s]
 90%|█████████ | 335168/371472 [4:30:09<2:44:02,  3.69it/s]
 90%|█████████ | 335169/371472 [4:30:09<2:45:25,  3.66it/s]
 90%|█████████ | 335170/371472 [4:30:09<2:43:31,  3.70it/s]
 90%|█████████ | 335171/371472 [4:30:09<2:39:50,  3.79it/s]
 90%|█████████ | 335172/371472 [4:30:10<2:52:40,  3.50it/s]
 90%|█████████ | 335173/371472 [4:30:10<2:59:20,  3.37it/s]
 90%|█████████ | 335174/371472 [4:30:10<3:01:19,  3.34it/s]
 90%|█████████ | 335175/371472 [4:30:11<2:57:17,  3.41it/s]
 90%|█████████ | 335176/371472 [4:30:11<2:51:08,  3.53it/s]
 90%|█████████ | 335177/371472 [4:30:11<2:50:17,  3.55it/s]
 90%|█████████ | 335178/371472 [4:30:11<2:48:50,  3.58it/s]
 90%|█████████ | 335179/371472 [4:30:12<2:53:56,  3.48it/s]
 90%|█████████ | 335180/371472 [4:30:12<3:10:08,  3.18it/s]
                                                           
{'loss': 2.6234, 'learning_rate': 1.8797539270400138e-07, 'epoch': 14.44}

 90%|█████████ | 335180/371472 [4:30:12<3:10:08,  3.18it/s]
 90%|█████████ | 335181/371472 [4:30:12<3:01:33,  3.33it/s]
 90%|█████████ | 335182/371472 [4:30:13<2:58:16,  3.39it/s]
 90%|█████████ | 335183/371472 [4:30:13<2:47:47,  3.60it/s]
 90%|█████████ | 335184/371472 [4:30:13<2:56:38,  3.42it/s]
 90%|█████████ | 335185/371472 [4:30:14<2:52:12,  3.51it/s]
 90%|█████████ | 335186/371472 [4:30:14<2:54:20,  3.47it/s]
 90%|█████████ | 335187/371472 [4:30:14<2:50:15,  3.55it/s]
 90%|█████████ | 335188/371472 [4:30:14<2:48:37,  3.59it/s]
 90%|█████████ | 335189/371472 [4:30:15<2:54:34,  3.46it/s]
 90%|█████████ | 335190/371472 [4:30:15<2:54:23,  3.47it/s]
 90%|█████████ | 335191/371472 [4:30:15<3:15:30,  3.09it/s]
 90%|█████████ | 335192/371472 [4:30:16<3:08:45,  3.20it/s]
 90%|█████████ | 335193/371472 [4:30:16<2:57:44,  3.40it/s]
 90%|█████████ | 335194/371472 [4:30:16<2:57:16,  3.41it/s]
 90%|█████████ | 335195/371472 [4:30:16<2:52:13,  3.51it/s]
 90%|█████████ | 335196/371472 [4:30:17<2:47:54,  3.60it/s]
 90%|█████████ | 335197/371472 [4:30:17<2:44:14,  3.68it/s]
 90%|█████████ | 335198/371472 [4:30:17<2:42:33,  3.72it/s]
 90%|█████████ | 335199/371472 [4:30:18<2:43:55,  3.69it/s]
 90%|█████████ | 335200/371472 [4:30:18<2:46:18,  3.64it/s]
                                                           
{'loss': 2.4454, 'learning_rate': 1.8792691072852248e-07, 'epoch': 14.44}

 90%|█████████ | 335200/371472 [4:30:18<2:46:18,  3.64it/s]
 90%|█████████ | 335201/371472 [4:30:18<2:47:51,  3.60it/s]
 90%|█████████ | 335202/371472 [4:30:18<2:42:31,  3.72it/s]
 90%|█████████ | 335203/371472 [4:30:19<2:49:03,  3.58it/s]
 90%|█████████ | 335204/371472 [4:30:19<2:51:02,  3.53it/s]
 90%|█████████ | 335205/371472 [4:30:19<2:47:04,  3.62it/s]
 90%|█████████ | 335206/371472 [4:30:19<2:43:50,  3.69it/s]
 90%|█████████ | 335207/371472 [4:30:20<3:02:04,  3.32it/s]
 90%|█████████ | 335208/371472 [4:30:20<3:00:50,  3.34it/s]
 90%|█████████ | 335209/371472 [4:30:20<3:01:29,  3.33it/s]
 90%|█████████ | 335210/371472 [4:30:21<2:55:14,  3.45it/s]
 90%|█████████ | 335211/371472 [4:30:21<3:00:10,  3.35it/s]
 90%|█████████ | 335212/371472 [4:30:21<2:51:48,  3.52it/s]
 90%|█████████ | 335213/371472 [4:30:22<2:51:29,  3.52it/s]
 90%|█████████ | 335214/371472 [4:30:22<2:49:50,  3.56it/s]
 90%|█████████ | 335215/371472 [4:30:22<2:48:19,  3.59it/s]
 90%|█████████ | 335216/371472 [4:30:22<2:49:43,  3.56it/s]
 90%|█████████ | 335217/371472 [4:30:23<2:47:27,  3.61it/s]
 90%|█████████ | 335218/371472 [4:30:23<2:43:09,  3.70it/s]
 90%|█████████ | 335219/371472 [4:30:23<2:46:27,  3.63it/s]
 90%|█████████ | 335220/371472 [4:30:23<2:45:42,  3.65it/s]
                                                           
{'loss': 2.5429, 'learning_rate': 1.8787842875304363e-07, 'epoch': 14.44}

 90%|█████████ | 335220/371472 [4:30:23<2:45:42,  3.65it/s]
 90%|█████████ | 335221/371472 [4:30:24<2:46:31,  3.63it/s]
 90%|█████████ | 335222/371472 [4:30:24<2:43:59,  3.68it/s]
 90%|█████████ | 335223/371472 [4:30:24<2:50:31,  3.54it/s]
 90%|█████████ | 335224/371472 [4:30:25<2:48:46,  3.58it/s]
 90%|█████████ | 335225/371472 [4:30:25<2:47:12,  3.61it/s]
 90%|█████████ | 335226/371472 [4:30:25<2:49:50,  3.56it/s]
 90%|█████████ | 335227/371472 [4:30:25<2:52:08,  3.51it/s]
 90%|█████████ | 335228/371472 [4:30:26<2:51:49,  3.52it/s]
 90%|█████████ | 335229/371472 [4:30:26<2:59:57,  3.36it/s]
 90%|█████████ | 335230/371472 [4:30:26<2:55:28,  3.44it/s]
 90%|█████████ | 335231/371472 [4:30:27<2:53:16,  3.49it/s]
 90%|█████████ | 335232/371472 [4:30:27<3:03:23,  3.29it/s]
 90%|█████████ | 335233/371472 [4:30:27<2:57:50,  3.40it/s]
 90%|█████████ | 335234/371472 [4:30:28<3:04:41,  3.27it/s]
 90%|█████████ | 335235/371472 [4:30:28<3:03:20,  3.29it/s]
 90%|█████████ | 335236/371472 [4:30:28<2:56:47,  3.42it/s]
 90%|█████████ | 335237/371472 [4:30:28<2:52:27,  3.50it/s]
 90%|█████████ | 335238/371472 [4:30:29<2:53:44,  3.48it/s]
 90%|█████████ | 335239/371472 [4:30:29<2:51:30,  3.52it/s]
 90%|█████████ | 335240/371472 [4:30:29<2:50:28,  3.54it/s]
                                                           
{'loss': 2.5376, 'learning_rate': 1.8782994677756468e-07, 'epoch': 14.44}

 90%|█████████ | 335240/371472 [4:30:29<2:50:28,  3.54it/s]
 90%|█████████ | 335241/371472 [4:30:30<2:58:35,  3.38it/s]
 90%|█████████ | 335242/371472 [4:30:30<2:54:02,  3.47it/s]
 90%|█████████ | 335243/371472 [4:30:30<2:55:19,  3.44it/s]
 90%|█████████ | 335244/371472 [4:30:30<2:56:00,  3.43it/s]
 90%|█████████ | 335245/371472 [4:30:31<2:56:04,  3.43it/s]
 90%|█████████ | 335246/371472 [4:30:31<3:12:18,  3.14it/s]
 90%|█████████ | 335247/371472 [4:30:31<3:00:20,  3.35it/s]
 90%|█████████ | 335248/371472 [4:30:32<2:58:36,  3.38it/s]
 90%|█████████ | 335249/371472 [4:30:32<2:57:19,  3.40it/s]
 90%|█████████ | 335250/371472 [4:30:32<3:01:45,  3.32it/s]
 90%|█████████ | 335251/371472 [4:30:32<2:56:15,  3.42it/s]
 90%|█████████ | 335252/371472 [4:30:33<2:51:02,  3.53it/s]
 90%|█████████ | 335253/371472 [4:30:33<2:47:33,  3.60it/s]
 90%|█████████ | 335254/371472 [4:30:33<2:53:27,  3.48it/s]
 90%|█████████ | 335255/371472 [4:30:34<2:48:40,  3.58it/s]
 90%|█████████ | 335256/371472 [4:30:34<2:44:44,  3.66it/s]
 90%|█████████ | 335257/371472 [4:30:34<2:43:19,  3.70it/s]
 90%|█████████ | 335258/371472 [4:30:34<2:46:49,  3.62it/s]
 90%|█████████ | 335259/371472 [4:30:35<2:53:47,  3.47it/s]
 90%|█████████ | 335260/371472 [4:30:35<2:55:45,  3.43it/s]
                                                           
{'loss': 2.4945, 'learning_rate': 1.8778146480208585e-07, 'epoch': 14.44}

 90%|█████████ | 335260/371472 [4:30:35<2:55:45,  3.43it/s]
 90%|█████████ | 335261/371472 [4:30:35<2:52:48,  3.49it/s]
 90%|█████████ | 335262/371472 [4:30:36<2:44:55,  3.66it/s]
 90%|█████████ | 335263/371472 [4:30:36<2:50:42,  3.54it/s]
 90%|█████████ | 335264/371472 [4:30:36<2:53:57,  3.47it/s]
 90%|█████████ | 335265/371472 [4:30:36<2:53:20,  3.48it/s]
 90%|█████████ | 335266/371472 [4:30:37<2:49:13,  3.57it/s]
 90%|█████████ | 335267/371472 [4:30:37<2:51:28,  3.52it/s]
 90%|█████████ | 335268/371472 [4:30:37<3:03:42,  3.28it/s]
 90%|█████████ | 335269/371472 [4:30:38<2:55:32,  3.44it/s]
 90%|█████████ | 335270/371472 [4:30:38<2:59:51,  3.35it/s]
 90%|█████████ | 335271/371472 [4:30:38<2:54:37,  3.45it/s]
 90%|█████████ | 335272/371472 [4:30:38<2:59:25,  3.36it/s]
 90%|█████████ | 335273/371472 [4:30:39<2:55:20,  3.44it/s]
 90%|█████████ | 335274/371472 [4:30:39<3:02:05,  3.31it/s]
 90%|█████████ | 335275/371472 [4:30:39<2:54:42,  3.45it/s]
 90%|█████████ | 335276/371472 [4:30:40<2:53:45,  3.47it/s]
 90%|█████████ | 335277/371472 [4:30:40<2:48:40,  3.58it/s]
 90%|█████████ | 335278/371472 [4:30:40<2:52:08,  3.50it/s]
 90%|█████████ | 335279/371472 [4:30:40<2:48:37,  3.58it/s]
 90%|█████████ | 335280/371472 [4:30:41<2:45:24,  3.65it/s]
                                                           
{'loss': 2.7709, 'learning_rate': 1.877329828266069e-07, 'epoch': 14.44}

 90%|█████████ | 335280/371472 [4:30:41<2:45:24,  3.65it/s]
 90%|█████████ | 335281/371472 [4:30:41<2:44:19,  3.67it/s]
 90%|█████████ | 335282/371472 [4:30:41<2:54:37,  3.45it/s]
 90%|█████████ | 335283/371472 [4:30:42<2:52:34,  3.50it/s]
 90%|█████████ | 335284/371472 [4:30:42<2:47:36,  3.60it/s]
 90%|█████████ | 335285/371472 [4:30:42<2:45:45,  3.64it/s]
 90%|█████████ | 335286/371472 [4:30:42<2:44:08,  3.67it/s]
 90%|█████████ | 335287/371472 [4:30:43<2:52:56,  3.49it/s]
 90%|█████████ | 335288/371472 [4:30:43<3:02:20,  3.31it/s]
 90%|█████████ | 335289/371472 [4:30:43<2:51:27,  3.52it/s]
 90%|█████████ | 335290/371472 [4:30:44<2:50:18,  3.54it/s]
 90%|█████████ | 335291/371472 [4:30:44<2:46:31,  3.62it/s]
 90%|█████████ | 335292/371472 [4:30:44<3:11:06,  3.16it/s]
 90%|█████████ | 335293/371472 [4:30:45<3:05:48,  3.25it/s]
 90%|█████████ | 335294/371472 [4:30:45<3:02:54,  3.30it/s]
 90%|█████████ | 335295/371472 [4:30:45<3:09:52,  3.18it/s]
 90%|█████████ | 335296/371472 [4:30:45<3:02:43,  3.30it/s]
 90%|█████████ | 335297/371472 [4:30:46<3:02:58,  3.29it/s]
 90%|█████████ | 335298/371472 [4:30:46<3:07:26,  3.22it/s]
 90%|█████████ | 335299/371472 [4:30:46<2:54:57,  3.45it/s]
 90%|█████████ | 335300/371472 [4:30:47<2:48:44,  3.57it/s]
                                                           
{'loss': 2.6673, 'learning_rate': 1.8768450085112794e-07, 'epoch': 14.44}

 90%|█████████ | 335300/371472 [4:30:47<2:48:44,  3.57it/s]
 90%|█████████ | 335301/371472 [4:30:47<2:46:34,  3.62it/s]
 90%|█████████ | 335302/371472 [4:30:47<2:47:57,  3.59it/s]
 90%|█████████ | 335303/371472 [4:30:47<2:51:53,  3.51it/s]
 90%|█████████ | 335304/371472 [4:30:48<2:49:42,  3.55it/s]
 90%|█████████ | 335305/371472 [4:30:48<2:49:50,  3.55it/s]
 90%|█████████ | 335306/371472 [4:30:48<2:54:53,  3.45it/s]
 90%|█████████ | 335307/371472 [4:30:49<3:03:25,  3.29it/s]
 90%|█████████ | 335308/371472 [4:30:49<2:57:42,  3.39it/s]
 90%|█████████ | 335309/371472 [4:30:49<2:47:04,  3.61it/s]
 90%|█████████ | 335310/371472 [4:30:49<2:57:51,  3.39it/s]
 90%|█████████ | 335311/371472 [4:30:50<3:00:19,  3.34it/s]
 90%|█████████ | 335312/371472 [4:30:50<2:56:41,  3.41it/s]
 90%|█████████ | 335313/371472 [4:30:50<2:52:47,  3.49it/s]
 90%|█████████ | 335314/371472 [4:30:51<2:57:01,  3.40it/s]
 90%|█████████ | 335315/371472 [4:30:51<2:53:41,  3.47it/s]
 90%|█████████ | 335316/371472 [4:30:51<2:57:40,  3.39it/s]
 90%|█████████ | 335317/371472 [4:30:52<3:05:25,  3.25it/s]
 90%|█████████ | 335318/371472 [4:30:52<2:57:03,  3.40it/s]
 90%|█████████ | 335319/371472 [4:30:52<2:52:31,  3.49it/s]
 90%|█████████ | 335320/371472 [4:30:52<2:48:52,  3.57it/s]
                                                           
{'loss': 2.6634, 'learning_rate': 1.8763601887564912e-07, 'epoch': 14.44}

 90%|█████████ | 335320/371472 [4:30:52<2:48:52,  3.57it/s]
 90%|█████████ | 335321/371472 [4:30:53<2:49:30,  3.55it/s]
 90%|█████████ | 335322/371472 [4:30:53<2:45:23,  3.64it/s]
 90%|█████████ | 335323/371472 [4:30:53<2:49:05,  3.56it/s]
 90%|█████████ | 335324/371472 [4:30:53<2:46:43,  3.61it/s]
 90%|█████████ | 335325/371472 [4:30:54<2:45:36,  3.64it/s]
 90%|█████████ | 335326/371472 [4:30:54<2:43:36,  3.68it/s]
 90%|█████████ | 335327/371472 [4:30:54<2:39:15,  3.78it/s]
 90%|█████████ | 335328/371472 [4:30:55<2:45:50,  3.63it/s]
 90%|█████████ | 335329/371472 [4:30:55<2:40:55,  3.74it/s]
 90%|█████████ | 335330/371472 [4:30:55<2:44:04,  3.67it/s]
 90%|█████████ | 335331/371472 [4:30:55<2:42:39,  3.70it/s]
 90%|█████████ | 335332/371472 [4:30:56<2:40:58,  3.74it/s]
 90%|█████████ | 335333/371472 [4:30:56<2:36:40,  3.84it/s]
 90%|█████████ | 335334/371472 [4:30:56<2:43:39,  3.68it/s]
 90%|█████████ | 335335/371472 [4:30:56<2:49:33,  3.55it/s]
 90%|█████████ | 335336/371472 [4:30:57<2:48:23,  3.58it/s]
 90%|█████████ | 335337/371472 [4:30:57<2:47:12,  3.60it/s]
 90%|█████████ | 335338/371472 [4:30:57<2:46:02,  3.63it/s]
 90%|█████████ | 335339/371472 [4:30:58<2:48:20,  3.58it/s]
 90%|█████████ | 335340/371472 [4:30:58<2:50:54,  3.52it/s]
                                                           
{'loss': 2.6563, 'learning_rate': 1.8758753690017017e-07, 'epoch': 14.44}

 90%|█████████ | 335340/371472 [4:30:58<2:50:54,  3.52it/s]
 90%|█████████ | 335341/371472 [4:30:58<2:45:30,  3.64it/s]
 90%|█████████ | 335342/371472 [4:30:58<2:42:15,  3.71it/s]
 90%|█████████ | 335343/371472 [4:30:59<2:42:46,  3.70it/s]
 90%|█████████ | 335344/371472 [4:30:59<2:40:32,  3.75it/s]
 90%|█████████ | 335345/371472 [4:30:59<2:41:40,  3.72it/s]
 90%|█████████ | 335346/371472 [4:30:59<2:36:52,  3.84it/s]
 90%|█████████ | 335347/371472 [4:31:00<2:41:12,  3.73it/s]
 90%|█████████ | 335348/371472 [4:31:00<2:41:13,  3.73it/s]
 90%|█████████ | 335349/371472 [4:31:00<2:44:30,  3.66it/s]
 90%|█████████ | 335350/371472 [4:31:01<2:51:17,  3.51it/s]
 90%|█████████ | 335351/371472 [4:31:01<2:42:42,  3.70it/s]
 90%|█████████ | 335352/371472 [4:31:01<2:42:59,  3.69it/s]
 90%|█████████ | 335353/371472 [4:31:01<2:44:26,  3.66it/s]
 90%|█████████ | 335354/371472 [4:31:02<2:45:14,  3.64it/s]
 90%|█████████ | 335355/371472 [4:31:02<2:57:32,  3.39it/s]
 90%|█████████ | 335356/371472 [4:31:02<3:15:16,  3.08it/s]
 90%|█████████ | 335357/371472 [4:31:03<3:09:59,  3.17it/s]
 90%|█████████ | 335358/371472 [4:31:03<3:00:26,  3.34it/s]
 90%|█████████ | 335359/371472 [4:31:03<3:02:50,  3.29it/s]
 90%|█████████ | 335360/371472 [4:31:04<3:01:46,  3.31it/s]
                                                           
{'loss': 2.6622, 'learning_rate': 1.8753905492469132e-07, 'epoch': 14.44}

 90%|█████████ | 335360/371472 [4:31:04<3:01:46,  3.31it/s]
 90%|█████████ | 335361/371472 [4:31:04<2:54:55,  3.44it/s]
 90%|█████████ | 335362/371472 [4:31:04<2:53:10,  3.48it/s]
 90%|█████████ | 335363/371472 [4:31:04<2:55:36,  3.43it/s]
 90%|█████████ | 335364/371472 [4:31:05<2:51:08,  3.52it/s]
 90%|█████████ | 335365/371472 [4:31:05<2:50:54,  3.52it/s]
 90%|█████████ | 335366/371472 [4:31:05<3:10:24,  3.16it/s]
 90%|█████████ | 335367/371472 [4:31:06<3:09:03,  3.18it/s]
 90%|█████████ | 335368/371472 [4:31:06<3:08:58,  3.18it/s]
 90%|█████████ | 335369/371472 [4:31:06<3:03:27,  3.28it/s]
 90%|█████████ | 335370/371472 [4:31:07<2:57:50,  3.38it/s]
 90%|█████████ | 335371/371472 [4:31:07<2:58:28,  3.37it/s]
 90%|█████████ | 335372/371472 [4:31:07<2:55:29,  3.43it/s]
 90%|█████████ | 335373/371472 [4:31:07<2:55:57,  3.42it/s]
 90%|█████████ | 335374/371472 [4:31:08<2:54:36,  3.45it/s]
 90%|█████████ | 335375/371472 [4:31:08<2:50:08,  3.54it/s]
 90%|█████████ | 335376/371472 [4:31:08<2:48:46,  3.56it/s]
 90%|█████████ | 335377/371472 [4:31:09<3:01:49,  3.31it/s]
 90%|█████████ | 335378/371472 [4:31:09<3:14:58,  3.09it/s]
 90%|█████████ | 335379/371472 [4:31:09<2:59:31,  3.35it/s]
 90%|█████████ | 335380/371472 [4:31:09<2:51:14,  3.51it/s]
                                                           
{'loss': 2.4427, 'learning_rate': 1.874905729492124e-07, 'epoch': 14.45}

 90%|█████████ | 335380/371472 [4:31:09<2:51:14,  3.51it/s]
 90%|█████████ | 335381/371472 [4:31:10<2:45:41,  3.63it/s]
 90%|█████████ | 335382/371472 [4:31:10<2:47:34,  3.59it/s]
 90%|█████████ | 335383/371472 [4:31:10<2:42:58,  3.69it/s]
 90%|█████████ | 335384/371472 [4:31:10<2:38:44,  3.79it/s]
 90%|█████████ | 335385/371472 [4:31:11<2:35:59,  3.86it/s]
 90%|█████████ | 335386/371472 [4:31:11<2:39:24,  3.77it/s]
 90%|█████████ | 335387/371472 [4:31:11<2:42:04,  3.71it/s]
 90%|█████████ | 335388/371472 [4:31:12<2:48:51,  3.56it/s]
 90%|█████████ | 335389/371472 [4:31:12<2:51:26,  3.51it/s]
 90%|█████████ | 335390/371472 [4:31:12<2:44:36,  3.65it/s]
 90%|█████████ | 335391/371472 [4:31:12<2:54:34,  3.44it/s]
 90%|█████████ | 335392/371472 [4:31:13<3:00:47,  3.33it/s]
 90%|█████████ | 335393/371472 [4:31:13<2:48:24,  3.57it/s]
 90%|█████████ | 335394/371472 [4:31:13<2:52:52,  3.48it/s]
 90%|█████████ | 335395/371472 [4:31:14<2:47:33,  3.59it/s]
 90%|█████████ | 335396/371472 [4:31:14<2:52:23,  3.49it/s]
 90%|█████████ | 335397/371472 [4:31:14<2:45:58,  3.62it/s]
 90%|█████████ | 335398/371472 [4:31:14<2:44:27,  3.66it/s]
 90%|█████████ | 335399/371472 [4:31:15<2:42:52,  3.69it/s]
 90%|█████████ | 335400/371472 [4:31:15<2:39:57,  3.76it/s]
                                                           
{'loss': 2.6766, 'learning_rate': 1.8744209097373357e-07, 'epoch': 14.45}

 90%|█████████ | 335400/371472 [4:31:15<2:39:57,  3.76it/s]
 90%|█████████ | 335401/371472 [4:31:15<2:37:19,  3.82it/s]
 90%|█████████ | 335402/371472 [4:31:15<2:41:17,  3.73it/s]
 90%|█████████ | 335403/371472 [4:31:16<2:40:46,  3.74it/s]
 90%|█████████ | 335404/371472 [4:31:16<2:45:30,  3.63it/s]
 90%|█████████ | 335405/371472 [4:31:16<2:46:49,  3.60it/s]
 90%|█████████ | 335406/371472 [4:31:17<2:44:15,  3.66it/s]
 90%|█████████ | 335407/371472 [4:31:17<2:57:49,  3.38it/s]
 90%|█████████ | 335408/371472 [4:31:17<2:53:52,  3.46it/s]
 90%|█████████ | 335409/371472 [4:31:18<3:01:49,  3.31it/s]
 90%|█████████ | 335410/371472 [4:31:18<2:52:19,  3.49it/s]
 90%|█████████ | 335411/371472 [4:31:18<2:46:35,  3.61it/s]
 90%|█████████ | 335412/371472 [4:31:18<2:58:19,  3.37it/s]
 90%|█████████ | 335413/371472 [4:31:19<3:04:39,  3.25it/s]
 90%|█████████ | 335414/371472 [4:31:19<2:59:31,  3.35it/s]
 90%|█████████ | 335415/371472 [4:31:19<2:53:30,  3.46it/s]
 90%|█████████ | 335416/371472 [4:31:19<2:45:02,  3.64it/s]
 90%|█████████ | 335417/371472 [4:31:20<2:42:14,  3.70it/s]
 90%|█████████ | 335418/371472 [4:31:20<2:38:42,  3.79it/s]
 90%|█████████ | 335419/371472 [4:31:20<2:38:30,  3.79it/s]
 90%|█████████ | 335420/371472 [4:31:21<2:40:02,  3.75it/s]
                                                           
{'loss': 2.6146, 'learning_rate': 1.873936089982546e-07, 'epoch': 14.45}

 90%|█████████ | 335420/371472 [4:31:21<2:40:02,  3.75it/s]
 90%|█████████ | 335421/371472 [4:31:21<2:47:26,  3.59it/s]
 90%|█████████ | 335422/371472 [4:31:21<2:50:23,  3.53it/s]
 90%|█████████ | 335423/371472 [4:31:21<2:48:02,  3.58it/s]
 90%|█████████ | 335424/371472 [4:31:22<2:51:02,  3.51it/s]
 90%|█████████ | 335425/371472 [4:31:22<3:00:43,  3.32it/s]
 90%|█████████ | 335426/371472 [4:31:22<3:05:21,  3.24it/s]
 90%|█████████ | 335427/371472 [4:31:23<3:04:16,  3.26it/s]
 90%|█████████ | 335428/371472 [4:31:23<2:50:45,  3.52it/s]
 90%|█████████ | 335429/371472 [4:31:23<3:06:01,  3.23it/s]
 90%|█████████ | 335430/371472 [4:31:24<2:56:37,  3.40it/s]
 90%|█████████ | 335431/371472 [4:31:24<2:55:16,  3.43it/s]
 90%|█████████ | 335432/371472 [4:31:24<2:48:29,  3.56it/s]
 90%|█████████ | 335433/371472 [4:31:24<2:51:16,  3.51it/s]
 90%|█████████ | 335434/371472 [4:31:25<2:49:15,  3.55it/s]
 90%|█████████ | 335435/371472 [4:31:25<2:54:29,  3.44it/s]
 90%|█████████ | 335436/371472 [4:31:25<2:51:51,  3.49it/s]
 90%|█████████ | 335437/371472 [4:31:26<2:58:06,  3.37it/s]
 90%|█████████ | 335438/371472 [4:31:26<2:48:09,  3.57it/s]
 90%|█████████ | 335439/371472 [4:31:26<2:51:19,  3.51it/s]
 90%|█████████ | 335440/371472 [4:31:26<2:51:00,  3.51it/s]
                                                           
{'loss': 2.6179, 'learning_rate': 1.8734512702277576e-07, 'epoch': 14.45}

 90%|█████████ | 335440/371472 [4:31:26<2:51:00,  3.51it/s]
 90%|█████████ | 335441/371472 [4:31:27<3:02:59,  3.28it/s]
 90%|█████████ | 335442/371472 [4:31:27<2:52:56,  3.47it/s]
 90%|█████████ | 335443/371472 [4:31:27<2:52:36,  3.48it/s]
 90%|█████████ | 335444/371472 [4:31:28<2:47:02,  3.59it/s]
 90%|█████████ | 335445/371472 [4:31:28<2:47:29,  3.58it/s]
 90%|█████████ | 335446/371472 [4:31:28<2:59:56,  3.34it/s]
 90%|█████████ | 335447/371472 [4:31:28<3:00:56,  3.32it/s]
 90%|█████████ | 335448/371472 [4:31:29<2:57:18,  3.39it/s]
 90%|█████████ | 335449/371472 [4:31:29<2:50:32,  3.52it/s]
 90%|█████████ | 335450/371472 [4:31:29<2:49:01,  3.55it/s]
 90%|█████████ | 335451/371472 [4:31:30<2:50:57,  3.51it/s]
 90%|█████████ | 335452/371472 [4:31:30<3:00:46,  3.32it/s]
 90%|█████████ | 335453/371472 [4:31:30<2:55:33,  3.42it/s]
 90%|█████████ | 335454/371472 [4:31:30<2:52:04,  3.49it/s]
 90%|█████████ | 335455/371472 [4:31:31<2:43:28,  3.67it/s]
 90%|█████████ | 335456/371472 [4:31:31<2:38:28,  3.79it/s]
 90%|█████████ | 335457/371472 [4:31:31<2:37:22,  3.81it/s]
 90%|█████████ | 335458/371472 [4:31:31<2:42:40,  3.69it/s]
 90%|█████████ | 335459/371472 [4:31:32<2:43:39,  3.67it/s]
 90%|█████████ | 335460/371472 [4:31:32<2:51:02,  3.51it/s]
                                                           
{'loss': 2.5001, 'learning_rate': 1.8729664504729683e-07, 'epoch': 14.45}

 90%|█████████ | 335460/371472 [4:31:32<2:51:02,  3.51it/s]
 90%|█████████ | 335461/371472 [4:31:32<2:49:50,  3.53it/s]
 90%|█████████ | 335462/371472 [4:31:33<2:51:12,  3.51it/s]
 90%|█████████ | 335463/371472 [4:31:33<2:53:28,  3.46it/s]
 90%|█████████ | 335464/371472 [4:31:33<3:08:04,  3.19it/s]
 90%|█████████ | 335465/371472 [4:31:34<3:01:43,  3.30it/s]
 90%|█████████ | 335466/371472 [4:31:34<3:03:24,  3.27it/s]
 90%|█████████ | 335467/371472 [4:31:34<3:02:19,  3.29it/s]
 90%|█████████ | 335468/371472 [4:31:34<2:56:26,  3.40it/s]
 90%|█████████ | 335469/371472 [4:31:35<2:48:11,  3.57it/s]
 90%|█████████ | 335470/371472 [4:31:35<2:46:55,  3.59it/s]
 90%|█████████ | 335471/371472 [4:31:35<2:52:08,  3.49it/s]
 90%|█████████ | 335472/371472 [4:31:36<2:57:28,  3.38it/s]
 90%|█████████ | 335473/371472 [4:31:36<2:53:27,  3.46it/s]
 90%|█████████ | 335474/371472 [4:31:36<2:54:13,  3.44it/s]
 90%|█████████ | 335475/371472 [4:31:36<2:54:39,  3.43it/s]
 90%|█████████ | 335476/371472 [4:31:37<2:53:48,  3.45it/s]
 90%|█████████ | 335477/371472 [4:31:37<2:54:31,  3.44it/s]
 90%|█████████ | 335478/371472 [4:31:37<2:52:41,  3.47it/s]
 90%|█████████ | 335479/371472 [4:31:38<2:54:26,  3.44it/s]
 90%|█████████ | 335480/371472 [4:31:38<2:59:54,  3.33it/s]
                                                           
{'loss': 2.4733, 'learning_rate': 1.8724816307181796e-07, 'epoch': 14.45}

 90%|█████████ | 335480/371472 [4:31:38<2:59:54,  3.33it/s]
 90%|█████████ | 335481/371472 [4:31:38<3:00:43,  3.32it/s]
 90%|█████████ | 335482/371472 [4:31:39<3:00:04,  3.33it/s]
 90%|█████████ | 335483/371472 [4:31:39<3:03:26,  3.27it/s]
 90%|█████████ | 335484/371472 [4:31:39<2:53:16,  3.46it/s]
 90%|█████████ | 335485/371472 [4:31:39<2:48:50,  3.55it/s]
 90%|█████████ | 335486/371472 [4:31:40<2:47:39,  3.58it/s]
 90%|█████████ | 335487/371472 [4:31:40<2:55:31,  3.42it/s]
 90%|█████████ | 335488/371472 [4:31:40<2:49:34,  3.54it/s]
 90%|█████████ | 335489/371472 [4:31:40<2:44:41,  3.64it/s]
 90%|█████████ | 335490/371472 [4:31:41<2:41:00,  3.72it/s]
 90%|█████████ | 335491/371472 [4:31:41<2:36:52,  3.82it/s]
 90%|█████████ | 335492/371472 [4:31:41<2:42:38,  3.69it/s]
 90%|█████████ | 335493/371472 [4:31:42<2:47:20,  3.58it/s]
 90%|█████████ | 335494/371472 [4:31:42<2:56:58,  3.39it/s]
 90%|█████████ | 335495/371472 [4:31:42<2:51:48,  3.49it/s]
 90%|█████████ | 335496/371472 [4:31:42<2:48:39,  3.56it/s]
 90%|█████████ | 335497/371472 [4:31:43<2:45:05,  3.63it/s]
 90%|█████████ | 335498/371472 [4:31:43<2:41:36,  3.71it/s]
 90%|█████████ | 335499/371472 [4:31:43<2:47:43,  3.57it/s]
 90%|█████████ | 335500/371472 [4:31:44<2:45:43,  3.62it/s]
                                                           
{'loss': 2.6842, 'learning_rate': 1.8719968109633903e-07, 'epoch': 14.45}

 90%|█████████ | 335500/371472 [4:31:44<2:45:43,  3.62it/s]
 90%|█████████ | 335501/371472 [4:31:44<2:47:59,  3.57it/s]
 90%|█████████ | 335502/371472 [4:31:44<2:40:01,  3.75it/s]
 90%|█████████ | 335503/371472 [4:31:44<2:38:16,  3.79it/s]
 90%|█████████ | 335504/371472 [4:31:45<2:50:31,  3.52it/s]
 90%|█████████ | 335505/371472 [4:31:45<2:50:00,  3.53it/s]
 90%|█████████ | 335506/371472 [4:31:45<2:50:13,  3.52it/s]
 90%|█████████ | 335507/371472 [4:31:45<2:49:58,  3.53it/s]
 90%|█████████ | 335508/371472 [4:31:46<2:53:12,  3.46it/s]
 90%|█████████ | 335509/371472 [4:31:46<2:59:54,  3.33it/s]
 90%|█████████ | 335510/371472 [4:31:46<2:56:05,  3.40it/s]
 90%|█████████ | 335511/371472 [4:31:47<2:50:04,  3.52it/s]
 90%|█████████ | 335512/371472 [4:31:47<2:43:07,  3.67it/s]
 90%|█████████ | 335513/371472 [4:31:47<2:45:05,  3.63it/s]
 90%|█████████ | 335514/371472 [4:31:48<2:53:52,  3.45it/s]
 90%|█████████ | 335515/371472 [4:31:48<2:44:42,  3.64it/s]
 90%|█████████ | 335516/371472 [4:31:48<2:45:56,  3.61it/s]
 90%|█████████ | 335517/371472 [4:31:48<2:54:03,  3.44it/s]
 90%|█████████ | 335518/371472 [4:31:49<3:02:22,  3.29it/s]
 90%|█████████ | 335519/371472 [4:31:49<2:55:45,  3.41it/s]
 90%|█████████ | 335520/371472 [4:31:49<2:49:33,  3.53it/s]
                                                           
{'loss': 2.5988, 'learning_rate': 1.8715119912086018e-07, 'epoch': 14.45}

 90%|█████████ | 335520/371472 [4:31:49<2:49:33,  3.53it/s]
 90%|█████████ | 335521/371472 [4:31:50<2:49:45,  3.53it/s]
 90%|█████████ | 335522/371472 [4:31:50<2:51:18,  3.50it/s]
 90%|█████████ | 335523/371472 [4:31:50<2:54:47,  3.43it/s]
 90%|█████████ | 335524/371472 [4:31:50<2:53:22,  3.46it/s]
 90%|█████████ | 335525/371472 [4:31:51<2:51:33,  3.49it/s]
 90%|█████████ | 335526/371472 [4:31:51<2:50:33,  3.51it/s]
 90%|█████████ | 335527/371472 [4:31:51<2:46:46,  3.59it/s]
 90%|█████████ | 335528/371472 [4:31:51<2:44:45,  3.64it/s]
 90%|█████████ | 335529/371472 [4:31:52<2:49:19,  3.54it/s]
 90%|█████████ | 335530/371472 [4:31:52<2:58:49,  3.35it/s]
 90%|█████████ | 335531/371472 [4:31:52<2:50:12,  3.52it/s]
 90%|█████████ | 335532/371472 [4:31:53<2:44:33,  3.64it/s]
 90%|█████████ | 335533/371472 [4:31:53<2:40:39,  3.73it/s]
 90%|█████████ | 335534/371472 [4:31:53<2:41:08,  3.72it/s]
 90%|█████████ | 335535/371472 [4:31:53<2:46:10,  3.60it/s]
 90%|█████████ | 335536/371472 [4:31:54<2:50:29,  3.51it/s]
 90%|█████████ | 335537/371472 [4:31:54<2:51:47,  3.49it/s]
 90%|█████████ | 335538/371472 [4:31:54<2:49:16,  3.54it/s]
 90%|█████████ | 335539/371472 [4:31:55<2:58:01,  3.36it/s]
 90%|█████████ | 335540/371472 [4:31:55<3:14:14,  3.08it/s]
                                                           
{'loss': 2.5853, 'learning_rate': 1.8710271714538125e-07, 'epoch': 14.45}

 90%|█████████ | 335540/371472 [4:31:55<3:14:14,  3.08it/s]
 90%|█████████ | 335541/371472 [4:31:55<3:06:27,  3.21it/s]
 90%|█████████ | 335542/371472 [4:31:56<2:55:34,  3.41it/s]
 90%|█████████ | 335543/371472 [4:31:56<2:47:07,  3.58it/s]
 90%|█████████ | 335544/371472 [4:31:56<2:46:51,  3.59it/s]
 90%|█████████ | 335545/371472 [4:31:56<2:38:10,  3.79it/s]
 90%|█████████ | 335546/371472 [4:31:57<2:46:31,  3.60it/s]
 90%|█████████ | 335547/371472 [4:31:57<2:45:28,  3.62it/s]
 90%|█████████ | 335548/371472 [4:31:57<2:37:34,  3.80it/s]
 90%|█████████ | 335549/371472 [4:31:57<2:39:36,  3.75it/s]
 90%|█████████ | 335550/371472 [4:31:58<2:41:23,  3.71it/s]
 90%|█████████ | 335551/371472 [4:31:58<2:42:33,  3.68it/s]
 90%|█████████ | 335552/371472 [4:31:58<2:42:14,  3.69it/s]
 90%|█████████ | 335553/371472 [4:31:58<2:39:30,  3.75it/s]
 90%|█████████ | 335554/371472 [4:31:59<2:43:07,  3.67it/s]
 90%|█████████ | 335555/371472 [4:31:59<2:40:37,  3.73it/s]
 90%|█████████ | 335556/371472 [4:31:59<2:39:32,  3.75it/s]
 90%|█████████ | 335557/371472 [4:32:00<2:34:59,  3.86it/s]
 90%|█████████ | 335558/371472 [4:32:00<2:39:43,  3.75it/s]
 90%|█████████ | 335559/371472 [4:32:00<2:38:17,  3.78it/s]
 90%|█████████ | 335560/371472 [4:32:00<2:39:20,  3.76it/s]
                                                           
{'loss': 2.6677, 'learning_rate': 1.870542351699024e-07, 'epoch': 14.45}

 90%|█████████ | 335560/371472 [4:32:00<2:39:20,  3.76it/s]
 90%|█████████ | 335561/371472 [4:32:01<2:46:15,  3.60it/s]
 90%|█████████ | 335562/371472 [4:32:01<2:44:09,  3.65it/s]
 90%|█████████ | 335563/371472 [4:32:01<2:54:50,  3.42it/s]
 90%|█████████ | 335564/371472 [4:32:02<3:05:53,  3.22it/s]
 90%|█████████ | 335565/371472 [4:32:02<3:07:04,  3.20it/s]
 90%|█████████ | 335566/371472 [4:32:02<2:57:50,  3.36it/s]
 90%|█████████ | 335567/371472 [4:32:02<2:51:08,  3.50it/s]
 90%|█████████ | 335568/371472 [4:32:03<2:44:51,  3.63it/s]
 90%|█████████ | 335569/371472 [4:32:03<2:42:06,  3.69it/s]
 90%|█████████ | 335570/371472 [4:32:03<2:41:37,  3.70it/s]
 90%|█████████ | 335571/371472 [4:32:03<2:40:37,  3.73it/s]
 90%|█████████ | 335572/371472 [4:32:04<2:44:36,  3.64it/s]
 90%|█████████ | 335573/371472 [4:32:04<2:48:14,  3.56it/s]
 90%|█████████ | 335574/371472 [4:32:04<2:56:36,  3.39it/s]
 90%|█████████ | 335575/371472 [4:32:05<2:55:57,  3.40it/s]
 90%|█████████ | 335576/371472 [4:32:05<2:49:41,  3.53it/s]
 90%|█████████ | 335577/371472 [4:32:05<2:47:01,  3.58it/s]
 90%|█████████ | 335578/371472 [4:32:05<2:39:51,  3.74it/s]
 90%|█████████ | 335579/371472 [4:32:06<2:39:24,  3.75it/s]
 90%|█████████ | 335580/371472 [4:32:06<2:44:00,  3.65it/s]
                                                           
{'loss': 2.4537, 'learning_rate': 1.8700575319442347e-07, 'epoch': 14.45}

 90%|█████████ | 335580/371472 [4:32:06<2:44:00,  3.65it/s]
 90%|█████████ | 335581/371472 [4:32:06<2:48:01,  3.56it/s]
 90%|█████████ | 335582/371472 [4:32:07<2:48:12,  3.56it/s]
 90%|█████████ | 335583/371472 [4:32:07<2:52:54,  3.46it/s]
 90%|█████████ | 335584/371472 [4:32:07<2:50:14,  3.51it/s]
 90%|█████████ | 335585/371472 [4:32:07<2:44:52,  3.63it/s]
 90%|█████████ | 335586/371472 [4:32:08<2:37:52,  3.79it/s]
 90%|█████████ | 335587/371472 [4:32:08<2:43:37,  3.66it/s]
 90%|█████████ | 335588/371472 [4:32:08<2:41:58,  3.69it/s]
 90%|█████████ | 335589/371472 [4:32:08<2:37:07,  3.81it/s]
 90%|█████████ | 335590/371472 [4:32:09<2:37:57,  3.79it/s]
 90%|█████████ | 335591/371472 [4:32:09<2:57:09,  3.38it/s]
 90%|█████████ | 335592/371472 [4:32:09<2:51:34,  3.49it/s]
 90%|█████████ | 335593/371472 [4:32:10<2:50:06,  3.52it/s]
 90%|█████████ | 335594/371472 [4:32:10<2:55:10,  3.41it/s]
 90%|█████████ | 335595/371472 [4:32:10<2:54:06,  3.43it/s]
 90%|█████████ | 335596/371472 [4:32:11<2:48:27,  3.55it/s]
 90%|█████████ | 335597/371472 [4:32:11<3:02:39,  3.27it/s]
 90%|█████████ | 335598/371472 [4:32:11<3:08:27,  3.17it/s]
 90%|█████████ | 335599/371472 [4:32:12<3:04:56,  3.23it/s]
 90%|█████████ | 335600/371472 [4:32:12<2:54:17,  3.43it/s]
                                                           
{'loss': 2.6151, 'learning_rate': 1.8695727121894462e-07, 'epoch': 14.45}

 90%|█████████ | 335600/371472 [4:32:12<2:54:17,  3.43it/s]
 90%|█████████ | 335601/371472 [4:32:12<2:59:25,  3.33it/s]
 90%|█████████ | 335602/371472 [4:32:12<2:49:43,  3.52it/s]
 90%|█████████ | 335603/371472 [4:32:13<2:43:25,  3.66it/s]
 90%|█████████ | 335604/371472 [4:32:13<2:51:53,  3.48it/s]
 90%|█████████ | 335605/371472 [4:32:13<2:50:32,  3.51it/s]
 90%|█████████ | 335606/371472 [4:32:13<2:54:50,  3.42it/s]
 90%|█████████ | 335607/371472 [4:32:14<2:57:50,  3.36it/s]
 90%|█████████ | 335608/371472 [4:32:14<2:51:56,  3.48it/s]
 90%|█████████ | 335609/371472 [4:32:14<2:50:03,  3.51it/s]
 90%|█████████ | 335610/371472 [4:32:15<2:52:07,  3.47it/s]
 90%|█████████ | 335611/371472 [4:32:15<2:47:36,  3.57it/s]
 90%|█████████ | 335612/371472 [4:32:15<2:42:03,  3.69it/s]
 90%|█████████ | 335613/371472 [4:32:15<2:43:48,  3.65it/s]
 90%|█████████ | 335614/371472 [4:32:16<2:35:52,  3.83it/s]
 90%|█████████ | 335615/371472 [4:32:16<2:33:10,  3.90it/s]
 90%|█████████ | 335616/371472 [4:32:16<2:49:41,  3.52it/s]
 90%|█████████ | 335617/371472 [4:32:17<2:45:07,  3.62it/s]
 90%|█████████ | 335618/371472 [4:32:17<3:05:31,  3.22it/s]
 90%|█████████ | 335619/371472 [4:32:17<3:03:04,  3.26it/s]
 90%|█████████ | 335620/371472 [4:32:17<3:02:04,  3.28it/s]
                                                           
{'loss': 2.5345, 'learning_rate': 1.8690878924346567e-07, 'epoch': 14.46}

 90%|█████████ | 335620/371472 [4:32:17<3:02:04,  3.28it/s]
 90%|█████████ | 335621/371472 [4:32:18<2:52:11,  3.47it/s]
 90%|█████████ | 335622/371472 [4:32:18<2:46:52,  3.58it/s]
 90%|█████████ | 335623/371472 [4:32:18<2:45:53,  3.60it/s]
 90%|█████████ | 335624/371472 [4:32:19<2:46:27,  3.59it/s]
 90%|█████████ | 335625/371472 [4:32:19<2:46:32,  3.59it/s]
 90%|█████████ | 335626/371472 [4:32:19<2:50:45,  3.50it/s]
 90%|█████████ | 335627/371472 [4:32:19<2:45:31,  3.61it/s]
 90%|█████████ | 335628/371472 [4:32:20<2:57:39,  3.36it/s]
 90%|█████████ | 335629/371472 [4:32:20<2:51:52,  3.48it/s]
 90%|█████████ | 335630/371472 [4:32:20<2:49:12,  3.53it/s]
 90%|█████████ | 335631/371472 [4:32:21<2:41:55,  3.69it/s]
 90%|█████████ | 335632/371472 [4:32:21<2:39:33,  3.74it/s]
 90%|█████████ | 335633/371472 [4:32:21<2:39:54,  3.74it/s]
 90%|█████████ | 335634/371472 [4:32:21<2:36:51,  3.81it/s]
 90%|█████████ | 335635/371472 [4:32:22<2:57:18,  3.37it/s]
 90%|█████████ | 335636/371472 [4:32:22<2:47:27,  3.57it/s]
 90%|█████████ | 335637/371472 [4:32:22<2:47:07,  3.57it/s]
 90%|█████████ | 335638/371472 [4:32:22<2:43:43,  3.65it/s]
 90%|█████████ | 335639/371472 [4:32:23<2:37:45,  3.79it/s]
 90%|█████████ | 335640/371472 [4:32:23<2:42:03,  3.69it/s]
                                                           
{'loss': 2.5777, 'learning_rate': 1.8686030726798685e-07, 'epoch': 14.46}

 90%|█████████ | 335640/371472 [4:32:23<2:42:03,  3.69it/s]
 90%|█████████ | 335641/371472 [4:32:23<2:43:54,  3.64it/s]
 90%|█████████ | 335642/371472 [4:32:24<2:40:42,  3.72it/s]
 90%|█████████ | 335643/371472 [4:32:24<2:45:55,  3.60it/s]
 90%|█████████ | 335644/371472 [4:32:24<3:07:22,  3.19it/s]
 90%|█████████ | 335645/371472 [4:32:24<3:01:52,  3.28it/s]
 90%|█████████ | 335646/371472 [4:32:25<2:52:39,  3.46it/s]
 90%|█████████ | 335647/371472 [4:32:25<3:03:48,  3.25it/s]
 90%|█████████ | 335648/371472 [4:32:25<3:17:35,  3.02it/s]
 90%|█████████ | 335649/371472 [4:32:26<3:05:58,  3.21it/s]
 90%|█████████ | 335650/371472 [4:32:26<3:10:18,  3.14it/s]
 90%|█████████ | 335651/371472 [4:32:26<3:07:49,  3.18it/s]
 90%|█████████ | 335652/371472 [4:32:27<2:58:06,  3.35it/s]
 90%|█████████ | 335653/371472 [4:32:27<2:53:25,  3.44it/s]
 90%|█████████ | 335654/371472 [4:32:27<2:47:13,  3.57it/s]
 90%|█████████ | 335655/371472 [4:32:27<2:41:58,  3.69it/s]
 90%|█████████ | 335656/371472 [4:32:28<2:57:55,  3.35it/s]
 90%|█████████ | 335657/371472 [4:32:28<2:47:46,  3.56it/s]
 90%|█████████ | 335658/371472 [4:32:28<2:44:29,  3.63it/s]
 90%|█████████ | 335659/371472 [4:32:29<2:36:48,  3.81it/s]
 90%|█████████ | 335660/371472 [4:32:29<2:34:47,  3.86it/s]
                                                           
{'loss': 2.532, 'learning_rate': 1.868118252925079e-07, 'epoch': 14.46}

 90%|█████████ | 335660/371472 [4:32:29<2:34:47,  3.86it/s]
 90%|█████████ | 335661/371472 [4:32:29<2:33:33,  3.89it/s]
 90%|█████████ | 335662/371472 [4:32:29<2:43:27,  3.65it/s]
 90%|█████████ | 335663/371472 [4:32:30<2:45:46,  3.60it/s]
 90%|█████████ | 335664/371472 [4:32:30<2:44:06,  3.64it/s]
 90%|█████████ | 335665/371472 [4:32:30<2:45:39,  3.60it/s]
 90%|█████████ | 335666/371472 [4:32:31<2:53:05,  3.45it/s]
 90%|█████████ | 335667/371472 [4:32:31<2:44:35,  3.63it/s]
 90%|█████████ | 335668/371472 [4:32:31<2:43:10,  3.66it/s]
 90%|█████████ | 335669/371472 [4:32:31<2:47:40,  3.56it/s]
 90%|█████████ | 335670/371472 [4:32:32<2:57:18,  3.37it/s]
 90%|█████████ | 335671/371472 [4:32:32<3:00:06,  3.31it/s]
 90%|█████████ | 335672/371472 [4:32:32<3:02:05,  3.28it/s]
 90%|█████████ | 335673/371472 [4:32:33<2:54:14,  3.42it/s]
 90%|█████████ | 335674/371472 [4:32:33<2:58:41,  3.34it/s]
 90%|█████████ | 335675/371472 [4:32:33<2:47:21,  3.56it/s]
 90%|█████████ | 335676/371472 [4:32:33<3:03:42,  3.25it/s]
 90%|█████████ | 335677/371472 [4:32:34<2:58:38,  3.34it/s]
 90%|█████████ | 335678/371472 [4:32:34<2:56:39,  3.38it/s]
 90%|█████████ | 335679/371472 [4:32:34<2:58:12,  3.35it/s]
 90%|█████████ | 335680/371472 [4:32:35<3:03:11,  3.26it/s]
                                                           
{'loss': 2.5491, 'learning_rate': 1.8676334331702904e-07, 'epoch': 14.46}

 90%|█████████ | 335680/371472 [4:32:35<3:03:11,  3.26it/s]
 90%|█████████ | 335681/371472 [4:32:35<3:00:54,  3.30it/s]
 90%|█████████ | 335682/371472 [4:32:35<2:58:01,  3.35it/s]
 90%|█████████ | 335683/371472 [4:32:35<2:50:38,  3.50it/s]
 90%|█████████ | 335684/371472 [4:32:36<2:50:46,  3.49it/s]
 90%|█████████ | 335685/371472 [4:32:36<2:51:10,  3.48it/s]
 90%|█████████ | 335686/371472 [4:32:36<3:04:09,  3.24it/s]
 90%|█████████ | 335687/371472 [4:32:37<2:58:20,  3.34it/s]
 90%|█████████ | 335688/371472 [4:32:37<3:00:29,  3.30it/s]
 90%|█████████ | 335689/371472 [4:32:37<2:54:08,  3.42it/s]
 90%|█████████ | 335690/371472 [4:32:38<2:49:11,  3.52it/s]
 90%|█████████ | 335691/371472 [4:32:38<2:46:49,  3.57it/s]
 90%|█████████ | 335692/371472 [4:32:38<2:39:20,  3.74it/s]
 90%|█████████ | 335693/371472 [4:32:38<2:39:28,  3.74it/s]
 90%|█████████ | 335694/371472 [4:32:39<2:38:10,  3.77it/s]
 90%|█████████ | 335695/371472 [4:32:39<2:38:29,  3.76it/s]
 90%|█████████ | 335696/371472 [4:32:39<2:35:07,  3.84it/s]
 90%|█████████ | 335697/371472 [4:32:39<2:46:56,  3.57it/s]
 90%|█████████ | 335698/371472 [4:32:40<2:41:50,  3.68it/s]
 90%|█████████ | 335699/371472 [4:32:40<2:47:12,  3.57it/s]
 90%|█████████ | 335700/371472 [4:32:40<2:44:45,  3.62it/s]
                                                           
{'loss': 2.6189, 'learning_rate': 1.8671486134155011e-07, 'epoch': 14.46}

 90%|█████████ | 335700/371472 [4:32:40<2:44:45,  3.62it/s]
 90%|█████████ | 335701/371472 [4:32:40<2:38:36,  3.76it/s]
 90%|█████████ | 335702/371472 [4:32:41<2:37:13,  3.79it/s]
 90%|█████████ | 335703/371472 [4:32:41<2:52:10,  3.46it/s]
 90%|█████████ | 335704/371472 [4:32:41<2:56:37,  3.38it/s]
 90%|█████████ | 335705/371472 [4:32:42<3:10:06,  3.14it/s]
 90%|█████████ | 335706/371472 [4:32:42<2:59:14,  3.33it/s]
 90%|█████████ | 335707/371472 [4:32:42<2:51:19,  3.48it/s]
 90%|█████████ | 335708/371472 [4:32:43<2:49:40,  3.51it/s]
 90%|█████████ | 335709/371472 [4:32:43<3:02:24,  3.27it/s]
 90%|█████████ | 335710/371472 [4:32:43<2:53:12,  3.44it/s]
 90%|█████████ | 335711/371472 [4:32:43<2:51:25,  3.48it/s]
 90%|█████████ | 335712/371472 [4:32:44<3:09:35,  3.14it/s]
 90%|█████████ | 335713/371472 [4:32:44<3:01:08,  3.29it/s]
 90%|█████████ | 335714/371472 [4:32:44<2:53:41,  3.43it/s]
 90%|█████████ | 335715/371472 [4:32:45<2:45:15,  3.61it/s]
 90%|█████████ | 335716/371472 [4:32:45<2:46:45,  3.57it/s]
 90%|█████████ | 335717/371472 [4:32:45<2:49:46,  3.51it/s]
 90%|█████████ | 335718/371472 [4:32:46<2:51:18,  3.48it/s]
 90%|█████████ | 335719/371472 [4:32:46<2:43:53,  3.64it/s]
 90%|█████████ | 335720/371472 [4:32:46<2:55:10,  3.40it/s]
                                                           
{'loss': 2.5919, 'learning_rate': 1.8666637936607127e-07, 'epoch': 14.46}

 90%|█████████ | 335720/371472 [4:32:46<2:55:10,  3.40it/s]
 90%|█████████ | 335721/371472 [4:32:46<2:59:45,  3.31it/s]
 90%|█████████ | 335722/371472 [4:32:47<2:53:25,  3.44it/s]
 90%|█████████ | 335723/371472 [4:32:47<2:49:35,  3.51it/s]
 90%|█████████ | 335724/371472 [4:32:47<2:47:44,  3.55it/s]
 90%|█████████ | 335725/371472 [4:32:48<2:52:22,  3.46it/s]
 90%|█████████ | 335726/371472 [4:32:48<2:47:43,  3.55it/s]
 90%|█████████ | 335727/371472 [4:32:48<2:59:59,  3.31it/s]
 90%|█████████ | 335728/371472 [4:32:49<3:15:08,  3.05it/s]
 90%|█████████ | 335729/371472 [4:32:49<3:06:38,  3.19it/s]
 90%|█████████ | 335730/371472 [4:32:49<3:00:50,  3.29it/s]
 90%|█████████ | 335731/371472 [4:32:49<2:53:32,  3.43it/s]
 90%|█████████ | 335732/371472 [4:32:50<2:58:15,  3.34it/s]
 90%|█████████ | 335733/371472 [4:32:50<2:58:04,  3.34it/s]
 90%|█████████ | 335734/371472 [4:32:50<2:49:52,  3.51it/s]
 90%|█████████ | 335735/371472 [4:32:50<2:47:40,  3.55it/s]
 90%|█████████ | 335736/371472 [4:32:51<2:41:05,  3.70it/s]
 90%|█████████ | 335737/371472 [4:32:51<2:39:37,  3.73it/s]
 90%|█████████ | 335738/371472 [4:32:51<2:38:25,  3.76it/s]
 90%|█████████ | 335739/371472 [4:32:52<2:40:40,  3.71it/s]
 90%|█████████ | 335740/371472 [4:32:52<2:40:59,  3.70it/s]
                                                           
{'loss': 2.5821, 'learning_rate': 1.866178973905923e-07, 'epoch': 14.46}

 90%|█████████ | 335740/371472 [4:32:52<2:40:59,  3.70it/s]
 90%|█████████ | 335741/371472 [4:32:52<2:54:44,  3.41it/s]
 90%|█████████ | 335742/371472 [4:32:52<2:54:37,  3.41it/s]
 90%|█████████ | 335743/371472 [4:32:53<2:47:28,  3.56it/s]
 90%|█████████ | 335744/371472 [4:32:53<2:43:35,  3.64it/s]
 90%|█████████ | 335745/371472 [4:32:53<2:38:24,  3.76it/s]
 90%|█████████ | 335746/371472 [4:32:54<2:47:07,  3.56it/s]
 90%|█████████ | 335747/371472 [4:32:54<2:46:10,  3.58it/s]
 90%|█████████ | 335748/371472 [4:32:54<2:44:48,  3.61it/s]
 90%|█████████ | 335749/371472 [4:32:54<2:48:25,  3.53it/s]
 90%|█████████ | 335750/371472 [4:32:55<2:54:13,  3.42it/s]
 90%|█████████ | 335751/371472 [4:32:55<2:45:53,  3.59it/s]
 90%|█████████ | 335752/371472 [4:32:55<2:40:04,  3.72it/s]
 90%|█████████ | 335753/371472 [4:32:55<2:39:17,  3.74it/s]
 90%|█████████ | 335754/371472 [4:32:56<2:35:57,  3.82it/s]
 90%|█████████ | 335755/371472 [4:32:56<2:34:04,  3.86it/s]
 90%|█████████ | 335756/371472 [4:32:56<2:37:32,  3.78it/s]
 90%|█████████ | 335757/371472 [4:32:57<2:40:15,  3.71it/s]
 90%|█████████ | 335758/371472 [4:32:57<2:40:58,  3.70it/s]
 90%|█████████ | 335759/371472 [4:32:57<2:38:50,  3.75it/s]
 90%|█████████ | 335760/371472 [4:32:57<2:50:17,  3.50it/s]
                                                           
{'loss': 2.5806, 'learning_rate': 1.865694154151135e-07, 'epoch': 14.46}

 90%|█████████ | 335760/371472 [4:32:57<2:50:17,  3.50it/s]
 90%|█████████ | 335761/371472 [4:32:58<2:48:38,  3.53it/s]
 90%|█████████ | 335762/371472 [4:32:58<2:46:45,  3.57it/s]
 90%|█████████ | 335763/371472 [4:32:58<2:52:45,  3.45it/s]
 90%|█████████ | 335764/371472 [4:32:58<2:43:42,  3.64it/s]
 90%|█████████ | 335765/371472 [4:32:59<2:42:07,  3.67it/s]
 90%|█████████ | 335766/371472 [4:32:59<2:42:37,  3.66it/s]
 90%|█████████ | 335767/371472 [4:32:59<2:39:08,  3.74it/s]
 90%|█████████ | 335768/371472 [4:33:00<2:38:07,  3.76it/s]
 90%|█████████ | 335769/371472 [4:33:00<2:34:28,  3.85it/s]
 90%|█████████ | 335770/371472 [4:33:00<2:34:39,  3.85it/s]
 90%|█████████ | 335771/371472 [4:33:00<2:33:12,  3.88it/s]
 90%|█████████ | 335772/371472 [4:33:01<2:36:47,  3.79it/s]
 90%|█████████ | 335773/371472 [4:33:01<2:37:08,  3.79it/s]
 90%|█████████ | 335774/371472 [4:33:01<2:41:34,  3.68it/s]
 90%|█████████ | 335775/371472 [4:33:01<2:46:27,  3.57it/s]
 90%|█████████ | 335776/371472 [4:33:02<2:47:56,  3.54it/s]
 90%|█████████ | 335777/371472 [4:33:02<2:46:54,  3.56it/s]
 90%|█████████ | 335778/371472 [4:33:02<2:40:44,  3.70it/s]
 90%|█████████ | 335779/371472 [4:33:02<2:38:54,  3.74it/s]
 90%|█████████ | 335780/371472 [4:33:03<2:40:52,  3.70it/s]
                                                           
{'loss': 2.6219, 'learning_rate': 1.8652093343963456e-07, 'epoch': 14.46}

 90%|█████████ | 335780/371472 [4:33:03<2:40:52,  3.70it/s]
 90%|█████████ | 335781/371472 [4:33:03<2:42:11,  3.67it/s]
 90%|█████████ | 335782/371472 [4:33:03<2:48:20,  3.53it/s]
 90%|█████████ | 335783/371472 [4:33:04<2:48:06,  3.54it/s]
 90%|█████████ | 335784/371472 [4:33:04<2:39:59,  3.72it/s]
 90%|█████████ | 335785/371472 [4:33:04<2:52:54,  3.44it/s]
 90%|█████████ | 335786/371472 [4:33:04<2:48:43,  3.52it/s]
 90%|█████████ | 335787/371472 [4:33:05<2:48:14,  3.54it/s]
 90%|█████████ | 335788/371472 [4:33:05<2:55:27,  3.39it/s]
 90%|█████████ | 335789/371472 [4:33:05<2:52:55,  3.44it/s]
 90%|█████████ | 335790/371472 [4:33:06<2:46:36,  3.57it/s]
 90%|█████████ | 335791/371472 [4:33:06<2:43:16,  3.64it/s]
 90%|█████████ | 335792/371472 [4:33:06<2:55:46,  3.38it/s]
 90%|█████████ | 335793/371472 [4:33:06<2:44:12,  3.62it/s]
 90%|█████████ | 335794/371472 [4:33:07<2:44:49,  3.61it/s]
 90%|█████████ | 335795/371472 [4:33:07<2:55:21,  3.39it/s]
 90%|█████████ | 335796/371472 [4:33:07<2:58:31,  3.33it/s]
 90%|█████████ | 335797/371472 [4:33:08<2:50:37,  3.48it/s]
 90%|█████████ | 335798/371472 [4:33:08<2:46:13,  3.58it/s]
 90%|█████████ | 335799/371472 [4:33:08<2:45:13,  3.60it/s]
 90%|█████████ | 335800/371472 [4:33:08<2:49:10,  3.51it/s]
                                                           
{'loss': 2.5689, 'learning_rate': 1.8647245146415568e-07, 'epoch': 14.46}

 90%|█████████ | 335800/371472 [4:33:08<2:49:10,  3.51it/s]
 90%|█████████ | 335801/371472 [4:33:09<2:47:02,  3.56it/s]
 90%|█████████ | 335802/371472 [4:33:09<2:44:00,  3.62it/s]
 90%|█████████ | 335803/371472 [4:33:09<2:43:18,  3.64it/s]
 90%|█████████ | 335804/371472 [4:33:10<2:43:04,  3.65it/s]
 90%|█████████ | 335805/371472 [4:33:10<2:42:45,  3.65it/s]
 90%|█████████ | 335806/371472 [4:33:10<2:50:04,  3.50it/s]
 90%|█████████ | 335807/371472 [4:33:10<2:44:19,  3.62it/s]
 90%|█████████ | 335808/371472 [4:33:11<2:44:54,  3.60it/s]
 90%|█████████ | 335809/371472 [4:33:11<2:44:16,  3.62it/s]
 90%|█████████ | 335810/371472 [4:33:11<2:41:38,  3.68it/s]
 90%|█████████ | 335811/371472 [4:33:12<2:44:49,  3.61it/s]
 90%|█████████ | 335812/371472 [4:33:12<2:48:02,  3.54it/s]
 90%|█████████ | 335813/371472 [4:33:12<2:50:22,  3.49it/s]
 90%|█████████ | 335814/371472 [4:33:12<2:49:03,  3.52it/s]
 90%|█████████ | 335815/371472 [4:33:13<2:47:45,  3.54it/s]
 90%|█████████ | 335816/371472 [4:33:13<2:58:25,  3.33it/s]
 90%|█████████ | 335817/371472 [4:33:13<2:49:01,  3.52it/s]
 90%|█████████ | 335818/371472 [4:33:13<2:43:44,  3.63it/s]
 90%|█████████ | 335819/371472 [4:33:14<2:43:23,  3.64it/s]
 90%|█████████ | 335820/371472 [4:33:14<2:41:49,  3.67it/s]
                                                           
{'loss': 2.5367, 'learning_rate': 1.8642396948867676e-07, 'epoch': 14.46}

 90%|█████████ | 335820/371472 [4:33:14<2:41:49,  3.67it/s]
 90%|█████████ | 335821/371472 [4:33:14<2:40:28,  3.70it/s]
 90%|█████████ | 335822/371472 [4:33:15<2:36:06,  3.81it/s]
 90%|█████████ | 335823/371472 [4:33:15<2:35:17,  3.83it/s]
 90%|█████████ | 335824/371472 [4:33:15<2:44:53,  3.60it/s]
 90%|█████████ | 335825/371472 [4:33:15<2:44:40,  3.61it/s]
 90%|█████████ | 335826/371472 [4:33:16<3:17:25,  3.01it/s]
 90%|█████████ | 335827/371472 [4:33:16<2:59:55,  3.30it/s]
 90%|█████████ | 335828/371472 [4:33:16<2:52:45,  3.44it/s]
 90%|█████████ | 335829/371472 [4:33:17<2:57:54,  3.34it/s]
 90%|█████████ | 335830/371472 [4:33:17<2:52:41,  3.44it/s]
 90%|█████████ | 335831/371472 [4:33:17<2:46:20,  3.57it/s]
 90%|█████████ | 335832/371472 [4:33:17<2:42:06,  3.66it/s]
 90%|█████████ | 335833/371472 [4:33:18<2:43:25,  3.63it/s]
 90%|█████████ | 335834/371472 [4:33:18<2:42:26,  3.66it/s]
 90%|█████████ | 335835/371472 [4:33:18<2:41:27,  3.68it/s]
 90%|█████████ | 335836/371472 [4:33:19<2:58:27,  3.33it/s]
 90%|█████████ | 335837/371472 [4:33:19<3:17:30,  3.01it/s]
 90%|█████████ | 335838/371472 [4:33:19<3:08:30,  3.15it/s]
 90%|█████████ | 335839/371472 [4:33:20<2:58:18,  3.33it/s]
 90%|█████████ | 335840/371472 [4:33:20<2:53:50,  3.42it/s]
                                                           
{'loss': 2.6006, 'learning_rate': 1.8637548751319783e-07, 'epoch': 14.47}

 90%|█████████ | 335840/371472 [4:33:20<2:53:50,  3.42it/s]
 90%|█████████ | 335841/371472 [4:33:20<2:47:25,  3.55it/s]
 90%|█████████ | 335842/371472 [4:33:20<2:46:22,  3.57it/s]
 90%|█████████ | 335843/371472 [4:33:21<2:54:44,  3.40it/s]
 90%|█████████ | 335844/371472 [4:33:21<2:56:42,  3.36it/s]
 90%|█████████ | 335845/371472 [4:33:21<2:51:37,  3.46it/s]
 90%|█████████ | 335846/371472 [4:33:22<2:50:36,  3.48it/s]
 90%|█████████ | 335847/371472 [4:33:22<2:51:18,  3.47it/s]
 90%|█████████ | 335848/371472 [4:33:22<2:49:04,  3.51it/s]
 90%|█████████ | 335849/371472 [4:33:22<2:42:49,  3.65it/s]
 90%|█████████ | 335850/371472 [4:33:23<2:41:28,  3.68it/s]
 90%|█████████ | 335851/371472 [4:33:23<2:39:26,  3.72it/s]
 90%|█████████ | 335852/371472 [4:33:23<2:40:04,  3.71it/s]
 90%|█████████ | 335853/371472 [4:33:23<2:39:59,  3.71it/s]
 90%|█████████ | 335854/371472 [4:33:24<2:42:00,  3.66it/s]
 90%|█████████ | 335855/371472 [4:33:24<2:39:00,  3.73it/s]
 90%|█████████ | 335856/371472 [4:33:24<2:37:37,  3.77it/s]
 90%|█████████ | 335857/371472 [4:33:25<2:32:23,  3.90it/s]
 90%|█████████ | 335858/371472 [4:33:25<2:49:40,  3.50it/s]
 90%|█████████ | 335859/371472 [4:33:25<2:46:18,  3.57it/s]
 90%|█████████ | 335860/371472 [4:33:25<2:42:00,  3.66it/s]
                                                           
{'loss': 2.5307, 'learning_rate': 1.8632700553771898e-07, 'epoch': 14.47}

 90%|█████████ | 335860/371472 [4:33:25<2:42:00,  3.66it/s]
 90%|█████████ | 335861/371472 [4:33:26<2:46:34,  3.56it/s]
 90%|█████████ | 335862/371472 [4:33:26<2:43:27,  3.63it/s]
 90%|█████████ | 335863/371472 [4:33:26<2:45:02,  3.60it/s]
 90%|█████████ | 335864/371472 [4:33:27<2:44:48,  3.60it/s]
 90%|█████████ | 335865/371472 [4:33:27<2:56:21,  3.36it/s]
 90%|█████████ | 335866/371472 [4:33:27<2:49:35,  3.50it/s]
 90%|█████████ | 335867/371472 [4:33:27<2:50:19,  3.48it/s]
 90%|█████████ | 335868/371472 [4:33:28<2:45:55,  3.58it/s]
 90%|█████████ | 335869/371472 [4:33:28<2:57:33,  3.34it/s]
 90%|█████████ | 335870/371472 [4:33:28<2:46:54,  3.55it/s]
 90%|█████████ | 335871/371472 [4:33:28<2:42:24,  3.65it/s]
 90%|█████████ | 335872/371472 [4:33:29<2:46:09,  3.57it/s]
 90%|█████████ | 335873/371472 [4:33:29<2:49:50,  3.49it/s]
 90%|█████████ | 335874/371472 [4:33:29<2:40:15,  3.70it/s]
 90%|█████████ | 335875/371472 [4:33:30<2:39:55,  3.71it/s]
 90%|█████████ | 335876/371472 [4:33:30<2:36:42,  3.79it/s]
 90%|█████████ | 335877/371472 [4:33:30<2:43:18,  3.63it/s]
 90%|█████████ | 335878/371472 [4:33:30<2:44:07,  3.61it/s]
 90%|█████████ | 335879/371472 [4:33:31<2:41:51,  3.67it/s]
 90%|█████████ | 335880/371472 [4:33:31<2:56:33,  3.36it/s]
                                                           
{'loss': 2.6742, 'learning_rate': 1.8627852356224002e-07, 'epoch': 14.47}

 90%|█████████ | 335880/371472 [4:33:31<2:56:33,  3.36it/s]
 90%|█████████ | 335881/371472 [4:33:31<3:00:24,  3.29it/s]
 90%|█████████ | 335882/371472 [4:33:32<2:56:02,  3.37it/s]
 90%|█████████ | 335883/371472 [4:33:32<2:47:50,  3.53it/s]
 90%|█████████ | 335884/371472 [4:33:32<2:41:51,  3.66it/s]
 90%|█████████ | 335885/371472 [4:33:32<2:40:27,  3.70it/s]
 90%|█████████ | 335886/371472 [4:33:33<2:42:15,  3.66it/s]
 90%|█████████ | 335887/371472 [4:33:33<2:42:15,  3.66it/s]
 90%|█████████ | 335888/371472 [4:33:33<2:36:24,  3.79it/s]
 90%|█████████ | 335889/371472 [4:33:33<2:37:34,  3.76it/s]
 90%|█████████ | 335890/371472 [4:33:34<2:35:21,  3.82it/s]
 90%|█████████ | 335891/371472 [4:33:34<2:51:26,  3.46it/s]
 90%|█████████ | 335892/371472 [4:33:34<2:49:16,  3.50it/s]
 90%|█████████ | 335893/371472 [4:33:35<2:49:22,  3.50it/s]
 90%|█████████ | 335894/371472 [4:33:35<2:42:38,  3.65it/s]
 90%|█████████ | 335895/371472 [4:33:35<2:39:16,  3.72it/s]
 90%|█████████ | 335896/371472 [4:33:35<2:38:40,  3.74it/s]
 90%|█████████ | 335897/371472 [4:33:36<2:47:57,  3.53it/s]
 90%|█████████ | 335898/371472 [4:33:36<2:57:35,  3.34it/s]
 90%|█████████ | 335899/371472 [4:33:36<2:57:58,  3.33it/s]
 90%|█████████ | 335900/371472 [4:33:37<2:58:29,  3.32it/s]
                                                           
{'loss': 2.6068, 'learning_rate': 1.862300415867612e-07, 'epoch': 14.47}

 90%|█████████ | 335900/371472 [4:33:37<2:58:29,  3.32it/s]
 90%|█████████ | 335901/371472 [4:33:37<2:57:05,  3.35it/s]
 90%|█████████ | 335902/371472 [4:33:37<2:53:28,  3.42it/s]
 90%|█████████ | 335903/371472 [4:33:38<2:49:27,  3.50it/s]
 90%|█████████ | 335904/371472 [4:33:38<2:41:32,  3.67it/s]
 90%|█████████ | 335905/371472 [4:33:38<2:43:47,  3.62it/s]
 90%|█████████ | 335906/371472 [4:33:38<2:37:29,  3.76it/s]
 90%|█████████ | 335907/371472 [4:33:39<2:46:34,  3.56it/s]
 90%|█████████ | 335908/371472 [4:33:39<2:44:24,  3.61it/s]
 90%|█████████ | 335909/371472 [4:33:39<2:54:11,  3.40it/s]
 90%|█████████ | 335910/371472 [4:33:40<2:57:48,  3.33it/s]
 90%|█████████ | 335911/371472 [4:33:40<2:52:57,  3.43it/s]
 90%|█████████ | 335912/371472 [4:33:40<2:46:49,  3.55it/s]
 90%|█████████ | 335913/371472 [4:33:40<2:53:21,  3.42it/s]
 90%|█████████ | 335914/371472 [4:33:41<2:56:05,  3.37it/s]
 90%|█████████ | 335915/371472 [4:33:41<2:52:51,  3.43it/s]
 90%|█████████ | 335916/371472 [4:33:41<2:45:46,  3.57it/s]
 90%|█████████ | 335917/371472 [4:33:41<2:38:48,  3.73it/s]
 90%|█████████ | 335918/371472 [4:33:42<2:47:58,  3.53it/s]
 90%|█████████ | 335919/371472 [4:33:42<2:43:46,  3.62it/s]
 90%|█████████ | 335920/371472 [4:33:42<2:41:41,  3.66it/s]
                                                           
{'loss': 2.4895, 'learning_rate': 1.8618155961128224e-07, 'epoch': 14.47}

 90%|█████████ | 335920/371472 [4:33:42<2:41:41,  3.66it/s]
 90%|█████████ | 335921/371472 [4:33:43<2:40:27,  3.69it/s]
 90%|█████████ | 335922/371472 [4:33:43<2:46:11,  3.57it/s]
 90%|█████████ | 335923/371472 [4:33:43<2:40:37,  3.69it/s]
 90%|█████████ | 335924/371472 [4:33:43<2:40:22,  3.69it/s]
 90%|█████████ | 335925/371472 [4:33:44<2:44:49,  3.59it/s]
 90%|█████████ | 335926/371472 [4:33:44<2:49:36,  3.49it/s]
 90%|█████████ | 335927/371472 [4:33:44<2:46:47,  3.55it/s]
 90%|█████████ | 335928/371472 [4:33:45<2:43:32,  3.62it/s]
 90%|█████████ | 335929/371472 [4:33:45<2:40:13,  3.70it/s]
 90%|█████████ | 335930/371472 [4:33:45<2:47:43,  3.53it/s]
 90%|█████████ | 335931/371472 [4:33:45<2:46:08,  3.57it/s]
 90%|█████████ | 335932/371472 [4:33:46<2:42:47,  3.64it/s]
 90%|█████████ | 335933/371472 [4:33:46<2:40:10,  3.70it/s]
 90%|█████████ | 335934/371472 [4:33:46<2:45:51,  3.57it/s]
 90%|█████████ | 335935/371472 [4:33:46<2:42:10,  3.65it/s]
 90%|█████████ | 335936/371472 [4:33:47<2:41:07,  3.68it/s]
 90%|█████████ | 335937/371472 [4:33:47<2:37:25,  3.76it/s]
 90%|█████████ | 335938/371472 [4:33:47<2:34:23,  3.84it/s]
 90%|█████████ | 335939/371472 [4:33:47<2:35:40,  3.80it/s]
 90%|█████████ | 335940/371472 [4:33:48<2:37:21,  3.76it/s]
                                                           
{'loss': 2.5679, 'learning_rate': 1.8613307763580342e-07, 'epoch': 14.47}

 90%|█████████ | 335940/371472 [4:33:48<2:37:21,  3.76it/s]
 90%|█████████ | 335941/371472 [4:33:48<2:38:15,  3.74it/s]
 90%|█████████ | 335942/371472 [4:33:48<2:44:33,  3.60it/s]
 90%|█████████ | 335943/371472 [4:33:49<2:45:41,  3.57it/s]
 90%|█████████ | 335944/371472 [4:33:49<2:45:07,  3.59it/s]
 90%|█████████ | 335945/371472 [4:33:49<2:39:55,  3.70it/s]
 90%|█████████ | 335946/371472 [4:33:49<2:40:15,  3.69it/s]
 90%|█████████ | 335947/371472 [4:33:50<2:40:03,  3.70it/s]
 90%|█████████ | 335948/371472 [4:33:50<2:39:35,  3.71it/s]
 90%|█████████ | 335949/371472 [4:33:50<2:56:51,  3.35it/s]
 90%|█████████ | 335950/371472 [4:33:51<2:49:57,  3.48it/s]
 90%|█████████ | 335951/371472 [4:33:51<2:44:42,  3.59it/s]
 90%|█████████ | 335952/371472 [4:33:51<2:42:14,  3.65it/s]
 90%|█████████ | 335953/371472 [4:33:51<2:46:58,  3.55it/s]
 90%|█████████ | 335954/371472 [4:33:52<2:48:45,  3.51it/s]
 90%|█████████ | 335955/371472 [4:33:52<2:46:47,  3.55it/s]
 90%|█████████ | 335956/371472 [4:33:52<2:42:35,  3.64it/s]
 90%|█████████ | 335957/371472 [4:33:52<2:38:10,  3.74it/s]
 90%|█████████ | 335958/371472 [4:33:53<2:36:25,  3.78it/s]
 90%|█████████ | 335959/371472 [4:33:53<2:32:21,  3.88it/s]
 90%|█████████ | 335960/371472 [4:33:53<2:33:23,  3.86it/s]
                                                           
{'loss': 2.7321, 'learning_rate': 1.8608459566032447e-07, 'epoch': 14.47}

 90%|█████████ | 335960/371472 [4:33:53<2:33:23,  3.86it/s]
 90%|█████████ | 335961/371472 [4:33:54<2:38:39,  3.73it/s]
 90%|█████████ | 335962/371472 [4:33:54<2:41:58,  3.65it/s]
 90%|█████████ | 335963/371472 [4:33:54<2:41:46,  3.66it/s]
 90%|█████████ | 335964/371472 [4:33:54<2:46:40,  3.55it/s]
 90%|█████████ | 335965/371472 [4:33:55<2:55:43,  3.37it/s]
 90%|█████████ | 335966/371472 [4:33:55<2:55:19,  3.38it/s]
 90%|█████████ | 335967/371472 [4:33:55<2:52:18,  3.43it/s]
 90%|█████████ | 335968/371472 [4:33:56<2:45:55,  3.57it/s]
 90%|█████████ | 335969/371472 [4:33:56<2:41:16,  3.67it/s]
 90%|█████████ | 335970/371472 [4:33:56<2:37:10,  3.76it/s]
 90%|█████████ | 335971/371472 [4:33:56<2:42:59,  3.63it/s]
 90%|█████████ | 335972/371472 [4:33:57<2:42:18,  3.65it/s]
 90%|█████████ | 335973/371472 [4:33:57<2:45:24,  3.58it/s]
 90%|█████████ | 335974/371472 [4:33:57<2:57:51,  3.33it/s]
 90%|█████████ | 335975/371472 [4:33:58<2:53:59,  3.40it/s]
 90%|█████████ | 335976/371472 [4:33:58<2:46:51,  3.55it/s]
 90%|█████████ | 335977/371472 [4:33:58<2:54:08,  3.40it/s]
 90%|█████████ | 335978/371472 [4:33:58<2:50:21,  3.47it/s]
 90%|█████████ | 335979/371472 [4:33:59<2:48:06,  3.52it/s]
 90%|█████████ | 335980/371472 [4:33:59<2:45:29,  3.57it/s]
                                                           
{'loss': 2.5233, 'learning_rate': 1.8603611368484562e-07, 'epoch': 14.47}

 90%|█████████ | 335980/371472 [4:33:59<2:45:29,  3.57it/s]
 90%|█████████ | 335981/371472 [4:33:59<2:48:39,  3.51it/s]
 90%|█████████ | 335982/371472 [4:33:59<2:41:57,  3.65it/s]
 90%|█████████ | 335983/371472 [4:34:00<2:40:28,  3.69it/s]
 90%|█████████ | 335984/371472 [4:34:00<2:36:39,  3.78it/s]
 90%|█████████ | 335985/371472 [4:34:00<2:45:26,  3.57it/s]
 90%|█████████ | 335986/371472 [4:34:01<2:46:16,  3.56it/s]
 90%|█████████ | 335987/371472 [4:34:01<2:48:02,  3.52it/s]
 90%|█████████ | 335988/371472 [4:34:01<2:39:55,  3.70it/s]
 90%|█████████ | 335989/371472 [4:34:01<2:37:21,  3.76it/s]
 90%|█████████ | 335990/371472 [4:34:02<2:47:17,  3.54it/s]
 90%|█████████ | 335991/371472 [4:34:02<2:50:08,  3.48it/s]
 90%|█████████ | 335992/371472 [4:34:02<2:55:02,  3.38it/s]
 90%|█████████ | 335993/371472 [4:34:03<2:45:45,  3.57it/s]
 90%|█████████ | 335994/371472 [4:34:03<2:49:42,  3.48it/s]
 90%|█████████ | 335995/371472 [4:34:03<2:44:39,  3.59it/s]
 90%|█████████ | 335996/371472 [4:34:03<2:50:23,  3.47it/s]
 90%|█████████ | 335997/371472 [4:34:04<2:54:59,  3.38it/s]
 90%|█████████ | 335998/371472 [4:34:04<2:46:16,  3.56it/s]
 90%|█████████ | 335999/371472 [4:34:04<2:46:55,  3.54it/s]
 90%|█████████ | 336000/371472 [4:34:05<2:44:45,  3.59it/s]
                                                           
{'loss': 2.6011, 'learning_rate': 1.8598763170936666e-07, 'epoch': 14.47}

 90%|█████████ | 336000/371472 [4:34:05<2:44:45,  3.59it/s]
 90%|█████████ | 336001/371472 [4:34:05<2:45:41,  3.57it/s]
 90%|█████████ | 336002/371472 [4:34:05<2:50:00,  3.48it/s]
 90%|█████████ | 336003/371472 [4:34:05<2:43:31,  3.61it/s]
 90%|█████████ | 336004/371472 [4:34:06<2:40:55,  3.67it/s]
 90%|█████████ | 336005/371472 [4:34:06<2:42:12,  3.64it/s]
 90%|█████████ | 336006/371472 [4:34:06<2:53:53,  3.40it/s]
 90%|█████████ | 336007/371472 [4:34:07<2:51:35,  3.44it/s]
 90%|█████████ | 336008/371472 [4:34:07<2:45:43,  3.57it/s]
 90%|█████████ | 336009/371472 [4:34:07<2:45:58,  3.56it/s]
 90%|█████████ | 336010/371472 [4:34:07<2:57:39,  3.33it/s]
 90%|█████████ | 336011/371472 [4:34:08<2:51:30,  3.45it/s]
 90%|█████████ | 336012/371472 [4:34:08<2:43:13,  3.62it/s]
 90%|█████████ | 336013/371472 [4:34:08<2:53:40,  3.40it/s]
 90%|█████████ | 336014/371472 [4:34:09<2:48:19,  3.51it/s]
 90%|█████████ | 336015/371472 [4:34:09<3:04:26,  3.20it/s]
 90%|█████████ | 336016/371472 [4:34:09<2:59:11,  3.30it/s]
 90%|█████████ | 336017/371472 [4:34:09<2:57:24,  3.33it/s]
 90%|█████████ | 336018/371472 [4:34:10<2:48:34,  3.51it/s]
 90%|█████████ | 336019/371472 [4:34:10<2:47:51,  3.52it/s]
 90%|█████████ | 336020/371472 [4:34:10<2:46:04,  3.56it/s]
                                                           
{'loss': 2.6345, 'learning_rate': 1.8593914973388784e-07, 'epoch': 14.47}

 90%|█████████ | 336020/371472 [4:34:10<2:46:04,  3.56it/s]
 90%|█████████ | 336021/371472 [4:34:11<2:44:59,  3.58it/s]
 90%|█████████ | 336022/371472 [4:34:11<2:39:30,  3.70it/s]
 90%|█████████ | 336023/371472 [4:34:11<2:37:29,  3.75it/s]
 90%|█████████ | 336024/371472 [4:34:11<2:33:59,  3.84it/s]
 90%|█████████ | 336025/371472 [4:34:12<2:43:15,  3.62it/s]
 90%|█████████ | 336026/371472 [4:34:12<2:39:27,  3.70it/s]
 90%|█████████ | 336027/371472 [4:34:12<2:36:35,  3.77it/s]
 90%|█████████ | 336028/371472 [4:34:12<2:34:19,  3.83it/s]
 90%|█████████ | 336029/371472 [4:34:13<2:39:35,  3.70it/s]
 90%|█████████ | 336030/371472 [4:34:13<2:43:41,  3.61it/s]
 90%|█████████ | 336031/371472 [4:34:13<2:45:12,  3.58it/s]
 90%|█████████ | 336032/371472 [4:34:14<2:40:10,  3.69it/s]
 90%|█████████ | 336033/371472 [4:34:14<2:41:34,  3.66it/s]
 90%|█████████ | 336034/371472 [4:34:14<2:47:16,  3.53it/s]
 90%|█████████ | 336035/371472 [4:34:14<2:46:58,  3.54it/s]
 90%|█████████ | 336036/371472 [4:34:15<2:40:13,  3.69it/s]
 90%|█████████ | 336037/371472 [4:34:15<2:59:30,  3.29it/s]
 90%|█████████ | 336038/371472 [4:34:15<3:04:51,  3.19it/s]
 90%|█████████ | 336039/371472 [4:34:16<3:07:50,  3.14it/s]
 90%|█████████ | 336040/371472 [4:34:16<2:52:53,  3.42it/s]
                                                           
{'loss': 2.3949, 'learning_rate': 1.8589066775840889e-07, 'epoch': 14.47}

 90%|█████████ | 336040/371472 [4:34:16<2:52:53,  3.42it/s]
 90%|█████████ | 336041/371472 [4:34:16<2:48:08,  3.51it/s]
 90%|█████████ | 336042/371472 [4:34:16<2:53:10,  3.41it/s]
 90%|█████████ | 336043/371472 [4:34:17<2:48:56,  3.50it/s]
 90%|█████████ | 336044/371472 [4:34:17<2:49:30,  3.48it/s]
 90%|█████████ | 336045/371472 [4:34:17<2:44:47,  3.58it/s]
 90%|█████████ | 336046/371472 [4:34:18<2:39:28,  3.70it/s]
 90%|█████████ | 336047/371472 [4:34:18<2:49:18,  3.49it/s]
 90%|█████████ | 336048/371472 [4:34:18<2:41:30,  3.66it/s]
 90%|█████████ | 336049/371472 [4:34:18<2:34:24,  3.82it/s]
 90%|█████████ | 336050/371472 [4:34:19<2:38:47,  3.72it/s]
 90%|█████████ | 336051/371472 [4:34:19<2:36:23,  3.77it/s]
 90%|█████████ | 336052/371472 [4:34:19<2:35:35,  3.79it/s]
 90%|█████████ | 336053/371472 [4:34:19<2:35:05,  3.81it/s]
 90%|█████████ | 336054/371472 [4:34:20<2:41:07,  3.66it/s]
 90%|█████████ | 336055/371472 [4:34:20<2:42:27,  3.63it/s]
 90%|█████████ | 336056/371472 [4:34:20<2:41:43,  3.65it/s]
 90%|█████████ | 336057/371472 [4:34:21<2:38:14,  3.73it/s]
 90%|█████████ | 336058/371472 [4:34:21<2:43:36,  3.61it/s]
 90%|█████████ | 336059/371472 [4:34:21<2:46:47,  3.54it/s]
 90%|█████████ | 336060/371472 [4:34:21<2:42:06,  3.64it/s]
                                                           
{'loss': 2.6121, 'learning_rate': 1.8584218578293004e-07, 'epoch': 14.47}

 90%|█████████ | 336060/371472 [4:34:21<2:42:06,  3.64it/s]
 90%|█████████ | 336061/371472 [4:34:22<2:38:45,  3.72it/s]
 90%|█████████ | 336062/371472 [4:34:22<2:42:05,  3.64it/s]
 90%|█████████ | 336063/371472 [4:34:22<2:42:06,  3.64it/s]
 90%|█████████ | 336064/371472 [4:34:22<2:40:38,  3.67it/s]
 90%|█████████ | 336065/371472 [4:34:23<2:41:08,  3.66it/s]
 90%|█████████ | 336066/371472 [4:34:23<2:40:24,  3.68it/s]
 90%|█████████ | 336067/371472 [4:34:23<2:38:28,  3.72it/s]
 90%|█████████ | 336068/371472 [4:34:24<2:43:06,  3.62it/s]
 90%|█████████ | 336069/371472 [4:34:24<2:45:26,  3.57it/s]
 90%|█████████ | 336070/371472 [4:34:24<2:43:25,  3.61it/s]
 90%|█████████ | 336071/371472 [4:34:24<2:42:38,  3.63it/s]
 90%|█████████ | 336072/371472 [4:34:25<2:36:19,  3.77it/s]
 90%|█████████ | 336073/371472 [4:34:25<2:36:53,  3.76it/s]
 90%|█████████ | 336074/371472 [4:34:25<2:36:33,  3.77it/s]
 90%|█████████ | 336075/371472 [4:34:25<2:35:08,  3.80it/s]
 90%|█████████ | 336076/371472 [4:34:26<2:57:20,  3.33it/s]
 90%|█████████ | 336077/371472 [4:34:26<2:53:29,  3.40it/s]
 90%|█████████ | 336078/371472 [4:34:26<2:47:25,  3.52it/s]
 90%|█████████ | 336079/371472 [4:34:27<2:47:00,  3.53it/s]
 90%|█████████ | 336080/371472 [4:34:27<2:44:47,  3.58it/s]
                                                           
{'loss': 2.6152, 'learning_rate': 1.857937038074511e-07, 'epoch': 14.48}

 90%|█████████ | 336080/371472 [4:34:27<2:44:47,  3.58it/s]
 90%|█████████ | 336081/371472 [4:34:27<2:41:51,  3.64it/s]
 90%|█████████ | 336082/371472 [4:34:28<2:58:15,  3.31it/s]
 90%|█████████ | 336083/371472 [4:34:28<3:02:11,  3.24it/s]
 90%|█████████ | 336084/371472 [4:34:28<3:14:30,  3.03it/s]
 90%|█████████ | 336085/371472 [4:34:29<3:07:07,  3.15it/s]
 90%|█████████ | 336086/371472 [4:34:29<2:57:39,  3.32it/s]
 90%|█████████ | 336087/371472 [4:34:29<2:49:22,  3.48it/s]
 90%|█████████ | 336088/371472 [4:34:29<2:42:42,  3.62it/s]
 90%|█████████ | 336089/371472 [4:34:30<2:41:44,  3.65it/s]
 90%|█████████ | 336090/371472 [4:34:30<2:37:05,  3.75it/s]
 90%|█████████ | 336091/371472 [4:34:30<2:35:11,  3.80it/s]
 90%|█████████ | 336092/371472 [4:34:30<2:44:03,  3.59it/s]
 90%|█████████ | 336093/371472 [4:34:31<2:43:49,  3.60it/s]
 90%|█████████ | 336094/371472 [4:34:31<2:52:18,  3.42it/s]
 90%|█████████ | 336095/371472 [4:34:31<2:47:23,  3.52it/s]
 90%|█████████ | 336096/371472 [4:34:31<2:39:59,  3.69it/s]
 90%|█████████ | 336097/371472 [4:34:32<2:37:51,  3.73it/s]
 90%|█████████ | 336098/371472 [4:34:32<2:41:20,  3.65it/s]
 90%|█████████ | 336099/371472 [4:34:32<2:37:02,  3.75it/s]
 90%|█████████ | 336100/371472 [4:34:33<2:37:34,  3.74it/s]
                                                           
{'loss': 2.5647, 'learning_rate': 1.8574522183197226e-07, 'epoch': 14.48}

 90%|█████████ | 336100/371472 [4:34:33<2:37:34,  3.74it/s]
 90%|█████████ | 336101/371472 [4:34:33<2:37:02,  3.75it/s]
 90%|█████████ | 336102/371472 [4:34:33<2:37:34,  3.74it/s]
 90%|█████████ | 336103/371472 [4:34:33<2:34:04,  3.83it/s]
 90%|█████████ | 336104/371472 [4:34:34<2:37:17,  3.75it/s]
 90%|█████████ | 336105/371472 [4:34:34<2:32:21,  3.87it/s]
 90%|█████████ | 336106/371472 [4:34:34<2:30:18,  3.92it/s]
 90%|█████████ | 336107/371472 [4:34:34<2:29:20,  3.95it/s]
 90%|█████████ | 336108/371472 [4:34:35<2:32:15,  3.87it/s]
 90%|█████████ | 336109/371472 [4:34:35<2:27:32,  3.99it/s]
 90%|█████████ | 336110/371472 [4:34:35<2:25:20,  4.06it/s]
 90%|█████████ | 336111/371472 [4:34:35<2:27:32,  3.99it/s]
 90%|█████████ | 336112/371472 [4:34:36<2:23:43,  4.10it/s]
 90%|█████████ | 336113/371472 [4:34:36<2:23:45,  4.10it/s]
 90%|█████████ | 336114/371472 [4:34:36<2:30:19,  3.92it/s]
 90%|█████████ | 336115/371472 [4:34:36<2:35:05,  3.80it/s]
 90%|█████████ | 336116/371472 [4:34:37<2:34:36,  3.81it/s]
 90%|█████████ | 336117/371472 [4:34:37<2:34:55,  3.80it/s]
 90%|█████████ | 336118/371472 [4:34:37<2:44:59,  3.57it/s]
 90%|█████████ | 336119/371472 [4:34:38<2:50:19,  3.46it/s]
 90%|█████████ | 336120/371472 [4:34:38<2:51:01,  3.45it/s]
                                                           
{'loss': 2.7412, 'learning_rate': 1.856967398564933e-07, 'epoch': 14.48}

 90%|█████████ | 336120/371472 [4:34:38<2:51:01,  3.45it/s]
 90%|█████████ | 336121/371472 [4:34:38<2:58:25,  3.30it/s]
 90%|█████████ | 336122/371472 [4:34:38<2:55:15,  3.36it/s]
 90%|█████████ | 336123/371472 [4:34:39<2:52:51,  3.41it/s]
 90%|█████████ | 336124/371472 [4:34:39<2:58:17,  3.30it/s]
 90%|█████████ | 336125/371472 [4:34:39<2:48:09,  3.50it/s]
 90%|█████████ | 336126/371472 [4:34:40<2:42:58,  3.61it/s]
 90%|█████████ | 336127/371472 [4:34:40<2:52:07,  3.42it/s]
 90%|█████████ | 336128/371472 [4:34:40<2:46:00,  3.55it/s]
 90%|█████████ | 336129/371472 [4:34:40<2:42:45,  3.62it/s]
 90%|█████████ | 336130/371472 [4:34:41<2:43:12,  3.61it/s]
 90%|█████████ | 336131/371472 [4:34:41<3:08:42,  3.12it/s]
 90%|█████████ | 336132/371472 [4:34:41<3:03:53,  3.20it/s]
 90%|█████████ | 336133/371472 [4:34:42<2:57:34,  3.32it/s]
 90%|█████████ | 336134/371472 [4:34:42<3:04:34,  3.19it/s]
 90%|█████████ | 336135/371472 [4:34:42<2:56:09,  3.34it/s]
 90%|█████████ | 336136/371472 [4:34:43<3:02:59,  3.22it/s]
 90%|█████████ | 336137/371472 [4:34:43<2:50:40,  3.45it/s]
 90%|█████████ | 336138/371472 [4:34:43<2:51:34,  3.43it/s]
 90%|█████████ | 336139/371472 [4:34:44<3:17:15,  2.99it/s]
 90%|█████████ | 336140/371472 [4:34:44<3:08:55,  3.12it/s]
                                                           
{'loss': 2.502, 'learning_rate': 1.8564825788101448e-07, 'epoch': 14.48}

 90%|█████████ | 336140/371472 [4:34:44<3:08:55,  3.12it/s]
 90%|█████████ | 336141/371472 [4:34:44<3:03:16,  3.21it/s]
 90%|█████████ | 336142/371472 [4:34:44<2:55:18,  3.36it/s]
 90%|█████████ | 336143/371472 [4:34:45<3:00:40,  3.26it/s]
 90%|█████████ | 336144/371472 [4:34:45<3:18:10,  2.97it/s]
 90%|█████████ | 336145/371472 [4:34:45<3:06:53,  3.15it/s]
 90%|█████████ | 336146/371472 [4:34:46<2:54:31,  3.37it/s]
 90%|█████████ | 336147/371472 [4:34:46<2:48:12,  3.50it/s]
 90%|█████████ | 336148/371472 [4:34:46<2:50:48,  3.45it/s]
 90%|█████████ | 336149/371472 [4:34:47<2:59:55,  3.27it/s]
 90%|█████████ | 336150/371472 [4:34:47<3:16:30,  3.00it/s]
 90%|█████████ | 336151/371472 [4:34:47<3:03:15,  3.21it/s]
 90%|█████████ | 336152/371472 [4:34:48<3:03:52,  3.20it/s]
 90%|█████████ | 336153/371472 [4:34:48<3:01:39,  3.24it/s]
 90%|█████████ | 336154/371472 [4:34:48<3:09:20,  3.11it/s]
 90%|█████████ | 336155/371472 [4:34:49<3:08:30,  3.12it/s]
 90%|█████████ | 336156/371472 [4:34:49<3:02:46,  3.22it/s]
 90%|█████████ | 336157/371472 [4:34:49<2:54:40,  3.37it/s]
 90%|█████████ | 336158/371472 [4:34:49<2:54:46,  3.37it/s]
 90%|█████████ | 336159/371472 [4:34:50<3:06:49,  3.15it/s]
 90%|█████████ | 336160/371472 [4:34:50<2:59:13,  3.28it/s]
                                                           
{'loss': 2.5522, 'learning_rate': 1.8559977590553555e-07, 'epoch': 14.48}

 90%|█████████ | 336160/371472 [4:34:50<2:59:13,  3.28it/s]
 90%|█████████ | 336161/371472 [4:34:50<2:58:10,  3.30it/s]
 90%|█████████ | 336162/371472 [4:34:51<2:48:31,  3.49it/s]
 90%|█████████ | 336163/371472 [4:34:51<2:42:04,  3.63it/s]
 90%|█████████ | 336164/371472 [4:34:51<2:47:13,  3.52it/s]
 90%|█████████ | 336165/371472 [4:34:51<2:46:02,  3.54it/s]
 90%|█████████ | 336166/371472 [4:34:52<2:39:49,  3.68it/s]
 90%|█████████ | 336167/371472 [4:34:52<2:40:15,  3.67it/s]
 90%|█████████ | 336168/371472 [4:34:52<2:39:00,  3.70it/s]
 90%|█████████ | 336169/371472 [4:34:52<2:46:23,  3.54it/s]
 90%|█████████ | 336170/371472 [4:34:53<2:45:42,  3.55it/s]
 90%|█████████ | 336171/371472 [4:34:53<2:45:58,  3.54it/s]
 90%|█████████ | 336172/371472 [4:34:53<2:50:55,  3.44it/s]
 90%|█████████ | 336173/371472 [4:34:54<2:48:46,  3.49it/s]
 90%|█████████ | 336174/371472 [4:34:54<2:48:35,  3.49it/s]
 90%|█████████ | 336175/371472 [4:34:54<2:52:04,  3.42it/s]
 90%|█████████ | 336176/371472 [4:34:55<2:55:50,  3.35it/s]
 90%|█████████ | 336177/371472 [4:34:55<3:06:18,  3.16it/s]
 90%|█████████ | 336178/371472 [4:34:55<3:03:28,  3.21it/s]
 90%|█████████ | 336179/371472 [4:34:55<2:58:11,  3.30it/s]
 90%|█████████ | 336180/371472 [4:34:56<2:48:29,  3.49it/s]
                                                           
{'loss': 2.5612, 'learning_rate': 1.8555129393005668e-07, 'epoch': 14.48}

 90%|█████████ | 336180/371472 [4:34:56<2:48:29,  3.49it/s]
 90%|█████████ | 336181/371472 [4:34:56<2:58:26,  3.30it/s]
 90%|█████████ | 336182/371472 [4:34:56<2:51:14,  3.43it/s]
 91%|█████████ | 336183/371472 [4:34:57<2:49:22,  3.47it/s]
 91%|█████████ | 336184/371472 [4:34:57<2:54:07,  3.38it/s]
 91%|█████████ | 336185/371472 [4:34:57<2:54:14,  3.38it/s]
 91%|█████████ | 336186/371472 [4:34:57<2:45:12,  3.56it/s]
 91%|█████████ | 336187/371472 [4:34:58<2:49:58,  3.46it/s]
 91%|█████████ | 336188/371472 [4:34:58<2:47:36,  3.51it/s]
 91%|█████████ | 336189/371472 [4:34:58<2:40:01,  3.67it/s]
 91%|█████████ | 336190/371472 [4:34:59<2:41:30,  3.64it/s]
 91%|█████████ | 336191/371472 [4:34:59<2:42:21,  3.62it/s]
 91%|█████████ | 336192/371472 [4:34:59<2:58:56,  3.29it/s]
 91%|█████████ | 336193/371472 [4:34:59<2:49:45,  3.46it/s]
 91%|█████████ | 336194/371472 [4:35:00<2:52:26,  3.41it/s]
 91%|█████████ | 336195/371472 [4:35:00<2:47:54,  3.50it/s]
 91%|█████████ | 336196/371472 [4:35:00<2:41:06,  3.65it/s]
 91%|█████████ | 336197/371472 [4:35:01<2:39:40,  3.68it/s]
 91%|█████████ | 336198/371472 [4:35:01<2:50:12,  3.45it/s]
 91%|█████████ | 336199/371472 [4:35:01<2:48:57,  3.48it/s]
 91%|█████████ | 336200/371472 [4:35:01<2:45:20,  3.56it/s]
                                                           
{'loss': 2.5573, 'learning_rate': 1.8550281195457775e-07, 'epoch': 14.48}

 91%|█████████ | 336200/371472 [4:35:01<2:45:20,  3.56it/s]
 91%|█████████ | 336201/371472 [4:35:02<2:44:54,  3.56it/s]
 91%|█████████ | 336202/371472 [4:35:02<2:42:59,  3.61it/s]
 91%|█████████ | 336203/371472 [4:35:02<2:47:00,  3.52it/s]
 91%|█████████ | 336204/371472 [4:35:03<2:42:46,  3.61it/s]
 91%|█████████ | 336205/371472 [4:35:03<2:44:05,  3.58it/s]
 91%|█████████ | 336206/371472 [4:35:03<2:39:00,  3.70it/s]
 91%|█████████ | 336207/371472 [4:35:03<2:42:43,  3.61it/s]
 91%|█████████ | 336208/371472 [4:35:04<2:41:30,  3.64it/s]
 91%|█████████ | 336209/371472 [4:35:04<2:43:52,  3.59it/s]
 91%|█████████ | 336210/371472 [4:35:04<2:54:41,  3.36it/s]
 91%|█████████ | 336211/371472 [4:35:05<2:45:14,  3.56it/s]
 91%|█████████ | 336212/371472 [4:35:05<2:37:30,  3.73it/s]
 91%|█████████ | 336213/371472 [4:35:05<2:36:57,  3.74it/s]
 91%|█████████ | 336214/371472 [4:35:05<2:35:40,  3.77it/s]
 91%|█████████ | 336215/371472 [4:35:06<2:31:49,  3.87it/s]
 91%|█████████ | 336216/371472 [4:35:06<2:27:36,  3.98it/s]
 91%|█████████ | 336217/371472 [4:35:06<2:34:47,  3.80it/s]
 91%|█████████ | 336218/371472 [4:35:06<3:00:07,  3.26it/s]
 91%|█████████ | 336219/371472 [4:35:07<3:08:13,  3.12it/s]
 91%|█████████ | 336220/371472 [4:35:07<3:06:55,  3.14it/s]
                                                           
{'loss': 2.5753, 'learning_rate': 1.8545432997909893e-07, 'epoch': 14.48}

 91%|█████████ | 336220/371472 [4:35:07<3:06:55,  3.14it/s]
 91%|█████████ | 336221/371472 [4:35:07<2:56:36,  3.33it/s]
 91%|█████████ | 336222/371472 [4:35:08<2:47:57,  3.50it/s]
 91%|█████████ | 336223/371472 [4:35:08<2:37:50,  3.72it/s]
 91%|█████████ | 336224/371472 [4:35:08<2:34:13,  3.81it/s]
 91%|█████████ | 336225/371472 [4:35:08<2:32:51,  3.84it/s]
 91%|█████████ | 336226/371472 [4:35:09<2:38:42,  3.70it/s]
 91%|█████████ | 336227/371472 [4:35:09<2:33:13,  3.83it/s]
 91%|█████████ | 336228/371472 [4:35:09<2:39:32,  3.68it/s]
 91%|█████████ | 336229/371472 [4:35:10<2:42:16,  3.62it/s]
 91%|█████████ | 336230/371472 [4:35:10<2:42:43,  3.61it/s]
 91%|█████████ | 336231/371472 [4:35:10<2:36:55,  3.74it/s]
 91%|█████████ | 336232/371472 [4:35:10<2:39:34,  3.68it/s]
 91%|█████████ | 336233/371472 [4:35:11<2:38:37,  3.70it/s]
 91%|█████████ | 336234/371472 [4:35:11<2:37:11,  3.74it/s]
 91%|█████████ | 336235/371472 [4:35:11<2:39:16,  3.69it/s]
 91%|█████████ | 336236/371472 [4:35:11<2:51:17,  3.43it/s]
 91%|█████████ | 336237/371472 [4:35:12<2:46:00,  3.54it/s]
 91%|█████████ | 336238/371472 [4:35:12<2:42:08,  3.62it/s]
 91%|█████████ | 336239/371472 [4:35:12<2:35:14,  3.78it/s]
 91%|█████████ | 336240/371472 [4:35:12<2:39:01,  3.69it/s]
                                                           
{'loss': 2.5301, 'learning_rate': 1.8540584800361997e-07, 'epoch': 14.48}

 91%|█████████ | 336240/371472 [4:35:12<2:39:01,  3.69it/s]
 91%|█████████ | 336241/371472 [4:35:13<2:42:03,  3.62it/s]
 91%|█████████ | 336242/371472 [4:35:13<2:38:21,  3.71it/s]
 91%|█████████ | 336243/371472 [4:35:13<2:42:26,  3.61it/s]
 91%|█████████ | 336244/371472 [4:35:14<2:44:35,  3.57it/s]
 91%|█████████ | 336245/371472 [4:35:14<2:43:09,  3.60it/s]
 91%|█████████ | 336246/371472 [4:35:14<2:37:52,  3.72it/s]
 91%|█████████ | 336247/371472 [4:35:14<2:37:50,  3.72it/s]
 91%|█████████ | 336248/371472 [4:35:15<2:38:31,  3.70it/s]
 91%|█████████ | 336249/371472 [4:35:15<2:47:55,  3.50it/s]
 91%|█████████ | 336250/371472 [4:35:15<2:42:28,  3.61it/s]
 91%|█████████ | 336251/371472 [4:35:16<2:40:46,  3.65it/s]
 91%|█████████ | 336252/371472 [4:35:16<2:35:28,  3.78it/s]
 91%|█████████ | 336253/371472 [4:35:16<2:44:11,  3.58it/s]
 91%|█████████ | 336254/371472 [4:35:16<2:46:49,  3.52it/s]
 91%|█████████ | 336255/371472 [4:35:17<2:48:24,  3.49it/s]
 91%|█████████ | 336256/371472 [4:35:17<2:46:14,  3.53it/s]
 91%|█████████ | 336257/371472 [4:35:17<2:37:34,  3.72it/s]
 91%|█████████ | 336258/371472 [4:35:17<2:34:28,  3.80it/s]
 91%|█████████ | 336259/371472 [4:35:18<2:32:00,  3.86it/s]
 91%|█████████ | 336260/371472 [4:35:18<2:36:43,  3.74it/s]
                                                           
{'loss': 2.696, 'learning_rate': 1.8535736602814112e-07, 'epoch': 14.48}

 91%|█████████ | 336260/371472 [4:35:18<2:36:43,  3.74it/s]
 91%|█████████ | 336261/371472 [4:35:18<2:38:30,  3.70it/s]
 91%|█████████ | 336262/371472 [4:35:19<2:42:09,  3.62it/s]
 91%|█████████ | 336263/371472 [4:35:19<2:38:53,  3.69it/s]
 91%|█████████ | 336264/371472 [4:35:19<2:36:07,  3.76it/s]
 91%|█████████ | 336265/371472 [4:35:19<2:36:39,  3.75it/s]
 91%|█████████ | 336266/371472 [4:35:20<2:38:49,  3.69it/s]
 91%|█████████ | 336267/371472 [4:35:20<2:36:27,  3.75it/s]
 91%|█████████ | 336268/371472 [4:35:20<3:18:25,  2.96it/s]
 91%|█████████ | 336269/371472 [4:35:21<3:01:47,  3.23it/s]
 91%|█████████ | 336270/371472 [4:35:21<3:00:34,  3.25it/s]
 91%|█████████ | 336271/371472 [4:35:21<2:59:48,  3.26it/s]
 91%|█████████ | 336272/371472 [4:35:22<3:12:28,  3.05it/s]
 91%|█████████ | 336273/371472 [4:35:22<3:01:00,  3.24it/s]
 91%|█████████ | 336274/371472 [4:35:22<3:04:50,  3.17it/s]
 91%|█████████ | 336275/371472 [4:35:22<2:55:51,  3.34it/s]
 91%|█████████ | 336276/371472 [4:35:23<2:53:38,  3.38it/s]
 91%|█████████ | 336277/371472 [4:35:23<2:44:42,  3.56it/s]
 91%|█████████ | 336278/371472 [4:35:23<2:43:24,  3.59it/s]
 91%|█████████ | 336279/371472 [4:35:24<2:43:19,  3.59it/s]
 91%|█████████ | 336280/371472 [4:35:24<2:43:23,  3.59it/s]
                                                           
{'loss': 2.6997, 'learning_rate': 1.853088840526622e-07, 'epoch': 14.48}

 91%|█████████ | 336280/371472 [4:35:24<2:43:23,  3.59it/s]
 91%|█████████ | 336281/371472 [4:35:24<2:40:14,  3.66it/s]
 91%|█████████ | 336282/371472 [4:35:24<2:45:15,  3.55it/s]
 91%|█████████ | 336283/371472 [4:35:25<2:53:34,  3.38it/s]
 91%|█████████ | 336284/371472 [4:35:25<2:49:17,  3.46it/s]
 91%|█████████ | 336285/371472 [4:35:25<2:40:08,  3.66it/s]
 91%|█████████ | 336286/371472 [4:35:25<2:33:57,  3.81it/s]
 91%|█████████ | 336287/371472 [4:35:26<2:42:23,  3.61it/s]
 91%|█████████ | 336288/371472 [4:35:26<2:44:06,  3.57it/s]
 91%|█████████ | 336289/371472 [4:35:26<2:43:02,  3.60it/s]
 91%|█████████ | 336290/371472 [4:35:27<2:43:52,  3.58it/s]
 91%|█████████ | 336291/371472 [4:35:27<2:50:02,  3.45it/s]
 91%|█████████ | 336292/371472 [4:35:27<3:05:20,  3.16it/s]
 91%|█████████ | 336293/371472 [4:35:28<2:53:59,  3.37it/s]
 91%|█████████ | 336294/371472 [4:35:28<2:47:13,  3.51it/s]
 91%|█████████ | 336295/371472 [4:35:28<2:45:55,  3.53it/s]
 91%|█████████ | 336296/371472 [4:35:28<2:43:14,  3.59it/s]
 91%|█████████ | 336297/371472 [4:35:29<2:36:18,  3.75it/s]
 91%|█████████ | 336298/371472 [4:35:29<2:40:11,  3.66it/s]
 91%|█████████ | 336299/371472 [4:35:29<2:43:15,  3.59it/s]
 91%|█████████ | 336300/371472 [4:35:29<2:39:05,  3.68it/s]
                                                           
{'loss': 2.5177, 'learning_rate': 1.8526040207718334e-07, 'epoch': 14.49}

 91%|█████████ | 336300/371472 [4:35:29<2:39:05,  3.68it/s]
 91%|█████████ | 336301/371472 [4:35:30<2:58:20,  3.29it/s]
 91%|█████████ | 336302/371472 [4:35:30<2:51:31,  3.42it/s]
 91%|█████████ | 336303/371472 [4:35:30<2:48:45,  3.47it/s]
 91%|█████████ | 336304/371472 [4:35:31<2:50:46,  3.43it/s]
 91%|█████████ | 336305/371472 [4:35:31<2:47:30,  3.50it/s]
 91%|█████████ | 336306/371472 [4:35:31<2:55:31,  3.34it/s]
 91%|█████████ | 336307/371472 [4:35:32<2:48:16,  3.48it/s]
 91%|█████████ | 336308/371472 [4:35:32<2:41:51,  3.62it/s]
 91%|█████████ | 336309/371472 [4:35:32<2:33:03,  3.83it/s]
 91%|█████████ | 336310/371472 [4:35:32<2:49:39,  3.45it/s]
 91%|█████████ | 336311/371472 [4:35:33<2:50:30,  3.44it/s]
 91%|█████████ | 336312/371472 [4:35:33<2:43:04,  3.59it/s]
 91%|█████████ | 336313/371472 [4:35:33<2:58:46,  3.28it/s]
 91%|█████████ | 336314/371472 [4:35:34<2:57:28,  3.30it/s]
 91%|█████████ | 336315/371472 [4:35:34<3:01:09,  3.23it/s]
 91%|█████████ | 336316/371472 [4:35:34<3:00:20,  3.25it/s]
 91%|█████████ | 336317/371472 [4:35:34<2:57:47,  3.30it/s]
 91%|█████████ | 336318/371472 [4:35:35<2:49:46,  3.45it/s]
 91%|█████████ | 336319/371472 [4:35:35<2:44:17,  3.57it/s]
 91%|█████████ | 336320/371472 [4:35:35<2:45:41,  3.54it/s]
                                                           
{'loss': 2.5498, 'learning_rate': 1.852119201017044e-07, 'epoch': 14.49}

 91%|█████████ | 336320/371472 [4:35:35<2:45:41,  3.54it/s]
 91%|█████████ | 336321/371472 [4:35:36<2:40:47,  3.64it/s]
 91%|█████████ | 336322/371472 [4:35:36<2:37:13,  3.73it/s]
 91%|█████████ | 336323/371472 [4:35:36<2:43:31,  3.58it/s]
 91%|█████████ | 336324/371472 [4:35:36<2:45:31,  3.54it/s]
 91%|█████████ | 336325/371472 [4:35:37<2:52:52,  3.39it/s]
 91%|█████████ | 336326/371472 [4:35:37<2:49:01,  3.47it/s]
 91%|█████████ | 336327/371472 [4:35:37<2:53:40,  3.37it/s]
 91%|█████████ | 336328/371472 [4:35:38<2:58:18,  3.29it/s]
 91%|█████████ | 336329/371472 [4:35:38<2:50:58,  3.43it/s]
 91%|█████████ | 336330/371472 [4:35:38<2:47:26,  3.50it/s]
 91%|█████████ | 336331/371472 [4:35:38<2:48:02,  3.49it/s]
 91%|█████████ | 336332/371472 [4:35:39<2:40:58,  3.64it/s]
 91%|█████████ | 336333/371472 [4:35:39<2:50:20,  3.44it/s]
 91%|█████████ | 336334/371472 [4:35:39<2:44:49,  3.55it/s]
 91%|█████████ | 336335/371472 [4:35:40<2:48:12,  3.48it/s]
 91%|█████████ | 336336/371472 [4:35:40<2:48:58,  3.47it/s]
 91%|█████████ | 336337/371472 [4:35:40<2:48:17,  3.48it/s]
 91%|█████████ | 336338/371472 [4:35:40<2:53:05,  3.38it/s]
 91%|█████████ | 336339/371472 [4:35:41<2:47:56,  3.49it/s]
 91%|█████████ | 336340/371472 [4:35:41<2:42:54,  3.59it/s]
                                                           
{'loss': 2.5846, 'learning_rate': 1.8516343812622557e-07, 'epoch': 14.49}

 91%|█████████ | 336340/371472 [4:35:41<2:42:54,  3.59it/s]
 91%|█████████ | 336341/371472 [4:35:41<2:50:39,  3.43it/s]
 91%|█████████ | 336342/371472 [4:35:42<2:43:22,  3.58it/s]
 91%|█████████ | 336343/371472 [4:35:42<2:39:08,  3.68it/s]
 91%|█████████ | 336344/371472 [4:35:42<2:36:41,  3.74it/s]
 91%|█████████ | 336345/371472 [4:35:42<2:33:14,  3.82it/s]
 91%|█████████ | 336346/371472 [4:35:43<2:40:38,  3.64it/s]
 91%|█████████ | 336347/371472 [4:35:43<2:45:00,  3.55it/s]
 91%|█████████ | 336348/371472 [4:35:43<2:40:24,  3.65it/s]
 91%|█████████ | 336349/371472 [4:35:43<2:35:56,  3.75it/s]
 91%|█████████ | 336350/371472 [4:35:44<2:43:51,  3.57it/s]
 91%|█████████ | 336351/371472 [4:35:44<2:41:10,  3.63it/s]
 91%|█████████ | 336352/371472 [4:35:44<2:37:46,  3.71it/s]
 91%|█████████ | 336353/371472 [4:35:45<2:40:52,  3.64it/s]
 91%|█████████ | 336354/371472 [4:35:45<2:38:20,  3.70it/s]
 91%|█████████ | 336355/371472 [4:35:45<2:38:03,  3.70it/s]
 91%|█████████ | 336356/371472 [4:35:45<2:43:54,  3.57it/s]
 91%|█████████ | 336357/371472 [4:35:46<2:44:43,  3.55it/s]
 91%|█████████ | 336358/371472 [4:35:46<2:38:05,  3.70it/s]
 91%|█████████ | 336359/371472 [4:35:46<2:40:43,  3.64it/s]
 91%|█████████ | 336360/371472 [4:35:47<2:49:53,  3.44it/s]
                                                           
{'loss': 2.618, 'learning_rate': 1.8511495615074659e-07, 'epoch': 14.49}

 91%|█████████ | 336360/371472 [4:35:47<2:49:53,  3.44it/s]
 91%|█████████ | 336361/371472 [4:35:47<2:48:17,  3.48it/s]
 91%|█████████ | 336362/371472 [4:35:47<2:38:20,  3.70it/s]
 91%|█████████ | 336363/371472 [4:35:47<2:43:19,  3.58it/s]
 91%|█████████ | 336364/371472 [4:35:48<2:39:51,  3.66it/s]
 91%|█████████ | 336365/371472 [4:35:48<2:41:51,  3.62it/s]
 91%|█████████ | 336366/371472 [4:35:48<2:36:29,  3.74it/s]
 91%|█████████ | 336367/371472 [4:35:48<2:32:12,  3.84it/s]
 91%|█████████ | 336368/371472 [4:35:49<2:33:17,  3.82it/s]
 91%|█████████ | 336369/371472 [4:35:49<2:31:13,  3.87it/s]
 91%|█████████ | 336370/371472 [4:35:49<2:35:00,  3.77it/s]
 91%|█████████ | 336371/371472 [4:35:49<2:39:53,  3.66it/s]
 91%|█████████ | 336372/371472 [4:35:50<2:51:05,  3.42it/s]
 91%|█████████ | 336373/371472 [4:35:50<2:58:28,  3.28it/s]
 91%|█████████ | 336374/371472 [4:35:50<3:01:41,  3.22it/s]
 91%|█████████ | 336375/371472 [4:35:51<3:00:51,  3.23it/s]
 91%|█████████ | 336376/371472 [4:35:51<3:03:21,  3.19it/s]
 91%|█████████ | 336377/371472 [4:35:51<2:52:05,  3.40it/s]
 91%|█████████ | 336378/371472 [4:35:52<2:46:02,  3.52it/s]
 91%|█████████ | 336379/371472 [4:35:52<2:41:14,  3.63it/s]
 91%|█████████ | 336380/371472 [4:35:52<2:40:00,  3.66it/s]
                                                           
{'loss': 2.6411, 'learning_rate': 1.8506647417526766e-07, 'epoch': 14.49}

 91%|█████████ | 336380/371472 [4:35:52<2:40:00,  3.66it/s]
 91%|█████████ | 336381/371472 [4:35:52<2:35:23,  3.76it/s]
 91%|█████████ | 336382/371472 [4:35:53<2:40:26,  3.65it/s]
 91%|█████████ | 336383/371472 [4:35:53<2:38:39,  3.69it/s]
 91%|█████████ | 336384/371472 [4:35:53<2:55:46,  3.33it/s]
 91%|█████████ | 336385/371472 [4:35:54<2:58:23,  3.28it/s]
 91%|█████████ | 336386/371472 [4:35:54<2:49:51,  3.44it/s]
 91%|█████████ | 336387/371472 [4:35:54<2:41:50,  3.61it/s]
 91%|█████████ | 336388/371472 [4:35:54<2:42:35,  3.60it/s]
 91%|█████████ | 336389/371472 [4:35:55<2:41:33,  3.62it/s]
 91%|█████████ | 336390/371472 [4:35:55<3:00:27,  3.24it/s]
 91%|█████████ | 336391/371472 [4:35:55<3:06:22,  3.14it/s]
 91%|█████████ | 336392/371472 [4:35:56<3:04:04,  3.18it/s]
 91%|█████████ | 336393/371472 [4:35:56<2:56:03,  3.32it/s]
 91%|█████████ | 336394/371472 [4:35:56<2:50:46,  3.42it/s]
 91%|█████████ | 336395/371472 [4:35:57<2:50:26,  3.43it/s]
 91%|█████████ | 336396/371472 [4:35:57<2:50:49,  3.42it/s]
 91%|█████████ | 336397/371472 [4:35:57<2:47:18,  3.49it/s]
 91%|█████████ | 336398/371472 [4:35:57<2:43:21,  3.58it/s]
 91%|█████████ | 336399/371472 [4:35:58<2:42:06,  3.61it/s]
 91%|█████████ | 336400/371472 [4:35:58<2:53:51,  3.36it/s]
                                                           
{'loss': 2.5752, 'learning_rate': 1.8501799219978883e-07, 'epoch': 14.49}

 91%|█████████ | 336400/371472 [4:35:58<2:53:51,  3.36it/s]
 91%|█████████ | 336401/371472 [4:35:58<3:00:58,  3.23it/s]
 91%|█████████ | 336402/371472 [4:35:59<2:53:33,  3.37it/s]
 91%|█████████ | 336403/371472 [4:35:59<2:45:46,  3.53it/s]
 91%|█████████ | 336404/371472 [4:35:59<2:36:01,  3.75it/s]
 91%|█████████ | 336405/371472 [4:35:59<2:35:11,  3.77it/s]
 91%|█████████ | 336406/371472 [4:36:00<2:38:28,  3.69it/s]
 91%|█████████ | 336407/371472 [4:36:00<2:37:23,  3.71it/s]
 91%|█████████ | 336408/371472 [4:36:00<2:48:10,  3.48it/s]
 91%|█████████ | 336409/371472 [4:36:00<2:48:19,  3.47it/s]
 91%|█████████ | 336410/371472 [4:36:01<2:44:06,  3.56it/s]
 91%|█████████ | 336411/371472 [4:36:01<2:48:07,  3.48it/s]
 91%|█████████ | 336412/371472 [4:36:01<2:43:19,  3.58it/s]
 91%|█████████ | 336413/371472 [4:36:02<2:37:15,  3.72it/s]
 91%|█████████ | 336414/371472 [4:36:02<2:33:45,  3.80it/s]
 91%|█████████ | 336415/371472 [4:36:02<2:28:53,  3.92it/s]
 91%|█████████ | 336416/371472 [4:36:02<2:28:55,  3.92it/s]
 91%|█████████ | 336417/371472 [4:36:03<2:31:29,  3.86it/s]
 91%|█████████ | 336418/371472 [4:36:03<2:32:02,  3.84it/s]
 91%|█████████ | 336419/371472 [4:36:03<2:37:21,  3.71it/s]
 91%|█████████ | 336420/371472 [4:36:03<2:33:41,  3.80it/s]
                                                           
{'loss': 2.5783, 'learning_rate': 1.849695102243099e-07, 'epoch': 14.49}

 91%|█████████ | 336420/371472 [4:36:03<2:33:41,  3.80it/s]
 91%|█████████ | 336421/371472 [4:36:04<2:43:59,  3.56it/s]
 91%|█████████ | 336422/371472 [4:36:04<2:50:59,  3.42it/s]
 91%|█████████ | 336423/371472 [4:36:04<2:44:29,  3.55it/s]
 91%|█████████ | 336424/371472 [4:36:05<2:59:27,  3.26it/s]
 91%|█████████ | 336425/371472 [4:36:05<2:53:17,  3.37it/s]
 91%|█████████ | 336426/371472 [4:36:05<2:56:08,  3.32it/s]
 91%|█████████ | 336427/371472 [4:36:06<3:02:39,  3.20it/s]
 91%|█████████ | 336428/371472 [4:36:06<3:09:23,  3.08it/s]
 91%|█████████ | 336429/371472 [4:36:06<3:00:49,  3.23it/s]
 91%|█████████ | 336430/371472 [4:36:06<2:53:40,  3.36it/s]
 91%|█████████ | 336431/371472 [4:36:07<2:53:46,  3.36it/s]
 91%|█████████ | 336432/371472 [4:36:07<2:46:11,  3.51it/s]
 91%|█████████ | 336433/371472 [4:36:07<2:47:14,  3.49it/s]
 91%|█████████ | 336434/371472 [4:36:08<2:38:57,  3.67it/s]
 91%|█████████ | 336435/371472 [4:36:08<2:37:33,  3.71it/s]
 91%|█████████ | 336436/371472 [4:36:08<2:38:57,  3.67it/s]
 91%|█████████ | 336437/371472 [4:36:08<2:38:10,  3.69it/s]
 91%|█████████ | 336438/371472 [4:36:09<2:52:45,  3.38it/s]
 91%|█████████ | 336439/371472 [4:36:09<3:04:14,  3.17it/s]
 91%|█████████ | 336440/371472 [4:36:09<2:52:08,  3.39it/s]
                                                           
{'loss': 2.4926, 'learning_rate': 1.8492102824883103e-07, 'epoch': 14.49}

 91%|█████████ | 336440/371472 [4:36:09<2:52:08,  3.39it/s]
 91%|█████████ | 336441/371472 [4:36:10<2:54:30,  3.35it/s]
 91%|█████████ | 336442/371472 [4:36:10<2:43:24,  3.57it/s]
 91%|█████████ | 336443/371472 [4:36:10<2:47:28,  3.49it/s]
 91%|█████████ | 336444/371472 [4:36:10<2:45:35,  3.53it/s]
 91%|█████████ | 336445/371472 [4:36:11<2:54:35,  3.34it/s]
 91%|█████████ | 336446/371472 [4:36:11<2:52:32,  3.38it/s]
 91%|█████████ | 336447/371472 [4:36:11<2:48:16,  3.47it/s]
 91%|█████████ | 336448/371472 [4:36:12<2:44:08,  3.56it/s]
 91%|█████████ | 336449/371472 [4:36:12<2:46:15,  3.51it/s]
 91%|█████████ | 336450/371472 [4:36:12<2:44:25,  3.55it/s]
 91%|█████████ | 336451/371472 [4:36:13<2:56:53,  3.30it/s]
 91%|█████████ | 336452/371472 [4:36:13<2:49:00,  3.45it/s]
 91%|█████████ | 336453/371472 [4:36:13<2:51:32,  3.40it/s]
 91%|█████████ | 336454/371472 [4:36:13<2:49:55,  3.43it/s]
 91%|█████████ | 336455/371472 [4:36:14<2:51:02,  3.41it/s]
 91%|█████████ | 336456/371472 [4:36:14<2:47:15,  3.49it/s]
 91%|█████████ | 336457/371472 [4:36:14<2:54:18,  3.35it/s]
 91%|█████████ | 336458/371472 [4:36:15<3:00:07,  3.24it/s]
 91%|█████████ | 336459/371472 [4:36:15<2:54:41,  3.34it/s]
 91%|█████████ | 336460/371472 [4:36:15<2:50:30,  3.42it/s]
                                                           
{'loss': 2.5619, 'learning_rate': 1.848725462733521e-07, 'epoch': 14.49}

 91%|█████████ | 336460/371472 [4:36:15<2:50:30,  3.42it/s]
 91%|█████████ | 336461/371472 [4:36:15<2:43:20,  3.57it/s]
 91%|█████████ | 336462/371472 [4:36:16<2:42:12,  3.60it/s]
 91%|█████████ | 336463/371472 [4:36:16<2:49:20,  3.45it/s]
 91%|█████████ | 336464/371472 [4:36:16<2:56:38,  3.30it/s]
 91%|█████████ | 336465/371472 [4:36:17<2:52:51,  3.38it/s]
 91%|█████████ | 336466/371472 [4:36:17<2:43:36,  3.57it/s]
 91%|█████████ | 336467/371472 [4:36:17<2:48:45,  3.46it/s]
 91%|█████████ | 336468/371472 [4:36:17<2:41:36,  3.61it/s]
 91%|█████████ | 336469/371472 [4:36:18<2:42:31,  3.59it/s]
 91%|█████████ | 336470/371472 [4:36:18<2:36:30,  3.73it/s]
 91%|█████████ | 336471/371472 [4:36:18<2:48:06,  3.47it/s]
 91%|█████████ | 336472/371472 [4:36:19<3:11:08,  3.05it/s]
 91%|█████████ | 336473/371472 [4:36:19<2:54:45,  3.34it/s]
 91%|█████████ | 336474/371472 [4:36:19<2:49:02,  3.45it/s]
 91%|█████████ | 336475/371472 [4:36:19<2:43:50,  3.56it/s]
 91%|█████████ | 336476/371472 [4:36:20<2:46:20,  3.51it/s]
 91%|█████████ | 336477/371472 [4:36:20<2:43:57,  3.56it/s]
 91%|█████████ | 336478/371472 [4:36:20<2:45:33,  3.52it/s]
 91%|█████████ | 336479/371472 [4:36:21<2:43:16,  3.57it/s]
 91%|█████████ | 336480/371472 [4:36:21<2:42:42,  3.58it/s]
                                                           
{'loss': 2.6067, 'learning_rate': 1.8482406429787328e-07, 'epoch': 14.49}

 91%|█████████ | 336480/371472 [4:36:21<2:42:42,  3.58it/s]
 91%|█████████ | 336481/371472 [4:36:21<2:41:30,  3.61it/s]
 91%|█████████ | 336482/371472 [4:36:21<2:43:19,  3.57it/s]
 91%|█████████ | 336483/371472 [4:36:22<2:42:44,  3.58it/s]
 91%|█████████ | 336484/371472 [4:36:22<2:42:40,  3.58it/s]
 91%|█████████ | 336485/371472 [4:36:22<2:37:23,  3.70it/s]
 91%|█████████ | 336486/371472 [4:36:23<2:43:41,  3.56it/s]
 91%|█████████ | 336487/371472 [4:36:23<2:43:14,  3.57it/s]
 91%|█████████ | 336488/371472 [4:36:23<2:47:30,  3.48it/s]
 91%|█████████ | 336489/371472 [4:36:23<2:43:41,  3.56it/s]
 91%|█████████ | 336490/371472 [4:36:24<3:16:25,  2.97it/s]
 91%|█████████ | 336491/371472 [4:36:24<3:05:34,  3.14it/s]
 91%|█████████ | 336492/371472 [4:36:24<2:53:54,  3.35it/s]
 91%|█████████ | 336493/371472 [4:36:25<2:53:42,  3.36it/s]
 91%|█████████ | 336494/371472 [4:36:25<3:01:21,  3.21it/s]
 91%|█████████ | 336495/371472 [4:36:25<2:52:20,  3.38it/s]
 91%|█████████ | 336496/371472 [4:36:26<2:45:00,  3.53it/s]
 91%|█████████ | 336497/371472 [4:36:26<2:39:36,  3.65it/s]
 91%|█████████ | 336498/371472 [4:36:26<2:42:23,  3.59it/s]
 91%|█████████ | 336499/371472 [4:36:26<2:48:26,  3.46it/s]
 91%|█████████ | 336500/371472 [4:36:27<2:50:03,  3.43it/s]
                                                           
{'loss': 2.6574, 'learning_rate': 1.8477558232239432e-07, 'epoch': 14.49}

 91%|█████████ | 336500/371472 [4:36:27<2:50:03,  3.43it/s]
 91%|█████████ | 336501/371472 [4:36:27<2:43:07,  3.57it/s]
 91%|█████████ | 336502/371472 [4:36:27<2:43:52,  3.56it/s]
 91%|█████████ | 336503/371472 [4:36:28<2:48:26,  3.46it/s]
 91%|█████████ | 336504/371472 [4:36:28<2:45:36,  3.52it/s]
 91%|█████████ | 336505/371472 [4:36:28<2:48:05,  3.47it/s]
 91%|█████████ | 336506/371472 [4:36:28<2:42:48,  3.58it/s]
 91%|█████████ | 336507/371472 [4:36:29<2:41:05,  3.62it/s]
 91%|█████████ | 336508/371472 [4:36:29<2:43:33,  3.56it/s]
 91%|█████████ | 336509/371472 [4:36:29<2:39:06,  3.66it/s]
 91%|█████████ | 336510/371472 [4:36:29<2:48:39,  3.45it/s]
 91%|█████████ | 336511/371472 [4:36:30<2:53:21,  3.36it/s]
 91%|█████████ | 336512/371472 [4:36:30<2:46:52,  3.49it/s]
 91%|█████████ | 336513/371472 [4:36:31<3:16:38,  2.96it/s]
 91%|█████████ | 336514/371472 [4:36:31<3:10:36,  3.06it/s]
 91%|█████████ | 336515/371472 [4:36:31<3:04:32,  3.16it/s]
 91%|█████████ | 336516/371472 [4:36:31<2:54:26,  3.34it/s]
 91%|█████████ | 336517/371472 [4:36:32<3:07:31,  3.11it/s]
 91%|█████████ | 336518/371472 [4:36:32<2:58:39,  3.26it/s]
 91%|█████████ | 336519/371472 [4:36:32<2:57:04,  3.29it/s]
 91%|█████████ | 336520/371472 [4:36:33<2:46:51,  3.49it/s]
                                                           
{'loss': 2.6785, 'learning_rate': 1.8472710034691548e-07, 'epoch': 14.49}

 91%|█████████ | 336520/371472 [4:36:33<2:46:51,  3.49it/s]
 91%|█████████ | 336521/371472 [4:36:33<2:37:33,  3.70it/s]
 91%|█████████ | 336522/371472 [4:36:33<2:39:29,  3.65it/s]
 91%|█████████ | 336523/371472 [4:36:33<2:50:40,  3.41it/s]
 91%|█████████ | 336524/371472 [4:36:34<2:45:48,  3.51it/s]
 91%|█████████ | 336525/371472 [4:36:34<2:49:26,  3.44it/s]
 91%|█████████ | 336526/371472 [4:36:34<2:37:34,  3.70it/s]
 91%|█████████ | 336527/371472 [4:36:35<2:46:31,  3.50it/s]
 91%|█████████ | 336528/371472 [4:36:35<2:50:59,  3.41it/s]
 91%|█████████ | 336529/371472 [4:36:35<2:48:45,  3.45it/s]
 91%|█████████ | 336530/371472 [4:36:35<2:51:50,  3.39it/s]
 91%|█████████ | 336531/371472 [4:36:36<2:46:44,  3.49it/s]
 91%|█████████ | 336532/371472 [4:36:36<2:42:22,  3.59it/s]
 91%|█████████ | 336533/371472 [4:36:36<2:40:17,  3.63it/s]
 91%|█████████ | 336534/371472 [4:36:36<2:41:03,  3.62it/s]
 91%|█████████ | 336535/371472 [4:36:37<2:38:40,  3.67it/s]
 91%|█████████ | 336536/371472 [4:36:37<2:38:18,  3.68it/s]
 91%|█████████ | 336537/371472 [4:36:37<2:39:30,  3.65it/s]
 91%|█████████ | 336538/371472 [4:36:38<2:36:14,  3.73it/s]
 91%|█████████ | 336539/371472 [4:36:38<2:40:00,  3.64it/s]
 91%|█████████ | 336540/371472 [4:36:38<2:52:53,  3.37it/s]
                                                           
{'loss': 2.5385, 'learning_rate': 1.8467861837143655e-07, 'epoch': 14.5}

 91%|█████████ | 336540/371472 [4:36:38<2:52:53,  3.37it/s]
 91%|█████████ | 336541/371472 [4:36:38<2:49:10,  3.44it/s]
 91%|█████████ | 336542/371472 [4:36:39<2:58:49,  3.26it/s]
 91%|█████████ | 336543/371472 [4:36:39<2:50:25,  3.42it/s]
 91%|█████████ | 336544/371472 [4:36:39<2:43:54,  3.55it/s]
 91%|█████████ | 336545/371472 [4:36:40<2:38:15,  3.68it/s]
 91%|█████████ | 336546/371472 [4:36:40<2:36:31,  3.72it/s]
 91%|█████████ | 336547/371472 [4:36:40<2:38:57,  3.66it/s]
 91%|█████████ | 336548/371472 [4:36:40<2:45:50,  3.51it/s]
 91%|█████████ | 336549/371472 [4:36:41<2:43:12,  3.57it/s]
 91%|█████████ | 336550/371472 [4:36:41<2:42:39,  3.58it/s]
 91%|█████████ | 336551/371472 [4:36:41<2:44:47,  3.53it/s]
 91%|█████████ | 336552/371472 [4:36:42<2:40:34,  3.62it/s]
 91%|█████████ | 336553/371472 [4:36:42<2:39:57,  3.64it/s]
 91%|█████████ | 336554/371472 [4:36:42<2:44:11,  3.54it/s]
 91%|█████████ | 336555/371472 [4:36:42<2:42:28,  3.58it/s]
 91%|█████████ | 336556/371472 [4:36:43<2:42:35,  3.58it/s]
 91%|█████████ | 336557/371472 [4:36:43<2:36:52,  3.71it/s]
 91%|█████████ | 336558/371472 [4:36:43<2:49:46,  3.43it/s]
 91%|█████████ | 336559/371472 [4:36:44<2:58:14,  3.26it/s]
 91%|█████████ | 336560/371472 [4:36:44<2:48:38,  3.45it/s]
                                                           
{'loss': 2.649, 'learning_rate': 1.846301363959577e-07, 'epoch': 14.5}

 91%|█████████ | 336560/371472 [4:36:44<2:48:38,  3.45it/s]
 91%|█████████ | 336561/371472 [4:36:44<2:52:15,  3.38it/s]
 91%|█████████ | 336562/371472 [4:36:44<2:42:04,  3.59it/s]
 91%|█████████ | 336563/371472 [4:36:45<2:42:43,  3.58it/s]
 91%|█████████ | 336564/371472 [4:36:45<2:39:43,  3.64it/s]
 91%|█████████ | 336565/371472 [4:36:45<2:34:45,  3.76it/s]
 91%|█████████ | 336566/371472 [4:36:45<2:33:02,  3.80it/s]
 91%|█████████ | 336567/371472 [4:36:46<2:38:44,  3.66it/s]
 91%|█████████ | 336568/371472 [4:36:46<2:49:19,  3.44it/s]
 91%|█████████ | 336569/371472 [4:36:46<2:44:24,  3.54it/s]
 91%|█████████ | 336570/371472 [4:36:47<2:56:27,  3.30it/s]
 91%|█████████ | 336571/371472 [4:36:47<2:59:17,  3.24it/s]
 91%|█████████ | 336572/371472 [4:36:47<2:48:21,  3.45it/s]
 91%|█████████ | 336573/371472 [4:36:48<2:42:24,  3.58it/s]
 91%|█████████ | 336574/371472 [4:36:48<2:47:09,  3.48it/s]
 91%|█████████ | 336575/371472 [4:36:48<2:58:11,  3.26it/s]
 91%|█████████ | 336576/371472 [4:36:48<2:47:40,  3.47it/s]
 91%|█████████ | 336577/371472 [4:36:49<2:42:50,  3.57it/s]
 91%|█████████ | 336578/371472 [4:36:49<2:47:40,  3.47it/s]
 91%|█████████ | 336579/371472 [4:36:49<2:48:04,  3.46it/s]
 91%|█████████ | 336580/371472 [4:36:50<2:38:35,  3.67it/s]
                                                           
{'loss': 2.703, 'learning_rate': 1.8458165442047874e-07, 'epoch': 14.5}

 91%|█████████ | 336580/371472 [4:36:50<2:38:35,  3.67it/s]
 91%|█████████ | 336581/371472 [4:36:50<2:42:53,  3.57it/s]
 91%|█████████ | 336582/371472 [4:36:50<2:38:07,  3.68it/s]
 91%|█████████ | 336583/371472 [4:36:50<2:40:19,  3.63it/s]
 91%|█████████ | 336584/371472 [4:36:51<2:35:16,  3.74it/s]
 91%|█████████ | 336585/371472 [4:36:51<2:30:46,  3.86it/s]
 91%|█████████ | 336586/371472 [4:36:51<2:33:00,  3.80it/s]
 91%|█████████ | 336587/371472 [4:36:51<2:40:00,  3.63it/s]
 91%|█████████ | 336588/371472 [4:36:52<2:34:22,  3.77it/s]
 91%|█████████ | 336589/371472 [4:36:52<2:36:07,  3.72it/s]
 91%|█████████ | 336590/371472 [4:36:52<2:53:48,  3.34it/s]
 91%|█████████ | 336591/371472 [4:36:53<3:06:47,  3.11it/s]
 91%|█████████ | 336592/371472 [4:36:53<3:27:24,  2.80it/s]
 91%|█████████ | 336593/371472 [4:36:53<3:17:12,  2.95it/s]
 91%|█████████ | 336594/371472 [4:36:54<3:04:32,  3.15it/s]
 91%|█████████ | 336595/371472 [4:36:54<2:59:10,  3.24it/s]
 91%|█████████ | 336596/371472 [4:36:54<2:55:34,  3.31it/s]
 91%|█████████ | 336597/371472 [4:36:55<2:51:49,  3.38it/s]
 91%|█████████ | 336598/371472 [4:36:55<3:00:27,  3.22it/s]
 91%|█████████ | 336599/371472 [4:36:55<2:56:14,  3.30it/s]
 91%|█████████ | 336600/371472 [4:36:56<3:20:40,  2.90it/s]
                                                           
{'loss': 2.6855, 'learning_rate': 1.8453317244499992e-07, 'epoch': 14.5}

 91%|█████████ | 336600/371472 [4:36:56<3:20:40,  2.90it/s]
 91%|█████████ | 336601/371472 [4:36:56<3:30:41,  2.76it/s]
 91%|█████████ | 336602/371472 [4:36:56<3:30:42,  2.76it/s]
 91%|█████████ | 336603/371472 [4:36:57<3:10:28,  3.05it/s]
 91%|█████████ | 336604/371472 [4:36:57<3:03:59,  3.16it/s]
 91%|█████████ | 336605/371472 [4:36:57<3:12:05,  3.03it/s]
 91%|█████████ | 336606/371472 [4:36:58<2:59:39,  3.23it/s]
 91%|█████████ | 336607/371472 [4:36:58<2:50:56,  3.40it/s]
 91%|█████████ | 336608/371472 [4:36:58<2:43:37,  3.55it/s]
 91%|█████████ | 336609/371472 [4:36:58<2:41:33,  3.60it/s]
 91%|█████████ | 336610/371472 [4:36:59<2:37:15,  3.69it/s]
 91%|█████████ | 336611/371472 [4:36:59<2:35:45,  3.73it/s]
 91%|█████████ | 336612/371472 [4:36:59<2:38:17,  3.67it/s]
 91%|█████████ | 336613/371472 [4:36:59<2:42:43,  3.57it/s]
 91%|█████████ | 336614/371472 [4:37:00<2:41:18,  3.60it/s]
 91%|█████████ | 336615/371472 [4:37:00<2:39:19,  3.65it/s]
 91%|█████████ | 336616/371472 [4:37:00<2:37:41,  3.68it/s]
 91%|█████████ | 336617/371472 [4:37:00<2:39:25,  3.64it/s]
 91%|█████████ | 336618/371472 [4:37:01<2:44:59,  3.52it/s]
 91%|█████████ | 336619/371472 [4:37:01<2:42:33,  3.57it/s]
 91%|█████████ | 336620/371472 [4:37:01<2:42:01,  3.58it/s]
                                                           
{'loss': 2.6806, 'learning_rate': 1.8448469046952096e-07, 'epoch': 14.5}

 91%|█████████ | 336620/371472 [4:37:01<2:42:01,  3.58it/s]
 91%|█████████ | 336621/371472 [4:37:02<2:54:54,  3.32it/s]
 91%|█████████ | 336622/371472 [4:37:02<2:47:23,  3.47it/s]
 91%|█████████ | 336623/371472 [4:37:02<2:59:27,  3.24it/s]
 91%|█████████ | 336624/371472 [4:37:03<2:48:17,  3.45it/s]
 91%|█████████ | 336625/371472 [4:37:03<2:45:31,  3.51it/s]
 91%|█████████ | 336626/371472 [4:37:03<2:39:25,  3.64it/s]
 91%|█████████ | 336627/371472 [4:37:03<2:43:49,  3.54it/s]
 91%|█████████ | 336628/371472 [4:37:04<2:41:02,  3.61it/s]
 91%|█████████ | 336629/371472 [4:37:04<2:49:01,  3.44it/s]
 91%|█████████ | 336630/371472 [4:37:04<2:43:06,  3.56it/s]
 91%|█████████ | 336631/371472 [4:37:04<2:40:59,  3.61it/s]
 91%|█████████ | 336632/371472 [4:37:05<2:39:28,  3.64it/s]
 91%|█████████ | 336633/371472 [4:37:05<2:39:43,  3.64it/s]
 91%|█████████ | 336634/371472 [4:37:05<2:45:55,  3.50it/s]
 91%|█████████ | 336635/371472 [4:37:06<2:58:03,  3.26it/s]
 91%|█████████ | 336636/371472 [4:37:06<3:04:48,  3.14it/s]
 91%|█████████ | 336637/371472 [4:37:06<3:00:21,  3.22it/s]
 91%|█████████ | 336638/371472 [4:37:07<2:54:26,  3.33it/s]
 91%|█████████ | 336639/371472 [4:37:07<2:44:58,  3.52it/s]
 91%|█████████ | 336640/371472 [4:37:07<2:50:39,  3.40it/s]
                                                           
{'loss': 2.6524, 'learning_rate': 1.8443620849404212e-07, 'epoch': 14.5}

 91%|█████████ | 336640/371472 [4:37:07<2:50:39,  3.40it/s]
 91%|█████████ | 336641/371472 [4:37:07<2:49:57,  3.42it/s]
 91%|█████████ | 336642/371472 [4:37:08<2:45:08,  3.52it/s]
 91%|█████████ | 336643/371472 [4:37:08<2:51:09,  3.39it/s]
 91%|█████████ | 336644/371472 [4:37:08<2:46:41,  3.48it/s]
 91%|█████████ | 336645/371472 [4:37:09<2:38:30,  3.66it/s]
 91%|█████████ | 336646/371472 [4:37:09<2:42:28,  3.57it/s]
 91%|█████████ | 336647/371472 [4:37:09<2:46:40,  3.48it/s]
 91%|█████████ | 336648/371472 [4:37:09<2:43:24,  3.55it/s]
 91%|█████████ | 336649/371472 [4:37:10<2:56:50,  3.28it/s]
 91%|█████████ | 336650/371472 [4:37:10<2:49:11,  3.43it/s]
 91%|█████████ | 336651/371472 [4:37:10<2:59:22,  3.24it/s]
 91%|█████████ | 336652/371472 [4:37:11<2:50:56,  3.40it/s]
 91%|█████████ | 336653/371472 [4:37:11<2:48:34,  3.44it/s]
 91%|█████████ | 336654/371472 [4:37:11<2:44:32,  3.53it/s]
 91%|█████████ | 336655/371472 [4:37:11<2:38:35,  3.66it/s]
 91%|█████████ | 336656/371472 [4:37:12<2:47:40,  3.46it/s]
 91%|█████████ | 336657/371472 [4:37:12<2:44:07,  3.54it/s]
 91%|█████████ | 336658/371472 [4:37:12<2:48:17,  3.45it/s]
 91%|█████████ | 336659/371472 [4:37:13<2:50:40,  3.40it/s]
 91%|█████████ | 336660/371472 [4:37:13<2:45:01,  3.52it/s]
                                                           
{'loss': 2.6472, 'learning_rate': 1.843877265185632e-07, 'epoch': 14.5}

 91%|█████████ | 336660/371472 [4:37:13<2:45:01,  3.52it/s]
 91%|█████████ | 336661/371472 [4:37:13<2:42:11,  3.58it/s]
 91%|█████████ | 336662/371472 [4:37:13<2:44:21,  3.53it/s]
 91%|█████████ | 336663/371472 [4:37:14<2:41:35,  3.59it/s]
 91%|█████████ | 336664/371472 [4:37:14<2:47:34,  3.46it/s]
 91%|█████████ | 336665/371472 [4:37:14<2:50:21,  3.41it/s]
 91%|█████████ | 336666/371472 [4:37:15<2:44:25,  3.53it/s]
 91%|█████████ | 336667/371472 [4:37:15<2:42:18,  3.57it/s]
 91%|█████████ | 336668/371472 [4:37:15<2:50:28,  3.40it/s]
 91%|█████████ | 336669/371472 [4:37:16<2:47:33,  3.46it/s]
 91%|█████████ | 336670/371472 [4:37:16<2:45:35,  3.50it/s]
 91%|█████████ | 336671/371472 [4:37:16<2:43:10,  3.55it/s]
 91%|█████████ | 336672/371472 [4:37:16<3:00:19,  3.22it/s]
 91%|█████████ | 336673/371472 [4:37:17<2:53:06,  3.35it/s]
 91%|█████████ | 336674/371472 [4:37:17<2:47:24,  3.46it/s]
 91%|█████████ | 336675/371472 [4:37:17<2:44:10,  3.53it/s]
 91%|█████████ | 336676/371472 [4:37:18<2:45:42,  3.50it/s]
 91%|█████████ | 336677/371472 [4:37:18<2:41:16,  3.60it/s]
 91%|█████████ | 336678/371472 [4:37:18<2:42:26,  3.57it/s]
 91%|█████████ | 336679/371472 [4:37:18<2:41:47,  3.58it/s]
 91%|█████████ | 336680/371472 [4:37:19<2:40:38,  3.61it/s]
                                                           
{'loss': 2.5838, 'learning_rate': 1.8433924454308434e-07, 'epoch': 14.5}

 91%|█████████ | 336680/371472 [4:37:19<2:40:38,  3.61it/s]
 91%|█████████ | 336681/371472 [4:37:19<2:37:40,  3.68it/s]
 91%|█████████ | 336682/371472 [4:37:19<2:37:49,  3.67it/s]
 91%|█████████ | 336683/371472 [4:37:19<2:35:36,  3.73it/s]
 91%|█████████ | 336684/371472 [4:37:20<2:34:36,  3.75it/s]
 91%|█████████ | 336685/371472 [4:37:20<2:41:52,  3.58it/s]
 91%|█████████ | 336686/371472 [4:37:20<2:35:40,  3.72it/s]
 91%|█████████ | 336687/371472 [4:37:20<2:32:48,  3.79it/s]
 91%|█████████ | 336688/371472 [4:37:21<2:37:38,  3.68it/s]
 91%|█████████ | 336689/371472 [4:37:21<2:51:01,  3.39it/s]
 91%|█████████ | 336690/371472 [4:37:21<2:48:13,  3.45it/s]
 91%|█████████ | 336691/371472 [4:37:22<2:44:14,  3.53it/s]
 91%|█████████ | 336692/371472 [4:37:22<2:45:45,  3.50it/s]
 91%|█████████ | 336693/371472 [4:37:22<2:50:06,  3.41it/s]
 91%|█████████ | 336694/371472 [4:37:23<2:48:03,  3.45it/s]
 91%|█████████ | 336695/371472 [4:37:23<2:46:43,  3.48it/s]
 91%|█████████ | 336696/371472 [4:37:23<2:42:56,  3.56it/s]
 91%|█████████ | 336697/371472 [4:37:23<2:42:10,  3.57it/s]
 91%|█████████ | 336698/371472 [4:37:24<2:44:16,  3.53it/s]
 91%|█████████ | 336699/371472 [4:37:24<2:42:30,  3.57it/s]
 91%|█████████ | 336700/371472 [4:37:24<2:40:48,  3.60it/s]
                                                           
{'loss': 2.657, 'learning_rate': 1.8429076256760538e-07, 'epoch': 14.5}

 91%|█████████ | 336700/371472 [4:37:24<2:40:48,  3.60it/s]
 91%|█████████ | 336701/371472 [4:37:24<2:37:33,  3.68it/s]
 91%|█████████ | 336702/371472 [4:37:25<2:42:31,  3.57it/s]
 91%|█████████ | 336703/371472 [4:37:25<2:44:15,  3.53it/s]
 91%|█████████ | 336704/371472 [4:37:25<2:43:10,  3.55it/s]
 91%|█████████ | 336705/371472 [4:37:26<2:40:05,  3.62it/s]
 91%|█████████ | 336706/371472 [4:37:26<2:34:59,  3.74it/s]
 91%|█████████ | 336707/371472 [4:37:26<2:35:02,  3.74it/s]
 91%|█████████ | 336708/371472 [4:37:26<2:40:26,  3.61it/s]
 91%|█████████ | 336709/371472 [4:37:27<2:59:48,  3.22it/s]
 91%|█████████ | 336710/371472 [4:37:27<2:58:04,  3.25it/s]
 91%|█████████ | 336711/371472 [4:37:27<2:57:25,  3.27it/s]
 91%|█████████ | 336712/371472 [4:37:28<2:55:22,  3.30it/s]
 91%|█████████ | 336713/371472 [4:37:28<2:50:39,  3.39it/s]
 91%|█████████ | 336714/371472 [4:37:28<2:43:08,  3.55it/s]
 91%|█████████ | 336715/371472 [4:37:29<2:50:13,  3.40it/s]
 91%|█████████ | 336716/371472 [4:37:29<2:44:14,  3.53it/s]
 91%|█████████ | 336717/371472 [4:37:29<2:49:04,  3.43it/s]
 91%|█████████ | 336718/371472 [4:37:29<2:43:43,  3.54it/s]
 91%|█████████ | 336719/371472 [4:37:30<2:48:58,  3.43it/s]
 91%|█████████ | 336720/371472 [4:37:30<2:50:44,  3.39it/s]
                                                           
{'loss': 2.6172, 'learning_rate': 1.8424228059212656e-07, 'epoch': 14.5}

 91%|█████████ | 336720/371472 [4:37:30<2:50:44,  3.39it/s]
 91%|█████████ | 336721/371472 [4:37:30<2:50:59,  3.39it/s]
 91%|█████████ | 336722/371472 [4:37:31<2:45:21,  3.50it/s]
 91%|█████████ | 336723/371472 [4:37:31<2:54:19,  3.32it/s]
 91%|█████████ | 336724/371472 [4:37:31<2:54:03,  3.33it/s]
 91%|█████████ | 336725/371472 [4:37:31<2:43:36,  3.54it/s]
 91%|█████████ | 336726/371472 [4:37:32<2:37:43,  3.67it/s]
 91%|█████████ | 336727/371472 [4:37:32<2:38:26,  3.66it/s]
 91%|█████████ | 336728/371472 [4:37:32<2:36:44,  3.69it/s]
 91%|█████████ | 336729/371472 [4:37:33<2:51:48,  3.37it/s]
 91%|█████████ | 336730/371472 [4:37:33<2:46:39,  3.47it/s]
 91%|█████████ | 336731/371472 [4:37:33<2:42:03,  3.57it/s]
 91%|█████████ | 336732/371472 [4:37:33<2:46:36,  3.48it/s]
 91%|█████████ | 336733/371472 [4:37:34<2:38:21,  3.66it/s]
 91%|█████████ | 336734/371472 [4:37:34<2:39:08,  3.64it/s]
 91%|█████████ | 336735/371472 [4:37:34<2:44:46,  3.51it/s]
 91%|█████████ | 336736/371472 [4:37:35<2:49:08,  3.42it/s]
 91%|█████████ | 336737/371472 [4:37:35<2:53:28,  3.34it/s]
 91%|█████████ | 336738/371472 [4:37:35<2:57:49,  3.26it/s]
 91%|█████████ | 336739/371472 [4:37:35<2:52:02,  3.36it/s]
 91%|█████████ | 336740/371472 [4:37:36<2:48:51,  3.43it/s]
                                                           
{'loss': 2.4239, 'learning_rate': 1.841937986166476e-07, 'epoch': 14.5}

 91%|█████████ | 336740/371472 [4:37:36<2:48:51,  3.43it/s]
 91%|█████████ | 336741/371472 [4:37:36<2:47:54,  3.45it/s]
 91%|█████████ | 336742/371472 [4:37:36<2:42:46,  3.56it/s]
 91%|█████████ | 336743/371472 [4:37:37<2:41:38,  3.58it/s]
 91%|█████████ | 336744/371472 [4:37:37<2:37:58,  3.66it/s]
 91%|█████████ | 336745/371472 [4:37:37<2:36:48,  3.69it/s]
 91%|█████████ | 336746/371472 [4:37:37<2:52:31,  3.35it/s]
 91%|█████████ | 336747/371472 [4:37:38<2:54:40,  3.31it/s]
 91%|█████████ | 336748/371472 [4:37:38<2:47:42,  3.45it/s]
 91%|█████████ | 336749/371472 [4:37:38<2:46:06,  3.48it/s]
 91%|█████████ | 336750/371472 [4:37:39<2:38:10,  3.66it/s]
 91%|█████████ | 336751/371472 [4:37:39<2:36:20,  3.70it/s]
 91%|█████████ | 336752/371472 [4:37:39<2:33:14,  3.78it/s]
 91%|█████████ | 336753/371472 [4:37:39<2:39:31,  3.63it/s]
 91%|█████████ | 336754/371472 [4:37:40<2:41:02,  3.59it/s]
 91%|█████████ | 336755/371472 [4:37:40<2:40:47,  3.60it/s]
 91%|█████████ | 336756/371472 [4:37:40<2:43:29,  3.54it/s]
 91%|█████████ | 336757/371472 [4:37:41<2:46:55,  3.47it/s]
 91%|█████████ | 336758/371472 [4:37:41<2:43:02,  3.55it/s]
 91%|█████████ | 336759/371472 [4:37:41<2:40:58,  3.59it/s]
 91%|█████████ | 336760/371472 [4:37:41<2:39:06,  3.64it/s]
                                                           
{'loss': 2.7046, 'learning_rate': 1.8414531664116876e-07, 'epoch': 14.5}

 91%|█████████ | 336760/371472 [4:37:41<2:39:06,  3.64it/s]
 91%|█████████ | 336761/371472 [4:37:42<2:39:36,  3.62it/s]
 91%|█████████ | 336762/371472 [4:37:42<2:59:44,  3.22it/s]
 91%|█████████ | 336763/371472 [4:37:42<2:50:51,  3.39it/s]
 91%|█████████ | 336764/371472 [4:37:43<2:45:43,  3.49it/s]
 91%|█████████ | 336765/371472 [4:37:43<2:43:40,  3.53it/s]
 91%|█████████ | 336766/371472 [4:37:43<2:41:40,  3.58it/s]
 91%|█████████ | 336767/371472 [4:37:43<2:43:42,  3.53it/s]
 91%|█████████ | 336768/371472 [4:37:44<2:40:34,  3.60it/s]
 91%|█████████ | 336769/371472 [4:37:44<2:46:22,  3.48it/s]
 91%|█████████ | 336770/371472 [4:37:44<2:55:31,  3.29it/s]
 91%|█████████ | 336771/371472 [4:37:45<2:50:55,  3.38it/s]
 91%|█████████ | 336772/371472 [4:37:45<2:45:56,  3.49it/s]
 91%|█████████ | 336773/371472 [4:37:45<2:39:59,  3.61it/s]
 91%|█████████ | 336774/371472 [4:37:45<2:39:27,  3.63it/s]
 91%|█████████ | 336775/371472 [4:37:46<2:33:13,  3.77it/s]
 91%|█████████ | 336776/371472 [4:37:46<2:37:46,  3.67it/s]
 91%|█████████ | 336777/371472 [4:37:46<2:41:30,  3.58it/s]
 91%|█████████ | 336778/371472 [4:37:47<2:57:33,  3.26it/s]
 91%|█████████ | 336779/371472 [4:37:47<2:59:42,  3.22it/s]
 91%|█████████ | 336780/371472 [4:37:47<3:06:02,  3.11it/s]
                                                           
{'loss': 2.713, 'learning_rate': 1.8409683466568983e-07, 'epoch': 14.51}

 91%|█████████ | 336780/371472 [4:37:47<3:06:02,  3.11it/s]
 91%|█████████ | 336781/371472 [4:37:47<2:56:17,  3.28it/s]
 91%|█████████ | 336782/371472 [4:37:48<2:47:57,  3.44it/s]
 91%|█████████ | 336783/371472 [4:37:48<2:42:41,  3.55it/s]
 91%|█████████ | 336784/371472 [4:37:48<2:45:28,  3.49it/s]
 91%|█████████ | 336785/371472 [4:37:49<2:41:53,  3.57it/s]
 91%|█████████ | 336786/371472 [4:37:49<2:52:30,  3.35it/s]
 91%|█████████ | 336787/371472 [4:37:49<2:44:05,  3.52it/s]
 91%|█████████ | 336788/371472 [4:37:49<2:47:26,  3.45it/s]
 91%|█████████ | 336789/371472 [4:37:50<2:54:46,  3.31it/s]
 91%|█████████ | 336790/371472 [4:37:50<2:52:49,  3.34it/s]
 91%|█████████ | 336791/371472 [4:37:50<2:45:13,  3.50it/s]
 91%|█████████ | 336792/371472 [4:37:51<2:44:03,  3.52it/s]
 91%|█████████ | 336793/371472 [4:37:51<2:42:29,  3.56it/s]
 91%|█████████ | 336794/371472 [4:37:51<2:41:17,  3.58it/s]
 91%|█████████ | 336795/371472 [4:37:51<2:37:58,  3.66it/s]
 91%|█████████ | 336796/371472 [4:37:52<2:33:56,  3.75it/s]
 91%|█████████ | 336797/371472 [4:37:52<2:31:23,  3.82it/s]
 91%|█████████ | 336798/371472 [4:37:52<2:29:34,  3.86it/s]
 91%|█████████ | 336799/371472 [4:37:52<2:38:58,  3.64it/s]
 91%|█████████ | 336800/371472 [4:37:53<2:40:41,  3.60it/s]
                                                           
{'loss': 2.638, 'learning_rate': 1.8404835269021098e-07, 'epoch': 14.51}

 91%|█████████ | 336800/371472 [4:37:53<2:40:41,  3.60it/s]
 91%|█████████ | 336801/371472 [4:37:53<2:46:31,  3.47it/s]
 91%|█████████ | 336802/371472 [4:37:53<2:49:44,  3.40it/s]
 91%|█████████ | 336803/371472 [4:37:54<2:57:44,  3.25it/s]
 91%|█████████ | 336804/371472 [4:37:54<2:51:42,  3.36it/s]
 91%|█████████ | 336805/371472 [4:37:54<2:45:20,  3.49it/s]
 91%|█████████ | 336806/371472 [4:37:55<2:58:30,  3.24it/s]
 91%|█████████ | 336807/371472 [4:37:55<2:57:48,  3.25it/s]
 91%|█████████ | 336808/371472 [4:37:55<2:54:00,  3.32it/s]
 91%|█████████ | 336809/371472 [4:37:56<2:56:06,  3.28it/s]
 91%|█████████ | 336810/371472 [4:37:56<2:55:13,  3.30it/s]
 91%|█████████ | 336811/371472 [4:37:56<2:48:02,  3.44it/s]
 91%|█████████ | 336812/371472 [4:37:57<3:25:40,  2.81it/s]
 91%|█████████ | 336813/371472 [4:37:57<3:20:06,  2.89it/s]
 91%|█████████ | 336814/371472 [4:37:57<3:07:27,  3.08it/s]
 91%|█████████ | 336815/371472 [4:37:57<3:00:37,  3.20it/s]
 91%|█████████ | 336816/371472 [4:37:58<2:52:25,  3.35it/s]
 91%|█████████ | 336817/371472 [4:37:58<2:42:49,  3.55it/s]
 91%|█████████ | 336818/371472 [4:37:58<2:57:33,  3.25it/s]
 91%|█████████ | 336819/371472 [4:37:59<2:52:54,  3.34it/s]
 91%|█████████ | 336820/371472 [4:37:59<2:49:40,  3.40it/s]
                                                           
{'loss': 2.4432, 'learning_rate': 1.8399987071473202e-07, 'epoch': 14.51}

 91%|█████████ | 336820/371472 [4:37:59<2:49:40,  3.40it/s]
 91%|█████████ | 336821/371472 [4:37:59<2:52:45,  3.34it/s]
 91%|█████████ | 336822/371472 [4:38:00<2:47:18,  3.45it/s]
 91%|█████████ | 336823/371472 [4:38:00<2:52:37,  3.35it/s]
 91%|█████████ | 336824/371472 [4:38:00<2:54:08,  3.32it/s]
 91%|█████████ | 336825/371472 [4:38:00<2:46:08,  3.48it/s]
 91%|█████████ | 336826/371472 [4:38:01<2:40:52,  3.59it/s]
 91%|█████████ | 336827/371472 [4:38:01<2:39:25,  3.62it/s]
 91%|█████████ | 336828/371472 [4:38:01<2:50:33,  3.39it/s]
 91%|█████████ | 336829/371472 [4:38:02<2:48:30,  3.43it/s]
 91%|█████████ | 336830/371472 [4:38:02<2:47:51,  3.44it/s]
 91%|█████████ | 336831/371472 [4:38:02<2:45:08,  3.50it/s]
 91%|█████████ | 336832/371472 [4:38:02<2:46:29,  3.47it/s]
 91%|█████████ | 336833/371472 [4:38:03<2:42:40,  3.55it/s]
 91%|█████████ | 336834/371472 [4:38:03<2:34:47,  3.73it/s]
 91%|█████████ | 336835/371472 [4:38:03<2:29:52,  3.85it/s]
 91%|█████████ | 336836/371472 [4:38:03<2:32:32,  3.78it/s]
 91%|█████████ | 336837/371472 [4:38:04<2:29:53,  3.85it/s]
 91%|█████████ | 336838/371472 [4:38:04<2:27:54,  3.90it/s]
 91%|█████████ | 336839/371472 [4:38:04<2:31:45,  3.80it/s]
 91%|█████████ | 336840/371472 [4:38:04<2:29:43,  3.86it/s]
                                                           
{'loss': 2.6298, 'learning_rate': 1.839513887392532e-07, 'epoch': 14.51}

 91%|█████████ | 336840/371472 [4:38:04<2:29:43,  3.86it/s]
 91%|█████████ | 336841/371472 [4:38:05<2:35:13,  3.72it/s]
 91%|█████████ | 336842/371472 [4:38:05<2:32:48,  3.78it/s]
 91%|█████████ | 336843/371472 [4:38:05<2:35:52,  3.70it/s]
 91%|█████████ | 336844/371472 [4:38:06<2:32:41,  3.78it/s]
 91%|█████████ | 336845/371472 [4:38:06<2:39:15,  3.62it/s]
 91%|█████████ | 336846/371472 [4:38:06<2:39:27,  3.62it/s]
 91%|█████████ | 336847/371472 [4:38:06<2:38:01,  3.65it/s]
 91%|█████████ | 336848/371472 [4:38:07<2:35:37,  3.71it/s]
 91%|█████████ | 336849/371472 [4:38:07<2:36:45,  3.68it/s]
 91%|█████████ | 336850/371472 [4:38:07<2:36:07,  3.70it/s]
 91%|█████████ | 336851/371472 [4:38:07<2:37:36,  3.66it/s]
 91%|█████████ | 336852/371472 [4:38:08<2:39:23,  3.62it/s]
 91%|█████████ | 336853/371472 [4:38:08<2:47:00,  3.45it/s]
 91%|█████████ | 336854/371472 [4:38:08<2:46:17,  3.47it/s]
 91%|█████████ | 336855/371472 [4:38:09<2:46:34,  3.46it/s]
 91%|█████████ | 336856/371472 [4:38:09<2:39:44,  3.61it/s]
 91%|█████████ | 336857/371472 [4:38:09<2:46:46,  3.46it/s]
 91%|█████████ | 336858/371472 [4:38:09<2:46:26,  3.47it/s]
 91%|█████████ | 336859/371472 [4:38:10<2:41:00,  3.58it/s]
 91%|█████████ | 336860/371472 [4:38:10<2:47:28,  3.44it/s]
                                                           
{'loss': 2.5205, 'learning_rate': 1.8390290676377427e-07, 'epoch': 14.51}

 91%|█████████ | 336860/371472 [4:38:10<2:47:28,  3.44it/s]
 91%|█████████ | 336861/371472 [4:38:10<3:01:41,  3.17it/s]
 91%|█████████ | 336862/371472 [4:38:11<2:53:27,  3.33it/s]
 91%|█████████ | 336863/371472 [4:38:11<2:46:51,  3.46it/s]
 91%|█████████ | 336864/371472 [4:38:11<2:43:16,  3.53it/s]
 91%|█████████ | 336865/371472 [4:38:12<2:45:23,  3.49it/s]
 91%|█████████ | 336866/371472 [4:38:12<2:38:48,  3.63it/s]
 91%|█████████ | 336867/371472 [4:38:12<2:44:30,  3.51it/s]
 91%|█████████ | 336868/371472 [4:38:12<2:59:19,  3.22it/s]
 91%|█████████ | 336869/371472 [4:38:13<2:49:39,  3.40it/s]
 91%|█████████ | 336870/371472 [4:38:13<2:46:29,  3.46it/s]
 91%|█████████ | 336871/371472 [4:38:13<2:43:13,  3.53it/s]
 91%|█████████ | 336872/371472 [4:38:14<2:41:58,  3.56it/s]
 91%|█████████ | 336873/371472 [4:38:14<2:58:18,  3.23it/s]
 91%|█████████ | 336874/371472 [4:38:14<2:48:17,  3.43it/s]
 91%|█████████ | 336875/371472 [4:38:14<2:52:42,  3.34it/s]
 91%|█████████ | 336876/371472 [4:38:15<2:47:38,  3.44it/s]
 91%|█████████ | 336877/371472 [4:38:15<2:45:04,  3.49it/s]
 91%|█████████ | 336878/371472 [4:38:15<2:42:34,  3.55it/s]
 91%|█████████ | 336879/371472 [4:38:16<2:41:10,  3.58it/s]
 91%|█████████ | 336880/371472 [4:38:16<2:38:45,  3.63it/s]
                                                           
{'loss': 2.627, 'learning_rate': 1.838544247882954e-07, 'epoch': 14.51}

 91%|█████████ | 336880/371472 [4:38:16<2:38:45,  3.63it/s]
 91%|█████████ | 336881/371472 [4:38:16<2:59:13,  3.22it/s]
 91%|█████████ | 336882/371472 [4:38:16<2:53:16,  3.33it/s]
 91%|█████████ | 336883/371472 [4:38:17<3:08:15,  3.06it/s]
 91%|█████████ | 336884/371472 [4:38:17<2:54:46,  3.30it/s]
 91%|█████████ | 336885/371472 [4:38:17<2:48:44,  3.42it/s]
 91%|█████████ | 336886/371472 [4:38:18<2:47:49,  3.43it/s]
 91%|█████████ | 336887/371472 [4:38:18<2:41:12,  3.58it/s]
 91%|█████████ | 336888/371472 [4:38:18<2:39:40,  3.61it/s]
 91%|█████████ | 336889/371472 [4:38:19<2:45:18,  3.49it/s]
 91%|█████████ | 336890/371472 [4:38:19<2:38:48,  3.63it/s]
 91%|█████████ | 336891/371472 [4:38:19<2:44:21,  3.51it/s]
 91%|█████████ | 336892/371472 [4:38:19<2:37:49,  3.65it/s]
 91%|█████████ | 336893/371472 [4:38:20<2:33:01,  3.77it/s]
 91%|█████████ | 336894/371472 [4:38:20<2:31:12,  3.81it/s]
 91%|█████████ | 336895/371472 [4:38:20<2:37:32,  3.66it/s]
 91%|█████████ | 336896/371472 [4:38:20<2:39:33,  3.61it/s]
 91%|█████████ | 336897/371472 [4:38:21<2:35:13,  3.71it/s]
 91%|█████████ | 336898/371472 [4:38:21<2:32:42,  3.77it/s]
 91%|█████████ | 336899/371472 [4:38:21<2:34:17,  3.73it/s]
 91%|█████████ | 336900/371472 [4:38:22<2:47:12,  3.45it/s]
                                                           
{'loss': 2.7548, 'learning_rate': 1.8380594281281647e-07, 'epoch': 14.51}

 91%|█████████ | 336900/371472 [4:38:22<2:47:12,  3.45it/s]
 91%|█████████ | 336901/371472 [4:38:22<2:50:51,  3.37it/s]
 91%|█████████ | 336902/371472 [4:38:22<2:50:41,  3.38it/s]
 91%|█████████ | 336903/371472 [4:38:22<2:43:23,  3.53it/s]
 91%|█████████ | 336904/371472 [4:38:23<2:38:44,  3.63it/s]
 91%|█████████ | 336905/371472 [4:38:23<2:43:03,  3.53it/s]
 91%|█████████ | 336906/371472 [4:38:23<2:45:43,  3.48it/s]
 91%|█████████ | 336907/371472 [4:38:24<2:39:05,  3.62it/s]
 91%|█████████ | 336908/371472 [4:38:24<2:38:31,  3.63it/s]
 91%|█████████ | 336909/371472 [4:38:24<2:40:21,  3.59it/s]
 91%|█████████ | 336910/371472 [4:38:24<2:40:04,  3.60it/s]
 91%|█████████ | 336911/371472 [4:38:25<2:35:34,  3.70it/s]
 91%|█████████ | 336912/371472 [4:38:25<2:38:27,  3.63it/s]
 91%|█████████ | 336913/371472 [4:38:25<2:39:41,  3.61it/s]
 91%|█████████ | 336914/371472 [4:38:25<2:37:17,  3.66it/s]
 91%|█████████ | 336915/371472 [4:38:26<2:38:03,  3.64it/s]
 91%|█████████ | 336916/371472 [4:38:26<2:51:45,  3.35it/s]
 91%|█████████ | 336917/371472 [4:38:26<2:53:35,  3.32it/s]
 91%|█████████ | 336918/371472 [4:38:27<2:54:38,  3.30it/s]
 91%|█████████ | 336919/371472 [4:38:27<2:52:15,  3.34it/s]
 91%|█████████ | 336920/371472 [4:38:27<2:55:05,  3.29it/s]
                                                           
{'loss': 2.6773, 'learning_rate': 1.8375746083733754e-07, 'epoch': 14.51}

 91%|█████████ | 336920/371472 [4:38:27<2:55:05,  3.29it/s]
 91%|█████████ | 336921/371472 [4:38:28<2:50:25,  3.38it/s]
 91%|█████████ | 336922/371472 [4:38:28<2:51:56,  3.35it/s]
 91%|█████████ | 336923/371472 [4:38:28<2:50:18,  3.38it/s]
 91%|█████████ | 336924/371472 [4:38:28<2:47:32,  3.44it/s]
 91%|█████████ | 336925/371472 [4:38:29<2:39:34,  3.61it/s]
 91%|█████████ | 336926/371472 [4:38:29<2:34:30,  3.73it/s]
 91%|█████████ | 336927/371472 [4:38:29<2:39:02,  3.62it/s]
 91%|█████████ | 336928/371472 [4:38:29<2:36:14,  3.69it/s]
 91%|█████████ | 336929/371472 [4:38:30<2:36:58,  3.67it/s]
 91%|█████████ | 336930/371472 [4:38:30<2:36:09,  3.69it/s]
 91%|█████████ | 336931/371472 [4:38:30<2:58:49,  3.22it/s]
 91%|█████████ | 336932/371472 [4:38:31<2:56:14,  3.27it/s]
 91%|█████████ | 336933/371472 [4:38:31<2:53:27,  3.32it/s]
 91%|█████████ | 336934/371472 [4:38:31<2:55:31,  3.28it/s]
 91%|█████████ | 336935/371472 [4:38:32<2:47:17,  3.44it/s]
 91%|█████████ | 336936/371472 [4:38:32<2:51:16,  3.36it/s]
 91%|█████████ | 336937/371472 [4:38:32<2:44:39,  3.50it/s]
 91%|█████████ | 336938/371472 [4:38:32<2:46:26,  3.46it/s]
 91%|█████████ | 336939/371472 [4:38:33<2:40:56,  3.58it/s]
 91%|█████████ | 336940/371472 [4:38:33<2:42:23,  3.54it/s]
                                                           
{'loss': 2.5411, 'learning_rate': 1.837089788618587e-07, 'epoch': 14.51}

 91%|█████████ | 336940/371472 [4:38:33<2:42:23,  3.54it/s]
 91%|█████████ | 336941/371472 [4:38:33<2:48:43,  3.41it/s]
 91%|█████████ | 336942/371472 [4:38:34<2:46:19,  3.46it/s]
 91%|█████████ | 336943/371472 [4:38:34<2:45:52,  3.47it/s]
 91%|█████████ | 336944/371472 [4:38:34<2:45:24,  3.48it/s]
 91%|█████████ | 336945/371472 [4:38:34<2:41:12,  3.57it/s]
 91%|█████████ | 336946/371472 [4:38:35<2:37:55,  3.64it/s]
 91%|█████████ | 336947/371472 [4:38:35<2:39:41,  3.60it/s]
 91%|█████████ | 336948/371472 [4:38:35<2:39:47,  3.60it/s]
 91%|█████████ | 336949/371472 [4:38:36<2:57:51,  3.23it/s]
 91%|█████████ | 336950/371472 [4:38:36<3:01:38,  3.17it/s]
 91%|█████████ | 336951/371472 [4:38:36<2:59:27,  3.21it/s]
 91%|█████████ | 336952/371472 [4:38:37<2:53:09,  3.32it/s]
 91%|█████████ | 336953/371472 [4:38:37<2:47:09,  3.44it/s]
 91%|█████████ | 336954/371472 [4:38:37<2:45:04,  3.48it/s]
 91%|█████████ | 336955/371472 [4:38:37<2:57:26,  3.24it/s]
 91%|█████████ | 336956/371472 [4:38:38<3:06:00,  3.09it/s]
 91%|█████████ | 336957/371472 [4:38:38<3:09:32,  3.03it/s]
 91%|█████████ | 336958/371472 [4:38:38<2:59:55,  3.20it/s]
 91%|█████████ | 336959/371472 [4:38:39<2:54:03,  3.30it/s]
 91%|█████████ | 336960/371472 [4:38:39<2:53:54,  3.31it/s]
                                                           
{'loss': 2.5742, 'learning_rate': 1.8366049688637974e-07, 'epoch': 14.51}

 91%|█████████ | 336960/371472 [4:38:39<2:53:54,  3.31it/s]
 91%|█████████ | 336961/371472 [4:38:39<2:53:27,  3.32it/s]
 91%|█████████ | 336962/371472 [4:38:40<2:45:57,  3.47it/s]
 91%|█████████ | 336963/371472 [4:38:40<2:43:05,  3.53it/s]
 91%|█████████ | 336964/371472 [4:38:40<2:47:05,  3.44it/s]
 91%|█████████ | 336965/371472 [4:38:40<2:44:43,  3.49it/s]
 91%|█████████ | 336966/371472 [4:38:41<3:03:23,  3.14it/s]
 91%|█████████ | 336967/371472 [4:38:41<2:51:30,  3.35it/s]
 91%|█████████ | 336968/371472 [4:38:41<2:43:50,  3.51it/s]
 91%|█████████ | 336969/371472 [4:38:42<2:39:46,  3.60it/s]
 91%|█████████ | 336970/371472 [4:38:42<2:39:24,  3.61it/s]
 91%|█████████ | 336971/371472 [4:38:42<2:58:10,  3.23it/s]
 91%|█████████ | 336972/371472 [4:38:42<2:46:40,  3.45it/s]
 91%|█████████ | 336973/371472 [4:38:43<2:43:40,  3.51it/s]
 91%|█████████ | 336974/371472 [4:38:43<2:41:16,  3.57it/s]
 91%|█████████ | 336975/371472 [4:38:43<3:03:12,  3.14it/s]
 91%|█████████ | 336976/371472 [4:38:44<2:56:25,  3.26it/s]
 91%|█████████ | 336977/371472 [4:38:44<2:48:14,  3.42it/s]
 91%|█████████ | 336978/371472 [4:38:44<2:40:14,  3.59it/s]
 91%|█████████ | 336979/371472 [4:38:44<2:37:25,  3.65it/s]
 91%|█████████ | 336980/371472 [4:38:45<2:37:10,  3.66it/s]
                                                           
{'loss': 2.7246, 'learning_rate': 1.8361201491090091e-07, 'epoch': 14.51}

 91%|█████████ | 336980/371472 [4:38:45<2:37:10,  3.66it/s]
 91%|█████████ | 336981/371472 [4:38:45<2:40:05,  3.59it/s]
 91%|█████████ | 336982/371472 [4:38:45<2:43:26,  3.52it/s]
 91%|█████████ | 336983/371472 [4:38:46<2:41:33,  3.56it/s]
 91%|█████████ | 336984/371472 [4:38:46<2:38:31,  3.63it/s]
 91%|█████████ | 336985/371472 [4:38:46<2:55:40,  3.27it/s]
 91%|█████████ | 336986/371472 [4:38:47<2:50:18,  3.37it/s]
 91%|█████████ | 336987/371472 [4:38:47<2:45:47,  3.47it/s]
 91%|█████████ | 336988/371472 [4:38:47<2:46:39,  3.45it/s]
 91%|█████████ | 336989/371472 [4:38:47<2:42:09,  3.54it/s]
 91%|█████████ | 336990/371472 [4:38:48<2:46:11,  3.46it/s]
 91%|█████████ | 336991/371472 [4:38:48<2:46:47,  3.45it/s]
 91%|█████████ | 336992/371472 [4:38:48<2:44:09,  3.50it/s]
 91%|█████████ | 336993/371472 [4:38:48<2:39:02,  3.61it/s]
 91%|█████████ | 336994/371472 [4:38:49<2:42:27,  3.54it/s]
 91%|█████████ | 336995/371472 [4:38:49<2:38:54,  3.62it/s]
 91%|█████████ | 336996/371472 [4:38:49<2:43:04,  3.52it/s]
 91%|█████████ | 336997/371472 [4:38:50<2:36:31,  3.67it/s]
 91%|█████████ | 336998/371472 [4:38:50<2:38:59,  3.61it/s]
 91%|█████████ | 336999/371472 [4:38:50<2:36:11,  3.68it/s]
 91%|█████████ | 337000/371472 [4:38:50<2:42:50,  3.53it/s]
                                                           
{'loss': 2.6607, 'learning_rate': 1.8356353293542196e-07, 'epoch': 14.52}

 91%|█████████ | 337000/371472 [4:38:50<2:42:50,  3.53it/s]
 91%|█████████ | 337001/371472 [4:38:51<2:39:32,  3.60it/s]
 91%|█████████ | 337002/371472 [4:38:51<2:35:58,  3.68it/s]
 91%|█████████ | 337003/371472 [4:38:51<2:37:33,  3.65it/s]
 91%|█████████ | 337004/371472 [4:38:52<2:42:14,  3.54it/s]
 91%|█████████ | 337005/371472 [4:38:52<2:48:37,  3.41it/s]
 91%|█████████ | 337006/371472 [4:38:52<2:46:33,  3.45it/s]
 91%|█████████ | 337007/371472 [4:38:52<2:54:26,  3.29it/s]
 91%|█████████ | 337008/371472 [4:38:53<2:52:16,  3.33it/s]
 91%|█████████ | 337009/371472 [4:38:53<2:44:59,  3.48it/s]
 91%|█████████ | 337010/371472 [4:38:53<2:38:06,  3.63it/s]
 91%|█████████ | 337011/371472 [4:38:54<2:43:14,  3.52it/s]
 91%|█████████ | 337012/371472 [4:38:54<2:53:41,  3.31it/s]
 91%|█████████ | 337013/371472 [4:38:54<2:49:52,  3.38it/s]
 91%|█████████ | 337014/371472 [4:38:54<2:45:34,  3.47it/s]
 91%|█████████ | 337015/371472 [4:38:55<2:44:35,  3.49it/s]
 91%|█████████ | 337016/371472 [4:38:55<2:45:22,  3.47it/s]
 91%|█████████ | 337017/371472 [4:38:55<2:44:04,  3.50it/s]
 91%|█████████ | 337018/371472 [4:38:56<2:40:44,  3.57it/s]
 91%|█████████ | 337019/371472 [4:38:56<2:45:54,  3.46it/s]
 91%|█████████ | 337020/371472 [4:38:56<2:49:20,  3.39it/s]
                                                           
{'loss': 2.5649, 'learning_rate': 1.835150509599431e-07, 'epoch': 14.52}

 91%|█████████ | 337020/371472 [4:38:56<2:49:20,  3.39it/s]
 91%|█████████ | 337021/371472 [4:38:56<2:45:20,  3.47it/s]
 91%|█████████ | 337022/371472 [4:38:57<2:46:34,  3.45it/s]
 91%|█████████ | 337023/371472 [4:38:57<2:49:24,  3.39it/s]
 91%|█████████ | 337024/371472 [4:38:57<2:43:48,  3.50it/s]
 91%|█████████ | 337025/371472 [4:38:58<2:43:23,  3.51it/s]
 91%|█████████ | 337026/371472 [4:38:58<2:55:47,  3.27it/s]
 91%|█████████ | 337027/371472 [4:38:58<3:03:46,  3.12it/s]
 91%|█████████ | 337028/371472 [4:38:59<2:57:33,  3.23it/s]
 91%|█████████ | 337029/371472 [4:38:59<2:52:40,  3.32it/s]
 91%|█████████ | 337030/371472 [4:38:59<2:49:49,  3.38it/s]
 91%|█████████ | 337031/371472 [4:38:59<2:43:16,  3.52it/s]
 91%|█████████ | 337032/371472 [4:39:00<2:42:11,  3.54it/s]
 91%|█████████ | 337033/371472 [4:39:00<3:22:01,  2.84it/s]
 91%|█████████ | 337034/371472 [4:39:01<3:18:41,  2.89it/s]
 91%|█████████ | 337035/371472 [4:39:01<3:03:41,  3.12it/s]
 91%|█████████ | 337036/371472 [4:39:01<2:53:57,  3.30it/s]
 91%|█████████ | 337037/371472 [4:39:01<2:53:06,  3.32it/s]
 91%|█████████ | 337038/371472 [4:39:02<2:46:59,  3.44it/s]
 91%|█████████ | 337039/371472 [4:39:02<2:56:47,  3.25it/s]
 91%|█████████ | 337040/371472 [4:39:02<3:15:18,  2.94it/s]
                                                           
{'loss': 2.7537, 'learning_rate': 1.8346656898446418e-07, 'epoch': 14.52}

 91%|█████████ | 337040/371472 [4:39:02<3:15:18,  2.94it/s]
 91%|█████████ | 337041/371472 [4:39:03<3:06:37,  3.07it/s]
 91%|█████████ | 337042/371472 [4:39:03<3:02:51,  3.14it/s]
 91%|█████████ | 337043/371472 [4:39:03<2:56:16,  3.26it/s]
 91%|█████████ | 337044/371472 [4:39:04<3:04:44,  3.11it/s]
 91%|█████████ | 337045/371472 [4:39:04<2:55:41,  3.27it/s]
 91%|█████████ | 337046/371472 [4:39:04<2:56:58,  3.24it/s]
 91%|█████████ | 337047/371472 [4:39:05<2:51:05,  3.35it/s]
 91%|█████████ | 337048/371472 [4:39:05<2:55:04,  3.28it/s]
 91%|█████████ | 337049/371472 [4:39:05<2:55:16,  3.27it/s]
 91%|█████████ | 337050/371472 [4:39:05<2:47:47,  3.42it/s]
 91%|█████████ | 337051/371472 [4:39:06<2:52:15,  3.33it/s]
 91%|█████████ | 337052/371472 [4:39:06<2:51:51,  3.34it/s]
 91%|█████████ | 337053/371472 [4:39:06<2:49:06,  3.39it/s]
 91%|█████████ | 337054/371472 [4:39:07<2:45:05,  3.47it/s]
 91%|█████████ | 337055/371472 [4:39:07<2:41:27,  3.55it/s]
 91%|█████████ | 337056/371472 [4:39:07<2:45:25,  3.47it/s]
 91%|█████████ | 337057/371472 [4:39:07<2:39:43,  3.59it/s]
 91%|█████████ | 337058/371472 [4:39:08<2:38:05,  3.63it/s]
 91%|█████████ | 337059/371472 [4:39:08<2:42:43,  3.52it/s]
 91%|█████████ | 337060/371472 [4:39:08<2:40:09,  3.58it/s]
                                                           
{'loss': 2.5292, 'learning_rate': 1.8341808700898533e-07, 'epoch': 14.52}

 91%|█████████ | 337060/371472 [4:39:08<2:40:09,  3.58it/s]
 91%|█████████ | 337061/371472 [4:39:09<2:45:52,  3.46it/s]
 91%|█████████ | 337062/371472 [4:39:09<2:41:08,  3.56it/s]
 91%|█████████ | 337063/371472 [4:39:09<2:39:23,  3.60it/s]
 91%|█████████ | 337064/371472 [4:39:09<2:37:29,  3.64it/s]
 91%|█████████ | 337065/371472 [4:39:10<2:36:04,  3.67it/s]
 91%|█████████ | 337066/371472 [4:39:10<2:35:49,  3.68it/s]
 91%|█████████ | 337067/371472 [4:39:10<2:31:53,  3.78it/s]
 91%|█████████ | 337068/371472 [4:39:10<2:33:01,  3.75it/s]
 91%|█████████ | 337069/371472 [4:39:11<2:30:44,  3.80it/s]
 91%|█████████ | 337070/371472 [4:39:11<2:32:58,  3.75it/s]
 91%|█████████ | 337071/371472 [4:39:11<2:32:41,  3.75it/s]
 91%|█████████ | 337072/371472 [4:39:11<2:32:40,  3.76it/s]
 91%|█████████ | 337073/371472 [4:39:12<2:29:45,  3.83it/s]
 91%|█████████ | 337074/371472 [4:39:12<2:27:13,  3.89it/s]
 91%|█████████ | 337075/371472 [4:39:12<2:31:43,  3.78it/s]
 91%|█████████ | 337076/371472 [4:39:13<2:35:28,  3.69it/s]
 91%|█████████ | 337077/371472 [4:39:13<2:32:52,  3.75it/s]
 91%|█████████ | 337078/371472 [4:39:13<2:47:51,  3.42it/s]
 91%|█████████ | 337079/371472 [4:39:13<2:45:44,  3.46it/s]
 91%|█████████ | 337080/371472 [4:39:14<2:42:16,  3.53it/s]
                                                           
{'loss': 2.5679, 'learning_rate': 1.8336960503350638e-07, 'epoch': 14.52}

 91%|█████████ | 337080/371472 [4:39:14<2:42:16,  3.53it/s]
 91%|█████████ | 337081/371472 [4:39:14<2:44:12,  3.49it/s]
 91%|█████████ | 337082/371472 [4:39:14<2:45:35,  3.46it/s]
 91%|█████████ | 337083/371472 [4:39:15<2:55:02,  3.27it/s]
 91%|█████████ | 337084/371472 [4:39:15<2:51:24,  3.34it/s]
 91%|█████████ | 337085/371472 [4:39:15<2:41:35,  3.55it/s]
 91%|█████████ | 337086/371472 [4:39:15<2:37:16,  3.64it/s]
 91%|█████████ | 337087/371472 [4:39:16<2:42:50,  3.52it/s]
 91%|█████████ | 337088/371472 [4:39:16<2:34:11,  3.72it/s]
 91%|█████████ | 337089/371472 [4:39:16<2:31:55,  3.77it/s]
 91%|█████████ | 337090/371472 [4:39:16<2:35:05,  3.69it/s]
 91%|█████████ | 337091/371472 [4:39:17<2:37:03,  3.65it/s]
 91%|█████████ | 337092/371472 [4:39:17<2:33:44,  3.73it/s]
 91%|█████████ | 337093/371472 [4:39:17<2:56:30,  3.25it/s]
 91%|█████████ | 337094/371472 [4:39:18<2:52:14,  3.33it/s]
 91%|█████████ | 337095/371472 [4:39:18<2:48:06,  3.41it/s]
 91%|█████████ | 337096/371472 [4:39:18<2:38:16,  3.62it/s]
 91%|█████████ | 337097/371472 [4:39:18<2:33:19,  3.74it/s]
 91%|█████████ | 337098/371472 [4:39:19<2:36:46,  3.65it/s]
 91%|█████████ | 337099/371472 [4:39:19<2:42:08,  3.53it/s]
 91%|█████████ | 337100/371472 [4:39:19<2:37:12,  3.64it/s]
                                                           
{'loss': 2.612, 'learning_rate': 1.8332112305802755e-07, 'epoch': 14.52}

 91%|█████████ | 337100/371472 [4:39:19<2:37:12,  3.64it/s]
 91%|█████████ | 337101/371472 [4:39:20<2:32:01,  3.77it/s]
 91%|█████████ | 337102/371472 [4:39:20<2:33:01,  3.74it/s]
 91%|█████████ | 337103/371472 [4:39:20<2:38:22,  3.62it/s]
 91%|█████████ | 337104/371472 [4:39:20<2:35:34,  3.68it/s]
 91%|█████████ | 337105/371472 [4:39:21<2:39:20,  3.59it/s]
 91%|█████████ | 337106/371472 [4:39:21<2:35:42,  3.68it/s]
 91%|█████████ | 337107/371472 [4:39:21<2:33:29,  3.73it/s]
 91%|█████████ | 337108/371472 [4:39:22<2:39:22,  3.59it/s]
 91%|█████████ | 337109/371472 [4:39:22<2:46:58,  3.43it/s]
 91%|█████████ | 337110/371472 [4:39:22<2:47:03,  3.43it/s]
 91%|█████████ | 337111/371472 [4:39:22<2:40:47,  3.56it/s]
 91%|█████████ | 337112/371472 [4:39:23<2:50:33,  3.36it/s]
 91%|█████████ | 337113/371472 [4:39:23<2:49:30,  3.38it/s]
 91%|█████████ | 337114/371472 [4:39:23<2:42:45,  3.52it/s]
 91%|█████████ | 337115/371472 [4:39:24<2:39:13,  3.60it/s]
 91%|█████████ | 337116/371472 [4:39:24<2:38:19,  3.62it/s]
 91%|█████████ | 337117/371472 [4:39:24<2:33:29,  3.73it/s]
 91%|█████████ | 337118/371472 [4:39:24<2:48:18,  3.40it/s]
 91%|█████████ | 337119/371472 [4:39:25<2:36:10,  3.67it/s]
 91%|█████████ | 337120/371472 [4:39:25<2:42:43,  3.52it/s]
                                                           
{'loss': 2.529, 'learning_rate': 1.8327264108254863e-07, 'epoch': 14.52}

 91%|█████████ | 337120/371472 [4:39:25<2:42:43,  3.52it/s]
 91%|█████████ | 337121/371472 [4:39:25<2:40:54,  3.56it/s]
 91%|█████████ | 337122/371472 [4:39:26<2:46:06,  3.45it/s]
 91%|█████████ | 337123/371472 [4:39:26<2:40:22,  3.57it/s]
 91%|█████████ | 337124/371472 [4:39:26<2:44:21,  3.48it/s]
 91%|█████████ | 337125/371472 [4:39:26<2:49:32,  3.38it/s]
 91%|█████████ | 337126/371472 [4:39:27<2:43:05,  3.51it/s]
 91%|█████████ | 337127/371472 [4:39:27<2:34:38,  3.70it/s]
 91%|█████████ | 337128/371472 [4:39:27<2:37:17,  3.64it/s]
 91%|█████████ | 337129/371472 [4:39:27<2:36:51,  3.65it/s]
 91%|█████████ | 337130/371472 [4:39:28<2:47:32,  3.42it/s]
 91%|█████████ | 337131/371472 [4:39:28<2:39:32,  3.59it/s]
 91%|█████████ | 337132/371472 [4:39:28<2:36:50,  3.65it/s]
 91%|█████████ | 337133/371472 [4:39:29<2:34:29,  3.70it/s]
 91%|█████████ | 337134/371472 [4:39:29<2:33:28,  3.73it/s]
 91%|█████████ | 337135/371472 [4:39:29<2:41:45,  3.54it/s]
 91%|█████████ | 337136/371472 [4:39:29<2:47:12,  3.42it/s]
 91%|█████████ | 337137/371472 [4:39:30<2:40:27,  3.57it/s]
 91%|█████████ | 337138/371472 [4:39:30<2:43:40,  3.50it/s]
 91%|█████████ | 337139/371472 [4:39:30<2:39:46,  3.58it/s]
 91%|█████████ | 337140/371472 [4:39:31<2:53:45,  3.29it/s]
                                                           
{'loss': 2.5375, 'learning_rate': 1.8322415910706975e-07, 'epoch': 14.52}

 91%|█████████ | 337140/371472 [4:39:31<2:53:45,  3.29it/s]
 91%|█████████ | 337141/371472 [4:39:31<2:54:28,  3.28it/s]
 91%|█████████ | 337142/371472 [4:39:31<2:46:41,  3.43it/s]
 91%|█████████ | 337143/371472 [4:39:31<2:45:52,  3.45it/s]
 91%|█████████ | 337144/371472 [4:39:32<2:47:01,  3.43it/s]
 91%|█████████ | 337145/371472 [4:39:32<2:38:47,  3.60it/s]
 91%|█████████ | 337146/371472 [4:39:32<2:33:43,  3.72it/s]
 91%|█████████ | 337147/371472 [4:39:33<2:35:06,  3.69it/s]
 91%|█████████ | 337148/371472 [4:39:33<2:34:17,  3.71it/s]
 91%|█████████ | 337149/371472 [4:39:33<2:28:20,  3.86it/s]
 91%|█████████ | 337150/371472 [4:39:33<2:33:43,  3.72it/s]
 91%|█████████ | 337151/371472 [4:39:34<2:40:55,  3.55it/s]
 91%|█████████ | 337152/371472 [4:39:34<2:44:26,  3.48it/s]
 91%|█████████ | 337153/371472 [4:39:34<2:40:58,  3.55it/s]
 91%|█████████ | 337154/371472 [4:39:35<2:45:13,  3.46it/s]
 91%|█████████ | 337155/371472 [4:39:35<2:40:43,  3.56it/s]
 91%|█████████ | 337156/371472 [4:39:35<2:41:10,  3.55it/s]
 91%|█████████ | 337157/371472 [4:39:35<2:39:16,  3.59it/s]
 91%|█████████ | 337158/371472 [4:39:36<2:44:40,  3.47it/s]
 91%|█████████ | 337159/371472 [4:39:36<2:45:10,  3.46it/s]
 91%|█████████ | 337160/371472 [4:39:36<2:42:35,  3.52it/s]
                                                           
{'loss': 2.4589, 'learning_rate': 1.8317567713159082e-07, 'epoch': 14.52}

 91%|█████████ | 337160/371472 [4:39:36<2:42:35,  3.52it/s]
 91%|█████████ | 337161/371472 [4:39:37<2:41:36,  3.54it/s]
 91%|█████████ | 337162/371472 [4:39:37<2:38:16,  3.61it/s]
 91%|█████████ | 337163/371472 [4:39:37<2:40:50,  3.56it/s]
 91%|█████████ | 337164/371472 [4:39:37<2:39:43,  3.58it/s]
 91%|█████████ | 337165/371472 [4:39:38<2:42:51,  3.51it/s]
 91%|█████████ | 337166/371472 [4:39:38<2:42:55,  3.51it/s]
 91%|█████████ | 337167/371472 [4:39:38<2:40:59,  3.55it/s]
 91%|█████████ | 337168/371472 [4:39:39<2:48:27,  3.39it/s]
 91%|█████████ | 337169/371472 [4:39:39<2:46:08,  3.44it/s]
 91%|█████████ | 337170/371472 [4:39:39<2:48:49,  3.39it/s]
 91%|█████████ | 337171/371472 [4:39:39<2:53:21,  3.30it/s]
 91%|█████████ | 337172/371472 [4:39:40<2:58:28,  3.20it/s]
 91%|█████████ | 337173/371472 [4:39:40<2:58:12,  3.21it/s]
 91%|█████████ | 337174/371472 [4:39:40<2:48:28,  3.39it/s]
 91%|█████████ | 337175/371472 [4:39:41<2:44:26,  3.48it/s]
 91%|█████████ | 337176/371472 [4:39:41<2:38:40,  3.60it/s]
 91%|█████████ | 337177/371472 [4:39:41<2:52:50,  3.31it/s]
 91%|█████████ | 337178/371472 [4:39:41<2:44:05,  3.48it/s]
 91%|█████████ | 337179/371472 [4:39:42<2:38:52,  3.60it/s]
 91%|█████████ | 337180/371472 [4:39:42<2:47:56,  3.40it/s]
                                                           
{'loss': 2.4873, 'learning_rate': 1.83127195156112e-07, 'epoch': 14.52}

 91%|█████████ | 337180/371472 [4:39:42<2:47:56,  3.40it/s]
 91%|█████████ | 337181/371472 [4:39:42<2:42:36,  3.51it/s]
 91%|█████████ | 337182/371472 [4:39:43<2:48:55,  3.38it/s]
 91%|█████████ | 337183/371472 [4:39:43<2:45:40,  3.45it/s]
 91%|█████████ | 337184/371472 [4:39:43<2:42:35,  3.51it/s]
 91%|█████████ | 337185/371472 [4:39:44<2:51:41,  3.33it/s]
 91%|█████████ | 337186/371472 [4:39:44<2:53:33,  3.29it/s]
 91%|█████████ | 337187/371472 [4:39:44<2:47:34,  3.41it/s]
 91%|█████████ | 337188/371472 [4:39:44<2:48:15,  3.40it/s]
 91%|█████████ | 337189/371472 [4:39:45<2:47:59,  3.40it/s]
 91%|█████████ | 337190/371472 [4:39:45<2:44:17,  3.48it/s]
 91%|█████████ | 337191/371472 [4:39:45<2:38:44,  3.60it/s]
 91%|█████████ | 337192/371472 [4:39:45<2:35:09,  3.68it/s]
 91%|█████████ | 337193/371472 [4:39:46<2:48:57,  3.38it/s]
 91%|█████████ | 337194/371472 [4:39:46<2:43:30,  3.49it/s]
 91%|█████████ | 337195/371472 [4:39:46<2:46:23,  3.43it/s]
 91%|█████████ | 337196/371472 [4:39:47<2:39:33,  3.58it/s]
 91%|█████████ | 337197/371472 [4:39:47<2:31:27,  3.77it/s]
 91%|█████████ | 337198/371472 [4:39:47<2:32:51,  3.74it/s]
 91%|█████████ | 337199/371472 [4:39:47<2:35:13,  3.68it/s]
 91%|█████████ | 337200/371472 [4:39:48<2:44:53,  3.46it/s]
                                                           
{'loss': 2.5065, 'learning_rate': 1.8307871318063304e-07, 'epoch': 14.52}

 91%|█████████ | 337200/371472 [4:39:48<2:44:53,  3.46it/s]
 91%|█████████ | 337201/371472 [4:39:48<3:04:43,  3.09it/s]
 91%|█████████ | 337202/371472 [4:39:48<2:55:08,  3.26it/s]
 91%|█████████ | 337203/371472 [4:39:49<3:25:03,  2.79it/s]
 91%|█████████ | 337204/371472 [4:39:49<3:20:02,  2.86it/s]
 91%|█████████ | 337205/371472 [4:39:49<3:04:09,  3.10it/s]
 91%|█████████ | 337206/371472 [4:39:50<2:57:37,  3.22it/s]
 91%|█████████ | 337207/371472 [4:39:50<2:52:58,  3.30it/s]
 91%|█████████ | 337208/371472 [4:39:50<2:57:45,  3.21it/s]
 91%|█████████ | 337209/371472 [4:39:51<2:50:03,  3.36it/s]
 91%|█████████ | 337210/371472 [4:39:51<2:41:42,  3.53it/s]
 91%|█████████ | 337211/371472 [4:39:51<2:37:07,  3.63it/s]
 91%|█████████ | 337212/371472 [4:39:51<2:39:07,  3.59it/s]
 91%|█████████ | 337213/371472 [4:39:52<2:36:02,  3.66it/s]
 91%|█████████ | 337214/371472 [4:39:52<2:38:08,  3.61it/s]
 91%|█████████ | 337215/371472 [4:39:52<2:36:43,  3.64it/s]
 91%|█████████ | 337216/371472 [4:39:53<2:50:21,  3.35it/s]
 91%|█████████ | 337217/371472 [4:39:53<2:52:32,  3.31it/s]
 91%|█████████ | 337218/371472 [4:39:53<2:44:32,  3.47it/s]
 91%|█████████ | 337219/371472 [4:39:53<2:45:32,  3.45it/s]
 91%|█████████ | 337220/371472 [4:39:54<2:40:55,  3.55it/s]
                                                           
{'loss': 2.4964, 'learning_rate': 1.830302312051542e-07, 'epoch': 14.52}

 91%|█████████ | 337220/371472 [4:39:54<2:40:55,  3.55it/s]
 91%|█████████ | 337221/371472 [4:39:54<2:32:14,  3.75it/s]
 91%|█████████ | 337222/371472 [4:39:54<2:32:55,  3.73it/s]
 91%|█████████ | 337223/371472 [4:39:55<2:31:30,  3.77it/s]
 91%|█████████ | 337224/371472 [4:39:55<2:28:58,  3.83it/s]
 91%|█████████ | 337225/371472 [4:39:55<2:27:27,  3.87it/s]
 91%|█████████ | 337226/371472 [4:39:55<2:39:13,  3.58it/s]
 91%|█████████ | 337227/371472 [4:39:56<2:44:00,  3.48it/s]
 91%|█████████ | 337228/371472 [4:39:56<2:47:58,  3.40it/s]
 91%|█████████ | 337229/371472 [4:39:56<2:44:26,  3.47it/s]
 91%|█████████ | 337230/371472 [4:39:57<2:45:37,  3.45it/s]
 91%|█████████ | 337231/371472 [4:39:57<2:43:28,  3.49it/s]
 91%|█████████ | 337232/371472 [4:39:57<2:42:09,  3.52it/s]
 91%|█████████ | 337233/371472 [4:39:57<2:48:59,  3.38it/s]
 91%|█████████ | 337234/371472 [4:39:58<2:49:02,  3.38it/s]
 91%|█████████ | 337235/371472 [4:39:58<2:47:09,  3.41it/s]
 91%|█████████ | 337236/371472 [4:39:58<2:55:38,  3.25it/s]
 91%|█████████ | 337237/371472 [4:39:59<2:51:03,  3.34it/s]
 91%|█████████ | 337238/371472 [4:39:59<2:44:45,  3.46it/s]
 91%|█████████ | 337239/371472 [4:39:59<2:47:18,  3.41it/s]
 91%|█████████ | 337240/371472 [4:39:59<2:51:48,  3.32it/s]
                                                           
{'loss': 2.6586, 'learning_rate': 1.8298174922967527e-07, 'epoch': 14.53}

 91%|█████████ | 337240/371472 [4:40:00<2:51:48,  3.32it/s]
 91%|█████████ | 337241/371472 [4:40:00<2:43:17,  3.49it/s]
 91%|█████████ | 337242/371472 [4:40:00<2:46:22,  3.43it/s]
 91%|█████████ | 337243/371472 [4:40:00<2:48:21,  3.39it/s]
 91%|█████████ | 337244/371472 [4:40:01<2:47:51,  3.40it/s]
 91%|█████████ | 337245/371472 [4:40:01<2:49:52,  3.36it/s]
 91%|█████████ | 337246/371472 [4:40:01<2:46:09,  3.43it/s]
 91%|█████████ | 337247/371472 [4:40:02<2:42:32,  3.51it/s]
 91%|█████████ | 337248/371472 [4:40:02<2:40:31,  3.55it/s]
 91%|█████████ | 337249/371472 [4:40:02<2:42:58,  3.50it/s]
 91%|█████████ | 337250/371472 [4:40:02<2:40:13,  3.56it/s]
 91%|█████████ | 337251/371472 [4:40:03<2:36:35,  3.64it/s]
 91%|█████████ | 337252/371472 [4:40:03<2:32:42,  3.73it/s]
 91%|█████████ | 337253/371472 [4:40:03<2:27:26,  3.87it/s]
 91%|█████████ | 337254/371472 [4:40:03<2:26:12,  3.90it/s]
 91%|█████████ | 337255/371472 [4:40:04<2:36:36,  3.64it/s]
 91%|█████████ | 337256/371472 [4:40:04<2:34:52,  3.68it/s]
 91%|█████████ | 337257/371472 [4:40:04<2:32:46,  3.73it/s]
 91%|█████████ | 337258/371472 [4:40:04<2:40:13,  3.56it/s]
 91%|█████████ | 337259/371472 [4:40:05<2:39:05,  3.58it/s]
 91%|█████████ | 337260/371472 [4:40:05<2:32:59,  3.73it/s]
                                                           
{'loss': 2.5288, 'learning_rate': 1.829332672541964e-07, 'epoch': 14.53}

 91%|█████████ | 337260/371472 [4:40:05<2:32:59,  3.73it/s]
 91%|█████████ | 337261/371472 [4:40:05<2:52:44,  3.30it/s]
 91%|█████████ | 337262/371472 [4:40:06<2:43:42,  3.48it/s]
 91%|█████████ | 337263/371472 [4:40:06<2:38:06,  3.61it/s]
 91%|█████████ | 337264/371472 [4:40:06<3:09:25,  3.01it/s]
 91%|█████████ | 337265/371472 [4:40:07<3:00:44,  3.15it/s]
 91%|█████████ | 337266/371472 [4:40:07<2:50:11,  3.35it/s]
 91%|█████████ | 337267/371472 [4:40:07<2:44:58,  3.46it/s]
 91%|█████████ | 337268/371472 [4:40:07<2:41:27,  3.53it/s]
 91%|█████████ | 337269/371472 [4:40:08<2:55:04,  3.26it/s]
 91%|█████████ | 337270/371472 [4:40:08<2:55:06,  3.26it/s]
 91%|█████████ | 337271/371472 [4:40:08<2:56:04,  3.24it/s]
 91%|█████████ | 337272/371472 [4:40:09<2:48:55,  3.37it/s]
 91%|█████████ | 337273/371472 [4:40:09<2:47:51,  3.40it/s]
 91%|█████████ | 337274/371472 [4:40:09<2:42:27,  3.51it/s]
 91%|█████████ | 337275/371472 [4:40:10<2:44:21,  3.47it/s]
 91%|█████████ | 337276/371472 [4:40:10<2:42:44,  3.50it/s]
 91%|█████████ | 337277/371472 [4:40:10<2:48:57,  3.37it/s]
 91%|█████████ | 337278/371472 [4:40:10<2:45:22,  3.45it/s]
 91%|█████████ | 337279/371472 [4:40:11<2:41:55,  3.52it/s]
 91%|█████████ | 337280/371472 [4:40:11<2:38:45,  3.59it/s]
                                                           
{'loss': 2.6021, 'learning_rate': 1.8288478527871746e-07, 'epoch': 14.53}

 91%|█████████ | 337280/371472 [4:40:11<2:38:45,  3.59it/s]
 91%|█████████ | 337281/371472 [4:40:11<2:41:56,  3.52it/s]
 91%|█████████ | 337282/371472 [4:40:12<2:39:23,  3.57it/s]
 91%|█████████ | 337283/371472 [4:40:12<2:47:30,  3.40it/s]
 91%|█████████ | 337284/371472 [4:40:12<2:37:41,  3.61it/s]
 91%|█████████ | 337285/371472 [4:40:12<2:31:30,  3.76it/s]
 91%|█████████ | 337286/371472 [4:40:13<2:31:53,  3.75it/s]
 91%|█████████ | 337287/371472 [4:40:13<2:29:11,  3.82it/s]
 91%|█████████ | 337288/371472 [4:40:13<2:26:31,  3.89it/s]
 91%|█████████ | 337289/371472 [4:40:13<2:31:17,  3.77it/s]
 91%|█████████ | 337290/371472 [4:40:14<2:38:52,  3.59it/s]
 91%|█████████ | 337291/371472 [4:40:14<2:33:28,  3.71it/s]
 91%|█████████ | 337292/371472 [4:40:14<2:35:06,  3.67it/s]
 91%|█████████ | 337293/371472 [4:40:14<2:29:25,  3.81it/s]
 91%|█████████ | 337294/371472 [4:40:15<2:31:25,  3.76it/s]
 91%|█████████ | 337295/371472 [4:40:15<2:41:29,  3.53it/s]
 91%|█████████ | 337296/371472 [4:40:15<2:39:19,  3.58it/s]
 91%|█████████ | 337297/371472 [4:40:16<2:38:57,  3.58it/s]
 91%|█████████ | 337298/371472 [4:40:16<2:35:08,  3.67it/s]
 91%|█████████ | 337299/371472 [4:40:16<2:31:34,  3.76it/s]
 91%|█████████ | 337300/371472 [4:40:16<2:34:40,  3.68it/s]
                                                           
{'loss': 2.6757, 'learning_rate': 1.828363033032386e-07, 'epoch': 14.53}

 91%|█████████ | 337300/371472 [4:40:16<2:34:40,  3.68it/s]
 91%|█████████ | 337301/371472 [4:40:17<2:34:01,  3.70it/s]
 91%|█████████ | 337302/371472 [4:40:17<2:37:36,  3.61it/s]
 91%|█████████ | 337303/371472 [4:40:17<2:31:22,  3.76it/s]
 91%|█████████ | 337304/371472 [4:40:17<2:34:15,  3.69it/s]
 91%|█████████ | 337305/371472 [4:40:18<2:36:53,  3.63it/s]
 91%|█████████ | 337306/371472 [4:40:18<2:29:50,  3.80it/s]
 91%|█████████ | 337307/371472 [4:40:18<2:32:24,  3.74it/s]
 91%|█████████ | 337308/371472 [4:40:19<2:34:10,  3.69it/s]
 91%|█████████ | 337309/371472 [4:40:19<2:32:27,  3.73it/s]
 91%|█████████ | 337310/371472 [4:40:19<2:32:34,  3.73it/s]
 91%|█████████ | 337311/371472 [4:40:19<2:28:15,  3.84it/s]
 91%|█████████ | 337312/371472 [4:40:20<2:28:53,  3.82it/s]
 91%|█████████ | 337313/371472 [4:40:20<2:29:21,  3.81it/s]
 91%|█████████ | 337314/371472 [4:40:20<2:37:13,  3.62it/s]
 91%|█████████ | 337315/371472 [4:40:20<2:36:55,  3.63it/s]
 91%|█████████ | 337316/371472 [4:40:21<2:53:08,  3.29it/s]
 91%|█████████ | 337317/371472 [4:40:21<2:47:43,  3.39it/s]
 91%|█████████ | 337318/371472 [4:40:21<2:38:54,  3.58it/s]
 91%|█████████ | 337319/371472 [4:40:22<2:37:29,  3.61it/s]
 91%|█████████ | 337320/371472 [4:40:22<3:11:22,  2.97it/s]
                                                           
{'loss': 2.4936, 'learning_rate': 1.8278782132775968e-07, 'epoch': 14.53}

 91%|█████████ | 337320/371472 [4:40:22<3:11:22,  2.97it/s]
 91%|█████████ | 337321/371472 [4:40:22<3:12:14,  2.96it/s]
 91%|█████████ | 337322/371472 [4:40:23<3:10:15,  2.99it/s]
 91%|█████████ | 337323/371472 [4:40:23<3:08:59,  3.01it/s]
 91%|█████████ | 337324/371472 [4:40:23<2:53:27,  3.28it/s]
 91%|█████████ | 337325/371472 [4:40:24<2:43:10,  3.49it/s]
 91%|█████████ | 337326/371472 [4:40:24<2:38:30,  3.59it/s]
 91%|█████████ | 337327/371472 [4:40:24<2:35:32,  3.66it/s]
 91%|█████████ | 337328/371472 [4:40:24<2:39:42,  3.56it/s]
 91%|█████████ | 337329/371472 [4:40:25<2:33:38,  3.70it/s]
 91%|█████████ | 337330/371472 [4:40:25<2:35:04,  3.67it/s]
 91%|█████████ | 337331/371472 [4:40:25<2:38:45,  3.58it/s]
 91%|█████████ | 337332/371472 [4:40:25<2:40:27,  3.55it/s]
 91%|█████████ | 337333/371472 [4:40:26<2:45:56,  3.43it/s]
 91%|█████████ | 337334/371472 [4:40:26<2:41:30,  3.52it/s]
 91%|█████████ | 337335/371472 [4:40:26<2:40:14,  3.55it/s]
 91%|█████████ | 337336/371472 [4:40:27<2:35:59,  3.65it/s]
 91%|█████████ | 337337/371472 [4:40:27<2:35:25,  3.66it/s]
 91%|█████████ | 337338/371472 [4:40:27<2:44:03,  3.47it/s]
 91%|█████████ | 337339/371472 [4:40:27<2:43:03,  3.49it/s]
 91%|█████████ | 337340/371472 [4:40:28<2:46:44,  3.41it/s]
                                                           
{'loss': 2.593, 'learning_rate': 1.8273933935228084e-07, 'epoch': 14.53}

 91%|█████████ | 337340/371472 [4:40:28<2:46:44,  3.41it/s]
 91%|█████████ | 337341/371472 [4:40:28<2:40:17,  3.55it/s]
 91%|█████████ | 337342/371472 [4:40:28<2:33:25,  3.71it/s]
 91%|█████████ | 337343/371472 [4:40:29<2:37:05,  3.62it/s]
 91%|█████████ | 337344/371472 [4:40:29<2:29:49,  3.80it/s]
 91%|█████████ | 337345/371472 [4:40:29<2:35:17,  3.66it/s]
 91%|█████████ | 337346/371472 [4:40:29<2:29:27,  3.81it/s]
 91%|█████████ | 337347/371472 [4:40:30<2:34:41,  3.68it/s]
 91%|█████████ | 337348/371472 [4:40:30<2:50:01,  3.34it/s]
 91%|█████████ | 337349/371472 [4:40:30<2:41:21,  3.52it/s]
 91%|█████████ | 337350/371472 [4:40:31<2:40:54,  3.53it/s]
 91%|█████████ | 337351/371472 [4:40:31<2:39:34,  3.56it/s]
 91%|█████████ | 337352/371472 [4:40:31<2:40:49,  3.54it/s]
 91%|█████████ | 337353/371472 [4:40:31<2:36:14,  3.64it/s]
 91%|█████████ | 337354/371472 [4:40:32<2:33:13,  3.71it/s]
 91%|█████████ | 337355/371472 [4:40:32<2:33:35,  3.70it/s]
 91%|█████████ | 337356/371472 [4:40:32<2:30:25,  3.78it/s]
 91%|█████████ | 337357/371472 [4:40:32<2:29:09,  3.81it/s]
 91%|█████████ | 337358/371472 [4:40:33<2:31:40,  3.75it/s]
 91%|█████████ | 337359/371472 [4:40:33<2:43:27,  3.48it/s]
 91%|█████████ | 337360/371472 [4:40:33<2:41:12,  3.53it/s]
                                                           
{'loss': 2.6045, 'learning_rate': 1.826908573768019e-07, 'epoch': 14.53}

 91%|█████████ | 337360/371472 [4:40:33<2:41:12,  3.53it/s]
 91%|█████████ | 337361/371472 [4:40:33<2:34:46,  3.67it/s]
 91%|█████████ | 337362/371472 [4:40:34<2:39:07,  3.57it/s]
 91%|█████████ | 337363/371472 [4:40:34<2:34:35,  3.68it/s]
 91%|█████████ | 337364/371472 [4:40:34<2:43:49,  3.47it/s]
 91%|█████████ | 337365/371472 [4:40:35<2:40:22,  3.54it/s]
 91%|█████████ | 337366/371472 [4:40:35<2:40:17,  3.55it/s]
 91%|█████████ | 337367/371472 [4:40:35<2:42:59,  3.49it/s]
 91%|█████████ | 337368/371472 [4:40:35<2:36:53,  3.62it/s]
 91%|█████████ | 337369/371472 [4:40:36<2:48:59,  3.36it/s]
 91%|█████████ | 337370/371472 [4:40:36<2:43:06,  3.48it/s]
 91%|█████████ | 337371/371472 [4:40:36<2:40:26,  3.54it/s]
 91%|█████████ | 337372/371472 [4:40:37<2:35:53,  3.65it/s]
 91%|█████████ | 337373/371472 [4:40:37<2:33:41,  3.70it/s]
 91%|█████████ | 337374/371472 [4:40:37<2:36:58,  3.62it/s]
 91%|█████████ | 337375/371472 [4:40:37<2:38:58,  3.57it/s]
 91%|█████████ | 337376/371472 [4:40:38<2:36:13,  3.64it/s]
 91%|█████████ | 337377/371472 [4:40:38<2:42:30,  3.50it/s]
 91%|█████████ | 337378/371472 [4:40:38<2:42:27,  3.50it/s]
 91%|█████████ | 337379/371472 [4:40:39<2:35:52,  3.65it/s]
 91%|█████████ | 337380/371472 [4:40:39<2:36:26,  3.63it/s]
                                                           
{'loss': 2.5138, 'learning_rate': 1.8264237540132306e-07, 'epoch': 14.53}

 91%|█████████ | 337380/371472 [4:40:39<2:36:26,  3.63it/s]
 91%|█████████ | 337381/371472 [4:40:39<2:36:58,  3.62it/s]
 91%|█████████ | 337382/371472 [4:40:39<2:34:01,  3.69it/s]
 91%|█████████ | 337383/371472 [4:40:40<2:27:58,  3.84it/s]
 91%|█████████ | 337384/371472 [4:40:40<2:27:42,  3.85it/s]
 91%|█████████ | 337385/371472 [4:40:40<2:37:48,  3.60it/s]
 91%|█████████ | 337386/371472 [4:40:40<2:36:27,  3.63it/s]
 91%|█████████ | 337387/371472 [4:40:41<2:32:36,  3.72it/s]
 91%|█████████ | 337388/371472 [4:40:41<2:30:25,  3.78it/s]
 91%|█████████ | 337389/371472 [4:40:41<2:25:59,  3.89it/s]
 91%|█████████ | 337390/371472 [4:40:41<2:25:18,  3.91it/s]
 91%|█████████ | 337391/371472 [4:40:42<2:29:33,  3.80it/s]
 91%|█████████ | 337392/371472 [4:40:42<2:32:19,  3.73it/s]
 91%|█████████ | 337393/371472 [4:40:42<2:31:17,  3.75it/s]
 91%|█████████ | 337394/371472 [4:40:43<2:29:55,  3.79it/s]
 91%|█████████ | 337395/371472 [4:40:43<2:29:04,  3.81it/s]
 91%|█████████ | 337396/371472 [4:40:43<2:40:12,  3.54it/s]
 91%|█████████ | 337397/371472 [4:40:43<2:42:53,  3.49it/s]
 91%|█████████ | 337398/371472 [4:40:44<2:40:50,  3.53it/s]
 91%|█████████ | 337399/371472 [4:40:44<2:42:50,  3.49it/s]
 91%|█████████ | 337400/371472 [4:40:44<2:38:20,  3.59it/s]
                                                           
{'loss': 2.7271, 'learning_rate': 1.825938934258441e-07, 'epoch': 14.53}

 91%|█████████ | 337400/371472 [4:40:44<2:38:20,  3.59it/s]
 91%|█████████ | 337401/371472 [4:40:44<2:32:48,  3.72it/s]
 91%|█████████ | 337402/371472 [4:40:45<2:38:42,  3.58it/s]
 91%|█████████ | 337403/371472 [4:40:45<2:48:57,  3.36it/s]
 91%|█████████ | 337404/371472 [4:40:45<2:42:45,  3.49it/s]
 91%|█████████ | 337405/371472 [4:40:46<2:38:47,  3.58it/s]
 91%|█████████ | 337406/371472 [4:40:46<2:36:59,  3.62it/s]
 91%|█████████ | 337407/371472 [4:40:46<2:44:09,  3.46it/s]
 91%|█████████ | 337408/371472 [4:40:47<2:41:02,  3.53it/s]
 91%|█████████ | 337409/371472 [4:40:47<2:34:37,  3.67it/s]
 91%|█████████ | 337410/371472 [4:40:47<2:38:13,  3.59it/s]
 91%|█████████ | 337411/371472 [4:40:47<2:36:04,  3.64it/s]
 91%|█████████ | 337412/371472 [4:40:48<2:32:54,  3.71it/s]
 91%|█████████ | 337413/371472 [4:40:48<2:35:19,  3.65it/s]
 91%|█████████ | 337414/371472 [4:40:48<2:47:15,  3.39it/s]
 91%|█████████ | 337415/371472 [4:40:48<2:42:18,  3.50it/s]
 91%|█████████ | 337416/371472 [4:40:49<2:45:28,  3.43it/s]
 91%|█████████ | 337417/371472 [4:40:49<2:37:20,  3.61it/s]
 91%|█████████ | 337418/371472 [4:40:49<2:40:41,  3.53it/s]
 91%|█████████ | 337419/371472 [4:40:50<2:32:53,  3.71it/s]
 91%|█████████ | 337420/371472 [4:40:50<2:31:11,  3.75it/s]
                                                           
{'loss': 2.5677, 'learning_rate': 1.8254541145036528e-07, 'epoch': 14.53}

 91%|█████████ | 337420/371472 [4:40:50<2:31:11,  3.75it/s]
 91%|█████████ | 337421/371472 [4:40:50<2:33:35,  3.69it/s]
 91%|█████████ | 337422/371472 [4:40:50<2:49:55,  3.34it/s]
 91%|█████████ | 337423/371472 [4:40:51<2:43:23,  3.47it/s]
 91%|█████████ | 337424/371472 [4:40:51<2:43:45,  3.47it/s]
 91%|█████████ | 337425/371472 [4:40:51<2:36:45,  3.62it/s]
 91%|█████████ | 337426/371472 [4:40:52<2:45:17,  3.43it/s]
 91%|█████████ | 337427/371472 [4:40:52<2:54:37,  3.25it/s]
 91%|█████████ | 337428/371472 [4:40:52<2:44:35,  3.45it/s]
 91%|█████████ | 337429/371472 [4:40:52<2:41:08,  3.52it/s]
 91%|█████████ | 337430/371472 [4:40:53<2:34:24,  3.67it/s]
 91%|█████████ | 337431/371472 [4:40:53<2:30:02,  3.78it/s]
 91%|█████████ | 337432/371472 [4:40:53<2:28:49,  3.81it/s]
 91%|█████████ | 337433/371472 [4:40:53<2:27:42,  3.84it/s]
 91%|█████████ | 337434/371472 [4:40:54<2:27:57,  3.83it/s]
 91%|█████████ | 337435/371472 [4:40:54<2:28:07,  3.83it/s]
 91%|█████████ | 337436/371472 [4:40:54<2:32:48,  3.71it/s]
 91%|█████████ | 337437/371472 [4:40:55<2:34:06,  3.68it/s]
 91%|█████████ | 337438/371472 [4:40:55<2:47:36,  3.38it/s]
 91%|█████████ | 337439/371472 [4:40:55<2:51:33,  3.31it/s]
 91%|█████████ | 337440/371472 [4:40:56<2:50:51,  3.32it/s]
                                                           
{'loss': 2.484, 'learning_rate': 1.8249692947488633e-07, 'epoch': 14.53}

 91%|█████████ | 337440/371472 [4:40:56<2:50:51,  3.32it/s]
 91%|█████████ | 337441/371472 [4:40:56<2:47:36,  3.38it/s]
 91%|█████████ | 337442/371472 [4:40:56<2:52:24,  3.29it/s]
 91%|█████████ | 337443/371472 [4:40:56<2:43:16,  3.47it/s]
 91%|█████████ | 337444/371472 [4:40:57<2:37:03,  3.61it/s]
 91%|█████████ | 337445/371472 [4:40:57<2:40:51,  3.53it/s]
 91%|█████████ | 337446/371472 [4:40:57<2:41:38,  3.51it/s]
 91%|█████████ | 337447/371472 [4:40:58<2:56:01,  3.22it/s]
 91%|█████████ | 337448/371472 [4:40:58<2:47:37,  3.38it/s]
 91%|█████████ | 337449/371472 [4:40:58<2:39:02,  3.57it/s]
 91%|█████████ | 337450/371472 [4:40:58<2:42:17,  3.49it/s]
 91%|█████████ | 337451/371472 [4:40:59<2:46:36,  3.40it/s]
 91%|█████████ | 337452/371472 [4:40:59<2:42:11,  3.50it/s]
 91%|█████████ | 337453/371472 [4:40:59<2:35:38,  3.64it/s]
 91%|█████████ | 337454/371472 [4:41:00<2:38:58,  3.57it/s]
 91%|█████████ | 337455/371472 [4:41:00<2:42:44,  3.48it/s]
 91%|█████████ | 337456/371472 [4:41:00<2:41:30,  3.51it/s]
 91%|█████████ | 337457/371472 [4:41:00<2:33:13,  3.70it/s]
 91%|█████████ | 337458/371472 [4:41:01<2:34:57,  3.66it/s]
 91%|█████████ | 337459/371472 [4:41:01<2:37:07,  3.61it/s]
 91%|█████████ | 337460/371472 [4:41:01<2:31:34,  3.74it/s]
                                                           
{'loss': 2.6673, 'learning_rate': 1.8244844749940737e-07, 'epoch': 14.54}

 91%|█████████ | 337460/371472 [4:41:01<2:31:34,  3.74it/s]
 91%|█████████ | 337461/371472 [4:41:01<2:27:04,  3.85it/s]
 91%|█████████ | 337462/371472 [4:41:02<2:26:34,  3.87it/s]
 91%|█████████ | 337463/371472 [4:41:02<2:28:13,  3.82it/s]
 91%|█████████ | 337464/371472 [4:41:02<2:30:05,  3.78it/s]
 91%|█████████ | 337465/371472 [4:41:02<2:28:19,  3.82it/s]
 91%|█████████ | 337466/371472 [4:41:03<2:28:09,  3.83it/s]
 91%|█████████ | 337467/371472 [4:41:03<2:37:57,  3.59it/s]
 91%|█████████ | 337468/371472 [4:41:03<2:32:57,  3.71it/s]
 91%|█████████ | 337469/371472 [4:41:04<2:33:39,  3.69it/s]
 91%|█████████ | 337470/371472 [4:41:04<2:31:02,  3.75it/s]
 91%|█████████ | 337471/371472 [4:41:04<2:30:04,  3.78it/s]
 91%|█████████ | 337472/371472 [4:41:04<2:31:03,  3.75it/s]
 91%|█████████ | 337473/371472 [4:41:05<2:38:24,  3.58it/s]
 91%|█████████ | 337474/371472 [4:41:05<2:40:13,  3.54it/s]
 91%|█████████ | 337475/371472 [4:41:05<2:36:08,  3.63it/s]
 91%|█████████ | 337476/371472 [4:41:05<2:32:12,  3.72it/s]
 91%|█████████ | 337477/371472 [4:41:06<2:38:48,  3.57it/s]
 91%|█████████ | 337478/371472 [4:41:06<2:36:47,  3.61it/s]
 91%|█████████ | 337479/371472 [4:41:06<2:40:15,  3.54it/s]
 91%|█████████ | 337480/371472 [4:41:07<2:54:03,  3.25it/s]
                                                           
{'loss': 2.5696, 'learning_rate': 1.8239996552392855e-07, 'epoch': 14.54}

 91%|█████████ | 337480/371472 [4:41:07<2:54:03,  3.25it/s]
 91%|█████████ | 337481/371472 [4:41:07<2:49:38,  3.34it/s]
 91%|█████████ | 337482/371472 [4:41:07<2:48:01,  3.37it/s]
 91%|█████████ | 337483/371472 [4:41:07<2:40:59,  3.52it/s]
 91%|█████████ | 337484/371472 [4:41:08<3:03:56,  3.08it/s]
 91%|█████████ | 337485/371472 [4:41:08<2:52:16,  3.29it/s]
 91%|█████████ | 337486/371472 [4:41:08<2:49:44,  3.34it/s]
 91%|█████████ | 337487/371472 [4:41:09<2:50:43,  3.32it/s]
 91%|█████████ | 337488/371472 [4:41:09<2:40:42,  3.52it/s]
 91%|█████████ | 337489/371472 [4:41:09<2:44:00,  3.45it/s]
 91%|█████████ | 337490/371472 [4:41:10<2:40:23,  3.53it/s]
 91%|█████████ | 337491/371472 [4:41:10<2:36:14,  3.62it/s]
 91%|█████████ | 337492/371472 [4:41:10<2:40:44,  3.52it/s]
 91%|█████████ | 337493/371472 [4:41:10<2:38:10,  3.58it/s]
 91%|█████████ | 337494/371472 [4:41:11<2:45:00,  3.43it/s]
 91%|█████████ | 337495/371472 [4:41:11<2:39:17,  3.56it/s]
 91%|█████████ | 337496/371472 [4:41:11<2:48:32,  3.36it/s]
 91%|█████████ | 337497/371472 [4:41:12<3:02:48,  3.10it/s]
 91%|█████████ | 337498/371472 [4:41:12<2:49:37,  3.34it/s]
 91%|█████████ | 337499/371472 [4:41:12<2:45:11,  3.43it/s]
 91%|█████████ | 337500/371472 [4:41:12<2:41:08,  3.51it/s]
                                                           
{'loss': 2.632, 'learning_rate': 1.8235148354844962e-07, 'epoch': 14.54}

 91%|█████████ | 337500/371472 [4:41:12<2:41:08,  3.51it/s]
 91%|█████████ | 337501/371472 [4:41:13<3:04:14,  3.07it/s]
 91%|█████████ | 337502/371472 [4:41:13<2:57:21,  3.19it/s]
 91%|█████████ | 337503/371472 [4:41:13<2:50:51,  3.31it/s]
 91%|█████████ | 337504/371472 [4:41:14<2:41:51,  3.50it/s]
 91%|█████████ | 337505/371472 [4:41:14<2:44:18,  3.45it/s]
 91%|█████████ | 337506/371472 [4:41:14<2:43:07,  3.47it/s]
 91%|█████████ | 337507/371472 [4:41:15<2:44:46,  3.44it/s]
 91%|█████████ | 337508/371472 [4:41:15<2:56:47,  3.20it/s]
 91%|█████████ | 337509/371472 [4:41:15<2:52:46,  3.28it/s]
 91%|█████████ | 337510/371472 [4:41:16<2:52:42,  3.28it/s]
 91%|█████████ | 337511/371472 [4:41:16<2:45:49,  3.41it/s]
 91%|█████████ | 337512/371472 [4:41:16<2:39:12,  3.56it/s]
 91%|█████████ | 337513/371472 [4:41:16<2:42:00,  3.49it/s]
 91%|█████████ | 337514/371472 [4:41:17<2:36:31,  3.62it/s]
 91%|█████████ | 337515/371472 [4:41:17<2:42:31,  3.48it/s]
 91%|█████████ | 337516/371472 [4:41:17<2:39:31,  3.55it/s]
 91%|█████████ | 337517/371472 [4:41:17<2:34:25,  3.66it/s]
 91%|█████████ | 337518/371472 [4:41:18<2:39:13,  3.55it/s]
 91%|█████████ | 337519/371472 [4:41:18<2:40:54,  3.52it/s]
 91%|█████████ | 337520/371472 [4:41:18<2:35:15,  3.64it/s]
                                                           
{'loss': 2.6452, 'learning_rate': 1.8230300157297074e-07, 'epoch': 14.54}

 91%|█████████ | 337520/371472 [4:41:18<2:35:15,  3.64it/s]
 91%|█████████ | 337521/371472 [4:41:19<2:30:28,  3.76it/s]
 91%|█████████ | 337522/371472 [4:41:19<2:30:19,  3.76it/s]
 91%|█████████ | 337523/371472 [4:41:19<2:35:58,  3.63it/s]
 91%|█████████ | 337524/371472 [4:41:19<2:31:31,  3.73it/s]
 91%|█████████ | 337525/371472 [4:41:20<2:32:33,  3.71it/s]
 91%|█████████ | 337526/371472 [4:41:20<2:33:10,  3.69it/s]
 91%|█████████ | 337527/371472 [4:41:20<2:39:39,  3.54it/s]
 91%|█████████ | 337528/371472 [4:41:20<2:33:00,  3.70it/s]
 91%|█████████ | 337529/371472 [4:41:21<3:06:12,  3.04it/s]
 91%|█████████ | 337530/371472 [4:41:21<2:59:14,  3.16it/s]
 91%|█████████ | 337531/371472 [4:41:21<2:47:18,  3.38it/s]
 91%|█████████ | 337532/371472 [4:41:22<2:38:28,  3.57it/s]
 91%|█████████ | 337533/371472 [4:41:22<2:42:50,  3.47it/s]
 91%|█████████ | 337534/371472 [4:41:23<4:03:06,  2.33it/s]
 91%|█████████ | 337535/371472 [4:41:23<3:35:11,  2.63it/s]
 91%|█████████ | 337536/371472 [4:41:23<3:11:32,  2.95it/s]
 91%|█████████ | 337537/371472 [4:41:24<2:57:58,  3.18it/s]
 91%|█████████ | 337538/371472 [4:41:24<2:55:37,  3.22it/s]
 91%|█████████ | 337539/371472 [4:41:24<2:44:40,  3.43it/s]
 91%|█████████ | 337540/371472 [4:41:24<2:36:04,  3.62it/s]
                                                           
{'loss': 2.5718, 'learning_rate': 1.822545195974918e-07, 'epoch': 14.54}

 91%|█████████ | 337540/371472 [4:41:24<2:36:04,  3.62it/s]
 91%|█████████ | 337541/371472 [4:41:25<2:35:53,  3.63it/s]
 91%|█████████ | 337542/371472 [4:41:25<2:33:30,  3.68it/s]
 91%|█████████ | 337543/371472 [4:41:25<2:28:21,  3.81it/s]
 91%|█████████ | 337544/371472 [4:41:25<2:28:46,  3.80it/s]
 91%|█████████ | 337545/371472 [4:41:26<2:25:43,  3.88it/s]
 91%|█████████ | 337546/371472 [4:41:26<2:26:08,  3.87it/s]
 91%|█████████ | 337547/371472 [4:41:26<2:27:32,  3.83it/s]
 91%|█████████ | 337548/371472 [4:41:26<2:32:33,  3.71it/s]
 91%|█████████ | 337549/371472 [4:41:27<2:32:24,  3.71it/s]
 91%|█████████ | 337550/371472 [4:41:27<2:32:02,  3.72it/s]
 91%|█████████ | 337551/371472 [4:41:27<2:27:42,  3.83it/s]
 91%|█████████ | 337552/371472 [4:41:27<2:27:23,  3.84it/s]
 91%|█████████ | 337553/371472 [4:41:28<2:29:36,  3.78it/s]
 91%|█████████ | 337554/371472 [4:41:28<2:32:22,  3.71it/s]
 91%|█████████ | 337555/371472 [4:41:28<2:28:14,  3.81it/s]
 91%|█████████ | 337556/371472 [4:41:29<2:26:36,  3.86it/s]
 91%|█████████ | 337557/371472 [4:41:29<2:36:41,  3.61it/s]
 91%|█████████ | 337558/371472 [4:41:29<2:32:46,  3.70it/s]
 91%|█████████ | 337559/371472 [4:41:29<2:29:53,  3.77it/s]
 91%|█████████ | 337560/371472 [4:41:30<2:28:27,  3.81it/s]
                                                           
{'loss': 2.7629, 'learning_rate': 1.82206037622013e-07, 'epoch': 14.54}

 91%|█████████ | 337560/371472 [4:41:30<2:28:27,  3.81it/s]
 91%|█████████ | 337561/371472 [4:41:30<2:25:22,  3.89it/s]
 91%|█████████ | 337562/371472 [4:41:30<2:25:51,  3.87it/s]
 91%|█████████ | 337563/371472 [4:41:30<2:32:13,  3.71it/s]
 91%|█████████ | 337564/371472 [4:41:31<2:27:28,  3.83it/s]
 91%|█████████ | 337565/371472 [4:41:31<2:32:21,  3.71it/s]
 91%|█████████ | 337566/371472 [4:41:31<2:45:37,  3.41it/s]
 91%|█████████ | 337567/371472 [4:41:32<2:40:59,  3.51it/s]
 91%|█████████ | 337568/371472 [4:41:32<2:33:59,  3.67it/s]
 91%|█████████ | 337569/371472 [4:41:32<2:28:52,  3.80it/s]
 91%|█████████ | 337570/371472 [4:41:32<2:32:47,  3.70it/s]
 91%|█████████ | 337571/371472 [4:41:33<2:32:35,  3.70it/s]
 91%|█████████ | 337572/371472 [4:41:33<2:27:12,  3.84it/s]
 91%|█████████ | 337573/371472 [4:41:33<2:34:53,  3.65it/s]
 91%|█████████ | 337574/371472 [4:41:33<2:37:00,  3.60it/s]
 91%|█████████ | 337575/371472 [4:41:34<2:42:09,  3.48it/s]
 91%|█████████ | 337576/371472 [4:41:34<2:37:42,  3.58it/s]
 91%|█████████ | 337577/371472 [4:41:34<2:36:30,  3.61it/s]
 91%|█████████ | 337578/371472 [4:41:35<2:40:35,  3.52it/s]
 91%|█████████ | 337579/371472 [4:41:35<2:39:35,  3.54it/s]
 91%|█████████ | 337580/371472 [4:41:35<2:41:05,  3.51it/s]
                                                           
{'loss': 2.5936, 'learning_rate': 1.8215755564653404e-07, 'epoch': 14.54}

 91%|█████████ | 337580/371472 [4:41:35<2:41:05,  3.51it/s]
 91%|█████████ | 337581/371472 [4:41:35<2:45:01,  3.42it/s]
 91%|█████████ | 337582/371472 [4:41:36<2:46:04,  3.40it/s]
 91%|█████████ | 337583/371472 [4:41:36<2:46:56,  3.38it/s]
 91%|█████████ | 337584/371472 [4:41:36<2:45:00,  3.42it/s]
 91%|█████████ | 337585/371472 [4:41:37<2:47:06,  3.38it/s]
 91%|█████████ | 337586/371472 [4:41:37<2:46:16,  3.40it/s]
 91%|█████████ | 337587/371472 [4:41:37<2:48:59,  3.34it/s]
 91%|█████████ | 337588/371472 [4:41:38<2:44:49,  3.43it/s]
 91%|█████████ | 337589/371472 [4:41:38<2:42:25,  3.48it/s]
 91%|█████████ | 337590/371472 [4:41:38<2:37:34,  3.58it/s]
 91%|█████████ | 337591/371472 [4:41:38<2:33:51,  3.67it/s]
 91%|█████████ | 337592/371472 [4:41:39<2:32:15,  3.71it/s]
 91%|█████████ | 337593/371472 [4:41:39<2:43:39,  3.45it/s]
 91%|█████████ | 337594/371472 [4:41:39<2:46:32,  3.39it/s]
 91%|█████████ | 337595/371472 [4:41:40<2:48:28,  3.35it/s]
 91%|█████████ | 337596/371472 [4:41:40<2:40:36,  3.52it/s]
 91%|█████████ | 337597/371472 [4:41:40<2:43:38,  3.45it/s]
 91%|█████████ | 337598/371472 [4:41:40<2:50:57,  3.30it/s]
 91%|█████████ | 337599/371472 [4:41:41<2:49:29,  3.33it/s]
 91%|█████████ | 337600/371472 [4:41:41<2:39:21,  3.54it/s]
                                                           
{'loss': 2.5221, 'learning_rate': 1.821090736710552e-07, 'epoch': 14.54}

 91%|█████████ | 337600/371472 [4:41:41<2:39:21,  3.54it/s]
 91%|█████████ | 337601/371472 [4:41:41<2:36:34,  3.61it/s]
 91%|█████████ | 337602/371472 [4:41:41<2:32:55,  3.69it/s]
 91%|█████████ | 337603/371472 [4:41:42<2:42:40,  3.47it/s]
 91%|█████████ | 337604/371472 [4:41:42<2:50:47,  3.31it/s]
 91%|█████████ | 337605/371472 [4:41:42<2:48:19,  3.35it/s]
 91%|█████████ | 337606/371472 [4:41:43<2:45:26,  3.41it/s]
 91%|█████████ | 337607/371472 [4:41:43<2:53:10,  3.26it/s]
 91%|█████████ | 337608/371472 [4:41:43<2:44:06,  3.44it/s]
 91%|█████████ | 337609/371472 [4:41:44<2:49:34,  3.33it/s]
 91%|█████████ | 337610/371472 [4:41:44<2:40:33,  3.52it/s]
 91%|█████████ | 337611/371472 [4:41:44<2:36:02,  3.62it/s]
 91%|█████████ | 337612/371472 [4:41:44<2:34:31,  3.65it/s]
 91%|█████████ | 337613/371472 [4:41:45<2:27:53,  3.82it/s]
 91%|█████████ | 337614/371472 [4:41:45<2:26:30,  3.85it/s]
 91%|█████████ | 337615/371472 [4:41:45<2:30:23,  3.75it/s]
 91%|█████████ | 337616/371472 [4:41:45<2:30:37,  3.75it/s]
 91%|█████████ | 337617/371472 [4:41:46<2:47:43,  3.36it/s]
 91%|█████████ | 337618/371472 [4:41:46<2:53:41,  3.25it/s]
 91%|█████████ | 337619/371472 [4:41:46<2:51:48,  3.28it/s]
 91%|█████████ | 337620/371472 [4:41:47<2:47:20,  3.37it/s]
                                                           
{'loss': 2.7465, 'learning_rate': 1.8206059169557626e-07, 'epoch': 14.54}

 91%|█████████ | 337620/371472 [4:41:47<2:47:20,  3.37it/s]
 91%|█████████ | 337621/371472 [4:41:47<2:43:27,  3.45it/s]
 91%|█████████ | 337622/371472 [4:41:47<2:35:55,  3.62it/s]
 91%|█████████ | 337623/371472 [4:41:48<2:42:28,  3.47it/s]
 91%|█████████ | 337624/371472 [4:41:48<2:40:43,  3.51it/s]
 91%|█████████ | 337625/371472 [4:41:48<2:36:25,  3.61it/s]
 91%|█████████ | 337626/371472 [4:41:48<2:32:50,  3.69it/s]
 91%|█████████ | 337627/371472 [4:41:49<2:31:43,  3.72it/s]
 91%|█████████ | 337628/371472 [4:41:49<2:44:22,  3.43it/s]
 91%|█████████ | 337629/371472 [4:41:49<2:38:23,  3.56it/s]
 91%|█████████ | 337630/371472 [4:41:49<2:34:33,  3.65it/s]
 91%|█████████ | 337631/371472 [4:41:50<2:36:17,  3.61it/s]
 91%|█████████ | 337632/371472 [4:41:50<2:45:58,  3.40it/s]
 91%|█████████ | 337633/371472 [4:41:50<2:37:44,  3.58it/s]
 91%|█████████ | 337634/371472 [4:41:51<2:33:26,  3.68it/s]
 91%|█████████ | 337635/371472 [4:41:51<2:31:58,  3.71it/s]
 91%|█████████ | 337636/371472 [4:41:51<2:32:23,  3.70it/s]
 91%|█████████ | 337637/371472 [4:41:51<2:32:22,  3.70it/s]
 91%|█████████ | 337638/371472 [4:41:52<2:38:56,  3.55it/s]
 91%|█████████ | 337639/371472 [4:41:52<2:33:40,  3.67it/s]
 91%|█████████ | 337640/371472 [4:41:52<2:34:22,  3.65it/s]
                                                           
{'loss': 2.7285, 'learning_rate': 1.820121097200974e-07, 'epoch': 14.54}

 91%|█████████ | 337640/371472 [4:41:52<2:34:22,  3.65it/s]
 91%|█████████ | 337641/371472 [4:41:53<2:37:49,  3.57it/s]
 91%|█████████ | 337642/371472 [4:41:53<2:38:31,  3.56it/s]
 91%|█████████ | 337643/371472 [4:41:53<2:38:05,  3.57it/s]
 91%|█████████ | 337644/371472 [4:41:53<2:34:45,  3.64it/s]
 91%|█████████ | 337645/371472 [4:41:54<2:31:27,  3.72it/s]
 91%|█████████ | 337646/371472 [4:41:54<2:42:07,  3.48it/s]
 91%|█████████ | 337647/371472 [4:41:54<2:49:16,  3.33it/s]
 91%|█████████ | 337648/371472 [4:41:55<2:45:39,  3.40it/s]
 91%|█████████ | 337649/371472 [4:41:55<2:39:52,  3.53it/s]
 91%|█████████ | 337650/371472 [4:41:55<2:36:24,  3.60it/s]
 91%|█████████ | 337651/371472 [4:41:55<2:33:39,  3.67it/s]
 91%|█████████ | 337652/371472 [4:41:56<2:35:08,  3.63it/s]
 91%|█████████ | 337653/371472 [4:41:56<2:32:59,  3.68it/s]
 91%|█████████ | 337654/371472 [4:41:56<2:39:34,  3.53it/s]
 91%|█████████ | 337655/371472 [4:41:56<2:46:13,  3.39it/s]
 91%|█████████ | 337656/371472 [4:41:57<2:44:14,  3.43it/s]
 91%|█████████ | 337657/371472 [4:41:57<2:37:33,  3.58it/s]
 91%|█████████ | 337658/371472 [4:41:57<2:44:00,  3.44it/s]
 91%|█████████ | 337659/371472 [4:41:58<2:38:15,  3.56it/s]
 91%|█████████ | 337660/371472 [4:41:58<2:42:00,  3.48it/s]
                                                           
{'loss': 2.6008, 'learning_rate': 1.8196362774461846e-07, 'epoch': 14.54}

 91%|█████████ | 337660/371472 [4:41:58<2:42:00,  3.48it/s]
 91%|█████████ | 337661/371472 [4:41:58<2:41:07,  3.50it/s]
 91%|█████████ | 337662/371472 [4:41:58<2:38:51,  3.55it/s]
 91%|█████████ | 337663/371472 [4:41:59<2:40:09,  3.52it/s]
 91%|█████████ | 337664/371472 [4:41:59<2:35:48,  3.62it/s]
 91%|█████████ | 337665/371472 [4:41:59<2:31:25,  3.72it/s]
 91%|█████████ | 337666/371472 [4:41:59<2:27:43,  3.81it/s]
 91%|█████████ | 337667/371472 [4:42:00<2:24:32,  3.90it/s]
 91%|█████████ | 337668/371472 [4:42:00<2:27:50,  3.81it/s]
 91%|█████████ | 337669/371472 [4:42:00<2:44:29,  3.42it/s]
 91%|█████████ | 337670/371472 [4:42:01<2:44:33,  3.42it/s]
 91%|█████████ | 337671/371472 [4:42:01<2:48:25,  3.34it/s]
 91%|█████████ | 337672/371472 [4:42:01<2:39:12,  3.54it/s]
 91%|█████████ | 337673/371472 [4:42:02<2:40:50,  3.50it/s]
 91%|█████████ | 337674/371472 [4:42:02<2:37:47,  3.57it/s]
 91%|█████████ | 337675/371472 [4:42:02<2:31:55,  3.71it/s]
 91%|█████████ | 337676/371472 [4:42:02<2:27:54,  3.81it/s]
 91%|█████████ | 337677/371472 [4:42:03<2:24:56,  3.89it/s]
 91%|█████████ | 337678/371472 [4:42:03<2:23:10,  3.93it/s]
 91%|█████████ | 337679/371472 [4:42:03<2:27:52,  3.81it/s]
 91%|█████████ | 337680/371472 [4:42:03<2:29:46,  3.76it/s]
                                                           
{'loss': 2.617, 'learning_rate': 1.8191514576913963e-07, 'epoch': 14.54}

 91%|█████████ | 337680/371472 [4:42:03<2:29:46,  3.76it/s]
 91%|█████████ | 337681/371472 [4:42:04<2:34:32,  3.64it/s]
 91%|█████████ | 337682/371472 [4:42:04<2:43:31,  3.44it/s]
 91%|█████████ | 337683/371472 [4:42:04<2:42:55,  3.46it/s]
 91%|█████████ | 337684/371472 [4:42:05<2:47:53,  3.35it/s]
 91%|█████████ | 337685/371472 [4:42:05<2:59:45,  3.13it/s]
 91%|█████████ | 337686/371472 [4:42:06<3:55:50,  2.39it/s]
 91%|█████████ | 337687/371472 [4:42:06<3:54:09,  2.40it/s]
 91%|█████████ | 337688/371472 [4:42:06<3:35:04,  2.62it/s]
 91%|█████████ | 337689/371472 [4:42:07<3:16:23,  2.87it/s]
 91%|█████████ | 337690/371472 [4:42:07<3:01:36,  3.10it/s]
 91%|█████████ | 337691/371472 [4:42:07<2:53:38,  3.24it/s]
 91%|█████████ | 337692/371472 [4:42:07<2:42:20,  3.47it/s]
 91%|█████████ | 337693/371472 [4:42:08<2:37:40,  3.57it/s]
 91%|█████████ | 337694/371472 [4:42:08<2:29:22,  3.77it/s]
 91%|█████████ | 337695/371472 [4:42:08<2:26:19,  3.85it/s]
 91%|█████████ | 337696/371472 [4:42:08<2:37:33,  3.57it/s]
 91%|█████████ | 337697/371472 [4:42:09<2:34:23,  3.65it/s]
 91%|█████████ | 337698/371472 [4:42:09<2:27:48,  3.81it/s]
 91%|█████████ | 337699/371472 [4:42:09<2:30:54,  3.73it/s]
 91%|█████████ | 337700/371472 [4:42:09<2:27:29,  3.82it/s]
                                                           
{'loss': 2.5139, 'learning_rate': 1.8186666379366068e-07, 'epoch': 14.55}

 91%|█████████ | 337700/371472 [4:42:09<2:27:29,  3.82it/s]
 91%|█████████ | 337701/371472 [4:42:10<2:28:09,  3.80it/s]
 91%|█████████ | 337702/371472 [4:42:10<2:25:23,  3.87it/s]
 91%|█████████ | 337703/371472 [4:42:10<2:28:51,  3.78it/s]
 91%|█████████ | 337704/371472 [4:42:11<2:32:23,  3.69it/s]
 91%|█████████ | 337705/371472 [4:42:11<2:39:49,  3.52it/s]
 91%|█████████ | 337706/371472 [4:42:11<2:47:55,  3.35it/s]
 91%|█████████ | 337707/371472 [4:42:11<2:54:08,  3.23it/s]
 91%|█████████ | 337708/371472 [4:42:12<2:56:56,  3.18it/s]
 91%|█████████ | 337709/371472 [4:42:12<2:47:54,  3.35it/s]
 91%|█████████ | 337710/371472 [4:42:12<2:39:16,  3.53it/s]
 91%|█████████ | 337711/371472 [4:42:13<2:35:14,  3.62it/s]
 91%|█████████ | 337712/371472 [4:42:13<2:54:54,  3.22it/s]
 91%|█████████ | 337713/371472 [4:42:13<2:52:43,  3.26it/s]
 91%|█████████ | 337714/371472 [4:42:14<2:49:58,  3.31it/s]
 91%|█████████ | 337715/371472 [4:42:14<2:45:09,  3.41it/s]
 91%|█████████ | 337716/371472 [4:42:14<2:44:02,  3.43it/s]
 91%|█████████ | 337717/371472 [4:42:14<2:38:43,  3.54it/s]
 91%|█████████ | 337718/371472 [4:42:15<2:38:46,  3.54it/s]
 91%|█████████ | 337719/371472 [4:42:15<2:32:26,  3.69it/s]
 91%|█████████ | 337720/371472 [4:42:15<2:28:16,  3.79it/s]
                                                           
{'loss': 2.7798, 'learning_rate': 1.8181818181818186e-07, 'epoch': 14.55}

 91%|█████████ | 337720/371472 [4:42:15<2:28:16,  3.79it/s]
 91%|█████████ | 337721/371472 [4:42:15<2:25:45,  3.86it/s]
 91%|█████████ | 337722/371472 [4:42:16<2:33:56,  3.65it/s]
 91%|█████████ | 337723/371472 [4:42:16<2:32:43,  3.68it/s]
 91%|█████████ | 337724/371472 [4:42:16<2:37:45,  3.57it/s]
 91%|█████████ | 337725/371472 [4:42:17<2:34:33,  3.64it/s]
 91%|█████████ | 337726/371472 [4:42:17<2:38:16,  3.55it/s]
 91%|█████████ | 337727/371472 [4:42:17<2:39:35,  3.52it/s]
 91%|█████████ | 337728/371472 [4:42:17<2:35:37,  3.61it/s]
 91%|█████████ | 337729/371472 [4:42:18<2:47:26,  3.36it/s]
 91%|█████████ | 337730/371472 [4:42:18<2:41:56,  3.47it/s]
 91%|█████████ | 337731/371472 [4:42:18<2:51:00,  3.29it/s]
 91%|█████████ | 337732/371472 [4:42:19<2:45:20,  3.40it/s]
 91%|█████████ | 337733/371472 [4:42:19<2:40:37,  3.50it/s]
 91%|█████████ | 337734/371472 [4:42:19<2:36:24,  3.59it/s]
 91%|█████████ | 337735/371472 [4:42:19<2:32:51,  3.68it/s]
 91%|█████████ | 337736/371472 [4:42:20<2:37:55,  3.56it/s]
 91%|█████████ | 337737/371472 [4:42:20<2:36:51,  3.58it/s]
 91%|█████████ | 337738/371472 [4:42:20<2:40:20,  3.51it/s]
 91%|█████████ | 337739/371472 [4:42:21<2:40:03,  3.51it/s]
 91%|█████████ | 337740/371472 [4:42:21<2:35:09,  3.62it/s]
                                                           
{'loss': 2.5051, 'learning_rate': 1.817696998427029e-07, 'epoch': 14.55}

 91%|█████████ | 337740/371472 [4:42:21<2:35:09,  3.62it/s]
 91%|█████████ | 337741/371472 [4:42:21<2:43:11,  3.44it/s]
 91%|█████████ | 337742/371472 [4:42:21<2:41:01,  3.49it/s]
 91%|█████████ | 337743/371472 [4:42:22<2:46:10,  3.38it/s]
 91%|█████████ | 337744/371472 [4:42:22<2:47:42,  3.35it/s]
 91%|█████████ | 337745/371472 [4:42:22<2:42:49,  3.45it/s]
 91%|█████████ | 337746/371472 [4:42:23<2:49:12,  3.32it/s]
 91%|█████████ | 337747/371472 [4:42:23<2:44:39,  3.41it/s]
 91%|█████████ | 337748/371472 [4:42:23<2:37:24,  3.57it/s]
 91%|█████████ | 337749/371472 [4:42:24<2:49:03,  3.32it/s]
 91%|█████████ | 337750/371472 [4:42:24<2:44:48,  3.41it/s]
 91%|█████████ | 337751/371472 [4:42:24<2:50:59,  3.29it/s]
 91%|█████████ | 337752/371472 [4:42:24<2:42:37,  3.46it/s]
 91%|█████████ | 337753/371472 [4:42:25<2:40:36,  3.50it/s]
 91%|█████████ | 337754/371472 [4:42:25<2:40:17,  3.51it/s]
 91%|█████████ | 337755/371472 [4:42:25<2:37:19,  3.57it/s]
 91%|█████████ | 337756/371472 [4:42:25<2:39:49,  3.52it/s]
 91%|█████████ | 337757/371472 [4:42:26<2:35:52,  3.60it/s]
 91%|█████████ | 337758/371472 [4:42:26<2:38:50,  3.54it/s]
 91%|█████████ | 337759/371472 [4:42:26<2:41:00,  3.49it/s]
 91%|█████████ | 337760/371472 [4:42:27<2:39:38,  3.52it/s]
                                                           
{'loss': 2.6823, 'learning_rate': 1.8172121786722405e-07, 'epoch': 14.55}

 91%|█████████ | 337760/371472 [4:42:27<2:39:38,  3.52it/s]
 91%|█████████ | 337761/371472 [4:42:27<2:34:58,  3.63it/s]
 91%|█████████ | 337762/371472 [4:42:27<2:37:51,  3.56it/s]
 91%|█████████ | 337763/371472 [4:42:28<3:06:48,  3.01it/s]
 91%|█████████ | 337764/371472 [4:42:28<2:54:39,  3.22it/s]
 91%|█████████ | 337765/371472 [4:42:28<2:47:03,  3.36it/s]
 91%|█████████ | 337766/371472 [4:42:28<2:49:54,  3.31it/s]
 91%|█████████ | 337767/371472 [4:42:29<2:54:02,  3.23it/s]
 91%|█████████ | 337768/371472 [4:42:29<3:00:31,  3.11it/s]
 91%|█████████ | 337769/371472 [4:42:29<2:56:44,  3.18it/s]
 91%|█████████ | 337770/371472 [4:42:30<2:54:56,  3.21it/s]
 91%|█████████ | 337771/371472 [4:42:30<2:47:53,  3.35it/s]
 91%|█████████ | 337772/371472 [4:42:30<2:37:44,  3.56it/s]
 91%|█████████ | 337773/371472 [4:42:31<2:41:57,  3.47it/s]
 91%|█████████ | 337774/371472 [4:42:31<2:35:01,  3.62it/s]
 91%|█████████ | 337775/371472 [4:42:31<2:32:57,  3.67it/s]
 91%|█████████ | 337776/371472 [4:42:31<2:40:39,  3.50it/s]
 91%|█████████ | 337777/371472 [4:42:32<2:33:24,  3.66it/s]
 91%|█████████ | 337778/371472 [4:42:32<2:30:40,  3.73it/s]
 91%|█████████ | 337779/371472 [4:42:32<2:34:05,  3.64it/s]
 91%|█████████ | 337780/371472 [4:42:32<2:30:07,  3.74it/s]
                                                           
{'loss': 2.4576, 'learning_rate': 1.816727358917451e-07, 'epoch': 14.55}

 91%|█████████ | 337780/371472 [4:42:32<2:30:07,  3.74it/s]
 91%|█████████ | 337781/371472 [4:42:33<2:33:38,  3.65it/s]
 91%|█████████ | 337782/371472 [4:42:33<2:46:50,  3.37it/s]
 91%|█████████ | 337783/371472 [4:42:33<2:39:00,  3.53it/s]
 91%|█████████ | 337784/371472 [4:42:34<2:35:45,  3.60it/s]
 91%|█████████ | 337785/371472 [4:42:34<2:49:04,  3.32it/s]
 91%|█████████ | 337786/371472 [4:42:34<2:48:13,  3.34it/s]
 91%|█████████ | 337787/371472 [4:42:34<2:41:50,  3.47it/s]
 91%|█████████ | 337788/371472 [4:42:35<2:36:12,  3.59it/s]
 91%|█████████ | 337789/371472 [4:42:35<2:32:38,  3.68it/s]
 91%|█████████ | 337790/371472 [4:42:35<2:33:36,  3.65it/s]
 91%|█████████ | 337791/371472 [4:42:36<2:31:44,  3.70it/s]
 91%|█████████ | 337792/371472 [4:42:36<2:35:42,  3.61it/s]
 91%|█████████ | 337793/371472 [4:42:36<2:37:39,  3.56it/s]
 91%|█████████ | 337794/371472 [4:42:36<2:34:05,  3.64it/s]
 91%|█████████ | 337795/371472 [4:42:37<2:31:30,  3.70it/s]
 91%|█████████ | 337796/371472 [4:42:37<2:40:25,  3.50it/s]
 91%|█████████ | 337797/371472 [4:42:37<2:39:09,  3.53it/s]
 91%|█████████ | 337798/371472 [4:42:38<2:44:59,  3.40it/s]
 91%|█████████ | 337799/371472 [4:42:38<2:39:32,  3.52it/s]
 91%|█████████ | 337800/371472 [4:42:38<2:34:18,  3.64it/s]
                                                           
{'loss': 2.6677, 'learning_rate': 1.8162425391626627e-07, 'epoch': 14.55}

 91%|█████████ | 337800/371472 [4:42:38<2:34:18,  3.64it/s]
 91%|█████████ | 337801/371472 [4:42:38<2:31:11,  3.71it/s]
 91%|█████████ | 337802/371472 [4:42:39<2:27:13,  3.81it/s]
 91%|█████████ | 337803/371472 [4:42:39<2:37:06,  3.57it/s]
 91%|█████████ | 337804/371472 [4:42:39<2:34:02,  3.64it/s]
 91%|█████████ | 337805/371472 [4:42:39<2:35:03,  3.62it/s]
 91%|█████████ | 337806/371472 [4:42:40<2:37:05,  3.57it/s]
 91%|█████████ | 337807/371472 [4:42:40<2:33:52,  3.65it/s]
 91%|█████████ | 337808/371472 [4:42:40<2:33:14,  3.66it/s]
 91%|█████████ | 337809/371472 [4:42:41<2:34:54,  3.62it/s]
 91%|█████████ | 337810/371472 [4:42:41<2:32:25,  3.68it/s]
 91%|█████████ | 337811/371472 [4:42:41<2:50:20,  3.29it/s]
 91%|█████████ | 337812/371472 [4:42:41<2:42:14,  3.46it/s]
 91%|█████████ | 337813/371472 [4:42:42<2:39:32,  3.52it/s]
 91%|█████████ | 337814/371472 [4:42:42<2:45:10,  3.40it/s]
 91%|█████████ | 337815/371472 [4:42:42<2:35:40,  3.60it/s]
 91%|█████████ | 337816/371472 [4:42:43<2:32:14,  3.68it/s]
 91%|█████████ | 337817/371472 [4:42:43<2:28:37,  3.77it/s]
 91%|█████████ | 337818/371472 [4:42:43<2:30:38,  3.72it/s]
 91%|█████████ | 337819/371472 [4:42:43<2:27:37,  3.80it/s]
 91%|█████████ | 337820/371472 [4:42:44<2:31:28,  3.70it/s]
                                                           
{'loss': 2.4616, 'learning_rate': 1.8157577194078732e-07, 'epoch': 14.55}

 91%|█████████ | 337820/371472 [4:42:44<2:31:28,  3.70it/s]
 91%|█████████ | 337821/371472 [4:42:44<2:33:39,  3.65it/s]
 91%|█████████ | 337822/371472 [4:42:44<2:31:14,  3.71it/s]
 91%|█████████ | 337823/371472 [4:42:44<2:32:03,  3.69it/s]
 91%|█████████ | 337824/371472 [4:42:45<2:42:13,  3.46it/s]
 91%|█████████ | 337825/371472 [4:42:45<2:36:23,  3.59it/s]
 91%|█████████ | 337826/371472 [4:42:45<2:30:41,  3.72it/s]
 91%|█████████ | 337827/371472 [4:42:46<2:36:28,  3.58it/s]
 91%|█████████ | 337828/371472 [4:42:46<2:33:08,  3.66it/s]
 91%|█████████ | 337829/371472 [4:42:46<2:33:25,  3.65it/s]
 91%|█████████ | 337830/371472 [4:42:46<2:38:24,  3.54it/s]
 91%|█████████ | 337831/371472 [4:42:47<2:34:22,  3.63it/s]
 91%|█████████ | 337832/371472 [4:42:47<2:36:45,  3.58it/s]
 91%|█████████ | 337833/371472 [4:42:47<2:29:47,  3.74it/s]
 91%|█████████ | 337834/371472 [4:42:47<2:34:25,  3.63it/s]
 91%|█████████ | 337835/371472 [4:42:48<2:34:04,  3.64it/s]
 91%|█████████ | 337836/371472 [4:42:48<2:41:16,  3.48it/s]
 91%|█████████ | 337837/371472 [4:42:48<2:40:01,  3.50it/s]
 91%|█████████ | 337838/371472 [4:42:49<2:46:24,  3.37it/s]
 91%|█████████ | 337839/371472 [4:42:49<2:51:30,  3.27it/s]
 91%|█████████ | 337840/371472 [4:42:49<2:42:26,  3.45it/s]
                                                           
{'loss': 2.529, 'learning_rate': 1.8152728996530847e-07, 'epoch': 14.55}

 91%|█████████ | 337840/371472 [4:42:49<2:42:26,  3.45it/s]
 91%|█████████ | 337841/371472 [4:42:49<2:35:18,  3.61it/s]
 91%|█████████ | 337842/371472 [4:42:50<2:31:08,  3.71it/s]
 91%|█████████ | 337843/371472 [4:42:50<2:28:53,  3.76it/s]
 91%|█████████ | 337844/371472 [4:42:50<2:35:11,  3.61it/s]
 91%|█████████ | 337845/371472 [4:42:51<2:35:11,  3.61it/s]
 91%|█████████ | 337846/371472 [4:42:51<2:35:03,  3.61it/s]
 91%|█████████ | 337847/371472 [4:42:51<2:35:05,  3.61it/s]
 91%|█████████ | 337848/371472 [4:42:51<2:28:12,  3.78it/s]
 91%|█████████ | 337849/371472 [4:42:52<2:27:16,  3.80it/s]
 91%|█████████ | 337850/371472 [4:42:52<2:25:22,  3.85it/s]
 91%|█████████ | 337851/371472 [4:42:52<2:36:56,  3.57it/s]
 91%|█████████ | 337852/371472 [4:42:52<2:30:05,  3.73it/s]
 91%|█████████ | 337853/371472 [4:42:53<2:34:16,  3.63it/s]
 91%|█████████ | 337854/371472 [4:42:53<2:33:40,  3.65it/s]
 91%|█████████ | 337855/371472 [4:42:53<2:31:46,  3.69it/s]
 91%|█████████ | 337856/371472 [4:42:54<2:30:16,  3.73it/s]
 91%|█████████ | 337857/371472 [4:42:54<2:33:00,  3.66it/s]
 91%|█████████ | 337858/371472 [4:42:54<2:28:28,  3.77it/s]
 91%|█████████ | 337859/371472 [4:42:54<2:38:40,  3.53it/s]
 91%|█████████ | 337860/371472 [4:42:55<2:39:16,  3.52it/s]
                                                           
{'loss': 2.5993, 'learning_rate': 1.8147880798982954e-07, 'epoch': 14.55}

 91%|█████████ | 337860/371472 [4:42:55<2:39:16,  3.52it/s]
 91%|█████████ | 337861/371472 [4:42:55<2:48:56,  3.32it/s]
 91%|█████████ | 337862/371472 [4:42:55<2:46:31,  3.36it/s]
 91%|█████████ | 337863/371472 [4:42:56<2:41:46,  3.46it/s]
 91%|█████████ | 337864/371472 [4:42:56<2:36:35,  3.58it/s]
 91%|█████████ | 337865/371472 [4:42:56<2:39:08,  3.52it/s]
 91%|█████████ | 337866/371472 [4:42:56<2:34:02,  3.64it/s]
 91%|█████████ | 337867/371472 [4:42:57<2:30:34,  3.72it/s]
 91%|█████████ | 337868/371472 [4:42:57<2:30:18,  3.73it/s]
 91%|█████████ | 337869/371472 [4:42:57<2:26:52,  3.81it/s]
 91%|█████████ | 337870/371472 [4:42:57<2:33:12,  3.66it/s]
 91%|█████████ | 337871/371472 [4:42:58<2:41:38,  3.46it/s]
 91%|█████████ | 337872/371472 [4:42:58<2:40:39,  3.49it/s]
 91%|█████████ | 337873/371472 [4:42:58<2:33:53,  3.64it/s]
 91%|█████████ | 337874/371472 [4:42:59<2:32:22,  3.67it/s]
 91%|█████████ | 337875/371472 [4:42:59<2:25:14,  3.86it/s]
 91%|█████████ | 337876/371472 [4:42:59<2:24:33,  3.87it/s]
 91%|█████████ | 337877/371472 [4:42:59<2:24:21,  3.88it/s]
 91%|█████████ | 337878/371472 [4:43:00<2:40:46,  3.48it/s]
 91%|█████████ | 337879/371472 [4:43:00<2:40:36,  3.49it/s]
 91%|█████████ | 337880/371472 [4:43:00<2:38:46,  3.53it/s]
                                                           
{'loss': 2.7066, 'learning_rate': 1.814303260143507e-07, 'epoch': 14.55}

 91%|█████████ | 337880/371472 [4:43:00<2:38:46,  3.53it/s]
 91%|█████████ | 337881/371472 [4:43:00<2:35:12,  3.61it/s]
 91%|█████████ | 337882/371472 [4:43:01<2:32:12,  3.68it/s]
 91%|█████████ | 337883/371472 [4:43:01<2:36:01,  3.59it/s]
 91%|█████████ | 337884/371472 [4:43:01<2:47:22,  3.34it/s]
 91%|█████████ | 337885/371472 [4:43:02<2:40:35,  3.49it/s]
 91%|█████████ | 337886/371472 [4:43:02<2:39:49,  3.50it/s]
 91%|█████████ | 337887/371472 [4:43:02<2:39:58,  3.50it/s]
 91%|█████████ | 337888/371472 [4:43:02<2:35:56,  3.59it/s]
 91%|█████████ | 337889/371472 [4:43:03<2:36:44,  3.57it/s]
 91%|█████████ | 337890/371472 [4:43:03<2:32:26,  3.67it/s]
 91%|█████████ | 337891/371472 [4:43:03<2:30:46,  3.71it/s]
 91%|█████████ | 337892/371472 [4:43:04<2:34:40,  3.62it/s]
 91%|█████████ | 337893/371472 [4:43:04<2:39:58,  3.50it/s]
 91%|█████████ | 337894/371472 [4:43:04<2:40:22,  3.49it/s]
 91%|█████████ | 337895/371472 [4:43:04<2:36:53,  3.57it/s]
 91%|█████████ | 337896/371472 [4:43:05<2:37:30,  3.55it/s]
 91%|█████████ | 337897/371472 [4:43:05<2:47:59,  3.33it/s]
 91%|█████████ | 337898/371472 [4:43:06<3:12:24,  2.91it/s]
 91%|█████████ | 337899/371472 [4:43:06<3:02:24,  3.07it/s]
 91%|█████████ | 337900/371472 [4:43:06<2:55:45,  3.18it/s]
                                                           
{'loss': 2.5157, 'learning_rate': 1.8138184403887174e-07, 'epoch': 14.55}

 91%|█████████ | 337900/371472 [4:43:06<2:55:45,  3.18it/s]
 91%|█████████ | 337901/371472 [4:43:06<2:52:53,  3.24it/s]
 91%|█████████ | 337902/371472 [4:43:07<2:41:20,  3.47it/s]
 91%|█████████ | 337903/371472 [4:43:07<2:44:14,  3.41it/s]
 91%|█████████ | 337904/371472 [4:43:07<2:40:33,  3.48it/s]
 91%|█████████ | 337905/371472 [4:43:07<2:32:42,  3.66it/s]
 91%|█████████ | 337906/371472 [4:43:08<2:29:23,  3.74it/s]
 91%|█████████ | 337907/371472 [4:43:08<2:36:47,  3.57it/s]
 91%|█████████ | 337908/371472 [4:43:08<2:38:06,  3.54it/s]
 91%|█████████ | 337909/371472 [4:43:09<2:33:11,  3.65it/s]
 91%|█████████ | 337910/371472 [4:43:09<2:30:31,  3.72it/s]
 91%|█████████ | 337911/371472 [4:43:09<2:48:39,  3.32it/s]
 91%|█████████ | 337912/371472 [4:43:09<2:44:25,  3.40it/s]
 91%|█████████ | 337913/371472 [4:43:10<2:42:30,  3.44it/s]
 91%|█████████ | 337914/371472 [4:43:10<2:39:06,  3.52it/s]
 91%|█████████ | 337915/371472 [4:43:10<2:37:42,  3.55it/s]
 91%|█████████ | 337916/371472 [4:43:11<2:35:28,  3.60it/s]
 91%|█████████ | 337917/371472 [4:43:11<2:39:12,  3.51it/s]
 91%|█████████ | 337918/371472 [4:43:11<2:38:28,  3.53it/s]
 91%|█████████ | 337919/371472 [4:43:11<2:34:38,  3.62it/s]
 91%|█████████ | 337920/371472 [4:43:12<2:31:55,  3.68it/s]
                                                           
{'loss': 2.6327, 'learning_rate': 1.8133336206339291e-07, 'epoch': 14.55}

 91%|█████████ | 337920/371472 [4:43:12<2:31:55,  3.68it/s]
 91%|█████████ | 337921/371472 [4:43:12<2:32:07,  3.68it/s]
 91%|█████████ | 337922/371472 [4:43:12<2:36:19,  3.58it/s]
 91%|█████████ | 337923/371472 [4:43:12<2:33:08,  3.65it/s]
 91%|█████████ | 337924/371472 [4:43:13<2:28:26,  3.77it/s]
 91%|█████████ | 337925/371472 [4:43:13<2:38:45,  3.52it/s]
 91%|█████████ | 337926/371472 [4:43:13<2:35:24,  3.60it/s]
 91%|█████████ | 337927/371472 [4:43:14<2:32:46,  3.66it/s]
 91%|█████████ | 337928/371472 [4:43:14<2:32:24,  3.67it/s]
 91%|█████████ | 337929/371472 [4:43:14<2:34:38,  3.62it/s]
 91%|█████████ | 337930/371472 [4:43:14<2:36:36,  3.57it/s]
 91%|█████████ | 337931/371472 [4:43:15<2:32:27,  3.67it/s]
 91%|█████████ | 337932/371472 [4:43:15<2:34:24,  3.62it/s]
 91%|█████████ | 337933/371472 [4:43:15<2:34:32,  3.62it/s]
 91%|█████████ | 337934/371472 [4:43:16<2:35:33,  3.59it/s]
 91%|█████████ | 337935/371472 [4:43:16<2:38:04,  3.54it/s]
 91%|█████████ | 337936/371472 [4:43:16<2:47:25,  3.34it/s]
 91%|█████████ | 337937/371472 [4:43:16<2:41:55,  3.45it/s]
 91%|█████████ | 337938/371472 [4:43:17<2:49:18,  3.30it/s]
 91%|█████████ | 337939/371472 [4:43:17<2:46:08,  3.36it/s]
 91%|█████████ | 337940/371472 [4:43:17<2:35:39,  3.59it/s]
                                                           
{'loss': 2.5274, 'learning_rate': 1.8128488008791399e-07, 'epoch': 14.56}

 91%|█████████ | 337940/371472 [4:43:17<2:35:39,  3.59it/s]
 91%|█████████ | 337941/371472 [4:43:18<2:45:24,  3.38it/s]
 91%|█████████ | 337942/371472 [4:43:18<2:40:40,  3.48it/s]
 91%|█████████ | 337943/371472 [4:43:18<2:40:45,  3.48it/s]
 91%|█████████ | 337944/371472 [4:43:18<2:35:08,  3.60it/s]
 91%|█████████ | 337945/371472 [4:43:19<2:44:59,  3.39it/s]
 91%|█████████ | 337946/371472 [4:43:19<2:42:06,  3.45it/s]
 91%|█████████ | 337947/371472 [4:43:19<2:33:47,  3.63it/s]
 91%|█████████ | 337948/371472 [4:43:20<2:28:28,  3.76it/s]
 91%|█████████ | 337949/371472 [4:43:20<2:28:29,  3.76it/s]
 91%|█████████ | 337950/371472 [4:43:20<2:32:04,  3.67it/s]
 91%|█████████ | 337951/371472 [4:43:20<2:30:25,  3.71it/s]
 91%|█████████ | 337952/371472 [4:43:21<2:26:37,  3.81it/s]
 91%|█████████ | 337953/371472 [4:43:21<2:27:45,  3.78it/s]
 91%|█████████ | 337954/371472 [4:43:21<2:29:09,  3.75it/s]
 91%|█████████ | 337955/371472 [4:43:21<2:41:22,  3.46it/s]
 91%|█████████ | 337956/371472 [4:43:22<2:38:44,  3.52it/s]
 91%|█████████ | 337957/371472 [4:43:22<2:35:07,  3.60it/s]
 91%|█████████ | 337958/371472 [4:43:22<2:33:22,  3.64it/s]
 91%|█████████ | 337959/371472 [4:43:23<2:57:14,  3.15it/s]
 91%|█████████ | 337960/371472 [4:43:23<2:46:45,  3.35it/s]
                                                           
{'loss': 2.477, 'learning_rate': 1.812363981124351e-07, 'epoch': 14.56}

 91%|█████████ | 337960/371472 [4:43:23<2:46:45,  3.35it/s]
 91%|█████████ | 337961/371472 [4:43:23<2:43:20,  3.42it/s]
 91%|█████████ | 337962/371472 [4:43:23<2:40:05,  3.49it/s]
 91%|█████████ | 337963/371472 [4:43:24<2:34:45,  3.61it/s]
 91%|█████████ | 337964/371472 [4:43:24<2:35:16,  3.60it/s]
 91%|█████████ | 337965/371472 [4:43:24<2:36:55,  3.56it/s]
 91%|█████████ | 337966/371472 [4:43:25<2:38:52,  3.51it/s]
 91%|█████████ | 337967/371472 [4:43:25<2:31:57,  3.67it/s]
 91%|█████████ | 337968/371472 [4:43:25<2:40:30,  3.48it/s]
 91%|█████████ | 337969/371472 [4:43:26<2:47:59,  3.32it/s]
 91%|█████████ | 337970/371472 [4:43:26<2:46:42,  3.35it/s]
 91%|█████████ | 337971/371472 [4:43:26<2:43:38,  3.41it/s]
 91%|█████████ | 337972/371472 [4:43:26<2:49:48,  3.29it/s]
 91%|█████████ | 337973/371472 [4:43:27<2:42:47,  3.43it/s]
 91%|█████████ | 337974/371472 [4:43:27<2:46:08,  3.36it/s]
 91%|█████████ | 337975/371472 [4:43:27<2:46:31,  3.35it/s]
 91%|█████████ | 337976/371472 [4:43:28<2:44:41,  3.39it/s]
 91%|█████████ | 337977/371472 [4:43:28<2:57:44,  3.14it/s]
 91%|█████████ | 337978/371472 [4:43:28<2:58:38,  3.12it/s]
 91%|█████████ | 337979/371472 [4:43:29<2:58:10,  3.13it/s]
 91%|█████████ | 337980/371472 [4:43:29<2:50:02,  3.28it/s]
                                                           
{'loss': 2.5406, 'learning_rate': 1.8118791613695618e-07, 'epoch': 14.56}

 91%|█████████ | 337980/371472 [4:43:29<2:50:02,  3.28it/s]
 91%|█████████ | 337981/371472 [4:43:29<2:44:42,  3.39it/s]
 91%|█████████ | 337982/371472 [4:43:29<2:45:53,  3.36it/s]
 91%|█████████ | 337983/371472 [4:43:30<2:41:27,  3.46it/s]
 91%|█████████ | 337984/371472 [4:43:30<2:47:38,  3.33it/s]
 91%|█████████ | 337985/371472 [4:43:30<2:46:48,  3.35it/s]
 91%|█████████ | 337986/371472 [4:43:31<2:40:31,  3.48it/s]
 91%|█████████ | 337987/371472 [4:43:31<2:49:08,  3.30it/s]
 91%|█████████ | 337988/371472 [4:43:31<2:45:09,  3.38it/s]
 91%|█████████ | 337989/371472 [4:43:31<2:42:42,  3.43it/s]
 91%|█████████ | 337990/371472 [4:43:32<2:36:57,  3.56it/s]
 91%|█████████ | 337991/371472 [4:43:32<2:30:01,  3.72it/s]
 91%|█████████ | 337992/371472 [4:43:32<2:26:57,  3.80it/s]
 91%|█████████ | 337993/371472 [4:43:33<2:34:34,  3.61it/s]
 91%|█████████ | 337994/371472 [4:43:33<2:48:10,  3.32it/s]
 91%|█████████ | 337995/371472 [4:43:33<2:43:45,  3.41it/s]
 91%|█████████ | 337996/371472 [4:43:33<2:44:39,  3.39it/s]
 91%|█████████ | 337997/371472 [4:43:34<2:43:20,  3.42it/s]
 91%|█████████ | 337998/371472 [4:43:34<2:38:20,  3.52it/s]
 91%|█████████ | 337999/371472 [4:43:34<2:33:10,  3.64it/s]
 91%|█████████ | 338000/371472 [4:43:35<2:31:44,  3.68it/s]
                                                           
{'loss': 2.6239, 'learning_rate': 1.8113943416147725e-07, 'epoch': 14.56}

 91%|█████████ | 338000/371472 [4:43:35<2:31:44,  3.68it/s]
 91%|█████████ | 338001/371472 [4:43:35<2:34:52,  3.60it/s]
 91%|█████████ | 338002/371472 [4:43:35<2:34:59,  3.60it/s]
 91%|█████████ | 338003/371472 [4:43:35<2:31:01,  3.69it/s]
 91%|█████████ | 338004/371472 [4:43:36<2:33:20,  3.64it/s]
 91%|█████████ | 338005/371472 [4:43:36<2:42:42,  3.43it/s]
 91%|█████████ | 338006/371472 [4:43:36<2:43:51,  3.40it/s]
 91%|█████████ | 338007/371472 [4:43:37<2:47:59,  3.32it/s]
 91%|█████████ | 338008/371472 [4:43:37<2:53:32,  3.21it/s]
 91%|█████████ | 338009/371472 [4:43:37<2:52:46,  3.23it/s]
 91%|█████████ | 338010/371472 [4:43:38<2:54:37,  3.19it/s]
 91%|█████████ | 338011/371472 [4:43:38<2:57:47,  3.14it/s]
 91%|█████████ | 338012/371472 [4:43:38<2:51:17,  3.26it/s]
 91%|█████████ | 338013/371472 [4:43:38<2:42:14,  3.44it/s]
 91%|█████████ | 338014/371472 [4:43:39<2:38:54,  3.51it/s]
 91%|█████████ | 338015/371472 [4:43:39<2:37:09,  3.55it/s]
 91%|█████████ | 338016/371472 [4:43:39<2:32:34,  3.65it/s]
 91%|█████████ | 338017/371472 [4:43:39<2:32:38,  3.65it/s]
 91%|█████████ | 338018/371472 [4:43:40<2:36:07,  3.57it/s]
 91%|█████████ | 338019/371472 [4:43:40<2:39:01,  3.51it/s]
 91%|█████████ | 338020/371472 [4:43:40<2:33:47,  3.63it/s]
                                                           
{'loss': 2.4821, 'learning_rate': 1.810909521859984e-07, 'epoch': 14.56}

 91%|█████████ | 338020/371472 [4:43:40<2:33:47,  3.63it/s]
 91%|█████████ | 338021/371472 [4:43:41<2:33:24,  3.63it/s]
 91%|█████████ | 338022/371472 [4:43:41<2:32:24,  3.66it/s]
 91%|█████████ | 338023/371472 [4:43:41<2:35:09,  3.59it/s]
 91%|█████████ | 338024/371472 [4:43:41<2:33:46,  3.63it/s]
 91%|█████████ | 338025/371472 [4:43:42<2:40:28,  3.47it/s]
 91%|█████████ | 338026/371472 [4:43:42<2:33:12,  3.64it/s]
 91%|█████████ | 338027/371472 [4:43:42<2:35:41,  3.58it/s]
 91%|█████████ | 338028/371472 [4:43:43<2:38:47,  3.51it/s]
 91%|█████████ | 338029/371472 [4:43:43<2:40:11,  3.48it/s]
 91%|█████████ | 338030/371472 [4:43:43<2:37:03,  3.55it/s]
 91%|█████████ | 338031/371472 [4:43:43<2:31:24,  3.68it/s]
 91%|█████████ | 338032/371472 [4:43:44<2:32:56,  3.64it/s]
 91%|█████████ | 338033/371472 [4:43:44<2:38:20,  3.52it/s]
 91%|█████████ | 338034/371472 [4:43:44<2:57:24,  3.14it/s]
 91%|█████████ | 338035/371472 [4:43:45<2:58:38,  3.12it/s]
 91%|█████████ | 338036/371472 [4:43:45<2:53:20,  3.21it/s]
 91%|█████████ | 338037/371472 [4:43:45<2:45:15,  3.37it/s]
 91%|█████████ | 338038/371472 [4:43:46<2:43:42,  3.40it/s]
 91%|█████████ | 338039/371472 [4:43:46<2:38:16,  3.52it/s]
 91%|█████████ | 338040/371472 [4:43:46<2:45:14,  3.37it/s]
                                                           
{'loss': 2.6172, 'learning_rate': 1.8104247021051945e-07, 'epoch': 14.56}

 91%|█████████ | 338040/371472 [4:43:46<2:45:14,  3.37it/s]
 91%|█████████ | 338041/371472 [4:43:46<2:43:18,  3.41it/s]
 91%|█████████ | 338042/371472 [4:43:47<2:45:56,  3.36it/s]
 91%|█████████ | 338043/371472 [4:43:47<2:47:10,  3.33it/s]
 91%|█████████ | 338044/371472 [4:43:47<2:39:37,  3.49it/s]
 91%|█████████ | 338045/371472 [4:43:48<2:36:06,  3.57it/s]
 91%|█████████ | 338046/371472 [4:43:48<2:45:47,  3.36it/s]
 91%|█████████ | 338047/371472 [4:43:48<2:39:43,  3.49it/s]
 91%|█████████ | 338048/371472 [4:43:48<2:39:10,  3.50it/s]
 91%|█████████ | 338049/371472 [4:43:49<2:36:29,  3.56it/s]
 91%|█████████ | 338050/371472 [4:43:49<2:35:40,  3.58it/s]
 91%|█████████ | 338051/371472 [4:43:49<2:32:55,  3.64it/s]
 91%|█████████ | 338052/371472 [4:43:50<2:30:42,  3.70it/s]
 91%|█████████ | 338053/371472 [4:43:50<2:38:53,  3.51it/s]
 91%|█████████ | 338054/371472 [4:43:50<2:59:04,  3.11it/s]
 91%|█████████ | 338055/371472 [4:43:51<3:16:18,  2.84it/s]
 91%|█████████ | 338056/371472 [4:43:51<3:02:48,  3.05it/s]
 91%|█████████ | 338057/371472 [4:43:51<2:52:20,  3.23it/s]
 91%|█████████ | 338058/371472 [4:43:51<2:47:35,  3.32it/s]
 91%|█████████ | 338059/371472 [4:43:52<2:40:58,  3.46it/s]
 91%|█████████ | 338060/371472 [4:43:52<2:35:21,  3.58it/s]
                                                           
{'loss': 2.6636, 'learning_rate': 1.8099398823504063e-07, 'epoch': 14.56}

 91%|█████████ | 338060/371472 [4:43:52<2:35:21,  3.58it/s]
 91%|█████████ | 338061/371472 [4:43:52<2:55:07,  3.18it/s]
 91%|█████████ | 338062/371472 [4:43:53<2:59:26,  3.10it/s]
 91%|█████████ | 338063/371472 [4:43:53<2:51:22,  3.25it/s]
 91%|█████████ | 338064/371472 [4:43:53<2:41:58,  3.44it/s]
 91%|█████████ | 338065/371472 [4:43:54<2:40:41,  3.47it/s]
 91%|█████████ | 338066/371472 [4:43:54<2:34:10,  3.61it/s]
 91%|█████████ | 338067/371472 [4:43:54<2:33:11,  3.63it/s]
 91%|█████████ | 338068/371472 [4:43:54<2:36:44,  3.55it/s]
 91%|█████████ | 338069/371472 [4:43:55<2:36:49,  3.55it/s]
 91%|█████████ | 338070/371472 [4:43:55<2:39:39,  3.49it/s]
 91%|█████████ | 338071/371472 [4:43:55<2:37:51,  3.53it/s]
 91%|█████████ | 338072/371472 [4:43:55<2:31:23,  3.68it/s]
 91%|█████████ | 338073/371472 [4:43:56<2:42:21,  3.43it/s]
 91%|█████████ | 338074/371472 [4:43:56<2:44:14,  3.39it/s]
 91%|█████████ | 338075/371472 [4:43:56<2:43:54,  3.40it/s]
 91%|█████████ | 338076/371472 [4:43:57<2:39:01,  3.50it/s]
 91%|█████████ | 338077/371472 [4:43:57<3:00:31,  3.08it/s]
 91%|█████████ | 338078/371472 [4:43:57<2:51:10,  3.25it/s]
 91%|█████████ | 338079/371472 [4:43:58<2:42:08,  3.43it/s]
 91%|█████████ | 338080/371472 [4:43:58<2:41:44,  3.44it/s]
                                                           
{'loss': 2.7485, 'learning_rate': 1.8094550625956167e-07, 'epoch': 14.56}

 91%|█████████ | 338080/371472 [4:43:58<2:41:44,  3.44it/s]
 91%|█████████ | 338081/371472 [4:43:58<2:40:04,  3.48it/s]
 91%|█████████ | 338082/371472 [4:43:58<2:35:21,  3.58it/s]
 91%|█████████ | 338083/371472 [4:43:59<2:40:47,  3.46it/s]
 91%|█████████ | 338084/371472 [4:43:59<2:36:33,  3.55it/s]
 91%|█████████ | 338085/371472 [4:43:59<2:34:40,  3.60it/s]
 91%|█████████ | 338086/371472 [4:44:00<2:33:10,  3.63it/s]
 91%|█████████ | 338087/371472 [4:44:00<2:29:08,  3.73it/s]
 91%|█████████ | 338088/371472 [4:44:00<2:26:49,  3.79it/s]
 91%|█████████ | 338089/371472 [4:44:00<2:24:38,  3.85it/s]
 91%|█████████ | 338090/371472 [4:44:01<2:32:40,  3.64it/s]
 91%|█████████ | 338091/371472 [4:44:01<2:31:29,  3.67it/s]
 91%|█████████ | 338092/371472 [4:44:01<2:32:44,  3.64it/s]
 91%|█████████ | 338093/371472 [4:44:01<2:28:13,  3.75it/s]
 91%|█████████ | 338094/371472 [4:44:02<2:26:35,  3.79it/s]
 91%|█████████ | 338095/371472 [4:44:02<2:26:36,  3.79it/s]
 91%|█████████ | 338096/371472 [4:44:02<2:23:40,  3.87it/s]
 91%|█████████ | 338097/371472 [4:44:02<2:22:47,  3.90it/s]
 91%|█████████ | 338098/371472 [4:44:03<2:25:49,  3.81it/s]
 91%|█████████ | 338099/371472 [4:44:03<2:40:51,  3.46it/s]
 91%|█████████ | 338100/371472 [4:44:03<2:39:02,  3.50it/s]
                                                           
{'loss': 2.6885, 'learning_rate': 1.8089702428408282e-07, 'epoch': 14.56}

 91%|█████████ | 338100/371472 [4:44:03<2:39:02,  3.50it/s]
 91%|█████████ | 338101/371472 [4:44:04<2:40:12,  3.47it/s]
 91%|█████████ | 338102/371472 [4:44:04<2:34:43,  3.59it/s]
 91%|█████████ | 338103/371472 [4:44:04<2:40:16,  3.47it/s]
 91%|█████████ | 338104/371472 [4:44:05<2:46:33,  3.34it/s]
 91%|█████████ | 338105/371472 [4:44:05<2:55:23,  3.17it/s]
 91%|█████████ | 338106/371472 [4:44:05<2:47:25,  3.32it/s]
 91%|█████████ | 338107/371472 [4:44:05<2:47:58,  3.31it/s]
 91%|█████████ | 338108/371472 [4:44:06<2:43:05,  3.41it/s]
 91%|█████████ | 338109/371472 [4:44:06<2:52:06,  3.23it/s]
 91%|█████████ | 338110/371472 [4:44:06<2:46:03,  3.35it/s]
 91%|█████████ | 338111/371472 [4:44:07<2:41:36,  3.44it/s]
 91%|█████████ | 338112/371472 [4:44:07<2:37:08,  3.54it/s]
 91%|█████████ | 338113/371472 [4:44:07<2:32:20,  3.65it/s]
 91%|█████████ | 338114/371472 [4:44:07<2:32:50,  3.64it/s]
 91%|█████████ | 338115/371472 [4:44:08<2:37:23,  3.53it/s]
 91%|█████████ | 338116/371472 [4:44:08<2:36:10,  3.56it/s]
 91%|█████████ | 338117/371472 [4:44:08<2:37:34,  3.53it/s]
 91%|█████████ | 338118/371472 [4:44:09<2:52:15,  3.23it/s]
 91%|█████████ | 338119/371472 [4:44:09<2:44:15,  3.38it/s]
 91%|█████████ | 338120/371472 [4:44:09<2:36:33,  3.55it/s]
                                                           
{'loss': 2.6096, 'learning_rate': 1.808485423086039e-07, 'epoch': 14.56}

 91%|█████████ | 338120/371472 [4:44:09<2:36:33,  3.55it/s]
 91%|█████████ | 338121/371472 [4:44:09<2:41:59,  3.43it/s]
 91%|█████████ | 338122/371472 [4:44:10<2:36:28,  3.55it/s]
 91%|█████████ | 338123/371472 [4:44:10<2:47:40,  3.31it/s]
 91%|█████████ | 338124/371472 [4:44:10<2:40:41,  3.46it/s]
 91%|█████████ | 338125/371472 [4:44:11<2:34:14,  3.60it/s]
 91%|█████████ | 338126/371472 [4:44:11<2:37:26,  3.53it/s]
 91%|█████████ | 338127/371472 [4:44:11<2:37:06,  3.54it/s]
 91%|█████████ | 338128/371472 [4:44:11<2:40:12,  3.47it/s]
 91%|█████████ | 338129/371472 [4:44:12<2:41:15,  3.45it/s]
 91%|█████████ | 338130/371472 [4:44:12<2:39:09,  3.49it/s]
 91%|█████████ | 338131/371472 [4:44:12<2:41:40,  3.44it/s]
 91%|█████████ | 338132/371472 [4:44:13<2:41:18,  3.44it/s]
 91%|█████████ | 338133/371472 [4:44:13<2:34:39,  3.59it/s]
 91%|█████████ | 338134/371472 [4:44:13<2:41:13,  3.45it/s]
 91%|█████████ | 338135/371472 [4:44:13<2:39:56,  3.47it/s]
 91%|█████████ | 338136/371472 [4:44:14<2:40:52,  3.45it/s]
 91%|█████████ | 338137/371472 [4:44:14<2:34:36,  3.59it/s]
 91%|█████████ | 338138/371472 [4:44:14<2:37:35,  3.53it/s]
 91%|█████████ | 338139/371472 [4:44:15<2:38:09,  3.51it/s]
 91%|█████████ | 338140/371472 [4:44:15<2:36:09,  3.56it/s]
                                                           
{'loss': 2.4298, 'learning_rate': 1.8080006033312502e-07, 'epoch': 14.56}

 91%|█████████ | 338140/371472 [4:44:15<2:36:09,  3.56it/s]
 91%|█████████ | 338141/371472 [4:44:15<2:41:18,  3.44it/s]
 91%|█████████ | 338142/371472 [4:44:15<2:39:46,  3.48it/s]
 91%|█████████ | 338143/371472 [4:44:16<2:42:06,  3.43it/s]
 91%|█████████ | 338144/371472 [4:44:16<2:39:05,  3.49it/s]
 91%|█████████ | 338145/371472 [4:44:16<2:37:41,  3.52it/s]
 91%|█████████ | 338146/371472 [4:44:17<2:38:27,  3.51it/s]
 91%|█████████ | 338147/371472 [4:44:17<2:34:11,  3.60it/s]
 91%|█████████ | 338148/371472 [4:44:17<2:35:27,  3.57it/s]
 91%|█████████ | 338149/371472 [4:44:17<2:36:03,  3.56it/s]
 91%|█████████ | 338150/371472 [4:44:18<2:38:34,  3.50it/s]
 91%|█████████ | 338151/371472 [4:44:18<2:38:15,  3.51it/s]
 91%|█████████ | 338152/371472 [4:44:18<2:32:59,  3.63it/s]
 91%|█████████ | 338153/371472 [4:44:19<2:32:21,  3.64it/s]
 91%|█████████ | 338154/371472 [4:44:19<2:51:03,  3.25it/s]
 91%|█████████ | 338155/371472 [4:44:19<2:51:58,  3.23it/s]
 91%|█████████ | 338156/371472 [4:44:20<2:48:41,  3.29it/s]
 91%|█████████ | 338157/371472 [4:44:20<2:38:07,  3.51it/s]
 91%|█████████ | 338158/371472 [4:44:20<2:41:38,  3.43it/s]
 91%|█████████ | 338159/371472 [4:44:20<2:36:43,  3.54it/s]
 91%|█████████ | 338160/371472 [4:44:21<2:46:51,  3.33it/s]
                                                           
{'loss': 2.5278, 'learning_rate': 1.807515783576461e-07, 'epoch': 14.57}

 91%|█████████ | 338160/371472 [4:44:21<2:46:51,  3.33it/s]
 91%|█████████ | 338161/371472 [4:44:21<2:41:46,  3.43it/s]
 91%|█████████ | 338162/371472 [4:44:21<2:48:07,  3.30it/s]
 91%|█████████ | 338163/371472 [4:44:22<2:40:28,  3.46it/s]
 91%|█████████ | 338164/371472 [4:44:22<2:40:15,  3.46it/s]
 91%|█████████ | 338165/371472 [4:44:22<2:37:46,  3.52it/s]
 91%|█████████ | 338166/371472 [4:44:22<2:37:43,  3.52it/s]
 91%|█████████ | 338167/371472 [4:44:23<2:33:06,  3.63it/s]
 91%|█████████ | 338168/371472 [4:44:23<2:28:46,  3.73it/s]
 91%|█████████ | 338169/371472 [4:44:23<2:34:27,  3.59it/s]
 91%|█████████ | 338170/371472 [4:44:23<2:31:49,  3.66it/s]
 91%|█████████ | 338171/371472 [4:44:24<2:31:16,  3.67it/s]
 91%|█████████ | 338172/371472 [4:44:24<2:29:43,  3.71it/s]
 91%|█████████ | 338173/371472 [4:44:24<2:32:50,  3.63it/s]
 91%|█████████ | 338174/371472 [4:44:25<2:43:29,  3.39it/s]
 91%|█████████ | 338175/371472 [4:44:25<2:50:44,  3.25it/s]
 91%|█████████ | 338176/371472 [4:44:25<2:47:13,  3.32it/s]
 91%|█████████ | 338177/371472 [4:44:26<2:40:59,  3.45it/s]
 91%|█████████ | 338178/371472 [4:44:26<2:43:38,  3.39it/s]
 91%|█████████ | 338179/371472 [4:44:26<2:38:13,  3.51it/s]
 91%|█████████ | 338180/371472 [4:44:26<2:44:10,  3.38it/s]
                                                           
{'loss': 2.6301, 'learning_rate': 1.8070309638216727e-07, 'epoch': 14.57}

 91%|█████████ | 338180/371472 [4:44:26<2:44:10,  3.38it/s]
 91%|█████████ | 338181/371472 [4:44:27<3:01:46,  3.05it/s]
 91%|█████████ | 338182/371472 [4:44:27<2:50:13,  3.26it/s]
 91%|█████████ | 338183/371472 [4:44:27<2:40:31,  3.46it/s]
 91%|█████████ | 338184/371472 [4:44:28<2:50:18,  3.26it/s]
 91%|█████████ | 338185/371472 [4:44:28<2:42:33,  3.41it/s]
 91%|█████████ | 338186/371472 [4:44:28<2:38:35,  3.50it/s]
 91%|█████████ | 338187/371472 [4:44:28<2:35:45,  3.56it/s]
 91%|█████████ | 338188/371472 [4:44:29<2:37:09,  3.53it/s]
 91%|█████████ | 338189/371472 [4:44:29<2:36:50,  3.54it/s]
 91%|█████████ | 338190/371472 [4:44:29<2:46:05,  3.34it/s]
 91%|█████████ | 338191/371472 [4:44:30<2:43:01,  3.40it/s]
 91%|█████████ | 338192/371472 [4:44:30<2:38:25,  3.50it/s]
 91%|█████████ | 338193/371472 [4:44:30<2:36:10,  3.55it/s]
 91%|█████████ | 338194/371472 [4:44:30<2:33:46,  3.61it/s]
 91%|█████████ | 338195/371472 [4:44:31<2:35:46,  3.56it/s]
 91%|█████████ | 338196/371472 [4:44:31<2:37:18,  3.53it/s]
 91%|█████████ | 338197/371472 [4:44:31<2:34:34,  3.59it/s]
 91%|█████████ | 338198/371472 [4:44:32<2:32:56,  3.63it/s]
 91%|█████████ | 338199/371472 [4:44:32<2:36:48,  3.54it/s]
 91%|█████████ | 338200/371472 [4:44:32<2:41:18,  3.44it/s]
                                                           
{'loss': 2.6126, 'learning_rate': 1.8065461440668834e-07, 'epoch': 14.57}

 91%|█████████ | 338200/371472 [4:44:32<2:41:18,  3.44it/s]
 91%|█████████ | 338201/371472 [4:44:32<2:38:42,  3.49it/s]
 91%|█████████ | 338202/371472 [4:44:33<2:37:35,  3.52it/s]
 91%|█████████ | 338203/371472 [4:44:33<2:39:12,  3.48it/s]
 91%|█████████ | 338204/371472 [4:44:33<2:37:12,  3.53it/s]
 91%|█████████ | 338205/371472 [4:44:34<2:39:39,  3.47it/s]
 91%|█████████ | 338206/371472 [4:44:34<2:37:51,  3.51it/s]
 91%|█████████ | 338207/371472 [4:44:34<2:41:53,  3.42it/s]
 91%|█████████ | 338208/371472 [4:44:34<2:39:57,  3.47it/s]
 91%|█████████ | 338209/371472 [4:44:35<2:41:24,  3.43it/s]
 91%|█████████ | 338210/371472 [4:44:35<2:57:59,  3.11it/s]
 91%|█████████ | 338211/371472 [4:44:35<2:50:58,  3.24it/s]
 91%|█████████ | 338212/371472 [4:44:36<2:50:25,  3.25it/s]
 91%|█████████ | 338213/371472 [4:44:36<2:46:36,  3.33it/s]
 91%|█████████ | 338214/371472 [4:44:36<2:48:39,  3.29it/s]
 91%|█████████ | 338215/371472 [4:44:37<2:48:02,  3.30it/s]
 91%|█████████ | 338216/371472 [4:44:37<2:48:36,  3.29it/s]
 91%|█████████ | 338217/371472 [4:44:37<2:52:37,  3.21it/s]
 91%|█████████ | 338218/371472 [4:44:38<2:52:29,  3.21it/s]
 91%|█████████ | 338219/371472 [4:44:38<2:43:56,  3.38it/s]
 91%|█████████ | 338220/371472 [4:44:38<2:49:15,  3.27it/s]
                                                           
{'loss': 2.6192, 'learning_rate': 1.8060613243120946e-07, 'epoch': 14.57}

 91%|█████████ | 338220/371472 [4:44:38<2:49:15,  3.27it/s]
 91%|█████████ | 338221/371472 [4:44:38<2:38:56,  3.49it/s]
 91%|█████████ | 338222/371472 [4:44:39<2:32:49,  3.63it/s]
 91%|█████████ | 338223/371472 [4:44:39<2:45:08,  3.36it/s]
 91%|█████████ | 338224/371472 [4:44:39<2:39:27,  3.48it/s]
 91%|█████████ | 338225/371472 [4:44:40<2:39:36,  3.47it/s]
 91%|█████████ | 338226/371472 [4:44:40<2:36:02,  3.55it/s]
 91%|█████████ | 338227/371472 [4:44:40<2:46:59,  3.32it/s]
 91%|█████████ | 338228/371472 [4:44:41<3:00:24,  3.07it/s]
 91%|█████████ | 338229/371472 [4:44:41<2:55:54,  3.15it/s]
 91%|█████████ | 338230/371472 [4:44:41<2:51:54,  3.22it/s]
 91%|█████████ | 338231/371472 [4:44:41<2:52:47,  3.21it/s]
 91%|█████████ | 338232/371472 [4:44:42<3:02:19,  3.04it/s]
 91%|█████████ | 338233/371472 [4:44:42<2:58:42,  3.10it/s]
 91%|█████████ | 338234/371472 [4:44:42<2:54:12,  3.18it/s]
 91%|█████████ | 338235/371472 [4:44:43<2:49:36,  3.27it/s]
 91%|█████████ | 338236/371472 [4:44:43<2:45:27,  3.35it/s]
 91%|█████████ | 338237/371472 [4:44:43<2:43:57,  3.38it/s]
 91%|█████████ | 338238/371472 [4:44:44<2:44:04,  3.38it/s]
 91%|█████████ | 338239/371472 [4:44:44<2:43:55,  3.38it/s]
 91%|█████████ | 338240/371472 [4:44:44<2:42:05,  3.42it/s]
                                                           
{'loss': 2.5981, 'learning_rate': 1.8055765045573054e-07, 'epoch': 14.57}

 91%|█████████ | 338240/371472 [4:44:44<2:42:05,  3.42it/s]
 91%|█████████ | 338241/371472 [4:44:44<2:38:38,  3.49it/s]
 91%|█████████ | 338242/371472 [4:44:45<2:38:14,  3.50it/s]
 91%|█████████ | 338243/371472 [4:44:45<2:42:19,  3.41it/s]
 91%|█████████ | 338244/371472 [4:44:45<2:47:54,  3.30it/s]
 91%|█████████ | 338245/371472 [4:44:46<2:36:27,  3.54it/s]
 91%|█████████ | 338246/371472 [4:44:46<2:36:40,  3.53it/s]
 91%|█████████ | 338247/371472 [4:44:46<2:44:24,  3.37it/s]
 91%|█████████ | 338248/371472 [4:44:47<2:44:36,  3.36it/s]
 91%|█████████ | 338249/371472 [4:44:47<2:38:46,  3.49it/s]
 91%|█████████ | 338250/371472 [4:44:47<2:36:08,  3.55it/s]
 91%|█████████ | 338251/371472 [4:44:47<2:49:04,  3.27it/s]
 91%|█████████ | 338252/371472 [4:44:48<2:48:15,  3.29it/s]
 91%|█████████ | 338253/371472 [4:44:48<2:44:42,  3.36it/s]
 91%|█████████ | 338254/371472 [4:44:48<2:36:49,  3.53it/s]
 91%|█████████ | 338255/371472 [4:44:49<2:34:25,  3.59it/s]
 91%|█████████ | 338256/371472 [4:44:49<2:36:00,  3.55it/s]
 91%|█████████ | 338257/371472 [4:44:49<2:35:51,  3.55it/s]
 91%|█████████ | 338258/371472 [4:44:49<2:34:04,  3.59it/s]
 91%|█████████ | 338259/371472 [4:44:50<2:41:53,  3.42it/s]
 91%|█████████ | 338260/371472 [4:44:50<2:36:44,  3.53it/s]
                                                           
{'loss': 2.4902, 'learning_rate': 1.805091684802517e-07, 'epoch': 14.57}

 91%|█████████ | 338260/371472 [4:44:50<2:36:44,  3.53it/s]
 91%|█████████ | 338261/371472 [4:44:50<2:31:11,  3.66it/s]
 91%|█████████ | 338262/371472 [4:44:50<2:31:01,  3.67it/s]
 91%|█████████ | 338263/371472 [4:44:51<2:33:44,  3.60it/s]
 91%|█████████ | 338264/371472 [4:44:51<2:30:18,  3.68it/s]
 91%|█████████ | 338265/371472 [4:44:51<2:32:39,  3.63it/s]
 91%|█████████ | 338266/371472 [4:44:52<2:41:22,  3.43it/s]
 91%|█████████ | 338267/371472 [4:44:52<2:33:36,  3.60it/s]
 91%|█████████ | 338268/371472 [4:44:52<2:31:55,  3.64it/s]
 91%|█████████ | 338269/371472 [4:44:52<2:28:09,  3.74it/s]
 91%|█████████ | 338270/371472 [4:44:53<2:36:13,  3.54it/s]
 91%|█████████ | 338271/371472 [4:44:53<2:33:47,  3.60it/s]
 91%|█████████ | 338272/371472 [4:44:53<2:38:19,  3.49it/s]
 91%|█████████ | 338273/371472 [4:44:54<2:32:43,  3.62it/s]
 91%|█████████ | 338274/371472 [4:44:54<2:32:11,  3.64it/s]
 91%|█████████ | 338275/371472 [4:44:54<2:27:05,  3.76it/s]
 91%|█████████ | 338276/371472 [4:44:54<2:28:14,  3.73it/s]
 91%|█████████ | 338277/371472 [4:44:55<2:26:44,  3.77it/s]
 91%|█████████ | 338278/371472 [4:44:55<2:30:39,  3.67it/s]
 91%|█████████ | 338279/371472 [4:44:55<2:34:45,  3.57it/s]
 91%|█████████ | 338280/371472 [4:44:55<2:34:54,  3.57it/s]
                                                           
{'loss': 2.7589, 'learning_rate': 1.8046068650477276e-07, 'epoch': 14.57}

 91%|█████████ | 338280/371472 [4:44:55<2:34:54,  3.57it/s]
 91%|█████████ | 338281/371472 [4:44:56<2:29:50,  3.69it/s]
 91%|█████████ | 338282/371472 [4:44:56<2:31:50,  3.64it/s]
 91%|█████████ | 338283/371472 [4:44:56<2:37:07,  3.52it/s]
 91%|█████████ | 338284/371472 [4:44:57<2:37:27,  3.51it/s]
 91%|█████████ | 338285/371472 [4:44:57<2:37:24,  3.51it/s]
 91%|█████████ | 338286/371472 [4:44:57<2:33:09,  3.61it/s]
 91%|█████████ | 338287/371472 [4:44:57<2:40:59,  3.44it/s]
 91%|█████████ | 338288/371472 [4:44:58<2:36:17,  3.54it/s]
 91%|█████████ | 338289/371472 [4:44:58<2:46:11,  3.33it/s]
 91%|█████████ | 338290/371472 [4:44:58<2:44:44,  3.36it/s]
 91%|█████████ | 338291/371472 [4:44:59<2:39:44,  3.46it/s]
 91%|█████████ | 338292/371472 [4:44:59<2:37:36,  3.51it/s]
 91%|█████████ | 338293/371472 [4:44:59<2:32:28,  3.63it/s]
 91%|█████████ | 338294/371472 [4:44:59<2:37:02,  3.52it/s]
 91%|█████████ | 338295/371472 [4:45:00<2:44:07,  3.37it/s]
 91%|█████████ | 338296/371472 [4:45:00<2:40:38,  3.44it/s]
 91%|█████████ | 338297/371472 [4:45:00<2:43:25,  3.38it/s]
 91%|█████████ | 338298/371472 [4:45:01<2:49:49,  3.26it/s]
 91%|█████████ | 338299/371472 [4:45:01<2:52:45,  3.20it/s]
 91%|█████████ | 338300/371472 [4:45:01<2:42:53,  3.39it/s]
                                                           
{'loss': 2.5826, 'learning_rate': 1.804122045292939e-07, 'epoch': 14.57}

 91%|█████████ | 338300/371472 [4:45:01<2:42:53,  3.39it/s]
 91%|█████████ | 338301/371472 [4:45:02<2:46:27,  3.32it/s]
 91%|█████████ | 338302/371472 [4:45:02<2:40:19,  3.45it/s]
 91%|█████████ | 338303/371472 [4:45:02<2:37:16,  3.51it/s]
 91%|█████████ | 338304/371472 [4:45:02<2:34:16,  3.58it/s]
 91%|█████████ | 338305/371472 [4:45:03<2:32:37,  3.62it/s]
 91%|█████████ | 338306/371472 [4:45:03<2:32:43,  3.62it/s]
 91%|█████████ | 338307/371472 [4:45:03<2:29:41,  3.69it/s]
 91%|█████████ | 338308/371472 [4:45:03<2:27:33,  3.75it/s]
 91%|█████████ | 338309/371472 [4:45:04<2:33:37,  3.60it/s]
 91%|█████████ | 338310/371472 [4:45:04<2:40:57,  3.43it/s]
 91%|█████████ | 338311/371472 [4:45:04<2:36:22,  3.53it/s]
 91%|█████████ | 338312/371472 [4:45:05<2:32:13,  3.63it/s]
 91%|█████████ | 338313/371472 [4:45:05<2:34:23,  3.58it/s]
 91%|█████████ | 338314/371472 [4:45:05<2:32:23,  3.63it/s]
 91%|█████████ | 338315/371472 [4:45:05<2:31:37,  3.64it/s]
 91%|█████████ | 338316/371472 [4:45:06<2:35:23,  3.56it/s]
 91%|█████████ | 338317/371472 [4:45:06<2:35:12,  3.56it/s]
 91%|█████████ | 338318/371472 [4:45:06<2:37:45,  3.50it/s]
 91%|█████████ | 338319/371472 [4:45:07<2:32:42,  3.62it/s]
 91%|█████████ | 338320/371472 [4:45:07<2:29:01,  3.71it/s]
                                                           
{'loss': 2.5593, 'learning_rate': 1.8036372255381498e-07, 'epoch': 14.57}

 91%|█████████ | 338320/371472 [4:45:07<2:29:01,  3.71it/s]
 91%|█████████ | 338321/371472 [4:45:07<2:50:08,  3.25it/s]
 91%|█████████ | 338322/371472 [4:45:08<3:00:22,  3.06it/s]
 91%|█████████ | 338323/371472 [4:45:08<2:50:50,  3.23it/s]
 91%|█████████ | 338324/371472 [4:45:08<2:41:13,  3.43it/s]
 91%|█████████ | 338325/371472 [4:45:08<2:34:56,  3.57it/s]
 91%|█████████ | 338326/371472 [4:45:09<2:41:32,  3.42it/s]
 91%|█████████ | 338327/371472 [4:45:09<2:33:32,  3.60it/s]
 91%|█████████ | 338328/371472 [4:45:09<2:31:12,  3.65it/s]
 91%|█████████ | 338329/371472 [4:45:09<2:29:27,  3.70it/s]
 91%|█████████ | 338330/371472 [4:45:10<2:40:49,  3.43it/s]
 91%|█████████ | 338331/371472 [4:45:10<2:36:56,  3.52it/s]
 91%|█████████ | 338332/371472 [4:45:10<2:33:50,  3.59it/s]
 91%|█████████ | 338333/371472 [4:45:11<2:29:12,  3.70it/s]
 91%|█████████ | 338334/371472 [4:45:11<2:28:49,  3.71it/s]
 91%|█████████ | 338335/371472 [4:45:11<2:26:39,  3.77it/s]
 91%|█████████ | 338336/371472 [4:45:11<2:28:49,  3.71it/s]
 91%|█████████ | 338337/371472 [4:45:12<2:42:00,  3.41it/s]
 91%|█████████ | 338338/371472 [4:45:12<2:42:38,  3.40it/s]
 91%|█████████ | 338339/371472 [4:45:12<2:42:52,  3.39it/s]
 91%|█████████ | 338340/371472 [4:45:13<2:42:41,  3.39it/s]
                                                           
{'loss': 2.6938, 'learning_rate': 1.8031524057833613e-07, 'epoch': 14.57}

 91%|█████████ | 338340/371472 [4:45:13<2:42:41,  3.39it/s]
 91%|█████████ | 338341/371472 [4:45:13<2:38:41,  3.48it/s]
 91%|█████████ | 338342/371472 [4:45:13<2:37:31,  3.51it/s]
 91%|█████████ | 338343/371472 [4:45:13<2:34:34,  3.57it/s]
 91%|█████████ | 338344/371472 [4:45:14<2:38:58,  3.47it/s]
 91%|█████████ | 338345/371472 [4:45:14<2:51:41,  3.22it/s]
 91%|█████████ | 338346/371472 [4:45:14<2:41:45,  3.41it/s]
 91%|█████████ | 338347/371472 [4:45:15<2:50:44,  3.23it/s]
 91%|█████████ | 338348/371472 [4:45:15<2:42:54,  3.39it/s]
 91%|█████████ | 338349/371472 [4:45:15<2:40:01,  3.45it/s]
 91%|█████████ | 338350/371472 [4:45:16<2:45:10,  3.34it/s]
 91%|█████████ | 338351/371472 [4:45:16<2:41:02,  3.43it/s]
 91%|█████████ | 338352/371472 [4:45:16<2:43:08,  3.38it/s]
 91%|█████████ | 338353/371472 [4:45:16<2:39:18,  3.46it/s]
 91%|█████████ | 338354/371472 [4:45:17<2:33:05,  3.61it/s]
 91%|█████████ | 338355/371472 [4:45:17<2:27:34,  3.74it/s]
 91%|█████████ | 338356/371472 [4:45:17<2:25:47,  3.79it/s]
 91%|█████████ | 338357/371472 [4:45:17<2:26:03,  3.78it/s]
 91%|█████████ | 338358/371472 [4:45:18<2:24:11,  3.83it/s]
 91%|█████████ | 338359/371472 [4:45:18<2:31:00,  3.65it/s]
 91%|█████████ | 338360/371472 [4:45:18<2:29:44,  3.69it/s]
                                                           
{'loss': 2.5349, 'learning_rate': 1.8026675860285718e-07, 'epoch': 14.57}

 91%|█████████ | 338360/371472 [4:45:18<2:29:44,  3.69it/s]
 91%|█████████ | 338361/371472 [4:45:19<2:46:09,  3.32it/s]
 91%|█████████ | 338362/371472 [4:45:19<2:37:27,  3.50it/s]
 91%|█████████ | 338363/371472 [4:45:19<2:35:17,  3.55it/s]
 91%|█████████ | 338364/371472 [4:45:19<2:35:04,  3.56it/s]
 91%|█████████ | 338365/371472 [4:45:20<2:33:35,  3.59it/s]
 91%|█████████ | 338366/371472 [4:45:20<2:31:36,  3.64it/s]
 91%|█████████ | 338367/371472 [4:45:20<2:33:45,  3.59it/s]
 91%|█████████ | 338368/371472 [4:45:21<2:45:13,  3.34it/s]
 91%|█████████ | 338369/371472 [4:45:21<2:44:11,  3.36it/s]
 91%|█████████ | 338370/371472 [4:45:21<2:36:54,  3.52it/s]
 91%|█████████ | 338371/371472 [4:45:21<2:31:34,  3.64it/s]
 91%|█████████ | 338372/371472 [4:45:22<2:31:32,  3.64it/s]
 91%|█████████ | 338373/371472 [4:45:22<2:27:39,  3.74it/s]
 91%|█████████ | 338374/371472 [4:45:22<2:28:30,  3.71it/s]
 91%|█████████ | 338375/371472 [4:45:22<2:29:58,  3.68it/s]
 91%|█████████ | 338376/371472 [4:45:23<2:27:05,  3.75it/s]
 91%|█████████ | 338377/371472 [4:45:23<2:36:43,  3.52it/s]
 91%|█████████ | 338378/371472 [4:45:23<2:31:00,  3.65it/s]
 91%|█████████ | 338379/371472 [4:45:24<2:31:07,  3.65it/s]
 91%|█████████ | 338380/371472 [4:45:24<2:33:51,  3.58it/s]
                                                           
{'loss': 2.5463, 'learning_rate': 1.8021827662737835e-07, 'epoch': 14.57}

 91%|█████████ | 338380/371472 [4:45:24<2:33:51,  3.58it/s]
 91%|█████████ | 338381/371472 [4:45:24<2:32:44,  3.61it/s]
 91%|█████████ | 338382/371472 [4:45:24<2:42:26,  3.40it/s]
 91%|█████████ | 338383/371472 [4:45:25<2:40:49,  3.43it/s]
 91%|█████████ | 338384/371472 [4:45:25<2:36:58,  3.51it/s]
 91%|█████████ | 338385/371472 [4:45:25<2:33:47,  3.59it/s]
 91%|█████████ | 338386/371472 [4:45:26<2:40:41,  3.43it/s]
 91%|█████████ | 338387/371472 [4:45:26<2:38:21,  3.48it/s]
 91%|█████████ | 338388/371472 [4:45:26<2:34:58,  3.56it/s]
 91%|█████████ | 338389/371472 [4:45:26<2:37:13,  3.51it/s]
 91%|█████████ | 338390/371472 [4:45:27<2:33:18,  3.60it/s]
 91%|█████████ | 338391/371472 [4:45:27<2:32:56,  3.61it/s]
 91%|█████████ | 338392/371472 [4:45:27<2:33:59,  3.58it/s]
 91%|█████████ | 338393/371472 [4:45:28<2:43:09,  3.38it/s]
 91%|█████████ | 338394/371472 [4:45:28<2:41:48,  3.41it/s]
 91%|█████████ | 338395/371472 [4:45:28<2:36:21,  3.53it/s]
 91%|█████████ | 338396/371472 [4:45:28<2:29:24,  3.69it/s]
 91%|█████████ | 338397/371472 [4:45:29<2:25:58,  3.78it/s]
 91%|█████████ | 338398/371472 [4:45:29<2:35:41,  3.54it/s]
 91%|█████████ | 338399/371472 [4:45:29<2:29:49,  3.68it/s]
 91%|█████████ | 338400/371472 [4:45:29<2:28:56,  3.70it/s]
                                                           
{'loss': 2.5486, 'learning_rate': 1.801697946518994e-07, 'epoch': 14.58}

 91%|█████████ | 338400/371472 [4:45:29<2:28:56,  3.70it/s]
 91%|█████████ | 338401/371472 [4:45:30<2:45:36,  3.33it/s]
 91%|█████████ | 338402/371472 [4:45:30<2:42:53,  3.38it/s]
 91%|█████████ | 338403/371472 [4:45:30<2:37:32,  3.50it/s]
 91%|█████████ | 338404/371472 [4:45:31<2:38:21,  3.48it/s]
 91%|█████████ | 338405/371472 [4:45:31<2:37:25,  3.50it/s]
 91%|█████████ | 338406/371472 [4:45:31<2:31:23,  3.64it/s]
 91%|█████████ | 338407/371472 [4:45:32<2:42:49,  3.38it/s]
 91%|█████████ | 338408/371472 [4:45:32<2:43:14,  3.38it/s]
 91%|█████████ | 338409/371472 [4:45:32<2:49:52,  3.24it/s]
 91%|█████████ | 338410/371472 [4:45:32<2:43:34,  3.37it/s]
 91%|█████████ | 338411/371472 [4:45:33<2:45:27,  3.33it/s]
 91%|█████████ | 338412/371472 [4:45:33<2:40:41,  3.43it/s]
 91%|█████████ | 338413/371472 [4:45:33<2:51:53,  3.21it/s]
 91%|█████████ | 338414/371472 [4:45:34<2:40:46,  3.43it/s]
 91%|█████████ | 338415/371472 [4:45:34<3:02:03,  3.03it/s]
 91%|█████████ | 338416/371472 [4:45:34<2:51:47,  3.21it/s]
 91%|█████████ | 338417/371472 [4:45:35<2:40:37,  3.43it/s]
 91%|█████████ | 338418/371472 [4:45:35<2:36:30,  3.52it/s]
 91%|█████████ | 338419/371472 [4:45:35<2:35:21,  3.55it/s]
 91%|█████████ | 338420/371472 [4:45:35<2:50:15,  3.24it/s]
                                                           
{'loss': 2.604, 'learning_rate': 1.8012131267642055e-07, 'epoch': 14.58}

 91%|█████████ | 338420/371472 [4:45:35<2:50:15,  3.24it/s]
 91%|█████████ | 338421/371472 [4:45:36<2:43:43,  3.36it/s]
 91%|█████████ | 338422/371472 [4:45:36<2:42:15,  3.39it/s]
 91%|█████████ | 338423/371472 [4:45:36<2:48:18,  3.27it/s]
 91%|█████████ | 338424/371472 [4:45:37<2:44:40,  3.34it/s]
 91%|█████████ | 338425/371472 [4:45:37<2:39:14,  3.46it/s]
 91%|█████████ | 338426/371472 [4:45:37<2:40:38,  3.43it/s]
 91%|█████████ | 338427/371472 [4:45:37<2:38:07,  3.48it/s]
 91%|█████████ | 338428/371472 [4:45:38<2:42:35,  3.39it/s]
 91%|█████████ | 338429/371472 [4:45:38<2:43:25,  3.37it/s]
 91%|█████████ | 338430/371472 [4:45:38<2:40:46,  3.43it/s]
 91%|█████████ | 338431/371472 [4:45:39<2:46:28,  3.31it/s]
 91%|█████████ | 338432/371472 [4:45:39<2:38:12,  3.48it/s]
 91%|█████████ | 338433/371472 [4:45:39<2:34:23,  3.57it/s]
 91%|█████████ | 338434/371472 [4:45:40<2:34:57,  3.55it/s]
 91%|█████████ | 338435/371472 [4:45:40<2:32:35,  3.61it/s]
 91%|█████████ | 338436/371472 [4:45:40<2:27:58,  3.72it/s]
 91%|█████████ | 338437/371472 [4:45:40<2:25:29,  3.78it/s]
 91%|█████████ | 338438/371472 [4:45:41<2:33:50,  3.58it/s]
 91%|█████████ | 338439/371472 [4:45:41<2:36:04,  3.53it/s]
 91%|█████████ | 338440/371472 [4:45:41<2:31:01,  3.65it/s]
                                                           
{'loss': 2.5268, 'learning_rate': 1.8007283070094162e-07, 'epoch': 14.58}

 91%|█████████ | 338440/371472 [4:45:41<2:31:01,  3.65it/s]
 91%|█████████ | 338441/371472 [4:45:41<2:28:11,  3.71it/s]
 91%|█████████ | 338442/371472 [4:45:42<2:33:27,  3.59it/s]
 91%|█████████ | 338443/371472 [4:45:42<2:34:55,  3.55it/s]
 91%|█████████ | 338444/371472 [4:45:42<2:30:01,  3.67it/s]
 91%|█████████ | 338445/371472 [4:45:42<2:27:42,  3.73it/s]
 91%|█████████ | 338446/371472 [4:45:43<2:28:17,  3.71it/s]
 91%|█████████ | 338447/371472 [4:45:43<2:33:30,  3.59it/s]
 91%|█████████ | 338448/371472 [4:45:43<2:34:16,  3.57it/s]
 91%|█████████ | 338449/371472 [4:45:44<2:30:48,  3.65it/s]
 91%|█████████ | 338450/371472 [4:45:44<2:27:49,  3.72it/s]
 91%|█████████ | 338451/371472 [4:45:44<2:26:16,  3.76it/s]
 91%|█████████ | 338452/371472 [4:45:44<2:38:30,  3.47it/s]
 91%|█████████ | 338453/371472 [4:45:45<2:37:27,  3.50it/s]
 91%|█████████ | 338454/371472 [4:45:45<2:39:55,  3.44it/s]
 91%|█████████ | 338455/371472 [4:45:45<2:48:47,  3.26it/s]
 91%|█████████ | 338456/371472 [4:45:46<2:43:46,  3.36it/s]
 91%|█████████ | 338457/371472 [4:45:46<2:40:34,  3.43it/s]
 91%|█████████ | 338458/371472 [4:45:46<2:47:46,  3.28it/s]
 91%|█████████ | 338459/371472 [4:45:47<2:49:05,  3.25it/s]
 91%|█████████ | 338460/371472 [4:45:47<2:43:38,  3.36it/s]
                                                           
{'loss': 2.5312, 'learning_rate': 1.8002434872546277e-07, 'epoch': 14.58}

 91%|█████████ | 338460/371472 [4:45:47<2:43:38,  3.36it/s]
 91%|█████████ | 338461/371472 [4:45:47<2:37:11,  3.50it/s]
 91%|█████████ | 338462/371472 [4:45:47<2:33:10,  3.59it/s]
 91%|█████████ | 338463/371472 [4:45:48<2:27:55,  3.72it/s]
 91%|█████████ | 338464/371472 [4:45:48<2:26:07,  3.77it/s]
 91%|█████████ | 338465/371472 [4:45:48<2:22:54,  3.85it/s]
 91%|█████████ | 338466/371472 [4:45:49<2:45:10,  3.33it/s]
 91%|█████████ | 338467/371472 [4:45:49<2:42:23,  3.39it/s]
 91%|█████████ | 338468/371472 [4:45:49<2:38:00,  3.48it/s]
 91%|█████████ | 338469/371472 [4:45:49<2:47:03,  3.29it/s]
 91%|█████████ | 338470/371472 [4:45:50<2:40:46,  3.42it/s]
 91%|█████████ | 338471/371472 [4:45:50<2:40:06,  3.44it/s]
 91%|█████████ | 338472/371472 [4:45:50<2:46:52,  3.30it/s]
 91%|█████████ | 338473/371472 [4:45:51<2:38:23,  3.47it/s]
 91%|█████████ | 338474/371472 [4:45:51<2:35:33,  3.54it/s]
 91%|█████████ | 338475/371472 [4:45:51<2:29:19,  3.68it/s]
 91%|█████████ | 338476/371472 [4:45:51<2:28:13,  3.71it/s]
 91%|█████████ | 338477/371472 [4:45:52<2:25:34,  3.78it/s]
 91%|█████████ | 338478/371472 [4:45:52<2:28:09,  3.71it/s]
 91%|█████████ | 338479/371472 [4:45:52<2:28:17,  3.71it/s]
 91%|█████████ | 338480/371472 [4:45:52<2:29:42,  3.67it/s]
                                                           
{'loss': 2.5899, 'learning_rate': 1.7997586674998382e-07, 'epoch': 14.58}

 91%|█████████ | 338480/371472 [4:45:52<2:29:42,  3.67it/s]
 91%|█████████ | 338481/371472 [4:45:53<2:40:41,  3.42it/s]
 91%|█████████ | 338482/371472 [4:45:53<2:40:25,  3.43it/s]
 91%|█████████ | 338483/371472 [4:45:53<2:38:18,  3.47it/s]
 91%|█████████ | 338484/371472 [4:45:54<2:35:44,  3.53it/s]
 91%|█████████ | 338485/371472 [4:45:54<2:37:56,  3.48it/s]
 91%|█████████ | 338486/371472 [4:45:54<2:35:53,  3.53it/s]
 91%|█████████ | 338487/371472 [4:45:54<2:32:33,  3.60it/s]
 91%|█████████ | 338488/371472 [4:45:55<2:37:59,  3.48it/s]
 91%|█████████ | 338489/371472 [4:45:55<2:37:28,  3.49it/s]
 91%|█████████ | 338490/371472 [4:45:55<2:34:44,  3.55it/s]
 91%|█████████ | 338491/371472 [4:45:56<2:34:59,  3.55it/s]
 91%|█████████ | 338492/371472 [4:45:56<2:28:01,  3.71it/s]
 91%|█████████ | 338493/371472 [4:45:56<2:24:21,  3.81it/s]
 91%|█████████ | 338494/371472 [4:45:56<2:25:00,  3.79it/s]
 91%|█████████ | 338495/371472 [4:45:57<2:21:48,  3.88it/s]
 91%|█████████ | 338496/371472 [4:45:57<2:21:21,  3.89it/s]
 91%|█████████ | 338497/371472 [4:45:57<2:24:34,  3.80it/s]
 91%|█████████ | 338498/371472 [4:45:57<2:32:13,  3.61it/s]
 91%|█████████ | 338499/371472 [4:45:58<2:32:25,  3.61it/s]
 91%|█████████ | 338500/371472 [4:45:58<2:39:03,  3.45it/s]
                                                           
{'loss': 2.4637, 'learning_rate': 1.79927384774505e-07, 'epoch': 14.58}

 91%|█████████ | 338500/371472 [4:45:58<2:39:03,  3.45it/s]
 91%|█████████ | 338501/371472 [4:45:58<2:36:39,  3.51it/s]
 91%|█████████ | 338502/371472 [4:45:59<2:46:52,  3.29it/s]
 91%|█████████ | 338503/371472 [4:45:59<2:42:22,  3.38it/s]
 91%|█████████ | 338504/371472 [4:45:59<2:38:10,  3.47it/s]
 91%|█████████ | 338505/371472 [4:46:00<2:40:44,  3.42it/s]
 91%|█████████ | 338506/371472 [4:46:00<2:37:23,  3.49it/s]
 91%|█████████ | 338507/371472 [4:46:00<2:32:06,  3.61it/s]
 91%|█████████ | 338508/371472 [4:46:00<2:29:33,  3.67it/s]
 91%|█████████ | 338509/371472 [4:46:01<2:29:56,  3.66it/s]
 91%|█████████ | 338510/371472 [4:46:01<2:34:06,  3.56it/s]
 91%|█████████ | 338511/371472 [4:46:01<2:32:50,  3.59it/s]
 91%|█████████ | 338512/371472 [4:46:01<2:35:13,  3.54it/s]
 91%|█████████ | 338513/371472 [4:46:02<2:34:05,  3.56it/s]
 91%|█████████ | 338514/371472 [4:46:02<2:38:52,  3.46it/s]
 91%|█████████ | 338515/371472 [4:46:02<2:29:36,  3.67it/s]
 91%|█████████ | 338516/371472 [4:46:03<2:30:00,  3.66it/s]
 91%|█████████ | 338517/371472 [4:46:03<2:42:31,  3.38it/s]
 91%|█████████ | 338518/371472 [4:46:03<2:40:23,  3.42it/s]
 91%|█████████ | 338519/371472 [4:46:03<2:38:53,  3.46it/s]
 91%|█████████ | 338520/371472 [4:46:04<2:37:07,  3.50it/s]
                                                           
{'loss': 2.6968, 'learning_rate': 1.7987890279902604e-07, 'epoch': 14.58}

 91%|█████████ | 338520/371472 [4:46:04<2:37:07,  3.50it/s]
 91%|█████████ | 338521/371472 [4:46:04<2:42:17,  3.38it/s]
 91%|█████████ | 338522/371472 [4:46:04<2:43:59,  3.35it/s]
 91%|█████████ | 338523/371472 [4:46:05<2:36:07,  3.52it/s]
 91%|█████████ | 338524/371472 [4:46:05<2:32:51,  3.59it/s]
 91%|█████████ | 338525/371472 [4:46:05<2:34:00,  3.57it/s]
 91%|█████████ | 338526/371472 [4:46:05<2:39:12,  3.45it/s]
 91%|█████████ | 338527/371472 [4:46:06<2:39:12,  3.45it/s]
 91%|█████████ | 338528/371472 [4:46:06<2:40:39,  3.42it/s]
 91%|█████████ | 338529/371472 [4:46:06<2:44:29,  3.34it/s]
 91%|█████████ | 338530/371472 [4:46:07<2:40:08,  3.43it/s]
 91%|█████████ | 338531/371472 [4:46:07<2:46:31,  3.30it/s]
 91%|█████████ | 338532/371472 [4:46:07<2:46:04,  3.31it/s]
 91%|█████████ | 338533/371472 [4:46:08<2:36:10,  3.52it/s]
 91%|█████████ | 338534/371472 [4:46:08<2:37:12,  3.49it/s]
 91%|█████████ | 338535/371472 [4:46:08<2:34:02,  3.56it/s]
 91%|█████████ | 338536/371472 [4:46:08<2:50:49,  3.21it/s]
 91%|█████████ | 338537/371472 [4:46:09<2:47:10,  3.28it/s]
 91%|█████████ | 338538/371472 [4:46:09<2:54:36,  3.14it/s]
 91%|█████████ | 338539/371472 [4:46:09<2:55:30,  3.13it/s]
 91%|█████████ | 338540/371472 [4:46:10<2:51:45,  3.20it/s]
                                                           
{'loss': 2.5094, 'learning_rate': 1.7983042082354708e-07, 'epoch': 14.58}

 91%|█████████ | 338540/371472 [4:46:10<2:51:45,  3.20it/s]
 91%|█████████ | 338541/371472 [4:46:10<2:47:25,  3.28it/s]
 91%|█████████ | 338542/371472 [4:46:10<3:04:23,  2.98it/s]
 91%|█████████ | 338543/371472 [4:46:11<3:01:41,  3.02it/s]
 91%|█████████ | 338544/371472 [4:46:11<3:04:57,  2.97it/s]
 91%|█████████ | 338545/371472 [4:46:11<3:00:46,  3.04it/s]
 91%|█████████ | 338546/371472 [4:46:12<2:54:03,  3.15it/s]
 91%|█████████ | 338547/371472 [4:46:12<2:45:08,  3.32it/s]
 91%|█████████ | 338548/371472 [4:46:12<2:44:43,  3.33it/s]
 91%|█████████ | 338549/371472 [4:46:13<2:52:09,  3.19it/s]
 91%|█████████ | 338550/371472 [4:46:13<2:52:24,  3.18it/s]
 91%|█████████ | 338551/371472 [4:46:13<2:51:56,  3.19it/s]
 91%|█████████ | 338552/371472 [4:46:13<2:42:29,  3.38it/s]
 91%|█████████ | 338553/371472 [4:46:14<2:39:44,  3.43it/s]
 91%|█████████ | 338554/371472 [4:46:14<2:38:55,  3.45it/s]
 91%|█████████ | 338555/371472 [4:46:14<2:34:23,  3.55it/s]
 91%|█████████ | 338556/371472 [4:46:15<2:28:41,  3.69it/s]
 91%|█████████ | 338557/371472 [4:46:15<2:25:11,  3.78it/s]
 91%|█████████ | 338558/371472 [4:46:15<2:35:26,  3.53it/s]
 91%|█████████ | 338559/371472 [4:46:15<2:32:22,  3.60it/s]
 91%|█████████ | 338560/371472 [4:46:16<2:32:28,  3.60it/s]
                                                           
{'loss': 2.5594, 'learning_rate': 1.7978193884806826e-07, 'epoch': 14.58}

 91%|█████████ | 338560/371472 [4:46:16<2:32:28,  3.60it/s]
 91%|█████████ | 338561/371472 [4:46:16<2:33:30,  3.57it/s]
 91%|█████████ | 338562/371472 [4:46:16<2:46:37,  3.29it/s]
 91%|█████████ | 338563/371472 [4:46:17<2:46:41,  3.29it/s]
 91%|█████████ | 338564/371472 [4:46:17<2:40:23,  3.42it/s]
 91%|█████████ | 338565/371472 [4:46:17<2:43:36,  3.35it/s]
 91%|█████████ | 338566/371472 [4:46:17<2:37:20,  3.49it/s]
 91%|█████████ | 338567/371472 [4:46:18<2:53:36,  3.16it/s]
 91%|█████████ | 338568/371472 [4:46:18<2:44:14,  3.34it/s]
 91%|█████████ | 338569/371472 [4:46:18<2:37:36,  3.48it/s]
 91%|█████████ | 338570/371472 [4:46:19<2:31:44,  3.61it/s]
 91%|█████████ | 338571/371472 [4:46:19<2:31:52,  3.61it/s]
 91%|█████████ | 338572/371472 [4:46:19<2:45:27,  3.31it/s]
 91%|█████████ | 338573/371472 [4:46:20<2:46:06,  3.30it/s]
 91%|█████████ | 338574/371472 [4:46:20<2:37:28,  3.48it/s]
 91%|█████████ | 338575/371472 [4:46:20<2:38:23,  3.46it/s]
 91%|█████████ | 338576/371472 [4:46:20<2:40:47,  3.41it/s]
 91%|█████████ | 338577/371472 [4:46:21<2:34:42,  3.54it/s]
 91%|█████████ | 338578/371472 [4:46:21<2:30:34,  3.64it/s]
 91%|█████████ | 338579/371472 [4:46:21<2:28:32,  3.69it/s]
 91%|█████████ | 338580/371472 [4:46:21<2:30:07,  3.65it/s]
                                                           
{'loss': 2.5752, 'learning_rate': 1.7973345687258933e-07, 'epoch': 14.58}

 91%|█████████ | 338580/371472 [4:46:21<2:30:07,  3.65it/s]
 91%|█████████ | 338581/371472 [4:46:22<2:37:53,  3.47it/s]
 91%|█████████ | 338582/371472 [4:46:22<2:36:43,  3.50it/s]
 91%|█████████ | 338583/371472 [4:46:22<2:31:04,  3.63it/s]
 91%|█████████ | 338584/371472 [4:46:23<2:44:41,  3.33it/s]
 91%|█████████ | 338585/371472 [4:46:23<2:51:54,  3.19it/s]
 91%|█████████ | 338586/371472 [4:46:23<2:45:28,  3.31it/s]
 91%|█████████ | 338587/371472 [4:46:24<2:48:45,  3.25it/s]
 91%|█████████ | 338588/371472 [4:46:24<2:41:30,  3.39it/s]
 91%|█████████ | 338589/371472 [4:46:24<2:53:03,  3.17it/s]
 91%|█████████ | 338590/371472 [4:46:25<2:46:59,  3.28it/s]
 91%|█████████ | 338591/371472 [4:46:25<2:38:31,  3.46it/s]
 91%|█████████ | 338592/371472 [4:46:25<2:43:44,  3.35it/s]
 91%|█████████ | 338593/371472 [4:46:25<2:47:23,  3.27it/s]
 91%|█████████ | 338594/371472 [4:46:26<2:54:55,  3.13it/s]
 91%|█████████ | 338595/371472 [4:46:26<2:48:54,  3.24it/s]
 91%|█████████ | 338596/371472 [4:46:26<2:44:31,  3.33it/s]
 91%|█████████ | 338597/371472 [4:46:27<2:48:45,  3.25it/s]
 91%|█████████ | 338598/371472 [4:46:27<2:45:58,  3.30it/s]
 91%|█████████ | 338599/371472 [4:46:27<2:38:24,  3.46it/s]
 91%|█████████ | 338600/371472 [4:46:27<2:32:35,  3.59it/s]
                                                           
{'loss': 2.6366, 'learning_rate': 1.7968497489711046e-07, 'epoch': 14.58}

 91%|█████████ | 338600/371472 [4:46:27<2:32:35,  3.59it/s]
 91%|█████████ | 338601/371472 [4:46:28<2:36:31,  3.50it/s]
 91%|█████████ | 338602/371472 [4:46:28<2:32:33,  3.59it/s]
 91%|█████████ | 338603/371472 [4:46:28<2:32:12,  3.60it/s]
 91%|█████████ | 338604/371472 [4:46:29<2:36:24,  3.50it/s]
 91%|█████████ | 338605/371472 [4:46:29<2:30:12,  3.65it/s]
 91%|█████████ | 338606/371472 [4:46:29<2:31:40,  3.61it/s]
 91%|█████████ | 338607/371472 [4:46:29<2:35:46,  3.52it/s]
 91%|█████████ | 338608/371472 [4:46:30<2:34:34,  3.54it/s]
 91%|█████████ | 338609/371472 [4:46:30<2:38:05,  3.46it/s]
 91%|█████████ | 338610/371472 [4:46:30<2:49:43,  3.23it/s]
 91%|█████████ | 338611/371472 [4:46:31<2:55:40,  3.12it/s]
 91%|█████████ | 338612/371472 [4:46:31<2:52:41,  3.17it/s]
 91%|█████████ | 338613/371472 [4:46:31<3:08:57,  2.90it/s]
 91%|█████████ | 338614/371472 [4:46:32<2:59:25,  3.05it/s]
 91%|█████████ | 338615/371472 [4:46:32<2:53:13,  3.16it/s]
 91%|█████████ | 338616/371472 [4:46:32<2:46:00,  3.30it/s]
 91%|█████████ | 338617/371472 [4:46:33<2:38:50,  3.45it/s]
 91%|█████████ | 338618/371472 [4:46:33<2:45:24,  3.31it/s]
 91%|█████████ | 338619/371472 [4:46:33<2:37:00,  3.49it/s]
 91%|█████████ | 338620/371472 [4:46:33<2:45:35,  3.31it/s]
                                                           
{'loss': 2.6288, 'learning_rate': 1.7963649292163153e-07, 'epoch': 14.59}

 91%|█████████ | 338620/371472 [4:46:33<2:45:35,  3.31it/s]
 91%|█████████ | 338621/371472 [4:46:34<2:52:26,  3.18it/s]
 91%|█████████ | 338622/371472 [4:46:34<2:44:18,  3.33it/s]
 91%|█████████ | 338623/371472 [4:46:34<2:45:10,  3.31it/s]
 91%|█████████ | 338624/371472 [4:46:35<2:40:04,  3.42it/s]
 91%|█████████ | 338625/371472 [4:46:35<2:32:45,  3.58it/s]
 91%|█████████ | 338626/371472 [4:46:35<2:37:26,  3.48it/s]
 91%|█████████ | 338627/371472 [4:46:35<2:39:43,  3.43it/s]
 91%|█████████ | 338628/371472 [4:46:36<2:33:59,  3.55it/s]
 91%|█████████ | 338629/371472 [4:46:36<2:37:57,  3.47it/s]
 91%|█████████ | 338630/371472 [4:46:36<2:40:59,  3.40it/s]
 91%|█████████ | 338631/371472 [4:46:37<2:36:15,  3.50it/s]
 91%|█████████ | 338632/371472 [4:46:37<2:31:51,  3.60it/s]
 91%|█████████ | 338633/371472 [4:46:37<2:30:18,  3.64it/s]
 91%|█████████ | 338634/371472 [4:46:37<2:30:15,  3.64it/s]
 91%|█████████ | 338635/371472 [4:46:38<2:35:30,  3.52it/s]
 91%|█████████ | 338636/371472 [4:46:38<2:32:58,  3.58it/s]
 91%|█████████ | 338637/371472 [4:46:38<2:29:37,  3.66it/s]
 91%|█████████ | 338638/371472 [4:46:39<2:32:08,  3.60it/s]
 91%|█████████ | 338639/371472 [4:46:39<2:27:41,  3.71it/s]
 91%|█████████ | 338640/371472 [4:46:39<2:45:06,  3.31it/s]
                                                           
{'loss': 2.6625, 'learning_rate': 1.795880109461527e-07, 'epoch': 14.59}

 91%|█████████ | 338640/371472 [4:46:39<2:45:06,  3.31it/s]
 91%|█████████ | 338641/371472 [4:46:39<2:36:01,  3.51it/s]
 91%|█████████ | 338642/371472 [4:46:40<2:31:59,  3.60it/s]
 91%|█████████ | 338643/371472 [4:46:40<2:31:59,  3.60it/s]
 91%|█████████ | 338644/371472 [4:46:40<2:37:11,  3.48it/s]
 91%|█████████ | 338645/371472 [4:46:41<2:32:25,  3.59it/s]
 91%|█████████ | 338646/371472 [4:46:41<2:32:31,  3.59it/s]
 91%|█████████ | 338647/371472 [4:46:41<2:31:39,  3.61it/s]
 91%|█████████ | 338648/371472 [4:46:41<2:40:58,  3.40it/s]
 91%|█████████ | 338649/371472 [4:46:42<2:38:06,  3.46it/s]
 91%|█████████ | 338650/371472 [4:46:42<2:32:23,  3.59it/s]
 91%|█████████ | 338651/371472 [4:46:42<2:30:33,  3.63it/s]
 91%|█████████ | 338652/371472 [4:46:43<2:39:06,  3.44it/s]
 91%|█████████ | 338653/371472 [4:46:43<2:44:05,  3.33it/s]
 91%|█████████ | 338654/371472 [4:46:43<2:44:51,  3.32it/s]
 91%|█████████ | 338655/371472 [4:46:44<2:50:31,  3.21it/s]
 91%|█████████ | 338656/371472 [4:46:44<2:52:48,  3.16it/s]
 91%|█████████ | 338657/371472 [4:46:44<2:44:08,  3.33it/s]
 91%|█████████ | 338658/371472 [4:46:44<2:38:42,  3.45it/s]
 91%|█████████ | 338659/371472 [4:46:45<2:35:46,  3.51it/s]
 91%|█████████ | 338660/371472 [4:46:45<2:33:37,  3.56it/s]
                                                           
{'loss': 2.5961, 'learning_rate': 1.7953952897067375e-07, 'epoch': 14.59}

 91%|█████████ | 338660/371472 [4:46:45<2:33:37,  3.56it/s]
 91%|█████████ | 338661/371472 [4:46:45<2:32:44,  3.58it/s]
 91%|█████████ | 338662/371472 [4:46:45<2:27:53,  3.70it/s]
 91%|█████████ | 338663/371472 [4:46:46<2:31:07,  3.62it/s]
 91%|█████████ | 338664/371472 [4:46:46<2:32:54,  3.58it/s]
 91%|█████████ | 338665/371472 [4:46:46<2:34:53,  3.53it/s]
 91%|█████████ | 338666/371472 [4:46:47<2:33:11,  3.57it/s]
 91%|█████████ | 338667/371472 [4:46:47<2:39:01,  3.44it/s]
 91%|█████████ | 338668/371472 [4:46:47<2:39:17,  3.43it/s]
 91%|█████████ | 338669/371472 [4:46:47<2:39:07,  3.44it/s]
 91%|█████████ | 338670/371472 [4:46:48<2:36:21,  3.50it/s]
 91%|█████████ | 338671/371472 [4:46:48<2:31:34,  3.61it/s]
 91%|█████████ | 338672/371472 [4:46:48<2:30:36,  3.63it/s]
 91%|█████████ | 338673/371472 [4:46:49<2:34:11,  3.55it/s]
 91%|█████████ | 338674/371472 [4:46:49<2:29:17,  3.66it/s]
 91%|█████████ | 338675/371472 [4:46:49<2:27:15,  3.71it/s]
 91%|█████████ | 338676/371472 [4:46:49<2:21:48,  3.85it/s]
 91%|█████████ | 338677/371472 [4:46:50<2:21:08,  3.87it/s]
 91%|█████████ | 338678/371472 [4:46:50<2:18:20,  3.95it/s]
 91%|█████████ | 338679/371472 [4:46:50<2:18:35,  3.94it/s]
 91%|█████████ | 338680/371472 [4:46:50<2:25:40,  3.75it/s]
                                                           
{'loss': 2.6832, 'learning_rate': 1.794910469951949e-07, 'epoch': 14.59}

 91%|█████████ | 338680/371472 [4:46:50<2:25:40,  3.75it/s]
 91%|█████████ | 338681/371472 [4:46:51<2:26:53,  3.72it/s]
 91%|█████████ | 338682/371472 [4:46:51<2:25:44,  3.75it/s]
 91%|█████████ | 338683/371472 [4:46:51<2:26:30,  3.73it/s]
 91%|█████████ | 338684/371472 [4:46:52<2:37:40,  3.47it/s]
 91%|█████████ | 338685/371472 [4:46:52<2:31:04,  3.62it/s]
 91%|█████████ | 338686/371472 [4:46:52<2:36:20,  3.50it/s]
 91%|█████████ | 338687/371472 [4:46:52<2:35:38,  3.51it/s]
 91%|█████████ | 338688/371472 [4:46:53<2:43:19,  3.35it/s]
 91%|█████████ | 338689/371472 [4:46:53<2:36:12,  3.50it/s]
 91%|█████████ | 338690/371472 [4:46:53<2:40:02,  3.41it/s]
 91%|█████████ | 338691/371472 [4:46:54<2:35:13,  3.52it/s]
 91%|█████████ | 338692/371472 [4:46:54<2:30:53,  3.62it/s]
 91%|█████████ | 338693/371472 [4:46:54<2:30:29,  3.63it/s]
 91%|█████████ | 338694/371472 [4:46:54<2:30:06,  3.64it/s]
 91%|█████████ | 338695/371472 [4:46:55<2:27:25,  3.71it/s]
 91%|█████████ | 338696/371472 [4:46:55<2:23:36,  3.80it/s]
 91%|█████████ | 338697/371472 [4:46:55<2:23:41,  3.80it/s]
 91%|█████████ | 338698/371472 [4:46:55<2:28:20,  3.68it/s]
 91%|█████████ | 338699/371472 [4:46:56<2:37:54,  3.46it/s]
 91%|█████████ | 338700/371472 [4:46:56<2:33:47,  3.55it/s]
                                                           
{'loss': 2.6731, 'learning_rate': 1.7944256501971597e-07, 'epoch': 14.59}

 91%|█████████ | 338700/371472 [4:46:56<2:33:47,  3.55it/s]
 91%|█████████ | 338701/371472 [4:46:56<2:37:54,  3.46it/s]
 91%|█████████ | 338702/371472 [4:46:57<2:31:45,  3.60it/s]
 91%|█████████ | 338703/371472 [4:46:57<2:37:22,  3.47it/s]
 91%|█████████ | 338704/371472 [4:46:57<2:41:04,  3.39it/s]
 91%|█████████ | 338705/371472 [4:46:57<2:44:57,  3.31it/s]
 91%|█████████ | 338706/371472 [4:46:58<2:49:41,  3.22it/s]
 91%|█████████ | 338707/371472 [4:46:58<2:41:28,  3.38it/s]
 91%|█████████ | 338708/371472 [4:46:58<2:42:29,  3.36it/s]
 91%|█████████ | 338709/371472 [4:46:59<2:34:54,  3.52it/s]
 91%|█████████ | 338710/371472 [4:46:59<2:38:08,  3.45it/s]
 91%|█████████ | 338711/371472 [4:46:59<2:35:44,  3.51it/s]
 91%|█████████ | 338712/371472 [4:46:59<2:31:12,  3.61it/s]
 91%|█████████ | 338713/371472 [4:47:00<2:26:40,  3.72it/s]
 91%|█████████ | 338714/371472 [4:47:00<2:23:24,  3.81it/s]
 91%|█████████ | 338715/371472 [4:47:00<2:25:58,  3.74it/s]
 91%|█████████ | 338716/371472 [4:47:01<2:29:12,  3.66it/s]
 91%|█████████ | 338717/371472 [4:47:01<2:29:32,  3.65it/s]
 91%|█████████ | 338718/371472 [4:47:01<2:31:45,  3.60it/s]
 91%|█████████ | 338719/371472 [4:47:01<2:33:10,  3.56it/s]
 91%|█████████ | 338720/371472 [4:47:02<2:33:14,  3.56it/s]
                                                           
{'loss': 2.5802, 'learning_rate': 1.7939408304423712e-07, 'epoch': 14.59}

 91%|█████████ | 338720/371472 [4:47:02<2:33:14,  3.56it/s]
 91%|█████████ | 338721/371472 [4:47:02<2:28:20,  3.68it/s]
 91%|█████████ | 338722/371472 [4:47:02<2:35:37,  3.51it/s]
 91%|█████████ | 338723/371472 [4:47:03<2:38:15,  3.45it/s]
 91%|█████████ | 338724/371472 [4:47:03<2:34:09,  3.54it/s]
 91%|█████████ | 338725/371472 [4:47:03<2:39:03,  3.43it/s]
 91%|█████████ | 338726/371472 [4:47:03<2:38:41,  3.44it/s]
 91%|█████████ | 338727/371472 [4:47:04<2:52:06,  3.17it/s]
 91%|█████████ | 338728/371472 [4:47:04<3:09:49,  2.87it/s]
 91%|█████████ | 338729/371472 [4:47:04<2:59:26,  3.04it/s]
 91%|█████████ | 338730/371472 [4:47:05<2:53:14,  3.15it/s]
 91%|█████████ | 338731/371472 [4:47:05<2:43:47,  3.33it/s]
 91%|█████████ | 338732/371472 [4:47:05<2:39:18,  3.43it/s]
 91%|█████████ | 338733/371472 [4:47:06<2:40:05,  3.41it/s]
 91%|█████████ | 338734/371472 [4:47:06<2:37:10,  3.47it/s]
 91%|█████████ | 338735/371472 [4:47:06<2:36:40,  3.48it/s]
 91%|█████████ | 338736/371472 [4:47:06<2:41:05,  3.39it/s]
 91%|█████████ | 338737/371472 [4:47:07<2:37:54,  3.45it/s]
 91%|█████████ | 338738/371472 [4:47:07<2:32:36,  3.57it/s]
 91%|█████████ | 338739/371472 [4:47:07<2:28:44,  3.67it/s]
 91%|█████████ | 338740/371472 [4:47:08<2:29:32,  3.65it/s]
                                                           
{'loss': 2.4937, 'learning_rate': 1.7934560106875817e-07, 'epoch': 14.59}

 91%|█████████ | 338740/371472 [4:47:08<2:29:32,  3.65it/s]
 91%|█████████ | 338741/371472 [4:47:08<2:34:09,  3.54it/s]
 91%|█████████ | 338742/371472 [4:47:08<2:34:06,  3.54it/s]
 91%|█████████ | 338743/371472 [4:47:08<2:29:36,  3.65it/s]
 91%|█████████ | 338744/371472 [4:47:09<2:26:21,  3.73it/s]
 91%|█████████ | 338745/371472 [4:47:09<2:27:05,  3.71it/s]
 91%|█████████ | 338746/371472 [4:47:09<2:30:36,  3.62it/s]
 91%|█████████ | 338747/371472 [4:47:09<2:29:01,  3.66it/s]
 91%|█████████ | 338748/371472 [4:47:10<2:30:30,  3.62it/s]
 91%|█████████ | 338749/371472 [4:47:10<2:30:17,  3.63it/s]
 91%|█████████ | 338750/371472 [4:47:10<2:38:03,  3.45it/s]
 91%|█████████ | 338751/371472 [4:47:11<2:33:13,  3.56it/s]
 91%|█████████ | 338752/371472 [4:47:11<2:32:12,  3.58it/s]
 91%|█████████ | 338753/371472 [4:47:11<2:34:05,  3.54it/s]
 91%|█████████ | 338754/371472 [4:47:11<2:29:49,  3.64it/s]
 91%|█████████ | 338755/371472 [4:47:12<2:28:29,  3.67it/s]
 91%|█████████ | 338756/371472 [4:47:12<2:28:57,  3.66it/s]
 91%|█████████ | 338757/371472 [4:47:12<2:25:05,  3.76it/s]
 91%|█████████ | 338758/371472 [4:47:13<2:32:13,  3.58it/s]
 91%|█████████ | 338759/371472 [4:47:13<2:35:31,  3.51it/s]
 91%|█████████ | 338760/371472 [4:47:13<3:04:38,  2.95it/s]
                                                           
{'loss': 2.6134, 'learning_rate': 1.7929711909327935e-07, 'epoch': 14.59}

 91%|█████████ | 338760/371472 [4:47:13<3:04:38,  2.95it/s]
 91%|█████████ | 338761/371472 [4:47:14<2:52:44,  3.16it/s]
 91%|█████████ | 338762/371472 [4:47:14<2:48:46,  3.23it/s]
 91%|█████████ | 338763/371472 [4:47:14<3:05:31,  2.94it/s]
 91%|█████████ | 338764/371472 [4:47:15<2:56:51,  3.08it/s]
 91%|█████████ | 338765/371472 [4:47:15<2:44:40,  3.31it/s]
 91%|█████████ | 338766/371472 [4:47:15<2:42:07,  3.36it/s]
 91%|█████████ | 338767/371472 [4:47:15<2:43:49,  3.33it/s]
 91%|█████████ | 338768/371472 [4:47:16<2:42:36,  3.35it/s]
 91%|█████████ | 338769/371472 [4:47:16<2:40:20,  3.40it/s]
 91%|█████████ | 338770/371472 [4:47:16<2:50:13,  3.20it/s]
 91%|█████████ | 338771/371472 [4:47:17<2:54:41,  3.12it/s]
 91%|█████████ | 338772/371472 [4:47:17<2:47:46,  3.25it/s]
 91%|█████████ | 338773/371472 [4:47:17<2:41:02,  3.38it/s]
 91%|█████████ | 338774/371472 [4:47:18<2:43:25,  3.33it/s]
 91%|█████████ | 338775/371472 [4:47:18<2:46:00,  3.28it/s]
 91%|█████████ | 338776/371472 [4:47:18<2:42:34,  3.35it/s]
 91%|█████████ | 338777/371472 [4:47:18<2:42:56,  3.34it/s]
 91%|█████████ | 338778/371472 [4:47:19<2:33:43,  3.54it/s]
 91%|█████████ | 338779/371472 [4:47:19<2:34:20,  3.53it/s]
 91%|█████████ | 338780/371472 [4:47:19<2:31:55,  3.59it/s]
                                                           
{'loss': 2.4656, 'learning_rate': 1.792486371178004e-07, 'epoch': 14.59}

 91%|█████████ | 338780/371472 [4:47:19<2:31:55,  3.59it/s]
 91%|█████████ | 338781/371472 [4:47:20<2:35:53,  3.49it/s]
 91%|█████████ | 338782/371472 [4:47:20<2:45:32,  3.29it/s]
 91%|█████████ | 338783/371472 [4:47:20<2:39:46,  3.41it/s]
 91%|█████████ | 338784/371472 [4:47:20<2:40:28,  3.39it/s]
 91%|█████████ | 338785/371472 [4:47:21<2:39:51,  3.41it/s]
 91%|█████████ | 338786/371472 [4:47:21<2:47:43,  3.25it/s]
 91%|█████████ | 338787/371472 [4:47:21<2:45:28,  3.29it/s]
 91%|█████████ | 338788/371472 [4:47:22<2:37:45,  3.45it/s]
 91%|█████████ | 338789/371472 [4:47:22<2:30:18,  3.62it/s]
 91%|█████████ | 338790/371472 [4:47:22<2:29:25,  3.65it/s]
 91%|█████████ | 338791/371472 [4:47:22<2:31:24,  3.60it/s]
 91%|█████████ | 338792/371472 [4:47:23<2:37:08,  3.47it/s]
 91%|█████████ | 338793/371472 [4:47:23<2:36:01,  3.49it/s]
 91%|█████████ | 338794/371472 [4:47:23<2:31:50,  3.59it/s]
 91%|█████████ | 338795/371472 [4:47:24<2:29:51,  3.63it/s]
 91%|█████████ | 338796/371472 [4:47:24<2:26:11,  3.73it/s]
 91%|█████████ | 338797/371472 [4:47:24<2:25:58,  3.73it/s]
 91%|█████████ | 338798/371472 [4:47:24<2:29:47,  3.64it/s]
 91%|█████████ | 338799/371472 [4:47:25<2:41:17,  3.38it/s]
 91%|█████████ | 338800/371472 [4:47:25<2:33:15,  3.55it/s]
                                                           
{'loss': 2.6006, 'learning_rate': 1.7920015514232154e-07, 'epoch': 14.59}

 91%|█████████ | 338800/371472 [4:47:25<2:33:15,  3.55it/s]
 91%|█████████ | 338801/371472 [4:47:25<2:35:58,  3.49it/s]
 91%|█████████ | 338802/371472 [4:47:25<2:33:34,  3.55it/s]
 91%|█████████ | 338803/371472 [4:47:26<2:34:45,  3.52it/s]
 91%|█████████ | 338804/371472 [4:47:26<2:33:23,  3.55it/s]
 91%|█████████ | 338805/371472 [4:47:26<2:33:27,  3.55it/s]
 91%|█████████ | 338806/371472 [4:47:27<2:28:24,  3.67it/s]
 91%|█████████ | 338807/371472 [4:47:27<2:24:41,  3.76it/s]
 91%|█████████ | 338808/371472 [4:47:27<2:35:19,  3.50it/s]
 91%|█████████ | 338809/371472 [4:47:27<2:34:31,  3.52it/s]
 91%|█████████ | 338810/371472 [4:47:28<2:35:19,  3.50it/s]
 91%|█████████ | 338811/371472 [4:47:28<2:43:14,  3.33it/s]
 91%|█████████ | 338812/371472 [4:47:28<2:35:59,  3.49it/s]
 91%|█████████ | 338813/371472 [4:47:29<2:36:58,  3.47it/s]
 91%|█████████ | 338814/371472 [4:47:29<2:35:45,  3.49it/s]
 91%|█████████ | 338815/371472 [4:47:29<2:39:06,  3.42it/s]
 91%|█████████ | 338816/371472 [4:47:29<2:33:29,  3.55it/s]
 91%|█████████ | 338817/371472 [4:47:30<2:38:39,  3.43it/s]
 91%|█████████ | 338818/371472 [4:47:30<2:34:32,  3.52it/s]
 91%|█████████ | 338819/371472 [4:47:30<2:30:18,  3.62it/s]
 91%|█████████ | 338820/371472 [4:47:31<2:28:44,  3.66it/s]
                                                           
{'loss': 2.5593, 'learning_rate': 1.7915167316684261e-07, 'epoch': 14.59}

 91%|█████████ | 338820/371472 [4:47:31<2:28:44,  3.66it/s]
 91%|█████████ | 338821/371472 [4:47:31<2:29:31,  3.64it/s]
 91%|█████████ | 338822/371472 [4:47:31<2:34:09,  3.53it/s]
 91%|█████████ | 338823/371472 [4:47:31<2:30:59,  3.60it/s]
 91%|█████████ | 338824/371472 [4:47:32<2:46:14,  3.27it/s]
 91%|█████████ | 338825/371472 [4:47:32<2:50:16,  3.20it/s]
 91%|█████████ | 338826/371472 [4:47:32<2:46:24,  3.27it/s]
 91%|█████████ | 338827/371472 [4:47:33<2:37:09,  3.46it/s]
 91%|█████████ | 338828/371472 [4:47:33<2:30:25,  3.62it/s]
 91%|█████████ | 338829/371472 [4:47:33<2:25:02,  3.75it/s]
 91%|█████████ | 338830/371472 [4:47:33<2:21:00,  3.86it/s]
 91%|█████████ | 338831/371472 [4:47:34<2:20:37,  3.87it/s]
 91%|█████████ | 338832/371472 [4:47:34<2:27:04,  3.70it/s]
 91%|█████████ | 338833/371472 [4:47:34<2:28:53,  3.65it/s]
 91%|█████████ | 338834/371472 [4:47:34<2:26:59,  3.70it/s]
 91%|█████████ | 338835/371472 [4:47:35<2:36:36,  3.47it/s]
 91%|█████████ | 338836/371472 [4:47:35<2:38:06,  3.44it/s]
 91%|█████████ | 338837/371472 [4:47:35<2:35:55,  3.49it/s]
 91%|█████████ | 338838/371472 [4:47:36<2:35:07,  3.51it/s]
 91%|█████████ | 338839/371472 [4:47:36<2:29:34,  3.64it/s]
 91%|█████████ | 338840/371472 [4:47:36<2:29:47,  3.63it/s]
                                                           
{'loss': 2.6959, 'learning_rate': 1.7910319119136377e-07, 'epoch': 14.59}

 91%|█████████ | 338840/371472 [4:47:36<2:29:47,  3.63it/s]
 91%|█████████ | 338841/371472 [4:47:37<2:33:55,  3.53it/s]
 91%|█████████ | 338842/371472 [4:47:37<2:31:18,  3.59it/s]
 91%|█████████ | 338843/371472 [4:47:37<2:29:30,  3.64it/s]
 91%|█████████ | 338844/371472 [4:47:37<2:26:35,  3.71it/s]
 91%|█████████ | 338845/371472 [4:47:38<2:23:14,  3.80it/s]
 91%|█████████ | 338846/371472 [4:47:38<2:24:14,  3.77it/s]
 91%|█████████ | 338847/371472 [4:47:38<2:25:44,  3.73it/s]
 91%|█████████ | 338848/371472 [4:47:38<2:23:30,  3.79it/s]
 91%|█████████ | 338849/371472 [4:47:39<2:34:39,  3.52it/s]
 91%|█████████ | 338850/371472 [4:47:39<2:32:55,  3.56it/s]
 91%|█████████ | 338851/371472 [4:47:39<2:31:21,  3.59it/s]
 91%|█████████ | 338852/371472 [4:47:40<2:38:55,  3.42it/s]
 91%|█████████ | 338853/371472 [4:47:40<2:45:51,  3.28it/s]
 91%|█████████ | 338854/371472 [4:47:40<2:36:55,  3.46it/s]
 91%|█████████ | 338855/371472 [4:47:40<2:40:35,  3.39it/s]
 91%|█████████ | 338856/371472 [4:47:41<2:39:17,  3.41it/s]
 91%|█████████ | 338857/371472 [4:47:41<2:49:40,  3.20it/s]
 91%|█████████ | 338858/371472 [4:47:41<2:39:32,  3.41it/s]
 91%|█████████ | 338859/371472 [4:47:42<2:43:45,  3.32it/s]
 91%|█████████ | 338860/371472 [4:47:42<2:41:17,  3.37it/s]
                                                           
{'loss': 2.5178, 'learning_rate': 1.790547092158848e-07, 'epoch': 14.6}

 91%|█████████ | 338860/371472 [4:47:42<2:41:17,  3.37it/s]
 91%|█████████ | 338861/371472 [4:47:42<2:35:07,  3.50it/s]
 91%|█████████ | 338862/371472 [4:47:42<2:29:52,  3.63it/s]
 91%|█████████ | 338863/371472 [4:47:43<2:31:12,  3.59it/s]
 91%|█████████ | 338864/371472 [4:47:43<2:29:48,  3.63it/s]
 91%|█████████ | 338865/371472 [4:47:43<2:27:11,  3.69it/s]
 91%|█████████ | 338866/371472 [4:47:44<2:33:02,  3.55it/s]
 91%|█████████ | 338867/371472 [4:47:44<2:27:17,  3.69it/s]
 91%|█████████ | 338868/371472 [4:47:44<2:29:36,  3.63it/s]
 91%|█████████ | 338869/371472 [4:47:44<2:28:45,  3.65it/s]
 91%|█████████ | 338870/371472 [4:47:45<2:33:35,  3.54it/s]
 91%|█████████ | 338871/371472 [4:47:45<2:32:09,  3.57it/s]
 91%|█████████ | 338872/371472 [4:47:45<2:30:48,  3.60it/s]
 91%|█████████ | 338873/371472 [4:47:46<2:30:55,  3.60it/s]
 91%|█████████ | 338874/371472 [4:47:46<2:30:58,  3.60it/s]
 91%|█████████ | 338875/371472 [4:47:46<2:31:13,  3.59it/s]
 91%|█████████ | 338876/371472 [4:47:46<2:33:07,  3.55it/s]
 91%|█████████ | 338877/371472 [4:47:47<2:36:03,  3.48it/s]
 91%|█████████ | 338878/371472 [4:47:47<2:32:17,  3.57it/s]
 91%|█████████ | 338879/371472 [4:47:47<2:37:38,  3.45it/s]
 91%|█████████ | 338880/371472 [4:47:48<2:34:19,  3.52it/s]
                                                           
{'loss': 2.5967, 'learning_rate': 1.79006227240406e-07, 'epoch': 14.6}

 91%|█████████ | 338880/371472 [4:47:48<2:34:19,  3.52it/s]
 91%|█████████ | 338881/371472 [4:47:48<2:29:51,  3.62it/s]
 91%|█████████ | 338882/371472 [4:47:48<2:28:06,  3.67it/s]
 91%|█████████ | 338883/371472 [4:47:48<2:38:07,  3.44it/s]
 91%|█████████ | 338884/371472 [4:47:49<2:35:11,  3.50it/s]
 91%|█████████ | 338885/371472 [4:47:49<2:30:07,  3.62it/s]
 91%|█████████ | 338886/371472 [4:47:49<2:29:50,  3.62it/s]
 91%|█████████ | 338887/371472 [4:47:49<2:28:21,  3.66it/s]
 91%|█████████ | 338888/371472 [4:47:50<2:27:25,  3.68it/s]
 91%|█████████ | 338889/371472 [4:47:50<2:24:07,  3.77it/s]
 91%|█████████ | 338890/371472 [4:47:50<2:30:33,  3.61it/s]
 91%|█████████ | 338891/371472 [4:47:51<2:51:19,  3.17it/s]
 91%|█████████ | 338892/371472 [4:47:51<2:45:40,  3.28it/s]
 91%|█████████ | 338893/371472 [4:47:51<2:39:28,  3.40it/s]
 91%|█████████ | 338894/371472 [4:47:51<2:36:44,  3.46it/s]
 91%|█████████ | 338895/371472 [4:47:52<2:33:55,  3.53it/s]
 91%|█████████ | 338896/371472 [4:47:52<2:28:57,  3.64it/s]
 91%|█████████ | 338897/371472 [4:47:52<2:34:21,  3.52it/s]
 91%|█████████ | 338898/371472 [4:47:53<2:33:27,  3.54it/s]
 91%|█████████ | 338899/371472 [4:47:53<2:30:07,  3.62it/s]
 91%|█████████ | 338900/371472 [4:47:53<2:29:29,  3.63it/s]
                                                           
{'loss': 2.5897, 'learning_rate': 1.7895774526492706e-07, 'epoch': 14.6}

 91%|█████████ | 338900/371472 [4:47:53<2:29:29,  3.63it/s]
 91%|█████████ | 338901/371472 [4:47:53<2:34:36,  3.51it/s]
 91%|█████████ | 338902/371472 [4:47:54<2:28:48,  3.65it/s]
 91%|█████████ | 338903/371472 [4:47:54<2:35:21,  3.49it/s]
 91%|█████████ | 338904/371472 [4:47:54<2:44:33,  3.30it/s]
 91%|█████████ | 338905/371472 [4:47:55<2:34:00,  3.52it/s]
 91%|█████████ | 338906/371472 [4:47:55<2:29:46,  3.62it/s]
 91%|█████████ | 338907/371472 [4:47:55<2:32:01,  3.57it/s]
 91%|█████████ | 338908/371472 [4:47:55<2:29:54,  3.62it/s]
 91%|█████████ | 338909/371472 [4:47:56<2:39:00,  3.41it/s]
 91%|█████████ | 338910/371472 [4:47:56<2:30:30,  3.61it/s]
 91%|█████████ | 338911/371472 [4:47:56<2:32:40,  3.55it/s]
 91%|█████████ | 338912/371472 [4:47:57<2:33:18,  3.54it/s]
 91%|█████████ | 338913/371472 [4:47:57<2:31:34,  3.58it/s]
 91%|█████████ | 338914/371472 [4:47:57<2:32:44,  3.55it/s]
 91%|█████████ | 338915/371472 [4:47:57<2:28:45,  3.65it/s]
 91%|█████████ | 338916/371472 [4:47:58<2:25:57,  3.72it/s]
 91%|█████████ | 338917/371472 [4:47:58<3:00:35,  3.00it/s]
 91%|█████████ | 338918/371472 [4:47:58<2:57:15,  3.06it/s]
 91%|█████████ | 338919/371472 [4:47:59<2:48:10,  3.23it/s]
 91%|█████████ | 338920/371472 [4:47:59<2:40:13,  3.39it/s]
                                                           
{'loss': 2.496, 'learning_rate': 1.7890926328944818e-07, 'epoch': 14.6}

 91%|█████████ | 338920/371472 [4:47:59<2:40:13,  3.39it/s]
 91%|█████████ | 338921/371472 [4:47:59<2:36:54,  3.46it/s]
 91%|█████████ | 338922/371472 [4:47:59<2:32:05,  3.57it/s]
 91%|█████████ | 338923/371472 [4:48:00<2:25:16,  3.73it/s]
 91%|█████████ | 338924/371472 [4:48:00<2:34:27,  3.51it/s]
 91%|█████████ | 338925/371472 [4:48:00<2:30:28,  3.60it/s]
 91%|█████████ | 338926/371472 [4:48:01<2:43:18,  3.32it/s]
 91%|█████████ | 338927/371472 [4:48:01<2:41:17,  3.36it/s]
 91%|█████████ | 338928/371472 [4:48:01<2:35:00,  3.50it/s]
 91%|█████████ | 338929/371472 [4:48:01<2:34:47,  3.50it/s]
 91%|█████████ | 338930/371472 [4:48:02<2:35:05,  3.50it/s]
 91%|█████████ | 338931/371472 [4:48:02<2:29:48,  3.62it/s]
 91%|█████████ | 338932/371472 [4:48:02<2:34:21,  3.51it/s]
 91%|█████████ | 338933/371472 [4:48:03<2:32:45,  3.55it/s]
 91%|█████████ | 338934/371472 [4:48:03<2:32:21,  3.56it/s]
 91%|█████████ | 338935/371472 [4:48:03<2:43:49,  3.31it/s]
 91%|█████████ | 338936/371472 [4:48:04<2:37:50,  3.44it/s]
 91%|█████████ | 338937/371472 [4:48:04<2:28:30,  3.65it/s]
 91%|█████████ | 338938/371472 [4:48:04<2:26:04,  3.71it/s]
 91%|█████████ | 338939/371472 [4:48:04<2:25:49,  3.72it/s]
 91%|█████████ | 338940/371472 [4:48:05<2:23:24,  3.78it/s]
                                                           
{'loss': 2.7591, 'learning_rate': 1.7886078131396925e-07, 'epoch': 14.6}

 91%|█████████ | 338940/371472 [4:48:05<2:23:24,  3.78it/s]
 91%|█████████ | 338941/371472 [4:48:05<2:26:02,  3.71it/s]
 91%|█████████ | 338942/371472 [4:48:05<2:45:18,  3.28it/s]
 91%|█████████ | 338943/371472 [4:48:05<2:41:41,  3.35it/s]
 91%|█████████ | 338944/371472 [4:48:06<2:38:42,  3.42it/s]
 91%|█████████ | 338945/371472 [4:48:06<2:48:19,  3.22it/s]
 91%|█████████ | 338946/371472 [4:48:06<2:40:07,  3.39it/s]
 91%|█████████ | 338947/371472 [4:48:07<2:35:50,  3.48it/s]
 91%|█████████ | 338948/371472 [4:48:07<2:40:57,  3.37it/s]
 91%|█████████ | 338949/371472 [4:48:07<2:38:22,  3.42it/s]
 91%|█████████ | 338950/371472 [4:48:08<2:39:10,  3.41it/s]
 91%|█████████ | 338951/371472 [4:48:08<2:40:18,  3.38it/s]
 91%|█████████ | 338952/371472 [4:48:08<2:33:25,  3.53it/s]
 91%|█████████ | 338953/371472 [4:48:08<2:40:09,  3.38it/s]
 91%|█████████ | 338954/371472 [4:48:09<2:51:11,  3.17it/s]
 91%|█████████ | 338955/371472 [4:48:09<2:41:58,  3.35it/s]
 91%|█████████ | 338956/371472 [4:48:09<2:44:12,  3.30it/s]
 91%|█████████ | 338957/371472 [4:48:10<2:44:12,  3.30it/s]
 91%|█████████ | 338958/371472 [4:48:10<2:47:20,  3.24it/s]
 91%|█████████ | 338959/371472 [4:48:10<2:42:48,  3.33it/s]
 91%|█████████ | 338960/371472 [4:48:11<3:18:50,  2.73it/s]
                                                           
{'loss': 2.5345, 'learning_rate': 1.7881229933849043e-07, 'epoch': 14.6}

 91%|█████████ | 338960/371472 [4:48:11<3:18:50,  2.73it/s]
 91%|█████████ | 338961/371472 [4:48:11<3:01:24,  2.99it/s]
 91%|█████████ | 338962/371472 [4:48:11<2:49:15,  3.20it/s]
 91%|█████████ | 338963/371472 [4:48:12<2:40:16,  3.38it/s]
 91%|█████████ | 338964/371472 [4:48:12<2:33:21,  3.53it/s]
 91%|█████████ | 338965/371472 [4:48:12<2:33:29,  3.53it/s]
 91%|█████████ | 338966/371472 [4:48:12<2:42:02,  3.34it/s]
 91%|█████████ | 338967/371472 [4:48:13<2:43:25,  3.32it/s]
 91%|█████████ | 338968/371472 [4:48:13<2:34:21,  3.51it/s]
 91%|█████████▏| 338969/371472 [4:48:13<2:31:34,  3.57it/s]
 91%|█████████▏| 338970/371472 [4:48:14<2:31:51,  3.57it/s]
 91%|█████████▏| 338971/371472 [4:48:14<2:27:25,  3.67it/s]
 91%|█████████▏| 338972/371472 [4:48:14<2:29:15,  3.63it/s]
 91%|█████████▏| 338973/371472 [4:48:14<2:26:06,  3.71it/s]
 91%|█████████▏| 338974/371472 [4:48:15<2:38:54,  3.41it/s]
 91%|█████████▏| 338975/371472 [4:48:15<2:39:24,  3.40it/s]
 91%|█████████▏| 338976/371472 [4:48:15<2:37:40,  3.43it/s]
 91%|█████████▏| 338977/371472 [4:48:15<2:30:46,  3.59it/s]
 91%|█████████▏| 338978/371472 [4:48:16<2:23:39,  3.77it/s]
 91%|█████████▏| 338979/371472 [4:48:16<2:22:59,  3.79it/s]
 91%|█████████▏| 338980/371472 [4:48:16<2:37:31,  3.44it/s]
                                                           
{'loss': 2.7493, 'learning_rate': 1.7876381736301148e-07, 'epoch': 14.6}

 91%|█████████▏| 338980/371472 [4:48:16<2:37:31,  3.44it/s]
 91%|█████████▏| 338981/371472 [4:48:17<2:34:20,  3.51it/s]
 91%|█████████▏| 338982/371472 [4:48:17<2:54:28,  3.10it/s]
 91%|█████████▏| 338983/371472 [4:48:17<2:58:18,  3.04it/s]
 91%|█████████▏| 338984/371472 [4:48:18<2:49:56,  3.19it/s]
 91%|█████████▏| 338985/371472 [4:48:18<2:42:50,  3.32it/s]
 91%|█████████▏| 338986/371472 [4:48:18<2:51:46,  3.15it/s]
 91%|█████████▏| 338987/371472 [4:48:19<2:42:56,  3.32it/s]
 91%|█████████▏| 338988/371472 [4:48:19<2:36:10,  3.47it/s]
 91%|█████████▏| 338989/371472 [4:48:19<2:32:47,  3.54it/s]
 91%|█████████▏| 338990/371472 [4:48:19<2:31:06,  3.58it/s]
 91%|█████████▏| 338991/371472 [4:48:20<2:33:30,  3.53it/s]
 91%|█████████▏| 338992/371472 [4:48:20<2:35:47,  3.47it/s]
 91%|█████████▏| 338993/371472 [4:48:20<2:34:04,  3.51it/s]
 91%|█████████▏| 338994/371472 [4:48:20<2:31:10,  3.58it/s]
 91%|█████████▏| 338995/371472 [4:48:21<2:32:16,  3.55it/s]
 91%|█████████▏| 338996/371472 [4:48:21<2:27:44,  3.66it/s]
 91%|█████████▏| 338997/371472 [4:48:21<2:26:13,  3.70it/s]
 91%|█████████▏| 338998/371472 [4:48:22<2:24:40,  3.74it/s]
 91%|█████████▏| 338999/371472 [4:48:22<2:22:15,  3.80it/s]
 91%|█████████▏| 339000/371472 [4:48:22<2:21:00,  3.84it/s]
                                                           
{'loss': 2.694, 'learning_rate': 1.7871533538753263e-07, 'epoch': 14.6}

 91%|█████████▏| 339000/371472 [4:48:22<2:21:00,  3.84it/s]
 91%|█████████▏| 339001/371472 [4:48:22<2:31:46,  3.57it/s]
 91%|█████████▏| 339002/371472 [4:48:23<2:36:41,  3.45it/s]
 91%|█████████▏| 339003/371472 [4:48:23<2:37:56,  3.43it/s]
 91%|█████████▏| 339004/371472 [4:48:23<2:49:56,  3.18it/s]
 91%|█████████▏| 339005/371472 [4:48:24<2:47:24,  3.23it/s]
 91%|█████████▏| 339006/371472 [4:48:24<2:42:37,  3.33it/s]
 91%|█████████▏| 339007/371472 [4:48:24<2:38:08,  3.42it/s]
 91%|█████████▏| 339008/371472 [4:48:24<2:34:38,  3.50it/s]
 91%|█████████▏| 339009/371472 [4:48:25<2:59:14,  3.02it/s]
 91%|█████████▏| 339010/371472 [4:48:25<2:51:02,  3.16it/s]
 91%|█████████▏| 339011/371472 [4:48:25<2:41:18,  3.35it/s]
 91%|█████████▏| 339012/371472 [4:48:26<2:40:57,  3.36it/s]
 91%|█████████▏| 339013/371472 [4:48:26<2:33:17,  3.53it/s]
 91%|█████████▏| 339014/371472 [4:48:26<2:37:40,  3.43it/s]
 91%|█████████▏| 339015/371472 [4:48:27<2:33:00,  3.54it/s]
 91%|█████████▏| 339016/371472 [4:48:27<2:43:28,  3.31it/s]
 91%|█████████▏| 339017/371472 [4:48:27<2:40:12,  3.38it/s]
 91%|█████████▏| 339018/371472 [4:48:28<2:45:54,  3.26it/s]
 91%|█████████▏| 339019/371472 [4:48:28<2:42:35,  3.33it/s]
 91%|█████████▏| 339020/371472 [4:48:28<2:38:38,  3.41it/s]
                                                           
{'loss': 2.5914, 'learning_rate': 1.786668534120537e-07, 'epoch': 14.6}

 91%|█████████▏| 339020/371472 [4:48:28<2:38:38,  3.41it/s]
 91%|█████████▏| 339021/371472 [4:48:28<2:30:23,  3.60it/s]
 91%|█████████▏| 339022/371472 [4:48:29<2:25:05,  3.73it/s]
 91%|█████████▏| 339023/371472 [4:48:29<2:27:01,  3.68it/s]
 91%|█████████▏| 339024/371472 [4:48:29<2:22:22,  3.80it/s]
 91%|█████████▏| 339025/371472 [4:48:29<2:20:14,  3.86it/s]
 91%|█████████▏| 339026/371472 [4:48:30<2:20:28,  3.85it/s]
 91%|█████████▏| 339027/371472 [4:48:30<2:23:27,  3.77it/s]
 91%|█████████▏| 339028/371472 [4:48:30<2:23:40,  3.76it/s]
 91%|█████████▏| 339029/371472 [4:48:30<2:28:32,  3.64it/s]
 91%|█████████▏| 339030/371472 [4:48:31<2:29:45,  3.61it/s]
 91%|█████████▏| 339031/371472 [4:48:31<2:33:56,  3.51it/s]
 91%|█████████▏| 339032/371472 [4:48:31<2:32:48,  3.54it/s]
 91%|█████████▏| 339033/371472 [4:48:32<2:29:36,  3.61it/s]
 91%|█████████▏| 339034/371472 [4:48:32<2:35:28,  3.48it/s]
 91%|█████████▏| 339035/371472 [4:48:32<2:34:45,  3.49it/s]
 91%|█████████▏| 339036/371472 [4:48:32<2:34:39,  3.50it/s]
 91%|█████████▏| 339037/371472 [4:48:33<2:41:52,  3.34it/s]
 91%|█████████▏| 339038/371472 [4:48:33<2:38:57,  3.40it/s]
 91%|█████████▏| 339039/371472 [4:48:33<2:35:28,  3.48it/s]
 91%|█████████▏| 339040/371472 [4:48:34<2:45:08,  3.27it/s]
                                                           
{'loss': 2.5996, 'learning_rate': 1.7861837143657485e-07, 'epoch': 14.6}

 91%|█████████▏| 339040/371472 [4:48:34<2:45:08,  3.27it/s]
 91%|█████████▏| 339041/371472 [4:48:34<2:41:31,  3.35it/s]
 91%|█████████▏| 339042/371472 [4:48:34<2:37:48,  3.42it/s]
 91%|█████████▏| 339043/371472 [4:48:35<2:36:16,  3.46it/s]
 91%|█████████▏| 339044/371472 [4:48:35<2:34:47,  3.49it/s]
 91%|█████████▏| 339045/371472 [4:48:35<2:38:42,  3.41it/s]
 91%|█████████▏| 339046/371472 [4:48:35<2:46:02,  3.25it/s]
 91%|█████████▏| 339047/371472 [4:48:36<2:37:39,  3.43it/s]
 91%|█████████▏| 339048/371472 [4:48:36<2:34:49,  3.49it/s]
 91%|█████████▏| 339049/371472 [4:48:36<2:34:22,  3.50it/s]
 91%|█████████▏| 339050/371472 [4:48:37<2:28:22,  3.64it/s]
 91%|█████████▏| 339051/371472 [4:48:37<2:36:37,  3.45it/s]
 91%|█████████▏| 339052/371472 [4:48:37<2:28:49,  3.63it/s]
 91%|█████████▏| 339053/371472 [4:48:37<2:28:42,  3.63it/s]
 91%|█████████▏| 339054/371472 [4:48:38<2:29:33,  3.61it/s]
 91%|█████████▏| 339055/371472 [4:48:38<2:27:53,  3.65it/s]
 91%|█████████▏| 339056/371472 [4:48:38<2:26:15,  3.69it/s]
 91%|█████████▏| 339057/371472 [4:48:38<2:22:52,  3.78it/s]
 91%|█████████▏| 339058/371472 [4:48:39<2:25:44,  3.71it/s]
 91%|█████████▏| 339059/371472 [4:48:39<2:31:17,  3.57it/s]
 91%|█████████▏| 339060/371472 [4:48:39<2:28:22,  3.64it/s]
                                                           
{'loss': 2.7092, 'learning_rate': 1.785698894610959e-07, 'epoch': 14.6}

 91%|█████████▏| 339060/371472 [4:48:39<2:28:22,  3.64it/s]
 91%|█████████▏| 339061/371472 [4:48:40<2:30:50,  3.58it/s]
 91%|█████████▏| 339062/371472 [4:48:40<2:31:04,  3.58it/s]
 91%|█████████▏| 339063/371472 [4:48:40<2:31:11,  3.57it/s]
 91%|█████████▏| 339064/371472 [4:48:40<2:26:16,  3.69it/s]
 91%|█████████▏| 339065/371472 [4:48:41<2:24:16,  3.74it/s]
 91%|█████████▏| 339066/371472 [4:48:41<2:28:29,  3.64it/s]
 91%|█████████▏| 339067/371472 [4:48:41<2:25:16,  3.72it/s]
 91%|█████████▏| 339068/371472 [4:48:41<2:26:57,  3.67it/s]
 91%|█████████▏| 339069/371472 [4:48:42<2:24:20,  3.74it/s]
 91%|█████████▏| 339070/371472 [4:48:42<2:25:18,  3.72it/s]
 91%|█████████▏| 339071/371472 [4:48:42<2:23:36,  3.76it/s]
 91%|█████████▏| 339072/371472 [4:48:42<2:19:07,  3.88it/s]
 91%|█████████▏| 339073/371472 [4:48:43<2:20:16,  3.85it/s]
 91%|█████████▏| 339074/371472 [4:48:43<2:22:59,  3.78it/s]
 91%|█████████▏| 339075/371472 [4:48:43<2:28:45,  3.63it/s]
 91%|█████████▏| 339076/371472 [4:48:44<2:29:39,  3.61it/s]
 91%|█████████▏| 339077/371472 [4:48:44<2:32:54,  3.53it/s]
 91%|█████████▏| 339078/371472 [4:48:44<2:28:06,  3.65it/s]
 91%|█████████▏| 339079/371472 [4:48:44<2:27:59,  3.65it/s]
 91%|█████████▏| 339080/371472 [4:48:45<2:26:14,  3.69it/s]
                                                           
{'loss': 2.6678, 'learning_rate': 1.7852140748561697e-07, 'epoch': 14.6}

 91%|█████████▏| 339080/371472 [4:48:45<2:26:14,  3.69it/s]
 91%|█████████▏| 339081/371472 [4:48:45<2:33:38,  3.51it/s]
 91%|█████████▏| 339082/371472 [4:48:45<2:35:05,  3.48it/s]
 91%|█████████▏| 339083/371472 [4:48:46<2:31:17,  3.57it/s]
 91%|█████████▏| 339084/371472 [4:48:46<2:33:56,  3.51it/s]
 91%|█████████▏| 339085/371472 [4:48:46<2:33:52,  3.51it/s]
 91%|█████████▏| 339086/371472 [4:48:46<2:31:54,  3.55it/s]
 91%|█████████▏| 339087/371472 [4:48:47<2:29:45,  3.60it/s]
 91%|█████████▏| 339088/371472 [4:48:47<2:30:27,  3.59it/s]
 91%|█████████▏| 339089/371472 [4:48:47<2:29:21,  3.61it/s]
 91%|█████████▏| 339090/371472 [4:48:47<2:22:31,  3.79it/s]
 91%|█████████▏| 339091/371472 [4:48:48<2:37:20,  3.43it/s]
 91%|█████████▏| 339092/371472 [4:48:48<2:40:35,  3.36it/s]
 91%|█████████▏| 339093/371472 [4:48:48<2:39:57,  3.37it/s]
 91%|█████████▏| 339094/371472 [4:48:49<2:35:15,  3.48it/s]
 91%|█████████▏| 339095/371472 [4:48:49<2:30:22,  3.59it/s]
 91%|█████████▏| 339096/371472 [4:48:49<2:28:45,  3.63it/s]
 91%|█████████▏| 339097/371472 [4:48:50<2:30:39,  3.58it/s]
 91%|█████████▏| 339098/371472 [4:48:50<2:29:19,  3.61it/s]
 91%|█████████▏| 339099/371472 [4:48:50<2:25:52,  3.70it/s]
 91%|█████████▏| 339100/371472 [4:48:50<2:22:24,  3.79it/s]
                                                           
{'loss': 2.7574, 'learning_rate': 1.7847292551013812e-07, 'epoch': 14.61}

 91%|█████████▏| 339100/371472 [4:48:50<2:22:24,  3.79it/s]
 91%|█████████▏| 339101/371472 [4:48:51<2:31:47,  3.55it/s]
 91%|█████████▏| 339102/371472 [4:48:51<2:41:08,  3.35it/s]
 91%|█████████▏| 339103/371472 [4:48:51<2:33:49,  3.51it/s]
 91%|█████████▏| 339104/371472 [4:48:51<2:34:30,  3.49it/s]
 91%|█████████▏| 339105/371472 [4:48:52<2:29:24,  3.61it/s]
 91%|█████████▏| 339106/371472 [4:48:52<2:32:42,  3.53it/s]
 91%|█████████▏| 339107/371472 [4:48:52<2:29:06,  3.62it/s]
 91%|█████████▏| 339108/371472 [4:48:53<2:35:55,  3.46it/s]
 91%|█████████▏| 339109/371472 [4:48:53<2:40:21,  3.36it/s]
 91%|█████████▏| 339110/371472 [4:48:53<2:41:20,  3.34it/s]
 91%|█████████▏| 339111/371472 [4:48:54<2:47:09,  3.23it/s]
 91%|█████████▏| 339112/371472 [4:48:54<2:52:20,  3.13it/s]
 91%|█████████▏| 339113/371472 [4:48:54<3:01:08,  2.98it/s]
 91%|█████████▏| 339114/371472 [4:48:55<3:02:43,  2.95it/s]
 91%|█████████▏| 339115/371472 [4:48:55<2:53:27,  3.11it/s]
 91%|█████████▏| 339116/371472 [4:48:55<2:51:10,  3.15it/s]
 91%|█████████▏| 339117/371472 [4:48:55<2:40:40,  3.36it/s]
 91%|█████████▏| 339118/371472 [4:48:56<2:40:30,  3.36it/s]
 91%|█████████▏| 339119/371472 [4:48:56<2:39:55,  3.37it/s]
 91%|█████████▏| 339120/371472 [4:48:56<2:38:25,  3.40it/s]
                                                           
{'loss': 2.5218, 'learning_rate': 1.7842444353465916e-07, 'epoch': 14.61}

 91%|█████████▏| 339120/371472 [4:48:56<2:38:25,  3.40it/s]
 91%|█████████▏| 339121/371472 [4:48:57<2:48:07,  3.21it/s]
 91%|█████████▏| 339122/371472 [4:48:57<2:45:51,  3.25it/s]
 91%|█████████▏| 339123/371472 [4:48:57<2:40:13,  3.36it/s]
 91%|█████████▏| 339124/371472 [4:48:58<2:30:31,  3.58it/s]
 91%|█████████▏| 339125/371472 [4:48:58<2:29:00,  3.62it/s]
 91%|█████████▏| 339126/371472 [4:48:58<2:32:20,  3.54it/s]
 91%|█████████▏| 339127/371472 [4:48:58<2:33:51,  3.50it/s]
 91%|█████████▏| 339128/371472 [4:48:59<2:33:34,  3.51it/s]
 91%|█████████▏| 339129/371472 [4:48:59<2:31:10,  3.57it/s]
 91%|█████████▏| 339130/371472 [4:48:59<2:27:18,  3.66it/s]
 91%|█████████▏| 339131/371472 [4:48:59<2:23:47,  3.75it/s]
 91%|█████████▏| 339132/371472 [4:49:00<2:23:37,  3.75it/s]
 91%|█████████▏| 339133/371472 [4:49:00<2:28:25,  3.63it/s]
 91%|█████████▏| 339134/371472 [4:49:00<2:35:37,  3.46it/s]
 91%|█████████▏| 339135/371472 [4:49:01<2:30:07,  3.59it/s]
 91%|█████████▏| 339136/371472 [4:49:01<2:25:05,  3.71it/s]
 91%|█████████▏| 339137/371472 [4:49:01<2:24:55,  3.72it/s]
 91%|█████████▏| 339138/371472 [4:49:01<2:25:26,  3.71it/s]
 91%|█████████▏| 339139/371472 [4:49:02<2:20:58,  3.82it/s]
 91%|█████████▏| 339140/371472 [4:49:02<2:24:17,  3.73it/s]
                                                           
{'loss': 2.6695, 'learning_rate': 1.7837596155918034e-07, 'epoch': 14.61}

 91%|█████████▏| 339140/371472 [4:49:02<2:24:17,  3.73it/s]
 91%|█████████▏| 339141/371472 [4:49:02<2:25:09,  3.71it/s]
 91%|█████████▏| 339142/371472 [4:49:02<2:30:30,  3.58it/s]
 91%|█████████▏| 339143/371472 [4:49:03<2:43:41,  3.29it/s]
 91%|█████████▏| 339144/371472 [4:49:03<2:50:41,  3.16it/s]
 91%|█████████▏| 339145/371472 [4:49:03<2:42:03,  3.32it/s]
 91%|█████████▏| 339146/371472 [4:49:04<2:56:36,  3.05it/s]
 91%|█████████▏| 339147/371472 [4:49:04<2:48:12,  3.20it/s]
 91%|█████████▏| 339148/371472 [4:49:04<2:41:57,  3.33it/s]
 91%|█████████▏| 339149/371472 [4:49:05<2:34:32,  3.49it/s]
 91%|█████████▏| 339150/371472 [4:49:05<2:31:56,  3.55it/s]
 91%|█████████▏| 339151/371472 [4:49:05<2:29:29,  3.60it/s]
 91%|█████████▏| 339152/371472 [4:49:05<2:27:54,  3.64it/s]
 91%|█████████▏| 339153/371472 [4:49:06<2:30:34,  3.58it/s]
 91%|█████████▏| 339154/371472 [4:49:06<2:33:12,  3.52it/s]
 91%|█████████▏| 339155/371472 [4:49:06<2:29:29,  3.60it/s]
 91%|█████████▏| 339156/371472 [4:49:07<2:26:45,  3.67it/s]
 91%|█████████▏| 339157/371472 [4:49:07<2:32:21,  3.53it/s]
 91%|█████████▏| 339158/371472 [4:49:07<2:32:37,  3.53it/s]
 91%|█████████▏| 339159/371472 [4:49:07<2:35:42,  3.46it/s]
 91%|█████████▏| 339160/371472 [4:49:08<2:36:20,  3.44it/s]
                                                           
{'loss': 2.4204, 'learning_rate': 1.7832747958370139e-07, 'epoch': 14.61}

 91%|█████████▏| 339160/371472 [4:49:08<2:36:20,  3.44it/s]
 91%|█████████▏| 339161/371472 [4:49:08<2:34:34,  3.48it/s]
 91%|█████████▏| 339162/371472 [4:49:08<2:31:39,  3.55it/s]
 91%|█████████▏| 339163/371472 [4:49:09<2:27:34,  3.65it/s]
 91%|█████████▏| 339164/371472 [4:49:09<2:34:16,  3.49it/s]
 91%|█████████▏| 339165/371472 [4:49:09<2:31:03,  3.56it/s]
 91%|█████████▏| 339166/371472 [4:49:09<2:32:54,  3.52it/s]
 91%|█████████▏| 339167/371472 [4:49:10<2:28:44,  3.62it/s]
 91%|█████████▏| 339168/371472 [4:49:10<2:26:49,  3.67it/s]
 91%|█████████▏| 339169/371472 [4:49:10<2:22:01,  3.79it/s]
 91%|█████████▏| 339170/371472 [4:49:10<2:28:32,  3.62it/s]
 91%|█████████▏| 339171/371472 [4:49:11<2:46:17,  3.24it/s]
 91%|█████████▏| 339172/371472 [4:49:11<2:39:58,  3.37it/s]
 91%|█████████▏| 339173/371472 [4:49:11<2:43:49,  3.29it/s]
 91%|█████████▏| 339174/371472 [4:49:12<2:41:40,  3.33it/s]
 91%|█████████▏| 339175/371472 [4:49:12<2:44:27,  3.27it/s]
 91%|█████████▏| 339176/371472 [4:49:12<2:48:31,  3.19it/s]
 91%|█████████▏| 339177/371472 [4:49:13<2:42:49,  3.31it/s]
 91%|█████████▏| 339178/371472 [4:49:13<2:39:52,  3.37it/s]
 91%|█████████▏| 339179/371472 [4:49:13<2:39:38,  3.37it/s]
 91%|█████████▏| 339180/371472 [4:49:14<2:39:43,  3.37it/s]
                                                           
{'loss': 2.5512, 'learning_rate': 1.7827899760822254e-07, 'epoch': 14.61}

 91%|█████████▏| 339180/371472 [4:49:14<2:39:43,  3.37it/s]
 91%|█████████▏| 339181/371472 [4:49:14<2:33:17,  3.51it/s]
 91%|█████████▏| 339182/371472 [4:49:14<2:37:50,  3.41it/s]
 91%|█████████▏| 339183/371472 [4:49:14<2:46:35,  3.23it/s]
 91%|█████████▏| 339184/371472 [4:49:15<2:43:22,  3.29it/s]
 91%|█████████▏| 339185/371472 [4:49:15<2:35:58,  3.45it/s]
 91%|█████████▏| 339186/371472 [4:49:15<2:37:40,  3.41it/s]
 91%|█████████▏| 339187/371472 [4:49:16<2:37:29,  3.42it/s]
 91%|█████████▏| 339188/371472 [4:49:16<2:38:50,  3.39it/s]
 91%|█████████▏| 339189/371472 [4:49:16<2:36:25,  3.44it/s]
 91%|█████████▏| 339190/371472 [4:49:16<2:30:03,  3.59it/s]
 91%|█████████▏| 339191/371472 [4:49:17<2:36:26,  3.44it/s]
 91%|█████████▏| 339192/371472 [4:49:17<2:41:54,  3.32it/s]
 91%|█████████▏| 339193/371472 [4:49:17<2:52:45,  3.11it/s]
 91%|█████████▏| 339194/371472 [4:49:18<2:46:24,  3.23it/s]
 91%|█████████▏| 339195/371472 [4:49:18<2:48:11,  3.20it/s]
 91%|█████████▏| 339196/371472 [4:49:18<2:46:15,  3.24it/s]
 91%|█████████▏| 339197/371472 [4:49:19<2:40:34,  3.35it/s]
 91%|█████████▏| 339198/371472 [4:49:19<2:34:08,  3.49it/s]
 91%|█████████▏| 339199/371472 [4:49:19<2:33:10,  3.51it/s]
 91%|█████████▏| 339200/371472 [4:49:19<2:29:13,  3.60it/s]
                                                           
{'loss': 2.6443, 'learning_rate': 1.782305156327436e-07, 'epoch': 14.61}

 91%|█████████▏| 339200/371472 [4:49:19<2:29:13,  3.60it/s]
 91%|█████████▏| 339201/371472 [4:49:20<2:34:10,  3.49it/s]
 91%|█████████▏| 339202/371472 [4:49:20<2:33:40,  3.50it/s]
 91%|█████████▏| 339203/371472 [4:49:20<2:45:18,  3.25it/s]
 91%|█████████▏| 339204/371472 [4:49:21<2:37:45,  3.41it/s]
 91%|█████████▏| 339205/371472 [4:49:21<2:47:34,  3.21it/s]
 91%|█████████▏| 339206/371472 [4:49:21<2:45:27,  3.25it/s]
 91%|█████████▏| 339207/371472 [4:49:22<2:44:31,  3.27it/s]
 91%|█████████▏| 339208/371472 [4:49:22<2:37:19,  3.42it/s]
 91%|█████████▏| 339209/371472 [4:49:22<2:29:03,  3.61it/s]
 91%|█████████▏| 339210/371472 [4:49:22<2:27:12,  3.65it/s]
 91%|█████████▏| 339211/371472 [4:49:23<2:26:36,  3.67it/s]
 91%|█████████▏| 339212/371472 [4:49:23<2:30:37,  3.57it/s]
 91%|█████████▏| 339213/371472 [4:49:23<2:47:37,  3.21it/s]
 91%|█████████▏| 339214/371472 [4:49:24<2:45:57,  3.24it/s]
 91%|█████████▏| 339215/371472 [4:49:24<2:41:15,  3.33it/s]
 91%|█████████▏| 339216/371472 [4:49:24<2:37:26,  3.41it/s]
 91%|█████████▏| 339217/371472 [4:49:24<2:38:28,  3.39it/s]
 91%|█████████▏| 339218/371472 [4:49:25<2:38:05,  3.40it/s]
 91%|█████████▏| 339219/371472 [4:49:25<2:40:24,  3.35it/s]
 91%|█████████▏| 339220/371472 [4:49:25<2:39:33,  3.37it/s]
                                                           
{'loss': 2.6351, 'learning_rate': 1.7818203365726476e-07, 'epoch': 14.61}

 91%|█████████▏| 339220/371472 [4:49:25<2:39:33,  3.37it/s]
 91%|█████████▏| 339221/371472 [4:49:26<2:35:55,  3.45it/s]
 91%|█████████▏| 339222/371472 [4:49:26<2:43:39,  3.28it/s]
 91%|█████████▏| 339223/371472 [4:49:26<2:45:39,  3.24it/s]
 91%|█████████▏| 339224/371472 [4:49:27<2:46:14,  3.23it/s]
 91%|█████████▏| 339225/371472 [4:49:27<2:47:05,  3.22it/s]
 91%|█████████▏| 339226/371472 [4:49:27<2:50:10,  3.16it/s]
 91%|█████████▏| 339227/371472 [4:49:28<2:41:28,  3.33it/s]
 91%|█████████▏| 339228/371472 [4:49:28<2:40:49,  3.34it/s]
 91%|█████████▏| 339229/371472 [4:49:28<2:41:04,  3.34it/s]
 91%|█████████▏| 339230/371472 [4:49:28<2:38:45,  3.38it/s]
 91%|█████████▏| 339231/371472 [4:49:29<2:34:52,  3.47it/s]
 91%|█████████▏| 339232/371472 [4:49:29<2:32:48,  3.52it/s]
 91%|█████████▏| 339233/371472 [4:49:29<2:30:04,  3.58it/s]
 91%|█████████▏| 339234/371472 [4:49:30<2:37:18,  3.42it/s]
 91%|█████████▏| 339235/371472 [4:49:30<2:37:18,  3.42it/s]
 91%|█████████▏| 339236/371472 [4:49:30<2:34:38,  3.47it/s]
 91%|█████████▏| 339237/371472 [4:49:30<2:38:11,  3.40it/s]
 91%|█████████▏| 339238/371472 [4:49:31<2:31:46,  3.54it/s]
 91%|█████████▏| 339239/371472 [4:49:31<2:30:52,  3.56it/s]
 91%|█████████▏| 339240/371472 [4:49:31<2:25:29,  3.69it/s]
                                                           
{'loss': 2.6114, 'learning_rate': 1.781335516817858e-07, 'epoch': 14.61}

 91%|█████████▏| 339240/371472 [4:49:31<2:25:29,  3.69it/s]
 91%|█████████▏| 339241/371472 [4:49:31<2:24:40,  3.71it/s]
 91%|█████████▏| 339242/371472 [4:49:32<2:27:04,  3.65it/s]
 91%|█████████▏| 339243/371472 [4:49:32<2:24:36,  3.71it/s]
 91%|█████████▏| 339244/371472 [4:49:32<2:21:26,  3.80it/s]
 91%|█████████▏| 339245/371472 [4:49:33<2:27:09,  3.65it/s]
 91%|█████████▏| 339246/371472 [4:49:33<2:27:40,  3.64it/s]
 91%|█████████▏| 339247/371472 [4:49:33<2:28:51,  3.61it/s]
 91%|█████████▏| 339248/371472 [4:49:33<2:24:49,  3.71it/s]
 91%|█████████▏| 339249/371472 [4:49:34<2:33:17,  3.50it/s]
 91%|█████████▏| 339250/371472 [4:49:34<2:28:55,  3.61it/s]
 91%|█████████▏| 339251/371472 [4:49:34<2:32:02,  3.53it/s]
 91%|█████████▏| 339252/371472 [4:49:35<2:29:41,  3.59it/s]
 91%|█████████▏| 339253/371472 [4:49:35<2:35:50,  3.45it/s]
 91%|█████████▏| 339254/371472 [4:49:35<2:31:36,  3.54it/s]
 91%|█████████▏| 339255/371472 [4:49:35<2:30:08,  3.58it/s]
 91%|█████████▏| 339256/371472 [4:49:36<2:27:22,  3.64it/s]
 91%|█████████▏| 339257/371472 [4:49:36<2:31:05,  3.55it/s]
 91%|█████████▏| 339258/371472 [4:49:36<2:31:23,  3.55it/s]
 91%|█████████▏| 339259/371472 [4:49:37<2:34:31,  3.47it/s]
 91%|█████████▏| 339260/371472 [4:49:37<2:32:43,  3.52it/s]
                                                           
{'loss': 2.749, 'learning_rate': 1.7808506970630698e-07, 'epoch': 14.61}

 91%|█████████▏| 339260/371472 [4:49:37<2:32:43,  3.52it/s]
 91%|█████████▏| 339261/371472 [4:49:37<2:33:45,  3.49it/s]
 91%|█████████▏| 339262/371472 [4:49:37<2:28:51,  3.61it/s]
 91%|█████████▏| 339263/371472 [4:49:38<2:33:13,  3.50it/s]
 91%|█████████▏| 339264/371472 [4:49:38<2:28:48,  3.61it/s]
 91%|█████████▏| 339265/371472 [4:49:38<2:27:02,  3.65it/s]
 91%|█████████▏| 339266/371472 [4:49:38<2:27:55,  3.63it/s]
 91%|█████████▏| 339267/371472 [4:49:39<2:24:39,  3.71it/s]
 91%|█████████▏| 339268/371472 [4:49:39<2:24:23,  3.72it/s]
 91%|█████████▏| 339269/371472 [4:49:39<2:25:03,  3.70it/s]
 91%|█████████▏| 339270/371472 [4:49:40<2:29:56,  3.58it/s]
 91%|█████████▏| 339271/371472 [4:49:40<2:26:11,  3.67it/s]
 91%|█████████▏| 339272/371472 [4:49:40<2:31:42,  3.54it/s]
 91%|█████████▏| 339273/371472 [4:49:40<2:44:15,  3.27it/s]
 91%|█████████▏| 339274/371472 [4:49:41<2:35:58,  3.44it/s]
 91%|█████████▏| 339275/371472 [4:49:41<2:29:22,  3.59it/s]
 91%|█████████▏| 339276/371472 [4:49:41<2:36:48,  3.42it/s]
 91%|█████████▏| 339277/371472 [4:49:42<2:50:18,  3.15it/s]
 91%|█████████▏| 339278/371472 [4:49:42<2:42:24,  3.30it/s]
 91%|█████████▏| 339279/371472 [4:49:42<2:40:14,  3.35it/s]
 91%|█████████▏| 339280/371472 [4:49:43<2:37:37,  3.40it/s]
                                                           
{'loss': 2.5861, 'learning_rate': 1.7803658773082805e-07, 'epoch': 14.61}

 91%|█████████▏| 339280/371472 [4:49:43<2:37:37,  3.40it/s]
 91%|█████████▏| 339281/371472 [4:49:43<2:51:01,  3.14it/s]
 91%|█████████▏| 339282/371472 [4:49:43<2:43:09,  3.29it/s]
 91%|█████████▏| 339283/371472 [4:49:43<2:37:50,  3.40it/s]
 91%|█████████▏| 339284/371472 [4:49:44<2:38:16,  3.39it/s]
 91%|█████████▏| 339285/371472 [4:49:44<2:35:28,  3.45it/s]
 91%|█████████▏| 339286/371472 [4:49:44<2:29:46,  3.58it/s]
 91%|█████████▏| 339287/371472 [4:49:45<2:30:47,  3.56it/s]
 91%|█████████▏| 339288/371472 [4:49:45<2:28:52,  3.60it/s]
 91%|█████████▏| 339289/371472 [4:49:45<2:23:07,  3.75it/s]
 91%|█████████▏| 339290/371472 [4:49:45<2:22:16,  3.77it/s]
 91%|█████████▏| 339291/371472 [4:49:46<2:20:23,  3.82it/s]
 91%|█████████▏| 339292/371472 [4:49:46<2:25:06,  3.70it/s]
 91%|█████████▏| 339293/371472 [4:49:46<2:25:22,  3.69it/s]
 91%|█████████▏| 339294/371472 [4:49:46<2:24:29,  3.71it/s]
 91%|█████████▏| 339295/371472 [4:49:47<2:22:24,  3.77it/s]
 91%|█████████▏| 339296/371472 [4:49:47<2:21:09,  3.80it/s]
 91%|█████████▏| 339297/371472 [4:49:47<2:43:52,  3.27it/s]
 91%|█████████▏| 339298/371472 [4:49:48<2:37:47,  3.40it/s]
 91%|█████████▏| 339299/371472 [4:49:48<2:29:50,  3.58it/s]
 91%|█████████▏| 339300/371472 [4:49:48<2:30:25,  3.56it/s]
                                                           
{'loss': 2.5905, 'learning_rate': 1.7798810575534918e-07, 'epoch': 14.61}

 91%|█████████▏| 339300/371472 [4:49:48<2:30:25,  3.56it/s]
 91%|█████████▏| 339301/371472 [4:49:48<2:25:24,  3.69it/s]
 91%|█████████▏| 339302/371472 [4:49:49<2:24:30,  3.71it/s]
 91%|█████████▏| 339303/371472 [4:49:49<2:23:25,  3.74it/s]
 91%|█████████▏| 339304/371472 [4:49:49<2:22:28,  3.76it/s]
 91%|█████████▏| 339305/371472 [4:49:50<2:39:31,  3.36it/s]
 91%|█████████▏| 339306/371472 [4:49:50<2:40:10,  3.35it/s]
 91%|█████████▏| 339307/371472 [4:49:50<2:37:48,  3.40it/s]
 91%|█████████▏| 339308/371472 [4:49:50<2:35:47,  3.44it/s]
 91%|█████████▏| 339309/371472 [4:49:51<2:30:46,  3.56it/s]
 91%|█████████▏| 339310/371472 [4:49:51<2:32:40,  3.51it/s]
 91%|█████████▏| 339311/371472 [4:49:51<2:26:56,  3.65it/s]
 91%|█████████▏| 339312/371472 [4:49:51<2:22:25,  3.76it/s]
 91%|█████████▏| 339313/371472 [4:49:52<2:30:14,  3.57it/s]
 91%|█████████▏| 339314/371472 [4:49:52<2:26:45,  3.65it/s]
 91%|█████████▏| 339315/371472 [4:49:52<2:27:05,  3.64it/s]
 91%|█████████▏| 339316/371472 [4:49:53<2:26:04,  3.67it/s]
 91%|█████████▏| 339317/371472 [4:49:53<2:30:46,  3.55it/s]
 91%|█████████▏| 339318/371472 [4:49:53<2:27:57,  3.62it/s]
 91%|█████████▏| 339319/371472 [4:49:53<2:22:55,  3.75it/s]
 91%|█████████▏| 339320/371472 [4:49:54<2:21:36,  3.78it/s]
                                                           
{'loss': 2.454, 'learning_rate': 1.7793962377987022e-07, 'epoch': 14.62}

 91%|█████████▏| 339320/371472 [4:49:54<2:21:36,  3.78it/s]
 91%|█████████▏| 339321/371472 [4:49:54<2:21:49,  3.78it/s]
 91%|█████████▏| 339322/371472 [4:49:54<2:33:11,  3.50it/s]
 91%|█████████▏| 339323/371472 [4:49:55<2:35:37,  3.44it/s]
 91%|█████████▏| 339324/371472 [4:49:55<2:27:42,  3.63it/s]
 91%|█████████▏| 339325/371472 [4:49:55<2:28:26,  3.61it/s]
 91%|█████████▏| 339326/371472 [4:49:55<2:30:21,  3.56it/s]
 91%|█████████▏| 339327/371472 [4:49:56<2:29:18,  3.59it/s]
 91%|█████████▏| 339328/371472 [4:49:56<2:27:33,  3.63it/s]
 91%|█████████▏| 339329/371472 [4:49:56<2:28:33,  3.61it/s]
 91%|█████████▏| 339330/371472 [4:49:57<2:38:49,  3.37it/s]
 91%|█████████▏| 339331/371472 [4:49:57<2:36:36,  3.42it/s]
 91%|█████████▏| 339332/371472 [4:49:57<2:33:22,  3.49it/s]
 91%|█████████▏| 339333/371472 [4:49:57<2:28:32,  3.61it/s]
 91%|█████████▏| 339334/371472 [4:49:58<2:30:09,  3.57it/s]
 91%|█████████▏| 339335/371472 [4:49:58<2:38:40,  3.38it/s]
 91%|█████████▏| 339336/371472 [4:49:58<2:45:54,  3.23it/s]
 91%|█████████▏| 339337/371472 [4:49:59<2:40:44,  3.33it/s]
 91%|█████████▏| 339338/371472 [4:49:59<2:33:59,  3.48it/s]
 91%|█████████▏| 339339/371472 [4:49:59<2:34:13,  3.47it/s]
 91%|█████████▏| 339340/371472 [4:49:59<2:30:06,  3.57it/s]
                                                           
{'loss': 2.6315, 'learning_rate': 1.7789114180439143e-07, 'epoch': 14.62}

 91%|█████████▏| 339340/371472 [4:49:59<2:30:06,  3.57it/s]
 91%|█████████▏| 339341/371472 [4:50:00<2:32:18,  3.52it/s]
 91%|█████████▏| 339342/371472 [4:50:00<2:33:52,  3.48it/s]
 91%|█████████▏| 339343/371472 [4:50:00<2:35:24,  3.45it/s]
 91%|█████████▏| 339344/371472 [4:50:01<2:30:07,  3.57it/s]
 91%|█████████▏| 339345/371472 [4:50:01<2:43:09,  3.28it/s]
 91%|█████████▏| 339346/371472 [4:50:01<2:45:19,  3.24it/s]
 91%|█████████▏| 339347/371472 [4:50:02<2:46:41,  3.21it/s]
 91%|█████████▏| 339348/371472 [4:50:02<2:39:27,  3.36it/s]
 91%|█████████▏| 339349/371472 [4:50:02<2:42:25,  3.30it/s]
 91%|█████████▏| 339350/371472 [4:50:02<2:37:32,  3.40it/s]
 91%|█████████▏| 339351/371472 [4:50:03<2:33:35,  3.49it/s]
 91%|█████████▏| 339352/371472 [4:50:03<2:33:52,  3.48it/s]
 91%|█████████▏| 339353/371472 [4:50:03<2:33:37,  3.48it/s]
 91%|█████████▏| 339354/371472 [4:50:03<2:28:51,  3.60it/s]
 91%|█████████▏| 339355/371472 [4:50:04<2:22:08,  3.77it/s]
 91%|█████████▏| 339356/371472 [4:50:04<2:24:56,  3.69it/s]
 91%|█████████▏| 339357/371472 [4:50:04<2:38:09,  3.38it/s]
 91%|█████████▏| 339358/371472 [4:50:05<2:42:12,  3.30it/s]
 91%|█████████▏| 339359/371472 [4:50:05<2:38:20,  3.38it/s]
 91%|█████████▏| 339360/371472 [4:50:05<2:30:13,  3.56it/s]
                                                           
{'loss': 2.6015, 'learning_rate': 1.7784265982891247e-07, 'epoch': 14.62}

 91%|█████████▏| 339360/371472 [4:50:05<2:30:13,  3.56it/s]
 91%|█████████▏| 339361/371472 [4:50:05<2:29:39,  3.58it/s]
 91%|█████████▏| 339362/371472 [4:50:06<2:32:26,  3.51it/s]
 91%|█████████▏| 339363/371472 [4:50:06<2:32:25,  3.51it/s]
 91%|█████████▏| 339364/371472 [4:50:06<2:25:57,  3.67it/s]
 91%|█████████▏| 339365/371472 [4:50:07<2:36:00,  3.43it/s]
 91%|█████████▏| 339366/371472 [4:50:07<2:43:52,  3.27it/s]
 91%|█████████▏| 339367/371472 [4:50:07<2:38:28,  3.38it/s]
 91%|█████████▏| 339368/371472 [4:50:08<2:38:47,  3.37it/s]
 91%|█████████▏| 339369/371472 [4:50:08<2:35:04,  3.45it/s]
 91%|█████████▏| 339370/371472 [4:50:08<2:35:52,  3.43it/s]
 91%|█████████▏| 339371/371472 [4:50:08<2:30:11,  3.56it/s]
 91%|█████████▏| 339372/371472 [4:50:09<2:42:01,  3.30it/s]
 91%|█████████▏| 339373/371472 [4:50:09<2:39:04,  3.36it/s]
 91%|█████████▏| 339374/371472 [4:50:09<2:31:32,  3.53it/s]
 91%|█████████▏| 339375/371472 [4:50:10<2:31:01,  3.54it/s]
 91%|█████████▏| 339376/371472 [4:50:10<2:29:17,  3.58it/s]
 91%|█████████▏| 339377/371472 [4:50:10<2:33:56,  3.47it/s]
 91%|█████████▏| 339378/371472 [4:50:10<2:39:40,  3.35it/s]
 91%|█████████▏| 339379/371472 [4:50:11<2:35:29,  3.44it/s]
 91%|█████████▏| 339380/371472 [4:50:11<2:31:11,  3.54it/s]
                                                           
{'loss': 2.5794, 'learning_rate': 1.7779417785343362e-07, 'epoch': 14.62}

 91%|█████████▏| 339380/371472 [4:50:11<2:31:11,  3.54it/s]
 91%|█████████▏| 339381/371472 [4:50:11<2:32:03,  3.52it/s]
 91%|█████████▏| 339382/371472 [4:50:12<2:28:25,  3.60it/s]
 91%|█████████▏| 339383/371472 [4:50:12<2:31:56,  3.52it/s]
 91%|█████████▏| 339384/371472 [4:50:12<2:27:26,  3.63it/s]
 91%|█████████▏| 339385/371472 [4:50:12<2:28:25,  3.60it/s]
 91%|█████████▏| 339386/371472 [4:50:13<2:24:12,  3.71it/s]
 91%|█████████▏| 339387/371472 [4:50:13<2:26:51,  3.64it/s]
 91%|█████████▏| 339388/371472 [4:50:13<2:27:00,  3.64it/s]
 91%|█████████▏| 339389/371472 [4:50:13<2:29:07,  3.59it/s]
 91%|█████████▏| 339390/371472 [4:50:14<2:33:15,  3.49it/s]
 91%|█████████▏| 339391/371472 [4:50:14<2:32:17,  3.51it/s]
 91%|█████████▏| 339392/371472 [4:50:14<2:43:14,  3.28it/s]
 91%|█████████▏| 339393/371472 [4:50:15<2:49:18,  3.16it/s]
 91%|█████████▏| 339394/371472 [4:50:15<2:47:24,  3.19it/s]
 91%|█████████▏| 339395/371472 [4:50:15<2:52:57,  3.09it/s]
 91%|█████████▏| 339396/371472 [4:50:16<2:41:41,  3.31it/s]
 91%|█████████▏| 339397/371472 [4:50:16<2:39:17,  3.36it/s]
 91%|█████████▏| 339398/371472 [4:50:16<2:35:19,  3.44it/s]
 91%|█████████▏| 339399/371472 [4:50:17<2:41:50,  3.30it/s]
 91%|█████████▏| 339400/371472 [4:50:17<2:41:32,  3.31it/s]
                                                           
{'loss': 2.5939, 'learning_rate': 1.777456958779547e-07, 'epoch': 14.62}

 91%|█████████▏| 339400/371472 [4:50:17<2:41:32,  3.31it/s]
 91%|█████████▏| 339401/371472 [4:50:17<2:49:47,  3.15it/s]
 91%|█████████▏| 339402/371472 [4:50:18<3:21:50,  2.65it/s]
 91%|█████████▏| 339403/371472 [4:50:18<3:00:46,  2.96it/s]
 91%|█████████▏| 339404/371472 [4:50:18<2:49:15,  3.16it/s]
 91%|█████████▏| 339405/371472 [4:50:19<2:51:11,  3.12it/s]
 91%|█████████▏| 339406/371472 [4:50:19<2:39:46,  3.34it/s]
 91%|█████████▏| 339407/371472 [4:50:19<2:35:55,  3.43it/s]
 91%|█████████▏| 339408/371472 [4:50:19<2:34:43,  3.45it/s]
 91%|█████████▏| 339409/371472 [4:50:20<2:30:59,  3.54it/s]
 91%|█████████▏| 339410/371472 [4:50:20<2:33:07,  3.49it/s]
 91%|█████████▏| 339411/371472 [4:50:20<2:41:47,  3.30it/s]
 91%|█████████▏| 339412/371472 [4:50:21<2:34:35,  3.46it/s]
 91%|█████████▏| 339413/371472 [4:50:21<2:46:30,  3.21it/s]
 91%|█████████▏| 339414/371472 [4:50:21<2:39:14,  3.36it/s]
 91%|█████████▏| 339415/371472 [4:50:21<2:36:44,  3.41it/s]
 91%|█████████▏| 339416/371472 [4:50:22<2:30:17,  3.55it/s]
 91%|█████████▏| 339417/371472 [4:50:22<2:50:50,  3.13it/s]
 91%|█████████▏| 339418/371472 [4:50:22<2:49:44,  3.15it/s]
 91%|█████████▏| 339419/371472 [4:50:23<2:53:26,  3.08it/s]
 91%|█████████▏| 339420/371472 [4:50:23<2:52:18,  3.10it/s]
                                                           
{'loss': 2.6136, 'learning_rate': 1.7769721390247584e-07, 'epoch': 14.62}

 91%|█████████▏| 339420/371472 [4:50:23<2:52:18,  3.10it/s]
 91%|█████████▏| 339421/371472 [4:50:23<2:56:39,  3.02it/s]
 91%|█████████▏| 339422/371472 [4:50:24<2:44:04,  3.26it/s]
 91%|█████████▏| 339423/371472 [4:50:24<2:54:44,  3.06it/s]
 91%|█████████▏| 339424/371472 [4:50:24<2:42:02,  3.30it/s]
 91%|█████████▏| 339425/371472 [4:50:25<2:32:05,  3.51it/s]
 91%|█████████▏| 339426/371472 [4:50:25<2:28:43,  3.59it/s]
 91%|█████████▏| 339427/371472 [4:50:25<2:37:07,  3.40it/s]
 91%|█████████▏| 339428/371472 [4:50:25<2:31:28,  3.53it/s]
 91%|█████████▏| 339429/371472 [4:50:26<2:30:46,  3.54it/s]
 91%|█████████▏| 339430/371472 [4:50:26<2:34:38,  3.45it/s]
 91%|█████████▏| 339431/371472 [4:50:26<2:32:52,  3.49it/s]
 91%|█████████▏| 339432/371472 [4:50:27<2:29:42,  3.57it/s]
 91%|█████████▏| 339433/371472 [4:50:27<2:30:00,  3.56it/s]
 91%|█████████▏| 339434/371472 [4:50:27<2:27:01,  3.63it/s]
 91%|█████████▏| 339435/371472 [4:50:27<2:39:32,  3.35it/s]
 91%|█████████▏| 339436/371472 [4:50:28<2:38:46,  3.36it/s]
 91%|█████████▏| 339437/371472 [4:50:28<2:37:50,  3.38it/s]
 91%|█████████▏| 339438/371472 [4:50:28<2:44:40,  3.24it/s]
 91%|█████████▏| 339439/371472 [4:50:29<2:38:41,  3.36it/s]
 91%|█████████▏| 339440/371472 [4:50:29<2:33:29,  3.48it/s]
                                                           
{'loss': 2.6159, 'learning_rate': 1.776487319269969e-07, 'epoch': 14.62}

 91%|█████████▏| 339440/371472 [4:50:29<2:33:29,  3.48it/s]
 91%|█████████▏| 339441/371472 [4:50:29<2:36:56,  3.40it/s]
 91%|█████████▏| 339442/371472 [4:50:29<2:33:35,  3.48it/s]
 91%|█████████▏| 339443/371472 [4:50:30<2:31:32,  3.52it/s]
 91%|█████████▏| 339444/371472 [4:50:30<2:30:04,  3.56it/s]
 91%|█████████▏| 339445/371472 [4:50:30<2:36:04,  3.42it/s]
 91%|█████████▏| 339446/371472 [4:50:31<2:39:09,  3.35it/s]
 91%|█████████▏| 339447/371472 [4:50:31<2:34:55,  3.45it/s]
 91%|█████████▏| 339448/371472 [4:50:31<2:39:30,  3.35it/s]
 91%|█████████▏| 339449/371472 [4:50:32<2:38:08,  3.37it/s]
 91%|█████████▏| 339450/371472 [4:50:32<2:39:20,  3.35it/s]
 91%|█████████▏| 339451/371472 [4:50:32<2:56:50,  3.02it/s]
 91%|█████████▏| 339452/371472 [4:50:32<2:45:31,  3.22it/s]
 91%|█████████▏| 339453/371472 [4:50:33<2:44:12,  3.25it/s]
 91%|█████████▏| 339454/371472 [4:50:33<2:36:23,  3.41it/s]
 91%|█████████▏| 339455/371472 [4:50:33<2:34:17,  3.46it/s]
 91%|█████████▏| 339456/371472 [4:50:34<2:27:55,  3.61it/s]
 91%|█████████▏| 339457/371472 [4:50:34<2:33:20,  3.48it/s]
 91%|█████████▏| 339458/371472 [4:50:34<2:29:17,  3.57it/s]
 91%|█████████▏| 339459/371472 [4:50:34<2:26:32,  3.64it/s]
 91%|█████████▏| 339460/371472 [4:50:35<2:25:34,  3.67it/s]
                                                           
{'loss': 2.6264, 'learning_rate': 1.7760024995151807e-07, 'epoch': 14.62}

 91%|█████████▏| 339460/371472 [4:50:35<2:25:34,  3.67it/s]
 91%|█████████▏| 339461/371472 [4:50:35<2:28:39,  3.59it/s]
 91%|█████████▏| 339462/371472 [4:50:35<2:26:09,  3.65it/s]
 91%|█████████▏| 339463/371472 [4:50:35<2:23:44,  3.71it/s]
 91%|█████████▏| 339464/371472 [4:50:36<2:23:32,  3.72it/s]
 91%|█████████▏| 339465/371472 [4:50:36<2:29:59,  3.56it/s]
 91%|█████████▏| 339466/371472 [4:50:36<2:38:10,  3.37it/s]
 91%|█████████▏| 339467/371472 [4:50:37<2:39:40,  3.34it/s]
 91%|█████████▏| 339468/371472 [4:50:37<2:32:40,  3.49it/s]
 91%|█████████▏| 339469/371472 [4:50:37<2:29:35,  3.57it/s]
 91%|█████████▏| 339470/371472 [4:50:37<2:23:12,  3.72it/s]
 91%|█████████▏| 339471/371472 [4:50:38<2:21:22,  3.77it/s]
 91%|█████████▏| 339472/371472 [4:50:38<2:26:40,  3.64it/s]
 91%|█████████▏| 339473/371472 [4:50:38<2:20:21,  3.80it/s]
 91%|█████████▏| 339474/371472 [4:50:39<2:28:23,  3.59it/s]
 91%|█████████▏| 339475/371472 [4:50:39<2:31:22,  3.52it/s]
 91%|█████████▏| 339476/371472 [4:50:39<2:29:05,  3.58it/s]
 91%|█████████▏| 339477/371472 [4:50:39<2:28:10,  3.60it/s]
 91%|█████████▏| 339478/371472 [4:50:40<2:28:11,  3.60it/s]
 91%|█████████▏| 339479/371472 [4:50:40<2:23:43,  3.71it/s]
 91%|█████████▏| 339480/371472 [4:50:40<2:24:43,  3.68it/s]
                                                           
{'loss': 2.4667, 'learning_rate': 1.775517679760391e-07, 'epoch': 14.62}

 91%|█████████▏| 339480/371472 [4:50:40<2:24:43,  3.68it/s]
 91%|█████████▏| 339481/371472 [4:50:40<2:23:03,  3.73it/s]
 91%|█████████▏| 339482/371472 [4:50:41<2:22:22,  3.74it/s]
 91%|█████████▏| 339483/371472 [4:50:41<2:35:06,  3.44it/s]
 91%|█████████▏| 339484/371472 [4:50:41<2:29:49,  3.56it/s]
 91%|█████████▏| 339485/371472 [4:50:42<2:24:43,  3.68it/s]
 91%|█████████▏| 339486/371472 [4:50:42<2:27:41,  3.61it/s]
 91%|█████████▏| 339487/371472 [4:50:42<2:33:15,  3.48it/s]
 91%|█████████▏| 339488/371472 [4:50:42<2:26:43,  3.63it/s]
 91%|█████████▏| 339489/371472 [4:50:43<2:20:40,  3.79it/s]
 91%|█████████▏| 339490/371472 [4:50:43<2:16:30,  3.90it/s]
 91%|█████████▏| 339491/371472 [4:50:43<2:19:08,  3.83it/s]
 91%|█████████▏| 339492/371472 [4:50:43<2:22:20,  3.74it/s]
 91%|█████████▏| 339493/371472 [4:50:44<2:28:49,  3.58it/s]
 91%|█████████▏| 339494/371472 [4:50:44<2:25:12,  3.67it/s]
 91%|█████████▏| 339495/371472 [4:50:44<2:27:04,  3.62it/s]
 91%|█████████▏| 339496/371472 [4:50:45<2:23:58,  3.70it/s]
 91%|█████████▏| 339497/371472 [4:50:45<2:26:24,  3.64it/s]
 91%|█████████▏| 339498/371472 [4:50:45<2:27:39,  3.61it/s]
 91%|█████████▏| 339499/371472 [4:50:46<2:39:18,  3.35it/s]
 91%|█████████▏| 339500/371472 [4:50:46<2:40:00,  3.33it/s]
                                                           
{'loss': 2.6404, 'learning_rate': 1.775032860005603e-07, 'epoch': 14.62}

 91%|█████████▏| 339500/371472 [4:50:46<2:40:00,  3.33it/s]
 91%|█████████▏| 339501/371472 [4:50:46<2:36:14,  3.41it/s]
 91%|█████████▏| 339502/371472 [4:50:46<2:39:40,  3.34it/s]
 91%|█████████▏| 339503/371472 [4:50:47<2:36:56,  3.40it/s]
 91%|█████████▏| 339504/371472 [4:50:47<2:29:47,  3.56it/s]
 91%|█████████▏| 339505/371472 [4:50:47<2:26:43,  3.63it/s]
 91%|█████████▏| 339506/371472 [4:50:48<2:37:03,  3.39it/s]
 91%|█████████▏| 339507/371472 [4:50:48<2:37:59,  3.37it/s]
 91%|█████████▏| 339508/371472 [4:50:48<2:31:42,  3.51it/s]
 91%|█████████▏| 339509/371472 [4:50:48<2:27:32,  3.61it/s]
 91%|█████████▏| 339510/371472 [4:50:49<2:30:25,  3.54it/s]
 91%|█████████▏| 339511/371472 [4:50:49<2:29:25,  3.56it/s]
 91%|█████████▏| 339512/371472 [4:50:49<2:32:08,  3.50it/s]
 91%|█████████▏| 339513/371472 [4:50:50<2:33:16,  3.48it/s]
 91%|█████████▏| 339514/371472 [4:50:50<2:29:28,  3.56it/s]
 91%|█████████▏| 339515/371472 [4:50:50<2:28:52,  3.58it/s]
 91%|█████████▏| 339516/371472 [4:50:50<2:27:55,  3.60it/s]
 91%|█████████▏| 339517/371472 [4:50:51<2:27:39,  3.61it/s]
 91%|█████████▏| 339518/371472 [4:50:51<2:28:11,  3.59it/s]
 91%|█████████▏| 339519/371472 [4:50:51<2:26:01,  3.65it/s]
 91%|█████████▏| 339520/371472 [4:50:51<2:24:38,  3.68it/s]
                                                           
{'loss': 2.664, 'learning_rate': 1.7745480402508133e-07, 'epoch': 14.62}

 91%|█████████▏| 339520/371472 [4:50:51<2:24:38,  3.68it/s]
 91%|█████████▏| 339521/371472 [4:50:52<2:24:20,  3.69it/s]
 91%|█████████▏| 339522/371472 [4:50:52<2:46:42,  3.19it/s]
 91%|█████████▏| 339523/371472 [4:50:52<2:45:04,  3.23it/s]
 91%|█████████▏| 339524/371472 [4:50:53<2:36:31,  3.40it/s]
 91%|█████████▏| 339525/371472 [4:50:53<2:30:44,  3.53it/s]
 91%|█████████▏| 339526/371472 [4:50:53<2:37:19,  3.38it/s]
 91%|█████████▏| 339527/371472 [4:50:54<2:32:59,  3.48it/s]
 91%|█████████▏| 339528/371472 [4:50:54<2:28:37,  3.58it/s]
 91%|█████████▏| 339529/371472 [4:50:54<2:29:52,  3.55it/s]
 91%|█████████▏| 339530/371472 [4:50:54<2:26:07,  3.64it/s]
 91%|█████████▏| 339531/371472 [4:50:55<2:23:25,  3.71it/s]
 91%|█████████▏| 339532/371472 [4:50:55<3:15:42,  2.72it/s]
 91%|█████████▏| 339533/371472 [4:50:55<2:55:44,  3.03it/s]
 91%|█████████▏| 339534/371472 [4:50:56<2:54:09,  3.06it/s]
 91%|█████████▏| 339535/371472 [4:50:56<2:46:19,  3.20it/s]
 91%|█████████▏| 339536/371472 [4:50:56<2:42:35,  3.27it/s]
 91%|█████████▏| 339537/371472 [4:50:57<3:04:11,  2.89it/s]
 91%|█████████▏| 339538/371472 [4:50:57<3:00:15,  2.95it/s]
 91%|█████████▏| 339539/371472 [4:50:57<2:53:09,  3.07it/s]
 91%|█████████▏| 339540/371472 [4:50:58<2:51:34,  3.10it/s]
                                                           
{'loss': 2.6269, 'learning_rate': 1.7740632204960248e-07, 'epoch': 14.62}

 91%|█████████▏| 339540/371472 [4:50:58<2:51:34,  3.10it/s]
 91%|█████████▏| 339541/371472 [4:50:58<2:44:03,  3.24it/s]
 91%|█████████▏| 339542/371472 [4:50:58<2:43:39,  3.25it/s]
 91%|█████████▏| 339543/371472 [4:50:59<2:44:35,  3.23it/s]
 91%|█████████▏| 339544/371472 [4:50:59<2:36:34,  3.40it/s]
 91%|█████████▏| 339545/371472 [4:50:59<2:38:20,  3.36it/s]
 91%|█████████▏| 339546/371472 [4:50:59<2:37:29,  3.38it/s]
 91%|█████████▏| 339547/371472 [4:51:00<2:35:57,  3.41it/s]
 91%|█████████▏| 339548/371472 [4:51:00<2:35:01,  3.43it/s]
 91%|█████████▏| 339549/371472 [4:51:00<2:39:03,  3.35it/s]
 91%|█████████▏| 339550/371472 [4:51:01<2:33:35,  3.46it/s]
 91%|█████████▏| 339551/371472 [4:51:01<2:42:57,  3.26it/s]
 91%|█████████▏| 339552/371472 [4:51:01<2:39:07,  3.34it/s]
 91%|█████████▏| 339553/371472 [4:51:01<2:33:43,  3.46it/s]
 91%|█████████▏| 339554/371472 [4:51:02<2:29:34,  3.56it/s]
 91%|█████████▏| 339555/371472 [4:51:02<2:26:55,  3.62it/s]
 91%|█████████▏| 339556/371472 [4:51:02<2:27:51,  3.60it/s]
 91%|█████████▏| 339557/371472 [4:51:03<2:27:25,  3.61it/s]
 91%|█████████▏| 339558/371472 [4:51:03<2:34:22,  3.45it/s]
 91%|█████████▏| 339559/371472 [4:51:03<2:39:57,  3.32it/s]
 91%|█████████▏| 339560/371472 [4:51:03<2:33:48,  3.46it/s]
                                                           
{'loss': 2.4913, 'learning_rate': 1.7735784007412353e-07, 'epoch': 14.63}

 91%|█████████▏| 339560/371472 [4:51:03<2:33:48,  3.46it/s]
 91%|█████████▏| 339561/371472 [4:51:04<2:35:39,  3.42it/s]
 91%|█████████▏| 339562/371472 [4:51:04<2:33:39,  3.46it/s]
 91%|█████████▏| 339563/371472 [4:51:04<2:38:15,  3.36it/s]
 91%|█████████▏| 339564/371472 [4:51:05<2:30:53,  3.52it/s]
 91%|█████████▏| 339565/371472 [4:51:05<2:42:31,  3.27it/s]
 91%|█████████▏| 339566/371472 [4:51:05<2:41:13,  3.30it/s]
 91%|█████████▏| 339567/371472 [4:51:06<2:33:19,  3.47it/s]
 91%|█████████▏| 339568/371472 [4:51:06<2:35:59,  3.41it/s]
 91%|█████████▏| 339569/371472 [4:51:06<2:40:27,  3.31it/s]
 91%|█████████▏| 339570/371472 [4:51:06<2:33:49,  3.46it/s]
 91%|█████████▏| 339571/371472 [4:51:07<2:30:55,  3.52it/s]
 91%|█████████▏| 339572/371472 [4:51:07<2:32:47,  3.48it/s]
 91%|█████████▏| 339573/371472 [4:51:07<2:29:24,  3.56it/s]
 91%|█████████▏| 339574/371472 [4:51:08<2:26:36,  3.63it/s]
 91%|█████████▏| 339575/371472 [4:51:08<2:30:40,  3.53it/s]
 91%|█████████▏| 339576/371472 [4:51:08<2:31:43,  3.50it/s]
 91%|█████████▏| 339577/371472 [4:51:08<2:33:00,  3.47it/s]
 91%|█████████▏| 339578/371472 [4:51:09<2:34:27,  3.44it/s]
 91%|█████████▏| 339579/371472 [4:51:09<2:35:01,  3.43it/s]
 91%|█████████▏| 339580/371472 [4:51:09<2:32:25,  3.49it/s]
                                                           
{'loss': 2.5596, 'learning_rate': 1.773093580986447e-07, 'epoch': 14.63}

 91%|█████████▏| 339580/371472 [4:51:09<2:32:25,  3.49it/s]
 91%|█████████▏| 339581/371472 [4:51:10<2:29:12,  3.56it/s]
 91%|█████████▏| 339582/371472 [4:51:10<2:25:10,  3.66it/s]
 91%|█████████▏| 339583/371472 [4:51:10<2:27:10,  3.61it/s]
 91%|█████████▏| 339584/371472 [4:51:10<2:34:55,  3.43it/s]
 91%|█████████▏| 339585/371472 [4:51:11<2:33:58,  3.45it/s]
 91%|█████████▏| 339586/371472 [4:51:11<2:32:52,  3.48it/s]
 91%|█████████▏| 339587/371472 [4:51:11<2:30:16,  3.54it/s]
 91%|█████████▏| 339588/371472 [4:51:11<2:27:43,  3.60it/s]
 91%|█████████▏| 339589/371472 [4:51:12<2:31:37,  3.50it/s]
 91%|█████████▏| 339590/371472 [4:51:12<2:29:30,  3.55it/s]
 91%|█████████▏| 339591/371472 [4:51:12<2:26:52,  3.62it/s]
 91%|█████████▏| 339592/371472 [4:51:13<2:28:37,  3.57it/s]
 91%|█████████▏| 339593/371472 [4:51:13<2:24:20,  3.68it/s]
 91%|█████████▏| 339594/371472 [4:51:13<2:35:24,  3.42it/s]
 91%|█████████▏| 339595/371472 [4:51:13<2:27:57,  3.59it/s]
 91%|█████████▏| 339596/371472 [4:51:14<2:30:12,  3.54it/s]
 91%|█████████▏| 339597/371472 [4:51:14<2:31:23,  3.51it/s]
 91%|█████████▏| 339598/371472 [4:51:14<2:40:46,  3.30it/s]
 91%|█████████▏| 339599/371472 [4:51:15<2:33:16,  3.47it/s]
 91%|█████████▏| 339600/371472 [4:51:15<2:29:42,  3.55it/s]
                                                           
{'loss': 2.5817, 'learning_rate': 1.7726087612316578e-07, 'epoch': 14.63}

 91%|█████████▏| 339600/371472 [4:51:15<2:29:42,  3.55it/s]
 91%|█████████▏| 339601/371472 [4:51:15<2:25:49,  3.64it/s]
 91%|█████████▏| 339602/371472 [4:51:15<2:24:21,  3.68it/s]
 91%|█████████▏| 339603/371472 [4:51:16<2:23:40,  3.70it/s]
 91%|█████████▏| 339604/371472 [4:51:16<2:37:58,  3.36it/s]
 91%|█████████▏| 339605/371472 [4:51:16<2:29:16,  3.56it/s]
 91%|█████████▏| 339606/371472 [4:51:17<2:25:02,  3.66it/s]
 91%|█████████▏| 339607/371472 [4:51:17<2:22:05,  3.74it/s]
 91%|█████████▏| 339608/371472 [4:51:17<2:26:17,  3.63it/s]
 91%|█████████▏| 339609/371472 [4:51:17<2:36:46,  3.39it/s]
 91%|█████████▏| 339610/371472 [4:51:18<2:44:34,  3.23it/s]
 91%|█████████▏| 339611/371472 [4:51:18<2:33:49,  3.45it/s]
 91%|█████████▏| 339612/371472 [4:51:18<2:33:42,  3.45it/s]
 91%|█████████▏| 339613/371472 [4:51:19<2:31:05,  3.51it/s]
 91%|█████████▏| 339614/371472 [4:51:19<2:34:37,  3.43it/s]
 91%|█████████▏| 339615/371472 [4:51:19<2:26:34,  3.62it/s]
 91%|█████████▏| 339616/371472 [4:51:19<2:31:36,  3.50it/s]
 91%|█████████▏| 339617/371472 [4:51:20<2:38:36,  3.35it/s]
 91%|█████████▏| 339618/371472 [4:51:20<2:45:32,  3.21it/s]
 91%|█████████▏| 339619/371472 [4:51:20<2:41:49,  3.28it/s]
 91%|█████████▏| 339620/371472 [4:51:21<2:34:49,  3.43it/s]
                                                           
{'loss': 2.5338, 'learning_rate': 1.772123941476868e-07, 'epoch': 14.63}

 91%|█████████▏| 339620/371472 [4:51:21<2:34:49,  3.43it/s]
 91%|█████████▏| 339621/371472 [4:51:21<2:37:19,  3.37it/s]
 91%|█████████▏| 339622/371472 [4:51:21<2:27:18,  3.60it/s]
 91%|█████████▏| 339623/371472 [4:51:21<2:27:09,  3.61it/s]
 91%|█████████▏| 339624/371472 [4:51:22<2:20:45,  3.77it/s]
 91%|█████████▏| 339625/371472 [4:51:22<2:21:35,  3.75it/s]
 91%|█████████▏| 339626/371472 [4:51:22<2:29:53,  3.54it/s]
 91%|█████████▏| 339627/371472 [4:51:23<2:25:54,  3.64it/s]
 91%|█████████▏| 339628/371472 [4:51:23<2:29:10,  3.56it/s]
 91%|█████████▏| 339629/371472 [4:51:23<2:22:41,  3.72it/s]
 91%|█████████▏| 339630/371472 [4:51:23<2:22:35,  3.72it/s]
 91%|█████████▏| 339631/371472 [4:51:24<2:27:08,  3.61it/s]
 91%|█████████▏| 339632/371472 [4:51:24<2:31:15,  3.51it/s]
 91%|█████████▏| 339633/371472 [4:51:24<2:28:34,  3.57it/s]
 91%|█████████▏| 339634/371472 [4:51:25<2:26:55,  3.61it/s]
 91%|█████████▏| 339635/371472 [4:51:25<2:22:43,  3.72it/s]
 91%|█████████▏| 339636/371472 [4:51:25<2:33:48,  3.45it/s]
 91%|█████████▏| 339637/371472 [4:51:25<2:31:46,  3.50it/s]
 91%|█████████▏| 339638/371472 [4:51:26<2:35:54,  3.40it/s]
 91%|█████████▏| 339639/371472 [4:51:26<2:32:14,  3.48it/s]
 91%|█████████▏| 339640/371472 [4:51:26<2:31:46,  3.50it/s]
                                                           
{'loss': 2.6306, 'learning_rate': 1.7716391217220797e-07, 'epoch': 14.63}

 91%|█████████▏| 339640/371472 [4:51:26<2:31:46,  3.50it/s]
 91%|█████████▏| 339641/371472 [4:51:27<2:28:45,  3.57it/s]
 91%|█████████▏| 339642/371472 [4:51:27<2:27:36,  3.59it/s]
 91%|█████████▏| 339643/371472 [4:51:27<2:31:45,  3.50it/s]
 91%|█████████▏| 339644/371472 [4:51:27<2:33:11,  3.46it/s]
 91%|█████████▏| 339645/371472 [4:51:28<2:38:49,  3.34it/s]
 91%|█████████▏| 339646/371472 [4:51:28<2:40:49,  3.30it/s]
 91%|█████████▏| 339647/371472 [4:51:28<2:39:00,  3.34it/s]
 91%|█████████▏| 339648/371472 [4:51:29<2:37:49,  3.36it/s]
 91%|█████████▏| 339649/371472 [4:51:29<2:32:32,  3.48it/s]
 91%|█████████▏| 339650/371472 [4:51:29<2:26:23,  3.62it/s]
 91%|█████████▏| 339651/371472 [4:51:29<2:20:07,  3.78it/s]
 91%|█████████▏| 339652/371472 [4:51:30<2:24:45,  3.66it/s]
 91%|█████████▏| 339653/371472 [4:51:30<2:24:02,  3.68it/s]
 91%|█████████▏| 339654/371472 [4:51:30<2:19:58,  3.79it/s]
 91%|█████████▏| 339655/371472 [4:51:30<2:22:26,  3.72it/s]
 91%|█████████▏| 339656/371472 [4:51:31<2:23:01,  3.71it/s]
 91%|█████████▏| 339657/371472 [4:51:31<2:23:03,  3.71it/s]
 91%|█████████▏| 339658/371472 [4:51:31<2:22:18,  3.73it/s]
 91%|█████████▏| 339659/371472 [4:51:31<2:18:43,  3.82it/s]
 91%|█████████▏| 339660/371472 [4:51:32<2:20:16,  3.78it/s]
                                                           
{'loss': 2.6348, 'learning_rate': 1.7711543019672907e-07, 'epoch': 14.63}

 91%|█████████▏| 339660/371472 [4:51:32<2:20:16,  3.78it/s]
 91%|█████████▏| 339661/371472 [4:51:32<2:36:32,  3.39it/s]
 91%|█████████▏| 339662/371472 [4:51:32<2:29:10,  3.55it/s]
 91%|█████████▏| 339663/371472 [4:51:33<2:30:35,  3.52it/s]
 91%|█████████▏| 339664/371472 [4:51:33<2:26:22,  3.62it/s]
 91%|█████████▏| 339665/371472 [4:51:33<2:26:46,  3.61it/s]
 91%|█████████▏| 339666/371472 [4:51:33<2:22:23,  3.72it/s]
 91%|█████████▏| 339667/371472 [4:51:34<2:24:25,  3.67it/s]
 91%|█████████▏| 339668/371472 [4:51:34<2:27:32,  3.59it/s]
 91%|█████████▏| 339669/371472 [4:51:34<2:24:41,  3.66it/s]
 91%|█████████▏| 339670/371472 [4:51:35<2:31:39,  3.50it/s]
 91%|█████████▏| 339671/371472 [4:51:35<2:37:35,  3.36it/s]
 91%|█████████▏| 339672/371472 [4:51:35<2:31:12,  3.51it/s]
 91%|█████████▏| 339673/371472 [4:51:36<2:51:25,  3.09it/s]
 91%|█████████▏| 339674/371472 [4:51:36<2:42:23,  3.26it/s]
 91%|█████████▏| 339675/371472 [4:51:36<2:46:17,  3.19it/s]
 91%|█████████▏| 339676/371472 [4:51:36<2:39:00,  3.33it/s]
 91%|█████████▏| 339677/371472 [4:51:37<2:54:25,  3.04it/s]
 91%|█████████▏| 339678/371472 [4:51:37<2:50:53,  3.10it/s]
 91%|█████████▏| 339679/371472 [4:51:37<2:47:19,  3.17it/s]
 91%|█████████▏| 339680/371472 [4:51:38<3:02:43,  2.90it/s]
                                                           
{'loss': 2.5321, 'learning_rate': 1.7706694822125017e-07, 'epoch': 14.63}

 91%|█████████▏| 339680/371472 [4:51:38<3:02:43,  2.90it/s]
 91%|█████████▏| 339681/371472 [4:51:38<3:18:22,  2.67it/s]
 91%|█████████▏| 339682/371472 [4:51:39<2:59:29,  2.95it/s]
 91%|█████████▏| 339683/371472 [4:51:39<2:47:44,  3.16it/s]
 91%|█████████▏| 339684/371472 [4:51:39<2:51:57,  3.08it/s]
 91%|█████████▏| 339685/371472 [4:51:39<2:44:02,  3.23it/s]
 91%|█████████▏| 339686/371472 [4:51:40<2:36:50,  3.38it/s]
 91%|█████████▏| 339687/371472 [4:51:40<2:30:58,  3.51it/s]
 91%|█████████▏| 339688/371472 [4:51:40<2:33:29,  3.45it/s]
 91%|█████████▏| 339689/371472 [4:51:41<2:31:11,  3.50it/s]
 91%|█████████▏| 339690/371472 [4:51:41<2:28:44,  3.56it/s]
 91%|█████████▏| 339691/371472 [4:51:41<2:28:41,  3.56it/s]
 91%|█████████▏| 339692/371472 [4:51:41<2:26:19,  3.62it/s]
 91%|█████████▏| 339693/371472 [4:51:42<2:28:50,  3.56it/s]
 91%|█████████▏| 339694/371472 [4:51:42<2:36:52,  3.38it/s]
 91%|█████████▏| 339695/371472 [4:51:42<2:30:42,  3.51it/s]
 91%|█████████▏| 339696/371472 [4:51:43<2:25:50,  3.63it/s]
 91%|█████████▏| 339697/371472 [4:51:43<2:29:02,  3.55it/s]
 91%|█████████▏| 339698/371472 [4:51:43<2:39:08,  3.33it/s]
 91%|█████████▏| 339699/371472 [4:51:43<2:44:09,  3.23it/s]
 91%|█████████▏| 339700/371472 [4:51:44<2:39:46,  3.31it/s]
                                                           
{'loss': 2.5812, 'learning_rate': 1.7701846624577124e-07, 'epoch': 14.63}

 91%|█████████▏| 339700/371472 [4:51:44<2:39:46,  3.31it/s]
 91%|█████████▏| 339701/371472 [4:51:44<2:36:15,  3.39it/s]
 91%|█████████▏| 339702/371472 [4:51:44<2:35:06,  3.41it/s]
 91%|█████████▏| 339703/371472 [4:51:45<2:32:39,  3.47it/s]
 91%|█████████▏| 339704/371472 [4:51:45<2:30:14,  3.52it/s]
 91%|█████████▏| 339705/371472 [4:51:45<2:27:17,  3.59it/s]
 91%|█████████▏| 339706/371472 [4:51:45<2:30:30,  3.52it/s]
 91%|█████████▏| 339707/371472 [4:51:46<2:31:00,  3.51it/s]
 91%|█████████▏| 339708/371472 [4:51:46<2:28:48,  3.56it/s]
 91%|█████████▏| 339709/371472 [4:51:46<2:30:28,  3.52it/s]
 91%|█████████▏| 339710/371472 [4:51:47<2:25:41,  3.63it/s]
 91%|█████████▏| 339711/371472 [4:51:47<2:31:09,  3.50it/s]
 91%|█████████▏| 339712/371472 [4:51:47<2:34:04,  3.44it/s]
 91%|█████████▏| 339713/371472 [4:51:47<2:27:00,  3.60it/s]
 91%|█████████▏| 339714/371472 [4:51:48<2:24:43,  3.66it/s]
 91%|█████████▏| 339715/371472 [4:51:48<2:26:30,  3.61it/s]
 91%|█████████▏| 339716/371472 [4:51:48<2:21:00,  3.75it/s]
 91%|█████████▏| 339717/371472 [4:51:48<2:21:01,  3.75it/s]
 91%|█████████▏| 339718/371472 [4:51:49<2:20:45,  3.76it/s]
 91%|█████████▏| 339719/371472 [4:51:49<2:34:08,  3.43it/s]
 91%|█████████▏| 339720/371472 [4:51:49<2:38:14,  3.34it/s]
                                                           
{'loss': 2.6164, 'learning_rate': 1.7696998427029242e-07, 'epoch': 14.63}

 91%|█████████▏| 339720/371472 [4:51:49<2:38:14,  3.34it/s]
 91%|█████████▏| 339721/371472 [4:51:50<2:29:42,  3.53it/s]
 91%|█████████▏| 339722/371472 [4:51:50<2:31:26,  3.49it/s]
 91%|█████████▏| 339723/371472 [4:51:50<2:32:08,  3.48it/s]
 91%|█████████▏| 339724/371472 [4:51:50<2:25:53,  3.63it/s]
 91%|█████████▏| 339725/371472 [4:51:51<2:26:57,  3.60it/s]
 91%|█████████▏| 339726/371472 [4:51:51<2:24:09,  3.67it/s]
 91%|█████████▏| 339727/371472 [4:51:51<2:18:39,  3.82it/s]
 91%|█████████▏| 339728/371472 [4:51:52<2:17:11,  3.86it/s]
 91%|█████████▏| 339729/371472 [4:51:52<2:20:12,  3.77it/s]
 91%|█████████▏| 339730/371472 [4:51:52<2:22:24,  3.71it/s]
 91%|█████████▏| 339731/371472 [4:51:52<2:19:58,  3.78it/s]
 91%|█████████▏| 339732/371472 [4:51:53<2:18:33,  3.82it/s]
 91%|█████████▏| 339733/371472 [4:51:53<2:20:16,  3.77it/s]
 91%|█████████▏| 339734/371472 [4:51:53<2:25:59,  3.62it/s]
 91%|█████████▏| 339735/371472 [4:51:54<2:37:01,  3.37it/s]
 91%|█████████▏| 339736/371472 [4:51:54<2:42:31,  3.25it/s]
 91%|█████████▏| 339737/371472 [4:51:54<2:35:03,  3.41it/s]
 91%|█████████▏| 339738/371472 [4:51:54<2:36:54,  3.37it/s]
 91%|█████████▏| 339739/371472 [4:51:55<2:30:50,  3.51it/s]
 91%|█████████▏| 339740/371472 [4:51:55<2:40:46,  3.29it/s]
                                                           
{'loss': 2.7126, 'learning_rate': 1.7692150229481346e-07, 'epoch': 14.63}

 91%|█████████▏| 339740/371472 [4:51:55<2:40:46,  3.29it/s]
 91%|█████████▏| 339741/371472 [4:51:55<2:35:41,  3.40it/s]
 91%|█████████▏| 339742/371472 [4:51:56<2:33:42,  3.44it/s]
 91%|█████████▏| 339743/371472 [4:51:56<2:29:52,  3.53it/s]
 91%|█████████▏| 339744/371472 [4:51:56<2:30:19,  3.52it/s]
 91%|█████████▏| 339745/371472 [4:51:56<2:30:07,  3.52it/s]
 91%|█████████▏| 339746/371472 [4:51:57<2:31:16,  3.50it/s]
 91%|█████████▏| 339747/371472 [4:51:57<2:22:45,  3.70it/s]
 91%|█████████▏| 339748/371472 [4:51:57<2:21:50,  3.73it/s]
 91%|█████████▏| 339749/371472 [4:51:57<2:19:32,  3.79it/s]
 91%|█████████▏| 339750/371472 [4:51:58<2:26:50,  3.60it/s]
 91%|█████████▏| 339751/371472 [4:51:58<2:19:56,  3.78it/s]
 91%|█████████▏| 339752/371472 [4:51:58<2:21:11,  3.74it/s]
 91%|█████████▏| 339753/371472 [4:51:59<2:23:52,  3.67it/s]
 91%|█████████▏| 339754/371472 [4:51:59<2:22:54,  3.70it/s]
 91%|█████████▏| 339755/371472 [4:51:59<2:20:03,  3.77it/s]
 91%|█████████▏| 339756/371472 [4:51:59<2:19:50,  3.78it/s]
 91%|█████████▏| 339757/371472 [4:52:00<2:18:50,  3.81it/s]
 91%|█████████▏| 339758/371472 [4:52:00<2:26:31,  3.61it/s]
 91%|█████████▏| 339759/371472 [4:52:00<2:39:23,  3.32it/s]
 91%|█████████▏| 339760/371472 [4:52:01<2:35:26,  3.40it/s]
                                                           
{'loss': 2.4992, 'learning_rate': 1.7687302031933462e-07, 'epoch': 14.63}

 91%|█████████▏| 339760/371472 [4:52:01<2:35:26,  3.40it/s]
 91%|█████████▏| 339761/371472 [4:52:01<2:27:57,  3.57it/s]
 91%|█████████▏| 339762/371472 [4:52:01<2:45:52,  3.19it/s]
 91%|█████████▏| 339763/371472 [4:52:01<2:37:36,  3.35it/s]
 91%|█████████▏| 339764/371472 [4:52:02<2:41:45,  3.27it/s]
 91%|█████████▏| 339765/371472 [4:52:02<2:43:10,  3.24it/s]
 91%|█████████▏| 339766/371472 [4:52:02<2:41:04,  3.28it/s]
 91%|█████████▏| 339767/371472 [4:52:03<2:42:13,  3.26it/s]
 91%|█████████▏| 339768/371472 [4:52:03<2:32:38,  3.46it/s]
 91%|█████████▏| 339769/371472 [4:52:03<2:31:50,  3.48it/s]
 91%|█████████▏| 339770/371472 [4:52:03<2:30:48,  3.50it/s]
 91%|█████████▏| 339771/371472 [4:52:04<2:33:14,  3.45it/s]
 91%|█████████▏| 339772/371472 [4:52:04<2:27:30,  3.58it/s]
 91%|█████████▏| 339773/371472 [4:52:04<2:30:27,  3.51it/s]
 91%|█████████▏| 339774/371472 [4:52:05<2:31:17,  3.49it/s]
 91%|█████████▏| 339775/371472 [4:52:05<2:33:23,  3.44it/s]
 91%|█████████▏| 339776/371472 [4:52:05<2:27:10,  3.59it/s]
 91%|█████████▏| 339777/371472 [4:52:05<2:27:19,  3.59it/s]
 91%|█████████▏| 339778/371472 [4:52:06<2:20:00,  3.77it/s]
 91%|█████████▏| 339779/371472 [4:52:06<2:20:11,  3.77it/s]
 91%|█████████▏| 339780/371472 [4:52:06<2:25:31,  3.63it/s]
                                                           
{'loss': 2.5162, 'learning_rate': 1.768245383438557e-07, 'epoch': 14.63}

 91%|█████████▏| 339780/371472 [4:52:06<2:25:31,  3.63it/s]
 91%|█████████▏| 339781/371472 [4:52:07<2:32:46,  3.46it/s]
 91%|█████████▏| 339782/371472 [4:52:07<2:33:14,  3.45it/s]
 91%|█████████▏| 339783/371472 [4:52:07<2:27:12,  3.59it/s]
 91%|█████████▏| 339784/371472 [4:52:07<2:31:36,  3.48it/s]
 91%|█████████▏| 339785/371472 [4:52:08<2:34:49,  3.41it/s]
 91%|█████████▏| 339786/371472 [4:52:08<2:44:23,  3.21it/s]
 91%|█████████▏| 339787/371472 [4:52:08<2:37:43,  3.35it/s]
 91%|█████████▏| 339788/371472 [4:52:09<2:33:09,  3.45it/s]
 91%|█████████▏| 339789/371472 [4:52:09<2:38:23,  3.33it/s]
 91%|█████████▏| 339790/371472 [4:52:09<2:34:23,  3.42it/s]
 91%|█████████▏| 339791/371472 [4:52:10<2:33:37,  3.44it/s]
 91%|█████████▏| 339792/371472 [4:52:10<2:45:41,  3.19it/s]
 91%|█████████▏| 339793/371472 [4:52:10<2:36:39,  3.37it/s]
 91%|█████████▏| 339794/371472 [4:52:10<2:30:16,  3.51it/s]
 91%|█████████▏| 339795/371472 [4:52:11<2:27:11,  3.59it/s]
 91%|█████████▏| 339796/371472 [4:52:11<2:23:55,  3.67it/s]
 91%|█████████▏| 339797/371472 [4:52:11<2:24:17,  3.66it/s]
 91%|█████████▏| 339798/371472 [4:52:11<2:18:41,  3.81it/s]
 91%|█████████▏| 339799/371472 [4:52:12<2:21:38,  3.73it/s]
 91%|█████████▏| 339800/371472 [4:52:12<2:26:39,  3.60it/s]
                                                           
{'loss': 2.3363, 'learning_rate': 1.7677605636837684e-07, 'epoch': 14.64}

 91%|█████████▏| 339800/371472 [4:52:12<2:26:39,  3.60it/s]
 91%|█████████▏| 339801/371472 [4:52:12<2:34:22,  3.42it/s]
 91%|█████████▏| 339802/371472 [4:52:13<2:33:10,  3.45it/s]
 91%|█████████▏| 339803/371472 [4:52:13<2:27:57,  3.57it/s]
 91%|█████████▏| 339804/371472 [4:52:13<2:30:36,  3.50it/s]
 91%|█████████▏| 339805/371472 [4:52:13<2:30:16,  3.51it/s]
 91%|█████████▏| 339806/371472 [4:52:14<2:23:47,  3.67it/s]
 91%|█████████▏| 339807/371472 [4:52:14<2:21:51,  3.72it/s]
 91%|█████████▏| 339808/371472 [4:52:14<2:23:29,  3.68it/s]
 91%|█████████▏| 339809/371472 [4:52:15<2:32:22,  3.46it/s]
 91%|█████████▏| 339810/371472 [4:52:15<2:27:38,  3.57it/s]
 91%|█████████▏| 339811/371472 [4:52:15<2:24:44,  3.65it/s]
 91%|█████████▏| 339812/371472 [4:52:15<2:27:25,  3.58it/s]
 91%|█████████▏| 339813/371472 [4:52:16<2:36:06,  3.38it/s]
 91%|█████████▏| 339814/371472 [4:52:16<2:29:04,  3.54it/s]
 91%|█████████▏| 339815/371472 [4:52:16<2:32:48,  3.45it/s]
 91%|█████████▏| 339816/371472 [4:52:17<2:33:20,  3.44it/s]
 91%|█████████▏| 339817/371472 [4:52:17<2:27:32,  3.58it/s]
 91%|█████████▏| 339818/371472 [4:52:17<2:31:07,  3.49it/s]
 91%|█████████▏| 339819/371472 [4:52:17<2:37:19,  3.35it/s]
 91%|█████████▏| 339820/371472 [4:52:18<2:43:08,  3.23it/s]
                                                           
{'loss': 2.531, 'learning_rate': 1.7672757439289788e-07, 'epoch': 14.64}

 91%|█████████▏| 339820/371472 [4:52:18<2:43:08,  3.23it/s]
 91%|█████████▏| 339821/371472 [4:52:18<2:36:15,  3.38it/s]
 91%|█████████▏| 339822/371472 [4:52:18<2:32:38,  3.46it/s]
 91%|█████████▏| 339823/371472 [4:52:19<2:34:27,  3.42it/s]
 91%|█████████▏| 339824/371472 [4:52:19<2:35:31,  3.39it/s]
 91%|█████████▏| 339825/371472 [4:52:19<2:32:31,  3.46it/s]
 91%|█████████▏| 339826/371472 [4:52:19<2:25:48,  3.62it/s]
 91%|█████████▏| 339827/371472 [4:52:20<2:24:09,  3.66it/s]
 91%|█████████▏| 339828/371472 [4:52:20<2:19:58,  3.77it/s]
 91%|█████████▏| 339829/371472 [4:52:20<2:25:00,  3.64it/s]
 91%|█████████▏| 339830/371472 [4:52:21<2:23:26,  3.68it/s]
 91%|█████████▏| 339831/371472 [4:52:21<2:23:32,  3.67it/s]
 91%|█████████▏| 339832/371472 [4:52:21<2:30:22,  3.51it/s]
 91%|█████████▏| 339833/371472 [4:52:21<2:28:19,  3.55it/s]
 91%|█████████▏| 339834/371472 [4:52:22<2:23:06,  3.68it/s]
 91%|█████████▏| 339835/371472 [4:52:22<2:25:42,  3.62it/s]
 91%|█████████▏| 339836/371472 [4:52:22<2:25:21,  3.63it/s]
 91%|█████████▏| 339837/371472 [4:52:22<2:25:12,  3.63it/s]
 91%|█████████▏| 339838/371472 [4:52:23<2:28:49,  3.54it/s]
 91%|█████████▏| 339839/371472 [4:52:23<2:26:42,  3.59it/s]
 91%|█████████▏| 339840/371472 [4:52:23<2:29:37,  3.52it/s]
                                                           
{'loss': 2.7059, 'learning_rate': 1.7667909241741906e-07, 'epoch': 14.64}

 91%|█████████▏| 339840/371472 [4:52:23<2:29:37,  3.52it/s]
 91%|█████████▏| 339841/371472 [4:52:24<2:22:05,  3.71it/s]
 91%|█████████▏| 339842/371472 [4:52:24<2:18:36,  3.80it/s]
 91%|█████████▏| 339843/371472 [4:52:24<2:20:01,  3.76it/s]
 91%|█████████▏| 339844/371472 [4:52:24<2:23:50,  3.66it/s]
 91%|█████████▏| 339845/371472 [4:52:25<2:27:42,  3.57it/s]
 91%|█████████▏| 339846/371472 [4:52:25<2:31:40,  3.48it/s]
 91%|█████████▏| 339847/371472 [4:52:25<2:29:28,  3.53it/s]
 91%|█████████▏| 339848/371472 [4:52:26<2:28:12,  3.56it/s]
 91%|█████████▏| 339849/371472 [4:52:26<2:24:43,  3.64it/s]
 91%|█████████▏| 339850/371472 [4:52:26<2:22:41,  3.69it/s]
 91%|█████████▏| 339851/371472 [4:52:26<2:22:11,  3.71it/s]
 91%|█████████▏| 339852/371472 [4:52:27<2:21:54,  3.71it/s]
 91%|█████████▏| 339853/371472 [4:52:27<2:23:13,  3.68it/s]
 91%|█████████▏| 339854/371472 [4:52:27<2:25:31,  3.62it/s]
 91%|█████████▏| 339855/371472 [4:52:27<2:20:59,  3.74it/s]
 91%|█████████▏| 339856/371472 [4:52:28<2:22:25,  3.70it/s]
 91%|█████████▏| 339857/371472 [4:52:28<2:20:10,  3.76it/s]
 91%|█████████▏| 339858/371472 [4:52:28<2:20:15,  3.76it/s]
 91%|█████████▏| 339859/371472 [4:52:28<2:18:51,  3.79it/s]
 91%|█████████▏| 339860/371472 [4:52:29<2:26:13,  3.60it/s]
                                                           
{'loss': 2.6678, 'learning_rate': 1.766306104419401e-07, 'epoch': 14.64}

 91%|█████████▏| 339860/371472 [4:52:29<2:26:13,  3.60it/s]
 91%|█████████▏| 339861/371472 [4:52:29<2:22:55,  3.69it/s]
 91%|█████████▏| 339862/371472 [4:52:29<2:15:56,  3.88it/s]
 91%|█████████▏| 339863/371472 [4:52:30<2:14:46,  3.91it/s]
 91%|█████████▏| 339864/371472 [4:52:30<2:13:04,  3.96it/s]
 91%|█████████▏| 339865/371472 [4:52:30<2:13:38,  3.94it/s]
 91%|█████████▏| 339866/371472 [4:52:30<2:24:55,  3.63it/s]
 91%|█████████▏| 339867/371472 [4:52:31<2:35:48,  3.38it/s]
 91%|█████████▏| 339868/371472 [4:52:31<2:29:35,  3.52it/s]
 91%|█████████▏| 339869/371472 [4:52:31<2:31:14,  3.48it/s]
 91%|█████████▏| 339870/371472 [4:52:32<2:40:54,  3.27it/s]
 91%|█████████▏| 339871/371472 [4:52:32<2:36:22,  3.37it/s]
 91%|█████████▏| 339872/371472 [4:52:32<2:32:49,  3.45it/s]
 91%|█████████▏| 339873/371472 [4:52:32<2:27:00,  3.58it/s]
 91%|█████████▏| 339874/371472 [4:52:33<2:28:06,  3.56it/s]
 91%|█████████▏| 339875/371472 [4:52:33<2:32:23,  3.46it/s]
 91%|█████████▏| 339876/371472 [4:52:33<2:29:54,  3.51it/s]
 91%|█████████▏| 339877/371472 [4:52:34<2:30:12,  3.51it/s]
 91%|█████████▏| 339878/371472 [4:52:34<2:28:54,  3.54it/s]
 91%|█████████▏| 339879/371472 [4:52:34<2:29:42,  3.52it/s]
 91%|█████████▏| 339880/371472 [4:52:34<2:25:05,  3.63it/s]
                                                           
{'loss': 2.7573, 'learning_rate': 1.7658212846646126e-07, 'epoch': 14.64}

 91%|█████████▏| 339880/371472 [4:52:34<2:25:05,  3.63it/s]
 91%|█████████▏| 339881/371472 [4:52:35<2:33:13,  3.44it/s]
 91%|█████████▏| 339882/371472 [4:52:35<2:33:12,  3.44it/s]
 91%|█████████▏| 339883/371472 [4:52:35<2:27:07,  3.58it/s]
 91%|█████████▏| 339884/371472 [4:52:35<2:23:35,  3.67it/s]
 91%|█████████▏| 339885/371472 [4:52:36<2:19:20,  3.78it/s]
 91%|█████████▏| 339886/371472 [4:52:36<2:16:47,  3.85it/s]
 91%|█████████▏| 339887/371472 [4:52:36<2:21:56,  3.71it/s]
 91%|█████████▏| 339888/371472 [4:52:37<2:20:35,  3.74it/s]
 91%|█████████▏| 339889/371472 [4:52:37<2:21:03,  3.73it/s]
 91%|█████████▏| 339890/371472 [4:52:37<2:19:30,  3.77it/s]
 91%|█████████▏| 339891/371472 [4:52:37<2:19:30,  3.77it/s]
 91%|█████████▏| 339892/371472 [4:52:38<2:18:09,  3.81it/s]
 91%|█████████▏| 339893/371472 [4:52:38<2:20:01,  3.76it/s]
 91%|█████████▏| 339894/371472 [4:52:38<2:18:00,  3.81it/s]
 91%|█████████▏| 339895/371472 [4:52:38<2:21:04,  3.73it/s]
 91%|█████████▏| 339896/371472 [4:52:39<2:30:36,  3.49it/s]
 92%|█████████▏| 339897/371472 [4:52:39<2:29:15,  3.53it/s]
 92%|█████████▏| 339898/371472 [4:52:39<2:26:36,  3.59it/s]
 92%|█████████▏| 339899/371472 [4:52:40<2:42:22,  3.24it/s]
 92%|█████████▏| 339900/371472 [4:52:40<2:45:24,  3.18it/s]
                                                           
{'loss': 2.6109, 'learning_rate': 1.7653364649098233e-07, 'epoch': 14.64}

 92%|█████████▏| 339900/371472 [4:52:40<2:45:24,  3.18it/s]
 92%|█████████▏| 339901/371472 [4:52:40<2:37:03,  3.35it/s]
 92%|█████████▏| 339902/371472 [4:52:41<2:37:26,  3.34it/s]
 92%|█████████▏| 339903/371472 [4:52:41<2:32:44,  3.44it/s]
 92%|█████████▏| 339904/371472 [4:52:41<2:30:31,  3.50it/s]
 92%|█████████▏| 339905/371472 [4:52:41<2:34:27,  3.41it/s]
 92%|█████████▏| 339906/371472 [4:52:42<2:31:08,  3.48it/s]
 92%|█████████▏| 339907/371472 [4:52:42<2:33:28,  3.43it/s]
 92%|█████████▏| 339908/371472 [4:52:42<2:26:44,  3.59it/s]
 92%|█████████▏| 339909/371472 [4:52:42<2:24:25,  3.64it/s]
 92%|█████████▏| 339910/371472 [4:52:43<2:22:24,  3.69it/s]
 92%|█████████▏| 339911/371472 [4:52:43<2:26:29,  3.59it/s]
 92%|█████████▏| 339912/371472 [4:52:43<2:23:32,  3.66it/s]
 92%|█████████▏| 339913/371472 [4:52:44<2:25:44,  3.61it/s]
 92%|█████████▏| 339914/371472 [4:52:44<2:26:38,  3.59it/s]
 92%|█████████▏| 339915/371472 [4:52:44<2:30:19,  3.50it/s]
 92%|█████████▏| 339916/371472 [4:52:44<2:30:39,  3.49it/s]
 92%|█████████▏| 339917/371472 [4:52:45<2:37:11,  3.35it/s]
 92%|█████████▏| 339918/371472 [4:52:45<2:34:43,  3.40it/s]
 92%|█████████▏| 339919/371472 [4:52:45<2:30:44,  3.49it/s]
 92%|█████████▏| 339920/371472 [4:52:46<2:41:32,  3.26it/s]
                                                           
{'loss': 2.5386, 'learning_rate': 1.7648516451550345e-07, 'epoch': 14.64}

 92%|█████████▏| 339920/371472 [4:52:46<2:41:32,  3.26it/s]
 92%|█████████▏| 339921/371472 [4:52:46<2:48:10,  3.13it/s]
 92%|█████████▏| 339922/371472 [4:52:46<2:41:56,  3.25it/s]
 92%|█████████▏| 339923/371472 [4:52:47<2:32:39,  3.44it/s]
 92%|█████████▏| 339924/371472 [4:52:47<2:36:53,  3.35it/s]
 92%|█████████▏| 339925/371472 [4:52:47<2:30:33,  3.49it/s]
 92%|█████████▏| 339926/371472 [4:52:47<2:32:47,  3.44it/s]
 92%|█████████▏| 339927/371472 [4:52:48<2:42:42,  3.23it/s]
 92%|█████████▏| 339928/371472 [4:52:48<2:40:59,  3.27it/s]
 92%|█████████▏| 339929/371472 [4:52:48<2:49:15,  3.11it/s]
 92%|█████████▏| 339930/371472 [4:52:49<2:42:16,  3.24it/s]
 92%|█████████▏| 339931/371472 [4:52:49<2:37:18,  3.34it/s]
 92%|█████████▏| 339932/371472 [4:52:49<2:38:39,  3.31it/s]
 92%|█████████▏| 339933/371472 [4:52:50<2:28:26,  3.54it/s]
 92%|█████████▏| 339934/371472 [4:52:50<2:32:55,  3.44it/s]
 92%|█████████▏| 339935/371472 [4:52:50<2:29:39,  3.51it/s]
 92%|█████████▏| 339936/371472 [4:52:50<2:25:18,  3.62it/s]
 92%|█████████▏| 339937/371472 [4:52:51<2:24:52,  3.63it/s]
 92%|█████████▏| 339938/371472 [4:52:51<2:24:41,  3.63it/s]
 92%|█████████▏| 339939/371472 [4:52:51<2:21:35,  3.71it/s]
 92%|█████████▏| 339940/371472 [4:52:51<2:16:34,  3.85it/s]
                                                           
{'loss': 2.582, 'learning_rate': 1.7643668254002452e-07, 'epoch': 14.64}

 92%|█████████▏| 339940/371472 [4:52:51<2:16:34,  3.85it/s]
 92%|█████████▏| 339941/371472 [4:52:52<2:17:19,  3.83it/s]
 92%|█████████▏| 339942/371472 [4:52:52<2:18:56,  3.78it/s]
 92%|█████████▏| 339943/371472 [4:52:52<2:20:24,  3.74it/s]
 92%|█████████▏| 339944/371472 [4:52:53<2:25:56,  3.60it/s]
 92%|█████████▏| 339945/371472 [4:52:53<2:24:57,  3.62it/s]
 92%|█████████▏| 339946/371472 [4:52:53<2:24:55,  3.63it/s]
 92%|█████████▏| 339947/371472 [4:52:53<2:34:11,  3.41it/s]
 92%|█████████▏| 339948/371472 [4:52:54<2:26:21,  3.59it/s]
 92%|█████████▏| 339949/371472 [4:52:54<2:22:19,  3.69it/s]
 92%|█████████▏| 339950/371472 [4:52:54<2:20:28,  3.74it/s]
 92%|█████████▏| 339951/371472 [4:52:54<2:21:39,  3.71it/s]
 92%|█████████▏| 339952/371472 [4:52:55<2:22:59,  3.67it/s]
 92%|█████████▏| 339953/371472 [4:52:55<2:30:19,  3.49it/s]
 92%|█████████▏| 339954/371472 [4:52:55<2:26:44,  3.58it/s]
 92%|█████████▏| 339955/371472 [4:52:56<2:44:58,  3.18it/s]
 92%|█████████▏| 339956/371472 [4:52:56<2:58:13,  2.95it/s]
 92%|█████████▏| 339957/371472 [4:52:56<2:47:32,  3.14it/s]
 92%|█████████▏| 339958/371472 [4:52:57<2:39:38,  3.29it/s]
 92%|█████████▏| 339959/371472 [4:52:57<2:37:01,  3.34it/s]
 92%|█████████▏| 339960/371472 [4:52:57<2:30:17,  3.49it/s]
                                                           
{'loss': 2.5466, 'learning_rate': 1.763882005645457e-07, 'epoch': 14.64}

 92%|█████████▏| 339960/371472 [4:52:57<2:30:17,  3.49it/s]
 92%|█████████▏| 339961/371472 [4:52:57<2:27:19,  3.56it/s]
 92%|█████████▏| 339962/371472 [4:52:58<2:22:20,  3.69it/s]
 92%|█████████▏| 339963/371472 [4:52:58<2:23:12,  3.67it/s]
 92%|█████████▏| 339964/371472 [4:52:58<2:23:31,  3.66it/s]
 92%|█████████▏| 339965/371472 [4:52:59<2:29:59,  3.50it/s]
 92%|█████████▏| 339966/371472 [4:52:59<2:26:30,  3.58it/s]
 92%|█████████▏| 339967/371472 [4:52:59<2:47:51,  3.13it/s]
 92%|█████████▏| 339968/371472 [4:53:00<2:37:08,  3.34it/s]
 92%|█████████▏| 339969/371472 [4:53:00<2:37:08,  3.34it/s]
 92%|█████████▏| 339970/371472 [4:53:00<2:46:29,  3.15it/s]
 92%|█████████▏| 339971/371472 [4:53:00<2:38:25,  3.31it/s]
 92%|█████████▏| 339972/371472 [4:53:01<2:40:26,  3.27it/s]
 92%|█████████▏| 339973/371472 [4:53:01<2:36:51,  3.35it/s]
 92%|█████████▏| 339974/371472 [4:53:01<2:36:10,  3.36it/s]
 92%|█████████▏| 339975/371472 [4:53:02<2:32:18,  3.45it/s]
 92%|█████████▏| 339976/371472 [4:53:02<2:35:28,  3.38it/s]
 92%|█████████▏| 339977/371472 [4:53:02<2:39:09,  3.30it/s]
 92%|█████████▏| 339978/371472 [4:53:03<2:38:35,  3.31it/s]
 92%|█████████▏| 339979/371472 [4:53:03<2:32:23,  3.44it/s]
 92%|█████████▏| 339980/371472 [4:53:03<2:28:18,  3.54it/s]
                                                           
{'loss': 2.6752, 'learning_rate': 1.7633971858906677e-07, 'epoch': 14.64}

 92%|█████████▏| 339980/371472 [4:53:03<2:28:18,  3.54it/s]
 92%|█████████▏| 339981/371472 [4:53:03<2:23:38,  3.65it/s]
 92%|█████████▏| 339982/371472 [4:53:04<2:37:20,  3.34it/s]
 92%|█████████▏| 339983/371472 [4:53:04<2:36:07,  3.36it/s]
 92%|█████████▏| 339984/371472 [4:53:04<2:32:48,  3.43it/s]
 92%|█████████▏| 339985/371472 [4:53:05<2:33:55,  3.41it/s]
 92%|█████████▏| 339986/371472 [4:53:05<2:31:40,  3.46it/s]
 92%|█████████▏| 339987/371472 [4:53:05<2:27:56,  3.55it/s]
 92%|█████████▏| 339988/371472 [4:53:05<2:31:50,  3.46it/s]
 92%|█████████▏| 339989/371472 [4:53:06<2:45:27,  3.17it/s]
 92%|█████████▏| 339990/371472 [4:53:06<2:41:58,  3.24it/s]
 92%|█████████▏| 339991/371472 [4:53:06<2:32:17,  3.45it/s]
 92%|█████████▏| 339992/371472 [4:53:07<2:32:30,  3.44it/s]
 92%|█████████▏| 339993/371472 [4:53:07<2:36:10,  3.36it/s]
 92%|█████████▏| 339994/371472 [4:53:07<2:40:57,  3.26it/s]
 92%|█████████▏| 339995/371472 [4:53:08<2:35:20,  3.38it/s]
 92%|█████████▏| 339996/371472 [4:53:08<2:32:25,  3.44it/s]
 92%|█████████▏| 339997/371472 [4:53:08<2:37:09,  3.34it/s]
 92%|█████████▏| 339998/371472 [4:53:08<2:32:39,  3.44it/s]
 92%|█████████▏| 339999/371472 [4:53:09<2:30:15,  3.49it/s]
 92%|█████████▏| 340000/371472 [4:53:09<2:37:21,  3.33it/s]
                                                           
{'loss': 2.6851, 'learning_rate': 1.762912366135879e-07, 'epoch': 14.64}

 92%|█████████▏| 340000/371472 [4:53:09<2:37:21,  3.33it/s]
 92%|█████████▏| 340001/371472 [4:53:09<2:30:32,  3.48it/s]
 92%|█████████▏| 340002/371472 [4:53:10<2:37:31,  3.33it/s]
 92%|█████████▏| 340003/371472 [4:53:10<2:33:08,  3.42it/s]
 92%|█████████▏| 340004/371472 [4:53:10<2:26:34,  3.58it/s]
 92%|█████████▏| 340005/371472 [4:53:10<2:25:39,  3.60it/s]
 92%|█████████▏| 340006/371472 [4:53:11<2:34:10,  3.40it/s]
 92%|█████████▏| 340007/371472 [4:53:11<2:31:06,  3.47it/s]
 92%|█████████▏| 340008/371472 [4:53:11<2:27:04,  3.57it/s]
 92%|█████████▏| 340009/371472 [4:53:11<2:20:53,  3.72it/s]
 92%|█████████▏| 340010/371472 [4:53:12<2:20:36,  3.73it/s]
 92%|█████████▏| 340011/371472 [4:53:12<2:18:48,  3.78it/s]
 92%|█████████▏| 340012/371472 [4:53:12<2:25:26,  3.61it/s]
 92%|█████████▏| 340013/371472 [4:53:13<2:31:02,  3.47it/s]
 92%|█████████▏| 340014/371472 [4:53:13<2:26:41,  3.57it/s]
 92%|█████████▏| 340015/371472 [4:53:13<2:34:39,  3.39it/s]
 92%|█████████▏| 340016/371472 [4:53:13<2:27:08,  3.56it/s]
 92%|█████████▏| 340017/371472 [4:53:14<2:32:09,  3.45it/s]
 92%|█████████▏| 340018/371472 [4:53:14<2:29:12,  3.51it/s]
 92%|█████████▏| 340019/371472 [4:53:14<2:28:47,  3.52it/s]
 92%|█████████▏| 340020/371472 [4:53:15<2:39:38,  3.28it/s]
                                                           
{'loss': 2.5789, 'learning_rate': 1.7624275463810897e-07, 'epoch': 14.65}

 92%|█████████▏| 340020/371472 [4:53:15<2:39:38,  3.28it/s]
 92%|█████████▏| 340021/371472 [4:53:15<2:48:04,  3.12it/s]
 92%|█████████▏| 340022/371472 [4:53:15<2:41:00,  3.26it/s]
 92%|█████████▏| 340023/371472 [4:53:16<2:42:50,  3.22it/s]
 92%|█████████▏| 340024/371472 [4:53:16<3:05:45,  2.82it/s]
 92%|█████████▏| 340025/371472 [4:53:16<2:55:51,  2.98it/s]
 92%|█████████▏| 340026/371472 [4:53:17<2:46:05,  3.16it/s]
 92%|█████████▏| 340027/371472 [4:53:17<2:39:48,  3.28it/s]
 92%|█████████▏| 340028/371472 [4:53:17<2:34:36,  3.39it/s]
 92%|█████████▏| 340029/371472 [4:53:17<2:31:13,  3.47it/s]
 92%|█████████▏| 340030/371472 [4:53:18<2:28:00,  3.54it/s]
 92%|█████████▏| 340031/371472 [4:53:18<2:30:23,  3.48it/s]
 92%|█████████▏| 340032/371472 [4:53:18<2:33:38,  3.41it/s]
 92%|█████████▏| 340033/371472 [4:53:19<2:33:15,  3.42it/s]
 92%|█████████▏| 340034/371472 [4:53:19<2:31:50,  3.45it/s]
 92%|█████████▏| 340035/371472 [4:53:19<2:27:24,  3.55it/s]
 92%|█████████▏| 340036/371472 [4:53:20<2:32:56,  3.43it/s]
 92%|█████████▏| 340037/371472 [4:53:20<2:31:48,  3.45it/s]
 92%|█████████▏| 340038/371472 [4:53:20<2:32:15,  3.44it/s]
 92%|█████████▏| 340039/371472 [4:53:20<2:32:48,  3.43it/s]
 92%|█████████▏| 340040/371472 [4:53:21<2:29:33,  3.50it/s]
                                                           
{'loss': 2.4464, 'learning_rate': 1.7619427266263015e-07, 'epoch': 14.65}

 92%|█████████▏| 340040/371472 [4:53:21<2:29:33,  3.50it/s]
 92%|█████████▏| 340041/371472 [4:53:21<2:30:19,  3.48it/s]
 92%|█████████▏| 340042/371472 [4:53:21<2:26:24,  3.58it/s]
 92%|█████████▏| 340043/371472 [4:53:21<2:23:53,  3.64it/s]
 92%|█████████▏| 340044/371472 [4:53:22<2:17:32,  3.81it/s]
 92%|█████████▏| 340045/371472 [4:53:22<2:18:40,  3.78it/s]
 92%|█████████▏| 340046/371472 [4:53:22<2:19:45,  3.75it/s]
 92%|█████████▏| 340047/371472 [4:53:22<2:17:14,  3.82it/s]
 92%|█████████▏| 340048/371472 [4:53:23<2:18:00,  3.79it/s]
 92%|█████████▏| 340049/371472 [4:53:23<2:27:06,  3.56it/s]
 92%|█████████▏| 340050/371472 [4:53:23<2:28:20,  3.53it/s]
 92%|█████████▏| 340051/371472 [4:53:24<2:29:44,  3.50it/s]
 92%|█████████▏| 340052/371472 [4:53:24<2:29:55,  3.49it/s]
 92%|█████████▏| 340053/371472 [4:53:24<2:26:52,  3.57it/s]
 92%|█████████▏| 340054/371472 [4:53:24<2:23:45,  3.64it/s]
 92%|█████████▏| 340055/371472 [4:53:25<2:21:45,  3.69it/s]
 92%|█████████▏| 340056/371472 [4:53:25<2:21:21,  3.70it/s]
 92%|█████████▏| 340057/371472 [4:53:25<2:22:20,  3.68it/s]
 92%|█████████▏| 340058/371472 [4:53:26<2:23:54,  3.64it/s]
 92%|█████████▏| 340059/371472 [4:53:26<2:24:16,  3.63it/s]
 92%|█████████▏| 340060/371472 [4:53:26<2:25:24,  3.60it/s]
                                                           
{'loss': 2.5959, 'learning_rate': 1.761457906871512e-07, 'epoch': 14.65}

 92%|█████████▏| 340060/371472 [4:53:26<2:25:24,  3.60it/s]
 92%|█████████▏| 340061/371472 [4:53:26<2:34:39,  3.38it/s]
 92%|█████████▏| 340062/371472 [4:53:27<2:31:00,  3.47it/s]
 92%|█████████▏| 340063/371472 [4:53:27<2:27:49,  3.54it/s]
 92%|█████████▏| 340064/371472 [4:53:27<2:28:48,  3.52it/s]
 92%|█████████▏| 340065/371472 [4:53:28<2:30:11,  3.49it/s]
 92%|█████████▏| 340066/371472 [4:53:28<2:25:52,  3.59it/s]
 92%|█████████▏| 340067/371472 [4:53:28<2:33:08,  3.42it/s]
 92%|█████████▏| 340068/371472 [4:53:28<2:28:38,  3.52it/s]
 92%|█████████▏| 340069/371472 [4:53:29<2:28:21,  3.53it/s]
 92%|█████████▏| 340070/371472 [4:53:29<2:41:26,  3.24it/s]
 92%|█████████▏| 340071/371472 [4:53:29<2:31:59,  3.44it/s]
 92%|█████████▏| 340072/371472 [4:53:30<2:25:33,  3.60it/s]
 92%|█████████▏| 340073/371472 [4:53:30<2:41:29,  3.24it/s]
 92%|█████████▏| 340074/371472 [4:53:30<2:33:26,  3.41it/s]
 92%|█████████▏| 340075/371472 [4:53:30<2:32:00,  3.44it/s]
 92%|█████████▏| 340076/371472 [4:53:31<2:38:50,  3.29it/s]
 92%|█████████▏| 340077/371472 [4:53:31<2:32:38,  3.43it/s]
 92%|█████████▏| 340078/371472 [4:53:31<2:25:07,  3.61it/s]
 92%|█████████▏| 340079/371472 [4:53:32<2:24:22,  3.62it/s]
 92%|█████████▏| 340080/371472 [4:53:32<2:28:58,  3.51it/s]
                                                           
{'loss': 2.6947, 'learning_rate': 1.7609730871167234e-07, 'epoch': 14.65}

 92%|█████████▏| 340080/371472 [4:53:32<2:28:58,  3.51it/s]
 92%|█████████▏| 340081/371472 [4:53:32<2:25:05,  3.61it/s]
 92%|█████████▏| 340082/371472 [4:53:32<2:28:53,  3.51it/s]
 92%|█████████▏| 340083/371472 [4:53:33<2:31:43,  3.45it/s]
 92%|█████████▏| 340084/371472 [4:53:33<2:27:30,  3.55it/s]
 92%|█████████▏| 340085/371472 [4:53:33<2:22:45,  3.66it/s]
 92%|█████████▏| 340086/371472 [4:53:34<2:19:20,  3.75it/s]
 92%|█████████▏| 340087/371472 [4:53:34<2:17:20,  3.81it/s]
 92%|█████████▏| 340088/371472 [4:53:34<2:18:00,  3.79it/s]
 92%|█████████▏| 340089/371472 [4:53:34<2:24:07,  3.63it/s]
 92%|█████████▏| 340090/371472 [4:53:35<2:22:00,  3.68it/s]
 92%|█████████▏| 340091/371472 [4:53:35<2:18:39,  3.77it/s]
 92%|█████████▏| 340092/371472 [4:53:35<2:16:51,  3.82it/s]
 92%|█████████▏| 340093/371472 [4:53:35<2:17:16,  3.81it/s]
 92%|█████████▏| 340094/371472 [4:53:36<2:27:33,  3.54it/s]
 92%|█████████▏| 340095/371472 [4:53:36<2:29:05,  3.51it/s]
 92%|█████████▏| 340096/371472 [4:53:36<2:33:35,  3.40it/s]
 92%|█████████▏| 340097/371472 [4:53:37<2:28:20,  3.53it/s]
 92%|█████████▏| 340098/371472 [4:53:37<2:27:57,  3.53it/s]
 92%|█████████▏| 340099/371472 [4:53:37<2:22:42,  3.66it/s]
 92%|█████████▏| 340100/371472 [4:53:37<2:24:31,  3.62it/s]
                                                           
{'loss': 2.5643, 'learning_rate': 1.760488267361934e-07, 'epoch': 14.65}

 92%|█████████▏| 340100/371472 [4:53:37<2:24:31,  3.62it/s]
 92%|█████████▏| 340101/371472 [4:53:38<2:22:54,  3.66it/s]
 92%|█████████▏| 340102/371472 [4:53:38<2:19:17,  3.75it/s]
 92%|█████████▏| 340103/371472 [4:53:38<2:16:34,  3.83it/s]
 92%|█████████▏| 340104/371472 [4:53:38<2:16:03,  3.84it/s]
 92%|█████████▏| 340105/371472 [4:53:39<2:16:34,  3.83it/s]
 92%|█████████▏| 340106/371472 [4:53:39<2:15:08,  3.87it/s]
 92%|█████████▏| 340107/371472 [4:53:39<2:20:37,  3.72it/s]
 92%|█████████▏| 340108/371472 [4:53:40<2:24:03,  3.63it/s]
 92%|█████████▏| 340109/371472 [4:53:40<2:25:08,  3.60it/s]
 92%|█████████▏| 340110/371472 [4:53:40<2:27:28,  3.54it/s]
 92%|█████████▏| 340111/371472 [4:53:40<2:29:38,  3.49it/s]
 92%|█████████▏| 340112/371472 [4:53:41<2:24:59,  3.60it/s]
 92%|█████████▏| 340113/371472 [4:53:41<2:23:35,  3.64it/s]
 92%|█████████▏| 340114/371472 [4:53:41<2:22:15,  3.67it/s]
 92%|█████████▏| 340115/371472 [4:53:42<2:27:12,  3.55it/s]
 92%|█████████▏| 340116/371472 [4:53:42<2:20:51,  3.71it/s]
 92%|█████████▏| 340117/371472 [4:53:42<2:35:47,  3.35it/s]
 92%|█████████▏| 340118/371472 [4:53:42<2:36:25,  3.34it/s]
 92%|█████████▏| 340119/371472 [4:53:43<2:33:08,  3.41it/s]
 92%|█████████▏| 340120/371472 [4:53:43<2:36:28,  3.34it/s]
                                                           
{'loss': 2.5277, 'learning_rate': 1.7600034476071446e-07, 'epoch': 14.65}

 92%|█████████▏| 340120/371472 [4:53:43<2:36:28,  3.34it/s]
 92%|█████████▏| 340121/371472 [4:53:43<2:32:04,  3.44it/s]
 92%|█████████▏| 340122/371472 [4:53:44<2:31:32,  3.45it/s]
 92%|█████████▏| 340123/371472 [4:53:44<2:23:04,  3.65it/s]
 92%|█████████▏| 340124/371472 [4:53:44<2:28:55,  3.51it/s]
 92%|█████████▏| 340125/371472 [4:53:44<2:34:36,  3.38it/s]
 92%|█████████▏| 340126/371472 [4:53:45<2:31:39,  3.44it/s]
 92%|█████████▏| 340127/371472 [4:53:45<2:27:12,  3.55it/s]
 92%|█████████▏| 340128/371472 [4:53:45<2:34:35,  3.38it/s]
 92%|█████████▏| 340129/371472 [4:53:46<2:31:15,  3.45it/s]
 92%|█████████▏| 340130/371472 [4:53:46<2:35:09,  3.37it/s]
 92%|█████████▏| 340131/371472 [4:53:46<2:32:28,  3.43it/s]
 92%|█████████▏| 340132/371472 [4:53:46<2:27:01,  3.55it/s]
 92%|█████████▏| 340133/371472 [4:53:47<2:33:42,  3.40it/s]
 92%|█████████▏| 340134/371472 [4:53:47<2:33:29,  3.40it/s]
 92%|█████████▏| 340135/371472 [4:53:47<2:28:35,  3.51it/s]
 92%|█████████▏| 340136/371472 [4:53:48<2:25:54,  3.58it/s]
 92%|█████████▏| 340137/371472 [4:53:48<2:23:21,  3.64it/s]
 92%|█████████▏| 340138/371472 [4:53:48<2:25:54,  3.58it/s]
 92%|█████████▏| 340139/371472 [4:53:48<2:27:16,  3.55it/s]
 92%|█████████▏| 340140/371472 [4:53:49<2:30:26,  3.47it/s]
                                                           
{'loss': 2.5237, 'learning_rate': 1.759518627852356e-07, 'epoch': 14.65}

 92%|█████████▏| 340140/371472 [4:53:49<2:30:26,  3.47it/s]
 92%|█████████▏| 340141/371472 [4:53:49<2:26:04,  3.57it/s]
 92%|█████████▏| 340142/371472 [4:53:49<2:31:46,  3.44it/s]
 92%|█████████▏| 340143/371472 [4:53:50<2:35:11,  3.36it/s]
 92%|█████████▏| 340144/371472 [4:53:50<2:29:26,  3.49it/s]
 92%|█████████▏| 340145/371472 [4:53:50<2:29:57,  3.48it/s]
 92%|█████████▏| 340146/371472 [4:53:50<2:26:07,  3.57it/s]
 92%|█████████▏| 340147/371472 [4:53:51<2:23:33,  3.64it/s]
 92%|█████████▏| 340148/371472 [4:53:51<2:28:43,  3.51it/s]
 92%|█████████▏| 340149/371472 [4:53:51<2:31:38,  3.44it/s]
 92%|█████████▏| 340150/371472 [4:53:52<2:29:20,  3.50it/s]
 92%|█████████▏| 340151/371472 [4:53:52<2:31:59,  3.43it/s]
 92%|█████████▏| 340152/371472 [4:53:52<2:28:50,  3.51it/s]
 92%|█████████▏| 340153/371472 [4:53:52<2:22:43,  3.66it/s]
 92%|█████████▏| 340154/371472 [4:53:53<2:19:37,  3.74it/s]
 92%|█████████▏| 340155/371472 [4:53:53<2:19:51,  3.73it/s]
 92%|█████████▏| 340156/371472 [4:53:53<2:20:57,  3.70it/s]
 92%|█████████▏| 340157/371472 [4:53:54<2:32:05,  3.43it/s]
 92%|█████████▏| 340158/371472 [4:53:54<2:29:42,  3.49it/s]
 92%|█████████▏| 340159/371472 [4:53:54<2:28:30,  3.51it/s]
 92%|█████████▏| 340160/371472 [4:53:54<2:24:42,  3.61it/s]
                                                           
{'loss': 2.6182, 'learning_rate': 1.7590338080975668e-07, 'epoch': 14.65}

 92%|█████████▏| 340160/371472 [4:53:54<2:24:42,  3.61it/s]
 92%|█████████▏| 340161/371472 [4:53:55<2:22:43,  3.66it/s]
 92%|█████████▏| 340162/371472 [4:53:55<2:21:19,  3.69it/s]
 92%|█████████▏| 340163/371472 [4:53:55<2:24:18,  3.62it/s]
 92%|█████████▏| 340164/371472 [4:53:55<2:31:00,  3.46it/s]
 92%|█████████▏| 340165/371472 [4:53:56<2:25:07,  3.60it/s]
 92%|█████████▏| 340166/371472 [4:53:56<2:31:15,  3.45it/s]
 92%|█████████▏| 340167/371472 [4:53:56<2:26:56,  3.55it/s]
 92%|█████████▏| 340168/371472 [4:53:57<2:30:25,  3.47it/s]
 92%|█████████▏| 340169/371472 [4:53:57<2:29:29,  3.49it/s]
 92%|█████████▏| 340170/371472 [4:53:57<2:24:41,  3.61it/s]
 92%|█████████▏| 340171/371472 [4:53:57<2:22:12,  3.67it/s]
 92%|█████████▏| 340172/371472 [4:53:58<2:19:40,  3.73it/s]
 92%|█████████▏| 340173/371472 [4:53:58<2:17:16,  3.80it/s]
 92%|█████████▏| 340174/371472 [4:53:58<2:22:10,  3.67it/s]
 92%|█████████▏| 340175/371472 [4:53:58<2:21:43,  3.68it/s]
 92%|█████████▏| 340176/371472 [4:53:59<2:21:44,  3.68it/s]
 92%|█████████▏| 340177/371472 [4:53:59<2:37:19,  3.32it/s]
 92%|█████████▏| 340178/371472 [4:53:59<2:35:16,  3.36it/s]
 92%|█████████▏| 340179/371472 [4:54:00<2:33:53,  3.39it/s]
 92%|█████████▏| 340180/371472 [4:54:00<2:31:41,  3.44it/s]
                                                           
{'loss': 2.6643, 'learning_rate': 1.7585489883427783e-07, 'epoch': 14.65}

 92%|█████████▏| 340180/371472 [4:54:00<2:31:41,  3.44it/s]
 92%|█████████▏| 340181/371472 [4:54:00<2:29:43,  3.48it/s]
 92%|█████████▏| 340182/371472 [4:54:01<2:36:13,  3.34it/s]
 92%|█████████▏| 340183/371472 [4:54:01<2:29:38,  3.48it/s]
 92%|█████████▏| 340184/371472 [4:54:01<2:29:33,  3.49it/s]
 92%|█████████▏| 340185/371472 [4:54:01<2:34:05,  3.38it/s]
 92%|█████████▏| 340186/371472 [4:54:02<2:29:43,  3.48it/s]
 92%|█████████▏| 340187/371472 [4:54:02<2:26:04,  3.57it/s]
 92%|█████████▏| 340188/371472 [4:54:02<2:21:18,  3.69it/s]
 92%|█████████▏| 340189/371472 [4:54:03<2:22:46,  3.65it/s]
 92%|█████████▏| 340190/371472 [4:54:03<2:19:15,  3.74it/s]
 92%|█████████▏| 340191/371472 [4:54:03<2:22:05,  3.67it/s]
 92%|█████████▏| 340192/371472 [4:54:03<2:32:14,  3.42it/s]
 92%|█████████▏| 340193/371472 [4:54:04<2:28:49,  3.50it/s]
 92%|█████████▏| 340194/371472 [4:54:04<2:31:48,  3.43it/s]
 92%|█████████▏| 340195/371472 [4:54:04<2:31:32,  3.44it/s]
 92%|█████████▏| 340196/371472 [4:54:05<2:31:21,  3.44it/s]
 92%|█████████▏| 340197/371472 [4:54:05<2:25:27,  3.58it/s]
 92%|█████████▏| 340198/371472 [4:54:05<2:33:17,  3.40it/s]
 92%|█████████▏| 340199/371472 [4:54:05<2:30:46,  3.46it/s]
 92%|█████████▏| 340200/371472 [4:54:06<2:31:53,  3.43it/s]
                                                           
{'loss': 2.5842, 'learning_rate': 1.7580641685879888e-07, 'epoch': 14.65}

 92%|█████████▏| 340200/371472 [4:54:06<2:31:53,  3.43it/s]
 92%|█████████▏| 340201/371472 [4:54:06<2:30:45,  3.46it/s]
 92%|█████████▏| 340202/371472 [4:54:06<2:31:11,  3.45it/s]
 92%|█████████▏| 340203/371472 [4:54:07<2:26:11,  3.56it/s]
 92%|█████████▏| 340204/371472 [4:54:07<2:19:34,  3.73it/s]
 92%|█████████▏| 340205/371472 [4:54:07<2:21:11,  3.69it/s]
 92%|█████████▏| 340206/371472 [4:54:07<2:21:26,  3.68it/s]
 92%|█████████▏| 340207/371472 [4:54:08<2:21:20,  3.69it/s]
 92%|█████████▏| 340208/371472 [4:54:08<2:23:53,  3.62it/s]
 92%|█████████▏| 340209/371472 [4:54:08<2:23:11,  3.64it/s]
 92%|█████████▏| 340210/371472 [4:54:08<2:21:29,  3.68it/s]
 92%|█████████▏| 340211/371472 [4:54:09<2:19:32,  3.73it/s]
 92%|█████████▏| 340212/371472 [4:54:09<2:16:26,  3.82it/s]
 92%|█████████▏| 340213/371472 [4:54:09<2:19:55,  3.72it/s]
 92%|█████████▏| 340214/371472 [4:54:09<2:19:06,  3.74it/s]
 92%|█████████▏| 340215/371472 [4:54:10<2:44:33,  3.17it/s]
 92%|█████████▏| 340216/371472 [4:54:10<2:35:09,  3.36it/s]
 92%|█████████▏| 340217/371472 [4:54:10<2:40:32,  3.24it/s]
 92%|█████████▏| 340218/371472 [4:54:11<2:44:58,  3.16it/s]
 92%|█████████▏| 340219/371472 [4:54:11<2:43:38,  3.18it/s]
 92%|█████████▏| 340220/371472 [4:54:11<2:36:13,  3.33it/s]
                                                           
{'loss': 2.6119, 'learning_rate': 1.7575793488332005e-07, 'epoch': 14.65}

 92%|█████████▏| 340220/371472 [4:54:11<2:36:13,  3.33it/s]
 92%|█████████▏| 340221/371472 [4:54:12<2:30:38,  3.46it/s]
 92%|█████████▏| 340222/371472 [4:54:12<2:35:53,  3.34it/s]
 92%|█████████▏| 340223/371472 [4:54:12<2:37:44,  3.30it/s]
 92%|█████████▏| 340224/371472 [4:54:13<2:36:04,  3.34it/s]
 92%|█████████▏| 340225/371472 [4:54:13<2:28:38,  3.50it/s]
 92%|█████████▏| 340226/371472 [4:54:13<2:28:48,  3.50it/s]
 92%|█████████▏| 340227/371472 [4:54:13<2:28:24,  3.51it/s]
 92%|█████████▏| 340228/371472 [4:54:14<2:26:38,  3.55it/s]
 92%|█████████▏| 340229/371472 [4:54:14<2:22:05,  3.66it/s]
 92%|█████████▏| 340230/371472 [4:54:14<2:22:29,  3.65it/s]
 92%|█████████▏| 340231/371472 [4:54:15<2:26:22,  3.56it/s]
 92%|█████████▏| 340232/371472 [4:54:15<2:25:41,  3.57it/s]
 92%|█████████▏| 340233/371472 [4:54:15<2:31:38,  3.43it/s]
 92%|█████████▏| 340234/371472 [4:54:15<2:28:36,  3.50it/s]
 92%|█████████▏| 340235/371472 [4:54:16<2:30:31,  3.46it/s]
 92%|█████████▏| 340236/371472 [4:54:16<2:26:54,  3.54it/s]
 92%|█████████▏| 340237/371472 [4:54:16<2:41:07,  3.23it/s]
 92%|█████████▏| 340238/371472 [4:54:17<2:50:33,  3.05it/s]
 92%|█████████▏| 340239/371472 [4:54:17<2:38:17,  3.29it/s]
 92%|█████████▏| 340240/371472 [4:54:17<2:30:49,  3.45it/s]
                                                           
{'loss': 2.5157, 'learning_rate': 1.757094529078411e-07, 'epoch': 14.65}

 92%|█████████▏| 340240/371472 [4:54:17<2:30:49,  3.45it/s]
 92%|█████████▏| 340241/371472 [4:54:18<2:33:07,  3.40it/s]
 92%|█████████▏| 340242/371472 [4:54:18<2:30:07,  3.47it/s]
 92%|█████████▏| 340243/371472 [4:54:18<2:22:42,  3.65it/s]
 92%|█████████▏| 340244/371472 [4:54:18<2:22:41,  3.65it/s]
 92%|█████████▏| 340245/371472 [4:54:19<2:25:28,  3.58it/s]
 92%|█████████▏| 340246/371472 [4:54:19<2:18:41,  3.75it/s]
 92%|█████████▏| 340247/371472 [4:54:19<2:17:50,  3.78it/s]
 92%|█████████▏| 340248/371472 [4:54:19<2:24:07,  3.61it/s]
 92%|█████████▏| 340249/371472 [4:54:20<2:22:26,  3.65it/s]
 92%|█████████▏| 340250/371472 [4:54:20<2:21:16,  3.68it/s]
 92%|█████████▏| 340251/371472 [4:54:20<2:21:10,  3.69it/s]
 92%|█████████▏| 340252/371472 [4:54:20<2:23:45,  3.62it/s]
 92%|█████████▏| 340253/371472 [4:54:21<2:22:04,  3.66it/s]
 92%|█████████▏| 340254/371472 [4:54:21<2:27:16,  3.53it/s]
 92%|█████████▏| 340255/371472 [4:54:21<2:22:24,  3.65it/s]
 92%|█████████▏| 340256/371472 [4:54:22<2:20:24,  3.71it/s]
 92%|█████████▏| 340257/371472 [4:54:22<2:28:18,  3.51it/s]
 92%|█████████▏| 340258/371472 [4:54:22<2:24:29,  3.60it/s]
 92%|█████████▏| 340259/371472 [4:54:23<2:37:58,  3.29it/s]
 92%|█████████▏| 340260/371472 [4:54:23<2:35:32,  3.34it/s]
                                                           
{'loss': 2.5149, 'learning_rate': 1.7566097093236225e-07, 'epoch': 14.66}

 92%|█████████▏| 340260/371472 [4:54:23<2:35:32,  3.34it/s]
 92%|█████████▏| 340261/371472 [4:54:23<2:29:19,  3.48it/s]
 92%|█████████▏| 340262/371472 [4:54:23<2:37:01,  3.31it/s]
 92%|█████████▏| 340263/371472 [4:54:24<2:33:48,  3.38it/s]
 92%|█████████▏| 340264/371472 [4:54:24<2:28:06,  3.51it/s]
 92%|█████████▏| 340265/371472 [4:54:24<2:25:05,  3.58it/s]
 92%|█████████▏| 340266/371472 [4:54:24<2:25:13,  3.58it/s]
 92%|█████████▏| 340267/371472 [4:54:25<2:32:37,  3.41it/s]
 92%|█████████▏| 340268/371472 [4:54:25<2:30:01,  3.47it/s]
 92%|█████████▏| 340269/371472 [4:54:25<2:27:44,  3.52it/s]
 92%|█████████▏| 340270/371472 [4:54:26<2:23:42,  3.62it/s]
 92%|█████████▏| 340271/371472 [4:54:26<2:28:13,  3.51it/s]
 92%|█████████▏| 340272/371472 [4:54:26<2:35:37,  3.34it/s]
 92%|█████████▏| 340273/371472 [4:54:27<2:32:21,  3.41it/s]
 92%|█████████▏| 340274/371472 [4:54:27<2:28:27,  3.50it/s]
 92%|█████████▏| 340275/371472 [4:54:27<2:27:19,  3.53it/s]
 92%|█████████▏| 340276/371472 [4:54:27<2:23:51,  3.61it/s]
 92%|█████████▏| 340277/371472 [4:54:28<2:21:14,  3.68it/s]
 92%|█████████▏| 340278/371472 [4:54:28<2:24:01,  3.61it/s]
 92%|█████████▏| 340279/371472 [4:54:28<2:28:48,  3.49it/s]
 92%|█████████▏| 340280/371472 [4:54:28<2:25:23,  3.58it/s]
                                                           
{'loss': 2.5127, 'learning_rate': 1.7561248895688332e-07, 'epoch': 14.66}

 92%|█████████▏| 340280/371472 [4:54:28<2:25:23,  3.58it/s]
 92%|█████████▏| 340281/371472 [4:54:29<2:28:50,  3.49it/s]
 92%|█████████▏| 340282/371472 [4:54:29<2:32:07,  3.42it/s]
 92%|█████████▏| 340283/371472 [4:54:29<2:25:25,  3.57it/s]
 92%|█████████▏| 340284/371472 [4:54:30<2:32:08,  3.42it/s]
 92%|█████████▏| 340285/371472 [4:54:30<2:42:33,  3.20it/s]
 92%|█████████▏| 340286/371472 [4:54:30<2:37:10,  3.31it/s]
 92%|█████████▏| 340287/371472 [4:54:31<2:41:01,  3.23it/s]
 92%|█████████▏| 340288/371472 [4:54:31<2:35:30,  3.34it/s]
 92%|█████████▏| 340289/371472 [4:54:31<2:34:15,  3.37it/s]
 92%|█████████▏| 340290/371472 [4:54:31<2:26:22,  3.55it/s]
 92%|█████████▏| 340291/371472 [4:54:32<2:22:49,  3.64it/s]
 92%|█████████▏| 340292/371472 [4:54:32<2:19:47,  3.72it/s]
 92%|█████████▏| 340293/371472 [4:54:32<2:23:08,  3.63it/s]
 92%|█████████▏| 340294/371472 [4:54:33<2:23:51,  3.61it/s]
 92%|█████████▏| 340295/371472 [4:54:33<2:27:54,  3.51it/s]
 92%|█████████▏| 340296/371472 [4:54:33<2:32:16,  3.41it/s]
 92%|█████████▏| 340297/371472 [4:54:33<2:26:11,  3.55it/s]
 92%|█████████▏| 340298/371472 [4:54:34<2:22:50,  3.64it/s]
 92%|█████████▏| 340299/371472 [4:54:34<2:19:39,  3.72it/s]
 92%|█████████▏| 340300/371472 [4:54:34<2:22:21,  3.65it/s]
                                                           
{'loss': 2.5413, 'learning_rate': 1.7556400698140447e-07, 'epoch': 14.66}

 92%|█████████▏| 340300/371472 [4:54:34<2:22:21,  3.65it/s]
 92%|█████████▏| 340301/371472 [4:54:34<2:19:09,  3.73it/s]
 92%|█████████▏| 340302/371472 [4:54:35<2:20:13,  3.70it/s]
 92%|█████████▏| 340303/371472 [4:54:35<2:19:18,  3.73it/s]
 92%|█████████▏| 340304/371472 [4:54:35<2:23:07,  3.63it/s]
 92%|█████████▏| 340305/371472 [4:54:36<2:27:00,  3.53it/s]
 92%|█████████▏| 340306/371472 [4:54:36<2:31:53,  3.42it/s]
 92%|█████████▏| 340307/371472 [4:54:36<2:33:18,  3.39it/s]
 92%|█████████▏| 340308/371472 [4:54:36<2:26:48,  3.54it/s]
 92%|█████████▏| 340309/371472 [4:54:37<2:31:01,  3.44it/s]
 92%|█████████▏| 340310/371472 [4:54:37<2:47:46,  3.10it/s]
 92%|█████████▏| 340311/371472 [4:54:37<2:35:27,  3.34it/s]
 92%|█████████▏| 340312/371472 [4:54:38<2:29:12,  3.48it/s]
 92%|█████████▏| 340313/371472 [4:54:38<2:44:09,  3.16it/s]
 92%|█████████▏| 340314/371472 [4:54:38<2:34:58,  3.35it/s]
 92%|█████████▏| 340315/371472 [4:54:39<2:34:24,  3.36it/s]
 92%|█████████▏| 340316/371472 [4:54:39<2:47:11,  3.11it/s]
 92%|█████████▏| 340317/371472 [4:54:39<2:37:58,  3.29it/s]
 92%|█████████▏| 340318/371472 [4:54:39<2:34:41,  3.36it/s]
 92%|█████████▏| 340319/371472 [4:54:40<2:31:02,  3.44it/s]
 92%|█████████▏| 340320/371472 [4:54:40<2:30:00,  3.46it/s]
                                                           
{'loss': 2.6602, 'learning_rate': 1.7551552500592552e-07, 'epoch': 14.66}

 92%|█████████▏| 340320/371472 [4:54:40<2:30:00,  3.46it/s]
 92%|█████████▏| 340321/371472 [4:54:40<2:35:36,  3.34it/s]
 92%|█████████▏| 340322/371472 [4:54:41<2:30:28,  3.45it/s]
 92%|█████████▏| 340323/371472 [4:54:41<2:23:13,  3.62it/s]
 92%|█████████▏| 340324/371472 [4:54:41<2:21:39,  3.66it/s]
 92%|█████████▏| 340325/371472 [4:54:41<2:16:36,  3.80it/s]
 92%|█████████▏| 340326/371472 [4:54:42<2:22:58,  3.63it/s]
 92%|█████████▏| 340327/371472 [4:54:42<2:18:03,  3.76it/s]
 92%|█████████▏| 340328/371472 [4:54:42<2:20:53,  3.68it/s]
 92%|█████████▏| 340329/371472 [4:54:43<2:21:41,  3.66it/s]
 92%|█████████▏| 340330/371472 [4:54:43<2:22:14,  3.65it/s]
 92%|█████████▏| 340331/371472 [4:54:43<2:19:08,  3.73it/s]
 92%|█████████▏| 340332/371472 [4:54:43<2:20:00,  3.71it/s]
 92%|█████████▏| 340333/371472 [4:54:44<2:31:02,  3.44it/s]
 92%|█████████▏| 340334/371472 [4:54:44<2:33:11,  3.39it/s]
 92%|█████████▏| 340335/371472 [4:54:44<2:26:23,  3.55it/s]
 92%|█████████▏| 340336/371472 [4:54:44<2:26:10,  3.55it/s]
 92%|█████████▏| 340337/371472 [4:54:45<2:31:07,  3.43it/s]
 92%|█████████▏| 340338/371472 [4:54:45<2:27:21,  3.52it/s]
 92%|█████████▏| 340339/371472 [4:54:45<2:37:54,  3.29it/s]
 92%|█████████▏| 340340/371472 [4:54:46<2:31:22,  3.43it/s]
                                                           
{'loss': 2.69, 'learning_rate': 1.754670430304467e-07, 'epoch': 14.66}

 92%|█████████▏| 340340/371472 [4:54:46<2:31:22,  3.43it/s]
 92%|█████████▏| 340341/371472 [4:54:46<2:30:23,  3.45it/s]
 92%|█████████▏| 340342/371472 [4:54:46<2:37:40,  3.29it/s]
 92%|█████████▏| 340343/371472 [4:54:47<2:30:51,  3.44it/s]
 92%|█████████▏| 340344/371472 [4:54:47<2:24:26,  3.59it/s]
 92%|█████████▏| 340345/371472 [4:54:47<2:24:35,  3.59it/s]
 92%|█████████▏| 340346/371472 [4:54:47<2:29:45,  3.46it/s]
 92%|█████████▏| 340347/371472 [4:54:48<2:31:35,  3.42it/s]
 92%|█████████▏| 340348/371472 [4:54:48<2:31:21,  3.43it/s]
 92%|█████████▏| 340349/371472 [4:54:48<2:36:09,  3.32it/s]
 92%|█████████▏| 340350/371472 [4:54:49<2:31:34,  3.42it/s]
 92%|█████████▏| 340351/371472 [4:54:49<2:50:16,  3.05it/s]
 92%|█████████▏| 340352/371472 [4:54:49<2:50:49,  3.04it/s]
 92%|█████████▏| 340353/371472 [4:54:50<2:46:54,  3.11it/s]
 92%|█████████▏| 340354/371472 [4:54:50<2:49:08,  3.07it/s]
 92%|█████████▏| 340355/371472 [4:54:50<2:39:41,  3.25it/s]
 92%|█████████▏| 340356/371472 [4:54:51<2:36:49,  3.31it/s]
 92%|█████████▏| 340357/371472 [4:54:51<2:42:22,  3.19it/s]
 92%|█████████▏| 340358/371472 [4:54:51<2:35:42,  3.33it/s]
 92%|█████████▏| 340359/371472 [4:54:51<2:26:41,  3.54it/s]
 92%|█████████▏| 340360/371472 [4:54:52<2:21:41,  3.66it/s]
                                                           
{'loss': 2.5693, 'learning_rate': 1.7541856105496777e-07, 'epoch': 14.66}

 92%|█████████▏| 340360/371472 [4:54:52<2:21:41,  3.66it/s]
 92%|█████████▏| 340361/371472 [4:54:52<2:29:30,  3.47it/s]
 92%|█████████▏| 340362/371472 [4:54:52<2:31:04,  3.43it/s]
 92%|█████████▏| 340363/371472 [4:54:53<2:32:07,  3.41it/s]
 92%|█████████▏| 340364/371472 [4:54:53<2:31:31,  3.42it/s]
 92%|█████████▏| 340365/371472 [4:54:53<2:29:53,  3.46it/s]
 92%|█████████▏| 340366/371472 [4:54:53<2:26:10,  3.55it/s]
 92%|█████████▏| 340367/371472 [4:54:54<2:25:18,  3.57it/s]
 92%|█████████▏| 340368/371472 [4:54:54<2:21:15,  3.67it/s]
 92%|█████████▏| 340369/371472 [4:54:54<2:17:32,  3.77it/s]
 92%|█████████▏| 340370/371472 [4:54:54<2:18:50,  3.73it/s]
 92%|█████████▏| 340371/371472 [4:54:55<2:17:52,  3.76it/s]
 92%|█████████▏| 340372/371472 [4:54:55<2:32:18,  3.40it/s]
 92%|█████████▏| 340373/371472 [4:54:55<2:31:55,  3.41it/s]
 92%|█████████▏| 340374/371472 [4:54:56<2:32:16,  3.40it/s]
 92%|█████████▏| 340375/371472 [4:54:56<2:29:22,  3.47it/s]
 92%|█████████▏| 340376/371472 [4:54:56<2:29:44,  3.46it/s]
 92%|█████████▏| 340377/371472 [4:54:57<2:33:50,  3.37it/s]
 92%|█████████▏| 340378/371472 [4:54:57<2:26:01,  3.55it/s]
 92%|█████████▏| 340379/371472 [4:54:57<3:04:40,  2.81it/s]
 92%|█████████▏| 340380/371472 [4:54:58<2:54:15,  2.97it/s]
                                                           
{'loss': 2.6219, 'learning_rate': 1.753700790794889e-07, 'epoch': 14.66}

 92%|█████████▏| 340380/371472 [4:54:58<2:54:15,  2.97it/s]
 92%|█████████▏| 340381/371472 [4:54:58<2:42:36,  3.19it/s]
 92%|█████████▏| 340382/371472 [4:54:58<2:33:50,  3.37it/s]
 92%|█████████▏| 340383/371472 [4:54:58<2:38:04,  3.28it/s]
 92%|█████████▏| 340384/371472 [4:54:59<2:32:29,  3.40it/s]
 92%|█████████▏| 340385/371472 [4:54:59<2:39:51,  3.24it/s]
 92%|█████████▏| 340386/371472 [4:54:59<2:34:41,  3.35it/s]
 92%|█████████▏| 340387/371472 [4:55:00<2:29:49,  3.46it/s]
 92%|█████████▏| 340388/371472 [4:55:00<2:39:30,  3.25it/s]
 92%|█████████▏| 340389/371472 [4:55:00<2:32:11,  3.40it/s]
 92%|█████████▏| 340390/371472 [4:55:00<2:26:52,  3.53it/s]
 92%|█████████▏| 340391/371472 [4:55:01<2:35:42,  3.33it/s]
 92%|█████████▏| 340392/371472 [4:55:01<2:35:28,  3.33it/s]
 92%|█████████▏| 340393/371472 [4:55:01<2:31:49,  3.41it/s]
 92%|█████████▏| 340394/371472 [4:55:02<2:24:39,  3.58it/s]
 92%|█████████▏| 340395/371472 [4:55:02<2:25:25,  3.56it/s]
 92%|█████████▏| 340396/371472 [4:55:02<2:31:56,  3.41it/s]
 92%|█████████▏| 340397/371472 [4:55:02<2:26:58,  3.52it/s]
 92%|█████████▏| 340398/371472 [4:55:03<2:22:41,  3.63it/s]
 92%|█████████▏| 340399/371472 [4:55:03<2:22:10,  3.64it/s]
 92%|█████████▏| 340400/371472 [4:55:03<2:20:19,  3.69it/s]
                                                           
{'loss': 2.6203, 'learning_rate': 1.7532159710400996e-07, 'epoch': 14.66}

 92%|█████████▏| 340400/371472 [4:55:03<2:20:19,  3.69it/s]
 92%|█████████▏| 340401/371472 [4:55:04<2:16:19,  3.80it/s]
 92%|█████████▏| 340402/371472 [4:55:04<2:18:14,  3.75it/s]
 92%|█████████▏| 340403/371472 [4:55:04<2:19:08,  3.72it/s]
 92%|█████████▏| 340404/371472 [4:55:04<2:27:02,  3.52it/s]
 92%|█████████▏| 340405/371472 [4:55:05<2:32:04,  3.40it/s]
 92%|█████████▏| 340406/371472 [4:55:05<2:30:12,  3.45it/s]
 92%|█████████▏| 340407/371472 [4:55:05<2:23:02,  3.62it/s]
 92%|█████████▏| 340408/371472 [4:55:06<2:27:50,  3.50it/s]
 92%|█████████▏| 340409/371472 [4:55:06<2:42:18,  3.19it/s]
 92%|█████████▏| 340410/371472 [4:55:06<2:37:37,  3.28it/s]
 92%|█████████▏| 340411/371472 [4:55:07<2:40:19,  3.23it/s]
 92%|█████████▏| 340412/371472 [4:55:07<2:38:33,  3.26it/s]
 92%|█████████▏| 340413/371472 [4:55:07<2:38:17,  3.27it/s]
 92%|█████████▏| 340414/371472 [4:55:07<2:41:53,  3.20it/s]
 92%|█████████▏| 340415/371472 [4:55:08<2:40:12,  3.23it/s]
 92%|█████████▏| 340416/371472 [4:55:08<2:36:19,  3.31it/s]
 92%|█████████▏| 340417/371472 [4:55:08<2:29:36,  3.46it/s]
 92%|█████████▏| 340418/371472 [4:55:09<2:28:58,  3.47it/s]
 92%|█████████▏| 340419/371472 [4:55:09<2:33:21,  3.37it/s]
 92%|█████████▏| 340420/371472 [4:55:09<2:26:36,  3.53it/s]
                                                           
{'loss': 2.6107, 'learning_rate': 1.7527311512853114e-07, 'epoch': 14.66}

 92%|█████████▏| 340420/371472 [4:55:09<2:26:36,  3.53it/s]
 92%|█████████▏| 340421/371472 [4:55:09<2:29:37,  3.46it/s]
 92%|█████████▏| 340422/371472 [4:55:10<2:33:44,  3.37it/s]
 92%|█████████▏| 340423/371472 [4:55:10<2:36:11,  3.31it/s]
 92%|█████████▏| 340424/371472 [4:55:10<2:34:26,  3.35it/s]
 92%|█████████▏| 340425/371472 [4:55:11<2:28:05,  3.49it/s]
 92%|█████████▏| 340426/371472 [4:55:11<2:29:33,  3.46it/s]
 92%|█████████▏| 340427/371472 [4:55:11<2:23:43,  3.60it/s]
 92%|█████████▏| 340428/371472 [4:55:11<2:26:51,  3.52it/s]
 92%|█████████▏| 340429/371472 [4:55:12<2:21:31,  3.66it/s]
 92%|█████████▏| 340430/371472 [4:55:12<2:27:32,  3.51it/s]
 92%|█████████▏| 340431/371472 [4:55:12<2:33:28,  3.37it/s]
 92%|█████████▏| 340432/371472 [4:55:13<2:33:21,  3.37it/s]
 92%|█████████▏| 340433/371472 [4:55:13<2:29:38,  3.46it/s]
 92%|█████████▏| 340434/371472 [4:55:13<2:30:59,  3.43it/s]
 92%|█████████▏| 340435/371472 [4:55:14<2:27:29,  3.51it/s]
 92%|█████████▏| 340436/371472 [4:55:14<2:34:07,  3.36it/s]
 92%|█████████▏| 340437/371472 [4:55:14<2:42:37,  3.18it/s]
 92%|█████████▏| 340438/371472 [4:55:14<2:34:41,  3.34it/s]
 92%|█████████▏| 340439/371472 [4:55:15<2:37:06,  3.29it/s]
 92%|█████████▏| 340440/371472 [4:55:15<2:40:35,  3.22it/s]
                                                           
{'loss': 2.5456, 'learning_rate': 1.7522463315305218e-07, 'epoch': 14.66}

 92%|█████████▏| 340440/371472 [4:55:15<2:40:35,  3.22it/s]
 92%|█████████▏| 340441/371472 [4:55:15<2:32:19,  3.40it/s]
 92%|█████████▏| 340442/371472 [4:55:16<2:23:59,  3.59it/s]
 92%|█████████▏| 340443/371472 [4:55:16<2:24:36,  3.58it/s]
 92%|█████████▏| 340444/371472 [4:55:16<2:22:58,  3.62it/s]
 92%|█████████▏| 340445/371472 [4:55:16<2:17:31,  3.76it/s]
 92%|█████████▏| 340446/371472 [4:55:17<2:21:36,  3.65it/s]
 92%|█████████▏| 340447/371472 [4:55:17<2:25:27,  3.55it/s]
 92%|█████████▏| 340448/371472 [4:55:17<2:22:27,  3.63it/s]
 92%|█████████▏| 340449/371472 [4:55:18<2:20:29,  3.68it/s]
 92%|█████████▏| 340450/371472 [4:55:18<2:15:26,  3.82it/s]
 92%|█████████▏| 340451/371472 [4:55:18<2:15:02,  3.83it/s]
 92%|█████████▏| 340452/371472 [4:55:18<2:15:17,  3.82it/s]
 92%|█████████▏| 340453/371472 [4:55:19<2:14:45,  3.84it/s]
 92%|█████████▏| 340454/371472 [4:55:19<2:25:59,  3.54it/s]
 92%|█████████▏| 340455/371472 [4:55:19<2:21:10,  3.66it/s]
 92%|█████████▏| 340456/371472 [4:55:19<2:25:34,  3.55it/s]
 92%|█████████▏| 340457/371472 [4:55:20<2:22:58,  3.62it/s]
 92%|█████████▏| 340458/371472 [4:55:20<2:33:13,  3.37it/s]
 92%|█████████▏| 340459/371472 [4:55:20<2:30:49,  3.43it/s]
 92%|█████████▏| 340460/371472 [4:55:21<2:27:56,  3.49it/s]
                                                           
{'loss': 2.6728, 'learning_rate': 1.7517615117757334e-07, 'epoch': 14.66}

 92%|█████████▏| 340460/371472 [4:55:21<2:27:56,  3.49it/s]
 92%|█████████▏| 340461/371472 [4:55:21<2:27:28,  3.50it/s]
 92%|█████████▏| 340462/371472 [4:55:21<2:22:00,  3.64it/s]
 92%|█████████▏| 340463/371472 [4:55:21<2:18:27,  3.73it/s]
 92%|█████████▏| 340464/371472 [4:55:22<2:23:33,  3.60it/s]
 92%|█████████▏| 340465/371472 [4:55:22<2:21:34,  3.65it/s]
 92%|█████████▏| 340466/371472 [4:55:22<2:20:30,  3.68it/s]
 92%|█████████▏| 340467/371472 [4:55:22<2:21:26,  3.65it/s]
 92%|█████████▏| 340468/371472 [4:55:23<2:27:21,  3.51it/s]
 92%|█████████▏| 340469/371472 [4:55:23<2:35:07,  3.33it/s]
 92%|█████████▏| 340470/371472 [4:55:23<2:32:34,  3.39it/s]
 92%|█████████▏| 340471/371472 [4:55:24<2:28:27,  3.48it/s]
 92%|█████████▏| 340472/371472 [4:55:24<2:24:14,  3.58it/s]
 92%|█████████▏| 340473/371472 [4:55:24<2:23:08,  3.61it/s]
 92%|█████████▏| 340474/371472 [4:55:25<2:28:33,  3.48it/s]
 92%|█████████▏| 340475/371472 [4:55:25<2:35:20,  3.33it/s]
 92%|█████████▏| 340476/371472 [4:55:25<2:32:58,  3.38it/s]
 92%|█████████▏| 340477/371472 [4:55:26<2:56:34,  2.93it/s]
 92%|█████████▏| 340478/371472 [4:55:26<2:52:46,  2.99it/s]
 92%|█████████▏| 340479/371472 [4:55:26<2:47:13,  3.09it/s]
 92%|█████████▏| 340480/371472 [4:55:27<2:45:49,  3.11it/s]
                                                           
{'loss': 2.5568, 'learning_rate': 1.751276692020944e-07, 'epoch': 14.67}

 92%|█████████▏| 340480/371472 [4:55:27<2:45:49,  3.11it/s]
 92%|█████████▏| 340481/371472 [4:55:27<2:43:23,  3.16it/s]
 92%|█████████▏| 340482/371472 [4:55:27<2:42:49,  3.17it/s]
 92%|█████████▏| 340483/371472 [4:55:27<2:36:51,  3.29it/s]
 92%|█████████▏| 340484/371472 [4:55:28<2:33:49,  3.36it/s]
 92%|█████████▏| 340485/371472 [4:55:28<2:27:13,  3.51it/s]
 92%|█████████▏| 340486/371472 [4:55:28<2:25:03,  3.56it/s]
 92%|█████████▏| 340487/371472 [4:55:28<2:21:53,  3.64it/s]
 92%|█████████▏| 340488/371472 [4:55:29<2:33:08,  3.37it/s]
 92%|█████████▏| 340489/371472 [4:55:29<2:29:38,  3.45it/s]
 92%|█████████▏| 340490/371472 [4:55:29<2:25:01,  3.56it/s]
 92%|█████████▏| 340491/371472 [4:55:30<2:30:30,  3.43it/s]
 92%|█████████▏| 340492/371472 [4:55:30<2:28:22,  3.48it/s]
 92%|█████████▏| 340493/371472 [4:55:30<2:29:14,  3.46it/s]
 92%|█████████▏| 340494/371472 [4:55:31<2:29:43,  3.45it/s]
 92%|█████████▏| 340495/371472 [4:55:31<2:24:56,  3.56it/s]
 92%|█████████▏| 340496/371472 [4:55:31<2:33:08,  3.37it/s]
 92%|█████████▏| 340497/371472 [4:55:31<2:26:30,  3.52it/s]
 92%|█████████▏| 340498/371472 [4:55:32<2:21:34,  3.65it/s]
 92%|█████████▏| 340499/371472 [4:55:32<2:19:57,  3.69it/s]
 92%|█████████▏| 340500/371472 [4:55:32<2:18:29,  3.73it/s]
                                                           
{'loss': 2.6637, 'learning_rate': 1.7507918722661556e-07, 'epoch': 14.67}

 92%|█████████▏| 340500/371472 [4:55:32<2:18:29,  3.73it/s]
 92%|█████████▏| 340501/371472 [4:55:32<2:21:11,  3.66it/s]
 92%|█████████▏| 340502/371472 [4:55:33<2:24:54,  3.56it/s]
 92%|█████████▏| 340503/371472 [4:55:33<2:25:34,  3.55it/s]
 92%|█████████▏| 340504/371472 [4:55:33<2:29:52,  3.44it/s]
 92%|█████████▏| 340505/371472 [4:55:34<2:29:10,  3.46it/s]
 92%|█████████▏| 340506/371472 [4:55:34<2:40:18,  3.22it/s]
 92%|█████████▏| 340507/371472 [4:55:34<2:37:50,  3.27it/s]
 92%|█████████▏| 340508/371472 [4:55:35<2:35:45,  3.31it/s]
 92%|█████████▏| 340509/371472 [4:55:35<2:32:46,  3.38it/s]
 92%|█████████▏| 340510/371472 [4:55:35<2:25:43,  3.54it/s]
 92%|█████████▏| 340511/371472 [4:55:35<2:28:49,  3.47it/s]
 92%|█████████▏| 340512/371472 [4:55:36<2:26:10,  3.53it/s]
 92%|█████████▏| 340513/371472 [4:55:36<2:24:05,  3.58it/s]
 92%|█████████▏| 340514/371472 [4:55:36<2:36:53,  3.29it/s]
 92%|█████████▏| 340515/371472 [4:55:37<2:35:52,  3.31it/s]
 92%|█████████▏| 340516/371472 [4:55:37<2:27:00,  3.51it/s]
 92%|█████████▏| 340517/371472 [4:55:37<2:25:19,  3.55it/s]
 92%|█████████▏| 340518/371472 [4:55:37<2:20:37,  3.67it/s]
 92%|█████████▏| 340519/371472 [4:55:38<2:15:55,  3.80it/s]
 92%|█████████▏| 340520/371472 [4:55:38<2:23:16,  3.60it/s]
                                                           
{'loss': 2.4692, 'learning_rate': 1.750307052511366e-07, 'epoch': 14.67}

 92%|█████████▏| 340520/371472 [4:55:38<2:23:16,  3.60it/s]
 92%|█████████▏| 340521/371472 [4:55:38<2:21:26,  3.65it/s]
 92%|█████████▏| 340522/371472 [4:55:38<2:25:28,  3.55it/s]
 92%|█████████▏| 340523/371472 [4:55:39<2:20:39,  3.67it/s]
 92%|█████████▏| 340524/371472 [4:55:39<2:23:35,  3.59it/s]
 92%|█████████▏| 340525/371472 [4:55:39<2:25:44,  3.54it/s]
 92%|█████████▏| 340526/371472 [4:55:40<2:20:55,  3.66it/s]
 92%|█████████▏| 340527/371472 [4:55:40<2:26:08,  3.53it/s]
 92%|█████████▏| 340528/371472 [4:55:40<2:32:19,  3.39it/s]
 92%|█████████▏| 340529/371472 [4:55:41<2:32:45,  3.38it/s]
 92%|█████████▏| 340530/371472 [4:55:41<2:31:00,  3.42it/s]
 92%|█████████▏| 340531/371472 [4:55:41<2:28:16,  3.48it/s]
 92%|█████████▏| 340532/371472 [4:55:41<2:27:16,  3.50it/s]
 92%|█████████▏| 340533/371472 [4:55:42<2:28:31,  3.47it/s]
 92%|█████████▏| 340534/371472 [4:55:42<2:38:33,  3.25it/s]
 92%|█████████▏| 340535/371472 [4:55:42<2:33:39,  3.36it/s]
 92%|█████████▏| 340536/371472 [4:55:43<2:30:48,  3.42it/s]
 92%|█████████▏| 340537/371472 [4:55:43<2:42:21,  3.18it/s]
 92%|█████████▏| 340538/371472 [4:55:43<2:48:01,  3.07it/s]
 92%|█████████▏| 340539/371472 [4:55:44<2:38:10,  3.26it/s]
 92%|█████████▏| 340540/371472 [4:55:44<2:32:27,  3.38it/s]
                                                           
{'loss': 2.6168, 'learning_rate': 1.7498222327565778e-07, 'epoch': 14.67}

 92%|█████████▏| 340540/371472 [4:55:44<2:32:27,  3.38it/s]
 92%|█████████▏| 340541/371472 [4:55:44<2:29:30,  3.45it/s]
 92%|█████████▏| 340542/371472 [4:55:44<2:29:50,  3.44it/s]
 92%|█████████▏| 340543/371472 [4:55:45<2:33:09,  3.37it/s]
 92%|█████████▏| 340544/371472 [4:55:45<2:40:53,  3.20it/s]
 92%|█████████▏| 340545/371472 [4:55:45<2:38:22,  3.25it/s]
 92%|█████████▏| 340546/371472 [4:55:46<2:39:13,  3.24it/s]
 92%|█████████▏| 340547/371472 [4:55:46<2:33:03,  3.37it/s]
 92%|█████████▏| 340548/371472 [4:55:46<2:32:31,  3.38it/s]
 92%|█████████▏| 340549/371472 [4:55:47<2:43:33,  3.15it/s]
 92%|█████████▏| 340550/371472 [4:55:47<2:34:51,  3.33it/s]
 92%|█████████▏| 340551/371472 [4:55:47<2:28:23,  3.47it/s]
 92%|█████████▏| 340552/371472 [4:55:47<2:30:46,  3.42it/s]
 92%|█████████▏| 340553/371472 [4:55:48<2:22:10,  3.62it/s]
 92%|█████████▏| 340554/371472 [4:55:48<2:20:38,  3.66it/s]
 92%|█████████▏| 340555/371472 [4:55:48<2:26:23,  3.52it/s]
 92%|█████████▏| 340556/371472 [4:55:48<2:26:34,  3.52it/s]
 92%|█████████▏| 340557/371472 [4:55:49<2:26:36,  3.51it/s]
 92%|█████████▏| 340558/371472 [4:55:49<2:28:46,  3.46it/s]
 92%|█████████▏| 340559/371472 [4:55:49<2:28:01,  3.48it/s]
 92%|█████████▏| 340560/371472 [4:55:50<2:24:21,  3.57it/s]
                                                           
{'loss': 2.7016, 'learning_rate': 1.7493374130017883e-07, 'epoch': 14.67}

 92%|█████████▏| 340560/371472 [4:55:50<2:24:21,  3.57it/s]
 92%|█████████▏| 340561/371472 [4:55:50<2:23:14,  3.60it/s]
 92%|█████████▏| 340562/371472 [4:55:50<2:31:49,  3.39it/s]
 92%|█████████▏| 340563/371472 [4:55:51<2:42:28,  3.17it/s]
 92%|█████████▏| 340564/371472 [4:55:51<2:39:32,  3.23it/s]
 92%|█████████▏| 340565/371472 [4:55:51<2:34:53,  3.33it/s]
 92%|█████████▏| 340566/371472 [4:55:51<2:37:17,  3.27it/s]
 92%|█████████▏| 340567/371472 [4:55:52<2:34:22,  3.34it/s]
 92%|█████████▏| 340568/371472 [4:55:52<3:06:48,  2.76it/s]
 92%|█████████▏| 340569/371472 [4:55:53<2:58:17,  2.89it/s]
 92%|█████████▏| 340570/371472 [4:55:53<2:47:06,  3.08it/s]
 92%|█████████▏| 340571/371472 [4:55:53<2:45:10,  3.12it/s]
 92%|█████████▏| 340572/371472 [4:55:53<2:35:11,  3.32it/s]
 92%|█████████▏| 340573/371472 [4:55:54<2:29:55,  3.43it/s]
 92%|█████████▏| 340574/371472 [4:55:54<2:26:49,  3.51it/s]
 92%|█████████▏| 340575/371472 [4:55:54<2:27:50,  3.48it/s]
 92%|█████████▏| 340576/371472 [4:55:55<2:22:39,  3.61it/s]
 92%|█████████▏| 340577/371472 [4:55:55<2:23:11,  3.60it/s]
 92%|█████████▏| 340578/371472 [4:55:55<2:21:44,  3.63it/s]
 92%|█████████▏| 340579/371472 [4:55:55<2:20:56,  3.65it/s]
 92%|█████████▏| 340580/371472 [4:55:56<2:23:20,  3.59it/s]
                                                           
{'loss': 2.6794, 'learning_rate': 1.7488525932469998e-07, 'epoch': 14.67}

 92%|█████████▏| 340580/371472 [4:55:56<2:23:20,  3.59it/s]
 92%|█████████▏| 340581/371472 [4:55:56<2:26:35,  3.51it/s]
 92%|█████████▏| 340582/371472 [4:55:56<2:27:34,  3.49it/s]
 92%|█████████▏| 340583/371472 [4:55:57<2:27:52,  3.48it/s]
 92%|█████████▏| 340584/371472 [4:55:57<2:24:55,  3.55it/s]
 92%|█████████▏| 340585/371472 [4:55:57<2:22:14,  3.62it/s]
 92%|█████████▏| 340586/371472 [4:55:57<2:20:17,  3.67it/s]
 92%|█████████▏| 340587/371472 [4:55:58<2:19:50,  3.68it/s]
 92%|█████████▏| 340588/371472 [4:55:58<2:17:46,  3.74it/s]
 92%|█████████▏| 340589/371472 [4:55:58<2:16:07,  3.78it/s]
 92%|█████████▏| 340590/371472 [4:55:58<2:14:36,  3.82it/s]
 92%|█████████▏| 340591/371472 [4:55:59<2:15:29,  3.80it/s]
 92%|█████████▏| 340592/371472 [4:55:59<2:14:03,  3.84it/s]
 92%|█████████▏| 340593/371472 [4:55:59<2:14:50,  3.82it/s]
 92%|█████████▏| 340594/371472 [4:55:59<2:12:52,  3.87it/s]
 92%|█████████▏| 340595/371472 [4:56:00<2:16:37,  3.77it/s]
 92%|█████████▏| 340596/371472 [4:56:00<2:14:12,  3.83it/s]
 92%|█████████▏| 340597/371472 [4:56:00<2:19:18,  3.69it/s]
 92%|█████████▏| 340598/371472 [4:56:00<2:16:42,  3.76it/s]
 92%|█████████▏| 340599/371472 [4:56:01<2:22:22,  3.61it/s]
 92%|█████████▏| 340600/371472 [4:56:01<2:22:00,  3.62it/s]
                                                           
{'loss': 2.698, 'learning_rate': 1.7483677734922105e-07, 'epoch': 14.67}

 92%|█████████▏| 340600/371472 [4:56:01<2:22:00,  3.62it/s]
 92%|█████████▏| 340601/371472 [4:56:01<2:18:54,  3.70it/s]
 92%|█████████▏| 340602/371472 [4:56:02<2:20:50,  3.65it/s]
 92%|█████████▏| 340603/371472 [4:56:02<2:25:18,  3.54it/s]
 92%|█████████▏| 340604/371472 [4:56:02<2:23:23,  3.59it/s]
 92%|█████████▏| 340605/371472 [4:56:03<2:35:01,  3.32it/s]
 92%|█████████▏| 340606/371472 [4:56:03<2:27:49,  3.48it/s]
 92%|█████████▏| 340607/371472 [4:56:03<2:25:45,  3.53it/s]
 92%|█████████▏| 340608/371472 [4:56:03<2:48:38,  3.05it/s]
 92%|█████████▏| 340609/371472 [4:56:04<2:37:21,  3.27it/s]
 92%|█████████▏| 340610/371472 [4:56:04<2:34:48,  3.32it/s]
 92%|█████████▏| 340611/371472 [4:56:04<2:43:56,  3.14it/s]
 92%|█████████▏| 340612/371472 [4:56:05<2:40:21,  3.21it/s]
 92%|█████████▏| 340613/371472 [4:56:05<2:34:55,  3.32it/s]
 92%|█████████▏| 340614/371472 [4:56:05<2:26:32,  3.51it/s]
 92%|█████████▏| 340615/371472 [4:56:05<2:27:53,  3.48it/s]
 92%|█████████▏| 340616/371472 [4:56:06<2:19:38,  3.68it/s]
 92%|█████████▏| 340617/371472 [4:56:06<2:23:31,  3.58it/s]
 92%|█████████▏| 340618/371472 [4:56:06<2:28:21,  3.47it/s]
 92%|█████████▏| 340619/371472 [4:56:07<2:28:16,  3.47it/s]
 92%|█████████▏| 340620/371472 [4:56:07<2:22:58,  3.60it/s]
                                                           
{'loss': 2.4233, 'learning_rate': 1.747882953737422e-07, 'epoch': 14.67}

 92%|█████████▏| 340620/371472 [4:56:07<2:22:58,  3.60it/s]
 92%|█████████▏| 340621/371472 [4:56:07<2:24:11,  3.57it/s]
 92%|█████████▏| 340622/371472 [4:56:07<2:30:51,  3.41it/s]
 92%|█████████▏| 340623/371472 [4:56:08<2:31:19,  3.40it/s]
 92%|█████████▏| 340624/371472 [4:56:08<2:30:40,  3.41it/s]
 92%|█████████▏| 340625/371472 [4:56:08<2:22:53,  3.60it/s]
 92%|█████████▏| 340626/371472 [4:56:09<2:40:18,  3.21it/s]
 92%|█████████▏| 340627/371472 [4:56:09<2:37:38,  3.26it/s]
 92%|█████████▏| 340628/371472 [4:56:09<2:35:20,  3.31it/s]
 92%|█████████▏| 340629/371472 [4:56:10<2:32:39,  3.37it/s]
 92%|█████████▏| 340630/371472 [4:56:10<2:34:45,  3.32it/s]
 92%|█████████▏| 340631/371472 [4:56:10<2:42:22,  3.17it/s]
 92%|█████████▏| 340632/371472 [4:56:10<2:33:05,  3.36it/s]
 92%|█████████▏| 340633/371472 [4:56:11<2:28:53,  3.45it/s]
 92%|█████████▏| 340634/371472 [4:56:11<2:30:01,  3.43it/s]
 92%|█████████▏| 340635/371472 [4:56:11<2:46:24,  3.09it/s]
 92%|█████████▏| 340636/371472 [4:56:12<2:38:40,  3.24it/s]
 92%|█████████▏| 340637/371472 [4:56:12<2:35:32,  3.30it/s]
 92%|█████████▏| 340638/371472 [4:56:12<2:29:37,  3.43it/s]
 92%|█████████▏| 340639/371472 [4:56:13<2:47:22,  3.07it/s]
 92%|█████████▏| 340640/371472 [4:56:13<2:36:11,  3.29it/s]
                                                           
{'loss': 2.6859, 'learning_rate': 1.7473981339826324e-07, 'epoch': 14.67}

 92%|█████████▏| 340640/371472 [4:56:13<2:36:11,  3.29it/s]
 92%|█████████▏| 340641/371472 [4:56:13<2:36:55,  3.27it/s]
 92%|█████████▏| 340642/371472 [4:56:14<2:30:44,  3.41it/s]
 92%|█████████▏| 340643/371472 [4:56:14<2:25:01,  3.54it/s]
 92%|█████████▏| 340644/371472 [4:56:14<2:22:34,  3.60it/s]
 92%|█████████▏| 340645/371472 [4:56:14<2:36:58,  3.27it/s]
 92%|█████████▏| 340646/371472 [4:56:15<2:37:55,  3.25it/s]
 92%|█████████▏| 340647/371472 [4:56:15<2:31:37,  3.39it/s]
 92%|█████████▏| 340648/371472 [4:56:15<2:29:40,  3.43it/s]
 92%|█████████▏| 340649/371472 [4:56:16<2:27:32,  3.48it/s]
 92%|█████████▏| 340650/371472 [4:56:16<2:27:47,  3.48it/s]
 92%|█████████▏| 340651/371472 [4:56:16<2:21:03,  3.64it/s]
 92%|█████████▏| 340652/371472 [4:56:16<2:19:56,  3.67it/s]
 92%|█████████▏| 340653/371472 [4:56:17<2:19:14,  3.69it/s]
 92%|█████████▏| 340654/371472 [4:56:17<2:22:12,  3.61it/s]
 92%|█████████▏| 340655/371472 [4:56:17<2:20:17,  3.66it/s]
 92%|█████████▏| 340656/371472 [4:56:17<2:17:50,  3.73it/s]
 92%|█████████▏| 340657/371472 [4:56:18<2:23:01,  3.59it/s]
 92%|█████████▏| 340658/371472 [4:56:18<2:21:17,  3.63it/s]
 92%|█████████▏| 340659/371472 [4:56:18<2:21:44,  3.62it/s]
 92%|█████████▏| 340660/371472 [4:56:19<2:21:45,  3.62it/s]
                                                           
{'loss': 2.8167, 'learning_rate': 1.7469133142278431e-07, 'epoch': 14.67}

 92%|█████████▏| 340660/371472 [4:56:19<2:21:45,  3.62it/s]
 92%|█████████▏| 340661/371472 [4:56:19<2:17:52,  3.72it/s]
 92%|█████████▏| 340662/371472 [4:56:19<2:17:19,  3.74it/s]
 92%|█████████▏| 340663/371472 [4:56:19<2:18:50,  3.70it/s]
 92%|█████████▏| 340664/371472 [4:56:20<2:15:36,  3.79it/s]
 92%|█████████▏| 340665/371472 [4:56:20<2:28:25,  3.46it/s]
 92%|█████████▏| 340666/371472 [4:56:20<2:20:48,  3.65it/s]
 92%|█████████▏| 340667/371472 [4:56:20<2:19:48,  3.67it/s]
 92%|█████████▏| 340668/371472 [4:56:21<2:34:07,  3.33it/s]
 92%|█████████▏| 340669/371472 [4:56:21<2:30:44,  3.41it/s]
 92%|█████████▏| 340670/371472 [4:56:21<2:26:48,  3.50it/s]
 92%|█████████▏| 340671/371472 [4:56:22<2:31:55,  3.38it/s]
 92%|█████████▏| 340672/371472 [4:56:22<2:31:01,  3.40it/s]
 92%|█████████▏| 340673/371472 [4:56:22<2:30:02,  3.42it/s]
 92%|█████████▏| 340674/371472 [4:56:23<2:27:33,  3.48it/s]
 92%|█████████▏| 340675/371472 [4:56:23<2:22:56,  3.59it/s]
 92%|█████████▏| 340676/371472 [4:56:23<2:20:10,  3.66it/s]
 92%|█████████▏| 340677/371472 [4:56:23<2:31:19,  3.39it/s]
 92%|█████████▏| 340678/371472 [4:56:24<2:30:26,  3.41it/s]
 92%|█████████▏| 340679/371472 [4:56:24<2:33:22,  3.35it/s]
 92%|█████████▏| 340680/371472 [4:56:24<2:40:03,  3.21it/s]
                                                           
{'loss': 2.643, 'learning_rate': 1.746428494473055e-07, 'epoch': 14.67}

 92%|█████████▏| 340680/371472 [4:56:24<2:40:03,  3.21it/s]
 92%|█████████▏| 340681/371472 [4:56:25<2:31:23,  3.39it/s]
 92%|█████████▏| 340682/371472 [4:56:25<2:25:56,  3.52it/s]
 92%|█████████▏| 340683/371472 [4:56:25<2:18:49,  3.70it/s]
 92%|█████████▏| 340684/371472 [4:56:25<2:23:08,  3.58it/s]
 92%|█████████▏| 340685/371472 [4:56:26<2:32:10,  3.37it/s]
 92%|█████████▏| 340686/371472 [4:56:26<2:39:27,  3.22it/s]
 92%|█████████▏| 340687/371472 [4:56:26<2:31:04,  3.40it/s]
 92%|█████████▏| 340688/371472 [4:56:27<2:29:09,  3.44it/s]
 92%|█████████▏| 340689/371472 [4:56:27<2:25:53,  3.52it/s]
 92%|█████████▏| 340690/371472 [4:56:27<2:25:17,  3.53it/s]
 92%|█████████▏| 340691/371472 [4:56:27<2:24:49,  3.54it/s]
 92%|█████████▏| 340692/371472 [4:56:28<2:25:59,  3.51it/s]
 92%|█████████▏| 340693/371472 [4:56:28<2:28:31,  3.45it/s]
 92%|█████████▏| 340694/371472 [4:56:28<2:31:12,  3.39it/s]
 92%|█████████▏| 340695/371472 [4:56:29<2:24:06,  3.56it/s]
 92%|█████████▏| 340696/371472 [4:56:29<2:22:36,  3.60it/s]
 92%|█████████▏| 340697/371472 [4:56:29<2:21:12,  3.63it/s]
 92%|█████████▏| 340698/371472 [4:56:29<2:25:54,  3.52it/s]
 92%|█████████▏| 340699/371472 [4:56:30<2:18:42,  3.70it/s]
 92%|█████████▏| 340700/371472 [4:56:30<2:21:05,  3.64it/s]
                                                           
{'loss': 2.5921, 'learning_rate': 1.7459436747182654e-07, 'epoch': 14.67}

 92%|█████████▏| 340700/371472 [4:56:30<2:21:05,  3.64it/s]
 92%|█████████▏| 340701/371472 [4:56:30<2:40:01,  3.20it/s]
 92%|█████████▏| 340702/371472 [4:56:31<2:36:02,  3.29it/s]
 92%|█████████▏| 340703/371472 [4:56:31<2:31:29,  3.39it/s]
 92%|█████████▏| 340704/371472 [4:56:31<2:28:20,  3.46it/s]
 92%|█████████▏| 340705/371472 [4:56:31<2:26:10,  3.51it/s]
 92%|█████████▏| 340706/371472 [4:56:32<2:23:34,  3.57it/s]
 92%|█████████▏| 340707/371472 [4:56:32<2:34:11,  3.33it/s]
 92%|█████████▏| 340708/371472 [4:56:32<2:28:05,  3.46it/s]
 92%|█████████▏| 340709/371472 [4:56:33<2:29:26,  3.43it/s]
 92%|█████████▏| 340710/371472 [4:56:33<2:26:46,  3.49it/s]
 92%|█████████▏| 340711/371472 [4:56:33<2:31:33,  3.38it/s]
 92%|█████████▏| 340712/371472 [4:56:33<2:25:20,  3.53it/s]
 92%|█████████▏| 340713/371472 [4:56:34<2:21:39,  3.62it/s]
 92%|█████████▏| 340714/371472 [4:56:34<2:21:27,  3.62it/s]
 92%|█████████▏| 340715/371472 [4:56:34<2:17:13,  3.74it/s]
 92%|█████████▏| 340716/371472 [4:56:35<2:17:53,  3.72it/s]
 92%|█████████▏| 340717/371472 [4:56:35<2:20:54,  3.64it/s]
 92%|█████████▏| 340718/371472 [4:56:35<2:25:09,  3.53it/s]
 92%|█████████▏| 340719/371472 [4:56:35<2:31:08,  3.39it/s]
 92%|█████████▏| 340720/371472 [4:56:36<2:25:41,  3.52it/s]
                                                           
{'loss': 2.5132, 'learning_rate': 1.745458854963477e-07, 'epoch': 14.68}

 92%|█████████▏| 340720/371472 [4:56:36<2:25:41,  3.52it/s]
 92%|█████████▏| 340721/371472 [4:56:36<2:42:44,  3.15it/s]
 92%|█████████▏| 340722/371472 [4:56:36<2:33:29,  3.34it/s]
 92%|█████████▏| 340723/371472 [4:56:37<2:31:32,  3.38it/s]
 92%|█████████▏| 340724/371472 [4:56:37<2:38:48,  3.23it/s]
 92%|█████████▏| 340725/371472 [4:56:37<2:36:51,  3.27it/s]
 92%|█████████▏| 340726/371472 [4:56:38<2:33:07,  3.35it/s]
 92%|█████████▏| 340727/371472 [4:56:38<2:29:51,  3.42it/s]
 92%|█████████▏| 340728/371472 [4:56:38<2:25:13,  3.53it/s]
 92%|█████████▏| 340729/371472 [4:56:38<2:22:39,  3.59it/s]
 92%|█████████▏| 340730/371472 [4:56:39<2:20:02,  3.66it/s]
 92%|█████████▏| 340731/371472 [4:56:39<2:21:04,  3.63it/s]
 92%|█████████▏| 340732/371472 [4:56:39<2:29:33,  3.43it/s]
 92%|█████████▏| 340733/371472 [4:56:40<2:36:24,  3.28it/s]
 92%|█████████▏| 340734/371472 [4:56:40<2:33:39,  3.33it/s]
 92%|█████████▏| 340735/371472 [4:56:40<2:30:01,  3.41it/s]
 92%|█████████▏| 340736/371472 [4:56:40<2:27:42,  3.47it/s]
 92%|█████████▏| 340737/371472 [4:56:41<2:21:48,  3.61it/s]
 92%|█████████▏| 340738/371472 [4:56:41<2:18:40,  3.69it/s]
 92%|█████████▏| 340739/371472 [4:56:41<2:13:47,  3.83it/s]
 92%|█████████▏| 340740/371472 [4:56:41<2:13:33,  3.83it/s]
                                                           
{'loss': 2.6309, 'learning_rate': 1.7449740352086876e-07, 'epoch': 14.68}

 92%|█████████▏| 340740/371472 [4:56:41<2:13:33,  3.83it/s]
 92%|█████████▏| 340741/371472 [4:56:42<2:14:44,  3.80it/s]
 92%|█████████▏| 340742/371472 [4:56:42<2:16:33,  3.75it/s]
 92%|█████████▏| 340743/371472 [4:56:42<2:13:32,  3.84it/s]
 92%|█████████▏| 340744/371472 [4:56:43<2:21:26,  3.62it/s]
 92%|█████████▏| 340745/371472 [4:56:43<2:24:33,  3.54it/s]
 92%|█████████▏| 340746/371472 [4:56:43<2:19:38,  3.67it/s]
 92%|█████████▏| 340747/371472 [4:56:43<2:17:41,  3.72it/s]
 92%|█████████▏| 340748/371472 [4:56:44<2:15:23,  3.78it/s]
 92%|█████████▏| 340749/371472 [4:56:44<2:19:48,  3.66it/s]
 92%|█████████▏| 340750/371472 [4:56:44<2:19:38,  3.67it/s]
 92%|█████████▏| 340751/371472 [4:56:44<2:26:20,  3.50it/s]
 92%|█████████▏| 340752/371472 [4:56:45<2:18:59,  3.68it/s]
 92%|█████████▏| 340753/371472 [4:56:45<2:18:15,  3.70it/s]
 92%|█████████▏| 340754/371472 [4:56:45<2:18:15,  3.70it/s]
 92%|█████████▏| 340755/371472 [4:56:46<2:17:58,  3.71it/s]
 92%|█████████▏| 340756/371472 [4:56:46<2:23:59,  3.56it/s]
 92%|█████████▏| 340757/371472 [4:56:46<2:31:43,  3.37it/s]
 92%|█████████▏| 340758/371472 [4:56:47<2:39:45,  3.20it/s]
 92%|█████████▏| 340759/371472 [4:56:47<2:35:25,  3.29it/s]
 92%|█████████▏| 340760/371472 [4:56:47<2:26:43,  3.49it/s]
                                                           
{'loss': 2.6264, 'learning_rate': 1.744489215453899e-07, 'epoch': 14.68}

 92%|█████████▏| 340760/371472 [4:56:47<2:26:43,  3.49it/s]
 92%|█████████▏| 340761/371472 [4:56:47<2:30:49,  3.39it/s]
 92%|█████████▏| 340762/371472 [4:56:48<2:26:19,  3.50it/s]
 92%|█████████▏| 340763/371472 [4:56:48<2:42:34,  3.15it/s]
 92%|█████████▏| 340764/371472 [4:56:48<2:36:31,  3.27it/s]
 92%|█████████▏| 340765/371472 [4:56:49<2:30:37,  3.40it/s]
 92%|█████████▏| 340766/371472 [4:56:49<2:24:43,  3.54it/s]
 92%|█████████▏| 340767/371472 [4:56:49<2:30:14,  3.41it/s]
 92%|█████████▏| 340768/371472 [4:56:49<2:30:10,  3.41it/s]
 92%|█████████▏| 340769/371472 [4:56:50<2:27:52,  3.46it/s]
 92%|█████████▏| 340770/371472 [4:56:50<2:25:51,  3.51it/s]
 92%|█████████▏| 340771/371472 [4:56:50<2:23:01,  3.58it/s]
 92%|█████████▏| 340772/371472 [4:56:51<2:23:47,  3.56it/s]
 92%|█████████▏| 340773/371472 [4:56:51<2:25:55,  3.51it/s]
 92%|█████████▏| 340774/371472 [4:56:51<2:25:25,  3.52it/s]
 92%|█████████▏| 340775/371472 [4:56:51<2:25:36,  3.51it/s]
 92%|█████████▏| 340776/371472 [4:56:52<2:23:51,  3.56it/s]
 92%|█████████▏| 340777/371472 [4:56:52<2:20:42,  3.64it/s]
 92%|█████████▏| 340778/371472 [4:56:52<2:22:18,  3.59it/s]
 92%|█████████▏| 340779/371472 [4:56:52<2:20:42,  3.64it/s]
 92%|█████████▏| 340780/371472 [4:56:53<2:20:53,  3.63it/s]
                                                           
{'loss': 2.4774, 'learning_rate': 1.7440043956991096e-07, 'epoch': 14.68}

 92%|█████████▏| 340780/371472 [4:56:53<2:20:53,  3.63it/s]
 92%|█████████▏| 340781/371472 [4:56:53<2:23:36,  3.56it/s]
 92%|█████████▏| 340782/371472 [4:56:53<2:21:27,  3.62it/s]
 92%|█████████▏| 340783/371472 [4:56:54<2:18:37,  3.69it/s]
 92%|█████████▏| 340784/371472 [4:56:54<2:17:00,  3.73it/s]
 92%|█████████▏| 340785/371472 [4:56:54<2:18:39,  3.69it/s]
 92%|█████████▏| 340786/371472 [4:56:54<2:24:33,  3.54it/s]
 92%|█████████▏| 340787/371472 [4:56:55<2:19:33,  3.66it/s]
 92%|█████████▏| 340788/371472 [4:56:55<2:18:46,  3.69it/s]
 92%|█████████▏| 340789/371472 [4:56:55<2:37:19,  3.25it/s]
 92%|█████████▏| 340790/371472 [4:56:56<2:28:40,  3.44it/s]
 92%|█████████▏| 340791/371472 [4:56:56<2:34:15,  3.31it/s]
 92%|█████████▏| 340792/371472 [4:56:56<2:32:33,  3.35it/s]
 92%|█████████▏| 340793/371472 [4:56:57<2:38:44,  3.22it/s]
 92%|█████████▏| 340794/371472 [4:56:57<2:38:29,  3.23it/s]
 92%|█████████▏| 340795/371472 [4:56:57<2:35:20,  3.29it/s]
 92%|█████████▏| 340796/371472 [4:56:57<2:37:53,  3.24it/s]
 92%|█████████▏| 340797/371472 [4:56:58<2:32:03,  3.36it/s]
 92%|█████████▏| 340798/371472 [4:56:58<2:31:50,  3.37it/s]
 92%|█████████▏| 340799/371472 [4:56:58<2:24:31,  3.54it/s]
 92%|█████████▏| 340800/371472 [4:56:59<2:28:50,  3.43it/s]
                                                           
{'loss': 2.5527, 'learning_rate': 1.7435195759443213e-07, 'epoch': 14.68}

 92%|█████████▏| 340800/371472 [4:56:59<2:28:50,  3.43it/s]
 92%|█████████▏| 340801/371472 [4:56:59<2:32:34,  3.35it/s]
 92%|█████████▏| 340802/371472 [4:56:59<2:27:18,  3.47it/s]
 92%|█████████▏| 340803/371472 [4:56:59<2:26:25,  3.49it/s]
 92%|█████████▏| 340804/371472 [4:57:00<2:23:15,  3.57it/s]
 92%|█████████▏| 340805/371472 [4:57:00<2:18:17,  3.70it/s]
 92%|█████████▏| 340806/371472 [4:57:00<2:23:23,  3.56it/s]
 92%|█████████▏| 340807/371472 [4:57:01<2:20:48,  3.63it/s]
 92%|█████████▏| 340808/371472 [4:57:01<2:24:33,  3.54it/s]
 92%|█████████▏| 340809/371472 [4:57:01<2:20:10,  3.65it/s]
 92%|█████████▏| 340810/371472 [4:57:01<2:22:12,  3.59it/s]
 92%|█████████▏| 340811/371472 [4:57:02<2:23:25,  3.56it/s]
 92%|█████████▏| 340812/371472 [4:57:02<2:19:45,  3.66it/s]
 92%|█████████▏| 340813/371472 [4:57:02<2:19:10,  3.67it/s]
 92%|█████████▏| 340814/371472 [4:57:02<2:23:37,  3.56it/s]
 92%|█████████▏| 340815/371472 [4:57:03<2:26:37,  3.48it/s]
 92%|█████████▏| 340816/371472 [4:57:03<2:34:10,  3.31it/s]
 92%|█████████▏| 340817/371472 [4:57:03<2:28:32,  3.44it/s]
 92%|█████████▏| 340818/371472 [4:57:04<2:25:59,  3.50it/s]
 92%|█████████▏| 340819/371472 [4:57:04<2:23:56,  3.55it/s]
 92%|█████████▏| 340820/371472 [4:57:04<2:19:28,  3.66it/s]
                                                           
{'loss': 2.5391, 'learning_rate': 1.7430347561895318e-07, 'epoch': 14.68}

 92%|█████████▏| 340820/371472 [4:57:04<2:19:28,  3.66it/s]
 92%|█████████▏| 340821/371472 [4:57:04<2:19:13,  3.67it/s]
 92%|█████████▏| 340822/371472 [4:57:05<2:16:03,  3.75it/s]
 92%|█████████▏| 340823/371472 [4:57:05<2:25:19,  3.52it/s]
 92%|█████████▏| 340824/371472 [4:57:05<2:27:31,  3.46it/s]
 92%|█████████▏| 340825/371472 [4:57:06<2:23:27,  3.56it/s]
 92%|█████████▏| 340826/371472 [4:57:06<2:22:07,  3.59it/s]
 92%|█████████▏| 340827/371472 [4:57:06<2:31:10,  3.38it/s]
 92%|█████████▏| 340828/371472 [4:57:06<2:29:08,  3.42it/s]
 92%|█████████▏| 340829/371472 [4:57:07<2:28:16,  3.44it/s]
 92%|█████████▏| 340830/371472 [4:57:07<2:25:42,  3.50it/s]
 92%|█████████▏| 340831/371472 [4:57:07<2:21:48,  3.60it/s]
 92%|█████████▏| 340832/371472 [4:57:08<2:26:55,  3.48it/s]
 92%|█████████▏| 340833/371472 [4:57:08<2:31:09,  3.38it/s]
 92%|█████████▏| 340834/371472 [4:57:08<2:26:13,  3.49it/s]
 92%|█████████▏| 340835/371472 [4:57:08<2:21:01,  3.62it/s]
 92%|█████████▏| 340836/371472 [4:57:09<2:27:27,  3.46it/s]
 92%|█████████▏| 340837/371472 [4:57:09<2:26:07,  3.49it/s]
 92%|█████████▏| 340838/371472 [4:57:09<2:23:00,  3.57it/s]
 92%|█████████▏| 340839/371472 [4:57:10<2:20:09,  3.64it/s]
 92%|█████████▏| 340840/371472 [4:57:10<2:22:10,  3.59it/s]
                                                           
{'loss': 2.5193, 'learning_rate': 1.7425499364347433e-07, 'epoch': 14.68}

 92%|█████████▏| 340840/371472 [4:57:10<2:22:10,  3.59it/s]
 92%|█████████▏| 340841/371472 [4:57:10<2:19:28,  3.66it/s]
 92%|█████████▏| 340842/371472 [4:57:10<2:14:55,  3.78it/s]
 92%|█████████▏| 340843/371472 [4:57:11<2:20:35,  3.63it/s]
 92%|█████████▏| 340844/371472 [4:57:11<2:18:09,  3.69it/s]
 92%|█████████▏| 340845/371472 [4:57:11<2:14:42,  3.79it/s]
 92%|█████████▏| 340846/371472 [4:57:11<2:13:59,  3.81it/s]
 92%|█████████▏| 340847/371472 [4:57:12<2:12:22,  3.86it/s]
 92%|█████████▏| 340848/371472 [4:57:12<2:24:03,  3.54it/s]
 92%|█████████▏| 340849/371472 [4:57:12<2:22:29,  3.58it/s]
 92%|█████████▏| 340850/371472 [4:57:13<2:19:36,  3.66it/s]
 92%|█████████▏| 340851/371472 [4:57:13<2:22:50,  3.57it/s]
 92%|█████████▏| 340852/371472 [4:57:13<2:17:45,  3.70it/s]
 92%|█████████▏| 340853/371472 [4:57:13<2:33:21,  3.33it/s]
 92%|█████████▏| 340854/371472 [4:57:14<2:37:43,  3.24it/s]
 92%|█████████▏| 340855/371472 [4:57:14<2:45:53,  3.08it/s]
 92%|█████████▏| 340856/371472 [4:57:14<2:45:43,  3.08it/s]
 92%|█████████▏| 340857/371472 [4:57:15<2:37:06,  3.25it/s]
 92%|█████████▏| 340858/371472 [4:57:15<2:41:43,  3.16it/s]
 92%|█████████▏| 340859/371472 [4:57:15<2:43:26,  3.12it/s]
 92%|█████████▏| 340860/371472 [4:57:16<2:37:50,  3.23it/s]
                                                           
{'loss': 2.6409, 'learning_rate': 1.742065116679954e-07, 'epoch': 14.68}

 92%|█████████▏| 340860/371472 [4:57:16<2:37:50,  3.23it/s]
 92%|█████████▏| 340861/371472 [4:57:16<2:31:20,  3.37it/s]
 92%|█████████▏| 340862/371472 [4:57:16<2:33:16,  3.33it/s]
 92%|█████████▏| 340863/371472 [4:57:17<2:25:54,  3.50it/s]
 92%|█████████▏| 340864/371472 [4:57:17<2:28:22,  3.44it/s]
 92%|█████████▏| 340865/371472 [4:57:17<2:23:28,  3.56it/s]
 92%|█████████▏| 340866/371472 [4:57:17<2:21:18,  3.61it/s]
 92%|█████████▏| 340867/371472 [4:57:18<2:25:08,  3.51it/s]
 92%|█████████▏| 340868/371472 [4:57:18<2:21:02,  3.62it/s]
 92%|█████████▏| 340869/371472 [4:57:18<2:19:47,  3.65it/s]
 92%|█████████▏| 340870/371472 [4:57:18<2:22:31,  3.58it/s]
 92%|█████████▏| 340871/371472 [4:57:19<2:20:05,  3.64it/s]
 92%|█████████▏| 340872/371472 [4:57:19<2:19:09,  3.66it/s]
 92%|█████████▏| 340873/371472 [4:57:19<2:47:02,  3.05it/s]
 92%|█████████▏| 340874/371472 [4:57:20<2:38:04,  3.23it/s]
 92%|█████████▏| 340875/371472 [4:57:20<2:29:55,  3.40it/s]
 92%|█████████▏| 340876/371472 [4:57:20<2:28:02,  3.44it/s]
 92%|█████████▏| 340877/371472 [4:57:21<2:29:16,  3.42it/s]
 92%|█████████▏| 340878/371472 [4:57:21<2:30:33,  3.39it/s]
 92%|█████████▏| 340879/371472 [4:57:21<2:38:21,  3.22it/s]
 92%|█████████▏| 340880/371472 [4:57:22<2:33:17,  3.33it/s]
                                                           
{'loss': 2.5824, 'learning_rate': 1.7415802969251655e-07, 'epoch': 14.68}

 92%|█████████▏| 340880/371472 [4:57:22<2:33:17,  3.33it/s]
 92%|█████████▏| 340881/371472 [4:57:22<2:30:11,  3.39it/s]
 92%|█████████▏| 340882/371472 [4:57:22<2:41:46,  3.15it/s]
 92%|█████████▏| 340883/371472 [4:57:22<2:38:11,  3.22it/s]
 92%|█████████▏| 340884/371472 [4:57:23<2:30:47,  3.38it/s]
 92%|█████████▏| 340885/371472 [4:57:23<2:26:43,  3.47it/s]
 92%|█████████▏| 340886/371472 [4:57:23<2:33:43,  3.32it/s]
 92%|█████████▏| 340887/371472 [4:57:24<2:27:30,  3.46it/s]
 92%|█████████▏| 340888/371472 [4:57:24<2:23:37,  3.55it/s]
 92%|█████████▏| 340889/371472 [4:57:24<2:18:11,  3.69it/s]
 92%|█████████▏| 340890/371472 [4:57:24<2:33:05,  3.33it/s]
 92%|█████████▏| 340891/371472 [4:57:25<2:28:50,  3.42it/s]
 92%|█████████▏| 340892/371472 [4:57:25<2:24:30,  3.53it/s]
 92%|█████████▏| 340893/371472 [4:57:25<2:21:46,  3.59it/s]
 92%|█████████▏| 340894/371472 [4:57:26<2:19:52,  3.64it/s]
 92%|█████████▏| 340895/371472 [4:57:26<2:21:53,  3.59it/s]
 92%|█████████▏| 340896/371472 [4:57:26<2:33:08,  3.33it/s]
 92%|█████████▏| 340897/371472 [4:57:26<2:31:47,  3.36it/s]
 92%|█████████▏| 340898/371472 [4:57:27<2:32:45,  3.34it/s]
 92%|█████████▏| 340899/371472 [4:57:27<2:28:19,  3.44it/s]
 92%|█████████▏| 340900/371472 [4:57:27<2:22:46,  3.57it/s]
                                                           
{'loss': 2.643, 'learning_rate': 1.741095477170376e-07, 'epoch': 14.68}

 92%|█████████▏| 340900/371472 [4:57:27<2:22:46,  3.57it/s]
 92%|█████████▏| 340901/371472 [4:57:28<2:18:29,  3.68it/s]
 92%|█████████▏| 340902/371472 [4:57:28<2:35:14,  3.28it/s]
 92%|█████████▏| 340903/371472 [4:57:28<2:30:43,  3.38it/s]
 92%|█████████▏| 340904/371472 [4:57:29<2:37:06,  3.24it/s]
 92%|█████████▏| 340905/371472 [4:57:29<2:29:23,  3.41it/s]
 92%|█████████▏| 340906/371472 [4:57:29<2:31:33,  3.36it/s]
 92%|█████████▏| 340907/371472 [4:57:29<2:26:16,  3.48it/s]
 92%|█████████▏| 340908/371472 [4:57:30<2:28:46,  3.42it/s]
 92%|█████████▏| 340909/371472 [4:57:30<2:22:14,  3.58it/s]
 92%|█████████▏| 340910/371472 [4:57:30<2:18:57,  3.67it/s]
 92%|█████████▏| 340911/371472 [4:57:30<2:18:39,  3.67it/s]
 92%|█████████▏| 340912/371472 [4:57:31<2:16:02,  3.74it/s]
 92%|█████████▏| 340913/371472 [4:57:31<2:22:45,  3.57it/s]
 92%|█████████▏| 340914/371472 [4:57:31<2:27:04,  3.46it/s]
 92%|█████████▏| 340915/371472 [4:57:32<2:33:26,  3.32it/s]
 92%|█████████▏| 340916/371472 [4:57:32<2:33:33,  3.32it/s]
 92%|█████████▏| 340917/371472 [4:57:32<2:30:15,  3.39it/s]
 92%|█████████▏| 340918/371472 [4:57:33<2:33:34,  3.32it/s]
 92%|█████████▏| 340919/371472 [4:57:33<2:42:00,  3.14it/s]
 92%|█████████▏| 340920/371472 [4:57:33<2:36:24,  3.26it/s]
                                                           
{'loss': 2.6, 'learning_rate': 1.7406106574155877e-07, 'epoch': 14.68}

 92%|█████████▏| 340920/371472 [4:57:33<2:36:24,  3.26it/s]
 92%|█████████▏| 340921/371472 [4:57:33<2:32:09,  3.35it/s]
 92%|█████████▏| 340922/371472 [4:57:34<2:26:06,  3.48it/s]
 92%|█████████▏| 340923/371472 [4:57:34<2:21:12,  3.61it/s]
 92%|█████████▏| 340924/371472 [4:57:34<2:22:05,  3.58it/s]
 92%|█████████▏| 340925/371472 [4:57:35<2:29:50,  3.40it/s]
 92%|█████████▏| 340926/371472 [4:57:35<2:28:17,  3.43it/s]
 92%|█████████▏| 340927/371472 [4:57:35<2:31:04,  3.37it/s]
 92%|█████████▏| 340928/371472 [4:57:35<2:27:02,  3.46it/s]
 92%|█████████▏| 340929/371472 [4:57:36<2:27:25,  3.45it/s]
 92%|█████████▏| 340930/371472 [4:57:36<2:36:22,  3.26it/s]
 92%|█████████▏| 340931/371472 [4:57:36<2:35:19,  3.28it/s]
 92%|█████████▏| 340932/371472 [4:57:37<2:32:43,  3.33it/s]
 92%|█████████▏| 340933/371472 [4:57:37<2:31:32,  3.36it/s]
 92%|█████████▏| 340934/371472 [4:57:37<2:36:44,  3.25it/s]
 92%|█████████▏| 340935/371472 [4:57:38<2:36:47,  3.25it/s]
 92%|█████████▏| 340936/371472 [4:57:38<2:26:14,  3.48it/s]
 92%|█████████▏| 340937/371472 [4:57:38<2:21:25,  3.60it/s]
 92%|█████████▏| 340938/371472 [4:57:38<2:27:46,  3.44it/s]
 92%|█████████▏| 340939/371472 [4:57:39<2:22:54,  3.56it/s]
 92%|█████████▏| 340940/371472 [4:57:39<2:25:35,  3.50it/s]
                                                           
{'loss': 2.5229, 'learning_rate': 1.7401258376607982e-07, 'epoch': 14.68}

 92%|█████████▏| 340940/371472 [4:57:39<2:25:35,  3.50it/s]
 92%|█████████▏| 340941/371472 [4:57:39<2:25:47,  3.49it/s]
 92%|█████████▏| 340942/371472 [4:57:40<2:31:40,  3.35it/s]
 92%|█████████▏| 340943/371472 [4:57:40<2:28:48,  3.42it/s]
 92%|█████████▏| 340944/371472 [4:57:40<2:34:41,  3.29it/s]
 92%|█████████▏| 340945/371472 [4:57:40<2:32:33,  3.34it/s]
 92%|█████████▏| 340946/371472 [4:57:41<2:28:11,  3.43it/s]
 92%|█████████▏| 340947/371472 [4:57:41<2:28:11,  3.43it/s]
 92%|█████████▏| 340948/371472 [4:57:41<2:27:43,  3.44it/s]
 92%|█████████▏| 340949/371472 [4:57:42<2:27:22,  3.45it/s]
 92%|█████████▏| 340950/371472 [4:57:42<2:24:48,  3.51it/s]
 92%|█████████▏| 340951/371472 [4:57:42<2:23:46,  3.54it/s]
 92%|█████████▏| 340952/371472 [4:57:42<2:21:59,  3.58it/s]
 92%|█████████▏| 340953/371472 [4:57:43<2:17:38,  3.70it/s]
 92%|█████████▏| 340954/371472 [4:57:43<2:38:09,  3.22it/s]
 92%|█████████▏| 340955/371472 [4:57:43<2:34:39,  3.29it/s]
 92%|█████████▏| 340956/371472 [4:57:44<2:32:27,  3.34it/s]
 92%|█████████▏| 340957/371472 [4:57:44<2:28:26,  3.43it/s]
 92%|█████████▏| 340958/371472 [4:57:44<2:24:07,  3.53it/s]
 92%|█████████▏| 340959/371472 [4:57:45<2:40:59,  3.16it/s]
 92%|█████████▏| 340960/371472 [4:57:45<2:39:01,  3.20it/s]
                                                           
{'loss': 2.4644, 'learning_rate': 1.7396410179060097e-07, 'epoch': 14.69}

 92%|█████████▏| 340960/371472 [4:57:45<2:39:01,  3.20it/s]
 92%|█████████▏| 340961/371472 [4:57:45<2:30:03,  3.39it/s]
 92%|█████████▏| 340962/371472 [4:57:45<2:28:39,  3.42it/s]
 92%|█████████▏| 340963/371472 [4:57:46<2:28:47,  3.42it/s]
 92%|█████████▏| 340964/371472 [4:57:46<2:22:24,  3.57it/s]
 92%|█████████▏| 340965/371472 [4:57:46<2:24:31,  3.52it/s]
 92%|█████████▏| 340966/371472 [4:57:47<2:22:02,  3.58it/s]
 92%|█████████▏| 340967/371472 [4:57:47<2:20:09,  3.63it/s]
 92%|█████████▏| 340968/371472 [4:57:47<2:18:58,  3.66it/s]
 92%|█████████▏| 340969/371472 [4:57:47<2:19:54,  3.63it/s]
 92%|█████████▏| 340970/371472 [4:57:48<2:17:48,  3.69it/s]
 92%|█████████▏| 340971/371472 [4:57:48<2:22:38,  3.56it/s]
 92%|█████████▏| 340972/371472 [4:57:48<2:17:47,  3.69it/s]
 92%|█████████▏| 340973/371472 [4:57:48<2:18:54,  3.66it/s]
 92%|█████████▏| 340974/371472 [4:57:49<2:23:13,  3.55it/s]
 92%|█████████▏| 340975/371472 [4:57:49<2:19:29,  3.64it/s]
 92%|█████████▏| 340976/371472 [4:57:49<2:31:56,  3.35it/s]
 92%|█████████▏| 340977/371472 [4:57:50<2:30:02,  3.39it/s]
 92%|█████████▏| 340978/371472 [4:57:50<2:25:43,  3.49it/s]
 92%|█████████▏| 340979/371472 [4:57:50<2:32:09,  3.34it/s]
 92%|█████████▏| 340980/371472 [4:57:51<2:30:33,  3.38it/s]
                                                           
{'loss': 2.6092, 'learning_rate': 1.7391561981512204e-07, 'epoch': 14.69}

 92%|█████████▏| 340980/371472 [4:57:51<2:30:33,  3.38it/s]
 92%|█████████▏| 340981/371472 [4:57:51<2:21:08,  3.60it/s]
 92%|█████████▏| 340982/371472 [4:57:51<2:18:30,  3.67it/s]
 92%|█████████▏| 340983/371472 [4:57:51<2:20:06,  3.63it/s]
 92%|█████████▏| 340984/371472 [4:57:52<2:23:38,  3.54it/s]
 92%|█████████▏| 340985/371472 [4:57:52<2:22:42,  3.56it/s]
 92%|█████████▏| 340986/371472 [4:57:52<2:49:25,  3.00it/s]
 92%|█████████▏| 340987/371472 [4:57:53<2:38:57,  3.20it/s]
 92%|█████████▏| 340988/371472 [4:57:53<2:39:28,  3.19it/s]
 92%|█████████▏| 340989/371472 [4:57:53<2:41:20,  3.15it/s]
 92%|█████████▏| 340990/371472 [4:57:54<2:32:18,  3.34it/s]
 92%|█████████▏| 340991/371472 [4:57:54<2:31:47,  3.35it/s]
 92%|█████████▏| 340992/371472 [4:57:54<2:28:55,  3.41it/s]
 92%|█████████▏| 340993/371472 [4:57:54<2:26:14,  3.47it/s]
 92%|█████████▏| 340994/371472 [4:57:55<2:34:18,  3.29it/s]
 92%|█████████▏| 340995/371472 [4:57:55<2:31:08,  3.36it/s]
 92%|█████████▏| 340996/371472 [4:57:55<2:30:24,  3.38it/s]
 92%|█████████▏| 340997/371472 [4:57:56<2:31:00,  3.36it/s]
 92%|█████████▏| 340998/371472 [4:57:56<2:35:13,  3.27it/s]
 92%|█████████▏| 340999/371472 [4:57:56<2:29:17,  3.40it/s]
 92%|█████████▏| 341000/371472 [4:57:57<2:41:42,  3.14it/s]
                                                           
{'loss': 2.5717, 'learning_rate': 1.738671378396432e-07, 'epoch': 14.69}

 92%|█████████▏| 341000/371472 [4:57:57<2:41:42,  3.14it/s]
 92%|█████████▏| 341001/371472 [4:57:57<2:32:56,  3.32it/s]
 92%|█████████▏| 341002/371472 [4:57:57<2:25:21,  3.49it/s]
 92%|█████████▏| 341003/371472 [4:57:57<2:25:46,  3.48it/s]
 92%|█████████▏| 341004/371472 [4:57:58<2:26:45,  3.46it/s]
 92%|█████████▏| 341005/371472 [4:57:58<2:22:54,  3.55it/s]
 92%|█████████▏| 341006/371472 [4:57:58<2:36:13,  3.25it/s]
 92%|█████████▏| 341007/371472 [4:57:59<2:28:14,  3.43it/s]
 92%|█████████▏| 341008/371472 [4:57:59<2:23:07,  3.55it/s]
 92%|█████████▏| 341009/371472 [4:57:59<2:25:04,  3.50it/s]
 92%|█████████▏| 341010/371472 [4:57:59<2:36:14,  3.25it/s]
 92%|█████████▏| 341011/371472 [4:58:00<2:31:41,  3.35it/s]
 92%|█████████▏| 341012/371472 [4:58:00<2:23:06,  3.55it/s]
 92%|█████████▏| 341013/371472 [4:58:00<2:21:00,  3.60it/s]
 92%|█████████▏| 341014/371472 [4:58:01<2:22:41,  3.56it/s]
 92%|█████████▏| 341015/371472 [4:58:01<2:28:40,  3.41it/s]
 92%|█████████▏| 341016/371472 [4:58:01<2:24:47,  3.51it/s]
 92%|█████████▏| 341017/371472 [4:58:01<2:24:21,  3.52it/s]
 92%|█████████▏| 341018/371472 [4:58:02<2:22:08,  3.57it/s]
 92%|█████████▏| 341019/371472 [4:58:02<2:18:11,  3.67it/s]
 92%|█████████▏| 341020/371472 [4:58:02<2:16:02,  3.73it/s]
                                                           
{'loss': 2.493, 'learning_rate': 1.7381865586416424e-07, 'epoch': 14.69}

 92%|█████████▏| 341020/371472 [4:58:02<2:16:02,  3.73it/s]
 92%|█████████▏| 341021/371472 [4:58:03<2:21:10,  3.59it/s]
 92%|█████████▏| 341022/371472 [4:58:03<2:37:07,  3.23it/s]
 92%|█████████▏| 341023/371472 [4:58:03<2:30:39,  3.37it/s]
 92%|█████████▏| 341024/371472 [4:58:03<2:26:45,  3.46it/s]
 92%|█████████▏| 341025/371472 [4:58:04<2:22:19,  3.57it/s]
 92%|█████████▏| 341026/371472 [4:58:04<2:19:07,  3.65it/s]
 92%|█████████▏| 341027/371472 [4:58:04<2:34:05,  3.29it/s]
 92%|█████████▏| 341028/371472 [4:58:05<2:31:05,  3.36it/s]
 92%|█████████▏| 341029/371472 [4:58:05<2:38:05,  3.21it/s]
 92%|█████████▏| 341030/371472 [4:58:05<2:31:15,  3.35it/s]
 92%|█████████▏| 341031/371472 [4:58:06<2:30:55,  3.36it/s]
 92%|█████████▏| 341032/371472 [4:58:06<2:23:25,  3.54it/s]
 92%|█████████▏| 341033/371472 [4:58:06<2:25:33,  3.49it/s]
 92%|█████████▏| 341034/371472 [4:58:06<2:38:04,  3.21it/s]
 92%|█████████▏| 341035/371472 [4:58:07<2:30:38,  3.37it/s]
 92%|█████████▏| 341036/371472 [4:58:07<2:30:36,  3.37it/s]
 92%|█████████▏| 341037/371472 [4:58:07<2:34:04,  3.29it/s]
 92%|█████████▏| 341038/371472 [4:58:08<2:40:43,  3.16it/s]
 92%|█████████▏| 341039/371472 [4:58:08<2:29:26,  3.39it/s]
 92%|█████████▏| 341040/371472 [4:58:08<2:24:58,  3.50it/s]
                                                           
{'loss': 2.4997, 'learning_rate': 1.7377017388868541e-07, 'epoch': 14.69}

 92%|█████████▏| 341040/371472 [4:58:08<2:24:58,  3.50it/s]
 92%|█████████▏| 341041/371472 [4:58:08<2:18:44,  3.66it/s]
 92%|█████████▏| 341042/371472 [4:58:09<2:29:14,  3.40it/s]
 92%|█████████▏| 341043/371472 [4:58:09<2:35:13,  3.27it/s]
 92%|█████████▏| 341044/371472 [4:58:09<2:28:14,  3.42it/s]
 92%|█████████▏| 341045/371472 [4:58:10<2:20:33,  3.61it/s]
 92%|█████████▏| 341046/371472 [4:58:10<2:27:38,  3.43it/s]
 92%|█████████▏| 341047/371472 [4:58:10<2:28:04,  3.42it/s]
 92%|█████████▏| 341048/371472 [4:58:10<2:27:15,  3.44it/s]
 92%|█████████▏| 341049/371472 [4:58:11<2:22:05,  3.57it/s]
 92%|█████████▏| 341050/371472 [4:58:11<2:22:08,  3.57it/s]
 92%|█████████▏| 341051/371472 [4:58:11<2:25:06,  3.49it/s]
 92%|█████████▏| 341052/371472 [4:58:12<2:24:24,  3.51it/s]
 92%|█████████▏| 341053/371472 [4:58:12<2:25:58,  3.47it/s]
 92%|█████████▏| 341054/371472 [4:58:12<2:21:15,  3.59it/s]
 92%|█████████▏| 341055/371472 [4:58:12<2:17:45,  3.68it/s]
 92%|█████████▏| 341056/371472 [4:58:13<2:14:51,  3.76it/s]
 92%|█████████▏| 341057/371472 [4:58:13<2:17:17,  3.69it/s]
 92%|█████████▏| 341058/371472 [4:58:13<2:16:30,  3.71it/s]
 92%|█████████▏| 341059/371472 [4:58:14<2:23:46,  3.53it/s]
 92%|█████████▏| 341060/371472 [4:58:14<2:30:28,  3.37it/s]
                                                           
{'loss': 2.4931, 'learning_rate': 1.7372169191320649e-07, 'epoch': 14.69}

 92%|█████████▏| 341060/371472 [4:58:14<2:30:28,  3.37it/s]
 92%|█████████▏| 341061/371472 [4:58:14<2:23:44,  3.53it/s]
 92%|█████████▏| 341062/371472 [4:58:14<2:16:14,  3.72it/s]
 92%|█████████▏| 341063/371472 [4:58:15<2:30:31,  3.37it/s]
 92%|█████████▏| 341064/371472 [4:58:15<2:26:13,  3.47it/s]
 92%|█████████▏| 341065/371472 [4:58:15<2:30:50,  3.36it/s]
 92%|█████████▏| 341066/371472 [4:58:16<2:26:33,  3.46it/s]
 92%|█████████▏| 341067/371472 [4:58:16<2:23:17,  3.54it/s]
 92%|█████████▏| 341068/371472 [4:58:16<2:22:47,  3.55it/s]
 92%|█████████▏| 341069/371472 [4:58:16<2:26:31,  3.46it/s]
 92%|█████████▏| 341070/371472 [4:58:17<2:22:22,  3.56it/s]
 92%|█████████▏| 341071/371472 [4:58:17<2:26:31,  3.46it/s]
 92%|█████████▏| 341072/371472 [4:58:17<2:31:03,  3.35it/s]
 92%|█████████▏| 341073/371472 [4:58:18<2:25:07,  3.49it/s]
 92%|█████████▏| 341074/371472 [4:58:18<2:18:46,  3.65it/s]
 92%|█████████▏| 341075/371472 [4:58:18<2:19:36,  3.63it/s]
 92%|█████████▏| 341076/371472 [4:58:18<2:27:52,  3.43it/s]
 92%|█████████▏| 341077/371472 [4:58:19<2:37:00,  3.23it/s]
 92%|█████████▏| 341078/371472 [4:58:19<2:29:50,  3.38it/s]
 92%|█████████▏| 341079/371472 [4:58:19<2:29:51,  3.38it/s]
 92%|█████████▏| 341080/371472 [4:58:20<2:28:45,  3.40it/s]
                                                           
{'loss': 2.5552, 'learning_rate': 1.736732099377276e-07, 'epoch': 14.69}

 92%|█████████▏| 341080/371472 [4:58:20<2:28:45,  3.40it/s]
 92%|█████████▏| 341081/371472 [4:58:20<2:23:16,  3.54it/s]
 92%|█████████▏| 341082/371472 [4:58:20<2:20:45,  3.60it/s]
 92%|█████████▏| 341083/371472 [4:58:20<2:16:51,  3.70it/s]
 92%|█████████▏| 341084/371472 [4:58:21<2:18:03,  3.67it/s]
 92%|█████████▏| 341085/371472 [4:58:21<2:21:49,  3.57it/s]
 92%|█████████▏| 341086/371472 [4:58:21<2:21:52,  3.57it/s]
 92%|█████████▏| 341087/371472 [4:58:21<2:17:23,  3.69it/s]
 92%|█████████▏| 341088/371472 [4:58:22<2:16:09,  3.72it/s]
 92%|█████████▏| 341089/371472 [4:58:22<2:24:36,  3.50it/s]
 92%|█████████▏| 341090/371472 [4:58:22<2:25:29,  3.48it/s]
 92%|█████████▏| 341091/371472 [4:58:23<2:26:38,  3.45it/s]
 92%|█████████▏| 341092/371472 [4:58:23<2:37:31,  3.21it/s]
 92%|█████████▏| 341093/371472 [4:58:23<2:27:20,  3.44it/s]
 92%|█████████▏| 341094/371472 [4:58:24<2:25:43,  3.47it/s]
 92%|█████████▏| 341095/371472 [4:58:24<2:23:13,  3.53it/s]
 92%|█████████▏| 341096/371472 [4:58:24<2:21:08,  3.59it/s]
 92%|█████████▏| 341097/371472 [4:58:24<2:17:25,  3.68it/s]
 92%|█████████▏| 341098/371472 [4:58:25<2:15:31,  3.74it/s]
 92%|█████████▏| 341099/371472 [4:58:25<2:17:44,  3.68it/s]
 92%|█████████▏| 341100/371472 [4:58:25<2:18:45,  3.65it/s]
                                                           
{'loss': 2.6086, 'learning_rate': 1.7362472796224866e-07, 'epoch': 14.69}

 92%|█████████▏| 341100/371472 [4:58:25<2:18:45,  3.65it/s]
 92%|█████████▏| 341101/371472 [4:58:25<2:17:49,  3.67it/s]
 92%|█████████▏| 341102/371472 [4:58:26<2:16:18,  3.71it/s]
 92%|█████████▏| 341103/371472 [4:58:26<2:21:47,  3.57it/s]
 92%|█████████▏| 341104/371472 [4:58:26<2:24:31,  3.50it/s]
 92%|█████████▏| 341105/371472 [4:58:27<2:27:10,  3.44it/s]
 92%|█████████▏| 341106/371472 [4:58:27<2:23:24,  3.53it/s]
 92%|█████████▏| 341107/371472 [4:58:27<2:24:19,  3.51it/s]
 92%|█████████▏| 341108/371472 [4:58:27<2:20:06,  3.61it/s]
 92%|█████████▏| 341109/371472 [4:58:28<2:18:17,  3.66it/s]
 92%|█████████▏| 341110/371472 [4:58:28<2:24:52,  3.49it/s]
 92%|█████████▏| 341111/371472 [4:58:28<2:32:41,  3.31it/s]
 92%|█████████▏| 341112/371472 [4:58:29<2:29:04,  3.39it/s]
 92%|█████████▏| 341113/371472 [4:58:29<2:26:01,  3.47it/s]
 92%|█████████▏| 341114/371472 [4:58:29<2:17:08,  3.69it/s]
 92%|█████████▏| 341115/371472 [4:58:30<2:39:45,  3.17it/s]
 92%|█████████▏| 341116/371472 [4:58:30<2:32:01,  3.33it/s]
 92%|█████████▏| 341117/371472 [4:58:30<2:28:19,  3.41it/s]
 92%|█████████▏| 341118/371472 [4:58:30<2:19:59,  3.61it/s]
 92%|█████████▏| 341119/371472 [4:58:31<2:16:22,  3.71it/s]
 92%|█████████▏| 341120/371472 [4:58:31<2:23:45,  3.52it/s]
                                                           
{'loss': 2.6389, 'learning_rate': 1.7357624598676986e-07, 'epoch': 14.69}

 92%|█████████▏| 341120/371472 [4:58:31<2:23:45,  3.52it/s]
 92%|█████████▏| 341121/371472 [4:58:31<2:18:38,  3.65it/s]
 92%|█████████▏| 341122/371472 [4:58:31<2:18:00,  3.67it/s]
 92%|█████████▏| 341123/371472 [4:58:32<2:26:00,  3.46it/s]
 92%|█████████▏| 341124/371472 [4:58:32<2:22:45,  3.54it/s]
 92%|█████████▏| 341125/371472 [4:58:32<2:21:55,  3.56it/s]
 92%|█████████▏| 341126/371472 [4:58:33<2:21:29,  3.57it/s]
 92%|█████████▏| 341127/371472 [4:58:33<2:18:59,  3.64it/s]
 92%|█████████▏| 341128/371472 [4:58:33<2:18:46,  3.64it/s]
 92%|█████████▏| 341129/371472 [4:58:33<2:19:52,  3.62it/s]
 92%|█████████▏| 341130/371472 [4:58:34<2:14:15,  3.77it/s]
 92%|█████████▏| 341131/371472 [4:58:34<2:14:30,  3.76it/s]
 92%|█████████▏| 341132/371472 [4:58:34<2:12:23,  3.82it/s]
 92%|█████████▏| 341133/371472 [4:58:34<2:14:51,  3.75it/s]
 92%|█████████▏| 341134/371472 [4:58:35<2:13:30,  3.79it/s]
 92%|█████████▏| 341135/371472 [4:58:35<2:20:46,  3.59it/s]
 92%|█████████▏| 341136/371472 [4:58:35<2:19:47,  3.62it/s]
 92%|█████████▏| 341137/371472 [4:58:36<2:17:40,  3.67it/s]
 92%|█████████▏| 341138/371472 [4:58:36<2:26:38,  3.45it/s]
 92%|█████████▏| 341139/371472 [4:58:36<2:33:34,  3.29it/s]
 92%|█████████▏| 341140/371472 [4:58:36<2:27:35,  3.43it/s]
                                                           
{'loss': 2.643, 'learning_rate': 1.735277640112909e-07, 'epoch': 14.69}

 92%|█████████▏| 341140/371472 [4:58:36<2:27:35,  3.43it/s]
 92%|█████████▏| 341141/371472 [4:58:37<2:23:16,  3.53it/s]
 92%|█████████▏| 341142/371472 [4:58:37<2:19:42,  3.62it/s]
 92%|█████████▏| 341143/371472 [4:58:37<2:27:09,  3.43it/s]
 92%|█████████▏| 341144/371472 [4:58:38<2:21:13,  3.58it/s]
 92%|█████████▏| 341145/371472 [4:58:38<2:26:56,  3.44it/s]
 92%|█████████▏| 341146/371472 [4:58:38<2:26:44,  3.44it/s]
 92%|█████████▏| 341147/371472 [4:58:38<2:28:01,  3.41it/s]
 92%|█████████▏| 341148/371472 [4:58:39<2:26:15,  3.46it/s]
 92%|█████████▏| 341149/371472 [4:58:39<2:29:26,  3.38it/s]
 92%|█████████▏| 341150/371472 [4:58:39<2:27:51,  3.42it/s]
 92%|█████████▏| 341151/371472 [4:58:40<2:36:56,  3.22it/s]
 92%|█████████▏| 341152/371472 [4:58:40<2:40:23,  3.15it/s]
 92%|█████████▏| 341153/371472 [4:58:40<2:31:04,  3.34it/s]
 92%|█████████▏| 341154/371472 [4:58:41<2:27:28,  3.43it/s]
 92%|█████████▏| 341155/371472 [4:58:41<2:21:46,  3.56it/s]
 92%|█████████▏| 341156/371472 [4:58:41<2:21:44,  3.56it/s]
 92%|█████████▏| 341157/371472 [4:58:41<2:18:46,  3.64it/s]
 92%|█████████▏| 341158/371472 [4:58:42<2:15:57,  3.72it/s]
 92%|█████████▏| 341159/371472 [4:58:42<2:26:31,  3.45it/s]
 92%|█████████▏| 341160/371472 [4:58:42<2:24:11,  3.50it/s]
                                                           
{'loss': 2.6484, 'learning_rate': 1.7347928203581206e-07, 'epoch': 14.69}

 92%|█████████▏| 341160/371472 [4:58:42<2:24:11,  3.50it/s]
 92%|█████████▏| 341161/371472 [4:58:43<2:35:11,  3.26it/s]
 92%|█████████▏| 341162/371472 [4:58:43<2:31:16,  3.34it/s]
 92%|█████████▏| 341163/371472 [4:58:43<2:31:44,  3.33it/s]
 92%|█████████▏| 341164/371472 [4:58:43<2:29:41,  3.37it/s]
 92%|█████████▏| 341165/371472 [4:58:44<2:27:04,  3.43it/s]
 92%|█████████▏| 341166/371472 [4:58:44<2:24:34,  3.49it/s]
 92%|█████████▏| 341167/371472 [4:58:44<2:22:52,  3.54it/s]
 92%|█████████▏| 341168/371472 [4:58:45<2:21:05,  3.58it/s]
 92%|█████████▏| 341169/371472 [4:58:45<2:21:58,  3.56it/s]
 92%|█████████▏| 341170/371472 [4:58:45<2:25:55,  3.46it/s]
 92%|█████████▏| 341171/371472 [4:58:45<2:21:55,  3.56it/s]
 92%|█████████▏| 341172/371472 [4:58:46<2:22:33,  3.54it/s]
 92%|█████████▏| 341173/371472 [4:58:46<2:24:21,  3.50it/s]
 92%|█████████▏| 341174/371472 [4:58:46<2:36:24,  3.23it/s]
 92%|█████████▏| 341175/371472 [4:58:47<2:31:32,  3.33it/s]
 92%|█████████▏| 341176/371472 [4:58:47<2:32:11,  3.32it/s]
 92%|█████████▏| 341177/371472 [4:58:47<2:23:41,  3.51it/s]
 92%|█████████▏| 341178/371472 [4:58:47<2:24:39,  3.49it/s]
 92%|█████████▏| 341179/371472 [4:58:48<2:22:22,  3.55it/s]
 92%|█████████▏| 341180/371472 [4:58:48<2:17:40,  3.67it/s]
                                                           
{'loss': 2.6341, 'learning_rate': 1.7343080006033313e-07, 'epoch': 14.7}

 92%|█████████▏| 341180/371472 [4:58:48<2:17:40,  3.67it/s]
 92%|█████████▏| 341181/371472 [4:58:48<2:23:32,  3.52it/s]
 92%|█████████▏| 341182/371472 [4:58:49<2:19:15,  3.63it/s]
 92%|█████████▏| 341183/371472 [4:58:49<2:19:23,  3.62it/s]
 92%|█████████▏| 341184/371472 [4:58:49<2:20:21,  3.60it/s]
 92%|█████████▏| 341185/371472 [4:58:49<2:17:10,  3.68it/s]
 92%|█████████▏| 341186/371472 [4:58:50<2:24:09,  3.50it/s]
 92%|█████████▏| 341187/371472 [4:58:50<2:25:29,  3.47it/s]
 92%|█████████▏| 341188/371472 [4:58:50<2:24:47,  3.49it/s]
 92%|█████████▏| 341189/371472 [4:58:51<2:24:32,  3.49it/s]
 92%|█████████▏| 341190/371472 [4:58:51<2:26:17,  3.45it/s]
 92%|█████████▏| 341191/371472 [4:58:51<2:23:38,  3.51it/s]
 92%|█████████▏| 341192/371472 [4:58:51<2:21:48,  3.56it/s]
 92%|█████████▏| 341193/371472 [4:58:52<2:27:23,  3.42it/s]
 92%|█████████▏| 341194/371472 [4:58:52<2:24:48,  3.48it/s]
 92%|█████████▏| 341195/371472 [4:58:52<2:25:40,  3.46it/s]
 92%|█████████▏| 341196/371472 [4:58:53<2:24:01,  3.50it/s]
 92%|█████████▏| 341197/371472 [4:58:53<2:25:02,  3.48it/s]
 92%|█████████▏| 341198/371472 [4:58:53<2:23:15,  3.52it/s]
 92%|█████████▏| 341199/371472 [4:58:53<2:21:44,  3.56it/s]
 92%|█████████▏| 341200/371472 [4:58:54<2:18:21,  3.65it/s]
                                                           
{'loss': 2.5684, 'learning_rate': 1.7338231808485417e-07, 'epoch': 14.7}

 92%|█████████▏| 341200/371472 [4:58:54<2:18:21,  3.65it/s]
 92%|█████████▏| 341201/371472 [4:58:54<2:15:32,  3.72it/s]
 92%|█████████▏| 341202/371472 [4:58:54<2:13:00,  3.79it/s]
 92%|█████████▏| 341203/371472 [4:58:54<2:18:08,  3.65it/s]
 92%|█████████▏| 341204/371472 [4:58:55<2:17:01,  3.68it/s]
 92%|█████████▏| 341205/371472 [4:58:55<2:14:37,  3.75it/s]
 92%|█████████▏| 341206/371472 [4:58:55<2:26:44,  3.44it/s]
 92%|█████████▏| 341207/371472 [4:58:56<2:40:51,  3.14it/s]
 92%|█████████▏| 341208/371472 [4:58:56<2:33:05,  3.29it/s]
 92%|█████████▏| 341209/371472 [4:58:56<2:38:06,  3.19it/s]
 92%|█████████▏| 341210/371472 [4:58:57<2:30:57,  3.34it/s]
 92%|█████████▏| 341211/371472 [4:58:57<2:27:31,  3.42it/s]
 92%|█████████▏| 341212/371472 [4:58:57<2:23:10,  3.52it/s]
 92%|█████████▏| 341213/371472 [4:58:57<2:26:29,  3.44it/s]
 92%|█████████▏| 341214/371472 [4:58:58<2:26:52,  3.43it/s]
 92%|█████████▏| 341215/371472 [4:58:58<2:23:05,  3.52it/s]
 92%|█████████▏| 341216/371472 [4:58:58<2:25:37,  3.46it/s]
 92%|█████████▏| 341217/371472 [4:58:59<2:23:35,  3.51it/s]
 92%|█████████▏| 341218/371472 [4:58:59<2:36:03,  3.23it/s]
 92%|█████████▏| 341219/371472 [4:58:59<2:31:34,  3.33it/s]
 92%|█████████▏| 341220/371472 [4:58:59<2:25:59,  3.45it/s]
                                                           
{'loss': 2.6155, 'learning_rate': 1.7333383610937532e-07, 'epoch': 14.7}

 92%|█████████▏| 341220/371472 [4:58:59<2:25:59,  3.45it/s]
 92%|█████████▏| 341221/371472 [4:59:00<2:22:33,  3.54it/s]
 92%|█████████▏| 341222/371472 [4:59:00<2:20:12,  3.60it/s]
 92%|█████████▏| 341223/371472 [4:59:00<2:17:23,  3.67it/s]
 92%|█████████▏| 341224/371472 [4:59:01<2:18:15,  3.65it/s]
 92%|█████████▏| 341225/371472 [4:59:01<2:34:55,  3.25it/s]
 92%|█████████▏| 341226/371472 [4:59:01<2:32:47,  3.30it/s]
 92%|█████████▏| 341227/371472 [4:59:02<2:28:16,  3.40it/s]
 92%|█████████▏| 341228/371472 [4:59:02<2:33:47,  3.28it/s]
 92%|█████████▏| 341229/371472 [4:59:02<2:56:08,  2.86it/s]
 92%|█████████▏| 341230/371472 [4:59:03<2:49:51,  2.97it/s]
 92%|█████████▏| 341231/371472 [4:59:03<2:41:47,  3.12it/s]
 92%|█████████▏| 341232/371472 [4:59:03<2:38:23,  3.18it/s]
 92%|█████████▏| 341233/371472 [4:59:03<2:31:42,  3.32it/s]
 92%|█████████▏| 341234/371472 [4:59:04<2:33:44,  3.28it/s]
 92%|█████████▏| 341235/371472 [4:59:04<2:24:21,  3.49it/s]
 92%|█████████▏| 341236/371472 [4:59:04<2:20:37,  3.58it/s]
 92%|█████████▏| 341237/371472 [4:59:05<2:27:04,  3.43it/s]
 92%|█████████▏| 341238/371472 [4:59:05<2:19:56,  3.60it/s]
 92%|█████████▏| 341239/371472 [4:59:05<2:19:29,  3.61it/s]
 92%|█████████▏| 341240/371472 [4:59:05<2:17:29,  3.66it/s]
                                                           
{'loss': 2.5842, 'learning_rate': 1.732853541338964e-07, 'epoch': 14.7}

 92%|█████████▏| 341240/371472 [4:59:05<2:17:29,  3.66it/s]
 92%|█████████▏| 341241/371472 [4:59:06<2:29:38,  3.37it/s]
 92%|█████████▏| 341242/371472 [4:59:06<2:26:55,  3.43it/s]
 92%|█████████▏| 341243/371472 [4:59:06<2:33:25,  3.28it/s]
 92%|█████████▏| 341244/371472 [4:59:07<2:28:12,  3.40it/s]
 92%|█████████▏| 341245/371472 [4:59:07<2:22:42,  3.53it/s]
 92%|█████████▏| 341246/371472 [4:59:07<2:20:20,  3.59it/s]
 92%|█████████▏| 341247/371472 [4:59:07<2:21:28,  3.56it/s]
 92%|█████████▏| 341248/371472 [4:59:08<2:20:01,  3.60it/s]
 92%|█████████▏| 341249/371472 [4:59:08<2:41:19,  3.12it/s]
 92%|█████████▏| 341250/371472 [4:59:08<2:34:59,  3.25it/s]
 92%|█████████▏| 341251/371472 [4:59:09<2:35:17,  3.24it/s]
 92%|█████████▏| 341252/371472 [4:59:09<2:29:09,  3.38it/s]
 92%|█████████▏| 341253/371472 [4:59:09<2:23:25,  3.51it/s]
 92%|█████████▏| 341254/371472 [4:59:09<2:20:43,  3.58it/s]
 92%|█████████▏| 341255/371472 [4:59:10<2:21:24,  3.56it/s]
 92%|█████████▏| 341256/371472 [4:59:10<2:17:03,  3.67it/s]
 92%|█████████▏| 341257/371472 [4:59:10<2:15:36,  3.71it/s]
 92%|█████████▏| 341258/371472 [4:59:11<2:26:15,  3.44it/s]
 92%|█████████▏| 341259/371472 [4:59:11<2:21:35,  3.56it/s]
 92%|█████████▏| 341260/371472 [4:59:11<2:21:44,  3.55it/s]
                                                           
{'loss': 2.6351, 'learning_rate': 1.7323687215841754e-07, 'epoch': 14.7}

 92%|█████████▏| 341260/371472 [4:59:11<2:21:44,  3.55it/s]
 92%|█████████▏| 341261/371472 [4:59:12<2:29:56,  3.36it/s]
 92%|█████████▏| 341262/371472 [4:59:12<2:25:33,  3.46it/s]
 92%|█████████▏| 341263/371472 [4:59:12<2:23:59,  3.50it/s]
 92%|█████████▏| 341264/371472 [4:59:12<2:21:47,  3.55it/s]
 92%|█████████▏| 341265/371472 [4:59:13<2:18:17,  3.64it/s]
 92%|█████████▏| 341266/371472 [4:59:13<2:17:06,  3.67it/s]
 92%|█████████▏| 341267/371472 [4:59:13<2:16:46,  3.68it/s]
 92%|█████████▏| 341268/371472 [4:59:13<2:15:09,  3.72it/s]
 92%|█████████▏| 341269/371472 [4:59:14<2:17:56,  3.65it/s]
 92%|█████████▏| 341270/371472 [4:59:14<2:22:19,  3.54it/s]
 92%|█████████▏| 341271/371472 [4:59:14<2:29:39,  3.36it/s]
 92%|█████████▏| 341272/371472 [4:59:15<2:26:14,  3.44it/s]
 92%|█████████▏| 341273/371472 [4:59:15<2:27:52,  3.40it/s]
 92%|█████████▏| 341274/371472 [4:59:15<2:27:23,  3.41it/s]
 92%|█████████▏| 341275/371472 [4:59:15<2:27:05,  3.42it/s]
 92%|█████████▏| 341276/371472 [4:59:16<2:27:14,  3.42it/s]
 92%|█████████▏| 341277/371472 [4:59:16<2:23:58,  3.50it/s]
 92%|█████████▏| 341278/371472 [4:59:16<2:23:19,  3.51it/s]
 92%|█████████▏| 341279/371472 [4:59:17<2:24:02,  3.49it/s]
 92%|█████████▏| 341280/371472 [4:59:17<2:30:36,  3.34it/s]
                                                           
{'loss': 2.5773, 'learning_rate': 1.731883901829386e-07, 'epoch': 14.7}

 92%|█████████▏| 341280/371472 [4:59:17<2:30:36,  3.34it/s]
 92%|█████████▏| 341281/371472 [4:59:17<2:33:22,  3.28it/s]
 92%|█████████▏| 341282/371472 [4:59:18<2:45:36,  3.04it/s]
 92%|█████████▏| 341283/371472 [4:59:18<2:38:15,  3.18it/s]
 92%|█████████▏| 341284/371472 [4:59:18<2:32:20,  3.30it/s]
 92%|█████████▏| 341285/371472 [4:59:19<2:40:27,  3.14it/s]
 92%|█████████▏| 341286/371472 [4:59:19<2:46:40,  3.02it/s]
 92%|█████████▏| 341287/371472 [4:59:19<2:39:18,  3.16it/s]
 92%|█████████▏| 341288/371472 [4:59:20<2:38:47,  3.17it/s]
 92%|█████████▏| 341289/371472 [4:59:20<2:31:51,  3.31it/s]
 92%|█████████▏| 341290/371472 [4:59:20<2:31:29,  3.32it/s]
 92%|█████████▏| 341291/371472 [4:59:20<2:27:40,  3.41it/s]
 92%|█████████▏| 341292/371472 [4:59:21<2:22:07,  3.54it/s]
 92%|█████████▏| 341293/371472 [4:59:21<2:28:00,  3.40it/s]
 92%|█████████▏| 341294/371472 [4:59:21<2:26:48,  3.43it/s]
 92%|█████████▏| 341295/371472 [4:59:21<2:22:31,  3.53it/s]
 92%|█████████▏| 341296/371472 [4:59:22<2:19:19,  3.61it/s]
 92%|█████████▏| 341297/371472 [4:59:22<2:22:46,  3.52it/s]
 92%|█████████▏| 341298/371472 [4:59:22<2:19:40,  3.60it/s]
 92%|█████████▏| 341299/371472 [4:59:23<3:20:26,  2.51it/s]
 92%|█████████▏| 341300/371472 [4:59:23<3:06:48,  2.69it/s]
                                                           
{'loss': 2.5023, 'learning_rate': 1.7313990820745977e-07, 'epoch': 14.7}

 92%|█████████▏| 341300/371472 [4:59:23<3:06:48,  2.69it/s]
 92%|█████████▏| 341301/371472 [4:59:24<2:48:59,  2.98it/s]
 92%|█████████▏| 341302/371472 [4:59:24<2:36:18,  3.22it/s]
 92%|█████████▏| 341303/371472 [4:59:24<2:31:06,  3.33it/s]
 92%|█████████▏| 341304/371472 [4:59:24<2:30:39,  3.34it/s]
 92%|█████████▏| 341305/371472 [4:59:25<2:32:20,  3.30it/s]
 92%|█████████▏| 341306/371472 [4:59:25<2:23:21,  3.51it/s]
 92%|█████████▏| 341307/371472 [4:59:25<2:22:18,  3.53it/s]
 92%|█████████▏| 341308/371472 [4:59:25<2:19:29,  3.60it/s]
 92%|█████████▏| 341309/371472 [4:59:26<2:23:05,  3.51it/s]
 92%|█████████▏| 341310/371472 [4:59:26<2:23:12,  3.51it/s]
 92%|█████████▏| 341311/371472 [4:59:26<2:19:22,  3.61it/s]
 92%|█████████▏| 341312/371472 [4:59:27<2:20:32,  3.58it/s]
 92%|█████████▏| 341313/371472 [4:59:27<2:23:08,  3.51it/s]
 92%|█████████▏| 341314/371472 [4:59:27<2:22:10,  3.54it/s]
 92%|█████████▏| 341315/371472 [4:59:27<2:24:14,  3.48it/s]
 92%|█████████▏| 341316/371472 [4:59:28<2:27:14,  3.41it/s]
 92%|█████████▏| 341317/371472 [4:59:28<2:24:39,  3.47it/s]
 92%|█████████▏| 341318/371472 [4:59:29<2:49:27,  2.97it/s]
 92%|█████████▏| 341319/371472 [4:59:29<2:37:07,  3.20it/s]
 92%|█████████▏| 341320/371472 [4:59:29<2:26:03,  3.44it/s]
                                                           
{'loss': 2.5195, 'learning_rate': 1.7309142623198084e-07, 'epoch': 14.7}

 92%|█████████▏| 341320/371472 [4:59:29<2:26:03,  3.44it/s]
 92%|█████████▏| 341321/371472 [4:59:29<2:21:50,  3.54it/s]
 92%|█████████▏| 341322/371472 [4:59:30<2:23:47,  3.49it/s]
 92%|█████████▏| 341323/371472 [4:59:30<2:21:26,  3.55it/s]
 92%|█████████▏| 341324/371472 [4:59:30<2:20:53,  3.57it/s]
 92%|█████████▏| 341325/371472 [4:59:30<2:15:08,  3.72it/s]
 92%|█████████▏| 341326/371472 [4:59:31<2:24:49,  3.47it/s]
 92%|█████████▏| 341327/371472 [4:59:31<2:24:32,  3.48it/s]
 92%|█████████▏| 341328/371472 [4:59:31<2:19:21,  3.61it/s]
 92%|█████████▏| 341329/371472 [4:59:31<2:16:40,  3.68it/s]
 92%|█████████▏| 341330/371472 [4:59:32<2:14:22,  3.74it/s]
 92%|█████████▏| 341331/371472 [4:59:32<2:16:10,  3.69it/s]
 92%|█████████▏| 341332/371472 [4:59:32<2:12:44,  3.78it/s]
 92%|█████████▏| 341333/371472 [4:59:33<2:21:37,  3.55it/s]
 92%|█████████▏| 341334/371472 [4:59:33<2:16:45,  3.67it/s]
 92%|█████████▏| 341335/371472 [4:59:33<2:21:03,  3.56it/s]
 92%|█████████▏| 341336/371472 [4:59:33<2:22:25,  3.53it/s]
 92%|█████████▏| 341337/371472 [4:59:34<2:28:32,  3.38it/s]
 92%|█████████▏| 341338/371472 [4:59:34<2:25:29,  3.45it/s]
 92%|█████████▏| 341339/371472 [4:59:34<2:19:21,  3.60it/s]
 92%|█████████▏| 341340/371472 [4:59:35<2:15:51,  3.70it/s]
                                                           
{'loss': 2.543, 'learning_rate': 1.7304294425650196e-07, 'epoch': 14.7}

 92%|█████████▏| 341340/371472 [4:59:35<2:15:51,  3.70it/s]
 92%|█████████▏| 341341/371472 [4:59:35<2:17:09,  3.66it/s]
 92%|█████████▏| 341342/371472 [4:59:35<2:15:44,  3.70it/s]
 92%|█████████▏| 341343/371472 [4:59:35<2:09:53,  3.87it/s]
 92%|█████████▏| 341344/371472 [4:59:36<2:09:16,  3.88it/s]
 92%|█████████▏| 341345/371472 [4:59:36<2:08:46,  3.90it/s]
 92%|█████████▏| 341346/371472 [4:59:36<2:08:52,  3.90it/s]
 92%|█████████▏| 341347/371472 [4:59:36<2:08:09,  3.92it/s]
 92%|█████████▏| 341348/371472 [4:59:37<2:17:12,  3.66it/s]
 92%|█████████▏| 341349/371472 [4:59:37<2:26:15,  3.43it/s]
 92%|█████████▏| 341350/371472 [4:59:37<2:24:06,  3.48it/s]
 92%|█████████▏| 341351/371472 [4:59:38<2:20:20,  3.58it/s]
 92%|█████████▏| 341352/371472 [4:59:38<2:18:34,  3.62it/s]
 92%|█████████▏| 341353/371472 [4:59:38<2:15:44,  3.70it/s]
 92%|█████████▏| 341354/371472 [4:59:38<2:38:03,  3.18it/s]
 92%|█████████▏| 341355/371472 [4:59:39<2:32:48,  3.28it/s]
 92%|█████████▏| 341356/371472 [4:59:39<2:25:07,  3.46it/s]
 92%|█████████▏| 341357/371472 [4:59:39<2:19:31,  3.60it/s]
 92%|█████████▏| 341358/371472 [4:59:40<2:18:35,  3.62it/s]
 92%|█████████▏| 341359/371472 [4:59:40<2:16:48,  3.67it/s]
 92%|█████████▏| 341360/371472 [4:59:40<2:18:33,  3.62it/s]
                                                           
{'loss': 2.5258, 'learning_rate': 1.7299446228102303e-07, 'epoch': 14.7}

 92%|█████████▏| 341360/371472 [4:59:40<2:18:33,  3.62it/s]
 92%|█████████▏| 341361/371472 [4:59:40<2:22:15,  3.53it/s]
 92%|█████████▏| 341362/371472 [4:59:41<2:41:14,  3.11it/s]
 92%|█████████▏| 341363/371472 [4:59:41<2:40:42,  3.12it/s]
 92%|█████████▏| 341364/371472 [4:59:41<2:33:27,  3.27it/s]
 92%|█████████▏| 341365/371472 [4:59:42<2:35:25,  3.23it/s]
 92%|█████████▏| 341366/371472 [4:59:42<2:31:07,  3.32it/s]
 92%|█████████▏| 341367/371472 [4:59:42<2:24:15,  3.48it/s]
 92%|█████████▏| 341368/371472 [4:59:43<2:26:54,  3.42it/s]
 92%|█████████▏| 341369/371472 [4:59:43<2:24:10,  3.48it/s]
 92%|█████████▏| 341370/371472 [4:59:43<2:20:56,  3.56it/s]
 92%|█████████▏| 341371/371472 [4:59:43<2:15:41,  3.70it/s]
 92%|█████████▏| 341372/371472 [4:59:44<2:10:36,  3.84it/s]
 92%|█████████▏| 341373/371472 [4:59:44<2:11:14,  3.82it/s]
 92%|█████████▏| 341374/371472 [4:59:44<2:12:43,  3.78it/s]
 92%|█████████▏| 341375/371472 [4:59:44<2:11:16,  3.82it/s]
 92%|█████████▏| 341376/371472 [4:59:45<2:12:13,  3.79it/s]
 92%|█████████▏| 341377/371472 [4:59:45<2:12:04,  3.80it/s]
 92%|█████████▏| 341378/371472 [4:59:45<2:10:52,  3.83it/s]
 92%|█████████▏| 341379/371472 [4:59:45<2:20:10,  3.58it/s]
 92%|█████████▏| 341380/371472 [4:59:46<2:20:30,  3.57it/s]
                                                           
{'loss': 2.5802, 'learning_rate': 1.729459803055442e-07, 'epoch': 14.7}

 92%|█████████▏| 341380/371472 [4:59:46<2:20:30,  3.57it/s]
 92%|█████████▏| 341381/371472 [4:59:46<2:41:35,  3.10it/s]
 92%|█████████▏| 341382/371472 [4:59:46<2:31:38,  3.31it/s]
 92%|█████████▏| 341383/371472 [4:59:47<2:28:54,  3.37it/s]
 92%|█████████▏| 341384/371472 [4:59:47<2:30:34,  3.33it/s]
 92%|█████████▏| 341385/371472 [4:59:47<2:28:26,  3.38it/s]
 92%|█████████▏| 341386/371472 [4:59:48<2:27:25,  3.40it/s]
 92%|█████████▏| 341387/371472 [4:59:48<2:20:22,  3.57it/s]
 92%|█████████▏| 341388/371472 [4:59:48<2:28:44,  3.37it/s]
 92%|█████████▏| 341389/371472 [4:59:48<2:34:27,  3.25it/s]
 92%|█████████▏| 341390/371472 [4:59:49<2:33:20,  3.27it/s]
 92%|█████████▏| 341391/371472 [4:59:49<2:24:44,  3.46it/s]
 92%|█████████▏| 341392/371472 [4:59:49<2:32:12,  3.29it/s]
 92%|█████████▏| 341393/371472 [4:59:50<2:29:49,  3.35it/s]
 92%|█████████▏| 341394/371472 [4:59:50<2:28:58,  3.36it/s]
 92%|█████████▏| 341395/371472 [4:59:50<2:28:45,  3.37it/s]
 92%|█████████▏| 341396/371472 [4:59:50<2:20:48,  3.56it/s]
 92%|█████████▏| 341397/371472 [4:59:51<2:20:32,  3.57it/s]
 92%|█████████▏| 341398/371472 [4:59:51<2:20:04,  3.58it/s]
 92%|█████████▏| 341399/371472 [4:59:51<2:20:40,  3.56it/s]
 92%|█████████▏| 341400/371472 [4:59:52<2:23:09,  3.50it/s]
                                                           
{'loss': 2.6789, 'learning_rate': 1.7289749833006523e-07, 'epoch': 14.7}

 92%|█████████▏| 341400/371472 [4:59:52<2:23:09,  3.50it/s]
 92%|█████████▏| 341401/371472 [4:59:52<2:33:27,  3.27it/s]
 92%|█████████▏| 341402/371472 [4:59:52<2:37:54,  3.17it/s]
 92%|█████████▏| 341403/371472 [4:59:53<2:39:19,  3.15it/s]
 92%|█████████▏| 341404/371472 [4:59:53<2:56:37,  2.84it/s]
 92%|█████████▏| 341405/371472 [4:59:53<2:49:08,  2.96it/s]
 92%|█████████▏| 341406/371472 [4:59:54<2:37:09,  3.19it/s]
 92%|█████████▏| 341407/371472 [4:59:54<2:29:48,  3.34it/s]
 92%|█████████▏| 341408/371472 [4:59:54<2:23:53,  3.48it/s]
 92%|█████████▏| 341409/371472 [4:59:54<2:20:31,  3.57it/s]
 92%|█████████▏| 341410/371472 [4:59:55<2:20:55,  3.56it/s]
 92%|█████████▏| 341411/371472 [4:59:55<2:15:24,  3.70it/s]
 92%|█████████▏| 341412/371472 [4:59:55<2:15:25,  3.70it/s]
 92%|█████████▏| 341413/371472 [4:59:56<2:15:15,  3.70it/s]
 92%|█████████▏| 341414/371472 [4:59:56<2:12:47,  3.77it/s]
 92%|█████████▏| 341415/371472 [4:59:56<2:28:24,  3.38it/s]
 92%|█████████▏| 341416/371472 [4:59:56<2:25:33,  3.44it/s]
 92%|█████████▏| 341417/371472 [4:59:57<2:31:34,  3.30it/s]
 92%|█████████▏| 341418/371472 [4:59:57<2:25:18,  3.45it/s]
 92%|█████████▏| 341419/371472 [4:59:57<2:34:43,  3.24it/s]
 92%|█████████▏| 341420/371472 [4:59:58<2:32:28,  3.29it/s]
                                                           
{'loss': 2.5746, 'learning_rate': 1.728490163545864e-07, 'epoch': 14.71}

 92%|█████████▏| 341420/371472 [4:59:58<2:32:28,  3.29it/s]
 92%|█████████▏| 341421/371472 [4:59:58<2:25:52,  3.43it/s]
 92%|█████████▏| 341422/371472 [4:59:58<2:19:55,  3.58it/s]
 92%|█████████▏| 341423/371472 [4:59:58<2:24:44,  3.46it/s]
 92%|█████████▏| 341424/371472 [4:59:59<2:23:13,  3.50it/s]
 92%|█████████▏| 341425/371472 [4:59:59<2:19:02,  3.60it/s]
 92%|█████████▏| 341426/371472 [4:59:59<2:15:39,  3.69it/s]
 92%|█████████▏| 341427/371472 [5:00:00<2:15:06,  3.71it/s]
 92%|█████████▏| 341428/371472 [5:00:00<2:38:14,  3.16it/s]
 92%|█████████▏| 341429/371472 [5:00:00<2:40:27,  3.12it/s]
 92%|█████████▏| 341430/371472 [5:00:01<2:31:31,  3.30it/s]
 92%|█████████▏| 341431/371472 [5:00:01<2:24:04,  3.48it/s]
 92%|█████████▏| 341432/371472 [5:00:01<2:19:37,  3.59it/s]
 92%|█████████▏| 341433/371472 [5:00:01<2:22:12,  3.52it/s]
 92%|█████████▏| 341434/371472 [5:00:02<2:29:26,  3.35it/s]
 92%|█████████▏| 341435/371472 [5:00:02<2:34:04,  3.25it/s]
 92%|█████████▏| 341436/371472 [5:00:02<2:38:55,  3.15it/s]
 92%|█████████▏| 341437/371472 [5:00:03<2:35:03,  3.23it/s]
 92%|█████████▏| 341438/371472 [5:00:03<2:39:05,  3.15it/s]
 92%|█████████▏| 341439/371472 [5:00:03<2:31:52,  3.30it/s]
 92%|█████████▏| 341440/371472 [5:00:04<2:31:35,  3.30it/s]
                                                           
{'loss': 2.5274, 'learning_rate': 1.728005343791075e-07, 'epoch': 14.71}

 92%|█████████▏| 341440/371472 [5:00:04<2:31:35,  3.30it/s]
 92%|█████████▏| 341441/371472 [5:00:04<2:27:06,  3.40it/s]
 92%|█████████▏| 341442/371472 [5:00:04<2:21:42,  3.53it/s]
 92%|█████████▏| 341443/371472 [5:00:04<2:19:40,  3.58it/s]
 92%|█████████▏| 341444/371472 [5:00:05<2:18:10,  3.62it/s]
 92%|█████████▏| 341445/371472 [5:00:05<2:24:36,  3.46it/s]
 92%|█████████▏| 341446/371472 [5:00:05<2:19:07,  3.60it/s]
 92%|█████████▏| 341447/371472 [5:00:05<2:15:13,  3.70it/s]
 92%|█████████▏| 341448/371472 [5:00:06<2:19:08,  3.60it/s]
 92%|█████████▏| 341449/371472 [5:00:06<2:27:38,  3.39it/s]
 92%|█████████▏| 341450/371472 [5:00:06<2:23:22,  3.49it/s]
 92%|█████████▏| 341451/371472 [5:00:07<2:24:06,  3.47it/s]
 92%|█████████▏| 341452/371472 [5:00:07<2:23:19,  3.49it/s]
 92%|█████████▏| 341453/371472 [5:00:07<2:19:43,  3.58it/s]
 92%|█████████▏| 341454/371472 [5:00:07<2:20:38,  3.56it/s]
 92%|█████████▏| 341455/371472 [5:00:08<2:29:05,  3.36it/s]
 92%|█████████▏| 341456/371472 [5:00:08<2:38:27,  3.16it/s]
 92%|█████████▏| 341457/371472 [5:00:08<2:32:29,  3.28it/s]
 92%|█████████▏| 341458/371472 [5:00:09<2:27:58,  3.38it/s]
 92%|█████████▏| 341459/371472 [5:00:09<2:23:40,  3.48it/s]
 92%|█████████▏| 341460/371472 [5:00:09<2:32:27,  3.28it/s]
                                                           
{'loss': 2.6513, 'learning_rate': 1.727520524036286e-07, 'epoch': 14.71}

 92%|█████████▏| 341460/371472 [5:00:09<2:32:27,  3.28it/s]
 92%|█████████▏| 341461/371472 [5:00:10<2:33:31,  3.26it/s]
 92%|█████████▏| 341462/371472 [5:00:10<2:26:41,  3.41it/s]
 92%|█████████▏| 341463/371472 [5:00:10<2:23:34,  3.48it/s]
 92%|█████████▏| 341464/371472 [5:00:10<2:21:49,  3.53it/s]
 92%|█████████▏| 341465/371472 [5:00:11<2:19:56,  3.57it/s]
 92%|█████████▏| 341466/371472 [5:00:11<2:19:57,  3.57it/s]
 92%|█████████▏| 341467/371472 [5:00:11<2:16:42,  3.66it/s]
 92%|█████████▏| 341468/371472 [5:00:12<2:17:42,  3.63it/s]
 92%|█████████▏| 341469/371472 [5:00:12<2:23:18,  3.49it/s]
 92%|█████████▏| 341470/371472 [5:00:12<2:20:13,  3.57it/s]
 92%|█████████▏| 341471/371472 [5:00:12<2:19:02,  3.60it/s]
 92%|█████████▏| 341472/371472 [5:00:13<2:16:35,  3.66it/s]
 92%|█████████▏| 341473/371472 [5:00:13<2:16:40,  3.66it/s]
 92%|█████████▏| 341474/371472 [5:00:13<2:25:19,  3.44it/s]
 92%|█████████▏| 341475/371472 [5:00:14<2:24:36,  3.46it/s]
 92%|█████████▏| 341476/371472 [5:00:14<2:20:02,  3.57it/s]
 92%|█████████▏| 341477/371472 [5:00:14<2:18:36,  3.61it/s]
 92%|█████████▏| 341478/371472 [5:00:14<2:21:05,  3.54it/s]
 92%|█████████▏| 341479/371472 [5:00:15<2:29:24,  3.35it/s]
 92%|█████████▏| 341480/371472 [5:00:15<2:29:10,  3.35it/s]
                                                           
{'loss': 2.4518, 'learning_rate': 1.7270357042814968e-07, 'epoch': 14.71}

 92%|█████████▏| 341480/371472 [5:00:15<2:29:10,  3.35it/s]
 92%|█████████▏| 341481/371472 [5:00:15<2:22:11,  3.52it/s]
 92%|█████████▏| 341482/371472 [5:00:16<2:20:37,  3.55it/s]
 92%|█████████▏| 341483/371472 [5:00:16<2:24:10,  3.47it/s]
 92%|█████████▏| 341484/371472 [5:00:16<2:31:54,  3.29it/s]
 92%|█████████▏| 341485/371472 [5:00:17<2:37:07,  3.18it/s]
 92%|█████████▏| 341486/371472 [5:00:17<2:29:49,  3.34it/s]
 92%|█████████▏| 341487/371472 [5:00:17<2:26:04,  3.42it/s]
 92%|█████████▏| 341488/371472 [5:00:17<2:22:29,  3.51it/s]
 92%|█████████▏| 341489/371472 [5:00:18<2:30:06,  3.33it/s]
 92%|█████████▏| 341490/371472 [5:00:18<2:22:52,  3.50it/s]
 92%|█████████▏| 341491/371472 [5:00:18<2:20:48,  3.55it/s]
 92%|█████████▏| 341492/371472 [5:00:18<2:16:57,  3.65it/s]
 92%|█████████▏| 341493/371472 [5:00:19<2:19:35,  3.58it/s]
 92%|█████████▏| 341494/371472 [5:00:19<2:14:48,  3.71it/s]
 92%|█████████▏| 341495/371472 [5:00:19<2:26:10,  3.42it/s]
 92%|█████████▏| 341496/371472 [5:00:20<2:25:21,  3.44it/s]
 92%|█████████▏| 341497/371472 [5:00:20<2:20:25,  3.56it/s]
 92%|█████████▏| 341498/371472 [5:00:20<2:16:39,  3.66it/s]
 92%|█████████▏| 341499/371472 [5:00:20<2:24:36,  3.45it/s]
 92%|█████████▏| 341500/371472 [5:00:21<2:27:07,  3.40it/s]
                                                           
{'loss': 2.741, 'learning_rate': 1.7265508845267085e-07, 'epoch': 14.71}

 92%|█████████▏| 341500/371472 [5:00:21<2:27:07,  3.40it/s]
 92%|█████████▏| 341501/371472 [5:00:21<2:29:54,  3.33it/s]
 92%|█████████▏| 341502/371472 [5:00:21<2:25:34,  3.43it/s]
 92%|█████████▏| 341503/371472 [5:00:22<2:36:02,  3.20it/s]
 92%|█████████▏| 341504/371472 [5:00:22<2:28:58,  3.35it/s]
 92%|█████████▏| 341505/371472 [5:00:22<2:25:39,  3.43it/s]
 92%|█████████▏| 341506/371472 [5:00:23<2:27:53,  3.38it/s]
 92%|█████████▏| 341507/371472 [5:00:23<2:25:45,  3.43it/s]
 92%|█████████▏| 341508/371472 [5:00:23<2:24:30,  3.46it/s]
 92%|█████████▏| 341509/371472 [5:00:23<2:24:11,  3.46it/s]
 92%|█████████▏| 341510/371472 [5:00:24<2:23:38,  3.48it/s]
 92%|█████████▏| 341511/371472 [5:00:24<2:26:59,  3.40it/s]
 92%|█████████▏| 341512/371472 [5:00:24<2:24:56,  3.45it/s]
 92%|█████████▏| 341513/371472 [5:00:25<2:35:17,  3.22it/s]
 92%|█████████▏| 341514/371472 [5:00:25<2:28:43,  3.36it/s]
 92%|█████████▏| 341515/371472 [5:00:25<2:28:36,  3.36it/s]
 92%|█████████▏| 341516/371472 [5:00:25<2:22:48,  3.50it/s]
 92%|█████████▏| 341517/371472 [5:00:26<2:18:41,  3.60it/s]
 92%|█████████▏| 341518/371472 [5:00:26<2:16:59,  3.64it/s]
 92%|█████████▏| 341519/371472 [5:00:26<2:18:25,  3.61it/s]
 92%|█████████▏| 341520/371472 [5:00:27<2:19:43,  3.57it/s]
                                                           
{'loss': 2.4868, 'learning_rate': 1.726066064771919e-07, 'epoch': 14.71}

 92%|█████████▏| 341520/371472 [5:00:27<2:19:43,  3.57it/s]
 92%|█████████▏| 341521/371472 [5:00:27<2:28:16,  3.37it/s]
 92%|█████████▏| 341522/371472 [5:00:27<2:24:59,  3.44it/s]
 92%|█████████▏| 341523/371472 [5:00:27<2:21:24,  3.53it/s]
 92%|█████████▏| 341524/371472 [5:00:28<2:21:36,  3.52it/s]
 92%|█████████▏| 341525/371472 [5:00:28<2:20:45,  3.55it/s]
 92%|█████████▏| 341526/371472 [5:00:28<2:26:31,  3.41it/s]
 92%|█████████▏| 341527/371472 [5:00:29<2:20:04,  3.56it/s]
 92%|█████████▏| 341528/371472 [5:00:29<2:22:21,  3.51it/s]
 92%|█████████▏| 341529/371472 [5:00:29<2:18:35,  3.60it/s]
 92%|█████████▏| 341530/371472 [5:00:29<2:13:14,  3.75it/s]
 92%|█████████▏| 341531/371472 [5:00:30<2:12:03,  3.78it/s]
 92%|█████████▏| 341532/371472 [5:00:30<2:14:46,  3.70it/s]
 92%|█████████▏| 341533/371472 [5:00:30<2:13:23,  3.74it/s]
 92%|█████████▏| 341534/371472 [5:00:30<2:14:39,  3.71it/s]
 92%|█████████▏| 341535/371472 [5:00:31<2:21:03,  3.54it/s]
 92%|█████████▏| 341536/371472 [5:00:31<2:21:39,  3.52it/s]
 92%|█████████▏| 341537/371472 [5:00:31<2:32:47,  3.27it/s]
 92%|█████████▏| 341538/371472 [5:00:32<2:23:52,  3.47it/s]
 92%|█████████▏| 341539/371472 [5:00:32<2:22:55,  3.49it/s]
 92%|█████████▏| 341540/371472 [5:00:32<2:19:39,  3.57it/s]
                                                           
{'loss': 2.5749, 'learning_rate': 1.7255812450171305e-07, 'epoch': 14.71}

 92%|█████████▏| 341540/371472 [5:00:32<2:19:39,  3.57it/s]
 92%|█████████▏| 341541/371472 [5:00:33<2:30:54,  3.31it/s]
 92%|█████████▏| 341542/371472 [5:00:33<2:24:00,  3.46it/s]
 92%|█████████▏| 341543/371472 [5:00:33<2:39:40,  3.12it/s]
 92%|█████████▏| 341544/371472 [5:00:33<2:36:58,  3.18it/s]
 92%|█████████▏| 341545/371472 [5:00:34<2:26:14,  3.41it/s]
 92%|█████████▏| 341546/371472 [5:00:34<2:23:20,  3.48it/s]
 92%|█████████▏| 341547/371472 [5:00:35<2:57:29,  2.81it/s]
 92%|█████████▏| 341548/371472 [5:00:35<2:45:35,  3.01it/s]
 92%|█████████▏| 341549/371472 [5:00:35<2:36:49,  3.18it/s]
 92%|█████████▏| 341550/371472 [5:00:35<2:29:49,  3.33it/s]
 92%|█████████▏| 341551/371472 [5:00:36<2:24:40,  3.45it/s]
 92%|█████████▏| 341552/371472 [5:00:36<2:16:28,  3.65it/s]
 92%|█████████▏| 341553/371472 [5:00:36<2:18:34,  3.60it/s]
 92%|█████████▏| 341554/371472 [5:00:36<2:14:42,  3.70it/s]
 92%|█████████▏| 341555/371472 [5:00:37<2:12:40,  3.76it/s]
 92%|█████████▏| 341556/371472 [5:00:37<2:22:12,  3.51it/s]
 92%|█████████▏| 341557/371472 [5:00:37<2:18:13,  3.61it/s]
 92%|█████████▏| 341558/371472 [5:00:38<2:19:27,  3.58it/s]
 92%|█████████▏| 341559/371472 [5:00:38<2:22:12,  3.51it/s]
 92%|█████████▏| 341560/371472 [5:00:38<2:17:20,  3.63it/s]
                                                           
{'loss': 2.5644, 'learning_rate': 1.7250964252623412e-07, 'epoch': 14.71}

 92%|█████████▏| 341560/371472 [5:00:38<2:17:20,  3.63it/s]
 92%|█████████▏| 341561/371472 [5:00:38<2:17:52,  3.62it/s]
 92%|█████████▏| 341562/371472 [5:00:39<2:33:24,  3.25it/s]
 92%|█████████▏| 341563/371472 [5:00:39<2:27:48,  3.37it/s]
 92%|█████████▏| 341564/371472 [5:00:39<2:38:48,  3.14it/s]
 92%|█████████▏| 341565/371472 [5:00:40<2:32:10,  3.28it/s]
 92%|█████████▏| 341566/371472 [5:00:40<2:29:52,  3.33it/s]
 92%|█████████▏| 341567/371472 [5:00:40<2:24:24,  3.45it/s]
 92%|█████████▏| 341568/371472 [5:00:41<2:35:07,  3.21it/s]
 92%|█████████▏| 341569/371472 [5:00:41<2:34:14,  3.23it/s]
 92%|█████████▏| 341570/371472 [5:00:41<2:27:30,  3.38it/s]
 92%|█████████▏| 341571/371472 [5:00:41<2:23:14,  3.48it/s]
 92%|█████████▏| 341572/371472 [5:00:42<2:18:37,  3.59it/s]
 92%|█████████▏| 341573/371472 [5:00:42<2:14:34,  3.70it/s]
 92%|█████████▏| 341574/371472 [5:00:42<2:17:00,  3.64it/s]
 92%|█████████▏| 341575/371472 [5:00:43<2:30:56,  3.30it/s]
 92%|█████████▏| 341576/371472 [5:00:43<2:24:09,  3.46it/s]
 92%|█████████▏| 341577/371472 [5:00:43<2:25:04,  3.43it/s]
 92%|█████████▏| 341578/371472 [5:00:43<2:18:28,  3.60it/s]
 92%|█████████▏| 341579/371472 [5:00:44<2:15:34,  3.67it/s]
 92%|█████████▏| 341580/371472 [5:00:44<2:19:51,  3.56it/s]
                                                           
{'loss': 2.471, 'learning_rate': 1.7246116055075527e-07, 'epoch': 14.71}

 92%|█████████▏| 341580/371472 [5:00:44<2:19:51,  3.56it/s]
 92%|█████████▏| 341581/371472 [5:00:44<2:18:27,  3.60it/s]
 92%|█████████▏| 341582/371472 [5:00:44<2:17:33,  3.62it/s]
 92%|█████████▏| 341583/371472 [5:00:45<2:12:16,  3.77it/s]
 92%|█████████▏| 341584/371472 [5:00:45<2:15:36,  3.67it/s]
 92%|█████████▏| 341585/371472 [5:00:45<2:18:16,  3.60it/s]
 92%|█████████▏| 341586/371472 [5:00:46<2:29:22,  3.33it/s]
 92%|█████████▏| 341587/371472 [5:00:46<2:41:59,  3.07it/s]
 92%|█████████▏| 341588/371472 [5:00:46<2:33:32,  3.24it/s]
 92%|█████████▏| 341589/371472 [5:00:47<2:27:34,  3.37it/s]
 92%|█████████▏| 341590/371472 [5:00:47<2:27:08,  3.38it/s]
 92%|█████████▏| 341591/371472 [5:00:47<2:24:51,  3.44it/s]
 92%|█████████▏| 341592/371472 [5:00:47<2:19:31,  3.57it/s]
 92%|█████████▏| 341593/371472 [5:00:48<2:16:48,  3.64it/s]
 92%|█████████▏| 341594/371472 [5:00:48<2:16:16,  3.65it/s]
 92%|█████████▏| 341595/371472 [5:00:48<2:22:11,  3.50it/s]
 92%|█████████▏| 341596/371472 [5:00:49<2:32:45,  3.26it/s]
 92%|█████████▏| 341597/371472 [5:00:49<2:22:11,  3.50it/s]
 92%|█████████▏| 341598/371472 [5:00:49<2:19:15,  3.58it/s]
 92%|█████████▏| 341599/371472 [5:00:49<2:19:06,  3.58it/s]
 92%|█████████▏| 341600/371472 [5:00:50<2:24:21,  3.45it/s]
                                                           
{'loss': 2.4756, 'learning_rate': 1.7241267857527632e-07, 'epoch': 14.71}

 92%|█████████▏| 341600/371472 [5:00:50<2:24:21,  3.45it/s]
 92%|█████████▏| 341601/371472 [5:00:50<2:19:00,  3.58it/s]
 92%|█████████▏| 341602/371472 [5:00:50<2:19:11,  3.58it/s]
 92%|█████████▏| 341603/371472 [5:00:50<2:13:58,  3.72it/s]
 92%|█████████▏| 341604/371472 [5:00:51<2:11:08,  3.80it/s]
 92%|█████████▏| 341605/371472 [5:00:51<2:10:37,  3.81it/s]
 92%|█████████▏| 341606/371472 [5:00:51<2:11:12,  3.79it/s]
 92%|█████████▏| 341607/371472 [5:00:52<2:11:41,  3.78it/s]
 92%|█████████▏| 341608/371472 [5:00:52<2:11:43,  3.78it/s]
 92%|█████████▏| 341609/371472 [5:00:52<2:10:49,  3.80it/s]
 92%|█████████▏| 341610/371472 [5:00:52<2:17:17,  3.62it/s]
 92%|█████████▏| 341611/371472 [5:00:53<2:16:19,  3.65it/s]
 92%|█████████▏| 341612/371472 [5:00:53<2:18:07,  3.60it/s]
 92%|█████████▏| 341613/371472 [5:00:53<2:14:07,  3.71it/s]
 92%|█████████▏| 341614/371472 [5:00:53<2:14:40,  3.70it/s]
 92%|█████████▏| 341615/371472 [5:00:54<2:30:24,  3.31it/s]
 92%|█████████▏| 341616/371472 [5:00:54<2:32:46,  3.26it/s]
 92%|█████████▏| 341617/371472 [5:00:54<2:26:31,  3.40it/s]
 92%|█████████▏| 341618/371472 [5:00:55<2:21:47,  3.51it/s]
 92%|█████████▏| 341619/371472 [5:00:55<2:27:52,  3.36it/s]
 92%|█████████▏| 341620/371472 [5:00:55<2:34:17,  3.22it/s]
                                                           
{'loss': 2.7564, 'learning_rate': 1.723641965997975e-07, 'epoch': 14.71}

 92%|█████████▏| 341620/371472 [5:00:55<2:34:17,  3.22it/s]
 92%|█████████▏| 341621/371472 [5:00:56<2:35:44,  3.19it/s]
 92%|█████████▏| 341622/371472 [5:00:56<2:34:21,  3.22it/s]
 92%|█████████▏| 341623/371472 [5:00:56<2:35:46,  3.19it/s]
 92%|█████████▏| 341624/371472 [5:00:57<2:30:07,  3.31it/s]
 92%|█████████▏| 341625/371472 [5:00:57<2:29:13,  3.33it/s]
 92%|█████████▏| 341626/371472 [5:00:57<2:25:54,  3.41it/s]
 92%|█████████▏| 341627/371472 [5:00:57<2:21:43,  3.51it/s]
 92%|█████████▏| 341628/371472 [5:00:58<2:18:18,  3.60it/s]
 92%|█████████▏| 341629/371472 [5:00:58<2:15:43,  3.66it/s]
 92%|█████████▏| 341630/371472 [5:00:58<2:16:13,  3.65it/s]
 92%|█████████▏| 341631/371472 [5:00:58<2:12:25,  3.76it/s]
 92%|█████████▏| 341632/371472 [5:00:59<2:13:24,  3.73it/s]
 92%|█████████▏| 341633/371472 [5:00:59<2:17:21,  3.62it/s]
 92%|█████████▏| 341634/371472 [5:00:59<2:27:38,  3.37it/s]
 92%|█████████▏| 341635/371472 [5:01:00<2:23:17,  3.47it/s]
 92%|█████████▏| 341636/371472 [5:01:00<2:20:34,  3.54it/s]
 92%|█████████▏| 341637/371472 [5:01:00<2:17:35,  3.61it/s]
 92%|█████████▏| 341638/371472 [5:01:01<2:35:56,  3.19it/s]
 92%|█████████▏| 341639/371472 [5:01:01<2:33:23,  3.24it/s]
 92%|█████████▏| 341640/371472 [5:01:01<2:31:46,  3.28it/s]
                                                           
{'loss': 2.5753, 'learning_rate': 1.7231571462431854e-07, 'epoch': 14.72}

 92%|█████████▏| 341640/371472 [5:01:01<2:31:46,  3.28it/s]
 92%|█████████▏| 341641/371472 [5:01:01<2:26:41,  3.39it/s]
 92%|█████████▏| 341642/371472 [5:01:02<2:33:49,  3.23it/s]
 92%|█████████▏| 341643/371472 [5:01:02<2:25:34,  3.42it/s]
 92%|█████████▏| 341644/371472 [5:01:02<2:29:38,  3.32it/s]
 92%|█████████▏| 341645/371472 [5:01:03<2:29:25,  3.33it/s]
 92%|█████████▏| 341646/371472 [5:01:03<2:27:55,  3.36it/s]
 92%|█████████▏| 341647/371472 [5:01:03<2:22:29,  3.49it/s]
 92%|█████████▏| 341648/371472 [5:01:03<2:20:06,  3.55it/s]
 92%|█████████▏| 341649/371472 [5:01:04<2:21:36,  3.51it/s]
 92%|█████████▏| 341650/371472 [5:01:04<2:31:56,  3.27it/s]
 92%|█████████▏| 341651/371472 [5:01:04<2:25:00,  3.43it/s]
 92%|█████████▏| 341652/371472 [5:01:05<2:23:44,  3.46it/s]
 92%|█████████▏| 341653/371472 [5:01:05<2:22:00,  3.50it/s]
 92%|█████████▏| 341654/371472 [5:01:05<2:19:02,  3.57it/s]
 92%|█████████▏| 341655/371472 [5:01:05<2:23:07,  3.47it/s]
 92%|█████████▏| 341656/371472 [5:01:06<2:22:24,  3.49it/s]
 92%|█████████▏| 341657/371472 [5:01:06<2:23:21,  3.47it/s]
 92%|█████████▏| 341658/371472 [5:01:06<2:29:45,  3.32it/s]
 92%|█████████▏| 341659/371472 [5:01:07<2:27:03,  3.38it/s]
 92%|█████████▏| 341660/371472 [5:01:07<2:23:12,  3.47it/s]
                                                           
{'loss': 2.4489, 'learning_rate': 1.722672326488397e-07, 'epoch': 14.72}

 92%|█████████▏| 341660/371472 [5:01:07<2:23:12,  3.47it/s]
 92%|█████████▏| 341661/371472 [5:01:07<2:18:24,  3.59it/s]
 92%|█████████▏| 341662/371472 [5:01:07<2:15:44,  3.66it/s]
 92%|█████████▏| 341663/371472 [5:01:08<2:18:09,  3.60it/s]
 92%|█████████▏| 341664/371472 [5:01:08<2:31:36,  3.28it/s]
 92%|█████████▏| 341665/371472 [5:01:08<2:23:45,  3.46it/s]
 92%|█████████▏| 341666/371472 [5:01:09<2:22:12,  3.49it/s]
 92%|█████████▏| 341667/371472 [5:01:09<2:29:35,  3.32it/s]
 92%|█████████▏| 341668/371472 [5:01:09<2:23:00,  3.47it/s]
 92%|█████████▏| 341669/371472 [5:01:10<2:28:15,  3.35it/s]
 92%|█████████▏| 341670/371472 [5:01:10<2:23:23,  3.46it/s]
 92%|█████████▏| 341671/371472 [5:01:10<2:34:49,  3.21it/s]
 92%|█████████▏| 341672/371472 [5:01:11<2:40:20,  3.10it/s]
 92%|█████████▏| 341673/371472 [5:01:11<2:31:00,  3.29it/s]
 92%|█████████▏| 341674/371472 [5:01:11<2:27:28,  3.37it/s]
 92%|█████████▏| 341675/371472 [5:01:11<2:29:32,  3.32it/s]
 92%|█████████▏| 341676/371472 [5:01:12<2:25:44,  3.41it/s]
 92%|█████████▏| 341677/371472 [5:01:12<2:23:21,  3.46it/s]
 92%|█████████▏| 341678/371472 [5:01:12<2:18:36,  3.58it/s]
 92%|█████████▏| 341679/371472 [5:01:12<2:15:14,  3.67it/s]
 92%|█████████▏| 341680/371472 [5:01:13<2:19:00,  3.57it/s]
                                                           
{'loss': 2.5379, 'learning_rate': 1.7221875067336076e-07, 'epoch': 14.72}

 92%|█████████▏| 341680/371472 [5:01:13<2:19:00,  3.57it/s]
 92%|█████████▏| 341681/371472 [5:01:13<2:22:00,  3.50it/s]
 92%|█████████▏| 341682/371472 [5:01:13<2:24:13,  3.44it/s]
 92%|█████████▏| 341683/371472 [5:01:14<2:27:27,  3.37it/s]
 92%|█████████▏| 341684/371472 [5:01:14<2:24:47,  3.43it/s]
 92%|█████████▏| 341685/371472 [5:01:14<2:21:56,  3.50it/s]
 92%|█████████▏| 341686/371472 [5:01:15<2:30:22,  3.30it/s]
 92%|█████████▏| 341687/371472 [5:01:15<2:29:04,  3.33it/s]
 92%|█████████▏| 341688/371472 [5:01:15<2:25:41,  3.41it/s]
 92%|█████████▏| 341689/371472 [5:01:15<2:24:17,  3.44it/s]
 92%|█████████▏| 341690/371472 [5:01:16<2:24:51,  3.43it/s]
 92%|█████████▏| 341691/371472 [5:01:16<2:19:10,  3.57it/s]
 92%|█████████▏| 341692/371472 [5:01:16<2:20:50,  3.52it/s]
 92%|█████████▏| 341693/371472 [5:01:17<2:25:51,  3.40it/s]
 92%|█████████▏| 341694/371472 [5:01:17<2:46:08,  2.99it/s]
 92%|█████████▏| 341695/371472 [5:01:17<2:33:34,  3.23it/s]
 92%|█████████▏| 341696/371472 [5:01:18<2:30:37,  3.29it/s]
 92%|█████████▏| 341697/371472 [5:01:18<2:24:14,  3.44it/s]
 92%|█████████▏| 341698/371472 [5:01:18<2:27:08,  3.37it/s]
 92%|█████████▏| 341699/371472 [5:01:18<2:28:13,  3.35it/s]
 92%|█████████▏| 341700/371472 [5:01:19<2:29:17,  3.32it/s]
                                                           
{'loss': 2.5592, 'learning_rate': 1.7217026869788189e-07, 'epoch': 14.72}

 92%|█████████▏| 341700/371472 [5:01:19<2:29:17,  3.32it/s]
 92%|█████████▏| 341701/371472 [5:01:19<2:20:08,  3.54it/s]
 92%|█████████▏| 341702/371472 [5:01:19<2:28:35,  3.34it/s]
 92%|█████████▏| 341703/371472 [5:01:20<2:21:24,  3.51it/s]
 92%|█████████▏| 341704/371472 [5:01:20<2:22:19,  3.49it/s]
 92%|█████████▏| 341705/371472 [5:01:20<2:18:09,  3.59it/s]
 92%|█████████▏| 341706/371472 [5:01:20<2:16:26,  3.64it/s]
 92%|█████████▏| 341707/371472 [5:01:21<2:13:03,  3.73it/s]
 92%|█████████▏| 341708/371472 [5:01:21<2:11:52,  3.76it/s]
 92%|█████████▏| 341709/371472 [5:01:21<2:17:19,  3.61it/s]
 92%|█████████▏| 341710/371472 [5:01:21<2:16:09,  3.64it/s]
 92%|█████████▏| 341711/371472 [5:01:22<2:14:39,  3.68it/s]
 92%|█████████▏| 341712/371472 [5:01:22<2:33:57,  3.22it/s]
 92%|█████████▏| 341713/371472 [5:01:22<2:25:33,  3.41it/s]
 92%|█████████▏| 341714/371472 [5:01:23<2:17:22,  3.61it/s]
 92%|█████████▏| 341715/371472 [5:01:23<2:21:53,  3.50it/s]
 92%|█████████▏| 341716/371472 [5:01:23<2:24:40,  3.43it/s]
 92%|█████████▏| 341717/371472 [5:01:24<2:25:41,  3.40it/s]
 92%|█████████▏| 341718/371472 [5:01:24<2:25:54,  3.40it/s]
 92%|█████████▏| 341719/371472 [5:01:24<2:24:30,  3.43it/s]
 92%|█████████▏| 341720/371472 [5:01:24<2:30:15,  3.30it/s]
                                                           
{'loss': 2.4912, 'learning_rate': 1.7212178672240296e-07, 'epoch': 14.72}

 92%|█████████▏| 341720/371472 [5:01:24<2:30:15,  3.30it/s]
 92%|█████████▏| 341721/371472 [5:01:25<2:32:38,  3.25it/s]
 92%|█████████▏| 341722/371472 [5:01:25<2:30:46,  3.29it/s]
 92%|█████████▏| 341723/371472 [5:01:25<2:24:31,  3.43it/s]
 92%|█████████▏| 341724/371472 [5:01:26<2:27:02,  3.37it/s]
 92%|█████████▏| 341725/371472 [5:01:26<2:33:32,  3.23it/s]
 92%|█████████▏| 341726/371472 [5:01:26<2:32:15,  3.26it/s]
 92%|█████████▏| 341727/371472 [5:01:27<2:33:56,  3.22it/s]
 92%|█████████▏| 341728/371472 [5:01:27<2:29:03,  3.33it/s]
 92%|█████████▏| 341729/371472 [5:01:27<2:27:27,  3.36it/s]
 92%|█████████▏| 341730/371472 [5:01:27<2:26:55,  3.37it/s]
 92%|█████████▏| 341731/371472 [5:01:28<2:37:32,  3.15it/s]
 92%|█████████▏| 341732/371472 [5:01:28<2:39:26,  3.11it/s]
 92%|█████████▏| 341733/371472 [5:01:28<2:29:17,  3.32it/s]
 92%|█████████▏| 341734/371472 [5:01:29<2:22:33,  3.48it/s]
 92%|█████████▏| 341735/371472 [5:01:29<2:17:36,  3.60it/s]
 92%|█████████▏| 341736/371472 [5:01:29<2:26:30,  3.38it/s]
 92%|█████████▏| 341737/371472 [5:01:29<2:20:38,  3.52it/s]
 92%|█████████▏| 341738/371472 [5:01:30<2:26:36,  3.38it/s]
 92%|█████████▏| 341739/371472 [5:01:30<2:21:32,  3.50it/s]
 92%|█████████▏| 341740/371472 [5:01:30<2:28:36,  3.33it/s]
                                                           
{'loss': 2.5286, 'learning_rate': 1.7207330474692403e-07, 'epoch': 14.72}

 92%|█████████▏| 341740/371472 [5:01:30<2:28:36,  3.33it/s]
 92%|█████████▏| 341741/371472 [5:01:31<2:22:51,  3.47it/s]
 92%|█████████▏| 341742/371472 [5:01:31<2:16:32,  3.63it/s]
 92%|█████████▏| 341743/371472 [5:01:31<2:21:43,  3.50it/s]
 92%|█████████▏| 341744/371472 [5:01:32<2:25:05,  3.41it/s]
 92%|█████████▏| 341745/371472 [5:01:32<2:19:12,  3.56it/s]
 92%|█████████▏| 341746/371472 [5:01:32<2:17:42,  3.60it/s]
 92%|█████████▏| 341747/371472 [5:01:32<2:17:04,  3.61it/s]
 92%|█████████▏| 341748/371472 [5:01:33<2:24:00,  3.44it/s]
 92%|█████████▏| 341749/371472 [5:01:33<2:28:16,  3.34it/s]
 92%|█████████▏| 341750/371472 [5:01:33<2:25:29,  3.40it/s]
 92%|█████████▏| 341751/371472 [5:01:34<2:26:58,  3.37it/s]
 92%|█████████▏| 341752/371472 [5:01:34<2:22:14,  3.48it/s]
 92%|█████████▏| 341753/371472 [5:01:34<2:19:37,  3.55it/s]
 92%|█████████▏| 341754/371472 [5:01:34<2:22:24,  3.48it/s]
 92%|█████████▏| 341755/371472 [5:01:35<2:18:46,  3.57it/s]
 92%|█████████▏| 341756/371472 [5:01:35<2:15:52,  3.65it/s]
 92%|█████████▏| 341757/371472 [5:01:35<2:19:11,  3.56it/s]
 92%|█████████▏| 341758/371472 [5:01:35<2:18:42,  3.57it/s]
 92%|█████████▏| 341759/371472 [5:01:36<2:19:47,  3.54it/s]
 92%|█████████▏| 341760/371472 [5:01:36<2:18:33,  3.57it/s]
                                                           
{'loss': 2.6536, 'learning_rate': 1.720248227714452e-07, 'epoch': 14.72}

 92%|█████████▏| 341760/371472 [5:01:36<2:18:33,  3.57it/s]
 92%|█████████▏| 341761/371472 [5:01:36<2:30:13,  3.30it/s]
 92%|█████████▏| 341762/371472 [5:01:37<2:21:46,  3.49it/s]
 92%|█████████▏| 341763/371472 [5:01:37<2:21:05,  3.51it/s]
 92%|█████████▏| 341764/371472 [5:01:37<2:18:19,  3.58it/s]
 92%|█████████▏| 341765/371472 [5:01:38<2:25:07,  3.41it/s]
 92%|█████████▏| 341766/371472 [5:01:38<2:17:19,  3.61it/s]
 92%|█████████▏| 341767/371472 [5:01:38<2:16:46,  3.62it/s]
 92%|█████████▏| 341768/371472 [5:01:38<2:20:15,  3.53it/s]
 92%|█████████▏| 341769/371472 [5:01:39<2:28:27,  3.33it/s]
 92%|█████████▏| 341770/371472 [5:01:39<2:25:08,  3.41it/s]
 92%|█████████▏| 341771/371472 [5:01:39<2:20:11,  3.53it/s]
 92%|█████████▏| 341772/371472 [5:01:40<2:22:24,  3.48it/s]
 92%|█████████▏| 341773/371472 [5:01:40<2:17:09,  3.61it/s]
 92%|█████████▏| 341774/371472 [5:01:40<2:15:38,  3.65it/s]
 92%|█████████▏| 341775/371472 [5:01:40<2:23:17,  3.45it/s]
 92%|█████████▏| 341776/371472 [5:01:41<2:19:15,  3.55it/s]
 92%|█████████▏| 341777/371472 [5:01:41<2:16:05,  3.64it/s]
 92%|█████████▏| 341778/371472 [5:01:41<2:17:23,  3.60it/s]
 92%|█████████▏| 341779/371472 [5:01:41<2:15:34,  3.65it/s]
 92%|█████████▏| 341780/371472 [5:01:42<2:11:51,  3.75it/s]
                                                           
{'loss': 2.5995, 'learning_rate': 1.7197634079596625e-07, 'epoch': 14.72}

 92%|█████████▏| 341780/371472 [5:01:42<2:11:51,  3.75it/s]
 92%|█████████▏| 341781/371472 [5:01:42<2:19:18,  3.55it/s]
 92%|█████████▏| 341782/371472 [5:01:42<2:14:04,  3.69it/s]
 92%|█████████▏| 341783/371472 [5:01:43<2:22:47,  3.47it/s]
 92%|█████████▏| 341784/371472 [5:01:43<2:21:27,  3.50it/s]
 92%|█████████▏| 341785/371472 [5:01:43<2:19:46,  3.54it/s]
 92%|█████████▏| 341786/371472 [5:01:43<2:14:12,  3.69it/s]
 92%|█████████▏| 341787/371472 [5:01:44<2:14:14,  3.69it/s]
 92%|█████████▏| 341788/371472 [5:01:44<2:12:25,  3.74it/s]
 92%|█████████▏| 341789/371472 [5:01:44<2:09:08,  3.83it/s]
 92%|█████████▏| 341790/371472 [5:01:44<2:18:54,  3.56it/s]
 92%|█████████▏| 341791/371472 [5:01:45<2:19:36,  3.54it/s]
 92%|█████████▏| 341792/371472 [5:01:45<2:16:42,  3.62it/s]
 92%|█████████▏| 341793/371472 [5:01:45<2:21:40,  3.49it/s]
 92%|█████████▏| 341794/371472 [5:01:46<2:19:48,  3.54it/s]
 92%|█████████▏| 341795/371472 [5:01:46<2:20:35,  3.52it/s]
 92%|█████████▏| 341796/371472 [5:01:46<2:20:37,  3.52it/s]
 92%|█████████▏| 341797/371472 [5:01:47<2:26:44,  3.37it/s]
 92%|█████████▏| 341798/371472 [5:01:47<2:26:24,  3.38it/s]
 92%|█████████▏| 341799/371472 [5:01:47<2:20:24,  3.52it/s]
 92%|█████████▏| 341800/371472 [5:01:47<2:20:14,  3.53it/s]
                                                           
{'loss': 2.5196, 'learning_rate': 1.719278588204874e-07, 'epoch': 14.72}

 92%|█████████▏| 341800/371472 [5:01:47<2:20:14,  3.53it/s]
 92%|█████████▏| 341801/371472 [5:01:48<2:24:22,  3.43it/s]
 92%|█████████▏| 341802/371472 [5:01:48<2:20:26,  3.52it/s]
 92%|█████████▏| 341803/371472 [5:01:48<2:17:36,  3.59it/s]
 92%|█████████▏| 341804/371472 [5:01:48<2:13:38,  3.70it/s]
 92%|█████████▏| 341805/371472 [5:01:49<2:17:04,  3.61it/s]
 92%|█████████▏| 341806/371472 [5:01:49<2:20:37,  3.52it/s]
 92%|█████████▏| 341807/371472 [5:01:49<2:21:50,  3.49it/s]
 92%|█████████▏| 341808/371472 [5:01:50<2:24:06,  3.43it/s]
 92%|█████████▏| 341809/371472 [5:01:50<2:16:58,  3.61it/s]
 92%|█████████▏| 341810/371472 [5:01:50<2:19:14,  3.55it/s]
 92%|█████████▏| 341811/371472 [5:01:50<2:16:22,  3.63it/s]
 92%|█████████▏| 341812/371472 [5:01:51<2:26:01,  3.39it/s]
 92%|█████████▏| 341813/371472 [5:01:51<2:38:55,  3.11it/s]
 92%|█████████▏| 341814/371472 [5:01:51<2:31:41,  3.26it/s]
 92%|█████████▏| 341815/371472 [5:01:52<2:26:14,  3.38it/s]
 92%|█████████▏| 341816/371472 [5:01:52<2:31:57,  3.25it/s]
 92%|█████████▏| 341817/371472 [5:01:52<2:31:50,  3.26it/s]
 92%|█████████▏| 341818/371472 [5:01:53<2:24:17,  3.43it/s]
 92%|█████████▏| 341819/371472 [5:01:53<2:22:23,  3.47it/s]
 92%|█████████▏| 341820/371472 [5:01:53<2:22:19,  3.47it/s]
                                                           
{'loss': 2.5159, 'learning_rate': 1.7187937684500847e-07, 'epoch': 14.72}

 92%|█████████▏| 341820/371472 [5:01:53<2:22:19,  3.47it/s]
 92%|█████████▏| 341821/371472 [5:01:53<2:20:12,  3.52it/s]
 92%|█████████▏| 341822/371472 [5:01:54<2:17:34,  3.59it/s]
 92%|█████████▏| 341823/371472 [5:01:54<2:19:16,  3.55it/s]
 92%|█████████▏| 341824/371472 [5:01:54<2:14:48,  3.67it/s]
 92%|█████████▏| 341825/371472 [5:01:55<2:24:20,  3.42it/s]
 92%|█████████▏| 341826/371472 [5:01:55<2:20:01,  3.53it/s]
 92%|█████████▏| 341827/371472 [5:01:55<2:14:41,  3.67it/s]
 92%|█████████▏| 341828/371472 [5:01:55<2:10:31,  3.79it/s]
 92%|█████████▏| 341829/371472 [5:01:56<2:08:55,  3.83it/s]
 92%|█████████▏| 341830/371472 [5:01:56<2:11:22,  3.76it/s]
 92%|█████████▏| 341831/371472 [5:01:56<2:14:45,  3.67it/s]
 92%|█████████▏| 341832/371472 [5:01:56<2:18:54,  3.56it/s]
 92%|█████████▏| 341833/371472 [5:01:57<2:20:11,  3.52it/s]
 92%|█████████▏| 341834/371472 [5:01:57<2:18:57,  3.55it/s]
 92%|█████████▏| 341835/371472 [5:01:57<2:14:43,  3.67it/s]
 92%|█████████▏| 341836/371472 [5:01:58<2:18:08,  3.58it/s]
 92%|█████████▏| 341837/371472 [5:01:58<2:17:44,  3.59it/s]
 92%|█████████▏| 341838/371472 [5:01:58<2:20:16,  3.52it/s]
 92%|█████████▏| 341839/371472 [5:01:58<2:24:39,  3.41it/s]
 92%|█████████▏| 341840/371472 [5:01:59<2:28:48,  3.32it/s]
                                                           
{'loss': 2.5153, 'learning_rate': 1.7183089486952962e-07, 'epoch': 14.72}

 92%|█████████▏| 341840/371472 [5:01:59<2:28:48,  3.32it/s]
 92%|█████████▏| 341841/371472 [5:01:59<2:28:51,  3.32it/s]
 92%|█████████▏| 341842/371472 [5:01:59<2:22:16,  3.47it/s]
 92%|█████████▏| 341843/371472 [5:02:00<2:16:20,  3.62it/s]
 92%|█████████▏| 341844/371472 [5:02:00<2:24:18,  3.42it/s]
 92%|█████████▏| 341845/371472 [5:02:00<2:31:50,  3.25it/s]
 92%|█████████▏| 341846/371472 [5:02:01<2:33:48,  3.21it/s]
 92%|█████████▏| 341847/371472 [5:02:01<2:25:35,  3.39it/s]
 92%|█████████▏| 341848/371472 [5:02:01<2:22:36,  3.46it/s]
 92%|█████████▏| 341849/371472 [5:02:01<2:18:41,  3.56it/s]
 92%|█████████▏| 341850/371472 [5:02:02<2:13:20,  3.70it/s]
 92%|█████████▏| 341851/371472 [5:02:02<2:14:47,  3.66it/s]
 92%|█████████▏| 341852/371472 [5:02:02<2:14:09,  3.68it/s]
 92%|█████████▏| 341853/371472 [5:02:02<2:22:54,  3.45it/s]
 92%|█████████▏| 341854/371472 [5:02:03<2:25:04,  3.40it/s]
 92%|█████████▏| 341855/371472 [5:02:03<2:20:46,  3.51it/s]
 92%|█████████▏| 341856/371472 [5:02:03<2:18:51,  3.55it/s]
 92%|█████████▏| 341857/371472 [5:02:04<2:29:20,  3.30it/s]
 92%|█████████▏| 341858/371472 [5:02:04<2:42:54,  3.03it/s]
 92%|█████████▏| 341859/371472 [5:02:04<2:36:32,  3.15it/s]
 92%|█████████▏| 341860/371472 [5:02:05<2:40:33,  3.07it/s]
                                                           
{'loss': 2.4343, 'learning_rate': 1.7178241289405067e-07, 'epoch': 14.72}

 92%|█████████▏| 341860/371472 [5:02:05<2:40:33,  3.07it/s]
 92%|█████████▏| 341861/371472 [5:02:05<2:31:27,  3.26it/s]
 92%|█████████▏| 341862/371472 [5:02:05<2:36:53,  3.15it/s]
 92%|█████████▏| 341863/371472 [5:02:06<2:31:40,  3.25it/s]
 92%|█████████▏| 341864/371472 [5:02:06<2:30:50,  3.27it/s]
 92%|█████████▏| 341865/371472 [5:02:06<2:38:11,  3.12it/s]
 92%|█████████▏| 341866/371472 [5:02:07<2:27:06,  3.35it/s]
 92%|█████████▏| 341867/371472 [5:02:07<2:22:47,  3.46it/s]
 92%|█████████▏| 341868/371472 [5:02:07<2:25:11,  3.40it/s]
 92%|█████████▏| 341869/371472 [5:02:07<2:24:18,  3.42it/s]
 92%|█████████▏| 341870/371472 [5:02:08<2:19:06,  3.55it/s]
 92%|█████████▏| 341871/371472 [5:02:08<2:16:31,  3.61it/s]
 92%|█████████▏| 341872/371472 [5:02:08<2:12:33,  3.72it/s]
 92%|█████████▏| 341873/371472 [5:02:08<2:10:42,  3.77it/s]
 92%|█████████▏| 341874/371472 [5:02:09<2:13:02,  3.71it/s]
 92%|█████████▏| 341875/371472 [5:02:09<2:12:20,  3.73it/s]
 92%|█████████▏| 341876/371472 [5:02:09<2:22:44,  3.46it/s]
 92%|█████████▏| 341877/371472 [5:02:10<2:28:20,  3.33it/s]
 92%|█████████▏| 341878/371472 [5:02:10<2:26:25,  3.37it/s]
 92%|█████████▏| 341879/371472 [5:02:10<2:20:24,  3.51it/s]
 92%|█████████▏| 341880/371472 [5:02:10<2:14:09,  3.68it/s]
                                                           
{'loss': 2.5033, 'learning_rate': 1.7173393091857185e-07, 'epoch': 14.73}

 92%|█████████▏| 341880/371472 [5:02:10<2:14:09,  3.68it/s]
 92%|█████████▏| 341881/371472 [5:02:11<2:11:22,  3.75it/s]
 92%|█████████▏| 341882/371472 [5:02:11<2:15:58,  3.63it/s]
 92%|█████████▏| 341883/371472 [5:02:11<2:14:16,  3.67it/s]
 92%|█████████▏| 341884/371472 [5:02:11<2:13:21,  3.70it/s]
 92%|█████████▏| 341885/371472 [5:02:12<2:08:41,  3.83it/s]
 92%|█████████▏| 341886/371472 [5:02:12<2:13:02,  3.71it/s]
 92%|█████████▏| 341887/371472 [5:02:12<2:16:39,  3.61it/s]
 92%|█████████▏| 341888/371472 [5:02:13<2:14:17,  3.67it/s]
 92%|█████████▏| 341889/371472 [5:02:13<2:13:25,  3.70it/s]
 92%|█████████▏| 341890/371472 [5:02:13<2:09:36,  3.80it/s]
 92%|█████████▏| 341891/371472 [5:02:13<2:13:40,  3.69it/s]
 92%|█████████▏| 341892/371472 [5:02:14<2:16:38,  3.61it/s]
 92%|█████████▏| 341893/371472 [5:02:14<2:23:02,  3.45it/s]
 92%|█████████▏| 341894/371472 [5:02:14<2:17:48,  3.58it/s]
 92%|█████████▏| 341895/371472 [5:02:15<2:17:42,  3.58it/s]
 92%|█████████▏| 341896/371472 [5:02:15<2:21:21,  3.49it/s]
 92%|█████████▏| 341897/371472 [5:02:15<2:24:23,  3.41it/s]
 92%|█████████▏| 341898/371472 [5:02:16<2:44:46,  2.99it/s]
 92%|█████████▏| 341899/371472 [5:02:16<2:50:43,  2.89it/s]
 92%|█████████▏| 341900/371472 [5:02:16<2:41:13,  3.06it/s]
                                                           
{'loss': 2.571, 'learning_rate': 1.716854489430929e-07, 'epoch': 14.73}

 92%|█████████▏| 341900/371472 [5:02:16<2:41:13,  3.06it/s]
 92%|█████████▏| 341901/371472 [5:02:16<2:33:36,  3.21it/s]
 92%|█████████▏| 341902/371472 [5:02:17<2:24:24,  3.41it/s]
 92%|█████████▏| 341903/371472 [5:02:17<2:17:16,  3.59it/s]
 92%|█████████▏| 341904/371472 [5:02:17<2:16:13,  3.62it/s]
 92%|█████████▏| 341905/371472 [5:02:17<2:12:01,  3.73it/s]
 92%|█████████▏| 341906/371472 [5:02:18<2:11:00,  3.76it/s]
 92%|█████████▏| 341907/371472 [5:02:18<2:15:01,  3.65it/s]
 92%|█████████▏| 341908/371472 [5:02:18<2:13:24,  3.69it/s]
 92%|█████████▏| 341909/371472 [5:02:19<2:13:33,  3.69it/s]
 92%|█████████▏| 341910/371472 [5:02:19<2:11:28,  3.75it/s]
 92%|█████████▏| 341911/371472 [5:02:19<2:15:05,  3.65it/s]
 92%|█████████▏| 341912/371472 [5:02:20<2:40:15,  3.07it/s]
 92%|█████████▏| 341913/371472 [5:02:20<2:53:42,  2.84it/s]
 92%|█████████▏| 341914/371472 [5:02:20<2:41:54,  3.04it/s]
 92%|█████████▏| 341915/371472 [5:02:21<2:38:16,  3.11it/s]
 92%|█████████▏| 341916/371472 [5:02:21<2:33:24,  3.21it/s]
 92%|█████████▏| 341917/371472 [5:02:21<2:55:45,  2.80it/s]
 92%|█████████▏| 341918/371472 [5:02:22<2:46:47,  2.95it/s]
 92%|█████████▏| 341919/371472 [5:02:22<2:34:18,  3.19it/s]
 92%|█████████▏| 341920/371472 [5:02:22<2:27:10,  3.35it/s]
                                                           
{'loss': 2.6179, 'learning_rate': 1.7163696696761404e-07, 'epoch': 14.73}

 92%|█████████▏| 341920/371472 [5:02:22<2:27:10,  3.35it/s]
 92%|█████████▏| 341921/371472 [5:02:22<2:30:15,  3.28it/s]
 92%|█████████▏| 341922/371472 [5:02:23<2:24:44,  3.40it/s]
 92%|█████████▏| 341923/371472 [5:02:23<2:25:09,  3.39it/s]
 92%|█████████▏| 341924/371472 [5:02:23<2:21:27,  3.48it/s]
 92%|█████████▏| 341925/371472 [5:02:24<2:17:11,  3.59it/s]
 92%|█████████▏| 341926/371472 [5:02:24<2:15:43,  3.63it/s]
 92%|█████████▏| 341927/371472 [5:02:24<2:18:24,  3.56it/s]
 92%|█████████▏| 341928/371472 [5:02:24<2:17:46,  3.57it/s]
 92%|█████████▏| 341929/371472 [5:02:25<2:21:56,  3.47it/s]
 92%|█████████▏| 341930/371472 [5:02:25<2:41:51,  3.04it/s]
 92%|█████████▏| 341931/371472 [5:02:25<2:32:54,  3.22it/s]
 92%|█████████▏| 341932/371472 [5:02:26<2:23:43,  3.43it/s]
 92%|█████████▏| 341933/371472 [5:02:26<2:27:28,  3.34it/s]
 92%|█████████▏| 341934/371472 [5:02:26<2:28:08,  3.32it/s]
 92%|█████████▏| 341935/371472 [5:02:27<2:25:11,  3.39it/s]
 92%|█████████▏| 341936/371472 [5:02:27<2:25:12,  3.39it/s]
 92%|█████████▏| 341937/371472 [5:02:27<2:19:34,  3.53it/s]
 92%|█████████▏| 341938/371472 [5:02:27<2:25:30,  3.38it/s]
 92%|█████████▏| 341939/371472 [5:02:28<2:18:01,  3.57it/s]
 92%|█████████▏| 341940/371472 [5:02:28<2:12:35,  3.71it/s]
                                                           
{'loss': 2.566, 'learning_rate': 1.7158848499213511e-07, 'epoch': 14.73}

 92%|█████████▏| 341940/371472 [5:02:28<2:12:35,  3.71it/s]
 92%|█████████▏| 341941/371472 [5:02:28<2:32:18,  3.23it/s]
 92%|█████████▏| 341942/371472 [5:02:29<2:30:47,  3.26it/s]
 92%|█████████▏| 341943/371472 [5:02:29<2:23:51,  3.42it/s]
 92%|█████████▏| 341944/371472 [5:02:29<2:30:51,  3.26it/s]
 92%|█████████▏| 341945/371472 [5:02:29<2:26:39,  3.36it/s]
 92%|█████████▏| 341946/371472 [5:02:30<2:33:07,  3.21it/s]
 92%|█████████▏| 341947/371472 [5:02:30<2:24:32,  3.40it/s]
 92%|█████████▏| 341948/371472 [5:02:30<2:22:39,  3.45it/s]
 92%|█████████▏| 341949/371472 [5:02:31<2:25:55,  3.37it/s]
 92%|█████████▏| 341950/371472 [5:02:31<2:21:58,  3.47it/s]
 92%|█████████▏| 341951/371472 [5:02:31<2:32:34,  3.22it/s]
 92%|█████████▏| 341952/371472 [5:02:32<2:28:30,  3.31it/s]
 92%|█████████▏| 341953/371472 [5:02:32<2:24:18,  3.41it/s]
 92%|█████████▏| 341954/371472 [5:02:32<2:26:14,  3.36it/s]
 92%|█████████▏| 341955/371472 [5:02:32<2:19:25,  3.53it/s]
 92%|█████████▏| 341956/371472 [5:02:33<2:18:53,  3.54it/s]
 92%|█████████▏| 341957/371472 [5:02:33<2:17:20,  3.58it/s]
 92%|█████████▏| 341958/371472 [5:02:33<2:14:50,  3.65it/s]
 92%|█████████▏| 341959/371472 [5:02:34<2:37:44,  3.12it/s]
 92%|█████████▏| 341960/371472 [5:02:34<2:29:43,  3.29it/s]
                                                           
{'loss': 2.538, 'learning_rate': 1.7154000301665626e-07, 'epoch': 14.73}

 92%|█████████▏| 341960/371472 [5:02:34<2:29:43,  3.29it/s]
 92%|█████████▏| 341961/371472 [5:02:34<2:31:28,  3.25it/s]
 92%|█████████▏| 341962/371472 [5:02:35<2:25:11,  3.39it/s]
 92%|█████████▏| 341963/371472 [5:02:35<2:19:51,  3.52it/s]
 92%|█████████▏| 341964/371472 [5:02:35<2:18:12,  3.56it/s]
 92%|█████████▏| 341965/371472 [5:02:35<2:12:13,  3.72it/s]
 92%|█████████▏| 341966/371472 [5:02:36<2:24:18,  3.41it/s]
 92%|█████████▏| 341967/371472 [5:02:36<2:24:46,  3.40it/s]
 92%|█████████▏| 341968/371472 [5:02:36<2:28:21,  3.31it/s]
 92%|█████████▏| 341969/371472 [5:02:37<2:32:52,  3.22it/s]
 92%|█████████▏| 341970/371472 [5:02:37<2:23:07,  3.44it/s]
 92%|█████████▏| 341971/371472 [5:02:37<2:30:46,  3.26it/s]
 92%|█████████▏| 341972/371472 [5:02:37<2:24:10,  3.41it/s]
 92%|█████████▏| 341973/371472 [5:02:38<2:18:57,  3.54it/s]
 92%|█████████▏| 341974/371472 [5:02:38<2:16:47,  3.59it/s]
 92%|█████████▏| 341975/371472 [5:02:38<2:14:38,  3.65it/s]
 92%|█████████▏| 341976/371472 [5:02:39<2:20:37,  3.50it/s]
 92%|█████████▏| 341977/371472 [5:02:39<2:17:38,  3.57it/s]
 92%|█████████▏| 341978/371472 [5:02:39<2:16:15,  3.61it/s]
 92%|█████████▏| 341979/371472 [5:02:39<2:15:44,  3.62it/s]
 92%|█████████▏| 341980/371472 [5:02:40<2:16:37,  3.60it/s]
                                                           
{'loss': 2.6944, 'learning_rate': 1.714915210411773e-07, 'epoch': 14.73}

 92%|█████████▏| 341980/371472 [5:02:40<2:16:37,  3.60it/s]
 92%|█████████▏| 341981/371472 [5:02:40<2:23:19,  3.43it/s]
 92%|█████████▏| 341982/371472 [5:02:40<2:25:24,  3.38it/s]
 92%|█████████▏| 341983/371472 [5:02:41<2:22:35,  3.45it/s]
 92%|█████████▏| 341984/371472 [5:02:41<2:26:41,  3.35it/s]
 92%|█████████▏| 341985/371472 [5:02:41<2:23:12,  3.43it/s]
 92%|█████████▏| 341986/371472 [5:02:41<2:22:27,  3.45it/s]
 92%|█████████▏| 341987/371472 [5:02:42<2:17:53,  3.56it/s]
 92%|█████████▏| 341988/371472 [5:02:42<2:14:39,  3.65it/s]
 92%|█████████▏| 341989/371472 [5:02:42<2:19:18,  3.53it/s]
 92%|█████████▏| 341990/371472 [5:02:43<2:23:43,  3.42it/s]
 92%|█████████▏| 341991/371472 [5:02:43<2:14:18,  3.66it/s]
 92%|█████████▏| 341992/371472 [5:02:43<2:12:40,  3.70it/s]
 92%|█████████▏| 341993/371472 [5:02:43<2:18:26,  3.55it/s]
 92%|█████████▏| 341994/371472 [5:02:44<2:12:22,  3.71it/s]
 92%|█████████▏| 341995/371472 [5:02:44<2:10:01,  3.78it/s]
 92%|█████████▏| 341996/371472 [5:02:44<2:11:27,  3.74it/s]
 92%|█████████▏| 341997/371472 [5:02:44<2:11:21,  3.74it/s]
 92%|█████████▏| 341998/371472 [5:02:45<2:13:26,  3.68it/s]
 92%|█████████▏| 341999/371472 [5:02:45<2:17:49,  3.56it/s]
 92%|█████████▏| 342000/371472 [5:02:45<2:13:03,  3.69it/s]
                                                           
{'loss': 2.6228, 'learning_rate': 1.714430390656985e-07, 'epoch': 14.73}

 92%|█████████▏| 342000/371472 [5:02:45<2:13:03,  3.69it/s]
 92%|█████████▏| 342001/371472 [5:02:46<2:18:21,  3.55it/s]
 92%|█████████▏| 342002/371472 [5:02:46<2:17:59,  3.56it/s]
 92%|█████████▏| 342003/371472 [5:02:46<2:18:06,  3.56it/s]
 92%|█████████▏| 342004/371472 [5:02:46<2:14:31,  3.65it/s]
 92%|█████████▏| 342005/371472 [5:02:47<2:14:53,  3.64it/s]
 92%|█████████▏| 342006/371472 [5:02:47<2:20:32,  3.49it/s]
 92%|█████████▏| 342007/371472 [5:02:47<2:20:25,  3.50it/s]
 92%|█████████▏| 342008/371472 [5:02:47<2:18:55,  3.53it/s]
 92%|█████████▏| 342009/371472 [5:02:48<2:28:23,  3.31it/s]
 92%|█████████▏| 342010/371472 [5:02:48<2:27:51,  3.32it/s]
 92%|█████████▏| 342011/371472 [5:02:48<2:20:44,  3.49it/s]
 92%|█████████▏| 342012/371472 [5:02:49<2:18:52,  3.54it/s]
 92%|█████████▏| 342013/371472 [5:02:49<2:20:16,  3.50it/s]
 92%|█████████▏| 342014/371472 [5:02:49<2:21:57,  3.46it/s]
 92%|█████████▏| 342015/371472 [5:02:50<2:21:59,  3.46it/s]
 92%|█████████▏| 342016/371472 [5:02:50<2:21:54,  3.46it/s]
 92%|█████████▏| 342017/371472 [5:02:50<2:16:05,  3.61it/s]
 92%|█████████▏| 342018/371472 [5:02:50<2:15:14,  3.63it/s]
 92%|█████████▏| 342019/371472 [5:02:51<2:17:07,  3.58it/s]
 92%|█████████▏| 342020/371472 [5:02:51<2:31:04,  3.25it/s]
                                                           
{'loss': 2.6103, 'learning_rate': 1.7139455709021953e-07, 'epoch': 14.73}

 92%|█████████▏| 342020/371472 [5:02:51<2:31:04,  3.25it/s]
 92%|█████████▏| 342021/371472 [5:02:51<2:31:38,  3.24it/s]
 92%|█████████▏| 342022/371472 [5:02:52<2:22:55,  3.43it/s]
 92%|█████████▏| 342023/371472 [5:02:52<2:19:08,  3.53it/s]
 92%|█████████▏| 342024/371472 [5:02:52<2:11:50,  3.72it/s]
 92%|█████████▏| 342025/371472 [5:02:52<2:13:44,  3.67it/s]
 92%|█████████▏| 342026/371472 [5:02:53<2:13:29,  3.68it/s]
 92%|█████████▏| 342027/371472 [5:02:53<2:15:47,  3.61it/s]
 92%|█████████▏| 342028/371472 [5:02:53<2:17:15,  3.58it/s]
 92%|█████████▏| 342029/371472 [5:02:53<2:19:38,  3.51it/s]
 92%|█████████▏| 342030/371472 [5:02:54<2:20:22,  3.50it/s]
 92%|█████████▏| 342031/371472 [5:02:54<2:19:01,  3.53it/s]
 92%|█████████▏| 342032/371472 [5:02:54<2:15:39,  3.62it/s]
 92%|█████████▏| 342033/371472 [5:02:55<2:15:12,  3.63it/s]
 92%|█████████▏| 342034/371472 [5:02:55<2:31:06,  3.25it/s]
 92%|█████████▏| 342035/371472 [5:02:55<2:29:56,  3.27it/s]
 92%|█████████▏| 342036/371472 [5:02:56<2:24:07,  3.40it/s]
 92%|█████████▏| 342037/371472 [5:02:56<2:20:16,  3.50it/s]
 92%|█████████▏| 342038/371472 [5:02:56<2:17:57,  3.56it/s]
 92%|█████████▏| 342039/371472 [5:02:56<2:17:23,  3.57it/s]
 92%|█████████▏| 342040/371472 [5:02:57<2:14:11,  3.66it/s]
                                                           
{'loss': 2.6205, 'learning_rate': 1.7134607511474068e-07, 'epoch': 14.73}

 92%|█████████▏| 342040/371472 [5:02:57<2:14:11,  3.66it/s]
 92%|█████████▏| 342041/371472 [5:02:57<2:26:04,  3.36it/s]
 92%|█████████▏| 342042/371472 [5:02:57<2:24:30,  3.39it/s]
 92%|█████████▏| 342043/371472 [5:02:58<2:25:33,  3.37it/s]
 92%|█████████▏| 342044/371472 [5:02:58<2:28:01,  3.31it/s]
 92%|█████████▏| 342045/371472 [5:02:58<2:30:29,  3.26it/s]
 92%|█████████▏| 342046/371472 [5:02:58<2:25:47,  3.36it/s]
 92%|█████████▏| 342047/371472 [5:02:59<2:18:39,  3.54it/s]
 92%|█████████▏| 342048/371472 [5:02:59<2:23:45,  3.41it/s]
 92%|█████████▏| 342049/371472 [5:02:59<2:21:38,  3.46it/s]
 92%|█████████▏| 342050/371472 [5:03:00<2:19:02,  3.53it/s]
 92%|█████████▏| 342051/371472 [5:03:00<2:25:01,  3.38it/s]
 92%|█████████▏| 342052/371472 [5:03:00<2:21:02,  3.48it/s]
 92%|█████████▏| 342053/371472 [5:03:00<2:15:06,  3.63it/s]
 92%|█████████▏| 342054/371472 [5:03:01<2:19:30,  3.51it/s]
 92%|█████████▏| 342055/371472 [5:03:01<2:22:45,  3.43it/s]
 92%|█████████▏| 342056/371472 [5:03:01<2:20:26,  3.49it/s]
 92%|█████████▏| 342057/371472 [5:03:02<2:17:09,  3.57it/s]
 92%|█████████▏| 342058/371472 [5:03:02<2:18:13,  3.55it/s]
 92%|█████████▏| 342059/371472 [5:03:02<2:31:10,  3.24it/s]
 92%|█████████▏| 342060/371472 [5:03:03<2:26:43,  3.34it/s]
                                                           
{'loss': 2.68, 'learning_rate': 1.7129759313926175e-07, 'epoch': 14.73}

 92%|█████████▏| 342060/371472 [5:03:03<2:26:43,  3.34it/s]
 92%|█████████▏| 342061/371472 [5:03:03<2:24:53,  3.38it/s]
 92%|█████████▏| 342062/371472 [5:03:03<2:23:03,  3.43it/s]
 92%|█████████▏| 342063/371472 [5:03:03<2:21:07,  3.47it/s]
 92%|█████████▏| 342064/371472 [5:03:04<2:16:36,  3.59it/s]
 92%|█████████▏| 342065/371472 [5:03:04<2:15:28,  3.62it/s]
 92%|█████████▏| 342066/371472 [5:03:04<2:21:21,  3.47it/s]
 92%|█████████▏| 342067/371472 [5:03:04<2:20:04,  3.50it/s]
 92%|█████████▏| 342068/371472 [5:03:05<2:32:07,  3.22it/s]
 92%|█████████▏| 342069/371472 [5:03:05<2:30:08,  3.26it/s]
 92%|█████████▏| 342070/371472 [5:03:05<2:30:13,  3.26it/s]
 92%|█████████▏| 342071/371472 [5:03:06<2:24:05,  3.40it/s]
 92%|█████████▏| 342072/371472 [5:03:06<2:25:22,  3.37it/s]
 92%|█████████▏| 342073/371472 [5:03:06<2:26:52,  3.34it/s]
 92%|█████████▏| 342074/371472 [5:03:07<2:30:03,  3.27it/s]
 92%|█████████▏| 342075/371472 [5:03:07<2:28:04,  3.31it/s]
 92%|█████████▏| 342076/371472 [5:03:07<2:23:09,  3.42it/s]
 92%|█████████▏| 342077/371472 [5:03:08<2:48:41,  2.90it/s]
 92%|█████████▏| 342078/371472 [5:03:08<2:36:43,  3.13it/s]
 92%|█████████▏| 342079/371472 [5:03:08<2:31:53,  3.23it/s]
 92%|█████████▏| 342080/371472 [5:03:09<2:34:06,  3.18it/s]
                                                           
{'loss': 2.6569, 'learning_rate': 1.712491111637829e-07, 'epoch': 14.73}

 92%|█████████▏| 342080/371472 [5:03:09<2:34:06,  3.18it/s]
 92%|█████████▏| 342081/371472 [5:03:09<2:29:52,  3.27it/s]
 92%|█████████▏| 342082/371472 [5:03:09<2:22:50,  3.43it/s]
 92%|█████████▏| 342083/371472 [5:03:09<2:28:27,  3.30it/s]
 92%|█████████▏| 342084/371472 [5:03:10<2:22:18,  3.44it/s]
 92%|█████████▏| 342085/371472 [5:03:10<2:24:27,  3.39it/s]
 92%|█████████▏| 342086/371472 [5:03:10<2:22:40,  3.43it/s]
 92%|█████████▏| 342087/371472 [5:03:11<2:15:28,  3.61it/s]
 92%|█████████▏| 342088/371472 [5:03:11<2:22:21,  3.44it/s]
 92%|█████████▏| 342089/371472 [5:03:11<2:22:41,  3.43it/s]
 92%|█████████▏| 342090/371472 [5:03:11<2:23:32,  3.41it/s]
 92%|█████████▏| 342091/371472 [5:03:12<2:22:20,  3.44it/s]
 92%|█████████▏| 342092/371472 [5:03:12<2:18:28,  3.54it/s]
 92%|█████████▏| 342093/371472 [5:03:12<2:15:03,  3.63it/s]
 92%|█████████▏| 342094/371472 [5:03:13<2:16:55,  3.58it/s]
 92%|█████████▏| 342095/371472 [5:03:13<2:15:50,  3.60it/s]
 92%|█████████▏| 342096/371472 [5:03:13<2:15:16,  3.62it/s]
 92%|█████████▏| 342097/371472 [5:03:13<2:17:49,  3.55it/s]
 92%|█████████▏| 342098/371472 [5:03:14<2:17:29,  3.56it/s]
 92%|█████████▏| 342099/371472 [5:03:14<2:12:48,  3.69it/s]
 92%|█████████▏| 342100/371472 [5:03:14<2:13:54,  3.66it/s]
                                                           
{'loss': 2.3767, 'learning_rate': 1.7120062918830395e-07, 'epoch': 14.73}

 92%|█████████▏| 342100/371472 [5:03:14<2:13:54,  3.66it/s]
 92%|█████████▏| 342101/371472 [5:03:14<2:18:34,  3.53it/s]
 92%|█████████▏| 342102/371472 [5:03:15<2:21:24,  3.46it/s]
 92%|█████████▏| 342103/371472 [5:03:15<2:27:20,  3.32it/s]
 92%|█████████▏| 342104/371472 [5:03:15<2:22:06,  3.44it/s]
 92%|█████████▏| 342105/371472 [5:03:16<2:19:45,  3.50it/s]
 92%|█████████▏| 342106/371472 [5:03:16<2:18:52,  3.52it/s]
 92%|█████████▏| 342107/371472 [5:03:16<2:24:41,  3.38it/s]
 92%|█████████▏| 342108/371472 [5:03:17<2:18:39,  3.53it/s]
 92%|█████████▏| 342109/371472 [5:03:17<2:15:37,  3.61it/s]
 92%|█████████▏| 342110/371472 [5:03:17<2:26:55,  3.33it/s]
 92%|█████████▏| 342111/371472 [5:03:17<2:21:35,  3.46it/s]
 92%|█████████▏| 342112/371472 [5:03:18<2:15:19,  3.62it/s]
 92%|█████████▏| 342113/371472 [5:03:18<2:15:18,  3.62it/s]
 92%|█████████▏| 342114/371472 [5:03:18<2:15:43,  3.61it/s]
 92%|█████████▏| 342115/371472 [5:03:18<2:19:36,  3.50it/s]
 92%|█████████▏| 342116/371472 [5:03:19<2:19:11,  3.51it/s]
 92%|█████████▏| 342117/371472 [5:03:19<2:19:22,  3.51it/s]
 92%|█████████▏| 342118/371472 [5:03:19<2:20:24,  3.48it/s]
 92%|█████████▏| 342119/371472 [5:03:20<2:20:47,  3.47it/s]
 92%|█████████▏| 342120/371472 [5:03:20<2:16:31,  3.58it/s]
                                                           
{'loss': 2.6719, 'learning_rate': 1.7115214721282513e-07, 'epoch': 14.74}

 92%|█████████▏| 342120/371472 [5:03:20<2:16:31,  3.58it/s]
 92%|█████████▏| 342121/371472 [5:03:20<2:18:09,  3.54it/s]
 92%|█████████▏| 342122/371472 [5:03:20<2:20:12,  3.49it/s]
 92%|█████████▏| 342123/371472 [5:03:21<2:20:55,  3.47it/s]
 92%|█████████▏| 342124/371472 [5:03:21<2:22:57,  3.42it/s]
 92%|█████████▏| 342125/371472 [5:03:21<2:23:30,  3.41it/s]
 92%|█████████▏| 342126/371472 [5:03:22<2:22:02,  3.44it/s]
 92%|█████████▏| 342127/371472 [5:03:22<2:24:52,  3.38it/s]
 92%|█████████▏| 342128/371472 [5:03:22<2:18:13,  3.54it/s]
 92%|█████████▏| 342129/371472 [5:03:23<2:17:20,  3.56it/s]
 92%|█████████▏| 342130/371472 [5:03:23<2:13:52,  3.65it/s]
 92%|█████████▏| 342131/371472 [5:03:23<2:12:58,  3.68it/s]
 92%|█████████▏| 342132/371472 [5:03:23<2:21:55,  3.45it/s]
 92%|█████████▏| 342133/371472 [5:03:24<2:16:30,  3.58it/s]
 92%|█████████▏| 342134/371472 [5:03:24<2:19:44,  3.50it/s]
 92%|█████████▏| 342135/371472 [5:03:24<2:14:36,  3.63it/s]
 92%|█████████▏| 342136/371472 [5:03:24<2:11:55,  3.71it/s]
 92%|█████████▏| 342137/371472 [5:03:25<2:27:55,  3.31it/s]
 92%|█████████▏| 342138/371472 [5:03:25<2:22:15,  3.44it/s]
 92%|█████████▏| 342139/371472 [5:03:25<2:22:05,  3.44it/s]
 92%|█████████▏| 342140/371472 [5:03:26<2:27:14,  3.32it/s]
                                                           
{'loss': 2.7518, 'learning_rate': 1.711036652373462e-07, 'epoch': 14.74}

 92%|█████████▏| 342140/371472 [5:03:26<2:27:14,  3.32it/s]
 92%|█████████▏| 342141/371472 [5:03:26<2:33:05,  3.19it/s]
 92%|█████████▏| 342142/371472 [5:03:26<2:52:51,  2.83it/s]
 92%|█████████▏| 342143/371472 [5:03:27<2:43:24,  2.99it/s]
 92%|█████████▏| 342144/371472 [5:03:27<2:37:44,  3.10it/s]
 92%|█████████▏| 342145/371472 [5:03:27<2:32:19,  3.21it/s]
 92%|█████████▏| 342146/371472 [5:03:28<2:28:52,  3.28it/s]
 92%|█████████▏| 342147/371472 [5:03:28<2:28:58,  3.28it/s]
 92%|█████████▏| 342148/371472 [5:03:28<2:25:35,  3.36it/s]
 92%|█████████▏| 342149/371472 [5:03:28<2:18:41,  3.52it/s]
 92%|█████████▏| 342150/371472 [5:03:29<2:21:53,  3.44it/s]
 92%|█████████▏| 342151/371472 [5:03:29<2:34:59,  3.15it/s]
 92%|█████████▏| 342152/371472 [5:03:29<2:28:08,  3.30it/s]
 92%|█████████▏| 342153/371472 [5:03:30<2:26:45,  3.33it/s]
 92%|█████████▏| 342154/371472 [5:03:30<2:22:22,  3.43it/s]
 92%|█████████▏| 342155/371472 [5:03:30<2:22:48,  3.42it/s]
 92%|█████████▏| 342156/371472 [5:03:31<2:33:41,  3.18it/s]
 92%|█████████▏| 342157/371472 [5:03:31<2:26:30,  3.33it/s]
 92%|█████████▏| 342158/371472 [5:03:31<2:36:46,  3.12it/s]
 92%|█████████▏| 342159/371472 [5:03:32<2:32:28,  3.20it/s]
 92%|█████████▏| 342160/371472 [5:03:32<2:28:01,  3.30it/s]
                                                           
{'loss': 2.6239, 'learning_rate': 1.7105518326186732e-07, 'epoch': 14.74}

 92%|█████████▏| 342160/371472 [5:03:32<2:28:01,  3.30it/s]
 92%|█████████▏| 342161/371472 [5:03:32<2:24:36,  3.38it/s]
 92%|█████████▏| 342162/371472 [5:03:32<2:25:31,  3.36it/s]
 92%|█████████▏| 342163/371472 [5:03:33<2:22:38,  3.42it/s]
 92%|█████████▏| 342164/371472 [5:03:33<2:22:24,  3.43it/s]
 92%|█████████▏| 342165/371472 [5:03:33<2:27:30,  3.31it/s]
 92%|█████████▏| 342166/371472 [5:03:34<2:20:35,  3.47it/s]
 92%|█████████▏| 342167/371472 [5:03:34<2:15:59,  3.59it/s]
 92%|█████████▏| 342168/371472 [5:03:34<2:12:47,  3.68it/s]
 92%|█████████▏| 342169/371472 [5:03:34<2:12:06,  3.70it/s]
 92%|█████████▏| 342170/371472 [5:03:35<2:08:30,  3.80it/s]
 92%|█████████▏| 342171/371472 [5:03:35<2:10:10,  3.75it/s]
 92%|█████████▏| 342172/371472 [5:03:35<2:12:01,  3.70it/s]
 92%|█████████▏| 342173/371472 [5:03:35<2:17:29,  3.55it/s]
 92%|█████████▏| 342174/371472 [5:03:36<2:14:08,  3.64it/s]
 92%|█████████▏| 342175/371472 [5:03:36<2:13:47,  3.65it/s]
 92%|█████████▏| 342176/371472 [5:03:36<2:19:39,  3.50it/s]
 92%|█████████▏| 342177/371472 [5:03:37<2:18:51,  3.52it/s]
 92%|█████████▏| 342178/371472 [5:03:37<2:23:30,  3.40it/s]
 92%|█████████▏| 342179/371472 [5:03:37<2:19:37,  3.50it/s]
 92%|█████████▏| 342180/371472 [5:03:37<2:14:14,  3.64it/s]
                                                           
{'loss': 2.6798, 'learning_rate': 1.710067012863884e-07, 'epoch': 14.74}

 92%|█████████▏| 342180/371472 [5:03:37<2:14:14,  3.64it/s]
 92%|█████████▏| 342181/371472 [5:03:38<2:15:05,  3.61it/s]
 92%|█████████▏| 342182/371472 [5:03:38<2:09:53,  3.76it/s]
 92%|█████████▏| 342183/371472 [5:03:38<2:10:05,  3.75it/s]
 92%|█████████▏| 342184/371472 [5:03:38<2:10:01,  3.75it/s]
 92%|█████████▏| 342185/371472 [5:03:39<2:11:49,  3.70it/s]
 92%|█████████▏| 342186/371472 [5:03:39<2:07:28,  3.83it/s]
 92%|█████████▏| 342187/371472 [5:03:39<2:13:18,  3.66it/s]
 92%|█████████▏| 342188/371472 [5:03:40<2:12:11,  3.69it/s]
 92%|█████████▏| 342189/371472 [5:03:40<2:12:40,  3.68it/s]
 92%|█████████▏| 342190/371472 [5:03:40<2:12:13,  3.69it/s]
 92%|█████████▏| 342191/371472 [5:03:40<2:09:02,  3.78it/s]
 92%|█████████▏| 342192/371472 [5:03:41<2:10:00,  3.75it/s]
 92%|█████████▏| 342193/371472 [5:03:41<2:12:00,  3.70it/s]
 92%|█████████▏| 342194/371472 [5:03:41<2:11:53,  3.70it/s]
 92%|█████████▏| 342195/371472 [5:03:41<2:08:42,  3.79it/s]
 92%|█████████▏| 342196/371472 [5:03:42<2:06:36,  3.85it/s]
 92%|█████████▏| 342197/371472 [5:03:42<2:07:25,  3.83it/s]
 92%|█████████▏| 342198/371472 [5:03:42<2:23:21,  3.40it/s]
 92%|█████████▏| 342199/371472 [5:03:43<2:30:13,  3.25it/s]
 92%|█████████▏| 342200/371472 [5:03:43<2:46:04,  2.94it/s]
                                                           
{'loss': 2.6244, 'learning_rate': 1.7095821931090957e-07, 'epoch': 14.74}

 92%|█████████▏| 342200/371472 [5:03:43<2:46:04,  2.94it/s]
 92%|█████████▏| 342201/371472 [5:03:43<2:35:08,  3.14it/s]
 92%|█████████▏| 342202/371472 [5:03:44<2:31:36,  3.22it/s]
 92%|█████████▏| 342203/371472 [5:03:44<2:29:24,  3.27it/s]
 92%|█████████▏| 342204/371472 [5:03:44<2:34:39,  3.15it/s]
 92%|█████████▏| 342205/371472 [5:03:45<2:35:04,  3.15it/s]
 92%|█████████▏| 342206/371472 [5:03:45<2:24:58,  3.36it/s]
 92%|█████████▏| 342207/371472 [5:03:45<2:21:04,  3.46it/s]
 92%|█████████▏| 342208/371472 [5:03:45<2:22:51,  3.41it/s]
 92%|█████████▏| 342209/371472 [5:03:46<2:37:38,  3.09it/s]
 92%|█████████▏| 342210/371472 [5:03:46<2:37:18,  3.10it/s]
 92%|█████████▏| 342211/371472 [5:03:46<2:41:53,  3.01it/s]
 92%|█████████▏| 342212/371472 [5:03:47<2:43:19,  2.99it/s]
 92%|█████████▏| 342213/371472 [5:03:47<2:37:54,  3.09it/s]
 92%|█████████▏| 342214/371472 [5:03:47<2:36:35,  3.11it/s]
 92%|█████████▏| 342215/371472 [5:03:48<2:35:46,  3.13it/s]
 92%|█████████▏| 342216/371472 [5:03:48<2:36:33,  3.11it/s]
 92%|█████████▏| 342217/371472 [5:03:48<2:26:51,  3.32it/s]
 92%|█████████▏| 342218/371472 [5:03:49<2:22:14,  3.43it/s]
 92%|█████████▏| 342219/371472 [5:03:49<2:20:22,  3.47it/s]
 92%|█████████▏| 342220/371472 [5:03:49<2:17:28,  3.55it/s]
                                                           
{'loss': 2.598, 'learning_rate': 1.7090973733543062e-07, 'epoch': 14.74}

 92%|█████████▏| 342220/371472 [5:03:49<2:17:28,  3.55it/s]
 92%|█████████▏| 342221/371472 [5:03:49<2:16:46,  3.56it/s]
 92%|█████████▏| 342222/371472 [5:03:50<2:15:29,  3.60it/s]
 92%|█████████▏| 342223/371472 [5:03:50<2:20:41,  3.46it/s]
 92%|█████████▏| 342224/371472 [5:03:50<2:21:49,  3.44it/s]
 92%|█████████▏| 342225/371472 [5:03:51<2:17:31,  3.54it/s]
 92%|█████████▏| 342226/371472 [5:03:51<2:17:28,  3.55it/s]
 92%|█████████▏| 342227/371472 [5:03:51<2:17:50,  3.54it/s]
 92%|█████████▏| 342228/371472 [5:03:51<2:16:29,  3.57it/s]
 92%|█████████▏| 342229/371472 [5:03:52<2:19:00,  3.51it/s]
 92%|█████████▏| 342230/371472 [5:03:52<2:24:25,  3.37it/s]
 92%|█████████▏| 342231/371472 [5:03:52<2:22:58,  3.41it/s]
 92%|█████████▏| 342232/371472 [5:03:53<2:19:23,  3.50it/s]
 92%|█████████▏| 342233/371472 [5:03:53<2:23:31,  3.40it/s]
 92%|█████████▏| 342234/371472 [5:03:53<2:22:48,  3.41it/s]
 92%|█████████▏| 342235/371472 [5:03:53<2:16:39,  3.57it/s]
 92%|█████████▏| 342236/371472 [5:03:54<2:20:51,  3.46it/s]
 92%|█████████▏| 342237/371472 [5:03:54<2:33:36,  3.17it/s]
 92%|█████████▏| 342238/371472 [5:03:54<2:25:37,  3.35it/s]
 92%|█████████▏| 342239/371472 [5:03:55<2:21:52,  3.43it/s]
 92%|█████████▏| 342240/371472 [5:03:55<2:20:08,  3.48it/s]
                                                           
{'loss': 2.5643, 'learning_rate': 1.7086125535995177e-07, 'epoch': 14.74}

 92%|█████████▏| 342240/371472 [5:03:55<2:20:08,  3.48it/s]
 92%|█████████▏| 342241/371472 [5:03:55<2:21:43,  3.44it/s]
 92%|█████████▏| 342242/371472 [5:03:56<2:18:17,  3.52it/s]
 92%|█████████▏| 342243/371472 [5:03:56<2:27:48,  3.30it/s]
 92%|█████████▏| 342244/371472 [5:03:56<2:27:56,  3.29it/s]
 92%|█████████▏| 342245/371472 [5:03:56<2:20:49,  3.46it/s]
 92%|█████████▏| 342246/371472 [5:03:57<2:26:14,  3.33it/s]
 92%|█████████▏| 342247/371472 [5:03:57<2:28:19,  3.28it/s]
 92%|█████████▏| 342248/371472 [5:03:57<2:23:13,  3.40it/s]
 92%|█████████▏| 342249/371472 [5:03:58<2:28:52,  3.27it/s]
 92%|█████████▏| 342250/371472 [5:03:58<2:26:37,  3.32it/s]
 92%|█████████▏| 342251/371472 [5:03:58<2:19:56,  3.48it/s]
 92%|█████████▏| 342252/371472 [5:03:58<2:15:22,  3.60it/s]
 92%|█████████▏| 342253/371472 [5:03:59<2:21:13,  3.45it/s]
 92%|█████████▏| 342254/371472 [5:03:59<2:19:05,  3.50it/s]
 92%|█████████▏| 342255/371472 [5:03:59<2:20:59,  3.45it/s]
 92%|█████████▏| 342256/371472 [5:04:00<2:27:51,  3.29it/s]
 92%|█████████▏| 342257/371472 [5:04:00<2:28:16,  3.28it/s]
 92%|█████████▏| 342258/371472 [5:04:00<2:21:31,  3.44it/s]
 92%|█████████▏| 342259/371472 [5:04:01<2:19:51,  3.48it/s]
 92%|█████████▏| 342260/371472 [5:04:01<2:25:05,  3.36it/s]
                                                           
{'loss': 2.6849, 'learning_rate': 1.7081277338447284e-07, 'epoch': 14.74}

 92%|█████████▏| 342260/371472 [5:04:01<2:25:05,  3.36it/s]
 92%|█████████▏| 342261/371472 [5:04:01<2:23:20,  3.40it/s]
 92%|█████████▏| 342262/371472 [5:04:01<2:23:44,  3.39it/s]
 92%|█████████▏| 342263/371472 [5:04:02<2:19:44,  3.48it/s]
 92%|█████████▏| 342264/371472 [5:04:02<2:21:42,  3.44it/s]
 92%|█████████▏| 342265/371472 [5:04:02<2:18:23,  3.52it/s]
 92%|█████████▏| 342266/371472 [5:04:03<2:19:22,  3.49it/s]
 92%|█████████▏| 342267/371472 [5:04:03<2:16:52,  3.56it/s]
 92%|█████████▏| 342268/371472 [5:04:03<2:17:07,  3.55it/s]
 92%|█████████▏| 342269/371472 [5:04:03<2:15:55,  3.58it/s]
 92%|█████████▏| 342270/371472 [5:04:04<2:18:52,  3.50it/s]
 92%|█████████▏| 342271/371472 [5:04:04<2:18:21,  3.52it/s]
 92%|█████████▏| 342272/371472 [5:04:04<2:17:25,  3.54it/s]
 92%|█████████▏| 342273/371472 [5:04:05<2:16:18,  3.57it/s]
 92%|█████████▏| 342274/371472 [5:04:05<2:24:05,  3.38it/s]
 92%|█████████▏| 342275/371472 [5:04:05<2:26:09,  3.33it/s]
 92%|█████████▏| 342276/371472 [5:04:05<2:19:52,  3.48it/s]
 92%|█████████▏| 342277/371472 [5:04:06<2:18:52,  3.50it/s]
 92%|█████████▏| 342278/371472 [5:04:06<2:28:34,  3.27it/s]
 92%|█████████▏| 342279/371472 [5:04:06<2:20:28,  3.46it/s]
 92%|█████████▏| 342280/371472 [5:04:07<2:29:57,  3.24it/s]
                                                           
{'loss': 2.5761, 'learning_rate': 1.7076429140899386e-07, 'epoch': 14.74}

 92%|█████████▏| 342280/371472 [5:04:07<2:29:57,  3.24it/s]
 92%|█████████▏| 342281/371472 [5:04:07<2:24:02,  3.38it/s]
 92%|█████████▏| 342282/371472 [5:04:07<2:19:37,  3.48it/s]
 92%|█████████▏| 342283/371472 [5:04:08<2:23:24,  3.39it/s]
 92%|█████████▏| 342284/371472 [5:04:08<2:20:41,  3.46it/s]
 92%|█████████▏| 342285/371472 [5:04:08<2:23:14,  3.40it/s]
 92%|█████████▏| 342286/371472 [5:04:08<2:18:20,  3.52it/s]
 92%|█████████▏| 342287/371472 [5:04:09<2:11:54,  3.69it/s]
 92%|█████████▏| 342288/371472 [5:04:09<2:14:52,  3.61it/s]
 92%|█████████▏| 342289/371472 [5:04:09<2:32:24,  3.19it/s]
 92%|█████████▏| 342290/371472 [5:04:10<2:25:28,  3.34it/s]
 92%|█████████▏| 342291/371472 [5:04:10<2:21:45,  3.43it/s]
 92%|█████████▏| 342292/371472 [5:04:10<2:21:54,  3.43it/s]
 92%|█████████▏| 342293/371472 [5:04:10<2:20:14,  3.47it/s]
 92%|█████████▏| 342294/371472 [5:04:11<2:20:24,  3.46it/s]
 92%|█████████▏| 342295/371472 [5:04:11<2:23:54,  3.38it/s]
 92%|█████████▏| 342296/371472 [5:04:11<2:20:57,  3.45it/s]
 92%|█████████▏| 342297/371472 [5:04:12<2:19:43,  3.48it/s]
 92%|█████████▏| 342298/371472 [5:04:12<2:21:47,  3.43it/s]
 92%|█████████▏| 342299/371472 [5:04:12<2:14:49,  3.61it/s]
 92%|█████████▏| 342300/371472 [5:04:12<2:22:32,  3.41it/s]
                                                           
{'loss': 2.5459, 'learning_rate': 1.7071580943351504e-07, 'epoch': 14.74}

 92%|█████████▏| 342300/371472 [5:04:12<2:22:32,  3.41it/s]
 92%|█████████▏| 342301/371472 [5:04:13<2:24:19,  3.37it/s]
 92%|█████████▏| 342302/371472 [5:04:13<2:29:33,  3.25it/s]
 92%|█████████▏| 342303/371472 [5:04:13<2:24:11,  3.37it/s]
 92%|█████████▏| 342304/371472 [5:04:14<2:16:48,  3.55it/s]
 92%|█████████▏| 342305/371472 [5:04:14<2:16:17,  3.57it/s]
 92%|█████████▏| 342306/371472 [5:04:14<2:12:49,  3.66it/s]
 92%|█████████▏| 342307/371472 [5:04:14<2:11:00,  3.71it/s]
 92%|█████████▏| 342308/371472 [5:04:15<2:08:54,  3.77it/s]
 92%|█████████▏| 342309/371472 [5:04:15<2:14:15,  3.62it/s]
 92%|█████████▏| 342310/371472 [5:04:15<2:09:56,  3.74it/s]
 92%|█████████▏| 342311/371472 [5:04:16<2:19:03,  3.50it/s]
 92%|█████████▏| 342312/371472 [5:04:16<2:23:10,  3.39it/s]
 92%|█████████▏| 342313/371472 [5:04:16<2:24:23,  3.37it/s]
 92%|█████████▏| 342314/371472 [5:04:16<2:29:57,  3.24it/s]
 92%|█████████▏| 342315/371472 [5:04:17<2:31:19,  3.21it/s]
 92%|█████████▏| 342316/371472 [5:04:17<2:29:45,  3.24it/s]
 92%|█████████▏| 342317/371472 [5:04:17<2:27:32,  3.29it/s]
 92%|█████████▏| 342318/371472 [5:04:18<2:25:40,  3.34it/s]
 92%|█████████▏| 342319/371472 [5:04:18<2:20:59,  3.45it/s]
 92%|█████████▏| 342320/371472 [5:04:18<2:17:48,  3.53it/s]
                                                           
{'loss': 2.6648, 'learning_rate': 1.706673274580361e-07, 'epoch': 14.74}

 92%|█████████▏| 342320/371472 [5:04:18<2:17:48,  3.53it/s]
 92%|█████████▏| 342321/371472 [5:04:18<2:14:45,  3.61it/s]
 92%|█████████▏| 342322/371472 [5:04:19<2:16:34,  3.56it/s]
 92%|█████████▏| 342323/371472 [5:04:19<2:13:38,  3.64it/s]
 92%|█████████▏| 342324/371472 [5:04:19<2:10:37,  3.72it/s]
 92%|█████████▏| 342325/371472 [5:04:20<2:23:54,  3.38it/s]
 92%|█████████▏| 342326/371472 [5:04:20<2:21:33,  3.43it/s]
 92%|█████████▏| 342327/371472 [5:04:20<2:18:20,  3.51it/s]
 92%|█████████▏| 342328/371472 [5:04:20<2:13:21,  3.64it/s]
 92%|█████████▏| 342329/371472 [5:04:21<2:13:40,  3.63it/s]
 92%|█████████▏| 342330/371472 [5:04:21<2:12:02,  3.68it/s]
 92%|█████████▏| 342331/371472 [5:04:21<2:09:39,  3.75it/s]
 92%|█████████▏| 342332/371472 [5:04:22<2:11:47,  3.69it/s]
 92%|█████████▏| 342333/371472 [5:04:22<2:13:00,  3.65it/s]
 92%|█████████▏| 342334/371472 [5:04:22<2:12:53,  3.65it/s]
 92%|█████████▏| 342335/371472 [5:04:22<2:15:49,  3.58it/s]
 92%|█████████▏| 342336/371472 [5:04:23<2:12:32,  3.66it/s]
 92%|█████████▏| 342337/371472 [5:04:23<2:24:03,  3.37it/s]
 92%|█████████▏| 342338/371472 [5:04:23<2:33:02,  3.17it/s]
 92%|█████████▏| 342339/371472 [5:04:24<2:23:12,  3.39it/s]
 92%|█████████▏| 342340/371472 [5:04:24<2:20:46,  3.45it/s]
                                                           
{'loss': 2.6256, 'learning_rate': 1.7061884548255726e-07, 'epoch': 14.75}

 92%|█████████▏| 342340/371472 [5:04:24<2:20:46,  3.45it/s]
 92%|█████████▏| 342341/371472 [5:04:24<2:21:47,  3.42it/s]
 92%|█████████▏| 342342/371472 [5:04:24<2:28:17,  3.27it/s]
 92%|█████████▏| 342343/371472 [5:04:25<2:23:25,  3.39it/s]
 92%|█████████▏| 342344/371472 [5:04:25<2:19:38,  3.48it/s]
 92%|█████████▏| 342345/371472 [5:04:25<2:22:56,  3.40it/s]
 92%|█████████▏| 342346/371472 [5:04:26<2:14:44,  3.60it/s]
 92%|█████████▏| 342347/371472 [5:04:26<2:24:09,  3.37it/s]
 92%|█████████▏| 342348/371472 [5:04:26<2:24:51,  3.35it/s]
 92%|█████████▏| 342349/371472 [5:04:26<2:19:11,  3.49it/s]
 92%|█████████▏| 342350/371472 [5:04:27<2:17:20,  3.53it/s]
 92%|█████████▏| 342351/371472 [5:04:27<2:12:26,  3.66it/s]
 92%|█████████▏| 342352/371472 [5:04:27<2:10:54,  3.71it/s]
 92%|█████████▏| 342353/371472 [5:04:28<2:16:09,  3.56it/s]
 92%|█████████▏| 342354/371472 [5:04:28<2:15:24,  3.58it/s]
 92%|█████████▏| 342355/371472 [5:04:28<2:11:08,  3.70it/s]
 92%|█████████▏| 342356/371472 [5:04:28<2:16:13,  3.56it/s]
 92%|█████████▏| 342357/371472 [5:04:29<2:18:15,  3.51it/s]
 92%|█████████▏| 342358/371472 [5:04:29<2:15:27,  3.58it/s]
 92%|█████████▏| 342359/371472 [5:04:29<2:13:47,  3.63it/s]
 92%|█████████▏| 342360/371472 [5:04:30<2:22:28,  3.41it/s]
                                                           
{'loss': 2.6155, 'learning_rate': 1.705703635070783e-07, 'epoch': 14.75}

 92%|█████████▏| 342360/371472 [5:04:30<2:22:28,  3.41it/s]
 92%|█████████▏| 342361/371472 [5:04:30<2:16:52,  3.54it/s]
 92%|█████████▏| 342362/371472 [5:04:30<2:18:54,  3.49it/s]
 92%|█████████▏| 342363/371472 [5:04:30<2:15:14,  3.59it/s]
 92%|█████████▏| 342364/371472 [5:04:31<2:16:08,  3.56it/s]
 92%|█████████▏| 342365/371472 [5:04:31<2:20:29,  3.45it/s]
 92%|█████████▏| 342366/371472 [5:04:31<2:19:48,  3.47it/s]
 92%|█████████▏| 342367/371472 [5:04:32<2:19:38,  3.47it/s]
 92%|█████████▏| 342368/371472 [5:04:32<2:17:27,  3.53it/s]
 92%|█████████▏| 342369/371472 [5:04:32<2:12:32,  3.66it/s]
 92%|█████████▏| 342370/371472 [5:04:32<2:08:39,  3.77it/s]
 92%|█████████▏| 342371/371472 [5:04:33<2:11:07,  3.70it/s]
 92%|█████████▏| 342372/371472 [5:04:33<2:15:28,  3.58it/s]
 92%|█████████▏| 342373/371472 [5:04:33<2:11:04,  3.70it/s]
 92%|█████████▏| 342374/371472 [5:04:33<2:06:26,  3.84it/s]
 92%|█████████▏| 342375/371472 [5:04:34<2:04:28,  3.90it/s]
 92%|█████████▏| 342376/371472 [5:04:34<2:24:09,  3.36it/s]
 92%|█████████▏| 342377/371472 [5:04:34<2:21:36,  3.42it/s]
 92%|█████████▏| 342378/371472 [5:04:35<2:17:37,  3.52it/s]
 92%|█████████▏| 342379/371472 [5:04:35<2:22:48,  3.40it/s]
 92%|█████████▏| 342380/371472 [5:04:35<2:31:17,  3.20it/s]
                                                           
{'loss': 2.62, 'learning_rate': 1.7052188153159948e-07, 'epoch': 14.75}

 92%|█████████▏| 342380/371472 [5:04:35<2:31:17,  3.20it/s]
 92%|█████████▏| 342381/371472 [5:04:36<2:33:04,  3.17it/s]
 92%|█████████▏| 342382/371472 [5:04:36<2:24:51,  3.35it/s]
 92%|█████████▏| 342383/371472 [5:04:36<2:20:45,  3.44it/s]
 92%|█████████▏| 342384/371472 [5:04:36<2:17:14,  3.53it/s]
 92%|█████████▏| 342385/371472 [5:04:37<2:26:43,  3.30it/s]
 92%|█████████▏| 342386/371472 [5:04:37<2:26:32,  3.31it/s]
 92%|█████████▏| 342387/371472 [5:04:37<2:19:25,  3.48it/s]
 92%|█████████▏| 342388/371472 [5:04:38<2:16:33,  3.55it/s]
 92%|█████████▏| 342389/371472 [5:04:38<2:18:46,  3.49it/s]
 92%|█████████▏| 342390/371472 [5:04:38<2:21:40,  3.42it/s]
 92%|█████████▏| 342391/371472 [5:04:38<2:24:23,  3.36it/s]
 92%|█████████▏| 342392/371472 [5:04:39<2:18:54,  3.49it/s]
 92%|█████████▏| 342393/371472 [5:04:39<2:25:44,  3.33it/s]
 92%|█████████▏| 342394/371472 [5:04:39<2:23:52,  3.37it/s]
 92%|█████████▏| 342395/371472 [5:04:40<2:19:07,  3.48it/s]
 92%|█████████▏| 342396/371472 [5:04:40<2:16:22,  3.55it/s]
 92%|█████████▏| 342397/371472 [5:04:40<2:12:22,  3.66it/s]
 92%|█████████▏| 342398/371472 [5:04:41<2:35:47,  3.11it/s]
 92%|█████████▏| 342399/371472 [5:04:41<2:27:17,  3.29it/s]
 92%|█████████▏| 342400/371472 [5:04:41<2:29:52,  3.23it/s]
                                                           
{'loss': 2.5477, 'learning_rate': 1.7047339955612055e-07, 'epoch': 14.75}

 92%|█████████▏| 342400/371472 [5:04:41<2:29:52,  3.23it/s]
 92%|█████████▏| 342401/371472 [5:04:41<2:31:04,  3.21it/s]
 92%|█████████▏| 342402/371472 [5:04:42<2:27:43,  3.28it/s]
 92%|█████████▏| 342403/371472 [5:04:42<2:21:51,  3.42it/s]
 92%|█████████▏| 342404/371472 [5:04:42<2:19:27,  3.47it/s]
 92%|█████████▏| 342405/371472 [5:04:43<2:13:33,  3.63it/s]
 92%|█████████▏| 342406/371472 [5:04:43<2:16:49,  3.54it/s]
 92%|█████████▏| 342407/371472 [5:04:43<2:14:36,  3.60it/s]
 92%|█████████▏| 342408/371472 [5:04:43<2:14:27,  3.60it/s]
 92%|█████████▏| 342409/371472 [5:04:44<2:22:40,  3.40it/s]
 92%|█████████▏| 342410/371472 [5:04:44<2:23:33,  3.37it/s]
 92%|█████████▏| 342411/371472 [5:04:44<2:17:39,  3.52it/s]
 92%|█████████▏| 342412/371472 [5:04:45<2:10:29,  3.71it/s]
 92%|█████████▏| 342413/371472 [5:04:45<2:13:12,  3.64it/s]
 92%|█████████▏| 342414/371472 [5:04:45<2:10:35,  3.71it/s]
 92%|█████████▏| 342415/371472 [5:04:45<2:12:16,  3.66it/s]
 92%|█████████▏| 342416/371472 [5:04:46<2:13:36,  3.62it/s]
 92%|█████████▏| 342417/371472 [5:04:46<2:17:01,  3.53it/s]
 92%|█████████▏| 342418/371472 [5:04:46<2:19:04,  3.48it/s]
 92%|█████████▏| 342419/371472 [5:04:46<2:14:17,  3.61it/s]
 92%|█████████▏| 342420/371472 [5:04:47<2:10:05,  3.72it/s]
                                                           
{'loss': 2.6321, 'learning_rate': 1.7042491758064168e-07, 'epoch': 14.75}

 92%|█████████▏| 342420/371472 [5:04:47<2:10:05,  3.72it/s]
 92%|█████████▏| 342421/371472 [5:04:47<2:11:15,  3.69it/s]
 92%|█████████▏| 342422/371472 [5:04:47<2:12:29,  3.65it/s]
 92%|█████████▏| 342423/371472 [5:04:48<2:14:13,  3.61it/s]
 92%|█████████▏| 342424/371472 [5:04:48<2:30:41,  3.21it/s]
 92%|█████████▏| 342425/371472 [5:04:48<2:23:58,  3.36it/s]
 92%|█████████▏| 342426/371472 [5:04:48<2:19:31,  3.47it/s]
 92%|█████████▏| 342427/371472 [5:04:49<2:16:02,  3.56it/s]
 92%|█████████▏| 342428/371472 [5:04:49<2:15:31,  3.57it/s]
 92%|█████████▏| 342429/371472 [5:04:49<2:18:37,  3.49it/s]
 92%|█████████▏| 342430/371472 [5:04:50<2:14:13,  3.61it/s]
 92%|█████████▏| 342431/371472 [5:04:50<2:20:00,  3.46it/s]
 92%|█████████▏| 342432/371472 [5:04:50<2:14:21,  3.60it/s]
 92%|█████████▏| 342433/371472 [5:04:50<2:11:27,  3.68it/s]
 92%|█████████▏| 342434/371472 [5:04:51<2:08:40,  3.76it/s]
 92%|█████████▏| 342435/371472 [5:04:51<2:08:00,  3.78it/s]
 92%|█████████▏| 342436/371472 [5:04:51<2:16:13,  3.55it/s]
 92%|█████████▏| 342437/371472 [5:04:52<2:19:51,  3.46it/s]
 92%|█████████▏| 342438/371472 [5:04:52<2:16:39,  3.54it/s]
 92%|█████████▏| 342439/371472 [5:04:52<2:15:33,  3.57it/s]
 92%|█████████▏| 342440/371472 [5:04:52<2:16:46,  3.54it/s]
                                                           
{'loss': 2.5903, 'learning_rate': 1.7037643560516275e-07, 'epoch': 14.75}

 92%|█████████▏| 342440/371472 [5:04:52<2:16:46,  3.54it/s]
 92%|█████████▏| 342441/371472 [5:04:53<2:19:54,  3.46it/s]
 92%|█████████▏| 342442/371472 [5:04:53<2:14:18,  3.60it/s]
 92%|█████████▏| 342443/371472 [5:04:53<2:19:26,  3.47it/s]
 92%|█████████▏| 342444/371472 [5:04:54<2:20:40,  3.44it/s]
 92%|█████████▏| 342445/371472 [5:04:54<2:16:07,  3.55it/s]
 92%|█████████▏| 342446/371472 [5:04:54<2:16:41,  3.54it/s]
 92%|█████████▏| 342447/371472 [5:04:54<2:11:09,  3.69it/s]
 92%|█████████▏| 342448/371472 [5:04:55<2:16:09,  3.55it/s]
 92%|█████████▏| 342449/371472 [5:04:55<2:17:38,  3.51it/s]
 92%|█████████▏| 342450/371472 [5:04:55<2:22:08,  3.40it/s]
 92%|█████████▏| 342451/371472 [5:04:56<2:20:05,  3.45it/s]
 92%|█████████▏| 342452/371472 [5:04:56<2:16:18,  3.55it/s]
 92%|█████████▏| 342453/371472 [5:04:56<2:13:00,  3.64it/s]
 92%|█████████▏| 342454/371472 [5:04:56<2:10:32,  3.70it/s]
 92%|█████████▏| 342455/371472 [5:04:57<2:16:21,  3.55it/s]
 92%|█████████▏| 342456/371472 [5:04:57<2:17:17,  3.52it/s]
 92%|█████████▏| 342457/371472 [5:04:57<2:12:14,  3.66it/s]
 92%|█████████▏| 342458/371472 [5:04:57<2:08:02,  3.78it/s]
 92%|█████████▏| 342459/371472 [5:04:58<2:09:56,  3.72it/s]
 92%|█████████▏| 342460/371472 [5:04:58<2:07:25,  3.79it/s]
                                                           
{'loss': 2.4972, 'learning_rate': 1.7032795362968393e-07, 'epoch': 14.75}

 92%|█████████▏| 342460/371472 [5:04:58<2:07:25,  3.79it/s]
 92%|█████████▏| 342461/371472 [5:04:58<2:10:03,  3.72it/s]
 92%|█████████▏| 342462/371472 [5:04:58<2:14:06,  3.61it/s]
 92%|█████████▏| 342463/371472 [5:04:59<2:15:55,  3.56it/s]
 92%|█████████▏| 342464/371472 [5:04:59<2:26:17,  3.30it/s]
 92%|█████████▏| 342465/371472 [5:04:59<2:26:02,  3.31it/s]
 92%|█████████▏| 342466/371472 [5:05:00<2:21:45,  3.41it/s]
 92%|█████████▏| 342467/371472 [5:05:00<2:18:32,  3.49it/s]
 92%|█████████▏| 342468/371472 [5:05:00<2:15:42,  3.56it/s]
 92%|█████████▏| 342469/371472 [5:05:01<2:24:07,  3.35it/s]
 92%|█████████▏| 342470/371472 [5:05:01<2:33:27,  3.15it/s]
 92%|█████████▏| 342471/371472 [5:05:01<2:41:32,  2.99it/s]
 92%|█████████▏| 342472/371472 [5:05:02<2:39:55,  3.02it/s]
 92%|█████████▏| 342473/371472 [5:05:02<2:29:56,  3.22it/s]
 92%|█████████▏| 342474/371472 [5:05:02<2:28:28,  3.26it/s]
 92%|█████████▏| 342475/371472 [5:05:03<2:39:04,  3.04it/s]
 92%|█████████▏| 342476/371472 [5:05:03<2:28:44,  3.25it/s]
 92%|█████████▏| 342477/371472 [5:05:03<2:27:23,  3.28it/s]
 92%|█████████▏| 342478/371472 [5:05:03<2:23:01,  3.38it/s]
 92%|█████████▏| 342479/371472 [5:05:04<2:16:10,  3.55it/s]
 92%|█████████▏| 342480/371472 [5:05:04<2:16:37,  3.54it/s]
                                                           
{'loss': 2.6274, 'learning_rate': 1.7027947165420497e-07, 'epoch': 14.75}

 92%|█████████▏| 342480/371472 [5:05:04<2:16:37,  3.54it/s]
 92%|█████████▏| 342481/371472 [5:05:04<2:13:14,  3.63it/s]
 92%|█████████▏| 342482/371472 [5:05:05<2:18:46,  3.48it/s]
 92%|█████████▏| 342483/371472 [5:05:05<2:24:05,  3.35it/s]
 92%|█████████▏| 342484/371472 [5:05:05<2:30:18,  3.21it/s]
 92%|█████████▏| 342485/371472 [5:05:05<2:22:51,  3.38it/s]
 92%|█████████▏| 342486/371472 [5:05:06<2:24:19,  3.35it/s]
 92%|█████████▏| 342487/371472 [5:05:06<2:20:59,  3.43it/s]
 92%|█████████▏| 342488/371472 [5:05:06<2:23:55,  3.36it/s]
 92%|█████████▏| 342489/371472 [5:05:07<2:35:29,  3.11it/s]
 92%|█████████▏| 342490/371472 [5:05:07<2:24:58,  3.33it/s]
 92%|█████████▏| 342491/371472 [5:05:07<2:21:32,  3.41it/s]
 92%|█████████▏| 342492/371472 [5:05:08<2:23:50,  3.36it/s]
 92%|█████████▏| 342493/371472 [5:05:08<2:21:47,  3.41it/s]
 92%|█████████▏| 342494/371472 [5:05:08<2:19:49,  3.45it/s]
 92%|█████████▏| 342495/371472 [5:05:08<2:15:30,  3.56it/s]
 92%|█████████▏| 342496/371472 [5:05:09<2:16:07,  3.55it/s]
 92%|█████████▏| 342497/371472 [5:05:09<2:16:01,  3.55it/s]
 92%|█████████▏| 342498/371472 [5:05:09<2:11:14,  3.68it/s]
 92%|█████████▏| 342499/371472 [5:05:10<2:17:37,  3.51it/s]
 92%|█████████▏| 342500/371472 [5:05:10<2:14:11,  3.60it/s]
                                                           
{'loss': 2.6541, 'learning_rate': 1.7023098967872612e-07, 'epoch': 14.75}

 92%|█████████▏| 342500/371472 [5:05:10<2:14:11,  3.60it/s]
 92%|█████████▏| 342501/371472 [5:05:10<2:26:04,  3.31it/s]
 92%|█████████▏| 342502/371472 [5:05:10<2:26:02,  3.31it/s]
 92%|█████████▏| 342503/371472 [5:05:11<2:25:06,  3.33it/s]
 92%|█████████▏| 342504/371472 [5:05:11<2:27:43,  3.27it/s]
 92%|█████████▏| 342505/371472 [5:05:11<2:31:41,  3.18it/s]
 92%|█████████▏| 342506/371472 [5:05:12<2:27:09,  3.28it/s]
 92%|█████████▏| 342507/371472 [5:05:12<2:22:27,  3.39it/s]
 92%|█████████▏| 342508/371472 [5:05:12<2:16:54,  3.53it/s]
 92%|█████████▏| 342509/371472 [5:05:13<2:19:12,  3.47it/s]
 92%|█████████▏| 342510/371472 [5:05:13<2:16:58,  3.52it/s]
 92%|█████████▏| 342511/371472 [5:05:13<2:18:11,  3.49it/s]
 92%|█████████▏| 342512/371472 [5:05:13<2:21:16,  3.42it/s]
 92%|█████████▏| 342513/371472 [5:05:14<2:18:33,  3.48it/s]
 92%|█████████▏| 342514/371472 [5:05:14<2:22:15,  3.39it/s]
 92%|█████████▏| 342515/371472 [5:05:14<2:27:14,  3.28it/s]
 92%|█████████▏| 342516/371472 [5:05:15<2:27:38,  3.27it/s]
 92%|█████████▏| 342517/371472 [5:05:15<2:17:05,  3.52it/s]
 92%|█████████▏| 342518/371472 [5:05:15<2:16:03,  3.55it/s]
 92%|█████████▏| 342519/371472 [5:05:15<2:11:21,  3.67it/s]
 92%|█████████▏| 342520/371472 [5:05:16<2:09:58,  3.71it/s]
                                                           
{'loss': 2.6049, 'learning_rate': 1.701825077032472e-07, 'epoch': 14.75}

 92%|█████████▏| 342520/371472 [5:05:16<2:09:58,  3.71it/s]
 92%|█████████▏| 342521/371472 [5:05:16<2:24:45,  3.33it/s]
 92%|█████████▏| 342522/371472 [5:05:16<2:30:39,  3.20it/s]
 92%|█████████▏| 342523/371472 [5:05:17<2:25:35,  3.31it/s]
 92%|█████████▏| 342524/371472 [5:05:17<2:32:19,  3.17it/s]
 92%|█████████▏| 342525/371472 [5:05:17<2:33:35,  3.14it/s]
 92%|█████████▏| 342526/371472 [5:05:18<2:36:10,  3.09it/s]
 92%|█████████▏| 342527/371472 [5:05:18<2:25:25,  3.32it/s]
 92%|█████████▏| 342528/371472 [5:05:18<2:22:11,  3.39it/s]
 92%|█████████▏| 342529/371472 [5:05:18<2:18:14,  3.49it/s]
 92%|█████████▏| 342530/371472 [5:05:19<2:12:44,  3.63it/s]
 92%|█████████▏| 342531/371472 [5:05:19<2:15:05,  3.57it/s]
 92%|█████████▏| 342532/371472 [5:05:19<2:13:29,  3.61it/s]
 92%|█████████▏| 342533/371472 [5:05:20<2:13:35,  3.61it/s]
 92%|█████████▏| 342534/371472 [5:05:20<2:14:28,  3.59it/s]
 92%|█████████▏| 342535/371472 [5:05:20<2:11:25,  3.67it/s]
 92%|█████████▏| 342536/371472 [5:05:20<2:10:04,  3.71it/s]
 92%|█████████▏| 342537/371472 [5:05:21<2:14:04,  3.60it/s]
 92%|█████████▏| 342538/371472 [5:05:21<2:22:54,  3.37it/s]
 92%|█████████▏| 342539/371472 [5:05:21<2:32:58,  3.15it/s]
 92%|█████████▏| 342540/371472 [5:05:22<2:36:10,  3.09it/s]
                                                           
{'loss': 2.5887, 'learning_rate': 1.7013402572776834e-07, 'epoch': 14.75}

 92%|█████████▏| 342540/371472 [5:05:22<2:36:10,  3.09it/s]
 92%|█████████▏| 342541/371472 [5:05:22<2:29:23,  3.23it/s]
 92%|█████████▏| 342542/371472 [5:05:22<2:30:04,  3.21it/s]
 92%|█████████▏| 342543/371472 [5:05:23<2:24:53,  3.33it/s]
 92%|█████████▏| 342544/371472 [5:05:23<2:26:19,  3.30it/s]
 92%|█████████▏| 342545/371472 [5:05:23<2:24:46,  3.33it/s]
 92%|█████████▏| 342546/371472 [5:05:23<2:20:56,  3.42it/s]
 92%|█████████▏| 342547/371472 [5:05:24<2:19:03,  3.47it/s]
 92%|█████████▏| 342548/371472 [5:05:24<2:13:23,  3.61it/s]
 92%|█████████▏| 342549/371472 [5:05:24<2:12:15,  3.64it/s]
 92%|█████████▏| 342550/371472 [5:05:24<2:09:56,  3.71it/s]
 92%|█████████▏| 342551/371472 [5:05:25<2:20:56,  3.42it/s]
 92%|█████████▏| 342552/371472 [5:05:25<2:13:31,  3.61it/s]
 92%|█████████▏| 342553/371472 [5:05:25<2:11:41,  3.66it/s]
 92%|█████████▏| 342554/371472 [5:05:26<2:11:18,  3.67it/s]
 92%|█████████▏| 342555/371472 [5:05:26<2:09:25,  3.72it/s]
 92%|█████████▏| 342556/371472 [5:05:26<2:12:45,  3.63it/s]
 92%|█████████▏| 342557/371472 [5:05:26<2:08:51,  3.74it/s]
 92%|█████████▏| 342558/371472 [5:05:27<2:07:10,  3.79it/s]
 92%|█████████▏| 342559/371472 [5:05:27<2:04:58,  3.86it/s]
 92%|█████████▏| 342560/371472 [5:05:27<2:06:35,  3.81it/s]
                                                           
{'loss': 2.5643, 'learning_rate': 1.700855437522894e-07, 'epoch': 14.75}

 92%|█████████▏| 342560/371472 [5:05:27<2:06:35,  3.81it/s]
 92%|█████████▏| 342561/371472 [5:05:27<2:06:54,  3.80it/s]
 92%|█████████▏| 342562/371472 [5:05:28<2:10:50,  3.68it/s]
 92%|█████████▏| 342563/371472 [5:05:28<2:17:34,  3.50it/s]
 92%|█████████▏| 342564/371472 [5:05:28<2:19:02,  3.47it/s]
 92%|█████████▏| 342565/371472 [5:05:29<2:23:51,  3.35it/s]
 92%|█████████▏| 342566/371472 [5:05:29<2:35:51,  3.09it/s]
 92%|█████████▏| 342567/371472 [5:05:29<2:29:59,  3.21it/s]
 92%|█████████▏| 342568/371472 [5:05:30<2:31:17,  3.18it/s]
 92%|█████████▏| 342569/371472 [5:05:30<2:35:40,  3.09it/s]
 92%|█████████▏| 342570/371472 [5:05:30<2:26:59,  3.28it/s]
 92%|█████████▏| 342571/371472 [5:05:30<2:18:31,  3.48it/s]
 92%|█████████▏| 342572/371472 [5:05:31<2:20:22,  3.43it/s]
 92%|█████████▏| 342573/371472 [5:05:31<2:20:39,  3.42it/s]
 92%|█████████▏| 342574/371472 [5:05:31<2:31:34,  3.18it/s]
 92%|█████████▏| 342575/371472 [5:05:32<2:26:10,  3.29it/s]
 92%|█████████▏| 342576/371472 [5:05:32<2:27:56,  3.26it/s]
 92%|█████████▏| 342577/371472 [5:05:32<2:17:51,  3.49it/s]
 92%|█████████▏| 342578/371472 [5:05:33<2:11:17,  3.67it/s]
 92%|█████████▏| 342579/371472 [5:05:33<2:10:45,  3.68it/s]
 92%|█████████▏| 342580/371472 [5:05:33<2:09:12,  3.73it/s]
                                                           
{'loss': 2.537, 'learning_rate': 1.7003706177681057e-07, 'epoch': 14.76}

 92%|█████████▏| 342580/371472 [5:05:33<2:09:12,  3.73it/s]
 92%|█████████▏| 342581/371472 [5:05:33<2:16:09,  3.54it/s]
 92%|█████████▏| 342582/371472 [5:05:34<2:13:36,  3.60it/s]
 92%|█████████▏| 342583/371472 [5:05:34<2:10:12,  3.70it/s]
 92%|█████████▏| 342584/371472 [5:05:34<2:08:26,  3.75it/s]
 92%|█████████▏| 342585/371472 [5:05:34<2:14:37,  3.58it/s]
 92%|█████████▏| 342586/371472 [5:05:35<2:13:11,  3.61it/s]
 92%|█████████▏| 342587/371472 [5:05:35<2:13:54,  3.60it/s]
 92%|█████████▏| 342588/371472 [5:05:35<2:12:05,  3.64it/s]
 92%|█████████▏| 342589/371472 [5:05:36<2:13:49,  3.60it/s]
 92%|█████████▏| 342590/371472 [5:05:36<2:20:12,  3.43it/s]
 92%|█████████▏| 342591/371472 [5:05:36<2:20:55,  3.42it/s]
 92%|█████████▏| 342592/371472 [5:05:36<2:14:25,  3.58it/s]
 92%|█████████▏| 342593/371472 [5:05:37<2:11:49,  3.65it/s]
 92%|█████████▏| 342594/371472 [5:05:37<2:11:51,  3.65it/s]
 92%|█████████▏| 342595/371472 [5:05:37<2:14:09,  3.59it/s]
 92%|█████████▏| 342596/371472 [5:05:38<2:23:39,  3.35it/s]
 92%|█████████▏| 342597/371472 [5:05:38<2:22:32,  3.38it/s]
 92%|█████████▏| 342598/371472 [5:05:38<2:23:11,  3.36it/s]
 92%|█████████▏| 342599/371472 [5:05:38<2:17:32,  3.50it/s]
 92%|█████████▏| 342600/371472 [5:05:39<2:17:59,  3.49it/s]
                                                           
{'loss': 2.6809, 'learning_rate': 1.699885798013316e-07, 'epoch': 14.76}

 92%|█████████▏| 342600/371472 [5:05:39<2:17:59,  3.49it/s]
 92%|█████████▏| 342601/371472 [5:05:39<2:14:57,  3.57it/s]
 92%|█████████▏| 342602/371472 [5:05:39<2:09:38,  3.71it/s]
 92%|█████████▏| 342603/371472 [5:05:39<2:07:13,  3.78it/s]
 92%|█████████▏| 342604/371472 [5:05:40<2:03:50,  3.89it/s]
 92%|█████████▏| 342605/371472 [5:05:40<2:03:06,  3.91it/s]
 92%|█████████▏| 342606/371472 [5:05:40<2:07:18,  3.78it/s]
 92%|█████████▏| 342607/371472 [5:05:41<2:08:51,  3.73it/s]
 92%|█████████▏| 342608/371472 [5:05:41<2:21:59,  3.39it/s]
 92%|█████████▏| 342609/371472 [5:05:41<2:34:40,  3.11it/s]
 92%|█████████▏| 342610/371472 [5:05:42<2:24:09,  3.34it/s]
 92%|█████████▏| 342611/371472 [5:05:42<2:17:39,  3.49it/s]
 92%|█████████▏| 342612/371472 [5:05:42<2:13:40,  3.60it/s]
 92%|█████████▏| 342613/371472 [5:05:42<2:14:37,  3.57it/s]
 92%|█████████▏| 342614/371472 [5:05:43<2:09:31,  3.71it/s]
 92%|█████████▏| 342615/371472 [5:05:43<2:08:32,  3.74it/s]
 92%|█████████▏| 342616/371472 [5:05:43<2:18:42,  3.47it/s]
 92%|█████████▏| 342617/371472 [5:05:43<2:22:03,  3.39it/s]
 92%|█████████▏| 342618/371472 [5:05:44<2:22:09,  3.38it/s]
 92%|█████████▏| 342619/371472 [5:05:44<2:16:22,  3.53it/s]
 92%|█████████▏| 342620/371472 [5:05:44<2:14:57,  3.56it/s]
                                                           
{'loss': 2.7381, 'learning_rate': 1.6994009782585276e-07, 'epoch': 14.76}

 92%|█████████▏| 342620/371472 [5:05:44<2:14:57,  3.56it/s]
 92%|█████████▏| 342621/371472 [5:05:45<2:14:12,  3.58it/s]
 92%|█████████▏| 342622/371472 [5:05:45<2:16:16,  3.53it/s]
 92%|█████████▏| 342623/371472 [5:05:45<2:20:22,  3.43it/s]
 92%|█████████▏| 342624/371472 [5:05:45<2:15:42,  3.54it/s]
 92%|█████████▏| 342625/371472 [5:05:46<2:18:11,  3.48it/s]
 92%|█████████▏| 342626/371472 [5:05:46<2:20:34,  3.42it/s]
 92%|█████████▏| 342627/371472 [5:05:46<2:28:42,  3.23it/s]
 92%|█████████▏| 342628/371472 [5:05:47<2:33:17,  3.14it/s]
 92%|█████████▏| 342629/371472 [5:05:47<2:24:23,  3.33it/s]
 92%|█████████▏| 342630/371472 [5:05:47<2:14:21,  3.58it/s]
 92%|█████████▏| 342631/371472 [5:05:47<2:13:20,  3.60it/s]
 92%|█████████▏| 342632/371472 [5:05:48<2:11:09,  3.66it/s]
 92%|█████████▏| 342633/371472 [5:05:48<2:15:05,  3.56it/s]
 92%|█████████▏| 342634/371472 [5:05:48<2:10:43,  3.68it/s]
 92%|█████████▏| 342635/371472 [5:05:49<2:09:53,  3.70it/s]
 92%|█████████▏| 342636/371472 [5:05:49<2:06:54,  3.79it/s]
 92%|█████████▏| 342637/371472 [5:05:49<2:05:21,  3.83it/s]
 92%|█████████▏| 342638/371472 [5:05:49<2:18:19,  3.47it/s]
 92%|█████████▏| 342639/371472 [5:05:50<2:12:23,  3.63it/s]
 92%|█████████▏| 342640/371472 [5:05:50<2:22:27,  3.37it/s]
                                                           
{'loss': 2.5811, 'learning_rate': 1.6989161585037383e-07, 'epoch': 14.76}

 92%|█████████▏| 342640/371472 [5:05:50<2:22:27,  3.37it/s]
 92%|█████████▏| 342641/371472 [5:05:50<2:24:19,  3.33it/s]
 92%|█████████▏| 342642/371472 [5:05:51<2:47:45,  2.86it/s]
 92%|█████████▏| 342643/371472 [5:05:51<2:35:51,  3.08it/s]
 92%|█████████▏| 342644/371472 [5:05:51<2:36:05,  3.08it/s]
 92%|█████████▏| 342645/371472 [5:05:52<2:32:47,  3.14it/s]
 92%|█████████▏| 342646/371472 [5:05:52<2:23:24,  3.35it/s]
 92%|█████████▏| 342647/371472 [5:05:52<2:24:51,  3.32it/s]
 92%|█████████▏| 342648/371472 [5:05:53<2:19:11,  3.45it/s]
 92%|█████████▏| 342649/371472 [5:05:53<2:15:10,  3.55it/s]
 92%|█████████▏| 342650/371472 [5:05:53<2:12:52,  3.62it/s]
 92%|█████████▏| 342651/371472 [5:05:53<2:16:06,  3.53it/s]
 92%|█████████▏| 342652/371472 [5:05:54<2:18:04,  3.48it/s]
 92%|█████████▏| 342653/371472 [5:05:54<2:14:51,  3.56it/s]
 92%|█████████▏| 342654/371472 [5:05:54<2:17:45,  3.49it/s]
 92%|█████████▏| 342655/371472 [5:05:54<2:18:34,  3.47it/s]
 92%|█████████▏| 342656/371472 [5:05:55<2:13:21,  3.60it/s]
 92%|█████████▏| 342657/371472 [5:05:55<2:11:12,  3.66it/s]
 92%|█████████▏| 342658/371472 [5:05:55<2:09:57,  3.70it/s]
 92%|█████████▏| 342659/371472 [5:05:56<2:11:12,  3.66it/s]
 92%|█████████▏| 342660/371472 [5:05:56<2:13:15,  3.60it/s]
                                                           
{'loss': 2.5676, 'learning_rate': 1.6984313387489498e-07, 'epoch': 14.76}

 92%|█████████▏| 342660/371472 [5:05:56<2:13:15,  3.60it/s]
 92%|█████████▏| 342661/371472 [5:05:56<2:12:44,  3.62it/s]
 92%|█████████▏| 342662/371472 [5:05:56<2:12:27,  3.63it/s]
 92%|█████████▏| 342663/371472 [5:05:57<2:15:40,  3.54it/s]
 92%|█████████▏| 342664/371472 [5:05:57<2:18:23,  3.47it/s]
 92%|█████████▏| 342665/371472 [5:05:57<2:13:43,  3.59it/s]
 92%|█████████▏| 342666/371472 [5:05:58<2:12:12,  3.63it/s]
 92%|█████████▏| 342667/371472 [5:05:58<2:08:30,  3.74it/s]
 92%|█████████▏| 342668/371472 [5:05:58<2:06:59,  3.78it/s]
 92%|█████████▏| 342669/371472 [5:05:58<2:08:57,  3.72it/s]
 92%|█████████▏| 342670/371472 [5:05:59<2:12:49,  3.61it/s]
 92%|█████████▏| 342671/371472 [5:05:59<2:10:57,  3.67it/s]
 92%|█████████▏| 342672/371472 [5:05:59<2:19:29,  3.44it/s]
 92%|█████████▏| 342673/371472 [5:05:59<2:17:22,  3.49it/s]
 92%|█████████▏| 342674/371472 [5:06:00<2:23:31,  3.34it/s]
 92%|█████████▏| 342675/371472 [5:06:00<2:21:05,  3.40it/s]
 92%|█████████▏| 342676/371472 [5:06:00<2:18:29,  3.47it/s]
 92%|█████████▏| 342677/371472 [5:06:01<2:22:26,  3.37it/s]
 92%|█████████▏| 342678/371472 [5:06:01<2:20:30,  3.42it/s]
 92%|█████████▏| 342679/371472 [5:06:01<2:18:57,  3.45it/s]
 92%|█████████▏| 342680/371472 [5:06:01<2:12:51,  3.61it/s]
                                                           
{'loss': 2.6058, 'learning_rate': 1.6979465189941603e-07, 'epoch': 14.76}

 92%|█████████▏| 342680/371472 [5:06:01<2:12:51,  3.61it/s]
 92%|█████████▏| 342681/371472 [5:06:02<2:18:06,  3.47it/s]
 92%|█████████▏| 342682/371472 [5:06:02<2:25:35,  3.30it/s]
 92%|█████████▏| 342683/371472 [5:06:02<2:16:32,  3.51it/s]
 92%|█████████▏| 342684/371472 [5:06:03<2:15:18,  3.55it/s]
 92%|█████████▏| 342685/371472 [5:06:03<2:11:47,  3.64it/s]
 92%|█████████▏| 342686/371472 [5:06:03<2:06:37,  3.79it/s]
 92%|█████████▏| 342687/371472 [5:06:03<2:05:05,  3.84it/s]
 92%|█████████▏| 342688/371472 [5:06:04<2:30:46,  3.18it/s]
 92%|█████████▏| 342689/371472 [5:06:04<2:26:24,  3.28it/s]
 92%|█████████▏| 342690/371472 [5:06:04<2:23:28,  3.34it/s]
 92%|█████████▏| 342691/371472 [5:06:05<2:25:34,  3.29it/s]
 92%|█████████▏| 342692/371472 [5:06:05<2:19:32,  3.44it/s]
 92%|█████████▏| 342693/371472 [5:06:05<2:22:01,  3.38it/s]
 92%|█████████▏| 342694/371472 [5:06:06<2:14:25,  3.57it/s]
 92%|█████████▏| 342695/371472 [5:06:06<2:16:38,  3.51it/s]
 92%|█████████▏| 342696/371472 [5:06:06<2:17:48,  3.48it/s]
 92%|█████████▏| 342697/371472 [5:06:06<2:14:18,  3.57it/s]
 92%|█████████▏| 342698/371472 [5:06:07<2:11:19,  3.65it/s]
 92%|█████████▏| 342699/371472 [5:06:07<2:11:12,  3.65it/s]
 92%|█████████▏| 342700/371472 [5:06:07<2:12:24,  3.62it/s]
                                                           
{'loss': 2.7432, 'learning_rate': 1.697461699239372e-07, 'epoch': 14.76}

 92%|█████████▏| 342700/371472 [5:06:07<2:12:24,  3.62it/s]
 92%|█████████▏| 342701/371472 [5:06:07<2:14:12,  3.57it/s]
 92%|█████████▏| 342702/371472 [5:06:08<2:11:51,  3.64it/s]
 92%|█████████▏| 342703/371472 [5:06:08<2:08:19,  3.74it/s]
 92%|█████████▏| 342704/371472 [5:06:08<2:07:04,  3.77it/s]
 92%|█████████▏| 342705/371472 [5:06:09<2:10:13,  3.68it/s]
 92%|█████████▏| 342706/371472 [5:06:09<2:39:07,  3.01it/s]
 92%|█████████▏| 342707/371472 [5:06:09<2:34:41,  3.10it/s]
 92%|█████████▏| 342708/371472 [5:06:10<2:29:27,  3.21it/s]
 92%|█████████▏| 342709/371472 [5:06:10<2:22:42,  3.36it/s]
 92%|█████████▏| 342710/371472 [5:06:10<2:25:42,  3.29it/s]
 92%|█████████▏| 342711/371472 [5:06:10<2:22:22,  3.37it/s]
 92%|█████████▏| 342712/371472 [5:06:11<2:19:07,  3.45it/s]
 92%|█████████▏| 342713/371472 [5:06:11<2:13:56,  3.58it/s]
 92%|█████████▏| 342714/371472 [5:06:11<2:27:09,  3.26it/s]
 92%|█████████▏| 342715/371472 [5:06:12<2:22:21,  3.37it/s]
 92%|█████████▏| 342716/371472 [5:06:12<2:25:16,  3.30it/s]
 92%|█████████▏| 342717/371472 [5:06:12<2:23:54,  3.33it/s]
 92%|█████████▏| 342718/371472 [5:06:13<2:15:52,  3.53it/s]
 92%|█████████▏| 342719/371472 [5:06:13<2:20:27,  3.41it/s]
 92%|█████████▏| 342720/371472 [5:06:13<2:19:01,  3.45it/s]
                                                           
{'loss': 2.7373, 'learning_rate': 1.6969768794845825e-07, 'epoch': 14.76}

 92%|█████████▏| 342720/371472 [5:06:13<2:19:01,  3.45it/s]
 92%|█████████▏| 342721/371472 [5:06:13<2:14:40,  3.56it/s]
 92%|█████████▏| 342722/371472 [5:06:14<2:13:38,  3.59it/s]
 92%|█████████▏| 342723/371472 [5:06:14<2:12:21,  3.62it/s]
 92%|█████████▏| 342724/371472 [5:06:14<2:13:18,  3.59it/s]
 92%|█████████▏| 342725/371472 [5:06:14<2:16:38,  3.51it/s]
 92%|█████████▏| 342726/371472 [5:06:15<2:13:13,  3.60it/s]
 92%|█████████▏| 342727/371472 [5:06:15<2:14:41,  3.56it/s]
 92%|█████████▏| 342728/371472 [5:06:15<2:13:07,  3.60it/s]
 92%|█████████▏| 342729/371472 [5:06:16<2:14:33,  3.56it/s]
 92%|█████████▏| 342730/371472 [5:06:16<2:23:42,  3.33it/s]
 92%|█████████▏| 342731/371472 [5:06:16<2:26:48,  3.26it/s]
 92%|█████████▏| 342732/371472 [5:06:17<2:23:18,  3.34it/s]
 92%|█████████▏| 342733/371472 [5:06:17<2:23:31,  3.34it/s]
 92%|█████████▏| 342734/371472 [5:06:17<2:25:22,  3.29it/s]
 92%|█████████▏| 342735/371472 [5:06:17<2:16:19,  3.51it/s]
 92%|█████████▏| 342736/371472 [5:06:18<2:17:49,  3.48it/s]
 92%|█████████▏| 342737/371472 [5:06:18<2:20:31,  3.41it/s]
 92%|█████████▏| 342738/371472 [5:06:18<2:13:06,  3.60it/s]
 92%|█████████▏| 342739/371472 [5:06:18<2:07:43,  3.75it/s]
 92%|█████████▏| 342740/371472 [5:06:19<2:10:33,  3.67it/s]
                                                           
{'loss': 2.6206, 'learning_rate': 1.696492059729794e-07, 'epoch': 14.76}

 92%|█████████▏| 342740/371472 [5:06:19<2:10:33,  3.67it/s]
 92%|█████████▏| 342741/371472 [5:06:19<2:17:12,  3.49it/s]
 92%|█████████▏| 342742/371472 [5:06:19<2:18:27,  3.46it/s]
 92%|█████████▏| 342743/371472 [5:06:20<2:15:28,  3.53it/s]
 92%|█████████▏| 342744/371472 [5:06:20<2:10:44,  3.66it/s]
 92%|█████████▏| 342745/371472 [5:06:20<2:09:22,  3.70it/s]
 92%|█████████▏| 342746/371472 [5:06:20<2:13:31,  3.59it/s]
 92%|█████████▏| 342747/371472 [5:06:21<2:17:58,  3.47it/s]
 92%|█████████▏| 342748/371472 [5:06:21<2:22:22,  3.36it/s]
 92%|█████████▏| 342749/371472 [5:06:21<2:20:06,  3.42it/s]
 92%|█████████▏| 342750/371472 [5:06:22<2:16:41,  3.50it/s]
 92%|█████████▏| 342751/371472 [5:06:22<2:12:24,  3.62it/s]
 92%|█████████▏| 342752/371472 [5:06:22<2:11:31,  3.64it/s]
 92%|█████████▏| 342753/371472 [5:06:22<2:13:10,  3.59it/s]
 92%|█████████▏| 342754/371472 [5:06:23<2:15:34,  3.53it/s]
 92%|█████████▏| 342755/371472 [5:06:23<2:17:29,  3.48it/s]
 92%|█████████▏| 342756/371472 [5:06:23<2:12:52,  3.60it/s]
 92%|█████████▏| 342757/371472 [5:06:24<2:12:04,  3.62it/s]
 92%|█████████▏| 342758/371472 [5:06:24<2:22:04,  3.37it/s]
 92%|█████████▏| 342759/371472 [5:06:24<2:29:04,  3.21it/s]
 92%|█████████▏| 342760/371472 [5:06:25<2:25:02,  3.30it/s]
                                                           
{'loss': 2.6122, 'learning_rate': 1.6960072399750047e-07, 'epoch': 14.76}

 92%|█████████▏| 342760/371472 [5:06:25<2:25:02,  3.30it/s]
 92%|█████████▏| 342761/371472 [5:06:25<2:27:20,  3.25it/s]
 92%|█████████▏| 342762/371472 [5:06:25<2:24:15,  3.32it/s]
 92%|█████████▏| 342763/371472 [5:06:25<2:20:07,  3.41it/s]
 92%|█████████▏| 342764/371472 [5:06:26<2:13:53,  3.57it/s]
 92%|█████████▏| 342765/371472 [5:06:26<2:10:54,  3.65it/s]
 92%|█████████▏| 342766/371472 [5:06:26<2:14:10,  3.57it/s]
 92%|█████████▏| 342767/371472 [5:06:27<2:19:01,  3.44it/s]
 92%|█████████▏| 342768/371472 [5:06:27<2:42:19,  2.95it/s]
 92%|█████████▏| 342769/371472 [5:06:27<2:31:12,  3.16it/s]
 92%|█████████▏| 342770/371472 [5:06:28<2:27:07,  3.25it/s]
 92%|█████████▏| 342771/371472 [5:06:28<2:25:29,  3.29it/s]
 92%|█████████▏| 342772/371472 [5:06:28<2:22:25,  3.36it/s]
 92%|█████████▏| 342773/371472 [5:06:28<2:27:34,  3.24it/s]
 92%|█████████▏| 342774/371472 [5:06:29<2:21:55,  3.37it/s]
 92%|█████████▏| 342775/371472 [5:06:29<2:22:02,  3.37it/s]
 92%|█████████▏| 342776/371472 [5:06:29<2:20:16,  3.41it/s]
 92%|█████████▏| 342777/371472 [5:06:30<2:22:36,  3.35it/s]
 92%|█████████▏| 342778/371472 [5:06:30<2:20:34,  3.40it/s]
 92%|█████████▏| 342779/371472 [5:06:30<2:19:06,  3.44it/s]
 92%|█████████▏| 342780/371472 [5:06:31<2:24:20,  3.31it/s]
                                                           
{'loss': 2.6639, 'learning_rate': 1.6955224202202163e-07, 'epoch': 14.76}

 92%|█████████▏| 342780/371472 [5:06:31<2:24:20,  3.31it/s]
 92%|█████████▏| 342781/371472 [5:06:31<2:18:14,  3.46it/s]
 92%|█████████▏| 342782/371472 [5:06:31<2:13:50,  3.57it/s]
 92%|█████████▏| 342783/371472 [5:06:31<2:08:35,  3.72it/s]
 92%|█████████▏| 342784/371472 [5:06:32<2:10:28,  3.66it/s]
 92%|█████████▏| 342785/371472 [5:06:32<2:19:38,  3.42it/s]
 92%|█████████▏| 342786/371472 [5:06:32<2:15:26,  3.53it/s]
 92%|█████████▏| 342787/371472 [5:06:32<2:12:56,  3.60it/s]
 92%|█████████▏| 342788/371472 [5:06:33<2:20:55,  3.39it/s]
 92%|█████████▏| 342789/371472 [5:06:33<2:15:55,  3.52it/s]
 92%|█████████▏| 342790/371472 [5:06:33<2:13:55,  3.57it/s]
 92%|█████████▏| 342791/371472 [5:06:34<2:12:50,  3.60it/s]
 92%|█████████▏| 342792/371472 [5:06:34<2:09:08,  3.70it/s]
 92%|█████████▏| 342793/371472 [5:06:34<2:13:04,  3.59it/s]
 92%|█████████▏| 342794/371472 [5:06:34<2:13:41,  3.57it/s]
 92%|█████████▏| 342795/371472 [5:06:35<2:17:07,  3.49it/s]
 92%|█████████▏| 342796/371472 [5:06:35<2:11:58,  3.62it/s]
 92%|█████████▏| 342797/371472 [5:06:35<2:09:48,  3.68it/s]
 92%|█████████▏| 342798/371472 [5:06:35<2:05:26,  3.81it/s]
 92%|█████████▏| 342799/371472 [5:06:36<2:08:58,  3.71it/s]
 92%|█████████▏| 342800/371472 [5:06:36<2:09:38,  3.69it/s]
                                                           
{'loss': 2.715, 'learning_rate': 1.6950376004654267e-07, 'epoch': 14.77}

 92%|█████████▏| 342800/371472 [5:06:36<2:09:38,  3.69it/s]
 92%|█████████▏| 342801/371472 [5:06:36<2:18:55,  3.44it/s]
 92%|█████████▏| 342802/371472 [5:06:37<2:14:50,  3.54it/s]
 92%|█████████▏| 342803/371472 [5:06:37<2:20:27,  3.40it/s]
 92%|█████████▏| 342804/371472 [5:06:37<2:20:01,  3.41it/s]
 92%|█████████▏| 342805/371472 [5:06:37<2:15:30,  3.53it/s]
 92%|█████████▏| 342806/371472 [5:06:38<2:14:22,  3.56it/s]
 92%|█████████▏| 342807/371472 [5:06:38<2:09:11,  3.70it/s]
 92%|█████████▏| 342808/371472 [5:06:38<2:08:10,  3.73it/s]
 92%|█████████▏| 342809/371472 [5:06:39<2:09:50,  3.68it/s]
 92%|█████████▏| 342810/371472 [5:06:39<2:09:34,  3.69it/s]
 92%|█████████▏| 342811/371472 [5:06:39<2:11:16,  3.64it/s]
 92%|█████████▏| 342812/371472 [5:06:39<2:06:58,  3.76it/s]
 92%|█████████▏| 342813/371472 [5:06:40<2:18:05,  3.46it/s]
 92%|█████████▏| 342814/371472 [5:06:40<2:13:56,  3.57it/s]
 92%|█████████▏| 342815/371472 [5:06:40<2:13:18,  3.58it/s]
 92%|█████████▏| 342816/371472 [5:06:40<2:08:47,  3.71it/s]
 92%|█████████▏| 342817/371472 [5:06:41<2:12:20,  3.61it/s]
 92%|█████████▏| 342818/371472 [5:06:41<2:09:35,  3.69it/s]
 92%|█████████▏| 342819/371472 [5:06:41<2:09:53,  3.68it/s]
 92%|█████████▏| 342820/371472 [5:06:42<2:09:17,  3.69it/s]
                                                           
{'loss': 2.5814, 'learning_rate': 1.6945527807106374e-07, 'epoch': 14.77}

 92%|█████████▏| 342820/371472 [5:06:42<2:09:17,  3.69it/s]
 92%|█████████▏| 342821/371472 [5:06:42<2:18:49,  3.44it/s]
 92%|█████████▏| 342822/371472 [5:06:42<2:12:16,  3.61it/s]
 92%|█████████▏| 342823/371472 [5:06:42<2:17:51,  3.46it/s]
 92%|█████████▏| 342824/371472 [5:06:43<2:11:58,  3.62it/s]
 92%|█████████▏| 342825/371472 [5:06:43<2:09:07,  3.70it/s]
 92%|█████████▏| 342826/371472 [5:06:43<2:06:52,  3.76it/s]
 92%|█████████▏| 342827/371472 [5:06:44<2:33:17,  3.11it/s]
 92%|█████████▏| 342828/371472 [5:06:44<2:27:45,  3.23it/s]
 92%|█████████▏| 342829/371472 [5:06:44<2:25:53,  3.27it/s]
 92%|█████████▏| 342830/371472 [5:06:45<2:22:06,  3.36it/s]
 92%|█████████▏| 342831/371472 [5:06:45<2:21:52,  3.36it/s]
 92%|█████████▏| 342832/371472 [5:06:45<2:35:44,  3.06it/s]
 92%|█████████▏| 342833/371472 [5:06:46<2:27:51,  3.23it/s]
 92%|█████████▏| 342834/371472 [5:06:46<2:19:28,  3.42it/s]
 92%|█████████▏| 342835/371472 [5:06:46<2:15:52,  3.51it/s]
 92%|█████████▏| 342836/371472 [5:06:46<2:14:03,  3.56it/s]
 92%|█████████▏| 342837/371472 [5:06:47<2:13:34,  3.57it/s]
 92%|█████████▏| 342838/371472 [5:06:47<2:11:44,  3.62it/s]
 92%|█████████▏| 342839/371472 [5:06:47<2:08:08,  3.72it/s]
 92%|█████████▏| 342840/371472 [5:06:47<2:24:18,  3.31it/s]
                                                           
{'loss': 2.6579, 'learning_rate': 1.6940679609558492e-07, 'epoch': 14.77}

 92%|█████████▏| 342840/371472 [5:06:47<2:24:18,  3.31it/s]
 92%|█████████▏| 342841/371472 [5:06:48<2:19:51,  3.41it/s]
 92%|█████████▏| 342842/371472 [5:06:48<2:19:42,  3.42it/s]
 92%|█████████▏| 342843/371472 [5:06:48<2:15:42,  3.52it/s]
 92%|█████████▏| 342844/371472 [5:06:49<2:12:47,  3.59it/s]
 92%|█████████▏| 342845/371472 [5:06:49<2:11:52,  3.62it/s]
 92%|█████████▏| 342846/371472 [5:06:49<2:11:46,  3.62it/s]
 92%|█████████▏| 342847/371472 [5:06:49<2:09:05,  3.70it/s]
 92%|█████████▏| 342848/371472 [5:06:50<2:13:30,  3.57it/s]
 92%|█████████▏| 342849/371472 [5:06:50<2:11:17,  3.63it/s]
 92%|█████████▏| 342850/371472 [5:06:50<2:16:35,  3.49it/s]
 92%|█████████▏| 342851/371472 [5:06:50<2:09:38,  3.68it/s]
 92%|█████████▏| 342852/371472 [5:06:51<2:09:50,  3.67it/s]
 92%|█████████▏| 342853/371472 [5:06:51<2:11:14,  3.63it/s]
 92%|█████████▏| 342854/371472 [5:06:51<2:11:16,  3.63it/s]
 92%|█████████▏| 342855/371472 [5:06:52<2:13:20,  3.58it/s]
 92%|█████████▏| 342856/371472 [5:06:52<2:12:27,  3.60it/s]
 92%|█████████▏| 342857/371472 [5:06:52<2:13:00,  3.59it/s]
 92%|█████████▏| 342858/371472 [5:06:52<2:14:21,  3.55it/s]
 92%|█████████▏| 342859/371472 [5:06:53<2:16:19,  3.50it/s]
 92%|█████████▏| 342860/371472 [5:06:53<2:31:30,  3.15it/s]
                                                           
{'loss': 2.5533, 'learning_rate': 1.6935831412010596e-07, 'epoch': 14.77}

 92%|█████████▏| 342860/371472 [5:06:53<2:31:30,  3.15it/s]
 92%|█████████▏| 342861/371472 [5:06:53<2:26:13,  3.26it/s]
 92%|█████████▏| 342862/371472 [5:06:54<2:21:24,  3.37it/s]
 92%|█████████▏| 342863/371472 [5:06:54<2:23:44,  3.32it/s]
 92%|█████████▏| 342864/371472 [5:06:54<2:29:23,  3.19it/s]
 92%|█████████▏| 342865/371472 [5:06:55<2:31:40,  3.14it/s]
 92%|█████████▏| 342866/371472 [5:06:55<2:24:28,  3.30it/s]
 92%|█████████▏| 342867/371472 [5:06:55<2:26:52,  3.25it/s]
 92%|█████████▏| 342868/371472 [5:06:56<2:26:48,  3.25it/s]
 92%|█████████▏| 342869/371472 [5:06:56<2:25:43,  3.27it/s]
 92%|█████████▏| 342870/371472 [5:06:56<2:28:06,  3.22it/s]
 92%|█████████▏| 342871/371472 [5:06:56<2:20:36,  3.39it/s]
 92%|█████████▏| 342872/371472 [5:06:57<2:24:55,  3.29it/s]
 92%|█████████▏| 342873/371472 [5:06:57<2:20:51,  3.38it/s]
 92%|█████████▏| 342874/371472 [5:06:57<2:39:02,  3.00it/s]
 92%|█████████▏| 342875/371472 [5:06:58<2:33:20,  3.11it/s]
 92%|█████████▏| 342876/371472 [5:06:58<2:27:57,  3.22it/s]
 92%|█████████▏| 342877/371472 [5:06:58<2:22:40,  3.34it/s]
 92%|█████████▏| 342878/371472 [5:06:59<2:16:14,  3.50it/s]
 92%|█████████▏| 342879/371472 [5:06:59<2:13:07,  3.58it/s]
 92%|█████████▏| 342880/371472 [5:06:59<2:12:26,  3.60it/s]
                                                           
{'loss': 2.4367, 'learning_rate': 1.693098321446271e-07, 'epoch': 14.77}

 92%|█████████▏| 342880/371472 [5:06:59<2:12:26,  3.60it/s]
 92%|█████████▏| 342881/371472 [5:06:59<2:11:56,  3.61it/s]
 92%|█████████▏| 342882/371472 [5:07:00<2:09:39,  3.68it/s]
 92%|█████████▏| 342883/371472 [5:07:00<2:12:46,  3.59it/s]
 92%|█████████▏| 342884/371472 [5:07:00<2:11:02,  3.64it/s]
 92%|█████████▏| 342885/371472 [5:07:00<2:06:04,  3.78it/s]
 92%|█████████▏| 342886/371472 [5:07:01<2:08:06,  3.72it/s]
 92%|█████████▏| 342887/371472 [5:07:01<2:11:45,  3.62it/s]
 92%|█████████▏| 342888/371472 [5:07:01<2:10:53,  3.64it/s]
 92%|█████████▏| 342889/371472 [5:07:02<2:12:42,  3.59it/s]
 92%|█████████▏| 342890/371472 [5:07:02<2:12:20,  3.60it/s]
 92%|█████████▏| 342891/371472 [5:07:02<2:09:58,  3.66it/s]
 92%|█████████▏| 342892/371472 [5:07:02<2:09:17,  3.68it/s]
 92%|█████████▏| 342893/371472 [5:07:03<2:13:17,  3.57it/s]
 92%|█████████▏| 342894/371472 [5:07:03<2:25:45,  3.27it/s]
 92%|█████████▏| 342895/371472 [5:07:03<2:23:24,  3.32it/s]
 92%|█████████▏| 342896/371472 [5:07:04<2:18:20,  3.44it/s]
 92%|█████████▏| 342897/371472 [5:07:04<2:15:04,  3.53it/s]
 92%|█████████▏| 342898/371472 [5:07:04<2:10:37,  3.65it/s]
 92%|█████████▏| 342899/371472 [5:07:04<2:10:26,  3.65it/s]
 92%|█████████▏| 342900/371472 [5:07:05<2:13:37,  3.56it/s]
                                                           
{'loss': 2.5589, 'learning_rate': 1.6926135016914819e-07, 'epoch': 14.77}

 92%|█████████▏| 342900/371472 [5:07:05<2:13:37,  3.56it/s]
 92%|█████████▏| 342901/371472 [5:07:05<2:09:45,  3.67it/s]
 92%|█████████▏| 342902/371472 [5:07:05<2:12:12,  3.60it/s]
 92%|█████████▏| 342903/371472 [5:07:06<2:13:27,  3.57it/s]
 92%|█████████▏| 342904/371472 [5:07:06<2:12:28,  3.59it/s]
 92%|█████████▏| 342905/371472 [5:07:06<2:12:19,  3.60it/s]
 92%|█████████▏| 342906/371472 [5:07:06<2:10:16,  3.65it/s]
 92%|█████████▏| 342907/371472 [5:07:07<2:05:22,  3.80it/s]
 92%|█████████▏| 342908/371472 [5:07:07<2:09:45,  3.67it/s]
 92%|█████████▏| 342909/371472 [5:07:07<2:15:03,  3.52it/s]
 92%|█████████▏| 342910/371472 [5:07:07<2:11:27,  3.62it/s]
 92%|█████████▏| 342911/371472 [5:07:08<2:09:32,  3.67it/s]
 92%|█████████▏| 342912/371472 [5:07:08<2:07:40,  3.73it/s]
 92%|█████████▏| 342913/371472 [5:07:08<2:12:46,  3.58it/s]
 92%|█████████▏| 342914/371472 [5:07:09<2:14:45,  3.53it/s]
 92%|█████████▏| 342915/371472 [5:07:09<2:12:21,  3.60it/s]
 92%|█████████▏| 342916/371472 [5:07:09<2:06:59,  3.75it/s]
 92%|█████████▏| 342917/371472 [5:07:09<2:14:43,  3.53it/s]
 92%|█████████▏| 342918/371472 [5:07:10<2:11:01,  3.63it/s]
 92%|█████████▏| 342919/371472 [5:07:10<2:13:07,  3.57it/s]
 92%|█████████▏| 342920/371472 [5:07:10<2:08:02,  3.72it/s]
                                                           
{'loss': 2.6291, 'learning_rate': 1.6921286819366934e-07, 'epoch': 14.77}

 92%|█████████▏| 342920/371472 [5:07:10<2:08:02,  3.72it/s]
 92%|█████████▏| 342921/371472 [5:07:10<2:06:47,  3.75it/s]
 92%|█████████▏| 342922/371472 [5:07:11<2:06:02,  3.78it/s]
 92%|█████████▏| 342923/371472 [5:07:11<2:07:14,  3.74it/s]
 92%|█████████▏| 342924/371472 [5:07:11<2:11:32,  3.62it/s]
 92%|█████████▏| 342925/371472 [5:07:12<2:13:51,  3.55it/s]
 92%|█████████▏| 342926/371472 [5:07:12<2:19:07,  3.42it/s]
 92%|█████████▏| 342927/371472 [5:07:12<2:21:02,  3.37it/s]
 92%|█████████▏| 342928/371472 [5:07:13<2:45:24,  2.88it/s]
 92%|█████████▏| 342929/371472 [5:07:13<2:32:35,  3.12it/s]
 92%|█████████▏| 342930/371472 [5:07:13<2:21:22,  3.36it/s]
 92%|█████████▏| 342931/371472 [5:07:13<2:14:49,  3.53it/s]
 92%|█████████▏| 342932/371472 [5:07:14<2:16:48,  3.48it/s]
 92%|█████████▏| 342933/371472 [5:07:14<2:15:58,  3.50it/s]
 92%|█████████▏| 342934/371472 [5:07:14<2:14:04,  3.55it/s]
 92%|█████████▏| 342935/371472 [5:07:15<2:12:20,  3.59it/s]
 92%|█████████▏| 342936/371472 [5:07:15<2:10:45,  3.64it/s]
 92%|█████████▏| 342937/371472 [5:07:15<2:14:52,  3.53it/s]
 92%|█████████▏| 342938/371472 [5:07:15<2:15:26,  3.51it/s]
 92%|█████████▏| 342939/371472 [5:07:16<2:18:02,  3.44it/s]
 92%|█████████▏| 342940/371472 [5:07:16<2:18:14,  3.44it/s]
                                                           
{'loss': 2.56, 'learning_rate': 1.6916438621819038e-07, 'epoch': 14.77}

 92%|█████████▏| 342940/371472 [5:07:16<2:18:14,  3.44it/s]
 92%|█████████▏| 342941/371472 [5:07:16<2:16:13,  3.49it/s]
 92%|█████████▏| 342942/371472 [5:07:17<2:10:49,  3.63it/s]
 92%|█████████▏| 342943/371472 [5:07:17<2:14:19,  3.54it/s]
 92%|█████████▏| 342944/371472 [5:07:17<2:13:19,  3.57it/s]
 92%|█████████▏| 342945/371472 [5:07:17<2:14:15,  3.54it/s]
 92%|█████████▏| 342946/371472 [5:07:18<2:12:48,  3.58it/s]
 92%|█████████▏| 342947/371472 [5:07:18<2:10:07,  3.65it/s]
 92%|█████████▏| 342948/371472 [5:07:18<2:10:21,  3.65it/s]
 92%|█████████▏| 342949/371472 [5:07:18<2:08:43,  3.69it/s]
 92%|█████████▏| 342950/371472 [5:07:19<2:12:05,  3.60it/s]
 92%|█████████▏| 342951/371472 [5:07:19<2:35:17,  3.06it/s]
 92%|█████████▏| 342952/371472 [5:07:20<2:36:12,  3.04it/s]
 92%|█████████▏| 342953/371472 [5:07:20<2:30:33,  3.16it/s]
 92%|█████████▏| 342954/371472 [5:07:20<2:24:28,  3.29it/s]
 92%|█████████▏| 342955/371472 [5:07:20<2:21:12,  3.37it/s]
 92%|█████████▏| 342956/371472 [5:07:21<2:14:41,  3.53it/s]
 92%|█████████▏| 342957/371472 [5:07:21<2:16:09,  3.49it/s]
 92%|█████████▏| 342958/371472 [5:07:21<2:13:59,  3.55it/s]
 92%|█████████▏| 342959/371472 [5:07:21<2:10:37,  3.64it/s]
 92%|█████████▏| 342960/371472 [5:07:22<2:10:53,  3.63it/s]
                                                           
{'loss': 2.5937, 'learning_rate': 1.6911590424271156e-07, 'epoch': 14.77}

 92%|█████████▏| 342960/371472 [5:07:22<2:10:53,  3.63it/s]
 92%|█████████▏| 342961/371472 [5:07:22<2:06:54,  3.74it/s]
 92%|█████████▏| 342962/371472 [5:07:22<2:08:26,  3.70it/s]
 92%|█████████▏| 342963/371472 [5:07:22<2:06:36,  3.75it/s]
 92%|█████████▏| 342964/371472 [5:07:23<2:13:23,  3.56it/s]
 92%|█████████▏| 342965/371472 [5:07:23<2:16:07,  3.49it/s]
 92%|█████████▏| 342966/371472 [5:07:23<2:14:57,  3.52it/s]
 92%|█████████▏| 342967/371472 [5:07:24<2:14:02,  3.54it/s]
 92%|█████████▏| 342968/371472 [5:07:24<2:12:53,  3.57it/s]
 92%|█████████▏| 342969/371472 [5:07:24<2:13:54,  3.55it/s]
 92%|█████████▏| 342970/371472 [5:07:25<2:20:01,  3.39it/s]
 92%|█████████▏| 342971/371472 [5:07:25<2:13:53,  3.55it/s]
 92%|█████████▏| 342972/371472 [5:07:25<2:09:23,  3.67it/s]
 92%|█████████▏| 342973/371472 [5:07:25<2:13:45,  3.55it/s]
 92%|█████████▏| 342974/371472 [5:07:26<2:18:27,  3.43it/s]
 92%|█████████▏| 342975/371472 [5:07:26<2:19:59,  3.39it/s]
 92%|█████████▏| 342976/371472 [5:07:26<2:19:05,  3.41it/s]
 92%|█████████▏| 342977/371472 [5:07:27<2:17:11,  3.46it/s]
 92%|█████████▏| 342978/371472 [5:07:27<2:11:40,  3.61it/s]
 92%|█████████▏| 342979/371472 [5:07:27<2:10:32,  3.64it/s]
 92%|█████████▏| 342980/371472 [5:07:27<2:07:45,  3.72it/s]
                                                           
{'loss': 2.4951, 'learning_rate': 1.690674222672326e-07, 'epoch': 14.77}

 92%|█████████▏| 342980/371472 [5:07:27<2:07:45,  3.72it/s]
 92%|█████████▏| 342981/371472 [5:07:28<2:09:05,  3.68it/s]
 92%|█████████▏| 342982/371472 [5:07:28<2:08:00,  3.71it/s]
 92%|█████████▏| 342983/371472 [5:07:28<2:06:30,  3.75it/s]
 92%|█████████▏| 342984/371472 [5:07:28<2:05:15,  3.79it/s]
 92%|█████████▏| 342985/371472 [5:07:29<2:05:44,  3.78it/s]
 92%|█████████▏| 342986/371472 [5:07:29<2:04:53,  3.80it/s]
 92%|█████████▏| 342987/371472 [5:07:29<2:08:03,  3.71it/s]
 92%|█████████▏| 342988/371472 [5:07:29<2:04:03,  3.83it/s]
 92%|█████████▏| 342989/371472 [5:07:30<2:05:45,  3.77it/s]
 92%|█████████▏| 342990/371472 [5:07:30<2:12:30,  3.58it/s]
 92%|█████████▏| 342991/371472 [5:07:30<2:13:25,  3.56it/s]
 92%|█████████▏| 342992/371472 [5:07:31<2:26:37,  3.24it/s]
 92%|█████████▏| 342993/371472 [5:07:31<2:22:56,  3.32it/s]
 92%|█████████▏| 342994/371472 [5:07:31<2:24:33,  3.28it/s]
 92%|█████████▏| 342995/371472 [5:07:32<2:21:53,  3.34it/s]
 92%|█████████▏| 342996/371472 [5:07:32<2:18:27,  3.43it/s]
 92%|█████████▏| 342997/371472 [5:07:32<2:15:32,  3.50it/s]
 92%|█████████▏| 342998/371472 [5:07:32<2:16:50,  3.47it/s]
 92%|█████████▏| 342999/371472 [5:07:33<2:22:32,  3.33it/s]
 92%|█████████▏| 343000/371472 [5:07:33<2:19:00,  3.41it/s]
                                                           
{'loss': 2.5811, 'learning_rate': 1.6901894029175376e-07, 'epoch': 14.77}

 92%|█████████▏| 343000/371472 [5:07:33<2:19:00,  3.41it/s]
 92%|█████████▏| 343001/371472 [5:07:33<2:15:51,  3.49it/s]
 92%|█████████▏| 343002/371472 [5:07:34<2:24:18,  3.29it/s]
 92%|█████████▏| 343003/371472 [5:07:34<2:17:55,  3.44it/s]
 92%|█████████▏| 343004/371472 [5:07:34<2:27:26,  3.22it/s]
 92%|█████████▏| 343005/371472 [5:07:35<2:22:53,  3.32it/s]
 92%|█████████▏| 343006/371472 [5:07:35<2:19:49,  3.39it/s]
 92%|█████████▏| 343007/371472 [5:07:35<2:15:11,  3.51it/s]
 92%|█████████▏| 343008/371472 [5:07:35<2:17:39,  3.45it/s]
 92%|█████████▏| 343009/371472 [5:07:36<2:17:35,  3.45it/s]
 92%|█████████▏| 343010/371472 [5:07:36<2:13:38,  3.55it/s]
 92%|█████████▏| 343011/371472 [5:07:36<2:17:35,  3.45it/s]
 92%|█████████▏| 343012/371472 [5:07:36<2:14:04,  3.54it/s]
 92%|█████████▏| 343013/371472 [5:07:37<2:22:38,  3.33it/s]
 92%|█████████▏| 343014/371472 [5:07:37<2:21:43,  3.35it/s]
 92%|█████████▏| 343015/371472 [5:07:37<2:19:00,  3.41it/s]
 92%|█████████▏| 343016/371472 [5:07:38<2:14:12,  3.53it/s]
 92%|█████████▏| 343017/371472 [5:07:38<2:16:09,  3.48it/s]
 92%|█████████▏| 343018/371472 [5:07:38<2:23:25,  3.31it/s]
 92%|█████████▏| 343019/371472 [5:07:39<2:17:16,  3.45it/s]
 92%|█████████▏| 343020/371472 [5:07:39<2:19:09,  3.41it/s]
                                                           
{'loss': 2.611, 'learning_rate': 1.6897045831627483e-07, 'epoch': 14.77}

 92%|█████████▏| 343020/371472 [5:07:39<2:19:09,  3.41it/s]
 92%|█████████▏| 343021/371472 [5:07:39<2:14:30,  3.53it/s]
 92%|█████████▏| 343022/371472 [5:07:39<2:16:24,  3.48it/s]
 92%|█████████▏| 343023/371472 [5:07:40<2:11:13,  3.61it/s]
 92%|█████████▏| 343024/371472 [5:07:40<2:06:09,  3.76it/s]
 92%|█████████▏| 343025/371472 [5:07:40<2:05:28,  3.78it/s]
 92%|█████████▏| 343026/371472 [5:07:40<2:06:06,  3.76it/s]
 92%|█████████▏| 343027/371472 [5:07:41<2:08:23,  3.69it/s]
 92%|█████████▏| 343028/371472 [5:07:41<2:05:24,  3.78it/s]
 92%|█████████▏| 343029/371472 [5:07:41<2:05:15,  3.78it/s]
 92%|█████████▏| 343030/371472 [5:07:41<2:04:24,  3.81it/s]
 92%|█████████▏| 343031/371472 [5:07:42<2:00:47,  3.92it/s]
 92%|█████████▏| 343032/371472 [5:07:42<2:08:41,  3.68it/s]
 92%|█████████▏| 343033/371472 [5:07:42<2:10:06,  3.64it/s]
 92%|█████████▏| 343034/371472 [5:07:43<2:10:51,  3.62it/s]
 92%|█████████▏| 343035/371472 [5:07:43<2:11:17,  3.61it/s]
 92%|█████████▏| 343036/371472 [5:07:43<2:10:20,  3.64it/s]
 92%|█████████▏| 343037/371472 [5:07:43<2:08:08,  3.70it/s]
 92%|█████████▏| 343038/371472 [5:07:44<2:07:25,  3.72it/s]
 92%|█████████▏| 343039/371472 [5:07:44<2:08:13,  3.70it/s]
 92%|█████████▏| 343040/371472 [5:07:44<2:14:46,  3.52it/s]
                                                           
{'loss': 2.6426, 'learning_rate': 1.6892197634079598e-07, 'epoch': 14.78}

 92%|█████████▏| 343040/371472 [5:07:44<2:14:46,  3.52it/s]
 92%|█████████▏| 343041/371472 [5:07:45<2:13:14,  3.56it/s]
 92%|█████████▏| 343042/371472 [5:07:45<2:22:04,  3.34it/s]
 92%|█████████▏| 343043/371472 [5:07:45<2:23:34,  3.30it/s]
 92%|█████████▏| 343044/371472 [5:07:45<2:21:10,  3.36it/s]
 92%|█████████▏| 343045/371472 [5:07:46<2:13:34,  3.55it/s]
 92%|█████████▏| 343046/371472 [5:07:46<2:18:53,  3.41it/s]
 92%|█████████▏| 343047/371472 [5:07:46<2:26:15,  3.24it/s]
 92%|█████████▏| 343048/371472 [5:07:47<2:16:45,  3.46it/s]
 92%|█████████▏| 343049/371472 [5:07:47<2:10:26,  3.63it/s]
 92%|█████████▏| 343050/371472 [5:07:47<2:14:19,  3.53it/s]
 92%|█████████▏| 343051/371472 [5:07:47<2:11:32,  3.60it/s]
 92%|█████████▏| 343052/371472 [5:07:48<2:06:49,  3.73it/s]
 92%|█████████▏| 343053/371472 [5:07:48<2:07:12,  3.72it/s]
 92%|█████████▏| 343054/371472 [5:07:48<2:15:31,  3.49it/s]
 92%|█████████▏| 343055/371472 [5:07:49<2:21:54,  3.34it/s]
 92%|█████████▏| 343056/371472 [5:07:49<2:16:40,  3.47it/s]
 92%|█████████▏| 343057/371472 [5:07:49<2:25:53,  3.25it/s]
 92%|█████████▏| 343058/371472 [5:07:49<2:18:42,  3.41it/s]
 92%|█████████▏| 343059/371472 [5:07:50<2:13:30,  3.55it/s]
 92%|█████████▏| 343060/371472 [5:07:50<2:16:42,  3.46it/s]
                                                           
{'loss': 2.5223, 'learning_rate': 1.6887349436531702e-07, 'epoch': 14.78}

 92%|█████████▏| 343060/371472 [5:07:50<2:16:42,  3.46it/s]
 92%|█████████▏| 343061/371472 [5:07:50<2:17:22,  3.45it/s]
 92%|█████████▏| 343062/371472 [5:07:51<2:13:39,  3.54it/s]
 92%|█████████▏| 343063/371472 [5:07:51<2:11:39,  3.60it/s]
 92%|█████████▏| 343064/371472 [5:07:51<2:10:20,  3.63it/s]
 92%|█████████▏| 343065/371472 [5:07:51<2:13:26,  3.55it/s]
 92%|█████████▏| 343066/371472 [5:07:52<2:09:51,  3.65it/s]
 92%|█████████▏| 343067/371472 [5:07:52<2:09:13,  3.66it/s]
 92%|█████████▏| 343068/371472 [5:07:52<2:07:23,  3.72it/s]
 92%|█████████▏| 343069/371472 [5:07:53<2:12:52,  3.56it/s]
 92%|█████████▏| 343070/371472 [5:07:53<2:08:50,  3.67it/s]
 92%|█████████▏| 343071/371472 [5:07:53<2:18:14,  3.42it/s]
 92%|█████████▏| 343072/371472 [5:07:53<2:16:03,  3.48it/s]
 92%|█████████▏| 343073/371472 [5:07:54<2:15:54,  3.48it/s]
 92%|█████████▏| 343074/371472 [5:07:54<2:16:02,  3.48it/s]
 92%|█████████▏| 343075/371472 [5:07:54<2:13:39,  3.54it/s]
 92%|█████████▏| 343076/371472 [5:07:55<2:12:12,  3.58it/s]
 92%|█████████▏| 343077/371472 [5:07:55<2:08:48,  3.67it/s]
 92%|█████████▏| 343078/371472 [5:07:55<2:07:32,  3.71it/s]
 92%|█████████▏| 343079/371472 [5:07:55<2:13:39,  3.54it/s]
 92%|█████████▏| 343080/371472 [5:07:56<2:17:53,  3.43it/s]
                                                           
{'loss': 2.7211, 'learning_rate': 1.688250123898382e-07, 'epoch': 14.78}

 92%|█████████▏| 343080/371472 [5:07:56<2:17:53,  3.43it/s]
 92%|█████████▏| 343081/371472 [5:07:56<2:19:07,  3.40it/s]
 92%|█████████▏| 343082/371472 [5:07:56<2:19:10,  3.40it/s]
 92%|█████████▏| 343083/371472 [5:07:57<2:17:10,  3.45it/s]
 92%|█████████▏| 343084/371472 [5:07:57<2:16:05,  3.48it/s]
 92%|█████████▏| 343085/371472 [5:07:57<2:11:16,  3.60it/s]
 92%|█████████▏| 343086/371472 [5:07:57<2:06:57,  3.73it/s]
 92%|█████████▏| 343087/371472 [5:07:58<2:08:49,  3.67it/s]
 92%|█████████▏| 343088/371472 [5:07:58<2:04:39,  3.79it/s]
 92%|█████████▏| 343089/371472 [5:07:58<2:08:58,  3.67it/s]
 92%|█████████▏| 343090/371472 [5:07:58<2:07:22,  3.71it/s]
 92%|█████████▏| 343091/371472 [5:07:59<2:09:54,  3.64it/s]
 92%|█████████▏| 343092/371472 [5:07:59<2:08:07,  3.69it/s]
 92%|█████████▏| 343093/371472 [5:07:59<2:06:40,  3.73it/s]
 92%|█████████▏| 343094/371472 [5:07:59<2:03:24,  3.83it/s]
 92%|█████████▏| 343095/371472 [5:08:00<2:08:52,  3.67it/s]
 92%|█████████▏| 343096/371472 [5:08:00<2:09:31,  3.65it/s]
 92%|█████████▏| 343097/371472 [5:08:00<2:23:04,  3.31it/s]
 92%|█████████▏| 343098/371472 [5:08:01<2:20:41,  3.36it/s]
 92%|█████████▏| 343099/371472 [5:08:01<2:13:53,  3.53it/s]
 92%|█████████▏| 343100/371472 [5:08:01<2:08:08,  3.69it/s]
                                                           
{'loss': 2.5406, 'learning_rate': 1.6877653041435927e-07, 'epoch': 14.78}

 92%|█████████▏| 343100/371472 [5:08:01<2:08:08,  3.69it/s]
 92%|█████████▏| 343101/371472 [5:08:01<2:05:51,  3.76it/s]
 92%|█████████▏| 343102/371472 [5:08:02<2:08:35,  3.68it/s]
 92%|█████████▏| 343103/371472 [5:08:02<2:06:09,  3.75it/s]
 92%|█████████▏| 343104/371472 [5:08:02<2:05:40,  3.76it/s]
 92%|█████████▏| 343105/371472 [5:08:03<2:09:03,  3.66it/s]
 92%|█████████▏| 343106/371472 [5:08:03<2:21:49,  3.33it/s]
 92%|█████████▏| 343107/371472 [5:08:03<2:23:03,  3.30it/s]
 92%|█████████▏| 343108/371472 [5:08:03<2:18:57,  3.40it/s]
 92%|█████████▏| 343109/371472 [5:08:04<2:12:19,  3.57it/s]
 92%|█████████▏| 343110/371472 [5:08:04<2:18:15,  3.42it/s]
 92%|█████████▏| 343111/371472 [5:08:04<2:12:41,  3.56it/s]
 92%|█████████▏| 343112/371472 [5:08:05<2:12:09,  3.58it/s]
 92%|█████████▏| 343113/371472 [5:08:05<2:12:53,  3.56it/s]
 92%|█████████▏| 343114/371472 [5:08:05<2:19:40,  3.38it/s]
 92%|█████████▏| 343115/371472 [5:08:06<2:24:47,  3.26it/s]
 92%|█████████▏| 343116/371472 [5:08:06<2:21:01,  3.35it/s]
 92%|█████████▏| 343117/371472 [5:08:06<2:19:36,  3.39it/s]
 92%|█████████▏| 343118/371472 [5:08:06<2:11:31,  3.59it/s]
 92%|█████████▏| 343119/371472 [5:08:07<2:08:11,  3.69it/s]
 92%|█████████▏| 343120/371472 [5:08:07<2:09:08,  3.66it/s]
                                                           
{'loss': 2.5753, 'learning_rate': 1.687280484388804e-07, 'epoch': 14.78}

 92%|█████████▏| 343120/371472 [5:08:07<2:09:08,  3.66it/s]
 92%|█████████▏| 343121/371472 [5:08:07<2:09:01,  3.66it/s]
 92%|█████████▏| 343122/371472 [5:08:07<2:11:10,  3.60it/s]
 92%|█████████▏| 343123/371472 [5:08:08<2:12:42,  3.56it/s]
 92%|█████████▏| 343124/371472 [5:08:08<2:09:21,  3.65it/s]
 92%|█████████▏| 343125/371472 [5:08:08<2:14:11,  3.52it/s]
 92%|█████████▏| 343126/371472 [5:08:09<2:13:57,  3.53it/s]
 92%|█████████▏| 343127/371472 [5:08:09<2:10:34,  3.62it/s]
 92%|█████████▏| 343128/371472 [5:08:09<2:17:45,  3.43it/s]
 92%|█████████▏| 343129/371472 [5:08:09<2:13:32,  3.54it/s]
 92%|█████████▏| 343130/371472 [5:08:10<2:13:07,  3.55it/s]
 92%|█████████▏| 343131/371472 [5:08:10<2:15:58,  3.47it/s]
 92%|█████████▏| 343132/371472 [5:08:10<2:11:20,  3.60it/s]
 92%|█████████▏| 343133/371472 [5:08:11<2:11:59,  3.58it/s]
 92%|█████████▏| 343134/371472 [5:08:11<2:13:02,  3.55it/s]
 92%|█████████▏| 343135/371472 [5:08:11<2:08:42,  3.67it/s]
 92%|█████████▏| 343136/371472 [5:08:11<2:04:36,  3.79it/s]
 92%|█████████▏| 343137/371472 [5:08:12<2:05:06,  3.77it/s]
 92%|█████████▏| 343138/371472 [5:08:12<2:09:06,  3.66it/s]
 92%|█████████▏| 343139/371472 [5:08:12<2:21:12,  3.34it/s]
 92%|█████████▏| 343140/371472 [5:08:12<2:11:06,  3.60it/s]
                                                           
{'loss': 2.7322, 'learning_rate': 1.6867956646340147e-07, 'epoch': 14.78}

 92%|█████████▏| 343140/371472 [5:08:12<2:11:06,  3.60it/s]
 92%|█████████▏| 343141/371472 [5:08:13<2:06:22,  3.74it/s]
 92%|█████████▏| 343142/371472 [5:08:13<2:02:14,  3.86it/s]
 92%|█████████▏| 343143/371472 [5:08:13<2:14:30,  3.51it/s]
 92%|█████████▏| 343144/371472 [5:08:14<2:11:47,  3.58it/s]
 92%|█████████▏| 343145/371472 [5:08:14<2:09:41,  3.64it/s]
 92%|█████████▏| 343146/371472 [5:08:14<2:10:00,  3.63it/s]
 92%|█████████▏| 343147/371472 [5:08:14<2:12:16,  3.57it/s]
 92%|█████████▏| 343148/371472 [5:08:15<2:11:01,  3.60it/s]
 92%|█████████▏| 343149/371472 [5:08:15<2:09:41,  3.64it/s]
 92%|█████████▏| 343150/371472 [5:08:15<2:14:07,  3.52it/s]
 92%|█████████▏| 343151/371472 [5:08:16<2:13:29,  3.54it/s]
 92%|█████████▏| 343152/371472 [5:08:16<2:14:34,  3.51it/s]
 92%|█████████▏| 343153/371472 [5:08:16<2:14:07,  3.52it/s]
 92%|█████████▏| 343154/371472 [5:08:16<2:12:32,  3.56it/s]
 92%|█████████▏| 343155/371472 [5:08:17<2:23:28,  3.29it/s]
 92%|█████████▏| 343156/371472 [5:08:17<2:16:55,  3.45it/s]
 92%|█████████▏| 343157/371472 [5:08:17<2:15:34,  3.48it/s]
 92%|█████████▏| 343158/371472 [5:08:17<2:08:55,  3.66it/s]
 92%|█████████▏| 343159/371472 [5:08:18<2:14:19,  3.51it/s]
 92%|█████████▏| 343160/371472 [5:08:18<2:10:45,  3.61it/s]
                                                           
{'loss': 2.7668, 'learning_rate': 1.6863108448792265e-07, 'epoch': 14.78}

 92%|█████████▏| 343160/371472 [5:08:18<2:10:45,  3.61it/s]
 92%|█████████▏| 343161/371472 [5:08:18<2:17:55,  3.42it/s]
 92%|█████████▏| 343162/371472 [5:08:19<2:25:01,  3.25it/s]
 92%|█████████▏| 343163/371472 [5:08:19<2:15:30,  3.48it/s]
 92%|█████████▏| 343164/371472 [5:08:19<2:10:16,  3.62it/s]
 92%|█████████▏| 343165/371472 [5:08:20<2:12:20,  3.57it/s]
 92%|█████████▏| 343166/371472 [5:08:20<2:10:06,  3.63it/s]
 92%|█████████▏| 343167/371472 [5:08:20<2:12:50,  3.55it/s]
 92%|█████████▏| 343168/371472 [5:08:20<2:08:59,  3.66it/s]
 92%|█████████▏| 343169/371472 [5:08:21<2:14:00,  3.52it/s]
 92%|█████████▏| 343170/371472 [5:08:21<2:13:38,  3.53it/s]
 92%|█████████▏| 343171/371472 [5:08:21<2:13:39,  3.53it/s]
 92%|█████████▏| 343172/371472 [5:08:21<2:12:57,  3.55it/s]
 92%|█████████▏| 343173/371472 [5:08:22<2:19:33,  3.38it/s]
 92%|█████████▏| 343174/371472 [5:08:22<2:18:31,  3.40it/s]
 92%|█████████▏| 343175/371472 [5:08:22<2:25:35,  3.24it/s]
 92%|█████████▏| 343176/371472 [5:08:23<2:28:07,  3.18it/s]
 92%|█████████▏| 343177/371472 [5:08:23<2:19:52,  3.37it/s]
 92%|█████████▏| 343178/371472 [5:08:23<2:19:30,  3.38it/s]
 92%|█████████▏| 343179/371472 [5:08:24<2:12:37,  3.56it/s]
 92%|█████████▏| 343180/371472 [5:08:24<2:09:39,  3.64it/s]
                                                           
{'loss': 2.5182, 'learning_rate': 1.6858260251244366e-07, 'epoch': 14.78}

 92%|█████████▏| 343180/371472 [5:08:24<2:09:39,  3.64it/s]
 92%|█████████▏| 343181/371472 [5:08:24<2:16:51,  3.45it/s]
 92%|█████████▏| 343182/371472 [5:08:24<2:12:14,  3.57it/s]
 92%|█████████▏| 343183/371472 [5:08:25<2:19:15,  3.39it/s]
 92%|█████████▏| 343184/371472 [5:08:25<2:13:48,  3.52it/s]
 92%|█████████▏| 343185/371472 [5:08:25<2:06:00,  3.74it/s]
 92%|█████████▏| 343186/371472 [5:08:26<2:10:02,  3.63it/s]
 92%|█████████▏| 343187/371472 [5:08:26<2:16:34,  3.45it/s]
 92%|█████████▏| 343188/371472 [5:08:26<2:27:24,  3.20it/s]
 92%|█████████▏| 343189/371472 [5:08:26<2:23:21,  3.29it/s]
 92%|█████████▏| 343190/371472 [5:08:27<2:18:43,  3.40it/s]
 92%|█████████▏| 343191/371472 [5:08:27<2:15:40,  3.47it/s]
 92%|█████████▏| 343192/371472 [5:08:27<2:29:21,  3.16it/s]
 92%|█████████▏| 343193/371472 [5:08:28<2:23:54,  3.28it/s]
 92%|█████████▏| 343194/371472 [5:08:28<2:17:28,  3.43it/s]
 92%|█████████▏| 343195/371472 [5:08:28<2:10:58,  3.60it/s]
 92%|█████████▏| 343196/371472 [5:08:28<2:06:40,  3.72it/s]
 92%|█████████▏| 343197/371472 [5:08:29<2:05:31,  3.75it/s]
 92%|█████████▏| 343198/371472 [5:08:29<2:03:41,  3.81it/s]
 92%|█████████▏| 343199/371472 [5:08:29<1:59:55,  3.93it/s]
 92%|█████████▏| 343200/371472 [5:08:30<2:16:06,  3.46it/s]
                                                           
{'loss': 2.6251, 'learning_rate': 1.6853412053696484e-07, 'epoch': 14.78}

 92%|█████████▏| 343200/371472 [5:08:30<2:16:06,  3.46it/s]
 92%|█████████▏| 343201/371472 [5:08:30<2:10:10,  3.62it/s]
 92%|█████████▏| 343202/371472 [5:08:30<2:13:04,  3.54it/s]
 92%|█████████▏| 343203/371472 [5:08:30<2:11:04,  3.59it/s]
 92%|█████████▏| 343204/371472 [5:08:31<2:13:54,  3.52it/s]
 92%|█████████▏| 343205/371472 [5:08:31<2:07:40,  3.69it/s]
 92%|█████████▏| 343206/371472 [5:08:31<2:11:59,  3.57it/s]
 92%|█████████▏| 343207/371472 [5:08:32<2:13:07,  3.54it/s]
 92%|█████████▏| 343208/371472 [5:08:32<2:14:55,  3.49it/s]
 92%|█████████▏| 343209/371472 [5:08:32<2:14:44,  3.50it/s]
 92%|█████████▏| 343210/371472 [5:08:32<2:09:02,  3.65it/s]
 92%|█████████▏| 343211/371472 [5:08:33<2:11:38,  3.58it/s]
 92%|█████████▏| 343212/371472 [5:08:33<2:09:58,  3.62it/s]
 92%|█████████▏| 343213/371472 [5:08:33<2:09:46,  3.63it/s]
 92%|█████████▏| 343214/371472 [5:08:33<2:08:48,  3.66it/s]
 92%|█████████▏| 343215/371472 [5:08:34<2:14:12,  3.51it/s]
 92%|█████████▏| 343216/371472 [5:08:34<2:13:37,  3.52it/s]
 92%|█████████▏| 343217/371472 [5:08:34<2:20:32,  3.35it/s]
 92%|█████████▏| 343218/371472 [5:08:35<2:17:07,  3.43it/s]
 92%|█████████▏| 343219/371472 [5:08:35<2:11:24,  3.58it/s]
 92%|█████████▏| 343220/371472 [5:08:35<2:20:54,  3.34it/s]
                                                           
{'loss': 2.6019, 'learning_rate': 1.6848563856148594e-07, 'epoch': 14.78}

 92%|█████████▏| 343220/371472 [5:08:35<2:20:54,  3.34it/s]
 92%|█████████▏| 343221/371472 [5:08:35<2:15:49,  3.47it/s]
 92%|█████████▏| 343222/371472 [5:08:36<2:14:30,  3.50it/s]
 92%|█████████▏| 343223/371472 [5:08:36<2:17:35,  3.42it/s]
 92%|█████████▏| 343224/371472 [5:08:36<2:15:45,  3.47it/s]
 92%|█████████▏| 343225/371472 [5:08:37<2:10:41,  3.60it/s]
 92%|█████████▏| 343226/371472 [5:08:37<2:10:18,  3.61it/s]
 92%|█████████▏| 343227/371472 [5:08:37<2:06:41,  3.72it/s]
 92%|█████████▏| 343228/371472 [5:08:37<2:04:46,  3.77it/s]
 92%|█████████▏| 343229/371472 [5:08:38<2:11:03,  3.59it/s]
 92%|█████████▏| 343230/371472 [5:08:38<2:15:42,  3.47it/s]
 92%|█████████▏| 343231/371472 [5:08:38<2:14:53,  3.49it/s]
 92%|█████████▏| 343232/371472 [5:08:39<2:13:37,  3.52it/s]
 92%|█████████▏| 343233/371472 [5:08:39<2:23:04,  3.29it/s]
 92%|█████████▏| 343234/371472 [5:08:39<2:18:20,  3.40it/s]
 92%|█████████▏| 343235/371472 [5:08:40<2:30:57,  3.12it/s]
 92%|█████████▏| 343236/371472 [5:08:40<2:22:34,  3.30it/s]
 92%|█████████▏| 343237/371472 [5:08:40<2:16:30,  3.45it/s]
 92%|█████████▏| 343238/371472 [5:08:40<2:18:04,  3.41it/s]
 92%|█████████▏| 343239/371472 [5:08:41<2:15:43,  3.47it/s]
 92%|█████████▏| 343240/371472 [5:08:41<2:13:43,  3.52it/s]
                                                           
{'loss': 2.7366, 'learning_rate': 1.6843715658600704e-07, 'epoch': 14.78}

 92%|█████████▏| 343240/371472 [5:08:41<2:13:43,  3.52it/s]
 92%|█████████▏| 343241/371472 [5:08:41<2:13:49,  3.52it/s]
 92%|█████████▏| 343242/371472 [5:08:42<2:10:25,  3.61it/s]
 92%|█████████▏| 343243/371472 [5:08:42<2:10:54,  3.59it/s]
 92%|█████████▏| 343244/371472 [5:08:42<2:07:36,  3.69it/s]
 92%|█████████▏| 343245/371472 [5:08:42<2:14:19,  3.50it/s]
 92%|█████████▏| 343246/371472 [5:08:43<2:10:48,  3.60it/s]
 92%|█████████▏| 343247/371472 [5:08:43<2:06:02,  3.73it/s]
 92%|█████████▏| 343248/371472 [5:08:43<2:08:27,  3.66it/s]
 92%|█████████▏| 343249/371472 [5:08:43<2:07:19,  3.69it/s]
 92%|█████████▏| 343250/371472 [5:08:44<2:08:27,  3.66it/s]
 92%|█████████▏| 343251/371472 [5:08:44<2:05:22,  3.75it/s]
 92%|█████████▏| 343252/371472 [5:08:44<2:08:04,  3.67it/s]
 92%|█████████▏| 343253/371472 [5:08:45<2:08:06,  3.67it/s]
 92%|█████████▏| 343254/371472 [5:08:45<2:06:16,  3.72it/s]
 92%|█████████▏| 343255/371472 [5:08:45<2:05:36,  3.74it/s]
 92%|█████████▏| 343256/371472 [5:08:45<2:15:49,  3.46it/s]
 92%|█████████▏| 343257/371472 [5:08:46<2:13:12,  3.53it/s]
 92%|█████████▏| 343258/371472 [5:08:46<2:12:55,  3.54it/s]
 92%|█████████▏| 343259/371472 [5:08:46<2:14:24,  3.50it/s]
 92%|█████████▏| 343260/371472 [5:08:47<2:15:18,  3.47it/s]
                                                           
{'loss': 2.5965, 'learning_rate': 1.683886746105281e-07, 'epoch': 14.78}

 92%|█████████▏| 343260/371472 [5:08:47<2:15:18,  3.47it/s]
 92%|█████████▏| 343261/371472 [5:08:47<2:24:33,  3.25it/s]
 92%|█████████▏| 343262/371472 [5:08:47<2:18:06,  3.40it/s]
 92%|█████████▏| 343263/371472 [5:08:47<2:13:36,  3.52it/s]
 92%|█████████▏| 343264/371472 [5:08:48<2:21:50,  3.31it/s]
 92%|█████████▏| 343265/371472 [5:08:48<2:16:55,  3.43it/s]
 92%|█████████▏| 343266/371472 [5:08:48<2:11:19,  3.58it/s]
 92%|█████████▏| 343267/371472 [5:08:49<2:14:06,  3.51it/s]
 92%|█████████▏| 343268/371472 [5:08:49<2:15:05,  3.48it/s]
 92%|█████████▏| 343269/371472 [5:08:49<2:11:22,  3.58it/s]
 92%|█████████▏| 343270/371472 [5:08:49<2:10:08,  3.61it/s]
 92%|█████████▏| 343271/371472 [5:08:50<2:10:04,  3.61it/s]
 92%|█████████▏| 343272/371472 [5:08:50<2:07:40,  3.68it/s]
 92%|█████████▏| 343273/371472 [5:08:50<2:04:46,  3.77it/s]
 92%|█████████▏| 343274/371472 [5:08:50<2:06:23,  3.72it/s]
 92%|█████████▏| 343275/371472 [5:08:51<2:06:09,  3.72it/s]
 92%|█████████▏| 343276/371472 [5:08:51<2:09:24,  3.63it/s]
 92%|█████████▏| 343277/371472 [5:08:51<2:21:18,  3.33it/s]
 92%|█████████▏| 343278/371472 [5:08:52<2:19:31,  3.37it/s]
 92%|█████████▏| 343279/371472 [5:08:52<2:15:53,  3.46it/s]
 92%|█████████▏| 343280/371472 [5:08:52<2:14:24,  3.50it/s]
                                                           
{'loss': 2.5121, 'learning_rate': 1.6834019263504929e-07, 'epoch': 14.79}

 92%|█████████▏| 343280/371472 [5:08:52<2:14:24,  3.50it/s]
 92%|█████████▏| 343281/371472 [5:08:53<2:20:17,  3.35it/s]
 92%|█████████▏| 343282/371472 [5:08:53<2:24:48,  3.24it/s]
 92%|█████████▏| 343283/371472 [5:08:53<2:37:34,  2.98it/s]
 92%|█████████▏| 343284/371472 [5:08:53<2:23:38,  3.27it/s]
 92%|█████████▏| 343285/371472 [5:08:54<2:28:31,  3.16it/s]
 92%|█████████▏| 343286/371472 [5:08:54<2:18:27,  3.39it/s]
 92%|█████████▏| 343287/371472 [5:08:54<2:16:56,  3.43it/s]
 92%|█████████▏| 343288/371472 [5:08:55<2:22:41,  3.29it/s]
 92%|█████████▏| 343289/371472 [5:08:55<2:13:15,  3.52it/s]
 92%|█████████▏| 343290/371472 [5:08:55<2:13:18,  3.52it/s]
 92%|█████████▏| 343291/371472 [5:08:55<2:11:33,  3.57it/s]
 92%|█████████▏| 343292/371472 [5:08:56<2:08:39,  3.65it/s]
 92%|█████████▏| 343293/371472 [5:08:56<2:11:18,  3.58it/s]
 92%|█████████▏| 343294/371472 [5:08:56<2:10:38,  3.60it/s]
 92%|█████████▏| 343295/371472 [5:08:57<2:11:22,  3.57it/s]
 92%|█████████▏| 343296/371472 [5:08:57<2:09:33,  3.62it/s]
 92%|█████████▏| 343297/371472 [5:08:57<2:13:57,  3.51it/s]
 92%|█████████▏| 343298/371472 [5:08:57<2:19:24,  3.37it/s]
 92%|█████████▏| 343299/371472 [5:08:58<2:17:21,  3.42it/s]
 92%|█████████▏| 343300/371472 [5:08:58<2:14:00,  3.50it/s]
                                                           
{'loss': 2.5029, 'learning_rate': 1.6829171065957033e-07, 'epoch': 14.79}

 92%|█████████▏| 343300/371472 [5:08:58<2:14:00,  3.50it/s]
 92%|█████████▏| 343301/371472 [5:08:58<2:16:11,  3.45it/s]
 92%|█████████▏| 343302/371472 [5:08:59<2:19:29,  3.37it/s]
 92%|█████████▏| 343303/371472 [5:08:59<2:21:28,  3.32it/s]
 92%|█████████▏| 343304/371472 [5:08:59<2:15:32,  3.46it/s]
 92%|█████████▏| 343305/371472 [5:09:00<2:19:14,  3.37it/s]
 92%|█████████▏| 343306/371472 [5:09:00<2:14:32,  3.49it/s]
 92%|█████████▏| 343307/371472 [5:09:00<2:11:40,  3.57it/s]
 92%|█████████▏| 343308/371472 [5:09:00<2:12:53,  3.53it/s]
 92%|█████████▏| 343309/371472 [5:09:01<2:11:58,  3.56it/s]
 92%|█████████▏| 343310/371472 [5:09:01<2:11:50,  3.56it/s]
 92%|█████████▏| 343311/371472 [5:09:01<2:07:02,  3.69it/s]
 92%|█████████▏| 343312/371472 [5:09:01<2:05:24,  3.74it/s]
 92%|█████████▏| 343313/371472 [5:09:02<2:13:19,  3.52it/s]
 92%|█████████▏| 343314/371472 [5:09:02<2:12:25,  3.54it/s]
 92%|█████████▏| 343315/371472 [5:09:02<2:08:28,  3.65it/s]
 92%|█████████▏| 343316/371472 [5:09:03<2:09:29,  3.62it/s]
 92%|█████████▏| 343317/371472 [5:09:03<2:08:52,  3.64it/s]
 92%|█████████▏| 343318/371472 [5:09:03<2:22:27,  3.29it/s]
 92%|█████████▏| 343319/371472 [5:09:03<2:19:27,  3.36it/s]
 92%|█████████▏| 343320/371472 [5:09:04<2:19:00,  3.38it/s]
                                                           
{'loss': 2.5728, 'learning_rate': 1.6824322868409148e-07, 'epoch': 14.79}

 92%|█████████▏| 343320/371472 [5:09:04<2:19:00,  3.38it/s]
 92%|█████████▏| 343321/371472 [5:09:04<2:20:35,  3.34it/s]
 92%|█████████▏| 343322/371472 [5:09:04<2:15:52,  3.45it/s]
 92%|█████████▏| 343323/371472 [5:09:05<2:20:40,  3.33it/s]
 92%|█████████▏| 343324/371472 [5:09:05<2:19:27,  3.36it/s]
 92%|█████████▏| 343325/371472 [5:09:05<2:14:20,  3.49it/s]
 92%|█████████▏| 343326/371472 [5:09:06<2:15:15,  3.47it/s]
 92%|█████████▏| 343327/371472 [5:09:06<2:13:21,  3.52it/s]
 92%|█████████▏| 343328/371472 [5:09:06<2:13:15,  3.52it/s]
 92%|█████████▏| 343329/371472 [5:09:06<2:08:37,  3.65it/s]
 92%|█████████▏| 343330/371472 [5:09:07<2:10:24,  3.60it/s]
 92%|█████████▏| 343331/371472 [5:09:07<2:09:42,  3.62it/s]
 92%|█████████▏| 343332/371472 [5:09:07<2:11:57,  3.55it/s]
 92%|█████████▏| 343333/371472 [5:09:07<2:14:37,  3.48it/s]
 92%|█████████▏| 343334/371472 [5:09:08<2:09:20,  3.63it/s]
 92%|█████████▏| 343335/371472 [5:09:08<2:09:41,  3.62it/s]
 92%|█████████▏| 343336/371472 [5:09:08<2:10:41,  3.59it/s]
 92%|█████████▏| 343337/371472 [5:09:09<2:21:27,  3.31it/s]
 92%|█████████▏| 343338/371472 [5:09:09<2:16:36,  3.43it/s]
 92%|█████████▏| 343339/371472 [5:09:09<2:10:20,  3.60it/s]
 92%|█████████▏| 343340/371472 [5:09:09<2:17:36,  3.41it/s]
                                                           
{'loss': 2.4926, 'learning_rate': 1.6819474670861255e-07, 'epoch': 14.79}

 92%|█████████▏| 343340/371472 [5:09:09<2:17:36,  3.41it/s]
 92%|█████████▏| 343341/371472 [5:09:10<2:15:16,  3.47it/s]
 92%|█████████▏| 343342/371472 [5:09:10<2:12:12,  3.55it/s]
 92%|█████████▏| 343343/371472 [5:09:10<2:10:20,  3.60it/s]
 92%|█████████▏| 343344/371472 [5:09:11<2:08:24,  3.65it/s]
 92%|█████████▏| 343345/371472 [5:09:11<2:07:29,  3.68it/s]
 92%|█████████▏| 343346/371472 [5:09:11<2:06:28,  3.71it/s]
 92%|█████████▏| 343347/371472 [5:09:11<2:08:56,  3.64it/s]
 92%|█████████▏| 343348/371472 [5:09:12<2:09:11,  3.63it/s]
 92%|█████████▏| 343349/371472 [5:09:12<2:11:04,  3.58it/s]
 92%|█████████▏| 343350/371472 [5:09:12<2:14:25,  3.49it/s]
 92%|█████████▏| 343351/371472 [5:09:13<2:09:41,  3.61it/s]
 92%|█████████▏| 343352/371472 [5:09:13<2:07:41,  3.67it/s]
 92%|█████████▏| 343353/371472 [5:09:13<2:05:50,  3.72it/s]
 92%|█████████▏| 343354/371472 [5:09:13<2:01:27,  3.86it/s]
 92%|█████████▏| 343355/371472 [5:09:14<2:04:20,  3.77it/s]
 92%|█████████▏| 343356/371472 [5:09:14<2:12:59,  3.52it/s]
 92%|█████████▏| 343357/371472 [5:09:14<2:09:37,  3.61it/s]
 92%|█████████▏| 343358/371472 [5:09:14<2:14:05,  3.49it/s]
 92%|█████████▏| 343359/371472 [5:09:15<2:20:28,  3.34it/s]
 92%|█████████▏| 343360/371472 [5:09:15<2:31:22,  3.10it/s]
                                                           
{'loss': 2.6545, 'learning_rate': 1.681462647331336e-07, 'epoch': 14.79}

 92%|█████████▏| 343360/371472 [5:09:15<2:31:22,  3.10it/s]
 92%|█████████▏| 343361/371472 [5:09:15<2:29:37,  3.13it/s]
 92%|█████████▏| 343362/371472 [5:09:16<2:20:53,  3.33it/s]
 92%|█████████▏| 343363/371472 [5:09:16<2:15:40,  3.45it/s]
 92%|█████████▏| 343364/371472 [5:09:16<2:21:18,  3.32it/s]
 92%|█████████▏| 343365/371472 [5:09:17<2:21:06,  3.32it/s]
 92%|█████████▏| 343366/371472 [5:09:17<2:21:06,  3.32it/s]
 92%|█████████▏| 343367/371472 [5:09:17<2:16:57,  3.42it/s]
 92%|█████████▏| 343368/371472 [5:09:17<2:16:53,  3.42it/s]
 92%|█████████▏| 343369/371472 [5:09:18<2:13:53,  3.50it/s]
 92%|█████████▏| 343370/371472 [5:09:18<2:20:55,  3.32it/s]
 92%|█████████▏| 343371/371472 [5:09:18<2:13:58,  3.50it/s]
 92%|█████████▏| 343372/371472 [5:09:19<2:10:06,  3.60it/s]
 92%|█████████▏| 343373/371472 [5:09:19<2:19:19,  3.36it/s]
 92%|█████████▏| 343374/371472 [5:09:19<2:14:41,  3.48it/s]
 92%|█████████▏| 343375/371472 [5:09:19<2:10:44,  3.58it/s]
 92%|█████████▏| 343376/371472 [5:09:20<2:06:38,  3.70it/s]
 92%|█████████▏| 343377/371472 [5:09:20<2:06:54,  3.69it/s]
 92%|█████████▏| 343378/371472 [5:09:20<2:06:41,  3.70it/s]
 92%|█████████▏| 343379/371472 [5:09:21<2:07:34,  3.67it/s]
 92%|█████████▏| 343380/371472 [5:09:21<2:15:58,  3.44it/s]
                                                           
{'loss': 2.663, 'learning_rate': 1.6809778275765475e-07, 'epoch': 14.79}

 92%|█████████▏| 343380/371472 [5:09:21<2:15:58,  3.44it/s]
 92%|█████████▏| 343381/371472 [5:09:21<2:15:16,  3.46it/s]
 92%|█████████▏| 343382/371472 [5:09:21<2:10:33,  3.59it/s]
 92%|█████████▏| 343383/371472 [5:09:22<2:12:25,  3.54it/s]
 92%|█████████▏| 343384/371472 [5:09:22<2:16:28,  3.43it/s]
 92%|█████████▏| 343385/371472 [5:09:22<2:13:15,  3.51it/s]
 92%|█████████▏| 343386/371472 [5:09:23<2:11:47,  3.55it/s]
 92%|█████████▏| 343387/371472 [5:09:23<2:17:15,  3.41it/s]
 92%|█████████▏| 343388/371472 [5:09:23<2:15:10,  3.46it/s]
 92%|█████████▏| 343389/371472 [5:09:23<2:14:01,  3.49it/s]
 92%|█████████▏| 343390/371472 [5:09:24<2:08:12,  3.65it/s]
 92%|█████████▏| 343391/371472 [5:09:24<2:06:34,  3.70it/s]
 92%|█████████▏| 343392/371472 [5:09:24<2:04:58,  3.74it/s]
 92%|█████████▏| 343393/371472 [5:09:24<2:06:03,  3.71it/s]
 92%|█████████▏| 343394/371472 [5:09:25<2:04:48,  3.75it/s]
 92%|█████████▏| 343395/371472 [5:09:25<2:06:53,  3.69it/s]
 92%|█████████▏| 343396/371472 [5:09:25<2:03:19,  3.79it/s]
 92%|█████████▏| 343397/371472 [5:09:26<2:10:38,  3.58it/s]
 92%|█████████▏| 343398/371472 [5:09:26<2:22:04,  3.29it/s]
 92%|█████████▏| 343399/371472 [5:09:26<2:21:37,  3.30it/s]
 92%|█████████▏| 343400/371472 [5:09:26<2:15:49,  3.44it/s]
                                                           
{'loss': 2.7356, 'learning_rate': 1.6804930078217582e-07, 'epoch': 14.79}

 92%|█████████▏| 343400/371472 [5:09:26<2:15:49,  3.44it/s]
 92%|█████████▏| 343401/371472 [5:09:27<2:12:49,  3.52it/s]
 92%|█████████▏| 343402/371472 [5:09:27<2:13:43,  3.50it/s]
 92%|█████████▏| 343403/371472 [5:09:27<2:14:05,  3.49it/s]
 92%|█████████▏| 343404/371472 [5:09:28<2:10:35,  3.58it/s]
 92%|█████████▏| 343405/371472 [5:09:28<2:07:19,  3.67it/s]
 92%|█████████▏| 343406/371472 [5:09:28<2:05:48,  3.72it/s]
 92%|█████████▏| 343407/371472 [5:09:28<2:04:30,  3.76it/s]
 92%|█████████▏| 343408/371472 [5:09:29<2:03:38,  3.78it/s]
 92%|█████████▏| 343409/371472 [5:09:29<2:10:15,  3.59it/s]
 92%|█████████▏| 343410/371472 [5:09:29<2:10:45,  3.58it/s]
 92%|█████████▏| 343411/371472 [5:09:30<2:24:20,  3.24it/s]
 92%|█████████▏| 343412/371472 [5:09:30<2:21:00,  3.32it/s]
 92%|█████████▏| 343413/371472 [5:09:30<2:18:40,  3.37it/s]
 92%|█████████▏| 343414/371472 [5:09:30<2:10:42,  3.58it/s]
 92%|█████████▏| 343415/371472 [5:09:31<2:15:04,  3.46it/s]
 92%|█████████▏| 343416/371472 [5:09:31<2:13:05,  3.51it/s]
 92%|█████████▏| 343417/371472 [5:09:31<2:18:39,  3.37it/s]
 92%|█████████▏| 343418/371472 [5:09:32<2:27:24,  3.17it/s]
 92%|█████████▏| 343419/371472 [5:09:32<2:19:00,  3.36it/s]
 92%|█████████▏| 343420/371472 [5:09:32<2:12:59,  3.52it/s]
                                                           
{'loss': 2.679, 'learning_rate': 1.6800081880669697e-07, 'epoch': 14.79}

 92%|█████████▏| 343420/371472 [5:09:32<2:12:59,  3.52it/s]
 92%|█████████▏| 343421/371472 [5:09:33<2:24:28,  3.24it/s]
 92%|█████████▏| 343422/371472 [5:09:33<2:17:53,  3.39it/s]
 92%|█████████▏| 343423/371472 [5:09:33<2:14:14,  3.48it/s]
 92%|█████████▏| 343424/371472 [5:09:33<2:09:19,  3.61it/s]
 92%|█████████▏| 343425/371472 [5:09:34<2:18:58,  3.36it/s]
 92%|█████████▏| 343426/371472 [5:09:34<2:11:31,  3.55it/s]
 92%|█████████▏| 343427/371472 [5:09:34<2:09:15,  3.62it/s]
 92%|█████████▏| 343428/371472 [5:09:35<2:17:24,  3.40it/s]
 92%|█████████▏| 343429/371472 [5:09:35<2:15:17,  3.45it/s]
 92%|█████████▏| 343430/371472 [5:09:35<2:21:46,  3.30it/s]
 92%|█████████▏| 343431/371472 [5:09:35<2:28:11,  3.15it/s]
 92%|█████████▏| 343432/371472 [5:09:36<2:19:16,  3.36it/s]
 92%|█████████▏| 343433/371472 [5:09:36<2:19:16,  3.36it/s]
 92%|█████████▏| 343434/371472 [5:09:36<2:19:12,  3.36it/s]
 92%|█████████▏| 343435/371472 [5:09:37<2:13:50,  3.49it/s]
 92%|█████████▏| 343436/371472 [5:09:37<2:06:23,  3.70it/s]
 92%|█████████▏| 343437/371472 [5:09:37<2:20:51,  3.32it/s]
 92%|█████████▏| 343438/371472 [5:09:37<2:11:24,  3.56it/s]
 92%|█████████▏| 343439/371472 [5:09:38<2:15:00,  3.46it/s]
 92%|█████████▏| 343440/371472 [5:09:38<2:08:58,  3.62it/s]
                                                           
{'loss': 2.6834, 'learning_rate': 1.6795233683121802e-07, 'epoch': 14.79}

 92%|█████████▏| 343440/371472 [5:09:38<2:08:58,  3.62it/s]
 92%|█████████▏| 343441/371472 [5:09:38<2:24:45,  3.23it/s]
 92%|█████████▏| 343442/371472 [5:09:39<2:28:30,  3.15it/s]
 92%|█████████▏| 343443/371472 [5:09:39<2:32:01,  3.07it/s]
 92%|█████████▏| 343444/371472 [5:09:39<2:32:17,  3.07it/s]
 92%|█████████▏| 343445/371472 [5:09:40<2:27:42,  3.16it/s]
 92%|█████████▏| 343446/371472 [5:09:40<2:17:05,  3.41it/s]
 92%|█████████▏| 343447/371472 [5:09:40<2:18:03,  3.38it/s]
 92%|█████████▏| 343448/371472 [5:09:40<2:09:58,  3.59it/s]
 92%|█████████▏| 343449/371472 [5:09:41<2:12:06,  3.54it/s]
 92%|█████████▏| 343450/371472 [5:09:41<2:17:04,  3.41it/s]
 92%|█████████▏| 343451/371472 [5:09:41<2:17:56,  3.39it/s]
 92%|█████████▏| 343452/371472 [5:09:42<2:15:08,  3.46it/s]
 92%|█████████▏| 343453/371472 [5:09:42<2:20:05,  3.33it/s]
 92%|█████████▏| 343454/371472 [5:09:42<2:18:32,  3.37it/s]
 92%|█████████▏| 343455/371472 [5:09:43<2:15:33,  3.44it/s]
 92%|█████████▏| 343456/371472 [5:09:43<2:14:55,  3.46it/s]
 92%|█████████▏| 343457/371472 [5:09:43<2:10:15,  3.58it/s]
 92%|█████████▏| 343458/371472 [5:09:43<2:09:06,  3.62it/s]
 92%|█████████▏| 343459/371472 [5:09:44<2:07:36,  3.66it/s]
 92%|█████████▏| 343460/371472 [5:09:44<2:05:24,  3.72it/s]
                                                           
{'loss': 2.5731, 'learning_rate': 1.679038548557392e-07, 'epoch': 14.79}

 92%|█████████▏| 343460/371472 [5:09:44<2:05:24,  3.72it/s]
 92%|█████████▏| 343461/371472 [5:09:44<2:10:02,  3.59it/s]
 92%|█████████▏| 343462/371472 [5:09:44<2:10:14,  3.58it/s]
 92%|█████████▏| 343463/371472 [5:09:45<2:22:07,  3.28it/s]
 92%|█████████▏| 343464/371472 [5:09:45<2:25:20,  3.21it/s]
 92%|█████████▏| 343465/371472 [5:09:46<2:30:37,  3.10it/s]
 92%|█████████▏| 343466/371472 [5:09:46<2:22:21,  3.28it/s]
 92%|█████████▏| 343467/371472 [5:09:46<2:20:36,  3.32it/s]
 92%|█████████▏| 343468/371472 [5:09:46<2:18:38,  3.37it/s]
 92%|█████████▏| 343469/371472 [5:09:47<2:22:47,  3.27it/s]
 92%|█████████▏| 343470/371472 [5:09:47<2:16:11,  3.43it/s]
 92%|█████████▏| 343471/371472 [5:09:47<2:15:42,  3.44it/s]
 92%|█████████▏| 343472/371472 [5:09:47<2:12:01,  3.53it/s]
 92%|█████████▏| 343473/371472 [5:09:48<2:07:50,  3.65it/s]
 92%|█████████▏| 343474/371472 [5:09:48<2:10:09,  3.59it/s]
 92%|█████████▏| 343475/371472 [5:09:48<2:09:42,  3.60it/s]
 92%|█████████▏| 343476/371472 [5:09:49<2:07:23,  3.66it/s]
 92%|█████████▏| 343477/371472 [5:09:49<2:13:11,  3.50it/s]
 92%|█████████▏| 343478/371472 [5:09:49<2:09:52,  3.59it/s]
 92%|█████████▏| 343479/371472 [5:09:49<2:08:32,  3.63it/s]
 92%|█████████▏| 343480/371472 [5:09:50<2:08:24,  3.63it/s]
                                                           
{'loss': 2.635, 'learning_rate': 1.6785537288026027e-07, 'epoch': 14.79}

 92%|█████████▏| 343480/371472 [5:09:50<2:08:24,  3.63it/s]
 92%|█████████▏| 343481/371472 [5:09:50<2:08:13,  3.64it/s]
 92%|█████████▏| 343482/371472 [5:09:50<2:04:05,  3.76it/s]
 92%|█████████▏| 343483/371472 [5:09:50<2:05:31,  3.72it/s]
 92%|█████████▏| 343484/371472 [5:09:51<2:04:35,  3.74it/s]
 92%|█████████▏| 343485/371472 [5:09:51<2:02:24,  3.81it/s]
 92%|█████████▏| 343486/371472 [5:09:51<2:00:29,  3.87it/s]
 92%|█████████▏| 343487/371472 [5:09:52<2:06:33,  3.69it/s]
 92%|█████████▏| 343488/371472 [5:09:52<2:05:09,  3.73it/s]
 92%|█████████▏| 343489/371472 [5:09:52<2:09:14,  3.61it/s]
 92%|█████████▏| 343490/371472 [5:09:52<2:12:57,  3.51it/s]
 92%|█████████▏| 343491/371472 [5:09:53<2:10:24,  3.58it/s]
 92%|█████████▏| 343492/371472 [5:09:53<2:08:13,  3.64it/s]
 92%|█████████▏| 343493/371472 [5:09:53<2:06:49,  3.68it/s]
 92%|█████████▏| 343494/371472 [5:09:54<2:10:34,  3.57it/s]
 92%|█████████▏| 343495/371472 [5:09:54<2:17:45,  3.38it/s]
 92%|█████████▏| 343496/371472 [5:09:54<2:11:41,  3.54it/s]
 92%|█████████▏| 343497/371472 [5:09:54<2:12:00,  3.53it/s]
 92%|█████████▏| 343498/371472 [5:09:55<2:12:53,  3.51it/s]
 92%|█████████▏| 343499/371472 [5:09:55<2:10:42,  3.57it/s]
 92%|█████████▏| 343500/371472 [5:09:55<2:22:30,  3.27it/s]
                                                           
{'loss': 2.6227, 'learning_rate': 1.678068909047814e-07, 'epoch': 14.8}

 92%|█████████▏| 343500/371472 [5:09:55<2:22:30,  3.27it/s]
 92%|█████████▏| 343501/371472 [5:09:56<2:14:27,  3.47it/s]
 92%|█████████▏| 343502/371472 [5:09:56<2:14:16,  3.47it/s]
 92%|█████████▏| 343503/371472 [5:09:56<2:13:56,  3.48it/s]
 92%|█████████▏| 343504/371472 [5:09:56<2:18:46,  3.36it/s]
 92%|█████████▏| 343505/371472 [5:09:57<2:11:04,  3.56it/s]
 92%|█████████▏| 343506/371472 [5:09:57<2:12:13,  3.52it/s]
 92%|█████████▏| 343507/371472 [5:09:57<2:09:18,  3.60it/s]
 92%|█████████▏| 343508/371472 [5:09:58<2:08:14,  3.63it/s]
 92%|█████████▏| 343509/371472 [5:09:58<2:04:31,  3.74it/s]
 92%|█████████▏| 343510/371472 [5:09:58<2:03:45,  3.77it/s]
 92%|█████████▏| 343511/371472 [5:09:58<2:03:41,  3.77it/s]
 92%|█████████▏| 343512/371472 [5:09:59<2:03:45,  3.77it/s]
 92%|█████████▏| 343513/371472 [5:09:59<2:11:38,  3.54it/s]
 92%|█████████▏| 343514/371472 [5:09:59<2:06:29,  3.68it/s]
 92%|█████████▏| 343515/371472 [5:09:59<2:09:46,  3.59it/s]
 92%|█████████▏| 343516/371472 [5:10:00<2:10:30,  3.57it/s]
 92%|█████████▏| 343517/371472 [5:10:00<2:13:01,  3.50it/s]
 92%|█████████▏| 343518/371472 [5:10:00<2:11:34,  3.54it/s]
 92%|█████████▏| 343519/371472 [5:10:01<2:10:16,  3.58it/s]
 92%|█████████▏| 343520/371472 [5:10:01<2:04:41,  3.74it/s]
                                                           
{'loss': 2.594, 'learning_rate': 1.6775840892930246e-07, 'epoch': 14.8}

 92%|█████████▏| 343520/371472 [5:10:01<2:04:41,  3.74it/s]
 92%|█████████▏| 343521/371472 [5:10:01<2:01:31,  3.83it/s]
 92%|█████████▏| 343522/371472 [5:10:01<2:06:25,  3.68it/s]
 92%|█████████▏| 343523/371472 [5:10:02<2:08:33,  3.62it/s]
 92%|█████████▏| 343524/371472 [5:10:02<2:16:14,  3.42it/s]
 92%|█████████▏| 343525/371472 [5:10:02<2:11:49,  3.53it/s]
 92%|█████████▏| 343526/371472 [5:10:02<2:09:38,  3.59it/s]
 92%|█████████▏| 343527/371472 [5:10:03<2:07:45,  3.65it/s]
 92%|█████████▏| 343528/371472 [5:10:03<2:08:49,  3.62it/s]
 92%|█████████▏| 343529/371472 [5:10:03<2:10:10,  3.58it/s]
 92%|█████████▏| 343530/371472 [5:10:04<2:20:44,  3.31it/s]
 92%|█████████▏| 343531/371472 [5:10:04<2:22:54,  3.26it/s]
 92%|█████████▏| 343532/371472 [5:10:04<2:16:12,  3.42it/s]
 92%|█████████▏| 343533/371472 [5:10:05<2:21:08,  3.30it/s]
 92%|█████████▏| 343534/371472 [5:10:05<2:19:52,  3.33it/s]
 92%|█████████▏| 343535/371472 [5:10:05<2:15:30,  3.44it/s]
 92%|█████████▏| 343536/371472 [5:10:05<2:12:10,  3.52it/s]
 92%|█████████▏| 343537/371472 [5:10:06<2:08:37,  3.62it/s]
 92%|█████████▏| 343538/371472 [5:10:06<2:09:35,  3.59it/s]
 92%|█████████▏| 343539/371472 [5:10:06<2:13:47,  3.48it/s]
 92%|█████████▏| 343540/371472 [5:10:07<2:14:04,  3.47it/s]
                                                           
{'loss': 2.6105, 'learning_rate': 1.6770992695382364e-07, 'epoch': 14.8}

 92%|█████████▏| 343540/371472 [5:10:07<2:14:04,  3.47it/s]
 92%|█████████▏| 343541/371472 [5:10:07<2:07:57,  3.64it/s]
 92%|█████████▏| 343542/371472 [5:10:07<2:23:55,  3.23it/s]
 92%|█████████▏| 343543/371472 [5:10:07<2:20:23,  3.32it/s]
 92%|█████████▏| 343544/371472 [5:10:08<2:17:10,  3.39it/s]
 92%|█████████▏| 343545/371472 [5:10:08<2:21:25,  3.29it/s]
 92%|█████████▏| 343546/371472 [5:10:08<2:15:59,  3.42it/s]
 92%|█████████▏| 343547/371472 [5:10:09<2:10:38,  3.56it/s]
 92%|█████████▏| 343548/371472 [5:10:09<2:09:25,  3.60it/s]
 92%|█████████▏| 343549/371472 [5:10:09<2:22:50,  3.26it/s]
 92%|█████████▏| 343550/371472 [5:10:10<2:32:50,  3.04it/s]
 92%|█████████▏| 343551/371472 [5:10:10<2:25:36,  3.20it/s]
 92%|█████████▏| 343552/371472 [5:10:10<2:29:06,  3.12it/s]
 92%|█████████▏| 343553/371472 [5:10:11<2:27:05,  3.16it/s]
 92%|█████████▏| 343554/371472 [5:10:11<2:24:22,  3.22it/s]
 92%|█████████▏| 343555/371472 [5:10:11<2:23:31,  3.24it/s]
 92%|█████████▏| 343556/371472 [5:10:11<2:17:23,  3.39it/s]
 92%|█████████▏| 343557/371472 [5:10:12<2:15:40,  3.43it/s]
 92%|█████████▏| 343558/371472 [5:10:12<2:13:13,  3.49it/s]
 92%|█████████▏| 343559/371472 [5:10:12<2:08:46,  3.61it/s]
 92%|█████████▏| 343560/371472 [5:10:12<2:07:46,  3.64it/s]
                                                           
{'loss': 2.5951, 'learning_rate': 1.6766144497834468e-07, 'epoch': 14.8}

 92%|█████████▏| 343560/371472 [5:10:12<2:07:46,  3.64it/s]
 92%|█████████▏| 343561/371472 [5:10:13<2:05:39,  3.70it/s]
 92%|█████████▏| 343562/371472 [5:10:13<2:04:59,  3.72it/s]
 92%|█████████▏| 343563/371472 [5:10:13<2:01:35,  3.83it/s]
 92%|█████████▏| 343564/371472 [5:10:14<2:08:07,  3.63it/s]
 92%|█████████▏| 343565/371472 [5:10:14<2:08:36,  3.62it/s]
 92%|█████████▏| 343566/371472 [5:10:14<2:05:34,  3.70it/s]
 92%|█████████▏| 343567/371472 [5:10:14<2:05:28,  3.71it/s]
 92%|█████████▏| 343568/371472 [5:10:15<2:03:45,  3.76it/s]
 92%|█████████▏| 343569/371472 [5:10:15<2:13:14,  3.49it/s]
 92%|█████████▏| 343570/371472 [5:10:15<2:07:31,  3.65it/s]
 92%|█████████▏| 343571/371472 [5:10:16<2:17:28,  3.38it/s]
 92%|█████████▏| 343572/371472 [5:10:16<2:27:11,  3.16it/s]
 92%|█████████▏| 343573/371472 [5:10:16<2:23:14,  3.25it/s]
 92%|█████████▏| 343574/371472 [5:10:16<2:18:54,  3.35it/s]
 92%|█████████▏| 343575/371472 [5:10:17<2:14:31,  3.46it/s]
 92%|█████████▏| 343576/371472 [5:10:17<2:17:21,  3.38it/s]
 92%|█████████▏| 343577/371472 [5:10:17<2:10:13,  3.57it/s]
 92%|█████████▏| 343578/371472 [5:10:18<2:08:29,  3.62it/s]
 92%|█████████▏| 343579/371472 [5:10:18<2:03:22,  3.77it/s]
 92%|█████████▏| 343580/371472 [5:10:18<2:08:58,  3.60it/s]
                                                           
{'loss': 2.5114, 'learning_rate': 1.6761296300286583e-07, 'epoch': 14.8}

 92%|█████████▏| 343580/371472 [5:10:18<2:08:58,  3.60it/s]
 92%|█████████▏| 343581/371472 [5:10:18<2:05:47,  3.70it/s]
 92%|█████████▏| 343582/371472 [5:10:19<2:08:36,  3.61it/s]
 92%|█████████▏| 343583/371472 [5:10:19<2:04:30,  3.73it/s]
 92%|█████████▏| 343584/371472 [5:10:19<2:02:46,  3.79it/s]
 92%|█████████▏| 343585/371472 [5:10:19<2:07:43,  3.64it/s]
 92%|█████████▏| 343586/371472 [5:10:20<2:06:45,  3.67it/s]
 92%|█████████▏| 343587/371472 [5:10:20<2:05:43,  3.70it/s]
 92%|█████████▏| 343588/371472 [5:10:20<2:07:51,  3.63it/s]
 92%|█████████▏| 343589/371472 [5:10:21<2:05:12,  3.71it/s]
 92%|█████████▏| 343590/371472 [5:10:21<2:08:10,  3.63it/s]
 92%|█████████▏| 343591/371472 [5:10:21<2:13:04,  3.49it/s]
 92%|█████████▏| 343592/371472 [5:10:21<2:11:13,  3.54it/s]
 92%|█████████▏| 343593/371472 [5:10:22<2:06:50,  3.66it/s]
 92%|█████████▏| 343594/371472 [5:10:22<2:15:31,  3.43it/s]
 92%|█████████▏| 343595/371472 [5:10:22<2:11:02,  3.55it/s]
 92%|█████████▏| 343596/371472 [5:10:23<2:08:57,  3.60it/s]
 92%|█████████▏| 343597/371472 [5:10:23<2:11:10,  3.54it/s]
 92%|█████████▏| 343598/371472 [5:10:23<2:09:00,  3.60it/s]
 92%|█████████▏| 343599/371472 [5:10:23<2:13:07,  3.49it/s]
 92%|█████████▏| 343600/371472 [5:10:24<2:12:55,  3.49it/s]
                                                           
{'loss': 2.617, 'learning_rate': 1.675644810273869e-07, 'epoch': 14.8}

 92%|█████████▏| 343600/371472 [5:10:24<2:12:55,  3.49it/s]
 92%|█████████▏| 343601/371472 [5:10:24<2:08:37,  3.61it/s]
 92%|█████████▏| 343602/371472 [5:10:24<2:14:36,  3.45it/s]
 92%|█████████▏| 343603/371472 [5:10:24<2:10:21,  3.56it/s]
 92%|█████████▏| 343604/371472 [5:10:25<2:09:07,  3.60it/s]
 92%|█████████▏| 343605/371472 [5:10:25<2:14:56,  3.44it/s]
 92%|█████████▏| 343606/371472 [5:10:25<2:23:42,  3.23it/s]
 92%|█████████▏| 343607/371472 [5:10:26<2:29:28,  3.11it/s]
 92%|█████████▏| 343608/371472 [5:10:26<2:24:57,  3.20it/s]
 92%|█████████▏| 343609/371472 [5:10:26<2:20:47,  3.30it/s]
 92%|█████████▏| 343610/371472 [5:10:27<2:16:09,  3.41it/s]
 92%|█████████▏| 343611/371472 [5:10:27<2:14:19,  3.46it/s]
 93%|█████████▎| 343612/371472 [5:10:27<2:10:23,  3.56it/s]
 93%|█████████▎| 343613/371472 [5:10:27<2:04:27,  3.73it/s]
 93%|█████████▎| 343614/371472 [5:10:28<2:03:49,  3.75it/s]
 93%|█████████▎| 343615/371472 [5:10:28<2:13:54,  3.47it/s]
 93%|█████████▎| 343616/371472 [5:10:28<2:10:08,  3.57it/s]
 93%|█████████▎| 343617/371472 [5:10:29<2:17:32,  3.38it/s]
 93%|█████████▎| 343618/371472 [5:10:29<2:22:36,  3.26it/s]
 93%|█████████▎| 343619/371472 [5:10:29<2:18:36,  3.35it/s]
 93%|█████████▎| 343620/371472 [5:10:29<2:11:21,  3.53it/s]
                                                           
{'loss': 2.6254, 'learning_rate': 1.6751599905190806e-07, 'epoch': 14.8}

 93%|█████████▎| 343620/371472 [5:10:29<2:11:21,  3.53it/s]
 93%|█████████▎| 343621/371472 [5:10:30<2:08:44,  3.61it/s]
 93%|█████████▎| 343622/371472 [5:10:30<2:23:38,  3.23it/s]
 93%|█████████▎| 343623/371472 [5:10:30<2:14:44,  3.44it/s]
 93%|█████████▎| 343624/371472 [5:10:31<2:09:18,  3.59it/s]
 93%|█████████▎| 343625/371472 [5:10:31<2:07:48,  3.63it/s]
 93%|█████████▎| 343626/371472 [5:10:31<2:06:14,  3.68it/s]
 93%|█████████▎| 343627/371472 [5:10:31<2:09:44,  3.58it/s]
 93%|█████████▎| 343628/371472 [5:10:32<2:19:37,  3.32it/s]
 93%|█████████▎| 343629/371472 [5:10:32<2:17:40,  3.37it/s]
 93%|█████████▎| 343630/371472 [5:10:32<2:14:31,  3.45it/s]
 93%|█████████▎| 343631/371472 [5:10:33<2:15:40,  3.42it/s]
 93%|█████████▎| 343632/371472 [5:10:33<2:19:02,  3.34it/s]
 93%|█████████▎| 343633/371472 [5:10:33<2:18:59,  3.34it/s]
 93%|█████████▎| 343634/371472 [5:10:34<2:12:24,  3.50it/s]
 93%|█████████▎| 343635/371472 [5:10:34<2:18:50,  3.34it/s]
 93%|█████████▎| 343636/371472 [5:10:34<2:23:59,  3.22it/s]
 93%|█████████▎| 343637/371472 [5:10:34<2:20:02,  3.31it/s]
 93%|█████████▎| 343638/371472 [5:10:35<2:19:01,  3.34it/s]
 93%|█████████▎| 343639/371472 [5:10:35<2:14:22,  3.45it/s]
 93%|█████████▎| 343640/371472 [5:10:35<2:09:43,  3.58it/s]
                                                           
{'loss': 2.5578, 'learning_rate': 1.6746751707642913e-07, 'epoch': 14.8}

 93%|█████████▎| 343640/371472 [5:10:35<2:09:43,  3.58it/s]
 93%|█████████▎| 343641/371472 [5:10:36<2:10:11,  3.56it/s]
 93%|█████████▎| 343642/371472 [5:10:36<2:14:41,  3.44it/s]
 93%|█████████▎| 343643/371472 [5:10:36<2:17:56,  3.36it/s]
 93%|█████████▎| 343644/371472 [5:10:36<2:16:02,  3.41it/s]
 93%|█████████▎| 343645/371472 [5:10:37<2:10:53,  3.54it/s]
 93%|█████████▎| 343646/371472 [5:10:37<2:14:52,  3.44it/s]
 93%|█████████▎| 343647/371472 [5:10:37<2:12:51,  3.49it/s]
 93%|█████████▎| 343648/371472 [5:10:38<2:12:52,  3.49it/s]
 93%|█████████▎| 343649/371472 [5:10:38<2:09:42,  3.57it/s]
 93%|█████████▎| 343650/371472 [5:10:38<2:13:41,  3.47it/s]
 93%|█████████▎| 343651/371472 [5:10:38<2:06:48,  3.66it/s]
 93%|█████████▎| 343652/371472 [5:10:39<2:17:02,  3.38it/s]
 93%|█████████▎| 343653/371472 [5:10:39<2:11:27,  3.53it/s]
 93%|█████████▎| 343654/371472 [5:10:39<2:14:32,  3.45it/s]
 93%|█████████▎| 343655/371472 [5:10:40<2:11:28,  3.53it/s]
 93%|█████████▎| 343656/371472 [5:10:40<2:15:08,  3.43it/s]
 93%|█████████▎| 343657/371472 [5:10:40<2:18:57,  3.34it/s]
 93%|█████████▎| 343658/371472 [5:10:40<2:10:40,  3.55it/s]
 93%|█████████▎| 343659/371472 [5:10:41<2:22:40,  3.25it/s]
 93%|█████████▎| 343660/371472 [5:10:41<2:19:58,  3.31it/s]
                                                           
{'loss': 2.4715, 'learning_rate': 1.6741903510095028e-07, 'epoch': 14.8}

 93%|█████████▎| 343660/371472 [5:10:41<2:19:58,  3.31it/s]
 93%|█████████▎| 343661/371472 [5:10:41<2:16:48,  3.39it/s]
 93%|█████████▎| 343662/371472 [5:10:42<2:08:57,  3.59it/s]
 93%|█████████▎| 343663/371472 [5:10:42<2:08:30,  3.61it/s]
 93%|█████████▎| 343664/371472 [5:10:42<2:07:01,  3.65it/s]
 93%|█████████▎| 343665/371472 [5:10:42<2:04:13,  3.73it/s]
 93%|█████████▎| 343666/371472 [5:10:43<2:06:46,  3.66it/s]
 93%|█████████▎| 343667/371472 [5:10:43<2:24:53,  3.20it/s]
 93%|█████████▎| 343668/371472 [5:10:43<2:20:20,  3.30it/s]
 93%|█████████▎| 343669/371472 [5:10:44<2:16:06,  3.40it/s]
 93%|█████████▎| 343670/371472 [5:10:44<2:16:06,  3.40it/s]
 93%|█████████▎| 343671/371472 [5:10:44<2:15:43,  3.41it/s]
 93%|█████████▎| 343672/371472 [5:10:45<2:11:13,  3.53it/s]
 93%|█████████▎| 343673/371472 [5:10:45<2:12:11,  3.50it/s]
 93%|█████████▎| 343674/371472 [5:10:45<2:10:06,  3.56it/s]
 93%|█████████▎| 343675/371472 [5:10:45<2:13:18,  3.48it/s]
 93%|█████████▎| 343676/371472 [5:10:46<2:09:21,  3.58it/s]
 93%|█████████▎| 343677/371472 [5:10:46<2:07:19,  3.64it/s]
 93%|█████████▎| 343678/371472 [5:10:46<2:12:11,  3.50it/s]
 93%|█████████▎| 343679/371472 [5:10:46<2:06:45,  3.65it/s]
 93%|█████████▎| 343680/371472 [5:10:47<2:05:04,  3.70it/s]
                                                           
{'loss': 2.718, 'learning_rate': 1.6737055312547132e-07, 'epoch': 14.8}

 93%|█████████▎| 343680/371472 [5:10:47<2:05:04,  3.70it/s]
 93%|█████████▎| 343681/371472 [5:10:47<2:06:23,  3.66it/s]
 93%|█████████▎| 343682/371472 [5:10:47<2:06:59,  3.65it/s]
 93%|█████████▎| 343683/371472 [5:10:48<2:05:48,  3.68it/s]
 93%|█████████▎| 343684/371472 [5:10:48<2:07:33,  3.63it/s]
 93%|█████████▎| 343685/371472 [5:10:48<2:06:02,  3.67it/s]
 93%|█████████▎| 343686/371472 [5:10:48<2:08:01,  3.62it/s]
 93%|█████████▎| 343687/371472 [5:10:49<2:10:16,  3.55it/s]
 93%|█████████▎| 343688/371472 [5:10:49<2:09:48,  3.57it/s]
 93%|█████████▎| 343689/371472 [5:10:49<2:08:26,  3.61it/s]
 93%|█████████▎| 343690/371472 [5:10:50<2:08:33,  3.60it/s]
 93%|█████████▎| 343691/371472 [5:10:50<2:13:47,  3.46it/s]
 93%|█████████▎| 343692/371472 [5:10:50<2:18:15,  3.35it/s]
 93%|█████████▎| 343693/371472 [5:10:50<2:18:24,  3.35it/s]
 93%|█████████▎| 343694/371472 [5:10:51<2:13:05,  3.48it/s]
 93%|█████████▎| 343695/371472 [5:10:51<2:14:17,  3.45it/s]
 93%|█████████▎| 343696/371472 [5:10:51<2:24:37,  3.20it/s]
 93%|█████████▎| 343697/371472 [5:10:52<2:26:08,  3.17it/s]
 93%|█████████▎| 343698/371472 [5:10:52<2:24:08,  3.21it/s]
 93%|█████████▎| 343699/371472 [5:10:52<2:27:12,  3.14it/s]
 93%|█████████▎| 343700/371472 [5:10:53<2:21:18,  3.28it/s]
                                                           
{'loss': 2.7059, 'learning_rate': 1.6732207114999248e-07, 'epoch': 14.8}

 93%|█████████▎| 343700/371472 [5:10:53<2:21:18,  3.28it/s]
 93%|█████████▎| 343701/371472 [5:10:53<2:13:56,  3.46it/s]
 93%|█████████▎| 343702/371472 [5:10:53<2:10:53,  3.54it/s]
 93%|█████████▎| 343703/371472 [5:10:53<2:10:12,  3.55it/s]
 93%|█████████▎| 343704/371472 [5:10:54<2:11:24,  3.52it/s]
 93%|█████████▎| 343705/371472 [5:10:54<2:07:21,  3.63it/s]
 93%|█████████▎| 343706/371472 [5:10:54<2:05:45,  3.68it/s]
 93%|█████████▎| 343707/371472 [5:10:54<2:05:18,  3.69it/s]
 93%|█████████▎| 343708/371472 [5:10:55<2:08:37,  3.60it/s]
 93%|█████████▎| 343709/371472 [5:10:55<2:03:59,  3.73it/s]
 93%|█████████▎| 343710/371472 [5:10:55<2:19:34,  3.31it/s]
 93%|█████████▎| 343711/371472 [5:10:56<2:22:33,  3.25it/s]
 93%|█████████▎| 343712/371472 [5:10:56<2:15:18,  3.42it/s]
 93%|█████████▎| 343713/371472 [5:10:56<2:24:48,  3.19it/s]
 93%|█████████▎| 343714/371472 [5:10:57<2:23:17,  3.23it/s]
 93%|█████████▎| 343715/371472 [5:10:57<2:16:14,  3.40it/s]
 93%|█████████▎| 343716/371472 [5:10:57<2:13:13,  3.47it/s]
 93%|█████████▎| 343717/371472 [5:10:57<2:09:25,  3.57it/s]
 93%|█████████▎| 343718/371472 [5:10:58<2:07:36,  3.62it/s]
 93%|█████████▎| 343719/371472 [5:10:58<2:05:52,  3.67it/s]
 93%|█████████▎| 343720/371472 [5:10:58<2:24:12,  3.21it/s]
                                                           
{'loss': 2.5951, 'learning_rate': 1.6727358917451355e-07, 'epoch': 14.8}

 93%|█████████▎| 343720/371472 [5:10:58<2:24:12,  3.21it/s]
 93%|█████████▎| 343721/371472 [5:10:59<2:19:43,  3.31it/s]
 93%|█████████▎| 343722/371472 [5:10:59<2:19:25,  3.32it/s]
 93%|█████████▎| 343723/371472 [5:10:59<2:17:21,  3.37it/s]
 93%|█████████▎| 343724/371472 [5:10:59<2:10:45,  3.54it/s]
 93%|█████████▎| 343725/371472 [5:11:00<2:11:11,  3.53it/s]
 93%|█████████▎| 343726/371472 [5:11:00<2:06:44,  3.65it/s]
 93%|█████████▎| 343727/371472 [5:11:00<2:09:02,  3.58it/s]
 93%|█████████▎| 343728/371472 [5:11:01<2:06:53,  3.64it/s]
 93%|█████████▎| 343729/371472 [5:11:01<2:05:21,  3.69it/s]
 93%|█████████▎| 343730/371472 [5:11:01<2:05:18,  3.69it/s]
 93%|█████████▎| 343731/371472 [5:11:01<2:04:17,  3.72it/s]
 93%|█████████▎| 343732/371472 [5:11:02<2:06:25,  3.66it/s]
 93%|█████████▎| 343733/371472 [5:11:02<2:15:03,  3.42it/s]
 93%|█████████▎| 343734/371472 [5:11:02<2:16:04,  3.40it/s]
 93%|█████████▎| 343735/371472 [5:11:03<2:14:28,  3.44it/s]
 93%|█████████▎| 343736/371472 [5:11:03<2:11:53,  3.50it/s]
 93%|█████████▎| 343737/371472 [5:11:03<2:19:23,  3.32it/s]
 93%|█████████▎| 343738/371472 [5:11:04<2:28:37,  3.11it/s]
 93%|█████████▎| 343739/371472 [5:11:04<2:21:16,  3.27it/s]
 93%|█████████▎| 343740/371472 [5:11:04<2:17:15,  3.37it/s]
                                                           
{'loss': 2.6414, 'learning_rate': 1.672251071990347e-07, 'epoch': 14.81}

 93%|█████████▎| 343740/371472 [5:11:04<2:17:15,  3.37it/s]
 93%|█████████▎| 343741/371472 [5:11:04<2:10:16,  3.55it/s]
 93%|█████████▎| 343742/371472 [5:11:05<2:10:40,  3.54it/s]
 93%|█████████▎| 343743/371472 [5:11:05<2:11:14,  3.52it/s]
 93%|█████████▎| 343744/371472 [5:11:05<2:07:57,  3.61it/s]
 93%|█████████▎| 343745/371472 [5:11:06<2:17:42,  3.36it/s]
 93%|█████████▎| 343746/371472 [5:11:06<2:09:21,  3.57it/s]
 93%|█████████▎| 343747/371472 [5:11:06<2:20:22,  3.29it/s]
 93%|█████████▎| 343748/371472 [5:11:06<2:15:26,  3.41it/s]
 93%|█████████▎| 343749/371472 [5:11:07<2:21:42,  3.26it/s]
 93%|█████████▎| 343750/371472 [5:11:07<2:14:22,  3.44it/s]
 93%|█████████▎| 343751/371472 [5:11:07<2:20:24,  3.29it/s]
 93%|█████████▎| 343752/371472 [5:11:08<2:18:20,  3.34it/s]
 93%|█████████▎| 343753/371472 [5:11:08<2:11:49,  3.50it/s]
 93%|█████████▎| 343754/371472 [5:11:08<2:06:55,  3.64it/s]
 93%|█████████▎| 343755/371472 [5:11:08<2:05:28,  3.68it/s]
 93%|█████████▎| 343756/371472 [5:11:09<2:03:46,  3.73it/s]
 93%|█████████▎| 343757/371472 [5:11:09<2:10:31,  3.54it/s]
 93%|█████████▎| 343758/371472 [5:11:09<2:16:36,  3.38it/s]
 93%|█████████▎| 343759/371472 [5:11:10<2:10:54,  3.53it/s]
 93%|█████████▎| 343760/371472 [5:11:10<2:08:32,  3.59it/s]
                                                           
{'loss': 2.679, 'learning_rate': 1.6717662522355574e-07, 'epoch': 14.81}

 93%|█████████▎| 343760/371472 [5:11:10<2:08:32,  3.59it/s]
 93%|█████████▎| 343761/371472 [5:11:10<2:04:00,  3.72it/s]
 93%|█████████▎| 343762/371472 [5:11:10<2:04:21,  3.71it/s]
 93%|█████████▎| 343763/371472 [5:11:11<2:07:01,  3.64it/s]
 93%|█████████▎| 343764/371472 [5:11:11<2:13:11,  3.47it/s]
 93%|█████████▎| 343765/371472 [5:11:11<2:20:47,  3.28it/s]
 93%|█████████▎| 343766/371472 [5:11:12<2:13:55,  3.45it/s]
 93%|█████████▎| 343767/371472 [5:11:12<2:23:05,  3.23it/s]
 93%|█████████▎| 343768/371472 [5:11:12<2:17:08,  3.37it/s]
 93%|█████████▎| 343769/371472 [5:11:12<2:25:11,  3.18it/s]
 93%|█████████▎| 343770/371472 [5:11:13<2:17:33,  3.36it/s]
 93%|█████████▎| 343771/371472 [5:11:13<2:11:44,  3.50it/s]
 93%|█████████▎| 343772/371472 [5:11:13<2:13:56,  3.45it/s]
 93%|█████████▎| 343773/371472 [5:11:14<2:08:19,  3.60it/s]
 93%|█████████▎| 343774/371472 [5:11:14<2:14:24,  3.43it/s]
 93%|█████████▎| 343775/371472 [5:11:14<2:10:53,  3.53it/s]
 93%|█████████▎| 343776/371472 [5:11:14<2:17:47,  3.35it/s]
 93%|█████████▎| 343777/371472 [5:11:15<2:11:47,  3.50it/s]
 93%|█████████▎| 343778/371472 [5:11:15<2:15:20,  3.41it/s]
 93%|█████████▎| 343779/371472 [5:11:15<2:25:20,  3.18it/s]
 93%|█████████▎| 343780/371472 [5:11:16<2:14:19,  3.44it/s]
                                                           
{'loss': 2.5788, 'learning_rate': 1.6712814324807692e-07, 'epoch': 14.81}

 93%|█████████▎| 343780/371472 [5:11:16<2:14:19,  3.44it/s]
 93%|█████████▎| 343781/371472 [5:11:16<2:08:23,  3.59it/s]
 93%|█████████▎| 343782/371472 [5:11:16<2:13:04,  3.47it/s]
 93%|█████████▎| 343783/371472 [5:11:16<2:08:59,  3.58it/s]
 93%|█████████▎| 343784/371472 [5:11:17<2:16:17,  3.39it/s]
 93%|█████████▎| 343785/371472 [5:11:17<2:09:54,  3.55it/s]
 93%|█████████▎| 343786/371472 [5:11:17<2:07:59,  3.61it/s]
 93%|█████████▎| 343787/371472 [5:11:18<2:12:51,  3.47it/s]
 93%|█████████▎| 343788/371472 [5:11:18<2:06:10,  3.66it/s]
 93%|█████████▎| 343789/371472 [5:11:18<2:06:49,  3.64it/s]
 93%|█████████▎| 343790/371472 [5:11:18<2:12:33,  3.48it/s]
 93%|█████████▎| 343791/371472 [5:11:19<2:13:00,  3.47it/s]
 93%|█████████▎| 343792/371472 [5:11:19<2:05:41,  3.67it/s]
 93%|█████████▎| 343793/371472 [5:11:19<2:10:51,  3.53it/s]
 93%|█████████▎| 343794/371472 [5:11:20<2:12:24,  3.48it/s]
 93%|█████████▎| 343795/371472 [5:11:20<2:15:16,  3.41it/s]
 93%|█████████▎| 343796/371472 [5:11:20<2:16:32,  3.38it/s]
 93%|█████████▎| 343797/371472 [5:11:21<2:18:58,  3.32it/s]
 93%|█████████▎| 343798/371472 [5:11:21<2:15:11,  3.41it/s]
 93%|█████████▎| 343799/371472 [5:11:21<2:09:37,  3.56it/s]
 93%|█████████▎| 343800/371472 [5:11:21<2:11:27,  3.51it/s]
                                                           
{'loss': 2.5702, 'learning_rate': 1.6707966127259797e-07, 'epoch': 14.81}

 93%|█████████▎| 343800/371472 [5:11:21<2:11:27,  3.51it/s]
 93%|█████████▎| 343801/371472 [5:11:22<2:10:25,  3.54it/s]
 93%|█████████▎| 343802/371472 [5:11:22<2:09:38,  3.56it/s]
 93%|█████████▎| 343803/371472 [5:11:22<2:08:48,  3.58it/s]
 93%|█████████▎| 343804/371472 [5:11:22<2:15:28,  3.40it/s]
 93%|█████████▎| 343805/371472 [5:11:23<2:15:44,  3.40it/s]
 93%|█████████▎| 343806/371472 [5:11:23<2:14:57,  3.42it/s]
 93%|█████████▎| 343807/371472 [5:11:23<2:21:45,  3.25it/s]
 93%|█████████▎| 343808/371472 [5:11:24<2:30:56,  3.05it/s]
 93%|█████████▎| 343809/371472 [5:11:24<2:22:54,  3.23it/s]
 93%|█████████▎| 343810/371472 [5:11:24<2:14:40,  3.42it/s]
 93%|█████████▎| 343811/371472 [5:11:25<2:11:09,  3.52it/s]
 93%|█████████▎| 343812/371472 [5:11:25<2:16:46,  3.37it/s]
 93%|█████████▎| 343813/371472 [5:11:25<2:14:58,  3.42it/s]
 93%|█████████▎| 343814/371472 [5:11:25<2:11:23,  3.51it/s]
 93%|█████████▎| 343815/371472 [5:11:26<2:26:17,  3.15it/s]
 93%|█████████▎| 343816/371472 [5:11:26<2:27:24,  3.13it/s]
 93%|█████████▎| 343817/371472 [5:11:26<2:20:40,  3.28it/s]
 93%|█████████▎| 343818/371472 [5:11:27<2:15:11,  3.41it/s]
 93%|█████████▎| 343819/371472 [5:11:27<2:11:02,  3.52it/s]
 93%|█████████▎| 343820/371472 [5:11:27<2:19:21,  3.31it/s]
                                                           
{'loss': 2.479, 'learning_rate': 1.6703117929711912e-07, 'epoch': 14.81}

 93%|█████████▎| 343820/371472 [5:11:27<2:19:21,  3.31it/s]
 93%|█████████▎| 343821/371472 [5:11:28<2:16:26,  3.38it/s]
 93%|█████████▎| 343822/371472 [5:11:28<2:16:13,  3.38it/s]
 93%|█████████▎| 343823/371472 [5:11:28<2:10:56,  3.52it/s]
 93%|█████████▎| 343824/371472 [5:11:28<2:16:07,  3.39it/s]
 93%|█████████▎| 343825/371472 [5:11:29<2:22:18,  3.24it/s]
 93%|█████████▎| 343826/371472 [5:11:29<2:16:37,  3.37it/s]
 93%|█████████▎| 343827/371472 [5:11:29<2:14:03,  3.44it/s]
 93%|█████████▎| 343828/371472 [5:11:30<2:12:28,  3.48it/s]
 93%|█████████▎| 343829/371472 [5:11:30<2:15:32,  3.40it/s]
 93%|█████████▎| 343830/371472 [5:11:30<2:13:57,  3.44it/s]
 93%|█████████▎| 343831/371472 [5:11:31<2:11:55,  3.49it/s]
 93%|█████████▎| 343832/371472 [5:11:31<2:10:17,  3.54it/s]
 93%|█████████▎| 343833/371472 [5:11:31<2:06:46,  3.63it/s]
 93%|█████████▎| 343834/371472 [5:11:31<2:15:32,  3.40it/s]
 93%|█████████▎| 343835/371472 [5:11:32<2:11:49,  3.49it/s]
 93%|█████████▎| 343836/371472 [5:11:32<2:15:16,  3.40it/s]
 93%|█████████▎| 343837/371472 [5:11:32<2:15:20,  3.40it/s]
 93%|█████████▎| 343838/371472 [5:11:33<2:19:32,  3.30it/s]
 93%|█████████▎| 343839/371472 [5:11:33<2:16:15,  3.38it/s]
 93%|█████████▎| 343840/371472 [5:11:33<2:14:13,  3.43it/s]
                                                           
{'loss': 2.6102, 'learning_rate': 1.669826973216402e-07, 'epoch': 14.81}

 93%|█████████▎| 343840/371472 [5:11:33<2:14:13,  3.43it/s]
 93%|█████████▎| 343841/371472 [5:11:33<2:12:42,  3.47it/s]
 93%|█████████▎| 343842/371472 [5:11:34<2:10:13,  3.54it/s]
 93%|█████████▎| 343843/371472 [5:11:34<2:15:30,  3.40it/s]
 93%|█████████▎| 343844/371472 [5:11:34<2:16:31,  3.37it/s]
 93%|█████████▎| 343845/371472 [5:11:35<2:11:43,  3.50it/s]
 93%|█████████▎| 343846/371472 [5:11:35<2:09:31,  3.55it/s]
 93%|█████████▎| 343847/371472 [5:11:35<2:17:08,  3.36it/s]
 93%|█████████▎| 343848/371472 [5:11:35<2:11:34,  3.50it/s]
 93%|█████████▎| 343849/371472 [5:11:36<2:11:03,  3.51it/s]
 93%|█████████▎| 343850/371472 [5:11:36<2:09:51,  3.54it/s]
 93%|█████████▎| 343851/371472 [5:11:36<2:14:49,  3.41it/s]
 93%|█████████▎| 343852/371472 [5:11:37<2:20:50,  3.27it/s]
 93%|█████████▎| 343853/371472 [5:11:37<2:15:45,  3.39it/s]
 93%|█████████▎| 343854/371472 [5:11:37<2:12:10,  3.48it/s]
 93%|█████████▎| 343855/371472 [5:11:37<2:05:50,  3.66it/s]
 93%|█████████▎| 343856/371472 [5:11:38<2:08:26,  3.58it/s]
 93%|█████████▎| 343857/371472 [5:11:38<2:18:08,  3.33it/s]
 93%|█████████▎| 343858/371472 [5:11:38<2:12:14,  3.48it/s]
 93%|█████████▎| 343859/371472 [5:11:39<2:17:15,  3.35it/s]
 93%|█████████▎| 343860/371472 [5:11:39<2:17:26,  3.35it/s]
                                                           
{'loss': 2.4668, 'learning_rate': 1.6693421534616134e-07, 'epoch': 14.81}

 93%|█████████▎| 343860/371472 [5:11:39<2:17:26,  3.35it/s]
 93%|█████████▎| 343861/371472 [5:11:39<2:14:44,  3.42it/s]
 93%|█████████▎| 343862/371472 [5:11:39<2:07:56,  3.60it/s]
 93%|█████████▎| 343863/371472 [5:11:40<2:05:56,  3.65it/s]
 93%|█████████▎| 343864/371472 [5:11:40<2:10:34,  3.52it/s]
 93%|█████████▎| 343865/371472 [5:11:40<2:06:20,  3.64it/s]
 93%|█████████▎| 343866/371472 [5:11:41<2:03:39,  3.72it/s]
 93%|█████████▎| 343867/371472 [5:11:41<2:07:15,  3.62it/s]
 93%|█████████▎| 343868/371472 [5:11:41<2:06:14,  3.64it/s]
 93%|█████████▎| 343869/371472 [5:11:41<2:05:09,  3.68it/s]
 93%|█████████▎| 343870/371472 [5:11:42<2:06:04,  3.65it/s]
 93%|█████████▎| 343871/371472 [5:11:42<2:06:35,  3.63it/s]
 93%|█████████▎| 343872/371472 [5:11:42<2:13:48,  3.44it/s]
 93%|█████████▎| 343873/371472 [5:11:43<2:16:01,  3.38it/s]
 93%|█████████▎| 343874/371472 [5:11:43<2:16:38,  3.37it/s]
 93%|█████████▎| 343875/371472 [5:11:43<2:20:22,  3.28it/s]
 93%|█████████▎| 343876/371472 [5:11:43<2:17:39,  3.34it/s]
 93%|█████████▎| 343877/371472 [5:11:44<2:11:04,  3.51it/s]
 93%|█████████▎| 343878/371472 [5:11:44<2:10:03,  3.54it/s]
 93%|█████████▎| 343879/371472 [5:11:44<2:13:01,  3.46it/s]
 93%|█████████▎| 343880/371472 [5:11:45<2:17:22,  3.35it/s]
                                                           
{'loss': 2.6407, 'learning_rate': 1.6688573337068238e-07, 'epoch': 14.81}

 93%|█████████▎| 343880/371472 [5:11:45<2:17:22,  3.35it/s]
 93%|█████████▎| 343881/371472 [5:11:45<2:11:52,  3.49it/s]
 93%|█████████▎| 343882/371472 [5:11:45<2:15:07,  3.40it/s]
 93%|█████████▎| 343883/371472 [5:11:45<2:11:31,  3.50it/s]
 93%|█████████▎| 343884/371472 [5:11:46<2:12:01,  3.48it/s]
 93%|█████████▎| 343885/371472 [5:11:46<2:10:45,  3.52it/s]
 93%|█████████▎| 343886/371472 [5:11:46<2:08:30,  3.58it/s]
 93%|█████████▎| 343887/371472 [5:11:47<2:15:14,  3.40it/s]
 93%|█████████▎| 343888/371472 [5:11:47<2:11:26,  3.50it/s]
 93%|█████████▎| 343889/371472 [5:11:47<2:07:28,  3.61it/s]
 93%|█████████▎| 343890/371472 [5:11:47<2:15:35,  3.39it/s]
 93%|█████████▎| 343891/371472 [5:11:48<2:20:36,  3.27it/s]
 93%|█████████▎| 343892/371472 [5:11:48<2:12:22,  3.47it/s]
 93%|█████████▎| 343893/371472 [5:11:48<2:08:36,  3.57it/s]
 93%|█████████▎| 343894/371472 [5:11:49<2:10:51,  3.51it/s]
 93%|█████████▎| 343895/371472 [5:11:49<2:09:29,  3.55it/s]
 93%|█████████▎| 343896/371472 [5:11:49<2:12:33,  3.47it/s]
 93%|█████████▎| 343897/371472 [5:11:49<2:08:15,  3.58it/s]
 93%|█████████▎| 343898/371472 [5:11:50<2:12:11,  3.48it/s]
 93%|█████████▎| 343899/371472 [5:11:50<2:16:58,  3.35it/s]
 93%|█████████▎| 343900/371472 [5:11:50<2:20:35,  3.27it/s]
                                                           
{'loss': 2.413, 'learning_rate': 1.6683725139520346e-07, 'epoch': 14.81}

 93%|█████████▎| 343900/371472 [5:11:50<2:20:35,  3.27it/s]
 93%|█████████▎| 343901/371472 [5:11:51<2:17:20,  3.35it/s]
 93%|█████████▎| 343902/371472 [5:11:51<2:17:46,  3.34it/s]
 93%|█████████▎| 343903/371472 [5:11:51<2:14:41,  3.41it/s]
 93%|█████████▎| 343904/371472 [5:11:52<2:18:08,  3.33it/s]
 93%|█████████▎| 343905/371472 [5:11:52<2:17:15,  3.35it/s]
 93%|█████████▎| 343906/371472 [5:11:52<2:12:19,  3.47it/s]
 93%|█████████▎| 343907/371472 [5:11:52<2:10:37,  3.52it/s]
 93%|█████████▎| 343908/371472 [5:11:53<2:08:37,  3.57it/s]
 93%|█████████▎| 343909/371472 [5:11:53<2:21:35,  3.24it/s]
 93%|█████████▎| 343910/371472 [5:11:53<2:16:09,  3.37it/s]
 93%|█████████▎| 343911/371472 [5:11:54<2:12:07,  3.48it/s]
 93%|█████████▎| 343912/371472 [5:11:54<2:20:16,  3.27it/s]
 93%|█████████▎| 343913/371472 [5:11:54<2:22:52,  3.21it/s]
 93%|█████████▎| 343914/371472 [5:11:55<2:24:44,  3.17it/s]
 93%|█████████▎| 343915/371472 [5:11:55<2:21:44,  3.24it/s]
 93%|█████████▎| 343916/371472 [5:11:55<2:20:39,  3.27it/s]
 93%|█████████▎| 343917/371472 [5:11:56<2:22:17,  3.23it/s]
 93%|█████████▎| 343918/371472 [5:11:56<2:27:13,  3.12it/s]
 93%|█████████▎| 343919/371472 [5:11:56<2:23:47,  3.19it/s]
 93%|█████████▎| 343920/371472 [5:11:56<2:20:11,  3.28it/s]
                                                           
{'loss': 2.5972, 'learning_rate': 1.6678876941972463e-07, 'epoch': 14.81}

 93%|█████████▎| 343920/371472 [5:11:56<2:20:11,  3.28it/s]
 93%|█████████▎| 343921/371472 [5:11:57<2:16:06,  3.37it/s]
 93%|█████████▎| 343922/371472 [5:11:57<2:10:07,  3.53it/s]
 93%|█████████▎| 343923/371472 [5:11:57<2:09:58,  3.53it/s]
 93%|█████████▎| 343924/371472 [5:11:58<2:07:59,  3.59it/s]
 93%|█████████▎| 343925/371472 [5:11:58<2:09:51,  3.54it/s]
 93%|█████████▎| 343926/371472 [5:11:58<2:07:49,  3.59it/s]
 93%|█████████▎| 343927/371472 [5:11:58<2:13:13,  3.45it/s]
 93%|█████████▎| 343928/371472 [5:11:59<2:10:05,  3.53it/s]
 93%|█████████▎| 343929/371472 [5:11:59<2:09:56,  3.53it/s]
 93%|█████████▎| 343930/371472 [5:11:59<2:10:08,  3.53it/s]
 93%|█████████▎| 343931/371472 [5:12:00<2:15:32,  3.39it/s]
 93%|█████████▎| 343932/371472 [5:12:00<2:10:42,  3.51it/s]
 93%|█████████▎| 343933/371472 [5:12:00<2:14:44,  3.41it/s]
 93%|█████████▎| 343934/371472 [5:12:00<2:11:00,  3.50it/s]
 93%|█████████▎| 343935/371472 [5:12:01<2:14:38,  3.41it/s]
 93%|█████████▎| 343936/371472 [5:12:01<2:12:23,  3.47it/s]
 93%|█████████▎| 343937/371472 [5:12:01<2:07:29,  3.60it/s]
 93%|█████████▎| 343938/371472 [5:12:02<2:13:20,  3.44it/s]
 93%|█████████▎| 343939/371472 [5:12:02<2:10:12,  3.52it/s]
 93%|█████████▎| 343940/371472 [5:12:02<2:09:37,  3.54it/s]
                                                           
{'loss': 2.5663, 'learning_rate': 1.6674028744424568e-07, 'epoch': 14.81}

 93%|█████████▎| 343940/371472 [5:12:02<2:09:37,  3.54it/s]
 93%|█████████▎| 343941/371472 [5:12:02<2:14:34,  3.41it/s]
 93%|█████████▎| 343942/371472 [5:12:03<2:17:45,  3.33it/s]
 93%|█████████▎| 343943/371472 [5:12:03<2:14:06,  3.42it/s]
 93%|█████████▎| 343944/371472 [5:12:03<2:10:51,  3.51it/s]
 93%|█████████▎| 343945/371472 [5:12:04<2:26:27,  3.13it/s]
 93%|█████████▎| 343946/371472 [5:12:04<2:20:52,  3.26it/s]
 93%|█████████▎| 343947/371472 [5:12:04<2:11:59,  3.48it/s]
 93%|█████████▎| 343948/371472 [5:12:05<2:12:57,  3.45it/s]
 93%|█████████▎| 343949/371472 [5:12:05<2:21:21,  3.24it/s]
 93%|█████████▎| 343950/371472 [5:12:05<2:18:49,  3.30it/s]
 93%|█████████▎| 343951/371472 [5:12:05<2:13:49,  3.43it/s]
 93%|█████████▎| 343952/371472 [5:12:06<2:13:59,  3.42it/s]
 93%|█████████▎| 343953/371472 [5:12:06<2:11:11,  3.50it/s]
 93%|█████████▎| 343954/371472 [5:12:06<2:12:55,  3.45it/s]
 93%|█████████▎| 343955/371472 [5:12:07<2:09:53,  3.53it/s]
 93%|█████████▎| 343956/371472 [5:12:07<2:09:34,  3.54it/s]
 93%|█████████▎| 343957/371472 [5:12:07<2:12:20,  3.47it/s]
 93%|█████████▎| 343958/371472 [5:12:07<2:09:48,  3.53it/s]
 93%|█████████▎| 343959/371472 [5:12:08<2:15:29,  3.38it/s]
 93%|█████████▎| 343960/371472 [5:12:08<2:14:46,  3.40it/s]
                                                           
{'loss': 2.605, 'learning_rate': 1.6669180546876683e-07, 'epoch': 14.82}

 93%|█████████▎| 343960/371472 [5:12:08<2:14:46,  3.40it/s]
 93%|█████████▎| 343961/371472 [5:12:08<2:10:06,  3.52it/s]
 93%|█████████▎| 343962/371472 [5:12:09<2:06:59,  3.61it/s]
 93%|█████████▎| 343963/371472 [5:12:09<2:03:35,  3.71it/s]
 93%|█████████▎| 343964/371472 [5:12:09<2:04:53,  3.67it/s]
 93%|█████████▎| 343965/371472 [5:12:09<1:59:30,  3.84it/s]
 93%|█████████▎| 343966/371472 [5:12:10<1:59:35,  3.83it/s]
 93%|█████████▎| 343967/371472 [5:12:10<1:58:03,  3.88it/s]
 93%|█████████▎| 343968/371472 [5:12:10<1:57:10,  3.91it/s]
 93%|█████████▎| 343969/371472 [5:12:10<1:57:17,  3.91it/s]
 93%|█████████▎| 343970/371472 [5:12:11<1:58:42,  3.86it/s]
 93%|█████████▎| 343971/371472 [5:12:11<1:58:46,  3.86it/s]
 93%|█████████▎| 343972/371472 [5:12:11<1:57:35,  3.90it/s]
 93%|█████████▎| 343973/371472 [5:12:11<2:05:55,  3.64it/s]
 93%|█████████▎| 343974/371472 [5:12:12<2:08:19,  3.57it/s]
 93%|█████████▎| 343975/371472 [5:12:12<2:04:16,  3.69it/s]
 93%|█████████▎| 343976/371472 [5:12:12<2:20:00,  3.27it/s]
 93%|█████████▎| 343977/371472 [5:12:13<2:18:50,  3.30it/s]
 93%|█████████▎| 343978/371472 [5:12:13<2:15:34,  3.38it/s]
 93%|█████████▎| 343979/371472 [5:12:13<2:13:10,  3.44it/s]
 93%|█████████▎| 343980/371472 [5:12:13<2:10:08,  3.52it/s]
                                                           
{'loss': 2.5784, 'learning_rate': 1.666433234932879e-07, 'epoch': 14.82}

 93%|█████████▎| 343980/371472 [5:12:13<2:10:08,  3.52it/s]
 93%|█████████▎| 343981/371472 [5:12:14<2:06:56,  3.61it/s]
 93%|█████████▎| 343982/371472 [5:12:14<2:05:47,  3.64it/s]
 93%|█████████▎| 343983/371472 [5:12:14<2:04:07,  3.69it/s]
 93%|█████████▎| 343984/371472 [5:12:15<2:06:26,  3.62it/s]
 93%|█████████▎| 343985/371472 [5:12:15<2:02:48,  3.73it/s]
 93%|█████████▎| 343986/371472 [5:12:15<2:01:12,  3.78it/s]
 93%|█████████▎| 343987/371472 [5:12:15<2:04:10,  3.69it/s]
 93%|█████████▎| 343988/371472 [5:12:16<2:12:03,  3.47it/s]
 93%|█████████▎| 343989/371472 [5:12:16<2:09:04,  3.55it/s]
 93%|█████████▎| 343990/371472 [5:12:16<2:08:43,  3.56it/s]
 93%|█████████▎| 343991/371472 [5:12:16<2:08:57,  3.55it/s]
 93%|█████████▎| 343992/371472 [5:12:17<2:09:52,  3.53it/s]
 93%|█████████▎| 343993/371472 [5:12:17<2:09:39,  3.53it/s]
 93%|█████████▎| 343994/371472 [5:12:17<2:03:56,  3.70it/s]
 93%|█████████▎| 343995/371472 [5:12:18<2:04:18,  3.68it/s]
 93%|█████████▎| 343996/371472 [5:12:18<2:06:12,  3.63it/s]
 93%|█████████▎| 343997/371472 [5:12:18<2:03:06,  3.72it/s]
 93%|█████████▎| 343998/371472 [5:12:18<2:03:25,  3.71it/s]
 93%|█████████▎| 343999/371472 [5:12:19<2:04:05,  3.69it/s]
 93%|█████████▎| 344000/371472 [5:12:19<2:02:14,  3.75it/s]
                                                           
{'loss': 2.6577, 'learning_rate': 1.6659484151780905e-07, 'epoch': 14.82}

 93%|█████████▎| 344000/371472 [5:12:19<2:02:14,  3.75it/s]
 93%|█████████▎| 344001/371472 [5:12:19<2:17:02,  3.34it/s]
 93%|█████████▎| 344002/371472 [5:12:20<2:16:04,  3.36it/s]
 93%|█████████▎| 344003/371472 [5:12:20<2:14:48,  3.40it/s]
 93%|█████████▎| 344004/371472 [5:12:20<2:12:18,  3.46it/s]
 93%|█████████▎| 344005/371472 [5:12:20<2:04:54,  3.67it/s]
 93%|█████████▎| 344006/371472 [5:12:21<2:11:47,  3.47it/s]
 93%|█████████▎| 344007/371472 [5:12:21<2:12:13,  3.46it/s]
 93%|█████████▎| 344008/371472 [5:12:21<2:09:18,  3.54it/s]
 93%|█████████▎| 344009/371472 [5:12:22<2:04:38,  3.67it/s]
 93%|█████████▎| 344010/371472 [5:12:22<2:01:31,  3.77it/s]
 93%|█████████▎| 344011/371472 [5:12:22<2:09:23,  3.54it/s]
 93%|█████████▎| 344012/371472 [5:12:22<2:10:53,  3.50it/s]
 93%|█████████▎| 344013/371472 [5:12:23<2:13:15,  3.43it/s]
 93%|█████████▎| 344014/371472 [5:12:23<2:15:19,  3.38it/s]
 93%|█████████▎| 344015/371472 [5:12:23<2:10:25,  3.51it/s]
 93%|█████████▎| 344016/371472 [5:12:24<2:13:58,  3.42it/s]
 93%|█████████▎| 344017/371472 [5:12:24<2:06:50,  3.61it/s]
 93%|█████████▎| 344018/371472 [5:12:24<2:10:42,  3.50it/s]
 93%|█████████▎| 344019/371472 [5:12:24<2:10:03,  3.52it/s]
 93%|█████████▎| 344020/371472 [5:12:25<2:04:58,  3.66it/s]
                                                           
{'loss': 2.5853, 'learning_rate': 1.665463595423301e-07, 'epoch': 14.82}

 93%|█████████▎| 344020/371472 [5:12:25<2:04:58,  3.66it/s]
 93%|█████████▎| 344021/371472 [5:12:25<2:07:34,  3.59it/s]
 93%|█████████▎| 344022/371472 [5:12:25<2:10:58,  3.49it/s]
 93%|█████████▎| 344023/371472 [5:12:26<2:17:49,  3.32it/s]
 93%|█████████▎| 344024/371472 [5:12:26<2:16:48,  3.34it/s]
 93%|█████████▎| 344025/371472 [5:12:26<2:16:11,  3.36it/s]
 93%|█████████▎| 344026/371472 [5:12:26<2:17:27,  3.33it/s]
 93%|█████████▎| 344027/371472 [5:12:27<2:15:40,  3.37it/s]
 93%|█████████▎| 344028/371472 [5:12:27<2:12:52,  3.44it/s]
 93%|█████████▎| 344029/371472 [5:12:27<2:14:50,  3.39it/s]
 93%|█████████▎| 344030/371472 [5:12:28<2:13:04,  3.44it/s]
 93%|█████████▎| 344031/371472 [5:12:28<2:16:03,  3.36it/s]
 93%|█████████▎| 344032/371472 [5:12:28<2:09:55,  3.52it/s]
 93%|█████████▎| 344033/371472 [5:12:29<2:18:32,  3.30it/s]
 93%|█████████▎| 344034/371472 [5:12:29<2:21:07,  3.24it/s]
 93%|█████████▎| 344035/371472 [5:12:29<2:12:28,  3.45it/s]
 93%|█████████▎| 344036/371472 [5:12:29<2:09:13,  3.54it/s]
 93%|█████████▎| 344037/371472 [5:12:30<2:06:53,  3.60it/s]
 93%|█████████▎| 344038/371472 [5:12:30<2:05:27,  3.64it/s]
 93%|█████████▎| 344039/371472 [5:12:30<2:03:58,  3.69it/s]
 93%|█████████▎| 344040/371472 [5:12:30<2:00:11,  3.80it/s]
                                                           
{'loss': 2.6172, 'learning_rate': 1.6649787756685127e-07, 'epoch': 14.82}

 93%|█████████▎| 344040/371472 [5:12:30<2:00:11,  3.80it/s]
 93%|█████████▎| 344041/371472 [5:12:31<1:56:40,  3.92it/s]
 93%|█████████▎| 344042/371472 [5:12:31<2:01:29,  3.76it/s]
 93%|█████████▎| 344043/371472 [5:12:31<2:07:34,  3.58it/s]
 93%|█████████▎| 344044/371472 [5:12:32<2:06:16,  3.62it/s]
 93%|█████████▎| 344045/371472 [5:12:32<2:05:07,  3.65it/s]
 93%|█████████▎| 344046/371472 [5:12:32<2:08:49,  3.55it/s]
 93%|█████████▎| 344047/371472 [5:12:32<2:09:02,  3.54it/s]
 93%|█████████▎| 344048/371472 [5:12:33<2:06:32,  3.61it/s]
 93%|█████████▎| 344049/371472 [5:12:33<2:09:34,  3.53it/s]
 93%|█████████▎| 344050/371472 [5:12:33<2:09:23,  3.53it/s]
 93%|█████████▎| 344051/371472 [5:12:33<2:08:16,  3.56it/s]
 93%|█████████▎| 344052/371472 [5:12:34<2:05:32,  3.64it/s]
 93%|█████████▎| 344053/371472 [5:12:34<2:14:42,  3.39it/s]
 93%|█████████▎| 344054/371472 [5:12:34<2:11:58,  3.46it/s]
 93%|█████████▎| 344055/371472 [5:12:35<2:08:47,  3.55it/s]
 93%|█████████▎| 344056/371472 [5:12:35<2:06:46,  3.60it/s]
 93%|█████████▎| 344057/371472 [5:12:35<2:08:29,  3.56it/s]
 93%|█████████▎| 344058/371472 [5:12:36<2:14:17,  3.40it/s]
 93%|█████████▎| 344059/371472 [5:12:36<2:08:30,  3.56it/s]
 93%|█████████▎| 344060/371472 [5:12:36<2:13:14,  3.43it/s]
                                                           
{'loss': 2.4886, 'learning_rate': 1.664493955913723e-07, 'epoch': 14.82}

 93%|█████████▎| 344060/371472 [5:12:36<2:13:14,  3.43it/s]
 93%|█████████▎| 344061/371472 [5:12:36<2:09:06,  3.54it/s]
 93%|█████████▎| 344062/371472 [5:12:37<2:12:06,  3.46it/s]
 93%|█████████▎| 344063/371472 [5:12:37<2:09:56,  3.52it/s]
 93%|█████████▎| 344064/371472 [5:12:37<2:09:49,  3.52it/s]
 93%|█████████▎| 344065/371472 [5:12:38<2:16:53,  3.34it/s]
 93%|█████████▎| 344066/371472 [5:12:38<2:08:38,  3.55it/s]
 93%|█████████▎| 344067/371472 [5:12:38<2:11:49,  3.46it/s]
 93%|█████████▎| 344068/371472 [5:12:38<2:06:22,  3.61it/s]
 93%|█████████▎| 344069/371472 [5:12:39<2:04:15,  3.68it/s]
 93%|█████████▎| 344070/371472 [5:12:39<2:07:57,  3.57it/s]
 93%|█████████▎| 344071/371472 [5:12:39<2:06:08,  3.62it/s]
 93%|█████████▎| 344072/371472 [5:12:39<2:07:06,  3.59it/s]
 93%|█████████▎| 344073/371472 [5:12:40<2:08:45,  3.55it/s]
 93%|█████████▎| 344074/371472 [5:12:40<2:12:07,  3.46it/s]
 93%|█████████▎| 344075/371472 [5:12:40<2:10:02,  3.51it/s]
 93%|█████████▎| 344076/371472 [5:12:41<2:12:02,  3.46it/s]
 93%|█████████▎| 344077/371472 [5:12:41<2:04:43,  3.66it/s]
 93%|█████████▎| 344078/371472 [5:12:41<2:09:39,  3.52it/s]
 93%|█████████▎| 344079/371472 [5:12:41<2:05:20,  3.64it/s]
 93%|█████████▎| 344080/371472 [5:12:42<2:04:45,  3.66it/s]
                                                           
{'loss': 2.623, 'learning_rate': 1.6640091361589347e-07, 'epoch': 14.82}

 93%|█████████▎| 344080/371472 [5:12:42<2:04:45,  3.66it/s]
 93%|█████████▎| 344081/371472 [5:12:42<2:03:24,  3.70it/s]
 93%|█████████▎| 344082/371472 [5:12:42<2:01:23,  3.76it/s]
 93%|█████████▎| 344083/371472 [5:12:42<2:00:08,  3.80it/s]
 93%|█████████▎| 344084/371472 [5:12:43<2:03:47,  3.69it/s]
 93%|█████████▎| 344085/371472 [5:12:43<2:00:45,  3.78it/s]
 93%|█████████▎| 344086/371472 [5:12:43<2:03:52,  3.68it/s]
 93%|█████████▎| 344087/371472 [5:12:44<2:06:42,  3.60it/s]
 93%|█████████▎| 344088/371472 [5:12:44<2:03:50,  3.69it/s]
 93%|█████████▎| 344089/371472 [5:12:44<2:13:59,  3.41it/s]
 93%|█████████▎| 344090/371472 [5:12:44<2:16:30,  3.34it/s]
 93%|█████████▎| 344091/371472 [5:12:45<2:13:02,  3.43it/s]
 93%|█████████▎| 344092/371472 [5:12:45<2:20:59,  3.24it/s]
 93%|█████████▎| 344093/371472 [5:12:45<2:15:01,  3.38it/s]
 93%|█████████▎| 344094/371472 [5:12:46<2:10:48,  3.49it/s]
 93%|█████████▎| 344095/371472 [5:12:46<2:27:39,  3.09it/s]
 93%|█████████▎| 344096/371472 [5:12:46<2:29:34,  3.05it/s]
 93%|█████████▎| 344097/371472 [5:12:47<2:19:06,  3.28it/s]
 93%|█████████▎| 344098/371472 [5:12:47<2:22:58,  3.19it/s]
 93%|█████████▎| 344099/371472 [5:12:47<2:19:13,  3.28it/s]
 93%|█████████▎| 344100/371472 [5:12:48<2:13:39,  3.41it/s]
                                                           
{'loss': 2.594, 'learning_rate': 1.6635243164041454e-07, 'epoch': 14.82}

 93%|█████████▎| 344100/371472 [5:12:48<2:13:39,  3.41it/s]
 93%|█████████▎| 344101/371472 [5:12:48<2:11:38,  3.47it/s]
 93%|█████████▎| 344102/371472 [5:12:48<2:12:11,  3.45it/s]
 93%|█████████▎| 344103/371472 [5:12:48<2:06:27,  3.61it/s]
 93%|█████████▎| 344104/371472 [5:12:49<2:05:12,  3.64it/s]
 93%|█████████▎| 344105/371472 [5:12:49<2:00:50,  3.77it/s]
 93%|█████████▎| 344106/371472 [5:12:49<2:09:32,  3.52it/s]
 93%|█████████▎| 344107/371472 [5:12:49<2:09:51,  3.51it/s]
 93%|█████████▎| 344108/371472 [5:12:50<2:07:01,  3.59it/s]
 93%|█████████▎| 344109/371472 [5:12:50<2:05:16,  3.64it/s]
 93%|█████████▎| 344110/371472 [5:12:50<2:05:13,  3.64it/s]
 93%|█████████▎| 344111/371472 [5:12:51<2:06:00,  3.62it/s]
 93%|█████████▎| 344112/371472 [5:12:51<2:04:30,  3.66it/s]
 93%|█████████▎| 344113/371472 [5:12:51<2:09:43,  3.52it/s]
 93%|█████████▎| 344114/371472 [5:12:51<2:16:34,  3.34it/s]
 93%|█████████▎| 344115/371472 [5:12:52<2:21:40,  3.22it/s]
 93%|█████████▎| 344116/371472 [5:12:52<2:20:57,  3.23it/s]
 93%|█████████▎| 344117/371472 [5:12:52<2:21:40,  3.22it/s]
 93%|█████████▎| 344118/371472 [5:12:53<2:17:35,  3.31it/s]
 93%|█████████▎| 344119/371472 [5:12:53<2:16:35,  3.34it/s]
 93%|█████████▎| 344120/371472 [5:12:53<2:15:20,  3.37it/s]
                                                           
{'loss': 2.568, 'learning_rate': 1.663039496649357e-07, 'epoch': 14.82}

 93%|█████████▎| 344120/371472 [5:12:53<2:15:20,  3.37it/s]
 93%|█████████▎| 344121/371472 [5:12:54<2:12:48,  3.43it/s]
 93%|█████████▎| 344122/371472 [5:12:54<2:13:50,  3.41it/s]
 93%|█████████▎| 344123/371472 [5:12:54<2:20:24,  3.25it/s]
 93%|█████████▎| 344124/371472 [5:12:54<2:17:25,  3.32it/s]
 93%|█████████▎| 344125/371472 [5:12:55<2:15:31,  3.36it/s]
 93%|█████████▎| 344126/371472 [5:12:55<2:09:34,  3.52it/s]
 93%|█████████▎| 344127/371472 [5:12:55<2:11:36,  3.46it/s]
 93%|█████████▎| 344128/371472 [5:12:56<2:13:49,  3.41it/s]
 93%|█████████▎| 344129/371472 [5:12:56<2:16:39,  3.33it/s]
 93%|█████████▎| 344130/371472 [5:12:56<2:13:51,  3.40it/s]
 93%|█████████▎| 344131/371472 [5:12:57<2:11:31,  3.46it/s]
 93%|█████████▎| 344132/371472 [5:12:57<2:04:28,  3.66it/s]
 93%|█████████▎| 344133/371472 [5:12:57<2:27:26,  3.09it/s]
 93%|█████████▎| 344134/371472 [5:12:57<2:23:19,  3.18it/s]
 93%|█████████▎| 344135/371472 [5:12:58<2:28:36,  3.07it/s]
 93%|█████████▎| 344136/371472 [5:12:58<2:26:37,  3.11it/s]
 93%|█████████▎| 344137/371472 [5:12:58<2:23:04,  3.18it/s]
 93%|█████████▎| 344138/371472 [5:12:59<2:15:06,  3.37it/s]
 93%|█████████▎| 344139/371472 [5:12:59<2:08:47,  3.54it/s]
 93%|█████████▎| 344140/371472 [5:12:59<2:14:27,  3.39it/s]
                                                           
{'loss': 2.6965, 'learning_rate': 1.6625546768945674e-07, 'epoch': 14.82}

 93%|█████████▎| 344140/371472 [5:12:59<2:14:27,  3.39it/s]
 93%|█████████▎| 344141/371472 [5:13:00<2:10:37,  3.49it/s]
 93%|█████████▎| 344142/371472 [5:13:00<2:22:18,  3.20it/s]
 93%|█████████▎| 344143/371472 [5:13:00<2:15:16,  3.37it/s]
 93%|█████████▎| 344144/371472 [5:13:00<2:09:59,  3.50it/s]
 93%|█████████▎| 344145/371472 [5:13:01<2:12:31,  3.44it/s]
 93%|█████████▎| 344146/371472 [5:13:01<2:11:46,  3.46it/s]
 93%|█████████▎| 344147/371472 [5:13:01<2:12:57,  3.43it/s]
 93%|█████████▎| 344148/371472 [5:13:02<2:10:25,  3.49it/s]
 93%|█████████▎| 344149/371472 [5:13:02<2:05:11,  3.64it/s]
 93%|█████████▎| 344150/371472 [5:13:02<2:05:15,  3.64it/s]
 93%|█████████▎| 344151/371472 [5:13:02<2:08:28,  3.54it/s]
 93%|█████████▎| 344152/371472 [5:13:03<2:09:31,  3.52it/s]
 93%|█████████▎| 344153/371472 [5:13:03<2:12:42,  3.43it/s]
 93%|█████████▎| 344154/371472 [5:13:03<2:12:08,  3.45it/s]
 93%|█████████▎| 344155/371472 [5:13:04<2:10:00,  3.50it/s]
 93%|█████████▎| 344156/371472 [5:13:04<2:09:48,  3.51it/s]
 93%|█████████▎| 344157/371472 [5:13:04<2:11:35,  3.46it/s]
 93%|█████████▎| 344158/371472 [5:13:05<2:19:20,  3.27it/s]
 93%|█████████▎| 344159/371472 [5:13:05<2:14:59,  3.37it/s]
 93%|█████████▎| 344160/371472 [5:13:05<2:10:48,  3.48it/s]
                                                           
{'loss': 2.4886, 'learning_rate': 1.6620698571397791e-07, 'epoch': 14.82}

 93%|█████████▎| 344160/371472 [5:13:05<2:10:48,  3.48it/s]
 93%|█████████▎| 344161/371472 [5:13:05<2:06:42,  3.59it/s]
 93%|█████████▎| 344162/371472 [5:13:06<2:05:59,  3.61it/s]
 93%|█████████▎| 344163/371472 [5:13:06<2:09:51,  3.50it/s]
 93%|█████████▎| 344164/371472 [5:13:06<2:09:21,  3.52it/s]
 93%|█████████▎| 344165/371472 [5:13:06<2:07:33,  3.57it/s]
 93%|█████████▎| 344166/371472 [5:13:07<2:11:50,  3.45it/s]
 93%|█████████▎| 344167/371472 [5:13:07<2:06:14,  3.60it/s]
 93%|█████████▎| 344168/371472 [5:13:07<2:04:20,  3.66it/s]
 93%|█████████▎| 344169/371472 [5:13:08<2:03:43,  3.68it/s]
 93%|█████████▎| 344170/371472 [5:13:08<2:01:18,  3.75it/s]
 93%|█████████▎| 344171/371472 [5:13:08<2:10:52,  3.48it/s]
 93%|█████████▎| 344172/371472 [5:13:08<2:10:17,  3.49it/s]
 93%|█████████▎| 344173/371472 [5:13:09<2:07:43,  3.56it/s]
 93%|█████████▎| 344174/371472 [5:13:09<2:02:56,  3.70it/s]
 93%|█████████▎| 344175/371472 [5:13:09<2:04:40,  3.65it/s]
 93%|█████████▎| 344176/371472 [5:13:09<2:03:55,  3.67it/s]
 93%|█████████▎| 344177/371472 [5:13:10<1:59:16,  3.81it/s]
 93%|█████████▎| 344178/371472 [5:13:10<2:02:08,  3.72it/s]
 93%|█████████▎| 344179/371472 [5:13:10<2:04:38,  3.65it/s]
 93%|█████████▎| 344180/371472 [5:13:11<2:06:25,  3.60it/s]
                                                           
{'loss': 2.8566, 'learning_rate': 1.6615850373849899e-07, 'epoch': 14.82}

 93%|█████████▎| 344180/371472 [5:13:11<2:06:25,  3.60it/s]
 93%|█████████▎| 344181/371472 [5:13:11<2:06:29,  3.60it/s]
 93%|█████████▎| 344182/371472 [5:13:11<2:03:18,  3.69it/s]
 93%|█████████▎| 344183/371472 [5:13:11<2:04:25,  3.66it/s]
 93%|█████████▎| 344184/371472 [5:13:12<2:03:16,  3.69it/s]
 93%|█████████▎| 344185/371472 [5:13:12<2:04:04,  3.67it/s]
 93%|█████████▎| 344186/371472 [5:13:12<2:04:43,  3.65it/s]
 93%|█████████▎| 344187/371472 [5:13:12<2:04:13,  3.66it/s]
 93%|█████████▎| 344188/371472 [5:13:13<2:01:16,  3.75it/s]
 93%|█████████▎| 344189/371472 [5:13:13<2:00:40,  3.77it/s]
 93%|█████████▎| 344190/371472 [5:13:13<2:04:22,  3.66it/s]
 93%|█████████▎| 344191/371472 [5:13:14<2:01:19,  3.75it/s]
 93%|█████████▎| 344192/371472 [5:13:14<2:00:02,  3.79it/s]
 93%|█████████▎| 344193/371472 [5:13:14<2:00:24,  3.78it/s]
 93%|█████████▎| 344194/371472 [5:13:14<1:59:46,  3.80it/s]
 93%|█████████▎| 344195/371472 [5:13:15<2:07:36,  3.56it/s]
 93%|█████████▎| 344196/371472 [5:13:15<2:08:32,  3.54it/s]
 93%|█████████▎| 344197/371472 [5:13:15<2:03:41,  3.68it/s]
 93%|█████████▎| 344198/371472 [5:13:15<2:02:06,  3.72it/s]
 93%|█████████▎| 344199/371472 [5:13:16<2:09:21,  3.51it/s]
 93%|█████████▎| 344200/371472 [5:13:16<2:08:10,  3.55it/s]
                                                           
{'loss': 2.5231, 'learning_rate': 1.661100217630201e-07, 'epoch': 14.83}

 93%|█████████▎| 344200/371472 [5:13:16<2:08:10,  3.55it/s]
 93%|█████████▎| 344201/371472 [5:13:16<2:07:15,  3.57it/s]
 93%|█████████▎| 344202/371472 [5:13:17<2:11:24,  3.46it/s]
 93%|█████████▎| 344203/371472 [5:13:17<2:10:46,  3.48it/s]
 93%|█████████▎| 344204/371472 [5:13:17<2:06:11,  3.60it/s]
 93%|█████████▎| 344205/371472 [5:13:17<2:04:41,  3.64it/s]
 93%|█████████▎| 344206/371472 [5:13:18<2:02:25,  3.71it/s]
 93%|█████████▎| 344207/371472 [5:13:18<1:59:52,  3.79it/s]
 93%|█████████▎| 344208/371472 [5:13:18<1:57:24,  3.87it/s]
 93%|█████████▎| 344209/371472 [5:13:18<1:58:55,  3.82it/s]
 93%|█████████▎| 344210/371472 [5:13:19<1:59:07,  3.81it/s]
 93%|█████████▎| 344211/371472 [5:13:19<2:02:51,  3.70it/s]
 93%|█████████▎| 344212/371472 [5:13:19<1:59:56,  3.79it/s]
 93%|█████████▎| 344213/371472 [5:13:20<2:12:25,  3.43it/s]
 93%|█████████▎| 344214/371472 [5:13:20<2:10:48,  3.47it/s]
 93%|█████████▎| 344215/371472 [5:13:20<2:04:41,  3.64it/s]
 93%|█████████▎| 344216/371472 [5:13:20<2:05:18,  3.63it/s]
 93%|█████████▎| 344217/371472 [5:13:21<2:06:07,  3.60it/s]
 93%|█████████▎| 344218/371472 [5:13:21<2:01:29,  3.74it/s]
 93%|█████████▎| 344219/371472 [5:13:21<2:05:14,  3.63it/s]
 93%|█████████▎| 344220/371472 [5:13:21<2:02:37,  3.70it/s]
                                                           
{'loss': 2.581, 'learning_rate': 1.6606153978754118e-07, 'epoch': 14.83}

 93%|█████████▎| 344220/371472 [5:13:21<2:02:37,  3.70it/s]
 93%|█████████▎| 344221/371472 [5:13:22<2:06:25,  3.59it/s]
 93%|█████████▎| 344222/371472 [5:13:22<2:03:13,  3.69it/s]
 93%|█████████▎| 344223/371472 [5:13:22<2:02:39,  3.70it/s]
 93%|█████████▎| 344224/371472 [5:13:23<2:04:00,  3.66it/s]
 93%|█████████▎| 344225/371472 [5:13:23<2:05:52,  3.61it/s]
 93%|█████████▎| 344226/371472 [5:13:23<2:01:08,  3.75it/s]
 93%|█████████▎| 344227/371472 [5:13:23<2:02:53,  3.69it/s]
 93%|█████████▎| 344228/371472 [5:13:24<2:15:37,  3.35it/s]
 93%|█████████▎| 344229/371472 [5:13:24<2:10:01,  3.49it/s]
 93%|█████████▎| 344230/371472 [5:13:24<2:17:51,  3.29it/s]
 93%|█████████▎| 344231/371472 [5:13:25<2:11:13,  3.46it/s]
 93%|█████████▎| 344232/371472 [5:13:25<2:16:02,  3.34it/s]
 93%|█████████▎| 344233/371472 [5:13:25<2:20:47,  3.22it/s]
 93%|█████████▎| 344234/371472 [5:13:26<2:14:53,  3.37it/s]
 93%|█████████▎| 344235/371472 [5:13:26<2:15:27,  3.35it/s]
 93%|█████████▎| 344236/371472 [5:13:26<2:17:14,  3.31it/s]
 93%|█████████▎| 344237/371472 [5:13:26<2:11:45,  3.45it/s]
 93%|█████████▎| 344238/371472 [5:13:27<2:07:47,  3.55it/s]
 93%|█████████▎| 344239/371472 [5:13:27<2:03:41,  3.67it/s]
 93%|█████████▎| 344240/371472 [5:13:27<2:12:16,  3.43it/s]
                                                           
{'loss': 2.794, 'learning_rate': 1.6601305781206236e-07, 'epoch': 14.83}

 93%|█████████▎| 344240/371472 [5:13:27<2:12:16,  3.43it/s]
 93%|█████████▎| 344241/371472 [5:13:28<2:08:21,  3.54it/s]
 93%|█████████▎| 344242/371472 [5:13:28<2:13:48,  3.39it/s]
 93%|█████████▎| 344243/371472 [5:13:28<2:14:02,  3.39it/s]
 93%|█████████▎| 344244/371472 [5:13:28<2:24:01,  3.15it/s]
 93%|█████████▎| 344245/371472 [5:13:29<2:22:05,  3.19it/s]
 93%|█████████▎| 344246/371472 [5:13:29<2:19:53,  3.24it/s]
 93%|█████████▎| 344247/371472 [5:13:29<2:13:58,  3.39it/s]
 93%|█████████▎| 344248/371472 [5:13:30<2:16:21,  3.33it/s]
 93%|█████████▎| 344249/371472 [5:13:30<2:12:50,  3.42it/s]
 93%|█████████▎| 344250/371472 [5:13:30<2:10:37,  3.47it/s]
 93%|█████████▎| 344251/371472 [5:13:30<2:05:11,  3.62it/s]
 93%|█████████▎| 344252/371472 [5:13:31<2:02:37,  3.70it/s]
 93%|█████████▎| 344253/371472 [5:13:31<2:01:26,  3.74it/s]
 93%|█████████▎| 344254/371472 [5:13:31<2:01:32,  3.73it/s]
 93%|█████████▎| 344255/371472 [5:13:32<2:10:15,  3.48it/s]
 93%|█████████▎| 344256/371472 [5:13:32<2:07:17,  3.56it/s]
 93%|█████████▎| 344257/371472 [5:13:32<2:13:52,  3.39it/s]
 93%|█████████▎| 344258/371472 [5:13:32<2:09:09,  3.51it/s]
 93%|█████████▎| 344259/371472 [5:13:33<2:04:14,  3.65it/s]
 93%|█████████▎| 344260/371472 [5:13:33<2:13:32,  3.40it/s]
                                                           
{'loss': 2.4604, 'learning_rate': 1.659645758365834e-07, 'epoch': 14.83}

 93%|█████████▎| 344260/371472 [5:13:33<2:13:32,  3.40it/s]
 93%|█████████▎| 344261/371472 [5:13:33<2:11:51,  3.44it/s]
 93%|█████████▎| 344262/371472 [5:13:34<2:08:19,  3.53it/s]
 93%|█████████▎| 344263/371472 [5:13:34<2:06:54,  3.57it/s]
 93%|█████████▎| 344264/371472 [5:13:34<2:05:08,  3.62it/s]
 93%|█████████▎| 344265/371472 [5:13:34<2:04:29,  3.64it/s]
 93%|█████████▎| 344266/371472 [5:13:35<2:04:43,  3.64it/s]
 93%|█████████▎| 344267/371472 [5:13:35<2:04:37,  3.64it/s]
 93%|█████████▎| 344268/371472 [5:13:35<2:06:28,  3.59it/s]
 93%|█████████▎| 344269/371472 [5:13:36<2:06:50,  3.57it/s]
 93%|█████████▎| 344270/371472 [5:13:36<2:03:04,  3.68it/s]
 93%|█████████▎| 344271/371472 [5:13:36<2:03:13,  3.68it/s]
 93%|█████████▎| 344272/371472 [5:13:36<2:03:29,  3.67it/s]
 93%|█████████▎| 344273/371472 [5:13:37<2:09:40,  3.50it/s]
 93%|█████████▎| 344274/371472 [5:13:37<2:06:31,  3.58it/s]
 93%|█████████▎| 344275/371472 [5:13:37<2:02:53,  3.69it/s]
 93%|█████████▎| 344276/371472 [5:13:37<2:00:30,  3.76it/s]
 93%|█████████▎| 344277/371472 [5:13:38<2:02:57,  3.69it/s]
 93%|█████████▎| 344278/371472 [5:13:38<2:03:24,  3.67it/s]
 93%|█████████▎| 344279/371472 [5:13:38<2:03:11,  3.68it/s]
 93%|█████████▎| 344280/371472 [5:13:38<2:02:23,  3.70it/s]
                                                           
{'loss': 2.663, 'learning_rate': 1.6591609386110455e-07, 'epoch': 14.83}

 93%|█████████▎| 344280/371472 [5:13:39<2:02:23,  3.70it/s]
 93%|█████████▎| 344281/371472 [5:13:39<2:06:14,  3.59it/s]
 93%|█████████▎| 344282/371472 [5:13:39<2:06:09,  3.59it/s]
 93%|█████████▎| 344283/371472 [5:13:39<2:06:52,  3.57it/s]
 93%|█████████▎| 344284/371472 [5:13:40<2:02:56,  3.69it/s]
 93%|█████████▎| 344285/371472 [5:13:40<2:15:22,  3.35it/s]
 93%|█████████▎| 344286/371472 [5:13:40<2:10:28,  3.47it/s]
 93%|█████████▎| 344287/371472 [5:13:41<2:16:14,  3.33it/s]
 93%|█████████▎| 344288/371472 [5:13:41<2:14:10,  3.38it/s]
 93%|█████████▎| 344289/371472 [5:13:41<2:13:10,  3.40it/s]
 93%|█████████▎| 344290/371472 [5:13:41<2:08:51,  3.52it/s]
 93%|█████████▎| 344291/371472 [5:13:42<2:10:38,  3.47it/s]
 93%|█████████▎| 344292/371472 [5:13:42<2:13:06,  3.40it/s]
 93%|█████████▎| 344293/371472 [5:13:42<2:09:31,  3.50it/s]
 93%|█████████▎| 344294/371472 [5:13:43<2:22:18,  3.18it/s]
 93%|█████████▎| 344295/371472 [5:13:43<2:23:57,  3.15it/s]
 93%|█████████▎| 344296/371472 [5:13:43<2:21:28,  3.20it/s]
 93%|█████████▎| 344297/371472 [5:13:44<2:24:42,  3.13it/s]
 93%|█████████▎| 344298/371472 [5:13:44<2:22:53,  3.17it/s]
 93%|█████████▎| 344299/371472 [5:13:44<2:22:56,  3.17it/s]
 93%|█████████▎| 344300/371472 [5:13:44<2:14:08,  3.38it/s]
                                                           
{'loss': 2.6029, 'learning_rate': 1.6586761188562563e-07, 'epoch': 14.83}

 93%|█████████▎| 344300/371472 [5:13:44<2:14:08,  3.38it/s]
 93%|█████████▎| 344301/371472 [5:13:45<2:09:10,  3.51it/s]
 93%|█████████▎| 344302/371472 [5:13:45<2:07:00,  3.57it/s]
 93%|█████████▎| 344303/371472 [5:13:45<2:05:52,  3.60it/s]
 93%|█████████▎| 344304/371472 [5:13:46<2:28:25,  3.05it/s]
 93%|█████████▎| 344305/371472 [5:13:46<2:23:00,  3.17it/s]
 93%|█████████▎| 344306/371472 [5:13:46<2:15:59,  3.33it/s]
 93%|█████████▎| 344307/371472 [5:13:47<2:09:54,  3.49it/s]
 93%|█████████▎| 344308/371472 [5:13:47<2:06:47,  3.57it/s]
 93%|█████████▎| 344309/371472 [5:13:47<2:22:03,  3.19it/s]
 93%|█████████▎| 344310/371472 [5:13:47<2:14:39,  3.36it/s]
 93%|█████████▎| 344311/371472 [5:13:48<2:10:19,  3.47it/s]
 93%|█████████▎| 344312/371472 [5:13:48<2:05:34,  3.60it/s]
 93%|█████████▎| 344313/371472 [5:13:48<2:04:17,  3.64it/s]
 93%|█████████▎| 344314/371472 [5:13:49<2:03:04,  3.68it/s]
 93%|█████████▎| 344315/371472 [5:13:49<2:08:41,  3.52it/s]
 93%|█████████▎| 344316/371472 [5:13:49<2:03:00,  3.68it/s]
 93%|█████████▎| 344317/371472 [5:13:49<2:01:20,  3.73it/s]
 93%|█████████▎| 344318/371472 [5:13:50<2:03:38,  3.66it/s]
 93%|█████████▎| 344319/371472 [5:13:50<2:07:38,  3.55it/s]
 93%|█████████▎| 344320/371472 [5:13:50<2:04:04,  3.65it/s]
                                                           
{'loss': 2.603, 'learning_rate': 1.6581912991014678e-07, 'epoch': 14.83}

 93%|█████████▎| 344320/371472 [5:13:50<2:04:04,  3.65it/s]
 93%|█████████▎| 344321/371472 [5:13:50<2:02:03,  3.71it/s]
 93%|█████████▎| 344322/371472 [5:13:51<2:01:00,  3.74it/s]
 93%|█████████▎| 344323/371472 [5:13:51<2:10:48,  3.46it/s]
 93%|█████████▎| 344324/371472 [5:13:51<2:06:01,  3.59it/s]
 93%|█████████▎| 344325/371472 [5:13:52<2:11:32,  3.44it/s]
 93%|█████████▎| 344326/371472 [5:13:52<2:07:22,  3.55it/s]
 93%|█████████▎| 344327/371472 [5:13:52<2:02:05,  3.71it/s]
 93%|█████████▎| 344328/371472 [5:13:52<1:58:44,  3.81it/s]
 93%|█████████▎| 344329/371472 [5:13:53<2:01:33,  3.72it/s]
 93%|█████████▎| 344330/371472 [5:13:53<2:04:11,  3.64it/s]
 93%|█████████▎| 344331/371472 [5:13:53<2:01:25,  3.73it/s]
 93%|█████████▎| 344332/371472 [5:13:53<2:01:18,  3.73it/s]
 93%|█████████▎| 344333/371472 [5:13:54<2:00:45,  3.75it/s]
 93%|█████████▎| 344334/371472 [5:13:54<1:59:47,  3.78it/s]
 93%|█████████▎| 344335/371472 [5:13:54<2:03:28,  3.66it/s]
 93%|█████████▎| 344336/371472 [5:13:55<2:03:08,  3.67it/s]
 93%|█████████▎| 344337/371472 [5:13:55<2:19:06,  3.25it/s]
 93%|█████████▎| 344338/371472 [5:13:55<2:10:30,  3.47it/s]
 93%|█████████▎| 344339/371472 [5:13:55<2:12:20,  3.42it/s]
 93%|█████████▎| 344340/371472 [5:13:56<2:08:21,  3.52it/s]
                                                           
{'loss': 2.5551, 'learning_rate': 1.6577064793466782e-07, 'epoch': 14.83}

 93%|█████████▎| 344340/371472 [5:13:56<2:08:21,  3.52it/s]
 93%|█████████▎| 344341/371472 [5:13:56<2:05:01,  3.62it/s]
 93%|█████████▎| 344342/371472 [5:13:56<2:03:02,  3.67it/s]
 93%|█████████▎| 344343/371472 [5:13:57<2:04:05,  3.64it/s]
 93%|█████████▎| 344344/371472 [5:13:57<2:07:44,  3.54it/s]
 93%|█████████▎| 344345/371472 [5:13:57<2:06:12,  3.58it/s]
 93%|█████████▎| 344346/371472 [5:13:57<2:02:06,  3.70it/s]
 93%|█████████▎| 344347/371472 [5:13:58<2:01:12,  3.73it/s]
 93%|█████████▎| 344348/371472 [5:13:58<2:00:32,  3.75it/s]
 93%|█████████▎| 344349/371472 [5:13:58<2:05:16,  3.61it/s]
 93%|█████████▎| 344350/371472 [5:13:59<2:25:05,  3.12it/s]
 93%|█████████▎| 344351/371472 [5:13:59<2:19:24,  3.24it/s]
 93%|█████████▎| 344352/371472 [5:13:59<2:11:37,  3.43it/s]
 93%|█████████▎| 344353/371472 [5:13:59<2:08:53,  3.51it/s]
 93%|█████████▎| 344354/371472 [5:14:00<2:10:54,  3.45it/s]
 93%|█████████▎| 344355/371472 [5:14:00<2:09:43,  3.48it/s]
 93%|█████████▎| 344356/371472 [5:14:00<2:12:14,  3.42it/s]
 93%|█████████▎| 344357/371472 [5:14:01<2:11:54,  3.43it/s]
 93%|█████████▎| 344358/371472 [5:14:01<2:13:04,  3.40it/s]
 93%|█████████▎| 344359/371472 [5:14:01<2:14:51,  3.35it/s]
 93%|█████████▎| 344360/371472 [5:14:02<2:27:38,  3.06it/s]
                                                           
{'loss': 2.7415, 'learning_rate': 1.65722165959189e-07, 'epoch': 14.83}

 93%|█████████▎| 344360/371472 [5:14:02<2:27:38,  3.06it/s]
 93%|█████████▎| 344361/371472 [5:14:02<2:23:38,  3.15it/s]
 93%|█████████▎| 344362/371472 [5:14:02<2:15:36,  3.33it/s]
 93%|█████████▎| 344363/371472 [5:14:02<2:14:03,  3.37it/s]
 93%|█████████▎| 344364/371472 [5:14:03<2:11:35,  3.43it/s]
 93%|█████████▎| 344365/371472 [5:14:03<2:07:32,  3.54it/s]
 93%|█████████▎| 344366/371472 [5:14:03<2:13:22,  3.39it/s]
 93%|█████████▎| 344367/371472 [5:14:04<2:14:11,  3.37it/s]
 93%|█████████▎| 344368/371472 [5:14:04<2:13:07,  3.39it/s]
 93%|█████████▎| 344369/371472 [5:14:04<2:13:05,  3.39it/s]
 93%|█████████▎| 344370/371472 [5:14:04<2:07:58,  3.53it/s]
 93%|█████████▎| 344371/371472 [5:14:05<2:07:36,  3.54it/s]
 93%|█████████▎| 344372/371472 [5:14:05<2:21:06,  3.20it/s]
 93%|█████████▎| 344373/371472 [5:14:05<2:10:57,  3.45it/s]
 93%|█████████▎| 344374/371472 [5:14:06<2:10:49,  3.45it/s]
 93%|█████████▎| 344375/371472 [5:14:06<2:07:35,  3.54it/s]
 93%|█████████▎| 344376/371472 [5:14:06<2:10:32,  3.46it/s]
 93%|█████████▎| 344377/371472 [5:14:06<2:11:17,  3.44it/s]
 93%|█████████▎| 344378/371472 [5:14:07<2:09:44,  3.48it/s]
 93%|█████████▎| 344379/371472 [5:14:07<2:08:57,  3.50it/s]
 93%|█████████▎| 344380/371472 [5:14:07<2:05:04,  3.61it/s]
                                                           
{'loss': 2.5495, 'learning_rate': 1.6567368398371004e-07, 'epoch': 14.83}

 93%|█████████▎| 344380/371472 [5:14:07<2:05:04,  3.61it/s]
 93%|█████████▎| 344381/371472 [5:14:08<2:08:00,  3.53it/s]
 93%|█████████▎| 344382/371472 [5:14:08<2:07:34,  3.54it/s]
 93%|█████████▎| 344383/371472 [5:14:08<2:12:32,  3.41it/s]
 93%|█████████▎| 344384/371472 [5:14:09<2:12:59,  3.39it/s]
 93%|█████████▎| 344385/371472 [5:14:09<2:09:35,  3.48it/s]
 93%|█████████▎| 344386/371472 [5:14:09<2:07:56,  3.53it/s]
 93%|█████████▎| 344387/371472 [5:14:10<2:53:14,  2.61it/s]
 93%|█████████▎| 344388/371472 [5:14:10<2:36:19,  2.89it/s]
 93%|█████████▎| 344389/371472 [5:14:10<2:34:46,  2.92it/s]
 93%|█████████▎| 344390/371472 [5:14:11<2:28:14,  3.04it/s]
 93%|█████████▎| 344391/371472 [5:14:11<2:30:53,  2.99it/s]
 93%|█████████▎| 344392/371472 [5:14:11<2:20:52,  3.20it/s]
 93%|█████████▎| 344393/371472 [5:14:11<2:16:15,  3.31it/s]
 93%|█████████▎| 344394/371472 [5:14:12<2:18:27,  3.26it/s]
 93%|█████████▎| 344395/371472 [5:14:12<2:11:54,  3.42it/s]
 93%|█████████▎| 344396/371472 [5:14:12<2:07:18,  3.54it/s]
 93%|█████████▎| 344397/371472 [5:14:13<2:17:08,  3.29it/s]
 93%|█████████▎| 344398/371472 [5:14:13<2:15:13,  3.34it/s]
 93%|█████████▎| 344399/371472 [5:14:13<2:08:02,  3.52it/s]
 93%|█████████▎| 344400/371472 [5:14:13<2:11:54,  3.42it/s]
                                                           
{'loss': 2.5892, 'learning_rate': 1.656252020082312e-07, 'epoch': 14.83}

 93%|█████████▎| 344400/371472 [5:14:13<2:11:54,  3.42it/s]
 93%|█████████▎| 344401/371472 [5:14:14<2:07:35,  3.54it/s]
 93%|█████████▎| 344402/371472 [5:14:14<2:11:55,  3.42it/s]
 93%|█████████▎| 344403/371472 [5:14:14<2:09:37,  3.48it/s]
 93%|█████████▎| 344404/371472 [5:14:15<2:14:14,  3.36it/s]
 93%|█████████▎| 344405/371472 [5:14:15<2:10:21,  3.46it/s]
 93%|█████████▎| 344406/371472 [5:14:15<2:10:33,  3.46it/s]
 93%|█████████▎| 344407/371472 [5:14:16<2:17:26,  3.28it/s]
 93%|█████████▎| 344408/371472 [5:14:16<2:09:43,  3.48it/s]
 93%|█████████▎| 344409/371472 [5:14:16<2:05:59,  3.58it/s]
 93%|█████████▎| 344410/371472 [5:14:16<2:03:24,  3.65it/s]
 93%|█████████▎| 344411/371472 [5:14:17<2:05:19,  3.60it/s]
 93%|█████████▎| 344412/371472 [5:14:17<2:10:54,  3.45it/s]
 93%|█████████▎| 344413/371472 [5:14:17<2:09:24,  3.48it/s]
 93%|█████████▎| 344414/371472 [5:14:17<2:05:38,  3.59it/s]
 93%|█████████▎| 344415/371472 [5:14:18<2:02:36,  3.68it/s]
 93%|█████████▎| 344416/371472 [5:14:18<2:07:09,  3.55it/s]
 93%|█████████▎| 344417/371472 [5:14:18<2:08:18,  3.51it/s]
 93%|█████████▎| 344418/371472 [5:14:19<2:11:25,  3.43it/s]
 93%|█████████▎| 344419/371472 [5:14:19<2:16:36,  3.30it/s]
 93%|█████████▎| 344420/371472 [5:14:19<2:21:13,  3.19it/s]
                                                           
{'loss': 2.6541, 'learning_rate': 1.6557672003275227e-07, 'epoch': 14.83}

 93%|█████████▎| 344420/371472 [5:14:19<2:21:13,  3.19it/s]
 93%|█████████▎| 344421/371472 [5:14:20<2:16:17,  3.31it/s]
 93%|█████████▎| 344422/371472 [5:14:20<2:21:35,  3.18it/s]
 93%|█████████▎| 344423/371472 [5:14:20<2:14:48,  3.34it/s]
 93%|█████████▎| 344424/371472 [5:14:20<2:05:49,  3.58it/s]
 93%|█████████▎| 344425/371472 [5:14:21<2:17:03,  3.29it/s]
 93%|█████████▎| 344426/371472 [5:14:21<2:10:18,  3.46it/s]
 93%|█████████▎| 344427/371472 [5:14:21<2:06:33,  3.56it/s]
 93%|█████████▎| 344428/371472 [5:14:22<2:05:40,  3.59it/s]
 93%|█████████▎| 344429/371472 [5:14:22<2:00:00,  3.76it/s]
 93%|█████████▎| 344430/371472 [5:14:22<2:04:35,  3.62it/s]
 93%|█████████▎| 344431/371472 [5:14:22<2:06:39,  3.56it/s]
 93%|█████████▎| 344432/371472 [5:14:23<2:02:59,  3.66it/s]
 93%|█████████▎| 344433/371472 [5:14:23<2:02:30,  3.68it/s]
 93%|█████████▎| 344434/371472 [5:14:23<2:01:10,  3.72it/s]
 93%|█████████▎| 344435/371472 [5:14:24<2:10:49,  3.44it/s]
 93%|█████████▎| 344436/371472 [5:14:24<2:19:18,  3.23it/s]
 93%|█████████▎| 344437/371472 [5:14:24<2:12:23,  3.40it/s]
 93%|█████████▎| 344438/371472 [5:14:24<2:11:34,  3.42it/s]
 93%|█████████▎| 344439/371472 [5:14:25<2:08:29,  3.51it/s]
 93%|█████████▎| 344440/371472 [5:14:25<2:03:32,  3.65it/s]
                                                           
{'loss': 2.5401, 'learning_rate': 1.655282380572733e-07, 'epoch': 14.84}

 93%|█████████▎| 344440/371472 [5:14:25<2:03:32,  3.65it/s]
 93%|█████████▎| 344441/371472 [5:14:25<2:10:35,  3.45it/s]
 93%|█████████▎| 344442/371472 [5:14:26<2:14:00,  3.36it/s]
 93%|█████████▎| 344443/371472 [5:14:26<2:07:50,  3.52it/s]
 93%|█████████▎| 344444/371472 [5:14:26<2:04:01,  3.63it/s]
 93%|█████████▎| 344445/371472 [5:14:26<2:04:21,  3.62it/s]
 93%|█████████▎| 344446/371472 [5:14:27<2:01:33,  3.71it/s]
 93%|█████████▎| 344447/371472 [5:14:27<2:03:02,  3.66it/s]
 93%|█████████▎| 344448/371472 [5:14:27<2:01:28,  3.71it/s]
 93%|█████████▎| 344449/371472 [5:14:27<2:01:55,  3.69it/s]
 93%|█████████▎| 344450/371472 [5:14:28<2:04:45,  3.61it/s]
 93%|█████████▎| 344451/371472 [5:14:28<2:02:48,  3.67it/s]
 93%|█████████▎| 344452/371472 [5:14:28<2:07:09,  3.54it/s]
 93%|█████████▎| 344453/371472 [5:14:29<2:01:56,  3.69it/s]
 93%|█████████▎| 344454/371472 [5:14:29<2:04:37,  3.61it/s]
 93%|█████████▎| 344455/371472 [5:14:29<2:04:48,  3.61it/s]
 93%|█████████▎| 344456/371472 [5:14:29<2:09:58,  3.46it/s]
 93%|█████████▎| 344457/371472 [5:14:30<2:07:33,  3.53it/s]
 93%|█████████▎| 344458/371472 [5:14:30<2:16:11,  3.31it/s]
 93%|█████████▎| 344459/371472 [5:14:30<2:09:26,  3.48it/s]
 93%|█████████▎| 344460/371472 [5:14:31<2:15:50,  3.31it/s]
                                                           
{'loss': 2.6194, 'learning_rate': 1.6547975608179446e-07, 'epoch': 14.84}

 93%|█████████▎| 344460/371472 [5:14:31<2:15:50,  3.31it/s]
 93%|█████████▎| 344461/371472 [5:14:31<2:10:16,  3.46it/s]
 93%|█████████▎| 344462/371472 [5:14:31<2:10:27,  3.45it/s]
 93%|█████████▎| 344463/371472 [5:14:31<2:09:16,  3.48it/s]
 93%|█████████▎| 344464/371472 [5:14:32<2:08:45,  3.50it/s]
 93%|█████████▎| 344465/371472 [5:14:32<2:08:40,  3.50it/s]
 93%|█████████▎| 344466/371472 [5:14:32<2:04:55,  3.60it/s]
 93%|█████████▎| 344467/371472 [5:14:33<2:06:32,  3.56it/s]
 93%|█████████▎| 344468/371472 [5:14:33<2:06:53,  3.55it/s]
 93%|█████████▎| 344469/371472 [5:14:33<2:02:29,  3.67it/s]
 93%|█████████▎| 344470/371472 [5:14:33<2:00:30,  3.73it/s]
 93%|█████████▎| 344471/371472 [5:14:34<2:06:22,  3.56it/s]
 93%|█████████▎| 344472/371472 [5:14:34<2:02:59,  3.66it/s]
 93%|█████████▎| 344473/371472 [5:14:34<2:17:40,  3.27it/s]
 93%|█████████▎| 344474/371472 [5:14:35<2:14:23,  3.35it/s]
 93%|█████████▎| 344475/371472 [5:14:35<2:09:51,  3.47it/s]
 93%|█████████▎| 344476/371472 [5:14:35<2:07:36,  3.53it/s]
 93%|█████████▎| 344477/371472 [5:14:35<2:08:43,  3.49it/s]
 93%|█████████▎| 344478/371472 [5:14:36<2:07:47,  3.52it/s]
 93%|█████████▎| 344479/371472 [5:14:36<2:05:21,  3.59it/s]
 93%|█████████▎| 344480/371472 [5:14:36<2:09:57,  3.46it/s]
                                                           
{'loss': 2.6601, 'learning_rate': 1.6543127410631553e-07, 'epoch': 14.84}

 93%|█████████▎| 344480/371472 [5:14:36<2:09:57,  3.46it/s]
 93%|█████████▎| 344481/371472 [5:14:37<2:07:32,  3.53it/s]
 93%|█████████▎| 344482/371472 [5:14:37<2:10:16,  3.45it/s]
 93%|█████████▎| 344483/371472 [5:14:37<2:05:05,  3.60it/s]
 93%|█████████▎| 344484/371472 [5:14:37<2:05:01,  3.60it/s]
 93%|█████████▎| 344485/371472 [5:14:38<1:59:41,  3.76it/s]
 93%|█████████▎| 344486/371472 [5:14:38<2:00:16,  3.74it/s]
 93%|█████████▎| 344487/371472 [5:14:38<2:00:58,  3.72it/s]
 93%|█████████▎| 344488/371472 [5:14:38<2:01:39,  3.70it/s]
 93%|█████████▎| 344489/371472 [5:14:39<2:04:43,  3.61it/s]
 93%|█████████▎| 344490/371472 [5:14:39<2:03:23,  3.64it/s]
 93%|█████████▎| 344491/371472 [5:14:39<2:02:28,  3.67it/s]
 93%|█████████▎| 344492/371472 [5:14:40<2:08:24,  3.50it/s]
 93%|█████████▎| 344493/371472 [5:14:40<2:04:52,  3.60it/s]
 93%|█████████▎| 344494/371472 [5:14:40<2:06:33,  3.55it/s]
 93%|█████████▎| 344495/371472 [5:14:40<2:12:39,  3.39it/s]
 93%|█████████▎| 344496/371472 [5:14:41<2:16:16,  3.30it/s]
 93%|█████████▎| 344497/371472 [5:14:41<2:14:45,  3.34it/s]
 93%|█████████▎| 344498/371472 [5:14:41<2:07:48,  3.52it/s]
 93%|█████████▎| 344499/371472 [5:14:42<2:03:09,  3.65it/s]
 93%|█████████▎| 344500/371472 [5:14:42<2:10:31,  3.44it/s]
                                                           
{'loss': 2.6342, 'learning_rate': 1.6538279213083669e-07, 'epoch': 14.84}

 93%|█████████▎| 344500/371472 [5:14:42<2:10:31,  3.44it/s]
 93%|█████████▎| 344501/371472 [5:14:42<2:11:58,  3.41it/s]
 93%|█████████▎| 344502/371472 [5:14:42<2:09:20,  3.48it/s]
 93%|█████████▎| 344503/371472 [5:14:43<2:06:24,  3.56it/s]
 93%|█████████▎| 344504/371472 [5:14:43<2:02:59,  3.65it/s]
 93%|█████████▎| 344505/371472 [5:14:43<2:07:32,  3.52it/s]
 93%|█████████▎| 344506/371472 [5:14:44<2:11:12,  3.43it/s]
 93%|█████████▎| 344507/371472 [5:14:44<2:09:27,  3.47it/s]
 93%|█████████▎| 344508/371472 [5:14:44<2:24:50,  3.10it/s]
 93%|█████████▎| 344509/371472 [5:14:45<2:23:38,  3.13it/s]
 93%|█████████▎| 344510/371472 [5:14:45<2:16:26,  3.29it/s]
 93%|█████████▎| 344511/371472 [5:14:45<2:09:24,  3.47it/s]
 93%|█████████▎| 344512/371472 [5:14:45<2:05:56,  3.57it/s]
 93%|█████████▎| 344513/371472 [5:14:46<2:05:17,  3.59it/s]
 93%|█████████▎| 344514/371472 [5:14:46<2:06:10,  3.56it/s]
 93%|█████████▎| 344515/371472 [5:14:46<2:05:14,  3.59it/s]
 93%|█████████▎| 344516/371472 [5:14:47<2:22:49,  3.15it/s]
 93%|█████████▎| 344517/371472 [5:14:47<2:16:38,  3.29it/s]
 93%|█████████▎| 344518/371472 [5:14:47<2:13:14,  3.37it/s]
 93%|█████████▎| 344519/371472 [5:14:47<2:08:50,  3.49it/s]
 93%|█████████▎| 344520/371472 [5:14:48<2:39:09,  2.82it/s]
                                                           
{'loss': 2.587, 'learning_rate': 1.6533431015535773e-07, 'epoch': 14.84}

 93%|█████████▎| 344520/371472 [5:14:48<2:39:09,  2.82it/s]
 93%|█████████▎| 344521/371472 [5:14:48<2:34:34,  2.91it/s]
 93%|█████████▎| 344522/371472 [5:14:49<2:23:24,  3.13it/s]
 93%|█████████▎| 344523/371472 [5:14:49<2:21:45,  3.17it/s]
 93%|█████████▎| 344524/371472 [5:14:49<2:15:15,  3.32it/s]
 93%|█████████▎| 344525/371472 [5:14:49<2:15:11,  3.32it/s]
 93%|█████████▎| 344526/371472 [5:14:50<2:07:28,  3.52it/s]
 93%|█████████▎| 344527/371472 [5:14:50<2:09:41,  3.46it/s]
 93%|█████████▎| 344528/371472 [5:14:50<2:14:39,  3.33it/s]
 93%|█████████▎| 344529/371472 [5:14:51<2:07:01,  3.53it/s]
 93%|█████████▎| 344530/371472 [5:14:51<2:08:04,  3.51it/s]
 93%|█████████▎| 344531/371472 [5:14:51<2:14:33,  3.34it/s]
 93%|█████████▎| 344532/371472 [5:14:51<2:06:16,  3.56it/s]
 93%|█████████▎| 344533/371472 [5:14:52<2:07:47,  3.51it/s]
 93%|█████████▎| 344534/371472 [5:14:52<2:05:43,  3.57it/s]
 93%|█████████▎| 344535/371472 [5:14:52<2:03:19,  3.64it/s]
 93%|█████████▎| 344536/371472 [5:14:52<2:03:06,  3.65it/s]
 93%|█████████▎| 344537/371472 [5:14:53<2:02:18,  3.67it/s]
 93%|█████████▎| 344538/371472 [5:14:53<2:01:42,  3.69it/s]
 93%|█████████▎| 344539/371472 [5:14:53<2:03:37,  3.63it/s]
 93%|█████████▎| 344540/371472 [5:14:54<2:05:22,  3.58it/s]
                                                           
{'loss': 2.5741, 'learning_rate': 1.652858281798789e-07, 'epoch': 14.84}

 93%|█████████▎| 344540/371472 [5:14:54<2:05:22,  3.58it/s]
 93%|█████████▎| 344541/371472 [5:14:54<2:01:54,  3.68it/s]
 93%|█████████▎| 344542/371472 [5:14:54<2:03:31,  3.63it/s]
 93%|█████████▎| 344543/371472 [5:14:55<2:18:35,  3.24it/s]
 93%|█████████▎| 344544/371472 [5:14:55<2:24:01,  3.12it/s]
 93%|█████████▎| 344545/371472 [5:14:55<2:20:40,  3.19it/s]
 93%|█████████▎| 344546/371472 [5:14:55<2:10:43,  3.43it/s]
 93%|█████████▎| 344547/371472 [5:14:56<2:09:31,  3.46it/s]
 93%|█████████▎| 344548/371472 [5:14:56<2:11:20,  3.42it/s]
 93%|█████████▎| 344549/371472 [5:14:56<2:19:43,  3.21it/s]
 93%|█████████▎| 344550/371472 [5:14:57<2:13:45,  3.35it/s]
 93%|█████████▎| 344551/371472 [5:14:57<2:09:59,  3.45it/s]
 93%|█████████▎| 344552/371472 [5:14:57<2:07:01,  3.53it/s]
 93%|█████████▎| 344553/371472 [5:14:57<2:10:08,  3.45it/s]
 93%|█████████▎| 344554/371472 [5:14:58<2:10:11,  3.45it/s]
 93%|█████████▎| 344555/371472 [5:14:58<2:10:16,  3.44it/s]
 93%|█████████▎| 344556/371472 [5:14:58<2:08:40,  3.49it/s]
 93%|█████████▎| 344557/371472 [5:14:59<2:08:54,  3.48it/s]
 93%|█████████▎| 344558/371472 [5:14:59<2:10:33,  3.44it/s]
 93%|█████████▎| 344559/371472 [5:14:59<2:06:44,  3.54it/s]
 93%|█████████▎| 344560/371472 [5:14:59<2:04:19,  3.61it/s]
                                                           
{'loss': 2.6947, 'learning_rate': 1.6523734620439998e-07, 'epoch': 14.84}

 93%|█████████▎| 344560/371472 [5:14:59<2:04:19,  3.61it/s]
 93%|█████████▎| 344561/371472 [5:15:00<2:07:30,  3.52it/s]
 93%|█████████▎| 344562/371472 [5:15:00<2:12:16,  3.39it/s]
 93%|█████████▎| 344563/371472 [5:15:00<2:08:05,  3.50it/s]
 93%|█████████▎| 344564/371472 [5:15:01<2:06:48,  3.54it/s]
 93%|█████████▎| 344565/371472 [5:15:01<2:06:32,  3.54it/s]
 93%|█████████▎| 344566/371472 [5:15:01<2:06:53,  3.53it/s]
 93%|█████████▎| 344567/371472 [5:15:01<2:05:46,  3.57it/s]
 93%|█████████▎| 344568/371472 [5:15:02<2:02:29,  3.66it/s]
 93%|█████████▎| 344569/371472 [5:15:02<2:07:25,  3.52it/s]
 93%|█████████▎| 344570/371472 [5:15:02<2:07:20,  3.52it/s]
 93%|█████████▎| 344571/371472 [5:15:03<2:06:59,  3.53it/s]
 93%|█████████▎| 344572/371472 [5:15:03<2:15:11,  3.32it/s]
 93%|█████████▎| 344573/371472 [5:15:03<2:14:18,  3.34it/s]
 93%|█████████▎| 344574/371472 [5:15:04<2:25:26,  3.08it/s]
 93%|█████████▎| 344575/371472 [5:15:04<2:22:02,  3.16it/s]
 93%|█████████▎| 344576/371472 [5:15:04<2:24:05,  3.11it/s]
 93%|█████████▎| 344577/371472 [5:15:04<2:14:14,  3.34it/s]
 93%|█████████▎| 344578/371472 [5:15:05<2:10:28,  3.44it/s]
 93%|█████████▎| 344579/371472 [5:15:05<2:10:31,  3.43it/s]
 93%|█████████▎| 344580/371472 [5:15:05<2:14:24,  3.33it/s]
                                                           
{'loss': 2.4015, 'learning_rate': 1.651888642289211e-07, 'epoch': 14.84}

 93%|█████████▎| 344580/371472 [5:15:05<2:14:24,  3.33it/s]
 93%|█████████▎| 344581/371472 [5:15:06<2:09:53,  3.45it/s]
 93%|█████████▎| 344582/371472 [5:15:06<2:06:20,  3.55it/s]
 93%|█████████▎| 344583/371472 [5:15:06<2:09:43,  3.45it/s]
 93%|█████████▎| 344584/371472 [5:15:06<2:09:20,  3.46it/s]
 93%|█████████▎| 344585/371472 [5:15:07<2:05:22,  3.57it/s]
 93%|█████████▎| 344586/371472 [5:15:07<2:07:09,  3.52it/s]
 93%|█████████▎| 344587/371472 [5:15:07<2:13:07,  3.37it/s]
 93%|█████████▎| 344588/371472 [5:15:08<2:07:40,  3.51it/s]
 93%|█████████▎| 344589/371472 [5:15:08<2:05:56,  3.56it/s]
 93%|█████████▎| 344590/371472 [5:15:08<2:03:04,  3.64it/s]
 93%|█████████▎| 344591/371472 [5:15:08<2:00:53,  3.71it/s]
 93%|█████████▎| 344592/371472 [5:15:09<2:01:29,  3.69it/s]
 93%|█████████▎| 344593/371472 [5:15:09<2:10:26,  3.43it/s]
 93%|█████████▎| 344594/371472 [5:15:09<2:11:45,  3.40it/s]
 93%|█████████▎| 344595/371472 [5:15:10<2:08:09,  3.50it/s]
 93%|█████████▎| 344596/371472 [5:15:10<2:11:31,  3.41it/s]
 93%|█████████▎| 344597/371472 [5:15:10<2:07:08,  3.52it/s]
 93%|█████████▎| 344598/371472 [5:15:10<2:02:47,  3.65it/s]
 93%|█████████▎| 344599/371472 [5:15:11<1:58:24,  3.78it/s]
 93%|█████████▎| 344600/371472 [5:15:11<2:08:56,  3.47it/s]
                                                           
{'loss': 2.6114, 'learning_rate': 1.6514038225344218e-07, 'epoch': 14.84}

 93%|█████████▎| 344600/371472 [5:15:11<2:08:56,  3.47it/s]
 93%|█████████▎| 344601/371472 [5:15:11<2:05:22,  3.57it/s]
 93%|█████████▎| 344602/371472 [5:15:12<2:05:14,  3.58it/s]
 93%|█████████▎| 344603/371472 [5:15:12<2:05:27,  3.57it/s]
 93%|█████████▎| 344604/371472 [5:15:12<2:03:10,  3.64it/s]
 93%|█████████▎| 344605/371472 [5:15:12<2:03:20,  3.63it/s]
 93%|█████████▎| 344606/371472 [5:15:13<2:04:39,  3.59it/s]
 93%|█████████▎| 344607/371472 [5:15:13<2:05:25,  3.57it/s]
 93%|█████████▎| 344608/371472 [5:15:13<2:00:53,  3.70it/s]
 93%|█████████▎| 344609/371472 [5:15:13<2:02:22,  3.66it/s]
 93%|█████████▎| 344610/371472 [5:15:14<1:59:11,  3.76it/s]
 93%|█████████▎| 344611/371472 [5:15:14<2:01:40,  3.68it/s]
 93%|█████████▎| 344612/371472 [5:15:14<2:04:03,  3.61it/s]
 93%|█████████▎| 344613/371472 [5:15:15<2:01:04,  3.70it/s]
 93%|█████████▎| 344614/371472 [5:15:15<2:10:48,  3.42it/s]
 93%|█████████▎| 344615/371472 [5:15:15<2:06:48,  3.53it/s]
 93%|█████████▎| 344616/371472 [5:15:15<2:01:55,  3.67it/s]
 93%|█████████▎| 344617/371472 [5:15:16<1:57:29,  3.81it/s]
 93%|█████████▎| 344618/371472 [5:15:16<2:04:30,  3.59it/s]
 93%|█████████▎| 344619/371472 [5:15:16<2:07:41,  3.50it/s]
 93%|█████████▎| 344620/371472 [5:15:17<2:05:24,  3.57it/s]
                                                           
{'loss': 2.734, 'learning_rate': 1.6509190027796335e-07, 'epoch': 14.84}

 93%|█████████▎| 344620/371472 [5:15:17<2:05:24,  3.57it/s]
 93%|█████████▎| 344621/371472 [5:15:17<2:04:50,  3.58it/s]
 93%|█████████▎| 344622/371472 [5:15:17<2:03:16,  3.63it/s]
 93%|█████████▎| 344623/371472 [5:15:17<2:01:37,  3.68it/s]
 93%|█████████▎| 344624/371472 [5:15:18<2:03:29,  3.62it/s]
 93%|█████████▎| 344625/371472 [5:15:18<2:01:53,  3.67it/s]
 93%|█████████▎| 344626/371472 [5:15:18<2:04:41,  3.59it/s]
 93%|█████████▎| 344627/371472 [5:15:18<2:08:57,  3.47it/s]
 93%|█████████▎| 344628/371472 [5:15:19<2:07:46,  3.50it/s]
 93%|█████████▎| 344629/371472 [5:15:19<2:05:18,  3.57it/s]
 93%|█████████▎| 344630/371472 [5:15:19<2:11:45,  3.40it/s]
 93%|█████████▎| 344631/371472 [5:15:20<2:07:20,  3.51it/s]
 93%|█████████▎| 344632/371472 [5:15:20<2:15:37,  3.30it/s]
 93%|█████████▎| 344633/371472 [5:15:20<2:08:41,  3.48it/s]
 93%|█████████▎| 344634/371472 [5:15:20<2:08:15,  3.49it/s]
 93%|█████████▎| 344635/371472 [5:15:21<2:08:19,  3.49it/s]
 93%|█████████▎| 344636/371472 [5:15:21<2:07:59,  3.49it/s]
 93%|█████████▎| 344637/371472 [5:15:21<2:04:52,  3.58it/s]
 93%|█████████▎| 344638/371472 [5:15:22<2:00:22,  3.72it/s]
 93%|█████████▎| 344639/371472 [5:15:22<2:00:44,  3.70it/s]
 93%|█████████▎| 344640/371472 [5:15:22<2:00:39,  3.71it/s]
                                                           
{'loss': 2.5489, 'learning_rate': 1.650434183024844e-07, 'epoch': 14.84}

 93%|█████████▎| 344640/371472 [5:15:22<2:00:39,  3.71it/s]
 93%|█████████▎| 344641/371472 [5:15:22<2:05:07,  3.57it/s]
 93%|█████████▎| 344642/371472 [5:15:23<2:06:40,  3.53it/s]
 93%|█████████▎| 344643/371472 [5:15:23<2:03:03,  3.63it/s]
 93%|█████████▎| 344644/371472 [5:15:23<2:04:05,  3.60it/s]
 93%|█████████▎| 344645/371472 [5:15:24<2:06:13,  3.54it/s]
 93%|█████████▎| 344646/371472 [5:15:24<2:04:12,  3.60it/s]
 93%|█████████▎| 344647/371472 [5:15:24<2:04:47,  3.58it/s]
 93%|█████████▎| 344648/371472 [5:15:24<2:00:12,  3.72it/s]
 93%|█████████▎| 344649/371472 [5:15:25<2:02:11,  3.66it/s]
 93%|█████████▎| 344650/371472 [5:15:25<2:03:31,  3.62it/s]
 93%|█████████▎| 344651/371472 [5:15:25<2:09:52,  3.44it/s]
 93%|█████████▎| 344652/371472 [5:15:26<2:18:01,  3.24it/s]
 93%|█████████▎| 344653/371472 [5:15:26<2:13:05,  3.36it/s]
 93%|█████████▎| 344654/371472 [5:15:26<2:12:30,  3.37it/s]
 93%|█████████▎| 344655/371472 [5:15:26<2:06:58,  3.52it/s]
 93%|█████████▎| 344656/371472 [5:15:27<2:14:14,  3.33it/s]
 93%|█████████▎| 344657/371472 [5:15:27<2:15:24,  3.30it/s]
 93%|█████████▎| 344658/371472 [5:15:27<2:19:16,  3.21it/s]
 93%|█████████▎| 344659/371472 [5:15:28<2:16:07,  3.28it/s]
 93%|█████████▎| 344660/371472 [5:15:28<2:10:44,  3.42it/s]
                                                           
{'loss': 2.6928, 'learning_rate': 1.6499493632700552e-07, 'epoch': 14.85}

 93%|█████████▎| 344660/371472 [5:15:28<2:10:44,  3.42it/s]
 93%|█████████▎| 344661/371472 [5:15:28<2:12:37,  3.37it/s]
 93%|█████████▎| 344662/371472 [5:15:29<2:17:04,  3.26it/s]
 93%|█████████▎| 344663/371472 [5:15:29<2:14:36,  3.32it/s]
 93%|█████████▎| 344664/371472 [5:15:29<2:14:26,  3.32it/s]
 93%|█████████▎| 344665/371472 [5:15:29<2:06:55,  3.52it/s]
 93%|█████████▎| 344666/371472 [5:15:30<2:02:21,  3.65it/s]
 93%|█████████▎| 344667/371472 [5:15:30<2:08:23,  3.48it/s]
 93%|█████████▎| 344668/371472 [5:15:30<2:10:23,  3.43it/s]
 93%|█████████▎| 344669/371472 [5:15:31<2:06:01,  3.54it/s]
 93%|█████████▎| 344670/371472 [5:15:31<2:04:57,  3.57it/s]
 93%|█████████▎| 344671/371472 [5:15:31<2:05:01,  3.57it/s]
 93%|█████████▎| 344672/371472 [5:15:31<2:02:16,  3.65it/s]
 93%|█████████▎| 344673/371472 [5:15:32<2:02:46,  3.64it/s]
 93%|█████████▎| 344674/371472 [5:15:32<2:01:19,  3.68it/s]
 93%|█████████▎| 344675/371472 [5:15:32<2:03:37,  3.61it/s]
 93%|█████████▎| 344676/371472 [5:15:33<2:13:31,  3.34it/s]
 93%|█████████▎| 344677/371472 [5:15:33<2:06:51,  3.52it/s]
 93%|█████████▎| 344678/371472 [5:15:33<2:08:51,  3.47it/s]
 93%|█████████▎| 344679/371472 [5:15:33<2:08:04,  3.49it/s]
 93%|█████████▎| 344680/371472 [5:15:34<2:11:29,  3.40it/s]
                                                           
{'loss': 2.5303, 'learning_rate': 1.6494645435152662e-07, 'epoch': 14.85}

 93%|█████████▎| 344680/371472 [5:15:34<2:11:29,  3.40it/s]
 93%|█████████▎| 344681/371472 [5:15:34<2:18:49,  3.22it/s]
 93%|█████████▎| 344682/371472 [5:15:34<2:17:56,  3.24it/s]
 93%|█████████▎| 344683/371472 [5:15:35<2:13:45,  3.34it/s]
 93%|█████████▎| 344684/371472 [5:15:35<2:13:21,  3.35it/s]
 93%|█████████▎| 344685/371472 [5:15:35<2:06:47,  3.52it/s]
 93%|█████████▎| 344686/371472 [5:15:35<2:02:37,  3.64it/s]
 93%|█████████▎| 344687/371472 [5:15:36<1:57:56,  3.78it/s]
 93%|█████████▎| 344688/371472 [5:15:36<1:58:01,  3.78it/s]
 93%|█████████▎| 344689/371472 [5:15:36<2:02:56,  3.63it/s]
 93%|█████████▎| 344690/371472 [5:15:36<1:59:53,  3.72it/s]
 93%|█████████▎| 344691/371472 [5:15:37<2:00:09,  3.71it/s]
 93%|█████████▎| 344692/371472 [5:15:37<2:08:36,  3.47it/s]
 93%|█████████▎| 344693/371472 [5:15:37<2:08:34,  3.47it/s]
 93%|█████████▎| 344694/371472 [5:15:38<2:07:11,  3.51it/s]
 93%|█████████▎| 344695/371472 [5:15:38<2:04:02,  3.60it/s]
 93%|█████████▎| 344696/371472 [5:15:38<2:07:04,  3.51it/s]
 93%|█████████▎| 344697/371472 [5:15:39<2:14:26,  3.32it/s]
 93%|█████████▎| 344698/371472 [5:15:39<2:24:41,  3.08it/s]
 93%|█████████▎| 344699/371472 [5:15:39<2:14:05,  3.33it/s]
 93%|█████████▎| 344700/371472 [5:15:39<2:14:15,  3.32it/s]
                                                           
{'loss': 2.6019, 'learning_rate': 1.6489797237604777e-07, 'epoch': 14.85}

 93%|█████████▎| 344700/371472 [5:15:39<2:14:15,  3.32it/s]
 93%|█████████▎| 344701/371472 [5:15:40<2:09:26,  3.45it/s]
 93%|█████████▎| 344702/371472 [5:15:40<2:05:45,  3.55it/s]
 93%|█████████▎| 344703/371472 [5:15:40<2:01:52,  3.66it/s]
 93%|█████████▎| 344704/371472 [5:15:41<2:16:17,  3.27it/s]
 93%|█████████▎| 344705/371472 [5:15:41<2:14:02,  3.33it/s]
 93%|█████████▎| 344706/371472 [5:15:41<2:04:59,  3.57it/s]
 93%|█████████▎| 344707/371472 [5:15:41<2:07:56,  3.49it/s]
 93%|█████████▎| 344708/371472 [5:15:42<2:11:10,  3.40it/s]
 93%|█████████▎| 344709/371472 [5:15:42<2:06:19,  3.53it/s]
 93%|█████████▎| 344710/371472 [5:15:42<2:09:12,  3.45it/s]
 93%|█████████▎| 344711/371472 [5:15:43<2:06:37,  3.52it/s]
 93%|█████████▎| 344712/371472 [5:15:43<2:09:42,  3.44it/s]
 93%|█████████▎| 344713/371472 [5:15:43<2:04:44,  3.58it/s]
 93%|█████████▎| 344714/371472 [5:15:43<2:03:10,  3.62it/s]
 93%|█████████▎| 344715/371472 [5:15:44<2:00:10,  3.71it/s]
 93%|█████████▎| 344716/371472 [5:15:44<2:04:12,  3.59it/s]
 93%|█████████▎| 344717/371472 [5:15:44<2:05:40,  3.55it/s]
 93%|█████████▎| 344718/371472 [5:15:44<2:00:22,  3.70it/s]
 93%|█████████▎| 344719/371472 [5:15:45<2:06:35,  3.52it/s]
 93%|█████████▎| 344720/371472 [5:15:45<2:02:32,  3.64it/s]
                                                           
{'loss': 2.6274, 'learning_rate': 1.6484949040056882e-07, 'epoch': 14.85}

 93%|█████████▎| 344720/371472 [5:15:45<2:02:32,  3.64it/s]
 93%|█████████▎| 344721/371472 [5:15:45<2:02:04,  3.65it/s]
 93%|█████████▎| 344722/371472 [5:15:46<2:00:02,  3.71it/s]
 93%|█████████▎| 344723/371472 [5:15:46<2:01:18,  3.68it/s]
 93%|█████████▎| 344724/371472 [5:15:46<2:02:07,  3.65it/s]
 93%|█████████▎| 344725/371472 [5:15:46<1:58:05,  3.77it/s]
 93%|█████████▎| 344726/371472 [5:15:47<2:03:00,  3.62it/s]
 93%|█████████▎| 344727/371472 [5:15:47<2:04:03,  3.59it/s]
 93%|█████████▎| 344728/371472 [5:15:47<2:09:47,  3.43it/s]
 93%|█████████▎| 344729/371472 [5:15:48<2:06:13,  3.53it/s]
 93%|█████████▎| 344730/371472 [5:15:48<2:00:55,  3.69it/s]
 93%|█████████▎| 344731/371472 [5:15:48<1:57:20,  3.80it/s]
 93%|█████████▎| 344732/371472 [5:15:48<1:56:24,  3.83it/s]
 93%|█████████▎| 344733/371472 [5:15:49<1:57:15,  3.80it/s]
 93%|█████████▎| 344734/371472 [5:15:49<2:17:33,  3.24it/s]
 93%|█████████▎| 344735/371472 [5:15:49<2:12:27,  3.36it/s]
 93%|█████████▎| 344736/371472 [5:15:50<2:14:09,  3.32it/s]
 93%|█████████▎| 344737/371472 [5:15:50<2:09:18,  3.45it/s]
 93%|█████████▎| 344738/371472 [5:15:50<2:04:33,  3.58it/s]
 93%|█████████▎| 344739/371472 [5:15:50<2:08:18,  3.47it/s]
 93%|█████████▎| 344740/371472 [5:15:51<2:07:49,  3.49it/s]
                                                           
{'loss': 2.6353, 'learning_rate': 1.6480100842509e-07, 'epoch': 14.85}

 93%|█████████▎| 344740/371472 [5:15:51<2:07:49,  3.49it/s]
 93%|█████████▎| 344741/371472 [5:15:51<2:05:11,  3.56it/s]
 93%|█████████▎| 344742/371472 [5:15:51<2:08:08,  3.48it/s]
 93%|█████████▎| 344743/371472 [5:15:52<2:03:12,  3.62it/s]
 93%|█████████▎| 344744/371472 [5:15:52<2:06:32,  3.52it/s]
 93%|█████████▎| 344745/371472 [5:15:52<2:04:07,  3.59it/s]
 93%|█████████▎| 344746/371472 [5:15:52<2:02:40,  3.63it/s]
 93%|█████████▎| 344747/371472 [5:15:53<1:57:56,  3.78it/s]
 93%|█████████▎| 344748/371472 [5:15:53<1:57:24,  3.79it/s]
 93%|█████████▎| 344749/371472 [5:15:53<1:56:56,  3.81it/s]
 93%|█████████▎| 344750/371472 [5:15:53<2:01:46,  3.66it/s]
 93%|█████████▎| 344751/371472 [5:15:54<2:05:45,  3.54it/s]
 93%|█████████▎| 344752/371472 [5:15:54<2:04:37,  3.57it/s]
 93%|█████████▎| 344753/371472 [5:15:54<2:01:27,  3.67it/s]
 93%|█████████▎| 344754/371472 [5:15:54<1:58:53,  3.75it/s]
 93%|█████████▎| 344755/371472 [5:15:55<2:02:27,  3.64it/s]
 93%|█████████▎| 344756/371472 [5:15:55<2:08:50,  3.46it/s]
 93%|█████████▎| 344757/371472 [5:15:55<2:03:14,  3.61it/s]
 93%|█████████▎| 344758/371472 [5:15:56<2:08:42,  3.46it/s]
 93%|█████████▎| 344759/371472 [5:15:56<2:02:45,  3.63it/s]
 93%|█████████▎| 344760/371472 [5:15:56<2:02:43,  3.63it/s]
                                                           
{'loss': 2.7827, 'learning_rate': 1.6475252644961104e-07, 'epoch': 14.85}

 93%|█████████▎| 344760/371472 [5:15:56<2:02:43,  3.63it/s]
 93%|█████████▎| 344761/371472 [5:15:56<2:00:21,  3.70it/s]
 93%|█████████▎| 344762/371472 [5:15:57<1:56:20,  3.83it/s]
 93%|█████████▎| 344763/371472 [5:15:57<1:53:54,  3.91it/s]
 93%|█████████▎| 344764/371472 [5:15:57<2:03:44,  3.60it/s]
 93%|█████████▎| 344765/371472 [5:15:58<2:06:33,  3.52it/s]
 93%|█████████▎| 344766/371472 [5:15:58<2:02:42,  3.63it/s]
 93%|█████████▎| 344767/371472 [5:15:58<2:06:02,  3.53it/s]
 93%|█████████▎| 344768/371472 [5:15:58<2:03:54,  3.59it/s]
 93%|█████████▎| 344769/371472 [5:15:59<2:04:41,  3.57it/s]
 93%|█████████▎| 344770/371472 [5:15:59<2:01:49,  3.65it/s]
 93%|█████████▎| 344771/371472 [5:15:59<2:01:41,  3.66it/s]
 93%|█████████▎| 344772/371472 [5:15:59<2:00:46,  3.68it/s]
 93%|█████████▎| 344773/371472 [5:16:00<2:02:36,  3.63it/s]
 93%|█████████▎| 344774/371472 [5:16:00<2:04:24,  3.58it/s]
 93%|█████████▎| 344775/371472 [5:16:00<2:01:58,  3.65it/s]
 93%|█████████▎| 344776/371472 [5:16:01<2:06:23,  3.52it/s]
 93%|█████████▎| 344777/371472 [5:16:01<2:07:10,  3.50it/s]
 93%|█████████▎| 344778/371472 [5:16:01<2:01:22,  3.67it/s]
 93%|█████████▎| 344779/371472 [5:16:01<2:01:32,  3.66it/s]
 93%|█████████▎| 344780/371472 [5:16:02<2:02:34,  3.63it/s]
                                                           
{'loss': 2.6469, 'learning_rate': 1.647040444741322e-07, 'epoch': 14.85}

 93%|█████████▎| 344780/371472 [5:16:02<2:02:34,  3.63it/s]
 93%|█████████▎| 344781/371472 [5:16:02<1:59:26,  3.72it/s]
 93%|█████████▎| 344782/371472 [5:16:02<2:02:27,  3.63it/s]
 93%|█████████▎| 344783/371472 [5:16:03<2:02:05,  3.64it/s]
 93%|█████████▎| 344784/371472 [5:16:03<2:03:54,  3.59it/s]
 93%|█████████▎| 344785/371472 [5:16:03<2:03:51,  3.59it/s]
 93%|█████████▎| 344786/371472 [5:16:03<1:59:49,  3.71it/s]
 93%|█████████▎| 344787/371472 [5:16:04<1:58:25,  3.76it/s]
 93%|█████████▎| 344788/371472 [5:16:04<1:58:10,  3.76it/s]
 93%|█████████▎| 344789/371472 [5:16:04<2:23:32,  3.10it/s]
 93%|█████████▎| 344790/371472 [5:16:05<2:16:01,  3.27it/s]
 93%|█████████▎| 344791/371472 [5:16:05<2:10:48,  3.40it/s]
 93%|█████████▎| 344792/371472 [5:16:05<2:07:34,  3.49it/s]
 93%|█████████▎| 344793/371472 [5:16:05<2:07:57,  3.47it/s]
 93%|█████████▎| 344794/371472 [5:16:06<2:07:51,  3.48it/s]
 93%|█████████▎| 344795/371472 [5:16:06<2:10:36,  3.40it/s]
 93%|█████████▎| 344796/371472 [5:16:06<2:12:22,  3.36it/s]
 93%|█████████▎| 344797/371472 [5:16:07<2:15:50,  3.27it/s]
 93%|█████████▎| 344798/371472 [5:16:07<2:13:04,  3.34it/s]
 93%|█████████▎| 344799/371472 [5:16:07<2:08:08,  3.47it/s]
 93%|█████████▎| 344800/371472 [5:16:07<2:01:57,  3.65it/s]
                                                           
{'loss': 2.5557, 'learning_rate': 1.6465556249865326e-07, 'epoch': 14.85}

 93%|█████████▎| 344800/371472 [5:16:07<2:01:57,  3.65it/s]
 93%|█████████▎| 344801/371472 [5:16:08<1:59:39,  3.72it/s]
 93%|█████████▎| 344802/371472 [5:16:08<1:58:06,  3.76it/s]
 93%|█████████▎| 344803/371472 [5:16:08<1:57:51,  3.77it/s]
 93%|█████████▎| 344804/371472 [5:16:09<2:06:25,  3.52it/s]
 93%|█████████▎| 344805/371472 [5:16:09<2:02:42,  3.62it/s]
 93%|█████████▎| 344806/371472 [5:16:09<2:00:19,  3.69it/s]
 93%|█████████▎| 344807/371472 [5:16:09<1:59:15,  3.73it/s]
 93%|█████████▎| 344808/371472 [5:16:10<1:56:48,  3.80it/s]
 93%|█████████▎| 344809/371472 [5:16:10<1:58:59,  3.73it/s]
 93%|█████████▎| 344810/371472 [5:16:10<2:00:33,  3.69it/s]
 93%|█████████▎| 344811/371472 [5:16:10<1:59:57,  3.70it/s]
 93%|█████████▎| 344812/371472 [5:16:11<1:56:55,  3.80it/s]
 93%|█████████▎| 344813/371472 [5:16:11<1:56:45,  3.81it/s]
 93%|█████████▎| 344814/371472 [5:16:11<2:08:10,  3.47it/s]
 93%|█████████▎| 344815/371472 [5:16:12<2:11:48,  3.37it/s]
 93%|█████████▎| 344816/371472 [5:16:12<2:07:25,  3.49it/s]
 93%|█████████▎| 344817/371472 [5:16:12<2:03:06,  3.61it/s]
 93%|█████████▎| 344818/371472 [5:16:12<2:03:39,  3.59it/s]
 93%|█████████▎| 344819/371472 [5:16:13<2:03:24,  3.60it/s]
 93%|█████████▎| 344820/371472 [5:16:13<2:02:23,  3.63it/s]
                                                           
{'loss': 2.7461, 'learning_rate': 1.646070805231744e-07, 'epoch': 14.85}

 93%|█████████▎| 344820/371472 [5:16:13<2:02:23,  3.63it/s]
 93%|█████████▎| 344821/371472 [5:16:13<2:01:42,  3.65it/s]
 93%|█████████▎| 344822/371472 [5:16:13<2:01:07,  3.67it/s]
 93%|█████████▎| 344823/371472 [5:16:14<2:03:39,  3.59it/s]
 93%|█████████▎| 344824/371472 [5:16:14<2:03:40,  3.59it/s]
 93%|█████████▎| 344825/371472 [5:16:14<2:04:58,  3.55it/s]
 93%|█████████▎| 344826/371472 [5:16:15<2:06:50,  3.50it/s]
 93%|█████████▎| 344827/371472 [5:16:15<2:03:19,  3.60it/s]
 93%|█████████▎| 344828/371472 [5:16:15<2:05:30,  3.54it/s]
 93%|█████████▎| 344829/371472 [5:16:15<2:10:11,  3.41it/s]
 93%|█████████▎| 344830/371472 [5:16:16<2:13:12,  3.33it/s]
 93%|█████████▎| 344831/371472 [5:16:16<2:08:34,  3.45it/s]
 93%|█████████▎| 344832/371472 [5:16:16<2:07:10,  3.49it/s]
 93%|█████████▎| 344833/371472 [5:16:17<2:06:08,  3.52it/s]
 93%|█████████▎| 344834/371472 [5:16:17<2:06:44,  3.50it/s]
 93%|█████████▎| 344835/371472 [5:16:17<2:07:55,  3.47it/s]
 93%|█████████▎| 344836/371472 [5:16:17<2:08:12,  3.46it/s]
 93%|█████████▎| 344837/371472 [5:16:18<2:03:27,  3.60it/s]
 93%|█████████▎| 344838/371472 [5:16:18<2:02:48,  3.61it/s]
 93%|█████████▎| 344839/371472 [5:16:18<2:08:54,  3.44it/s]
 93%|█████████▎| 344840/371472 [5:16:19<2:03:22,  3.60it/s]
                                                           
{'loss': 2.5251, 'learning_rate': 1.6455859854769546e-07, 'epoch': 14.85}

 93%|█████████▎| 344840/371472 [5:16:19<2:03:22,  3.60it/s]
 93%|█████████▎| 344841/371472 [5:16:19<2:00:52,  3.67it/s]
 93%|█████████▎| 344842/371472 [5:16:19<1:58:14,  3.75it/s]
 93%|█████████▎| 344843/371472 [5:16:20<2:21:30,  3.14it/s]
 93%|█████████▎| 344844/371472 [5:16:20<2:14:43,  3.29it/s]
 93%|█████████▎| 344845/371472 [5:16:20<2:12:35,  3.35it/s]
 93%|█████████▎| 344846/371472 [5:16:20<2:07:05,  3.49it/s]
 93%|█████████▎| 344847/371472 [5:16:21<2:04:32,  3.56it/s]
 93%|█████████▎| 344848/371472 [5:16:21<2:31:27,  2.93it/s]
 93%|█████████▎| 344849/371472 [5:16:21<2:20:50,  3.15it/s]
 93%|█████████▎| 344850/371472 [5:16:22<2:10:26,  3.40it/s]
 93%|█████████▎| 344851/371472 [5:16:22<2:25:13,  3.06it/s]
 93%|█████████▎| 344852/371472 [5:16:22<2:18:26,  3.20it/s]
 93%|█████████▎| 344853/371472 [5:16:23<2:14:01,  3.31it/s]
 93%|█████████▎| 344854/371472 [5:16:23<2:12:07,  3.36it/s]
 93%|█████████▎| 344855/371472 [5:16:23<2:08:03,  3.46it/s]
 93%|█████████▎| 344856/371472 [5:16:23<2:04:40,  3.56it/s]
 93%|█████████▎| 344857/371472 [5:16:24<2:10:10,  3.41it/s]
 93%|█████████▎| 344858/371472 [5:16:24<2:08:19,  3.46it/s]
 93%|█████████▎| 344859/371472 [5:16:24<2:07:27,  3.48it/s]
 93%|█████████▎| 344860/371472 [5:16:25<2:06:25,  3.51it/s]
                                                           
{'loss': 2.6465, 'learning_rate': 1.6451011657221663e-07, 'epoch': 14.85}

 93%|█████████▎| 344860/371472 [5:16:25<2:06:25,  3.51it/s]
 93%|█████████▎| 344861/371472 [5:16:25<2:04:22,  3.57it/s]
 93%|█████████▎| 344862/371472 [5:16:25<2:03:50,  3.58it/s]
 93%|█████████▎| 344863/371472 [5:16:25<2:01:16,  3.66it/s]
 93%|█████████▎| 344864/371472 [5:16:26<1:59:43,  3.70it/s]
 93%|█████████▎| 344865/371472 [5:16:26<2:00:15,  3.69it/s]
 93%|█████████▎| 344866/371472 [5:16:26<2:00:36,  3.68it/s]
 93%|█████████▎| 344867/371472 [5:16:26<2:00:53,  3.67it/s]
 93%|█████████▎| 344868/371472 [5:16:27<2:06:40,  3.50it/s]
 93%|█████████▎| 344869/371472 [5:16:27<2:03:58,  3.58it/s]
 93%|█████████▎| 344870/371472 [5:16:27<2:10:04,  3.41it/s]
 93%|█████████▎| 344871/371472 [5:16:28<2:04:23,  3.56it/s]
 93%|█████████▎| 344872/371472 [5:16:28<2:03:30,  3.59it/s]
 93%|█████████▎| 344873/371472 [5:16:28<2:02:44,  3.61it/s]
 93%|█████████▎| 344874/371472 [5:16:28<1:59:15,  3.72it/s]
 93%|█████████▎| 344875/371472 [5:16:29<1:59:37,  3.71it/s]
 93%|█████████▎| 344876/371472 [5:16:29<1:59:55,  3.70it/s]
 93%|█████████▎| 344877/371472 [5:16:29<1:57:03,  3.79it/s]
 93%|█████████▎| 344878/371472 [5:16:29<2:01:43,  3.64it/s]
 93%|█████████▎| 344879/371472 [5:16:30<2:00:49,  3.67it/s]
 93%|█████████▎| 344880/371472 [5:16:30<2:00:30,  3.68it/s]
                                                           
{'loss': 2.7498, 'learning_rate': 1.644616345967377e-07, 'epoch': 14.85}

 93%|█████████▎| 344880/371472 [5:16:30<2:00:30,  3.68it/s]
 93%|█████████▎| 344881/371472 [5:16:30<2:07:39,  3.47it/s]
 93%|█████████▎| 344882/371472 [5:16:31<2:03:17,  3.59it/s]
 93%|█████████▎| 344883/371472 [5:16:31<2:05:39,  3.53it/s]
 93%|█████████▎| 344884/371472 [5:16:31<2:03:06,  3.60it/s]
 93%|█████████▎| 344885/371472 [5:16:32<2:16:31,  3.25it/s]
 93%|█████████▎| 344886/371472 [5:16:32<2:07:47,  3.47it/s]
 93%|█████████▎| 344887/371472 [5:16:32<2:16:42,  3.24it/s]
 93%|█████████▎| 344888/371472 [5:16:32<2:09:49,  3.41it/s]
 93%|█████████▎| 344889/371472 [5:16:33<2:03:14,  3.60it/s]
 93%|█████████▎| 344890/371472 [5:16:33<2:07:11,  3.48it/s]
 93%|█████████▎| 344891/371472 [5:16:33<2:07:39,  3.47it/s]
 93%|█████████▎| 344892/371472 [5:16:34<2:07:03,  3.49it/s]
 93%|█████████▎| 344893/371472 [5:16:34<2:09:54,  3.41it/s]
 93%|█████████▎| 344894/371472 [5:16:34<2:10:14,  3.40it/s]
 93%|█████████▎| 344895/371472 [5:16:34<2:08:56,  3.44it/s]
 93%|█████████▎| 344896/371472 [5:16:35<2:08:45,  3.44it/s]
 93%|█████████▎| 344897/371472 [5:16:35<2:14:57,  3.28it/s]
 93%|█████████▎| 344898/371472 [5:16:35<2:09:08,  3.43it/s]
 93%|█████████▎| 344899/371472 [5:16:36<2:02:47,  3.61it/s]
 93%|█████████▎| 344900/371472 [5:16:36<2:06:29,  3.50it/s]
                                                           
{'loss': 2.6287, 'learning_rate': 1.6441315262125883e-07, 'epoch': 14.86}

 93%|█████████▎| 344900/371472 [5:16:36<2:06:29,  3.50it/s]
 93%|█████████▎| 344901/371472 [5:16:36<2:12:17,  3.35it/s]
 93%|█████████▎| 344902/371472 [5:16:36<2:11:38,  3.36it/s]
 93%|█████████▎| 344903/371472 [5:16:37<2:13:39,  3.31it/s]
 93%|█████████▎| 344904/371472 [5:16:37<2:09:17,  3.42it/s]
 93%|█████████▎| 344905/371472 [5:16:37<2:12:44,  3.34it/s]
 93%|█████████▎| 344906/371472 [5:16:38<2:08:53,  3.44it/s]
 93%|█████████▎| 344907/371472 [5:16:38<2:08:30,  3.45it/s]
 93%|█████████▎| 344908/371472 [5:16:38<2:06:42,  3.49it/s]
 93%|█████████▎| 344909/371472 [5:16:38<2:09:38,  3.41it/s]
 93%|█████████▎| 344910/371472 [5:16:39<2:09:30,  3.42it/s]
 93%|█████████▎| 344911/371472 [5:16:39<2:01:47,  3.63it/s]
 93%|█████████▎| 344912/371472 [5:16:39<2:04:16,  3.56it/s]
 93%|█████████▎| 344913/371472 [5:16:40<2:03:00,  3.60it/s]
 93%|█████████▎| 344914/371472 [5:16:40<2:04:13,  3.56it/s]
 93%|█████████▎| 344915/371472 [5:16:40<1:59:51,  3.69it/s]
 93%|█████████▎| 344916/371472 [5:16:40<1:58:49,  3.72it/s]
 93%|█████████▎| 344917/371472 [5:16:41<1:58:21,  3.74it/s]
 93%|█████████▎| 344918/371472 [5:16:41<2:07:01,  3.48it/s]
 93%|█████████▎| 344919/371472 [5:16:41<2:04:16,  3.56it/s]
 93%|█████████▎| 344920/371472 [5:16:42<2:01:41,  3.64it/s]
                                                           
{'loss': 2.6287, 'learning_rate': 1.643646706457799e-07, 'epoch': 14.86}

 93%|█████████▎| 344920/371472 [5:16:42<2:01:41,  3.64it/s]
 93%|█████████▎| 344921/371472 [5:16:42<2:00:00,  3.69it/s]
 93%|█████████▎| 344922/371472 [5:16:42<2:12:54,  3.33it/s]
 93%|█████████▎| 344923/371472 [5:16:42<2:12:57,  3.33it/s]
 93%|█████████▎| 344924/371472 [5:16:43<2:12:13,  3.35it/s]
 93%|█████████▎| 344925/371472 [5:16:43<2:07:02,  3.48it/s]
 93%|█████████▎| 344926/371472 [5:16:43<2:13:15,  3.32it/s]
 93%|█████████▎| 344927/371472 [5:16:44<2:07:50,  3.46it/s]
 93%|█████████▎| 344928/371472 [5:16:44<2:09:32,  3.41it/s]
 93%|█████████▎| 344929/371472 [5:16:44<2:09:00,  3.43it/s]
 93%|█████████▎| 344930/371472 [5:16:45<2:15:30,  3.26it/s]
 93%|█████████▎| 344931/371472 [5:16:45<2:09:43,  3.41it/s]
 93%|█████████▎| 344932/371472 [5:16:45<2:10:57,  3.38it/s]
 93%|█████████▎| 344933/371472 [5:16:45<2:19:10,  3.18it/s]
 93%|█████████▎| 344934/371472 [5:16:46<2:27:16,  3.00it/s]
 93%|█████████▎| 344935/371472 [5:16:46<2:18:29,  3.19it/s]
 93%|█████████▎| 344936/371472 [5:16:46<2:19:40,  3.17it/s]
 93%|█████████▎| 344937/371472 [5:16:47<2:19:47,  3.16it/s]
 93%|█████████▎| 344938/371472 [5:16:47<2:16:11,  3.25it/s]
 93%|█████████▎| 344939/371472 [5:16:47<2:09:52,  3.40it/s]
 93%|█████████▎| 344940/371472 [5:16:48<2:10:25,  3.39it/s]
                                                           
{'loss': 2.5876, 'learning_rate': 1.6431618867030108e-07, 'epoch': 14.86}

 93%|█████████▎| 344940/371472 [5:16:48<2:10:25,  3.39it/s]
 93%|█████████▎| 344941/371472 [5:16:48<2:09:33,  3.41it/s]
 93%|█████████▎| 344942/371472 [5:16:48<2:03:57,  3.57it/s]
 93%|█████████▎| 344943/371472 [5:16:49<2:18:06,  3.20it/s]
 93%|█████████▎| 344944/371472 [5:16:49<2:13:16,  3.32it/s]
 93%|█████████▎| 344945/371472 [5:16:49<2:12:28,  3.34it/s]
 93%|█████████▎| 344946/371472 [5:16:49<2:10:59,  3.38it/s]
 93%|█████████▎| 344947/371472 [5:16:50<2:10:32,  3.39it/s]
 93%|█████████▎| 344948/371472 [5:16:50<2:13:31,  3.31it/s]
 93%|█████████▎| 344949/371472 [5:16:50<2:11:43,  3.36it/s]
 93%|█████████▎| 344950/371472 [5:16:51<2:08:22,  3.44it/s]
 93%|█████████▎| 344951/371472 [5:16:51<2:16:29,  3.24it/s]
 93%|█████████▎| 344952/371472 [5:16:51<2:12:28,  3.34it/s]
 93%|█████████▎| 344953/371472 [5:16:51<2:11:19,  3.37it/s]
 93%|█████████▎| 344954/371472 [5:16:52<2:15:27,  3.26it/s]
 93%|█████████▎| 344955/371472 [5:16:52<2:15:09,  3.27it/s]
 93%|█████████▎| 344956/371472 [5:16:52<2:08:15,  3.45it/s]
 93%|█████████▎| 344957/371472 [5:16:53<2:02:09,  3.62it/s]
 93%|█████████▎| 344958/371472 [5:16:53<1:58:41,  3.72it/s]
 93%|█████████▎| 344959/371472 [5:16:53<2:01:03,  3.65it/s]
 93%|█████████▎| 344960/371472 [5:16:53<2:08:19,  3.44it/s]
                                                           
{'loss': 2.5708, 'learning_rate': 1.642677066948221e-07, 'epoch': 14.86}

 93%|█████████▎| 344960/371472 [5:16:53<2:08:19,  3.44it/s]
 93%|█████████▎| 344961/371472 [5:16:54<2:14:39,  3.28it/s]
 93%|█████████▎| 344962/371472 [5:16:54<2:06:36,  3.49it/s]
 93%|█████████▎| 344963/371472 [5:16:54<2:03:33,  3.58it/s]
 93%|█████████▎| 344964/371472 [5:16:55<2:03:24,  3.58it/s]
 93%|█████████▎| 344965/371472 [5:16:55<2:01:57,  3.62it/s]
 93%|█████████▎| 344966/371472 [5:16:55<1:59:50,  3.69it/s]
 93%|█████████▎| 344967/371472 [5:16:55<1:57:28,  3.76it/s]
 93%|█████████▎| 344968/371472 [5:16:56<2:09:52,  3.40it/s]
 93%|█████████▎| 344969/371472 [5:16:56<2:09:29,  3.41it/s]
 93%|█████████▎| 344970/371472 [5:16:56<2:10:00,  3.40it/s]
 93%|█████████▎| 344971/371472 [5:16:57<2:04:53,  3.54it/s]
 93%|█████████▎| 344972/371472 [5:16:57<2:06:16,  3.50it/s]
 93%|█████████▎| 344973/371472 [5:16:57<2:07:30,  3.46it/s]
 93%|█████████▎| 344974/371472 [5:16:57<2:09:29,  3.41it/s]
 93%|█████████▎| 344975/371472 [5:16:58<2:13:13,  3.31it/s]
 93%|█████████▎| 344976/371472 [5:16:58<2:08:09,  3.45it/s]
 93%|█████████▎| 344977/371472 [5:16:58<2:01:55,  3.62it/s]
 93%|█████████▎| 344978/371472 [5:16:59<2:01:11,  3.64it/s]
 93%|█████████▎| 344979/371472 [5:16:59<2:01:48,  3.62it/s]
 93%|█████████▎| 344980/371472 [5:16:59<2:05:41,  3.51it/s]
                                                           
{'loss': 2.6257, 'learning_rate': 1.6421922471934317e-07, 'epoch': 14.86}

 93%|█████████▎| 344980/371472 [5:16:59<2:05:41,  3.51it/s]
 93%|█████████▎| 344981/371472 [5:16:59<2:00:19,  3.67it/s]
 93%|█████████▎| 344982/371472 [5:17:00<1:57:55,  3.74it/s]
 93%|█████████▎| 344983/371472 [5:17:00<1:55:33,  3.82it/s]
 93%|█████████▎| 344984/371472 [5:17:00<1:55:14,  3.83it/s]
 93%|█████████▎| 344985/371472 [5:17:00<2:01:49,  3.62it/s]
 93%|█████████▎| 344986/371472 [5:17:01<1:59:08,  3.71it/s]
 93%|█████████▎| 344987/371472 [5:17:01<2:00:47,  3.65it/s]
 93%|█████████▎| 344988/371472 [5:17:01<2:04:04,  3.56it/s]
 93%|█████████▎| 344989/371472 [5:17:02<2:04:02,  3.56it/s]
 93%|█████████▎| 344990/371472 [5:17:02<2:04:27,  3.55it/s]
 93%|█████████▎| 344991/371472 [5:17:02<2:02:02,  3.62it/s]
 93%|█████████▎| 344992/371472 [5:17:02<2:00:39,  3.66it/s]
 93%|█████████▎| 344993/371472 [5:17:03<2:06:34,  3.49it/s]
 93%|█████████▎| 344994/371472 [5:17:03<2:05:24,  3.52it/s]
 93%|█████████▎| 344995/371472 [5:17:03<2:00:33,  3.66it/s]
 93%|█████████▎| 344996/371472 [5:17:03<1:58:16,  3.73it/s]
 93%|█████████▎| 344997/371472 [5:17:04<1:58:17,  3.73it/s]
 93%|█████████▎| 344998/371472 [5:17:04<2:00:15,  3.67it/s]
 93%|█████████▎| 344999/371472 [5:17:04<1:58:00,  3.74it/s]
 93%|█████████▎| 345000/371472 [5:17:05<2:05:11,  3.52it/s]
                                                           
{'loss': 2.6275, 'learning_rate': 1.6417074274386437e-07, 'epoch': 14.86}

 93%|█████████▎| 345000/371472 [5:17:05<2:05:11,  3.52it/s]
 93%|█████████▎| 345001/371472 [5:17:05<2:03:09,  3.58it/s]
 93%|█████████▎| 345002/371472 [5:17:05<2:00:50,  3.65it/s]
 93%|█████████▎| 345003/371472 [5:17:05<2:05:06,  3.53it/s]
 93%|█████████▎| 345004/371472 [5:17:06<2:07:23,  3.46it/s]
 93%|█████████▎| 345005/371472 [5:17:06<2:09:20,  3.41it/s]
 93%|█████████▎| 345006/371472 [5:17:06<2:07:37,  3.46it/s]
 93%|█████████▎| 345007/371472 [5:17:07<2:04:31,  3.54it/s]
 93%|█████████▎| 345008/371472 [5:17:07<2:01:27,  3.63it/s]
 93%|█████████▎| 345009/371472 [5:17:07<2:20:19,  3.14it/s]
 93%|█████████▎| 345010/371472 [5:17:08<2:13:26,  3.30it/s]
 93%|█████████▎| 345011/371472 [5:17:08<2:07:57,  3.45it/s]
 93%|█████████▎| 345012/371472 [5:17:08<2:18:31,  3.18it/s]
 93%|█████████▎| 345013/371472 [5:17:08<2:19:36,  3.16it/s]
 93%|█████████▎| 345014/371472 [5:17:09<2:12:29,  3.33it/s]
 93%|█████████▎| 345015/371472 [5:17:09<2:24:27,  3.05it/s]
 93%|█████████▎| 345016/371472 [5:17:09<2:14:59,  3.27it/s]
 93%|█████████▎| 345017/371472 [5:17:10<2:12:50,  3.32it/s]
 93%|█████████▎| 345018/371472 [5:17:10<2:14:43,  3.27it/s]
 93%|█████████▎| 345019/371472 [5:17:10<2:09:14,  3.41it/s]
 93%|█████████▎| 345020/371472 [5:17:11<2:10:04,  3.39it/s]
                                                           
{'loss': 2.6077, 'learning_rate': 1.641222607683854e-07, 'epoch': 14.86}

 93%|█████████▎| 345020/371472 [5:17:11<2:10:04,  3.39it/s]
 93%|█████████▎| 345021/371472 [5:17:11<2:18:54,  3.17it/s]
 93%|█████████▎| 345022/371472 [5:17:11<2:12:12,  3.33it/s]
 93%|█████████▎| 345023/371472 [5:17:11<2:09:42,  3.40it/s]
 93%|█████████▎| 345024/371472 [5:17:12<2:04:27,  3.54it/s]
 93%|█████████▎| 345025/371472 [5:17:12<1:58:33,  3.72it/s]
 93%|█████████▎| 345026/371472 [5:17:12<1:56:18,  3.79it/s]
 93%|█████████▎| 345027/371472 [5:17:13<1:58:39,  3.71it/s]
 93%|█████████▎| 345028/371472 [5:17:13<1:57:35,  3.75it/s]
 93%|█████████▎| 345029/371472 [5:17:13<1:58:56,  3.71it/s]
 93%|█████████▎| 345030/371472 [5:17:13<2:03:54,  3.56it/s]
 93%|█████████▎| 345031/371472 [5:17:14<1:59:49,  3.68it/s]
 93%|█████████▎| 345032/371472 [5:17:14<2:07:07,  3.47it/s]
 93%|█████████▎| 345033/371472 [5:17:14<2:13:12,  3.31it/s]
 93%|█████████▎| 345034/371472 [5:17:15<2:06:54,  3.47it/s]
 93%|█████████▎| 345035/371472 [5:17:15<2:01:19,  3.63it/s]
 93%|█████████▎| 345036/371472 [5:17:15<1:59:25,  3.69it/s]
 93%|█████████▎| 345037/371472 [5:17:15<1:59:12,  3.70it/s]
 93%|█████████▎| 345038/371472 [5:17:16<1:59:21,  3.69it/s]
 93%|█████████▎| 345039/371472 [5:17:16<2:03:04,  3.58it/s]
 93%|█████████▎| 345040/371472 [5:17:16<2:04:58,  3.53it/s]
                                                           
{'loss': 2.4898, 'learning_rate': 1.6407377879290654e-07, 'epoch': 14.86}

 93%|█████████▎| 345040/371472 [5:17:16<2:04:58,  3.53it/s]
 93%|█████████▎| 345041/371472 [5:17:16<2:02:34,  3.59it/s]
 93%|█████████▎| 345042/371472 [5:17:17<2:01:57,  3.61it/s]
 93%|█████████▎| 345043/371472 [5:17:17<2:02:56,  3.58it/s]
 93%|█████████▎| 345044/371472 [5:17:17<2:00:42,  3.65it/s]
 93%|█████████▎| 345045/371472 [5:17:18<2:00:54,  3.64it/s]
 93%|█████████▎| 345046/371472 [5:17:18<1:58:24,  3.72it/s]
 93%|█████████▎| 345047/371472 [5:17:18<1:58:07,  3.73it/s]
 93%|█████████▎| 345048/371472 [5:17:18<1:59:52,  3.67it/s]
 93%|█████████▎| 345049/371472 [5:17:19<2:03:33,  3.56it/s]
 93%|█████████▎| 345050/371472 [5:17:19<2:00:59,  3.64it/s]
 93%|█████████▎| 345051/371472 [5:17:19<2:05:13,  3.52it/s]
 93%|█████████▎| 345052/371472 [5:17:19<2:06:36,  3.48it/s]
 93%|█████████▎| 345053/371472 [5:17:20<2:07:48,  3.45it/s]
 93%|█████████▎| 345054/371472 [5:17:20<2:10:13,  3.38it/s]
 93%|█████████▎| 345055/371472 [5:17:20<2:09:41,  3.40it/s]
 93%|█████████▎| 345056/371472 [5:17:21<2:08:13,  3.43it/s]
 93%|█████████▎| 345057/371472 [5:17:21<2:04:32,  3.54it/s]
 93%|█████████▎| 345058/371472 [5:17:21<2:07:11,  3.46it/s]
 93%|█████████▎| 345059/371472 [5:17:21<2:02:27,  3.59it/s]
 93%|█████████▎| 345060/371472 [5:17:22<2:04:19,  3.54it/s]
                                                           
{'loss': 2.525, 'learning_rate': 1.6402529681742761e-07, 'epoch': 14.86}

 93%|█████████▎| 345060/371472 [5:17:22<2:04:19,  3.54it/s]
 93%|█████████▎| 345061/371472 [5:17:22<2:03:36,  3.56it/s]
 93%|█████████▎| 345062/371472 [5:17:22<2:05:04,  3.52it/s]
 93%|█████████▎| 345063/371472 [5:17:23<2:01:48,  3.61it/s]
 93%|█████████▎| 345064/371472 [5:17:23<2:03:20,  3.57it/s]
 93%|█████████▎| 345065/371472 [5:17:23<2:07:38,  3.45it/s]
 93%|█████████▎| 345066/371472 [5:17:24<2:21:23,  3.11it/s]
 93%|█████████▎| 345067/371472 [5:17:24<2:14:11,  3.28it/s]
 93%|█████████▎| 345068/371472 [5:17:24<2:09:00,  3.41it/s]
 93%|█████████▎| 345069/371472 [5:17:24<2:07:46,  3.44it/s]
 93%|█████████▎| 345070/371472 [5:17:25<2:07:53,  3.44it/s]
 93%|█████████▎| 345071/371472 [5:17:25<2:02:27,  3.59it/s]
 93%|█████████▎| 345072/371472 [5:17:25<1:58:46,  3.70it/s]
 93%|█████████▎| 345073/371472 [5:17:26<2:15:06,  3.26it/s]
 93%|█████████▎| 345074/371472 [5:17:26<2:16:09,  3.23it/s]
 93%|█████████▎| 345075/371472 [5:17:26<2:15:55,  3.24it/s]
 93%|█████████▎| 345076/371472 [5:17:27<2:11:50,  3.34it/s]
 93%|█████████▎| 345077/371472 [5:17:27<2:08:48,  3.42it/s]
 93%|█████████▎| 345078/371472 [5:17:27<2:07:10,  3.46it/s]
 93%|█████████▎| 345079/371472 [5:17:27<2:06:24,  3.48it/s]
 93%|█████████▎| 345080/371472 [5:17:28<2:07:35,  3.45it/s]
                                                           
{'loss': 2.6247, 'learning_rate': 1.6397681484194876e-07, 'epoch': 14.86}

 93%|█████████▎| 345080/371472 [5:17:28<2:07:35,  3.45it/s]
 93%|█████████▎| 345081/371472 [5:17:28<2:04:56,  3.52it/s]
 93%|█████████▎| 345082/371472 [5:17:28<2:08:51,  3.41it/s]
 93%|█████████▎| 345083/371472 [5:17:29<2:09:13,  3.40it/s]
 93%|█████████▎| 345084/371472 [5:17:29<2:07:07,  3.46it/s]
 93%|█████████▎| 345085/371472 [5:17:29<2:05:42,  3.50it/s]
 93%|█████████▎| 345086/371472 [5:17:29<2:06:26,  3.48it/s]
 93%|█████████▎| 345087/371472 [5:17:30<2:08:16,  3.43it/s]
 93%|█████████▎| 345088/371472 [5:17:30<2:05:35,  3.50it/s]
 93%|█████████▎| 345089/371472 [5:17:30<2:03:36,  3.56it/s]
 93%|█████████▎| 345090/371472 [5:17:30<2:00:04,  3.66it/s]
 93%|█████████▎| 345091/371472 [5:17:31<1:58:54,  3.70it/s]
 93%|█████████▎| 345092/371472 [5:17:31<1:58:30,  3.71it/s]
 93%|█████████▎| 345093/371472 [5:17:31<1:56:32,  3.77it/s]
 93%|█████████▎| 345094/371472 [5:17:32<1:59:44,  3.67it/s]
 93%|█████████▎| 345095/371472 [5:17:32<1:59:07,  3.69it/s]
 93%|█████████▎| 345096/371472 [5:17:32<2:04:26,  3.53it/s]
 93%|█████████▎| 345097/371472 [5:17:32<2:03:36,  3.56it/s]
 93%|█████████▎| 345098/371472 [5:17:33<2:02:00,  3.60it/s]
 93%|█████████▎| 345099/371472 [5:17:33<2:00:57,  3.63it/s]
 93%|█████████▎| 345100/371472 [5:17:33<1:56:51,  3.76it/s]
                                                           
{'loss': 2.7243, 'learning_rate': 1.639283328664698e-07, 'epoch': 14.86}

 93%|█████████▎| 345100/371472 [5:17:33<1:56:51,  3.76it/s]
 93%|█████████▎| 345101/371472 [5:17:34<2:02:58,  3.57it/s]
 93%|█████████▎| 345102/371472 [5:17:34<2:08:19,  3.42it/s]
 93%|█████████▎| 345103/371472 [5:17:34<2:05:40,  3.50it/s]
 93%|█████████▎| 345104/371472 [5:17:34<2:11:02,  3.35it/s]
 93%|█████████▎| 345105/371472 [5:17:35<2:10:36,  3.36it/s]
 93%|█████████▎| 345106/371472 [5:17:35<2:06:39,  3.47it/s]
 93%|█████████▎| 345107/371472 [5:17:35<1:59:55,  3.66it/s]
 93%|█████████▎| 345108/371472 [5:17:35<2:00:03,  3.66it/s]
 93%|█████████▎| 345109/371472 [5:17:36<1:58:45,  3.70it/s]
 93%|█████████▎| 345110/371472 [5:17:36<2:05:07,  3.51it/s]
 93%|█████████▎| 345111/371472 [5:17:36<2:15:30,  3.24it/s]
 93%|█████████▎| 345112/371472 [5:17:37<2:08:33,  3.42it/s]
 93%|█████████▎| 345113/371472 [5:17:37<2:08:42,  3.41it/s]
 93%|█████████▎| 345114/371472 [5:17:37<2:14:13,  3.27it/s]
 93%|█████████▎| 345115/371472 [5:17:38<2:08:07,  3.43it/s]
 93%|█████████▎| 345116/371472 [5:17:38<2:16:37,  3.21it/s]
 93%|█████████▎| 345117/371472 [5:17:38<2:18:04,  3.18it/s]
 93%|█████████▎| 345118/371472 [5:17:39<2:17:40,  3.19it/s]
 93%|█████████▎| 345119/371472 [5:17:39<2:15:20,  3.25it/s]
 93%|█████████▎| 345120/371472 [5:17:39<2:11:22,  3.34it/s]
                                                           
{'loss': 2.6765, 'learning_rate': 1.63879850890991e-07, 'epoch': 14.86}

 93%|█████████▎| 345120/371472 [5:17:39<2:11:22,  3.34it/s]
 93%|█████████▎| 345121/371472 [5:17:39<2:14:34,  3.26it/s]
 93%|█████████▎| 345122/371472 [5:17:40<2:13:29,  3.29it/s]
 93%|█████████▎| 345123/371472 [5:17:40<2:06:21,  3.48it/s]
 93%|█████████▎| 345124/371472 [5:17:40<2:03:19,  3.56it/s]
 93%|█████████▎| 345125/371472 [5:17:41<2:13:37,  3.29it/s]
 93%|█████████▎| 345126/371472 [5:17:41<2:07:01,  3.46it/s]
 93%|█████████▎| 345127/371472 [5:17:41<2:09:58,  3.38it/s]
 93%|█████████▎| 345128/371472 [5:17:42<2:09:39,  3.39it/s]
 93%|█████████▎| 345129/371472 [5:17:42<2:09:01,  3.40it/s]
 93%|█████████▎| 345130/371472 [5:17:42<2:09:53,  3.38it/s]
 93%|█████████▎| 345131/371472 [5:17:42<2:07:28,  3.44it/s]
 93%|█████████▎| 345132/371472 [5:17:43<2:03:47,  3.55it/s]
 93%|█████████▎| 345133/371472 [5:17:43<1:58:01,  3.72it/s]
 93%|█████████▎| 345134/371472 [5:17:43<2:00:56,  3.63it/s]
 93%|█████████▎| 345135/371472 [5:17:43<2:01:20,  3.62it/s]
 93%|█████████▎| 345136/371472 [5:17:44<2:00:23,  3.65it/s]
 93%|█████████▎| 345137/371472 [5:17:44<2:11:17,  3.34it/s]
 93%|█████████▎| 345138/371472 [5:17:44<2:06:02,  3.48it/s]
 93%|█████████▎| 345139/371472 [5:17:45<2:02:02,  3.60it/s]
 93%|█████████▎| 345140/371472 [5:17:45<2:01:05,  3.62it/s]
                                                           
{'loss': 2.5928, 'learning_rate': 1.6383136891551203e-07, 'epoch': 14.87}

 93%|█████████▎| 345140/371472 [5:17:45<2:01:05,  3.62it/s]
 93%|█████████▎| 345141/371472 [5:17:45<1:59:02,  3.69it/s]
 93%|█████████▎| 345142/371472 [5:17:45<1:59:04,  3.69it/s]
 93%|█████████▎| 345143/371472 [5:17:46<2:05:33,  3.49it/s]
 93%|█████████▎| 345144/371472 [5:17:46<2:03:28,  3.55it/s]
 93%|█████████▎| 345145/371472 [5:17:46<2:03:58,  3.54it/s]
 93%|█████████▎| 345146/371472 [5:17:47<2:01:54,  3.60it/s]
 93%|█████████▎| 345147/371472 [5:17:47<2:02:22,  3.59it/s]
 93%|█████████▎| 345148/371472 [5:17:47<1:58:52,  3.69it/s]
 93%|█████████▎| 345149/371472 [5:17:47<1:59:15,  3.68it/s]
 93%|█████████▎| 345150/371472 [5:17:48<2:00:41,  3.63it/s]
 93%|█████████▎| 345151/371472 [5:17:48<1:58:48,  3.69it/s]
 93%|█████████▎| 345152/371472 [5:17:48<2:03:42,  3.55it/s]
 93%|█████████▎| 345153/371472 [5:17:48<2:05:31,  3.49it/s]
 93%|█████████▎| 345154/371472 [5:17:49<2:01:17,  3.62it/s]
 93%|█████████▎| 345155/371472 [5:17:49<2:00:17,  3.65it/s]
 93%|█████████▎| 345156/371472 [5:17:49<1:59:23,  3.67it/s]
 93%|█████████▎| 345157/371472 [5:17:50<1:59:49,  3.66it/s]
 93%|█████████▎| 345158/371472 [5:17:50<1:58:28,  3.70it/s]
 93%|█████████▎| 345159/371472 [5:17:50<2:02:36,  3.58it/s]
 93%|█████████▎| 345160/371472 [5:17:50<2:04:09,  3.53it/s]
                                                           
{'loss': 2.6438, 'learning_rate': 1.6378288694003318e-07, 'epoch': 14.87}

 93%|█████████▎| 345160/371472 [5:17:50<2:04:09,  3.53it/s]
 93%|█████████▎| 345161/371472 [5:17:51<2:03:14,  3.56it/s]
 93%|█████████▎| 345162/371472 [5:17:51<2:00:28,  3.64it/s]
 93%|█████████▎| 345163/371472 [5:17:51<2:01:49,  3.60it/s]
 93%|█████████▎| 345164/371472 [5:17:52<2:06:51,  3.46it/s]
 93%|█████████▎| 345165/371472 [5:17:52<2:01:13,  3.62it/s]
 93%|█████████▎| 345166/371472 [5:17:52<2:01:42,  3.60it/s]
 93%|█████████▎| 345167/371472 [5:17:52<2:10:21,  3.36it/s]
 93%|█████████▎| 345168/371472 [5:17:53<2:05:41,  3.49it/s]
 93%|█████████▎| 345169/371472 [5:17:53<2:00:54,  3.63it/s]
 93%|█████████▎| 345170/371472 [5:17:53<2:01:04,  3.62it/s]
 93%|█████████▎| 345171/371472 [5:17:53<1:59:18,  3.67it/s]
 93%|█████████▎| 345172/371472 [5:17:54<2:00:48,  3.63it/s]
 93%|█████████▎| 345173/371472 [5:17:54<2:04:44,  3.51it/s]
 93%|█████████▎| 345174/371472 [5:17:54<2:08:16,  3.42it/s]
 93%|█████████▎| 345175/371472 [5:17:55<2:10:21,  3.36it/s]
 93%|█████████▎| 345176/371472 [5:17:55<2:13:41,  3.28it/s]
 93%|█████████▎| 345177/371472 [5:17:55<2:21:45,  3.09it/s]
 93%|█████████▎| 345178/371472 [5:17:56<2:13:25,  3.28it/s]
 93%|█████████▎| 345179/371472 [5:17:56<2:09:51,  3.37it/s]
 93%|█████████▎| 345180/371472 [5:17:56<2:11:03,  3.34it/s]
                                                           
{'loss': 2.6963, 'learning_rate': 1.6373440496455425e-07, 'epoch': 14.87}

 93%|█████████▎| 345180/371472 [5:17:56<2:11:03,  3.34it/s]
 93%|█████████▎| 345181/371472 [5:17:56<2:10:20,  3.36it/s]
 93%|█████████▎| 345182/371472 [5:17:57<2:05:56,  3.48it/s]
 93%|█████████▎| 345183/371472 [5:17:57<2:00:47,  3.63it/s]
 93%|█████████▎| 345184/371472 [5:17:57<1:59:01,  3.68it/s]
 93%|█████████▎| 345185/371472 [5:17:58<2:01:59,  3.59it/s]
 93%|█████████▎| 345186/371472 [5:17:58<2:02:21,  3.58it/s]
 93%|█████████▎| 345187/371472 [5:17:58<2:00:03,  3.65it/s]
 93%|█████████▎| 345188/371472 [5:17:58<2:07:37,  3.43it/s]
 93%|█████████▎| 345189/371472 [5:17:59<2:02:46,  3.57it/s]
 93%|█████████▎| 345190/371472 [5:17:59<2:02:57,  3.56it/s]
 93%|█████████▎| 345191/371472 [5:17:59<2:07:42,  3.43it/s]
 93%|█████████▎| 345192/371472 [5:18:00<2:07:28,  3.44it/s]
 93%|█████████▎| 345193/371472 [5:18:00<2:00:26,  3.64it/s]
 93%|█████████▎| 345194/371472 [5:18:00<1:57:45,  3.72it/s]
 93%|█████████▎| 345195/371472 [5:18:00<1:53:24,  3.86it/s]
 93%|█████████▎| 345196/371472 [5:18:01<1:55:35,  3.79it/s]
 93%|█████████▎| 345197/371472 [5:18:01<2:00:43,  3.63it/s]
 93%|█████████▎| 345198/371472 [5:18:01<1:58:58,  3.68it/s]
 93%|█████████▎| 345199/371472 [5:18:01<1:57:47,  3.72it/s]
 93%|█████████▎| 345200/371472 [5:18:02<2:03:52,  3.53it/s]
                                                           
{'loss': 2.6933, 'learning_rate': 1.636859229890754e-07, 'epoch': 14.87}

 93%|█████████▎| 345200/371472 [5:18:02<2:03:52,  3.53it/s]
 93%|█████████▎| 345201/371472 [5:18:02<2:10:10,  3.36it/s]
 93%|█████████▎| 345202/371472 [5:18:02<2:04:47,  3.51it/s]
 93%|█████████▎| 345203/371472 [5:18:03<2:04:44,  3.51it/s]
 93%|█████████▎| 345204/371472 [5:18:03<2:04:30,  3.52it/s]
 93%|█████████▎| 345205/371472 [5:18:03<2:00:57,  3.62it/s]
 93%|█████████▎| 345206/371472 [5:18:03<2:02:16,  3.58it/s]
 93%|█████████▎| 345207/371472 [5:18:04<2:09:04,  3.39it/s]
 93%|█████████▎| 345208/371472 [5:18:04<2:07:18,  3.44it/s]
 93%|█████████▎| 345209/371472 [5:18:04<2:11:16,  3.33it/s]
 93%|█████████▎| 345210/371472 [5:18:05<2:05:35,  3.49it/s]
 93%|█████████▎| 345211/371472 [5:18:05<2:05:57,  3.47it/s]
 93%|█████████▎| 345212/371472 [5:18:05<2:10:24,  3.36it/s]
 93%|█████████▎| 345213/371472 [5:18:06<2:08:02,  3.42it/s]
 93%|█████████▎| 345214/371472 [5:18:06<2:08:26,  3.41it/s]
 93%|█████████▎| 345215/371472 [5:18:06<2:10:01,  3.37it/s]
 93%|█████████▎| 345216/371472 [5:18:06<2:09:28,  3.38it/s]
 93%|█████████▎| 345217/371472 [5:18:07<2:09:22,  3.38it/s]
 93%|█████████▎| 345218/371472 [5:18:07<2:21:41,  3.09it/s]
 93%|█████████▎| 345219/371472 [5:18:07<2:21:28,  3.09it/s]
 93%|█████████▎| 345220/371472 [5:18:08<2:13:20,  3.28it/s]
                                                           
{'loss': 2.5985, 'learning_rate': 1.6363744101359645e-07, 'epoch': 14.87}

 93%|█████████▎| 345220/371472 [5:18:08<2:13:20,  3.28it/s]
 93%|█████████▎| 345221/371472 [5:18:08<2:07:44,  3.42it/s]
 93%|█████████▎| 345222/371472 [5:18:08<2:07:05,  3.44it/s]
 93%|█████████▎| 345223/371472 [5:18:08<2:02:31,  3.57it/s]
 93%|█████████▎| 345224/371472 [5:18:09<2:03:48,  3.53it/s]
 93%|█████████▎| 345225/371472 [5:18:09<2:00:35,  3.63it/s]
 93%|█████████▎| 345226/371472 [5:18:09<2:01:22,  3.60it/s]
 93%|█████████▎| 345227/371472 [5:18:10<1:59:19,  3.67it/s]
 93%|█████████▎| 345228/371472 [5:18:10<1:57:14,  3.73it/s]
 93%|█████████▎| 345229/371472 [5:18:10<1:53:43,  3.85it/s]
 93%|█████████▎| 345230/371472 [5:18:10<1:53:16,  3.86it/s]
 93%|█████████▎| 345231/371472 [5:18:11<1:53:04,  3.87it/s]
 93%|█████████▎| 345232/371472 [5:18:11<2:06:24,  3.46it/s]
 93%|█████████▎| 345233/371472 [5:18:11<2:06:14,  3.46it/s]
 93%|█████████▎| 345234/371472 [5:18:12<2:08:28,  3.40it/s]
 93%|█████████▎| 345235/371472 [5:18:12<2:05:58,  3.47it/s]
 93%|█████████▎| 345236/371472 [5:18:12<2:01:22,  3.60it/s]
 93%|█████████▎| 345237/371472 [5:18:12<1:56:27,  3.75it/s]
 93%|█████████▎| 345238/371472 [5:18:13<1:57:24,  3.72it/s]
 93%|█████████▎| 345239/371472 [5:18:13<1:55:16,  3.79it/s]
 93%|█████████▎| 345240/371472 [5:18:13<1:57:08,  3.73it/s]
                                                           
{'loss': 2.4641, 'learning_rate': 1.6358895903811763e-07, 'epoch': 14.87}

 93%|█████████▎| 345240/371472 [5:18:13<1:57:08,  3.73it/s]
 93%|█████████▎| 345241/371472 [5:18:13<1:53:10,  3.86it/s]
 93%|█████████▎| 345242/371472 [5:18:14<1:53:24,  3.85it/s]
 93%|█████████▎| 345243/371472 [5:18:14<1:54:32,  3.82it/s]
 93%|█████████▎| 345244/371472 [5:18:14<1:52:29,  3.89it/s]
 93%|█████████▎| 345245/371472 [5:18:14<1:52:15,  3.89it/s]
 93%|█████████▎| 345246/371472 [5:18:15<2:02:47,  3.56it/s]
 93%|█████████▎| 345247/371472 [5:18:15<1:57:49,  3.71it/s]
 93%|█████████▎| 345248/371472 [5:18:15<1:59:23,  3.66it/s]
 93%|█████████▎| 345249/371472 [5:18:16<2:03:42,  3.53it/s]
 93%|█████████▎| 345250/371472 [5:18:16<2:01:20,  3.60it/s]
 93%|█████████▎| 345251/371472 [5:18:16<2:00:37,  3.62it/s]
 93%|█████████▎| 345252/371472 [5:18:16<1:56:28,  3.75it/s]
 93%|█████████▎| 345253/371472 [5:18:17<1:54:04,  3.83it/s]
 93%|█████████▎| 345254/371472 [5:18:17<1:59:31,  3.66it/s]
 93%|█████████▎| 345255/371472 [5:18:17<2:01:23,  3.60it/s]
 93%|█████████▎| 345256/371472 [5:18:17<1:57:56,  3.70it/s]
 93%|█████████▎| 345257/371472 [5:18:18<1:55:48,  3.77it/s]
 93%|█████████▎| 345258/371472 [5:18:18<1:56:11,  3.76it/s]
 93%|█████████▎| 345259/371472 [5:18:18<1:55:53,  3.77it/s]
 93%|█████████▎| 345260/371472 [5:18:19<2:10:13,  3.35it/s]
                                                           
{'loss': 2.5855, 'learning_rate': 1.635404770626387e-07, 'epoch': 14.87}

 93%|█████████▎| 345260/371472 [5:18:19<2:10:13,  3.35it/s]
 93%|█████████▎| 345261/371472 [5:18:19<2:09:28,  3.37it/s]
 93%|█████████▎| 345262/371472 [5:18:19<2:05:09,  3.49it/s]
 93%|█████████▎| 345263/371472 [5:18:19<2:04:08,  3.52it/s]
 93%|█████████▎| 345264/371472 [5:18:20<1:59:36,  3.65it/s]
 93%|█████████▎| 345265/371472 [5:18:20<1:58:53,  3.67it/s]
 93%|█████████▎| 345266/371472 [5:18:20<1:59:00,  3.67it/s]
 93%|█████████▎| 345267/371472 [5:18:21<2:04:34,  3.51it/s]
 93%|█████████▎| 345268/371472 [5:18:21<2:04:43,  3.50it/s]
 93%|█████████▎| 345269/371472 [5:18:21<1:58:53,  3.67it/s]
 93%|█████████▎| 345270/371472 [5:18:21<1:55:44,  3.77it/s]
 93%|█████████▎| 345271/371472 [5:18:22<1:54:50,  3.80it/s]
 93%|█████████▎| 345272/371472 [5:18:22<2:03:54,  3.52it/s]
 93%|█████████▎| 345273/371472 [5:18:22<2:36:16,  2.79it/s]
 93%|█████████▎| 345274/371472 [5:18:23<2:22:55,  3.06it/s]
 93%|█████████▎| 345275/371472 [5:18:23<2:25:45,  3.00it/s]
 93%|█████████▎| 345276/371472 [5:18:23<2:18:35,  3.15it/s]
 93%|█████████▎| 345277/371472 [5:18:24<2:10:49,  3.34it/s]
 93%|█████████▎| 345278/371472 [5:18:24<2:09:06,  3.38it/s]
 93%|█████████▎| 345279/371472 [5:18:24<2:02:46,  3.56it/s]
 93%|█████████▎| 345280/371472 [5:18:24<1:59:26,  3.65it/s]
                                                           
{'loss': 2.5802, 'learning_rate': 1.6349199508715982e-07, 'epoch': 14.87}

 93%|█████████▎| 345280/371472 [5:18:24<1:59:26,  3.65it/s]
 93%|█████████▎| 345281/371472 [5:18:25<2:00:28,  3.62it/s]
 93%|█████████▎| 345282/371472 [5:18:25<1:56:33,  3.75it/s]
 93%|█████████▎| 345283/371472 [5:18:25<2:04:02,  3.52it/s]
 93%|█████████▎| 345284/371472 [5:18:25<1:59:49,  3.64it/s]
 93%|█████████▎| 345285/371472 [5:18:26<2:02:16,  3.57it/s]
 93%|█████████▎| 345286/371472 [5:18:26<2:08:13,  3.40it/s]
 93%|█████████▎| 345287/371472 [5:18:26<2:02:19,  3.57it/s]
 93%|█████████▎| 345288/371472 [5:18:27<1:59:33,  3.65it/s]
 93%|█████████▎| 345289/371472 [5:18:27<1:57:21,  3.72it/s]
 93%|█████████▎| 345290/371472 [5:18:27<1:56:30,  3.75it/s]
 93%|█████████▎| 345291/371472 [5:18:27<2:03:37,  3.53it/s]
 93%|█████████▎| 345292/371472 [5:18:28<2:02:58,  3.55it/s]
 93%|█████████▎| 345293/371472 [5:18:28<2:01:22,  3.59it/s]
 93%|█████████▎| 345294/371472 [5:18:28<1:59:53,  3.64it/s]
 93%|█████████▎| 345295/371472 [5:18:29<2:09:22,  3.37it/s]
 93%|█████████▎| 345296/371472 [5:18:29<2:04:00,  3.52it/s]
 93%|█████████▎| 345297/371472 [5:18:29<2:07:02,  3.43it/s]
 93%|█████████▎| 345298/371472 [5:18:30<2:16:36,  3.19it/s]
 93%|█████████▎| 345299/371472 [5:18:30<2:10:48,  3.33it/s]
 93%|█████████▎| 345300/371472 [5:18:30<2:11:19,  3.32it/s]
                                                           
{'loss': 2.5267, 'learning_rate': 1.634435131116809e-07, 'epoch': 14.87}

 93%|█████████▎| 345300/371472 [5:18:30<2:11:19,  3.32it/s]
 93%|█████████▎| 345301/371472 [5:18:30<2:10:15,  3.35it/s]
 93%|█████████▎| 345302/371472 [5:18:31<2:07:15,  3.43it/s]
 93%|█████████▎| 345303/371472 [5:18:31<2:03:47,  3.52it/s]
 93%|█████████▎| 345304/371472 [5:18:31<2:00:04,  3.63it/s]
 93%|█████████▎| 345305/371472 [5:18:31<1:55:44,  3.77it/s]
 93%|█████████▎| 345306/371472 [5:18:32<1:56:34,  3.74it/s]
 93%|█████████▎| 345307/371472 [5:18:32<1:57:31,  3.71it/s]
 93%|█████████▎| 345308/371472 [5:18:32<2:02:53,  3.55it/s]
 93%|█████████▎| 345309/371472 [5:18:33<1:59:04,  3.66it/s]
 93%|█████████▎| 345310/371472 [5:18:33<1:55:42,  3.77it/s]
 93%|█████████▎| 345311/371472 [5:18:33<2:05:42,  3.47it/s]
 93%|█████████▎| 345312/371472 [5:18:33<2:05:08,  3.48it/s]
 93%|█████████▎| 345313/371472 [5:18:34<2:06:55,  3.43it/s]
 93%|█████████▎| 345314/371472 [5:18:34<2:08:01,  3.41it/s]
 93%|█████████▎| 345315/371472 [5:18:34<2:03:30,  3.53it/s]
 93%|█████████▎| 345316/371472 [5:18:34<1:57:58,  3.70it/s]
 93%|█████████▎| 345317/371472 [5:18:35<2:06:20,  3.45it/s]
 93%|█████████▎| 345318/371472 [5:18:35<2:04:32,  3.50it/s]
 93%|█████████▎| 345319/371472 [5:18:35<2:00:42,  3.61it/s]
 93%|█████████▎| 345320/371472 [5:18:36<1:56:56,  3.73it/s]
                                                           
{'loss': 2.5051, 'learning_rate': 1.6339503113620207e-07, 'epoch': 14.87}

 93%|█████████▎| 345320/371472 [5:18:36<1:56:56,  3.73it/s]
 93%|█████████▎| 345321/371472 [5:18:36<1:55:06,  3.79it/s]
 93%|█████████▎| 345322/371472 [5:18:36<1:54:20,  3.81it/s]
 93%|█████████▎| 345323/371472 [5:18:36<1:54:32,  3.81it/s]
 93%|█████████▎| 345324/371472 [5:18:37<1:52:59,  3.86it/s]
 93%|█████████▎| 345325/371472 [5:18:37<1:51:51,  3.90it/s]
 93%|█████████▎| 345326/371472 [5:18:37<2:09:06,  3.38it/s]
 93%|█████████▎| 345327/371472 [5:18:38<2:05:22,  3.48it/s]
 93%|█████████▎| 345328/371472 [5:18:38<2:06:16,  3.45it/s]
 93%|█████████▎| 345329/371472 [5:18:38<2:03:45,  3.52it/s]
 93%|█████████▎| 345330/371472 [5:18:38<1:58:49,  3.67it/s]
 93%|█████████▎| 345331/371472 [5:18:39<2:05:20,  3.48it/s]
 93%|█████████▎| 345332/371472 [5:18:39<2:00:58,  3.60it/s]
 93%|█████████▎| 345333/371472 [5:18:39<1:56:43,  3.73it/s]
 93%|█████████▎| 345334/371472 [5:18:39<1:56:34,  3.74it/s]
 93%|█████████▎| 345335/371472 [5:18:40<2:00:24,  3.62it/s]
 93%|█████████▎| 345336/371472 [5:18:40<2:03:48,  3.52it/s]
 93%|█████████▎| 345337/371472 [5:18:40<1:58:38,  3.67it/s]
 93%|█████████▎| 345338/371472 [5:18:41<1:55:19,  3.78it/s]
 93%|█████████▎| 345339/371472 [5:18:41<1:54:10,  3.81it/s]
 93%|█████████▎| 345340/371472 [5:18:41<1:56:08,  3.75it/s]
                                                           
{'loss': 2.5974, 'learning_rate': 1.6334654916072312e-07, 'epoch': 14.87}

 93%|█████████▎| 345340/371472 [5:18:41<1:56:08,  3.75it/s]
 93%|█████████▎| 345341/371472 [5:18:41<1:57:49,  3.70it/s]
 93%|█████████▎| 345342/371472 [5:18:42<1:59:06,  3.66it/s]
 93%|█████████▎| 345343/371472 [5:18:42<2:10:43,  3.33it/s]
 93%|█████████▎| 345344/371472 [5:18:42<2:10:34,  3.34it/s]
 93%|█████████▎| 345345/371472 [5:18:43<2:07:44,  3.41it/s]
 93%|█████████▎| 345346/371472 [5:18:43<2:03:44,  3.52it/s]
 93%|█████████▎| 345347/371472 [5:18:43<2:02:03,  3.57it/s]
 93%|█████████▎| 345348/371472 [5:18:43<2:09:32,  3.36it/s]
 93%|█████████▎| 345349/371472 [5:18:44<2:20:10,  3.11it/s]
 93%|█████████▎| 345350/371472 [5:18:44<2:12:39,  3.28it/s]
 93%|█████████▎| 345351/371472 [5:18:44<2:09:11,  3.37it/s]
 93%|█████████▎| 345352/371472 [5:18:45<2:08:57,  3.38it/s]
 93%|█████████▎| 345353/371472 [5:18:45<2:10:10,  3.34it/s]
 93%|█████████▎| 345354/371472 [5:18:45<2:06:28,  3.44it/s]
 93%|█████████▎| 345355/371472 [5:18:46<2:14:20,  3.24it/s]
 93%|█████████▎| 345356/371472 [5:18:46<2:29:05,  2.92it/s]
 93%|█████████▎| 345357/371472 [5:18:46<2:19:51,  3.11it/s]
 93%|█████████▎| 345358/371472 [5:18:47<2:12:40,  3.28it/s]
 93%|█████████▎| 345359/371472 [5:18:47<2:04:03,  3.51it/s]
 93%|█████████▎| 345360/371472 [5:18:47<1:58:05,  3.69it/s]
                                                           
{'loss': 2.5985, 'learning_rate': 1.6329806718524427e-07, 'epoch': 14.88}

 93%|█████████▎| 345360/371472 [5:18:47<1:58:05,  3.69it/s]
 93%|█████████▎| 345361/371472 [5:18:47<2:01:23,  3.58it/s]
 93%|█████████▎| 345362/371472 [5:18:48<2:08:57,  3.37it/s]
 93%|█████████▎| 345363/371472 [5:18:48<2:02:40,  3.55it/s]
 93%|█████████▎| 345364/371472 [5:18:48<1:59:47,  3.63it/s]
 93%|█████████▎| 345365/371472 [5:18:48<2:04:08,  3.51it/s]
 93%|█████████▎| 345366/371472 [5:18:49<2:01:49,  3.57it/s]
 93%|█████████▎| 345367/371472 [5:18:49<1:58:49,  3.66it/s]
 93%|█████████▎| 345368/371472 [5:18:49<1:59:48,  3.63it/s]
 93%|█████████▎| 345369/371472 [5:18:50<2:02:16,  3.56it/s]
 93%|█████████▎| 345370/371472 [5:18:50<2:03:19,  3.53it/s]
 93%|█████████▎| 345371/371472 [5:18:50<1:58:38,  3.67it/s]
 93%|█████████▎| 345372/371472 [5:18:50<2:00:38,  3.61it/s]
 93%|█████████▎| 345373/371472 [5:18:51<2:00:45,  3.60it/s]
 93%|█████████▎| 345374/371472 [5:18:51<2:02:34,  3.55it/s]
 93%|█████████▎| 345375/371472 [5:18:51<2:01:15,  3.59it/s]
 93%|█████████▎| 345376/371472 [5:18:52<1:59:20,  3.64it/s]
 93%|█████████▎| 345377/371472 [5:18:52<2:06:44,  3.43it/s]
 93%|█████████▎| 345378/371472 [5:18:52<2:03:41,  3.52it/s]
 93%|█████████▎| 345379/371472 [5:18:52<2:00:40,  3.60it/s]
 93%|█████████▎| 345380/371472 [5:18:53<2:02:58,  3.54it/s]
                                                           
{'loss': 2.6631, 'learning_rate': 1.6324958520976534e-07, 'epoch': 14.88}

 93%|█████████▎| 345380/371472 [5:18:53<2:02:58,  3.54it/s]
 93%|█████████▎| 345381/371472 [5:18:53<2:03:19,  3.53it/s]
 93%|█████████▎| 345382/371472 [5:18:53<2:04:52,  3.48it/s]
 93%|█████████▎| 345383/371472 [5:18:54<2:02:14,  3.56it/s]
 93%|█████████▎| 345384/371472 [5:18:54<2:08:09,  3.39it/s]
 93%|█████████▎| 345385/371472 [5:18:54<2:09:44,  3.35it/s]
 93%|█████████▎| 345386/371472 [5:18:54<2:12:01,  3.29it/s]
 93%|█████████▎| 345387/371472 [5:18:55<2:07:30,  3.41it/s]
 93%|█████████▎| 345388/371472 [5:18:55<2:04:14,  3.50it/s]
 93%|█████████▎| 345389/371472 [5:18:55<2:08:54,  3.37it/s]
 93%|█████████▎| 345390/371472 [5:18:56<2:11:22,  3.31it/s]
 93%|█████████▎| 345391/371472 [5:18:56<2:10:05,  3.34it/s]
 93%|█████████▎| 345392/371472 [5:18:56<2:07:33,  3.41it/s]
 93%|█████████▎| 345393/371472 [5:18:56<2:04:14,  3.50it/s]
 93%|█████████▎| 345394/371472 [5:18:57<2:04:02,  3.50it/s]
 93%|█████████▎| 345395/371472 [5:18:57<2:02:53,  3.54it/s]
 93%|█████████▎| 345396/371472 [5:18:57<2:00:41,  3.60it/s]
 93%|█████████▎| 345397/371472 [5:18:58<2:00:39,  3.60it/s]
 93%|█████████▎| 345398/371472 [5:18:58<2:03:23,  3.52it/s]
 93%|█████████▎| 345399/371472 [5:18:58<1:57:32,  3.70it/s]
 93%|█████████▎| 345400/371472 [5:18:58<1:57:20,  3.70it/s]
                                                           
{'loss': 2.5874, 'learning_rate': 1.632011032342865e-07, 'epoch': 14.88}

 93%|█████████▎| 345400/371472 [5:18:58<1:57:20,  3.70it/s]
 93%|█████████▎| 345401/371472 [5:18:59<1:58:12,  3.68it/s]
 93%|█████████▎| 345402/371472 [5:18:59<1:57:32,  3.70it/s]
 93%|█████████▎| 345403/371472 [5:18:59<1:53:04,  3.84it/s]
 93%|█████████▎| 345404/371472 [5:18:59<1:53:45,  3.82it/s]
 93%|█████████▎| 345405/371472 [5:19:00<1:59:12,  3.64it/s]
 93%|█████████▎| 345406/371472 [5:19:00<2:02:33,  3.54it/s]
 93%|█████████▎| 345407/371472 [5:19:00<2:01:00,  3.59it/s]
 93%|█████████▎| 345408/371472 [5:19:01<2:00:52,  3.59it/s]
 93%|█████████▎| 345409/371472 [5:19:01<1:58:00,  3.68it/s]
 93%|█████████▎| 345410/371472 [5:19:01<2:09:42,  3.35it/s]
 93%|█████████▎| 345411/371472 [5:19:01<2:05:37,  3.46it/s]
 93%|█████████▎| 345412/371472 [5:19:02<1:58:23,  3.67it/s]
 93%|█████████▎| 345413/371472 [5:19:02<1:57:23,  3.70it/s]
 93%|█████████▎| 345414/371472 [5:19:02<1:57:41,  3.69it/s]
 93%|█████████▎| 345415/371472 [5:19:03<2:02:49,  3.54it/s]
 93%|█████████▎| 345416/371472 [5:19:03<1:58:37,  3.66it/s]
 93%|█████████▎| 345417/371472 [5:19:03<2:11:08,  3.31it/s]
 93%|█████████▎| 345418/371472 [5:19:03<2:08:03,  3.39it/s]
 93%|█████████▎| 345419/371472 [5:19:04<2:06:06,  3.44it/s]
 93%|█████████▎| 345420/371472 [5:19:04<2:25:52,  2.98it/s]
                                                           
{'loss': 2.7137, 'learning_rate': 1.6315262125880756e-07, 'epoch': 14.88}

 93%|█████████▎| 345420/371472 [5:19:04<2:25:52,  2.98it/s]
 93%|█████████▎| 345421/371472 [5:19:04<2:16:02,  3.19it/s]
 93%|█████████▎| 345422/371472 [5:19:05<2:10:10,  3.34it/s]
 93%|█████████▎| 345423/371472 [5:19:05<2:06:39,  3.43it/s]
 93%|█████████▎| 345424/371472 [5:19:05<2:12:41,  3.27it/s]
 93%|█████████▎| 345425/371472 [5:19:06<2:11:31,  3.30it/s]
 93%|█████████▎| 345426/371472 [5:19:06<2:06:03,  3.44it/s]
 93%|█████████▎| 345427/371472 [5:19:06<2:03:59,  3.50it/s]
 93%|█████████▎| 345428/371472 [5:19:06<2:00:55,  3.59it/s]
 93%|█████████▎| 345429/371472 [5:19:07<1:58:08,  3.67it/s]
 93%|█████████▎| 345430/371472 [5:19:07<1:57:09,  3.70it/s]
 93%|█████████▎| 345431/371472 [5:19:07<1:55:19,  3.76it/s]
 93%|█████████▎| 345432/371472 [5:19:07<2:00:21,  3.61it/s]
 93%|█████████▎| 345433/371472 [5:19:08<1:57:54,  3.68it/s]
 93%|█████████▎| 345434/371472 [5:19:08<2:02:51,  3.53it/s]
 93%|█████████▎| 345435/371472 [5:19:08<2:01:27,  3.57it/s]
 93%|█████████▎| 345436/371472 [5:19:09<2:00:30,  3.60it/s]
 93%|█████████▎| 345437/371472 [5:19:09<1:57:52,  3.68it/s]
 93%|█████████▎| 345438/371472 [5:19:09<1:57:27,  3.69it/s]
 93%|█████████▎| 345439/371472 [5:19:09<1:55:49,  3.75it/s]
 93%|█████████▎| 345440/371472 [5:19:10<1:54:22,  3.79it/s]
                                                           
{'loss': 2.7381, 'learning_rate': 1.631041392833287e-07, 'epoch': 14.88}

 93%|█████████▎| 345440/371472 [5:19:10<1:54:22,  3.79it/s]
 93%|█████████▎| 345441/371472 [5:19:10<2:06:56,  3.42it/s]
 93%|█████████▎| 345442/371472 [5:19:10<2:02:11,  3.55it/s]
 93%|█████████▎| 345443/371472 [5:19:11<2:05:02,  3.47it/s]
 93%|█████████▎| 345444/371472 [5:19:11<2:00:10,  3.61it/s]
 93%|█████████▎| 345445/371472 [5:19:11<1:58:23,  3.66it/s]
 93%|█████████▎| 345446/371472 [5:19:11<1:54:00,  3.80it/s]
 93%|█████████▎| 345447/371472 [5:19:12<1:53:24,  3.82it/s]
 93%|█████████▎| 345448/371472 [5:19:12<1:53:23,  3.82it/s]
 93%|█████████▎| 345449/371472 [5:19:12<1:59:30,  3.63it/s]
 93%|█████████▎| 345450/371472 [5:19:12<1:56:18,  3.73it/s]
 93%|█████████▎| 345451/371472 [5:19:13<2:01:18,  3.57it/s]
 93%|█████████▎| 345452/371472 [5:19:13<2:06:09,  3.44it/s]
 93%|█████████▎| 345453/371472 [5:19:13<2:03:35,  3.51it/s]
 93%|█████████▎| 345454/371472 [5:19:14<2:09:40,  3.34it/s]
 93%|█████████▎| 345455/371472 [5:19:14<2:12:23,  3.28it/s]
 93%|█████████▎| 345456/371472 [5:19:14<2:07:40,  3.40it/s]
 93%|█████████▎| 345457/371472 [5:19:14<2:02:55,  3.53it/s]
 93%|█████████▎| 345458/371472 [5:19:15<2:04:09,  3.49it/s]
 93%|█████████▎| 345459/371472 [5:19:15<2:06:21,  3.43it/s]
 93%|█████████▎| 345460/371472 [5:19:15<1:59:34,  3.63it/s]
                                                           
{'loss': 2.6696, 'learning_rate': 1.6305565730784976e-07, 'epoch': 14.88}

 93%|█████████▎| 345460/371472 [5:19:15<1:59:34,  3.63it/s]
 93%|█████████▎| 345461/371472 [5:19:16<2:00:51,  3.59it/s]
 93%|█████████▎| 345462/371472 [5:19:16<2:01:40,  3.56it/s]
 93%|█████████▎| 345463/371472 [5:19:16<2:00:19,  3.60it/s]
 93%|█████████▎| 345464/371472 [5:19:16<2:03:07,  3.52it/s]
 93%|█████████▎| 345465/371472 [5:19:17<1:57:50,  3.68it/s]
 93%|█████████▎| 345466/371472 [5:19:17<2:04:06,  3.49it/s]
 93%|█████████▎| 345467/371472 [5:19:17<2:05:07,  3.46it/s]
 93%|█████████▎| 345468/371472 [5:19:18<2:06:54,  3.42it/s]
 93%|█████████▎| 345469/371472 [5:19:18<2:04:46,  3.47it/s]
 93%|█████████▎| 345470/371472 [5:19:18<2:01:39,  3.56it/s]
 93%|█████████▎| 345471/371472 [5:19:18<2:06:57,  3.41it/s]
 93%|█████████▎| 345472/371472 [5:19:19<2:04:25,  3.48it/s]
 93%|█████████▎| 345473/371472 [5:19:19<2:01:37,  3.56it/s]
 93%|█████████▎| 345474/371472 [5:19:19<2:08:50,  3.36it/s]
 93%|█████████▎| 345475/371472 [5:19:20<2:06:59,  3.41it/s]
 93%|█████████▎| 345476/371472 [5:19:20<2:07:00,  3.41it/s]
 93%|█████████▎| 345477/371472 [5:19:20<2:10:06,  3.33it/s]
 93%|█████████▎| 345478/371472 [5:19:21<2:08:45,  3.36it/s]
 93%|█████████▎| 345479/371472 [5:19:21<2:06:04,  3.44it/s]
 93%|█████████▎| 345480/371472 [5:19:21<2:01:26,  3.57it/s]
                                                           
{'loss': 2.6719, 'learning_rate': 1.630071753323709e-07, 'epoch': 14.88}

 93%|█████████▎| 345480/371472 [5:19:21<2:01:26,  3.57it/s]
 93%|█████████▎| 345481/371472 [5:19:21<2:01:22,  3.57it/s]
 93%|█████████▎| 345482/371472 [5:19:22<1:57:48,  3.68it/s]
 93%|█████████▎| 345483/371472 [5:19:22<1:54:51,  3.77it/s]
 93%|█████████▎| 345484/371472 [5:19:22<1:54:29,  3.78it/s]
 93%|█████████▎| 345485/371472 [5:19:22<1:58:28,  3.66it/s]
 93%|█████████▎| 345486/371472 [5:19:23<1:57:44,  3.68it/s]
 93%|█████████▎| 345487/371472 [5:19:23<2:01:09,  3.57it/s]
 93%|█████████▎| 345488/371472 [5:19:23<2:00:35,  3.59it/s]
 93%|█████████▎| 345489/371472 [5:19:23<1:56:24,  3.72it/s]
 93%|█████████▎| 345490/371472 [5:19:24<1:55:17,  3.76it/s]
 93%|█████████▎| 345491/371472 [5:19:24<1:52:17,  3.86it/s]
 93%|█████████▎| 345492/371472 [5:19:24<1:49:40,  3.95it/s]
 93%|█████████▎| 345493/371472 [5:19:25<1:55:40,  3.74it/s]
 93%|█████████▎| 345494/371472 [5:19:25<1:55:58,  3.73it/s]
 93%|█████████▎| 345495/371472 [5:19:25<2:09:11,  3.35it/s]
 93%|█████████▎| 345496/371472 [5:19:25<2:05:47,  3.44it/s]
 93%|█████████▎| 345497/371472 [5:19:26<2:07:37,  3.39it/s]
 93%|█████████▎| 345498/371472 [5:19:26<2:04:39,  3.47it/s]
 93%|█████████▎| 345499/371472 [5:19:26<2:03:16,  3.51it/s]
 93%|█████████▎| 345500/371472 [5:19:27<2:01:31,  3.56it/s]
                                                           
{'loss': 2.4692, 'learning_rate': 1.6295869335689198e-07, 'epoch': 14.88}

 93%|█████████▎| 345500/371472 [5:19:27<2:01:31,  3.56it/s]
 93%|█████████▎| 345501/371472 [5:19:27<2:00:02,  3.61it/s]
 93%|█████████▎| 345502/371472 [5:19:27<1:59:50,  3.61it/s]
 93%|█████████▎| 345503/371472 [5:19:27<1:55:12,  3.76it/s]
 93%|█████████▎| 345504/371472 [5:19:28<1:54:55,  3.77it/s]
 93%|█████████▎| 345505/371472 [5:19:28<1:58:10,  3.66it/s]
 93%|█████████▎| 345506/371472 [5:19:28<1:55:57,  3.73it/s]
 93%|█████████▎| 345507/371472 [5:19:29<2:07:20,  3.40it/s]
 93%|█████████▎| 345508/371472 [5:19:29<2:02:40,  3.53it/s]
 93%|█████████▎| 345509/371472 [5:19:29<2:04:36,  3.47it/s]
 93%|█████████▎| 345510/371472 [5:19:29<2:00:57,  3.58it/s]
 93%|█████████▎| 345511/371472 [5:19:30<2:11:07,  3.30it/s]
 93%|█████████▎| 345512/371472 [5:19:30<2:11:21,  3.29it/s]
 93%|█████████▎| 345513/371472 [5:19:30<2:06:13,  3.43it/s]
 93%|█████████▎| 345514/371472 [5:19:31<2:04:08,  3.48it/s]
 93%|█████████▎| 345515/371472 [5:19:31<2:15:29,  3.19it/s]
 93%|█████████▎| 345516/371472 [5:19:31<2:09:27,  3.34it/s]
 93%|█████████▎| 345517/371472 [5:19:31<2:07:06,  3.40it/s]
 93%|█████████▎| 345518/371472 [5:19:32<2:06:35,  3.42it/s]
 93%|█████████▎| 345519/371472 [5:19:32<2:02:24,  3.53it/s]
 93%|█████████▎| 345520/371472 [5:19:32<1:57:44,  3.67it/s]
                                                           
{'loss': 2.6071, 'learning_rate': 1.6291021138141303e-07, 'epoch': 14.88}

 93%|█████████▎| 345520/371472 [5:19:32<1:57:44,  3.67it/s]
 93%|█████████▎| 345521/371472 [5:19:33<1:55:47,  3.74it/s]
 93%|█████████▎| 345522/371472 [5:19:33<2:03:13,  3.51it/s]
 93%|█████████▎| 345523/371472 [5:19:33<2:11:10,  3.30it/s]
 93%|█████████▎| 345524/371472 [5:19:33<2:11:03,  3.30it/s]
 93%|█████████▎| 345525/371472 [5:19:34<2:10:11,  3.32it/s]
 93%|█████████▎| 345526/371472 [5:19:34<2:12:42,  3.26it/s]
 93%|█████████▎| 345527/371472 [5:19:34<2:10:33,  3.31it/s]
 93%|█████████▎| 345528/371472 [5:19:35<2:09:48,  3.33it/s]
 93%|█████████▎| 345529/371472 [5:19:35<2:02:21,  3.53it/s]
 93%|█████████▎| 345530/371472 [5:19:35<2:08:46,  3.36it/s]
 93%|█████████▎| 345531/371472 [5:19:35<2:00:37,  3.58it/s]
 93%|█████████▎| 345532/371472 [5:19:36<1:56:19,  3.72it/s]
 93%|█████████▎| 345533/371472 [5:19:36<1:57:06,  3.69it/s]
 93%|█████████▎| 345534/371472 [5:19:36<2:06:24,  3.42it/s]
 93%|█████████▎| 345535/371472 [5:19:37<2:04:50,  3.46it/s]
 93%|█████████▎| 345536/371472 [5:19:37<1:59:12,  3.63it/s]
 93%|█████████▎| 345537/371472 [5:19:37<1:56:45,  3.70it/s]
 93%|█████████▎| 345538/371472 [5:19:37<2:00:13,  3.60it/s]
 93%|█████████▎| 345539/371472 [5:19:38<2:02:19,  3.53it/s]
 93%|█████████▎| 345540/371472 [5:19:38<1:58:48,  3.64it/s]
                                                           
{'loss': 2.5103, 'learning_rate': 1.6286172940593418e-07, 'epoch': 14.88}

 93%|█████████▎| 345540/371472 [5:19:38<1:58:48,  3.64it/s]
 93%|█████████▎| 345541/371472 [5:19:38<1:57:46,  3.67it/s]
 93%|█████████▎| 345542/371472 [5:19:39<2:02:34,  3.53it/s]
 93%|█████████▎| 345543/371472 [5:19:39<2:01:40,  3.55it/s]
 93%|█████████▎| 345544/371472 [5:19:39<1:58:55,  3.63it/s]
 93%|█████████▎| 345545/371472 [5:19:39<2:06:14,  3.42it/s]
 93%|█████████▎| 345546/371472 [5:19:40<2:03:11,  3.51it/s]
 93%|█████████▎| 345547/371472 [5:19:40<2:07:23,  3.39it/s]
 93%|█████████▎| 345548/371472 [5:19:40<2:07:44,  3.38it/s]
 93%|█████████▎| 345549/371472 [5:19:41<2:06:20,  3.42it/s]
 93%|█████████▎| 345550/371472 [5:19:41<2:03:08,  3.51it/s]
 93%|█████████▎| 345551/371472 [5:19:41<2:10:30,  3.31it/s]
 93%|█████████▎| 345552/371472 [5:19:41<2:06:15,  3.42it/s]
 93%|█████████▎| 345553/371472 [5:19:42<2:10:24,  3.31it/s]
 93%|█████████▎| 345554/371472 [5:19:42<2:05:33,  3.44it/s]
 93%|█████████▎| 345555/371472 [5:19:42<2:01:39,  3.55it/s]
 93%|█████████▎| 345556/371472 [5:19:43<1:57:38,  3.67it/s]
 93%|█████████▎| 345557/371472 [5:19:43<2:05:13,  3.45it/s]
 93%|█████████▎| 345558/371472 [5:19:43<2:03:27,  3.50it/s]
 93%|█████████▎| 345559/371472 [5:19:43<1:58:04,  3.66it/s]
 93%|█████████▎| 345560/371472 [5:19:44<2:07:41,  3.38it/s]
                                                           
{'loss': 2.6904, 'learning_rate': 1.6281324743045525e-07, 'epoch': 14.88}

 93%|█████████▎| 345560/371472 [5:19:44<2:07:41,  3.38it/s]
 93%|█████████▎| 345561/371472 [5:19:44<2:06:38,  3.41it/s]
 93%|█████████▎| 345562/371472 [5:19:44<2:00:56,  3.57it/s]
 93%|█████████▎| 345563/371472 [5:19:45<2:00:40,  3.58it/s]
 93%|█████████▎| 345564/371472 [5:19:45<2:01:30,  3.55it/s]
 93%|█████████▎| 345565/371472 [5:19:45<2:01:48,  3.55it/s]
 93%|█████████▎| 345566/371472 [5:19:45<2:00:14,  3.59it/s]
 93%|█████████▎| 345567/371472 [5:19:46<2:02:01,  3.54it/s]
 93%|█████████▎| 345568/371472 [5:19:46<2:03:37,  3.49it/s]
 93%|█████████▎| 345569/371472 [5:19:46<2:05:43,  3.43it/s]
 93%|█████████▎| 345570/371472 [5:19:47<2:03:22,  3.50it/s]
 93%|█████████▎| 345571/371472 [5:19:47<2:06:33,  3.41it/s]
 93%|█████████▎| 345572/371472 [5:19:47<2:15:46,  3.18it/s]
 93%|█████████▎| 345573/371472 [5:19:48<2:11:48,  3.27it/s]
 93%|█████████▎| 345574/371472 [5:19:48<2:11:23,  3.29it/s]
 93%|█████████▎| 345575/371472 [5:19:48<2:08:43,  3.35it/s]
 93%|█████████▎| 345576/371472 [5:19:48<2:04:40,  3.46it/s]
 93%|█████████▎| 345577/371472 [5:19:49<2:09:02,  3.34it/s]
 93%|█████████▎| 345578/371472 [5:19:49<2:06:00,  3.43it/s]
 93%|█████████▎| 345579/371472 [5:19:49<2:02:48,  3.51it/s]
 93%|█████████▎| 345580/371472 [5:19:50<2:03:50,  3.48it/s]
                                                           
{'loss': 2.4942, 'learning_rate': 1.627647654549764e-07, 'epoch': 14.88}

 93%|█████████▎| 345580/371472 [5:19:50<2:03:50,  3.48it/s]
 93%|█████████▎| 345581/371472 [5:19:50<2:13:17,  3.24it/s]
 93%|█████████▎| 345582/371472 [5:19:50<2:09:49,  3.32it/s]
 93%|█████████▎| 345583/371472 [5:19:50<2:06:09,  3.42it/s]
 93%|█████████▎| 345584/371472 [5:19:51<2:08:03,  3.37it/s]
 93%|█████████▎| 345585/371472 [5:19:51<2:05:38,  3.43it/s]
 93%|█████████▎| 345586/371472 [5:19:51<2:01:58,  3.54it/s]
 93%|█████████▎| 345587/371472 [5:19:52<1:58:05,  3.65it/s]
 93%|█████████▎| 345588/371472 [5:19:52<2:03:07,  3.50it/s]
 93%|█████████▎| 345589/371472 [5:19:52<2:07:05,  3.39it/s]
 93%|█████████▎| 345590/371472 [5:19:52<2:01:14,  3.56it/s]
 93%|█████████▎| 345591/371472 [5:19:53<2:06:16,  3.42it/s]
 93%|█████████▎| 345592/371472 [5:19:53<2:02:29,  3.52it/s]
 93%|█████████▎| 345593/371472 [5:19:53<1:59:55,  3.60it/s]
 93%|█████████▎| 345594/371472 [5:19:54<2:05:56,  3.42it/s]
 93%|█████████▎| 345595/371472 [5:19:54<2:01:19,  3.55it/s]
 93%|█████████▎| 345596/371472 [5:19:54<1:58:35,  3.64it/s]
 93%|█████████▎| 345597/371472 [5:19:54<1:57:33,  3.67it/s]
 93%|█████████▎| 345598/371472 [5:19:55<1:56:21,  3.71it/s]
 93%|█████████▎| 345599/371472 [5:19:55<1:54:46,  3.76it/s]
 93%|█████████▎| 345600/371472 [5:19:55<1:55:06,  3.75it/s]
                                                           
{'loss': 2.4276, 'learning_rate': 1.6271628347949744e-07, 'epoch': 14.89}

 93%|█████████▎| 345600/371472 [5:19:55<1:55:06,  3.75it/s]
 93%|█████████▎| 345601/371472 [5:19:55<1:55:04,  3.75it/s]
 93%|█████████▎| 345602/371472 [5:19:56<1:54:34,  3.76it/s]
 93%|█████████▎| 345603/371472 [5:19:56<1:53:46,  3.79it/s]
 93%|█████████▎| 345604/371472 [5:19:56<2:06:51,  3.40it/s]
 93%|█████████▎| 345605/371472 [5:19:57<2:03:38,  3.49it/s]
 93%|█████████▎| 345606/371472 [5:19:57<2:00:01,  3.59it/s]
 93%|█████████▎| 345607/371472 [5:19:57<1:58:07,  3.65it/s]
 93%|█████████▎| 345608/371472 [5:19:57<1:55:13,  3.74it/s]
 93%|█████████▎| 345609/371472 [5:19:58<2:02:37,  3.52it/s]
 93%|█████████▎| 345610/371472 [5:19:58<2:01:07,  3.56it/s]
 93%|█████████▎| 345611/371472 [5:19:58<2:14:39,  3.20it/s]
 93%|█████████▎| 345612/371472 [5:19:59<2:16:38,  3.15it/s]
 93%|█████████▎| 345613/371472 [5:19:59<2:07:48,  3.37it/s]
 93%|█████████▎| 345614/371472 [5:19:59<2:06:28,  3.41it/s]
 93%|█████████▎| 345615/371472 [5:20:00<2:08:05,  3.36it/s]
 93%|█████████▎| 345616/371472 [5:20:00<2:04:18,  3.47it/s]
 93%|█████████▎| 345617/371472 [5:20:00<2:06:03,  3.42it/s]
 93%|█████████▎| 345618/371472 [5:20:00<2:01:56,  3.53it/s]
 93%|█████████▎| 345619/371472 [5:20:01<2:00:33,  3.57it/s]
 93%|█████████▎| 345620/371472 [5:20:01<2:01:08,  3.56it/s]
                                                           
{'loss': 2.5221, 'learning_rate': 1.6266780150401862e-07, 'epoch': 14.89}

 93%|█████████▎| 345620/371472 [5:20:01<2:01:08,  3.56it/s]
 93%|█████████▎| 345621/371472 [5:20:01<2:01:54,  3.53it/s]
 93%|█████████▎| 345622/371472 [5:20:02<2:03:29,  3.49it/s]
 93%|█████████▎| 345623/371472 [5:20:02<2:11:33,  3.27it/s]
 93%|█████████▎| 345624/371472 [5:20:02<2:03:02,  3.50it/s]
 93%|█████████▎| 345625/371472 [5:20:02<1:59:21,  3.61it/s]
 93%|█████████▎| 345626/371472 [5:20:03<2:01:55,  3.53it/s]
 93%|█████████▎| 345627/371472 [5:20:03<1:57:04,  3.68it/s]
 93%|█████████▎| 345628/371472 [5:20:03<1:55:43,  3.72it/s]
 93%|█████████▎| 345629/371472 [5:20:03<1:56:50,  3.69it/s]
 93%|█████████▎| 345630/371472 [5:20:04<1:59:40,  3.60it/s]
 93%|█████████▎| 345631/371472 [5:20:04<1:59:03,  3.62it/s]
 93%|█████████▎| 345632/371472 [5:20:04<2:01:23,  3.55it/s]
 93%|█████████▎| 345633/371472 [5:20:05<2:00:23,  3.58it/s]
 93%|█████████▎| 345634/371472 [5:20:05<1:58:32,  3.63it/s]
 93%|█████████▎| 345635/371472 [5:20:05<1:58:26,  3.64it/s]
 93%|█████████▎| 345636/371472 [5:20:05<2:07:41,  3.37it/s]
 93%|█████████▎| 345637/371472 [5:20:06<2:05:49,  3.42it/s]
 93%|█████████▎| 345638/371472 [5:20:06<2:04:48,  3.45it/s]
 93%|█████████▎| 345639/371472 [5:20:06<2:16:45,  3.15it/s]
 93%|█████████▎| 345640/371472 [5:20:07<2:09:31,  3.32it/s]
                                                           
{'loss': 2.6055, 'learning_rate': 1.626193195285397e-07, 'epoch': 14.89}

 93%|█████████▎| 345640/371472 [5:20:07<2:09:31,  3.32it/s]
 93%|█████████▎| 345641/371472 [5:20:07<2:05:48,  3.42it/s]
 93%|█████████▎| 345642/371472 [5:20:07<2:02:32,  3.51it/s]
 93%|█████████▎| 345643/371472 [5:20:08<2:08:43,  3.34it/s]
 93%|█████████▎| 345644/371472 [5:20:08<2:12:02,  3.26it/s]
 93%|█████████▎| 345645/371472 [5:20:08<2:17:45,  3.12it/s]
 93%|█████████▎| 345646/371472 [5:20:09<2:27:31,  2.92it/s]
 93%|█████████▎| 345647/371472 [5:20:09<2:16:28,  3.15it/s]
 93%|█████████▎| 345648/371472 [5:20:09<2:10:54,  3.29it/s]
 93%|█████████▎| 345649/371472 [5:20:09<2:02:10,  3.52it/s]
 93%|█████████▎| 345650/371472 [5:20:10<2:00:56,  3.56it/s]
 93%|█████████▎| 345651/371472 [5:20:10<2:11:23,  3.28it/s]
 93%|█████████▎| 345652/371472 [5:20:10<2:17:23,  3.13it/s]
 93%|█████████▎| 345653/371472 [5:20:11<2:18:40,  3.10it/s]
 93%|█████████▎| 345654/371472 [5:20:11<2:14:42,  3.19it/s]
 93%|█████████▎| 345655/371472 [5:20:11<2:11:30,  3.27it/s]
 93%|█████████▎| 345656/371472 [5:20:12<2:07:22,  3.38it/s]
 93%|█████████▎| 345657/371472 [5:20:12<2:03:38,  3.48it/s]
 93%|█████████▎| 345658/371472 [5:20:12<2:02:09,  3.52it/s]
 93%|█████████▎| 345659/371472 [5:20:12<2:01:08,  3.55it/s]
 93%|█████████▎| 345660/371472 [5:20:13<2:01:54,  3.53it/s]
                                                           
{'loss': 2.516, 'learning_rate': 1.6257083755306082e-07, 'epoch': 14.89}

 93%|█████████▎| 345660/371472 [5:20:13<2:01:54,  3.53it/s]
 93%|█████████▎| 345661/371472 [5:20:13<2:08:40,  3.34it/s]
 93%|█████████▎| 345662/371472 [5:20:13<2:05:49,  3.42it/s]
 93%|█████████▎| 345663/371472 [5:20:14<2:05:39,  3.42it/s]
 93%|█████████▎| 345664/371472 [5:20:14<2:04:47,  3.45it/s]
 93%|█████████▎| 345665/371472 [5:20:14<2:04:52,  3.44it/s]
 93%|█████████▎| 345666/371472 [5:20:14<2:01:50,  3.53it/s]
 93%|█████████▎| 345667/371472 [5:20:15<2:00:44,  3.56it/s]
 93%|█████████▎| 345668/371472 [5:20:15<2:03:19,  3.49it/s]
 93%|█████████▎| 345669/371472 [5:20:15<2:07:41,  3.37it/s]
 93%|█████████▎| 345670/371472 [5:20:16<2:13:34,  3.22it/s]
 93%|█████████▎| 345671/371472 [5:20:16<2:09:58,  3.31it/s]
 93%|█████████▎| 345672/371472 [5:20:16<2:12:35,  3.24it/s]
 93%|█████████▎| 345673/371472 [5:20:17<2:13:38,  3.22it/s]
 93%|█████████▎| 345674/371472 [5:20:17<2:14:11,  3.20it/s]
 93%|█████████▎| 345675/371472 [5:20:17<2:19:46,  3.08it/s]
 93%|█████████▎| 345676/371472 [5:20:18<2:12:59,  3.23it/s]
 93%|█████████▎| 345677/371472 [5:20:18<2:07:04,  3.38it/s]
 93%|█████████▎| 345678/371472 [5:20:18<2:05:11,  3.43it/s]
 93%|█████████▎| 345679/371472 [5:20:18<2:00:14,  3.58it/s]
 93%|█████████▎| 345680/371472 [5:20:19<1:57:00,  3.67it/s]
                                                           
{'loss': 2.7503, 'learning_rate': 1.625223555775819e-07, 'epoch': 14.89}

 93%|█████████▎| 345680/371472 [5:20:19<1:57:00,  3.67it/s]
 93%|█████████▎| 345681/371472 [5:20:19<2:00:32,  3.57it/s]
 93%|█████████▎| 345682/371472 [5:20:19<2:04:38,  3.45it/s]
 93%|█████████▎| 345683/371472 [5:20:20<2:06:49,  3.39it/s]
 93%|█████████▎| 345684/371472 [5:20:20<2:08:28,  3.35it/s]
 93%|█████████▎| 345685/371472 [5:20:20<2:01:50,  3.53it/s]
 93%|█████████▎| 345686/371472 [5:20:20<1:56:45,  3.68it/s]
 93%|█████████▎| 345687/371472 [5:20:21<1:52:38,  3.81it/s]
 93%|█████████▎| 345688/371472 [5:20:21<1:55:10,  3.73it/s]
 93%|█████████▎| 345689/371472 [5:20:21<1:56:20,  3.69it/s]
 93%|█████████▎| 345690/371472 [5:20:21<1:58:57,  3.61it/s]
 93%|█████████▎| 345691/371472 [5:20:22<1:57:12,  3.67it/s]
 93%|█████████▎| 345692/371472 [5:20:22<1:59:34,  3.59it/s]
 93%|█████████▎| 345693/371472 [5:20:22<1:56:43,  3.68it/s]
 93%|█████████▎| 345694/371472 [5:20:22<1:55:36,  3.72it/s]
 93%|█████████▎| 345695/371472 [5:20:23<2:03:44,  3.47it/s]
 93%|█████████▎| 345696/371472 [5:20:23<2:04:15,  3.46it/s]
 93%|█████████▎| 345697/371472 [5:20:23<2:06:27,  3.40it/s]
 93%|█████████▎| 345698/371472 [5:20:24<2:02:57,  3.49it/s]
 93%|█████████▎| 345699/371472 [5:20:24<2:11:04,  3.28it/s]
 93%|█████████▎| 345700/371472 [5:20:24<2:04:12,  3.46it/s]
                                                           
{'loss': 2.5931, 'learning_rate': 1.6247387360210307e-07, 'epoch': 14.89}

 93%|█████████▎| 345700/371472 [5:20:24<2:04:12,  3.46it/s]
 93%|█████████▎| 345701/371472 [5:20:25<2:23:20,  3.00it/s]
 93%|█████████▎| 345702/371472 [5:20:25<2:21:38,  3.03it/s]
 93%|█████████▎| 345703/371472 [5:20:25<2:17:29,  3.12it/s]
 93%|█████████▎| 345704/371472 [5:20:26<2:11:08,  3.27it/s]
 93%|█████████▎| 345705/371472 [5:20:26<2:06:18,  3.40it/s]
 93%|█████████▎| 345706/371472 [5:20:26<2:09:42,  3.31it/s]
 93%|█████████▎| 345707/371472 [5:20:26<2:03:29,  3.48it/s]
 93%|█████████▎| 345708/371472 [5:20:27<2:00:49,  3.55it/s]
 93%|█████████▎| 345709/371472 [5:20:27<2:06:21,  3.40it/s]
 93%|█████████▎| 345710/371472 [5:20:27<2:07:56,  3.36it/s]
 93%|█████████▎| 345711/371472 [5:20:28<2:02:01,  3.52it/s]
 93%|█████████▎| 345712/371472 [5:20:28<2:06:14,  3.40it/s]
 93%|█████████▎| 345713/371472 [5:20:28<2:07:34,  3.36it/s]
 93%|█████████▎| 345714/371472 [5:20:28<2:00:09,  3.57it/s]
 93%|█████████▎| 345715/371472 [5:20:29<1:55:37,  3.71it/s]
 93%|█████████▎| 345716/371472 [5:20:29<1:56:24,  3.69it/s]
 93%|█████████▎| 345717/371472 [5:20:29<1:58:29,  3.62it/s]
 93%|█████████▎| 345718/371472 [5:20:30<1:58:44,  3.61it/s]
 93%|█████████▎| 345719/371472 [5:20:30<1:59:00,  3.61it/s]
 93%|█████████▎| 345720/371472 [5:20:30<2:01:29,  3.53it/s]
                                                           
{'loss': 2.7622, 'learning_rate': 1.624253916266241e-07, 'epoch': 14.89}

 93%|█████████▎| 345720/371472 [5:20:30<2:01:29,  3.53it/s]
 93%|█████████▎| 345721/371472 [5:20:30<2:07:12,  3.37it/s]
 93%|█████████▎| 345722/371472 [5:20:31<2:04:02,  3.46it/s]
 93%|█████████▎| 345723/371472 [5:20:31<2:02:46,  3.50it/s]
 93%|█████████▎| 345724/371472 [5:20:31<2:00:05,  3.57it/s]
 93%|█████████▎| 345725/371472 [5:20:32<2:07:57,  3.35it/s]
 93%|█████████▎| 345726/371472 [5:20:32<2:01:49,  3.52it/s]
 93%|█████████▎| 345727/371472 [5:20:32<2:04:53,  3.44it/s]
 93%|█████████▎| 345728/371472 [5:20:32<2:10:08,  3.30it/s]
 93%|█████████▎| 345729/371472 [5:20:33<2:18:24,  3.10it/s]
 93%|█████████▎| 345730/371472 [5:20:33<2:14:28,  3.19it/s]
 93%|█████████▎| 345731/371472 [5:20:33<2:08:17,  3.34it/s]
 93%|█████████▎| 345732/371472 [5:20:34<2:15:54,  3.16it/s]
 93%|█████████▎| 345733/371472 [5:20:34<2:08:56,  3.33it/s]
 93%|█████████▎| 345734/371472 [5:20:34<2:04:36,  3.44it/s]
 93%|█████████▎| 345735/371472 [5:20:35<2:01:40,  3.53it/s]
 93%|█████████▎| 345736/371472 [5:20:35<2:01:26,  3.53it/s]
 93%|█████████▎| 345737/371472 [5:20:35<2:00:28,  3.56it/s]
 93%|█████████▎| 345738/371472 [5:20:35<1:56:55,  3.67it/s]
 93%|█████████▎| 345739/371472 [5:20:36<2:00:09,  3.57it/s]
 93%|█████████▎| 345740/371472 [5:20:36<2:05:01,  3.43it/s]
                                                           
{'loss': 2.5193, 'learning_rate': 1.6237690965114526e-07, 'epoch': 14.89}

 93%|█████████▎| 345740/371472 [5:20:36<2:05:01,  3.43it/s]
 93%|█████████▎| 345741/371472 [5:20:36<2:11:18,  3.27it/s]
 93%|█████████▎| 345742/371472 [5:20:37<2:10:16,  3.29it/s]
 93%|█████████▎| 345743/371472 [5:20:37<2:06:23,  3.39it/s]
 93%|█████████▎| 345744/371472 [5:20:37<2:10:54,  3.28it/s]
 93%|█████████▎| 345745/371472 [5:20:37<2:04:59,  3.43it/s]
 93%|█████████▎| 345746/371472 [5:20:38<2:01:54,  3.52it/s]
 93%|█████████▎| 345747/371472 [5:20:38<1:57:50,  3.64it/s]
 93%|█████████▎| 345748/371472 [5:20:38<1:57:36,  3.65it/s]
 93%|█████████▎| 345749/371472 [5:20:39<1:54:22,  3.75it/s]
 93%|█████████▎| 345750/371472 [5:20:39<1:58:42,  3.61it/s]
 93%|█████████▎| 345751/371472 [5:20:39<1:56:50,  3.67it/s]
 93%|█████████▎| 345752/371472 [5:20:39<1:56:19,  3.68it/s]
 93%|█████████▎| 345753/371472 [5:20:40<1:54:39,  3.74it/s]
 93%|█████████▎| 345754/371472 [5:20:40<2:03:26,  3.47it/s]
 93%|█████████▎| 345755/371472 [5:20:40<1:58:16,  3.62it/s]
 93%|█████████▎| 345756/371472 [5:20:41<2:06:26,  3.39it/s]
 93%|█████████▎| 345757/371472 [5:20:41<2:03:18,  3.48it/s]
 93%|█████████▎| 345758/371472 [5:20:41<2:02:19,  3.50it/s]
 93%|█████████▎| 345759/371472 [5:20:41<2:03:49,  3.46it/s]
 93%|█████████▎| 345760/371472 [5:20:42<1:58:32,  3.62it/s]
                                                           
{'loss': 2.612, 'learning_rate': 1.6232842767566633e-07, 'epoch': 14.89}

 93%|█████████▎| 345760/371472 [5:20:42<1:58:32,  3.62it/s]
 93%|█████████▎| 345761/371472 [5:20:42<2:00:28,  3.56it/s]
 93%|█████████▎| 345762/371472 [5:20:42<1:59:04,  3.60it/s]
 93%|█████████▎| 345763/371472 [5:20:43<2:03:56,  3.46it/s]
 93%|█████████▎| 345764/371472 [5:20:43<2:01:14,  3.53it/s]
 93%|█████████▎| 345765/371472 [5:20:43<1:58:03,  3.63it/s]
 93%|█████████▎| 345766/371472 [5:20:43<2:06:13,  3.39it/s]
 93%|█████████▎| 345767/371472 [5:20:44<2:10:12,  3.29it/s]
 93%|█████████▎| 345768/371472 [5:20:44<2:03:55,  3.46it/s]
 93%|█████████▎| 345769/371472 [5:20:44<2:20:35,  3.05it/s]
 93%|█████████▎| 345770/371472 [5:20:45<2:11:43,  3.25it/s]
 93%|█████████▎| 345771/371472 [5:20:45<2:10:26,  3.28it/s]
 93%|█████████▎| 345772/371472 [5:20:45<2:08:38,  3.33it/s]
 93%|█████████▎| 345773/371472 [5:20:45<2:03:43,  3.46it/s]
 93%|█████████▎| 345774/371472 [5:20:46<2:02:13,  3.50it/s]
 93%|█████████▎| 345775/371472 [5:20:46<2:02:23,  3.50it/s]
 93%|█████████▎| 345776/371472 [5:20:46<2:12:25,  3.23it/s]
 93%|█████████▎| 345777/371472 [5:20:47<2:12:58,  3.22it/s]
 93%|█████████▎| 345778/371472 [5:20:47<2:08:23,  3.34it/s]
 93%|█████████▎| 345779/371472 [5:20:47<2:09:51,  3.30it/s]
 93%|█████████▎| 345780/371472 [5:20:48<2:11:29,  3.26it/s]
                                                           
{'loss': 2.4931, 'learning_rate': 1.6227994570018748e-07, 'epoch': 14.89}

 93%|█████████▎| 345780/371472 [5:20:48<2:11:29,  3.26it/s]
 93%|█████████▎| 345781/371472 [5:20:48<2:14:43,  3.18it/s]
 93%|█████████▎| 345782/371472 [5:20:48<2:22:16,  3.01it/s]
 93%|█████████▎| 345783/371472 [5:20:49<2:13:13,  3.21it/s]
 93%|█████████▎| 345784/371472 [5:20:49<2:07:27,  3.36it/s]
 93%|█████████▎| 345785/371472 [5:20:49<2:09:22,  3.31it/s]
 93%|█████████▎| 345786/371472 [5:20:50<2:11:27,  3.26it/s]
 93%|█████████▎| 345787/371472 [5:20:50<2:08:20,  3.34it/s]
 93%|█████████▎| 345788/371472 [5:20:50<2:05:37,  3.41it/s]
 93%|█████████▎| 345789/371472 [5:20:50<2:20:50,  3.04it/s]
 93%|█████████▎| 345790/371472 [5:20:51<2:27:45,  2.90it/s]
 93%|█████████▎| 345791/371472 [5:20:51<2:17:19,  3.12it/s]
 93%|█████████▎| 345792/371472 [5:20:51<2:19:19,  3.07it/s]
 93%|█████████▎| 345793/371472 [5:20:52<2:14:47,  3.18it/s]
 93%|█████████▎| 345794/371472 [5:20:52<2:09:27,  3.31it/s]
 93%|█████████▎| 345795/371472 [5:20:52<2:04:20,  3.44it/s]
 93%|█████████▎| 345796/371472 [5:20:53<2:09:12,  3.31it/s]
 93%|█████████▎| 345797/371472 [5:20:53<2:04:28,  3.44it/s]
 93%|█████████▎| 345798/371472 [5:20:53<2:00:11,  3.56it/s]
 93%|█████████▎| 345799/371472 [5:20:54<2:13:06,  3.21it/s]
 93%|█████████▎| 345800/371472 [5:20:54<2:07:31,  3.36it/s]
                                                           
{'loss': 2.4328, 'learning_rate': 1.6223146372470853e-07, 'epoch': 14.89}

 93%|█████████▎| 345800/371472 [5:20:54<2:07:31,  3.36it/s]
 93%|█████████▎| 345801/371472 [5:20:54<2:01:26,  3.52it/s]
 93%|█████████▎| 345802/371472 [5:20:54<1:59:18,  3.59it/s]
 93%|█████████▎| 345803/371472 [5:20:55<2:08:26,  3.33it/s]
 93%|█████████▎| 345804/371472 [5:20:55<2:03:06,  3.47it/s]
 93%|█████████▎| 345805/371472 [5:20:55<2:02:46,  3.48it/s]
 93%|█████████▎| 345806/371472 [5:20:55<2:04:36,  3.43it/s]
 93%|█████████▎| 345807/371472 [5:20:56<2:02:11,  3.50it/s]
 93%|█████████▎| 345808/371472 [5:20:56<2:01:03,  3.53it/s]
 93%|█████████▎| 345809/371472 [5:20:56<2:02:49,  3.48it/s]
 93%|█████████▎| 345810/371472 [5:20:57<2:01:21,  3.52it/s]
 93%|█████████▎| 345811/371472 [5:20:57<2:03:39,  3.46it/s]
 93%|█████████▎| 345812/371472 [5:20:57<2:06:38,  3.38it/s]
 93%|█████████▎| 345813/371472 [5:20:57<2:00:40,  3.54it/s]
 93%|█████████▎| 345814/371472 [5:20:58<2:04:29,  3.43it/s]
 93%|█████████▎| 345815/371472 [5:20:58<2:03:00,  3.48it/s]
 93%|█████████▎| 345816/371472 [5:20:58<2:04:16,  3.44it/s]
 93%|█████████▎| 345817/371472 [5:20:59<2:04:15,  3.44it/s]
 93%|█████████▎| 345818/371472 [5:20:59<2:06:42,  3.37it/s]
 93%|█████████▎| 345819/371472 [5:20:59<2:02:52,  3.48it/s]
 93%|█████████▎| 345820/371472 [5:21:00<2:02:54,  3.48it/s]
                                                           
{'loss': 2.5436, 'learning_rate': 1.621829817492297e-07, 'epoch': 14.9}

 93%|█████████▎| 345820/371472 [5:21:00<2:02:54,  3.48it/s]
 93%|█████████▎| 345821/371472 [5:21:00<2:03:33,  3.46it/s]
 93%|█████████▎| 345822/371472 [5:21:00<2:05:49,  3.40it/s]
 93%|█████████▎| 345823/371472 [5:21:00<2:03:56,  3.45it/s]
 93%|█████████▎| 345824/371472 [5:21:01<2:05:34,  3.40it/s]
 93%|█████████▎| 345825/371472 [5:21:01<2:07:27,  3.35it/s]
 93%|█████████▎| 345826/371472 [5:21:01<2:02:28,  3.49it/s]
 93%|█████████▎| 345827/371472 [5:21:02<2:03:53,  3.45it/s]
 93%|█████████▎| 345828/371472 [5:21:02<1:59:17,  3.58it/s]
 93%|█████████▎| 345829/371472 [5:21:02<2:13:18,  3.21it/s]
 93%|█████████▎| 345830/371472 [5:21:02<2:08:49,  3.32it/s]
 93%|█████████▎| 345831/371472 [5:21:03<2:07:26,  3.35it/s]
 93%|█████████▎| 345832/371472 [5:21:03<2:06:20,  3.38it/s]
 93%|█████████▎| 345833/371472 [5:21:03<2:06:31,  3.38it/s]
 93%|█████████▎| 345834/371472 [5:21:04<2:09:47,  3.29it/s]
 93%|█████████▎| 345835/371472 [5:21:04<2:05:11,  3.41it/s]
 93%|█████████▎| 345836/371472 [5:21:04<2:00:20,  3.55it/s]
 93%|█████████▎| 345837/371472 [5:21:04<1:58:50,  3.60it/s]
 93%|█████████▎| 345838/371472 [5:21:05<1:57:48,  3.63it/s]
 93%|█████████▎| 345839/371472 [5:21:05<2:00:41,  3.54it/s]
 93%|█████████▎| 345840/371472 [5:21:05<1:59:21,  3.58it/s]
                                                           
{'loss': 2.5189, 'learning_rate': 1.6213449977375073e-07, 'epoch': 14.9}

 93%|█████████▎| 345840/371472 [5:21:05<1:59:21,  3.58it/s]
 93%|█████████▎| 345841/371472 [5:21:06<2:00:43,  3.54it/s]
 93%|█████████▎| 345842/371472 [5:21:06<1:59:34,  3.57it/s]
 93%|█████████▎| 345843/371472 [5:21:06<2:02:46,  3.48it/s]
 93%|█████████▎| 345844/371472 [5:21:06<2:00:33,  3.54it/s]
 93%|█████████▎| 345845/371472 [5:21:07<2:05:06,  3.41it/s]
 93%|█████████▎| 345846/371472 [5:21:07<2:14:46,  3.17it/s]
 93%|█████████▎| 345847/371472 [5:21:07<2:12:20,  3.23it/s]
 93%|█████████▎| 345848/371472 [5:21:08<2:03:48,  3.45it/s]
 93%|█████████▎| 345849/371472 [5:21:08<2:02:46,  3.48it/s]
 93%|█████████▎| 345850/371472 [5:21:08<2:00:52,  3.53it/s]
 93%|█████████▎| 345851/371472 [5:21:09<1:57:24,  3.64it/s]
 93%|█████████▎| 345852/371472 [5:21:09<1:58:55,  3.59it/s]
 93%|█████████▎| 345853/371472 [5:21:09<2:00:50,  3.53it/s]
 93%|█████████▎| 345854/371472 [5:21:09<2:16:14,  3.13it/s]
 93%|█████████▎| 345855/371472 [5:21:10<2:10:20,  3.28it/s]
 93%|█████████▎| 345856/371472 [5:21:10<2:03:38,  3.45it/s]
 93%|█████████▎| 345857/371472 [5:21:10<2:08:58,  3.31it/s]
 93%|█████████▎| 345858/371472 [5:21:11<2:12:32,  3.22it/s]
 93%|█████████▎| 345859/371472 [5:21:11<2:07:41,  3.34it/s]
 93%|█████████▎| 345860/371472 [5:21:11<2:01:56,  3.50it/s]
                                                           
{'loss': 2.5495, 'learning_rate': 1.620860177982719e-07, 'epoch': 14.9}

 93%|█████████▎| 345860/371472 [5:21:11<2:01:56,  3.50it/s]
 93%|█████████▎| 345861/371472 [5:21:11<1:58:40,  3.60it/s]
 93%|█████████▎| 345862/371472 [5:21:12<2:03:18,  3.46it/s]
 93%|█████████▎| 345863/371472 [5:21:12<1:58:56,  3.59it/s]
 93%|█████████▎| 345864/371472 [5:21:12<2:03:38,  3.45it/s]
 93%|█████████▎| 345865/371472 [5:21:13<1:59:19,  3.58it/s]
 93%|█████████▎| 345866/371472 [5:21:13<1:55:53,  3.68it/s]
 93%|█████████▎| 345867/371472 [5:21:13<2:00:43,  3.53it/s]
 93%|█████████▎| 345868/371472 [5:21:13<2:04:39,  3.42it/s]
 93%|█████████▎| 345869/371472 [5:21:14<2:05:18,  3.41it/s]
 93%|█████████▎| 345870/371472 [5:21:14<1:58:24,  3.60it/s]
 93%|█████████▎| 345871/371472 [5:21:14<2:00:17,  3.55it/s]
 93%|█████████▎| 345872/371472 [5:21:15<1:59:01,  3.58it/s]
 93%|█████████▎| 345873/371472 [5:21:15<2:03:48,  3.45it/s]
 93%|█████████▎| 345874/371472 [5:21:15<2:04:52,  3.42it/s]
 93%|█████████▎| 345875/371472 [5:21:15<2:04:56,  3.41it/s]
 93%|█████████▎| 345876/371472 [5:21:16<2:07:48,  3.34it/s]
 93%|█████████▎| 345877/371472 [5:21:16<2:02:29,  3.48it/s]
 93%|█████████▎| 345878/371472 [5:21:16<2:04:28,  3.43it/s]
 93%|█████████▎| 345879/371472 [5:21:17<2:00:57,  3.53it/s]
 93%|█████████▎| 345880/371472 [5:21:17<2:01:31,  3.51it/s]
                                                           
{'loss': 2.6103, 'learning_rate': 1.6203753582279297e-07, 'epoch': 14.9}

 93%|█████████▎| 345880/371472 [5:21:17<2:01:31,  3.51it/s]
 93%|█████████▎| 345881/371472 [5:21:17<2:04:40,  3.42it/s]
 93%|█████████▎| 345882/371472 [5:21:18<2:05:02,  3.41it/s]
 93%|█████████▎| 345883/371472 [5:21:18<2:00:06,  3.55it/s]
 93%|█████████▎| 345884/371472 [5:21:18<2:05:34,  3.40it/s]
 93%|█████████▎| 345885/371472 [5:21:18<2:07:16,  3.35it/s]
 93%|█████████▎| 345886/371472 [5:21:19<2:00:08,  3.55it/s]
 93%|█████████▎| 345887/371472 [5:21:19<1:59:13,  3.58it/s]
 93%|█████████▎| 345888/371472 [5:21:19<2:00:33,  3.54it/s]
 93%|█████████▎| 345889/371472 [5:21:20<2:24:55,  2.94it/s]
 93%|█████████▎| 345890/371472 [5:21:20<2:15:53,  3.14it/s]
 93%|█████████▎| 345891/371472 [5:21:20<2:07:41,  3.34it/s]
 93%|█████████▎| 345892/371472 [5:21:20<2:03:50,  3.44it/s]
 93%|█████████▎| 345893/371472 [5:21:21<2:07:41,  3.34it/s]
 93%|█████████▎| 345894/371472 [5:21:21<2:03:35,  3.45it/s]
 93%|█████████▎| 345895/371472 [5:21:21<2:04:14,  3.43it/s]
 93%|█████████▎| 345896/371472 [5:21:22<2:05:43,  3.39it/s]
 93%|█████████▎| 345897/371472 [5:21:22<1:59:49,  3.56it/s]
 93%|█████████▎| 345898/371472 [5:21:22<2:00:16,  3.54it/s]
 93%|█████████▎| 345899/371472 [5:21:23<2:09:22,  3.29it/s]
 93%|█████████▎| 345900/371472 [5:21:23<2:03:27,  3.45it/s]
                                                           
{'loss': 2.5796, 'learning_rate': 1.6198905384731413e-07, 'epoch': 14.9}

 93%|█████████▎| 345900/371472 [5:21:23<2:03:27,  3.45it/s]
 93%|█████████▎| 345901/371472 [5:21:23<1:59:38,  3.56it/s]
 93%|█████████▎| 345902/371472 [5:21:23<2:05:01,  3.41it/s]
 93%|█████████▎| 345903/371472 [5:21:24<2:00:30,  3.54it/s]
 93%|█████████▎| 345904/371472 [5:21:24<1:58:42,  3.59it/s]
 93%|█████████▎| 345905/371472 [5:21:24<2:05:01,  3.41it/s]
 93%|█████████▎| 345906/371472 [5:21:25<2:00:46,  3.53it/s]
 93%|█████████▎| 345907/371472 [5:21:25<2:01:09,  3.52it/s]
 93%|█████████▎| 345908/371472 [5:21:25<2:09:32,  3.29it/s]
 93%|█████████▎| 345909/371472 [5:21:25<2:06:16,  3.37it/s]
 93%|█████████▎| 345910/371472 [5:21:26<2:03:00,  3.46it/s]
 93%|█████████▎| 345911/371472 [5:21:26<2:02:41,  3.47it/s]
 93%|█████████▎| 345912/371472 [5:21:26<2:03:57,  3.44it/s]
 93%|█████████▎| 345913/371472 [5:21:27<2:02:03,  3.49it/s]
 93%|█████████▎| 345914/371472 [5:21:27<2:11:27,  3.24it/s]
 93%|█████████▎| 345915/371472 [5:21:27<2:05:49,  3.39it/s]
 93%|█████████▎| 345916/371472 [5:21:27<2:02:22,  3.48it/s]
 93%|█████████▎| 345917/371472 [5:21:28<1:59:07,  3.58it/s]
 93%|█████████▎| 345918/371472 [5:21:28<1:56:42,  3.65it/s]
 93%|█████████▎| 345919/371472 [5:21:28<1:55:38,  3.68it/s]
 93%|█████████▎| 345920/371472 [5:21:29<2:02:38,  3.47it/s]
                                                           
{'loss': 2.6702, 'learning_rate': 1.6194057187183517e-07, 'epoch': 14.9}

 93%|█████████▎| 345920/371472 [5:21:29<2:02:38,  3.47it/s]
 93%|█████████▎| 345921/371472 [5:21:29<1:59:24,  3.57it/s]
 93%|█████████▎| 345922/371472 [5:21:29<1:59:30,  3.56it/s]
 93%|█████████▎| 345923/371472 [5:21:29<2:01:53,  3.49it/s]
 93%|█████████▎| 345924/371472 [5:21:30<2:05:12,  3.40it/s]
 93%|█████████▎| 345925/371472 [5:21:30<1:59:28,  3.56it/s]
 93%|█████████▎| 345926/371472 [5:21:30<2:00:04,  3.55it/s]
 93%|█████████▎| 345927/371472 [5:21:31<1:58:43,  3.59it/s]
 93%|█████████▎| 345928/371472 [5:21:31<1:58:18,  3.60it/s]
 93%|█████████▎| 345929/371472 [5:21:31<2:09:05,  3.30it/s]
 93%|█████████▎| 345930/371472 [5:21:32<2:20:48,  3.02it/s]
 93%|█████████▎| 345931/371472 [5:21:32<2:11:12,  3.24it/s]
 93%|█████████▎| 345932/371472 [5:21:32<2:10:07,  3.27it/s]
 93%|█████████▎| 345933/371472 [5:21:32<2:07:48,  3.33it/s]
 93%|█████████▎| 345934/371472 [5:21:33<2:21:42,  3.00it/s]
 93%|█████████▎| 345935/371472 [5:21:33<2:11:35,  3.23it/s]
 93%|█████████▎| 345936/371472 [5:21:33<2:06:47,  3.36it/s]
 93%|█████████▎| 345937/371472 [5:21:34<2:09:31,  3.29it/s]
 93%|█████████▎| 345938/371472 [5:21:34<2:07:02,  3.35it/s]
 93%|█████████▎| 345939/371472 [5:21:34<2:02:28,  3.47it/s]
 93%|█████████▎| 345940/371472 [5:21:34<2:03:34,  3.44it/s]
                                                           
{'loss': 2.4787, 'learning_rate': 1.6189208989635635e-07, 'epoch': 14.9}

 93%|█████████▎| 345940/371472 [5:21:35<2:03:34,  3.44it/s]
 93%|█████████▎| 345941/371472 [5:21:35<1:59:03,  3.57it/s]
 93%|█████████▎| 345942/371472 [5:21:35<2:01:43,  3.50it/s]
 93%|█████████▎| 345943/371472 [5:21:35<1:56:07,  3.66it/s]
 93%|█████████▎| 345944/371472 [5:21:36<2:02:06,  3.48it/s]
 93%|█████████▎| 345945/371472 [5:21:36<2:10:19,  3.26it/s]
 93%|█████████▎| 345946/371472 [5:21:36<2:12:48,  3.20it/s]
 93%|█████████▎| 345947/371472 [5:21:37<2:11:15,  3.24it/s]
 93%|█████████▎| 345948/371472 [5:21:37<2:11:12,  3.24it/s]
 93%|█████████▎| 345949/371472 [5:21:37<2:13:06,  3.20it/s]
 93%|█████████▎| 345950/371472 [5:21:37<2:05:17,  3.40it/s]
 93%|█████████▎| 345951/371472 [5:21:38<2:06:19,  3.37it/s]
 93%|█████████▎| 345952/371472 [5:21:38<2:03:00,  3.46it/s]
 93%|█████████▎| 345953/371472 [5:21:38<1:59:25,  3.56it/s]
 93%|█████████▎| 345954/371472 [5:21:39<1:55:01,  3.70it/s]
 93%|█████████▎| 345955/371472 [5:21:39<1:52:18,  3.79it/s]
 93%|█████████▎| 345956/371472 [5:21:39<1:54:55,  3.70it/s]
 93%|█████████▎| 345957/371472 [5:21:39<1:52:49,  3.77it/s]
 93%|█████████▎| 345958/371472 [5:21:40<1:54:04,  3.73it/s]
 93%|█████████▎| 345959/371472 [5:21:40<1:52:09,  3.79it/s]
 93%|█████████▎| 345960/371472 [5:21:40<1:51:57,  3.80it/s]
                                                           
{'loss': 2.6578, 'learning_rate': 1.6184360792087742e-07, 'epoch': 14.9}

 93%|█████████▎| 345960/371472 [5:21:40<1:51:57,  3.80it/s]
 93%|█████████▎| 345961/371472 [5:21:40<1:53:14,  3.75it/s]
 93%|█████████▎| 345962/371472 [5:21:41<2:02:56,  3.46it/s]
 93%|█████████▎| 345963/371472 [5:21:41<1:59:00,  3.57it/s]
 93%|█████████▎| 345964/371472 [5:21:41<1:55:00,  3.70it/s]
 93%|█████████▎| 345965/371472 [5:21:42<2:05:00,  3.40it/s]
 93%|█████████▎| 345966/371472 [5:21:42<1:59:53,  3.55it/s]
 93%|█████████▎| 345967/371472 [5:21:42<1:56:41,  3.64it/s]
 93%|█████████▎| 345968/371472 [5:21:42<1:54:19,  3.72it/s]
 93%|█████████▎| 345969/371472 [5:21:43<2:00:32,  3.53it/s]
 93%|█████████▎| 345970/371472 [5:21:43<2:01:06,  3.51it/s]
 93%|█████████▎| 345971/371472 [5:21:43<1:57:18,  3.62it/s]
 93%|█████████▎| 345972/371472 [5:21:44<2:03:04,  3.45it/s]
 93%|█████████▎| 345973/371472 [5:21:44<2:00:05,  3.54it/s]
 93%|█████████▎| 345974/371472 [5:21:44<1:56:16,  3.66it/s]
 93%|█████████▎| 345975/371472 [5:21:44<1:54:41,  3.70it/s]
 93%|█████████▎| 345976/371472 [5:21:45<1:53:15,  3.75it/s]
 93%|█████████▎| 345977/371472 [5:21:45<1:52:27,  3.78it/s]
 93%|█████████▎| 345978/371472 [5:21:45<2:01:06,  3.51it/s]
 93%|█████████▎| 345979/371472 [5:21:45<2:04:00,  3.43it/s]
 93%|█████████▎| 345980/371472 [5:21:46<2:03:22,  3.44it/s]
                                                           
{'loss': 2.4406, 'learning_rate': 1.6179512594539854e-07, 'epoch': 14.9}

 93%|█████████▎| 345980/371472 [5:21:46<2:03:22,  3.44it/s]
 93%|█████████▎| 345981/371472 [5:21:46<2:13:20,  3.19it/s]
 93%|█████████▎| 345982/371472 [5:21:46<2:07:42,  3.33it/s]
 93%|█████████▎| 345983/371472 [5:21:47<2:08:23,  3.31it/s]
 93%|█████████▎| 345984/371472 [5:21:47<2:01:02,  3.51it/s]
 93%|█████████▎| 345985/371472 [5:21:47<1:58:09,  3.60it/s]
 93%|█████████▎| 345986/371472 [5:21:48<1:57:38,  3.61it/s]
 93%|█████████▎| 345987/371472 [5:21:48<1:53:54,  3.73it/s]
 93%|█████████▎| 345988/371472 [5:21:48<1:56:49,  3.64it/s]
 93%|█████████▎| 345989/371472 [5:21:48<2:00:20,  3.53it/s]
 93%|█████████▎| 345990/371472 [5:21:49<2:03:25,  3.44it/s]
 93%|█████████▎| 345991/371472 [5:21:49<2:21:19,  3.01it/s]
 93%|█████████▎| 345992/371472 [5:21:49<2:16:48,  3.10it/s]
 93%|█████████▎| 345993/371472 [5:21:50<2:10:41,  3.25it/s]
 93%|█████████▎| 345994/371472 [5:21:50<2:03:37,  3.43it/s]
 93%|█████████▎| 345995/371472 [5:21:50<2:01:08,  3.51it/s]
 93%|█████████▎| 345996/371472 [5:21:50<1:59:41,  3.55it/s]
 93%|█████████▎| 345997/371472 [5:21:51<2:03:25,  3.44it/s]
 93%|█████████▎| 345998/371472 [5:21:51<2:12:36,  3.20it/s]
 93%|█████████▎| 345999/371472 [5:21:51<2:19:10,  3.05it/s]
 93%|█████████▎| 346000/371472 [5:21:52<2:15:19,  3.14it/s]
                                                           
{'loss': 2.5371, 'learning_rate': 1.6174664396991961e-07, 'epoch': 14.9}

 93%|█████████▎| 346000/371472 [5:21:52<2:15:19,  3.14it/s]
 93%|█████████▎| 346001/371472 [5:21:52<2:14:54,  3.15it/s]
 93%|█████████▎| 346002/371472 [5:21:52<2:13:02,  3.19it/s]
 93%|█████████▎| 346003/371472 [5:21:53<2:11:32,  3.23it/s]
 93%|█████████▎| 346004/371472 [5:21:53<2:13:54,  3.17it/s]
 93%|█████████▎| 346005/371472 [5:21:53<2:12:42,  3.20it/s]
 93%|█████████▎| 346006/371472 [5:21:54<2:06:06,  3.37it/s]
 93%|█████████▎| 346007/371472 [5:21:54<2:14:16,  3.16it/s]
 93%|█████████▎| 346008/371472 [5:21:54<2:07:42,  3.32it/s]
 93%|█████████▎| 346009/371472 [5:21:55<2:08:54,  3.29it/s]
 93%|█████████▎| 346010/371472 [5:21:55<2:03:55,  3.42it/s]
 93%|█████████▎| 346011/371472 [5:21:55<2:01:30,  3.49it/s]
 93%|█████████▎| 346012/371472 [5:21:55<1:58:55,  3.57it/s]
 93%|█████████▎| 346013/371472 [5:21:56<1:58:48,  3.57it/s]
 93%|█████████▎| 346014/371472 [5:21:56<2:00:13,  3.53it/s]
 93%|█████████▎| 346015/371472 [5:21:56<1:59:50,  3.54it/s]
 93%|█████████▎| 346016/371472 [5:21:56<1:57:41,  3.61it/s]
 93%|█████████▎| 346017/371472 [5:21:57<1:55:28,  3.67it/s]
 93%|█████████▎| 346018/371472 [5:21:57<1:56:21,  3.65it/s]
 93%|█████████▎| 346019/371472 [5:21:57<2:12:25,  3.20it/s]
 93%|█████████▎| 346020/371472 [5:21:58<2:11:54,  3.22it/s]
                                                           
{'loss': 2.6566, 'learning_rate': 1.616981619944408e-07, 'epoch': 14.9}

 93%|█████████▎| 346020/371472 [5:21:58<2:11:54,  3.22it/s]
 93%|█████████▎| 346021/371472 [5:21:58<2:11:08,  3.23it/s]
 93%|█████████▎| 346022/371472 [5:21:58<2:04:07,  3.42it/s]
 93%|█████████▎| 346023/371472 [5:21:59<2:00:36,  3.52it/s]
 93%|█████████▎| 346024/371472 [5:21:59<1:58:37,  3.58it/s]
 93%|█████████▎| 346025/371472 [5:21:59<1:56:51,  3.63it/s]
 93%|█████████▎| 346026/371472 [5:21:59<1:53:36,  3.73it/s]
 93%|█████████▎| 346027/371472 [5:22:00<1:53:07,  3.75it/s]
 93%|█████████▎| 346028/371472 [5:22:00<1:49:25,  3.88it/s]
 93%|█████████▎| 346029/371472 [5:22:00<1:57:45,  3.60it/s]
 93%|█████████▎| 346030/371472 [5:22:00<2:01:18,  3.50it/s]
 93%|█████████▎| 346031/371472 [5:22:01<2:00:40,  3.51it/s]
 93%|█████████▎| 346032/371472 [5:22:01<1:56:51,  3.63it/s]
 93%|█████████▎| 346033/371472 [5:22:01<1:56:25,  3.64it/s]
 93%|█████████▎| 346034/371472 [5:22:02<2:01:31,  3.49it/s]
 93%|█████████▎| 346035/371472 [5:22:02<1:59:12,  3.56it/s]
 93%|█████████▎| 346036/371472 [5:22:02<2:02:45,  3.45it/s]
 93%|█████████▎| 346037/371472 [5:22:02<2:00:30,  3.52it/s]
 93%|█████████▎| 346038/371472 [5:22:03<2:04:27,  3.41it/s]
 93%|█████████▎| 346039/371472 [5:22:03<2:10:01,  3.26it/s]
 93%|█████████▎| 346040/371472 [5:22:03<2:05:42,  3.37it/s]
                                                           
{'loss': 2.7222, 'learning_rate': 1.6164968001896184e-07, 'epoch': 14.9}

 93%|█████████▎| 346040/371472 [5:22:03<2:05:42,  3.37it/s]
 93%|█████████▎| 346041/371472 [5:22:04<2:13:43,  3.17it/s]
 93%|█████████▎| 346042/371472 [5:22:04<2:28:50,  2.85it/s]
 93%|█████████▎| 346043/371472 [5:22:04<2:18:07,  3.07it/s]
 93%|█████████▎| 346044/371472 [5:22:05<2:09:09,  3.28it/s]
 93%|█████████▎| 346045/371472 [5:22:05<2:20:02,  3.03it/s]
 93%|█████████▎| 346046/371472 [5:22:05<2:13:26,  3.18it/s]
 93%|█████████▎| 346047/371472 [5:22:06<2:04:25,  3.41it/s]
 93%|█████████▎| 346048/371472 [5:22:06<2:00:53,  3.50it/s]
 93%|█████████▎| 346049/371472 [5:22:06<2:08:07,  3.31it/s]
 93%|█████████▎| 346050/371472 [5:22:06<2:07:26,  3.32it/s]
 93%|█████████▎| 346051/371472 [5:22:07<2:12:33,  3.20it/s]
 93%|█████████▎| 346052/371472 [5:22:07<2:09:03,  3.28it/s]
 93%|█████████▎| 346053/371472 [5:22:08<2:24:28,  2.93it/s]
 93%|█████████▎| 346054/371472 [5:22:08<2:13:41,  3.17it/s]
 93%|█████████▎| 346055/371472 [5:22:08<2:11:47,  3.21it/s]
 93%|█████████▎| 346056/371472 [5:22:08<2:10:14,  3.25it/s]
 93%|█████████▎| 346057/371472 [5:22:09<2:12:24,  3.20it/s]
 93%|█████████▎| 346058/371472 [5:22:09<2:17:02,  3.09it/s]
 93%|█████████▎| 346059/371472 [5:22:09<2:13:18,  3.18it/s]
 93%|█████████▎| 346060/371472 [5:22:10<2:05:34,  3.37it/s]
                                                           
{'loss': 2.4852, 'learning_rate': 1.6160119804348288e-07, 'epoch': 14.91}

 93%|█████████▎| 346060/371472 [5:22:10<2:05:34,  3.37it/s]
 93%|█████████▎| 346061/371472 [5:22:10<2:01:35,  3.48it/s]
 93%|█████████▎| 346062/371472 [5:22:10<2:04:00,  3.41it/s]
 93%|█████████▎| 346063/371472 [5:22:10<2:03:00,  3.44it/s]
 93%|█████████▎| 346064/371472 [5:22:11<2:05:47,  3.37it/s]
 93%|█████████▎| 346065/371472 [5:22:11<2:03:25,  3.43it/s]
 93%|█████████▎| 346066/371472 [5:22:11<2:05:49,  3.37it/s]
 93%|█████████▎| 346067/371472 [5:22:12<2:01:48,  3.48it/s]
 93%|█████████▎| 346068/371472 [5:22:12<2:05:03,  3.39it/s]
 93%|█████████▎| 346069/371472 [5:22:12<2:01:13,  3.49it/s]
 93%|█████████▎| 346070/371472 [5:22:13<2:01:59,  3.47it/s]
 93%|█████████▎| 346071/371472 [5:22:13<2:03:09,  3.44it/s]
 93%|█████████▎| 346072/371472 [5:22:13<2:02:44,  3.45it/s]
 93%|█████████▎| 346073/371472 [5:22:13<2:06:06,  3.36it/s]
 93%|█████████▎| 346074/371472 [5:22:14<2:11:40,  3.21it/s]
 93%|█████████▎| 346075/371472 [5:22:14<2:03:19,  3.43it/s]
 93%|█████████▎| 346076/371472 [5:22:14<1:57:09,  3.61it/s]
 93%|█████████▎| 346077/371472 [5:22:15<1:57:11,  3.61it/s]
 93%|█████████▎| 346078/371472 [5:22:15<1:54:36,  3.69it/s]
 93%|█████████▎| 346079/371472 [5:22:15<1:57:02,  3.62it/s]
 93%|█████████▎| 346080/371472 [5:22:15<1:56:17,  3.64it/s]
                                                           
{'loss': 2.5385, 'learning_rate': 1.6155271606800406e-07, 'epoch': 14.91}

 93%|█████████▎| 346080/371472 [5:22:15<1:56:17,  3.64it/s]
 93%|█████████▎| 346081/371472 [5:22:16<1:57:40,  3.60it/s]
 93%|█████████▎| 346082/371472 [5:22:16<1:59:10,  3.55it/s]
 93%|█████████▎| 346083/371472 [5:22:16<1:59:55,  3.53it/s]
 93%|█████████▎| 346084/371472 [5:22:16<1:58:27,  3.57it/s]
 93%|█████████▎| 346085/371472 [5:22:17<2:01:57,  3.47it/s]
 93%|█████████▎| 346086/371472 [5:22:17<2:05:12,  3.38it/s]
 93%|█████████▎| 346087/371472 [5:22:17<2:09:22,  3.27it/s]
 93%|█████████▎| 346088/371472 [5:22:18<2:05:39,  3.37it/s]
 93%|█████████▎| 346089/371472 [5:22:18<2:04:58,  3.39it/s]
 93%|█████████▎| 346090/371472 [5:22:18<2:00:47,  3.50it/s]
 93%|█████████▎| 346091/371472 [5:22:19<1:56:25,  3.63it/s]
 93%|█████████▎| 346092/371472 [5:22:19<1:50:59,  3.81it/s]
 93%|█████████▎| 346093/371472 [5:22:19<2:00:53,  3.50it/s]
 93%|█████████▎| 346094/371472 [5:22:19<2:01:49,  3.47it/s]
 93%|█████████▎| 346095/371472 [5:22:20<2:02:42,  3.45it/s]
 93%|█████████▎| 346096/371472 [5:22:20<1:56:04,  3.64it/s]
 93%|█████████▎| 346097/371472 [5:22:20<1:55:47,  3.65it/s]
 93%|█████████▎| 346098/371472 [5:22:20<1:56:29,  3.63it/s]
 93%|█████████▎| 346099/371472 [5:22:21<2:01:08,  3.49it/s]
 93%|█████████▎| 346100/371472 [5:22:21<1:56:14,  3.64it/s]
                                                           
{'loss': 2.6379, 'learning_rate': 1.615042340925251e-07, 'epoch': 14.91}

 93%|█████████▎| 346100/371472 [5:22:21<1:56:14,  3.64it/s]
 93%|█████████▎| 346101/371472 [5:22:21<1:57:45,  3.59it/s]
 93%|█████████▎| 346102/371472 [5:22:22<2:01:52,  3.47it/s]
 93%|█████████▎| 346103/371472 [5:22:22<2:02:23,  3.45it/s]
 93%|█████████▎| 346104/371472 [5:22:22<2:03:48,  3.41it/s]
 93%|█████████▎| 346105/371472 [5:22:23<2:12:29,  3.19it/s]
 93%|█████████▎| 346106/371472 [5:22:23<2:04:29,  3.40it/s]
 93%|█████████▎| 346107/371472 [5:22:23<2:04:54,  3.38it/s]
 93%|█████████▎| 346108/371472 [5:22:23<2:03:54,  3.41it/s]
 93%|█████████▎| 346109/371472 [5:22:24<2:00:58,  3.49it/s]
 93%|█████████▎| 346110/371472 [5:22:24<1:57:32,  3.60it/s]
 93%|█████████▎| 346111/371472 [5:22:24<1:54:59,  3.68it/s]
 93%|█████████▎| 346112/371472 [5:22:24<1:55:55,  3.65it/s]
 93%|█████████▎| 346113/371472 [5:22:25<1:54:58,  3.68it/s]
 93%|█████████▎| 346114/371472 [5:22:25<1:56:07,  3.64it/s]
 93%|█████████▎| 346115/371472 [5:22:25<1:54:17,  3.70it/s]
 93%|█████████▎| 346116/371472 [5:22:26<1:59:11,  3.55it/s]
 93%|█████████▎| 346117/371472 [5:22:26<1:57:37,  3.59it/s]
 93%|█████████▎| 346118/371472 [5:22:26<1:57:40,  3.59it/s]
 93%|█████████▎| 346119/371472 [5:22:26<1:55:04,  3.67it/s]
 93%|█████████▎| 346120/371472 [5:22:27<1:51:39,  3.78it/s]
                                                           
{'loss': 2.5776, 'learning_rate': 1.6145575211704626e-07, 'epoch': 14.91}

 93%|█████████▎| 346120/371472 [5:22:27<1:51:39,  3.78it/s]
 93%|█████████▎| 346121/371472 [5:22:27<1:59:38,  3.53it/s]
 93%|█████████▎| 346122/371472 [5:22:27<1:57:12,  3.60it/s]
 93%|█████████▎| 346123/371472 [5:22:28<1:59:05,  3.55it/s]
 93%|█████████▎| 346124/371472 [5:22:28<2:06:17,  3.35it/s]
 93%|█████████▎| 346125/371472 [5:22:28<2:05:18,  3.37it/s]
 93%|█████████▎| 346126/371472 [5:22:28<2:03:45,  3.41it/s]
 93%|█████████▎| 346127/371472 [5:22:29<2:00:04,  3.52it/s]
 93%|█████████▎| 346128/371472 [5:22:29<1:58:46,  3.56it/s]
 93%|█████████▎| 346129/371472 [5:22:29<1:56:13,  3.63it/s]
 93%|█████████▎| 346130/371472 [5:22:30<2:05:32,  3.36it/s]
 93%|█████████▎| 346131/371472 [5:22:30<2:07:53,  3.30it/s]
 93%|█████████▎| 346132/371472 [5:22:30<2:07:42,  3.31it/s]
 93%|█████████▎| 346133/371472 [5:22:31<2:08:04,  3.30it/s]
 93%|█████████▎| 346134/371472 [5:22:31<2:02:21,  3.45it/s]
 93%|█████████▎| 346135/371472 [5:22:31<1:58:10,  3.57it/s]
 93%|█████████▎| 346136/371472 [5:22:31<2:04:58,  3.38it/s]
 93%|█████████▎| 346137/371472 [5:22:32<2:05:14,  3.37it/s]
 93%|█████████▎| 346138/371472 [5:22:32<2:06:03,  3.35it/s]
 93%|█████████▎| 346139/371472 [5:22:32<2:04:02,  3.40it/s]
 93%|█████████▎| 346140/371472 [5:22:33<2:03:43,  3.41it/s]
                                                           
{'loss': 2.7166, 'learning_rate': 1.6140727014156733e-07, 'epoch': 14.91}

 93%|█████████▎| 346140/371472 [5:22:33<2:03:43,  3.41it/s]
 93%|█████████▎| 346141/371472 [5:22:33<2:04:51,  3.38it/s]
 93%|█████████▎| 346142/371472 [5:22:33<2:10:30,  3.23it/s]
 93%|█████████▎| 346143/371472 [5:22:33<2:03:25,  3.42it/s]
 93%|█████████▎| 346144/371472 [5:22:34<2:01:50,  3.46it/s]
 93%|█████████▎| 346145/371472 [5:22:34<1:57:21,  3.60it/s]
 93%|█████████▎| 346146/371472 [5:22:34<1:56:02,  3.64it/s]
 93%|█████████▎| 346147/371472 [5:22:35<2:06:07,  3.35it/s]
 93%|█████████▎| 346148/371472 [5:22:35<1:58:57,  3.55it/s]
 93%|█████████▎| 346149/371472 [5:22:35<1:59:56,  3.52it/s]
 93%|█████████▎| 346150/371472 [5:22:35<1:57:35,  3.59it/s]
 93%|█████████▎| 346151/371472 [5:22:36<2:07:29,  3.31it/s]
 93%|█████████▎| 346152/371472 [5:22:36<2:03:49,  3.41it/s]
 93%|█████████▎| 346153/371472 [5:22:36<2:03:19,  3.42it/s]
 93%|█████████▎| 346154/371472 [5:22:37<1:56:56,  3.61it/s]
 93%|█████████▎| 346155/371472 [5:22:37<1:54:55,  3.67it/s]
 93%|█████████▎| 346156/371472 [5:22:37<1:53:31,  3.72it/s]
 93%|█████████▎| 346157/371472 [5:22:37<1:55:00,  3.67it/s]
 93%|█████████▎| 346158/371472 [5:22:38<1:56:43,  3.61it/s]
 93%|█████████▎| 346159/371472 [5:22:38<1:54:03,  3.70it/s]
 93%|█████████▎| 346160/371472 [5:22:38<1:59:32,  3.53it/s]
                                                           
{'loss': 2.5306, 'learning_rate': 1.6135878816608848e-07, 'epoch': 14.91}

 93%|█████████▎| 346160/371472 [5:22:38<1:59:32,  3.53it/s]
 93%|█████████▎| 346161/371472 [5:22:38<2:01:09,  3.48it/s]
 93%|█████████▎| 346162/371472 [5:22:39<1:57:40,  3.58it/s]
 93%|█████████▎| 346163/371472 [5:22:39<1:54:09,  3.69it/s]
 93%|█████████▎| 346164/371472 [5:22:39<1:58:43,  3.55it/s]
 93%|█████████▎| 346165/371472 [5:22:40<1:57:00,  3.60it/s]
 93%|█████████▎| 346166/371472 [5:22:40<1:51:32,  3.78it/s]
 93%|█████████▎| 346167/371472 [5:22:40<1:55:23,  3.66it/s]
 93%|█████████▎| 346168/371472 [5:22:40<1:53:30,  3.72it/s]
 93%|█████████▎| 346169/371472 [5:22:41<1:54:08,  3.69it/s]
 93%|█████████▎| 346170/371472 [5:22:41<1:52:22,  3.75it/s]
 93%|█████████▎| 346171/371472 [5:22:41<1:51:36,  3.78it/s]
 93%|█████████▎| 346172/371472 [5:22:41<1:49:55,  3.84it/s]
 93%|█████████▎| 346173/371472 [5:22:42<1:52:04,  3.76it/s]
 93%|█████████▎| 346174/371472 [5:22:42<1:51:23,  3.78it/s]
 93%|█████████▎| 346175/371472 [5:22:42<1:51:55,  3.77it/s]
 93%|█████████▎| 346176/371472 [5:22:43<1:54:38,  3.68it/s]
 93%|█████████▎| 346177/371472 [5:22:43<1:53:31,  3.71it/s]
 93%|█████████▎| 346178/371472 [5:22:43<1:51:50,  3.77it/s]
 93%|█████████▎| 346179/371472 [5:22:43<1:51:42,  3.77it/s]
 93%|█████████▎| 346180/371472 [5:22:44<1:52:48,  3.74it/s]
                                                           
{'loss': 2.6065, 'learning_rate': 1.6131030619060952e-07, 'epoch': 14.91}

 93%|█████████▎| 346180/371472 [5:22:44<1:52:48,  3.74it/s]
 93%|█████████▎| 346181/371472 [5:22:44<1:52:58,  3.73it/s]
 93%|█████████▎| 346182/371472 [5:22:44<1:55:03,  3.66it/s]
 93%|█████████▎| 346183/371472 [5:22:44<1:59:51,  3.52it/s]
 93%|█████████▎| 346184/371472 [5:22:45<2:02:14,  3.45it/s]
 93%|█████████▎| 346185/371472 [5:22:45<1:56:06,  3.63it/s]
 93%|█████████▎| 346186/371472 [5:22:45<1:59:07,  3.54it/s]
 93%|█████████▎| 346187/371472 [5:22:46<2:02:44,  3.43it/s]
 93%|█████████▎| 346188/371472 [5:22:46<1:59:17,  3.53it/s]
 93%|█████████▎| 346189/371472 [5:22:46<2:04:52,  3.37it/s]
 93%|█████████▎| 346190/371472 [5:22:47<2:10:27,  3.23it/s]
 93%|█████████▎| 346191/371472 [5:22:47<2:10:27,  3.23it/s]
 93%|█████████▎| 346192/371472 [5:22:47<2:13:51,  3.15it/s]
 93%|█████████▎| 346193/371472 [5:22:47<2:05:24,  3.36it/s]
 93%|█████████▎| 346194/371472 [5:22:48<2:00:40,  3.49it/s]
 93%|█████████▎| 346195/371472 [5:22:48<1:59:05,  3.54it/s]
 93%|█████████▎| 346196/371472 [5:22:48<1:54:48,  3.67it/s]
 93%|█████████▎| 346197/371472 [5:22:48<1:51:05,  3.79it/s]
 93%|█████████▎| 346198/371472 [5:22:49<1:50:45,  3.80it/s]
 93%|█████████▎| 346199/371472 [5:22:49<1:51:08,  3.79it/s]
 93%|█████████▎| 346200/371472 [5:22:49<1:49:18,  3.85it/s]
                                                           
{'loss': 2.5109, 'learning_rate': 1.612618242151307e-07, 'epoch': 14.91}

 93%|█████████▎| 346200/371472 [5:22:49<1:49:18,  3.85it/s]
 93%|█████████▎| 346201/371472 [5:22:49<1:49:09,  3.86it/s]
 93%|█████████▎| 346202/371472 [5:22:50<1:55:21,  3.65it/s]
 93%|█████████▎| 346203/371472 [5:22:50<1:52:17,  3.75it/s]
 93%|█████████▎| 346204/371472 [5:22:50<1:52:50,  3.73it/s]
 93%|█████████▎| 346205/371472 [5:22:51<1:53:01,  3.73it/s]
 93%|█████████▎| 346206/371472 [5:22:51<2:11:19,  3.21it/s]
 93%|█████████▎| 346207/371472 [5:22:51<2:16:24,  3.09it/s]
 93%|█████████▎| 346208/371472 [5:22:52<2:13:12,  3.16it/s]
 93%|█████████▎| 346209/371472 [5:22:52<2:05:27,  3.36it/s]
 93%|█████████▎| 346210/371472 [5:22:52<1:58:42,  3.55it/s]
 93%|█████████▎| 346211/371472 [5:22:52<2:01:47,  3.46it/s]
 93%|█████████▎| 346212/371472 [5:22:53<2:00:04,  3.51it/s]
 93%|█████████▎| 346213/371472 [5:22:53<1:58:13,  3.56it/s]
 93%|█████████▎| 346214/371472 [5:22:53<1:58:41,  3.55it/s]
 93%|█████████▎| 346215/371472 [5:22:54<2:06:57,  3.32it/s]
 93%|█████████▎| 346216/371472 [5:22:54<2:03:41,  3.40it/s]
 93%|█████████▎| 346217/371472 [5:22:54<1:57:58,  3.57it/s]
 93%|█████████▎| 346218/371472 [5:22:54<1:52:44,  3.73it/s]
 93%|█████████▎| 346219/371472 [5:22:55<1:50:53,  3.80it/s]
 93%|█████████▎| 346220/371472 [5:22:55<1:55:30,  3.64it/s]
                                                           
{'loss': 2.554, 'learning_rate': 1.6121334223965175e-07, 'epoch': 14.91}

 93%|█████████▎| 346220/371472 [5:22:55<1:55:30,  3.64it/s]
 93%|█████████▎| 346221/371472 [5:22:55<2:03:51,  3.40it/s]
 93%|█████████▎| 346222/371472 [5:22:56<2:01:27,  3.46it/s]
 93%|█████████▎| 346223/371472 [5:22:56<1:56:13,  3.62it/s]
 93%|█████████▎| 346224/371472 [5:22:56<1:59:16,  3.53it/s]
 93%|█████████▎| 346225/371472 [5:22:56<1:58:51,  3.54it/s]
 93%|█████████▎| 346226/371472 [5:22:57<2:01:45,  3.46it/s]
 93%|█████████▎| 346227/371472 [5:22:57<1:59:41,  3.52it/s]
 93%|█████████▎| 346228/371472 [5:22:57<1:58:59,  3.54it/s]
 93%|█████████▎| 346229/371472 [5:22:58<1:59:13,  3.53it/s]
 93%|█████████▎| 346230/371472 [5:22:58<1:56:20,  3.62it/s]
 93%|█████████▎| 346231/371472 [5:22:58<1:54:42,  3.67it/s]
 93%|█████████▎| 346232/371472 [5:22:58<1:53:19,  3.71it/s]
 93%|█████████▎| 346233/371472 [5:22:59<1:55:59,  3.63it/s]
 93%|█████████▎| 346234/371472 [5:22:59<1:54:15,  3.68it/s]
 93%|█████████▎| 346235/371472 [5:22:59<1:54:43,  3.67it/s]
 93%|█████████▎| 346236/371472 [5:22:59<1:55:15,  3.65it/s]
 93%|█████████▎| 346237/371472 [5:23:00<1:52:41,  3.73it/s]
 93%|█████████▎| 346238/371472 [5:23:00<2:04:23,  3.38it/s]
 93%|█████████▎| 346239/371472 [5:23:00<2:17:38,  3.06it/s]
 93%|█████████▎| 346240/371472 [5:23:01<2:09:35,  3.24it/s]
                                                           
{'loss': 2.5597, 'learning_rate': 1.611648602641729e-07, 'epoch': 14.91}

 93%|█████████▎| 346240/371472 [5:23:01<2:09:35,  3.24it/s]
 93%|█████████▎| 346241/371472 [5:23:01<2:04:28,  3.38it/s]
 93%|█████████▎| 346242/371472 [5:23:01<2:03:12,  3.41it/s]
 93%|█████████▎| 346243/371472 [5:23:02<2:05:49,  3.34it/s]
 93%|█████████▎| 346244/371472 [5:23:02<2:06:01,  3.34it/s]
 93%|█████████▎| 346245/371472 [5:23:02<2:06:01,  3.34it/s]
 93%|█████████▎| 346246/371472 [5:23:03<2:11:01,  3.21it/s]
 93%|█████████▎| 346247/371472 [5:23:03<2:04:12,  3.38it/s]
 93%|█████████▎| 346248/371472 [5:23:03<2:04:14,  3.38it/s]
 93%|█████████▎| 346249/371472 [5:23:03<2:02:49,  3.42it/s]
 93%|█████████▎| 346250/371472 [5:23:04<1:57:22,  3.58it/s]
 93%|█████████▎| 346251/371472 [5:23:04<1:54:50,  3.66it/s]
 93%|█████████▎| 346252/371472 [5:23:04<2:07:20,  3.30it/s]
 93%|█████████▎| 346253/371472 [5:23:05<2:11:33,  3.19it/s]
 93%|█████████▎| 346254/371472 [5:23:05<2:12:00,  3.18it/s]
 93%|█████████▎| 346255/371472 [5:23:05<2:09:59,  3.23it/s]
 93%|█████████▎| 346256/371472 [5:23:05<2:03:50,  3.39it/s]
 93%|█████████▎| 346257/371472 [5:23:06<2:18:48,  3.03it/s]
 93%|█████████▎| 346258/371472 [5:23:06<2:11:04,  3.21it/s]
 93%|█████████▎| 346259/371472 [5:23:06<2:02:23,  3.43it/s]
 93%|█████████▎| 346260/371472 [5:23:07<1:58:54,  3.53it/s]
                                                           
{'loss': 2.5992, 'learning_rate': 1.6111637828869397e-07, 'epoch': 14.91}

 93%|█████████▎| 346260/371472 [5:23:07<1:58:54,  3.53it/s]
 93%|█████████▎| 346261/371472 [5:23:07<1:57:16,  3.58it/s]
 93%|█████████▎| 346262/371472 [5:23:07<1:57:09,  3.59it/s]
 93%|█████████▎| 346263/371472 [5:23:07<2:02:00,  3.44it/s]
 93%|█████████▎| 346264/371472 [5:23:08<2:23:33,  2.93it/s]
 93%|█████████▎| 346265/371472 [5:23:08<2:24:51,  2.90it/s]
 93%|█████████▎| 346266/371472 [5:23:09<2:29:27,  2.81it/s]
 93%|█████████▎| 346267/371472 [5:23:09<2:18:55,  3.02it/s]
 93%|█████████▎| 346268/371472 [5:23:09<2:10:26,  3.22it/s]
 93%|█████████▎| 346269/371472 [5:23:09<2:05:01,  3.36it/s]
 93%|█████████▎| 346270/371472 [5:23:10<1:59:57,  3.50it/s]
 93%|█████████▎| 346271/371472 [5:23:10<1:57:46,  3.57it/s]
 93%|█████████▎| 346272/371472 [5:23:10<1:56:40,  3.60it/s]
 93%|█████████▎| 346273/371472 [5:23:11<1:57:12,  3.58it/s]
 93%|█████████▎| 346274/371472 [5:23:11<1:51:31,  3.77it/s]
 93%|█████████▎| 346275/371472 [5:23:11<1:53:02,  3.71it/s]
 93%|█████████▎| 346276/371472 [5:23:11<1:57:27,  3.58it/s]
 93%|█████████▎| 346277/371472 [5:23:12<1:56:20,  3.61it/s]
 93%|█████████▎| 346278/371472 [5:23:12<1:53:08,  3.71it/s]
 93%|█████████▎| 346279/371472 [5:23:12<2:06:19,  3.32it/s]
 93%|█████████▎| 346280/371472 [5:23:13<2:02:17,  3.43it/s]
                                                           
{'loss': 2.595, 'learning_rate': 1.6106789631321512e-07, 'epoch': 14.91}

 93%|█████████▎| 346280/371472 [5:23:13<2:02:17,  3.43it/s]
 93%|█████████▎| 346281/371472 [5:23:13<2:06:21,  3.32it/s]
 93%|█████████▎| 346282/371472 [5:23:13<2:00:01,  3.50it/s]
 93%|█████████▎| 346283/371472 [5:23:13<2:02:39,  3.42it/s]
 93%|█████████▎| 346284/371472 [5:23:14<2:04:19,  3.38it/s]
 93%|█████████▎| 346285/371472 [5:23:14<1:57:31,  3.57it/s]
 93%|█████████▎| 346286/371472 [5:23:14<1:56:44,  3.60it/s]
 93%|█████████▎| 346287/371472 [5:23:14<1:51:22,  3.77it/s]
 93%|█████████▎| 346288/371472 [5:23:15<1:58:19,  3.55it/s]
 93%|█████████▎| 346289/371472 [5:23:15<1:52:29,  3.73it/s]
 93%|█████████▎| 346290/371472 [5:23:15<1:54:50,  3.65it/s]
 93%|█████████▎| 346291/371472 [5:23:16<1:50:31,  3.80it/s]
 93%|█████████▎| 346292/371472 [5:23:16<1:52:38,  3.73it/s]
 93%|█████████▎| 346293/371472 [5:23:16<2:02:03,  3.44it/s]
 93%|█████████▎| 346294/371472 [5:23:17<2:05:23,  3.35it/s]
 93%|█████████▎| 346295/371472 [5:23:17<1:57:55,  3.56it/s]
 93%|█████████▎| 346296/371472 [5:23:17<2:00:07,  3.49it/s]
 93%|█████████▎| 346297/371472 [5:23:17<1:55:58,  3.62it/s]
 93%|█████████▎| 346298/371472 [5:23:18<2:02:44,  3.42it/s]
 93%|█████████▎| 346299/371472 [5:23:18<2:02:03,  3.44it/s]
 93%|█████████▎| 346300/371472 [5:23:18<1:59:18,  3.52it/s]
                                                           
{'loss': 2.5084, 'learning_rate': 1.6101941433773616e-07, 'epoch': 14.92}

 93%|█████████▎| 346300/371472 [5:23:18<1:59:18,  3.52it/s]
 93%|█████████▎| 346301/371472 [5:23:18<1:53:41,  3.69it/s]
 93%|█████████▎| 346302/371472 [5:23:19<1:53:02,  3.71it/s]
 93%|█████████▎| 346303/371472 [5:23:19<1:52:39,  3.72it/s]
 93%|█████████▎| 346304/371472 [5:23:19<1:54:08,  3.67it/s]
 93%|█████████▎| 346305/371472 [5:23:20<1:56:09,  3.61it/s]
 93%|█████████▎| 346306/371472 [5:23:20<1:57:07,  3.58it/s]
 93%|█████████▎| 346307/371472 [5:23:20<1:54:12,  3.67it/s]
 93%|█████████▎| 346308/371472 [5:23:20<1:58:38,  3.53it/s]
 93%|█████████▎| 346309/371472 [5:23:21<2:03:21,  3.40it/s]
 93%|█████████▎| 346310/371472 [5:23:21<2:00:36,  3.48it/s]
 93%|█████████▎| 346311/371472 [5:23:21<1:54:18,  3.67it/s]
 93%|█████████▎| 346312/371472 [5:23:22<2:05:13,  3.35it/s]
 93%|█████████▎| 346313/371472 [5:23:22<2:01:53,  3.44it/s]
 93%|█████████▎| 346314/371472 [5:23:22<1:57:25,  3.57it/s]
 93%|█████████▎| 346315/371472 [5:23:22<1:59:51,  3.50it/s]
 93%|█████████▎| 346316/371472 [5:23:23<2:09:14,  3.24it/s]
 93%|█████████▎| 346317/371472 [5:23:23<2:06:31,  3.31it/s]
 93%|█████████▎| 346318/371472 [5:23:23<2:01:00,  3.46it/s]
 93%|█████████▎| 346319/371472 [5:23:24<2:10:16,  3.22it/s]
 93%|█████████▎| 346320/371472 [5:23:24<2:10:49,  3.20it/s]
                                                           
{'loss': 2.6988, 'learning_rate': 1.6097093236225734e-07, 'epoch': 14.92}

 93%|█████████▎| 346320/371472 [5:23:24<2:10:49,  3.20it/s]
 93%|█████████▎| 346321/371472 [5:23:24<2:08:34,  3.26it/s]
 93%|█████████▎| 346322/371472 [5:23:25<2:08:19,  3.27it/s]
 93%|█████████▎| 346323/371472 [5:23:25<1:59:40,  3.50it/s]
 93%|█████████▎| 346324/371472 [5:23:25<1:57:42,  3.56it/s]
 93%|█████████▎| 346325/371472 [5:23:25<1:59:35,  3.50it/s]
 93%|█████████▎| 346326/371472 [5:23:26<1:57:45,  3.56it/s]
 93%|█████████▎| 346327/371472 [5:23:26<1:52:51,  3.71it/s]
 93%|█████████▎| 346328/371472 [5:23:26<1:54:51,  3.65it/s]
 93%|█████████▎| 346329/371472 [5:23:26<1:55:54,  3.62it/s]
 93%|█████████▎| 346330/371472 [5:23:27<1:54:18,  3.67it/s]
 93%|█████████▎| 346331/371472 [5:23:27<1:54:00,  3.68it/s]
 93%|█████████▎| 346332/371472 [5:23:27<1:59:06,  3.52it/s]
 93%|█████████▎| 346333/371472 [5:23:28<1:54:08,  3.67it/s]
 93%|█████████▎| 346334/371472 [5:23:28<2:03:35,  3.39it/s]
 93%|█████████▎| 346335/371472 [5:23:28<2:00:23,  3.48it/s]
 93%|█████████▎| 346336/371472 [5:23:29<2:06:36,  3.31it/s]
 93%|█████████▎| 346337/371472 [5:23:29<2:06:46,  3.30it/s]
 93%|█████████▎| 346338/371472 [5:23:29<2:03:44,  3.39it/s]
 93%|█████████▎| 346339/371472 [5:23:29<2:11:14,  3.19it/s]
 93%|█████████▎| 346340/371472 [5:23:30<2:02:36,  3.42it/s]
                                                           
{'loss': 2.7223, 'learning_rate': 1.609224503867784e-07, 'epoch': 14.92}

 93%|█████████▎| 346340/371472 [5:23:30<2:02:36,  3.42it/s]
 93%|█████████▎| 346341/371472 [5:23:30<1:58:03,  3.55it/s]
 93%|█████████▎| 346342/371472 [5:23:30<1:54:21,  3.66it/s]
 93%|█████████▎| 346343/371472 [5:23:30<1:58:42,  3.53it/s]
 93%|█████████▎| 346344/371472 [5:23:31<1:58:27,  3.54it/s]
 93%|█████████▎| 346345/371472 [5:23:31<1:59:35,  3.50it/s]
 93%|█████████▎| 346346/371472 [5:23:31<2:01:23,  3.45it/s]
 93%|█████████▎| 346347/371472 [5:23:32<2:09:29,  3.23it/s]
 93%|█████████▎| 346348/371472 [5:23:32<2:07:09,  3.29it/s]
 93%|█████████▎| 346349/371472 [5:23:32<1:59:55,  3.49it/s]
 93%|█████████▎| 346350/371472 [5:23:33<1:54:52,  3.64it/s]
 93%|█████████▎| 346351/371472 [5:23:33<1:55:53,  3.61it/s]
 93%|█████████▎| 346352/371472 [5:23:33<1:50:49,  3.78it/s]
 93%|█████████▎| 346353/371472 [5:23:33<1:49:21,  3.83it/s]
 93%|█████████▎| 346354/371472 [5:23:34<1:51:04,  3.77it/s]
 93%|█████████▎| 346355/371472 [5:23:34<2:00:55,  3.46it/s]
 93%|█████████▎| 346356/371472 [5:23:34<1:56:56,  3.58it/s]
 93%|█████████▎| 346357/371472 [5:23:34<1:58:16,  3.54it/s]
 93%|█████████▎| 346358/371472 [5:23:35<1:58:51,  3.52it/s]
 93%|█████████▎| 346359/371472 [5:23:35<1:55:59,  3.61it/s]
 93%|█████████▎| 346360/371472 [5:23:35<1:55:55,  3.61it/s]
                                                           
{'loss': 2.5473, 'learning_rate': 1.6087396841129954e-07, 'epoch': 14.92}

 93%|█████████▎| 346360/371472 [5:23:35<1:55:55,  3.61it/s]
 93%|█████████▎| 346361/371472 [5:23:36<1:54:22,  3.66it/s]
 93%|█████████▎| 346362/371472 [5:23:36<1:57:30,  3.56it/s]
 93%|█████████▎| 346363/371472 [5:23:36<1:55:13,  3.63it/s]
 93%|█████████▎| 346364/371472 [5:23:36<1:56:33,  3.59it/s]
 93%|█████████▎| 346365/371472 [5:23:37<1:56:57,  3.58it/s]
 93%|█████████▎| 346366/371472 [5:23:37<2:04:16,  3.37it/s]
 93%|█████████▎| 346367/371472 [5:23:37<2:00:53,  3.46it/s]
 93%|█████████▎| 346368/371472 [5:23:38<1:56:01,  3.61it/s]
 93%|█████████▎| 346369/371472 [5:23:38<1:54:13,  3.66it/s]
 93%|█████████▎| 346370/371472 [5:23:38<1:52:49,  3.71it/s]
 93%|█████████▎| 346371/371472 [5:23:38<1:49:46,  3.81it/s]
 93%|█████████▎| 346372/371472 [5:23:39<1:51:57,  3.74it/s]
 93%|█████████▎| 346373/371472 [5:23:39<1:48:30,  3.86it/s]
 93%|█████████▎| 346374/371472 [5:23:39<1:54:37,  3.65it/s]
 93%|█████████▎| 346375/371472 [5:23:39<1:55:49,  3.61it/s]
 93%|█████████▎| 346376/371472 [5:23:40<2:02:17,  3.42it/s]
 93%|█████████▎| 346377/371472 [5:23:40<1:57:41,  3.55it/s]
 93%|█████████▎| 346378/371472 [5:23:40<1:54:35,  3.65it/s]
 93%|█████████▎| 346379/371472 [5:23:40<1:48:45,  3.85it/s]
 93%|█████████▎| 346380/371472 [5:23:41<1:55:15,  3.63it/s]
                                                           
{'loss': 2.7332, 'learning_rate': 1.608254864358206e-07, 'epoch': 14.92}

 93%|█████████▎| 346380/371472 [5:23:41<1:55:15,  3.63it/s]
 93%|█████████▎| 346381/371472 [5:23:41<1:52:12,  3.73it/s]
 93%|█████████▎| 346382/371472 [5:23:41<1:50:39,  3.78it/s]
 93%|█████████▎| 346383/371472 [5:23:42<1:57:03,  3.57it/s]
 93%|█████████▎| 346384/371472 [5:23:42<2:00:46,  3.46it/s]
 93%|█████████▎| 346385/371472 [5:23:42<2:19:25,  3.00it/s]
 93%|█████████▎| 346386/371472 [5:23:43<2:10:09,  3.21it/s]
 93%|█████████▎| 346387/371472 [5:23:43<2:03:57,  3.37it/s]
 93%|█████████▎| 346388/371472 [5:23:43<1:57:51,  3.55it/s]
 93%|█████████▎| 346389/371472 [5:23:43<1:56:34,  3.59it/s]
 93%|█████████▎| 346390/371472 [5:23:44<1:55:46,  3.61it/s]
 93%|█████████▎| 346391/371472 [5:23:44<1:54:00,  3.67it/s]
 93%|█████████▎| 346392/371472 [5:23:44<1:52:50,  3.70it/s]
 93%|█████████▎| 346393/371472 [5:23:45<2:04:10,  3.37it/s]
 93%|█████████▎| 346394/371472 [5:23:45<2:00:51,  3.46it/s]
 93%|█████████▎| 346395/371472 [5:23:45<1:57:32,  3.56it/s]
 93%|█████████▎| 346396/371472 [5:23:45<1:55:11,  3.63it/s]
 93%|█████████▎| 346397/371472 [5:23:46<2:02:44,  3.40it/s]
 93%|█████████▎| 346398/371472 [5:23:46<2:01:51,  3.43it/s]
 93%|█████████▎| 346399/371472 [5:23:46<2:15:36,  3.08it/s]
 93%|█████████▎| 346400/371472 [5:23:47<2:23:58,  2.90it/s]
                                                           
{'loss': 2.6718, 'learning_rate': 1.6077700446034179e-07, 'epoch': 14.92}

 93%|█████████▎| 346400/371472 [5:23:47<2:23:58,  2.90it/s]
 93%|█████████▎| 346401/371472 [5:23:47<2:30:04,  2.78it/s]
 93%|█████████▎| 346402/371472 [5:23:47<2:21:34,  2.95it/s]
 93%|█████████▎| 346403/371472 [5:23:48<2:16:46,  3.05it/s]
 93%|█████████▎| 346404/371472 [5:23:48<2:18:34,  3.01it/s]
 93%|█████████▎| 346405/371472 [5:23:48<2:09:18,  3.23it/s]
 93%|█████████▎| 346406/371472 [5:23:49<2:05:36,  3.33it/s]
 93%|█████████▎| 346407/371472 [5:23:49<2:05:45,  3.32it/s]
 93%|█████████▎| 346408/371472 [5:23:49<2:01:05,  3.45it/s]
 93%|█████████▎| 346409/371472 [5:23:49<1:59:55,  3.48it/s]
 93%|█████████▎| 346410/371472 [5:23:50<1:59:14,  3.50it/s]
 93%|█████████▎| 346411/371472 [5:23:50<1:54:20,  3.65it/s]
 93%|█████████▎| 346412/371472 [5:23:50<1:55:58,  3.60it/s]
 93%|█████████▎| 346413/371472 [5:23:51<2:00:37,  3.46it/s]
 93%|█████████▎| 346414/371472 [5:23:51<1:57:31,  3.55it/s]
 93%|█████████▎| 346415/371472 [5:23:51<1:53:07,  3.69it/s]
 93%|█████████▎| 346416/371472 [5:23:51<1:55:19,  3.62it/s]
 93%|█████████▎| 346417/371472 [5:23:52<1:52:59,  3.70it/s]
 93%|█████████▎| 346418/371472 [5:23:52<1:57:12,  3.56it/s]
 93%|█████████▎| 346419/371472 [5:23:52<1:59:06,  3.51it/s]
 93%|█████████▎| 346420/371472 [5:23:53<1:58:26,  3.53it/s]
                                                           
{'loss': 2.5235, 'learning_rate': 1.6072852248486283e-07, 'epoch': 14.92}

 93%|█████████▎| 346420/371472 [5:23:53<1:58:26,  3.53it/s]
 93%|█████████▎| 346421/371472 [5:23:53<1:56:16,  3.59it/s]
 93%|█████████▎| 346422/371472 [5:23:53<1:52:37,  3.71it/s]
 93%|█████████▎| 346423/371472 [5:23:53<1:52:00,  3.73it/s]
 93%|█████████▎| 346424/371472 [5:23:54<1:51:55,  3.73it/s]
 93%|█████████▎| 346425/371472 [5:23:54<1:52:22,  3.71it/s]
 93%|█████████▎| 346426/371472 [5:23:54<1:55:06,  3.63it/s]
 93%|█████████▎| 346427/371472 [5:23:54<1:57:37,  3.55it/s]
 93%|█████████▎| 346428/371472 [5:23:55<2:06:23,  3.30it/s]
 93%|█████████▎| 346429/371472 [5:23:55<2:16:11,  3.06it/s]
 93%|█████████▎| 346430/371472 [5:23:55<2:12:44,  3.14it/s]
 93%|█████████▎| 346431/371472 [5:23:56<2:11:59,  3.16it/s]
 93%|█████████▎| 346432/371472 [5:23:56<2:06:15,  3.31it/s]
 93%|█████████▎| 346433/371472 [5:23:56<2:07:03,  3.28it/s]
 93%|█████████▎| 346434/371472 [5:23:57<2:05:57,  3.31it/s]
 93%|█████████▎| 346435/371472 [5:23:57<2:04:36,  3.35it/s]
 93%|█████████▎| 346436/371472 [5:23:57<2:05:01,  3.34it/s]
 93%|█████████▎| 346437/371472 [5:23:58<2:03:24,  3.38it/s]
 93%|█████████▎| 346438/371472 [5:23:58<2:01:22,  3.44it/s]
 93%|█████████▎| 346439/371472 [5:23:58<2:00:32,  3.46it/s]
 93%|█████████▎| 346440/371472 [5:23:58<2:05:02,  3.34it/s]
                                                           
{'loss': 2.4456, 'learning_rate': 1.6068004050938396e-07, 'epoch': 14.92}

 93%|█████████▎| 346440/371472 [5:23:58<2:05:02,  3.34it/s]
 93%|█████████▎| 346441/371472 [5:23:59<1:59:44,  3.48it/s]
 93%|█████████▎| 346442/371472 [5:23:59<2:02:08,  3.42it/s]
 93%|█████████▎| 346443/371472 [5:23:59<1:58:15,  3.53it/s]
 93%|█████████▎| 346444/371472 [5:24:00<1:56:23,  3.58it/s]
 93%|█████████▎| 346445/371472 [5:24:00<1:54:26,  3.65it/s]
 93%|█████████▎| 346446/371472 [5:24:00<1:55:14,  3.62it/s]
 93%|█████████▎| 346447/371472 [5:24:00<1:55:43,  3.60it/s]
 93%|█████████▎| 346448/371472 [5:24:01<1:57:30,  3.55it/s]
 93%|█████████▎| 346449/371472 [5:24:01<1:54:43,  3.64it/s]
 93%|█████████▎| 346450/371472 [5:24:01<1:52:26,  3.71it/s]
 93%|█████████▎| 346451/371472 [5:24:01<1:50:16,  3.78it/s]
 93%|█████████▎| 346452/371472 [5:24:02<1:51:14,  3.75it/s]
 93%|█████████▎| 346453/371472 [5:24:02<1:50:09,  3.79it/s]
 93%|█████████▎| 346454/371472 [5:24:02<1:47:59,  3.86it/s]
 93%|█████████▎| 346455/371472 [5:24:03<1:56:53,  3.57it/s]
 93%|█████████▎| 346456/371472 [5:24:03<1:57:37,  3.54it/s]
 93%|█████████▎| 346457/371472 [5:24:03<2:00:27,  3.46it/s]
 93%|█████████▎| 346458/371472 [5:24:03<1:58:19,  3.52it/s]
 93%|█████████▎| 346459/371472 [5:24:04<1:56:24,  3.58it/s]
 93%|█████████▎| 346460/371472 [5:24:04<2:11:08,  3.18it/s]
                                                           
{'loss': 2.5202, 'learning_rate': 1.6063155853390505e-07, 'epoch': 14.92}

 93%|█████████▎| 346460/371472 [5:24:04<2:11:08,  3.18it/s]
 93%|█████████▎| 346461/371472 [5:24:04<2:07:15,  3.28it/s]
 93%|█████████▎| 346462/371472 [5:24:05<2:01:07,  3.44it/s]
 93%|█████████▎| 346463/371472 [5:24:05<1:57:09,  3.56it/s]
 93%|█████████▎| 346464/371472 [5:24:05<1:58:33,  3.52it/s]
 93%|█████████▎| 346465/371472 [5:24:06<2:14:55,  3.09it/s]
 93%|█████████▎| 346466/371472 [5:24:06<2:14:15,  3.10it/s]
 93%|█████████▎| 346467/371472 [5:24:06<2:11:33,  3.17it/s]
 93%|█████████▎| 346468/371472 [5:24:07<2:20:38,  2.96it/s]
 93%|█████████▎| 346469/371472 [5:24:07<2:10:01,  3.20it/s]
 93%|█████████▎| 346470/371472 [5:24:07<2:03:48,  3.37it/s]
 93%|█████████▎| 346471/371472 [5:24:07<1:57:49,  3.54it/s]
 93%|█████████▎| 346472/371472 [5:24:08<1:55:26,  3.61it/s]
 93%|█████████▎| 346473/371472 [5:24:08<2:04:13,  3.35it/s]
 93%|█████████▎| 346474/371472 [5:24:08<2:06:02,  3.31it/s]
 93%|█████████▎| 346475/371472 [5:24:09<2:04:50,  3.34it/s]
 93%|█████████▎| 346476/371472 [5:24:09<2:08:25,  3.24it/s]
 93%|█████████▎| 346477/371472 [5:24:09<2:05:53,  3.31it/s]
 93%|█████████▎| 346478/371472 [5:24:09<2:04:05,  3.36it/s]
 93%|█████████▎| 346479/371472 [5:24:10<1:59:57,  3.47it/s]
 93%|█████████▎| 346480/371472 [5:24:10<1:57:29,  3.55it/s]
                                                           
{'loss': 2.6117, 'learning_rate': 1.605830765584262e-07, 'epoch': 14.92}

 93%|█████████▎| 346480/371472 [5:24:10<1:57:29,  3.55it/s]
 93%|█████████▎| 346481/371472 [5:24:10<2:03:52,  3.36it/s]
 93%|█████████▎| 346482/371472 [5:24:11<1:59:54,  3.47it/s]
 93%|█████████▎| 346483/371472 [5:24:11<1:54:40,  3.63it/s]
 93%|█████████▎| 346484/371472 [5:24:11<1:51:52,  3.72it/s]
 93%|█████████▎| 346485/371472 [5:24:11<1:50:47,  3.76it/s]
 93%|█████████▎| 346486/371472 [5:24:12<1:51:40,  3.73it/s]
 93%|█████████▎| 346487/371472 [5:24:12<1:58:55,  3.50it/s]
 93%|█████████▎| 346488/371472 [5:24:12<1:59:51,  3.47it/s]
 93%|█████████▎| 346489/371472 [5:24:13<1:58:04,  3.53it/s]
 93%|█████████▎| 346490/371472 [5:24:13<1:53:52,  3.66it/s]
 93%|█████████▎| 346491/371472 [5:24:13<1:56:41,  3.57it/s]
 93%|█████████▎| 346492/371472 [5:24:13<1:55:34,  3.60it/s]
 93%|█████████▎| 346493/371472 [5:24:14<2:03:56,  3.36it/s]
 93%|█████████▎| 346494/371472 [5:24:14<2:00:17,  3.46it/s]
 93%|█████████▎| 346495/371472 [5:24:14<2:01:51,  3.42it/s]
 93%|█████████▎| 346496/371472 [5:24:15<2:01:53,  3.41it/s]
 93%|█████████▎| 346497/371472 [5:24:15<2:03:20,  3.37it/s]
 93%|█████████▎| 346498/371472 [5:24:15<1:56:16,  3.58it/s]
 93%|█████████▎| 346499/371472 [5:24:15<1:52:52,  3.69it/s]
 93%|█████████▎| 346500/371472 [5:24:16<1:52:27,  3.70it/s]
                                                           
{'loss': 2.6368, 'learning_rate': 1.6053459458294725e-07, 'epoch': 14.92}

 93%|█████████▎| 346500/371472 [5:24:16<1:52:27,  3.70it/s]
 93%|█████████▎| 346501/371472 [5:24:16<1:55:59,  3.59it/s]
 93%|█████████▎| 346502/371472 [5:24:16<1:59:25,  3.48it/s]
 93%|█████████▎| 346503/371472 [5:24:17<2:00:31,  3.45it/s]
 93%|█████████▎| 346504/371472 [5:24:17<1:55:38,  3.60it/s]
 93%|█████████▎| 346505/371472 [5:24:17<2:07:39,  3.26it/s]
 93%|█████████▎| 346506/371472 [5:24:17<2:02:10,  3.41it/s]
 93%|█████████▎| 346507/371472 [5:24:18<1:57:29,  3.54it/s]
 93%|█████████▎| 346508/371472 [5:24:18<1:57:23,  3.54it/s]
 93%|█████████▎| 346509/371472 [5:24:18<1:56:01,  3.59it/s]
 93%|█████████▎| 346510/371472 [5:24:18<1:56:12,  3.58it/s]
 93%|█████████▎| 346511/371472 [5:24:19<1:53:50,  3.65it/s]
 93%|█████████▎| 346512/371472 [5:24:19<1:56:29,  3.57it/s]
 93%|█████████▎| 346513/371472 [5:24:19<1:56:51,  3.56it/s]
 93%|█████████▎| 346514/371472 [5:24:20<1:55:26,  3.60it/s]
 93%|█████████▎| 346515/371472 [5:24:20<1:52:36,  3.69it/s]
 93%|█████████▎| 346516/371472 [5:24:20<1:59:03,  3.49it/s]
 93%|█████████▎| 346517/371472 [5:24:20<1:56:47,  3.56it/s]
 93%|█████████▎| 346518/371472 [5:24:21<1:53:24,  3.67it/s]
 93%|█████████▎| 346519/371472 [5:24:21<1:51:46,  3.72it/s]
 93%|█████████▎| 346520/371472 [5:24:21<1:50:16,  3.77it/s]
                                                           
{'loss': 2.6138, 'learning_rate': 1.6048611260746843e-07, 'epoch': 14.93}

 93%|█████████▎| 346520/371472 [5:24:21<1:50:16,  3.77it/s]
 93%|█████████▎| 346521/371472 [5:24:21<1:49:29,  3.80it/s]
 93%|█████████▎| 346522/371472 [5:24:22<1:52:13,  3.71it/s]
 93%|█████████▎| 346523/371472 [5:24:22<1:58:25,  3.51it/s]
 93%|█████████▎| 346524/371472 [5:24:22<2:01:56,  3.41it/s]
 93%|█████████▎| 346525/371472 [5:24:23<2:02:13,  3.40it/s]
 93%|█████████▎| 346526/371472 [5:24:23<1:56:54,  3.56it/s]
 93%|█████████▎| 346527/371472 [5:24:23<1:54:27,  3.63it/s]
 93%|█████████▎| 346528/371472 [5:24:23<1:56:04,  3.58it/s]
 93%|█████████▎| 346529/371472 [5:24:24<2:04:34,  3.34it/s]
 93%|█████████▎| 346530/371472 [5:24:24<1:57:14,  3.55it/s]
 93%|█████████▎| 346531/371472 [5:24:24<2:00:51,  3.44it/s]
 93%|█████████▎| 346532/371472 [5:24:25<1:57:57,  3.52it/s]
 93%|█████████▎| 346533/371472 [5:24:25<1:55:14,  3.61it/s]
 93%|█████████▎| 346534/371472 [5:24:25<2:00:20,  3.45it/s]
 93%|█████████▎| 346535/371472 [5:24:25<1:57:22,  3.54it/s]
 93%|█████████▎| 346536/371472 [5:24:26<1:54:07,  3.64it/s]
 93%|█████████▎| 346537/371472 [5:24:26<1:55:32,  3.60it/s]
 93%|█████████▎| 346538/371472 [5:24:26<1:58:05,  3.52it/s]
 93%|█████████▎| 346539/371472 [5:24:27<1:56:40,  3.56it/s]
 93%|█████████▎| 346540/371472 [5:24:27<2:01:22,  3.42it/s]
                                                           
{'loss': 2.5027, 'learning_rate': 1.6043763063198947e-07, 'epoch': 14.93}

 93%|█████████▎| 346540/371472 [5:24:27<2:01:22,  3.42it/s]
 93%|█████████▎| 346541/371472 [5:24:27<2:01:08,  3.43it/s]
 93%|█████████▎| 346542/371472 [5:24:27<1:56:11,  3.58it/s]
 93%|█████████▎| 346543/371472 [5:24:28<1:59:08,  3.49it/s]
 93%|█████████▎| 346544/371472 [5:24:28<1:59:07,  3.49it/s]
 93%|█████████▎| 346545/371472 [5:24:28<2:03:51,  3.35it/s]
 93%|█████████▎| 346546/371472 [5:24:29<2:04:18,  3.34it/s]
 93%|█████████▎| 346547/371472 [5:24:29<1:59:15,  3.48it/s]
 93%|█████████▎| 346548/371472 [5:24:29<1:53:48,  3.65it/s]
 93%|█████████▎| 346549/371472 [5:24:30<2:01:26,  3.42it/s]
 93%|█████████▎| 346550/371472 [5:24:30<2:01:03,  3.43it/s]
 93%|█████████▎| 346551/371472 [5:24:30<1:59:30,  3.48it/s]
 93%|█████████▎| 346552/371472 [5:24:30<1:58:35,  3.50it/s]
 93%|█████████▎| 346553/371472 [5:24:31<2:13:16,  3.12it/s]
 93%|█████████▎| 346554/371472 [5:24:31<2:05:44,  3.30it/s]
 93%|█████████▎| 346555/371472 [5:24:31<2:01:15,  3.42it/s]
 93%|█████████▎| 346556/371472 [5:24:32<2:07:22,  3.26it/s]
 93%|█████████▎| 346557/371472 [5:24:32<2:06:30,  3.28it/s]
 93%|█████████▎| 346558/371472 [5:24:32<2:03:46,  3.35it/s]
 93%|█████████▎| 346559/371472 [5:24:32<2:01:10,  3.43it/s]
 93%|█████████▎| 346560/371472 [5:24:33<1:55:21,  3.60it/s]
                                                           
{'loss': 2.5706, 'learning_rate': 1.6038914865651062e-07, 'epoch': 14.93}

 93%|█████████▎| 346560/371472 [5:24:33<1:55:21,  3.60it/s]
 93%|█████████▎| 346561/371472 [5:24:33<1:59:46,  3.47it/s]
 93%|█████████▎| 346562/371472 [5:24:33<2:11:08,  3.17it/s]
 93%|█████████▎| 346563/371472 [5:24:34<2:09:04,  3.22it/s]
 93%|█████████▎| 346564/371472 [5:24:34<2:09:15,  3.21it/s]
 93%|█████████▎| 346565/371472 [5:24:34<2:02:26,  3.39it/s]
 93%|█████████▎| 346566/371472 [5:24:35<2:08:33,  3.23it/s]
 93%|█████████▎| 346567/371472 [5:24:35<2:03:06,  3.37it/s]
 93%|█████████▎| 346568/371472 [5:24:35<2:04:33,  3.33it/s]
 93%|█████████▎| 346569/371472 [5:24:35<1:59:49,  3.46it/s]
 93%|█████████▎| 346570/371472 [5:24:36<2:01:34,  3.41it/s]
 93%|█████████▎| 346571/371472 [5:24:36<1:58:53,  3.49it/s]
 93%|█████████▎| 346572/371472 [5:24:36<1:53:17,  3.66it/s]
 93%|█████████▎| 346573/371472 [5:24:37<1:56:58,  3.55it/s]
 93%|█████████▎| 346574/371472 [5:24:37<1:56:50,  3.55it/s]
 93%|█████████▎| 346575/371472 [5:24:37<1:59:25,  3.47it/s]
 93%|█████████▎| 346576/371472 [5:24:37<1:58:14,  3.51it/s]
 93%|█████████▎| 346577/371472 [5:24:38<1:59:00,  3.49it/s]
 93%|█████████▎| 346578/371472 [5:24:38<2:02:35,  3.38it/s]
 93%|█████████▎| 346579/371472 [5:24:38<1:55:33,  3.59it/s]
 93%|█████████▎| 346580/371472 [5:24:39<1:51:13,  3.73it/s]
                                                           
{'loss': 2.7174, 'learning_rate': 1.603406666810317e-07, 'epoch': 14.93}

 93%|█████████▎| 346580/371472 [5:24:39<1:51:13,  3.73it/s]
 93%|█████████▎| 346581/371472 [5:24:39<1:54:10,  3.63it/s]
 93%|█████████▎| 346582/371472 [5:24:39<1:55:34,  3.59it/s]
 93%|█████████▎| 346583/371472 [5:24:39<1:56:19,  3.57it/s]
 93%|█████████▎| 346584/371472 [5:24:40<2:01:49,  3.41it/s]
 93%|█████████▎| 346585/371472 [5:24:40<1:59:39,  3.47it/s]
 93%|█████████▎| 346586/371472 [5:24:40<1:59:46,  3.46it/s]
 93%|█████████▎| 346587/371472 [5:24:41<1:55:54,  3.58it/s]
 93%|█████████▎| 346588/371472 [5:24:41<1:57:47,  3.52it/s]
 93%|█████████▎| 346589/371472 [5:24:41<1:51:58,  3.70it/s]
 93%|█████████▎| 346590/371472 [5:24:41<2:03:43,  3.35it/s]
 93%|█████████▎| 346591/371472 [5:24:42<1:59:48,  3.46it/s]
 93%|█████████▎| 346592/371472 [5:24:42<1:57:15,  3.54it/s]
 93%|█████████▎| 346593/371472 [5:24:42<1:56:31,  3.56it/s]
 93%|█████████▎| 346594/371472 [5:24:43<1:54:52,  3.61it/s]
 93%|█████████▎| 346595/371472 [5:24:43<1:51:56,  3.70it/s]
 93%|█████████▎| 346596/371472 [5:24:43<1:52:54,  3.67it/s]
 93%|█████████▎| 346597/371472 [5:24:43<1:51:59,  3.70it/s]
 93%|█████████▎| 346598/371472 [5:24:44<1:51:45,  3.71it/s]
 93%|█████████▎| 346599/371472 [5:24:44<1:51:39,  3.71it/s]
 93%|█████████▎| 346600/371472 [5:24:44<1:53:55,  3.64it/s]
                                                           
{'loss': 2.5913, 'learning_rate': 1.6029218470555274e-07, 'epoch': 14.93}

 93%|█████████▎| 346600/371472 [5:24:44<1:53:55,  3.64it/s]
 93%|█████████▎| 346601/371472 [5:24:44<1:52:50,  3.67it/s]
 93%|█████████▎| 346602/371472 [5:24:45<1:53:34,  3.65it/s]
 93%|█████████▎| 346603/371472 [5:24:45<1:55:08,  3.60it/s]
 93%|█████████▎| 346604/371472 [5:24:45<1:55:45,  3.58it/s]
 93%|█████████▎| 346605/371472 [5:24:46<1:51:15,  3.73it/s]
 93%|█████████▎| 346606/371472 [5:24:46<1:54:12,  3.63it/s]
 93%|█████████▎| 346607/371472 [5:24:46<1:55:28,  3.59it/s]
 93%|█████████▎| 346608/371472 [5:24:46<1:55:17,  3.59it/s]
 93%|█████████▎| 346609/371472 [5:24:47<1:51:24,  3.72it/s]
 93%|█████████▎| 346610/371472 [5:24:47<2:00:35,  3.44it/s]
 93%|█████████▎| 346611/371472 [5:24:47<2:01:01,  3.42it/s]
 93%|█████████▎| 346612/371472 [5:24:48<1:59:35,  3.46it/s]
 93%|█████████▎| 346613/371472 [5:24:48<2:24:13,  2.87it/s]
 93%|█████████▎| 346614/371472 [5:24:48<2:14:40,  3.08it/s]
 93%|█████████▎| 346615/371472 [5:24:49<2:16:50,  3.03it/s]
 93%|█████████▎| 346616/371472 [5:24:49<2:09:14,  3.21it/s]
 93%|█████████▎| 346617/371472 [5:24:49<2:05:45,  3.29it/s]
 93%|█████████▎| 346618/371472 [5:24:50<2:09:40,  3.19it/s]
 93%|█████████▎| 346619/371472 [5:24:50<2:03:07,  3.36it/s]
 93%|█████████▎| 346620/371472 [5:24:50<2:05:27,  3.30it/s]
                                                           
{'loss': 2.631, 'learning_rate': 1.602437027300739e-07, 'epoch': 14.93}

 93%|█████████▎| 346620/371472 [5:24:50<2:05:27,  3.30it/s]
 93%|█████████▎| 346621/371472 [5:24:50<2:13:11,  3.11it/s]
 93%|█████████▎| 346622/371472 [5:24:51<2:07:09,  3.26it/s]
 93%|█████████▎| 346623/371472 [5:24:51<2:02:52,  3.37it/s]
 93%|█████████▎| 346624/371472 [5:24:51<1:58:12,  3.50it/s]
 93%|█████████▎| 346625/371472 [5:24:52<1:57:52,  3.51it/s]
 93%|█████████▎| 346626/371472 [5:24:52<1:55:18,  3.59it/s]
 93%|█████████▎| 346627/371472 [5:24:52<1:55:41,  3.58it/s]
 93%|█████████▎| 346628/371472 [5:24:52<1:56:28,  3.55it/s]
 93%|█████████▎| 346629/371472 [5:24:53<2:02:11,  3.39it/s]
 93%|█████████▎| 346630/371472 [5:24:53<1:56:54,  3.54it/s]
 93%|█████████▎| 346631/371472 [5:24:53<2:01:28,  3.41it/s]
 93%|█████████▎| 346632/371472 [5:24:54<2:03:51,  3.34it/s]
 93%|█████████▎| 346633/371472 [5:24:54<1:59:31,  3.46it/s]
 93%|█████████▎| 346634/371472 [5:24:54<1:55:20,  3.59it/s]
 93%|█████████▎| 346635/371472 [5:24:54<1:54:01,  3.63it/s]
 93%|█████████▎| 346636/371472 [5:24:55<1:51:54,  3.70it/s]
 93%|█████████▎| 346637/371472 [5:24:55<1:51:29,  3.71it/s]
 93%|█████████▎| 346638/371472 [5:24:55<1:52:51,  3.67it/s]
 93%|█████████▎| 346639/371472 [5:24:56<2:11:53,  3.14it/s]
 93%|█████████▎| 346640/371472 [5:24:56<2:24:28,  2.86it/s]
                                                           
{'loss': 2.4502, 'learning_rate': 1.6019522075459496e-07, 'epoch': 14.93}

 93%|█████████▎| 346640/371472 [5:24:56<2:24:28,  2.86it/s]
 93%|█████████▎| 346641/371472 [5:24:56<2:15:51,  3.05it/s]
 93%|█████████▎| 346642/371472 [5:24:57<2:27:01,  2.81it/s]
 93%|█████████▎| 346643/371472 [5:24:57<2:14:48,  3.07it/s]
 93%|█████████▎| 346644/371472 [5:24:57<2:06:50,  3.26it/s]
 93%|█████████▎| 346645/371472 [5:24:58<2:12:46,  3.12it/s]
 93%|█████████▎| 346646/371472 [5:24:58<2:07:30,  3.24it/s]
 93%|█████████▎| 346647/371472 [5:24:58<2:18:45,  2.98it/s]
 93%|█████████▎| 346648/371472 [5:24:59<2:12:33,  3.12it/s]
 93%|█████████▎| 346649/371472 [5:24:59<2:05:13,  3.30it/s]
 93%|█████████▎| 346650/371472 [5:24:59<2:03:39,  3.35it/s]
 93%|█████████▎| 346651/371472 [5:24:59<2:02:48,  3.37it/s]
 93%|█████████▎| 346652/371472 [5:25:00<2:01:28,  3.41it/s]
 93%|█████████▎| 346653/371472 [5:25:00<1:58:51,  3.48it/s]
 93%|█████████▎| 346654/371472 [5:25:00<1:54:12,  3.62it/s]
 93%|█████████▎| 346655/371472 [5:25:01<1:54:29,  3.61it/s]
 93%|█████████▎| 346656/371472 [5:25:01<1:50:30,  3.74it/s]
 93%|█████████▎| 346657/371472 [5:25:01<1:55:36,  3.58it/s]
 93%|█████████▎| 346658/371472 [5:25:01<1:57:45,  3.51it/s]
 93%|█████████▎| 346659/371472 [5:25:02<1:57:13,  3.53it/s]
 93%|█████████▎| 346660/371472 [5:25:02<1:52:40,  3.67it/s]
                                                           
{'loss': 2.6879, 'learning_rate': 1.6014673877911614e-07, 'epoch': 14.93}

 93%|█████████▎| 346660/371472 [5:25:02<1:52:40,  3.67it/s]
 93%|█████████▎| 346661/371472 [5:25:02<1:55:48,  3.57it/s]
 93%|█████████▎| 346662/371472 [5:25:02<1:54:21,  3.62it/s]
 93%|█████████▎| 346663/371472 [5:25:03<1:56:45,  3.54it/s]
 93%|█████████▎| 346664/371472 [5:25:03<2:00:25,  3.43it/s]
 93%|█████████▎| 346665/371472 [5:25:03<2:02:16,  3.38it/s]
 93%|█████████▎| 346666/371472 [5:25:04<2:01:08,  3.41it/s]
 93%|█████████▎| 346667/371472 [5:25:04<1:57:14,  3.53it/s]
 93%|█████████▎| 346668/371472 [5:25:04<1:56:57,  3.53it/s]
 93%|█████████▎| 346669/371472 [5:25:04<1:55:07,  3.59it/s]
 93%|█████████▎| 346670/371472 [5:25:05<1:59:44,  3.45it/s]
 93%|█████████▎| 346671/371472 [5:25:05<1:58:49,  3.48it/s]
 93%|█████████▎| 346672/371472 [5:25:05<1:56:42,  3.54it/s]
 93%|█████████▎| 346673/371472 [5:25:06<1:55:20,  3.58it/s]
 93%|█████████▎| 346674/371472 [5:25:06<1:59:11,  3.47it/s]
 93%|█████████▎| 346675/371472 [5:25:06<2:01:48,  3.39it/s]
 93%|█████████▎| 346676/371472 [5:25:06<1:59:09,  3.47it/s]
 93%|█████████▎| 346677/371472 [5:25:07<1:54:08,  3.62it/s]
 93%|█████████▎| 346678/371472 [5:25:07<1:53:52,  3.63it/s]
 93%|█████████▎| 346679/371472 [5:25:07<1:59:35,  3.46it/s]
 93%|█████████▎| 346680/371472 [5:25:08<2:00:42,  3.42it/s]
                                                           
{'loss': 2.5268, 'learning_rate': 1.6009825680363718e-07, 'epoch': 14.93}

 93%|█████████▎| 346680/371472 [5:25:08<2:00:42,  3.42it/s]
 93%|█████████▎| 346681/371472 [5:25:08<1:54:37,  3.60it/s]
 93%|█████████▎| 346682/371472 [5:25:08<1:55:49,  3.57it/s]
 93%|█████████▎| 346683/371472 [5:25:08<1:56:32,  3.54it/s]
 93%|█████████▎| 346684/371472 [5:25:09<1:59:03,  3.47it/s]
 93%|█████████▎| 346685/371472 [5:25:09<1:56:37,  3.54it/s]
 93%|█████████▎| 346686/371472 [5:25:09<1:54:39,  3.60it/s]
 93%|█████████▎| 346687/371472 [5:25:10<1:56:09,  3.56it/s]
 93%|█████████▎| 346688/371472 [5:25:10<1:57:28,  3.52it/s]
 93%|█████████▎| 346689/371472 [5:25:10<1:54:03,  3.62it/s]
 93%|█████████▎| 346690/371472 [5:25:10<1:53:57,  3.62it/s]
 93%|█████████▎| 346691/371472 [5:25:11<1:54:12,  3.62it/s]
 93%|█████████▎| 346692/371472 [5:25:11<1:54:24,  3.61it/s]
 93%|█████████▎| 346693/371472 [5:25:11<1:53:02,  3.65it/s]
 93%|█████████▎| 346694/371472 [5:25:12<1:53:09,  3.65it/s]
 93%|█████████▎| 346695/371472 [5:25:12<1:52:05,  3.68it/s]
 93%|█████████▎| 346696/371472 [5:25:12<1:52:05,  3.68it/s]
 93%|█████████▎| 346697/371472 [5:25:12<2:05:32,  3.29it/s]
 93%|█████████▎| 346698/371472 [5:25:13<2:01:55,  3.39it/s]
 93%|█████████▎| 346699/371472 [5:25:13<2:00:30,  3.43it/s]
 93%|█████████▎| 346700/371472 [5:25:13<2:01:34,  3.40it/s]
                                                           
{'loss': 2.6283, 'learning_rate': 1.6004977482815833e-07, 'epoch': 14.93}

 93%|█████████▎| 346700/371472 [5:25:13<2:01:34,  3.40it/s]
 93%|█████████▎| 346701/371472 [5:25:14<2:01:36,  3.39it/s]
 93%|█████████▎| 346702/371472 [5:25:14<2:00:34,  3.42it/s]
 93%|█████████▎| 346703/371472 [5:25:14<2:00:40,  3.42it/s]
 93%|█████████▎| 346704/371472 [5:25:14<1:55:37,  3.57it/s]
 93%|█████████▎| 346705/371472 [5:25:15<1:57:20,  3.52it/s]
 93%|█████████▎| 346706/371472 [5:25:15<2:06:37,  3.26it/s]
 93%|█████████▎| 346707/371472 [5:25:15<2:02:07,  3.38it/s]
 93%|█████████▎| 346708/371472 [5:25:16<1:57:26,  3.51it/s]
 93%|█████████▎| 346709/371472 [5:25:16<1:56:42,  3.54it/s]
 93%|█████████▎| 346710/371472 [5:25:16<1:54:24,  3.61it/s]
 93%|█████████▎| 346711/371472 [5:25:16<1:54:52,  3.59it/s]
 93%|█████████▎| 346712/371472 [5:25:17<1:49:35,  3.77it/s]
 93%|█████████▎| 346713/371472 [5:25:17<2:05:21,  3.29it/s]
 93%|█████████▎| 346714/371472 [5:25:17<1:59:22,  3.46it/s]
 93%|█████████▎| 346715/371472 [5:25:18<1:59:24,  3.46it/s]
 93%|█████████▎| 346716/371472 [5:25:18<1:53:55,  3.62it/s]
 93%|█████████▎| 346717/371472 [5:25:18<2:07:03,  3.25it/s]
 93%|█████████▎| 346718/371472 [5:25:18<2:00:06,  3.43it/s]
 93%|█████████▎| 346719/371472 [5:25:19<2:02:22,  3.37it/s]
 93%|█████████▎| 346720/371472 [5:25:19<2:08:54,  3.20it/s]
                                                           
{'loss': 2.5965, 'learning_rate': 1.600012928526794e-07, 'epoch': 14.93}

 93%|█████████▎| 346720/371472 [5:25:19<2:08:54,  3.20it/s]
 93%|█████████▎| 346721/371472 [5:25:19<2:02:22,  3.37it/s]
 93%|█████████▎| 346722/371472 [5:25:20<2:00:21,  3.43it/s]
 93%|█████████▎| 346723/371472 [5:25:20<1:54:54,  3.59it/s]
 93%|█████████▎| 346724/371472 [5:25:20<1:51:32,  3.70it/s]
 93%|█████████▎| 346725/371472 [5:25:20<1:50:48,  3.72it/s]
 93%|█████████▎| 346726/371472 [5:25:21<1:54:26,  3.60it/s]
 93%|█████████▎| 346727/371472 [5:25:21<1:56:06,  3.55it/s]
 93%|█████████▎| 346728/371472 [5:25:21<1:58:45,  3.47it/s]
 93%|█████████▎| 346729/371472 [5:25:22<1:55:33,  3.57it/s]
 93%|█████████▎| 346730/371472 [5:25:22<2:08:51,  3.20it/s]
 93%|█████████▎| 346731/371472 [5:25:22<2:06:54,  3.25it/s]
 93%|█████████▎| 346732/371472 [5:25:23<1:59:25,  3.45it/s]
 93%|█████████▎| 346733/371472 [5:25:23<2:00:10,  3.43it/s]
 93%|█████████▎| 346734/371472 [5:25:23<2:00:19,  3.43it/s]
 93%|█████████▎| 346735/371472 [5:25:23<2:02:22,  3.37it/s]
 93%|█████████▎| 346736/371472 [5:25:24<1:58:28,  3.48it/s]
 93%|█████████▎| 346737/371472 [5:25:24<2:05:24,  3.29it/s]
 93%|█████████▎| 346738/371472 [5:25:24<2:02:24,  3.37it/s]
 93%|█████████▎| 346739/371472 [5:25:25<2:03:02,  3.35it/s]
 93%|█████████▎| 346740/371472 [5:25:25<2:04:21,  3.31it/s]
                                                           
{'loss': 2.5719, 'learning_rate': 1.5995281087720053e-07, 'epoch': 14.93}

 93%|█████████▎| 346740/371472 [5:25:25<2:04:21,  3.31it/s]
 93%|█████████▎| 346741/371472 [5:25:25<2:01:09,  3.40it/s]
 93%|█████████▎| 346742/371472 [5:25:25<1:56:32,  3.54it/s]
 93%|█████████▎| 346743/371472 [5:25:26<1:53:46,  3.62it/s]
 93%|█████████▎| 346744/371472 [5:25:26<1:50:14,  3.74it/s]
 93%|█████████▎| 346745/371472 [5:25:26<1:52:37,  3.66it/s]
 93%|█████████▎| 346746/371472 [5:25:27<1:53:56,  3.62it/s]
 93%|█████████▎| 346747/371472 [5:25:27<1:58:25,  3.48it/s]
 93%|█████████▎| 346748/371472 [5:25:27<1:57:13,  3.52it/s]
 93%|█████████▎| 346749/371472 [5:25:27<1:52:58,  3.65it/s]
 93%|█████████▎| 346750/371472 [5:25:28<1:52:14,  3.67it/s]
 93%|█████████▎| 346751/371472 [5:25:28<1:53:17,  3.64it/s]
 93%|█████████▎| 346752/371472 [5:25:28<1:57:20,  3.51it/s]
 93%|█████████▎| 346753/371472 [5:25:29<1:57:59,  3.49it/s]
 93%|█████████▎| 346754/371472 [5:25:29<1:53:02,  3.64it/s]
 93%|█████████▎| 346755/371472 [5:25:29<1:53:24,  3.63it/s]
 93%|█████████▎| 346756/371472 [5:25:29<1:53:43,  3.62it/s]
 93%|█████████▎| 346757/371472 [5:25:30<1:54:22,  3.60it/s]
 93%|█████████▎| 346758/371472 [5:25:30<1:53:00,  3.65it/s]
 93%|█████████▎| 346759/371472 [5:25:30<1:51:05,  3.71it/s]
 93%|█████████▎| 346760/371472 [5:25:30<1:52:54,  3.65it/s]
                                                           
{'loss': 2.6764, 'learning_rate': 1.599043289017216e-07, 'epoch': 14.94}

 93%|█████████▎| 346760/371472 [5:25:30<1:52:54,  3.65it/s]
 93%|█████████▎| 346761/371472 [5:25:31<1:51:12,  3.70it/s]
 93%|█████████▎| 346762/371472 [5:25:31<1:56:43,  3.53it/s]
 93%|█████████▎| 346763/371472 [5:25:31<1:59:27,  3.45it/s]
 93%|█████████▎| 346764/371472 [5:25:32<1:55:00,  3.58it/s]
 93%|█████████▎| 346765/371472 [5:25:32<2:03:46,  3.33it/s]
 93%|█████████▎| 346766/371472 [5:25:32<1:58:03,  3.49it/s]
 93%|█████████▎| 346767/371472 [5:25:32<2:06:41,  3.25it/s]
 93%|█████████▎| 346768/371472 [5:25:33<2:03:55,  3.32it/s]
 93%|█████████▎| 346769/371472 [5:25:33<2:04:43,  3.30it/s]
 93%|█████████▎| 346770/371472 [5:25:33<1:59:05,  3.46it/s]
 93%|█████████▎| 346771/371472 [5:25:34<1:53:48,  3.62it/s]
 93%|█████████▎| 346772/371472 [5:25:34<1:50:03,  3.74it/s]
 93%|█████████▎| 346773/371472 [5:25:34<1:48:47,  3.78it/s]
 93%|█████████▎| 346774/371472 [5:25:34<1:47:38,  3.82it/s]
 93%|█████████▎| 346775/371472 [5:25:35<1:49:05,  3.77it/s]
 93%|█████████▎| 346776/371472 [5:25:35<1:49:48,  3.75it/s]
 93%|█████████▎| 346777/371472 [5:25:35<1:58:51,  3.46it/s]
 93%|█████████▎| 346778/371472 [5:25:36<1:58:29,  3.47it/s]
 93%|█████████▎| 346779/371472 [5:25:36<1:58:53,  3.46it/s]
 93%|█████████▎| 346780/371472 [5:25:36<1:58:10,  3.48it/s]
                                                           
{'loss': 2.5568, 'learning_rate': 1.5985584692624275e-07, 'epoch': 14.94}

 93%|█████████▎| 346780/371472 [5:25:36<1:58:10,  3.48it/s]
 93%|█████████▎| 346781/371472 [5:25:36<1:54:15,  3.60it/s]
 93%|█████████▎| 346782/371472 [5:25:37<1:58:42,  3.47it/s]
 93%|█████████▎| 346783/371472 [5:25:37<2:00:28,  3.42it/s]
 93%|█████████▎| 346784/371472 [5:25:37<1:59:25,  3.45it/s]
 93%|█████████▎| 346785/371472 [5:25:38<2:00:01,  3.43it/s]
 93%|█████████▎| 346786/371472 [5:25:38<2:00:27,  3.42it/s]
 93%|█████████▎| 346787/371472 [5:25:38<2:00:43,  3.41it/s]
 93%|█████████▎| 346788/371472 [5:25:38<1:57:35,  3.50it/s]
 93%|█████████▎| 346789/371472 [5:25:39<1:58:29,  3.47it/s]
 93%|█████████▎| 346790/371472 [5:25:39<1:54:59,  3.58it/s]
 93%|█████████▎| 346791/371472 [5:25:39<1:52:51,  3.64it/s]
 93%|█████████▎| 346792/371472 [5:25:40<1:57:38,  3.50it/s]
 93%|█████████▎| 346793/371472 [5:25:40<1:58:24,  3.47it/s]
 93%|█████████▎| 346794/371472 [5:25:40<2:04:43,  3.30it/s]
 93%|█████████▎| 346795/371472 [5:25:40<2:01:39,  3.38it/s]
 93%|█████████▎| 346796/371472 [5:25:41<1:57:55,  3.49it/s]
 93%|█████████▎| 346797/371472 [5:25:41<1:54:40,  3.59it/s]
 93%|█████████▎| 346798/371472 [5:25:41<2:18:40,  2.97it/s]
 93%|█████████▎| 346799/371472 [5:25:42<2:16:28,  3.01it/s]
 93%|█████████▎| 346800/371472 [5:25:42<2:15:25,  3.04it/s]
                                                           
{'loss': 2.5498, 'learning_rate': 1.5980736495076382e-07, 'epoch': 14.94}

 93%|█████████▎| 346800/371472 [5:25:42<2:15:25,  3.04it/s]
 93%|█████████▎| 346801/371472 [5:25:42<2:06:00,  3.26it/s]
 93%|█████████▎| 346802/371472 [5:25:43<2:04:21,  3.31it/s]
 93%|█████████▎| 346803/371472 [5:25:43<1:59:45,  3.43it/s]
 93%|█████████▎| 346804/371472 [5:25:43<1:53:54,  3.61it/s]
 93%|█████████▎| 346805/371472 [5:25:44<2:04:13,  3.31it/s]
 93%|█████████▎| 346806/371472 [5:25:44<2:00:02,  3.42it/s]
 93%|█████████▎| 346807/371472 [5:25:44<1:56:46,  3.52it/s]
 93%|█████████▎| 346808/371472 [5:25:44<1:53:37,  3.62it/s]
 93%|█████████▎| 346809/371472 [5:25:45<1:51:21,  3.69it/s]
 93%|█████████▎| 346810/371472 [5:25:45<1:50:23,  3.72it/s]
 93%|█████████▎| 346811/371472 [5:25:45<1:48:34,  3.79it/s]
 93%|█████████▎| 346812/371472 [5:25:45<1:46:54,  3.84it/s]
 93%|█████████▎| 346813/371472 [5:25:46<1:44:43,  3.92it/s]
 93%|█████████▎| 346814/371472 [5:25:46<1:46:42,  3.85it/s]
 93%|█████████▎| 346815/371472 [5:25:46<1:46:12,  3.87it/s]
 93%|█████████▎| 346816/371472 [5:25:46<1:46:39,  3.85it/s]
 93%|█████████▎| 346817/371472 [5:25:47<1:45:32,  3.89it/s]
 93%|█████████▎| 346818/371472 [5:25:47<1:50:03,  3.73it/s]
 93%|█████████▎| 346819/371472 [5:25:47<1:48:43,  3.78it/s]
 93%|█████████▎| 346820/371472 [5:25:47<1:49:09,  3.76it/s]
                                                           
{'loss': 2.7005, 'learning_rate': 1.5975888297528498e-07, 'epoch': 14.94}

 93%|█████████▎| 346820/371472 [5:25:47<1:49:09,  3.76it/s]
 93%|█████████▎| 346821/371472 [5:25:48<1:55:14,  3.57it/s]
 93%|█████████▎| 346822/371472 [5:25:48<1:56:13,  3.53it/s]
 93%|█████████▎| 346823/371472 [5:25:48<1:54:02,  3.60it/s]
 93%|█████████▎| 346824/371472 [5:25:49<1:50:55,  3.70it/s]
 93%|█████████▎| 346825/371472 [5:25:49<1:49:26,  3.75it/s]
 93%|█████████▎| 346826/371472 [5:25:49<1:50:01,  3.73it/s]
 93%|█████████▎| 346827/371472 [5:25:49<1:49:02,  3.77it/s]
 93%|█████████▎| 346828/371472 [5:25:50<1:45:30,  3.89it/s]
 93%|█████████▎| 346829/371472 [5:25:50<1:47:19,  3.83it/s]
 93%|█████████▎| 346830/371472 [5:25:50<1:45:36,  3.89it/s]
 93%|█████████▎| 346831/371472 [5:25:50<1:46:39,  3.85it/s]
 93%|█████████▎| 346832/371472 [5:25:51<1:43:40,  3.96it/s]
 93%|█████████▎| 346833/371472 [5:25:51<1:44:59,  3.91it/s]
 93%|█████████▎| 346834/371472 [5:25:51<1:51:16,  3.69it/s]
 93%|█████████▎| 346835/371472 [5:25:51<1:46:54,  3.84it/s]
 93%|█████████▎| 346836/371472 [5:25:52<1:46:10,  3.87it/s]
 93%|█████████▎| 346837/371472 [5:25:52<1:52:39,  3.64it/s]
 93%|█████████▎| 346838/371472 [5:25:52<1:48:38,  3.78it/s]
 93%|█████████▎| 346839/371472 [5:25:53<1:57:19,  3.50it/s]
 93%|█████████▎| 346840/371472 [5:25:53<2:00:15,  3.41it/s]
                                                           
{'loss': 2.6279, 'learning_rate': 1.5971040099980605e-07, 'epoch': 14.94}

 93%|█████████▎| 346840/371472 [5:25:53<2:00:15,  3.41it/s]
 93%|█████████▎| 346841/371472 [5:25:53<1:53:56,  3.60it/s]
 93%|█████████▎| 346842/371472 [5:25:53<1:51:46,  3.67it/s]
 93%|█████████▎| 346843/371472 [5:25:54<1:55:14,  3.56it/s]
 93%|█████████▎| 346844/371472 [5:25:54<1:57:25,  3.50it/s]
 93%|█████████▎| 346845/371472 [5:25:54<1:54:03,  3.60it/s]
 93%|█████████▎| 346846/371472 [5:25:54<1:53:46,  3.61it/s]
 93%|█████████▎| 346847/371472 [5:25:55<1:52:14,  3.66it/s]
 93%|█████████▎| 346848/371472 [5:25:55<1:47:32,  3.82it/s]
 93%|█████████▎| 346849/371472 [5:25:55<1:45:22,  3.89it/s]
 93%|█████████▎| 346850/371472 [5:25:56<1:51:54,  3.67it/s]
 93%|█████████▎| 346851/371472 [5:25:56<1:53:06,  3.63it/s]
 93%|█████████▎| 346852/371472 [5:25:56<1:49:39,  3.74it/s]
 93%|█████████▎| 346853/371472 [5:25:56<1:52:40,  3.64it/s]
 93%|█████████▎| 346854/371472 [5:25:57<1:53:28,  3.62it/s]
 93%|█████████▎| 346855/371472 [5:25:57<1:55:13,  3.56it/s]
 93%|█████████▎| 346856/371472 [5:25:57<1:55:58,  3.54it/s]
 93%|█████████▎| 346857/371472 [5:25:57<1:54:43,  3.58it/s]
 93%|█████████▎| 346858/371472 [5:25:58<1:53:31,  3.61it/s]
 93%|█████████▎| 346859/371472 [5:25:58<1:52:17,  3.65it/s]
 93%|█████████▎| 346860/371472 [5:25:58<1:55:52,  3.54it/s]
                                                           
{'loss': 2.6251, 'learning_rate': 1.596619190243272e-07, 'epoch': 14.94}

 93%|█████████▎| 346860/371472 [5:25:58<1:55:52,  3.54it/s]
 93%|█████████▎| 346861/371472 [5:25:59<2:07:20,  3.22it/s]
 93%|█████████▎| 346862/371472 [5:25:59<2:02:56,  3.34it/s]
 93%|█████████▎| 346863/371472 [5:25:59<2:05:20,  3.27it/s]
 93%|█████████▎| 346864/371472 [5:26:00<2:15:57,  3.02it/s]
 93%|█████████▎| 346865/371472 [5:26:00<2:05:59,  3.26it/s]
 93%|█████████▎| 346866/371472 [5:26:00<1:58:47,  3.45it/s]
 93%|█████████▎| 346867/371472 [5:26:01<2:03:59,  3.31it/s]
 93%|█████████▎| 346868/371472 [5:26:01<2:02:54,  3.34it/s]
 93%|█████████▎| 346869/371472 [5:26:01<2:06:45,  3.24it/s]
 93%|█████████▎| 346870/371472 [5:26:01<2:02:49,  3.34it/s]
 93%|█████████▎| 346871/371472 [5:26:02<2:13:41,  3.07it/s]
 93%|█████████▎| 346872/371472 [5:26:02<2:08:11,  3.20it/s]
 93%|█████████▎| 346873/371472 [5:26:02<2:02:49,  3.34it/s]
 93%|█████████▎| 346874/371472 [5:26:03<2:06:12,  3.25it/s]
 93%|█████████▎| 346875/371472 [5:26:03<2:05:18,  3.27it/s]
 93%|█████████▎| 346876/371472 [5:26:03<1:59:37,  3.43it/s]
 93%|█████████▎| 346877/371472 [5:26:04<2:12:31,  3.09it/s]
 93%|█████████▎| 346878/371472 [5:26:04<2:06:21,  3.24it/s]
 93%|█████████▎| 346879/371472 [5:26:04<2:00:01,  3.42it/s]
 93%|█████████▎| 346880/371472 [5:26:04<1:57:53,  3.48it/s]
                                                           
{'loss': 2.61, 'learning_rate': 1.5961343704884824e-07, 'epoch': 14.94}

 93%|█████████▎| 346880/371472 [5:26:04<1:57:53,  3.48it/s]
 93%|█████████▎| 346881/371472 [5:26:05<1:58:20,  3.46it/s]
 93%|█████████▎| 346882/371472 [5:26:05<1:52:50,  3.63it/s]
 93%|█████████▎| 346883/371472 [5:26:05<1:54:44,  3.57it/s]
 93%|█████████▎| 346884/371472 [5:26:06<1:56:04,  3.53it/s]
 93%|█████████▎| 346885/371472 [5:26:06<1:55:27,  3.55it/s]
 93%|█████████▎| 346886/371472 [5:26:06<1:57:24,  3.49it/s]
 93%|█████████▎| 346887/371472 [5:26:06<1:55:30,  3.55it/s]
 93%|█████████▎| 346888/371472 [5:26:07<1:57:46,  3.48it/s]
 93%|█████████▎| 346889/371472 [5:26:07<1:52:39,  3.64it/s]
 93%|█████████▎| 346890/371472 [5:26:07<1:50:05,  3.72it/s]
 93%|█████████▎| 346891/371472 [5:26:08<1:58:13,  3.47it/s]
 93%|█████████▎| 346892/371472 [5:26:08<2:15:59,  3.01it/s]
 93%|█████████▎| 346893/371472 [5:26:08<2:15:54,  3.01it/s]
 93%|█████████▎| 346894/371472 [5:26:09<2:06:12,  3.25it/s]
 93%|█████████▎| 346895/371472 [5:26:09<2:04:52,  3.28it/s]
 93%|█████████▎| 346896/371472 [5:26:09<1:59:26,  3.43it/s]
 93%|█████████▎| 346897/371472 [5:26:09<1:55:54,  3.53it/s]
 93%|█████████▎| 346898/371472 [5:26:10<1:54:12,  3.59it/s]
 93%|█████████▎| 346899/371472 [5:26:10<1:53:20,  3.61it/s]
 93%|█████████▎| 346900/371472 [5:26:10<1:51:00,  3.69it/s]
                                                           
{'loss': 2.5866, 'learning_rate': 1.5956495507336942e-07, 'epoch': 14.94}

 93%|█████████▎| 346900/371472 [5:26:10<1:51:00,  3.69it/s]
 93%|█████████▎| 346901/371472 [5:26:10<1:49:48,  3.73it/s]
 93%|█████████▎| 346902/371472 [5:26:11<1:57:28,  3.49it/s]
 93%|█████████▎| 346903/371472 [5:26:11<1:57:28,  3.49it/s]
 93%|█████████▎| 346904/371472 [5:26:11<1:52:11,  3.65it/s]
 93%|█████████▎| 346905/371472 [5:26:12<1:58:29,  3.46it/s]
 93%|█████████▎| 346906/371472 [5:26:12<1:58:54,  3.44it/s]
 93%|█████████▎| 346907/371472 [5:26:12<1:54:57,  3.56it/s]
 93%|█████████▎| 346908/371472 [5:26:13<2:06:57,  3.22it/s]
 93%|█████████▎| 346909/371472 [5:26:13<2:04:47,  3.28it/s]
 93%|█████████▎| 346910/371472 [5:26:13<2:00:27,  3.40it/s]
 93%|█████████▎| 346911/371472 [5:26:13<1:58:32,  3.45it/s]
 93%|█████████▎| 346912/371472 [5:26:14<1:59:42,  3.42it/s]
 93%|█████████▎| 346913/371472 [5:26:14<1:57:58,  3.47it/s]
 93%|█████████▎| 346914/371472 [5:26:14<2:04:58,  3.28it/s]
 93%|█████████▎| 346915/371472 [5:26:15<2:11:56,  3.10it/s]
 93%|█████████▎| 346916/371472 [5:26:15<2:03:57,  3.30it/s]
 93%|█████████▎| 346917/371472 [5:26:15<1:59:37,  3.42it/s]
 93%|█████████▎| 346918/371472 [5:26:16<2:04:00,  3.30it/s]
 93%|█████████▎| 346919/371472 [5:26:16<1:56:46,  3.50it/s]
 93%|█████████▎| 346920/371472 [5:26:16<1:54:28,  3.57it/s]
                                                           
{'loss': 2.6378, 'learning_rate': 1.5951647309789047e-07, 'epoch': 14.94}

 93%|█████████▎| 346920/371472 [5:26:16<1:54:28,  3.57it/s]
 93%|█████████▎| 346921/371472 [5:26:16<1:57:28,  3.48it/s]
 93%|█████████▎| 346922/371472 [5:26:17<1:56:17,  3.52it/s]
 93%|█████████▎| 346923/371472 [5:26:17<1:56:05,  3.52it/s]
 93%|█████████▎| 346924/371472 [5:26:17<1:56:44,  3.50it/s]
 93%|█████████▎| 346925/371472 [5:26:17<1:53:43,  3.60it/s]
 93%|█████████▎| 346926/371472 [5:26:18<1:50:23,  3.71it/s]
 93%|█████████▎| 346927/371472 [5:26:18<1:50:58,  3.69it/s]
 93%|█████████▎| 346928/371472 [5:26:18<1:53:26,  3.61it/s]
 93%|█████████▎| 346929/371472 [5:26:19<1:54:14,  3.58it/s]
 93%|█████████▎| 346930/371472 [5:26:19<1:51:02,  3.68it/s]
 93%|█████████▎| 346931/371472 [5:26:19<1:50:40,  3.70it/s]
 93%|█████████▎| 346932/371472 [5:26:19<1:47:37,  3.80it/s]
 93%|█████████▎| 346933/371472 [5:26:20<1:47:46,  3.79it/s]
 93%|█████████▎| 346934/371472 [5:26:20<1:45:40,  3.87it/s]
 93%|█████████▎| 346935/371472 [5:26:20<1:50:46,  3.69it/s]
 93%|█████████▎| 346936/371472 [5:26:20<1:51:26,  3.67it/s]
 93%|█████████▎| 346937/371472 [5:26:21<1:49:13,  3.74it/s]
 93%|█████████▎| 346938/371472 [5:26:21<1:50:55,  3.69it/s]
 93%|█████████▎| 346939/371472 [5:26:21<1:50:40,  3.69it/s]
 93%|█████████▎| 346940/371472 [5:26:22<1:55:10,  3.55it/s]
                                                           
{'loss': 2.8654, 'learning_rate': 1.5946799112241162e-07, 'epoch': 14.94}

 93%|█████████▎| 346940/371472 [5:26:22<1:55:10,  3.55it/s]
 93%|█████████▎| 346941/371472 [5:26:22<1:58:00,  3.46it/s]
 93%|█████████▎| 346942/371472 [5:26:22<2:04:47,  3.28it/s]
 93%|█████████▎| 346943/371472 [5:26:22<2:01:26,  3.37it/s]
 93%|█████████▎| 346944/371472 [5:26:23<1:56:00,  3.52it/s]
 93%|█████████▎| 346945/371472 [5:26:23<2:05:13,  3.26it/s]
 93%|█████████▎| 346946/371472 [5:26:23<2:01:33,  3.36it/s]
 93%|█████████▎| 346947/371472 [5:26:24<1:58:52,  3.44it/s]
 93%|█████████▎| 346948/371472 [5:26:24<2:03:18,  3.31it/s]
 93%|█████████▎| 346949/371472 [5:26:24<2:00:20,  3.40it/s]
 93%|█████████▎| 346950/371472 [5:26:25<2:04:04,  3.29it/s]
 93%|█████████▎| 346951/371472 [5:26:25<2:02:38,  3.33it/s]
 93%|█████████▎| 346952/371472 [5:26:25<1:59:33,  3.42it/s]
 93%|█████████▎| 346953/371472 [5:26:25<1:57:50,  3.47it/s]
 93%|█████████▎| 346954/371472 [5:26:26<1:56:26,  3.51it/s]
 93%|█████████▎| 346955/371472 [5:26:26<1:56:15,  3.51it/s]
 93%|█████████▎| 346956/371472 [5:26:26<2:01:40,  3.36it/s]
 93%|█████████▎| 346957/371472 [5:26:27<1:56:01,  3.52it/s]
 93%|█████████▎| 346958/371472 [5:26:27<1:51:21,  3.67it/s]
 93%|█████████▎| 346959/371472 [5:26:27<1:49:15,  3.74it/s]
 93%|█████████▎| 346960/371472 [5:26:27<1:46:02,  3.85it/s]
                                                           
{'loss': 2.5892, 'learning_rate': 1.594195091469327e-07, 'epoch': 14.94}

 93%|█████████▎| 346960/371472 [5:26:27<1:46:02,  3.85it/s]
 93%|█████████▎| 346961/371472 [5:26:28<1:47:21,  3.81it/s]
 93%|█████████▎| 346962/371472 [5:26:28<1:49:54,  3.72it/s]
 93%|█████████▎| 346963/371472 [5:26:28<1:49:25,  3.73it/s]
 93%|█████████▎| 346964/371472 [5:26:28<1:47:56,  3.78it/s]
 93%|█████████▎| 346965/371472 [5:26:29<1:55:13,  3.54it/s]
 93%|█████████▎| 346966/371472 [5:26:29<1:54:32,  3.57it/s]
 93%|█████████▎| 346967/371472 [5:26:29<1:52:26,  3.63it/s]
 93%|█████████▎| 346968/371472 [5:26:30<2:02:29,  3.33it/s]
 93%|█████████▎| 346969/371472 [5:26:30<2:03:21,  3.31it/s]
 93%|█████████▎| 346970/371472 [5:26:30<1:57:04,  3.49it/s]
 93%|█████████▎| 346971/371472 [5:26:30<1:52:48,  3.62it/s]
 93%|█████████▎| 346972/371472 [5:26:31<1:50:35,  3.69it/s]
 93%|█████████▎| 346973/371472 [5:26:31<1:54:47,  3.56it/s]
 93%|█████████▎| 346974/371472 [5:26:31<2:02:22,  3.34it/s]
 93%|█████████▎| 346975/371472 [5:26:32<1:55:52,  3.52it/s]
 93%|█████████▎| 346976/371472 [5:26:32<1:54:41,  3.56it/s]
 93%|█████████▎| 346977/371472 [5:26:32<1:55:33,  3.53it/s]
 93%|█████████▎| 346978/371472 [5:26:32<1:50:04,  3.71it/s]
 93%|█████████▎| 346979/371472 [5:26:33<1:47:58,  3.78it/s]
 93%|█████████▎| 346980/371472 [5:26:33<1:52:23,  3.63it/s]
                                                           
{'loss': 2.6767, 'learning_rate': 1.5937102717145384e-07, 'epoch': 14.95}

 93%|█████████▎| 346980/371472 [5:26:33<1:52:23,  3.63it/s]
 93%|█████████▎| 346981/371472 [5:26:33<1:56:33,  3.50it/s]
 93%|█████████▎| 346982/371472 [5:26:33<1:54:48,  3.56it/s]
 93%|█████████▎| 346983/371472 [5:26:34<2:02:22,  3.34it/s]
 93%|█████████▎| 346984/371472 [5:26:34<2:00:19,  3.39it/s]
 93%|█████████▎| 346985/371472 [5:26:34<1:58:15,  3.45it/s]
 93%|█████████▎| 346986/371472 [5:26:35<1:56:44,  3.50it/s]
 93%|█████████▎| 346987/371472 [5:26:35<1:55:31,  3.53it/s]
 93%|█████████▎| 346988/371472 [5:26:35<2:00:44,  3.38it/s]
 93%|█████████▎| 346989/371472 [5:26:36<2:00:56,  3.37it/s]
 93%|█████████▎| 346990/371472 [5:26:36<2:11:23,  3.11it/s]
 93%|█████████▎| 346991/371472 [5:26:36<2:07:38,  3.20it/s]
 93%|█████████▎| 346992/371472 [5:26:37<2:08:08,  3.18it/s]
 93%|█████████▎| 346993/371472 [5:26:37<2:05:07,  3.26it/s]
 93%|█████████▎| 346994/371472 [5:26:37<2:03:36,  3.30it/s]
 93%|█████████▎| 346995/371472 [5:26:37<1:59:07,  3.42it/s]
 93%|█████████▎| 346996/371472 [5:26:38<1:54:09,  3.57it/s]
 93%|█████████▎| 346997/371472 [5:26:38<1:53:04,  3.61it/s]
 93%|█████████▎| 346998/371472 [5:26:38<1:52:58,  3.61it/s]
 93%|█████████▎| 346999/371472 [5:26:39<1:56:00,  3.52it/s]
 93%|█████████▎| 347000/371472 [5:26:39<1:59:12,  3.42it/s]
                                                           
{'loss': 2.6672, 'learning_rate': 1.593225451959749e-07, 'epoch': 14.95}

 93%|█████████▎| 347000/371472 [5:26:39<1:59:12,  3.42it/s]
 93%|█████████▎| 347001/371472 [5:26:39<1:55:24,  3.53it/s]
 93%|█████████▎| 347002/371472 [5:26:39<1:57:46,  3.46it/s]
 93%|█████████▎| 347003/371472 [5:26:40<2:01:18,  3.36it/s]
 93%|█████████▎| 347004/371472 [5:26:40<2:04:26,  3.28it/s]
 93%|█████████▎| 347005/371472 [5:26:40<1:59:00,  3.43it/s]
 93%|█████████▎| 347006/371472 [5:26:41<1:56:58,  3.49it/s]
 93%|█████████▎| 347007/371472 [5:26:41<1:55:18,  3.54it/s]
 93%|█████████▎| 347008/371472 [5:26:41<1:51:06,  3.67it/s]
 93%|█████████▎| 347009/371472 [5:26:41<1:53:21,  3.60it/s]
 93%|█████████▎| 347010/371472 [5:26:42<2:00:12,  3.39it/s]
 93%|█████████▎| 347011/371472 [5:26:42<1:55:03,  3.54it/s]
 93%|█████████▎| 347012/371472 [5:26:42<1:57:39,  3.47it/s]
 93%|█████████▎| 347013/371472 [5:26:43<1:58:11,  3.45it/s]
 93%|█████████▎| 347014/371472 [5:26:43<1:58:24,  3.44it/s]
 93%|█████████▎| 347015/371472 [5:26:43<2:00:24,  3.39it/s]
 93%|█████████▎| 347016/371472 [5:26:43<1:57:47,  3.46it/s]
 93%|█████████▎| 347017/371472 [5:26:44<2:04:36,  3.27it/s]
 93%|█████████▎| 347018/371472 [5:26:44<1:59:26,  3.41it/s]
 93%|█████████▎| 347019/371472 [5:26:44<2:02:19,  3.33it/s]
 93%|█████████▎| 347020/371472 [5:26:45<2:03:07,  3.31it/s]
                                                           
{'loss': 2.6397, 'learning_rate': 1.5927406322049606e-07, 'epoch': 14.95}

 93%|█████████▎| 347020/371472 [5:26:45<2:03:07,  3.31it/s]
 93%|█████████▎| 347021/371472 [5:26:45<1:58:13,  3.45it/s]
 93%|█████████▎| 347022/371472 [5:26:45<2:01:53,  3.34it/s]
 93%|█████████▎| 347023/371472 [5:26:46<2:00:14,  3.39it/s]
 93%|█████████▎| 347024/371472 [5:26:46<1:58:42,  3.43it/s]
 93%|█████████▎| 347025/371472 [5:26:46<1:54:31,  3.56it/s]
 93%|█████████▎| 347026/371472 [5:26:46<1:52:20,  3.63it/s]
 93%|█████████▎| 347027/371472 [5:26:47<1:50:48,  3.68it/s]
 93%|█████████▎| 347028/371472 [5:26:47<1:49:38,  3.72it/s]
 93%|█████████▎| 347029/371472 [5:26:47<1:59:12,  3.42it/s]
 93%|█████████▎| 347030/371472 [5:26:47<1:59:11,  3.42it/s]
 93%|█████████▎| 347031/371472 [5:26:48<1:59:52,  3.40it/s]
 93%|█████████▎| 347032/371472 [5:26:48<1:59:52,  3.40it/s]
 93%|█████████▎| 347033/371472 [5:26:48<1:58:00,  3.45it/s]
 93%|█████████▎| 347034/371472 [5:26:49<1:52:56,  3.61it/s]
 93%|█████████▎| 347035/371472 [5:26:49<1:56:37,  3.49it/s]
 93%|█████████▎| 347036/371472 [5:26:49<1:52:53,  3.61it/s]
 93%|█████████▎| 347037/371472 [5:26:49<1:54:14,  3.56it/s]
 93%|█████████▎| 347038/371472 [5:26:50<1:47:32,  3.79it/s]
 93%|█████████▎| 347039/371472 [5:26:50<1:45:50,  3.85it/s]
 93%|█████████▎| 347040/371472 [5:26:50<1:51:26,  3.65it/s]
                                                           
{'loss': 2.578, 'learning_rate': 1.592255812450171e-07, 'epoch': 14.95}

 93%|█████████▎| 347040/371472 [5:26:50<1:51:26,  3.65it/s]
 93%|█████████▎| 347041/371472 [5:26:51<1:54:06,  3.57it/s]
 93%|█████████▎| 347042/371472 [5:26:51<1:51:28,  3.65it/s]
 93%|█████████▎| 347043/371472 [5:26:51<1:51:30,  3.65it/s]
 93%|█████████▎| 347044/371472 [5:26:51<1:48:21,  3.76it/s]
 93%|█████████▎| 347045/371472 [5:26:52<1:58:52,  3.42it/s]
 93%|█████████▎| 347046/371472 [5:26:52<2:04:02,  3.28it/s]
 93%|█████████▎| 347047/371472 [5:26:52<2:01:53,  3.34it/s]
 93%|█████████▎| 347048/371472 [5:26:53<1:59:37,  3.40it/s]
 93%|█████████▎| 347049/371472 [5:26:53<1:55:04,  3.54it/s]
 93%|█████████▎| 347050/371472 [5:26:53<1:52:47,  3.61it/s]
 93%|█████████▎| 347051/371472 [5:26:53<1:52:46,  3.61it/s]
 93%|█████████▎| 347052/371472 [5:26:54<1:49:55,  3.70it/s]
 93%|█████████▎| 347053/371472 [5:26:54<1:49:33,  3.71it/s]
 93%|█████████▎| 347054/371472 [5:26:54<1:58:51,  3.42it/s]
 93%|█████████▎| 347055/371472 [5:26:55<1:55:28,  3.52it/s]
 93%|█████████▎| 347056/371472 [5:26:55<1:50:47,  3.67it/s]
 93%|█████████▎| 347057/371472 [5:26:55<1:51:16,  3.66it/s]
 93%|█████████▎| 347058/371472 [5:26:55<1:49:57,  3.70it/s]
 93%|█████████▎| 347059/371472 [5:26:56<1:49:10,  3.73it/s]
 93%|█████████▎| 347060/371472 [5:26:56<1:53:45,  3.58it/s]
                                                           
{'loss': 2.5094, 'learning_rate': 1.5917709926953826e-07, 'epoch': 14.95}

 93%|█████████▎| 347060/371472 [5:26:56<1:53:45,  3.58it/s]
 93%|█████████▎| 347061/371472 [5:26:56<1:50:45,  3.67it/s]
 93%|█████████▎| 347062/371472 [5:26:56<1:50:23,  3.69it/s]
 93%|█████████▎| 347063/371472 [5:26:57<1:50:32,  3.68it/s]
 93%|█████████▎| 347064/371472 [5:26:57<1:48:28,  3.75it/s]
 93%|█████████▎| 347065/371472 [5:26:57<1:49:49,  3.70it/s]
 93%|█████████▎| 347066/371472 [5:26:57<1:50:01,  3.70it/s]
 93%|█████████▎| 347067/371472 [5:26:58<1:52:49,  3.61it/s]
 93%|█████████▎| 347068/371472 [5:26:58<1:54:29,  3.55it/s]
 93%|█████████▎| 347069/371472 [5:26:58<2:04:11,  3.27it/s]
 93%|█████████▎| 347070/371472 [5:26:59<2:06:21,  3.22it/s]
 93%|█████████▎| 347071/371472 [5:26:59<2:03:29,  3.29it/s]
 93%|█████████▎| 347072/371472 [5:26:59<1:57:42,  3.45it/s]
 93%|█████████▎| 347073/371472 [5:27:00<1:51:47,  3.64it/s]
 93%|█████████▎| 347074/371472 [5:27:00<1:50:13,  3.69it/s]
 93%|█████████▎| 347075/371472 [5:27:00<1:51:56,  3.63it/s]
 93%|█████████▎| 347076/371472 [5:27:00<1:53:10,  3.59it/s]
 93%|█████████▎| 347077/371472 [5:27:01<1:50:06,  3.69it/s]
 93%|█████████▎| 347078/371472 [5:27:01<1:53:03,  3.60it/s]
 93%|█████████▎| 347079/371472 [5:27:01<1:56:08,  3.50it/s]
 93%|█████████▎| 347080/371472 [5:27:01<1:53:44,  3.57it/s]
                                                           
{'loss': 2.5147, 'learning_rate': 1.5912861729405933e-07, 'epoch': 14.95}

 93%|█████████▎| 347080/371472 [5:27:01<1:53:44,  3.57it/s]
 93%|█████████▎| 347081/371472 [5:27:02<1:49:57,  3.70it/s]
 93%|█████████▎| 347082/371472 [5:27:02<1:46:03,  3.83it/s]
 93%|█████████▎| 347083/371472 [5:27:02<1:44:35,  3.89it/s]
 93%|█████████▎| 347084/371472 [5:27:02<1:48:04,  3.76it/s]
 93%|█████████▎| 347085/371472 [5:27:03<1:49:31,  3.71it/s]
 93%|█████████▎| 347086/371472 [5:27:03<1:52:58,  3.60it/s]
 93%|█████████▎| 347087/371472 [5:27:03<1:57:11,  3.47it/s]
 93%|█████████▎| 347088/371472 [5:27:04<2:02:54,  3.31it/s]
 93%|█████████▎| 347089/371472 [5:27:04<2:03:06,  3.30it/s]
 93%|█████████▎| 347090/371472 [5:27:04<2:03:04,  3.30it/s]
 93%|█████████▎| 347091/371472 [5:27:05<2:00:28,  3.37it/s]
 93%|█████████▎| 347092/371472 [5:27:05<1:59:09,  3.41it/s]
 93%|█████████▎| 347093/371472 [5:27:05<1:59:52,  3.39it/s]
 93%|█████████▎| 347094/371472 [5:27:05<1:58:36,  3.43it/s]
 93%|█████████▎| 347095/371472 [5:27:06<1:53:38,  3.58it/s]
 93%|█████████▎| 347096/371472 [5:27:06<1:54:07,  3.56it/s]
 93%|█████████▎| 347097/371472 [5:27:06<2:00:18,  3.38it/s]
 93%|█████████▎| 347098/371472 [5:27:07<1:53:34,  3.58it/s]
 93%|█████████▎| 347099/371472 [5:27:07<1:51:20,  3.65it/s]
 93%|█████████▎| 347100/371472 [5:27:07<1:50:59,  3.66it/s]
                                                           
{'loss': 2.6778, 'learning_rate': 1.5908013531858048e-07, 'epoch': 14.95}

 93%|█████████▎| 347100/371472 [5:27:07<1:50:59,  3.66it/s]
 93%|█████████▎| 347101/371472 [5:27:07<1:53:16,  3.59it/s]
 93%|█████████▎| 347102/371472 [5:27:08<1:52:37,  3.61it/s]
 93%|█████████▎| 347103/371472 [5:27:08<1:56:36,  3.48it/s]
 93%|█████████▎| 347104/371472 [5:27:08<1:55:05,  3.53it/s]
 93%|█████████▎| 347105/371472 [5:27:09<2:06:01,  3.22it/s]
 93%|█████████▎| 347106/371472 [5:27:09<2:06:53,  3.20it/s]
 93%|█████████▎| 347107/371472 [5:27:09<2:02:08,  3.32it/s]
 93%|█████████▎| 347108/371472 [5:27:09<1:58:33,  3.43it/s]
 93%|█████████▎| 347109/371472 [5:27:10<1:58:49,  3.42it/s]
 93%|█████████▎| 347110/371472 [5:27:10<1:55:23,  3.52it/s]
 93%|█████████▎| 347111/371472 [5:27:10<1:51:06,  3.65it/s]
 93%|█████████▎| 347112/371472 [5:27:11<1:51:24,  3.64it/s]
 93%|█████████▎| 347113/371472 [5:27:11<1:50:05,  3.69it/s]
 93%|█████████▎| 347114/371472 [5:27:11<1:51:24,  3.64it/s]
 93%|█████████▎| 347115/371472 [5:27:11<1:49:25,  3.71it/s]
 93%|█████████▎| 347116/371472 [5:27:12<2:05:01,  3.25it/s]
 93%|█████████▎| 347117/371472 [5:27:12<1:57:01,  3.47it/s]
 93%|█████████▎| 347118/371472 [5:27:12<1:59:08,  3.41it/s]
 93%|█████████▎| 347119/371472 [5:27:13<1:55:24,  3.52it/s]
 93%|█████████▎| 347120/371472 [5:27:13<1:55:22,  3.52it/s]
                                                           
{'loss': 2.5951, 'learning_rate': 1.5903165334310155e-07, 'epoch': 14.95}

 93%|█████████▎| 347120/371472 [5:27:13<1:55:22,  3.52it/s]
 93%|█████████▎| 347121/371472 [5:27:13<1:51:57,  3.62it/s]
 93%|█████████▎| 347122/371472 [5:27:13<1:53:00,  3.59it/s]
 93%|█████████▎| 347123/371472 [5:27:14<1:57:44,  3.45it/s]
 93%|█████████▎| 347124/371472 [5:27:14<1:54:20,  3.55it/s]
 93%|█████████▎| 347125/371472 [5:27:14<1:52:05,  3.62it/s]
 93%|█████████▎| 347126/371472 [5:27:15<1:54:57,  3.53it/s]
 93%|█████████▎| 347127/371472 [5:27:15<1:52:53,  3.59it/s]
 93%|█████████▎| 347128/371472 [5:27:15<1:57:02,  3.47it/s]
 93%|█████████▎| 347129/371472 [5:27:15<1:55:16,  3.52it/s]
 93%|█████████▎| 347130/371472 [5:27:16<1:52:28,  3.61it/s]
 93%|█████████▎| 347131/371472 [5:27:16<1:50:15,  3.68it/s]
 93%|█████████▎| 347132/371472 [5:27:16<1:58:07,  3.43it/s]
 93%|█████████▎| 347133/371472 [5:27:17<1:59:13,  3.40it/s]
 93%|█████████▎| 347134/371472 [5:27:17<1:53:47,  3.56it/s]
 93%|█████████▎| 347135/371472 [5:27:17<1:54:19,  3.55it/s]
 93%|█████████▎| 347136/371472 [5:27:17<1:55:43,  3.51it/s]
 93%|█████████▎| 347137/371472 [5:27:18<2:09:11,  3.14it/s]
 93%|█████████▎| 347138/371472 [5:27:18<2:04:20,  3.26it/s]
 93%|█████████▎| 347139/371472 [5:27:18<1:59:52,  3.38it/s]
 93%|█████████▎| 347140/371472 [5:27:19<2:01:29,  3.34it/s]
                                                           
{'loss': 2.6057, 'learning_rate': 1.589831713676226e-07, 'epoch': 14.95}

 93%|█████████▎| 347140/371472 [5:27:19<2:01:29,  3.34it/s]
 93%|█████████▎| 347141/371472 [5:27:19<1:58:43,  3.42it/s]
 93%|█████████▎| 347142/371472 [5:27:19<1:57:31,  3.45it/s]
 93%|█████████▎| 347143/371472 [5:27:20<2:06:40,  3.20it/s]
 93%|█████████▎| 347144/371472 [5:27:20<2:04:30,  3.26it/s]
 93%|█████████▎| 347145/371472 [5:27:20<2:00:30,  3.36it/s]
 93%|█████████▎| 347146/371472 [5:27:20<1:57:11,  3.46it/s]
 93%|█████████▎| 347147/371472 [5:27:21<1:54:30,  3.54it/s]
 93%|█████████▎| 347148/371472 [5:27:21<2:23:53,  2.82it/s]
 93%|█████████▎| 347149/371472 [5:27:21<2:13:43,  3.03it/s]
 93%|█████████▎| 347150/371472 [5:27:22<2:07:29,  3.18it/s]
 93%|█████████▎| 347151/371472 [5:27:22<2:02:23,  3.31it/s]
 93%|█████████▎| 347152/371472 [5:27:22<2:02:23,  3.31it/s]
 93%|█████████▎| 347153/371472 [5:27:23<2:00:44,  3.36it/s]
 93%|█████████▎| 347154/371472 [5:27:23<1:56:49,  3.47it/s]
 93%|█████████▎| 347155/371472 [5:27:23<1:55:04,  3.52it/s]
 93%|█████████▎| 347156/371472 [5:27:23<1:53:31,  3.57it/s]
 93%|█████████▎| 347157/371472 [5:27:24<1:56:00,  3.49it/s]
 93%|█████████▎| 347158/371472 [5:27:24<1:56:03,  3.49it/s]
 93%|█████████▎| 347159/371472 [5:27:24<1:55:19,  3.51it/s]
 93%|█████████▎| 347160/371472 [5:27:25<1:56:10,  3.49it/s]
                                                           
{'loss': 2.6166, 'learning_rate': 1.5893468939214377e-07, 'epoch': 14.95}

 93%|█████████▎| 347160/371472 [5:27:25<1:56:10,  3.49it/s]
 93%|█████████▎| 347161/371472 [5:27:25<2:08:00,  3.17it/s]
 93%|█████████▎| 347162/371472 [5:27:25<2:00:10,  3.37it/s]
 93%|█████████▎| 347163/371472 [5:27:26<2:01:17,  3.34it/s]
 93%|█████████▎| 347164/371472 [5:27:26<1:59:51,  3.38it/s]
 93%|█████████▎| 347165/371472 [5:27:26<1:58:23,  3.42it/s]
 93%|█████████▎| 347166/371472 [5:27:26<1:52:49,  3.59it/s]
 93%|█████████▎| 347167/371472 [5:27:27<1:53:33,  3.57it/s]
 93%|█████████▎| 347168/371472 [5:27:27<1:55:09,  3.52it/s]
 93%|█████████▎| 347169/371472 [5:27:27<1:54:01,  3.55it/s]
 93%|█████████▎| 347170/371472 [5:27:28<2:03:02,  3.29it/s]
 93%|█████████▎| 347171/371472 [5:27:28<1:58:08,  3.43it/s]
 93%|█████████▎| 347172/371472 [5:27:28<1:53:35,  3.57it/s]
 93%|█████████▎| 347173/371472 [5:27:28<1:55:01,  3.52it/s]
 93%|█████████▎| 347174/371472 [5:27:29<1:50:02,  3.68it/s]
 93%|█████████▎| 347175/371472 [5:27:29<1:57:37,  3.44it/s]
 93%|█████████▎| 347176/371472 [5:27:29<1:54:45,  3.53it/s]
 93%|█████████▎| 347177/371472 [5:27:30<2:23:23,  2.82it/s]
 93%|█████████▎| 347178/371472 [5:27:30<2:12:50,  3.05it/s]
 93%|█████████▎| 347179/371472 [5:27:30<2:08:08,  3.16it/s]
 93%|█████████▎| 347180/371472 [5:27:31<2:05:35,  3.22it/s]
                                                           
{'loss': 2.6152, 'learning_rate': 1.5888620741666482e-07, 'epoch': 14.95}

 93%|█████████▎| 347180/371472 [5:27:31<2:05:35,  3.22it/s]
 93%|█████████▎| 347181/371472 [5:27:31<2:06:28,  3.20it/s]
 93%|█████████▎| 347182/371472 [5:27:31<2:04:15,  3.26it/s]
 93%|█████████▎| 347183/371472 [5:27:31<1:58:56,  3.40it/s]
 93%|█████████▎| 347184/371472 [5:27:32<2:00:01,  3.37it/s]
 93%|█████████▎| 347185/371472 [5:27:32<1:56:39,  3.47it/s]
 93%|█████████▎| 347186/371472 [5:27:32<1:55:47,  3.50it/s]
 93%|█████████▎| 347187/371472 [5:27:33<1:55:21,  3.51it/s]
 93%|█████████▎| 347188/371472 [5:27:33<1:55:33,  3.50it/s]
 93%|█████████▎| 347189/371472 [5:27:33<2:03:03,  3.29it/s]
 93%|█████████▎| 347190/371472 [5:27:33<1:58:51,  3.40it/s]
 93%|█████████▎| 347191/371472 [5:27:34<1:57:49,  3.43it/s]
 93%|█████████▎| 347192/371472 [5:27:34<2:04:37,  3.25it/s]
 93%|█████████▎| 347193/371472 [5:27:34<2:08:55,  3.14it/s]
 93%|█████████▎| 347194/371472 [5:27:35<2:01:07,  3.34it/s]
 93%|█████████▎| 347195/371472 [5:27:35<1:58:01,  3.43it/s]
 93%|█████████▎| 347196/371472 [5:27:35<1:54:26,  3.54it/s]
 93%|█████████▎| 347197/371472 [5:27:36<2:01:58,  3.32it/s]
 93%|█████████▎| 347198/371472 [5:27:36<2:00:30,  3.36it/s]
 93%|█████████▎| 347199/371472 [5:27:36<2:02:28,  3.30it/s]
 93%|█████████▎| 347200/371472 [5:27:36<1:59:58,  3.37it/s]
                                                           
{'loss': 2.4921, 'learning_rate': 1.58837725441186e-07, 'epoch': 14.95}

 93%|█████████▎| 347200/371472 [5:27:36<1:59:58,  3.37it/s]
 93%|█████████▎| 347201/371472 [5:27:37<1:57:26,  3.44it/s]
 93%|█████████▎| 347202/371472 [5:27:37<1:56:10,  3.48it/s]
 93%|█████████▎| 347203/371472 [5:27:37<1:51:57,  3.61it/s]
 93%|█████████▎| 347204/371472 [5:27:38<1:48:29,  3.73it/s]
 93%|█████████▎| 347205/371472 [5:27:38<1:51:13,  3.64it/s]
 93%|█████████▎| 347206/371472 [5:27:38<1:54:15,  3.54it/s]
 93%|█████████▎| 347207/371472 [5:27:38<1:49:27,  3.69it/s]
 93%|█████████▎| 347208/371472 [5:27:39<1:49:19,  3.70it/s]
 93%|█████████▎| 347209/371472 [5:27:39<1:54:47,  3.52it/s]
 93%|█████████▎| 347210/371472 [5:27:39<2:07:48,  3.16it/s]
 93%|█████████▎| 347211/371472 [5:27:40<2:03:28,  3.27it/s]
 93%|█████████▎| 347212/371472 [5:27:40<2:01:21,  3.33it/s]
 93%|█████████▎| 347213/371472 [5:27:40<1:54:41,  3.53it/s]
 93%|█████████▎| 347214/371472 [5:27:40<1:58:28,  3.41it/s]
 93%|█████████▎| 347215/371472 [5:27:41<1:54:41,  3.53it/s]
 93%|█████████▎| 347216/371472 [5:27:41<1:59:05,  3.39it/s]
 93%|█████████▎| 347217/371472 [5:27:41<1:54:14,  3.54it/s]
 93%|█████████▎| 347218/371472 [5:27:42<1:52:24,  3.60it/s]
 93%|█████████▎| 347219/371472 [5:27:42<1:51:19,  3.63it/s]
 93%|█████████▎| 347220/371472 [5:27:42<1:53:09,  3.57it/s]
                                                           
{'loss': 2.4822, 'learning_rate': 1.5878924346570704e-07, 'epoch': 14.96}

 93%|█████████▎| 347220/371472 [5:27:42<1:53:09,  3.57it/s]
 93%|█████████▎| 347221/371472 [5:27:42<1:55:14,  3.51it/s]
 93%|█████████▎| 347222/371472 [5:27:43<1:52:19,  3.60it/s]
 93%|█████████▎| 347223/371472 [5:27:43<1:58:21,  3.41it/s]
 93%|█████████▎| 347224/371472 [5:27:43<1:54:53,  3.52it/s]
 93%|█████████▎| 347225/371472 [5:27:44<1:57:22,  3.44it/s]
 93%|█████████▎| 347226/371472 [5:27:44<1:56:37,  3.47it/s]
 93%|█████████▎| 347227/371472 [5:27:44<1:54:07,  3.54it/s]
 93%|█████████▎| 347228/371472 [5:27:44<1:53:43,  3.55it/s]
 93%|█████████▎| 347229/371472 [5:27:45<1:50:06,  3.67it/s]
 93%|█████████▎| 347230/371472 [5:27:45<1:51:02,  3.64it/s]
 93%|█████████▎| 347231/371472 [5:27:45<1:50:30,  3.66it/s]
 93%|█████████▎| 347232/371472 [5:27:46<1:54:04,  3.54it/s]
 93%|█████████▎| 347233/371472 [5:27:46<1:51:09,  3.63it/s]
 93%|█████████▎| 347234/371472 [5:27:46<1:49:51,  3.68it/s]
 93%|█████████▎| 347235/371472 [5:27:46<1:49:09,  3.70it/s]
 93%|█████████▎| 347236/371472 [5:27:47<1:53:38,  3.55it/s]
 93%|█████████▎| 347237/371472 [5:27:47<1:54:54,  3.52it/s]
 93%|█████████▎| 347238/371472 [5:27:47<1:56:53,  3.46it/s]
 93%|█████████▎| 347239/371472 [5:27:47<1:53:10,  3.57it/s]
 93%|█████████▎| 347240/371472 [5:27:48<1:50:59,  3.64it/s]
                                                           
{'loss': 2.6956, 'learning_rate': 1.587407614902282e-07, 'epoch': 14.96}

 93%|█████████▎| 347240/371472 [5:27:48<1:50:59,  3.64it/s]
 93%|█████████▎| 347241/371472 [5:27:48<1:50:56,  3.64it/s]
 93%|█████████▎| 347242/371472 [5:27:48<1:48:55,  3.71it/s]
 93%|█████████▎| 347243/371472 [5:27:49<1:47:11,  3.77it/s]
 93%|█████████▎| 347244/371472 [5:27:49<1:54:43,  3.52it/s]
 93%|█████████▎| 347245/371472 [5:27:49<1:49:30,  3.69it/s]
 93%|█████████▎| 347246/371472 [5:27:49<1:48:18,  3.73it/s]
 93%|█████████▎| 347247/371472 [5:27:50<1:59:54,  3.37it/s]
 93%|█████████▎| 347248/371472 [5:27:50<1:55:36,  3.49it/s]
 93%|█████████▎| 347249/371472 [5:27:50<1:52:51,  3.58it/s]
 93%|█████████▎| 347250/371472 [5:27:51<1:50:16,  3.66it/s]
 93%|█████████▎| 347251/371472 [5:27:51<1:51:44,  3.61it/s]
 93%|█████████▎| 347252/371472 [5:27:51<1:55:54,  3.48it/s]
 93%|█████████▎| 347253/371472 [5:27:51<1:57:16,  3.44it/s]
 93%|█████████▎| 347254/371472 [5:27:52<2:05:03,  3.23it/s]
 93%|█████████▎| 347255/371472 [5:27:52<2:00:42,  3.34it/s]
 93%|█████████▎| 347256/371472 [5:27:52<2:00:29,  3.35it/s]
 93%|█████████▎| 347257/371472 [5:27:53<2:07:53,  3.16it/s]
 93%|█████████▎| 347258/371472 [5:27:53<1:59:10,  3.39it/s]
 93%|█████████▎| 347259/371472 [5:27:53<2:02:16,  3.30it/s]
 93%|█████████▎| 347260/371472 [5:27:54<2:02:06,  3.30it/s]
                                                           
{'loss': 2.6404, 'learning_rate': 1.5869227951474924e-07, 'epoch': 14.96}

 93%|█████████▎| 347260/371472 [5:27:54<2:02:06,  3.30it/s]
 93%|█████████▎| 347261/371472 [5:27:54<1:58:13,  3.41it/s]
 93%|█████████▎| 347262/371472 [5:27:54<1:56:36,  3.46it/s]
 93%|█████████▎| 347263/371472 [5:27:54<1:58:48,  3.40it/s]
 93%|█████████▎| 347264/371472 [5:27:55<2:02:32,  3.29it/s]
 93%|█████████▎| 347265/371472 [5:27:55<2:09:55,  3.11it/s]
 93%|█████████▎| 347266/371472 [5:27:55<2:01:56,  3.31it/s]
 93%|█████████▎| 347267/371472 [5:27:56<1:56:27,  3.46it/s]
 93%|█████████▎| 347268/371472 [5:27:56<1:55:55,  3.48it/s]
 93%|█████████▎| 347269/371472 [5:27:56<1:58:27,  3.41it/s]
 93%|█████████▎| 347270/371472 [5:27:56<1:57:02,  3.45it/s]
 93%|█████████▎| 347271/371472 [5:27:57<2:02:07,  3.30it/s]
 93%|█████████▎| 347272/371472 [5:27:57<2:04:35,  3.24it/s]
 93%|█████████▎| 347273/371472 [5:27:57<2:00:56,  3.33it/s]
 93%|█████████▎| 347274/371472 [5:27:58<2:01:59,  3.31it/s]
 93%|█████████▎| 347275/371472 [5:27:58<1:57:14,  3.44it/s]
 93%|█████████▎| 347276/371472 [5:27:58<1:58:27,  3.40it/s]
 93%|█████████▎| 347277/371472 [5:27:59<2:06:50,  3.18it/s]
 93%|█████████▎| 347278/371472 [5:27:59<2:00:58,  3.33it/s]
 93%|█████████▎| 347279/371472 [5:27:59<1:56:36,  3.46it/s]
 93%|█████████▎| 347280/371472 [5:27:59<1:56:39,  3.46it/s]
                                                           
{'loss': 2.6398, 'learning_rate': 1.5864379753927041e-07, 'epoch': 14.96}

 93%|█████████▎| 347280/371472 [5:27:59<1:56:39,  3.46it/s]
 93%|█████████▎| 347281/371472 [5:28:00<1:56:26,  3.46it/s]
 93%|█████████▎| 347282/371472 [5:28:00<1:55:47,  3.48it/s]
 93%|█████████▎| 347283/371472 [5:28:00<2:02:01,  3.30it/s]
 93%|█████████▎| 347284/371472 [5:28:01<1:54:42,  3.51it/s]
 93%|█████████▎| 347285/371472 [5:28:01<1:53:35,  3.55it/s]
 93%|█████████▎| 347286/371472 [5:28:01<1:56:53,  3.45it/s]
 93%|█████████▎| 347287/371472 [5:28:01<1:54:45,  3.51it/s]
 93%|█████████▎| 347288/371472 [5:28:02<2:09:41,  3.11it/s]
 93%|█████████▎| 347289/371472 [5:28:02<2:03:18,  3.27it/s]
 93%|█████████▎| 347290/371472 [5:28:02<2:00:38,  3.34it/s]
 93%|█████████▎| 347291/371472 [5:28:03<2:01:34,  3.32it/s]
 93%|█████████▎| 347292/371472 [5:28:03<2:05:52,  3.20it/s]
 93%|█████████▎| 347293/371472 [5:28:03<2:02:50,  3.28it/s]
 93%|█████████▎| 347294/371472 [5:28:04<1:59:17,  3.38it/s]
 93%|█████████▎| 347295/371472 [5:28:04<1:55:55,  3.48it/s]
 93%|█████████▎| 347296/371472 [5:28:04<1:54:19,  3.52it/s]
 93%|█████████▎| 347297/371472 [5:28:04<1:49:43,  3.67it/s]
 93%|█████████▎| 347298/371472 [5:28:05<1:49:40,  3.67it/s]
 93%|█████████▎| 347299/371472 [5:28:05<1:46:39,  3.78it/s]
 93%|█████████▎| 347300/371472 [5:28:05<1:43:56,  3.88it/s]
                                                           
{'loss': 2.6804, 'learning_rate': 1.5859531556379146e-07, 'epoch': 14.96}

 93%|█████████▎| 347300/371472 [5:28:05<1:43:56,  3.88it/s]
 93%|█████████▎| 347301/371472 [5:28:05<1:44:28,  3.86it/s]
 93%|█████████▎| 347302/371472 [5:28:06<1:44:28,  3.86it/s]
 93%|█████████▎| 347303/371472 [5:28:06<1:54:40,  3.51it/s]
 93%|█████████▎| 347304/371472 [5:28:06<1:58:51,  3.39it/s]
 93%|█████████▎| 347305/371472 [5:28:07<1:58:02,  3.41it/s]
 93%|█████████▎| 347306/371472 [5:28:07<1:56:10,  3.47it/s]
 93%|█████████▎| 347307/371472 [5:28:07<1:54:31,  3.52it/s]
 93%|█████████▎| 347308/371472 [5:28:08<1:57:42,  3.42it/s]
 93%|█████████▎| 347309/371472 [5:28:08<1:56:03,  3.47it/s]
 93%|█████████▎| 347310/371472 [5:28:08<1:55:32,  3.49it/s]
 93%|█████████▎| 347311/371472 [5:28:08<2:01:15,  3.32it/s]
 93%|█████████▎| 347312/371472 [5:28:09<1:55:53,  3.47it/s]
 93%|█████████▎| 347313/371472 [5:28:09<1:49:58,  3.66it/s]
 93%|█████████▎| 347314/371472 [5:28:09<1:50:07,  3.66it/s]
 93%|█████████▎| 347315/371472 [5:28:10<1:52:11,  3.59it/s]
 93%|█████████▎| 347316/371472 [5:28:10<1:56:03,  3.47it/s]
 93%|█████████▎| 347317/371472 [5:28:10<1:55:48,  3.48it/s]
 93%|█████████▎| 347318/371472 [5:28:11<2:09:08,  3.12it/s]
 93%|█████████▎| 347319/371472 [5:28:11<2:05:36,  3.20it/s]
 93%|█████████▎| 347320/371472 [5:28:11<2:03:09,  3.27it/s]
                                                           
{'loss': 2.6549, 'learning_rate': 1.585468335883126e-07, 'epoch': 14.96}

 93%|█████████▎| 347320/371472 [5:28:11<2:03:09,  3.27it/s]
 93%|█████████▎| 347321/371472 [5:28:11<1:59:24,  3.37it/s]
 93%|█████████▎| 347322/371472 [5:28:12<1:56:43,  3.45it/s]
 93%|█████████▎| 347323/371472 [5:28:12<1:50:44,  3.63it/s]
 93%|█████████▎| 347324/371472 [5:28:12<1:50:52,  3.63it/s]
 93%|█████████▎| 347325/371472 [5:28:12<1:47:19,  3.75it/s]
 93%|█████████▎| 347326/371472 [5:28:13<1:43:54,  3.87it/s]
 94%|█████████▎| 347327/371472 [5:28:13<1:46:39,  3.77it/s]
 94%|█████████▎| 347328/371472 [5:28:13<1:45:03,  3.83it/s]
 94%|█████████▎| 347329/371472 [5:28:13<1:44:17,  3.86it/s]
 94%|█████████▎| 347330/371472 [5:28:14<1:47:16,  3.75it/s]
 94%|█████████▎| 347331/371472 [5:28:14<1:47:52,  3.73it/s]
 94%|█████████▎| 347332/371472 [5:28:14<1:47:14,  3.75it/s]
 94%|█████████▎| 347333/371472 [5:28:15<1:50:17,  3.65it/s]
 94%|█████████▎| 347334/371472 [5:28:15<1:52:08,  3.59it/s]
 94%|█████████▎| 347335/371472 [5:28:15<1:56:36,  3.45it/s]
 94%|█████████▎| 347336/371472 [5:28:15<1:53:39,  3.54it/s]
 94%|█████████▎| 347337/371472 [5:28:16<2:04:06,  3.24it/s]
 94%|█████████▎| 347338/371472 [5:28:16<2:02:27,  3.28it/s]
 94%|█████████▎| 347339/371472 [5:28:16<1:57:08,  3.43it/s]
 94%|█████████▎| 347340/371472 [5:28:17<1:54:40,  3.51it/s]
                                                           
{'loss': 2.6542, 'learning_rate': 1.5849835161283368e-07, 'epoch': 14.96}

 94%|█████████▎| 347340/371472 [5:28:17<1:54:40,  3.51it/s]
 94%|█████████▎| 347341/371472 [5:28:17<1:49:19,  3.68it/s]
 94%|█████████▎| 347342/371472 [5:28:17<1:48:10,  3.72it/s]
 94%|█████████▎| 347343/371472 [5:28:17<1:53:19,  3.55it/s]
 94%|█████████▎| 347344/371472 [5:28:18<1:55:53,  3.47it/s]
 94%|█████████▎| 347345/371472 [5:28:18<1:50:59,  3.62it/s]
 94%|█████████▎| 347346/371472 [5:28:18<1:49:49,  3.66it/s]
 94%|█████████▎| 347347/371472 [5:28:18<1:47:55,  3.73it/s]
 94%|█████████▎| 347348/371472 [5:28:19<1:55:55,  3.47it/s]
 94%|█████████▎| 347349/371472 [5:28:19<1:50:45,  3.63it/s]
 94%|█████████▎| 347350/371472 [5:28:19<1:48:50,  3.69it/s]
 94%|█████████▎| 347351/371472 [5:28:20<1:51:20,  3.61it/s]
 94%|█████████▎| 347352/371472 [5:28:20<1:47:28,  3.74it/s]
 94%|█████████▎| 347353/371472 [5:28:20<1:47:34,  3.74it/s]
 94%|█████████▎| 347354/371472 [5:28:20<1:48:28,  3.71it/s]
 94%|█████████▎| 347355/371472 [5:28:21<1:46:53,  3.76it/s]
 94%|█████████▎| 347356/371472 [5:28:21<1:46:24,  3.78it/s]
 94%|█████████▎| 347357/371472 [5:28:21<1:51:43,  3.60it/s]
 94%|█████████▎| 347358/371472 [5:28:22<1:56:52,  3.44it/s]
 94%|█████████▎| 347359/371472 [5:28:22<1:53:35,  3.54it/s]
 94%|█████████▎| 347360/371472 [5:28:22<1:51:06,  3.62it/s]
                                                           
{'loss': 2.5142, 'learning_rate': 1.5844986963735483e-07, 'epoch': 14.96}

 94%|█████████▎| 347360/371472 [5:28:22<1:51:06,  3.62it/s]
 94%|█████████▎| 347361/371472 [5:28:22<1:53:40,  3.54it/s]
 94%|█████████▎| 347362/371472 [5:28:23<2:07:14,  3.16it/s]
 94%|█████████▎| 347363/371472 [5:28:23<1:59:57,  3.35it/s]
 94%|█████████▎| 347364/371472 [5:28:23<1:54:31,  3.51it/s]
 94%|█████████▎| 347365/371472 [5:28:24<1:51:21,  3.61it/s]
 94%|█████████▎| 347366/371472 [5:28:24<1:47:08,  3.75it/s]
 94%|█████████▎| 347367/371472 [5:28:24<1:55:29,  3.48it/s]
 94%|█████████▎| 347368/371472 [5:28:24<1:54:21,  3.51it/s]
 94%|█████████▎| 347369/371472 [5:28:25<1:51:56,  3.59it/s]
 94%|█████████▎| 347370/371472 [5:28:25<1:50:25,  3.64it/s]
 94%|█████████▎| 347371/371472 [5:28:25<1:52:56,  3.56it/s]
 94%|█████████▎| 347372/371472 [5:28:25<1:50:40,  3.63it/s]
 94%|█████████▎| 347373/371472 [5:28:26<1:49:16,  3.68it/s]
 94%|█████████▎| 347374/371472 [5:28:26<1:50:51,  3.62it/s]
 94%|█████████▎| 347375/371472 [5:28:26<1:49:43,  3.66it/s]
 94%|█████████▎| 347376/371472 [5:28:27<1:51:56,  3.59it/s]
 94%|█████████▎| 347377/371472 [5:28:27<1:54:04,  3.52it/s]
 94%|█████████▎| 347378/371472 [5:28:27<1:54:21,  3.51it/s]
 94%|█████████▎| 347379/371472 [5:28:27<1:51:05,  3.61it/s]
 94%|█████████▎| 347380/371472 [5:28:28<1:47:30,  3.73it/s]
                                                           
{'loss': 2.617, 'learning_rate': 1.584013876618759e-07, 'epoch': 14.96}

 94%|█████████▎| 347380/371472 [5:28:28<1:47:30,  3.73it/s]
 94%|█████████▎| 347381/371472 [5:28:28<2:03:29,  3.25it/s]
 94%|█████████▎| 347382/371472 [5:28:28<1:59:03,  3.37it/s]
 94%|█████████▎| 347383/371472 [5:28:29<1:56:16,  3.45it/s]
 94%|█████████▎| 347384/371472 [5:28:29<1:53:53,  3.52it/s]
 94%|█████████▎| 347385/371472 [5:28:29<1:52:42,  3.56it/s]
 94%|█████████▎| 347386/371472 [5:28:29<1:48:22,  3.70it/s]
 94%|█████████▎| 347387/371472 [5:28:30<1:50:14,  3.64it/s]
 94%|█████████▎| 347388/371472 [5:28:30<1:53:42,  3.53it/s]
 94%|█████████▎| 347389/371472 [5:28:30<1:53:43,  3.53it/s]
 94%|█████████▎| 347390/371472 [5:28:31<1:52:16,  3.58it/s]
 94%|█████████▎| 347391/371472 [5:28:31<1:50:48,  3.62it/s]
 94%|█████████▎| 347392/371472 [5:28:31<1:52:22,  3.57it/s]
 94%|█████████▎| 347393/371472 [5:28:31<2:00:10,  3.34it/s]
 94%|█████████▎| 347394/371472 [5:28:32<1:56:32,  3.44it/s]
 94%|█████████▎| 347395/371472 [5:28:32<1:51:43,  3.59it/s]
 94%|█████████▎| 347396/371472 [5:28:32<2:02:58,  3.26it/s]
 94%|█████████▎| 347397/371472 [5:28:33<2:03:31,  3.25it/s]
 94%|█████████▎| 347398/371472 [5:28:33<1:57:37,  3.41it/s]
 94%|█████████▎| 347399/371472 [5:28:33<1:55:37,  3.47it/s]
 94%|█████████▎| 347400/371472 [5:28:33<1:56:05,  3.46it/s]
                                                           
{'loss': 2.552, 'learning_rate': 1.5835290568639705e-07, 'epoch': 14.96}

 94%|█████████▎| 347400/371472 [5:28:33<1:56:05,  3.46it/s]
 94%|█████████▎| 347401/371472 [5:28:34<1:52:35,  3.56it/s]
 94%|█████████▎| 347402/371472 [5:28:34<2:00:37,  3.33it/s]
 94%|█████████▎| 347403/371472 [5:28:34<1:58:01,  3.40it/s]
 94%|█████████▎| 347404/371472 [5:28:35<2:04:07,  3.23it/s]
 94%|█████████▎| 347405/371472 [5:28:35<1:59:18,  3.36it/s]
 94%|█████████▎| 347406/371472 [5:28:35<1:56:29,  3.44it/s]
 94%|█████████▎| 347407/371472 [5:28:36<1:58:28,  3.39it/s]
 94%|█████████▎| 347408/371472 [5:28:36<1:59:58,  3.34it/s]
 94%|█████████▎| 347409/371472 [5:28:36<1:59:20,  3.36it/s]
 94%|█████████▎| 347410/371472 [5:28:36<1:55:15,  3.48it/s]
 94%|█████████▎| 347411/371472 [5:28:37<1:54:05,  3.51it/s]
 94%|█████████▎| 347412/371472 [5:28:37<1:48:50,  3.68it/s]
 94%|█████████▎| 347413/371472 [5:28:37<1:49:50,  3.65it/s]
 94%|█████████▎| 347414/371472 [5:28:38<1:53:28,  3.53it/s]
 94%|█████████▎| 347415/371472 [5:28:38<1:58:10,  3.39it/s]
 94%|█████████▎| 347416/371472 [5:28:38<1:57:29,  3.41it/s]
 94%|█████████▎| 347417/371472 [5:28:38<1:57:46,  3.40it/s]
 94%|█████████▎| 347418/371472 [5:28:39<1:59:53,  3.34it/s]
 94%|█████████▎| 347419/371472 [5:28:39<2:04:24,  3.22it/s]
 94%|█████████▎| 347420/371472 [5:28:39<1:58:26,  3.38it/s]
                                                           
{'loss': 2.5894, 'learning_rate': 1.5830442371091813e-07, 'epoch': 14.96}

 94%|█████████▎| 347420/371472 [5:28:39<1:58:26,  3.38it/s]
 94%|█████████▎| 347421/371472 [5:28:40<1:55:18,  3.48it/s]
 94%|█████████▎| 347422/371472 [5:28:40<2:01:04,  3.31it/s]
 94%|█████████▎| 347423/371472 [5:28:40<1:58:01,  3.40it/s]
 94%|█████████▎| 347424/371472 [5:28:41<1:57:53,  3.40it/s]
 94%|█████████▎| 347425/371472 [5:28:41<1:58:29,  3.38it/s]
 94%|█████████▎| 347426/371472 [5:28:41<1:57:06,  3.42it/s]
 94%|█████████▎| 347427/371472 [5:28:41<1:54:44,  3.49it/s]
 94%|█████████▎| 347428/371472 [5:28:42<2:00:45,  3.32it/s]
 94%|█████████▎| 347429/371472 [5:28:42<1:58:20,  3.39it/s]
 94%|█████████▎| 347430/371472 [5:28:42<1:54:43,  3.49it/s]
 94%|█████████▎| 347431/371472 [5:28:43<1:50:47,  3.62it/s]
 94%|█████████▎| 347432/371472 [5:28:43<1:51:17,  3.60it/s]
 94%|█████████▎| 347433/371472 [5:28:43<1:49:30,  3.66it/s]
 94%|█████████▎| 347434/371472 [5:28:43<1:54:27,  3.50it/s]
 94%|█████████▎| 347435/371472 [5:28:44<1:50:48,  3.62it/s]
 94%|█████████▎| 347436/371472 [5:28:44<1:49:26,  3.66it/s]
 94%|█████████▎| 347437/371472 [5:28:44<1:47:35,  3.72it/s]
 94%|█████████▎| 347438/371472 [5:28:44<1:48:49,  3.68it/s]
 94%|█████████▎| 347439/371472 [5:28:45<2:02:26,  3.27it/s]
 94%|█████████▎| 347440/371472 [5:28:45<2:01:19,  3.30it/s]
                                                           
{'loss': 2.5318, 'learning_rate': 1.5825594173543928e-07, 'epoch': 14.96}

 94%|█████████▎| 347440/371472 [5:28:45<2:01:19,  3.30it/s]
 94%|█████████▎| 347441/371472 [5:28:45<1:58:52,  3.37it/s]
 94%|█████████▎| 347442/371472 [5:28:46<1:54:10,  3.51it/s]
 94%|█████████▎| 347443/371472 [5:28:46<1:59:25,  3.35it/s]
 94%|█████████▎| 347444/371472 [5:28:46<2:07:53,  3.13it/s]
 94%|█████████▎| 347445/371472 [5:28:47<2:10:51,  3.06it/s]
 94%|█████████▎| 347446/371472 [5:28:47<2:05:15,  3.20it/s]
 94%|█████████▎| 347447/371472 [5:28:47<1:59:51,  3.34it/s]
 94%|█████████▎| 347448/371472 [5:28:48<1:56:29,  3.44it/s]
 94%|█████████▎| 347449/371472 [5:28:48<1:50:46,  3.61it/s]
 94%|█████████▎| 347450/371472 [5:28:48<1:51:59,  3.58it/s]
 94%|█████████▎| 347451/371472 [5:28:48<1:49:57,  3.64it/s]
 94%|█████████▎| 347452/371472 [5:28:49<1:48:33,  3.69it/s]
 94%|█████████▎| 347453/371472 [5:28:49<1:47:06,  3.74it/s]
 94%|█████████▎| 347454/371472 [5:28:49<1:46:30,  3.76it/s]
 94%|█████████▎| 347455/371472 [5:28:49<1:49:00,  3.67it/s]
 94%|█████████▎| 347456/371472 [5:28:50<1:48:10,  3.70it/s]
 94%|█████████▎| 347457/371472 [5:28:50<1:52:39,  3.55it/s]
 94%|█████████▎| 347458/371472 [5:28:50<1:53:40,  3.52it/s]
 94%|█████████▎| 347459/371472 [5:28:51<1:55:27,  3.47it/s]
 94%|█████████▎| 347460/371472 [5:28:51<1:52:26,  3.56it/s]
                                                           
{'loss': 2.515, 'learning_rate': 1.5820745975996032e-07, 'epoch': 14.97}

 94%|█████████▎| 347460/371472 [5:28:51<1:52:26,  3.56it/s]
 94%|█████████▎| 347461/371472 [5:28:51<1:52:07,  3.57it/s]
 94%|█████████▎| 347462/371472 [5:28:51<1:50:58,  3.61it/s]
 94%|█████████▎| 347463/371472 [5:28:52<1:49:20,  3.66it/s]
 94%|█████████▎| 347464/371472 [5:28:52<1:49:27,  3.66it/s]
 94%|█████████▎| 347465/371472 [5:28:52<1:49:55,  3.64it/s]
 94%|█████████▎| 347466/371472 [5:28:52<1:49:59,  3.64it/s]
 94%|█████████▎| 347467/371472 [5:28:53<1:48:59,  3.67it/s]
 94%|█████████▎| 347468/371472 [5:28:53<1:46:43,  3.75it/s]
 94%|█████████▎| 347469/371472 [5:28:53<1:46:02,  3.77it/s]
 94%|█████████▎| 347470/371472 [5:28:54<1:46:57,  3.74it/s]
 94%|█████████▎| 347471/371472 [5:28:54<1:45:10,  3.80it/s]
 94%|█████████▎| 347472/371472 [5:28:54<1:51:38,  3.58it/s]
 94%|█████████▎| 347473/371472 [5:28:54<1:51:53,  3.57it/s]
 94%|█████████▎| 347474/371472 [5:28:55<1:52:26,  3.56it/s]
 94%|█████████▎| 347475/371472 [5:28:55<1:54:51,  3.48it/s]
 94%|█████████▎| 347476/371472 [5:28:55<1:50:58,  3.60it/s]
 94%|█████████▎| 347477/371472 [5:28:56<1:53:51,  3.51it/s]
 94%|█████████▎| 347478/371472 [5:28:56<1:50:49,  3.61it/s]
 94%|█████████▎| 347479/371472 [5:28:56<1:49:45,  3.64it/s]
 94%|█████████▎| 347480/371472 [5:28:56<1:54:17,  3.50it/s]
                                                           
{'loss': 2.5222, 'learning_rate': 1.581589777844815e-07, 'epoch': 14.97}

 94%|█████████▎| 347480/371472 [5:28:56<1:54:17,  3.50it/s]
 94%|█████████▎| 347481/371472 [5:28:57<1:52:25,  3.56it/s]
 94%|█████████▎| 347482/371472 [5:28:57<1:49:45,  3.64it/s]
 94%|█████████▎| 347483/371472 [5:28:57<1:48:53,  3.67it/s]
 94%|█████████▎| 347484/371472 [5:28:57<1:46:18,  3.76it/s]
 94%|█████████▎| 347485/371472 [5:28:58<1:47:44,  3.71it/s]
 94%|█████████▎| 347486/371472 [5:28:58<1:50:29,  3.62it/s]
 94%|█████████▎| 347487/371472 [5:28:58<1:48:07,  3.70it/s]
 94%|█████████▎| 347488/371472 [5:28:58<1:46:16,  3.76it/s]
 94%|█████████▎| 347489/371472 [5:28:59<1:53:22,  3.53it/s]
 94%|█████████▎| 347490/371472 [5:28:59<2:08:06,  3.12it/s]
 94%|█████████▎| 347491/371472 [5:28:59<2:03:28,  3.24it/s]
 94%|█████████▎| 347492/371472 [5:29:00<1:58:47,  3.36it/s]
 94%|█████████▎| 347493/371472 [5:29:00<1:58:03,  3.39it/s]
 94%|█████████▎| 347494/371472 [5:29:00<1:58:50,  3.36it/s]
 94%|█████████▎| 347495/371472 [5:29:01<1:57:56,  3.39it/s]
 94%|█████████▎| 347496/371472 [5:29:01<1:58:37,  3.37it/s]
 94%|█████████▎| 347497/371472 [5:29:01<1:56:42,  3.42it/s]
 94%|█████████▎| 347498/371472 [5:29:02<2:01:29,  3.29it/s]
 94%|█████████▎| 347499/371472 [5:29:02<1:57:11,  3.41it/s]
 94%|█████████▎| 347500/371472 [5:29:02<1:56:00,  3.44it/s]
                                                           
{'loss': 2.633, 'learning_rate': 1.5811049580900254e-07, 'epoch': 14.97}

 94%|█████████▎| 347500/371472 [5:29:02<1:56:00,  3.44it/s]
 94%|█████████▎| 347501/371472 [5:29:02<1:59:13,  3.35it/s]
 94%|█████████▎| 347502/371472 [5:29:03<1:56:44,  3.42it/s]
 94%|█████████▎| 347503/371472 [5:29:03<1:53:54,  3.51it/s]
 94%|█████████▎| 347504/371472 [5:29:03<1:57:03,  3.41it/s]
 94%|█████████▎| 347505/371472 [5:29:04<1:52:05,  3.56it/s]
 94%|█████████▎| 347506/371472 [5:29:04<1:51:01,  3.60it/s]
 94%|█████████▎| 347507/371472 [5:29:04<1:47:08,  3.73it/s]
 94%|█████████▎| 347508/371472 [5:29:04<1:47:25,  3.72it/s]
 94%|█████████▎| 347509/371472 [5:29:05<1:49:25,  3.65it/s]
 94%|█████████▎| 347510/371472 [5:29:05<1:48:19,  3.69it/s]
 94%|█████████▎| 347511/371472 [5:29:05<1:49:15,  3.66it/s]
 94%|█████████▎| 347512/371472 [5:29:05<1:54:36,  3.48it/s]
 94%|█████████▎| 347513/371472 [5:29:06<1:50:39,  3.61it/s]
 94%|█████████▎| 347514/371472 [5:29:06<1:51:56,  3.57it/s]
 94%|█████████▎| 347515/371472 [5:29:06<1:52:26,  3.55it/s]
 94%|█████████▎| 347516/371472 [5:29:07<1:48:15,  3.69it/s]
 94%|█████████▎| 347517/371472 [5:29:07<1:51:24,  3.58it/s]
 94%|█████████▎| 347518/371472 [5:29:07<1:48:50,  3.67it/s]
 94%|█████████▎| 347519/371472 [5:29:07<1:49:16,  3.65it/s]
 94%|█████████▎| 347520/371472 [5:29:08<1:51:04,  3.59it/s]
                                                           
{'loss': 2.7124, 'learning_rate': 1.580620138335237e-07, 'epoch': 14.97}

 94%|█████████▎| 347520/371472 [5:29:08<1:51:04,  3.59it/s]
 94%|█████████▎| 347521/371472 [5:29:08<1:52:25,  3.55it/s]
 94%|█████████▎| 347522/371472 [5:29:08<1:57:56,  3.38it/s]
 94%|█████████▎| 347523/371472 [5:29:09<1:55:31,  3.46it/s]
 94%|█████████▎| 347524/371472 [5:29:09<1:57:17,  3.40it/s]
 94%|█████████▎| 347525/371472 [5:29:09<2:02:35,  3.26it/s]
 94%|█████████▎| 347526/371472 [5:29:09<1:57:57,  3.38it/s]
 94%|█████████▎| 347527/371472 [5:29:10<1:57:05,  3.41it/s]
 94%|█████████▎| 347528/371472 [5:29:10<1:58:02,  3.38it/s]
 94%|█████████▎| 347529/371472 [5:29:10<1:58:02,  3.38it/s]
 94%|█████████▎| 347530/371472 [5:29:11<1:57:23,  3.40it/s]
 94%|█████████▎| 347531/371472 [5:29:11<1:57:03,  3.41it/s]
 94%|█████████▎| 347532/371472 [5:29:11<1:56:32,  3.42it/s]
 94%|█████████▎| 347533/371472 [5:29:11<1:51:06,  3.59it/s]
 94%|█████████▎| 347534/371472 [5:29:12<1:53:06,  3.53it/s]
 94%|█████████▎| 347535/371472 [5:29:12<1:55:13,  3.46it/s]
 94%|█████████▎| 347536/371472 [5:29:12<1:50:08,  3.62it/s]
 94%|█████████▎| 347537/371472 [5:29:13<1:49:37,  3.64it/s]
 94%|█████████▎| 347538/371472 [5:29:13<1:57:37,  3.39it/s]
 94%|█████████▎| 347539/371472 [5:29:13<2:02:30,  3.26it/s]
 94%|█████████▎| 347540/371472 [5:29:14<1:58:38,  3.36it/s]
                                                           
{'loss': 2.5157, 'learning_rate': 1.5801353185804477e-07, 'epoch': 14.97}

 94%|█████████▎| 347540/371472 [5:29:14<1:58:38,  3.36it/s]
 94%|█████████▎| 347541/371472 [5:29:14<1:56:22,  3.43it/s]
 94%|█████████▎| 347542/371472 [5:29:14<1:53:15,  3.52it/s]
 94%|█████████▎| 347543/371472 [5:29:14<1:57:54,  3.38it/s]
 94%|█████████▎| 347544/371472 [5:29:15<1:53:35,  3.51it/s]
 94%|█████████▎| 347545/371472 [5:29:15<1:50:34,  3.61it/s]
 94%|█████████▎| 347546/371472 [5:29:15<1:52:47,  3.54it/s]
 94%|█████████▎| 347547/371472 [5:29:15<1:49:14,  3.65it/s]
 94%|█████████▎| 347548/371472 [5:29:16<1:46:50,  3.73it/s]
 94%|█████████▎| 347549/371472 [5:29:16<1:52:42,  3.54it/s]
 94%|█████████▎| 347550/371472 [5:29:17<2:29:11,  2.67it/s]
 94%|█████████▎| 347551/371472 [5:29:17<2:12:32,  3.01it/s]
 94%|█████████▎| 347552/371472 [5:29:17<2:11:17,  3.04it/s]
 94%|█████████▎| 347553/371472 [5:29:17<2:01:58,  3.27it/s]
 94%|█████████▎| 347554/371472 [5:29:18<2:07:05,  3.14it/s]
 94%|█████████▎| 347555/371472 [5:29:18<2:03:06,  3.24it/s]
 94%|█████████▎| 347556/371472 [5:29:18<1:55:49,  3.44it/s]
 94%|█████████▎| 347557/371472 [5:29:19<1:53:52,  3.50it/s]
 94%|█████████▎| 347558/371472 [5:29:19<1:51:52,  3.56it/s]
 94%|█████████▎| 347559/371472 [5:29:19<1:47:59,  3.69it/s]
 94%|█████████▎| 347560/371472 [5:29:19<1:56:20,  3.43it/s]
                                                           
{'loss': 2.5336, 'learning_rate': 1.5796504988256592e-07, 'epoch': 14.97}

 94%|█████████▎| 347560/371472 [5:29:19<1:56:20,  3.43it/s]
 94%|█████████▎| 347561/371472 [5:29:20<1:56:28,  3.42it/s]
 94%|█████████▎| 347562/371472 [5:29:20<1:51:24,  3.58it/s]
 94%|█████████▎| 347563/371472 [5:29:20<1:53:54,  3.50it/s]
 94%|█████████▎| 347564/371472 [5:29:21<1:52:08,  3.55it/s]
 94%|█████████▎| 347565/371472 [5:29:21<1:56:04,  3.43it/s]
 94%|█████████▎| 347566/371472 [5:29:21<1:52:04,  3.56it/s]
 94%|█████████▎| 347567/371472 [5:29:21<1:53:34,  3.51it/s]
 94%|█████████▎| 347568/371472 [5:29:22<1:48:58,  3.66it/s]
 94%|█████████▎| 347569/371472 [5:29:22<1:48:34,  3.67it/s]
 94%|█████████▎| 347570/371472 [5:29:22<1:45:51,  3.76it/s]
 94%|█████████▎| 347571/371472 [5:29:22<1:45:02,  3.79it/s]
 94%|█████████▎| 347572/371472 [5:29:23<1:45:37,  3.77it/s]
 94%|█████████▎| 347573/371472 [5:29:23<1:49:49,  3.63it/s]
 94%|█████████▎| 347574/371472 [5:29:23<1:49:45,  3.63it/s]
 94%|█████████▎| 347575/371472 [5:29:24<1:50:05,  3.62it/s]
 94%|█████████▎| 347576/371472 [5:29:24<1:55:13,  3.46it/s]
 94%|█████████▎| 347577/371472 [5:29:24<1:54:08,  3.49it/s]
 94%|█████████▎| 347578/371472 [5:29:24<1:52:20,  3.55it/s]
 94%|█████████▎| 347579/371472 [5:29:25<1:51:51,  3.56it/s]
 94%|█████████▎| 347580/371472 [5:29:25<1:59:35,  3.33it/s]
                                                           
{'loss': 2.7341, 'learning_rate': 1.5791656790708696e-07, 'epoch': 14.97}

 94%|█████████▎| 347580/371472 [5:29:25<1:59:35,  3.33it/s]
 94%|█████████▎| 347581/371472 [5:29:25<1:57:59,  3.37it/s]
 94%|█████████▎| 347582/371472 [5:29:26<1:57:04,  3.40it/s]
 94%|█████████▎| 347583/371472 [5:29:26<1:55:06,  3.46it/s]
 94%|█████████▎| 347584/371472 [5:29:26<1:54:58,  3.46it/s]
 94%|█████████▎| 347585/371472 [5:29:26<1:51:29,  3.57it/s]
 94%|█████████▎| 347586/371472 [5:29:27<1:48:27,  3.67it/s]
 94%|█████████▎| 347587/371472 [5:29:27<1:46:24,  3.74it/s]
 94%|█████████▎| 347588/371472 [5:29:27<1:49:05,  3.65it/s]
 94%|█████████▎| 347589/371472 [5:29:28<1:49:02,  3.65it/s]
 94%|█████████▎| 347590/371472 [5:29:28<1:47:49,  3.69it/s]
 94%|█████████▎| 347591/371472 [5:29:28<1:54:04,  3.49it/s]
 94%|█████████▎| 347592/371472 [5:29:28<1:50:43,  3.59it/s]
 94%|█████████▎| 347593/371472 [5:29:29<1:51:09,  3.58it/s]
 94%|█████████▎| 347594/371472 [5:29:29<1:53:14,  3.51it/s]
 94%|█████████▎| 347595/371472 [5:29:29<1:51:47,  3.56it/s]
 94%|█████████▎| 347596/371472 [5:29:30<1:51:43,  3.56it/s]
 94%|█████████▎| 347597/371472 [5:29:30<1:50:13,  3.61it/s]
 94%|█████████▎| 347598/371472 [5:29:30<1:56:13,  3.42it/s]
 94%|█████████▎| 347599/371472 [5:29:30<1:52:40,  3.53it/s]
 94%|█████████▎| 347600/371472 [5:29:31<1:47:52,  3.69it/s]
                                                           
{'loss': 2.5821, 'learning_rate': 1.5786808593160814e-07, 'epoch': 14.97}

 94%|█████████▎| 347600/371472 [5:29:31<1:47:52,  3.69it/s]
 94%|█████████▎| 347601/371472 [5:29:31<1:50:39,  3.60it/s]
 94%|█████████▎| 347602/371472 [5:29:31<1:50:57,  3.59it/s]
 94%|█████████▎| 347603/371472 [5:29:32<2:03:49,  3.21it/s]
 94%|█████████▎| 347604/371472 [5:29:32<1:57:21,  3.39it/s]
 94%|█████████▎| 347605/371472 [5:29:32<1:53:32,  3.50it/s]
 94%|█████████▎| 347606/371472 [5:29:32<1:52:16,  3.54it/s]
 94%|█████████▎| 347607/371472 [5:29:33<1:51:32,  3.57it/s]
 94%|█████████▎| 347608/371472 [5:29:33<1:50:05,  3.61it/s]
 94%|█████████▎| 347609/371472 [5:29:33<1:53:33,  3.50it/s]
 94%|█████████▎| 347610/371472 [5:29:34<1:52:11,  3.54it/s]
 94%|█████████▎| 347611/371472 [5:29:34<1:55:06,  3.45it/s]
 94%|█████████▎| 347612/371472 [5:29:34<1:52:52,  3.52it/s]
 94%|█████████▎| 347613/371472 [5:29:34<1:56:10,  3.42it/s]
 94%|█████████▎| 347614/371472 [5:29:35<1:52:05,  3.55it/s]
 94%|█████████▎| 347615/371472 [5:29:35<1:50:12,  3.61it/s]
 94%|█████████▎| 347616/371472 [5:29:35<1:50:20,  3.60it/s]
 94%|█████████▎| 347617/371472 [5:29:36<1:53:21,  3.51it/s]
 94%|█████████▎| 347618/371472 [5:29:36<1:52:06,  3.55it/s]
 94%|█████████▎| 347619/371472 [5:29:36<1:54:57,  3.46it/s]
 94%|█████████▎| 347620/371472 [5:29:36<1:50:12,  3.61it/s]
                                                           
{'loss': 2.4875, 'learning_rate': 1.5781960395612916e-07, 'epoch': 14.97}

 94%|█████████▎| 347620/371472 [5:29:36<1:50:12,  3.61it/s]
 94%|█████████▎| 347621/371472 [5:29:37<1:49:49,  3.62it/s]
 94%|█████████▎| 347622/371472 [5:29:37<1:54:13,  3.48it/s]
 94%|█████████▎| 347623/371472 [5:29:37<1:56:38,  3.41it/s]
 94%|█████████▎| 347624/371472 [5:29:37<1:53:35,  3.50it/s]
 94%|█████████▎| 347625/371472 [5:29:38<1:49:24,  3.63it/s]
 94%|█████████▎| 347626/371472 [5:29:38<1:47:20,  3.70it/s]
 94%|█████████▎| 347627/371472 [5:29:38<1:45:54,  3.75it/s]
 94%|█████████▎| 347628/371472 [5:29:39<1:49:05,  3.64it/s]
 94%|█████████▎| 347629/371472 [5:29:39<1:51:29,  3.56it/s]
 94%|█████████▎| 347630/371472 [5:29:39<1:54:55,  3.46it/s]
 94%|█████████▎| 347631/371472 [5:29:39<1:51:51,  3.55it/s]
 94%|█████████▎| 347632/371472 [5:29:40<1:54:23,  3.47it/s]
 94%|█████████▎| 347633/371472 [5:29:40<1:56:41,  3.40it/s]
 94%|█████████▎| 347634/371472 [5:29:40<1:56:30,  3.41it/s]
 94%|█████████▎| 347635/371472 [5:29:41<1:56:34,  3.41it/s]
 94%|█████████▎| 347636/371472 [5:29:41<1:53:25,  3.50it/s]
 94%|█████████▎| 347637/371472 [5:29:41<1:58:54,  3.34it/s]
 94%|█████████▎| 347638/371472 [5:29:42<2:00:39,  3.29it/s]
 94%|█████████▎| 347639/371472 [5:29:42<1:56:18,  3.42it/s]
 94%|█████████▎| 347640/371472 [5:29:42<1:54:54,  3.46it/s]
                                                           
{'loss': 2.4558, 'learning_rate': 1.5777112198065034e-07, 'epoch': 14.97}

 94%|█████████▎| 347640/371472 [5:29:42<1:54:54,  3.46it/s]
 94%|█████████▎| 347641/371472 [5:29:42<1:55:06,  3.45it/s]
 94%|█████████▎| 347642/371472 [5:29:43<1:52:35,  3.53it/s]
 94%|█████████▎| 347643/371472 [5:29:43<1:52:48,  3.52it/s]
 94%|█████████▎| 347644/371472 [5:29:43<1:55:24,  3.44it/s]
 94%|█████████▎| 347645/371472 [5:29:44<2:02:35,  3.24it/s]
 94%|█████████▎| 347646/371472 [5:29:44<1:56:43,  3.40it/s]
 94%|█████████▎| 347647/371472 [5:29:44<1:53:16,  3.51it/s]
 94%|█████████▎| 347648/371472 [5:29:44<1:55:28,  3.44it/s]
 94%|█████████▎| 347649/371472 [5:29:45<1:52:35,  3.53it/s]
 94%|█████████▎| 347650/371472 [5:29:45<1:51:43,  3.55it/s]
 94%|█████████▎| 347651/371472 [5:29:45<2:01:56,  3.26it/s]
 94%|█████████▎| 347652/371472 [5:29:46<1:53:56,  3.48it/s]
 94%|█████████▎| 347653/371472 [5:29:46<1:50:54,  3.58it/s]
 94%|█████████▎| 347654/371472 [5:29:46<1:49:41,  3.62it/s]
 94%|█████████▎| 347655/371472 [5:29:46<1:48:51,  3.65it/s]
 94%|█████████▎| 347656/371472 [5:29:47<1:46:29,  3.73it/s]
 94%|█████████▎| 347657/371472 [5:29:47<1:47:58,  3.68it/s]
 94%|█████████▎| 347658/371472 [5:29:47<1:52:09,  3.54it/s]
 94%|█████████▎| 347659/371472 [5:29:47<1:50:19,  3.60it/s]
 94%|█████████▎| 347660/371472 [5:29:48<1:50:51,  3.58it/s]
                                                           
{'loss': 2.6138, 'learning_rate': 1.577226400051714e-07, 'epoch': 14.97}

 94%|█████████▎| 347660/371472 [5:29:48<1:50:51,  3.58it/s]
 94%|█████████▎| 347661/371472 [5:29:48<1:48:43,  3.65it/s]
 94%|█████████▎| 347662/371472 [5:29:48<1:53:28,  3.50it/s]
 94%|█████████▎| 347663/371472 [5:29:49<1:54:29,  3.47it/s]
 94%|█████████▎| 347664/371472 [5:29:49<1:54:49,  3.46it/s]
 94%|█████████▎| 347665/371472 [5:29:49<2:08:25,  3.09it/s]
 94%|█████████▎| 347666/371472 [5:29:50<2:02:48,  3.23it/s]
 94%|█████████▎| 347667/371472 [5:29:50<1:55:21,  3.44it/s]
 94%|█████████▎| 347668/371472 [5:29:50<1:52:43,  3.52it/s]
 94%|█████████▎| 347669/371472 [5:29:50<1:50:07,  3.60it/s]
 94%|█████████▎| 347670/371472 [5:29:51<1:49:32,  3.62it/s]
 94%|█████████▎| 347671/371472 [5:29:51<1:57:55,  3.36it/s]
 94%|█████████▎| 347672/371472 [5:29:51<2:04:31,  3.19it/s]
 94%|█████████▎| 347673/371472 [5:29:52<2:00:11,  3.30it/s]
 94%|█████████▎| 347674/371472 [5:29:52<1:57:15,  3.38it/s]
 94%|█████████▎| 347675/371472 [5:29:52<1:51:58,  3.54it/s]
 94%|█████████▎| 347676/371472 [5:29:52<1:53:53,  3.48it/s]
 94%|█████████▎| 347677/371472 [5:29:53<1:51:04,  3.57it/s]
 94%|█████████▎| 347678/371472 [5:29:53<1:57:55,  3.36it/s]
 94%|█████████▎| 347679/371472 [5:29:53<1:56:21,  3.41it/s]
 94%|█████████▎| 347680/371472 [5:29:54<1:57:00,  3.39it/s]
                                                           
{'loss': 2.6925, 'learning_rate': 1.5767415802969245e-07, 'epoch': 14.98}

 94%|█████████▎| 347680/371472 [5:29:54<1:57:00,  3.39it/s]
 94%|█████████▎| 347681/371472 [5:29:54<1:53:39,  3.49it/s]
 94%|█████████▎| 347682/371472 [5:29:54<2:02:30,  3.24it/s]
 94%|█████████▎| 347683/371472 [5:29:55<1:59:32,  3.32it/s]
 94%|█████████▎| 347684/371472 [5:29:55<1:53:48,  3.48it/s]
 94%|█████████▎| 347685/371472 [5:29:55<1:52:13,  3.53it/s]
 94%|█████████▎| 347686/371472 [5:29:55<2:00:25,  3.29it/s]
 94%|█████████▎| 347687/371472 [5:29:56<1:55:09,  3.44it/s]
 94%|█████████▎| 347688/371472 [5:29:56<1:54:52,  3.45it/s]
 94%|█████████▎| 347689/371472 [5:29:56<1:53:59,  3.48it/s]
 94%|█████████▎| 347690/371472 [5:29:57<1:54:31,  3.46it/s]
 94%|█████████▎| 347691/371472 [5:29:57<2:01:15,  3.27it/s]
 94%|█████████▎| 347692/371472 [5:29:57<1:59:06,  3.33it/s]
 94%|█████████▎| 347693/371472 [5:29:57<1:53:06,  3.50it/s]
 94%|█████████▎| 347694/371472 [5:29:58<1:54:19,  3.47it/s]
 94%|█████████▎| 347695/371472 [5:29:58<2:06:03,  3.14it/s]
 94%|█████████▎| 347696/371472 [5:29:58<1:58:08,  3.35it/s]
 94%|█████████▎| 347697/371472 [5:29:59<1:58:35,  3.34it/s]
 94%|█████████▎| 347698/371472 [5:29:59<1:53:27,  3.49it/s]
 94%|█████████▎| 347699/371472 [5:29:59<2:02:31,  3.23it/s]
 94%|█████████▎| 347700/371472 [5:30:00<1:57:48,  3.36it/s]
                                                           
{'loss': 2.4736, 'learning_rate': 1.576256760542136e-07, 'epoch': 14.98}

 94%|█████████▎| 347700/371472 [5:30:00<1:57:48,  3.36it/s]
 94%|█████████▎| 347701/371472 [5:30:00<1:53:03,  3.50it/s]
 94%|█████████▎| 347702/371472 [5:30:00<1:49:28,  3.62it/s]
 94%|█████████▎| 347703/371472 [5:30:00<1:46:18,  3.73it/s]
 94%|█████████▎| 347704/371472 [5:30:01<1:46:11,  3.73it/s]
 94%|█████████▎| 347705/371472 [5:30:01<1:47:03,  3.70it/s]
 94%|█████████▎| 347706/371472 [5:30:01<1:46:36,  3.72it/s]
 94%|█████████▎| 347707/371472 [5:30:01<1:44:47,  3.78it/s]
 94%|█████████▎| 347708/371472 [5:30:02<1:49:52,  3.60it/s]
 94%|█████████▎| 347709/371472 [5:30:02<1:47:06,  3.70it/s]
 94%|█████████▎| 347710/371472 [5:30:02<1:47:37,  3.68it/s]
 94%|█████████▎| 347711/371472 [5:30:03<1:56:46,  3.39it/s]
 94%|█████████▎| 347712/371472 [5:30:03<1:56:24,  3.40it/s]
 94%|█████████▎| 347713/371472 [5:30:03<1:56:30,  3.40it/s]
 94%|█████████▎| 347714/371472 [5:30:03<1:50:31,  3.58it/s]
 94%|█████████▎| 347715/371472 [5:30:04<1:49:42,  3.61it/s]
 94%|█████████▎| 347716/371472 [5:30:04<1:51:01,  3.57it/s]
 94%|█████████▎| 347717/371472 [5:30:04<1:54:02,  3.47it/s]
 94%|█████████▎| 347718/371472 [5:30:05<1:53:05,  3.50it/s]
 94%|█████████▎| 347719/371472 [5:30:05<1:52:37,  3.51it/s]
 94%|█████████▎| 347720/371472 [5:30:05<1:52:31,  3.52it/s]
                                                           
{'loss': 2.7135, 'learning_rate': 1.5757719407873467e-07, 'epoch': 14.98}

 94%|█████████▎| 347720/371472 [5:30:05<1:52:31,  3.52it/s]
 94%|█████████▎| 347721/371472 [5:30:05<2:03:01,  3.22it/s]
 94%|█████████▎| 347722/371472 [5:30:06<1:59:38,  3.31it/s]
 94%|█████████▎| 347723/371472 [5:30:06<2:03:09,  3.21it/s]
 94%|█████████▎| 347724/371472 [5:30:06<2:06:00,  3.14it/s]
 94%|█████████▎| 347725/371472 [5:30:07<2:01:39,  3.25it/s]
 94%|█████████▎| 347726/371472 [5:30:07<1:59:11,  3.32it/s]
 94%|█████████▎| 347727/371472 [5:30:07<1:57:14,  3.38it/s]
 94%|█████████▎| 347728/371472 [5:30:08<1:56:10,  3.41it/s]
 94%|█████████▎| 347729/371472 [5:30:08<1:54:37,  3.45it/s]
 94%|█████████▎| 347730/371472 [5:30:08<1:52:06,  3.53it/s]
 94%|█████████▎| 347731/371472 [5:30:08<1:50:28,  3.58it/s]
 94%|█████████▎| 347732/371472 [5:30:09<1:54:08,  3.47it/s]
 94%|█████████▎| 347733/371472 [5:30:09<1:52:44,  3.51it/s]
 94%|█████████▎| 347734/371472 [5:30:09<1:58:04,  3.35it/s]
 94%|█████████▎| 347735/371472 [5:30:10<1:52:33,  3.51it/s]
 94%|█████████▎| 347736/371472 [5:30:10<2:01:03,  3.27it/s]
 94%|█████████▎| 347737/371472 [5:30:10<1:56:48,  3.39it/s]
 94%|█████████▎| 347738/371472 [5:30:10<1:49:37,  3.61it/s]
 94%|█████████▎| 347739/371472 [5:30:11<1:48:15,  3.65it/s]
 94%|█████████▎| 347740/371472 [5:30:11<1:55:21,  3.43it/s]
                                                           
{'loss': 2.5614, 'learning_rate': 1.5752871210325583e-07, 'epoch': 14.98}

 94%|█████████▎| 347740/371472 [5:30:11<1:55:21,  3.43it/s]
 94%|█████████▎| 347741/371472 [5:30:11<2:00:21,  3.29it/s]
 94%|█████████▎| 347742/371472 [5:30:12<1:55:53,  3.41it/s]
 94%|█████████▎| 347743/371472 [5:30:12<1:55:07,  3.44it/s]
 94%|█████████▎| 347744/371472 [5:30:12<1:51:44,  3.54it/s]
 94%|█████████▎| 347745/371472 [5:30:12<1:53:10,  3.49it/s]
 94%|█████████▎| 347746/371472 [5:30:13<1:51:06,  3.56it/s]
 94%|█████████▎| 347747/371472 [5:30:13<1:51:46,  3.54it/s]
 94%|█████████▎| 347748/371472 [5:30:13<1:51:14,  3.55it/s]
 94%|█████████▎| 347749/371472 [5:30:14<1:49:55,  3.60it/s]
 94%|█████████▎| 347750/371472 [5:30:14<1:46:10,  3.72it/s]
 94%|█████████▎| 347751/371472 [5:30:14<1:45:57,  3.73it/s]
 94%|█████████▎| 347752/371472 [5:30:14<1:43:33,  3.82it/s]
 94%|█████████▎| 347753/371472 [5:30:15<1:44:54,  3.77it/s]
 94%|█████████▎| 347754/371472 [5:30:15<1:41:52,  3.88it/s]
 94%|█████████▎| 347755/371472 [5:30:15<1:50:33,  3.58it/s]
 94%|█████████▎| 347756/371472 [5:30:15<1:48:50,  3.63it/s]
 94%|█████████▎| 347757/371472 [5:30:16<1:52:34,  3.51it/s]
 94%|█████████▎| 347758/371472 [5:30:16<1:53:30,  3.48it/s]
 94%|█████████▎| 347759/371472 [5:30:16<2:06:12,  3.13it/s]
 94%|█████████▎| 347760/371472 [5:30:17<1:57:42,  3.36it/s]
                                                           
{'loss': 2.5618, 'learning_rate': 1.574802301277769e-07, 'epoch': 14.98}

 94%|█████████▎| 347760/371472 [5:30:17<1:57:42,  3.36it/s]
 94%|█████████▎| 347761/371472 [5:30:17<1:57:42,  3.36it/s]
 94%|█████████▎| 347762/371472 [5:30:17<2:03:56,  3.19it/s]
 94%|█████████▎| 347763/371472 [5:30:18<2:13:46,  2.95it/s]
 94%|█████████▎| 347764/371472 [5:30:18<2:07:56,  3.09it/s]
 94%|█████████▎| 347765/371472 [5:30:18<1:58:38,  3.33it/s]
 94%|█████████▎| 347766/371472 [5:30:19<2:00:31,  3.28it/s]
 94%|█████████▎| 347767/371472 [5:30:19<1:56:25,  3.39it/s]
 94%|█████████▎| 347768/371472 [5:30:19<2:00:29,  3.28it/s]
 94%|█████████▎| 347769/371472 [5:30:19<1:59:29,  3.31it/s]
 94%|█████████▎| 347770/371472 [5:30:20<1:54:45,  3.44it/s]
 94%|█████████▎| 347771/371472 [5:30:20<1:51:51,  3.53it/s]
 94%|█████████▎| 347772/371472 [5:30:20<1:55:14,  3.43it/s]
 94%|█████████▎| 347773/371472 [5:30:21<1:55:19,  3.43it/s]
 94%|█████████▎| 347774/371472 [5:30:21<1:56:09,  3.40it/s]
 94%|█████████▎| 347775/371472 [5:30:21<1:51:40,  3.54it/s]
 94%|█████████▎| 347776/371472 [5:30:21<1:49:57,  3.59it/s]
 94%|█████████▎| 347777/371472 [5:30:22<1:51:06,  3.55it/s]
 94%|█████████▎| 347778/371472 [5:30:22<1:47:34,  3.67it/s]
 94%|█████████▎| 347779/371472 [5:30:22<1:48:10,  3.65it/s]
 94%|█████████▎| 347780/371472 [5:30:23<1:49:33,  3.60it/s]
                                                           
{'loss': 2.5195, 'learning_rate': 1.5743174815229805e-07, 'epoch': 14.98}

 94%|█████████▎| 347780/371472 [5:30:23<1:49:33,  3.60it/s]
 94%|█████████▎| 347781/371472 [5:30:23<1:47:11,  3.68it/s]
 94%|█████████▎| 347782/371472 [5:30:23<1:58:48,  3.32it/s]
 94%|█████████▎| 347783/371472 [5:30:23<1:54:10,  3.46it/s]
 94%|█████████▎| 347784/371472 [5:30:24<1:52:32,  3.51it/s]
 94%|█████████▎| 347785/371472 [5:30:24<1:47:58,  3.66it/s]
 94%|█████████▎| 347786/371472 [5:30:24<1:46:27,  3.71it/s]
 94%|█████████▎| 347787/371472 [5:30:24<1:46:10,  3.72it/s]
 94%|█████████▎| 347788/371472 [5:30:25<1:42:59,  3.83it/s]
 94%|█████████▎| 347789/371472 [5:30:25<1:43:08,  3.83it/s]
 94%|█████████▎| 347790/371472 [5:30:25<1:41:53,  3.87it/s]
 94%|█████████▎| 347791/371472 [5:30:26<1:44:33,  3.77it/s]
 94%|█████████▎| 347792/371472 [5:30:26<1:42:07,  3.86it/s]
 94%|█████████▎| 347793/371472 [5:30:26<1:42:04,  3.87it/s]
 94%|█████████▎| 347794/371472 [5:30:26<1:43:21,  3.82it/s]
 94%|█████████▎| 347795/371472 [5:30:27<1:48:09,  3.65it/s]
 94%|█████████▎| 347796/371472 [5:30:27<1:46:50,  3.69it/s]
 94%|█████████▎| 347797/371472 [5:30:27<1:50:59,  3.55it/s]
 94%|█████████▎| 347798/371472 [5:30:27<1:49:31,  3.60it/s]
 94%|█████████▎| 347799/371472 [5:30:28<1:47:04,  3.68it/s]
 94%|█████████▎| 347800/371472 [5:30:28<1:51:02,  3.55it/s]
                                                           
{'loss': 2.6897, 'learning_rate': 1.5738326617681912e-07, 'epoch': 14.98}

 94%|█████████▎| 347800/371472 [5:30:28<1:51:02,  3.55it/s]
 94%|█████████▎| 347801/371472 [5:30:28<1:50:26,  3.57it/s]
 94%|█████████▎| 347802/371472 [5:30:29<1:57:02,  3.37it/s]
 94%|█████████▎| 347803/371472 [5:30:29<1:55:08,  3.43it/s]
 94%|█████████▎| 347804/371472 [5:30:29<1:51:41,  3.53it/s]
 94%|█████████▎| 347805/371472 [5:30:29<1:50:15,  3.58it/s]
 94%|█████████▎| 347806/371472 [5:30:30<1:52:48,  3.50it/s]
 94%|█████████▎| 347807/371472 [5:30:30<1:48:37,  3.63it/s]
 94%|█████████▎| 347808/371472 [5:30:30<1:45:21,  3.74it/s]
 94%|█████████▎| 347809/371472 [5:30:30<1:46:19,  3.71it/s]
 94%|█████████▎| 347810/371472 [5:30:31<1:44:31,  3.77it/s]
 94%|█████████▎| 347811/371472 [5:30:31<1:47:00,  3.69it/s]
 94%|█████████▎| 347812/371472 [5:30:31<1:45:34,  3.74it/s]
 94%|█████████▎| 347813/371472 [5:30:32<1:50:56,  3.55it/s]
 94%|█████████▎| 347814/371472 [5:30:32<1:51:02,  3.55it/s]
 94%|█████████▎| 347815/371472 [5:30:32<1:58:52,  3.32it/s]
 94%|█████████▎| 347816/371472 [5:30:32<1:51:52,  3.52it/s]
 94%|█████████▎| 347817/371472 [5:30:33<1:52:16,  3.51it/s]
 94%|█████████▎| 347818/371472 [5:30:33<1:51:30,  3.54it/s]
 94%|█████████▎| 347819/371472 [5:30:33<1:52:58,  3.49it/s]
 94%|█████████▎| 347820/371472 [5:30:34<1:57:44,  3.35it/s]
                                                           
{'loss': 2.6266, 'learning_rate': 1.5733478420134027e-07, 'epoch': 14.98}

 94%|█████████▎| 347820/371472 [5:30:34<1:57:44,  3.35it/s]
 94%|█████████▎| 347821/371472 [5:30:34<1:54:31,  3.44it/s]
 94%|█████████▎| 347822/371472 [5:30:34<2:04:20,  3.17it/s]
 94%|█████████▎| 347823/371472 [5:30:35<1:58:08,  3.34it/s]
 94%|█████████▎| 347824/371472 [5:30:35<1:57:38,  3.35it/s]
 94%|█████████▎| 347825/371472 [5:30:35<1:52:44,  3.50it/s]
 94%|█████████▎| 347826/371472 [5:30:35<1:49:36,  3.60it/s]
 94%|█████████▎| 347827/371472 [5:30:36<1:45:08,  3.75it/s]
 94%|█████████▎| 347828/371472 [5:30:36<1:46:46,  3.69it/s]
 94%|█████████▎| 347829/371472 [5:30:36<1:48:03,  3.65it/s]
 94%|█████████▎| 347830/371472 [5:30:37<2:01:47,  3.24it/s]
 94%|█████████▎| 347831/371472 [5:30:37<1:57:25,  3.36it/s]
 94%|█████████▎| 347832/371472 [5:30:37<1:55:23,  3.41it/s]
 94%|█████████▎| 347833/371472 [5:30:37<1:54:05,  3.45it/s]
 94%|█████████▎| 347834/371472 [5:30:38<1:51:47,  3.52it/s]
 94%|█████████▎| 347835/371472 [5:30:38<1:53:47,  3.46it/s]
 94%|█████████▎| 347836/371472 [5:30:38<2:01:01,  3.25it/s]
 94%|█████████▎| 347837/371472 [5:30:39<1:59:47,  3.29it/s]
 94%|█████████▎| 347838/371472 [5:30:39<2:00:12,  3.28it/s]
 94%|█████████▎| 347839/371472 [5:30:39<2:09:32,  3.04it/s]
 94%|█████████▎| 347840/371472 [5:30:40<2:05:43,  3.13it/s]
                                                           
{'loss': 2.5351, 'learning_rate': 1.5728630222586132e-07, 'epoch': 14.98}

 94%|█████████▎| 347840/371472 [5:30:40<2:05:43,  3.13it/s]
 94%|█████████▎| 347841/371472 [5:30:40<2:03:50,  3.18it/s]
 94%|█████████▎| 347842/371472 [5:30:40<1:56:52,  3.37it/s]
 94%|█████████▎| 347843/371472 [5:30:41<2:05:02,  3.15it/s]
 94%|█████████▎| 347844/371472 [5:30:41<2:00:40,  3.26it/s]
 94%|█████████▎| 347845/371472 [5:30:41<1:57:00,  3.37it/s]
 94%|█████████▎| 347846/371472 [5:30:41<1:52:23,  3.50it/s]
 94%|█████████▎| 347847/371472 [5:30:42<1:48:34,  3.63it/s]
 94%|█████████▎| 347848/371472 [5:30:42<1:49:03,  3.61it/s]
 94%|█████████▎| 347849/371472 [5:30:42<1:54:10,  3.45it/s]
 94%|█████████▎| 347850/371472 [5:30:42<1:50:43,  3.56it/s]
 94%|█████████▎| 347851/371472 [5:30:43<1:47:39,  3.66it/s]
 94%|█████████▎| 347852/371472 [5:30:43<1:54:50,  3.43it/s]
 94%|█████████▎| 347853/371472 [5:30:43<1:52:38,  3.49it/s]
 94%|█████████▎| 347854/371472 [5:30:44<1:51:37,  3.53it/s]
 94%|█████████▎| 347855/371472 [5:30:44<1:54:16,  3.44it/s]
 94%|█████████▎| 347856/371472 [5:30:44<1:55:32,  3.41it/s]
 94%|█████████▎| 347857/371472 [5:30:45<2:01:20,  3.24it/s]
 94%|█████████▎| 347858/371472 [5:30:45<1:56:58,  3.36it/s]
 94%|█████████▎| 347859/371472 [5:30:45<1:57:50,  3.34it/s]
 94%|█████████▎| 347860/371472 [5:30:45<1:57:50,  3.34it/s]
                                                           
{'loss': 2.5871, 'learning_rate': 1.572378202503825e-07, 'epoch': 14.98}

 94%|█████████▎| 347860/371472 [5:30:45<1:57:50,  3.34it/s]
 94%|█████████▎| 347861/371472 [5:30:46<1:53:23,  3.47it/s]
 94%|█████████▎| 347862/371472 [5:30:46<1:52:43,  3.49it/s]
 94%|█████████▎| 347863/371472 [5:30:46<1:55:18,  3.41it/s]
 94%|█████████▎| 347864/371472 [5:30:47<1:51:59,  3.51it/s]
 94%|█████████▎| 347865/371472 [5:30:47<1:53:54,  3.45it/s]
 94%|█████████▎| 347866/371472 [5:30:47<1:59:52,  3.28it/s]
 94%|█████████▎| 347867/371472 [5:30:47<1:56:05,  3.39it/s]
 94%|█████████▎| 347868/371472 [5:30:48<1:52:06,  3.51it/s]
 94%|█████████▎| 347869/371472 [5:30:48<1:47:34,  3.66it/s]
 94%|█████████▎| 347870/371472 [5:30:48<1:47:52,  3.65it/s]
 94%|█████████▎| 347871/371472 [5:30:49<1:52:38,  3.49it/s]
 94%|█████████▎| 347872/371472 [5:30:49<1:50:08,  3.57it/s]
 94%|█████████▎| 347873/371472 [5:30:49<1:55:39,  3.40it/s]
 94%|█████████▎| 347874/371472 [5:30:49<1:57:17,  3.35it/s]
 94%|█████████▎| 347875/371472 [5:30:50<1:55:22,  3.41it/s]
 94%|█████████▎| 347876/371472 [5:30:50<1:55:02,  3.42it/s]
 94%|█████████▎| 347877/371472 [5:30:50<1:52:15,  3.50it/s]
 94%|█████████▎| 347878/371472 [5:30:51<1:49:11,  3.60it/s]
 94%|█████████▎| 347879/371472 [5:30:51<1:45:41,  3.72it/s]
 94%|█████████▎| 347880/371472 [5:30:51<1:50:43,  3.55it/s]
                                                           
{'loss': 2.5432, 'learning_rate': 1.5718933827490354e-07, 'epoch': 14.98}

 94%|█████████▎| 347880/371472 [5:30:51<1:50:43,  3.55it/s]
 94%|█████████▎| 347881/371472 [5:30:51<1:45:30,  3.73it/s]
 94%|█████████▎| 347882/371472 [5:30:52<1:46:50,  3.68it/s]
 94%|█████████▎| 347883/371472 [5:30:52<1:51:13,  3.53it/s]
 94%|█████████▎| 347884/371472 [5:30:52<2:00:39,  3.26it/s]
 94%|█████████▎| 347885/371472 [5:30:53<1:54:20,  3.44it/s]
 94%|█████████▎| 347886/371472 [5:30:53<1:53:27,  3.46it/s]
 94%|█████████▎| 347887/371472 [5:30:53<1:54:53,  3.42it/s]
 94%|█████████▎| 347888/371472 [5:30:53<1:51:52,  3.51it/s]
 94%|█████████▎| 347889/371472 [5:30:54<2:03:59,  3.17it/s]
 94%|█████████▎| 347890/371472 [5:30:54<2:00:06,  3.27it/s]
 94%|█████████▎| 347891/371472 [5:30:54<1:56:07,  3.38it/s]
 94%|█████████▎| 347892/371472 [5:30:55<2:02:31,  3.21it/s]
 94%|█████████▎| 347893/371472 [5:30:55<1:55:16,  3.41it/s]
 94%|█████████▎| 347894/371472 [5:30:55<1:50:54,  3.54it/s]
 94%|█████████▎| 347895/371472 [5:30:55<1:47:58,  3.64it/s]
 94%|█████████▎| 347896/371472 [5:30:56<1:45:28,  3.73it/s]
 94%|█████████▎| 347897/371472 [5:30:56<1:48:55,  3.61it/s]
 94%|█████████▎| 347898/371472 [5:30:56<1:48:39,  3.62it/s]
 94%|█████████▎| 347899/371472 [5:30:57<1:49:40,  3.58it/s]
 94%|█████████▎| 347900/371472 [5:30:57<1:57:15,  3.35it/s]
                                                           
{'loss': 2.6277, 'learning_rate': 1.571408562994247e-07, 'epoch': 14.98}

 94%|█████████▎| 347900/371472 [5:30:57<1:57:15,  3.35it/s]
 94%|█████████▎| 347901/371472 [5:30:57<1:53:39,  3.46it/s]
 94%|█████████▎| 347902/371472 [5:30:57<1:53:25,  3.46it/s]
 94%|█████████▎| 347903/371472 [5:30:58<1:53:22,  3.46it/s]
 94%|█████████▎| 347904/371472 [5:30:58<1:50:05,  3.57it/s]
 94%|█████████▎| 347905/371472 [5:30:58<1:50:17,  3.56it/s]
 94%|█████████▎| 347906/371472 [5:30:59<1:49:21,  3.59it/s]
 94%|█████████▎| 347907/371472 [5:30:59<1:48:46,  3.61it/s]
 94%|█████████▎| 347908/371472 [5:30:59<1:48:07,  3.63it/s]
 94%|█████████▎| 347909/371472 [5:30:59<1:46:15,  3.70it/s]
 94%|█████████▎| 347910/371472 [5:31:00<1:41:52,  3.85it/s]
 94%|█████████▎| 347911/371472 [5:31:00<1:46:09,  3.70it/s]
 94%|█████████▎| 347912/371472 [5:31:00<1:44:35,  3.75it/s]
 94%|█████████▎| 347913/371472 [5:31:00<1:41:52,  3.85it/s]
 94%|█████████▎| 347914/371472 [5:31:01<1:42:59,  3.81it/s]
 94%|█████████▎| 347915/371472 [5:31:01<1:46:32,  3.69it/s]
 94%|█████████▎| 347916/371472 [5:31:01<1:49:09,  3.60it/s]
 94%|█████████▎| 347917/371472 [5:31:02<1:49:44,  3.58it/s]
 94%|█████████▎| 347918/371472 [5:31:02<1:53:44,  3.45it/s]
 94%|█████████▎| 347919/371472 [5:31:02<1:51:13,  3.53it/s]
 94%|█████████▎| 347920/371472 [5:31:02<1:52:31,  3.49it/s]
                                                           
{'loss': 2.5263, 'learning_rate': 1.5709237432394576e-07, 'epoch': 14.99}

 94%|█████████▎| 347920/371472 [5:31:02<1:52:31,  3.49it/s]
 94%|█████████▎| 347921/371472 [5:31:03<1:53:35,  3.46it/s]
 94%|█████████▎| 347922/371472 [5:31:03<1:55:37,  3.39it/s]
 94%|█████████▎| 347923/371472 [5:31:03<1:56:59,  3.35it/s]
 94%|█████████▎| 347924/371472 [5:31:04<1:54:15,  3.43it/s]
 94%|█████████▎| 347925/371472 [5:31:04<1:54:04,  3.44it/s]
 94%|█████████▎| 347926/371472 [5:31:04<1:50:21,  3.56it/s]
 94%|█████████▎| 347927/371472 [5:31:04<1:50:47,  3.54it/s]
 94%|█████████▎| 347928/371472 [5:31:05<2:01:02,  3.24it/s]
 94%|█████████▎| 347929/371472 [5:31:05<1:57:40,  3.33it/s]
 94%|█████████▎| 347930/371472 [5:31:05<2:01:36,  3.23it/s]
 94%|█████████▎| 347931/371472 [5:31:06<1:57:16,  3.35it/s]
 94%|█████████▎| 347932/371472 [5:31:06<1:56:13,  3.38it/s]
 94%|█████████▎| 347933/371472 [5:31:06<1:54:41,  3.42it/s]
 94%|█████████▎| 347934/371472 [5:31:07<1:48:57,  3.60it/s]
 94%|█████████▎| 347935/371472 [5:31:07<1:45:49,  3.71it/s]
 94%|█████████▎| 347936/371472 [5:31:07<1:44:43,  3.75it/s]
 94%|█████████▎| 347937/371472 [5:31:07<1:47:19,  3.65it/s]
 94%|█████████▎| 347938/371472 [5:31:08<1:42:56,  3.81it/s]
 94%|█████████▎| 347939/371472 [5:31:08<1:46:55,  3.67it/s]
 94%|█████████▎| 347940/371472 [5:31:08<1:42:40,  3.82it/s]
                                                           
{'loss': 2.6921, 'learning_rate': 1.570438923484669e-07, 'epoch': 14.99}

 94%|█████████▎| 347940/371472 [5:31:08<1:42:40,  3.82it/s]
 94%|█████████▎| 347941/371472 [5:31:08<1:42:18,  3.83it/s]
 94%|█████████▎| 347942/371472 [5:31:09<1:44:24,  3.76it/s]
 94%|█████████▎| 347943/371472 [5:31:09<1:44:35,  3.75it/s]
 94%|█████████▎| 347944/371472 [5:31:09<1:44:20,  3.76it/s]
 94%|█████████▎| 347945/371472 [5:31:09<1:46:59,  3.66it/s]
 94%|█████████▎| 347946/371472 [5:31:10<1:44:44,  3.74it/s]
 94%|█████████▎| 347947/371472 [5:31:10<1:47:02,  3.66it/s]
 94%|█████████▎| 347948/371472 [5:31:10<1:45:15,  3.73it/s]
 94%|█████████▎| 347949/371472 [5:31:11<1:48:03,  3.63it/s]
 94%|█████████▎| 347950/371472 [5:31:11<1:47:01,  3.66it/s]
 94%|█████████▎| 347951/371472 [5:31:11<1:45:05,  3.73it/s]
 94%|█████████▎| 347952/371472 [5:31:11<1:44:27,  3.75it/s]
 94%|█████████▎| 347953/371472 [5:31:12<1:47:41,  3.64it/s]
 94%|█████████▎| 347954/371472 [5:31:12<1:49:44,  3.57it/s]
 94%|█████████▎| 347955/371472 [5:31:12<1:48:49,  3.60it/s]
 94%|█████████▎| 347956/371472 [5:31:12<1:50:39,  3.54it/s]
 94%|█████████▎| 347957/371472 [5:31:13<1:49:17,  3.59it/s]
 94%|█████████▎| 347958/371472 [5:31:13<1:54:09,  3.43it/s]
 94%|█████████▎| 347959/371472 [5:31:13<1:50:53,  3.53it/s]
 94%|█████████▎| 347960/371472 [5:31:14<1:48:57,  3.60it/s]
                                                           
{'loss': 2.7375, 'learning_rate': 1.5699541037298796e-07, 'epoch': 14.99}

 94%|█████████▎| 347960/371472 [5:31:14<1:48:57,  3.60it/s]
 94%|█████████▎| 347961/371472 [5:31:14<1:47:14,  3.65it/s]
 94%|█████████▎| 347962/371472 [5:31:14<1:44:14,  3.76it/s]
 94%|█████████▎| 347963/371472 [5:31:14<1:45:09,  3.73it/s]
 94%|█████████▎| 347964/371472 [5:31:15<1:44:27,  3.75it/s]
 94%|█████████▎| 347965/371472 [5:31:15<1:41:11,  3.87it/s]
 94%|█████████▎| 347966/371472 [5:31:15<1:45:08,  3.73it/s]
 94%|█████████▎| 347967/371472 [5:31:15<1:43:25,  3.79it/s]
 94%|█████████▎| 347968/371472 [5:31:16<1:45:41,  3.71it/s]
 94%|█████████▎| 347969/371472 [5:31:16<1:48:10,  3.62it/s]
 94%|█████████▎| 347970/371472 [5:31:16<1:48:17,  3.62it/s]
 94%|█████████▎| 347971/371472 [5:31:17<1:46:57,  3.66it/s]
 94%|█████████▎| 347972/371472 [5:31:17<1:52:22,  3.49it/s]
 94%|█████████▎| 347973/371472 [5:31:17<1:55:06,  3.40it/s]
 94%|█████████▎| 347974/371472 [5:31:17<1:52:12,  3.49it/s]
 94%|█████████▎| 347975/371472 [5:31:18<1:50:00,  3.56it/s]
 94%|█████████▎| 347976/371472 [5:31:18<1:52:27,  3.48it/s]
 94%|█████████▎| 347977/371472 [5:31:18<1:51:42,  3.51it/s]
 94%|█████████▎| 347978/371472 [5:31:19<1:47:25,  3.64it/s]
 94%|█████████▎| 347979/371472 [5:31:19<1:45:27,  3.71it/s]
 94%|█████████▎| 347980/371472 [5:31:19<1:48:33,  3.61it/s]
                                                           
{'loss': 2.572, 'learning_rate': 1.5694692839750913e-07, 'epoch': 14.99}

 94%|█████████▎| 347980/371472 [5:31:19<1:48:33,  3.61it/s]
 94%|█████████▎| 347981/371472 [5:31:19<1:48:08,  3.62it/s]
 94%|█████████▎| 347982/371472 [5:31:20<1:47:19,  3.65it/s]
 94%|█████████▎| 347983/371472 [5:31:20<1:48:33,  3.61it/s]
 94%|█████████▎| 347984/371472 [5:31:20<1:54:31,  3.42it/s]
 94%|█████████▎| 347985/371472 [5:31:21<1:56:32,  3.36it/s]
 94%|█████████▎| 347986/371472 [5:31:21<1:52:13,  3.49it/s]
 94%|█████████▎| 347987/371472 [5:31:21<1:48:03,  3.62it/s]
 94%|█████████▎| 347988/371472 [5:31:21<1:47:17,  3.65it/s]
 94%|█████████▎| 347989/371472 [5:31:22<1:45:05,  3.72it/s]
 94%|█████████▎| 347990/371472 [5:31:22<1:43:39,  3.78it/s]
 94%|█████████▎| 347991/371472 [5:31:22<1:41:26,  3.86it/s]
 94%|█████████▎| 347992/371472 [5:31:22<1:47:24,  3.64it/s]
 94%|█████████▎| 347993/371472 [5:31:23<1:52:22,  3.48it/s]
 94%|█████████▎| 347994/371472 [5:31:23<1:46:26,  3.68it/s]
 94%|█████████▎| 347995/371472 [5:31:23<1:42:50,  3.80it/s]
 94%|█████████▎| 347996/371472 [5:31:24<1:45:15,  3.72it/s]
 94%|█████████▎| 347997/371472 [5:31:24<1:46:19,  3.68it/s]
 94%|█████████▎| 347998/371472 [5:31:24<1:49:04,  3.59it/s]
 94%|█████████▎| 347999/371472 [5:31:24<1:49:54,  3.56it/s]
 94%|█████████▎| 348000/371472 [5:31:25<1:55:25,  3.39it/s]
                                                           
{'loss': 2.6143, 'learning_rate': 1.5689844642203018e-07, 'epoch': 14.99}

 94%|█████████▎| 348000/371472 [5:31:25<1:55:25,  3.39it/s]
 94%|█████████▎| 348001/371472 [5:31:25<1:50:30,  3.54it/s]
 94%|█████████▎| 348002/371472 [5:31:25<1:53:08,  3.46it/s]
 94%|█████████▎| 348003/371472 [5:31:26<1:49:32,  3.57it/s]
 94%|█████████▎| 348004/371472 [5:31:26<1:50:47,  3.53it/s]
 94%|█████████▎| 348005/371472 [5:31:26<1:51:48,  3.50it/s]
 94%|█████████▎| 348006/371472 [5:31:26<1:48:07,  3.62it/s]
 94%|█████████▎| 348007/371472 [5:31:27<1:50:57,  3.52it/s]
 94%|█████████▎| 348008/371472 [5:31:27<1:50:36,  3.54it/s]
 94%|█████████▎| 348009/371472 [5:31:27<1:48:09,  3.62it/s]
 94%|█████████▎| 348010/371472 [5:31:27<1:47:29,  3.64it/s]
 94%|█████████▎| 348011/371472 [5:31:28<1:47:50,  3.63it/s]
 94%|█████████▎| 348012/371472 [5:31:28<1:48:02,  3.62it/s]
 94%|█████████▎| 348013/371472 [5:31:28<1:45:19,  3.71it/s]
 94%|█████████▎| 348014/371472 [5:31:29<1:49:27,  3.57it/s]
 94%|█████████▎| 348015/371472 [5:31:29<1:46:10,  3.68it/s]
 94%|█████████▎| 348016/371472 [5:31:29<1:42:16,  3.82it/s]
 94%|█████████▎| 348017/371472 [5:31:29<1:40:13,  3.90it/s]
 94%|█████████▎| 348018/371472 [5:31:30<1:44:53,  3.73it/s]
 94%|█████████▎| 348019/371472 [5:31:30<1:43:40,  3.77it/s]
 94%|█████████▎| 348020/371472 [5:31:30<1:40:05,  3.91it/s]
                                                           
{'loss': 2.5568, 'learning_rate': 1.5684996444655133e-07, 'epoch': 14.99}

 94%|█████████▎| 348020/371472 [5:31:30<1:40:05,  3.91it/s]
 94%|█████████▎| 348021/371472 [5:31:30<1:42:18,  3.82it/s]
 94%|█████████▎| 348022/371472 [5:31:31<1:47:32,  3.63it/s]
 94%|█████████▎| 348023/371472 [5:31:31<1:44:31,  3.74it/s]
 94%|█████████▎| 348024/371472 [5:31:31<1:43:32,  3.77it/s]
 94%|█████████▎| 348025/371472 [5:31:31<1:46:09,  3.68it/s]
 94%|█████████▎| 348026/371472 [5:31:32<1:45:58,  3.69it/s]
 94%|█████████▎| 348027/371472 [5:31:32<1:42:23,  3.82it/s]
 94%|█████████▎| 348028/371472 [5:31:32<1:44:13,  3.75it/s]
 94%|█████████▎| 348029/371472 [5:31:33<1:47:47,  3.63it/s]
 94%|█████████▎| 348030/371472 [5:31:33<1:49:45,  3.56it/s]
 94%|█████████▎| 348031/371472 [5:31:33<1:54:19,  3.42it/s]
 94%|█████████▎| 348032/371472 [5:31:33<1:57:29,  3.33it/s]
 94%|█████████▎| 348033/371472 [5:31:34<1:57:09,  3.33it/s]
 94%|█████████▎| 348034/371472 [5:31:34<1:54:43,  3.40it/s]
 94%|█████████▎| 348035/371472 [5:31:34<1:54:33,  3.41it/s]
 94%|█████████▎| 348036/371472 [5:31:35<1:49:21,  3.57it/s]
 94%|█████████▎| 348037/371472 [5:31:35<1:56:28,  3.35it/s]
 94%|█████████▎| 348038/371472 [5:31:35<1:54:51,  3.40it/s]
 94%|█████████▎| 348039/371472 [5:31:35<1:48:58,  3.58it/s]
 94%|█████████▎| 348040/371472 [5:31:36<1:47:03,  3.65it/s]
                                                           
{'loss': 2.4816, 'learning_rate': 1.568014824710724e-07, 'epoch': 14.99}

 94%|█████████▎| 348040/371472 [5:31:36<1:47:03,  3.65it/s]
 94%|█████████▎| 348041/371472 [5:31:36<2:03:21,  3.17it/s]
 94%|█████████▎| 348042/371472 [5:31:36<1:58:04,  3.31it/s]
 94%|█████████▎| 348043/371472 [5:31:37<1:57:35,  3.32it/s]
 94%|█████████▎| 348044/371472 [5:31:37<1:52:39,  3.47it/s]
 94%|█████████▎| 348045/371472 [5:31:37<1:48:42,  3.59it/s]
 94%|█████████▎| 348046/371472 [5:31:38<2:00:12,  3.25it/s]
 94%|█████████▎| 348047/371472 [5:31:38<1:56:47,  3.34it/s]
 94%|█████████▎| 348048/371472 [5:31:38<1:55:11,  3.39it/s]
 94%|█████████▎| 348049/371472 [5:31:38<1:51:42,  3.49it/s]
 94%|█████████▎| 348050/371472 [5:31:39<1:47:55,  3.62it/s]
 94%|█████████▎| 348051/371472 [5:31:39<1:46:58,  3.65it/s]
 94%|█████████▎| 348052/371472 [5:31:39<1:47:24,  3.63it/s]
 94%|█████████▎| 348053/371472 [5:31:40<1:50:28,  3.53it/s]
 94%|█████████▎| 348054/371472 [5:31:40<1:47:55,  3.62it/s]
 94%|█████████▎| 348055/371472 [5:31:40<1:46:21,  3.67it/s]
 94%|█████████▎| 348056/371472 [5:31:40<1:41:26,  3.85it/s]
 94%|█████████▎| 348057/371472 [5:31:41<1:51:16,  3.51it/s]
 94%|█████████▎| 348058/371472 [5:31:41<1:47:24,  3.63it/s]
 94%|█████████▎| 348059/371472 [5:31:41<1:51:01,  3.51it/s]
 94%|█████████▎| 348060/371472 [5:31:41<1:51:22,  3.50it/s]
                                                           
{'loss': 2.6472, 'learning_rate': 1.5675300049559355e-07, 'epoch': 14.99}

 94%|█████████▎| 348060/371472 [5:31:41<1:51:22,  3.50it/s]
 94%|█████████▎| 348061/371472 [5:31:42<1:55:06,  3.39it/s]
 94%|█████████▎| 348062/371472 [5:31:42<1:54:08,  3.42it/s]
 94%|█████████▎| 348063/371472 [5:31:42<1:49:27,  3.56it/s]
 94%|█████████▎| 348064/371472 [5:31:43<1:48:22,  3.60it/s]
 94%|█████████▎| 348065/371472 [5:31:43<1:56:35,  3.35it/s]
 94%|█████████▎| 348066/371472 [5:31:43<1:50:35,  3.53it/s]
 94%|█████████▎| 348067/371472 [5:31:44<1:51:38,  3.49it/s]
 94%|█████████▎| 348068/371472 [5:31:44<1:49:56,  3.55it/s]
 94%|█████████▎| 348069/371472 [5:31:44<1:52:17,  3.47it/s]
 94%|█████████▎| 348070/371472 [5:31:44<1:49:13,  3.57it/s]
 94%|█████████▎| 348071/371472 [5:31:45<1:50:52,  3.52it/s]
 94%|█████████▎| 348072/371472 [5:31:45<1:51:35,  3.50it/s]
 94%|█████████▎| 348073/371472 [5:31:45<1:51:44,  3.49it/s]
 94%|█████████▎| 348074/371472 [5:31:45<1:48:32,  3.59it/s]
 94%|█████████▎| 348075/371472 [5:31:46<1:45:55,  3.68it/s]
 94%|█████████▎| 348076/371472 [5:31:46<1:46:23,  3.67it/s]
 94%|█████████▎| 348077/371472 [5:31:46<1:50:04,  3.54it/s]
 94%|█████████▎| 348078/371472 [5:31:47<1:59:39,  3.26it/s]
 94%|█████████▎| 348079/371472 [5:31:47<2:02:25,  3.18it/s]
 94%|█████████▎| 348080/371472 [5:31:47<2:07:06,  3.07it/s]
                                                           
{'loss': 2.524, 'learning_rate': 1.5670451852011462e-07, 'epoch': 14.99}

 94%|█████████▎| 348080/371472 [5:31:47<2:07:06,  3.07it/s]
 94%|█████████▎| 348081/371472 [5:31:48<2:07:13,  3.06it/s]
 94%|█████████▎| 348082/371472 [5:31:48<2:06:12,  3.09it/s]
 94%|█████████▎| 348083/371472 [5:31:48<2:00:55,  3.22it/s]
 94%|█████████▎| 348084/371472 [5:31:49<1:58:44,  3.28it/s]
 94%|█████████▎| 348085/371472 [5:31:49<1:59:22,  3.27it/s]
 94%|█████████▎| 348086/371472 [5:31:49<1:52:39,  3.46it/s]
 94%|█████████▎| 348087/371472 [5:31:49<1:52:07,  3.48it/s]
 94%|█████████▎| 348088/371472 [5:31:50<1:51:44,  3.49it/s]
 94%|█████████▎| 348089/371472 [5:31:50<1:53:08,  3.44it/s]
 94%|█████████▎| 348090/371472 [5:31:50<1:52:25,  3.47it/s]
 94%|█████████▎| 348091/371472 [5:31:51<1:50:17,  3.53it/s]
 94%|█████████▎| 348092/371472 [5:31:51<1:49:00,  3.57it/s]
 94%|█████████▎| 348093/371472 [5:31:51<1:49:54,  3.55it/s]
 94%|█████████▎| 348094/371472 [5:31:51<1:47:42,  3.62it/s]
 94%|█████████▎| 348095/371472 [5:31:52<1:56:33,  3.34it/s]
 94%|█████████▎| 348096/371472 [5:31:52<1:55:47,  3.36it/s]
 94%|█████████▎| 348097/371472 [5:31:52<1:58:17,  3.29it/s]
 94%|█████████▎| 348098/371472 [5:31:53<1:50:25,  3.53it/s]
 94%|█████████▎| 348099/371472 [5:31:53<1:54:47,  3.39it/s]
 94%|█████████▎| 348100/371472 [5:31:53<1:47:35,  3.62it/s]
                                                           
{'loss': 2.6025, 'learning_rate': 1.5665603654463577e-07, 'epoch': 14.99}

 94%|█████████▎| 348100/371472 [5:31:53<1:47:35,  3.62it/s]
 94%|█████████▎| 348101/371472 [5:31:53<1:46:48,  3.65it/s]
 94%|█████████▎| 348102/371472 [5:31:54<1:47:37,  3.62it/s]
 94%|█████████▎| 348103/371472 [5:31:54<1:50:55,  3.51it/s]
 94%|█████████▎| 348104/371472 [5:31:54<1:45:58,  3.68it/s]
 94%|█████████▎| 348105/371472 [5:31:55<1:46:46,  3.65it/s]
 94%|█████████▎| 348106/371472 [5:31:55<1:51:54,  3.48it/s]
 94%|█████████▎| 348107/371472 [5:31:55<1:48:53,  3.58it/s]
 94%|█████████▎| 348108/371472 [5:31:55<1:50:17,  3.53it/s]
 94%|█████████▎| 348109/371472 [5:31:56<1:46:53,  3.64it/s]
 94%|█████████▎| 348110/371472 [5:31:56<1:49:15,  3.56it/s]
 94%|█████████▎| 348111/371472 [5:31:56<1:50:59,  3.51it/s]
 94%|█████████▎| 348112/371472 [5:31:56<1:46:12,  3.67it/s]
 94%|█████████▎| 348113/371472 [5:31:57<1:44:29,  3.73it/s]
 94%|█████████▎| 348114/371472 [5:31:57<1:44:00,  3.74it/s]
 94%|█████████▎| 348115/371472 [5:31:57<2:04:07,  3.14it/s]
 94%|█████████▎| 348116/371472 [5:31:58<1:58:31,  3.28it/s]
 94%|█████████▎| 348117/371472 [5:31:58<1:53:44,  3.42it/s]
 94%|█████████▎| 348118/371472 [5:31:58<1:50:12,  3.53it/s]
 94%|█████████▎| 348119/371472 [5:31:59<1:52:07,  3.47it/s]
 94%|█████████▎| 348120/371472 [5:31:59<1:55:49,  3.36it/s]
                                                           
{'loss': 2.5365, 'learning_rate': 1.5660755456915685e-07, 'epoch': 14.99}

 94%|█████████▎| 348120/371472 [5:31:59<1:55:49,  3.36it/s]
 94%|█████████▎| 348121/371472 [5:31:59<1:54:42,  3.39it/s]
 94%|█████████▎| 348122/371472 [5:31:59<1:50:13,  3.53it/s]
 94%|█████████▎| 348123/371472 [5:32:00<1:46:22,  3.66it/s]
 94%|█████████▎| 348124/371472 [5:32:00<1:59:23,  3.26it/s]
 94%|█████████▎| 348125/371472 [5:32:00<1:51:32,  3.49it/s]
 94%|█████████▎| 348126/371472 [5:32:01<1:54:27,  3.40it/s]
 94%|█████████▎| 348127/371472 [5:32:01<1:50:35,  3.52it/s]
 94%|█████████▎| 348128/371472 [5:32:01<1:47:29,  3.62it/s]
 94%|█████████▎| 348129/371472 [5:32:01<1:46:22,  3.66it/s]
 94%|█████████▎| 348130/371472 [5:32:02<1:48:17,  3.59it/s]
 94%|█████████▎| 348131/371472 [5:32:02<1:45:00,  3.70it/s]
 94%|█████████▎| 348132/371472 [5:32:02<1:42:47,  3.78it/s]
 94%|█████████▎| 348133/371472 [5:32:03<1:56:29,  3.34it/s]
 94%|█████████▎| 348134/371472 [5:32:03<1:58:08,  3.29it/s]
 94%|█████████▎| 348135/371472 [5:32:03<1:52:02,  3.47it/s]
 94%|█████████▎| 348136/371472 [5:32:03<1:49:54,  3.54it/s]
 94%|█████████▎| 348137/371472 [5:32:04<1:49:13,  3.56it/s]
 94%|█████████▎| 348138/371472 [5:32:04<1:54:20,  3.40it/s]
 94%|█████████▎| 348139/371472 [5:32:04<1:53:40,  3.42it/s]
 94%|█████████▎| 348140/371472 [5:32:05<1:50:21,  3.52it/s]
                                                           
{'loss': 2.5331, 'learning_rate': 1.56559072593678e-07, 'epoch': 15.0}

 94%|█████████▎| 348140/371472 [5:32:05<1:50:21,  3.52it/s]
 94%|█████████▎| 348141/371472 [5:32:05<1:49:57,  3.54it/s]
 94%|█████████▎| 348142/371472 [5:32:05<1:48:35,  3.58it/s]
 94%|█████████▎| 348143/371472 [5:32:05<1:48:40,  3.58it/s]
 94%|█████████▎| 348144/371472 [5:32:06<1:46:21,  3.66it/s]
 94%|█████████▎| 348145/371472 [5:32:06<1:46:52,  3.64it/s]
 94%|█████████▎| 348146/371472 [5:32:06<1:52:19,  3.46it/s]
 94%|█████████▎| 348147/371472 [5:32:06<1:50:45,  3.51it/s]
 94%|█████████▎| 348148/371472 [5:32:07<1:48:59,  3.57it/s]
 94%|█████████▎| 348149/371472 [5:32:07<1:50:59,  3.50it/s]
 94%|█████████▎| 348150/371472 [5:32:07<1:55:16,  3.37it/s]
 94%|█████████▎| 348151/371472 [5:32:08<1:55:41,  3.36it/s]
 94%|█████████▎| 348152/371472 [5:32:08<1:51:26,  3.49it/s]
 94%|█████████▎| 348153/371472 [5:32:08<1:49:47,  3.54it/s]
 94%|█████████▎| 348154/371472 [5:32:09<1:53:49,  3.41it/s]
 94%|█████████▎| 348155/371472 [5:32:09<1:50:39,  3.51it/s]
 94%|█████████▎| 348156/371472 [5:32:09<1:57:29,  3.31it/s]
 94%|█████████▎| 348157/371472 [5:32:09<1:52:55,  3.44it/s]
 94%|█████████▎| 348158/371472 [5:32:10<1:54:41,  3.39it/s]
 94%|█████████▎| 348159/371472 [5:32:10<1:54:44,  3.39it/s]
 94%|█████████▎| 348160/371472 [5:32:10<1:54:54,  3.38it/s]
                                                           
{'loss': 2.5148, 'learning_rate': 1.5651059061819904e-07, 'epoch': 15.0}

 94%|█████████▎| 348160/371472 [5:32:10<1:54:54,  3.38it/s]
 94%|█████████▎| 348161/371472 [5:32:11<1:55:33,  3.36it/s]
 94%|█████████▎| 348162/371472 [5:32:11<1:59:06,  3.26it/s]
 94%|█████████▎| 348163/371472 [5:32:11<1:55:18,  3.37it/s]
 94%|█████████▎| 348164/371472 [5:32:11<1:51:00,  3.50it/s]
 94%|█████████▎| 348165/371472 [5:32:12<1:48:02,  3.60it/s]
 94%|█████████▎| 348166/371472 [5:32:12<1:53:48,  3.41it/s]
 94%|█████████▎| 348167/371472 [5:32:12<2:05:57,  3.08it/s]
 94%|█████████▎| 348168/371472 [5:32:13<2:02:45,  3.16it/s]
 94%|█████████▎| 348169/371472 [5:32:13<1:55:11,  3.37it/s]
 94%|█████████▎| 348170/371472 [5:32:13<1:58:18,  3.28it/s]
 94%|█████████▎| 348171/371472 [5:32:14<1:55:02,  3.38it/s]
 94%|█████████▎| 348172/371472 [5:32:14<1:51:48,  3.47it/s]
 94%|█████████▎| 348173/371472 [5:32:14<1:51:47,  3.47it/s]
 94%|█████████▎| 348174/371472 [5:32:14<1:46:45,  3.64it/s]
 94%|█████████▎| 348175/371472 [5:32:15<2:05:13,  3.10it/s]
 94%|█████████▎| 348176/371472 [5:32:15<1:58:15,  3.28it/s]
 94%|█████████▎| 348177/371472 [5:32:15<1:53:25,  3.42it/s]
 94%|█████████▎| 348178/371472 [5:32:16<1:48:31,  3.58it/s]
 94%|█████████▎| 348179/371472 [5:32:16<2:20:51,  2.76it/s]
 94%|█████████▎| 348180/371472 [5:32:16<2:08:20,  3.02it/s]
                                                           
{'loss': 2.5245, 'learning_rate': 1.5646210864272022e-07, 'epoch': 15.0}

 94%|█████████▎| 348180/371472 [5:32:16<2:08:20,  3.02it/s]
 94%|█████████▎| 348181/371472 [5:32:17<2:01:21,  3.20it/s]
 94%|█████████▎| 348182/371472 [5:32:17<1:55:38,  3.36it/s]
 94%|█████████▎| 348183/371472 [5:32:17<1:52:28,  3.45it/s]
 94%|█████████▎| 348184/371472 [5:32:17<1:48:13,  3.59it/s]
 94%|█████████▎| 348185/371472 [5:32:18<1:47:11,  3.62it/s]
 94%|█████████▎| 348186/371472 [5:32:18<1:49:57,  3.53it/s]
 94%|█████████▎| 348187/371472 [5:32:18<1:55:00,  3.37it/s]
 94%|█████████▎| 348188/371472 [5:32:19<1:51:33,  3.48it/s]
 94%|█████████▎| 348189/371472 [5:32:19<2:01:46,  3.19it/s]
 94%|█████████▎| 348190/371472 [5:32:19<2:03:15,  3.15it/s]
 94%|█████████▎| 348191/371472 [5:32:20<2:02:07,  3.18it/s]
 94%|█████████▎| 348192/371472 [5:32:20<1:58:47,  3.27it/s]
 94%|█████████▎| 348193/371472 [5:32:20<1:56:39,  3.33it/s]
 94%|█████████▎| 348194/371472 [5:32:20<1:49:46,  3.53it/s]
 94%|█████████▎| 348195/371472 [5:32:21<1:46:44,  3.63it/s]
 94%|█████████▎| 348196/371472 [5:32:21<1:52:55,  3.44it/s]
 94%|█████████▎| 348197/371472 [5:32:21<1:54:05,  3.40it/s]
 94%|█████████▎| 348198/371472 [5:32:22<1:50:53,  3.50it/s]
 94%|█████████▎| 348199/371472 [5:32:22<1:48:17,  3.58it/s]
 94%|█████████▎| 348200/371472 [5:32:22<1:44:51,  3.70it/s]
                                                           
{'loss': 2.5548, 'learning_rate': 1.5641362666724126e-07, 'epoch': 15.0}

 94%|█████████▎| 348200/371472 [5:32:22<1:44:51,  3.70it/s]
 94%|█████████▎| 348201/371472 [5:32:22<1:55:15,  3.37it/s]
 94%|█████████▎| 348202/371472 [5:32:23<1:49:25,  3.54it/s]
 94%|█████████▎| 348203/371472 [5:32:23<1:50:28,  3.51it/s]
 94%|█████████▎| 348204/371472 [5:32:23<1:48:46,  3.56it/s]
 94%|█████████▎| 348205/371472 [5:32:24<1:50:31,  3.51it/s]
 94%|█████████▎| 348206/371472 [5:32:24<1:54:50,  3.38it/s]
 94%|█████████▎| 348207/371472 [5:32:24<1:53:19,  3.42it/s]
 94%|█████████▎| 348208/371472 [5:32:25<1:57:26,  3.30it/s]
 94%|█████████▎| 348209/371472 [5:32:25<1:57:54,  3.29it/s]
 94%|█████████▎| 348210/371472 [5:32:25<1:58:20,  3.28it/s]
 94%|█████████▎| 348211/371472 [5:32:26<2:08:38,  3.01it/s]
 94%|█████████▎| 348212/371472 [5:32:26<1:57:53,  3.29it/s]
 94%|█████████▎| 348213/371472 [5:32:26<1:51:05,  3.49it/s]
 94%|█████████▎| 348214/371472 [5:32:26<1:48:02,  3.59it/s]
 94%|█████████▎| 348215/371472 [5:32:27<1:46:23,  3.64it/s]
 94%|█████████▎| 348216/371472 [5:32:27<1:48:03,  3.59it/s]
 94%|█████████▎| 348217/371472 [5:32:27<1:48:39,  3.57it/s]
 94%|█████████▎| 348218/371472 [5:32:27<1:47:47,  3.60it/s]
 94%|█████████▎| 348219/371472 [5:32:28<1:45:08,  3.69it/s]
 94%|█████████▎| 348220/371472 [5:32:28<1:45:37,  3.67it/s]
                                                           
{'loss': 2.5468, 'learning_rate': 1.563651446917623e-07, 'epoch': 15.0}

 94%|█████████▎| 348220/371472 [5:32:28<1:45:37,  3.67it/s]
 94%|█████████▎| 348221/371472 [5:32:28<1:43:34,  3.74it/s]
 94%|█████████▎| 348222/371472 [5:32:28<1:42:49,  3.77it/s]
 94%|█████████▎| 348223/371472 [5:32:29<1:40:24,  3.86it/s]
 94%|█████████▎| 348224/371472 [5:32:29<1:42:44,  3.77it/s]
 94%|█████████▎| 348225/371472 [5:32:29<1:51:59,  3.46it/s]
 94%|█████████▎| 348226/371472 [5:32:30<1:58:34,  3.27it/s]
 94%|█████████▎| 348227/371472 [5:32:30<1:54:18,  3.39it/s]
 94%|█████████▎| 348228/371472 [5:32:30<1:49:00,  3.55it/s]
 94%|█████████▎| 348229/371472 [5:32:30<1:45:01,  3.69it/s]
 94%|█████████▎| 348230/371472 [5:32:31<1:42:04,  3.79it/s]
 94%|█████████▎| 348231/371472 [5:32:31<1:43:19,  3.75it/s]
 94%|█████████▎| 348232/371472 [5:32:31<1:41:24,  3.82it/s]
 94%|█████████▎| 348233/371472 [5:32:32<1:47:26,  3.60it/s]
 94%|█████████▎| 348234/371472 [5:32:32<1:46:25,  3.64it/s]
 94%|█████████▎| 348235/371472 [5:32:32<1:55:02,  3.37it/s]
 94%|█████████▎| 348236/371472 [5:32:33<2:05:50,  3.08it/s]
 94%|█████████▎| 348237/371472 [5:32:33<1:58:24,  3.27it/s]
 94%|█████████▎| 348238/371472 [5:32:33<1:54:12,  3.39it/s]
 94%|█████████▎| 348239/371472 [5:32:33<2:03:06,  3.15it/s]
 94%|█████████▎| 348240/371472 [5:32:34<2:00:08,  3.22it/s]
                                                           
{'loss': 2.4548, 'learning_rate': 1.5631666271628349e-07, 'epoch': 15.0}

 94%|█████████▎| 348240/371472 [5:32:34<2:00:08,  3.22it/s]
 94%|█████████▎| 348241/371472 [5:32:34<1:57:44,  3.29it/s]
 94%|█████████▎| 348242/371472 [5:32:34<2:00:06,  3.22it/s]
 94%|█████████▎| 348243/371472 [5:32:35<2:03:59,  3.12it/s]
 94%|█████████▎| 348244/371472 [5:32:35<1:56:44,  3.32it/s]
 94%|█████████▎| 348245/371472 [5:32:35<1:52:26,  3.44it/s]
 94%|█████████▎| 348246/371472 [5:32:35<1:48:54,  3.55it/s]
 94%|█████████▎| 348247/371472 [5:32:36<1:45:07,  3.68it/s]
 94%|█████████▎| 348248/371472 [5:32:36<1:46:34,  3.63it/s]
 94%|█████████▎| 348249/371472 [5:32:36<1:59:27,  3.24it/s]
 94%|█████████▎| 348250/371472 [5:32:37<1:58:01,  3.28it/s]
 94%|█████████▎| 348251/371472 [5:32:37<1:53:48,  3.40it/s]
 94%|█████████▎| 348252/371472 [5:32:37<1:51:04,  3.48it/s]
 94%|█████████▎| 348253/371472 [5:32:37<1:51:48,  3.46it/s]
 94%|█████████▎| 348254/371472 [5:32:38<1:45:39,  3.66it/s]
 94%|█████████▍| 348255/371472 [5:32:38<1:52:40,  3.43it/s]Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
Non-default generation parameters: {'max_length': 200, 'early_stopping': True, 'num_beams': 5, 'forced_eos_token_id': 2}
/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

 94%|█████████▍| 348256/371472 [5:33:04<51:46:25,  8.03s/it]
 94%|█████████▍| 348257/371472 [5:33:04<36:52:48,  5.72s/it]
 94%|█████████▍| 348258/371472 [5:33:05<26:28:19,  4.11s/it]
 94%|█████████▍| 348259/371472 [5:33:05<19:12:29,  2.98s/it]
 94%|█████████▍| 348260/371472 [5:33:05<14:03:54,  2.18s/it]
                                                            
{'loss': 2.7289, 'learning_rate': 1.5626818074080453e-07, 'epoch': 15.0}

 94%|█████████▍| 348260/371472 [5:33:05<14:03:54,  2.18s/it]
 94%|█████████▍| 348261/371472 [5:33:06<10:36:52,  1.65s/it]
 94%|█████████▍| 348262/371472 [5:33:06<8:05:39,  1.26s/it] 
 94%|█████████▍| 348263/371472 [5:33:07<6:21:04,  1.02it/s]
 94%|█████████▍| 348264/371472 [5:33:07<5:08:25,  1.25it/s]
 94%|█████████▍| 348265/371472 [5:33:07<4:26:31,  1.45it/s]
 94%|█████████▍| 348266/371472 [5:33:08<3:47:12,  1.70it/s]
 94%|█████████▍| 348267/371472 [5:33:08<3:15:33,  1.98it/s]
 94%|█████████▍| 348268/371472 [5:33:08<2:56:51,  2.19it/s]
 94%|█████████▍| 348269/371472 [5:33:09<2:41:38,  2.39it/s]
 94%|█████████▍| 348270/371472 [5:33:09<2:31:10,  2.56it/s]
 94%|█████████▍| 348271/371472 [5:33:09<2:23:25,  2.70it/s]
 94%|█████████▍| 348272/371472 [5:33:10<2:17:29,  2.81it/s]
 94%|█████████▍| 348273/371472 [5:33:10<2:09:18,  2.99it/s]
 94%|█████████▍| 348274/371472 [5:33:10<2:03:39,  3.13it/s]
 94%|█████████▍| 348275/371472 [5:33:11<1:59:24,  3.24it/s]
 94%|█████████▍| 348276/371472 [5:33:11<1:51:23,  3.47it/s]
 94%|█████████▍| 348277/371472 [5:33:11<1:51:19,  3.47it/s]
 94%|█████████▍| 348278/371472 [5:33:11<1:51:21,  3.47it/s]
 94%|█████████▍| 348279/371472 [5:33:12<1:56:30,  3.32it/s]
 94%|█████████▍| 348280/371472 [5:33:12<1:54:19,  3.38it/s]
                                                           
{'loss': 2.4949, 'learning_rate': 1.5621969876532568e-07, 'epoch': 15.0}

 94%|█████████▍| 348280/371472 [5:33:12<1:54:19,  3.38it/s]
 94%|█████████▍| 348281/371472 [5:33:12<1:59:49,  3.23it/s]
 94%|█████████▍| 348282/371472 [5:33:13<1:55:58,  3.33it/s]
 94%|█████████▍| 348283/371472 [5:33:13<2:00:29,  3.21it/s]
 94%|█████████▍| 348284/371472 [5:33:13<1:58:18,  3.27it/s]
 94%|█████████▍| 348285/371472 [5:33:13<1:53:30,  3.40it/s]
 94%|█████████▍| 348286/371472 [5:33:14<1:54:35,  3.37it/s]
 94%|█████████▍| 348287/371472 [5:33:14<1:55:45,  3.34it/s]
 94%|█████████▍| 348288/371472 [5:33:14<1:51:34,  3.46it/s]
 94%|█████████▍| 348289/371472 [5:33:15<1:53:35,  3.40it/s]
 94%|█████████▍| 348290/371472 [5:33:15<1:54:26,  3.38it/s]
 94%|█████████▍| 348291/371472 [5:33:15<1:53:09,  3.41it/s]
 94%|█████████▍| 348292/371472 [5:33:16<1:50:47,  3.49it/s]
 94%|█████████▍| 348293/371472 [5:33:16<1:49:31,  3.53it/s]
 94%|█████████▍| 348294/371472 [5:33:16<1:51:56,  3.45it/s]
 94%|█████████▍| 348295/371472 [5:33:16<1:51:25,  3.47it/s]
 94%|█████████▍| 348296/371472 [5:33:17<1:49:29,  3.53it/s]
 94%|█████████▍| 348297/371472 [5:33:17<1:50:19,  3.50it/s]
 94%|█████████▍| 348298/371472 [5:33:17<1:50:19,  3.50it/s]
 94%|█████████▍| 348299/371472 [5:33:18<1:50:04,  3.51it/s]
 94%|█████████▍| 348300/371472 [5:33:18<1:54:06,  3.38it/s]
                                                           
{'loss': 2.537, 'learning_rate': 1.5617121678984675e-07, 'epoch': 15.0}

 94%|█████████▍| 348300/371472 [5:33:18<1:54:06,  3.38it/s]
 94%|█████████▍| 348301/371472 [5:33:18<1:55:24,  3.35it/s]
 94%|█████████▍| 348302/371472 [5:33:19<2:10:12,  2.97it/s]
 94%|█████████▍| 348303/371472 [5:33:19<2:13:13,  2.90it/s]
 94%|█████████▍| 348304/371472 [5:33:19<2:08:03,  3.02it/s]
 94%|█████████▍| 348305/371472 [5:33:20<2:05:43,  3.07it/s]
 94%|█████████▍| 348306/371472 [5:33:20<1:58:27,  3.26it/s]
 94%|█████████▍| 348307/371472 [5:33:20<1:57:40,  3.28it/s]
 94%|█████████▍| 348308/371472 [5:33:20<1:56:41,  3.31it/s]
 94%|█████████▍| 348309/371472 [5:33:21<1:59:08,  3.24it/s]
 94%|█████████▍| 348310/371472 [5:33:21<2:04:28,  3.10it/s]
 94%|█████████▍| 348311/371472 [5:33:21<2:06:35,  3.05it/s]
 94%|█████████▍| 348312/371472 [5:33:22<2:07:52,  3.02it/s]
 94%|█████████▍| 348313/371472 [5:33:22<2:03:12,  3.13it/s]
 94%|█████████▍| 348314/371472 [5:33:22<2:11:21,  2.94it/s]
 94%|█████████▍| 348315/371472 [5:33:23<2:05:46,  3.07it/s]
 94%|█████████▍| 348316/371472 [5:33:23<2:05:10,  3.08it/s]
 94%|█████████▍| 348317/371472 [5:33:23<2:04:23,  3.10it/s]
 94%|█████████▍| 348318/371472 [5:33:24<1:56:18,  3.32it/s]
 94%|█████████▍| 348319/371472 [5:33:24<2:02:51,  3.14it/s]
 94%|█████████▍| 348320/371472 [5:33:24<2:02:45,  3.14it/s]
                                                           
{'loss': 2.5016, 'learning_rate': 1.561227348143679e-07, 'epoch': 15.0}

 94%|█████████▍| 348320/371472 [5:33:24<2:02:45,  3.14it/s]
 94%|█████████▍| 348321/371472 [5:33:25<2:01:23,  3.18it/s]
 94%|█████████▍| 348322/371472 [5:33:25<1:53:21,  3.40it/s]
 94%|█████████▍| 348323/371472 [5:33:25<1:54:44,  3.36it/s]
 94%|█████████▍| 348324/371472 [5:33:25<1:51:47,  3.45it/s]
 94%|█████████▍| 348325/371472 [5:33:26<1:50:00,  3.51it/s]
 94%|█████████▍| 348326/371472 [5:33:26<1:49:29,  3.52it/s]
 94%|█████████▍| 348327/371472 [5:33:26<1:58:55,  3.24it/s]
 94%|█████████▍| 348328/371472 [5:33:27<2:00:12,  3.21it/s]
 94%|█████████▍| 348329/371472 [5:33:27<1:57:54,  3.27it/s]
 94%|█████████▍| 348330/371472 [5:33:27<1:52:35,  3.43it/s]
 94%|█████████▍| 348331/371472 [5:33:28<2:00:36,  3.20it/s]
 94%|█████████▍| 348332/371472 [5:33:28<1:57:33,  3.28it/s]
 94%|█████████▍| 348333/371472 [5:33:28<1:54:47,  3.36it/s]
 94%|█████████▍| 348334/371472 [5:33:28<1:51:11,  3.47it/s]
 94%|█████████▍| 348335/371472 [5:33:29<1:50:11,  3.50it/s]
 94%|█████████▍| 348336/371472 [5:33:29<1:47:10,  3.60it/s]
 94%|█████████▍| 348337/371472 [5:33:29<1:48:30,  3.55it/s]
 94%|█████████▍| 348338/371472 [5:33:30<1:45:56,  3.64it/s]
 94%|█████████▍| 348339/371472 [5:33:30<1:50:06,  3.50it/s]
 94%|█████████▍| 348340/371472 [5:33:30<1:57:33,  3.28it/s]
                                                           
{'loss': 2.5126, 'learning_rate': 1.5607425283888895e-07, 'epoch': 15.0}

 94%|█████████▍| 348340/371472 [5:33:30<1:57:33,  3.28it/s]
 94%|█████████▍| 348341/371472 [5:33:30<1:55:26,  3.34it/s]
 94%|█████████▍| 348342/371472 [5:33:31<2:04:46,  3.09it/s]
 94%|█████████▍| 348343/371472 [5:33:31<2:04:33,  3.09it/s]
 94%|█████████▍| 348344/371472 [5:33:31<2:05:14,  3.08it/s]
 94%|█████████▍| 348345/371472 [5:33:32<2:03:05,  3.13it/s]
 94%|█████████▍| 348346/371472 [5:33:32<2:01:19,  3.18it/s]
 94%|█████████▍| 348347/371472 [5:33:32<2:03:02,  3.13it/s]
 94%|█████████▍| 348348/371472 [5:33:33<1:59:27,  3.23it/s]
 94%|█████████▍| 348349/371472 [5:33:33<1:57:55,  3.27it/s]
 94%|█████████▍| 348350/371472 [5:33:33<1:53:34,  3.39it/s]
 94%|█████████▍| 348351/371472 [5:33:34<1:50:57,  3.47it/s]
 94%|█████████▍| 348352/371472 [5:33:34<1:56:07,  3.32it/s]
 94%|█████████▍| 348353/371472 [5:33:34<1:51:54,  3.44it/s]
 94%|█████████▍| 348354/371472 [5:33:34<1:48:50,  3.54it/s]
 94%|█████████▍| 348355/371472 [5:33:35<1:48:52,  3.54it/s]
 94%|█████████▍| 348356/371472 [5:33:35<2:04:43,  3.09it/s]
 94%|█████████▍| 348357/371472 [5:33:35<2:01:52,  3.16it/s]
 94%|█████████▍| 348358/371472 [5:33:36<1:59:10,  3.23it/s]
 94%|█████████▍| 348359/371472 [5:33:36<1:56:01,  3.32it/s]
 94%|█████████▍| 348360/371472 [5:33:36<1:59:23,  3.23it/s]
                                                           
{'loss': 2.5462, 'learning_rate': 1.5602577086341013e-07, 'epoch': 15.0}

 94%|█████████▍| 348360/371472 [5:33:36<1:59:23,  3.23it/s]
 94%|█████████▍| 348361/371472 [5:33:37<1:56:52,  3.30it/s]
 94%|█████████▍| 348362/371472 [5:33:37<1:51:45,  3.45it/s]
 94%|█████████▍| 348363/371472 [5:33:37<1:59:26,  3.22it/s]
 94%|█████████▍| 348364/371472 [5:33:38<1:58:19,  3.25it/s]
 94%|█████████▍| 348365/371472 [5:33:38<2:03:09,  3.13it/s]
 94%|█████████▍| 348366/371472 [5:33:38<1:59:03,  3.23it/s]
 94%|█████████▍| 348367/371472 [5:33:38<1:54:28,  3.36it/s]
 94%|█████████▍| 348368/371472 [5:33:39<1:54:11,  3.37it/s]
 94%|█████████▍| 348369/371472 [5:33:39<2:03:14,  3.12it/s]
 94%|█████████▍| 348370/371472 [5:33:39<1:58:02,  3.26it/s]
 94%|█████████▍| 348371/371472 [5:33:40<2:00:51,  3.19it/s]
 94%|█████████▍| 348372/371472 [5:33:40<2:04:51,  3.08it/s]
 94%|█████████▍| 348373/371472 [5:33:40<1:59:27,  3.22it/s]
 94%|█████████▍| 348374/371472 [5:33:41<1:55:19,  3.34it/s]
 94%|█████████▍| 348375/371472 [5:33:41<2:06:24,  3.05it/s]
 94%|█████████▍| 348376/371472 [5:33:41<2:09:33,  2.97it/s]
 94%|█████████▍| 348377/371472 [5:33:42<2:01:21,  3.17it/s]
 94%|█████████▍| 348378/371472 [5:33:42<2:01:40,  3.16it/s]
 94%|█████████▍| 348379/371472 [5:33:42<1:55:45,  3.32it/s]
 94%|█████████▍| 348380/371472 [5:33:43<1:59:22,  3.22it/s]
                                                           
{'loss': 2.632, 'learning_rate': 1.5597728888793117e-07, 'epoch': 15.01}

 94%|█████████▍| 348380/371472 [5:33:43<1:59:22,  3.22it/s]
 94%|█████████▍| 348381/371472 [5:33:43<2:09:33,  2.97it/s]
 94%|█████████▍| 348382/371472 [5:33:43<2:01:51,  3.16it/s]
 94%|█████████▍| 348383/371472 [5:33:43<1:55:53,  3.32it/s]
 94%|█████████▍| 348384/371472 [5:33:44<2:21:11,  2.73it/s]
 94%|█████████▍| 348385/371472 [5:33:44<2:12:48,  2.90it/s]
 94%|█████████▍| 348386/371472 [5:33:45<2:06:40,  3.04it/s]
 94%|█████████▍| 348387/371472 [5:33:45<1:58:22,  3.25it/s]
 94%|█████████▍| 348388/371472 [5:33:45<1:57:59,  3.26it/s]
 94%|█████████▍| 348389/371472 [5:33:45<1:53:28,  3.39it/s]
 94%|█████████▍| 348390/371472 [5:33:46<1:51:10,  3.46it/s]
 94%|█████████▍| 348391/371472 [5:33:46<1:46:54,  3.60it/s]
 94%|█████████▍| 348392/371472 [5:33:46<1:46:55,  3.60it/s]
 94%|█████████▍| 348393/371472 [5:33:47<1:53:35,  3.39it/s]
 94%|█████████▍| 348394/371472 [5:33:47<1:50:42,  3.47it/s]
 94%|█████████▍| 348395/371472 [5:33:47<1:50:42,  3.47it/s]
 94%|█████████▍| 348396/371472 [5:33:47<1:48:10,  3.56it/s]
 94%|█████████▍| 348397/371472 [5:33:48<1:49:57,  3.50it/s]
 94%|█████████▍| 348398/371472 [5:33:48<1:46:26,  3.61it/s]
 94%|█████████▍| 348399/371472 [5:33:48<1:52:18,  3.42it/s]
 94%|█████████▍| 348400/371472 [5:33:49<1:54:29,  3.36it/s]
                                                           
{'loss': 2.6343, 'learning_rate': 1.5592880691245232e-07, 'epoch': 15.01}

 94%|█████████▍| 348400/371472 [5:33:49<1:54:29,  3.36it/s]
 94%|█████████▍| 348401/371472 [5:33:49<1:56:48,  3.29it/s]
 94%|█████████▍| 348402/371472 [5:33:49<1:55:25,  3.33it/s]
 94%|█████████▍| 348403/371472 [5:33:50<2:05:05,  3.07it/s]
 94%|█████████▍| 348404/371472 [5:33:50<1:57:40,  3.27it/s]
 94%|█████████▍| 348405/371472 [5:33:50<1:50:24,  3.48it/s]
 94%|█████████▍| 348406/371472 [5:33:50<1:48:29,  3.54it/s]
 94%|█████████▍| 348407/371472 [5:33:51<1:53:25,  3.39it/s]
 94%|█████████▍| 348408/371472 [5:33:51<1:54:08,  3.37it/s]
 94%|█████████▍| 348409/371472 [5:33:51<1:49:41,  3.50it/s]
 94%|█████████▍| 348410/371472 [5:33:52<1:48:55,  3.53it/s]
 94%|█████████▍| 348411/371472 [5:33:52<1:49:25,  3.51it/s]
 94%|█████████▍| 348412/371472 [5:33:52<1:53:27,  3.39it/s]
 94%|█████████▍| 348413/371472 [5:33:52<2:00:11,  3.20it/s]
 94%|█████████▍| 348414/371472 [5:33:53<1:55:47,  3.32it/s]
 94%|█████████▍| 348415/371472 [5:33:53<1:58:09,  3.25it/s]
 94%|█████████▍| 348416/371472 [5:33:53<1:57:38,  3.27it/s]
 94%|█████████▍| 348417/371472 [5:33:54<1:53:54,  3.37it/s]
 94%|█████████▍| 348418/371472 [5:33:54<1:53:55,  3.37it/s]
 94%|█████████▍| 348419/371472 [5:33:54<1:50:50,  3.47it/s]
 94%|█████████▍| 348420/371472 [5:33:54<1:51:15,  3.45it/s]
                                                           
{'loss': 2.5431, 'learning_rate': 1.558803249369734e-07, 'epoch': 15.01}

 94%|█████████▍| 348420/371472 [5:33:54<1:51:15,  3.45it/s]
 94%|█████████▍| 348421/371472 [5:33:55<1:52:59,  3.40it/s]
 94%|█████████▍| 348422/371472 [5:33:55<1:55:26,  3.33it/s]
 94%|█████████▍| 348423/371472 [5:33:55<1:51:12,  3.45it/s]
 94%|█████████▍| 348424/371472 [5:33:56<1:48:17,  3.55it/s]
 94%|█████████▍| 348425/371472 [5:33:56<1:46:37,  3.60it/s]
 94%|█████████▍| 348426/371472 [5:33:56<1:49:16,  3.51it/s]
 94%|█████████▍| 348427/371472 [5:33:56<1:49:35,  3.50it/s]
 94%|█████████▍| 348428/371472 [5:33:57<1:49:42,  3.50it/s]
 94%|█████████▍| 348429/371472 [5:33:57<1:50:46,  3.47it/s]
 94%|█████████▍| 348430/371472 [5:33:57<1:47:10,  3.58it/s]
 94%|█████████▍| 348431/371472 [5:33:58<1:51:31,  3.44it/s]
 94%|█████████▍| 348432/371472 [5:33:58<1:52:28,  3.41it/s]
 94%|█████████▍| 348433/371472 [5:33:58<1:51:41,  3.44it/s]
 94%|█████████▍| 348434/371472 [5:33:59<1:50:34,  3.47it/s]
 94%|█████████▍| 348435/371472 [5:33:59<1:49:15,  3.51it/s]
 94%|█████████▍| 348436/371472 [5:33:59<1:44:35,  3.67it/s]
 94%|█████████▍| 348437/371472 [5:33:59<1:51:04,  3.46it/s]
 94%|█████████▍| 348438/371472 [5:34:00<1:56:07,  3.31it/s]
 94%|█████████▍| 348439/371472 [5:34:00<1:53:12,  3.39it/s]
 94%|█████████▍| 348440/371472 [5:34:00<1:49:15,  3.51it/s]
                                                           
{'loss': 2.5396, 'learning_rate': 1.5583184296149455e-07, 'epoch': 15.01}

 94%|█████████▍| 348440/371472 [5:34:00<1:49:15,  3.51it/s]
 94%|█████████▍| 348441/371472 [5:34:01<1:48:24,  3.54it/s]
 94%|█████████▍| 348442/371472 [5:34:01<1:49:36,  3.50it/s]
 94%|█████████▍| 348443/371472 [5:34:01<1:43:56,  3.69it/s]
 94%|█████████▍| 348444/371472 [5:34:01<1:46:00,  3.62it/s]
 94%|█████████▍| 348445/371472 [5:34:02<1:45:41,  3.63it/s]
 94%|█████████▍| 348446/371472 [5:34:02<1:53:02,  3.39it/s]
 94%|█████████▍| 348447/371472 [5:34:02<1:50:41,  3.47it/s]
 94%|█████████▍| 348448/371472 [5:34:02<1:47:10,  3.58it/s]
 94%|█████████▍| 348449/371472 [5:34:03<1:48:22,  3.54it/s]
 94%|█████████▍| 348450/371472 [5:34:03<1:46:25,  3.61it/s]
 94%|█████████▍| 348451/371472 [5:34:03<1:47:17,  3.58it/s]
 94%|█████████▍| 348452/371472 [5:34:04<1:42:37,  3.74it/s]
 94%|█████████▍| 348453/371472 [5:34:04<1:43:50,  3.69it/s]
 94%|█████████▍| 348454/371472 [5:34:04<1:44:40,  3.66it/s]
 94%|█████████▍| 348455/371472 [5:34:04<1:52:02,  3.42it/s]
 94%|█████████▍| 348456/371472 [5:34:05<1:49:12,  3.51it/s]
 94%|█████████▍| 348457/371472 [5:34:05<1:45:50,  3.62it/s]
 94%|█████████▍| 348458/371472 [5:34:05<1:44:48,  3.66it/s]
 94%|█████████▍| 348459/371472 [5:34:06<1:46:38,  3.60it/s]
 94%|█████████▍| 348460/371472 [5:34:06<1:46:31,  3.60it/s]
                                                           
{'loss': 2.7789, 'learning_rate': 1.5578336098601562e-07, 'epoch': 15.01}

 94%|█████████▍| 348460/371472 [5:34:06<1:46:31,  3.60it/s]
 94%|█████████▍| 348461/371472 [5:34:06<1:51:24,  3.44it/s]
 94%|█████████▍| 348462/371472 [5:34:06<1:46:17,  3.61it/s]
 94%|█████████▍| 348463/371472 [5:34:07<1:47:51,  3.56it/s]
 94%|█████████▍| 348464/371472 [5:34:07<1:46:46,  3.59it/s]
 94%|█████████▍| 348465/371472 [5:34:07<1:47:20,  3.57it/s]
 94%|█████████▍| 348466/371472 [5:34:08<1:47:09,  3.58it/s]
 94%|█████████▍| 348467/371472 [5:34:08<1:52:30,  3.41it/s]
 94%|█████████▍| 348468/371472 [5:34:08<1:53:34,  3.38it/s]
 94%|█████████▍| 348469/371472 [5:34:08<1:54:02,  3.36it/s]
 94%|█████████▍| 348470/371472 [5:34:09<2:02:13,  3.14it/s]
 94%|█████████▍| 348471/371472 [5:34:09<2:05:24,  3.06it/s]
 94%|█████████▍| 348472/371472 [5:34:10<2:13:06,  2.88it/s]
 94%|█████████▍| 348473/371472 [5:34:10<2:02:58,  3.12it/s]
 94%|█████████▍| 348474/371472 [5:34:10<1:59:12,  3.22it/s]
 94%|█████████▍| 348475/371472 [5:34:10<1:55:32,  3.32it/s]
 94%|█████████▍| 348476/371472 [5:34:11<1:54:30,  3.35it/s]
 94%|█████████▍| 348477/371472 [5:34:11<1:56:43,  3.28it/s]
 94%|█████████▍| 348478/371472 [5:34:11<1:53:58,  3.36it/s]
 94%|█████████▍| 348479/371472 [5:34:12<1:53:02,  3.39it/s]
 94%|█████████▍| 348480/371472 [5:34:12<1:55:58,  3.30it/s]
                                                           
{'loss': 2.8674, 'learning_rate': 1.5573487901053677e-07, 'epoch': 15.01}

 94%|█████████▍| 348480/371472 [5:34:12<1:55:58,  3.30it/s]
 94%|█████████▍| 348481/371472 [5:34:12<1:55:15,  3.32it/s]
 94%|█████████▍| 348482/371472 [5:34:13<2:00:11,  3.19it/s]
 94%|█████████▍| 348483/371472 [5:34:13<1:56:49,  3.28it/s]
 94%|█████████▍| 348484/371472 [5:34:13<1:55:32,  3.32it/s]
 94%|█████████▍| 348485/371472 [5:34:13<1:51:37,  3.43it/s]
 94%|█████████▍| 348486/371472 [5:34:14<1:49:19,  3.50it/s]
 94%|█████████▍| 348487/371472 [5:34:14<2:04:12,  3.08it/s]
 94%|█████████▍| 348488/371472 [5:34:14<2:02:51,  3.12it/s]
 94%|█████████▍| 348489/371472 [5:34:15<1:57:44,  3.25it/s]
 94%|█████████▍| 348490/371472 [5:34:15<1:52:53,  3.39it/s]
 94%|█████████▍| 348491/371472 [5:34:15<1:52:56,  3.39it/s]
 94%|█████████▍| 348492/371472 [5:34:15<1:51:40,  3.43it/s]
 94%|█████████▍| 348493/371472 [5:34:16<1:53:05,  3.39it/s]
 94%|█████████▍| 348494/371472 [5:34:16<1:56:41,  3.28it/s]
 94%|█████████▍| 348495/371472 [5:34:16<1:56:28,  3.29it/s]
 94%|█████████▍| 348496/371472 [5:34:17<1:56:06,  3.30it/s]
 94%|█████████▍| 348497/371472 [5:34:17<1:53:28,  3.37it/s]
 94%|█████████▍| 348498/371472 [5:34:17<1:54:57,  3.33it/s]
 94%|█████████▍| 348499/371472 [5:34:18<1:57:03,  3.27it/s]
 94%|█████████▍| 348500/371472 [5:34:18<1:58:45,  3.22it/s]
                                                           
{'loss': 2.5768, 'learning_rate': 1.5568639703505784e-07, 'epoch': 15.01}

 94%|█████████▍| 348500/371472 [5:34:18<1:58:45,  3.22it/s]
 94%|█████████▍| 348501/371472 [5:34:18<1:55:01,  3.33it/s]
 94%|█████████▍| 348502/371472 [5:34:18<1:48:29,  3.53it/s]
 94%|█████████▍| 348503/371472 [5:34:19<1:51:34,  3.43it/s]
 94%|█████████▍| 348504/371472 [5:34:19<1:49:39,  3.49it/s]
 94%|█████████▍| 348505/371472 [5:34:19<1:54:08,  3.35it/s]
 94%|█████████▍| 348506/371472 [5:34:20<1:56:48,  3.28it/s]
 94%|█████████▍| 348507/371472 [5:34:20<1:55:54,  3.30it/s]
 94%|█████████▍| 348508/371472 [5:34:20<1:52:42,  3.40it/s]
 94%|█████████▍| 348509/371472 [5:34:21<1:47:09,  3.57it/s]
 94%|█████████▍| 348510/371472 [5:34:21<1:46:35,  3.59it/s]
 94%|█████████▍| 348511/371472 [5:34:21<1:47:56,  3.55it/s]
 94%|█████████▍| 348512/371472 [5:34:22<2:12:11,  2.89it/s]
 94%|█████████▍| 348513/371472 [5:34:22<2:08:27,  2.98it/s]
 94%|█████████▍| 348514/371472 [5:34:22<2:05:26,  3.05it/s]
 94%|█████████▍| 348515/371472 [5:34:22<2:01:05,  3.16it/s]
 94%|█████████▍| 348516/371472 [5:34:23<1:57:50,  3.25it/s]
 94%|█████████▍| 348517/371472 [5:34:23<1:55:41,  3.31it/s]
 94%|█████████▍| 348518/371472 [5:34:23<1:52:34,  3.40it/s]
 94%|█████████▍| 348519/371472 [5:34:24<1:52:50,  3.39it/s]
 94%|█████████▍| 348520/371472 [5:34:24<1:55:23,  3.32it/s]
                                                           
{'loss': 2.5725, 'learning_rate': 1.55637915059579e-07, 'epoch': 15.01}

 94%|█████████▍| 348520/371472 [5:34:24<1:55:23,  3.32it/s]
 94%|█████████▍| 348521/371472 [5:34:24<1:55:40,  3.31it/s]
 94%|█████████▍| 348522/371472 [5:34:25<1:58:02,  3.24it/s]
 94%|█████████▍| 348523/371472 [5:34:25<1:50:26,  3.46it/s]
 94%|█████████▍| 348524/371472 [5:34:25<1:49:36,  3.49it/s]
 94%|█████████▍| 348525/371472 [5:34:25<1:49:07,  3.50it/s]
 94%|█████████▍| 348526/371472 [5:34:26<1:45:38,  3.62it/s]
 94%|█████████▍| 348527/371472 [5:34:26<1:46:24,  3.59it/s]
 94%|█████████▍| 348528/371472 [5:34:26<1:46:37,  3.59it/s]
 94%|█████████▍| 348529/371472 [5:34:26<1:47:40,  3.55it/s]
 94%|█████████▍| 348530/371472 [5:34:27<1:51:05,  3.44it/s]
 94%|█████████▍| 348531/371472 [5:34:27<1:51:47,  3.42it/s]
 94%|█████████▍| 348532/371472 [5:34:27<2:02:03,  3.13it/s]
 94%|█████████▍| 348533/371472 [5:34:28<2:02:38,  3.12it/s]
 94%|█████████▍| 348534/371472 [5:34:28<1:57:42,  3.25it/s]
 94%|█████████▍| 348535/371472 [5:34:28<1:53:38,  3.36it/s]
 94%|█████████▍| 348536/371472 [5:34:29<1:49:07,  3.50it/s]
 94%|█████████▍| 348537/371472 [5:34:29<1:46:33,  3.59it/s]
 94%|█████████▍| 348538/371472 [5:34:29<1:45:38,  3.62it/s]
 94%|█████████▍| 348539/371472 [5:34:29<1:47:56,  3.54it/s]
 94%|█████████▍| 348540/371472 [5:34:30<1:48:21,  3.53it/s]
                                                           
{'loss': 2.7716, 'learning_rate': 1.5558943308410004e-07, 'epoch': 15.01}

 94%|█████████▍| 348540/371472 [5:34:30<1:48:21,  3.53it/s]
 94%|█████████▍| 348541/371472 [5:34:30<1:50:34,  3.46it/s]
 94%|█████████▍| 348542/371472 [5:34:30<1:56:36,  3.28it/s]
 94%|█████████▍| 348543/371472 [5:34:31<2:00:08,  3.18it/s]
 94%|█████████▍| 348544/371472 [5:34:31<1:58:57,  3.21it/s]
 94%|█████████▍| 348545/371472 [5:34:31<1:54:56,  3.32it/s]
 94%|█████████▍| 348546/371472 [5:34:32<1:52:47,  3.39it/s]
 94%|█████████▍| 348547/371472 [5:34:32<2:01:06,  3.15it/s]
 94%|█████████▍| 348548/371472 [5:34:32<2:02:59,  3.11it/s]
 94%|█████████▍| 348549/371472 [5:34:33<2:00:42,  3.17it/s]
 94%|█████████▍| 348550/371472 [5:34:33<2:00:17,  3.18it/s]
 94%|█████████▍| 348551/371472 [5:34:33<2:04:50,  3.06it/s]
 94%|█████████▍| 348552/371472 [5:34:34<2:05:29,  3.04it/s]
 94%|█████████▍| 348553/371472 [5:34:34<2:02:29,  3.12it/s]
 94%|█████████▍| 348554/371472 [5:34:34<2:02:05,  3.13it/s]
 94%|█████████▍| 348555/371472 [5:34:35<2:09:50,  2.94it/s]
 94%|█████████▍| 348556/371472 [5:34:35<2:12:05,  2.89it/s]
 94%|█████████▍| 348557/371472 [5:34:35<2:11:25,  2.91it/s]
 94%|█████████▍| 348558/371472 [5:34:36<2:01:48,  3.14it/s]
 94%|█████████▍| 348559/371472 [5:34:36<1:56:14,  3.29it/s]
 94%|█████████▍| 348560/371472 [5:34:36<1:51:20,  3.43it/s]
                                                           
{'loss': 2.4726, 'learning_rate': 1.5554095110862119e-07, 'epoch': 15.01}

 94%|█████████▍| 348560/371472 [5:34:36<1:51:20,  3.43it/s]
 94%|█████████▍| 348561/371472 [5:34:36<1:50:08,  3.47it/s]
 94%|█████████▍| 348562/371472 [5:34:37<1:47:33,  3.55it/s]
 94%|█████████▍| 348563/371472 [5:34:37<1:46:00,  3.60it/s]
 94%|█████████▍| 348564/371472 [5:34:37<1:57:27,  3.25it/s]
 94%|█████████▍| 348565/371472 [5:34:38<1:56:12,  3.29it/s]
 94%|█████████▍| 348566/371472 [5:34:38<1:49:50,  3.48it/s]
 94%|█████████▍| 348567/371472 [5:34:38<1:51:12,  3.43it/s]
 94%|█████████▍| 348568/371472 [5:34:38<1:49:13,  3.50it/s]
 94%|█████████▍| 348569/371472 [5:34:39<1:48:32,  3.52it/s]
 94%|█████████▍| 348570/371472 [5:34:39<1:57:00,  3.26it/s]
 94%|█████████▍| 348571/371472 [5:34:39<1:56:02,  3.29it/s]
 94%|█████████▍| 348572/371472 [5:34:40<2:06:13,  3.02it/s]
 94%|█████████▍| 348573/371472 [5:34:40<1:58:51,  3.21it/s]
 94%|█████████▍| 348574/371472 [5:34:40<1:53:53,  3.35it/s]
 94%|█████████▍| 348575/371472 [5:34:41<2:00:20,  3.17it/s]
 94%|█████████▍| 348576/371472 [5:34:41<2:01:16,  3.15it/s]
 94%|█████████▍| 348577/371472 [5:34:41<1:56:54,  3.26it/s]
 94%|█████████▍| 348578/371472 [5:34:41<1:52:40,  3.39it/s]
 94%|█████████▍| 348579/371472 [5:34:42<1:51:20,  3.43it/s]
 94%|█████████▍| 348580/371472 [5:34:42<1:52:26,  3.39it/s]
                                                           
{'loss': 2.6004, 'learning_rate': 1.5549246913314226e-07, 'epoch': 15.01}

 94%|█████████▍| 348580/371472 [5:34:42<1:52:26,  3.39it/s]
 94%|█████████▍| 348581/371472 [5:34:42<1:55:47,  3.29it/s]
 94%|█████████▍| 348582/371472 [5:34:43<1:55:51,  3.29it/s]
 94%|█████████▍| 348583/371472 [5:34:43<1:54:03,  3.34it/s]
 94%|█████████▍| 348584/371472 [5:34:43<1:53:28,  3.36it/s]
 94%|█████████▍| 348585/371472 [5:34:44<1:56:23,  3.28it/s]
 94%|█████████▍| 348586/371472 [5:34:44<1:54:51,  3.32it/s]
 94%|█████████▍| 348587/371472 [5:34:44<1:52:19,  3.40it/s]
 94%|█████████▍| 348588/371472 [5:34:45<2:05:42,  3.03it/s]
 94%|█████████▍| 348589/371472 [5:34:45<1:58:25,  3.22it/s]
 94%|█████████▍| 348590/371472 [5:34:45<2:04:06,  3.07it/s]
 94%|█████████▍| 348591/371472 [5:34:45<1:58:10,  3.23it/s]
 94%|█████████▍| 348592/371472 [5:34:46<1:55:54,  3.29it/s]
 94%|█████████▍| 348593/371472 [5:34:46<2:13:38,  2.85it/s]
 94%|█████████▍| 348594/371472 [5:34:46<2:03:19,  3.09it/s]
 94%|█████████▍| 348595/371472 [5:34:47<1:58:57,  3.21it/s]
 94%|█████████▍| 348596/371472 [5:34:47<1:55:11,  3.31it/s]
 94%|█████████▍| 348597/371472 [5:34:47<2:02:05,  3.12it/s]
 94%|█████████▍| 348598/371472 [5:34:48<1:58:03,  3.23it/s]
 94%|█████████▍| 348599/371472 [5:34:48<1:52:59,  3.37it/s]
 94%|█████████▍| 348600/371472 [5:34:48<1:50:10,  3.46it/s]
                                                           
{'loss': 2.6019, 'learning_rate': 1.554439871576634e-07, 'epoch': 15.01}

 94%|█████████▍| 348600/371472 [5:34:48<1:50:10,  3.46it/s]
 94%|█████████▍| 348601/371472 [5:34:49<1:53:47,  3.35it/s]
 94%|█████████▍| 348602/371472 [5:34:49<1:56:19,  3.28it/s]
 94%|█████████▍| 348603/371472 [5:34:49<1:54:56,  3.32it/s]
 94%|█████████▍| 348604/371472 [5:34:49<1:54:24,  3.33it/s]
 94%|█████████▍| 348605/371472 [5:34:50<1:49:33,  3.48it/s]
 94%|█████████▍| 348606/371472 [5:34:50<1:50:14,  3.46it/s]
 94%|█████████▍| 348607/371472 [5:34:50<1:47:07,  3.56it/s]
 94%|█████████▍| 348608/371472 [5:34:51<1:50:54,  3.44it/s]
 94%|█████████▍| 348609/371472 [5:34:51<1:47:08,  3.56it/s]
 94%|█████████▍| 348610/371472 [5:34:51<1:49:24,  3.48it/s]
 94%|█████████▍| 348611/371472 [5:34:51<1:51:15,  3.42it/s]
 94%|█████████▍| 348612/371472 [5:34:52<1:50:38,  3.44it/s]
 94%|█████████▍| 348613/371472 [5:34:52<1:46:54,  3.56it/s]
 94%|█████████▍| 348614/371472 [5:34:52<1:47:08,  3.56it/s]
 94%|█████████▍| 348615/371472 [5:34:53<1:47:30,  3.54it/s]
 94%|█████████▍| 348616/371472 [5:34:53<1:50:31,  3.45it/s]
 94%|█████████▍| 348617/371472 [5:34:53<1:47:32,  3.54it/s]
 94%|█████████▍| 348618/371472 [5:34:53<1:46:08,  3.59it/s]
 94%|█████████▍| 348619/371472 [5:34:54<1:48:52,  3.50it/s]
 94%|█████████▍| 348620/371472 [5:34:54<1:51:27,  3.42it/s]
                                                           
{'loss': 2.5714, 'learning_rate': 1.5539550518218448e-07, 'epoch': 15.02}

 94%|█████████▍| 348620/371472 [5:34:54<1:51:27,  3.42it/s]
 94%|█████████▍| 348621/371472 [5:34:54<1:50:15,  3.45it/s]
 94%|█████████▍| 348622/371472 [5:34:55<1:53:19,  3.36it/s]
 94%|█████████▍| 348623/371472 [5:34:55<1:53:14,  3.36it/s]
 94%|█████████▍| 348624/371472 [5:34:55<1:54:00,  3.34it/s]
 94%|█████████▍| 348625/371472 [5:34:55<1:51:05,  3.43it/s]
 94%|█████████▍| 348626/371472 [5:34:56<1:53:28,  3.36it/s]
 94%|█████████▍| 348627/371472 [5:34:56<2:06:53,  3.00it/s]
 94%|█████████▍| 348628/371472 [5:34:57<2:02:26,  3.11it/s]
 94%|█████████▍| 348629/371472 [5:34:57<1:58:12,  3.22it/s]
 94%|█████████▍| 348630/371472 [5:34:57<1:59:33,  3.18it/s]
 94%|█████████▍| 348631/371472 [5:34:57<1:56:20,  3.27it/s]
 94%|█████████▍| 348632/371472 [5:34:58<1:54:43,  3.32it/s]
 94%|█████████▍| 348633/371472 [5:34:58<1:51:25,  3.42it/s]
 94%|█████████▍| 348634/371472 [5:34:58<1:51:41,  3.41it/s]
 94%|█████████▍| 348635/371472 [5:34:59<2:00:27,  3.16it/s]
 94%|█████████▍| 348636/371472 [5:34:59<1:57:02,  3.25it/s]
 94%|█████████▍| 348637/371472 [5:34:59<1:53:05,  3.37it/s]
 94%|█████████▍| 348638/371472 [5:34:59<1:51:50,  3.40it/s]
 94%|█████████▍| 348639/371472 [5:35:00<1:58:32,  3.21it/s]
 94%|█████████▍| 348640/371472 [5:35:00<1:53:57,  3.34it/s]
                                                           
{'loss': 2.4869, 'learning_rate': 1.5534702320670563e-07, 'epoch': 15.02}

 94%|█████████▍| 348640/371472 [5:35:00<1:53:57,  3.34it/s]
 94%|█████████▍| 348641/371472 [5:35:00<1:54:28,  3.32it/s]
 94%|█████████▍| 348642/371472 [5:35:01<1:55:39,  3.29it/s]
 94%|█████████▍| 348643/371472 [5:35:01<2:01:59,  3.12it/s]
 94%|█████████▍| 348644/371472 [5:35:01<2:08:58,  2.95it/s]
 94%|█████████▍| 348645/371472 [5:35:02<2:13:48,  2.84it/s]
 94%|█████████▍| 348646/371472 [5:35:02<2:02:21,  3.11it/s]
 94%|█████████▍| 348647/371472 [5:35:02<2:02:09,  3.11it/s]
 94%|█████████▍| 348648/371472 [5:35:03<1:57:16,  3.24it/s]
 94%|█████████▍| 348649/371472 [5:35:03<1:55:44,  3.29it/s]
 94%|█████████▍| 348650/371472 [5:35:03<1:50:42,  3.44it/s]
 94%|█████████▍| 348651/371472 [5:35:04<1:46:37,  3.57it/s]
 94%|█████████▍| 348652/371472 [5:35:04<1:51:58,  3.40it/s]
 94%|█████████▍| 348653/371472 [5:35:04<2:03:42,  3.07it/s]
 94%|█████████▍| 348654/371472 [5:35:04<1:55:43,  3.29it/s]
 94%|█████████▍| 348655/371472 [5:35:05<1:56:20,  3.27it/s]
 94%|█████████▍| 348656/371472 [5:35:05<1:56:11,  3.27it/s]
 94%|█████████▍| 348657/371472 [5:35:05<1:56:46,  3.26it/s]
 94%|█████████▍| 348658/371472 [5:35:06<1:56:36,  3.26it/s]
 94%|█████████▍| 348659/371472 [5:35:06<1:56:22,  3.27it/s]
 94%|█████████▍| 348660/371472 [5:35:06<1:55:46,  3.28it/s]
                                                           
{'loss': 2.4539, 'learning_rate': 1.5529854123122668e-07, 'epoch': 15.02}

 94%|█████████▍| 348660/371472 [5:35:06<1:55:46,  3.28it/s]
 94%|█████████▍| 348661/371472 [5:35:07<1:52:27,  3.38it/s]
 94%|█████████▍| 348662/371472 [5:35:07<1:46:57,  3.55it/s]
 94%|█████████▍| 348663/371472 [5:35:07<1:45:27,  3.60it/s]
 94%|█████████▍| 348664/371472 [5:35:07<1:45:04,  3.62it/s]
 94%|█████████▍| 348665/371472 [5:35:08<1:49:23,  3.48it/s]
 94%|█████████▍| 348666/371472 [5:35:08<1:55:44,  3.28it/s]
 94%|█████████▍| 348667/371472 [5:35:08<1:54:06,  3.33it/s]
 94%|█████████▍| 348668/371472 [5:35:09<1:51:41,  3.40it/s]
 94%|█████████▍| 348669/371472 [5:35:09<1:52:11,  3.39it/s]
 94%|█████████▍| 348670/371472 [5:35:09<1:48:24,  3.51it/s]
 94%|█████████▍| 348671/371472 [5:35:09<1:46:03,  3.58it/s]
 94%|█████████▍| 348672/371472 [5:35:10<1:44:54,  3.62it/s]
 94%|█████████▍| 348673/371472 [5:35:10<1:47:01,  3.55it/s]
 94%|█████████▍| 348674/371472 [5:35:10<1:44:00,  3.65it/s]
 94%|█████████▍| 348675/371472 [5:35:11<1:43:12,  3.68it/s]
 94%|█████████▍| 348676/371472 [5:35:11<1:50:10,  3.45it/s]
 94%|█████████▍| 348677/371472 [5:35:11<2:05:01,  3.04it/s]
 94%|█████████▍| 348678/371472 [5:35:12<2:10:33,  2.91it/s]
 94%|█████████▍| 348679/371472 [5:35:12<2:02:56,  3.09it/s]
 94%|█████████▍| 348680/371472 [5:35:12<1:57:11,  3.24it/s]
                                                           
{'loss': 2.7332, 'learning_rate': 1.5525005925574785e-07, 'epoch': 15.02}

 94%|█████████▍| 348680/371472 [5:35:12<1:57:11,  3.24it/s]
 94%|█████████▍| 348681/371472 [5:35:13<1:59:28,  3.18it/s]
 94%|█████████▍| 348682/371472 [5:35:13<1:56:45,  3.25it/s]
 94%|█████████▍| 348683/371472 [5:35:13<2:06:28,  3.00it/s]
 94%|█████████▍| 348684/371472 [5:35:14<2:01:57,  3.11it/s]
 94%|█████████▍| 348685/371472 [5:35:14<1:58:58,  3.19it/s]
 94%|█████████▍| 348686/371472 [5:35:14<2:00:20,  3.16it/s]
 94%|█████████▍| 348687/371472 [5:35:14<1:53:58,  3.33it/s]
 94%|█████████▍| 348688/371472 [5:35:15<1:58:35,  3.20it/s]
 94%|█████████▍| 348689/371472 [5:35:15<1:55:33,  3.29it/s]
 94%|█████████▍| 348690/371472 [5:35:15<1:59:27,  3.18it/s]
 94%|█████████▍| 348691/371472 [5:35:16<2:00:43,  3.14it/s]
 94%|█████████▍| 348692/371472 [5:35:16<1:53:56,  3.33it/s]
 94%|█████████▍| 348693/371472 [5:35:16<1:50:43,  3.43it/s]
 94%|█████████▍| 348694/371472 [5:35:17<1:52:31,  3.37it/s]
 94%|█████████▍| 348695/371472 [5:35:17<1:54:01,  3.33it/s]
 94%|█████████▍| 348696/371472 [5:35:17<1:53:23,  3.35it/s]
 94%|█████████▍| 348697/371472 [5:35:17<1:51:32,  3.40it/s]
 94%|█████████▍| 348698/371472 [5:35:18<1:50:40,  3.43it/s]
 94%|█████████▍| 348699/371472 [5:35:18<1:47:22,  3.53it/s]
 94%|█████████▍| 348700/371472 [5:35:18<1:49:07,  3.48it/s]
                                                           
{'loss': 2.4427, 'learning_rate': 1.552015772802689e-07, 'epoch': 15.02}

 94%|█████████▍| 348700/371472 [5:35:18<1:49:07,  3.48it/s]
 94%|█████████▍| 348701/371472 [5:35:19<1:50:25,  3.44it/s]
 94%|█████████▍| 348702/371472 [5:35:19<2:08:10,  2.96it/s]
 94%|█████████▍| 348703/371472 [5:35:19<2:11:12,  2.89it/s]
 94%|█████████▍| 348704/371472 [5:35:20<2:09:01,  2.94it/s]
 94%|█████████▍| 348705/371472 [5:35:20<2:03:32,  3.07it/s]
 94%|█████████▍| 348706/371472 [5:35:20<1:57:29,  3.23it/s]
 94%|█████████▍| 348707/371472 [5:35:21<1:54:05,  3.33it/s]
 94%|█████████▍| 348708/371472 [5:35:21<1:53:45,  3.33it/s]
 94%|█████████▍| 348709/371472 [5:35:21<2:20:14,  2.71it/s]
 94%|█████████▍| 348710/371472 [5:35:22<2:14:52,  2.81it/s]
 94%|█████████▍| 348711/371472 [5:35:22<2:13:03,  2.85it/s]
 94%|█████████▍| 348712/371472 [5:35:22<2:09:05,  2.94it/s]
 94%|█████████▍| 348713/371472 [5:35:23<2:06:35,  3.00it/s]
 94%|█████████▍| 348714/371472 [5:35:23<2:02:39,  3.09it/s]
 94%|█████████▍| 348715/371472 [5:35:23<2:00:16,  3.15it/s]
 94%|█████████▍| 348716/371472 [5:35:24<1:58:53,  3.19it/s]
 94%|█████████▍| 348717/371472 [5:35:24<1:56:17,  3.26it/s]
 94%|█████████▍| 348718/371472 [5:35:24<1:56:23,  3.26it/s]
 94%|█████████▍| 348719/371472 [5:35:24<1:51:53,  3.39it/s]
 94%|█████████▍| 348720/371472 [5:35:25<1:50:33,  3.43it/s]
                                                           
{'loss': 2.7404, 'learning_rate': 1.5515309530479005e-07, 'epoch': 15.02}

 94%|█████████▍| 348720/371472 [5:35:25<1:50:33,  3.43it/s]
 94%|█████████▍| 348721/371472 [5:35:25<1:45:59,  3.58it/s]
 94%|█████████▍| 348722/371472 [5:35:25<1:46:39,  3.56it/s]
 94%|█████████▍| 348723/371472 [5:35:26<1:50:02,  3.45it/s]
 94%|█████████▍| 348724/371472 [5:35:26<1:50:08,  3.44it/s]
 94%|█████████▍| 348725/371472 [5:35:26<1:59:33,  3.17it/s]
 94%|█████████▍| 348726/371472 [5:35:27<1:58:38,  3.20it/s]
 94%|█████████▍| 348727/371472 [5:35:27<2:00:31,  3.15it/s]
 94%|█████████▍| 348728/371472 [5:35:27<1:57:57,  3.21it/s]
 94%|█████████▍| 348729/371472 [5:35:27<1:53:40,  3.33it/s]
 94%|█████████▍| 348730/371472 [5:35:28<1:50:24,  3.43it/s]
 94%|█████████▍| 348731/371472 [5:35:28<1:47:51,  3.51it/s]
 94%|█████████▍| 348732/371472 [5:35:28<1:48:44,  3.49it/s]
 94%|█████████▍| 348733/371472 [5:35:29<1:43:55,  3.65it/s]
 94%|█████████▍| 348734/371472 [5:35:29<1:52:12,  3.38it/s]
 94%|█████████▍| 348735/371472 [5:35:29<1:49:04,  3.47it/s]
 94%|█████████▍| 348736/371472 [5:35:29<1:55:10,  3.29it/s]
 94%|█████████▍| 348737/371472 [5:35:30<1:53:49,  3.33it/s]
 94%|█████████▍| 348738/371472 [5:35:30<1:52:40,  3.36it/s]
 94%|█████████▍| 348739/371472 [5:35:30<1:50:39,  3.42it/s]
 94%|█████████▍| 348740/371472 [5:35:31<1:44:18,  3.63it/s]
                                                           
{'loss': 2.6401, 'learning_rate': 1.5510461332931112e-07, 'epoch': 15.02}

 94%|█████████▍| 348740/371472 [5:35:31<1:44:18,  3.63it/s]
 94%|█████████▍| 348741/371472 [5:35:31<1:42:25,  3.70it/s]
 94%|█████████▍| 348742/371472 [5:35:31<1:44:22,  3.63it/s]
 94%|█████████▍| 348743/371472 [5:35:31<1:41:57,  3.72it/s]
 94%|█████████▍| 348744/371472 [5:35:32<1:43:08,  3.67it/s]
 94%|█████████▍| 348745/371472 [5:35:32<1:42:23,  3.70it/s]
 94%|█████████▍| 348746/371472 [5:35:32<1:40:39,  3.76it/s]
 94%|█████████▍| 348747/371472 [5:35:32<1:43:11,  3.67it/s]
 94%|█████████▍| 348748/371472 [5:35:33<1:42:04,  3.71it/s]
 94%|█████████▍| 348749/371472 [5:35:33<1:43:43,  3.65it/s]
 94%|█████████▍| 348750/371472 [5:35:33<1:45:23,  3.59it/s]
 94%|█████████▍| 348751/371472 [5:35:34<1:49:12,  3.47it/s]
 94%|█████████▍| 348752/371472 [5:35:34<1:46:33,  3.55it/s]
 94%|█████████▍| 348753/371472 [5:35:34<1:43:49,  3.65it/s]
 94%|█████████▍| 348754/371472 [5:35:34<1:50:58,  3.41it/s]
 94%|█████████▍| 348755/371472 [5:35:35<1:50:42,  3.42it/s]
 94%|█████████▍| 348756/371472 [5:35:35<1:51:55,  3.38it/s]
 94%|█████████▍| 348757/371472 [5:35:35<1:47:38,  3.52it/s]
 94%|█████████▍| 348758/371472 [5:35:36<1:44:33,  3.62it/s]
 94%|█████████▍| 348759/371472 [5:35:36<1:43:06,  3.67it/s]
 94%|█████████▍| 348760/371472 [5:35:36<1:44:53,  3.61it/s]
                                                           
{'loss': 2.5081, 'learning_rate': 1.5505613135383217e-07, 'epoch': 15.02}

 94%|█████████▍| 348760/371472 [5:35:36<1:44:53,  3.61it/s]
 94%|█████████▍| 348761/371472 [5:35:37<2:02:43,  3.08it/s]
 94%|█████████▍| 348762/371472 [5:35:37<1:54:59,  3.29it/s]
 94%|█████████▍| 348763/371472 [5:35:37<1:47:50,  3.51it/s]
 94%|█████████▍| 348764/371472 [5:35:37<1:46:00,  3.57it/s]
 94%|█████████▍| 348765/371472 [5:35:38<1:42:48,  3.68it/s]
 94%|█████████▍| 348766/371472 [5:35:38<1:42:34,  3.69it/s]
 94%|█████████▍| 348767/371472 [5:35:38<1:44:30,  3.62it/s]
 94%|█████████▍| 348768/371472 [5:35:38<1:44:59,  3.60it/s]
 94%|█████████▍| 348769/371472 [5:35:39<1:41:56,  3.71it/s]
 94%|█████████▍| 348770/371472 [5:35:39<1:41:47,  3.72it/s]
 94%|█████████▍| 348771/371472 [5:35:39<1:50:43,  3.42it/s]
 94%|█████████▍| 348772/371472 [5:35:40<1:48:05,  3.50it/s]
 94%|█████████▍| 348773/371472 [5:35:40<1:45:35,  3.58it/s]
 94%|█████████▍| 348774/371472 [5:35:40<1:45:03,  3.60it/s]
 94%|█████████▍| 348775/371472 [5:35:40<1:51:14,  3.40it/s]
 94%|█████████▍| 348776/371472 [5:35:41<1:52:24,  3.36it/s]
 94%|█████████▍| 348777/371472 [5:35:41<1:51:54,  3.38it/s]
 94%|█████████▍| 348778/371472 [5:35:41<1:50:10,  3.43it/s]
 94%|█████████▍| 348779/371472 [5:35:42<1:47:05,  3.53it/s]
 94%|█████████▍| 348780/371472 [5:35:42<1:46:12,  3.56it/s]
                                                           
{'loss': 2.5531, 'learning_rate': 1.5500764937835334e-07, 'epoch': 15.02}

 94%|█████████▍| 348780/371472 [5:35:42<1:46:12,  3.56it/s]
 94%|█████████▍| 348781/371472 [5:35:42<1:43:45,  3.65it/s]
 94%|█████████▍| 348782/371472 [5:35:42<1:45:52,  3.57it/s]
 94%|█████████▍| 348783/371472 [5:35:43<1:48:46,  3.48it/s]
 94%|█████████▍| 348784/371472 [5:35:43<1:45:52,  3.57it/s]
 94%|█████████▍| 348785/371472 [5:35:43<1:46:25,  3.55it/s]
 94%|█████████▍| 348786/371472 [5:35:44<1:46:02,  3.57it/s]
 94%|█████████▍| 348787/371472 [5:35:44<1:47:25,  3.52it/s]
 94%|█████████▍| 348788/371472 [5:35:44<1:49:49,  3.44it/s]
 94%|█████████▍| 348789/371472 [5:35:44<1:51:13,  3.40it/s]
 94%|█████████▍| 348790/371472 [5:35:45<1:50:50,  3.41it/s]
 94%|█████████▍| 348791/371472 [5:35:45<2:07:23,  2.97it/s]
 94%|█████████▍| 348792/371472 [5:35:45<2:01:42,  3.11it/s]
 94%|█████████▍| 348793/371472 [5:35:46<2:04:03,  3.05it/s]
 94%|█████████▍| 348794/371472 [5:35:46<1:55:50,  3.26it/s]
 94%|█████████▍| 348795/371472 [5:35:46<1:50:25,  3.42it/s]
 94%|█████████▍| 348796/371472 [5:35:47<1:44:44,  3.61it/s]
 94%|█████████▍| 348797/371472 [5:35:47<1:47:04,  3.53it/s]
 94%|█████████▍| 348798/371472 [5:35:47<1:45:45,  3.57it/s]
 94%|█████████▍| 348799/371472 [5:35:47<1:43:19,  3.66it/s]
 94%|█████████▍| 348800/371472 [5:35:48<1:48:46,  3.47it/s]
                                                           
{'loss': 2.5296, 'learning_rate': 1.5495916740287436e-07, 'epoch': 15.02}

 94%|█████████▍| 348800/371472 [5:35:48<1:48:46,  3.47it/s]
 94%|█████████▍| 348801/371472 [5:35:48<1:52:42,  3.35it/s]
 94%|█████████▍| 348802/371472 [5:35:48<1:47:50,  3.50it/s]
 94%|█████████▍| 348803/371472 [5:35:49<1:45:11,  3.59it/s]
 94%|█████████▍| 348804/371472 [5:35:49<1:50:52,  3.41it/s]
 94%|█████████▍| 348805/371472 [5:35:49<1:59:57,  3.15it/s]
 94%|█████████▍| 348806/371472 [5:35:50<2:00:30,  3.13it/s]
 94%|█████████▍| 348807/371472 [5:35:50<1:59:41,  3.16it/s]
 94%|█████████▍| 348808/371472 [5:35:50<1:53:58,  3.31it/s]
 94%|█████████▍| 348809/371472 [5:35:50<1:51:47,  3.38it/s]
 94%|█████████▍| 348810/371472 [5:35:51<1:51:35,  3.38it/s]
 94%|█████████▍| 348811/371472 [5:35:51<1:51:17,  3.39it/s]
 94%|█████████▍| 348812/371472 [5:35:51<1:46:06,  3.56it/s]
 94%|█████████▍| 348813/371472 [5:35:52<1:49:32,  3.45it/s]
 94%|█████████▍| 348814/371472 [5:35:52<1:49:13,  3.46it/s]
 94%|█████████▍| 348815/371472 [5:35:52<1:46:31,  3.54it/s]
 94%|█████████▍| 348816/371472 [5:35:52<1:50:09,  3.43it/s]
 94%|█████████▍| 348817/371472 [5:35:53<1:49:05,  3.46it/s]
 94%|█████████▍| 348818/371472 [5:35:53<1:47:17,  3.52it/s]
 94%|█████████▍| 348819/371472 [5:35:53<1:45:04,  3.59it/s]
 94%|█████████▍| 348820/371472 [5:35:54<1:44:03,  3.63it/s]
                                                           
{'loss': 2.6226, 'learning_rate': 1.5491068542739554e-07, 'epoch': 15.02}

 94%|█████████▍| 348820/371472 [5:35:54<1:44:03,  3.63it/s]
 94%|█████████▍| 348821/371472 [5:35:54<1:43:59,  3.63it/s]
 94%|█████████▍| 348822/371472 [5:35:54<1:45:19,  3.58it/s]
 94%|█████████▍| 348823/371472 [5:35:54<1:44:46,  3.60it/s]
 94%|█████████▍| 348824/371472 [5:35:55<1:48:02,  3.49it/s]
 94%|█████████▍| 348825/371472 [5:35:55<1:46:58,  3.53it/s]
 94%|█████████▍| 348826/371472 [5:35:55<1:47:42,  3.50it/s]
 94%|█████████▍| 348827/371472 [5:35:55<1:45:20,  3.58it/s]
 94%|█████████▍| 348828/371472 [5:35:56<1:48:49,  3.47it/s]
 94%|█████████▍| 348829/371472 [5:35:56<1:51:16,  3.39it/s]
 94%|█████████▍| 348830/371472 [5:35:56<1:47:28,  3.51it/s]
 94%|█████████▍| 348831/371472 [5:35:57<1:42:04,  3.70it/s]
 94%|█████████▍| 348832/371472 [5:35:57<1:43:58,  3.63it/s]
 94%|█████████▍| 348833/371472 [5:35:57<1:45:28,  3.58it/s]
 94%|█████████▍| 348834/371472 [5:35:57<1:46:21,  3.55it/s]
 94%|█████████▍| 348835/371472 [5:35:58<1:44:19,  3.62it/s]
 94%|█████████▍| 348836/371472 [5:35:58<1:45:09,  3.59it/s]
 94%|█████████▍| 348837/371472 [5:35:58<1:46:53,  3.53it/s]
 94%|█████████▍| 348838/371472 [5:35:59<1:45:48,  3.57it/s]
 94%|█████████▍| 348839/371472 [5:35:59<1:48:51,  3.47it/s]
 94%|█████████▍| 348840/371472 [5:35:59<1:46:02,  3.56it/s]
                                                           
{'loss': 2.589, 'learning_rate': 1.548622034519166e-07, 'epoch': 15.03}

 94%|█████████▍| 348840/371472 [5:35:59<1:46:02,  3.56it/s]
 94%|█████████▍| 348841/371472 [5:35:59<1:45:46,  3.57it/s]
 94%|█████████▍| 348842/371472 [5:36:00<1:46:32,  3.54it/s]
 94%|█████████▍| 348843/371472 [5:36:00<1:49:14,  3.45it/s]
 94%|█████████▍| 348844/371472 [5:36:00<1:48:20,  3.48it/s]
 94%|█████████▍| 348845/371472 [5:36:01<1:49:27,  3.45it/s]
 94%|█████████▍| 348846/371472 [5:36:01<1:45:49,  3.56it/s]
 94%|█████████▍| 348847/371472 [5:36:01<1:44:52,  3.60it/s]
 94%|█████████▍| 348848/371472 [5:36:02<1:54:05,  3.30it/s]
 94%|█████████▍| 348849/371472 [5:36:02<1:52:17,  3.36it/s]
 94%|█████████▍| 348850/371472 [5:36:02<1:50:05,  3.42it/s]
 94%|█████████▍| 348851/371472 [5:36:02<1:51:02,  3.40it/s]
 94%|█████████▍| 348852/371472 [5:36:03<1:50:05,  3.42it/s]
 94%|█████████▍| 348853/371472 [5:36:03<1:48:57,  3.46it/s]
 94%|█████████▍| 348854/371472 [5:36:03<1:53:52,  3.31it/s]
 94%|█████████▍| 348855/371472 [5:36:04<1:54:57,  3.28it/s]
 94%|█████████▍| 348856/371472 [5:36:04<1:50:53,  3.40it/s]
 94%|█████████▍| 348857/371472 [5:36:04<1:56:57,  3.22it/s]
 94%|█████████▍| 348858/371472 [5:36:05<1:55:39,  3.26it/s]
 94%|█████████▍| 348859/371472 [5:36:05<1:51:53,  3.37it/s]
 94%|█████████▍| 348860/371472 [5:36:05<1:50:20,  3.42it/s]
                                                           
{'loss': 2.6768, 'learning_rate': 1.5481372147643776e-07, 'epoch': 15.03}

 94%|█████████▍| 348860/371472 [5:36:05<1:50:20,  3.42it/s]
 94%|█████████▍| 348861/371472 [5:36:05<1:46:28,  3.54it/s]
 94%|█████████▍| 348862/371472 [5:36:06<1:53:58,  3.31it/s]
 94%|█████████▍| 348863/371472 [5:36:06<1:51:24,  3.38it/s]
 94%|█████████▍| 348864/371472 [5:36:06<1:50:02,  3.42it/s]
 94%|█████████▍| 348865/371472 [5:36:06<1:46:28,  3.54it/s]
 94%|█████████▍| 348866/371472 [5:36:07<1:51:49,  3.37it/s]
 94%|█████████▍| 348867/371472 [5:36:07<2:00:06,  3.14it/s]
 94%|█████████▍| 348868/371472 [5:36:07<1:53:57,  3.31it/s]
 94%|█████████▍| 348869/371472 [5:36:08<1:52:27,  3.35it/s]
 94%|█████████▍| 348870/371472 [5:36:08<1:48:47,  3.46it/s]
 94%|█████████▍| 348871/371472 [5:36:08<1:47:20,  3.51it/s]
 94%|█████████▍| 348872/371472 [5:36:09<1:44:13,  3.61it/s]
 94%|█████████▍| 348873/371472 [5:36:09<1:45:02,  3.59it/s]
 94%|█████████▍| 348874/371472 [5:36:09<1:48:38,  3.47it/s]
 94%|█████████▍| 348875/371472 [5:36:09<1:45:41,  3.56it/s]
 94%|█████████▍| 348876/371472 [5:36:10<1:48:45,  3.46it/s]
 94%|█████████▍| 348877/371472 [5:36:10<1:47:39,  3.50it/s]
 94%|█████████▍| 348878/371472 [5:36:10<1:52:10,  3.36it/s]
 94%|█████████▍| 348879/371472 [5:36:11<1:49:08,  3.45it/s]
 94%|█████████▍| 348880/371472 [5:36:11<2:00:48,  3.12it/s]
                                                           
{'loss': 2.566, 'learning_rate': 1.5476523950095883e-07, 'epoch': 15.03}

 94%|█████████▍| 348880/371472 [5:36:11<2:00:48,  3.12it/s]
 94%|█████████▍| 348881/371472 [5:36:11<1:57:34,  3.20it/s]
 94%|█████████▍| 348882/371472 [5:36:12<1:53:14,  3.32it/s]
 94%|█████████▍| 348883/371472 [5:36:12<1:48:20,  3.47it/s]
 94%|█████████▍| 348884/371472 [5:36:12<1:47:42,  3.50it/s]
 94%|█████████▍| 348885/371472 [5:36:12<1:45:04,  3.58it/s]
 94%|█████████▍| 348886/371472 [5:36:13<1:46:11,  3.54it/s]
 94%|█████████▍| 348887/371472 [5:36:13<1:43:14,  3.65it/s]
 94%|█████████▍| 348888/371472 [5:36:13<1:51:18,  3.38it/s]
 94%|█████████▍| 348889/371472 [5:36:14<1:50:25,  3.41it/s]
 94%|█████████▍| 348890/371472 [5:36:14<1:55:10,  3.27it/s]
 94%|█████████▍| 348891/371472 [5:36:14<1:53:12,  3.32it/s]
 94%|█████████▍| 348892/371472 [5:36:14<1:48:30,  3.47it/s]
 94%|█████████▍| 348893/371472 [5:36:15<1:55:54,  3.25it/s]
 94%|█████████▍| 348894/371472 [5:36:15<1:54:27,  3.29it/s]
 94%|█████████▍| 348895/371472 [5:36:15<1:52:25,  3.35it/s]
 94%|█████████▍| 348896/371472 [5:36:16<1:51:50,  3.36it/s]
 94%|█████████▍| 348897/371472 [5:36:16<1:55:04,  3.27it/s]
 94%|█████████▍| 348898/371472 [5:36:16<1:56:11,  3.24it/s]
 94%|█████████▍| 348899/371472 [5:36:17<1:56:08,  3.24it/s]
 94%|█████████▍| 348900/371472 [5:36:17<1:53:06,  3.33it/s]
                                                           
{'loss': 2.6027, 'learning_rate': 1.5471675752547998e-07, 'epoch': 15.03}

 94%|█████████▍| 348900/371472 [5:36:17<1:53:06,  3.33it/s]
 94%|█████████▍| 348901/371472 [5:36:17<1:48:32,  3.47it/s]
 94%|█████████▍| 348902/371472 [5:36:17<1:46:54,  3.52it/s]
 94%|█████████▍| 348903/371472 [5:36:18<1:44:44,  3.59it/s]
 94%|█████████▍| 348904/371472 [5:36:18<1:42:58,  3.65it/s]
 94%|█████████▍| 348905/371472 [5:36:18<1:40:11,  3.75it/s]
 94%|█████████▍| 348906/371472 [5:36:18<1:38:02,  3.84it/s]
 94%|█████████▍| 348907/371472 [5:36:19<1:41:16,  3.71it/s]
 94%|█████████▍| 348908/371472 [5:36:19<1:45:31,  3.56it/s]
 94%|█████████▍| 348909/371472 [5:36:19<1:43:39,  3.63it/s]
 94%|█████████▍| 348910/371472 [5:36:20<1:44:12,  3.61it/s]
 94%|█████████▍| 348911/371472 [5:36:20<1:46:55,  3.52it/s]
 94%|█████████▍| 348912/371472 [5:36:20<1:50:35,  3.40it/s]
 94%|█████████▍| 348913/371472 [5:36:20<1:52:08,  3.35it/s]
 94%|█████████▍| 348914/371472 [5:36:21<1:54:35,  3.28it/s]
 94%|█████████▍| 348915/371472 [5:36:21<1:53:13,  3.32it/s]
 94%|█████████▍| 348916/371472 [5:36:21<1:49:53,  3.42it/s]
 94%|█████████▍| 348917/371472 [5:36:22<1:48:54,  3.45it/s]
 94%|█████████▍| 348918/371472 [5:36:22<1:53:07,  3.32it/s]
 94%|█████████▍| 348919/371472 [5:36:22<1:55:38,  3.25it/s]
 94%|█████████▍| 348920/371472 [5:36:23<1:55:25,  3.26it/s]
                                                           
{'loss': 2.7091, 'learning_rate': 1.5466827555000103e-07, 'epoch': 15.03}

 94%|█████████▍| 348920/371472 [5:36:23<1:55:25,  3.26it/s]
 94%|█████████▍| 348921/371472 [5:36:23<1:50:14,  3.41it/s]
 94%|█████████▍| 348922/371472 [5:36:23<1:54:46,  3.27it/s]
 94%|█████████▍| 348923/371472 [5:36:23<1:51:07,  3.38it/s]
 94%|█████████▍| 348924/371472 [5:36:24<1:48:03,  3.48it/s]
 94%|█████████▍| 348925/371472 [5:36:24<1:46:58,  3.51it/s]
 94%|█████████▍| 348926/371472 [5:36:24<1:42:04,  3.68it/s]
 94%|█████████▍| 348927/371472 [5:36:25<1:43:33,  3.63it/s]
 94%|█████████▍| 348928/371472 [5:36:25<1:42:30,  3.67it/s]
 94%|█████████▍| 348929/371472 [5:36:25<1:52:21,  3.34it/s]
 94%|█████████▍| 348930/371472 [5:36:25<1:53:54,  3.30it/s]
 94%|█████████▍| 348931/371472 [5:36:26<1:53:30,  3.31it/s]
 94%|█████████▍| 348932/371472 [5:36:26<1:57:30,  3.20it/s]
 94%|█████████▍| 348933/371472 [5:36:26<1:52:14,  3.35it/s]
 94%|█████████▍| 348934/371472 [5:36:27<1:55:54,  3.24it/s]
 94%|█████████▍| 348935/371472 [5:36:27<1:54:56,  3.27it/s]
 94%|█████████▍| 348936/371472 [5:36:27<1:50:15,  3.41it/s]
 94%|█████████▍| 348937/371472 [5:36:28<1:55:46,  3.24it/s]
 94%|█████████▍| 348938/371472 [5:36:28<1:49:51,  3.42it/s]
 94%|█████████▍| 348939/371472 [5:36:28<1:53:00,  3.32it/s]
 94%|█████████▍| 348940/371472 [5:36:29<1:54:26,  3.28it/s]
                                                           
{'loss': 2.5573, 'learning_rate': 1.546197935745222e-07, 'epoch': 15.03}

 94%|█████████▍| 348940/371472 [5:36:29<1:54:26,  3.28it/s]
 94%|█████████▍| 348941/371472 [5:36:29<1:49:58,  3.41it/s]
 94%|█████████▍| 348942/371472 [5:36:29<1:51:11,  3.38it/s]
 94%|█████████▍| 348943/371472 [5:36:29<1:56:59,  3.21it/s]
 94%|█████████▍| 348944/371472 [5:36:30<2:03:05,  3.05it/s]
 94%|█████████▍| 348945/371472 [5:36:30<2:05:18,  3.00it/s]
 94%|█████████▍| 348946/371472 [5:36:31<2:07:25,  2.95it/s]
 94%|█████████▍| 348947/371472 [5:36:31<2:04:05,  3.03it/s]
 94%|█████████▍| 348948/371472 [5:36:31<2:01:03,  3.10it/s]
 94%|█████████▍| 348949/371472 [5:36:31<1:54:42,  3.27it/s]
 94%|█████████▍| 348950/371472 [5:36:32<1:57:45,  3.19it/s]
 94%|█████████▍| 348951/371472 [5:36:32<1:52:43,  3.33it/s]
 94%|█████████▍| 348952/371472 [5:36:32<1:53:26,  3.31it/s]
 94%|█████████▍| 348953/371472 [5:36:33<1:49:31,  3.43it/s]
 94%|█████████▍| 348954/371472 [5:36:33<1:49:57,  3.41it/s]
 94%|█████████▍| 348955/371472 [5:36:33<1:45:38,  3.55it/s]
 94%|█████████▍| 348956/371472 [5:36:33<1:45:36,  3.55it/s]
 94%|█████████▍| 348957/371472 [5:36:34<1:49:31,  3.43it/s]
 94%|█████████▍| 348958/371472 [5:36:34<1:46:57,  3.51it/s]
 94%|█████████▍| 348959/371472 [5:36:34<1:53:48,  3.30it/s]
 94%|█████████▍| 348960/371472 [5:36:35<1:52:28,  3.34it/s]
                                                           
{'loss': 2.5873, 'learning_rate': 1.5457131159904325e-07, 'epoch': 15.03}

 94%|█████████▍| 348960/371472 [5:36:35<1:52:28,  3.34it/s]
 94%|█████████▍| 348961/371472 [5:36:35<1:46:07,  3.54it/s]
 94%|█████████▍| 348962/371472 [5:36:35<1:43:10,  3.64it/s]
 94%|█████████▍| 348963/371472 [5:36:35<1:48:10,  3.47it/s]
 94%|█████████▍| 348964/371472 [5:36:36<1:54:40,  3.27it/s]
 94%|█████████▍| 348965/371472 [5:36:36<1:56:20,  3.22it/s]
 94%|█████████▍| 348966/371472 [5:36:36<1:50:16,  3.40it/s]
 94%|█████████▍| 348967/371472 [5:36:37<1:55:54,  3.24it/s]
 94%|█████████▍| 348968/371472 [5:36:37<1:52:40,  3.33it/s]
 94%|█████████▍| 348969/371472 [5:36:37<1:47:53,  3.48it/s]
 94%|█████████▍| 348970/371472 [5:36:38<1:50:47,  3.39it/s]
 94%|█████████▍| 348971/371472 [5:36:38<1:49:49,  3.41it/s]
 94%|█████████▍| 348972/371472 [5:36:38<1:46:56,  3.51it/s]
 94%|█████████▍| 348973/371472 [5:36:38<1:46:02,  3.54it/s]
 94%|█████████▍| 348974/371472 [5:36:39<1:42:54,  3.64it/s]
 94%|█████████▍| 348975/371472 [5:36:39<1:43:59,  3.61it/s]
 94%|█████████▍| 348976/371472 [5:36:39<1:54:23,  3.28it/s]
 94%|█████████▍| 348977/371472 [5:36:40<1:48:19,  3.46it/s]
 94%|█████████▍| 348978/371472 [5:36:40<1:56:43,  3.21it/s]
 94%|█████████▍| 348979/371472 [5:36:40<1:53:15,  3.31it/s]
 94%|█████████▍| 348980/371472 [5:36:41<1:57:04,  3.20it/s]
                                                           
{'loss': 2.5214, 'learning_rate': 1.5452282962356443e-07, 'epoch': 15.03}

 94%|█████████▍| 348980/371472 [5:36:41<1:57:04,  3.20it/s]
 94%|█████████▍| 348981/371472 [5:36:41<1:54:04,  3.29it/s]
 94%|█████████▍| 348982/371472 [5:36:41<2:05:15,  2.99it/s]
 94%|█████████▍| 348983/371472 [5:36:41<1:55:38,  3.24it/s]
 94%|█████████▍| 348984/371472 [5:36:42<1:53:24,  3.30it/s]
 94%|█████████▍| 348985/371472 [5:36:42<1:57:11,  3.20it/s]
 94%|█████████▍| 348986/371472 [5:36:42<1:56:14,  3.22it/s]
 94%|█████████▍| 348987/371472 [5:36:43<1:59:08,  3.15it/s]
 94%|█████████▍| 348988/371472 [5:36:43<1:52:21,  3.34it/s]
 94%|█████████▍| 348989/371472 [5:36:43<1:48:09,  3.46it/s]
 94%|█████████▍| 348990/371472 [5:36:44<1:45:13,  3.56it/s]
 94%|█████████▍| 348991/371472 [5:36:44<1:52:05,  3.34it/s]
 94%|█████████▍| 348992/371472 [5:36:44<1:50:19,  3.40it/s]
 94%|█████████▍| 348993/371472 [5:36:44<1:47:09,  3.50it/s]
 94%|█████████▍| 348994/371472 [5:36:45<1:46:24,  3.52it/s]
 94%|█████████▍| 348995/371472 [5:36:45<1:44:44,  3.58it/s]
 94%|█████████▍| 348996/371472 [5:36:45<1:47:13,  3.49it/s]
 94%|█████████▍| 348997/371472 [5:36:46<1:44:47,  3.57it/s]
 94%|█████████▍| 348998/371472 [5:36:46<1:44:45,  3.58it/s]
 94%|█████████▍| 348999/371472 [5:36:46<1:45:02,  3.57it/s]
 94%|█████████▍| 349000/371472 [5:36:46<1:41:28,  3.69it/s]
                                                           
{'loss': 2.6873, 'learning_rate': 1.5447434764808547e-07, 'epoch': 15.03}

 94%|█████████▍| 349000/371472 [5:36:46<1:41:28,  3.69it/s]
 94%|█████████▍| 349001/371472 [5:36:47<1:45:02,  3.57it/s]
 94%|█████████▍| 349002/371472 [5:36:47<1:44:35,  3.58it/s]
 94%|█████████▍| 349003/371472 [5:36:47<1:48:12,  3.46it/s]
 94%|█████████▍| 349004/371472 [5:36:48<1:51:06,  3.37it/s]
 94%|█████████▍| 349005/371472 [5:36:48<1:49:34,  3.42it/s]
 94%|█████████▍| 349006/371472 [5:36:48<1:44:00,  3.60it/s]
 94%|█████████▍| 349007/371472 [5:36:48<1:42:39,  3.65it/s]
 94%|█████████▍| 349008/371472 [5:36:49<1:43:26,  3.62it/s]
 94%|█████████▍| 349009/371472 [5:36:49<1:45:40,  3.54it/s]
 94%|█████████▍| 349010/371472 [5:36:49<1:46:16,  3.52it/s]
 94%|█████████▍| 349011/371472 [5:36:49<1:45:10,  3.56it/s]
 94%|█████████▍| 349012/371472 [5:36:50<1:47:25,  3.48it/s]
 94%|█████████▍| 349013/371472 [5:36:50<1:48:32,  3.45it/s]
 94%|█████████▍| 349014/371472 [5:36:50<1:49:05,  3.43it/s]
 94%|█████████▍| 349015/371472 [5:36:51<1:45:06,  3.56it/s]
 94%|█████████▍| 349016/371472 [5:36:51<1:45:37,  3.54it/s]
 94%|█████████▍| 349017/371472 [5:36:51<1:43:29,  3.62it/s]
 94%|█████████▍| 349018/371472 [5:36:51<1:42:21,  3.66it/s]
 94%|█████████▍| 349019/371472 [5:36:52<1:52:17,  3.33it/s]
 94%|█████████▍| 349020/371472 [5:36:52<1:48:58,  3.43it/s]
                                                           
{'loss': 2.5452, 'learning_rate': 1.5442586567260662e-07, 'epoch': 15.03}

 94%|█████████▍| 349020/371472 [5:36:52<1:48:58,  3.43it/s]
 94%|█████████▍| 349021/371472 [5:36:52<1:52:58,  3.31it/s]
 94%|█████████▍| 349022/371472 [5:36:53<1:50:45,  3.38it/s]
 94%|█████████▍| 349023/371472 [5:36:53<1:51:36,  3.35it/s]
 94%|█████████▍| 349024/371472 [5:36:53<1:53:39,  3.29it/s]
 94%|█████████▍| 349025/371472 [5:36:54<1:49:18,  3.42it/s]
 94%|█████████▍| 349026/371472 [5:36:54<1:54:54,  3.26it/s]
 94%|█████████▍| 349027/371472 [5:36:54<1:50:40,  3.38it/s]
 94%|█████████▍| 349028/371472 [5:36:55<1:55:38,  3.23it/s]
 94%|█████████▍| 349029/371472 [5:36:55<1:52:54,  3.31it/s]
 94%|█████████▍| 349030/371472 [5:36:55<1:50:03,  3.40it/s]
 94%|█████████▍| 349031/371472 [5:36:55<1:47:21,  3.48it/s]
 94%|█████████▍| 349032/371472 [5:36:56<1:53:05,  3.31it/s]
 94%|█████████▍| 349033/371472 [5:36:56<1:52:12,  3.33it/s]
 94%|█████████▍| 349034/371472 [5:36:56<1:52:47,  3.32it/s]
 94%|█████████▍| 349035/371472 [5:36:57<1:50:54,  3.37it/s]
 94%|█████████▍| 349036/371472 [5:36:57<1:48:54,  3.43it/s]
 94%|█████████▍| 349037/371472 [5:36:57<1:45:04,  3.56it/s]
 94%|█████████▍| 349038/371472 [5:36:57<1:44:11,  3.59it/s]
 94%|█████████▍| 349039/371472 [5:36:58<1:48:15,  3.45it/s]
 94%|█████████▍| 349040/371472 [5:36:58<1:44:17,  3.58it/s]
                                                           
{'loss': 2.6069, 'learning_rate': 1.5437738369712767e-07, 'epoch': 15.03}

 94%|█████████▍| 349040/371472 [5:36:58<1:44:17,  3.58it/s]
 94%|█████████▍| 349041/371472 [5:36:58<1:47:55,  3.46it/s]
 94%|█████████▍| 349042/371472 [5:36:59<1:43:10,  3.62it/s]
 94%|█████████▍| 349043/371472 [5:36:59<1:41:56,  3.67it/s]
 94%|█████████▍| 349044/371472 [5:36:59<1:43:35,  3.61it/s]
 94%|█████████▍| 349045/371472 [5:36:59<1:45:01,  3.56it/s]
 94%|█████████▍| 349046/371472 [5:37:00<1:56:26,  3.21it/s]
 94%|█████████▍| 349047/371472 [5:37:00<1:49:11,  3.42it/s]
 94%|█████████▍| 349048/371472 [5:37:00<1:52:32,  3.32it/s]
 94%|█████████▍| 349049/371472 [5:37:01<1:48:34,  3.44it/s]
 94%|█████████▍| 349050/371472 [5:37:01<1:49:09,  3.42it/s]
 94%|█████████▍| 349051/371472 [5:37:01<1:47:41,  3.47it/s]
 94%|█████████▍| 349052/371472 [5:37:01<1:53:45,  3.28it/s]
 94%|█████████▍| 349053/371472 [5:37:02<1:52:06,  3.33it/s]
 94%|█████████▍| 349054/371472 [5:37:02<1:49:02,  3.43it/s]
 94%|█████████▍| 349055/371472 [5:37:02<1:45:01,  3.56it/s]
 94%|█████████▍| 349056/371472 [5:37:03<1:44:35,  3.57it/s]
 94%|█████████▍| 349057/371472 [5:37:03<1:42:11,  3.66it/s]
 94%|█████████▍| 349058/371472 [5:37:03<1:49:56,  3.40it/s]
 94%|█████████▍| 349059/371472 [5:37:03<1:45:14,  3.55it/s]
 94%|█████████▍| 349060/371472 [5:37:04<1:41:07,  3.69it/s]
                                                           
{'loss': 2.502, 'learning_rate': 1.5432890172164885e-07, 'epoch': 15.03}

 94%|█████████▍| 349060/371472 [5:37:04<1:41:07,  3.69it/s]
 94%|█████████▍| 349061/371472 [5:37:04<1:38:54,  3.78it/s]
 94%|█████████▍| 349062/371472 [5:37:04<1:41:11,  3.69it/s]
 94%|█████████▍| 349063/371472 [5:37:05<1:45:19,  3.55it/s]
 94%|█████████▍| 349064/371472 [5:37:05<1:43:29,  3.61it/s]
 94%|█████████▍| 349065/371472 [5:37:05<1:49:55,  3.40it/s]
 94%|█████████▍| 349066/371472 [5:37:05<1:58:08,  3.16it/s]
 94%|█████████▍| 349067/371472 [5:37:06<1:55:10,  3.24it/s]
 94%|█████████▍| 349068/371472 [5:37:06<1:49:21,  3.41it/s]
 94%|█████████▍| 349069/371472 [5:37:06<1:47:55,  3.46it/s]
 94%|█████████▍| 349070/371472 [5:37:07<1:46:20,  3.51it/s]
 94%|█████████▍| 349071/371472 [5:37:07<1:41:44,  3.67it/s]
 94%|█████████▍| 349072/371472 [5:37:07<1:41:45,  3.67it/s]
 94%|█████████▍| 349073/371472 [5:37:07<1:41:09,  3.69it/s]
 94%|█████████▍| 349074/371472 [5:37:08<1:43:29,  3.61it/s]
 94%|█████████▍| 349075/371472 [5:37:08<1:38:47,  3.78it/s]
 94%|█████████▍| 349076/371472 [5:37:08<1:38:08,  3.80it/s]
 94%|█████████▍| 349077/371472 [5:37:08<1:36:32,  3.87it/s]
 94%|█████████▍| 349078/371472 [5:37:09<1:41:05,  3.69it/s]
 94%|█████████▍| 349079/371472 [5:37:09<1:39:17,  3.76it/s]
 94%|█████████▍| 349080/371472 [5:37:09<1:40:39,  3.71it/s]
                                                           
{'loss': 2.5976, 'learning_rate': 1.542804197461699e-07, 'epoch': 15.04}

 94%|█████████▍| 349080/371472 [5:37:09<1:40:39,  3.71it/s]
 94%|█████████▍| 349081/371472 [5:37:10<1:41:18,  3.68it/s]
 94%|█████████▍| 349082/371472 [5:37:10<1:43:00,  3.62it/s]
 94%|█████████▍| 349083/371472 [5:37:10<1:46:17,  3.51it/s]
 94%|█████████▍| 349084/371472 [5:37:10<1:44:10,  3.58it/s]
 94%|█████████▍| 349085/371472 [5:37:11<1:42:10,  3.65it/s]
 94%|█████████▍| 349086/371472 [5:37:11<1:50:11,  3.39it/s]
 94%|█████████▍| 349087/371472 [5:37:11<1:46:04,  3.52it/s]
 94%|█████████▍| 349088/371472 [5:37:12<1:50:16,  3.38it/s]
 94%|█████████▍| 349089/371472 [5:37:12<1:48:51,  3.43it/s]
 94%|█████████▍| 349090/371472 [5:37:12<1:45:42,  3.53it/s]
 94%|█████████▍| 349091/371472 [5:37:12<1:56:43,  3.20it/s]
 94%|█████████▍| 349092/371472 [5:37:13<1:57:31,  3.17it/s]
 94%|█████████▍| 349093/371472 [5:37:13<1:55:18,  3.23it/s]
 94%|█████████▍| 349094/371472 [5:37:13<1:49:36,  3.40it/s]
 94%|█████████▍| 349095/371472 [5:37:14<1:47:38,  3.46it/s]
 94%|█████████▍| 349096/371472 [5:37:14<1:52:05,  3.33it/s]
 94%|█████████▍| 349097/371472 [5:37:14<1:47:28,  3.47it/s]
 94%|█████████▍| 349098/371472 [5:37:15<1:48:44,  3.43it/s]
 94%|█████████▍| 349099/371472 [5:37:15<1:48:49,  3.43it/s]
 94%|█████████▍| 349100/371472 [5:37:15<1:46:55,  3.49it/s]
                                                           
{'loss': 2.6143, 'learning_rate': 1.5423193777069104e-07, 'epoch': 15.04}

 94%|█████████▍| 349100/371472 [5:37:15<1:46:55,  3.49it/s]
 94%|█████████▍| 349101/371472 [5:37:15<1:46:22,  3.51it/s]
 94%|█████████▍| 349102/371472 [5:37:16<1:45:03,  3.55it/s]
 94%|█████████▍| 349103/371472 [5:37:16<1:43:52,  3.59it/s]
 94%|█████████▍| 349104/371472 [5:37:16<1:45:07,  3.55it/s]
 94%|█████████▍| 349105/371472 [5:37:17<1:46:31,  3.50it/s]
 94%|█████████▍| 349106/371472 [5:37:17<1:46:51,  3.49it/s]
 94%|█████████▍| 349107/371472 [5:37:17<1:49:38,  3.40it/s]
 94%|█████████▍| 349108/371472 [5:37:17<1:50:45,  3.37it/s]
 94%|█████████▍| 349109/371472 [5:37:18<1:47:14,  3.48it/s]
 94%|█████████▍| 349110/371472 [5:37:18<1:44:31,  3.57it/s]
 94%|█████████▍| 349111/371472 [5:37:18<1:49:12,  3.41it/s]
 94%|█████████▍| 349112/371472 [5:37:19<1:51:01,  3.36it/s]
 94%|█████████▍| 349113/371472 [5:37:19<1:50:18,  3.38it/s]
 94%|█████████▍| 349114/371472 [5:37:19<1:46:36,  3.50it/s]
 94%|█████████▍| 349115/371472 [5:37:19<1:46:36,  3.50it/s]
 94%|█████████▍| 349116/371472 [5:37:20<1:46:43,  3.49it/s]
 94%|█████████▍| 349117/371472 [5:37:20<1:43:52,  3.59it/s]
 94%|█████████▍| 349118/371472 [5:37:20<2:02:33,  3.04it/s]
 94%|█████████▍| 349119/371472 [5:37:21<1:55:54,  3.21it/s]
 94%|█████████▍| 349120/371472 [5:37:21<1:51:52,  3.33it/s]
                                                           
{'loss': 2.6239, 'learning_rate': 1.5418345579521211e-07, 'epoch': 15.04}

 94%|█████████▍| 349120/371472 [5:37:21<1:51:52,  3.33it/s]
 94%|█████████▍| 349121/371472 [5:37:21<1:52:29,  3.31it/s]
 94%|█████████▍| 349122/371472 [5:37:22<1:46:37,  3.49it/s]
 94%|█████████▍| 349123/371472 [5:37:22<1:44:07,  3.58it/s]
 94%|█████████▍| 349124/371472 [5:37:22<1:47:43,  3.46it/s]
 94%|█████████▍| 349125/371472 [5:37:22<1:46:02,  3.51it/s]
 94%|█████████▍| 349126/371472 [5:37:23<1:44:32,  3.56it/s]
 94%|█████████▍| 349127/371472 [5:37:23<1:50:52,  3.36it/s]
 94%|█████████▍| 349128/371472 [5:37:23<1:48:08,  3.44it/s]
 94%|█████████▍| 349129/371472 [5:37:24<1:45:59,  3.51it/s]
 94%|█████████▍| 349130/371472 [5:37:24<1:46:19,  3.50it/s]
 94%|█████████▍| 349131/371472 [5:37:24<1:45:25,  3.53it/s]
 94%|█████████▍| 349132/371472 [5:37:24<1:45:48,  3.52it/s]
 94%|█████████▍| 349133/371472 [5:37:25<1:46:14,  3.50it/s]
 94%|█████████▍| 349134/371472 [5:37:25<1:46:51,  3.48it/s]
 94%|█████████▍| 349135/371472 [5:37:25<1:52:42,  3.30it/s]
 94%|█████████▍| 349136/371472 [5:37:26<1:46:29,  3.50it/s]
 94%|█████████▍| 349137/371472 [5:37:26<1:44:15,  3.57it/s]
 94%|█████████▍| 349138/371472 [5:37:26<1:44:06,  3.58it/s]
 94%|█████████▍| 349139/371472 [5:37:26<1:42:49,  3.62it/s]
 94%|█████████▍| 349140/371472 [5:37:27<1:39:55,  3.72it/s]
                                                           
{'loss': 2.6629, 'learning_rate': 1.5413497381973327e-07, 'epoch': 15.04}

 94%|█████████▍| 349140/371472 [5:37:27<1:39:55,  3.72it/s]
 94%|█████████▍| 349141/371472 [5:37:27<1:39:22,  3.75it/s]
 94%|█████████▍| 349142/371472 [5:37:27<1:40:04,  3.72it/s]
 94%|█████████▍| 349143/371472 [5:37:27<1:41:24,  3.67it/s]
 94%|█████████▍| 349144/371472 [5:37:28<1:42:48,  3.62it/s]
 94%|█████████▍| 349145/371472 [5:37:28<1:40:16,  3.71it/s]
 94%|█████████▍| 349146/371472 [5:37:28<1:38:56,  3.76it/s]
 94%|█████████▍| 349147/371472 [5:37:28<1:39:08,  3.75it/s]
 94%|█████████▍| 349148/371472 [5:37:29<1:36:57,  3.84it/s]
 94%|█████████▍| 349149/371472 [5:37:29<1:55:37,  3.22it/s]
 94%|█████████▍| 349150/371472 [5:37:29<1:52:43,  3.30it/s]
 94%|█████████▍| 349151/371472 [5:37:30<1:48:37,  3.42it/s]
 94%|█████████▍| 349152/371472 [5:37:30<1:44:12,  3.57it/s]
 94%|█████████▍| 349153/371472 [5:37:30<1:42:04,  3.64it/s]
 94%|█████████▍| 349154/371472 [5:37:30<1:41:54,  3.65it/s]
 94%|█████████▍| 349155/371472 [5:37:31<1:43:15,  3.60it/s]
 94%|█████████▍| 349156/371472 [5:37:31<1:46:29,  3.49it/s]
 94%|█████████▍| 349157/371472 [5:37:31<1:50:21,  3.37it/s]
 94%|█████████▍| 349158/371472 [5:37:32<1:51:18,  3.34it/s]
 94%|█████████▍| 349159/371472 [5:37:32<1:47:39,  3.45it/s]
 94%|█████████▍| 349160/371472 [5:37:32<1:45:04,  3.54it/s]
                                                           
{'loss': 2.5854, 'learning_rate': 1.5408649184425434e-07, 'epoch': 15.04}

 94%|█████████▍| 349160/371472 [5:37:32<1:45:04,  3.54it/s]
 94%|█████████▍| 349161/371472 [5:37:33<1:52:03,  3.32it/s]
 94%|█████████▍| 349162/371472 [5:37:33<1:47:45,  3.45it/s]
 94%|█████████▍| 349163/371472 [5:37:33<1:53:19,  3.28it/s]
 94%|█████████▍| 349164/371472 [5:37:34<1:58:57,  3.13it/s]
 94%|█████████▍| 349165/371472 [5:37:34<1:57:10,  3.17it/s]
 94%|█████████▍| 349166/371472 [5:37:34<1:54:27,  3.25it/s]
 94%|█████████▍| 349167/371472 [5:37:34<1:48:58,  3.41it/s]
 94%|█████████▍| 349168/371472 [5:37:35<1:47:54,  3.44it/s]
 94%|█████████▍| 349169/371472 [5:37:35<1:43:14,  3.60it/s]
 94%|█████████▍| 349170/371472 [5:37:35<1:44:19,  3.56it/s]
 94%|█████████▍| 349171/371472 [5:37:35<1:43:15,  3.60it/s]
 94%|█████████▍| 349172/371472 [5:37:36<1:41:33,  3.66it/s]
 94%|█████████▍| 349173/371472 [5:37:36<1:46:27,  3.49it/s]
 94%|█████████▍| 349174/371472 [5:37:36<1:43:32,  3.59it/s]
 94%|█████████▍| 349175/371472 [5:37:37<1:41:32,  3.66it/s]
 94%|█████████▍| 349176/371472 [5:37:37<1:40:27,  3.70it/s]
 94%|█████████▍| 349177/371472 [5:37:37<1:40:11,  3.71it/s]
 94%|█████████▍| 349178/371472 [5:37:37<1:48:33,  3.42it/s]
 94%|█████████▍| 349179/371472 [5:37:38<1:53:43,  3.27it/s]
 94%|█████████▍| 349180/371472 [5:37:38<1:48:50,  3.41it/s]
                                                           
{'loss': 2.6154, 'learning_rate': 1.540380098687755e-07, 'epoch': 15.04}

 94%|█████████▍| 349180/371472 [5:37:38<1:48:50,  3.41it/s]
 94%|█████████▍| 349181/371472 [5:37:38<1:50:48,  3.35it/s]
 94%|█████████▍| 349182/371472 [5:37:39<1:51:53,  3.32it/s]
 94%|█████████▍| 349183/371472 [5:37:39<1:50:54,  3.35it/s]
 94%|█████████▍| 349184/371472 [5:37:39<1:53:36,  3.27it/s]
 94%|█████████▍| 349185/371472 [5:37:40<1:53:22,  3.28it/s]
 94%|█████████▍| 349186/371472 [5:37:40<1:49:58,  3.38it/s]
 94%|█████████▍| 349187/371472 [5:37:40<1:45:49,  3.51it/s]
 94%|█████████▍| 349188/371472 [5:37:40<1:42:21,  3.63it/s]
 94%|█████████▍| 349189/371472 [5:37:41<1:45:44,  3.51it/s]
 94%|█████████▍| 349190/371472 [5:37:41<1:44:11,  3.56it/s]
 94%|█████████▍| 349191/371472 [5:37:41<1:41:43,  3.65it/s]
 94%|█████████▍| 349192/371472 [5:37:42<1:41:51,  3.65it/s]
 94%|█████████▍| 349193/371472 [5:37:42<1:44:24,  3.56it/s]
 94%|█████████▍| 349194/371472 [5:37:42<1:46:28,  3.49it/s]
 94%|█████████▍| 349195/371472 [5:37:42<1:43:51,  3.57it/s]
 94%|█████████▍| 349196/371472 [5:37:43<1:41:58,  3.64it/s]
 94%|█████████▍| 349197/371472 [5:37:43<1:38:42,  3.76it/s]
 94%|█████████▍| 349198/371472 [5:37:43<1:42:01,  3.64it/s]
 94%|█████████▍| 349199/371472 [5:37:43<1:41:09,  3.67it/s]
 94%|█████████▍| 349200/371472 [5:37:44<1:44:23,  3.56it/s]
                                                           
{'loss': 2.6273, 'learning_rate': 1.5398952789329656e-07, 'epoch': 15.04}

 94%|█████████▍| 349200/371472 [5:37:44<1:44:23,  3.56it/s]
 94%|█████████▍| 349201/371472 [5:37:44<1:41:44,  3.65it/s]
 94%|█████████▍| 349202/371472 [5:37:44<1:39:50,  3.72it/s]
 94%|█████████▍| 349203/371472 [5:37:45<1:38:35,  3.76it/s]
 94%|█████████▍| 349204/371472 [5:37:45<1:40:41,  3.69it/s]
 94%|█████████▍| 349205/371472 [5:37:45<1:41:53,  3.64it/s]
 94%|█████████▍| 349206/371472 [5:37:45<1:47:59,  3.44it/s]
 94%|█████████▍| 349207/371472 [5:37:46<1:45:02,  3.53it/s]
 94%|█████████▍| 349208/371472 [5:37:46<1:56:16,  3.19it/s]
 94%|█████████▍| 349209/371472 [5:37:46<1:49:34,  3.39it/s]
 94%|█████████▍| 349210/371472 [5:37:47<1:46:30,  3.48it/s]
 94%|█████████▍| 349211/371472 [5:37:47<1:47:00,  3.47it/s]
 94%|█████████▍| 349212/371472 [5:37:47<1:45:21,  3.52it/s]
 94%|█████████▍| 349213/371472 [5:37:47<1:51:04,  3.34it/s]
 94%|█████████▍| 349214/371472 [5:37:48<1:49:20,  3.39it/s]
 94%|█████████▍| 349215/371472 [5:37:48<1:44:30,  3.55it/s]
 94%|█████████▍| 349216/371472 [5:37:48<1:44:09,  3.56it/s]
 94%|█████████▍| 349217/371472 [5:37:49<1:41:45,  3.64it/s]
 94%|█████████▍| 349218/371472 [5:37:49<1:37:33,  3.80it/s]
 94%|█████████▍| 349219/371472 [5:37:49<1:37:02,  3.82it/s]
 94%|█████████▍| 349220/371472 [5:37:49<1:36:47,  3.83it/s]
                                                           
{'loss': 2.6398, 'learning_rate': 1.539410459178177e-07, 'epoch': 15.04}

 94%|█████████▍| 349220/371472 [5:37:49<1:36:47,  3.83it/s]
 94%|█████████▍| 349221/371472 [5:37:50<1:38:54,  3.75it/s]
 94%|█████████▍| 349222/371472 [5:37:50<1:39:08,  3.74it/s]
 94%|█████████▍| 349223/371472 [5:37:50<1:44:06,  3.56it/s]
 94%|█████████▍| 349224/371472 [5:37:50<1:44:50,  3.54it/s]
 94%|█████████▍| 349225/371472 [5:37:51<1:46:51,  3.47it/s]
 94%|█████████▍| 349226/371472 [5:37:51<1:46:19,  3.49it/s]
 94%|█████████▍| 349227/371472 [5:37:51<1:46:10,  3.49it/s]
 94%|█████████▍| 349228/371472 [5:37:52<1:53:04,  3.28it/s]
 94%|█████████▍| 349229/371472 [5:37:52<1:53:32,  3.27it/s]
 94%|█████████▍| 349230/371472 [5:37:52<1:56:53,  3.17it/s]
 94%|█████████▍| 349231/371472 [5:37:53<1:50:57,  3.34it/s]
 94%|█████████▍| 349232/371472 [5:37:53<1:57:46,  3.15it/s]
 94%|█████████▍| 349233/371472 [5:37:53<1:55:32,  3.21it/s]
 94%|█████████▍| 349234/371472 [5:37:54<1:51:57,  3.31it/s]
 94%|█████████▍| 349235/371472 [5:37:54<1:48:02,  3.43it/s]
 94%|█████████▍| 349236/371472 [5:37:54<1:46:10,  3.49it/s]
 94%|█████████▍| 349237/371472 [5:37:54<1:54:27,  3.24it/s]
 94%|█████████▍| 349238/371472 [5:37:55<1:51:40,  3.32it/s]
 94%|█████████▍| 349239/371472 [5:37:55<1:49:28,  3.38it/s]
 94%|█████████▍| 349240/371472 [5:37:55<1:42:31,  3.61it/s]
                                                           
{'loss': 2.5581, 'learning_rate': 1.5389256394233876e-07, 'epoch': 15.04}

 94%|█████████▍| 349240/371472 [5:37:55<1:42:31,  3.61it/s]
 94%|█████████▍| 349241/371472 [5:37:56<1:46:30,  3.48it/s]
 94%|█████████▍| 349242/371472 [5:37:56<1:45:23,  3.52it/s]
 94%|█████████▍| 349243/371472 [5:37:56<1:45:25,  3.51it/s]
 94%|█████████▍| 349244/371472 [5:37:56<1:42:33,  3.61it/s]
 94%|█████████▍| 349245/371472 [5:37:57<1:44:48,  3.53it/s]
 94%|█████████▍| 349246/371472 [5:37:57<1:47:10,  3.46it/s]
 94%|█████████▍| 349247/371472 [5:37:57<1:44:43,  3.54it/s]
 94%|█████████▍| 349248/371472 [5:37:58<1:45:46,  3.50it/s]
 94%|█████████▍| 349249/371472 [5:37:58<1:48:32,  3.41it/s]
 94%|█████████▍| 349250/371472 [5:37:58<1:49:08,  3.39it/s]
 94%|█████████▍| 349251/371472 [5:37:58<1:48:32,  3.41it/s]
 94%|█████████▍| 349252/371472 [5:37:59<1:42:45,  3.60it/s]
 94%|█████████▍| 349253/371472 [5:37:59<1:43:18,  3.58it/s]
 94%|█████████▍| 349254/371472 [5:37:59<1:42:20,  3.62it/s]
 94%|█████████▍| 349255/371472 [5:37:59<1:41:10,  3.66it/s]
 94%|█████████▍| 349256/371472 [5:38:00<1:41:03,  3.66it/s]
 94%|█████████▍| 349257/371472 [5:38:00<1:42:42,  3.60it/s]
 94%|█████████▍| 349258/371472 [5:38:00<1:40:09,  3.70it/s]
 94%|█████████▍| 349259/371472 [5:38:01<1:40:02,  3.70it/s]
 94%|█████████▍| 349260/371472 [5:38:01<1:40:04,  3.70it/s]
                                                           
{'loss': 2.4779, 'learning_rate': 1.5384408196685993e-07, 'epoch': 15.04}

 94%|█████████▍| 349260/371472 [5:38:01<1:40:04,  3.70it/s]
 94%|█████████▍| 349261/371472 [5:38:01<1:43:33,  3.57it/s]
 94%|█████████▍| 349262/371472 [5:38:01<1:40:52,  3.67it/s]
 94%|█████████▍| 349263/371472 [5:38:02<1:39:59,  3.70it/s]
 94%|█████████▍| 349264/371472 [5:38:02<1:38:49,  3.75it/s]
 94%|█████████▍| 349265/371472 [5:38:02<1:39:05,  3.74it/s]
 94%|█████████▍| 349266/371472 [5:38:02<1:37:17,  3.80it/s]
 94%|█████████▍| 349267/371472 [5:38:03<1:37:38,  3.79it/s]
 94%|█████████▍| 349268/371472 [5:38:03<1:37:22,  3.80it/s]
 94%|█████████▍| 349269/371472 [5:38:03<1:51:35,  3.32it/s]
 94%|█████████▍| 349270/371472 [5:38:04<1:53:16,  3.27it/s]
 94%|█████████▍| 349271/371472 [5:38:04<1:57:25,  3.15it/s]
 94%|█████████▍| 349272/371472 [5:38:04<1:52:20,  3.29it/s]
 94%|█████████▍| 349273/371472 [5:38:05<1:49:43,  3.37it/s]
 94%|█████████▍| 349274/371472 [5:38:05<1:45:29,  3.51it/s]
 94%|█████████▍| 349275/371472 [5:38:05<1:43:09,  3.59it/s]
 94%|█████████▍| 349276/371472 [5:38:05<1:45:43,  3.50it/s]
 94%|█████████▍| 349277/371472 [5:38:06<1:41:49,  3.63it/s]
 94%|█████████▍| 349278/371472 [5:38:06<1:45:46,  3.50it/s]
 94%|█████████▍| 349279/371472 [5:38:06<1:45:06,  3.52it/s]
 94%|█████████▍| 349280/371472 [5:38:07<1:44:48,  3.53it/s]
                                                           
{'loss': 2.6787, 'learning_rate': 1.5379559999138098e-07, 'epoch': 15.04}

 94%|█████████▍| 349280/371472 [5:38:07<1:44:48,  3.53it/s]
 94%|█████████▍| 349281/371472 [5:38:07<1:44:46,  3.53it/s]
 94%|█████████▍| 349282/371472 [5:38:07<1:43:09,  3.59it/s]
 94%|█████████▍| 349283/371472 [5:38:07<1:44:28,  3.54it/s]
 94%|█████████▍| 349284/371472 [5:38:08<1:48:39,  3.40it/s]
 94%|█████████▍| 349285/371472 [5:38:08<1:47:15,  3.45it/s]
 94%|█████████▍| 349286/371472 [5:38:08<1:43:21,  3.58it/s]
 94%|█████████▍| 349287/371472 [5:38:09<1:54:22,  3.23it/s]
 94%|█████████▍| 349288/371472 [5:38:09<1:48:20,  3.41it/s]
 94%|█████████▍| 349289/371472 [5:38:09<2:00:02,  3.08it/s]
 94%|█████████▍| 349290/371472 [5:38:10<1:59:26,  3.10it/s]
 94%|█████████▍| 349291/371472 [5:38:10<1:54:28,  3.23it/s]
 94%|█████████▍| 349292/371472 [5:38:10<1:49:16,  3.38it/s]
 94%|█████████▍| 349293/371472 [5:38:10<1:44:33,  3.54it/s]
 94%|█████████▍| 349294/371472 [5:38:11<1:52:49,  3.28it/s]
 94%|█████████▍| 349295/371472 [5:38:11<1:45:33,  3.50it/s]
 94%|█████████▍| 349296/371472 [5:38:11<1:47:09,  3.45it/s]
 94%|█████████▍| 349297/371472 [5:38:12<1:43:34,  3.57it/s]
 94%|█████████▍| 349298/371472 [5:38:12<1:48:44,  3.40it/s]
 94%|█████████▍| 349299/371472 [5:38:12<1:48:54,  3.39it/s]
 94%|█████████▍| 349300/371472 [5:38:12<1:47:20,  3.44it/s]
                                                           
{'loss': 2.7193, 'learning_rate': 1.5374711801590202e-07, 'epoch': 15.05}

 94%|█████████▍| 349300/371472 [5:38:12<1:47:20,  3.44it/s]
 94%|█████████▍| 349301/371472 [5:38:13<1:44:01,  3.55it/s]
 94%|█████████▍| 349302/371472 [5:38:13<1:46:41,  3.46it/s]
 94%|█████████▍| 349303/371472 [5:38:13<1:49:39,  3.37it/s]
 94%|█████████▍| 349304/371472 [5:38:14<1:47:16,  3.44it/s]
 94%|█████████▍| 349305/371472 [5:38:14<1:53:37,  3.25it/s]
 94%|█████████▍| 349306/371472 [5:38:14<1:47:56,  3.42it/s]
 94%|█████████▍| 349307/371472 [5:38:14<1:45:06,  3.51it/s]
 94%|█████████▍| 349308/371472 [5:38:15<1:50:33,  3.34it/s]
 94%|█████████▍| 349309/371472 [5:38:15<1:47:00,  3.45it/s]
 94%|█████████▍| 349310/371472 [5:38:15<1:43:55,  3.55it/s]
 94%|█████████▍| 349311/371472 [5:38:16<1:46:56,  3.45it/s]
 94%|█████████▍| 349312/371472 [5:38:16<1:43:07,  3.58it/s]
 94%|█████████▍| 349313/371472 [5:38:16<1:44:56,  3.52it/s]
 94%|█████████▍| 349314/371472 [5:38:16<1:41:19,  3.64it/s]
 94%|█████████▍| 349315/371472 [5:38:17<1:39:48,  3.70it/s]
 94%|█████████▍| 349316/371472 [5:38:17<1:40:36,  3.67it/s]
 94%|█████████▍| 349317/371472 [5:38:17<1:41:24,  3.64it/s]
 94%|█████████▍| 349318/371472 [5:38:18<1:45:16,  3.51it/s]
 94%|█████████▍| 349319/371472 [5:38:18<1:45:55,  3.49it/s]
 94%|█████████▍| 349320/371472 [5:38:18<1:46:05,  3.48it/s]
                                                           
{'loss': 2.6037, 'learning_rate': 1.536986360404232e-07, 'epoch': 15.05}

 94%|█████████▍| 349320/371472 [5:38:18<1:46:05,  3.48it/s]
 94%|█████████▍| 349321/371472 [5:38:18<1:48:02,  3.42it/s]
 94%|█████████▍| 349322/371472 [5:38:19<1:44:01,  3.55it/s]
 94%|█████████▍| 349323/371472 [5:38:19<1:44:22,  3.54it/s]
 94%|█████████▍| 349324/371472 [5:38:19<1:46:49,  3.46it/s]
 94%|█████████▍| 349325/371472 [5:38:20<1:46:11,  3.48it/s]
 94%|█████████▍| 349326/371472 [5:38:20<1:45:46,  3.49it/s]
 94%|█████████▍| 349327/371472 [5:38:20<1:43:43,  3.56it/s]
 94%|█████████▍| 349328/371472 [5:38:20<1:45:10,  3.51it/s]
 94%|█████████▍| 349329/371472 [5:38:21<1:43:17,  3.57it/s]
 94%|█████████▍| 349330/371472 [5:38:21<1:56:19,  3.17it/s]
 94%|█████████▍| 349331/371472 [5:38:21<1:49:43,  3.36it/s]
 94%|█████████▍| 349332/371472 [5:38:22<1:48:34,  3.40it/s]
 94%|█████████▍| 349333/371472 [5:38:22<1:48:02,  3.42it/s]
 94%|█████████▍| 349334/371472 [5:38:22<1:46:57,  3.45it/s]
 94%|█████████▍| 349335/371472 [5:38:22<1:49:25,  3.37it/s]
 94%|█████████▍| 349336/371472 [5:38:23<1:47:33,  3.43it/s]
 94%|█████████▍| 349337/371472 [5:38:23<1:51:14,  3.32it/s]
 94%|█████████▍| 349338/371472 [5:38:23<1:52:40,  3.27it/s]
 94%|█████████▍| 349339/371472 [5:38:24<1:56:10,  3.18it/s]
 94%|█████████▍| 349340/371472 [5:38:24<1:51:23,  3.31it/s]
                                                           
{'loss': 2.6163, 'learning_rate': 1.5365015406494425e-07, 'epoch': 15.05}

 94%|█████████▍| 349340/371472 [5:38:24<1:51:23,  3.31it/s]
 94%|█████████▍| 349341/371472 [5:38:24<1:54:00,  3.24it/s]
 94%|█████████▍| 349342/371472 [5:38:25<1:50:06,  3.35it/s]
 94%|█████████▍| 349343/371472 [5:38:25<1:49:12,  3.38it/s]
 94%|█████████▍| 349344/371472 [5:38:25<1:47:24,  3.43it/s]
 94%|█████████▍| 349345/371472 [5:38:25<1:45:57,  3.48it/s]
 94%|█████████▍| 349346/371472 [5:38:26<1:48:14,  3.41it/s]
 94%|█████████▍| 349347/371472 [5:38:26<1:46:16,  3.47it/s]
 94%|█████████▍| 349348/371472 [5:38:26<1:46:58,  3.45it/s]
 94%|█████████▍| 349349/371472 [5:38:27<2:00:18,  3.06it/s]
 94%|█████████▍| 349350/371472 [5:38:27<1:56:19,  3.17it/s]
 94%|█████████▍| 349351/371472 [5:38:27<1:50:24,  3.34it/s]
 94%|█████████▍| 349352/371472 [5:38:28<1:46:14,  3.47it/s]
 94%|█████████▍| 349353/371472 [5:38:28<1:43:56,  3.55it/s]
 94%|█████████▍| 349354/371472 [5:38:28<1:44:06,  3.54it/s]
 94%|█████████▍| 349355/371472 [5:38:28<1:45:18,  3.50it/s]
 94%|█████████▍| 349356/371472 [5:38:29<1:42:35,  3.59it/s]
 94%|█████████▍| 349357/371472 [5:38:29<1:49:05,  3.38it/s]
 94%|█████████▍| 349358/371472 [5:38:29<1:46:24,  3.46it/s]
 94%|█████████▍| 349359/371472 [5:38:30<1:42:06,  3.61it/s]
 94%|█████████▍| 349360/371472 [5:38:30<1:43:50,  3.55it/s]
                                                           
{'loss': 2.4882, 'learning_rate': 1.536016720894654e-07, 'epoch': 15.05}

 94%|█████████▍| 349360/371472 [5:38:30<1:43:50,  3.55it/s]
 94%|█████████▍| 349361/371472 [5:38:30<1:45:57,  3.48it/s]
 94%|█████████▍| 349362/371472 [5:38:30<1:46:47,  3.45it/s]
 94%|█████████▍| 349363/371472 [5:38:31<1:43:18,  3.57it/s]
 94%|█████████▍| 349364/371472 [5:38:31<1:45:50,  3.48it/s]
 94%|█████████▍| 349365/371472 [5:38:31<1:44:06,  3.54it/s]
 94%|█████████▍| 349366/371472 [5:38:32<1:45:39,  3.49it/s]
 94%|█████████▍| 349367/371472 [5:38:32<1:43:40,  3.55it/s]
 94%|█████████▍| 349368/371472 [5:38:32<1:40:36,  3.66it/s]
 94%|█████████▍| 349369/371472 [5:38:32<1:39:56,  3.69it/s]
 94%|█████████▍| 349370/371472 [5:38:33<1:42:07,  3.61it/s]
 94%|█████████▍| 349371/371472 [5:38:33<1:39:50,  3.69it/s]
 94%|█████████▍| 349372/371472 [5:38:33<1:41:42,  3.62it/s]
 94%|█████████▍| 349373/371472 [5:38:33<1:42:17,  3.60it/s]
 94%|█████████▍| 349374/371472 [5:38:34<1:50:47,  3.32it/s]
 94%|█████████▍| 349375/371472 [5:38:34<1:50:13,  3.34it/s]
 94%|█████████▍| 349376/371472 [5:38:34<1:47:59,  3.41it/s]
 94%|█████████▍| 349377/371472 [5:38:35<1:43:39,  3.55it/s]
 94%|█████████▍| 349378/371472 [5:38:35<1:55:20,  3.19it/s]
 94%|█████████▍| 349379/371472 [5:38:35<1:50:14,  3.34it/s]
 94%|█████████▍| 349380/371472 [5:38:36<1:51:13,  3.31it/s]
                                                           
{'loss': 2.4446, 'learning_rate': 1.5355319011398647e-07, 'epoch': 15.05}

 94%|█████████▍| 349380/371472 [5:38:36<1:51:13,  3.31it/s]
 94%|█████████▍| 349381/371472 [5:38:36<1:50:21,  3.34it/s]
 94%|█████████▍| 349382/371472 [5:38:36<1:56:18,  3.17it/s]
 94%|█████████▍| 349383/371472 [5:38:37<1:49:44,  3.35it/s]
 94%|█████████▍| 349384/371472 [5:38:37<1:46:44,  3.45it/s]
 94%|█████████▍| 349385/371472 [5:38:37<1:53:22,  3.25it/s]
 94%|█████████▍| 349386/371472 [5:38:37<1:53:29,  3.24it/s]
 94%|█████████▍| 349387/371472 [5:38:38<1:48:35,  3.39it/s]
 94%|█████████▍| 349388/371472 [5:38:38<1:51:17,  3.31it/s]
 94%|█████████▍| 349389/371472 [5:38:38<1:50:20,  3.34it/s]
 94%|█████████▍| 349390/371472 [5:38:39<1:51:00,  3.32it/s]
 94%|█████████▍| 349391/371472 [5:38:39<2:01:04,  3.04it/s]
 94%|█████████▍| 349392/371472 [5:38:39<1:53:32,  3.24it/s]
 94%|█████████▍| 349393/371472 [5:38:40<1:57:41,  3.13it/s]
 94%|█████████▍| 349394/371472 [5:38:40<1:55:49,  3.18it/s]
 94%|█████████▍| 349395/371472 [5:38:40<1:51:54,  3.29it/s]
 94%|█████████▍| 349396/371472 [5:38:40<1:49:25,  3.36it/s]
 94%|█████████▍| 349397/371472 [5:38:41<1:48:10,  3.40it/s]
 94%|█████████▍| 349398/371472 [5:38:41<1:46:38,  3.45it/s]
 94%|█████████▍| 349399/371472 [5:38:41<1:49:22,  3.36it/s]
 94%|█████████▍| 349400/371472 [5:38:42<1:48:43,  3.38it/s]
                                                           
{'loss': 2.5655, 'learning_rate': 1.535047081385076e-07, 'epoch': 15.05}

 94%|█████████▍| 349400/371472 [5:38:42<1:48:43,  3.38it/s]
 94%|█████████▍| 349401/371472 [5:38:42<1:46:58,  3.44it/s]
 94%|█████████▍| 349402/371472 [5:38:42<1:52:55,  3.26it/s]
 94%|█████████▍| 349403/371472 [5:38:43<1:49:25,  3.36it/s]
 94%|█████████▍| 349404/371472 [5:38:43<1:48:09,  3.40it/s]
 94%|█████████▍| 349405/371472 [5:38:43<1:51:12,  3.31it/s]
 94%|█████████▍| 349406/371472 [5:38:43<1:46:36,  3.45it/s]
 94%|█████████▍| 349407/371472 [5:38:44<1:47:24,  3.42it/s]
 94%|█████████▍| 349408/371472 [5:38:44<1:44:01,  3.54it/s]
 94%|█████████▍| 349409/371472 [5:38:44<1:45:48,  3.48it/s]
 94%|█████████▍| 349410/371472 [5:38:45<1:40:54,  3.64it/s]
 94%|█████████▍| 349411/371472 [5:38:45<1:45:00,  3.50it/s]
 94%|█████████▍| 349412/371472 [5:38:45<1:45:04,  3.50it/s]
 94%|█████████▍| 349413/371472 [5:38:45<1:43:05,  3.57it/s]
 94%|█████████▍| 349414/371472 [5:38:46<1:48:51,  3.38it/s]
 94%|█████████▍| 349415/371472 [5:38:46<1:48:19,  3.39it/s]
 94%|█████████▍| 349416/371472 [5:38:46<1:48:31,  3.39it/s]
 94%|█████████▍| 349417/371472 [5:38:47<1:52:25,  3.27it/s]
 94%|█████████▍| 349418/371472 [5:38:47<1:49:57,  3.34it/s]
 94%|█████████▍| 349419/371472 [5:38:47<1:49:00,  3.37it/s]
 94%|█████████▍| 349420/371472 [5:38:47<1:46:05,  3.46it/s]
                                                           
{'loss': 2.5647, 'learning_rate': 1.5345622616302866e-07, 'epoch': 15.05}

 94%|█████████▍| 349420/371472 [5:38:47<1:46:05,  3.46it/s]
 94%|█████████▍| 349421/371472 [5:38:48<1:53:38,  3.23it/s]
 94%|█████████▍| 349422/371472 [5:38:48<1:49:52,  3.34it/s]
 94%|█████████▍| 349423/371472 [5:38:48<1:48:33,  3.39it/s]
 94%|█████████▍| 349424/371472 [5:38:49<1:45:18,  3.49it/s]
 94%|█████████▍| 349425/371472 [5:38:49<1:43:55,  3.54it/s]
 94%|█████████▍| 349426/371472 [5:38:49<1:41:17,  3.63it/s]
 94%|█████████▍| 349427/371472 [5:38:49<1:42:22,  3.59it/s]
 94%|█████████▍| 349428/371472 [5:38:50<1:39:13,  3.70it/s]
 94%|█████████▍| 349429/371472 [5:38:50<1:38:27,  3.73it/s]
 94%|█████████▍| 349430/371472 [5:38:50<1:39:03,  3.71it/s]
 94%|█████████▍| 349431/371472 [5:38:51<1:40:52,  3.64it/s]
 94%|█████████▍| 349432/371472 [5:38:51<1:42:00,  3.60it/s]
 94%|█████████▍| 349433/371472 [5:38:51<1:41:17,  3.63it/s]
 94%|█████████▍| 349434/371472 [5:38:51<1:43:57,  3.53it/s]
 94%|█████████▍| 349435/371472 [5:38:52<1:43:18,  3.56it/s]
 94%|█████████▍| 349436/371472 [5:38:52<1:41:05,  3.63it/s]
 94%|█████████▍| 349437/371472 [5:38:52<1:45:57,  3.47it/s]
 94%|█████████▍| 349438/371472 [5:38:53<1:49:08,  3.36it/s]
 94%|█████████▍| 349439/371472 [5:38:53<1:47:59,  3.40it/s]
 94%|█████████▍| 349440/371472 [5:38:53<1:44:12,  3.52it/s]
                                                           
{'loss': 2.5786, 'learning_rate': 1.5340774418754984e-07, 'epoch': 15.05}

 94%|█████████▍| 349440/371472 [5:38:53<1:44:12,  3.52it/s]
 94%|█████████▍| 349441/371472 [5:38:53<1:40:35,  3.65it/s]
 94%|█████████▍| 349442/371472 [5:38:54<1:46:34,  3.45it/s]
 94%|█████████▍| 349443/371472 [5:38:54<1:42:57,  3.57it/s]
 94%|█████████▍| 349444/371472 [5:38:54<1:43:46,  3.54it/s]
 94%|█████████▍| 349445/371472 [5:38:55<1:41:31,  3.62it/s]
 94%|█████████▍| 349446/371472 [5:38:55<1:46:20,  3.45it/s]
 94%|█████████▍| 349447/371472 [5:38:55<1:44:03,  3.53it/s]
 94%|█████████▍| 349448/371472 [5:38:55<1:41:28,  3.62it/s]
 94%|█████████▍| 349449/371472 [5:38:56<1:43:33,  3.54it/s]
 94%|█████████▍| 349450/371472 [5:38:56<1:50:20,  3.33it/s]
 94%|█████████▍| 349451/371472 [5:38:56<1:52:46,  3.25it/s]
 94%|█████████▍| 349452/371472 [5:38:57<1:49:25,  3.35it/s]
 94%|█████████▍| 349453/371472 [5:38:57<1:45:45,  3.47it/s]
 94%|█████████▍| 349454/371472 [5:38:57<1:47:00,  3.43it/s]
 94%|█████████▍| 349455/371472 [5:38:57<1:47:06,  3.43it/s]
 94%|█████████▍| 349456/371472 [5:38:58<1:50:32,  3.32it/s]
 94%|█████████▍| 349457/371472 [5:38:58<1:47:49,  3.40it/s]
 94%|█████████▍| 349458/371472 [5:38:58<1:44:28,  3.51it/s]
 94%|█████████▍| 349459/371472 [5:38:59<1:47:16,  3.42it/s]
 94%|█████████▍| 349460/371472 [5:38:59<1:45:28,  3.48it/s]
                                                           
{'loss': 2.5515, 'learning_rate': 1.5335926221207089e-07, 'epoch': 15.05}

 94%|█████████▍| 349460/371472 [5:38:59<1:45:28,  3.48it/s]
 94%|█████████▍| 349461/371472 [5:38:59<1:49:09,  3.36it/s]
 94%|█████████▍| 349462/371472 [5:39:00<1:47:24,  3.42it/s]
 94%|█████████▍| 349463/371472 [5:39:00<1:57:57,  3.11it/s]
 94%|█████████▍| 349464/371472 [5:39:00<1:51:37,  3.29it/s]
 94%|█████████▍| 349465/371472 [5:39:00<1:53:03,  3.24it/s]
 94%|█████████▍| 349466/371472 [5:39:01<1:51:25,  3.29it/s]
 94%|█████████▍| 349467/371472 [5:39:01<1:53:18,  3.24it/s]
 94%|█████████▍| 349468/371472 [5:39:01<1:55:29,  3.18it/s]
 94%|█████████▍| 349469/371472 [5:39:02<1:48:17,  3.39it/s]
 94%|█████████▍| 349470/371472 [5:39:02<1:48:02,  3.39it/s]
 94%|█████████▍| 349471/371472 [5:39:02<1:42:25,  3.58it/s]
 94%|█████████▍| 349472/371472 [5:39:03<1:45:22,  3.48it/s]
 94%|█████████▍| 349473/371472 [5:39:03<1:47:41,  3.40it/s]
 94%|█████████▍| 349474/371472 [5:39:03<1:44:07,  3.52it/s]
 94%|█████████▍| 349475/371472 [5:39:03<1:48:26,  3.38it/s]
 94%|█████████▍| 349476/371472 [5:39:04<1:42:06,  3.59it/s]
 94%|█████████▍| 349477/371472 [5:39:04<1:53:58,  3.22it/s]
 94%|█████████▍| 349478/371472 [5:39:04<1:49:02,  3.36it/s]
 94%|█████████▍| 349479/371472 [5:39:05<1:44:45,  3.50it/s]
 94%|█████████▍| 349480/371472 [5:39:05<1:44:22,  3.51it/s]
                                                           
{'loss': 2.6034, 'learning_rate': 1.5331078023659204e-07, 'epoch': 15.05}

 94%|█████████▍| 349480/371472 [5:39:05<1:44:22,  3.51it/s]
 94%|█████████▍| 349481/371472 [5:39:05<1:42:13,  3.59it/s]
 94%|█████████▍| 349482/371472 [5:39:05<1:47:29,  3.41it/s]
 94%|█████████▍| 349483/371472 [5:39:06<1:46:32,  3.44it/s]
 94%|█████████▍| 349484/371472 [5:39:06<1:48:29,  3.38it/s]
 94%|█████████▍| 349485/371472 [5:39:06<1:53:42,  3.22it/s]
 94%|█████████▍| 349486/371472 [5:39:07<1:49:37,  3.34it/s]
 94%|█████████▍| 349487/371472 [5:39:07<1:47:36,  3.41it/s]
 94%|█████████▍| 349488/371472 [5:39:07<1:46:51,  3.43it/s]
 94%|█████████▍| 349489/371472 [5:39:08<1:53:26,  3.23it/s]
 94%|█████████▍| 349490/371472 [5:39:08<1:51:12,  3.29it/s]
 94%|█████████▍| 349491/371472 [5:39:08<1:45:06,  3.49it/s]
 94%|█████████▍| 349492/371472 [5:39:08<1:48:24,  3.38it/s]
 94%|█████████▍| 349493/371472 [5:39:09<1:49:11,  3.35it/s]
 94%|█████████▍| 349494/371472 [5:39:09<1:55:35,  3.17it/s]
 94%|█████████▍| 349495/371472 [5:39:09<1:57:34,  3.12it/s]
 94%|█████████▍| 349496/371472 [5:39:10<1:50:15,  3.32it/s]
 94%|█████████▍| 349497/371472 [5:39:10<1:52:26,  3.26it/s]
 94%|█████████▍| 349498/371472 [5:39:10<1:52:27,  3.26it/s]
 94%|█████████▍| 349499/371472 [5:39:11<1:46:50,  3.43it/s]
 94%|█████████▍| 349500/371472 [5:39:11<1:40:32,  3.64it/s]
                                                           
{'loss': 2.7043, 'learning_rate': 1.532622982611131e-07, 'epoch': 15.05}

 94%|█████████▍| 349500/371472 [5:39:11<1:40:32,  3.64it/s]
 94%|█████████▍| 349501/371472 [5:39:11<1:40:23,  3.65it/s]
 94%|█████████▍| 349502/371472 [5:39:11<1:39:00,  3.70it/s]
 94%|█████████▍| 349503/371472 [5:39:12<1:35:00,  3.85it/s]
 94%|█████████▍| 349504/371472 [5:39:12<1:37:44,  3.75it/s]
 94%|█████████▍| 349505/371472 [5:39:12<1:46:21,  3.44it/s]
 94%|█████████▍| 349506/371472 [5:39:12<1:42:26,  3.57it/s]
 94%|█████████▍| 349507/371472 [5:39:13<1:42:48,  3.56it/s]
 94%|█████████▍| 349508/371472 [5:39:13<1:49:45,  3.34it/s]
 94%|█████████▍| 349509/371472 [5:39:13<1:45:10,  3.48it/s]
 94%|█████████▍| 349510/371472 [5:39:14<1:41:56,  3.59it/s]
 94%|█████████▍| 349511/371472 [5:39:14<1:46:26,  3.44it/s]
 94%|█████████▍| 349512/371472 [5:39:14<1:45:58,  3.45it/s]
 94%|█████████▍| 349513/371472 [5:39:14<1:41:47,  3.60it/s]
 94%|█████████▍| 349514/371472 [5:39:15<1:44:15,  3.51it/s]
 94%|█████████▍| 349515/371472 [5:39:15<1:48:19,  3.38it/s]
 94%|█████████▍| 349516/371472 [5:39:15<1:51:10,  3.29it/s]
 94%|█████████▍| 349517/371472 [5:39:16<1:46:19,  3.44it/s]
 94%|█████████▍| 349518/371472 [5:39:16<1:46:05,  3.45it/s]
 94%|█████████▍| 349519/371472 [5:39:16<1:44:19,  3.51it/s]
 94%|█████████▍| 349520/371472 [5:39:16<1:42:29,  3.57it/s]
                                                           
{'loss': 2.6381, 'learning_rate': 1.5321381628563426e-07, 'epoch': 15.05}

 94%|█████████▍| 349520/371472 [5:39:16<1:42:29,  3.57it/s]
 94%|█████████▍| 349521/371472 [5:39:17<1:45:17,  3.47it/s]
 94%|█████████▍| 349522/371472 [5:39:17<1:42:01,  3.59it/s]
 94%|█████████▍| 349523/371472 [5:39:17<1:37:12,  3.76it/s]
 94%|█████████▍| 349524/371472 [5:39:18<1:34:39,  3.86it/s]
 94%|█████████▍| 349525/371472 [5:39:18<1:34:47,  3.86it/s]
 94%|█████████▍| 349526/371472 [5:39:18<1:34:17,  3.88it/s]
 94%|█████████▍| 349527/371472 [5:39:18<1:34:50,  3.86it/s]
 94%|█████████▍| 349528/371472 [5:39:19<1:38:02,  3.73it/s]
 94%|█████████▍| 349529/371472 [5:39:19<1:38:35,  3.71it/s]
 94%|█████████▍| 349530/371472 [5:39:19<1:39:02,  3.69it/s]
 94%|█████████▍| 349531/371472 [5:39:19<1:39:35,  3.67it/s]
 94%|█████████▍| 349532/371472 [5:39:20<1:40:02,  3.65it/s]
 94%|█████████▍| 349533/371472 [5:39:20<1:40:38,  3.63it/s]
 94%|█████████▍| 349534/371472 [5:39:20<1:38:58,  3.69it/s]
 94%|█████████▍| 349535/371472 [5:39:21<1:39:35,  3.67it/s]
 94%|█████████▍| 349536/371472 [5:39:21<1:37:11,  3.76it/s]
 94%|█████████▍| 349537/371472 [5:39:21<1:36:39,  3.78it/s]
 94%|█████████▍| 349538/371472 [5:39:21<1:37:39,  3.74it/s]
 94%|█████████▍| 349539/371472 [5:39:22<1:33:16,  3.92it/s]
 94%|█████████▍| 349540/371472 [5:39:22<1:33:56,  3.89it/s]
                                                           
{'loss': 2.5839, 'learning_rate': 1.5316533431015533e-07, 'epoch': 15.06}

 94%|█████████▍| 349540/371472 [5:39:22<1:33:56,  3.89it/s]
 94%|█████████▍| 349541/371472 [5:39:22<1:35:36,  3.82it/s]
 94%|█████████▍| 349542/371472 [5:39:22<1:32:50,  3.94it/s]
 94%|█████████▍| 349543/371472 [5:39:23<1:39:21,  3.68it/s]
 94%|█████████▍| 349544/371472 [5:39:23<1:38:40,  3.70it/s]
 94%|█████████▍| 349545/371472 [5:39:23<1:39:48,  3.66it/s]
 94%|█████████▍| 349546/371472 [5:39:23<1:40:33,  3.63it/s]
 94%|█████████▍| 349547/371472 [5:39:24<1:37:42,  3.74it/s]
 94%|█████████▍| 349548/371472 [5:39:24<1:38:59,  3.69it/s]
 94%|█████████▍| 349549/371472 [5:39:24<1:45:31,  3.46it/s]
 94%|█████████▍| 349550/371472 [5:39:25<1:43:36,  3.53it/s]
 94%|█████████▍| 349551/371472 [5:39:25<1:40:13,  3.65it/s]
 94%|█████████▍| 349552/371472 [5:39:25<1:38:08,  3.72it/s]
 94%|█████████▍| 349553/371472 [5:39:25<1:38:30,  3.71it/s]
 94%|█████████▍| 349554/371472 [5:39:26<1:37:33,  3.74it/s]
 94%|█████████▍| 349555/371472 [5:39:26<1:36:54,  3.77it/s]
 94%|█████████▍| 349556/371472 [5:39:26<1:45:27,  3.46it/s]
 94%|█████████▍| 349557/371472 [5:39:26<1:42:35,  3.56it/s]
 94%|█████████▍| 349558/371472 [5:39:27<1:41:47,  3.59it/s]
 94%|█████████▍| 349559/371472 [5:39:27<1:41:42,  3.59it/s]
 94%|█████████▍| 349560/371472 [5:39:27<1:39:50,  3.66it/s]
                                                           
{'loss': 2.5019, 'learning_rate': 1.5311685233467648e-07, 'epoch': 15.06}

 94%|█████████▍| 349560/371472 [5:39:27<1:39:50,  3.66it/s]
 94%|█████████▍| 349561/371472 [5:39:28<1:39:42,  3.66it/s]
 94%|█████████▍| 349562/371472 [5:39:28<1:36:46,  3.77it/s]
 94%|█████████▍| 349563/371472 [5:39:28<1:39:10,  3.68it/s]
 94%|█████████▍| 349564/371472 [5:39:28<1:38:05,  3.72it/s]
 94%|█████████▍| 349565/371472 [5:39:29<1:41:39,  3.59it/s]
 94%|█████████▍| 349566/371472 [5:39:29<1:38:45,  3.70it/s]
 94%|█████████▍| 349567/371472 [5:39:29<1:35:58,  3.80it/s]
 94%|█████████▍| 349568/371472 [5:39:29<1:42:49,  3.55it/s]
 94%|█████████▍| 349569/371472 [5:39:30<1:43:46,  3.52it/s]
 94%|█████████▍| 349570/371472 [5:39:30<1:48:25,  3.37it/s]
 94%|█████████▍| 349571/371472 [5:39:30<1:52:24,  3.25it/s]
 94%|█████████▍| 349572/371472 [5:39:31<1:48:48,  3.35it/s]
 94%|█████████▍| 349573/371472 [5:39:31<1:52:06,  3.26it/s]
 94%|█████████▍| 349574/371472 [5:39:31<1:48:32,  3.36it/s]
 94%|█████████▍| 349575/371472 [5:39:32<1:50:55,  3.29it/s]
 94%|█████████▍| 349576/371472 [5:39:32<1:52:23,  3.25it/s]
 94%|█████████▍| 349577/371472 [5:39:32<1:47:35,  3.39it/s]
 94%|█████████▍| 349578/371472 [5:39:32<1:47:25,  3.40it/s]
 94%|█████████▍| 349579/371472 [5:39:33<1:50:20,  3.31it/s]
 94%|█████████▍| 349580/371472 [5:39:33<1:47:18,  3.40it/s]
                                                           
{'loss': 2.5579, 'learning_rate': 1.5306837035919755e-07, 'epoch': 15.06}

 94%|█████████▍| 349580/371472 [5:39:33<1:47:18,  3.40it/s]
 94%|█████████▍| 349581/371472 [5:39:33<1:49:38,  3.33it/s]
 94%|█████████▍| 349582/371472 [5:39:34<1:45:33,  3.46it/s]
 94%|█████████▍| 349583/371472 [5:39:34<1:43:13,  3.53it/s]
 94%|█████████▍| 349584/371472 [5:39:34<1:45:51,  3.45it/s]
 94%|█████████▍| 349585/371472 [5:39:35<1:58:17,  3.08it/s]
 94%|█████████▍| 349586/371472 [5:39:35<1:50:23,  3.30it/s]
 94%|█████████▍| 349587/371472 [5:39:35<1:46:31,  3.42it/s]
 94%|█████████▍| 349588/371472 [5:39:35<1:46:48,  3.42it/s]
 94%|█████████▍| 349589/371472 [5:39:36<1:45:24,  3.46it/s]
 94%|█████████▍| 349590/371472 [5:39:36<1:44:25,  3.49it/s]
 94%|█████████▍| 349591/371472 [5:39:36<1:42:34,  3.56it/s]
 94%|█████████▍| 349592/371472 [5:39:37<1:42:38,  3.55it/s]
 94%|█████████▍| 349593/371472 [5:39:37<1:44:21,  3.49it/s]
 94%|█████████▍| 349594/371472 [5:39:37<1:48:12,  3.37it/s]
 94%|█████████▍| 349595/371472 [5:39:37<1:44:49,  3.48it/s]
 94%|█████████▍| 349596/371472 [5:39:38<1:43:05,  3.54it/s]
 94%|█████████▍| 349597/371472 [5:39:38<1:41:44,  3.58it/s]
 94%|█████████▍| 349598/371472 [5:39:38<1:44:12,  3.50it/s]
 94%|█████████▍| 349599/371472 [5:39:39<1:45:36,  3.45it/s]
 94%|█████████▍| 349600/371472 [5:39:39<1:47:49,  3.38it/s]
                                                           
{'loss': 2.5047, 'learning_rate': 1.530198883837187e-07, 'epoch': 15.06}

 94%|█████████▍| 349600/371472 [5:39:39<1:47:49,  3.38it/s]
 94%|█████████▍| 349601/371472 [5:39:39<1:44:52,  3.48it/s]
 94%|█████████▍| 349602/371472 [5:39:39<1:44:20,  3.49it/s]
 94%|█████████▍| 349603/371472 [5:39:40<1:42:47,  3.55it/s]
 94%|█████████▍| 349604/371472 [5:39:40<1:46:25,  3.42it/s]
 94%|█████████▍| 349605/371472 [5:39:40<1:47:58,  3.38it/s]
 94%|█████████▍| 349606/371472 [5:39:41<1:45:08,  3.47it/s]
 94%|█████████▍| 349607/371472 [5:39:41<1:45:08,  3.47it/s]
 94%|█████████▍| 349608/371472 [5:39:41<1:40:47,  3.62it/s]
 94%|█████████▍| 349609/371472 [5:39:41<1:37:16,  3.75it/s]
 94%|█████████▍| 349610/371472 [5:39:42<1:37:51,  3.72it/s]
 94%|█████████▍| 349611/371472 [5:39:42<1:42:36,  3.55it/s]
 94%|█████████▍| 349612/371472 [5:39:42<1:46:42,  3.41it/s]
 94%|█████████▍| 349613/371472 [5:39:43<1:40:47,  3.61it/s]
 94%|█████████▍| 349614/371472 [5:39:43<1:43:02,  3.54it/s]
 94%|█████████▍| 349615/371472 [5:39:43<1:37:34,  3.73it/s]
 94%|█████████▍| 349616/371472 [5:39:43<1:41:33,  3.59it/s]
 94%|█████████▍| 349617/371472 [5:39:44<1:40:37,  3.62it/s]
 94%|█████████▍| 349618/371472 [5:39:44<1:43:33,  3.52it/s]
 94%|█████████▍| 349619/371472 [5:39:44<1:48:20,  3.36it/s]
 94%|█████████▍| 349620/371472 [5:39:45<1:42:28,  3.55it/s]
                                                           
{'loss': 2.6704, 'learning_rate': 1.5297140640823975e-07, 'epoch': 15.06}

 94%|█████████▍| 349620/371472 [5:39:45<1:42:28,  3.55it/s]
 94%|█████████▍| 349621/371472 [5:39:45<1:38:57,  3.68it/s]
 94%|█████████▍| 349622/371472 [5:39:45<1:44:31,  3.48it/s]
 94%|█████████▍| 349623/371472 [5:39:45<1:46:56,  3.41it/s]
 94%|█████████▍| 349624/371472 [5:39:46<1:44:53,  3.47it/s]
 94%|█████████▍| 349625/371472 [5:39:46<1:49:01,  3.34it/s]
 94%|█████████▍| 349626/371472 [5:39:46<1:47:16,  3.39it/s]
 94%|█████████▍| 349627/371472 [5:39:47<1:42:04,  3.57it/s]
 94%|█████████▍| 349628/371472 [5:39:47<1:49:06,  3.34it/s]
 94%|█████████▍| 349629/371472 [5:39:47<1:53:32,  3.21it/s]
 94%|█████████▍| 349630/371472 [5:39:48<1:48:47,  3.35it/s]
 94%|█████████▍| 349631/371472 [5:39:48<1:45:55,  3.44it/s]
 94%|█████████▍| 349632/371472 [5:39:48<1:44:18,  3.49it/s]
 94%|█████████▍| 349633/371472 [5:39:48<1:41:59,  3.57it/s]
 94%|█████████▍| 349634/371472 [5:39:49<1:43:48,  3.51it/s]
 94%|█████████▍| 349635/371472 [5:39:49<1:41:15,  3.59it/s]
 94%|█████████▍| 349636/371472 [5:39:49<1:40:41,  3.61it/s]
 94%|█████████▍| 349637/371472 [5:39:49<1:37:38,  3.73it/s]
 94%|█████████▍| 349638/371472 [5:39:50<1:41:16,  3.59it/s]
 94%|█████████▍| 349639/371472 [5:39:50<1:43:20,  3.52it/s]
 94%|█████████▍| 349640/371472 [5:39:50<1:39:28,  3.66it/s]
                                                           
{'loss': 2.5967, 'learning_rate': 1.5292292443276093e-07, 'epoch': 15.06}

 94%|█████████▍| 349640/371472 [5:39:50<1:39:28,  3.66it/s]
 94%|█████████▍| 349641/371472 [5:39:50<1:37:29,  3.73it/s]
 94%|█████████▍| 349642/371472 [5:39:51<1:42:06,  3.56it/s]
 94%|█████████▍| 349643/371472 [5:39:51<1:43:16,  3.52it/s]
 94%|█████████▍| 349644/371472 [5:39:51<1:44:55,  3.47it/s]
 94%|█████████▍| 349645/371472 [5:39:52<1:39:34,  3.65it/s]
 94%|█████████▍| 349646/371472 [5:39:52<1:37:05,  3.75it/s]
 94%|█████████▍| 349647/371472 [5:39:52<1:45:20,  3.45it/s]
 94%|█████████▍| 349648/371472 [5:39:53<1:44:20,  3.49it/s]
 94%|█████████▍| 349649/371472 [5:39:53<1:45:30,  3.45it/s]
 94%|█████████▍| 349650/371472 [5:39:53<1:43:43,  3.51it/s]
 94%|█████████▍| 349651/371472 [5:39:53<1:42:31,  3.55it/s]
 94%|█████████▍| 349652/371472 [5:39:54<1:38:25,  3.69it/s]
 94%|█████████▍| 349653/371472 [5:39:54<1:49:33,  3.32it/s]
 94%|█████████▍| 349654/371472 [5:39:54<1:47:52,  3.37it/s]
 94%|█████████▍| 349655/371472 [5:39:55<1:47:22,  3.39it/s]
 94%|█████████▍| 349656/371472 [5:39:55<1:46:26,  3.42it/s]
 94%|█████████▍| 349657/371472 [5:39:55<1:47:48,  3.37it/s]
 94%|█████████▍| 349658/371472 [5:39:55<1:47:51,  3.37it/s]
 94%|█████████▍| 349659/371472 [5:39:56<1:43:36,  3.51it/s]
 94%|█████████▍| 349660/371472 [5:39:56<1:46:39,  3.41it/s]
                                                           
{'loss': 2.622, 'learning_rate': 1.5287444245728197e-07, 'epoch': 15.06}

 94%|█████████▍| 349660/371472 [5:39:56<1:46:39,  3.41it/s]
 94%|█████████▍| 349661/371472 [5:39:56<1:44:37,  3.47it/s]
 94%|█████████▍| 349662/371472 [5:39:57<1:42:46,  3.54it/s]
 94%|█████████▍| 349663/371472 [5:39:57<1:39:45,  3.64it/s]
 94%|█████████▍| 349664/371472 [5:39:57<1:39:55,  3.64it/s]
 94%|█████████▍| 349665/371472 [5:39:57<1:40:40,  3.61it/s]
 94%|█████████▍| 349666/371472 [5:39:58<1:39:32,  3.65it/s]
 94%|█████████▍| 349667/371472 [5:39:58<1:37:45,  3.72it/s]
 94%|█████████▍| 349668/371472 [5:39:58<1:38:27,  3.69it/s]
 94%|█████████▍| 349669/371472 [5:39:59<1:45:31,  3.44it/s]
 94%|█████████▍| 349670/371472 [5:39:59<1:47:36,  3.38it/s]
 94%|█████████▍| 349671/371472 [5:39:59<1:42:25,  3.55it/s]
 94%|█████████▍| 349672/371472 [5:39:59<1:39:40,  3.65it/s]
 94%|█████████▍| 349673/371472 [5:40:00<1:41:45,  3.57it/s]
 94%|█████████▍| 349674/371472 [5:40:00<1:51:10,  3.27it/s]
 94%|█████████▍| 349675/371472 [5:40:00<1:45:28,  3.44it/s]
 94%|█████████▍| 349676/371472 [5:40:01<1:45:05,  3.46it/s]
 94%|█████████▍| 349677/371472 [5:40:01<1:42:37,  3.54it/s]
 94%|█████████▍| 349678/371472 [5:40:01<1:56:03,  3.13it/s]
 94%|█████████▍| 349679/371472 [5:40:01<1:49:05,  3.33it/s]
 94%|█████████▍| 349680/371472 [5:40:02<1:45:17,  3.45it/s]
                                                           
{'loss': 2.5388, 'learning_rate': 1.5282596048180312e-07, 'epoch': 15.06}

 94%|█████████▍| 349680/371472 [5:40:02<1:45:17,  3.45it/s]
 94%|█████████▍| 349681/371472 [5:40:02<1:44:21,  3.48it/s]
 94%|█████████▍| 349682/371472 [5:40:02<1:47:42,  3.37it/s]
 94%|█████████▍| 349683/371472 [5:40:03<1:56:54,  3.11it/s]
 94%|█████████▍| 349684/371472 [5:40:03<1:48:52,  3.34it/s]
 94%|█████████▍| 349685/371472 [5:40:03<1:43:20,  3.51it/s]
 94%|█████████▍| 349686/371472 [5:40:03<1:41:56,  3.56it/s]
 94%|█████████▍| 349687/371472 [5:40:04<1:38:36,  3.68it/s]
 94%|█████████▍| 349688/371472 [5:40:04<1:41:40,  3.57it/s]
 94%|█████████▍| 349689/371472 [5:40:04<1:43:10,  3.52it/s]
 94%|█████████▍| 349690/371472 [5:40:05<1:42:17,  3.55it/s]
 94%|█████████▍| 349691/371472 [5:40:05<1:42:28,  3.54it/s]
 94%|█████████▍| 349692/371472 [5:40:05<1:42:03,  3.56it/s]
 94%|█████████▍| 349693/371472 [5:40:05<1:46:02,  3.42it/s]
 94%|█████████▍| 349694/371472 [5:40:06<1:41:46,  3.57it/s]
 94%|█████████▍| 349695/371472 [5:40:06<1:42:10,  3.55it/s]
 94%|█████████▍| 349696/371472 [5:40:06<1:44:54,  3.46it/s]
 94%|█████████▍| 349697/371472 [5:40:07<1:49:43,  3.31it/s]
 94%|█████████▍| 349698/371472 [5:40:07<1:46:24,  3.41it/s]
 94%|█████████▍| 349699/371472 [5:40:07<1:47:21,  3.38it/s]
 94%|█████████▍| 349700/371472 [5:40:07<1:41:36,  3.57it/s]
                                                           
{'loss': 2.6993, 'learning_rate': 1.527774785063242e-07, 'epoch': 15.06}

 94%|█████████▍| 349700/371472 [5:40:07<1:41:36,  3.57it/s]
 94%|█████████▍| 349701/371472 [5:40:08<1:46:39,  3.40it/s]
 94%|█████████▍| 349702/371472 [5:40:08<1:42:50,  3.53it/s]
 94%|█████████▍| 349703/371472 [5:40:08<1:41:54,  3.56it/s]
 94%|█████████▍| 349704/371472 [5:40:09<1:44:50,  3.46it/s]
 94%|█████████▍| 349705/371472 [5:40:09<1:56:04,  3.13it/s]
 94%|█████████▍| 349706/371472 [5:40:09<1:57:35,  3.08it/s]
 94%|█████████▍| 349707/371472 [5:40:10<1:58:16,  3.07it/s]
 94%|█████████▍| 349708/371472 [5:40:10<1:51:57,  3.24it/s]
 94%|█████████▍| 349709/371472 [5:40:10<1:50:28,  3.28it/s]
 94%|█████████▍| 349710/371472 [5:40:11<1:44:47,  3.46it/s]
 94%|█████████▍| 349711/371472 [5:40:11<1:42:05,  3.55it/s]
 94%|█████████▍| 349712/371472 [5:40:11<1:41:46,  3.56it/s]
 94%|█████████▍| 349713/371472 [5:40:11<1:40:25,  3.61it/s]
 94%|█████████▍| 349714/371472 [5:40:12<1:41:15,  3.58it/s]
 94%|█████████▍| 349715/371472 [5:40:12<1:42:02,  3.55it/s]
 94%|█████████▍| 349716/371472 [5:40:12<1:39:19,  3.65it/s]
 94%|█████████▍| 349717/371472 [5:40:12<1:38:42,  3.67it/s]
 94%|█████████▍| 349718/371472 [5:40:13<1:45:40,  3.43it/s]
 94%|█████████▍| 349719/371472 [5:40:13<1:47:34,  3.37it/s]
 94%|█████████▍| 349720/371472 [5:40:13<1:51:42,  3.25it/s]
                                                           
{'loss': 2.538, 'learning_rate': 1.5272899653084534e-07, 'epoch': 15.06}

 94%|█████████▍| 349720/371472 [5:40:13<1:51:42,  3.25it/s]
 94%|█████████▍| 349721/371472 [5:40:14<1:45:23,  3.44it/s]
 94%|█████████▍| 349722/371472 [5:40:14<1:48:14,  3.35it/s]
 94%|█████████▍| 349723/371472 [5:40:14<1:50:09,  3.29it/s]
 94%|█████████▍| 349724/371472 [5:40:15<1:46:54,  3.39it/s]
 94%|█████████▍| 349725/371472 [5:40:15<1:46:02,  3.42it/s]
 94%|█████████▍| 349726/371472 [5:40:15<1:44:58,  3.45it/s]
 94%|█████████▍| 349727/371472 [5:40:15<1:40:29,  3.61it/s]
 94%|█████████▍| 349728/371472 [5:40:16<1:38:47,  3.67it/s]
 94%|█████████▍| 349729/371472 [5:40:16<1:41:47,  3.56it/s]
 94%|█████████▍| 349730/371472 [5:40:16<1:44:11,  3.48it/s]
 94%|█████████▍| 349731/371472 [5:40:16<1:39:51,  3.63it/s]
 94%|█████████▍| 349732/371472 [5:40:17<1:37:19,  3.72it/s]
 94%|█████████▍| 349733/371472 [5:40:17<1:37:24,  3.72it/s]
 94%|█████████▍| 349734/371472 [5:40:17<1:37:39,  3.71it/s]
 94%|█████████▍| 349735/371472 [5:40:18<1:40:22,  3.61it/s]
 94%|█████████▍| 349736/371472 [5:40:18<1:42:14,  3.54it/s]
 94%|█████████▍| 349737/371472 [5:40:18<1:40:19,  3.61it/s]
 94%|█████████▍| 349738/371472 [5:40:18<1:42:07,  3.55it/s]
 94%|█████████▍| 349739/371472 [5:40:19<1:41:57,  3.55it/s]
 94%|█████████▍| 349740/371472 [5:40:19<1:39:23,  3.64it/s]
                                                           
{'loss': 2.6006, 'learning_rate': 1.526805145553664e-07, 'epoch': 15.06}

 94%|█████████▍| 349740/371472 [5:40:19<1:39:23,  3.64it/s]
 94%|█████████▍| 349741/371472 [5:40:19<1:37:38,  3.71it/s]
 94%|█████████▍| 349742/371472 [5:40:19<1:36:49,  3.74it/s]
 94%|█████████▍| 349743/371472 [5:40:20<1:46:06,  3.41it/s]
 94%|█████████▍| 349744/371472 [5:40:20<1:50:21,  3.28it/s]
 94%|█████████▍| 349745/371472 [5:40:21<1:56:14,  3.12it/s]
 94%|█████████▍| 349746/371472 [5:40:21<1:47:11,  3.38it/s]
 94%|█████████▍| 349747/371472 [5:40:21<1:43:10,  3.51it/s]
 94%|█████████▍| 349748/371472 [5:40:21<1:45:39,  3.43it/s]
 94%|█████████▍| 349749/371472 [5:40:22<1:45:02,  3.45it/s]
 94%|█████████▍| 349750/371472 [5:40:22<1:40:27,  3.60it/s]
 94%|█████████▍| 349751/371472 [5:40:22<1:40:59,  3.58it/s]
 94%|█████████▍| 349752/371472 [5:40:23<1:55:54,  3.12it/s]
 94%|█████████▍| 349753/371472 [5:40:23<1:51:26,  3.25it/s]
 94%|█████████▍| 349754/371472 [5:40:23<1:46:59,  3.38it/s]
 94%|█████████▍| 349755/371472 [5:40:23<1:47:43,  3.36it/s]
 94%|█████████▍| 349756/371472 [5:40:24<1:42:39,  3.53it/s]
 94%|█████████▍| 349757/371472 [5:40:24<1:52:41,  3.21it/s]
 94%|█████████▍| 349758/371472 [5:40:24<1:57:19,  3.08it/s]
 94%|█████████▍| 349759/371472 [5:40:25<1:50:21,  3.28it/s]
 94%|█████████▍| 349760/371472 [5:40:25<1:50:58,  3.26it/s]
                                                           
{'loss': 2.6051, 'learning_rate': 1.5263203257988757e-07, 'epoch': 15.06}

 94%|█████████▍| 349760/371472 [5:40:25<1:50:58,  3.26it/s]
 94%|█████████▍| 349761/371472 [5:40:25<1:46:23,  3.40it/s]
 94%|█████████▍| 349762/371472 [5:40:26<1:45:25,  3.43it/s]
 94%|█████████▍| 349763/371472 [5:40:26<1:40:29,  3.60it/s]
 94%|█████████▍| 349764/371472 [5:40:26<1:45:55,  3.42it/s]
 94%|█████████▍| 349765/371472 [5:40:26<1:43:59,  3.48it/s]
 94%|█████████▍| 349766/371472 [5:40:27<1:40:41,  3.59it/s]
 94%|█████████▍| 349767/371472 [5:40:27<1:45:04,  3.44it/s]
 94%|█████████▍| 349768/371472 [5:40:27<1:48:12,  3.34it/s]
 94%|█████████▍| 349769/371472 [5:40:28<1:49:08,  3.31it/s]
 94%|█████████▍| 349770/371472 [5:40:28<1:43:54,  3.48it/s]
 94%|█████████▍| 349771/371472 [5:40:28<1:41:36,  3.56it/s]
 94%|█████████▍| 349772/371472 [5:40:28<1:39:54,  3.62it/s]
 94%|█████████▍| 349773/371472 [5:40:29<1:43:28,  3.49it/s]
 94%|█████████▍| 349774/371472 [5:40:29<1:41:29,  3.56it/s]
 94%|█████████▍| 349775/371472 [5:40:29<1:41:37,  3.56it/s]
 94%|█████████▍| 349776/371472 [5:40:29<1:41:32,  3.56it/s]
 94%|█████████▍| 349777/371472 [5:40:30<1:43:46,  3.48it/s]
 94%|█████████▍| 349778/371472 [5:40:30<1:42:54,  3.51it/s]
 94%|█████████▍| 349779/371472 [5:40:30<1:45:45,  3.42it/s]
 94%|█████████▍| 349780/371472 [5:40:31<1:53:28,  3.19it/s]
                                                           
{'loss': 2.5891, 'learning_rate': 1.525835506044086e-07, 'epoch': 15.07}

 94%|█████████▍| 349780/371472 [5:40:31<1:53:28,  3.19it/s]
 94%|█████████▍| 349781/371472 [5:40:31<1:48:29,  3.33it/s]
 94%|█████████▍| 349782/371472 [5:40:31<1:50:42,  3.27it/s]
 94%|█████████▍| 349783/371472 [5:40:32<1:49:27,  3.30it/s]
 94%|█████████▍| 349784/371472 [5:40:32<1:51:43,  3.24it/s]
 94%|█████████▍| 349785/371472 [5:40:32<1:54:14,  3.16it/s]
 94%|█████████▍| 349786/371472 [5:40:33<1:59:41,  3.02it/s]
 94%|█████████▍| 349787/371472 [5:40:33<1:49:32,  3.30it/s]
 94%|█████████▍| 349788/371472 [5:40:33<1:45:02,  3.44it/s]
 94%|█████████▍| 349789/371472 [5:40:33<1:45:34,  3.42it/s]
 94%|█████████▍| 349790/371472 [5:40:34<1:44:50,  3.45it/s]
 94%|█████████▍| 349791/371472 [5:40:34<1:44:32,  3.46it/s]
 94%|█████████▍| 349792/371472 [5:40:34<1:42:59,  3.51it/s]
 94%|█████████▍| 349793/371472 [5:40:35<1:42:19,  3.53it/s]
 94%|█████████▍| 349794/371472 [5:40:35<1:41:09,  3.57it/s]
 94%|█████████▍| 349795/371472 [5:40:35<1:40:50,  3.58it/s]
 94%|█████████▍| 349796/371472 [5:40:35<1:40:05,  3.61it/s]
 94%|█████████▍| 349797/371472 [5:40:36<1:39:03,  3.65it/s]
 94%|█████████▍| 349798/371472 [5:40:36<1:38:13,  3.68it/s]
 94%|█████████▍| 349799/371472 [5:40:36<1:39:38,  3.62it/s]
 94%|█████████▍| 349800/371472 [5:40:36<1:40:57,  3.58it/s]
                                                           
{'loss': 2.5886, 'learning_rate': 1.5253506862892976e-07, 'epoch': 15.07}

 94%|█████████▍| 349800/371472 [5:40:36<1:40:57,  3.58it/s]
 94%|█████████▍| 349801/371472 [5:40:37<1:37:05,  3.72it/s]
 94%|█████████▍| 349802/371472 [5:40:37<1:39:16,  3.64it/s]
 94%|█████████▍| 349803/371472 [5:40:37<1:35:51,  3.77it/s]
 94%|█████████▍| 349804/371472 [5:40:38<1:37:38,  3.70it/s]
 94%|█████████▍| 349805/371472 [5:40:38<1:41:47,  3.55it/s]
 94%|█████████▍| 349806/371472 [5:40:38<1:37:42,  3.70it/s]
 94%|█████████▍| 349807/371472 [5:40:38<1:40:09,  3.60it/s]
 94%|█████████▍| 349808/371472 [5:40:39<1:46:55,  3.38it/s]
 94%|█████████▍| 349809/371472 [5:40:39<1:47:45,  3.35it/s]
 94%|█████████▍| 349810/371472 [5:40:39<1:51:01,  3.25it/s]
 94%|█████████▍| 349811/371472 [5:40:40<1:46:04,  3.40it/s]
 94%|█████████▍| 349812/371472 [5:40:40<1:40:24,  3.60it/s]
 94%|█████████▍| 349813/371472 [5:40:40<1:41:07,  3.57it/s]
 94%|█████████▍| 349814/371472 [5:40:40<1:39:56,  3.61it/s]
 94%|█████████▍| 349815/371472 [5:40:41<1:41:41,  3.55it/s]
 94%|█████████▍| 349816/371472 [5:40:41<1:43:29,  3.49it/s]
 94%|█████████▍| 349817/371472 [5:40:41<1:46:20,  3.39it/s]
 94%|█████████▍| 349818/371472 [5:40:42<1:49:47,  3.29it/s]
 94%|█████████▍| 349819/371472 [5:40:42<1:45:54,  3.41it/s]
 94%|█████████▍| 349820/371472 [5:40:42<1:53:32,  3.18it/s]
                                                           
{'loss': 2.5356, 'learning_rate': 1.5248658665345083e-07, 'epoch': 15.07}

 94%|█████████▍| 349820/371472 [5:40:42<1:53:32,  3.18it/s]
 94%|█████████▍| 349821/371472 [5:40:43<1:47:37,  3.35it/s]
 94%|█████████▍| 349822/371472 [5:40:43<1:55:32,  3.12it/s]
 94%|█████████▍| 349823/371472 [5:40:43<1:52:58,  3.19it/s]
 94%|█████████▍| 349824/371472 [5:40:44<1:50:42,  3.26it/s]
 94%|█████████▍| 349825/371472 [5:40:44<1:50:28,  3.27it/s]
 94%|█████████▍| 349826/371472 [5:40:44<1:47:04,  3.37it/s]
 94%|█████████▍| 349827/371472 [5:40:44<1:41:34,  3.55it/s]
 94%|█████████▍| 349828/371472 [5:40:45<1:40:56,  3.57it/s]
 94%|█████████▍| 349829/371472 [5:40:45<1:42:42,  3.51it/s]
 94%|█████████▍| 349830/371472 [5:40:45<1:39:08,  3.64it/s]
 94%|█████████▍| 349831/371472 [5:40:45<1:35:45,  3.77it/s]
 94%|█████████▍| 349832/371472 [5:40:46<1:37:56,  3.68it/s]
 94%|█████████▍| 349833/371472 [5:40:46<1:47:10,  3.37it/s]
 94%|█████████▍| 349834/371472 [5:40:46<1:44:56,  3.44it/s]
 94%|█████████▍| 349835/371472 [5:40:47<1:40:08,  3.60it/s]
 94%|█████████▍| 349836/371472 [5:40:47<1:38:21,  3.67it/s]
 94%|█████████▍| 349837/371472 [5:40:47<1:35:52,  3.76it/s]
 94%|█████████▍| 349838/371472 [5:40:47<1:35:00,  3.80it/s]
 94%|█████████▍| 349839/371472 [5:40:48<1:31:39,  3.93it/s]
 94%|█████████▍| 349840/371472 [5:40:48<1:33:48,  3.84it/s]
                                                           
{'loss': 2.5449, 'learning_rate': 1.524381046779719e-07, 'epoch': 15.07}

 94%|█████████▍| 349840/371472 [5:40:48<1:33:48,  3.84it/s]
 94%|█████████▍| 349841/371472 [5:40:48<1:32:13,  3.91it/s]
 94%|█████████▍| 349842/371472 [5:40:48<1:32:19,  3.90it/s]
 94%|█████████▍| 349843/371472 [5:40:49<1:39:51,  3.61it/s]
 94%|█████████▍| 349844/371472 [5:40:49<1:36:48,  3.72it/s]
 94%|█████████▍| 349845/371472 [5:40:49<1:36:44,  3.73it/s]
 94%|█████████▍| 349846/371472 [5:40:49<1:35:58,  3.76it/s]
 94%|█████████▍| 349847/371472 [5:40:50<1:36:14,  3.75it/s]
 94%|█████████▍| 349848/371472 [5:40:50<1:43:22,  3.49it/s]
 94%|█████████▍| 349849/371472 [5:40:50<1:45:39,  3.41it/s]
 94%|█████████▍| 349850/371472 [5:40:51<1:44:44,  3.44it/s]
 94%|█████████▍| 349851/371472 [5:40:51<1:44:47,  3.44it/s]
 94%|█████████▍| 349852/371472 [5:40:51<1:45:01,  3.43it/s]
 94%|█████████▍| 349853/371472 [5:40:52<1:51:52,  3.22it/s]
 94%|█████████▍| 349854/371472 [5:40:52<1:52:16,  3.21it/s]
 94%|█████████▍| 349855/371472 [5:40:52<1:45:19,  3.42it/s]
 94%|█████████▍| 349856/371472 [5:40:52<1:41:37,  3.55it/s]
 94%|█████████▍| 349857/371472 [5:40:53<1:44:36,  3.44it/s]
 94%|█████████▍| 349858/371472 [5:40:53<1:45:09,  3.43it/s]
 94%|█████████▍| 349859/371472 [5:40:53<1:43:11,  3.49it/s]
 94%|█████████▍| 349860/371472 [5:40:54<1:44:52,  3.43it/s]
                                                           
{'loss': 2.8186, 'learning_rate': 1.5238962270249306e-07, 'epoch': 15.07}

 94%|█████████▍| 349860/371472 [5:40:54<1:44:52,  3.43it/s]
 94%|█████████▍| 349861/371472 [5:40:54<1:49:44,  3.28it/s]
 94%|█████████▍| 349862/371472 [5:40:54<1:46:25,  3.38it/s]
 94%|█████████▍| 349863/371472 [5:40:54<1:45:46,  3.40it/s]
 94%|█████████▍| 349864/371472 [5:40:55<1:44:44,  3.44it/s]
 94%|█████████▍| 349865/371472 [5:40:55<1:44:07,  3.46it/s]
 94%|█████████▍| 349866/371472 [5:40:55<1:42:26,  3.52it/s]
 94%|█████████▍| 349867/371472 [5:40:56<1:39:54,  3.60it/s]
 94%|█████████▍| 349868/371472 [5:40:56<1:38:52,  3.64it/s]
 94%|█████████▍| 349869/371472 [5:40:56<1:44:04,  3.46it/s]
 94%|█████████▍| 349870/371472 [5:40:56<1:45:47,  3.40it/s]
 94%|█████████▍| 349871/371472 [5:40:57<1:48:40,  3.31it/s]
 94%|█████████▍| 349872/371472 [5:40:57<1:46:10,  3.39it/s]
 94%|█████████▍| 349873/371472 [5:40:57<1:42:01,  3.53it/s]
 94%|█████████▍| 349874/371472 [5:40:58<1:38:56,  3.64it/s]
 94%|█████████▍| 349875/371472 [5:40:58<1:38:23,  3.66it/s]
 94%|█████████▍| 349876/371472 [5:40:58<1:37:29,  3.69it/s]
 94%|█████████▍| 349877/371472 [5:40:58<1:38:43,  3.65it/s]
 94%|█████████▍| 349878/371472 [5:40:59<1:38:22,  3.66it/s]
 94%|█████████▍| 349879/371472 [5:40:59<1:36:30,  3.73it/s]
 94%|█████████▍| 349880/371472 [5:40:59<1:35:27,  3.77it/s]
                                                           
{'loss': 2.6495, 'learning_rate': 1.523411407270141e-07, 'epoch': 15.07}

 94%|█████████▍| 349880/371472 [5:40:59<1:35:27,  3.77it/s]
 94%|█████████▍| 349881/371472 [5:41:00<1:44:52,  3.43it/s]
 94%|█████████▍| 349882/371472 [5:41:00<1:43:11,  3.49it/s]
 94%|█████████▍| 349883/371472 [5:41:00<1:47:56,  3.33it/s]
 94%|█████████▍| 349884/371472 [5:41:00<1:44:46,  3.43it/s]
 94%|█████████▍| 349885/371472 [5:41:01<1:52:13,  3.21it/s]
 94%|█████████▍| 349886/371472 [5:41:01<1:59:13,  3.02it/s]
 94%|█████████▍| 349887/371472 [5:41:01<1:53:54,  3.16it/s]
 94%|█████████▍| 349888/371472 [5:41:02<1:52:30,  3.20it/s]
 94%|█████████▍| 349889/371472 [5:41:02<2:07:30,  2.82it/s]
 94%|█████████▍| 349890/371472 [5:41:02<1:57:54,  3.05it/s]
 94%|█████████▍| 349891/371472 [5:41:03<1:50:44,  3.25it/s]
 94%|█████████▍| 349892/371472 [5:41:03<1:43:04,  3.49it/s]
 94%|█████████▍| 349893/371472 [5:41:03<1:40:57,  3.56it/s]
 94%|█████████▍| 349894/371472 [5:41:04<1:43:30,  3.47it/s]
 94%|█████████▍| 349895/371472 [5:41:04<1:51:02,  3.24it/s]
 94%|█████████▍| 349896/371472 [5:41:04<1:50:01,  3.27it/s]
 94%|█████████▍| 349897/371472 [5:41:04<1:47:38,  3.34it/s]
 94%|█████████▍| 349898/371472 [5:41:05<1:45:46,  3.40it/s]
 94%|█████████▍| 349899/371472 [5:41:05<1:43:46,  3.46it/s]
 94%|█████████▍| 349900/371472 [5:41:05<1:40:28,  3.58it/s]
                                                           
{'loss': 2.5028, 'learning_rate': 1.5229265875153528e-07, 'epoch': 15.07}

 94%|█████████▍| 349900/371472 [5:41:05<1:40:28,  3.58it/s]
 94%|█████████▍| 349901/371472 [5:41:06<1:45:19,  3.41it/s]
 94%|█████████▍| 349902/371472 [5:41:06<1:58:27,  3.03it/s]
 94%|█████████▍| 349903/371472 [5:41:06<1:53:13,  3.17it/s]
 94%|█████████▍| 349904/371472 [5:41:07<1:49:54,  3.27it/s]
 94%|█████████▍| 349905/371472 [5:41:07<1:46:51,  3.36it/s]
 94%|█████████▍| 349906/371472 [5:41:07<1:44:53,  3.43it/s]
 94%|█████████▍| 349907/371472 [5:41:07<1:40:23,  3.58it/s]
 94%|█████████▍| 349908/371472 [5:41:08<1:39:09,  3.62it/s]
 94%|█████████▍| 349909/371472 [5:41:08<1:39:14,  3.62it/s]
 94%|█████████▍| 349910/371472 [5:41:08<1:42:54,  3.49it/s]
 94%|█████████▍| 349911/371472 [5:41:09<1:42:55,  3.49it/s]
 94%|█████████▍| 349912/371472 [5:41:09<1:41:24,  3.54it/s]
 94%|█████████▍| 349913/371472 [5:41:09<1:46:43,  3.37it/s]
 94%|█████████▍| 349914/371472 [5:41:09<1:48:42,  3.31it/s]
 94%|█████████▍| 349915/371472 [5:41:10<1:45:21,  3.41it/s]
 94%|█████████▍| 349916/371472 [5:41:10<1:41:48,  3.53it/s]
 94%|█████████▍| 349917/371472 [5:41:10<1:40:55,  3.56it/s]
 94%|█████████▍| 349918/371472 [5:41:11<1:47:51,  3.33it/s]
 94%|█████████▍| 349919/371472 [5:41:11<1:42:30,  3.50it/s]
 94%|█████████▍| 349920/371472 [5:41:11<1:43:13,  3.48it/s]
                                                           
{'loss': 2.5592, 'learning_rate': 1.5224417677605632e-07, 'epoch': 15.07}

 94%|█████████▍| 349920/371472 [5:41:11<1:43:13,  3.48it/s]
 94%|█████████▍| 349921/371472 [5:41:11<1:44:51,  3.43it/s]
 94%|█████████▍| 349922/371472 [5:41:12<1:58:01,  3.04it/s]
 94%|█████████▍| 349923/371472 [5:41:12<2:02:07,  2.94it/s]
 94%|█████████▍| 349924/371472 [5:41:13<1:55:15,  3.12it/s]
 94%|█████████▍| 349925/371472 [5:41:13<1:49:39,  3.27it/s]
 94%|█████████▍| 349926/371472 [5:41:13<1:43:49,  3.46it/s]
 94%|█████████▍| 349927/371472 [5:41:13<1:41:48,  3.53it/s]
 94%|█████████▍| 349928/371472 [5:41:14<1:41:02,  3.55it/s]
 94%|█████████▍| 349929/371472 [5:41:14<1:44:35,  3.43it/s]
 94%|█████████▍| 349930/371472 [5:41:14<1:46:28,  3.37it/s]
 94%|█████████▍| 349931/371472 [5:41:14<1:41:20,  3.54it/s]
 94%|█████████▍| 349932/371472 [5:41:15<1:42:04,  3.52it/s]
 94%|█████████▍| 349933/371472 [5:41:15<1:44:24,  3.44it/s]
 94%|█████████▍| 349934/371472 [5:41:15<1:56:02,  3.09it/s]
 94%|█████████▍| 349935/371472 [5:41:16<1:52:09,  3.20it/s]
 94%|█████████▍| 349936/371472 [5:41:16<1:46:23,  3.37it/s]
 94%|█████████▍| 349937/371472 [5:41:16<1:45:04,  3.42it/s]
 94%|█████████▍| 349938/371472 [5:41:17<1:41:07,  3.55it/s]
 94%|█████████▍| 349939/371472 [5:41:17<1:45:24,  3.40it/s]
 94%|█████████▍| 349940/371472 [5:41:17<1:46:44,  3.36it/s]
                                                           
{'loss': 2.5802, 'learning_rate': 1.5219569480057748e-07, 'epoch': 15.07}

 94%|█████████▍| 349940/371472 [5:41:17<1:46:44,  3.36it/s]
 94%|█████████▍| 349941/371472 [5:41:17<1:44:35,  3.43it/s]
 94%|█████████▍| 349942/371472 [5:41:18<1:40:11,  3.58it/s]
 94%|█████████▍| 349943/371472 [5:41:18<1:42:09,  3.51it/s]
 94%|█████████▍| 349944/371472 [5:41:18<1:47:11,  3.35it/s]
 94%|█████████▍| 349945/371472 [5:41:19<1:43:03,  3.48it/s]
 94%|█████████▍| 349946/371472 [5:41:19<1:38:55,  3.63it/s]
 94%|█████████▍| 349947/371472 [5:41:19<1:39:49,  3.59it/s]
 94%|█████████▍| 349948/371472 [5:41:19<1:43:46,  3.46it/s]
 94%|█████████▍| 349949/371472 [5:41:20<1:43:27,  3.47it/s]
 94%|█████████▍| 349950/371472 [5:41:20<1:44:02,  3.45it/s]
 94%|█████████▍| 349951/371472 [5:41:20<1:40:02,  3.59it/s]
 94%|█████████▍| 349952/371472 [5:41:21<1:36:13,  3.73it/s]
 94%|█████████▍| 349953/371472 [5:41:21<1:46:09,  3.38it/s]
 94%|█████████▍| 349954/371472 [5:41:21<1:42:52,  3.49it/s]
 94%|█████████▍| 349955/371472 [5:41:21<1:38:17,  3.65it/s]
 94%|█████████▍| 349956/371472 [5:41:22<1:43:37,  3.46it/s]
 94%|█████████▍| 349957/371472 [5:41:22<1:41:15,  3.54it/s]
 94%|█████████▍| 349958/371472 [5:41:22<1:38:26,  3.64it/s]
 94%|█████████▍| 349959/371472 [5:41:23<1:40:36,  3.56it/s]
 94%|█████████▍| 349960/371472 [5:41:23<1:41:05,  3.55it/s]
                                                           
{'loss': 2.528, 'learning_rate': 1.5214721282509855e-07, 'epoch': 15.07}

 94%|█████████▍| 349960/371472 [5:41:23<1:41:05,  3.55it/s]
 94%|█████████▍| 349961/371472 [5:41:23<1:37:52,  3.66it/s]
 94%|█████████▍| 349962/371472 [5:41:23<1:53:06,  3.17it/s]
 94%|█████████▍| 349963/371472 [5:41:24<1:47:57,  3.32it/s]
 94%|█████████▍| 349964/371472 [5:41:24<1:55:12,  3.11it/s]
 94%|█████████▍| 349965/371472 [5:41:24<1:49:51,  3.26it/s]
 94%|█████████▍| 349966/371472 [5:41:25<1:42:57,  3.48it/s]
 94%|█████████▍| 349967/371472 [5:41:25<1:43:09,  3.47it/s]
 94%|█████████▍| 349968/371472 [5:41:25<1:39:19,  3.61it/s]
 94%|█████████▍| 349969/371472 [5:41:25<1:44:26,  3.43it/s]
 94%|█████████▍| 349970/371472 [5:41:26<1:40:57,  3.55it/s]
 94%|█████████▍| 349971/371472 [5:41:26<1:45:27,  3.40it/s]
 94%|█████████▍| 349972/371472 [5:41:26<1:41:20,  3.54it/s]
 94%|█████████▍| 349973/371472 [5:41:27<1:39:10,  3.61it/s]
 94%|█████████▍| 349974/371472 [5:41:27<1:38:22,  3.64it/s]
 94%|█████████▍| 349975/371472 [5:41:27<1:36:41,  3.71it/s]
 94%|█████████▍| 349976/371472 [5:41:27<1:34:20,  3.80it/s]
 94%|█████████▍| 349977/371472 [5:41:28<1:34:09,  3.80it/s]
 94%|█████████▍| 349978/371472 [5:41:28<1:35:29,  3.75it/s]
 94%|█████████▍| 349979/371472 [5:41:28<1:33:57,  3.81it/s]
 94%|█████████▍| 349980/371472 [5:41:28<1:32:08,  3.89it/s]
                                                           
{'loss': 2.5758, 'learning_rate': 1.520987308496197e-07, 'epoch': 15.07}

 94%|█████████▍| 349980/371472 [5:41:28<1:32:08,  3.89it/s]
 94%|█████████▍| 349981/371472 [5:41:29<1:41:35,  3.53it/s]
 94%|█████████▍| 349982/371472 [5:41:29<1:44:38,  3.42it/s]
 94%|█████████▍| 349983/371472 [5:41:29<1:49:32,  3.27it/s]
 94%|█████████▍| 349984/371472 [5:41:30<1:47:33,  3.33it/s]
 94%|█████████▍| 349985/371472 [5:41:30<1:50:37,  3.24it/s]
 94%|█████████▍| 349986/371472 [5:41:30<1:51:11,  3.22it/s]
 94%|█████████▍| 349987/371472 [5:41:31<1:48:00,  3.32it/s]
 94%|█████████▍| 349988/371472 [5:41:31<1:44:49,  3.42it/s]
 94%|█████████▍| 349989/371472 [5:41:31<1:40:31,  3.56it/s]
 94%|█████████▍| 349990/371472 [5:41:31<1:44:51,  3.41it/s]
 94%|█████████▍| 349991/371472 [5:41:32<1:52:48,  3.17it/s]
 94%|█████████▍| 349992/371472 [5:41:32<1:50:22,  3.24it/s]
 94%|█████████▍| 349993/371472 [5:41:32<1:49:27,  3.27it/s]
 94%|█████████▍| 349994/371472 [5:41:33<1:44:32,  3.42it/s]
 94%|█████████▍| 349995/371472 [5:41:33<1:41:45,  3.52it/s]
 94%|█████████▍| 349996/371472 [5:41:33<1:38:52,  3.62it/s]
 94%|█████████▍| 349997/371472 [5:41:34<2:05:47,  2.85it/s]
 94%|█████████▍| 349998/371472 [5:41:34<1:56:06,  3.08it/s]
 94%|█████████▍| 349999/371472 [5:41:34<1:56:51,  3.06it/s]
 94%|█████████▍| 350000/371472 [5:41:35<1:48:24,  3.30it/s]
                                                           
{'loss': 2.5553, 'learning_rate': 1.5205024887414074e-07, 'epoch': 15.08}

 94%|█████████▍| 350000/371472 [5:41:35<1:48:24,  3.30it/s]
 94%|█████████▍| 350001/371472 [5:41:35<1:51:21,  3.21it/s]
 94%|█████████▍| 350002/371472 [5:41:35<1:44:54,  3.41it/s]
 94%|█████████▍| 350003/371472 [5:41:35<1:42:40,  3.48it/s]
 94%|█████████▍| 350004/371472 [5:41:36<1:39:27,  3.60it/s]
 94%|█████████▍| 350005/371472 [5:41:36<1:46:41,  3.35it/s]
 94%|█████████▍| 350006/371472 [5:41:36<1:43:11,  3.47it/s]
 94%|█████████▍| 350007/371472 [5:41:37<1:40:15,  3.57it/s]
 94%|█████████▍| 350008/371472 [5:41:37<1:38:43,  3.62it/s]
 94%|█████████▍| 350009/371472 [5:41:37<1:36:44,  3.70it/s]
 94%|█████████▍| 350010/371472 [5:41:37<1:35:51,  3.73it/s]
 94%|█████████▍| 350011/371472 [5:41:38<1:38:42,  3.62it/s]
 94%|█████████▍| 350012/371472 [5:41:38<1:38:31,  3.63it/s]
 94%|█████████▍| 350013/371472 [5:41:38<1:46:14,  3.37it/s]
 94%|█████████▍| 350014/371472 [5:41:39<1:49:47,  3.26it/s]
 94%|█████████▍| 350015/371472 [5:41:39<1:42:40,  3.48it/s]
 94%|█████████▍| 350016/371472 [5:41:39<1:49:18,  3.27it/s]
 94%|█████████▍| 350017/371472 [5:41:39<1:45:07,  3.40it/s]
 94%|█████████▍| 350018/371472 [5:41:40<1:41:14,  3.53it/s]
 94%|█████████▍| 350019/371472 [5:41:40<1:42:16,  3.50it/s]
 94%|█████████▍| 350020/371472 [5:41:40<1:42:38,  3.48it/s]
                                                           
{'loss': 2.4453, 'learning_rate': 1.5200176689866192e-07, 'epoch': 15.08}

 94%|█████████▍| 350020/371472 [5:41:40<1:42:38,  3.48it/s]
 94%|█████████▍| 350021/371472 [5:41:41<1:49:59,  3.25it/s]
 94%|█████████▍| 350022/371472 [5:41:41<1:50:53,  3.22it/s]
 94%|█████████▍| 350023/371472 [5:41:41<1:48:30,  3.29it/s]
 94%|█████████▍| 350024/371472 [5:41:41<1:43:20,  3.46it/s]
 94%|█████████▍| 350025/371472 [5:41:42<1:39:50,  3.58it/s]
 94%|█████████▍| 350026/371472 [5:41:42<1:42:18,  3.49it/s]
 94%|█████████▍| 350027/371472 [5:41:42<1:43:08,  3.47it/s]
 94%|█████████▍| 350028/371472 [5:41:43<1:41:36,  3.52it/s]
 94%|█████████▍| 350029/371472 [5:41:43<1:40:49,  3.54it/s]
 94%|█████████▍| 350030/371472 [5:41:43<1:45:56,  3.37it/s]
 94%|█████████▍| 350031/371472 [5:41:44<1:44:19,  3.43it/s]
 94%|█████████▍| 350032/371472 [5:41:44<1:47:24,  3.33it/s]
 94%|█████████▍| 350033/371472 [5:41:44<1:47:24,  3.33it/s]
 94%|█████████▍| 350034/371472 [5:41:44<1:50:35,  3.23it/s]
 94%|█████████▍| 350035/371472 [5:41:45<1:44:50,  3.41it/s]
 94%|█████████▍| 350036/371472 [5:41:45<1:44:07,  3.43it/s]
 94%|█████████▍| 350037/371472 [5:41:45<1:41:47,  3.51it/s]
 94%|█████████▍| 350038/371472 [5:41:46<1:41:11,  3.53it/s]
 94%|█████████▍| 350039/371472 [5:41:46<1:40:15,  3.56it/s]
 94%|█████████▍| 350040/371472 [5:41:46<1:41:25,  3.52it/s]
                                                           
{'loss': 2.5895, 'learning_rate': 1.5195328492318296e-07, 'epoch': 15.08}

 94%|█████████▍| 350040/371472 [5:41:46<1:41:25,  3.52it/s]
 94%|█████████▍| 350041/371472 [5:41:47<1:59:25,  2.99it/s]
 94%|█████████▍| 350042/371472 [5:41:47<1:56:43,  3.06it/s]
 94%|█████████▍| 350043/371472 [5:41:47<1:49:53,  3.25it/s]
 94%|█████████▍| 350044/371472 [5:41:47<1:44:10,  3.43it/s]
 94%|█████████▍| 350045/371472 [5:41:48<1:45:12,  3.39it/s]
 94%|█████████▍| 350046/371472 [5:41:48<1:43:00,  3.47it/s]
 94%|█████████▍| 350047/371472 [5:41:48<1:38:37,  3.62it/s]
 94%|█████████▍| 350048/371472 [5:41:48<1:34:42,  3.77it/s]
 94%|█████████▍| 350049/371472 [5:41:49<1:37:10,  3.67it/s]
 94%|█████████▍| 350050/371472 [5:41:49<1:33:57,  3.80it/s]
 94%|█████████▍| 350051/371472 [5:41:49<1:35:23,  3.74it/s]
 94%|█████████▍| 350052/371472 [5:41:50<1:34:44,  3.77it/s]
 94%|█████████▍| 350053/371472 [5:41:50<1:43:53,  3.44it/s]
 94%|█████████▍| 350054/371472 [5:41:50<1:43:24,  3.45it/s]
 94%|█████████▍| 350055/371472 [5:41:50<1:44:24,  3.42it/s]
 94%|█████████▍| 350056/371472 [5:41:51<1:41:44,  3.51it/s]
 94%|█████████▍| 350057/371472 [5:41:51<1:38:01,  3.64it/s]
 94%|█████████▍| 350058/371472 [5:41:51<1:39:00,  3.60it/s]
 94%|█████████▍| 350059/371472 [5:41:52<1:39:38,  3.58it/s]
 94%|█████████▍| 350060/371472 [5:41:52<1:38:15,  3.63it/s]
                                                           
{'loss': 2.552, 'learning_rate': 1.5190480294770412e-07, 'epoch': 15.08}

 94%|█████████▍| 350060/371472 [5:41:52<1:38:15,  3.63it/s]
 94%|█████████▍| 350061/371472 [5:41:52<1:45:53,  3.37it/s]
 94%|█████████▍| 350062/371472 [5:41:52<1:40:03,  3.57it/s]
 94%|█████████▍| 350063/371472 [5:41:53<1:42:26,  3.48it/s]
 94%|█████████▍| 350064/371472 [5:41:53<1:40:24,  3.55it/s]
 94%|█████████▍| 350065/371472 [5:41:53<1:38:30,  3.62it/s]
 94%|█████████▍| 350066/371472 [5:41:54<1:37:36,  3.65it/s]
 94%|█████████▍| 350067/371472 [5:41:54<1:45:23,  3.39it/s]
 94%|█████████▍| 350068/371472 [5:41:54<1:48:00,  3.30it/s]
 94%|█████████▍| 350069/371472 [5:41:54<1:44:43,  3.41it/s]
 94%|█████████▍| 350070/371472 [5:41:55<1:42:32,  3.48it/s]
 94%|█████████▍| 350071/371472 [5:41:55<1:43:19,  3.45it/s]
 94%|█████████▍| 350072/371472 [5:41:55<1:38:27,  3.62it/s]
 94%|█████████▍| 350073/371472 [5:41:56<1:40:34,  3.55it/s]
 94%|█████████▍| 350074/371472 [5:41:56<1:38:52,  3.61it/s]
 94%|█████████▍| 350075/371472 [5:41:56<1:45:07,  3.39it/s]
 94%|█████████▍| 350076/371472 [5:41:57<1:52:12,  3.18it/s]
 94%|█████████▍| 350077/371472 [5:41:57<1:45:30,  3.38it/s]
 94%|█████████▍| 350078/371472 [5:41:57<1:40:28,  3.55it/s]
 94%|█████████▍| 350079/371472 [5:41:57<1:42:47,  3.47it/s]
 94%|█████████▍| 350080/371472 [5:41:58<1:37:35,  3.65it/s]
                                                           
{'loss': 2.5067, 'learning_rate': 1.518563209722252e-07, 'epoch': 15.08}

 94%|█████████▍| 350080/371472 [5:41:58<1:37:35,  3.65it/s]
 94%|█████████▍| 350081/371472 [5:41:58<1:42:49,  3.47it/s]
 94%|█████████▍| 350082/371472 [5:41:58<1:42:02,  3.49it/s]
 94%|█████████▍| 350083/371472 [5:41:58<1:38:56,  3.60it/s]
 94%|█████████▍| 350084/371472 [5:41:59<1:35:43,  3.72it/s]
 94%|█████████▍| 350085/371472 [5:41:59<1:40:10,  3.56it/s]
 94%|█████████▍| 350086/371472 [5:41:59<1:40:43,  3.54it/s]
 94%|█████████▍| 350087/371472 [5:42:00<1:40:45,  3.54it/s]
 94%|█████████▍| 350088/371472 [5:42:00<1:38:28,  3.62it/s]
 94%|█████████▍| 350089/371472 [5:42:00<1:38:34,  3.62it/s]
 94%|█████████▍| 350090/371472 [5:42:00<1:34:13,  3.78it/s]
 94%|█████████▍| 350091/371472 [5:42:01<1:36:24,  3.70it/s]
 94%|█████████▍| 350092/371472 [5:42:01<1:36:59,  3.67it/s]
 94%|█████████▍| 350093/371472 [5:42:01<1:37:10,  3.67it/s]
 94%|█████████▍| 350094/371472 [5:42:01<1:34:52,  3.76it/s]
 94%|█████████▍| 350095/371472 [5:42:02<1:35:04,  3.75it/s]
 94%|█████████▍| 350096/371472 [5:42:02<1:37:03,  3.67it/s]
 94%|█████████▍| 350097/371472 [5:42:02<1:36:29,  3.69it/s]
 94%|█████████▍| 350098/371472 [5:42:03<1:35:38,  3.72it/s]
 94%|█████████▍| 350099/371472 [5:42:03<1:50:09,  3.23it/s]
 94%|█████████▍| 350100/371472 [5:42:03<1:44:11,  3.42it/s]
                                                           
{'loss': 2.6506, 'learning_rate': 1.5180783899674634e-07, 'epoch': 15.08}

 94%|█████████▍| 350100/371472 [5:42:03<1:44:11,  3.42it/s]
 94%|█████████▍| 350101/371472 [5:42:03<1:40:20,  3.55it/s]
 94%|█████████▍| 350102/371472 [5:42:04<1:38:37,  3.61it/s]
 94%|█████████▍| 350103/371472 [5:42:04<1:35:31,  3.73it/s]
 94%|█████████▍| 350104/371472 [5:42:04<1:43:24,  3.44it/s]
 94%|█████████▍| 350105/371472 [5:42:05<1:46:27,  3.35it/s]
 94%|█████████▍| 350106/371472 [5:42:05<1:43:34,  3.44it/s]
 94%|█████████▍| 350107/371472 [5:42:05<1:46:04,  3.36it/s]
 94%|█████████▍| 350108/371472 [5:42:05<1:42:07,  3.49it/s]
 94%|█████████▍| 350109/371472 [5:42:06<1:42:12,  3.48it/s]
 94%|█████████▍| 350110/371472 [5:42:06<1:42:02,  3.49it/s]
 94%|█████████▍| 350111/371472 [5:42:06<1:43:21,  3.44it/s]
 94%|█████████▍| 350112/371472 [5:42:07<1:39:48,  3.57it/s]
 94%|█████████▍| 350113/371472 [5:42:07<1:37:11,  3.66it/s]
 94%|█████████▍| 350114/371472 [5:42:07<1:33:05,  3.82it/s]
 94%|█████████▍| 350115/371472 [5:42:07<1:38:44,  3.61it/s]
 94%|█████████▍| 350116/371472 [5:42:08<1:43:13,  3.45it/s]
 94%|█████████▍| 350117/371472 [5:42:08<1:40:35,  3.54it/s]
 94%|█████████▍| 350118/371472 [5:42:08<1:39:14,  3.59it/s]
 94%|█████████▍| 350119/371472 [5:42:09<1:40:13,  3.55it/s]
 94%|█████████▍| 350120/371472 [5:42:09<1:35:48,  3.71it/s]
                                                           
{'loss': 2.6057, 'learning_rate': 1.5175935702126738e-07, 'epoch': 15.08}

 94%|█████████▍| 350120/371472 [5:42:09<1:35:48,  3.71it/s]
 94%|█████████▍| 350121/371472 [5:42:09<1:35:01,  3.75it/s]
 94%|█████████▍| 350122/371472 [5:42:09<1:34:36,  3.76it/s]
 94%|█████████▍| 350123/371472 [5:42:10<1:34:14,  3.78it/s]
 94%|█████████▍| 350124/371472 [5:42:10<1:35:22,  3.73it/s]
 94%|█████████▍| 350125/371472 [5:42:10<1:36:28,  3.69it/s]
 94%|█████████▍| 350126/371472 [5:42:10<1:42:28,  3.47it/s]
 94%|█████████▍| 350127/371472 [5:42:11<1:42:03,  3.49it/s]
 94%|█████████▍| 350128/371472 [5:42:11<1:40:22,  3.54it/s]
 94%|█████████▍| 350129/371472 [5:42:11<1:41:40,  3.50it/s]
 94%|█████████▍| 350130/371472 [5:42:12<1:54:34,  3.10it/s]
 94%|█████████▍| 350131/371472 [5:42:12<1:47:47,  3.30it/s]
 94%|█████████▍| 350132/371472 [5:42:12<1:45:23,  3.37it/s]
 94%|█████████▍| 350133/371472 [5:42:12<1:38:16,  3.62it/s]
 94%|█████████▍| 350134/371472 [5:42:13<1:36:42,  3.68it/s]
 94%|█████████▍| 350135/371472 [5:42:13<1:36:56,  3.67it/s]
 94%|█████████▍| 350136/371472 [5:42:13<1:36:55,  3.67it/s]
 94%|█████████▍| 350137/371472 [5:42:14<1:36:08,  3.70it/s]
 94%|█████████▍| 350138/371472 [5:42:14<1:38:04,  3.63it/s]
 94%|█████████▍| 350139/371472 [5:42:14<1:36:37,  3.68it/s]
 94%|█████████▍| 350140/371472 [5:42:14<1:43:00,  3.45it/s]
                                                           
{'loss': 2.4937, 'learning_rate': 1.5171087504578856e-07, 'epoch': 15.08}

 94%|█████████▍| 350140/371472 [5:42:14<1:43:00,  3.45it/s]
 94%|█████████▍| 350141/371472 [5:42:15<1:51:19,  3.19it/s]
 94%|█████████▍| 350142/371472 [5:42:15<1:50:40,  3.21it/s]
 94%|█████████▍| 350143/371472 [5:42:15<1:49:43,  3.24it/s]
 94%|█████████▍| 350144/371472 [5:42:16<1:46:51,  3.33it/s]
 94%|█████████▍| 350145/371472 [5:42:16<1:46:55,  3.32it/s]
 94%|█████████▍| 350146/371472 [5:42:16<1:44:53,  3.39it/s]
 94%|█████████▍| 350147/371472 [5:42:17<1:40:37,  3.53it/s]
 94%|█████████▍| 350148/371472 [5:42:17<1:46:00,  3.35it/s]
 94%|█████████▍| 350149/371472 [5:42:17<1:40:42,  3.53it/s]
 94%|█████████▍| 350150/371472 [5:42:17<1:40:35,  3.53it/s]
 94%|█████████▍| 350151/371472 [5:42:18<1:42:21,  3.47it/s]
 94%|█████████▍| 350152/371472 [5:42:18<1:41:37,  3.50it/s]
 94%|█████████▍| 350153/371472 [5:42:18<1:38:09,  3.62it/s]
 94%|█████████▍| 350154/371472 [5:42:19<1:42:36,  3.46it/s]
 94%|█████████▍| 350155/371472 [5:42:19<1:40:22,  3.54it/s]
 94%|█████████▍| 350156/371472 [5:42:19<1:39:47,  3.56it/s]
 94%|█████████▍| 350157/371472 [5:42:19<1:38:39,  3.60it/s]
 94%|█████████▍| 350158/371472 [5:42:20<1:43:20,  3.44it/s]
 94%|█████████▍| 350159/371472 [5:42:20<1:44:36,  3.40it/s]
 94%|█████████▍| 350160/371472 [5:42:20<1:44:36,  3.40it/s]
                                                           
{'loss': 2.5075, 'learning_rate': 1.5166239307030963e-07, 'epoch': 15.08}

 94%|█████████▍| 350160/371472 [5:42:20<1:44:36,  3.40it/s]
 94%|█████████▍| 350161/371472 [5:42:21<1:48:11,  3.28it/s]
 94%|█████████▍| 350162/371472 [5:42:21<1:46:44,  3.33it/s]
 94%|█████████▍| 350163/371472 [5:42:21<1:42:29,  3.47it/s]
 94%|█████████▍| 350164/371472 [5:42:21<1:44:24,  3.40it/s]
 94%|█████████▍| 350165/371472 [5:42:22<1:49:22,  3.25it/s]
 94%|█████████▍| 350166/371472 [5:42:22<1:44:51,  3.39it/s]
 94%|█████████▍| 350167/371472 [5:42:22<1:39:14,  3.58it/s]
 94%|█████████▍| 350168/371472 [5:42:23<1:37:40,  3.64it/s]
 94%|█████████▍| 350169/371472 [5:42:23<1:45:27,  3.37it/s]
 94%|█████████▍| 350170/371472 [5:42:23<1:41:28,  3.50it/s]
 94%|█████████▍| 350171/371472 [5:42:23<1:38:36,  3.60it/s]
 94%|█████████▍| 350172/371472 [5:42:24<1:37:40,  3.63it/s]
 94%|█████████▍| 350173/371472 [5:42:24<1:41:03,  3.51it/s]
 94%|█████████▍| 350174/371472 [5:42:24<1:46:14,  3.34it/s]
 94%|█████████▍| 350175/371472 [5:42:25<1:41:32,  3.50it/s]
 94%|█████████▍| 350176/371472 [5:42:25<1:46:59,  3.32it/s]
 94%|█████████▍| 350177/371472 [5:42:25<1:46:04,  3.35it/s]
 94%|█████████▍| 350178/371472 [5:42:25<1:39:42,  3.56it/s]
 94%|█████████▍| 350179/371472 [5:42:26<1:41:10,  3.51it/s]
 94%|█████████▍| 350180/371472 [5:42:26<1:41:01,  3.51it/s]
                                                           
{'loss': 2.5972, 'learning_rate': 1.5161391109483076e-07, 'epoch': 15.08}

 94%|█████████▍| 350180/371472 [5:42:26<1:41:01,  3.51it/s]
 94%|█████████▍| 350181/371472 [5:42:26<1:44:04,  3.41it/s]
 94%|█████████▍| 350182/371472 [5:42:27<1:41:45,  3.49it/s]
 94%|█████████▍| 350183/371472 [5:42:27<1:38:22,  3.61it/s]
 94%|█████████▍| 350184/371472 [5:42:27<1:37:00,  3.66it/s]
 94%|█████████▍| 350185/371472 [5:42:27<1:38:37,  3.60it/s]
 94%|█████████▍| 350186/371472 [5:42:28<1:42:12,  3.47it/s]
 94%|█████████▍| 350187/371472 [5:42:28<1:37:12,  3.65it/s]
 94%|█████████▍| 350188/371472 [5:42:28<1:35:29,  3.71it/s]
 94%|█████████▍| 350189/371472 [5:42:29<1:37:25,  3.64it/s]
 94%|█████████▍| 350190/371472 [5:42:29<1:41:17,  3.50it/s]
 94%|█████████▍| 350191/371472 [5:42:29<1:41:44,  3.49it/s]
 94%|█████████▍| 350192/371472 [5:42:29<1:38:24,  3.60it/s]
 94%|█████████▍| 350193/371472 [5:42:30<1:41:05,  3.51it/s]
 94%|█████████▍| 350194/371472 [5:42:30<1:41:07,  3.51it/s]
 94%|█████████▍| 350195/371472 [5:42:30<1:38:24,  3.60it/s]
 94%|█████████▍| 350196/371472 [5:42:30<1:36:00,  3.69it/s]
 94%|█████████▍| 350197/371472 [5:42:31<1:40:49,  3.52it/s]
 94%|█████████▍| 350198/371472 [5:42:31<1:39:37,  3.56it/s]
 94%|█████████▍| 350199/371472 [5:42:31<1:40:41,  3.52it/s]
 94%|█████████▍| 350200/371472 [5:42:32<1:39:17,  3.57it/s]
                                                           
{'loss': 2.5704, 'learning_rate': 1.5156542911935183e-07, 'epoch': 15.08}

 94%|█████████▍| 350200/371472 [5:42:32<1:39:17,  3.57it/s]
 94%|█████████▍| 350201/371472 [5:42:32<1:44:01,  3.41it/s]
 94%|█████████▍| 350202/371472 [5:42:32<1:39:01,  3.58it/s]
 94%|█████████▍| 350203/371472 [5:42:32<1:35:06,  3.73it/s]
 94%|█████████▍| 350204/371472 [5:42:33<1:43:56,  3.41it/s]
 94%|█████████▍| 350205/371472 [5:42:33<1:43:47,  3.42it/s]
 94%|█████████▍| 350206/371472 [5:42:33<1:43:40,  3.42it/s]
 94%|█████████▍| 350207/371472 [5:42:34<1:43:35,  3.42it/s]
 94%|█████████▍| 350208/371472 [5:42:34<1:45:59,  3.34it/s]
 94%|█████████▍| 350209/371472 [5:42:34<1:54:35,  3.09it/s]
 94%|█████████▍| 350210/371472 [5:42:35<1:50:55,  3.19it/s]
 94%|█████████▍| 350211/371472 [5:42:35<1:52:19,  3.15it/s]
 94%|█████████▍| 350212/371472 [5:42:35<1:47:58,  3.28it/s]
 94%|█████████▍| 350213/371472 [5:42:36<1:43:38,  3.42it/s]
 94%|█████████▍| 350214/371472 [5:42:36<1:41:15,  3.50it/s]
 94%|█████████▍| 350215/371472 [5:42:36<1:41:42,  3.48it/s]
 94%|█████████▍| 350216/371472 [5:42:36<1:38:51,  3.58it/s]
 94%|█████████▍| 350217/371472 [5:42:37<1:39:31,  3.56it/s]
 94%|█████████▍| 350218/371472 [5:42:37<1:37:26,  3.64it/s]
 94%|█████████▍| 350219/371472 [5:42:37<1:40:40,  3.52it/s]
 94%|█████████▍| 350220/371472 [5:42:37<1:39:07,  3.57it/s]
                                                           
{'loss': 2.5659, 'learning_rate': 1.5151694714387298e-07, 'epoch': 15.08}

 94%|█████████▍| 350220/371472 [5:42:37<1:39:07,  3.57it/s]
 94%|█████████▍| 350221/371472 [5:42:38<1:44:01,  3.40it/s]
 94%|█████████▍| 350222/371472 [5:42:38<1:38:57,  3.58it/s]
 94%|█████████▍| 350223/371472 [5:42:38<1:38:29,  3.60it/s]
 94%|█████████▍| 350224/371472 [5:42:39<1:36:25,  3.67it/s]
 94%|█████████▍| 350225/371472 [5:42:39<1:40:10,  3.54it/s]
 94%|█████████▍| 350226/371472 [5:42:39<1:36:25,  3.67it/s]
 94%|█████████▍| 350227/371472 [5:42:39<1:38:57,  3.58it/s]
 94%|█████████▍| 350228/371472 [5:42:40<1:36:04,  3.69it/s]
 94%|█████████▍| 350229/371472 [5:42:40<1:34:59,  3.73it/s]
 94%|█████████▍| 350230/371472 [5:42:40<1:32:55,  3.81it/s]
 94%|█████████▍| 350231/371472 [5:42:40<1:37:13,  3.64it/s]
 94%|█████████▍| 350232/371472 [5:42:41<1:36:03,  3.69it/s]
 94%|█████████▍| 350233/371472 [5:42:41<1:36:57,  3.65it/s]
 94%|█████████▍| 350234/371472 [5:42:41<1:37:12,  3.64it/s]
 94%|█████████▍| 350235/371472 [5:42:42<1:35:41,  3.70it/s]
 94%|█████████▍| 350236/371472 [5:42:42<1:35:46,  3.70it/s]
 94%|█████████▍| 350237/371472 [5:42:42<1:38:08,  3.61it/s]
 94%|█████████▍| 350238/371472 [5:42:42<1:36:48,  3.66it/s]
 94%|█████████▍| 350239/371472 [5:42:43<1:33:32,  3.78it/s]
 94%|█████████▍| 350240/371472 [5:42:43<1:31:43,  3.86it/s]
                                                           
{'loss': 2.6758, 'learning_rate': 1.5146846516839405e-07, 'epoch': 15.09}

 94%|█████████▍| 350240/371472 [5:42:43<1:31:43,  3.86it/s]
 94%|█████████▍| 350241/371472 [5:42:43<1:34:02,  3.76it/s]
 94%|█████████▍| 350242/371472 [5:42:44<1:43:57,  3.40it/s]
 94%|█████████▍| 350243/371472 [5:42:44<1:42:35,  3.45it/s]
 94%|█████████▍| 350244/371472 [5:42:44<1:43:39,  3.41it/s]
 94%|█████████▍| 350245/371472 [5:42:44<1:40:14,  3.53it/s]
 94%|█████████▍| 350246/371472 [5:42:45<1:37:22,  3.63it/s]
 94%|█████████▍| 350247/371472 [5:42:45<1:37:22,  3.63it/s]
 94%|█████████▍| 350248/371472 [5:42:45<1:38:22,  3.60it/s]
 94%|█████████▍| 350249/371472 [5:42:46<1:41:59,  3.47it/s]
 94%|█████████▍| 350250/371472 [5:42:46<1:42:19,  3.46it/s]
 94%|█████████▍| 350251/371472 [5:42:46<1:41:32,  3.48it/s]
 94%|█████████▍| 350252/371472 [5:42:46<1:41:44,  3.48it/s]
 94%|█████████▍| 350253/371472 [5:42:47<1:42:21,  3.45it/s]
 94%|█████████▍| 350254/371472 [5:42:47<1:39:48,  3.54it/s]
 94%|█████████▍| 350255/371472 [5:42:47<1:37:13,  3.64it/s]
 94%|█████████▍| 350256/371472 [5:42:47<1:33:14,  3.79it/s]
 94%|█████████▍| 350257/371472 [5:42:48<1:34:27,  3.74it/s]
 94%|█████████▍| 350258/371472 [5:42:48<1:33:14,  3.79it/s]
 94%|█████████▍| 350259/371472 [5:42:48<1:33:08,  3.80it/s]
 94%|█████████▍| 350260/371472 [5:42:48<1:33:03,  3.80it/s]
                                                           
{'loss': 2.5076, 'learning_rate': 1.514199831929152e-07, 'epoch': 15.09}

 94%|█████████▍| 350260/371472 [5:42:48<1:33:03,  3.80it/s]
 94%|█████████▍| 350261/371472 [5:42:49<1:33:05,  3.80it/s]
 94%|█████████▍| 350262/371472 [5:42:49<1:33:34,  3.78it/s]
 94%|█████████▍| 350263/371472 [5:42:49<1:35:07,  3.72it/s]
 94%|█████████▍| 350264/371472 [5:42:50<1:34:29,  3.74it/s]
 94%|█████████▍| 350265/371472 [5:42:50<1:40:05,  3.53it/s]
 94%|█████████▍| 350266/371472 [5:42:50<1:40:08,  3.53it/s]
 94%|█████████▍| 350267/371472 [5:42:50<1:39:11,  3.56it/s]
 94%|█████████▍| 350268/371472 [5:42:51<1:35:46,  3.69it/s]
 94%|█████████▍| 350269/371472 [5:42:51<1:33:51,  3.77it/s]
 94%|█████████▍| 350270/371472 [5:42:51<1:34:38,  3.73it/s]
 94%|█████████▍| 350271/371472 [5:42:51<1:35:08,  3.71it/s]
 94%|█████████▍| 350272/371472 [5:42:52<1:35:25,  3.70it/s]
 94%|█████████▍| 350273/371472 [5:42:52<1:38:57,  3.57it/s]
 94%|█████████▍| 350274/371472 [5:42:52<1:37:19,  3.63it/s]
 94%|█████████▍| 350275/371472 [5:42:53<1:36:41,  3.65it/s]
 94%|█████████▍| 350276/371472 [5:42:53<1:34:06,  3.75it/s]
 94%|█████████▍| 350277/371472 [5:42:53<1:35:56,  3.68it/s]
 94%|█████████▍| 350278/371472 [5:42:53<1:37:58,  3.61it/s]
 94%|█████████▍| 350279/371472 [5:42:54<1:38:22,  3.59it/s]
 94%|█████████▍| 350280/371472 [5:42:54<1:36:55,  3.64it/s]
                                                           
{'loss': 2.6375, 'learning_rate': 1.5137150121743627e-07, 'epoch': 15.09}

 94%|█████████▍| 350280/371472 [5:42:54<1:36:55,  3.64it/s]
 94%|█████████▍| 350281/371472 [5:42:54<1:38:00,  3.60it/s]
 94%|█████████▍| 350282/371472 [5:42:55<1:36:51,  3.65it/s]
 94%|█████████▍| 350283/371472 [5:42:55<1:36:44,  3.65it/s]
 94%|█████████▍| 350284/371472 [5:42:55<1:39:24,  3.55it/s]
 94%|█████████▍| 350285/371472 [5:42:55<1:43:54,  3.40it/s]
 94%|█████████▍| 350286/371472 [5:42:56<1:40:22,  3.52it/s]
 94%|█████████▍| 350287/371472 [5:42:56<1:40:38,  3.51it/s]
 94%|█████████▍| 350288/371472 [5:42:56<1:48:22,  3.26it/s]
 94%|█████████▍| 350289/371472 [5:42:57<1:48:10,  3.26it/s]
 94%|█████████▍| 350290/371472 [5:42:57<1:44:46,  3.37it/s]
 94%|█████████▍| 350291/371472 [5:42:57<1:42:51,  3.43it/s]
 94%|█████████▍| 350292/371472 [5:42:57<1:45:12,  3.36it/s]
 94%|█████████▍| 350293/371472 [5:42:58<1:44:44,  3.37it/s]
 94%|█████████▍| 350294/371472 [5:42:58<1:39:17,  3.55it/s]
 94%|█████████▍| 350295/371472 [5:42:58<1:37:41,  3.61it/s]
 94%|█████████▍| 350296/371472 [5:42:59<1:36:40,  3.65it/s]
 94%|█████████▍| 350297/371472 [5:42:59<1:34:49,  3.72it/s]
 94%|█████████▍| 350298/371472 [5:42:59<1:36:08,  3.67it/s]
 94%|█████████▍| 350299/371472 [5:42:59<1:35:31,  3.69it/s]
 94%|█████████▍| 350300/371472 [5:43:00<1:36:37,  3.65it/s]
                                                           
{'loss': 2.6214, 'learning_rate': 1.5132301924195742e-07, 'epoch': 15.09}

 94%|█████████▍| 350300/371472 [5:43:00<1:36:37,  3.65it/s]
 94%|█████████▍| 350301/371472 [5:43:00<1:36:24,  3.66it/s]
 94%|█████████▍| 350302/371472 [5:43:00<1:43:49,  3.40it/s]
 94%|█████████▍| 350303/371472 [5:43:01<1:42:37,  3.44it/s]
 94%|█████████▍| 350304/371472 [5:43:01<1:37:24,  3.62it/s]
 94%|█████████▍| 350305/371472 [5:43:01<1:35:55,  3.68it/s]
 94%|█████████▍| 350306/371472 [5:43:01<1:39:07,  3.56it/s]
 94%|█████████▍| 350307/371472 [5:43:02<1:46:37,  3.31it/s]
 94%|█████████▍| 350308/371472 [5:43:02<1:40:22,  3.51it/s]
 94%|█████████▍| 350309/371472 [5:43:02<1:40:25,  3.51it/s]
 94%|█████████▍| 350310/371472 [5:43:02<1:39:01,  3.56it/s]
 94%|█████████▍| 350311/371472 [5:43:03<1:37:15,  3.63it/s]
 94%|█████████▍| 350312/371472 [5:43:03<1:37:51,  3.60it/s]
 94%|█████████▍| 350313/371472 [5:43:03<1:40:46,  3.50it/s]
 94%|█████████▍| 350314/371472 [5:43:04<1:42:55,  3.43it/s]
 94%|█████████▍| 350315/371472 [5:43:04<1:39:48,  3.53it/s]
 94%|█████████▍| 350316/371472 [5:43:04<1:36:55,  3.64it/s]
 94%|█████████▍| 350317/371472 [5:43:04<1:37:38,  3.61it/s]
 94%|█████████▍| 350318/371472 [5:43:05<1:37:40,  3.61it/s]
 94%|█████████▍| 350319/371472 [5:43:05<1:36:59,  3.64it/s]
 94%|█████████▍| 350320/371472 [5:43:05<1:36:42,  3.65it/s]
                                                           
{'loss': 2.5668, 'learning_rate': 1.5127453726647847e-07, 'epoch': 15.09}

 94%|█████████▍| 350320/371472 [5:43:05<1:36:42,  3.65it/s]
 94%|█████████▍| 350321/371472 [5:43:06<1:37:15,  3.62it/s]
 94%|█████████▍| 350322/371472 [5:43:06<1:49:12,  3.23it/s]
 94%|█████████▍| 350323/371472 [5:43:06<1:48:36,  3.25it/s]
 94%|█████████▍| 350324/371472 [5:43:07<1:44:40,  3.37it/s]
 94%|█████████▍| 350325/371472 [5:43:07<1:42:27,  3.44it/s]
 94%|█████████▍| 350326/371472 [5:43:07<1:38:38,  3.57it/s]
 94%|█████████▍| 350327/371472 [5:43:07<1:39:41,  3.54it/s]
 94%|█████████▍| 350328/371472 [5:43:08<1:37:54,  3.60it/s]
 94%|█████████▍| 350329/371472 [5:43:08<1:47:19,  3.28it/s]
 94%|█████████▍| 350330/371472 [5:43:08<1:43:00,  3.42it/s]
 94%|█████████▍| 350331/371472 [5:43:08<1:39:49,  3.53it/s]
 94%|█████████▍| 350332/371472 [5:43:09<1:38:37,  3.57it/s]
 94%|█████████▍| 350333/371472 [5:43:09<1:36:55,  3.63it/s]
 94%|█████████▍| 350334/371472 [5:43:09<1:46:57,  3.29it/s]
 94%|█████████▍| 350335/371472 [5:43:10<1:45:50,  3.33it/s]
 94%|█████████▍| 350336/371472 [5:43:10<1:45:00,  3.35it/s]
 94%|█████████▍| 350337/371472 [5:43:10<1:50:09,  3.20it/s]
 94%|█████████▍| 350338/371472 [5:43:11<1:51:20,  3.16it/s]
 94%|█████████▍| 350339/371472 [5:43:11<1:48:50,  3.24it/s]
 94%|█████████▍| 350340/371472 [5:43:11<1:44:49,  3.36it/s]
                                                           
{'loss': 2.5264, 'learning_rate': 1.5122605529099962e-07, 'epoch': 15.09}

 94%|█████████▍| 350340/371472 [5:43:11<1:44:49,  3.36it/s]
 94%|█████████▍| 350341/371472 [5:43:11<1:40:53,  3.49it/s]
 94%|█████████▍| 350342/371472 [5:43:12<1:40:36,  3.50it/s]
 94%|█████████▍| 350343/371472 [5:43:12<1:38:51,  3.56it/s]
 94%|█████████▍| 350344/371472 [5:43:12<1:36:50,  3.64it/s]
 94%|█████████▍| 350345/371472 [5:43:13<1:36:42,  3.64it/s]
 94%|█████████▍| 350346/371472 [5:43:13<1:33:30,  3.77it/s]
 94%|█████████▍| 350347/371472 [5:43:13<1:35:57,  3.67it/s]
 94%|█████████▍| 350348/371472 [5:43:13<1:36:59,  3.63it/s]
 94%|█████████▍| 350349/371472 [5:43:14<1:42:07,  3.45it/s]
 94%|█████████▍| 350350/371472 [5:43:14<1:39:54,  3.52it/s]
 94%|█████████▍| 350351/371472 [5:43:14<1:40:22,  3.51it/s]
 94%|█████████▍| 350352/371472 [5:43:15<1:42:51,  3.42it/s]
 94%|█████████▍| 350353/371472 [5:43:15<1:40:01,  3.52it/s]
 94%|█████████▍| 350354/371472 [5:43:15<1:39:58,  3.52it/s]
 94%|█████████▍| 350355/371472 [5:43:15<1:40:45,  3.49it/s]
 94%|█████████▍| 350356/371472 [5:43:16<1:38:41,  3.57it/s]
 94%|█████████▍| 350357/371472 [5:43:16<1:36:57,  3.63it/s]
 94%|█████████▍| 350358/371472 [5:43:16<1:39:37,  3.53it/s]
 94%|█████████▍| 350359/371472 [5:43:17<1:45:57,  3.32it/s]
 94%|█████████▍| 350360/371472 [5:43:17<1:40:21,  3.51it/s]
                                                           
{'loss': 2.5393, 'learning_rate': 1.511775733155207e-07, 'epoch': 15.09}

 94%|█████████▍| 350360/371472 [5:43:17<1:40:21,  3.51it/s]
 94%|█████████▍| 350361/371472 [5:43:17<1:37:52,  3.59it/s]
 94%|█████████▍| 350362/371472 [5:43:17<1:44:29,  3.37it/s]
 94%|█████████▍| 350363/371472 [5:43:18<1:45:23,  3.34it/s]
 94%|█████████▍| 350364/371472 [5:43:18<1:45:12,  3.34it/s]
 94%|█████████▍| 350365/371472 [5:43:18<1:40:11,  3.51it/s]
 94%|█████████▍| 350366/371472 [5:43:19<1:38:28,  3.57it/s]
 94%|█████████▍| 350367/371472 [5:43:19<1:44:10,  3.38it/s]
 94%|█████████▍| 350368/371472 [5:43:19<1:41:21,  3.47it/s]
 94%|█████████▍| 350369/371472 [5:43:19<1:41:26,  3.47it/s]
 94%|█████████▍| 350370/371472 [5:43:20<1:45:38,  3.33it/s]
 94%|█████████▍| 350371/371472 [5:43:20<1:41:21,  3.47it/s]
 94%|█████████▍| 350372/371472 [5:43:20<1:37:46,  3.60it/s]
 94%|█████████▍| 350373/371472 [5:43:21<1:33:55,  3.74it/s]
 94%|█████████▍| 350374/371472 [5:43:21<1:39:04,  3.55it/s]
 94%|█████████▍| 350375/371472 [5:43:21<1:37:14,  3.62it/s]
 94%|█████████▍| 350376/371472 [5:43:21<1:37:32,  3.60it/s]
 94%|█████████▍| 350377/371472 [5:43:22<1:40:19,  3.50it/s]
 94%|█████████▍| 350378/371472 [5:43:22<1:38:29,  3.57it/s]
 94%|█████████▍| 350379/371472 [5:43:22<1:35:40,  3.67it/s]
 94%|█████████▍| 350380/371472 [5:43:23<1:47:08,  3.28it/s]
                                                           
{'loss': 2.6075, 'learning_rate': 1.5112909134004174e-07, 'epoch': 15.09}

 94%|█████████▍| 350380/371472 [5:43:23<1:47:08,  3.28it/s]
 94%|█████████▍| 350381/371472 [5:43:23<1:44:35,  3.36it/s]
 94%|█████████▍| 350382/371472 [5:43:23<1:42:10,  3.44it/s]
 94%|█████████▍| 350383/371472 [5:43:23<1:41:43,  3.46it/s]
 94%|█████████▍| 350384/371472 [5:43:24<1:46:19,  3.31it/s]
 94%|█████████▍| 350385/371472 [5:43:24<1:43:41,  3.39it/s]
 94%|█████████▍| 350386/371472 [5:43:25<2:01:31,  2.89it/s]
 94%|█████████▍| 350387/371472 [5:43:25<2:04:58,  2.81it/s]
 94%|█████████▍| 350388/371472 [5:43:25<2:01:34,  2.89it/s]
 94%|█████████▍| 350389/371472 [5:43:25<1:51:44,  3.14it/s]
 94%|█████████▍| 350390/371472 [5:43:26<1:43:19,  3.40it/s]
 94%|█████████▍| 350391/371472 [5:43:26<1:39:12,  3.54it/s]
 94%|█████████▍| 350392/371472 [5:43:26<1:40:59,  3.48it/s]
 94%|█████████▍| 350393/371472 [5:43:27<1:40:39,  3.49it/s]
 94%|█████████▍| 350394/371472 [5:43:27<1:42:14,  3.44it/s]
 94%|█████████▍| 350395/371472 [5:43:27<1:39:34,  3.53it/s]
 94%|█████████▍| 350396/371472 [5:43:27<1:39:49,  3.52it/s]
 94%|█████████▍| 350397/371472 [5:43:28<1:39:59,  3.51it/s]
 94%|█████████▍| 350398/371472 [5:43:28<1:41:06,  3.47it/s]
 94%|█████████▍| 350399/371472 [5:43:28<1:39:16,  3.54it/s]
 94%|█████████▍| 350400/371472 [5:43:29<1:39:30,  3.53it/s]
                                                           
{'loss': 2.4926, 'learning_rate': 1.5108060936456291e-07, 'epoch': 15.09}

 94%|█████████▍| 350400/371472 [5:43:29<1:39:30,  3.53it/s]
 94%|█████████▍| 350401/371472 [5:43:29<1:39:09,  3.54it/s]
 94%|█████████▍| 350402/371472 [5:43:29<1:38:39,  3.56it/s]
 94%|█████████▍| 350403/371472 [5:43:29<1:36:31,  3.64it/s]
 94%|█████████▍| 350404/371472 [5:43:30<1:37:51,  3.59it/s]
 94%|█████████▍| 350405/371472 [5:43:30<1:37:13,  3.61it/s]
 94%|█████████▍| 350406/371472 [5:43:30<1:36:27,  3.64it/s]
 94%|█████████▍| 350407/371472 [5:43:31<1:42:52,  3.41it/s]
 94%|█████████▍| 350408/371472 [5:43:31<1:46:29,  3.30it/s]
 94%|█████████▍| 350409/371472 [5:43:31<1:43:09,  3.40it/s]
 94%|█████████▍| 350410/371472 [5:43:31<1:40:52,  3.48it/s]
 94%|█████████▍| 350411/371472 [5:43:32<1:35:46,  3.67it/s]
 94%|█████████▍| 350412/371472 [5:43:32<1:33:09,  3.77it/s]
 94%|█████████▍| 350413/371472 [5:43:32<1:32:16,  3.80it/s]
 94%|█████████▍| 350414/371472 [5:43:33<1:44:20,  3.36it/s]
 94%|█████████▍| 350415/371472 [5:43:33<1:41:04,  3.47it/s]
 94%|█████████▍| 350416/371472 [5:43:33<1:41:35,  3.45it/s]
 94%|█████████▍| 350417/371472 [5:43:33<1:37:55,  3.58it/s]
 94%|█████████▍| 350418/371472 [5:43:34<1:47:05,  3.28it/s]
 94%|█████████▍| 350419/371472 [5:43:34<1:40:29,  3.49it/s]
 94%|█████████▍| 350420/371472 [5:43:34<1:37:58,  3.58it/s]
                                                           
{'loss': 2.5907, 'learning_rate': 1.5103212738908396e-07, 'epoch': 15.09}

 94%|█████████▍| 350420/371472 [5:43:34<1:37:58,  3.58it/s]
 94%|█████████▍| 350421/371472 [5:43:35<1:39:58,  3.51it/s]
 94%|█████████▍| 350422/371472 [5:43:35<1:44:50,  3.35it/s]
 94%|█████████▍| 350423/371472 [5:43:35<1:40:50,  3.48it/s]
 94%|█████████▍| 350424/371472 [5:43:35<1:40:34,  3.49it/s]
 94%|█████████▍| 350425/371472 [5:43:36<1:50:53,  3.16it/s]
 94%|█████████▍| 350426/371472 [5:43:36<1:50:54,  3.16it/s]
 94%|█████████▍| 350427/371472 [5:43:36<1:57:04,  3.00it/s]
 94%|█████████▍| 350428/371472 [5:43:37<1:50:00,  3.19it/s]
 94%|█████████▍| 350429/371472 [5:43:37<1:46:14,  3.30it/s]
 94%|█████████▍| 350430/371472 [5:43:37<1:40:37,  3.49it/s]
 94%|█████████▍| 350431/371472 [5:43:38<1:37:59,  3.58it/s]
 94%|█████████▍| 350432/371472 [5:43:38<1:37:59,  3.58it/s]
 94%|█████████▍| 350433/371472 [5:43:38<1:52:47,  3.11it/s]
 94%|█████████▍| 350434/371472 [5:43:39<1:59:28,  2.93it/s]
 94%|█████████▍| 350435/371472 [5:43:39<1:54:42,  3.06it/s]
 94%|█████████▍| 350436/371472 [5:43:39<1:55:45,  3.03it/s]
 94%|█████████▍| 350437/371472 [5:43:39<1:48:18,  3.24it/s]
 94%|█████████▍| 350438/371472 [5:43:40<1:47:23,  3.26it/s]
 94%|█████████▍| 350439/371472 [5:43:40<1:46:28,  3.29it/s]
 94%|█████████▍| 350440/371472 [5:43:40<1:42:42,  3.41it/s]
                                                           
{'loss': 2.6534, 'learning_rate': 1.509836454136051e-07, 'epoch': 15.09}

 94%|█████████▍| 350440/371472 [5:43:40<1:42:42,  3.41it/s]
 94%|█████████▍| 350441/371472 [5:43:41<1:41:12,  3.46it/s]
 94%|█████████▍| 350442/371472 [5:43:41<1:39:22,  3.53it/s]
 94%|█████████▍| 350443/371472 [5:43:41<1:41:09,  3.46it/s]
 94%|█████████▍| 350444/371472 [5:43:41<1:40:20,  3.49it/s]
 94%|█████████▍| 350445/371472 [5:43:42<1:37:20,  3.60it/s]
 94%|█████████▍| 350446/371472 [5:43:42<1:36:00,  3.65it/s]
 94%|█████████▍| 350447/371472 [5:43:42<1:34:04,  3.73it/s]
 94%|█████████▍| 350448/371472 [5:43:43<1:37:34,  3.59it/s]
 94%|█████████▍| 350449/371472 [5:43:43<1:38:28,  3.56it/s]
 94%|█████████▍| 350450/371472 [5:43:43<1:37:18,  3.60it/s]
 94%|█████████▍| 350451/371472 [5:43:43<1:36:27,  3.63it/s]
 94%|█████████▍| 350452/371472 [5:43:44<1:36:57,  3.61it/s]
 94%|█████████▍| 350453/371472 [5:43:44<1:33:14,  3.76it/s]
 94%|█████████▍| 350454/371472 [5:43:44<1:37:47,  3.58it/s]
 94%|█████████▍| 350455/371472 [5:43:45<1:39:32,  3.52it/s]
 94%|█████████▍| 350456/371472 [5:43:45<1:38:58,  3.54it/s]
 94%|█████████▍| 350457/371472 [5:43:45<1:37:07,  3.61it/s]
 94%|█████████▍| 350458/371472 [5:43:45<1:34:12,  3.72it/s]
 94%|█████████▍| 350459/371472 [5:43:46<1:32:45,  3.78it/s]
 94%|█████████▍| 350460/371472 [5:43:46<1:36:59,  3.61it/s]
                                                           
{'loss': 2.5793, 'learning_rate': 1.5093516343812618e-07, 'epoch': 15.09}

 94%|█████████▍| 350460/371472 [5:43:46<1:36:59,  3.61it/s]
 94%|█████████▍| 350461/371472 [5:43:46<1:42:51,  3.40it/s]
 94%|█████████▍| 350462/371472 [5:43:46<1:39:36,  3.52it/s]
 94%|█████████▍| 350463/371472 [5:43:47<1:36:04,  3.64it/s]
 94%|█████████▍| 350464/371472 [5:43:47<1:37:37,  3.59it/s]
 94%|█████████▍| 350465/371472 [5:43:47<1:45:37,  3.31it/s]
 94%|█████████▍| 350466/371472 [5:43:48<1:40:48,  3.47it/s]
 94%|█████████▍| 350467/371472 [5:43:48<1:35:03,  3.68it/s]
 94%|█████████▍| 350468/371472 [5:43:48<1:38:34,  3.55it/s]
 94%|█████████▍| 350469/371472 [5:43:48<1:40:51,  3.47it/s]
 94%|█████████▍| 350470/371472 [5:43:49<1:42:58,  3.40it/s]
 94%|█████████▍| 350471/371472 [5:43:49<1:43:47,  3.37it/s]
 94%|█████████▍| 350472/371472 [5:43:49<1:48:52,  3.21it/s]
 94%|█████████▍| 350473/371472 [5:43:50<1:49:10,  3.21it/s]
 94%|█████████▍| 350474/371472 [5:43:50<1:52:36,  3.11it/s]
 94%|█████████▍| 350475/371472 [5:43:50<1:45:46,  3.31it/s]
 94%|█████████▍| 350476/371472 [5:43:51<1:47:31,  3.25it/s]
 94%|█████████▍| 350477/371472 [5:43:51<1:42:14,  3.42it/s]
 94%|█████████▍| 350478/371472 [5:43:51<1:42:58,  3.40it/s]
 94%|█████████▍| 350479/371472 [5:43:51<1:38:46,  3.54it/s]
 94%|█████████▍| 350480/371472 [5:43:52<1:36:53,  3.61it/s]
                                                           
{'loss': 2.5142, 'learning_rate': 1.5088668146264733e-07, 'epoch': 15.1}

 94%|█████████▍| 350480/371472 [5:43:52<1:36:53,  3.61it/s]
 94%|█████████▍| 350481/371472 [5:43:52<1:34:46,  3.69it/s]
 94%|█████████▍| 350482/371472 [5:43:52<1:36:27,  3.63it/s]
 94%|█████████▍| 350483/371472 [5:43:53<1:39:09,  3.53it/s]
 94%|█████████▍| 350484/371472 [5:43:53<1:35:28,  3.66it/s]
 94%|█████████▍| 350485/371472 [5:43:53<1:35:11,  3.67it/s]
 94%|█████████▍| 350486/371472 [5:43:53<1:32:05,  3.80it/s]
 94%|█████████▍| 350487/371472 [5:43:54<1:34:35,  3.70it/s]
 94%|█████████▍| 350488/371472 [5:43:54<1:34:52,  3.69it/s]
 94%|█████████▍| 350489/371472 [5:43:54<1:36:30,  3.62it/s]
 94%|█████████▍| 350490/371472 [5:43:54<1:36:54,  3.61it/s]
 94%|█████████▍| 350491/371472 [5:43:55<1:41:45,  3.44it/s]
 94%|█████████▍| 350492/371472 [5:43:55<1:42:20,  3.42it/s]
 94%|█████████▍| 350493/371472 [5:43:55<1:43:48,  3.37it/s]
 94%|█████████▍| 350494/371472 [5:43:56<1:40:13,  3.49it/s]
 94%|█████████▍| 350495/371472 [5:43:56<1:35:55,  3.64it/s]
 94%|█████████▍| 350496/371472 [5:43:56<1:36:35,  3.62it/s]
 94%|█████████▍| 350497/371472 [5:43:56<1:33:07,  3.75it/s]
 94%|█████████▍| 350498/371472 [5:43:57<1:30:59,  3.84it/s]
 94%|█████████▍| 350499/371472 [5:43:57<1:33:09,  3.75it/s]
 94%|█████████▍| 350500/371472 [5:43:57<1:43:12,  3.39it/s]
                                                           
{'loss': 2.6497, 'learning_rate': 1.508381994871684e-07, 'epoch': 15.1}

 94%|█████████▍| 350500/371472 [5:43:57<1:43:12,  3.39it/s]
 94%|█████████▍| 350501/371472 [5:43:58<1:38:37,  3.54it/s]
 94%|█████████▍| 350502/371472 [5:43:58<1:46:37,  3.28it/s]
 94%|█████████▍| 350503/371472 [5:43:58<1:44:37,  3.34it/s]
 94%|█████████▍| 350504/371472 [5:43:59<1:45:21,  3.32it/s]
 94%|█████████▍| 350505/371472 [5:43:59<1:38:46,  3.54it/s]
 94%|█████████▍| 350506/371472 [5:43:59<1:41:11,  3.45it/s]
 94%|█████████▍| 350507/371472 [5:43:59<1:37:04,  3.60it/s]
 94%|█████████▍| 350508/371472 [5:44:00<1:36:14,  3.63it/s]
 94%|█████████▍| 350509/371472 [5:44:00<1:39:40,  3.51it/s]
 94%|█████████▍| 350510/371472 [5:44:00<1:40:31,  3.48it/s]
 94%|█████████▍| 350511/371472 [5:44:01<1:45:26,  3.31it/s]
 94%|█████████▍| 350512/371472 [5:44:01<1:40:27,  3.48it/s]
 94%|█████████▍| 350513/371472 [5:44:01<1:42:56,  3.39it/s]
 94%|█████████▍| 350514/371472 [5:44:01<1:40:29,  3.48it/s]
 94%|█████████▍| 350515/371472 [5:44:02<1:42:08,  3.42it/s]
 94%|█████████▍| 350516/371472 [5:44:02<1:48:39,  3.21it/s]
 94%|█████████▍| 350517/371472 [5:44:02<1:53:56,  3.07it/s]
 94%|█████████▍| 350518/371472 [5:44:03<1:46:51,  3.27it/s]
 94%|█████████▍| 350519/371472 [5:44:03<1:45:04,  3.32it/s]
 94%|█████████▍| 350520/371472 [5:44:03<1:43:38,  3.37it/s]
                                                           
{'loss': 2.6393, 'learning_rate': 1.5078971751168955e-07, 'epoch': 15.1}

 94%|█████████▍| 350520/371472 [5:44:03<1:43:38,  3.37it/s]
 94%|█████████▍| 350521/371472 [5:44:03<1:40:33,  3.47it/s]
 94%|█████████▍| 350522/371472 [5:44:04<1:40:18,  3.48it/s]
 94%|█████████▍| 350523/371472 [5:44:04<1:39:01,  3.53it/s]
 94%|█████████▍| 350524/371472 [5:44:04<1:35:37,  3.65it/s]
 94%|█████████▍| 350525/371472 [5:44:05<1:34:16,  3.70it/s]
 94%|█████████▍| 350526/371472 [5:44:05<1:38:25,  3.55it/s]
 94%|█████████▍| 350527/371472 [5:44:05<1:36:06,  3.63it/s]
 94%|█████████▍| 350528/371472 [5:44:05<1:38:08,  3.56it/s]
 94%|█████████▍| 350529/371472 [5:44:06<1:35:25,  3.66it/s]
 94%|█████████▍| 350530/371472 [5:44:06<1:41:15,  3.45it/s]
 94%|█████████▍| 350531/371472 [5:44:06<1:39:39,  3.50it/s]
 94%|█████████▍| 350532/371472 [5:44:07<1:38:18,  3.55it/s]
 94%|█████████▍| 350533/371472 [5:44:07<1:34:40,  3.69it/s]
 94%|█████████▍| 350534/371472 [5:44:07<1:35:44,  3.64it/s]
 94%|█████████▍| 350535/371472 [5:44:07<1:34:25,  3.70it/s]
 94%|█████████▍| 350536/371472 [5:44:08<1:35:48,  3.64it/s]
 94%|█████████▍| 350537/371472 [5:44:08<1:41:08,  3.45it/s]
 94%|█████████▍| 350538/371472 [5:44:08<1:42:01,  3.42it/s]
 94%|█████████▍| 350539/371472 [5:44:09<1:44:40,  3.33it/s]
 94%|█████████▍| 350540/371472 [5:44:09<1:43:34,  3.37it/s]
                                                           
{'loss': 2.4884, 'learning_rate': 1.5074123553621063e-07, 'epoch': 15.1}

 94%|█████████▍| 350540/371472 [5:44:09<1:43:34,  3.37it/s]
 94%|█████████▍| 350541/371472 [5:44:09<1:41:28,  3.44it/s]
 94%|█████████▍| 350542/371472 [5:44:09<1:46:21,  3.28it/s]
 94%|█████████▍| 350543/371472 [5:44:10<1:44:37,  3.33it/s]
 94%|█████████▍| 350544/371472 [5:44:10<1:40:19,  3.48it/s]
 94%|█████████▍| 350545/371472 [5:44:10<1:36:22,  3.62it/s]
 94%|█████████▍| 350546/371472 [5:44:11<1:36:22,  3.62it/s]
 94%|█████████▍| 350547/371472 [5:44:11<1:34:04,  3.71it/s]
 94%|█████████▍| 350548/371472 [5:44:11<1:32:29,  3.77it/s]
 94%|█████████▍| 350549/371472 [5:44:11<1:33:11,  3.74it/s]
 94%|█████████▍| 350550/371472 [5:44:12<1:33:54,  3.71it/s]
 94%|█████████▍| 350551/371472 [5:44:12<1:38:23,  3.54it/s]
 94%|█████████▍| 350552/371472 [5:44:12<1:39:57,  3.49it/s]
 94%|█████████▍| 350553/371472 [5:44:12<1:37:38,  3.57it/s]
 94%|█████████▍| 350554/371472 [5:44:13<1:38:26,  3.54it/s]
 94%|█████████▍| 350555/371472 [5:44:13<1:38:56,  3.52it/s]
 94%|█████████▍| 350556/371472 [5:44:13<1:35:05,  3.67it/s]
 94%|█████████▍| 350557/371472 [5:44:14<1:33:35,  3.72it/s]
 94%|█████████▍| 350558/371472 [5:44:14<1:34:52,  3.67it/s]
 94%|█████████▍| 350559/371472 [5:44:14<1:34:36,  3.68it/s]
 94%|█████████▍| 350560/371472 [5:44:14<1:34:02,  3.71it/s]
                                                           
{'loss': 2.6883, 'learning_rate': 1.5069275356073178e-07, 'epoch': 15.1}

 94%|█████████▍| 350560/371472 [5:44:14<1:34:02,  3.71it/s]
 94%|█████████▍| 350561/371472 [5:44:15<1:34:55,  3.67it/s]
 94%|█████████▍| 350562/371472 [5:44:15<1:34:55,  3.67it/s]
 94%|█████████▍| 350563/371472 [5:44:15<1:36:06,  3.63it/s]
 94%|█████████▍| 350564/371472 [5:44:15<1:34:14,  3.70it/s]
 94%|█████████▍| 350565/371472 [5:44:16<1:38:30,  3.54it/s]
 94%|█████████▍| 350566/371472 [5:44:16<1:38:20,  3.54it/s]
 94%|█████████▍| 350567/371472 [5:44:16<1:38:14,  3.55it/s]
 94%|█████████▍| 350568/371472 [5:44:17<1:39:02,  3.52it/s]
 94%|█████████▍| 350569/371472 [5:44:17<1:41:40,  3.43it/s]
 94%|█████████▍| 350570/371472 [5:44:17<1:38:36,  3.53it/s]
 94%|█████████▍| 350571/371472 [5:44:17<1:39:57,  3.49it/s]
 94%|█████████▍| 350572/371472 [5:44:18<1:41:00,  3.45it/s]
 94%|█████████▍| 350573/371472 [5:44:18<1:40:56,  3.45it/s]
 94%|█████████▍| 350574/371472 [5:44:18<1:45:46,  3.29it/s]
 94%|█████████▍| 350575/371472 [5:44:19<1:42:47,  3.39it/s]
 94%|█████████▍| 350576/371472 [5:44:19<1:36:28,  3.61it/s]
 94%|█████████▍| 350577/371472 [5:44:19<1:33:50,  3.71it/s]
 94%|█████████▍| 350578/371472 [5:44:19<1:33:15,  3.73it/s]
 94%|█████████▍| 350579/371472 [5:44:20<1:35:26,  3.65it/s]
 94%|█████████▍| 350580/371472 [5:44:20<1:36:57,  3.59it/s]
                                                           
{'loss': 2.4369, 'learning_rate': 1.506442715852528e-07, 'epoch': 15.1}

 94%|█████████▍| 350580/371472 [5:44:20<1:36:57,  3.59it/s]
 94%|█████████▍| 350581/371472 [5:44:20<1:41:18,  3.44it/s]
 94%|█████████▍| 350582/371472 [5:44:21<1:43:08,  3.38it/s]
 94%|█████████▍| 350583/371472 [5:44:21<1:38:41,  3.53it/s]
 94%|█████████▍| 350584/371472 [5:44:21<1:42:53,  3.38it/s]
 94%|█████████▍| 350585/371472 [5:44:22<1:41:41,  3.42it/s]
 94%|█████████▍| 350586/371472 [5:44:22<1:50:20,  3.15it/s]
 94%|█████████▍| 350587/371472 [5:44:22<1:46:05,  3.28it/s]
 94%|█████████▍| 350588/371472 [5:44:22<1:40:29,  3.46it/s]
 94%|█████████▍| 350589/371472 [5:44:23<1:41:46,  3.42it/s]
 94%|█████████▍| 350590/371472 [5:44:23<1:40:55,  3.45it/s]
 94%|█████████▍| 350591/371472 [5:44:23<1:39:41,  3.49it/s]
 94%|█████████▍| 350592/371472 [5:44:24<1:38:41,  3.53it/s]
 94%|█████████▍| 350593/371472 [5:44:24<1:33:55,  3.70it/s]
 94%|█████████▍| 350594/371472 [5:44:24<1:30:18,  3.85it/s]
 94%|█████████▍| 350595/371472 [5:44:24<1:33:39,  3.71it/s]
 94%|█████████▍| 350596/371472 [5:44:25<1:34:47,  3.67it/s]
 94%|█████████▍| 350597/371472 [5:44:25<1:37:55,  3.55it/s]
 94%|█████████▍| 350598/371472 [5:44:25<1:49:55,  3.16it/s]
 94%|█████████▍| 350599/371472 [5:44:26<1:52:55,  3.08it/s]
 94%|█████████▍| 350600/371472 [5:44:26<1:55:47,  3.00it/s]
                                                           
{'loss': 2.4566, 'learning_rate': 1.5059578960977397e-07, 'epoch': 15.1}

 94%|█████████▍| 350600/371472 [5:44:26<1:55:47,  3.00it/s]
 94%|█████████▍| 350601/371472 [5:44:26<1:51:12,  3.13it/s]
 94%|█████████▍| 350602/371472 [5:44:27<1:47:39,  3.23it/s]
 94%|█████████▍| 350603/371472 [5:44:27<1:50:17,  3.15it/s]
 94%|█████████▍| 350604/371472 [5:44:27<1:46:19,  3.27it/s]
 94%|█████████▍| 350605/371472 [5:44:28<1:48:19,  3.21it/s]
 94%|█████████▍| 350606/371472 [5:44:28<1:42:38,  3.39it/s]
 94%|█████████▍| 350607/371472 [5:44:28<1:43:48,  3.35it/s]
 94%|█████████▍| 350608/371472 [5:44:28<1:38:38,  3.53it/s]
 94%|█████████▍| 350609/371472 [5:44:29<1:39:30,  3.49it/s]
 94%|█████████▍| 350610/371472 [5:44:29<1:43:59,  3.34it/s]
 94%|█████████▍| 350611/371472 [5:44:29<1:44:11,  3.34it/s]
 94%|█████████▍| 350612/371472 [5:44:29<1:40:03,  3.47it/s]
 94%|█████████▍| 350613/371472 [5:44:30<1:38:07,  3.54it/s]
 94%|█████████▍| 350614/371472 [5:44:30<1:40:31,  3.46it/s]
 94%|█████████▍| 350615/371472 [5:44:30<1:36:48,  3.59it/s]
 94%|█████████▍| 350616/371472 [5:44:31<1:38:15,  3.54it/s]
 94%|█████████▍| 350617/371472 [5:44:31<1:43:21,  3.36it/s]
 94%|█████████▍| 350618/371472 [5:44:31<1:39:52,  3.48it/s]
 94%|█████████▍| 350619/371472 [5:44:31<1:38:16,  3.54it/s]
 94%|█████████▍| 350620/371472 [5:44:32<1:50:09,  3.15it/s]
                                                           
{'loss': 2.6296, 'learning_rate': 1.5054730763429504e-07, 'epoch': 15.1}

 94%|█████████▍| 350620/371472 [5:44:32<1:50:09,  3.15it/s]
 94%|█████████▍| 350621/371472 [5:44:32<1:43:25,  3.36it/s]
 94%|█████████▍| 350622/371472 [5:44:32<1:42:11,  3.40it/s]
 94%|█████████▍| 350623/371472 [5:44:33<1:43:27,  3.36it/s]
 94%|█████████▍| 350624/371472 [5:44:33<1:40:07,  3.47it/s]
 94%|█████████▍| 350625/371472 [5:44:33<1:43:59,  3.34it/s]
 94%|█████████▍| 350626/371472 [5:44:34<1:39:11,  3.50it/s]
 94%|█████████▍| 350627/371472 [5:44:34<1:38:39,  3.52it/s]
 94%|█████████▍| 350628/371472 [5:44:34<1:35:18,  3.64it/s]
 94%|█████████▍| 350629/371472 [5:44:34<1:40:58,  3.44it/s]
 94%|█████████▍| 350630/371472 [5:44:35<1:37:27,  3.56it/s]
 94%|█████████▍| 350631/371472 [5:44:35<1:33:46,  3.70it/s]
 94%|█████████▍| 350632/371472 [5:44:35<1:37:36,  3.56it/s]
 94%|█████████▍| 350633/371472 [5:44:36<1:47:38,  3.23it/s]
 94%|█████████▍| 350634/371472 [5:44:36<1:40:32,  3.45it/s]
 94%|█████████▍| 350635/371472 [5:44:36<1:39:49,  3.48it/s]
 94%|█████████▍| 350636/371472 [5:44:36<1:37:31,  3.56it/s]
 94%|█████████▍| 350637/371472 [5:44:37<1:33:44,  3.70it/s]
 94%|█████████▍| 350638/371472 [5:44:37<1:34:20,  3.68it/s]
 94%|█████████▍| 350639/371472 [5:44:37<1:31:58,  3.78it/s]
 94%|█████████▍| 350640/371472 [5:44:37<1:36:29,  3.60it/s]
                                                           
{'loss': 2.5365, 'learning_rate': 1.504988256588162e-07, 'epoch': 15.1}

 94%|█████████▍| 350640/371472 [5:44:37<1:36:29,  3.60it/s]
 94%|█████████▍| 350641/371472 [5:44:38<1:36:16,  3.61it/s]
 94%|█████████▍| 350642/371472 [5:44:38<1:36:12,  3.61it/s]
 94%|█████████▍| 350643/371472 [5:44:38<1:35:06,  3.65it/s]
 94%|█████████▍| 350644/371472 [5:44:39<1:32:30,  3.75it/s]
 94%|█████████▍| 350645/371472 [5:44:39<1:37:10,  3.57it/s]
 94%|█████████▍| 350646/371472 [5:44:39<1:36:06,  3.61it/s]
 94%|█████████▍| 350647/371472 [5:44:39<1:38:02,  3.54it/s]
 94%|█████████▍| 350648/371472 [5:44:40<1:32:53,  3.74it/s]
 94%|█████████▍| 350649/371472 [5:44:40<1:32:30,  3.75it/s]
 94%|█████████▍| 350650/371472 [5:44:40<1:34:25,  3.68it/s]
 94%|█████████▍| 350651/371472 [5:44:40<1:34:29,  3.67it/s]
 94%|█████████▍| 350652/371472 [5:44:41<1:34:46,  3.66it/s]
 94%|█████████▍| 350653/371472 [5:44:41<1:37:13,  3.57it/s]
 94%|█████████▍| 350654/371472 [5:44:41<1:38:46,  3.51it/s]
 94%|█████████▍| 350655/371472 [5:44:42<1:46:22,  3.26it/s]
 94%|█████████▍| 350656/371472 [5:44:42<1:48:40,  3.19it/s]
 94%|█████████▍| 350657/371472 [5:44:42<1:48:20,  3.20it/s]
 94%|█████████▍| 350658/371472 [5:44:43<1:42:09,  3.40it/s]
 94%|█████████▍| 350659/371472 [5:44:43<1:36:58,  3.58it/s]
 94%|█████████▍| 350660/371472 [5:44:43<1:33:48,  3.70it/s]
                                                           
{'loss': 2.63, 'learning_rate': 1.5045034368333727e-07, 'epoch': 15.1}

 94%|█████████▍| 350660/371472 [5:44:43<1:33:48,  3.70it/s]
 94%|█████████▍| 350661/371472 [5:44:43<1:37:37,  3.55it/s]
 94%|█████████▍| 350662/371472 [5:44:44<1:35:12,  3.64it/s]
 94%|█████████▍| 350663/371472 [5:44:44<1:34:32,  3.67it/s]
 94%|█████████▍| 350664/371472 [5:44:44<1:32:11,  3.76it/s]
 94%|█████████▍| 350665/371472 [5:44:44<1:32:27,  3.75it/s]
 94%|█████████▍| 350666/371472 [5:44:45<1:31:53,  3.77it/s]
 94%|█████████▍| 350667/371472 [5:44:45<1:32:01,  3.77it/s]
 94%|█████████▍| 350668/371472 [5:44:45<1:32:26,  3.75it/s]
 94%|█████████▍| 350669/371472 [5:44:46<1:42:16,  3.39it/s]
 94%|█████████▍| 350670/371472 [5:44:46<1:38:24,  3.52it/s]
 94%|█████████▍| 350671/371472 [5:44:46<1:41:12,  3.43it/s]
 94%|█████████▍| 350672/371472 [5:44:46<1:38:46,  3.51it/s]
 94%|█████████▍| 350673/371472 [5:44:47<1:37:38,  3.55it/s]
 94%|█████████▍| 350674/371472 [5:44:47<1:34:42,  3.66it/s]
 94%|█████████▍| 350675/371472 [5:44:47<1:37:16,  3.56it/s]
 94%|█████████▍| 350676/371472 [5:44:48<1:37:00,  3.57it/s]
 94%|█████████▍| 350677/371472 [5:44:48<1:34:05,  3.68it/s]
 94%|█████████▍| 350678/371472 [5:44:48<1:36:43,  3.58it/s]
 94%|█████████▍| 350679/371472 [5:44:48<1:35:50,  3.62it/s]
 94%|█████████▍| 350680/371472 [5:44:49<1:34:29,  3.67it/s]
                                                           
{'loss': 2.5121, 'learning_rate': 1.5040186170785842e-07, 'epoch': 15.1}

 94%|█████████▍| 350680/371472 [5:44:49<1:34:29,  3.67it/s]
 94%|█████████▍| 350681/371472 [5:44:49<1:36:40,  3.58it/s]
 94%|█████████▍| 350682/371472 [5:44:49<1:36:31,  3.59it/s]
 94%|█████████▍| 350683/371472 [5:44:49<1:35:10,  3.64it/s]
 94%|█████████▍| 350684/371472 [5:44:50<1:40:09,  3.46it/s]
 94%|█████████▍| 350685/371472 [5:44:50<1:38:49,  3.51it/s]
 94%|█████████▍| 350686/371472 [5:44:50<1:40:39,  3.44it/s]
 94%|█████████▍| 350687/371472 [5:44:51<1:35:08,  3.64it/s]
 94%|█████████▍| 350688/371472 [5:44:51<1:36:38,  3.58it/s]
 94%|█████████▍| 350689/371472 [5:44:51<1:33:59,  3.68it/s]
 94%|█████████▍| 350690/371472 [5:44:51<1:35:38,  3.62it/s]
 94%|█████████▍| 350691/371472 [5:44:52<1:35:41,  3.62it/s]
 94%|█████████▍| 350692/371472 [5:44:52<1:35:49,  3.61it/s]
 94%|█████████▍| 350693/371472 [5:44:52<1:35:39,  3.62it/s]
 94%|█████████▍| 350694/371472 [5:44:53<1:32:50,  3.73it/s]
 94%|█████████▍| 350695/371472 [5:44:53<1:34:06,  3.68it/s]
 94%|█████████▍| 350696/371472 [5:44:53<1:45:14,  3.29it/s]
 94%|█████████▍| 350697/371472 [5:44:53<1:39:04,  3.50it/s]
 94%|█████████▍| 350698/371472 [5:44:54<1:46:16,  3.26it/s]
 94%|█████████▍| 350699/371472 [5:44:54<1:41:57,  3.40it/s]
 94%|█████████▍| 350700/371472 [5:44:54<1:40:56,  3.43it/s]
                                                           
{'loss': 2.5946, 'learning_rate': 1.5035337973237946e-07, 'epoch': 15.11}

 94%|█████████▍| 350700/371472 [5:44:54<1:40:56,  3.43it/s]
 94%|█████████▍| 350701/371472 [5:44:55<1:38:31,  3.51it/s]
 94%|█████████▍| 350702/371472 [5:44:55<1:35:30,  3.62it/s]
 94%|█████████▍| 350703/371472 [5:44:55<1:32:34,  3.74it/s]
 94%|█████████▍| 350704/371472 [5:44:55<1:32:37,  3.74it/s]
 94%|█████████▍| 350705/371472 [5:44:56<1:31:55,  3.77it/s]
 94%|█████████▍| 350706/371472 [5:44:56<1:33:28,  3.70it/s]
 94%|█████████▍| 350707/371472 [5:44:56<1:34:09,  3.68it/s]
 94%|█████████▍| 350708/371472 [5:44:56<1:36:09,  3.60it/s]
 94%|█████████▍| 350709/371472 [5:44:57<1:33:15,  3.71it/s]
 94%|█████████▍| 350710/371472 [5:44:57<1:32:35,  3.74it/s]
 94%|█████████▍| 350711/371472 [5:44:57<1:38:36,  3.51it/s]
 94%|█████████▍| 350712/371472 [5:44:58<1:37:31,  3.55it/s]
 94%|█████████▍| 350713/371472 [5:44:58<1:46:57,  3.23it/s]
 94%|█████████▍| 350714/371472 [5:44:58<1:42:36,  3.37it/s]
 94%|█████████▍| 350715/371472 [5:44:59<1:41:04,  3.42it/s]
 94%|█████████▍| 350716/371472 [5:44:59<1:38:07,  3.53it/s]
 94%|█████████▍| 350717/371472 [5:44:59<1:40:31,  3.44it/s]
 94%|█████████▍| 350718/371472 [5:44:59<1:40:35,  3.44it/s]
 94%|█████████▍| 350719/371472 [5:45:00<1:37:59,  3.53it/s]
 94%|█████████▍| 350720/371472 [5:45:00<1:43:17,  3.35it/s]
                                                           
{'loss': 2.5452, 'learning_rate': 1.5030489775690064e-07, 'epoch': 15.11}

 94%|█████████▍| 350720/371472 [5:45:00<1:43:17,  3.35it/s]
 94%|█████████▍| 350721/371472 [5:45:00<1:41:47,  3.40it/s]
 94%|█████████▍| 350722/371472 [5:45:01<1:39:51,  3.46it/s]
 94%|█████████▍| 350723/371472 [5:45:01<1:37:43,  3.54it/s]
 94%|█████████▍| 350724/371472 [5:45:01<1:35:09,  3.63it/s]
 94%|█████████▍| 350725/371472 [5:45:01<1:41:52,  3.39it/s]
 94%|█████████▍| 350726/371472 [5:45:02<1:37:55,  3.53it/s]
 94%|█████████▍| 350727/371472 [5:45:02<1:36:32,  3.58it/s]
 94%|█████████▍| 350728/371472 [5:45:02<1:38:48,  3.50it/s]
 94%|█████████▍| 350729/371472 [5:45:03<1:51:10,  3.11it/s]
 94%|█████████▍| 350730/371472 [5:45:03<1:45:54,  3.26it/s]
 94%|█████████▍| 350731/371472 [5:45:03<1:40:36,  3.44it/s]
 94%|█████████▍| 350732/371472 [5:45:03<1:38:09,  3.52it/s]
 94%|█████████▍| 350733/371472 [5:45:04<1:35:14,  3.63it/s]
 94%|█████████▍| 350734/371472 [5:45:04<1:35:26,  3.62it/s]
 94%|█████████▍| 350735/371472 [5:45:04<1:31:55,  3.76it/s]
 94%|█████████▍| 350736/371472 [5:45:05<1:35:39,  3.61it/s]
 94%|█████████▍| 350737/371472 [5:45:05<1:32:19,  3.74it/s]
 94%|█████████▍| 350738/371472 [5:45:05<1:30:16,  3.83it/s]
 94%|█████████▍| 350739/371472 [5:45:05<1:30:46,  3.81it/s]
 94%|█████████▍| 350740/371472 [5:45:06<1:34:32,  3.65it/s]
                                                           
{'loss': 2.5496, 'learning_rate': 1.5025641578142168e-07, 'epoch': 15.11}

 94%|█████████▍| 350740/371472 [5:45:06<1:34:32,  3.65it/s]
 94%|█████████▍| 350741/371472 [5:45:06<1:39:18,  3.48it/s]
 94%|█████████▍| 350742/371472 [5:45:06<1:39:27,  3.47it/s]
 94%|█████████▍| 350743/371472 [5:45:06<1:38:36,  3.50it/s]
 94%|█████████▍| 350744/371472 [5:45:07<1:35:04,  3.63it/s]
 94%|█████████▍| 350745/371472 [5:45:07<1:35:22,  3.62it/s]
 94%|█████████▍| 350746/371472 [5:45:07<1:34:01,  3.67it/s]
 94%|█████████▍| 350747/371472 [5:45:08<1:34:05,  3.67it/s]
 94%|█████████▍| 350748/371472 [5:45:08<1:40:36,  3.43it/s]
 94%|█████████▍| 350749/371472 [5:45:08<1:43:32,  3.34it/s]
 94%|█████████▍| 350750/371472 [5:45:08<1:39:43,  3.46it/s]
 94%|█████████▍| 350751/371472 [5:45:09<1:43:00,  3.35it/s]
 94%|█████████▍| 350752/371472 [5:45:09<1:41:24,  3.41it/s]
 94%|█████████▍| 350753/371472 [5:45:09<1:38:44,  3.50it/s]
 94%|█████████▍| 350754/371472 [5:45:10<1:40:58,  3.42it/s]
 94%|█████████▍| 350755/371472 [5:45:10<1:50:33,  3.12it/s]
 94%|█████████▍| 350756/371472 [5:45:10<1:46:39,  3.24it/s]
 94%|█████████▍| 350757/371472 [5:45:11<1:50:33,  3.12it/s]
 94%|█████████▍| 350758/371472 [5:45:11<1:49:06,  3.16it/s]
 94%|█████████▍| 350759/371472 [5:45:11<1:42:15,  3.38it/s]
 94%|█████████▍| 350760/371472 [5:45:11<1:37:28,  3.54it/s]
                                                           
{'loss': 2.6479, 'learning_rate': 1.5020793380594286e-07, 'epoch': 15.11}

 94%|█████████▍| 350760/371472 [5:45:11<1:37:28,  3.54it/s]
 94%|█████████▍| 350761/371472 [5:45:12<1:38:17,  3.51it/s]
 94%|█████████▍| 350762/371472 [5:45:12<1:34:47,  3.64it/s]
 94%|█████████▍| 350763/371472 [5:45:12<1:34:36,  3.65it/s]
 94%|█████████▍| 350764/371472 [5:45:13<1:38:36,  3.50it/s]
 94%|█████████▍| 350765/371472 [5:45:13<1:37:11,  3.55it/s]
 94%|█████████▍| 350766/371472 [5:45:13<1:33:16,  3.70it/s]
 94%|█████████▍| 350767/371472 [5:45:13<1:38:10,  3.52it/s]
 94%|█████████▍| 350768/371472 [5:45:14<1:37:58,  3.52it/s]
 94%|█████████▍| 350769/371472 [5:45:14<1:36:52,  3.56it/s]
 94%|█████████▍| 350770/371472 [5:45:14<1:37:12,  3.55it/s]
 94%|█████████▍| 350771/371472 [5:45:15<1:38:11,  3.51it/s]
 94%|█████████▍| 350772/371472 [5:45:15<1:36:55,  3.56it/s]
 94%|█████████▍| 350773/371472 [5:45:15<1:37:13,  3.55it/s]
 94%|█████████▍| 350774/371472 [5:45:15<1:36:45,  3.56it/s]
 94%|█████████▍| 350775/371472 [5:45:16<1:36:25,  3.58it/s]
 94%|█████████▍| 350776/371472 [5:45:16<1:34:57,  3.63it/s]
 94%|█████████▍| 350777/371472 [5:45:16<1:35:54,  3.60it/s]
 94%|█████████▍| 350778/371472 [5:45:16<1:33:34,  3.69it/s]
 94%|█████████▍| 350779/371472 [5:45:17<1:35:35,  3.61it/s]
 94%|█████████▍| 350780/371472 [5:45:17<1:49:28,  3.15it/s]
                                                           
{'loss': 2.5785, 'learning_rate': 1.501594518304639e-07, 'epoch': 15.11}

 94%|█████████▍| 350780/371472 [5:45:17<1:49:28,  3.15it/s]
 94%|█████████▍| 350781/371472 [5:45:17<1:47:31,  3.21it/s]
 94%|█████████▍| 350782/371472 [5:45:18<1:53:19,  3.04it/s]
 94%|█████████▍| 350783/371472 [5:45:18<1:45:48,  3.26it/s]
 94%|█████████▍| 350784/371472 [5:45:18<1:42:08,  3.38it/s]
 94%|█████████▍| 350785/371472 [5:45:19<1:44:33,  3.30it/s]
 94%|█████████▍| 350786/371472 [5:45:19<1:44:00,  3.31it/s]
 94%|█████████▍| 350787/371472 [5:45:19<1:47:30,  3.21it/s]
 94%|█████████▍| 350788/371472 [5:45:20<1:47:25,  3.21it/s]
 94%|█████████▍| 350789/371472 [5:45:20<1:43:04,  3.34it/s]
 94%|█████████▍| 350790/371472 [5:45:20<1:39:30,  3.46it/s]
 94%|█████████▍| 350791/371472 [5:45:20<1:38:16,  3.51it/s]
 94%|█████████▍| 350792/371472 [5:45:21<1:37:44,  3.53it/s]
 94%|█████████▍| 350793/371472 [5:45:21<1:34:59,  3.63it/s]
 94%|█████████▍| 350794/371472 [5:45:21<1:32:24,  3.73it/s]
 94%|█████████▍| 350795/371472 [5:45:21<1:30:37,  3.80it/s]
 94%|█████████▍| 350796/371472 [5:45:22<1:32:44,  3.72it/s]
 94%|█████████▍| 350797/371472 [5:45:22<1:31:05,  3.78it/s]
 94%|█████████▍| 350798/371472 [5:45:22<1:33:42,  3.68it/s]
 94%|█████████▍| 350799/371472 [5:45:23<1:33:20,  3.69it/s]
 94%|█████████▍| 350800/371472 [5:45:23<1:33:38,  3.68it/s]
                                                           
{'loss': 2.7014, 'learning_rate': 1.5011096985498506e-07, 'epoch': 15.11}

 94%|█████████▍| 350800/371472 [5:45:23<1:33:38,  3.68it/s]
 94%|█████████▍| 350801/371472 [5:45:23<1:36:35,  3.57it/s]
 94%|█████████▍| 350802/371472 [5:45:23<1:42:43,  3.35it/s]
 94%|█████████▍| 350803/371472 [5:45:24<1:38:28,  3.50it/s]
 94%|█████████▍| 350804/371472 [5:45:24<1:40:51,  3.42it/s]
 94%|█████████▍| 350805/371472 [5:45:24<1:45:42,  3.26it/s]
 94%|█████████▍| 350806/371472 [5:45:25<1:42:41,  3.35it/s]
 94%|█████████▍| 350807/371472 [5:45:25<1:45:17,  3.27it/s]
 94%|█████████▍| 350808/371472 [5:45:25<1:44:20,  3.30it/s]
 94%|█████████▍| 350809/371472 [5:45:26<1:39:23,  3.46it/s]
 94%|█████████▍| 350810/371472 [5:45:26<1:47:08,  3.21it/s]
 94%|█████████▍| 350811/371472 [5:45:26<1:43:41,  3.32it/s]
 94%|█████████▍| 350812/371472 [5:45:26<1:37:45,  3.52it/s]
 94%|█████████▍| 350813/371472 [5:45:27<1:35:39,  3.60it/s]
 94%|█████████▍| 350814/371472 [5:45:27<1:38:11,  3.51it/s]
 94%|█████████▍| 350815/371472 [5:45:27<1:41:51,  3.38it/s]
 94%|█████████▍| 350816/371472 [5:45:28<1:41:51,  3.38it/s]
 94%|█████████▍| 350817/371472 [5:45:28<1:44:28,  3.30it/s]
 94%|█████████▍| 350818/371472 [5:45:28<1:40:50,  3.41it/s]
 94%|█████████▍| 350819/371472 [5:45:28<1:37:10,  3.54it/s]
 94%|█████████▍| 350820/371472 [5:45:29<1:35:59,  3.59it/s]
                                                           
{'loss': 2.3552, 'learning_rate': 1.500624878795061e-07, 'epoch': 15.11}

 94%|█████████▍| 350820/371472 [5:45:29<1:35:59,  3.59it/s]
 94%|█████████▍| 350821/371472 [5:45:29<1:36:36,  3.56it/s]
 94%|█████████▍| 350822/371472 [5:45:29<1:32:28,  3.72it/s]
 94%|█████████▍| 350823/371472 [5:45:30<1:33:43,  3.67it/s]
 94%|█████████▍| 350824/371472 [5:45:30<1:35:13,  3.61it/s]
 94%|█████████▍| 350825/371472 [5:45:30<1:36:35,  3.56it/s]
 94%|█████████▍| 350826/371472 [5:45:30<1:35:26,  3.61it/s]
 94%|█████████▍| 350827/371472 [5:45:31<1:32:02,  3.74it/s]
 94%|█████████▍| 350828/371472 [5:45:31<1:31:45,  3.75it/s]
 94%|█████████▍| 350829/371472 [5:45:31<1:31:51,  3.75it/s]
 94%|█████████▍| 350830/371472 [5:45:31<1:28:38,  3.88it/s]
 94%|█████████▍| 350831/371472 [5:45:32<1:35:03,  3.62it/s]
 94%|█████████▍| 350832/371472 [5:45:32<1:40:23,  3.43it/s]
 94%|█████████▍| 350833/371472 [5:45:32<1:37:13,  3.54it/s]
 94%|█████████▍| 350834/371472 [5:45:33<1:37:38,  3.52it/s]
 94%|█████████▍| 350835/371472 [5:45:33<1:38:17,  3.50it/s]
 94%|█████████▍| 350836/371472 [5:45:33<1:36:35,  3.56it/s]
 94%|█████████▍| 350837/371472 [5:45:33<1:46:09,  3.24it/s]
 94%|█████████▍| 350838/371472 [5:45:34<1:40:55,  3.41it/s]
 94%|█████████▍| 350839/371472 [5:45:34<1:44:23,  3.29it/s]
 94%|█████████▍| 350840/371472 [5:45:34<1:45:18,  3.27it/s]
                                                           
{'loss': 2.5884, 'learning_rate': 1.5001400590402728e-07, 'epoch': 15.11}

 94%|█████████▍| 350840/371472 [5:45:34<1:45:18,  3.27it/s]
 94%|█████████▍| 350841/371472 [5:45:35<1:40:09,  3.43it/s]
 94%|█████████▍| 350842/371472 [5:45:35<1:44:06,  3.30it/s]
 94%|█████████▍| 350843/371472 [5:45:35<1:43:36,  3.32it/s]
 94%|█████████▍| 350844/371472 [5:45:36<1:41:09,  3.40it/s]
 94%|█████████▍| 350845/371472 [5:45:36<1:39:08,  3.47it/s]
 94%|█████████▍| 350846/371472 [5:45:36<1:41:09,  3.40it/s]
 94%|█████████▍| 350847/371472 [5:45:36<1:38:56,  3.47it/s]
 94%|█████████▍| 350848/371472 [5:45:37<1:40:27,  3.42it/s]
 94%|█████████▍| 350849/371472 [5:45:37<1:40:46,  3.41it/s]
 94%|█████████▍| 350850/371472 [5:45:37<1:40:19,  3.43it/s]
 94%|█████████▍| 350851/371472 [5:45:38<1:37:41,  3.52it/s]
 94%|█████████▍| 350852/371472 [5:45:38<1:40:39,  3.41it/s]
 94%|█████████▍| 350853/371472 [5:45:38<1:46:08,  3.24it/s]
 94%|█████████▍| 350854/371472 [5:45:38<1:42:08,  3.36it/s]
 94%|█████████▍| 350855/371472 [5:45:39<1:42:09,  3.36it/s]
 94%|█████████▍| 350856/371472 [5:45:39<1:39:18,  3.46it/s]
 94%|█████████▍| 350857/371472 [5:45:39<1:39:22,  3.46it/s]
 94%|█████████▍| 350858/371472 [5:45:40<1:37:54,  3.51it/s]
 94%|█████████▍| 350859/371472 [5:45:40<1:35:38,  3.59it/s]
 94%|█████████▍| 350860/371472 [5:45:40<1:33:44,  3.66it/s]
                                                           
{'loss': 2.4191, 'learning_rate': 1.4996552392854833e-07, 'epoch': 15.11}

 94%|█████████▍| 350860/371472 [5:45:40<1:33:44,  3.66it/s]
 94%|█████████▍| 350861/371472 [5:45:40<1:34:26,  3.64it/s]
 94%|█████████▍| 350862/371472 [5:45:41<1:32:08,  3.73it/s]
 94%|█████████▍| 350863/371472 [5:45:41<1:33:27,  3.68it/s]
 94%|█████████▍| 350864/371472 [5:45:41<1:31:47,  3.74it/s]
 94%|█████████▍| 350865/371472 [5:45:42<1:37:25,  3.53it/s]
 94%|█████████▍| 350866/371472 [5:45:42<1:35:08,  3.61it/s]
 94%|█████████▍| 350867/371472 [5:45:42<1:35:48,  3.58it/s]
 94%|█████████▍| 350868/371472 [5:45:42<1:33:57,  3.65it/s]
 94%|█████████▍| 350869/371472 [5:45:43<1:34:20,  3.64it/s]
 94%|█████████▍| 350870/371472 [5:45:43<1:33:12,  3.68it/s]
 94%|█████████▍| 350871/371472 [5:45:43<1:35:03,  3.61it/s]
 94%|█████████▍| 350872/371472 [5:45:43<1:35:10,  3.61it/s]
 94%|█████████▍| 350873/371472 [5:45:44<1:33:57,  3.65it/s]
 94%|█████████▍| 350874/371472 [5:45:44<1:34:22,  3.64it/s]
 94%|█████████▍| 350875/371472 [5:45:44<1:34:38,  3.63it/s]
 94%|█████████▍| 350876/371472 [5:45:45<1:34:30,  3.63it/s]
 94%|█████████▍| 350877/371472 [5:45:45<1:33:21,  3.68it/s]
 94%|█████████▍| 350878/371472 [5:45:45<1:35:37,  3.59it/s]
 94%|█████████▍| 350879/371472 [5:45:45<1:33:38,  3.66it/s]
 94%|█████████▍| 350880/371472 [5:45:46<1:35:19,  3.60it/s]
                                                           
{'loss': 2.638, 'learning_rate': 1.4991704195306948e-07, 'epoch': 15.11}

 94%|█████████▍| 350880/371472 [5:45:46<1:35:19,  3.60it/s]
 94%|█████████▍| 350881/371472 [5:45:46<1:31:57,  3.73it/s]
 94%|█████████▍| 350882/371472 [5:45:46<1:33:58,  3.65it/s]
 94%|█████████▍| 350883/371472 [5:45:46<1:31:27,  3.75it/s]
 94%|█████████▍| 350884/371472 [5:45:47<1:37:44,  3.51it/s]
 94%|█████████▍| 350885/371472 [5:45:47<1:34:38,  3.63it/s]
 94%|█████████▍| 350886/371472 [5:45:47<1:35:33,  3.59it/s]
 94%|█████████▍| 350887/371472 [5:45:48<1:37:57,  3.50it/s]
 94%|█████████▍| 350888/371472 [5:45:48<1:38:50,  3.47it/s]
 94%|█████████▍| 350889/371472 [5:45:48<1:42:29,  3.35it/s]
 94%|█████████▍| 350890/371472 [5:45:49<1:40:41,  3.41it/s]
 94%|█████████▍| 350891/371472 [5:45:49<1:39:02,  3.46it/s]
 94%|█████████▍| 350892/371472 [5:45:49<1:36:54,  3.54it/s]
 94%|█████████▍| 350893/371472 [5:45:49<1:49:41,  3.13it/s]
 94%|█████████▍| 350894/371472 [5:45:50<1:47:58,  3.18it/s]
 94%|█████████▍| 350895/371472 [5:45:50<1:42:21,  3.35it/s]
 94%|█████████▍| 350896/371472 [5:45:50<1:41:34,  3.38it/s]
 94%|█████████▍| 350897/371472 [5:45:51<1:37:34,  3.51it/s]
 94%|█████████▍| 350898/371472 [5:45:51<1:37:30,  3.52it/s]
 94%|█████████▍| 350899/371472 [5:45:51<1:36:56,  3.54it/s]
 94%|█████████▍| 350900/371472 [5:45:51<1:38:35,  3.48it/s]
                                                           
{'loss': 2.6478, 'learning_rate': 1.4986855997759055e-07, 'epoch': 15.11}

 94%|█████████▍| 350900/371472 [5:45:51<1:38:35,  3.48it/s]
 94%|█████████▍| 350901/371472 [5:45:52<1:34:29,  3.63it/s]
 94%|█████████▍| 350902/371472 [5:45:52<1:41:39,  3.37it/s]
 94%|█████████▍| 350903/371472 [5:45:52<1:46:06,  3.23it/s]
 94%|█████████▍| 350904/371472 [5:45:53<1:48:26,  3.16it/s]
 94%|█████████▍| 350905/371472 [5:45:53<1:41:13,  3.39it/s]
 94%|█████████▍| 350906/371472 [5:45:53<1:39:38,  3.44it/s]
 94%|█████████▍| 350907/371472 [5:45:54<1:39:43,  3.44it/s]
 94%|█████████▍| 350908/371472 [5:45:54<1:39:22,  3.45it/s]
 94%|█████████▍| 350909/371472 [5:45:54<1:37:26,  3.52it/s]
 94%|█████████▍| 350910/371472 [5:45:54<1:40:44,  3.40it/s]
 94%|█████████▍| 350911/371472 [5:45:55<1:40:53,  3.40it/s]
 94%|█████████▍| 350912/371472 [5:45:55<1:40:55,  3.40it/s]
 94%|█████████▍| 350913/371472 [5:45:55<1:46:16,  3.22it/s]
 94%|█████████▍| 350914/371472 [5:45:56<1:52:04,  3.06it/s]
 94%|█████████▍| 350915/371472 [5:45:56<1:51:04,  3.08it/s]
 94%|█████████▍| 350916/371472 [5:45:56<1:46:50,  3.21it/s]
 94%|█████████▍| 350917/371472 [5:45:57<1:40:54,  3.39it/s]
 94%|█████████▍| 350918/371472 [5:45:57<1:39:10,  3.45it/s]
 94%|█████████▍| 350919/371472 [5:45:57<1:42:58,  3.33it/s]
 94%|█████████▍| 350920/371472 [5:45:57<1:40:13,  3.42it/s]
                                                           
{'loss': 2.5153, 'learning_rate': 1.4982007800211165e-07, 'epoch': 15.11}

 94%|█████████▍| 350920/371472 [5:45:57<1:40:13,  3.42it/s]
 94%|█████████▍| 350921/371472 [5:45:58<1:38:32,  3.48it/s]
 94%|█████████▍| 350922/371472 [5:45:58<1:37:26,  3.51it/s]
 94%|█████████▍| 350923/371472 [5:45:58<1:41:07,  3.39it/s]
 94%|█████████▍| 350924/371472 [5:45:59<1:39:28,  3.44it/s]
 94%|█████████▍| 350925/371472 [5:45:59<1:41:39,  3.37it/s]
 94%|█████████▍| 350926/371472 [5:45:59<1:40:03,  3.42it/s]
 94%|█████████▍| 350927/371472 [5:45:59<1:41:57,  3.36it/s]
 94%|█████████▍| 350928/371472 [5:46:00<1:44:47,  3.27it/s]
 94%|█████████▍| 350929/371472 [5:46:00<1:41:14,  3.38it/s]
 94%|█████████▍| 350930/371472 [5:46:00<1:44:50,  3.27it/s]
 94%|█████████▍| 350931/371472 [5:46:01<1:43:28,  3.31it/s]
 94%|█████████▍| 350932/371472 [5:46:01<1:38:30,  3.48it/s]
 94%|█████████▍| 350933/371472 [5:46:01<1:37:04,  3.53it/s]
 94%|█████████▍| 350934/371472 [5:46:02<1:40:05,  3.42it/s]
 94%|█████████▍| 350935/371472 [5:46:02<1:35:55,  3.57it/s]
 94%|█████████▍| 350936/371472 [5:46:02<1:30:51,  3.77it/s]
 94%|█████████▍| 350937/371472 [5:46:02<1:38:41,  3.47it/s]
 94%|█████████▍| 350938/371472 [5:46:03<1:46:51,  3.20it/s]
 94%|█████████▍| 350939/371472 [5:46:03<1:40:59,  3.39it/s]
 94%|█████████▍| 350940/371472 [5:46:03<1:42:14,  3.35it/s]
                                                           
{'loss': 2.6055, 'learning_rate': 1.4977159602663277e-07, 'epoch': 15.12}

 94%|█████████▍| 350940/371472 [5:46:03<1:42:14,  3.35it/s]
 94%|█████████▍| 350941/371472 [5:46:04<1:41:40,  3.37it/s]
 94%|█████████▍| 350942/371472 [5:46:04<1:36:31,  3.54it/s]
 94%|█████████▍| 350943/371472 [5:46:04<1:44:56,  3.26it/s]
 94%|█████████▍| 350944/371472 [5:46:04<1:42:19,  3.34it/s]
 94%|█████████▍| 350945/371472 [5:46:05<1:39:42,  3.43it/s]
 94%|█████████▍| 350946/371472 [5:46:05<1:42:10,  3.35it/s]
 94%|█████████▍| 350947/371472 [5:46:05<1:45:20,  3.25it/s]
 94%|█████████▍| 350948/371472 [5:46:06<1:40:58,  3.39it/s]
 94%|█████████▍| 350949/371472 [5:46:06<1:40:32,  3.40it/s]
 94%|█████████▍| 350950/371472 [5:46:06<1:38:52,  3.46it/s]
 94%|█████████▍| 350951/371472 [5:46:06<1:33:04,  3.67it/s]
 94%|█████████▍| 350952/371472 [5:46:07<1:33:45,  3.65it/s]
 94%|█████████▍| 350953/371472 [5:46:07<1:32:04,  3.71it/s]
 94%|█████████▍| 350954/371472 [5:46:07<1:32:20,  3.70it/s]
 94%|█████████▍| 350955/371472 [5:46:08<1:35:51,  3.57it/s]
 94%|█████████▍| 350956/371472 [5:46:08<1:40:08,  3.41it/s]
 94%|█████████▍| 350957/371472 [5:46:08<1:39:27,  3.44it/s]
 94%|█████████▍| 350958/371472 [5:46:08<1:38:36,  3.47it/s]
 94%|█████████▍| 350959/371472 [5:46:09<1:38:07,  3.48it/s]
 94%|█████████▍| 350960/371472 [5:46:09<1:35:01,  3.60it/s]
                                                           
{'loss': 2.5537, 'learning_rate': 1.4972311405115382e-07, 'epoch': 15.12}

 94%|█████████▍| 350960/371472 [5:46:09<1:35:01,  3.60it/s]
 94%|█████████▍| 350961/371472 [5:46:09<1:32:54,  3.68it/s]
 94%|█████████▍| 350962/371472 [5:46:10<1:34:16,  3.63it/s]
 94%|█████████▍| 350963/371472 [5:46:10<1:33:28,  3.66it/s]
 94%|█████████▍| 350964/371472 [5:46:10<1:35:30,  3.58it/s]
 94%|█████████▍| 350965/371472 [5:46:10<1:35:15,  3.59it/s]
 94%|█████████▍| 350966/371472 [5:46:11<1:33:51,  3.64it/s]
 94%|█████████▍| 350967/371472 [5:46:11<1:34:37,  3.61it/s]
 94%|█████████▍| 350968/371472 [5:46:11<1:36:34,  3.54it/s]
 94%|█████████▍| 350969/371472 [5:46:12<1:38:16,  3.48it/s]
 94%|█████████▍| 350970/371472 [5:46:12<1:34:33,  3.61it/s]
 94%|█████████▍| 350971/371472 [5:46:12<1:31:14,  3.74it/s]
 94%|█████████▍| 350972/371472 [5:46:12<1:33:16,  3.66it/s]
 94%|█████████▍| 350973/371472 [5:46:13<1:34:53,  3.60it/s]
 94%|█████████▍| 350974/371472 [5:46:13<1:32:17,  3.70it/s]
 94%|█████████▍| 350975/371472 [5:46:13<1:30:40,  3.77it/s]
 94%|█████████▍| 350976/371472 [5:46:13<1:31:38,  3.73it/s]
 94%|█████████▍| 350977/371472 [5:46:14<1:34:32,  3.61it/s]
 94%|█████████▍| 350978/371472 [5:46:14<1:32:34,  3.69it/s]
 94%|█████████▍| 350979/371472 [5:46:14<1:33:28,  3.65it/s]
 94%|█████████▍| 350980/371472 [5:46:14<1:30:33,  3.77it/s]
                                                           
{'loss': 2.4827, 'learning_rate': 1.49674632075675e-07, 'epoch': 15.12}

 94%|█████████▍| 350980/371472 [5:46:14<1:30:33,  3.77it/s]
 94%|█████████▍| 350981/371472 [5:46:15<1:28:38,  3.85it/s]
 94%|█████████▍| 350982/371472 [5:46:15<1:32:53,  3.68it/s]
 94%|█████████▍| 350983/371472 [5:46:15<1:39:22,  3.44it/s]
 94%|█████████▍| 350984/371472 [5:46:16<1:37:25,  3.51it/s]
 94%|█████████▍| 350985/371472 [5:46:16<1:35:33,  3.57it/s]
 94%|█████████▍| 350986/371472 [5:46:16<1:36:05,  3.55it/s]
 94%|█████████▍| 350987/371472 [5:46:16<1:34:44,  3.60it/s]
 94%|█████████▍| 350988/371472 [5:46:17<1:35:07,  3.59it/s]
 94%|█████████▍| 350989/371472 [5:46:17<1:49:11,  3.13it/s]
 94%|█████████▍| 350990/371472 [5:46:17<1:42:41,  3.32it/s]
 94%|█████████▍| 350991/371472 [5:46:18<1:40:00,  3.41it/s]
 94%|█████████▍| 350992/371472 [5:46:18<1:36:44,  3.53it/s]
 94%|█████████▍| 350993/371472 [5:46:18<1:39:38,  3.43it/s]
 94%|█████████▍| 350994/371472 [5:46:19<1:38:54,  3.45it/s]
 94%|█████████▍| 350995/371472 [5:46:19<1:37:13,  3.51it/s]
 94%|█████████▍| 350996/371472 [5:46:19<1:34:08,  3.63it/s]
 94%|█████████▍| 350997/371472 [5:46:19<1:35:50,  3.56it/s]
 94%|█████████▍| 350998/371472 [5:46:20<1:44:04,  3.28it/s]
 94%|█████████▍| 350999/371472 [5:46:20<1:42:37,  3.33it/s]
 94%|█████████▍| 351000/371472 [5:46:20<2:01:07,  2.82it/s]
                                                           
{'loss': 2.7124, 'learning_rate': 1.4962615010019604e-07, 'epoch': 15.12}

 94%|█████████▍| 351000/371472 [5:46:20<2:01:07,  2.82it/s]
 94%|█████████▍| 351001/371472 [5:46:21<1:59:07,  2.86it/s]
 94%|█████████▍| 351002/371472 [5:46:21<2:09:36,  2.63it/s]
 94%|█████████▍| 351003/371472 [5:46:22<1:55:19,  2.96it/s]
 94%|█████████▍| 351004/371472 [5:46:22<1:53:19,  3.01it/s]
 94%|█████████▍| 351005/371472 [5:46:22<1:44:02,  3.28it/s]
 94%|█████████▍| 351006/371472 [5:46:22<1:39:03,  3.44it/s]
 94%|█████████▍| 351007/371472 [5:46:23<1:37:19,  3.50it/s]
 94%|█████████▍| 351008/371472 [5:46:23<1:37:17,  3.51it/s]
 94%|█████████▍| 351009/371472 [5:46:23<1:37:29,  3.50it/s]
 94%|█████████▍| 351010/371472 [5:46:23<1:38:00,  3.48it/s]
 94%|█████████▍| 351011/371472 [5:46:24<1:45:59,  3.22it/s]
 94%|█████████▍| 351012/371472 [5:46:24<1:44:51,  3.25it/s]
 94%|█████████▍| 351013/371472 [5:46:24<1:39:51,  3.41it/s]
 94%|█████████▍| 351014/371472 [5:46:25<1:35:55,  3.55it/s]
 94%|█████████▍| 351015/371472 [5:46:25<1:54:09,  2.99it/s]
 94%|█████████▍| 351016/371472 [5:46:25<1:49:40,  3.11it/s]
 94%|█████████▍| 351017/371472 [5:46:26<1:44:45,  3.25it/s]
 94%|█████████▍| 351018/371472 [5:46:26<1:52:33,  3.03it/s]
 94%|█████████▍| 351019/371472 [5:46:26<1:47:23,  3.17it/s]
 94%|█████████▍| 351020/371472 [5:46:27<1:45:32,  3.23it/s]
                                                           
{'loss': 2.4571, 'learning_rate': 1.495776681247172e-07, 'epoch': 15.12}

 94%|█████████▍| 351020/371472 [5:46:27<1:45:32,  3.23it/s]
 94%|█████████▍| 351021/371472 [5:46:27<1:46:50,  3.19it/s]
 94%|█████████▍| 351022/371472 [5:46:27<1:44:49,  3.25it/s]
 94%|█████████▍| 351023/371472 [5:46:28<1:40:36,  3.39it/s]
 94%|█████████▍| 351024/371472 [5:46:28<1:37:12,  3.51it/s]
 94%|█████████▍| 351025/371472 [5:46:28<1:41:27,  3.36it/s]
 94%|█████████▍| 351026/371472 [5:46:28<1:37:49,  3.48it/s]
 94%|█████████▍| 351027/371472 [5:46:29<1:38:43,  3.45it/s]
 94%|█████████▍| 351028/371472 [5:46:29<1:40:52,  3.38it/s]
 94%|█████████▍| 351029/371472 [5:46:29<1:42:14,  3.33it/s]
 94%|█████████▍| 351030/371472 [5:46:30<1:42:01,  3.34it/s]
 94%|█████████▍| 351031/371472 [5:46:30<1:43:16,  3.30it/s]
 94%|█████████▍| 351032/371472 [5:46:30<1:41:53,  3.34it/s]
 94%|█████████▍| 351033/371472 [5:46:30<1:38:08,  3.47it/s]
 94%|█████████▍| 351034/371472 [5:46:31<1:33:25,  3.65it/s]
 94%|█████████▍| 351035/371472 [5:46:31<1:31:16,  3.73it/s]
 94%|█████████▍| 351036/371472 [5:46:31<1:35:20,  3.57it/s]
 94%|█████████▍| 351037/371472 [5:46:32<1:34:12,  3.62it/s]
 94%|█████████▍| 351038/371472 [5:46:32<1:40:43,  3.38it/s]
 94%|█████████▍| 351039/371472 [5:46:32<1:38:24,  3.46it/s]
 94%|█████████▍| 351040/371472 [5:46:32<1:38:23,  3.46it/s]
                                                           
{'loss': 2.5997, 'learning_rate': 1.4952918614923826e-07, 'epoch': 15.12}

 94%|█████████▍| 351040/371472 [5:46:32<1:38:23,  3.46it/s]
 94%|█████████▍| 351041/371472 [5:46:33<1:37:11,  3.50it/s]
 95%|█████████▍| 351042/371472 [5:46:33<1:34:32,  3.60it/s]
 95%|█████████▍| 351043/371472 [5:46:33<1:34:12,  3.61it/s]
 95%|█████████▍| 351044/371472 [5:46:34<1:40:04,  3.40it/s]
 95%|█████████▍| 351045/371472 [5:46:34<1:36:07,  3.54it/s]
 95%|█████████▍| 351046/371472 [5:46:34<1:35:58,  3.55it/s]
 95%|█████████▍| 351047/371472 [5:46:34<1:35:27,  3.57it/s]
 95%|█████████▍| 351048/371472 [5:46:35<1:30:58,  3.74it/s]
 95%|█████████▍| 351049/371472 [5:46:35<1:32:57,  3.66it/s]
 95%|█████████▍| 351050/371472 [5:46:35<1:34:43,  3.59it/s]
 95%|█████████▍| 351051/371472 [5:46:35<1:34:41,  3.59it/s]
 95%|█████████▍| 351052/371472 [5:46:36<1:33:57,  3.62it/s]
 95%|█████████▍| 351053/371472 [5:46:36<1:34:36,  3.60it/s]
 95%|█████████▍| 351054/371472 [5:46:36<1:36:04,  3.54it/s]
 95%|█████████▍| 351055/371472 [5:46:37<1:37:07,  3.50it/s]
 95%|█████████▍| 351056/371472 [5:46:37<1:33:36,  3.63it/s]
 95%|█████████▍| 351057/371472 [5:46:37<1:32:23,  3.68it/s]
 95%|█████████▍| 351058/371472 [5:46:37<1:34:18,  3.61it/s]
 95%|█████████▍| 351059/371472 [5:46:38<1:38:57,  3.44it/s]
 95%|█████████▍| 351060/371472 [5:46:38<1:39:00,  3.44it/s]
                                                           
{'loss': 2.5916, 'learning_rate': 1.494807041737594e-07, 'epoch': 15.12}

 95%|█████████▍| 351060/371472 [5:46:38<1:39:00,  3.44it/s]
 95%|█████████▍| 351061/371472 [5:46:38<1:40:03,  3.40it/s]
 95%|█████████▍| 351062/371472 [5:46:39<1:36:16,  3.53it/s]
 95%|█████████▍| 351063/371472 [5:46:39<1:33:30,  3.64it/s]
 95%|█████████▍| 351064/371472 [5:46:39<1:35:18,  3.57it/s]
 95%|█████████▍| 351065/371472 [5:46:39<1:36:38,  3.52it/s]
 95%|█████████▍| 351066/371472 [5:46:40<1:36:39,  3.52it/s]
 95%|█████████▍| 351067/371472 [5:46:40<1:37:18,  3.50it/s]
 95%|█████████▍| 351068/371472 [5:46:40<1:37:31,  3.49it/s]
 95%|█████████▍| 351069/371472 [5:46:41<1:42:28,  3.32it/s]
 95%|█████████▍| 351070/371472 [5:46:41<1:39:38,  3.41it/s]
 95%|█████████▍| 351071/371472 [5:46:41<1:36:54,  3.51it/s]
 95%|█████████▍| 351072/371472 [5:46:41<1:37:24,  3.49it/s]
 95%|█████████▍| 351073/371472 [5:46:42<1:35:02,  3.58it/s]
 95%|█████████▍| 351074/371472 [5:46:42<1:39:34,  3.41it/s]
 95%|█████████▍| 351075/371472 [5:46:42<1:34:44,  3.59it/s]
 95%|█████████▍| 351076/371472 [5:46:43<1:34:11,  3.61it/s]
 95%|█████████▍| 351077/371472 [5:46:43<1:33:51,  3.62it/s]
 95%|█████████▍| 351078/371472 [5:46:43<1:33:25,  3.64it/s]
 95%|█████████▍| 351079/371472 [5:46:43<1:30:36,  3.75it/s]
 95%|█████████▍| 351080/371472 [5:46:44<1:30:54,  3.74it/s]
                                                           
{'loss': 2.6563, 'learning_rate': 1.4943222219828046e-07, 'epoch': 15.12}

 95%|█████████▍| 351080/371472 [5:46:44<1:30:54,  3.74it/s]
 95%|█████████▍| 351081/371472 [5:46:44<1:33:34,  3.63it/s]
 95%|█████████▍| 351082/371472 [5:46:44<1:52:55,  3.01it/s]
 95%|█████████▍| 351083/371472 [5:46:45<1:47:21,  3.17it/s]
 95%|█████████▍| 351084/371472 [5:46:45<1:43:08,  3.29it/s]
 95%|█████████▍| 351085/371472 [5:46:45<1:36:56,  3.51it/s]
 95%|█████████▍| 351086/371472 [5:46:45<1:33:12,  3.65it/s]
 95%|█████████▍| 351087/371472 [5:46:46<1:30:31,  3.75it/s]
 95%|█████████▍| 351088/371472 [5:46:46<1:33:11,  3.65it/s]
 95%|█████████▍| 351089/371472 [5:46:46<1:33:12,  3.64it/s]
 95%|█████████▍| 351090/371472 [5:46:47<1:40:21,  3.38it/s]
 95%|█████████▍| 351091/371472 [5:46:47<1:38:17,  3.46it/s]
 95%|█████████▍| 351092/371472 [5:46:47<1:36:24,  3.52it/s]
 95%|█████████▍| 351093/371472 [5:46:47<1:35:25,  3.56it/s]
 95%|█████████▍| 351094/371472 [5:46:48<1:33:05,  3.65it/s]
 95%|█████████▍| 351095/371472 [5:46:48<1:31:17,  3.72it/s]
 95%|█████████▍| 351096/371472 [5:46:48<1:31:57,  3.69it/s]
 95%|█████████▍| 351097/371472 [5:46:49<1:36:26,  3.52it/s]
 95%|█████████▍| 351098/371472 [5:46:49<1:37:23,  3.49it/s]
 95%|█████████▍| 351099/371472 [5:46:49<1:38:52,  3.43it/s]
 95%|█████████▍| 351100/371472 [5:46:49<1:36:17,  3.53it/s]
                                                           
{'loss': 2.695, 'learning_rate': 1.4938374022280163e-07, 'epoch': 15.12}

 95%|█████████▍| 351100/371472 [5:46:49<1:36:17,  3.53it/s]
 95%|█████████▍| 351101/371472 [5:46:50<1:34:16,  3.60it/s]
 95%|█████████▍| 351102/371472 [5:46:50<1:36:12,  3.53it/s]
 95%|█████████▍| 351103/371472 [5:46:50<1:36:46,  3.51it/s]
 95%|█████████▍| 351104/371472 [5:46:51<1:44:16,  3.26it/s]
 95%|█████████▍| 351105/371472 [5:46:51<1:36:21,  3.52it/s]
 95%|█████████▍| 351106/371472 [5:46:51<1:44:34,  3.25it/s]
 95%|█████████▍| 351107/371472 [5:46:51<1:39:04,  3.43it/s]
 95%|█████████▍| 351108/371472 [5:46:52<1:35:04,  3.57it/s]
 95%|█████████▍| 351109/371472 [5:46:52<1:33:31,  3.63it/s]
 95%|█████████▍| 351110/371472 [5:46:52<1:34:58,  3.57it/s]
 95%|█████████▍| 351111/371472 [5:46:53<1:35:26,  3.56it/s]
 95%|█████████▍| 351112/371472 [5:46:53<1:41:11,  3.35it/s]
 95%|█████████▍| 351113/371472 [5:46:53<1:40:48,  3.37it/s]
 95%|█████████▍| 351114/371472 [5:46:53<1:37:03,  3.50it/s]
 95%|█████████▍| 351115/371472 [5:46:54<1:36:31,  3.52it/s]
 95%|█████████▍| 351116/371472 [5:46:54<1:43:22,  3.28it/s]
 95%|█████████▍| 351117/371472 [5:46:54<1:41:28,  3.34it/s]
 95%|█████████▍| 351118/371472 [5:46:55<1:39:23,  3.41it/s]
 95%|█████████▍| 351119/371472 [5:46:55<1:35:16,  3.56it/s]
 95%|█████████▍| 351120/371472 [5:46:55<1:41:24,  3.34it/s]
                                                           
{'loss': 2.5684, 'learning_rate': 1.4933525824732268e-07, 'epoch': 15.12}

 95%|█████████▍| 351120/371472 [5:46:55<1:41:24,  3.34it/s]
 95%|█████████▍| 351121/371472 [5:46:55<1:37:33,  3.48it/s]
 95%|█████████▍| 351122/371472 [5:46:56<1:35:17,  3.56it/s]
 95%|█████████▍| 351123/371472 [5:46:56<1:31:51,  3.69it/s]
 95%|█████████▍| 351124/371472 [5:46:56<1:33:11,  3.64it/s]
 95%|█████████▍| 351125/371472 [5:46:57<1:42:06,  3.32it/s]
 95%|█████████▍| 351126/371472 [5:46:57<1:44:42,  3.24it/s]
 95%|█████████▍| 351127/371472 [5:46:57<1:38:25,  3.45it/s]
 95%|█████████▍| 351128/371472 [5:46:57<1:35:00,  3.57it/s]
 95%|█████████▍| 351129/371472 [5:46:58<1:35:36,  3.55it/s]
 95%|█████████▍| 351130/371472 [5:46:58<1:34:45,  3.58it/s]
 95%|█████████▍| 351131/371472 [5:46:58<1:38:34,  3.44it/s]
 95%|█████████▍| 351132/371472 [5:46:59<1:40:55,  3.36it/s]
 95%|█████████▍| 351133/371472 [5:46:59<1:36:41,  3.51it/s]
 95%|█████████▍| 351134/371472 [5:46:59<1:31:48,  3.69it/s]
 95%|█████████▍| 351135/371472 [5:46:59<1:34:06,  3.60it/s]
 95%|█████████▍| 351136/371472 [5:47:00<1:32:18,  3.67it/s]
 95%|█████████▍| 351137/371472 [5:47:00<1:41:01,  3.35it/s]
 95%|█████████▍| 351138/371472 [5:47:00<1:38:10,  3.45it/s]
 95%|█████████▍| 351139/371472 [5:47:01<1:51:27,  3.04it/s]
 95%|█████████▍| 351140/371472 [5:47:01<1:46:42,  3.18it/s]
                                                           
{'loss': 2.7178, 'learning_rate': 1.4928677627184383e-07, 'epoch': 15.12}

 95%|█████████▍| 351140/371472 [5:47:01<1:46:42,  3.18it/s]
 95%|█████████▍| 351141/371472 [5:47:01<1:43:21,  3.28it/s]
 95%|█████████▍| 351142/371472 [5:47:02<1:46:33,  3.18it/s]
 95%|█████████▍| 351143/371472 [5:47:02<1:40:52,  3.36it/s]
 95%|█████████▍| 351144/371472 [5:47:02<1:43:04,  3.29it/s]
 95%|█████████▍| 351145/371472 [5:47:03<1:52:15,  3.02it/s]
 95%|█████████▍| 351146/371472 [5:47:03<1:46:13,  3.19it/s]
 95%|█████████▍| 351147/371472 [5:47:03<1:42:11,  3.32it/s]
 95%|█████████▍| 351148/371472 [5:47:03<1:38:10,  3.45it/s]
 95%|█████████▍| 351149/371472 [5:47:04<1:48:12,  3.13it/s]
 95%|█████████▍| 351150/371472 [5:47:04<1:49:08,  3.10it/s]
 95%|█████████▍| 351151/371472 [5:47:04<1:42:37,  3.30it/s]
 95%|█████████▍| 351152/371472 [5:47:05<1:44:40,  3.24it/s]
 95%|█████████▍| 351153/371472 [5:47:05<1:37:54,  3.46it/s]
 95%|█████████▍| 351154/371472 [5:47:05<1:42:07,  3.32it/s]
 95%|█████████▍| 351155/371472 [5:47:06<1:44:19,  3.25it/s]
 95%|█████████▍| 351156/371472 [5:47:06<1:41:30,  3.34it/s]
 95%|█████████▍| 351157/371472 [5:47:06<1:39:10,  3.41it/s]
 95%|█████████▍| 351158/371472 [5:47:06<1:36:08,  3.52it/s]
 95%|█████████▍| 351159/371472 [5:47:07<1:32:53,  3.64it/s]
 95%|█████████▍| 351160/371472 [5:47:07<1:34:10,  3.59it/s]
                                                           
{'loss': 2.5704, 'learning_rate': 1.492382942963649e-07, 'epoch': 15.13}

 95%|█████████▍| 351160/371472 [5:47:07<1:34:10,  3.59it/s]
 95%|█████████▍| 351161/371472 [5:47:07<1:35:36,  3.54it/s]
 95%|█████████▍| 351162/371472 [5:47:08<1:32:58,  3.64it/s]
 95%|█████████▍| 351163/371472 [5:47:08<1:29:59,  3.76it/s]
 95%|█████████▍| 351164/371472 [5:47:08<1:33:50,  3.61it/s]
 95%|█████████▍| 351165/371472 [5:47:08<1:33:05,  3.64it/s]
 95%|█████████▍| 351166/371472 [5:47:09<1:37:26,  3.47it/s]
 95%|█████████▍| 351167/371472 [5:47:09<1:44:37,  3.23it/s]
 95%|█████████▍| 351168/371472 [5:47:09<1:41:31,  3.33it/s]
 95%|█████████▍| 351169/371472 [5:47:10<1:41:27,  3.34it/s]
 95%|█████████▍| 351170/371472 [5:47:10<1:51:08,  3.04it/s]
 95%|█████████▍| 351171/371472 [5:47:10<1:43:21,  3.27it/s]
 95%|█████████▍| 351172/371472 [5:47:11<1:44:25,  3.24it/s]
 95%|█████████▍| 351173/371472 [5:47:11<1:40:35,  3.36it/s]
 95%|█████████▍| 351174/371472 [5:47:11<1:36:58,  3.49it/s]
 95%|█████████▍| 351175/371472 [5:47:11<1:35:25,  3.55it/s]
 95%|█████████▍| 351176/371472 [5:47:12<1:33:43,  3.61it/s]
 95%|█████████▍| 351177/371472 [5:47:12<1:36:05,  3.52it/s]
 95%|█████████▍| 351178/371472 [5:47:12<1:33:32,  3.62it/s]
 95%|█████████▍| 351179/371472 [5:47:12<1:35:23,  3.55it/s]
 95%|█████████▍| 351180/371472 [5:47:13<1:32:40,  3.65it/s]
                                                           
{'loss': 2.5567, 'learning_rate': 1.4918981232088603e-07, 'epoch': 15.13}

 95%|█████████▍| 351180/371472 [5:47:13<1:32:40,  3.65it/s]
 95%|█████████▍| 351181/371472 [5:47:13<1:36:36,  3.50it/s]
 95%|█████████▍| 351182/371472 [5:47:13<1:34:50,  3.57it/s]
 95%|█████████▍| 351183/371472 [5:47:14<1:31:30,  3.70it/s]
 95%|█████████▍| 351184/371472 [5:47:14<1:34:15,  3.59it/s]
 95%|█████████▍| 351185/371472 [5:47:14<1:32:24,  3.66it/s]
 95%|█████████▍| 351186/371472 [5:47:14<1:34:14,  3.59it/s]
 95%|█████████▍| 351187/371472 [5:47:15<1:33:06,  3.63it/s]
 95%|█████████▍| 351188/371472 [5:47:15<1:31:18,  3.70it/s]
 95%|█████████▍| 351189/371472 [5:47:15<1:34:48,  3.57it/s]
 95%|█████████▍| 351190/371472 [5:47:16<1:34:22,  3.58it/s]
 95%|█████████▍| 351191/371472 [5:47:16<1:34:03,  3.59it/s]
 95%|█████████▍| 351192/371472 [5:47:16<1:30:45,  3.72it/s]
 95%|█████████▍| 351193/371472 [5:47:16<1:37:17,  3.47it/s]
 95%|█████████▍| 351194/371472 [5:47:17<1:34:02,  3.59it/s]
 95%|█████████▍| 351195/371472 [5:47:17<1:36:46,  3.49it/s]
 95%|█████████▍| 351196/371472 [5:47:17<1:37:54,  3.45it/s]
 95%|█████████▍| 351197/371472 [5:47:17<1:33:28,  3.61it/s]
 95%|█████████▍| 351198/371472 [5:47:18<1:36:56,  3.49it/s]
 95%|█████████▍| 351199/371472 [5:47:18<1:39:02,  3.41it/s]
 95%|█████████▍| 351200/371472 [5:47:18<1:36:19,  3.51it/s]
                                                           
{'loss': 2.7135, 'learning_rate': 1.491413303454071e-07, 'epoch': 15.13}

 95%|█████████▍| 351200/371472 [5:47:18<1:36:19,  3.51it/s]
 95%|█████████▍| 351201/371472 [5:47:19<1:36:03,  3.52it/s]
 95%|█████████▍| 351202/371472 [5:47:19<1:35:22,  3.54it/s]
 95%|█████████▍| 351203/371472 [5:47:19<1:36:01,  3.52it/s]
 95%|█████████▍| 351204/371472 [5:47:20<1:39:46,  3.39it/s]
 95%|█████████▍| 351205/371472 [5:47:20<1:40:17,  3.37it/s]
 95%|█████████▍| 351206/371472 [5:47:20<1:36:59,  3.48it/s]
 95%|█████████▍| 351207/371472 [5:47:20<1:35:41,  3.53it/s]
 95%|█████████▍| 351208/371472 [5:47:21<1:39:40,  3.39it/s]
 95%|█████████▍| 351209/371472 [5:47:21<1:37:30,  3.46it/s]
 95%|█████████▍| 351210/371472 [5:47:21<1:38:22,  3.43it/s]
 95%|█████████▍| 351211/371472 [5:47:22<1:36:47,  3.49it/s]
 95%|█████████▍| 351212/371472 [5:47:22<1:47:18,  3.15it/s]
 95%|█████████▍| 351213/371472 [5:47:22<1:42:33,  3.29it/s]
 95%|█████████▍| 351214/371472 [5:47:22<1:38:07,  3.44it/s]
 95%|█████████▍| 351215/371472 [5:47:23<1:39:00,  3.41it/s]
 95%|█████████▍| 351216/371472 [5:47:23<1:37:13,  3.47it/s]
 95%|█████████▍| 351217/371472 [5:47:23<1:34:13,  3.58it/s]
 95%|█████████▍| 351218/371472 [5:47:24<1:34:50,  3.56it/s]
 95%|█████████▍| 351219/371472 [5:47:24<1:35:51,  3.52it/s]
 95%|█████████▍| 351220/371472 [5:47:24<1:33:53,  3.59it/s]
                                                           
{'loss': 2.5743, 'learning_rate': 1.4909284836992827e-07, 'epoch': 15.13}

 95%|█████████▍| 351220/371472 [5:47:24<1:33:53,  3.59it/s]
 95%|█████████▍| 351221/371472 [5:47:24<1:32:45,  3.64it/s]
 95%|█████████▍| 351222/371472 [5:47:25<1:33:10,  3.62it/s]
 95%|█████████▍| 351223/371472 [5:47:25<1:30:04,  3.75it/s]
 95%|█████████▍| 351224/371472 [5:47:25<1:31:58,  3.67it/s]
 95%|█████████▍| 351225/371472 [5:47:25<1:31:06,  3.70it/s]
 95%|█████████▍| 351226/371472 [5:47:26<1:32:19,  3.65it/s]
 95%|█████████▍| 351227/371472 [5:47:26<1:32:35,  3.64it/s]
 95%|█████████▍| 351228/371472 [5:47:26<1:30:45,  3.72it/s]
 95%|█████████▍| 351229/371472 [5:47:27<1:28:53,  3.80it/s]
 95%|█████████▍| 351230/371472 [5:47:27<1:30:31,  3.73it/s]
 95%|█████████▍| 351231/371472 [5:47:27<1:28:57,  3.79it/s]
 95%|█████████▍| 351232/371472 [5:47:27<1:43:50,  3.25it/s]
 95%|█████████▍| 351233/371472 [5:47:28<1:50:00,  3.07it/s]
 95%|█████████▍| 351234/371472 [5:47:28<1:43:15,  3.27it/s]
 95%|█████████▍| 351235/371472 [5:47:28<1:38:57,  3.41it/s]
 95%|█████████▍| 351236/371472 [5:47:29<1:39:08,  3.40it/s]
 95%|█████████▍| 351237/371472 [5:47:29<1:40:59,  3.34it/s]
 95%|█████████▍| 351238/371472 [5:47:29<1:36:32,  3.49it/s]
 95%|█████████▍| 351239/371472 [5:47:30<1:35:08,  3.54it/s]
 95%|█████████▍| 351240/371472 [5:47:30<1:33:36,  3.60it/s]
                                                           
{'loss': 2.7896, 'learning_rate': 1.4904436639444932e-07, 'epoch': 15.13}

 95%|█████████▍| 351240/371472 [5:47:30<1:33:36,  3.60it/s]
 95%|█████████▍| 351241/371472 [5:47:30<1:37:25,  3.46it/s]
 95%|█████████▍| 351242/371472 [5:47:30<1:36:10,  3.51it/s]
 95%|█████████▍| 351243/371472 [5:47:31<1:37:28,  3.46it/s]
 95%|█████████▍| 351244/371472 [5:47:31<1:40:59,  3.34it/s]
 95%|█████████▍| 351245/371472 [5:47:31<1:39:21,  3.39it/s]
 95%|█████████▍| 351246/371472 [5:47:32<1:39:32,  3.39it/s]
 95%|█████████▍| 351247/371472 [5:47:32<1:39:35,  3.38it/s]
 95%|█████████▍| 351248/371472 [5:47:32<1:39:24,  3.39it/s]
 95%|█████████▍| 351249/371472 [5:47:32<1:36:01,  3.51it/s]
 95%|█████████▍| 351250/371472 [5:47:33<1:35:54,  3.51it/s]
 95%|█████████▍| 351251/371472 [5:47:33<1:38:08,  3.43it/s]
 95%|█████████▍| 351252/371472 [5:47:33<1:32:21,  3.65it/s]
 95%|█████████▍| 351253/371472 [5:47:34<1:34:16,  3.57it/s]
 95%|█████████▍| 351254/371472 [5:47:34<1:35:11,  3.54it/s]
 95%|█████████▍| 351255/371472 [5:47:34<1:31:40,  3.68it/s]
 95%|█████████▍| 351256/371472 [5:47:34<1:34:20,  3.57it/s]
 95%|█████████▍| 351257/371472 [5:47:35<1:38:11,  3.43it/s]
 95%|█████████▍| 351258/371472 [5:47:35<1:49:32,  3.08it/s]
 95%|█████████▍| 351259/371472 [5:47:35<1:43:24,  3.26it/s]
 95%|█████████▍| 351260/371472 [5:47:36<1:38:28,  3.42it/s]
                                                           
{'loss': 2.4229, 'learning_rate': 1.4899588441897047e-07, 'epoch': 15.13}

 95%|█████████▍| 351260/371472 [5:47:36<1:38:28,  3.42it/s]
 95%|█████████▍| 351261/371472 [5:47:36<1:37:42,  3.45it/s]
 95%|█████████▍| 351262/371472 [5:47:36<1:39:12,  3.40it/s]
 95%|█████████▍| 351263/371472 [5:47:37<1:39:20,  3.39it/s]
 95%|█████████▍| 351264/371472 [5:47:37<1:33:48,  3.59it/s]
 95%|█████████▍| 351265/371472 [5:47:37<1:34:40,  3.56it/s]
 95%|█████████▍| 351266/371472 [5:47:37<1:34:57,  3.55it/s]
 95%|█████████▍| 351267/371472 [5:47:38<1:36:43,  3.48it/s]
 95%|█████████▍| 351268/371472 [5:47:38<1:34:27,  3.57it/s]
 95%|█████████▍| 351269/371472 [5:47:38<1:32:29,  3.64it/s]
 95%|█████████▍| 351270/371472 [5:47:39<1:40:01,  3.37it/s]
 95%|█████████▍| 351271/371472 [5:47:39<1:37:52,  3.44it/s]
 95%|█████████▍| 351272/371472 [5:47:39<1:39:04,  3.40it/s]
 95%|█████████▍| 351273/371472 [5:47:39<1:50:31,  3.05it/s]
 95%|█████████▍| 351274/371472 [5:47:40<1:42:34,  3.28it/s]
 95%|█████████▍| 351275/371472 [5:47:40<1:42:15,  3.29it/s]
 95%|█████████▍| 351276/371472 [5:47:40<1:42:09,  3.30it/s]
 95%|█████████▍| 351277/371472 [5:47:41<1:39:25,  3.39it/s]
 95%|█████████▍| 351278/371472 [5:47:41<1:35:40,  3.52it/s]
 95%|█████████▍| 351279/371472 [5:47:41<1:35:28,  3.53it/s]
 95%|█████████▍| 351280/371472 [5:47:41<1:38:23,  3.42it/s]
                                                           
{'loss': 2.5538, 'learning_rate': 1.4894740244349154e-07, 'epoch': 15.13}

 95%|█████████▍| 351280/371472 [5:47:41<1:38:23,  3.42it/s]
 95%|█████████▍| 351281/371472 [5:47:42<1:38:22,  3.42it/s]
 95%|█████████▍| 351282/371472 [5:47:42<1:40:26,  3.35it/s]
 95%|█████████▍| 351283/371472 [5:47:42<1:43:36,  3.25it/s]
 95%|█████████▍| 351284/371472 [5:47:43<1:47:36,  3.13it/s]
 95%|█████████▍| 351285/371472 [5:47:43<1:39:38,  3.38it/s]
 95%|█████████▍| 351286/371472 [5:47:43<1:36:03,  3.50it/s]
 95%|█████████▍| 351287/371472 [5:47:44<1:35:57,  3.51it/s]
 95%|█████████▍| 351288/371472 [5:47:44<1:35:57,  3.51it/s]
 95%|█████████▍| 351289/371472 [5:47:44<1:34:49,  3.55it/s]
 95%|█████████▍| 351290/371472 [5:47:44<1:38:58,  3.40it/s]
 95%|█████████▍| 351291/371472 [5:47:45<1:35:38,  3.52it/s]
 95%|█████████▍| 351292/371472 [5:47:45<1:31:54,  3.66it/s]
 95%|█████████▍| 351293/371472 [5:47:45<1:31:26,  3.68it/s]
 95%|█████████▍| 351294/371472 [5:47:46<1:34:11,  3.57it/s]
 95%|█████████▍| 351295/371472 [5:47:46<1:38:24,  3.42it/s]
 95%|█████████▍| 351296/371472 [5:47:46<1:34:16,  3.57it/s]
 95%|█████████▍| 351297/371472 [5:47:46<1:43:12,  3.26it/s]
 95%|█████████▍| 351298/371472 [5:47:47<1:43:41,  3.24it/s]
 95%|█████████▍| 351299/371472 [5:47:47<1:39:07,  3.39it/s]
 95%|█████████▍| 351300/371472 [5:47:47<1:45:30,  3.19it/s]
                                                           
{'loss': 2.6139, 'learning_rate': 1.488989204680127e-07, 'epoch': 15.13}

 95%|█████████▍| 351300/371472 [5:47:47<1:45:30,  3.19it/s]
 95%|█████████▍| 351301/371472 [5:47:48<1:43:34,  3.25it/s]
 95%|█████████▍| 351302/371472 [5:47:48<1:40:53,  3.33it/s]
 95%|█████████▍| 351303/371472 [5:47:48<1:41:08,  3.32it/s]
 95%|█████████▍| 351304/371472 [5:47:49<1:41:49,  3.30it/s]
 95%|█████████▍| 351305/371472 [5:47:49<1:36:58,  3.47it/s]
 95%|█████████▍| 351306/371472 [5:47:49<1:34:55,  3.54it/s]
 95%|█████████▍| 351307/371472 [5:47:49<1:35:20,  3.52it/s]
 95%|█████████▍| 351308/371472 [5:47:50<1:34:50,  3.54it/s]
 95%|█████████▍| 351309/371472 [5:47:50<1:34:24,  3.56it/s]
 95%|█████████▍| 351310/371472 [5:47:50<1:33:51,  3.58it/s]
 95%|█████████▍| 351311/371472 [5:47:51<1:38:50,  3.40it/s]
 95%|█████████▍| 351312/371472 [5:47:51<1:36:13,  3.49it/s]
 95%|█████████▍| 351313/371472 [5:47:51<1:38:06,  3.42it/s]
 95%|█████████▍| 351314/371472 [5:47:51<1:37:00,  3.46it/s]
 95%|█████████▍| 351315/371472 [5:47:52<1:38:20,  3.42it/s]
 95%|█████████▍| 351316/371472 [5:47:52<1:42:11,  3.29it/s]
 95%|█████████▍| 351317/371472 [5:47:52<1:43:20,  3.25it/s]
 95%|█████████▍| 351318/371472 [5:47:53<1:43:51,  3.23it/s]
 95%|█████████▍| 351319/371472 [5:47:53<1:38:25,  3.41it/s]
 95%|█████████▍| 351320/371472 [5:47:53<1:38:26,  3.41it/s]
                                                           
{'loss': 2.5182, 'learning_rate': 1.4885043849253376e-07, 'epoch': 15.13}

 95%|█████████▍| 351320/371472 [5:47:53<1:38:26,  3.41it/s]
 95%|█████████▍| 351321/371472 [5:47:53<1:36:53,  3.47it/s]
 95%|█████████▍| 351322/371472 [5:47:54<1:33:15,  3.60it/s]
 95%|█████████▍| 351323/371472 [5:47:54<1:31:29,  3.67it/s]
 95%|█████████▍| 351324/371472 [5:47:54<1:30:15,  3.72it/s]
 95%|█████████▍| 351325/371472 [5:47:55<1:29:56,  3.73it/s]
 95%|█████████▍| 351326/371472 [5:47:55<1:31:44,  3.66it/s]
 95%|█████████▍| 351327/371472 [5:47:55<1:34:15,  3.56it/s]
 95%|█████████▍| 351328/371472 [5:47:55<1:32:14,  3.64it/s]
 95%|█████████▍| 351329/371472 [5:47:56<1:32:51,  3.62it/s]
 95%|█████████▍| 351330/371472 [5:47:56<1:32:17,  3.64it/s]
 95%|█████████▍| 351331/371472 [5:47:56<1:33:16,  3.60it/s]
 95%|█████████▍| 351332/371472 [5:47:57<1:35:50,  3.50it/s]
 95%|█████████▍| 351333/371472 [5:47:57<1:31:16,  3.68it/s]
 95%|█████████▍| 351334/371472 [5:47:57<1:36:30,  3.48it/s]
 95%|█████████▍| 351335/371472 [5:47:57<1:33:49,  3.58it/s]
 95%|█████████▍| 351336/371472 [5:47:58<1:34:59,  3.53it/s]
 95%|█████████▍| 351337/371472 [5:47:58<1:36:05,  3.49it/s]
 95%|█████████▍| 351338/371472 [5:47:58<1:39:05,  3.39it/s]
 95%|█████████▍| 351339/371472 [5:47:59<1:37:49,  3.43it/s]
 95%|█████████▍| 351340/371472 [5:47:59<1:36:40,  3.47it/s]
                                                           
{'loss': 2.582, 'learning_rate': 1.4880195651705491e-07, 'epoch': 15.13}

 95%|█████████▍| 351340/371472 [5:47:59<1:36:40,  3.47it/s]
 95%|█████████▍| 351341/371472 [5:47:59<1:42:25,  3.28it/s]
 95%|█████████▍| 351342/371472 [5:47:59<1:46:22,  3.15it/s]
 95%|█████████▍| 351343/371472 [5:48:00<1:48:56,  3.08it/s]
 95%|█████████▍| 351344/371472 [5:48:00<1:41:23,  3.31it/s]
 95%|█████████▍| 351345/371472 [5:48:00<1:44:47,  3.20it/s]
 95%|█████████▍| 351346/371472 [5:48:01<1:44:08,  3.22it/s]
 95%|█████████▍| 351347/371472 [5:48:01<1:49:01,  3.08it/s]
 95%|█████████▍| 351348/371472 [5:48:01<1:44:42,  3.20it/s]
 95%|█████████▍| 351349/371472 [5:48:02<1:42:01,  3.29it/s]
 95%|█████████▍| 351350/371472 [5:48:02<1:38:18,  3.41it/s]
 95%|█████████▍| 351351/371472 [5:48:02<1:36:48,  3.46it/s]
 95%|█████████▍| 351352/371472 [5:48:02<1:35:58,  3.49it/s]
 95%|█████████▍| 351353/371472 [5:48:03<1:36:40,  3.47it/s]
 95%|█████████▍| 351354/371472 [5:48:03<1:39:30,  3.37it/s]
 95%|█████████▍| 351355/371472 [5:48:03<1:41:31,  3.30it/s]
 95%|█████████▍| 351356/371472 [5:48:04<1:40:15,  3.34it/s]
 95%|█████████▍| 351357/371472 [5:48:04<1:40:41,  3.33it/s]
 95%|█████████▍| 351358/371472 [5:48:04<1:37:47,  3.43it/s]
 95%|█████████▍| 351359/371472 [5:48:05<1:36:23,  3.48it/s]
 95%|█████████▍| 351360/371472 [5:48:05<1:34:37,  3.54it/s]
                                                           
{'loss': 2.7352, 'learning_rate': 1.4875347454157599e-07, 'epoch': 15.13}

 95%|█████████▍| 351360/371472 [5:48:05<1:34:37,  3.54it/s]
 95%|█████████▍| 351361/371472 [5:48:05<1:31:14,  3.67it/s]
 95%|█████████▍| 351362/371472 [5:48:05<1:30:57,  3.68it/s]
 95%|█████████▍| 351363/371472 [5:48:06<1:42:07,  3.28it/s]
 95%|█████████▍| 351364/371472 [5:48:06<1:39:24,  3.37it/s]
 95%|█████████▍| 351365/371472 [5:48:06<1:40:58,  3.32it/s]
 95%|█████████▍| 351366/371472 [5:48:07<1:34:59,  3.53it/s]
 95%|█████████▍| 351367/371472 [5:48:07<1:32:00,  3.64it/s]
 95%|█████████▍| 351368/371472 [5:48:07<1:28:39,  3.78it/s]
 95%|█████████▍| 351369/371472 [5:48:07<1:27:15,  3.84it/s]
 95%|█████████▍| 351370/371472 [5:48:08<1:30:13,  3.71it/s]
 95%|█████████▍| 351371/371472 [5:48:08<1:30:44,  3.69it/s]
 95%|█████████▍| 351372/371472 [5:48:08<1:34:48,  3.53it/s]
 95%|█████████▍| 351373/371472 [5:48:08<1:37:12,  3.45it/s]
 95%|█████████▍| 351374/371472 [5:48:09<1:41:33,  3.30it/s]
 95%|█████████▍| 351375/371472 [5:48:09<1:38:23,  3.40it/s]
 95%|█████████▍| 351376/371472 [5:48:09<1:42:22,  3.27it/s]
 95%|█████████▍| 351377/371472 [5:48:10<1:36:16,  3.48it/s]
 95%|█████████▍| 351378/371472 [5:48:10<1:45:02,  3.19it/s]
 95%|█████████▍| 351379/371472 [5:48:10<1:41:56,  3.29it/s]
 95%|█████████▍| 351380/371472 [5:48:11<1:38:41,  3.39it/s]
                                                           
{'loss': 2.5655, 'learning_rate': 1.4870499256609714e-07, 'epoch': 15.13}

 95%|█████████▍| 351380/371472 [5:48:11<1:38:41,  3.39it/s]
 95%|█████████▍| 351381/371472 [5:48:11<1:37:31,  3.43it/s]
 95%|█████████▍| 351382/371472 [5:48:11<1:35:57,  3.49it/s]
 95%|█████████▍| 351383/371472 [5:48:11<1:37:03,  3.45it/s]
 95%|█████████▍| 351384/371472 [5:48:12<1:39:53,  3.35it/s]
 95%|█████████▍| 351385/371472 [5:48:12<1:38:48,  3.39it/s]
 95%|█████████▍| 351386/371472 [5:48:12<1:35:16,  3.51it/s]
 95%|█████████▍| 351387/371472 [5:48:13<1:42:47,  3.26it/s]
 95%|█████████▍| 351388/371472 [5:48:13<1:41:06,  3.31it/s]
 95%|█████████▍| 351389/371472 [5:48:13<1:36:42,  3.46it/s]
 95%|█████████▍| 351390/371472 [5:48:13<1:33:12,  3.59it/s]
 95%|█████████▍| 351391/371472 [5:48:14<1:32:41,  3.61it/s]
 95%|█████████▍| 351392/371472 [5:48:14<1:32:23,  3.62it/s]
 95%|█████████▍| 351393/371472 [5:48:14<1:31:10,  3.67it/s]
 95%|█████████▍| 351394/371472 [5:48:15<1:30:18,  3.71it/s]
 95%|█████████▍| 351395/371472 [5:48:15<1:28:15,  3.79it/s]
 95%|█████████▍| 351396/371472 [5:48:15<1:35:43,  3.50it/s]
 95%|█████████▍| 351397/371472 [5:48:15<1:41:11,  3.31it/s]
 95%|█████████▍| 351398/371472 [5:48:16<1:36:58,  3.45it/s]
 95%|█████████▍| 351399/371472 [5:48:16<1:48:33,  3.08it/s]
 95%|█████████▍| 351400/371472 [5:48:16<1:47:03,  3.12it/s]
                                                           
{'loss': 2.4846, 'learning_rate': 1.4865651059061818e-07, 'epoch': 15.14}

 95%|█████████▍| 351400/371472 [5:48:16<1:47:03,  3.12it/s]
 95%|█████████▍| 351401/371472 [5:48:17<1:49:36,  3.05it/s]
 95%|█████████▍| 351402/371472 [5:48:17<1:47:42,  3.11it/s]
 95%|█████████▍| 351403/371472 [5:48:17<1:43:22,  3.24it/s]
 95%|█████████▍| 351404/371472 [5:48:18<1:41:30,  3.29it/s]
 95%|█████████▍| 351405/371472 [5:48:18<1:44:45,  3.19it/s]
 95%|█████████▍| 351406/371472 [5:48:18<1:41:40,  3.29it/s]
 95%|█████████▍| 351407/371472 [5:48:19<1:39:52,  3.35it/s]
 95%|█████████▍| 351408/371472 [5:48:19<1:35:03,  3.52it/s]
 95%|█████████▍| 351409/371472 [5:48:19<1:32:10,  3.63it/s]
 95%|█████████▍| 351410/371472 [5:48:19<1:31:59,  3.63it/s]
 95%|█████████▍| 351411/371472 [5:48:20<1:28:51,  3.76it/s]
 95%|█████████▍| 351412/371472 [5:48:20<1:32:11,  3.63it/s]
 95%|█████████▍| 351413/371472 [5:48:20<1:35:09,  3.51it/s]
 95%|█████████▍| 351414/371472 [5:48:20<1:32:42,  3.61it/s]
 95%|█████████▍| 351415/371472 [5:48:21<1:30:36,  3.69it/s]
 95%|█████████▍| 351416/371472 [5:48:21<1:30:49,  3.68it/s]
 95%|█████████▍| 351417/371472 [5:48:21<1:30:17,  3.70it/s]
 95%|█████████▍| 351418/371472 [5:48:22<1:27:46,  3.81it/s]
 95%|█████████▍| 351419/371472 [5:48:22<1:27:33,  3.82it/s]
 95%|█████████▍| 351420/371472 [5:48:22<1:34:29,  3.54it/s]
                                                           
{'loss': 2.6674, 'learning_rate': 1.4860802861513936e-07, 'epoch': 15.14}

 95%|█████████▍| 351420/371472 [5:48:22<1:34:29,  3.54it/s]
 95%|█████████▍| 351421/371472 [5:48:22<1:35:09,  3.51it/s]
 95%|█████████▍| 351422/371472 [5:48:23<1:34:43,  3.53it/s]
 95%|█████████▍| 351423/371472 [5:48:23<1:38:42,  3.39it/s]
 95%|█████████▍| 351424/371472 [5:48:23<1:43:01,  3.24it/s]
 95%|█████████▍| 351425/371472 [5:48:24<1:37:26,  3.43it/s]
 95%|█████████▍| 351426/371472 [5:48:24<1:44:32,  3.20it/s]
 95%|█████████▍| 351427/371472 [5:48:24<1:43:13,  3.24it/s]
 95%|█████████▍| 351428/371472 [5:48:25<1:43:36,  3.22it/s]
 95%|█████████▍| 351429/371472 [5:48:25<1:40:44,  3.32it/s]
 95%|█████████▍| 351430/371472 [5:48:25<1:42:10,  3.27it/s]
 95%|█████████▍| 351431/371472 [5:48:25<1:37:37,  3.42it/s]
 95%|█████████▍| 351432/371472 [5:48:26<1:35:11,  3.51it/s]
 95%|█████████▍| 351433/371472 [5:48:26<1:45:40,  3.16it/s]
 95%|█████████▍| 351434/371472 [5:48:26<1:41:00,  3.31it/s]
 95%|█████████▍| 351435/371472 [5:48:27<1:36:22,  3.47it/s]
 95%|█████████▍| 351436/371472 [5:48:27<1:38:25,  3.39it/s]
 95%|█████████▍| 351437/371472 [5:48:27<1:38:54,  3.38it/s]
 95%|█████████▍| 351438/371472 [5:48:28<1:41:25,  3.29it/s]
 95%|█████████▍| 351439/371472 [5:48:28<1:52:30,  2.97it/s]
 95%|█████████▍| 351440/371472 [5:48:28<1:50:19,  3.03it/s]
                                                           
{'loss': 2.5403, 'learning_rate': 1.485595466396604e-07, 'epoch': 15.14}

 95%|█████████▍| 351440/371472 [5:48:28<1:50:19,  3.03it/s]
 95%|█████████▍| 351441/371472 [5:48:29<1:48:51,  3.07it/s]
 95%|█████████▍| 351442/371472 [5:48:29<1:46:03,  3.15it/s]
 95%|█████████▍| 351443/371472 [5:48:29<1:39:29,  3.36it/s]
 95%|█████████▍| 351444/371472 [5:48:29<1:34:47,  3.52it/s]
 95%|█████████▍| 351445/371472 [5:48:30<1:36:17,  3.47it/s]
 95%|█████████▍| 351446/371472 [5:48:30<1:40:39,  3.32it/s]
 95%|█████████▍| 351447/371472 [5:48:30<1:43:26,  3.23it/s]
 95%|█████████▍| 351448/371472 [5:48:31<1:39:27,  3.36it/s]
 95%|█████████▍| 351449/371472 [5:48:31<1:39:12,  3.36it/s]
 95%|█████████▍| 351450/371472 [5:48:31<1:35:58,  3.48it/s]
 95%|█████████▍| 351451/371472 [5:48:31<1:32:43,  3.60it/s]
 95%|█████████▍| 351452/371472 [5:48:32<1:34:17,  3.54it/s]
 95%|█████████▍| 351453/371472 [5:48:32<1:31:46,  3.64it/s]
 95%|█████████▍| 351454/371472 [5:48:32<1:33:16,  3.58it/s]
 95%|█████████▍| 351455/371472 [5:48:33<1:34:26,  3.53it/s]
 95%|█████████▍| 351456/371472 [5:48:33<1:31:57,  3.63it/s]
 95%|█████████▍| 351457/371472 [5:48:33<1:30:34,  3.68it/s]
 95%|█████████▍| 351458/371472 [5:48:33<1:30:58,  3.67it/s]
 95%|█████████▍| 351459/371472 [5:48:34<1:33:54,  3.55it/s]
 95%|█████████▍| 351460/371472 [5:48:34<1:36:42,  3.45it/s]
                                                           
{'loss': 2.5934, 'learning_rate': 1.4851106466418145e-07, 'epoch': 15.14}

 95%|█████████▍| 351460/371472 [5:48:34<1:36:42,  3.45it/s]
 95%|█████████▍| 351461/371472 [5:48:34<1:35:11,  3.50it/s]
 95%|█████████▍| 351462/371472 [5:48:35<1:34:06,  3.54it/s]
 95%|█████████▍| 351463/371472 [5:48:35<1:31:17,  3.65it/s]
 95%|█████████▍| 351464/371472 [5:48:35<1:30:09,  3.70it/s]
 95%|█████████▍| 351465/371472 [5:48:35<1:33:27,  3.57it/s]
 95%|█████████▍| 351466/371472 [5:48:36<1:29:58,  3.71it/s]
 95%|█████████▍| 351467/371472 [5:48:36<1:27:22,  3.82it/s]
 95%|█████████▍| 351468/371472 [5:48:36<1:38:04,  3.40it/s]
 95%|█████████▍| 351469/371472 [5:48:36<1:35:10,  3.50it/s]
 95%|█████████▍| 351470/371472 [5:48:37<1:32:53,  3.59it/s]
 95%|█████████▍| 351471/371472 [5:48:37<1:31:15,  3.65it/s]
 95%|█████████▍| 351472/371472 [5:48:37<1:33:06,  3.58it/s]
 95%|█████████▍| 351473/371472 [5:48:38<1:30:28,  3.68it/s]
 95%|█████████▍| 351474/371472 [5:48:38<1:38:27,  3.39it/s]
 95%|█████████▍| 351475/371472 [5:48:38<1:35:36,  3.49it/s]
 95%|█████████▍| 351476/371472 [5:48:38<1:35:07,  3.50it/s]
 95%|█████████▍| 351477/371472 [5:48:39<1:32:04,  3.62it/s]
 95%|█████████▍| 351478/371472 [5:48:39<1:31:46,  3.63it/s]
 95%|█████████▍| 351479/371472 [5:48:39<1:32:44,  3.59it/s]
 95%|█████████▍| 351480/371472 [5:48:40<1:32:23,  3.61it/s]
                                                           
{'loss': 2.5181, 'learning_rate': 1.4846258268870263e-07, 'epoch': 15.14}

 95%|█████████▍| 351480/371472 [5:48:40<1:32:23,  3.61it/s]
 95%|█████████▍| 351481/371472 [5:48:40<1:37:03,  3.43it/s]
 95%|█████████▍| 351482/371472 [5:48:40<1:35:11,  3.50it/s]
 95%|█████████▍| 351483/371472 [5:48:40<1:30:36,  3.68it/s]
 95%|█████████▍| 351484/371472 [5:48:41<1:29:41,  3.71it/s]
 95%|█████████▍| 351485/371472 [5:48:41<1:37:17,  3.42it/s]
 95%|█████████▍| 351486/371472 [5:48:41<1:34:35,  3.52it/s]
 95%|█████████▍| 351487/371472 [5:48:41<1:33:23,  3.57it/s]
 95%|█████████▍| 351488/371472 [5:48:42<1:36:27,  3.45it/s]
 95%|█████████▍| 351489/371472 [5:48:42<1:31:46,  3.63it/s]
 95%|█████████▍| 351490/371472 [5:48:42<1:34:17,  3.53it/s]
 95%|█████████▍| 351491/371472 [5:48:43<1:36:17,  3.46it/s]
 95%|█████████▍| 351492/371472 [5:48:43<1:34:44,  3.51it/s]
 95%|█████████▍| 351493/371472 [5:48:43<1:38:39,  3.37it/s]
 95%|█████████▍| 351494/371472 [5:48:44<1:37:37,  3.41it/s]
 95%|█████████▍| 351495/371472 [5:48:44<1:35:35,  3.48it/s]
 95%|█████████▍| 351496/371472 [5:48:44<1:33:22,  3.57it/s]
 95%|█████████▍| 351497/371472 [5:48:44<1:30:16,  3.69it/s]
 95%|█████████▍| 351498/371472 [5:48:45<1:32:09,  3.61it/s]
 95%|█████████▍| 351499/371472 [5:48:45<1:29:16,  3.73it/s]
 95%|█████████▍| 351500/371472 [5:48:45<1:29:54,  3.70it/s]
                                                           
{'loss': 2.6259, 'learning_rate': 1.4841410071322367e-07, 'epoch': 15.14}

 95%|█████████▍| 351500/371472 [5:48:45<1:29:54,  3.70it/s]
 95%|█████████▍| 351501/371472 [5:48:45<1:28:53,  3.74it/s]
 95%|█████████▍| 351502/371472 [5:48:46<1:26:49,  3.83it/s]
 95%|█████████▍| 351503/371472 [5:48:46<1:26:45,  3.84it/s]
 95%|█████████▍| 351504/371472 [5:48:46<1:31:08,  3.65it/s]
 95%|█████████▍| 351505/371472 [5:48:46<1:29:28,  3.72it/s]
 95%|█████████▍| 351506/371472 [5:48:47<1:28:34,  3.76it/s]
 95%|█████████▍| 351507/371472 [5:48:47<1:28:55,  3.74it/s]
 95%|█████████▍| 351508/371472 [5:48:47<1:28:20,  3.77it/s]
 95%|█████████▍| 351509/371472 [5:48:48<1:28:49,  3.75it/s]
 95%|█████████▍| 351510/371472 [5:48:48<1:27:32,  3.80it/s]
 95%|█████████▍| 351511/371472 [5:48:48<1:36:59,  3.43it/s]
 95%|█████████▍| 351512/371472 [5:48:48<1:33:28,  3.56it/s]
 95%|█████████▍| 351513/371472 [5:48:49<1:34:06,  3.53it/s]
 95%|█████████▍| 351514/371472 [5:48:49<1:29:54,  3.70it/s]
 95%|█████████▍| 351515/371472 [5:48:49<1:32:05,  3.61it/s]
 95%|█████████▍| 351516/371472 [5:48:49<1:29:32,  3.71it/s]
 95%|█████████▍| 351517/371472 [5:48:50<1:29:11,  3.73it/s]
 95%|█████████▍| 351518/371472 [5:48:50<1:29:30,  3.72it/s]
 95%|█████████▍| 351519/371472 [5:48:50<1:33:28,  3.56it/s]
 95%|█████████▍| 351520/371472 [5:48:51<1:31:58,  3.62it/s]
                                                           
{'loss': 2.6567, 'learning_rate': 1.4836561873774482e-07, 'epoch': 15.14}

 95%|█████████▍| 351520/371472 [5:48:51<1:31:58,  3.62it/s]
 95%|█████████▍| 351521/371472 [5:48:51<1:31:03,  3.65it/s]
 95%|█████████▍| 351522/371472 [5:48:51<1:32:09,  3.61it/s]
 95%|█████████▍| 351523/371472 [5:48:51<1:29:47,  3.70it/s]
 95%|█████████▍| 351524/371472 [5:48:52<1:38:23,  3.38it/s]
 95%|█████████▍| 351525/371472 [5:48:52<1:33:41,  3.55it/s]
 95%|█████████▍| 351526/371472 [5:48:52<1:33:01,  3.57it/s]
 95%|█████████▍| 351527/371472 [5:48:53<1:30:23,  3.68it/s]
 95%|█████████▍| 351528/371472 [5:48:53<1:30:48,  3.66it/s]
 95%|█████████▍| 351529/371472 [5:48:53<1:28:53,  3.74it/s]
 95%|█████████▍| 351530/371472 [5:48:53<1:30:30,  3.67it/s]
 95%|█████████▍| 351531/371472 [5:48:54<1:29:47,  3.70it/s]
 95%|█████████▍| 351532/371472 [5:48:54<1:31:38,  3.63it/s]
 95%|█████████▍| 351533/371472 [5:48:54<1:32:37,  3.59it/s]
 95%|█████████▍| 351534/371472 [5:48:54<1:34:16,  3.53it/s]
 95%|█████████▍| 351535/371472 [5:48:55<1:47:36,  3.09it/s]
 95%|█████████▍| 351536/371472 [5:48:55<1:47:14,  3.10it/s]
 95%|█████████▍| 351537/371472 [5:48:55<1:42:37,  3.24it/s]
 95%|█████████▍| 351538/371472 [5:48:56<1:36:53,  3.43it/s]
 95%|█████████▍| 351539/371472 [5:48:56<1:33:00,  3.57it/s]
 95%|█████████▍| 351540/371472 [5:48:56<1:35:28,  3.48it/s]
                                                           
{'loss': 2.6869, 'learning_rate': 1.483171367622659e-07, 'epoch': 15.14}

 95%|█████████▍| 351540/371472 [5:48:56<1:35:28,  3.48it/s]
 95%|█████████▍| 351541/371472 [5:48:57<1:43:40,  3.20it/s]
 95%|█████████▍| 351542/371472 [5:48:57<1:38:45,  3.36it/s]
 95%|█████████▍| 351543/371472 [5:48:57<1:35:42,  3.47it/s]
 95%|█████████▍| 351544/371472 [5:48:57<1:32:57,  3.57it/s]
 95%|█████████▍| 351545/371472 [5:48:58<1:32:35,  3.59it/s]
 95%|█████████▍| 351546/371472 [5:48:58<1:32:08,  3.60it/s]
 95%|█████████▍| 351547/371472 [5:48:58<1:28:55,  3.73it/s]
 95%|█████████▍| 351548/371472 [5:48:59<1:32:33,  3.59it/s]
 95%|█████████▍| 351549/371472 [5:48:59<1:31:09,  3.64it/s]
 95%|█████████▍| 351550/371472 [5:48:59<1:30:17,  3.68it/s]
 95%|█████████▍| 351551/371472 [5:48:59<1:29:26,  3.71it/s]
 95%|█████████▍| 351552/371472 [5:49:00<1:27:31,  3.79it/s]
 95%|█████████▍| 351553/371472 [5:49:00<1:25:56,  3.86it/s]
 95%|█████████▍| 351554/371472 [5:49:00<1:29:16,  3.72it/s]
 95%|█████████▍| 351555/371472 [5:49:00<1:27:16,  3.80it/s]
 95%|█████████▍| 351556/371472 [5:49:01<1:27:28,  3.79it/s]
 95%|█████████▍| 351557/371472 [5:49:01<1:25:22,  3.89it/s]
 95%|█████████▍| 351558/371472 [5:49:01<1:24:50,  3.91it/s]
 95%|█████████▍| 351559/371472 [5:49:02<1:37:00,  3.42it/s]
 95%|█████████▍| 351560/371472 [5:49:02<1:34:39,  3.51it/s]
                                                           
{'loss': 2.7262, 'learning_rate': 1.4826865478678705e-07, 'epoch': 15.14}

 95%|█████████▍| 351560/371472 [5:49:02<1:34:39,  3.51it/s]
 95%|█████████▍| 351561/371472 [5:49:02<1:39:49,  3.32it/s]
 95%|█████████▍| 351562/371472 [5:49:02<1:35:19,  3.48it/s]
 95%|█████████▍| 351563/371472 [5:49:03<1:33:01,  3.57it/s]
 95%|█████████▍| 351564/371472 [5:49:03<1:32:42,  3.58it/s]
 95%|█████████▍| 351565/371472 [5:49:03<1:31:55,  3.61it/s]
 95%|█████████▍| 351566/371472 [5:49:03<1:33:50,  3.54it/s]
 95%|█████████▍| 351567/371472 [5:49:04<1:30:05,  3.68it/s]
 95%|█████████▍| 351568/371472 [5:49:04<1:30:04,  3.68it/s]
 95%|█████████▍| 351569/371472 [5:49:04<1:32:55,  3.57it/s]
 95%|█████████▍| 351570/371472 [5:49:05<1:30:29,  3.67it/s]
 95%|█████████▍| 351571/371472 [5:49:05<1:30:54,  3.65it/s]
 95%|█████████▍| 351572/371472 [5:49:05<1:29:26,  3.71it/s]
 95%|█████████▍| 351573/371472 [5:49:05<1:27:47,  3.78it/s]
 95%|█████████▍| 351574/371472 [5:49:06<1:30:39,  3.66it/s]
 95%|█████████▍| 351575/371472 [5:49:06<1:36:40,  3.43it/s]
 95%|█████████▍| 351576/371472 [5:49:06<1:37:43,  3.39it/s]
 95%|█████████▍| 351577/371472 [5:49:07<1:44:59,  3.16it/s]
 95%|█████████▍| 351578/371472 [5:49:07<1:39:37,  3.33it/s]
 95%|█████████▍| 351579/371472 [5:49:07<1:36:34,  3.43it/s]
 95%|█████████▍| 351580/371472 [5:49:07<1:34:46,  3.50it/s]
                                                           
{'loss': 2.6499, 'learning_rate': 1.4822017281130812e-07, 'epoch': 15.14}

 95%|█████████▍| 351580/371472 [5:49:07<1:34:46,  3.50it/s]
 95%|█████████▍| 351581/371472 [5:49:08<1:37:17,  3.41it/s]
 95%|█████████▍| 351582/371472 [5:49:08<1:40:37,  3.29it/s]
 95%|█████████▍| 351583/371472 [5:49:08<1:36:34,  3.43it/s]
 95%|█████████▍| 351584/371472 [5:49:09<1:37:54,  3.39it/s]
 95%|█████████▍| 351585/371472 [5:49:09<1:37:24,  3.40it/s]
 95%|█████████▍| 351586/371472 [5:49:09<1:33:31,  3.54it/s]
 95%|█████████▍| 351587/371472 [5:49:10<1:34:29,  3.51it/s]
 95%|█████████▍| 351588/371472 [5:49:10<1:38:29,  3.36it/s]
 95%|█████████▍| 351589/371472 [5:49:10<1:33:22,  3.55it/s]
 95%|█████████▍| 351590/371472 [5:49:10<1:30:52,  3.65it/s]
 95%|█████████▍| 351591/371472 [5:49:11<1:36:08,  3.45it/s]
 95%|█████████▍| 351592/371472 [5:49:11<1:38:19,  3.37it/s]
 95%|█████████▍| 351593/371472 [5:49:11<1:35:24,  3.47it/s]
 95%|█████████▍| 351594/371472 [5:49:11<1:31:40,  3.61it/s]
 95%|█████████▍| 351595/371472 [5:49:12<1:28:02,  3.76it/s]
 95%|█████████▍| 351596/371472 [5:49:12<1:27:45,  3.77it/s]
 95%|█████████▍| 351597/371472 [5:49:12<1:35:54,  3.45it/s]
 95%|█████████▍| 351598/371472 [5:49:13<1:33:23,  3.55it/s]
 95%|█████████▍| 351599/371472 [5:49:13<1:34:08,  3.52it/s]
 95%|█████████▍| 351600/371472 [5:49:13<1:31:01,  3.64it/s]
                                                           
{'loss': 2.5887, 'learning_rate': 1.4817169083582927e-07, 'epoch': 15.14}

 95%|█████████▍| 351600/371472 [5:49:13<1:31:01,  3.64it/s]
 95%|█████████▍| 351601/371472 [5:49:13<1:33:53,  3.53it/s]
 95%|█████████▍| 351602/371472 [5:49:14<1:29:49,  3.69it/s]
 95%|█████████▍| 351603/371472 [5:49:14<1:28:26,  3.74it/s]
 95%|█████████▍| 351604/371472 [5:49:14<1:29:47,  3.69it/s]
 95%|█████████▍| 351605/371472 [5:49:14<1:27:50,  3.77it/s]
 95%|█████████▍| 351606/371472 [5:49:15<1:27:47,  3.77it/s]
 95%|█████████▍| 351607/371472 [5:49:15<1:29:26,  3.70it/s]
 95%|█████████▍| 351608/371472 [5:49:15<1:31:27,  3.62it/s]
 95%|█████████▍| 351609/371472 [5:49:16<1:32:15,  3.59it/s]
 95%|█████████▍| 351610/371472 [5:49:16<1:29:22,  3.70it/s]
 95%|█████████▍| 351611/371472 [5:49:16<1:36:59,  3.41it/s]
 95%|█████████▍| 351612/371472 [5:49:16<1:35:01,  3.48it/s]
 95%|█████████▍| 351613/371472 [5:49:17<1:32:47,  3.57it/s]
 95%|█████████▍| 351614/371472 [5:49:17<1:42:30,  3.23it/s]
 95%|█████████▍| 351615/371472 [5:49:17<1:45:43,  3.13it/s]
 95%|█████████▍| 351616/371472 [5:49:18<1:40:27,  3.29it/s]
 95%|█████████▍| 351617/371472 [5:49:18<1:39:54,  3.31it/s]
 95%|█████████▍| 351618/371472 [5:49:18<1:34:57,  3.48it/s]
 95%|█████████▍| 351619/371472 [5:49:19<1:37:40,  3.39it/s]
 95%|█████████▍| 351620/371472 [5:49:19<1:38:05,  3.37it/s]
                                                           
{'loss': 2.5232, 'learning_rate': 1.4812320886035034e-07, 'epoch': 15.14}

 95%|█████████▍| 351620/371472 [5:49:19<1:38:05,  3.37it/s]
 95%|█████████▍| 351621/371472 [5:49:19<1:39:40,  3.32it/s]
 95%|█████████▍| 351622/371472 [5:49:19<1:36:26,  3.43it/s]
 95%|█████████▍| 351623/371472 [5:49:20<1:38:58,  3.34it/s]
 95%|█████████▍| 351624/371472 [5:49:20<1:44:06,  3.18it/s]
 95%|█████████▍| 351625/371472 [5:49:20<1:37:31,  3.39it/s]
 95%|█████████▍| 351626/371472 [5:49:21<1:33:49,  3.53it/s]
 95%|█████████▍| 351627/371472 [5:49:21<1:33:10,  3.55it/s]
 95%|█████████▍| 351628/371472 [5:49:21<1:43:49,  3.19it/s]
 95%|█████████▍| 351629/371472 [5:49:22<1:37:23,  3.40it/s]
 95%|█████████▍| 351630/371472 [5:49:22<1:32:42,  3.57it/s]
 95%|█████████▍| 351631/371472 [5:49:22<1:42:51,  3.22it/s]
 95%|█████████▍| 351632/371472 [5:49:22<1:42:48,  3.22it/s]
 95%|█████████▍| 351633/371472 [5:49:23<1:37:04,  3.41it/s]
 95%|█████████▍| 351634/371472 [5:49:23<1:40:03,  3.30it/s]
 95%|█████████▍| 351635/371472 [5:49:23<1:36:46,  3.42it/s]
 95%|█████████▍| 351636/371472 [5:49:24<1:31:16,  3.62it/s]
 95%|█████████▍| 351637/371472 [5:49:24<1:34:36,  3.49it/s]
 95%|█████████▍| 351638/371472 [5:49:24<1:33:30,  3.54it/s]
 95%|█████████▍| 351639/371472 [5:49:24<1:32:27,  3.57it/s]
 95%|█████████▍| 351640/371472 [5:49:25<1:35:30,  3.46it/s]
                                                           
{'loss': 2.4506, 'learning_rate': 1.480747268848715e-07, 'epoch': 15.15}

 95%|█████████▍| 351640/371472 [5:49:25<1:35:30,  3.46it/s]
 95%|█████████▍| 351641/371472 [5:49:25<1:36:00,  3.44it/s]
 95%|█████████▍| 351642/371472 [5:49:25<1:35:25,  3.46it/s]
 95%|█████████▍| 351643/371472 [5:49:26<1:44:44,  3.16it/s]
 95%|█████████▍| 351644/371472 [5:49:26<1:43:46,  3.18it/s]
 95%|█████████▍| 351645/371472 [5:49:26<1:38:53,  3.34it/s]
 95%|█████████▍| 351646/371472 [5:49:27<1:36:05,  3.44it/s]
 95%|█████████▍| 351647/371472 [5:49:27<1:33:06,  3.55it/s]
 95%|█████████▍| 351648/371472 [5:49:27<1:33:05,  3.55it/s]
 95%|█████████▍| 351649/371472 [5:49:27<1:30:22,  3.66it/s]
 95%|█████████▍| 351650/371472 [5:49:28<1:30:11,  3.66it/s]
 95%|█████████▍| 351651/371472 [5:49:28<1:28:15,  3.74it/s]
 95%|█████████▍| 351652/371472 [5:49:28<1:28:15,  3.74it/s]
 95%|█████████▍| 351653/371472 [5:49:28<1:27:21,  3.78it/s]
 95%|█████████▍| 351654/371472 [5:49:29<1:30:29,  3.65it/s]
 95%|█████████▍| 351655/371472 [5:49:29<1:32:11,  3.58it/s]
 95%|█████████▍| 351656/371472 [5:49:29<1:31:28,  3.61it/s]
 95%|█████████▍| 351657/371472 [5:49:30<1:29:38,  3.68it/s]
 95%|█████████▍| 351658/371472 [5:49:30<1:37:36,  3.38it/s]
 95%|█████████▍| 351659/371472 [5:49:30<1:41:01,  3.27it/s]
 95%|█████████▍| 351660/371472 [5:49:30<1:35:58,  3.44it/s]
                                                           
{'loss': 2.6012, 'learning_rate': 1.4802624490939254e-07, 'epoch': 15.15}

 95%|█████████▍| 351660/371472 [5:49:30<1:35:58,  3.44it/s]
 95%|█████████▍| 351661/371472 [5:49:31<1:37:32,  3.38it/s]
 95%|█████████▍| 351662/371472 [5:49:31<1:38:28,  3.35it/s]
 95%|█████████▍| 351663/371472 [5:49:31<1:38:58,  3.34it/s]
 95%|█████████▍| 351664/371472 [5:49:32<1:38:46,  3.34it/s]
 95%|█████████▍| 351665/371472 [5:49:32<1:34:53,  3.48it/s]
 95%|█████████▍| 351666/371472 [5:49:32<1:33:42,  3.52it/s]
 95%|█████████▍| 351667/371472 [5:49:33<1:38:24,  3.35it/s]
 95%|█████████▍| 351668/371472 [5:49:33<1:47:07,  3.08it/s]
 95%|█████████▍| 351669/371472 [5:49:33<1:45:38,  3.12it/s]
 95%|█████████▍| 351670/371472 [5:49:34<1:44:10,  3.17it/s]
 95%|█████████▍| 351671/371472 [5:49:34<1:37:45,  3.38it/s]
 95%|█████████▍| 351672/371472 [5:49:34<1:34:58,  3.47it/s]
 95%|█████████▍| 351673/371472 [5:49:34<1:34:26,  3.49it/s]
 95%|█████████▍| 351674/371472 [5:49:35<1:33:14,  3.54it/s]
 95%|█████████▍| 351675/371472 [5:49:35<1:34:31,  3.49it/s]
 95%|█████████▍| 351676/371472 [5:49:35<1:32:25,  3.57it/s]
 95%|█████████▍| 351677/371472 [5:49:35<1:32:12,  3.58it/s]
 95%|█████████▍| 351678/371472 [5:49:36<1:37:59,  3.37it/s]
 95%|█████████▍| 351679/371472 [5:49:36<1:33:40,  3.52it/s]
 95%|█████████▍| 351680/371472 [5:49:36<1:32:19,  3.57it/s]
                                                           
{'loss': 2.6042, 'learning_rate': 1.479777629339137e-07, 'epoch': 15.15}

 95%|█████████▍| 351680/371472 [5:49:36<1:32:19,  3.57it/s]
 95%|█████████▍| 351681/371472 [5:49:37<1:33:02,  3.54it/s]
 95%|█████████▍| 351682/371472 [5:49:37<1:32:52,  3.55it/s]
 95%|█████████▍| 351683/371472 [5:49:37<1:29:18,  3.69it/s]
 95%|█████████▍| 351684/371472 [5:49:37<1:30:09,  3.66it/s]
 95%|█████████▍| 351685/371472 [5:49:38<1:30:22,  3.65it/s]
 95%|█████████▍| 351686/371472 [5:49:38<1:27:28,  3.77it/s]
 95%|█████████▍| 351687/371472 [5:49:38<1:33:29,  3.53it/s]
 95%|█████████▍| 351688/371472 [5:49:39<1:31:38,  3.60it/s]
 95%|█████████▍| 351689/371472 [5:49:39<1:30:10,  3.66it/s]
 95%|█████████▍| 351690/371472 [5:49:39<1:31:15,  3.61it/s]
 95%|█████████▍| 351691/371472 [5:49:39<1:30:59,  3.62it/s]
 95%|█████████▍| 351692/371472 [5:49:40<1:28:04,  3.74it/s]
 95%|█████████▍| 351693/371472 [5:49:40<1:26:51,  3.80it/s]
 95%|█████████▍| 351694/371472 [5:49:40<1:26:19,  3.82it/s]
 95%|█████████▍| 351695/371472 [5:49:40<1:27:33,  3.76it/s]
 95%|█████████▍| 351696/371472 [5:49:41<1:28:05,  3.74it/s]
 95%|█████████▍| 351697/371472 [5:49:41<1:31:23,  3.61it/s]
 95%|█████████▍| 351698/371472 [5:49:41<1:36:23,  3.42it/s]
 95%|█████████▍| 351699/371472 [5:49:42<1:33:33,  3.52it/s]
 95%|█████████▍| 351700/371472 [5:49:42<1:33:59,  3.51it/s]
                                                           
{'loss': 2.6913, 'learning_rate': 1.4792928095843476e-07, 'epoch': 15.15}

 95%|█████████▍| 351700/371472 [5:49:42<1:33:59,  3.51it/s]
 95%|█████████▍| 351701/371472 [5:49:42<1:33:58,  3.51it/s]
 95%|█████████▍| 351702/371472 [5:49:42<1:29:26,  3.68it/s]
 95%|█████████▍| 351703/371472 [5:49:43<1:28:34,  3.72it/s]
 95%|█████████▍| 351704/371472 [5:49:43<1:25:59,  3.83it/s]
 95%|█████████▍| 351705/371472 [5:49:43<1:33:25,  3.53it/s]
 95%|█████████▍| 351706/371472 [5:49:43<1:34:45,  3.48it/s]
 95%|█████████▍| 351707/371472 [5:49:44<1:34:36,  3.48it/s]
 95%|█████████▍| 351708/371472 [5:49:44<1:31:47,  3.59it/s]
 95%|█████████▍| 351709/371472 [5:49:44<1:35:00,  3.47it/s]
 95%|█████████▍| 351710/371472 [5:49:45<1:33:53,  3.51it/s]
 95%|█████████▍| 351711/371472 [5:49:45<1:31:00,  3.62it/s]
 95%|█████████▍| 351712/371472 [5:49:45<1:29:40,  3.67it/s]
 95%|█████████▍| 351713/371472 [5:49:45<1:26:17,  3.82it/s]
 95%|█████████▍| 351714/371472 [5:49:46<1:31:41,  3.59it/s]
 95%|█████████▍| 351715/371472 [5:49:46<1:33:48,  3.51it/s]
 95%|█████████▍| 351716/371472 [5:49:46<1:47:09,  3.07it/s]
 95%|█████████▍| 351717/371472 [5:49:47<1:44:28,  3.15it/s]
 95%|█████████▍| 351718/371472 [5:49:47<1:45:18,  3.13it/s]
 95%|█████████▍| 351719/371472 [5:49:47<1:47:03,  3.08it/s]
 95%|█████████▍| 351720/371472 [5:49:48<1:46:43,  3.08it/s]
                                                           
{'loss': 2.4961, 'learning_rate': 1.478807989829559e-07, 'epoch': 15.15}

 95%|█████████▍| 351720/371472 [5:49:48<1:46:43,  3.08it/s]
 95%|█████████▍| 351721/371472 [5:49:48<1:43:25,  3.18it/s]
 95%|█████████▍| 351722/371472 [5:49:48<1:38:59,  3.33it/s]
 95%|█████████▍| 351723/371472 [5:49:49<1:38:04,  3.36it/s]
 95%|█████████▍| 351724/371472 [5:49:49<1:36:53,  3.40it/s]
 95%|█████████▍| 351725/371472 [5:49:49<1:45:22,  3.12it/s]
 95%|█████████▍| 351726/371472 [5:49:50<1:41:53,  3.23it/s]
 95%|█████████▍| 351727/371472 [5:49:50<1:35:35,  3.44it/s]
 95%|█████████▍| 351728/371472 [5:49:50<1:31:55,  3.58it/s]
 95%|█████████▍| 351729/371472 [5:49:50<1:30:55,  3.62it/s]
 95%|█████████▍| 351730/371472 [5:49:51<1:30:35,  3.63it/s]
 95%|█████████▍| 351731/371472 [5:49:51<1:34:15,  3.49it/s]
 95%|█████████▍| 351732/371472 [5:49:51<1:31:42,  3.59it/s]
 95%|█████████▍| 351733/371472 [5:49:51<1:37:49,  3.36it/s]
 95%|█████████▍| 351734/371472 [5:49:52<1:33:40,  3.51it/s]
 95%|█████████▍| 351735/371472 [5:49:52<1:30:04,  3.65it/s]
 95%|█████████▍| 351736/371472 [5:49:52<1:32:48,  3.54it/s]
 95%|█████████▍| 351737/371472 [5:49:53<1:29:16,  3.68it/s]
 95%|█████████▍| 351738/371472 [5:49:53<1:29:01,  3.69it/s]
 95%|█████████▍| 351739/371472 [5:49:53<1:35:33,  3.44it/s]
 95%|█████████▍| 351740/371472 [5:49:53<1:34:47,  3.47it/s]
                                                           
{'loss': 2.6891, 'learning_rate': 1.4783231700747698e-07, 'epoch': 15.15}

 95%|█████████▍| 351740/371472 [5:49:53<1:34:47,  3.47it/s]
 95%|█████████▍| 351741/371472 [5:49:54<1:31:37,  3.59it/s]
 95%|█████████▍| 351742/371472 [5:49:54<1:32:58,  3.54it/s]
 95%|█████████▍| 351743/371472 [5:49:54<1:31:37,  3.59it/s]
 95%|█████████▍| 351744/371472 [5:49:55<1:32:29,  3.55it/s]
 95%|█████████▍| 351745/371472 [5:49:55<1:32:59,  3.54it/s]
 95%|█████████▍| 351746/371472 [5:49:55<1:30:15,  3.64it/s]
 95%|█████████▍| 351747/371472 [5:49:55<1:33:05,  3.53it/s]
 95%|█████████▍| 351748/371472 [5:49:56<1:30:03,  3.65it/s]
 95%|█████████▍| 351749/371472 [5:49:56<1:39:52,  3.29it/s]
 95%|█████████▍| 351750/371472 [5:49:56<1:40:15,  3.28it/s]
 95%|█████████▍| 351751/371472 [5:49:57<1:37:46,  3.36it/s]
 95%|█████████▍| 351752/371472 [5:49:57<1:34:22,  3.48it/s]
 95%|█████████▍| 351753/371472 [5:49:57<1:33:34,  3.51it/s]
 95%|█████████▍| 351754/371472 [5:49:57<1:30:16,  3.64it/s]
 95%|█████████▍| 351755/371472 [5:49:58<1:29:17,  3.68it/s]
 95%|█████████▍| 351756/371472 [5:49:58<1:27:58,  3.74it/s]
 95%|█████████▍| 351757/371472 [5:49:58<1:28:08,  3.73it/s]
 95%|█████████▍| 351758/371472 [5:49:58<1:26:40,  3.79it/s]
 95%|█████████▍| 351759/371472 [5:49:59<1:27:31,  3.75it/s]
 95%|█████████▍| 351760/371472 [5:49:59<1:25:44,  3.83it/s]
                                                           
{'loss': 2.6537, 'learning_rate': 1.4778383503199813e-07, 'epoch': 15.15}

 95%|█████████▍| 351760/371472 [5:49:59<1:25:44,  3.83it/s]
 95%|█████████▍| 351761/371472 [5:49:59<1:25:03,  3.86it/s]
 95%|█████████▍| 351762/371472 [5:49:59<1:24:14,  3.90it/s]
 95%|█████████▍| 351763/371472 [5:50:00<1:25:09,  3.86it/s]
 95%|█████████▍| 351764/371472 [5:50:00<1:28:37,  3.71it/s]
 95%|█████████▍| 351765/371472 [5:50:00<1:30:14,  3.64it/s]
 95%|█████████▍| 351766/371472 [5:50:01<1:30:50,  3.62it/s]
 95%|█████████▍| 351767/371472 [5:50:01<1:29:54,  3.65it/s]
 95%|█████████▍| 351768/371472 [5:50:01<1:31:52,  3.57it/s]
 95%|█████████▍| 351769/371472 [5:50:01<1:32:38,  3.54it/s]
 95%|█████████▍| 351770/371472 [5:50:02<1:40:01,  3.28it/s]
 95%|█████████▍| 351771/371472 [5:50:02<1:43:02,  3.19it/s]
 95%|█████████▍| 351772/371472 [5:50:02<1:38:42,  3.33it/s]
 95%|█████████▍| 351773/371472 [5:50:03<1:34:39,  3.47it/s]
 95%|█████████▍| 351774/371472 [5:50:03<1:34:28,  3.47it/s]
 95%|█████████▍| 351775/371472 [5:50:03<1:37:06,  3.38it/s]
 95%|█████████▍| 351776/371472 [5:50:04<1:36:29,  3.40it/s]
 95%|█████████▍| 351777/371472 [5:50:04<1:34:50,  3.46it/s]
 95%|█████████▍| 351778/371472 [5:50:04<1:36:04,  3.42it/s]
 95%|█████████▍| 351779/371472 [5:50:04<1:32:16,  3.56it/s]
 95%|█████████▍| 351780/371472 [5:50:05<1:33:32,  3.51it/s]
                                                           
{'loss': 2.6841, 'learning_rate': 1.4773535305651918e-07, 'epoch': 15.15}

 95%|█████████▍| 351780/371472 [5:50:05<1:33:32,  3.51it/s]
 95%|█████████▍| 351781/371472 [5:50:05<1:33:53,  3.50it/s]
 95%|█████████▍| 351782/371472 [5:50:05<1:33:37,  3.51it/s]
 95%|█████████▍| 351783/371472 [5:50:06<1:34:39,  3.47it/s]
 95%|█████████▍| 351784/371472 [5:50:06<1:35:15,  3.44it/s]
 95%|█████████▍| 351785/371472 [5:50:06<1:35:35,  3.43it/s]
 95%|█████████▍| 351786/371472 [5:50:06<1:33:30,  3.51it/s]
 95%|█████████▍| 351787/371472 [5:50:07<1:30:00,  3.65it/s]
 95%|█████████▍| 351788/371472 [5:50:07<1:35:14,  3.44it/s]
 95%|█████████▍| 351789/371472 [5:50:07<1:33:28,  3.51it/s]
 95%|█████████▍| 351790/371472 [5:50:08<1:34:29,  3.47it/s]
 95%|█████████▍| 351791/371472 [5:50:08<1:36:30,  3.40it/s]
 95%|█████████▍| 351792/371472 [5:50:08<1:40:15,  3.27it/s]
 95%|█████████▍| 351793/371472 [5:50:08<1:37:02,  3.38it/s]
 95%|█████████▍| 351794/371472 [5:50:09<1:37:25,  3.37it/s]
 95%|█████████▍| 351795/371472 [5:50:09<1:35:19,  3.44it/s]
 95%|█████████▍| 351796/371472 [5:50:09<1:34:33,  3.47it/s]
 95%|█████████▍| 351797/371472 [5:50:10<1:33:17,  3.52it/s]
 95%|█████████▍| 351798/371472 [5:50:10<1:30:55,  3.61it/s]
 95%|█████████▍| 351799/371472 [5:50:10<1:29:36,  3.66it/s]
 95%|█████████▍| 351800/371472 [5:50:10<1:30:42,  3.61it/s]
                                                           
{'loss': 2.5269, 'learning_rate': 1.4768687108104035e-07, 'epoch': 15.15}

 95%|█████████▍| 351800/371472 [5:50:10<1:30:42,  3.61it/s]
 95%|█████████▍| 351801/371472 [5:50:11<1:29:10,  3.68it/s]
 95%|█████████▍| 351802/371472 [5:50:11<1:34:55,  3.45it/s]
 95%|█████████▍| 351803/371472 [5:50:11<1:33:40,  3.50it/s]
 95%|█████████▍| 351804/371472 [5:50:12<1:42:22,  3.20it/s]
 95%|█████████▍| 351805/371472 [5:50:12<1:39:00,  3.31it/s]
 95%|█████████▍| 351806/371472 [5:50:12<1:34:04,  3.48it/s]
 95%|█████████▍| 351807/371472 [5:50:12<1:34:46,  3.46it/s]
 95%|█████████▍| 351808/371472 [5:50:13<1:34:47,  3.46it/s]
 95%|█████████▍| 351809/371472 [5:50:13<1:34:45,  3.46it/s]
 95%|█████████▍| 351810/371472 [5:50:13<1:31:20,  3.59it/s]
 95%|█████████▍| 351811/371472 [5:50:14<1:31:08,  3.60it/s]
 95%|█████████▍| 351812/371472 [5:50:14<1:30:11,  3.63it/s]
 95%|█████████▍| 351813/371472 [5:50:14<1:29:03,  3.68it/s]
 95%|█████████▍| 351814/371472 [5:50:14<1:29:48,  3.65it/s]
 95%|█████████▍| 351815/371472 [5:50:15<1:31:49,  3.57it/s]
 95%|█████████▍| 351816/371472 [5:50:15<1:35:24,  3.43it/s]
 95%|█████████▍| 351817/371472 [5:50:15<1:32:52,  3.53it/s]
 95%|█████████▍| 351818/371472 [5:50:15<1:30:46,  3.61it/s]
 95%|█████████▍| 351819/371472 [5:50:16<1:31:10,  3.59it/s]
 95%|█████████▍| 351820/371472 [5:50:16<1:30:05,  3.64it/s]
                                                           
{'loss': 2.615, 'learning_rate': 1.476383891055614e-07, 'epoch': 15.15}

 95%|█████████▍| 351820/371472 [5:50:16<1:30:05,  3.64it/s]
 95%|█████████▍| 351821/371472 [5:50:16<1:31:47,  3.57it/s]
 95%|█████████▍| 351822/371472 [5:50:17<1:30:58,  3.60it/s]
 95%|█████████▍| 351823/371472 [5:50:17<1:31:58,  3.56it/s]
 95%|█████████▍| 351824/371472 [5:50:17<1:31:09,  3.59it/s]
 95%|█████████▍| 351825/371472 [5:50:18<1:41:54,  3.21it/s]
 95%|█████████▍| 351826/371472 [5:50:18<1:38:19,  3.33it/s]
 95%|█████████▍| 351827/371472 [5:50:18<1:38:40,  3.32it/s]
 95%|█████████▍| 351828/371472 [5:50:18<1:39:27,  3.29it/s]
 95%|█████████▍| 351829/371472 [5:50:19<1:37:53,  3.34it/s]
 95%|█████████▍| 351830/371472 [5:50:19<1:38:06,  3.34it/s]
 95%|█████████▍| 351831/371472 [5:50:19<1:38:40,  3.32it/s]
 95%|█████████▍| 351832/371472 [5:50:20<1:33:09,  3.51it/s]
 95%|█████████▍| 351833/371472 [5:50:20<1:37:27,  3.36it/s]
 95%|█████████▍| 351834/371472 [5:50:20<1:31:27,  3.58it/s]
 95%|█████████▍| 351835/371472 [5:50:20<1:32:37,  3.53it/s]
 95%|█████████▍| 351836/371472 [5:50:21<1:30:49,  3.60it/s]
 95%|█████████▍| 351837/371472 [5:50:21<1:41:44,  3.22it/s]
 95%|█████████▍| 351838/371472 [5:50:21<1:38:25,  3.32it/s]
 95%|█████████▍| 351839/371472 [5:50:22<1:36:50,  3.38it/s]
 95%|█████████▍| 351840/371472 [5:50:22<1:38:57,  3.31it/s]
                                                           
{'loss': 2.6477, 'learning_rate': 1.4758990713008255e-07, 'epoch': 15.15}

 95%|█████████▍| 351840/371472 [5:50:22<1:38:57,  3.31it/s]
 95%|█████████▍| 351841/371472 [5:50:22<1:35:12,  3.44it/s]
 95%|█████████▍| 351842/371472 [5:50:23<1:48:03,  3.03it/s]
 95%|█████████▍| 351843/371472 [5:50:23<1:46:18,  3.08it/s]
 95%|█████████▍| 351844/371472 [5:50:23<1:45:00,  3.12it/s]
 95%|█████████▍| 351845/371472 [5:50:24<1:39:43,  3.28it/s]
 95%|█████████▍| 351846/371472 [5:50:24<1:38:27,  3.32it/s]
 95%|█████████▍| 351847/371472 [5:50:24<1:37:56,  3.34it/s]
 95%|█████████▍| 351848/371472 [5:50:24<1:36:19,  3.40it/s]
 95%|█████████▍| 351849/371472 [5:50:25<1:33:18,  3.51it/s]
 95%|█████████▍| 351850/371472 [5:50:25<1:33:17,  3.51it/s]
 95%|█████████▍| 351851/371472 [5:50:25<1:35:40,  3.42it/s]
 95%|█████████▍| 351852/371472 [5:50:26<1:34:43,  3.45it/s]
 95%|█████████▍| 351853/371472 [5:50:26<1:34:18,  3.47it/s]
 95%|█████████▍| 351854/371472 [5:50:26<1:36:08,  3.40it/s]
 95%|█████████▍| 351855/371472 [5:50:26<1:35:07,  3.44it/s]
 95%|█████████▍| 351856/371472 [5:50:27<1:32:22,  3.54it/s]
 95%|█████████▍| 351857/371472 [5:50:27<1:37:19,  3.36it/s]
 95%|█████████▍| 351858/371472 [5:50:27<1:31:23,  3.58it/s]
 95%|█████████▍| 351859/371472 [5:50:28<1:29:19,  3.66it/s]
 95%|█████████▍| 351860/371472 [5:50:28<1:27:37,  3.73it/s]
                                                           
{'loss': 2.6667, 'learning_rate': 1.4754142515460362e-07, 'epoch': 15.16}

 95%|█████████▍| 351860/371472 [5:50:28<1:27:37,  3.73it/s]
 95%|█████████▍| 351861/371472 [5:50:28<1:35:27,  3.42it/s]
 95%|█████████▍| 351862/371472 [5:50:28<1:40:41,  3.25it/s]
 95%|█████████▍| 351863/371472 [5:50:29<1:37:05,  3.37it/s]
 95%|█████████▍| 351864/371472 [5:50:29<1:37:02,  3.37it/s]
 95%|█████████▍| 351865/371472 [5:50:29<1:37:22,  3.36it/s]
 95%|█████████▍| 351866/371472 [5:50:30<1:32:53,  3.52it/s]
 95%|█████████▍| 351867/371472 [5:50:30<1:31:49,  3.56it/s]
 95%|█████████▍| 351868/371472 [5:50:30<1:31:51,  3.56it/s]
 95%|█████████▍| 351869/371472 [5:50:30<1:34:36,  3.45it/s]
 95%|█████████▍| 351870/371472 [5:50:31<1:29:55,  3.63it/s]
 95%|█████████▍| 351871/371472 [5:50:31<1:32:57,  3.51it/s]
 95%|█████████▍| 351872/371472 [5:50:31<1:30:14,  3.62it/s]
 95%|█████████▍| 351873/371472 [5:50:32<1:29:26,  3.65it/s]
 95%|█████████▍| 351874/371472 [5:50:32<1:32:24,  3.53it/s]
 95%|█████████▍| 351875/371472 [5:50:32<1:34:05,  3.47it/s]
 95%|█████████▍| 351876/371472 [5:50:32<1:35:50,  3.41it/s]
 95%|█████████▍| 351877/371472 [5:50:33<1:32:13,  3.54it/s]
 95%|█████████▍| 351878/371472 [5:50:33<1:40:14,  3.26it/s]
 95%|█████████▍| 351879/371472 [5:50:33<1:34:18,  3.46it/s]
 95%|█████████▍| 351880/371472 [5:50:34<1:38:00,  3.33it/s]
                                                           
{'loss': 2.5958, 'learning_rate': 1.4749294317912477e-07, 'epoch': 15.16}

 95%|█████████▍| 351880/371472 [5:50:34<1:38:00,  3.33it/s]
 95%|█████████▍| 351881/371472 [5:50:34<1:34:39,  3.45it/s]
 95%|█████████▍| 351882/371472 [5:50:34<1:34:20,  3.46it/s]
 95%|█████████▍| 351883/371472 [5:50:34<1:33:39,  3.49it/s]
 95%|█████████▍| 351884/371472 [5:50:35<1:31:59,  3.55it/s]
 95%|█████████▍| 351885/371472 [5:50:35<1:32:36,  3.52it/s]
 95%|█████████▍| 351886/371472 [5:50:35<1:31:24,  3.57it/s]
 95%|█████████▍| 351887/371472 [5:50:36<1:35:25,  3.42it/s]
 95%|█████████▍| 351888/371472 [5:50:36<1:33:17,  3.50it/s]
 95%|█████████▍| 351889/371472 [5:50:36<1:33:24,  3.49it/s]
 95%|█████████▍| 351890/371472 [5:50:36<1:29:49,  3.63it/s]
 95%|█████████▍| 351891/371472 [5:50:37<1:36:15,  3.39it/s]
 95%|█████████▍| 351892/371472 [5:50:37<1:35:07,  3.43it/s]
 95%|█████████▍| 351893/371472 [5:50:37<1:34:41,  3.45it/s]
 95%|█████████▍| 351894/371472 [5:50:38<1:33:25,  3.49it/s]
 95%|█████████▍| 351895/371472 [5:50:38<1:42:17,  3.19it/s]
 95%|█████████▍| 351896/371472 [5:50:38<1:36:17,  3.39it/s]
 95%|█████████▍| 351897/371472 [5:50:39<1:32:03,  3.54it/s]
 95%|█████████▍| 351898/371472 [5:50:39<1:30:28,  3.61it/s]
 95%|█████████▍| 351899/371472 [5:50:39<1:30:36,  3.60it/s]
 95%|█████████▍| 351900/371472 [5:50:39<1:27:01,  3.75it/s]
                                                           
{'loss': 2.5292, 'learning_rate': 1.4744446120364582e-07, 'epoch': 15.16}

 95%|█████████▍| 351900/371472 [5:50:39<1:27:01,  3.75it/s]
 95%|█████████▍| 351901/371472 [5:50:40<1:28:35,  3.68it/s]
 95%|█████████▍| 351902/371472 [5:50:40<1:27:18,  3.74it/s]
 95%|█████████▍| 351903/371472 [5:50:40<1:34:30,  3.45it/s]
 95%|█████████▍| 351904/371472 [5:50:40<1:31:01,  3.58it/s]
 95%|█████████▍| 351905/371472 [5:50:41<1:31:28,  3.57it/s]
 95%|█████████▍| 351906/371472 [5:50:41<1:38:00,  3.33it/s]
 95%|█████████▍| 351907/371472 [5:50:41<1:35:54,  3.40it/s]
 95%|█████████▍| 351908/371472 [5:50:42<1:36:18,  3.39it/s]
 95%|█████████▍| 351909/371472 [5:50:42<1:34:17,  3.46it/s]
 95%|█████████▍| 351910/371472 [5:50:42<1:30:01,  3.62it/s]
 95%|█████████▍| 351911/371472 [5:50:42<1:27:46,  3.71it/s]
 95%|█████████▍| 351912/371472 [5:50:43<1:26:00,  3.79it/s]
 95%|█████████▍| 351913/371472 [5:50:43<1:30:07,  3.62it/s]
 95%|█████████▍| 351914/371472 [5:50:43<1:30:40,  3.59it/s]
 95%|█████████▍| 351915/371472 [5:50:44<1:30:58,  3.58it/s]
 95%|█████████▍| 351916/371472 [5:50:44<1:28:33,  3.68it/s]
 95%|█████████▍| 351917/371472 [5:50:44<1:27:49,  3.71it/s]
 95%|█████████▍| 351918/371472 [5:50:44<1:25:52,  3.80it/s]
 95%|█████████▍| 351919/371472 [5:50:45<1:25:54,  3.79it/s]
 95%|█████████▍| 351920/371472 [5:50:45<1:24:09,  3.87it/s]
                                                           
{'loss': 2.5468, 'learning_rate': 1.47395979228167e-07, 'epoch': 15.16}

 95%|█████████▍| 351920/371472 [5:50:45<1:24:09,  3.87it/s]
 95%|█████████▍| 351921/371472 [5:50:45<1:29:30,  3.64it/s]
 95%|█████████▍| 351922/371472 [5:50:45<1:30:57,  3.58it/s]
 95%|█████████▍| 351923/371472 [5:50:46<1:31:24,  3.56it/s]
 95%|█████████▍| 351924/371472 [5:50:46<1:30:50,  3.59it/s]
 95%|█████████▍| 351925/371472 [5:50:46<1:38:01,  3.32it/s]
 95%|█████████▍| 351926/371472 [5:50:47<1:34:55,  3.43it/s]
 95%|█████████▍| 351927/371472 [5:50:47<1:38:43,  3.30it/s]
 95%|█████████▍| 351928/371472 [5:50:47<1:40:12,  3.25it/s]
 95%|█████████▍| 351929/371472 [5:50:48<1:40:30,  3.24it/s]
 95%|█████████▍| 351930/371472 [5:50:48<1:42:27,  3.18it/s]
 95%|█████████▍| 351931/371472 [5:50:48<1:48:53,  2.99it/s]
 95%|█████████▍| 351932/371472 [5:50:49<1:45:03,  3.10it/s]
 95%|█████████▍| 351933/371472 [5:50:49<1:39:18,  3.28it/s]
 95%|█████████▍| 351934/371472 [5:50:49<1:33:23,  3.49it/s]
 95%|█████████▍| 351935/371472 [5:50:49<1:29:29,  3.64it/s]
 95%|█████████▍| 351936/371472 [5:50:50<1:31:27,  3.56it/s]
 95%|█████████▍| 351937/371472 [5:50:50<1:33:28,  3.48it/s]
 95%|█████████▍| 351938/371472 [5:50:50<1:32:46,  3.51it/s]
 95%|█████████▍| 351939/371472 [5:50:50<1:30:37,  3.59it/s]
 95%|█████████▍| 351940/371472 [5:50:51<1:29:53,  3.62it/s]
                                                           
{'loss': 2.6184, 'learning_rate': 1.4734749725268807e-07, 'epoch': 15.16}

 95%|█████████▍| 351940/371472 [5:50:51<1:29:53,  3.62it/s]
 95%|█████████▍| 351941/371472 [5:50:51<1:34:35,  3.44it/s]
 95%|█████████▍| 351942/371472 [5:50:51<1:33:22,  3.49it/s]
 95%|█████████▍| 351943/371472 [5:50:52<1:32:01,  3.54it/s]
 95%|█████████▍| 351944/371472 [5:50:52<1:34:08,  3.46it/s]
 95%|█████████▍| 351945/371472 [5:50:52<1:31:52,  3.54it/s]
 95%|█████████▍| 351946/371472 [5:50:52<1:31:02,  3.57it/s]
 95%|█████████▍| 351947/371472 [5:50:53<1:32:25,  3.52it/s]
 95%|█████████▍| 351948/371472 [5:50:53<1:38:02,  3.32it/s]
 95%|█████████▍| 351949/371472 [5:50:53<1:48:05,  3.01it/s]
 95%|█████████▍| 351950/371472 [5:50:54<1:42:37,  3.17it/s]
 95%|█████████▍| 351951/371472 [5:50:54<1:38:11,  3.31it/s]
 95%|█████████▍| 351952/371472 [5:50:54<1:37:49,  3.33it/s]
 95%|█████████▍| 351953/371472 [5:50:55<1:35:42,  3.40it/s]
 95%|█████████▍| 351954/371472 [5:50:55<1:33:06,  3.49it/s]
 95%|█████████▍| 351955/371472 [5:50:55<1:32:05,  3.53it/s]
 95%|█████████▍| 351956/371472 [5:50:55<1:32:26,  3.52it/s]
 95%|█████████▍| 351957/371472 [5:50:56<1:31:14,  3.56it/s]
 95%|█████████▍| 351958/371472 [5:50:56<1:29:02,  3.65it/s]
 95%|█████████▍| 351959/371472 [5:50:56<1:37:12,  3.35it/s]
 95%|█████████▍| 351960/371472 [5:50:57<1:40:07,  3.25it/s]
                                                           
{'loss': 2.4557, 'learning_rate': 1.472990152772092e-07, 'epoch': 15.16}

 95%|█████████▍| 351960/371472 [5:50:57<1:40:07,  3.25it/s]
 95%|█████████▍| 351961/371472 [5:50:57<1:36:31,  3.37it/s]
 95%|█████████▍| 351962/371472 [5:50:57<1:36:13,  3.38it/s]
 95%|█████████▍| 351963/371472 [5:50:57<1:34:47,  3.43it/s]
 95%|█████████▍| 351964/371472 [5:50:58<1:32:16,  3.52it/s]
 95%|█████████▍| 351965/371472 [5:50:58<1:33:27,  3.48it/s]
 95%|█████████▍| 351966/371472 [5:50:58<1:37:16,  3.34it/s]
 95%|█████████▍| 351967/371472 [5:50:59<1:39:02,  3.28it/s]
 95%|█████████▍| 351968/371472 [5:50:59<1:36:32,  3.37it/s]
 95%|█████████▍| 351969/371472 [5:50:59<1:37:32,  3.33it/s]
 95%|█████████▍| 351970/371472 [5:51:00<1:36:10,  3.38it/s]
 95%|█████████▍| 351971/371472 [5:51:00<1:39:49,  3.26it/s]
 95%|█████████▍| 351972/371472 [5:51:00<1:39:44,  3.26it/s]
 95%|█████████▍| 351973/371472 [5:51:00<1:36:01,  3.38it/s]
 95%|█████████▍| 351974/371472 [5:51:01<1:30:27,  3.59it/s]
 95%|█████████▍| 351975/371472 [5:51:01<1:49:17,  2.97it/s]
 95%|█████████▍| 351976/371472 [5:51:01<1:45:02,  3.09it/s]
 95%|█████████▍| 351977/371472 [5:51:02<1:38:47,  3.29it/s]
 95%|█████████▍| 351978/371472 [5:51:02<1:39:28,  3.27it/s]
 95%|█████████▍| 351979/371472 [5:51:02<1:40:40,  3.23it/s]
 95%|█████████▍| 351980/371472 [5:51:03<1:41:03,  3.21it/s]
                                                           
{'loss': 2.601, 'learning_rate': 1.4725053330173026e-07, 'epoch': 15.16}

 95%|█████████▍| 351980/371472 [5:51:03<1:41:03,  3.21it/s]
 95%|█████████▍| 351981/371472 [5:51:03<1:36:15,  3.37it/s]
 95%|█████████▍| 351982/371472 [5:51:03<1:34:12,  3.45it/s]
 95%|█████████▍| 351983/371472 [5:51:04<1:36:50,  3.35it/s]
 95%|█████████▍| 351984/371472 [5:51:04<1:38:30,  3.30it/s]
 95%|█████████▍| 351985/371472 [5:51:04<1:35:57,  3.38it/s]
 95%|█████████▍| 351986/371472 [5:51:04<1:33:55,  3.46it/s]
 95%|█████████▍| 351987/371472 [5:51:05<1:34:39,  3.43it/s]
 95%|█████████▍| 351988/371472 [5:51:05<1:33:25,  3.48it/s]
 95%|█████████▍| 351989/371472 [5:51:05<1:30:33,  3.59it/s]
 95%|█████████▍| 351990/371472 [5:51:06<1:29:01,  3.65it/s]
 95%|█████████▍| 351991/371472 [5:51:06<1:32:11,  3.52it/s]
 95%|█████████▍| 351992/371472 [5:51:06<1:32:33,  3.51it/s]
 95%|█████████▍| 351993/371472 [5:51:06<1:29:26,  3.63it/s]
 95%|█████████▍| 351994/371472 [5:51:07<1:26:56,  3.73it/s]
 95%|█████████▍| 351995/371472 [5:51:07<1:29:25,  3.63it/s]
 95%|█████████▍| 351996/371472 [5:51:07<1:32:30,  3.51it/s]
 95%|█████████▍| 351997/371472 [5:51:07<1:30:59,  3.57it/s]
 95%|█████████▍| 351998/371472 [5:51:08<1:29:49,  3.61it/s]
 95%|█████████▍| 351999/371472 [5:51:08<1:31:34,  3.54it/s]
 95%|█████████▍| 352000/371472 [5:51:08<1:32:00,  3.53it/s]
                                                           
{'loss': 2.5618, 'learning_rate': 1.4720205132625133e-07, 'epoch': 15.16}

 95%|█████████▍| 352000/371472 [5:51:08<1:32:00,  3.53it/s]
 95%|█████████▍| 352001/371472 [5:51:09<1:36:13,  3.37it/s]
 95%|█████████▍| 352002/371472 [5:51:09<1:35:06,  3.41it/s]
 95%|█████████▍| 352003/371472 [5:51:09<1:31:12,  3.56it/s]
 95%|█████████▍| 352004/371472 [5:51:09<1:27:39,  3.70it/s]
 95%|█████████▍| 352005/371472 [5:51:10<1:25:32,  3.79it/s]
 95%|█████████▍| 352006/371472 [5:51:10<1:26:29,  3.75it/s]
 95%|█████████▍| 352007/371472 [5:51:10<1:33:52,  3.46it/s]
 95%|█████████▍| 352008/371472 [5:51:11<1:30:50,  3.57it/s]
 95%|█████████▍| 352009/371472 [5:51:11<1:29:45,  3.61it/s]
 95%|█████████▍| 352010/371472 [5:51:11<1:30:21,  3.59it/s]
 95%|█████████▍| 352011/371472 [5:51:11<1:27:24,  3.71it/s]
 95%|█████████▍| 352012/371472 [5:51:12<1:27:33,  3.70it/s]
 95%|█████████▍| 352013/371472 [5:51:12<1:30:34,  3.58it/s]
 95%|█████████▍| 352014/371472 [5:51:12<1:27:48,  3.69it/s]
 95%|█████████▍| 352015/371472 [5:51:12<1:28:20,  3.67it/s]
 95%|█████████▍| 352016/371472 [5:51:13<1:28:08,  3.68it/s]
 95%|█████████▍| 352017/371472 [5:51:13<1:27:41,  3.70it/s]
 95%|█████████▍| 352018/371472 [5:51:13<1:29:55,  3.61it/s]
 95%|█████████▍| 352019/371472 [5:51:14<1:30:46,  3.57it/s]
 95%|█████████▍| 352020/371472 [5:51:14<1:31:31,  3.54it/s]
                                                           
{'loss': 2.5784, 'learning_rate': 1.4715356935077248e-07, 'epoch': 15.16}

 95%|█████████▍| 352020/371472 [5:51:14<1:31:31,  3.54it/s]
 95%|█████████▍| 352021/371472 [5:51:14<1:32:23,  3.51it/s]
 95%|█████████▍| 352022/371472 [5:51:14<1:29:56,  3.60it/s]
 95%|█████████▍| 352023/371472 [5:51:15<1:27:47,  3.69it/s]
 95%|█████████▍| 352024/371472 [5:51:15<1:25:28,  3.79it/s]
 95%|█████████▍| 352025/371472 [5:51:15<1:33:01,  3.48it/s]
 95%|█████████▍| 352026/371472 [5:51:16<1:33:19,  3.47it/s]
 95%|█████████▍| 352027/371472 [5:51:16<1:31:07,  3.56it/s]
 95%|█████████▍| 352028/371472 [5:51:16<1:29:35,  3.62it/s]
 95%|█████████▍| 352029/371472 [5:51:16<1:29:06,  3.64it/s]
 95%|█████████▍| 352030/371472 [5:51:17<1:32:31,  3.50it/s]
 95%|█████████▍| 352031/371472 [5:51:17<1:36:58,  3.34it/s]
 95%|█████████▍| 352032/371472 [5:51:17<1:33:35,  3.46it/s]
 95%|█████████▍| 352033/371472 [5:51:18<1:37:06,  3.34it/s]
 95%|█████████▍| 352034/371472 [5:51:18<1:38:27,  3.29it/s]
 95%|█████████▍| 352035/371472 [5:51:18<1:33:10,  3.48it/s]
 95%|█████████▍| 352036/371472 [5:51:18<1:32:38,  3.50it/s]
 95%|█████████▍| 352037/371472 [5:51:19<1:30:26,  3.58it/s]
 95%|█████████▍| 352038/371472 [5:51:19<1:30:36,  3.57it/s]
 95%|█████████▍| 352039/371472 [5:51:19<1:29:36,  3.61it/s]
 95%|█████████▍| 352040/371472 [5:51:20<1:31:08,  3.55it/s]
                                                           
{'loss': 2.4493, 'learning_rate': 1.4710508737529353e-07, 'epoch': 15.16}

 95%|█████████▍| 352040/371472 [5:51:20<1:31:08,  3.55it/s]
 95%|█████████▍| 352041/371472 [5:51:20<1:38:10,  3.30it/s]
 95%|█████████▍| 352042/371472 [5:51:20<1:37:52,  3.31it/s]
 95%|█████████▍| 352043/371472 [5:51:20<1:33:15,  3.47it/s]
 95%|█████████▍| 352044/371472 [5:51:21<1:32:55,  3.48it/s]
 95%|█████████▍| 352045/371472 [5:51:21<1:31:58,  3.52it/s]
 95%|█████████▍| 352046/371472 [5:51:21<1:29:38,  3.61it/s]
 95%|█████████▍| 352047/371472 [5:51:22<1:35:41,  3.38it/s]
 95%|█████████▍| 352048/371472 [5:51:22<1:31:19,  3.54it/s]
 95%|█████████▍| 352049/371472 [5:51:22<1:32:18,  3.51it/s]
 95%|█████████▍| 352050/371472 [5:51:22<1:30:15,  3.59it/s]
 95%|█████████▍| 352051/371472 [5:51:23<1:35:11,  3.40it/s]
 95%|█████████▍| 352052/371472 [5:51:23<1:34:30,  3.42it/s]
 95%|█████████▍| 352053/371472 [5:51:23<1:31:35,  3.53it/s]
 95%|█████████▍| 352054/371472 [5:51:24<1:29:27,  3.62it/s]
 95%|█████████▍| 352055/371472 [5:51:24<1:30:10,  3.59it/s]
 95%|█████████▍| 352056/371472 [5:51:24<1:34:38,  3.42it/s]
 95%|█████████▍| 352057/371472 [5:51:24<1:38:50,  3.27it/s]
 95%|█████████▍| 352058/371472 [5:51:25<1:39:55,  3.24it/s]
 95%|█████████▍| 352059/371472 [5:51:25<1:38:05,  3.30it/s]
 95%|█████████▍| 352060/371472 [5:51:25<1:39:54,  3.24it/s]
                                                           
{'loss': 2.47, 'learning_rate': 1.470566053998147e-07, 'epoch': 15.16}

 95%|█████████▍| 352060/371472 [5:51:25<1:39:54,  3.24it/s]
 95%|█████████▍| 352061/371472 [5:51:26<1:41:16,  3.19it/s]
 95%|█████████▍| 352062/371472 [5:51:26<1:36:39,  3.35it/s]
 95%|█████████▍| 352063/371472 [5:51:26<1:40:53,  3.21it/s]
 95%|█████████▍| 352064/371472 [5:51:27<1:36:24,  3.36it/s]
 95%|█████████▍| 352065/371472 [5:51:27<1:39:25,  3.25it/s]
 95%|█████████▍| 352066/371472 [5:51:27<1:37:04,  3.33it/s]
 95%|█████████▍| 352067/371472 [5:51:28<1:49:11,  2.96it/s]
 95%|█████████▍| 352068/371472 [5:51:28<1:46:19,  3.04it/s]
 95%|█████████▍| 352069/371472 [5:51:28<1:40:45,  3.21it/s]
 95%|█████████▍| 352070/371472 [5:51:29<1:46:08,  3.05it/s]
 95%|█████████▍| 352071/371472 [5:51:29<1:41:13,  3.19it/s]
 95%|█████████▍| 352072/371472 [5:51:29<1:35:38,  3.38it/s]
 95%|█████████▍| 352073/371472 [5:51:29<1:32:49,  3.48it/s]
 95%|█████████▍| 352074/371472 [5:51:30<1:31:55,  3.52it/s]
 95%|█████████▍| 352075/371472 [5:51:30<1:34:32,  3.42it/s]
 95%|█████████▍| 352076/371472 [5:51:30<1:35:10,  3.40it/s]
 95%|█████████▍| 352077/371472 [5:51:31<1:39:58,  3.23it/s]
 95%|█████████▍| 352078/371472 [5:51:31<1:34:39,  3.41it/s]
 95%|█████████▍| 352079/371472 [5:51:31<1:32:52,  3.48it/s]
 95%|█████████▍| 352080/371472 [5:51:32<1:37:44,  3.31it/s]
                                                           
{'loss': 2.5451, 'learning_rate': 1.4700812342433575e-07, 'epoch': 15.16}

 95%|█████████▍| 352080/371472 [5:51:32<1:37:44,  3.31it/s]
 95%|█████████▍| 352081/371472 [5:51:32<1:35:58,  3.37it/s]
 95%|█████████▍| 352082/371472 [5:51:32<1:34:06,  3.43it/s]
 95%|█████████▍| 352083/371472 [5:51:32<1:32:09,  3.51it/s]
 95%|█████████▍| 352084/371472 [5:51:33<1:34:42,  3.41it/s]
 95%|█████████▍| 352085/371472 [5:51:33<1:31:54,  3.52it/s]
 95%|█████████▍| 352086/371472 [5:51:33<1:32:08,  3.51it/s]
 95%|█████████▍| 352087/371472 [5:51:33<1:33:23,  3.46it/s]
 95%|█████████▍| 352088/371472 [5:51:34<1:34:04,  3.43it/s]
 95%|█████████▍| 352089/371472 [5:51:34<1:33:06,  3.47it/s]
 95%|█████████▍| 352090/371472 [5:51:34<1:31:48,  3.52it/s]
 95%|█████████▍| 352091/371472 [5:51:35<1:31:11,  3.54it/s]
 95%|█████████▍| 352092/371472 [5:51:35<1:30:47,  3.56it/s]
 95%|█████████▍| 352093/371472 [5:51:35<1:30:50,  3.56it/s]
 95%|█████████▍| 352094/371472 [5:51:35<1:28:23,  3.65it/s]
 95%|█████████▍| 352095/371472 [5:51:36<1:30:36,  3.56it/s]
 95%|█████████▍| 352096/371472 [5:51:36<1:29:25,  3.61it/s]
 95%|█████████▍| 352097/371472 [5:51:36<1:35:56,  3.37it/s]
 95%|█████████▍| 352098/371472 [5:51:37<1:37:06,  3.33it/s]
 95%|█████████▍| 352099/371472 [5:51:37<1:34:41,  3.41it/s]
 95%|█████████▍| 352100/371472 [5:51:37<1:32:33,  3.49it/s]
                                                           
{'loss': 2.6072, 'learning_rate': 1.469596414488569e-07, 'epoch': 15.17}

 95%|█████████▍| 352100/371472 [5:51:37<1:32:33,  3.49it/s]
 95%|█████████▍| 352101/371472 [5:51:38<1:35:51,  3.37it/s]
 95%|█████████▍| 352102/371472 [5:51:38<1:46:45,  3.02it/s]
 95%|█████████▍| 352103/371472 [5:51:38<1:41:07,  3.19it/s]
 95%|█████████▍| 352104/371472 [5:51:38<1:35:10,  3.39it/s]
 95%|█████████▍| 352105/371472 [5:51:39<1:32:30,  3.49it/s]
 95%|█████████▍| 352106/371472 [5:51:39<1:30:27,  3.57it/s]
 95%|█████████▍| 352107/371472 [5:51:39<1:37:54,  3.30it/s]
 95%|█████████▍| 352108/371472 [5:51:40<1:37:32,  3.31it/s]
 95%|█████████▍| 352109/371472 [5:51:40<1:37:46,  3.30it/s]
 95%|█████████▍| 352110/371472 [5:51:40<1:38:51,  3.26it/s]
 95%|█████████▍| 352111/371472 [5:51:41<1:36:30,  3.34it/s]
 95%|█████████▍| 352112/371472 [5:51:41<1:35:53,  3.36it/s]
 95%|█████████▍| 352113/371472 [5:51:41<1:39:57,  3.23it/s]
 95%|█████████▍| 352114/371472 [5:51:41<1:39:03,  3.26it/s]
 95%|█████████▍| 352115/371472 [5:51:42<1:34:10,  3.43it/s]
 95%|█████████▍| 352116/371472 [5:51:42<1:31:28,  3.53it/s]
 95%|█████████▍| 352117/371472 [5:51:42<1:30:38,  3.56it/s]
 95%|█████████▍| 352118/371472 [5:51:43<1:32:09,  3.50it/s]
 95%|█████████▍| 352119/371472 [5:51:43<1:27:46,  3.67it/s]
 95%|█████████▍| 352120/371472 [5:51:43<1:25:21,  3.78it/s]
                                                           
{'loss': 2.5157, 'learning_rate': 1.4691115947337797e-07, 'epoch': 15.17}

 95%|█████████▍| 352120/371472 [5:51:43<1:25:21,  3.78it/s]
 95%|█████████▍| 352121/371472 [5:51:43<1:25:14,  3.78it/s]
 95%|█████████▍| 352122/371472 [5:51:44<1:22:27,  3.91it/s]
 95%|█████████▍| 352123/371472 [5:51:44<1:30:25,  3.57it/s]
 95%|█████████▍| 352124/371472 [5:51:44<1:29:00,  3.62it/s]
 95%|█████████▍| 352125/371472 [5:51:44<1:32:20,  3.49it/s]
 95%|█████████▍| 352126/371472 [5:51:45<1:30:37,  3.56it/s]
 95%|█████████▍| 352127/371472 [5:51:45<1:27:34,  3.68it/s]
 95%|█████████▍| 352128/371472 [5:51:45<1:26:58,  3.71it/s]
 95%|█████████▍| 352129/371472 [5:51:46<1:30:03,  3.58it/s]
 95%|█████████▍| 352130/371472 [5:51:46<1:28:04,  3.66it/s]
 95%|█████████▍| 352131/371472 [5:51:46<1:30:46,  3.55it/s]
 95%|█████████▍| 352132/371472 [5:51:46<1:30:32,  3.56it/s]
 95%|█████████▍| 352133/371472 [5:51:47<1:28:06,  3.66it/s]
 95%|█████████▍| 352134/371472 [5:51:47<1:37:40,  3.30it/s]
 95%|█████████▍| 352135/371472 [5:51:47<1:33:07,  3.46it/s]
 95%|█████████▍| 352136/371472 [5:51:48<1:33:00,  3.46it/s]
 95%|█████████▍| 352137/371472 [5:51:48<1:29:35,  3.60it/s]
 95%|█████████▍| 352138/371472 [5:51:48<1:28:25,  3.64it/s]
 95%|█████████▍| 352139/371472 [5:51:48<1:25:19,  3.78it/s]
 95%|█████████▍| 352140/371472 [5:51:49<1:24:11,  3.83it/s]
                                                           
{'loss': 2.5283, 'learning_rate': 1.4686267749789912e-07, 'epoch': 15.17}

 95%|█████████▍| 352140/371472 [5:51:49<1:24:11,  3.83it/s]
 95%|█████████▍| 352141/371472 [5:51:49<1:23:46,  3.85it/s]
 95%|█████████▍| 352142/371472 [5:51:49<1:29:33,  3.60it/s]
 95%|█████████▍| 352143/371472 [5:51:49<1:28:34,  3.64it/s]
 95%|█████████▍| 352144/371472 [5:51:50<1:27:06,  3.70it/s]
 95%|█████████▍| 352145/371472 [5:51:50<1:27:35,  3.68it/s]
 95%|█████████▍| 352146/371472 [5:51:50<1:28:28,  3.64it/s]
 95%|█████████▍| 352147/371472 [5:51:51<1:27:19,  3.69it/s]
 95%|█████████▍| 352148/371472 [5:51:51<1:28:48,  3.63it/s]
 95%|█████████▍| 352149/371472 [5:51:51<1:28:40,  3.63it/s]
 95%|█████████▍| 352150/371472 [5:51:51<1:28:20,  3.65it/s]
 95%|█████████▍| 352151/371472 [5:51:52<1:28:40,  3.63it/s]
 95%|█████████▍| 352152/371472 [5:51:52<1:30:29,  3.56it/s]
 95%|█████████▍| 352153/371472 [5:51:52<1:34:32,  3.41it/s]
 95%|█████████▍| 352154/371472 [5:51:53<1:36:32,  3.34it/s]
 95%|█████████▍| 352155/371472 [5:51:53<1:34:02,  3.42it/s]
 95%|█████████▍| 352156/371472 [5:51:53<1:34:32,  3.41it/s]
 95%|█████████▍| 352157/371472 [5:51:53<1:31:47,  3.51it/s]
 95%|█████████▍| 352158/371472 [5:51:54<1:30:55,  3.54it/s]
 95%|█████████▍| 352159/371472 [5:51:54<1:30:57,  3.54it/s]
 95%|█████████▍| 352160/371472 [5:51:54<1:28:27,  3.64it/s]
                                                           
{'loss': 2.4667, 'learning_rate': 1.4681419552242017e-07, 'epoch': 15.17}

 95%|█████████▍| 352160/371472 [5:51:54<1:28:27,  3.64it/s]
 95%|█████████▍| 352161/371472 [5:51:54<1:27:08,  3.69it/s]
 95%|█████████▍| 352162/371472 [5:51:55<1:28:34,  3.63it/s]
 95%|█████████▍| 352163/371472 [5:51:55<1:28:11,  3.65it/s]
 95%|█████████▍| 352164/371472 [5:51:55<1:28:52,  3.62it/s]
 95%|█████████▍| 352165/371472 [5:51:56<1:25:13,  3.78it/s]
 95%|█████████▍| 352166/371472 [5:51:56<1:31:12,  3.53it/s]
 95%|█████████▍| 352167/371472 [5:51:56<1:46:44,  3.01it/s]
 95%|█████████▍| 352168/371472 [5:51:57<1:43:40,  3.10it/s]
 95%|█████████▍| 352169/371472 [5:51:57<1:37:58,  3.28it/s]
 95%|█████████▍| 352170/371472 [5:51:57<1:36:38,  3.33it/s]
 95%|█████████▍| 352171/371472 [5:51:58<1:46:38,  3.02it/s]
 95%|█████████▍| 352172/371472 [5:51:58<1:38:55,  3.25it/s]
 95%|█████████▍| 352173/371472 [5:51:58<1:43:36,  3.10it/s]
 95%|█████████▍| 352174/371472 [5:51:58<1:39:37,  3.23it/s]
 95%|█████████▍| 352175/371472 [5:51:59<1:40:12,  3.21it/s]
 95%|█████████▍| 352176/371472 [5:51:59<1:36:25,  3.34it/s]
 95%|█████████▍| 352177/371472 [5:51:59<1:32:56,  3.46it/s]
 95%|█████████▍| 352178/371472 [5:52:00<1:31:31,  3.51it/s]
 95%|█████████▍| 352179/371472 [5:52:00<1:33:08,  3.45it/s]
 95%|█████████▍| 352180/371472 [5:52:00<1:32:18,  3.48it/s]
                                                           
{'loss': 2.4131, 'learning_rate': 1.4676571354694135e-07, 'epoch': 15.17}

 95%|█████████▍| 352180/371472 [5:52:00<1:32:18,  3.48it/s]
 95%|█████████▍| 352181/371472 [5:52:00<1:30:58,  3.53it/s]
 95%|█████████▍| 352182/371472 [5:52:01<1:31:18,  3.52it/s]
 95%|█████████▍| 352183/371472 [5:52:01<1:36:05,  3.35it/s]
 95%|█████████▍| 352184/371472 [5:52:01<1:39:30,  3.23it/s]
 95%|█████████▍| 352185/371472 [5:52:02<1:36:35,  3.33it/s]
 95%|█████████▍| 352186/371472 [5:52:02<1:36:34,  3.33it/s]
 95%|█████████▍| 352187/371472 [5:52:02<1:33:40,  3.43it/s]
 95%|█████████▍| 352188/371472 [5:52:03<1:31:39,  3.51it/s]
 95%|█████████▍| 352189/371472 [5:52:03<1:29:04,  3.61it/s]
 95%|█████████▍| 352190/371472 [5:52:03<1:28:47,  3.62it/s]
 95%|█████████▍| 352191/371472 [5:52:03<1:30:49,  3.54it/s]
 95%|█████████▍| 352192/371472 [5:52:04<1:26:23,  3.72it/s]
 95%|█████████▍| 352193/371472 [5:52:04<1:32:20,  3.48it/s]
 95%|█████████▍| 352194/371472 [5:52:04<1:32:10,  3.49it/s]
 95%|█████████▍| 352195/371472 [5:52:05<1:34:02,  3.42it/s]
 95%|█████████▍| 352196/371472 [5:52:05<1:33:30,  3.44it/s]
 95%|█████████▍| 352197/371472 [5:52:05<1:33:43,  3.43it/s]
 95%|█████████▍| 352198/371472 [5:52:05<1:32:26,  3.47it/s]
 95%|█████████▍| 352199/371472 [5:52:06<1:30:37,  3.54it/s]
 95%|█████████▍| 352200/371472 [5:52:06<1:28:38,  3.62it/s]
                                                           
{'loss': 2.7205, 'learning_rate': 1.467172315714624e-07, 'epoch': 15.17}

 95%|█████████▍| 352200/371472 [5:52:06<1:28:38,  3.62it/s]
 95%|█████████▍| 352201/371472 [5:52:06<1:30:18,  3.56it/s]
 95%|█████████▍| 352202/371472 [5:52:07<1:32:53,  3.46it/s]
 95%|█████████▍| 352203/371472 [5:52:07<1:29:12,  3.60it/s]
 95%|█████████▍| 352204/371472 [5:52:07<1:27:43,  3.66it/s]
 95%|█████████▍| 352205/371472 [5:52:07<1:27:00,  3.69it/s]
 95%|█████████▍| 352206/371472 [5:52:08<1:27:35,  3.67it/s]
 95%|█████████▍| 352207/371472 [5:52:08<1:25:10,  3.77it/s]
 95%|█████████▍| 352208/371472 [5:52:08<1:29:12,  3.60it/s]
 95%|█████████▍| 352209/371472 [5:52:08<1:32:03,  3.49it/s]
 95%|█████████▍| 352210/371472 [5:52:09<1:30:51,  3.53it/s]
 95%|█████████▍| 352211/371472 [5:52:09<1:28:48,  3.61it/s]
 95%|█████████▍| 352212/371472 [5:52:09<1:26:56,  3.69it/s]
 95%|█████████▍| 352213/371472 [5:52:10<1:38:28,  3.26it/s]
 95%|█████████▍| 352214/371472 [5:52:10<1:34:43,  3.39it/s]
 95%|█████████▍| 352215/371472 [5:52:10<1:32:45,  3.46it/s]
 95%|█████████▍| 352216/371472 [5:52:10<1:29:54,  3.57it/s]
 95%|█████████▍| 352217/371472 [5:52:11<1:27:35,  3.66it/s]
 95%|█████████▍| 352218/371472 [5:52:11<1:27:36,  3.66it/s]
 95%|█████████▍| 352219/371472 [5:52:11<1:27:23,  3.67it/s]
 95%|█████████▍| 352220/371472 [5:52:12<1:33:52,  3.42it/s]
                                                           
{'loss': 2.5593, 'learning_rate': 1.4666874959598354e-07, 'epoch': 15.17}

 95%|█████████▍| 352220/371472 [5:52:12<1:33:52,  3.42it/s]
 95%|█████████▍| 352221/371472 [5:52:12<1:36:29,  3.33it/s]
 95%|█████████▍| 352222/371472 [5:52:12<1:31:44,  3.50it/s]
 95%|█████████▍| 352223/371472 [5:52:12<1:37:04,  3.30it/s]
 95%|█████████▍| 352224/371472 [5:52:13<1:34:42,  3.39it/s]
 95%|█████████▍| 352225/371472 [5:52:13<1:32:20,  3.47it/s]
 95%|█████████▍| 352226/371472 [5:52:13<1:30:59,  3.53it/s]
 95%|█████████▍| 352227/371472 [5:52:14<1:38:56,  3.24it/s]
 95%|█████████▍| 352228/371472 [5:52:14<1:40:49,  3.18it/s]
 95%|█████████▍| 352229/371472 [5:52:14<1:36:46,  3.31it/s]
 95%|█████████▍| 352230/371472 [5:52:15<1:31:41,  3.50it/s]
 95%|█████████▍| 352231/371472 [5:52:15<1:28:17,  3.63it/s]
 95%|█████████▍| 352232/371472 [5:52:15<1:27:01,  3.68it/s]
 95%|█████████▍| 352233/371472 [5:52:15<1:26:27,  3.71it/s]
 95%|█████████▍| 352234/371472 [5:52:16<1:26:37,  3.70it/s]
 95%|█████████▍| 352235/371472 [5:52:16<1:26:30,  3.71it/s]
 95%|█████████▍| 352236/371472 [5:52:16<1:24:45,  3.78it/s]
 95%|█████████▍| 352237/371472 [5:52:16<1:24:00,  3.82it/s]
 95%|█████████▍| 352238/371472 [5:52:17<1:26:05,  3.72it/s]
 95%|█████████▍| 352239/371472 [5:52:17<1:25:46,  3.74it/s]
 95%|█████████▍| 352240/371472 [5:52:17<1:26:22,  3.71it/s]
                                                           
{'loss': 2.5573, 'learning_rate': 1.4662026762050461e-07, 'epoch': 15.17}

 95%|█████████▍| 352240/371472 [5:52:17<1:26:22,  3.71it/s]
 95%|█████████▍| 352241/371472 [5:52:17<1:27:22,  3.67it/s]
 95%|█████████▍| 352242/371472 [5:52:18<1:26:40,  3.70it/s]
 95%|█████████▍| 352243/371472 [5:52:18<1:24:39,  3.79it/s]
 95%|█████████▍| 352244/371472 [5:52:18<1:23:27,  3.84it/s]
 95%|█████████▍| 352245/371472 [5:52:18<1:23:32,  3.84it/s]
 95%|█████████▍| 352246/371472 [5:52:19<1:23:54,  3.82it/s]
 95%|█████████▍| 352247/371472 [5:52:19<1:22:53,  3.87it/s]
 95%|█████████▍| 352248/371472 [5:52:19<1:30:10,  3.55it/s]
 95%|█████████▍| 352249/371472 [5:52:20<1:31:25,  3.50it/s]
 95%|█████████▍| 352250/371472 [5:52:20<1:42:32,  3.12it/s]
 95%|█████████▍| 352251/371472 [5:52:20<1:37:58,  3.27it/s]
 95%|█████████▍| 352252/371472 [5:52:21<1:33:34,  3.42it/s]
 95%|█████████▍| 352253/371472 [5:52:21<1:35:39,  3.35it/s]
 95%|█████████▍| 352254/371472 [5:52:21<1:35:51,  3.34it/s]
 95%|█████████▍| 352255/371472 [5:52:21<1:36:39,  3.31it/s]
 95%|█████████▍| 352256/371472 [5:52:22<1:34:30,  3.39it/s]
 95%|█████████▍| 352257/371472 [5:52:22<1:31:46,  3.49it/s]
 95%|█████████▍| 352258/371472 [5:52:22<1:28:54,  3.60it/s]
 95%|█████████▍| 352259/371472 [5:52:23<1:27:45,  3.65it/s]
 95%|█████████▍| 352260/371472 [5:52:23<1:29:24,  3.58it/s]
                                                           
{'loss': 2.6522, 'learning_rate': 1.4657178564502577e-07, 'epoch': 15.17}

 95%|█████████▍| 352260/371472 [5:52:23<1:29:24,  3.58it/s]
 95%|█████████▍| 352261/371472 [5:52:23<1:31:48,  3.49it/s]
 95%|█████████▍| 352262/371472 [5:52:23<1:28:23,  3.62it/s]
 95%|█████████▍| 352263/371472 [5:52:24<1:27:02,  3.68it/s]
 95%|█████████▍| 352264/371472 [5:52:24<1:26:04,  3.72it/s]
 95%|█████████▍| 352265/371472 [5:52:24<1:27:54,  3.64it/s]
 95%|█████████▍| 352266/371472 [5:52:25<1:33:32,  3.42it/s]
 95%|█████████▍| 352267/371472 [5:52:25<1:30:05,  3.55it/s]
 95%|█████████▍| 352268/371472 [5:52:25<1:28:15,  3.63it/s]
 95%|█████████▍| 352269/371472 [5:52:25<1:28:46,  3.61it/s]
 95%|█████████▍| 352270/371472 [5:52:26<1:28:26,  3.62it/s]
 95%|█████████▍| 352271/371472 [5:52:26<1:28:22,  3.62it/s]
 95%|█████████▍| 352272/371472 [5:52:26<1:32:43,  3.45it/s]
 95%|█████████▍| 352273/371472 [5:52:26<1:32:39,  3.45it/s]
 95%|█████████▍| 352274/371472 [5:52:27<1:34:51,  3.37it/s]
 95%|█████████▍| 352275/371472 [5:52:27<1:43:42,  3.09it/s]
 95%|█████████▍| 352276/371472 [5:52:27<1:41:58,  3.14it/s]
 95%|█████████▍| 352277/371472 [5:52:28<1:38:41,  3.24it/s]
 95%|█████████▍| 352278/371472 [5:52:28<1:38:40,  3.24it/s]
 95%|█████████▍| 352279/371472 [5:52:28<1:35:27,  3.35it/s]
 95%|█████████▍| 352280/371472 [5:52:29<1:43:36,  3.09it/s]
                                                           
{'loss': 2.6779, 'learning_rate': 1.4652330366954684e-07, 'epoch': 15.17}

 95%|█████████▍| 352280/371472 [5:52:29<1:43:36,  3.09it/s]
 95%|█████████▍| 352281/371472 [5:52:29<1:43:24,  3.09it/s]
 95%|█████████▍| 352282/371472 [5:52:29<1:41:49,  3.14it/s]
 95%|█████████▍| 352283/371472 [5:52:30<1:34:08,  3.40it/s]
 95%|█████████▍| 352284/371472 [5:52:30<1:31:09,  3.51it/s]
 95%|█████████▍| 352285/371472 [5:52:30<1:28:38,  3.61it/s]
 95%|█████████▍| 352286/371472 [5:52:30<1:26:44,  3.69it/s]
 95%|█████████▍| 352287/371472 [5:52:31<1:27:34,  3.65it/s]
 95%|█████████▍| 352288/371472 [5:52:31<1:35:16,  3.36it/s]
 95%|█████████▍| 352289/371472 [5:52:31<1:30:12,  3.54it/s]
 95%|█████████▍| 352290/371472 [5:52:32<1:28:43,  3.60it/s]
 95%|█████████▍| 352291/371472 [5:52:32<1:34:18,  3.39it/s]
 95%|█████████▍| 352292/371472 [5:52:32<1:40:00,  3.20it/s]
 95%|█████████▍| 352293/371472 [5:52:32<1:34:13,  3.39it/s]
 95%|█████████▍| 352294/371472 [5:52:33<1:31:03,  3.51it/s]
 95%|█████████▍| 352295/371472 [5:52:33<1:27:46,  3.64it/s]
 95%|█████████▍| 352296/371472 [5:52:33<1:27:42,  3.64it/s]
 95%|█████████▍| 352297/371472 [5:52:34<1:25:25,  3.74it/s]
 95%|█████████▍| 352298/371472 [5:52:34<1:23:21,  3.83it/s]
 95%|█████████▍| 352299/371472 [5:52:34<1:28:59,  3.59it/s]
 95%|█████████▍| 352300/371472 [5:52:34<1:29:48,  3.56it/s]
                                                           
{'loss': 2.5279, 'learning_rate': 1.46474821694068e-07, 'epoch': 15.17}

 95%|█████████▍| 352300/371472 [5:52:34<1:29:48,  3.56it/s]
 95%|█████████▍| 352301/371472 [5:52:35<1:30:04,  3.55it/s]
 95%|█████████▍| 352302/371472 [5:52:35<1:27:48,  3.64it/s]
 95%|█████████▍| 352303/371472 [5:52:35<1:26:01,  3.71it/s]
 95%|█████████▍| 352304/371472 [5:52:35<1:26:33,  3.69it/s]
 95%|█████████▍| 352305/371472 [5:52:36<1:28:55,  3.59it/s]
 95%|█████████▍| 352306/371472 [5:52:36<1:29:00,  3.59it/s]
 95%|█████████▍| 352307/371472 [5:52:36<1:37:22,  3.28it/s]
 95%|█████████▍| 352308/371472 [5:52:37<1:36:31,  3.31it/s]
 95%|█████████▍| 352309/371472 [5:52:37<1:33:09,  3.43it/s]
 95%|█████████▍| 352310/371472 [5:52:37<1:38:50,  3.23it/s]
 95%|█████████▍| 352311/371472 [5:52:38<1:38:23,  3.25it/s]
 95%|█████████▍| 352312/371472 [5:52:38<1:32:59,  3.43it/s]
 95%|█████████▍| 352313/371472 [5:52:38<1:34:17,  3.39it/s]
 95%|█████████▍| 352314/371472 [5:52:38<1:30:15,  3.54it/s]
 95%|█████████▍| 352315/371472 [5:52:39<1:33:02,  3.43it/s]
 95%|█████████▍| 352316/371472 [5:52:39<1:29:58,  3.55it/s]
 95%|█████████▍| 352317/371472 [5:52:39<1:26:44,  3.68it/s]
 95%|█████████▍| 352318/371472 [5:52:40<1:32:59,  3.43it/s]
 95%|█████████▍| 352319/371472 [5:52:40<1:32:29,  3.45it/s]
 95%|█████████▍| 352320/371472 [5:52:40<1:35:19,  3.35it/s]
                                                           
{'loss': 2.4927, 'learning_rate': 1.4642633971858906e-07, 'epoch': 15.18}

 95%|█████████▍| 352320/371472 [5:52:40<1:35:19,  3.35it/s]
 95%|█████████▍| 352321/371472 [5:52:41<1:39:15,  3.22it/s]
 95%|█████████▍| 352322/371472 [5:52:41<1:35:32,  3.34it/s]
 95%|█████████▍| 352323/371472 [5:52:41<1:32:08,  3.46it/s]
 95%|█████████▍| 352324/371472 [5:52:41<1:30:34,  3.52it/s]
 95%|█████████▍| 352325/371472 [5:52:42<1:39:06,  3.22it/s]
 95%|█████████▍| 352326/371472 [5:52:42<1:36:07,  3.32it/s]
 95%|█████████▍| 352327/371472 [5:52:42<1:33:57,  3.40it/s]
 95%|█████████▍| 352328/371472 [5:52:43<1:31:41,  3.48it/s]
 95%|█████████▍| 352329/371472 [5:52:43<1:33:21,  3.42it/s]
 95%|█████████▍| 352330/371472 [5:52:43<1:31:14,  3.50it/s]
 95%|█████████▍| 352331/371472 [5:52:43<1:30:12,  3.54it/s]
 95%|█████████▍| 352332/371472 [5:52:44<1:27:32,  3.64it/s]
 95%|█████████▍| 352333/371472 [5:52:44<1:32:25,  3.45it/s]
 95%|█████████▍| 352334/371472 [5:52:44<1:33:01,  3.43it/s]
 95%|█████████▍| 352335/371472 [5:52:45<1:33:14,  3.42it/s]
 95%|█████████▍| 352336/371472 [5:52:45<1:29:30,  3.56it/s]
 95%|█████████▍| 352337/371472 [5:52:45<1:27:16,  3.65it/s]
 95%|█████████▍| 352338/371472 [5:52:45<1:28:44,  3.59it/s]
 95%|█████████▍| 352339/371472 [5:52:46<1:28:01,  3.62it/s]
 95%|█████████▍| 352340/371472 [5:52:46<1:26:54,  3.67it/s]
                                                           
{'loss': 2.731, 'learning_rate': 1.463778577431102e-07, 'epoch': 15.18}

 95%|█████████▍| 352340/371472 [5:52:46<1:26:54,  3.67it/s]
 95%|█████████▍| 352341/371472 [5:52:46<1:28:20,  3.61it/s]
 95%|█████████▍| 352342/371472 [5:52:46<1:33:31,  3.41it/s]
 95%|█████████▍| 352343/371472 [5:52:47<1:30:51,  3.51it/s]
 95%|█████████▍| 352344/371472 [5:52:47<1:30:52,  3.51it/s]
 95%|█████████▍| 352345/371472 [5:52:47<1:29:58,  3.54it/s]
 95%|█████████▍| 352346/371472 [5:52:48<1:26:21,  3.69it/s]
 95%|█████████▍| 352347/371472 [5:52:48<1:28:49,  3.59it/s]
 95%|█████████▍| 352348/371472 [5:52:48<1:26:16,  3.69it/s]
 95%|█████████▍| 352349/371472 [5:52:48<1:25:09,  3.74it/s]
 95%|█████████▍| 352350/371472 [5:52:49<1:23:34,  3.81it/s]
 95%|█████████▍| 352351/371472 [5:52:49<1:23:33,  3.81it/s]
 95%|█████████▍| 352352/371472 [5:52:49<1:22:33,  3.86it/s]
 95%|█████████▍| 352353/371472 [5:52:49<1:22:43,  3.85it/s]
 95%|█████████▍| 352354/371472 [5:52:50<1:29:31,  3.56it/s]
 95%|█████████▍| 352355/371472 [5:52:50<1:27:19,  3.65it/s]
 95%|█████████▍| 352356/371472 [5:52:50<1:26:35,  3.68it/s]
 95%|█████████▍| 352357/371472 [5:52:50<1:23:50,  3.80it/s]
 95%|█████████▍| 352358/371472 [5:52:51<1:24:07,  3.79it/s]
 95%|█████████▍| 352359/371472 [5:52:51<1:25:34,  3.72it/s]
 95%|█████████▍| 352360/371472 [5:52:51<1:24:34,  3.77it/s]
                                                           
{'loss': 2.5462, 'learning_rate': 1.4632937576763123e-07, 'epoch': 15.18}

 95%|█████████▍| 352360/371472 [5:52:51<1:24:34,  3.77it/s]
 95%|█████████▍| 352361/371472 [5:52:52<1:24:40,  3.76it/s]
 95%|█████████▍| 352362/371472 [5:52:52<1:29:52,  3.54it/s]
 95%|█████████▍| 352363/371472 [5:52:52<1:30:29,  3.52it/s]
 95%|█████████▍| 352364/371472 [5:52:53<1:49:32,  2.91it/s]
 95%|█████████▍| 352365/371472 [5:52:53<1:44:17,  3.05it/s]
 95%|█████████▍| 352366/371472 [5:52:53<1:40:15,  3.18it/s]
 95%|█████████▍| 352367/371472 [5:52:54<1:35:42,  3.33it/s]
 95%|█████████▍| 352368/371472 [5:52:54<1:34:53,  3.36it/s]
 95%|█████████▍| 352369/371472 [5:52:54<1:33:23,  3.41it/s]
 95%|█████████▍| 352370/371472 [5:52:54<1:34:51,  3.36it/s]
 95%|█████████▍| 352371/371472 [5:52:55<1:31:10,  3.49it/s]
 95%|█████████▍| 352372/371472 [5:52:55<1:30:24,  3.52it/s]
 95%|█████████▍| 352373/371472 [5:52:55<1:29:17,  3.57it/s]
 95%|█████████▍| 352374/371472 [5:52:55<1:25:19,  3.73it/s]
 95%|█████████▍| 352375/371472 [5:52:56<1:26:07,  3.70it/s]
 95%|█████████▍| 352376/371472 [5:52:56<1:27:14,  3.65it/s]
 95%|█████████▍| 352377/371472 [5:52:56<1:30:28,  3.52it/s]
 95%|█████████▍| 352378/371472 [5:52:57<1:28:16,  3.60it/s]
 95%|█████████▍| 352379/371472 [5:52:57<1:24:33,  3.76it/s]
 95%|█████████▍| 352380/371472 [5:52:57<1:24:49,  3.75it/s]
                                                           
{'loss': 2.4691, 'learning_rate': 1.462808937921524e-07, 'epoch': 15.18}

 95%|█████████▍| 352380/371472 [5:52:57<1:24:49,  3.75it/s]
 95%|█████████▍| 352381/371472 [5:52:57<1:27:02,  3.66it/s]
 95%|█████████▍| 352382/371472 [5:52:58<1:24:54,  3.75it/s]
 95%|█████████▍| 352383/371472 [5:52:58<1:26:25,  3.68it/s]
 95%|█████████▍| 352384/371472 [5:52:58<1:23:22,  3.82it/s]
 95%|█████████▍| 352385/371472 [5:52:58<1:22:57,  3.83it/s]
 95%|█████████▍| 352386/371472 [5:52:59<1:25:10,  3.73it/s]
 95%|█████████▍| 352387/371472 [5:52:59<1:24:14,  3.78it/s]
 95%|█████████▍| 352388/371472 [5:52:59<1:23:48,  3.80it/s]
 95%|█████████▍| 352389/371472 [5:52:59<1:25:29,  3.72it/s]
 95%|█████████▍| 352390/371472 [5:53:00<1:25:57,  3.70it/s]
 95%|█████████▍| 352391/371472 [5:53:00<1:27:35,  3.63it/s]
 95%|█████████▍| 352392/371472 [5:53:00<1:30:17,  3.52it/s]
 95%|█████████▍| 352393/371472 [5:53:01<1:26:24,  3.68it/s]
 95%|█████████▍| 352394/371472 [5:53:01<1:25:08,  3.73it/s]
 95%|█████████▍| 352395/371472 [5:53:01<1:24:46,  3.75it/s]
 95%|█████████▍| 352396/371472 [5:53:01<1:31:08,  3.49it/s]
 95%|█████████▍| 352397/371472 [5:53:02<1:28:06,  3.61it/s]
 95%|█████████▍| 352398/371472 [5:53:02<1:27:48,  3.62it/s]
 95%|█████████▍| 352399/371472 [5:53:02<1:27:00,  3.65it/s]
 95%|█████████▍| 352400/371472 [5:53:03<1:26:37,  3.67it/s]
                                                           
{'loss': 2.7852, 'learning_rate': 1.4623241181667348e-07, 'epoch': 15.18}

 95%|█████████▍| 352400/371472 [5:53:03<1:26:37,  3.67it/s]
 95%|█████████▍| 352401/371472 [5:53:03<1:23:53,  3.79it/s]
 95%|█████████▍| 352402/371472 [5:53:03<1:22:09,  3.87it/s]
 95%|█████████▍| 352403/371472 [5:53:03<1:25:00,  3.74it/s]
 95%|█████████▍| 352404/371472 [5:53:04<1:33:35,  3.40it/s]
 95%|█████████▍| 352405/371472 [5:53:04<1:33:12,  3.41it/s]
 95%|█████████▍| 352406/371472 [5:53:04<1:31:07,  3.49it/s]
 95%|█████████▍| 352407/371472 [5:53:05<1:34:00,  3.38it/s]
 95%|█████████▍| 352408/371472 [5:53:05<1:32:40,  3.43it/s]
 95%|█████████▍| 352409/371472 [5:53:05<1:39:47,  3.18it/s]
 95%|█████████▍| 352410/371472 [5:53:05<1:36:39,  3.29it/s]
 95%|█████████▍| 352411/371472 [5:53:06<1:35:53,  3.31it/s]
 95%|█████████▍| 352412/371472 [5:53:06<1:35:14,  3.34it/s]
 95%|█████████▍| 352413/371472 [5:53:06<1:37:51,  3.25it/s]
 95%|█████████▍| 352414/371472 [5:53:07<1:33:39,  3.39it/s]
 95%|█████████▍| 352415/371472 [5:53:07<1:33:11,  3.41it/s]
 95%|█████████▍| 352416/371472 [5:53:07<1:30:45,  3.50it/s]
 95%|█████████▍| 352417/371472 [5:53:07<1:29:11,  3.56it/s]
 95%|█████████▍| 352418/371472 [5:53:08<1:26:06,  3.69it/s]
 95%|█████████▍| 352419/371472 [5:53:08<1:25:42,  3.70it/s]
 95%|█████████▍| 352420/371472 [5:53:08<1:26:51,  3.66it/s]
                                                           
{'loss': 2.5497, 'learning_rate': 1.4618392984119463e-07, 'epoch': 15.18}

 95%|█████████▍| 352420/371472 [5:53:08<1:26:51,  3.66it/s]
 95%|█████████▍| 352421/371472 [5:53:09<1:29:03,  3.57it/s]
 95%|█████████▍| 352422/371472 [5:53:09<1:30:06,  3.52it/s]
 95%|█████████▍| 352423/371472 [5:53:09<1:30:07,  3.52it/s]
 95%|█████████▍| 352424/371472 [5:53:09<1:32:05,  3.45it/s]
 95%|█████████▍| 352425/371472 [5:53:10<1:29:46,  3.54it/s]
 95%|█████████▍| 352426/371472 [5:53:10<1:32:44,  3.42it/s]
 95%|█████████▍| 352427/371472 [5:53:10<1:34:48,  3.35it/s]
 95%|█████████▍| 352428/371472 [5:53:11<1:31:06,  3.48it/s]
 95%|█████████▍| 352429/371472 [5:53:11<1:31:38,  3.46it/s]
 95%|█████████▍| 352430/371472 [5:53:11<1:36:59,  3.27it/s]
 95%|█████████▍| 352431/371472 [5:53:12<1:36:10,  3.30it/s]
 95%|█████████▍| 352432/371472 [5:53:12<1:36:47,  3.28it/s]
 95%|█████████▍| 352433/371472 [5:53:12<1:31:30,  3.47it/s]
 95%|█████████▍| 352434/371472 [5:53:12<1:30:12,  3.52it/s]
 95%|█████████▍| 352435/371472 [5:53:13<1:30:13,  3.52it/s]
 95%|█████████▍| 352436/371472 [5:53:13<1:28:39,  3.58it/s]
 95%|█████████▍| 352437/371472 [5:53:13<1:28:22,  3.59it/s]
 95%|█████████▍| 352438/371472 [5:53:13<1:31:02,  3.48it/s]
 95%|█████████▍| 352439/371472 [5:53:14<1:31:21,  3.47it/s]
 95%|█████████▍| 352440/371472 [5:53:14<1:30:20,  3.51it/s]
                                                           
{'loss': 2.5512, 'learning_rate': 1.461354478657157e-07, 'epoch': 15.18}

 95%|█████████▍| 352440/371472 [5:53:14<1:30:20,  3.51it/s]
 95%|█████████▍| 352441/371472 [5:53:14<1:38:46,  3.21it/s]
 95%|█████████▍| 352442/371472 [5:53:15<1:33:29,  3.39it/s]
 95%|█████████▍| 352443/371472 [5:53:15<1:32:50,  3.42it/s]
 95%|█████████▍| 352444/371472 [5:53:15<1:31:03,  3.48it/s]
 95%|█████████▍| 352445/371472 [5:53:16<1:29:34,  3.54it/s]
 95%|█████████▍| 352446/371472 [5:53:16<1:54:48,  2.76it/s]
 95%|█████████▍| 352447/371472 [5:53:16<1:46:50,  2.97it/s]
 95%|█████████▍| 352448/371472 [5:53:17<1:39:14,  3.19it/s]
 95%|█████████▍| 352449/371472 [5:53:17<1:34:31,  3.35it/s]
 95%|█████████▍| 352450/371472 [5:53:17<1:35:10,  3.33it/s]
 95%|█████████▍| 352451/371472 [5:53:17<1:33:45,  3.38it/s]
 95%|█████████▍| 352452/371472 [5:53:18<1:30:00,  3.52it/s]
 95%|█████████▍| 352453/371472 [5:53:18<1:31:56,  3.45it/s]
 95%|█████████▍| 352454/371472 [5:53:18<1:30:43,  3.49it/s]
 95%|█████████▍| 352455/371472 [5:53:19<1:30:17,  3.51it/s]
 95%|█████████▍| 352456/371472 [5:53:19<1:28:04,  3.60it/s]
 95%|█████████▍| 352457/371472 [5:53:19<1:45:53,  2.99it/s]
 95%|█████████▍| 352458/371472 [5:53:20<1:42:08,  3.10it/s]
 95%|█████████▍| 352459/371472 [5:53:20<1:38:48,  3.21it/s]
 95%|█████████▍| 352460/371472 [5:53:20<1:37:31,  3.25it/s]
                                                           
{'loss': 2.6826, 'learning_rate': 1.4608696589023685e-07, 'epoch': 15.18}

 95%|█████████▍| 352460/371472 [5:53:20<1:37:31,  3.25it/s]
 95%|█████████▍| 352461/371472 [5:53:20<1:35:35,  3.31it/s]
 95%|█████████▍| 352462/371472 [5:53:21<1:31:36,  3.46it/s]
 95%|█████████▍| 352463/371472 [5:53:21<1:32:15,  3.43it/s]
 95%|█████████▍| 352464/371472 [5:53:21<1:37:33,  3.25it/s]
 95%|█████████▍| 352465/371472 [5:53:22<1:34:57,  3.34it/s]
 95%|█████████▍| 352466/371472 [5:53:22<1:30:56,  3.48it/s]
 95%|█████████▍| 352467/371472 [5:53:22<1:28:49,  3.57it/s]
 95%|█████████▍| 352468/371472 [5:53:22<1:26:07,  3.68it/s]
 95%|█████████▍| 352469/371472 [5:53:23<1:32:29,  3.42it/s]
 95%|█████████▍| 352470/371472 [5:53:23<1:31:25,  3.46it/s]
 95%|█████████▍| 352471/371472 [5:53:23<1:29:46,  3.53it/s]
 95%|█████████▍| 352472/371472 [5:53:24<1:30:34,  3.50it/s]
 95%|█████████▍| 352473/371472 [5:53:24<1:29:41,  3.53it/s]
 95%|█████████▍| 352474/371472 [5:53:24<1:28:19,  3.58it/s]
 95%|█████████▍| 352475/371472 [5:53:24<1:28:03,  3.60it/s]
 95%|█████████▍| 352476/371472 [5:53:25<1:27:18,  3.63it/s]
 95%|█████████▍| 352477/371472 [5:53:25<1:24:57,  3.73it/s]
 95%|█████████▍| 352478/371472 [5:53:25<1:26:09,  3.67it/s]
 95%|█████████▍| 352479/371472 [5:53:26<1:25:04,  3.72it/s]
 95%|█████████▍| 352480/371472 [5:53:26<1:27:57,  3.60it/s]
                                                           
{'loss': 2.5204, 'learning_rate': 1.460384839147579e-07, 'epoch': 15.18}

 95%|█████████▍| 352480/371472 [5:53:26<1:27:57,  3.60it/s]
 95%|█████████▍| 352481/371472 [5:53:26<1:28:33,  3.57it/s]
 95%|█████████▍| 352482/371472 [5:53:26<1:27:08,  3.63it/s]
 95%|█████████▍| 352483/371472 [5:53:27<1:27:13,  3.63it/s]
 95%|█████████▍| 352484/371472 [5:53:27<1:28:47,  3.56it/s]
 95%|█████████▍| 352485/371472 [5:53:27<1:26:45,  3.65it/s]
 95%|█████████▍| 352486/371472 [5:53:27<1:26:13,  3.67it/s]
 95%|█████████▍| 352487/371472 [5:53:28<1:27:47,  3.60it/s]
 95%|█████████▍| 352488/371472 [5:53:28<1:30:19,  3.50it/s]
 95%|█████████▍| 352489/371472 [5:53:28<1:26:51,  3.64it/s]
 95%|█████████▍| 352490/371472 [5:53:29<1:25:36,  3.70it/s]
 95%|█████████▍| 352491/371472 [5:53:29<1:25:56,  3.68it/s]
 95%|█████████▍| 352492/371472 [5:53:29<1:41:59,  3.10it/s]
 95%|█████████▍| 352493/371472 [5:53:30<1:37:22,  3.25it/s]
 95%|█████████▍| 352494/371472 [5:53:30<1:35:29,  3.31it/s]
 95%|█████████▍| 352495/371472 [5:53:30<1:30:13,  3.51it/s]
 95%|█████████▍| 352496/371472 [5:53:30<1:30:18,  3.50it/s]
 95%|█████████▍| 352497/371472 [5:53:31<1:27:16,  3.62it/s]
 95%|█████████▍| 352498/371472 [5:53:31<1:26:46,  3.64it/s]
 95%|█████████▍| 352499/371472 [5:53:31<1:27:28,  3.61it/s]
 95%|█████████▍| 352500/371472 [5:53:31<1:27:31,  3.61it/s]
                                                           
{'loss': 2.5001, 'learning_rate': 1.4599000193927907e-07, 'epoch': 15.18}

 95%|█████████▍| 352500/371472 [5:53:31<1:27:31,  3.61it/s]
 95%|█████████▍| 352501/371472 [5:53:32<1:38:42,  3.20it/s]
 95%|█████████▍| 352502/371472 [5:53:32<1:32:42,  3.41it/s]
 95%|█████████▍| 352503/371472 [5:53:32<1:35:59,  3.29it/s]
 95%|█████████▍| 352504/371472 [5:53:33<1:30:30,  3.49it/s]
 95%|█████████▍| 352505/371472 [5:53:33<1:30:22,  3.50it/s]
 95%|█████████▍| 352506/371472 [5:53:33<1:27:55,  3.59it/s]
 95%|█████████▍| 352507/371472 [5:53:33<1:28:19,  3.58it/s]
 95%|█████████▍| 352508/371472 [5:53:34<1:25:47,  3.68it/s]
 95%|█████████▍| 352509/371472 [5:53:34<1:29:42,  3.52it/s]
 95%|█████████▍| 352510/371472 [5:53:34<1:30:25,  3.49it/s]
 95%|█████████▍| 352511/371472 [5:53:35<1:28:38,  3.57it/s]
 95%|█████████▍| 352512/371472 [5:53:35<1:26:54,  3.64it/s]
 95%|█████████▍| 352513/371472 [5:53:35<1:26:45,  3.64it/s]
 95%|█████████▍| 352514/371472 [5:53:36<1:35:21,  3.31it/s]
 95%|█████████▍| 352515/371472 [5:53:36<1:31:30,  3.45it/s]
 95%|█████████▍| 352516/371472 [5:53:36<1:29:59,  3.51it/s]
 95%|█████████▍| 352517/371472 [5:53:36<1:30:54,  3.48it/s]
 95%|█████████▍| 352518/371472 [5:53:37<1:28:38,  3.56it/s]
 95%|█████████▍| 352519/371472 [5:53:37<1:27:55,  3.59it/s]
 95%|█████████▍| 352520/371472 [5:53:37<1:31:03,  3.47it/s]
                                                           
{'loss': 2.5178, 'learning_rate': 1.4594151996380012e-07, 'epoch': 15.18}

 95%|█████████▍| 352520/371472 [5:53:37<1:31:03,  3.47it/s]
 95%|█████████▍| 352521/371472 [5:53:37<1:29:53,  3.51it/s]
 95%|█████████▍| 352522/371472 [5:53:38<1:32:14,  3.42it/s]
 95%|█████████▍| 352523/371472 [5:53:38<1:33:35,  3.37it/s]
 95%|█████████▍| 352524/371472 [5:53:38<1:31:42,  3.44it/s]
 95%|█████████▍| 352525/371472 [5:53:39<1:31:28,  3.45it/s]
 95%|█████████▍| 352526/371472 [5:53:39<1:29:16,  3.54it/s]
 95%|█████████▍| 352527/371472 [5:53:39<1:30:56,  3.47it/s]
 95%|█████████▍| 352528/371472 [5:53:39<1:29:38,  3.52it/s]
 95%|█████████▍| 352529/371472 [5:53:40<1:27:36,  3.60it/s]
 95%|█████████▍| 352530/371472 [5:53:40<1:24:17,  3.75it/s]
 95%|█████████▍| 352531/371472 [5:53:40<1:22:27,  3.83it/s]
 95%|█████████▍| 352532/371472 [5:53:40<1:20:39,  3.91it/s]
 95%|█████████▍| 352533/371472 [5:53:41<1:20:45,  3.91it/s]
 95%|█████████▍| 352534/371472 [5:53:41<1:21:37,  3.87it/s]
 95%|█████████▍| 352535/371472 [5:53:41<1:21:55,  3.85it/s]
 95%|█████████▍| 352536/371472 [5:53:42<1:22:55,  3.81it/s]
 95%|█████████▍| 352537/371472 [5:53:42<1:24:03,  3.75it/s]
 95%|█████████▍| 352538/371472 [5:53:42<1:24:53,  3.72it/s]
 95%|█████████▍| 352539/371472 [5:53:42<1:32:15,  3.42it/s]
 95%|█████████▍| 352540/371472 [5:53:43<1:29:46,  3.51it/s]
                                                           
{'loss': 2.4805, 'learning_rate': 1.4589303798832116e-07, 'epoch': 15.18}

 95%|█████████▍| 352540/371472 [5:53:43<1:29:46,  3.51it/s]
 95%|█████████▍| 352541/371472 [5:53:43<1:27:42,  3.60it/s]
 95%|█████████▍| 352542/371472 [5:53:43<1:28:49,  3.55it/s]
 95%|█████████▍| 352543/371472 [5:53:44<1:27:08,  3.62it/s]
 95%|█████████▍| 352544/371472 [5:53:44<1:26:52,  3.63it/s]
 95%|█████████▍| 352545/371472 [5:53:44<1:25:25,  3.69it/s]
 95%|█████████▍| 352546/371472 [5:53:44<1:39:32,  3.17it/s]
 95%|█████████▍| 352547/371472 [5:53:45<1:33:47,  3.36it/s]
 95%|█████████▍| 352548/371472 [5:53:45<1:34:38,  3.33it/s]
 95%|█████████▍| 352549/371472 [5:53:45<1:35:53,  3.29it/s]
 95%|█████████▍| 352550/371472 [5:53:46<1:33:46,  3.36it/s]
 95%|█████████▍| 352551/371472 [5:53:46<1:28:57,  3.55it/s]
 95%|█████████▍| 352552/371472 [5:53:46<1:30:07,  3.50it/s]
 95%|█████████▍| 352553/371472 [5:53:46<1:29:29,  3.52it/s]
 95%|█████████▍| 352554/371472 [5:53:47<1:27:33,  3.60it/s]
 95%|█████████▍| 352555/371472 [5:53:47<1:25:59,  3.67it/s]
 95%|█████████▍| 352556/371472 [5:53:47<1:32:13,  3.42it/s]
 95%|█████████▍| 352557/371472 [5:53:48<1:27:18,  3.61it/s]
 95%|█████████▍| 352558/371472 [5:53:48<1:27:58,  3.58it/s]
 95%|█████████▍| 352559/371472 [5:53:48<1:24:38,  3.72it/s]
 95%|█████████▍| 352560/371472 [5:53:48<1:27:09,  3.62it/s]
                                                           
{'loss': 2.5173, 'learning_rate': 1.4584455601284234e-07, 'epoch': 15.19}

 95%|█████████▍| 352560/371472 [5:53:48<1:27:09,  3.62it/s]
 95%|█████████▍| 352561/371472 [5:53:49<1:23:27,  3.78it/s]
 95%|█████████▍| 352562/371472 [5:53:49<1:25:19,  3.69it/s]
 95%|█████████▍| 352563/371472 [5:53:49<1:29:56,  3.50it/s]
 95%|█████████▍| 352564/371472 [5:53:49<1:25:37,  3.68it/s]
 95%|█████████▍| 352565/371472 [5:53:50<1:28:22,  3.57it/s]
 95%|█████████▍| 352566/371472 [5:53:50<1:25:03,  3.70it/s]
 95%|█████████▍| 352567/371472 [5:53:50<1:25:16,  3.70it/s]
 95%|█████████▍| 352568/371472 [5:53:51<1:27:20,  3.61it/s]
 95%|█████████▍| 352569/371472 [5:53:51<1:24:26,  3.73it/s]
 95%|█████████▍| 352570/371472 [5:53:51<1:28:38,  3.55it/s]
 95%|█████████▍| 352571/371472 [5:53:51<1:31:24,  3.45it/s]
 95%|█████████▍| 352572/371472 [5:53:52<1:31:43,  3.43it/s]
 95%|█████████▍| 352573/371472 [5:53:52<1:27:04,  3.62it/s]
 95%|█████████▍| 352574/371472 [5:53:52<1:25:47,  3.67it/s]
 95%|█████████▍| 352575/371472 [5:53:53<1:35:32,  3.30it/s]
 95%|█████████▍| 352576/371472 [5:53:53<1:33:24,  3.37it/s]
 95%|█████████▍| 352577/371472 [5:53:53<1:30:15,  3.49it/s]
 95%|█████████▍| 352578/371472 [5:53:53<1:28:07,  3.57it/s]
 95%|█████████▍| 352579/371472 [5:53:54<1:27:24,  3.60it/s]
 95%|█████████▍| 352580/371472 [5:53:54<1:45:37,  2.98it/s]
                                                           
{'loss': 2.435, 'learning_rate': 1.4579607403736339e-07, 'epoch': 15.19}

 95%|█████████▍| 352580/371472 [5:53:54<1:45:37,  2.98it/s]
 95%|█████████▍| 352581/371472 [5:53:54<1:43:12,  3.05it/s]
 95%|█████████▍| 352582/371472 [5:53:55<1:35:15,  3.31it/s]
 95%|█████████▍| 352583/371472 [5:53:55<1:30:03,  3.50it/s]
 95%|█████████▍| 352584/371472 [5:53:55<1:26:13,  3.65it/s]
 95%|█████████▍| 352585/371472 [5:53:56<1:32:18,  3.41it/s]
 95%|█████████▍| 352586/371472 [5:53:56<1:30:48,  3.47it/s]
 95%|█████████▍| 352587/371472 [5:53:56<1:30:14,  3.49it/s]
 95%|█████████▍| 352588/371472 [5:53:56<1:38:58,  3.18it/s]
 95%|█████████▍| 352589/371472 [5:53:57<1:41:18,  3.11it/s]
 95%|█████████▍| 352590/371472 [5:53:57<1:42:08,  3.08it/s]
 95%|█████████▍| 352591/371472 [5:53:57<1:39:23,  3.17it/s]
 95%|█████████▍| 352592/371472 [5:53:58<1:37:13,  3.24it/s]
 95%|█████████▍| 352593/371472 [5:53:58<1:34:29,  3.33it/s]
 95%|█████████▍| 352594/371472 [5:53:58<1:32:47,  3.39it/s]
 95%|█████████▍| 352595/371472 [5:53:59<1:31:50,  3.43it/s]
 95%|█████████▍| 352596/371472 [5:53:59<1:34:23,  3.33it/s]
 95%|█████████▍| 352597/371472 [5:53:59<1:32:19,  3.41it/s]
 95%|█████████▍| 352598/371472 [5:53:59<1:31:09,  3.45it/s]
 95%|█████████▍| 352599/371472 [5:54:00<1:31:29,  3.44it/s]
 95%|█████████▍| 352600/371472 [5:54:00<1:30:13,  3.49it/s]
                                                           
{'loss': 2.5328, 'learning_rate': 1.4574759206188454e-07, 'epoch': 15.19}

 95%|█████████▍| 352600/371472 [5:54:00<1:30:13,  3.49it/s]
 95%|█████████▍| 352601/371472 [5:54:00<1:27:50,  3.58it/s]
 95%|█████████▍| 352602/371472 [5:54:01<1:25:52,  3.66it/s]
 95%|█████████▍| 352603/371472 [5:54:01<1:25:46,  3.67it/s]
 95%|█████████▍| 352604/371472 [5:54:01<1:23:38,  3.76it/s]
 95%|█████████▍| 352605/371472 [5:54:01<1:29:07,  3.53it/s]
 95%|█████████▍| 352606/371472 [5:54:02<1:29:06,  3.53it/s]
 95%|█████████▍| 352607/371472 [5:54:02<1:32:38,  3.39it/s]
 95%|█████████▍| 352608/371472 [5:54:02<1:27:41,  3.59it/s]
 95%|█████████▍| 352609/371472 [5:54:03<1:26:42,  3.63it/s]
 95%|█████████▍| 352610/371472 [5:54:03<1:25:53,  3.66it/s]
 95%|█████████▍| 352611/371472 [5:54:03<1:25:25,  3.68it/s]
 95%|█████████▍| 352612/371472 [5:54:03<1:28:42,  3.54it/s]
 95%|█████████▍| 352613/371472 [5:54:04<1:36:25,  3.26it/s]
 95%|█████████▍| 352614/371472 [5:54:04<1:32:03,  3.41it/s]
 95%|█████████▍| 352615/371472 [5:54:04<1:28:37,  3.55it/s]
 95%|█████████▍| 352616/371472 [5:54:05<1:29:13,  3.52it/s]
 95%|█████████▍| 352617/371472 [5:54:05<1:27:50,  3.58it/s]
 95%|█████████▍| 352618/371472 [5:54:05<1:32:32,  3.40it/s]
 95%|█████████▍| 352619/371472 [5:54:05<1:30:03,  3.49it/s]
 95%|█████████▍| 352620/371472 [5:54:06<1:28:09,  3.56it/s]
                                                           
{'loss': 2.6025, 'learning_rate': 1.456991100864056e-07, 'epoch': 15.19}

 95%|█████████▍| 352620/371472 [5:54:06<1:28:09,  3.56it/s]
 95%|█████████▍| 352621/371472 [5:54:06<1:24:38,  3.71it/s]
 95%|█████████▍| 352622/371472 [5:54:06<1:23:55,  3.74it/s]
 95%|█████████▍| 352623/371472 [5:54:06<1:23:36,  3.76it/s]
 95%|█████████▍| 352624/371472 [5:54:07<1:26:21,  3.64it/s]
 95%|█████████▍| 352625/371472 [5:54:07<1:24:32,  3.72it/s]
 95%|█████████▍| 352626/371472 [5:54:07<1:23:07,  3.78it/s]
 95%|█████████▍| 352627/371472 [5:54:08<1:22:37,  3.80it/s]
 95%|█████████▍| 352628/371472 [5:54:08<1:21:48,  3.84it/s]
 95%|█████████▍| 352629/371472 [5:54:08<1:24:07,  3.73it/s]
 95%|█████████▍| 352630/371472 [5:54:08<1:25:46,  3.66it/s]
 95%|█████████▍| 352631/371472 [5:54:09<1:29:26,  3.51it/s]
 95%|█████████▍| 352632/371472 [5:54:09<1:29:58,  3.49it/s]
 95%|█████████▍| 352633/371472 [5:54:09<1:29:54,  3.49it/s]
 95%|█████████▍| 352634/371472 [5:54:09<1:26:15,  3.64it/s]
 95%|█████████▍| 352635/371472 [5:54:10<1:24:40,  3.71it/s]
 95%|█████████▍| 352636/371472 [5:54:10<1:26:38,  3.62it/s]
 95%|█████████▍| 352637/371472 [5:54:10<1:27:18,  3.60it/s]
 95%|█████████▍| 352638/371472 [5:54:11<1:26:44,  3.62it/s]
 95%|█████████▍| 352639/371472 [5:54:11<1:27:55,  3.57it/s]
 95%|█████████▍| 352640/371472 [5:54:11<1:30:22,  3.47it/s]
                                                           
{'loss': 2.5481, 'learning_rate': 1.4565062811092676e-07, 'epoch': 15.19}

 95%|█████████▍| 352640/371472 [5:54:11<1:30:22,  3.47it/s]
 95%|█████████▍| 352641/371472 [5:54:11<1:27:26,  3.59it/s]
 95%|█████████▍| 352642/371472 [5:54:12<1:26:21,  3.63it/s]
 95%|█████████▍| 352643/371472 [5:54:12<1:25:23,  3.68it/s]
 95%|█████████▍| 352644/371472 [5:54:12<1:25:25,  3.67it/s]
 95%|█████████▍| 352645/371472 [5:54:13<1:28:33,  3.54it/s]
 95%|█████████▍| 352646/371472 [5:54:13<1:26:25,  3.63it/s]
 95%|█████████▍| 352647/371472 [5:54:13<1:27:22,  3.59it/s]
 95%|█████████▍| 352648/371472 [5:54:13<1:30:41,  3.46it/s]
 95%|█████████▍| 352649/371472 [5:54:14<1:35:31,  3.28it/s]
 95%|█████████▍| 352650/371472 [5:54:14<1:34:53,  3.31it/s]
 95%|█████████▍| 352651/371472 [5:54:14<1:32:05,  3.41it/s]
 95%|█████████▍| 352652/371472 [5:54:15<1:28:10,  3.56it/s]
 95%|█████████▍| 352653/371472 [5:54:15<1:27:35,  3.58it/s]
 95%|█████████▍| 352654/371472 [5:54:15<1:25:42,  3.66it/s]
 95%|█████████▍| 352655/371472 [5:54:15<1:25:08,  3.68it/s]
 95%|█████████▍| 352656/371472 [5:54:16<1:27:15,  3.59it/s]
 95%|█████████▍| 352657/371472 [5:54:16<1:25:33,  3.66it/s]
 95%|█████████▍| 352658/371472 [5:54:16<1:30:57,  3.45it/s]
 95%|█████████▍| 352659/371472 [5:54:17<1:37:09,  3.23it/s]
 95%|█████████▍| 352660/371472 [5:54:17<1:47:43,  2.91it/s]
                                                           
{'loss': 2.5107, 'learning_rate': 1.4560214613544783e-07, 'epoch': 15.19}

 95%|█████████▍| 352660/371472 [5:54:17<1:47:43,  2.91it/s]
 95%|█████████▍| 352661/371472 [5:54:17<1:42:14,  3.07it/s]
 95%|█████████▍| 352662/371472 [5:54:18<1:36:07,  3.26it/s]
 95%|█████████▍| 352663/371472 [5:54:18<1:31:28,  3.43it/s]
 95%|█████████▍| 352664/371472 [5:54:18<1:29:20,  3.51it/s]
 95%|█████████▍| 352665/371472 [5:54:18<1:32:25,  3.39it/s]
 95%|█████████▍| 352666/371472 [5:54:19<1:28:16,  3.55it/s]
 95%|█████████▍| 352667/371472 [5:54:19<1:25:50,  3.65it/s]
 95%|█████████▍| 352668/371472 [5:54:19<1:31:39,  3.42it/s]
 95%|█████████▍| 352669/371472 [5:54:20<1:31:39,  3.42it/s]
 95%|█████████▍| 352670/371472 [5:54:20<1:29:21,  3.51it/s]
 95%|█████████▍| 352671/371472 [5:54:20<1:30:14,  3.47it/s]
 95%|█████████▍| 352672/371472 [5:54:21<1:42:00,  3.07it/s]
 95%|█████████▍| 352673/371472 [5:54:21<1:39:23,  3.15it/s]
 95%|█████████▍| 352674/371472 [5:54:21<1:33:48,  3.34it/s]
 95%|█████████▍| 352675/371472 [5:54:21<1:33:05,  3.37it/s]
 95%|█████████▍| 352676/371472 [5:54:22<1:28:40,  3.53it/s]
 95%|█████████▍| 352677/371472 [5:54:22<1:28:59,  3.52it/s]
 95%|█████████▍| 352678/371472 [5:54:22<1:25:45,  3.65it/s]
 95%|█████████▍| 352679/371472 [5:54:22<1:27:28,  3.58it/s]
 95%|█████████▍| 352680/371472 [5:54:23<1:27:58,  3.56it/s]
                                                           
{'loss': 2.5927, 'learning_rate': 1.4555366415996898e-07, 'epoch': 15.19}

 95%|█████████▍| 352680/371472 [5:54:23<1:27:58,  3.56it/s]
 95%|█████████▍| 352681/371472 [5:54:23<1:27:15,  3.59it/s]
 95%|█████████▍| 352682/371472 [5:54:23<1:28:14,  3.55it/s]
 95%|█████████▍| 352683/371472 [5:54:24<1:25:28,  3.66it/s]
 95%|█████████▍| 352684/371472 [5:54:24<1:31:09,  3.44it/s]
 95%|█████████▍| 352685/371472 [5:54:24<1:30:18,  3.47it/s]
 95%|█████████▍| 352686/371472 [5:54:24<1:29:34,  3.50it/s]
 95%|█████████▍| 352687/371472 [5:54:25<1:28:14,  3.55it/s]
 95%|█████████▍| 352688/371472 [5:54:25<1:33:35,  3.34it/s]
 95%|█████████▍| 352689/371472 [5:54:25<1:32:08,  3.40it/s]
 95%|█████████▍| 352690/371472 [5:54:26<1:27:57,  3.56it/s]
 95%|█████████▍| 352691/371472 [5:54:26<1:26:18,  3.63it/s]
 95%|█████████▍| 352692/371472 [5:54:26<1:42:28,  3.05it/s]
 95%|█████████▍| 352693/371472 [5:54:27<1:41:49,  3.07it/s]
 95%|█████████▍| 352694/371472 [5:54:27<1:34:22,  3.32it/s]
 95%|█████████▍| 352695/371472 [5:54:27<1:35:20,  3.28it/s]
 95%|█████████▍| 352696/371472 [5:54:27<1:31:16,  3.43it/s]
 95%|█████████▍| 352697/371472 [5:54:28<1:37:38,  3.20it/s]
 95%|█████████▍| 352698/371472 [5:54:28<1:33:35,  3.34it/s]
 95%|█████████▍| 352699/371472 [5:54:28<1:28:54,  3.52it/s]
 95%|█████████▍| 352700/371472 [5:54:29<1:30:45,  3.45it/s]
                                                           
{'loss': 2.5984, 'learning_rate': 1.4550518218449008e-07, 'epoch': 15.19}

 95%|█████████▍| 352700/371472 [5:54:29<1:30:45,  3.45it/s]
 95%|█████████▍| 352701/371472 [5:54:29<1:28:42,  3.53it/s]
 95%|█████████▍| 352702/371472 [5:54:29<1:27:11,  3.59it/s]
 95%|█████████▍| 352703/371472 [5:54:29<1:26:13,  3.63it/s]
 95%|█████████▍| 352704/371472 [5:54:30<1:23:17,  3.76it/s]
 95%|█████████▍| 352705/371472 [5:54:30<1:21:40,  3.83it/s]
 95%|█████████▍| 352706/371472 [5:54:30<1:20:35,  3.88it/s]
 95%|█████████▍| 352707/371472 [5:54:31<1:28:47,  3.52it/s]
 95%|█████████▍| 352708/371472 [5:54:31<1:29:46,  3.48it/s]
 95%|█████████▍| 352709/371472 [5:54:31<1:28:52,  3.52it/s]
 95%|█████████▍| 352710/371472 [5:54:31<1:34:58,  3.29it/s]
 95%|█████████▍| 352711/371472 [5:54:32<1:37:32,  3.21it/s]
 95%|█████████▍| 352712/371472 [5:54:32<1:33:57,  3.33it/s]
 95%|█████████▍| 352713/371472 [5:54:32<1:30:53,  3.44it/s]
 95%|█████████▍| 352714/371472 [5:54:33<1:33:15,  3.35it/s]
 95%|█████████▍| 352715/371472 [5:54:33<1:29:24,  3.50it/s]
 95%|█████████▍| 352716/371472 [5:54:33<1:39:30,  3.14it/s]
 95%|█████████▍| 352717/371472 [5:54:34<1:38:12,  3.18it/s]
 95%|█████████▍| 352718/371472 [5:54:34<1:34:33,  3.31it/s]
 95%|█████████▍| 352719/371472 [5:54:34<1:33:40,  3.34it/s]
 95%|█████████▍| 352720/371472 [5:54:34<1:29:21,  3.50it/s]
                                                           
{'loss': 2.6067, 'learning_rate': 1.454567002090112e-07, 'epoch': 15.19}

 95%|█████████▍| 352720/371472 [5:54:34<1:29:21,  3.50it/s]
 95%|█████████▍| 352721/371472 [5:54:35<1:29:48,  3.48it/s]
 95%|█████████▍| 352722/371472 [5:54:35<1:27:13,  3.58it/s]
 95%|█████████▍| 352723/371472 [5:54:35<1:26:36,  3.61it/s]
 95%|█████████▍| 352724/371472 [5:54:35<1:26:26,  3.62it/s]
 95%|█████████▍| 352725/371472 [5:54:36<1:26:14,  3.62it/s]
 95%|█████████▍| 352726/371472 [5:54:36<1:23:56,  3.72it/s]
 95%|█████████▍| 352727/371472 [5:54:36<1:25:31,  3.65it/s]
 95%|█████████▍| 352728/371472 [5:54:37<1:25:02,  3.67it/s]
 95%|█████████▍| 352729/371472 [5:54:37<1:23:42,  3.73it/s]
 95%|█████████▍| 352730/371472 [5:54:37<1:42:47,  3.04it/s]
 95%|█████████▍| 352731/371472 [5:54:38<1:42:53,  3.04it/s]
 95%|█████████▍| 352732/371472 [5:54:38<1:36:48,  3.23it/s]
 95%|█████████▍| 352733/371472 [5:54:38<1:37:11,  3.21it/s]
 95%|█████████▍| 352734/371472 [5:54:38<1:32:32,  3.37it/s]
 95%|█████████▍| 352735/371472 [5:54:39<1:30:32,  3.45it/s]
 95%|█████████▍| 352736/371472 [5:54:39<1:27:09,  3.58it/s]
 95%|█████████▍| 352737/371472 [5:54:39<1:30:35,  3.45it/s]
 95%|█████████▍| 352738/371472 [5:54:40<1:28:51,  3.51it/s]
 95%|█████████▍| 352739/371472 [5:54:40<1:27:23,  3.57it/s]
 95%|█████████▍| 352740/371472 [5:54:40<1:28:43,  3.52it/s]
                                                           
{'loss': 2.7445, 'learning_rate': 1.4540821823353225e-07, 'epoch': 15.19}

 95%|█████████▍| 352740/371472 [5:54:40<1:28:43,  3.52it/s]
 95%|█████████▍| 352741/371472 [5:54:40<1:27:22,  3.57it/s]
 95%|█████████▍| 352742/371472 [5:54:41<1:23:48,  3.72it/s]
 95%|█████████▍| 352743/371472 [5:54:41<1:31:45,  3.40it/s]
 95%|█████████▍| 352744/371472 [5:54:41<1:30:21,  3.45it/s]
 95%|█████████▍| 352745/371472 [5:54:42<1:27:29,  3.57it/s]
 95%|█████████▍| 352746/371472 [5:54:42<1:27:57,  3.55it/s]
 95%|█████████▍| 352747/371472 [5:54:42<1:25:00,  3.67it/s]
 95%|█████████▍| 352748/371472 [5:54:42<1:30:34,  3.45it/s]
 95%|█████████▍| 352749/371472 [5:54:43<1:27:43,  3.56it/s]
 95%|█████████▍| 352750/371472 [5:54:43<1:27:17,  3.57it/s]
 95%|█████████▍| 352751/371472 [5:54:43<1:28:20,  3.53it/s]
 95%|█████████▍| 352752/371472 [5:54:44<1:27:38,  3.56it/s]
 95%|█████████▍| 352753/371472 [5:54:44<1:26:34,  3.60it/s]
 95%|█████████▍| 352754/371472 [5:54:44<1:25:53,  3.63it/s]
 95%|█████████▍| 352755/371472 [5:54:44<1:28:57,  3.51it/s]
 95%|█████████▍| 352756/371472 [5:54:45<1:34:04,  3.32it/s]
 95%|█████████▍| 352757/371472 [5:54:45<1:35:38,  3.26it/s]
 95%|█████████▍| 352758/371472 [5:54:45<1:31:28,  3.41it/s]
 95%|█████████▍| 352759/371472 [5:54:46<1:31:50,  3.40it/s]
 95%|█████████▍| 352760/371472 [5:54:46<1:29:06,  3.50it/s]
                                                           
{'loss': 2.6974, 'learning_rate': 1.4535973625805343e-07, 'epoch': 15.19}

 95%|█████████▍| 352760/371472 [5:54:46<1:29:06,  3.50it/s]
 95%|█████████▍| 352761/371472 [5:54:46<1:26:48,  3.59it/s]
 95%|█████████▍| 352762/371472 [5:54:46<1:28:09,  3.54it/s]
 95%|█████████▍| 352763/371472 [5:54:47<1:33:43,  3.33it/s]
 95%|█████████▍| 352764/371472 [5:54:47<1:32:42,  3.36it/s]
 95%|█████████▍| 352765/371472 [5:54:47<1:28:19,  3.53it/s]
 95%|█████████▍| 352766/371472 [5:54:48<1:28:27,  3.52it/s]
 95%|█████████▍| 352767/371472 [5:54:48<1:29:31,  3.48it/s]
 95%|█████████▍| 352768/371472 [5:54:48<1:29:46,  3.47it/s]
 95%|█████████▍| 352769/371472 [5:54:48<1:26:12,  3.62it/s]
 95%|█████████▍| 352770/371472 [5:54:49<1:29:46,  3.47it/s]
 95%|█████████▍| 352771/371472 [5:54:49<1:26:24,  3.61it/s]
 95%|█████████▍| 352772/371472 [5:54:49<1:27:22,  3.57it/s]
 95%|█████████▍| 352773/371472 [5:54:50<1:30:25,  3.45it/s]
 95%|█████████▍| 352774/371472 [5:54:50<1:28:42,  3.51it/s]
 95%|█████████▍| 352775/371472 [5:54:50<1:26:14,  3.61it/s]
 95%|█████████▍| 352776/371472 [5:54:50<1:26:05,  3.62it/s]
 95%|█████████▍| 352777/371472 [5:54:51<1:30:01,  3.46it/s]
 95%|█████████▍| 352778/371472 [5:54:51<1:32:46,  3.36it/s]
 95%|█████████▍| 352779/371472 [5:54:51<1:31:13,  3.42it/s]
 95%|█████████▍| 352780/371472 [5:54:52<1:30:07,  3.46it/s]
                                                           
{'loss': 2.5571, 'learning_rate': 1.4531125428257447e-07, 'epoch': 15.19}

 95%|█████████▍| 352780/371472 [5:54:52<1:30:07,  3.46it/s]
 95%|█████████▍| 352781/371472 [5:54:52<1:31:13,  3.41it/s]
 95%|█████████▍| 352782/371472 [5:54:52<1:28:27,  3.52it/s]
 95%|█████████▍| 352783/371472 [5:54:52<1:29:18,  3.49it/s]
 95%|█████████▍| 352784/371472 [5:54:53<1:27:22,  3.56it/s]
 95%|█████████▍| 352785/371472 [5:54:53<1:26:27,  3.60it/s]
 95%|█████████▍| 352786/371472 [5:54:53<1:24:52,  3.67it/s]
 95%|█████████▍| 352787/371472 [5:54:53<1:22:58,  3.75it/s]
 95%|█████████▍| 352788/371472 [5:54:54<1:23:08,  3.75it/s]
 95%|█████████▍| 352789/371472 [5:54:54<1:25:32,  3.64it/s]
 95%|█████████▍| 352790/371472 [5:54:54<1:25:11,  3.65it/s]
 95%|█████████▍| 352791/371472 [5:54:55<1:25:02,  3.66it/s]
 95%|█████████▍| 352792/371472 [5:54:55<1:32:24,  3.37it/s]
 95%|█████████▍| 352793/371472 [5:54:55<1:33:41,  3.32it/s]
 95%|█████████▍| 352794/371472 [5:54:55<1:27:43,  3.55it/s]
 95%|█████████▍| 352795/371472 [5:54:56<1:32:36,  3.36it/s]
 95%|█████████▍| 352796/371472 [5:54:56<1:33:38,  3.32it/s]
 95%|█████████▍| 352797/371472 [5:54:56<1:28:02,  3.54it/s]
 95%|█████████▍| 352798/371472 [5:54:57<1:41:29,  3.07it/s]
 95%|█████████▍| 352799/371472 [5:54:57<1:34:55,  3.28it/s]
 95%|█████████▍| 352800/371472 [5:54:57<1:28:59,  3.50it/s]
                                                           
{'loss': 2.6046, 'learning_rate': 1.4526277230709562e-07, 'epoch': 15.2}

 95%|█████████▍| 352800/371472 [5:54:57<1:28:59,  3.50it/s]
 95%|█████████▍| 352801/371472 [5:54:58<1:29:10,  3.49it/s]
 95%|█████████▍| 352802/371472 [5:54:58<1:27:57,  3.54it/s]
 95%|█████████▍| 352803/371472 [5:54:58<1:29:27,  3.48it/s]
 95%|█████████▍| 352804/371472 [5:54:58<1:28:17,  3.52it/s]
 95%|█████████▍| 352805/371472 [5:54:59<1:32:38,  3.36it/s]
 95%|█████████▍| 352806/371472 [5:54:59<1:30:23,  3.44it/s]
 95%|█████████▍| 352807/371472 [5:54:59<1:30:23,  3.44it/s]
 95%|█████████▍| 352808/371472 [5:55:00<1:32:25,  3.37it/s]
 95%|█████████▍| 352809/371472 [5:55:00<1:33:23,  3.33it/s]
 95%|█████████▍| 352810/371472 [5:55:00<1:28:55,  3.50it/s]
 95%|█████████▍| 352811/371472 [5:55:01<1:32:42,  3.35it/s]
 95%|█████████▍| 352812/371472 [5:55:01<1:31:57,  3.38it/s]
 95%|█████████▍| 352813/371472 [5:55:01<1:30:40,  3.43it/s]
 95%|█████████▍| 352814/371472 [5:55:01<1:29:26,  3.48it/s]
 95%|█████████▍| 352815/371472 [5:55:02<1:26:37,  3.59it/s]
 95%|█████████▍| 352816/371472 [5:55:02<1:30:29,  3.44it/s]
 95%|█████████▍| 352817/371472 [5:55:02<1:30:43,  3.43it/s]
 95%|█████████▍| 352818/371472 [5:55:03<1:30:23,  3.44it/s]
 95%|█████████▍| 352819/371472 [5:55:03<1:32:17,  3.37it/s]
 95%|█████████▍| 352820/371472 [5:55:03<1:29:25,  3.48it/s]
                                                           
{'loss': 2.5581, 'learning_rate': 1.452142903316167e-07, 'epoch': 15.2}

 95%|█████████▍| 352820/371472 [5:55:03<1:29:25,  3.48it/s]
 95%|█████████▍| 352821/371472 [5:55:03<1:26:41,  3.59it/s]
 95%|█████████▍| 352822/371472 [5:55:04<1:27:56,  3.53it/s]
 95%|█████████▍| 352823/371472 [5:55:04<1:25:09,  3.65it/s]
 95%|█████████▍| 352824/371472 [5:55:04<1:26:58,  3.57it/s]
 95%|█████████▍| 352825/371472 [5:55:05<1:28:09,  3.53it/s]
 95%|█████████▍| 352826/371472 [5:55:05<1:33:22,  3.33it/s]
 95%|█████████▍| 352827/371472 [5:55:05<1:29:42,  3.46it/s]
 95%|█████████▍| 352828/371472 [5:55:05<1:25:51,  3.62it/s]
 95%|█████████▍| 352829/371472 [5:55:06<1:28:49,  3.50it/s]
 95%|█████████▍| 352830/371472 [5:55:06<1:32:05,  3.37it/s]
 95%|█████████▍| 352831/371472 [5:55:06<1:31:08,  3.41it/s]
 95%|█████████▍| 352832/371472 [5:55:07<1:29:17,  3.48it/s]
 95%|█████████▍| 352833/371472 [5:55:07<1:25:00,  3.65it/s]
 95%|█████████▍| 352834/371472 [5:55:07<1:25:36,  3.63it/s]
 95%|█████████▍| 352835/371472 [5:55:07<1:22:08,  3.78it/s]
 95%|█████████▍| 352836/371472 [5:55:08<1:21:23,  3.82it/s]
 95%|█████████▍| 352837/371472 [5:55:08<1:22:50,  3.75it/s]
 95%|█████████▍| 352838/371472 [5:55:08<1:29:47,  3.46it/s]
 95%|█████████▍| 352839/371472 [5:55:08<1:28:23,  3.51it/s]
 95%|█████████▍| 352840/371472 [5:55:09<1:26:00,  3.61it/s]
                                                           
{'loss': 2.6565, 'learning_rate': 1.4516580835613784e-07, 'epoch': 15.2}

 95%|█████████▍| 352840/371472 [5:55:09<1:26:00,  3.61it/s]
 95%|█████████▍| 352841/371472 [5:55:09<1:31:37,  3.39it/s]
 95%|█████████▍| 352842/371472 [5:55:09<1:28:21,  3.51it/s]
 95%|█████████▍| 352843/371472 [5:55:10<1:27:06,  3.56it/s]
 95%|█████████▍| 352844/371472 [5:55:10<1:30:30,  3.43it/s]
 95%|█████████▍| 352845/371472 [5:55:10<1:41:10,  3.07it/s]
 95%|█████████▍| 352846/371472 [5:55:11<1:34:42,  3.28it/s]
 95%|█████████▍| 352847/371472 [5:55:11<1:32:32,  3.35it/s]
 95%|█████████▍| 352848/371472 [5:55:11<1:30:47,  3.42it/s]
 95%|█████████▍| 352849/371472 [5:55:11<1:30:54,  3.41it/s]
 95%|█████████▍| 352850/371472 [5:55:12<1:28:15,  3.52it/s]
 95%|█████████▍| 352851/371472 [5:55:12<1:28:20,  3.51it/s]
 95%|█████████▍| 352852/371472 [5:55:12<1:25:54,  3.61it/s]
 95%|█████████▍| 352853/371472 [5:55:13<1:28:38,  3.50it/s]
 95%|█████████▍| 352854/371472 [5:55:13<1:27:25,  3.55it/s]
 95%|█████████▍| 352855/371472 [5:55:13<1:27:07,  3.56it/s]
 95%|█████████▍| 352856/371472 [5:55:13<1:25:18,  3.64it/s]
 95%|█████████▍| 352857/371472 [5:55:14<1:29:26,  3.47it/s]
 95%|█████████▍| 352858/371472 [5:55:14<1:26:15,  3.60it/s]
 95%|█████████▍| 352859/371472 [5:55:14<1:28:57,  3.49it/s]
 95%|█████████▍| 352860/371472 [5:55:15<1:37:15,  3.19it/s]
                                                           
{'loss': 2.5179, 'learning_rate': 1.451173263806589e-07, 'epoch': 15.2}

 95%|█████████▍| 352860/371472 [5:55:15<1:37:15,  3.19it/s]
 95%|█████████▍| 352861/371472 [5:55:15<1:32:59,  3.34it/s]
 95%|█████████▍| 352862/371472 [5:55:15<1:31:01,  3.41it/s]
 95%|█████████▍| 352863/371472 [5:55:15<1:30:22,  3.43it/s]
 95%|█████████▍| 352864/371472 [5:55:16<1:29:08,  3.48it/s]
 95%|█████████▍| 352865/371472 [5:55:16<1:31:02,  3.41it/s]
 95%|█████████▍| 352866/371472 [5:55:16<1:32:13,  3.36it/s]
 95%|█████████▍| 352867/371472 [5:55:17<1:29:50,  3.45it/s]
 95%|█████████▍| 352868/371472 [5:55:17<1:35:47,  3.24it/s]
 95%|█████████▍| 352869/371472 [5:55:17<1:36:02,  3.23it/s]
 95%|█████████▍| 352870/371472 [5:55:18<1:35:20,  3.25it/s]
 95%|█████████▍| 352871/371472 [5:55:18<1:28:58,  3.48it/s]
 95%|█████████▍| 352872/371472 [5:55:18<1:27:02,  3.56it/s]
 95%|█████████▍| 352873/371472 [5:55:18<1:27:55,  3.53it/s]
 95%|█████████▍| 352874/371472 [5:55:19<1:25:00,  3.65it/s]
 95%|█████████▍| 352875/371472 [5:55:19<1:27:11,  3.56it/s]
 95%|█████████▍| 352876/371472 [5:55:19<1:28:33,  3.50it/s]
 95%|█████████▍| 352877/371472 [5:55:20<1:28:45,  3.49it/s]
 95%|█████████▍| 352878/371472 [5:55:20<1:28:48,  3.49it/s]
 95%|█████████▍| 352879/371472 [5:55:20<1:36:04,  3.23it/s]
 95%|█████████▍| 352880/371472 [5:55:20<1:36:15,  3.22it/s]
                                                           
{'loss': 2.4706, 'learning_rate': 1.4506884440518007e-07, 'epoch': 15.2}

 95%|█████████▍| 352880/371472 [5:55:20<1:36:15,  3.22it/s]
 95%|█████████▍| 352881/371472 [5:55:21<1:31:10,  3.40it/s]
 95%|█████████▍| 352882/371472 [5:55:21<1:34:36,  3.27it/s]
 95%|█████████▍| 352883/371472 [5:55:21<1:35:22,  3.25it/s]
 95%|█████████▍| 352884/371472 [5:55:22<1:38:20,  3.15it/s]
 95%|█████████▍| 352885/371472 [5:55:22<1:33:16,  3.32it/s]
 95%|█████████▍| 352886/371472 [5:55:22<1:31:51,  3.37it/s]
 95%|█████████▍| 352887/371472 [5:55:23<1:31:19,  3.39it/s]
 95%|█████████▍| 352888/371472 [5:55:23<1:28:33,  3.50it/s]
 95%|█████████▍| 352889/371472 [5:55:23<1:26:26,  3.58it/s]
 95%|█████████▍| 352890/371472 [5:55:23<1:29:44,  3.45it/s]
 95%|█████████▍| 352891/371472 [5:55:24<1:32:23,  3.35it/s]
 95%|█████████▍| 352892/371472 [5:55:24<1:37:16,  3.18it/s]
 95%|█████████▍| 352893/371472 [5:55:24<1:36:10,  3.22it/s]
 95%|█████████▍| 352894/371472 [5:55:25<1:33:11,  3.32it/s]
 95%|█████████▍| 352895/371472 [5:55:25<1:30:39,  3.42it/s]
 95%|█████████▍| 352896/371472 [5:55:25<1:27:20,  3.54it/s]
 95%|█████████▍| 352897/371472 [5:55:25<1:25:45,  3.61it/s]
 95%|█████████▍| 352898/371472 [5:55:26<1:27:47,  3.53it/s]
 95%|█████████▌| 352899/371472 [5:55:26<1:27:31,  3.54it/s]
 95%|█████████▌| 352900/371472 [5:55:26<1:29:45,  3.45it/s]
                                                           
{'loss': 2.6417, 'learning_rate': 1.450203624297011e-07, 'epoch': 15.2}

 95%|█████████▌| 352900/371472 [5:55:26<1:29:45,  3.45it/s]
 95%|█████████▌| 352901/371472 [5:55:27<1:36:23,  3.21it/s]
 95%|█████████▌| 352902/371472 [5:55:27<1:32:24,  3.35it/s]
 95%|█████████▌| 352903/371472 [5:55:27<1:30:49,  3.41it/s]
 95%|█████████▌| 352904/371472 [5:55:27<1:27:46,  3.53it/s]
 95%|█████████▌| 352905/371472 [5:55:28<1:27:44,  3.53it/s]
 95%|█████████▌| 352906/371472 [5:55:28<1:31:30,  3.38it/s]
 95%|█████████▌| 352907/371472 [5:55:28<1:26:17,  3.59it/s]
 95%|█████████▌| 352908/371472 [5:55:29<1:29:52,  3.44it/s]
 95%|█████████▌| 352909/371472 [5:55:29<1:26:19,  3.58it/s]
 95%|█████████▌| 352910/371472 [5:55:29<1:23:54,  3.69it/s]
 95%|█████████▌| 352911/371472 [5:55:29<1:25:34,  3.62it/s]
 95%|█████████▌| 352912/371472 [5:55:30<1:27:19,  3.54it/s]
 95%|█████████▌| 352913/371472 [5:55:30<1:24:46,  3.65it/s]
 95%|█████████▌| 352914/371472 [5:55:30<1:26:39,  3.57it/s]
 95%|█████████▌| 352915/371472 [5:55:31<1:26:48,  3.56it/s]
 95%|█████████▌| 352916/371472 [5:55:31<1:25:11,  3.63it/s]
 95%|█████████▌| 352917/371472 [5:55:31<1:26:58,  3.56it/s]
 95%|█████████▌| 352918/371472 [5:55:31<1:24:49,  3.65it/s]
 95%|█████████▌| 352919/371472 [5:55:32<1:24:23,  3.66it/s]
 95%|█████████▌| 352920/371472 [5:55:32<1:23:17,  3.71it/s]
                                                           
{'loss': 2.6903, 'learning_rate': 1.4497188045422226e-07, 'epoch': 15.2}

 95%|█████████▌| 352920/371472 [5:55:32<1:23:17,  3.71it/s]
 95%|█████████▌| 352921/371472 [5:55:32<1:24:38,  3.65it/s]
 95%|█████████▌| 352922/371472 [5:55:32<1:24:37,  3.65it/s]
 95%|█████████▌| 352923/371472 [5:55:33<1:24:01,  3.68it/s]
 95%|█████████▌| 352924/371472 [5:55:33<1:24:02,  3.68it/s]
 95%|█████████▌| 352925/371472 [5:55:33<1:21:24,  3.80it/s]
 95%|█████████▌| 352926/371472 [5:55:34<1:26:11,  3.59it/s]
 95%|█████████▌| 352927/371472 [5:55:34<1:27:56,  3.51it/s]
 95%|█████████▌| 352928/371472 [5:55:34<1:26:59,  3.55it/s]
 95%|█████████▌| 352929/371472 [5:55:34<1:23:59,  3.68it/s]
 95%|█████████▌| 352930/371472 [5:55:35<1:22:06,  3.76it/s]
 95%|█████████▌| 352931/371472 [5:55:35<1:21:49,  3.78it/s]
 95%|█████████▌| 352932/371472 [5:55:35<1:22:40,  3.74it/s]
 95%|█████████▌| 352933/371472 [5:55:35<1:19:45,  3.87it/s]
 95%|█████████▌| 352934/371472 [5:55:36<1:20:00,  3.86it/s]
 95%|█████████▌| 352935/371472 [5:55:36<1:22:27,  3.75it/s]
 95%|█████████▌| 352936/371472 [5:55:36<1:27:24,  3.53it/s]
 95%|█████████▌| 352937/371472 [5:55:37<1:26:30,  3.57it/s]
 95%|█████████▌| 352938/371472 [5:55:37<1:27:00,  3.55it/s]
 95%|█████████▌| 352939/371472 [5:55:37<1:24:11,  3.67it/s]
 95%|█████████▌| 352940/371472 [5:55:37<1:26:05,  3.59it/s]
                                                           
{'loss': 2.59, 'learning_rate': 1.4492339847874333e-07, 'epoch': 15.2}

 95%|█████████▌| 352940/371472 [5:55:37<1:26:05,  3.59it/s]
 95%|█████████▌| 352941/371472 [5:55:38<1:26:10,  3.58it/s]
 95%|█████████▌| 352942/371472 [5:55:38<1:25:56,  3.59it/s]
 95%|█████████▌| 352943/371472 [5:55:38<1:22:52,  3.73it/s]
 95%|█████████▌| 352944/371472 [5:55:38<1:23:51,  3.68it/s]
 95%|█████████▌| 352945/371472 [5:55:39<1:23:28,  3.70it/s]
 95%|█████████▌| 352946/371472 [5:55:39<1:25:53,  3.59it/s]
 95%|█████████▌| 352947/371472 [5:55:39<1:26:02,  3.59it/s]
 95%|█████████▌| 352948/371472 [5:55:40<1:30:02,  3.43it/s]
 95%|█████████▌| 352949/371472 [5:55:40<1:28:38,  3.48it/s]
 95%|█████████▌| 352950/371472 [5:55:40<1:26:18,  3.58it/s]
 95%|█████████▌| 352951/371472 [5:55:40<1:27:23,  3.53it/s]
 95%|█████████▌| 352952/371472 [5:55:41<1:34:45,  3.26it/s]
 95%|█████████▌| 352953/371472 [5:55:41<1:35:53,  3.22it/s]
 95%|█████████▌| 352954/371472 [5:55:41<1:31:48,  3.36it/s]
 95%|█████████▌| 352955/371472 [5:55:42<1:29:30,  3.45it/s]
 95%|█████████▌| 352956/371472 [5:55:42<1:28:08,  3.50it/s]
 95%|█████████▌| 352957/371472 [5:55:42<1:26:32,  3.57it/s]
 95%|█████████▌| 352958/371472 [5:55:43<1:25:34,  3.61it/s]
 95%|█████████▌| 352959/371472 [5:55:43<1:28:48,  3.47it/s]
 95%|█████████▌| 352960/371472 [5:55:43<1:24:59,  3.63it/s]
                                                           
{'loss': 2.6392, 'learning_rate': 1.4487491650326446e-07, 'epoch': 15.2}

 95%|█████████▌| 352960/371472 [5:55:43<1:24:59,  3.63it/s]
 95%|█████████▌| 352961/371472 [5:55:43<1:27:47,  3.51it/s]
 95%|█████████▌| 352962/371472 [5:55:44<1:27:39,  3.52it/s]
 95%|█████████▌| 352963/371472 [5:55:44<1:34:49,  3.25it/s]
 95%|█████████▌| 352964/371472 [5:55:44<1:32:15,  3.34it/s]
 95%|█████████▌| 352965/371472 [5:55:45<1:28:08,  3.50it/s]
 95%|█████████▌| 352966/371472 [5:55:45<1:31:06,  3.39it/s]
 95%|█████████▌| 352967/371472 [5:55:45<1:30:40,  3.40it/s]
 95%|█████████▌| 352968/371472 [5:55:45<1:30:00,  3.43it/s]
 95%|█████████▌| 352969/371472 [5:55:46<1:28:28,  3.49it/s]
 95%|█████████▌| 352970/371472 [5:55:46<1:31:47,  3.36it/s]
 95%|█████████▌| 352971/371472 [5:55:46<1:35:43,  3.22it/s]
 95%|█████████▌| 352972/371472 [5:55:47<1:31:56,  3.35it/s]
 95%|█████████▌| 352973/371472 [5:55:47<1:31:18,  3.38it/s]
 95%|█████████▌| 352974/371472 [5:55:47<1:30:13,  3.42it/s]
 95%|█████████▌| 352975/371472 [5:55:47<1:26:51,  3.55it/s]
 95%|█████████▌| 352976/371472 [5:55:48<1:24:19,  3.66it/s]
 95%|█████████▌| 352977/371472 [5:55:48<1:28:09,  3.50it/s]
 95%|█████████▌| 352978/371472 [5:55:48<1:31:45,  3.36it/s]
 95%|█████████▌| 352979/371472 [5:55:49<1:30:09,  3.42it/s]
 95%|█████████▌| 352980/371472 [5:55:49<1:28:13,  3.49it/s]
                                                           
{'loss': 2.5677, 'learning_rate': 1.4482643452778553e-07, 'epoch': 15.2}

 95%|█████████▌| 352980/371472 [5:55:49<1:28:13,  3.49it/s]
 95%|█████████▌| 352981/371472 [5:55:49<1:26:16,  3.57it/s]
 95%|█████████▌| 352982/371472 [5:55:49<1:22:22,  3.74it/s]
 95%|█████████▌| 352983/371472 [5:55:50<1:25:49,  3.59it/s]
 95%|█████████▌| 352984/371472 [5:55:50<1:28:34,  3.48it/s]
 95%|█████████▌| 352985/371472 [5:55:50<1:24:58,  3.63it/s]
 95%|█████████▌| 352986/371472 [5:55:51<1:24:25,  3.65it/s]
 95%|█████████▌| 352987/371472 [5:55:51<1:25:54,  3.59it/s]
 95%|█████████▌| 352988/371472 [5:55:51<1:26:22,  3.57it/s]
 95%|█████████▌| 352989/371472 [5:55:51<1:25:03,  3.62it/s]
 95%|█████████▌| 352990/371472 [5:55:52<1:30:10,  3.42it/s]
 95%|█████████▌| 352991/371472 [5:55:52<1:30:29,  3.40it/s]
 95%|█████████▌| 352992/371472 [5:55:52<1:28:35,  3.48it/s]
 95%|█████████▌| 352993/371472 [5:55:53<1:26:26,  3.56it/s]
 95%|█████████▌| 352994/371472 [5:55:53<1:27:40,  3.51it/s]
 95%|█████████▌| 352995/371472 [5:55:53<1:33:59,  3.28it/s]
 95%|█████████▌| 352996/371472 [5:55:54<1:31:52,  3.35it/s]
 95%|█████████▌| 352997/371472 [5:55:54<1:45:34,  2.92it/s]
 95%|█████████▌| 352998/371472 [5:55:54<1:38:18,  3.13it/s]
 95%|█████████▌| 352999/371472 [5:55:55<1:45:00,  2.93it/s]
 95%|█████████▌| 353000/371472 [5:55:55<1:42:04,  3.02it/s]
                                                           
{'loss': 2.5056, 'learning_rate': 1.447779525523067e-07, 'epoch': 15.2}

 95%|█████████▌| 353000/371472 [5:55:55<1:42:04,  3.02it/s]
 95%|█████████▌| 353001/371472 [5:55:55<1:37:49,  3.15it/s]
 95%|█████████▌| 353002/371472 [5:55:55<1:33:11,  3.30it/s]
 95%|█████████▌| 353003/371472 [5:55:56<1:29:34,  3.44it/s]
 95%|█████████▌| 353004/371472 [5:55:56<1:26:08,  3.57it/s]
 95%|█████████▌| 353005/371472 [5:55:56<1:30:06,  3.42it/s]
 95%|█████████▌| 353006/371472 [5:55:57<1:35:02,  3.24it/s]
 95%|█████████▌| 353007/371472 [5:55:57<1:31:35,  3.36it/s]
 95%|█████████▌| 353008/371472 [5:55:57<1:28:59,  3.46it/s]
 95%|█████████▌| 353009/371472 [5:55:57<1:25:04,  3.62it/s]
 95%|█████████▌| 353010/371472 [5:55:58<1:30:08,  3.41it/s]
 95%|█████████▌| 353011/371472 [5:55:58<1:30:15,  3.41it/s]
 95%|█████████▌| 353012/371472 [5:55:58<1:29:26,  3.44it/s]
 95%|█████████▌| 353013/371472 [5:55:59<1:28:34,  3.47it/s]
 95%|█████████▌| 353014/371472 [5:55:59<1:29:45,  3.43it/s]
 95%|█████████▌| 353015/371472 [5:55:59<1:26:58,  3.54it/s]
 95%|█████████▌| 353016/371472 [5:55:59<1:24:36,  3.64it/s]
 95%|█████████▌| 353017/371472 [5:56:00<1:30:41,  3.39it/s]
 95%|█████████▌| 353018/371472 [5:56:00<1:31:03,  3.38it/s]
 95%|█████████▌| 353019/371472 [5:56:00<1:30:39,  3.39it/s]
 95%|█████████▌| 353020/371472 [5:56:01<1:25:34,  3.59it/s]
                                                           
{'loss': 2.7021, 'learning_rate': 1.4472947057682775e-07, 'epoch': 15.21}

 95%|█████████▌| 353020/371472 [5:56:01<1:25:34,  3.59it/s]
 95%|█████████▌| 353021/371472 [5:56:01<1:26:11,  3.57it/s]
 95%|█████████▌| 353022/371472 [5:56:01<1:25:35,  3.59it/s]
 95%|█████████▌| 353023/371472 [5:56:01<1:25:00,  3.62it/s]
 95%|█████████▌| 353024/371472 [5:56:02<1:24:12,  3.65it/s]
 95%|█████████▌| 353025/371472 [5:56:02<1:27:50,  3.50it/s]
 95%|█████████▌| 353026/371472 [5:56:02<1:24:01,  3.66it/s]
 95%|█████████▌| 353027/371472 [5:56:03<1:27:27,  3.51it/s]
 95%|█████████▌| 353028/371472 [5:56:03<1:24:53,  3.62it/s]
 95%|█████████▌| 353029/371472 [5:56:03<1:27:51,  3.50it/s]
 95%|█████████▌| 353030/371472 [5:56:03<1:29:23,  3.44it/s]
 95%|█████████▌| 353031/371472 [5:56:04<1:27:55,  3.50it/s]
 95%|█████████▌| 353032/371472 [5:56:04<1:28:10,  3.49it/s]
 95%|█████████▌| 353033/371472 [5:56:04<1:26:00,  3.57it/s]
 95%|█████████▌| 353034/371472 [5:56:05<1:23:48,  3.67it/s]
 95%|█████████▌| 353035/371472 [5:56:05<1:22:30,  3.72it/s]
 95%|█████████▌| 353036/371472 [5:56:05<1:21:18,  3.78it/s]
 95%|█████████▌| 353037/371472 [5:56:05<1:20:23,  3.82it/s]
 95%|█████████▌| 353038/371472 [5:56:06<1:23:03,  3.70it/s]
 95%|█████████▌| 353039/371472 [5:56:06<1:25:18,  3.60it/s]
 95%|█████████▌| 353040/371472 [5:56:06<1:27:04,  3.53it/s]
                                                           
{'loss': 2.6101, 'learning_rate': 1.446809886013489e-07, 'epoch': 15.21}

 95%|█████████▌| 353040/371472 [5:56:06<1:27:04,  3.53it/s]
 95%|█████████▌| 353041/371472 [5:56:07<1:30:56,  3.38it/s]
 95%|█████████▌| 353042/371472 [5:56:07<1:29:35,  3.43it/s]
 95%|█████████▌| 353043/371472 [5:56:07<1:26:47,  3.54it/s]
 95%|█████████▌| 353044/371472 [5:56:07<1:26:39,  3.54it/s]
 95%|█████████▌| 353045/371472 [5:56:08<1:24:47,  3.62it/s]
 95%|█████████▌| 353046/371472 [5:56:08<1:23:48,  3.66it/s]
 95%|█████████▌| 353047/371472 [5:56:08<1:27:12,  3.52it/s]
 95%|█████████▌| 353048/371472 [5:56:08<1:27:11,  3.52it/s]
 95%|█████████▌| 353049/371472 [5:56:09<1:26:33,  3.55it/s]
 95%|█████████▌| 353050/371472 [5:56:09<1:30:38,  3.39it/s]
 95%|█████████▌| 353051/371472 [5:56:09<1:30:26,  3.39it/s]
 95%|█████████▌| 353052/371472 [5:56:10<1:28:34,  3.47it/s]
 95%|█████████▌| 353053/371472 [5:56:10<1:41:45,  3.02it/s]
 95%|█████████▌| 353054/371472 [5:56:10<1:34:40,  3.24it/s]
 95%|█████████▌| 353055/371472 [5:56:11<1:33:50,  3.27it/s]
 95%|█████████▌| 353056/371472 [5:56:11<1:38:23,  3.12it/s]
 95%|█████████▌| 353057/371472 [5:56:11<1:33:50,  3.27it/s]
 95%|█████████▌| 353058/371472 [5:56:12<1:29:45,  3.42it/s]
 95%|█████████▌| 353059/371472 [5:56:12<1:27:32,  3.51it/s]
 95%|█████████▌| 353060/371472 [5:56:12<1:26:21,  3.55it/s]
                                                           
{'loss': 2.4156, 'learning_rate': 1.4463250662586997e-07, 'epoch': 15.21}

 95%|█████████▌| 353060/371472 [5:56:12<1:26:21,  3.55it/s]
 95%|█████████▌| 353061/371472 [5:56:12<1:22:41,  3.71it/s]
 95%|█████████▌| 353062/371472 [5:56:13<1:24:06,  3.65it/s]
 95%|█████████▌| 353063/371472 [5:56:13<1:27:24,  3.51it/s]
 95%|█████████▌| 353064/371472 [5:56:13<1:27:00,  3.53it/s]
 95%|█████████▌| 353065/371472 [5:56:13<1:25:14,  3.60it/s]
 95%|█████████▌| 353066/371472 [5:56:14<1:28:52,  3.45it/s]
 95%|█████████▌| 353067/371472 [5:56:14<1:27:07,  3.52it/s]
 95%|█████████▌| 353068/371472 [5:56:14<1:26:26,  3.55it/s]
 95%|█████████▌| 353069/371472 [5:56:15<1:31:53,  3.34it/s]
 95%|█████████▌| 353070/371472 [5:56:15<1:36:05,  3.19it/s]
 95%|█████████▌| 353071/371472 [5:56:15<1:30:05,  3.40it/s]
 95%|█████████▌| 353072/371472 [5:56:15<1:24:38,  3.62it/s]
 95%|█████████▌| 353073/371472 [5:56:16<1:25:46,  3.58it/s]
 95%|█████████▌| 353074/371472 [5:56:16<1:37:16,  3.15it/s]
 95%|█████████▌| 353075/371472 [5:56:16<1:29:35,  3.42it/s]
 95%|█████████▌| 353076/371472 [5:56:17<1:26:19,  3.55it/s]
 95%|█████████▌| 353077/371472 [5:56:17<1:24:35,  3.62it/s]
 95%|█████████▌| 353078/371472 [5:56:17<1:27:48,  3.49it/s]
 95%|█████████▌| 353079/371472 [5:56:17<1:24:50,  3.61it/s]
 95%|█████████▌| 353080/371472 [5:56:18<1:21:59,  3.74it/s]
                                                           
{'loss': 2.5549, 'learning_rate': 1.4458402465039105e-07, 'epoch': 15.21}

 95%|█████████▌| 353080/371472 [5:56:18<1:21:59,  3.74it/s]
 95%|█████████▌| 353081/371472 [5:56:18<1:22:11,  3.73it/s]
 95%|█████████▌| 353082/371472 [5:56:18<1:27:57,  3.48it/s]
 95%|█████████▌| 353083/371472 [5:56:19<1:26:52,  3.53it/s]
 95%|█████████▌| 353084/371472 [5:56:19<1:24:54,  3.61it/s]
 95%|█████████▌| 353085/371472 [5:56:19<1:27:19,  3.51it/s]
 95%|█████████▌| 353086/371472 [5:56:19<1:26:26,  3.55it/s]
 95%|█████████▌| 353087/371472 [5:56:20<1:28:10,  3.48it/s]
 95%|█████████▌| 353088/371472 [5:56:20<1:27:23,  3.51it/s]
 95%|█████████▌| 353089/371472 [5:56:20<1:24:40,  3.62it/s]
 95%|█████████▌| 353090/371472 [5:56:21<1:21:59,  3.74it/s]
 95%|█████████▌| 353091/371472 [5:56:21<1:20:37,  3.80it/s]
 95%|█████████▌| 353092/371472 [5:56:21<1:19:21,  3.86it/s]
 95%|█████████▌| 353093/371472 [5:56:21<1:26:47,  3.53it/s]
 95%|█████████▌| 353094/371472 [5:56:22<1:28:18,  3.47it/s]
 95%|█████████▌| 353095/371472 [5:56:22<1:29:28,  3.42it/s]
 95%|█████████▌| 353096/371472 [5:56:22<1:30:08,  3.40it/s]
 95%|█████████▌| 353097/371472 [5:56:23<1:28:03,  3.48it/s]
 95%|█████████▌| 353098/371472 [5:56:23<1:25:34,  3.58it/s]
 95%|█████████▌| 353099/371472 [5:56:23<1:25:02,  3.60it/s]
 95%|█████████▌| 353100/371472 [5:56:23<1:25:47,  3.57it/s]
                                                           
{'loss': 2.574, 'learning_rate': 1.445355426749122e-07, 'epoch': 15.21}

 95%|█████████▌| 353100/371472 [5:56:23<1:25:47,  3.57it/s]
 95%|█████████▌| 353101/371472 [5:56:24<1:26:21,  3.55it/s]
 95%|█████████▌| 353102/371472 [5:56:24<1:33:47,  3.26it/s]
 95%|█████████▌| 353103/371472 [5:56:24<1:30:59,  3.36it/s]
 95%|█████████▌| 353104/371472 [5:56:25<1:28:19,  3.47it/s]
 95%|█████████▌| 353105/371472 [5:56:25<1:32:40,  3.30it/s]
 95%|█████████▌| 353106/371472 [5:56:25<1:29:52,  3.41it/s]
 95%|█████████▌| 353107/371472 [5:56:25<1:27:58,  3.48it/s]
 95%|█████████▌| 353108/371472 [5:56:26<1:26:37,  3.53it/s]
 95%|█████████▌| 353109/371472 [5:56:26<1:27:56,  3.48it/s]
 95%|█████████▌| 353110/371472 [5:56:26<1:29:53,  3.40it/s]
 95%|█████████▌| 353111/371472 [5:56:27<1:29:32,  3.42it/s]
 95%|█████████▌| 353112/371472 [5:56:27<1:31:49,  3.33it/s]
 95%|█████████▌| 353113/371472 [5:56:27<1:33:06,  3.29it/s]
 95%|█████████▌| 353114/371472 [5:56:28<1:31:29,  3.34it/s]
 95%|█████████▌| 353115/371472 [5:56:28<1:34:04,  3.25it/s]
 95%|█████████▌| 353116/371472 [5:56:28<1:31:50,  3.33it/s]
 95%|█████████▌| 353117/371472 [5:56:28<1:27:29,  3.50it/s]
 95%|█████████▌| 353118/371472 [5:56:29<1:26:51,  3.52it/s]
 95%|█████████▌| 353119/371472 [5:56:29<1:23:36,  3.66it/s]
 95%|█████████▌| 353120/371472 [5:56:29<1:21:57,  3.73it/s]
                                                           
{'loss': 2.5385, 'learning_rate': 1.4448706069943324e-07, 'epoch': 15.21}

 95%|█████████▌| 353120/371472 [5:56:29<1:21:57,  3.73it/s]
 95%|█████████▌| 353121/371472 [5:56:29<1:21:05,  3.77it/s]
 95%|█████████▌| 353122/371472 [5:56:30<1:24:09,  3.63it/s]
 95%|█████████▌| 353123/371472 [5:56:30<1:27:17,  3.50it/s]
 95%|█████████▌| 353124/371472 [5:56:30<1:24:05,  3.64it/s]
 95%|█████████▌| 353125/371472 [5:56:31<1:21:57,  3.73it/s]
 95%|█████████▌| 353126/371472 [5:56:31<1:22:24,  3.71it/s]
 95%|█████████▌| 353127/371472 [5:56:31<1:24:23,  3.62it/s]
 95%|█████████▌| 353128/371472 [5:56:31<1:26:28,  3.54it/s]
 95%|█████████▌| 353129/371472 [5:56:32<1:28:27,  3.46it/s]
 95%|█████████▌| 353130/371472 [5:56:32<1:27:48,  3.48it/s]
 95%|█████████▌| 353131/371472 [5:56:32<1:25:07,  3.59it/s]
 95%|█████████▌| 353132/371472 [5:56:33<1:22:58,  3.68it/s]
 95%|█████████▌| 353133/371472 [5:56:33<1:21:15,  3.76it/s]
 95%|█████████▌| 353134/371472 [5:56:33<1:21:36,  3.75it/s]
 95%|█████████▌| 353135/371472 [5:56:33<1:24:24,  3.62it/s]
 95%|█████████▌| 353136/371472 [5:56:34<1:24:18,  3.62it/s]
 95%|█████████▌| 353137/371472 [5:56:34<1:22:22,  3.71it/s]
 95%|█████████▌| 353138/371472 [5:56:34<1:21:23,  3.75it/s]
 95%|█████████▌| 353139/371472 [5:56:34<1:28:19,  3.46it/s]
 95%|█████████▌| 353140/371472 [5:56:35<1:25:54,  3.56it/s]
                                                           
{'loss': 2.5167, 'learning_rate': 1.4443857872395442e-07, 'epoch': 15.21}

 95%|█████████▌| 353140/371472 [5:56:35<1:25:54,  3.56it/s]
 95%|█████████▌| 353141/371472 [5:56:35<1:28:02,  3.47it/s]
 95%|█████████▌| 353142/371472 [5:56:35<1:23:55,  3.64it/s]
 95%|█████████▌| 353143/371472 [5:56:36<1:23:12,  3.67it/s]
 95%|█████████▌| 353144/371472 [5:56:36<1:23:18,  3.67it/s]
 95%|█████████▌| 353145/371472 [5:56:36<1:26:51,  3.52it/s]
 95%|█████████▌| 353146/371472 [5:56:36<1:33:48,  3.26it/s]
 95%|█████████▌| 353147/371472 [5:56:37<1:31:15,  3.35it/s]
 95%|█████████▌| 353148/371472 [5:56:37<1:30:54,  3.36it/s]
 95%|█████████▌| 353149/371472 [5:56:37<1:29:44,  3.40it/s]
 95%|█████████▌| 353150/371472 [5:56:38<1:29:20,  3.42it/s]
 95%|█████████▌| 353151/371472 [5:56:38<1:36:36,  3.16it/s]
 95%|█████████▌| 353152/371472 [5:56:38<1:35:10,  3.21it/s]
 95%|█████████▌| 353153/371472 [5:56:39<1:33:39,  3.26it/s]
 95%|█████████▌| 353154/371472 [5:56:39<1:30:05,  3.39it/s]
 95%|█████████▌| 353155/371472 [5:56:39<1:34:13,  3.24it/s]
 95%|█████████▌| 353156/371472 [5:56:39<1:33:18,  3.27it/s]
 95%|█████████▌| 353157/371472 [5:56:40<1:30:04,  3.39it/s]
 95%|█████████▌| 353158/371472 [5:56:40<1:29:23,  3.41it/s]
 95%|█████████▌| 353159/371472 [5:56:40<1:31:50,  3.32it/s]
 95%|█████████▌| 353160/371472 [5:56:41<1:41:35,  3.00it/s]
                                                           
{'loss': 2.5262, 'learning_rate': 1.4439009674847546e-07, 'epoch': 15.21}

 95%|█████████▌| 353160/371472 [5:56:41<1:41:35,  3.00it/s]
 95%|█████████▌| 353161/371472 [5:56:41<1:37:47,  3.12it/s]
 95%|█████████▌| 353162/371472 [5:56:41<1:36:57,  3.15it/s]
 95%|█████████▌| 353163/371472 [5:56:42<1:32:02,  3.32it/s]
 95%|█████████▌| 353164/371472 [5:56:42<1:32:42,  3.29it/s]
 95%|█████████▌| 353165/371472 [5:56:42<1:32:29,  3.30it/s]
 95%|█████████▌| 353166/371472 [5:56:43<1:27:45,  3.48it/s]
 95%|█████████▌| 353167/371472 [5:56:43<1:32:49,  3.29it/s]
 95%|█████████▌| 353168/371472 [5:56:43<1:37:54,  3.12it/s]
 95%|█████████▌| 353169/371472 [5:56:43<1:32:33,  3.30it/s]
 95%|█████████▌| 353170/371472 [5:56:44<1:28:22,  3.45it/s]
 95%|█████████▌| 353171/371472 [5:56:44<1:25:21,  3.57it/s]
 95%|█████████▌| 353172/371472 [5:56:44<1:23:19,  3.66it/s]
 95%|█████████▌| 353173/371472 [5:56:44<1:20:51,  3.77it/s]
 95%|█████████▌| 353174/371472 [5:56:45<1:31:31,  3.33it/s]
 95%|█████████▌| 353175/371472 [5:56:45<1:27:19,  3.49it/s]
 95%|█████████▌| 353176/371472 [5:56:45<1:25:09,  3.58it/s]
 95%|█████████▌| 353177/371472 [5:56:46<1:25:11,  3.58it/s]
 95%|█████████▌| 353178/371472 [5:56:46<1:26:00,  3.54it/s]
 95%|█████████▌| 353179/371472 [5:56:46<1:29:51,  3.39it/s]
 95%|█████████▌| 353180/371472 [5:56:47<1:35:49,  3.18it/s]
                                                           
{'loss': 2.5118, 'learning_rate': 1.4434161477299662e-07, 'epoch': 15.21}

 95%|█████████▌| 353180/371472 [5:56:47<1:35:49,  3.18it/s]
 95%|█████████▌| 353181/371472 [5:56:47<1:30:05,  3.38it/s]
 95%|█████████▌| 353182/371472 [5:56:47<1:29:22,  3.41it/s]
 95%|█████████▌| 353183/371472 [5:56:47<1:29:24,  3.41it/s]
 95%|█████████▌| 353184/371472 [5:56:48<1:27:03,  3.50it/s]
 95%|█████████▌| 353185/371472 [5:56:48<1:24:55,  3.59it/s]
 95%|█████████▌| 353186/371472 [5:56:48<1:26:50,  3.51it/s]
 95%|█████████▌| 353187/371472 [5:56:49<1:31:10,  3.34it/s]
 95%|█████████▌| 353188/371472 [5:56:49<1:27:11,  3.50it/s]
 95%|█████████▌| 353189/371472 [5:56:49<1:27:59,  3.46it/s]
 95%|█████████▌| 353190/371472 [5:56:50<1:33:14,  3.27it/s]
 95%|█████████▌| 353191/371472 [5:56:50<1:28:18,  3.45it/s]
 95%|█████████▌| 353192/371472 [5:56:50<1:24:54,  3.59it/s]
 95%|█████████▌| 353193/371472 [5:56:50<1:22:21,  3.70it/s]
 95%|█████████▌| 353194/371472 [5:56:51<1:21:17,  3.75it/s]
 95%|█████████▌| 353195/371472 [5:56:51<1:23:20,  3.66it/s]
 95%|█████████▌| 353196/371472 [5:56:51<1:25:03,  3.58it/s]
 95%|█████████▌| 353197/371472 [5:56:51<1:22:21,  3.70it/s]
 95%|█████████▌| 353198/371472 [5:56:52<1:23:08,  3.66it/s]
 95%|█████████▌| 353199/371472 [5:56:52<1:25:03,  3.58it/s]
 95%|█████████▌| 353200/371472 [5:56:52<1:24:30,  3.60it/s]
                                                           
{'loss': 2.5959, 'learning_rate': 1.442931327975177e-07, 'epoch': 15.21}

 95%|█████████▌| 353200/371472 [5:56:52<1:24:30,  3.60it/s]
 95%|█████████▌| 353201/371472 [5:56:52<1:23:14,  3.66it/s]
 95%|█████████▌| 353202/371472 [5:56:53<1:26:04,  3.54it/s]
 95%|█████████▌| 353203/371472 [5:56:53<1:24:47,  3.59it/s]
 95%|█████████▌| 353204/371472 [5:56:53<1:24:23,  3.61it/s]
 95%|█████████▌| 353205/371472 [5:56:54<1:27:36,  3.48it/s]
 95%|█████████▌| 353206/371472 [5:56:54<1:25:34,  3.56it/s]
 95%|█████████▌| 353207/371472 [5:56:54<1:25:15,  3.57it/s]
 95%|█████████▌| 353208/371472 [5:56:54<1:25:21,  3.57it/s]
 95%|█████████▌| 353209/371472 [5:56:55<1:24:15,  3.61it/s]
 95%|█████████▌| 353210/371472 [5:56:55<1:28:16,  3.45it/s]
 95%|█████████▌| 353211/371472 [5:56:55<1:30:18,  3.37it/s]
 95%|█████████▌| 353212/371472 [5:56:56<1:37:28,  3.12it/s]
 95%|█████████▌| 353213/371472 [5:56:56<1:35:58,  3.17it/s]
 95%|█████████▌| 353214/371472 [5:56:56<1:36:46,  3.14it/s]
 95%|█████████▌| 353215/371472 [5:56:57<1:34:54,  3.21it/s]
 95%|█████████▌| 353216/371472 [5:56:57<1:33:04,  3.27it/s]
 95%|█████████▌| 353217/371472 [5:56:57<1:32:36,  3.29it/s]
 95%|█████████▌| 353218/371472 [5:56:58<1:30:46,  3.35it/s]
 95%|█████████▌| 353219/371472 [5:56:58<1:30:09,  3.37it/s]
 95%|█████████▌| 353220/371472 [5:56:58<1:28:27,  3.44it/s]
                                                           
{'loss': 2.577, 'learning_rate': 1.4424465082203884e-07, 'epoch': 15.21}

 95%|█████████▌| 353220/371472 [5:56:58<1:28:27,  3.44it/s]
 95%|█████████▌| 353221/371472 [5:56:58<1:26:20,  3.52it/s]
 95%|█████████▌| 353222/371472 [5:56:59<1:29:21,  3.40it/s]
 95%|█████████▌| 353223/371472 [5:56:59<1:27:42,  3.47it/s]
 95%|█████████▌| 353224/371472 [5:56:59<1:32:39,  3.28it/s]
 95%|█████████▌| 353225/371472 [5:57:00<1:29:23,  3.40it/s]
 95%|█████████▌| 353226/371472 [5:57:00<1:27:11,  3.49it/s]
 95%|█████████▌| 353227/371472 [5:57:00<1:25:47,  3.54it/s]
 95%|█████████▌| 353228/371472 [5:57:00<1:23:15,  3.65it/s]
 95%|█████████▌| 353229/371472 [5:57:01<1:21:00,  3.75it/s]
 95%|█████████▌| 353230/371472 [5:57:01<1:22:02,  3.71it/s]
 95%|█████████▌| 353231/371472 [5:57:01<1:25:22,  3.56it/s]
 95%|█████████▌| 353232/371472 [5:57:01<1:21:18,  3.74it/s]
 95%|█████████▌| 353233/371472 [5:57:02<1:19:26,  3.83it/s]
 95%|█████████▌| 353234/371472 [5:57:02<1:21:49,  3.71it/s]
 95%|█████████▌| 353235/371472 [5:57:02<1:24:50,  3.58it/s]
 95%|█████████▌| 353236/371472 [5:57:03<1:25:25,  3.56it/s]
 95%|█████████▌| 353237/371472 [5:57:03<1:25:20,  3.56it/s]
 95%|█████████▌| 353238/371472 [5:57:03<1:22:17,  3.69it/s]
 95%|█████████▌| 353239/371472 [5:57:03<1:24:55,  3.58it/s]
 95%|█████████▌| 353240/371472 [5:57:04<1:20:41,  3.77it/s]
                                                           
{'loss': 2.7245, 'learning_rate': 1.4419616884655988e-07, 'epoch': 15.21}

 95%|█████████▌| 353240/371472 [5:57:04<1:20:41,  3.77it/s]
 95%|█████████▌| 353241/371472 [5:57:04<1:20:17,  3.78it/s]
 95%|█████████▌| 353242/371472 [5:57:04<1:32:08,  3.30it/s]
 95%|█████████▌| 353243/371472 [5:57:05<1:33:14,  3.26it/s]
 95%|█████████▌| 353244/371472 [5:57:05<1:28:35,  3.43it/s]
 95%|█████████▌| 353245/371472 [5:57:05<1:29:29,  3.39it/s]
 95%|█████████▌| 353246/371472 [5:57:05<1:26:42,  3.50it/s]
 95%|█████████▌| 353247/371472 [5:57:06<1:26:01,  3.53it/s]
 95%|█████████▌| 353248/371472 [5:57:06<1:29:48,  3.38it/s]
 95%|█████████▌| 353249/371472 [5:57:06<1:27:59,  3.45it/s]
 95%|█████████▌| 353250/371472 [5:57:07<1:23:26,  3.64it/s]
 95%|█████████▌| 353251/371472 [5:57:07<1:23:24,  3.64it/s]
 95%|█████████▌| 353252/371472 [5:57:07<1:27:47,  3.46it/s]
 95%|█████████▌| 353253/371472 [5:57:07<1:30:23,  3.36it/s]
 95%|█████████▌| 353254/371472 [5:57:08<1:30:08,  3.37it/s]
 95%|█████████▌| 353255/371472 [5:57:08<1:24:53,  3.58it/s]
 95%|█████████▌| 353256/371472 [5:57:08<1:23:37,  3.63it/s]
 95%|█████████▌| 353257/371472 [5:57:09<1:22:13,  3.69it/s]
 95%|█████████▌| 353258/371472 [5:57:09<1:24:41,  3.58it/s]
 95%|█████████▌| 353259/371472 [5:57:09<1:24:16,  3.60it/s]
 95%|█████████▌| 353260/371472 [5:57:09<1:25:24,  3.55it/s]
                                                           
{'loss': 2.587, 'learning_rate': 1.4414768687108106e-07, 'epoch': 15.22}

 95%|█████████▌| 353260/371472 [5:57:09<1:25:24,  3.55it/s]
 95%|█████████▌| 353261/371472 [5:57:10<1:21:57,  3.70it/s]
 95%|█████████▌| 353262/371472 [5:57:10<1:24:48,  3.58it/s]
 95%|█████████▌| 353263/371472 [5:57:10<1:27:01,  3.49it/s]
 95%|█████████▌| 353264/371472 [5:57:11<1:29:10,  3.40it/s]
 95%|█████████▌| 353265/371472 [5:57:11<1:27:25,  3.47it/s]
 95%|█████████▌| 353266/371472 [5:57:11<1:28:23,  3.43it/s]
 95%|█████████▌| 353267/371472 [5:57:11<1:28:54,  3.41it/s]
 95%|█████████▌| 353268/371472 [5:57:12<1:26:49,  3.49it/s]
 95%|█████████▌| 353269/371472 [5:57:12<1:22:47,  3.66it/s]
 95%|█████████▌| 353270/371472 [5:57:12<1:24:17,  3.60it/s]
 95%|█████████▌| 353271/371472 [5:57:13<1:27:46,  3.46it/s]
 95%|█████████▌| 353272/371472 [5:57:13<1:29:15,  3.40it/s]
 95%|█████████▌| 353273/371472 [5:57:13<1:29:58,  3.37it/s]
 95%|█████████▌| 353274/371472 [5:57:13<1:27:16,  3.48it/s]
 95%|█████████▌| 353275/371472 [5:57:14<1:27:31,  3.47it/s]
 95%|█████████▌| 353276/371472 [5:57:14<1:25:03,  3.57it/s]
 95%|█████████▌| 353277/371472 [5:57:14<1:29:12,  3.40it/s]
 95%|█████████▌| 353278/371472 [5:57:15<1:26:04,  3.52it/s]
 95%|█████████▌| 353279/371472 [5:57:15<1:37:53,  3.10it/s]
 95%|█████████▌| 353280/371472 [5:57:15<1:33:44,  3.23it/s]
                                                           
{'loss': 2.6049, 'learning_rate': 1.440992048956021e-07, 'epoch': 15.22}

 95%|█████████▌| 353280/371472 [5:57:15<1:33:44,  3.23it/s]
 95%|█████████▌| 353281/371472 [5:57:16<1:29:28,  3.39it/s]
 95%|█████████▌| 353282/371472 [5:57:16<1:27:33,  3.46it/s]
 95%|█████████▌| 353283/371472 [5:57:16<1:27:23,  3.47it/s]
 95%|█████████▌| 353284/371472 [5:57:16<1:24:56,  3.57it/s]
 95%|█████████▌| 353285/371472 [5:57:17<1:25:28,  3.55it/s]
 95%|█████████▌| 353286/371472 [5:57:17<1:24:41,  3.58it/s]
 95%|█████████▌| 353287/371472 [5:57:17<1:23:18,  3.64it/s]
 95%|█████████▌| 353288/371472 [5:57:17<1:26:48,  3.49it/s]
 95%|█████████▌| 353289/371472 [5:57:18<1:25:49,  3.53it/s]
 95%|█████████▌| 353290/371472 [5:57:18<1:28:28,  3.43it/s]
 95%|█████████▌| 353291/371472 [5:57:18<1:27:20,  3.47it/s]
 95%|█████████▌| 353292/371472 [5:57:19<1:34:27,  3.21it/s]
 95%|█████████▌| 353293/371472 [5:57:19<1:29:47,  3.37it/s]
 95%|█████████▌| 353294/371472 [5:57:19<1:30:59,  3.33it/s]
 95%|█████████▌| 353295/371472 [5:57:20<1:27:41,  3.45it/s]
 95%|█████████▌| 353296/371472 [5:57:20<1:24:52,  3.57it/s]
 95%|█████████▌| 353297/371472 [5:57:20<1:23:11,  3.64it/s]
 95%|█████████▌| 353298/371472 [5:57:20<1:22:56,  3.65it/s]
 95%|█████████▌| 353299/371472 [5:57:21<1:22:48,  3.66it/s]
 95%|█████████▌| 353300/371472 [5:57:21<1:22:55,  3.65it/s]
                                                           
{'loss': 2.6307, 'learning_rate': 1.4405072292012326e-07, 'epoch': 15.22}

 95%|█████████▌| 353300/371472 [5:57:21<1:22:55,  3.65it/s]
 95%|█████████▌| 353301/371472 [5:57:21<1:24:48,  3.57it/s]
 95%|█████████▌| 353302/371472 [5:57:21<1:22:50,  3.66it/s]
 95%|█████████▌| 353303/371472 [5:57:22<1:24:08,  3.60it/s]
 95%|█████████▌| 353304/371472 [5:57:22<1:23:39,  3.62it/s]
 95%|█████████▌| 353305/371472 [5:57:22<1:22:20,  3.68it/s]
 95%|█████████▌| 353306/371472 [5:57:23<1:20:39,  3.75it/s]
 95%|█████████▌| 353307/371472 [5:57:23<1:22:38,  3.66it/s]
 95%|█████████▌| 353308/371472 [5:57:23<1:21:00,  3.74it/s]
 95%|█████████▌| 353309/371472 [5:57:23<1:21:47,  3.70it/s]
 95%|█████████▌| 353310/371472 [5:57:24<1:25:19,  3.55it/s]
 95%|█████████▌| 353311/371472 [5:57:24<1:21:20,  3.72it/s]
 95%|█████████▌| 353312/371472 [5:57:24<1:27:55,  3.44it/s]
 95%|█████████▌| 353313/371472 [5:57:25<1:31:01,  3.32it/s]
 95%|█████████▌| 353314/371472 [5:57:25<1:26:41,  3.49it/s]
 95%|█████████▌| 353315/371472 [5:57:25<1:26:00,  3.52it/s]
 95%|█████████▌| 353316/371472 [5:57:25<1:23:49,  3.61it/s]
 95%|█████████▌| 353317/371472 [5:57:26<1:22:42,  3.66it/s]
 95%|█████████▌| 353318/371472 [5:57:26<1:22:08,  3.68it/s]
 95%|█████████▌| 353319/371472 [5:57:26<1:22:27,  3.67it/s]
 95%|█████████▌| 353320/371472 [5:57:26<1:21:51,  3.70it/s]
                                                           
{'loss': 2.5835, 'learning_rate': 1.4400224094464433e-07, 'epoch': 15.22}

 95%|█████████▌| 353320/371472 [5:57:26<1:21:51,  3.70it/s]
 95%|█████████▌| 353321/371472 [5:57:27<1:20:43,  3.75it/s]
 95%|█████████▌| 353322/371472 [5:57:27<1:24:59,  3.56it/s]
 95%|█████████▌| 353323/371472 [5:57:27<1:23:40,  3.62it/s]
 95%|█████████▌| 353324/371472 [5:57:28<1:24:23,  3.58it/s]
 95%|█████████▌| 353325/371472 [5:57:28<1:21:14,  3.72it/s]
 95%|█████████▌| 353326/371472 [5:57:28<1:26:22,  3.50it/s]
 95%|█████████▌| 353327/371472 [5:57:28<1:25:22,  3.54it/s]
 95%|█████████▌| 353328/371472 [5:57:29<1:21:34,  3.71it/s]
 95%|█████████▌| 353329/371472 [5:57:29<1:20:37,  3.75it/s]
 95%|█████████▌| 353330/371472 [5:57:29<1:19:16,  3.81it/s]
 95%|█████████▌| 353331/371472 [5:57:29<1:21:24,  3.71it/s]
 95%|█████████▌| 353332/371472 [5:57:30<1:23:59,  3.60it/s]
 95%|█████████▌| 353333/371472 [5:57:30<1:21:34,  3.71it/s]
 95%|█████████▌| 353334/371472 [5:57:30<1:20:40,  3.75it/s]
 95%|█████████▌| 353335/371472 [5:57:30<1:19:07,  3.82it/s]
 95%|█████████▌| 353336/371472 [5:57:31<1:17:40,  3.89it/s]
 95%|█████████▌| 353337/371472 [5:57:31<1:19:35,  3.80it/s]
 95%|█████████▌| 353338/371472 [5:57:31<1:21:22,  3.71it/s]
 95%|█████████▌| 353339/371472 [5:57:32<1:22:20,  3.67it/s]
 95%|█████████▌| 353340/371472 [5:57:32<1:21:10,  3.72it/s]
                                                           
{'loss': 2.6179, 'learning_rate': 1.4395375896916548e-07, 'epoch': 15.22}

 95%|█████████▌| 353340/371472 [5:57:32<1:21:10,  3.72it/s]
 95%|█████████▌| 353341/371472 [5:57:32<1:23:49,  3.60it/s]
 95%|█████████▌| 353342/371472 [5:57:32<1:23:55,  3.60it/s]
 95%|█████████▌| 353343/371472 [5:57:33<1:23:12,  3.63it/s]
 95%|█████████▌| 353344/371472 [5:57:33<1:21:32,  3.71it/s]
 95%|█████████▌| 353345/371472 [5:57:33<1:30:45,  3.33it/s]
 95%|█████████▌| 353346/371472 [5:57:34<1:25:33,  3.53it/s]
 95%|█████████▌| 353347/371472 [5:57:34<1:23:01,  3.64it/s]
 95%|█████████▌| 353348/371472 [5:57:34<1:22:59,  3.64it/s]
 95%|█████████▌| 353349/371472 [5:57:34<1:23:25,  3.62it/s]
 95%|█████████▌| 353350/371472 [5:57:35<1:20:29,  3.75it/s]
 95%|█████████▌| 353351/371472 [5:57:35<1:20:00,  3.77it/s]
 95%|█████████▌| 353352/371472 [5:57:35<1:19:29,  3.80it/s]
 95%|█████████▌| 353353/371472 [5:57:35<1:23:21,  3.62it/s]
 95%|█████████▌| 353354/371472 [5:57:36<1:23:12,  3.63it/s]
 95%|█████████▌| 353355/371472 [5:57:36<1:23:39,  3.61it/s]
 95%|█████████▌| 353356/371472 [5:57:36<1:26:55,  3.47it/s]
 95%|█████████▌| 353357/371472 [5:57:37<1:24:39,  3.57it/s]
 95%|█████████▌| 353358/371472 [5:57:37<1:30:39,  3.33it/s]
 95%|█████████▌| 353359/371472 [5:57:37<1:28:55,  3.39it/s]
 95%|█████████▌| 353360/371472 [5:57:37<1:30:37,  3.33it/s]
                                                           
{'loss': 2.5218, 'learning_rate': 1.4390527699368655e-07, 'epoch': 15.22}

 95%|█████████▌| 353360/371472 [5:57:37<1:30:37,  3.33it/s]
 95%|█████████▌| 353361/371472 [5:57:38<1:26:35,  3.49it/s]
 95%|█████████▌| 353362/371472 [5:57:38<1:25:44,  3.52it/s]
 95%|█████████▌| 353363/371472 [5:57:38<1:24:25,  3.58it/s]
 95%|█████████▌| 353364/371472 [5:57:39<1:24:59,  3.55it/s]
 95%|█████████▌| 353365/371472 [5:57:39<1:23:30,  3.61it/s]
 95%|█████████▌| 353366/371472 [5:57:39<1:24:01,  3.59it/s]
 95%|█████████▌| 353367/371472 [5:57:39<1:20:53,  3.73it/s]
 95%|█████████▌| 353368/371472 [5:57:40<1:24:24,  3.57it/s]
 95%|█████████▌| 353369/371472 [5:57:40<1:21:47,  3.69it/s]
 95%|█████████▌| 353370/371472 [5:57:40<1:21:31,  3.70it/s]
 95%|█████████▌| 353371/371472 [5:57:40<1:20:46,  3.73it/s]
 95%|█████████▌| 353372/371472 [5:57:41<1:18:20,  3.85it/s]
 95%|█████████▌| 353373/371472 [5:57:41<1:20:34,  3.74it/s]
 95%|█████████▌| 353374/371472 [5:57:41<1:27:44,  3.44it/s]
 95%|█████████▌| 353375/371472 [5:57:42<1:34:37,  3.19it/s]
 95%|█████████▌| 353376/371472 [5:57:42<1:34:52,  3.18it/s]
 95%|█████████▌| 353377/371472 [5:57:42<1:31:09,  3.31it/s]
 95%|█████████▌| 353378/371472 [5:57:43<1:27:21,  3.45it/s]
 95%|█████████▌| 353379/371472 [5:57:43<1:28:17,  3.42it/s]
 95%|█████████▌| 353380/371472 [5:57:43<1:31:58,  3.28it/s]
                                                           
{'loss': 2.6177, 'learning_rate': 1.438567950182077e-07, 'epoch': 15.22}

 95%|█████████▌| 353380/371472 [5:57:43<1:31:58,  3.28it/s]
 95%|█████████▌| 353381/371472 [5:57:43<1:28:38,  3.40it/s]
 95%|█████████▌| 353382/371472 [5:57:44<1:26:41,  3.48it/s]
 95%|█████████▌| 353383/371472 [5:57:44<1:24:15,  3.58it/s]
 95%|█████████▌| 353384/371472 [5:57:44<1:25:39,  3.52it/s]
 95%|█████████▌| 353385/371472 [5:57:45<1:26:42,  3.48it/s]
 95%|█████████▌| 353386/371472 [5:57:45<1:23:34,  3.61it/s]
 95%|█████████▌| 353387/371472 [5:57:45<1:21:06,  3.72it/s]
 95%|█████████▌| 353388/371472 [5:57:45<1:24:53,  3.55it/s]
 95%|█████████▌| 353389/371472 [5:57:46<1:23:21,  3.62it/s]
 95%|█████████▌| 353390/371472 [5:57:46<1:23:33,  3.61it/s]
 95%|█████████▌| 353391/371472 [5:57:46<1:27:27,  3.45it/s]
 95%|█████████▌| 353392/371472 [5:57:46<1:23:13,  3.62it/s]
 95%|█████████▌| 353393/371472 [5:57:47<1:26:37,  3.48it/s]
 95%|█████████▌| 353394/371472 [5:57:47<1:23:53,  3.59it/s]
 95%|█████████▌| 353395/371472 [5:57:47<1:23:42,  3.60it/s]
 95%|█████████▌| 353396/371472 [5:57:48<1:19:31,  3.79it/s]
 95%|█████████▌| 353397/371472 [5:57:48<1:21:53,  3.68it/s]
 95%|█████████▌| 353398/371472 [5:57:48<1:23:47,  3.60it/s]
 95%|█████████▌| 353399/371472 [5:57:48<1:21:13,  3.71it/s]
 95%|█████████▌| 353400/371472 [5:57:49<1:24:06,  3.58it/s]
                                                           
{'loss': 2.697, 'learning_rate': 1.4380831304272877e-07, 'epoch': 15.22}

 95%|█████████▌| 353400/371472 [5:57:49<1:24:06,  3.58it/s]
 95%|█████████▌| 353401/371472 [5:57:49<1:26:11,  3.49it/s]
 95%|█████████▌| 353402/371472 [5:57:49<1:27:10,  3.45it/s]
 95%|█████████▌| 353403/371472 [5:57:50<1:28:45,  3.39it/s]
 95%|█████████▌| 353404/371472 [5:57:50<1:29:29,  3.36it/s]
 95%|█████████▌| 353405/371472 [5:57:50<1:24:59,  3.54it/s]
 95%|█████████▌| 353406/371472 [5:57:50<1:23:07,  3.62it/s]
 95%|█████████▌| 353407/371472 [5:57:51<1:20:47,  3.73it/s]
 95%|█████████▌| 353408/371472 [5:57:51<1:18:24,  3.84it/s]
 95%|█████████▌| 353409/371472 [5:57:51<1:18:42,  3.82it/s]
 95%|█████████▌| 353410/371472 [5:57:51<1:20:06,  3.76it/s]
 95%|█████████▌| 353411/371472 [5:57:52<1:20:23,  3.74it/s]
 95%|█████████▌| 353412/371472 [5:57:52<1:19:14,  3.80it/s]
 95%|█████████▌| 353413/371472 [5:57:52<1:18:35,  3.83it/s]
 95%|█████████▌| 353414/371472 [5:57:53<1:19:29,  3.79it/s]
 95%|█████████▌| 353415/371472 [5:57:53<1:22:15,  3.66it/s]
 95%|█████████▌| 353416/371472 [5:57:53<1:29:06,  3.38it/s]
 95%|█████████▌| 353417/371472 [5:57:53<1:28:50,  3.39it/s]
 95%|█████████▌| 353418/371472 [5:57:54<1:29:20,  3.37it/s]
 95%|█████████▌| 353419/371472 [5:57:54<1:26:58,  3.46it/s]
 95%|█████████▌| 353420/371472 [5:57:54<1:26:49,  3.46it/s]
                                                           
{'loss': 2.617, 'learning_rate': 1.4375983106724992e-07, 'epoch': 15.22}

 95%|█████████▌| 353420/371472 [5:57:54<1:26:49,  3.46it/s]
 95%|█████████▌| 353421/371472 [5:57:55<1:28:57,  3.38it/s]
 95%|█████████▌| 353422/371472 [5:57:55<1:30:09,  3.34it/s]
 95%|█████████▌| 353423/371472 [5:57:55<1:27:03,  3.46it/s]
 95%|█████████▌| 353424/371472 [5:57:56<1:29:08,  3.37it/s]
 95%|█████████▌| 353425/371472 [5:57:56<1:27:47,  3.43it/s]
 95%|█████████▌| 353426/371472 [5:57:56<1:30:51,  3.31it/s]
 95%|█████████▌| 353427/371472 [5:57:56<1:31:14,  3.30it/s]
 95%|█████████▌| 353428/371472 [5:57:57<1:29:34,  3.36it/s]
 95%|█████████▌| 353429/371472 [5:57:57<1:33:41,  3.21it/s]
 95%|█████████▌| 353430/371472 [5:57:57<1:28:12,  3.41it/s]
 95%|█████████▌| 353431/371472 [5:57:58<1:25:52,  3.50it/s]
 95%|█████████▌| 353432/371472 [5:57:58<1:23:18,  3.61it/s]
 95%|█████████▌| 353433/371472 [5:57:58<1:20:35,  3.73it/s]
 95%|█████████▌| 353434/371472 [5:57:58<1:18:32,  3.83it/s]
 95%|█████████▌| 353435/371472 [5:57:59<1:20:12,  3.75it/s]
 95%|█████████▌| 353436/371472 [5:57:59<1:22:00,  3.67it/s]
 95%|█████████▌| 353437/371472 [5:57:59<1:20:19,  3.74it/s]
 95%|█████████▌| 353438/371472 [5:57:59<1:18:06,  3.85it/s]
 95%|█████████▌| 353439/371472 [5:58:00<1:16:44,  3.92it/s]
 95%|█████████▌| 353440/371472 [5:58:00<1:21:12,  3.70it/s]
                                                           
{'loss': 2.6002, 'learning_rate': 1.4371134909177097e-07, 'epoch': 15.22}

 95%|█████████▌| 353440/371472 [5:58:00<1:21:12,  3.70it/s]
 95%|█████████▌| 353441/371472 [5:58:00<1:21:52,  3.67it/s]
 95%|█████████▌| 353442/371472 [5:58:00<1:18:46,  3.81it/s]
 95%|█████████▌| 353443/371472 [5:58:01<1:21:02,  3.71it/s]
 95%|█████████▌| 353444/371472 [5:58:01<1:19:27,  3.78it/s]
 95%|█████████▌| 353445/371472 [5:58:01<1:22:57,  3.62it/s]
 95%|█████████▌| 353446/371472 [5:58:02<1:21:03,  3.71it/s]
 95%|█████████▌| 353447/371472 [5:58:02<1:20:42,  3.72it/s]
 95%|█████████▌| 353448/371472 [5:58:02<1:19:47,  3.76it/s]
 95%|█████████▌| 353449/371472 [5:58:02<1:24:24,  3.56it/s]
 95%|█████████▌| 353450/371472 [5:58:03<1:25:00,  3.53it/s]
 95%|█████████▌| 353451/371472 [5:58:03<1:24:44,  3.54it/s]
 95%|█████████▌| 353452/371472 [5:58:03<1:25:29,  3.51it/s]
 95%|█████████▌| 353453/371472 [5:58:04<1:26:30,  3.47it/s]
 95%|█████████▌| 353454/371472 [5:58:04<1:33:43,  3.20it/s]
 95%|█████████▌| 353455/371472 [5:58:04<1:35:16,  3.15it/s]
 95%|█████████▌| 353456/371472 [5:58:05<1:31:11,  3.29it/s]
 95%|█████████▌| 353457/371472 [5:58:05<1:28:15,  3.40it/s]
 95%|█████████▌| 353458/371472 [5:58:05<1:25:08,  3.53it/s]
 95%|█████████▌| 353459/371472 [5:58:05<1:21:59,  3.66it/s]
 95%|█████████▌| 353460/371472 [5:58:06<1:20:50,  3.71it/s]
                                                           
{'loss': 2.5891, 'learning_rate': 1.4366286711629215e-07, 'epoch': 15.22}

 95%|█████████▌| 353460/371472 [5:58:06<1:20:50,  3.71it/s]
 95%|█████████▌| 353461/371472 [5:58:06<1:22:50,  3.62it/s]
 95%|█████████▌| 353462/371472 [5:58:06<1:23:04,  3.61it/s]
 95%|█████████▌| 353463/371472 [5:58:06<1:21:13,  3.70it/s]
 95%|█████████▌| 353464/371472 [5:58:07<1:18:08,  3.84it/s]
 95%|█████████▌| 353465/371472 [5:58:07<1:18:14,  3.84it/s]
 95%|█████████▌| 353466/371472 [5:58:07<1:18:40,  3.81it/s]
 95%|█████████▌| 353467/371472 [5:58:07<1:20:59,  3.71it/s]
 95%|█████████▌| 353468/371472 [5:58:08<1:30:21,  3.32it/s]
 95%|█████████▌| 353469/371472 [5:58:08<1:30:08,  3.33it/s]
 95%|█████████▌| 353470/371472 [5:58:08<1:33:09,  3.22it/s]
 95%|█████████▌| 353471/371472 [5:58:09<1:27:32,  3.43it/s]
 95%|█████████▌| 353472/371472 [5:58:09<1:23:55,  3.57it/s]
 95%|█████████▌| 353473/371472 [5:58:09<1:20:49,  3.71it/s]
 95%|█████████▌| 353474/371472 [5:58:09<1:22:00,  3.66it/s]
 95%|█████████▌| 353475/371472 [5:58:10<1:21:39,  3.67it/s]
 95%|█████████▌| 353476/371472 [5:58:10<1:20:55,  3.71it/s]
 95%|█████████▌| 353477/371472 [5:58:10<1:22:16,  3.65it/s]
 95%|█████████▌| 353478/371472 [5:58:11<1:24:15,  3.56it/s]
 95%|█████████▌| 353479/371472 [5:58:11<1:37:02,  3.09it/s]
 95%|█████████▌| 353480/371472 [5:58:11<1:32:17,  3.25it/s]
                                                           
{'loss': 2.5985, 'learning_rate': 1.436143851408132e-07, 'epoch': 15.23}

 95%|█████████▌| 353480/371472 [5:58:11<1:32:17,  3.25it/s]
 95%|█████████▌| 353481/371472 [5:58:12<1:31:27,  3.28it/s]
 95%|█████████▌| 353482/371472 [5:58:12<1:27:17,  3.43it/s]
 95%|█████████▌| 353483/371472 [5:58:12<1:25:18,  3.51it/s]
 95%|█████████▌| 353484/371472 [5:58:12<1:25:28,  3.51it/s]
 95%|█████████▌| 353485/371472 [5:58:13<1:22:56,  3.61it/s]
 95%|█████████▌| 353486/371472 [5:58:13<1:20:18,  3.73it/s]
 95%|█████████▌| 353487/371472 [5:58:13<1:22:42,  3.62it/s]
 95%|█████████▌| 353488/371472 [5:58:13<1:21:24,  3.68it/s]
 95%|█████████▌| 353489/371472 [5:58:14<1:20:23,  3.73it/s]
 95%|█████████▌| 353490/371472 [5:58:14<1:18:17,  3.83it/s]
 95%|█████████▌| 353491/371472 [5:58:14<1:17:52,  3.85it/s]
 95%|█████████▌| 353492/371472 [5:58:14<1:18:11,  3.83it/s]
 95%|█████████▌| 353493/371472 [5:58:15<1:25:12,  3.52it/s]
 95%|█████████▌| 353494/371472 [5:58:15<1:23:49,  3.57it/s]
 95%|█████████▌| 353495/371472 [5:58:15<1:24:07,  3.56it/s]
 95%|█████████▌| 353496/371472 [5:58:16<1:22:27,  3.63it/s]
 95%|█████████▌| 353497/371472 [5:58:16<1:21:44,  3.66it/s]
 95%|█████████▌| 353498/371472 [5:58:16<1:25:16,  3.51it/s]
 95%|█████████▌| 353499/371472 [5:58:16<1:23:20,  3.59it/s]
 95%|█████████▌| 353500/371472 [5:58:17<1:24:54,  3.53it/s]
                                                           
{'loss': 2.5123, 'learning_rate': 1.4356590316533434e-07, 'epoch': 15.23}

 95%|█████████▌| 353500/371472 [5:58:17<1:24:54,  3.53it/s]
 95%|█████████▌| 353501/371472 [5:58:17<1:26:58,  3.44it/s]
 95%|█████████▌| 353502/371472 [5:58:17<1:24:21,  3.55it/s]
 95%|█████████▌| 353503/371472 [5:58:18<1:23:06,  3.60it/s]
 95%|█████████▌| 353504/371472 [5:58:18<1:21:54,  3.66it/s]
 95%|█████████▌| 353505/371472 [5:58:18<1:21:31,  3.67it/s]
 95%|█████████▌| 353506/371472 [5:58:18<1:23:59,  3.57it/s]
 95%|█████████▌| 353507/371472 [5:58:19<1:25:53,  3.49it/s]
 95%|█████████▌| 353508/371472 [5:58:19<1:35:02,  3.15it/s]
 95%|█████████▌| 353509/371472 [5:58:19<1:30:14,  3.32it/s]
 95%|█████████▌| 353510/371472 [5:58:20<1:31:42,  3.26it/s]
 95%|█████████▌| 353511/371472 [5:58:20<1:33:12,  3.21it/s]
 95%|█████████▌| 353512/371472 [5:58:20<1:29:24,  3.35it/s]
 95%|█████████▌| 353513/371472 [5:58:21<1:28:05,  3.40it/s]
 95%|█████████▌| 353514/371472 [5:58:21<1:25:05,  3.52it/s]
 95%|█████████▌| 353515/371472 [5:58:21<1:23:14,  3.60it/s]
 95%|█████████▌| 353516/371472 [5:58:21<1:24:22,  3.55it/s]
 95%|█████████▌| 353517/371472 [5:58:22<1:23:28,  3.59it/s]
 95%|█████████▌| 353518/371472 [5:58:22<1:29:41,  3.34it/s]
 95%|█████████▌| 353519/371472 [5:58:22<1:27:23,  3.42it/s]
 95%|█████████▌| 353520/371472 [5:58:23<1:39:08,  3.02it/s]
                                                           
{'loss': 2.6804, 'learning_rate': 1.435174211898554e-07, 'epoch': 15.23}

 95%|█████████▌| 353520/371472 [5:58:23<1:39:08,  3.02it/s]
 95%|█████████▌| 353521/371472 [5:58:23<1:34:48,  3.16it/s]
 95%|█████████▌| 353522/371472 [5:58:23<1:29:11,  3.35it/s]
 95%|█████████▌| 353523/371472 [5:58:24<1:30:00,  3.32it/s]
 95%|█████████▌| 353524/371472 [5:58:24<1:29:38,  3.34it/s]
 95%|█████████▌| 353525/371472 [5:58:24<1:25:36,  3.49it/s]
 95%|█████████▌| 353526/371472 [5:58:24<1:26:01,  3.48it/s]
 95%|█████████▌| 353527/371472 [5:58:25<1:24:56,  3.52it/s]
 95%|█████████▌| 353528/371472 [5:58:25<1:22:07,  3.64it/s]
 95%|█████████▌| 353529/371472 [5:58:25<1:40:05,  2.99it/s]
 95%|█████████▌| 353530/371472 [5:58:26<1:38:06,  3.05it/s]
 95%|█████████▌| 353531/371472 [5:58:26<1:31:55,  3.25it/s]
 95%|█████████▌| 353532/371472 [5:58:26<1:35:13,  3.14it/s]
 95%|█████████▌| 353533/371472 [5:58:27<1:30:51,  3.29it/s]
 95%|█████████▌| 353534/371472 [5:58:27<1:27:36,  3.41it/s]
 95%|█████████▌| 353535/371472 [5:58:27<1:29:22,  3.34it/s]
 95%|█████████▌| 353536/371472 [5:58:27<1:30:02,  3.32it/s]
 95%|█████████▌| 353537/371472 [5:58:28<1:26:47,  3.44it/s]
 95%|█████████▌| 353538/371472 [5:58:28<1:26:42,  3.45it/s]
 95%|█████████▌| 353539/371472 [5:58:28<1:24:56,  3.52it/s]
 95%|█████████▌| 353540/371472 [5:58:29<1:25:40,  3.49it/s]
                                                           
{'loss': 2.4971, 'learning_rate': 1.4346893921437656e-07, 'epoch': 15.23}

 95%|█████████▌| 353540/371472 [5:58:29<1:25:40,  3.49it/s]
 95%|█████████▌| 353541/371472 [5:58:29<1:21:27,  3.67it/s]
 95%|█████████▌| 353542/371472 [5:58:29<1:23:14,  3.59it/s]
 95%|█████████▌| 353543/371472 [5:58:29<1:24:20,  3.54it/s]
 95%|█████████▌| 353544/371472 [5:58:30<1:27:09,  3.43it/s]
 95%|█████████▌| 353545/371472 [5:58:30<1:23:50,  3.56it/s]
 95%|█████████▌| 353546/371472 [5:58:30<1:22:44,  3.61it/s]
 95%|█████████▌| 353547/371472 [5:58:30<1:19:41,  3.75it/s]
 95%|█████████▌| 353548/371472 [5:58:31<1:18:24,  3.81it/s]
 95%|█████████▌| 353549/371472 [5:58:31<1:17:44,  3.84it/s]
 95%|█████████▌| 353550/371472 [5:58:31<1:19:46,  3.74it/s]
 95%|█████████▌| 353551/371472 [5:58:32<1:20:31,  3.71it/s]
 95%|█████████▌| 353552/371472 [5:58:32<1:19:40,  3.75it/s]
 95%|█████████▌| 353553/371472 [5:58:32<1:18:46,  3.79it/s]
 95%|█████████▌| 353554/371472 [5:58:32<1:17:45,  3.84it/s]
 95%|█████████▌| 353555/371472 [5:58:33<1:18:53,  3.78it/s]
 95%|█████████▌| 353556/371472 [5:58:33<1:21:41,  3.65it/s]
 95%|█████████▌| 353557/371472 [5:58:33<1:20:02,  3.73it/s]
 95%|█████████▌| 353558/371472 [5:58:33<1:20:11,  3.72it/s]
 95%|█████████▌| 353559/371472 [5:58:34<1:22:58,  3.60it/s]
 95%|█████████▌| 353560/371472 [5:58:34<1:24:10,  3.55it/s]
                                                           
{'loss': 2.5475, 'learning_rate': 1.434204572388976e-07, 'epoch': 15.23}

 95%|█████████▌| 353560/371472 [5:58:34<1:24:10,  3.55it/s]
 95%|█████████▌| 353561/371472 [5:58:34<1:23:31,  3.57it/s]
 95%|█████████▌| 353562/371472 [5:58:35<1:24:30,  3.53it/s]
 95%|█████████▌| 353563/371472 [5:58:35<1:22:07,  3.63it/s]
 95%|█████████▌| 353564/371472 [5:58:35<1:20:05,  3.73it/s]
 95%|█████████▌| 353565/371472 [5:58:35<1:23:11,  3.59it/s]
 95%|█████████▌| 353566/371472 [5:58:36<1:27:47,  3.40it/s]
 95%|█████████▌| 353567/371472 [5:58:36<1:28:38,  3.37it/s]
 95%|█████████▌| 353568/371472 [5:58:36<1:25:59,  3.47it/s]
 95%|█████████▌| 353569/371472 [5:58:37<1:25:20,  3.50it/s]
 95%|█████████▌| 353570/371472 [5:58:37<1:26:42,  3.44it/s]
 95%|█████████▌| 353571/371472 [5:58:37<1:27:20,  3.42it/s]
 95%|█████████▌| 353572/371472 [5:58:37<1:27:29,  3.41it/s]
 95%|█████████▌| 353573/371472 [5:58:38<1:27:33,  3.41it/s]
 95%|█████████▌| 353574/371472 [5:58:38<1:26:31,  3.45it/s]
 95%|█████████▌| 353575/371472 [5:58:38<1:27:04,  3.43it/s]
 95%|█████████▌| 353576/371472 [5:58:39<1:24:39,  3.52it/s]
 95%|█████████▌| 353577/371472 [5:58:39<1:26:26,  3.45it/s]
 95%|█████████▌| 353578/371472 [5:58:39<1:21:49,  3.64it/s]
 95%|█████████▌| 353579/371472 [5:58:39<1:19:06,  3.77it/s]
 95%|█████████▌| 353580/371472 [5:58:40<1:19:08,  3.77it/s]
                                                           
{'loss': 2.562, 'learning_rate': 1.4337197526341879e-07, 'epoch': 15.23}

 95%|█████████▌| 353580/371472 [5:58:40<1:19:08,  3.77it/s]
 95%|█████████▌| 353581/371472 [5:58:40<1:20:44,  3.69it/s]
 95%|█████████▌| 353582/371472 [5:58:40<1:19:57,  3.73it/s]
 95%|█████████▌| 353583/371472 [5:58:40<1:18:53,  3.78it/s]
 95%|█████████▌| 353584/371472 [5:58:41<1:21:00,  3.68it/s]
 95%|█████████▌| 353585/371472 [5:58:41<1:21:58,  3.64it/s]
 95%|█████████▌| 353586/371472 [5:58:41<1:29:40,  3.32it/s]
 95%|█████████▌| 353587/371472 [5:58:42<1:28:58,  3.35it/s]
 95%|█████████▌| 353588/371472 [5:58:42<1:25:01,  3.51it/s]
 95%|█████████▌| 353589/371472 [5:58:42<1:28:29,  3.37it/s]
 95%|█████████▌| 353590/371472 [5:58:43<1:24:45,  3.52it/s]
 95%|█████████▌| 353591/371472 [5:58:43<1:22:04,  3.63it/s]
 95%|█████████▌| 353592/371472 [5:58:43<1:29:05,  3.34it/s]
 95%|█████████▌| 353593/371472 [5:58:43<1:25:42,  3.48it/s]
 95%|█████████▌| 353594/371472 [5:58:44<1:23:54,  3.55it/s]
 95%|█████████▌| 353595/371472 [5:58:44<1:22:33,  3.61it/s]
 95%|█████████▌| 353596/371472 [5:58:44<1:24:22,  3.53it/s]
 95%|█████████▌| 353597/371472 [5:58:44<1:20:27,  3.70it/s]
 95%|█████████▌| 353598/371472 [5:58:45<1:22:07,  3.63it/s]
 95%|█████████▌| 353599/371472 [5:58:45<1:22:46,  3.60it/s]
 95%|█████████▌| 353600/371472 [5:58:45<1:21:41,  3.65it/s]
                                                           
{'loss': 2.6029, 'learning_rate': 1.4332349328793983e-07, 'epoch': 15.23}

 95%|█████████▌| 353600/371472 [5:58:45<1:21:41,  3.65it/s]
 95%|█████████▌| 353601/371472 [5:58:46<1:20:31,  3.70it/s]
 95%|█████████▌| 353602/371472 [5:58:46<1:20:12,  3.71it/s]
 95%|█████████▌| 353603/371472 [5:58:46<1:24:56,  3.51it/s]
 95%|█████████▌| 353604/371472 [5:58:46<1:26:05,  3.46it/s]
 95%|█████████▌| 353605/371472 [5:58:47<1:24:51,  3.51it/s]
 95%|█████████▌| 353606/371472 [5:58:47<1:23:13,  3.58it/s]
 95%|█████████▌| 353607/371472 [5:58:47<1:18:42,  3.78it/s]
 95%|█████████▌| 353608/371472 [5:58:47<1:20:22,  3.70it/s]
 95%|█████████▌| 353609/371472 [5:58:48<1:28:34,  3.36it/s]
 95%|█████████▌| 353610/371472 [5:58:48<1:26:34,  3.44it/s]
 95%|█████████▌| 353611/371472 [5:58:48<1:23:12,  3.58it/s]
 95%|█████████▌| 353612/371472 [5:58:49<1:20:11,  3.71it/s]
 95%|█████████▌| 353613/371472 [5:58:49<1:22:12,  3.62it/s]
 95%|█████████▌| 353614/371472 [5:58:49<1:20:20,  3.70it/s]
 95%|█████████▌| 353615/371472 [5:58:49<1:20:23,  3.70it/s]
 95%|█████████▌| 353616/371472 [5:58:50<1:22:53,  3.59it/s]
 95%|█████████▌| 353617/371472 [5:58:50<1:25:44,  3.47it/s]
 95%|█████████▌| 353618/371472 [5:58:50<1:22:30,  3.61it/s]
 95%|█████████▌| 353619/371472 [5:58:51<1:26:57,  3.42it/s]
 95%|█████████▌| 353620/371472 [5:58:51<1:24:41,  3.51it/s]
                                                           
{'loss': 2.5679, 'learning_rate': 1.4327501131246088e-07, 'epoch': 15.23}

 95%|█████████▌| 353620/371472 [5:58:51<1:24:41,  3.51it/s]
 95%|█████████▌| 353621/371472 [5:58:51<1:27:56,  3.38it/s]
 95%|█████████▌| 353622/371472 [5:58:52<1:29:16,  3.33it/s]
 95%|█████████▌| 353623/371472 [5:58:52<1:27:26,  3.40it/s]
 95%|█████████▌| 353624/371472 [5:58:52<1:30:25,  3.29it/s]
 95%|█████████▌| 353625/371472 [5:58:52<1:31:21,  3.26it/s]
 95%|█████████▌| 353626/371472 [5:58:53<1:27:37,  3.39it/s]
 95%|█████████▌| 353627/371472 [5:58:53<1:22:43,  3.59it/s]
 95%|█████████▌| 353628/371472 [5:58:53<1:24:56,  3.50it/s]
 95%|█████████▌| 353629/371472 [5:58:54<1:24:53,  3.50it/s]
 95%|█████████▌| 353630/371472 [5:58:54<1:25:48,  3.47it/s]
 95%|█████████▌| 353631/371472 [5:58:54<1:22:37,  3.60it/s]
 95%|█████████▌| 353632/371472 [5:58:54<1:24:45,  3.51it/s]
 95%|█████████▌| 353633/371472 [5:58:55<1:29:55,  3.31it/s]
 95%|█████████▌| 353634/371472 [5:58:55<1:26:45,  3.43it/s]
 95%|█████████▌| 353635/371472 [5:58:55<1:30:04,  3.30it/s]
 95%|█████████▌| 353636/371472 [5:58:56<1:25:32,  3.48it/s]
 95%|█████████▌| 353637/371472 [5:58:56<1:23:48,  3.55it/s]
 95%|█████████▌| 353638/371472 [5:58:56<1:23:54,  3.54it/s]
 95%|█████████▌| 353639/371472 [5:58:56<1:29:36,  3.32it/s]
 95%|█████████▌| 353640/371472 [5:58:57<1:27:04,  3.41it/s]
                                                           
{'loss': 2.517, 'learning_rate': 1.4322652933698205e-07, 'epoch': 15.23}

 95%|█████████▌| 353640/371472 [5:58:57<1:27:04,  3.41it/s]
 95%|█████████▌| 353641/371472 [5:58:57<1:24:27,  3.52it/s]
 95%|█████████▌| 353642/371472 [5:58:57<1:21:55,  3.63it/s]
 95%|█████████▌| 353643/371472 [5:58:58<1:20:10,  3.71it/s]
 95%|█████████▌| 353644/371472 [5:58:58<1:24:56,  3.50it/s]
 95%|█████████▌| 353645/371472 [5:58:58<1:20:45,  3.68it/s]
 95%|█████████▌| 353646/371472 [5:58:58<1:21:18,  3.65it/s]
 95%|█████████▌| 353647/371472 [5:58:59<1:21:24,  3.65it/s]
 95%|█████████▌| 353648/371472 [5:58:59<1:26:08,  3.45it/s]
 95%|█████████▌| 353649/371472 [5:58:59<1:26:45,  3.42it/s]
 95%|█████████▌| 353650/371472 [5:59:00<1:24:23,  3.52it/s]
 95%|█████████▌| 353651/371472 [5:59:00<1:28:37,  3.35it/s]
 95%|█████████▌| 353652/371472 [5:59:00<1:26:20,  3.44it/s]
 95%|█████████▌| 353653/371472 [5:59:00<1:30:28,  3.28it/s]
 95%|█████████▌| 353654/371472 [5:59:01<1:26:59,  3.41it/s]
 95%|█████████▌| 353655/371472 [5:59:01<1:24:27,  3.52it/s]
 95%|█████████▌| 353656/371472 [5:59:01<1:23:38,  3.55it/s]
 95%|█████████▌| 353657/371472 [5:59:02<1:22:11,  3.61it/s]
 95%|█████████▌| 353658/371472 [5:59:02<1:19:44,  3.72it/s]
 95%|█████████▌| 353659/371472 [5:59:02<1:18:34,  3.78it/s]
 95%|█████████▌| 353660/371472 [5:59:02<1:19:40,  3.73it/s]
                                                           
{'loss': 2.5771, 'learning_rate': 1.431780473615031e-07, 'epoch': 15.23}

 95%|█████████▌| 353660/371472 [5:59:02<1:19:40,  3.73it/s]
 95%|█████████▌| 353661/371472 [5:59:03<1:18:24,  3.79it/s]
 95%|█████████▌| 353662/371472 [5:59:03<1:18:38,  3.77it/s]
 95%|█████████▌| 353663/371472 [5:59:03<1:19:04,  3.75it/s]
 95%|█████████▌| 353664/371472 [5:59:03<1:25:11,  3.48it/s]
 95%|█████████▌| 353665/371472 [5:59:04<1:24:16,  3.52it/s]
 95%|█████████▌| 353666/371472 [5:59:04<1:24:29,  3.51it/s]
 95%|█████████▌| 353667/371472 [5:59:04<1:22:06,  3.61it/s]
 95%|█████████▌| 353668/371472 [5:59:05<1:21:59,  3.62it/s]
 95%|█████████▌| 353669/371472 [5:59:05<1:36:06,  3.09it/s]
 95%|█████████▌| 353670/371472 [5:59:05<1:29:30,  3.31it/s]
 95%|█████████▌| 353671/371472 [5:59:05<1:24:56,  3.49it/s]
 95%|█████████▌| 353672/371472 [5:59:06<1:22:59,  3.57it/s]
 95%|█████████▌| 353673/371472 [5:59:06<1:23:40,  3.55it/s]
 95%|█████████▌| 353674/371472 [5:59:06<1:22:29,  3.60it/s]
 95%|█████████▌| 353675/371472 [5:59:07<1:30:47,  3.27it/s]
 95%|█████████▌| 353676/371472 [5:59:07<1:32:21,  3.21it/s]
 95%|█████████▌| 353677/371472 [5:59:07<1:27:10,  3.40it/s]
 95%|█████████▌| 353678/371472 [5:59:08<1:22:22,  3.60it/s]
 95%|█████████▌| 353679/371472 [5:59:08<1:20:14,  3.70it/s]
 95%|█████████▌| 353680/371472 [5:59:08<1:17:57,  3.80it/s]
                                                           
{'loss': 2.7452, 'learning_rate': 1.4312956538602425e-07, 'epoch': 15.23}

 95%|█████████▌| 353680/371472 [5:59:08<1:17:57,  3.80it/s]
 95%|█████████▌| 353681/371472 [5:59:08<1:17:58,  3.80it/s]
 95%|█████████▌| 353682/371472 [5:59:09<1:24:21,  3.51it/s]
 95%|█████████▌| 353683/371472 [5:59:09<1:27:34,  3.39it/s]
 95%|█████████▌| 353684/371472 [5:59:09<1:25:06,  3.48it/s]
 95%|█████████▌| 353685/371472 [5:59:09<1:22:42,  3.58it/s]
 95%|█████████▌| 353686/371472 [5:59:10<1:21:11,  3.65it/s]
 95%|█████████▌| 353687/371472 [5:59:10<1:19:05,  3.75it/s]
 95%|█████████▌| 353688/371472 [5:59:10<1:20:05,  3.70it/s]
 95%|█████████▌| 353689/371472 [5:59:11<1:19:29,  3.73it/s]
 95%|█████████▌| 353690/371472 [5:59:11<1:30:20,  3.28it/s]
 95%|█████████▌| 353691/371472 [5:59:11<1:28:26,  3.35it/s]
 95%|█████████▌| 353692/371472 [5:59:11<1:26:38,  3.42it/s]
 95%|█████████▌| 353693/371472 [5:59:12<1:24:09,  3.52it/s]
 95%|█████████▌| 353694/371472 [5:59:12<1:21:29,  3.64it/s]
 95%|█████████▌| 353695/371472 [5:59:12<1:21:00,  3.66it/s]
 95%|█████████▌| 353696/371472 [5:59:13<1:22:26,  3.59it/s]
 95%|█████████▌| 353697/371472 [5:59:13<1:22:22,  3.60it/s]
 95%|█████████▌| 353698/371472 [5:59:13<1:20:53,  3.66it/s]
 95%|█████████▌| 353699/371472 [5:59:13<1:19:16,  3.74it/s]
 95%|█████████▌| 353700/371472 [5:59:14<1:18:43,  3.76it/s]
                                                           
{'loss': 2.7133, 'learning_rate': 1.4308108341054532e-07, 'epoch': 15.23}

 95%|█████████▌| 353700/371472 [5:59:14<1:18:43,  3.76it/s]
 95%|█████████▌| 353701/371472 [5:59:14<1:20:56,  3.66it/s]
 95%|█████████▌| 353702/371472 [5:59:14<1:24:26,  3.51it/s]
 95%|█████████▌| 353703/371472 [5:59:15<1:30:07,  3.29it/s]
 95%|█████████▌| 353704/371472 [5:59:15<1:27:24,  3.39it/s]
 95%|█████████▌| 353705/371472 [5:59:15<1:27:39,  3.38it/s]
 95%|█████████▌| 353706/371472 [5:59:15<1:25:15,  3.47it/s]
 95%|█████████▌| 353707/371472 [5:59:16<1:29:23,  3.31it/s]
 95%|█████████▌| 353708/371472 [5:59:16<1:26:31,  3.42it/s]
 95%|█████████▌| 353709/371472 [5:59:16<1:28:52,  3.33it/s]
 95%|█████████▌| 353710/371472 [5:59:17<1:25:56,  3.44it/s]
 95%|█████████▌| 353711/371472 [5:59:17<1:27:02,  3.40it/s]
 95%|█████████▌| 353712/371472 [5:59:17<1:23:19,  3.55it/s]
 95%|█████████▌| 353713/371472 [5:59:17<1:23:39,  3.54it/s]
 95%|█████████▌| 353714/371472 [5:59:18<1:22:50,  3.57it/s]
 95%|█████████▌| 353715/371472 [5:59:18<1:21:56,  3.61it/s]
 95%|█████████▌| 353716/371472 [5:59:18<1:21:49,  3.62it/s]
 95%|█████████▌| 353717/371472 [5:59:18<1:18:50,  3.75it/s]
 95%|█████████▌| 353718/371472 [5:59:19<1:17:52,  3.80it/s]
 95%|█████████▌| 353719/371472 [5:59:19<1:19:43,  3.71it/s]
 95%|█████████▌| 353720/371472 [5:59:19<1:21:20,  3.64it/s]
                                                           
{'loss': 2.569, 'learning_rate': 1.430326014350665e-07, 'epoch': 15.24}

 95%|█████████▌| 353720/371472 [5:59:19<1:21:20,  3.64it/s]
 95%|█████████▌| 353721/371472 [5:59:20<1:23:07,  3.56it/s]
 95%|█████████▌| 353722/371472 [5:59:20<1:23:23,  3.55it/s]
 95%|█████████▌| 353723/371472 [5:59:20<1:24:40,  3.49it/s]
 95%|█████████▌| 353724/371472 [5:59:20<1:25:37,  3.45it/s]
 95%|█████████▌| 353725/371472 [5:59:21<1:23:14,  3.55it/s]
 95%|█████████▌| 353726/371472 [5:59:21<1:20:58,  3.65it/s]
 95%|█████████▌| 353727/371472 [5:59:21<1:30:13,  3.28it/s]
 95%|█████████▌| 353728/371472 [5:59:22<1:28:30,  3.34it/s]
 95%|█████████▌| 353729/371472 [5:59:22<1:28:14,  3.35it/s]
 95%|█████████▌| 353730/371472 [5:59:22<1:25:28,  3.46it/s]
 95%|█████████▌| 353731/371472 [5:59:22<1:22:26,  3.59it/s]
 95%|█████████▌| 353732/371472 [5:59:23<1:21:34,  3.62it/s]
 95%|█████████▌| 353733/371472 [5:59:23<1:19:31,  3.72it/s]
 95%|█████████▌| 353734/371472 [5:59:23<1:24:51,  3.48it/s]
 95%|█████████▌| 353735/371472 [5:59:24<1:23:22,  3.55it/s]
 95%|█████████▌| 353736/371472 [5:59:24<1:31:10,  3.24it/s]
 95%|█████████▌| 353737/371472 [5:59:24<1:28:36,  3.34it/s]
 95%|█████████▌| 353738/371472 [5:59:25<1:31:54,  3.22it/s]
 95%|█████████▌| 353739/371472 [5:59:25<1:30:42,  3.26it/s]
 95%|█████████▌| 353740/371472 [5:59:25<1:26:48,  3.40it/s]
                                                           
{'loss': 2.6036, 'learning_rate': 1.4298411945958754e-07, 'epoch': 15.24}

 95%|█████████▌| 353740/371472 [5:59:25<1:26:48,  3.40it/s]
 95%|█████████▌| 353741/371472 [5:59:25<1:30:00,  3.28it/s]
 95%|█████████▌| 353742/371472 [5:59:26<1:26:48,  3.40it/s]
 95%|█████████▌| 353743/371472 [5:59:26<1:25:01,  3.48it/s]
 95%|█████████▌| 353744/371472 [5:59:26<1:24:47,  3.48it/s]
 95%|█████████▌| 353745/371472 [5:59:27<1:23:10,  3.55it/s]
 95%|█████████▌| 353746/371472 [5:59:27<1:31:42,  3.22it/s]
 95%|█████████▌| 353747/371472 [5:59:27<1:27:01,  3.39it/s]
 95%|█████████▌| 353748/371472 [5:59:27<1:23:40,  3.53it/s]
 95%|█████████▌| 353749/371472 [5:59:28<1:22:04,  3.60it/s]
 95%|█████████▌| 353750/371472 [5:59:28<1:22:45,  3.57it/s]
 95%|█████████▌| 353751/371472 [5:59:28<1:20:08,  3.69it/s]
 95%|█████████▌| 353752/371472 [5:59:29<1:22:41,  3.57it/s]
 95%|█████████▌| 353753/371472 [5:59:29<1:20:49,  3.65it/s]
 95%|█████████▌| 353754/371472 [5:59:29<1:18:31,  3.76it/s]
 95%|█████████▌| 353755/371472 [5:59:30<1:41:36,  2.91it/s]
 95%|█████████▌| 353756/371472 [5:59:30<1:36:29,  3.06it/s]
 95%|█████████▌| 353757/371472 [5:59:30<1:31:16,  3.23it/s]
 95%|█████████▌| 353758/371472 [5:59:30<1:28:42,  3.33it/s]
 95%|█████████▌| 353759/371472 [5:59:31<1:30:59,  3.24it/s]
 95%|█████████▌| 353760/371472 [5:59:31<1:29:09,  3.31it/s]
                                                           
{'loss': 2.6114, 'learning_rate': 1.429356374841087e-07, 'epoch': 15.24}

 95%|█████████▌| 353760/371472 [5:59:31<1:29:09,  3.31it/s]
 95%|█████████▌| 353761/371472 [5:59:31<1:23:39,  3.53it/s]
 95%|█████████▌| 353762/371472 [5:59:32<1:20:07,  3.68it/s]
 95%|█████████▌| 353763/371472 [5:59:32<1:21:29,  3.62it/s]
 95%|█████████▌| 353764/371472 [5:59:32<1:21:25,  3.62it/s]
 95%|█████████▌| 353765/371472 [5:59:32<1:19:54,  3.69it/s]
 95%|█████████▌| 353766/371472 [5:59:33<1:22:37,  3.57it/s]
 95%|█████████▌| 353767/371472 [5:59:33<1:22:14,  3.59it/s]
 95%|█████████▌| 353768/371472 [5:59:33<1:21:06,  3.64it/s]
 95%|█████████▌| 353769/371472 [5:59:33<1:22:04,  3.59it/s]
 95%|█████████▌| 353770/371472 [5:59:34<1:19:42,  3.70it/s]
 95%|█████████▌| 353771/371472 [5:59:34<1:19:50,  3.70it/s]
 95%|█████████▌| 353772/371472 [5:59:34<1:23:23,  3.54it/s]
 95%|█████████▌| 353773/371472 [5:59:35<1:24:59,  3.47it/s]
 95%|█████████▌| 353774/371472 [5:59:35<1:23:39,  3.53it/s]
 95%|█████████▌| 353775/371472 [5:59:35<1:23:42,  3.52it/s]
 95%|█████████▌| 353776/371472 [5:59:35<1:22:24,  3.58it/s]
 95%|█████████▌| 353777/371472 [5:59:36<1:22:39,  3.57it/s]
 95%|█████████▌| 353778/371472 [5:59:36<1:25:41,  3.44it/s]
 95%|█████████▌| 353779/371472 [5:59:36<1:27:17,  3.38it/s]
 95%|█████████▌| 353780/371472 [5:59:37<1:23:41,  3.52it/s]
                                                           
{'loss': 2.5741, 'learning_rate': 1.4288715550862977e-07, 'epoch': 15.24}

 95%|█████████▌| 353780/371472 [5:59:37<1:23:41,  3.52it/s]
 95%|█████████▌| 353781/371472 [5:59:37<1:22:51,  3.56it/s]
 95%|█████████▌| 353782/371472 [5:59:37<1:24:14,  3.50it/s]
 95%|█████████▌| 353783/371472 [5:59:37<1:23:12,  3.54it/s]
 95%|█████████▌| 353784/371472 [5:59:38<1:21:56,  3.60it/s]
 95%|█████████▌| 353785/371472 [5:59:38<1:23:08,  3.55it/s]
 95%|█████████▌| 353786/371472 [5:59:38<1:26:32,  3.41it/s]
 95%|█████████▌| 353787/371472 [5:59:39<1:25:55,  3.43it/s]
 95%|█████████▌| 353788/371472 [5:59:39<1:22:21,  3.58it/s]
 95%|█████████▌| 353789/371472 [5:59:39<1:23:33,  3.53it/s]
 95%|█████████▌| 353790/371472 [5:59:39<1:20:31,  3.66it/s]
 95%|█████████▌| 353791/371472 [5:59:40<1:20:17,  3.67it/s]
 95%|█████████▌| 353792/371472 [5:59:40<1:18:08,  3.77it/s]
 95%|█████████▌| 353793/371472 [5:59:40<1:20:16,  3.67it/s]
 95%|█████████▌| 353794/371472 [5:59:40<1:20:01,  3.68it/s]
 95%|█████████▌| 353795/371472 [5:59:41<1:28:38,  3.32it/s]
 95%|█████████▌| 353796/371472 [5:59:41<1:24:02,  3.51it/s]
 95%|█████████▌| 353797/371472 [5:59:41<1:22:09,  3.59it/s]
 95%|█████████▌| 353798/371472 [5:59:42<1:24:23,  3.49it/s]
 95%|█████████▌| 353799/371472 [5:59:42<1:24:37,  3.48it/s]
 95%|█████████▌| 353800/371472 [5:59:42<1:21:49,  3.60it/s]
                                                           
{'loss': 2.5969, 'learning_rate': 1.4283867353315092e-07, 'epoch': 15.24}

 95%|█████████▌| 353800/371472 [5:59:42<1:21:49,  3.60it/s]
 95%|█████████▌| 353801/371472 [5:59:42<1:19:38,  3.70it/s]
 95%|█████████▌| 353802/371472 [5:59:43<1:19:45,  3.69it/s]
 95%|█████████▌| 353803/371472 [5:59:43<1:18:10,  3.77it/s]
 95%|█████████▌| 353804/371472 [5:59:43<1:20:27,  3.66it/s]
 95%|█████████▌| 353805/371472 [5:59:44<1:21:43,  3.60it/s]
 95%|█████████▌| 353806/371472 [5:59:44<1:19:28,  3.70it/s]
 95%|█████████▌| 353807/371472 [5:59:44<1:25:54,  3.43it/s]
 95%|█████████▌| 353808/371472 [5:59:44<1:22:16,  3.58it/s]
 95%|█████████▌| 353809/371472 [5:59:45<1:20:55,  3.64it/s]
 95%|█████████▌| 353810/371472 [5:59:45<1:22:04,  3.59it/s]
 95%|█████████▌| 353811/371472 [5:59:45<1:23:56,  3.51it/s]
 95%|█████████▌| 353812/371472 [5:59:46<1:33:08,  3.16it/s]
 95%|█████████▌| 353813/371472 [5:59:46<1:28:40,  3.32it/s]
 95%|█████████▌| 353814/371472 [5:59:46<1:28:01,  3.34it/s]
 95%|█████████▌| 353815/371472 [5:59:47<1:26:39,  3.40it/s]
 95%|█████████▌| 353816/371472 [5:59:47<1:24:40,  3.48it/s]
 95%|█████████▌| 353817/371472 [5:59:47<1:28:08,  3.34it/s]
 95%|█████████▌| 353818/371472 [5:59:47<1:24:56,  3.46it/s]
 95%|█████████▌| 353819/371472 [5:59:48<1:22:26,  3.57it/s]
 95%|█████████▌| 353820/371472 [5:59:48<1:20:27,  3.66it/s]
                                                           
{'loss': 2.471, 'learning_rate': 1.4279019155767196e-07, 'epoch': 15.24}

 95%|█████████▌| 353820/371472 [5:59:48<1:20:27,  3.66it/s]
 95%|█████████▌| 353821/371472 [5:59:48<1:30:13,  3.26it/s]
 95%|█████████▌| 353822/371472 [5:59:49<1:26:58,  3.38it/s]
 95%|█████████▌| 353823/371472 [5:59:49<1:28:15,  3.33it/s]
 95%|█████████▌| 353824/371472 [5:59:49<1:25:53,  3.42it/s]
 95%|█████████▌| 353825/371472 [5:59:49<1:26:29,  3.40it/s]
 95%|█████████▌| 353826/371472 [5:59:50<1:25:03,  3.46it/s]
 95%|█████████▌| 353827/371472 [5:59:50<1:29:15,  3.29it/s]
 95%|█████████▌| 353828/371472 [5:59:50<1:28:30,  3.32it/s]
 95%|█████████▌| 353829/371472 [5:59:51<1:26:54,  3.38it/s]
 95%|█████████▌| 353830/371472 [5:59:51<1:24:06,  3.50it/s]
 95%|█████████▌| 353831/371472 [5:59:51<1:25:34,  3.44it/s]
 95%|█████████▌| 353832/371472 [5:59:51<1:23:36,  3.52it/s]
 95%|█████████▌| 353833/371472 [5:59:52<1:26:11,  3.41it/s]
 95%|█████████▌| 353834/371472 [5:59:52<1:22:52,  3.55it/s]
 95%|█████████▌| 353835/371472 [5:59:52<1:24:35,  3.48it/s]
 95%|█████████▌| 353836/371472 [5:59:53<1:24:08,  3.49it/s]
 95%|█████████▌| 353837/371472 [5:59:53<1:23:30,  3.52it/s]
 95%|█████████▌| 353838/371472 [5:59:53<1:22:28,  3.56it/s]
 95%|█████████▌| 353839/371472 [5:59:53<1:20:02,  3.67it/s]
 95%|█████████▌| 353840/371472 [5:59:54<1:17:35,  3.79it/s]
                                                           
{'loss': 2.5252, 'learning_rate': 1.4274170958219314e-07, 'epoch': 15.24}

 95%|█████████▌| 353840/371472 [5:59:54<1:17:35,  3.79it/s]
 95%|█████████▌| 353841/371472 [5:59:54<1:16:39,  3.83it/s]
 95%|█████████▌| 353842/371472 [5:59:54<1:20:04,  3.67it/s]
 95%|█████████▌| 353843/371472 [5:59:54<1:20:13,  3.66it/s]
 95%|█████████▌| 353844/371472 [5:59:55<1:25:14,  3.45it/s]
 95%|█████████▌| 353845/371472 [5:59:55<1:27:57,  3.34it/s]
 95%|█████████▌| 353846/371472 [5:59:55<1:27:11,  3.37it/s]
 95%|█████████▌| 353847/371472 [5:59:56<1:24:12,  3.49it/s]
 95%|█████████▌| 353848/371472 [5:59:56<1:24:48,  3.46it/s]
 95%|█████████▌| 353849/371472 [5:59:56<1:27:00,  3.38it/s]
 95%|█████████▌| 353850/371472 [5:59:57<1:26:43,  3.39it/s]
 95%|█████████▌| 353851/371472 [5:59:57<1:23:21,  3.52it/s]
 95%|█████████▌| 353852/371472 [5:59:57<1:22:56,  3.54it/s]
 95%|█████████▌| 353853/371472 [5:59:57<1:20:05,  3.67it/s]
 95%|█████████▌| 353854/371472 [5:59:58<1:19:38,  3.69it/s]
 95%|█████████▌| 353855/371472 [5:59:58<1:18:38,  3.73it/s]
 95%|█████████▌| 353856/371472 [5:59:58<1:18:34,  3.74it/s]
 95%|█████████▌| 353857/371472 [5:59:58<1:19:26,  3.70it/s]
 95%|█████████▌| 353858/371472 [5:59:59<1:28:08,  3.33it/s]
 95%|█████████▌| 353859/371472 [5:59:59<1:25:45,  3.42it/s]
 95%|█████████▌| 353860/371472 [5:59:59<1:24:27,  3.48it/s]
                                                           
{'loss': 2.526, 'learning_rate': 1.4269322760671418e-07, 'epoch': 15.24}

 95%|█████████▌| 353860/371472 [5:59:59<1:24:27,  3.48it/s]
 95%|█████████▌| 353861/371472 [6:00:00<1:21:23,  3.61it/s]
 95%|█████████▌| 353862/371472 [6:00:00<1:20:22,  3.65it/s]
 95%|█████████▌| 353863/371472 [6:00:00<1:20:41,  3.64it/s]
 95%|█████████▌| 353864/371472 [6:00:00<1:21:26,  3.60it/s]
 95%|█████████▌| 353865/371472 [6:00:01<1:30:58,  3.23it/s]
 95%|█████████▌| 353866/371472 [6:00:01<1:26:53,  3.38it/s]
 95%|█████████▌| 353867/371472 [6:00:01<1:24:42,  3.46it/s]
 95%|█████████▌| 353868/371472 [6:00:02<1:28:35,  3.31it/s]
 95%|█████████▌| 353869/371472 [6:00:02<1:27:22,  3.36it/s]
 95%|█████████▌| 353870/371472 [6:00:02<1:26:15,  3.40it/s]
 95%|█████████▌| 353871/371472 [6:00:03<1:31:44,  3.20it/s]
 95%|█████████▌| 353872/371472 [6:00:03<1:26:25,  3.39it/s]
 95%|█████████▌| 353873/371472 [6:00:03<1:23:44,  3.50it/s]
 95%|█████████▌| 353874/371472 [6:00:03<1:22:16,  3.56it/s]
 95%|█████████▌| 353875/371472 [6:00:04<1:25:06,  3.45it/s]
 95%|█████████▌| 353876/371472 [6:00:04<1:22:22,  3.56it/s]
 95%|█████████▌| 353877/371472 [6:00:04<1:23:58,  3.49it/s]
 95%|█████████▌| 353878/371472 [6:00:05<1:23:19,  3.52it/s]
 95%|█████████▌| 353879/371472 [6:00:05<1:24:41,  3.46it/s]
 95%|█████████▌| 353880/371472 [6:00:05<1:25:10,  3.44it/s]
                                                           
{'loss': 2.6591, 'learning_rate': 1.4264474563123534e-07, 'epoch': 15.24}

 95%|█████████▌| 353880/371472 [6:00:05<1:25:10,  3.44it/s]
 95%|█████████▌| 353881/371472 [6:00:05<1:29:15,  3.28it/s]
 95%|█████████▌| 353882/371472 [6:00:06<1:26:56,  3.37it/s]
 95%|█████████▌| 353883/371472 [6:00:06<1:36:29,  3.04it/s]
 95%|█████████▌| 353884/371472 [6:00:06<1:34:21,  3.11it/s]
 95%|█████████▌| 353885/371472 [6:00:07<1:30:08,  3.25it/s]
 95%|█████████▌| 353886/371472 [6:00:07<1:25:42,  3.42it/s]
 95%|█████████▌| 353887/371472 [6:00:07<1:23:52,  3.49it/s]
 95%|█████████▌| 353888/371472 [6:00:08<1:23:23,  3.51it/s]
 95%|█████████▌| 353889/371472 [6:00:08<1:21:44,  3.58it/s]
 95%|█████████▌| 353890/371472 [6:00:08<1:20:45,  3.63it/s]
 95%|█████████▌| 353891/371472 [6:00:08<1:24:55,  3.45it/s]
 95%|█████████▌| 353892/371472 [6:00:09<1:29:50,  3.26it/s]
 95%|█████████▌| 353893/371472 [6:00:09<1:35:51,  3.06it/s]
 95%|█████████▌| 353894/371472 [6:00:09<1:27:39,  3.34it/s]
 95%|█████████▌| 353895/371472 [6:00:10<1:28:23,  3.31it/s]
 95%|█████████▌| 353896/371472 [6:00:10<1:24:08,  3.48it/s]
 95%|█████████▌| 353897/371472 [6:00:10<1:21:09,  3.61it/s]
 95%|█████████▌| 353898/371472 [6:00:10<1:20:47,  3.63it/s]
 95%|█████████▌| 353899/371472 [6:00:11<1:20:59,  3.62it/s]
 95%|█████████▌| 353900/371472 [6:00:11<1:25:03,  3.44it/s]
                                                           
{'loss': 2.5319, 'learning_rate': 1.425962636557564e-07, 'epoch': 15.24}

 95%|█████████▌| 353900/371472 [6:00:11<1:25:03,  3.44it/s]
 95%|█████████▌| 353901/371472 [6:00:11<1:22:53,  3.53it/s]
 95%|█████████▌| 353902/371472 [6:00:12<1:22:37,  3.54it/s]
 95%|█████████▌| 353903/371472 [6:00:12<1:28:47,  3.30it/s]
 95%|█████████▌| 353904/371472 [6:00:12<1:24:50,  3.45it/s]
 95%|█████████▌| 353905/371472 [6:00:12<1:22:18,  3.56it/s]
 95%|█████████▌| 353906/371472 [6:00:13<1:21:19,  3.60it/s]
 95%|█████████▌| 353907/371472 [6:00:13<1:18:50,  3.71it/s]
 95%|█████████▌| 353908/371472 [6:00:13<1:21:58,  3.57it/s]
 95%|█████████▌| 353909/371472 [6:00:14<1:18:05,  3.75it/s]
 95%|█████████▌| 353910/371472 [6:00:14<1:17:31,  3.78it/s]
 95%|█████████▌| 353911/371472 [6:00:14<1:16:39,  3.82it/s]
 95%|█████████▌| 353912/371472 [6:00:14<1:17:10,  3.79it/s]
 95%|█████████▌| 353913/371472 [6:00:15<1:18:06,  3.75it/s]
 95%|█████████▌| 353914/371472 [6:00:15<1:17:28,  3.78it/s]
 95%|█████████▌| 353915/371472 [6:00:15<1:17:08,  3.79it/s]
 95%|█████████▌| 353916/371472 [6:00:15<1:19:27,  3.68it/s]
 95%|█████████▌| 353917/371472 [6:00:16<1:25:02,  3.44it/s]
 95%|█████████▌| 353918/371472 [6:00:16<1:22:44,  3.54it/s]
 95%|█████████▌| 353919/371472 [6:00:16<1:21:28,  3.59it/s]
 95%|█████████▌| 353920/371472 [6:00:17<1:23:34,  3.50it/s]
                                                           
{'loss': 2.6817, 'learning_rate': 1.4254778168027756e-07, 'epoch': 15.24}

 95%|█████████▌| 353920/371472 [6:00:17<1:23:34,  3.50it/s]
 95%|█████████▌| 353921/371472 [6:00:17<1:20:54,  3.62it/s]
 95%|█████████▌| 353922/371472 [6:00:17<1:25:39,  3.42it/s]
 95%|█████████▌| 353923/371472 [6:00:17<1:28:25,  3.31it/s]
 95%|█████████▌| 353924/371472 [6:00:18<1:25:28,  3.42it/s]
 95%|█████████▌| 353925/371472 [6:00:18<1:32:07,  3.17it/s]
 95%|█████████▌| 353926/371472 [6:00:18<1:28:09,  3.32it/s]
 95%|█████████▌| 353927/371472 [6:00:19<1:28:25,  3.31it/s]
 95%|█████████▌| 353928/371472 [6:00:19<1:24:23,  3.46it/s]
 95%|█████████▌| 353929/371472 [6:00:19<1:21:45,  3.58it/s]
 95%|█████████▌| 353930/371472 [6:00:19<1:19:33,  3.67it/s]
 95%|█████████▌| 353931/371472 [6:00:20<1:23:25,  3.50it/s]
 95%|█████████▌| 353932/371472 [6:00:20<1:26:44,  3.37it/s]
 95%|█████████▌| 353933/371472 [6:00:20<1:25:50,  3.41it/s]
 95%|█████████▌| 353934/371472 [6:00:21<1:24:41,  3.45it/s]
 95%|█████████▌| 353935/371472 [6:00:21<1:27:21,  3.35it/s]
 95%|█████████▌| 353936/371472 [6:00:21<1:25:31,  3.42it/s]
 95%|█████████▌| 353937/371472 [6:00:22<1:21:36,  3.58it/s]
 95%|█████████▌| 353938/371472 [6:00:22<1:20:12,  3.64it/s]
 95%|█████████▌| 353939/371472 [6:00:22<1:28:00,  3.32it/s]
 95%|█████████▌| 353940/371472 [6:00:22<1:24:40,  3.45it/s]
                                                           
{'loss': 2.6248, 'learning_rate': 1.424992997047986e-07, 'epoch': 15.24}

 95%|█████████▌| 353940/371472 [6:00:22<1:24:40,  3.45it/s]
 95%|█████████▌| 353941/371472 [6:00:23<1:24:10,  3.47it/s]
 95%|█████████▌| 353942/371472 [6:00:23<1:22:34,  3.54it/s]
 95%|█████████▌| 353943/371472 [6:00:23<1:21:22,  3.59it/s]
 95%|█████████▌| 353944/371472 [6:00:23<1:19:03,  3.70it/s]
 95%|█████████▌| 353945/371472 [6:00:24<1:18:22,  3.73it/s]
 95%|█████████▌| 353946/371472 [6:00:24<1:18:57,  3.70it/s]
 95%|█████████▌| 353947/371472 [6:00:24<1:18:02,  3.74it/s]
 95%|█████████▌| 353948/371472 [6:00:25<1:17:49,  3.75it/s]
 95%|█████████▌| 353949/371472 [6:00:25<1:19:14,  3.69it/s]
 95%|█████████▌| 353950/371472 [6:00:25<1:18:33,  3.72it/s]
 95%|█████████▌| 353951/371472 [6:00:25<1:18:50,  3.70it/s]
 95%|█████████▌| 353952/371472 [6:00:26<1:17:53,  3.75it/s]
 95%|█████████▌| 353953/371472 [6:00:26<1:17:59,  3.74it/s]
 95%|█████████▌| 353954/371472 [6:00:26<1:19:17,  3.68it/s]
 95%|█████████▌| 353955/371472 [6:00:26<1:17:08,  3.78it/s]
 95%|█████████▌| 353956/371472 [6:00:27<1:22:59,  3.52it/s]
 95%|█████████▌| 353957/371472 [6:00:27<1:26:02,  3.39it/s]
 95%|█████████▌| 353958/371472 [6:00:27<1:24:54,  3.44it/s]
 95%|█████████▌| 353959/371472 [6:00:28<1:23:25,  3.50it/s]
 95%|█████████▌| 353960/371472 [6:00:28<1:21:01,  3.60it/s]
                                                           
{'loss': 2.6229, 'learning_rate': 1.4245081772931978e-07, 'epoch': 15.25}

 95%|█████████▌| 353960/371472 [6:00:28<1:21:01,  3.60it/s]
 95%|█████████▌| 353961/371472 [6:00:28<1:20:19,  3.63it/s]
 95%|█████████▌| 353962/371472 [6:00:28<1:24:15,  3.46it/s]
 95%|█████████▌| 353963/371472 [6:00:29<1:27:02,  3.35it/s]
 95%|█████████▌| 353964/371472 [6:00:29<1:25:55,  3.40it/s]
 95%|█████████▌| 353965/371472 [6:00:29<1:24:21,  3.46it/s]
 95%|█████████▌| 353966/371472 [6:00:30<1:21:47,  3.57it/s]
 95%|█████████▌| 353967/371472 [6:00:30<1:19:49,  3.66it/s]
 95%|█████████▌| 353968/371472 [6:00:30<1:19:01,  3.69it/s]
 95%|█████████▌| 353969/371472 [6:00:30<1:23:56,  3.48it/s]
 95%|█████████▌| 353970/371472 [6:00:31<1:24:55,  3.43it/s]
 95%|█████████▌| 353971/371472 [6:00:31<1:21:32,  3.58it/s]
 95%|█████████▌| 353972/371472 [6:00:31<1:19:47,  3.66it/s]
 95%|█████████▌| 353973/371472 [6:00:32<1:20:38,  3.62it/s]
 95%|█████████▌| 353974/371472 [6:00:32<1:20:52,  3.61it/s]
 95%|█████████▌| 353975/371472 [6:00:32<1:21:35,  3.57it/s]
 95%|█████████▌| 353976/371472 [6:00:32<1:21:45,  3.57it/s]
 95%|█████████▌| 353977/371472 [6:00:33<1:19:56,  3.65it/s]
 95%|█████████▌| 353978/371472 [6:00:33<1:22:12,  3.55it/s]
 95%|█████████▌| 353979/371472 [6:00:33<1:24:52,  3.44it/s]
 95%|█████████▌| 353980/371472 [6:00:34<1:21:01,  3.60it/s]
                                                           
{'loss': 2.5831, 'learning_rate': 1.4240233575384083e-07, 'epoch': 15.25}

 95%|█████████▌| 353980/371472 [6:00:34<1:21:01,  3.60it/s]
 95%|█████████▌| 353981/371472 [6:00:34<1:20:56,  3.60it/s]
 95%|█████████▌| 353982/371472 [6:00:34<1:22:54,  3.52it/s]
 95%|█████████▌| 353983/371472 [6:00:34<1:21:08,  3.59it/s]
 95%|█████████▌| 353984/371472 [6:00:35<1:22:05,  3.55it/s]
 95%|█████████▌| 353985/371472 [6:00:35<1:22:05,  3.55it/s]
 95%|█████████▌| 353986/371472 [6:00:35<1:23:08,  3.51it/s]
 95%|█████████▌| 353987/371472 [6:00:36<1:24:57,  3.43it/s]
 95%|█████████▌| 353988/371472 [6:00:36<1:22:04,  3.55it/s]
 95%|█████████▌| 353989/371472 [6:00:36<1:20:37,  3.61it/s]
 95%|█████████▌| 353990/371472 [6:00:36<1:20:27,  3.62it/s]
 95%|█████████▌| 353991/371472 [6:00:37<1:18:41,  3.70it/s]
 95%|█████████▌| 353992/371472 [6:00:37<1:17:01,  3.78it/s]
 95%|█████████▌| 353993/371472 [6:00:37<1:19:30,  3.66it/s]
 95%|█████████▌| 353994/371472 [6:00:37<1:24:57,  3.43it/s]
 95%|█████████▌| 353995/371472 [6:00:38<1:23:35,  3.48it/s]
 95%|█████████▌| 353996/371472 [6:00:38<1:24:03,  3.46it/s]
 95%|█████████▌| 353997/371472 [6:00:38<1:22:59,  3.51it/s]
 95%|█████████▌| 353998/371472 [6:00:39<1:24:13,  3.46it/s]
 95%|█████████▌| 353999/371472 [6:00:39<1:22:08,  3.55it/s]
 95%|█████████▌| 354000/371472 [6:00:39<1:21:44,  3.56it/s]
                                                           
{'loss': 2.7255, 'learning_rate': 1.4235385377836198e-07, 'epoch': 15.25}

 95%|█████████▌| 354000/371472 [6:00:39<1:21:44,  3.56it/s]
 95%|█████████▌| 354001/371472 [6:00:39<1:20:55,  3.60it/s]
 95%|█████████▌| 354002/371472 [6:00:40<1:19:22,  3.67it/s]
 95%|█████████▌| 354003/371472 [6:00:40<1:17:24,  3.76it/s]
 95%|█████████▌| 354004/371472 [6:00:40<1:31:39,  3.18it/s]
 95%|█████████▌| 354005/371472 [6:00:41<1:28:37,  3.28it/s]
 95%|█████████▌| 354006/371472 [6:00:41<1:25:14,  3.42it/s]
 95%|█████████▌| 354007/371472 [6:00:41<1:21:50,  3.56it/s]
 95%|█████████▌| 354008/371472 [6:00:41<1:22:01,  3.55it/s]
 95%|█████████▌| 354009/371472 [6:00:42<1:26:15,  3.37it/s]
 95%|█████████▌| 354010/371472 [6:00:42<1:25:14,  3.41it/s]
 95%|█████████▌| 354011/371472 [6:00:42<1:26:58,  3.35it/s]
 95%|█████████▌| 354012/371472 [6:00:43<1:22:48,  3.51it/s]
 95%|█████████▌| 354013/371472 [6:00:43<1:23:36,  3.48it/s]
 95%|█████████▌| 354014/371472 [6:00:43<1:21:18,  3.58it/s]
 95%|█████████▌| 354015/371472 [6:00:43<1:21:09,  3.59it/s]
 95%|█████████▌| 354016/371472 [6:00:44<1:22:59,  3.51it/s]
 95%|█████████▌| 354017/371472 [6:00:44<1:24:33,  3.44it/s]
 95%|█████████▌| 354018/371472 [6:00:44<1:20:41,  3.61it/s]
 95%|█████████▌| 354019/371472 [6:00:45<1:21:45,  3.56it/s]
 95%|█████████▌| 354020/371472 [6:00:45<1:21:03,  3.59it/s]
                                                           
{'loss': 2.5514, 'learning_rate': 1.4230537180288305e-07, 'epoch': 15.25}

 95%|█████████▌| 354020/371472 [6:00:45<1:21:03,  3.59it/s]
 95%|█████████▌| 354021/371472 [6:00:45<1:19:27,  3.66it/s]
 95%|█████████▌| 354022/371472 [6:00:45<1:16:48,  3.79it/s]
 95%|█████████▌| 354023/371472 [6:00:46<1:19:28,  3.66it/s]
 95%|█████████▌| 354024/371472 [6:00:46<1:18:07,  3.72it/s]
 95%|█████████▌| 354025/371472 [6:00:46<1:19:10,  3.67it/s]
 95%|█████████▌| 354026/371472 [6:00:46<1:17:53,  3.73it/s]
 95%|█████████▌| 354027/371472 [6:00:47<1:19:46,  3.64it/s]
 95%|█████████▌| 354028/371472 [6:00:47<1:23:17,  3.49it/s]
 95%|█████████▌| 354029/371472 [6:00:47<1:26:23,  3.37it/s]
 95%|█████████▌| 354030/371472 [6:00:48<1:24:33,  3.44it/s]
 95%|█████████▌| 354031/371472 [6:00:48<1:23:25,  3.48it/s]
 95%|█████████▌| 354032/371472 [6:00:48<1:20:35,  3.61it/s]
 95%|█████████▌| 354033/371472 [6:00:49<1:22:36,  3.52it/s]
 95%|█████████▌| 354034/371472 [6:00:49<1:21:32,  3.56it/s]
 95%|█████████▌| 354035/371472 [6:00:49<1:20:46,  3.60it/s]
 95%|█████████▌| 354036/371472 [6:00:49<1:24:03,  3.46it/s]
 95%|█████████▌| 354037/371472 [6:00:50<1:22:15,  3.53it/s]
 95%|█████████▌| 354038/371472 [6:00:50<1:21:53,  3.55it/s]
 95%|█████████▌| 354039/371472 [6:00:50<1:22:44,  3.51it/s]
 95%|█████████▌| 354040/371472 [6:00:50<1:21:58,  3.54it/s]
                                                           
{'loss': 2.7804, 'learning_rate': 1.422568898274042e-07, 'epoch': 15.25}

 95%|█████████▌| 354040/371472 [6:00:50<1:21:58,  3.54it/s]
 95%|█████████▌| 354041/371472 [6:00:51<1:21:39,  3.56it/s]
 95%|█████████▌| 354042/371472 [6:00:51<1:21:09,  3.58it/s]
 95%|█████████▌| 354043/371472 [6:00:51<1:19:36,  3.65it/s]
 95%|█████████▌| 354044/371472 [6:00:52<1:23:20,  3.49it/s]
 95%|█████████▌| 354045/371472 [6:00:52<1:19:54,  3.64it/s]
 95%|█████████▌| 354046/371472 [6:00:52<1:18:59,  3.68it/s]
 95%|█████████▌| 354047/371472 [6:00:52<1:23:45,  3.47it/s]
 95%|█████████▌| 354048/371472 [6:00:53<1:26:21,  3.36it/s]
 95%|█████████▌| 354049/371472 [6:00:53<1:25:36,  3.39it/s]
 95%|█████████▌| 354050/371472 [6:00:53<1:33:40,  3.10it/s]
 95%|█████████▌| 354051/371472 [6:00:54<1:31:18,  3.18it/s]
 95%|█████████▌| 354052/371472 [6:00:54<1:29:12,  3.25it/s]
 95%|█████████▌| 354053/371472 [6:00:54<1:23:15,  3.49it/s]
 95%|█████████▌| 354054/371472 [6:00:55<1:21:24,  3.57it/s]
 95%|█████████▌| 354055/371472 [6:00:55<1:19:20,  3.66it/s]
 95%|█████████▌| 354056/371472 [6:00:55<1:20:05,  3.62it/s]
 95%|█████████▌| 354057/371472 [6:00:55<1:19:21,  3.66it/s]
 95%|█████████▌| 354058/371472 [6:00:56<1:21:50,  3.55it/s]
 95%|█████████▌| 354059/371472 [6:00:56<1:18:41,  3.69it/s]
 95%|█████████▌| 354060/371472 [6:00:56<1:21:25,  3.56it/s]
                                                           
{'loss': 2.6442, 'learning_rate': 1.4220840785192527e-07, 'epoch': 15.25}

 95%|█████████▌| 354060/371472 [6:00:56<1:21:25,  3.56it/s]
 95%|█████████▌| 354061/371472 [6:00:57<1:27:57,  3.30it/s]
 95%|█████████▌| 354062/371472 [6:00:57<1:27:52,  3.30it/s]
 95%|█████████▌| 354063/371472 [6:00:57<1:30:08,  3.22it/s]
 95%|█████████▌| 354064/371472 [6:00:57<1:26:22,  3.36it/s]
 95%|█████████▌| 354065/371472 [6:00:58<1:23:48,  3.46it/s]
 95%|█████████▌| 354066/371472 [6:00:58<1:26:37,  3.35it/s]
 95%|█████████▌| 354067/371472 [6:00:58<1:27:18,  3.32it/s]
 95%|█████████▌| 354068/371472 [6:00:59<1:27:07,  3.33it/s]
 95%|█████████▌| 354069/371472 [6:00:59<1:24:58,  3.41it/s]
 95%|█████████▌| 354070/371472 [6:00:59<1:21:09,  3.57it/s]
 95%|█████████▌| 354071/371472 [6:00:59<1:20:05,  3.62it/s]
 95%|█████████▌| 354072/371472 [6:01:00<1:21:15,  3.57it/s]
 95%|█████████▌| 354073/371472 [6:01:00<1:20:26,  3.61it/s]
 95%|█████████▌| 354074/371472 [6:01:00<1:18:27,  3.70it/s]
 95%|█████████▌| 354075/371472 [6:01:01<1:18:49,  3.68it/s]
 95%|█████████▌| 354076/371472 [6:01:01<1:20:50,  3.59it/s]
 95%|█████████▌| 354077/371472 [6:01:01<1:19:01,  3.67it/s]
 95%|█████████▌| 354078/371472 [6:01:01<1:16:33,  3.79it/s]
 95%|█████████▌| 354079/371472 [6:01:02<1:20:02,  3.62it/s]
 95%|█████████▌| 354080/371472 [6:01:02<1:20:30,  3.60it/s]
                                                           
{'loss': 2.4991, 'learning_rate': 1.4215992587644642e-07, 'epoch': 15.25}

 95%|█████████▌| 354080/371472 [6:01:02<1:20:30,  3.60it/s]
 95%|█████████▌| 354081/371472 [6:01:02<1:18:02,  3.71it/s]
 95%|█████████▌| 354082/371472 [6:01:02<1:21:55,  3.54it/s]
 95%|█████████▌| 354083/371472 [6:01:03<1:21:22,  3.56it/s]
 95%|█████████▌| 354084/371472 [6:01:03<1:25:49,  3.38it/s]
 95%|█████████▌| 354085/371472 [6:01:03<1:28:14,  3.28it/s]
 95%|█████████▌| 354086/371472 [6:01:04<1:29:07,  3.25it/s]
 95%|█████████▌| 354087/371472 [6:01:04<1:26:49,  3.34it/s]
 95%|█████████▌| 354088/371472 [6:01:04<1:29:19,  3.24it/s]
 95%|█████████▌| 354089/371472 [6:01:05<1:25:42,  3.38it/s]
 95%|█████████▌| 354090/371472 [6:01:05<1:26:51,  3.34it/s]
 95%|█████████▌| 354091/371472 [6:01:05<1:23:37,  3.46it/s]
 95%|█████████▌| 354092/371472 [6:01:06<1:39:12,  2.92it/s]
 95%|█████████▌| 354093/371472 [6:01:06<1:36:48,  2.99it/s]
 95%|█████████▌| 354094/371472 [6:01:06<1:32:42,  3.12it/s]
 95%|█████████▌| 354095/371472 [6:01:07<1:26:39,  3.34it/s]
 95%|█████████▌| 354096/371472 [6:01:07<1:22:33,  3.51it/s]
 95%|█████████▌| 354097/371472 [6:01:07<1:26:41,  3.34it/s]
 95%|█████████▌| 354098/371472 [6:01:07<1:25:43,  3.38it/s]
 95%|█████████▌| 354099/371472 [6:01:08<1:24:56,  3.41it/s]
 95%|█████████▌| 354100/371472 [6:01:08<1:24:33,  3.42it/s]
                                                           
{'loss': 2.5911, 'learning_rate': 1.421114439009675e-07, 'epoch': 15.25}

 95%|█████████▌| 354100/371472 [6:01:08<1:24:33,  3.42it/s]
 95%|█████████▌| 354101/371472 [6:01:08<1:27:22,  3.31it/s]
 95%|█████████▌| 354102/371472 [6:01:09<1:23:20,  3.47it/s]
 95%|█████████▌| 354103/371472 [6:01:09<1:23:07,  3.48it/s]
 95%|█████████▌| 354104/371472 [6:01:09<1:21:25,  3.55it/s]
 95%|█████████▌| 354105/371472 [6:01:09<1:26:07,  3.36it/s]
 95%|█████████▌| 354106/371472 [6:01:10<1:24:57,  3.41it/s]
 95%|█████████▌| 354107/371472 [6:01:10<1:24:12,  3.44it/s]
 95%|█████████▌| 354108/371472 [6:01:10<1:21:29,  3.55it/s]
 95%|█████████▌| 354109/371472 [6:01:11<1:21:55,  3.53it/s]
 95%|█████████▌| 354110/371472 [6:01:11<1:22:28,  3.51it/s]
 95%|█████████▌| 354111/371472 [6:01:11<1:21:43,  3.54it/s]
 95%|█████████▌| 354112/371472 [6:01:11<1:19:58,  3.62it/s]
 95%|█████████▌| 354113/371472 [6:01:12<1:19:53,  3.62it/s]
 95%|█████████▌| 354114/371472 [6:01:12<1:18:57,  3.66it/s]
 95%|█████████▌| 354115/371472 [6:01:12<1:19:09,  3.65it/s]
 95%|█████████▌| 354116/371472 [6:01:12<1:21:16,  3.56it/s]
 95%|█████████▌| 354117/371472 [6:01:13<1:25:09,  3.40it/s]
 95%|█████████▌| 354118/371472 [6:01:13<1:23:40,  3.46it/s]
 95%|█████████▌| 354119/371472 [6:01:13<1:29:20,  3.24it/s]
 95%|█████████▌| 354120/371472 [6:01:14<1:31:12,  3.17it/s]
                                                           
{'loss': 2.5611, 'learning_rate': 1.4206296192548864e-07, 'epoch': 15.25}

 95%|█████████▌| 354120/371472 [6:01:14<1:31:12,  3.17it/s]
 95%|█████████▌| 354121/371472 [6:01:14<1:26:28,  3.34it/s]
 95%|█████████▌| 354122/371472 [6:01:14<1:22:49,  3.49it/s]
 95%|█████████▌| 354123/371472 [6:01:15<1:19:42,  3.63it/s]
 95%|█████████▌| 354124/371472 [6:01:15<1:23:09,  3.48it/s]
 95%|█████████▌| 354125/371472 [6:01:15<1:22:06,  3.52it/s]
 95%|█████████▌| 354126/371472 [6:01:15<1:26:17,  3.35it/s]
 95%|█████████▌| 354127/371472 [6:01:16<1:26:48,  3.33it/s]
 95%|█████████▌| 354128/371472 [6:01:16<1:25:04,  3.40it/s]
 95%|█████████▌| 354129/371472 [6:01:16<1:29:29,  3.23it/s]
 95%|█████████▌| 354130/371472 [6:01:17<1:25:32,  3.38it/s]
 95%|█████████▌| 354131/371472 [6:01:17<1:22:50,  3.49it/s]
 95%|█████████▌| 354132/371472 [6:01:17<1:22:56,  3.48it/s]
 95%|█████████▌| 354133/371472 [6:01:17<1:21:45,  3.53it/s]
 95%|█████████▌| 354134/371472 [6:01:18<1:18:48,  3.67it/s]
 95%|█████████▌| 354135/371472 [6:01:18<1:17:05,  3.75it/s]
 95%|█████████▌| 354136/371472 [6:01:18<1:18:31,  3.68it/s]
 95%|█████████▌| 354137/371472 [6:01:19<1:18:14,  3.69it/s]
 95%|█████████▌| 354138/371472 [6:01:19<1:20:37,  3.58it/s]
 95%|█████████▌| 354139/371472 [6:01:19<1:19:10,  3.65it/s]
 95%|█████████▌| 354140/371472 [6:01:19<1:21:52,  3.53it/s]
                                                           
{'loss': 2.5594, 'learning_rate': 1.4201447995000966e-07, 'epoch': 15.25}

 95%|█████████▌| 354140/371472 [6:01:19<1:21:52,  3.53it/s]
 95%|█████████▌| 354141/371472 [6:01:20<1:24:58,  3.40it/s]
 95%|█████████▌| 354142/371472 [6:01:20<1:22:47,  3.49it/s]
 95%|█████████▌| 354143/371472 [6:01:20<1:21:30,  3.54it/s]
 95%|█████████▌| 354144/371472 [6:01:21<1:19:14,  3.64it/s]
 95%|█████████▌| 354145/371472 [6:01:21<1:18:47,  3.67it/s]
 95%|█████████▌| 354146/371472 [6:01:21<1:18:44,  3.67it/s]
 95%|█████████▌| 354147/371472 [6:01:21<1:18:09,  3.69it/s]
 95%|█████████▌| 354148/371472 [6:01:22<1:16:06,  3.79it/s]
 95%|█████████▌| 354149/371472 [6:01:22<1:17:37,  3.72it/s]
 95%|█████████▌| 354150/371472 [6:01:22<1:19:27,  3.63it/s]
 95%|█████████▌| 354151/371472 [6:01:23<1:30:52,  3.18it/s]
 95%|█████████▌| 354152/371472 [6:01:23<1:30:01,  3.21it/s]
 95%|█████████▌| 354153/371472 [6:01:23<1:30:54,  3.18it/s]
 95%|█████████▌| 354154/371472 [6:01:23<1:25:39,  3.37it/s]
 95%|█████████▌| 354155/371472 [6:01:24<1:24:13,  3.43it/s]
 95%|█████████▌| 354156/371472 [6:01:24<1:22:02,  3.52it/s]
 95%|█████████▌| 354157/371472 [6:01:24<1:19:47,  3.62it/s]
 95%|█████████▌| 354158/371472 [6:01:24<1:17:02,  3.75it/s]
 95%|█████████▌| 354159/371472 [6:01:25<1:14:48,  3.86it/s]
 95%|█████████▌| 354160/371472 [6:01:25<1:16:13,  3.79it/s]
                                                           
{'loss': 2.5811, 'learning_rate': 1.4196599797453076e-07, 'epoch': 15.25}

 95%|█████████▌| 354160/371472 [6:01:25<1:16:13,  3.79it/s]
 95%|█████████▌| 354161/371472 [6:01:25<1:16:00,  3.80it/s]
 95%|█████████▌| 354162/371472 [6:01:26<1:20:50,  3.57it/s]
 95%|█████████▌| 354163/371472 [6:01:26<1:19:02,  3.65it/s]
 95%|█████████▌| 354164/371472 [6:01:26<1:18:52,  3.66it/s]
 95%|█████████▌| 354165/371472 [6:01:26<1:21:41,  3.53it/s]
 95%|█████████▌| 354166/371472 [6:01:27<1:25:12,  3.38it/s]
 95%|█████████▌| 354167/371472 [6:01:27<1:25:44,  3.36it/s]
 95%|█████████▌| 354168/371472 [6:01:27<1:23:41,  3.45it/s]
 95%|█████████▌| 354169/371472 [6:01:28<1:23:17,  3.46it/s]
 95%|█████████▌| 354170/371472 [6:01:28<1:28:21,  3.26it/s]
 95%|█████████▌| 354171/371472 [6:01:28<1:25:01,  3.39it/s]
 95%|█████████▌| 354172/371472 [6:01:28<1:23:35,  3.45it/s]
 95%|█████████▌| 354173/371472 [6:01:29<1:22:03,  3.51it/s]
 95%|█████████▌| 354174/371472 [6:01:29<1:22:58,  3.47it/s]
 95%|█████████▌| 354175/371472 [6:01:29<1:21:36,  3.53it/s]
 95%|█████████▌| 354176/371472 [6:01:30<1:20:28,  3.58it/s]
 95%|█████████▌| 354177/371472 [6:01:30<1:18:07,  3.69it/s]
 95%|█████████▌| 354178/371472 [6:01:30<1:16:22,  3.77it/s]
 95%|█████████▌| 354179/371472 [6:01:30<1:20:35,  3.58it/s]
 95%|█████████▌| 354180/371472 [6:01:31<1:21:16,  3.55it/s]
                                                           
{'loss': 2.7166, 'learning_rate': 1.419175159990519e-07, 'epoch': 15.26}

 95%|█████████▌| 354180/371472 [6:01:31<1:21:16,  3.55it/s]
 95%|█████████▌| 354181/371472 [6:01:31<1:23:13,  3.46it/s]
 95%|█████████▌| 354182/371472 [6:01:31<1:29:59,  3.20it/s]
 95%|█████████▌| 354183/371472 [6:01:32<1:26:40,  3.32it/s]
 95%|█████████▌| 354184/371472 [6:01:32<1:26:28,  3.33it/s]
 95%|█████████▌| 354185/371472 [6:01:32<1:23:37,  3.45it/s]
 95%|█████████▌| 354186/371472 [6:01:33<1:24:58,  3.39it/s]
 95%|█████████▌| 354187/371472 [6:01:33<1:30:05,  3.20it/s]
 95%|█████████▌| 354188/371472 [6:01:33<1:26:16,  3.34it/s]
 95%|█████████▌| 354189/371472 [6:01:33<1:23:55,  3.43it/s]
 95%|█████████▌| 354190/371472 [6:01:34<1:26:59,  3.31it/s]
 95%|█████████▌| 354191/371472 [6:01:34<1:24:27,  3.41it/s]
 95%|█████████▌| 354192/371472 [6:01:34<1:24:52,  3.39it/s]
 95%|█████████▌| 354193/371472 [6:01:35<1:27:58,  3.27it/s]
 95%|█████████▌| 354194/371472 [6:01:35<1:28:26,  3.26it/s]
 95%|█████████▌| 354195/371472 [6:01:35<1:25:03,  3.39it/s]
 95%|█████████▌| 354196/371472 [6:01:35<1:22:17,  3.50it/s]
 95%|█████████▌| 354197/371472 [6:01:36<1:22:30,  3.49it/s]
 95%|█████████▌| 354198/371472 [6:01:36<1:25:15,  3.38it/s]
 95%|█████████▌| 354199/371472 [6:01:36<1:22:34,  3.49it/s]
 95%|█████████▌| 354200/371472 [6:01:37<1:21:11,  3.55it/s]
                                                           
{'loss': 2.7085, 'learning_rate': 1.4186903402357296e-07, 'epoch': 15.26}

 95%|█████████▌| 354200/371472 [6:01:37<1:21:11,  3.55it/s]
 95%|█████████▌| 354201/371472 [6:01:37<1:19:02,  3.64it/s]
 95%|█████████▌| 354202/371472 [6:01:37<1:23:29,  3.45it/s]
 95%|█████████▌| 354203/371472 [6:01:37<1:22:48,  3.48it/s]
 95%|█████████▌| 354204/371472 [6:01:38<1:21:05,  3.55it/s]
 95%|█████████▌| 354205/371472 [6:01:38<1:18:00,  3.69it/s]
 95%|█████████▌| 354206/371472 [6:01:38<1:17:03,  3.73it/s]
 95%|█████████▌| 354207/371472 [6:01:39<1:18:44,  3.65it/s]
 95%|█████████▌| 354208/371472 [6:01:39<1:21:47,  3.52it/s]
 95%|█████████▌| 354209/371472 [6:01:39<1:22:57,  3.47it/s]
 95%|█████████▌| 354210/371472 [6:01:39<1:19:46,  3.61it/s]
 95%|█████████▌| 354211/371472 [6:01:40<1:17:47,  3.70it/s]
 95%|█████████▌| 354212/371472 [6:01:40<1:17:51,  3.69it/s]
 95%|█████████▌| 354213/371472 [6:01:40<1:17:33,  3.71it/s]
 95%|█████████▌| 354214/371472 [6:01:41<1:24:37,  3.40it/s]
 95%|█████████▌| 354215/371472 [6:01:41<1:22:59,  3.47it/s]
 95%|█████████▌| 354216/371472 [6:01:41<1:26:45,  3.31it/s]
 95%|█████████▌| 354217/371472 [6:01:41<1:24:01,  3.42it/s]
 95%|█████████▌| 354218/371472 [6:01:42<1:23:39,  3.44it/s]
 95%|█████████▌| 354219/371472 [6:01:42<1:21:15,  3.54it/s]
 95%|█████████▌| 354220/371472 [6:01:42<1:29:29,  3.21it/s]
                                                           
{'loss': 2.4786, 'learning_rate': 1.4182055204809413e-07, 'epoch': 15.26}

 95%|█████████▌| 354220/371472 [6:01:42<1:29:29,  3.21it/s]
 95%|█████████▌| 354221/371472 [6:01:43<1:25:45,  3.35it/s]
 95%|█████████▌| 354222/371472 [6:01:43<1:25:13,  3.37it/s]
 95%|█████████▌| 354223/371472 [6:01:43<1:21:08,  3.54it/s]
 95%|█████████▌| 354224/371472 [6:01:43<1:21:08,  3.54it/s]
 95%|█████████▌| 354225/371472 [6:01:44<1:19:34,  3.61it/s]
 95%|█████████▌| 354226/371472 [6:01:44<1:22:13,  3.50it/s]
 95%|█████████▌| 354227/371472 [6:01:44<1:20:06,  3.59it/s]
 95%|█████████▌| 354228/371472 [6:01:45<1:18:16,  3.67it/s]
 95%|█████████▌| 354229/371472 [6:01:45<1:15:20,  3.81it/s]
 95%|█████████▌| 354230/371472 [6:01:45<1:19:22,  3.62it/s]
 95%|█████████▌| 354231/371472 [6:01:45<1:18:42,  3.65it/s]
 95%|█████████▌| 354232/371472 [6:01:46<1:17:23,  3.71it/s]
 95%|█████████▌| 354233/371472 [6:01:46<1:23:18,  3.45it/s]
 95%|█████████▌| 354234/371472 [6:01:46<1:26:43,  3.31it/s]
 95%|█████████▌| 354235/371472 [6:01:47<1:22:23,  3.49it/s]
 95%|█████████▌| 354236/371472 [6:01:47<1:23:04,  3.46it/s]
 95%|█████████▌| 354237/371472 [6:01:47<1:23:40,  3.43it/s]
 95%|█████████▌| 354238/371472 [6:01:47<1:20:38,  3.56it/s]
 95%|█████████▌| 354239/371472 [6:01:48<1:18:20,  3.67it/s]
 95%|█████████▌| 354240/371472 [6:01:48<1:19:00,  3.63it/s]
                                                           
{'loss': 2.6354, 'learning_rate': 1.4177207007261518e-07, 'epoch': 15.26}

 95%|█████████▌| 354240/371472 [6:01:48<1:19:00,  3.63it/s]
 95%|█████████▌| 354241/371472 [6:01:48<1:18:24,  3.66it/s]
 95%|█████████▌| 354242/371472 [6:01:48<1:18:49,  3.64it/s]
 95%|█████████▌| 354243/371472 [6:01:49<1:20:49,  3.55it/s]
 95%|█████████▌| 354244/371472 [6:01:49<1:19:36,  3.61it/s]
 95%|█████████▌| 354245/371472 [6:01:49<1:19:39,  3.60it/s]
 95%|█████████▌| 354246/371472 [6:01:50<1:30:03,  3.19it/s]
 95%|█████████▌| 354247/371472 [6:01:50<1:27:34,  3.28it/s]
 95%|█████████▌| 354248/371472 [6:01:50<1:24:20,  3.40it/s]
 95%|█████████▌| 354249/371472 [6:01:51<1:20:54,  3.55it/s]
 95%|█████████▌| 354250/371472 [6:01:51<1:37:31,  2.94it/s]
 95%|█████████▌| 354251/371472 [6:01:51<1:30:13,  3.18it/s]
 95%|█████████▌| 354252/371472 [6:01:52<1:28:28,  3.24it/s]
 95%|█████████▌| 354253/371472 [6:01:52<1:24:02,  3.41it/s]
 95%|█████████▌| 354254/371472 [6:01:52<1:21:54,  3.50it/s]
 95%|█████████▌| 354255/371472 [6:01:52<1:23:56,  3.42it/s]
 95%|█████████▌| 354256/371472 [6:01:53<1:25:40,  3.35it/s]
 95%|█████████▌| 354257/371472 [6:01:53<1:23:31,  3.44it/s]
 95%|█████████▌| 354258/371472 [6:01:53<1:27:22,  3.28it/s]
 95%|█████████▌| 354259/371472 [6:01:54<1:26:32,  3.32it/s]
 95%|█████████▌| 354260/371472 [6:01:54<1:24:54,  3.38it/s]
                                                           
{'loss': 2.5064, 'learning_rate': 1.4172358809713633e-07, 'epoch': 15.26}

 95%|█████████▌| 354260/371472 [6:01:54<1:24:54,  3.38it/s]
 95%|█████████▌| 354261/371472 [6:01:54<1:21:29,  3.52it/s]
 95%|█████████▌| 354262/371472 [6:01:54<1:21:44,  3.51it/s]
 95%|█████████▌| 354263/371472 [6:01:55<1:22:16,  3.49it/s]
 95%|█████████▌| 354264/371472 [6:01:55<1:33:55,  3.05it/s]
 95%|█████████▌| 354265/371472 [6:01:55<1:28:05,  3.26it/s]
 95%|█████████▌| 354266/371472 [6:01:56<1:24:24,  3.40it/s]
 95%|█████████▌| 354267/371472 [6:01:56<1:25:23,  3.36it/s]
 95%|█████████▌| 354268/371472 [6:01:56<1:24:44,  3.38it/s]
 95%|█████████▌| 354269/371472 [6:01:57<1:29:21,  3.21it/s]
 95%|█████████▌| 354270/371472 [6:01:57<1:26:14,  3.32it/s]
 95%|█████████▌| 354271/371472 [6:01:57<1:22:19,  3.48it/s]
 95%|█████████▌| 354272/371472 [6:01:57<1:22:52,  3.46it/s]
 95%|█████████▌| 354273/371472 [6:01:58<1:22:11,  3.49it/s]
 95%|█████████▌| 354274/371472 [6:01:58<1:19:43,  3.60it/s]
 95%|█████████▌| 354275/371472 [6:01:58<1:20:38,  3.55it/s]
 95%|█████████▌| 354276/371472 [6:01:59<1:20:19,  3.57it/s]
 95%|█████████▌| 354277/371472 [6:01:59<1:28:18,  3.25it/s]
 95%|█████████▌| 354278/371472 [6:01:59<1:27:43,  3.27it/s]
 95%|█████████▌| 354279/371472 [6:01:59<1:24:49,  3.38it/s]
 95%|█████████▌| 354280/371472 [6:02:00<1:20:32,  3.56it/s]
                                                           
{'loss': 2.5734, 'learning_rate': 1.416751061216574e-07, 'epoch': 15.26}

 95%|█████████▌| 354280/371472 [6:02:00<1:20:32,  3.56it/s]
 95%|█████████▌| 354281/371472 [6:02:00<1:21:36,  3.51it/s]
 95%|█████████▌| 354282/371472 [6:02:00<1:23:08,  3.45it/s]
 95%|█████████▌| 354283/371472 [6:02:01<1:27:02,  3.29it/s]
 95%|█████████▌| 354284/371472 [6:02:01<1:25:48,  3.34it/s]
 95%|█████████▌| 354285/371472 [6:02:01<1:23:33,  3.43it/s]
 95%|█████████▌| 354286/371472 [6:02:02<1:23:17,  3.44it/s]
 95%|█████████▌| 354287/371472 [6:02:02<1:21:15,  3.52it/s]
 95%|█████████▌| 354288/371472 [6:02:02<1:21:19,  3.52it/s]
 95%|█████████▌| 354289/371472 [6:02:02<1:28:32,  3.23it/s]
 95%|█████████▌| 354290/371472 [6:02:03<1:27:15,  3.28it/s]
 95%|█████████▌| 354291/371472 [6:02:03<1:27:49,  3.26it/s]
 95%|█████████▌| 354292/371472 [6:02:04<1:41:42,  2.82it/s]
 95%|█████████▌| 354293/371472 [6:02:04<1:39:18,  2.88it/s]
 95%|█████████▌| 354294/371472 [6:02:04<1:32:42,  3.09it/s]
 95%|█████████▌| 354295/371472 [6:02:04<1:28:37,  3.23it/s]
 95%|█████████▌| 354296/371472 [6:02:05<1:24:15,  3.40it/s]
 95%|█████████▌| 354297/371472 [6:02:05<1:22:09,  3.48it/s]
 95%|█████████▌| 354298/371472 [6:02:05<1:22:41,  3.46it/s]
 95%|█████████▌| 354299/371472 [6:02:06<1:26:44,  3.30it/s]
 95%|█████████▌| 354300/371472 [6:02:06<1:22:21,  3.48it/s]
                                                           
{'loss': 2.5081, 'learning_rate': 1.4162662414617855e-07, 'epoch': 15.26}

 95%|█████████▌| 354300/371472 [6:02:06<1:22:21,  3.48it/s]
 95%|█████████▌| 354301/371472 [6:02:06<1:21:36,  3.51it/s]
 95%|█████████▌| 354302/371472 [6:02:06<1:19:08,  3.62it/s]
 95%|█████████▌| 354303/371472 [6:02:07<1:19:34,  3.60it/s]
 95%|█████████▌| 354304/371472 [6:02:07<1:22:23,  3.47it/s]
 95%|█████████▌| 354305/371472 [6:02:07<1:22:07,  3.48it/s]
 95%|█████████▌| 354306/371472 [6:02:07<1:22:08,  3.48it/s]
 95%|█████████▌| 354307/371472 [6:02:08<1:22:04,  3.49it/s]
 95%|█████████▌| 354308/371472 [6:02:08<1:21:19,  3.52it/s]
 95%|█████████▌| 354309/371472 [6:02:08<1:18:12,  3.66it/s]
 95%|█████████▌| 354310/371472 [6:02:09<1:16:54,  3.72it/s]
 95%|█████████▌| 354311/371472 [6:02:09<1:17:02,  3.71it/s]
 95%|█████████▌| 354312/371472 [6:02:09<1:20:40,  3.54it/s]
 95%|█████████▌| 354313/371472 [6:02:09<1:22:25,  3.47it/s]
 95%|█████████▌| 354314/371472 [6:02:10<1:22:45,  3.46it/s]
 95%|█████████▌| 354315/371472 [6:02:10<1:19:17,  3.61it/s]
 95%|█████████▌| 354316/371472 [6:02:10<1:18:55,  3.62it/s]
 95%|█████████▌| 354317/371472 [6:02:11<1:17:53,  3.67it/s]
 95%|█████████▌| 354318/371472 [6:02:11<1:16:32,  3.74it/s]
 95%|█████████▌| 354319/371472 [6:02:11<1:23:11,  3.44it/s]
 95%|█████████▌| 354320/371472 [6:02:11<1:24:04,  3.40it/s]
                                                           
{'loss': 2.604, 'learning_rate': 1.415781421706996e-07, 'epoch': 15.26}

 95%|█████████▌| 354320/371472 [6:02:11<1:24:04,  3.40it/s]
 95%|█████████▌| 354321/371472 [6:02:12<1:24:43,  3.37it/s]
 95%|█████████▌| 354322/371472 [6:02:12<1:22:24,  3.47it/s]
 95%|█████████▌| 354323/371472 [6:02:12<1:23:18,  3.43it/s]
 95%|█████████▌| 354324/371472 [6:02:13<1:20:32,  3.55it/s]
 95%|█████████▌| 354325/371472 [6:02:13<1:17:34,  3.68it/s]
 95%|█████████▌| 354326/371472 [6:02:13<1:16:51,  3.72it/s]
 95%|█████████▌| 354327/371472 [6:02:13<1:17:24,  3.69it/s]
 95%|█████████▌| 354328/371472 [6:02:14<1:18:00,  3.66it/s]
 95%|█████████▌| 354329/371472 [6:02:14<1:16:13,  3.75it/s]
 95%|█████████▌| 354330/371472 [6:02:14<1:17:55,  3.67it/s]
 95%|█████████▌| 354331/371472 [6:02:14<1:18:42,  3.63it/s]
 95%|█████████▌| 354332/371472 [6:02:15<1:17:22,  3.69it/s]
 95%|█████████▌| 354333/371472 [6:02:15<1:18:11,  3.65it/s]
 95%|█████████▌| 354334/371472 [6:02:15<1:17:16,  3.70it/s]
 95%|█████████▌| 354335/371472 [6:02:16<1:17:20,  3.69it/s]
 95%|█████████▌| 354336/371472 [6:02:16<1:14:23,  3.84it/s]
 95%|█████████▌| 354337/371472 [6:02:16<1:25:54,  3.32it/s]
 95%|█████████▌| 354338/371472 [6:02:16<1:21:30,  3.50it/s]
 95%|█████████▌| 354339/371472 [6:02:17<1:21:25,  3.51it/s]
 95%|█████████▌| 354340/371472 [6:02:17<1:19:17,  3.60it/s]
                                                           
{'loss': 2.4917, 'learning_rate': 1.4152966019522077e-07, 'epoch': 15.26}

 95%|█████████▌| 354340/371472 [6:02:17<1:19:17,  3.60it/s]
 95%|█████████▌| 354341/371472 [6:02:17<1:18:22,  3.64it/s]
 95%|█████████▌| 354342/371472 [6:02:17<1:18:03,  3.66it/s]
 95%|█████████▌| 354343/371472 [6:02:18<1:21:34,  3.50it/s]
 95%|█████████▌| 354344/371472 [6:02:18<1:17:48,  3.67it/s]
 95%|█████████▌| 354345/371472 [6:02:18<1:16:42,  3.72it/s]
 95%|█████████▌| 354346/371472 [6:02:19<1:23:54,  3.40it/s]
 95%|█████████▌| 354347/371472 [6:02:19<1:23:31,  3.42it/s]
 95%|█████████▌| 354348/371472 [6:02:19<1:20:15,  3.56it/s]
 95%|█████████▌| 354349/371472 [6:02:19<1:21:39,  3.49it/s]
 95%|█████████▌| 354350/371472 [6:02:20<1:27:19,  3.27it/s]
 95%|█████████▌| 354351/371472 [6:02:20<1:35:13,  3.00it/s]
 95%|█████████▌| 354352/371472 [6:02:21<1:29:21,  3.19it/s]
 95%|█████████▌| 354353/371472 [6:02:21<1:24:26,  3.38it/s]
 95%|█████████▌| 354354/371472 [6:02:21<1:22:00,  3.48it/s]
 95%|█████████▌| 354355/371472 [6:02:21<1:20:48,  3.53it/s]
 95%|█████████▌| 354356/371472 [6:02:22<1:18:23,  3.64it/s]
 95%|█████████▌| 354357/371472 [6:02:22<1:20:39,  3.54it/s]
 95%|█████████▌| 354358/371472 [6:02:22<1:17:16,  3.69it/s]
 95%|█████████▌| 354359/371472 [6:02:22<1:18:27,  3.64it/s]
 95%|█████████▌| 354360/371472 [6:02:23<1:17:15,  3.69it/s]
                                                           
{'loss': 2.6963, 'learning_rate': 1.4148117821974182e-07, 'epoch': 15.26}

 95%|█████████▌| 354360/371472 [6:02:23<1:17:15,  3.69it/s]
 95%|█████████▌| 354361/371472 [6:02:23<1:17:15,  3.69it/s]
 95%|█████████▌| 354362/371472 [6:02:23<1:16:29,  3.73it/s]
 95%|█████████▌| 354363/371472 [6:02:23<1:15:24,  3.78it/s]
 95%|█████████▌| 354364/371472 [6:02:24<1:22:49,  3.44it/s]
 95%|█████████▌| 354365/371472 [6:02:24<1:21:21,  3.50it/s]
 95%|█████████▌| 354366/371472 [6:02:24<1:18:34,  3.63it/s]
 95%|█████████▌| 354367/371472 [6:02:25<1:21:29,  3.50it/s]
 95%|█████████▌| 354368/371472 [6:02:25<1:25:01,  3.35it/s]
 95%|█████████▌| 354369/371472 [6:02:25<1:22:05,  3.47it/s]
 95%|█████████▌| 354370/371472 [6:02:26<1:22:28,  3.46it/s]
 95%|█████████▌| 354371/371472 [6:02:26<1:27:02,  3.27it/s]
 95%|█████████▌| 354372/371472 [6:02:26<1:23:44,  3.40it/s]
 95%|█████████▌| 354373/371472 [6:02:26<1:21:21,  3.50it/s]
 95%|█████████▌| 354374/371472 [6:02:27<1:22:13,  3.47it/s]
 95%|█████████▌| 354375/371472 [6:02:27<1:20:07,  3.56it/s]
 95%|█████████▌| 354376/371472 [6:02:27<1:22:00,  3.47it/s]
 95%|█████████▌| 354377/371472 [6:02:28<1:23:13,  3.42it/s]
 95%|█████████▌| 354378/371472 [6:02:28<1:24:43,  3.36it/s]
 95%|█████████▌| 354379/371472 [6:02:28<1:28:51,  3.21it/s]
 95%|█████████▌| 354380/371472 [6:02:28<1:26:52,  3.28it/s]
                                                           
{'loss': 2.4483, 'learning_rate': 1.4143269624426297e-07, 'epoch': 15.26}

 95%|█████████▌| 354380/371472 [6:02:28<1:26:52,  3.28it/s]
 95%|█████████▌| 354381/371472 [6:02:29<1:23:35,  3.41it/s]
 95%|█████████▌| 354382/371472 [6:02:29<1:18:28,  3.63it/s]
 95%|█████████▌| 354383/371472 [6:02:29<1:16:44,  3.71it/s]
 95%|█████████▌| 354384/371472 [6:02:30<1:15:36,  3.77it/s]
 95%|█████████▌| 354385/371472 [6:02:30<1:18:12,  3.64it/s]
 95%|█████████▌| 354386/371472 [6:02:30<1:18:20,  3.64it/s]
 95%|█████████▌| 354387/371472 [6:02:30<1:17:35,  3.67it/s]
 95%|█████████▌| 354388/371472 [6:02:31<1:16:50,  3.71it/s]
 95%|█████████▌| 354389/371472 [6:02:31<1:17:31,  3.67it/s]
 95%|█████████▌| 354390/371472 [6:02:31<1:15:32,  3.77it/s]
 95%|█████████▌| 354391/371472 [6:02:31<1:18:09,  3.64it/s]
 95%|█████████▌| 354392/371472 [6:02:32<1:15:13,  3.78it/s]
 95%|█████████▌| 354393/371472 [6:02:32<1:15:57,  3.75it/s]
 95%|█████████▌| 354394/371472 [6:02:32<1:13:21,  3.88it/s]
 95%|█████████▌| 354395/371472 [6:02:32<1:13:39,  3.86it/s]
 95%|█████████▌| 354396/371472 [6:02:33<1:14:34,  3.82it/s]
 95%|█████████▌| 354397/371472 [6:02:33<1:18:28,  3.63it/s]
 95%|█████████▌| 354398/371472 [6:02:33<1:16:34,  3.72it/s]
 95%|█████████▌| 354399/371472 [6:02:34<1:19:08,  3.60it/s]
 95%|█████████▌| 354400/371472 [6:02:34<1:18:11,  3.64it/s]
                                                           
{'loss': 2.5005, 'learning_rate': 1.4138421426878404e-07, 'epoch': 15.26}

 95%|█████████▌| 354400/371472 [6:02:34<1:18:11,  3.64it/s]
 95%|█████████▌| 354401/371472 [6:02:34<1:20:46,  3.52it/s]
 95%|█████████▌| 354402/371472 [6:02:34<1:20:57,  3.51it/s]
 95%|█████████▌| 354403/371472 [6:02:35<1:23:42,  3.40it/s]
 95%|█████████▌| 354404/371472 [6:02:35<1:23:15,  3.42it/s]
 95%|█████████▌| 354405/371472 [6:02:35<1:21:45,  3.48it/s]
 95%|█████████▌| 354406/371472 [6:02:36<1:23:52,  3.39it/s]
 95%|█████████▌| 354407/371472 [6:02:36<1:23:11,  3.42it/s]
 95%|█████████▌| 354408/371472 [6:02:36<1:22:52,  3.43it/s]
 95%|█████████▌| 354409/371472 [6:02:37<1:30:37,  3.14it/s]
 95%|█████████▌| 354410/371472 [6:02:37<1:33:37,  3.04it/s]
 95%|█████████▌| 354411/371472 [6:02:37<1:29:51,  3.16it/s]
 95%|█████████▌| 354412/371472 [6:02:37<1:26:04,  3.30it/s]
 95%|█████████▌| 354413/371472 [6:02:38<1:25:39,  3.32it/s]
 95%|█████████▌| 354414/371472 [6:02:38<1:21:09,  3.50it/s]
 95%|█████████▌| 354415/371472 [6:02:38<1:22:33,  3.44it/s]
 95%|█████████▌| 354416/371472 [6:02:39<1:21:39,  3.48it/s]
 95%|█████████▌| 354417/371472 [6:02:39<1:21:52,  3.47it/s]
 95%|█████████▌| 354418/371472 [6:02:39<1:19:27,  3.58it/s]
 95%|█████████▌| 354419/371472 [6:02:39<1:18:39,  3.61it/s]
 95%|█████████▌| 354420/371472 [6:02:40<1:23:54,  3.39it/s]
                                                           
{'loss': 2.6328, 'learning_rate': 1.413357322933052e-07, 'epoch': 15.27}

 95%|█████████▌| 354420/371472 [6:02:40<1:23:54,  3.39it/s]
 95%|█████████▌| 354421/371472 [6:02:40<1:23:13,  3.41it/s]
 95%|█████████▌| 354422/371472 [6:02:40<1:19:41,  3.57it/s]
 95%|█████████▌| 354423/371472 [6:02:41<1:17:49,  3.65it/s]
 95%|█████████▌| 354424/371472 [6:02:41<1:17:17,  3.68it/s]
 95%|█████████▌| 354425/371472 [6:02:41<1:19:02,  3.59it/s]
 95%|█████████▌| 354426/371472 [6:02:41<1:18:33,  3.62it/s]
 95%|█████████▌| 354427/371472 [6:02:42<1:16:10,  3.73it/s]
 95%|█████████▌| 354428/371472 [6:02:42<1:15:51,  3.74it/s]
 95%|█████████▌| 354429/371472 [6:02:42<1:16:48,  3.70it/s]
 95%|█████████▌| 354430/371472 [6:02:43<1:20:49,  3.51it/s]
 95%|█████████▌| 354431/371472 [6:02:43<1:21:41,  3.48it/s]
 95%|█████████▌| 354432/371472 [6:02:43<1:20:49,  3.51it/s]
 95%|█████████▌| 354433/371472 [6:02:43<1:20:25,  3.53it/s]
 95%|█████████▌| 354434/371472 [6:02:44<1:19:51,  3.56it/s]
 95%|█████████▌| 354435/371472 [6:02:44<1:25:17,  3.33it/s]
 95%|█████████▌| 354436/371472 [6:02:44<1:20:53,  3.51it/s]
 95%|█████████▌| 354437/371472 [6:02:45<1:20:23,  3.53it/s]
 95%|█████████▌| 354438/371472 [6:02:45<1:19:36,  3.57it/s]
 95%|█████████▌| 354439/371472 [6:02:45<1:22:57,  3.42it/s]
 95%|█████████▌| 354440/371472 [6:02:45<1:20:32,  3.52it/s]
                                                           
{'loss': 2.5912, 'learning_rate': 1.4128725031782626e-07, 'epoch': 15.27}

 95%|█████████▌| 354440/371472 [6:02:45<1:20:32,  3.52it/s]
 95%|█████████▌| 354441/371472 [6:02:46<1:20:58,  3.51it/s]
 95%|█████████▌| 354442/371472 [6:02:46<1:18:33,  3.61it/s]
 95%|█████████▌| 354443/371472 [6:02:46<1:17:40,  3.65it/s]
 95%|█████████▌| 354444/371472 [6:02:46<1:18:01,  3.64it/s]
 95%|█████████▌| 354445/371472 [6:02:47<1:18:34,  3.61it/s]
 95%|█████████▌| 354446/371472 [6:02:47<1:18:19,  3.62it/s]
 95%|█████████▌| 354447/371472 [6:02:47<1:19:13,  3.58it/s]
 95%|█████████▌| 354448/371472 [6:02:48<1:17:03,  3.68it/s]
 95%|█████████▌| 354449/371472 [6:02:48<1:25:51,  3.30it/s]
 95%|█████████▌| 354450/371472 [6:02:48<1:21:30,  3.48it/s]
 95%|█████████▌| 354451/371472 [6:02:48<1:20:44,  3.51it/s]
 95%|█████████▌| 354452/371472 [6:02:49<1:18:51,  3.60it/s]
 95%|█████████▌| 354453/371472 [6:02:49<1:21:53,  3.46it/s]
 95%|█████████▌| 354454/371472 [6:02:49<1:19:37,  3.56it/s]
 95%|█████████▌| 354455/371472 [6:02:50<1:21:12,  3.49it/s]
 95%|█████████▌| 354456/371472 [6:02:50<1:19:47,  3.55it/s]
 95%|█████████▌| 354457/371472 [6:02:50<1:24:35,  3.35it/s]
 95%|█████████▌| 354458/371472 [6:02:51<1:25:06,  3.33it/s]
 95%|█████████▌| 354459/371472 [6:02:51<1:25:17,  3.32it/s]
 95%|█████████▌| 354460/371472 [6:02:51<1:21:59,  3.46it/s]
                                                           
{'loss': 2.5157, 'learning_rate': 1.4123876834234741e-07, 'epoch': 15.27}

 95%|█████████▌| 354460/371472 [6:02:51<1:21:59,  3.46it/s]
 95%|█████████▌| 354461/371472 [6:02:51<1:19:57,  3.55it/s]
 95%|█████████▌| 354462/371472 [6:02:52<1:16:50,  3.69it/s]
 95%|█████████▌| 354463/371472 [6:02:52<1:15:24,  3.76it/s]
 95%|█████████▌| 354464/371472 [6:02:52<1:13:03,  3.88it/s]
 95%|█████████▌| 354465/371472 [6:02:52<1:16:01,  3.73it/s]
 95%|█████████▌| 354466/371472 [6:02:53<1:17:03,  3.68it/s]
 95%|█████████▌| 354467/371472 [6:02:53<1:20:42,  3.51it/s]
 95%|█████████▌| 354468/371472 [6:02:53<1:25:47,  3.30it/s]
 95%|█████████▌| 354469/371472 [6:02:54<1:22:53,  3.42it/s]
 95%|█████████▌| 354470/371472 [6:02:54<1:21:14,  3.49it/s]
 95%|█████████▌| 354471/371472 [6:02:54<1:24:33,  3.35it/s]
 95%|█████████▌| 354472/371472 [6:02:55<1:26:09,  3.29it/s]
 95%|█████████▌| 354473/371472 [6:02:55<1:30:56,  3.12it/s]
 95%|█████████▌| 354474/371472 [6:02:55<1:29:36,  3.16it/s]
 95%|█████████▌| 354475/371472 [6:02:55<1:25:47,  3.30it/s]
 95%|█████████▌| 354476/371472 [6:02:56<1:23:15,  3.40it/s]
 95%|█████████▌| 354477/371472 [6:02:56<1:27:37,  3.23it/s]
 95%|█████████▌| 354478/371472 [6:02:56<1:23:28,  3.39it/s]
 95%|█████████▌| 354479/371472 [6:02:57<1:22:51,  3.42it/s]
 95%|█████████▌| 354480/371472 [6:02:57<1:20:20,  3.52it/s]
                                                           
{'loss': 2.5835, 'learning_rate': 1.411902863668685e-07, 'epoch': 15.27}

 95%|█████████▌| 354480/371472 [6:02:57<1:20:20,  3.52it/s]
 95%|█████████▌| 354481/371472 [6:02:57<1:19:25,  3.57it/s]
 95%|█████████▌| 354482/371472 [6:02:57<1:17:59,  3.63it/s]
 95%|█████████▌| 354483/371472 [6:02:58<1:16:29,  3.70it/s]
 95%|█████████▌| 354484/371472 [6:02:58<1:15:21,  3.76it/s]
 95%|█████████▌| 354485/371472 [6:02:58<1:18:16,  3.62it/s]
 95%|█████████▌| 354486/371472 [6:02:58<1:18:08,  3.62it/s]
 95%|█████████▌| 354487/371472 [6:02:59<1:19:11,  3.57it/s]
 95%|█████████▌| 354488/371472 [6:02:59<1:17:14,  3.66it/s]
 95%|█████████▌| 354489/371472 [6:02:59<1:15:57,  3.73it/s]
 95%|█████████▌| 354490/371472 [6:03:00<1:19:50,  3.54it/s]
 95%|█████████▌| 354491/371472 [6:03:00<1:23:29,  3.39it/s]
 95%|█████████▌| 354492/371472 [6:03:00<1:20:14,  3.53it/s]
 95%|█████████▌| 354493/371472 [6:03:01<1:23:05,  3.41it/s]
 95%|█████████▌| 354494/371472 [6:03:01<1:19:44,  3.55it/s]
 95%|█████████▌| 354495/371472 [6:03:01<1:32:18,  3.07it/s]
 95%|█████████▌| 354496/371472 [6:03:02<1:30:11,  3.14it/s]
 95%|█████████▌| 354497/371472 [6:03:02<1:25:12,  3.32it/s]
 95%|█████████▌| 354498/371472 [6:03:02<1:25:57,  3.29it/s]
 95%|█████████▌| 354499/371472 [6:03:02<1:22:38,  3.42it/s]
 95%|█████████▌| 354500/371472 [6:03:03<1:29:15,  3.17it/s]
                                                           
{'loss': 2.5653, 'learning_rate': 1.4114180439138964e-07, 'epoch': 15.27}

 95%|█████████▌| 354500/371472 [6:03:03<1:29:15,  3.17it/s]
 95%|█████████▌| 354501/371472 [6:03:03<1:24:51,  3.33it/s]
 95%|█████████▌| 354502/371472 [6:03:03<1:20:05,  3.53it/s]
 95%|█████████▌| 354503/371472 [6:03:04<1:24:56,  3.33it/s]
 95%|█████████▌| 354504/371472 [6:03:04<1:27:48,  3.22it/s]
 95%|█████████▌| 354505/371472 [6:03:04<1:23:53,  3.37it/s]
 95%|█████████▌| 354506/371472 [6:03:04<1:21:52,  3.45it/s]
 95%|█████████▌| 354507/371472 [6:03:05<1:19:15,  3.57it/s]
 95%|█████████▌| 354508/371472 [6:03:05<1:18:38,  3.60it/s]
 95%|█████████▌| 354509/371472 [6:03:05<1:18:13,  3.61it/s]
 95%|█████████▌| 354510/371472 [6:03:06<1:18:08,  3.62it/s]
 95%|█████████▌| 354511/371472 [6:03:06<1:18:19,  3.61it/s]
 95%|█████████▌| 354512/371472 [6:03:06<1:18:21,  3.61it/s]
 95%|█████████▌| 354513/371472 [6:03:06<1:18:04,  3.62it/s]
 95%|█████████▌| 354514/371472 [6:03:07<1:21:57,  3.45it/s]
 95%|█████████▌| 354515/371472 [6:03:07<1:26:13,  3.28it/s]
 95%|█████████▌| 354516/371472 [6:03:07<1:21:40,  3.46it/s]
 95%|█████████▌| 354517/371472 [6:03:08<1:28:57,  3.18it/s]
 95%|█████████▌| 354518/371472 [6:03:08<1:25:02,  3.32it/s]
 95%|█████████▌| 354519/371472 [6:03:08<1:24:48,  3.33it/s]
 95%|█████████▌| 354520/371472 [6:03:08<1:24:04,  3.36it/s]
                                                           
{'loss': 2.6409, 'learning_rate': 1.4109332241591068e-07, 'epoch': 15.27}

 95%|█████████▌| 354520/371472 [6:03:08<1:24:04,  3.36it/s]
 95%|█████████▌| 354521/371472 [6:03:09<1:25:21,  3.31it/s]
 95%|█████████▌| 354522/371472 [6:03:09<1:26:51,  3.25it/s]
 95%|█████████▌| 354523/371472 [6:03:09<1:22:02,  3.44it/s]
 95%|█████████▌| 354524/371472 [6:03:10<1:26:19,  3.27it/s]
 95%|█████████▌| 354525/371472 [6:03:10<1:29:56,  3.14it/s]
 95%|█████████▌| 354526/371472 [6:03:10<1:29:06,  3.17it/s]
 95%|█████████▌| 354527/371472 [6:03:11<1:29:44,  3.15it/s]
 95%|█████████▌| 354528/371472 [6:03:11<1:31:33,  3.08it/s]
 95%|█████████▌| 354529/371472 [6:03:11<1:28:42,  3.18it/s]
 95%|█████████▌| 354530/371472 [6:03:12<1:27:43,  3.22it/s]
 95%|█████████▌| 354531/371472 [6:03:12<1:24:29,  3.34it/s]
 95%|█████████▌| 354532/371472 [6:03:12<1:23:58,  3.36it/s]
 95%|█████████▌| 354533/371472 [6:03:12<1:21:31,  3.46it/s]
 95%|█████████▌| 354534/371472 [6:03:13<1:19:21,  3.56it/s]
 95%|█████████▌| 354535/371472 [6:03:13<1:18:09,  3.61it/s]
 95%|█████████▌| 354536/371472 [6:03:13<1:16:57,  3.67it/s]
 95%|█████████▌| 354537/371472 [6:03:14<1:20:57,  3.49it/s]
 95%|█████████▌| 354538/371472 [6:03:14<1:17:46,  3.63it/s]
 95%|█████████▌| 354539/371472 [6:03:14<1:16:16,  3.70it/s]
 95%|█████████▌| 354540/371472 [6:03:14<1:16:41,  3.68it/s]
                                                           
{'loss': 2.3744, 'learning_rate': 1.4104484044043186e-07, 'epoch': 15.27}

 95%|█████████▌| 354540/371472 [6:03:14<1:16:41,  3.68it/s]
 95%|█████████▌| 354541/371472 [6:03:15<1:18:16,  3.61it/s]
 95%|█████████▌| 354542/371472 [6:03:15<1:15:47,  3.72it/s]
 95%|█████████▌| 354543/371472 [6:03:15<1:16:38,  3.68it/s]
 95%|█████████▌| 354544/371472 [6:03:15<1:16:30,  3.69it/s]
 95%|█████████▌| 354545/371472 [6:03:16<1:18:44,  3.58it/s]
 95%|█████████▌| 354546/371472 [6:03:16<1:23:39,  3.37it/s]
 95%|█████████▌| 354547/371472 [6:03:16<1:21:04,  3.48it/s]
 95%|█████████▌| 354548/371472 [6:03:17<1:23:44,  3.37it/s]
 95%|█████████▌| 354549/371472 [6:03:17<1:21:29,  3.46it/s]
 95%|█████████▌| 354550/371472 [6:03:17<1:25:56,  3.28it/s]
 95%|█████████▌| 354551/371472 [6:03:18<1:21:55,  3.44it/s]
 95%|█████████▌| 354552/371472 [6:03:18<1:21:20,  3.47it/s]
 95%|█████████▌| 354553/371472 [6:03:18<1:31:00,  3.10it/s]
 95%|█████████▌| 354554/371472 [6:03:19<1:29:38,  3.15it/s]
 95%|█████████▌| 354555/371472 [6:03:19<1:24:36,  3.33it/s]
 95%|█████████▌| 354556/371472 [6:03:19<1:20:16,  3.51it/s]
 95%|█████████▌| 354557/371472 [6:03:19<1:24:01,  3.36it/s]
 95%|█████████▌| 354558/371472 [6:03:20<1:19:56,  3.53it/s]
 95%|█████████▌| 354559/371472 [6:03:20<1:18:06,  3.61it/s]
 95%|█████████▌| 354560/371472 [6:03:20<1:17:31,  3.64it/s]
                                                           
{'loss': 2.6112, 'learning_rate': 1.409963584649529e-07, 'epoch': 15.27}

 95%|█████████▌| 354560/371472 [6:03:20<1:17:31,  3.64it/s]
 95%|█████████▌| 354561/371472 [6:03:20<1:18:43,  3.58it/s]
 95%|█████████▌| 354562/371472 [6:03:21<1:16:55,  3.66it/s]
 95%|█████████▌| 354563/371472 [6:03:21<1:22:08,  3.43it/s]
 95%|█████████▌| 354564/371472 [6:03:21<1:17:53,  3.62it/s]
 95%|█████████▌| 354565/371472 [6:03:22<1:18:23,  3.59it/s]
 95%|█████████▌| 354566/371472 [6:03:22<1:18:37,  3.58it/s]
 95%|█████████▌| 354567/371472 [6:03:22<1:17:54,  3.62it/s]
 95%|█████████▌| 354568/371472 [6:03:22<1:21:44,  3.45it/s]
 95%|█████████▌| 354569/371472 [6:03:23<1:19:16,  3.55it/s]
 95%|█████████▌| 354570/371472 [6:03:23<1:18:49,  3.57it/s]
 95%|█████████▌| 354571/371472 [6:03:23<1:17:42,  3.62it/s]
 95%|█████████▌| 354572/371472 [6:03:23<1:16:36,  3.68it/s]
 95%|█████████▌| 354573/371472 [6:03:24<1:17:18,  3.64it/s]
 95%|█████████▌| 354574/371472 [6:03:24<1:14:22,  3.79it/s]
 95%|█████████▌| 354575/371472 [6:03:24<1:14:23,  3.79it/s]
 95%|█████████▌| 354576/371472 [6:03:25<1:15:34,  3.73it/s]
 95%|█████████▌| 354577/371472 [6:03:25<1:25:00,  3.31it/s]
 95%|█████████▌| 354578/371472 [6:03:25<1:26:04,  3.27it/s]
 95%|█████████▌| 354579/371472 [6:03:26<1:23:01,  3.39it/s]
 95%|█████████▌| 354580/371472 [6:03:26<1:23:53,  3.36it/s]
                                                           
{'loss': 2.6178, 'learning_rate': 1.4094787648947406e-07, 'epoch': 15.27}

 95%|█████████▌| 354580/371472 [6:03:26<1:23:53,  3.36it/s]
 95%|█████████▌| 354581/371472 [6:03:26<1:23:41,  3.36it/s]
 95%|█████████▌| 354582/371472 [6:03:26<1:21:27,  3.46it/s]
 95%|█████████▌| 354583/371472 [6:03:27<1:23:53,  3.36it/s]
 95%|█████████▌| 354584/371472 [6:03:27<1:22:50,  3.40it/s]
 95%|█████████▌| 354585/371472 [6:03:27<1:36:02,  2.93it/s]
 95%|█████████▌| 354586/371472 [6:03:28<1:28:16,  3.19it/s]
 95%|█████████▌| 354587/371472 [6:03:28<1:24:55,  3.31it/s]
 95%|█████████▌| 354588/371472 [6:03:28<1:23:47,  3.36it/s]
 95%|█████████▌| 354589/371472 [6:03:29<1:24:34,  3.33it/s]
 95%|█████████▌| 354590/371472 [6:03:29<1:20:18,  3.50it/s]
 95%|█████████▌| 354591/371472 [6:03:29<1:20:00,  3.52it/s]
 95%|█████████▌| 354592/371472 [6:03:29<1:20:11,  3.51it/s]
 95%|█████████▌| 354593/371472 [6:03:30<1:19:05,  3.56it/s]
 95%|█████████▌| 354594/371472 [6:03:30<1:16:31,  3.68it/s]
 95%|█████████▌| 354595/371472 [6:03:30<1:20:42,  3.49it/s]
 95%|█████████▌| 354596/371472 [6:03:31<1:20:17,  3.50it/s]
 95%|█████████▌| 354597/371472 [6:03:31<1:20:11,  3.51it/s]
 95%|█████████▌| 354598/371472 [6:03:31<1:20:39,  3.49it/s]
 95%|█████████▌| 354599/371472 [6:03:31<1:24:10,  3.34it/s]
 95%|█████████▌| 354600/371472 [6:03:32<1:21:49,  3.44it/s]
                                                           
{'loss': 2.5548, 'learning_rate': 1.4089939451399513e-07, 'epoch': 15.27}

 95%|█████████▌| 354600/371472 [6:03:32<1:21:49,  3.44it/s]
 95%|█████████▌| 354601/371472 [6:03:32<1:19:40,  3.53it/s]
 95%|█████████▌| 354602/371472 [6:03:32<1:24:04,  3.34it/s]
 95%|█████████▌| 354603/371472 [6:03:33<1:22:37,  3.40it/s]
 95%|█████████▌| 354604/371472 [6:03:33<1:21:37,  3.44it/s]
 95%|█████████▌| 354605/371472 [6:03:33<1:21:04,  3.47it/s]
 95%|█████████▌| 354606/371472 [6:03:33<1:19:44,  3.52it/s]
 95%|█████████▌| 354607/371472 [6:03:34<1:18:58,  3.56it/s]
 95%|█████████▌| 354608/371472 [6:03:34<1:16:33,  3.67it/s]
 95%|█████████▌| 354609/371472 [6:03:34<1:22:35,  3.40it/s]
 95%|█████████▌| 354610/371472 [6:03:35<1:19:31,  3.53it/s]
 95%|█████████▌| 354611/371472 [6:03:35<1:16:59,  3.65it/s]
 95%|█████████▌| 354612/371472 [6:03:35<1:19:47,  3.52it/s]
 95%|█████████▌| 354613/371472 [6:03:35<1:18:30,  3.58it/s]
 95%|█████████▌| 354614/371472 [6:03:36<1:18:41,  3.57it/s]
 95%|█████████▌| 354615/371472 [6:03:36<1:21:05,  3.46it/s]
 95%|█████████▌| 354616/371472 [6:03:36<1:21:13,  3.46it/s]
 95%|█████████▌| 354617/371472 [6:03:37<1:32:51,  3.03it/s]
 95%|█████████▌| 354618/371472 [6:03:37<1:29:43,  3.13it/s]
 95%|█████████▌| 354619/371472 [6:03:37<1:27:16,  3.22it/s]
 95%|█████████▌| 354620/371472 [6:03:38<1:25:55,  3.27it/s]
                                                           
{'loss': 2.5435, 'learning_rate': 1.4085091253851628e-07, 'epoch': 15.27}

 95%|█████████▌| 354620/371472 [6:03:38<1:25:55,  3.27it/s]
 95%|█████████▌| 354621/371472 [6:03:38<1:26:38,  3.24it/s]
 95%|█████████▌| 354622/371472 [6:03:38<1:23:26,  3.37it/s]
 95%|█████████▌| 354623/371472 [6:03:38<1:22:21,  3.41it/s]
 95%|█████████▌| 354624/371472 [6:03:39<1:19:26,  3.53it/s]
 95%|█████████▌| 354625/371472 [6:03:39<1:17:33,  3.62it/s]
 95%|█████████▌| 354626/371472 [6:03:39<1:16:29,  3.67it/s]
 95%|█████████▌| 354627/371472 [6:03:39<1:16:40,  3.66it/s]
 95%|█████████▌| 354628/371472 [6:03:40<1:14:16,  3.78it/s]
 95%|█████████▌| 354629/371472 [6:03:40<1:14:19,  3.78it/s]
 95%|█████████▌| 354630/371472 [6:03:40<1:15:12,  3.73it/s]
 95%|█████████▌| 354631/371472 [6:03:41<1:19:06,  3.55it/s]
 95%|█████████▌| 354632/371472 [6:03:41<1:16:49,  3.65it/s]
 95%|█████████▌| 354633/371472 [6:03:41<1:17:46,  3.61it/s]
 95%|█████████▌| 354634/371472 [6:03:41<1:19:36,  3.53it/s]
 95%|█████████▌| 354635/371472 [6:03:42<1:31:29,  3.07it/s]
 95%|█████████▌| 354636/371472 [6:03:42<1:27:41,  3.20it/s]
 95%|█████████▌| 354637/371472 [6:03:42<1:28:41,  3.16it/s]
 95%|█████████▌| 354638/371472 [6:03:43<1:26:31,  3.24it/s]
 95%|█████████▌| 354639/371472 [6:03:43<1:21:31,  3.44it/s]
 95%|█████████▌| 354640/371472 [6:03:43<1:22:11,  3.41it/s]
                                                           
{'loss': 2.6694, 'learning_rate': 1.4080243056303732e-07, 'epoch': 15.28}

 95%|█████████▌| 354640/371472 [6:03:43<1:22:11,  3.41it/s]
 95%|█████████▌| 354641/371472 [6:03:44<1:25:00,  3.30it/s]
 95%|█████████▌| 354642/371472 [6:03:44<1:25:05,  3.30it/s]
 95%|█████████▌| 354643/371472 [6:03:44<1:22:50,  3.39it/s]
 95%|█████████▌| 354644/371472 [6:03:44<1:19:13,  3.54it/s]
 95%|█████████▌| 354645/371472 [6:03:45<1:18:20,  3.58it/s]
 95%|█████████▌| 354646/371472 [6:03:45<1:18:35,  3.57it/s]
 95%|█████████▌| 354647/371472 [6:03:45<1:18:05,  3.59it/s]
 95%|█████████▌| 354648/371472 [6:03:46<1:18:07,  3.59it/s]
 95%|█████████▌| 354649/371472 [6:03:46<1:20:05,  3.50it/s]
 95%|█████████▌| 354650/371472 [6:03:46<1:19:08,  3.54it/s]
 95%|█████████▌| 354651/371472 [6:03:46<1:24:02,  3.34it/s]
 95%|█████████▌| 354652/371472 [6:03:47<1:24:01,  3.34it/s]
 95%|█████████▌| 354653/371472 [6:03:47<1:26:40,  3.23it/s]
 95%|█████████▌| 354654/371472 [6:03:47<1:22:13,  3.41it/s]
 95%|█████████▌| 354655/371472 [6:03:48<1:27:29,  3.20it/s]
 95%|█████████▌| 354656/371472 [6:03:48<1:24:00,  3.34it/s]
 95%|█████████▌| 354657/371472 [6:03:48<1:24:29,  3.32it/s]
 95%|█████████▌| 354658/371472 [6:03:49<1:20:04,  3.50it/s]
 95%|█████████▌| 354659/371472 [6:03:49<1:19:24,  3.53it/s]
 95%|█████████▌| 354660/371472 [6:03:49<1:21:16,  3.45it/s]
                                                           
{'loss': 2.3769, 'learning_rate': 1.407539485875585e-07, 'epoch': 15.28}

 95%|█████████▌| 354660/371472 [6:03:49<1:21:16,  3.45it/s]
 95%|█████████▌| 354661/371472 [6:03:49<1:23:18,  3.36it/s]
 95%|█████████▌| 354662/371472 [6:03:50<1:22:49,  3.38it/s]
 95%|█████████▌| 354663/371472 [6:03:50<1:18:55,  3.55it/s]
 95%|█████████▌| 354664/371472 [6:03:50<1:19:45,  3.51it/s]
 95%|█████████▌| 354665/371472 [6:03:51<1:21:55,  3.42it/s]
 95%|█████████▌| 354666/371472 [6:03:51<1:21:36,  3.43it/s]
 95%|█████████▌| 354667/371472 [6:03:51<1:25:24,  3.28it/s]
 95%|█████████▌| 354668/371472 [6:03:51<1:25:08,  3.29it/s]
 95%|█████████▌| 354669/371472 [6:03:52<1:22:45,  3.38it/s]
 95%|█████████▌| 354670/371472 [6:03:52<1:19:40,  3.51it/s]
 95%|█████████▌| 354671/371472 [6:03:52<1:20:09,  3.49it/s]
 95%|█████████▌| 354672/371472 [6:03:53<1:17:30,  3.61it/s]
 95%|█████████▌| 354673/371472 [6:03:53<1:16:15,  3.67it/s]
 95%|█████████▌| 354674/371472 [6:03:53<1:14:32,  3.76it/s]
 95%|█████████▌| 354675/371472 [6:03:53<1:14:58,  3.73it/s]
 95%|█████████▌| 354676/371472 [6:03:54<1:19:41,  3.51it/s]
 95%|█████████▌| 354677/371472 [6:03:54<1:21:53,  3.42it/s]
 95%|█████████▌| 354678/371472 [6:03:54<1:22:59,  3.37it/s]
 95%|█████████▌| 354679/371472 [6:03:55<1:22:43,  3.38it/s]
 95%|█████████▌| 354680/371472 [6:03:55<1:21:12,  3.45it/s]
                                                           
{'loss': 2.6113, 'learning_rate': 1.4070546661207954e-07, 'epoch': 15.28}

 95%|█████████▌| 354680/371472 [6:03:55<1:21:12,  3.45it/s]
 95%|█████████▌| 354681/371472 [6:03:55<1:24:48,  3.30it/s]
 95%|█████████▌| 354682/371472 [6:03:55<1:23:31,  3.35it/s]
 95%|█████████▌| 354683/371472 [6:03:56<1:24:40,  3.30it/s]
 95%|█████████▌| 354684/371472 [6:03:56<1:24:47,  3.30it/s]
 95%|█████████▌| 354685/371472 [6:03:56<1:21:22,  3.44it/s]
 95%|█████████▌| 354686/371472 [6:03:57<1:19:28,  3.52it/s]
 95%|█████████▌| 354687/371472 [6:03:57<1:30:11,  3.10it/s]
 95%|█████████▌| 354688/371472 [6:03:57<1:25:45,  3.26it/s]
 95%|█████████▌| 354689/371472 [6:03:58<1:28:18,  3.17it/s]
 95%|█████████▌| 354690/371472 [6:03:58<1:25:04,  3.29it/s]
 95%|█████████▌| 354691/371472 [6:03:58<1:27:37,  3.19it/s]
 95%|█████████▌| 354692/371472 [6:03:59<1:23:52,  3.33it/s]
 95%|█████████▌| 354693/371472 [6:03:59<1:22:23,  3.39it/s]
 95%|█████████▌| 354694/371472 [6:03:59<1:20:56,  3.45it/s]
 95%|█████████▌| 354695/371472 [6:03:59<1:21:12,  3.44it/s]
 95%|█████████▌| 354696/371472 [6:04:00<1:18:43,  3.55it/s]
 95%|█████████▌| 354697/371472 [6:04:00<1:18:10,  3.58it/s]
 95%|█████████▌| 354698/371472 [6:04:00<1:16:34,  3.65it/s]
 95%|█████████▌| 354699/371472 [6:04:01<1:23:01,  3.37it/s]
 95%|█████████▌| 354700/371472 [6:04:01<1:21:54,  3.41it/s]
                                                           
{'loss': 2.435, 'learning_rate': 1.406569846366006e-07, 'epoch': 15.28}

 95%|█████████▌| 354700/371472 [6:04:01<1:21:54,  3.41it/s]
 95%|█████████▌| 354701/371472 [6:04:01<1:23:30,  3.35it/s]
 95%|█████████▌| 354702/371472 [6:04:01<1:20:41,  3.46it/s]
 95%|█████████▌| 354703/371472 [6:04:02<1:19:05,  3.53it/s]
 95%|█████████▌| 354704/371472 [6:04:02<1:16:01,  3.68it/s]
 95%|█████████▌| 354705/371472 [6:04:02<1:15:45,  3.69it/s]
 95%|█████████▌| 354706/371472 [6:04:03<1:20:41,  3.46it/s]
 95%|█████████▌| 354707/371472 [6:04:03<1:19:53,  3.50it/s]
 95%|█████████▌| 354708/371472 [6:04:03<1:18:32,  3.56it/s]
 95%|█████████▌| 354709/371472 [6:04:03<1:21:49,  3.41it/s]
 95%|█████████▌| 354710/371472 [6:04:04<1:20:24,  3.47it/s]
 95%|█████████▌| 354711/371472 [6:04:04<1:26:20,  3.24it/s]
 95%|█████████▌| 354712/371472 [6:04:04<1:22:14,  3.40it/s]
 95%|█████████▌| 354713/371472 [6:04:05<1:19:09,  3.53it/s]
 95%|█████████▌| 354714/371472 [6:04:05<1:18:37,  3.55it/s]
 95%|█████████▌| 354715/371472 [6:04:05<1:16:51,  3.63it/s]
 95%|█████████▌| 354716/371472 [6:04:05<1:23:32,  3.34it/s]
 95%|█████████▌| 354717/371472 [6:04:06<1:21:35,  3.42it/s]
 95%|█████████▌| 354718/371472 [6:04:06<1:23:06,  3.36it/s]
 95%|█████████▌| 354719/371472 [6:04:06<1:23:47,  3.33it/s]
 95%|█████████▌| 354720/371472 [6:04:07<1:22:03,  3.40it/s]
                                                           
{'loss': 2.563, 'learning_rate': 1.4060850266112177e-07, 'epoch': 15.28}

 95%|█████████▌| 354720/371472 [6:04:07<1:22:03,  3.40it/s]
 95%|█████████▌| 354721/371472 [6:04:07<1:19:21,  3.52it/s]
 95%|█████████▌| 354722/371472 [6:04:07<1:19:16,  3.52it/s]
 95%|█████████▌| 354723/371472 [6:04:07<1:17:32,  3.60it/s]
 95%|█████████▌| 354724/371472 [6:04:08<1:19:35,  3.51it/s]
 95%|█████████▌| 354725/371472 [6:04:08<1:22:29,  3.38it/s]
 95%|█████████▌| 354726/371472 [6:04:08<1:20:37,  3.46it/s]
 95%|█████████▌| 354727/371472 [6:04:09<1:26:28,  3.23it/s]
 95%|█████████▌| 354728/371472 [6:04:09<1:22:12,  3.39it/s]
 95%|█████████▌| 354729/371472 [6:04:09<1:24:51,  3.29it/s]
 95%|█████████▌| 354730/371472 [6:04:10<1:23:34,  3.34it/s]
 95%|█████████▌| 354731/371472 [6:04:10<1:22:19,  3.39it/s]
 95%|█████████▌| 354732/371472 [6:04:10<1:20:47,  3.45it/s]
 95%|█████████▌| 354733/371472 [6:04:10<1:20:45,  3.45it/s]
 95%|█████████▌| 354734/371472 [6:04:11<1:18:21,  3.56it/s]
 95%|█████████▌| 354735/371472 [6:04:11<1:18:25,  3.56it/s]
 95%|█████████▌| 354736/371472 [6:04:11<1:18:06,  3.57it/s]
 95%|█████████▌| 354737/371472 [6:04:11<1:15:35,  3.69it/s]
 95%|█████████▌| 354738/371472 [6:04:12<1:17:14,  3.61it/s]
 95%|█████████▌| 354739/371472 [6:04:12<1:16:42,  3.64it/s]
 95%|█████████▌| 354740/371472 [6:04:12<1:22:50,  3.37it/s]
                                                           
{'loss': 2.6459, 'learning_rate': 1.405600206856428e-07, 'epoch': 15.28}

 95%|█████████▌| 354740/371472 [6:04:12<1:22:50,  3.37it/s]
 95%|█████████▌| 354741/371472 [6:04:13<1:24:31,  3.30it/s]
 95%|█████████▌| 354742/371472 [6:04:13<1:24:17,  3.31it/s]
 95%|█████████▌| 354743/371472 [6:04:13<1:29:15,  3.12it/s]
 95%|█████████▌| 354744/371472 [6:04:14<1:29:49,  3.10it/s]
 95%|█████████▌| 354745/371472 [6:04:14<1:28:39,  3.14it/s]
 95%|█████████▌| 354746/371472 [6:04:14<1:31:22,  3.05it/s]
 95%|█████████▌| 354747/371472 [6:04:15<1:33:02,  3.00it/s]
 95%|█████████▌| 354748/371472 [6:04:15<1:31:54,  3.03it/s]
 95%|█████████▌| 354749/371472 [6:04:15<1:29:19,  3.12it/s]
 95%|█████████▌| 354750/371472 [6:04:16<1:27:02,  3.20it/s]
 95%|█████████▌| 354751/371472 [6:04:16<1:30:04,  3.09it/s]
 95%|█████████▌| 354752/371472 [6:04:16<1:28:31,  3.15it/s]
 95%|█████████▌| 354753/371472 [6:04:17<1:24:09,  3.31it/s]
 95%|█████████▌| 354754/371472 [6:04:17<1:22:00,  3.40it/s]
 95%|█████████▌| 354755/371472 [6:04:17<1:18:23,  3.55it/s]
 96%|█████████▌| 354756/371472 [6:04:17<1:19:05,  3.52it/s]
 96%|█████████▌| 354757/371472 [6:04:18<1:24:36,  3.29it/s]
 96%|█████████▌| 354758/371472 [6:04:18<1:20:19,  3.47it/s]
 96%|█████████▌| 354759/371472 [6:04:18<1:20:55,  3.44it/s]
 96%|█████████▌| 354760/371472 [6:04:19<1:21:27,  3.42it/s]
                                                           
{'loss': 2.5291, 'learning_rate': 1.4051153871016396e-07, 'epoch': 15.28}

 96%|█████████▌| 354760/371472 [6:04:19<1:21:27,  3.42it/s]
 96%|█████████▌| 354761/371472 [6:04:19<1:22:49,  3.36it/s]
 96%|█████████▌| 354762/371472 [6:04:19<1:19:18,  3.51it/s]
 96%|█████████▌| 354763/371472 [6:04:19<1:24:10,  3.31it/s]
 96%|█████████▌| 354764/371472 [6:04:20<1:22:24,  3.38it/s]
 96%|█████████▌| 354765/371472 [6:04:20<1:19:55,  3.48it/s]
 96%|█████████▌| 354766/371472 [6:04:20<1:30:53,  3.06it/s]
 96%|█████████▌| 354767/371472 [6:04:21<1:26:14,  3.23it/s]
 96%|█████████▌| 354768/371472 [6:04:21<1:23:24,  3.34it/s]
 96%|█████████▌| 354769/371472 [6:04:21<1:23:30,  3.33it/s]
 96%|█████████▌| 354770/371472 [6:04:22<1:26:01,  3.24it/s]
 96%|█████████▌| 354771/371472 [6:04:22<1:21:55,  3.40it/s]
 96%|█████████▌| 354772/371472 [6:04:22<1:19:33,  3.50it/s]
 96%|█████████▌| 354773/371472 [6:04:22<1:20:31,  3.46it/s]
 96%|█████████▌| 354774/371472 [6:04:23<1:19:35,  3.50it/s]
 96%|█████████▌| 354775/371472 [6:04:23<1:28:10,  3.16it/s]
 96%|█████████▌| 354776/371472 [6:04:23<1:25:16,  3.26it/s]
 96%|█████████▌| 354777/371472 [6:04:24<1:26:26,  3.22it/s]
 96%|█████████▌| 354778/371472 [6:04:24<1:26:56,  3.20it/s]
 96%|█████████▌| 354779/371472 [6:04:24<1:24:54,  3.28it/s]
 96%|█████████▌| 354780/371472 [6:04:25<1:21:58,  3.39it/s]
                                                           
{'loss': 2.6228, 'learning_rate': 1.4046305673468503e-07, 'epoch': 15.28}

 96%|█████████▌| 354780/371472 [6:04:25<1:21:58,  3.39it/s]
 96%|█████████▌| 354781/371472 [6:04:25<1:19:37,  3.49it/s]
 96%|█████████▌| 354782/371472 [6:04:25<1:20:36,  3.45it/s]
 96%|█████████▌| 354783/371472 [6:04:26<1:31:18,  3.05it/s]
 96%|█████████▌| 354784/371472 [6:04:26<1:24:32,  3.29it/s]
 96%|█████████▌| 354785/371472 [6:04:26<1:27:54,  3.16it/s]
 96%|█████████▌| 354786/371472 [6:04:26<1:23:08,  3.34it/s]
 96%|█████████▌| 354787/371472 [6:04:27<1:19:59,  3.48it/s]
 96%|█████████▌| 354788/371472 [6:04:27<1:18:55,  3.52it/s]
 96%|█████████▌| 354789/371472 [6:04:27<1:22:40,  3.36it/s]
 96%|█████████▌| 354790/371472 [6:04:28<1:20:58,  3.43it/s]
 96%|█████████▌| 354791/371472 [6:04:28<1:18:57,  3.52it/s]
 96%|█████████▌| 354792/371472 [6:04:28<1:20:27,  3.46it/s]
 96%|█████████▌| 354793/371472 [6:04:28<1:18:04,  3.56it/s]
 96%|█████████▌| 354794/371472 [6:04:29<1:18:37,  3.54it/s]
 96%|█████████▌| 354795/371472 [6:04:29<1:17:13,  3.60it/s]
 96%|█████████▌| 354796/371472 [6:04:29<1:21:01,  3.43it/s]
 96%|█████████▌| 354797/371472 [6:04:29<1:18:45,  3.53it/s]
 96%|█████████▌| 354798/371472 [6:04:30<1:19:06,  3.51it/s]
 96%|█████████▌| 354799/371472 [6:04:30<1:17:32,  3.58it/s]
 96%|█████████▌| 354800/371472 [6:04:30<1:15:34,  3.68it/s]
                                                           
{'loss': 2.5245, 'learning_rate': 1.4041457475920619e-07, 'epoch': 15.28}

 96%|█████████▌| 354800/371472 [6:04:30<1:15:34,  3.68it/s]
 96%|█████████▌| 354801/371472 [6:04:31<1:13:59,  3.76it/s]
 96%|█████████▌| 354802/371472 [6:04:31<1:14:32,  3.73it/s]
 96%|█████████▌| 354803/371472 [6:04:31<1:19:48,  3.48it/s]
 96%|█████████▌| 354804/371472 [6:04:31<1:18:37,  3.53it/s]
 96%|█████████▌| 354805/371472 [6:04:32<1:21:39,  3.40it/s]
 96%|█████████▌| 354806/371472 [6:04:32<1:20:39,  3.44it/s]
 96%|█████████▌| 354807/371472 [6:04:32<1:19:06,  3.51it/s]
 96%|█████████▌| 354808/371472 [6:04:33<1:17:27,  3.59it/s]
 96%|█████████▌| 354809/371472 [6:04:33<1:20:11,  3.46it/s]
 96%|█████████▌| 354810/371472 [6:04:33<1:17:11,  3.60it/s]
 96%|█████████▌| 354811/371472 [6:04:33<1:19:34,  3.49it/s]
 96%|█████████▌| 354812/371472 [6:04:34<1:20:31,  3.45it/s]
 96%|█████████▌| 354813/371472 [6:04:34<1:23:09,  3.34it/s]
 96%|█████████▌| 354814/371472 [6:04:34<1:20:26,  3.45it/s]
 96%|█████████▌| 354815/371472 [6:04:35<1:23:03,  3.34it/s]
 96%|█████████▌| 354816/371472 [6:04:35<1:24:43,  3.28it/s]
 96%|█████████▌| 354817/371472 [6:04:35<1:21:25,  3.41it/s]
 96%|█████████▌| 354818/371472 [6:04:36<1:20:20,  3.45it/s]
 96%|█████████▌| 354819/371472 [6:04:36<1:19:29,  3.49it/s]
 96%|█████████▌| 354820/371472 [6:04:36<1:17:25,  3.58it/s]
                                                           
{'loss': 2.5262, 'learning_rate': 1.4036609278372726e-07, 'epoch': 15.28}

 96%|█████████▌| 354820/371472 [6:04:36<1:17:25,  3.58it/s]
 96%|█████████▌| 354821/371472 [6:04:36<1:17:11,  3.59it/s]
 96%|█████████▌| 354822/371472 [6:04:37<1:16:49,  3.61it/s]
 96%|█████████▌| 354823/371472 [6:04:37<1:18:30,  3.53it/s]
 96%|█████████▌| 354824/371472 [6:04:37<1:15:27,  3.68it/s]
 96%|█████████▌| 354825/371472 [6:04:37<1:12:46,  3.81it/s]
 96%|█████████▌| 354826/371472 [6:04:38<1:17:18,  3.59it/s]
 96%|█████████▌| 354827/371472 [6:04:38<1:21:06,  3.42it/s]
 96%|█████████▌| 354828/371472 [6:04:38<1:19:00,  3.51it/s]
 96%|█████████▌| 354829/371472 [6:04:39<1:21:08,  3.42it/s]
 96%|█████████▌| 354830/371472 [6:04:39<1:17:24,  3.58it/s]
 96%|█████████▌| 354831/371472 [6:04:39<1:15:25,  3.68it/s]
 96%|█████████▌| 354832/371472 [6:04:39<1:12:24,  3.83it/s]
 96%|█████████▌| 354833/371472 [6:04:40<1:17:12,  3.59it/s]
 96%|█████████▌| 354834/371472 [6:04:40<1:21:41,  3.39it/s]
 96%|█████████▌| 354835/371472 [6:04:40<1:19:59,  3.47it/s]
 96%|█████████▌| 354836/371472 [6:04:41<1:18:31,  3.53it/s]
 96%|█████████▌| 354837/371472 [6:04:41<1:20:07,  3.46it/s]
 96%|█████████▌| 354838/371472 [6:04:41<1:20:58,  3.42it/s]
 96%|█████████▌| 354839/371472 [6:04:41<1:21:10,  3.42it/s]
 96%|█████████▌| 354840/371472 [6:04:42<1:24:45,  3.27it/s]
                                                           
{'loss': 2.6586, 'learning_rate': 1.403176108082484e-07, 'epoch': 15.28}

 96%|█████████▌| 354840/371472 [6:04:42<1:24:45,  3.27it/s]
 96%|█████████▌| 354841/371472 [6:04:42<1:21:21,  3.41it/s]
 96%|█████████▌| 354842/371472 [6:04:42<1:20:48,  3.43it/s]
 96%|█████████▌| 354843/371472 [6:04:43<1:18:21,  3.54it/s]
 96%|█████████▌| 354844/371472 [6:04:43<1:16:44,  3.61it/s]
 96%|█████████▌| 354845/371472 [6:04:43<1:23:10,  3.33it/s]
 96%|█████████▌| 354846/371472 [6:04:43<1:20:02,  3.46it/s]
 96%|█████████▌| 354847/371472 [6:04:44<1:18:44,  3.52it/s]
 96%|█████████▌| 354848/371472 [6:04:44<1:17:38,  3.57it/s]
 96%|█████████▌| 354849/371472 [6:04:44<1:16:38,  3.62it/s]
 96%|█████████▌| 354850/371472 [6:04:45<1:16:58,  3.60it/s]
 96%|█████████▌| 354851/371472 [6:04:45<1:16:25,  3.63it/s]
 96%|█████████▌| 354852/371472 [6:04:45<1:16:42,  3.61it/s]
 96%|█████████▌| 354853/371472 [6:04:46<1:26:12,  3.21it/s]
 96%|█████████▌| 354854/371472 [6:04:46<1:21:04,  3.42it/s]
 96%|█████████▌| 354855/371472 [6:04:46<1:20:36,  3.44it/s]
 96%|█████████▌| 354856/371472 [6:04:46<1:18:54,  3.51it/s]
 96%|█████████▌| 354857/371472 [6:04:47<1:17:25,  3.58it/s]
 96%|█████████▌| 354858/371472 [6:04:47<1:17:55,  3.55it/s]
 96%|█████████▌| 354859/371472 [6:04:47<1:13:48,  3.75it/s]
 96%|█████████▌| 354860/371472 [6:04:47<1:15:41,  3.66it/s]
                                                           
{'loss': 2.521, 'learning_rate': 1.4026912883276948e-07, 'epoch': 15.28}

 96%|█████████▌| 354860/371472 [6:04:47<1:15:41,  3.66it/s]
 96%|█████████▌| 354861/371472 [6:04:48<1:20:26,  3.44it/s]
 96%|█████████▌| 354862/371472 [6:04:48<1:18:54,  3.51it/s]
 96%|█████████▌| 354863/371472 [6:04:48<1:20:37,  3.43it/s]
 96%|█████████▌| 354864/371472 [6:04:49<1:21:58,  3.38it/s]
 96%|█████████▌| 354865/371472 [6:04:49<1:29:05,  3.11it/s]
 96%|█████████▌| 354866/371472 [6:04:49<1:23:43,  3.31it/s]
 96%|█████████▌| 354867/371472 [6:04:50<1:22:04,  3.37it/s]
 96%|█████████▌| 354868/371472 [6:04:50<1:26:47,  3.19it/s]
 96%|█████████▌| 354869/371472 [6:04:50<1:22:15,  3.36it/s]
 96%|█████████▌| 354870/371472 [6:04:50<1:20:31,  3.44it/s]
 96%|█████████▌| 354871/371472 [6:04:51<1:21:54,  3.38it/s]
 96%|█████████▌| 354872/371472 [6:04:51<1:19:47,  3.47it/s]
 96%|█████████▌| 354873/371472 [6:04:51<1:17:42,  3.56it/s]
 96%|█████████▌| 354874/371472 [6:04:52<1:17:54,  3.55it/s]
 96%|█████████▌| 354875/371472 [6:04:52<1:19:10,  3.49it/s]
 96%|█████████▌| 354876/371472 [6:04:52<1:24:52,  3.26it/s]
 96%|█████████▌| 354877/371472 [6:04:52<1:21:30,  3.39it/s]
 96%|█████████▌| 354878/371472 [6:04:53<1:19:42,  3.47it/s]
 96%|█████████▌| 354879/371472 [6:04:53<1:21:02,  3.41it/s]
 96%|█████████▌| 354880/371472 [6:04:53<1:17:04,  3.59it/s]
                                                           
{'loss': 2.6081, 'learning_rate': 1.4022064685729063e-07, 'epoch': 15.29}

 96%|█████████▌| 354880/371472 [6:04:53<1:17:04,  3.59it/s]
 96%|█████████▌| 354881/371472 [6:04:54<1:24:42,  3.26it/s]
 96%|█████████▌| 354882/371472 [6:04:54<1:20:03,  3.45it/s]
 96%|█████████▌| 354883/371472 [6:04:54<1:18:16,  3.53it/s]
 96%|█████████▌| 354884/371472 [6:04:55<1:25:52,  3.22it/s]
 96%|█████████▌| 354885/371472 [6:04:55<1:21:33,  3.39it/s]
 96%|█████████▌| 354886/371472 [6:04:55<1:22:14,  3.36it/s]
 96%|█████████▌| 354887/371472 [6:04:55<1:21:52,  3.38it/s]
 96%|█████████▌| 354888/371472 [6:04:56<1:22:50,  3.34it/s]
 96%|█████████▌| 354889/371472 [6:04:56<1:19:05,  3.49it/s]
 96%|█████████▌| 354890/371472 [6:04:56<1:19:33,  3.47it/s]
 96%|█████████▌| 354891/371472 [6:04:57<1:20:17,  3.44it/s]
 96%|█████████▌| 354892/371472 [6:04:57<1:16:30,  3.61it/s]
 96%|█████████▌| 354893/371472 [6:04:57<1:14:50,  3.69it/s]
 96%|█████████▌| 354894/371472 [6:04:57<1:17:17,  3.57it/s]
 96%|█████████▌| 354895/371472 [6:04:58<1:14:39,  3.70it/s]
 96%|█████████▌| 354896/371472 [6:04:58<1:21:45,  3.38it/s]
 96%|█████████▌| 354897/371472 [6:04:58<1:17:45,  3.55it/s]
 96%|█████████▌| 354898/371472 [6:04:58<1:15:24,  3.66it/s]
 96%|█████████▌| 354899/371472 [6:04:59<1:14:28,  3.71it/s]
 96%|█████████▌| 354900/371472 [6:04:59<1:16:40,  3.60it/s]
                                                           
{'loss': 2.6854, 'learning_rate': 1.4017216488181168e-07, 'epoch': 15.29}

 96%|█████████▌| 354900/371472 [6:04:59<1:16:40,  3.60it/s]
 96%|█████████▌| 354901/371472 [6:04:59<1:16:03,  3.63it/s]
 96%|█████████▌| 354902/371472 [6:05:00<1:13:47,  3.74it/s]
 96%|█████████▌| 354903/371472 [6:05:00<1:13:32,  3.75it/s]
 96%|█████████▌| 354904/371472 [6:05:00<1:11:30,  3.86it/s]
 96%|█████████▌| 354905/371472 [6:05:00<1:10:45,  3.90it/s]
 96%|█████████▌| 354906/371472 [6:05:01<1:11:35,  3.86it/s]
 96%|█████████▌| 354907/371472 [6:05:01<1:10:38,  3.91it/s]
 96%|█████████▌| 354908/371472 [6:05:01<1:13:48,  3.74it/s]
 96%|█████████▌| 354909/371472 [6:05:01<1:11:30,  3.86it/s]
 96%|█████████▌| 354910/371472 [6:05:02<1:14:29,  3.71it/s]
 96%|█████████▌| 354911/371472 [6:05:02<1:15:57,  3.63it/s]
 96%|█████████▌| 354912/371472 [6:05:02<1:21:12,  3.40it/s]
 96%|█████████▌| 354913/371472 [6:05:03<1:24:44,  3.26it/s]
 96%|█████████▌| 354914/371472 [6:05:03<1:21:04,  3.40it/s]
 96%|█████████▌| 354915/371472 [6:05:03<1:19:04,  3.49it/s]
 96%|█████████▌| 354916/371472 [6:05:03<1:15:29,  3.66it/s]
 96%|█████████▌| 354917/371472 [6:05:04<1:15:14,  3.67it/s]
 96%|█████████▌| 354918/371472 [6:05:04<1:15:19,  3.66it/s]
 96%|█████████▌| 354919/371472 [6:05:04<1:15:33,  3.65it/s]
 96%|█████████▌| 354920/371472 [6:05:05<1:18:26,  3.52it/s]
                                                           
{'loss': 2.4633, 'learning_rate': 1.4012368290633285e-07, 'epoch': 15.29}

 96%|█████████▌| 354920/371472 [6:05:05<1:18:26,  3.52it/s]
 96%|█████████▌| 354921/371472 [6:05:05<1:18:54,  3.50it/s]
 96%|█████████▌| 354922/371472 [6:05:05<1:16:29,  3.61it/s]
 96%|█████████▌| 354923/371472 [6:05:05<1:22:06,  3.36it/s]
 96%|█████████▌| 354924/371472 [6:05:06<1:20:24,  3.43it/s]
 96%|█████████▌| 354925/371472 [6:05:06<1:17:48,  3.54it/s]
 96%|█████████▌| 354926/371472 [6:05:06<1:18:40,  3.51it/s]
 96%|█████████▌| 354927/371472 [6:05:07<1:19:24,  3.47it/s]
 96%|█████████▌| 354928/371472 [6:05:07<1:19:28,  3.47it/s]
 96%|█████████▌| 354929/371472 [6:05:07<1:19:32,  3.47it/s]
 96%|█████████▌| 354930/371472 [6:05:07<1:16:22,  3.61it/s]
 96%|█████████▌| 354931/371472 [6:05:08<1:16:02,  3.63it/s]
 96%|█████████▌| 354932/371472 [6:05:08<1:17:19,  3.57it/s]
 96%|█████████▌| 354933/371472 [6:05:08<1:16:04,  3.62it/s]
 96%|█████████▌| 354934/371472 [6:05:08<1:16:28,  3.60it/s]
 96%|█████████▌| 354935/371472 [6:05:09<1:18:43,  3.50it/s]
 96%|█████████▌| 354936/371472 [6:05:09<1:17:16,  3.57it/s]
 96%|█████████▌| 354937/371472 [6:05:09<1:17:20,  3.56it/s]
 96%|█████████▌| 354938/371472 [6:05:10<1:15:59,  3.63it/s]
 96%|█████████▌| 354939/371472 [6:05:10<1:19:05,  3.48it/s]
 96%|█████████▌| 354940/371472 [6:05:10<1:17:15,  3.57it/s]
                                                           
{'loss': 2.5005, 'learning_rate': 1.400752009308539e-07, 'epoch': 15.29}

 96%|█████████▌| 354940/371472 [6:05:10<1:17:15,  3.57it/s]
 96%|█████████▌| 354941/371472 [6:05:10<1:14:48,  3.68it/s]
 96%|█████████▌| 354942/371472 [6:05:11<1:15:43,  3.64it/s]
 96%|█████████▌| 354943/371472 [6:05:11<1:16:53,  3.58it/s]
 96%|█████████▌| 354944/371472 [6:05:11<1:22:58,  3.32it/s]
 96%|█████████▌| 354945/371472 [6:05:12<1:24:13,  3.27it/s]
 96%|█████████▌| 354946/371472 [6:05:12<1:21:14,  3.39it/s]
 96%|█████████▌| 354947/371472 [6:05:12<1:16:46,  3.59it/s]
 96%|█████████▌| 354948/371472 [6:05:13<1:26:29,  3.18it/s]
 96%|█████████▌| 354949/371472 [6:05:13<1:20:56,  3.40it/s]
 96%|█████████▌| 354950/371472 [6:05:13<1:25:25,  3.22it/s]
 96%|█████████▌| 354951/371472 [6:05:13<1:24:43,  3.25it/s]
 96%|█████████▌| 354952/371472 [6:05:14<1:25:17,  3.23it/s]
 96%|█████████▌| 354953/371472 [6:05:14<1:22:18,  3.35it/s]
 96%|█████████▌| 354954/371472 [6:05:14<1:21:11,  3.39it/s]
 96%|█████████▌| 354955/371472 [6:05:15<1:17:42,  3.54it/s]
 96%|█████████▌| 354956/371472 [6:05:15<1:21:40,  3.37it/s]
 96%|█████████▌| 354957/371472 [6:05:15<1:17:10,  3.57it/s]
 96%|█████████▌| 354958/371472 [6:05:15<1:15:34,  3.64it/s]
 96%|█████████▌| 354959/371472 [6:05:16<1:15:30,  3.65it/s]
 96%|█████████▌| 354960/371472 [6:05:16<1:23:31,  3.29it/s]
                                                           
{'loss': 2.5811, 'learning_rate': 1.4002671895537505e-07, 'epoch': 15.29}

 96%|█████████▌| 354960/371472 [6:05:16<1:23:31,  3.29it/s]
 96%|█████████▌| 354961/371472 [6:05:16<1:19:51,  3.45it/s]
 96%|█████████▌| 354962/371472 [6:05:17<1:16:23,  3.60it/s]
 96%|█████████▌| 354963/371472 [6:05:17<1:14:29,  3.69it/s]
 96%|█████████▌| 354964/371472 [6:05:17<1:22:47,  3.32it/s]
 96%|█████████▌| 354965/371472 [6:05:18<1:24:46,  3.25it/s]
 96%|█████████▌| 354966/371472 [6:05:18<1:19:38,  3.45it/s]
 96%|█████████▌| 354967/371472 [6:05:18<1:16:52,  3.58it/s]
 96%|█████████▌| 354968/371472 [6:05:18<1:27:28,  3.14it/s]
 96%|█████████▌| 354969/371472 [6:05:19<1:24:36,  3.25it/s]
 96%|█████████▌| 354970/371472 [6:05:19<1:20:33,  3.41it/s]
 96%|█████████▌| 354971/371472 [6:05:19<1:17:06,  3.57it/s]
 96%|█████████▌| 354972/371472 [6:05:19<1:16:47,  3.58it/s]
 96%|█████████▌| 354973/371472 [6:05:20<1:14:55,  3.67it/s]
 96%|█████████▌| 354974/371472 [6:05:20<1:13:47,  3.73it/s]
 96%|█████████▌| 354975/371472 [6:05:20<1:13:00,  3.77it/s]
 96%|█████████▌| 354976/371472 [6:05:21<1:13:31,  3.74it/s]
 96%|█████████▌| 354977/371472 [6:05:21<1:19:50,  3.44it/s]
 96%|█████████▌| 354978/371472 [6:05:21<1:23:10,  3.31it/s]
 96%|█████████▌| 354979/371472 [6:05:22<1:22:29,  3.33it/s]
 96%|█████████▌| 354980/371472 [6:05:22<1:18:59,  3.48it/s]
                                                           
{'loss': 2.7288, 'learning_rate': 1.3997823697989612e-07, 'epoch': 15.29}

 96%|█████████▌| 354980/371472 [6:05:22<1:18:59,  3.48it/s]
 96%|█████████▌| 354981/371472 [6:05:22<1:23:22,  3.30it/s]
 96%|█████████▌| 354982/371472 [6:05:22<1:20:22,  3.42it/s]
 96%|█████████▌| 354983/371472 [6:05:23<1:18:31,  3.50it/s]
 96%|█████████▌| 354984/371472 [6:05:23<1:17:12,  3.56it/s]
 96%|█████████▌| 354985/371472 [6:05:23<1:15:43,  3.63it/s]
 96%|█████████▌| 354986/371472 [6:05:23<1:14:05,  3.71it/s]
 96%|█████████▌| 354987/371472 [6:05:24<1:14:11,  3.70it/s]
 96%|█████████▌| 354988/371472 [6:05:24<1:14:29,  3.69it/s]
 96%|█████████▌| 354989/371472 [6:05:24<1:15:41,  3.63it/s]
 96%|█████████▌| 354990/371472 [6:05:25<1:18:31,  3.50it/s]
 96%|█████████▌| 354991/371472 [6:05:25<1:21:19,  3.38it/s]
 96%|█████████▌| 354992/371472 [6:05:25<1:24:31,  3.25it/s]
 96%|█████████▌| 354993/371472 [6:05:26<1:25:00,  3.23it/s]
 96%|█████████▌| 354994/371472 [6:05:26<1:23:45,  3.28it/s]
 96%|█████████▌| 354995/371472 [6:05:26<1:22:46,  3.32it/s]
 96%|█████████▌| 354996/371472 [6:05:26<1:23:29,  3.29it/s]
 96%|█████████▌| 354997/371472 [6:05:27<1:18:50,  3.48it/s]
 96%|█████████▌| 354998/371472 [6:05:27<1:26:10,  3.19it/s]
 96%|█████████▌| 354999/371472 [6:05:27<1:24:36,  3.24it/s]
 96%|█████████▌| 355000/371472 [6:05:28<1:29:37,  3.06it/s]
                                                           
{'loss': 2.4586, 'learning_rate': 1.3992975500441727e-07, 'epoch': 15.29}

 96%|█████████▌| 355000/371472 [6:05:28<1:29:37,  3.06it/s]
 96%|█████████▌| 355001/371472 [6:05:28<1:30:16,  3.04it/s]
 96%|█████████▌| 355002/371472 [6:05:28<1:25:23,  3.21it/s]
 96%|█████████▌| 355003/371472 [6:05:29<1:35:18,  2.88it/s]
 96%|█████████▌| 355004/371472 [6:05:29<1:27:41,  3.13it/s]
 96%|█████████▌| 355005/371472 [6:05:29<1:22:22,  3.33it/s]
 96%|█████████▌| 355006/371472 [6:05:30<1:19:58,  3.43it/s]
 96%|█████████▌| 355007/371472 [6:05:30<1:16:16,  3.60it/s]
 96%|█████████▌| 355008/371472 [6:05:30<1:16:56,  3.57it/s]
 96%|█████████▌| 355009/371472 [6:05:30<1:14:32,  3.68it/s]
 96%|█████████▌| 355010/371472 [6:05:31<1:15:01,  3.66it/s]
 96%|█████████▌| 355011/371472 [6:05:31<1:16:13,  3.60it/s]
 96%|█████████▌| 355012/371472 [6:05:31<1:14:48,  3.67it/s]
 96%|█████████▌| 355013/371472 [6:05:32<1:26:40,  3.17it/s]
 96%|█████████▌| 355014/371472 [6:05:32<1:25:31,  3.21it/s]
 96%|█████████▌| 355015/371472 [6:05:32<1:20:44,  3.40it/s]
 96%|█████████▌| 355016/371472 [6:05:32<1:18:13,  3.51it/s]
 96%|█████████▌| 355017/371472 [6:05:33<1:19:04,  3.47it/s]
 96%|█████████▌| 355018/371472 [6:05:33<1:18:46,  3.48it/s]
 96%|█████████▌| 355019/371472 [6:05:33<1:15:13,  3.65it/s]
 96%|█████████▌| 355020/371472 [6:05:33<1:15:12,  3.65it/s]
                                                           
{'loss': 2.6385, 'learning_rate': 1.3988127302893832e-07, 'epoch': 15.29}

 96%|█████████▌| 355020/371472 [6:05:33<1:15:12,  3.65it/s]
 96%|█████████▌| 355021/371472 [6:05:34<1:14:27,  3.68it/s]
 96%|█████████▌| 355022/371472 [6:05:34<1:14:03,  3.70it/s]
 96%|█████████▌| 355023/371472 [6:05:34<1:15:38,  3.62it/s]
 96%|█████████▌| 355024/371472 [6:05:35<1:13:11,  3.75it/s]
 96%|█████████▌| 355025/371472 [6:05:35<1:15:37,  3.62it/s]
 96%|█████████▌| 355026/371472 [6:05:35<1:16:43,  3.57it/s]
 96%|█████████▌| 355027/371472 [6:05:35<1:16:40,  3.57it/s]
 96%|█████████▌| 355028/371472 [6:05:36<1:18:03,  3.51it/s]
 96%|█████████▌| 355029/371472 [6:05:36<1:16:10,  3.60it/s]
 96%|█████████▌| 355030/371472 [6:05:36<1:18:17,  3.50it/s]
 96%|█████████▌| 355031/371472 [6:05:37<1:19:41,  3.44it/s]
 96%|█████████▌| 355032/371472 [6:05:37<1:23:15,  3.29it/s]
 96%|█████████▌| 355033/371472 [6:05:37<1:24:09,  3.26it/s]
 96%|█████████▌| 355034/371472 [6:05:38<1:24:08,  3.26it/s]
 96%|█████████▌| 355035/371472 [6:05:38<1:20:28,  3.40it/s]
 96%|█████████▌| 355036/371472 [6:05:38<1:21:59,  3.34it/s]
 96%|█████████▌| 355037/371472 [6:05:38<1:18:35,  3.49it/s]
 96%|█████████▌| 355038/371472 [6:05:39<1:18:07,  3.51it/s]
 96%|█████████▌| 355039/371472 [6:05:39<1:18:09,  3.50it/s]
 96%|█████████▌| 355040/371472 [6:05:39<1:15:42,  3.62it/s]
                                                           
{'loss': 2.5244, 'learning_rate': 1.398327910534595e-07, 'epoch': 15.29}

 96%|█████████▌| 355040/371472 [6:05:39<1:15:42,  3.62it/s]
 96%|█████████▌| 355041/371472 [6:05:39<1:14:32,  3.67it/s]
 96%|█████████▌| 355042/371472 [6:05:40<1:16:55,  3.56it/s]
 96%|█████████▌| 355043/371472 [6:05:40<1:16:19,  3.59it/s]
 96%|█████████▌| 355044/371472 [6:05:40<1:17:02,  3.55it/s]
 96%|█████████▌| 355045/371472 [6:05:41<1:13:11,  3.74it/s]
 96%|█████████▌| 355046/371472 [6:05:41<1:13:05,  3.75it/s]
 96%|█████████▌| 355047/371472 [6:05:41<1:10:52,  3.86it/s]
 96%|█████████▌| 355048/371472 [6:05:41<1:09:36,  3.93it/s]
 96%|█████████▌| 355049/371472 [6:05:42<1:15:03,  3.65it/s]
 96%|█████████▌| 355050/371472 [6:05:42<1:20:39,  3.39it/s]
 96%|█████████▌| 355051/371472 [6:05:42<1:19:36,  3.44it/s]
 96%|█████████▌| 355052/371472 [6:05:43<1:20:46,  3.39it/s]
 96%|█████████▌| 355053/371472 [6:05:43<1:22:32,  3.32it/s]
 96%|█████████▌| 355054/371472 [6:05:43<1:20:17,  3.41it/s]
 96%|█████████▌| 355055/371472 [6:05:43<1:19:49,  3.43it/s]
 96%|█████████▌| 355056/371472 [6:05:44<1:18:09,  3.50it/s]
 96%|█████████▌| 355057/371472 [6:05:44<1:22:21,  3.32it/s]
 96%|█████████▌| 355058/371472 [6:05:44<1:17:50,  3.51it/s]
 96%|█████████▌| 355059/371472 [6:05:45<1:17:22,  3.54it/s]
 96%|█████████▌| 355060/371472 [6:05:45<1:14:27,  3.67it/s]
                                                           
{'loss': 2.6683, 'learning_rate': 1.3978430907798054e-07, 'epoch': 15.29}

 96%|█████████▌| 355060/371472 [6:05:45<1:14:27,  3.67it/s]
 96%|█████████▌| 355061/371472 [6:05:45<1:20:35,  3.39it/s]
 96%|█████████▌| 355062/371472 [6:05:45<1:17:00,  3.55it/s]
 96%|█████████▌| 355063/371472 [6:05:46<1:13:53,  3.70it/s]
 96%|█████████▌| 355064/371472 [6:05:46<1:15:35,  3.62it/s]
 96%|█████████▌| 355065/371472 [6:05:46<1:14:34,  3.67it/s]
 96%|█████████▌| 355066/371472 [6:05:46<1:13:24,  3.73it/s]
 96%|█████████▌| 355067/371472 [6:05:47<1:17:04,  3.55it/s]
 96%|█████████▌| 355068/371472 [6:05:47<1:17:33,  3.53it/s]
 96%|█████████▌| 355069/371472 [6:05:47<1:18:24,  3.49it/s]
 96%|█████████▌| 355070/371472 [6:05:48<1:15:31,  3.62it/s]
 96%|█████████▌| 355071/371472 [6:05:48<1:18:42,  3.47it/s]
 96%|█████████▌| 355072/371472 [6:05:48<1:16:38,  3.57it/s]
 96%|█████████▌| 355073/371472 [6:05:48<1:14:36,  3.66it/s]
 96%|█████████▌| 355074/371472 [6:05:49<1:16:06,  3.59it/s]
 96%|█████████▌| 355075/371472 [6:05:49<1:15:30,  3.62it/s]
 96%|█████████▌| 355076/371472 [6:05:49<1:18:44,  3.47it/s]
 96%|█████████▌| 355077/371472 [6:05:50<1:16:21,  3.58it/s]
 96%|█████████▌| 355078/371472 [6:05:50<1:13:55,  3.70it/s]
 96%|█████████▌| 355079/371472 [6:05:50<1:16:15,  3.58it/s]
 96%|█████████▌| 355080/371472 [6:05:50<1:17:32,  3.52it/s]
                                                           
{'loss': 2.5025, 'learning_rate': 1.397358271025017e-07, 'epoch': 15.29}

 96%|█████████▌| 355080/371472 [6:05:50<1:17:32,  3.52it/s]
 96%|█████████▌| 355081/371472 [6:05:51<1:16:52,  3.55it/s]
 96%|█████████▌| 355082/371472 [6:05:51<1:19:54,  3.42it/s]
 96%|█████████▌| 355083/371472 [6:05:51<1:25:42,  3.19it/s]
 96%|█████████▌| 355084/371472 [6:05:52<1:32:59,  2.94it/s]
 96%|█████████▌| 355085/371472 [6:05:52<1:27:44,  3.11it/s]
 96%|█████████▌| 355086/371472 [6:05:52<1:24:26,  3.23it/s]
 96%|█████████▌| 355087/371472 [6:05:53<1:20:47,  3.38it/s]
 96%|█████████▌| 355088/371472 [6:05:53<1:24:17,  3.24it/s]
 96%|█████████▌| 355089/371472 [6:05:53<1:21:39,  3.34it/s]
 96%|█████████▌| 355090/371472 [6:05:54<1:19:18,  3.44it/s]
 96%|█████████▌| 355091/371472 [6:05:54<1:16:54,  3.55it/s]
 96%|█████████▌| 355092/371472 [6:05:54<1:29:13,  3.06it/s]
 96%|█████████▌| 355093/371472 [6:05:54<1:23:16,  3.28it/s]
 96%|█████████▌| 355094/371472 [6:05:55<1:17:43,  3.51it/s]
 96%|█████████▌| 355095/371472 [6:05:55<1:15:31,  3.61it/s]
 96%|█████████▌| 355096/371472 [6:05:55<1:14:02,  3.69it/s]
 96%|█████████▌| 355097/371472 [6:05:56<1:16:23,  3.57it/s]
 96%|█████████▌| 355098/371472 [6:05:56<1:14:52,  3.64it/s]
 96%|█████████▌| 355099/371472 [6:05:56<1:14:20,  3.67it/s]
 96%|█████████▌| 355100/371472 [6:05:56<1:19:13,  3.44it/s]
                                                           
{'loss': 2.5527, 'learning_rate': 1.3968734512702276e-07, 'epoch': 15.29}

 96%|█████████▌| 355100/371472 [6:05:56<1:19:13,  3.44it/s]
 96%|█████████▌| 355101/371472 [6:05:57<1:19:01,  3.45it/s]
 96%|█████████▌| 355102/371472 [6:05:57<1:17:19,  3.53it/s]
 96%|█████████▌| 355103/371472 [6:05:57<1:14:32,  3.66it/s]
 96%|█████████▌| 355104/371472 [6:05:58<1:19:28,  3.43it/s]
 96%|█████████▌| 355105/371472 [6:05:58<1:19:13,  3.44it/s]
 96%|█████████▌| 355106/371472 [6:05:58<1:17:15,  3.53it/s]
 96%|█████████▌| 355107/371472 [6:05:58<1:19:07,  3.45it/s]
 96%|█████████▌| 355108/371472 [6:05:59<1:14:34,  3.66it/s]
 96%|█████████▌| 355109/371472 [6:05:59<1:17:08,  3.54it/s]
 96%|█████████▌| 355110/371472 [6:05:59<1:14:23,  3.67it/s]
 96%|█████████▌| 355111/371472 [6:05:59<1:15:08,  3.63it/s]
 96%|█████████▌| 355112/371472 [6:06:00<1:17:53,  3.50it/s]
 96%|█████████▌| 355113/371472 [6:06:00<1:22:31,  3.30it/s]
 96%|█████████▌| 355114/371472 [6:06:00<1:25:36,  3.18it/s]
 96%|█████████▌| 355115/371472 [6:06:01<1:21:45,  3.33it/s]
 96%|█████████▌| 355116/371472 [6:06:01<1:18:23,  3.48it/s]
 96%|█████████▌| 355117/371472 [6:06:01<1:20:18,  3.39it/s]
 96%|█████████▌| 355118/371472 [6:06:02<1:16:27,  3.56it/s]
 96%|█████████▌| 355119/371472 [6:06:02<1:13:51,  3.69it/s]
 96%|█████████▌| 355120/371472 [6:06:02<1:12:38,  3.75it/s]
                                                           
{'loss': 2.5698, 'learning_rate': 1.396388631515439e-07, 'epoch': 15.3}

 96%|█████████▌| 355120/371472 [6:06:02<1:12:38,  3.75it/s]
 96%|█████████▌| 355121/371472 [6:06:02<1:13:09,  3.73it/s]
 96%|█████████▌| 355122/371472 [6:06:03<1:18:22,  3.48it/s]
 96%|█████████▌| 355123/371472 [6:06:03<1:16:38,  3.56it/s]
 96%|█████████▌| 355124/371472 [6:06:03<1:15:25,  3.61it/s]
 96%|█████████▌| 355125/371472 [6:06:03<1:13:57,  3.68it/s]
 96%|█████████▌| 355126/371472 [6:06:04<1:13:12,  3.72it/s]
 96%|█████████▌| 355127/371472 [6:06:04<1:13:50,  3.69it/s]
 96%|█████████▌| 355128/371472 [6:06:04<1:15:11,  3.62it/s]
 96%|█████████▌| 355129/371472 [6:06:05<1:19:29,  3.43it/s]
 96%|█████████▌| 355130/371472 [6:06:05<1:21:15,  3.35it/s]
 96%|█████████▌| 355131/371472 [6:06:05<1:21:39,  3.34it/s]
 96%|█████████▌| 355132/371472 [6:06:05<1:18:05,  3.49it/s]
 96%|█████████▌| 355133/371472 [6:06:06<1:15:22,  3.61it/s]
 96%|█████████▌| 355134/371472 [6:06:06<1:14:14,  3.67it/s]
 96%|█████████▌| 355135/371472 [6:06:06<1:16:33,  3.56it/s]
 96%|█████████▌| 355136/371472 [6:06:07<1:14:40,  3.65it/s]
 96%|█████████▌| 355137/371472 [6:06:07<1:20:00,  3.40it/s]
 96%|█████████▌| 355138/371472 [6:06:07<1:19:31,  3.42it/s]
 96%|█████████▌| 355139/371472 [6:06:07<1:21:55,  3.32it/s]
 96%|█████████▌| 355140/371472 [6:06:08<1:18:46,  3.46it/s]
                                                           
{'loss': 2.7704, 'learning_rate': 1.3959038117606498e-07, 'epoch': 15.3}

 96%|█████████▌| 355140/371472 [6:06:08<1:18:46,  3.46it/s]
 96%|█████████▌| 355141/371472 [6:06:08<1:17:29,  3.51it/s]
 96%|█████████▌| 355142/371472 [6:06:08<1:30:28,  3.01it/s]
 96%|█████████▌| 355143/371472 [6:06:09<1:25:32,  3.18it/s]
 96%|█████████▌| 355144/371472 [6:06:09<1:20:17,  3.39it/s]
 96%|█████████▌| 355145/371472 [6:06:09<1:19:03,  3.44it/s]
 96%|█████████▌| 355146/371472 [6:06:10<1:17:50,  3.50it/s]
 96%|█████████▌| 355147/371472 [6:06:10<1:17:43,  3.50it/s]
 96%|█████████▌| 355148/371472 [6:06:10<1:15:54,  3.58it/s]
 96%|█████████▌| 355149/371472 [6:06:10<1:17:23,  3.51it/s]
 96%|█████████▌| 355150/371472 [6:06:11<1:14:25,  3.66it/s]
 96%|█████████▌| 355151/371472 [6:06:11<1:19:25,  3.43it/s]
 96%|█████████▌| 355152/371472 [6:06:11<1:27:14,  3.12it/s]
 96%|█████████▌| 355153/371472 [6:06:12<1:22:40,  3.29it/s]
 96%|█████████▌| 355154/371472 [6:06:12<1:19:10,  3.43it/s]
 96%|█████████▌| 355155/371472 [6:06:12<1:16:33,  3.55it/s]
 96%|█████████▌| 355156/371472 [6:06:12<1:17:14,  3.52it/s]
 96%|█████████▌| 355157/371472 [6:06:13<1:17:56,  3.49it/s]
 96%|█████████▌| 355158/371472 [6:06:13<1:14:28,  3.65it/s]
 96%|█████████▌| 355159/371472 [6:06:13<1:14:01,  3.67it/s]
 96%|█████████▌| 355160/371472 [6:06:13<1:13:06,  3.72it/s]
                                                           
{'loss': 2.406, 'learning_rate': 1.3954189920058613e-07, 'epoch': 15.3}

 96%|█████████▌| 355160/371472 [6:06:13<1:13:06,  3.72it/s]
 96%|█████████▌| 355161/371472 [6:06:14<1:16:09,  3.57it/s]
 96%|█████████▌| 355162/371472 [6:06:14<1:17:02,  3.53it/s]
 96%|█████████▌| 355163/371472 [6:06:14<1:19:54,  3.40it/s]
 96%|█████████▌| 355164/371472 [6:06:15<1:18:45,  3.45it/s]
 96%|█████████▌| 355165/371472 [6:06:15<1:21:07,  3.35it/s]
 96%|█████████▌| 355166/371472 [6:06:15<1:18:48,  3.45it/s]
 96%|█████████▌| 355167/371472 [6:06:16<1:14:49,  3.63it/s]
 96%|█████████▌| 355168/371472 [6:06:16<1:17:34,  3.50it/s]
 96%|█████████▌| 355169/371472 [6:06:16<1:21:40,  3.33it/s]
 96%|█████████▌| 355170/371472 [6:06:16<1:18:41,  3.45it/s]
 96%|█████████▌| 355171/371472 [6:06:17<1:19:32,  3.42it/s]
 96%|█████████▌| 355172/371472 [6:06:17<1:16:44,  3.54it/s]
 96%|█████████▌| 355173/371472 [6:06:17<1:16:04,  3.57it/s]
 96%|█████████▌| 355174/371472 [6:06:18<1:17:16,  3.52it/s]
 96%|█████████▌| 355175/371472 [6:06:18<1:14:43,  3.63it/s]
 96%|█████████▌| 355176/371472 [6:06:18<1:14:43,  3.63it/s]
 96%|█████████▌| 355177/371472 [6:06:18<1:16:42,  3.54it/s]
 96%|█████████▌| 355178/371472 [6:06:19<1:18:49,  3.45it/s]
 96%|█████████▌| 355179/371472 [6:06:19<1:16:52,  3.53it/s]
 96%|█████████▌| 355180/371472 [6:06:19<1:16:39,  3.54it/s]
                                                           
{'loss': 2.8004, 'learning_rate': 1.394934172251072e-07, 'epoch': 15.3}

 96%|█████████▌| 355180/371472 [6:06:19<1:16:39,  3.54it/s]
 96%|█████████▌| 355181/371472 [6:06:20<1:17:21,  3.51it/s]
 96%|█████████▌| 355182/371472 [6:06:20<1:15:19,  3.60it/s]
 96%|█████████▌| 355183/371472 [6:06:20<1:13:58,  3.67it/s]
 96%|█████████▌| 355184/371472 [6:06:20<1:12:05,  3.77it/s]
 96%|█████████▌| 355185/371472 [6:06:21<1:13:34,  3.69it/s]
 96%|█████████▌| 355186/371472 [6:06:21<1:18:40,  3.45it/s]
 96%|█████████▌| 355187/371472 [6:06:21<1:21:39,  3.32it/s]
 96%|█████████▌| 355188/371472 [6:06:22<1:25:50,  3.16it/s]
 96%|█████████▌| 355189/371472 [6:06:22<1:23:38,  3.24it/s]
 96%|█████████▌| 355190/371472 [6:06:22<1:19:08,  3.43it/s]
 96%|█████████▌| 355191/371472 [6:06:22<1:16:13,  3.56it/s]
 96%|█████████▌| 355192/371472 [6:06:23<1:16:11,  3.56it/s]
 96%|█████████▌| 355193/371472 [6:06:23<1:16:59,  3.52it/s]
 96%|█████████▌| 355194/371472 [6:06:23<1:18:25,  3.46it/s]
 96%|█████████▌| 355195/371472 [6:06:24<1:15:44,  3.58it/s]
 96%|█████████▌| 355196/371472 [6:06:24<1:15:44,  3.58it/s]
 96%|█████████▌| 355197/371472 [6:06:24<1:19:36,  3.41it/s]
 96%|█████████▌| 355198/371472 [6:06:24<1:16:24,  3.55it/s]
 96%|█████████▌| 355199/371472 [6:06:25<1:14:04,  3.66it/s]
 96%|█████████▌| 355200/371472 [6:06:25<1:12:30,  3.74it/s]
                                                           
{'loss': 2.5196, 'learning_rate': 1.3944493524962836e-07, 'epoch': 15.3}

 96%|█████████▌| 355200/371472 [6:06:25<1:12:30,  3.74it/s]
 96%|█████████▌| 355201/371472 [6:06:25<1:14:02,  3.66it/s]
 96%|█████████▌| 355202/371472 [6:06:25<1:13:30,  3.69it/s]
 96%|█████████▌| 355203/371472 [6:06:26<1:16:08,  3.56it/s]
 96%|█████████▌| 355204/371472 [6:06:26<1:15:39,  3.58it/s]
 96%|█████████▌| 355205/371472 [6:06:26<1:16:51,  3.53it/s]
 96%|█████████▌| 355206/371472 [6:06:27<1:20:43,  3.36it/s]
 96%|█████████▌| 355207/371472 [6:06:27<1:18:26,  3.46it/s]
 96%|█████████▌| 355208/371472 [6:06:27<1:18:54,  3.43it/s]
 96%|█████████▌| 355209/371472 [6:06:28<1:21:37,  3.32it/s]
 96%|█████████▌| 355210/371472 [6:06:28<1:20:52,  3.35it/s]
 96%|█████████▌| 355211/371472 [6:06:28<1:16:18,  3.55it/s]
 96%|█████████▌| 355212/371472 [6:06:28<1:16:11,  3.56it/s]
 96%|█████████▌| 355213/371472 [6:06:29<1:15:13,  3.60it/s]
 96%|█████████▌| 355214/371472 [6:06:29<1:16:59,  3.52it/s]
 96%|█████████▌| 355215/371472 [6:06:29<1:21:50,  3.31it/s]
 96%|█████████▌| 355216/371472 [6:06:30<1:27:01,  3.11it/s]
 96%|█████████▌| 355217/371472 [6:06:30<1:26:25,  3.13it/s]
 96%|█████████▌| 355218/371472 [6:06:30<1:24:10,  3.22it/s]
 96%|█████████▌| 355219/371472 [6:06:31<1:21:24,  3.33it/s]
 96%|█████████▌| 355220/371472 [6:06:31<1:20:33,  3.36it/s]
                                                           
{'loss': 2.665, 'learning_rate': 1.393964532741494e-07, 'epoch': 15.3}

 96%|█████████▌| 355220/371472 [6:06:31<1:20:33,  3.36it/s]
 96%|█████████▌| 355221/371472 [6:06:31<1:18:13,  3.46it/s]
 96%|█████████▌| 355222/371472 [6:06:31<1:16:43,  3.53it/s]
 96%|█████████▌| 355223/371472 [6:06:32<1:17:44,  3.48it/s]
 96%|█████████▌| 355224/371472 [6:06:32<1:18:37,  3.44it/s]
 96%|█████████▌| 355225/371472 [6:06:32<1:17:57,  3.47it/s]
 96%|█████████▌| 355226/371472 [6:06:33<1:22:50,  3.27it/s]
 96%|█████████▌| 355227/371472 [6:06:33<1:20:24,  3.37it/s]
 96%|█████████▌| 355228/371472 [6:06:33<1:17:53,  3.48it/s]
 96%|█████████▌| 355229/371472 [6:06:33<1:16:19,  3.55it/s]
 96%|█████████▌| 355230/371472 [6:06:34<1:21:02,  3.34it/s]
 96%|█████████▌| 355231/371472 [6:06:34<1:17:27,  3.49it/s]
 96%|█████████▌| 355232/371472 [6:06:34<1:18:45,  3.44it/s]
 96%|█████████▌| 355233/371472 [6:06:35<1:16:26,  3.54it/s]
 96%|█████████▌| 355234/371472 [6:06:35<1:16:50,  3.52it/s]
 96%|█████████▌| 355235/371472 [6:06:35<1:15:46,  3.57it/s]
 96%|█████████▌| 355236/371472 [6:06:35<1:19:16,  3.41it/s]
 96%|█████████▌| 355237/371472 [6:06:36<1:15:53,  3.57it/s]
 96%|█████████▌| 355238/371472 [6:06:36<1:17:16,  3.50it/s]
 96%|█████████▌| 355239/371472 [6:06:36<1:18:53,  3.43it/s]
 96%|█████████▌| 355240/371472 [6:06:37<1:20:20,  3.37it/s]
                                                           
{'loss': 2.6103, 'learning_rate': 1.3934797129867047e-07, 'epoch': 15.3}

 96%|█████████▌| 355240/371472 [6:06:37<1:20:20,  3.37it/s]
 96%|█████████▌| 355241/371472 [6:06:37<1:35:47,  2.82it/s]
 96%|█████████▌| 355242/371472 [6:06:37<1:28:16,  3.06it/s]
 96%|█████████▌| 355243/371472 [6:06:38<1:23:55,  3.22it/s]
 96%|█████████▌| 355244/371472 [6:06:38<1:26:30,  3.13it/s]
 96%|█████████▌| 355245/371472 [6:06:38<1:23:12,  3.25it/s]
 96%|█████████▌| 355246/371472 [6:06:39<1:21:18,  3.33it/s]
 96%|█████████▌| 355247/371472 [6:06:39<1:18:22,  3.45it/s]
 96%|█████████▌| 355248/371472 [6:06:39<1:23:05,  3.25it/s]
 96%|█████████▌| 355249/371472 [6:06:39<1:19:01,  3.42it/s]
 96%|█████████▌| 355250/371472 [6:06:40<1:20:05,  3.38it/s]
 96%|█████████▌| 355251/371472 [6:06:40<1:21:41,  3.31it/s]
 96%|█████████▌| 355252/371472 [6:06:40<1:17:27,  3.49it/s]
 96%|█████████▌| 355253/371472 [6:06:41<1:17:44,  3.48it/s]
 96%|█████████▌| 355254/371472 [6:06:41<1:17:32,  3.49it/s]
 96%|█████████▌| 355255/371472 [6:06:41<1:16:10,  3.55it/s]
 96%|█████████▌| 355256/371472 [6:06:41<1:18:24,  3.45it/s]
 96%|█████████▌| 355257/371472 [6:06:42<1:18:41,  3.43it/s]
 96%|█████████▌| 355258/371472 [6:06:42<1:15:30,  3.58it/s]
 96%|█████████▌| 355259/371472 [6:06:42<1:16:07,  3.55it/s]
 96%|█████████▌| 355260/371472 [6:06:42<1:15:03,  3.60it/s]
                                                           
{'loss': 2.587, 'learning_rate': 1.3929948932319162e-07, 'epoch': 15.3}

 96%|█████████▌| 355260/371472 [6:06:43<1:15:03,  3.60it/s]
 96%|█████████▌| 355261/371472 [6:06:43<1:14:56,  3.61it/s]
 96%|█████████▌| 355262/371472 [6:06:43<1:14:58,  3.60it/s]
 96%|█████████▌| 355263/371472 [6:06:43<1:18:37,  3.44it/s]
 96%|█████████▌| 355264/371472 [6:06:44<1:20:41,  3.35it/s]
 96%|█████████▌| 355265/371472 [6:06:44<1:24:13,  3.21it/s]
 96%|█████████▌| 355266/371472 [6:06:44<1:19:44,  3.39it/s]
 96%|█████████▌| 355267/371472 [6:06:45<1:19:20,  3.40it/s]
 96%|█████████▌| 355268/371472 [6:06:45<1:15:17,  3.59it/s]
 96%|█████████▌| 355269/371472 [6:06:45<1:12:56,  3.70it/s]
 96%|█████████▌| 355270/371472 [6:06:45<1:13:46,  3.66it/s]
 96%|█████████▌| 355271/371472 [6:06:46<1:12:38,  3.72it/s]
 96%|█████████▌| 355272/371472 [6:06:46<1:10:40,  3.82it/s]
 96%|█████████▌| 355273/371472 [6:06:46<1:15:32,  3.57it/s]
 96%|█████████▌| 355274/371472 [6:06:46<1:13:26,  3.68it/s]
 96%|█████████▌| 355275/371472 [6:06:47<1:14:48,  3.61it/s]
 96%|█████████▌| 355276/371472 [6:06:47<1:13:38,  3.67it/s]
 96%|█████████▌| 355277/371472 [6:06:47<1:20:18,  3.36it/s]
 96%|█████████▌| 355278/371472 [6:06:48<1:18:05,  3.46it/s]
 96%|█████████▌| 355279/371472 [6:06:48<1:15:12,  3.59it/s]
 96%|█████████▌| 355280/371472 [6:06:48<1:12:16,  3.73it/s]
                                                           
{'loss': 2.7581, 'learning_rate': 1.3925100734771267e-07, 'epoch': 15.3}

 96%|█████████▌| 355280/371472 [6:06:48<1:12:16,  3.73it/s]
 96%|█████████▌| 355281/371472 [6:06:48<1:18:46,  3.43it/s]
 96%|█████████▌| 355282/371472 [6:06:49<1:20:05,  3.37it/s]
 96%|█████████▌| 355283/371472 [6:06:49<1:17:07,  3.50it/s]
 96%|█████████▌| 355284/371472 [6:06:49<1:15:14,  3.59it/s]
 96%|█████████▌| 355285/371472 [6:06:50<1:16:32,  3.52it/s]
 96%|█████████▌| 355286/371472 [6:06:50<1:17:07,  3.50it/s]
 96%|█████████▌| 355287/371472 [6:06:50<1:14:25,  3.62it/s]
 96%|█████████▌| 355288/371472 [6:06:50<1:16:13,  3.54it/s]
 96%|█████████▌| 355289/371472 [6:06:51<1:16:49,  3.51it/s]
 96%|█████████▌| 355290/371472 [6:06:51<1:15:21,  3.58it/s]
 96%|█████████▌| 355291/371472 [6:06:51<1:13:09,  3.69it/s]
 96%|█████████▌| 355292/371472 [6:06:52<1:13:35,  3.66it/s]
 96%|█████████▌| 355293/371472 [6:06:52<1:14:26,  3.62it/s]
 96%|█████████▌| 355294/371472 [6:06:52<1:12:37,  3.71it/s]
 96%|█████████▌| 355295/371472 [6:06:52<1:18:51,  3.42it/s]
 96%|█████████▌| 355296/371472 [6:06:53<1:18:58,  3.41it/s]
 96%|█████████▌| 355297/371472 [6:06:53<1:15:58,  3.55it/s]
 96%|█████████▌| 355298/371472 [6:06:53<1:14:48,  3.60it/s]
 96%|█████████▌| 355299/371472 [6:06:53<1:15:08,  3.59it/s]
 96%|█████████▌| 355300/371472 [6:06:54<1:20:56,  3.33it/s]
                                                           
{'loss': 2.5031, 'learning_rate': 1.3920252537223385e-07, 'epoch': 15.3}

 96%|█████████▌| 355300/371472 [6:06:54<1:20:56,  3.33it/s]
 96%|█████████▌| 355301/371472 [6:06:54<1:16:31,  3.52it/s]
 96%|█████████▌| 355302/371472 [6:06:54<1:16:30,  3.52it/s]
 96%|█████████▌| 355303/371472 [6:06:55<1:15:52,  3.55it/s]
 96%|█████████▌| 355304/371472 [6:06:55<1:16:17,  3.53it/s]
 96%|█████████▌| 355305/371472 [6:06:55<1:14:05,  3.64it/s]
 96%|█████████▌| 355306/371472 [6:06:55<1:15:06,  3.59it/s]
 96%|█████████▌| 355307/371472 [6:06:56<1:16:01,  3.54it/s]
 96%|█████████▌| 355308/371472 [6:06:56<1:14:52,  3.60it/s]
 96%|█████████▌| 355309/371472 [6:06:56<1:14:41,  3.61it/s]
 96%|█████████▌| 355310/371472 [6:06:57<1:15:43,  3.56it/s]
 96%|█████████▌| 355311/371472 [6:06:57<1:13:16,  3.68it/s]
 96%|█████████▌| 355312/371472 [6:06:57<1:14:21,  3.62it/s]
 96%|█████████▌| 355313/371472 [6:06:58<1:26:25,  3.12it/s]
 96%|█████████▌| 355314/371472 [6:06:58<1:22:10,  3.28it/s]
 96%|█████████▌| 355315/371472 [6:06:58<1:19:20,  3.39it/s]
 96%|█████████▌| 355316/371472 [6:06:58<1:18:19,  3.44it/s]
 96%|█████████▌| 355317/371472 [6:06:59<1:15:56,  3.55it/s]
 96%|█████████▌| 355318/371472 [6:06:59<1:17:06,  3.49it/s]
 96%|█████████▌| 355319/371472 [6:06:59<1:16:21,  3.53it/s]
 96%|█████████▌| 355320/371472 [6:06:59<1:14:33,  3.61it/s]
                                                           
{'loss': 2.8277, 'learning_rate': 1.3915404339675487e-07, 'epoch': 15.3}

 96%|█████████▌| 355320/371472 [6:06:59<1:14:33,  3.61it/s]
 96%|█████████▌| 355321/371472 [6:07:00<1:14:50,  3.60it/s]
 96%|█████████▌| 355322/371472 [6:07:00<1:13:04,  3.68it/s]
 96%|█████████▌| 355323/371472 [6:07:00<1:13:23,  3.67it/s]
 96%|█████████▌| 355324/371472 [6:07:01<1:12:56,  3.69it/s]
 96%|█████████▌| 355325/371472 [6:07:01<1:12:50,  3.69it/s]
 96%|█████████▌| 355326/371472 [6:07:01<1:22:39,  3.26it/s]
 96%|█████████▌| 355327/371472 [6:07:01<1:18:34,  3.42it/s]
 96%|█████████▌| 355328/371472 [6:07:02<1:20:11,  3.36it/s]
 96%|█████████▌| 355329/371472 [6:07:02<1:18:03,  3.45it/s]
 96%|█████████▌| 355330/371472 [6:07:02<1:16:39,  3.51it/s]
 96%|█████████▌| 355331/371472 [6:07:03<1:14:54,  3.59it/s]
 96%|█████████▌| 355332/371472 [6:07:03<1:14:46,  3.60it/s]
 96%|█████████▌| 355333/371472 [6:07:03<1:12:55,  3.69it/s]
 96%|█████████▌| 355334/371472 [6:07:03<1:12:43,  3.70it/s]
 96%|█████████▌| 355335/371472 [6:07:04<1:13:30,  3.66it/s]
 96%|█████████▌| 355336/371472 [6:07:04<1:14:04,  3.63it/s]
 96%|█████████▌| 355337/371472 [6:07:04<1:13:24,  3.66it/s]
 96%|█████████▌| 355338/371472 [6:07:05<1:13:06,  3.68it/s]
 96%|█████████▌| 355339/371472 [6:07:05<1:13:35,  3.65it/s]
 96%|█████████▌| 355340/371472 [6:07:05<1:13:06,  3.68it/s]
                                                           
{'loss': 2.5798, 'learning_rate': 1.3910556142127604e-07, 'epoch': 15.31}

 96%|█████████▌| 355340/371472 [6:07:05<1:13:06,  3.68it/s]
 96%|█████████▌| 355341/371472 [6:07:05<1:14:32,  3.61it/s]
 96%|█████████▌| 355342/371472 [6:07:06<1:14:16,  3.62it/s]
 96%|█████████▌| 355343/371472 [6:07:06<1:13:42,  3.65it/s]
 96%|█████████▌| 355344/371472 [6:07:06<1:19:06,  3.40it/s]
 96%|█████████▌| 355345/371472 [6:07:06<1:15:19,  3.57it/s]
 96%|█████████▌| 355346/371472 [6:07:07<1:14:58,  3.59it/s]
 96%|█████████▌| 355347/371472 [6:07:07<1:16:59,  3.49it/s]
 96%|█████████▌| 355348/371472 [6:07:07<1:17:51,  3.45it/s]
 96%|█████████▌| 355349/371472 [6:07:08<1:15:10,  3.57it/s]
 96%|█████████▌| 355350/371472 [6:07:08<1:13:06,  3.68it/s]
 96%|█████████▌| 355351/371472 [6:07:08<1:12:12,  3.72it/s]
 96%|█████████▌| 355352/371472 [6:07:08<1:10:55,  3.79it/s]
 96%|█████████▌| 355353/371472 [6:07:09<1:12:49,  3.69it/s]
 96%|█████████▌| 355354/371472 [6:07:09<1:16:02,  3.53it/s]
 96%|█████████▌| 355355/371472 [6:07:09<1:13:51,  3.64it/s]
 96%|█████████▌| 355356/371472 [6:07:10<1:16:16,  3.52it/s]
 96%|█████████▌| 355357/371472 [6:07:10<1:14:46,  3.59it/s]
 96%|█████████▌| 355358/371472 [6:07:10<1:20:17,  3.34it/s]
 96%|█████████▌| 355359/371472 [6:07:10<1:22:58,  3.24it/s]
 96%|█████████▌| 355360/371472 [6:07:11<1:20:12,  3.35it/s]
                                                           
{'loss': 2.566, 'learning_rate': 1.3905707944579711e-07, 'epoch': 15.31}

 96%|█████████▌| 355360/371472 [6:07:11<1:20:12,  3.35it/s]
 96%|█████████▌| 355361/371472 [6:07:11<1:18:52,  3.40it/s]
 96%|█████████▌| 355362/371472 [6:07:11<1:16:36,  3.51it/s]
 96%|█████████▌| 355363/371472 [6:07:12<1:18:57,  3.40it/s]
 96%|█████████▌| 355364/371472 [6:07:12<1:19:03,  3.40it/s]
 96%|█████████▌| 355365/371472 [6:07:12<1:18:30,  3.42it/s]
 96%|█████████▌| 355366/371472 [6:07:13<1:21:28,  3.29it/s]
 96%|█████████▌| 355367/371472 [6:07:13<1:20:15,  3.34it/s]
 96%|█████████▌| 355368/371472 [6:07:13<1:17:04,  3.48it/s]
 96%|█████████▌| 355369/371472 [6:07:13<1:15:42,  3.55it/s]
 96%|█████████▌| 355370/371472 [6:07:14<1:20:13,  3.35it/s]
 96%|█████████▌| 355371/371472 [6:07:14<1:16:17,  3.52it/s]
 96%|█████████▌| 355372/371472 [6:07:14<1:13:44,  3.64it/s]
 96%|█████████▌| 355373/371472 [6:07:14<1:13:15,  3.66it/s]
 96%|█████████▌| 355374/371472 [6:07:15<1:14:44,  3.59it/s]
 96%|█████████▌| 355375/371472 [6:07:15<1:17:36,  3.46it/s]
 96%|█████████▌| 355376/371472 [6:07:15<1:16:28,  3.51it/s]
 96%|█████████▌| 355377/371472 [6:07:16<1:15:44,  3.54it/s]
 96%|█████████▌| 355378/371472 [6:07:16<1:25:43,  3.13it/s]
 96%|█████████▌| 355379/371472 [6:07:16<1:21:42,  3.28it/s]
 96%|█████████▌| 355380/371472 [6:07:17<1:23:25,  3.21it/s]
                                                           
{'loss': 2.6812, 'learning_rate': 1.3900859747031826e-07, 'epoch': 15.31}

 96%|█████████▌| 355380/371472 [6:07:17<1:23:25,  3.21it/s]
 96%|█████████▌| 355381/371472 [6:07:17<1:18:56,  3.40it/s]
 96%|█████████▌| 355382/371472 [6:07:17<1:21:56,  3.27it/s]
 96%|█████████▌| 355383/371472 [6:07:17<1:18:44,  3.41it/s]
 96%|█████████▌| 355384/371472 [6:07:18<1:20:17,  3.34it/s]
 96%|█████████▌| 355385/371472 [6:07:18<1:19:04,  3.39it/s]
 96%|█████████▌| 355386/371472 [6:07:18<1:15:48,  3.54it/s]
 96%|█████████▌| 355387/371472 [6:07:19<1:16:56,  3.48it/s]
 96%|█████████▌| 355388/371472 [6:07:19<1:15:06,  3.57it/s]
 96%|█████████▌| 355389/371472 [6:07:19<1:13:23,  3.65it/s]
 96%|█████████▌| 355390/371472 [6:07:19<1:11:22,  3.76it/s]
 96%|█████████▌| 355391/371472 [6:07:20<1:13:05,  3.67it/s]
 96%|█████████▌| 355392/371472 [6:07:20<1:15:44,  3.54it/s]
 96%|█████████▌| 355393/371472 [6:07:20<1:17:15,  3.47it/s]
 96%|█████████▌| 355394/371472 [6:07:21<1:17:53,  3.44it/s]
 96%|█████████▌| 355395/371472 [6:07:21<1:23:05,  3.22it/s]
 96%|█████████▌| 355396/371472 [6:07:21<1:20:50,  3.31it/s]
 96%|█████████▌| 355397/371472 [6:07:21<1:16:59,  3.48it/s]
 96%|█████████▌| 355398/371472 [6:07:22<1:16:24,  3.51it/s]
 96%|█████████▌| 355399/371472 [6:07:22<1:15:29,  3.55it/s]
 96%|█████████▌| 355400/371472 [6:07:22<1:17:55,  3.44it/s]
                                                           
{'loss': 2.7132, 'learning_rate': 1.389601154948393e-07, 'epoch': 15.31}

 96%|█████████▌| 355400/371472 [6:07:22<1:17:55,  3.44it/s]
 96%|█████████▌| 355401/371472 [6:07:23<1:15:19,  3.56it/s]
 96%|█████████▌| 355402/371472 [6:07:23<1:12:58,  3.67it/s]
 96%|█████████▌| 355403/371472 [6:07:23<1:16:07,  3.52it/s]
 96%|█████████▌| 355404/371472 [6:07:24<1:22:32,  3.24it/s]
 96%|█████████▌| 355405/371472 [6:07:24<1:18:04,  3.43it/s]
 96%|█████████▌| 355406/371472 [6:07:24<1:26:20,  3.10it/s]
 96%|█████████▌| 355407/371472 [6:07:24<1:19:36,  3.36it/s]
 96%|█████████▌| 355408/371472 [6:07:25<1:18:43,  3.40it/s]
 96%|█████████▌| 355409/371472 [6:07:25<1:17:21,  3.46it/s]
 96%|█████████▌| 355410/371472 [6:07:25<1:14:20,  3.60it/s]
 96%|█████████▌| 355411/371472 [6:07:26<1:49:56,  2.43it/s]
 96%|█████████▌| 355412/371472 [6:07:26<1:40:54,  2.65it/s]
 96%|█████████▌| 355413/371472 [6:07:27<1:33:40,  2.86it/s]
 96%|█████████▌| 355414/371472 [6:07:27<1:28:55,  3.01it/s]
 96%|█████████▌| 355415/371472 [6:07:27<1:25:11,  3.14it/s]
 96%|█████████▌| 355416/371472 [6:07:27<1:22:39,  3.24it/s]
 96%|█████████▌| 355417/371472 [6:07:28<1:17:53,  3.44it/s]
 96%|█████████▌| 355418/371472 [6:07:28<1:15:28,  3.55it/s]
 96%|█████████▌| 355419/371472 [6:07:28<1:12:16,  3.70it/s]
 96%|█████████▌| 355420/371472 [6:07:28<1:15:15,  3.55it/s]
                                                           
{'loss': 2.5162, 'learning_rate': 1.389116335193605e-07, 'epoch': 15.31}

 96%|█████████▌| 355420/371472 [6:07:28<1:15:15,  3.55it/s]
 96%|█████████▌| 355421/371472 [6:07:29<1:18:29,  3.41it/s]
 96%|█████████▌| 355422/371472 [6:07:29<1:14:37,  3.58it/s]
 96%|█████████▌| 355423/371472 [6:07:29<1:14:09,  3.61it/s]
 96%|█████████▌| 355424/371472 [6:07:30<1:11:30,  3.74it/s]
 96%|█████████▌| 355425/371472 [6:07:30<1:13:15,  3.65it/s]
 96%|█████████▌| 355426/371472 [6:07:30<1:11:34,  3.74it/s]
 96%|█████████▌| 355427/371472 [6:07:30<1:11:49,  3.72it/s]
 96%|█████████▌| 355428/371472 [6:07:31<1:11:07,  3.76it/s]
 96%|█████████▌| 355429/371472 [6:07:31<1:12:32,  3.69it/s]
 96%|█████████▌| 355430/371472 [6:07:31<1:16:10,  3.51it/s]
 96%|█████████▌| 355431/371472 [6:07:31<1:15:52,  3.52it/s]
 96%|█████████▌| 355432/371472 [6:07:32<1:14:31,  3.59it/s]
 96%|█████████▌| 355433/371472 [6:07:32<1:16:47,  3.48it/s]
 96%|█████████▌| 355434/371472 [6:07:32<1:15:12,  3.55it/s]
 96%|█████████▌| 355435/371472 [6:07:33<1:13:11,  3.65it/s]
 96%|█████████▌| 355436/371472 [6:07:33<1:16:39,  3.49it/s]
 96%|█████████▌| 355437/371472 [6:07:33<1:16:46,  3.48it/s]
 96%|█████████▌| 355438/371472 [6:07:34<1:19:15,  3.37it/s]
 96%|█████████▌| 355439/371472 [6:07:34<1:18:14,  3.42it/s]
 96%|█████████▌| 355440/371472 [6:07:34<1:15:53,  3.52it/s]
                                                           
{'loss': 2.6849, 'learning_rate': 1.3886315154388153e-07, 'epoch': 15.31}

 96%|█████████▌| 355440/371472 [6:07:34<1:15:53,  3.52it/s]
 96%|█████████▌| 355441/371472 [6:07:34<1:17:29,  3.45it/s]
 96%|█████████▌| 355442/371472 [6:07:35<1:16:08,  3.51it/s]
 96%|█████████▌| 355443/371472 [6:07:35<1:23:19,  3.21it/s]
 96%|█████████▌| 355444/371472 [6:07:35<1:20:54,  3.30it/s]
 96%|█████████▌| 355445/371472 [6:07:36<1:17:13,  3.46it/s]
 96%|█████████▌| 355446/371472 [6:07:36<1:16:09,  3.51it/s]
 96%|█████████▌| 355447/371472 [6:07:36<1:19:03,  3.38it/s]
 96%|█████████▌| 355448/371472 [6:07:36<1:19:54,  3.34it/s]
 96%|█████████▌| 355449/371472 [6:07:37<1:17:38,  3.44it/s]
 96%|█████████▌| 355450/371472 [6:07:37<1:16:52,  3.47it/s]
 96%|█████████▌| 355451/371472 [6:07:37<1:18:05,  3.42it/s]
 96%|█████████▌| 355452/371472 [6:07:38<1:17:18,  3.45it/s]
 96%|█████████▌| 355453/371472 [6:07:38<1:15:34,  3.53it/s]
 96%|█████████▌| 355454/371472 [6:07:38<1:17:35,  3.44it/s]
 96%|█████████▌| 355455/371472 [6:07:38<1:14:53,  3.56it/s]
 96%|█████████▌| 355456/371472 [6:07:39<1:13:48,  3.62it/s]
 96%|█████████▌| 355457/371472 [6:07:39<1:27:38,  3.05it/s]
 96%|█████████▌| 355458/371472 [6:07:39<1:26:55,  3.07it/s]
 96%|█████████▌| 355459/371472 [6:07:40<1:33:38,  2.85it/s]
 96%|█████████▌| 355460/371472 [6:07:40<1:27:04,  3.06it/s]
                                                           
{'loss': 2.5024, 'learning_rate': 1.3881466956840268e-07, 'epoch': 15.31}

 96%|█████████▌| 355460/371472 [6:07:40<1:27:04,  3.06it/s]
 96%|█████████▌| 355461/371472 [6:07:40<1:25:31,  3.12it/s]
 96%|█████████▌| 355462/371472 [6:07:41<1:23:50,  3.18it/s]
 96%|█████████▌| 355463/371472 [6:07:41<1:24:08,  3.17it/s]
 96%|█████████▌| 355464/371472 [6:07:41<1:19:16,  3.37it/s]
 96%|█████████▌| 355465/371472 [6:07:42<1:16:44,  3.48it/s]
 96%|█████████▌| 355466/371472 [6:07:42<1:14:51,  3.56it/s]
 96%|█████████▌| 355467/371472 [6:07:42<1:11:48,  3.71it/s]
 96%|█████████▌| 355468/371472 [6:07:42<1:12:40,  3.67it/s]
 96%|█████████▌| 355469/371472 [6:07:43<1:13:14,  3.64it/s]
 96%|█████████▌| 355470/371472 [6:07:43<1:21:50,  3.26it/s]
 96%|█████████▌| 355471/371472 [6:07:43<1:25:31,  3.12it/s]
 96%|█████████▌| 355472/371472 [6:07:44<1:27:22,  3.05it/s]
 96%|█████████▌| 355473/371472 [6:07:44<1:24:35,  3.15it/s]
 96%|█████████▌| 355474/371472 [6:07:44<1:20:12,  3.32it/s]
 96%|█████████▌| 355475/371472 [6:07:45<1:16:38,  3.48it/s]
 96%|█████████▌| 355476/371472 [6:07:45<1:16:49,  3.47it/s]
 96%|█████████▌| 355477/371472 [6:07:45<1:16:09,  3.50it/s]
 96%|█████████▌| 355478/371472 [6:07:46<1:25:22,  3.12it/s]
 96%|█████████▌| 355479/371472 [6:07:46<1:25:21,  3.12it/s]
 96%|█████████▌| 355480/371472 [6:07:46<1:23:40,  3.19it/s]
                                                           
{'loss': 2.617, 'learning_rate': 1.3876618759292375e-07, 'epoch': 15.31}

 96%|█████████▌| 355480/371472 [6:07:46<1:23:40,  3.19it/s]
 96%|█████████▌| 355481/371472 [6:07:46<1:19:38,  3.35it/s]
 96%|█████████▌| 355482/371472 [6:07:47<1:19:52,  3.34it/s]
 96%|█████████▌| 355483/371472 [6:07:47<1:18:09,  3.41it/s]
 96%|█████████▌| 355484/371472 [6:07:47<1:16:18,  3.49it/s]
 96%|█████████▌| 355485/371472 [6:07:47<1:12:58,  3.65it/s]
 96%|█████████▌| 355486/371472 [6:07:48<1:14:42,  3.57it/s]
 96%|█████████▌| 355487/371472 [6:07:48<1:20:10,  3.32it/s]
 96%|█████████▌| 355488/371472 [6:07:48<1:17:06,  3.45it/s]
 96%|█████████▌| 355489/371472 [6:07:49<1:15:24,  3.53it/s]
 96%|█████████▌| 355490/371472 [6:07:49<1:15:38,  3.52it/s]
 96%|█████████▌| 355491/371472 [6:07:49<1:15:28,  3.53it/s]
 96%|█████████▌| 355492/371472 [6:07:49<1:13:32,  3.62it/s]
 96%|█████████▌| 355493/371472 [6:07:50<1:27:14,  3.05it/s]
 96%|█████████▌| 355494/371472 [6:07:50<1:22:18,  3.24it/s]
 96%|█████████▌| 355495/371472 [6:07:51<1:22:21,  3.23it/s]
 96%|█████████▌| 355496/371472 [6:07:51<1:23:16,  3.20it/s]
 96%|█████████▌| 355497/371472 [6:07:51<1:20:49,  3.29it/s]
 96%|█████████▌| 355498/371472 [6:07:51<1:18:40,  3.38it/s]
 96%|█████████▌| 355499/371472 [6:07:52<1:17:50,  3.42it/s]
 96%|█████████▌| 355500/371472 [6:07:52<1:16:19,  3.49it/s]
                                                           
{'loss': 2.6808, 'learning_rate': 1.3871770561744493e-07, 'epoch': 15.31}

 96%|█████████▌| 355500/371472 [6:07:52<1:16:19,  3.49it/s]
 96%|█████████▌| 355501/371472 [6:07:52<1:16:20,  3.49it/s]
 96%|█████████▌| 355502/371472 [6:07:53<1:18:27,  3.39it/s]
 96%|█████████▌| 355503/371472 [6:07:53<1:26:15,  3.09it/s]
 96%|█████████▌| 355504/371472 [6:07:53<1:24:04,  3.17it/s]
 96%|█████████▌| 355505/371472 [6:07:54<1:20:45,  3.30it/s]
 96%|█████████▌| 355506/371472 [6:07:54<1:22:51,  3.21it/s]
 96%|█████████▌| 355507/371472 [6:07:54<1:18:34,  3.39it/s]
 96%|█████████▌| 355508/371472 [6:07:54<1:17:23,  3.44it/s]
 96%|█████████▌| 355509/371472 [6:07:55<1:14:41,  3.56it/s]
 96%|█████████▌| 355510/371472 [6:07:55<1:11:56,  3.70it/s]
 96%|█████████▌| 355511/371472 [6:07:55<1:11:35,  3.72it/s]
 96%|█████████▌| 355512/371472 [6:07:55<1:10:57,  3.75it/s]
 96%|█████████▌| 355513/371472 [6:07:56<1:12:01,  3.69it/s]
 96%|█████████▌| 355514/371472 [6:07:56<1:10:54,  3.75it/s]
 96%|█████████▌| 355515/371472 [6:07:56<1:11:02,  3.74it/s]
 96%|█████████▌| 355516/371472 [6:07:56<1:09:57,  3.80it/s]
 96%|█████████▌| 355517/371472 [6:07:57<1:10:03,  3.80it/s]
 96%|█████████▌| 355518/371472 [6:07:57<1:16:04,  3.50it/s]
 96%|█████████▌| 355519/371472 [6:07:57<1:15:13,  3.53it/s]
 96%|█████████▌| 355520/371472 [6:07:58<1:12:15,  3.68it/s]
                                                           
{'loss': 2.5115, 'learning_rate': 1.3866922364196598e-07, 'epoch': 15.31}

 96%|█████████▌| 355520/371472 [6:07:58<1:12:15,  3.68it/s]
 96%|█████████▌| 355521/371472 [6:07:58<1:10:26,  3.77it/s]
 96%|█████████▌| 355522/371472 [6:07:58<1:10:33,  3.77it/s]
 96%|█████████▌| 355523/371472 [6:07:58<1:12:02,  3.69it/s]
 96%|█████████▌| 355524/371472 [6:07:59<1:11:10,  3.73it/s]
 96%|█████████▌| 355525/371472 [6:07:59<1:13:49,  3.60it/s]
 96%|█████████▌| 355526/371472 [6:07:59<1:14:58,  3.54it/s]
 96%|█████████▌| 355527/371472 [6:08:00<1:18:56,  3.37it/s]
 96%|█████████▌| 355528/371472 [6:08:00<1:17:07,  3.45it/s]
 96%|█████████▌| 355529/371472 [6:08:00<1:18:25,  3.39it/s]
 96%|█████████▌| 355530/371472 [6:08:00<1:15:41,  3.51it/s]
 96%|█████████▌| 355531/371472 [6:08:01<1:12:55,  3.64it/s]
 96%|█████████▌| 355532/371472 [6:08:01<1:11:01,  3.74it/s]
 96%|█████████▌| 355533/371472 [6:08:01<1:10:57,  3.74it/s]
 96%|█████████▌| 355534/371472 [6:08:01<1:11:34,  3.71it/s]
 96%|█████████▌| 355535/371472 [6:08:02<1:09:24,  3.83it/s]
 96%|█████████▌| 355536/371472 [6:08:02<1:10:17,  3.78it/s]
 96%|█████████▌| 355537/371472 [6:08:02<1:13:20,  3.62it/s]
 96%|█████████▌| 355538/371472 [6:08:03<1:16:16,  3.48it/s]
 96%|█████████▌| 355539/371472 [6:08:03<1:14:39,  3.56it/s]
 96%|█████████▌| 355540/371472 [6:08:03<1:17:37,  3.42it/s]
                                                           
{'loss': 2.445, 'learning_rate': 1.3862074166648713e-07, 'epoch': 15.31}

 96%|█████████▌| 355540/371472 [6:08:03<1:17:37,  3.42it/s]
 96%|█████████▌| 355541/371472 [6:08:03<1:15:02,  3.54it/s]
 96%|█████████▌| 355542/371472 [6:08:04<1:16:27,  3.47it/s]
 96%|█████████▌| 355543/371472 [6:08:04<1:20:19,  3.30it/s]
 96%|█████████▌| 355544/371472 [6:08:04<1:23:41,  3.17it/s]
 96%|█████████▌| 355545/371472 [6:08:05<1:20:18,  3.31it/s]
 96%|█████████▌| 355546/371472 [6:08:05<1:17:24,  3.43it/s]
 96%|█████████▌| 355547/371472 [6:08:05<1:15:23,  3.52it/s]
 96%|█████████▌| 355548/371472 [6:08:06<1:14:41,  3.55it/s]
 96%|█████████▌| 355549/371472 [6:08:06<1:14:25,  3.57it/s]
 96%|█████████▌| 355550/371472 [6:08:06<1:12:16,  3.67it/s]
 96%|█████████▌| 355551/371472 [6:08:06<1:11:38,  3.70it/s]
 96%|█████████▌| 355552/371472 [6:08:07<1:11:14,  3.72it/s]
 96%|█████████▌| 355553/371472 [6:08:07<1:12:25,  3.66it/s]
 96%|█████████▌| 355554/371472 [6:08:07<1:13:53,  3.59it/s]
 96%|█████████▌| 355555/371472 [6:08:07<1:13:24,  3.61it/s]
 96%|█████████▌| 355556/371472 [6:08:08<1:12:27,  3.66it/s]
 96%|█████████▌| 355557/371472 [6:08:08<1:17:05,  3.44it/s]
 96%|█████████▌| 355558/371472 [6:08:08<1:15:01,  3.54it/s]
 96%|█████████▌| 355559/371472 [6:08:09<1:18:18,  3.39it/s]
 96%|█████████▌| 355560/371472 [6:08:09<1:16:34,  3.46it/s]
                                                           
{'loss': 2.6425, 'learning_rate': 1.385722596910082e-07, 'epoch': 15.31}

 96%|█████████▌| 355560/371472 [6:08:09<1:16:34,  3.46it/s]
 96%|█████████▌| 355561/371472 [6:08:09<1:20:14,  3.30it/s]
 96%|█████████▌| 355562/371472 [6:08:09<1:18:01,  3.40it/s]
 96%|█████████▌| 355563/371472 [6:08:10<1:14:47,  3.55it/s]
 96%|█████████▌| 355564/371472 [6:08:10<1:20:18,  3.30it/s]
 96%|█████████▌| 355565/371472 [6:08:10<1:20:38,  3.29it/s]
 96%|█████████▌| 355566/371472 [6:08:11<1:20:23,  3.30it/s]
 96%|█████████▌| 355567/371472 [6:08:11<1:17:13,  3.43it/s]
 96%|█████████▌| 355568/371472 [6:08:11<1:16:04,  3.48it/s]
 96%|█████████▌| 355569/371472 [6:08:12<1:15:35,  3.51it/s]
 96%|█████████▌| 355570/371472 [6:08:12<1:18:33,  3.37it/s]
 96%|█████████▌| 355571/371472 [6:08:12<1:19:33,  3.33it/s]
 96%|█████████▌| 355572/371472 [6:08:12<1:18:07,  3.39it/s]
 96%|█████████▌| 355573/371472 [6:08:13<1:15:48,  3.50it/s]
 96%|█████████▌| 355574/371472 [6:08:13<1:18:18,  3.38it/s]
 96%|█████████▌| 355575/371472 [6:08:13<1:15:25,  3.51it/s]
 96%|█████████▌| 355576/371472 [6:08:14<1:13:50,  3.59it/s]
 96%|█████████▌| 355577/371472 [6:08:14<1:16:32,  3.46it/s]
 96%|█████████▌| 355578/371472 [6:08:14<1:13:35,  3.60it/s]
 96%|█████████▌| 355579/371472 [6:08:14<1:20:16,  3.30it/s]
 96%|█████████▌| 355580/371472 [6:08:15<1:17:44,  3.41it/s]
                                                           
{'loss': 2.7245, 'learning_rate': 1.3852377771552935e-07, 'epoch': 15.32}

 96%|█████████▌| 355580/371472 [6:08:15<1:17:44,  3.41it/s]
 96%|█████████▌| 355581/371472 [6:08:15<1:14:23,  3.56it/s]
 96%|█████████▌| 355582/371472 [6:08:15<1:12:25,  3.66it/s]
 96%|█████████▌| 355583/371472 [6:08:16<1:13:06,  3.62it/s]
 96%|█████████▌| 355584/371472 [6:08:16<1:12:18,  3.66it/s]
 96%|█████████▌| 355585/371472 [6:08:16<1:11:57,  3.68it/s]
 96%|█████████▌| 355586/371472 [6:08:16<1:11:42,  3.69it/s]
 96%|█████████▌| 355587/371472 [6:08:17<1:09:15,  3.82it/s]
 96%|█████████▌| 355588/371472 [6:08:17<1:09:45,  3.80it/s]
 96%|█████████▌| 355589/371472 [6:08:17<1:10:56,  3.73it/s]
 96%|█████████▌| 355590/371472 [6:08:17<1:17:44,  3.40it/s]
 96%|█████████▌| 355591/371472 [6:08:18<1:15:42,  3.50it/s]
 96%|█████████▌| 355592/371472 [6:08:18<1:15:07,  3.52it/s]
 96%|█████████▌| 355593/371472 [6:08:18<1:13:39,  3.59it/s]
 96%|█████████▌| 355594/371472 [6:08:19<1:13:53,  3.58it/s]
 96%|█████████▌| 355595/371472 [6:08:19<1:18:04,  3.39it/s]
 96%|█████████▌| 355596/371472 [6:08:19<1:21:28,  3.25it/s]
 96%|█████████▌| 355597/371472 [6:08:20<1:21:20,  3.25it/s]
 96%|█████████▌| 355598/371472 [6:08:20<1:16:53,  3.44it/s]
 96%|█████████▌| 355599/371472 [6:08:20<1:20:50,  3.27it/s]
 96%|█████████▌| 355600/371472 [6:08:20<1:16:07,  3.47it/s]
                                                           
{'loss': 2.656, 'learning_rate': 1.384752957400504e-07, 'epoch': 15.32}

 96%|█████████▌| 355600/371472 [6:08:20<1:16:07,  3.47it/s]
 96%|█████████▌| 355601/371472 [6:08:21<1:14:24,  3.55it/s]
 96%|█████████▌| 355602/371472 [6:08:21<1:31:08,  2.90it/s]
 96%|█████████▌| 355603/371472 [6:08:21<1:28:04,  3.00it/s]
 96%|█████████▌| 355604/371472 [6:08:22<1:22:56,  3.19it/s]
 96%|█████████▌| 355605/371472 [6:08:22<1:19:15,  3.34it/s]
 96%|█████████▌| 355606/371472 [6:08:22<1:21:03,  3.26it/s]
 96%|█████████▌| 355607/371472 [6:08:23<1:17:28,  3.41it/s]
 96%|█████████▌| 355608/371472 [6:08:23<1:14:30,  3.55it/s]
 96%|█████████▌| 355609/371472 [6:08:23<1:13:43,  3.59it/s]
 96%|█████████▌| 355610/371472 [6:08:23<1:15:49,  3.49it/s]
 96%|█████████▌| 355611/371472 [6:08:24<1:17:14,  3.42it/s]
 96%|█████████▌| 355612/371472 [6:08:24<1:19:58,  3.30it/s]
 96%|█████████▌| 355613/371472 [6:08:24<1:19:14,  3.34it/s]
 96%|█████████▌| 355614/371472 [6:08:25<1:17:49,  3.40it/s]
 96%|█████████▌| 355615/371472 [6:08:25<1:17:25,  3.41it/s]
 96%|█████████▌| 355616/371472 [6:08:25<1:18:43,  3.36it/s]
 96%|█████████▌| 355617/371472 [6:08:26<1:18:55,  3.35it/s]
 96%|█████████▌| 355618/371472 [6:08:26<1:15:47,  3.49it/s]
 96%|█████████▌| 355619/371472 [6:08:26<1:15:29,  3.50it/s]
 96%|█████████▌| 355620/371472 [6:08:26<1:19:31,  3.32it/s]
                                                           
{'loss': 2.7099, 'learning_rate': 1.3842681376457157e-07, 'epoch': 15.32}

 96%|█████████▌| 355620/371472 [6:08:26<1:19:31,  3.32it/s]
 96%|█████████▌| 355621/371472 [6:08:27<1:18:29,  3.37it/s]
 96%|█████████▌| 355622/371472 [6:08:27<1:15:29,  3.50it/s]
 96%|█████████▌| 355623/371472 [6:08:27<1:15:54,  3.48it/s]
 96%|█████████▌| 355624/371472 [6:08:28<1:17:30,  3.41it/s]
 96%|█████████▌| 355625/371472 [6:08:28<1:17:32,  3.41it/s]
 96%|█████████▌| 355626/371472 [6:08:28<1:13:41,  3.58it/s]
 96%|█████████▌| 355627/371472 [6:08:28<1:16:24,  3.46it/s]
 96%|█████████▌| 355628/371472 [6:08:29<1:18:44,  3.35it/s]
 96%|█████████▌| 355629/371472 [6:08:29<1:19:13,  3.33it/s]
 96%|█████████▌| 355630/371472 [6:08:29<1:17:24,  3.41it/s]
 96%|█████████▌| 355631/371472 [6:08:30<1:18:01,  3.38it/s]
 96%|█████████▌| 355632/371472 [6:08:30<1:17:33,  3.40it/s]
 96%|█████████▌| 355633/371472 [6:08:30<1:15:27,  3.50it/s]
 96%|█████████▌| 355634/371472 [6:08:30<1:18:20,  3.37it/s]
 96%|█████████▌| 355635/371472 [6:08:31<1:19:16,  3.33it/s]
 96%|█████████▌| 355636/371472 [6:08:31<1:16:54,  3.43it/s]
 96%|█████████▌| 355637/371472 [6:08:31<1:18:28,  3.36it/s]
 96%|█████████▌| 355638/371472 [6:08:32<1:23:36,  3.16it/s]
 96%|█████████▌| 355639/371472 [6:08:32<1:20:19,  3.29it/s]
 96%|█████████▌| 355640/371472 [6:08:32<1:26:57,  3.03it/s]
                                                           
{'loss': 2.5826, 'learning_rate': 1.3837833178909262e-07, 'epoch': 15.32}

 96%|█████████▌| 355640/371472 [6:08:32<1:26:57,  3.03it/s]
 96%|█████████▌| 355641/371472 [6:08:33<1:21:08,  3.25it/s]
 96%|█████████▌| 355642/371472 [6:08:33<1:16:29,  3.45it/s]
 96%|█████████▌| 355643/371472 [6:08:33<1:15:59,  3.47it/s]
 96%|█████████▌| 355644/371472 [6:08:33<1:12:55,  3.62it/s]
 96%|█████████▌| 355645/371472 [6:08:34<1:14:30,  3.54it/s]
 96%|█████████▌| 355646/371472 [6:08:34<1:13:50,  3.57it/s]
 96%|█████████▌| 355647/371472 [6:08:34<1:20:24,  3.28it/s]
 96%|█████████▌| 355648/371472 [6:08:35<1:21:40,  3.23it/s]
 96%|█████████▌| 355649/371472 [6:08:35<1:22:01,  3.21it/s]
 96%|█████████▌| 355650/371472 [6:08:35<1:23:06,  3.17it/s]
 96%|█████████▌| 355651/371472 [6:08:36<1:18:39,  3.35it/s]
 96%|█████████▌| 355652/371472 [6:08:36<1:15:09,  3.51it/s]
 96%|█████████▌| 355653/371472 [6:08:36<1:12:12,  3.65it/s]
 96%|█████████▌| 355654/371472 [6:08:36<1:12:37,  3.63it/s]
 96%|█████████▌| 355655/371472 [6:08:37<1:11:04,  3.71it/s]
 96%|█████████▌| 355656/371472 [6:08:37<1:09:59,  3.77it/s]
 96%|█████████▌| 355657/371472 [6:08:37<1:12:47,  3.62it/s]
 96%|█████████▌| 355658/371472 [6:08:37<1:11:34,  3.68it/s]
 96%|█████████▌| 355659/371472 [6:08:38<1:13:25,  3.59it/s]
 96%|█████████▌| 355660/371472 [6:08:38<1:10:22,  3.74it/s]
                                                           
{'loss': 2.7634, 'learning_rate': 1.3832984981361377e-07, 'epoch': 15.32}

 96%|█████████▌| 355660/371472 [6:08:38<1:10:22,  3.74it/s]
 96%|█████████▌| 355661/371472 [6:08:38<1:18:03,  3.38it/s]
 96%|█████████▌| 355662/371472 [6:08:39<1:15:18,  3.50it/s]
 96%|█████████▌| 355663/371472 [6:08:39<1:14:55,  3.52it/s]
 96%|█████████▌| 355664/371472 [6:08:39<1:19:37,  3.31it/s]
 96%|█████████▌| 355665/371472 [6:08:40<1:19:04,  3.33it/s]
 96%|█████████▌| 355666/371472 [6:08:40<1:16:45,  3.43it/s]
 96%|█████████▌| 355667/371472 [6:08:40<1:15:21,  3.50it/s]
 96%|█████████▌| 355668/371472 [6:08:40<1:17:37,  3.39it/s]
 96%|█████████▌| 355669/371472 [6:08:41<1:17:38,  3.39it/s]
 96%|█████████▌| 355670/371472 [6:08:41<1:15:10,  3.50it/s]
 96%|█████████▌| 355671/371472 [6:08:41<1:14:59,  3.51it/s]
 96%|█████████▌| 355672/371472 [6:08:42<1:16:41,  3.43it/s]
 96%|█████████▌| 355673/371472 [6:08:42<1:13:40,  3.57it/s]
 96%|█████████▌| 355674/371472 [6:08:42<1:14:27,  3.54it/s]
 96%|█████████▌| 355675/371472 [6:08:42<1:24:44,  3.11it/s]
 96%|█████████▌| 355676/371472 [6:08:43<1:20:17,  3.28it/s]
 96%|█████████▌| 355677/371472 [6:08:43<1:23:53,  3.14it/s]
 96%|█████████▌| 355678/371472 [6:08:43<1:22:44,  3.18it/s]
 96%|█████████▌| 355679/371472 [6:08:44<1:18:50,  3.34it/s]
 96%|█████████▌| 355680/371472 [6:08:44<1:15:26,  3.49it/s]
                                                           
{'loss': 2.6542, 'learning_rate': 1.3828136783813484e-07, 'epoch': 15.32}

 96%|█████████▌| 355680/371472 [6:08:44<1:15:26,  3.49it/s]
 96%|█████████▌| 355681/371472 [6:08:44<1:14:31,  3.53it/s]
 96%|█████████▌| 355682/371472 [6:08:44<1:15:54,  3.47it/s]
 96%|█████████▌| 355683/371472 [6:08:45<1:19:42,  3.30it/s]
 96%|█████████▌| 355684/371472 [6:08:45<1:16:46,  3.43it/s]
 96%|█████████▌| 355685/371472 [6:08:45<1:15:44,  3.47it/s]
 96%|█████████▌| 355686/371472 [6:08:46<1:13:05,  3.60it/s]
 96%|█████████▌| 355687/371472 [6:08:46<1:11:28,  3.68it/s]
 96%|█████████▌| 355688/371472 [6:08:46<1:12:03,  3.65it/s]
 96%|█████████▌| 355689/371472 [6:08:46<1:10:43,  3.72it/s]
 96%|█████████▌| 355690/371472 [6:08:47<1:18:35,  3.35it/s]
 96%|█████████▌| 355691/371472 [6:08:47<1:17:54,  3.38it/s]
 96%|█████████▌| 355692/371472 [6:08:47<1:18:17,  3.36it/s]
 96%|█████████▌| 355693/371472 [6:08:48<1:22:29,  3.19it/s]
 96%|█████████▌| 355694/371472 [6:08:48<1:17:59,  3.37it/s]
 96%|█████████▌| 355695/371472 [6:08:48<1:17:40,  3.38it/s]
 96%|█████████▌| 355696/371472 [6:08:49<1:18:08,  3.36it/s]
 96%|█████████▌| 355697/371472 [6:08:49<1:22:55,  3.17it/s]
 96%|█████████▌| 355698/371472 [6:08:49<1:19:45,  3.30it/s]
 96%|█████████▌| 355699/371472 [6:08:49<1:15:46,  3.47it/s]
 96%|█████████▌| 355700/371472 [6:08:50<1:15:12,  3.50it/s]
                                                           
{'loss': 2.5529, 'learning_rate': 1.38232885862656e-07, 'epoch': 15.32}

 96%|█████████▌| 355700/371472 [6:08:50<1:15:12,  3.50it/s]
 96%|█████████▌| 355701/371472 [6:08:50<1:13:45,  3.56it/s]
 96%|█████████▌| 355702/371472 [6:08:50<1:13:08,  3.59it/s]
 96%|█████████▌| 355703/371472 [6:08:51<1:12:09,  3.64it/s]
 96%|█████████▌| 355704/371472 [6:08:51<1:10:18,  3.74it/s]
 96%|█████████▌| 355705/371472 [6:08:51<1:11:29,  3.68it/s]
 96%|█████████▌| 355706/371472 [6:08:51<1:14:41,  3.52it/s]
 96%|█████████▌| 355707/371472 [6:08:52<1:13:29,  3.58it/s]
 96%|█████████▌| 355708/371472 [6:08:52<1:12:38,  3.62it/s]
 96%|█████████▌| 355709/371472 [6:08:52<1:12:46,  3.61it/s]
 96%|█████████▌| 355710/371472 [6:08:52<1:09:45,  3.77it/s]
 96%|█████████▌| 355711/371472 [6:08:53<1:14:02,  3.55it/s]
 96%|█████████▌| 355712/371472 [6:08:53<1:13:40,  3.57it/s]
 96%|█████████▌| 355713/371472 [6:08:53<1:13:46,  3.56it/s]
 96%|█████████▌| 355714/371472 [6:08:54<1:11:40,  3.66it/s]
 96%|█████████▌| 355715/371472 [6:08:54<1:09:23,  3.78it/s]
 96%|█████████▌| 355716/371472 [6:08:54<1:13:27,  3.58it/s]
 96%|█████████▌| 355717/371472 [6:08:54<1:14:38,  3.52it/s]
 96%|█████████▌| 355718/371472 [6:08:55<1:17:28,  3.39it/s]
 96%|█████████▌| 355719/371472 [6:08:55<1:19:39,  3.30it/s]
 96%|█████████▌| 355720/371472 [6:08:55<1:22:13,  3.19it/s]
                                                           
{'loss': 2.444, 'learning_rate': 1.3818440388717704e-07, 'epoch': 15.32}

 96%|█████████▌| 355720/371472 [6:08:55<1:22:13,  3.19it/s]
 96%|█████████▌| 355721/371472 [6:08:56<1:25:57,  3.05it/s]
 96%|█████████▌| 355722/371472 [6:08:56<1:20:53,  3.25it/s]
 96%|█████████▌| 355723/371472 [6:08:56<1:17:38,  3.38it/s]
 96%|█████████▌| 355724/371472 [6:08:57<1:13:46,  3.56it/s]
 96%|█████████▌| 355725/371472 [6:08:57<1:13:33,  3.57it/s]
 96%|█████████▌| 355726/371472 [6:08:57<1:12:37,  3.61it/s]
 96%|█████████▌| 355727/371472 [6:08:57<1:13:10,  3.59it/s]
 96%|█████████▌| 355728/371472 [6:08:58<1:11:22,  3.68it/s]
 96%|█████████▌| 355729/371472 [6:08:58<1:11:23,  3.68it/s]
 96%|█████████▌| 355730/371472 [6:08:58<1:11:40,  3.66it/s]
 96%|█████████▌| 355731/371472 [6:08:58<1:12:19,  3.63it/s]
 96%|█████████▌| 355732/371472 [6:08:59<1:10:39,  3.71it/s]
 96%|█████████▌| 355733/371472 [6:08:59<1:10:52,  3.70it/s]
 96%|█████████▌| 355734/371472 [6:08:59<1:12:26,  3.62it/s]
 96%|█████████▌| 355735/371472 [6:09:00<1:11:16,  3.68it/s]
 96%|█████████▌| 355736/371472 [6:09:00<1:10:06,  3.74it/s]
 96%|█████████▌| 355737/371472 [6:09:00<1:11:15,  3.68it/s]
 96%|█████████▌| 355738/371472 [6:09:00<1:17:24,  3.39it/s]
 96%|█████████▌| 355739/371472 [6:09:01<1:20:39,  3.25it/s]
 96%|█████████▌| 355740/371472 [6:09:01<1:16:09,  3.44it/s]
                                                           
{'loss': 2.5641, 'learning_rate': 1.3813592191169821e-07, 'epoch': 15.32}

 96%|█████████▌| 355740/371472 [6:09:01<1:16:09,  3.44it/s]
 96%|█████████▌| 355741/371472 [6:09:01<1:15:31,  3.47it/s]
 96%|█████████▌| 355742/371472 [6:09:02<1:13:29,  3.57it/s]
 96%|█████████▌| 355743/371472 [6:09:02<1:27:13,  3.01it/s]
 96%|█████████▌| 355744/371472 [6:09:02<1:22:25,  3.18it/s]
 96%|█████████▌| 355745/371472 [6:09:03<1:22:47,  3.17it/s]
 96%|█████████▌| 355746/371472 [6:09:03<1:20:37,  3.25it/s]
 96%|█████████▌| 355747/371472 [6:09:03<1:18:25,  3.34it/s]
 96%|█████████▌| 355748/371472 [6:09:03<1:16:21,  3.43it/s]
 96%|█████████▌| 355749/371472 [6:09:04<1:23:41,  3.13it/s]
 96%|█████████▌| 355750/371472 [6:09:04<1:18:18,  3.35it/s]
 96%|█████████▌| 355751/371472 [6:09:04<1:16:27,  3.43it/s]
 96%|█████████▌| 355752/371472 [6:09:05<1:15:41,  3.46it/s]
 96%|█████████▌| 355753/371472 [6:09:05<1:18:47,  3.33it/s]
 96%|█████████▌| 355754/371472 [6:09:05<1:15:53,  3.45it/s]
 96%|█████████▌| 355755/371472 [6:09:06<1:13:36,  3.56it/s]
 96%|█████████▌| 355756/371472 [6:09:06<1:11:20,  3.67it/s]
 96%|█████████▌| 355757/371472 [6:09:06<1:12:37,  3.61it/s]
 96%|█████████▌| 355758/371472 [6:09:06<1:12:20,  3.62it/s]
 96%|█████████▌| 355759/371472 [6:09:07<1:10:18,  3.72it/s]
 96%|█████████▌| 355760/371472 [6:09:07<1:13:31,  3.56it/s]
                                                           
{'loss': 2.7158, 'learning_rate': 1.3808743993621926e-07, 'epoch': 15.32}

 96%|█████████▌| 355760/371472 [6:09:07<1:13:31,  3.56it/s]
 96%|█████████▌| 355761/371472 [6:09:07<1:12:30,  3.61it/s]
 96%|█████████▌| 355762/371472 [6:09:07<1:16:22,  3.43it/s]
 96%|█████████▌| 355763/371472 [6:09:08<1:13:19,  3.57it/s]
 96%|█████████▌| 355764/371472 [6:09:08<1:12:32,  3.61it/s]
 96%|█████████▌| 355765/371472 [6:09:08<1:13:22,  3.57it/s]
 96%|█████████▌| 355766/371472 [6:09:09<1:11:43,  3.65it/s]
 96%|█████████▌| 355767/371472 [6:09:09<1:12:44,  3.60it/s]
 96%|█████████▌| 355768/371472 [6:09:09<1:13:26,  3.56it/s]
 96%|█████████▌| 355769/371472 [6:09:09<1:11:38,  3.65it/s]
 96%|█████████▌| 355770/371472 [6:09:10<1:09:36,  3.76it/s]
 96%|█████████▌| 355771/371472 [6:09:10<1:09:13,  3.78it/s]
 96%|█████████▌| 355772/371472 [6:09:10<1:08:21,  3.83it/s]
 96%|█████████▌| 355773/371472 [6:09:10<1:11:20,  3.67it/s]
 96%|█████████▌| 355774/371472 [6:09:11<1:11:15,  3.67it/s]
 96%|█████████▌| 355775/371472 [6:09:11<1:12:35,  3.60it/s]
 96%|█████████▌| 355776/371472 [6:09:11<1:11:12,  3.67it/s]
 96%|█████████▌| 355777/371472 [6:09:12<1:13:30,  3.56it/s]
 96%|█████████▌| 355778/371472 [6:09:12<1:18:54,  3.31it/s]
 96%|█████████▌| 355779/371472 [6:09:12<1:25:02,  3.08it/s]
 96%|█████████▌| 355780/371472 [6:09:13<1:24:58,  3.08it/s]
                                                           
{'loss': 2.612, 'learning_rate': 1.3803895796074033e-07, 'epoch': 15.32}

 96%|█████████▌| 355780/371472 [6:09:13<1:24:58,  3.08it/s]
 96%|█████████▌| 355781/371472 [6:09:13<1:19:32,  3.29it/s]
 96%|█████████▌| 355782/371472 [6:09:13<1:17:32,  3.37it/s]
 96%|█████████▌| 355783/371472 [6:09:13<1:15:12,  3.48it/s]
 96%|█████████▌| 355784/371472 [6:09:14<1:13:25,  3.56it/s]
 96%|█████████▌| 355785/371472 [6:09:14<1:11:29,  3.66it/s]
 96%|█████████▌| 355786/371472 [6:09:14<1:10:00,  3.73it/s]
 96%|█████████▌| 355787/371472 [6:09:14<1:11:18,  3.67it/s]
 96%|█████████▌| 355788/371472 [6:09:15<1:11:42,  3.65it/s]
 96%|█████████▌| 355789/371472 [6:09:15<1:11:44,  3.64it/s]
 96%|█████████▌| 355790/371472 [6:09:15<1:13:13,  3.57it/s]
 96%|█████████▌| 355791/371472 [6:09:16<1:11:47,  3.64it/s]
 96%|█████████▌| 355792/371472 [6:09:16<1:10:58,  3.68it/s]
 96%|█████████▌| 355793/371472 [6:09:16<1:09:40,  3.75it/s]
 96%|█████████▌| 355794/371472 [6:09:16<1:09:41,  3.75it/s]
 96%|█████████▌| 355795/371472 [6:09:17<1:08:46,  3.80it/s]
 96%|█████████▌| 355796/371472 [6:09:17<1:11:08,  3.67it/s]
 96%|█████████▌| 355797/371472 [6:09:17<1:12:13,  3.62it/s]
 96%|█████████▌| 355798/371472 [6:09:17<1:10:50,  3.69it/s]
 96%|█████████▌| 355799/371472 [6:09:18<1:09:26,  3.76it/s]
 96%|█████████▌| 355800/371472 [6:09:18<1:09:23,  3.76it/s]
                                                           
{'loss': 2.4557, 'learning_rate': 1.3799047598526148e-07, 'epoch': 15.32}

 96%|█████████▌| 355800/371472 [6:09:18<1:09:23,  3.76it/s]
 96%|█████████▌| 355801/371472 [6:09:18<1:08:44,  3.80it/s]
 96%|█████████▌| 355802/371472 [6:09:19<1:10:21,  3.71it/s]
 96%|█████████▌| 355803/371472 [6:09:19<1:14:36,  3.50it/s]
 96%|█████████▌| 355804/371472 [6:09:19<1:13:20,  3.56it/s]
 96%|█████████▌| 355805/371472 [6:09:19<1:11:36,  3.65it/s]
 96%|█████████▌| 355806/371472 [6:09:20<1:11:10,  3.67it/s]
 96%|█████████▌| 355807/371472 [6:09:20<1:11:16,  3.66it/s]
 96%|█████████▌| 355808/371472 [6:09:20<1:09:42,  3.74it/s]
 96%|█████████▌| 355809/371472 [6:09:20<1:10:33,  3.70it/s]
 96%|█████████▌| 355810/371472 [6:09:21<1:10:18,  3.71it/s]
 96%|█████████▌| 355811/371472 [6:09:21<1:10:39,  3.69it/s]
 96%|█████████▌| 355812/371472 [6:09:21<1:10:02,  3.73it/s]
 96%|█████████▌| 355813/371472 [6:09:22<1:08:17,  3.82it/s]
 96%|█████████▌| 355814/371472 [6:09:22<1:09:33,  3.75it/s]
 96%|█████████▌| 355815/371472 [6:09:22<1:11:13,  3.66it/s]
 96%|█████████▌| 355816/371472 [6:09:22<1:11:59,  3.62it/s]
 96%|█████████▌| 355817/371472 [6:09:23<1:10:01,  3.73it/s]
 96%|█████████▌| 355818/371472 [6:09:23<1:12:13,  3.61it/s]
 96%|█████████▌| 355819/371472 [6:09:23<1:15:53,  3.44it/s]
 96%|█████████▌| 355820/371472 [6:09:23<1:14:31,  3.50it/s]
                                                           
{'loss': 2.43, 'learning_rate': 1.3794199400978255e-07, 'epoch': 15.33}

 96%|█████████▌| 355820/371472 [6:09:23<1:14:31,  3.50it/s]
 96%|█████████▌| 355821/371472 [6:09:24<1:14:57,  3.48it/s]
 96%|█████████▌| 355822/371472 [6:09:24<1:11:37,  3.64it/s]
 96%|█████████▌| 355823/371472 [6:09:24<1:15:27,  3.46it/s]
 96%|█████████▌| 355824/371472 [6:09:25<1:16:16,  3.42it/s]
 96%|█████████▌| 355825/371472 [6:09:25<1:17:50,  3.35it/s]
 96%|█████████▌| 355826/371472 [6:09:25<1:13:57,  3.53it/s]
 96%|█████████▌| 355827/371472 [6:09:25<1:13:58,  3.53it/s]
 96%|█████████▌| 355828/371472 [6:09:26<1:13:26,  3.55it/s]
 96%|█████████▌| 355829/371472 [6:09:26<1:12:35,  3.59it/s]
 96%|█████████▌| 355830/371472 [6:09:26<1:14:18,  3.51it/s]
 96%|█████████▌| 355831/371472 [6:09:27<1:14:55,  3.48it/s]
 96%|█████████▌| 355832/371472 [6:09:27<1:14:47,  3.49it/s]
 96%|█████████▌| 355833/371472 [6:09:27<1:14:17,  3.51it/s]
 96%|█████████▌| 355834/371472 [6:09:27<1:12:39,  3.59it/s]
 96%|█████████▌| 355835/371472 [6:09:28<1:16:57,  3.39it/s]
 96%|█████████▌| 355836/371472 [6:09:28<1:17:07,  3.38it/s]
 96%|█████████▌| 355837/371472 [6:09:28<1:15:39,  3.44it/s]
 96%|█████████▌| 355838/371472 [6:09:29<1:15:06,  3.47it/s]
 96%|█████████▌| 355839/371472 [6:09:29<1:13:42,  3.53it/s]
 96%|█████████▌| 355840/371472 [6:09:29<1:11:10,  3.66it/s]
                                                           
{'loss': 2.7721, 'learning_rate': 1.378935120343037e-07, 'epoch': 15.33}

 96%|█████████▌| 355840/371472 [6:09:29<1:11:10,  3.66it/s]
 96%|█████████▌| 355841/371472 [6:09:29<1:10:31,  3.69it/s]
 96%|█████████▌| 355842/371472 [6:09:30<1:13:03,  3.57it/s]
 96%|█████████▌| 355843/371472 [6:09:30<1:11:15,  3.66it/s]
 96%|█████████▌| 355844/371472 [6:09:30<1:09:34,  3.74it/s]
 96%|█████████▌| 355845/371472 [6:09:31<1:14:00,  3.52it/s]
 96%|█████████▌| 355846/371472 [6:09:31<1:12:00,  3.62it/s]
 96%|█████████▌| 355847/371472 [6:09:31<1:10:55,  3.67it/s]
 96%|█████████▌| 355848/371472 [6:09:31<1:12:28,  3.59it/s]
 96%|█████████▌| 355849/371472 [6:09:32<1:11:00,  3.67it/s]
 96%|█████████▌| 355850/371472 [6:09:32<1:12:24,  3.60it/s]
 96%|█████████▌| 355851/371472 [6:09:32<1:10:49,  3.68it/s]
 96%|█████████▌| 355852/371472 [6:09:32<1:10:20,  3.70it/s]
 96%|█████████▌| 355853/371472 [6:09:33<1:14:14,  3.51it/s]
 96%|█████████▌| 355854/371472 [6:09:33<1:10:30,  3.69it/s]
 96%|█████████▌| 355855/371472 [6:09:33<1:10:53,  3.67it/s]
 96%|█████████▌| 355856/371472 [6:09:34<1:10:51,  3.67it/s]
 96%|█████████▌| 355857/371472 [6:09:34<1:13:49,  3.53it/s]
 96%|█████████▌| 355858/371472 [6:09:34<1:13:01,  3.56it/s]
 96%|█████████▌| 355859/371472 [6:09:34<1:14:24,  3.50it/s]
 96%|█████████▌| 355860/371472 [6:09:35<1:12:19,  3.60it/s]
                                                           
{'loss': 2.6042, 'learning_rate': 1.3784503005882475e-07, 'epoch': 15.33}

 96%|█████████▌| 355860/371472 [6:09:35<1:12:19,  3.60it/s]
 96%|█████████▌| 355861/371472 [6:09:35<1:11:13,  3.65it/s]
 96%|█████████▌| 355862/371472 [6:09:35<1:17:15,  3.37it/s]
 96%|█████████▌| 355863/371472 [6:09:36<1:16:43,  3.39it/s]
 96%|█████████▌| 355864/371472 [6:09:36<1:15:01,  3.47it/s]
 96%|█████████▌| 355865/371472 [6:09:36<1:15:55,  3.43it/s]
 96%|█████████▌| 355866/371472 [6:09:36<1:13:28,  3.54it/s]
 96%|█████████▌| 355867/371472 [6:09:37<1:11:27,  3.64it/s]
 96%|█████████▌| 355868/371472 [6:09:37<1:12:30,  3.59it/s]
 96%|█████████▌| 355869/371472 [6:09:37<1:13:05,  3.56it/s]
 96%|█████████▌| 355870/371472 [6:09:38<1:13:30,  3.54it/s]
 96%|█████████▌| 355871/371472 [6:09:38<1:12:50,  3.57it/s]
 96%|█████████▌| 355872/371472 [6:09:38<1:10:02,  3.71it/s]
 96%|█████████▌| 355873/371472 [6:09:38<1:07:20,  3.86it/s]
 96%|█████████▌| 355874/371472 [6:09:39<1:11:42,  3.63it/s]
 96%|█████████▌| 355875/371472 [6:09:39<1:16:38,  3.39it/s]
 96%|█████████▌| 355876/371472 [6:09:39<1:15:07,  3.46it/s]
 96%|█████████▌| 355877/371472 [6:09:40<1:24:14,  3.09it/s]
 96%|█████████▌| 355878/371472 [6:09:40<1:22:11,  3.16it/s]
 96%|█████████▌| 355879/371472 [6:09:40<1:24:19,  3.08it/s]
 96%|█████████▌| 355880/371472 [6:09:41<1:20:01,  3.25it/s]
                                                           
{'loss': 2.6828, 'learning_rate': 1.3779654808334593e-07, 'epoch': 15.33}

 96%|█████████▌| 355880/371472 [6:09:41<1:20:01,  3.25it/s]
 96%|█████████▌| 355881/371472 [6:09:41<1:18:22,  3.32it/s]
 96%|█████████▌| 355882/371472 [6:09:41<1:22:39,  3.14it/s]
 96%|█████████▌| 355883/371472 [6:09:42<1:21:11,  3.20it/s]
 96%|█████████▌| 355884/371472 [6:09:42<1:15:42,  3.43it/s]
 96%|█████████▌| 355885/371472 [6:09:42<1:16:28,  3.40it/s]
 96%|█████████▌| 355886/371472 [6:09:42<1:14:55,  3.47it/s]
 96%|█████████▌| 355887/371472 [6:09:43<1:20:35,  3.22it/s]
 96%|█████████▌| 355888/371472 [6:09:43<1:23:13,  3.12it/s]
 96%|█████████▌| 355889/371472 [6:09:43<1:19:16,  3.28it/s]
 96%|█████████▌| 355890/371472 [6:09:44<1:17:15,  3.36it/s]
 96%|█████████▌| 355891/371472 [6:09:44<1:17:14,  3.36it/s]
 96%|█████████▌| 355892/371472 [6:09:44<1:13:46,  3.52it/s]
 96%|█████████▌| 355893/371472 [6:09:44<1:12:17,  3.59it/s]
 96%|█████████▌| 355894/371472 [6:09:45<1:12:41,  3.57it/s]
 96%|█████████▌| 355895/371472 [6:09:45<1:14:32,  3.48it/s]
 96%|█████████▌| 355896/371472 [6:09:45<1:13:43,  3.52it/s]
 96%|█████████▌| 355897/371472 [6:09:46<1:13:32,  3.53it/s]
 96%|█████████▌| 355898/371472 [6:09:46<1:10:58,  3.66it/s]
 96%|█████████▌| 355899/371472 [6:09:46<1:10:49,  3.66it/s]
 96%|█████████▌| 355900/371472 [6:09:46<1:12:56,  3.56it/s]
                                                           
{'loss': 2.6199, 'learning_rate': 1.3774806610786697e-07, 'epoch': 15.33}

 96%|█████████▌| 355900/371472 [6:09:46<1:12:56,  3.56it/s]
 96%|█████████▌| 355901/371472 [6:09:47<1:23:39,  3.10it/s]
 96%|█████████▌| 355902/371472 [6:09:47<1:18:44,  3.30it/s]
 96%|█████████▌| 355903/371472 [6:09:47<1:17:00,  3.37it/s]
 96%|█████████▌| 355904/371472 [6:09:48<1:16:36,  3.39it/s]
 96%|█████████▌| 355905/371472 [6:09:48<1:16:47,  3.38it/s]
 96%|█████████▌| 355906/371472 [6:09:48<1:17:45,  3.34it/s]
 96%|█████████▌| 355907/371472 [6:09:49<1:16:49,  3.38it/s]
 96%|█████████▌| 355908/371472 [6:09:49<1:14:28,  3.48it/s]
 96%|█████████▌| 355909/371472 [6:09:49<1:15:44,  3.42it/s]
 96%|█████████▌| 355910/371472 [6:09:49<1:12:15,  3.59it/s]
 96%|█████████▌| 355911/371472 [6:09:50<1:17:31,  3.35it/s]
 96%|█████████▌| 355912/371472 [6:09:50<1:13:23,  3.53it/s]
 96%|█████████▌| 355913/371472 [6:09:50<1:10:45,  3.66it/s]
 96%|█████████▌| 355914/371472 [6:09:50<1:09:39,  3.72it/s]
 96%|█████████▌| 355915/371472 [6:09:51<1:16:04,  3.41it/s]
 96%|█████████▌| 355916/371472 [6:09:51<1:16:01,  3.41it/s]
 96%|█████████▌| 355917/371472 [6:09:51<1:22:22,  3.15it/s]
 96%|█████████▌| 355918/371472 [6:09:52<1:21:42,  3.17it/s]
 96%|█████████▌| 355919/371472 [6:09:52<1:20:11,  3.23it/s]
 96%|█████████▌| 355920/371472 [6:09:52<1:19:06,  3.28it/s]
                                                           
{'loss': 2.6048, 'learning_rate': 1.376995841323881e-07, 'epoch': 15.33}

 96%|█████████▌| 355920/371472 [6:09:52<1:19:06,  3.28it/s]
 96%|█████████▌| 355921/371472 [6:09:53<1:16:02,  3.41it/s]
 96%|█████████▌| 355922/371472 [6:09:53<1:20:06,  3.24it/s]
 96%|█████████▌| 355923/371472 [6:09:53<1:16:03,  3.41it/s]
 96%|█████████▌| 355924/371472 [6:09:53<1:13:45,  3.51it/s]
 96%|█████████▌| 355925/371472 [6:09:54<1:16:36,  3.38it/s]
 96%|█████████▌| 355926/371472 [6:09:54<1:16:54,  3.37it/s]
 96%|█████████▌| 355927/371472 [6:09:54<1:14:54,  3.46it/s]
 96%|█████████▌| 355928/371472 [6:09:55<1:11:40,  3.61it/s]
 96%|█████████▌| 355929/371472 [6:09:55<1:19:13,  3.27it/s]
 96%|█████████▌| 355930/371472 [6:09:55<1:20:05,  3.23it/s]
 96%|█████████▌| 355931/371472 [6:09:56<1:15:49,  3.42it/s]
 96%|█████████▌| 355932/371472 [6:09:56<1:13:42,  3.51it/s]
 96%|█████████▌| 355933/371472 [6:09:56<1:12:03,  3.59it/s]
 96%|█████████▌| 355934/371472 [6:09:56<1:12:05,  3.59it/s]
 96%|█████████▌| 355935/371472 [6:09:57<1:13:12,  3.54it/s]
 96%|█████████▌| 355936/371472 [6:09:57<1:14:43,  3.46it/s]
 96%|█████████▌| 355937/371472 [6:09:57<1:12:12,  3.59it/s]
 96%|█████████▌| 355938/371472 [6:09:57<1:11:08,  3.64it/s]
 96%|█████████▌| 355939/371472 [6:09:58<1:13:57,  3.50it/s]
 96%|█████████▌| 355940/371472 [6:09:58<1:13:33,  3.52it/s]
                                                           
{'loss': 2.5047, 'learning_rate': 1.376511021569092e-07, 'epoch': 15.33}

 96%|█████████▌| 355940/371472 [6:09:58<1:13:33,  3.52it/s]
 96%|█████████▌| 355941/371472 [6:09:58<1:12:16,  3.58it/s]
 96%|█████████▌| 355942/371472 [6:09:59<1:12:35,  3.57it/s]
 96%|█████████▌| 355943/371472 [6:09:59<1:11:34,  3.62it/s]
 96%|█████████▌| 355944/371472 [6:09:59<1:12:04,  3.59it/s]
 96%|█████████▌| 355945/371472 [6:09:59<1:10:29,  3.67it/s]
 96%|█████████▌| 355946/371472 [6:10:00<1:11:49,  3.60it/s]
 96%|█████████▌| 355947/371472 [6:10:00<1:09:54,  3.70it/s]
 96%|█████████▌| 355948/371472 [6:10:00<1:08:42,  3.77it/s]
 96%|█████████▌| 355949/371472 [6:10:01<1:24:18,  3.07it/s]
 96%|█████████▌| 355950/371472 [6:10:01<1:18:36,  3.29it/s]
 96%|█████████▌| 355951/371472 [6:10:01<1:20:53,  3.20it/s]
 96%|█████████▌| 355952/371472 [6:10:02<1:16:37,  3.38it/s]
 96%|█████████▌| 355953/371472 [6:10:02<1:14:29,  3.47it/s]
 96%|█████████▌| 355954/371472 [6:10:02<1:13:13,  3.53it/s]
 96%|█████████▌| 355955/371472 [6:10:02<1:11:03,  3.64it/s]
 96%|█████████▌| 355956/371472 [6:10:03<1:25:25,  3.03it/s]
 96%|█████████▌| 355957/371472 [6:10:03<1:20:55,  3.20it/s]
 96%|█████████▌| 355958/371472 [6:10:03<1:17:10,  3.35it/s]
 96%|█████████▌| 355959/371472 [6:10:04<1:15:32,  3.42it/s]
 96%|█████████▌| 355960/371472 [6:10:04<1:15:55,  3.41it/s]
                                                           
{'loss': 2.6965, 'learning_rate': 1.3760262018143034e-07, 'epoch': 15.33}

 96%|█████████▌| 355960/371472 [6:10:04<1:15:55,  3.41it/s]
 96%|█████████▌| 355961/371472 [6:10:04<1:14:44,  3.46it/s]
 96%|█████████▌| 355962/371472 [6:10:04<1:13:47,  3.50it/s]
 96%|█████████▌| 355963/371472 [6:10:05<1:11:39,  3.61it/s]
 96%|█████████▌| 355964/371472 [6:10:05<1:11:46,  3.60it/s]
 96%|█████████▌| 355965/371472 [6:10:05<1:11:36,  3.61it/s]
 96%|█████████▌| 355966/371472 [6:10:06<1:18:43,  3.28it/s]
 96%|█████████▌| 355967/371472 [6:10:06<1:15:04,  3.44it/s]
 96%|█████████▌| 355968/371472 [6:10:06<1:14:23,  3.47it/s]
 96%|█████████▌| 355969/371472 [6:10:07<1:19:30,  3.25it/s]
 96%|█████████▌| 355970/371472 [6:10:07<1:17:42,  3.32it/s]
 96%|█████████▌| 355971/371472 [6:10:07<1:13:47,  3.50it/s]
 96%|█████████▌| 355972/371472 [6:10:07<1:17:46,  3.32it/s]
 96%|█████████▌| 355973/371472 [6:10:08<1:19:18,  3.26it/s]
 96%|█████████▌| 355974/371472 [6:10:08<1:17:14,  3.34it/s]
 96%|█████████▌| 355975/371472 [6:10:08<1:12:13,  3.58it/s]
 96%|█████████▌| 355976/371472 [6:10:09<1:15:35,  3.42it/s]
 96%|█████████▌| 355977/371472 [6:10:09<1:12:09,  3.58it/s]
 96%|█████████▌| 355978/371472 [6:10:09<1:16:37,  3.37it/s]
 96%|█████████▌| 355979/371472 [6:10:09<1:13:14,  3.53it/s]
 96%|█████████▌| 355980/371472 [6:10:10<1:12:57,  3.54it/s]
                                                           
{'loss': 2.5248, 'learning_rate': 1.375541382059514e-07, 'epoch': 15.33}

 96%|█████████▌| 355980/371472 [6:10:10<1:12:57,  3.54it/s]
 96%|█████████▌| 355981/371472 [6:10:10<1:11:46,  3.60it/s]
 96%|█████████▌| 355982/371472 [6:10:10<1:11:32,  3.61it/s]
 96%|█████████▌| 355983/371472 [6:10:11<1:10:06,  3.68it/s]
 96%|█████████▌| 355984/371472 [6:10:11<1:14:36,  3.46it/s]
 96%|█████████▌| 355985/371472 [6:10:11<1:12:37,  3.55it/s]
 96%|█████████▌| 355986/371472 [6:10:11<1:10:45,  3.65it/s]
 96%|█████████▌| 355987/371472 [6:10:12<1:11:46,  3.60it/s]
 96%|█████████▌| 355988/371472 [6:10:12<1:11:04,  3.63it/s]
 96%|█████████▌| 355989/371472 [6:10:12<1:16:49,  3.36it/s]
 96%|█████████▌| 355990/371472 [6:10:13<1:24:00,  3.07it/s]
 96%|█████████▌| 355991/371472 [6:10:13<1:23:46,  3.08it/s]
 96%|█████████▌| 355992/371472 [6:10:13<1:20:04,  3.22it/s]
 96%|█████████▌| 355993/371472 [6:10:14<1:23:29,  3.09it/s]
 96%|█████████▌| 355994/371472 [6:10:14<1:21:55,  3.15it/s]
 96%|█████████▌| 355995/371472 [6:10:14<1:20:59,  3.18it/s]
 96%|█████████▌| 355996/371472 [6:10:14<1:15:43,  3.41it/s]
 96%|█████████▌| 355997/371472 [6:10:15<1:16:36,  3.37it/s]
 96%|█████████▌| 355998/371472 [6:10:15<1:15:17,  3.43it/s]
 96%|█████████▌| 355999/371472 [6:10:15<1:15:18,  3.42it/s]
 96%|█████████▌| 356000/371472 [6:10:16<1:12:16,  3.57it/s]
                                                           
{'loss': 2.5559, 'learning_rate': 1.3750565623047257e-07, 'epoch': 15.33}

 96%|█████████▌| 356000/371472 [6:10:16<1:12:16,  3.57it/s]
 96%|█████████▌| 356001/371472 [6:10:16<1:13:09,  3.52it/s]
 96%|█████████▌| 356002/371472 [6:10:16<1:11:45,  3.59it/s]
 96%|█████████▌| 356003/371472 [6:10:16<1:10:26,  3.66it/s]
 96%|█████████▌| 356004/371472 [6:10:17<1:09:57,  3.69it/s]
 96%|█████████▌| 356005/371472 [6:10:17<1:10:47,  3.64it/s]
 96%|█████████▌| 356006/371472 [6:10:17<1:13:12,  3.52it/s]
 96%|█████████▌| 356007/371472 [6:10:18<1:10:09,  3.67it/s]
 96%|█████████▌| 356008/371472 [6:10:18<1:13:08,  3.52it/s]
 96%|█████████▌| 356009/371472 [6:10:18<1:13:57,  3.48it/s]
 96%|█████████▌| 356010/371472 [6:10:18<1:10:21,  3.66it/s]
 96%|█████████▌| 356011/371472 [6:10:19<1:11:58,  3.58it/s]
 96%|█████████▌| 356012/371472 [6:10:19<1:17:17,  3.33it/s]
 96%|█████████▌| 356013/371472 [6:10:19<1:13:50,  3.49it/s]
 96%|█████████▌| 356014/371472 [6:10:20<1:11:29,  3.60it/s]
 96%|█████████▌| 356015/371472 [6:10:20<1:12:49,  3.54it/s]
 96%|█████████▌| 356016/371472 [6:10:20<1:12:12,  3.57it/s]
 96%|█████████▌| 356017/371472 [6:10:20<1:12:03,  3.58it/s]
 96%|█████████▌| 356018/371472 [6:10:21<1:12:20,  3.56it/s]
 96%|█████████▌| 356019/371472 [6:10:21<1:16:54,  3.35it/s]
 96%|█████████▌| 356020/371472 [6:10:21<1:14:47,  3.44it/s]
                                                           
{'loss': 2.4135, 'learning_rate': 1.374571742549936e-07, 'epoch': 15.33}

 96%|█████████▌| 356020/371472 [6:10:21<1:14:47,  3.44it/s]
 96%|█████████▌| 356021/371472 [6:10:22<1:19:05,  3.26it/s]
 96%|█████████▌| 356022/371472 [6:10:22<1:13:43,  3.49it/s]
 96%|█████████▌| 356023/371472 [6:10:22<1:11:21,  3.61it/s]
 96%|█████████▌| 356024/371472 [6:10:22<1:13:54,  3.48it/s]
 96%|█████████▌| 356025/371472 [6:10:23<1:15:55,  3.39it/s]
 96%|█████████▌| 356026/371472 [6:10:23<1:16:26,  3.37it/s]
 96%|█████████▌| 356027/371472 [6:10:23<1:15:55,  3.39it/s]
 96%|█████████▌| 356028/371472 [6:10:24<1:14:41,  3.45it/s]
 96%|█████████▌| 356029/371472 [6:10:24<1:11:27,  3.60it/s]
 96%|█████████▌| 356030/371472 [6:10:24<1:10:05,  3.67it/s]
 96%|█████████▌| 356031/371472 [6:10:24<1:13:20,  3.51it/s]
 96%|█████████▌| 356032/371472 [6:10:25<1:15:47,  3.40it/s]
 96%|█████████▌| 356033/371472 [6:10:25<1:17:02,  3.34it/s]
 96%|█████████▌| 356034/371472 [6:10:25<1:18:08,  3.29it/s]
 96%|█████████▌| 356035/371472 [6:10:26<1:17:28,  3.32it/s]
 96%|█████████▌| 356036/371472 [6:10:26<1:17:36,  3.31it/s]
 96%|█████████▌| 356037/371472 [6:10:26<1:21:11,  3.17it/s]
 96%|█████████▌| 356038/371472 [6:10:27<1:22:45,  3.11it/s]
 96%|█████████▌| 356039/371472 [6:10:27<1:19:49,  3.22it/s]
 96%|█████████▌| 356040/371472 [6:10:27<1:17:51,  3.30it/s]
                                                           
{'loss': 2.5815, 'learning_rate': 1.3740869227951476e-07, 'epoch': 15.34}

 96%|█████████▌| 356040/371472 [6:10:27<1:17:51,  3.30it/s]
 96%|█████████▌| 356041/371472 [6:10:27<1:15:28,  3.41it/s]
 96%|█████████▌| 356042/371472 [6:10:28<1:18:11,  3.29it/s]
 96%|█████████▌| 356043/371472 [6:10:28<1:17:12,  3.33it/s]
 96%|█████████▌| 356044/371472 [6:10:28<1:15:55,  3.39it/s]
 96%|█████████▌| 356045/371472 [6:10:29<1:13:57,  3.48it/s]
 96%|█████████▌| 356046/371472 [6:10:29<1:20:27,  3.20it/s]
 96%|█████████▌| 356047/371472 [6:10:29<1:25:22,  3.01it/s]
 96%|█████████▌| 356048/371472 [6:10:30<1:20:25,  3.20it/s]
 96%|█████████▌| 356049/371472 [6:10:30<1:16:42,  3.35it/s]
 96%|█████████▌| 356050/371472 [6:10:30<1:14:55,  3.43it/s]
 96%|█████████▌| 356051/371472 [6:10:30<1:13:29,  3.50it/s]
 96%|█████████▌| 356052/371472 [6:10:31<1:16:37,  3.35it/s]
 96%|█████████▌| 356053/371472 [6:10:31<1:14:06,  3.47it/s]
 96%|█████████▌| 356054/371472 [6:10:31<1:15:38,  3.40it/s]
 96%|█████████▌| 356055/371472 [6:10:32<1:20:16,  3.20it/s]
 96%|█████████▌| 356056/371472 [6:10:32<1:18:27,  3.28it/s]
 96%|█████████▌| 356057/371472 [6:10:32<1:21:06,  3.17it/s]
 96%|█████████▌| 356058/371472 [6:10:33<1:19:43,  3.22it/s]
 96%|█████████▌| 356059/371472 [6:10:33<1:21:36,  3.15it/s]
 96%|█████████▌| 356060/371472 [6:10:33<1:16:36,  3.35it/s]
                                                           
{'loss': 2.5068, 'learning_rate': 1.3736021030403583e-07, 'epoch': 15.34}

 96%|█████████▌| 356060/371472 [6:10:33<1:16:36,  3.35it/s]
 96%|█████████▌| 356061/371472 [6:10:34<1:15:25,  3.41it/s]
 96%|█████████▌| 356062/371472 [6:10:34<1:16:04,  3.38it/s]
 96%|█████████▌| 356063/371472 [6:10:34<1:21:10,  3.16it/s]
 96%|█████████▌| 356064/371472 [6:10:34<1:17:21,  3.32it/s]
 96%|█████████▌| 356065/371472 [6:10:35<1:13:25,  3.50it/s]
 96%|█████████▌| 356066/371472 [6:10:35<1:11:12,  3.61it/s]
 96%|█████████▌| 356067/371472 [6:10:35<1:21:22,  3.16it/s]
 96%|█████████▌| 356068/371472 [6:10:36<1:22:29,  3.11it/s]
 96%|█████████▌| 356069/371472 [6:10:36<1:16:54,  3.34it/s]
 96%|█████████▌| 356070/371472 [6:10:36<1:18:42,  3.26it/s]
 96%|█████████▌| 356071/371472 [6:10:37<1:16:19,  3.36it/s]
 96%|█████████▌| 356072/371472 [6:10:37<1:12:13,  3.55it/s]
 96%|█████████▌| 356073/371472 [6:10:37<1:10:35,  3.64it/s]
 96%|█████████▌| 356074/371472 [6:10:37<1:11:02,  3.61it/s]
 96%|█████████▌| 356075/371472 [6:10:38<1:08:51,  3.73it/s]
 96%|█████████▌| 356076/371472 [6:10:38<1:11:43,  3.58it/s]
 96%|█████████▌| 356077/371472 [6:10:38<1:11:38,  3.58it/s]
 96%|█████████▌| 356078/371472 [6:10:38<1:09:37,  3.68it/s]
 96%|█████████▌| 356079/371472 [6:10:39<1:07:47,  3.78it/s]
 96%|█████████▌| 356080/371472 [6:10:39<1:10:25,  3.64it/s]
                                                           
{'loss': 2.7345, 'learning_rate': 1.3731172832855698e-07, 'epoch': 15.34}

 96%|█████████▌| 356080/371472 [6:10:39<1:10:25,  3.64it/s]
 96%|█████████▌| 356081/371472 [6:10:39<1:08:55,  3.72it/s]
 96%|█████████▌| 356082/371472 [6:10:39<1:07:56,  3.78it/s]
 96%|█████████▌| 356083/371472 [6:10:40<1:08:12,  3.76it/s]
 96%|█████████▌| 356084/371472 [6:10:40<1:08:43,  3.73it/s]
 96%|█████████▌| 356085/371472 [6:10:40<1:07:13,  3.81it/s]
 96%|█████████▌| 356086/371472 [6:10:41<1:06:40,  3.85it/s]
 96%|█████████▌| 356087/371472 [6:10:41<1:06:48,  3.84it/s]
 96%|█████████▌| 356088/371472 [6:10:41<1:08:30,  3.74it/s]
 96%|█████████▌| 356089/371472 [6:10:41<1:11:35,  3.58it/s]
 96%|█████████▌| 356090/371472 [6:10:42<1:16:41,  3.34it/s]
 96%|█████████▌| 356091/371472 [6:10:42<1:16:02,  3.37it/s]
 96%|█████████▌| 356092/371472 [6:10:42<1:17:21,  3.31it/s]
 96%|█████████▌| 356093/371472 [6:10:43<1:16:17,  3.36it/s]
 96%|█████████▌| 356094/371472 [6:10:43<1:15:43,  3.38it/s]
 96%|█████████▌| 356095/371472 [6:10:43<1:11:37,  3.58it/s]
 96%|█████████▌| 356096/371472 [6:10:43<1:11:12,  3.60it/s]
 96%|█████████▌| 356097/371472 [6:10:44<1:14:46,  3.43it/s]
 96%|█████████▌| 356098/371472 [6:10:44<1:11:52,  3.57it/s]
 96%|█████████▌| 356099/371472 [6:10:44<1:17:54,  3.29it/s]
 96%|█████████▌| 356100/371472 [6:10:45<1:14:06,  3.46it/s]
                                                           
{'loss': 2.604, 'learning_rate': 1.3726324635307803e-07, 'epoch': 15.34}

 96%|█████████▌| 356100/371472 [6:10:45<1:14:06,  3.46it/s]
 96%|█████████▌| 356101/371472 [6:10:45<1:16:29,  3.35it/s]
 96%|█████████▌| 356102/371472 [6:10:45<1:26:44,  2.95it/s]
 96%|█████████▌| 356103/371472 [6:10:46<1:20:57,  3.16it/s]
 96%|█████████▌| 356104/371472 [6:10:46<1:17:13,  3.32it/s]
 96%|█████████▌| 356105/371472 [6:10:46<1:19:00,  3.24it/s]
 96%|█████████▌| 356106/371472 [6:10:47<1:17:35,  3.30it/s]
 96%|█████████▌| 356107/371472 [6:10:47<1:14:29,  3.44it/s]
 96%|█████████▌| 356108/371472 [6:10:47<1:12:57,  3.51it/s]
 96%|█████████▌| 356109/371472 [6:10:47<1:13:29,  3.48it/s]
 96%|█████████▌| 356110/371472 [6:10:48<1:13:55,  3.46it/s]
 96%|█████████▌| 356111/371472 [6:10:48<1:14:59,  3.41it/s]
 96%|█████████▌| 356112/371472 [6:10:48<1:13:12,  3.50it/s]
 96%|█████████▌| 356113/371472 [6:10:48<1:11:28,  3.58it/s]
 96%|█████████▌| 356114/371472 [6:10:49<1:11:48,  3.56it/s]
 96%|█████████▌| 356115/371472 [6:10:49<1:10:46,  3.62it/s]
 96%|█████████▌| 356116/371472 [6:10:49<1:12:34,  3.53it/s]
 96%|█████████▌| 356117/371472 [6:10:50<1:13:03,  3.50it/s]
 96%|█████████▌| 356118/371472 [6:10:50<1:10:03,  3.65it/s]
 96%|█████████▌| 356119/371472 [6:10:50<1:10:10,  3.65it/s]
 96%|█████████▌| 356120/371472 [6:10:50<1:08:25,  3.74it/s]
                                                           
{'loss': 2.585, 'learning_rate': 1.372147643775992e-07, 'epoch': 15.34}

 96%|█████████▌| 356120/371472 [6:10:50<1:08:25,  3.74it/s]
 96%|█████████▌| 356121/371472 [6:10:51<1:07:25,  3.79it/s]
 96%|█████████▌| 356122/371472 [6:10:51<1:11:12,  3.59it/s]
 96%|█████████▌| 356123/371472 [6:10:51<1:09:34,  3.68it/s]
 96%|█████████▌| 356124/371472 [6:10:51<1:07:09,  3.81it/s]
 96%|█████████▌| 356125/371472 [6:10:52<1:09:17,  3.69it/s]
 96%|█████████▌| 356126/371472 [6:10:52<1:15:12,  3.40it/s]
 96%|█████████▌| 356127/371472 [6:10:52<1:14:17,  3.44it/s]
 96%|█████████▌| 356128/371472 [6:10:53<1:13:07,  3.50it/s]
 96%|█████████▌| 356129/371472 [6:10:53<1:12:55,  3.51it/s]
 96%|█████████▌| 356130/371472 [6:10:53<1:13:58,  3.46it/s]
 96%|█████████▌| 356131/371472 [6:10:54<1:14:45,  3.42it/s]
 96%|█████████▌| 356132/371472 [6:10:54<1:13:10,  3.49it/s]
 96%|█████████▌| 356133/371472 [6:10:54<1:10:16,  3.64it/s]
 96%|█████████▌| 356134/371472 [6:10:54<1:15:43,  3.38it/s]
 96%|█████████▌| 356135/371472 [6:10:55<1:15:29,  3.39it/s]
 96%|█████████▌| 356136/371472 [6:10:55<1:11:28,  3.58it/s]
 96%|█████████▌| 356137/371472 [6:10:55<1:09:48,  3.66it/s]
 96%|█████████▌| 356138/371472 [6:10:55<1:07:47,  3.77it/s]
 96%|█████████▌| 356139/371472 [6:10:56<1:09:25,  3.68it/s]
 96%|█████████▌| 356140/371472 [6:10:56<1:09:44,  3.66it/s]
                                                           
{'loss': 2.6818, 'learning_rate': 1.3716628240212025e-07, 'epoch': 15.34}

 96%|█████████▌| 356140/371472 [6:10:56<1:09:44,  3.66it/s]
 96%|█████████▌| 356141/371472 [6:10:56<1:12:38,  3.52it/s]
 96%|█████████▌| 356142/371472 [6:10:57<1:11:03,  3.60it/s]
 96%|█████████▌| 356143/371472 [6:10:57<1:15:10,  3.40it/s]
 96%|█████████▌| 356144/371472 [6:10:57<1:12:49,  3.51it/s]
 96%|█████████▌| 356145/371472 [6:10:57<1:11:18,  3.58it/s]
 96%|█████████▌| 356146/371472 [6:10:58<1:11:03,  3.59it/s]
 96%|█████████▌| 356147/371472 [6:10:58<1:11:27,  3.57it/s]
 96%|█████████▌| 356148/371472 [6:10:58<1:13:20,  3.48it/s]
 96%|█████████▌| 356149/371472 [6:10:59<1:13:37,  3.47it/s]
 96%|█████████▌| 356150/371472 [6:10:59<1:15:29,  3.38it/s]
 96%|█████████▌| 356151/371472 [6:10:59<1:15:05,  3.40it/s]
 96%|█████████▌| 356152/371472 [6:10:59<1:11:03,  3.59it/s]
 96%|█████████▌| 356153/371472 [6:11:00<1:09:01,  3.70it/s]
 96%|█████████▌| 356154/371472 [6:11:00<1:11:06,  3.59it/s]
 96%|█████████▌| 356155/371472 [6:11:00<1:13:13,  3.49it/s]
 96%|█████████▌| 356156/371472 [6:11:01<1:19:38,  3.21it/s]
 96%|█████████▌| 356157/371472 [6:11:01<1:18:00,  3.27it/s]
 96%|█████████▌| 356158/371472 [6:11:01<1:15:41,  3.37it/s]
 96%|█████████▌| 356159/371472 [6:11:02<1:17:05,  3.31it/s]
 96%|█████████▌| 356160/371472 [6:11:02<1:13:11,  3.49it/s]
                                                           
{'loss': 2.708, 'learning_rate': 1.371178004266414e-07, 'epoch': 15.34}

 96%|█████████▌| 356160/371472 [6:11:02<1:13:11,  3.49it/s]
 96%|█████████▌| 356161/371472 [6:11:02<1:14:35,  3.42it/s]
 96%|█████████▌| 356162/371472 [6:11:02<1:12:15,  3.53it/s]
 96%|█████████▌| 356163/371472 [6:11:03<1:08:34,  3.72it/s]
 96%|█████████▌| 356164/371472 [6:11:03<1:08:52,  3.70it/s]
 96%|█████████▌| 356165/371472 [6:11:03<1:10:25,  3.62it/s]
 96%|█████████▌| 356166/371472 [6:11:03<1:09:31,  3.67it/s]
 96%|█████████▌| 356167/371472 [6:11:04<1:12:39,  3.51it/s]
 96%|█████████▌| 356168/371472 [6:11:04<1:11:38,  3.56it/s]
 96%|█████████▌| 356169/371472 [6:11:04<1:09:05,  3.69it/s]
 96%|█████████▌| 356170/371472 [6:11:05<1:09:05,  3.69it/s]
 96%|█████████▌| 356171/371472 [6:11:05<1:09:51,  3.65it/s]
 96%|█████████▌| 356172/371472 [6:11:05<1:08:39,  3.71it/s]
 96%|█████████▌| 356173/371472 [6:11:05<1:08:15,  3.74it/s]
 96%|█████████▌| 356174/371472 [6:11:06<1:08:02,  3.75it/s]
 96%|█████████▌| 356175/371472 [6:11:06<1:10:35,  3.61it/s]
 96%|█████████▌| 356176/371472 [6:11:06<1:12:15,  3.53it/s]
 96%|█████████▌| 356177/371472 [6:11:07<1:16:36,  3.33it/s]
 96%|█████████▌| 356178/371472 [6:11:07<1:14:40,  3.41it/s]
 96%|█████████▌| 356179/371472 [6:11:07<1:15:30,  3.38it/s]
 96%|█████████▌| 356180/371472 [6:11:07<1:21:06,  3.14it/s]
                                                           
{'loss': 2.519, 'learning_rate': 1.3706931845116247e-07, 'epoch': 15.34}

 96%|█████████▌| 356180/371472 [6:11:07<1:21:06,  3.14it/s]
 96%|█████████▌| 356181/371472 [6:11:08<1:18:42,  3.24it/s]
 96%|█████████▌| 356182/371472 [6:11:08<1:14:35,  3.42it/s]
 96%|█████████▌| 356183/371472 [6:11:08<1:12:28,  3.52it/s]
 96%|█████████▌| 356184/371472 [6:11:09<1:13:03,  3.49it/s]
 96%|█████████▌| 356185/371472 [6:11:09<1:13:57,  3.44it/s]
 96%|█████████▌| 356186/371472 [6:11:09<1:13:44,  3.45it/s]
 96%|█████████▌| 356187/371472 [6:11:09<1:13:41,  3.46it/s]
 96%|█████████▌| 356188/371472 [6:11:10<1:12:29,  3.51it/s]
 96%|█████████▌| 356189/371472 [6:11:10<1:11:05,  3.58it/s]
 96%|█████████▌| 356190/371472 [6:11:10<1:15:04,  3.39it/s]
 96%|█████████▌| 356191/371472 [6:11:11<1:11:58,  3.54it/s]
 96%|█████████▌| 356192/371472 [6:11:11<1:11:52,  3.54it/s]
 96%|█████████▌| 356193/371472 [6:11:11<1:17:29,  3.29it/s]
 96%|█████████▌| 356194/371472 [6:11:11<1:13:00,  3.49it/s]
 96%|█████████▌| 356195/371472 [6:11:12<1:09:50,  3.65it/s]
 96%|█████████▌| 356196/371472 [6:11:12<1:10:00,  3.64it/s]
 96%|█████████▌| 356197/371472 [6:11:12<1:08:45,  3.70it/s]
 96%|█████████▌| 356198/371472 [6:11:13<1:11:28,  3.56it/s]
 96%|█████████▌| 356199/371472 [6:11:13<1:07:52,  3.75it/s]
 96%|█████████▌| 356200/371472 [6:11:13<1:08:56,  3.69it/s]
                                                           
{'loss': 2.5596, 'learning_rate': 1.3702083647568363e-07, 'epoch': 15.34}

 96%|█████████▌| 356200/371472 [6:11:13<1:08:56,  3.69it/s]
 96%|█████████▌| 356201/371472 [6:11:13<1:10:36,  3.60it/s]
 96%|█████████▌| 356202/371472 [6:11:14<1:10:45,  3.60it/s]
 96%|█████████▌| 356203/371472 [6:11:14<1:15:25,  3.37it/s]
 96%|█████████▌| 356204/371472 [6:11:14<1:14:27,  3.42it/s]
 96%|█████████▌| 356205/371472 [6:11:15<1:18:01,  3.26it/s]
 96%|█████████▌| 356206/371472 [6:11:15<1:16:15,  3.34it/s]
 96%|█████████▌| 356207/371472 [6:11:15<1:14:14,  3.43it/s]
 96%|█████████▌| 356208/371472 [6:11:15<1:17:28,  3.28it/s]
 96%|█████████▌| 356209/371472 [6:11:16<1:15:30,  3.37it/s]
 96%|█████████▌| 356210/371472 [6:11:16<1:15:01,  3.39it/s]
 96%|█████████▌| 356211/371472 [6:11:16<1:12:59,  3.48it/s]
 96%|█████████▌| 356212/371472 [6:11:17<1:09:58,  3.63it/s]
 96%|█████████▌| 356213/371472 [6:11:17<1:10:05,  3.63it/s]
 96%|█████████▌| 356214/371472 [6:11:17<1:09:00,  3.68it/s]
 96%|█████████▌| 356215/371472 [6:11:17<1:09:34,  3.65it/s]
 96%|█████████▌| 356216/371472 [6:11:18<1:13:13,  3.47it/s]
 96%|█████████▌| 356217/371472 [6:11:18<1:11:44,  3.54it/s]
 96%|█████████▌| 356218/371472 [6:11:18<1:14:04,  3.43it/s]
 96%|█████████▌| 356219/371472 [6:11:19<1:10:46,  3.59it/s]
 96%|█████████▌| 356220/371472 [6:11:19<1:12:17,  3.52it/s]
                                                           
{'loss': 2.5721, 'learning_rate': 1.369723545002047e-07, 'epoch': 15.34}

 96%|█████████▌| 356220/371472 [6:11:19<1:12:17,  3.52it/s]
 96%|█████████▌| 356221/371472 [6:11:19<1:15:14,  3.38it/s]
 96%|█████████▌| 356222/371472 [6:11:20<1:20:23,  3.16it/s]
 96%|█████████▌| 356223/371472 [6:11:20<1:18:58,  3.22it/s]
 96%|█████████▌| 356224/371472 [6:11:20<1:21:40,  3.11it/s]
 96%|█████████▌| 356225/371472 [6:11:21<1:28:49,  2.86it/s]
 96%|█████████▌| 356226/371472 [6:11:21<1:24:24,  3.01it/s]
 96%|█████████▌| 356227/371472 [6:11:21<1:24:17,  3.01it/s]
 96%|█████████▌| 356228/371472 [6:11:21<1:19:01,  3.22it/s]
 96%|█████████▌| 356229/371472 [6:11:22<1:17:11,  3.29it/s]
 96%|█████████▌| 356230/371472 [6:11:22<1:16:46,  3.31it/s]
 96%|█████████▌| 356231/371472 [6:11:22<1:17:08,  3.29it/s]
 96%|█████████▌| 356232/371472 [6:11:23<1:16:59,  3.30it/s]
 96%|█████████▌| 356233/371472 [6:11:23<1:16:23,  3.32it/s]
 96%|█████████▌| 356234/371472 [6:11:23<1:12:59,  3.48it/s]
 96%|█████████▌| 356235/371472 [6:11:23<1:11:21,  3.56it/s]
 96%|█████████▌| 356236/371472 [6:11:24<1:08:20,  3.72it/s]
 96%|█████████▌| 356237/371472 [6:11:24<1:09:25,  3.66it/s]
 96%|█████████▌| 356238/371472 [6:11:24<1:13:41,  3.45it/s]
 96%|█████████▌| 356239/371472 [6:11:25<1:10:30,  3.60it/s]
 96%|█████████▌| 356240/371472 [6:11:25<1:09:29,  3.65it/s]
                                                           
{'loss': 2.5023, 'learning_rate': 1.3692387252472585e-07, 'epoch': 15.34}

 96%|█████████▌| 356240/371472 [6:11:25<1:09:29,  3.65it/s]
 96%|█████████▌| 356241/371472 [6:11:25<1:07:15,  3.77it/s]
 96%|█████████▌| 356242/371472 [6:11:25<1:06:41,  3.81it/s]
 96%|█████████▌| 356243/371472 [6:11:26<1:09:48,  3.64it/s]
 96%|█████████▌| 356244/371472 [6:11:26<1:13:47,  3.44it/s]
 96%|█████████▌| 356245/371472 [6:11:26<1:22:12,  3.09it/s]
 96%|█████████▌| 356246/371472 [6:11:27<1:21:02,  3.13it/s]
 96%|█████████▌| 356247/371472 [6:11:27<1:17:10,  3.29it/s]
 96%|█████████▌| 356248/371472 [6:11:27<1:16:10,  3.33it/s]
 96%|█████████▌| 356249/371472 [6:11:28<1:13:49,  3.44it/s]
 96%|█████████▌| 356250/371472 [6:11:28<1:12:26,  3.50it/s]
 96%|█████████▌| 356251/371472 [6:11:28<1:10:40,  3.59it/s]
 96%|█████████▌| 356252/371472 [6:11:28<1:13:12,  3.47it/s]
 96%|█████████▌| 356253/371472 [6:11:29<1:14:34,  3.40it/s]
 96%|█████████▌| 356254/371472 [6:11:29<1:12:59,  3.47it/s]
 96%|█████████▌| 356255/371472 [6:11:29<1:12:44,  3.49it/s]
 96%|█████████▌| 356256/371472 [6:11:30<1:13:48,  3.44it/s]
 96%|█████████▌| 356257/371472 [6:11:30<1:15:44,  3.35it/s]
 96%|█████████▌| 356258/371472 [6:11:30<1:13:05,  3.47it/s]
 96%|█████████▌| 356259/371472 [6:11:30<1:12:51,  3.48it/s]
 96%|█████████▌| 356260/371472 [6:11:31<1:12:29,  3.50it/s]
                                                           
{'loss': 2.6405, 'learning_rate': 1.3687539054924695e-07, 'epoch': 15.34}

 96%|█████████▌| 356260/371472 [6:11:31<1:12:29,  3.50it/s]
 96%|█████████▌| 356261/371472 [6:11:31<1:11:41,  3.54it/s]
 96%|█████████▌| 356262/371472 [6:11:31<1:08:12,  3.72it/s]
 96%|█████████▌| 356263/371472 [6:11:32<1:13:08,  3.47it/s]
 96%|█████████▌| 356264/371472 [6:11:32<1:14:35,  3.40it/s]
 96%|█████████▌| 356265/371472 [6:11:32<1:19:59,  3.17it/s]
 96%|█████████▌| 356266/371472 [6:11:33<1:18:42,  3.22it/s]
 96%|█████████▌| 356267/371472 [6:11:33<1:17:26,  3.27it/s]
 96%|█████████▌| 356268/371472 [6:11:33<1:17:01,  3.29it/s]
 96%|█████████▌| 356269/371472 [6:11:33<1:19:24,  3.19it/s]
 96%|█████████▌| 356270/371472 [6:11:34<1:14:37,  3.40it/s]
 96%|█████████▌| 356271/371472 [6:11:34<1:11:21,  3.55it/s]
 96%|█████████▌| 356272/371472 [6:11:34<1:11:02,  3.57it/s]
 96%|█████████▌| 356273/371472 [6:11:34<1:10:01,  3.62it/s]
 96%|█████████▌| 356274/371472 [6:11:35<1:07:10,  3.77it/s]
 96%|█████████▌| 356275/371472 [6:11:35<1:07:33,  3.75it/s]
 96%|█████████▌| 356276/371472 [6:11:35<1:14:03,  3.42it/s]
 96%|█████████▌| 356277/371472 [6:11:36<1:15:40,  3.35it/s]
 96%|█████████▌| 356278/371472 [6:11:36<1:14:11,  3.41it/s]
 96%|█████████▌| 356279/371472 [6:11:36<1:12:16,  3.50it/s]
 96%|█████████▌| 356280/371472 [6:11:36<1:10:28,  3.59it/s]
                                                           
{'loss': 2.6164, 'learning_rate': 1.3682690857376807e-07, 'epoch': 15.35}

 96%|█████████▌| 356280/371472 [6:11:36<1:10:28,  3.59it/s]
 96%|█████████▌| 356281/371472 [6:11:37<1:11:23,  3.55it/s]
 96%|█████████▌| 356282/371472 [6:11:37<1:10:50,  3.57it/s]
 96%|█████████▌| 356283/371472 [6:11:37<1:09:18,  3.65it/s]
 96%|█████████▌| 356284/371472 [6:11:38<1:08:07,  3.72it/s]
 96%|█████████▌| 356285/371472 [6:11:38<1:12:23,  3.50it/s]
 96%|█████████▌| 356286/371472 [6:11:38<1:10:05,  3.61it/s]
 96%|█████████▌| 356287/371472 [6:11:38<1:11:03,  3.56it/s]
 96%|█████████▌| 356288/371472 [6:11:39<1:13:22,  3.45it/s]
 96%|█████████▌| 356289/371472 [6:11:39<1:19:07,  3.20it/s]
 96%|█████████▌| 356290/371472 [6:11:40<1:27:47,  2.88it/s]
 96%|█████████▌| 356291/371472 [6:11:40<1:32:22,  2.74it/s]
 96%|█████████▌| 356292/371472 [6:11:40<1:24:24,  3.00it/s]
 96%|█████████▌| 356293/371472 [6:11:40<1:18:30,  3.22it/s]
 96%|█████████▌| 356294/371472 [6:11:41<1:16:48,  3.29it/s]
 96%|█████████▌| 356295/371472 [6:11:41<1:14:08,  3.41it/s]
 96%|█████████▌| 356296/371472 [6:11:41<1:14:25,  3.40it/s]
 96%|█████████▌| 356297/371472 [6:11:42<1:11:54,  3.52it/s]
 96%|█████████▌| 356298/371472 [6:11:42<1:13:28,  3.44it/s]
 96%|█████████▌| 356299/371472 [6:11:42<1:10:35,  3.58it/s]
 96%|█████████▌| 356300/371472 [6:11:42<1:08:30,  3.69it/s]
                                                           
{'loss': 2.49, 'learning_rate': 1.3677842659828912e-07, 'epoch': 15.35}

 96%|█████████▌| 356300/371472 [6:11:42<1:08:30,  3.69it/s]
 96%|█████████▌| 356301/371472 [6:11:43<1:14:08,  3.41it/s]
 96%|█████████▌| 356302/371472 [6:11:43<1:13:15,  3.45it/s]
 96%|█████████▌| 356303/371472 [6:11:43<1:12:01,  3.51it/s]
 96%|█████████▌| 356304/371472 [6:11:44<1:11:14,  3.55it/s]
 96%|█████████▌| 356305/371472 [6:11:44<1:11:44,  3.52it/s]
 96%|█████████▌| 356306/371472 [6:11:44<1:20:17,  3.15it/s]
 96%|█████████▌| 356307/371472 [6:11:44<1:16:09,  3.32it/s]
 96%|█████████▌| 356308/371472 [6:11:45<1:15:12,  3.36it/s]
 96%|█████████▌| 356309/371472 [6:11:45<1:12:45,  3.47it/s]
 96%|█████████▌| 356310/371472 [6:11:45<1:12:23,  3.49it/s]
 96%|█████████▌| 356311/371472 [6:11:46<1:09:15,  3.65it/s]
 96%|█████████▌| 356312/371472 [6:11:46<1:09:44,  3.62it/s]
 96%|█████████▌| 356313/371472 [6:11:46<1:14:25,  3.39it/s]
 96%|█████████▌| 356314/371472 [6:11:47<1:20:05,  3.15it/s]
 96%|█████████▌| 356315/371472 [6:11:47<1:16:39,  3.30it/s]
 96%|█████████▌| 356316/371472 [6:11:47<1:19:11,  3.19it/s]
 96%|█████████▌| 356317/371472 [6:11:47<1:15:26,  3.35it/s]
 96%|█████████▌| 356318/371472 [6:11:48<1:12:08,  3.50it/s]
 96%|█████████▌| 356319/371472 [6:11:48<1:11:44,  3.52it/s]
 96%|█████████▌| 356320/371472 [6:11:48<1:14:28,  3.39it/s]
                                                           
{'loss': 2.4903, 'learning_rate': 1.3672994462281019e-07, 'epoch': 15.35}

 96%|█████████▌| 356320/371472 [6:11:48<1:14:28,  3.39it/s]
 96%|█████████▌| 356321/371472 [6:11:49<1:14:06,  3.41it/s]
 96%|█████████▌| 356322/371472 [6:11:49<1:16:07,  3.32it/s]
 96%|█████████▌| 356323/371472 [6:11:49<1:16:30,  3.30it/s]
 96%|█████████▌| 356324/371472 [6:11:50<1:16:44,  3.29it/s]
 96%|█████████▌| 356325/371472 [6:11:50<1:14:05,  3.41it/s]
 96%|█████████▌| 356326/371472 [6:11:50<1:12:25,  3.49it/s]
 96%|█████████▌| 356327/371472 [6:11:50<1:15:15,  3.35it/s]
 96%|█████████▌| 356328/371472 [6:11:51<1:13:37,  3.43it/s]
 96%|█████████▌| 356329/371472 [6:11:51<1:13:26,  3.44it/s]
 96%|█████████▌| 356330/371472 [6:11:51<1:19:11,  3.19it/s]
 96%|█████████▌| 356331/371472 [6:11:52<1:14:43,  3.38it/s]
 96%|█████████▌| 356332/371472 [6:11:52<1:12:46,  3.47it/s]
 96%|█████████▌| 356333/371472 [6:11:52<1:17:05,  3.27it/s]
 96%|█████████▌| 356334/371472 [6:11:52<1:13:17,  3.44it/s]
 96%|█████████▌| 356335/371472 [6:11:53<1:12:32,  3.48it/s]
 96%|█████████▌| 356336/371472 [6:11:53<1:12:41,  3.47it/s]
 96%|█████████▌| 356337/371472 [6:11:53<1:14:54,  3.37it/s]
 96%|█████████▌| 356338/371472 [6:11:54<1:12:00,  3.50it/s]
 96%|█████████▌| 356339/371472 [6:11:54<1:09:13,  3.64it/s]
 96%|█████████▌| 356340/371472 [6:11:54<1:07:52,  3.72it/s]
                                                           
{'loss': 2.5136, 'learning_rate': 1.3668146264733134e-07, 'epoch': 15.35}

 96%|█████████▌| 356340/371472 [6:11:54<1:07:52,  3.72it/s]
 96%|█████████▌| 356341/371472 [6:11:54<1:08:24,  3.69it/s]
 96%|█████████▌| 356342/371472 [6:11:55<1:10:16,  3.59it/s]
 96%|█████████▌| 356343/371472 [6:11:55<1:13:21,  3.44it/s]
 96%|█████████▌| 356344/371472 [6:11:55<1:09:09,  3.65it/s]
 96%|█████████▌| 356345/371472 [6:11:56<1:09:58,  3.60it/s]
 96%|█████████▌| 356346/371472 [6:11:56<1:07:52,  3.71it/s]
 96%|█████████▌| 356347/371472 [6:11:56<1:09:05,  3.65it/s]
 96%|█████████▌| 356348/371472 [6:11:56<1:09:23,  3.63it/s]
 96%|█████████▌| 356349/371472 [6:11:57<1:09:33,  3.62it/s]
 96%|█████████▌| 356350/371472 [6:11:57<1:06:40,  3.78it/s]
 96%|█████████▌| 356351/371472 [6:11:57<1:04:31,  3.91it/s]
 96%|█████████▌| 356352/371472 [6:11:57<1:07:22,  3.74it/s]
 96%|█████████▌| 356353/371472 [6:11:58<1:07:30,  3.73it/s]
 96%|█████████▌| 356354/371472 [6:11:58<1:10:30,  3.57it/s]
 96%|█████████▌| 356355/371472 [6:11:58<1:09:27,  3.63it/s]
 96%|█████████▌| 356356/371472 [6:11:58<1:08:21,  3.69it/s]
 96%|█████████▌| 356357/371472 [6:11:59<1:08:14,  3.69it/s]
 96%|█████████▌| 356358/371472 [6:11:59<1:10:36,  3.57it/s]
 96%|█████████▌| 356359/371472 [6:11:59<1:08:19,  3.69it/s]
 96%|█████████▌| 356360/371472 [6:12:00<1:07:54,  3.71it/s]
                                                           
{'loss': 2.7022, 'learning_rate': 1.3663298067185238e-07, 'epoch': 15.35}

 96%|█████████▌| 356360/371472 [6:12:00<1:07:54,  3.71it/s]
 96%|█████████▌| 356361/371472 [6:12:00<1:07:03,  3.76it/s]
 96%|█████████▌| 356362/371472 [6:12:00<1:06:57,  3.76it/s]
 96%|█████████▌| 356363/371472 [6:12:00<1:05:05,  3.87it/s]
 96%|█████████▌| 356364/371472 [6:12:01<1:05:58,  3.82it/s]
 96%|█████████▌| 356365/371472 [6:12:01<1:04:29,  3.90it/s]
 96%|█████████▌| 356366/371472 [6:12:01<1:09:50,  3.61it/s]
 96%|█████████▌| 356367/371472 [6:12:01<1:11:41,  3.51it/s]
 96%|█████████▌| 356368/371472 [6:12:02<1:10:18,  3.58it/s]
 96%|█████████▌| 356369/371472 [6:12:02<1:11:48,  3.51it/s]
 96%|█████████▌| 356370/371472 [6:12:02<1:09:17,  3.63it/s]
 96%|█████████▌| 356371/371472 [6:12:03<1:11:00,  3.54it/s]
 96%|█████████▌| 356372/371472 [6:12:03<1:09:01,  3.65it/s]
 96%|█████████▌| 356373/371472 [6:12:03<1:13:07,  3.44it/s]
 96%|█████████▌| 356374/371472 [6:12:03<1:12:11,  3.49it/s]
 96%|█████████▌| 356375/371472 [6:12:04<1:13:30,  3.42it/s]
 96%|█████████▌| 356376/371472 [6:12:04<1:16:12,  3.30it/s]
 96%|█████████▌| 356377/371472 [6:12:04<1:19:20,  3.17it/s]
 96%|█████████▌| 356378/371472 [6:12:05<1:15:04,  3.35it/s]
 96%|█████████▌| 356379/371472 [6:12:05<1:12:08,  3.49it/s]
 96%|█████████▌| 356380/371472 [6:12:05<1:13:18,  3.43it/s]
                                                           
{'loss': 2.7203, 'learning_rate': 1.3658449869637356e-07, 'epoch': 15.35}

 96%|█████████▌| 356380/371472 [6:12:05<1:13:18,  3.43it/s]
 96%|█████████▌| 356381/371472 [6:12:06<1:12:08,  3.49it/s]
 96%|█████████▌| 356382/371472 [6:12:06<1:08:41,  3.66it/s]
 96%|█████████▌| 356383/371472 [6:12:06<1:09:49,  3.60it/s]
 96%|█████████▌| 356384/371472 [6:12:06<1:09:12,  3.63it/s]
 96%|█████████▌| 356385/371472 [6:12:07<1:07:04,  3.75it/s]
 96%|█████████▌| 356386/371472 [6:12:07<1:06:35,  3.78it/s]
 96%|█████████▌| 356387/371472 [6:12:07<1:06:15,  3.79it/s]
 96%|█████████▌| 356388/371472 [6:12:07<1:07:20,  3.73it/s]
 96%|█████████▌| 356389/371472 [6:12:08<1:08:56,  3.65it/s]
 96%|█████████▌| 356390/371472 [6:12:08<1:13:34,  3.42it/s]
 96%|█████████▌| 356391/371472 [6:12:08<1:10:05,  3.59it/s]
 96%|█████████▌| 356392/371472 [6:12:09<1:09:24,  3.62it/s]
 96%|█████████▌| 356393/371472 [6:12:09<1:09:49,  3.60it/s]
 96%|█████████▌| 356394/371472 [6:12:09<1:14:01,  3.39it/s]
 96%|█████████▌| 356395/371472 [6:12:09<1:13:08,  3.44it/s]
 96%|█████████▌| 356396/371472 [6:12:10<1:15:39,  3.32it/s]
 96%|█████████▌| 356397/371472 [6:12:10<1:20:59,  3.10it/s]
 96%|█████████▌| 356398/371472 [6:12:10<1:18:49,  3.19it/s]
 96%|█████████▌| 356399/371472 [6:12:11<1:15:36,  3.32it/s]
 96%|█████████▌| 356400/371472 [6:12:11<1:21:09,  3.09it/s]
                                                           
{'loss': 2.4629, 'learning_rate': 1.365360167208946e-07, 'epoch': 15.35}

 96%|█████████▌| 356400/371472 [6:12:11<1:21:09,  3.09it/s]
 96%|█████████▌| 356401/371472 [6:12:11<1:18:12,  3.21it/s]
 96%|█████████▌| 356402/371472 [6:12:12<1:14:01,  3.39it/s]
 96%|█████████▌| 356403/371472 [6:12:12<1:13:06,  3.44it/s]
 96%|█████████▌| 356404/371472 [6:12:12<1:10:58,  3.54it/s]
 96%|█████████▌| 356405/371472 [6:12:12<1:09:18,  3.62it/s]
 96%|█████████▌| 356406/371472 [6:12:13<1:07:07,  3.74it/s]
 96%|█████████▌| 356407/371472 [6:12:13<1:06:28,  3.78it/s]
 96%|█████████▌| 356408/371472 [6:12:13<1:09:05,  3.63it/s]
 96%|█████████▌| 356409/371472 [6:12:13<1:11:05,  3.53it/s]
 96%|█████████▌| 356410/371472 [6:12:14<1:10:51,  3.54it/s]
 96%|█████████▌| 356411/371472 [6:12:14<1:09:58,  3.59it/s]
 96%|█████████▌| 356412/371472 [6:12:14<1:09:42,  3.60it/s]
 96%|█████████▌| 356413/371472 [6:12:15<1:10:22,  3.57it/s]
 96%|█████████▌| 356414/371472 [6:12:15<1:10:22,  3.57it/s]
 96%|█████████▌| 356415/371472 [6:12:15<1:10:20,  3.57it/s]
 96%|█████████▌| 356416/371472 [6:12:15<1:09:25,  3.61it/s]
 96%|█████████▌| 356417/371472 [6:12:16<1:09:15,  3.62it/s]
 96%|█████████▌| 356418/371472 [6:12:16<1:11:13,  3.52it/s]
 96%|█████████▌| 356419/371472 [6:12:16<1:11:40,  3.50it/s]
 96%|█████████▌| 356420/371472 [6:12:17<1:11:30,  3.51it/s]
                                                           
{'loss': 2.6773, 'learning_rate': 1.3648753474541576e-07, 'epoch': 15.35}

 96%|█████████▌| 356420/371472 [6:12:17<1:11:30,  3.51it/s]
 96%|█████████▌| 356421/371472 [6:12:17<1:08:32,  3.66it/s]
 96%|█████████▌| 356422/371472 [6:12:17<1:07:36,  3.71it/s]
 96%|█████████▌| 356423/371472 [6:12:17<1:11:45,  3.50it/s]
 96%|█████████▌| 356424/371472 [6:12:18<1:08:22,  3.67it/s]
 96%|█████████▌| 356425/371472 [6:12:18<1:10:24,  3.56it/s]
 96%|█████████▌| 356426/371472 [6:12:18<1:16:13,  3.29it/s]
 96%|█████████▌| 356427/371472 [6:12:19<1:12:46,  3.45it/s]
 96%|█████████▌| 356428/371472 [6:12:19<1:10:54,  3.54it/s]
 96%|█████████▌| 356429/371472 [6:12:19<1:11:28,  3.51it/s]
 96%|█████████▌| 356430/371472 [6:12:19<1:10:46,  3.54it/s]
 96%|█████████▌| 356431/371472 [6:12:20<1:14:38,  3.36it/s]
 96%|█████████▌| 356432/371472 [6:12:20<1:14:18,  3.37it/s]
 96%|█████████▌| 356433/371472 [6:12:20<1:10:31,  3.55it/s]
 96%|█████████▌| 356434/371472 [6:12:21<1:09:22,  3.61it/s]
 96%|█████████▌| 356435/371472 [6:12:21<1:08:34,  3.65it/s]
 96%|█████████▌| 356436/371472 [6:12:21<1:12:53,  3.44it/s]
 96%|█████████▌| 356437/371472 [6:12:21<1:13:05,  3.43it/s]
 96%|█████████▌| 356438/371472 [6:12:22<1:12:56,  3.44it/s]
 96%|█████████▌| 356439/371472 [6:12:22<1:13:27,  3.41it/s]
 96%|█████████▌| 356440/371472 [6:12:22<1:12:27,  3.46it/s]
                                                           
{'loss': 2.6087, 'learning_rate': 1.3643905276993683e-07, 'epoch': 15.35}

 96%|█████████▌| 356440/371472 [6:12:22<1:12:27,  3.46it/s]
 96%|█████████▌| 356441/371472 [6:12:23<1:10:09,  3.57it/s]
 96%|█████████▌| 356442/371472 [6:12:23<1:10:25,  3.56it/s]
 96%|█████████▌| 356443/371472 [6:12:23<1:08:55,  3.63it/s]
 96%|█████████▌| 356444/371472 [6:12:23<1:09:15,  3.62it/s]
 96%|█████████▌| 356445/371472 [6:12:24<1:13:09,  3.42it/s]
 96%|█████████▌| 356446/371472 [6:12:24<1:13:57,  3.39it/s]
 96%|█████████▌| 356447/371472 [6:12:24<1:13:12,  3.42it/s]
 96%|█████████▌| 356448/371472 [6:12:25<1:13:01,  3.43it/s]
 96%|█████████▌| 356449/371472 [6:12:25<1:12:12,  3.47it/s]
 96%|█████████▌| 356450/371472 [6:12:25<1:09:29,  3.60it/s]
 96%|█████████▌| 356451/371472 [6:12:25<1:12:36,  3.45it/s]
 96%|█████████▌| 356452/371472 [6:12:26<1:09:51,  3.58it/s]
 96%|█████████▌| 356453/371472 [6:12:26<1:09:10,  3.62it/s]
 96%|█████████▌| 356454/371472 [6:12:26<1:11:18,  3.51it/s]
 96%|█████████▌| 356455/371472 [6:12:27<1:10:35,  3.55it/s]
 96%|█████████▌| 356456/371472 [6:12:27<1:11:27,  3.50it/s]
 96%|█████████▌| 356457/371472 [6:12:27<1:11:56,  3.48it/s]
 96%|█████████▌| 356458/371472 [6:12:27<1:12:11,  3.47it/s]
 96%|█████████▌| 356459/371472 [6:12:28<1:10:54,  3.53it/s]
 96%|█████████▌| 356460/371472 [6:12:28<1:19:08,  3.16it/s]
                                                           
{'loss': 2.5368, 'learning_rate': 1.3639057079445798e-07, 'epoch': 15.35}

 96%|█████████▌| 356460/371472 [6:12:28<1:19:08,  3.16it/s]
 96%|█████████▌| 356461/371472 [6:12:28<1:16:29,  3.27it/s]
 96%|█████████▌| 356462/371472 [6:12:29<1:14:58,  3.34it/s]
 96%|█████████▌| 356463/371472 [6:12:29<1:14:17,  3.37it/s]
 96%|█████████▌| 356464/371472 [6:12:29<1:12:51,  3.43it/s]
 96%|█████████▌| 356465/371472 [6:12:29<1:11:41,  3.49it/s]
 96%|█████████▌| 356466/371472 [6:12:30<1:10:24,  3.55it/s]
 96%|█████████▌| 356467/371472 [6:12:30<1:08:16,  3.66it/s]
 96%|█████████▌| 356468/371472 [6:12:30<1:08:08,  3.67it/s]
 96%|█████████▌| 356469/371472 [6:12:31<1:09:56,  3.57it/s]
 96%|█████████▌| 356470/371472 [6:12:31<1:08:54,  3.63it/s]
 96%|█████████▌| 356471/371472 [6:12:31<1:09:12,  3.61it/s]
 96%|█████████▌| 356472/371472 [6:12:31<1:08:44,  3.64it/s]
 96%|█████████▌| 356473/371472 [6:12:32<1:08:42,  3.64it/s]
 96%|█████████▌| 356474/371472 [6:12:32<1:08:04,  3.67it/s]
 96%|█████████▌| 356475/371472 [6:12:32<1:07:25,  3.71it/s]
 96%|█████████▌| 356476/371472 [6:12:32<1:07:14,  3.72it/s]
 96%|█████████▌| 356477/371472 [6:12:33<1:05:56,  3.79it/s]
 96%|█████████▌| 356478/371472 [6:12:33<1:08:01,  3.67it/s]
 96%|█████████▌| 356479/371472 [6:12:33<1:05:54,  3.79it/s]
 96%|█████████▌| 356480/371472 [6:12:34<1:06:11,  3.77it/s]
                                                           
{'loss': 2.5748, 'learning_rate': 1.3634208881897902e-07, 'epoch': 15.35}

 96%|█████████▌| 356480/371472 [6:12:34<1:06:11,  3.77it/s]
 96%|█████████▌| 356481/371472 [6:12:34<1:07:50,  3.68it/s]
 96%|█████████▌| 356482/371472 [6:12:34<1:10:23,  3.55it/s]
 96%|█████████▌| 356483/371472 [6:12:34<1:08:06,  3.67it/s]
 96%|█████████▌| 356484/371472 [6:12:35<1:07:53,  3.68it/s]
 96%|█████████▌| 356485/371472 [6:12:35<1:19:10,  3.16it/s]
 96%|█████████▌| 356486/371472 [6:12:35<1:21:52,  3.05it/s]
 96%|█████████▌| 356487/371472 [6:12:36<1:17:36,  3.22it/s]
 96%|█████████▌| 356488/371472 [6:12:36<1:13:36,  3.39it/s]
 96%|█████████▌| 356489/371472 [6:12:36<1:13:44,  3.39it/s]
 96%|█████████▌| 356490/371472 [6:12:37<1:14:02,  3.37it/s]
 96%|█████████▌| 356491/371472 [6:12:37<1:12:36,  3.44it/s]
 96%|█████████▌| 356492/371472 [6:12:37<1:10:21,  3.55it/s]
 96%|█████████▌| 356493/371472 [6:12:37<1:11:13,  3.51it/s]
 96%|█████████▌| 356494/371472 [6:12:38<1:08:15,  3.66it/s]
 96%|█████████▌| 356495/371472 [6:12:38<1:09:10,  3.61it/s]
 96%|█████████▌| 356496/371472 [6:12:38<1:09:33,  3.59it/s]
 96%|█████████▌| 356497/371472 [6:12:38<1:07:47,  3.68it/s]
 96%|█████████▌| 356498/371472 [6:12:39<1:06:15,  3.77it/s]
 96%|█████████▌| 356499/371472 [6:12:39<1:09:00,  3.62it/s]
 96%|█████████▌| 356500/371472 [6:12:39<1:06:34,  3.75it/s]
                                                           
{'loss': 2.6974, 'learning_rate': 1.362936068435002e-07, 'epoch': 15.36}

 96%|█████████▌| 356500/371472 [6:12:39<1:06:34,  3.75it/s]
 96%|█████████▌| 356501/371472 [6:12:40<1:07:05,  3.72it/s]
 96%|█████████▌| 356502/371472 [6:12:40<1:10:59,  3.51it/s]
 96%|█████████▌| 356503/371472 [6:12:40<1:12:13,  3.45it/s]
 96%|█████████▌| 356504/371472 [6:12:40<1:14:06,  3.37it/s]
 96%|█████████▌| 356505/371472 [6:12:41<1:17:20,  3.23it/s]
 96%|█████████▌| 356506/371472 [6:12:41<1:13:08,  3.41it/s]
 96%|█████████▌| 356507/371472 [6:12:41<1:11:21,  3.50it/s]
 96%|█████████▌| 356508/371472 [6:12:42<1:15:38,  3.30it/s]
 96%|█████████▌| 356509/371472 [6:12:42<1:14:23,  3.35it/s]
 96%|█████████▌| 356510/371472 [6:12:42<1:18:59,  3.16it/s]
 96%|█████████▌| 356511/371472 [6:12:43<1:15:09,  3.32it/s]
 96%|█████████▌| 356512/371472 [6:12:43<1:13:07,  3.41it/s]
 96%|█████████▌| 356513/371472 [6:12:43<1:12:58,  3.42it/s]
 96%|█████████▌| 356514/371472 [6:12:43<1:11:17,  3.50it/s]
 96%|█████████▌| 356515/371472 [6:12:44<1:09:24,  3.59it/s]
 96%|█████████▌| 356516/371472 [6:12:44<1:07:25,  3.70it/s]
 96%|█████████▌| 356517/371472 [6:12:44<1:06:26,  3.75it/s]
 96%|█████████▌| 356518/371472 [6:12:44<1:06:22,  3.75it/s]
 96%|█████████▌| 356519/371472 [6:12:45<1:05:37,  3.80it/s]
 96%|█████████▌| 356520/371472 [6:12:45<1:04:36,  3.86it/s]
                                                           
{'loss': 2.4561, 'learning_rate': 1.3624512486802125e-07, 'epoch': 15.36}

 96%|█████████▌| 356520/371472 [6:12:45<1:04:36,  3.86it/s]
 96%|█████████▌| 356521/371472 [6:12:45<1:04:57,  3.84it/s]
 96%|█████████▌| 356522/371472 [6:12:45<1:03:32,  3.92it/s]
 96%|█████████▌| 356523/371472 [6:12:46<1:05:21,  3.81it/s]
 96%|█████████▌| 356524/371472 [6:12:46<1:05:34,  3.80it/s]
 96%|█████████▌| 356525/371472 [6:12:46<1:08:21,  3.64it/s]
 96%|█████████▌| 356526/371472 [6:12:47<1:08:18,  3.65it/s]
 96%|█████████▌| 356527/371472 [6:12:47<1:06:18,  3.76it/s]
 96%|█████████▌| 356528/371472 [6:12:47<1:05:36,  3.80it/s]
 96%|█████████▌| 356529/371472 [6:12:47<1:04:54,  3.84it/s]
 96%|█████████▌| 356530/371472 [6:12:48<1:06:23,  3.75it/s]
 96%|█████████▌| 356531/371472 [6:12:48<1:04:34,  3.86it/s]
 96%|█████████▌| 356532/371472 [6:12:48<1:04:37,  3.85it/s]
 96%|█████████▌| 356533/371472 [6:12:48<1:06:31,  3.74it/s]
 96%|█████████▌| 356534/371472 [6:12:49<1:11:50,  3.47it/s]
 96%|█████████▌| 356535/371472 [6:12:49<1:09:59,  3.56it/s]
 96%|█████████▌| 356536/371472 [6:12:49<1:08:29,  3.63it/s]
 96%|█████████▌| 356537/371472 [6:12:50<1:14:42,  3.33it/s]
 96%|█████████▌| 356538/371472 [6:12:50<1:11:08,  3.50it/s]
 96%|█████████▌| 356539/371472 [6:12:50<1:08:19,  3.64it/s]
 96%|█████████▌| 356540/371472 [6:12:50<1:06:30,  3.74it/s]
                                                           
{'loss': 2.6078, 'learning_rate': 1.361966428925424e-07, 'epoch': 15.36}

 96%|█████████▌| 356540/371472 [6:12:50<1:06:30,  3.74it/s]
 96%|█████████▌| 356541/371472 [6:12:51<1:07:04,  3.71it/s]
 96%|█████████▌| 356542/371472 [6:12:51<1:09:15,  3.59it/s]
 96%|█████████▌| 356543/371472 [6:12:51<1:07:30,  3.69it/s]
 96%|█████████▌| 356544/371472 [6:12:51<1:06:41,  3.73it/s]
 96%|█████████▌| 356545/371472 [6:12:52<1:06:34,  3.74it/s]
 96%|█████████▌| 356546/371472 [6:12:52<1:05:06,  3.82it/s]
 96%|█████████▌| 356547/371472 [6:12:52<1:03:50,  3.90it/s]
 96%|█████████▌| 356548/371472 [6:12:52<1:03:30,  3.92it/s]
 96%|█████████▌| 356549/371472 [6:12:53<1:09:17,  3.59it/s]
 96%|█████████▌| 356550/371472 [6:12:53<1:13:44,  3.37it/s]
 96%|█████████▌| 356551/371472 [6:12:53<1:15:11,  3.31it/s]
 96%|█████████▌| 356552/371472 [6:12:54<1:17:56,  3.19it/s]
 96%|█████████▌| 356553/371472 [6:12:54<1:14:17,  3.35it/s]
 96%|█████████▌| 356554/371472 [6:12:54<1:16:35,  3.25it/s]
 96%|█████████▌| 356555/371472 [6:12:55<1:16:40,  3.24it/s]
 96%|█████████▌| 356556/371472 [6:12:55<1:14:59,  3.32it/s]
 96%|█████████▌| 356557/371472 [6:12:55<1:19:57,  3.11it/s]
 96%|█████████▌| 356558/371472 [6:12:56<1:19:58,  3.11it/s]
 96%|█████████▌| 356559/371472 [6:12:56<1:21:13,  3.06it/s]
 96%|█████████▌| 356560/371472 [6:12:56<1:18:23,  3.17it/s]
                                                           
{'loss': 2.5544, 'learning_rate': 1.3614816091706347e-07, 'epoch': 15.36}

 96%|█████████▌| 356560/371472 [6:12:56<1:18:23,  3.17it/s]
 96%|█████████▌| 356561/371472 [6:12:57<1:16:23,  3.25it/s]
 96%|█████████▌| 356562/371472 [6:12:57<1:13:09,  3.40it/s]
 96%|█████████▌| 356563/371472 [6:12:57<1:11:49,  3.46it/s]
 96%|█████████▌| 356564/371472 [6:12:58<1:17:27,  3.21it/s]
 96%|█████████▌| 356565/371472 [6:12:58<1:14:55,  3.32it/s]
 96%|█████████▌| 356566/371472 [6:12:58<1:15:05,  3.31it/s]
 96%|█████████▌| 356567/371472 [6:12:58<1:15:23,  3.30it/s]
 96%|█████████▌| 356568/371472 [6:12:59<1:13:22,  3.39it/s]
 96%|█████████▌| 356569/371472 [6:12:59<1:10:46,  3.51it/s]
 96%|█████████▌| 356570/371472 [6:12:59<1:09:45,  3.56it/s]
 96%|█████████▌| 356571/371472 [6:13:00<1:15:08,  3.30it/s]
 96%|█████████▌| 356572/371472 [6:13:00<1:10:56,  3.50it/s]
 96%|█████████▌| 356573/371472 [6:13:00<1:09:28,  3.57it/s]
 96%|█████████▌| 356574/371472 [6:13:00<1:08:03,  3.65it/s]
 96%|█████████▌| 356575/371472 [6:13:01<1:06:46,  3.72it/s]
 96%|█████████▌| 356576/371472 [6:13:01<1:09:03,  3.60it/s]
 96%|█████████▌| 356577/371472 [6:13:01<1:08:52,  3.60it/s]
 96%|█████████▌| 356578/371472 [6:13:01<1:11:29,  3.47it/s]
 96%|█████████▌| 356579/371472 [6:13:02<1:09:02,  3.60it/s]
 96%|█████████▌| 356580/371472 [6:13:02<1:07:10,  3.69it/s]
                                                           
{'loss': 2.7059, 'learning_rate': 1.3609967894158462e-07, 'epoch': 15.36}

 96%|█████████▌| 356580/371472 [6:13:02<1:07:10,  3.69it/s]
 96%|█████████▌| 356581/371472 [6:13:02<1:11:19,  3.48it/s]
 96%|█████████▌| 356582/371472 [6:13:03<1:11:06,  3.49it/s]
 96%|█████████▌| 356583/371472 [6:13:03<1:08:23,  3.63it/s]
 96%|█████████▌| 356584/371472 [6:13:03<1:10:21,  3.53it/s]
 96%|█████████▌| 356585/371472 [6:13:04<1:17:23,  3.21it/s]
 96%|█████████▌| 356586/371472 [6:13:04<1:13:29,  3.38it/s]
 96%|█████████▌| 356587/371472 [6:13:04<1:13:08,  3.39it/s]
 96%|█████████▌| 356588/371472 [6:13:04<1:12:15,  3.43it/s]
 96%|█████████▌| 356589/371472 [6:13:05<1:08:49,  3.60it/s]
 96%|█████████▌| 356590/371472 [6:13:05<1:05:53,  3.76it/s]
 96%|█████████▌| 356591/371472 [6:13:05<1:07:39,  3.67it/s]
 96%|█████████▌| 356592/371472 [6:13:05<1:07:03,  3.70it/s]
 96%|█████████▌| 356593/371472 [6:13:06<1:04:53,  3.82it/s]
 96%|█████████▌| 356594/371472 [6:13:06<1:12:36,  3.41it/s]
 96%|█████████▌| 356595/371472 [6:13:06<1:17:21,  3.20it/s]
 96%|█████████▌| 356596/371472 [6:13:07<1:16:10,  3.25it/s]
 96%|█████████▌| 356597/371472 [6:13:07<1:20:52,  3.07it/s]
 96%|█████████▌| 356598/371472 [6:13:07<1:17:09,  3.21it/s]
 96%|█████████▌| 356599/371472 [6:13:08<1:15:55,  3.26it/s]
 96%|█████████▌| 356600/371472 [6:13:08<1:11:48,  3.45it/s]
                                                           
{'loss': 2.6965, 'learning_rate': 1.360511969661057e-07, 'epoch': 15.36}

 96%|█████████▌| 356600/371472 [6:13:08<1:11:48,  3.45it/s]
 96%|█████████▌| 356601/371472 [6:13:08<1:09:28,  3.57it/s]
 96%|█████████▌| 356602/371472 [6:13:08<1:15:50,  3.27it/s]
 96%|█████████▌| 356603/371472 [6:13:09<1:15:10,  3.30it/s]
 96%|█████████▌| 356604/371472 [6:13:09<1:17:40,  3.19it/s]
 96%|█████████▌| 356605/371472 [6:13:09<1:16:06,  3.26it/s]
 96%|█████████▌| 356606/371472 [6:13:10<1:15:42,  3.27it/s]
 96%|█████████▌| 356607/371472 [6:13:10<1:11:30,  3.46it/s]
 96%|█████████▌| 356608/371472 [6:13:10<1:11:44,  3.45it/s]
 96%|█████████▌| 356609/371472 [6:13:11<1:12:03,  3.44it/s]
 96%|█████████▌| 356610/371472 [6:13:11<1:11:55,  3.44it/s]
 96%|█████████▌| 356611/371472 [6:13:11<1:19:00,  3.14it/s]
 96%|█████████▌| 356612/371472 [6:13:11<1:16:23,  3.24it/s]
 96%|█████████▌| 356613/371472 [6:13:12<1:12:45,  3.40it/s]
 96%|█████████▌| 356614/371472 [6:13:12<1:10:57,  3.49it/s]
 96%|█████████▌| 356615/371472 [6:13:12<1:09:03,  3.59it/s]
 96%|█████████▌| 356616/371472 [6:13:13<1:12:32,  3.41it/s]
 96%|█████████▌| 356617/371472 [6:13:13<1:10:29,  3.51it/s]
 96%|█████████▌| 356618/371472 [6:13:13<1:13:33,  3.37it/s]
 96%|█████████▌| 356619/371472 [6:13:13<1:13:35,  3.36it/s]
 96%|█████████▌| 356620/371472 [6:13:14<1:11:51,  3.44it/s]
                                                           
{'loss': 2.7667, 'learning_rate': 1.3600271499062684e-07, 'epoch': 15.36}

 96%|█████████▌| 356620/371472 [6:13:14<1:11:51,  3.44it/s]
 96%|█████████▌| 356621/371472 [6:13:14<1:15:07,  3.30it/s]
 96%|█████████▌| 356622/371472 [6:13:14<1:13:43,  3.36it/s]
 96%|█████████▌| 356623/371472 [6:13:15<1:14:37,  3.32it/s]
 96%|█████████▌| 356624/371472 [6:13:15<1:13:13,  3.38it/s]
 96%|█████████▌| 356625/371472 [6:13:15<1:19:14,  3.12it/s]
 96%|█████████▌| 356626/371472 [6:13:16<1:19:57,  3.09it/s]
 96%|█████████▌| 356627/371472 [6:13:16<1:17:43,  3.18it/s]
 96%|█████████▌| 356628/371472 [6:13:16<1:16:23,  3.24it/s]
 96%|█████████▌| 356629/371472 [6:13:17<1:12:14,  3.42it/s]
 96%|█████████▌| 356630/371472 [6:13:17<1:09:08,  3.58it/s]
 96%|█████████▌| 356631/371472 [6:13:17<1:17:15,  3.20it/s]
 96%|█████████▌| 356632/371472 [6:13:17<1:14:59,  3.30it/s]
 96%|█████████▌| 356633/371472 [6:13:18<1:16:07,  3.25it/s]
 96%|█████████▌| 356634/371472 [6:13:18<1:11:55,  3.44it/s]
 96%|█████████▌| 356635/371472 [6:13:18<1:08:14,  3.62it/s]
 96%|█████████▌| 356636/371472 [6:13:19<1:06:38,  3.71it/s]
 96%|█████████▌| 356637/371472 [6:13:19<1:09:40,  3.55it/s]
 96%|█████████▌| 356638/371472 [6:13:19<1:09:03,  3.58it/s]
 96%|█████████▌| 356639/371472 [6:13:19<1:06:00,  3.75it/s]
 96%|█████████▌| 356640/371472 [6:13:20<1:08:21,  3.62it/s]
                                                           
{'loss': 2.613, 'learning_rate': 1.359542330151479e-07, 'epoch': 15.36}

 96%|█████████▌| 356640/371472 [6:13:20<1:08:21,  3.62it/s]
 96%|█████████▌| 356641/371472 [6:13:20<1:08:13,  3.62it/s]
 96%|█████████▌| 356642/371472 [6:13:20<1:14:59,  3.30it/s]
 96%|█████████▌| 356643/371472 [6:13:21<1:15:30,  3.27it/s]
 96%|█████████▌| 356644/371472 [6:13:21<1:12:40,  3.40it/s]
 96%|█████████▌| 356645/371472 [6:13:21<1:11:02,  3.48it/s]
 96%|█████████▌| 356646/371472 [6:13:21<1:12:49,  3.39it/s]
 96%|█████████▌| 356647/371472 [6:13:22<1:11:10,  3.47it/s]
 96%|█████████▌| 356648/371472 [6:13:22<1:08:55,  3.58it/s]
 96%|█████████▌| 356649/371472 [6:13:22<1:08:47,  3.59it/s]
 96%|█████████▌| 356650/371472 [6:13:23<1:06:43,  3.70it/s]
 96%|█████████▌| 356651/371472 [6:13:23<1:04:57,  3.80it/s]
 96%|█████████▌| 356652/371472 [6:13:23<1:08:46,  3.59it/s]
 96%|█████████▌| 356653/371472 [6:13:23<1:10:17,  3.51it/s]
 96%|█████████▌| 356654/371472 [6:13:24<1:08:56,  3.58it/s]
 96%|█████████▌| 356655/371472 [6:13:24<1:07:29,  3.66it/s]
 96%|█████████▌| 356656/371472 [6:13:24<1:07:05,  3.68it/s]
 96%|█████████▌| 356657/371472 [6:13:24<1:10:16,  3.51it/s]
 96%|█████████▌| 356658/371472 [6:13:25<1:13:00,  3.38it/s]
 96%|█████████▌| 356659/371472 [6:13:25<1:12:55,  3.39it/s]
 96%|█████████▌| 356660/371472 [6:13:25<1:11:34,  3.45it/s]
                                                           
{'loss': 2.4522, 'learning_rate': 1.3590575103966906e-07, 'epoch': 15.36}

 96%|█████████▌| 356660/371472 [6:13:25<1:11:34,  3.45it/s]
 96%|█████████▌| 356661/371472 [6:13:26<1:10:29,  3.50it/s]
 96%|█████████▌| 356662/371472 [6:13:26<1:08:00,  3.63it/s]
 96%|█████████▌| 356663/371472 [6:13:26<1:11:37,  3.45it/s]
 96%|█████████▌| 356664/371472 [6:13:26<1:09:07,  3.57it/s]
 96%|█████████▌| 356665/371472 [6:13:27<1:08:37,  3.60it/s]
 96%|█████████▌| 356666/371472 [6:13:27<1:11:23,  3.46it/s]
 96%|█████████▌| 356667/371472 [6:13:27<1:13:56,  3.34it/s]
 96%|█████████▌| 356668/371472 [6:13:28<1:11:29,  3.45it/s]
 96%|█████████▌| 356669/371472 [6:13:28<1:20:13,  3.08it/s]
 96%|█████████▌| 356670/371472 [6:13:28<1:16:53,  3.21it/s]
 96%|█████████▌| 356671/371472 [6:13:29<1:11:52,  3.43it/s]
 96%|█████████▌| 356672/371472 [6:13:29<1:10:29,  3.50it/s]
 96%|█████████▌| 356673/371472 [6:13:29<1:12:10,  3.42it/s]
 96%|█████████▌| 356674/371472 [6:13:29<1:09:39,  3.54it/s]
 96%|█████████▌| 356675/371472 [6:13:30<1:08:50,  3.58it/s]
 96%|█████████▌| 356676/371472 [6:13:30<1:07:01,  3.68it/s]
 96%|█████████▌| 356677/371472 [6:13:30<1:05:59,  3.74it/s]
 96%|█████████▌| 356678/371472 [6:13:30<1:05:54,  3.74it/s]
 96%|█████████▌| 356679/371472 [6:13:31<1:09:13,  3.56it/s]
 96%|█████████▌| 356680/371472 [6:13:31<1:08:56,  3.58it/s]
                                                           
{'loss': 2.4585, 'learning_rate': 1.358572690641901e-07, 'epoch': 15.36}

 96%|█████████▌| 356680/371472 [6:13:31<1:08:56,  3.58it/s]
 96%|█████████▌| 356681/371472 [6:13:31<1:07:29,  3.65it/s]
 96%|█████████▌| 356682/371472 [6:13:32<1:05:36,  3.76it/s]
 96%|█████████▌| 356683/371472 [6:13:32<1:13:46,  3.34it/s]
 96%|█████████▌| 356684/371472 [6:13:32<1:11:41,  3.44it/s]
 96%|█████████▌| 356685/371472 [6:13:33<1:11:52,  3.43it/s]
 96%|█████████▌| 356686/371472 [6:13:33<1:09:16,  3.56it/s]
 96%|█████████▌| 356687/371472 [6:13:33<1:09:26,  3.55it/s]
 96%|█████████▌| 356688/371472 [6:13:33<1:06:05,  3.73it/s]
 96%|█████████▌| 356689/371472 [6:13:34<1:09:30,  3.54it/s]
 96%|█████████▌| 356690/371472 [6:13:34<1:07:02,  3.68it/s]
 96%|█████████▌| 356691/371472 [6:13:34<1:05:44,  3.75it/s]
 96%|█████████▌| 356692/371472 [6:13:34<1:08:35,  3.59it/s]
 96%|█████████▌| 356693/371472 [6:13:35<1:07:27,  3.65it/s]
 96%|█████████▌| 356694/371472 [6:13:35<1:11:34,  3.44it/s]
 96%|█████████▌| 356695/371472 [6:13:35<1:08:45,  3.58it/s]
 96%|█████████▌| 356696/371472 [6:13:36<1:07:45,  3.63it/s]
 96%|█████████▌| 356697/371472 [6:13:36<1:07:45,  3.63it/s]
 96%|█████████▌| 356698/371472 [6:13:36<1:07:11,  3.66it/s]
 96%|█████████▌| 356699/371472 [6:13:36<1:07:42,  3.64it/s]
 96%|█████████▌| 356700/371472 [6:13:37<1:07:38,  3.64it/s]
                                                           
{'loss': 2.6564, 'learning_rate': 1.3580878708871129e-07, 'epoch': 15.36}

 96%|█████████▌| 356700/371472 [6:13:37<1:07:38,  3.64it/s]
 96%|█████████▌| 356701/371472 [6:13:37<1:05:54,  3.73it/s]
 96%|█████████▌| 356702/371472 [6:13:37<1:05:45,  3.74it/s]
 96%|█████████▌| 356703/371472 [6:13:37<1:12:14,  3.41it/s]
 96%|█████████▌| 356704/371472 [6:13:38<1:13:20,  3.36it/s]
 96%|█████████▌| 356705/371472 [6:13:38<1:11:42,  3.43it/s]
 96%|█████████▌| 356706/371472 [6:13:38<1:09:52,  3.52it/s]
 96%|█████████▌| 356707/371472 [6:13:39<1:08:11,  3.61it/s]
 96%|█████████▌| 356708/371472 [6:13:39<1:08:02,  3.62it/s]
 96%|█████████▌| 356709/371472 [6:13:39<1:08:35,  3.59it/s]
 96%|█████████▌| 356710/371472 [6:13:39<1:07:25,  3.65it/s]
 96%|█████████▌| 356711/371472 [6:13:40<1:07:08,  3.66it/s]
 96%|█████████▌| 356712/371472 [6:13:40<1:06:01,  3.73it/s]
 96%|█████████▌| 356713/371472 [6:13:40<1:05:25,  3.76it/s]
 96%|█████████▌| 356714/371472 [6:13:40<1:03:48,  3.85it/s]
 96%|█████████▌| 356715/371472 [6:13:41<1:04:16,  3.83it/s]
 96%|█████████▌| 356716/371472 [6:13:41<1:03:45,  3.86it/s]
 96%|█████████▌| 356717/371472 [6:13:41<1:06:40,  3.69it/s]
 96%|█████████▌| 356718/371472 [6:13:42<1:07:21,  3.65it/s]
 96%|█████████▌| 356719/371472 [6:13:42<1:07:33,  3.64it/s]
 96%|█████████▌| 356720/371472 [6:13:42<1:10:46,  3.47it/s]
                                                           
{'loss': 2.6827, 'learning_rate': 1.3576030511323233e-07, 'epoch': 15.36}

 96%|█████████▌| 356720/371472 [6:13:42<1:10:46,  3.47it/s]
 96%|█████████▌| 356721/371472 [6:13:42<1:09:32,  3.54it/s]
 96%|█████████▌| 356722/371472 [6:13:43<1:07:08,  3.66it/s]
 96%|█████████▌| 356723/371472 [6:13:43<1:09:54,  3.52it/s]
 96%|█████████▌| 356724/371472 [6:13:43<1:08:39,  3.58it/s]
 96%|█████████▌| 356725/371472 [6:13:44<1:13:13,  3.36it/s]
 96%|█████████▌| 356726/371472 [6:13:44<1:12:28,  3.39it/s]
 96%|█████████▌| 356727/371472 [6:13:44<1:11:44,  3.43it/s]
 96%|█████████▌| 356728/371472 [6:13:44<1:10:19,  3.49it/s]
 96%|█████████▌| 356729/371472 [6:13:45<1:11:42,  3.43it/s]
 96%|█████████▌| 356730/371472 [6:13:45<1:08:24,  3.59it/s]
 96%|█████████▌| 356731/371472 [6:13:45<1:06:44,  3.68it/s]
 96%|█████████▌| 356732/371472 [6:13:46<1:05:53,  3.73it/s]
 96%|█████████▌| 356733/371472 [6:13:46<1:10:40,  3.48it/s]
 96%|█████████▌| 356734/371472 [6:13:46<1:10:13,  3.50it/s]
 96%|█████████▌| 356735/371472 [6:13:46<1:14:42,  3.29it/s]
 96%|█████████▌| 356736/371472 [6:13:47<1:12:08,  3.40it/s]
 96%|█████████▌| 356737/371472 [6:13:47<1:18:16,  3.14it/s]
 96%|█████████▌| 356738/371472 [6:13:47<1:13:38,  3.33it/s]
 96%|█████████▌| 356739/371472 [6:13:48<1:10:13,  3.50it/s]
 96%|█████████▌| 356740/371472 [6:13:48<1:12:32,  3.38it/s]
                                                           
{'loss': 2.4151, 'learning_rate': 1.3571182313775348e-07, 'epoch': 15.37}

 96%|█████████▌| 356740/371472 [6:13:48<1:12:32,  3.38it/s]
 96%|█████████▌| 356741/371472 [6:13:48<1:13:26,  3.34it/s]
 96%|█████████▌| 356742/371472 [6:13:49<1:11:04,  3.45it/s]
 96%|█████████▌| 356743/371472 [6:13:49<1:13:25,  3.34it/s]
 96%|█████████▌| 356744/371472 [6:13:49<1:11:06,  3.45it/s]
 96%|█████████▌| 356745/371472 [6:13:49<1:07:57,  3.61it/s]
 96%|█████████▌| 356746/371472 [6:13:50<1:11:59,  3.41it/s]
 96%|█████████▌| 356747/371472 [6:13:50<1:10:19,  3.49it/s]
 96%|█████████▌| 356748/371472 [6:13:50<1:10:00,  3.51it/s]
 96%|█████████▌| 356749/371472 [6:13:51<1:08:11,  3.60it/s]
 96%|█████████▌| 356750/371472 [6:13:51<1:06:40,  3.68it/s]
 96%|█████████▌| 356751/371472 [6:13:51<1:04:59,  3.78it/s]
 96%|█████████▌| 356752/371472 [6:13:51<1:03:29,  3.86it/s]
 96%|█████████▌| 356753/371472 [6:13:52<1:03:31,  3.86it/s]
 96%|█████████▌| 356754/371472 [6:13:52<1:03:37,  3.86it/s]
 96%|█████████▌| 356755/371472 [6:13:52<1:04:38,  3.79it/s]
 96%|█████████▌| 356756/371472 [6:13:52<1:04:19,  3.81it/s]
 96%|█████████▌| 356757/371472 [6:13:53<1:04:39,  3.79it/s]
 96%|█████████▌| 356758/371472 [6:13:53<1:07:06,  3.65it/s]
 96%|█████████▌| 356759/371472 [6:13:53<1:05:59,  3.72it/s]
 96%|█████████▌| 356760/371472 [6:13:53<1:08:55,  3.56it/s]
                                                           
{'loss': 2.5558, 'learning_rate': 1.3566334116227455e-07, 'epoch': 15.37}

 96%|█████████▌| 356760/371472 [6:13:53<1:08:55,  3.56it/s]
 96%|█████████▌| 356761/371472 [6:13:54<1:06:29,  3.69it/s]
 96%|█████████▌| 356762/371472 [6:13:54<1:06:06,  3.71it/s]
 96%|█████████▌| 356763/371472 [6:13:54<1:10:28,  3.48it/s]
 96%|█████████▌| 356764/371472 [6:13:55<1:08:06,  3.60it/s]
 96%|█████████▌| 356765/371472 [6:13:55<1:10:11,  3.49it/s]
 96%|█████████▌| 356766/371472 [6:13:55<1:08:08,  3.60it/s]
 96%|█████████▌| 356767/371472 [6:13:55<1:07:46,  3.62it/s]
 96%|█████████▌| 356768/371472 [6:13:56<1:07:05,  3.65it/s]
 96%|█████████▌| 356769/371472 [6:13:56<1:05:37,  3.73it/s]
 96%|█████████▌| 356770/371472 [6:13:56<1:07:15,  3.64it/s]
 96%|█████████▌| 356771/371472 [6:13:57<1:10:49,  3.46it/s]
 96%|█████████▌| 356772/371472 [6:13:57<1:11:21,  3.43it/s]
 96%|█████████▌| 356773/371472 [6:13:57<1:13:32,  3.33it/s]
 96%|█████████▌| 356774/371472 [6:13:57<1:15:00,  3.27it/s]
 96%|█████████▌| 356775/371472 [6:13:58<1:11:15,  3.44it/s]
 96%|█████████▌| 356776/371472 [6:13:58<1:10:47,  3.46it/s]
 96%|█████████▌| 356777/371472 [6:13:58<1:09:46,  3.51it/s]
 96%|█████████▌| 356778/371472 [6:13:59<1:07:21,  3.64it/s]
 96%|█████████▌| 356779/371472 [6:13:59<1:11:24,  3.43it/s]
 96%|█████████▌| 356780/371472 [6:13:59<1:08:37,  3.57it/s]
                                                           
{'loss': 2.5457, 'learning_rate': 1.356148591867957e-07, 'epoch': 15.37}

 96%|█████████▌| 356780/371472 [6:13:59<1:08:37,  3.57it/s]
 96%|█████████▌| 356781/371472 [6:13:59<1:10:50,  3.46it/s]
 96%|█████████▌| 356782/371472 [6:14:00<1:11:00,  3.45it/s]
 96%|█████████▌| 356783/371472 [6:14:00<1:11:22,  3.43it/s]
 96%|█████████▌| 356784/371472 [6:14:00<1:07:16,  3.64it/s]
 96%|█████████▌| 356785/371472 [6:14:01<1:09:58,  3.50it/s]
 96%|█████████▌| 356786/371472 [6:14:01<1:07:45,  3.61it/s]
 96%|█████████▌| 356787/371472 [6:14:01<1:09:17,  3.53it/s]
 96%|█████████▌| 356788/371472 [6:14:01<1:09:37,  3.51it/s]
 96%|█████████▌| 356789/371472 [6:14:02<1:10:02,  3.49it/s]
 96%|█████████▌| 356790/371472 [6:14:02<1:12:06,  3.39it/s]
 96%|█████████▌| 356791/371472 [6:14:02<1:09:23,  3.53it/s]
 96%|█████████▌| 356792/371472 [6:14:03<1:11:07,  3.44it/s]
 96%|█████████▌| 356793/371472 [6:14:03<1:15:45,  3.23it/s]
 96%|█████████▌| 356794/371472 [6:14:03<1:11:42,  3.41it/s]
 96%|█████████▌| 356795/371472 [6:14:04<1:16:21,  3.20it/s]
 96%|█████████▌| 356796/371472 [6:14:04<1:15:13,  3.25it/s]
 96%|█████████▌| 356797/371472 [6:14:04<1:11:56,  3.40it/s]
 96%|█████████▌| 356798/371472 [6:14:04<1:14:06,  3.30it/s]
 96%|█████████▌| 356799/371472 [6:14:05<1:10:13,  3.48it/s]
 96%|█████████▌| 356800/371472 [6:14:05<1:08:10,  3.59it/s]
                                                           
{'loss': 2.6274, 'learning_rate': 1.3556637721131675e-07, 'epoch': 15.37}

 96%|█████████▌| 356800/371472 [6:14:05<1:08:10,  3.59it/s]
 96%|█████████▌| 356801/371472 [6:14:05<1:09:01,  3.54it/s]
 96%|█████████▌| 356802/371472 [6:14:06<1:11:04,  3.44it/s]
 96%|█████████▌| 356803/371472 [6:14:06<1:07:38,  3.61it/s]
 96%|█████████▌| 356804/371472 [6:14:06<1:07:16,  3.63it/s]
 96%|█████████▌| 356805/371472 [6:14:06<1:08:33,  3.57it/s]
 96%|█████████▌| 356806/371472 [6:14:07<1:08:29,  3.57it/s]
 96%|█████████▌| 356807/371472 [6:14:07<1:07:39,  3.61it/s]
 96%|█████████▌| 356808/371472 [6:14:07<1:05:36,  3.72it/s]
 96%|█████████▌| 356809/371472 [6:14:07<1:04:59,  3.76it/s]
 96%|█████████▌| 356810/371472 [6:14:08<1:06:01,  3.70it/s]
 96%|█████████▌| 356811/371472 [6:14:08<1:05:52,  3.71it/s]
 96%|█████████▌| 356812/371472 [6:14:08<1:06:33,  3.67it/s]
 96%|█████████▌| 356813/371472 [6:14:08<1:06:22,  3.68it/s]
 96%|█████████▌| 356814/371472 [6:14:09<1:09:56,  3.49it/s]
 96%|█████████▌| 356815/371472 [6:14:09<1:09:02,  3.54it/s]
 96%|█████████▌| 356816/371472 [6:14:09<1:07:31,  3.62it/s]
 96%|█████████▌| 356817/371472 [6:14:10<1:11:43,  3.41it/s]
 96%|█████████▌| 356818/371472 [6:14:10<1:10:02,  3.49it/s]
 96%|█████████▌| 356819/371472 [6:14:10<1:09:08,  3.53it/s]
 96%|█████████▌| 356820/371472 [6:14:10<1:07:29,  3.62it/s]
                                                           
{'loss': 2.5292, 'learning_rate': 1.3551789523583782e-07, 'epoch': 15.37}

 96%|█████████▌| 356820/371472 [6:14:10<1:07:29,  3.62it/s]
 96%|█████████▌| 356821/371472 [6:14:11<1:12:47,  3.35it/s]
 96%|█████████▌| 356822/371472 [6:14:11<1:12:30,  3.37it/s]
 96%|█████████▌| 356823/371472 [6:14:11<1:11:06,  3.43it/s]
 96%|█████████▌| 356824/371472 [6:14:12<1:07:55,  3.59it/s]
 96%|█████████▌| 356825/371472 [6:14:12<1:05:35,  3.72it/s]
 96%|█████████▌| 356826/371472 [6:14:12<1:11:59,  3.39it/s]
 96%|█████████▌| 356827/371472 [6:14:13<1:11:57,  3.39it/s]
 96%|█████████▌| 356828/371472 [6:14:13<1:14:24,  3.28it/s]
 96%|█████████▌| 356829/371472 [6:14:13<1:17:21,  3.16it/s]
 96%|█████████▌| 356830/371472 [6:14:13<1:14:21,  3.28it/s]
 96%|█████████▌| 356831/371472 [6:14:14<1:14:34,  3.27it/s]
 96%|█████████▌| 356832/371472 [6:14:14<1:14:31,  3.27it/s]
 96%|█████████▌| 356833/371472 [6:14:14<1:11:08,  3.43it/s]
 96%|█████████▌| 356834/371472 [6:14:15<1:09:40,  3.50it/s]
 96%|█████████▌| 356835/371472 [6:14:15<1:16:06,  3.21it/s]
 96%|█████████▌| 356836/371472 [6:14:15<1:12:56,  3.34it/s]
 96%|█████████▌| 356837/371472 [6:14:16<1:09:18,  3.52it/s]
 96%|█████████▌| 356838/371472 [6:14:16<1:07:39,  3.60it/s]
 96%|█████████▌| 356839/371472 [6:14:16<1:11:00,  3.43it/s]
 96%|█████████▌| 356840/371472 [6:14:16<1:09:23,  3.51it/s]
                                                           
{'loss': 2.4636, 'learning_rate': 1.3546941326035897e-07, 'epoch': 15.37}

 96%|█████████▌| 356840/371472 [6:14:16<1:09:23,  3.51it/s]
 96%|█████████▌| 356841/371472 [6:14:17<1:07:37,  3.61it/s]
 96%|█████████▌| 356842/371472 [6:14:17<1:11:52,  3.39it/s]
 96%|█████████▌| 356843/371472 [6:14:17<1:09:35,  3.50it/s]
 96%|█████████▌| 356844/371472 [6:14:18<1:09:24,  3.51it/s]
 96%|█████████▌| 356845/371472 [6:14:18<1:10:01,  3.48it/s]
 96%|█████████▌| 356846/371472 [6:14:18<1:09:35,  3.50it/s]
 96%|█████████▌| 356847/371472 [6:14:18<1:14:02,  3.29it/s]
 96%|█████████▌| 356848/371472 [6:14:19<1:11:07,  3.43it/s]
 96%|█████████▌| 356849/371472 [6:14:19<1:16:03,  3.20it/s]
 96%|█████████▌| 356850/371472 [6:14:19<1:12:48,  3.35it/s]
 96%|█████████▌| 356851/371472 [6:14:20<1:11:11,  3.42it/s]
 96%|█████████▌| 356852/371472 [6:14:20<1:09:45,  3.49it/s]
 96%|█████████▌| 356853/371472 [6:14:20<1:09:46,  3.49it/s]
 96%|█████████▌| 356854/371472 [6:14:20<1:10:33,  3.45it/s]
 96%|█████████▌| 356855/371472 [6:14:21<1:14:56,  3.25it/s]
 96%|█████████▌| 356856/371472 [6:14:21<1:16:05,  3.20it/s]
 96%|█████████▌| 356857/371472 [6:14:21<1:14:56,  3.25it/s]
 96%|█████████▌| 356858/371472 [6:14:22<1:18:26,  3.10it/s]
 96%|█████████▌| 356859/371472 [6:14:22<1:18:05,  3.12it/s]
 96%|█████████▌| 356860/371472 [6:14:22<1:15:24,  3.23it/s]
                                                           
{'loss': 2.6202, 'learning_rate': 1.3542093128488004e-07, 'epoch': 15.37}

 96%|█████████▌| 356860/371472 [6:14:22<1:15:24,  3.23it/s]
 96%|█████████▌| 356861/371472 [6:14:23<1:17:08,  3.16it/s]
 96%|█████████▌| 356862/371472 [6:14:23<1:14:38,  3.26it/s]
 96%|█████████▌| 356863/371472 [6:14:23<1:11:44,  3.39it/s]
 96%|█████████▌| 356864/371472 [6:14:24<1:13:04,  3.33it/s]
 96%|█████████▌| 356865/371472 [6:14:24<1:12:51,  3.34it/s]
 96%|█████████▌| 356866/371472 [6:14:24<1:09:52,  3.48it/s]
 96%|█████████▌| 356867/371472 [6:14:24<1:06:53,  3.64it/s]
 96%|█████████▌| 356868/371472 [6:14:25<1:07:32,  3.60it/s]
 96%|█████████▌| 356869/371472 [6:14:25<1:08:30,  3.55it/s]
 96%|█████████▌| 356870/371472 [6:14:25<1:08:06,  3.57it/s]
 96%|█████████▌| 356871/371472 [6:14:25<1:05:44,  3.70it/s]
 96%|█████████▌| 356872/371472 [6:14:26<1:05:24,  3.72it/s]
 96%|█████████▌| 356873/371472 [6:14:26<1:03:44,  3.82it/s]
 96%|█████████▌| 356874/371472 [6:14:26<1:05:50,  3.70it/s]
 96%|█████████▌| 356875/371472 [6:14:27<1:08:49,  3.53it/s]
 96%|█████████▌| 356876/371472 [6:14:27<1:07:58,  3.58it/s]
 96%|█████████▌| 356877/371472 [6:14:27<1:05:43,  3.70it/s]
 96%|█████████▌| 356878/371472 [6:14:27<1:04:00,  3.80it/s]
 96%|█████████▌| 356879/371472 [6:14:28<1:04:48,  3.75it/s]
 96%|█████████▌| 356880/371472 [6:14:28<1:07:20,  3.61it/s]
                                                           
{'loss': 2.6561, 'learning_rate': 1.353724493094012e-07, 'epoch': 15.37}

 96%|█████████▌| 356880/371472 [6:14:28<1:07:20,  3.61it/s]
 96%|█████████▌| 356881/371472 [6:14:28<1:09:39,  3.49it/s]
 96%|█████████▌| 356882/371472 [6:14:29<1:10:58,  3.43it/s]
 96%|█████████▌| 356883/371472 [6:14:29<1:08:16,  3.56it/s]
 96%|█████████▌| 356884/371472 [6:14:29<1:07:47,  3.59it/s]
 96%|█████████▌| 356885/371472 [6:14:29<1:06:57,  3.63it/s]
 96%|█████████▌| 356886/371472 [6:14:30<1:04:49,  3.75it/s]
 96%|█████████▌| 356887/371472 [6:14:30<1:09:01,  3.52it/s]
 96%|█████████▌| 356888/371472 [6:14:30<1:06:27,  3.66it/s]
 96%|█████████▌| 356889/371472 [6:14:31<1:10:49,  3.43it/s]
 96%|█████████▌| 356890/371472 [6:14:31<1:12:27,  3.35it/s]
 96%|█████████▌| 356891/371472 [6:14:31<1:08:18,  3.56it/s]
 96%|█████████▌| 356892/371472 [6:14:31<1:05:30,  3.71it/s]
 96%|█████████▌| 356893/371472 [6:14:32<1:05:04,  3.73it/s]
 96%|█████████▌| 356894/371472 [6:14:32<1:09:10,  3.51it/s]
 96%|█████████▌| 356895/371472 [6:14:32<1:08:34,  3.54it/s]
 96%|█████████▌| 356896/371472 [6:14:32<1:12:03,  3.37it/s]
 96%|█████████▌| 356897/371472 [6:14:33<1:09:15,  3.51it/s]
 96%|█████████▌| 356898/371472 [6:14:33<1:09:11,  3.51it/s]
 96%|█████████▌| 356899/371472 [6:14:33<1:10:13,  3.46it/s]
 96%|█████████▌| 356900/371472 [6:14:34<1:10:28,  3.45it/s]
                                                           
{'loss': 2.8457, 'learning_rate': 1.3532396733392227e-07, 'epoch': 15.37}

 96%|█████████▌| 356900/371472 [6:14:34<1:10:28,  3.45it/s]
 96%|█████████▌| 356901/371472 [6:14:34<1:18:53,  3.08it/s]
 96%|█████████▌| 356902/371472 [6:14:34<1:16:17,  3.18it/s]
 96%|█████████▌| 356903/371472 [6:14:35<1:12:32,  3.35it/s]
 96%|█████████▌| 356904/371472 [6:14:35<1:12:32,  3.35it/s]
 96%|█████████▌| 356905/371472 [6:14:35<1:14:34,  3.26it/s]
 96%|█████████▌| 356906/371472 [6:14:36<1:14:42,  3.25it/s]
 96%|█████████▌| 356907/371472 [6:14:36<1:12:07,  3.37it/s]
 96%|█████████▌| 356908/371472 [6:14:36<1:11:09,  3.41it/s]
 96%|█████████▌| 356909/371472 [6:14:36<1:13:51,  3.29it/s]
 96%|█████████▌| 356910/371472 [6:14:37<1:16:22,  3.18it/s]
 96%|█████████▌| 356911/371472 [6:14:37<1:15:42,  3.21it/s]
 96%|█████████▌| 356912/371472 [6:14:37<1:15:35,  3.21it/s]
 96%|█████████▌| 356913/371472 [6:14:38<1:12:55,  3.33it/s]
 96%|█████████▌| 356914/371472 [6:14:38<1:08:23,  3.55it/s]
 96%|█████████▌| 356915/371472 [6:14:38<1:12:58,  3.32it/s]
 96%|█████████▌| 356916/371472 [6:14:38<1:09:32,  3.49it/s]
 96%|█████████▌| 356917/371472 [6:14:39<1:07:47,  3.58it/s]
 96%|█████████▌| 356918/371472 [6:14:39<1:07:30,  3.59it/s]
 96%|█████████▌| 356919/371472 [6:14:39<1:08:36,  3.54it/s]
 96%|█████████▌| 356920/371472 [6:14:40<1:06:19,  3.66it/s]
                                                           
{'loss': 2.436, 'learning_rate': 1.3527548535844342e-07, 'epoch': 15.37}

 96%|█████████▌| 356920/371472 [6:14:40<1:06:19,  3.66it/s]
 96%|█████████▌| 356921/371472 [6:14:40<1:09:50,  3.47it/s]
 96%|█████████▌| 356922/371472 [6:14:40<1:08:24,  3.55it/s]
 96%|█████████▌| 356923/371472 [6:14:40<1:08:19,  3.55it/s]
 96%|█████████▌| 356924/371472 [6:14:41<1:06:58,  3.62it/s]
 96%|█████████▌| 356925/371472 [6:14:41<1:07:37,  3.58it/s]
 96%|█████████▌| 356926/371472 [6:14:41<1:06:40,  3.64it/s]
 96%|█████████▌| 356927/371472 [6:14:42<1:12:36,  3.34it/s]
 96%|█████████▌| 356928/371472 [6:14:42<1:09:49,  3.47it/s]
 96%|█████████▌| 356929/371472 [6:14:42<1:06:23,  3.65it/s]
 96%|█████████▌| 356930/371472 [6:14:42<1:07:06,  3.61it/s]
 96%|█████████▌| 356931/371472 [6:14:43<1:13:15,  3.31it/s]
 96%|█████████▌| 356932/371472 [6:14:43<1:12:30,  3.34it/s]
 96%|█████████▌| 356933/371472 [6:14:43<1:12:39,  3.34it/s]
 96%|█████████▌| 356934/371472 [6:14:44<1:09:15,  3.50it/s]
 96%|█████████▌| 356935/371472 [6:14:44<1:06:35,  3.64it/s]
 96%|█████████▌| 356936/371472 [6:14:44<1:07:22,  3.60it/s]
 96%|█████████▌| 356937/371472 [6:14:44<1:10:17,  3.45it/s]
 96%|█████████▌| 356938/371472 [6:14:45<1:15:02,  3.23it/s]
 96%|█████████▌| 356939/371472 [6:14:45<1:12:27,  3.34it/s]
 96%|█████████▌| 356940/371472 [6:14:45<1:10:03,  3.46it/s]
                                                           
{'loss': 2.4739, 'learning_rate': 1.3522700338296446e-07, 'epoch': 15.37}

 96%|█████████▌| 356940/371472 [6:14:45<1:10:03,  3.46it/s]
 96%|█████████▌| 356941/371472 [6:14:46<1:08:14,  3.55it/s]
 96%|█████████▌| 356942/371472 [6:14:46<1:09:07,  3.50it/s]
 96%|█████████▌| 356943/371472 [6:14:46<1:12:26,  3.34it/s]
 96%|█████████▌| 356944/371472 [6:14:46<1:08:42,  3.52it/s]
 96%|█████████▌| 356945/371472 [6:14:47<1:14:51,  3.23it/s]
 96%|█████████▌| 356946/371472 [6:14:47<1:14:16,  3.26it/s]
 96%|█████████▌| 356947/371472 [6:14:47<1:12:45,  3.33it/s]
 96%|█████████▌| 356948/371472 [6:14:48<1:09:39,  3.48it/s]
 96%|█████████▌| 356949/371472 [6:14:48<1:13:49,  3.28it/s]
 96%|█████████▌| 356950/371472 [6:14:48<1:10:35,  3.43it/s]
 96%|█████████▌| 356951/371472 [6:14:49<1:09:56,  3.46it/s]
 96%|█████████▌| 356952/371472 [6:14:49<1:10:39,  3.42it/s]
 96%|█████████▌| 356953/371472 [6:14:49<1:06:29,  3.64it/s]
 96%|█████████▌| 356954/371472 [6:14:49<1:07:07,  3.60it/s]
 96%|█████████▌| 356955/371472 [6:14:50<1:08:42,  3.52it/s]
 96%|█████████▌| 356956/371472 [6:14:50<1:09:20,  3.49it/s]
 96%|█████████▌| 356957/371472 [6:14:50<1:07:31,  3.58it/s]
 96%|█████████▌| 356958/371472 [6:14:51<1:06:03,  3.66it/s]
 96%|█████████▌| 356959/371472 [6:14:51<1:08:46,  3.52it/s]
 96%|█████████▌| 356960/371472 [6:14:51<1:14:13,  3.26it/s]
                                                           
{'loss': 2.5, 'learning_rate': 1.3517852140748564e-07, 'epoch': 15.37}

 96%|█████████▌| 356960/371472 [6:14:51<1:14:13,  3.26it/s]
 96%|█████████▌| 356961/371472 [6:14:51<1:13:59,  3.27it/s]
 96%|█████████▌| 356962/371472 [6:14:52<1:12:23,  3.34it/s]
 96%|█████████▌| 356963/371472 [6:14:52<1:11:08,  3.40it/s]
 96%|█████████▌| 356964/371472 [6:14:52<1:08:34,  3.53it/s]
 96%|█████████▌| 356965/371472 [6:14:53<1:09:43,  3.47it/s]
 96%|█████████▌| 356966/371472 [6:14:53<1:12:16,  3.34it/s]
 96%|█████████▌| 356967/371472 [6:14:53<1:11:39,  3.37it/s]
 96%|█████████▌| 356968/371472 [6:14:53<1:07:19,  3.59it/s]
 96%|█████████▌| 356969/371472 [6:14:54<1:05:30,  3.69it/s]
 96%|█████████▌| 356970/371472 [6:14:54<1:05:57,  3.66it/s]
 96%|█████████▌| 356971/371472 [6:14:54<1:05:47,  3.67it/s]
 96%|█████████▌| 356972/371472 [6:14:55<1:04:35,  3.74it/s]
 96%|█████████▌| 356973/371472 [6:14:55<1:04:12,  3.76it/s]
 96%|█████████▌| 356974/371472 [6:14:55<1:04:43,  3.73it/s]
 96%|█████████▌| 356975/371472 [6:14:55<1:03:00,  3.83it/s]
 96%|█████████▌| 356976/371472 [6:14:56<1:04:29,  3.75it/s]
 96%|█████████▌| 356977/371472 [6:14:56<1:04:01,  3.77it/s]
 96%|█████████▌| 356978/371472 [6:14:56<1:04:44,  3.73it/s]
 96%|█████████▌| 356979/371472 [6:14:56<1:07:16,  3.59it/s]
 96%|█████████▌| 356980/371472 [6:14:57<1:05:37,  3.68it/s]
                                                           
{'loss': 2.6973, 'learning_rate': 1.3513003943200668e-07, 'epoch': 15.38}

 96%|█████████▌| 356980/371472 [6:14:57<1:05:37,  3.68it/s]
 96%|█████████▌| 356981/371472 [6:14:57<1:06:11,  3.65it/s]
 96%|█████████▌| 356982/371472 [6:14:57<1:10:23,  3.43it/s]
 96%|█████████▌| 356983/371472 [6:14:58<1:08:07,  3.54it/s]
 96%|█████████▌| 356984/371472 [6:14:58<1:06:18,  3.64it/s]
 96%|█████████▌| 356985/371472 [6:14:58<1:08:03,  3.55it/s]
 96%|█████████▌| 356986/371472 [6:14:58<1:05:43,  3.67it/s]
 96%|█████████▌| 356987/371472 [6:14:59<1:05:34,  3.68it/s]
 96%|█████████▌| 356988/371472 [6:14:59<1:06:32,  3.63it/s]
 96%|█████████▌| 356989/371472 [6:14:59<1:06:03,  3.65it/s]
 96%|█████████▌| 356990/371472 [6:14:59<1:06:02,  3.65it/s]
 96%|█████████▌| 356991/371472 [6:15:00<1:04:24,  3.75it/s]
 96%|█████████▌| 356992/371472 [6:15:00<1:06:47,  3.61it/s]
 96%|█████████▌| 356993/371472 [6:15:00<1:12:59,  3.31it/s]
 96%|█████████▌| 356994/371472 [6:15:01<1:09:23,  3.48it/s]
 96%|█████████▌| 356995/371472 [6:15:01<1:08:12,  3.54it/s]
 96%|█████████▌| 356996/371472 [6:15:01<1:05:24,  3.69it/s]
 96%|█████████▌| 356997/371472 [6:15:01<1:06:02,  3.65it/s]
 96%|█████████▌| 356998/371472 [6:15:02<1:06:04,  3.65it/s]
 96%|█████████▌| 356999/371472 [6:15:02<1:09:30,  3.47it/s]
 96%|█████████▌| 357000/371472 [6:15:02<1:08:20,  3.53it/s]
                                                           
{'loss': 2.7393, 'learning_rate': 1.3508155745652783e-07, 'epoch': 15.38}

 96%|█████████▌| 357000/371472 [6:15:02<1:08:20,  3.53it/s]
 96%|█████████▌| 357001/371472 [6:15:03<1:08:44,  3.51it/s]
 96%|█████████▌| 357002/371472 [6:15:03<1:07:37,  3.57it/s]
 96%|█████████▌| 357003/371472 [6:15:03<1:09:21,  3.48it/s]
 96%|█████████▌| 357004/371472 [6:15:03<1:08:55,  3.50it/s]
 96%|█████████▌| 357005/371472 [6:15:04<1:14:07,  3.25it/s]
 96%|█████████▌| 357006/371472 [6:15:04<1:10:51,  3.40it/s]
 96%|█████████▌| 357007/371472 [6:15:04<1:07:27,  3.57it/s]
 96%|█████████▌| 357008/371472 [6:15:05<1:09:14,  3.48it/s]
 96%|█████████▌| 357009/371472 [6:15:05<1:06:12,  3.64it/s]
 96%|█████████▌| 357010/371472 [6:15:05<1:05:54,  3.66it/s]
 96%|█████████▌| 357011/371472 [6:15:05<1:07:57,  3.55it/s]
 96%|█████████▌| 357012/371472 [6:15:06<1:07:04,  3.59it/s]
 96%|█████████▌| 357013/371472 [6:15:06<1:07:55,  3.55it/s]
 96%|█████████▌| 357014/371472 [6:15:06<1:12:01,  3.35it/s]
 96%|█████████▌| 357015/371472 [6:15:07<1:10:21,  3.42it/s]
 96%|█████████▌| 357016/371472 [6:15:07<1:10:19,  3.43it/s]
 96%|█████████▌| 357017/371472 [6:15:07<1:09:02,  3.49it/s]
 96%|█████████▌| 357018/371472 [6:15:07<1:07:31,  3.57it/s]
 96%|█████████▌| 357019/371472 [6:15:08<1:08:24,  3.52it/s]
 96%|█████████▌| 357020/371472 [6:15:08<1:08:05,  3.54it/s]
                                                           
{'loss': 2.5465, 'learning_rate': 1.350330754810489e-07, 'epoch': 15.38}

 96%|█████████▌| 357020/371472 [6:15:08<1:08:05,  3.54it/s]
 96%|█████████▌| 357021/371472 [6:15:08<1:07:24,  3.57it/s]
 96%|█████████▌| 357022/371472 [6:15:09<1:11:57,  3.35it/s]
 96%|█████████▌| 357023/371472 [6:15:09<1:08:59,  3.49it/s]
 96%|█████████▌| 357024/371472 [6:15:09<1:07:00,  3.59it/s]
 96%|█████████▌| 357025/371472 [6:15:09<1:03:50,  3.77it/s]
 96%|█████████▌| 357026/371472 [6:15:10<1:08:55,  3.49it/s]
 96%|█████████▌| 357027/371472 [6:15:10<1:07:37,  3.56it/s]
 96%|█████████▌| 357028/371472 [6:15:10<1:09:26,  3.47it/s]
 96%|█████████▌| 357029/371472 [6:15:11<1:07:38,  3.56it/s]
 96%|█████████▌| 357030/371472 [6:15:11<1:06:41,  3.61it/s]
 96%|█████████▌| 357031/371472 [6:15:11<1:04:50,  3.71it/s]
 96%|█████████▌| 357032/371472 [6:15:11<1:05:34,  3.67it/s]
 96%|█████████▌| 357033/371472 [6:15:12<1:37:27,  2.47it/s]
 96%|█████████▌| 357034/371472 [6:15:12<1:30:59,  2.64it/s]
 96%|█████████▌| 357035/371472 [6:15:13<1:23:57,  2.87it/s]
 96%|█████████▌| 357036/371472 [6:15:13<1:17:36,  3.10it/s]
 96%|█████████▌| 357037/371472 [6:15:13<1:13:43,  3.26it/s]
 96%|█████████▌| 357038/371472 [6:15:14<1:18:18,  3.07it/s]
 96%|█████████▌| 357039/371472 [6:15:14<1:14:55,  3.21it/s]
 96%|█████████▌| 357040/371472 [6:15:14<1:12:39,  3.31it/s]
                                                           
{'loss': 2.5614, 'learning_rate': 1.3498459350557006e-07, 'epoch': 15.38}

 96%|█████████▌| 357040/371472 [6:15:14<1:12:39,  3.31it/s]
 96%|█████████▌| 357041/371472 [6:15:14<1:19:08,  3.04it/s]
 96%|█████████▌| 357042/371472 [6:15:15<1:27:16,  2.76it/s]
 96%|█████████▌| 357043/371472 [6:15:15<1:20:13,  3.00it/s]
 96%|█████████▌| 357044/371472 [6:15:15<1:13:23,  3.28it/s]
 96%|█████████▌| 357045/371472 [6:15:16<1:09:53,  3.44it/s]
 96%|█████████▌| 357046/371472 [6:15:16<1:12:25,  3.32it/s]
 96%|█████████▌| 357047/371472 [6:15:16<1:11:52,  3.34it/s]
 96%|█████████▌| 357048/371472 [6:15:17<1:10:22,  3.42it/s]
 96%|█████████▌| 357049/371472 [6:15:17<1:08:24,  3.51it/s]
 96%|█████████▌| 357050/371472 [6:15:17<1:06:51,  3.59it/s]
 96%|█████████▌| 357051/371472 [6:15:17<1:05:17,  3.68it/s]
 96%|█████████▌| 357052/371472 [6:15:18<1:04:13,  3.74it/s]
 96%|█████████▌| 357053/371472 [6:15:18<1:08:47,  3.49it/s]
 96%|█████████▌| 357054/371472 [6:15:18<1:07:45,  3.55it/s]
 96%|█████████▌| 357055/371472 [6:15:19<1:06:25,  3.62it/s]
 96%|█████████▌| 357056/371472 [6:15:19<1:08:54,  3.49it/s]
 96%|█████████▌| 357057/371472 [6:15:19<1:11:17,  3.37it/s]
 96%|█████████▌| 357058/371472 [6:15:19<1:07:35,  3.55it/s]
 96%|█████████▌| 357059/371472 [6:15:20<1:05:11,  3.69it/s]
 96%|█████████▌| 357060/371472 [6:15:20<1:08:36,  3.50it/s]
                                                           
{'loss': 2.6187, 'learning_rate': 1.349361115300911e-07, 'epoch': 15.38}

 96%|█████████▌| 357060/371472 [6:15:20<1:08:36,  3.50it/s]
 96%|█████████▌| 357061/371472 [6:15:20<1:08:47,  3.49it/s]
 96%|█████████▌| 357062/371472 [6:15:21<1:07:34,  3.55it/s]
 96%|█████████▌| 357063/371472 [6:15:21<1:06:30,  3.61it/s]
 96%|█████████▌| 357064/371472 [6:15:21<1:08:16,  3.52it/s]
 96%|█████████▌| 357065/371472 [6:15:21<1:08:40,  3.50it/s]
 96%|█████████▌| 357066/371472 [6:15:22<1:08:07,  3.52it/s]
 96%|█████████▌| 357067/371472 [6:15:22<1:11:11,  3.37it/s]
 96%|█████████▌| 357068/371472 [6:15:22<1:09:47,  3.44it/s]
 96%|█████████▌| 357069/371472 [6:15:23<1:08:15,  3.52it/s]
 96%|█████████▌| 357070/371472 [6:15:23<1:07:45,  3.54it/s]
 96%|█████████▌| 357071/371472 [6:15:23<1:08:34,  3.50it/s]
 96%|█████████▌| 357072/371472 [6:15:23<1:08:52,  3.48it/s]
 96%|█████████▌| 357073/371472 [6:15:24<1:10:25,  3.41it/s]
 96%|█████████▌| 357074/371472 [6:15:24<1:08:21,  3.51it/s]
 96%|█████████▌| 357075/371472 [6:15:24<1:07:57,  3.53it/s]
 96%|█████████▌| 357076/371472 [6:15:25<1:07:15,  3.57it/s]
 96%|█████████▌| 357077/371472 [6:15:25<1:05:29,  3.66it/s]
 96%|█████████▌| 357078/371472 [6:15:25<1:09:37,  3.45it/s]
 96%|█████████▌| 357079/371472 [6:15:25<1:09:36,  3.45it/s]
 96%|█████████▌| 357080/371472 [6:15:26<1:07:53,  3.53it/s]
                                                           
{'loss': 2.5014, 'learning_rate': 1.3488762955461228e-07, 'epoch': 15.38}

 96%|█████████▌| 357080/371472 [6:15:26<1:07:53,  3.53it/s]
 96%|█████████▌| 357081/371472 [6:15:26<1:07:40,  3.54it/s]
 96%|█████████▌| 357082/371472 [6:15:26<1:10:13,  3.41it/s]
 96%|█████████▌| 357083/371472 [6:15:27<1:18:17,  3.06it/s]
 96%|█████████▌| 357084/371472 [6:15:27<1:21:14,  2.95it/s]
 96%|█████████▌| 357085/371472 [6:15:27<1:17:00,  3.11it/s]
 96%|█████████▌| 357086/371472 [6:15:28<1:13:35,  3.26it/s]
 96%|█████████▌| 357087/371472 [6:15:28<1:11:28,  3.35it/s]
 96%|█████████▌| 357088/371472 [6:15:28<1:10:00,  3.42it/s]
 96%|█████████▌| 357089/371472 [6:15:28<1:07:06,  3.57it/s]
 96%|█████████▌| 357090/371472 [6:15:29<1:06:21,  3.61it/s]
 96%|█████████▌| 357091/371472 [6:15:29<1:04:32,  3.71it/s]
 96%|█████████▌| 357092/371472 [6:15:29<1:05:15,  3.67it/s]
 96%|█████████▌| 357093/371472 [6:15:29<1:05:08,  3.68it/s]
 96%|█████████▌| 357094/371472 [6:15:30<1:07:58,  3.53it/s]
 96%|█████████▌| 357095/371472 [6:15:30<1:06:07,  3.62it/s]
 96%|█████████▌| 357096/371472 [6:15:30<1:07:48,  3.53it/s]
 96%|█████████▌| 357097/371472 [6:15:31<1:10:49,  3.38it/s]
 96%|█████████▌| 357098/371472 [6:15:31<1:07:19,  3.56it/s]
 96%|█████████▌| 357099/371472 [6:15:31<1:08:52,  3.48it/s]
 96%|█████████▌| 357100/371472 [6:15:31<1:08:10,  3.51it/s]
                                                           
{'loss': 2.613, 'learning_rate': 1.348391475791333e-07, 'epoch': 15.38}

 96%|█████████▌| 357100/371472 [6:15:31<1:08:10,  3.51it/s]
 96%|█████████▌| 357101/371472 [6:15:32<1:06:15,  3.61it/s]
 96%|█████████▌| 357102/371472 [6:15:32<1:08:43,  3.48it/s]
 96%|█████████▌| 357103/371472 [6:15:32<1:07:05,  3.57it/s]
 96%|█████████▌| 357104/371472 [6:15:33<1:05:12,  3.67it/s]
 96%|█████████▌| 357105/371472 [6:15:33<1:05:12,  3.67it/s]
 96%|█████████▌| 357106/371472 [6:15:33<1:06:56,  3.58it/s]
 96%|█████████▌| 357107/371472 [6:15:33<1:07:42,  3.54it/s]
 96%|█████████▌| 357108/371472 [6:15:34<1:05:30,  3.65it/s]
 96%|█████████▌| 357109/371472 [6:15:34<1:06:01,  3.63it/s]
 96%|█████████▌| 357110/371472 [6:15:34<1:04:19,  3.72it/s]
 96%|█████████▌| 357111/371472 [6:15:34<1:02:39,  3.82it/s]
 96%|█████████▌| 357112/371472 [6:15:35<1:02:58,  3.80it/s]
 96%|█████████▌| 357113/371472 [6:15:35<1:06:04,  3.62it/s]
 96%|█████████▌| 357114/371472 [6:15:35<1:04:40,  3.70it/s]
 96%|█████████▌| 357115/371472 [6:15:36<1:09:13,  3.46it/s]
 96%|█████████▌| 357116/371472 [6:15:36<1:08:51,  3.47it/s]
 96%|█████████▌| 357117/371472 [6:15:36<1:09:22,  3.45it/s]
 96%|█████████▌| 357118/371472 [6:15:37<1:18:42,  3.04it/s]
 96%|█████████▌| 357119/371472 [6:15:37<1:13:41,  3.25it/s]
 96%|█████████▌| 357120/371472 [6:15:37<1:12:23,  3.30it/s]
                                                           
{'loss': 2.6171, 'learning_rate': 1.3479066560365448e-07, 'epoch': 15.38}

 96%|█████████▌| 357120/371472 [6:15:37<1:12:23,  3.30it/s]
 96%|█████████▌| 357121/371472 [6:15:37<1:09:41,  3.43it/s]
 96%|█████████▌| 357122/371472 [6:15:38<1:09:35,  3.44it/s]
 96%|█████████▌| 357123/371472 [6:15:38<1:07:09,  3.56it/s]
 96%|█████████▌| 357124/371472 [6:15:38<1:07:46,  3.53it/s]
 96%|█████████▌| 357125/371472 [6:15:39<1:07:48,  3.53it/s]
 96%|█████████▌| 357126/371472 [6:15:39<1:06:59,  3.57it/s]
 96%|█████████▌| 357127/371472 [6:15:39<1:08:01,  3.51it/s]
 96%|█████████▌| 357128/371472 [6:15:39<1:12:03,  3.32it/s]
 96%|█████████▌| 357129/371472 [6:15:40<1:08:41,  3.48it/s]
 96%|█████████▌| 357130/371472 [6:15:40<1:05:32,  3.65it/s]
 96%|█████████▌| 357131/371472 [6:15:40<1:03:53,  3.74it/s]
 96%|█████████▌| 357132/371472 [6:15:40<1:05:01,  3.68it/s]
 96%|█████████▌| 357133/371472 [6:15:41<1:07:05,  3.56it/s]
 96%|█████████▌| 357134/371472 [6:15:41<1:06:57,  3.57it/s]
 96%|█████████▌| 357135/371472 [6:15:41<1:08:25,  3.49it/s]
 96%|█████████▌| 357136/371472 [6:15:42<1:07:52,  3.52it/s]
 96%|█████████▌| 357137/371472 [6:15:42<1:05:52,  3.63it/s]
 96%|█████████▌| 357138/371472 [6:15:42<1:13:23,  3.26it/s]
 96%|█████████▌| 357139/371472 [6:15:43<1:09:19,  3.45it/s]
 96%|█████████▌| 357140/371472 [6:15:43<1:12:38,  3.29it/s]
                                                           
{'loss': 2.5206, 'learning_rate': 1.3474218362817555e-07, 'epoch': 15.38}

 96%|█████████▌| 357140/371472 [6:15:43<1:12:38,  3.29it/s]
 96%|█████████▌| 357141/371472 [6:15:43<1:13:45,  3.24it/s]
 96%|█████████▌| 357142/371472 [6:15:43<1:10:30,  3.39it/s]
 96%|█████████▌| 357143/371472 [6:15:44<1:16:45,  3.11it/s]
 96%|█████████▌| 357144/371472 [6:15:44<1:14:21,  3.21it/s]
 96%|█████████▌| 357145/371472 [6:15:44<1:16:12,  3.13it/s]
 96%|█████████▌| 357146/371472 [6:15:45<1:15:06,  3.18it/s]
 96%|█████████▌| 357147/371472 [6:15:45<1:12:45,  3.28it/s]
 96%|█████████▌| 357148/371472 [6:15:45<1:13:03,  3.27it/s]
 96%|█████████▌| 357149/371472 [6:15:46<1:14:32,  3.20it/s]
 96%|█████████▌| 357150/371472 [6:15:46<1:12:22,  3.30it/s]
 96%|█████████▌| 357151/371472 [6:15:46<1:18:35,  3.04it/s]
 96%|█████████▌| 357152/371472 [6:15:47<1:12:16,  3.30it/s]
 96%|█████████▌| 357153/371472 [6:15:47<1:08:40,  3.47it/s]
 96%|█████████▌| 357154/371472 [6:15:47<1:07:22,  3.54it/s]
 96%|█████████▌| 357155/371472 [6:15:47<1:06:39,  3.58it/s]
 96%|█████████▌| 357156/371472 [6:15:48<1:05:57,  3.62it/s]
 96%|█████████▌| 357157/371472 [6:15:48<1:04:03,  3.72it/s]
 96%|█████████▌| 357158/371472 [6:15:48<1:04:37,  3.69it/s]
 96%|█████████▌| 357159/371472 [6:15:48<1:03:07,  3.78it/s]
 96%|█████████▌| 357160/371472 [6:15:49<1:05:14,  3.66it/s]
                                                           
{'loss': 2.4861, 'learning_rate': 1.346937016526967e-07, 'epoch': 15.38}

 96%|█████████▌| 357160/371472 [6:15:49<1:05:14,  3.66it/s]
 96%|█████████▌| 357161/371472 [6:15:49<1:05:36,  3.64it/s]
 96%|█████████▌| 357162/371472 [6:15:49<1:04:57,  3.67it/s]
 96%|█████████▌| 357163/371472 [6:15:50<1:03:17,  3.77it/s]
 96%|█████████▌| 357164/371472 [6:15:50<1:03:23,  3.76it/s]
 96%|█████████▌| 357165/371472 [6:15:50<1:05:44,  3.63it/s]
 96%|█████████▌| 357166/371472 [6:15:50<1:11:35,  3.33it/s]
 96%|█████████▌| 357167/371472 [6:15:51<1:09:22,  3.44it/s]
 96%|█████████▌| 357168/371472 [6:15:51<1:07:29,  3.53it/s]
 96%|█████████▌| 357169/371472 [6:15:51<1:08:03,  3.50it/s]
 96%|█████████▌| 357170/371472 [6:15:52<1:05:36,  3.63it/s]
 96%|█████████▌| 357171/371472 [6:15:52<1:09:18,  3.44it/s]
 96%|█████████▌| 357172/371472 [6:15:52<1:09:32,  3.43it/s]
 96%|█████████▌| 357173/371472 [6:15:52<1:09:51,  3.41it/s]
 96%|█████████▌| 357174/371472 [6:15:53<1:13:46,  3.23it/s]
 96%|█████████▌| 357175/371472 [6:15:53<1:16:19,  3.12it/s]
 96%|█████████▌| 357176/371472 [6:15:53<1:11:15,  3.34it/s]
 96%|█████████▌| 357177/371472 [6:15:54<1:12:26,  3.29it/s]
 96%|█████████▌| 357178/371472 [6:15:54<1:10:04,  3.40it/s]
 96%|█████████▌| 357179/371472 [6:15:54<1:08:02,  3.50it/s]
 96%|█████████▌| 357180/371472 [6:15:55<1:09:09,  3.44it/s]
                                                           
{'loss': 2.4912, 'learning_rate': 1.3464521967721774e-07, 'epoch': 15.38}

 96%|█████████▌| 357180/371472 [6:15:55<1:09:09,  3.44it/s]
 96%|█████████▌| 357181/371472 [6:15:55<1:08:33,  3.47it/s]
 96%|█████████▌| 357182/371472 [6:15:55<1:10:29,  3.38it/s]
 96%|█████████▌| 357183/371472 [6:15:55<1:08:21,  3.48it/s]
 96%|█████████▌| 357184/371472 [6:15:56<1:05:54,  3.61it/s]
 96%|█████████▌| 357185/371472 [6:15:56<1:04:34,  3.69it/s]
 96%|█████████▌| 357186/371472 [6:15:56<1:05:37,  3.63it/s]
 96%|█████████▌| 357187/371472 [6:15:56<1:05:20,  3.64it/s]
 96%|█████████▌| 357188/371472 [6:15:57<1:05:52,  3.61it/s]
 96%|█████████▌| 357189/371472 [6:15:57<1:06:18,  3.59it/s]
 96%|█████████▌| 357190/371472 [6:15:57<1:10:11,  3.39it/s]
 96%|█████████▌| 357191/371472 [6:15:58<1:06:41,  3.57it/s]
 96%|█████████▌| 357192/371472 [6:15:58<1:04:41,  3.68it/s]
 96%|█████████▌| 357193/371472 [6:15:58<1:08:36,  3.47it/s]
 96%|█████████▌| 357194/371472 [6:15:58<1:05:11,  3.65it/s]
 96%|█████████▌| 357195/371472 [6:15:59<1:06:34,  3.57it/s]
 96%|█████████▌| 357196/371472 [6:15:59<1:05:31,  3.63it/s]
 96%|█████████▌| 357197/371472 [6:15:59<1:05:09,  3.65it/s]
 96%|█████████▌| 357198/371472 [6:16:00<1:04:06,  3.71it/s]
 96%|█████████▌| 357199/371472 [6:16:00<1:03:02,  3.77it/s]
 96%|█████████▌| 357200/371472 [6:16:00<1:03:03,  3.77it/s]
                                                           
{'loss': 2.4914, 'learning_rate': 1.3459673770173892e-07, 'epoch': 15.39}

 96%|█████████▌| 357200/371472 [6:16:00<1:03:03,  3.77it/s]
 96%|█████████▌| 357201/371472 [6:16:00<1:02:15,  3.82it/s]
 96%|█████████▌| 357202/371472 [6:16:01<1:09:45,  3.41it/s]
 96%|█████████▌| 357203/371472 [6:16:01<1:08:08,  3.49it/s]
 96%|█████████▌| 357204/371472 [6:16:01<1:12:24,  3.28it/s]
 96%|█████████▌| 357205/371472 [6:16:02<1:11:05,  3.34it/s]
 96%|█████████▌| 357206/371472 [6:16:02<1:09:35,  3.42it/s]
 96%|█████████▌| 357207/371472 [6:16:02<1:07:53,  3.50it/s]
 96%|█████████▌| 357208/371472 [6:16:02<1:07:28,  3.52it/s]
 96%|█████████▌| 357209/371472 [6:16:03<1:11:06,  3.34it/s]
 96%|█████████▌| 357210/371472 [6:16:03<1:09:59,  3.40it/s]
 96%|█████████▌| 357211/371472 [6:16:03<1:09:48,  3.40it/s]
 96%|█████████▌| 357212/371472 [6:16:04<1:10:39,  3.36it/s]
 96%|█████████▌| 357213/371472 [6:16:04<1:06:55,  3.55it/s]
 96%|█████████▌| 357214/371472 [6:16:04<1:05:08,  3.65it/s]
 96%|█████████▌| 357215/371472 [6:16:04<1:04:45,  3.67it/s]
 96%|█████████▌| 357216/371472 [6:16:05<1:03:15,  3.76it/s]
 96%|█████████▌| 357217/371472 [6:16:05<1:05:03,  3.65it/s]
 96%|█████████▌| 357218/371472 [6:16:05<1:04:34,  3.68it/s]
 96%|█████████▌| 357219/371472 [6:16:05<1:07:15,  3.53it/s]
 96%|█████████▌| 357220/371472 [6:16:06<1:05:43,  3.61it/s]
                                                           
{'loss': 2.4217, 'learning_rate': 1.3454825572625997e-07, 'epoch': 15.39}

 96%|█████████▌| 357220/371472 [6:16:06<1:05:43,  3.61it/s]
 96%|█████████▌| 357221/371472 [6:16:06<1:06:28,  3.57it/s]
 96%|█████████▌| 357222/371472 [6:16:06<1:12:18,  3.28it/s]
 96%|█████████▌| 357223/371472 [6:16:07<1:09:32,  3.42it/s]
 96%|█████████▌| 357224/371472 [6:16:07<1:09:38,  3.41it/s]
 96%|█████████▌| 357225/371472 [6:16:07<1:08:55,  3.45it/s]
 96%|█████████▌| 357226/371472 [6:16:08<1:09:54,  3.40it/s]
 96%|█████████▌| 357227/371472 [6:16:08<1:07:18,  3.53it/s]
 96%|█████████▌| 357228/371472 [6:16:08<1:05:47,  3.61it/s]
 96%|█████████▌| 357229/371472 [6:16:08<1:05:37,  3.62it/s]
 96%|█████████▌| 357230/371472 [6:16:09<1:21:44,  2.90it/s]
 96%|█████████▌| 357231/371472 [6:16:09<1:16:04,  3.12it/s]
 96%|█████████▌| 357232/371472 [6:16:09<1:13:03,  3.25it/s]
 96%|█████████▌| 357233/371472 [6:16:10<1:12:31,  3.27it/s]
 96%|█████████▌| 357234/371472 [6:16:10<1:10:50,  3.35it/s]
 96%|█████████▌| 357235/371472 [6:16:10<1:06:39,  3.56it/s]
 96%|█████████▌| 357236/371472 [6:16:10<1:03:20,  3.75it/s]
 96%|█████████▌| 357237/371472 [6:16:11<1:05:58,  3.60it/s]
 96%|█████████▌| 357238/371472 [6:16:11<1:03:01,  3.76it/s]
 96%|█████████▌| 357239/371472 [6:16:11<1:09:17,  3.42it/s]
 96%|█████████▌| 357240/371472 [6:16:12<1:06:48,  3.55it/s]
                                                           
{'loss': 2.5138, 'learning_rate': 1.3449977375078112e-07, 'epoch': 15.39}

 96%|█████████▌| 357240/371472 [6:16:12<1:06:48,  3.55it/s]
 96%|█████████▌| 357241/371472 [6:16:12<1:04:47,  3.66it/s]
 96%|█████████▌| 357242/371472 [6:16:12<1:04:30,  3.68it/s]
 96%|█████████▌| 357243/371472 [6:16:12<1:05:05,  3.64it/s]
 96%|█████████▌| 357244/371472 [6:16:13<1:07:02,  3.54it/s]
 96%|█████████▌| 357245/371472 [6:16:13<1:04:57,  3.65it/s]
 96%|█████████▌| 357246/371472 [6:16:13<1:06:48,  3.55it/s]
 96%|█████████▌| 357247/371472 [6:16:14<1:07:37,  3.51it/s]
 96%|█████████▌| 357248/371472 [6:16:14<1:05:38,  3.61it/s]
 96%|█████████▌| 357249/371472 [6:16:14<1:05:28,  3.62it/s]
 96%|█████████▌| 357250/371472 [6:16:14<1:04:48,  3.66it/s]
 96%|█████████▌| 357251/371472 [6:16:15<1:07:44,  3.50it/s]
 96%|█████████▌| 357252/371472 [6:16:15<1:07:51,  3.49it/s]
 96%|█████████▌| 357253/371472 [6:16:15<1:06:03,  3.59it/s]
 96%|█████████▌| 357254/371472 [6:16:16<1:09:17,  3.42it/s]
 96%|█████████▌| 357255/371472 [6:16:16<1:08:43,  3.45it/s]
 96%|█████████▌| 357256/371472 [6:16:16<1:10:48,  3.35it/s]
 96%|█████████▌| 357257/371472 [6:16:16<1:13:24,  3.23it/s]
 96%|█████████▌| 357258/371472 [6:16:17<1:11:28,  3.31it/s]
 96%|█████████▌| 357259/371472 [6:16:17<1:08:19,  3.47it/s]
 96%|█████████▌| 357260/371472 [6:16:17<1:09:00,  3.43it/s]
                                                           
{'loss': 2.6025, 'learning_rate': 1.344512917753022e-07, 'epoch': 15.39}

 96%|█████████▌| 357260/371472 [6:16:17<1:09:00,  3.43it/s]
 96%|█████████▌| 357261/371472 [6:16:18<1:07:05,  3.53it/s]
 96%|█████████▌| 357262/371472 [6:16:18<1:11:55,  3.29it/s]
 96%|█████████▌| 357263/371472 [6:16:18<1:09:16,  3.42it/s]
 96%|█████████▌| 357264/371472 [6:16:18<1:07:15,  3.52it/s]
 96%|█████████▌| 357265/371472 [6:16:19<1:06:38,  3.55it/s]
 96%|█████████▌| 357266/371472 [6:16:19<1:08:29,  3.46it/s]
 96%|█████████▌| 357267/371472 [6:16:19<1:08:19,  3.47it/s]
 96%|█████████▌| 357268/371472 [6:16:20<1:06:13,  3.57it/s]
 96%|█████████▌| 357269/371472 [6:16:20<1:04:42,  3.66it/s]
 96%|█████████▌| 357270/371472 [6:16:20<1:09:18,  3.41it/s]
 96%|█████████▌| 357271/371472 [6:16:20<1:08:24,  3.46it/s]
 96%|█████████▌| 357272/371472 [6:16:21<1:06:53,  3.54it/s]
 96%|█████████▌| 357273/371472 [6:16:21<1:03:59,  3.70it/s]
 96%|█████████▌| 357274/371472 [6:16:21<1:04:50,  3.65it/s]
 96%|█████████▌| 357275/371472 [6:16:22<1:08:38,  3.45it/s]
 96%|█████████▌| 357276/371472 [6:16:22<1:07:04,  3.53it/s]
 96%|█████████▌| 357277/371472 [6:16:22<1:06:38,  3.55it/s]
 96%|█████████▌| 357278/371472 [6:16:22<1:06:23,  3.56it/s]
 96%|█████████▌| 357279/371472 [6:16:23<1:07:18,  3.51it/s]
 96%|█████████▌| 357280/371472 [6:16:23<1:05:05,  3.63it/s]
                                                           
{'loss': 2.6837, 'learning_rate': 1.3440280979982337e-07, 'epoch': 15.39}

 96%|█████████▌| 357280/371472 [6:16:23<1:05:05,  3.63it/s]
 96%|█████████▌| 357281/371472 [6:16:23<1:05:28,  3.61it/s]
 96%|█████████▌| 357282/371472 [6:16:24<1:05:17,  3.62it/s]
 96%|█████████▌| 357283/371472 [6:16:24<1:04:35,  3.66it/s]
 96%|█████████▌| 357284/371472 [6:16:24<1:04:38,  3.66it/s]
 96%|█████████▌| 357285/371472 [6:16:24<1:03:26,  3.73it/s]
 96%|█████████▌| 357286/371472 [6:16:25<1:04:54,  3.64it/s]
 96%|█████████▌| 357287/371472 [6:16:25<1:05:13,  3.62it/s]
 96%|█████████▌| 357288/371472 [6:16:25<1:06:09,  3.57it/s]
 96%|█████████▌| 357289/371472 [6:16:25<1:05:04,  3.63it/s]
 96%|█████████▌| 357290/371472 [6:16:26<1:05:52,  3.59it/s]
 96%|█████████▌| 357291/371472 [6:16:26<1:08:39,  3.44it/s]
 96%|█████████▌| 357292/371472 [6:16:26<1:05:27,  3.61it/s]
 96%|█████████▌| 357293/371472 [6:16:27<1:11:39,  3.30it/s]
 96%|█████████▌| 357294/371472 [6:16:27<1:14:07,  3.19it/s]
 96%|█████████▌| 357295/371472 [6:16:27<1:17:02,  3.07it/s]
 96%|█████████▌| 357296/371472 [6:16:28<1:13:53,  3.20it/s]
 96%|█████████▌| 357297/371472 [6:16:28<1:10:39,  3.34it/s]
 96%|█████████▌| 357298/371472 [6:16:28<1:07:12,  3.51it/s]
 96%|█████████▌| 357299/371472 [6:16:28<1:04:38,  3.65it/s]
 96%|█████████▌| 357300/371472 [6:16:29<1:05:45,  3.59it/s]
                                                           
{'loss': 2.5791, 'learning_rate': 1.343543278243444e-07, 'epoch': 15.39}

 96%|█████████▌| 357300/371472 [6:16:29<1:05:45,  3.59it/s]
 96%|█████████▌| 357301/371472 [6:16:29<1:06:53,  3.53it/s]
 96%|█████████▌| 357302/371472 [6:16:29<1:04:20,  3.67it/s]
 96%|█████████▌| 357303/371472 [6:16:29<1:04:40,  3.65it/s]
 96%|█████████▌| 357304/371472 [6:16:30<1:02:59,  3.75it/s]
 96%|█████████▌| 357305/371472 [6:16:30<1:03:15,  3.73it/s]
 96%|█████████▌| 357306/371472 [6:16:30<1:06:18,  3.56it/s]
 96%|█████████▌| 357307/371472 [6:16:31<1:04:19,  3.67it/s]
 96%|█████████▌| 357308/371472 [6:16:31<1:02:10,  3.80it/s]
 96%|█████████▌| 357309/371472 [6:16:31<1:04:45,  3.65it/s]
 96%|█████████▌| 357310/371472 [6:16:31<1:07:52,  3.48it/s]
 96%|█████████▌| 357311/371472 [6:16:32<1:04:32,  3.66it/s]
 96%|█████████▌| 357312/371472 [6:16:32<1:05:25,  3.61it/s]
 96%|█████████▌| 357313/371472 [6:16:32<1:05:03,  3.63it/s]
 96%|█████████▌| 357314/371472 [6:16:32<1:03:12,  3.73it/s]
 96%|█████████▌| 357315/371472 [6:16:33<1:03:23,  3.72it/s]
 96%|█████████▌| 357316/371472 [6:16:33<1:04:10,  3.68it/s]
 96%|█████████▌| 357317/371472 [6:16:33<1:06:50,  3.53it/s]
 96%|█████████▌| 357318/371472 [6:16:34<1:06:32,  3.55it/s]
 96%|█████████▌| 357319/371472 [6:16:34<1:11:04,  3.32it/s]
 96%|█████████▌| 357320/371472 [6:16:34<1:11:10,  3.31it/s]
                                                           
{'loss': 2.6322, 'learning_rate': 1.3430584584886556e-07, 'epoch': 15.39}

 96%|█████████▌| 357320/371472 [6:16:34<1:11:10,  3.31it/s]
 96%|█████████▌| 357321/371472 [6:16:35<1:11:11,  3.31it/s]
 96%|█████████▌| 357322/371472 [6:16:35<1:08:36,  3.44it/s]
 96%|█████████▌| 357323/371472 [6:16:35<1:08:35,  3.44it/s]
 96%|█████████▌| 357324/371472 [6:16:36<1:19:32,  2.96it/s]
 96%|█████████▌| 357325/371472 [6:16:36<1:15:12,  3.14it/s]
 96%|█████████▌| 357326/371472 [6:16:36<1:15:12,  3.13it/s]
 96%|█████████▌| 357327/371472 [6:16:36<1:13:52,  3.19it/s]
 96%|█████████▌| 357328/371472 [6:16:37<1:16:37,  3.08it/s]
 96%|█████████▌| 357329/371472 [6:16:37<1:12:07,  3.27it/s]
 96%|█████████▌| 357330/371472 [6:16:37<1:11:46,  3.28it/s]
 96%|█████████▌| 357331/371472 [6:16:38<1:08:13,  3.45it/s]
 96%|█████████▌| 357332/371472 [6:16:38<1:05:40,  3.59it/s]
 96%|█████████▌| 357333/371472 [6:16:38<1:09:20,  3.40it/s]
 96%|█████████▌| 357334/371472 [6:16:38<1:07:00,  3.52it/s]
 96%|█████████▌| 357335/371472 [6:16:39<1:10:12,  3.36it/s]
 96%|█████████▌| 357336/371472 [6:16:39<1:09:13,  3.40it/s]
 96%|█████████▌| 357337/371472 [6:16:39<1:12:24,  3.25it/s]
 96%|█████████▌| 357338/371472 [6:16:40<1:10:33,  3.34it/s]
 96%|█████████▌| 357339/371472 [6:16:40<1:07:29,  3.49it/s]
 96%|█████████▌| 357340/371472 [6:16:40<1:04:15,  3.67it/s]
                                                           
{'loss': 2.532, 'learning_rate': 1.3425736387338663e-07, 'epoch': 15.39}

 96%|█████████▌| 357340/371472 [6:16:40<1:04:15,  3.67it/s]
 96%|█████████▌| 357341/371472 [6:16:40<1:03:33,  3.71it/s]
 96%|█████████▌| 357342/371472 [6:16:41<1:12:53,  3.23it/s]
 96%|█████████▌| 357343/371472 [6:16:41<1:09:31,  3.39it/s]
 96%|█████████▌| 357344/371472 [6:16:41<1:10:06,  3.36it/s]
 96%|█████████▌| 357345/371472 [6:16:42<1:07:32,  3.49it/s]
 96%|█████████▌| 357346/371472 [6:16:42<1:11:42,  3.28it/s]
 96%|█████████▌| 357347/371472 [6:16:42<1:07:14,  3.50it/s]
 96%|█████████▌| 357348/371472 [6:16:43<1:05:46,  3.58it/s]
 96%|█████████▌| 357349/371472 [6:16:43<1:06:57,  3.52it/s]
 96%|█████████▌| 357350/371472 [6:16:43<1:12:04,  3.27it/s]
 96%|█████████▌| 357351/371472 [6:16:43<1:08:41,  3.43it/s]
 96%|█████████▌| 357352/371472 [6:16:44<1:06:35,  3.53it/s]
 96%|█████████▌| 357353/371472 [6:16:44<1:05:43,  3.58it/s]
 96%|█████████▌| 357354/371472 [6:16:44<1:07:00,  3.51it/s]
 96%|█████████▌| 357355/371472 [6:16:45<1:07:12,  3.50it/s]
 96%|█████████▌| 357356/371472 [6:16:45<1:05:34,  3.59it/s]
 96%|█████████▌| 357357/371472 [6:16:45<1:09:35,  3.38it/s]
 96%|█████████▌| 357358/371472 [6:16:46<1:15:00,  3.14it/s]
 96%|█████████▌| 357359/371472 [6:16:46<1:13:48,  3.19it/s]
 96%|█████████▌| 357360/371472 [6:16:46<1:13:09,  3.21it/s]
                                                           
{'loss': 2.5935, 'learning_rate': 1.3420888189790768e-07, 'epoch': 15.39}

 96%|█████████▌| 357360/371472 [6:16:46<1:13:09,  3.21it/s]
 96%|█████████▌| 357361/371472 [6:16:46<1:13:16,  3.21it/s]
 96%|█████████▌| 357362/371472 [6:16:47<1:15:12,  3.13it/s]
 96%|█████████▌| 357363/371472 [6:16:47<1:15:03,  3.13it/s]
 96%|█████████▌| 357364/371472 [6:16:47<1:12:47,  3.23it/s]
 96%|█████████▌| 357365/371472 [6:16:48<1:13:31,  3.20it/s]
 96%|█████████▌| 357366/371472 [6:16:48<1:11:50,  3.27it/s]
 96%|█████████▌| 357367/371472 [6:16:48<1:12:38,  3.24it/s]
 96%|█████████▌| 357368/371472 [6:16:49<1:09:59,  3.36it/s]
 96%|█████████▌| 357369/371472 [6:16:49<1:09:17,  3.39it/s]
 96%|█████████▌| 357370/371472 [6:16:49<1:07:08,  3.50it/s]
 96%|█████████▌| 357371/371472 [6:16:49<1:08:36,  3.43it/s]
 96%|█████████▌| 357372/371472 [6:16:50<1:08:24,  3.44it/s]
 96%|█████████▌| 357373/371472 [6:16:50<1:06:29,  3.53it/s]
 96%|█████████▌| 357374/371472 [6:16:50<1:04:32,  3.64it/s]
 96%|█████████▌| 357375/371472 [6:16:51<1:06:08,  3.55it/s]
 96%|█████████▌| 357376/371472 [6:16:51<1:03:52,  3.68it/s]
 96%|█████████▌| 357377/371472 [6:16:51<1:01:45,  3.80it/s]
 96%|█████████▌| 357378/371472 [6:16:51<1:00:43,  3.87it/s]
 96%|█████████▌| 357379/371472 [6:16:52<1:01:36,  3.81it/s]
 96%|█████████▌| 357380/371472 [6:16:52<1:03:42,  3.69it/s]
                                                           
{'loss': 2.5235, 'learning_rate': 1.3416039992242883e-07, 'epoch': 15.39}

 96%|█████████▌| 357380/371472 [6:16:52<1:03:42,  3.69it/s]
 96%|█████████▌| 357381/371472 [6:16:52<1:07:15,  3.49it/s]
 96%|█████████▌| 357382/371472 [6:16:52<1:04:32,  3.64it/s]
 96%|█████████▌| 357383/371472 [6:16:53<1:02:09,  3.78it/s]
 96%|█████████▌| 357384/371472 [6:16:53<1:02:03,  3.78it/s]
 96%|█████████▌| 357385/371472 [6:16:53<1:05:16,  3.60it/s]
 96%|█████████▌| 357386/371472 [6:16:54<1:04:42,  3.63it/s]
 96%|█████████▌| 357387/371472 [6:16:54<1:03:08,  3.72it/s]
 96%|█████████▌| 357388/371472 [6:16:54<1:02:26,  3.76it/s]
 96%|█████████▌| 357389/371472 [6:16:54<1:01:05,  3.84it/s]
 96%|█████████▌| 357390/371472 [6:16:55<1:02:32,  3.75it/s]
 96%|█████████▌| 357391/371472 [6:16:55<1:03:36,  3.69it/s]
 96%|█████████▌| 357392/371472 [6:16:55<1:06:34,  3.52it/s]
 96%|█████████▌| 357393/371472 [6:16:55<1:04:48,  3.62it/s]
 96%|█████████▌| 357394/371472 [6:16:56<1:05:27,  3.58it/s]
 96%|█████████▌| 357395/371472 [6:16:56<1:07:25,  3.48it/s]
 96%|█████████▌| 357396/371472 [6:16:56<1:04:51,  3.62it/s]
 96%|█████████▌| 357397/371472 [6:16:57<1:05:09,  3.60it/s]
 96%|█████████▌| 357398/371472 [6:16:57<1:06:09,  3.55it/s]
 96%|█████████▌| 357399/371472 [6:16:57<1:04:20,  3.65it/s]
 96%|█████████▌| 357400/371472 [6:16:57<1:03:06,  3.72it/s]
                                                           
{'loss': 2.6444, 'learning_rate': 1.341119179469499e-07, 'epoch': 15.39}

 96%|█████████▌| 357400/371472 [6:16:57<1:03:06,  3.72it/s]
 96%|█████████▌| 357401/371472 [6:16:58<1:01:20,  3.82it/s]
 96%|█████████▌| 357402/371472 [6:16:58<1:03:07,  3.72it/s]
 96%|█████████▌| 357403/371472 [6:16:58<1:07:54,  3.45it/s]
 96%|█████████▌| 357404/371472 [6:16:58<1:04:57,  3.61it/s]
 96%|█████████▌| 357405/371472 [6:16:59<1:04:39,  3.63it/s]
 96%|█████████▌| 357406/371472 [6:16:59<1:06:57,  3.50it/s]
 96%|█████████▌| 357407/371472 [6:16:59<1:10:22,  3.33it/s]
 96%|█████████▌| 357408/371472 [6:17:00<1:07:41,  3.46it/s]
 96%|█████████▌| 357409/371472 [6:17:00<1:06:36,  3.52it/s]
 96%|█████████▌| 357410/371472 [6:17:00<1:05:28,  3.58it/s]
 96%|█████████▌| 357411/371472 [6:17:00<1:04:00,  3.66it/s]
 96%|█████████▌| 357412/371472 [6:17:01<1:09:06,  3.39it/s]
 96%|█████████▌| 357413/371472 [6:17:01<1:16:54,  3.05it/s]
 96%|█████████▌| 357414/371472 [6:17:02<1:15:23,  3.11it/s]
 96%|█████████▌| 357415/371472 [6:17:02<1:11:41,  3.27it/s]
 96%|█████████▌| 357416/371472 [6:17:02<1:10:46,  3.31it/s]
 96%|█████████▌| 357417/371472 [6:17:02<1:13:56,  3.17it/s]
 96%|█████████▌| 357418/371472 [6:17:03<1:11:40,  3.27it/s]
 96%|█████████▌| 357419/371472 [6:17:03<1:08:29,  3.42it/s]
 96%|█████████▌| 357420/371472 [6:17:03<1:14:38,  3.14it/s]
                                                           
{'loss': 2.3656, 'learning_rate': 1.3406343597147105e-07, 'epoch': 15.39}

 96%|█████████▌| 357420/371472 [6:17:03<1:14:38,  3.14it/s]
 96%|█████████▌| 357421/371472 [6:17:04<1:11:58,  3.25it/s]
 96%|█████████▌| 357422/371472 [6:17:04<1:09:13,  3.38it/s]
 96%|█████████▌| 357423/371472 [6:17:04<1:07:07,  3.49it/s]
 96%|█████████▌| 357424/371472 [6:17:04<1:04:25,  3.63it/s]
 96%|█████████▌| 357425/371472 [6:17:05<1:04:56,  3.61it/s]
 96%|█████████▌| 357426/371472 [6:17:05<1:06:11,  3.54it/s]
 96%|█████████▌| 357427/371472 [6:17:05<1:07:14,  3.48it/s]
 96%|█████████▌| 357428/371472 [6:17:06<1:06:13,  3.53it/s]
 96%|█████████▌| 357429/371472 [6:17:06<1:04:50,  3.61it/s]
 96%|█████████▌| 357430/371472 [6:17:06<1:07:48,  3.45it/s]
 96%|█████████▌| 357431/371472 [6:17:06<1:06:52,  3.50it/s]
 96%|█████████▌| 357432/371472 [6:17:07<1:06:45,  3.50it/s]
 96%|█████████▌| 357433/371472 [6:17:07<1:03:58,  3.66it/s]
 96%|█████████▌| 357434/371472 [6:17:07<1:05:49,  3.55it/s]
 96%|█████████▌| 357435/371472 [6:17:08<1:06:26,  3.52it/s]
 96%|█████████▌| 357436/371472 [6:17:08<1:06:13,  3.53it/s]
 96%|█████████▌| 357437/371472 [6:17:08<1:08:56,  3.39it/s]
 96%|█████████▌| 357438/371472 [6:17:08<1:06:41,  3.51it/s]
 96%|█████████▌| 357439/371472 [6:17:09<1:08:16,  3.43it/s]
 96%|█████████▌| 357440/371472 [6:17:09<1:06:55,  3.49it/s]
                                                           
{'loss': 2.6019, 'learning_rate': 1.340149539959921e-07, 'epoch': 15.4}

 96%|█████████▌| 357440/371472 [6:17:09<1:06:55,  3.49it/s]
 96%|█████████▌| 357441/371472 [6:17:09<1:07:35,  3.46it/s]
 96%|█████████▌| 357442/371472 [6:17:10<1:10:11,  3.33it/s]
 96%|█████████▌| 357443/371472 [6:17:10<1:08:45,  3.40it/s]
 96%|█████████▌| 357444/371472 [6:17:10<1:09:28,  3.37it/s]
 96%|█████████▌| 357445/371472 [6:17:10<1:06:29,  3.52it/s]
 96%|█████████▌| 357446/371472 [6:17:11<1:04:00,  3.65it/s]
 96%|█████████▌| 357447/371472 [6:17:11<1:03:14,  3.70it/s]
 96%|█████████▌| 357448/371472 [6:17:11<1:07:11,  3.48it/s]
 96%|█████████▌| 357449/371472 [6:17:12<1:05:40,  3.56it/s]
 96%|█████████▌| 357450/371472 [6:17:12<1:07:07,  3.48it/s]
 96%|█████████▌| 357451/371472 [6:17:12<1:06:22,  3.52it/s]
 96%|█████████▌| 357452/371472 [6:17:12<1:05:11,  3.58it/s]
 96%|█████████▌| 357453/371472 [6:17:13<1:03:38,  3.67it/s]
 96%|█████████▌| 357454/371472 [6:17:13<1:03:54,  3.66it/s]
 96%|█████████▌| 357455/371472 [6:17:13<1:02:49,  3.72it/s]
 96%|█████████▌| 357456/371472 [6:17:13<1:04:14,  3.64it/s]
 96%|█████████▌| 357457/371472 [6:17:14<1:03:56,  3.65it/s]
 96%|█████████▌| 357458/371472 [6:17:14<1:02:35,  3.73it/s]
 96%|█████████▌| 357459/371472 [6:17:14<1:03:53,  3.65it/s]
 96%|█████████▌| 357460/371472 [6:17:15<1:02:47,  3.72it/s]
                                                           
{'loss': 2.4433, 'learning_rate': 1.3396647202051327e-07, 'epoch': 15.4}

 96%|█████████▌| 357460/371472 [6:17:15<1:02:47,  3.72it/s]
 96%|█████████▌| 357461/371472 [6:17:15<1:04:53,  3.60it/s]
 96%|█████████▌| 357462/371472 [6:17:15<1:05:25,  3.57it/s]
 96%|█████████▌| 357463/371472 [6:17:15<1:05:52,  3.54it/s]
 96%|█████████▌| 357464/371472 [6:17:16<1:05:28,  3.57it/s]
 96%|█████████▌| 357465/371472 [6:17:16<1:04:54,  3.60it/s]
 96%|█████████▌| 357466/371472 [6:17:16<1:05:33,  3.56it/s]
 96%|█████████▌| 357467/371472 [6:17:17<1:05:30,  3.56it/s]
 96%|█████████▌| 357468/371472 [6:17:17<1:06:31,  3.51it/s]
 96%|█████████▌| 357469/371472 [6:17:17<1:14:13,  3.14it/s]
 96%|█████████▌| 357470/371472 [6:17:18<1:17:32,  3.01it/s]
 96%|█████████▌| 357471/371472 [6:17:18<1:11:33,  3.26it/s]
 96%|█████████▌| 357472/371472 [6:17:18<1:08:38,  3.40it/s]
 96%|█████████▌| 357473/371472 [6:17:18<1:09:31,  3.36it/s]
 96%|█████████▌| 357474/371472 [6:17:19<1:07:07,  3.48it/s]
 96%|█████████▌| 357475/371472 [6:17:19<1:06:41,  3.50it/s]
 96%|█████████▌| 357476/371472 [6:17:19<1:03:45,  3.66it/s]
 96%|█████████▌| 357477/371472 [6:17:19<1:04:12,  3.63it/s]
 96%|█████████▌| 357478/371472 [6:17:20<1:07:08,  3.47it/s]
 96%|█████████▌| 357479/371472 [6:17:20<1:03:29,  3.67it/s]
 96%|█████████▌| 357480/371472 [6:17:20<1:03:23,  3.68it/s]
                                                           
{'loss': 2.5902, 'learning_rate': 1.3391799004503432e-07, 'epoch': 15.4}

 96%|█████████▌| 357480/371472 [6:17:20<1:03:23,  3.68it/s]
 96%|█████████▌| 357481/371472 [6:17:21<1:03:33,  3.67it/s]
 96%|█████████▌| 357482/371472 [6:17:21<1:02:47,  3.71it/s]
 96%|█████████▌| 357483/371472 [6:17:21<1:02:50,  3.71it/s]
 96%|█████████▌| 357484/371472 [6:17:21<1:03:35,  3.67it/s]
 96%|█████████▌| 357485/371472 [6:17:22<1:12:35,  3.21it/s]
 96%|█████████▌| 357486/371472 [6:17:22<1:09:57,  3.33it/s]
 96%|█████████▌| 357487/371472 [6:17:22<1:09:53,  3.33it/s]
 96%|█████████▌| 357488/371472 [6:17:23<1:08:26,  3.41it/s]
 96%|█████████▌| 357489/371472 [6:17:23<1:10:04,  3.33it/s]
 96%|█████████▌| 357490/371472 [6:17:23<1:07:02,  3.48it/s]
 96%|█████████▌| 357491/371472 [6:17:23<1:04:51,  3.59it/s]
 96%|█████████▌| 357492/371472 [6:17:24<1:04:05,  3.64it/s]
 96%|█████████▌| 357493/371472 [6:17:24<1:03:51,  3.65it/s]
 96%|█████████▌| 357494/371472 [6:17:24<1:04:12,  3.63it/s]
 96%|█████████▌| 357495/371472 [6:17:25<1:10:49,  3.29it/s]
 96%|█████████▌| 357496/371472 [6:17:25<1:06:55,  3.48it/s]
 96%|█████████▌| 357497/371472 [6:17:25<1:09:47,  3.34it/s]
 96%|█████████▌| 357498/371472 [6:17:25<1:06:01,  3.53it/s]
 96%|█████████▌| 357499/371472 [6:17:26<1:05:32,  3.55it/s]
 96%|█████████▌| 357500/371472 [6:17:26<1:05:44,  3.54it/s]
                                                           
{'loss': 2.6976, 'learning_rate': 1.3386950806955547e-07, 'epoch': 15.4}

 96%|█████████▌| 357500/371472 [6:17:26<1:05:44,  3.54it/s]
 96%|█████████▌| 357501/371472 [6:17:26<1:05:57,  3.53it/s]
 96%|█████████▌| 357502/371472 [6:17:27<1:02:53,  3.70it/s]
 96%|█████████▌| 357503/371472 [6:17:27<1:03:46,  3.65it/s]
 96%|█████████▌| 357504/371472 [6:17:27<1:03:45,  3.65it/s]
 96%|█████████▌| 357505/371472 [6:17:27<1:01:55,  3.76it/s]
 96%|█████████▌| 357506/371472 [6:17:28<1:02:28,  3.73it/s]
 96%|█████████▌| 357507/371472 [6:17:28<1:07:17,  3.46it/s]
 96%|█████████▌| 357508/371472 [6:17:28<1:04:26,  3.61it/s]
 96%|█████████▌| 357509/371472 [6:17:29<1:06:29,  3.50it/s]
 96%|█████████▌| 357510/371472 [6:17:29<1:04:31,  3.61it/s]
 96%|█████████▌| 357511/371472 [6:17:29<1:04:17,  3.62it/s]
 96%|█████████▌| 357512/371472 [6:17:29<1:06:13,  3.51it/s]
 96%|█████████▌| 357513/371472 [6:17:30<1:15:01,  3.10it/s]
 96%|█████████▌| 357514/371472 [6:17:30<1:10:33,  3.30it/s]
 96%|█████████▌| 357515/371472 [6:17:30<1:12:47,  3.20it/s]
 96%|█████████▌| 357516/371472 [6:17:31<1:14:17,  3.13it/s]
 96%|█████████▌| 357517/371472 [6:17:31<1:11:25,  3.26it/s]
 96%|█████████▌| 357518/371472 [6:17:31<1:07:20,  3.45it/s]
 96%|█████████▌| 357519/371472 [6:17:32<1:06:34,  3.49it/s]
 96%|█████████▌| 357520/371472 [6:17:32<1:06:10,  3.51it/s]
                                                           
{'loss': 2.5105, 'learning_rate': 1.3382102609407654e-07, 'epoch': 15.4}

 96%|█████████▌| 357520/371472 [6:17:32<1:06:10,  3.51it/s]
 96%|█████████▌| 357521/371472 [6:17:32<1:03:20,  3.67it/s]
 96%|█████████▌| 357522/371472 [6:17:32<1:03:34,  3.66it/s]
 96%|█████████▌| 357523/371472 [6:17:33<1:00:46,  3.82it/s]
 96%|█████████▌| 357524/371472 [6:17:33<1:02:03,  3.75it/s]
 96%|█████████▌| 357525/371472 [6:17:33<1:03:42,  3.65it/s]
 96%|█████████▌| 357526/371472 [6:17:33<1:05:58,  3.52it/s]
 96%|█████████▌| 357527/371472 [6:17:34<1:06:34,  3.49it/s]
 96%|█████████▌| 357528/371472 [6:17:34<1:05:11,  3.56it/s]
 96%|█████████▌| 357529/371472 [6:17:34<1:03:56,  3.63it/s]
 96%|█████████▌| 357530/371472 [6:17:35<1:04:19,  3.61it/s]
 96%|█████████▌| 357531/371472 [6:17:35<1:04:49,  3.58it/s]
 96%|█████████▌| 357532/371472 [6:17:35<1:06:11,  3.51it/s]
 96%|█████████▌| 357533/371472 [6:17:35<1:07:06,  3.46it/s]
 96%|█████████▌| 357534/371472 [6:17:36<1:09:11,  3.36it/s]
 96%|█████████▌| 357535/371472 [6:17:36<1:07:37,  3.43it/s]
 96%|█████████▌| 357536/371472 [6:17:36<1:14:44,  3.11it/s]
 96%|█████████▌| 357537/371472 [6:17:37<1:10:14,  3.31it/s]
 96%|█████████▌| 357538/371472 [6:17:37<1:08:58,  3.37it/s]
 96%|█████████▌| 357539/371472 [6:17:37<1:06:49,  3.47it/s]
 96%|█████████▌| 357540/371472 [6:17:37<1:03:53,  3.63it/s]
                                                           
{'loss': 2.5551, 'learning_rate': 1.337725441185977e-07, 'epoch': 15.4}

 96%|█████████▌| 357540/371472 [6:17:37<1:03:53,  3.63it/s]
 96%|█████████▌| 357541/371472 [6:17:38<1:03:14,  3.67it/s]
 96%|█████████▋| 357542/371472 [6:17:38<1:02:22,  3.72it/s]
 96%|█████████▋| 357543/371472 [6:17:38<1:07:52,  3.42it/s]
 96%|█████████▋| 357544/371472 [6:17:39<1:35:39,  2.43it/s]
 96%|█████████▋| 357545/371472 [6:17:39<1:25:06,  2.73it/s]
 96%|█████████▋| 357546/371472 [6:17:40<1:17:33,  2.99it/s]
 96%|█████████▋| 357547/371472 [6:17:40<1:14:12,  3.13it/s]
 96%|█████████▋| 357548/371472 [6:17:40<1:09:24,  3.34it/s]
 96%|█████████▋| 357549/371472 [6:17:40<1:09:26,  3.34it/s]
 96%|█████████▋| 357550/371472 [6:17:41<1:06:58,  3.46it/s]
 96%|█████████▋| 357551/371472 [6:17:41<1:04:12,  3.61it/s]
 96%|█████████▋| 357552/371472 [6:17:41<1:01:57,  3.74it/s]
 96%|█████████▋| 357553/371472 [6:17:41<1:02:08,  3.73it/s]
 96%|█████████▋| 357554/371472 [6:17:42<1:02:01,  3.74it/s]
 96%|█████████▋| 357555/371472 [6:17:42<1:02:18,  3.72it/s]
 96%|█████████▋| 357556/371472 [6:17:42<1:02:06,  3.73it/s]
 96%|█████████▋| 357557/371472 [6:17:42<1:01:36,  3.76it/s]
 96%|█████████▋| 357558/371472 [6:17:43<1:01:37,  3.76it/s]
 96%|█████████▋| 357559/371472 [6:17:43<1:04:53,  3.57it/s]
 96%|█████████▋| 357560/371472 [6:17:43<1:04:55,  3.57it/s]
                                                           
{'loss': 2.6433, 'learning_rate': 1.3372406214311876e-07, 'epoch': 15.4}

 96%|█████████▋| 357560/371472 [6:17:43<1:04:55,  3.57it/s]
 96%|█████████▋| 357561/371472 [6:17:44<1:06:42,  3.48it/s]
 96%|█████████▋| 357562/371472 [6:17:44<1:04:46,  3.58it/s]
 96%|█████████▋| 357563/371472 [6:17:44<1:02:32,  3.71it/s]
 96%|█████████▋| 357564/371472 [6:17:44<1:00:47,  3.81it/s]
 96%|█████████▋| 357565/371472 [6:17:45<1:02:06,  3.73it/s]
 96%|█████████▋| 357566/371472 [6:17:45<59:59,  3.86it/s]  
 96%|█████████▋| 357567/371472 [6:17:45<1:02:09,  3.73it/s]
 96%|█████████▋| 357568/371472 [6:17:45<1:03:42,  3.64it/s]
 96%|█████████▋| 357569/371472 [6:17:46<1:02:00,  3.74it/s]
 96%|█████████▋| 357570/371472 [6:17:46<1:01:53,  3.74it/s]
 96%|█████████▋| 357571/371472 [6:17:46<1:04:22,  3.60it/s]
 96%|█████████▋| 357572/371472 [6:17:47<1:05:54,  3.52it/s]
 96%|█████████▋| 357573/371472 [6:17:47<1:06:25,  3.49it/s]
 96%|█████████▋| 357574/371472 [6:17:47<1:03:14,  3.66it/s]
 96%|█████████▋| 357575/371472 [6:17:47<1:04:56,  3.57it/s]
 96%|█████████▋| 357576/371472 [6:17:48<1:03:19,  3.66it/s]
 96%|█████████▋| 357577/371472 [6:17:48<1:01:54,  3.74it/s]
 96%|█████████▋| 357578/371472 [6:17:48<1:05:56,  3.51it/s]
 96%|█████████▋| 357579/371472 [6:17:49<1:08:38,  3.37it/s]
 96%|█████████▋| 357580/371472 [6:17:49<1:07:16,  3.44it/s]
                                                           
{'loss': 2.7044, 'learning_rate': 1.3367558016763991e-07, 'epoch': 15.4}

 96%|█████████▋| 357580/371472 [6:17:49<1:07:16,  3.44it/s]
 96%|█████████▋| 357581/371472 [6:17:49<1:09:43,  3.32it/s]
 96%|█████████▋| 357582/371472 [6:17:49<1:06:41,  3.47it/s]
 96%|█████████▋| 357583/371472 [6:17:50<1:08:00,  3.40it/s]
 96%|█████████▋| 357584/371472 [6:17:50<1:10:09,  3.30it/s]
 96%|█████████▋| 357585/371472 [6:17:50<1:08:05,  3.40it/s]
 96%|█████████▋| 357586/371472 [6:17:51<1:11:33,  3.23it/s]
 96%|█████████▋| 357587/371472 [6:17:51<1:09:07,  3.35it/s]
 96%|█████████▋| 357588/371472 [6:17:51<1:07:26,  3.43it/s]
 96%|█████████▋| 357589/371472 [6:17:52<1:05:46,  3.52it/s]
 96%|█████████▋| 357590/371472 [6:17:52<1:04:45,  3.57it/s]
 96%|█████████▋| 357591/371472 [6:17:52<1:04:00,  3.61it/s]
 96%|█████████▋| 357592/371472 [6:17:52<1:01:17,  3.77it/s]
 96%|█████████▋| 357593/371472 [6:17:53<1:01:53,  3.74it/s]
 96%|█████████▋| 357594/371472 [6:17:53<1:04:56,  3.56it/s]
 96%|█████████▋| 357595/371472 [6:17:53<1:04:41,  3.57it/s]
 96%|█████████▋| 357596/371472 [6:17:53<1:06:53,  3.46it/s]
 96%|█████████▋| 357597/371472 [6:17:54<1:14:08,  3.12it/s]
 96%|█████████▋| 357598/371472 [6:17:54<1:09:14,  3.34it/s]
 96%|█████████▋| 357599/371472 [6:17:54<1:10:43,  3.27it/s]
 96%|█████████▋| 357600/371472 [6:17:55<1:08:03,  3.40it/s]
                                                           
{'loss': 2.6796, 'learning_rate': 1.3362709819216099e-07, 'epoch': 15.4}

 96%|█████████▋| 357600/371472 [6:17:55<1:08:03,  3.40it/s]
 96%|█████████▋| 357601/371472 [6:17:55<1:10:44,  3.27it/s]
 96%|█████████▋| 357602/371472 [6:17:55<1:08:37,  3.37it/s]
 96%|█████████▋| 357603/371472 [6:17:56<1:06:34,  3.47it/s]
 96%|█████████▋| 357604/371472 [6:17:56<1:04:35,  3.58it/s]
 96%|█████████▋| 357605/371472 [6:17:56<1:03:43,  3.63it/s]
 96%|█████████▋| 357606/371472 [6:17:56<1:03:16,  3.65it/s]
 96%|█████████▋| 357607/371472 [6:17:57<1:07:17,  3.43it/s]
 96%|█████████▋| 357608/371472 [6:17:57<1:06:04,  3.50it/s]
 96%|█████████▋| 357609/371472 [6:17:57<1:05:31,  3.53it/s]
 96%|█████████▋| 357610/371472 [6:17:58<1:05:03,  3.55it/s]
 96%|█████████▋| 357611/371472 [6:17:58<1:04:04,  3.61it/s]
 96%|█████████▋| 357612/371472 [6:17:58<1:03:28,  3.64it/s]
 96%|█████████▋| 357613/371472 [6:17:58<1:06:15,  3.49it/s]
 96%|█████████▋| 357614/371472 [6:17:59<1:02:40,  3.69it/s]
 96%|█████████▋| 357615/371472 [6:17:59<1:02:03,  3.72it/s]
 96%|█████████▋| 357616/371472 [6:17:59<1:02:05,  3.72it/s]
 96%|█████████▋| 357617/371472 [6:17:59<1:02:35,  3.69it/s]
 96%|█████████▋| 357618/371472 [6:18:00<1:01:40,  3.74it/s]
 96%|█████████▋| 357619/371472 [6:18:00<1:04:23,  3.59it/s]
 96%|█████████▋| 357620/371472 [6:18:00<1:02:54,  3.67it/s]
                                                           
{'loss': 2.5611, 'learning_rate': 1.3357861621668214e-07, 'epoch': 15.4}

 96%|█████████▋| 357620/371472 [6:18:00<1:02:54,  3.67it/s]
 96%|█████████▋| 357621/371472 [6:18:01<1:02:46,  3.68it/s]
 96%|█████████▋| 357622/371472 [6:18:01<1:03:31,  3.63it/s]
 96%|█████████▋| 357623/371472 [6:18:01<1:09:15,  3.33it/s]
 96%|█████████▋| 357624/371472 [6:18:01<1:08:01,  3.39it/s]
 96%|█████████▋| 357625/371472 [6:18:02<1:15:03,  3.07it/s]
 96%|█████████▋| 357626/371472 [6:18:02<1:10:21,  3.28it/s]
 96%|█████████▋| 357627/371472 [6:18:02<1:05:44,  3.51it/s]
 96%|█████████▋| 357628/371472 [6:18:03<1:02:41,  3.68it/s]
 96%|█████████▋| 357629/371472 [6:18:03<59:59,  3.85it/s]  
 96%|█████████▋| 357630/371472 [6:18:03<59:37,  3.87it/s]
 96%|█████████▋| 357631/371472 [6:18:03<59:59,  3.84it/s]
 96%|█████████▋| 357632/371472 [6:18:04<1:02:04,  3.72it/s]
 96%|█████████▋| 357633/371472 [6:18:04<1:04:05,  3.60it/s]
 96%|█████████▋| 357634/371472 [6:18:04<1:02:37,  3.68it/s]
 96%|█████████▋| 357635/371472 [6:18:04<1:03:35,  3.63it/s]
 96%|█████████▋| 357636/371472 [6:18:05<1:04:03,  3.60it/s]
 96%|█████████▋| 357637/371472 [6:18:05<1:02:11,  3.71it/s]
 96%|█████████▋| 357638/371472 [6:18:05<1:00:06,  3.84it/s]
 96%|█████████▋| 357639/371472 [6:18:05<59:08,  3.90it/s]  
 96%|█████████▋| 357640/371472 [6:18:06<59:54,  3.85it/s]
                                                         
{'loss': 2.684, 'learning_rate': 1.3353013424120318e-07, 'epoch': 15.4}

 96%|█████████▋| 357640/371472 [6:18:06<59:54,  3.85it/s]
 96%|█████████▋| 357641/371472 [6:18:06<59:49,  3.85it/s]
 96%|█████████▋| 357642/371472 [6:18:06<1:02:10,  3.71it/s]
 96%|█████████▋| 357643/371472 [6:18:07<1:03:07,  3.65it/s]
 96%|█████████▋| 357644/371472 [6:18:07<1:02:56,  3.66it/s]
 96%|█████████▋| 357645/371472 [6:18:07<1:03:43,  3.62it/s]
 96%|█████████▋| 357646/371472 [6:18:07<1:04:24,  3.58it/s]
 96%|█████████▋| 357647/371472 [6:18:08<1:02:57,  3.66it/s]
 96%|█████████▋| 357648/371472 [6:18:08<1:05:17,  3.53it/s]
 96%|█████████▋| 357649/371472 [6:18:08<1:07:55,  3.39it/s]
 96%|█████████▋| 357650/371472 [6:18:09<1:08:46,  3.35it/s]
 96%|█████████▋| 357651/371472 [6:18:09<1:06:15,  3.48it/s]
 96%|█████████▋| 357652/371472 [6:18:09<1:03:12,  3.64it/s]
 96%|█████████▋| 357653/371472 [6:18:09<1:02:31,  3.68it/s]
 96%|█████████▋| 357654/371472 [6:18:10<1:08:58,  3.34it/s]
 96%|█████████▋| 357655/371472 [6:18:10<1:09:23,  3.32it/s]
 96%|█████████▋| 357656/371472 [6:18:10<1:08:07,  3.38it/s]
 96%|█████████▋| 357657/371472 [6:18:11<1:04:46,  3.55it/s]
 96%|█████████▋| 357658/371472 [6:18:11<1:02:16,  3.70it/s]
 96%|█████████▋| 357659/371472 [6:18:11<1:01:55,  3.72it/s]
 96%|█████████▋| 357660/371472 [6:18:11<1:00:16,  3.82it/s]
                                                           
{'loss': 2.5946, 'learning_rate': 1.3348165226572436e-07, 'epoch': 15.41}

 96%|█████████▋| 357660/371472 [6:18:11<1:00:16,  3.82it/s]
 96%|█████████▋| 357661/371472 [6:18:12<1:01:26,  3.75it/s]
 96%|█████████▋| 357662/371472 [6:18:12<59:37,  3.86it/s]  
 96%|█████████▋| 357663/371472 [6:18:12<1:04:28,  3.57it/s]
 96%|█████████▋| 357664/371472 [6:18:12<1:03:56,  3.60it/s]
 96%|█████████▋| 357665/371472 [6:18:13<1:02:30,  3.68it/s]
 96%|█████████▋| 357666/371472 [6:18:13<1:02:29,  3.68it/s]
 96%|█████████▋| 357667/371472 [6:18:13<1:02:28,  3.68it/s]
 96%|█████████▋| 357668/371472 [6:18:14<1:00:45,  3.79it/s]
 96%|█████████▋| 357669/371472 [6:18:14<59:12,  3.88it/s]  
 96%|█████████▋| 357670/371472 [6:18:14<57:29,  4.00it/s]
 96%|█████████▋| 357671/371472 [6:18:14<1:01:25,  3.74it/s]
 96%|█████████▋| 357672/371472 [6:18:15<1:03:36,  3.62it/s]
 96%|█████████▋| 357673/371472 [6:18:15<1:04:08,  3.59it/s]
 96%|█████████▋| 357674/371472 [6:18:15<1:01:09,  3.76it/s]
 96%|█████████▋| 357675/371472 [6:18:15<1:02:57,  3.65it/s]
 96%|█████████▋| 357676/371472 [6:18:16<1:06:54,  3.44it/s]
 96%|█████████▋| 357677/371472 [6:18:16<1:05:52,  3.49it/s]
 96%|█████████▋| 357678/371472 [6:18:16<1:08:54,  3.34it/s]
 96%|█████████▋| 357679/371472 [6:18:17<1:07:51,  3.39it/s]
 96%|█████████▋| 357680/371472 [6:18:17<1:06:12,  3.47it/s]
                                                           
{'loss': 2.4644, 'learning_rate': 1.334331702902454e-07, 'epoch': 15.41}

 96%|█████████▋| 357680/371472 [6:18:17<1:06:12,  3.47it/s]
 96%|█████████▋| 357681/371472 [6:18:17<1:07:58,  3.38it/s]
 96%|█████████▋| 357682/371472 [6:18:17<1:05:23,  3.51it/s]
 96%|█████████▋| 357683/371472 [6:18:18<1:03:29,  3.62it/s]
 96%|█████████▋| 357684/371472 [6:18:18<1:07:42,  3.39it/s]
 96%|█████████▋| 357685/371472 [6:18:18<1:03:33,  3.62it/s]
 96%|█████████▋| 357686/371472 [6:18:19<1:02:33,  3.67it/s]
 96%|█████████▋| 357687/371472 [6:18:19<1:03:00,  3.65it/s]
 96%|█████████▋| 357688/371472 [6:18:19<1:02:56,  3.65it/s]
 96%|█████████▋| 357689/371472 [6:18:19<1:01:44,  3.72it/s]
 96%|█████████▋| 357690/371472 [6:18:20<1:03:07,  3.64it/s]
 96%|█████████▋| 357691/371472 [6:18:20<1:02:05,  3.70it/s]
 96%|█████████▋| 357692/371472 [6:18:20<1:00:45,  3.78it/s]
 96%|█████████▋| 357693/371472 [6:18:20<1:01:11,  3.75it/s]
 96%|█████████▋| 357694/371472 [6:18:21<1:01:42,  3.72it/s]
 96%|█████████▋| 357695/371472 [6:18:21<1:00:32,  3.79it/s]
 96%|█████████▋| 357696/371472 [6:18:21<1:02:11,  3.69it/s]
 96%|█████████▋| 357697/371472 [6:18:22<1:01:58,  3.70it/s]
 96%|█████████▋| 357698/371472 [6:18:22<1:01:16,  3.75it/s]
 96%|█████████▋| 357699/371472 [6:18:22<1:02:28,  3.67it/s]
 96%|█████████▋| 357700/371472 [6:18:22<1:02:37,  3.67it/s]
                                                           
{'loss': 2.6161, 'learning_rate': 1.3338468831476653e-07, 'epoch': 15.41}

 96%|█████████▋| 357700/371472 [6:18:22<1:02:37,  3.67it/s]
 96%|█████████▋| 357701/371472 [6:18:23<1:01:08,  3.75it/s]
 96%|█████████▋| 357702/371472 [6:18:23<1:01:39,  3.72it/s]
 96%|█████████▋| 357703/371472 [6:18:23<1:01:58,  3.70it/s]
 96%|█████████▋| 357704/371472 [6:18:23<1:00:37,  3.79it/s]
 96%|█████████▋| 357705/371472 [6:18:24<59:17,  3.87it/s]  
 96%|█████████▋| 357706/371472 [6:18:24<1:01:26,  3.73it/s]
 96%|█████████▋| 357707/371472 [6:18:24<1:00:11,  3.81it/s]
 96%|█████████▋| 357708/371472 [6:18:25<1:05:48,  3.49it/s]
 96%|█████████▋| 357709/371472 [6:18:25<1:04:42,  3.55it/s]
 96%|█████████▋| 357710/371472 [6:18:25<1:04:37,  3.55it/s]
 96%|█████████▋| 357711/371472 [6:18:25<1:03:16,  3.62it/s]
 96%|█████████▋| 357712/371472 [6:18:26<1:02:58,  3.64it/s]
 96%|█████████▋| 357713/371472 [6:18:26<1:00:53,  3.77it/s]
 96%|█████████▋| 357714/371472 [6:18:26<1:02:08,  3.69it/s]
 96%|█████████▋| 357715/371472 [6:18:27<1:12:06,  3.18it/s]
 96%|█████████▋| 357716/371472 [6:18:27<1:14:23,  3.08it/s]
 96%|█████████▋| 357717/371472 [6:18:27<1:09:49,  3.28it/s]
 96%|█████████▋| 357718/371472 [6:18:27<1:06:28,  3.45it/s]
 96%|█████████▋| 357719/371472 [6:18:28<1:05:58,  3.47it/s]
 96%|█████████▋| 357720/371472 [6:18:28<1:03:48,  3.59it/s]
                                                           
{'loss': 2.4774, 'learning_rate': 1.3333620633928763e-07, 'epoch': 15.41}

 96%|█████████▋| 357720/371472 [6:18:28<1:03:48,  3.59it/s]
 96%|█████████▋| 357721/371472 [6:18:28<1:09:25,  3.30it/s]
 96%|█████████▋| 357722/371472 [6:18:29<1:18:50,  2.91it/s]
 96%|█████████▋| 357723/371472 [6:18:29<1:11:37,  3.20it/s]
 96%|█████████▋| 357724/371472 [6:18:29<1:08:56,  3.32it/s]
 96%|█████████▋| 357725/371472 [6:18:30<1:07:22,  3.40it/s]
 96%|█████████▋| 357726/371472 [6:18:30<1:04:59,  3.53it/s]
 96%|█████████▋| 357727/371472 [6:18:30<1:02:08,  3.69it/s]
 96%|█████████▋| 357728/371472 [6:18:30<1:01:54,  3.70it/s]
 96%|█████████▋| 357729/371472 [6:18:31<1:07:47,  3.38it/s]
 96%|█████████▋| 357730/371472 [6:18:31<1:14:27,  3.08it/s]
 96%|█████████▋| 357731/371472 [6:18:31<1:15:59,  3.01it/s]
 96%|█████████▋| 357732/371472 [6:18:32<1:12:09,  3.17it/s]
 96%|█████████▋| 357733/371472 [6:18:32<1:08:41,  3.33it/s]
 96%|█████████▋| 357734/371472 [6:18:32<1:08:45,  3.33it/s]
 96%|█████████▋| 357735/371472 [6:18:33<1:07:10,  3.41it/s]
 96%|█████████▋| 357736/371472 [6:18:33<1:10:33,  3.24it/s]
 96%|█████████▋| 357737/371472 [6:18:33<1:07:38,  3.38it/s]
 96%|█████████▋| 357738/371472 [6:18:33<1:06:54,  3.42it/s]
 96%|█████████▋| 357739/371472 [6:18:34<1:11:55,  3.18it/s]
 96%|█████████▋| 357740/371472 [6:18:34<1:08:20,  3.35it/s]
                                                           
{'loss': 2.5197, 'learning_rate': 1.3328772436380878e-07, 'epoch': 15.41}

 96%|█████████▋| 357740/371472 [6:18:34<1:08:20,  3.35it/s]
 96%|█████████▋| 357741/371472 [6:18:34<1:04:24,  3.55it/s]
 96%|█████████▋| 357742/371472 [6:18:35<1:03:51,  3.58it/s]
 96%|█████████▋| 357743/371472 [6:18:35<1:05:12,  3.51it/s]
 96%|█████████▋| 357744/371472 [6:18:35<1:06:21,  3.45it/s]
 96%|█████████▋| 357745/371472 [6:18:35<1:07:05,  3.41it/s]
 96%|█████████▋| 357746/371472 [6:18:36<1:07:45,  3.38it/s]
 96%|█████████▋| 357747/371472 [6:18:36<1:04:37,  3.54it/s]
 96%|█████████▋| 357748/371472 [6:18:36<1:03:54,  3.58it/s]
 96%|█████████▋| 357749/371472 [6:18:37<1:02:40,  3.65it/s]
 96%|█████████▋| 357750/371472 [6:18:37<1:01:18,  3.73it/s]
 96%|█████████▋| 357751/371472 [6:18:37<1:03:12,  3.62it/s]
 96%|█████████▋| 357752/371472 [6:18:37<1:02:31,  3.66it/s]
 96%|█████████▋| 357753/371472 [6:18:38<1:05:56,  3.47it/s]
 96%|█████████▋| 357754/371472 [6:18:38<1:03:15,  3.61it/s]
 96%|█████████▋| 357755/371472 [6:18:38<1:02:48,  3.64it/s]
 96%|█████████▋| 357756/371472 [6:18:38<1:02:10,  3.68it/s]
 96%|█████████▋| 357757/371472 [6:18:39<1:02:31,  3.66it/s]
 96%|█████████▋| 357758/371472 [6:18:39<1:10:33,  3.24it/s]
 96%|█████████▋| 357759/371472 [6:18:39<1:08:59,  3.31it/s]
 96%|█████████▋| 357760/371472 [6:18:40<1:11:02,  3.22it/s]
                                                           
{'loss': 2.6126, 'learning_rate': 1.3323924238832982e-07, 'epoch': 15.41}

 96%|█████████▋| 357760/371472 [6:18:40<1:11:02,  3.22it/s]
 96%|█████████▋| 357761/371472 [6:18:40<1:07:24,  3.39it/s]
 96%|█████████▋| 357762/371472 [6:18:40<1:05:08,  3.51it/s]
 96%|█████████▋| 357763/371472 [6:18:41<1:06:25,  3.44it/s]
 96%|█████████▋| 357764/371472 [6:18:41<1:05:23,  3.49it/s]
 96%|█████████▋| 357765/371472 [6:18:41<1:01:49,  3.70it/s]
 96%|█████████▋| 357766/371472 [6:18:41<1:02:58,  3.63it/s]
 96%|█████████▋| 357767/371472 [6:18:42<1:02:27,  3.66it/s]
 96%|█████████▋| 357768/371472 [6:18:42<1:05:41,  3.48it/s]
 96%|█████████▋| 357769/371472 [6:18:42<1:10:50,  3.22it/s]
 96%|█████████▋| 357770/371472 [6:18:43<1:07:45,  3.37it/s]
 96%|█████████▋| 357771/371472 [6:18:43<1:06:56,  3.41it/s]
 96%|█████████▋| 357772/371472 [6:18:43<1:04:50,  3.52it/s]
 96%|█████████▋| 357773/371472 [6:18:43<1:03:14,  3.61it/s]
 96%|█████████▋| 357774/371472 [6:18:44<1:04:44,  3.53it/s]
 96%|█████████▋| 357775/371472 [6:18:44<1:05:06,  3.51it/s]
 96%|█████████▋| 357776/371472 [6:18:44<1:01:43,  3.70it/s]
 96%|█████████▋| 357777/371472 [6:18:45<1:01:21,  3.72it/s]
 96%|█████████▋| 357778/371472 [6:18:45<1:00:24,  3.78it/s]
 96%|█████████▋| 357779/371472 [6:18:45<1:00:37,  3.76it/s]
 96%|█████████▋| 357780/371472 [6:18:45<1:01:24,  3.72it/s]
                                                           
{'loss': 2.5587, 'learning_rate': 1.33190760412851e-07, 'epoch': 15.41}

 96%|█████████▋| 357780/371472 [6:18:45<1:01:24,  3.72it/s]
 96%|█████████▋| 357781/371472 [6:18:46<1:00:46,  3.75it/s]
 96%|█████████▋| 357782/371472 [6:18:46<59:48,  3.82it/s]  
 96%|█████████▋| 357783/371472 [6:18:46<1:05:03,  3.51it/s]
 96%|█████████▋| 357784/371472 [6:18:46<1:03:33,  3.59it/s]
 96%|█████████▋| 357785/371472 [6:18:47<1:01:38,  3.70it/s]
 96%|█████████▋| 357786/371472 [6:18:47<1:03:02,  3.62it/s]
 96%|█████████▋| 357787/371472 [6:18:47<1:08:13,  3.34it/s]
 96%|█████████▋| 357788/371472 [6:18:48<1:05:04,  3.50it/s]
 96%|█████████▋| 357789/371472 [6:18:48<1:02:37,  3.64it/s]
 96%|█████████▋| 357790/371472 [6:18:48<1:02:52,  3.63it/s]
 96%|█████████▋| 357791/371472 [6:18:48<1:03:46,  3.58it/s]
 96%|█████████▋| 357792/371472 [6:18:49<1:02:14,  3.66it/s]
 96%|█████████▋| 357793/371472 [6:18:49<1:00:25,  3.77it/s]
 96%|█████████▋| 357794/371472 [6:18:49<1:04:16,  3.55it/s]
 96%|█████████▋| 357795/371472 [6:18:49<1:04:13,  3.55it/s]
 96%|█████████▋| 357796/371472 [6:18:50<1:05:49,  3.46it/s]
 96%|█████████▋| 357797/371472 [6:18:50<1:03:41,  3.58it/s]
 96%|█████████▋| 357798/371472 [6:18:50<1:01:15,  3.72it/s]
 96%|█████████▋| 357799/371472 [6:18:51<1:00:57,  3.74it/s]
 96%|█████████▋| 357800/371472 [6:18:51<1:03:23,  3.60it/s]
                                                           
{'loss': 2.7785, 'learning_rate': 1.3314227843737204e-07, 'epoch': 15.41}

 96%|█████████▋| 357800/371472 [6:18:51<1:03:23,  3.60it/s]
 96%|█████████▋| 357801/371472 [6:18:51<1:09:34,  3.28it/s]
 96%|█████████▋| 357802/371472 [6:18:51<1:05:25,  3.48it/s]
 96%|█████████▋| 357803/371472 [6:18:52<1:02:10,  3.66it/s]
 96%|█████████▋| 357804/371472 [6:18:52<1:02:55,  3.62it/s]
 96%|█████████▋| 357805/371472 [6:18:52<1:02:28,  3.65it/s]
 96%|█████████▋| 357806/371472 [6:18:53<1:05:25,  3.48it/s]
 96%|█████████▋| 357807/371472 [6:18:53<1:06:08,  3.44it/s]
 96%|█████████▋| 357808/371472 [6:18:53<1:05:57,  3.45it/s]
 96%|█████████▋| 357809/371472 [6:18:53<1:04:18,  3.54it/s]
 96%|█████████▋| 357810/371472 [6:18:54<1:04:00,  3.56it/s]
 96%|█████████▋| 357811/371472 [6:18:54<1:02:31,  3.64it/s]
 96%|█████████▋| 357812/371472 [6:18:54<1:03:33,  3.58it/s]
 96%|█████████▋| 357813/371472 [6:18:55<1:01:02,  3.73it/s]
 96%|█████████▋| 357814/371472 [6:18:55<1:01:38,  3.69it/s]
 96%|█████████▋| 357815/371472 [6:18:55<1:00:43,  3.75it/s]
 96%|█████████▋| 357816/371472 [6:18:55<1:01:35,  3.69it/s]
 96%|█████████▋| 357817/371472 [6:18:56<1:00:47,  3.74it/s]
 96%|█████████▋| 357818/371472 [6:18:56<1:00:06,  3.79it/s]
 96%|█████████▋| 357819/371472 [6:18:56<1:03:17,  3.60it/s]
 96%|█████████▋| 357820/371472 [6:18:56<1:02:05,  3.66it/s]
                                                           
{'loss': 2.7721, 'learning_rate': 1.330937964618932e-07, 'epoch': 15.41}

 96%|█████████▋| 357820/371472 [6:18:56<1:02:05,  3.66it/s]
 96%|█████████▋| 357821/371472 [6:18:57<1:11:36,  3.18it/s]
 96%|█████████▋| 357822/371472 [6:18:57<1:09:27,  3.28it/s]
 96%|█████████▋| 357823/371472 [6:18:57<1:06:30,  3.42it/s]
 96%|█████████▋| 357824/371472 [6:18:58<1:07:38,  3.36it/s]
 96%|█████████▋| 357825/371472 [6:18:58<1:08:57,  3.30it/s]
 96%|█████████▋| 357826/371472 [6:18:58<1:05:21,  3.48it/s]
 96%|█████████▋| 357827/371472 [6:18:59<1:03:24,  3.59it/s]
 96%|█████████▋| 357828/371472 [6:18:59<1:02:46,  3.62it/s]
 96%|█████████▋| 357829/371472 [6:18:59<1:00:44,  3.74it/s]
 96%|█████████▋| 357830/371472 [6:18:59<1:05:13,  3.49it/s]
 96%|█████████▋| 357831/371472 [6:19:00<1:04:56,  3.50it/s]
 96%|█████████▋| 357832/371472 [6:19:00<1:04:36,  3.52it/s]
 96%|█████████▋| 357833/371472 [6:19:00<1:02:48,  3.62it/s]
 96%|█████████▋| 357834/371472 [6:19:00<1:05:20,  3.48it/s]
 96%|█████████▋| 357835/371472 [6:19:01<1:02:07,  3.66it/s]
 96%|█████████▋| 357836/371472 [6:19:01<59:09,  3.84it/s]  
 96%|█████████▋| 357837/371472 [6:19:01<58:41,  3.87it/s]
 96%|█████████▋| 357838/371472 [6:19:02<1:05:32,  3.47it/s]
 96%|█████████▋| 357839/371472 [6:19:02<1:03:40,  3.57it/s]
 96%|█████████▋| 357840/371472 [6:19:02<1:02:53,  3.61it/s]
                                                           
{'loss': 2.545, 'learning_rate': 1.3304531448641427e-07, 'epoch': 15.41}

 96%|█████████▋| 357840/371472 [6:19:02<1:02:53,  3.61it/s]
 96%|█████████▋| 357841/371472 [6:19:02<1:00:28,  3.76it/s]
 96%|█████████▋| 357842/371472 [6:19:03<1:00:53,  3.73it/s]
 96%|█████████▋| 357843/371472 [6:19:03<58:46,  3.86it/s]  
 96%|█████████▋| 357844/371472 [6:19:03<59:14,  3.83it/s]
 96%|█████████▋| 357845/371472 [6:19:03<59:04,  3.84it/s]
 96%|█████████▋| 357846/371472 [6:19:04<59:59,  3.79it/s]
 96%|█████████▋| 357847/371472 [6:19:04<1:03:21,  3.58it/s]
 96%|█████████▋| 357848/371472 [6:19:04<1:03:51,  3.56it/s]
 96%|█████████▋| 357849/371472 [6:19:04<1:00:56,  3.73it/s]
 96%|█████████▋| 357850/371472 [6:19:05<1:08:28,  3.32it/s]
 96%|█████████▋| 357851/371472 [6:19:05<1:07:43,  3.35it/s]
 96%|█████████▋| 357852/371472 [6:19:05<1:06:14,  3.43it/s]
 96%|█████████▋| 357853/371472 [6:19:06<1:11:05,  3.19it/s]
 96%|█████████▋| 357854/371472 [6:19:06<1:09:31,  3.26it/s]
 96%|█████████▋| 357855/371472 [6:19:06<1:10:53,  3.20it/s]
 96%|█████████▋| 357856/371472 [6:19:07<1:07:16,  3.37it/s]
 96%|█████████▋| 357857/371472 [6:19:07<1:08:34,  3.31it/s]
 96%|█████████▋| 357858/371472 [6:19:07<1:05:34,  3.46it/s]
 96%|█████████▋| 357859/371472 [6:19:08<1:04:23,  3.52it/s]
 96%|█████████▋| 357860/371472 [6:19:08<1:04:48,  3.50it/s]
                                                           
{'loss': 2.7441, 'learning_rate': 1.3299683251093542e-07, 'epoch': 15.41}

 96%|█████████▋| 357860/371472 [6:19:08<1:04:48,  3.50it/s]
 96%|█████████▋| 357861/371472 [6:19:08<1:03:47,  3.56it/s]
 96%|█████████▋| 357862/371472 [6:19:08<1:01:31,  3.69it/s]
 96%|█████████▋| 357863/371472 [6:19:09<1:03:55,  3.55it/s]
 96%|█████████▋| 357864/371472 [6:19:09<1:04:27,  3.52it/s]
 96%|█████████▋| 357865/371472 [6:19:09<1:02:28,  3.63it/s]
 96%|█████████▋| 357866/371472 [6:19:09<1:00:27,  3.75it/s]
 96%|█████████▋| 357867/371472 [6:19:10<1:01:09,  3.71it/s]
 96%|█████████▋| 357868/371472 [6:19:10<1:01:11,  3.71it/s]
 96%|█████████▋| 357869/371472 [6:19:10<1:01:51,  3.67it/s]
 96%|█████████▋| 357870/371472 [6:19:11<1:03:47,  3.55it/s]
 96%|█████████▋| 357871/371472 [6:19:11<1:01:51,  3.66it/s]
 96%|█████████▋| 357872/371472 [6:19:11<1:01:53,  3.66it/s]
 96%|█████████▋| 357873/371472 [6:19:11<1:04:25,  3.52it/s]
 96%|█████████▋| 357874/371472 [6:19:12<1:01:39,  3.68it/s]
 96%|█████████▋| 357875/371472 [6:19:12<1:01:49,  3.67it/s]
 96%|█████████▋| 357876/371472 [6:19:12<59:08,  3.83it/s]  
 96%|█████████▋| 357877/371472 [6:19:12<57:44,  3.92it/s]
 96%|█████████▋| 357878/371472 [6:19:13<58:39,  3.86it/s]
 96%|█████████▋| 357879/371472 [6:19:13<57:49,  3.92it/s]
 96%|█████████▋| 357880/371472 [6:19:13<59:51,  3.78it/s]
                                                         
{'loss': 2.5583, 'learning_rate': 1.3294835053545646e-07, 'epoch': 15.41}

 96%|█████████▋| 357880/371472 [6:19:13<59:51,  3.78it/s]
 96%|█████████▋| 357881/371472 [6:19:13<1:00:46,  3.73it/s]
 96%|█████████▋| 357882/371472 [6:19:14<1:03:03,  3.59it/s]
 96%|█████████▋| 357883/371472 [6:19:14<1:01:21,  3.69it/s]
 96%|█████████▋| 357884/371472 [6:19:14<1:00:44,  3.73it/s]
 96%|█████████▋| 357885/371472 [6:19:15<1:02:12,  3.64it/s]
 96%|█████████▋| 357886/371472 [6:19:15<1:01:56,  3.66it/s]
 96%|█████████▋| 357887/371472 [6:19:15<1:01:53,  3.66it/s]
 96%|█████████▋| 357888/371472 [6:19:15<1:01:38,  3.67it/s]
 96%|█████████▋| 357889/371472 [6:19:16<1:00:48,  3.72it/s]
 96%|█████████▋| 357890/371472 [6:19:16<1:01:35,  3.67it/s]
 96%|█████████▋| 357891/371472 [6:19:16<1:07:10,  3.37it/s]
 96%|█████████▋| 357892/371472 [6:19:17<1:05:41,  3.45it/s]
 96%|█████████▋| 357893/371472 [6:19:17<1:04:47,  3.49it/s]
 96%|█████████▋| 357894/371472 [6:19:17<1:04:47,  3.49it/s]
 96%|█████████▋| 357895/371472 [6:19:17<1:09:13,  3.27it/s]
 96%|█████████▋| 357896/371472 [6:19:18<1:06:26,  3.41it/s]
 96%|█████████▋| 357897/371472 [6:19:18<1:04:50,  3.49it/s]
 96%|█████████▋| 357898/371472 [6:19:18<1:07:11,  3.37it/s]
 96%|█████████▋| 357899/371472 [6:19:19<1:09:10,  3.27it/s]
 96%|█████████▋| 357900/371472 [6:19:19<1:06:21,  3.41it/s]
                                                           
{'loss': 2.5272, 'learning_rate': 1.3289986855997753e-07, 'epoch': 15.42}

 96%|█████████▋| 357900/371472 [6:19:19<1:06:21,  3.41it/s]
 96%|█████████▋| 357901/371472 [6:19:19<1:05:44,  3.44it/s]
 96%|█████████▋| 357902/371472 [6:19:19<1:02:11,  3.64it/s]
 96%|█████████▋| 357903/371472 [6:19:20<1:03:44,  3.55it/s]
 96%|█████████▋| 357904/371472 [6:19:20<1:02:23,  3.62it/s]
 96%|█████████▋| 357905/371472 [6:19:20<1:03:24,  3.57it/s]
 96%|█████████▋| 357906/371472 [6:19:21<1:02:29,  3.62it/s]
 96%|█████████▋| 357907/371472 [6:19:21<1:01:46,  3.66it/s]
 96%|█████████▋| 357908/371472 [6:19:21<1:04:02,  3.53it/s]
 96%|█████████▋| 357909/371472 [6:19:21<1:01:35,  3.67it/s]
 96%|█████████▋| 357910/371472 [6:19:22<1:00:38,  3.73it/s]
 96%|█████████▋| 357911/371472 [6:19:22<1:01:06,  3.70it/s]
 96%|█████████▋| 357912/371472 [6:19:22<1:01:00,  3.70it/s]
 96%|█████████▋| 357913/371472 [6:19:22<1:01:52,  3.65it/s]
 96%|█████████▋| 357914/371472 [6:19:23<1:03:31,  3.56it/s]
 96%|█████████▋| 357915/371472 [6:19:23<1:16:18,  2.96it/s]
 96%|█████████▋| 357916/371472 [6:19:24<1:11:23,  3.16it/s]
 96%|█████████▋| 357917/371472 [6:19:24<1:07:40,  3.34it/s]
 96%|█████████▋| 357918/371472 [6:19:24<1:04:11,  3.52it/s]
 96%|█████████▋| 357919/371472 [6:19:24<1:04:40,  3.49it/s]
 96%|█████████▋| 357920/371472 [6:19:25<1:09:05,  3.27it/s]
                                                           
{'loss': 2.5949, 'learning_rate': 1.3285138658449869e-07, 'epoch': 15.42}

 96%|█████████▋| 357920/371472 [6:19:25<1:09:05,  3.27it/s]
 96%|█████████▋| 357921/371472 [6:19:25<1:06:25,  3.40it/s]
 96%|█████████▋| 357922/371472 [6:19:25<1:02:49,  3.59it/s]
 96%|█████████▋| 357923/371472 [6:19:25<1:03:06,  3.58it/s]
 96%|█████████▋| 357924/371472 [6:19:26<1:06:34,  3.39it/s]
 96%|█████████▋| 357925/371472 [6:19:26<1:12:22,  3.12it/s]
 96%|█████████▋| 357926/371472 [6:19:26<1:11:48,  3.14it/s]
 96%|█████████▋| 357927/371472 [6:19:27<1:18:25,  2.88it/s]
 96%|█████████▋| 357928/371472 [6:19:27<1:13:00,  3.09it/s]
 96%|█████████▋| 357929/371472 [6:19:27<1:11:04,  3.18it/s]
 96%|█████████▋| 357930/371472 [6:19:28<1:07:29,  3.34it/s]
 96%|█████████▋| 357931/371472 [6:19:28<1:07:24,  3.35it/s]
 96%|█████████▋| 357932/371472 [6:19:28<1:05:44,  3.43it/s]
 96%|█████████▋| 357933/371472 [6:19:29<1:04:47,  3.48it/s]
 96%|█████████▋| 357934/371472 [6:19:29<1:02:44,  3.60it/s]
 96%|█████████▋| 357935/371472 [6:19:29<1:04:32,  3.50it/s]
 96%|█████████▋| 357936/371472 [6:19:29<1:00:41,  3.72it/s]
 96%|█████████▋| 357937/371472 [6:19:30<1:01:29,  3.67it/s]
 96%|█████████▋| 357938/371472 [6:19:30<58:18,  3.87it/s]  
 96%|█████████▋| 357939/371472 [6:19:30<58:04,  3.88it/s]
 96%|█████████▋| 357940/371472 [6:19:30<1:04:06,  3.52it/s]
                                                           
{'loss': 2.5335, 'learning_rate': 1.3280290460901976e-07, 'epoch': 15.42}

 96%|█████████▋| 357940/371472 [6:19:30<1:04:06,  3.52it/s]
 96%|█████████▋| 357941/371472 [6:19:31<1:01:49,  3.65it/s]
 96%|█████████▋| 357942/371472 [6:19:31<1:00:36,  3.72it/s]
 96%|█████████▋| 357943/371472 [6:19:31<1:00:51,  3.71it/s]
 96%|█████████▋| 357944/371472 [6:19:32<1:00:41,  3.72it/s]
 96%|█████████▋| 357945/371472 [6:19:32<59:58,  3.76it/s]  
 96%|█████████▋| 357946/371472 [6:19:32<59:28,  3.79it/s]
 96%|█████████▋| 357947/371472 [6:19:32<58:53,  3.83it/s]
 96%|█████████▋| 357948/371472 [6:19:33<59:35,  3.78it/s]
 96%|█████████▋| 357949/371472 [6:19:33<1:03:58,  3.52it/s]
 96%|█████████▋| 357950/371472 [6:19:33<1:01:43,  3.65it/s]
 96%|█████████▋| 357951/371472 [6:19:33<1:01:44,  3.65it/s]
 96%|█████████▋| 357952/371472 [6:19:34<1:02:58,  3.58it/s]
 96%|█████████▋| 357953/371472 [6:19:34<1:05:58,  3.42it/s]
 96%|█████████▋| 357954/371472 [6:19:34<1:11:06,  3.17it/s]
 96%|█████████▋| 357955/371472 [6:19:35<1:06:12,  3.40it/s]
 96%|█████████▋| 357956/371472 [6:19:35<1:07:05,  3.36it/s]
 96%|█████████▋| 357957/371472 [6:19:35<1:06:25,  3.39it/s]
 96%|█████████▋| 357958/371472 [6:19:35<1:04:13,  3.51it/s]
 96%|█████████▋| 357959/371472 [6:19:36<1:05:12,  3.45it/s]
 96%|█████████▋| 357960/371472 [6:19:36<1:08:48,  3.27it/s]
                                                           
{'loss': 2.5555, 'learning_rate': 1.327544226335409e-07, 'epoch': 15.42}

 96%|█████████▋| 357960/371472 [6:19:36<1:08:48,  3.27it/s]
 96%|█████████▋| 357961/371472 [6:19:36<1:05:54,  3.42it/s]
 96%|█████████▋| 357962/371472 [6:19:37<1:09:47,  3.23it/s]
 96%|█████████▋| 357963/371472 [6:19:37<1:07:02,  3.36it/s]
 96%|█████████▋| 357964/371472 [6:19:37<1:05:23,  3.44it/s]
 96%|█████████▋| 357965/371472 [6:19:38<1:03:54,  3.52it/s]
 96%|█████████▋| 357966/371472 [6:19:38<1:02:17,  3.61it/s]
 96%|█████████▋| 357967/371472 [6:19:38<1:01:59,  3.63it/s]
 96%|█████████▋| 357968/371472 [6:19:38<1:00:46,  3.70it/s]
 96%|█████████▋| 357969/371472 [6:19:39<1:04:41,  3.48it/s]
 96%|█████████▋| 357970/371472 [6:19:39<1:03:38,  3.54it/s]
 96%|█████████▋| 357971/371472 [6:19:39<1:02:57,  3.57it/s]
 96%|█████████▋| 357972/371472 [6:19:39<1:02:07,  3.62it/s]
 96%|█████████▋| 357973/371472 [6:19:40<1:02:14,  3.61it/s]
 96%|█████████▋| 357974/371472 [6:19:40<1:01:48,  3.64it/s]
 96%|█████████▋| 357975/371472 [6:19:40<1:00:58,  3.69it/s]
 96%|█████████▋| 357976/371472 [6:19:41<1:00:58,  3.69it/s]
 96%|█████████▋| 357977/371472 [6:19:41<1:00:11,  3.74it/s]
 96%|█████████▋| 357978/371472 [6:19:41<1:03:01,  3.57it/s]
 96%|█████████▋| 357979/371472 [6:19:41<1:03:26,  3.54it/s]
 96%|█████████▋| 357980/371472 [6:19:42<1:02:40,  3.59it/s]
                                                           
{'loss': 2.5573, 'learning_rate': 1.3270594065806198e-07, 'epoch': 15.42}

 96%|█████████▋| 357980/371472 [6:19:42<1:02:40,  3.59it/s]
 96%|█████████▋| 357981/371472 [6:19:42<1:01:22,  3.66it/s]
 96%|█████████▋| 357982/371472 [6:19:42<1:04:03,  3.51it/s]
 96%|█████████▋| 357983/371472 [6:19:43<1:08:47,  3.27it/s]
 96%|█████████▋| 357984/371472 [6:19:43<1:05:38,  3.42it/s]
 96%|█████████▋| 357985/371472 [6:19:43<1:03:41,  3.53it/s]
 96%|█████████▋| 357986/371472 [6:19:43<1:02:06,  3.62it/s]
 96%|█████████▋| 357987/371472 [6:19:44<1:06:08,  3.40it/s]
 96%|█████████▋| 357988/371472 [6:19:44<1:06:58,  3.36it/s]
 96%|█████████▋| 357989/371472 [6:19:44<1:09:47,  3.22it/s]
 96%|█████████▋| 357990/371472 [6:19:45<1:04:16,  3.50it/s]
 96%|█████████▋| 357991/371472 [6:19:45<1:03:31,  3.54it/s]
 96%|█████████▋| 357992/371472 [6:19:45<1:01:38,  3.64it/s]
 96%|█████████▋| 357993/371472 [6:19:45<59:43,  3.76it/s]  
 96%|█████████▋| 357994/371472 [6:19:46<1:01:46,  3.64it/s]
 96%|█████████▋| 357995/371472 [6:19:46<1:00:38,  3.70it/s]
 96%|█████████▋| 357996/371472 [6:19:46<1:02:56,  3.57it/s]
 96%|█████████▋| 357997/371472 [6:19:47<1:01:42,  3.64it/s]
 96%|█████████▋| 357998/371472 [6:19:47<1:04:45,  3.47it/s]
 96%|█████████▋| 357999/371472 [6:19:47<1:05:20,  3.44it/s]
 96%|█████████▋| 358000/371472 [6:19:47<1:03:28,  3.54it/s]
                                                           
{'loss': 2.3475, 'learning_rate': 1.3265745868258313e-07, 'epoch': 15.42}

 96%|█████████▋| 358000/371472 [6:19:47<1:03:28,  3.54it/s]
 96%|█████████▋| 358001/371472 [6:19:48<1:06:44,  3.36it/s]
 96%|█████████▋| 358002/371472 [6:19:48<1:07:19,  3.33it/s]
 96%|█████████▋| 358003/371472 [6:19:48<1:04:50,  3.46it/s]
 96%|█████████▋| 358004/371472 [6:19:49<1:03:24,  3.54it/s]
 96%|█████████▋| 358005/371472 [6:19:49<1:02:24,  3.60it/s]
 96%|█████████▋| 358006/371472 [6:19:49<1:03:51,  3.51it/s]
 96%|█████████▋| 358007/371472 [6:19:49<1:02:17,  3.60it/s]
 96%|█████████▋| 358008/371472 [6:19:50<1:01:54,  3.62it/s]
 96%|█████████▋| 358009/371472 [6:19:50<1:01:10,  3.67it/s]
 96%|█████████▋| 358010/371472 [6:19:50<1:02:42,  3.58it/s]
 96%|█████████▋| 358011/371472 [6:19:51<1:03:31,  3.53it/s]
 96%|█████████▋| 358012/371472 [6:19:51<1:05:31,  3.42it/s]
 96%|█████████▋| 358013/371472 [6:19:51<1:02:59,  3.56it/s]
 96%|█████████▋| 358014/371472 [6:19:51<1:01:17,  3.66it/s]
 96%|█████████▋| 358015/371472 [6:19:52<1:00:49,  3.69it/s]
 96%|█████████▋| 358016/371472 [6:19:52<59:44,  3.75it/s]  
 96%|█████████▋| 358017/371472 [6:19:52<1:01:10,  3.67it/s]
 96%|█████████▋| 358018/371472 [6:19:52<1:00:40,  3.70it/s]
 96%|█████████▋| 358019/371472 [6:19:53<1:00:17,  3.72it/s]
 96%|█████████▋| 358020/371472 [6:19:53<58:47,  3.81it/s]  
                                                         
{'loss': 2.6319, 'learning_rate': 1.3260897670710418e-07, 'epoch': 15.42}

 96%|█████████▋| 358020/371472 [6:19:53<58:47,  3.81it/s]
 96%|█████████▋| 358021/371472 [6:19:53<58:41,  3.82it/s]
 96%|█████████▋| 358022/371472 [6:19:54<1:04:03,  3.50it/s]
 96%|█████████▋| 358023/371472 [6:19:54<1:19:28,  2.82it/s]
 96%|█████████▋| 358024/371472 [6:19:54<1:13:56,  3.03it/s]
 96%|█████████▋| 358025/371472 [6:19:55<1:13:22,  3.05it/s]
 96%|█████████▋| 358026/371472 [6:19:55<1:11:53,  3.12it/s]
 96%|█████████▋| 358027/371472 [6:19:55<1:18:09,  2.87it/s]
 96%|█████████▋| 358028/371472 [6:19:56<1:13:12,  3.06it/s]
 96%|█████████▋| 358029/371472 [6:19:56<1:09:16,  3.23it/s]
 96%|█████████▋| 358030/371472 [6:19:56<1:11:52,  3.12it/s]
 96%|█████████▋| 358031/371472 [6:19:57<1:07:35,  3.31it/s]
 96%|█████████▋| 358032/371472 [6:19:57<1:05:09,  3.44it/s]
 96%|█████████▋| 358033/371472 [6:19:57<1:07:19,  3.33it/s]
 96%|█████████▋| 358034/371472 [6:19:57<1:08:16,  3.28it/s]
 96%|█████████▋| 358035/371472 [6:19:58<1:05:08,  3.44it/s]
 96%|█████████▋| 358036/371472 [6:19:58<1:07:07,  3.34it/s]
 96%|█████████▋| 358037/371472 [6:19:58<1:14:28,  3.01it/s]
 96%|█████████▋| 358038/371472 [6:19:59<1:11:11,  3.15it/s]
 96%|█████████▋| 358039/371472 [6:19:59<1:09:01,  3.24it/s]
 96%|█████████▋| 358040/371472 [6:19:59<1:06:08,  3.38it/s]
                                                           
{'loss': 2.467, 'learning_rate': 1.3256049473162538e-07, 'epoch': 15.42}

 96%|█████████▋| 358040/371472 [6:19:59<1:06:08,  3.38it/s]
 96%|█████████▋| 358041/371472 [6:19:59<1:03:54,  3.50it/s]
 96%|█████████▋| 358042/371472 [6:20:00<1:07:09,  3.33it/s]
 96%|█████████▋| 358043/371472 [6:20:00<1:04:28,  3.47it/s]
 96%|█████████▋| 358044/371472 [6:20:00<1:08:34,  3.26it/s]
 96%|█████████▋| 358045/371472 [6:20:01<1:03:35,  3.52it/s]
 96%|█████████▋| 358046/371472 [6:20:01<1:02:30,  3.58it/s]
 96%|█████████▋| 358047/371472 [6:20:01<1:03:17,  3.54it/s]
 96%|█████████▋| 358048/371472 [6:20:01<1:00:30,  3.70it/s]
 96%|█████████▋| 358049/371472 [6:20:02<1:00:57,  3.67it/s]
 96%|█████████▋| 358050/371472 [6:20:02<59:25,  3.76it/s]  
 96%|█████████▋| 358051/371472 [6:20:02<59:25,  3.76it/s]
 96%|█████████▋| 358052/371472 [6:20:03<58:29,  3.82it/s]
 96%|█████████▋| 358053/371472 [6:20:03<56:58,  3.92it/s]
 96%|█████████▋| 358054/371472 [6:20:03<57:49,  3.87it/s]
 96%|█████████▋| 358055/371472 [6:20:03<1:00:43,  3.68it/s]
 96%|█████████▋| 358056/371472 [6:20:04<59:23,  3.76it/s]  
 96%|█████████▋| 358057/371472 [6:20:04<59:15,  3.77it/s]
 96%|█████████▋| 358058/371472 [6:20:04<1:00:06,  3.72it/s]
 96%|█████████▋| 358059/371472 [6:20:04<1:03:40,  3.51it/s]
 96%|█████████▋| 358060/371472 [6:20:05<1:03:30,  3.52it/s]
                                                           
{'loss': 2.4972, 'learning_rate': 1.325120127561464e-07, 'epoch': 15.42}

 96%|█████████▋| 358060/371472 [6:20:05<1:03:30,  3.52it/s]
 96%|█████████▋| 358061/371472 [6:20:05<1:01:46,  3.62it/s]
 96%|█████████▋| 358062/371472 [6:20:05<59:35,  3.75it/s]  
 96%|█████████▋| 358063/371472 [6:20:05<59:56,  3.73it/s]
 96%|█████████▋| 358064/371472 [6:20:06<1:00:36,  3.69it/s]
 96%|█████████▋| 358065/371472 [6:20:06<1:02:35,  3.57it/s]
 96%|█████████▋| 358066/371472 [6:20:06<1:00:21,  3.70it/s]
 96%|█████████▋| 358067/371472 [6:20:07<1:00:46,  3.68it/s]
 96%|█████████▋| 358068/371472 [6:20:07<59:40,  3.74it/s]  
 96%|█████████▋| 358069/371472 [6:20:07<59:00,  3.79it/s]
 96%|█████████▋| 358070/371472 [6:20:07<58:38,  3.81it/s]
 96%|█████████▋| 358071/371472 [6:20:08<56:43,  3.94it/s]
 96%|█████████▋| 358072/371472 [6:20:08<58:42,  3.80it/s]
 96%|█████████▋| 358073/371472 [6:20:08<57:55,  3.86it/s]
 96%|█████████▋| 358074/371472 [6:20:08<58:20,  3.83it/s]
 96%|█████████▋| 358075/371472 [6:20:09<1:04:16,  3.47it/s]
 96%|█████████▋| 358076/371472 [6:20:09<1:03:48,  3.50it/s]
 96%|█████████▋| 358077/371472 [6:20:09<1:04:24,  3.47it/s]
 96%|█████████▋| 358078/371472 [6:20:10<1:01:17,  3.64it/s]
 96%|█████████▋| 358079/371472 [6:20:10<1:02:23,  3.58it/s]
 96%|█████████▋| 358080/371472 [6:20:10<1:05:12,  3.42it/s]
                                                           
{'loss': 2.5584, 'learning_rate': 1.3246353078066755e-07, 'epoch': 15.42}

 96%|█████████▋| 358080/371472 [6:20:10<1:05:12,  3.42it/s]
 96%|█████████▋| 358081/371472 [6:20:10<1:01:33,  3.63it/s]
 96%|█████████▋| 358082/371472 [6:20:11<1:01:53,  3.61it/s]
 96%|█████████▋| 358083/371472 [6:20:11<1:02:51,  3.55it/s]
 96%|█████████▋| 358084/371472 [6:20:11<1:02:09,  3.59it/s]
 96%|█████████▋| 358085/371472 [6:20:12<1:00:22,  3.70it/s]
 96%|█████████▋| 358086/371472 [6:20:12<59:54,  3.72it/s]  
 96%|█████████▋| 358087/371472 [6:20:12<59:38,  3.74it/s]
 96%|█████████▋| 358088/371472 [6:20:12<58:42,  3.80it/s]
 96%|█████████▋| 358089/371472 [6:20:13<58:29,  3.81it/s]
 96%|█████████▋| 358090/371472 [6:20:13<58:16,  3.83it/s]
 96%|█████████▋| 358091/371472 [6:20:13<58:26,  3.82it/s]
 96%|█████████▋| 358092/371472 [6:20:13<59:00,  3.78it/s]
 96%|█████████▋| 358093/371472 [6:20:14<1:00:18,  3.70it/s]
 96%|█████████▋| 358094/371472 [6:20:14<1:00:16,  3.70it/s]
 96%|█████████▋| 358095/371472 [6:20:14<1:00:17,  3.70it/s]
 96%|█████████▋| 358096/371472 [6:20:14<1:01:48,  3.61it/s]
 96%|█████████▋| 358097/371472 [6:20:15<1:03:39,  3.50it/s]
 96%|█████████▋| 358098/371472 [6:20:15<1:01:26,  3.63it/s]
 96%|█████████▋| 358099/371472 [6:20:15<1:01:37,  3.62it/s]
 96%|█████████▋| 358100/371472 [6:20:16<1:03:01,  3.54it/s]
                                                           
{'loss': 2.6771, 'learning_rate': 1.3241504880518862e-07, 'epoch': 15.42}

 96%|█████████▋| 358100/371472 [6:20:16<1:03:01,  3.54it/s]
 96%|█████████▋| 358101/371472 [6:20:16<1:03:20,  3.52it/s]
 96%|█████████▋| 358102/371472 [6:20:16<1:01:36,  3.62it/s]
 96%|█████████▋| 358103/371472 [6:20:16<59:29,  3.75it/s]  
 96%|█████████▋| 358104/371472 [6:20:17<58:08,  3.83it/s]
 96%|█████████▋| 358105/371472 [6:20:17<59:31,  3.74it/s]
 96%|█████████▋| 358106/371472 [6:20:17<1:01:40,  3.61it/s]
 96%|█████████▋| 358107/371472 [6:20:18<1:06:17,  3.36it/s]
 96%|█████████▋| 358108/371472 [6:20:18<1:06:22,  3.36it/s]
 96%|█████████▋| 358109/371472 [6:20:18<1:04:34,  3.45it/s]
 96%|█████████▋| 358110/371472 [6:20:18<1:03:50,  3.49it/s]
 96%|█████████▋| 358111/371472 [6:20:19<1:01:14,  3.64it/s]
 96%|█████████▋| 358112/371472 [6:20:19<58:43,  3.79it/s]  
 96%|█████████▋| 358113/371472 [6:20:19<1:00:29,  3.68it/s]
 96%|█████████▋| 358114/371472 [6:20:19<59:18,  3.75it/s]  
 96%|█████████▋| 358115/371472 [6:20:20<1:01:58,  3.59it/s]
 96%|█████████▋| 358116/371472 [6:20:20<59:57,  3.71it/s]  
 96%|█████████▋| 358117/371472 [6:20:20<1:02:20,  3.57it/s]
 96%|█████████▋| 358118/371472 [6:20:21<1:01:48,  3.60it/s]
 96%|█████████▋| 358119/371472 [6:20:21<1:00:41,  3.67it/s]
 96%|█████████▋| 358120/371472 [6:20:21<1:02:57,  3.53it/s]
                                                           
{'loss': 2.6383, 'learning_rate': 1.3236656682970977e-07, 'epoch': 15.42}

 96%|█████████▋| 358120/371472 [6:20:21<1:02:57,  3.53it/s]
 96%|█████████▋| 358121/371472 [6:20:21<1:03:33,  3.50it/s]
 96%|█████████▋| 358122/371472 [6:20:22<1:02:30,  3.56it/s]
 96%|█████████▋| 358123/371472 [6:20:22<1:08:23,  3.25it/s]
 96%|█████████▋| 358124/371472 [6:20:22<1:06:11,  3.36it/s]
 96%|█████████▋| 358125/371472 [6:20:23<1:03:24,  3.51it/s]
 96%|█████████▋| 358126/371472 [6:20:23<1:02:37,  3.55it/s]
 96%|█████████▋| 358127/371472 [6:20:23<1:05:04,  3.42it/s]
 96%|█████████▋| 358128/371472 [6:20:23<1:03:21,  3.51it/s]
 96%|█████████▋| 358129/371472 [6:20:24<1:02:39,  3.55it/s]
 96%|█████████▋| 358130/371472 [6:20:24<1:02:07,  3.58it/s]
 96%|█████████▋| 358131/371472 [6:20:24<1:01:06,  3.64it/s]
 96%|█████████▋| 358132/371472 [6:20:25<1:01:37,  3.61it/s]
 96%|█████████▋| 358133/371472 [6:20:25<59:31,  3.74it/s]  
 96%|█████████▋| 358134/371472 [6:20:25<59:33,  3.73it/s]
 96%|█████████▋| 358135/371472 [6:20:25<1:00:48,  3.66it/s]
 96%|█████████▋| 358136/371472 [6:20:26<1:01:19,  3.62it/s]
 96%|█████████▋| 358137/371472 [6:20:26<1:00:35,  3.67it/s]
 96%|█████████▋| 358138/371472 [6:20:26<1:02:58,  3.53it/s]
 96%|█████████▋| 358139/371472 [6:20:26<1:00:41,  3.66it/s]
 96%|█████████▋| 358140/371472 [6:20:27<1:02:24,  3.56it/s]
                                                           
{'loss': 2.8025, 'learning_rate': 1.3231808485423082e-07, 'epoch': 15.43}

 96%|█████████▋| 358140/371472 [6:20:27<1:02:24,  3.56it/s]
 96%|█████████▋| 358141/371472 [6:20:27<1:04:12,  3.46it/s]
 96%|█████████▋| 358142/371472 [6:20:27<1:04:33,  3.44it/s]
 96%|█████████▋| 358143/371472 [6:20:28<1:04:28,  3.45it/s]
 96%|█████████▋| 358144/371472 [6:20:28<1:05:34,  3.39it/s]
 96%|█████████▋| 358145/371472 [6:20:28<1:06:22,  3.35it/s]
 96%|█████████▋| 358146/371472 [6:20:29<1:04:05,  3.47it/s]
 96%|█████████▋| 358147/371472 [6:20:29<1:04:09,  3.46it/s]
 96%|█████████▋| 358148/371472 [6:20:29<1:10:11,  3.16it/s]
 96%|█████████▋| 358149/371472 [6:20:29<1:06:46,  3.33it/s]
 96%|█████████▋| 358150/371472 [6:20:30<1:02:49,  3.53it/s]
 96%|█████████▋| 358151/371472 [6:20:30<1:03:03,  3.52it/s]
 96%|█████████▋| 358152/371472 [6:20:30<1:02:06,  3.57it/s]
 96%|█████████▋| 358153/371472 [6:20:31<1:02:34,  3.55it/s]
 96%|█████████▋| 358154/371472 [6:20:31<1:00:51,  3.65it/s]
 96%|█████████▋| 358155/371472 [6:20:31<1:04:20,  3.45it/s]
 96%|█████████▋| 358156/371472 [6:20:31<1:02:18,  3.56it/s]
 96%|█████████▋| 358157/371472 [6:20:32<1:07:46,  3.27it/s]
 96%|█████████▋| 358158/371472 [6:20:32<1:07:28,  3.29it/s]
 96%|█████████▋| 358159/371472 [6:20:32<1:06:37,  3.33it/s]
 96%|█████████▋| 358160/371472 [6:20:33<1:07:45,  3.27it/s]
                                                           
{'loss': 2.5147, 'learning_rate': 1.32269602878752e-07, 'epoch': 15.43}

 96%|█████████▋| 358160/371472 [6:20:33<1:07:45,  3.27it/s]
 96%|█████████▋| 358161/371472 [6:20:33<1:06:09,  3.35it/s]
 96%|█████████▋| 358162/371472 [6:20:33<1:03:15,  3.51it/s]
 96%|█████████▋| 358163/371472 [6:20:34<1:04:52,  3.42it/s]
 96%|█████████▋| 358164/371472 [6:20:34<1:09:01,  3.21it/s]
 96%|█████████▋| 358165/371472 [6:20:34<1:06:21,  3.34it/s]
 96%|█████████▋| 358166/371472 [6:20:34<1:06:48,  3.32it/s]
 96%|█████████▋| 358167/371472 [6:20:35<1:05:16,  3.40it/s]
 96%|█████████▋| 358168/371472 [6:20:35<1:04:04,  3.46it/s]
 96%|█████████▋| 358169/371472 [6:20:35<1:05:39,  3.38it/s]
 96%|█████████▋| 358170/371472 [6:20:36<1:06:06,  3.35it/s]
 96%|█████████▋| 358171/371472 [6:20:36<1:02:54,  3.52it/s]
 96%|█████████▋| 358172/371472 [6:20:36<1:06:45,  3.32it/s]
 96%|█████████▋| 358173/371472 [6:20:36<1:04:40,  3.43it/s]
 96%|█████████▋| 358174/371472 [6:20:37<1:03:59,  3.46it/s]
 96%|█████████▋| 358175/371472 [6:20:37<1:04:33,  3.43it/s]
 96%|█████████▋| 358176/371472 [6:20:37<1:08:39,  3.23it/s]
 96%|█████████▋| 358177/371472 [6:20:38<1:06:37,  3.33it/s]
 96%|█████████▋| 358178/371472 [6:20:38<1:06:17,  3.34it/s]
 96%|█████████▋| 358179/371472 [6:20:38<1:02:55,  3.52it/s]
 96%|█████████▋| 358180/371472 [6:20:38<1:00:26,  3.67it/s]
                                                           
{'loss': 2.5479, 'learning_rate': 1.3222112090327304e-07, 'epoch': 15.43}

 96%|█████████▋| 358180/371472 [6:20:38<1:00:26,  3.67it/s]
 96%|█████████▋| 358181/371472 [6:20:39<57:46,  3.83it/s]  
 96%|█████████▋| 358182/371472 [6:20:39<57:08,  3.88it/s]
 96%|█████████▋| 358183/371472 [6:20:39<56:24,  3.93it/s]
 96%|█████████▋| 358184/371472 [6:20:40<58:48,  3.77it/s]
 96%|█████████▋| 358185/371472 [6:20:40<59:43,  3.71it/s]
 96%|█████████▋| 358186/371472 [6:20:40<1:00:05,  3.68it/s]
 96%|█████████▋| 358187/371472 [6:20:40<1:00:42,  3.65it/s]
 96%|█████████▋| 358188/371472 [6:20:41<59:22,  3.73it/s]  
 96%|█████████▋| 358189/371472 [6:20:41<59:31,  3.72it/s]
 96%|█████████▋| 358190/371472 [6:20:41<1:02:03,  3.57it/s]
 96%|█████████▋| 358191/371472 [6:20:41<1:01:08,  3.62it/s]
 96%|█████████▋| 358192/371472 [6:20:42<1:01:43,  3.59it/s]
 96%|█████████▋| 358193/371472 [6:20:42<1:00:16,  3.67it/s]
 96%|█████████▋| 358194/371472 [6:20:42<1:02:00,  3.57it/s]
 96%|█████████▋| 358195/371472 [6:20:43<1:00:37,  3.65it/s]
 96%|█████████▋| 358196/371472 [6:20:43<57:59,  3.82it/s]  
 96%|█████████▋| 358197/371472 [6:20:43<1:00:38,  3.65it/s]
 96%|█████████▋| 358198/371472 [6:20:43<1:02:13,  3.56it/s]
 96%|█████████▋| 358199/371472 [6:20:44<1:04:03,  3.45it/s]
 96%|█████████▋| 358200/371472 [6:20:44<1:03:30,  3.48it/s]
                                                           
{'loss': 2.6118, 'learning_rate': 1.321726389277942e-07, 'epoch': 15.43}

 96%|█████████▋| 358200/371472 [6:20:44<1:03:30,  3.48it/s]
 96%|█████████▋| 358201/371472 [6:20:44<1:03:32,  3.48it/s]
 96%|█████████▋| 358202/371472 [6:20:45<1:03:03,  3.51it/s]
 96%|█████████▋| 358203/371472 [6:20:45<1:01:54,  3.57it/s]
 96%|█████████▋| 358204/371472 [6:20:45<1:03:11,  3.50it/s]
 96%|█████████▋| 358205/371472 [6:20:45<1:01:25,  3.60it/s]
 96%|█████████▋| 358206/371472 [6:20:46<1:06:17,  3.34it/s]
 96%|█████████▋| 358207/371472 [6:20:46<1:06:23,  3.33it/s]
 96%|█████████▋| 358208/371472 [6:20:46<1:06:00,  3.35it/s]
 96%|█████████▋| 358209/371472 [6:20:47<1:08:26,  3.23it/s]
 96%|█████████▋| 358210/371472 [6:20:47<1:05:04,  3.40it/s]
 96%|█████████▋| 358211/371472 [6:20:47<1:02:52,  3.52it/s]
 96%|█████████▋| 358212/371472 [6:20:47<1:01:58,  3.57it/s]
 96%|█████████▋| 358213/371472 [6:20:48<1:02:02,  3.56it/s]
 96%|█████████▋| 358214/371472 [6:20:48<59:17,  3.73it/s]  
 96%|█████████▋| 358215/371472 [6:20:48<1:00:49,  3.63it/s]
 96%|█████████▋| 358216/371472 [6:20:49<1:01:09,  3.61it/s]
 96%|█████████▋| 358217/371472 [6:20:49<1:02:42,  3.52it/s]
 96%|█████████▋| 358218/371472 [6:20:49<1:00:40,  3.64it/s]
 96%|█████████▋| 358219/371472 [6:20:49<1:00:05,  3.68it/s]
 96%|█████████▋| 358220/371472 [6:20:50<58:06,  3.80it/s]  
                                                         
{'loss': 2.6103, 'learning_rate': 1.3212415695231526e-07, 'epoch': 15.43}

 96%|█████████▋| 358220/371472 [6:20:50<58:06,  3.80it/s]
 96%|█████████▋| 358221/371472 [6:20:50<1:08:12,  3.24it/s]
 96%|█████████▋| 358222/371472 [6:20:50<1:08:16,  3.23it/s]
 96%|█████████▋| 358223/371472 [6:20:51<1:05:25,  3.37it/s]
 96%|█████████▋| 358224/371472 [6:20:51<1:02:14,  3.55it/s]
 96%|█████████▋| 358225/371472 [6:20:51<1:01:43,  3.58it/s]
 96%|█████████▋| 358226/371472 [6:20:51<1:05:14,  3.38it/s]
 96%|█████████▋| 358227/371472 [6:20:52<1:03:36,  3.47it/s]
 96%|█████████▋| 358228/371472 [6:20:52<1:07:45,  3.26it/s]
 96%|█████████▋| 358229/371472 [6:20:52<1:05:53,  3.35it/s]
 96%|█████████▋| 358230/371472 [6:20:53<1:02:08,  3.55it/s]
 96%|█████████▋| 358231/371472 [6:20:53<1:00:09,  3.67it/s]
 96%|█████████▋| 358232/371472 [6:20:53<59:49,  3.69it/s]  
 96%|█████████▋| 358233/371472 [6:20:53<59:21,  3.72it/s]
 96%|█████████▋| 358234/371472 [6:20:54<58:28,  3.77it/s]
 96%|█████████▋| 358235/371472 [6:20:54<56:12,  3.93it/s]
 96%|█████████▋| 358236/371472 [6:20:54<57:54,  3.81it/s]
 96%|█████████▋| 358237/371472 [6:20:54<57:35,  3.83it/s]
 96%|█████████▋| 358238/371472 [6:20:55<57:24,  3.84it/s]
 96%|█████████▋| 358239/371472 [6:20:55<1:01:18,  3.60it/s]
 96%|█████████▋| 358240/371472 [6:20:55<1:03:09,  3.49it/s]
                                                           
{'loss': 2.7325, 'learning_rate': 1.320756749768364e-07, 'epoch': 15.43}

 96%|█████████▋| 358240/371472 [6:20:55<1:03:09,  3.49it/s]
 96%|█████████▋| 358241/371472 [6:20:56<1:02:59,  3.50it/s]
 96%|█████████▋| 358242/371472 [6:20:56<1:06:29,  3.32it/s]
 96%|█████████▋| 358243/371472 [6:20:56<1:06:10,  3.33it/s]
 96%|█████████▋| 358244/371472 [6:20:56<1:07:06,  3.29it/s]
 96%|█████████▋| 358245/371472 [6:20:57<1:07:38,  3.26it/s]
 96%|█████████▋| 358246/371472 [6:20:57<1:06:03,  3.34it/s]
 96%|█████████▋| 358247/371472 [6:20:57<1:03:36,  3.47it/s]
 96%|█████████▋| 358248/371472 [6:20:58<1:01:03,  3.61it/s]
 96%|█████████▋| 358249/371472 [6:20:58<59:54,  3.68it/s]  
 96%|█████████▋| 358250/371472 [6:20:58<59:35,  3.70it/s]
 96%|█████████▋| 358251/371472 [6:20:58<58:34,  3.76it/s]
 96%|█████████▋| 358252/371472 [6:20:59<57:58,  3.80it/s]
 96%|█████████▋| 358253/371472 [6:20:59<1:00:31,  3.64it/s]
 96%|█████████▋| 358254/371472 [6:20:59<1:00:29,  3.64it/s]
 96%|█████████▋| 358255/371472 [6:21:00<1:03:04,  3.49it/s]
 96%|█████████▋| 358256/371472 [6:21:00<1:01:30,  3.58it/s]
 96%|█████████▋| 358257/371472 [6:21:00<1:04:03,  3.44it/s]
 96%|█████████▋| 358258/371472 [6:21:00<1:01:44,  3.57it/s]
 96%|█████████▋| 358259/371472 [6:21:01<1:09:06,  3.19it/s]
 96%|█████████▋| 358260/371472 [6:21:01<1:07:37,  3.26it/s]
                                                           
{'loss': 2.5245, 'learning_rate': 1.3202719300135746e-07, 'epoch': 15.43}

 96%|█████████▋| 358260/371472 [6:21:01<1:07:37,  3.26it/s]
 96%|█████████▋| 358261/371472 [6:21:01<1:14:50,  2.94it/s]
 96%|█████████▋| 358262/371472 [6:21:02<1:10:19,  3.13it/s]
 96%|█████████▋| 358263/371472 [6:21:02<1:07:50,  3.25it/s]
 96%|█████████▋| 358264/371472 [6:21:02<1:05:11,  3.38it/s]
 96%|█████████▋| 358265/371472 [6:21:03<1:04:19,  3.42it/s]
 96%|█████████▋| 358266/371472 [6:21:03<1:02:01,  3.55it/s]
 96%|█████████▋| 358267/371472 [6:21:03<1:05:08,  3.38it/s]
 96%|█████████▋| 358268/371472 [6:21:03<1:03:14,  3.48it/s]
 96%|█████████▋| 358269/371472 [6:21:04<1:05:28,  3.36it/s]
 96%|█████████▋| 358270/371472 [6:21:04<1:02:43,  3.51it/s]
 96%|█████████▋| 358271/371472 [6:21:04<1:02:37,  3.51it/s]
 96%|█████████▋| 358272/371472 [6:21:05<1:08:29,  3.21it/s]
 96%|█████████▋| 358273/371472 [6:21:05<1:06:35,  3.30it/s]
 96%|█████████▋| 358274/371472 [6:21:05<1:05:48,  3.34it/s]
 96%|█████████▋| 358275/371472 [6:21:06<1:04:19,  3.42it/s]
 96%|█████████▋| 358276/371472 [6:21:06<1:02:34,  3.51it/s]
 96%|█████████▋| 358277/371472 [6:21:06<1:05:03,  3.38it/s]
 96%|█████████▋| 358278/371472 [6:21:06<1:04:51,  3.39it/s]
 96%|█████████▋| 358279/371472 [6:21:07<1:03:34,  3.46it/s]
 96%|█████████▋| 358280/371472 [6:21:07<1:04:25,  3.41it/s]
                                                           
{'loss': 2.7162, 'learning_rate': 1.3197871102587863e-07, 'epoch': 15.43}

 96%|█████████▋| 358280/371472 [6:21:07<1:04:25,  3.41it/s]
 96%|█████████▋| 358281/371472 [6:21:07<1:06:36,  3.30it/s]
 96%|█████████▋| 358282/371472 [6:21:08<1:15:34,  2.91it/s]
 96%|█████████▋| 358283/371472 [6:21:08<1:17:00,  2.85it/s]
 96%|█████████▋| 358284/371472 [6:21:08<1:18:18,  2.81it/s]
 96%|█████████▋| 358285/371472 [6:21:09<1:12:27,  3.03it/s]
 96%|█████████▋| 358286/371472 [6:21:09<1:07:22,  3.26it/s]
 96%|█████████▋| 358287/371472 [6:21:09<1:02:36,  3.51it/s]
 96%|█████████▋| 358288/371472 [6:21:09<1:01:00,  3.60it/s]
 96%|█████████▋| 358289/371472 [6:21:10<59:41,  3.68it/s]  
 96%|█████████▋| 358290/371472 [6:21:10<59:22,  3.70it/s]
 96%|█████████▋| 358291/371472 [6:21:10<58:32,  3.75it/s]
 96%|█████████▋| 358292/371472 [6:21:11<1:04:45,  3.39it/s]
 96%|█████████▋| 358293/371472 [6:21:11<1:02:53,  3.49it/s]
 96%|█████████▋| 358294/371472 [6:21:11<1:01:40,  3.56it/s]
 96%|█████████▋| 358295/371472 [6:21:11<59:58,  3.66it/s]  
 96%|█████████▋| 358296/371472 [6:21:12<1:00:24,  3.64it/s]
 96%|█████████▋| 358297/371472 [6:21:12<1:00:10,  3.65it/s]
 96%|█████████▋| 358298/371472 [6:21:12<59:02,  3.72it/s]  
 96%|█████████▋| 358299/371472 [6:21:13<1:00:12,  3.65it/s]
 96%|█████████▋| 358300/371472 [6:21:13<1:00:05,  3.65it/s]
                                                           
{'loss': 2.6455, 'learning_rate': 1.3193022905039968e-07, 'epoch': 15.43}

 96%|█████████▋| 358300/371472 [6:21:13<1:00:05,  3.65it/s]
 96%|█████████▋| 358301/371472 [6:21:13<59:13,  3.71it/s]  
 96%|█████████▋| 358302/371472 [6:21:13<59:54,  3.66it/s]
 96%|█████████▋| 358303/371472 [6:21:14<58:50,  3.73it/s]
 96%|█████████▋| 358304/371472 [6:21:14<58:24,  3.76it/s]
 96%|█████████▋| 358305/371472 [6:21:14<57:10,  3.84it/s]
 96%|█████████▋| 358306/371472 [6:21:14<56:53,  3.86it/s]
 96%|█████████▋| 358307/371472 [6:21:15<56:07,  3.91it/s]
 96%|█████████▋| 358308/371472 [6:21:15<58:00,  3.78it/s]
 96%|█████████▋| 358309/371472 [6:21:15<59:20,  3.70it/s]
 96%|█████████▋| 358310/371472 [6:21:15<1:00:54,  3.60it/s]
 96%|█████████▋| 358311/371472 [6:21:16<1:00:09,  3.65it/s]
 96%|█████████▋| 358312/371472 [6:21:16<1:02:04,  3.53it/s]
 96%|█████████▋| 358313/371472 [6:21:16<1:02:19,  3.52it/s]
 96%|█████████▋| 358314/371472 [6:21:17<1:00:14,  3.64it/s]
 96%|█████████▋| 358315/371472 [6:21:17<1:00:39,  3.61it/s]
 96%|█████████▋| 358316/371472 [6:21:17<1:04:28,  3.40it/s]
 96%|█████████▋| 358317/371472 [6:21:17<1:01:52,  3.54it/s]
 96%|█████████▋| 358318/371472 [6:21:18<1:00:44,  3.61it/s]
 96%|█████████▋| 358319/371472 [6:21:18<1:03:43,  3.44it/s]
 96%|█████████▋| 358320/371472 [6:21:18<1:04:56,  3.37it/s]
                                                           
{'loss': 2.6967, 'learning_rate': 1.3188174707492083e-07, 'epoch': 15.43}

 96%|█████████▋| 358320/371472 [6:21:18<1:04:56,  3.37it/s]
 96%|█████████▋| 358321/371472 [6:21:19<1:02:05,  3.53it/s]
 96%|█████████▋| 358322/371472 [6:21:19<1:02:48,  3.49it/s]
 96%|█████████▋| 358323/371472 [6:21:19<1:00:39,  3.61it/s]
 96%|█████████▋| 358324/371472 [6:21:19<1:00:13,  3.64it/s]
 96%|█████████▋| 358325/371472 [6:21:20<58:41,  3.73it/s]  
 96%|█████████▋| 358326/371472 [6:21:20<59:04,  3.71it/s]
 96%|█████████▋| 358327/371472 [6:21:20<1:03:33,  3.45it/s]
 96%|█████████▋| 358328/371472 [6:21:21<1:03:23,  3.46it/s]
 96%|█████████▋| 358329/371472 [6:21:21<1:01:51,  3.54it/s]
 96%|█████████▋| 358330/371472 [6:21:21<1:00:21,  3.63it/s]
 96%|█████████▋| 358331/371472 [6:21:21<1:03:53,  3.43it/s]
 96%|█████████▋| 358332/371472 [6:21:22<1:06:24,  3.30it/s]
 96%|█████████▋| 358333/371472 [6:21:22<1:11:22,  3.07it/s]
 96%|█████████▋| 358334/371472 [6:21:22<1:05:57,  3.32it/s]
 96%|█████████▋| 358335/371472 [6:21:23<1:02:32,  3.50it/s]
 96%|█████████▋| 358336/371472 [6:21:23<1:00:49,  3.60it/s]
 96%|█████████▋| 358337/371472 [6:21:23<1:01:19,  3.57it/s]
 96%|█████████▋| 358338/371472 [6:21:23<1:00:25,  3.62it/s]
 96%|█████████▋| 358339/371472 [6:21:24<1:07:26,  3.25it/s]
 96%|█████████▋| 358340/371472 [6:21:24<1:05:34,  3.34it/s]
                                                           
{'loss': 2.4969, 'learning_rate': 1.318332650994419e-07, 'epoch': 15.43}

 96%|█████████▋| 358340/371472 [6:21:24<1:05:34,  3.34it/s]
 96%|█████████▋| 358341/371472 [6:21:24<1:02:32,  3.50it/s]
 96%|█████████▋| 358342/371472 [6:21:25<1:02:05,  3.52it/s]
 96%|█████████▋| 358343/371472 [6:21:25<1:01:55,  3.53it/s]
 96%|█████████▋| 358344/371472 [6:21:25<1:02:11,  3.52it/s]
 96%|█████████▋| 358345/371472 [6:21:25<1:00:32,  3.61it/s]
 96%|█████████▋| 358346/371472 [6:21:26<59:14,  3.69it/s]  
 96%|█████████▋| 358347/371472 [6:21:26<1:03:48,  3.43it/s]
 96%|█████████▋| 358348/371472 [6:21:26<1:02:07,  3.52it/s]
 96%|█████████▋| 358349/371472 [6:21:27<1:06:15,  3.30it/s]
 96%|█████████▋| 358350/371472 [6:21:27<1:07:53,  3.22it/s]
 96%|█████████▋| 358351/371472 [6:21:27<1:04:44,  3.38it/s]
 96%|█████████▋| 358352/371472 [6:21:27<1:00:51,  3.59it/s]
 96%|█████████▋| 358353/371472 [6:21:28<1:07:01,  3.26it/s]
 96%|█████████▋| 358354/371472 [6:21:28<1:04:52,  3.37it/s]
 96%|█████████▋| 358355/371472 [6:21:28<1:04:30,  3.39it/s]
 96%|█████████▋| 358356/371472 [6:21:29<1:03:56,  3.42it/s]
 96%|█████████▋| 358357/371472 [6:21:29<1:03:29,  3.44it/s]
 96%|█████████▋| 358358/371472 [6:21:29<1:02:30,  3.50it/s]
 96%|█████████▋| 358359/371472 [6:21:30<1:03:35,  3.44it/s]
 96%|█████████▋| 358360/371472 [6:21:30<1:05:01,  3.36it/s]
                                                           
{'loss': 2.5631, 'learning_rate': 1.3178478312396305e-07, 'epoch': 15.44}

 96%|█████████▋| 358360/371472 [6:21:30<1:05:01,  3.36it/s]
 96%|█████████▋| 358361/371472 [6:21:30<1:06:09,  3.30it/s]
 96%|█████████▋| 358362/371472 [6:21:30<1:02:59,  3.47it/s]
 96%|█████████▋| 358363/371472 [6:21:31<1:04:47,  3.37it/s]
 96%|█████████▋| 358364/371472 [6:21:31<1:03:32,  3.44it/s]
 96%|█████████▋| 358365/371472 [6:21:31<1:01:49,  3.53it/s]
 96%|█████████▋| 358366/371472 [6:21:32<1:02:08,  3.52it/s]
 96%|█████████▋| 358367/371472 [6:21:32<1:00:56,  3.58it/s]
 96%|█████████▋| 358368/371472 [6:21:32<59:26,  3.67it/s]  
 96%|█████████▋| 358369/371472 [6:21:32<1:02:29,  3.49it/s]
 96%|█████████▋| 358370/371472 [6:21:33<1:01:05,  3.57it/s]
 96%|█████████▋| 358371/371472 [6:21:33<1:02:12,  3.51it/s]
 96%|█████████▋| 358372/371472 [6:21:33<1:03:44,  3.43it/s]
 96%|█████████▋| 358373/371472 [6:21:34<1:01:31,  3.55it/s]
 96%|█████████▋| 358374/371472 [6:21:34<59:46,  3.65it/s]  
 96%|█████████▋| 358375/371472 [6:21:34<1:02:12,  3.51it/s]
 96%|█████████▋| 358376/371472 [6:21:34<1:01:31,  3.55it/s]
 96%|█████████▋| 358377/371472 [6:21:35<59:04,  3.69it/s]  
 96%|█████████▋| 358378/371472 [6:21:35<1:00:02,  3.64it/s]
 96%|█████████▋| 358379/371472 [6:21:35<59:41,  3.66it/s]  
 96%|█████████▋| 358380/371472 [6:21:35<58:37,  3.72it/s]
                                                         
{'loss': 2.3669, 'learning_rate': 1.3173630114848412e-07, 'epoch': 15.44}

 96%|█████████▋| 358380/371472 [6:21:35<58:37,  3.72it/s]
 96%|█████████▋| 358381/371472 [6:21:36<59:51,  3.65it/s]
 96%|█████████▋| 358382/371472 [6:21:36<1:08:57,  3.16it/s]
 96%|█████████▋| 358383/371472 [6:21:36<1:06:20,  3.29it/s]
 96%|█████████▋| 358384/371472 [6:21:37<1:03:09,  3.45it/s]
 96%|█████████▋| 358385/371472 [6:21:37<1:01:11,  3.56it/s]
 96%|█████████▋| 358386/371472 [6:21:37<59:23,  3.67it/s]  
 96%|█████████▋| 358387/371472 [6:21:37<58:28,  3.73it/s]
 96%|█████████▋| 358388/371472 [6:21:38<58:37,  3.72it/s]
 96%|█████████▋| 358389/371472 [6:21:38<1:03:00,  3.46it/s]
 96%|█████████▋| 358390/371472 [6:21:38<1:02:41,  3.48it/s]
 96%|█████████▋| 358391/371472 [6:21:39<1:02:14,  3.50it/s]
 96%|█████████▋| 358392/371472 [6:21:39<1:03:22,  3.44it/s]
 96%|█████████▋| 358393/371472 [6:21:39<1:00:35,  3.60it/s]
 96%|█████████▋| 358394/371472 [6:21:39<1:01:47,  3.53it/s]
 96%|█████████▋| 358395/371472 [6:21:40<1:09:47,  3.12it/s]
 96%|█████████▋| 358396/371472 [6:21:40<1:04:51,  3.36it/s]
 96%|█████████▋| 358397/371472 [6:21:40<1:03:48,  3.42it/s]
 96%|█████████▋| 358398/371472 [6:21:41<1:04:08,  3.40it/s]
 96%|█████████▋| 358399/371472 [6:21:41<1:07:33,  3.23it/s]
 96%|█████████▋| 358400/371472 [6:21:41<1:09:17,  3.14it/s]
                                                           
{'loss': 2.6126, 'learning_rate': 1.3168781917300527e-07, 'epoch': 15.44}

 96%|█████████▋| 358400/371472 [6:21:41<1:09:17,  3.14it/s]
 96%|█████████▋| 358401/371472 [6:21:42<1:05:58,  3.30it/s]
 96%|█████████▋| 358402/371472 [6:21:42<1:03:44,  3.42it/s]
 96%|█████████▋| 358403/371472 [6:21:42<1:04:02,  3.40it/s]
 96%|█████████▋| 358404/371472 [6:21:42<1:00:41,  3.59it/s]
 96%|█████████▋| 358405/371472 [6:21:43<59:59,  3.63it/s]  
 96%|█████████▋| 358406/371472 [6:21:43<1:00:23,  3.61it/s]
 96%|█████████▋| 358407/371472 [6:21:43<59:11,  3.68it/s]  
 96%|█████████▋| 358408/371472 [6:21:44<58:41,  3.71it/s]
 96%|█████████▋| 358409/371472 [6:21:44<56:15,  3.87it/s]
 96%|█████████▋| 358410/371472 [6:21:44<55:32,  3.92it/s]
 96%|█████████▋| 358411/371472 [6:21:44<1:01:02,  3.57it/s]
 96%|█████████▋| 358412/371472 [6:21:45<1:03:02,  3.45it/s]
 96%|█████████▋| 358413/371472 [6:21:45<1:04:29,  3.37it/s]
 96%|█████████▋| 358414/371472 [6:21:45<1:04:08,  3.39it/s]
 96%|█████████▋| 358415/371472 [6:21:46<1:00:14,  3.61it/s]
 96%|█████████▋| 358416/371472 [6:21:46<59:10,  3.68it/s]  
 96%|█████████▋| 358417/371472 [6:21:46<1:01:45,  3.52it/s]
 96%|█████████▋| 358418/371472 [6:21:46<1:01:29,  3.54it/s]
 96%|█████████▋| 358419/371472 [6:21:47<1:01:38,  3.53it/s]
 96%|█████████▋| 358420/371472 [6:21:47<1:00:00,  3.63it/s]
                                                           
{'loss': 2.4964, 'learning_rate': 1.3163933719752635e-07, 'epoch': 15.44}

 96%|█████████▋| 358420/371472 [6:21:47<1:00:00,  3.63it/s]
 96%|█████████▋| 358421/371472 [6:21:47<1:00:28,  3.60it/s]
 96%|█████████▋| 358422/371472 [6:21:48<1:01:44,  3.52it/s]
 96%|█████████▋| 358423/371472 [6:21:48<59:29,  3.66it/s]  
 96%|█████████▋| 358424/371472 [6:21:48<1:00:45,  3.58it/s]
 96%|█████████▋| 358425/371472 [6:21:48<57:43,  3.77it/s]  
 96%|█████████▋| 358426/371472 [6:21:49<1:03:30,  3.42it/s]
 96%|█████████▋| 358427/371472 [6:21:49<1:05:21,  3.33it/s]
 96%|█████████▋| 358428/371472 [6:21:49<1:03:34,  3.42it/s]
 96%|█████████▋| 358429/371472 [6:21:50<1:04:10,  3.39it/s]
 96%|█████████▋| 358430/371472 [6:21:50<1:01:57,  3.51it/s]
 96%|█████████▋| 358431/371472 [6:21:50<1:01:14,  3.55it/s]
 96%|█████████▋| 358432/371472 [6:21:50<1:00:52,  3.57it/s]
 96%|█████████▋| 358433/371472 [6:21:51<59:47,  3.63it/s]  
 96%|█████████▋| 358434/371472 [6:21:51<1:00:01,  3.62it/s]
 96%|█████████▋| 358435/371472 [6:21:51<1:05:23,  3.32it/s]
 96%|█████████▋| 358436/371472 [6:21:52<1:05:52,  3.30it/s]
 96%|█████████▋| 358437/371472 [6:21:52<1:06:00,  3.29it/s]
 96%|█████████▋| 358438/371472 [6:21:52<1:03:18,  3.43it/s]
 96%|█████████▋| 358439/371472 [6:21:52<1:07:28,  3.22it/s]
 96%|█████████▋| 358440/371472 [6:21:53<1:05:06,  3.34it/s]
                                                           
{'loss': 2.4935, 'learning_rate': 1.315908552220474e-07, 'epoch': 15.44}

 96%|█████████▋| 358440/371472 [6:21:53<1:05:06,  3.34it/s]
 96%|█████████▋| 358441/371472 [6:21:53<1:03:17,  3.43it/s]
 96%|█████████▋| 358442/371472 [6:21:53<1:08:39,  3.16it/s]
 96%|█████████▋| 358443/371472 [6:21:54<1:05:24,  3.32it/s]
 96%|█████████▋| 358444/371472 [6:21:54<1:16:08,  2.85it/s]
 96%|█████████▋| 358445/371472 [6:21:55<1:17:47,  2.79it/s]
 96%|█████████▋| 358446/371472 [6:21:55<1:12:35,  2.99it/s]
 96%|█████████▋| 358447/371472 [6:21:55<1:12:00,  3.01it/s]
 96%|█████████▋| 358448/371472 [6:21:55<1:06:58,  3.24it/s]
 96%|█████████▋| 358449/371472 [6:21:56<1:04:37,  3.36it/s]
 96%|█████████▋| 358450/371472 [6:21:56<1:03:12,  3.43it/s]
 96%|█████████▋| 358451/371472 [6:21:56<1:05:09,  3.33it/s]
 96%|█████████▋| 358452/371472 [6:21:57<1:07:22,  3.22it/s]
 96%|█████████▋| 358453/371472 [6:21:57<1:03:44,  3.40it/s]
 96%|█████████▋| 358454/371472 [6:21:57<1:01:27,  3.53it/s]
 96%|█████████▋| 358455/371472 [6:21:57<1:00:42,  3.57it/s]
 96%|█████████▋| 358456/371472 [6:21:58<59:22,  3.65it/s]  
 96%|█████████▋| 358457/371472 [6:21:58<58:19,  3.72it/s]
 96%|█████████▋| 358458/371472 [6:21:58<57:18,  3.78it/s]
 96%|█████████▋| 358459/371472 [6:21:58<57:23,  3.78it/s]
 96%|█████████▋| 358460/371472 [6:21:59<57:05,  3.80it/s]
                                                         
{'loss': 2.6113, 'learning_rate': 1.3154237324656857e-07, 'epoch': 15.44}

 96%|█████████▋| 358460/371472 [6:21:59<57:05,  3.80it/s]
 96%|█████████▋| 358461/371472 [6:21:59<59:06,  3.67it/s]
 96%|█████████▋| 358462/371472 [6:21:59<1:01:13,  3.54it/s]
 96%|█████████▋| 358463/371472 [6:22:00<1:00:14,  3.60it/s]
 96%|█████████▋| 358464/371472 [6:22:00<1:00:03,  3.61it/s]
 96%|█████████▋| 358465/371472 [6:22:00<1:00:26,  3.59it/s]
 96%|█████████▋| 358466/371472 [6:22:00<59:24,  3.65it/s]  
 96%|█████████▋| 358467/371472 [6:22:01<59:30,  3.64it/s]
 96%|█████████▋| 358468/371472 [6:22:01<59:47,  3.62it/s]
 96%|█████████▋| 358469/371472 [6:22:01<1:00:02,  3.61it/s]
 96%|█████████▋| 358470/371472 [6:22:02<1:06:32,  3.26it/s]
 97%|█████████▋| 358471/371472 [6:22:02<1:05:13,  3.32it/s]
 97%|█████████▋| 358472/371472 [6:22:02<1:03:30,  3.41it/s]
 97%|█████████▋| 358473/371472 [6:22:02<1:01:06,  3.55it/s]
 97%|█████████▋| 358474/371472 [6:22:03<59:22,  3.65it/s]  
 97%|█████████▋| 358475/371472 [6:22:03<1:01:46,  3.51it/s]
 97%|█████████▋| 358476/371472 [6:22:03<1:04:40,  3.35it/s]
 97%|█████████▋| 358477/371472 [6:22:04<1:02:13,  3.48it/s]
 97%|█████████▋| 358478/371472 [6:22:04<1:03:02,  3.44it/s]
 97%|█████████▋| 358479/371472 [6:22:04<1:01:48,  3.50it/s]
 97%|█████████▋| 358480/371472 [6:22:04<1:00:39,  3.57it/s]
                                                           
{'loss': 2.568, 'learning_rate': 1.3149389127108961e-07, 'epoch': 15.44}

 97%|█████████▋| 358480/371472 [6:22:04<1:00:39,  3.57it/s]
 97%|█████████▋| 358481/371472 [6:22:05<1:00:37,  3.57it/s]
 97%|█████████▋| 358482/371472 [6:22:05<59:11,  3.66it/s]  
 97%|█████████▋| 358483/371472 [6:22:05<1:00:22,  3.59it/s]
 97%|█████████▋| 358484/371472 [6:22:05<59:05,  3.66it/s]  
 97%|█████████▋| 358485/371472 [6:22:06<57:59,  3.73it/s]
 97%|█████████▋| 358486/371472 [6:22:06<59:42,  3.63it/s]
 97%|█████████▋| 358487/371472 [6:22:06<1:01:04,  3.54it/s]
 97%|█████████▋| 358488/371472 [6:22:07<1:00:40,  3.57it/s]
 97%|█████████▋| 358489/371472 [6:22:07<1:00:22,  3.58it/s]
 97%|█████████▋| 358490/371472 [6:22:07<1:00:19,  3.59it/s]
 97%|█████████▋| 358491/371472 [6:22:07<1:00:41,  3.56it/s]
 97%|█████████▋| 358492/371472 [6:22:08<1:02:05,  3.48it/s]
 97%|█████████▋| 358493/371472 [6:22:08<1:06:04,  3.27it/s]
 97%|█████████▋| 358494/371472 [6:22:08<1:01:55,  3.49it/s]
 97%|█████████▋| 358495/371472 [6:22:09<1:02:02,  3.49it/s]
 97%|█████████▋| 358496/371472 [6:22:09<1:04:28,  3.35it/s]
 97%|█████████▋| 358497/371472 [6:22:09<1:02:15,  3.47it/s]
 97%|█████████▋| 358498/371472 [6:22:09<1:00:26,  3.58it/s]
 97%|█████████▋| 358499/371472 [6:22:10<1:00:42,  3.56it/s]
 97%|█████████▋| 358500/371472 [6:22:10<59:53,  3.61it/s]  
                                                         
{'loss': 2.6067, 'learning_rate': 1.3144540929561076e-07, 'epoch': 15.44}

 97%|█████████▋| 358500/371472 [6:22:10<59:53,  3.61it/s]
 97%|█████████▋| 358501/371472 [6:22:10<1:00:53,  3.55it/s]
 97%|█████████▋| 358502/371472 [6:22:11<1:01:19,  3.53it/s]
 97%|█████████▋| 358503/371472 [6:22:11<1:05:44,  3.29it/s]
 97%|█████████▋| 358504/371472 [6:22:11<1:04:59,  3.33it/s]
 97%|█████████▋| 358505/371472 [6:22:11<1:03:06,  3.42it/s]
 97%|█████████▋| 358506/371472 [6:22:12<1:01:10,  3.53it/s]
 97%|█████████▋| 358507/371472 [6:22:12<1:02:41,  3.45it/s]
 97%|█████████▋| 358508/371472 [6:22:13<1:19:04,  2.73it/s]
 97%|█████████▋| 358509/371472 [6:22:13<1:13:58,  2.92it/s]
 97%|█████████▋| 358510/371472 [6:22:13<1:11:51,  3.01it/s]
 97%|█████████▋| 358511/371472 [6:22:13<1:06:16,  3.26it/s]
 97%|█████████▋| 358512/371472 [6:22:14<1:02:47,  3.44it/s]
 97%|█████████▋| 358513/371472 [6:22:14<1:01:44,  3.50it/s]
 97%|█████████▋| 358514/371472 [6:22:14<59:14,  3.65it/s]  
 97%|█████████▋| 358515/371472 [6:22:14<57:25,  3.76it/s]
 97%|█████████▋| 358516/371472 [6:22:15<56:46,  3.80it/s]
 97%|█████████▋| 358517/371472 [6:22:15<57:07,  3.78it/s]
 97%|█████████▋| 358518/371472 [6:22:15<1:02:28,  3.46it/s]
 97%|█████████▋| 358519/371472 [6:22:16<1:02:09,  3.47it/s]
 97%|█████████▋| 358520/371472 [6:22:16<1:00:16,  3.58it/s]
                                                           
{'loss': 2.5474, 'learning_rate': 1.313969273201318e-07, 'epoch': 15.44}

 97%|█████████▋| 358520/371472 [6:22:16<1:00:16,  3.58it/s]
 97%|█████████▋| 358521/371472 [6:22:16<1:02:17,  3.46it/s]
 97%|█████████▋| 358522/371472 [6:22:16<1:00:11,  3.59it/s]
 97%|█████████▋| 358523/371472 [6:22:17<58:59,  3.66it/s]  
 97%|█████████▋| 358524/371472 [6:22:17<57:23,  3.76it/s]
 97%|█████████▋| 358525/371472 [6:22:17<57:03,  3.78it/s]
 97%|█████████▋| 358526/371472 [6:22:18<1:03:42,  3.39it/s]
 97%|█████████▋| 358527/371472 [6:22:18<1:01:10,  3.53it/s]
 97%|█████████▋| 358528/371472 [6:22:18<57:47,  3.73it/s]  
 97%|█████████▋| 358529/371472 [6:22:18<58:15,  3.70it/s]
 97%|█████████▋| 358530/371472 [6:22:19<57:20,  3.76it/s]
 97%|█████████▋| 358531/371472 [6:22:19<56:23,  3.82it/s]
 97%|█████████▋| 358532/371472 [6:22:19<59:15,  3.64it/s]
 97%|█████████▋| 358533/371472 [6:22:19<56:49,  3.79it/s]
 97%|█████████▋| 358534/371472 [6:22:20<1:00:26,  3.57it/s]
 97%|█████████▋| 358535/371472 [6:22:20<1:02:43,  3.44it/s]
 97%|█████████▋| 358536/371472 [6:22:20<1:00:54,  3.54it/s]
 97%|█████████▋| 358537/371472 [6:22:21<1:00:37,  3.56it/s]
 97%|█████████▋| 358538/371472 [6:22:21<58:18,  3.70it/s]  
 97%|█████████▋| 358539/371472 [6:22:21<1:01:09,  3.52it/s]
 97%|█████████▋| 358540/371472 [6:22:21<1:04:57,  3.32it/s]
                                                           
{'loss': 2.6256, 'learning_rate': 1.31348445344653e-07, 'epoch': 15.44}

 97%|█████████▋| 358540/371472 [6:22:21<1:04:57,  3.32it/s]
 97%|█████████▋| 358541/371472 [6:22:22<1:06:23,  3.25it/s]
 97%|█████████▋| 358542/371472 [6:22:22<1:01:58,  3.48it/s]
 97%|█████████▋| 358543/371472 [6:22:22<1:01:51,  3.48it/s]
 97%|█████████▋| 358544/371472 [6:22:23<1:00:42,  3.55it/s]
 97%|█████████▋| 358545/371472 [6:22:23<59:06,  3.65it/s]  
 97%|█████████▋| 358546/371472 [6:22:23<58:43,  3.67it/s]
 97%|█████████▋| 358547/371472 [6:22:23<59:01,  3.65it/s]
 97%|█████████▋| 358548/371472 [6:22:24<57:56,  3.72it/s]
 97%|█████████▋| 358549/371472 [6:22:24<57:59,  3.71it/s]
 97%|█████████▋| 358550/371472 [6:22:24<58:50,  3.66it/s]
 97%|█████████▋| 358551/371472 [6:22:25<1:01:08,  3.52it/s]
 97%|█████████▋| 358552/371472 [6:22:25<1:03:07,  3.41it/s]
 97%|█████████▋| 358553/371472 [6:22:25<1:02:32,  3.44it/s]
 97%|█████████▋| 358554/371472 [6:22:25<1:02:59,  3.42it/s]
 97%|█████████▋| 358555/371472 [6:22:26<1:02:25,  3.45it/s]
 97%|█████████▋| 358556/371472 [6:22:26<1:03:31,  3.39it/s]
 97%|█████████▋| 358557/371472 [6:22:26<1:02:45,  3.43it/s]
 97%|█████████▋| 358558/371472 [6:22:27<1:02:53,  3.42it/s]
 97%|█████████▋| 358559/371472 [6:22:27<1:01:44,  3.49it/s]
 97%|█████████▋| 358560/371472 [6:22:27<1:00:53,  3.53it/s]
                                                           
{'loss': 2.4989, 'learning_rate': 1.3129996336917403e-07, 'epoch': 15.44}

 97%|█████████▋| 358560/371472 [6:22:27<1:00:53,  3.53it/s]
 97%|█████████▋| 358561/371472 [6:22:27<1:02:12,  3.46it/s]
 97%|█████████▋| 358562/371472 [6:22:28<1:00:51,  3.54it/s]
 97%|█████████▋| 358563/371472 [6:22:28<59:09,  3.64it/s]  
 97%|█████████▋| 358564/371472 [6:22:28<59:32,  3.61it/s]
 97%|█████████▋| 358565/371472 [6:22:29<59:38,  3.61it/s]
 97%|█████████▋| 358566/371472 [6:22:29<1:00:58,  3.53it/s]
 97%|█████████▋| 358567/371472 [6:22:29<59:02,  3.64it/s]  
 97%|█████████▋| 358568/371472 [6:22:29<57:06,  3.77it/s]
 97%|█████████▋| 358569/371472 [6:22:30<57:40,  3.73it/s]
 97%|█████████▋| 358570/371472 [6:22:30<58:08,  3.70it/s]
 97%|█████████▋| 358571/371472 [6:22:30<58:20,  3.69it/s]
 97%|█████████▋| 358572/371472 [6:22:30<58:30,  3.68it/s]
 97%|█████████▋| 358573/371472 [6:22:31<58:59,  3.64it/s]
 97%|█████████▋| 358574/371472 [6:22:31<1:00:05,  3.58it/s]
 97%|█████████▋| 358575/371472 [6:22:31<1:01:10,  3.51it/s]
 97%|█████████▋| 358576/371472 [6:22:32<1:00:34,  3.55it/s]
 97%|█████████▋| 358577/371472 [6:22:32<1:04:50,  3.31it/s]
 97%|█████████▋| 358578/371472 [6:22:32<1:05:25,  3.28it/s]
 97%|█████████▋| 358579/371472 [6:22:33<1:08:11,  3.15it/s]
 97%|█████████▋| 358580/371472 [6:22:33<1:06:47,  3.22it/s]
                                                           
{'loss': 2.5126, 'learning_rate': 1.3125148139369518e-07, 'epoch': 15.44}

 97%|█████████▋| 358580/371472 [6:22:33<1:06:47,  3.22it/s]
 97%|█████████▋| 358581/371472 [6:22:33<1:04:49,  3.31it/s]
 97%|█████████▋| 358582/371472 [6:22:33<1:03:38,  3.38it/s]
 97%|█████████▋| 358583/371472 [6:22:34<1:02:31,  3.44it/s]
 97%|█████████▋| 358584/371472 [6:22:34<1:00:10,  3.57it/s]
 97%|█████████▋| 358585/371472 [6:22:34<58:41,  3.66it/s]  
 97%|█████████▋| 358586/371472 [6:22:34<58:54,  3.65it/s]
 97%|█████████▋| 358587/371472 [6:22:35<1:00:19,  3.56it/s]
 97%|█████████▋| 358588/371472 [6:22:35<1:01:33,  3.49it/s]
 97%|█████████▋| 358589/371472 [6:22:35<59:12,  3.63it/s]  
 97%|█████████▋| 358590/371472 [6:22:36<1:05:52,  3.26it/s]
 97%|█████████▋| 358591/371472 [6:22:36<1:01:45,  3.48it/s]
 97%|█████████▋| 358592/371472 [6:22:36<1:01:47,  3.47it/s]
 97%|█████████▋| 358593/371472 [6:22:37<1:01:31,  3.49it/s]
 97%|█████████▋| 358594/371472 [6:22:37<59:16,  3.62it/s]  
 97%|█████████▋| 358595/371472 [6:22:37<1:00:07,  3.57it/s]
 97%|█████████▋| 358596/371472 [6:22:37<1:00:08,  3.57it/s]
 97%|█████████▋| 358597/371472 [6:22:38<57:32,  3.73it/s]  
 97%|█████████▋| 358598/371472 [6:22:38<1:07:13,  3.19it/s]
 97%|█████████▋| 358599/371472 [6:22:38<1:03:24,  3.38it/s]
 97%|█████████▋| 358600/371472 [6:22:39<1:00:26,  3.55it/s]
                                                           
{'loss': 2.4675, 'learning_rate': 1.3120299941821625e-07, 'epoch': 15.45}

 97%|█████████▋| 358600/371472 [6:22:39<1:00:26,  3.55it/s]
 97%|█████████▋| 358601/371472 [6:22:39<59:06,  3.63it/s]  
 97%|█████████▋| 358602/371472 [6:22:39<58:58,  3.64it/s]
 97%|█████████▋| 358603/371472 [6:22:39<59:31,  3.60it/s]
 97%|█████████▋| 358604/371472 [6:22:40<57:47,  3.71it/s]
 97%|█████████▋| 358605/371472 [6:22:40<59:37,  3.60it/s]
 97%|█████████▋| 358606/371472 [6:22:40<58:45,  3.65it/s]
 97%|█████████▋| 358607/371472 [6:22:40<1:02:04,  3.45it/s]
 97%|█████████▋| 358608/371472 [6:22:41<1:01:13,  3.50it/s]
 97%|█████████▋| 358609/371472 [6:22:41<1:03:10,  3.39it/s]
 97%|█████████▋| 358610/371472 [6:22:41<1:01:55,  3.46it/s]
 97%|█████████▋| 358611/371472 [6:22:42<1:04:25,  3.33it/s]
 97%|█████████▋| 358612/371472 [6:22:42<1:02:32,  3.43it/s]
 97%|█████████▋| 358613/371472 [6:22:42<1:02:33,  3.43it/s]
 97%|█████████▋| 358614/371472 [6:22:43<1:02:25,  3.43it/s]
 97%|█████████▋| 358615/371472 [6:22:43<1:02:40,  3.42it/s]
 97%|█████████▋| 358616/371472 [6:22:43<1:04:55,  3.30it/s]
 97%|█████████▋| 358617/371472 [6:22:43<1:05:57,  3.25it/s]
 97%|█████████▋| 358618/371472 [6:22:44<1:05:45,  3.26it/s]
 97%|█████████▋| 358619/371472 [6:22:44<1:07:52,  3.16it/s]
 97%|█████████▋| 358620/371472 [6:22:44<1:04:16,  3.33it/s]
                                                           
{'loss': 2.5771, 'learning_rate': 1.311545174427374e-07, 'epoch': 15.45}

 97%|█████████▋| 358620/371472 [6:22:44<1:04:16,  3.33it/s]
 97%|█████████▋| 358621/371472 [6:22:45<1:02:42,  3.42it/s]
 97%|█████████▋| 358622/371472 [6:22:45<1:01:04,  3.51it/s]
 97%|█████████▋| 358623/371472 [6:22:45<1:00:04,  3.56it/s]
 97%|█████████▋| 358624/371472 [6:22:45<58:42,  3.65it/s]  
 97%|█████████▋| 358625/371472 [6:22:46<57:49,  3.70it/s]
 97%|█████████▋| 358626/371472 [6:22:46<58:17,  3.67it/s]
 97%|█████████▋| 358627/371472 [6:22:46<1:00:43,  3.53it/s]
 97%|█████████▋| 358628/371472 [6:22:47<1:05:36,  3.26it/s]
 97%|█████████▋| 358629/371472 [6:22:47<1:04:09,  3.34it/s]
 97%|█████████▋| 358630/371472 [6:22:47<1:02:55,  3.40it/s]
 97%|█████████▋| 358631/371472 [6:22:47<1:02:08,  3.44it/s]
 97%|█████████▋| 358632/371472 [6:22:48<1:09:02,  3.10it/s]
 97%|█████████▋| 358633/371472 [6:22:48<1:04:34,  3.31it/s]
 97%|█████████▋| 358634/371472 [6:22:48<1:01:04,  3.50it/s]
 97%|█████████▋| 358635/371472 [6:22:49<58:42,  3.64it/s]  
 97%|█████████▋| 358636/371472 [6:22:49<59:20,  3.60it/s]
 97%|█████████▋| 358637/371472 [6:22:49<58:22,  3.66it/s]
 97%|█████████▋| 358638/371472 [6:22:49<59:28,  3.60it/s]
 97%|█████████▋| 358639/371472 [6:22:50<57:49,  3.70it/s]
 97%|█████████▋| 358640/371472 [6:22:50<56:53,  3.76it/s]
                                                         
{'loss': 2.696, 'learning_rate': 1.3110603546725848e-07, 'epoch': 15.45}

 97%|█████████▋| 358640/371472 [6:22:50<56:53,  3.76it/s]
 97%|█████████▋| 358641/371472 [6:22:50<1:02:01,  3.45it/s]
 97%|█████████▋| 358642/371472 [6:22:51<59:50,  3.57it/s]  
 97%|█████████▋| 358643/371472 [6:22:51<1:03:47,  3.35it/s]
 97%|█████████▋| 358644/371472 [6:22:51<1:02:08,  3.44it/s]
 97%|█████████▋| 358645/371472 [6:22:51<1:01:38,  3.47it/s]
 97%|█████████▋| 358646/371472 [6:22:52<1:02:32,  3.42it/s]
 97%|█████████▋| 358647/371472 [6:22:52<1:05:08,  3.28it/s]
 97%|█████████▋| 358648/371472 [6:22:52<1:06:50,  3.20it/s]
 97%|█████████▋| 358649/371472 [6:22:53<1:06:49,  3.20it/s]
 97%|█████████▋| 358650/371472 [6:22:53<1:10:19,  3.04it/s]
 97%|█████████▋| 358651/371472 [6:22:53<1:05:47,  3.25it/s]
 97%|█████████▋| 358652/371472 [6:22:54<1:01:45,  3.46it/s]
 97%|█████████▋| 358653/371472 [6:22:54<1:00:03,  3.56it/s]
 97%|█████████▋| 358654/371472 [6:22:54<1:01:21,  3.48it/s]
 97%|█████████▋| 358655/371472 [6:22:54<59:24,  3.60it/s]  
 97%|█████████▋| 358656/371472 [6:22:55<57:23,  3.72it/s]
 97%|█████████▋| 358657/371472 [6:22:55<56:52,  3.76it/s]
 97%|█████████▋| 358658/371472 [6:22:55<1:02:36,  3.41it/s]
 97%|█████████▋| 358659/371472 [6:22:56<1:04:44,  3.30it/s]
 97%|█████████▋| 358660/371472 [6:22:56<1:03:05,  3.38it/s]
                                                           
{'loss': 2.5282, 'learning_rate': 1.3105755349177963e-07, 'epoch': 15.45}

 97%|█████████▋| 358660/371472 [6:22:56<1:03:05,  3.38it/s]
 97%|█████████▋| 358661/371472 [6:22:56<1:03:58,  3.34it/s]
 97%|█████████▋| 358662/371472 [6:22:57<1:02:05,  3.44it/s]
 97%|█████████▋| 358663/371472 [6:22:57<1:01:31,  3.47it/s]
 97%|█████████▋| 358664/371472 [6:22:57<59:36,  3.58it/s]  
 97%|█████████▋| 358665/371472 [6:22:57<1:01:22,  3.48it/s]
 97%|█████████▋| 358666/371472 [6:22:58<59:56,  3.56it/s]  
 97%|█████████▋| 358667/371472 [6:22:58<58:55,  3.62it/s]
 97%|█████████▋| 358668/371472 [6:22:58<57:14,  3.73it/s]
 97%|█████████▋| 358669/371472 [6:22:58<55:32,  3.84it/s]
 97%|█████████▋| 358670/371472 [6:22:59<58:50,  3.63it/s]
 97%|█████████▋| 358671/371472 [6:22:59<1:05:43,  3.25it/s]
 97%|█████████▋| 358672/371472 [6:22:59<1:06:50,  3.19it/s]
 97%|█████████▋| 358673/371472 [6:23:00<1:06:07,  3.23it/s]
 97%|█████████▋| 358674/371472 [6:23:00<1:02:22,  3.42it/s]
 97%|█████████▋| 358675/371472 [6:23:00<1:04:14,  3.32it/s]
 97%|█████████▋| 358676/371472 [6:23:01<1:02:12,  3.43it/s]
 97%|█████████▋| 358677/371472 [6:23:01<59:49,  3.56it/s]  
 97%|█████████▋| 358678/371472 [6:23:01<58:36,  3.64it/s]
 97%|█████████▋| 358679/371472 [6:23:01<58:37,  3.64it/s]
 97%|█████████▋| 358680/371472 [6:23:02<58:28,  3.65it/s]
                                                         
{'loss': 2.4702, 'learning_rate': 1.310090715163007e-07, 'epoch': 15.45}

 97%|█████████▋| 358680/371472 [6:23:02<58:28,  3.65it/s]
 97%|█████████▋| 358681/371472 [6:23:02<59:21,  3.59it/s]
 97%|█████████▋| 358682/371472 [6:23:02<1:03:33,  3.35it/s]
 97%|█████████▋| 358683/371472 [6:23:03<1:02:11,  3.43it/s]
 97%|█████████▋| 358684/371472 [6:23:03<1:00:44,  3.51it/s]
 97%|█████████▋| 358685/371472 [6:23:03<58:49,  3.62it/s]  
 97%|█████████▋| 358686/371472 [6:23:03<55:59,  3.81it/s]
 97%|█████████▋| 358687/371472 [6:23:04<1:03:58,  3.33it/s]
 97%|█████████▋| 358688/371472 [6:23:04<1:01:43,  3.45it/s]
 97%|█████████▋| 358689/371472 [6:23:04<1:01:39,  3.45it/s]
 97%|█████████▋| 358690/371472 [6:23:04<1:01:04,  3.49it/s]
 97%|█████████▋| 358691/371472 [6:23:05<1:03:16,  3.37it/s]
 97%|█████████▋| 358692/371472 [6:23:05<1:02:48,  3.39it/s]
 97%|█████████▋| 358693/371472 [6:23:05<59:13,  3.60it/s]  
 97%|█████████▋| 358694/371472 [6:23:06<1:02:09,  3.43it/s]
 97%|█████████▋| 358695/371472 [6:23:06<1:02:44,  3.39it/s]
 97%|█████████▋| 358696/371472 [6:23:06<1:00:58,  3.49it/s]
 97%|█████████▋| 358697/371472 [6:23:06<59:17,  3.59it/s]  
 97%|█████████▋| 358698/371472 [6:23:07<1:03:48,  3.34it/s]
 97%|█████████▋| 358699/371472 [6:23:07<1:01:01,  3.49it/s]
 97%|█████████▋| 358700/371472 [6:23:07<58:20,  3.65it/s]  
                                                         
{'loss': 2.6523, 'learning_rate': 1.3096058954082185e-07, 'epoch': 15.45}

 97%|█████████▋| 358700/371472 [6:23:07<58:20,  3.65it/s]
 97%|█████████▋| 358701/371472 [6:23:08<57:30,  3.70it/s]
 97%|█████████▋| 358702/371472 [6:23:08<57:45,  3.69it/s]
 97%|█████████▋| 358703/371472 [6:23:08<58:56,  3.61it/s]
 97%|█████████▋| 358704/371472 [6:23:08<56:59,  3.73it/s]
 97%|█████████▋| 358705/371472 [6:23:09<57:16,  3.72it/s]
 97%|█████████▋| 358706/371472 [6:23:09<57:13,  3.72it/s]
 97%|█████████▋| 358707/371472 [6:23:09<1:00:40,  3.51it/s]
 97%|█████████▋| 358708/371472 [6:23:10<58:06,  3.66it/s]  
 97%|█████████▋| 358709/371472 [6:23:10<57:01,  3.73it/s]
 97%|█████████▋| 358710/371472 [6:23:10<1:00:36,  3.51it/s]
 97%|█████████▋| 358711/371472 [6:23:10<1:03:39,  3.34it/s]
 97%|█████████▋| 358712/371472 [6:23:11<1:02:31,  3.40it/s]
 97%|█████████▋| 358713/371472 [6:23:11<1:00:21,  3.52it/s]
 97%|█████████▋| 358714/371472 [6:23:11<58:43,  3.62it/s]  
 97%|█████████▋| 358715/371472 [6:23:11<56:08,  3.79it/s]
 97%|█████████▋| 358716/371472 [6:23:12<58:26,  3.64it/s]
 97%|█████████▋| 358717/371472 [6:23:12<56:54,  3.74it/s]
 97%|█████████▋| 358718/371472 [6:23:12<56:24,  3.77it/s]
 97%|█████████▋| 358719/371472 [6:23:13<57:38,  3.69it/s]
 97%|█████████▋| 358720/371472 [6:23:13<57:01,  3.73it/s]
                                                         
{'loss': 2.7284, 'learning_rate': 1.309121075653429e-07, 'epoch': 15.45}

 97%|█████████▋| 358720/371472 [6:23:13<57:01,  3.73it/s]
 97%|█████████▋| 358721/371472 [6:23:13<58:44,  3.62it/s]
 97%|█████████▋| 358722/371472 [6:23:13<1:01:45,  3.44it/s]
 97%|█████████▋| 358723/371472 [6:23:14<1:00:54,  3.49it/s]
 97%|█████████▋| 358724/371472 [6:23:14<58:55,  3.61it/s]  
 97%|█████████▋| 358725/371472 [6:23:14<59:28,  3.57it/s]
 97%|█████████▋| 358726/371472 [6:23:15<58:01,  3.66it/s]
 97%|█████████▋| 358727/371472 [6:23:15<58:43,  3.62it/s]
 97%|█████████▋| 358728/371472 [6:23:15<58:41,  3.62it/s]
 97%|█████████▋| 358729/371472 [6:23:15<1:01:23,  3.46it/s]
 97%|█████████▋| 358730/371472 [6:23:16<59:44,  3.55it/s]  
 97%|█████████▋| 358731/371472 [6:23:16<59:00,  3.60it/s]
 97%|█████████▋| 358732/371472 [6:23:16<1:00:10,  3.53it/s]
 97%|█████████▋| 358733/371472 [6:23:16<57:01,  3.72it/s]  
 97%|█████████▋| 358734/371472 [6:23:17<55:54,  3.80it/s]
 97%|█████████▋| 358735/371472 [6:23:17<58:30,  3.63it/s]
 97%|█████████▋| 358736/371472 [6:23:17<1:02:33,  3.39it/s]
 97%|█████████▋| 358737/371472 [6:23:18<1:04:28,  3.29it/s]
 97%|█████████▋| 358738/371472 [6:23:18<1:02:36,  3.39it/s]
 97%|█████████▋| 358739/371472 [6:23:18<1:02:39,  3.39it/s]
 97%|█████████▋| 358740/371472 [6:23:19<1:02:35,  3.39it/s]
                                                           
{'loss': 2.5496, 'learning_rate': 1.3086362558986407e-07, 'epoch': 15.45}

 97%|█████████▋| 358740/371472 [6:23:19<1:02:35,  3.39it/s]
 97%|█████████▋| 358741/371472 [6:23:19<1:01:08,  3.47it/s]
 97%|█████████▋| 358742/371472 [6:23:19<58:04,  3.65it/s]  
 97%|█████████▋| 358743/371472 [6:23:19<58:08,  3.65it/s]
 97%|█████████▋| 358744/371472 [6:23:20<57:27,  3.69it/s]
 97%|█████████▋| 358745/371472 [6:23:20<55:00,  3.86it/s]
 97%|█████████▋| 358746/371472 [6:23:20<59:51,  3.54it/s]
 97%|█████████▋| 358747/371472 [6:23:20<1:01:48,  3.43it/s]
 97%|█████████▋| 358748/371472 [6:23:21<1:00:00,  3.53it/s]
 97%|█████████▋| 358749/371472 [6:23:21<1:00:49,  3.49it/s]
 97%|█████████▋| 358750/371472 [6:23:21<59:36,  3.56it/s]  
 97%|█████████▋| 358751/371472 [6:23:22<58:49,  3.60it/s]
 97%|█████████▋| 358752/371472 [6:23:22<57:08,  3.71it/s]
 97%|█████████▋| 358753/371472 [6:23:22<55:59,  3.79it/s]
 97%|█████████▋| 358754/371472 [6:23:22<1:00:30,  3.50it/s]
 97%|█████████▋| 358755/371472 [6:23:23<1:01:33,  3.44it/s]
 97%|█████████▋| 358756/371472 [6:23:23<1:01:45,  3.43it/s]
 97%|█████████▋| 358757/371472 [6:23:23<1:05:16,  3.25it/s]
 97%|█████████▋| 358758/371472 [6:23:24<1:01:27,  3.45it/s]
 97%|█████████▋| 358759/371472 [6:23:24<59:52,  3.54it/s]  
 97%|█████████▋| 358760/371472 [6:23:24<58:51,  3.60it/s]
                                                         
{'loss': 2.5931, 'learning_rate': 1.3081514361438512e-07, 'epoch': 15.45}

 97%|█████████▋| 358760/371472 [6:23:24<58:51,  3.60it/s]
 97%|█████████▋| 358761/371472 [6:23:24<57:52,  3.66it/s]
 97%|█████████▋| 358762/371472 [6:23:25<58:27,  3.62it/s]
 97%|█████████▋| 358763/371472 [6:23:25<59:05,  3.58it/s]
 97%|█████████▋| 358764/371472 [6:23:25<59:57,  3.53it/s]
 97%|█████████▋| 358765/371472 [6:23:26<1:12:08,  2.94it/s]
 97%|█████████▋| 358766/371472 [6:23:26<1:11:37,  2.96it/s]
 97%|█████████▋| 358767/371472 [6:23:26<1:06:35,  3.18it/s]
 97%|█████████▋| 358768/371472 [6:23:27<1:06:07,  3.20it/s]
 97%|█████████▋| 358769/371472 [6:23:27<1:01:54,  3.42it/s]
 97%|█████████▋| 358770/371472 [6:23:27<1:02:11,  3.40it/s]
 97%|█████████▋| 358771/371472 [6:23:28<1:09:29,  3.05it/s]
 97%|█████████▋| 358772/371472 [6:23:28<1:09:36,  3.04it/s]
 97%|█████████▋| 358773/371472 [6:23:28<1:07:59,  3.11it/s]
 97%|█████████▋| 358774/371472 [6:23:28<1:03:32,  3.33it/s]
 97%|█████████▋| 358775/371472 [6:23:29<1:00:30,  3.50it/s]
 97%|█████████▋| 358776/371472 [6:23:29<1:01:55,  3.42it/s]
 97%|█████████▋| 358777/371472 [6:23:29<1:04:36,  3.27it/s]
 97%|█████████▋| 358778/371472 [6:23:30<1:02:01,  3.41it/s]
 97%|█████████▋| 358779/371472 [6:23:30<59:09,  3.58it/s]  
 97%|█████████▋| 358780/371472 [6:23:30<56:45,  3.73it/s]
                                                         
{'loss': 2.6042, 'learning_rate': 1.3076666163890627e-07, 'epoch': 15.45}

 97%|█████████▋| 358780/371472 [6:23:30<56:45,  3.73it/s]
 97%|█████████▋| 358781/371472 [6:23:30<59:05,  3.58it/s]
 97%|█████████▋| 358782/371472 [6:23:31<59:25,  3.56it/s]
 97%|█████████▋| 358783/371472 [6:23:31<57:07,  3.70it/s]
 97%|█████████▋| 358784/371472 [6:23:31<56:50,  3.72it/s]
 97%|█████████▋| 358785/371472 [6:23:31<55:35,  3.80it/s]
 97%|█████████▋| 358786/371472 [6:23:32<55:25,  3.81it/s]
 97%|█████████▋| 358787/371472 [6:23:32<56:11,  3.76it/s]
 97%|█████████▋| 358788/371472 [6:23:32<57:27,  3.68it/s]
 97%|█████████▋| 358789/371472 [6:23:33<59:30,  3.55it/s]
 97%|█████████▋| 358790/371472 [6:23:33<58:36,  3.61it/s]
 97%|█████████▋| 358791/371472 [6:23:33<58:13,  3.63it/s]
 97%|█████████▋| 358792/371472 [6:23:33<1:01:51,  3.42it/s]
 97%|█████████▋| 358793/371472 [6:23:34<1:01:53,  3.41it/s]
 97%|█████████▋| 358794/371472 [6:23:34<59:01,  3.58it/s]  
 97%|█████████▋| 358795/371472 [6:23:34<57:39,  3.66it/s]
 97%|█████████▋| 358796/371472 [6:23:35<57:22,  3.68it/s]
 97%|█████████▋| 358797/371472 [6:23:35<55:20,  3.82it/s]
 97%|█████████▋| 358798/371472 [6:23:35<57:21,  3.68it/s]
 97%|█████████▋| 358799/371472 [6:23:35<57:44,  3.66it/s]
 97%|█████████▋| 358800/371472 [6:23:36<59:04,  3.57it/s]
                                                         
{'loss': 2.7924, 'learning_rate': 1.3071817966342734e-07, 'epoch': 15.45}

 97%|█████████▋| 358800/371472 [6:23:36<59:04,  3.57it/s]
 97%|█████████▋| 358801/371472 [6:23:36<58:29,  3.61it/s]
 97%|█████████▋| 358802/371472 [6:23:36<1:00:15,  3.50it/s]
 97%|█████████▋| 358803/371472 [6:23:36<59:18,  3.56it/s]  
 97%|█████████▋| 358804/371472 [6:23:37<58:49,  3.59it/s]
 97%|█████████▋| 358805/371472 [6:23:37<58:21,  3.62it/s]
 97%|█████████▋| 358806/371472 [6:23:37<1:00:41,  3.48it/s]
 97%|█████████▋| 358807/371472 [6:23:38<57:22,  3.68it/s]  
 97%|█████████▋| 358808/371472 [6:23:38<58:25,  3.61it/s]
 97%|█████████▋| 358809/371472 [6:23:38<56:13,  3.75it/s]
 97%|█████████▋| 358810/371472 [6:23:38<59:36,  3.54it/s]
 97%|█████████▋| 358811/371472 [6:23:39<58:25,  3.61it/s]
 97%|█████████▋| 358812/371472 [6:23:39<58:59,  3.58it/s]
 97%|█████████▋| 358813/371472 [6:23:39<57:20,  3.68it/s]
 97%|█████████▋| 358814/371472 [6:23:40<58:35,  3.60it/s]
 97%|█████████▋| 358815/371472 [6:23:40<59:36,  3.54it/s]
 97%|█████████▋| 358816/371472 [6:23:40<59:40,  3.53it/s]
 97%|█████████▋| 358817/371472 [6:23:40<1:02:46,  3.36it/s]
 97%|█████████▋| 358818/371472 [6:23:41<1:02:26,  3.38it/s]
 97%|█████████▋| 358819/371472 [6:23:41<1:00:49,  3.47it/s]
 97%|█████████▋| 358820/371472 [6:23:41<1:00:11,  3.50it/s]
                                                           
{'loss': 2.5375, 'learning_rate': 1.306696976879485e-07, 'epoch': 15.46}

 97%|█████████▋| 358820/371472 [6:23:41<1:00:11,  3.50it/s]
 97%|█████████▋| 358821/371472 [6:23:42<1:03:28,  3.32it/s]
 97%|█████████▋| 358822/371472 [6:23:42<1:01:41,  3.42it/s]
 97%|█████████▋| 358823/371472 [6:23:42<58:59,  3.57it/s]  
 97%|█████████▋| 358824/371472 [6:23:42<58:53,  3.58it/s]
 97%|█████████▋| 358825/371472 [6:23:43<59:39,  3.53it/s]
 97%|█████████▋| 358826/371472 [6:23:43<1:02:34,  3.37it/s]
 97%|█████████▋| 358827/371472 [6:23:43<1:00:56,  3.46it/s]
 97%|█████████▋| 358828/371472 [6:23:44<57:43,  3.65it/s]  
 97%|█████████▋| 358829/371472 [6:23:44<1:02:45,  3.36it/s]
 97%|█████████▋| 358830/371472 [6:23:44<1:02:17,  3.38it/s]
 97%|█████████▋| 358831/371472 [6:23:44<59:53,  3.52it/s]  
 97%|█████████▋| 358832/371472 [6:23:45<58:55,  3.58it/s]
 97%|█████████▋| 358833/371472 [6:23:45<57:03,  3.69it/s]
 97%|█████████▋| 358834/371472 [6:23:45<58:29,  3.60it/s]
 97%|█████████▋| 358835/371472 [6:23:46<59:25,  3.54it/s]
 97%|█████████▋| 358836/371472 [6:23:46<57:44,  3.65it/s]
 97%|█████████▋| 358837/371472 [6:23:46<59:15,  3.55it/s]
 97%|█████████▋| 358838/371472 [6:23:46<59:55,  3.51it/s]
 97%|█████████▋| 358839/371472 [6:23:47<58:06,  3.62it/s]
 97%|█████████▋| 358840/371472 [6:23:47<56:48,  3.71it/s]
                                                         
{'loss': 2.5327, 'learning_rate': 1.3062121571246954e-07, 'epoch': 15.46}

 97%|█████████▋| 358840/371472 [6:23:47<56:48,  3.71it/s]
 97%|█████████▋| 358841/371472 [6:23:47<56:34,  3.72it/s]
 97%|█████████▋| 358842/371472 [6:23:47<54:41,  3.85it/s]
 97%|█████████▋| 358843/371472 [6:23:48<53:17,  3.95it/s]
 97%|█████████▋| 358844/371472 [6:23:48<52:54,  3.98it/s]
 97%|█████████▋| 358845/371472 [6:23:48<53:39,  3.92it/s]
 97%|█████████▋| 358846/371472 [6:23:48<56:14,  3.74it/s]
 97%|█████████▋| 358847/371472 [6:23:49<55:44,  3.78it/s]
 97%|█████████▋| 358848/371472 [6:23:49<54:47,  3.84it/s]
 97%|█████████▋| 358849/371472 [6:23:49<55:21,  3.80it/s]
 97%|█████████▋| 358850/371472 [6:23:49<54:38,  3.85it/s]
 97%|█████████▋| 358851/371472 [6:23:50<54:27,  3.86it/s]
 97%|█████████▋| 358852/371472 [6:23:50<53:23,  3.94it/s]
 97%|█████████▋| 358853/371472 [6:23:50<53:42,  3.92it/s]
 97%|█████████▋| 358854/371472 [6:23:51<55:19,  3.80it/s]
 97%|█████████▋| 358855/371472 [6:23:51<58:07,  3.62it/s]
 97%|█████████▋| 358856/371472 [6:23:51<57:16,  3.67it/s]
 97%|█████████▋| 358857/371472 [6:23:51<1:01:32,  3.42it/s]
 97%|█████████▋| 358858/371472 [6:23:52<1:03:36,  3.31it/s]
 97%|█████████▋| 358859/371472 [6:23:52<1:01:49,  3.40it/s]
 97%|█████████▋| 358860/371472 [6:23:52<1:06:19,  3.17it/s]
                                                           
{'loss': 2.5791, 'learning_rate': 1.305727337369907e-07, 'epoch': 15.46}

 97%|█████████▋| 358860/371472 [6:23:52<1:06:19,  3.17it/s]
 97%|█████████▋| 358861/371472 [6:23:53<1:02:19,  3.37it/s]
 97%|█████████▋| 358862/371472 [6:23:53<1:00:39,  3.46it/s]
 97%|█████████▋| 358863/371472 [6:23:53<59:36,  3.53it/s]  
 97%|█████████▋| 358864/371472 [6:23:54<1:02:12,  3.38it/s]
 97%|█████████▋| 358865/371472 [6:23:54<1:00:38,  3.47it/s]
 97%|█████████▋| 358866/371472 [6:23:54<1:01:25,  3.42it/s]
 97%|█████████▋| 358867/371472 [6:23:54<58:35,  3.59it/s]  
 97%|█████████▋| 358868/371472 [6:23:55<59:30,  3.53it/s]
 97%|█████████▋| 358869/371472 [6:23:55<59:15,  3.54it/s]
 97%|█████████▋| 358870/371472 [6:23:55<57:16,  3.67it/s]
 97%|█████████▋| 358871/371472 [6:23:55<56:04,  3.75it/s]
 97%|█████████▋| 358872/371472 [6:23:56<1:01:26,  3.42it/s]
 97%|█████████▋| 358873/371472 [6:23:56<1:03:41,  3.30it/s]
 97%|█████████▋| 358874/371472 [6:23:56<1:03:32,  3.30it/s]
 97%|█████████▋| 358875/371472 [6:23:57<1:03:56,  3.28it/s]
 97%|█████████▋| 358876/371472 [6:23:57<1:06:48,  3.14it/s]
 97%|█████████▋| 358877/371472 [6:23:57<1:08:18,  3.07it/s]
 97%|█████████▋| 358878/371472 [6:23:58<1:09:05,  3.04it/s]
 97%|█████████▋| 358879/371472 [6:23:58<1:05:30,  3.20it/s]
 97%|█████████▋| 358880/371472 [6:23:58<1:01:03,  3.44it/s]
                                                           
{'loss': 2.5158, 'learning_rate': 1.3052425176151173e-07, 'epoch': 15.46}

 97%|█████████▋| 358880/371472 [6:23:58<1:01:03,  3.44it/s]
 97%|█████████▋| 358881/371472 [6:23:59<1:05:05,  3.22it/s]
 97%|█████████▋| 358882/371472 [6:23:59<1:02:23,  3.36it/s]
 97%|█████████▋| 358883/371472 [6:23:59<1:00:37,  3.46it/s]
 97%|█████████▋| 358884/371472 [6:23:59<57:18,  3.66it/s]  
 97%|█████████▋| 358885/371472 [6:24:00<57:22,  3.66it/s]
 97%|█████████▋| 358886/371472 [6:24:00<56:06,  3.74it/s]
 97%|█████████▋| 358887/371472 [6:24:00<55:49,  3.76it/s]
 97%|█████████▋| 358888/371472 [6:24:00<54:34,  3.84it/s]
 97%|█████████▋| 358889/371472 [6:24:01<55:29,  3.78it/s]
 97%|█████████▋| 358890/371472 [6:24:01<57:17,  3.66it/s]
 97%|█████████▋| 358891/371472 [6:24:01<55:57,  3.75it/s]
 97%|█████████▋| 358892/371472 [6:24:02<55:38,  3.77it/s]
 97%|█████████▋| 358893/371472 [6:24:02<54:57,  3.82it/s]
 97%|█████████▋| 358894/371472 [6:24:02<54:01,  3.88it/s]
 97%|█████████▋| 358895/371472 [6:24:02<54:19,  3.86it/s]
 97%|█████████▋| 358896/371472 [6:24:03<58:23,  3.59it/s]
 97%|█████████▋| 358897/371472 [6:24:03<1:06:36,  3.15it/s]
 97%|█████████▋| 358898/371472 [6:24:03<1:05:45,  3.19it/s]
 97%|█████████▋| 358899/371472 [6:24:04<1:03:45,  3.29it/s]
 97%|█████████▋| 358900/371472 [6:24:04<1:02:28,  3.35it/s]
                                                           
{'loss': 2.5614, 'learning_rate': 1.304757697860329e-07, 'epoch': 15.46}

 97%|█████████▋| 358900/371472 [6:24:04<1:02:28,  3.35it/s]
 97%|█████████▋| 358901/371472 [6:24:04<59:12,  3.54it/s]  
 97%|█████████▋| 358902/371472 [6:24:04<1:01:25,  3.41it/s]
 97%|█████████▋| 358903/371472 [6:24:05<1:03:16,  3.31it/s]
 97%|█████████▋| 358904/371472 [6:24:05<1:02:04,  3.37it/s]
 97%|█████████▋| 358905/371472 [6:24:05<59:54,  3.50it/s]  
 97%|█████████▋| 358906/371472 [6:24:06<59:38,  3.51it/s]
 97%|█████████▋| 358907/371472 [6:24:06<57:55,  3.62it/s]
 97%|█████████▋| 358908/371472 [6:24:06<58:44,  3.56it/s]
 97%|█████████▋| 358909/371472 [6:24:06<58:26,  3.58it/s]
 97%|█████████▋| 358910/371472 [6:24:07<57:18,  3.65it/s]
 97%|█████████▋| 358911/371472 [6:24:07<55:44,  3.76it/s]
 97%|█████████▋| 358912/371472 [6:24:07<56:23,  3.71it/s]
 97%|█████████▋| 358913/371472 [6:24:07<55:47,  3.75it/s]
 97%|█████████▋| 358914/371472 [6:24:08<57:43,  3.63it/s]
 97%|█████████▋| 358915/371472 [6:24:08<59:23,  3.52it/s]
 97%|█████████▋| 358916/371472 [6:24:08<57:59,  3.61it/s]
 97%|█████████▋| 358917/371472 [6:24:09<56:15,  3.72it/s]
 97%|█████████▋| 358918/371472 [6:24:09<56:01,  3.73it/s]
 97%|█████████▋| 358919/371472 [6:24:09<58:18,  3.59it/s]
 97%|█████████▋| 358920/371472 [6:24:09<58:19,  3.59it/s]
                                                         
{'loss': 2.5917, 'learning_rate': 1.3042728781055398e-07, 'epoch': 15.46}

 97%|█████████▋| 358920/371472 [6:24:09<58:19,  3.59it/s]
 97%|█████████▋| 358921/371472 [6:24:10<55:25,  3.77it/s]
 97%|█████████▋| 358922/371472 [6:24:10<56:27,  3.70it/s]
 97%|█████████▋| 358923/371472 [6:24:10<59:31,  3.51it/s]
 97%|█████████▋| 358924/371472 [6:24:11<1:01:20,  3.41it/s]
 97%|█████████▋| 358925/371472 [6:24:11<59:01,  3.54it/s]  
 97%|█████████▋| 358926/371472 [6:24:11<56:32,  3.70it/s]
 97%|█████████▋| 358927/371472 [6:24:11<59:08,  3.54it/s]
 97%|█████████▋| 358928/371472 [6:24:12<59:14,  3.53it/s]
 97%|█████████▋| 358929/371472 [6:24:12<1:00:33,  3.45it/s]
 97%|█████████▋| 358930/371472 [6:24:12<59:44,  3.50it/s]  
 97%|█████████▋| 358931/371472 [6:24:13<1:01:55,  3.38it/s]
 97%|█████████▋| 358932/371472 [6:24:13<1:01:03,  3.42it/s]
 97%|█████████▋| 358933/371472 [6:24:13<58:57,  3.54it/s]  
 97%|█████████▋| 358934/371472 [6:24:13<57:59,  3.60it/s]
 97%|█████████▋| 358935/371472 [6:24:14<59:20,  3.52it/s]
 97%|█████████▋| 358936/371472 [6:24:14<57:39,  3.62it/s]
 97%|█████████▋| 358937/371472 [6:24:14<55:41,  3.75it/s]
 97%|█████████▋| 358938/371472 [6:24:14<55:28,  3.77it/s]
 97%|█████████▋| 358939/371472 [6:24:15<55:35,  3.76it/s]
 97%|█████████▋| 358940/371472 [6:24:15<58:47,  3.55it/s]
                                                         
{'loss': 2.6282, 'learning_rate': 1.3037880583507513e-07, 'epoch': 15.46}

 97%|█████████▋| 358940/371472 [6:24:15<58:47,  3.55it/s]
 97%|█████████▋| 358941/371472 [6:24:15<57:13,  3.65it/s]
 97%|█████████▋| 358942/371472 [6:24:16<58:11,  3.59it/s]
 97%|█████████▋| 358943/371472 [6:24:16<55:14,  3.78it/s]
 97%|█████████▋| 358944/371472 [6:24:16<55:42,  3.75it/s]
 97%|█████████▋| 358945/371472 [6:24:16<57:34,  3.63it/s]
 97%|█████████▋| 358946/371472 [6:24:17<1:02:51,  3.32it/s]
 97%|█████████▋| 358947/371472 [6:24:17<1:01:16,  3.41it/s]
 97%|█████████▋| 358948/371472 [6:24:17<59:00,  3.54it/s]  
 97%|█████████▋| 358949/371472 [6:24:18<1:16:12,  2.74it/s]
 97%|█████████▋| 358950/371472 [6:24:18<1:08:51,  3.03it/s]
 97%|█████████▋| 358951/371472 [6:24:18<1:06:58,  3.12it/s]
 97%|█████████▋| 358952/371472 [6:24:19<1:03:11,  3.30it/s]
 97%|█████████▋| 358953/371472 [6:24:19<59:12,  3.52it/s]  
 97%|█████████▋| 358954/371472 [6:24:19<57:55,  3.60it/s]
 97%|█████████▋| 358955/371472 [6:24:19<55:45,  3.74it/s]
 97%|█████████▋| 358956/371472 [6:24:20<57:18,  3.64it/s]
 97%|█████████▋| 358957/371472 [6:24:20<58:48,  3.55it/s]
 97%|█████████▋| 358958/371472 [6:24:20<58:06,  3.59it/s]
 97%|█████████▋| 358959/371472 [6:24:21<59:44,  3.49it/s]
 97%|█████████▋| 358960/371472 [6:24:21<57:10,  3.65it/s]
                                                         
{'loss': 2.5659, 'learning_rate': 1.3033032385959618e-07, 'epoch': 15.46}

 97%|█████████▋| 358960/371472 [6:24:21<57:10,  3.65it/s]
 97%|█████████▋| 358961/371472 [6:24:21<58:26,  3.57it/s]
 97%|█████████▋| 358962/371472 [6:24:21<59:12,  3.52it/s]
 97%|█████████▋| 358963/371472 [6:24:22<57:55,  3.60it/s]
 97%|█████████▋| 358964/371472 [6:24:22<57:10,  3.65it/s]
 97%|█████████▋| 358965/371472 [6:24:22<57:24,  3.63it/s]
 97%|█████████▋| 358966/371472 [6:24:22<56:30,  3.69it/s]
 97%|█████████▋| 358967/371472 [6:24:23<58:18,  3.57it/s]
 97%|█████████▋| 358968/371472 [6:24:23<58:21,  3.57it/s]
 97%|█████████▋| 358969/371472 [6:24:23<57:57,  3.60it/s]
 97%|█████████▋| 358970/371472 [6:24:24<56:37,  3.68it/s]
 97%|█████████▋| 358971/371472 [6:24:24<55:39,  3.74it/s]
 97%|█████████▋| 358972/371472 [6:24:24<55:20,  3.76it/s]
 97%|█████████▋| 358973/371472 [6:24:24<56:32,  3.68it/s]
 97%|█████████▋| 358974/371472 [6:24:25<55:29,  3.75it/s]
 97%|█████████▋| 358975/371472 [6:24:25<55:57,  3.72it/s]
 97%|█████████▋| 358976/371472 [6:24:25<59:13,  3.52it/s]
 97%|█████████▋| 358977/371472 [6:24:25<56:18,  3.70it/s]
 97%|█████████▋| 358978/371472 [6:24:26<58:06,  3.58it/s]
 97%|█████████▋| 358979/371472 [6:24:26<58:13,  3.58it/s]
 97%|█████████▋| 358980/371472 [6:24:26<1:00:15,  3.45it/s]
                                                           
{'loss': 2.6214, 'learning_rate': 1.3028184188411725e-07, 'epoch': 15.46}

 97%|█████████▋| 358980/371472 [6:24:26<1:00:15,  3.45it/s]
 97%|█████████▋| 358981/371472 [6:24:27<1:02:25,  3.33it/s]
 97%|█████████▋| 358982/371472 [6:24:27<1:02:10,  3.35it/s]
 97%|█████████▋| 358983/371472 [6:24:27<59:46,  3.48it/s]  
 97%|█████████▋| 358984/371472 [6:24:27<58:38,  3.55it/s]
 97%|█████████▋| 358985/371472 [6:24:28<57:56,  3.59it/s]
 97%|█████████▋| 358986/371472 [6:24:28<57:01,  3.65it/s]
 97%|█████████▋| 358987/371472 [6:24:28<56:29,  3.68it/s]
 97%|█████████▋| 358988/371472 [6:24:29<56:52,  3.66it/s]
 97%|█████████▋| 358989/371472 [6:24:29<54:57,  3.79it/s]
 97%|█████████▋| 358990/371472 [6:24:29<54:25,  3.82it/s]
 97%|█████████▋| 358991/371472 [6:24:29<53:38,  3.88it/s]
 97%|█████████▋| 358992/371472 [6:24:30<53:22,  3.90it/s]
 97%|█████████▋| 358993/371472 [6:24:30<55:06,  3.77it/s]
 97%|█████████▋| 358994/371472 [6:24:30<57:04,  3.64it/s]
 97%|█████████▋| 358995/371472 [6:24:30<55:43,  3.73it/s]
 97%|█████████▋| 358996/371472 [6:24:31<54:58,  3.78it/s]
 97%|█████████▋| 358997/371472 [6:24:31<56:00,  3.71it/s]
 97%|█████████▋| 358998/371472 [6:24:31<55:00,  3.78it/s]
 97%|█████████▋| 358999/371472 [6:24:31<55:38,  3.74it/s]
 97%|█████████▋| 359000/371472 [6:24:32<57:29,  3.62it/s]
                                                         
{'loss': 2.5694, 'learning_rate': 1.302333599086384e-07, 'epoch': 15.46}

 97%|█████████▋| 359000/371472 [6:24:32<57:29,  3.62it/s]
 97%|█████████▋| 359001/371472 [6:24:32<57:22,  3.62it/s]
 97%|█████████▋| 359002/371472 [6:24:32<58:50,  3.53it/s]
 97%|█████████▋| 359003/371472 [6:24:33<1:00:16,  3.45it/s]
 97%|█████████▋| 359004/371472 [6:24:33<58:45,  3.54it/s]  
 97%|█████████▋| 359005/371472 [6:24:33<56:08,  3.70it/s]
 97%|█████████▋| 359006/371472 [6:24:33<54:48,  3.79it/s]
 97%|█████████▋| 359007/371472 [6:24:34<56:26,  3.68it/s]
 97%|█████████▋| 359008/371472 [6:24:34<58:57,  3.52it/s]
 97%|█████████▋| 359009/371472 [6:24:34<58:45,  3.54it/s]
 97%|█████████▋| 359010/371472 [6:24:35<59:08,  3.51it/s]
 97%|█████████▋| 359011/371472 [6:24:35<57:58,  3.58it/s]
 97%|█████████▋| 359012/371472 [6:24:35<57:33,  3.61it/s]
 97%|█████████▋| 359013/371472 [6:24:35<56:42,  3.66it/s]
 97%|█████████▋| 359014/371472 [6:24:36<55:43,  3.73it/s]
 97%|█████████▋| 359015/371472 [6:24:36<57:48,  3.59it/s]
 97%|█████████▋| 359016/371472 [6:24:36<1:00:27,  3.43it/s]
 97%|█████████▋| 359017/371472 [6:24:37<59:45,  3.47it/s]  
 97%|█████████▋| 359018/371472 [6:24:37<58:45,  3.53it/s]
 97%|█████████▋| 359019/371472 [6:24:37<57:45,  3.59it/s]
 97%|█████████▋| 359020/371472 [6:24:37<57:13,  3.63it/s]
                                                         
{'loss': 2.5497, 'learning_rate': 1.3018487793315947e-07, 'epoch': 15.46}

 97%|█████████▋| 359020/371472 [6:24:37<57:13,  3.63it/s]
 97%|█████████▋| 359021/371472 [6:24:38<57:38,  3.60it/s]
 97%|█████████▋| 359022/371472 [6:24:38<56:14,  3.69it/s]
 97%|█████████▋| 359023/371472 [6:24:38<54:07,  3.83it/s]
 97%|█████████▋| 359024/371472 [6:24:38<53:47,  3.86it/s]
 97%|█████████▋| 359025/371472 [6:24:39<56:00,  3.70it/s]
 97%|█████████▋| 359026/371472 [6:24:39<55:07,  3.76it/s]
 97%|█████████▋| 359027/371472 [6:24:39<54:23,  3.81it/s]
 97%|█████████▋| 359028/371472 [6:24:39<53:06,  3.91it/s]
 97%|█████████▋| 359029/371472 [6:24:40<52:21,  3.96it/s]
 97%|█████████▋| 359030/371472 [6:24:40<52:14,  3.97it/s]
 97%|█████████▋| 359031/371472 [6:24:40<51:35,  4.02it/s]
 97%|█████████▋| 359032/371472 [6:24:40<54:33,  3.80it/s]
 97%|█████████▋| 359033/371472 [6:24:41<54:10,  3.83it/s]
 97%|█████████▋| 359034/371472 [6:24:41<54:45,  3.79it/s]
 97%|█████████▋| 359035/371472 [6:24:41<58:07,  3.57it/s]
 97%|█████████▋| 359036/371472 [6:24:42<56:21,  3.68it/s]
 97%|█████████▋| 359037/371472 [6:24:42<59:43,  3.47it/s]
 97%|█████████▋| 359038/371472 [6:24:42<57:15,  3.62it/s]
 97%|█████████▋| 359039/371472 [6:24:42<56:13,  3.69it/s]
 97%|█████████▋| 359040/371472 [6:24:43<55:32,  3.73it/s]
                                                         
{'loss': 2.5184, 'learning_rate': 1.3013639595768062e-07, 'epoch': 15.46}

 97%|█████████▋| 359040/371472 [6:24:43<55:32,  3.73it/s]
 97%|█████████▋| 359041/371472 [6:24:43<55:29,  3.73it/s]
 97%|█████████▋| 359042/371472 [6:24:43<56:14,  3.68it/s]
 97%|█████████▋| 359043/371472 [6:24:43<54:11,  3.82it/s]
 97%|█████████▋| 359044/371472 [6:24:44<1:00:24,  3.43it/s]
 97%|█████████▋| 359045/371472 [6:24:44<59:47,  3.46it/s]  
 97%|█████████▋| 359046/371472 [6:24:44<1:01:50,  3.35it/s]
 97%|█████████▋| 359047/371472 [6:24:45<1:00:52,  3.40it/s]
 97%|█████████▋| 359048/371472 [6:24:45<59:00,  3.51it/s]  
 97%|█████████▋| 359049/371472 [6:24:45<1:03:08,  3.28it/s]
 97%|█████████▋| 359050/371472 [6:24:46<1:02:58,  3.29it/s]
 97%|█████████▋| 359051/371472 [6:24:46<59:14,  3.49it/s]  
 97%|█████████▋| 359052/371472 [6:24:46<1:02:46,  3.30it/s]
 97%|█████████▋| 359053/371472 [6:24:46<1:00:55,  3.40it/s]
 97%|█████████▋| 359054/371472 [6:24:47<58:35,  3.53it/s]  
 97%|█████████▋| 359055/371472 [6:24:47<1:00:58,  3.39it/s]
 97%|█████████▋| 359056/371472 [6:24:47<1:00:13,  3.44it/s]
 97%|█████████▋| 359057/371472 [6:24:48<59:19,  3.49it/s]  
 97%|█████████▋| 359058/371472 [6:24:48<57:29,  3.60it/s]
 97%|█████████▋| 359059/371472 [6:24:48<56:46,  3.64it/s]
 97%|█████████▋| 359060/371472 [6:24:48<58:23,  3.54it/s]
                                                         
{'loss': 2.4884, 'learning_rate': 1.300879139822017e-07, 'epoch': 15.47}

 97%|█████████▋| 359060/371472 [6:24:48<58:23,  3.54it/s]
 97%|█████████▋| 359061/371472 [6:24:49<57:09,  3.62it/s]
 97%|█████████▋| 359062/371472 [6:24:49<56:42,  3.65it/s]
 97%|█████████▋| 359063/371472 [6:24:49<54:13,  3.81it/s]
 97%|█████████▋| 359064/371472 [6:24:49<56:36,  3.65it/s]
 97%|█████████▋| 359065/371472 [6:24:50<55:00,  3.76it/s]
 97%|█████████▋| 359066/371472 [6:24:50<58:31,  3.53it/s]
 97%|█████████▋| 359067/371472 [6:24:50<1:01:31,  3.36it/s]
 97%|█████████▋| 359068/371472 [6:24:51<1:01:18,  3.37it/s]
 97%|█████████▋| 359069/371472 [6:24:51<1:02:11,  3.32it/s]
 97%|█████████▋| 359070/371472 [6:24:51<1:05:07,  3.17it/s]
 97%|█████████▋| 359071/371472 [6:24:52<1:02:14,  3.32it/s]
 97%|█████████▋| 359072/371472 [6:24:52<59:27,  3.48it/s]  
 97%|█████████▋| 359073/371472 [6:24:52<1:00:28,  3.42it/s]
 97%|█████████▋| 359074/371472 [6:24:52<58:33,  3.53it/s]  
 97%|█████████▋| 359075/371472 [6:24:53<58:09,  3.55it/s]
 97%|█████████▋| 359076/371472 [6:24:53<56:36,  3.65it/s]
 97%|█████████▋| 359077/371472 [6:24:53<54:39,  3.78it/s]
 97%|█████████▋| 359078/371472 [6:24:53<53:59,  3.83it/s]
 97%|█████████▋| 359079/371472 [6:24:54<1:01:21,  3.37it/s]
 97%|█████████▋| 359080/371472 [6:24:54<57:31,  3.59it/s]  
                                                         
{'loss': 2.5107, 'learning_rate': 1.3003943200672284e-07, 'epoch': 15.47}

 97%|█████████▋| 359080/371472 [6:24:54<57:31,  3.59it/s]
 97%|█████████▋| 359081/371472 [6:24:54<55:52,  3.70it/s]
 97%|█████████▋| 359082/371472 [6:24:55<54:24,  3.80it/s]
 97%|█████████▋| 359083/371472 [6:24:55<54:53,  3.76it/s]
 97%|█████████▋| 359084/371472 [6:24:55<55:53,  3.69it/s]
 97%|█████████▋| 359085/371472 [6:24:55<56:42,  3.64it/s]
 97%|█████████▋| 359086/371472 [6:24:56<56:21,  3.66it/s]
 97%|█████████▋| 359087/371472 [6:24:56<1:03:35,  3.25it/s]
 97%|█████████▋| 359088/371472 [6:24:56<1:05:16,  3.16it/s]
 97%|█████████▋| 359089/371472 [6:24:57<1:02:07,  3.32it/s]
 97%|█████████▋| 359090/371472 [6:24:57<1:00:06,  3.43it/s]
 97%|█████████▋| 359091/371472 [6:24:57<1:02:09,  3.32it/s]
 97%|█████████▋| 359092/371472 [6:24:58<59:10,  3.49it/s]  
 97%|█████████▋| 359093/371472 [6:24:58<59:30,  3.47it/s]
 97%|█████████▋| 359094/371472 [6:24:58<57:09,  3.61it/s]
 97%|█████████▋| 359095/371472 [6:24:58<56:27,  3.65it/s]
 97%|█████████▋| 359096/371472 [6:24:59<58:30,  3.53it/s]
 97%|█████████▋| 359097/371472 [6:24:59<57:46,  3.57it/s]
 97%|█████████▋| 359098/371472 [6:24:59<57:21,  3.60it/s]
 97%|█████████▋| 359099/371472 [6:24:59<55:59,  3.68it/s]
 97%|█████████▋| 359100/371472 [6:25:00<54:14,  3.80it/s]
                                                         
{'loss': 2.5366, 'learning_rate': 1.299909500312439e-07, 'epoch': 15.47}

 97%|█████████▋| 359100/371472 [6:25:00<54:14,  3.80it/s]
 97%|█████████▋| 359101/371472 [6:25:00<55:28,  3.72it/s]
 97%|█████████▋| 359102/371472 [6:25:00<56:33,  3.65it/s]
 97%|█████████▋| 359103/371472 [6:25:00<54:09,  3.81it/s]
 97%|█████████▋| 359104/371472 [6:25:01<55:19,  3.73it/s]
 97%|█████████▋| 359105/371472 [6:25:01<54:41,  3.77it/s]
 97%|█████████▋| 359106/371472 [6:25:01<1:01:41,  3.34it/s]
 97%|█████████▋| 359107/371472 [6:25:02<1:01:38,  3.34it/s]
 97%|█████████▋| 359108/371472 [6:25:02<59:22,  3.47it/s]  
 97%|█████████▋| 359109/371472 [6:25:02<56:43,  3.63it/s]
 97%|█████████▋| 359110/371472 [6:25:02<57:04,  3.61it/s]
 97%|█████████▋| 359111/371472 [6:25:03<55:14,  3.73it/s]
 97%|█████████▋| 359112/371472 [6:25:03<54:27,  3.78it/s]
 97%|█████████▋| 359113/371472 [6:25:03<58:11,  3.54it/s]
 97%|█████████▋| 359114/371472 [6:25:04<58:08,  3.54it/s]
 97%|█████████▋| 359115/371472 [6:25:04<58:38,  3.51it/s]
 97%|█████████▋| 359116/371472 [6:25:04<55:44,  3.69it/s]
 97%|█████████▋| 359117/371472 [6:25:04<54:06,  3.81it/s]
 97%|█████████▋| 359118/371472 [6:25:05<55:15,  3.73it/s]
 97%|█████████▋| 359119/371472 [6:25:05<54:55,  3.75it/s]
 97%|█████████▋| 359120/371472 [6:25:05<56:35,  3.64it/s]
                                                         
{'loss': 2.7086, 'learning_rate': 1.2994246805576507e-07, 'epoch': 15.47}

 97%|█████████▋| 359120/371472 [6:25:05<56:35,  3.64it/s]
 97%|█████████▋| 359121/371472 [6:25:06<59:28,  3.46it/s]
 97%|█████████▋| 359122/371472 [6:25:06<59:25,  3.46it/s]
 97%|█████████▋| 359123/371472 [6:25:06<58:22,  3.53it/s]
 97%|█████████▋| 359124/371472 [6:25:06<58:35,  3.51it/s]
 97%|█████████▋| 359125/371472 [6:25:07<56:44,  3.63it/s]
 97%|█████████▋| 359126/371472 [6:25:07<56:15,  3.66it/s]
 97%|█████████▋| 359127/371472 [6:25:07<57:28,  3.58it/s]
 97%|█████████▋| 359128/371472 [6:25:08<1:03:37,  3.23it/s]
 97%|█████████▋| 359129/371472 [6:25:08<1:02:27,  3.29it/s]
 97%|█████████▋| 359130/371472 [6:25:08<59:41,  3.45it/s]  
 97%|█████████▋| 359131/371472 [6:25:08<1:02:31,  3.29it/s]
 97%|█████████▋| 359132/371472 [6:25:09<58:30,  3.52it/s]  
 97%|█████████▋| 359133/371472 [6:25:09<1:01:42,  3.33it/s]
 97%|█████████▋| 359134/371472 [6:25:09<1:00:07,  3.42it/s]
 97%|█████████▋| 359135/371472 [6:25:10<57:07,  3.60it/s]  
 97%|█████████▋| 359136/371472 [6:25:10<56:07,  3.66it/s]
 97%|█████████▋| 359137/371472 [6:25:10<56:07,  3.66it/s]
 97%|█████████▋| 359138/371472 [6:25:10<54:54,  3.74it/s]
 97%|█████████▋| 359139/371472 [6:25:11<57:58,  3.55it/s]
 97%|█████████▋| 359140/371472 [6:25:11<58:20,  3.52it/s]
                                                         
{'loss': 2.4984, 'learning_rate': 1.298939860802861e-07, 'epoch': 15.47}

 97%|█████████▋| 359140/371472 [6:25:11<58:20,  3.52it/s]
 97%|█████████▋| 359141/371472 [6:25:11<57:06,  3.60it/s]
 97%|█████████▋| 359142/371472 [6:25:11<57:00,  3.60it/s]
 97%|█████████▋| 359143/371472 [6:25:12<55:16,  3.72it/s]
 97%|█████████▋| 359144/371472 [6:25:12<1:00:59,  3.37it/s]
 97%|█████████▋| 359145/371472 [6:25:12<1:00:25,  3.40it/s]
 97%|█████████▋| 359146/371472 [6:25:13<58:02,  3.54it/s]  
 97%|█████████▋| 359147/371472 [6:25:13<59:10,  3.47it/s]
 97%|█████████▋| 359148/371472 [6:25:13<1:01:06,  3.36it/s]
 97%|█████████▋| 359149/371472 [6:25:14<59:08,  3.47it/s]  
 97%|█████████▋| 359150/371472 [6:25:14<58:45,  3.50it/s]
 97%|█████████▋| 359151/371472 [6:25:14<57:25,  3.58it/s]
 97%|█████████▋| 359152/371472 [6:25:14<56:38,  3.62it/s]
 97%|█████████▋| 359153/371472 [6:25:15<56:27,  3.64it/s]
 97%|█████████▋| 359154/371472 [6:25:15<59:18,  3.46it/s]
 97%|█████████▋| 359155/371472 [6:25:15<1:02:34,  3.28it/s]
 97%|█████████▋| 359156/371472 [6:25:16<59:08,  3.47it/s]  
 97%|█████████▋| 359157/371472 [6:25:16<58:24,  3.51it/s]
 97%|█████████▋| 359158/371472 [6:25:16<57:44,  3.55it/s]
 97%|█████████▋| 359159/371472 [6:25:16<1:00:59,  3.36it/s]
 97%|█████████▋| 359160/371472 [6:25:17<1:02:54,  3.26it/s]
                                                           
{'loss': 2.376, 'learning_rate': 1.2984550410480726e-07, 'epoch': 15.47}

 97%|█████████▋| 359160/371472 [6:25:17<1:02:54,  3.26it/s]
 97%|█████████▋| 359161/371472 [6:25:17<58:33,  3.50it/s]  
 97%|█████████▋| 359162/371472 [6:25:17<57:51,  3.55it/s]
 97%|█████████▋| 359163/371472 [6:25:18<58:31,  3.51it/s]
 97%|█████████▋| 359164/371472 [6:25:18<56:42,  3.62it/s]
 97%|█████████▋| 359165/371472 [6:25:18<55:46,  3.68it/s]
 97%|█████████▋| 359166/371472 [6:25:18<55:25,  3.70it/s]
 97%|█████████▋| 359167/371472 [6:25:19<53:50,  3.81it/s]
 97%|█████████▋| 359168/371472 [6:25:19<51:46,  3.96it/s]
 97%|█████████▋| 359169/371472 [6:25:19<54:38,  3.75it/s]
 97%|█████████▋| 359170/371472 [6:25:19<55:08,  3.72it/s]
 97%|█████████▋| 359171/371472 [6:25:20<54:41,  3.75it/s]
 97%|█████████▋| 359172/371472 [6:25:20<54:14,  3.78it/s]
 97%|█████████▋| 359173/371472 [6:25:20<53:37,  3.82it/s]
 97%|█████████▋| 359174/371472 [6:25:20<55:21,  3.70it/s]
 97%|█████████▋| 359175/371472 [6:25:21<53:41,  3.82it/s]
 97%|█████████▋| 359176/371472 [6:25:21<55:14,  3.71it/s]
 97%|█████████▋| 359177/371472 [6:25:21<1:01:15,  3.35it/s]
 97%|█████████▋| 359178/371472 [6:25:22<58:38,  3.49it/s]  
 97%|█████████▋| 359179/371472 [6:25:22<57:15,  3.58it/s]
 97%|█████████▋| 359180/371472 [6:25:22<59:47,  3.43it/s]
                                                         
{'loss': 2.6673, 'learning_rate': 1.2979702212932833e-07, 'epoch': 15.47}

 97%|█████████▋| 359180/371472 [6:25:22<59:47,  3.43it/s]
 97%|█████████▋| 359181/371472 [6:25:22<59:49,  3.42it/s]
 97%|█████████▋| 359182/371472 [6:25:23<57:58,  3.53it/s]
 97%|█████████▋| 359183/371472 [6:25:23<59:18,  3.45it/s]
 97%|█████████▋| 359184/371472 [6:25:23<57:33,  3.56it/s]
 97%|█████████▋| 359185/371472 [6:25:24<1:02:26,  3.28it/s]
 97%|█████████▋| 359186/371472 [6:25:24<1:00:21,  3.39it/s]
 97%|█████████▋| 359187/371472 [6:25:24<59:13,  3.46it/s]  
 97%|█████████▋| 359188/371472 [6:25:24<56:58,  3.59it/s]
 97%|█████████▋| 359189/371472 [6:25:25<1:00:09,  3.40it/s]
 97%|█████████▋| 359190/371472 [6:25:25<58:57,  3.47it/s]  
 97%|█████████▋| 359191/371472 [6:25:25<56:47,  3.60it/s]
 97%|█████████▋| 359192/371472 [6:25:26<57:25,  3.56it/s]
 97%|█████████▋| 359193/371472 [6:25:26<56:54,  3.60it/s]
 97%|█████████▋| 359194/371472 [6:25:26<56:11,  3.64it/s]
 97%|█████████▋| 359195/371472 [6:25:26<59:08,  3.46it/s]
 97%|█████████▋| 359196/371472 [6:25:27<57:39,  3.55it/s]
 97%|█████████▋| 359197/371472 [6:25:27<56:06,  3.65it/s]
 97%|█████████▋| 359198/371472 [6:25:27<55:42,  3.67it/s]
 97%|█████████▋| 359199/371472 [6:25:28<55:44,  3.67it/s]
 97%|█████████▋| 359200/371472 [6:25:28<55:32,  3.68it/s]
                                                         
{'loss': 2.5011, 'learning_rate': 1.2974854015384948e-07, 'epoch': 15.47}

 97%|█████████▋| 359200/371472 [6:25:28<55:32,  3.68it/s]
 97%|█████████▋| 359201/371472 [6:25:28<57:45,  3.54it/s]
 97%|█████████▋| 359202/371472 [6:25:28<1:00:24,  3.39it/s]
 97%|█████████▋| 359203/371472 [6:25:29<59:17,  3.45it/s]  
 97%|█████████▋| 359204/371472 [6:25:29<57:54,  3.53it/s]
 97%|█████████▋| 359205/371472 [6:25:29<59:02,  3.46it/s]
 97%|█████████▋| 359206/371472 [6:25:30<58:08,  3.52it/s]
 97%|█████████▋| 359207/371472 [6:25:30<56:38,  3.61it/s]
 97%|█████████▋| 359208/371472 [6:25:30<56:30,  3.62it/s]
 97%|█████████▋| 359209/371472 [6:25:30<59:16,  3.45it/s]
 97%|█████████▋| 359210/371472 [6:25:31<58:14,  3.51it/s]
 97%|█████████▋| 359211/371472 [6:25:31<1:00:14,  3.39it/s]
 97%|█████████▋| 359212/371472 [6:25:31<58:13,  3.51it/s]  
 97%|█████████▋| 359213/371472 [6:25:32<56:15,  3.63it/s]
 97%|█████████▋| 359214/371472 [6:25:32<54:29,  3.75it/s]
 97%|█████████▋| 359215/371472 [6:25:32<54:37,  3.74it/s]
 97%|█████████▋| 359216/371472 [6:25:32<54:44,  3.73it/s]
 97%|█████████▋| 359217/371472 [6:25:33<58:15,  3.51it/s]
 97%|█████████▋| 359218/371472 [6:25:33<1:00:39,  3.37it/s]
 97%|█████████▋| 359219/371472 [6:25:33<57:56,  3.52it/s]  
 97%|█████████▋| 359220/371472 [6:25:33<57:46,  3.53it/s]
                                                         
{'loss': 2.7215, 'learning_rate': 1.2970005817837053e-07, 'epoch': 15.47}

 97%|█████████▋| 359220/371472 [6:25:33<57:46,  3.53it/s]
 97%|█████████▋| 359221/371472 [6:25:34<57:09,  3.57it/s]
 97%|█████████▋| 359222/371472 [6:25:34<56:53,  3.59it/s]
 97%|█████████▋| 359223/371472 [6:25:34<57:35,  3.54it/s]
 97%|█████████▋| 359224/371472 [6:25:35<56:32,  3.61it/s]
 97%|█████████▋| 359225/371472 [6:25:35<54:58,  3.71it/s]
 97%|█████████▋| 359226/371472 [6:25:35<55:54,  3.65it/s]
 97%|█████████▋| 359227/371472 [6:25:35<54:02,  3.78it/s]
 97%|█████████▋| 359228/371472 [6:25:36<53:58,  3.78it/s]
 97%|█████████▋| 359229/371472 [6:25:36<55:30,  3.68it/s]
 97%|█████████▋| 359230/371472 [6:25:36<56:23,  3.62it/s]
 97%|█████████▋| 359231/371472 [6:25:36<57:02,  3.58it/s]
 97%|█████████▋| 359232/371472 [6:25:37<55:19,  3.69it/s]
 97%|█████████▋| 359233/371472 [6:25:37<56:00,  3.64it/s]
 97%|█████████▋| 359234/371472 [6:25:37<56:20,  3.62it/s]
 97%|█████████▋| 359235/371472 [6:25:38<53:53,  3.78it/s]
 97%|█████████▋| 359236/371472 [6:25:38<53:19,  3.82it/s]
 97%|█████████▋| 359237/371472 [6:25:38<55:43,  3.66it/s]
 97%|█████████▋| 359238/371472 [6:25:38<53:31,  3.81it/s]
 97%|█████████▋| 359239/371472 [6:25:39<54:12,  3.76it/s]
 97%|█████████▋| 359240/371472 [6:25:39<56:51,  3.59it/s]
                                                         
{'loss': 2.6141, 'learning_rate': 1.296515762028917e-07, 'epoch': 15.47}

 97%|█████████▋| 359240/371472 [6:25:39<56:51,  3.59it/s]
 97%|█████████▋| 359241/371472 [6:25:39<56:26,  3.61it/s]
 97%|█████████▋| 359242/371472 [6:25:39<55:47,  3.65it/s]
 97%|█████████▋| 359243/371472 [6:25:40<57:30,  3.54it/s]
 97%|█████████▋| 359244/371472 [6:25:40<59:35,  3.42it/s]
 97%|█████████▋| 359245/371472 [6:25:40<57:08,  3.57it/s]
 97%|█████████▋| 359246/371472 [6:25:41<54:30,  3.74it/s]
 97%|█████████▋| 359247/371472 [6:25:41<56:48,  3.59it/s]
 97%|█████████▋| 359248/371472 [6:25:41<56:14,  3.62it/s]
 97%|█████████▋| 359249/371472 [6:25:42<1:02:27,  3.26it/s]
 97%|█████████▋| 359250/371472 [6:25:42<1:00:34,  3.36it/s]
 97%|█████████▋| 359251/371472 [6:25:42<58:18,  3.49it/s]  
 97%|█████████▋| 359252/371472 [6:25:42<58:00,  3.51it/s]
 97%|█████████▋| 359253/371472 [6:25:43<56:57,  3.58it/s]
 97%|█████████▋| 359254/371472 [6:25:43<56:13,  3.62it/s]
 97%|█████████▋| 359255/371472 [6:25:43<54:50,  3.71it/s]
 97%|█████████▋| 359256/371472 [6:25:43<54:22,  3.74it/s]
 97%|█████████▋| 359257/371472 [6:25:44<56:00,  3.63it/s]
 97%|█████████▋| 359258/371472 [6:25:44<55:10,  3.69it/s]
 97%|█████████▋| 359259/371472 [6:25:44<55:05,  3.69it/s]
 97%|█████████▋| 359260/371472 [6:25:44<55:52,  3.64it/s]
                                                         
{'loss': 2.5615, 'learning_rate': 1.2960309422741275e-07, 'epoch': 15.47}

 97%|█████████▋| 359260/371472 [6:25:44<55:52,  3.64it/s]
 97%|█████████▋| 359261/371472 [6:25:45<53:46,  3.78it/s]
 97%|█████████▋| 359262/371472 [6:25:45<52:54,  3.85it/s]
 97%|█████████▋| 359263/371472 [6:25:45<59:15,  3.43it/s]
 97%|█████████▋| 359264/371472 [6:25:46<57:51,  3.52it/s]
 97%|█████████▋| 359265/371472 [6:25:46<55:47,  3.65it/s]
 97%|█████████▋| 359266/371472 [6:25:46<55:37,  3.66it/s]
 97%|█████████▋| 359267/371472 [6:25:46<59:22,  3.43it/s]
 97%|█████████▋| 359268/371472 [6:25:47<58:27,  3.48it/s]
 97%|█████████▋| 359269/371472 [6:25:47<57:09,  3.56it/s]
 97%|█████████▋| 359270/371472 [6:25:47<55:59,  3.63it/s]
 97%|█████████▋| 359271/371472 [6:25:48<1:00:20,  3.37it/s]
 97%|█████████▋| 359272/371472 [6:25:48<58:53,  3.45it/s]  
 97%|█████████▋| 359273/371472 [6:25:48<56:54,  3.57it/s]
 97%|█████████▋| 359274/371472 [6:25:48<55:40,  3.65it/s]
 97%|█████████▋| 359275/371472 [6:25:49<54:00,  3.76it/s]
 97%|█████████▋| 359276/371472 [6:25:49<53:05,  3.83it/s]
 97%|█████████▋| 359277/371472 [6:25:49<59:26,  3.42it/s]
 97%|█████████▋| 359278/371472 [6:25:50<1:01:22,  3.31it/s]
 97%|█████████▋| 359279/371472 [6:25:50<1:00:21,  3.37it/s]
 97%|█████████▋| 359280/371472 [6:25:50<59:44,  3.40it/s]  
                                                         
{'loss': 2.463, 'learning_rate': 1.295546122519339e-07, 'epoch': 15.47}

 97%|█████████▋| 359280/371472 [6:25:50<59:44,  3.40it/s]
 97%|█████████▋| 359281/371472 [6:25:50<57:54,  3.51it/s]
 97%|█████████▋| 359282/371472 [6:25:51<55:44,  3.64it/s]
 97%|█████████▋| 359283/371472 [6:25:51<58:28,  3.47it/s]
 97%|█████████▋| 359284/371472 [6:25:51<55:49,  3.64it/s]
 97%|█████████▋| 359285/371472 [6:25:52<54:31,  3.73it/s]
 97%|█████████▋| 359286/371472 [6:25:52<1:00:49,  3.34it/s]
 97%|█████████▋| 359287/371472 [6:25:52<59:59,  3.39it/s]  
 97%|█████████▋| 359288/371472 [6:25:52<57:34,  3.53it/s]
 97%|█████████▋| 359289/371472 [6:25:53<55:28,  3.66it/s]
 97%|█████████▋| 359290/371472 [6:25:53<59:48,  3.39it/s]
 97%|█████████▋| 359291/371472 [6:25:53<59:41,  3.40it/s]
 97%|█████████▋| 359292/371472 [6:25:54<56:44,  3.58it/s]
 97%|█████████▋| 359293/371472 [6:25:54<56:19,  3.60it/s]
 97%|█████████▋| 359294/371472 [6:25:54<58:24,  3.47it/s]
 97%|█████████▋| 359295/371472 [6:25:54<55:58,  3.63it/s]
 97%|█████████▋| 359296/371472 [6:25:55<58:15,  3.48it/s]
 97%|█████████▋| 359297/371472 [6:25:55<57:57,  3.50it/s]
 97%|█████████▋| 359298/371472 [6:25:55<1:01:25,  3.30it/s]
 97%|█████████▋| 359299/371472 [6:25:56<1:00:36,  3.35it/s]
 97%|█████████▋| 359300/371472 [6:25:56<59:53,  3.39it/s]  
                                                         
{'loss': 2.5259, 'learning_rate': 1.2950613027645497e-07, 'epoch': 15.48}

 97%|█████████▋| 359300/371472 [6:25:56<59:53,  3.39it/s]
 97%|█████████▋| 359301/371472 [6:25:56<1:00:37,  3.35it/s]
 97%|█████████▋| 359302/371472 [6:25:56<58:13,  3.48it/s]  
 97%|█████████▋| 359303/371472 [6:25:57<56:56,  3.56it/s]
 97%|█████████▋| 359304/371472 [6:25:57<57:01,  3.56it/s]
 97%|█████████▋| 359305/371472 [6:25:57<59:09,  3.43it/s]
 97%|█████████▋| 359306/371472 [6:25:58<58:25,  3.47it/s]
 97%|█████████▋| 359307/371472 [6:25:58<57:26,  3.53it/s]
 97%|█████████▋| 359308/371472 [6:25:58<55:54,  3.63it/s]
 97%|█████████▋| 359309/371472 [6:25:58<55:30,  3.65it/s]
 97%|█████████▋| 359310/371472 [6:25:59<59:39,  3.40it/s]
 97%|█████████▋| 359311/371472 [6:25:59<59:17,  3.42it/s]
 97%|█████████▋| 359312/371472 [6:25:59<1:00:52,  3.33it/s]
 97%|█████████▋| 359313/371472 [6:26:00<57:48,  3.51it/s]  
 97%|█████████▋| 359314/371472 [6:26:00<55:47,  3.63it/s]
 97%|█████████▋| 359315/371472 [6:26:00<55:54,  3.62it/s]
 97%|█████████▋| 359316/371472 [6:26:00<55:04,  3.68it/s]
 97%|█████████▋| 359317/371472 [6:26:01<56:09,  3.61it/s]
 97%|█████████▋| 359318/371472 [6:26:01<55:02,  3.68it/s]
 97%|█████████▋| 359319/371472 [6:26:01<57:23,  3.53it/s]
 97%|█████████▋| 359320/371472 [6:26:02<54:49,  3.69it/s]
                                                         
{'loss': 2.5497, 'learning_rate': 1.2945764830097613e-07, 'epoch': 15.48}

 97%|█████████▋| 359320/371472 [6:26:02<54:49,  3.69it/s]
 97%|█████████▋| 359321/371472 [6:26:02<1:01:31,  3.29it/s]
 97%|█████████▋| 359322/371472 [6:26:02<59:42,  3.39it/s]  
 97%|█████████▋| 359323/371472 [6:26:02<57:30,  3.52it/s]
 97%|█████████▋| 359324/371472 [6:26:03<55:56,  3.62it/s]
 97%|█████████▋| 359325/371472 [6:26:03<54:38,  3.70it/s]
 97%|█████████▋| 359326/371472 [6:26:03<54:01,  3.75it/s]
 97%|█████████▋| 359327/371472 [6:26:03<53:47,  3.76it/s]
 97%|█████████▋| 359328/371472 [6:26:04<53:51,  3.76it/s]
 97%|█████████▋| 359329/371472 [6:26:04<57:07,  3.54it/s]
 97%|█████████▋| 359330/371472 [6:26:04<56:42,  3.57it/s]
 97%|█████████▋| 359331/371472 [6:26:05<54:57,  3.68it/s]
 97%|█████████▋| 359332/371472 [6:26:05<56:14,  3.60it/s]
 97%|█████████▋| 359333/371472 [6:26:05<55:33,  3.64it/s]
 97%|█████████▋| 359334/371472 [6:26:05<54:19,  3.72it/s]
 97%|█████████▋| 359335/371472 [6:26:06<54:13,  3.73it/s]
 97%|█████████▋| 359336/371472 [6:26:06<55:45,  3.63it/s]
 97%|█████████▋| 359337/371472 [6:26:06<54:56,  3.68it/s]
 97%|█████████▋| 359338/371472 [6:26:06<55:51,  3.62it/s]
 97%|█████████▋| 359339/371472 [6:26:07<59:46,  3.38it/s]
 97%|█████████▋| 359340/371472 [6:26:07<1:00:32,  3.34it/s]
                                                           
{'loss': 2.5841, 'learning_rate': 1.294091663254972e-07, 'epoch': 15.48}

 97%|█████████▋| 359340/371472 [6:26:07<1:00:32,  3.34it/s]
 97%|█████████▋| 359341/371472 [6:26:07<59:53,  3.38it/s]  
 97%|█████████▋| 359342/371472 [6:26:08<58:25,  3.46it/s]
 97%|█████████▋| 359343/371472 [6:26:08<1:04:41,  3.13it/s]
 97%|█████████▋| 359344/371472 [6:26:08<1:02:29,  3.23it/s]
 97%|█████████▋| 359345/371472 [6:26:09<59:57,  3.37it/s]  
 97%|█████████▋| 359346/371472 [6:26:09<1:00:25,  3.35it/s]
 97%|█████████▋| 359347/371472 [6:26:09<57:48,  3.50it/s]  
 97%|█████████▋| 359348/371472 [6:26:09<56:59,  3.55it/s]
 97%|█████████▋| 359349/371472 [6:26:10<59:42,  3.38it/s]
 97%|█████████▋| 359350/371472 [6:26:10<1:03:28,  3.18it/s]
 97%|█████████▋| 359351/371472 [6:26:10<1:02:47,  3.22it/s]
 97%|█████████▋| 359352/371472 [6:26:11<1:00:08,  3.36it/s]
 97%|█████████▋| 359353/371472 [6:26:11<59:11,  3.41it/s]  
 97%|█████████▋| 359354/371472 [6:26:11<59:13,  3.41it/s]
 97%|█████████▋| 359355/371472 [6:26:12<56:29,  3.57it/s]
 97%|█████████▋| 359356/371472 [6:26:12<54:21,  3.71it/s]
 97%|█████████▋| 359357/371472 [6:26:12<56:19,  3.58it/s]
 97%|█████████▋| 359358/371472 [6:26:12<58:38,  3.44it/s]
 97%|█████████▋| 359359/371472 [6:26:13<58:32,  3.45it/s]
 97%|█████████▋| 359360/371472 [6:26:13<56:11,  3.59it/s]
                                                         
{'loss': 2.6298, 'learning_rate': 1.2936068435001835e-07, 'epoch': 15.48}

 97%|█████████▋| 359360/371472 [6:26:13<56:11,  3.59it/s]
 97%|█████████▋| 359361/371472 [6:26:13<54:14,  3.72it/s]
 97%|█████████▋| 359362/371472 [6:26:14<59:06,  3.42it/s]
 97%|█████████▋| 359363/371472 [6:26:14<59:06,  3.41it/s]
 97%|█████████▋| 359364/371472 [6:26:14<57:04,  3.54it/s]
 97%|█████████▋| 359365/371472 [6:26:14<55:24,  3.64it/s]
 97%|█████████▋| 359366/371472 [6:26:15<53:25,  3.78it/s]
 97%|█████████▋| 359367/371472 [6:26:15<52:33,  3.84it/s]
 97%|█████████▋| 359368/371472 [6:26:15<51:47,  3.90it/s]
 97%|█████████▋| 359369/371472 [6:26:15<52:51,  3.82it/s]
 97%|█████████▋| 359370/371472 [6:26:16<51:22,  3.93it/s]
 97%|█████████▋| 359371/371472 [6:26:16<51:54,  3.89it/s]
 97%|█████████▋| 359372/371472 [6:26:16<54:52,  3.67it/s]
 97%|█████████▋| 359373/371472 [6:26:16<57:35,  3.50it/s]
 97%|█████████▋| 359374/371472 [6:26:17<56:03,  3.60it/s]
 97%|█████████▋| 359375/371472 [6:26:17<1:00:34,  3.33it/s]
 97%|█████████▋| 359376/371472 [6:26:17<57:11,  3.52it/s]  
 97%|█████████▋| 359377/371472 [6:26:18<57:21,  3.51it/s]
 97%|█████████▋| 359378/371472 [6:26:18<55:57,  3.60it/s]
 97%|█████████▋| 359379/371472 [6:26:18<57:13,  3.52it/s]
 97%|█████████▋| 359380/371472 [6:26:19<1:02:21,  3.23it/s]
                                                           
{'loss': 2.632, 'learning_rate': 1.293122023745394e-07, 'epoch': 15.48}

 97%|█████████▋| 359380/371472 [6:26:19<1:02:21,  3.23it/s]
 97%|█████████▋| 359381/371472 [6:26:19<59:51,  3.37it/s]  
 97%|█████████▋| 359382/371472 [6:26:19<56:28,  3.57it/s]
 97%|█████████▋| 359383/371472 [6:26:19<58:40,  3.43it/s]
 97%|█████████▋| 359384/371472 [6:26:20<56:48,  3.55it/s]
 97%|█████████▋| 359385/371472 [6:26:20<56:37,  3.56it/s]
 97%|█████████▋| 359386/371472 [6:26:20<1:01:24,  3.28it/s]
 97%|█████████▋| 359387/371472 [6:26:21<58:43,  3.43it/s]  
 97%|█████████▋| 359388/371472 [6:26:21<1:06:54,  3.01it/s]
 97%|█████████▋| 359389/371472 [6:26:21<1:02:40,  3.21it/s]
 97%|█████████▋| 359390/371472 [6:26:22<59:06,  3.41it/s]  
 97%|█████████▋| 359391/371472 [6:26:22<56:20,  3.57it/s]
 97%|█████████▋| 359392/371472 [6:26:22<56:39,  3.55it/s]
 97%|█████████▋| 359393/371472 [6:26:22<57:05,  3.53it/s]
 97%|█████████▋| 359394/371472 [6:26:23<58:00,  3.47it/s]
 97%|█████████▋| 359395/371472 [6:26:23<57:46,  3.48it/s]
 97%|█████████▋| 359396/371472 [6:26:23<1:01:38,  3.27it/s]
 97%|█████████▋| 359397/371472 [6:26:24<1:01:06,  3.29it/s]
 97%|█████████▋| 359398/371472 [6:26:24<59:14,  3.40it/s]  
 97%|█████████▋| 359399/371472 [6:26:24<1:01:38,  3.26it/s]
 97%|█████████▋| 359400/371472 [6:26:24<58:57,  3.41it/s]  
                                                         
{'loss': 2.5546, 'learning_rate': 1.2926372039906057e-07, 'epoch': 15.48}

 97%|█████████▋| 359400/371472 [6:26:24<58:57,  3.41it/s]
 97%|█████████▋| 359401/371472 [6:26:25<58:24,  3.44it/s]
 97%|█████████▋| 359402/371472 [6:26:25<59:45,  3.37it/s]
 97%|█████████▋| 359403/371472 [6:26:25<59:58,  3.35it/s]
 97%|█████████▋| 359404/371472 [6:26:26<57:41,  3.49it/s]
 97%|█████████▋| 359405/371472 [6:26:26<56:20,  3.57it/s]
 97%|█████████▋| 359406/371472 [6:26:26<55:19,  3.63it/s]
 97%|█████████▋| 359407/371472 [6:26:26<53:41,  3.75it/s]
 97%|█████████▋| 359408/371472 [6:26:27<55:22,  3.63it/s]
 97%|█████████▋| 359409/371472 [6:26:27<55:36,  3.62it/s]
 97%|█████████▋| 359410/371472 [6:26:27<54:25,  3.69it/s]
 97%|█████████▋| 359411/371472 [6:26:27<54:41,  3.68it/s]
 97%|█████████▋| 359412/371472 [6:26:28<57:53,  3.47it/s]
 97%|█████████▋| 359413/371472 [6:26:28<55:44,  3.61it/s]
 97%|█████████▋| 359414/371472 [6:26:28<54:26,  3.69it/s]
 97%|█████████▋| 359415/371472 [6:26:29<58:59,  3.41it/s]
 97%|█████████▋| 359416/371472 [6:26:29<59:04,  3.40it/s]
 97%|█████████▋| 359417/371472 [6:26:29<56:58,  3.53it/s]
 97%|█████████▋| 359418/371472 [6:26:29<56:03,  3.58it/s]
 97%|█████████▋| 359419/371472 [6:26:30<58:26,  3.44it/s]
 97%|█████████▋| 359420/371472 [6:26:30<56:53,  3.53it/s]
                                                         
{'loss': 2.4961, 'learning_rate': 1.2921523842358161e-07, 'epoch': 15.48}

 97%|█████████▋| 359420/371472 [6:26:30<56:53,  3.53it/s]
 97%|█████████▋| 359421/371472 [6:26:30<55:14,  3.64it/s]
 97%|█████████▋| 359422/371472 [6:26:31<54:58,  3.65it/s]
 97%|█████████▋| 359423/371472 [6:26:31<56:23,  3.56it/s]
 97%|█████████▋| 359424/371472 [6:26:31<58:52,  3.41it/s]
 97%|█████████▋| 359425/371472 [6:26:31<57:17,  3.50it/s]
 97%|█████████▋| 359426/371472 [6:26:32<57:21,  3.50it/s]
 97%|█████████▋| 359427/371472 [6:26:32<59:19,  3.38it/s]
 97%|█████████▋| 359428/371472 [6:26:32<59:07,  3.39it/s]
 97%|█████████▋| 359429/371472 [6:26:33<57:45,  3.47it/s]
 97%|█████████▋| 359430/371472 [6:26:33<55:21,  3.63it/s]
 97%|█████████▋| 359431/371472 [6:26:33<56:03,  3.58it/s]
 97%|█████████▋| 359432/371472 [6:26:33<53:48,  3.73it/s]
 97%|█████████▋| 359433/371472 [6:26:34<52:19,  3.83it/s]
 97%|█████████▋| 359434/371472 [6:26:34<1:00:15,  3.33it/s]
 97%|█████████▋| 359435/371472 [6:26:34<56:59,  3.52it/s]  
 97%|█████████▋| 359436/371472 [6:26:35<55:18,  3.63it/s]
 97%|█████████▋| 359437/371472 [6:26:35<54:00,  3.71it/s]
 97%|█████████▋| 359438/371472 [6:26:35<54:32,  3.68it/s]
 97%|█████████▋| 359439/371472 [6:26:35<58:18,  3.44it/s]
 97%|█████████▋| 359440/371472 [6:26:36<56:33,  3.55it/s]
                                                         
{'loss': 2.5815, 'learning_rate': 1.2916675644810277e-07, 'epoch': 15.48}

 97%|█████████▋| 359440/371472 [6:26:36<56:33,  3.55it/s]
 97%|█████████▋| 359441/371472 [6:26:36<56:54,  3.52it/s]
 97%|█████████▋| 359442/371472 [6:26:36<1:01:40,  3.25it/s]
 97%|█████████▋| 359443/371472 [6:26:37<59:06,  3.39it/s]  
 97%|█████████▋| 359444/371472 [6:26:37<58:27,  3.43it/s]
 97%|█████████▋| 359445/371472 [6:26:37<59:25,  3.37it/s]
 97%|█████████▋| 359446/371472 [6:26:37<59:00,  3.40it/s]
 97%|█████████▋| 359447/371472 [6:26:38<56:51,  3.52it/s]
 97%|█████████▋| 359448/371472 [6:26:38<55:51,  3.59it/s]
 97%|█████████▋| 359449/371472 [6:26:38<53:17,  3.76it/s]
 97%|█████████▋| 359450/371472 [6:26:39<54:07,  3.70it/s]
 97%|█████████▋| 359451/371472 [6:26:39<54:35,  3.67it/s]
 97%|█████████▋| 359452/371472 [6:26:39<53:19,  3.76it/s]
 97%|█████████▋| 359453/371472 [6:26:39<52:58,  3.78it/s]
 97%|█████████▋| 359454/371472 [6:26:40<56:03,  3.57it/s]
 97%|█████████▋| 359455/371472 [6:26:40<57:11,  3.50it/s]
 97%|█████████▋| 359456/371472 [6:26:40<55:40,  3.60it/s]
 97%|█████████▋| 359457/371472 [6:26:41<1:07:25,  2.97it/s]
 97%|█████████▋| 359458/371472 [6:26:41<1:03:02,  3.18it/s]
 97%|█████████▋| 359459/371472 [6:26:41<1:01:10,  3.27it/s]
 97%|█████████▋| 359460/371472 [6:26:42<1:00:44,  3.30it/s]
                                                           
{'loss': 2.7068, 'learning_rate': 1.2911827447262384e-07, 'epoch': 15.48}

 97%|█████████▋| 359460/371472 [6:26:42<1:00:44,  3.30it/s]
 97%|█████████▋| 359461/371472 [6:26:42<57:44,  3.47it/s]  
 97%|█████████▋| 359462/371472 [6:26:42<58:38,  3.41it/s]
 97%|█████████▋| 359463/371472 [6:26:42<57:00,  3.51it/s]
 97%|█████████▋| 359464/371472 [6:26:43<56:37,  3.53it/s]
 97%|█████████▋| 359465/371472 [6:26:43<55:49,  3.58it/s]
 97%|█████████▋| 359466/371472 [6:26:43<55:12,  3.62it/s]
 97%|█████████▋| 359467/371472 [6:26:43<55:05,  3.63it/s]
 97%|█████████▋| 359468/371472 [6:26:44<55:05,  3.63it/s]
 97%|█████████▋| 359469/371472 [6:26:44<53:36,  3.73it/s]
 97%|█████████▋| 359470/371472 [6:26:44<52:56,  3.78it/s]
 97%|█████████▋| 359471/371472 [6:26:44<54:12,  3.69it/s]
 97%|█████████▋| 359472/371472 [6:26:45<54:34,  3.66it/s]
 97%|█████████▋| 359473/371472 [6:26:45<59:28,  3.36it/s]
 97%|█████████▋| 359474/371472 [6:26:45<57:37,  3.47it/s]
 97%|█████████▋| 359475/371472 [6:26:46<57:13,  3.49it/s]
 97%|█████████▋| 359476/371472 [6:26:46<55:15,  3.62it/s]
 97%|█████████▋| 359477/371472 [6:26:46<55:44,  3.59it/s]
 97%|█████████▋| 359478/371472 [6:26:46<54:42,  3.65it/s]
 97%|█████████▋| 359479/371472 [6:26:47<57:16,  3.49it/s]
 97%|█████████▋| 359480/371472 [6:26:47<54:10,  3.69it/s]
                                                         
{'loss': 2.4765, 'learning_rate': 1.2906979249714496e-07, 'epoch': 15.48}

 97%|█████████▋| 359480/371472 [6:26:47<54:10,  3.69it/s]
 97%|█████████▋| 359481/371472 [6:26:47<56:33,  3.53it/s]
 97%|█████████▋| 359482/371472 [6:26:48<54:57,  3.64it/s]
 97%|█████████▋| 359483/371472 [6:26:48<54:02,  3.70it/s]
 97%|█████████▋| 359484/371472 [6:26:48<55:04,  3.63it/s]
 97%|█████████▋| 359485/371472 [6:26:48<55:23,  3.61it/s]
 97%|█████████▋| 359486/371472 [6:26:49<54:18,  3.68it/s]
 97%|█████████▋| 359487/371472 [6:26:49<54:54,  3.64it/s]
 97%|█████████▋| 359488/371472 [6:26:49<52:59,  3.77it/s]
 97%|█████████▋| 359489/371472 [6:26:49<53:15,  3.75it/s]
 97%|█████████▋| 359490/371472 [6:26:50<53:23,  3.74it/s]
 97%|█████████▋| 359491/371472 [6:26:50<55:41,  3.59it/s]
 97%|█████████▋| 359492/371472 [6:26:50<56:30,  3.53it/s]
 97%|█████████▋| 359493/371472 [6:26:51<55:03,  3.63it/s]
 97%|█████████▋| 359494/371472 [6:26:51<54:38,  3.65it/s]
 97%|█████████▋| 359495/371472 [6:26:51<54:50,  3.64it/s]
 97%|█████████▋| 359496/371472 [6:26:51<53:44,  3.71it/s]
 97%|█████████▋| 359497/371472 [6:26:52<54:49,  3.64it/s]
 97%|█████████▋| 359498/371472 [6:26:52<55:24,  3.60it/s]
 97%|█████████▋| 359499/371472 [6:26:52<53:21,  3.74it/s]
 97%|█████████▋| 359500/371472 [6:26:52<52:30,  3.80it/s]
                                                         
{'loss': 2.5755, 'learning_rate': 1.2902131052166606e-07, 'epoch': 15.48}

 97%|█████████▋| 359500/371472 [6:26:52<52:30,  3.80it/s]
 97%|█████████▋| 359501/371472 [6:26:53<56:51,  3.51it/s]
 97%|█████████▋| 359502/371472 [6:26:53<57:07,  3.49it/s]
 97%|█████████▋| 359503/371472 [6:26:53<59:35,  3.35it/s]
 97%|█████████▋| 359504/371472 [6:26:54<59:52,  3.33it/s]
 97%|█████████▋| 359505/371472 [6:26:54<55:56,  3.57it/s]
 97%|█████████▋| 359506/371472 [6:26:54<57:36,  3.46it/s]
 97%|█████████▋| 359507/371472 [6:26:55<56:56,  3.50it/s]
 97%|█████████▋| 359508/371472 [6:26:55<55:18,  3.61it/s]
 97%|█████████▋| 359509/371472 [6:26:55<56:34,  3.52it/s]
 97%|█████████▋| 359510/371472 [6:26:55<59:17,  3.36it/s]
 97%|█████████▋| 359511/371472 [6:26:56<57:24,  3.47it/s]
 97%|█████████▋| 359512/371472 [6:26:56<59:11,  3.37it/s]
 97%|█████████▋| 359513/371472 [6:26:56<59:07,  3.37it/s]
 97%|█████████▋| 359514/371472 [6:26:57<57:56,  3.44it/s]
 97%|█████████▋| 359515/371472 [6:26:57<58:11,  3.42it/s]
 97%|█████████▋| 359516/371472 [6:26:57<1:00:13,  3.31it/s]
 97%|█████████▋| 359517/371472 [6:26:57<59:06,  3.37it/s]  
 97%|█████████▋| 359518/371472 [6:26:58<56:45,  3.51it/s]
 97%|█████████▋| 359519/371472 [6:26:58<56:27,  3.53it/s]
 97%|█████████▋| 359520/371472 [6:26:58<1:02:57,  3.16it/s]
                                                           
{'loss': 2.509, 'learning_rate': 1.289728285461871e-07, 'epoch': 15.49}

 97%|█████████▋| 359520/371472 [6:26:58<1:02:57,  3.16it/s]
 97%|█████████▋| 359521/371472 [6:26:59<1:02:03,  3.21it/s]
 97%|█████████▋| 359522/371472 [6:26:59<58:49,  3.39it/s]  
 97%|█████████▋| 359523/371472 [6:26:59<55:36,  3.58it/s]
 97%|█████████▋| 359524/371472 [6:27:00<57:34,  3.46it/s]
 97%|█████████▋| 359525/371472 [6:27:00<58:02,  3.43it/s]
 97%|█████████▋| 359526/371472 [6:27:00<54:53,  3.63it/s]
 97%|█████████▋| 359527/371472 [6:27:00<58:19,  3.41it/s]
 97%|█████████▋| 359528/371472 [6:27:01<57:17,  3.47it/s]
 97%|█████████▋| 359529/371472 [6:27:01<57:46,  3.45it/s]
 97%|█████████▋| 359530/371472 [6:27:01<54:29,  3.65it/s]
 97%|█████████▋| 359531/371472 [6:27:02<58:25,  3.41it/s]
 97%|█████████▋| 359532/371472 [6:27:02<56:46,  3.51it/s]
 97%|█████████▋| 359533/371472 [6:27:02<1:01:37,  3.23it/s]
 97%|█████████▋| 359534/371472 [6:27:03<1:02:55,  3.16it/s]
 97%|█████████▋| 359535/371472 [6:27:03<58:46,  3.38it/s]  
 97%|█████████▋| 359536/371472 [6:27:03<59:10,  3.36it/s]
 97%|█████████▋| 359537/371472 [6:27:03<1:01:38,  3.23it/s]
 97%|█████████▋| 359538/371472 [6:27:04<58:19,  3.41it/s]  
 97%|█████████▋| 359539/371472 [6:27:04<58:58,  3.37it/s]
 97%|█████████▋| 359540/371472 [6:27:04<59:00,  3.37it/s]
                                                         
{'loss': 2.5718, 'learning_rate': 1.2892434657070826e-07, 'epoch': 15.49}

 97%|█████████▋| 359540/371472 [6:27:04<59:00,  3.37it/s]
 97%|█████████▋| 359541/371472 [6:27:05<56:59,  3.49it/s]
 97%|█████████▋| 359542/371472 [6:27:05<56:59,  3.49it/s]
 97%|█████████▋| 359543/371472 [6:27:05<55:50,  3.56it/s]
 97%|█████████▋| 359544/371472 [6:27:05<52:46,  3.77it/s]
 97%|█████████▋| 359545/371472 [6:27:06<51:37,  3.85it/s]
 97%|█████████▋| 359546/371472 [6:27:06<51:53,  3.83it/s]
 97%|█████████▋| 359547/371472 [6:27:06<53:41,  3.70it/s]
 97%|█████████▋| 359548/371472 [6:27:06<52:49,  3.76it/s]
 97%|█████████▋| 359549/371472 [6:27:07<51:56,  3.83it/s]
 97%|█████████▋| 359550/371472 [6:27:07<53:18,  3.73it/s]
 97%|█████████▋| 359551/371472 [6:27:07<52:02,  3.82it/s]
 97%|█████████▋| 359552/371472 [6:27:07<53:36,  3.71it/s]
 97%|█████████▋| 359553/371472 [6:27:08<55:12,  3.60it/s]
 97%|█████████▋| 359554/371472 [6:27:08<56:23,  3.52it/s]
 97%|█████████▋| 359555/371472 [6:27:08<55:20,  3.59it/s]
 97%|█████████▋| 359556/371472 [6:27:09<53:41,  3.70it/s]
 97%|█████████▋| 359557/371472 [6:27:09<52:32,  3.78it/s]
 97%|█████████▋| 359558/371472 [6:27:09<55:17,  3.59it/s]
 97%|█████████▋| 359559/371472 [6:27:09<55:41,  3.57it/s]
 97%|█████████▋| 359560/371472 [6:27:10<55:44,  3.56it/s]
                                                         
{'loss': 2.6312, 'learning_rate': 1.2887586459522933e-07, 'epoch': 15.49}

 97%|█████████▋| 359560/371472 [6:27:10<55:44,  3.56it/s]
 97%|█████████▋| 359561/371472 [6:27:10<54:01,  3.67it/s]
 97%|█████████▋| 359562/371472 [6:27:10<52:01,  3.82it/s]
 97%|█████████▋| 359563/371472 [6:27:10<53:07,  3.74it/s]
 97%|█████████▋| 359564/371472 [6:27:11<52:22,  3.79it/s]
 97%|█████████▋| 359565/371472 [6:27:11<58:02,  3.42it/s]
 97%|█████████▋| 359566/371472 [6:27:11<1:00:18,  3.29it/s]
 97%|█████████▋| 359567/371472 [6:27:12<57:00,  3.48it/s]  
 97%|█████████▋| 359568/371472 [6:27:12<1:00:10,  3.30it/s]
 97%|█████████▋| 359569/371472 [6:27:12<58:49,  3.37it/s]  
 97%|█████████▋| 359570/371472 [6:27:13<57:08,  3.47it/s]
 97%|█████████▋| 359571/371472 [6:27:13<55:42,  3.56it/s]
 97%|█████████▋| 359572/371472 [6:27:13<56:01,  3.54it/s]
 97%|█████████▋| 359573/371472 [6:27:13<55:32,  3.57it/s]
 97%|█████████▋| 359574/371472 [6:27:14<57:31,  3.45it/s]
 97%|█████████▋| 359575/371472 [6:27:14<57:44,  3.43it/s]
 97%|█████████▋| 359576/371472 [6:27:14<55:32,  3.57it/s]
 97%|█████████▋| 359577/371472 [6:27:14<55:43,  3.56it/s]
 97%|█████████▋| 359578/371472 [6:27:15<55:13,  3.59it/s]
 97%|█████████▋| 359579/371472 [6:27:15<52:55,  3.75it/s]
 97%|█████████▋| 359580/371472 [6:27:15<52:42,  3.76it/s]
                                                         
{'loss': 2.6278, 'learning_rate': 1.2882738261975048e-07, 'epoch': 15.49}

 97%|█████████▋| 359580/371472 [6:27:15<52:42,  3.76it/s]
 97%|█████████▋| 359581/371472 [6:27:16<53:19,  3.72it/s]
 97%|█████████▋| 359582/371472 [6:27:16<59:54,  3.31it/s]
 97%|█████████▋| 359583/371472 [6:27:16<59:02,  3.36it/s]
 97%|█████████▋| 359584/371472 [6:27:16<56:46,  3.49it/s]
 97%|█████████▋| 359585/371472 [6:27:17<57:44,  3.43it/s]
 97%|█████████▋| 359586/371472 [6:27:17<55:30,  3.57it/s]
 97%|█████████▋| 359587/371472 [6:27:17<55:49,  3.55it/s]
 97%|█████████▋| 359588/371472 [6:27:18<54:52,  3.61it/s]
 97%|█████████▋| 359589/371472 [6:27:18<53:20,  3.71it/s]
 97%|█████████▋| 359590/371472 [6:27:18<51:41,  3.83it/s]
 97%|█████████▋| 359591/371472 [6:27:18<50:26,  3.93it/s]
 97%|█████████▋| 359592/371472 [6:27:19<51:54,  3.81it/s]
 97%|█████████▋| 359593/371472 [6:27:19<51:33,  3.84it/s]
 97%|█████████▋| 359594/371472 [6:27:19<50:30,  3.92it/s]
 97%|█████████▋| 359595/371472 [6:27:19<51:50,  3.82it/s]
 97%|█████████▋| 359596/371472 [6:27:20<51:39,  3.83it/s]
 97%|█████████▋| 359597/371472 [6:27:20<51:31,  3.84it/s]
 97%|█████████▋| 359598/371472 [6:27:20<50:34,  3.91it/s]
 97%|█████████▋| 359599/371472 [6:27:20<50:04,  3.95it/s]
 97%|█████████▋| 359600/371472 [6:27:21<50:44,  3.90it/s]
                                                         
{'loss': 2.7416, 'learning_rate': 1.2877890064427152e-07, 'epoch': 15.49}

 97%|█████████▋| 359600/371472 [6:27:21<50:44,  3.90it/s]
 97%|█████████▋| 359601/371472 [6:27:21<51:10,  3.87it/s]
 97%|█████████▋| 359602/371472 [6:27:21<56:34,  3.50it/s]
 97%|█████████▋| 359603/371472 [6:27:22<56:30,  3.50it/s]
 97%|█████████▋| 359604/371472 [6:27:22<58:30,  3.38it/s]
 97%|█████████▋| 359605/371472 [6:27:22<1:00:49,  3.25it/s]
 97%|█████████▋| 359606/371472 [6:27:22<58:43,  3.37it/s]  
 97%|█████████▋| 359607/371472 [6:27:23<56:08,  3.52it/s]
 97%|█████████▋| 359608/371472 [6:27:23<54:59,  3.60it/s]
 97%|█████████▋| 359609/371472 [6:27:23<53:04,  3.72it/s]
 97%|█████████▋| 359610/371472 [6:27:23<51:52,  3.81it/s]
 97%|█████████▋| 359611/371472 [6:27:24<50:48,  3.89it/s]
 97%|█████████▋| 359612/371472 [6:27:24<52:16,  3.78it/s]
 97%|█████████▋| 359613/371472 [6:27:24<51:14,  3.86it/s]
 97%|█████████▋| 359614/371472 [6:27:25<53:57,  3.66it/s]
 97%|█████████▋| 359615/371472 [6:27:25<52:35,  3.76it/s]
 97%|█████████▋| 359616/371472 [6:27:25<52:15,  3.78it/s]
 97%|█████████▋| 359617/371472 [6:27:25<53:31,  3.69it/s]
 97%|█████████▋| 359618/371472 [6:27:26<52:56,  3.73it/s]
 97%|█████████▋| 359619/371472 [6:27:26<51:35,  3.83it/s]
 97%|█████████▋| 359620/371472 [6:27:26<54:01,  3.66it/s]
                                                         
{'loss': 2.599, 'learning_rate': 1.287304186687927e-07, 'epoch': 15.49}

 97%|█████████▋| 359620/371472 [6:27:26<54:01,  3.66it/s]
 97%|█████████▋| 359621/371472 [6:27:26<53:44,  3.68it/s]
 97%|█████████▋| 359622/371472 [6:27:27<53:57,  3.66it/s]
 97%|█████████▋| 359623/371472 [6:27:27<55:19,  3.57it/s]
 97%|█████████▋| 359624/371472 [6:27:27<55:15,  3.57it/s]
 97%|█████████▋| 359625/371472 [6:27:28<56:24,  3.50it/s]
 97%|█████████▋| 359626/371472 [6:27:28<57:15,  3.45it/s]
 97%|█████████▋| 359627/371472 [6:27:28<55:39,  3.55it/s]
 97%|█████████▋| 359628/371472 [6:27:28<53:33,  3.69it/s]
 97%|█████████▋| 359629/371472 [6:27:29<53:02,  3.72it/s]
 97%|█████████▋| 359630/371472 [6:27:29<51:56,  3.80it/s]
 97%|█████████▋| 359631/371472 [6:27:29<51:29,  3.83it/s]
 97%|█████████▋| 359632/371472 [6:27:29<53:38,  3.68it/s]
 97%|█████████▋| 359633/371472 [6:27:30<54:42,  3.61it/s]
 97%|█████████▋| 359634/371472 [6:27:30<56:43,  3.48it/s]
 97%|█████████▋| 359635/371472 [6:27:30<59:58,  3.29it/s]
 97%|█████████▋| 359636/371472 [6:27:31<57:43,  3.42it/s]
 97%|█████████▋| 359637/371472 [6:27:31<54:37,  3.61it/s]
 97%|█████████▋| 359638/371472 [6:27:31<52:56,  3.73it/s]
 97%|█████████▋| 359639/371472 [6:27:31<52:11,  3.78it/s]
 97%|█████████▋| 359640/371472 [6:27:32<53:17,  3.70it/s]
                                                         
{'loss': 2.8069, 'learning_rate': 1.2868193669331375e-07, 'epoch': 15.49}

 97%|█████████▋| 359640/371472 [6:27:32<53:17,  3.70it/s]
 97%|█████████▋| 359641/371472 [6:27:32<56:36,  3.48it/s]
 97%|█████████▋| 359642/371472 [6:27:32<55:22,  3.56it/s]
 97%|█████████▋| 359643/371472 [6:27:33<53:04,  3.71it/s]
 97%|█████████▋| 359644/371472 [6:27:33<52:21,  3.76it/s]
 97%|█████████▋| 359645/371472 [6:27:33<52:16,  3.77it/s]
 97%|█████████▋| 359646/371472 [6:27:33<54:05,  3.64it/s]
 97%|█████████▋| 359647/371472 [6:27:34<55:52,  3.53it/s]
 97%|█████████▋| 359648/371472 [6:27:34<53:54,  3.66it/s]
 97%|█████████▋| 359649/371472 [6:27:34<53:37,  3.67it/s]
 97%|█████████▋| 359650/371472 [6:27:34<52:23,  3.76it/s]
 97%|█████████▋| 359651/371472 [6:27:35<53:24,  3.69it/s]
 97%|█████████▋| 359652/371472 [6:27:35<52:08,  3.78it/s]
 97%|█████████▋| 359653/371472 [6:27:35<53:29,  3.68it/s]
 97%|█████████▋| 359654/371472 [6:27:36<53:02,  3.71it/s]
 97%|█████████▋| 359655/371472 [6:27:36<52:53,  3.72it/s]
 97%|█████████▋| 359656/371472 [6:27:36<52:45,  3.73it/s]
 97%|█████████▋| 359657/371472 [6:27:36<54:09,  3.64it/s]
 97%|█████████▋| 359658/371472 [6:27:37<53:06,  3.71it/s]
 97%|█████████▋| 359659/371472 [6:27:37<58:51,  3.35it/s]
 97%|█████████▋| 359660/371472 [6:27:37<56:14,  3.50it/s]
                                                         
{'loss': 2.5786, 'learning_rate': 1.286334547178349e-07, 'epoch': 15.49}

 97%|█████████▋| 359660/371472 [6:27:37<56:14,  3.50it/s]
 97%|█████████▋| 359661/371472 [6:27:37<53:48,  3.66it/s]
 97%|█████████▋| 359662/371472 [6:27:38<52:51,  3.72it/s]
 97%|█████████▋| 359663/371472 [6:27:38<54:39,  3.60it/s]
 97%|█████████▋| 359664/371472 [6:27:38<52:09,  3.77it/s]
 97%|█████████▋| 359665/371472 [6:27:39<54:03,  3.64it/s]
 97%|█████████▋| 359666/371472 [6:27:39<55:04,  3.57it/s]
 97%|█████████▋| 359667/371472 [6:27:39<55:40,  3.53it/s]
 97%|█████████▋| 359668/371472 [6:27:39<53:56,  3.65it/s]
 97%|█████████▋| 359669/371472 [6:27:40<55:11,  3.56it/s]
 97%|█████████▋| 359670/371472 [6:27:40<57:04,  3.45it/s]
 97%|█████████▋| 359671/371472 [6:27:40<55:13,  3.56it/s]
 97%|█████████▋| 359672/371472 [6:27:41<53:57,  3.64it/s]
 97%|█████████▋| 359673/371472 [6:27:41<53:21,  3.69it/s]
 97%|█████████▋| 359674/371472 [6:27:41<52:44,  3.73it/s]
 97%|█████████▋| 359675/371472 [6:27:41<53:22,  3.68it/s]
 97%|█████████▋| 359676/371472 [6:27:42<1:01:50,  3.18it/s]
 97%|█████████▋| 359677/371472 [6:27:42<59:13,  3.32it/s]  
 97%|█████████▋| 359678/371472 [6:27:42<58:01,  3.39it/s]
 97%|█████████▋| 359679/371472 [6:27:43<55:37,  3.53it/s]
 97%|█████████▋| 359680/371472 [6:27:43<59:13,  3.32it/s]
                                                         
{'loss': 2.4706, 'learning_rate': 1.2858497274235597e-07, 'epoch': 15.49}

 97%|█████████▋| 359680/371472 [6:27:43<59:13,  3.32it/s]
 97%|█████████▋| 359681/371472 [6:27:43<57:39,  3.41it/s]
 97%|█████████▋| 359682/371472 [6:27:43<59:35,  3.30it/s]
 97%|█████████▋| 359683/371472 [6:27:44<56:49,  3.46it/s]
 97%|█████████▋| 359684/371472 [6:27:44<1:00:03,  3.27it/s]
 97%|█████████▋| 359685/371472 [6:27:44<1:01:55,  3.17it/s]
 97%|█████████▋| 359686/371472 [6:27:45<59:11,  3.32it/s]  
 97%|█████████▋| 359687/371472 [6:27:45<58:24,  3.36it/s]
 97%|█████████▋| 359688/371472 [6:27:45<1:00:40,  3.24it/s]
 97%|█████████▋| 359689/371472 [6:27:46<57:38,  3.41it/s]  
 97%|█████████▋| 359690/371472 [6:27:46<57:58,  3.39it/s]
 97%|█████████▋| 359691/371472 [6:27:46<59:59,  3.27it/s]
 97%|█████████▋| 359692/371472 [6:27:46<58:02,  3.38it/s]
 97%|█████████▋| 359693/371472 [6:27:47<57:11,  3.43it/s]
 97%|█████████▋| 359694/371472 [6:27:47<55:59,  3.51it/s]
 97%|█████████▋| 359695/371472 [6:27:47<56:09,  3.50it/s]
 97%|█████████▋| 359696/371472 [6:27:48<1:00:22,  3.25it/s]
 97%|█████████▋| 359697/371472 [6:27:48<57:51,  3.39it/s]  
 97%|█████████▋| 359698/371472 [6:27:48<58:27,  3.36it/s]
 97%|█████████▋| 359699/371472 [6:27:49<58:57,  3.33it/s]
 97%|█████████▋| 359700/371472 [6:27:49<58:44,  3.34it/s]
                                                         
{'loss': 2.6211, 'learning_rate': 1.2853649076687712e-07, 'epoch': 15.49}

 97%|█████████▋| 359700/371472 [6:27:49<58:44,  3.34it/s]
 97%|█████████▋| 359701/371472 [6:27:49<57:44,  3.40it/s]
 97%|█████████▋| 359702/371472 [6:27:49<55:46,  3.52it/s]
 97%|█████████▋| 359703/371472 [6:27:50<56:20,  3.48it/s]
 97%|█████████▋| 359704/371472 [6:27:50<54:17,  3.61it/s]
 97%|█████████▋| 359705/371472 [6:27:50<55:38,  3.52it/s]
 97%|█████████▋| 359706/371472 [6:27:50<53:35,  3.66it/s]
 97%|█████████▋| 359707/371472 [6:27:51<52:40,  3.72it/s]
 97%|█████████▋| 359708/371472 [6:27:51<53:30,  3.66it/s]
 97%|█████████▋| 359709/371472 [6:27:51<55:22,  3.54it/s]
 97%|█████████▋| 359710/371472 [6:27:52<55:32,  3.53it/s]
 97%|█████████▋| 359711/371472 [6:27:52<59:02,  3.32it/s]
 97%|█████████▋| 359712/371472 [6:27:52<1:02:03,  3.16it/s]
 97%|█████████▋| 359713/371472 [6:27:53<1:00:40,  3.23it/s]
 97%|█████████▋| 359714/371472 [6:27:53<57:31,  3.41it/s]  
 97%|█████████▋| 359715/371472 [6:27:53<55:27,  3.53it/s]
 97%|█████████▋| 359716/371472 [6:27:53<54:15,  3.61it/s]
 97%|█████████▋| 359717/371472 [6:27:54<54:27,  3.60it/s]
 97%|█████████▋| 359718/371472 [6:27:54<56:28,  3.47it/s]
 97%|█████████▋| 359719/371472 [6:27:54<54:18,  3.61it/s]
 97%|█████████▋| 359720/371472 [6:27:55<55:15,  3.54it/s]
                                                         
{'loss': 2.6636, 'learning_rate': 1.284880087913982e-07, 'epoch': 15.49}

 97%|█████████▋| 359720/371472 [6:27:55<55:15,  3.54it/s]
 97%|█████████▋| 359721/371472 [6:27:55<55:08,  3.55it/s]
 97%|█████████▋| 359722/371472 [6:27:55<1:00:33,  3.23it/s]
 97%|█████████▋| 359723/371472 [6:27:56<1:04:05,  3.06it/s]
 97%|█████████▋| 359724/371472 [6:27:56<59:14,  3.30it/s]  
 97%|█████████▋| 359725/371472 [6:27:56<57:07,  3.43it/s]
 97%|█████████▋| 359726/371472 [6:27:56<55:56,  3.50it/s]
 97%|█████████▋| 359727/371472 [6:27:57<54:16,  3.61it/s]
 97%|█████████▋| 359728/371472 [6:27:57<55:52,  3.50it/s]
 97%|█████████▋| 359729/371472 [6:27:57<59:17,  3.30it/s]
 97%|█████████▋| 359730/371472 [6:27:57<57:14,  3.42it/s]
 97%|█████████▋| 359731/371472 [6:27:58<56:19,  3.47it/s]
 97%|█████████▋| 359732/371472 [6:27:58<56:51,  3.44it/s]
 97%|█████████▋| 359733/371472 [6:27:58<57:14,  3.42it/s]
 97%|█████████▋| 359734/371472 [6:27:59<53:37,  3.65it/s]
 97%|█████████▋| 359735/371472 [6:27:59<52:22,  3.73it/s]
 97%|█████████▋| 359736/371472 [6:27:59<52:44,  3.71it/s]
 97%|█████████▋| 359737/371472 [6:27:59<56:03,  3.49it/s]
 97%|█████████▋| 359738/371472 [6:28:00<55:20,  3.53it/s]
 97%|█████████▋| 359739/371472 [6:28:00<53:16,  3.67it/s]
 97%|█████████▋| 359740/371472 [6:28:00<52:06,  3.75it/s]
                                                         
{'loss': 2.6967, 'learning_rate': 1.2843952681591934e-07, 'epoch': 15.49}

 97%|█████████▋| 359740/371472 [6:28:00<52:06,  3.75it/s]
 97%|█████████▋| 359741/371472 [6:28:00<51:43,  3.78it/s]
 97%|█████████▋| 359742/371472 [6:28:01<50:59,  3.83it/s]
 97%|█████████▋| 359743/371472 [6:28:01<52:13,  3.74it/s]
 97%|█████████▋| 359744/371472 [6:28:01<53:48,  3.63it/s]
 97%|█████████▋| 359745/371472 [6:28:02<53:26,  3.66it/s]
 97%|█████████▋| 359746/371472 [6:28:02<55:28,  3.52it/s]
 97%|█████████▋| 359747/371472 [6:28:02<58:08,  3.36it/s]
 97%|█████████▋| 359748/371472 [6:28:03<58:02,  3.37it/s]
 97%|█████████▋| 359749/371472 [6:28:03<53:48,  3.63it/s]
 97%|█████████▋| 359750/371472 [6:28:03<1:01:13,  3.19it/s]
 97%|█████████▋| 359751/371472 [6:28:03<57:34,  3.39it/s]  
 97%|█████████▋| 359752/371472 [6:28:04<1:00:05,  3.25it/s]
 97%|█████████▋| 359753/371472 [6:28:04<57:40,  3.39it/s]  
 97%|█████████▋| 359754/371472 [6:28:04<59:45,  3.27it/s]
 97%|█████████▋| 359755/371472 [6:28:05<59:54,  3.26it/s]
 97%|█████████▋| 359756/371472 [6:28:05<1:03:31,  3.07it/s]
 97%|█████████▋| 359757/371472 [6:28:05<59:12,  3.30it/s]  
 97%|█████████▋| 359758/371472 [6:28:06<58:52,  3.32it/s]
 97%|█████████▋| 359759/371472 [6:28:06<57:24,  3.40it/s]
 97%|█████████▋| 359760/371472 [6:28:06<57:32,  3.39it/s]
                                                         
{'loss': 2.547, 'learning_rate': 1.283910448404404e-07, 'epoch': 15.5}

 97%|█████████▋| 359760/371472 [6:28:06<57:32,  3.39it/s]
 97%|█████████▋| 359761/371472 [6:28:06<56:35,  3.45it/s]
 97%|█████████▋| 359762/371472 [6:28:07<58:38,  3.33it/s]
 97%|█████████▋| 359763/371472 [6:28:07<55:32,  3.51it/s]
 97%|█████████▋| 359764/371472 [6:28:07<58:57,  3.31it/s]
 97%|█████████▋| 359765/371472 [6:28:08<56:21,  3.46it/s]
 97%|█████████▋| 359766/371472 [6:28:08<53:56,  3.62it/s]
 97%|█████████▋| 359767/371472 [6:28:08<53:16,  3.66it/s]
 97%|█████████▋| 359768/371472 [6:28:08<54:04,  3.61it/s]
 97%|█████████▋| 359769/371472 [6:28:09<52:07,  3.74it/s]
 97%|█████████▋| 359770/371472 [6:28:09<52:56,  3.68it/s]
 97%|█████████▋| 359771/371472 [6:28:09<52:41,  3.70it/s]
 97%|█████████▋| 359772/371472 [6:28:09<50:12,  3.88it/s]
 97%|█████████▋| 359773/371472 [6:28:10<51:22,  3.80it/s]
 97%|█████████▋| 359774/371472 [6:28:10<49:41,  3.92it/s]
 97%|█████████▋| 359775/371472 [6:28:10<50:05,  3.89it/s]
 97%|█████████▋| 359776/371472 [6:28:10<53:04,  3.67it/s]
 97%|█████████▋| 359777/371472 [6:28:11<56:00,  3.48it/s]
 97%|█████████▋| 359778/371472 [6:28:11<59:35,  3.27it/s]
 97%|█████████▋| 359779/371472 [6:28:11<58:16,  3.34it/s]
 97%|█████████▋| 359780/371472 [6:28:12<54:56,  3.55it/s]
                                                         
{'loss': 2.6945, 'learning_rate': 1.2834256286496156e-07, 'epoch': 15.5}

 97%|█████████▋| 359780/371472 [6:28:12<54:56,  3.55it/s]
 97%|█████████▋| 359781/371472 [6:28:12<53:32,  3.64it/s]
 97%|█████████▋| 359782/371472 [6:28:12<52:03,  3.74it/s]
 97%|█████████▋| 359783/371472 [6:28:12<50:46,  3.84it/s]
 97%|█████████▋| 359784/371472 [6:28:13<50:01,  3.89it/s]
 97%|█████████▋| 359785/371472 [6:28:13<52:43,  3.69it/s]
 97%|█████████▋| 359786/371472 [6:28:13<52:01,  3.74it/s]
 97%|█████████▋| 359787/371472 [6:28:14<53:23,  3.65it/s]
 97%|█████████▋| 359788/371472 [6:28:14<54:05,  3.60it/s]
 97%|█████████▋| 359789/371472 [6:28:14<52:25,  3.71it/s]
 97%|█████████▋| 359790/371472 [6:28:14<52:05,  3.74it/s]
 97%|█████████▋| 359791/371472 [6:28:15<55:49,  3.49it/s]
 97%|█████████▋| 359792/371472 [6:28:15<53:40,  3.63it/s]
 97%|█████████▋| 359793/371472 [6:28:15<55:12,  3.53it/s]
 97%|█████████▋| 359794/371472 [6:28:16<56:51,  3.42it/s]
 97%|█████████▋| 359795/371472 [6:28:16<56:28,  3.45it/s]
 97%|█████████▋| 359796/371472 [6:28:16<1:02:00,  3.14it/s]
 97%|█████████▋| 359797/371472 [6:28:16<59:22,  3.28it/s]  
 97%|█████████▋| 359798/371472 [6:28:17<55:56,  3.48it/s]
 97%|█████████▋| 359799/371472 [6:28:17<53:39,  3.63it/s]
 97%|█████████▋| 359800/371472 [6:28:17<54:26,  3.57it/s]
                                                         
{'loss': 2.5918, 'learning_rate': 1.282940808894826e-07, 'epoch': 15.5}

 97%|█████████▋| 359800/371472 [6:28:17<54:26,  3.57it/s]
 97%|█████████▋| 359801/371472 [6:28:18<53:11,  3.66it/s]
 97%|█████████▋| 359802/371472 [6:28:18<53:24,  3.64it/s]
 97%|█████████▋| 359803/371472 [6:28:18<53:03,  3.66it/s]
 97%|█████████▋| 359804/371472 [6:28:18<52:33,  3.70it/s]
 97%|█████████▋| 359805/371472 [6:28:19<54:03,  3.60it/s]
 97%|█████████▋| 359806/371472 [6:28:19<54:42,  3.55it/s]
 97%|█████████▋| 359807/371472 [6:28:19<55:08,  3.53it/s]
 97%|█████████▋| 359808/371472 [6:28:19<54:10,  3.59it/s]
 97%|█████████▋| 359809/371472 [6:28:20<58:04,  3.35it/s]
 97%|█████████▋| 359810/371472 [6:28:20<55:47,  3.48it/s]
 97%|█████████▋| 359811/371472 [6:28:20<55:10,  3.52it/s]
 97%|█████████▋| 359812/371472 [6:28:21<54:06,  3.59it/s]
 97%|█████████▋| 359813/371472 [6:28:21<51:29,  3.77it/s]
 97%|█████████▋| 359814/371472 [6:28:21<53:21,  3.64it/s]
 97%|█████████▋| 359815/371472 [6:28:21<52:38,  3.69it/s]
 97%|█████████▋| 359816/371472 [6:28:22<55:08,  3.52it/s]
 97%|█████████▋| 359817/371472 [6:28:22<56:46,  3.42it/s]
 97%|█████████▋| 359818/371472 [6:28:22<56:08,  3.46it/s]
 97%|█████████▋| 359819/371472 [6:28:23<54:24,  3.57it/s]
 97%|█████████▋| 359820/371472 [6:28:23<53:03,  3.66it/s]
                                                         
{'loss': 2.6382, 'learning_rate': 1.282455989140038e-07, 'epoch': 15.5}

 97%|█████████▋| 359820/371472 [6:28:23<53:03,  3.66it/s]
 97%|█████████▋| 359821/371472 [6:28:23<56:50,  3.42it/s]
 97%|█████████▋| 359822/371472 [6:28:23<55:18,  3.51it/s]
 97%|█████████▋| 359823/371472 [6:28:24<58:28,  3.32it/s]
 97%|█████████▋| 359824/371472 [6:28:24<57:23,  3.38it/s]
 97%|█████████▋| 359825/371472 [6:28:24<56:03,  3.46it/s]
 97%|█████████▋| 359826/371472 [6:28:25<56:41,  3.42it/s]
 97%|█████████▋| 359827/371472 [6:28:25<54:38,  3.55it/s]
 97%|█████████▋| 359828/371472 [6:28:25<55:03,  3.52it/s]
 97%|█████████▋| 359829/371472 [6:28:25<53:17,  3.64it/s]
 97%|█████████▋| 359830/371472 [6:28:26<53:18,  3.64it/s]
 97%|█████████▋| 359831/371472 [6:28:26<50:42,  3.83it/s]
 97%|█████████▋| 359832/371472 [6:28:26<52:19,  3.71it/s]
 97%|█████████▋| 359833/371472 [6:28:26<51:25,  3.77it/s]
 97%|█████████▋| 359834/371472 [6:28:27<51:44,  3.75it/s]
 97%|█████████▋| 359835/371472 [6:28:27<54:38,  3.55it/s]
 97%|█████████▋| 359836/371472 [6:28:27<57:12,  3.39it/s]
 97%|█████████▋| 359837/371472 [6:28:28<54:36,  3.55it/s]
 97%|█████████▋| 359838/371472 [6:28:28<55:29,  3.49it/s]
 97%|█████████▋| 359839/371472 [6:28:28<54:57,  3.53it/s]
 97%|█████████▋| 359840/371472 [6:28:29<55:38,  3.48it/s]
                                                         
{'loss': 2.5138, 'learning_rate': 1.2819711693852483e-07, 'epoch': 15.5}

 97%|█████████▋| 359840/371472 [6:28:29<55:38,  3.48it/s]
 97%|█████████▋| 359841/371472 [6:28:29<54:47,  3.54it/s]
 97%|█████████▋| 359842/371472 [6:28:29<57:07,  3.39it/s]
 97%|█████████▋| 359843/371472 [6:28:29<54:30,  3.56it/s]
 97%|█████████▋| 359844/371472 [6:28:30<56:45,  3.41it/s]
 97%|█████████▋| 359845/371472 [6:28:30<54:16,  3.57it/s]
 97%|█████████▋| 359846/371472 [6:28:30<54:16,  3.57it/s]
 97%|█████████▋| 359847/371472 [6:28:30<54:00,  3.59it/s]
 97%|█████████▋| 359848/371472 [6:28:31<53:43,  3.61it/s]
 97%|█████████▋| 359849/371472 [6:28:31<52:13,  3.71it/s]
 97%|█████████▋| 359850/371472 [6:28:31<52:10,  3.71it/s]
 97%|█████████▋| 359851/371472 [6:28:32<55:29,  3.49it/s]
 97%|█████████▋| 359852/371472 [6:28:32<53:13,  3.64it/s]
 97%|█████████▋| 359853/371472 [6:28:32<53:41,  3.61it/s]
 97%|█████████▋| 359854/371472 [6:28:32<51:53,  3.73it/s]
 97%|█████████▋| 359855/371472 [6:28:33<49:50,  3.88it/s]
 97%|█████████▋| 359856/371472 [6:28:33<50:56,  3.80it/s]
 97%|█████████▋| 359857/371472 [6:28:33<50:02,  3.87it/s]
 97%|█████████▋| 359858/371472 [6:28:33<48:55,  3.96it/s]
 97%|█████████▋| 359859/371472 [6:28:34<48:42,  3.97it/s]
 97%|█████████▋| 359860/371472 [6:28:34<53:45,  3.60it/s]
                                                         
{'loss': 2.4515, 'learning_rate': 1.2814863496304598e-07, 'epoch': 15.5}

 97%|█████████▋| 359860/371472 [6:28:34<53:45,  3.60it/s]
 97%|█████████▋| 359861/371472 [6:28:34<55:46,  3.47it/s]
 97%|█████████▋| 359862/371472 [6:28:35<1:01:47,  3.13it/s]
 97%|█████████▋| 359863/371472 [6:28:35<57:17,  3.38it/s]  
 97%|█████████▋| 359864/371472 [6:28:35<54:17,  3.56it/s]
 97%|█████████▋| 359865/371472 [6:28:35<53:26,  3.62it/s]
 97%|█████████▋| 359866/371472 [6:28:36<53:41,  3.60it/s]
 97%|█████████▋| 359867/371472 [6:28:36<55:38,  3.48it/s]
 97%|█████████▋| 359868/371472 [6:28:36<1:03:34,  3.04it/s]
 97%|█████████▋| 359869/371472 [6:28:37<1:00:47,  3.18it/s]
 97%|█████████▋| 359870/371472 [6:28:37<59:25,  3.25it/s]  
 97%|█████████▋| 359871/371472 [6:28:37<56:05,  3.45it/s]
 97%|█████████▋| 359872/371472 [6:28:38<53:39,  3.60it/s]
 97%|█████████▋| 359873/371472 [6:28:38<51:25,  3.76it/s]
 97%|█████████▋| 359874/371472 [6:28:38<52:00,  3.72it/s]
 97%|█████████▋| 359875/371472 [6:28:38<52:25,  3.69it/s]
 97%|█████████▋| 359876/371472 [6:28:39<53:47,  3.59it/s]
 97%|█████████▋| 359877/371472 [6:28:39<58:01,  3.33it/s]
 97%|█████████▋| 359878/371472 [6:28:39<59:39,  3.24it/s]
 97%|█████████▋| 359879/371472 [6:28:40<1:01:09,  3.16it/s]
 97%|█████████▋| 359880/371472 [6:28:40<57:38,  3.35it/s]  
                                                         
{'loss': 2.4686, 'learning_rate': 1.2810015298756705e-07, 'epoch': 15.5}

 97%|█████████▋| 359880/371472 [6:28:40<57:38,  3.35it/s]
 97%|█████████▋| 359881/371472 [6:28:40<55:03,  3.51it/s]
 97%|█████████▋| 359882/371472 [6:28:40<53:51,  3.59it/s]
 97%|█████████▋| 359883/371472 [6:28:41<55:06,  3.51it/s]
 97%|█████████▋| 359884/371472 [6:28:41<54:34,  3.54it/s]
 97%|█████████▋| 359885/371472 [6:28:41<52:41,  3.66it/s]
 97%|█████████▋| 359886/371472 [6:28:42<54:59,  3.51it/s]
 97%|█████████▋| 359887/371472 [6:28:42<58:45,  3.29it/s]
 97%|█████████▋| 359888/371472 [6:28:42<55:41,  3.47it/s]
 97%|█████████▋| 359889/371472 [6:28:42<54:43,  3.53it/s]
 97%|█████████▋| 359890/371472 [6:28:43<54:21,  3.55it/s]
 97%|█████████▋| 359891/371472 [6:28:43<56:57,  3.39it/s]
 97%|█████████▋| 359892/371472 [6:28:43<55:14,  3.49it/s]
 97%|█████████▋| 359893/371472 [6:28:44<53:42,  3.59it/s]
 97%|█████████▋| 359894/371472 [6:28:44<56:59,  3.39it/s]
 97%|█████████▋| 359895/371472 [6:28:44<55:36,  3.47it/s]
 97%|█████████▋| 359896/371472 [6:28:44<53:11,  3.63it/s]
 97%|█████████▋| 359897/371472 [6:28:45<53:53,  3.58it/s]
 97%|█████████▋| 359898/371472 [6:28:45<57:01,  3.38it/s]
 97%|█████████▋| 359899/371472 [6:28:45<54:14,  3.56it/s]
 97%|█████████▋| 359900/371472 [6:28:46<52:35,  3.67it/s]
                                                         
{'loss': 2.4857, 'learning_rate': 1.280516710120882e-07, 'epoch': 15.5}

 97%|█████████▋| 359900/371472 [6:28:46<52:35,  3.67it/s]
 97%|█████████▋| 359901/371472 [6:28:46<51:40,  3.73it/s]
 97%|█████████▋| 359902/371472 [6:28:46<53:42,  3.59it/s]
 97%|█████████▋| 359903/371472 [6:28:46<57:35,  3.35it/s]
 97%|█████████▋| 359904/371472 [6:28:47<57:24,  3.36it/s]
 97%|█████████▋| 359905/371472 [6:28:47<56:44,  3.40it/s]
 97%|█████████▋| 359906/371472 [6:28:47<57:31,  3.35it/s]
 97%|█████████▋| 359907/371472 [6:28:48<59:29,  3.24it/s]
 97%|█████████▋| 359908/371472 [6:28:48<58:04,  3.32it/s]
 97%|█████████▋| 359909/371472 [6:28:48<54:47,  3.52it/s]
 97%|█████████▋| 359910/371472 [6:28:48<54:43,  3.52it/s]
 97%|█████████▋| 359911/371472 [6:28:49<54:14,  3.55it/s]
 97%|█████████▋| 359912/371472 [6:28:49<54:57,  3.51it/s]
 97%|█████████▋| 359913/371472 [6:28:49<51:53,  3.71it/s]
 97%|█████████▋| 359914/371472 [6:28:50<53:07,  3.63it/s]
 97%|█████████▋| 359915/371472 [6:28:50<54:51,  3.51it/s]
 97%|█████████▋| 359916/371472 [6:28:50<52:04,  3.70it/s]
 97%|█████████▋| 359917/371472 [6:28:50<55:25,  3.47it/s]
 97%|█████████▋| 359918/371472 [6:28:51<53:59,  3.57it/s]
 97%|█████████▋| 359919/371472 [6:28:51<53:54,  3.57it/s]
 97%|█████████▋| 359920/371472 [6:28:51<54:08,  3.56it/s]
                                                         
{'loss': 2.523, 'learning_rate': 1.2800318903660925e-07, 'epoch': 15.5}

 97%|█████████▋| 359920/371472 [6:28:51<54:08,  3.56it/s]
 97%|█████████▋| 359921/371472 [6:28:51<52:40,  3.65it/s]
 97%|█████████▋| 359922/371472 [6:28:52<52:08,  3.69it/s]
 97%|█████████▋| 359923/371472 [6:28:52<55:26,  3.47it/s]
 97%|█████████▋| 359924/371472 [6:28:52<1:00:36,  3.18it/s]
 97%|█████████▋| 359925/371472 [6:28:53<57:04,  3.37it/s]  
 97%|█████████▋| 359926/371472 [6:28:53<56:36,  3.40it/s]
 97%|█████████▋| 359927/371472 [6:28:53<59:55,  3.21it/s]
 97%|█████████▋| 359928/371472 [6:28:54<1:00:53,  3.16it/s]
 97%|█████████▋| 359929/371472 [6:28:54<1:01:08,  3.15it/s]
 97%|█████████▋| 359930/371472 [6:28:54<57:42,  3.33it/s]  
 97%|█████████▋| 359931/371472 [6:28:55<55:50,  3.44it/s]
 97%|█████████▋| 359932/371472 [6:28:55<56:49,  3.39it/s]
 97%|█████████▋| 359933/371472 [6:28:55<55:40,  3.45it/s]
 97%|█████████▋| 359934/371472 [6:28:55<59:51,  3.21it/s]
 97%|█████████▋| 359935/371472 [6:28:56<1:00:26,  3.18it/s]
 97%|█████████▋| 359936/371472 [6:28:56<58:11,  3.30it/s]  
 97%|█████████▋| 359937/371472 [6:28:56<58:50,  3.27it/s]
 97%|█████████▋| 359938/371472 [6:28:57<57:18,  3.35it/s]
 97%|█████████▋| 359939/371472 [6:28:57<1:00:54,  3.16it/s]
 97%|█████████▋| 359940/371472 [6:28:57<57:50,  3.32it/s]  
                                                         
{'loss': 2.5763, 'learning_rate': 1.2795470706113043e-07, 'epoch': 15.5}

 97%|█████████▋| 359940/371472 [6:28:57<57:50,  3.32it/s]
 97%|█████████▋| 359941/371472 [6:28:58<56:57,  3.37it/s]
 97%|█████████▋| 359942/371472 [6:28:58<55:14,  3.48it/s]
 97%|█████████▋| 359943/371472 [6:28:58<56:35,  3.40it/s]
 97%|█████████▋| 359944/371472 [6:28:58<56:53,  3.38it/s]
 97%|█████████▋| 359945/371472 [6:28:59<57:13,  3.36it/s]
 97%|█████████▋| 359946/371472 [6:28:59<1:00:06,  3.20it/s]
 97%|█████████▋| 359947/371472 [6:28:59<1:04:46,  2.97it/s]
 97%|█████████▋| 359948/371472 [6:29:00<1:00:27,  3.18it/s]
 97%|█████████▋| 359949/371472 [6:29:00<55:39,  3.45it/s]  
 97%|█████████▋| 359950/371472 [6:29:00<56:29,  3.40it/s]
 97%|█████████▋| 359951/371472 [6:29:01<53:36,  3.58it/s]
 97%|█████████▋| 359952/371472 [6:29:01<51:21,  3.74it/s]
 97%|█████████▋| 359953/371472 [6:29:01<51:44,  3.71it/s]
 97%|█████████▋| 359954/371472 [6:29:01<52:41,  3.64it/s]
 97%|█████████▋| 359955/371472 [6:29:02<51:39,  3.72it/s]
 97%|█████████▋| 359956/371472 [6:29:02<52:09,  3.68it/s]
 97%|█████████▋| 359957/371472 [6:29:02<51:23,  3.73it/s]
 97%|█████████▋| 359958/371472 [6:29:02<49:05,  3.91it/s]
 97%|█████████▋| 359959/371472 [6:29:03<48:54,  3.92it/s]
 97%|█████████▋| 359960/371472 [6:29:03<53:55,  3.56it/s]
                                                         
{'loss': 2.5861, 'learning_rate': 1.2790622508565147e-07, 'epoch': 15.5}

 97%|█████████▋| 359960/371472 [6:29:03<53:55,  3.56it/s]
 97%|█████████▋| 359961/371472 [6:29:03<57:57,  3.31it/s]
 97%|█████████▋| 359962/371472 [6:29:04<56:03,  3.42it/s]
 97%|█████████▋| 359963/371472 [6:29:04<53:58,  3.55it/s]
 97%|█████████▋| 359964/371472 [6:29:04<52:11,  3.67it/s]
 97%|█████████▋| 359965/371472 [6:29:04<58:35,  3.27it/s]
 97%|█████████▋| 359966/371472 [6:29:05<56:37,  3.39it/s]
 97%|█████████▋| 359967/371472 [6:29:05<54:19,  3.53it/s]
 97%|█████████▋| 359968/371472 [6:29:05<51:49,  3.70it/s]
 97%|█████████▋| 359969/371472 [6:29:05<51:27,  3.73it/s]
 97%|█████████▋| 359970/371472 [6:29:06<53:53,  3.56it/s]
 97%|█████████▋| 359971/371472 [6:29:06<56:48,  3.37it/s]
 97%|█████████▋| 359972/371472 [6:29:06<59:47,  3.21it/s]
 97%|█████████▋| 359973/371472 [6:29:07<57:12,  3.35it/s]
 97%|█████████▋| 359974/371472 [6:29:07<53:39,  3.57it/s]
 97%|█████████▋| 359975/371472 [6:29:07<52:52,  3.62it/s]
 97%|█████████▋| 359976/371472 [6:29:08<51:49,  3.70it/s]
 97%|█████████▋| 359977/371472 [6:29:08<52:32,  3.65it/s]
 97%|█████████▋| 359978/371472 [6:29:08<53:01,  3.61it/s]
 97%|█████████▋| 359979/371472 [6:29:09<1:02:56,  3.04it/s]
 97%|█████████▋| 359980/371472 [6:29:09<1:01:50,  3.10it/s]
                                                           
{'loss': 2.5417, 'learning_rate': 1.2785774311017262e-07, 'epoch': 15.51}

 97%|█████████▋| 359980/371472 [6:29:09<1:01:50,  3.10it/s]
 97%|█████████▋| 359981/371472 [6:29:09<1:01:23,  3.12it/s]
 97%|█████████▋| 359982/371472 [6:29:09<57:38,  3.32it/s]  
 97%|█████████▋| 359983/371472 [6:29:10<55:23,  3.46it/s]
 97%|█████████▋| 359984/371472 [6:29:10<59:28,  3.22it/s]
 97%|█████████▋| 359985/371472 [6:29:10<56:50,  3.37it/s]
 97%|█████████▋| 359986/371472 [6:29:11<55:39,  3.44it/s]
 97%|█████████▋| 359987/371472 [6:29:11<56:38,  3.38it/s]
 97%|█████████▋| 359988/371472 [6:29:11<58:09,  3.29it/s]
 97%|█████████▋| 359989/371472 [6:29:11<56:17,  3.40it/s]
 97%|█████████▋| 359990/371472 [6:29:12<54:27,  3.51it/s]
 97%|█████████▋| 359991/371472 [6:29:12<52:59,  3.61it/s]
 97%|█████████▋| 359992/371472 [6:29:12<58:03,  3.30it/s]
 97%|█████████▋| 359993/371472 [6:29:13<56:20,  3.40it/s]
 97%|█████████▋| 359994/371472 [6:29:13<58:46,  3.25it/s]
 97%|█████████▋| 359995/371472 [6:29:13<57:51,  3.31it/s]
 97%|█████████▋| 359996/371472 [6:29:14<58:01,  3.30it/s]
 97%|█████████▋| 359997/371472 [6:29:14<54:54,  3.48it/s]
 97%|█████████▋| 359998/371472 [6:29:14<55:04,  3.47it/s]
 97%|█████████▋| 359999/371472 [6:29:14<54:55,  3.48it/s]
 97%|█████████▋| 360000/371472 [6:29:15<58:23,  3.27it/s]
                                                         
{'loss': 2.5145, 'learning_rate': 1.278092611346937e-07, 'epoch': 15.51}

 97%|█████████▋| 360000/371472 [6:29:15<58:23,  3.27it/s]
 97%|█████████▋| 360001/371472 [6:29:15<57:40,  3.31it/s]
 97%|█████████▋| 360002/371472 [6:29:15<56:59,  3.35it/s]
 97%|█████████▋| 360003/371472 [6:29:16<56:03,  3.41it/s]
 97%|█████████▋| 360004/371472 [6:29:16<55:32,  3.44it/s]
 97%|█████████▋| 360005/371472 [6:29:16<55:23,  3.45it/s]
 97%|█████████▋| 360006/371472 [6:29:16<54:50,  3.48it/s]
 97%|█████████▋| 360007/371472 [6:29:17<54:48,  3.49it/s]
 97%|█████████▋| 360008/371472 [6:29:17<57:01,  3.35it/s]
 97%|█████████▋| 360009/371472 [6:29:17<55:19,  3.45it/s]
 97%|█████████▋| 360010/371472 [6:29:18<57:30,  3.32it/s]
 97%|█████████▋| 360011/371472 [6:29:18<54:51,  3.48it/s]
 97%|█████████▋| 360012/371472 [6:29:18<52:12,  3.66it/s]
 97%|█████████▋| 360013/371472 [6:29:18<52:26,  3.64it/s]
 97%|█████████▋| 360014/371472 [6:29:19<52:24,  3.64it/s]
 97%|█████████▋| 360015/371472 [6:29:19<52:34,  3.63it/s]
 97%|█████████▋| 360016/371472 [6:29:19<52:29,  3.64it/s]
 97%|█████████▋| 360017/371472 [6:29:20<52:01,  3.67it/s]
 97%|█████████▋| 360018/371472 [6:29:20<50:53,  3.75it/s]
 97%|█████████▋| 360019/371472 [6:29:20<54:24,  3.51it/s]
 97%|█████████▋| 360020/371472 [6:29:20<52:16,  3.65it/s]
                                                         
{'loss': 2.7408, 'learning_rate': 1.2776077915921484e-07, 'epoch': 15.51}

 97%|█████████▋| 360020/371472 [6:29:20<52:16,  3.65it/s]
 97%|█████████▋| 360021/371472 [6:29:21<51:53,  3.68it/s]
 97%|█████████▋| 360022/371472 [6:29:21<51:11,  3.73it/s]
 97%|█████████▋| 360023/371472 [6:29:21<52:40,  3.62it/s]
 97%|█████████▋| 360024/371472 [6:29:21<54:33,  3.50it/s]
 97%|█████████▋| 360025/371472 [6:29:22<56:19,  3.39it/s]
 97%|█████████▋| 360026/371472 [6:29:22<54:55,  3.47it/s]
 97%|█████████▋| 360027/371472 [6:29:22<52:39,  3.62it/s]
 97%|█████████▋| 360028/371472 [6:29:23<52:32,  3.63it/s]
 97%|█████████▋| 360029/371472 [6:29:23<52:57,  3.60it/s]
 97%|█████████▋| 360030/371472 [6:29:23<51:31,  3.70it/s]
 97%|█████████▋| 360031/371472 [6:29:23<50:27,  3.78it/s]
 97%|█████████▋| 360032/371472 [6:29:24<49:25,  3.86it/s]
 97%|█████████▋| 360033/371472 [6:29:24<49:57,  3.82it/s]
 97%|█████████▋| 360034/371472 [6:29:24<53:21,  3.57it/s]
 97%|█████████▋| 360035/371472 [6:29:24<52:24,  3.64it/s]
 97%|█████████▋| 360036/371472 [6:29:25<51:10,  3.72it/s]
 97%|█████████▋| 360037/371472 [6:29:25<50:24,  3.78it/s]
 97%|█████████▋| 360038/371472 [6:29:25<51:21,  3.71it/s]
 97%|█████████▋| 360039/371472 [6:29:26<52:52,  3.60it/s]
 97%|█████████▋| 360040/371472 [6:29:26<51:36,  3.69it/s]
                                                         
{'loss': 2.5205, 'learning_rate': 1.2771229718373592e-07, 'epoch': 15.51}

 97%|█████████▋| 360040/371472 [6:29:26<51:36,  3.69it/s]
 97%|█████████▋| 360041/371472 [6:29:26<53:19,  3.57it/s]
 97%|█████████▋| 360042/371472 [6:29:26<51:43,  3.68it/s]
 97%|█████████▋| 360043/371472 [6:29:27<53:07,  3.59it/s]
 97%|█████████▋| 360044/371472 [6:29:27<52:14,  3.65it/s]
 97%|█████████▋| 360045/371472 [6:29:27<50:31,  3.77it/s]
 97%|█████████▋| 360046/371472 [6:29:27<50:33,  3.77it/s]
 97%|█████████▋| 360047/371472 [6:29:28<54:04,  3.52it/s]
 97%|█████████▋| 360048/371472 [6:29:28<58:17,  3.27it/s]
 97%|█████████▋| 360049/371472 [6:29:28<58:52,  3.23it/s]
 97%|█████████▋| 360050/371472 [6:29:29<1:01:19,  3.10it/s]
 97%|█████████▋| 360051/371472 [6:29:29<1:05:29,  2.91it/s]
 97%|█████████▋| 360052/371472 [6:29:29<1:01:00,  3.12it/s]
 97%|█████████▋| 360053/371472 [6:29:30<57:35,  3.30it/s]  
 97%|█████████▋| 360054/371472 [6:29:30<1:06:26,  2.86it/s]
 97%|█████████▋| 360055/371472 [6:29:30<59:52,  3.18it/s]  
 97%|█████████▋| 360056/371472 [6:29:31<59:13,  3.21it/s]
 97%|█████████▋| 360057/371472 [6:29:31<56:23,  3.37it/s]
 97%|█████████▋| 360058/371472 [6:29:31<56:08,  3.39it/s]
 97%|█████████▋| 360059/371472 [6:29:32<54:42,  3.48it/s]
 97%|█████████▋| 360060/371472 [6:29:32<55:52,  3.40it/s]
                                                         
{'loss': 2.639, 'learning_rate': 1.27663815208257e-07, 'epoch': 15.51}

 97%|█████████▋| 360060/371472 [6:29:32<55:52,  3.40it/s]
 97%|█████████▋| 360061/371472 [6:29:32<53:29,  3.56it/s]
 97%|█████████▋| 360062/371472 [6:29:32<51:52,  3.67it/s]
 97%|█████████▋| 360063/371472 [6:29:33<51:13,  3.71it/s]
 97%|█████████▋| 360064/371472 [6:29:33<52:14,  3.64it/s]
 97%|█████████▋| 360065/371472 [6:29:33<52:14,  3.64it/s]
 97%|█████████▋| 360066/371472 [6:29:33<54:12,  3.51it/s]
 97%|█████████▋| 360067/371472 [6:29:34<54:07,  3.51it/s]
 97%|█████████▋| 360068/371472 [6:29:34<52:04,  3.65it/s]
 97%|█████████▋| 360069/371472 [6:29:34<52:36,  3.61it/s]
 97%|█████████▋| 360070/371472 [6:29:35<54:11,  3.51it/s]
 97%|█████████▋| 360071/371472 [6:29:35<52:45,  3.60it/s]
 97%|█████████▋| 360072/371472 [6:29:35<50:51,  3.74it/s]
 97%|█████████▋| 360073/371472 [6:29:35<50:29,  3.76it/s]
 97%|█████████▋| 360074/371472 [6:29:36<50:07,  3.79it/s]
 97%|█████████▋| 360075/371472 [6:29:36<50:31,  3.76it/s]
 97%|█████████▋| 360076/371472 [6:29:36<51:43,  3.67it/s]
 97%|█████████▋| 360077/371472 [6:29:36<51:30,  3.69it/s]
 97%|█████████▋| 360078/371472 [6:29:37<54:36,  3.48it/s]
 97%|█████████▋| 360079/371472 [6:29:37<52:05,  3.64it/s]
 97%|█████████▋| 360080/371472 [6:29:37<50:23,  3.77it/s]
                                                         
{'loss': 2.6369, 'learning_rate': 1.276153332327781e-07, 'epoch': 15.51}

 97%|█████████▋| 360080/371472 [6:29:37<50:23,  3.77it/s]
 97%|█████████▋| 360081/371472 [6:29:38<50:11,  3.78it/s]
 97%|█████████▋| 360082/371472 [6:29:38<51:51,  3.66it/s]
 97%|█████████▋| 360083/371472 [6:29:38<58:21,  3.25it/s]
 97%|█████████▋| 360084/371472 [6:29:39<57:06,  3.32it/s]
 97%|█████████▋| 360085/371472 [6:29:39<59:26,  3.19it/s]
 97%|█████████▋| 360086/371472 [6:29:39<56:02,  3.39it/s]
 97%|█████████▋| 360087/371472 [6:29:39<55:03,  3.45it/s]
 97%|█████████▋| 360088/371472 [6:29:40<56:51,  3.34it/s]
 97%|█████████▋| 360089/371472 [6:29:40<57:15,  3.31it/s]
 97%|█████████▋| 360090/371472 [6:29:40<56:34,  3.35it/s]
 97%|█████████▋| 360091/371472 [6:29:41<54:57,  3.45it/s]
 97%|█████████▋| 360092/371472 [6:29:41<52:01,  3.65it/s]
 97%|█████████▋| 360093/371472 [6:29:41<54:01,  3.51it/s]
 97%|█████████▋| 360094/371472 [6:29:41<56:07,  3.38it/s]
 97%|█████████▋| 360095/371472 [6:29:42<57:11,  3.32it/s]
 97%|█████████▋| 360096/371472 [6:29:42<55:00,  3.45it/s]
 97%|█████████▋| 360097/371472 [6:29:42<54:27,  3.48it/s]
 97%|█████████▋| 360098/371472 [6:29:43<51:36,  3.67it/s]
 97%|█████████▋| 360099/371472 [6:29:43<50:12,  3.77it/s]
 97%|█████████▋| 360100/371472 [6:29:43<49:38,  3.82it/s]
                                                         
{'loss': 2.4437, 'learning_rate': 1.2756685125729918e-07, 'epoch': 15.51}

 97%|█████████▋| 360100/371472 [6:29:43<49:38,  3.82it/s]
 97%|█████████▋| 360101/371472 [6:29:43<52:10,  3.63it/s]
 97%|█████████▋| 360102/371472 [6:29:44<50:07,  3.78it/s]
 97%|█████████▋| 360103/371472 [6:29:44<1:06:58,  2.83it/s]
 97%|█████████▋| 360104/371472 [6:29:44<1:03:17,  2.99it/s]
 97%|█████████▋| 360105/371472 [6:29:45<57:26,  3.30it/s]  
 97%|█████████▋| 360106/371472 [6:29:45<57:24,  3.30it/s]
 97%|█████████▋| 360107/371472 [6:29:45<54:16,  3.49it/s]
 97%|█████████▋| 360108/371472 [6:29:46<56:20,  3.36it/s]
 97%|█████████▋| 360109/371472 [6:29:46<55:18,  3.42it/s]
 97%|█████████▋| 360110/371472 [6:29:46<54:47,  3.46it/s]
 97%|█████████▋| 360111/371472 [6:29:46<55:34,  3.41it/s]
 97%|█████████▋| 360112/371472 [6:29:47<53:36,  3.53it/s]
 97%|█████████▋| 360113/371472 [6:29:47<52:12,  3.63it/s]
 97%|█████████▋| 360114/371472 [6:29:47<51:43,  3.66it/s]
 97%|█████████▋| 360115/371472 [6:29:47<50:25,  3.75it/s]
 97%|█████████▋| 360116/371472 [6:29:48<50:18,  3.76it/s]
 97%|█████████▋| 360117/371472 [6:29:48<50:47,  3.73it/s]
 97%|█████████▋| 360118/371472 [6:29:48<51:24,  3.68it/s]
 97%|█████████▋| 360119/371472 [6:29:49<51:57,  3.64it/s]
 97%|█████████▋| 360120/371472 [6:29:49<49:59,  3.78it/s]
                                                         
{'loss': 2.5743, 'learning_rate': 1.2751836928182033e-07, 'epoch': 15.51}

 97%|█████████▋| 360120/371472 [6:29:49<49:59,  3.78it/s]
 97%|█████████▋| 360121/371472 [6:29:49<49:38,  3.81it/s]
 97%|█████████▋| 360122/371472 [6:29:49<49:05,  3.85it/s]
 97%|█████████▋| 360123/371472 [6:29:50<49:52,  3.79it/s]
 97%|█████████▋| 360124/371472 [6:29:50<52:27,  3.61it/s]
 97%|█████████▋| 360125/371472 [6:29:50<54:07,  3.49it/s]
 97%|█████████▋| 360126/371472 [6:29:50<54:02,  3.50it/s]
 97%|█████████▋| 360127/371472 [6:29:51<56:26,  3.35it/s]
 97%|█████████▋| 360128/371472 [6:29:51<53:53,  3.51it/s]
 97%|█████████▋| 360129/371472 [6:29:51<52:59,  3.57it/s]
 97%|█████████▋| 360130/371472 [6:29:52<52:03,  3.63it/s]
 97%|█████████▋| 360131/371472 [6:29:52<52:03,  3.63it/s]
 97%|█████████▋| 360132/371472 [6:29:52<54:23,  3.47it/s]
 97%|█████████▋| 360133/371472 [6:29:52<51:53,  3.64it/s]
 97%|█████████▋| 360134/371472 [6:29:53<50:36,  3.73it/s]
 97%|█████████▋| 360135/371472 [6:29:53<48:42,  3.88it/s]
 97%|█████████▋| 360136/371472 [6:29:53<50:16,  3.76it/s]
 97%|█████████▋| 360137/371472 [6:29:54<53:03,  3.56it/s]
 97%|█████████▋| 360138/371472 [6:29:54<53:11,  3.55it/s]
 97%|█████████▋| 360139/371472 [6:29:54<56:51,  3.32it/s]
 97%|█████████▋| 360140/371472 [6:29:54<54:58,  3.44it/s]
                                                         
{'loss': 2.4876, 'learning_rate': 1.274698873063414e-07, 'epoch': 15.51}

 97%|█████████▋| 360140/371472 [6:29:54<54:58,  3.44it/s]
 97%|█████████▋| 360141/371472 [6:29:55<53:43,  3.52it/s]
 97%|█████████▋| 360142/371472 [6:29:55<54:38,  3.46it/s]
 97%|█████████▋| 360143/371472 [6:29:55<52:11,  3.62it/s]
 97%|█████████▋| 360144/371472 [6:29:55<50:25,  3.74it/s]
 97%|█████████▋| 360145/371472 [6:29:56<50:44,  3.72it/s]
 97%|█████████▋| 360146/371472 [6:29:56<51:52,  3.64it/s]
 97%|█████████▋| 360147/371472 [6:29:56<58:22,  3.23it/s]
 97%|█████████▋| 360148/371472 [6:29:57<56:49,  3.32it/s]
 97%|█████████▋| 360149/371472 [6:29:57<55:19,  3.41it/s]
 97%|█████████▋| 360150/371472 [6:29:57<56:37,  3.33it/s]
 97%|█████████▋| 360151/371472 [6:29:58<59:11,  3.19it/s]
 97%|█████████▋| 360152/371472 [6:29:58<57:30,  3.28it/s]
 97%|█████████▋| 360153/371472 [6:29:58<58:33,  3.22it/s]
 97%|█████████▋| 360154/371472 [6:29:59<56:56,  3.31it/s]
 97%|█████████▋| 360155/371472 [6:29:59<55:13,  3.42it/s]
 97%|█████████▋| 360156/371472 [6:29:59<53:52,  3.50it/s]
 97%|█████████▋| 360157/371472 [6:29:59<54:49,  3.44it/s]
 97%|█████████▋| 360158/371472 [6:30:00<55:38,  3.39it/s]
 97%|█████████▋| 360159/371472 [6:30:00<54:36,  3.45it/s]
 97%|█████████▋| 360160/371472 [6:30:00<56:52,  3.31it/s]
                                                         
{'loss': 2.5064, 'learning_rate': 1.2742140533086256e-07, 'epoch': 15.51}

 97%|█████████▋| 360160/371472 [6:30:00<56:52,  3.31it/s]
 97%|█████████▋| 360161/371472 [6:30:01<54:11,  3.48it/s]
 97%|█████████▋| 360162/371472 [6:30:01<59:11,  3.19it/s]
 97%|█████████▋| 360163/371472 [6:30:01<58:44,  3.21it/s]
 97%|█████████▋| 360164/371472 [6:30:02<59:13,  3.18it/s]
 97%|█████████▋| 360165/371472 [6:30:02<55:56,  3.37it/s]
 97%|█████████▋| 360166/371472 [6:30:02<53:32,  3.52it/s]
 97%|█████████▋| 360167/371472 [6:30:02<53:02,  3.55it/s]
 97%|█████████▋| 360168/371472 [6:30:03<53:19,  3.53it/s]
 97%|█████████▋| 360169/371472 [6:30:03<52:49,  3.57it/s]
 97%|█████████▋| 360170/371472 [6:30:03<51:02,  3.69it/s]
 97%|█████████▋| 360171/371472 [6:30:03<49:45,  3.79it/s]
 97%|█████████▋| 360172/371472 [6:30:04<57:26,  3.28it/s]
 97%|█████████▋| 360173/371472 [6:30:04<56:24,  3.34it/s]
 97%|█████████▋| 360174/371472 [6:30:04<53:31,  3.52it/s]
 97%|█████████▋| 360175/371472 [6:30:05<52:34,  3.58it/s]
 97%|█████████▋| 360176/371472 [6:30:05<53:05,  3.55it/s]
 97%|█████████▋| 360177/371472 [6:30:05<52:25,  3.59it/s]
 97%|█████████▋| 360178/371472 [6:30:05<50:44,  3.71it/s]
 97%|█████████▋| 360179/371472 [6:30:06<51:40,  3.64it/s]
 97%|█████████▋| 360180/371472 [6:30:06<49:21,  3.81it/s]
                                                         
{'loss': 2.6562, 'learning_rate': 1.273729233553836e-07, 'epoch': 15.51}

 97%|█████████▋| 360180/371472 [6:30:06<49:21,  3.81it/s]
 97%|█████████▋| 360181/371472 [6:30:06<50:01,  3.76it/s]
 97%|█████████▋| 360182/371472 [6:30:06<50:55,  3.70it/s]
 97%|█████████▋| 360183/371472 [6:30:07<52:28,  3.59it/s]
 97%|█████████▋| 360184/371472 [6:30:07<52:08,  3.61it/s]
 97%|█████████▋| 360185/371472 [6:30:07<55:28,  3.39it/s]
 97%|█████████▋| 360186/371472 [6:30:08<55:27,  3.39it/s]
 97%|█████████▋| 360187/371472 [6:30:08<54:42,  3.44it/s]
 97%|█████████▋| 360188/371472 [6:30:08<54:15,  3.47it/s]
 97%|█████████▋| 360189/371472 [6:30:08<52:41,  3.57it/s]
 97%|█████████▋| 360190/371472 [6:30:09<56:55,  3.30it/s]
 97%|█████████▋| 360191/371472 [6:30:09<54:10,  3.47it/s]
 97%|█████████▋| 360192/371472 [6:30:09<53:43,  3.50it/s]
 97%|█████████▋| 360193/371472 [6:30:10<51:55,  3.62it/s]
 97%|█████████▋| 360194/371472 [6:30:10<51:30,  3.65it/s]
 97%|█████████▋| 360195/371472 [6:30:10<50:48,  3.70it/s]
 97%|█████████▋| 360196/371472 [6:30:10<52:50,  3.56it/s]
 97%|█████████▋| 360197/371472 [6:30:11<51:58,  3.62it/s]
 97%|█████████▋| 360198/371472 [6:30:11<52:09,  3.60it/s]
 97%|█████████▋| 360199/371472 [6:30:11<51:08,  3.67it/s]
 97%|█████████▋| 360200/371472 [6:30:12<49:05,  3.83it/s]
                                                         
{'loss': 2.6843, 'learning_rate': 1.2732444137990478e-07, 'epoch': 15.51}

 97%|█████████▋| 360200/371472 [6:30:12<49:05,  3.83it/s]
 97%|█████████▋| 360201/371472 [6:30:12<48:49,  3.85it/s]
 97%|█████████▋| 360202/371472 [6:30:12<48:05,  3.91it/s]
 97%|█████████▋| 360203/371472 [6:30:12<48:19,  3.89it/s]
 97%|█████████▋| 360204/371472 [6:30:13<53:29,  3.51it/s]
 97%|█████████▋| 360205/371472 [6:30:13<54:36,  3.44it/s]
 97%|█████████▋| 360206/371472 [6:30:13<53:28,  3.51it/s]
 97%|█████████▋| 360207/371472 [6:30:13<52:37,  3.57it/s]
 97%|█████████▋| 360208/371472 [6:30:14<52:54,  3.55it/s]
 97%|█████████▋| 360209/371472 [6:30:14<54:23,  3.45it/s]
 97%|█████████▋| 360210/371472 [6:30:14<52:58,  3.54it/s]
 97%|█████████▋| 360211/371472 [6:30:15<52:20,  3.59it/s]
 97%|█████████▋| 360212/371472 [6:30:15<50:20,  3.73it/s]
 97%|█████████▋| 360213/371472 [6:30:15<48:47,  3.85it/s]
 97%|█████████▋| 360214/371472 [6:30:15<48:42,  3.85it/s]
 97%|█████████▋| 360215/371472 [6:30:16<53:30,  3.51it/s]
 97%|█████████▋| 360216/371472 [6:30:16<55:01,  3.41it/s]
 97%|█████████▋| 360217/371472 [6:30:16<54:31,  3.44it/s]
 97%|█████████▋| 360218/371472 [6:30:17<54:58,  3.41it/s]
 97%|█████████▋| 360219/371472 [6:30:17<54:10,  3.46it/s]
 97%|█████████▋| 360220/371472 [6:30:17<54:35,  3.44it/s]
                                                         
{'loss': 2.4722, 'learning_rate': 1.2727595940442582e-07, 'epoch': 15.52}

 97%|█████████▋| 360220/371472 [6:30:17<54:35,  3.44it/s]
 97%|█████████▋| 360221/371472 [6:30:17<54:43,  3.43it/s]
 97%|█████████▋| 360222/371472 [6:30:18<53:10,  3.53it/s]
 97%|█████████▋| 360223/371472 [6:30:18<51:49,  3.62it/s]
 97%|█████████▋| 360224/371472 [6:30:18<51:41,  3.63it/s]
 97%|█████████▋| 360225/371472 [6:30:19<51:26,  3.64it/s]
 97%|█████████▋| 360226/371472 [6:30:19<50:29,  3.71it/s]
 97%|█████████▋| 360227/371472 [6:30:19<49:53,  3.76it/s]
 97%|█████████▋| 360228/371472 [6:30:19<48:09,  3.89it/s]
 97%|█████████▋| 360229/371472 [6:30:20<47:11,  3.97it/s]
 97%|█████████▋| 360230/371472 [6:30:20<48:48,  3.84it/s]
 97%|█████████▋| 360231/371472 [6:30:20<48:55,  3.83it/s]
 97%|█████████▋| 360232/371472 [6:30:20<49:41,  3.77it/s]
 97%|█████████▋| 360233/371472 [6:30:21<51:54,  3.61it/s]
 97%|█████████▋| 360234/371472 [6:30:21<55:52,  3.35it/s]
 97%|█████████▋| 360235/371472 [6:30:21<55:54,  3.35it/s]
 97%|█████████▋| 360236/371472 [6:30:22<54:04,  3.46it/s]
 97%|█████████▋| 360237/371472 [6:30:22<53:08,  3.52it/s]
 97%|█████████▋| 360238/371472 [6:30:22<52:38,  3.56it/s]
 97%|█████████▋| 360239/371472 [6:30:22<52:58,  3.53it/s]
 97%|█████████▋| 360240/371472 [6:30:23<52:50,  3.54it/s]
                                                         
{'loss': 2.669, 'learning_rate': 1.27227477428947e-07, 'epoch': 15.52}

 97%|█████████▋| 360240/371472 [6:30:23<52:50,  3.54it/s]
 97%|█████████▋| 360241/371472 [6:30:23<50:42,  3.69it/s]
 97%|█████████▋| 360242/371472 [6:30:23<56:46,  3.30it/s]
 97%|█████████▋| 360243/371472 [6:30:24<57:15,  3.27it/s]
 97%|█████████▋| 360244/371472 [6:30:24<58:07,  3.22it/s]
 97%|█████████▋| 360245/371472 [6:30:24<54:57,  3.40it/s]
 97%|█████████▋| 360246/371472 [6:30:24<53:03,  3.53it/s]
 97%|█████████▋| 360247/371472 [6:30:25<52:16,  3.58it/s]
 97%|█████████▋| 360248/371472 [6:30:25<57:42,  3.24it/s]
 97%|█████████▋| 360249/371472 [6:30:25<53:52,  3.47it/s]
 97%|█████████▋| 360250/371472 [6:30:26<53:04,  3.52it/s]
 97%|█████████▋| 360251/371472 [6:30:26<54:19,  3.44it/s]
 97%|█████████▋| 360252/371472 [6:30:26<1:01:01,  3.06it/s]
 97%|█████████▋| 360253/371472 [6:30:27<57:49,  3.23it/s]  
 97%|█████████▋| 360254/371472 [6:30:27<57:15,  3.26it/s]
 97%|█████████▋| 360255/371472 [6:30:27<58:32,  3.19it/s]
 97%|█████████▋| 360256/371472 [6:30:28<1:01:08,  3.06it/s]
 97%|█████████▋| 360257/371472 [6:30:28<58:09,  3.21it/s]  
 97%|█████████▋| 360258/371472 [6:30:28<56:25,  3.31it/s]
 97%|█████████▋| 360259/371472 [6:30:28<55:31,  3.37it/s]
 97%|█████████▋| 360260/371472 [6:30:29<53:06,  3.52it/s]
                                                         
{'loss': 2.6349, 'learning_rate': 1.2717899545346805e-07, 'epoch': 15.52}

 97%|█████████▋| 360260/371472 [6:30:29<53:06,  3.52it/s]
 97%|█████████▋| 360261/371472 [6:30:29<52:50,  3.54it/s]
 97%|█████████▋| 360262/371472 [6:30:29<53:34,  3.49it/s]
 97%|█████████▋| 360263/371472 [6:30:30<51:57,  3.60it/s]
 97%|█████████▋| 360264/371472 [6:30:30<55:24,  3.37it/s]
 97%|█████████▋| 360265/371472 [6:30:30<53:30,  3.49it/s]
 97%|█████████▋| 360266/371472 [6:30:30<53:02,  3.52it/s]
 97%|█████████▋| 360267/371472 [6:30:31<51:05,  3.66it/s]
 97%|█████████▋| 360268/371472 [6:30:31<56:39,  3.30it/s]
 97%|█████████▋| 360269/371472 [6:30:31<53:50,  3.47it/s]
 97%|█████████▋| 360270/371472 [6:30:32<53:28,  3.49it/s]
 97%|█████████▋| 360271/371472 [6:30:32<53:10,  3.51it/s]
 97%|█████████▋| 360272/371472 [6:30:32<52:04,  3.58it/s]
 97%|█████████▋| 360273/371472 [6:30:32<52:01,  3.59it/s]
 97%|█████████▋| 360274/371472 [6:30:33<53:34,  3.48it/s]
 97%|█████████▋| 360275/371472 [6:30:33<50:21,  3.71it/s]
 97%|█████████▋| 360276/371472 [6:30:33<49:41,  3.75it/s]
 97%|█████████▋| 360277/371472 [6:30:33<51:11,  3.64it/s]
 97%|█████████▋| 360278/371472 [6:30:34<51:18,  3.64it/s]
 97%|█████████▋| 360279/371472 [6:30:34<50:19,  3.71it/s]
 97%|█████████▋| 360280/371472 [6:30:34<54:07,  3.45it/s]
                                                         
{'loss': 2.6174, 'learning_rate': 1.271305134779892e-07, 'epoch': 15.52}

 97%|█████████▋| 360280/371472 [6:30:34<54:07,  3.45it/s]
 97%|█████████▋| 360281/371472 [6:30:35<58:33,  3.19it/s]
 97%|█████████▋| 360282/371472 [6:30:35<57:06,  3.27it/s]
 97%|█████████▋| 360283/371472 [6:30:35<55:08,  3.38it/s]
 97%|█████████▋| 360284/371472 [6:30:36<53:47,  3.47it/s]
 97%|█████████▋| 360285/371472 [6:30:36<53:02,  3.52it/s]
 97%|█████████▋| 360286/371472 [6:30:36<52:47,  3.53it/s]
 97%|█████████▋| 360287/371472 [6:30:36<50:47,  3.67it/s]
 97%|█████████▋| 360288/371472 [6:30:37<52:30,  3.55it/s]
 97%|█████████▋| 360289/371472 [6:30:37<51:26,  3.62it/s]
 97%|█████████▋| 360290/371472 [6:30:37<51:06,  3.65it/s]
 97%|█████████▋| 360291/371472 [6:30:37<49:29,  3.76it/s]
 97%|█████████▋| 360292/371472 [6:30:38<49:55,  3.73it/s]
 97%|█████████▋| 360293/371472 [6:30:38<51:31,  3.62it/s]
 97%|█████████▋| 360294/371472 [6:30:38<50:20,  3.70it/s]
 97%|█████████▋| 360295/371472 [6:30:39<52:57,  3.52it/s]
 97%|█████████▋| 360296/371472 [6:30:39<56:39,  3.29it/s]
 97%|█████████▋| 360297/371472 [6:30:39<54:45,  3.40it/s]
 97%|█████████▋| 360298/371472 [6:30:39<55:49,  3.34it/s]
 97%|█████████▋| 360299/371472 [6:30:40<54:56,  3.39it/s]
 97%|█████████▋| 360300/371472 [6:30:40<52:07,  3.57it/s]
                                                         
{'loss': 2.5786, 'learning_rate': 1.2708203150251024e-07, 'epoch': 15.52}

 97%|█████████▋| 360300/371472 [6:30:40<52:07,  3.57it/s]
 97%|█████████▋| 360301/371472 [6:30:40<54:06,  3.44it/s]
 97%|█████████▋| 360302/371472 [6:30:41<52:46,  3.53it/s]
 97%|█████████▋| 360303/371472 [6:30:41<54:19,  3.43it/s]
 97%|█████████▋| 360304/371472 [6:30:41<52:30,  3.55it/s]
 97%|█████████▋| 360305/371472 [6:30:41<51:14,  3.63it/s]
 97%|█████████▋| 360306/371472 [6:30:42<48:56,  3.80it/s]
 97%|█████████▋| 360307/371472 [6:30:42<51:11,  3.64it/s]
 97%|█████████▋| 360308/371472 [6:30:42<51:20,  3.62it/s]
 97%|█████████▋| 360309/371472 [6:30:42<49:58,  3.72it/s]
 97%|█████████▋| 360310/371472 [6:30:43<49:12,  3.78it/s]
 97%|█████████▋| 360311/371472 [6:30:43<52:14,  3.56it/s]
 97%|█████████▋| 360312/371472 [6:30:43<52:25,  3.55it/s]
 97%|█████████▋| 360313/371472 [6:30:44<52:32,  3.54it/s]
 97%|█████████▋| 360314/371472 [6:30:44<56:22,  3.30it/s]
 97%|█████████▋| 360315/371472 [6:30:44<53:03,  3.50it/s]
 97%|█████████▋| 360316/371472 [6:30:45<58:59,  3.15it/s]
 97%|█████████▋| 360317/371472 [6:30:45<57:58,  3.21it/s]
 97%|█████████▋| 360318/371472 [6:30:45<57:20,  3.24it/s]
 97%|█████████▋| 360319/371472 [6:30:45<53:53,  3.45it/s]
 97%|█████████▋| 360320/371472 [6:30:46<58:26,  3.18it/s]
                                                         
{'loss': 2.7205, 'learning_rate': 1.2703354952703142e-07, 'epoch': 15.52}

 97%|█████████▋| 360320/371472 [6:30:46<58:26,  3.18it/s]
 97%|█████████▋| 360321/371472 [6:30:46<54:28,  3.41it/s]
 97%|█████████▋| 360322/371472 [6:30:46<54:33,  3.41it/s]
 97%|█████████▋| 360323/371472 [6:30:47<53:33,  3.47it/s]
 97%|█████████▋| 360324/371472 [6:30:47<52:10,  3.56it/s]
 97%|█████████▋| 360325/371472 [6:30:47<53:21,  3.48it/s]
 97%|█████████▋| 360326/371472 [6:30:47<50:53,  3.65it/s]
 97%|█████████▋| 360327/371472 [6:30:48<50:42,  3.66it/s]
 97%|█████████▋| 360328/371472 [6:30:48<51:11,  3.63it/s]
 97%|█████████▋| 360329/371472 [6:30:48<50:04,  3.71it/s]
 97%|█████████▋| 360330/371472 [6:30:49<48:54,  3.80it/s]
 97%|█████████▋| 360331/371472 [6:30:49<51:15,  3.62it/s]
 97%|█████████▋| 360332/371472 [6:30:49<50:16,  3.69it/s]
 97%|█████████▋| 360333/371472 [6:30:49<52:27,  3.54it/s]
 97%|█████████▋| 360334/371472 [6:30:50<50:43,  3.66it/s]
 97%|█████████▋| 360335/371472 [6:30:50<51:32,  3.60it/s]
 97%|█████████▋| 360336/371472 [6:30:50<50:57,  3.64it/s]
 97%|█████████▋| 360337/371472 [6:30:51<53:53,  3.44it/s]
 97%|█████████▋| 360338/371472 [6:30:51<52:49,  3.51it/s]
 97%|█████████▋| 360339/371472 [6:30:51<53:10,  3.49it/s]
 97%|█████████▋| 360340/371472 [6:30:51<55:44,  3.33it/s]
                                                         
{'loss': 2.5017, 'learning_rate': 1.2698506755155247e-07, 'epoch': 15.52}

 97%|█████████▋| 360340/371472 [6:30:51<55:44,  3.33it/s]
 97%|█████████▋| 360341/371472 [6:30:52<57:32,  3.22it/s]
 97%|█████████▋| 360342/371472 [6:30:52<55:35,  3.34it/s]
 97%|█████████▋| 360343/371472 [6:30:52<55:19,  3.35it/s]
 97%|█████████▋| 360344/371472 [6:30:53<55:28,  3.34it/s]
 97%|█████████▋| 360345/371472 [6:30:53<57:27,  3.23it/s]
 97%|█████████▋| 360346/371472 [6:30:53<55:38,  3.33it/s]
 97%|█████████▋| 360347/371472 [6:30:54<53:47,  3.45it/s]
 97%|█████████▋| 360348/371472 [6:30:54<56:29,  3.28it/s]
 97%|█████████▋| 360349/371472 [6:30:54<54:32,  3.40it/s]
 97%|█████████▋| 360350/371472 [6:30:54<52:29,  3.53it/s]
 97%|█████████▋| 360351/371472 [6:30:55<57:37,  3.22it/s]
 97%|█████████▋| 360352/371472 [6:30:55<55:20,  3.35it/s]
 97%|█████████▋| 360353/371472 [6:30:55<54:38,  3.39it/s]
 97%|█████████▋| 360354/371472 [6:30:56<59:35,  3.11it/s]
 97%|█████████▋| 360355/371472 [6:30:56<55:39,  3.33it/s]
 97%|█████████▋| 360356/371472 [6:30:56<56:08,  3.30it/s]
 97%|█████████▋| 360357/371472 [6:30:57<57:37,  3.22it/s]
 97%|█████████▋| 360358/371472 [6:30:57<1:00:38,  3.05it/s]
 97%|█████████▋| 360359/371472 [6:30:57<57:51,  3.20it/s]  
 97%|█████████▋| 360360/371472 [6:30:57<55:54,  3.31it/s]
                                                         
{'loss': 2.5386, 'learning_rate': 1.2693658557607362e-07, 'epoch': 15.52}

 97%|█████████▋| 360360/371472 [6:30:57<55:54,  3.31it/s]
 97%|█████████▋| 360361/371472 [6:30:58<54:24,  3.40it/s]
 97%|█████████▋| 360362/371472 [6:30:58<53:14,  3.48it/s]
 97%|█████████▋| 360363/371472 [6:30:58<52:02,  3.56it/s]
 97%|█████████▋| 360364/371472 [6:30:59<51:14,  3.61it/s]
 97%|█████████▋| 360365/371472 [6:30:59<53:37,  3.45it/s]
 97%|█████████▋| 360366/371472 [6:30:59<53:10,  3.48it/s]
 97%|█████████▋| 360367/371472 [6:30:59<53:01,  3.49it/s]
 97%|█████████▋| 360368/371472 [6:31:00<52:35,  3.52it/s]
 97%|█████████▋| 360369/371472 [6:31:00<50:35,  3.66it/s]
 97%|█████████▋| 360370/371472 [6:31:00<49:57,  3.70it/s]
 97%|█████████▋| 360371/371472 [6:31:01<48:58,  3.78it/s]
 97%|█████████▋| 360372/371472 [6:31:01<50:34,  3.66it/s]
 97%|█████████▋| 360373/371472 [6:31:01<50:08,  3.69it/s]
 97%|█████████▋| 360374/371472 [6:31:01<56:32,  3.27it/s]
 97%|█████████▋| 360375/371472 [6:31:02<53:46,  3.44it/s]
 97%|█████████▋| 360376/371472 [6:31:02<57:01,  3.24it/s]
 97%|█████████▋| 360377/371472 [6:31:02<54:48,  3.37it/s]
 97%|█████████▋| 360378/371472 [6:31:03<57:16,  3.23it/s]
 97%|█████████▋| 360379/371472 [6:31:03<55:48,  3.31it/s]
 97%|█████████▋| 360380/371472 [6:31:03<53:16,  3.47it/s]
                                                         
{'loss': 2.5244, 'learning_rate': 1.268881036005947e-07, 'epoch': 15.52}

 97%|█████████▋| 360380/371472 [6:31:03<53:16,  3.47it/s]
 97%|█████████▋| 360381/371472 [6:31:04<54:09,  3.41it/s]
 97%|█████████▋| 360382/371472 [6:31:04<51:41,  3.58it/s]
 97%|█████████▋| 360383/371472 [6:31:04<51:03,  3.62it/s]
 97%|█████████▋| 360384/371472 [6:31:04<55:15,  3.34it/s]
 97%|█████████▋| 360385/371472 [6:31:05<54:17,  3.40it/s]
 97%|█████████▋| 360386/371472 [6:31:05<55:01,  3.36it/s]
 97%|█████████▋| 360387/371472 [6:31:05<54:05,  3.42it/s]
 97%|█████████▋| 360388/371472 [6:31:05<51:08,  3.61it/s]
 97%|█████████▋| 360389/371472 [6:31:06<51:15,  3.60it/s]
 97%|█████████▋| 360390/371472 [6:31:06<53:16,  3.47it/s]
 97%|█████████▋| 360391/371472 [6:31:06<54:07,  3.41it/s]
 97%|█████████▋| 360392/371472 [6:31:07<52:55,  3.49it/s]
 97%|█████████▋| 360393/371472 [6:31:07<51:13,  3.61it/s]
 97%|█████████▋| 360394/371472 [6:31:07<52:43,  3.50it/s]
 97%|█████████▋| 360395/371472 [6:31:08<1:00:25,  3.06it/s]
 97%|█████████▋| 360396/371472 [6:31:08<55:31,  3.32it/s]  
 97%|█████████▋| 360397/371472 [6:31:08<53:52,  3.43it/s]
 97%|█████████▋| 360398/371472 [6:31:08<53:46,  3.43it/s]
 97%|█████████▋| 360399/371472 [6:31:09<54:00,  3.42it/s]
 97%|█████████▋| 360400/371472 [6:31:09<53:07,  3.47it/s]
                                                         
{'loss': 2.4744, 'learning_rate': 1.2683962162511584e-07, 'epoch': 15.52}

 97%|█████████▋| 360400/371472 [6:31:09<53:07,  3.47it/s]
 97%|█████████▋| 360401/371472 [6:31:09<51:26,  3.59it/s]
 97%|█████████▋| 360402/371472 [6:31:10<53:47,  3.43it/s]
 97%|█████████▋| 360403/371472 [6:31:10<51:26,  3.59it/s]
 97%|█████████▋| 360404/371472 [6:31:10<54:39,  3.38it/s]
 97%|█████████▋| 360405/371472 [6:31:10<52:20,  3.52it/s]
 97%|█████████▋| 360406/371472 [6:31:11<55:01,  3.35it/s]
 97%|█████████▋| 360407/371472 [6:31:11<59:21,  3.11it/s]
 97%|█████████▋| 360408/371472 [6:31:11<54:53,  3.36it/s]
 97%|█████████▋| 360409/371472 [6:31:12<56:50,  3.24it/s]
 97%|█████████▋| 360410/371472 [6:31:12<55:02,  3.35it/s]
 97%|█████████▋| 360411/371472 [6:31:12<55:33,  3.32it/s]
 97%|█████████▋| 360412/371472 [6:31:13<52:17,  3.53it/s]
 97%|█████████▋| 360413/371472 [6:31:13<51:08,  3.60it/s]
 97%|█████████▋| 360414/371472 [6:31:13<50:38,  3.64it/s]
 97%|█████████▋| 360415/371472 [6:31:13<52:10,  3.53it/s]
 97%|█████████▋| 360416/371472 [6:31:14<49:45,  3.70it/s]
 97%|█████████▋| 360417/371472 [6:31:14<49:31,  3.72it/s]
 97%|█████████▋| 360418/371472 [6:31:14<49:58,  3.69it/s]
 97%|█████████▋| 360419/371472 [6:31:14<50:22,  3.66it/s]
 97%|█████████▋| 360420/371472 [6:31:15<51:06,  3.60it/s]
                                                         
{'loss': 2.528, 'learning_rate': 1.267911396496369e-07, 'epoch': 15.52}

 97%|█████████▋| 360420/371472 [6:31:15<51:06,  3.60it/s]
 97%|█████████▋| 360421/371472 [6:31:15<56:51,  3.24it/s]
 97%|█████████▋| 360422/371472 [6:31:15<55:38,  3.31it/s]
 97%|█████████▋| 360423/371472 [6:31:16<59:11,  3.11it/s]
 97%|█████████▋| 360424/371472 [6:31:16<57:12,  3.22it/s]
 97%|█████████▋| 360425/371472 [6:31:16<59:16,  3.11it/s]
 97%|█████████▋| 360426/371472 [6:31:17<58:22,  3.15it/s]
 97%|█████████▋| 360427/371472 [6:31:17<55:03,  3.34it/s]
 97%|█████████▋| 360428/371472 [6:31:17<54:34,  3.37it/s]
 97%|█████████▋| 360429/371472 [6:31:18<54:16,  3.39it/s]
 97%|█████████▋| 360430/371472 [6:31:18<53:17,  3.45it/s]
 97%|█████████▋| 360431/371472 [6:31:18<53:40,  3.43it/s]
 97%|█████████▋| 360432/371472 [6:31:18<51:14,  3.59it/s]
 97%|█████████▋| 360433/371472 [6:31:19<50:14,  3.66it/s]
 97%|█████████▋| 360434/371472 [6:31:19<49:48,  3.69it/s]
 97%|█████████▋| 360435/371472 [6:31:19<48:12,  3.82it/s]
 97%|█████████▋| 360436/371472 [6:31:19<51:27,  3.57it/s]
 97%|█████████▋| 360437/371472 [6:31:20<50:40,  3.63it/s]
 97%|█████████▋| 360438/371472 [6:31:20<51:04,  3.60it/s]
 97%|█████████▋| 360439/371472 [6:31:20<50:50,  3.62it/s]
 97%|█████████▋| 360440/371472 [6:31:21<49:55,  3.68it/s]
                                                         
{'loss': 2.5705, 'learning_rate': 1.2674265767415806e-07, 'epoch': 15.52}

 97%|█████████▋| 360440/371472 [6:31:21<49:55,  3.68it/s]
 97%|█████████▋| 360441/371472 [6:31:21<50:46,  3.62it/s]
 97%|█████████▋| 360442/371472 [6:31:21<53:42,  3.42it/s]
 97%|█████████▋| 360443/371472 [6:31:21<52:39,  3.49it/s]
 97%|█████████▋| 360444/371472 [6:31:22<58:04,  3.16it/s]
 97%|█████████▋| 360445/371472 [6:31:22<54:50,  3.35it/s]
 97%|█████████▋| 360446/371472 [6:31:22<53:01,  3.47it/s]
 97%|█████████▋| 360447/371472 [6:31:23<50:44,  3.62it/s]
 97%|█████████▋| 360448/371472 [6:31:23<50:13,  3.66it/s]
 97%|█████████▋| 360449/371472 [6:31:23<50:31,  3.64it/s]
 97%|█████████▋| 360450/371472 [6:31:23<49:37,  3.70it/s]
 97%|█████████▋| 360451/371472 [6:31:24<47:57,  3.83it/s]
 97%|█████████▋| 360452/371472 [6:31:24<49:09,  3.74it/s]
 97%|█████████▋| 360453/371472 [6:31:24<55:04,  3.33it/s]
 97%|█████████▋| 360454/371472 [6:31:25<53:23,  3.44it/s]
 97%|█████████▋| 360455/371472 [6:31:25<50:49,  3.61it/s]
 97%|█████████▋| 360456/371472 [6:31:25<54:02,  3.40it/s]
 97%|█████████▋| 360457/371472 [6:31:25<53:54,  3.41it/s]
 97%|█████████▋| 360458/371472 [6:31:26<53:36,  3.42it/s]
 97%|█████████▋| 360459/371472 [6:31:26<53:53,  3.41it/s]
 97%|█████████▋| 360460/371472 [6:31:26<53:12,  3.45it/s]
                                                         
{'loss': 2.517, 'learning_rate': 1.2669417569867913e-07, 'epoch': 15.53}

 97%|█████████▋| 360460/371472 [6:31:26<53:12,  3.45it/s]
 97%|█████████▋| 360461/371472 [6:31:27<52:13,  3.51it/s]
 97%|█████████▋| 360462/371472 [6:31:27<50:51,  3.61it/s]
 97%|█████████▋| 360463/371472 [6:31:27<50:03,  3.67it/s]
 97%|█████████▋| 360464/371472 [6:31:27<50:24,  3.64it/s]
 97%|█████████▋| 360465/371472 [6:31:28<52:43,  3.48it/s]
 97%|█████████▋| 360466/371472 [6:31:28<50:15,  3.65it/s]
 97%|█████████▋| 360467/371472 [6:31:28<49:28,  3.71it/s]
 97%|█████████▋| 360468/371472 [6:31:28<49:24,  3.71it/s]
 97%|█████████▋| 360469/371472 [6:31:29<51:22,  3.57it/s]
 97%|█████████▋| 360470/371472 [6:31:29<51:33,  3.56it/s]
 97%|█████████▋| 360471/371472 [6:31:29<50:35,  3.62it/s]
 97%|█████████▋| 360472/371472 [6:31:30<51:38,  3.55it/s]
 97%|█████████▋| 360473/371472 [6:31:30<52:57,  3.46it/s]
 97%|█████████▋| 360474/371472 [6:31:30<54:41,  3.35it/s]
 97%|█████████▋| 360475/371472 [6:31:31<56:36,  3.24it/s]
 97%|█████████▋| 360476/371472 [6:31:31<53:58,  3.40it/s]
 97%|█████████▋| 360477/371472 [6:31:31<52:34,  3.49it/s]
 97%|█████████▋| 360478/371472 [6:31:31<57:49,  3.17it/s]
 97%|█████████▋| 360479/371472 [6:31:32<55:12,  3.32it/s]
 97%|█████████▋| 360480/371472 [6:31:32<52:28,  3.49it/s]
                                                         
{'loss': 2.608, 'learning_rate': 1.2664569372320028e-07, 'epoch': 15.53}

 97%|█████████▋| 360480/371472 [6:31:32<52:28,  3.49it/s]
 97%|█████████▋| 360481/371472 [6:31:32<52:20,  3.50it/s]
 97%|█████████▋| 360482/371472 [6:31:33<54:38,  3.35it/s]
 97%|█████████▋| 360483/371472 [6:31:33<53:34,  3.42it/s]
 97%|█████████▋| 360484/371472 [6:31:33<51:24,  3.56it/s]
 97%|█████████▋| 360485/371472 [6:31:33<52:44,  3.47it/s]
 97%|█████████▋| 360486/371472 [6:31:34<50:46,  3.61it/s]
 97%|█████████▋| 360487/371472 [6:31:34<51:22,  3.56it/s]
 97%|█████████▋| 360488/371472 [6:31:34<50:35,  3.62it/s]
 97%|█████████▋| 360489/371472 [6:31:35<50:56,  3.59it/s]
 97%|█████████▋| 360490/371472 [6:31:35<49:44,  3.68it/s]
 97%|█████████▋| 360491/371472 [6:31:35<49:20,  3.71it/s]
 97%|█████████▋| 360492/371472 [6:31:35<49:58,  3.66it/s]
 97%|█████████▋| 360493/371472 [6:31:36<51:01,  3.59it/s]
 97%|█████████▋| 360494/371472 [6:31:36<50:17,  3.64it/s]
 97%|█████████▋| 360495/371472 [6:31:36<54:15,  3.37it/s]
 97%|█████████▋| 360496/371472 [6:31:36<52:21,  3.49it/s]
 97%|█████████▋| 360497/371472 [6:31:37<50:35,  3.62it/s]
 97%|█████████▋| 360498/371472 [6:31:37<53:10,  3.44it/s]
 97%|█████████▋| 360499/371472 [6:31:37<51:16,  3.57it/s]
 97%|█████████▋| 360500/371472 [6:31:38<51:42,  3.54it/s]
                                                         
{'loss': 2.499, 'learning_rate': 1.2659721174772133e-07, 'epoch': 15.53}

 97%|█████████▋| 360500/371472 [6:31:38<51:42,  3.54it/s]
 97%|█████████▋| 360501/371472 [6:31:38<52:05,  3.51it/s]
 97%|█████████▋| 360502/371472 [6:31:38<51:30,  3.55it/s]
 97%|█████████▋| 360503/371472 [6:31:38<48:58,  3.73it/s]
 97%|█████████▋| 360504/371472 [6:31:39<52:23,  3.49it/s]
 97%|█████████▋| 360505/371472 [6:31:39<50:06,  3.65it/s]
 97%|█████████▋| 360506/371472 [6:31:39<50:53,  3.59it/s]
 97%|█████████▋| 360507/371472 [6:31:40<53:20,  3.43it/s]
 97%|█████████▋| 360508/371472 [6:31:40<50:43,  3.60it/s]
 97%|█████████▋| 360509/371472 [6:31:40<57:05,  3.20it/s]
 97%|█████████▋| 360510/371472 [6:31:41<57:12,  3.19it/s]
 97%|█████████▋| 360511/371472 [6:31:41<54:04,  3.38it/s]
 97%|█████████▋| 360512/371472 [6:31:41<56:47,  3.22it/s]
 97%|█████████▋| 360513/371472 [6:31:41<53:57,  3.38it/s]
 97%|█████████▋| 360514/371472 [6:31:42<53:25,  3.42it/s]
 97%|█████████▋| 360515/371472 [6:31:42<56:55,  3.21it/s]
 97%|█████████▋| 360516/371472 [6:31:42<57:11,  3.19it/s]
 97%|█████████▋| 360517/371472 [6:31:43<53:19,  3.42it/s]
 97%|█████████▋| 360518/371472 [6:31:43<54:34,  3.35it/s]
 97%|█████████▋| 360519/371472 [6:31:43<57:28,  3.18it/s]
 97%|█████████▋| 360520/371472 [6:31:44<53:51,  3.39it/s]
                                                         
{'loss': 2.6176, 'learning_rate': 1.2654872977224248e-07, 'epoch': 15.53}

 97%|█████████▋| 360520/371472 [6:31:44<53:51,  3.39it/s]
 97%|█████████▋| 360521/371472 [6:31:44<51:31,  3.54it/s]
 97%|█████████▋| 360522/371472 [6:31:44<50:26,  3.62it/s]
 97%|█████████▋| 360523/371472 [6:31:44<50:26,  3.62it/s]
 97%|█████████▋| 360524/371472 [6:31:45<54:42,  3.34it/s]
 97%|█████████▋| 360525/371472 [6:31:45<51:13,  3.56it/s]
 97%|█████████▋| 360526/371472 [6:31:45<50:19,  3.62it/s]
 97%|█████████▋| 360527/371472 [6:31:45<50:40,  3.60it/s]
 97%|█████████▋| 360528/371472 [6:31:46<53:27,  3.41it/s]
 97%|█████████▋| 360529/371472 [6:31:46<56:13,  3.24it/s]
 97%|█████████▋| 360530/371472 [6:31:46<55:54,  3.26it/s]
 97%|█████████▋| 360531/371472 [6:31:47<53:07,  3.43it/s]
 97%|█████████▋| 360532/371472 [6:31:47<50:44,  3.59it/s]
 97%|█████████▋| 360533/371472 [6:31:47<48:16,  3.78it/s]
 97%|█████████▋| 360534/371472 [6:31:47<47:58,  3.80it/s]
 97%|█████████▋| 360535/371472 [6:31:48<54:23,  3.35it/s]
 97%|█████████▋| 360536/371472 [6:31:48<55:41,  3.27it/s]
 97%|█████████▋| 360537/371472 [6:31:48<54:38,  3.34it/s]
 97%|█████████▋| 360538/371472 [6:31:49<52:08,  3.49it/s]
 97%|█████████▋| 360539/371472 [6:31:49<51:19,  3.55it/s]
 97%|█████████▋| 360540/371472 [6:31:49<52:33,  3.47it/s]
                                                         
{'loss': 2.4552, 'learning_rate': 1.2650024779676355e-07, 'epoch': 15.53}

 97%|█████████▋| 360540/371472 [6:31:49<52:33,  3.47it/s]
 97%|█████████▋| 360541/371472 [6:31:50<51:48,  3.52it/s]
 97%|█████████▋| 360542/371472 [6:31:50<50:50,  3.58it/s]
 97%|█████████▋| 360543/371472 [6:31:50<49:28,  3.68it/s]
 97%|█████████▋| 360544/371472 [6:31:50<50:46,  3.59it/s]
 97%|█████████▋| 360545/371472 [6:31:51<48:39,  3.74it/s]
 97%|█████████▋| 360546/371472 [6:31:51<51:28,  3.54it/s]
 97%|█████████▋| 360547/371472 [6:31:51<49:13,  3.70it/s]
 97%|█████████▋| 360548/371472 [6:31:51<52:05,  3.49it/s]
 97%|█████████▋| 360549/371472 [6:31:52<49:20,  3.69it/s]
 97%|█████████▋| 360550/371472 [6:31:52<50:05,  3.63it/s]
 97%|█████████▋| 360551/371472 [6:31:52<49:57,  3.64it/s]
 97%|█████████▋| 360552/371472 [6:31:53<49:36,  3.67it/s]
 97%|█████████▋| 360553/371472 [6:31:53<51:29,  3.53it/s]
 97%|█████████▋| 360554/371472 [6:31:53<55:05,  3.30it/s]
 97%|█████████▋| 360555/371472 [6:31:53<52:40,  3.45it/s]
 97%|█████████▋| 360556/371472 [6:31:54<54:20,  3.35it/s]
 97%|█████████▋| 360557/371472 [6:31:54<54:47,  3.32it/s]
 97%|█████████▋| 360558/371472 [6:31:54<54:48,  3.32it/s]
 97%|█████████▋| 360559/371472 [6:31:55<53:46,  3.38it/s]
 97%|█████████▋| 360560/371472 [6:31:55<54:46,  3.32it/s]
                                                         
{'loss': 2.6149, 'learning_rate': 1.264517658212847e-07, 'epoch': 15.53}

 97%|█████████▋| 360560/371472 [6:31:55<54:46,  3.32it/s]
 97%|█████████▋| 360561/371472 [6:31:55<57:24,  3.17it/s]
 97%|█████████▋| 360562/371472 [6:31:56<58:01,  3.13it/s]
 97%|█████████▋| 360563/371472 [6:31:56<56:55,  3.19it/s]
 97%|█████████▋| 360564/371472 [6:31:56<55:41,  3.26it/s]
 97%|█████████▋| 360565/371472 [6:31:57<53:58,  3.37it/s]
 97%|█████████▋| 360566/371472 [6:31:57<52:57,  3.43it/s]
 97%|█████████▋| 360567/371472 [6:31:57<52:49,  3.44it/s]
 97%|█████████▋| 360568/371472 [6:31:57<52:39,  3.45it/s]
 97%|█████████▋| 360569/371472 [6:31:58<54:44,  3.32it/s]
 97%|█████████▋| 360570/371472 [6:31:58<55:13,  3.29it/s]
 97%|█████████▋| 360571/371472 [6:31:58<56:34,  3.21it/s]
 97%|█████████▋| 360572/371472 [6:31:59<56:00,  3.24it/s]
 97%|█████████▋| 360573/371472 [6:31:59<54:44,  3.32it/s]
 97%|█████████▋| 360574/371472 [6:31:59<51:31,  3.53it/s]
 97%|█████████▋| 360575/371472 [6:31:59<52:25,  3.46it/s]
 97%|█████████▋| 360576/371472 [6:32:00<51:24,  3.53it/s]
 97%|█████████▋| 360577/371472 [6:32:00<50:38,  3.59it/s]
 97%|█████████▋| 360578/371472 [6:32:00<49:18,  3.68it/s]
 97%|█████████▋| 360579/371472 [6:32:01<47:56,  3.79it/s]
 97%|█████████▋| 360580/371472 [6:32:01<46:39,  3.89it/s]
                                                         
{'loss': 2.5328, 'learning_rate': 1.2640328384580577e-07, 'epoch': 15.53}

 97%|█████████▋| 360580/371472 [6:32:01<46:39,  3.89it/s]
 97%|█████████▋| 360581/371472 [6:32:01<46:58,  3.86it/s]
 97%|█████████▋| 360582/371472 [6:32:01<47:22,  3.83it/s]
 97%|█████████▋| 360583/371472 [6:32:02<48:06,  3.77it/s]
 97%|█████████▋| 360584/371472 [6:32:02<55:40,  3.26it/s]
 97%|█████████▋| 360585/371472 [6:32:02<53:20,  3.40it/s]
 97%|█████████▋| 360586/371472 [6:32:03<53:03,  3.42it/s]
 97%|█████████▋| 360587/371472 [6:32:03<51:31,  3.52it/s]
 97%|█████████▋| 360588/371472 [6:32:03<52:05,  3.48it/s]
 97%|█████████▋| 360589/371472 [6:32:03<51:34,  3.52it/s]
 97%|█████████▋| 360590/371472 [6:32:04<53:01,  3.42it/s]
 97%|█████████▋| 360591/371472 [6:32:04<50:35,  3.58it/s]
 97%|█████████▋| 360592/371472 [6:32:04<48:43,  3.72it/s]
 97%|█████████▋| 360593/371472 [6:32:04<48:44,  3.72it/s]
 97%|█████████▋| 360594/371472 [6:32:05<48:58,  3.70it/s]
 97%|█████████▋| 360595/371472 [6:32:05<50:35,  3.58it/s]
 97%|█████████▋| 360596/371472 [6:32:05<49:11,  3.68it/s]
 97%|█████████▋| 360597/371472 [6:32:06<49:19,  3.67it/s]
 97%|█████████▋| 360598/371472 [6:32:06<49:43,  3.65it/s]
 97%|█████████▋| 360599/371472 [6:32:06<51:27,  3.52it/s]
 97%|█████████▋| 360600/371472 [6:32:06<49:23,  3.67it/s]
                                                         
{'loss': 2.5616, 'learning_rate': 1.2635480187032682e-07, 'epoch': 15.53}

 97%|█████████▋| 360600/371472 [6:32:06<49:23,  3.67it/s]
 97%|█████████▋| 360601/371472 [6:32:07<50:26,  3.59it/s]
 97%|█████████▋| 360602/371472 [6:32:07<50:39,  3.58it/s]
 97%|█████████▋| 360603/371472 [6:32:07<53:49,  3.37it/s]
 97%|█████████▋| 360604/371472 [6:32:08<55:01,  3.29it/s]
 97%|█████████▋| 360605/371472 [6:32:08<53:38,  3.38it/s]
 97%|█████████▋| 360606/371472 [6:32:08<52:13,  3.47it/s]
 97%|█████████▋| 360607/371472 [6:32:08<53:50,  3.36it/s]
 97%|█████████▋| 360608/371472 [6:32:09<52:17,  3.46it/s]
 97%|█████████▋| 360609/371472 [6:32:09<52:04,  3.48it/s]
 97%|█████████▋| 360610/371472 [6:32:09<50:41,  3.57it/s]
 97%|█████████▋| 360611/371472 [6:32:10<49:34,  3.65it/s]
 97%|█████████▋| 360612/371472 [6:32:10<49:50,  3.63it/s]
 97%|█████████▋| 360613/371472 [6:32:10<51:23,  3.52it/s]
 97%|█████████▋| 360614/371472 [6:32:10<52:19,  3.46it/s]
 97%|█████████▋| 360615/371472 [6:32:11<52:13,  3.46it/s]
 97%|█████████▋| 360616/371472 [6:32:11<50:59,  3.55it/s]
 97%|█████████▋| 360617/371472 [6:32:11<51:29,  3.51it/s]
 97%|█████████▋| 360618/371472 [6:32:12<51:35,  3.51it/s]
 97%|█████████▋| 360619/371472 [6:32:12<51:21,  3.52it/s]
 97%|█████████▋| 360620/371472 [6:32:12<50:36,  3.57it/s]
                                                         
{'loss': 2.5625, 'learning_rate': 1.2630631989484797e-07, 'epoch': 15.53}

 97%|█████████▋| 360620/371472 [6:32:12<50:36,  3.57it/s]
 97%|█████████▋| 360621/371472 [6:32:12<53:44,  3.37it/s]
 97%|█████████▋| 360622/371472 [6:32:13<52:06,  3.47it/s]
 97%|█████████▋| 360623/371472 [6:32:13<54:36,  3.31it/s]
 97%|█████████▋| 360624/371472 [6:32:13<52:36,  3.44it/s]
 97%|█████████▋| 360625/371472 [6:32:14<54:24,  3.32it/s]
 97%|█████████▋| 360626/371472 [6:32:14<53:23,  3.39it/s]
 97%|█████████▋| 360627/371472 [6:32:14<50:22,  3.59it/s]
 97%|█████████▋| 360628/371472 [6:32:14<49:59,  3.61it/s]
 97%|█████████▋| 360629/371472 [6:32:15<52:09,  3.46it/s]
 97%|█████████▋| 360630/371472 [6:32:15<51:46,  3.49it/s]
 97%|█████████▋| 360631/371472 [6:32:15<49:33,  3.65it/s]
 97%|█████████▋| 360632/371472 [6:32:16<48:21,  3.74it/s]
 97%|█████████▋| 360633/371472 [6:32:16<49:22,  3.66it/s]
 97%|█████████▋| 360634/371472 [6:32:16<52:05,  3.47it/s]
 97%|█████████▋| 360635/371472 [6:32:16<52:37,  3.43it/s]
 97%|█████████▋| 360636/371472 [6:32:17<51:39,  3.50it/s]
 97%|█████████▋| 360637/371472 [6:32:17<53:08,  3.40it/s]
 97%|█████████▋| 360638/371472 [6:32:17<51:59,  3.47it/s]
 97%|█████████▋| 360639/371472 [6:32:18<50:20,  3.59it/s]
 97%|█████████▋| 360640/371472 [6:32:18<49:20,  3.66it/s]
                                                         
{'loss': 2.5174, 'learning_rate': 1.2625783791936904e-07, 'epoch': 15.53}

 97%|█████████▋| 360640/371472 [6:32:18<49:20,  3.66it/s]
 97%|█████████▋| 360641/371472 [6:32:18<49:05,  3.68it/s]
 97%|█████████▋| 360642/371472 [6:32:18<51:05,  3.53it/s]
 97%|█████████▋| 360643/371472 [6:32:19<49:00,  3.68it/s]
 97%|█████████▋| 360644/371472 [6:32:19<50:20,  3.58it/s]
 97%|█████████▋| 360645/371472 [6:32:19<50:27,  3.58it/s]
 97%|█████████▋| 360646/371472 [6:32:19<50:14,  3.59it/s]
 97%|█████████▋| 360647/371472 [6:32:20<54:16,  3.32it/s]
 97%|█████████▋| 360648/371472 [6:32:20<58:55,  3.06it/s]
 97%|█████████▋| 360649/371472 [6:32:21<57:26,  3.14it/s]
 97%|█████████▋| 360650/371472 [6:32:21<55:15,  3.26it/s]
 97%|█████████▋| 360651/371472 [6:32:21<55:19,  3.26it/s]
 97%|█████████▋| 360652/371472 [6:32:21<53:51,  3.35it/s]
 97%|█████████▋| 360653/371472 [6:32:22<51:03,  3.53it/s]
 97%|█████████▋| 360654/371472 [6:32:22<52:05,  3.46it/s]
 97%|█████████▋| 360655/371472 [6:32:22<50:24,  3.58it/s]
 97%|█████████▋| 360656/371472 [6:32:23<52:48,  3.41it/s]
 97%|█████████▋| 360657/371472 [6:32:23<52:28,  3.43it/s]
 97%|█████████▋| 360658/371472 [6:32:23<54:50,  3.29it/s]
 97%|█████████▋| 360659/371472 [6:32:23<52:52,  3.41it/s]
 97%|█████████▋| 360660/371472 [6:32:24<50:03,  3.60it/s]
                                                         
{'loss': 2.4765, 'learning_rate': 1.2620935594389016e-07, 'epoch': 15.53}

 97%|█████████▋| 360660/371472 [6:32:24<50:03,  3.60it/s]
 97%|█████████▋| 360661/371472 [6:32:24<49:36,  3.63it/s]
 97%|█████████▋| 360662/371472 [6:32:24<48:51,  3.69it/s]
 97%|█████████▋| 360663/371472 [6:32:24<51:05,  3.53it/s]
 97%|█████████▋| 360664/371472 [6:32:25<50:23,  3.57it/s]
 97%|█████████▋| 360665/371472 [6:32:25<48:59,  3.68it/s]
 97%|█████████▋| 360666/371472 [6:32:25<47:01,  3.83it/s]
 97%|█████████▋| 360667/371472 [6:32:26<47:17,  3.81it/s]
 97%|█████████▋| 360668/371472 [6:32:26<47:06,  3.82it/s]
 97%|█████████▋| 360669/371472 [6:32:26<47:49,  3.76it/s]
 97%|█████████▋| 360670/371472 [6:32:26<48:38,  3.70it/s]
 97%|█████████▋| 360671/371472 [6:32:27<50:01,  3.60it/s]
 97%|█████████▋| 360672/371472 [6:32:27<50:40,  3.55it/s]
 97%|█████████▋| 360673/371472 [6:32:27<51:42,  3.48it/s]
 97%|█████████▋| 360674/371472 [6:32:28<55:59,  3.21it/s]
 97%|█████████▋| 360675/371472 [6:32:28<53:19,  3.37it/s]
 97%|█████████▋| 360676/371472 [6:32:28<53:10,  3.38it/s]
 97%|█████████▋| 360677/371472 [6:32:28<52:13,  3.45it/s]
 97%|█████████▋| 360678/371472 [6:32:29<50:04,  3.59it/s]
 97%|█████████▋| 360679/371472 [6:32:29<48:45,  3.69it/s]
 97%|█████████▋| 360680/371472 [6:32:29<48:29,  3.71it/s]
                                                         
{'loss': 2.5934, 'learning_rate': 1.2616087396841126e-07, 'epoch': 15.54}

 97%|█████████▋| 360680/371472 [6:32:29<48:29,  3.71it/s]
 97%|█████████▋| 360681/371472 [6:32:29<47:45,  3.77it/s]
 97%|█████████▋| 360682/371472 [6:32:30<47:16,  3.80it/s]
 97%|█████████▋| 360683/371472 [6:32:30<47:35,  3.78it/s]
 97%|█████████▋| 360684/371472 [6:32:30<49:52,  3.60it/s]
 97%|█████████▋| 360685/371472 [6:32:31<48:16,  3.72it/s]
 97%|█████████▋| 360686/371472 [6:32:31<53:08,  3.38it/s]
 97%|█████████▋| 360687/371472 [6:32:31<52:42,  3.41it/s]
 97%|█████████▋| 360688/371472 [6:32:31<53:05,  3.39it/s]
 97%|█████████▋| 360689/371472 [6:32:32<54:33,  3.29it/s]
 97%|█████████▋| 360690/371472 [6:32:32<51:42,  3.48it/s]
 97%|█████████▋| 360691/371472 [6:32:32<50:14,  3.58it/s]
 97%|█████████▋| 360692/371472 [6:32:33<51:42,  3.47it/s]
 97%|█████████▋| 360693/371472 [6:32:33<52:15,  3.44it/s]
 97%|█████████▋| 360694/371472 [6:32:33<49:19,  3.64it/s]
 97%|█████████▋| 360695/371472 [6:32:33<51:33,  3.48it/s]
 97%|█████████▋| 360696/371472 [6:32:34<50:55,  3.53it/s]
 97%|█████████▋| 360697/371472 [6:32:34<50:43,  3.54it/s]
 97%|█████████▋| 360698/371472 [6:32:34<53:28,  3.36it/s]
 97%|█████████▋| 360699/371472 [6:32:35<51:40,  3.47it/s]
 97%|█████████▋| 360700/371472 [6:32:35<49:45,  3.61it/s]
                                                         
{'loss': 2.5004, 'learning_rate': 1.2611239199293241e-07, 'epoch': 15.54}

 97%|█████████▋| 360700/371472 [6:32:35<49:45,  3.61it/s]
 97%|█████████▋| 360701/371472 [6:32:35<49:33,  3.62it/s]
 97%|█████████▋| 360702/371472 [6:32:35<48:59,  3.66it/s]
 97%|█████████▋| 360703/371472 [6:32:36<48:31,  3.70it/s]
 97%|█████████▋| 360704/371472 [6:32:36<52:14,  3.44it/s]
 97%|█████████▋| 360705/371472 [6:32:36<51:58,  3.45it/s]
 97%|█████████▋| 360706/371472 [6:32:37<59:04,  3.04it/s]
 97%|█████████▋| 360707/371472 [6:32:37<1:10:50,  2.53it/s]
 97%|█████████▋| 360708/371472 [6:32:38<1:05:34,  2.74it/s]
 97%|█████████▋| 360709/371472 [6:32:38<1:02:57,  2.85it/s]
 97%|█████████▋| 360710/371472 [6:32:38<1:03:09,  2.84it/s]
 97%|█████████▋| 360711/371472 [6:32:39<59:50,  3.00it/s]  
 97%|█████████▋| 360712/371472 [6:32:39<57:24,  3.12it/s]
 97%|█████████▋| 360713/371472 [6:32:39<57:19,  3.13it/s]
 97%|█████████▋| 360714/371472 [6:32:39<56:13,  3.19it/s]
 97%|█████████▋| 360715/371472 [6:32:40<52:56,  3.39it/s]
 97%|█████████▋| 360716/371472 [6:32:40<53:26,  3.35it/s]
 97%|█████████▋| 360717/371472 [6:32:40<52:00,  3.45it/s]
 97%|█████████▋| 360718/371472 [6:32:41<52:38,  3.40it/s]
 97%|█████████▋| 360719/371472 [6:32:41<53:06,  3.37it/s]
 97%|█████████▋| 360720/371472 [6:32:41<51:45,  3.46it/s]
                                                         
{'loss': 2.6951, 'learning_rate': 1.2606391001745346e-07, 'epoch': 15.54}

 97%|█████████▋| 360720/371472 [6:32:41<51:45,  3.46it/s]
 97%|█████████▋| 360721/371472 [6:32:41<50:36,  3.54it/s]
 97%|█████████▋| 360722/371472 [6:32:42<49:44,  3.60it/s]
 97%|█████████▋| 360723/371472 [6:32:42<49:21,  3.63it/s]
 97%|█████████▋| 360724/371472 [6:32:42<47:40,  3.76it/s]
 97%|█████████▋| 360725/371472 [6:32:42<47:03,  3.81it/s]
 97%|█████████▋| 360726/371472 [6:32:43<46:46,  3.83it/s]
 97%|█████████▋| 360727/371472 [6:32:43<47:31,  3.77it/s]
 97%|█████████▋| 360728/371472 [6:32:43<46:07,  3.88it/s]
 97%|█████████▋| 360729/371472 [6:32:43<47:56,  3.73it/s]
 97%|█████████▋| 360730/371472 [6:32:44<48:57,  3.66it/s]
 97%|█████████▋| 360731/371472 [6:32:44<51:28,  3.48it/s]
 97%|█████████▋| 360732/371472 [6:32:44<51:36,  3.47it/s]
 97%|█████████▋| 360733/371472 [6:32:45<49:41,  3.60it/s]
 97%|█████████▋| 360734/371472 [6:32:45<48:55,  3.66it/s]
 97%|█████████▋| 360735/371472 [6:32:45<47:07,  3.80it/s]
 97%|█████████▋| 360736/371472 [6:32:45<46:56,  3.81it/s]
 97%|█████████▋| 360737/371472 [6:32:46<51:08,  3.50it/s]
 97%|█████████▋| 360738/371472 [6:32:46<51:29,  3.47it/s]
 97%|█████████▋| 360739/371472 [6:32:46<51:21,  3.48it/s]
 97%|█████████▋| 360740/371472 [6:32:47<50:24,  3.55it/s]
                                                         
{'loss': 2.3781, 'learning_rate': 1.2601542804197464e-07, 'epoch': 15.54}

 97%|█████████▋| 360740/371472 [6:32:47<50:24,  3.55it/s]
 97%|█████████▋| 360741/371472 [6:32:47<50:12,  3.56it/s]
 97%|█████████▋| 360742/371472 [6:32:47<52:55,  3.38it/s]
 97%|█████████▋| 360743/371472 [6:32:47<52:26,  3.41it/s]
 97%|█████████▋| 360744/371472 [6:32:48<51:37,  3.46it/s]
 97%|█████████▋| 360745/371472 [6:32:48<51:07,  3.50it/s]
 97%|█████████▋| 360746/371472 [6:32:48<51:18,  3.48it/s]
 97%|█████████▋| 360747/371472 [6:32:49<57:36,  3.10it/s]
 97%|█████████▋| 360748/371472 [6:32:49<1:02:36,  2.85it/s]
 97%|█████████▋| 360749/371472 [6:32:49<58:32,  3.05it/s]  
 97%|█████████▋| 360750/371472 [6:32:50<54:38,  3.27it/s]
 97%|█████████▋| 360751/371472 [6:32:50<54:03,  3.30it/s]
 97%|█████████▋| 360752/371472 [6:32:50<51:05,  3.50it/s]
 97%|█████████▋| 360753/371472 [6:32:50<48:56,  3.65it/s]
 97%|█████████▋| 360754/371472 [6:32:51<47:54,  3.73it/s]
 97%|█████████▋| 360755/371472 [6:32:51<47:01,  3.80it/s]
 97%|█████████▋| 360756/371472 [6:32:51<46:26,  3.85it/s]
 97%|█████████▋| 360757/371472 [6:32:51<46:20,  3.85it/s]
 97%|█████████▋| 360758/371472 [6:32:52<48:13,  3.70it/s]
 97%|█████████▋| 360759/371472 [6:32:52<47:57,  3.72it/s]
 97%|█████████▋| 360760/371472 [6:32:52<48:02,  3.72it/s]
                                                         
{'loss': 2.4353, 'learning_rate': 1.2596694606649568e-07, 'epoch': 15.54}

 97%|█████████▋| 360760/371472 [6:32:52<48:02,  3.72it/s]
 97%|█████████▋| 360761/371472 [6:32:53<47:18,  3.77it/s]
 97%|█████████▋| 360762/371472 [6:32:53<49:18,  3.62it/s]
 97%|█████████▋| 360763/371472 [6:32:53<50:18,  3.55it/s]
 97%|█████████▋| 360764/371472 [6:32:53<49:50,  3.58it/s]
 97%|█████████▋| 360765/371472 [6:32:54<48:43,  3.66it/s]
 97%|█████████▋| 360766/371472 [6:32:54<48:36,  3.67it/s]
 97%|█████████▋| 360767/371472 [6:32:54<47:20,  3.77it/s]
 97%|█████████▋| 360768/371472 [6:32:55<49:29,  3.61it/s]
 97%|█████████▋| 360769/371472 [6:32:55<48:41,  3.66it/s]
 97%|█████████▋| 360770/371472 [6:32:55<47:47,  3.73it/s]
 97%|█████████▋| 360771/371472 [6:32:55<47:17,  3.77it/s]
 97%|█████████▋| 360772/371472 [6:32:56<51:04,  3.49it/s]
 97%|█████████▋| 360773/371472 [6:32:56<49:40,  3.59it/s]
 97%|█████████▋| 360774/371472 [6:32:56<58:54,  3.03it/s]
 97%|█████████▋| 360775/371472 [6:32:57<58:26,  3.05it/s]
 97%|█████████▋| 360776/371472 [6:32:57<55:20,  3.22it/s]
 97%|█████████▋| 360777/371472 [6:32:57<56:10,  3.17it/s]
 97%|█████████▋| 360778/371472 [6:32:58<54:40,  3.26it/s]
 97%|█████████▋| 360779/371472 [6:32:58<53:10,  3.35it/s]
 97%|█████████▋| 360780/371472 [6:32:58<52:44,  3.38it/s]
                                                         
{'loss': 2.5696, 'learning_rate': 1.2591846409101683e-07, 'epoch': 15.54}

 97%|█████████▋| 360780/371472 [6:32:58<52:44,  3.38it/s]
 97%|█████████▋| 360781/371472 [6:32:58<51:40,  3.45it/s]
 97%|█████████▋| 360782/371472 [6:32:59<50:27,  3.53it/s]
 97%|█████████▋| 360783/371472 [6:32:59<53:16,  3.34it/s]
 97%|█████████▋| 360784/371472 [6:32:59<52:37,  3.39it/s]
 97%|█████████▋| 360785/371472 [6:33:00<51:46,  3.44it/s]
 97%|█████████▋| 360786/371472 [6:33:00<50:00,  3.56it/s]
 97%|█████████▋| 360787/371472 [6:33:00<49:02,  3.63it/s]
 97%|█████████▋| 360788/371472 [6:33:00<51:53,  3.43it/s]
 97%|█████████▋| 360789/371472 [6:33:01<51:43,  3.44it/s]
 97%|█████████▋| 360790/371472 [6:33:01<53:20,  3.34it/s]
 97%|█████████▋| 360791/371472 [6:33:01<51:14,  3.47it/s]
 97%|█████████▋| 360792/371472 [6:33:02<52:44,  3.38it/s]
 97%|█████████▋| 360793/371472 [6:33:02<52:29,  3.39it/s]
 97%|█████████▋| 360794/371472 [6:33:02<52:57,  3.36it/s]
 97%|█████████▋| 360795/371472 [6:33:02<52:20,  3.40it/s]
 97%|█████████▋| 360796/371472 [6:33:03<52:12,  3.41it/s]
 97%|█████████▋| 360797/371472 [6:33:03<50:06,  3.55it/s]
 97%|█████████▋| 360798/371472 [6:33:03<50:12,  3.54it/s]
 97%|█████████▋| 360799/371472 [6:33:04<49:02,  3.63it/s]
 97%|█████████▋| 360800/371472 [6:33:04<48:56,  3.63it/s]
                                                         
{'loss': 2.4297, 'learning_rate': 1.258699821155379e-07, 'epoch': 15.54}

 97%|█████████▋| 360800/371472 [6:33:04<48:56,  3.63it/s]
 97%|█████████▋| 360801/371472 [6:33:04<47:11,  3.77it/s]
 97%|█████████▋| 360802/371472 [6:33:04<49:36,  3.58it/s]
 97%|█████████▋| 360803/371472 [6:33:05<52:39,  3.38it/s]
 97%|█████████▋| 360804/371472 [6:33:05<51:04,  3.48it/s]
 97%|█████████▋| 360805/371472 [6:33:05<49:22,  3.60it/s]
 97%|█████████▋| 360806/371472 [6:33:06<47:29,  3.74it/s]
 97%|█████████▋| 360807/371472 [6:33:06<55:36,  3.20it/s]
 97%|█████████▋| 360808/371472 [6:33:06<53:01,  3.35it/s]
 97%|█████████▋| 360809/371472 [6:33:06<50:45,  3.50it/s]
 97%|█████████▋| 360810/371472 [6:33:07<49:20,  3.60it/s]
 97%|█████████▋| 360811/371472 [6:33:07<48:28,  3.67it/s]
 97%|█████████▋| 360812/371472 [6:33:07<48:28,  3.66it/s]
 97%|█████████▋| 360813/371472 [6:33:08<48:08,  3.69it/s]
 97%|█████████▋| 360814/371472 [6:33:08<48:00,  3.70it/s]
 97%|█████████▋| 360815/371472 [6:33:08<51:22,  3.46it/s]
 97%|█████████▋| 360816/371472 [6:33:08<49:56,  3.56it/s]
 97%|█████████▋| 360817/371472 [6:33:09<48:13,  3.68it/s]
 97%|█████████▋| 360818/371472 [6:33:09<49:09,  3.61it/s]
 97%|█████████▋| 360819/371472 [6:33:09<48:49,  3.64it/s]
 97%|█████████▋| 360820/371472 [6:33:09<49:37,  3.58it/s]
                                                         
{'loss': 2.5256, 'learning_rate': 1.2582150014005905e-07, 'epoch': 15.54}

 97%|█████████▋| 360820/371472 [6:33:09<49:37,  3.58it/s]
 97%|█████████▋| 360821/371472 [6:33:10<49:30,  3.59it/s]
 97%|█████████▋| 360822/371472 [6:33:10<49:16,  3.60it/s]
 97%|█████████▋| 360823/371472 [6:33:10<47:44,  3.72it/s]
 97%|█████████▋| 360824/371472 [6:33:11<49:09,  3.61it/s]
 97%|█████████▋| 360825/371472 [6:33:11<49:25,  3.59it/s]
 97%|█████████▋| 360826/371472 [6:33:11<49:27,  3.59it/s]
 97%|█████████▋| 360827/371472 [6:33:11<49:12,  3.61it/s]
 97%|█████████▋| 360828/371472 [6:33:12<48:54,  3.63it/s]
 97%|█████████▋| 360829/371472 [6:33:12<48:22,  3.67it/s]
 97%|█████████▋| 360830/371472 [6:33:12<46:54,  3.78it/s]
 97%|█████████▋| 360831/371472 [6:33:13<51:26,  3.45it/s]
 97%|█████████▋| 360832/371472 [6:33:13<52:38,  3.37it/s]
 97%|█████████▋| 360833/371472 [6:33:13<50:13,  3.53it/s]
 97%|█████████▋| 360834/371472 [6:33:13<51:20,  3.45it/s]
 97%|█████████▋| 360835/371472 [6:33:14<50:59,  3.48it/s]
 97%|█████████▋| 360836/371472 [6:33:14<56:45,  3.12it/s]
 97%|█████████▋| 360837/371472 [6:33:14<57:27,  3.08it/s]
 97%|█████████▋| 360838/371472 [6:33:15<58:13,  3.04it/s]
 97%|█████████▋| 360839/371472 [6:33:15<53:30,  3.31it/s]
 97%|█████████▋| 360840/371472 [6:33:15<50:59,  3.47it/s]
                                                         
{'loss': 2.4734, 'learning_rate': 1.2577301816458013e-07, 'epoch': 15.54}

 97%|█████████▋| 360840/371472 [6:33:15<50:59,  3.47it/s]
 97%|█████████▋| 360841/371472 [6:33:16<51:54,  3.41it/s]
 97%|█████████▋| 360842/371472 [6:33:16<50:30,  3.51it/s]
 97%|█████████▋| 360843/371472 [6:33:16<49:54,  3.55it/s]
 97%|█████████▋| 360844/371472 [6:33:16<49:23,  3.59it/s]
 97%|█████████▋| 360845/371472 [6:33:17<52:37,  3.37it/s]
 97%|█████████▋| 360846/371472 [6:33:17<50:24,  3.51it/s]
 97%|█████████▋| 360847/371472 [6:33:17<49:43,  3.56it/s]
 97%|█████████▋| 360848/371472 [6:33:18<49:52,  3.55it/s]
 97%|█████████▋| 360849/371472 [6:33:18<49:10,  3.60it/s]
 97%|█████████▋| 360850/371472 [6:33:18<48:53,  3.62it/s]
 97%|█████████▋| 360851/371472 [6:33:18<52:12,  3.39it/s]
 97%|█████████▋| 360852/371472 [6:33:19<52:04,  3.40it/s]
 97%|█████████▋| 360853/371472 [6:33:19<51:20,  3.45it/s]
 97%|█████████▋| 360854/371472 [6:33:19<52:54,  3.34it/s]
 97%|█████████▋| 360855/371472 [6:33:20<51:50,  3.41it/s]
 97%|█████████▋| 360856/371472 [6:33:20<51:23,  3.44it/s]
 97%|█████████▋| 360857/371472 [6:33:20<52:21,  3.38it/s]
 97%|█████████▋| 360858/371472 [6:33:20<53:14,  3.32it/s]
 97%|█████████▋| 360859/371472 [6:33:21<51:10,  3.46it/s]
 97%|█████████▋| 360860/371472 [6:33:21<51:03,  3.46it/s]
                                                         
{'loss': 2.7959, 'learning_rate': 1.2572453618910128e-07, 'epoch': 15.54}

 97%|█████████▋| 360860/371472 [6:33:21<51:03,  3.46it/s]
 97%|█████████▋| 360861/371472 [6:33:21<53:06,  3.33it/s]
 97%|█████████▋| 360862/371472 [6:33:22<52:54,  3.34it/s]
 97%|█████████▋| 360863/371472 [6:33:22<51:50,  3.41it/s]
 97%|█████████▋| 360864/371472 [6:33:22<51:48,  3.41it/s]
 97%|█████████▋| 360865/371472 [6:33:22<48:48,  3.62it/s]
 97%|█████████▋| 360866/371472 [6:33:23<53:20,  3.31it/s]
 97%|█████████▋| 360867/371472 [6:33:23<51:04,  3.46it/s]
 97%|█████████▋| 360868/371472 [6:33:23<53:02,  3.33it/s]
 97%|█████████▋| 360869/371472 [6:33:24<54:31,  3.24it/s]
 97%|█████████▋| 360870/371472 [6:33:24<52:06,  3.39it/s]
 97%|█████████▋| 360871/371472 [6:33:24<50:03,  3.53it/s]
 97%|█████████▋| 360872/371472 [6:33:25<50:26,  3.50it/s]
 97%|█████████▋| 360873/371472 [6:33:25<50:25,  3.50it/s]
 97%|█████████▋| 360874/371472 [6:33:25<49:07,  3.60it/s]
 97%|█████████▋| 360875/371472 [6:33:25<53:26,  3.30it/s]
 97%|█████████▋| 360876/371472 [6:33:26<50:32,  3.49it/s]
 97%|█████████▋| 360877/371472 [6:33:26<49:38,  3.56it/s]
 97%|█████████▋| 360878/371472 [6:33:26<50:37,  3.49it/s]
 97%|█████████▋| 360879/371472 [6:33:27<50:03,  3.53it/s]
 97%|█████████▋| 360880/371472 [6:33:27<49:14,  3.58it/s]
                                                         
{'loss': 2.6099, 'learning_rate': 1.2567605421362232e-07, 'epoch': 15.54}

 97%|█████████▋| 360880/371472 [6:33:27<49:14,  3.58it/s]
 97%|█████████▋| 360881/371472 [6:33:27<47:50,  3.69it/s]
 97%|█████████▋| 360882/371472 [6:33:27<47:56,  3.68it/s]
 97%|█████████▋| 360883/371472 [6:33:28<48:16,  3.66it/s]
 97%|█████████▋| 360884/371472 [6:33:28<48:42,  3.62it/s]
 97%|█████████▋| 360885/371472 [6:33:28<49:36,  3.56it/s]
 97%|█████████▋| 360886/371472 [6:33:28<49:33,  3.56it/s]
 97%|█████████▋| 360887/371472 [6:33:29<49:52,  3.54it/s]
 97%|█████████▋| 360888/371472 [6:33:29<1:00:02,  2.94it/s]
 97%|█████████▋| 360889/371472 [6:33:30<56:39,  3.11it/s]  
 97%|█████████▋| 360890/371472 [6:33:30<56:41,  3.11it/s]
 97%|█████████▋| 360891/371472 [6:33:30<56:22,  3.13it/s]
 97%|█████████▋| 360892/371472 [6:33:30<52:56,  3.33it/s]
 97%|█████████▋| 360893/371472 [6:33:31<51:18,  3.44it/s]
 97%|█████████▋| 360894/371472 [6:33:31<53:56,  3.27it/s]
 97%|█████████▋| 360895/371472 [6:33:31<52:16,  3.37it/s]
 97%|█████████▋| 360896/371472 [6:33:32<49:16,  3.58it/s]
 97%|█████████▋| 360897/371472 [6:33:32<49:06,  3.59it/s]
 97%|█████████▋| 360898/371472 [6:33:32<50:47,  3.47it/s]
 97%|█████████▋| 360899/371472 [6:33:32<48:51,  3.61it/s]
 97%|█████████▋| 360900/371472 [6:33:33<49:45,  3.54it/s]
                                                         
{'loss': 2.4343, 'learning_rate': 1.256275722381435e-07, 'epoch': 15.54}

 97%|█████████▋| 360900/371472 [6:33:33<49:45,  3.54it/s]
 97%|█████████▋| 360901/371472 [6:33:33<48:42,  3.62it/s]
 97%|█████████▋| 360902/371472 [6:33:33<50:23,  3.50it/s]
 97%|█████████▋| 360903/371472 [6:33:34<52:31,  3.35it/s]
 97%|█████████▋| 360904/371472 [6:33:34<49:37,  3.55it/s]
 97%|█████████▋| 360905/371472 [6:33:34<48:07,  3.66it/s]
 97%|█████████▋| 360906/371472 [6:33:34<49:51,  3.53it/s]
 97%|█████████▋| 360907/371472 [6:33:35<48:07,  3.66it/s]
 97%|█████████▋| 360908/371472 [6:33:35<46:45,  3.77it/s]
 97%|█████████▋| 360909/371472 [6:33:35<46:28,  3.79it/s]
 97%|█████████▋| 360910/371472 [6:33:35<46:32,  3.78it/s]
 97%|█████████▋| 360911/371472 [6:33:36<46:58,  3.75it/s]
 97%|█████████▋| 360912/371472 [6:33:36<46:54,  3.75it/s]
 97%|█████████▋| 360913/371472 [6:33:36<52:36,  3.35it/s]
 97%|█████████▋| 360914/371472 [6:33:37<50:31,  3.48it/s]
 97%|█████████▋| 360915/371472 [6:33:37<48:57,  3.59it/s]
 97%|█████████▋| 360916/371472 [6:33:37<48:15,  3.65it/s]
 97%|█████████▋| 360917/371472 [6:33:37<47:59,  3.67it/s]
 97%|█████████▋| 360918/371472 [6:33:38<49:02,  3.59it/s]
 97%|█████████▋| 360919/371472 [6:33:38<48:17,  3.64it/s]
 97%|█████████▋| 360920/371472 [6:33:38<48:19,  3.64it/s]
                                                         
{'loss': 2.5113, 'learning_rate': 1.2557909026266454e-07, 'epoch': 15.55}

 97%|█████████▋| 360920/371472 [6:33:38<48:19,  3.64it/s]
 97%|█████████▋| 360921/371472 [6:33:39<57:56,  3.03it/s]
 97%|█████████▋| 360922/371472 [6:33:39<54:35,  3.22it/s]
 97%|█████████▋| 360923/371472 [6:33:39<51:13,  3.43it/s]
 97%|█████████▋| 360924/371472 [6:33:39<50:46,  3.46it/s]
 97%|█████████▋| 360925/371472 [6:33:40<48:16,  3.64it/s]
 97%|█████████▋| 360926/371472 [6:33:40<48:20,  3.64it/s]
 97%|█████████▋| 360927/371472 [6:33:40<47:12,  3.72it/s]
 97%|█████████▋| 360928/371472 [6:33:41<52:34,  3.34it/s]
 97%|█████████▋| 360929/371472 [6:33:41<53:00,  3.32it/s]
 97%|█████████▋| 360930/371472 [6:33:41<55:30,  3.17it/s]
 97%|█████████▋| 360931/371472 [6:33:42<53:39,  3.27it/s]
 97%|█████████▋| 360932/371472 [6:33:42<51:22,  3.42it/s]
 97%|█████████▋| 360933/371472 [6:33:42<49:57,  3.52it/s]
 97%|█████████▋| 360934/371472 [6:33:42<50:29,  3.48it/s]
 97%|█████████▋| 360935/371472 [6:33:43<49:38,  3.54it/s]
 97%|█████████▋| 360936/371472 [6:33:43<48:02,  3.66it/s]
 97%|█████████▋| 360937/371472 [6:33:43<46:24,  3.78it/s]
 97%|█████████▋| 360938/371472 [6:33:43<45:49,  3.83it/s]
 97%|█████████▋| 360939/371472 [6:33:44<45:58,  3.82it/s]
 97%|█████████▋| 360940/371472 [6:33:44<46:52,  3.75it/s]
                                                         
{'loss': 2.5506, 'learning_rate': 1.255306082871857e-07, 'epoch': 15.55}

 97%|█████████▋| 360940/371472 [6:33:44<46:52,  3.75it/s]
 97%|█████████▋| 360941/371472 [6:33:44<45:50,  3.83it/s]
 97%|█████████▋| 360942/371472 [6:33:44<44:43,  3.92it/s]
 97%|█████████▋| 360943/371472 [6:33:45<47:52,  3.67it/s]
 97%|█████████▋| 360944/371472 [6:33:45<47:55,  3.66it/s]
 97%|█████████▋| 360945/371472 [6:33:45<48:24,  3.62it/s]
 97%|█████████▋| 360946/371472 [6:33:46<48:29,  3.62it/s]
 97%|█████████▋| 360947/371472 [6:33:46<47:07,  3.72it/s]
 97%|█████████▋| 360948/371472 [6:33:46<50:20,  3.48it/s]
 97%|█████████▋| 360949/371472 [6:33:46<50:08,  3.50it/s]
 97%|█████████▋| 360950/371472 [6:33:47<50:33,  3.47it/s]
 97%|█████████▋| 360951/371472 [6:33:47<57:15,  3.06it/s]
 97%|█████████▋| 360952/371472 [6:33:47<54:45,  3.20it/s]
 97%|█████████▋| 360953/371472 [6:33:48<51:27,  3.41it/s]
 97%|█████████▋| 360954/371472 [6:33:48<51:00,  3.44it/s]
 97%|█████████▋| 360955/371472 [6:33:48<48:32,  3.61it/s]
 97%|█████████▋| 360956/371472 [6:33:48<47:38,  3.68it/s]
 97%|█████████▋| 360957/371472 [6:33:49<46:24,  3.78it/s]
 97%|█████████▋| 360958/371472 [6:33:49<48:54,  3.58it/s]
 97%|█████████▋| 360959/371472 [6:33:49<48:27,  3.62it/s]
 97%|█████████▋| 360960/371472 [6:33:50<49:45,  3.52it/s]
                                                         
{'loss': 2.5927, 'learning_rate': 1.2548212631170677e-07, 'epoch': 15.55}

 97%|█████████▋| 360960/371472 [6:33:50<49:45,  3.52it/s]
 97%|█████████▋| 360961/371472 [6:33:50<48:52,  3.58it/s]
 97%|█████████▋| 360962/371472 [6:33:50<51:11,  3.42it/s]
 97%|█████████▋| 360963/371472 [6:33:50<48:56,  3.58it/s]
 97%|█████████▋| 360964/371472 [6:33:51<48:44,  3.59it/s]
 97%|█████████▋| 360965/371472 [6:33:51<48:48,  3.59it/s]
 97%|█████████▋| 360966/371472 [6:33:51<47:27,  3.69it/s]
 97%|█████████▋| 360967/371472 [6:33:51<46:23,  3.77it/s]
 97%|█████████▋| 360968/371472 [6:33:52<46:51,  3.74it/s]
 97%|█████████▋| 360969/371472 [6:33:52<48:37,  3.60it/s]
 97%|█████████▋| 360970/371472 [6:33:52<46:50,  3.74it/s]
 97%|█████████▋| 360971/371472 [6:33:53<45:00,  3.89it/s]
 97%|█████████▋| 360972/371472 [6:33:53<47:54,  3.65it/s]
 97%|█████████▋| 360973/371472 [6:33:53<46:35,  3.76it/s]
 97%|█████████▋| 360974/371472 [6:33:53<46:00,  3.80it/s]
 97%|█████████▋| 360975/371472 [6:33:54<49:46,  3.51it/s]
 97%|█████████▋| 360976/371472 [6:33:54<48:13,  3.63it/s]
 97%|█████████▋| 360977/371472 [6:33:54<46:49,  3.74it/s]
 97%|█████████▋| 360978/371472 [6:33:54<47:20,  3.69it/s]
 97%|█████████▋| 360979/371472 [6:33:55<46:54,  3.73it/s]
 97%|█████████▋| 360980/371472 [6:33:55<46:58,  3.72it/s]
                                                         
{'loss': 2.724, 'learning_rate': 1.2543364433622792e-07, 'epoch': 15.55}

 97%|█████████▋| 360980/371472 [6:33:55<46:58,  3.72it/s]
 97%|█████████▋| 360981/371472 [6:33:55<48:19,  3.62it/s]
 97%|█████████▋| 360982/371472 [6:33:56<50:00,  3.50it/s]
 97%|█████████▋| 360983/371472 [6:33:56<49:55,  3.50it/s]
 97%|█████████▋| 360984/371472 [6:33:56<47:53,  3.65it/s]
 97%|█████████▋| 360985/371472 [6:33:56<46:13,  3.78it/s]
 97%|█████████▋| 360986/371472 [6:33:57<46:44,  3.74it/s]
 97%|█████████▋| 360987/371472 [6:33:57<46:36,  3.75it/s]
 97%|█████████▋| 360988/371472 [6:33:57<47:49,  3.65it/s]
 97%|█████████▋| 360989/371472 [6:33:57<48:09,  3.63it/s]
 97%|█████████▋| 360990/371472 [6:33:58<48:01,  3.64it/s]
 97%|█████████▋| 360991/371472 [6:33:58<47:26,  3.68it/s]
 97%|█████████▋| 360992/371472 [6:33:58<46:42,  3.74it/s]
 97%|█████████▋| 360993/371472 [6:33:59<47:50,  3.65it/s]
 97%|█████████▋| 360994/371472 [6:33:59<49:57,  3.50it/s]
 97%|█████████▋| 360995/371472 [6:33:59<47:50,  3.65it/s]
 97%|█████████▋| 360996/371472 [6:33:59<48:22,  3.61it/s]
 97%|█████████▋| 360997/371472 [6:34:00<50:32,  3.45it/s]
 97%|█████████▋| 360998/371472 [6:34:00<48:33,  3.60it/s]
 97%|█████████▋| 360999/371472 [6:34:00<48:46,  3.58it/s]
 97%|█████████▋| 361000/371472 [6:34:00<46:42,  3.74it/s]
                                                         
{'loss': 2.7193, 'learning_rate': 1.2538516236074896e-07, 'epoch': 15.55}

 97%|█████████▋| 361000/371472 [6:34:00<46:42,  3.74it/s]
 97%|█████████▋| 361001/371472 [6:34:01<48:51,  3.57it/s]
 97%|█████████▋| 361002/371472 [6:34:01<49:14,  3.54it/s]
 97%|█████████▋| 361003/371472 [6:34:01<48:58,  3.56it/s]
 97%|█████████▋| 361004/371472 [6:34:02<47:25,  3.68it/s]
 97%|█████████▋| 361005/371472 [6:34:02<46:37,  3.74it/s]
 97%|█████████▋| 361006/371472 [6:34:02<45:35,  3.83it/s]
 97%|█████████▋| 361007/371472 [6:34:02<45:14,  3.86it/s]
 97%|█████████▋| 361008/371472 [6:34:03<45:46,  3.81it/s]
 97%|█████████▋| 361009/371472 [6:34:03<45:43,  3.81it/s]
 97%|█████████▋| 361010/371472 [6:34:03<44:05,  3.95it/s]
 97%|█████████▋| 361011/371472 [6:34:03<45:10,  3.86it/s]
 97%|█████████▋| 361012/371472 [6:34:04<45:39,  3.82it/s]
 97%|█████████▋| 361013/371472 [6:34:04<45:02,  3.87it/s]
 97%|█████████▋| 361014/371472 [6:34:04<48:39,  3.58it/s]
 97%|█████████▋| 361015/371472 [6:34:05<49:29,  3.52it/s]
 97%|█████████▋| 361016/371472 [6:34:05<48:18,  3.61it/s]
 97%|█████████▋| 361017/371472 [6:34:05<46:43,  3.73it/s]
 97%|█████████▋| 361018/371472 [6:34:05<49:41,  3.51it/s]
 97%|█████████▋| 361019/371472 [6:34:06<49:17,  3.53it/s]
 97%|█████████▋| 361020/371472 [6:34:06<51:16,  3.40it/s]
                                                         
{'loss': 2.4747, 'learning_rate': 1.2533668038527014e-07, 'epoch': 15.55}

 97%|█████████▋| 361020/371472 [6:34:06<51:16,  3.40it/s]
 97%|█████████▋| 361021/371472 [6:34:06<51:05,  3.41it/s]
 97%|█████████▋| 361022/371472 [6:34:07<48:17,  3.61it/s]
 97%|█████████▋| 361023/371472 [6:34:07<47:45,  3.65it/s]
 97%|█████████▋| 361024/371472 [6:34:07<47:03,  3.70it/s]
 97%|█████████▋| 361025/371472 [6:34:07<46:52,  3.71it/s]
 97%|█████████▋| 361026/371472 [6:34:08<48:01,  3.63it/s]
 97%|█████████▋| 361027/371472 [6:34:08<50:04,  3.48it/s]
 97%|█████████▋| 361028/371472 [6:34:08<48:32,  3.59it/s]
 97%|█████████▋| 361029/371472 [6:34:08<47:00,  3.70it/s]
 97%|█████████▋| 361030/371472 [6:34:09<49:14,  3.53it/s]
 97%|█████████▋| 361031/371472 [6:34:09<49:31,  3.51it/s]
 97%|█████████▋| 361032/371472 [6:34:09<49:21,  3.52it/s]
 97%|█████████▋| 361033/371472 [6:34:10<55:41,  3.12it/s]
 97%|█████████▋| 361034/371472 [6:34:10<51:46,  3.36it/s]
 97%|█████████▋| 361035/371472 [6:34:10<50:44,  3.43it/s]
 97%|█████████▋| 361036/371472 [6:34:11<50:16,  3.46it/s]
 97%|█████████▋| 361037/371472 [6:34:11<50:03,  3.47it/s]
 97%|█████████▋| 361038/371472 [6:34:11<48:45,  3.57it/s]
 97%|█████████▋| 361039/371472 [6:34:11<47:08,  3.69it/s]
 97%|█████████▋| 361040/371472 [6:34:12<45:38,  3.81it/s]
                                                         
{'loss': 2.4665, 'learning_rate': 1.2528819840979119e-07, 'epoch': 15.55}

 97%|█████████▋| 361040/371472 [6:34:12<45:38,  3.81it/s]
 97%|█████████▋| 361041/371472 [6:34:12<46:09,  3.77it/s]
 97%|█████████▋| 361042/371472 [6:34:12<47:36,  3.65it/s]
 97%|█████████▋| 361043/371472 [6:34:12<47:03,  3.69it/s]
 97%|█████████▋| 361044/371472 [6:34:13<50:12,  3.46it/s]
 97%|█████████▋| 361045/371472 [6:34:13<50:10,  3.46it/s]
 97%|█████████▋| 361046/371472 [6:34:13<49:37,  3.50it/s]
 97%|█████████▋| 361047/371472 [6:34:14<49:45,  3.49it/s]
 97%|█████████▋| 361048/371472 [6:34:14<51:45,  3.36it/s]
 97%|█████████▋| 361049/371472 [6:34:14<48:43,  3.57it/s]
 97%|█████████▋| 361050/371472 [6:34:14<48:55,  3.55it/s]
 97%|█████████▋| 361051/371472 [6:34:15<46:55,  3.70it/s]
 97%|█████████▋| 361052/371472 [6:34:15<47:54,  3.62it/s]
 97%|█████████▋| 361053/371472 [6:34:15<46:57,  3.70it/s]
 97%|█████████▋| 361054/371472 [6:34:15<47:16,  3.67it/s]
 97%|█████████▋| 361055/371472 [6:34:16<46:46,  3.71it/s]
 97%|█████████▋| 361056/371472 [6:34:16<47:51,  3.63it/s]
 97%|█████████▋| 361057/371472 [6:34:16<48:49,  3.56it/s]
 97%|█████████▋| 361058/371472 [6:34:17<48:54,  3.55it/s]
 97%|█████████▋| 361059/371472 [6:34:17<48:50,  3.55it/s]
 97%|█████████▋| 361060/371472 [6:34:17<48:25,  3.58it/s]
                                                         
{'loss': 2.6839, 'learning_rate': 1.2523971643431234e-07, 'epoch': 15.55}

 97%|█████████▋| 361060/371472 [6:34:17<48:25,  3.58it/s]
 97%|█████████▋| 361061/371472 [6:34:17<46:22,  3.74it/s]
 97%|█████████▋| 361062/371472 [6:34:18<46:54,  3.70it/s]
 97%|█████████▋| 361063/371472 [6:34:18<46:49,  3.71it/s]
 97%|█████████▋| 361064/371472 [6:34:18<47:02,  3.69it/s]
 97%|█████████▋| 361065/371472 [6:34:19<48:22,  3.59it/s]
 97%|█████████▋| 361066/371472 [6:34:19<53:45,  3.23it/s]
 97%|█████████▋| 361067/371472 [6:34:19<51:52,  3.34it/s]
 97%|█████████▋| 361068/371472 [6:34:19<49:27,  3.51it/s]
 97%|█████████▋| 361069/371472 [6:34:20<59:29,  2.91it/s]
 97%|█████████▋| 361070/371472 [6:34:20<55:32,  3.12it/s]
 97%|█████████▋| 361071/371472 [6:34:21<55:38,  3.12it/s]
 97%|█████████▋| 361072/371472 [6:34:21<54:46,  3.16it/s]
 97%|█████████▋| 361073/371472 [6:34:21<52:03,  3.33it/s]
 97%|█████████▋| 361074/371472 [6:34:21<49:58,  3.47it/s]
 97%|█████████▋| 361075/371472 [6:34:22<48:08,  3.60it/s]
 97%|█████████▋| 361076/371472 [6:34:22<47:09,  3.67it/s]
 97%|█████████▋| 361077/371472 [6:34:22<47:36,  3.64it/s]
 97%|█████████▋| 361078/371472 [6:34:22<48:57,  3.54it/s]
 97%|█████████▋| 361079/371472 [6:34:23<47:30,  3.65it/s]
 97%|█████████▋| 361080/371472 [6:34:23<49:56,  3.47it/s]
                                                         
{'loss': 2.6732, 'learning_rate': 1.251912344588334e-07, 'epoch': 15.55}

 97%|█████████▋| 361080/371472 [6:34:23<49:56,  3.47it/s]
 97%|█████████▋| 361081/371472 [6:34:23<49:38,  3.49it/s]
 97%|█████████▋| 361082/371472 [6:34:24<47:13,  3.67it/s]
 97%|█████████▋| 361083/371472 [6:34:24<47:46,  3.62it/s]
 97%|█████████▋| 361084/371472 [6:34:24<49:51,  3.47it/s]
 97%|█████████▋| 361085/371472 [6:34:24<51:05,  3.39it/s]
 97%|█████████▋| 361086/371472 [6:34:25<49:48,  3.48it/s]
 97%|█████████▋| 361087/371472 [6:34:25<49:25,  3.50it/s]
 97%|█████████▋| 361088/371472 [6:34:25<48:48,  3.55it/s]
 97%|█████████▋| 361089/371472 [6:34:26<47:06,  3.67it/s]
 97%|█████████▋| 361090/371472 [6:34:26<48:58,  3.53it/s]
 97%|█████████▋| 361091/371472 [6:34:26<48:50,  3.54it/s]
 97%|█████████▋| 361092/371472 [6:34:26<48:44,  3.55it/s]
 97%|█████████▋| 361093/371472 [6:34:27<49:24,  3.50it/s]
 97%|█████████▋| 361094/371472 [6:34:27<49:51,  3.47it/s]
 97%|█████████▋| 361095/371472 [6:34:27<53:08,  3.25it/s]
 97%|█████████▋| 361096/371472 [6:34:28<50:50,  3.40it/s]
 97%|█████████▋| 361097/371472 [6:34:28<48:25,  3.57it/s]
 97%|█████████▋| 361098/371472 [6:34:28<47:41,  3.63it/s]
 97%|█████████▋| 361099/371472 [6:34:28<46:52,  3.69it/s]
 97%|█████████▋| 361100/371472 [6:34:29<47:42,  3.62it/s]
                                                         
{'loss': 2.6763, 'learning_rate': 1.2514275248335456e-07, 'epoch': 15.55}

 97%|█████████▋| 361100/371472 [6:34:29<47:42,  3.62it/s]
 97%|█████████▋| 361101/371472 [6:34:29<53:06,  3.25it/s]
 97%|█████████▋| 361102/371472 [6:34:29<53:22,  3.24it/s]
 97%|█████████▋| 361103/371472 [6:34:30<53:20,  3.24it/s]
 97%|█████████▋| 361104/371472 [6:34:30<55:59,  3.09it/s]
 97%|█████████▋| 361105/371472 [6:34:30<54:19,  3.18it/s]
 97%|█████████▋| 361106/371472 [6:34:31<54:30,  3.17it/s]
 97%|█████████▋| 361107/371472 [6:34:31<54:42,  3.16it/s]
 97%|█████████▋| 361108/371472 [6:34:31<50:47,  3.40it/s]
 97%|█████████▋| 361109/371472 [6:34:31<48:13,  3.58it/s]
 97%|█████████▋| 361110/371472 [6:34:32<47:32,  3.63it/s]
 97%|█████████▋| 361111/371472 [6:34:32<48:19,  3.57it/s]
 97%|█████████▋| 361112/371472 [6:34:32<54:36,  3.16it/s]
 97%|█████████▋| 361113/371472 [6:34:33<55:22,  3.12it/s]
 97%|█████████▋| 361114/371472 [6:34:33<55:26,  3.11it/s]
 97%|█████████▋| 361115/371472 [6:34:33<53:14,  3.24it/s]
 97%|█████████▋| 361116/371472 [6:34:34<51:40,  3.34it/s]
 97%|█████████▋| 361117/371472 [6:34:34<49:22,  3.49it/s]
 97%|█████████▋| 361118/371472 [6:34:34<47:23,  3.64it/s]
 97%|█████████▋| 361119/371472 [6:34:34<45:42,  3.78it/s]
 97%|█████████▋| 361120/371472 [6:34:35<45:22,  3.80it/s]
                                                         
{'loss': 2.716, 'learning_rate': 1.2509427050787563e-07, 'epoch': 15.55}

 97%|█████████▋| 361120/371472 [6:34:35<45:22,  3.80it/s]
 97%|█████████▋| 361121/371472 [6:34:35<44:55,  3.84it/s]
 97%|█████████▋| 361122/371472 [6:34:35<45:38,  3.78it/s]
 97%|█████████▋| 361123/371472 [6:34:35<46:29,  3.71it/s]
 97%|█████████▋| 361124/371472 [6:34:36<50:30,  3.41it/s]
 97%|█████████▋| 361125/371472 [6:34:36<56:07,  3.07it/s]
 97%|█████████▋| 361126/371472 [6:34:36<53:20,  3.23it/s]
 97%|█████████▋| 361127/371472 [6:34:37<49:30,  3.48it/s]
 97%|█████████▋| 361128/371472 [6:34:37<49:02,  3.52it/s]
 97%|█████████▋| 361129/371472 [6:34:37<50:37,  3.40it/s]
 97%|█████████▋| 361130/371472 [6:34:38<49:54,  3.45it/s]
 97%|█████████▋| 361131/371472 [6:34:38<49:15,  3.50it/s]
 97%|█████████▋| 361132/371472 [6:34:38<51:24,  3.35it/s]
 97%|█████████▋| 361133/371472 [6:34:38<51:42,  3.33it/s]
 97%|█████████▋| 361134/371472 [6:34:39<52:43,  3.27it/s]
 97%|█████████▋| 361135/371472 [6:34:39<53:30,  3.22it/s]
 97%|█████████▋| 361136/371472 [6:34:39<50:43,  3.40it/s]
 97%|█████████▋| 361137/371472 [6:34:40<50:26,  3.41it/s]
 97%|█████████▋| 361138/371472 [6:34:40<48:59,  3.52it/s]
 97%|█████████▋| 361139/371472 [6:34:40<47:46,  3.60it/s]
 97%|█████████▋| 361140/371472 [6:34:40<47:21,  3.64it/s]
                                                         
{'loss': 2.4667, 'learning_rate': 1.2504578853239667e-07, 'epoch': 15.55}

 97%|█████████▋| 361140/371472 [6:34:40<47:21,  3.64it/s]
 97%|█████████▋| 361141/371472 [6:34:41<49:32,  3.48it/s]
 97%|█████████▋| 361142/371472 [6:34:41<47:44,  3.61it/s]
 97%|█████████▋| 361143/371472 [6:34:41<46:25,  3.71it/s]
 97%|█████████▋| 361144/371472 [6:34:42<48:22,  3.56it/s]
 97%|█████████▋| 361145/371472 [6:34:42<46:29,  3.70it/s]
 97%|█████████▋| 361146/371472 [6:34:42<45:10,  3.81it/s]
 97%|█████████▋| 361147/371472 [6:34:42<49:39,  3.47it/s]
 97%|█████████▋| 361148/371472 [6:34:43<48:07,  3.58it/s]
 97%|█████████▋| 361149/371472 [6:34:43<48:07,  3.57it/s]
 97%|█████████▋| 361150/371472 [6:34:43<49:45,  3.46it/s]
 97%|█████████▋| 361151/371472 [6:34:44<48:29,  3.55it/s]
 97%|█████████▋| 361152/371472 [6:34:44<46:21,  3.71it/s]
 97%|█████████▋| 361153/371472 [6:34:44<47:00,  3.66it/s]
 97%|█████████▋| 361154/371472 [6:34:44<46:48,  3.67it/s]
 97%|█████████▋| 361155/371472 [6:34:45<45:58,  3.74it/s]
 97%|█████████▋| 361156/371472 [6:34:45<48:14,  3.56it/s]
 97%|█████████▋| 361157/371472 [6:34:45<46:31,  3.70it/s]
 97%|█████████▋| 361158/371472 [6:34:45<45:11,  3.80it/s]
 97%|█████████▋| 361159/371472 [6:34:46<44:22,  3.87it/s]
 97%|█████████▋| 361160/371472 [6:34:46<44:44,  3.84it/s]
                                                         
{'loss': 2.6191, 'learning_rate': 1.2499730655691783e-07, 'epoch': 15.56}

 97%|█████████▋| 361160/371472 [6:34:46<44:44,  3.84it/s]
 97%|█████████▋| 361161/371472 [6:34:46<48:55,  3.51it/s]
 97%|█████████▋| 361162/371472 [6:34:46<47:47,  3.60it/s]
 97%|█████████▋| 361163/371472 [6:34:47<46:04,  3.73it/s]
 97%|█████████▋| 361164/371472 [6:34:47<48:39,  3.53it/s]
 97%|█████████▋| 361165/371472 [6:34:47<48:32,  3.54it/s]
 97%|█████████▋| 361166/371472 [6:34:48<50:37,  3.39it/s]
 97%|█████████▋| 361167/371472 [6:34:48<52:45,  3.26it/s]
 97%|█████████▋| 361168/371472 [6:34:48<49:46,  3.45it/s]
 97%|█████████▋| 361169/371472 [6:34:49<50:25,  3.41it/s]
 97%|█████████▋| 361170/371472 [6:34:49<48:38,  3.53it/s]
 97%|█████████▋| 361171/371472 [6:34:49<49:59,  3.43it/s]
 97%|█████████▋| 361172/371472 [6:34:49<49:28,  3.47it/s]
 97%|█████████▋| 361173/371472 [6:34:50<47:21,  3.63it/s]
 97%|█████████▋| 361174/371472 [6:34:50<48:52,  3.51it/s]
 97%|█████████▋| 361175/371472 [6:34:50<48:49,  3.52it/s]
 97%|█████████▋| 361176/371472 [6:34:51<48:43,  3.52it/s]
 97%|█████████▋| 361177/371472 [6:34:51<46:26,  3.69it/s]
 97%|█████████▋| 361178/371472 [6:34:51<47:22,  3.62it/s]
 97%|█████████▋| 361179/371472 [6:34:51<46:57,  3.65it/s]
 97%|█████████▋| 361180/371472 [6:34:52<46:11,  3.71it/s]
                                                         
{'loss': 2.4963, 'learning_rate': 1.249488245814389e-07, 'epoch': 15.56}

 97%|█████████▋| 361180/371472 [6:34:52<46:11,  3.71it/s]
 97%|█████████▋| 361181/371472 [6:34:52<46:22,  3.70it/s]
 97%|█████████▋| 361182/371472 [6:34:52<45:43,  3.75it/s]
 97%|█████████▋| 361183/371472 [6:34:52<49:00,  3.50it/s]
 97%|█████████▋| 361184/371472 [6:34:53<47:04,  3.64it/s]
 97%|█████████▋| 361185/371472 [6:34:53<48:28,  3.54it/s]
 97%|█████████▋| 361186/371472 [6:34:53<49:22,  3.47it/s]
 97%|█████████▋| 361187/371472 [6:34:54<49:33,  3.46it/s]
 97%|█████████▋| 361188/371472 [6:34:54<49:33,  3.46it/s]
 97%|█████████▋| 361189/371472 [6:34:54<47:42,  3.59it/s]
 97%|█████████▋| 361190/371472 [6:34:54<46:30,  3.69it/s]
 97%|█████████▋| 361191/371472 [6:34:55<44:58,  3.81it/s]
 97%|█████████▋| 361192/371472 [6:34:55<45:02,  3.80it/s]
 97%|█████████▋| 361193/371472 [6:34:55<44:52,  3.82it/s]
 97%|█████████▋| 361194/371472 [6:34:55<44:28,  3.85it/s]
 97%|█████████▋| 361195/371472 [6:34:56<42:54,  3.99it/s]
 97%|█████████▋| 361196/371472 [6:34:56<42:35,  4.02it/s]
 97%|█████████▋| 361197/371472 [6:34:56<44:15,  3.87it/s]
 97%|█████████▋| 361198/371472 [6:34:56<44:18,  3.86it/s]
 97%|█████████▋| 361199/371472 [6:34:57<43:30,  3.94it/s]
 97%|█████████▋| 361200/371472 [6:34:57<43:46,  3.91it/s]
                                                         
{'loss': 2.4325, 'learning_rate': 1.2490034260596005e-07, 'epoch': 15.56}

 97%|█████████▋| 361200/371472 [6:34:57<43:46,  3.91it/s]
 97%|█████████▋| 361201/371472 [6:34:57<46:35,  3.67it/s]
 97%|█████████▋| 361202/371472 [6:34:57<47:18,  3.62it/s]
 97%|█████████▋| 361203/371472 [6:34:58<48:42,  3.51it/s]
 97%|█████████▋| 361204/371472 [6:34:58<48:26,  3.53it/s]
 97%|█████████▋| 361205/371472 [6:34:58<47:23,  3.61it/s]
 97%|█████████▋| 361206/371472 [6:34:59<44:59,  3.80it/s]
 97%|█████████▋| 361207/371472 [6:34:59<44:13,  3.87it/s]
 97%|█████████▋| 361208/371472 [6:34:59<44:14,  3.87it/s]
 97%|█████████▋| 361209/371472 [6:34:59<46:01,  3.72it/s]
 97%|█████████▋| 361210/371472 [6:35:00<45:17,  3.78it/s]
 97%|█████████▋| 361211/371472 [6:35:00<44:02,  3.88it/s]
 97%|█████████▋| 361212/371472 [6:35:00<44:12,  3.87it/s]
 97%|█████████▋| 361213/371472 [6:35:00<46:05,  3.71it/s]
 97%|█████████▋| 361214/371472 [6:35:01<46:15,  3.70it/s]
 97%|█████████▋| 361215/371472 [6:35:01<46:22,  3.69it/s]
 97%|█████████▋| 361216/371472 [6:35:01<47:30,  3.60it/s]
 97%|█████████▋| 361217/371472 [6:35:02<48:17,  3.54it/s]
 97%|█████████▋| 361218/371472 [6:35:02<46:47,  3.65it/s]
 97%|█████████▋| 361219/371472 [6:35:02<46:00,  3.71it/s]
 97%|█████████▋| 361220/371472 [6:35:02<46:57,  3.64it/s]
                                                         
{'loss': 2.6134, 'learning_rate': 1.2485186063048112e-07, 'epoch': 15.56}

 97%|█████████▋| 361220/371472 [6:35:02<46:57,  3.64it/s]
 97%|█████████▋| 361221/371472 [6:35:03<46:06,  3.71it/s]
 97%|█████████▋| 361222/371472 [6:35:03<44:55,  3.80it/s]
 97%|█████████▋| 361223/371472 [6:35:03<48:12,  3.54it/s]
 97%|█████████▋| 361224/371472 [6:35:04<52:09,  3.27it/s]
 97%|█████████▋| 361225/371472 [6:35:04<54:50,  3.11it/s]
 97%|█████████▋| 361226/371472 [6:35:04<51:06,  3.34it/s]
 97%|█████████▋| 361227/371472 [6:35:04<49:29,  3.45it/s]
 97%|█████████▋| 361228/371472 [6:35:05<48:00,  3.56it/s]
 97%|█████████▋| 361229/371472 [6:35:05<45:49,  3.73it/s]
 97%|█████████▋| 361230/371472 [6:35:05<52:02,  3.28it/s]
 97%|█████████▋| 361231/371472 [6:35:06<51:20,  3.32it/s]
 97%|█████████▋| 361232/371472 [6:35:06<52:22,  3.26it/s]
 97%|█████████▋| 361233/371472 [6:35:06<56:06,  3.04it/s]
 97%|█████████▋| 361234/371472 [6:35:07<51:44,  3.30it/s]
 97%|█████████▋| 361235/371472 [6:35:07<54:37,  3.12it/s]
 97%|█████████▋| 361236/371472 [6:35:07<52:39,  3.24it/s]
 97%|█████████▋| 361237/371472 [6:35:07<49:28,  3.45it/s]
 97%|█████████▋| 361238/371472 [6:35:08<49:24,  3.45it/s]
 97%|█████████▋| 361239/371472 [6:35:08<48:58,  3.48it/s]
 97%|█████████▋| 361240/371472 [6:35:08<48:45,  3.50it/s]
                                                         
{'loss': 2.5301, 'learning_rate': 1.2480337865500227e-07, 'epoch': 15.56}

 97%|█████████▋| 361240/371472 [6:35:08<48:45,  3.50it/s]
 97%|█████████▋| 361241/371472 [6:35:09<47:28,  3.59it/s]
 97%|█████████▋| 361242/371472 [6:35:09<46:05,  3.70it/s]
 97%|█████████▋| 361243/371472 [6:35:09<46:24,  3.67it/s]
 97%|█████████▋| 361244/371472 [6:35:09<45:24,  3.75it/s]
 97%|█████████▋| 361245/371472 [6:35:10<45:48,  3.72it/s]
 97%|█████████▋| 361246/371472 [6:35:10<44:40,  3.82it/s]
 97%|█████████▋| 361247/371472 [6:35:10<43:05,  3.96it/s]
 97%|█████████▋| 361248/371472 [6:35:10<44:40,  3.81it/s]
 97%|█████████▋| 361249/371472 [6:35:11<48:14,  3.53it/s]
 97%|█████████▋| 361250/371472 [6:35:11<46:59,  3.63it/s]
 97%|█████████▋| 361251/371472 [6:35:11<45:28,  3.75it/s]
 97%|█████████▋| 361252/371472 [6:35:11<46:11,  3.69it/s]
 97%|█████████▋| 361253/371472 [6:35:12<44:31,  3.83it/s]
 97%|█████████▋| 361254/371472 [6:35:12<46:21,  3.67it/s]
 97%|█████████▋| 361255/371472 [6:35:12<46:35,  3.65it/s]
 97%|█████████▋| 361256/371472 [6:35:13<45:50,  3.71it/s]
 97%|█████████▋| 361257/371472 [6:35:13<44:57,  3.79it/s]
 97%|█████████▋| 361258/371472 [6:35:13<45:37,  3.73it/s]
 97%|█████████▋| 361259/371472 [6:35:13<46:53,  3.63it/s]
 97%|█████████▋| 361260/371472 [6:35:14<46:57,  3.62it/s]
                                                         
{'loss': 2.5886, 'learning_rate': 1.2475489667952332e-07, 'epoch': 15.56}

 97%|█████████▋| 361260/371472 [6:35:14<46:57,  3.62it/s]
 97%|█████████▋| 361261/371472 [6:35:14<48:23,  3.52it/s]
 97%|█████████▋| 361262/371472 [6:35:14<47:00,  3.62it/s]
 97%|█████████▋| 361263/371472 [6:35:14<45:13,  3.76it/s]
 97%|█████████▋| 361264/371472 [6:35:15<45:47,  3.72it/s]
 97%|█████████▋| 361265/371472 [6:35:15<45:40,  3.72it/s]
 97%|█████████▋| 361266/371472 [6:35:15<44:47,  3.80it/s]
 97%|█████████▋| 361267/371472 [6:35:15<43:37,  3.90it/s]
 97%|█████████▋| 361268/371472 [6:35:16<45:14,  3.76it/s]
 97%|█████████▋| 361269/371472 [6:35:16<46:03,  3.69it/s]
 97%|█████████▋| 361270/371472 [6:35:16<46:53,  3.63it/s]
 97%|█████████▋| 361271/371472 [6:35:17<47:44,  3.56it/s]
 97%|█████████▋| 361272/371472 [6:35:17<47:18,  3.59it/s]
 97%|█████████▋| 361273/371472 [6:35:17<49:51,  3.41it/s]
 97%|█████████▋| 361274/371472 [6:35:17<47:18,  3.59it/s]
 97%|█████████▋| 361275/371472 [6:35:18<45:37,  3.72it/s]
 97%|█████████▋| 361276/371472 [6:35:18<46:46,  3.63it/s]
 97%|█████████▋| 361277/371472 [6:35:18<50:42,  3.35it/s]
 97%|█████████▋| 361278/371472 [6:35:19<52:30,  3.24it/s]
 97%|█████████▋| 361279/371472 [6:35:19<50:04,  3.39it/s]
 97%|█████████▋| 361280/371472 [6:35:19<57:35,  2.95it/s]
                                                         
{'loss': 2.6661, 'learning_rate': 1.247064147040445e-07, 'epoch': 15.56}

 97%|█████████▋| 361280/371472 [6:35:19<57:35,  2.95it/s]
 97%|█████████▋| 361281/371472 [6:35:20<54:39,  3.11it/s]
 97%|█████████▋| 361282/371472 [6:35:20<50:48,  3.34it/s]
 97%|█████████▋| 361283/371472 [6:35:20<47:59,  3.54it/s]
 97%|█████████▋| 361284/371472 [6:35:20<46:46,  3.63it/s]
 97%|█████████▋| 361285/371472 [6:35:21<46:57,  3.62it/s]
 97%|█████████▋| 361286/371472 [6:35:21<47:38,  3.56it/s]
 97%|█████████▋| 361287/371472 [6:35:21<47:45,  3.55it/s]
 97%|█████████▋| 361288/371472 [6:35:22<47:04,  3.61it/s]
 97%|█████████▋| 361289/371472 [6:35:22<48:37,  3.49it/s]
 97%|█████████▋| 361290/371472 [6:35:22<51:12,  3.31it/s]
 97%|█████████▋| 361291/371472 [6:35:22<50:04,  3.39it/s]
 97%|█████████▋| 361292/371472 [6:35:23<47:56,  3.54it/s]
 97%|█████████▋| 361293/371472 [6:35:23<48:10,  3.52it/s]
 97%|█████████▋| 361294/371472 [6:35:23<45:29,  3.73it/s]
 97%|█████████▋| 361295/371472 [6:35:24<45:01,  3.77it/s]
 97%|█████████▋| 361296/371472 [6:35:24<45:47,  3.70it/s]
 97%|█████████▋| 361297/371472 [6:35:24<48:01,  3.53it/s]
 97%|█████████▋| 361298/371472 [6:35:24<48:48,  3.47it/s]
 97%|█████████▋| 361299/371472 [6:35:25<50:36,  3.35it/s]
 97%|█████████▋| 361300/371472 [6:35:25<48:28,  3.50it/s]
                                                         
{'loss': 2.4483, 'learning_rate': 1.2465793272856554e-07, 'epoch': 15.56}

 97%|█████████▋| 361300/371472 [6:35:25<48:28,  3.50it/s]
 97%|█████████▋| 361301/371472 [6:35:25<47:54,  3.54it/s]
 97%|█████████▋| 361302/371472 [6:35:26<48:05,  3.53it/s]
 97%|█████████▋| 361303/371472 [6:35:26<46:13,  3.67it/s]
 97%|█████████▋| 361304/371472 [6:35:26<47:45,  3.55it/s]
 97%|█████████▋| 361305/371472 [6:35:26<47:44,  3.55it/s]
 97%|█████████▋| 361306/371472 [6:35:27<46:02,  3.68it/s]
 97%|█████████▋| 361307/371472 [6:35:27<47:45,  3.55it/s]
 97%|█████████▋| 361308/371472 [6:35:27<48:39,  3.48it/s]
 97%|█████████▋| 361309/371472 [6:35:27<46:41,  3.63it/s]
 97%|█████████▋| 361310/371472 [6:35:28<47:55,  3.53it/s]
 97%|█████████▋| 361311/371472 [6:35:28<45:33,  3.72it/s]
 97%|█████████▋| 361312/371472 [6:35:28<44:50,  3.78it/s]
 97%|█████████▋| 361313/371472 [6:35:29<44:36,  3.80it/s]
 97%|█████████▋| 361314/371472 [6:35:29<47:01,  3.60it/s]
 97%|█████████▋| 361315/371472 [6:35:29<48:11,  3.51it/s]
 97%|█████████▋| 361316/371472 [6:35:29<46:27,  3.64it/s]
 97%|█████████▋| 361317/371472 [6:35:30<45:25,  3.73it/s]
 97%|█████████▋| 361318/371472 [6:35:30<44:55,  3.77it/s]
 97%|█████████▋| 361319/371472 [6:35:30<44:44,  3.78it/s]
 97%|█████████▋| 361320/371472 [6:35:30<47:14,  3.58it/s]
                                                         
{'loss': 2.6183, 'learning_rate': 1.246094507530867e-07, 'epoch': 15.56}

 97%|█████████▋| 361320/371472 [6:35:30<47:14,  3.58it/s]
 97%|█████████▋| 361321/371472 [6:35:31<49:48,  3.40it/s]
 97%|█████████▋| 361322/371472 [6:35:31<54:06,  3.13it/s]
 97%|█████████▋| 361323/371472 [6:35:31<50:34,  3.34it/s]
 97%|█████████▋| 361324/371472 [6:35:32<52:44,  3.21it/s]
 97%|█████████▋| 361325/371472 [6:35:32<51:58,  3.25it/s]
 97%|█████████▋| 361326/371472 [6:35:32<53:35,  3.16it/s]
 97%|█████████▋| 361327/371472 [6:35:33<56:43,  2.98it/s]
 97%|█████████▋| 361328/371472 [6:35:33<55:11,  3.06it/s]
 97%|█████████▋| 361329/371472 [6:35:33<53:13,  3.18it/s]
 97%|█████████▋| 361330/371472 [6:35:34<50:23,  3.35it/s]
 97%|█████████▋| 361331/371472 [6:35:34<51:32,  3.28it/s]
 97%|█████████▋| 361332/371472 [6:35:34<50:08,  3.37it/s]
 97%|█████████▋| 361333/371472 [6:35:35<51:25,  3.29it/s]
 97%|█████████▋| 361334/371472 [6:35:35<51:45,  3.26it/s]
 97%|█████████▋| 361335/371472 [6:35:35<53:28,  3.16it/s]
 97%|█████████▋| 361336/371472 [6:35:36<56:32,  2.99it/s]
 97%|█████████▋| 361337/371472 [6:35:36<52:47,  3.20it/s]
 97%|█████████▋| 361338/371472 [6:35:36<53:34,  3.15it/s]
 97%|█████████▋| 361339/371472 [6:35:36<51:42,  3.27it/s]
 97%|█████████▋| 361340/371472 [6:35:37<51:21,  3.29it/s]
                                                         
{'loss': 2.4052, 'learning_rate': 1.2456096877760776e-07, 'epoch': 15.56}

 97%|█████████▋| 361340/371472 [6:35:37<51:21,  3.29it/s]
 97%|█████████▋| 361341/371472 [6:35:37<50:27,  3.35it/s]
 97%|█████████▋| 361342/371472 [6:35:37<48:38,  3.47it/s]
 97%|█████████▋| 361343/371472 [6:35:38<47:17,  3.57it/s]
 97%|█████████▋| 361344/371472 [6:35:38<46:39,  3.62it/s]
 97%|█████████▋| 361345/371472 [6:35:38<45:42,  3.69it/s]
 97%|█████████▋| 361346/371472 [6:35:38<45:42,  3.69it/s]
 97%|█████████▋| 361347/371472 [6:35:39<46:15,  3.65it/s]
 97%|█████████▋| 361348/371472 [6:35:39<47:06,  3.58it/s]
 97%|█████████▋| 361349/371472 [6:35:39<48:27,  3.48it/s]
 97%|█████████▋| 361350/371472 [6:35:40<52:57,  3.19it/s]
 97%|█████████▋| 361351/371472 [6:35:40<49:58,  3.38it/s]
 97%|█████████▋| 361352/371472 [6:35:40<50:49,  3.32it/s]
 97%|█████████▋| 361353/371472 [6:35:40<49:07,  3.43it/s]
 97%|█████████▋| 361354/371472 [6:35:41<47:27,  3.55it/s]
 97%|█████████▋| 361355/371472 [6:35:41<48:03,  3.51it/s]
 97%|█████████▋| 361356/371472 [6:35:41<46:41,  3.61it/s]
 97%|█████████▋| 361357/371472 [6:35:42<46:10,  3.65it/s]
 97%|█████████▋| 361358/371472 [6:35:42<50:06,  3.36it/s]
 97%|█████████▋| 361359/371472 [6:35:42<50:29,  3.34it/s]
 97%|█████████▋| 361360/371472 [6:35:43<50:15,  3.35it/s]
                                                         
{'loss': 2.5579, 'learning_rate': 1.245124868021289e-07, 'epoch': 15.56}

 97%|█████████▋| 361360/371472 [6:35:43<50:15,  3.35it/s]
 97%|█████████▋| 361361/371472 [6:35:43<50:27,  3.34it/s]
 97%|█████████▋| 361362/371472 [6:35:43<52:01,  3.24it/s]
 97%|█████████▋| 361363/371472 [6:35:43<50:11,  3.36it/s]
 97%|█████████▋| 361364/371472 [6:35:44<48:39,  3.46it/s]
 97%|█████████▋| 361365/371472 [6:35:44<48:35,  3.47it/s]
 97%|█████████▋| 361366/371472 [6:35:44<48:48,  3.45it/s]
 97%|█████████▋| 361367/371472 [6:35:45<47:14,  3.57it/s]
 97%|█████████▋| 361368/371472 [6:35:45<46:42,  3.60it/s]
 97%|█████████▋| 361369/371472 [6:35:45<46:07,  3.65it/s]
 97%|█████████▋| 361370/371472 [6:35:45<49:56,  3.37it/s]
 97%|█████████▋| 361371/371472 [6:35:46<50:08,  3.36it/s]
 97%|█████████▋| 361372/371472 [6:35:46<48:16,  3.49it/s]
 97%|█████████▋| 361373/371472 [6:35:46<49:15,  3.42it/s]
 97%|█████████▋| 361374/371472 [6:35:47<50:40,  3.32it/s]
 97%|█████████▋| 361375/371472 [6:35:47<53:50,  3.13it/s]
 97%|█████████▋| 361376/371472 [6:35:47<51:00,  3.30it/s]
 97%|█████████▋| 361377/371472 [6:35:47<49:17,  3.41it/s]
 97%|█████████▋| 361378/371472 [6:35:48<49:20,  3.41it/s]
 97%|█████████▋| 361379/371472 [6:35:48<51:19,  3.28it/s]
 97%|█████████▋| 361380/371472 [6:35:48<52:19,  3.21it/s]
                                                         
{'loss': 2.5738, 'learning_rate': 1.2446400482664996e-07, 'epoch': 15.57}

 97%|█████████▋| 361380/371472 [6:35:48<52:19,  3.21it/s]
 97%|█████████▋| 361381/371472 [6:35:49<50:21,  3.34it/s]
 97%|█████████▋| 361382/371472 [6:35:49<48:36,  3.46it/s]
 97%|█████████▋| 361383/371472 [6:35:49<48:27,  3.47it/s]
 97%|█████████▋| 361384/371472 [6:35:50<50:53,  3.30it/s]
 97%|█████████▋| 361385/371472 [6:35:50<49:52,  3.37it/s]
 97%|█████████▋| 361386/371472 [6:35:50<48:18,  3.48it/s]
 97%|█████████▋| 361387/371472 [6:35:50<51:03,  3.29it/s]
 97%|█████████▋| 361388/371472 [6:35:51<51:54,  3.24it/s]
 97%|█████████▋| 361389/371472 [6:35:51<50:54,  3.30it/s]
 97%|█████████▋| 361390/371472 [6:35:52<56:30,  2.97it/s]
 97%|█████████▋| 361391/371472 [6:35:52<55:17,  3.04it/s]
 97%|█████████▋| 361392/371472 [6:35:52<52:55,  3.17it/s]
 97%|█████████▋| 361393/371472 [6:35:52<52:36,  3.19it/s]
 97%|█████████▋| 361394/371472 [6:35:53<50:03,  3.35it/s]
 97%|█████████▋| 361395/371472 [6:35:53<47:38,  3.53it/s]
 97%|█████████▋| 361396/371472 [6:35:53<45:39,  3.68it/s]
 97%|█████████▋| 361397/371472 [6:35:53<45:25,  3.70it/s]
 97%|█████████▋| 361398/371472 [6:35:54<51:12,  3.28it/s]
 97%|█████████▋| 361399/371472 [6:35:54<51:42,  3.25it/s]
 97%|█████████▋| 361400/371472 [6:35:54<48:56,  3.43it/s]
                                                         
{'loss': 2.612, 'learning_rate': 1.2441552285117113e-07, 'epoch': 15.57}

 97%|█████████▋| 361400/371472 [6:35:54<48:56,  3.43it/s]
 97%|█████████▋| 361401/371472 [6:35:55<51:25,  3.26it/s]
 97%|█████████▋| 361402/371472 [6:35:55<51:27,  3.26it/s]
 97%|█████████▋| 361403/371472 [6:35:55<49:41,  3.38it/s]
 97%|█████████▋| 361404/371472 [6:35:56<48:21,  3.47it/s]
 97%|█████████▋| 361405/371472 [6:35:56<46:18,  3.62it/s]
 97%|█████████▋| 361406/371472 [6:35:56<45:29,  3.69it/s]
 97%|█████████▋| 361407/371472 [6:35:56<46:07,  3.64it/s]
 97%|█████████▋| 361408/371472 [6:35:57<46:24,  3.61it/s]
 97%|█████████▋| 361409/371472 [6:35:57<45:55,  3.65it/s]
 97%|█████████▋| 361410/371472 [6:35:57<46:12,  3.63it/s]
 97%|█████████▋| 361411/371472 [6:35:58<48:48,  3.44it/s]
 97%|█████████▋| 361412/371472 [6:35:58<46:24,  3.61it/s]
 97%|█████████▋| 361413/371472 [6:35:58<45:39,  3.67it/s]
 97%|█████████▋| 361414/371472 [6:35:58<44:34,  3.76it/s]
 97%|█████████▋| 361415/371472 [6:35:59<45:57,  3.65it/s]
 97%|█████████▋| 361416/371472 [6:35:59<46:00,  3.64it/s]
 97%|█████████▋| 361417/371472 [6:35:59<46:23,  3.61it/s]
 97%|█████████▋| 361418/371472 [6:35:59<44:39,  3.75it/s]
 97%|█████████▋| 361419/371472 [6:36:00<47:28,  3.53it/s]
 97%|█████████▋| 361420/371472 [6:36:00<45:17,  3.70it/s]
                                                         
{'loss': 2.4066, 'learning_rate': 1.2436704087569218e-07, 'epoch': 15.57}

 97%|█████████▋| 361420/371472 [6:36:00<45:17,  3.70it/s]
 97%|█████████▋| 361421/371472 [6:36:00<48:08,  3.48it/s]
 97%|█████████▋| 361422/371472 [6:36:01<47:46,  3.51it/s]
 97%|█████████▋| 361423/371472 [6:36:01<46:23,  3.61it/s]
 97%|█████████▋| 361424/371472 [6:36:01<46:54,  3.57it/s]
 97%|█████████▋| 361425/371472 [6:36:01<47:46,  3.51it/s]
 97%|█████████▋| 361426/371472 [6:36:02<47:32,  3.52it/s]
 97%|█████████▋| 361427/371472 [6:36:02<49:14,  3.40it/s]
 97%|█████████▋| 361428/371472 [6:36:02<47:17,  3.54it/s]
 97%|█████████▋| 361429/371472 [6:36:03<46:15,  3.62it/s]
 97%|█████████▋| 361430/371472 [6:36:03<46:35,  3.59it/s]
 97%|█████████▋| 361431/371472 [6:36:03<50:39,  3.30it/s]
 97%|█████████▋| 361432/371472 [6:36:03<49:01,  3.41it/s]
 97%|█████████▋| 361433/371472 [6:36:04<47:50,  3.50it/s]
 97%|█████████▋| 361434/371472 [6:36:04<46:26,  3.60it/s]
 97%|█████████▋| 361435/371472 [6:36:04<45:17,  3.69it/s]
 97%|█████████▋| 361436/371472 [6:36:05<46:43,  3.58it/s]
 97%|█████████▋| 361437/371472 [6:36:05<45:41,  3.66it/s]
 97%|█████████▋| 361438/371472 [6:36:05<44:08,  3.79it/s]
 97%|█████████▋| 361439/371472 [6:36:05<43:28,  3.85it/s]
 97%|█████████▋| 361440/371472 [6:36:06<44:32,  3.75it/s]
                                                         
{'loss': 2.65, 'learning_rate': 1.2431855890021333e-07, 'epoch': 15.57}

 97%|█████████▋| 361440/371472 [6:36:06<44:32,  3.75it/s]
 97%|█████████▋| 361441/371472 [6:36:06<45:19,  3.69it/s]
 97%|█████████▋| 361442/371472 [6:36:06<44:52,  3.72it/s]
 97%|█████████▋| 361443/371472 [6:36:06<45:41,  3.66it/s]
 97%|█████████▋| 361444/371472 [6:36:07<47:16,  3.54it/s]
 97%|█████████▋| 361445/371472 [6:36:07<45:21,  3.68it/s]
 97%|█████████▋| 361446/371472 [6:36:07<46:00,  3.63it/s]
 97%|█████████▋| 361447/371472 [6:36:07<46:18,  3.61it/s]
 97%|█████████▋| 361448/371472 [6:36:08<45:32,  3.67it/s]
 97%|█████████▋| 361449/371472 [6:36:08<44:18,  3.77it/s]
 97%|█████████▋| 361450/371472 [6:36:08<46:42,  3.58it/s]
 97%|█████████▋| 361451/371472 [6:36:09<47:51,  3.49it/s]
 97%|█████████▋| 361452/371472 [6:36:09<50:11,  3.33it/s]
 97%|█████████▋| 361453/371472 [6:36:09<50:46,  3.29it/s]
 97%|█████████▋| 361454/371472 [6:36:09<47:48,  3.49it/s]
 97%|█████████▋| 361455/371472 [6:36:10<46:53,  3.56it/s]
 97%|█████████▋| 361456/371472 [6:36:10<46:45,  3.57it/s]
 97%|█████████▋| 361457/371472 [6:36:10<47:27,  3.52it/s]
 97%|█████████▋| 361458/371472 [6:36:11<46:14,  3.61it/s]
 97%|█████████▋| 361459/371472 [6:36:11<46:03,  3.62it/s]
 97%|█████████▋| 361460/371472 [6:36:11<45:34,  3.66it/s]
                                                         
{'loss': 2.5046, 'learning_rate': 1.242700769247344e-07, 'epoch': 15.57}

 97%|█████████▋| 361460/371472 [6:36:11<45:34,  3.66it/s]
 97%|█████████▋| 361461/371472 [6:36:11<44:59,  3.71it/s]
 97%|█████████▋| 361462/371472 [6:36:12<45:12,  3.69it/s]
 97%|█████████▋| 361463/371472 [6:36:12<44:37,  3.74it/s]
 97%|█████████▋| 361464/371472 [6:36:12<45:06,  3.70it/s]
 97%|█████████▋| 361465/371472 [6:36:12<44:41,  3.73it/s]
 97%|█████████▋| 361466/371472 [6:36:13<45:19,  3.68it/s]
 97%|█████████▋| 361467/371472 [6:36:13<45:40,  3.65it/s]
 97%|█████████▋| 361468/371472 [6:36:13<45:58,  3.63it/s]
 97%|█████████▋| 361469/371472 [6:36:14<48:38,  3.43it/s]
 97%|█████████▋| 361470/371472 [6:36:14<47:46,  3.49it/s]
 97%|█████████▋| 361471/371472 [6:36:14<47:32,  3.51it/s]
 97%|█████████▋| 361472/371472 [6:36:14<47:07,  3.54it/s]
 97%|█████████▋| 361473/371472 [6:36:15<48:23,  3.44it/s]
 97%|█████████▋| 361474/371472 [6:36:15<49:23,  3.37it/s]
 97%|█████████▋| 361475/371472 [6:36:15<48:28,  3.44it/s]
 97%|█████████▋| 361476/371472 [6:36:16<50:22,  3.31it/s]
 97%|█████████▋| 361477/371472 [6:36:16<50:49,  3.28it/s]
 97%|█████████▋| 361478/371472 [6:36:16<49:30,  3.36it/s]
 97%|█████████▋| 361479/371472 [6:36:17<47:18,  3.52it/s]
 97%|█████████▋| 361480/371472 [6:36:17<48:04,  3.46it/s]
                                                         
{'loss': 2.7726, 'learning_rate': 1.2422159494925555e-07, 'epoch': 15.57}

 97%|█████████▋| 361480/371472 [6:36:17<48:04,  3.46it/s]
 97%|█████████▋| 361481/371472 [6:36:17<48:43,  3.42it/s]
 97%|█████████▋| 361482/371472 [6:36:17<47:41,  3.49it/s]
 97%|█████████▋| 361483/371472 [6:36:18<46:32,  3.58it/s]
 97%|█████████▋| 361484/371472 [6:36:18<47:35,  3.50it/s]
 97%|█████████▋| 361485/371472 [6:36:18<46:56,  3.55it/s]
 97%|█████████▋| 361486/371472 [6:36:19<46:41,  3.56it/s]
 97%|█████████▋| 361487/371472 [6:36:19<51:35,  3.23it/s]
 97%|█████████▋| 361488/371472 [6:36:19<55:02,  3.02it/s]
 97%|█████████▋| 361489/371472 [6:36:20<50:15,  3.31it/s]
 97%|█████████▋| 361490/371472 [6:36:20<51:52,  3.21it/s]
 97%|█████████▋| 361491/371472 [6:36:20<52:35,  3.16it/s]
 97%|█████████▋| 361492/371472 [6:36:20<50:48,  3.27it/s]
 97%|█████████▋| 361493/371472 [6:36:21<56:09,  2.96it/s]
 97%|█████████▋| 361494/371472 [6:36:21<1:01:40,  2.70it/s]
 97%|█████████▋| 361495/371472 [6:36:22<55:37,  2.99it/s]  
 97%|█████████▋| 361496/371472 [6:36:22<52:15,  3.18it/s]
 97%|█████████▋| 361497/371472 [6:36:22<51:36,  3.22it/s]
 97%|█████████▋| 361498/371472 [6:36:22<50:14,  3.31it/s]
 97%|█████████▋| 361499/371472 [6:36:23<47:37,  3.49it/s]
 97%|█████████▋| 361500/371472 [6:36:23<46:38,  3.56it/s]
                                                         
{'loss': 2.5325, 'learning_rate': 1.2417311297377662e-07, 'epoch': 15.57}

 97%|█████████▋| 361500/371472 [6:36:23<46:38,  3.56it/s]
 97%|█████████▋| 361501/371472 [6:36:23<52:03,  3.19it/s]
 97%|█████████▋| 361502/371472 [6:36:24<50:46,  3.27it/s]
 97%|█████████▋| 361503/371472 [6:36:24<49:44,  3.34it/s]
 97%|█████████▋| 361504/371472 [6:36:24<54:17,  3.06it/s]
 97%|█████████▋| 361505/371472 [6:36:25<54:51,  3.03it/s]
 97%|█████████▋| 361506/371472 [6:36:25<52:19,  3.17it/s]
 97%|█████████▋| 361507/371472 [6:36:25<50:15,  3.30it/s]
 97%|█████████▋| 361508/371472 [6:36:25<49:45,  3.34it/s]
 97%|█████████▋| 361509/371472 [6:36:26<51:08,  3.25it/s]
 97%|█████████▋| 361510/371472 [6:36:26<49:59,  3.32it/s]
 97%|█████████▋| 361511/371472 [6:36:26<51:23,  3.23it/s]
 97%|█████████▋| 361512/371472 [6:36:27<50:21,  3.30it/s]
 97%|█████████▋| 361513/371472 [6:36:27<50:04,  3.32it/s]
 97%|█████████▋| 361514/371472 [6:36:27<51:11,  3.24it/s]
 97%|█████████▋| 361515/371472 [6:36:28<49:48,  3.33it/s]
 97%|█████████▋| 361516/371472 [6:36:28<47:44,  3.48it/s]
 97%|█████████▋| 361517/371472 [6:36:28<45:47,  3.62it/s]
 97%|█████████▋| 361518/371472 [6:36:28<45:23,  3.66it/s]
 97%|█████████▋| 361519/371472 [6:36:29<45:09,  3.67it/s]
 97%|█████████▋| 361520/371472 [6:36:29<44:43,  3.71it/s]
                                                         
{'loss': 2.6197, 'learning_rate': 1.2412463099829777e-07, 'epoch': 15.57}

 97%|█████████▋| 361520/371472 [6:36:29<44:43,  3.71it/s]
 97%|█████████▋| 361521/371472 [6:36:29<44:51,  3.70it/s]
 97%|█████████▋| 361522/371472 [6:36:30<49:02,  3.38it/s]
 97%|█████████▋| 361523/371472 [6:36:30<47:00,  3.53it/s]
 97%|█████████▋| 361524/371472 [6:36:30<45:46,  3.62it/s]
 97%|█████████▋| 361525/371472 [6:36:30<45:16,  3.66it/s]
 97%|█████████▋| 361526/371472 [6:36:31<44:18,  3.74it/s]
 97%|█████████▋| 361527/371472 [6:36:31<45:10,  3.67it/s]
 97%|█████████▋| 361528/371472 [6:36:31<44:22,  3.74it/s]
 97%|█████████▋| 361529/371472 [6:36:31<45:51,  3.61it/s]
 97%|█████████▋| 361530/371472 [6:36:32<45:17,  3.66it/s]
 97%|█████████▋| 361531/371472 [6:36:32<45:06,  3.67it/s]
 97%|█████████▋| 361532/371472 [6:36:32<44:41,  3.71it/s]
 97%|█████████▋| 361533/371472 [6:36:32<43:40,  3.79it/s]
 97%|█████████▋| 361534/371472 [6:36:33<43:14,  3.83it/s]
 97%|█████████▋| 361535/371472 [6:36:33<45:09,  3.67it/s]
 97%|█████████▋| 361536/371472 [6:36:33<44:43,  3.70it/s]
 97%|█████████▋| 361537/371472 [6:36:34<45:42,  3.62it/s]
 97%|█████████▋| 361538/371472 [6:36:34<43:42,  3.79it/s]
 97%|█████████▋| 361539/371472 [6:36:34<44:05,  3.75it/s]
 97%|█████████▋| 361540/371472 [6:36:34<43:12,  3.83it/s]
                                                         
{'loss': 2.7923, 'learning_rate': 1.2407614902281885e-07, 'epoch': 15.57}

 97%|█████████▋| 361540/371472 [6:36:34<43:12,  3.83it/s]
 97%|█████████▋| 361541/371472 [6:36:35<43:16,  3.82it/s]
 97%|█████████▋| 361542/371472 [6:36:35<45:46,  3.61it/s]
 97%|█████████▋| 361543/371472 [6:36:35<46:41,  3.54it/s]
 97%|█████████▋| 361544/371472 [6:36:36<47:11,  3.51it/s]
 97%|█████████▋| 361545/371472 [6:36:36<45:28,  3.64it/s]
 97%|█████████▋| 361546/371472 [6:36:36<46:51,  3.53it/s]
 97%|█████████▋| 361547/371472 [6:36:36<46:16,  3.57it/s]
 97%|█████████▋| 361548/371472 [6:36:37<46:24,  3.56it/s]
 97%|█████████▋| 361549/371472 [6:36:37<44:45,  3.70it/s]
 97%|█████████▋| 361550/371472 [6:36:37<48:06,  3.44it/s]
 97%|█████████▋| 361551/371472 [6:36:37<47:13,  3.50it/s]
 97%|█████████▋| 361552/371472 [6:36:38<45:34,  3.63it/s]
 97%|█████████▋| 361553/371472 [6:36:38<44:57,  3.68it/s]
 97%|█████████▋| 361554/371472 [6:36:38<48:47,  3.39it/s]
 97%|█████████▋| 361555/371472 [6:36:39<48:01,  3.44it/s]
 97%|█████████▋| 361556/371472 [6:36:39<48:00,  3.44it/s]
 97%|█████████▋| 361557/371472 [6:36:39<48:03,  3.44it/s]
 97%|█████████▋| 361558/371472 [6:36:39<45:47,  3.61it/s]
 97%|█████████▋| 361559/371472 [6:36:40<44:33,  3.71it/s]
 97%|█████████▋| 361560/371472 [6:36:40<43:35,  3.79it/s]
                                                         
{'loss': 2.6133, 'learning_rate': 1.2402766704734e-07, 'epoch': 15.57}

 97%|█████████▋| 361560/371472 [6:36:40<43:35,  3.79it/s]
 97%|█████████▋| 361561/371472 [6:36:40<43:40,  3.78it/s]
 97%|█████████▋| 361562/371472 [6:36:40<43:39,  3.78it/s]
 97%|█████████▋| 361563/371472 [6:36:41<46:33,  3.55it/s]
 97%|█████████▋| 361564/371472 [6:36:41<47:25,  3.48it/s]
 97%|█████████▋| 361565/371472 [6:36:41<45:36,  3.62it/s]
 97%|█████████▋| 361566/371472 [6:36:42<44:53,  3.68it/s]
 97%|█████████▋| 361567/371472 [6:36:42<49:27,  3.34it/s]
 97%|█████████▋| 361568/371472 [6:36:42<46:35,  3.54it/s]
 97%|█████████▋| 361569/371472 [6:36:42<44:28,  3.71it/s]
 97%|█████████▋| 361570/371472 [6:36:43<48:32,  3.40it/s]
 97%|█████████▋| 361571/371472 [6:36:43<46:57,  3.51it/s]
 97%|█████████▋| 361572/371472 [6:36:43<45:10,  3.65it/s]
 97%|█████████▋| 361573/371472 [6:36:44<44:12,  3.73it/s]
 97%|█████████▋| 361574/371472 [6:36:44<42:45,  3.86it/s]
 97%|█████████▋| 361575/371472 [6:36:44<42:15,  3.90it/s]
 97%|█████████▋| 361576/371472 [6:36:44<44:11,  3.73it/s]
 97%|█████████▋| 361577/371472 [6:36:45<44:18,  3.72it/s]
 97%|█████████▋| 361578/371472 [6:36:45<43:57,  3.75it/s]
 97%|█████████▋| 361579/371472 [6:36:45<43:47,  3.77it/s]
 97%|█████████▋| 361580/371472 [6:36:46<50:45,  3.25it/s]
                                                         
{'loss': 2.674, 'learning_rate': 1.2397918507186104e-07, 'epoch': 15.57}

 97%|█████████▋| 361580/371472 [6:36:46<50:45,  3.25it/s]
 97%|█████████▋| 361581/371472 [6:36:46<49:06,  3.36it/s]
 97%|█████████▋| 361582/371472 [6:36:46<53:50,  3.06it/s]
 97%|█████████▋| 361583/371472 [6:36:47<51:25,  3.21it/s]
 97%|█████████▋| 361584/371472 [6:36:47<49:23,  3.34it/s]
 97%|█████████▋| 361585/371472 [6:36:47<47:30,  3.47it/s]
 97%|█████████▋| 361586/371472 [6:36:47<48:57,  3.37it/s]
 97%|█████████▋| 361587/371472 [6:36:48<47:47,  3.45it/s]
 97%|█████████▋| 361588/371472 [6:36:48<46:37,  3.53it/s]
 97%|█████████▋| 361589/371472 [6:36:48<45:26,  3.63it/s]
 97%|█████████▋| 361590/371472 [6:36:48<45:41,  3.60it/s]
 97%|█████████▋| 361591/371472 [6:36:49<44:15,  3.72it/s]
 97%|█████████▋| 361592/371472 [6:36:49<44:28,  3.70it/s]
 97%|█████████▋| 361593/371472 [6:36:49<44:30,  3.70it/s]
 97%|█████████▋| 361594/371472 [6:36:49<43:54,  3.75it/s]
 97%|█████████▋| 361595/371472 [6:36:50<43:34,  3.78it/s]
 97%|█████████▋| 361596/371472 [6:36:50<42:38,  3.86it/s]
 97%|█████████▋| 361597/371472 [6:36:50<42:55,  3.83it/s]
 97%|█████████▋| 361598/371472 [6:36:51<43:53,  3.75it/s]
 97%|█████████▋| 361599/371472 [6:36:51<43:47,  3.76it/s]
 97%|█████████▋| 361600/371472 [6:36:51<43:32,  3.78it/s]
                                                         
{'loss': 2.6656, 'learning_rate': 1.2393070309638222e-07, 'epoch': 15.57}

 97%|█████████▋| 361600/371472 [6:36:51<43:32,  3.78it/s]
 97%|█████████▋| 361601/371472 [6:36:51<42:28,  3.87it/s]
 97%|█████████▋| 361602/371472 [6:36:52<43:42,  3.76it/s]
 97%|█████████▋| 361603/371472 [6:36:52<45:50,  3.59it/s]
 97%|█████████▋| 361604/371472 [6:36:52<48:15,  3.41it/s]
 97%|█████████▋| 361605/371472 [6:36:53<52:22,  3.14it/s]
 97%|█████████▋| 361606/371472 [6:36:53<48:07,  3.42it/s]
 97%|█████████▋| 361607/371472 [6:36:53<46:27,  3.54it/s]
 97%|█████████▋| 361608/371472 [6:36:53<45:35,  3.61it/s]
 97%|█████████▋| 361609/371472 [6:36:54<44:47,  3.67it/s]
 97%|█████████▋| 361610/371472 [6:36:54<43:38,  3.77it/s]
 97%|█████████▋| 361611/371472 [6:36:54<43:05,  3.81it/s]
 97%|█████████▋| 361612/371472 [6:36:54<43:19,  3.79it/s]
 97%|█████████▋| 361613/371472 [6:36:55<45:19,  3.62it/s]
 97%|█████████▋| 361614/371472 [6:36:55<49:48,  3.30it/s]
 97%|█████████▋| 361615/371472 [6:36:55<47:00,  3.49it/s]
 97%|█████████▋| 361616/371472 [6:36:56<46:54,  3.50it/s]
 97%|█████████▋| 361617/371472 [6:36:56<49:02,  3.35it/s]
 97%|█████████▋| 361618/371472 [6:36:56<47:03,  3.49it/s]
 97%|█████████▋| 361619/371472 [6:36:56<45:27,  3.61it/s]
 97%|█████████▋| 361620/371472 [6:36:57<47:16,  3.47it/s]
                                                         
{'loss': 2.5405, 'learning_rate': 1.2388222112090326e-07, 'epoch': 15.58}

 97%|█████████▋| 361620/371472 [6:36:57<47:16,  3.47it/s]
 97%|█████████▋| 361621/371472 [6:36:57<48:43,  3.37it/s]
 97%|█████████▋| 361622/371472 [6:36:57<46:41,  3.52it/s]
 97%|█████████▋| 361623/371472 [6:36:58<46:51,  3.50it/s]
 97%|█████████▋| 361624/371472 [6:36:58<46:10,  3.55it/s]
 97%|█████████▋| 361625/371472 [6:36:58<45:27,  3.61it/s]
 97%|█████████▋| 361626/371472 [6:36:58<44:48,  3.66it/s]
 97%|█████████▋| 361627/371472 [6:36:59<43:41,  3.76it/s]
 97%|█████████▋| 361628/371472 [6:36:59<44:01,  3.73it/s]
 97%|█████████▋| 361629/371472 [6:36:59<45:21,  3.62it/s]
 97%|█████████▋| 361630/371472 [6:36:59<44:50,  3.66it/s]
 97%|█████████▋| 361631/371472 [6:37:00<47:06,  3.48it/s]
 97%|█████████▋| 361632/371472 [6:37:00<49:45,  3.30it/s]
 97%|█████████▋| 361633/371472 [6:37:00<47:26,  3.46it/s]
 97%|█████████▋| 361634/371472 [6:37:01<45:28,  3.61it/s]
 97%|█████████▋| 361635/371472 [6:37:01<45:24,  3.61it/s]
 97%|█████████▋| 361636/371472 [6:37:01<44:50,  3.66it/s]
 97%|█████████▋| 361637/371472 [6:37:01<44:18,  3.70it/s]
 97%|█████████▋| 361638/371472 [6:37:02<43:18,  3.78it/s]
 97%|█████████▋| 361639/371472 [6:37:02<47:17,  3.47it/s]
 97%|█████████▋| 361640/371472 [6:37:02<46:55,  3.49it/s]
                                                         
{'loss': 2.55, 'learning_rate': 1.2383373914542442e-07, 'epoch': 15.58}

 97%|█████████▋| 361640/371472 [6:37:02<46:55,  3.49it/s]
 97%|█████████▋| 361641/371472 [6:37:03<47:25,  3.46it/s]
 97%|█████████▋| 361642/371472 [6:37:03<48:39,  3.37it/s]
 97%|█████████▋| 361643/371472 [6:37:03<47:38,  3.44it/s]
 97%|█████████▋| 361644/371472 [6:37:03<45:23,  3.61it/s]
 97%|█████████▋| 361645/371472 [6:37:04<45:29,  3.60it/s]
 97%|█████████▋| 361646/371472 [6:37:04<45:06,  3.63it/s]
 97%|█████████▋| 361647/371472 [6:37:04<44:59,  3.64it/s]
 97%|█████████▋| 361648/371472 [6:37:05<46:11,  3.54it/s]
 97%|█████████▋| 361649/371472 [6:37:05<44:48,  3.65it/s]
 97%|█████████▋| 361650/371472 [6:37:05<45:08,  3.63it/s]
 97%|█████████▋| 361651/371472 [6:37:05<44:39,  3.66it/s]
 97%|█████████▋| 361652/371472 [6:37:06<57:13,  2.86it/s]
 97%|█████████▋| 361653/371472 [6:37:06<53:05,  3.08it/s]
 97%|█████████▋| 361654/371472 [6:37:06<50:34,  3.23it/s]
 97%|█████████▋| 361655/371472 [6:37:07<47:13,  3.47it/s]
 97%|█████████▋| 361656/371472 [6:37:07<45:53,  3.57it/s]
 97%|█████████▋| 361657/371472 [6:37:07<45:18,  3.61it/s]
 97%|█████████▋| 361658/371472 [6:37:08<45:19,  3.61it/s]
 97%|█████████▋| 361659/371472 [6:37:08<46:44,  3.50it/s]
 97%|█████████▋| 361660/371472 [6:37:08<45:22,  3.60it/s]
                                                         
{'loss': 2.5734, 'learning_rate': 1.2378525716994549e-07, 'epoch': 15.58}

 97%|█████████▋| 361660/371472 [6:37:08<45:22,  3.60it/s]
 97%|█████████▋| 361661/371472 [6:37:08<44:37,  3.66it/s]
 97%|█████████▋| 361662/371472 [6:37:09<45:44,  3.57it/s]
 97%|█████████▋| 361663/371472 [6:37:09<45:21,  3.60it/s]
 97%|█████████▋| 361664/371472 [6:37:09<49:51,  3.28it/s]
 97%|█████████▋| 361665/371472 [6:37:10<49:51,  3.28it/s]
 97%|█████████▋| 361666/371472 [6:37:10<48:42,  3.35it/s]
 97%|█████████▋| 361667/371472 [6:37:10<49:25,  3.31it/s]
 97%|█████████▋| 361668/371472 [6:37:11<57:26,  2.84it/s]
 97%|█████████▋| 361669/371472 [6:37:11<52:46,  3.10it/s]
 97%|█████████▋| 361670/371472 [6:37:11<50:02,  3.26it/s]
 97%|█████████▋| 361671/371472 [6:37:11<47:01,  3.47it/s]
 97%|█████████▋| 361672/371472 [6:37:12<46:53,  3.48it/s]
 97%|█████████▋| 361673/371472 [6:37:12<45:23,  3.60it/s]
 97%|█████████▋| 361674/371472 [6:37:12<45:38,  3.58it/s]
 97%|█████████▋| 361675/371472 [6:37:13<45:43,  3.57it/s]
 97%|█████████▋| 361676/371472 [6:37:13<47:35,  3.43it/s]
 97%|█████████▋| 361677/371472 [6:37:13<46:36,  3.50it/s]
 97%|█████████▋| 361678/371472 [6:37:13<46:49,  3.49it/s]
 97%|█████████▋| 361679/371472 [6:37:14<47:45,  3.42it/s]
 97%|█████████▋| 361680/371472 [6:37:14<50:20,  3.24it/s]
                                                         
{'loss': 2.462, 'learning_rate': 1.2373677519446653e-07, 'epoch': 15.58}

 97%|█████████▋| 361680/371472 [6:37:14<50:20,  3.24it/s]
 97%|█████████▋| 361681/371472 [6:37:14<48:49,  3.34it/s]
 97%|█████████▋| 361682/371472 [6:37:15<47:55,  3.40it/s]
 97%|█████████▋| 361683/371472 [6:37:15<45:54,  3.55it/s]
 97%|█████████▋| 361684/371472 [6:37:15<44:54,  3.63it/s]
 97%|█████████▋| 361685/371472 [6:37:15<47:14,  3.45it/s]
 97%|█████████▋| 361686/371472 [6:37:16<48:09,  3.39it/s]
 97%|█████████▋| 361687/371472 [6:37:16<47:02,  3.47it/s]
 97%|█████████▋| 361688/371472 [6:37:16<48:03,  3.39it/s]
 97%|█████████▋| 361689/371472 [6:37:17<45:52,  3.55it/s]
 97%|█████████▋| 361690/371472 [6:37:17<45:17,  3.60it/s]
 97%|█████████▋| 361691/371472 [6:37:17<46:57,  3.47it/s]
 97%|█████████▋| 361692/371472 [6:37:17<44:39,  3.65it/s]
 97%|█████████▋| 361693/371472 [6:37:18<43:22,  3.76it/s]
 97%|█████████▋| 361694/371472 [6:37:18<43:19,  3.76it/s]
 97%|█████████▋| 361695/371472 [6:37:18<42:05,  3.87it/s]
 97%|█████████▋| 361696/371472 [6:37:18<42:26,  3.84it/s]
 97%|█████████▋| 361697/371472 [6:37:19<41:51,  3.89it/s]
 97%|█████████▋| 361698/371472 [6:37:19<43:05,  3.78it/s]
 97%|█████████▋| 361699/371472 [6:37:19<43:04,  3.78it/s]
 97%|█████████▋| 361700/371472 [6:37:20<44:24,  3.67it/s]
                                                         
{'loss': 2.5638, 'learning_rate': 1.2368829321898768e-07, 'epoch': 15.58}

 97%|█████████▋| 361700/371472 [6:37:20<44:24,  3.67it/s]
 97%|█████████▋| 361701/371472 [6:37:20<45:16,  3.60it/s]
 97%|█████████▋| 361702/371472 [6:37:20<43:58,  3.70it/s]
 97%|█████████▋| 361703/371472 [6:37:20<43:51,  3.71it/s]
 97%|█████████▋| 361704/371472 [6:37:21<53:05,  3.07it/s]
 97%|█████████▋| 361705/371472 [6:37:21<54:52,  2.97it/s]
 97%|█████████▋| 361706/371472 [6:37:21<52:11,  3.12it/s]
 97%|█████████▋| 361707/371472 [6:37:22<52:41,  3.09it/s]
 97%|█████████▋| 361708/371472 [6:37:22<47:52,  3.40it/s]
 97%|█████████▋| 361709/371472 [6:37:22<48:44,  3.34it/s]
 97%|█████████▋| 361710/371472 [6:37:23<48:05,  3.38it/s]
 97%|█████████▋| 361711/371472 [6:37:23<46:28,  3.50it/s]
 97%|█████████▋| 361712/371472 [6:37:23<45:46,  3.55it/s]
 97%|█████████▋| 361713/371472 [6:37:23<46:07,  3.53it/s]
 97%|█████████▋| 361714/371472 [6:37:24<45:23,  3.58it/s]
 97%|█████████▋| 361715/371472 [6:37:24<44:23,  3.66it/s]
 97%|█████████▋| 361716/371472 [6:37:24<47:06,  3.45it/s]
 97%|█████████▋| 361717/371472 [6:37:24<44:22,  3.66it/s]
 97%|█████████▋| 361718/371472 [6:37:25<43:01,  3.78it/s]
 97%|█████████▋| 361719/371472 [6:37:25<43:49,  3.71it/s]
 97%|█████████▋| 361720/371472 [6:37:25<45:50,  3.55it/s]
                                                         
{'loss': 2.3672, 'learning_rate': 1.2363981124350875e-07, 'epoch': 15.58}

 97%|█████████▋| 361720/371472 [6:37:25<45:50,  3.55it/s]
 97%|█████████▋| 361721/371472 [6:37:26<51:00,  3.19it/s]
 97%|█████████▋| 361722/371472 [6:37:26<51:11,  3.17it/s]
 97%|█████████▋| 361723/371472 [6:37:26<51:03,  3.18it/s]
 97%|█████████▋| 361724/371472 [6:37:27<50:57,  3.19it/s]
 97%|█████████▋| 361725/371472 [6:37:27<53:45,  3.02it/s]
 97%|█████████▋| 361726/371472 [6:37:27<51:35,  3.15it/s]
 97%|█████████▋| 361727/371472 [6:37:28<51:38,  3.14it/s]
 97%|█████████▋| 361728/371472 [6:37:28<51:37,  3.15it/s]
 97%|█████████▋| 361729/371472 [6:37:28<51:09,  3.17it/s]
 97%|█████████▋| 361730/371472 [6:37:29<51:13,  3.17it/s]
 97%|█████████▋| 361731/371472 [6:37:29<48:55,  3.32it/s]
 97%|█████████▋| 361732/371472 [6:37:29<47:25,  3.42it/s]
 97%|█████████▋| 361733/371472 [6:37:29<47:36,  3.41it/s]
 97%|█████████▋| 361734/371472 [6:37:30<56:46,  2.86it/s]
 97%|█████████▋| 361735/371472 [6:37:30<52:23,  3.10it/s]
 97%|█████████▋| 361736/371472 [6:37:30<50:00,  3.24it/s]
 97%|█████████▋| 361737/371472 [6:37:31<51:14,  3.17it/s]
 97%|█████████▋| 361738/371472 [6:37:31<47:25,  3.42it/s]
 97%|█████████▋| 361739/371472 [6:37:31<46:25,  3.49it/s]
 97%|█████████▋| 361740/371472 [6:37:32<45:03,  3.60it/s]
                                                         
{'loss': 2.526, 'learning_rate': 1.235913292680299e-07, 'epoch': 15.58}

 97%|█████████▋| 361740/371472 [6:37:32<45:03,  3.60it/s]
 97%|█████████▋| 361741/371472 [6:37:32<45:55,  3.53it/s]
 97%|█████████▋| 361742/371472 [6:37:32<46:56,  3.46it/s]
 97%|█████████▋| 361743/371472 [6:37:32<46:43,  3.47it/s]
 97%|█████████▋| 361744/371472 [6:37:33<46:26,  3.49it/s]
 97%|█████████▋| 361745/371472 [6:37:33<44:37,  3.63it/s]
 97%|█████████▋| 361746/371472 [6:37:33<45:50,  3.54it/s]
 97%|█████████▋| 361747/371472 [6:37:34<47:01,  3.45it/s]
 97%|█████████▋| 361748/371472 [6:37:34<45:55,  3.53it/s]
 97%|█████████▋| 361749/371472 [6:37:34<48:50,  3.32it/s]
 97%|█████████▋| 361750/371472 [6:37:34<48:43,  3.33it/s]
 97%|█████████▋| 361751/371472 [6:37:35<48:35,  3.33it/s]
 97%|█████████▋| 361752/371472 [6:37:35<47:05,  3.44it/s]
 97%|█████████▋| 361753/371472 [6:37:35<45:12,  3.58it/s]
 97%|█████████▋| 361754/371472 [6:37:36<44:40,  3.62it/s]
 97%|█████████▋| 361755/371472 [6:37:36<46:43,  3.47it/s]
 97%|█████████▋| 361756/371472 [6:37:36<46:33,  3.48it/s]
 97%|█████████▋| 361757/371472 [6:37:36<48:04,  3.37it/s]
 97%|█████████▋| 361758/371472 [6:37:37<49:40,  3.26it/s]
 97%|█████████▋| 361759/371472 [6:37:37<47:22,  3.42it/s]
 97%|█████████▋| 361760/371472 [6:37:37<51:24,  3.15it/s]
                                                         
{'loss': 2.6794, 'learning_rate': 1.2354284729255098e-07, 'epoch': 15.58}

 97%|█████████▋| 361760/371472 [6:37:37<51:24,  3.15it/s]
 97%|█████████▋| 361761/371472 [6:37:38<53:23,  3.03it/s]
 97%|█████████▋| 361762/371472 [6:37:38<50:13,  3.22it/s]
 97%|█████████▋| 361763/371472 [6:37:38<47:48,  3.39it/s]
 97%|█████████▋| 361764/371472 [6:37:39<48:05,  3.36it/s]
 97%|█████████▋| 361765/371472 [6:37:39<46:30,  3.48it/s]
 97%|█████████▋| 361766/371472 [6:37:39<45:31,  3.55it/s]
 97%|█████████▋| 361767/371472 [6:37:39<45:04,  3.59it/s]
 97%|█████████▋| 361768/371472 [6:37:40<48:03,  3.37it/s]
 97%|█████████▋| 361769/371472 [6:37:40<49:28,  3.27it/s]
 97%|█████████▋| 361770/371472 [6:37:40<47:30,  3.40it/s]
 97%|█████████▋| 361771/371472 [6:37:41<51:02,  3.17it/s]
 97%|█████████▋| 361772/371472 [6:37:41<50:54,  3.18it/s]
 97%|█████████▋| 361773/371472 [6:37:41<49:00,  3.30it/s]
 97%|█████████▋| 361774/371472 [6:37:42<47:36,  3.39it/s]
 97%|█████████▋| 361775/371472 [6:37:42<45:50,  3.53it/s]
 97%|█████████▋| 361776/371472 [6:37:42<47:19,  3.41it/s]
 97%|█████████▋| 361777/371472 [6:37:42<45:59,  3.51it/s]
 97%|█████████▋| 361778/371472 [6:37:43<45:16,  3.57it/s]
 97%|█████████▋| 361779/371472 [6:37:43<48:56,  3.30it/s]
 97%|█████████▋| 361780/371472 [6:37:43<49:40,  3.25it/s]
                                                         
{'loss': 2.5369, 'learning_rate': 1.2349436531707213e-07, 'epoch': 15.58}

 97%|█████████▋| 361780/371472 [6:37:43<49:40,  3.25it/s]
 97%|█████████▋| 361781/371472 [6:37:44<47:00,  3.44it/s]
 97%|█████████▋| 361782/371472 [6:37:44<45:29,  3.55it/s]
 97%|█████████▋| 361783/371472 [6:37:44<47:48,  3.38it/s]
 97%|█████████▋| 361784/371472 [6:37:44<46:05,  3.50it/s]
 97%|█████████▋| 361785/371472 [6:37:45<47:24,  3.41it/s]
 97%|█████████▋| 361786/371472 [6:37:45<46:11,  3.49it/s]
 97%|█████████▋| 361787/371472 [6:37:45<48:31,  3.33it/s]
 97%|█████████▋| 361788/371472 [6:37:46<47:04,  3.43it/s]
 97%|█████████▋| 361789/371472 [6:37:46<50:49,  3.17it/s]
 97%|█████████▋| 361790/371472 [6:37:46<50:25,  3.20it/s]
 97%|█████████▋| 361791/371472 [6:37:47<50:35,  3.19it/s]
 97%|█████████▋| 361792/371472 [6:37:47<50:41,  3.18it/s]
 97%|█████████▋| 361793/371472 [6:37:47<53:43,  3.00it/s]
 97%|█████████▋| 361794/371472 [6:37:48<50:23,  3.20it/s]
 97%|█████████▋| 361795/371472 [6:37:48<52:01,  3.10it/s]
 97%|█████████▋| 361796/371472 [6:37:48<49:24,  3.26it/s]
 97%|█████████▋| 361797/371472 [6:37:48<47:01,  3.43it/s]
 97%|█████████▋| 361798/371472 [6:37:49<46:34,  3.46it/s]
 97%|█████████▋| 361799/371472 [6:37:49<46:48,  3.44it/s]
 97%|█████████▋| 361800/371472 [6:37:49<47:41,  3.38it/s]
                                                         
{'loss': 2.4671, 'learning_rate': 1.2344588334159317e-07, 'epoch': 15.58}

 97%|█████████▋| 361800/371472 [6:37:49<47:41,  3.38it/s]
 97%|█████████▋| 361801/371472 [6:37:50<47:43,  3.38it/s]
 97%|█████████▋| 361802/371472 [6:37:50<47:10,  3.42it/s]
 97%|█████████▋| 361803/371472 [6:37:50<45:25,  3.55it/s]
 97%|█████████▋| 361804/371472 [6:37:51<50:30,  3.19it/s]
 97%|█████████▋| 361805/371472 [6:37:51<50:42,  3.18it/s]
 97%|█████████▋| 361806/371472 [6:37:51<49:07,  3.28it/s]
 97%|█████████▋| 361807/371472 [6:37:51<47:53,  3.36it/s]
 97%|█████████▋| 361808/371472 [6:37:52<47:31,  3.39it/s]
 97%|█████████▋| 361809/371472 [6:37:52<45:37,  3.53it/s]
 97%|█████████▋| 361810/371472 [6:37:52<46:51,  3.44it/s]
 97%|█████████▋| 361811/371472 [6:37:53<47:01,  3.42it/s]
 97%|█████████▋| 361812/371472 [6:37:53<48:12,  3.34it/s]
 97%|█████████▋| 361813/371472 [6:37:53<47:57,  3.36it/s]
 97%|█████████▋| 361814/371472 [6:37:54<47:48,  3.37it/s]
 97%|█████████▋| 361815/371472 [6:37:54<49:38,  3.24it/s]
 97%|█████████▋| 361816/371472 [6:37:54<48:21,  3.33it/s]
 97%|█████████▋| 361817/371472 [6:37:54<46:48,  3.44it/s]
 97%|█████████▋| 361818/371472 [6:37:55<45:42,  3.52it/s]
 97%|█████████▋| 361819/371472 [6:37:55<47:15,  3.40it/s]
 97%|█████████▋| 361820/371472 [6:37:55<45:16,  3.55it/s]
                                                         
{'loss': 2.4805, 'learning_rate': 1.2339740136611435e-07, 'epoch': 15.58}

 97%|█████████▋| 361820/371472 [6:37:55<45:16,  3.55it/s]
 97%|█████████▋| 361821/371472 [6:37:56<45:02,  3.57it/s]
 97%|█████████▋| 361822/371472 [6:37:56<44:27,  3.62it/s]
 97%|█████████▋| 361823/371472 [6:37:56<44:00,  3.65it/s]
 97%|█████████▋| 361824/371472 [6:37:56<47:54,  3.36it/s]
 97%|█████████▋| 361825/371472 [6:37:57<59:29,  2.70it/s]
 97%|█████████▋| 361826/371472 [6:37:57<58:28,  2.75it/s]
 97%|█████████▋| 361827/371472 [6:37:58<55:00,  2.92it/s]
 97%|█████████▋| 361828/371472 [6:37:58<53:28,  3.01it/s]
 97%|█████████▋| 361829/371472 [6:37:58<51:38,  3.11it/s]
 97%|█████████▋| 361830/371472 [6:37:58<48:17,  3.33it/s]
 97%|█████████▋| 361831/371472 [6:37:59<46:57,  3.42it/s]
 97%|█████████▋| 361832/371472 [6:37:59<49:09,  3.27it/s]
 97%|█████████▋| 361833/371472 [6:37:59<48:58,  3.28it/s]
 97%|█████████▋| 361834/371472 [6:38:00<48:51,  3.29it/s]
 97%|█████████▋| 361835/371472 [6:38:00<46:39,  3.44it/s]
 97%|█████████▋| 361836/371472 [6:38:00<45:33,  3.53it/s]
 97%|█████████▋| 361837/371472 [6:38:00<44:09,  3.64it/s]
 97%|█████████▋| 361838/371472 [6:38:01<43:27,  3.70it/s]
 97%|█████████▋| 361839/371472 [6:38:01<43:47,  3.67it/s]
 97%|█████████▋| 361840/371472 [6:38:01<47:14,  3.40it/s]
                                                         
{'loss': 2.5526, 'learning_rate': 1.233489193906354e-07, 'epoch': 15.59}

 97%|█████████▋| 361840/371472 [6:38:01<47:14,  3.40it/s]
 97%|█████████▋| 361841/371472 [6:38:02<44:51,  3.58it/s]
 97%|█████████▋| 361842/371472 [6:38:02<43:55,  3.65it/s]
 97%|█████████▋| 361843/371472 [6:38:02<45:40,  3.51it/s]
 97%|█████████▋| 361844/371472 [6:38:02<44:34,  3.60it/s]
 97%|█████████▋| 361845/371472 [6:38:03<46:51,  3.42it/s]
 97%|█████████▋| 361846/371472 [6:38:03<47:11,  3.40it/s]
 97%|█████████▋| 361847/371472 [6:38:03<48:37,  3.30it/s]
 97%|█████████▋| 361848/371472 [6:38:04<48:34,  3.30it/s]
 97%|█████████▋| 361849/371472 [6:38:04<46:12,  3.47it/s]
 97%|█████████▋| 361850/371472 [6:38:04<49:31,  3.24it/s]
 97%|█████████▋| 361851/371472 [6:38:05<49:03,  3.27it/s]
 97%|█████████▋| 361852/371472 [6:38:05<46:47,  3.43it/s]
 97%|█████████▋| 361853/371472 [6:38:05<46:54,  3.42it/s]
 97%|█████████▋| 361854/371472 [6:38:05<47:10,  3.40it/s]
 97%|█████████▋| 361855/371472 [6:38:06<45:42,  3.51it/s]
 97%|█████████▋| 361856/371472 [6:38:06<44:34,  3.60it/s]
 97%|█████████▋| 361857/371472 [6:38:06<45:37,  3.51it/s]
 97%|█████████▋| 361858/371472 [6:38:07<45:50,  3.50it/s]
 97%|█████████▋| 361859/371472 [6:38:07<44:26,  3.60it/s]
 97%|█████████▋| 361860/371472 [6:38:07<48:18,  3.32it/s]
                                                         
{'loss': 2.5908, 'learning_rate': 1.2330043741515655e-07, 'epoch': 15.59}

 97%|█████████▋| 361860/371472 [6:38:07<48:18,  3.32it/s]
 97%|█████████▋| 361861/371472 [6:38:07<45:21,  3.53it/s]
 97%|█████████▋| 361862/371472 [6:38:08<44:50,  3.57it/s]
 97%|█████████▋| 361863/371472 [6:38:08<43:36,  3.67it/s]
 97%|█████████▋| 361864/371472 [6:38:08<42:54,  3.73it/s]
 97%|█████████▋| 361865/371472 [6:38:08<43:24,  3.69it/s]
 97%|█████████▋| 361866/371472 [6:38:09<42:51,  3.74it/s]
 97%|█████████▋| 361867/371472 [6:38:09<44:43,  3.58it/s]
 97%|█████████▋| 361868/371472 [6:38:09<44:15,  3.62it/s]
 97%|█████████▋| 361869/371472 [6:38:10<42:45,  3.74it/s]
 97%|█████████▋| 361870/371472 [6:38:10<42:30,  3.76it/s]
 97%|█████████▋| 361871/371472 [6:38:10<44:04,  3.63it/s]
 97%|█████████▋| 361872/371472 [6:38:10<47:43,  3.35it/s]
 97%|█████████▋| 361873/371472 [6:38:11<47:13,  3.39it/s]
 97%|█████████▋| 361874/371472 [6:38:11<46:43,  3.42it/s]
 97%|█████████▋| 361875/371472 [6:38:11<48:37,  3.29it/s]
 97%|█████████▋| 361876/371472 [6:38:12<47:08,  3.39it/s]
 97%|█████████▋| 361877/371472 [6:38:12<48:40,  3.29it/s]
 97%|█████████▋| 361878/371472 [6:38:12<49:11,  3.25it/s]
 97%|█████████▋| 361879/371472 [6:38:13<47:33,  3.36it/s]
 97%|█████████▋| 361880/371472 [6:38:13<51:45,  3.09it/s]
                                                         
{'loss': 2.5348, 'learning_rate': 1.2325195543967762e-07, 'epoch': 15.59}

 97%|█████████▋| 361880/371472 [6:38:13<51:45,  3.09it/s]
 97%|█████████▋| 361881/371472 [6:38:13<49:04,  3.26it/s]
 97%|█████████▋| 361882/371472 [6:38:13<46:53,  3.41it/s]
 97%|█████████▋| 361883/371472 [6:38:14<45:41,  3.50it/s]
 97%|█████████▋| 361884/371472 [6:38:14<46:17,  3.45it/s]
 97%|█████████▋| 361885/371472 [6:38:14<47:56,  3.33it/s]
 97%|█████████▋| 361886/371472 [6:38:15<51:46,  3.09it/s]
 97%|█████████▋| 361887/371472 [6:38:15<48:57,  3.26it/s]
 97%|█████████▋| 361888/371472 [6:38:15<50:22,  3.17it/s]
 97%|█████████▋| 361889/371472 [6:38:16<53:46,  2.97it/s]
 97%|█████████▋| 361890/371472 [6:38:16<51:25,  3.11it/s]
 97%|█████████▋| 361891/371472 [6:38:16<52:31,  3.04it/s]
 97%|█████████▋| 361892/371472 [6:38:17<54:21,  2.94it/s]
 97%|█████████▋| 361893/371472 [6:38:17<52:53,  3.02it/s]
 97%|█████████▋| 361894/371472 [6:38:17<49:33,  3.22it/s]
 97%|█████████▋| 361895/371472 [6:38:18<47:55,  3.33it/s]
 97%|█████████▋| 361896/371472 [6:38:18<46:30,  3.43it/s]
 97%|█████████▋| 361897/371472 [6:38:18<45:35,  3.50it/s]
 97%|█████████▋| 361898/371472 [6:38:18<44:05,  3.62it/s]
 97%|█████████▋| 361899/371472 [6:38:19<43:33,  3.66it/s]
 97%|█████████▋| 361900/371472 [6:38:19<43:21,  3.68it/s]
                                                         
{'loss': 2.6776, 'learning_rate': 1.2320347346419877e-07, 'epoch': 15.59}

 97%|█████████▋| 361900/371472 [6:38:19<43:21,  3.68it/s]
 97%|█████████▋| 361901/371472 [6:38:19<44:32,  3.58it/s]
 97%|█████████▋| 361902/371472 [6:38:19<43:29,  3.67it/s]
 97%|█████████▋| 361903/371472 [6:38:20<45:18,  3.52it/s]
 97%|█████████▋| 361904/371472 [6:38:20<44:39,  3.57it/s]
 97%|█████████▋| 361905/371472 [6:38:20<47:26,  3.36it/s]
 97%|█████████▋| 361906/371472 [6:38:21<46:03,  3.46it/s]
 97%|█████████▋| 361907/371472 [6:38:21<44:55,  3.55it/s]
 97%|█████████▋| 361908/371472 [6:38:21<45:12,  3.53it/s]
 97%|█████████▋| 361909/371472 [6:38:21<45:36,  3.49it/s]
 97%|█████████▋| 361910/371472 [6:38:22<44:08,  3.61it/s]
 97%|█████████▋| 361911/371472 [6:38:22<43:25,  3.67it/s]
 97%|█████████▋| 361912/371472 [6:38:22<42:01,  3.79it/s]
 97%|█████████▋| 361913/371472 [6:38:23<43:14,  3.68it/s]
 97%|█████████▋| 361914/371472 [6:38:23<44:17,  3.60it/s]
 97%|█████████▋| 361915/371472 [6:38:23<42:37,  3.74it/s]
 97%|█████████▋| 361916/371472 [6:38:23<45:32,  3.50it/s]
 97%|█████████▋| 361917/371472 [6:38:24<44:29,  3.58it/s]
 97%|█████████▋| 361918/371472 [6:38:24<46:43,  3.41it/s]
 97%|█████████▋| 361919/371472 [6:38:24<48:16,  3.30it/s]
 97%|█████████▋| 361920/371472 [6:38:25<47:06,  3.38it/s]
                                                         
{'loss': 2.5266, 'learning_rate': 1.2315499148871984e-07, 'epoch': 15.59}

 97%|█████████▋| 361920/371472 [6:38:25<47:06,  3.38it/s]
 97%|█████████▋| 361921/371472 [6:38:25<44:58,  3.54it/s]
 97%|█████████▋| 361922/371472 [6:38:25<45:25,  3.50it/s]
 97%|█████████▋| 361923/371472 [6:38:25<47:10,  3.37it/s]
 97%|█████████▋| 361924/371472 [6:38:26<47:02,  3.38it/s]
 97%|█████████▋| 361925/371472 [6:38:26<46:46,  3.40it/s]
 97%|█████████▋| 361926/371472 [6:38:26<45:37,  3.49it/s]
 97%|█████████▋| 361927/371472 [6:38:27<46:42,  3.41it/s]
 97%|█████████▋| 361928/371472 [6:38:27<45:52,  3.47it/s]
 97%|█████████▋| 361929/371472 [6:38:27<44:42,  3.56it/s]
 97%|█████████▋| 361930/371472 [6:38:27<43:46,  3.63it/s]
 97%|█████████▋| 361931/371472 [6:38:28<45:05,  3.53it/s]
 97%|█████████▋| 361932/371472 [6:38:28<46:08,  3.45it/s]
 97%|█████████▋| 361933/371472 [6:38:28<44:54,  3.54it/s]
 97%|█████████▋| 361934/371472 [6:38:29<43:31,  3.65it/s]
 97%|█████████▋| 361935/371472 [6:38:29<44:10,  3.60it/s]
 97%|█████████▋| 361936/371472 [6:38:29<44:10,  3.60it/s]
 97%|█████████▋| 361937/371472 [6:38:29<42:56,  3.70it/s]
 97%|█████████▋| 361938/371472 [6:38:30<47:03,  3.38it/s]
 97%|█████████▋| 361939/371472 [6:38:30<45:31,  3.49it/s]
 97%|█████████▋| 361940/371472 [6:38:30<46:23,  3.42it/s]
                                                         
{'loss': 2.5518, 'learning_rate': 1.23106509513241e-07, 'epoch': 15.59}

 97%|█████████▋| 361940/371472 [6:38:30<46:23,  3.42it/s]
 97%|█████████▋| 361941/371472 [6:38:31<46:04,  3.45it/s]
 97%|█████████▋| 361942/371472 [6:38:31<50:12,  3.16it/s]
 97%|█████████▋| 361943/371472 [6:38:31<50:48,  3.13it/s]
 97%|█████████▋| 361944/371472 [6:38:32<48:14,  3.29it/s]
 97%|█████████▋| 361945/371472 [6:38:32<52:26,  3.03it/s]
 97%|█████████▋| 361946/371472 [6:38:32<56:06,  2.83it/s]
 97%|█████████▋| 361947/371472 [6:38:33<54:56,  2.89it/s]
 97%|█████████▋| 361948/371472 [6:38:33<50:24,  3.15it/s]
 97%|█████████▋| 361949/371472 [6:38:33<48:48,  3.25it/s]
 97%|█████████▋| 361950/371472 [6:38:33<46:46,  3.39it/s]
 97%|█████████▋| 361951/371472 [6:38:34<46:26,  3.42it/s]
 97%|█████████▋| 361952/371472 [6:38:34<45:23,  3.50it/s]
 97%|█████████▋| 361953/371472 [6:38:34<47:36,  3.33it/s]
 97%|█████████▋| 361954/371472 [6:38:35<48:08,  3.30it/s]
 97%|█████████▋| 361955/371472 [6:38:35<49:55,  3.18it/s]
 97%|█████████▋| 361956/371472 [6:38:35<47:24,  3.35it/s]
 97%|█████████▋| 361957/371472 [6:38:36<46:37,  3.40it/s]
 97%|█████████▋| 361958/371472 [6:38:36<44:11,  3.59it/s]
 97%|█████████▋| 361959/371472 [6:38:36<44:22,  3.57it/s]
 97%|█████████▋| 361960/371472 [6:38:36<46:34,  3.40it/s]
                                                         
{'loss': 2.6189, 'learning_rate': 1.2305802753776204e-07, 'epoch': 15.59}

 97%|█████████▋| 361960/371472 [6:38:36<46:34,  3.40it/s]
 97%|█████████▋| 361961/371472 [6:38:37<48:35,  3.26it/s]
 97%|█████████▋| 361962/371472 [6:38:37<46:26,  3.41it/s]
 97%|█████████▋| 361963/371472 [6:38:37<45:37,  3.47it/s]
 97%|█████████▋| 361964/371472 [6:38:38<47:02,  3.37it/s]
 97%|█████████▋| 361965/371472 [6:38:38<46:39,  3.40it/s]
 97%|█████████▋| 361966/371472 [6:38:38<48:14,  3.28it/s]
 97%|█████████▋| 361967/371472 [6:38:39<57:02,  2.78it/s]
 97%|█████████▋| 361968/371472 [6:38:39<51:48,  3.06it/s]
 97%|█████████▋| 361969/371472 [6:38:39<49:17,  3.21it/s]
 97%|█████████▋| 361970/371472 [6:38:40<46:55,  3.38it/s]
 97%|█████████▋| 361971/371472 [6:38:40<51:06,  3.10it/s]
 97%|█████████▋| 361972/371472 [6:38:40<47:34,  3.33it/s]
 97%|█████████▋| 361973/371472 [6:38:40<45:51,  3.45it/s]
 97%|█████████▋| 361974/371472 [6:38:41<43:11,  3.67it/s]
 97%|█████████▋| 361975/371472 [6:38:41<41:58,  3.77it/s]
 97%|█████████▋| 361976/371472 [6:38:41<43:04,  3.67it/s]
 97%|█████████▋| 361977/371472 [6:38:42<46:23,  3.41it/s]
 97%|█████████▋| 361978/371472 [6:38:42<46:46,  3.38it/s]
 97%|█████████▋| 361979/371472 [6:38:42<47:56,  3.30it/s]
 97%|█████████▋| 361980/371472 [6:38:42<46:18,  3.42it/s]
                                                         
{'loss': 2.5711, 'learning_rate': 1.230095455622832e-07, 'epoch': 15.59}

 97%|█████████▋| 361980/371472 [6:38:42<46:18,  3.42it/s]
 97%|█████████▋| 361981/371472 [6:38:43<44:17,  3.57it/s]
 97%|█████████▋| 361982/371472 [6:38:43<43:19,  3.65it/s]
 97%|█████████▋| 361983/371472 [6:38:43<44:06,  3.59it/s]
 97%|█████████▋| 361984/371472 [6:38:43<44:19,  3.57it/s]
 97%|█████████▋| 361985/371472 [6:38:44<43:12,  3.66it/s]
 97%|█████████▋| 361986/371472 [6:38:44<43:22,  3.65it/s]
 97%|█████████▋| 361987/371472 [6:38:44<44:31,  3.55it/s]
 97%|█████████▋| 361988/371472 [6:38:45<43:39,  3.62it/s]
 97%|█████████▋| 361989/371472 [6:38:45<51:58,  3.04it/s]
 97%|█████████▋| 361990/371472 [6:38:45<47:41,  3.31it/s]
 97%|█████████▋| 361991/371472 [6:38:46<47:02,  3.36it/s]
 97%|█████████▋| 361992/371472 [6:38:46<45:12,  3.49it/s]
 97%|█████████▋| 361993/371472 [6:38:46<45:46,  3.45it/s]
 97%|█████████▋| 361994/371472 [6:38:46<46:37,  3.39it/s]
 97%|█████████▋| 361995/371472 [6:38:47<44:39,  3.54it/s]
 97%|█████████▋| 361996/371472 [6:38:47<46:07,  3.42it/s]
 97%|█████████▋| 361997/371472 [6:38:47<50:27,  3.13it/s]
 97%|█████████▋| 361998/371472 [6:38:48<47:34,  3.32it/s]
 97%|█████████▋| 361999/371472 [6:38:48<44:30,  3.55it/s]
 97%|█████████▋| 362000/371472 [6:38:48<44:07,  3.58it/s]
                                                         
{'loss': 2.5771, 'learning_rate': 1.2296106358680426e-07, 'epoch': 15.59}

 97%|█████████▋| 362000/371472 [6:38:48<44:07,  3.58it/s]
 97%|█████████▋| 362001/371472 [6:38:48<43:06,  3.66it/s]
 97%|█████████▋| 362002/371472 [6:38:49<42:04,  3.75it/s]
 97%|█████████▋| 362003/371472 [6:38:49<41:36,  3.79it/s]
 97%|█████████▋| 362004/371472 [6:38:49<41:44,  3.78it/s]
 97%|█████████▋| 362005/371472 [6:38:49<41:58,  3.76it/s]
 97%|█████████▋| 362006/371472 [6:38:50<41:41,  3.78it/s]
 97%|█████████▋| 362007/371472 [6:38:50<40:55,  3.85it/s]
 97%|█████████▋| 362008/371472 [6:38:50<40:54,  3.86it/s]
 97%|█████████▋| 362009/371472 [6:38:50<40:44,  3.87it/s]
 97%|█████████▋| 362010/371472 [6:38:51<41:00,  3.84it/s]
 97%|█████████▋| 362011/371472 [6:38:51<42:07,  3.74it/s]
 97%|█████████▋| 362012/371472 [6:38:51<42:35,  3.70it/s]
 97%|█████████▋| 362013/371472 [6:38:52<44:18,  3.56it/s]
 97%|█████████▋| 362014/371472 [6:38:52<43:33,  3.62it/s]
 97%|█████████▋| 362015/371472 [6:38:52<41:57,  3.76it/s]
 97%|█████████▋| 362016/371472 [6:38:52<45:47,  3.44it/s]
 97%|█████████▋| 362017/371472 [6:38:53<44:12,  3.57it/s]
 97%|█████████▋| 362018/371472 [6:38:53<43:57,  3.58it/s]
 97%|█████████▋| 362019/371472 [6:38:53<44:52,  3.51it/s]
 97%|█████████▋| 362020/371472 [6:38:54<44:48,  3.52it/s]
                                                         
{'loss': 2.7437, 'learning_rate': 1.229125816113254e-07, 'epoch': 15.59}

 97%|█████████▋| 362020/371472 [6:38:54<44:48,  3.52it/s]
 97%|█████████▋| 362021/371472 [6:38:54<42:48,  3.68it/s]
 97%|█████████▋| 362022/371472 [6:38:54<43:49,  3.59it/s]
 97%|█████████▋| 362023/371472 [6:38:54<44:10,  3.56it/s]
 97%|█████████▋| 362024/371472 [6:38:55<46:34,  3.38it/s]
 97%|█████████▋| 362025/371472 [6:38:55<43:58,  3.58it/s]
 97%|█████████▋| 362026/371472 [6:38:55<43:45,  3.60it/s]
 97%|█████████▋| 362027/371472 [6:38:56<42:38,  3.69it/s]
 97%|█████████▋| 362028/371472 [6:38:56<42:06,  3.74it/s]
 97%|█████████▋| 362029/371472 [6:38:56<41:58,  3.75it/s]
 97%|█████████▋| 362030/371472 [6:38:56<48:30,  3.24it/s]
 97%|█████████▋| 362031/371472 [6:38:57<46:26,  3.39it/s]
 97%|█████████▋| 362032/371472 [6:38:57<48:17,  3.26it/s]
 97%|█████████▋| 362033/371472 [6:38:57<46:23,  3.39it/s]
 97%|█████████▋| 362034/371472 [6:38:58<45:14,  3.48it/s]
 97%|█████████▋| 362035/371472 [6:38:58<43:29,  3.62it/s]
 97%|█████████▋| 362036/371472 [6:38:58<42:37,  3.69it/s]
 97%|█████████▋| 362037/371472 [6:38:58<41:50,  3.76it/s]
 97%|█████████▋| 362038/371472 [6:38:59<40:41,  3.86it/s]
 97%|█████████▋| 362039/371472 [6:38:59<41:36,  3.78it/s]
 97%|█████████▋| 362040/371472 [6:38:59<41:43,  3.77it/s]
                                                         
{'loss': 2.5378, 'learning_rate': 1.2286409963584648e-07, 'epoch': 15.59}

 97%|█████████▋| 362040/371472 [6:38:59<41:43,  3.77it/s]
 97%|█████████▋| 362041/371472 [6:38:59<42:12,  3.72it/s]
 97%|█████████▋| 362042/371472 [6:39:00<41:14,  3.81it/s]
 97%|█████████▋| 362043/371472 [6:39:00<41:31,  3.78it/s]
 97%|█████████▋| 362044/371472 [6:39:00<43:32,  3.61it/s]
 97%|█████████▋| 362045/371472 [6:39:00<43:10,  3.64it/s]
 97%|█████████▋| 362046/371472 [6:39:01<42:09,  3.73it/s]
 97%|█████████▋| 362047/371472 [6:39:01<41:52,  3.75it/s]
 97%|█████████▋| 362048/371472 [6:39:01<42:25,  3.70it/s]
 97%|█████████▋| 362049/371472 [6:39:02<43:07,  3.64it/s]
 97%|█████████▋| 362050/371472 [6:39:02<43:24,  3.62it/s]
 97%|█████████▋| 362051/371472 [6:39:02<44:37,  3.52it/s]
 97%|█████████▋| 362052/371472 [6:39:02<44:47,  3.50it/s]
 97%|█████████▋| 362053/371472 [6:39:03<45:51,  3.42it/s]
 97%|█████████▋| 362054/371472 [6:39:03<44:25,  3.53it/s]
 97%|█████████▋| 362055/371472 [6:39:03<44:38,  3.52it/s]
 97%|█████████▋| 362056/371472 [6:39:04<45:33,  3.44it/s]
 97%|█████████▋| 362057/371472 [6:39:04<43:45,  3.59it/s]
 97%|█████████▋| 362058/371472 [6:39:04<44:52,  3.50it/s]
 97%|█████████▋| 362059/371472 [6:39:04<42:49,  3.66it/s]
 97%|█████████▋| 362060/371472 [6:39:05<40:47,  3.85it/s]
                                                         
{'loss': 2.6151, 'learning_rate': 1.2281561766036763e-07, 'epoch': 15.59}

 97%|█████████▋| 362060/371472 [6:39:05<40:47,  3.85it/s]
 97%|█████████▋| 362061/371472 [6:39:05<43:22,  3.62it/s]
 97%|█████████▋| 362062/371472 [6:39:05<43:03,  3.64it/s]
 97%|█████████▋| 362063/371472 [6:39:06<45:55,  3.41it/s]
 97%|█████████▋| 362064/371472 [6:39:06<45:42,  3.43it/s]
 97%|█████████▋| 362065/371472 [6:39:06<45:42,  3.43it/s]
 97%|█████████▋| 362066/371472 [6:39:06<44:49,  3.50it/s]
 97%|█████████▋| 362067/371472 [6:39:07<44:28,  3.52it/s]
 97%|█████████▋| 362068/371472 [6:39:07<44:41,  3.51it/s]
 97%|█████████▋| 362069/371472 [6:39:07<44:42,  3.51it/s]
 97%|█████████▋| 362070/371472 [6:39:08<46:21,  3.38it/s]
 97%|█████████▋| 362071/371472 [6:39:08<44:18,  3.54it/s]
 97%|█████████▋| 362072/371472 [6:39:08<42:05,  3.72it/s]
 97%|█████████▋| 362073/371472 [6:39:08<44:21,  3.53it/s]
 97%|█████████▋| 362074/371472 [6:39:09<43:05,  3.63it/s]
 97%|█████████▋| 362075/371472 [6:39:09<42:19,  3.70it/s]
 97%|█████████▋| 362076/371472 [6:39:09<41:50,  3.74it/s]
 97%|█████████▋| 362077/371472 [6:39:09<41:13,  3.80it/s]
 97%|█████████▋| 362078/371472 [6:39:10<41:13,  3.80it/s]
 97%|█████████▋| 362079/371472 [6:39:10<41:15,  3.79it/s]
 97%|█████████▋| 362080/371472 [6:39:10<45:54,  3.41it/s]
                                                         
{'loss': 2.5708, 'learning_rate': 1.2276713568488868e-07, 'epoch': 15.6}

 97%|█████████▋| 362080/371472 [6:39:10<45:54,  3.41it/s]
 97%|█████████▋| 362081/371472 [6:39:11<46:58,  3.33it/s]
 97%|█████████▋| 362082/371472 [6:39:11<43:45,  3.58it/s]
 97%|█████████▋| 362083/371472 [6:39:11<42:58,  3.64it/s]
 97%|█████████▋| 362084/371472 [6:39:11<42:56,  3.64it/s]
 97%|█████████▋| 362085/371472 [6:39:12<41:33,  3.76it/s]
 97%|█████████▋| 362086/371472 [6:39:12<40:55,  3.82it/s]
 97%|█████████▋| 362087/371472 [6:39:12<39:26,  3.97it/s]
 97%|█████████▋| 362088/371472 [6:39:12<39:33,  3.95it/s]
 97%|█████████▋| 362089/371472 [6:39:13<39:34,  3.95it/s]
 97%|█████████▋| 362090/371472 [6:39:13<42:03,  3.72it/s]
 97%|█████████▋| 362091/371472 [6:39:13<43:09,  3.62it/s]
 97%|█████████▋| 362092/371472 [6:39:13<41:30,  3.77it/s]
 97%|█████████▋| 362093/371472 [6:39:14<42:59,  3.64it/s]
 97%|█████████▋| 362094/371472 [6:39:14<44:55,  3.48it/s]
 97%|█████████▋| 362095/371472 [6:39:14<47:02,  3.32it/s]
 97%|█████████▋| 362096/371472 [6:39:15<48:25,  3.23it/s]
 97%|█████████▋| 362097/371472 [6:39:15<47:41,  3.28it/s]
 97%|█████████▋| 362098/371472 [6:39:15<46:31,  3.36it/s]
 97%|█████████▋| 362099/371472 [6:39:16<44:50,  3.48it/s]
 97%|█████████▋| 362100/371472 [6:39:16<47:53,  3.26it/s]
                                                         
{'loss': 2.552, 'learning_rate': 1.2271865370940985e-07, 'epoch': 15.6}

 97%|█████████▋| 362100/371472 [6:39:16<47:53,  3.26it/s]
 97%|█████████▋| 362101/371472 [6:39:16<47:10,  3.31it/s]
 97%|█████████▋| 362102/371472 [6:39:16<44:24,  3.52it/s]
 97%|█████████▋| 362103/371472 [6:39:17<43:03,  3.63it/s]
 97%|█████████▋| 362104/371472 [6:39:17<42:05,  3.71it/s]
 97%|█████████▋| 362105/371472 [6:39:17<44:31,  3.51it/s]
 97%|█████████▋| 362106/371472 [6:39:18<45:01,  3.47it/s]
 97%|█████████▋| 362107/371472 [6:39:18<42:29,  3.67it/s]
 97%|█████████▋| 362108/371472 [6:39:18<45:13,  3.45it/s]
 97%|█████████▋| 362109/371472 [6:39:19<49:41,  3.14it/s]
 97%|█████████▋| 362110/371472 [6:39:19<49:09,  3.17it/s]
 97%|█████████▋| 362111/371472 [6:39:19<47:51,  3.26it/s]
 97%|█████████▋| 362112/371472 [6:39:19<46:10,  3.38it/s]
 97%|█████████▋| 362113/371472 [6:39:20<45:03,  3.46it/s]
 97%|█████████▋| 362114/371472 [6:39:20<47:23,  3.29it/s]
 97%|█████████▋| 362115/371472 [6:39:20<45:10,  3.45it/s]
 97%|█████████▋| 362116/371472 [6:39:21<44:29,  3.51it/s]
 97%|█████████▋| 362117/371472 [6:39:21<44:56,  3.47it/s]
 97%|█████████▋| 362118/371472 [6:39:21<43:00,  3.63it/s]
 97%|█████████▋| 362119/371472 [6:39:21<42:19,  3.68it/s]
 97%|█████████▋| 362120/371472 [6:39:22<42:48,  3.64it/s]
                                                         
{'loss': 2.6538, 'learning_rate': 1.226701717339309e-07, 'epoch': 15.6}

 97%|█████████▋| 362120/371472 [6:39:22<42:48,  3.64it/s]
 97%|█████████▋| 362121/371472 [6:39:22<43:52,  3.55it/s]
 97%|█████████▋| 362122/371472 [6:39:22<45:00,  3.46it/s]
 97%|█████████▋| 362123/371472 [6:39:23<50:05,  3.11it/s]
 97%|█████████▋| 362124/371472 [6:39:23<46:00,  3.39it/s]
 97%|█████████▋| 362125/371472 [6:39:23<47:23,  3.29it/s]
 97%|█████████▋| 362126/371472 [6:39:24<49:57,  3.12it/s]
 97%|█████████▋| 362127/371472 [6:39:24<46:07,  3.38it/s]
 97%|█████████▋| 362128/371472 [6:39:24<43:49,  3.55it/s]
 97%|█████████▋| 362129/371472 [6:39:24<44:32,  3.50it/s]
 97%|█████████▋| 362130/371472 [6:39:25<48:30,  3.21it/s]
 97%|█████████▋| 362131/371472 [6:39:25<47:27,  3.28it/s]
 97%|█████████▋| 362132/371472 [6:39:25<44:31,  3.50it/s]
 97%|█████████▋| 362133/371472 [6:39:25<42:49,  3.64it/s]
 97%|█████████▋| 362134/371472 [6:39:26<42:49,  3.63it/s]
 97%|█████████▋| 362135/371472 [6:39:26<41:20,  3.76it/s]
 97%|█████████▋| 362136/371472 [6:39:26<42:24,  3.67it/s]
 97%|█████████▋| 362137/371472 [6:39:27<45:27,  3.42it/s]
 97%|█████████▋| 362138/371472 [6:39:27<44:55,  3.46it/s]
 97%|█████████▋| 362139/371472 [6:39:27<43:22,  3.59it/s]
 97%|█████████▋| 362140/371472 [6:39:27<44:03,  3.53it/s]
                                                         
{'loss': 2.5349, 'learning_rate': 1.2262168975845205e-07, 'epoch': 15.6}

 97%|█████████▋| 362140/371472 [6:39:27<44:03,  3.53it/s]
 97%|█████████▋| 362141/371472 [6:39:28<43:28,  3.58it/s]
 97%|█████████▋| 362142/371472 [6:39:28<43:00,  3.62it/s]
 97%|█████████▋| 362143/371472 [6:39:28<42:31,  3.66it/s]
 97%|█████████▋| 362144/371472 [6:39:29<44:49,  3.47it/s]
 97%|█████████▋| 362145/371472 [6:39:29<47:13,  3.29it/s]
 97%|█████████▋| 362146/371472 [6:39:29<45:59,  3.38it/s]
 97%|█████████▋| 362147/371472 [6:39:29<45:20,  3.43it/s]
 97%|█████████▋| 362148/371472 [6:39:30<44:36,  3.48it/s]
 97%|█████████▋| 362149/371472 [6:39:30<42:52,  3.62it/s]
 97%|█████████▋| 362150/371472 [6:39:30<42:05,  3.69it/s]
 97%|█████████▋| 362151/371472 [6:39:31<42:26,  3.66it/s]
 97%|█████████▋| 362152/371472 [6:39:31<41:31,  3.74it/s]
 97%|█████████▋| 362153/371472 [6:39:31<41:17,  3.76it/s]
 97%|█████████▋| 362154/371472 [6:39:31<41:20,  3.76it/s]
 97%|█████████▋| 362155/371472 [6:39:32<41:30,  3.74it/s]
 97%|█████████▋| 362156/371472 [6:39:32<44:11,  3.51it/s]
 97%|█████████▋| 362157/371472 [6:39:32<43:21,  3.58it/s]
 97%|█████████▋| 362158/371472 [6:39:32<42:31,  3.65it/s]
 97%|█████████▋| 362159/371472 [6:39:33<43:01,  3.61it/s]
 97%|█████████▋| 362160/371472 [6:39:33<41:41,  3.72it/s]
                                                         
{'loss': 2.5672, 'learning_rate': 1.2257320778297312e-07, 'epoch': 15.6}

 97%|█████████▋| 362160/371472 [6:39:33<41:41,  3.72it/s]
 97%|█████████▋| 362161/371472 [6:39:33<41:46,  3.71it/s]
 97%|█████████▋| 362162/371472 [6:39:34<40:28,  3.83it/s]
 97%|█████████▋| 362163/371472 [6:39:34<40:29,  3.83it/s]
 97%|█████████▋| 362164/371472 [6:39:34<40:01,  3.88it/s]
 97%|█████████▋| 362165/371472 [6:39:34<39:05,  3.97it/s]
 97%|█████████▋| 362166/371472 [6:39:35<41:38,  3.72it/s]
 97%|█████████▋| 362167/371472 [6:39:35<41:56,  3.70it/s]
 97%|█████████▋| 362168/371472 [6:39:35<41:49,  3.71it/s]
 97%|█████████▋| 362169/371472 [6:39:35<42:02,  3.69it/s]
 97%|█████████▋| 362170/371472 [6:39:36<42:37,  3.64it/s]
 97%|█████████▋| 362171/371472 [6:39:36<48:44,  3.18it/s]
 97%|█████████▋| 362172/371472 [6:39:36<46:03,  3.37it/s]
 97%|█████████▋| 362173/371472 [6:39:37<46:10,  3.36it/s]
 97%|█████████▋| 362174/371472 [6:39:37<48:41,  3.18it/s]
 97%|█████████▋| 362175/371472 [6:39:37<45:23,  3.41it/s]
 97%|█████████▋| 362176/371472 [6:39:37<44:17,  3.50it/s]
 97%|█████████▋| 362177/371472 [6:39:38<42:53,  3.61it/s]
 97%|█████████▋| 362178/371472 [6:39:38<45:50,  3.38it/s]
 97%|█████████▋| 362179/371472 [6:39:38<44:29,  3.48it/s]
 97%|█████████▋| 362180/371472 [6:39:39<43:22,  3.57it/s]
                                                         
{'loss': 2.6594, 'learning_rate': 1.2252472580749427e-07, 'epoch': 15.6}

 97%|█████████▋| 362180/371472 [6:39:39<43:22,  3.57it/s]
 97%|█████████▋| 362181/371472 [6:39:39<48:15,  3.21it/s]
 97%|█████████▋| 362182/371472 [6:39:39<46:28,  3.33it/s]
 97%|█████████▋| 362183/371472 [6:39:40<46:11,  3.35it/s]
 97%|█████████▋| 362184/371472 [6:39:40<45:38,  3.39it/s]
 97%|█████████▋| 362185/371472 [6:39:40<43:53,  3.53it/s]
 98%|█████████▊| 362186/371472 [6:39:40<45:06,  3.43it/s]
 98%|█████████▊| 362187/371472 [6:39:41<44:25,  3.48it/s]
 98%|█████████▊| 362188/371472 [6:39:41<46:03,  3.36it/s]
 98%|█████████▊| 362189/371472 [6:39:41<44:22,  3.49it/s]
 98%|█████████▊| 362190/371472 [6:39:42<42:51,  3.61it/s]
 98%|█████████▊| 362191/371472 [6:39:42<41:50,  3.70it/s]
 98%|█████████▊| 362192/371472 [6:39:42<41:29,  3.73it/s]
 98%|█████████▊| 362193/371472 [6:39:42<42:19,  3.65it/s]
 98%|█████████▊| 362194/371472 [6:39:43<44:22,  3.48it/s]
 98%|█████████▊| 362195/371472 [6:39:43<43:41,  3.54it/s]
 98%|█████████▊| 362196/371472 [6:39:43<42:18,  3.65it/s]
 98%|█████████▊| 362197/371472 [6:39:43<43:03,  3.59it/s]
 98%|█████████▊| 362198/371472 [6:39:44<44:54,  3.44it/s]
 98%|█████████▊| 362199/371472 [6:39:44<48:26,  3.19it/s]
 98%|█████████▊| 362200/371472 [6:39:44<46:47,  3.30it/s]
                                                         
{'loss': 2.5935, 'learning_rate': 1.2247624383201534e-07, 'epoch': 15.6}

 98%|█████████▊| 362200/371472 [6:39:44<46:47,  3.30it/s]
 98%|█████████▊| 362201/371472 [6:39:45<44:45,  3.45it/s]
 98%|█████████▊| 362202/371472 [6:39:45<44:42,  3.46it/s]
 98%|█████████▊| 362203/371472 [6:39:45<42:08,  3.67it/s]
 98%|█████████▊| 362204/371472 [6:39:45<41:24,  3.73it/s]
 98%|█████████▊| 362205/371472 [6:39:46<43:40,  3.54it/s]
 98%|█████████▊| 362206/371472 [6:39:46<42:27,  3.64it/s]
 98%|█████████▊| 362207/371472 [6:39:46<44:11,  3.49it/s]
 98%|█████████▊| 362208/371472 [6:39:47<43:41,  3.53it/s]
 98%|█████████▊| 362209/371472 [6:39:47<44:32,  3.47it/s]
 98%|█████████▊| 362210/371472 [6:39:47<44:04,  3.50it/s]
 98%|█████████▊| 362211/371472 [6:39:48<44:15,  3.49it/s]
 98%|█████████▊| 362212/371472 [6:39:48<43:41,  3.53it/s]
 98%|█████████▊| 362213/371472 [6:39:48<44:14,  3.49it/s]
 98%|█████████▊| 362214/371472 [6:39:48<43:19,  3.56it/s]
 98%|█████████▊| 362215/371472 [6:39:49<42:25,  3.64it/s]
 98%|█████████▊| 362216/371472 [6:39:49<42:18,  3.65it/s]
 98%|█████████▊| 362217/371472 [6:39:49<41:54,  3.68it/s]
 98%|█████████▊| 362218/371472 [6:39:49<42:50,  3.60it/s]
 98%|█████████▊| 362219/371472 [6:39:50<43:55,  3.51it/s]
 98%|█████████▊| 362220/371472 [6:39:50<43:31,  3.54it/s]
                                                         
{'loss': 2.4667, 'learning_rate': 1.224277618565364e-07, 'epoch': 15.6}

 98%|█████████▊| 362220/371472 [6:39:50<43:31,  3.54it/s]
 98%|█████████▊| 362221/371472 [6:39:50<44:15,  3.48it/s]
 98%|█████████▊| 362222/371472 [6:39:51<41:50,  3.68it/s]
 98%|█████████▊| 362223/371472 [6:39:51<42:59,  3.58it/s]
 98%|█████████▊| 362224/371472 [6:39:51<43:36,  3.53it/s]
 98%|█████████▊| 362225/371472 [6:39:51<42:41,  3.61it/s]
 98%|█████████▊| 362226/371472 [6:39:52<43:05,  3.58it/s]
 98%|█████████▊| 362227/371472 [6:39:52<42:40,  3.61it/s]
 98%|█████████▊| 362228/371472 [6:39:52<43:03,  3.58it/s]
 98%|█████████▊| 362229/371472 [6:39:53<43:29,  3.54it/s]
 98%|█████████▊| 362230/371472 [6:39:53<45:14,  3.40it/s]
 98%|█████████▊| 362231/371472 [6:39:53<43:42,  3.52it/s]
 98%|█████████▊| 362232/371472 [6:39:53<42:18,  3.64it/s]
 98%|█████████▊| 362233/371472 [6:39:54<44:20,  3.47it/s]
 98%|█████████▊| 362234/371472 [6:39:54<43:20,  3.55it/s]
 98%|█████████▊| 362235/371472 [6:39:54<41:40,  3.69it/s]
 98%|█████████▊| 362236/371472 [6:39:54<40:55,  3.76it/s]
 98%|█████████▊| 362237/371472 [6:39:55<39:16,  3.92it/s]
 98%|█████████▊| 362238/371472 [6:39:55<39:40,  3.88it/s]
 98%|█████████▊| 362239/371472 [6:39:55<40:57,  3.76it/s]
 98%|█████████▊| 362240/371472 [6:39:55<40:18,  3.82it/s]
                                                         
{'loss': 2.5434, 'learning_rate': 1.2237927988105757e-07, 'epoch': 15.6}

 98%|█████████▊| 362240/371472 [6:39:55<40:18,  3.82it/s]
 98%|█████████▊| 362241/371472 [6:39:56<44:15,  3.48it/s]
 98%|█████████▊| 362242/371472 [6:39:56<48:10,  3.19it/s]
 98%|█████████▊| 362243/371472 [6:39:56<46:12,  3.33it/s]
 98%|█████████▊| 362244/371472 [6:39:57<45:10,  3.40it/s]
 98%|█████████▊| 362245/371472 [6:39:57<48:41,  3.16it/s]
 98%|█████████▊| 362246/371472 [6:39:57<49:01,  3.14it/s]
 98%|█████████▊| 362247/371472 [6:39:58<48:07,  3.19it/s]
 98%|█████████▊| 362248/371472 [6:39:58<48:08,  3.19it/s]
 98%|█████████▊| 362249/371472 [6:39:58<45:08,  3.40it/s]
 98%|█████████▊| 362250/371472 [6:39:59<46:19,  3.32it/s]
 98%|█████████▊| 362251/371472 [6:39:59<43:32,  3.53it/s]
 98%|█████████▊| 362252/371472 [6:39:59<41:29,  3.70it/s]
 98%|█████████▊| 362253/371472 [6:39:59<43:53,  3.50it/s]
 98%|█████████▊| 362254/371472 [6:40:00<45:32,  3.37it/s]
 98%|█████████▊| 362255/371472 [6:40:00<45:31,  3.37it/s]
 98%|█████████▊| 362256/371472 [6:40:00<43:04,  3.57it/s]
 98%|█████████▊| 362257/371472 [6:40:01<48:12,  3.19it/s]
 98%|█████████▊| 362258/371472 [6:40:01<50:42,  3.03it/s]
 98%|█████████▊| 362259/371472 [6:40:01<49:16,  3.12it/s]
 98%|█████████▊| 362260/371472 [6:40:02<46:42,  3.29it/s]
                                                         
{'loss': 2.5538, 'learning_rate': 1.223307979055786e-07, 'epoch': 15.6}

 98%|█████████▊| 362260/371472 [6:40:02<46:42,  3.29it/s]
 98%|█████████▊| 362261/371472 [6:40:02<44:57,  3.41it/s]
 98%|█████████▊| 362262/371472 [6:40:02<43:14,  3.55it/s]
 98%|█████████▊| 362263/371472 [6:40:02<41:35,  3.69it/s]
 98%|█████████▊| 362264/371472 [6:40:03<43:50,  3.50it/s]
 98%|█████████▊| 362265/371472 [6:40:03<44:16,  3.47it/s]
 98%|█████████▊| 362266/371472 [6:40:03<45:07,  3.40it/s]
 98%|█████████▊| 362267/371472 [6:40:04<45:17,  3.39it/s]
 98%|█████████▊| 362268/371472 [6:40:04<44:27,  3.45it/s]
 98%|█████████▊| 362269/371472 [6:40:04<42:56,  3.57it/s]
 98%|█████████▊| 362270/371472 [6:40:04<42:49,  3.58it/s]
 98%|█████████▊| 362271/371472 [6:40:05<42:07,  3.64it/s]
 98%|█████████▊| 362272/371472 [6:40:05<40:38,  3.77it/s]
 98%|█████████▊| 362273/371472 [6:40:05<41:50,  3.66it/s]
 98%|█████████▊| 362274/371472 [6:40:05<42:06,  3.64it/s]
 98%|█████████▊| 362275/371472 [6:40:06<41:13,  3.72it/s]
 98%|█████████▊| 362276/371472 [6:40:06<43:01,  3.56it/s]
 98%|█████████▊| 362277/371472 [6:40:06<41:34,  3.69it/s]
 98%|█████████▊| 362278/371472 [6:40:07<40:21,  3.80it/s]
 98%|█████████▊| 362279/371472 [6:40:07<41:11,  3.72it/s]
 98%|█████████▊| 362280/371472 [6:40:07<41:44,  3.67it/s]
                                                         
{'loss': 2.6149, 'learning_rate': 1.2228231593009976e-07, 'epoch': 15.6}

 98%|█████████▊| 362280/371472 [6:40:07<41:44,  3.67it/s]
 98%|█████████▊| 362281/371472 [6:40:07<40:14,  3.81it/s]
 98%|█████████▊| 362282/371472 [6:40:08<40:49,  3.75it/s]
 98%|█████████▊| 362283/371472 [6:40:08<46:20,  3.30it/s]
 98%|█████████▊| 362284/371472 [6:40:08<44:12,  3.46it/s]
 98%|█████████▊| 362285/371472 [6:40:09<46:51,  3.27it/s]
 98%|█████████▊| 362286/371472 [6:40:09<44:41,  3.43it/s]
 98%|█████████▊| 362287/371472 [6:40:09<45:49,  3.34it/s]
 98%|█████████▊| 362288/371472 [6:40:10<47:29,  3.22it/s]
 98%|█████████▊| 362289/371472 [6:40:10<45:35,  3.36it/s]
 98%|█████████▊| 362290/371472 [6:40:10<45:26,  3.37it/s]
 98%|█████████▊| 362291/371472 [6:40:10<45:33,  3.36it/s]
 98%|█████████▊| 362292/371472 [6:40:11<44:32,  3.43it/s]
 98%|█████████▊| 362293/371472 [6:40:11<46:35,  3.28it/s]
 98%|█████████▊| 362294/371472 [6:40:11<46:12,  3.31it/s]
 98%|█████████▊| 362295/371472 [6:40:12<43:28,  3.52it/s]
 98%|█████████▊| 362296/371472 [6:40:12<44:16,  3.45it/s]
 98%|█████████▊| 362297/371472 [6:40:12<42:54,  3.56it/s]
 98%|█████████▊| 362298/371472 [6:40:12<45:17,  3.38it/s]
 98%|█████████▊| 362299/371472 [6:40:13<45:14,  3.38it/s]
 98%|█████████▊| 362300/371472 [6:40:13<44:21,  3.45it/s]
                                                         
{'loss': 2.5803, 'learning_rate': 1.2223383395462083e-07, 'epoch': 15.6}

 98%|█████████▊| 362300/371472 [6:40:13<44:21,  3.45it/s]
 98%|█████████▊| 362301/371472 [6:40:13<42:33,  3.59it/s]
 98%|█████████▊| 362302/371472 [6:40:14<41:11,  3.71it/s]
 98%|█████████▊| 362303/371472 [6:40:14<41:19,  3.70it/s]
 98%|█████████▊| 362304/371472 [6:40:14<41:57,  3.64it/s]
 98%|█████████▊| 362305/371472 [6:40:14<45:34,  3.35it/s]
 98%|█████████▊| 362306/371472 [6:40:15<43:02,  3.55it/s]
 98%|█████████▊| 362307/371472 [6:40:15<46:31,  3.28it/s]
 98%|█████████▊| 362308/371472 [6:40:15<43:31,  3.51it/s]
 98%|█████████▊| 362309/371472 [6:40:16<42:38,  3.58it/s]
 98%|█████████▊| 362310/371472 [6:40:16<42:21,  3.61it/s]
 98%|█████████▊| 362311/371472 [6:40:16<43:01,  3.55it/s]
 98%|█████████▊| 362312/371472 [6:40:16<41:10,  3.71it/s]
 98%|█████████▊| 362313/371472 [6:40:17<41:16,  3.70it/s]
 98%|█████████▊| 362314/371472 [6:40:17<39:29,  3.86it/s]
 98%|█████████▊| 362315/371472 [6:40:17<39:24,  3.87it/s]
 98%|█████████▊| 362316/371472 [6:40:17<38:38,  3.95it/s]
 98%|█████████▊| 362317/371472 [6:40:18<40:01,  3.81it/s]
 98%|█████████▊| 362318/371472 [6:40:18<40:49,  3.74it/s]
 98%|█████████▊| 362319/371472 [6:40:18<44:08,  3.46it/s]
 98%|█████████▊| 362320/371472 [6:40:19<47:53,  3.19it/s]
                                                         
{'loss': 2.6754, 'learning_rate': 1.2218535197914198e-07, 'epoch': 15.61}

 98%|█████████▊| 362320/371472 [6:40:19<47:53,  3.19it/s]
 98%|█████████▊| 362321/371472 [6:40:19<48:03,  3.17it/s]
 98%|█████████▊| 362322/371472 [6:40:19<46:21,  3.29it/s]
 98%|█████████▊| 362323/371472 [6:40:20<46:45,  3.26it/s]
 98%|█████████▊| 362324/371472 [6:40:20<45:07,  3.38it/s]
 98%|█████████▊| 362325/371472 [6:40:20<47:54,  3.18it/s]
 98%|█████████▊| 362326/371472 [6:40:20<45:43,  3.33it/s]
 98%|█████████▊| 362327/371472 [6:40:21<44:19,  3.44it/s]
 98%|█████████▊| 362328/371472 [6:40:21<44:57,  3.39it/s]
 98%|█████████▊| 362329/371472 [6:40:21<42:17,  3.60it/s]
 98%|█████████▊| 362330/371472 [6:40:21<41:32,  3.67it/s]
 98%|█████████▊| 362331/371472 [6:40:22<42:29,  3.59it/s]
 98%|█████████▊| 362332/371472 [6:40:22<45:49,  3.32it/s]
 98%|█████████▊| 362333/371472 [6:40:22<44:01,  3.46it/s]
 98%|█████████▊| 362334/371472 [6:40:23<44:04,  3.45it/s]
 98%|█████████▊| 362335/371472 [6:40:23<42:05,  3.62it/s]
 98%|█████████▊| 362336/371472 [6:40:23<41:14,  3.69it/s]
 98%|█████████▊| 362337/371472 [6:40:23<41:26,  3.67it/s]
 98%|█████████▊| 362338/371472 [6:40:24<40:07,  3.79it/s]
 98%|█████████▊| 362339/371472 [6:40:24<43:07,  3.53it/s]
 98%|█████████▊| 362340/371472 [6:40:24<43:39,  3.49it/s]
                                                         
{'loss': 2.5449, 'learning_rate': 1.2213687000366303e-07, 'epoch': 15.61}

 98%|█████████▊| 362340/371472 [6:40:24<43:39,  3.49it/s]
 98%|█████████▊| 362341/371472 [6:40:25<42:07,  3.61it/s]
 98%|█████████▊| 362342/371472 [6:40:25<42:01,  3.62it/s]
 98%|█████████▊| 362343/371472 [6:40:25<42:32,  3.58it/s]
 98%|█████████▊| 362344/371472 [6:40:25<40:26,  3.76it/s]
 98%|█████████▊| 362345/371472 [6:40:26<39:31,  3.85it/s]
 98%|█████████▊| 362346/371472 [6:40:26<40:08,  3.79it/s]
 98%|█████████▊| 362347/371472 [6:40:26<42:14,  3.60it/s]
 98%|█████████▊| 362348/371472 [6:40:26<41:05,  3.70it/s]
 98%|█████████▊| 362349/371472 [6:40:27<42:15,  3.60it/s]
 98%|█████████▊| 362350/371472 [6:40:27<40:43,  3.73it/s]
 98%|█████████▊| 362351/371472 [6:40:27<44:59,  3.38it/s]
 98%|█████████▊| 362352/371472 [6:40:28<42:36,  3.57it/s]
 98%|█████████▊| 362353/371472 [6:40:28<41:01,  3.70it/s]
 98%|█████████▊| 362354/371472 [6:40:28<41:54,  3.63it/s]
 98%|█████████▊| 362355/371472 [6:40:28<40:30,  3.75it/s]
 98%|█████████▊| 362356/371472 [6:40:29<40:54,  3.71it/s]
 98%|█████████▊| 362357/371472 [6:40:29<42:43,  3.56it/s]
 98%|█████████▊| 362358/371472 [6:40:29<41:20,  3.67it/s]
 98%|█████████▊| 362359/371472 [6:40:30<41:55,  3.62it/s]
 98%|█████████▊| 362360/371472 [6:40:30<46:07,  3.29it/s]
                                                         
{'loss': 2.7549, 'learning_rate': 1.220883880281842e-07, 'epoch': 15.61}

 98%|█████████▊| 362360/371472 [6:40:30<46:07,  3.29it/s]
 98%|█████████▊| 362361/371472 [6:40:30<44:59,  3.37it/s]
 98%|█████████▊| 362362/371472 [6:40:30<46:25,  3.27it/s]
 98%|█████████▊| 362363/371472 [6:40:31<45:56,  3.31it/s]
 98%|█████████▊| 362364/371472 [6:40:31<47:08,  3.22it/s]
 98%|█████████▊| 362365/371472 [6:40:31<49:37,  3.06it/s]
 98%|█████████▊| 362366/371472 [6:40:32<46:12,  3.28it/s]
 98%|█████████▊| 362367/371472 [6:40:32<43:04,  3.52it/s]
 98%|█████████▊| 362368/371472 [6:40:32<41:33,  3.65it/s]
 98%|█████████▊| 362369/371472 [6:40:32<40:52,  3.71it/s]
 98%|█████████▊| 362370/371472 [6:40:33<40:58,  3.70it/s]
 98%|█████████▊| 362371/371472 [6:40:33<40:00,  3.79it/s]
 98%|█████████▊| 362372/371472 [6:40:33<42:45,  3.55it/s]
 98%|█████████▊| 362373/371472 [6:40:34<41:29,  3.65it/s]
 98%|█████████▊| 362374/371472 [6:40:34<44:27,  3.41it/s]
 98%|█████████▊| 362375/371472 [6:40:34<45:15,  3.35it/s]
 98%|█████████▊| 362376/371472 [6:40:34<42:40,  3.55it/s]
 98%|█████████▊| 362377/371472 [6:40:35<46:55,  3.23it/s]
 98%|█████████▊| 362378/371472 [6:40:35<46:47,  3.24it/s]
 98%|█████████▊| 362379/371472 [6:40:35<47:20,  3.20it/s]
 98%|█████████▊| 362380/371472 [6:40:36<47:17,  3.20it/s]
                                                         
{'loss': 2.437, 'learning_rate': 1.2203990605270525e-07, 'epoch': 15.61}

 98%|█████████▊| 362380/371472 [6:40:36<47:17,  3.20it/s]
 98%|█████████▊| 362381/371472 [6:40:36<46:40,  3.25it/s]
 98%|█████████▊| 362382/371472 [6:40:36<46:25,  3.26it/s]
 98%|█████████▊| 362383/371472 [6:40:37<45:50,  3.30it/s]
 98%|█████████▊| 362384/371472 [6:40:37<45:04,  3.36it/s]
 98%|█████████▊| 362385/371472 [6:40:37<43:33,  3.48it/s]
 98%|█████████▊| 362386/371472 [6:40:38<43:09,  3.51it/s]
 98%|█████████▊| 362387/371472 [6:40:38<42:36,  3.55it/s]
 98%|█████████▊| 362388/371472 [6:40:38<43:24,  3.49it/s]
 98%|█████████▊| 362389/371472 [6:40:38<42:13,  3.59it/s]
 98%|█████████▊| 362390/371472 [6:40:39<41:15,  3.67it/s]
 98%|█████████▊| 362391/371472 [6:40:39<41:19,  3.66it/s]
 98%|█████████▊| 362392/371472 [6:40:39<40:10,  3.77it/s]
 98%|█████████▊| 362393/371472 [6:40:39<40:32,  3.73it/s]
 98%|█████████▊| 362394/371472 [6:40:40<43:21,  3.49it/s]
 98%|█████████▊| 362395/371472 [6:40:40<42:20,  3.57it/s]
 98%|█████████▊| 362396/371472 [6:40:40<42:42,  3.54it/s]
 98%|█████████▊| 362397/371472 [6:40:41<41:50,  3.61it/s]
 98%|█████████▊| 362398/371472 [6:40:41<41:24,  3.65it/s]
 98%|█████████▊| 362399/371472 [6:40:41<40:58,  3.69it/s]
 98%|█████████▊| 362400/371472 [6:40:41<40:46,  3.71it/s]
                                                         
{'loss': 2.5268, 'learning_rate': 1.219914240772264e-07, 'epoch': 15.61}

 98%|█████████▊| 362400/371472 [6:40:41<40:46,  3.71it/s]
 98%|█████████▊| 362401/371472 [6:40:42<41:20,  3.66it/s]
 98%|█████████▊| 362402/371472 [6:40:42<41:27,  3.65it/s]
 98%|█████████▊| 362403/371472 [6:40:42<43:14,  3.50it/s]
 98%|█████████▊| 362404/371472 [6:40:42<42:33,  3.55it/s]
 98%|█████████▊| 362405/371472 [6:40:43<43:02,  3.51it/s]
 98%|█████████▊| 362406/371472 [6:40:43<43:26,  3.48it/s]
 98%|█████████▊| 362407/371472 [6:40:43<43:44,  3.45it/s]
 98%|█████████▊| 362408/371472 [6:40:44<44:19,  3.41it/s]
 98%|█████████▊| 362409/371472 [6:40:44<42:26,  3.56it/s]
 98%|█████████▊| 362410/371472 [6:40:44<46:24,  3.25it/s]
 98%|█████████▊| 362411/371472 [6:40:45<43:54,  3.44it/s]
 98%|█████████▊| 362412/371472 [6:40:45<42:19,  3.57it/s]
 98%|█████████▊| 362413/371472 [6:40:45<42:05,  3.59it/s]
 98%|█████████▊| 362414/371472 [6:40:45<42:38,  3.54it/s]
 98%|█████████▊| 362415/371472 [6:40:46<42:22,  3.56it/s]
 98%|█████████▊| 362416/371472 [6:40:46<43:31,  3.47it/s]
 98%|█████████▊| 362417/371472 [6:40:46<42:47,  3.53it/s]
 98%|█████████▊| 362418/371472 [6:40:46<41:06,  3.67it/s]
 98%|█████████▊| 362419/371472 [6:40:47<41:02,  3.68it/s]
 98%|█████████▊| 362420/371472 [6:40:47<41:27,  3.64it/s]
                                                         
{'loss': 2.6461, 'learning_rate': 1.2194294210174747e-07, 'epoch': 15.61}

 98%|█████████▊| 362420/371472 [6:40:47<41:27,  3.64it/s]
 98%|█████████▊| 362421/371472 [6:40:47<41:53,  3.60it/s]
 98%|█████████▊| 362422/371472 [6:40:48<40:46,  3.70it/s]
 98%|█████████▊| 362423/371472 [6:40:48<40:57,  3.68it/s]
 98%|█████████▊| 362424/371472 [6:40:48<44:48,  3.37it/s]
 98%|█████████▊| 362425/371472 [6:40:48<46:00,  3.28it/s]
 98%|█████████▊| 362426/371472 [6:40:49<44:50,  3.36it/s]
 98%|█████████▊| 362427/371472 [6:40:49<43:33,  3.46it/s]
 98%|█████████▊| 362428/371472 [6:40:49<44:13,  3.41it/s]
 98%|█████████▊| 362429/371472 [6:40:50<45:31,  3.31it/s]
 98%|█████████▊| 362430/371472 [6:40:50<44:28,  3.39it/s]
 98%|█████████▊| 362431/371472 [6:40:50<42:33,  3.54it/s]
 98%|█████████▊| 362432/371472 [6:40:50<41:47,  3.61it/s]
 98%|█████████▊| 362433/371472 [6:40:51<41:24,  3.64it/s]
 98%|█████████▊| 362434/371472 [6:40:51<40:52,  3.69it/s]
 98%|█████████▊| 362435/371472 [6:40:51<39:32,  3.81it/s]
 98%|█████████▊| 362436/371472 [6:40:52<41:23,  3.64it/s]
 98%|█████████▊| 362437/371472 [6:40:52<40:39,  3.70it/s]
 98%|█████████▊| 362438/371472 [6:40:52<42:35,  3.54it/s]
 98%|█████████▊| 362439/371472 [6:40:52<40:43,  3.70it/s]
 98%|█████████▊| 362440/371472 [6:40:53<41:07,  3.66it/s]
                                                         
{'loss': 2.5633, 'learning_rate': 1.2189446012626862e-07, 'epoch': 15.61}

 98%|█████████▊| 362440/371472 [6:40:53<41:07,  3.66it/s]
 98%|█████████▊| 362441/371472 [6:40:53<43:25,  3.47it/s]
 98%|█████████▊| 362442/371472 [6:40:53<41:24,  3.63it/s]
 98%|█████████▊| 362443/371472 [6:40:53<40:57,  3.67it/s]
 98%|█████████▊| 362444/371472 [6:40:54<44:47,  3.36it/s]
 98%|█████████▊| 362445/371472 [6:40:54<43:03,  3.49it/s]
 98%|█████████▊| 362446/371472 [6:40:54<42:16,  3.56it/s]
 98%|█████████▊| 362447/371472 [6:40:55<42:30,  3.54it/s]
 98%|█████████▊| 362448/371472 [6:40:55<41:33,  3.62it/s]
 98%|█████████▊| 362449/371472 [6:40:55<44:03,  3.41it/s]
 98%|█████████▊| 362450/371472 [6:40:56<42:47,  3.51it/s]
 98%|█████████▊| 362451/371472 [6:40:56<41:10,  3.65it/s]
 98%|█████████▊| 362452/371472 [6:40:56<41:00,  3.67it/s]
 98%|█████████▊| 362453/371472 [6:40:56<41:45,  3.60it/s]
 98%|█████████▊| 362454/371472 [6:40:57<41:18,  3.64it/s]
 98%|█████████▊| 362455/371472 [6:40:57<42:22,  3.55it/s]
 98%|█████████▊| 362456/371472 [6:40:57<41:24,  3.63it/s]
 98%|█████████▊| 362457/371472 [6:40:57<42:41,  3.52it/s]
 98%|█████████▊| 362458/371472 [6:40:58<42:06,  3.57it/s]
 98%|█████████▊| 362459/371472 [6:40:58<43:54,  3.42it/s]
 98%|█████████▊| 362460/371472 [6:40:58<42:45,  3.51it/s]
                                                         
{'loss': 2.7042, 'learning_rate': 1.218459781507897e-07, 'epoch': 15.61}

 98%|█████████▊| 362460/371472 [6:40:58<42:45,  3.51it/s]
 98%|█████████▊| 362461/371472 [6:40:59<45:54,  3.27it/s]
 98%|█████████▊| 362462/371472 [6:40:59<44:04,  3.41it/s]
 98%|█████████▊| 362463/371472 [6:40:59<42:42,  3.52it/s]
 98%|█████████▊| 362464/371472 [6:40:59<40:46,  3.68it/s]
 98%|█████████▊| 362465/371472 [6:41:00<41:15,  3.64it/s]
 98%|█████████▊| 362466/371472 [6:41:00<41:48,  3.59it/s]
 98%|█████████▊| 362467/371472 [6:41:00<41:27,  3.62it/s]
 98%|█████████▊| 362468/371472 [6:41:01<40:41,  3.69it/s]
 98%|█████████▊| 362469/371472 [6:41:01<44:35,  3.37it/s]
 98%|█████████▊| 362470/371472 [6:41:01<44:05,  3.40it/s]
 98%|█████████▊| 362471/371472 [6:41:01<42:37,  3.52it/s]
 98%|█████████▊| 362472/371472 [6:41:02<42:19,  3.54it/s]
 98%|█████████▊| 362473/371472 [6:41:02<40:53,  3.67it/s]
 98%|█████████▊| 362474/371472 [6:41:02<39:30,  3.80it/s]
 98%|█████████▊| 362475/371472 [6:41:02<38:56,  3.85it/s]
 98%|█████████▊| 362476/371472 [6:41:03<43:40,  3.43it/s]
 98%|█████████▊| 362477/371472 [6:41:03<42:17,  3.54it/s]
 98%|█████████▊| 362478/371472 [6:41:03<40:16,  3.72it/s]
 98%|█████████▊| 362479/371472 [6:41:04<41:56,  3.57it/s]
 98%|█████████▊| 362480/371472 [6:41:04<40:44,  3.68it/s]
                                                         
{'loss': 2.774, 'learning_rate': 1.2179749617531085e-07, 'epoch': 15.61}

 98%|█████████▊| 362480/371472 [6:41:04<40:44,  3.68it/s]
 98%|█████████▊| 362481/371472 [6:41:04<40:07,  3.73it/s]
 98%|█████████▊| 362482/371472 [6:41:04<38:55,  3.85it/s]
 98%|█████████▊| 362483/371472 [6:41:05<38:45,  3.87it/s]
 98%|█████████▊| 362484/371472 [6:41:05<38:13,  3.92it/s]
 98%|█████████▊| 362485/371472 [6:41:05<38:22,  3.90it/s]
 98%|█████████▊| 362486/371472 [6:41:05<39:20,  3.81it/s]
 98%|█████████▊| 362487/371472 [6:41:06<40:16,  3.72it/s]
 98%|█████████▊| 362488/371472 [6:41:06<43:19,  3.46it/s]
 98%|█████████▊| 362489/371472 [6:41:06<42:27,  3.53it/s]
 98%|█████████▊| 362490/371472 [6:41:07<42:07,  3.55it/s]
 98%|█████████▊| 362491/371472 [6:41:07<44:14,  3.38it/s]
 98%|█████████▊| 362492/371472 [6:41:07<42:38,  3.51it/s]
 98%|█████████▊| 362493/371472 [6:41:07<41:49,  3.58it/s]
 98%|█████████▊| 362494/371472 [6:41:08<41:36,  3.60it/s]
 98%|█████████▊| 362495/371472 [6:41:08<41:50,  3.58it/s]
 98%|█████████▊| 362496/371472 [6:41:08<42:28,  3.52it/s]
 98%|█████████▊| 362497/371472 [6:41:09<44:58,  3.33it/s]
 98%|█████████▊| 362498/371472 [6:41:09<42:21,  3.53it/s]
 98%|█████████▊| 362499/371472 [6:41:09<41:58,  3.56it/s]
 98%|█████████▊| 362500/371472 [6:41:09<40:09,  3.72it/s]
                                                         
{'loss': 2.3987, 'learning_rate': 1.217490141998319e-07, 'epoch': 15.61}

 98%|█████████▊| 362500/371472 [6:41:09<40:09,  3.72it/s]
 98%|█████████▊| 362501/371472 [6:41:10<40:56,  3.65it/s]
 98%|█████████▊| 362502/371472 [6:41:10<41:40,  3.59it/s]
 98%|█████████▊| 362503/371472 [6:41:10<40:23,  3.70it/s]
 98%|█████████▊| 362504/371472 [6:41:10<38:59,  3.83it/s]
 98%|█████████▊| 362505/371472 [6:41:11<38:51,  3.85it/s]
 98%|█████████▊| 362506/371472 [6:41:11<42:58,  3.48it/s]
 98%|█████████▊| 362507/371472 [6:41:11<42:10,  3.54it/s]
 98%|█████████▊| 362508/371472 [6:41:12<41:50,  3.57it/s]
 98%|█████████▊| 362509/371472 [6:41:12<42:35,  3.51it/s]
 98%|█████████▊| 362510/371472 [6:41:12<41:42,  3.58it/s]
 98%|█████████▊| 362511/371472 [6:41:12<42:46,  3.49it/s]
 98%|█████████▊| 362512/371472 [6:41:13<41:18,  3.62it/s]
 98%|█████████▊| 362513/371472 [6:41:13<40:46,  3.66it/s]
 98%|█████████▊| 362514/371472 [6:41:13<40:13,  3.71it/s]
 98%|█████████▊| 362515/371472 [6:41:14<40:29,  3.69it/s]
 98%|█████████▊| 362516/371472 [6:41:14<39:52,  3.74it/s]
 98%|█████████▊| 362517/371472 [6:41:14<42:19,  3.53it/s]
 98%|█████████▊| 362518/371472 [6:41:14<44:31,  3.35it/s]
 98%|█████████▊| 362519/371472 [6:41:15<43:54,  3.40it/s]
 98%|█████████▊| 362520/371472 [6:41:15<43:28,  3.43it/s]
                                                         
{'loss': 2.7462, 'learning_rate': 1.2170053222435307e-07, 'epoch': 15.61}

 98%|█████████▊| 362520/371472 [6:41:15<43:28,  3.43it/s]
 98%|█████████▊| 362521/371472 [6:41:15<43:23,  3.44it/s]
 98%|█████████▊| 362522/371472 [6:41:16<44:55,  3.32it/s]
 98%|█████████▊| 362523/371472 [6:41:16<44:15,  3.37it/s]
 98%|█████████▊| 362524/371472 [6:41:16<46:01,  3.24it/s]
 98%|█████████▊| 362525/371472 [6:41:17<48:12,  3.09it/s]
 98%|█████████▊| 362526/371472 [6:41:17<46:13,  3.23it/s]
 98%|█████████▊| 362527/371472 [6:41:17<43:55,  3.39it/s]
 98%|█████████▊| 362528/371472 [6:41:17<42:06,  3.54it/s]
 98%|█████████▊| 362529/371472 [6:41:18<41:02,  3.63it/s]
 98%|█████████▊| 362530/371472 [6:41:18<40:44,  3.66it/s]
 98%|█████████▊| 362531/371472 [6:41:18<42:03,  3.54it/s]
 98%|█████████▊| 362532/371472 [6:41:18<39:54,  3.73it/s]
 98%|█████████▊| 362533/371472 [6:41:19<39:47,  3.74it/s]
 98%|█████████▊| 362534/371472 [6:41:19<39:31,  3.77it/s]
 98%|█████████▊| 362535/371472 [6:41:19<40:22,  3.69it/s]
 98%|█████████▊| 362536/371472 [6:41:20<39:22,  3.78it/s]
 98%|█████████▊| 362537/371472 [6:41:20<41:32,  3.58it/s]
 98%|█████████▊| 362538/371472 [6:41:20<41:16,  3.61it/s]
 98%|█████████▊| 362539/371472 [6:41:20<41:02,  3.63it/s]
 98%|█████████▊| 362540/371472 [6:41:21<42:24,  3.51it/s]
                                                         
{'loss': 2.4385, 'learning_rate': 1.2165205024887411e-07, 'epoch': 15.62}

 98%|█████████▊| 362540/371472 [6:41:21<42:24,  3.51it/s]
 98%|█████████▊| 362541/371472 [6:41:21<41:41,  3.57it/s]
 98%|█████████▊| 362542/371472 [6:41:21<45:22,  3.28it/s]
 98%|█████████▊| 362543/371472 [6:41:22<43:44,  3.40it/s]
 98%|█████████▊| 362544/371472 [6:41:22<41:59,  3.54it/s]
 98%|█████████▊| 362545/371472 [6:41:22<41:33,  3.58it/s]
 98%|█████████▊| 362546/371472 [6:41:22<41:39,  3.57it/s]
 98%|█████████▊| 362547/371472 [6:41:23<45:37,  3.26it/s]
 98%|█████████▊| 362548/371472 [6:41:23<45:36,  3.26it/s]
 98%|█████████▊| 362549/371472 [6:41:23<42:59,  3.46it/s]
 98%|█████████▊| 362550/371472 [6:41:24<43:09,  3.45it/s]
 98%|█████████▊| 362551/371472 [6:41:24<43:41,  3.40it/s]
 98%|█████████▊| 362552/371472 [6:41:24<44:34,  3.34it/s]
 98%|█████████▊| 362553/371472 [6:41:24<43:06,  3.45it/s]
 98%|█████████▊| 362554/371472 [6:41:25<42:53,  3.47it/s]
 98%|█████████▊| 362555/371472 [6:41:25<42:14,  3.52it/s]
 98%|█████████▊| 362556/371472 [6:41:25<42:16,  3.51it/s]
 98%|█████████▊| 362557/371472 [6:41:26<41:32,  3.58it/s]
 98%|█████████▊| 362558/371472 [6:41:26<42:47,  3.47it/s]
 98%|█████████▊| 362559/371472 [6:41:26<42:09,  3.52it/s]
 98%|█████████▊| 362560/371472 [6:41:26<41:58,  3.54it/s]
                                                         
{'loss': 2.497, 'learning_rate': 1.2160356827339527e-07, 'epoch': 15.62}

 98%|█████████▊| 362560/371472 [6:41:26<41:58,  3.54it/s]
 98%|█████████▊| 362561/371472 [6:41:27<40:58,  3.62it/s]
 98%|█████████▊| 362562/371472 [6:41:27<39:32,  3.76it/s]
 98%|█████████▊| 362563/371472 [6:41:27<42:03,  3.53it/s]
 98%|█████████▊| 362564/371472 [6:41:28<42:36,  3.48it/s]
 98%|█████████▊| 362565/371472 [6:41:28<41:46,  3.55it/s]
 98%|█████████▊| 362566/371472 [6:41:28<42:26,  3.50it/s]
 98%|█████████▊| 362567/371472 [6:41:28<41:34,  3.57it/s]
 98%|█████████▊| 362568/371472 [6:41:29<45:51,  3.24it/s]
 98%|█████████▊| 362569/371472 [6:41:29<48:50,  3.04it/s]
 98%|█████████▊| 362570/371472 [6:41:29<47:25,  3.13it/s]
 98%|█████████▊| 362571/371472 [6:41:30<45:30,  3.26it/s]
 98%|█████████▊| 362572/371472 [6:41:30<45:00,  3.30it/s]
 98%|█████████▊| 362573/371472 [6:41:30<45:05,  3.29it/s]
 98%|█████████▊| 362574/371472 [6:41:31<43:19,  3.42it/s]
 98%|█████████▊| 362575/371472 [6:41:31<41:20,  3.59it/s]
 98%|█████████▊| 362576/371472 [6:41:31<42:13,  3.51it/s]
 98%|█████████▊| 362577/371472 [6:41:32<46:15,  3.20it/s]
 98%|█████████▊| 362578/371472 [6:41:32<44:44,  3.31it/s]
 98%|█████████▊| 362579/371472 [6:41:32<44:24,  3.34it/s]
 98%|█████████▊| 362580/371472 [6:41:32<42:35,  3.48it/s]
                                                         
{'loss': 2.5052, 'learning_rate': 1.2155508629791634e-07, 'epoch': 15.62}

 98%|█████████▊| 362580/371472 [6:41:32<42:35,  3.48it/s]
 98%|█████████▊| 362581/371472 [6:41:33<42:04,  3.52it/s]
 98%|█████████▊| 362582/371472 [6:41:33<41:02,  3.61it/s]
 98%|█████████▊| 362583/371472 [6:41:33<40:47,  3.63it/s]
 98%|█████████▊| 362584/371472 [6:41:33<39:44,  3.73it/s]
 98%|█████████▊| 362585/371472 [6:41:34<39:02,  3.79it/s]
 98%|█████████▊| 362586/371472 [6:41:34<39:02,  3.79it/s]
 98%|█████████▊| 362587/371472 [6:41:34<39:05,  3.79it/s]
 98%|█████████▊| 362588/371472 [6:41:34<40:11,  3.68it/s]
 98%|█████████▊| 362589/371472 [6:41:35<42:28,  3.49it/s]
 98%|█████████▊| 362590/371472 [6:41:35<41:42,  3.55it/s]
 98%|█████████▊| 362591/371472 [6:41:35<42:41,  3.47it/s]
 98%|█████████▊| 362592/371472 [6:41:36<40:47,  3.63it/s]
 98%|█████████▊| 362593/371472 [6:41:36<40:43,  3.63it/s]
 98%|█████████▊| 362594/371472 [6:41:36<41:33,  3.56it/s]
 98%|█████████▊| 362595/371472 [6:41:37<42:12,  3.50it/s]
 98%|█████████▊| 362596/371472 [6:41:37<41:07,  3.60it/s]
 98%|█████████▊| 362597/371472 [6:41:37<41:21,  3.58it/s]
 98%|█████████▊| 362598/371472 [6:41:37<40:45,  3.63it/s]
 98%|█████████▊| 362599/371472 [6:41:38<39:23,  3.75it/s]
 98%|█████████▊| 362600/371472 [6:41:38<38:54,  3.80it/s]
                                                         
{'loss': 2.5635, 'learning_rate': 1.215066043224375e-07, 'epoch': 15.62}

 98%|█████████▊| 362600/371472 [6:41:38<38:54,  3.80it/s]
 98%|█████████▊| 362601/371472 [6:41:38<38:41,  3.82it/s]
 98%|█████████▊| 362602/371472 [6:41:38<38:38,  3.83it/s]
 98%|█████████▊| 362603/371472 [6:41:39<38:48,  3.81it/s]
 98%|█████████▊| 362604/371472 [6:41:39<39:12,  3.77it/s]
 98%|█████████▊| 362605/371472 [6:41:39<39:20,  3.76it/s]
 98%|█████████▊| 362606/371472 [6:41:39<39:58,  3.70it/s]
 98%|█████████▊| 362607/371472 [6:41:40<38:48,  3.81it/s]
 98%|█████████▊| 362608/371472 [6:41:40<39:55,  3.70it/s]
 98%|█████████▊| 362609/371472 [6:41:40<39:57,  3.70it/s]
 98%|█████████▊| 362610/371472 [6:41:40<39:30,  3.74it/s]
 98%|█████████▊| 362611/371472 [6:41:41<39:11,  3.77it/s]
 98%|█████████▊| 362612/371472 [6:41:41<38:53,  3.80it/s]
 98%|█████████▊| 362613/371472 [6:41:41<38:44,  3.81it/s]
 98%|█████████▊| 362614/371472 [6:41:41<37:25,  3.94it/s]
 98%|█████████▊| 362615/371472 [6:41:42<38:32,  3.83it/s]
 98%|█████████▊| 362616/371472 [6:41:42<39:47,  3.71it/s]
 98%|█████████▊| 362617/371472 [6:41:42<38:50,  3.80it/s]
 98%|█████████▊| 362618/371472 [6:41:43<40:14,  3.67it/s]
 98%|█████████▊| 362619/371472 [6:41:43<43:22,  3.40it/s]
 98%|█████████▊| 362620/371472 [6:41:43<43:05,  3.42it/s]
                                                         
{'loss': 2.6826, 'learning_rate': 1.2145812234695856e-07, 'epoch': 15.62}

 98%|█████████▊| 362620/371472 [6:41:43<43:05,  3.42it/s]
 98%|█████████▊| 362621/371472 [6:41:44<42:51,  3.44it/s]
 98%|█████████▊| 362622/371472 [6:41:44<41:39,  3.54it/s]
 98%|█████████▊| 362623/371472 [6:41:44<39:38,  3.72it/s]
 98%|█████████▊| 362624/371472 [6:41:44<39:33,  3.73it/s]
 98%|█████████▊| 362625/371472 [6:41:45<42:02,  3.51it/s]
 98%|█████████▊| 362626/371472 [6:41:45<41:15,  3.57it/s]
 98%|█████████▊| 362627/371472 [6:41:45<41:50,  3.52it/s]
 98%|█████████▊| 362628/371472 [6:41:45<42:03,  3.50it/s]
 98%|█████████▊| 362629/371472 [6:41:46<43:17,  3.40it/s]
 98%|█████████▊| 362630/371472 [6:41:46<44:31,  3.31it/s]
 98%|█████████▊| 362631/371472 [6:41:46<43:25,  3.39it/s]
 98%|█████████▊| 362632/371472 [6:41:47<41:19,  3.57it/s]
 98%|█████████▊| 362633/371472 [6:41:47<41:59,  3.51it/s]
 98%|█████████▊| 362634/371472 [6:41:47<40:34,  3.63it/s]
 98%|█████████▊| 362635/371472 [6:41:47<39:47,  3.70it/s]
 98%|█████████▊| 362636/371472 [6:41:48<39:12,  3.76it/s]
 98%|█████████▊| 362637/371472 [6:41:48<39:02,  3.77it/s]
 98%|█████████▊| 362638/371472 [6:41:48<40:33,  3.63it/s]
 98%|█████████▊| 362639/371472 [6:41:49<41:53,  3.51it/s]
 98%|█████████▊| 362640/371472 [6:41:49<44:49,  3.28it/s]
                                                         
{'loss': 2.5188, 'learning_rate': 1.214096403714797e-07, 'epoch': 15.62}

 98%|█████████▊| 362640/371472 [6:41:49<44:49,  3.28it/s]
 98%|█████████▊| 362641/371472 [6:41:49<43:37,  3.37it/s]
 98%|█████████▊| 362642/371472 [6:41:49<41:36,  3.54it/s]
 98%|█████████▊| 362643/371472 [6:41:50<43:30,  3.38it/s]
 98%|█████████▊| 362644/371472 [6:41:50<42:00,  3.50it/s]
 98%|█████████▊| 362645/371472 [6:41:50<43:10,  3.41it/s]
 98%|█████████▊| 362646/371472 [6:41:51<41:02,  3.58it/s]
 98%|█████████▊| 362647/371472 [6:41:51<42:27,  3.46it/s]
 98%|█████████▊| 362648/371472 [6:41:51<44:46,  3.28it/s]
 98%|█████████▊| 362649/371472 [6:41:52<43:17,  3.40it/s]
 98%|█████████▊| 362650/371472 [6:41:52<44:26,  3.31it/s]
 98%|█████████▊| 362651/371472 [6:41:52<41:47,  3.52it/s]
 98%|█████████▊| 362652/371472 [6:41:52<41:50,  3.51it/s]
 98%|█████████▊| 362653/371472 [6:41:53<43:40,  3.37it/s]
 98%|█████████▊| 362654/371472 [6:41:53<43:34,  3.37it/s]
 98%|█████████▊| 362655/371472 [6:41:53<41:43,  3.52it/s]
 98%|█████████▊| 362656/371472 [6:41:53<40:33,  3.62it/s]
 98%|█████████▊| 362657/371472 [6:41:54<39:48,  3.69it/s]
 98%|█████████▊| 362658/371472 [6:41:54<39:28,  3.72it/s]
 98%|█████████▊| 362659/371472 [6:41:54<38:53,  3.78it/s]
 98%|█████████▊| 362660/371472 [6:41:55<38:25,  3.82it/s]
                                                         
{'loss': 2.6908, 'learning_rate': 1.2136115839600076e-07, 'epoch': 15.62}

 98%|█████████▊| 362660/371472 [6:41:55<38:25,  3.82it/s]
 98%|█████████▊| 362661/371472 [6:41:55<39:56,  3.68it/s]
 98%|█████████▊| 362662/371472 [6:41:55<42:29,  3.46it/s]
 98%|█████████▊| 362663/371472 [6:41:55<45:03,  3.26it/s]
 98%|█████████▊| 362664/371472 [6:41:56<46:49,  3.14it/s]
 98%|█████████▊| 362665/371472 [6:41:56<46:02,  3.19it/s]
 98%|█████████▊| 362666/371472 [6:41:56<44:16,  3.31it/s]
 98%|█████████▊| 362667/371472 [6:41:57<42:26,  3.46it/s]
 98%|█████████▊| 362668/371472 [6:41:57<42:04,  3.49it/s]
 98%|█████████▊| 362669/371472 [6:41:57<41:24,  3.54it/s]
 98%|█████████▊| 362670/371472 [6:41:57<40:06,  3.66it/s]
 98%|█████████▊| 362671/371472 [6:41:58<39:18,  3.73it/s]
 98%|█████████▊| 362672/371472 [6:41:58<39:45,  3.69it/s]
 98%|█████████▊| 362673/371472 [6:41:58<38:43,  3.79it/s]
 98%|█████████▊| 362674/371472 [6:41:59<40:07,  3.65it/s]
 98%|█████████▊| 362675/371472 [6:41:59<41:25,  3.54it/s]
 98%|█████████▊| 362676/371472 [6:41:59<40:45,  3.60it/s]
 98%|█████████▊| 362677/371472 [6:41:59<43:55,  3.34it/s]
 98%|█████████▊| 362678/371472 [6:42:00<42:47,  3.42it/s]
 98%|█████████▊| 362679/371472 [6:42:00<40:38,  3.61it/s]
 98%|█████████▊| 362680/371472 [6:42:00<42:29,  3.45it/s]
                                                         
{'loss': 2.5963, 'learning_rate': 1.2131267642052193e-07, 'epoch': 15.62}

 98%|█████████▊| 362680/371472 [6:42:00<42:29,  3.45it/s]
 98%|█████████▊| 362681/371472 [6:42:01<45:13,  3.24it/s]
 98%|█████████▊| 362682/371472 [6:42:01<42:56,  3.41it/s]
 98%|█████████▊| 362683/371472 [6:42:01<43:07,  3.40it/s]
 98%|█████████▊| 362684/371472 [6:42:01<41:56,  3.49it/s]
 98%|█████████▊| 362685/371472 [6:42:02<41:15,  3.55it/s]
 98%|█████████▊| 362686/371472 [6:42:02<41:09,  3.56it/s]
 98%|█████████▊| 362687/371472 [6:42:02<42:14,  3.47it/s]
 98%|█████████▊| 362688/371472 [6:42:03<46:59,  3.12it/s]
 98%|█████████▊| 362689/371472 [6:42:03<43:44,  3.35it/s]
 98%|█████████▊| 362690/371472 [6:42:03<44:08,  3.32it/s]
 98%|█████████▊| 362691/371472 [6:42:04<41:49,  3.50it/s]
 98%|█████████▊| 362692/371472 [6:42:04<41:42,  3.51it/s]
 98%|█████████▊| 362693/371472 [6:42:04<41:11,  3.55it/s]
 98%|█████████▊| 362694/371472 [6:42:04<39:19,  3.72it/s]
 98%|█████████▊| 362695/371472 [6:42:05<38:30,  3.80it/s]
 98%|█████████▊| 362696/371472 [6:42:05<38:10,  3.83it/s]
 98%|█████████▊| 362697/371472 [6:42:05<39:01,  3.75it/s]
 98%|█████████▊| 362698/371472 [6:42:05<38:39,  3.78it/s]
 98%|█████████▊| 362699/371472 [6:42:06<38:39,  3.78it/s]
 98%|█████████▊| 362700/371472 [6:42:06<39:13,  3.73it/s]
                                                         
{'loss': 2.5804, 'learning_rate': 1.2126419444504298e-07, 'epoch': 15.62}

 98%|█████████▊| 362700/371472 [6:42:06<39:13,  3.73it/s]
 98%|█████████▊| 362701/371472 [6:42:06<44:13,  3.31it/s]
 98%|█████████▊| 362702/371472 [6:42:07<43:42,  3.34it/s]
 98%|█████████▊| 362703/371472 [6:42:07<42:50,  3.41it/s]
 98%|█████████▊| 362704/371472 [6:42:07<42:34,  3.43it/s]
 98%|█████████▊| 362705/371472 [6:42:07<41:16,  3.54it/s]
 98%|█████████▊| 362706/371472 [6:42:08<41:06,  3.55it/s]
 98%|█████████▊| 362707/371472 [6:42:08<40:08,  3.64it/s]
 98%|█████████▊| 362708/371472 [6:42:08<39:12,  3.73it/s]
 98%|█████████▊| 362709/371472 [6:42:08<38:57,  3.75it/s]
 98%|█████████▊| 362710/371472 [6:42:09<39:14,  3.72it/s]
 98%|█████████▊| 362711/371472 [6:42:09<38:56,  3.75it/s]
 98%|█████████▊| 362712/371472 [6:42:09<39:33,  3.69it/s]
 98%|█████████▊| 362713/371472 [6:42:10<40:41,  3.59it/s]
 98%|█████████▊| 362714/371472 [6:42:10<40:18,  3.62it/s]
 98%|█████████▊| 362715/371472 [6:42:10<38:33,  3.79it/s]
 98%|█████████▊| 362716/371472 [6:42:10<38:49,  3.76it/s]
 98%|█████████▊| 362717/371472 [6:42:11<38:20,  3.81it/s]
 98%|█████████▊| 362718/371472 [6:42:11<37:59,  3.84it/s]
 98%|█████████▊| 362719/371472 [6:42:11<37:14,  3.92it/s]
 98%|█████████▊| 362720/371472 [6:42:11<41:18,  3.53it/s]
                                                         
{'loss': 2.6059, 'learning_rate': 1.2121571246956413e-07, 'epoch': 15.62}

 98%|█████████▊| 362720/371472 [6:42:11<41:18,  3.53it/s]
 98%|█████████▊| 362721/371472 [6:42:12<41:26,  3.52it/s]
 98%|█████████▊| 362722/371472 [6:42:12<42:05,  3.46it/s]
 98%|█████████▊| 362723/371472 [6:42:12<41:38,  3.50it/s]
 98%|█████████▊| 362724/371472 [6:42:13<40:34,  3.59it/s]
 98%|█████████▊| 362725/371472 [6:42:13<41:51,  3.48it/s]
 98%|█████████▊| 362726/371472 [6:42:13<41:04,  3.55it/s]
 98%|█████████▊| 362727/371472 [6:42:13<40:39,  3.58it/s]
 98%|█████████▊| 362728/371472 [6:42:14<40:13,  3.62it/s]
 98%|█████████▊| 362729/371472 [6:42:14<40:27,  3.60it/s]
 98%|█████████▊| 362730/371472 [6:42:14<41:22,  3.52it/s]
 98%|█████████▊| 362731/371472 [6:42:15<41:23,  3.52it/s]
 98%|█████████▊| 362732/371472 [6:42:15<39:56,  3.65it/s]
 98%|█████████▊| 362733/371472 [6:42:15<41:20,  3.52it/s]
 98%|█████████▊| 362734/371472 [6:42:15<41:29,  3.51it/s]
 98%|█████████▊| 362735/371472 [6:42:16<40:22,  3.61it/s]
 98%|█████████▊| 362736/371472 [6:42:16<42:28,  3.43it/s]
 98%|█████████▊| 362737/371472 [6:42:16<42:10,  3.45it/s]
 98%|█████████▊| 362738/371472 [6:42:17<42:32,  3.42it/s]
 98%|█████████▊| 362739/371472 [6:42:17<42:06,  3.46it/s]
 98%|█████████▊| 362740/371472 [6:42:17<41:19,  3.52it/s]
                                                         
{'loss': 2.4746, 'learning_rate': 1.211672304940852e-07, 'epoch': 15.62}

 98%|█████████▊| 362740/371472 [6:42:17<41:19,  3.52it/s]
 98%|█████████▊| 362741/371472 [6:42:17<40:34,  3.59it/s]
 98%|█████████▊| 362742/371472 [6:42:18<41:17,  3.52it/s]
 98%|█████████▊| 362743/371472 [6:42:18<40:35,  3.58it/s]
 98%|█████████▊| 362744/371472 [6:42:18<40:35,  3.58it/s]
 98%|█████████▊| 362745/371472 [6:42:19<40:38,  3.58it/s]
 98%|█████████▊| 362746/371472 [6:42:19<40:44,  3.57it/s]
 98%|█████████▊| 362747/371472 [6:42:19<42:34,  3.41it/s]
 98%|█████████▊| 362748/371472 [6:42:19<41:14,  3.53it/s]
 98%|█████████▊| 362749/371472 [6:42:20<41:18,  3.52it/s]
 98%|█████████▊| 362750/371472 [6:42:20<41:22,  3.51it/s]
 98%|█████████▊| 362751/371472 [6:42:20<43:12,  3.36it/s]
 98%|█████████▊| 362752/371472 [6:42:21<42:38,  3.41it/s]
 98%|█████████▊| 362753/371472 [6:42:21<40:43,  3.57it/s]
 98%|█████████▊| 362754/371472 [6:42:21<40:04,  3.63it/s]
 98%|█████████▊| 362755/371472 [6:42:21<43:41,  3.32it/s]
 98%|█████████▊| 362756/371472 [6:42:22<43:02,  3.37it/s]
 98%|█████████▊| 362757/371472 [6:42:22<42:07,  3.45it/s]
 98%|█████████▊| 362758/371472 [6:42:22<42:50,  3.39it/s]
 98%|█████████▊| 362759/371472 [6:42:23<40:57,  3.55it/s]
 98%|█████████▊| 362760/371472 [6:42:23<41:49,  3.47it/s]
                                                         
{'loss': 2.4865, 'learning_rate': 1.2111874851860625e-07, 'epoch': 15.62}

 98%|█████████▊| 362760/371472 [6:42:23<41:49,  3.47it/s]
 98%|█████████▊| 362761/371472 [6:42:23<47:16,  3.07it/s]
 98%|█████████▊| 362762/371472 [6:42:24<47:04,  3.08it/s]
 98%|█████████▊| 362763/371472 [6:42:24<47:29,  3.06it/s]
 98%|█████████▊| 362764/371472 [6:42:24<44:50,  3.24it/s]
 98%|█████████▊| 362765/371472 [6:42:25<44:47,  3.24it/s]
 98%|█████████▊| 362766/371472 [6:42:25<42:32,  3.41it/s]
 98%|█████████▊| 362767/371472 [6:42:25<42:47,  3.39it/s]
 98%|█████████▊| 362768/371472 [6:42:25<42:07,  3.44it/s]
 98%|█████████▊| 362769/371472 [6:42:26<40:28,  3.58it/s]
 98%|█████████▊| 362770/371472 [6:42:26<38:54,  3.73it/s]
 98%|█████████▊| 362771/371472 [6:42:26<38:21,  3.78it/s]
 98%|█████████▊| 362772/371472 [6:42:26<38:20,  3.78it/s]
 98%|█████████▊| 362773/371472 [6:42:27<40:29,  3.58it/s]
 98%|█████████▊| 362774/371472 [6:42:27<41:59,  3.45it/s]
 98%|█████████▊| 362775/371472 [6:42:27<40:24,  3.59it/s]
 98%|█████████▊| 362776/371472 [6:42:28<40:09,  3.61it/s]
 98%|█████████▊| 362777/371472 [6:42:28<41:18,  3.51it/s]
 98%|█████████▊| 362778/371472 [6:42:28<40:09,  3.61it/s]
 98%|█████████▊| 362779/371472 [6:42:28<39:17,  3.69it/s]
 98%|█████████▊| 362780/371472 [6:42:29<39:08,  3.70it/s]
                                                         
{'loss': 2.634, 'learning_rate': 1.210702665431274e-07, 'epoch': 15.63}

 98%|█████████▊| 362780/371472 [6:42:29<39:08,  3.70it/s]
 98%|█████████▊| 362781/371472 [6:42:29<42:00,  3.45it/s]
 98%|█████████▊| 362782/371472 [6:42:29<39:57,  3.63it/s]
 98%|█████████▊| 362783/371472 [6:42:29<39:23,  3.68it/s]
 98%|█████████▊| 362784/371472 [6:42:30<40:09,  3.61it/s]
 98%|█████████▊| 362785/371472 [6:42:30<40:12,  3.60it/s]
 98%|█████████▊| 362786/371472 [6:42:30<40:39,  3.56it/s]
 98%|█████████▊| 362787/371472 [6:42:31<39:55,  3.63it/s]
 98%|█████████▊| 362788/371472 [6:42:31<38:55,  3.72it/s]
 98%|█████████▊| 362789/371472 [6:42:31<38:26,  3.76it/s]
 98%|█████████▊| 362790/371472 [6:42:31<39:55,  3.62it/s]
 98%|█████████▊| 362791/371472 [6:42:32<38:11,  3.79it/s]
 98%|█████████▊| 362792/371472 [6:42:32<40:24,  3.58it/s]
 98%|█████████▊| 362793/371472 [6:42:32<40:26,  3.58it/s]
 98%|█████████▊| 362794/371472 [6:42:32<39:55,  3.62it/s]
 98%|█████████▊| 362795/371472 [6:42:33<40:39,  3.56it/s]
 98%|█████████▊| 362796/371472 [6:42:33<39:53,  3.63it/s]
 98%|█████████▊| 362797/371472 [6:42:33<39:45,  3.64it/s]
 98%|█████████▊| 362798/371472 [6:42:34<41:19,  3.50it/s]
 98%|█████████▊| 362799/371472 [6:42:34<39:44,  3.64it/s]
 98%|█████████▊| 362800/371472 [6:42:34<43:00,  3.36it/s]
                                                         
{'loss': 2.6028, 'learning_rate': 1.2102178456764847e-07, 'epoch': 15.63}

 98%|█████████▊| 362800/371472 [6:42:34<43:00,  3.36it/s]
 98%|█████████▊| 362801/371472 [6:42:35<43:06,  3.35it/s]
 98%|█████████▊| 362802/371472 [6:42:35<41:41,  3.47it/s]
 98%|█████████▊| 362803/371472 [6:42:35<41:46,  3.46it/s]
 98%|█████████▊| 362804/371472 [6:42:35<41:17,  3.50it/s]
 98%|█████████▊| 362805/371472 [6:42:36<40:32,  3.56it/s]
 98%|█████████▊| 362806/371472 [6:42:36<40:47,  3.54it/s]
 98%|█████████▊| 362807/371472 [6:42:36<43:28,  3.32it/s]
 98%|█████████▊| 362808/371472 [6:42:37<42:14,  3.42it/s]
 98%|█████████▊| 362809/371472 [6:42:37<41:27,  3.48it/s]
 98%|█████████▊| 362810/371472 [6:42:37<39:48,  3.63it/s]
 98%|█████████▊| 362811/371472 [6:42:37<40:46,  3.54it/s]
 98%|█████████▊| 362812/371472 [6:42:38<43:31,  3.32it/s]
 98%|█████████▊| 362813/371472 [6:42:38<43:19,  3.33it/s]
 98%|█████████▊| 362814/371472 [6:42:38<43:43,  3.30it/s]
 98%|█████████▊| 362815/371472 [6:42:39<42:23,  3.40it/s]
 98%|█████████▊| 362816/371472 [6:42:39<41:30,  3.48it/s]
 98%|█████████▊| 362817/371472 [6:42:39<41:26,  3.48it/s]
 98%|█████████▊| 362818/371472 [6:42:40<45:45,  3.15it/s]
 98%|█████████▊| 362819/371472 [6:42:40<43:47,  3.29it/s]
 98%|█████████▊| 362820/371472 [6:42:40<42:18,  3.41it/s]
                                                         
{'loss': 2.55, 'learning_rate': 1.2097330259216962e-07, 'epoch': 15.63}

 98%|█████████▊| 362820/371472 [6:42:40<42:18,  3.41it/s]
 98%|█████████▊| 362821/371472 [6:42:40<40:18,  3.58it/s]
 98%|█████████▊| 362822/371472 [6:42:41<46:18,  3.11it/s]
 98%|█████████▊| 362823/371472 [6:42:41<43:31,  3.31it/s]
 98%|█████████▊| 362824/371472 [6:42:41<41:46,  3.45it/s]
 98%|█████████▊| 362825/371472 [6:42:42<42:24,  3.40it/s]
 98%|█████████▊| 362826/371472 [6:42:42<57:38,  2.50it/s]
 98%|█████████▊| 362827/371472 [6:42:43<52:40,  2.74it/s]
 98%|█████████▊| 362828/371472 [6:42:43<48:04,  3.00it/s]
 98%|█████████▊| 362829/371472 [6:42:43<44:58,  3.20it/s]
 98%|█████████▊| 362830/371472 [6:42:43<43:35,  3.30it/s]
 98%|█████████▊| 362831/371472 [6:42:44<42:00,  3.43it/s]
 98%|█████████▊| 362832/371472 [6:42:44<40:03,  3.59it/s]
 98%|█████████▊| 362833/371472 [6:42:44<42:56,  3.35it/s]
 98%|█████████▊| 362834/371472 [6:42:44<42:07,  3.42it/s]
 98%|█████████▊| 362835/371472 [6:42:45<40:08,  3.59it/s]
 98%|█████████▊| 362836/371472 [6:42:45<41:02,  3.51it/s]
 98%|█████████▊| 362837/371472 [6:42:45<42:31,  3.38it/s]
 98%|█████████▊| 362838/371472 [6:42:46<41:00,  3.51it/s]
 98%|█████████▊| 362839/371472 [6:42:46<39:11,  3.67it/s]
 98%|█████████▊| 362840/371472 [6:42:46<38:38,  3.72it/s]
                                                         
{'loss': 2.6876, 'learning_rate': 1.209248206166907e-07, 'epoch': 15.63}

 98%|█████████▊| 362840/371472 [6:42:46<38:38,  3.72it/s]
 98%|█████████▊| 362841/371472 [6:42:46<40:34,  3.54it/s]
 98%|█████████▊| 362842/371472 [6:42:47<40:44,  3.53it/s]
 98%|█████████▊| 362843/371472 [6:42:47<41:27,  3.47it/s]
 98%|█████████▊| 362844/371472 [6:42:47<40:43,  3.53it/s]
 98%|█████████▊| 362845/371472 [6:42:48<40:30,  3.55it/s]
 98%|█████████▊| 362846/371472 [6:42:48<41:34,  3.46it/s]
 98%|█████████▊| 362847/371472 [6:42:48<40:17,  3.57it/s]
 98%|█████████▊| 362848/371472 [6:42:48<41:50,  3.44it/s]
 98%|█████████▊| 362849/371472 [6:42:49<41:08,  3.49it/s]
 98%|█████████▊| 362850/371472 [6:42:49<39:07,  3.67it/s]
 98%|█████████▊| 362851/371472 [6:42:49<39:55,  3.60it/s]
 98%|█████████▊| 362852/371472 [6:42:50<40:56,  3.51it/s]
 98%|█████████▊| 362853/371472 [6:42:50<40:33,  3.54it/s]
 98%|█████████▊| 362854/371472 [6:42:50<43:54,  3.27it/s]
 98%|█████████▊| 362855/371472 [6:42:50<42:25,  3.39it/s]
 98%|█████████▊| 362856/371472 [6:42:51<42:19,  3.39it/s]
 98%|█████████▊| 362857/371472 [6:42:51<40:23,  3.55it/s]
 98%|█████████▊| 362858/371472 [6:42:51<38:40,  3.71it/s]
 98%|█████████▊| 362859/371472 [6:42:51<38:10,  3.76it/s]
 98%|█████████▊| 362860/371472 [6:42:52<36:50,  3.90it/s]
                                                         
{'loss': 2.6096, 'learning_rate': 1.2087633864121184e-07, 'epoch': 15.63}

 98%|█████████▊| 362860/371472 [6:42:52<36:50,  3.90it/s]
 98%|█████████▊| 362861/371472 [6:42:52<38:35,  3.72it/s]
 98%|█████████▊| 362862/371472 [6:42:52<37:42,  3.81it/s]
 98%|█████████▊| 362863/371472 [6:42:53<40:51,  3.51it/s]
 98%|█████████▊| 362864/371472 [6:42:53<39:31,  3.63it/s]
 98%|█████████▊| 362865/371472 [6:42:53<39:47,  3.60it/s]
 98%|█████████▊| 362866/371472 [6:42:53<39:29,  3.63it/s]
 98%|█████████▊| 362867/371472 [6:42:54<42:11,  3.40it/s]
 98%|█████████▊| 362868/371472 [6:42:54<41:39,  3.44it/s]
 98%|█████████▊| 362869/371472 [6:42:54<42:54,  3.34it/s]
 98%|█████████▊| 362870/371472 [6:42:55<42:47,  3.35it/s]
 98%|█████████▊| 362871/371472 [6:42:55<41:57,  3.42it/s]
 98%|█████████▊| 362872/371472 [6:42:55<43:14,  3.31it/s]
 98%|█████████▊| 362873/371472 [6:42:55<41:22,  3.46it/s]
 98%|█████████▊| 362874/371472 [6:42:56<40:28,  3.54it/s]
 98%|█████████▊| 362875/371472 [6:42:56<39:00,  3.67it/s]
 98%|█████████▊| 362876/371472 [6:42:56<40:36,  3.53it/s]
 98%|█████████▊| 362877/371472 [6:42:57<41:06,  3.48it/s]
 98%|█████████▊| 362878/371472 [6:42:57<42:49,  3.34it/s]
 98%|█████████▊| 362879/371472 [6:42:57<41:22,  3.46it/s]
 98%|█████████▊| 362880/371472 [6:42:57<39:21,  3.64it/s]
                                                         
{'loss': 2.4786, 'learning_rate': 1.2082785666573289e-07, 'epoch': 15.63}

 98%|█████████▊| 362880/371472 [6:42:57<39:21,  3.64it/s]
 98%|█████████▊| 362881/371472 [6:42:58<38:44,  3.70it/s]
 98%|█████████▊| 362882/371472 [6:42:58<41:22,  3.46it/s]
 98%|█████████▊| 362883/371472 [6:42:58<42:15,  3.39it/s]
 98%|█████████▊| 362884/371472 [6:42:59<40:37,  3.52it/s]
 98%|█████████▊| 362885/371472 [6:42:59<38:53,  3.68it/s]
 98%|█████████▊| 362886/371472 [6:42:59<38:18,  3.74it/s]
 98%|█████████▊| 362887/371472 [6:43:00<45:39,  3.13it/s]
 98%|█████████▊| 362888/371472 [6:43:00<44:00,  3.25it/s]
 98%|█████████▊| 362889/371472 [6:43:00<48:33,  2.95it/s]
 98%|█████████▊| 362890/371472 [6:43:01<47:26,  3.01it/s]
 98%|█████████▊| 362891/371472 [6:43:01<44:22,  3.22it/s]
 98%|█████████▊| 362892/371472 [6:43:01<44:44,  3.20it/s]
 98%|█████████▊| 362893/371472 [6:43:01<41:51,  3.42it/s]
 98%|█████████▊| 362894/371472 [6:43:02<40:34,  3.52it/s]
 98%|█████████▊| 362895/371472 [6:43:02<41:31,  3.44it/s]
 98%|█████████▊| 362896/371472 [6:43:02<41:47,  3.42it/s]
 98%|█████████▊| 362897/371472 [6:43:03<41:16,  3.46it/s]
 98%|█████████▊| 362898/371472 [6:43:03<43:10,  3.31it/s]
 98%|█████████▊| 362899/371472 [6:43:03<41:10,  3.47it/s]
 98%|█████████▊| 362900/371472 [6:43:03<42:13,  3.38it/s]
                                                         
{'loss': 2.71, 'learning_rate': 1.2077937469025406e-07, 'epoch': 15.63}

 98%|█████████▊| 362900/371472 [6:43:03<42:13,  3.38it/s]
 98%|█████████▊| 362901/371472 [6:43:04<40:46,  3.50it/s]
 98%|█████████▊| 362902/371472 [6:43:04<40:53,  3.49it/s]
 98%|█████████▊| 362903/371472 [6:43:04<40:31,  3.52it/s]
 98%|█████████▊| 362904/371472 [6:43:05<39:45,  3.59it/s]
 98%|█████████▊| 362905/371472 [6:43:05<39:12,  3.64it/s]
 98%|█████████▊| 362906/371472 [6:43:05<39:33,  3.61it/s]
 98%|█████████▊| 362907/371472 [6:43:05<39:09,  3.64it/s]
 98%|█████████▊| 362908/371472 [6:43:06<39:13,  3.64it/s]
 98%|█████████▊| 362909/371472 [6:43:06<39:21,  3.63it/s]
 98%|█████████▊| 362910/371472 [6:43:06<40:46,  3.50it/s]
 98%|█████████▊| 362911/371472 [6:43:06<40:38,  3.51it/s]
 98%|█████████▊| 362912/371472 [6:43:07<38:51,  3.67it/s]
 98%|█████████▊| 362913/371472 [6:43:07<38:47,  3.68it/s]
 98%|█████████▊| 362914/371472 [6:43:07<37:59,  3.75it/s]
 98%|█████████▊| 362915/371472 [6:43:07<37:37,  3.79it/s]
 98%|█████████▊| 362916/371472 [6:43:08<38:39,  3.69it/s]
 98%|█████████▊| 362917/371472 [6:43:08<40:21,  3.53it/s]
 98%|█████████▊| 362918/371472 [6:43:08<38:34,  3.70it/s]
 98%|█████████▊| 362919/371472 [6:43:09<38:26,  3.71it/s]
 98%|█████████▊| 362920/371472 [6:43:09<39:43,  3.59it/s]
                                                         
{'loss': 2.3971, 'learning_rate': 1.207308927147751e-07, 'epoch': 15.63}

 98%|█████████▊| 362920/371472 [6:43:09<39:43,  3.59it/s]
 98%|█████████▊| 362921/371472 [6:43:09<40:45,  3.50it/s]
 98%|█████████▊| 362922/371472 [6:43:09<39:17,  3.63it/s]
 98%|█████████▊| 362923/371472 [6:43:10<41:50,  3.40it/s]
 98%|█████████▊| 362924/371472 [6:43:10<40:58,  3.48it/s]
 98%|█████████▊| 362925/371472 [6:43:10<40:04,  3.56it/s]
 98%|█████████▊| 362926/371472 [6:43:11<40:01,  3.56it/s]
 98%|█████████▊| 362927/371472 [6:43:11<38:31,  3.70it/s]
 98%|█████████▊| 362928/371472 [6:43:11<39:28,  3.61it/s]
 98%|█████████▊| 362929/371472 [6:43:11<38:01,  3.74it/s]
 98%|█████████▊| 362930/371472 [6:43:12<40:36,  3.51it/s]
 98%|█████████▊| 362931/371472 [6:43:12<41:01,  3.47it/s]
 98%|█████████▊| 362932/371472 [6:43:12<38:53,  3.66it/s]
 98%|█████████▊| 362933/371472 [6:43:13<39:45,  3.58it/s]
 98%|█████████▊| 362934/371472 [6:43:13<38:18,  3.71it/s]
 98%|█████████▊| 362935/371472 [6:43:13<39:33,  3.60it/s]
 98%|█████████▊| 362936/371472 [6:43:13<40:04,  3.55it/s]
 98%|█████████▊| 362937/371472 [6:43:14<41:16,  3.45it/s]
 98%|█████████▊| 362938/371472 [6:43:14<40:54,  3.48it/s]
 98%|█████████▊| 362939/371472 [6:43:14<41:12,  3.45it/s]
 98%|█████████▊| 362940/371472 [6:43:15<43:13,  3.29it/s]
                                                         
{'loss': 2.6482, 'learning_rate': 1.2068241073929626e-07, 'epoch': 15.63}

 98%|█████████▊| 362940/371472 [6:43:15<43:13,  3.29it/s]
 98%|█████████▊| 362941/371472 [6:43:15<40:48,  3.48it/s]
 98%|█████████▊| 362942/371472 [6:43:15<39:06,  3.64it/s]
 98%|█████████▊| 362943/371472 [6:43:15<38:56,  3.65it/s]
 98%|█████████▊| 362944/371472 [6:43:16<37:59,  3.74it/s]
 98%|█████████▊| 362945/371472 [6:43:16<37:34,  3.78it/s]
 98%|█████████▊| 362946/371472 [6:43:16<37:50,  3.76it/s]
 98%|█████████▊| 362947/371472 [6:43:16<39:20,  3.61it/s]
 98%|█████████▊| 362948/371472 [6:43:17<43:03,  3.30it/s]
 98%|█████████▊| 362949/371472 [6:43:17<40:57,  3.47it/s]
 98%|█████████▊| 362950/371472 [6:43:17<38:52,  3.65it/s]
 98%|█████████▊| 362951/371472 [6:43:18<37:36,  3.78it/s]
 98%|█████████▊| 362952/371472 [6:43:18<36:55,  3.85it/s]
 98%|█████████▊| 362953/371472 [6:43:18<38:25,  3.70it/s]
 98%|█████████▊| 362954/371472 [6:43:18<40:35,  3.50it/s]
 98%|█████████▊| 362955/371472 [6:43:19<40:23,  3.51it/s]
 98%|█████████▊| 362956/371472 [6:43:19<42:48,  3.32it/s]
 98%|█████████▊| 362957/371472 [6:43:19<41:45,  3.40it/s]
 98%|█████████▊| 362958/371472 [6:43:20<39:46,  3.57it/s]
 98%|█████████▊| 362959/371472 [6:43:20<39:50,  3.56it/s]
 98%|█████████▊| 362960/371472 [6:43:20<39:19,  3.61it/s]
                                                         
{'loss': 2.6494, 'learning_rate': 1.2063392876381733e-07, 'epoch': 15.63}

 98%|█████████▊| 362960/371472 [6:43:20<39:19,  3.61it/s]
 98%|█████████▊| 362961/371472 [6:43:20<37:34,  3.77it/s]
 98%|█████████▊| 362962/371472 [6:43:21<38:22,  3.70it/s]
 98%|█████████▊| 362963/371472 [6:43:21<38:47,  3.66it/s]
 98%|█████████▊| 362964/371472 [6:43:21<39:48,  3.56it/s]
 98%|█████████▊| 362965/371472 [6:43:21<38:47,  3.65it/s]
 98%|█████████▊| 362966/371472 [6:43:22<39:36,  3.58it/s]
 98%|█████████▊| 362967/371472 [6:43:22<43:53,  3.23it/s]
 98%|█████████▊| 362968/371472 [6:43:22<42:10,  3.36it/s]
 98%|█████████▊| 362969/371472 [6:43:23<40:34,  3.49it/s]
 98%|█████████▊| 362970/371472 [6:43:23<39:14,  3.61it/s]
 98%|█████████▊| 362971/371472 [6:43:23<38:47,  3.65it/s]
 98%|█████████▊| 362972/371472 [6:43:23<38:28,  3.68it/s]
 98%|█████████▊| 362973/371472 [6:43:24<38:14,  3.70it/s]
 98%|█████████▊| 362974/371472 [6:43:24<40:10,  3.53it/s]
 98%|█████████▊| 362975/371472 [6:43:24<41:10,  3.44it/s]
 98%|█████████▊| 362976/371472 [6:43:25<40:17,  3.51it/s]
 98%|█████████▊| 362977/371472 [6:43:25<39:07,  3.62it/s]
 98%|█████████▊| 362978/371472 [6:43:25<39:36,  3.57it/s]
 98%|█████████▊| 362979/371472 [6:43:25<38:48,  3.65it/s]
 98%|█████████▊| 362980/371472 [6:43:26<40:42,  3.48it/s]
                                                         
{'loss': 2.6278, 'learning_rate': 1.2058544678833848e-07, 'epoch': 15.63}

 98%|█████████▊| 362980/371472 [6:43:26<40:42,  3.48it/s]
 98%|█████████▊| 362981/371472 [6:43:26<43:11,  3.28it/s]
 98%|█████████▊| 362982/371472 [6:43:26<45:49,  3.09it/s]
 98%|█████████▊| 362983/371472 [6:43:27<43:11,  3.28it/s]
 98%|█████████▊| 362984/371472 [6:43:27<40:51,  3.46it/s]
 98%|█████████▊| 362985/371472 [6:43:27<43:32,  3.25it/s]
 98%|█████████▊| 362986/371472 [6:43:28<43:32,  3.25it/s]
 98%|█████████▊| 362987/371472 [6:43:28<40:48,  3.46it/s]
 98%|█████████▊| 362988/371472 [6:43:28<42:28,  3.33it/s]
 98%|█████████▊| 362989/371472 [6:43:29<43:28,  3.25it/s]
 98%|█████████▊| 362990/371472 [6:43:29<44:47,  3.16it/s]
 98%|█████████▊| 362991/371472 [6:43:29<44:18,  3.19it/s]
 98%|█████████▊| 362992/371472 [6:43:30<45:12,  3.13it/s]
 98%|█████████▊| 362993/371472 [6:43:30<43:29,  3.25it/s]
 98%|█████████▊| 362994/371472 [6:43:30<41:13,  3.43it/s]
 98%|█████████▊| 362995/371472 [6:43:30<40:14,  3.51it/s]
 98%|█████████▊| 362996/371472 [6:43:31<40:32,  3.48it/s]
 98%|█████████▊| 362997/371472 [6:43:31<40:03,  3.53it/s]
 98%|█████████▊| 362998/371472 [6:43:31<42:18,  3.34it/s]
 98%|█████████▊| 362999/371472 [6:43:31<40:08,  3.52it/s]
 98%|█████████▊| 363000/371472 [6:43:32<39:01,  3.62it/s]
                                                         
{'loss': 2.5964, 'learning_rate': 1.2053696481285955e-07, 'epoch': 15.64}

 98%|█████████▊| 363000/371472 [6:43:32<39:01,  3.62it/s]
 98%|█████████▊| 363001/371472 [6:43:32<40:30,  3.49it/s]
 98%|█████████▊| 363002/371472 [6:43:32<40:57,  3.45it/s]
 98%|█████████▊| 363003/371472 [6:43:33<40:26,  3.49it/s]
 98%|█████████▊| 363004/371472 [6:43:33<40:29,  3.49it/s]
 98%|█████████▊| 363005/371472 [6:43:33<39:30,  3.57it/s]
 98%|█████████▊| 363006/371472 [6:43:33<38:28,  3.67it/s]
 98%|█████████▊| 363007/371472 [6:43:34<39:01,  3.62it/s]
 98%|█████████▊| 363008/371472 [6:43:34<37:40,  3.75it/s]
 98%|█████████▊| 363009/371472 [6:43:34<39:49,  3.54it/s]
 98%|█████████▊| 363010/371472 [6:43:35<37:49,  3.73it/s]
 98%|█████████▊| 363011/371472 [6:43:35<38:33,  3.66it/s]
 98%|█████████▊| 363012/371472 [6:43:35<38:50,  3.63it/s]
 98%|█████████▊| 363013/371472 [6:43:35<38:17,  3.68it/s]
 98%|█████████▊| 363014/371472 [6:43:36<39:20,  3.58it/s]
 98%|█████████▊| 363015/371472 [6:43:36<37:49,  3.73it/s]
 98%|█████████▊| 363016/371472 [6:43:36<38:02,  3.71it/s]
 98%|█████████▊| 363017/371472 [6:43:36<39:08,  3.60it/s]
 98%|█████████▊| 363018/371472 [6:43:37<39:54,  3.53it/s]
 98%|█████████▊| 363019/371472 [6:43:37<39:15,  3.59it/s]
 98%|█████████▊| 363020/371472 [6:43:37<39:26,  3.57it/s]
                                                         
{'loss': 2.5642, 'learning_rate': 1.204884828373807e-07, 'epoch': 15.64}

 98%|█████████▊| 363020/371472 [6:43:37<39:26,  3.57it/s]
 98%|█████████▊| 363021/371472 [6:43:38<39:37,  3.56it/s]
 98%|█████████▊| 363022/371472 [6:43:38<39:03,  3.61it/s]
 98%|█████████▊| 363023/371472 [6:43:38<39:00,  3.61it/s]
 98%|█████████▊| 363024/371472 [6:43:38<39:29,  3.57it/s]
 98%|█████████▊| 363025/371472 [6:43:39<38:35,  3.65it/s]
 98%|█████████▊| 363026/371472 [6:43:39<39:07,  3.60it/s]
 98%|█████████▊| 363027/371472 [6:43:39<38:57,  3.61it/s]
 98%|█████████▊| 363028/371472 [6:43:39<38:41,  3.64it/s]
 98%|█████████▊| 363029/371472 [6:43:40<37:24,  3.76it/s]
 98%|█████████▊| 363030/371472 [6:43:40<39:04,  3.60it/s]
 98%|█████████▊| 363031/371472 [6:43:40<38:56,  3.61it/s]
 98%|█████████▊| 363032/371472 [6:43:41<38:26,  3.66it/s]
 98%|█████████▊| 363033/371472 [6:43:41<43:38,  3.22it/s]
 98%|█████████▊| 363034/371472 [6:43:41<42:59,  3.27it/s]
 98%|█████████▊| 363035/371472 [6:43:42<42:13,  3.33it/s]
 98%|█████████▊| 363036/371472 [6:43:42<39:29,  3.56it/s]
 98%|█████████▊| 363037/371472 [6:43:42<37:56,  3.70it/s]
 98%|█████████▊| 363038/371472 [6:43:42<40:40,  3.46it/s]
 98%|█████████▊| 363039/371472 [6:43:43<40:15,  3.49it/s]
 98%|█████████▊| 363040/371472 [6:43:43<40:19,  3.49it/s]
                                                         
{'loss': 2.4696, 'learning_rate': 1.2044000086190175e-07, 'epoch': 15.64}

 98%|█████████▊| 363040/371472 [6:43:43<40:19,  3.49it/s]
 98%|█████████▊| 363041/371472 [6:43:43<41:44,  3.37it/s]
 98%|█████████▊| 363042/371472 [6:43:44<40:27,  3.47it/s]
 98%|█████████▊| 363043/371472 [6:43:44<41:08,  3.41it/s]
 98%|█████████▊| 363044/371472 [6:43:44<39:34,  3.55it/s]
 98%|█████████▊| 363045/371472 [6:43:44<38:45,  3.62it/s]
 98%|█████████▊| 363046/371472 [6:43:45<38:10,  3.68it/s]
 98%|█████████▊| 363047/371472 [6:43:45<37:50,  3.71it/s]
 98%|█████████▊| 363048/371472 [6:43:45<37:55,  3.70it/s]
 98%|█████████▊| 363049/371472 [6:43:45<37:54,  3.70it/s]
 98%|█████████▊| 363050/371472 [6:43:46<37:04,  3.79it/s]
 98%|█████████▊| 363051/371472 [6:43:46<38:26,  3.65it/s]
 98%|█████████▊| 363052/371472 [6:43:46<44:09,  3.18it/s]
 98%|█████████▊| 363053/371472 [6:43:47<42:25,  3.31it/s]
 98%|█████████▊| 363054/371472 [6:43:47<41:32,  3.38it/s]
 98%|█████████▊| 363055/371472 [6:43:47<41:51,  3.35it/s]
 98%|█████████▊| 363056/371472 [6:43:48<40:21,  3.48it/s]
 98%|█████████▊| 363057/371472 [6:43:48<39:04,  3.59it/s]
 98%|█████████▊| 363058/371472 [6:43:48<39:58,  3.51it/s]
 98%|█████████▊| 363059/371472 [6:43:48<38:44,  3.62it/s]
 98%|█████████▊| 363060/371472 [6:43:49<38:09,  3.67it/s]
                                                         
{'loss': 2.7335, 'learning_rate': 1.2039151888642293e-07, 'epoch': 15.64}

 98%|█████████▊| 363060/371472 [6:43:49<38:09,  3.67it/s]
 98%|█████████▊| 363061/371472 [6:43:49<38:48,  3.61it/s]
 98%|█████████▊| 363062/371472 [6:43:49<38:49,  3.61it/s]
 98%|█████████▊| 363063/371472 [6:43:49<40:42,  3.44it/s]
 98%|█████████▊| 363064/371472 [6:43:50<40:31,  3.46it/s]
 98%|█████████▊| 363065/371472 [6:43:50<39:58,  3.50it/s]
 98%|█████████▊| 363066/371472 [6:43:50<37:48,  3.71it/s]
 98%|█████████▊| 363067/371472 [6:43:51<38:07,  3.67it/s]
 98%|█████████▊| 363068/371472 [6:43:51<40:27,  3.46it/s]
 98%|█████████▊| 363069/371472 [6:43:51<41:00,  3.42it/s]
 98%|█████████▊| 363070/371472 [6:43:51<38:56,  3.60it/s]
 98%|█████████▊| 363071/371472 [6:43:52<37:42,  3.71it/s]
 98%|█████████▊| 363072/371472 [6:43:52<38:57,  3.59it/s]
 98%|█████████▊| 363073/371472 [6:43:52<43:28,  3.22it/s]
 98%|█████████▊| 363074/371472 [6:43:53<41:20,  3.39it/s]
 98%|█████████▊| 363075/371472 [6:43:53<39:42,  3.52it/s]
 98%|█████████▊| 363076/371472 [6:43:53<41:48,  3.35it/s]
 98%|█████████▊| 363077/371472 [6:43:53<40:17,  3.47it/s]
 98%|█████████▊| 363078/371472 [6:43:54<41:17,  3.39it/s]
 98%|█████████▊| 363079/371472 [6:43:54<39:19,  3.56it/s]
 98%|█████████▊| 363080/371472 [6:43:54<38:59,  3.59it/s]
                                                         
{'loss': 2.4981, 'learning_rate': 1.2034303691094397e-07, 'epoch': 15.64}

 98%|█████████▊| 363080/371472 [6:43:54<38:59,  3.59it/s]
 98%|█████████▊| 363081/371472 [6:43:55<39:25,  3.55it/s]
 98%|█████████▊| 363082/371472 [6:43:55<39:03,  3.58it/s]
 98%|█████████▊| 363083/371472 [6:43:55<38:56,  3.59it/s]
 98%|█████████▊| 363084/371472 [6:43:55<38:21,  3.64it/s]
 98%|█████████▊| 363085/371472 [6:43:56<36:54,  3.79it/s]
 98%|█████████▊| 363086/371472 [6:43:56<36:19,  3.85it/s]
 98%|█████████▊| 363087/371472 [6:43:56<38:19,  3.65it/s]
 98%|█████████▊| 363088/371472 [6:43:57<41:09,  3.40it/s]
 98%|█████████▊| 363089/371472 [6:43:57<40:46,  3.43it/s]
 98%|█████████▊| 363090/371472 [6:43:57<39:57,  3.50it/s]
 98%|█████████▊| 363091/371472 [6:43:57<40:54,  3.41it/s]
 98%|█████████▊| 363092/371472 [6:43:58<40:51,  3.42it/s]
 98%|█████████▊| 363093/371472 [6:43:58<41:12,  3.39it/s]
 98%|█████████▊| 363094/371472 [6:43:58<39:58,  3.49it/s]
 98%|█████████▊| 363095/371472 [6:43:59<39:10,  3.56it/s]
 98%|█████████▊| 363096/371472 [6:43:59<39:31,  3.53it/s]
 98%|█████████▊| 363097/371472 [6:43:59<40:58,  3.41it/s]
 98%|█████████▊| 363098/371472 [6:43:59<38:21,  3.64it/s]
 98%|█████████▊| 363099/371472 [6:44:00<37:20,  3.74it/s]
 98%|█████████▊| 363100/371472 [6:44:00<39:05,  3.57it/s]
                                                         
{'loss': 2.5884, 'learning_rate': 1.2029455493546512e-07, 'epoch': 15.64}

 98%|█████████▊| 363100/371472 [6:44:00<39:05,  3.57it/s]
 98%|█████████▊| 363101/371472 [6:44:00<39:32,  3.53it/s]
 98%|█████████▊| 363102/371472 [6:44:01<41:39,  3.35it/s]
 98%|█████████▊| 363103/371472 [6:44:01<40:09,  3.47it/s]
 98%|█████████▊| 363104/371472 [6:44:01<38:37,  3.61it/s]
 98%|█████████▊| 363105/371472 [6:44:01<39:07,  3.56it/s]
 98%|█████████▊| 363106/371472 [6:44:02<37:42,  3.70it/s]
 98%|█████████▊| 363107/371472 [6:44:02<36:29,  3.82it/s]
 98%|█████████▊| 363108/371472 [6:44:02<36:24,  3.83it/s]
 98%|█████████▊| 363109/371472 [6:44:02<36:35,  3.81it/s]
 98%|█████████▊| 363110/371472 [6:44:03<36:06,  3.86it/s]
 98%|█████████▊| 363111/371472 [6:44:03<38:08,  3.65it/s]
 98%|█████████▊| 363112/371472 [6:44:03<36:42,  3.79it/s]
 98%|█████████▊| 363113/371472 [6:44:03<38:52,  3.58it/s]
 98%|█████████▊| 363114/371472 [6:44:04<39:00,  3.57it/s]
 98%|█████████▊| 363115/371472 [6:44:04<38:44,  3.60it/s]
 98%|█████████▊| 363116/371472 [6:44:04<38:43,  3.60it/s]
 98%|█████████▊| 363117/371472 [6:44:05<37:26,  3.72it/s]
 98%|█████████▊| 363118/371472 [6:44:05<36:52,  3.77it/s]
 98%|█████████▊| 363119/371472 [6:44:05<36:35,  3.81it/s]
 98%|█████████▊| 363120/371472 [6:44:05<36:07,  3.85it/s]
                                                         
{'loss': 2.742, 'learning_rate': 1.202460729599862e-07, 'epoch': 15.64}

 98%|█████████▊| 363120/371472 [6:44:05<36:07,  3.85it/s]
 98%|█████████▊| 363121/371472 [6:44:06<36:46,  3.78it/s]
 98%|█████████▊| 363122/371472 [6:44:06<43:10,  3.22it/s]
 98%|█████████▊| 363123/371472 [6:44:06<44:21,  3.14it/s]
 98%|█████████▊| 363124/371472 [6:44:07<42:12,  3.30it/s]
 98%|█████████▊| 363125/371472 [6:44:07<39:46,  3.50it/s]
 98%|█████████▊| 363126/371472 [6:44:07<40:27,  3.44it/s]
 98%|█████████▊| 363127/371472 [6:44:07<38:56,  3.57it/s]
 98%|█████████▊| 363128/371472 [6:44:08<39:03,  3.56it/s]
 98%|█████████▊| 363129/371472 [6:44:08<37:31,  3.71it/s]
 98%|█████████▊| 363130/371472 [6:44:08<36:34,  3.80it/s]
 98%|█████████▊| 363131/371472 [6:44:08<36:25,  3.82it/s]
 98%|█████████▊| 363132/371472 [6:44:09<37:31,  3.70it/s]
 98%|█████████▊| 363133/371472 [6:44:09<38:39,  3.59it/s]
 98%|█████████▊| 363134/371472 [6:44:09<43:18,  3.21it/s]
 98%|█████████▊| 363135/371472 [6:44:10<42:58,  3.23it/s]
 98%|█████████▊| 363136/371472 [6:44:10<42:55,  3.24it/s]
 98%|█████████▊| 363137/371472 [6:44:10<40:28,  3.43it/s]
 98%|█████████▊| 363138/371472 [6:44:11<39:46,  3.49it/s]
 98%|█████████▊| 363139/371472 [6:44:11<39:09,  3.55it/s]
 98%|█████████▊| 363140/371472 [6:44:11<38:03,  3.65it/s]
                                                         
{'loss': 2.5444, 'learning_rate': 1.2019759098450734e-07, 'epoch': 15.64}

 98%|█████████▊| 363140/371472 [6:44:11<38:03,  3.65it/s]
 98%|█████████▊| 363141/371472 [6:44:11<37:51,  3.67it/s]
 98%|█████████▊| 363142/371472 [6:44:12<37:49,  3.67it/s]
 98%|█████████▊| 363143/371472 [6:44:12<39:03,  3.55it/s]
 98%|█████████▊| 363144/371472 [6:44:12<43:01,  3.23it/s]
 98%|█████████▊| 363145/371472 [6:44:13<41:24,  3.35it/s]
 98%|█████████▊| 363146/371472 [6:44:13<39:49,  3.48it/s]
 98%|█████████▊| 363147/371472 [6:44:13<38:52,  3.57it/s]
 98%|█████████▊| 363148/371472 [6:44:13<39:09,  3.54it/s]
 98%|█████████▊| 363149/371472 [6:44:14<40:42,  3.41it/s]
 98%|█████████▊| 363150/371472 [6:44:14<40:14,  3.45it/s]
 98%|█████████▊| 363151/371472 [6:44:14<39:36,  3.50it/s]
 98%|█████████▊| 363152/371472 [6:44:15<38:26,  3.61it/s]
 98%|█████████▊| 363153/371472 [6:44:15<38:15,  3.62it/s]
 98%|█████████▊| 363154/371472 [6:44:15<37:46,  3.67it/s]
 98%|█████████▊| 363155/371472 [6:44:15<37:30,  3.70it/s]
 98%|█████████▊| 363156/371472 [6:44:16<37:06,  3.73it/s]
 98%|█████████▊| 363157/371472 [6:44:16<36:44,  3.77it/s]
 98%|█████████▊| 363158/371472 [6:44:16<39:31,  3.51it/s]
 98%|█████████▊| 363159/371472 [6:44:16<38:45,  3.57it/s]
 98%|█████████▊| 363160/371472 [6:44:17<38:02,  3.64it/s]
                                                         
{'loss': 2.6159, 'learning_rate': 1.201491090090284e-07, 'epoch': 15.64}

 98%|█████████▊| 363160/371472 [6:44:17<38:02,  3.64it/s]
 98%|█████████▊| 363161/371472 [6:44:17<36:38,  3.78it/s]
 98%|█████████▊| 363162/371472 [6:44:17<40:30,  3.42it/s]
 98%|█████████▊| 363163/371472 [6:44:18<38:46,  3.57it/s]
 98%|█████████▊| 363164/371472 [6:44:18<38:08,  3.63it/s]
 98%|█████████▊| 363165/371472 [6:44:18<38:50,  3.56it/s]
 98%|█████████▊| 363166/371472 [6:44:18<38:12,  3.62it/s]
 98%|█████████▊| 363167/371472 [6:44:19<43:12,  3.20it/s]
 98%|█████████▊| 363168/371472 [6:44:19<40:29,  3.42it/s]
 98%|█████████▊| 363169/371472 [6:44:19<40:58,  3.38it/s]
 98%|█████████▊| 363170/371472 [6:44:20<40:41,  3.40it/s]
 98%|█████████▊| 363171/371472 [6:44:20<43:49,  3.16it/s]
 98%|█████████▊| 363172/371472 [6:44:20<41:03,  3.37it/s]
 98%|█████████▊| 363173/371472 [6:44:21<39:08,  3.53it/s]
 98%|█████████▊| 363174/371472 [6:44:21<40:54,  3.38it/s]
 98%|█████████▊| 363175/371472 [6:44:21<38:43,  3.57it/s]
 98%|█████████▊| 363176/371472 [6:44:21<38:07,  3.63it/s]
 98%|█████████▊| 363177/371472 [6:44:22<38:14,  3.62it/s]
 98%|█████████▊| 363178/371472 [6:44:22<37:18,  3.70it/s]
 98%|█████████▊| 363179/371472 [6:44:22<36:55,  3.74it/s]
 98%|█████████▊| 363180/371472 [6:44:22<37:24,  3.69it/s]
                                                         
{'loss': 2.6473, 'learning_rate': 1.2010062703354957e-07, 'epoch': 15.64}

 98%|█████████▊| 363180/371472 [6:44:22<37:24,  3.69it/s]
 98%|█████████▊| 363181/371472 [6:44:23<37:26,  3.69it/s]
 98%|█████████▊| 363182/371472 [6:44:23<37:32,  3.68it/s]
 98%|█████████▊| 363183/371472 [6:44:23<39:36,  3.49it/s]
 98%|█████████▊| 363184/371472 [6:44:24<39:07,  3.53it/s]
 98%|█████████▊| 363185/371472 [6:44:24<39:53,  3.46it/s]
 98%|█████████▊| 363186/371472 [6:44:24<38:05,  3.63it/s]
 98%|█████████▊| 363187/371472 [6:44:24<39:08,  3.53it/s]
 98%|█████████▊| 363188/371472 [6:44:25<38:30,  3.58it/s]
 98%|█████████▊| 363189/371472 [6:44:25<39:12,  3.52it/s]
 98%|█████████▊| 363190/371472 [6:44:25<39:17,  3.51it/s]
 98%|█████████▊| 363191/371472 [6:44:26<38:00,  3.63it/s]
 98%|█████████▊| 363192/371472 [6:44:26<38:53,  3.55it/s]
 98%|█████████▊| 363193/371472 [6:44:26<37:58,  3.63it/s]
 98%|█████████▊| 363194/371472 [6:44:26<37:45,  3.65it/s]
 98%|█████████▊| 363195/371472 [6:44:27<37:20,  3.69it/s]
 98%|█████████▊| 363196/371472 [6:44:27<41:17,  3.34it/s]
 98%|█████████▊| 363197/371472 [6:44:27<41:42,  3.31it/s]
 98%|█████████▊| 363198/371472 [6:44:28<40:14,  3.43it/s]
 98%|█████████▊| 363199/371472 [6:44:28<39:31,  3.49it/s]
 98%|█████████▊| 363200/371472 [6:44:28<40:41,  3.39it/s]
                                                         
{'loss': 2.4425, 'learning_rate': 1.200521450580706e-07, 'epoch': 15.64}

 98%|█████████▊| 363200/371472 [6:44:28<40:41,  3.39it/s]
 98%|█████████▊| 363201/371472 [6:44:28<39:08,  3.52it/s]
 98%|█████████▊| 363202/371472 [6:44:29<49:01,  2.81it/s]
 98%|█████████▊| 363203/371472 [6:44:29<45:50,  3.01it/s]
 98%|█████████▊| 363204/371472 [6:44:30<44:47,  3.08it/s]
 98%|█████████▊| 363205/371472 [6:44:30<43:17,  3.18it/s]
 98%|█████████▊| 363206/371472 [6:44:30<41:41,  3.30it/s]
 98%|█████████▊| 363207/371472 [6:44:30<39:45,  3.46it/s]
 98%|█████████▊| 363208/371472 [6:44:31<37:20,  3.69it/s]
 98%|█████████▊| 363209/371472 [6:44:31<38:25,  3.58it/s]
 98%|█████████▊| 363210/371472 [6:44:31<38:53,  3.54it/s]
 98%|█████████▊| 363211/371472 [6:44:31<37:53,  3.63it/s]
 98%|█████████▊| 363212/371472 [6:44:32<41:43,  3.30it/s]
 98%|█████████▊| 363213/371472 [6:44:32<41:05,  3.35it/s]
 98%|█████████▊| 363214/371472 [6:44:32<39:48,  3.46it/s]
 98%|█████████▊| 363215/371472 [6:44:33<39:42,  3.47it/s]
 98%|█████████▊| 363216/371472 [6:44:33<39:52,  3.45it/s]
 98%|█████████▊| 363217/371472 [6:44:33<38:48,  3.55it/s]
 98%|█████████▊| 363218/371472 [6:44:33<36:48,  3.74it/s]
 98%|█████████▊| 363219/371472 [6:44:34<36:51,  3.73it/s]
 98%|█████████▊| 363220/371472 [6:44:34<44:01,  3.12it/s]
                                                         
{'loss': 2.5308, 'learning_rate': 1.2000366308259176e-07, 'epoch': 15.64}

 98%|█████████▊| 363220/371472 [6:44:34<44:01,  3.12it/s]
 98%|█████████▊| 363221/371472 [6:44:34<43:12,  3.18it/s]
 98%|█████████▊| 363222/371472 [6:44:35<42:03,  3.27it/s]
 98%|█████████▊| 363223/371472 [6:44:35<39:34,  3.47it/s]
 98%|█████████▊| 363224/371472 [6:44:35<43:28,  3.16it/s]
 98%|█████████▊| 363225/371472 [6:44:36<41:18,  3.33it/s]
 98%|█████████▊| 363226/371472 [6:44:36<39:44,  3.46it/s]
 98%|█████████▊| 363227/371472 [6:44:36<38:43,  3.55it/s]
 98%|█████████▊| 363228/371472 [6:44:36<37:57,  3.62it/s]
 98%|█████████▊| 363229/371472 [6:44:37<36:56,  3.72it/s]
 98%|█████████▊| 363230/371472 [6:44:37<37:28,  3.66it/s]
 98%|█████████▊| 363231/371472 [6:44:37<36:53,  3.72it/s]
 98%|█████████▊| 363232/371472 [6:44:37<37:01,  3.71it/s]
 98%|█████████▊| 363233/371472 [6:44:38<37:55,  3.62it/s]
 98%|█████████▊| 363234/371472 [6:44:38<37:21,  3.67it/s]
 98%|█████████▊| 363235/371472 [6:44:38<36:55,  3.72it/s]
 98%|█████████▊| 363236/371472 [6:44:39<37:46,  3.63it/s]
 98%|█████████▊| 363237/371472 [6:44:39<38:15,  3.59it/s]
 98%|█████████▊| 363238/371472 [6:44:39<38:24,  3.57it/s]
 98%|█████████▊| 363239/371472 [6:44:39<38:10,  3.59it/s]
 98%|█████████▊| 363240/371472 [6:44:40<38:13,  3.59it/s]
                                                         
{'loss': 2.4085, 'learning_rate': 1.1995518110711283e-07, 'epoch': 15.65}

 98%|█████████▊| 363240/371472 [6:44:40<38:13,  3.59it/s]
 98%|█████████▊| 363241/371472 [6:44:40<37:02,  3.70it/s]
 98%|█████████▊| 363242/371472 [6:44:40<41:50,  3.28it/s]
 98%|█████████▊| 363243/371472 [6:44:41<40:43,  3.37it/s]
 98%|█████████▊| 363244/371472 [6:44:41<40:20,  3.40it/s]
 98%|█████████▊| 363245/371472 [6:44:41<42:23,  3.24it/s]
 98%|█████████▊| 363246/371472 [6:44:41<40:06,  3.42it/s]
 98%|█████████▊| 363247/371472 [6:44:42<38:03,  3.60it/s]
 98%|█████████▊| 363248/371472 [6:44:42<36:44,  3.73it/s]
 98%|█████████▊| 363249/371472 [6:44:42<36:54,  3.71it/s]
 98%|█████████▊| 363250/371472 [6:44:43<37:00,  3.70it/s]
 98%|█████████▊| 363251/371472 [6:44:43<37:07,  3.69it/s]
 98%|█████████▊| 363252/371472 [6:44:43<37:39,  3.64it/s]
 98%|█████████▊| 363253/371472 [6:44:43<37:31,  3.65it/s]
 98%|█████████▊| 363254/371472 [6:44:44<36:58,  3.70it/s]
 98%|█████████▊| 363255/371472 [6:44:44<37:15,  3.68it/s]
 98%|█████████▊| 363256/371472 [6:44:44<37:04,  3.69it/s]
 98%|█████████▊| 363257/371472 [6:44:44<37:45,  3.63it/s]
 98%|█████████▊| 363258/371472 [6:44:45<37:52,  3.61it/s]
 98%|█████████▊| 363259/371472 [6:44:45<36:12,  3.78it/s]
 98%|█████████▊| 363260/371472 [6:44:45<37:13,  3.68it/s]
                                                         
{'loss': 2.4244, 'learning_rate': 1.1990669913163399e-07, 'epoch': 15.65}

 98%|█████████▊| 363260/371472 [6:44:45<37:13,  3.68it/s]
 98%|█████████▊| 363261/371472 [6:44:46<37:52,  3.61it/s]
 98%|█████████▊| 363262/371472 [6:44:46<36:23,  3.76it/s]
 98%|█████████▊| 363263/371472 [6:44:46<37:38,  3.64it/s]
 98%|█████████▊| 363264/371472 [6:44:46<36:54,  3.71it/s]
 98%|█████████▊| 363265/371472 [6:44:47<36:13,  3.78it/s]
 98%|█████████▊| 363266/371472 [6:44:47<35:31,  3.85it/s]
 98%|█████████▊| 363267/371472 [6:44:47<36:01,  3.80it/s]
 98%|█████████▊| 363268/371472 [6:44:47<36:50,  3.71it/s]
 98%|█████████▊| 363269/371472 [6:44:48<35:56,  3.80it/s]
 98%|█████████▊| 363270/371472 [6:44:48<36:48,  3.71it/s]
 98%|█████████▊| 363271/371472 [6:44:48<36:44,  3.72it/s]
 98%|█████████▊| 363272/371472 [6:44:48<37:27,  3.65it/s]
 98%|█████████▊| 363273/371472 [6:44:49<37:27,  3.65it/s]
 98%|█████████▊| 363274/371472 [6:44:49<36:24,  3.75it/s]
 98%|█████████▊| 363275/371472 [6:44:49<36:58,  3.70it/s]
 98%|█████████▊| 363276/371472 [6:44:50<36:15,  3.77it/s]
 98%|█████████▊| 363277/371472 [6:44:50<41:39,  3.28it/s]
 98%|█████████▊| 363278/371472 [6:44:50<40:05,  3.41it/s]
 98%|█████████▊| 363279/371472 [6:44:50<40:04,  3.41it/s]
 98%|█████████▊| 363280/371472 [6:44:51<39:54,  3.42it/s]
                                                         
{'loss': 2.6898, 'learning_rate': 1.1985821715615506e-07, 'epoch': 15.65}

 98%|█████████▊| 363280/371472 [6:44:51<39:54,  3.42it/s]
 98%|█████████▊| 363281/371472 [6:44:51<40:14,  3.39it/s]
 98%|█████████▊| 363282/371472 [6:44:51<38:52,  3.51it/s]
 98%|█████████▊| 363283/371472 [6:44:52<38:12,  3.57it/s]
 98%|█████████▊| 363284/371472 [6:44:52<38:18,  3.56it/s]
 98%|█████████▊| 363285/371472 [6:44:52<38:10,  3.57it/s]
 98%|█████████▊| 363286/371472 [6:44:52<38:17,  3.56it/s]
 98%|█████████▊| 363287/371472 [6:44:53<37:11,  3.67it/s]
 98%|█████████▊| 363288/371472 [6:44:53<36:57,  3.69it/s]
 98%|█████████▊| 363289/371472 [6:44:53<37:03,  3.68it/s]
 98%|█████████▊| 363290/371472 [6:44:54<37:35,  3.63it/s]
 98%|█████████▊| 363291/371472 [6:44:54<36:27,  3.74it/s]
 98%|█████████▊| 363292/371472 [6:44:54<35:58,  3.79it/s]
 98%|█████████▊| 363293/371472 [6:44:54<36:46,  3.71it/s]
 98%|█████████▊| 363294/371472 [6:44:55<37:02,  3.68it/s]
 98%|█████████▊| 363295/371472 [6:44:55<36:21,  3.75it/s]
 98%|█████████▊| 363296/371472 [6:44:55<37:54,  3.59it/s]
 98%|█████████▊| 363297/371472 [6:44:55<37:29,  3.63it/s]
 98%|█████████▊| 363298/371472 [6:44:56<38:35,  3.53it/s]
 98%|█████████▊| 363299/371472 [6:44:56<38:22,  3.55it/s]
 98%|█████████▊| 363300/371472 [6:44:56<39:49,  3.42it/s]
                                                         
{'loss': 2.6376, 'learning_rate': 1.198097351806761e-07, 'epoch': 15.65}

 98%|█████████▊| 363300/371472 [6:44:56<39:49,  3.42it/s]
 98%|█████████▊| 363301/371472 [6:44:57<39:17,  3.47it/s]
 98%|█████████▊| 363302/371472 [6:44:57<38:36,  3.53it/s]
 98%|█████████▊| 363303/371472 [6:44:57<38:32,  3.53it/s]
 98%|█████████▊| 363304/371472 [6:44:57<37:52,  3.59it/s]
 98%|█████████▊| 363305/371472 [6:44:58<38:42,  3.52it/s]
 98%|█████████▊| 363306/371472 [6:44:58<37:46,  3.60it/s]
 98%|█████████▊| 363307/371472 [6:44:58<39:07,  3.48it/s]
 98%|█████████▊| 363308/371472 [6:44:59<37:38,  3.61it/s]
 98%|█████████▊| 363309/371472 [6:44:59<37:03,  3.67it/s]
 98%|█████████▊| 363310/371472 [6:44:59<36:05,  3.77it/s]
 98%|█████████▊| 363311/371472 [6:44:59<37:46,  3.60it/s]
 98%|█████████▊| 363312/371472 [6:45:00<37:46,  3.60it/s]
 98%|█████████▊| 363313/371472 [6:45:00<37:29,  3.63it/s]
 98%|█████████▊| 363314/371472 [6:45:00<36:50,  3.69it/s]
 98%|█████████▊| 363315/371472 [6:45:00<38:14,  3.56it/s]
 98%|█████████▊| 363316/371472 [6:45:01<39:38,  3.43it/s]
 98%|█████████▊| 363317/371472 [6:45:01<41:11,  3.30it/s]
 98%|█████████▊| 363318/371472 [6:45:01<40:10,  3.38it/s]
 98%|█████████▊| 363319/371472 [6:45:02<39:23,  3.45it/s]
 98%|█████████▊| 363320/371472 [6:45:02<39:09,  3.47it/s]
                                                         
{'loss': 2.5261, 'learning_rate': 1.1976125320519728e-07, 'epoch': 15.65}

 98%|█████████▊| 363320/371472 [6:45:02<39:09,  3.47it/s]
 98%|█████████▊| 363321/371472 [6:45:02<39:18,  3.46it/s]
 98%|█████████▊| 363322/371472 [6:45:03<41:44,  3.25it/s]
 98%|█████████▊| 363323/371472 [6:45:03<41:11,  3.30it/s]
 98%|█████████▊| 363324/371472 [6:45:03<39:35,  3.43it/s]
 98%|█████████▊| 363325/371472 [6:45:03<38:35,  3.52it/s]
 98%|█████████▊| 363326/371472 [6:45:04<38:41,  3.51it/s]
 98%|█████████▊| 363327/371472 [6:45:04<37:29,  3.62it/s]
 98%|█████████▊| 363328/371472 [6:45:04<38:26,  3.53it/s]
 98%|█████████▊| 363329/371472 [6:45:05<39:00,  3.48it/s]
 98%|█████████▊| 363330/371472 [6:45:05<38:35,  3.52it/s]
 98%|█████████▊| 363331/371472 [6:45:05<38:02,  3.57it/s]
 98%|█████████▊| 363332/371472 [6:45:05<39:33,  3.43it/s]
 98%|█████████▊| 363333/371472 [6:45:06<40:26,  3.35it/s]
 98%|█████████▊| 363334/371472 [6:45:06<41:19,  3.28it/s]
 98%|█████████▊| 363335/371472 [6:45:06<40:46,  3.33it/s]
 98%|█████████▊| 363336/371472 [6:45:07<39:27,  3.44it/s]
 98%|█████████▊| 363337/371472 [6:45:07<39:11,  3.46it/s]
 98%|█████████▊| 363338/371472 [6:45:07<36:59,  3.67it/s]
 98%|█████████▊| 363339/371472 [6:45:07<36:02,  3.76it/s]
 98%|█████████▊| 363340/371472 [6:45:08<37:49,  3.58it/s]
                                                         
{'loss': 2.5846, 'learning_rate': 1.1971277122971832e-07, 'epoch': 15.65}

 98%|█████████▊| 363340/371472 [6:45:08<37:49,  3.58it/s]
 98%|█████████▊| 363341/371472 [6:45:08<37:11,  3.64it/s]
 98%|█████████▊| 363342/371472 [6:45:08<38:22,  3.53it/s]
 98%|█████████▊| 363343/371472 [6:45:09<38:11,  3.55it/s]
 98%|█████████▊| 363344/371472 [6:45:09<40:10,  3.37it/s]
 98%|█████████▊| 363345/371472 [6:45:09<39:08,  3.46it/s]
 98%|█████████▊| 363346/371472 [6:45:09<37:54,  3.57it/s]
 98%|█████████▊| 363347/371472 [6:45:10<37:26,  3.62it/s]
 98%|█████████▊| 363348/371472 [6:45:10<38:21,  3.53it/s]
 98%|█████████▊| 363349/371472 [6:45:10<40:52,  3.31it/s]
 98%|█████████▊| 363350/371472 [6:45:11<39:38,  3.41it/s]
 98%|█████████▊| 363351/371472 [6:45:11<39:31,  3.42it/s]
 98%|█████████▊| 363352/371472 [6:45:11<38:14,  3.54it/s]
 98%|█████████▊| 363353/371472 [6:45:11<38:07,  3.55it/s]
 98%|█████████▊| 363354/371472 [6:45:12<37:41,  3.59it/s]
 98%|█████████▊| 363355/371472 [6:45:12<36:20,  3.72it/s]
 98%|█████████▊| 363356/371472 [6:45:12<36:32,  3.70it/s]
 98%|█████████▊| 363357/371472 [6:45:12<36:57,  3.66it/s]
 98%|█████████▊| 363358/371472 [6:45:13<37:11,  3.64it/s]
 98%|█████████▊| 363359/371472 [6:45:13<36:46,  3.68it/s]
 98%|█████████▊| 363360/371472 [6:45:13<35:54,  3.77it/s]
                                                         
{'loss': 2.5755, 'learning_rate': 1.1966428925423948e-07, 'epoch': 15.65}

 98%|█████████▊| 363360/371472 [6:45:13<35:54,  3.77it/s]
 98%|█████████▊| 363361/371472 [6:45:14<36:56,  3.66it/s]
 98%|█████████▊| 363362/371472 [6:45:14<37:01,  3.65it/s]
 98%|█████████▊| 363363/371472 [6:45:14<35:56,  3.76it/s]
 98%|█████████▊| 363364/371472 [6:45:14<37:22,  3.62it/s]
 98%|█████████▊| 363365/371472 [6:45:15<42:06,  3.21it/s]
 98%|█████████▊| 363366/371472 [6:45:15<45:04,  3.00it/s]
 98%|█████████▊| 363367/371472 [6:45:15<44:29,  3.04it/s]
 98%|█████████▊| 363368/371472 [6:45:16<41:55,  3.22it/s]
 98%|█████████▊| 363369/371472 [6:45:16<41:29,  3.26it/s]
 98%|█████████▊| 363370/371472 [6:45:16<40:30,  3.33it/s]
 98%|█████████▊| 363371/371472 [6:45:17<38:52,  3.47it/s]
 98%|█████████▊| 363372/371472 [6:45:17<38:30,  3.51it/s]
 98%|█████████▊| 363373/371472 [6:45:17<37:37,  3.59it/s]
 98%|█████████▊| 363374/371472 [6:45:17<37:07,  3.64it/s]
 98%|█████████▊| 363375/371472 [6:45:18<37:00,  3.65it/s]
 98%|█████████▊| 363376/371472 [6:45:18<35:19,  3.82it/s]
 98%|█████████▊| 363377/371472 [6:45:18<36:15,  3.72it/s]
 98%|█████████▊| 363378/371472 [6:45:18<36:02,  3.74it/s]
 98%|█████████▊| 363379/371472 [6:45:19<39:34,  3.41it/s]
 98%|█████████▊| 363380/371472 [6:45:19<38:13,  3.53it/s]
                                                         
{'loss': 2.4491, 'learning_rate': 1.1961580727876055e-07, 'epoch': 15.65}

 98%|█████████▊| 363380/371472 [6:45:19<38:13,  3.53it/s]
 98%|█████████▊| 363381/371472 [6:45:19<37:27,  3.60it/s]
 98%|█████████▊| 363382/371472 [6:45:20<36:59,  3.65it/s]
 98%|█████████▊| 363383/371472 [6:45:20<36:30,  3.69it/s]
 98%|█████████▊| 363384/371472 [6:45:20<36:53,  3.65it/s]
 98%|█████████▊| 363385/371472 [6:45:20<35:46,  3.77it/s]
 98%|█████████▊| 363386/371472 [6:45:21<37:14,  3.62it/s]
 98%|█████████▊| 363387/371472 [6:45:21<39:20,  3.42it/s]
 98%|█████████▊| 363388/371472 [6:45:21<38:41,  3.48it/s]
 98%|█████████▊| 363389/371472 [6:45:22<36:41,  3.67it/s]
 98%|█████████▊| 363390/371472 [6:45:22<36:39,  3.67it/s]
 98%|█████████▊| 363391/371472 [6:45:22<35:32,  3.79it/s]
 98%|█████████▊| 363392/371472 [6:45:22<34:45,  3.87it/s]
 98%|█████████▊| 363393/371472 [6:45:23<35:36,  3.78it/s]
 98%|█████████▊| 363394/371472 [6:45:23<37:09,  3.62it/s]
 98%|█████████▊| 363395/371472 [6:45:23<38:34,  3.49it/s]
 98%|█████████▊| 363396/371472 [6:45:24<40:27,  3.33it/s]
 98%|█████████▊| 363397/371472 [6:45:24<40:58,  3.28it/s]
 98%|█████████▊| 363398/371472 [6:45:24<42:16,  3.18it/s]
 98%|█████████▊| 363399/371472 [6:45:24<39:39,  3.39it/s]
 98%|█████████▊| 363400/371472 [6:45:25<37:54,  3.55it/s]
                                                         
{'loss': 2.5875, 'learning_rate': 1.195673253032817e-07, 'epoch': 15.65}

 98%|█████████▊| 363400/371472 [6:45:25<37:54,  3.55it/s]
 98%|█████████▊| 363401/371472 [6:45:25<37:54,  3.55it/s]
 98%|█████████▊| 363402/371472 [6:45:25<37:05,  3.63it/s]
 98%|█████████▊| 363403/371472 [6:45:26<37:07,  3.62it/s]
 98%|█████████▊| 363404/371472 [6:45:26<35:26,  3.79it/s]
 98%|█████████▊| 363405/371472 [6:45:26<40:55,  3.29it/s]
 98%|█████████▊| 363406/371472 [6:45:26<40:19,  3.33it/s]
 98%|█████████▊| 363407/371472 [6:45:27<41:34,  3.23it/s]
 98%|█████████▊| 363408/371472 [6:45:27<40:23,  3.33it/s]
 98%|█████████▊| 363409/371472 [6:45:27<38:24,  3.50it/s]
 98%|█████████▊| 363410/371472 [6:45:28<37:45,  3.56it/s]
 98%|█████████▊| 363411/371472 [6:45:28<42:00,  3.20it/s]
 98%|█████████▊| 363412/371472 [6:45:28<38:43,  3.47it/s]
 98%|█████████▊| 363413/371472 [6:45:28<38:27,  3.49it/s]
 98%|█████████▊| 363414/371472 [6:45:29<38:05,  3.53it/s]
 98%|█████████▊| 363415/371472 [6:45:29<37:00,  3.63it/s]
 98%|█████████▊| 363416/371472 [6:45:29<37:07,  3.62it/s]
 98%|█████████▊| 363417/371472 [6:45:30<36:18,  3.70it/s]
 98%|█████████▊| 363418/371472 [6:45:30<36:47,  3.65it/s]
 98%|█████████▊| 363419/371472 [6:45:30<37:41,  3.56it/s]
 98%|█████████▊| 363420/371472 [6:45:30<38:42,  3.47it/s]
                                                         
{'loss': 2.526, 'learning_rate': 1.1951884332780274e-07, 'epoch': 15.65}

 98%|█████████▊| 363420/371472 [6:45:30<38:42,  3.47it/s]
 98%|█████████▊| 363421/371472 [6:45:31<40:14,  3.33it/s]
 98%|█████████▊| 363422/371472 [6:45:31<39:07,  3.43it/s]
 98%|█████████▊| 363423/371472 [6:45:31<37:01,  3.62it/s]
 98%|█████████▊| 363424/371472 [6:45:32<39:23,  3.41it/s]
 98%|█████████▊| 363425/371472 [6:45:32<38:50,  3.45it/s]
 98%|█████████▊| 363426/371472 [6:45:32<39:45,  3.37it/s]
 98%|█████████▊| 363427/371472 [6:45:32<38:37,  3.47it/s]
 98%|█████████▊| 363428/371472 [6:45:33<37:23,  3.59it/s]
 98%|█████████▊| 363429/371472 [6:45:33<36:22,  3.68it/s]
 98%|█████████▊| 363430/371472 [6:45:33<36:14,  3.70it/s]
 98%|█████████▊| 363431/371472 [6:45:34<38:48,  3.45it/s]
 98%|█████████▊| 363432/371472 [6:45:34<37:49,  3.54it/s]
 98%|█████████▊| 363433/371472 [6:45:34<37:41,  3.55it/s]
 98%|█████████▊| 363434/371472 [6:45:34<36:43,  3.65it/s]
 98%|█████████▊| 363435/371472 [6:45:35<36:54,  3.63it/s]
 98%|█████████▊| 363436/371472 [6:45:35<36:58,  3.62it/s]
 98%|█████████▊| 363437/371472 [6:45:35<37:28,  3.57it/s]
 98%|█████████▊| 363438/371472 [6:45:36<38:11,  3.51it/s]
 98%|█████████▊| 363439/371472 [6:45:36<37:03,  3.61it/s]
 98%|█████████▊| 363440/371472 [6:45:36<37:16,  3.59it/s]
                                                         
{'loss': 2.6976, 'learning_rate': 1.1947036135232392e-07, 'epoch': 15.65}

 98%|█████████▊| 363440/371472 [6:45:36<37:16,  3.59it/s]
 98%|█████████▊| 363441/371472 [6:45:36<36:53,  3.63it/s]
 98%|█████████▊| 363442/371472 [6:45:37<38:28,  3.48it/s]
 98%|█████████▊| 363443/371472 [6:45:37<39:21,  3.40it/s]
 98%|█████████▊| 363444/371472 [6:45:37<38:05,  3.51it/s]
 98%|█████████▊| 363445/371472 [6:45:37<38:40,  3.46it/s]
 98%|█████████▊| 363446/371472 [6:45:38<39:06,  3.42it/s]
 98%|█████████▊| 363447/371472 [6:45:38<38:28,  3.48it/s]
 98%|█████████▊| 363448/371472 [6:45:38<41:33,  3.22it/s]
 98%|█████████▊| 363449/371472 [6:45:39<41:49,  3.20it/s]
 98%|█████████▊| 363450/371472 [6:45:39<39:35,  3.38it/s]
 98%|█████████▊| 363451/371472 [6:45:39<39:56,  3.35it/s]
 98%|█████████▊| 363452/371472 [6:45:40<38:46,  3.45it/s]
 98%|█████████▊| 363453/371472 [6:45:40<36:44,  3.64it/s]
 98%|█████████▊| 363454/371472 [6:45:40<39:34,  3.38it/s]
 98%|█████████▊| 363455/371472 [6:45:41<41:00,  3.26it/s]
 98%|█████████▊| 363456/371472 [6:45:41<39:51,  3.35it/s]
 98%|█████████▊| 363457/371472 [6:45:41<38:43,  3.45it/s]
 98%|█████████▊| 363458/371472 [6:45:41<38:22,  3.48it/s]
 98%|█████████▊| 363459/371472 [6:45:42<37:18,  3.58it/s]
 98%|█████████▊| 363460/371472 [6:45:42<39:46,  3.36it/s]
                                                         
{'loss': 2.4426, 'learning_rate': 1.1942187937684496e-07, 'epoch': 15.65}

 98%|█████████▊| 363460/371472 [6:45:42<39:46,  3.36it/s]
 98%|█████████▊| 363461/371472 [6:45:42<38:54,  3.43it/s]
 98%|█████████▊| 363462/371472 [6:45:42<37:10,  3.59it/s]
 98%|█████████▊| 363463/371472 [6:45:43<36:11,  3.69it/s]
 98%|█████████▊| 363464/371472 [6:45:43<35:15,  3.79it/s]
 98%|█████████▊| 363465/371472 [6:45:43<35:22,  3.77it/s]
 98%|█████████▊| 363466/371472 [6:45:44<36:47,  3.63it/s]
 98%|█████████▊| 363467/371472 [6:45:44<40:33,  3.29it/s]
 98%|█████████▊| 363468/371472 [6:45:44<38:28,  3.47it/s]
 98%|█████████▊| 363469/371472 [6:45:44<39:33,  3.37it/s]
 98%|█████████▊| 363470/371472 [6:45:45<37:59,  3.51it/s]
 98%|█████████▊| 363471/371472 [6:45:45<37:28,  3.56it/s]
 98%|█████████▊| 363472/371472 [6:45:45<38:07,  3.50it/s]
 98%|█████████▊| 363473/371472 [6:45:46<40:33,  3.29it/s]
 98%|█████████▊| 363474/371472 [6:45:46<38:54,  3.43it/s]
 98%|█████████▊| 363475/371472 [6:45:46<40:43,  3.27it/s]
 98%|█████████▊| 363476/371472 [6:45:47<38:50,  3.43it/s]
 98%|█████████▊| 363477/371472 [6:45:47<37:20,  3.57it/s]
 98%|█████████▊| 363478/371472 [6:45:47<37:00,  3.60it/s]
 98%|█████████▊| 363479/371472 [6:45:47<39:27,  3.38it/s]
 98%|█████████▊| 363480/371472 [6:45:48<39:34,  3.37it/s]
                                                         
{'loss': 2.3106, 'learning_rate': 1.1937339740136612e-07, 'epoch': 15.66}

 98%|█████████▊| 363480/371472 [6:45:48<39:34,  3.37it/s]
 98%|█████████▊| 363481/371472 [6:45:48<37:45,  3.53it/s]
 98%|█████████▊| 363482/371472 [6:45:48<40:34,  3.28it/s]
 98%|█████████▊| 363483/371472 [6:45:49<38:52,  3.43it/s]
 98%|█████████▊| 363484/371472 [6:45:49<37:29,  3.55it/s]
 98%|█████████▊| 363485/371472 [6:45:49<36:27,  3.65it/s]
 98%|█████████▊| 363486/371472 [6:45:49<35:53,  3.71it/s]
 98%|█████████▊| 363487/371472 [6:45:50<35:15,  3.77it/s]
 98%|█████████▊| 363488/371472 [6:45:50<35:57,  3.70it/s]
 98%|█████████▊| 363489/371472 [6:45:50<40:11,  3.31it/s]
 98%|█████████▊| 363490/371472 [6:45:51<40:14,  3.31it/s]
 98%|█████████▊| 363491/371472 [6:45:51<39:27,  3.37it/s]
 98%|█████████▊| 363492/371472 [6:45:51<38:13,  3.48it/s]
 98%|█████████▊| 363493/371472 [6:45:51<38:34,  3.45it/s]
 98%|█████████▊| 363494/371472 [6:45:52<37:48,  3.52it/s]
 98%|█████████▊| 363495/371472 [6:45:52<36:39,  3.63it/s]
 98%|█████████▊| 363496/371472 [6:45:52<35:37,  3.73it/s]
 98%|█████████▊| 363497/371472 [6:45:52<36:38,  3.63it/s]
 98%|█████████▊| 363498/371472 [6:45:53<38:06,  3.49it/s]
 98%|█████████▊| 363499/371472 [6:45:53<37:26,  3.55it/s]
 98%|█████████▊| 363500/371472 [6:45:53<37:40,  3.53it/s]
                                                         
{'loss': 2.5534, 'learning_rate': 1.193249154258872e-07, 'epoch': 15.66}

 98%|█████████▊| 363500/371472 [6:45:53<37:40,  3.53it/s]
 98%|█████████▊| 363501/371472 [6:45:54<37:12,  3.57it/s]
 98%|█████████▊| 363502/371472 [6:45:54<39:30,  3.36it/s]
 98%|█████████▊| 363503/371472 [6:45:54<38:16,  3.47it/s]
 98%|█████████▊| 363504/371472 [6:45:54<37:17,  3.56it/s]
 98%|█████████▊| 363505/371472 [6:45:55<36:32,  3.63it/s]
 98%|█████████▊| 363506/371472 [6:45:55<36:04,  3.68it/s]
 98%|█████████▊| 363507/371472 [6:45:55<39:15,  3.38it/s]
 98%|█████████▊| 363508/371472 [6:45:56<39:43,  3.34it/s]
 98%|█████████▊| 363509/371472 [6:45:56<38:10,  3.48it/s]
 98%|█████████▊| 363510/371472 [6:45:56<37:35,  3.53it/s]
 98%|█████████▊| 363511/371472 [6:45:57<40:37,  3.27it/s]
 98%|█████████▊| 363512/371472 [6:45:57<38:26,  3.45it/s]
 98%|█████████▊| 363513/371472 [6:45:57<36:52,  3.60it/s]
 98%|█████████▊| 363514/371472 [6:45:57<36:16,  3.66it/s]
 98%|█████████▊| 363515/371472 [6:45:58<35:31,  3.73it/s]
 98%|█████████▊| 363516/371472 [6:45:58<35:10,  3.77it/s]
 98%|█████████▊| 363517/371472 [6:45:58<34:28,  3.85it/s]
 98%|█████████▊| 363518/371472 [6:45:58<35:04,  3.78it/s]
 98%|█████████▊| 363519/371472 [6:45:59<34:09,  3.88it/s]
 98%|█████████▊| 363520/371472 [6:45:59<34:55,  3.79it/s]
                                                         
{'loss': 2.5937, 'learning_rate': 1.1927643345040834e-07, 'epoch': 15.66}

 98%|█████████▊| 363520/371472 [6:45:59<34:55,  3.79it/s]
 98%|█████████▊| 363521/371472 [6:45:59<36:22,  3.64it/s]
 98%|█████████▊| 363522/371472 [6:45:59<35:00,  3.78it/s]
 98%|█████████▊| 363523/371472 [6:46:00<35:08,  3.77it/s]
 98%|█████████▊| 363524/371472 [6:46:00<38:49,  3.41it/s]
 98%|█████████▊| 363525/371472 [6:46:00<40:26,  3.27it/s]
 98%|█████████▊| 363526/371472 [6:46:01<38:52,  3.41it/s]
 98%|█████████▊| 363527/371472 [6:46:01<38:22,  3.45it/s]
 98%|█████████▊| 363528/371472 [6:46:01<38:44,  3.42it/s]
 98%|█████████▊| 363529/371472 [6:46:01<38:23,  3.45it/s]
 98%|█████████▊| 363530/371472 [6:46:02<36:12,  3.65it/s]
 98%|█████████▊| 363531/371472 [6:46:02<36:49,  3.59it/s]
 98%|█████████▊| 363532/371472 [6:46:02<37:17,  3.55it/s]
 98%|█████████▊| 363533/371472 [6:46:03<36:11,  3.66it/s]
 98%|█████████▊| 363534/371472 [6:46:03<36:46,  3.60it/s]
 98%|█████████▊| 363535/371472 [6:46:03<36:44,  3.60it/s]
 98%|█████████▊| 363536/371472 [6:46:03<36:16,  3.65it/s]
 98%|█████████▊| 363537/371472 [6:46:04<35:30,  3.72it/s]
 98%|█████████▊| 363538/371472 [6:46:04<35:57,  3.68it/s]
 98%|█████████▊| 363539/371472 [6:46:04<35:57,  3.68it/s]
 98%|█████████▊| 363540/371472 [6:46:05<37:37,  3.51it/s]
                                                         
{'loss': 2.6376, 'learning_rate': 1.192279514749294e-07, 'epoch': 15.66}

 98%|█████████▊| 363540/371472 [6:46:05<37:37,  3.51it/s]
 98%|█████████▊| 363541/371472 [6:46:05<37:33,  3.52it/s]
 98%|█████████▊| 363542/371472 [6:46:05<36:32,  3.62it/s]
 98%|█████████▊| 363543/371472 [6:46:05<37:53,  3.49it/s]
 98%|█████████▊| 363544/371472 [6:46:06<36:09,  3.65it/s]
 98%|█████████▊| 363545/371472 [6:46:06<36:38,  3.61it/s]
 98%|█████████▊| 363546/371472 [6:46:06<36:34,  3.61it/s]
 98%|█████████▊| 363547/371472 [6:46:06<37:46,  3.50it/s]
 98%|█████████▊| 363548/371472 [6:46:07<36:45,  3.59it/s]
 98%|█████████▊| 363549/371472 [6:46:07<38:49,  3.40it/s]
 98%|█████████▊| 363550/371472 [6:46:07<40:28,  3.26it/s]
 98%|█████████▊| 363551/371472 [6:46:08<37:39,  3.51it/s]
 98%|█████████▊| 363552/371472 [6:46:08<36:57,  3.57it/s]
 98%|█████████▊| 363553/371472 [6:46:08<41:47,  3.16it/s]
 98%|█████████▊| 363554/371472 [6:46:09<39:46,  3.32it/s]
 98%|█████████▊| 363555/371472 [6:46:09<36:55,  3.57it/s]
 98%|█████████▊| 363556/371472 [6:46:09<37:03,  3.56it/s]
 98%|█████████▊| 363557/371472 [6:46:09<37:23,  3.53it/s]
 98%|█████████▊| 363558/371472 [6:46:10<35:37,  3.70it/s]
 98%|█████████▊| 363559/371472 [6:46:10<35:23,  3.73it/s]
 98%|█████████▊| 363560/371472 [6:46:10<36:00,  3.66it/s]
                                                         
{'loss': 2.5423, 'learning_rate': 1.1917946949945056e-07, 'epoch': 15.66}

 98%|█████████▊| 363560/371472 [6:46:10<36:00,  3.66it/s]
 98%|█████████▊| 363561/371472 [6:46:10<35:26,  3.72it/s]
 98%|█████████▊| 363562/371472 [6:46:11<35:14,  3.74it/s]
 98%|█████████▊| 363563/371472 [6:46:11<35:57,  3.67it/s]
 98%|█████████▊| 363564/371472 [6:46:11<35:05,  3.76it/s]
 98%|█████████▊| 363565/371472 [6:46:11<34:54,  3.78it/s]
 98%|█████████▊| 363566/371472 [6:46:12<34:08,  3.86it/s]
 98%|█████████▊| 363567/371472 [6:46:12<34:15,  3.85it/s]
 98%|█████████▊| 363568/371472 [6:46:12<35:12,  3.74it/s]
 98%|█████████▊| 363569/371472 [6:46:13<34:57,  3.77it/s]
 98%|█████████▊| 363570/371472 [6:46:13<35:02,  3.76it/s]
 98%|█████████▊| 363571/371472 [6:46:13<34:50,  3.78it/s]
 98%|█████████▊| 363572/371472 [6:46:13<35:27,  3.71it/s]
 98%|█████████▊| 363573/371472 [6:46:14<36:11,  3.64it/s]
 98%|█████████▊| 363574/371472 [6:46:14<35:52,  3.67it/s]
 98%|█████████▊| 363575/371472 [6:46:14<36:13,  3.63it/s]
 98%|█████████▊| 363576/371472 [6:46:14<36:45,  3.58it/s]
 98%|█████████▊| 363577/371472 [6:46:15<38:31,  3.41it/s]
 98%|█████████▊| 363578/371472 [6:46:15<39:00,  3.37it/s]
 98%|█████████▊| 363579/371472 [6:46:15<36:55,  3.56it/s]
 98%|█████████▊| 363580/371472 [6:46:16<36:05,  3.64it/s]
                                                         
{'loss': 2.489, 'learning_rate': 1.1913098752397162e-07, 'epoch': 15.66}

 98%|█████████▊| 363580/371472 [6:46:16<36:05,  3.64it/s]
 98%|█████████▊| 363581/371472 [6:46:16<35:14,  3.73it/s]
 98%|█████████▊| 363582/371472 [6:46:16<35:30,  3.70it/s]
 98%|█████████▊| 363583/371472 [6:46:16<35:24,  3.71it/s]
 98%|█████████▊| 363584/371472 [6:46:17<37:50,  3.47it/s]
 98%|█████████▊| 363585/371472 [6:46:17<37:57,  3.46it/s]
 98%|█████████▊| 363586/371472 [6:46:17<36:26,  3.61it/s]
 98%|█████████▊| 363587/371472 [6:46:18<36:14,  3.63it/s]
 98%|█████████▊| 363588/371472 [6:46:18<36:46,  3.57it/s]
 98%|█████████▊| 363589/371472 [6:46:18<35:32,  3.70it/s]
 98%|█████████▊| 363590/371472 [6:46:18<34:46,  3.78it/s]
 98%|█████████▊| 363591/371472 [6:46:19<36:25,  3.61it/s]
 98%|█████████▊| 363592/371472 [6:46:19<35:21,  3.72it/s]
 98%|█████████▊| 363593/371472 [6:46:19<35:25,  3.71it/s]
 98%|█████████▊| 363594/371472 [6:46:19<37:24,  3.51it/s]
 98%|█████████▊| 363595/371472 [6:46:20<36:22,  3.61it/s]
 98%|█████████▊| 363596/371472 [6:46:20<35:44,  3.67it/s]
 98%|█████████▊| 363597/371472 [6:46:20<34:24,  3.81it/s]
 98%|█████████▊| 363598/371472 [6:46:21<36:06,  3.63it/s]
 98%|█████████▊| 363599/371472 [6:46:21<39:53,  3.29it/s]
 98%|█████████▊| 363600/371472 [6:46:21<37:47,  3.47it/s]
                                                         
{'loss': 2.6304, 'learning_rate': 1.1908250554849277e-07, 'epoch': 15.66}

 98%|█████████▊| 363600/371472 [6:46:21<37:47,  3.47it/s]
 98%|█████████▊| 363601/371472 [6:46:21<36:49,  3.56it/s]
 98%|█████████▊| 363602/371472 [6:46:22<38:29,  3.41it/s]
 98%|█████████▊| 363603/371472 [6:46:22<37:37,  3.49it/s]
 98%|█████████▊| 363604/371472 [6:46:22<36:46,  3.57it/s]
 98%|█████████▊| 363605/371472 [6:46:23<35:38,  3.68it/s]
 98%|█████████▊| 363606/371472 [6:46:23<36:28,  3.59it/s]
 98%|█████████▊| 363607/371472 [6:46:23<36:03,  3.63it/s]
 98%|█████████▊| 363608/371472 [6:46:23<35:44,  3.67it/s]
 98%|█████████▊| 363609/371472 [6:46:24<38:23,  3.41it/s]
 98%|█████████▊| 363610/371472 [6:46:24<37:49,  3.46it/s]
 98%|█████████▊| 363611/371472 [6:46:24<36:37,  3.58it/s]
 98%|█████████▊| 363612/371472 [6:46:25<35:53,  3.65it/s]
 98%|█████████▊| 363613/371472 [6:46:25<35:24,  3.70it/s]
 98%|█████████▊| 363614/371472 [6:46:25<36:56,  3.54it/s]
 98%|█████████▊| 363615/371472 [6:46:25<39:17,  3.33it/s]
 98%|█████████▊| 363616/371472 [6:46:26<38:55,  3.36it/s]
 98%|█████████▊| 363617/371472 [6:46:26<37:56,  3.45it/s]
 98%|█████████▊| 363618/371472 [6:46:26<36:39,  3.57it/s]
 98%|█████████▊| 363619/371472 [6:46:27<36:09,  3.62it/s]
 98%|█████████▊| 363620/371472 [6:46:27<37:24,  3.50it/s]
                                                         
{'loss': 2.5457, 'learning_rate': 1.1903402357301383e-07, 'epoch': 15.66}

 98%|█████████▊| 363620/371472 [6:46:27<37:24,  3.50it/s]
 98%|█████████▊| 363621/371472 [6:46:27<36:20,  3.60it/s]
 98%|█████████▊| 363622/371472 [6:46:27<35:40,  3.67it/s]
 98%|█████████▊| 363623/371472 [6:46:28<34:33,  3.79it/s]
 98%|█████████▊| 363624/371472 [6:46:28<34:09,  3.83it/s]
 98%|█████████▊| 363625/371472 [6:46:28<35:51,  3.65it/s]
 98%|█████████▊| 363626/371472 [6:46:28<35:46,  3.66it/s]
 98%|█████████▊| 363627/371472 [6:46:29<34:53,  3.75it/s]
 98%|█████████▊| 363628/371472 [6:46:29<34:22,  3.80it/s]
 98%|█████████▊| 363629/371472 [6:46:29<33:45,  3.87it/s]
 98%|█████████▊| 363630/371472 [6:46:29<34:34,  3.78it/s]
 98%|█████████▊| 363631/371472 [6:46:30<34:03,  3.84it/s]
 98%|█████████▊| 363632/371472 [6:46:30<33:57,  3.85it/s]
 98%|█████████▊| 363633/371472 [6:46:30<34:56,  3.74it/s]
 98%|█████████▊| 363634/371472 [6:46:30<33:58,  3.84it/s]
 98%|█████████▊| 363635/371472 [6:46:31<35:35,  3.67it/s]
 98%|█████████▊| 363636/371472 [6:46:31<34:15,  3.81it/s]
 98%|█████████▊| 363637/371472 [6:46:31<34:10,  3.82it/s]
 98%|█████████▊| 363638/371472 [6:46:32<35:21,  3.69it/s]
 98%|█████████▊| 363639/371472 [6:46:32<36:23,  3.59it/s]
 98%|█████████▊| 363640/371472 [6:46:32<36:16,  3.60it/s]
                                                         
{'loss': 2.7068, 'learning_rate': 1.1898554159753499e-07, 'epoch': 15.66}

 98%|█████████▊| 363640/371472 [6:46:32<36:16,  3.60it/s]
 98%|█████████▊| 363641/371472 [6:46:32<35:09,  3.71it/s]
 98%|█████████▊| 363642/371472 [6:46:33<35:36,  3.66it/s]
 98%|█████████▊| 363643/371472 [6:46:33<35:55,  3.63it/s]
 98%|█████████▊| 363644/371472 [6:46:33<34:42,  3.76it/s]
 98%|█████████▊| 363645/371472 [6:46:33<34:50,  3.74it/s]
 98%|█████████▊| 363646/371472 [6:46:34<35:00,  3.73it/s]
 98%|█████████▊| 363647/371472 [6:46:34<35:45,  3.65it/s]
 98%|█████████▊| 363648/371472 [6:46:34<36:07,  3.61it/s]
 98%|█████████▊| 363649/371472 [6:46:35<36:25,  3.58it/s]
 98%|█████████▊| 363650/371472 [6:46:35<38:30,  3.39it/s]
 98%|█████████▊| 363651/371472 [6:46:35<37:44,  3.45it/s]
 98%|█████████▊| 363652/371472 [6:46:35<37:12,  3.50it/s]
 98%|█████████▊| 363653/371472 [6:46:36<35:54,  3.63it/s]
 98%|█████████▊| 363654/371472 [6:46:36<42:37,  3.06it/s]
 98%|█████████▊| 363655/371472 [6:46:36<40:36,  3.21it/s]
 98%|█████████▊| 363656/371472 [6:46:37<39:36,  3.29it/s]
 98%|█████████▊| 363657/371472 [6:46:37<37:49,  3.44it/s]
 98%|█████████▊| 363658/371472 [6:46:37<36:38,  3.55it/s]
 98%|█████████▊| 363659/371472 [6:46:38<36:23,  3.58it/s]
 98%|█████████▊| 363660/371472 [6:46:38<37:01,  3.52it/s]
                                                         
{'loss': 2.7249, 'learning_rate': 1.1893705962205605e-07, 'epoch': 15.66}

 98%|█████████▊| 363660/371472 [6:46:38<37:01,  3.52it/s]
 98%|█████████▊| 363661/371472 [6:46:38<38:07,  3.42it/s]
 98%|█████████▊| 363662/371472 [6:46:38<40:07,  3.24it/s]
 98%|█████████▊| 363663/371472 [6:46:39<40:04,  3.25it/s]
 98%|█████████▊| 363664/371472 [6:46:39<38:39,  3.37it/s]
 98%|█████████▊| 363665/371472 [6:46:39<37:22,  3.48it/s]
 98%|█████████▊| 363666/371472 [6:46:40<37:46,  3.44it/s]
 98%|█████████▊| 363667/371472 [6:46:40<37:21,  3.48it/s]
 98%|█████████▊| 363668/371472 [6:46:40<36:52,  3.53it/s]
 98%|█████████▊| 363669/371472 [6:46:40<36:09,  3.60it/s]
 98%|█████████▊| 363670/371472 [6:46:41<36:30,  3.56it/s]
 98%|█████████▊| 363671/371472 [6:46:41<35:00,  3.71it/s]
 98%|█████████▊| 363672/371472 [6:46:41<35:47,  3.63it/s]
 98%|█████████▊| 363673/371472 [6:46:42<34:53,  3.73it/s]
 98%|█████████▊| 363674/371472 [6:46:42<34:09,  3.80it/s]
 98%|█████████▊| 363675/371472 [6:46:42<33:44,  3.85it/s]
 98%|█████████▊| 363676/371472 [6:46:42<37:38,  3.45it/s]
 98%|█████████▊| 363677/371472 [6:46:43<36:36,  3.55it/s]
 98%|█████████▊| 363678/371472 [6:46:43<35:12,  3.69it/s]
 98%|█████████▊| 363679/371472 [6:46:43<34:37,  3.75it/s]
 98%|█████████▊| 363680/371472 [6:46:43<34:44,  3.74it/s]
                                                         
{'loss': 2.6517, 'learning_rate': 1.188885776465772e-07, 'epoch': 15.66}

 98%|█████████▊| 363680/371472 [6:46:43<34:44,  3.74it/s]
 98%|█████████▊| 363681/371472 [6:46:44<35:58,  3.61it/s]
 98%|█████████▊| 363682/371472 [6:46:44<36:09,  3.59it/s]
 98%|█████████▊| 363683/371472 [6:46:44<35:40,  3.64it/s]
 98%|█████████▊| 363684/371472 [6:46:45<36:24,  3.56it/s]
 98%|█████████▊| 363685/371472 [6:46:45<36:55,  3.52it/s]
 98%|█████████▊| 363686/371472 [6:46:45<35:34,  3.65it/s]
 98%|█████████▊| 363687/371472 [6:46:45<37:08,  3.49it/s]
 98%|█████████▊| 363688/371472 [6:46:46<35:07,  3.69it/s]
 98%|█████████▊| 363689/371472 [6:46:46<35:08,  3.69it/s]
 98%|█████████▊| 363690/371472 [6:46:46<35:35,  3.64it/s]
 98%|█████████▊| 363691/371472 [6:46:47<36:45,  3.53it/s]
 98%|█████████▊| 363692/371472 [6:46:47<35:58,  3.61it/s]
 98%|█████████▊| 363693/371472 [6:46:47<35:35,  3.64it/s]
 98%|█████████▊| 363694/371472 [6:46:47<35:56,  3.61it/s]
 98%|█████████▊| 363695/371472 [6:46:48<34:47,  3.73it/s]
 98%|█████████▊| 363696/371472 [6:46:48<34:51,  3.72it/s]
 98%|█████████▊| 363697/371472 [6:46:48<35:12,  3.68it/s]
 98%|█████████▊| 363698/371472 [6:46:48<34:39,  3.74it/s]
 98%|█████████▊| 363699/371472 [6:46:49<33:49,  3.83it/s]
 98%|█████████▊| 363700/371472 [6:46:49<34:44,  3.73it/s]
                                                         
{'loss': 2.5935, 'learning_rate': 1.1884009567109826e-07, 'epoch': 15.67}

 98%|█████████▊| 363700/371472 [6:46:49<34:44,  3.73it/s]
 98%|█████████▊| 363701/371472 [6:46:49<35:06,  3.69it/s]
 98%|█████████▊| 363702/371472 [6:46:49<34:07,  3.80it/s]
 98%|█████████▊| 363703/371472 [6:46:50<35:06,  3.69it/s]
 98%|█████████▊| 363704/371472 [6:46:50<34:23,  3.76it/s]
 98%|█████████▊| 363705/371472 [6:46:50<35:24,  3.66it/s]
 98%|█████████▊| 363706/371472 [6:46:51<34:49,  3.72it/s]
 98%|█████████▊| 363707/371472 [6:46:51<36:25,  3.55it/s]
 98%|█████████▊| 363708/371472 [6:46:51<36:17,  3.57it/s]
 98%|█████████▊| 363709/371472 [6:46:51<35:59,  3.59it/s]
 98%|█████████▊| 363710/371472 [6:46:52<36:16,  3.57it/s]
 98%|█████████▊| 363711/371472 [6:46:52<34:53,  3.71it/s]
 98%|█████████▊| 363712/371472 [6:46:52<35:46,  3.62it/s]
 98%|█████████▊| 363713/371472 [6:46:52<35:46,  3.62it/s]
 98%|█████████▊| 363714/371472 [6:46:53<36:19,  3.56it/s]
 98%|█████████▊| 363715/371472 [6:46:53<36:20,  3.56it/s]
 98%|█████████▊| 363716/371472 [6:46:53<35:37,  3.63it/s]
 98%|█████████▊| 363717/371472 [6:46:54<38:44,  3.34it/s]
 98%|█████████▊| 363718/371472 [6:46:54<40:32,  3.19it/s]
 98%|█████████▊| 363719/371472 [6:46:54<38:49,  3.33it/s]
 98%|█████████▊| 363720/371472 [6:46:55<38:47,  3.33it/s]
                                                         
{'loss': 2.5588, 'learning_rate': 1.1879161369561942e-07, 'epoch': 15.67}

 98%|█████████▊| 363720/371472 [6:46:55<38:47,  3.33it/s]
 98%|█████████▊| 363721/371472 [6:46:55<38:57,  3.32it/s]
 98%|█████████▊| 363722/371472 [6:46:55<39:21,  3.28it/s]
 98%|█████████▊| 363723/371472 [6:46:56<39:25,  3.28it/s]
 98%|█████████▊| 363724/371472 [6:46:56<36:55,  3.50it/s]
 98%|█████████▊| 363725/371472 [6:46:56<37:06,  3.48it/s]
 98%|█████████▊| 363726/371472 [6:46:56<36:46,  3.51it/s]
 98%|█████████▊| 363727/371472 [6:46:57<38:10,  3.38it/s]
 98%|█████████▊| 363728/371472 [6:46:57<37:04,  3.48it/s]
 98%|█████████▊| 363729/371472 [6:46:57<35:50,  3.60it/s]
 98%|█████████▊| 363730/371472 [6:46:58<39:05,  3.30it/s]
 98%|█████████▊| 363731/371472 [6:46:58<37:42,  3.42it/s]
 98%|█████████▊| 363732/371472 [6:46:58<38:09,  3.38it/s]
 98%|█████████▊| 363733/371472 [6:46:58<36:39,  3.52it/s]
 98%|█████████▊| 363734/371472 [6:46:59<36:15,  3.56it/s]
 98%|█████████▊| 363735/371472 [6:46:59<34:50,  3.70it/s]
 98%|█████████▊| 363736/371472 [6:46:59<35:15,  3.66it/s]
 98%|█████████▊| 363737/371472 [6:46:59<35:43,  3.61it/s]
 98%|█████████▊| 363738/371472 [6:47:00<35:31,  3.63it/s]
 98%|█████████▊| 363739/371472 [6:47:00<35:04,  3.67it/s]
 98%|█████████▊| 363740/371472 [6:47:00<36:45,  3.51it/s]
                                                         
{'loss': 2.4459, 'learning_rate': 1.1874313172014047e-07, 'epoch': 15.67}

 98%|█████████▊| 363740/371472 [6:47:00<36:45,  3.51it/s]
 98%|█████████▊| 363741/371472 [6:47:01<36:04,  3.57it/s]
 98%|█████████▊| 363742/371472 [6:47:01<35:25,  3.64it/s]
 98%|█████████▊| 363743/371472 [6:47:01<34:16,  3.76it/s]
 98%|█████████▊| 363744/371472 [6:47:01<35:17,  3.65it/s]
 98%|█████████▊| 363745/371472 [6:47:02<34:26,  3.74it/s]
 98%|█████████▊| 363746/371472 [6:47:02<35:36,  3.62it/s]
 98%|█████████▊| 363747/371472 [6:47:02<34:18,  3.75it/s]
 98%|█████████▊| 363748/371472 [6:47:02<34:57,  3.68it/s]
 98%|█████████▊| 363749/371472 [6:47:03<37:03,  3.47it/s]
 98%|█████████▊| 363750/371472 [6:47:03<34:57,  3.68it/s]
 98%|█████████▊| 363751/371472 [6:47:03<34:00,  3.78it/s]
 98%|█████████▊| 363752/371472 [6:47:04<34:37,  3.72it/s]
 98%|█████████▊| 363753/371472 [6:47:04<36:24,  3.53it/s]
 98%|█████████▊| 363754/371472 [6:47:04<34:27,  3.73it/s]
 98%|█████████▊| 363755/371472 [6:47:04<35:05,  3.67it/s]
 98%|█████████▊| 363756/371472 [6:47:05<34:36,  3.72it/s]
 98%|█████████▊| 363757/371472 [6:47:05<35:16,  3.64it/s]
 98%|█████████▊| 363758/371472 [6:47:05<35:26,  3.63it/s]
 98%|█████████▊| 363759/371472 [6:47:05<35:37,  3.61it/s]
 98%|█████████▊| 363760/371472 [6:47:06<35:55,  3.58it/s]
                                                         
{'loss': 2.5437, 'learning_rate': 1.1869464974466163e-07, 'epoch': 15.67}

 98%|█████████▊| 363760/371472 [6:47:06<35:55,  3.58it/s]
 98%|█████████▊| 363761/371472 [6:47:06<36:52,  3.49it/s]
 98%|█████████▊| 363762/371472 [6:47:06<37:42,  3.41it/s]
 98%|█████████▊| 363763/371472 [6:47:07<36:28,  3.52it/s]
 98%|█████████▊| 363764/371472 [6:47:07<38:34,  3.33it/s]
 98%|█████████▊| 363765/371472 [6:47:07<36:46,  3.49it/s]
 98%|█████████▊| 363766/371472 [6:47:07<36:14,  3.54it/s]
 98%|█████████▊| 363767/371472 [6:47:08<35:43,  3.59it/s]
 98%|█████████▊| 363768/371472 [6:47:08<35:19,  3.63it/s]
 98%|█████████▊| 363769/371472 [6:47:08<34:36,  3.71it/s]
 98%|█████████▊| 363770/371472 [6:47:09<35:00,  3.67it/s]
 98%|█████████▊| 363771/371472 [6:47:09<36:12,  3.54it/s]
 98%|█████████▊| 363772/371472 [6:47:09<38:30,  3.33it/s]
 98%|█████████▊| 363773/371472 [6:47:09<36:55,  3.47it/s]
 98%|█████████▊| 363774/371472 [6:47:10<37:18,  3.44it/s]
 98%|█████████▊| 363775/371472 [6:47:10<38:52,  3.30it/s]
 98%|█████████▊| 363776/371472 [6:47:10<37:18,  3.44it/s]
 98%|█████████▊| 363777/371472 [6:47:11<36:52,  3.48it/s]
 98%|█████████▊| 363778/371472 [6:47:11<35:06,  3.65it/s]
 98%|█████████▊| 363779/371472 [6:47:11<34:41,  3.70it/s]
 98%|█████████▊| 363780/371472 [6:47:11<34:59,  3.66it/s]
                                                         
{'loss': 2.5921, 'learning_rate': 1.1864616776918269e-07, 'epoch': 15.67}

 98%|█████████▊| 363780/371472 [6:47:11<34:59,  3.66it/s]
 98%|█████████▊| 363781/371472 [6:47:12<36:03,  3.56it/s]
 98%|█████████▊| 363782/371472 [6:47:12<36:17,  3.53it/s]
 98%|█████████▊| 363783/371472 [6:47:12<36:04,  3.55it/s]
 98%|█████████▊| 363784/371472 [6:47:13<41:43,  3.07it/s]
 98%|█████████▊| 363785/371472 [6:47:13<38:54,  3.29it/s]
 98%|█████████▊| 363786/371472 [6:47:13<36:35,  3.50it/s]
 98%|█████████▊| 363787/371472 [6:47:13<35:50,  3.57it/s]
 98%|█████████▊| 363788/371472 [6:47:14<35:47,  3.58it/s]
 98%|█████████▊| 363789/371472 [6:47:14<38:17,  3.34it/s]
 98%|█████████▊| 363790/371472 [6:47:14<38:02,  3.37it/s]
 98%|█████████▊| 363791/371472 [6:47:15<36:44,  3.48it/s]
 98%|█████████▊| 363792/371472 [6:47:15<35:38,  3.59it/s]
 98%|█████████▊| 363793/371472 [6:47:15<41:02,  3.12it/s]
 98%|█████████▊| 363794/371472 [6:47:16<37:56,  3.37it/s]
 98%|█████████▊| 363795/371472 [6:47:16<38:39,  3.31it/s]
 98%|█████████▊| 363796/371472 [6:47:16<38:45,  3.30it/s]
 98%|█████████▊| 363797/371472 [6:47:16<37:00,  3.46it/s]
 98%|█████████▊| 363798/371472 [6:47:17<36:48,  3.47it/s]
 98%|█████████▊| 363799/371472 [6:47:17<36:01,  3.55it/s]
 98%|█████████▊| 363800/371472 [6:47:17<34:35,  3.70it/s]
                                                         
{'loss': 2.6403, 'learning_rate': 1.1859768579370384e-07, 'epoch': 15.67}

 98%|█████████▊| 363800/371472 [6:47:17<34:35,  3.70it/s]
 98%|█████████▊| 363801/371472 [6:47:18<35:31,  3.60it/s]
 98%|█████████▊| 363802/371472 [6:47:18<36:27,  3.51it/s]
 98%|█████████▊| 363803/371472 [6:47:18<35:40,  3.58it/s]
 98%|█████████▊| 363804/371472 [6:47:19<39:42,  3.22it/s]
 98%|█████████▊| 363805/371472 [6:47:19<41:35,  3.07it/s]
 98%|█████████▊| 363806/371472 [6:47:19<39:41,  3.22it/s]
 98%|█████████▊| 363807/371472 [6:47:19<40:45,  3.13it/s]
 98%|█████████▊| 363808/371472 [6:47:20<41:25,  3.08it/s]
 98%|█████████▊| 363809/371472 [6:47:20<38:56,  3.28it/s]
 98%|█████████▊| 363810/371472 [6:47:20<36:52,  3.46it/s]
 98%|█████████▊| 363811/371472 [6:47:21<36:57,  3.46it/s]
 98%|█████████▊| 363812/371472 [6:47:21<37:32,  3.40it/s]
 98%|█████████▊| 363813/371472 [6:47:21<35:56,  3.55it/s]
 98%|█████████▊| 363814/371472 [6:47:21<35:03,  3.64it/s]
 98%|█████████▊| 363815/371472 [6:47:22<34:31,  3.70it/s]
 98%|█████████▊| 363816/371472 [6:47:22<34:07,  3.74it/s]
 98%|█████████▊| 363817/371472 [6:47:22<33:38,  3.79it/s]
 98%|█████████▊| 363818/371472 [6:47:22<34:41,  3.68it/s]
 98%|█████████▊| 363819/371472 [6:47:23<33:06,  3.85it/s]
 98%|█████████▊| 363820/371472 [6:47:23<33:38,  3.79it/s]
                                                         
{'loss': 2.8078, 'learning_rate': 1.1854920381822491e-07, 'epoch': 15.67}

 98%|█████████▊| 363820/371472 [6:47:23<33:38,  3.79it/s]
 98%|█████████▊| 363821/371472 [6:47:23<39:45,  3.21it/s]
 98%|█████████▊| 363822/371472 [6:47:24<38:19,  3.33it/s]
 98%|█████████▊| 363823/371472 [6:47:24<37:19,  3.41it/s]
 98%|█████████▊| 363824/371472 [6:47:24<35:51,  3.56it/s]
 98%|█████████▊| 363825/371472 [6:47:24<34:52,  3.65it/s]
 98%|█████████▊| 363826/371472 [6:47:25<34:18,  3.71it/s]
 98%|█████████▊| 363827/371472 [6:47:25<37:23,  3.41it/s]
 98%|█████████▊| 363828/371472 [6:47:25<37:17,  3.42it/s]
 98%|█████████▊| 363829/371472 [6:47:26<39:29,  3.23it/s]
 98%|█████████▊| 363830/371472 [6:47:26<38:08,  3.34it/s]
 98%|█████████▊| 363831/371472 [6:47:26<39:40,  3.21it/s]
 98%|█████████▊| 363832/371472 [6:47:27<38:44,  3.29it/s]
 98%|█████████▊| 363833/371472 [6:47:27<38:34,  3.30it/s]
 98%|█████████▊| 363834/371472 [6:47:27<37:14,  3.42it/s]
 98%|█████████▊| 363835/371472 [6:47:27<36:14,  3.51it/s]
 98%|█████████▊| 363836/371472 [6:47:28<36:14,  3.51it/s]
 98%|█████████▊| 363837/371472 [6:47:28<35:26,  3.59it/s]
 98%|█████████▊| 363838/371472 [6:47:28<35:21,  3.60it/s]
 98%|█████████▊| 363839/371472 [6:47:29<34:38,  3.67it/s]
 98%|█████████▊| 363840/371472 [6:47:29<33:58,  3.74it/s]
                                                         
{'loss': 2.3763, 'learning_rate': 1.1850072184274596e-07, 'epoch': 15.67}

 98%|█████████▊| 363840/371472 [6:47:29<33:58,  3.74it/s]
 98%|█████████▊| 363841/371472 [6:47:29<34:14,  3.71it/s]
 98%|█████████▊| 363842/371472 [6:47:29<33:37,  3.78it/s]
 98%|█████████▊| 363843/371472 [6:47:30<35:18,  3.60it/s]
 98%|█████████▊| 363844/371472 [6:47:30<33:49,  3.76it/s]
 98%|█████████▊| 363845/371472 [6:47:30<34:10,  3.72it/s]
 98%|█████████▊| 363846/371472 [6:47:30<35:56,  3.54it/s]
 98%|█████████▊| 363847/371472 [6:47:31<37:43,  3.37it/s]
 98%|█████████▊| 363848/371472 [6:47:31<37:25,  3.40it/s]
 98%|█████████▊| 363849/371472 [6:47:31<37:59,  3.34it/s]
 98%|█████████▊| 363850/371472 [6:47:32<38:10,  3.33it/s]
 98%|█████████▊| 363851/371472 [6:47:32<36:40,  3.46it/s]
 98%|█████████▊| 363852/371472 [6:47:32<36:42,  3.46it/s]
 98%|█████████▊| 363853/371472 [6:47:33<34:56,  3.63it/s]
 98%|█████████▊| 363854/371472 [6:47:33<35:34,  3.57it/s]
 98%|█████████▊| 363855/371472 [6:47:33<34:59,  3.63it/s]
 98%|█████████▊| 363856/371472 [6:47:33<34:41,  3.66it/s]
 98%|█████████▊| 363857/371472 [6:47:34<33:09,  3.83it/s]
 98%|█████████▊| 363858/371472 [6:47:34<32:55,  3.85it/s]
 98%|█████████▊| 363859/371472 [6:47:34<32:53,  3.86it/s]
 98%|█████████▊| 363860/371472 [6:47:34<34:25,  3.69it/s]
                                                         
{'loss': 2.4756, 'learning_rate': 1.1845223986726712e-07, 'epoch': 15.67}

 98%|█████████▊| 363860/371472 [6:47:34<34:25,  3.69it/s]
 98%|█████████▊| 363861/371472 [6:47:35<34:30,  3.68it/s]
 98%|█████████▊| 363862/371472 [6:47:35<34:06,  3.72it/s]
 98%|█████████▊| 363863/371472 [6:47:35<33:49,  3.75it/s]
 98%|█████████▊| 363864/371472 [6:47:35<35:30,  3.57it/s]
 98%|█████████▊| 363865/371472 [6:47:36<35:44,  3.55it/s]
 98%|█████████▊| 363866/371472 [6:47:36<35:25,  3.58it/s]
 98%|█████████▊| 363867/371472 [6:47:36<35:13,  3.60it/s]
 98%|█████████▊| 363868/371472 [6:47:37<34:51,  3.64it/s]
 98%|█████████▊| 363869/371472 [6:47:37<34:45,  3.65it/s]
 98%|█████████▊| 363870/371472 [6:47:37<35:23,  3.58it/s]
 98%|█████████▊| 363871/371472 [6:47:37<35:24,  3.58it/s]
 98%|█████████▊| 363872/371472 [6:47:38<34:48,  3.64it/s]
 98%|█████████▊| 363873/371472 [6:47:38<34:05,  3.72it/s]
 98%|█████████▊| 363874/371472 [6:47:38<35:58,  3.52it/s]
 98%|█████████▊| 363875/371472 [6:47:39<35:19,  3.58it/s]
 98%|█████████▊| 363876/371472 [6:47:39<35:08,  3.60it/s]
 98%|█████████▊| 363877/371472 [6:47:39<35:18,  3.58it/s]
 98%|█████████▊| 363878/371472 [6:47:39<34:16,  3.69it/s]
 98%|█████████▊| 363879/371472 [6:47:40<36:01,  3.51it/s]
 98%|█████████▊| 363880/371472 [6:47:40<35:39,  3.55it/s]
                                                         
{'loss': 2.4845, 'learning_rate': 1.1840375789178818e-07, 'epoch': 15.67}

 98%|█████████▊| 363880/371472 [6:47:40<35:39,  3.55it/s]
 98%|█████████▊| 363881/371472 [6:47:40<34:46,  3.64it/s]
 98%|█████████▊| 363882/371472 [6:47:40<35:16,  3.59it/s]
 98%|█████████▊| 363883/371472 [6:47:41<34:53,  3.62it/s]
 98%|█████████▊| 363884/371472 [6:47:41<33:34,  3.77it/s]
 98%|█████████▊| 363885/371472 [6:47:41<32:55,  3.84it/s]
 98%|█████████▊| 363886/371472 [6:47:42<35:06,  3.60it/s]
 98%|█████████▊| 363887/371472 [6:47:42<35:46,  3.53it/s]
 98%|█████████▊| 363888/371472 [6:47:42<35:37,  3.55it/s]
 98%|█████████▊| 363889/371472 [6:47:42<36:06,  3.50it/s]
 98%|█████████▊| 363890/371472 [6:47:43<34:03,  3.71it/s]
 98%|█████████▊| 363891/371472 [6:47:43<35:21,  3.57it/s]
 98%|█████████▊| 363892/371472 [6:47:43<34:22,  3.67it/s]
 98%|█████████▊| 363893/371472 [6:47:44<35:16,  3.58it/s]
 98%|█████████▊| 363894/371472 [6:47:44<36:55,  3.42it/s]
 98%|█████████▊| 363895/371472 [6:47:44<35:35,  3.55it/s]
 98%|█████████▊| 363896/371472 [6:47:44<34:49,  3.63it/s]
 98%|█████████▊| 363897/371472 [6:47:45<34:36,  3.65it/s]
 98%|█████████▊| 363898/371472 [6:47:45<34:14,  3.69it/s]
 98%|█████████▊| 363899/371472 [6:47:45<33:46,  3.74it/s]
 98%|█████████▊| 363900/371472 [6:47:45<33:47,  3.73it/s]
                                                         
{'loss': 2.648, 'learning_rate': 1.1835527591630933e-07, 'epoch': 15.67}

 98%|█████████▊| 363900/371472 [6:47:45<33:47,  3.73it/s]
 98%|█████████▊| 363901/371472 [6:47:46<33:35,  3.76it/s]
 98%|█████████▊| 363902/371472 [6:47:46<33:18,  3.79it/s]
 98%|█████████▊| 363903/371472 [6:47:46<34:02,  3.71it/s]
 98%|█████████▊| 363904/371472 [6:47:46<33:36,  3.75it/s]
 98%|█████████▊| 363905/371472 [6:47:47<32:54,  3.83it/s]
 98%|█████████▊| 363906/371472 [6:47:47<32:10,  3.92it/s]
 98%|█████████▊| 363907/371472 [6:47:47<33:33,  3.76it/s]
 98%|█████████▊| 363908/371472 [6:47:48<33:13,  3.79it/s]
 98%|█████████▊| 363909/371472 [6:47:48<34:25,  3.66it/s]
 98%|█████████▊| 363910/371472 [6:47:48<38:39,  3.26it/s]
 98%|█████████▊| 363911/371472 [6:47:48<37:16,  3.38it/s]
 98%|█████████▊| 363912/371472 [6:47:49<38:14,  3.29it/s]
 98%|█████████▊| 363913/371472 [6:47:49<37:15,  3.38it/s]
 98%|█████████▊| 363914/371472 [6:47:49<37:30,  3.36it/s]
 98%|█████████▊| 363915/371472 [6:47:50<38:21,  3.28it/s]
 98%|█████████▊| 363916/371472 [6:47:50<37:39,  3.34it/s]
 98%|█████████▊| 363917/371472 [6:47:50<37:28,  3.36it/s]
 98%|█████████▊| 363918/371472 [6:47:51<36:41,  3.43it/s]
 98%|█████████▊| 363919/371472 [6:47:51<35:47,  3.52it/s]
 98%|█████████▊| 363920/371472 [6:47:51<37:24,  3.36it/s]
                                                         
{'loss': 2.6715, 'learning_rate': 1.183067939408304e-07, 'epoch': 15.67}

 98%|█████████▊| 363920/371472 [6:47:51<37:24,  3.36it/s]
 98%|█████████▊| 363921/371472 [6:47:51<37:30,  3.36it/s]
 98%|█████████▊| 363922/371472 [6:47:52<38:16,  3.29it/s]
 98%|█████████▊| 363923/371472 [6:47:52<38:37,  3.26it/s]
 98%|█████████▊| 363924/371472 [6:47:52<39:59,  3.15it/s]
 98%|█████████▊| 363925/371472 [6:47:53<39:08,  3.21it/s]
 98%|█████████▊| 363926/371472 [6:47:53<41:45,  3.01it/s]
 98%|█████████▊| 363927/371472 [6:47:53<40:07,  3.13it/s]
 98%|█████████▊| 363928/371472 [6:47:54<37:40,  3.34it/s]
 98%|█████████▊| 363929/371472 [6:47:54<35:36,  3.53it/s]
 98%|█████████▊| 363930/371472 [6:47:54<37:57,  3.31it/s]
 98%|█████████▊| 363931/371472 [6:47:54<36:12,  3.47it/s]
 98%|█████████▊| 363932/371472 [6:47:55<34:18,  3.66it/s]
 98%|█████████▊| 363933/371472 [6:47:55<33:53,  3.71it/s]
 98%|█████████▊| 363934/371472 [6:47:55<34:34,  3.63it/s]
 98%|█████████▊| 363935/371472 [6:47:56<33:24,  3.76it/s]
 98%|█████████▊| 363936/371472 [6:47:56<34:52,  3.60it/s]
 98%|█████████▊| 363937/371472 [6:47:56<35:18,  3.56it/s]
 98%|█████████▊| 363938/371472 [6:47:56<35:39,  3.52it/s]
 98%|█████████▊| 363939/371472 [6:47:57<39:49,  3.15it/s]
 98%|█████████▊| 363940/371472 [6:47:57<39:14,  3.20it/s]
                                                         
{'loss': 2.5261, 'learning_rate': 1.1825831196535155e-07, 'epoch': 15.68}

 98%|█████████▊| 363940/371472 [6:47:57<39:14,  3.20it/s]
 98%|█████████▊| 363941/371472 [6:47:57<37:13,  3.37it/s]
 98%|█████████▊| 363942/371472 [6:47:58<36:39,  3.42it/s]
 98%|█████████▊| 363943/371472 [6:47:58<35:26,  3.54it/s]
 98%|█████████▊| 363944/371472 [6:47:58<35:40,  3.52it/s]
 98%|█████████▊| 363945/371472 [6:47:58<35:54,  3.49it/s]
 98%|█████████▊| 363946/371472 [6:47:59<35:15,  3.56it/s]
 98%|█████████▊| 363947/371472 [6:47:59<34:05,  3.68it/s]
 98%|█████████▊| 363948/371472 [6:47:59<34:11,  3.67it/s]
 98%|█████████▊| 363949/371472 [6:48:00<33:57,  3.69it/s]
 98%|█████████▊| 363950/371472 [6:48:00<34:13,  3.66it/s]
 98%|█████████▊| 363951/371472 [6:48:00<33:43,  3.72it/s]
 98%|█████████▊| 363952/371472 [6:48:00<32:58,  3.80it/s]
 98%|█████████▊| 363953/371472 [6:48:01<39:24,  3.18it/s]
 98%|█████████▊| 363954/371472 [6:48:01<37:22,  3.35it/s]
 98%|█████████▊| 363955/371472 [6:48:01<37:08,  3.37it/s]
 98%|█████████▊| 363956/371472 [6:48:02<35:20,  3.54it/s]
 98%|█████████▊| 363957/371472 [6:48:02<35:20,  3.54it/s]
 98%|█████████▊| 363958/371472 [6:48:02<34:43,  3.61it/s]
 98%|█████████▊| 363959/371472 [6:48:02<35:15,  3.55it/s]
 98%|█████████▊| 363960/371472 [6:48:03<34:03,  3.68it/s]
                                                         
{'loss': 2.5999, 'learning_rate': 1.1820982998987261e-07, 'epoch': 15.68}

 98%|█████████▊| 363960/371472 [6:48:03<34:03,  3.68it/s]
 98%|█████████▊| 363961/371472 [6:48:03<35:43,  3.50it/s]
 98%|█████████▊| 363962/371472 [6:48:03<35:41,  3.51it/s]
 98%|█████████▊| 363963/371472 [6:48:04<35:00,  3.57it/s]
 98%|█████████▊| 363964/371472 [6:48:04<37:35,  3.33it/s]
 98%|█████████▊| 363965/371472 [6:48:04<35:39,  3.51it/s]
 98%|█████████▊| 363966/371472 [6:48:04<34:55,  3.58it/s]
 98%|█████████▊| 363967/371472 [6:48:05<33:50,  3.70it/s]
 98%|█████████▊| 363968/371472 [6:48:05<33:59,  3.68it/s]
 98%|█████████▊| 363969/371472 [6:48:05<33:16,  3.76it/s]
 98%|█████████▊| 363970/371472 [6:48:05<34:28,  3.63it/s]
 98%|█████████▊| 363971/371472 [6:48:06<33:57,  3.68it/s]
 98%|█████████▊| 363972/371472 [6:48:06<36:13,  3.45it/s]
 98%|█████████▊| 363973/371472 [6:48:06<38:17,  3.26it/s]
 98%|█████████▊| 363974/371472 [6:48:07<36:04,  3.46it/s]
 98%|█████████▊| 363975/371472 [6:48:07<37:00,  3.38it/s]
 98%|█████████▊| 363976/371472 [6:48:07<35:06,  3.56it/s]
 98%|█████████▊| 363977/371472 [6:48:07<33:59,  3.67it/s]
 98%|█████████▊| 363978/371472 [6:48:08<34:53,  3.58it/s]
 98%|█████████▊| 363979/371472 [6:48:08<34:44,  3.59it/s]
 98%|█████████▊| 363980/371472 [6:48:08<33:48,  3.69it/s]
                                                         
{'loss': 2.6795, 'learning_rate': 1.1816134801439378e-07, 'epoch': 15.68}

 98%|█████████▊| 363980/371472 [6:48:08<33:48,  3.69it/s]
 98%|█████████▊| 363981/371472 [6:48:09<34:49,  3.59it/s]
 98%|█████████▊| 363982/371472 [6:48:09<35:20,  3.53it/s]
 98%|█████████▊| 363983/371472 [6:48:09<39:22,  3.17it/s]
 98%|█████████▊| 363984/371472 [6:48:10<40:57,  3.05it/s]
 98%|█████████▊| 363985/371472 [6:48:10<39:21,  3.17it/s]
 98%|█████████▊| 363986/371472 [6:48:10<39:38,  3.15it/s]
 98%|█████████▊| 363987/371472 [6:48:10<37:33,  3.32it/s]
 98%|█████████▊| 363988/371472 [6:48:11<38:05,  3.27it/s]
 98%|█████████▊| 363989/371472 [6:48:11<38:27,  3.24it/s]
 98%|█████████▊| 363990/371472 [6:48:11<38:02,  3.28it/s]
 98%|█████████▊| 363991/371472 [6:48:12<36:12,  3.44it/s]
 98%|█████████▊| 363992/371472 [6:48:12<34:35,  3.60it/s]
 98%|█████████▊| 363993/371472 [6:48:12<37:47,  3.30it/s]
 98%|█████████▊| 363994/371472 [6:48:13<37:08,  3.36it/s]
 98%|█████████▊| 363995/371472 [6:48:13<35:38,  3.50it/s]
 98%|█████████▊| 363996/371472 [6:48:13<35:38,  3.50it/s]
 98%|█████████▊| 363997/371472 [6:48:13<35:11,  3.54it/s]
 98%|█████████▊| 363998/371472 [6:48:14<34:47,  3.58it/s]
 98%|█████████▊| 363999/371472 [6:48:14<35:06,  3.55it/s]
 98%|█████████▊| 364000/371472 [6:48:14<34:38,  3.59it/s]
                                                         
{'loss': 2.4338, 'learning_rate': 1.1811286603891482e-07, 'epoch': 15.68}

 98%|█████████▊| 364000/371472 [6:48:14<34:38,  3.59it/s]
 98%|█████████▊| 364001/371472 [6:48:14<34:02,  3.66it/s]
 98%|█████████▊| 364002/371472 [6:48:15<34:09,  3.64it/s]
 98%|█████████▊| 364003/371472 [6:48:15<33:05,  3.76it/s]
 98%|█████████▊| 364004/371472 [6:48:15<33:40,  3.70it/s]
 98%|█████████▊| 364005/371472 [6:48:16<34:02,  3.66it/s]
 98%|█████████▊| 364006/371472 [6:48:16<33:00,  3.77it/s]
 98%|█████████▊| 364007/371472 [6:48:16<32:56,  3.78it/s]
 98%|█████████▊| 364008/371472 [6:48:16<33:39,  3.70it/s]
 98%|█████████▊| 364009/371472 [6:48:17<33:15,  3.74it/s]
 98%|█████████▊| 364010/371472 [6:48:17<32:21,  3.84it/s]
 98%|█████████▊| 364011/371472 [6:48:17<32:00,  3.88it/s]
 98%|█████████▊| 364012/371472 [6:48:17<31:53,  3.90it/s]
 98%|█████████▊| 364013/371472 [6:48:18<36:07,  3.44it/s]
 98%|█████████▊| 364014/371472 [6:48:18<37:02,  3.36it/s]
 98%|█████████▊| 364015/371472 [6:48:18<35:44,  3.48it/s]
 98%|█████████▊| 364016/371472 [6:48:19<34:57,  3.56it/s]
 98%|█████████▊| 364017/371472 [6:48:19<34:36,  3.59it/s]
 98%|█████████▊| 364018/371472 [6:48:19<35:31,  3.50it/s]
 98%|█████████▊| 364019/371472 [6:48:19<35:46,  3.47it/s]
 98%|█████████▊| 364020/371472 [6:48:20<34:41,  3.58it/s]
                                                         
{'loss': 2.5579, 'learning_rate': 1.1806438406343599e-07, 'epoch': 15.68}

 98%|█████████▊| 364020/371472 [6:48:20<34:41,  3.58it/s]
 98%|█████████▊| 364021/371472 [6:48:20<35:26,  3.50it/s]
 98%|█████████▊| 364022/371472 [6:48:20<33:34,  3.70it/s]
 98%|█████████▊| 364023/371472 [6:48:21<33:47,  3.67it/s]
 98%|█████████▊| 364024/371472 [6:48:21<32:51,  3.78it/s]
 98%|█████████▊| 364025/371472 [6:48:21<32:24,  3.83it/s]
 98%|█████████▊| 364026/371472 [6:48:21<35:01,  3.54it/s]
 98%|█████████▊| 364027/371472 [6:48:22<35:10,  3.53it/s]
 98%|█████████▊| 364028/371472 [6:48:22<34:20,  3.61it/s]
 98%|█████████▊| 364029/371472 [6:48:22<35:04,  3.54it/s]
 98%|█████████▊| 364030/371472 [6:48:22<33:51,  3.66it/s]
 98%|█████████▊| 364031/371472 [6:48:23<32:55,  3.77it/s]
 98%|█████████▊| 364032/371472 [6:48:23<36:35,  3.39it/s]
 98%|█████████▊| 364033/371472 [6:48:23<35:49,  3.46it/s]
 98%|█████████▊| 364034/371472 [6:48:24<37:11,  3.33it/s]
 98%|█████████▊| 364035/371472 [6:48:24<35:42,  3.47it/s]
 98%|█████████▊| 364036/371472 [6:48:24<36:31,  3.39it/s]
 98%|█████████▊| 364037/371472 [6:48:24<34:57,  3.54it/s]
 98%|█████████▊| 364038/371472 [6:48:25<34:53,  3.55it/s]
 98%|█████████▊| 364039/371472 [6:48:25<34:53,  3.55it/s]
 98%|█████████▊| 364040/371472 [6:48:25<33:49,  3.66it/s]
                                                         
{'loss': 2.3911, 'learning_rate': 1.1801590208795704e-07, 'epoch': 15.68}

 98%|█████████▊| 364040/371472 [6:48:25<33:49,  3.66it/s]
 98%|█████████▊| 364041/371472 [6:48:26<32:51,  3.77it/s]
 98%|█████████▊| 364042/371472 [6:48:26<33:00,  3.75it/s]
 98%|█████████▊| 364043/371472 [6:48:26<35:23,  3.50it/s]
 98%|█████████▊| 364044/371472 [6:48:26<34:55,  3.54it/s]
 98%|█████████▊| 364045/371472 [6:48:27<38:41,  3.20it/s]
 98%|█████████▊| 364046/371472 [6:48:27<37:32,  3.30it/s]
 98%|█████████▊| 364047/371472 [6:48:27<35:19,  3.50it/s]
 98%|█████████▊| 364048/371472 [6:48:28<34:50,  3.55it/s]
 98%|█████████▊| 364049/371472 [6:48:28<34:32,  3.58it/s]
 98%|█████████▊| 364050/371472 [6:48:28<33:57,  3.64it/s]
 98%|█████████▊| 364051/371472 [6:48:28<35:24,  3.49it/s]
 98%|█████████▊| 364052/371472 [6:48:29<33:42,  3.67it/s]
 98%|█████████▊| 364053/371472 [6:48:29<35:07,  3.52it/s]
 98%|█████████▊| 364054/371472 [6:48:29<34:43,  3.56it/s]
 98%|█████████▊| 364055/371472 [6:48:30<34:07,  3.62it/s]
 98%|█████████▊| 364056/371472 [6:48:30<33:24,  3.70it/s]
 98%|█████████▊| 364057/371472 [6:48:30<33:06,  3.73it/s]
 98%|█████████▊| 364058/371472 [6:48:30<34:35,  3.57it/s]
 98%|█████████▊| 364059/371472 [6:48:31<33:35,  3.68it/s]
 98%|█████████▊| 364060/371472 [6:48:31<37:38,  3.28it/s]
                                                         
{'loss': 2.5988, 'learning_rate': 1.179674201124782e-07, 'epoch': 15.68}

 98%|█████████▊| 364060/371472 [6:48:31<37:38,  3.28it/s]
 98%|█████████▊| 364061/371472 [6:48:31<36:04,  3.42it/s]
 98%|█████████▊| 364062/371472 [6:48:32<34:34,  3.57it/s]
 98%|█████████▊| 364063/371472 [6:48:32<34:17,  3.60it/s]
 98%|█████████▊| 364064/371472 [6:48:32<33:56,  3.64it/s]
 98%|█████████▊| 364065/371472 [6:48:32<34:10,  3.61it/s]
 98%|█████████▊| 364066/371472 [6:48:33<33:08,  3.72it/s]
 98%|█████████▊| 364067/371472 [6:48:33<33:17,  3.71it/s]
 98%|█████████▊| 364068/371472 [6:48:33<34:01,  3.63it/s]
 98%|█████████▊| 364069/371472 [6:48:33<33:34,  3.67it/s]
 98%|█████████▊| 364070/371472 [6:48:34<35:19,  3.49it/s]
 98%|█████████▊| 364071/371472 [6:48:34<36:31,  3.38it/s]
 98%|█████████▊| 364072/371472 [6:48:34<36:13,  3.41it/s]
 98%|█████████▊| 364073/371472 [6:48:35<37:28,  3.29it/s]
 98%|█████████▊| 364074/371472 [6:48:35<34:58,  3.53it/s]
 98%|█████████▊| 364075/371472 [6:48:35<33:43,  3.66it/s]
 98%|█████████▊| 364076/371472 [6:48:35<34:23,  3.58it/s]
 98%|█████████▊| 364077/371472 [6:48:36<34:43,  3.55it/s]
 98%|█████████▊| 364078/371472 [6:48:36<34:31,  3.57it/s]
 98%|█████████▊| 364079/371472 [6:48:36<35:43,  3.45it/s]
 98%|█████████▊| 364080/371472 [6:48:37<35:40,  3.45it/s]
                                                         
{'loss': 2.6504, 'learning_rate': 1.1791893813699925e-07, 'epoch': 15.68}

 98%|█████████▊| 364080/371472 [6:48:37<35:40,  3.45it/s]
 98%|█████████▊| 364081/371472 [6:48:37<33:32,  3.67it/s]
 98%|█████████▊| 364082/371472 [6:48:37<32:07,  3.83it/s]
 98%|█████████▊| 364083/371472 [6:48:37<32:19,  3.81it/s]
 98%|█████████▊| 364084/371472 [6:48:38<32:46,  3.76it/s]
 98%|█████████▊| 364085/371472 [6:48:38<33:13,  3.71it/s]
 98%|█████████▊| 364086/371472 [6:48:38<35:36,  3.46it/s]
 98%|█████████▊| 364087/371472 [6:48:38<34:17,  3.59it/s]
 98%|█████████▊| 364088/371472 [6:48:39<34:29,  3.57it/s]
 98%|█████████▊| 364089/371472 [6:48:39<34:07,  3.61it/s]
 98%|█████████▊| 364090/371472 [6:48:39<33:35,  3.66it/s]
 98%|█████████▊| 364091/371472 [6:48:40<33:37,  3.66it/s]
 98%|█████████▊| 364092/371472 [6:48:40<33:34,  3.66it/s]
 98%|█████████▊| 364093/371472 [6:48:40<37:23,  3.29it/s]
 98%|█████████▊| 364094/371472 [6:48:41<36:09,  3.40it/s]
 98%|█████████▊| 364095/371472 [6:48:41<38:17,  3.21it/s]
 98%|█████████▊| 364096/371472 [6:48:41<38:34,  3.19it/s]
 98%|█████████▊| 364097/371472 [6:48:41<38:18,  3.21it/s]
 98%|█████████▊| 364098/371472 [6:48:42<37:11,  3.30it/s]
 98%|█████████▊| 364099/371472 [6:48:42<38:17,  3.21it/s]
 98%|█████████▊| 364100/371472 [6:48:42<36:59,  3.32it/s]
                                                         
{'loss': 2.5545, 'learning_rate': 1.1787045616152042e-07, 'epoch': 15.68}

 98%|█████████▊| 364100/371472 [6:48:42<36:59,  3.32it/s]
 98%|█████████▊| 364101/371472 [6:48:43<35:14,  3.49it/s]
 98%|█████████▊| 364102/371472 [6:48:43<34:36,  3.55it/s]
 98%|█████████▊| 364103/371472 [6:48:43<34:21,  3.57it/s]
 98%|█████████▊| 364104/371472 [6:48:43<35:13,  3.49it/s]
 98%|█████████▊| 364105/371472 [6:48:44<34:24,  3.57it/s]
 98%|█████████▊| 364106/371472 [6:48:44<33:15,  3.69it/s]
 98%|█████████▊| 364107/371472 [6:48:44<32:16,  3.80it/s]
 98%|█████████▊| 364108/371472 [6:48:44<32:05,  3.82it/s]
 98%|█████████▊| 364109/371472 [6:48:45<34:32,  3.55it/s]
 98%|█████████▊| 364110/371472 [6:48:45<34:15,  3.58it/s]
 98%|█████████▊| 364111/371472 [6:48:45<33:48,  3.63it/s]
 98%|█████████▊| 364112/371472 [6:48:46<35:59,  3.41it/s]
 98%|█████████▊| 364113/371472 [6:48:46<34:22,  3.57it/s]
 98%|█████████▊| 364114/371472 [6:48:46<33:34,  3.65it/s]
 98%|█████████▊| 364115/371472 [6:48:47<37:00,  3.31it/s]
 98%|█████████▊| 364116/371472 [6:48:47<35:39,  3.44it/s]
 98%|█████████▊| 364117/371472 [6:48:47<34:29,  3.55it/s]
 98%|█████████▊| 364118/371472 [6:48:47<34:27,  3.56it/s]
 98%|█████████▊| 364119/371472 [6:48:48<33:31,  3.66it/s]
 98%|█████████▊| 364120/371472 [6:48:48<32:32,  3.76it/s]
                                                         
{'loss': 2.7996, 'learning_rate': 1.1782197418604148e-07, 'epoch': 15.68}

 98%|█████████▊| 364120/371472 [6:48:48<32:32,  3.76it/s]
 98%|█████████▊| 364121/371472 [6:48:48<32:18,  3.79it/s]
 98%|█████████▊| 364122/371472 [6:48:48<31:57,  3.83it/s]
 98%|█████████▊| 364123/371472 [6:48:49<31:54,  3.84it/s]
 98%|█████████▊| 364124/371472 [6:48:49<36:27,  3.36it/s]
 98%|█████████▊| 364125/371472 [6:48:49<35:12,  3.48it/s]
 98%|█████████▊| 364126/371472 [6:48:50<35:48,  3.42it/s]
 98%|█████████▊| 364127/371472 [6:48:50<35:41,  3.43it/s]
 98%|█████████▊| 364128/371472 [6:48:50<36:00,  3.40it/s]
 98%|█████████▊| 364129/371472 [6:48:50<34:43,  3.52it/s]
 98%|█████████▊| 364130/371472 [6:48:51<34:10,  3.58it/s]
 98%|█████████▊| 364131/371472 [6:48:51<35:21,  3.46it/s]
 98%|█████████▊| 364132/371472 [6:48:51<34:11,  3.58it/s]
 98%|█████████▊| 364133/371472 [6:48:52<33:51,  3.61it/s]
 98%|█████████▊| 364134/371472 [6:48:52<33:28,  3.65it/s]
 98%|█████████▊| 364135/371472 [6:48:52<34:16,  3.57it/s]
 98%|█████████▊| 364136/371472 [6:48:52<33:05,  3.69it/s]
 98%|█████████▊| 364137/371472 [6:48:53<33:04,  3.70it/s]
 98%|█████████▊| 364138/371472 [6:48:53<33:41,  3.63it/s]
 98%|█████████▊| 364139/371472 [6:48:53<34:03,  3.59it/s]
 98%|█████████▊| 364140/371472 [6:48:53<32:59,  3.70it/s]
                                                         
{'loss': 2.5878, 'learning_rate': 1.1777349221056263e-07, 'epoch': 15.68}

 98%|█████████▊| 364140/371472 [6:48:53<32:59,  3.70it/s]
 98%|█████████▊| 364141/371472 [6:48:54<32:27,  3.76it/s]
 98%|█████████▊| 364142/371472 [6:48:54<32:52,  3.72it/s]
 98%|█████████▊| 364143/371472 [6:48:54<33:08,  3.69it/s]
 98%|█████████▊| 364144/371472 [6:48:55<33:38,  3.63it/s]
 98%|█████████▊| 364145/371472 [6:48:55<33:33,  3.64it/s]
 98%|█████████▊| 364146/371472 [6:48:55<35:24,  3.45it/s]
 98%|█████████▊| 364147/371472 [6:48:55<34:51,  3.50it/s]
 98%|█████████▊| 364148/371472 [6:48:56<34:23,  3.55it/s]
 98%|█████████▊| 364149/371472 [6:48:56<33:34,  3.63it/s]
 98%|█████████▊| 364150/371472 [6:48:56<36:15,  3.36it/s]
 98%|█████████▊| 364151/371472 [6:48:57<35:20,  3.45it/s]
 98%|█████████▊| 364152/371472 [6:48:57<37:56,  3.22it/s]
 98%|█████████▊| 364153/371472 [6:48:57<37:13,  3.28it/s]
 98%|█████████▊| 364154/371472 [6:48:58<36:45,  3.32it/s]
 98%|█████████▊| 364155/371472 [6:48:58<35:50,  3.40it/s]
 98%|█████████▊| 364156/371472 [6:48:58<36:00,  3.39it/s]
 98%|█████████▊| 364157/371472 [6:48:58<37:00,  3.29it/s]
 98%|█████████▊| 364158/371472 [6:48:59<36:07,  3.37it/s]
 98%|█████████▊| 364159/371472 [6:48:59<36:16,  3.36it/s]
 98%|█████████▊| 364160/371472 [6:48:59<34:56,  3.49it/s]
                                                         
{'loss': 2.4243, 'learning_rate': 1.1772501023508368e-07, 'epoch': 15.69}

 98%|█████████▊| 364160/371472 [6:48:59<34:56,  3.49it/s]
 98%|█████████▊| 364161/371472 [6:49:00<33:51,  3.60it/s]
 98%|█████████▊| 364162/371472 [6:49:00<35:06,  3.47it/s]
 98%|█████████▊| 364163/371472 [6:49:00<34:36,  3.52it/s]
 98%|█████████▊| 364164/371472 [6:49:00<35:44,  3.41it/s]
 98%|█████████▊| 364165/371472 [6:49:01<36:14,  3.36it/s]
 98%|█████████▊| 364166/371472 [6:49:01<34:34,  3.52it/s]
 98%|█████████▊| 364167/371472 [6:49:01<34:48,  3.50it/s]
 98%|█████████▊| 364168/371472 [6:49:02<33:22,  3.65it/s]
 98%|█████████▊| 364169/371472 [6:49:02<36:10,  3.36it/s]
 98%|█████████▊| 364170/371472 [6:49:02<37:54,  3.21it/s]
 98%|█████████▊| 364171/371472 [6:49:02<35:01,  3.47it/s]
 98%|█████████▊| 364172/371472 [6:49:03<33:23,  3.64it/s]
 98%|█████████▊| 364173/371472 [6:49:03<35:17,  3.45it/s]
 98%|█████████▊| 364174/371472 [6:49:03<35:47,  3.40it/s]
 98%|█████████▊| 364175/371472 [6:49:04<36:34,  3.33it/s]
 98%|█████████▊| 364176/371472 [6:49:04<35:18,  3.44it/s]
 98%|█████████▊| 364177/371472 [6:49:04<35:01,  3.47it/s]
 98%|█████████▊| 364178/371472 [6:49:05<39:12,  3.10it/s]
 98%|█████████▊| 364179/371472 [6:49:05<37:34,  3.23it/s]
 98%|█████████▊| 364180/371472 [6:49:05<35:12,  3.45it/s]
                                                         
{'loss': 2.533, 'learning_rate': 1.1767652825960485e-07, 'epoch': 15.69}

 98%|█████████▊| 364180/371472 [6:49:05<35:12,  3.45it/s]
 98%|█████████▊| 364181/371472 [6:49:05<34:51,  3.49it/s]
 98%|█████████▊| 364182/371472 [6:49:06<34:04,  3.57it/s]
 98%|█████████▊| 364183/371472 [6:49:06<34:48,  3.49it/s]
 98%|█████████▊| 364184/371472 [6:49:06<35:44,  3.40it/s]
 98%|█████████▊| 364185/371472 [6:49:07<35:45,  3.40it/s]
 98%|█████████▊| 364186/371472 [6:49:07<35:30,  3.42it/s]
 98%|█████████▊| 364187/371472 [6:49:07<33:45,  3.60it/s]
 98%|█████████▊| 364188/371472 [6:49:07<37:02,  3.28it/s]
 98%|█████████▊| 364189/371472 [6:49:08<35:52,  3.38it/s]
 98%|█████████▊| 364190/371472 [6:49:08<37:11,  3.26it/s]
 98%|█████████▊| 364191/371472 [6:49:08<35:30,  3.42it/s]
 98%|█████████▊| 364192/371472 [6:49:09<36:52,  3.29it/s]
 98%|█████████▊| 364193/371472 [6:49:09<35:10,  3.45it/s]
 98%|█████████▊| 364194/371472 [6:49:09<34:18,  3.54it/s]
 98%|█████████▊| 364195/371472 [6:49:10<35:31,  3.41it/s]
 98%|█████████▊| 364196/371472 [6:49:10<35:47,  3.39it/s]
 98%|█████████▊| 364197/371472 [6:49:10<33:31,  3.62it/s]
 98%|█████████▊| 364198/371472 [6:49:10<33:56,  3.57it/s]
 98%|█████████▊| 364199/371472 [6:49:11<35:15,  3.44it/s]
 98%|█████████▊| 364200/371472 [6:49:11<36:06,  3.36it/s]
                                                         
{'loss': 2.6663, 'learning_rate': 1.1762804628412591e-07, 'epoch': 15.69}

 98%|█████████▊| 364200/371472 [6:49:11<36:06,  3.36it/s]
 98%|█████████▊| 364201/371472 [6:49:11<35:58,  3.37it/s]
 98%|█████████▊| 364202/371472 [6:49:12<34:58,  3.46it/s]
 98%|█████████▊| 364203/371472 [6:49:12<35:14,  3.44it/s]
 98%|█████████▊| 364204/371472 [6:49:12<33:36,  3.60it/s]
 98%|█████████▊| 364205/371472 [6:49:12<34:58,  3.46it/s]
 98%|█████████▊| 364206/371472 [6:49:13<34:02,  3.56it/s]
 98%|█████████▊| 364207/371472 [6:49:13<33:08,  3.65it/s]
 98%|█████████▊| 364208/371472 [6:49:13<34:17,  3.53it/s]
 98%|█████████▊| 364209/371472 [6:49:14<35:33,  3.40it/s]
 98%|█████████▊| 364210/371472 [6:49:14<34:46,  3.48it/s]
 98%|█████████▊| 364211/371472 [6:49:14<35:02,  3.45it/s]
 98%|█████████▊| 364212/371472 [6:49:14<34:32,  3.50it/s]
 98%|█████████▊| 364213/371472 [6:49:15<33:12,  3.64it/s]
 98%|█████████▊| 364214/371472 [6:49:15<32:02,  3.77it/s]
 98%|█████████▊| 364215/371472 [6:49:15<31:27,  3.84it/s]
 98%|█████████▊| 364216/371472 [6:49:15<31:58,  3.78it/s]
 98%|█████████▊| 364217/371472 [6:49:16<32:09,  3.76it/s]
 98%|█████████▊| 364218/371472 [6:49:16<33:10,  3.64it/s]
 98%|█████████▊| 364219/371472 [6:49:16<34:33,  3.50it/s]
 98%|█████████▊| 364220/371472 [6:49:17<35:29,  3.41it/s]
                                                         
{'loss': 2.6595, 'learning_rate': 1.1757956430864706e-07, 'epoch': 15.69}

 98%|█████████▊| 364220/371472 [6:49:17<35:29,  3.41it/s]
 98%|█████████▊| 364221/371472 [6:49:17<34:10,  3.54it/s]
 98%|█████████▊| 364222/371472 [6:49:17<33:24,  3.62it/s]
 98%|█████████▊| 364223/371472 [6:49:17<32:50,  3.68it/s]
 98%|█████████▊| 364224/371472 [6:49:18<31:17,  3.86it/s]
 98%|█████████▊| 364225/371472 [6:49:18<31:15,  3.86it/s]
 98%|█████████▊| 364226/371472 [6:49:18<31:33,  3.83it/s]
 98%|█████████▊| 364227/371472 [6:49:18<32:15,  3.74it/s]
 98%|█████████▊| 364228/371472 [6:49:19<35:03,  3.44it/s]
 98%|█████████▊| 364229/371472 [6:49:19<37:25,  3.23it/s]
 98%|█████████▊| 364230/371472 [6:49:19<36:59,  3.26it/s]
 98%|█████████▊| 364231/371472 [6:49:20<35:35,  3.39it/s]
 98%|█████████▊| 364232/371472 [6:49:20<33:44,  3.58it/s]
 98%|█████████▊| 364233/371472 [6:49:20<33:10,  3.64it/s]
 98%|█████████▊| 364234/371472 [6:49:20<32:43,  3.69it/s]
 98%|█████████▊| 364235/371472 [6:49:21<33:42,  3.58it/s]
 98%|█████████▊| 364236/371472 [6:49:21<32:18,  3.73it/s]
 98%|█████████▊| 364237/371472 [6:49:21<32:29,  3.71it/s]
 98%|█████████▊| 364238/371472 [6:49:22<32:35,  3.70it/s]
 98%|█████████▊| 364239/371472 [6:49:22<32:54,  3.66it/s]
 98%|█████████▊| 364240/371472 [6:49:22<32:58,  3.66it/s]
                                                         
{'loss': 2.6815, 'learning_rate': 1.1753108233316812e-07, 'epoch': 15.69}

 98%|█████████▊| 364240/371472 [6:49:22<32:58,  3.66it/s]
 98%|█████████▊| 364241/371472 [6:49:22<33:00,  3.65it/s]
 98%|█████████▊| 364242/371472 [6:49:23<32:35,  3.70it/s]
 98%|█████████▊| 364243/371472 [6:49:23<31:33,  3.82it/s]
 98%|█████████▊| 364244/371472 [6:49:23<31:03,  3.88it/s]
 98%|█████████▊| 364245/371472 [6:49:23<33:16,  3.62it/s]
 98%|█████████▊| 364246/371472 [6:49:24<34:05,  3.53it/s]
 98%|█████████▊| 364247/371472 [6:49:24<33:27,  3.60it/s]
 98%|█████████▊| 364248/371472 [6:49:24<33:33,  3.59it/s]
 98%|█████████▊| 364249/371472 [6:49:25<35:08,  3.43it/s]
 98%|█████████▊| 364250/371472 [6:49:25<36:37,  3.29it/s]
 98%|█████████▊| 364251/371472 [6:49:25<36:05,  3.33it/s]
 98%|█████████▊| 364252/371472 [6:49:25<35:17,  3.41it/s]
 98%|█████████▊| 364253/371472 [6:49:26<33:53,  3.55it/s]
 98%|█████████▊| 364254/371472 [6:49:26<35:01,  3.43it/s]
 98%|█████████▊| 364255/371472 [6:49:26<37:05,  3.24it/s]
 98%|█████████▊| 364256/371472 [6:49:27<35:30,  3.39it/s]
 98%|█████████▊| 364257/371472 [6:49:27<36:21,  3.31it/s]
 98%|█████████▊| 364258/371472 [6:49:27<36:02,  3.34it/s]
 98%|█████████▊| 364259/371472 [6:49:28<35:24,  3.40it/s]
 98%|█████████▊| 364260/371472 [6:49:28<35:01,  3.43it/s]
                                                         
{'loss': 2.5289, 'learning_rate': 1.1748260035768928e-07, 'epoch': 15.69}

 98%|█████████▊| 364260/371472 [6:49:28<35:01,  3.43it/s]
 98%|█████████▊| 364261/371472 [6:49:28<33:36,  3.58it/s]
 98%|█████████▊| 364262/371472 [6:49:28<32:16,  3.72it/s]
 98%|█████████▊| 364263/371472 [6:49:29<36:25,  3.30it/s]
 98%|█████████▊| 364264/371472 [6:49:29<35:24,  3.39it/s]
 98%|█████████▊| 364265/371472 [6:49:29<33:36,  3.57it/s]
 98%|█████████▊| 364266/371472 [6:49:29<32:55,  3.65it/s]
 98%|█████████▊| 364267/371472 [6:49:30<34:27,  3.49it/s]
 98%|█████████▊| 364268/371472 [6:49:30<33:17,  3.61it/s]
 98%|█████████▊| 364269/371472 [6:49:30<34:05,  3.52it/s]
 98%|█████████▊| 364270/371472 [6:49:31<36:38,  3.28it/s]
 98%|█████████▊| 364271/371472 [6:49:31<34:35,  3.47it/s]
 98%|█████████▊| 364272/371472 [6:49:31<34:37,  3.47it/s]
 98%|█████████▊| 364273/371472 [6:49:32<34:27,  3.48it/s]
 98%|█████████▊| 364274/371472 [6:49:32<33:12,  3.61it/s]
 98%|█████████▊| 364275/371472 [6:49:32<32:34,  3.68it/s]
 98%|█████████▊| 364276/371472 [6:49:32<31:42,  3.78it/s]
 98%|█████████▊| 364277/371472 [6:49:33<30:47,  3.89it/s]
 98%|█████████▊| 364278/371472 [6:49:33<31:00,  3.87it/s]
 98%|█████████▊| 364279/371472 [6:49:33<31:25,  3.82it/s]
 98%|█████████▊| 364280/371472 [6:49:33<32:51,  3.65it/s]
                                                         
{'loss': 2.5646, 'learning_rate': 1.1743411838221035e-07, 'epoch': 15.69}

 98%|█████████▊| 364280/371472 [6:49:33<32:51,  3.65it/s]
 98%|█████████▊| 364281/371472 [6:49:34<33:01,  3.63it/s]
 98%|█████████▊| 364282/371472 [6:49:34<33:58,  3.53it/s]
 98%|█████████▊| 364283/371472 [6:49:34<35:27,  3.38it/s]
 98%|█████████▊| 364284/371472 [6:49:35<35:50,  3.34it/s]
 98%|█████████▊| 364285/371472 [6:49:35<34:40,  3.45it/s]
 98%|█████████▊| 364286/371472 [6:49:35<34:01,  3.52it/s]
 98%|█████████▊| 364287/371472 [6:49:35<32:32,  3.68it/s]
 98%|█████████▊| 364288/371472 [6:49:36<33:07,  3.62it/s]
 98%|█████████▊| 364289/371472 [6:49:36<32:36,  3.67it/s]
 98%|█████████▊| 364290/371472 [6:49:36<32:53,  3.64it/s]
 98%|█████████▊| 364291/371472 [6:49:36<31:41,  3.78it/s]
 98%|█████████▊| 364292/371472 [6:49:37<33:23,  3.58it/s]
 98%|█████████▊| 364293/371472 [6:49:37<32:24,  3.69it/s]
 98%|█████████▊| 364294/371472 [6:49:37<31:56,  3.75it/s]
 98%|█████████▊| 364295/371472 [6:49:38<32:50,  3.64it/s]
 98%|█████████▊| 364296/371472 [6:49:38<37:02,  3.23it/s]
 98%|█████████▊| 364297/371472 [6:49:38<35:42,  3.35it/s]
 98%|█████████▊| 364298/371472 [6:49:39<35:08,  3.40it/s]
 98%|█████████▊| 364299/371472 [6:49:39<33:49,  3.53it/s]
 98%|█████████▊| 364300/371472 [6:49:39<33:09,  3.60it/s]
                                                         
{'loss': 2.5328, 'learning_rate': 1.1738563640673149e-07, 'epoch': 15.69}

 98%|█████████▊| 364300/371472 [6:49:39<33:09,  3.60it/s]
 98%|█████████▊| 364301/371472 [6:49:39<32:02,  3.73it/s]
 98%|█████████▊| 364302/371472 [6:49:40<34:02,  3.51it/s]
 98%|█████████▊| 364303/371472 [6:49:40<37:36,  3.18it/s]
 98%|█████████▊| 364304/371472 [6:49:40<35:51,  3.33it/s]
 98%|█████████▊| 364305/371472 [6:49:40<34:05,  3.50it/s]
 98%|█████████▊| 364306/371472 [6:49:41<33:15,  3.59it/s]
 98%|█████████▊| 364307/371472 [6:49:41<31:47,  3.76it/s]
 98%|█████████▊| 364308/371472 [6:49:41<32:47,  3.64it/s]
 98%|█████████▊| 364309/371472 [6:49:42<34:52,  3.42it/s]
 98%|█████████▊| 364310/371472 [6:49:42<34:17,  3.48it/s]
 98%|█████████▊| 364311/371472 [6:49:42<32:15,  3.70it/s]
 98%|█████████▊| 364312/371472 [6:49:42<33:35,  3.55it/s]
 98%|█████████▊| 364313/371472 [6:49:43<33:57,  3.51it/s]
 98%|█████████▊| 364314/371472 [6:49:43<34:57,  3.41it/s]
 98%|█████████▊| 364315/371472 [6:49:43<35:37,  3.35it/s]
 98%|█████████▊| 364316/371472 [6:49:44<35:11,  3.39it/s]
 98%|█████████▊| 364317/371472 [6:49:44<36:03,  3.31it/s]
 98%|█████████▊| 364318/371472 [6:49:44<34:31,  3.45it/s]
 98%|█████████▊| 364319/371472 [6:49:45<34:32,  3.45it/s]
 98%|█████████▊| 364320/371472 [6:49:45<33:22,  3.57it/s]
                                                         
{'loss': 2.4993, 'learning_rate': 1.1733715443125255e-07, 'epoch': 15.69}

 98%|█████████▊| 364320/371472 [6:49:45<33:22,  3.57it/s]
 98%|█████████▊| 364321/371472 [6:49:45<32:44,  3.64it/s]
 98%|█████████▊| 364322/371472 [6:49:45<32:10,  3.70it/s]
 98%|█████████▊| 364323/371472 [6:49:46<32:11,  3.70it/s]
 98%|█████████▊| 364324/371472 [6:49:46<31:23,  3.80it/s]
 98%|█████████▊| 364325/371472 [6:49:46<31:00,  3.84it/s]
 98%|█████████▊| 364326/371472 [6:49:46<31:11,  3.82it/s]
 98%|█████████▊| 364327/371472 [6:49:47<32:12,  3.70it/s]
 98%|█████████▊| 364328/371472 [6:49:47<32:49,  3.63it/s]
 98%|█████████▊| 364329/371472 [6:49:47<32:09,  3.70it/s]
 98%|█████████▊| 364330/371472 [6:49:47<31:28,  3.78it/s]
 98%|█████████▊| 364331/371472 [6:49:48<34:12,  3.48it/s]
 98%|█████████▊| 364332/371472 [6:49:48<32:31,  3.66it/s]
 98%|█████████▊| 364333/371472 [6:49:48<34:53,  3.41it/s]
 98%|█████████▊| 364334/371472 [6:49:49<33:26,  3.56it/s]
 98%|█████████▊| 364335/371472 [6:49:49<32:28,  3.66it/s]
 98%|█████████▊| 364336/371472 [6:49:49<34:42,  3.43it/s]
 98%|█████████▊| 364337/371472 [6:49:49<34:05,  3.49it/s]
 98%|█████████▊| 364338/371472 [6:49:50<32:18,  3.68it/s]
 98%|█████████▊| 364339/371472 [6:49:50<31:50,  3.73it/s]
 98%|█████████▊| 364340/371472 [6:49:50<30:39,  3.88it/s]
                                                         
{'loss': 2.6201, 'learning_rate': 1.1728867245577371e-07, 'epoch': 15.69}

 98%|█████████▊| 364340/371472 [6:49:50<30:39,  3.88it/s]
 98%|█████████▊| 364341/371472 [6:49:50<31:35,  3.76it/s]
 98%|█████████▊| 364342/371472 [6:49:51<31:09,  3.81it/s]
 98%|█████████▊| 364343/371472 [6:49:51<30:56,  3.84it/s]
 98%|█████████▊| 364344/371472 [6:49:51<30:32,  3.89it/s]
 98%|█████████▊| 364345/371472 [6:49:52<31:08,  3.81it/s]
 98%|█████████▊| 364346/371472 [6:49:52<32:30,  3.65it/s]
 98%|█████████▊| 364347/371472 [6:49:52<32:49,  3.62it/s]
 98%|█████████▊| 364348/371472 [6:49:52<31:36,  3.76it/s]
 98%|█████████▊| 364349/371472 [6:49:53<31:23,  3.78it/s]
 98%|█████████▊| 364350/371472 [6:49:53<30:37,  3.88it/s]
 98%|█████████▊| 364351/371472 [6:49:53<31:55,  3.72it/s]
 98%|█████████▊| 364352/371472 [6:49:53<31:23,  3.78it/s]
 98%|█████████▊| 364353/371472 [6:49:54<31:39,  3.75it/s]
 98%|█████████▊| 364354/371472 [6:49:54<31:32,  3.76it/s]
 98%|█████████▊| 364355/371472 [6:49:54<30:43,  3.86it/s]
 98%|█████████▊| 364356/371472 [6:49:54<30:30,  3.89it/s]
 98%|█████████▊| 364357/371472 [6:49:55<33:13,  3.57it/s]
 98%|█████████▊| 364358/371472 [6:49:55<33:28,  3.54it/s]
 98%|█████████▊| 364359/371472 [6:49:55<32:17,  3.67it/s]
 98%|█████████▊| 364360/371472 [6:49:56<31:24,  3.77it/s]
                                                         
{'loss': 2.7352, 'learning_rate': 1.1724019048029477e-07, 'epoch': 15.69}

 98%|█████████▊| 364360/371472 [6:49:56<31:24,  3.77it/s]
 98%|█████████▊| 364361/371472 [6:49:56<33:00,  3.59it/s]
 98%|█████████▊| 364362/371472 [6:49:56<32:00,  3.70it/s]
 98%|█████████▊| 364363/371472 [6:49:56<31:38,  3.75it/s]
 98%|█████████▊| 364364/371472 [6:49:57<32:13,  3.68it/s]
 98%|█████████▊| 364365/371472 [6:49:57<31:52,  3.72it/s]
 98%|█████████▊| 364366/371472 [6:49:57<31:30,  3.76it/s]
 98%|█████████▊| 364367/371472 [6:49:57<32:53,  3.60it/s]
 98%|█████████▊| 364368/371472 [6:49:58<31:47,  3.72it/s]
 98%|█████████▊| 364369/371472 [6:49:58<30:55,  3.83it/s]
 98%|█████████▊| 364370/371472 [6:49:58<30:59,  3.82it/s]
 98%|█████████▊| 364371/371472 [6:49:58<30:11,  3.92it/s]
 98%|█████████▊| 364372/371472 [6:49:59<30:10,  3.92it/s]
 98%|█████████▊| 364373/371472 [6:49:59<29:46,  3.97it/s]
 98%|█████████▊| 364374/371472 [6:49:59<29:57,  3.95it/s]
 98%|█████████▊| 364375/371472 [6:50:00<31:32,  3.75it/s]
 98%|█████████▊| 364376/371472 [6:50:00<30:32,  3.87it/s]
 98%|█████████▊| 364377/371472 [6:50:00<30:14,  3.91it/s]
 98%|█████████▊| 364378/371472 [6:50:00<29:22,  4.03it/s]
 98%|█████████▊| 364379/371472 [6:50:00<29:58,  3.94it/s]
 98%|█████████▊| 364380/371472 [6:50:01<31:08,  3.80it/s]
                                                         
{'loss': 2.7911, 'learning_rate': 1.1719170850481582e-07, 'epoch': 15.69}

 98%|█████████▊| 364380/371472 [6:50:01<31:08,  3.80it/s]
 98%|█████████▊| 364381/371472 [6:50:01<31:38,  3.73it/s]
 98%|█████████▊| 364382/371472 [6:50:01<31:15,  3.78it/s]
 98%|█████████▊| 364383/371472 [6:50:02<31:54,  3.70it/s]
 98%|█████████▊| 364384/371472 [6:50:02<35:55,  3.29it/s]
 98%|█████████▊| 364385/371472 [6:50:02<35:49,  3.30it/s]
 98%|█████████▊| 364386/371472 [6:50:03<34:29,  3.42it/s]
 98%|█████████▊| 364387/371472 [6:50:03<34:34,  3.42it/s]
 98%|█████████▊| 364388/371472 [6:50:03<40:41,  2.90it/s]
 98%|█████████▊| 364389/371472 [6:50:04<37:34,  3.14it/s]
 98%|█████████▊| 364390/371472 [6:50:04<35:20,  3.34it/s]
 98%|█████████▊| 364391/371472 [6:50:04<34:01,  3.47it/s]
 98%|█████████▊| 364392/371472 [6:50:04<35:07,  3.36it/s]
 98%|█████████▊| 364393/371472 [6:50:05<34:51,  3.38it/s]
 98%|█████████▊| 364394/371472 [6:50:05<32:44,  3.60it/s]
 98%|█████████▊| 364395/371472 [6:50:05<36:01,  3.27it/s]
 98%|█████████▊| 364396/371472 [6:50:06<34:46,  3.39it/s]
 98%|█████████▊| 364397/371472 [6:50:06<33:12,  3.55it/s]
 98%|█████████▊| 364398/371472 [6:50:06<33:35,  3.51it/s]
 98%|█████████▊| 364399/371472 [6:50:06<32:40,  3.61it/s]
 98%|█████████▊| 364400/371472 [6:50:07<34:13,  3.44it/s]
                                                         
{'loss': 2.4854, 'learning_rate': 1.1714322652933698e-07, 'epoch': 15.7}

 98%|█████████▊| 364400/371472 [6:50:07<34:13,  3.44it/s]
 98%|█████████▊| 364401/371472 [6:50:07<35:09,  3.35it/s]
 98%|█████████▊| 364402/371472 [6:50:07<33:28,  3.52it/s]
 98%|█████████▊| 364403/371472 [6:50:08<32:45,  3.60it/s]
 98%|█████████▊| 364404/371472 [6:50:08<31:18,  3.76it/s]
 98%|█████████▊| 364405/371472 [6:50:08<31:11,  3.78it/s]
 98%|█████████▊| 364406/371472 [6:50:08<30:35,  3.85it/s]
 98%|█████████▊| 364407/371472 [6:50:09<31:45,  3.71it/s]
 98%|█████████▊| 364408/371472 [6:50:09<30:49,  3.82it/s]
 98%|█████████▊| 364409/371472 [6:50:09<30:19,  3.88it/s]
 98%|█████████▊| 364410/371472 [6:50:09<30:32,  3.85it/s]
 98%|█████████▊| 364411/371472 [6:50:10<32:14,  3.65it/s]
 98%|█████████▊| 364412/371472 [6:50:10<31:18,  3.76it/s]
 98%|█████████▊| 364413/371472 [6:50:10<30:41,  3.83it/s]
 98%|█████████▊| 364414/371472 [6:50:10<30:49,  3.82it/s]
 98%|█████████▊| 364415/371472 [6:50:11<32:26,  3.63it/s]
 98%|█████████▊| 364416/371472 [6:50:11<33:51,  3.47it/s]
 98%|█████████▊| 364417/371472 [6:50:11<33:13,  3.54it/s]
 98%|█████████▊| 364418/371472 [6:50:12<32:36,  3.60it/s]
 98%|█████████▊| 364419/371472 [6:50:12<32:37,  3.60it/s]
 98%|█████████▊| 364420/371472 [6:50:12<32:29,  3.62it/s]
                                                         
{'loss': 2.7192, 'learning_rate': 1.1709474455385804e-07, 'epoch': 15.7}

 98%|█████████▊| 364420/371472 [6:50:12<32:29,  3.62it/s]
 98%|█████████▊| 364421/371472 [6:50:12<31:46,  3.70it/s]
 98%|█████████▊| 364422/371472 [6:50:13<33:06,  3.55it/s]
 98%|█████████▊| 364423/371472 [6:50:13<32:44,  3.59it/s]
 98%|█████████▊| 364424/371472 [6:50:13<32:14,  3.64it/s]
 98%|█████████▊| 364425/371472 [6:50:14<33:06,  3.55it/s]
 98%|█████████▊| 364426/371472 [6:50:14<35:26,  3.31it/s]
 98%|█████████▊| 364427/371472 [6:50:14<36:15,  3.24it/s]
 98%|█████████▊| 364428/371472 [6:50:14<34:29,  3.40it/s]
 98%|█████████▊| 364429/371472 [6:50:15<33:27,  3.51it/s]
 98%|█████████▊| 364430/371472 [6:50:15<32:51,  3.57it/s]
 98%|█████████▊| 364431/371472 [6:50:15<32:08,  3.65it/s]
 98%|█████████▊| 364432/371472 [6:50:16<33:36,  3.49it/s]
 98%|█████████▊| 364433/371472 [6:50:16<33:57,  3.46it/s]
 98%|█████████▊| 364434/371472 [6:50:16<32:39,  3.59it/s]
 98%|█████████▊| 364435/371472 [6:50:16<33:33,  3.49it/s]
 98%|█████████▊| 364436/371472 [6:50:17<33:12,  3.53it/s]
 98%|█████████▊| 364437/371472 [6:50:17<32:24,  3.62it/s]
 98%|█████████▊| 364438/371472 [6:50:17<31:21,  3.74it/s]
 98%|█████████▊| 364439/371472 [6:50:17<31:34,  3.71it/s]
 98%|█████████▊| 364440/371472 [6:50:18<31:41,  3.70it/s]
                                                         
{'loss': 2.4633, 'learning_rate': 1.1704626257837919e-07, 'epoch': 15.7}

 98%|█████████▊| 364440/371472 [6:50:18<31:41,  3.70it/s]
 98%|█████████▊| 364441/371472 [6:50:18<31:21,  3.74it/s]
 98%|█████████▊| 364442/371472 [6:50:18<31:15,  3.75it/s]
 98%|█████████▊| 364443/371472 [6:50:19<32:52,  3.56it/s]
 98%|█████████▊| 364444/371472 [6:50:19<33:18,  3.52it/s]
 98%|█████████▊| 364445/371472 [6:50:19<33:11,  3.53it/s]
 98%|█████████▊| 364446/371472 [6:50:19<33:23,  3.51it/s]
 98%|█████████▊| 364447/371472 [6:50:20<34:36,  3.38it/s]
 98%|█████████▊| 364448/371472 [6:50:20<35:58,  3.25it/s]
 98%|█████████▊| 364449/371472 [6:50:20<36:17,  3.23it/s]
 98%|█████████▊| 364450/371472 [6:50:21<35:01,  3.34it/s]
 98%|█████████▊| 364451/371472 [6:50:21<33:38,  3.48it/s]
 98%|█████████▊| 364452/371472 [6:50:21<32:37,  3.59it/s]
 98%|█████████▊| 364453/371472 [6:50:21<32:12,  3.63it/s]
 98%|█████████▊| 364454/371472 [6:50:22<31:59,  3.66it/s]
 98%|█████████▊| 364455/371472 [6:50:22<34:04,  3.43it/s]
 98%|█████████▊| 364456/371472 [6:50:22<33:07,  3.53it/s]
 98%|█████████▊| 364457/371472 [6:50:23<31:54,  3.66it/s]
 98%|█████████▊| 364458/371472 [6:50:23<32:56,  3.55it/s]
 98%|█████████▊| 364459/371472 [6:50:23<33:41,  3.47it/s]
 98%|█████████▊| 364460/371472 [6:50:23<32:17,  3.62it/s]
                                                         
{'loss': 2.6139, 'learning_rate': 1.1699778060290026e-07, 'epoch': 15.7}

 98%|█████████▊| 364460/371472 [6:50:23<32:17,  3.62it/s]
 98%|█████████▊| 364461/371472 [6:50:24<31:47,  3.67it/s]
 98%|█████████▊| 364462/371472 [6:50:24<39:07,  2.99it/s]
 98%|█████████▊| 364463/371472 [6:50:25<39:12,  2.98it/s]
 98%|█████████▊| 364464/371472 [6:50:25<36:13,  3.22it/s]
 98%|█████████▊| 364465/371472 [6:50:25<34:32,  3.38it/s]
 98%|█████████▊| 364466/371472 [6:50:25<33:11,  3.52it/s]
 98%|█████████▊| 364467/371472 [6:50:26<31:47,  3.67it/s]
 98%|█████████▊| 364468/371472 [6:50:26<32:49,  3.56it/s]
 98%|█████████▊| 364469/371472 [6:50:26<33:02,  3.53it/s]
 98%|█████████▊| 364470/371472 [6:50:26<31:45,  3.68it/s]
 98%|█████████▊| 364471/371472 [6:50:27<33:12,  3.51it/s]
 98%|█████████▊| 364472/371472 [6:50:27<32:12,  3.62it/s]
 98%|█████████▊| 364473/371472 [6:50:27<31:39,  3.68it/s]
 98%|█████████▊| 364474/371472 [6:50:27<30:28,  3.83it/s]
 98%|█████████▊| 364475/371472 [6:50:28<30:11,  3.86it/s]
 98%|█████████▊| 364476/371472 [6:50:28<31:17,  3.73it/s]
 98%|█████████▊| 364477/371472 [6:50:28<30:31,  3.82it/s]
 98%|█████████▊| 364478/371472 [6:50:29<33:41,  3.46it/s]
 98%|█████████▊| 364479/371472 [6:50:29<33:56,  3.43it/s]
 98%|█████████▊| 364480/371472 [6:50:29<33:29,  3.48it/s]
                                                         
{'loss': 2.4743, 'learning_rate': 1.1694929862742141e-07, 'epoch': 15.7}

 98%|█████████▊| 364480/371472 [6:50:29<33:29,  3.48it/s]
 98%|█████████▊| 364481/371472 [6:50:29<32:19,  3.61it/s]
 98%|█████████▊| 364482/371472 [6:50:30<33:45,  3.45it/s]
 98%|█████████▊| 364483/371472 [6:50:30<33:12,  3.51it/s]
 98%|█████████▊| 364484/371472 [6:50:30<34:09,  3.41it/s]
 98%|█████████▊| 364485/371472 [6:50:31<33:56,  3.43it/s]
 98%|█████████▊| 364486/371472 [6:50:31<32:17,  3.60it/s]
 98%|█████████▊| 364487/371472 [6:50:31<33:12,  3.51it/s]
 98%|█████████▊| 364488/371472 [6:50:31<32:59,  3.53it/s]
 98%|█████████▊| 364489/371472 [6:50:32<32:52,  3.54it/s]
 98%|█████████▊| 364490/371472 [6:50:32<33:01,  3.52it/s]
 98%|█████████▊| 364491/371472 [6:50:32<32:24,  3.59it/s]
 98%|█████████▊| 364492/371472 [6:50:32<30:26,  3.82it/s]
 98%|█████████▊| 364493/371472 [6:50:33<30:53,  3.76it/s]
 98%|█████████▊| 364494/371472 [6:50:33<30:03,  3.87it/s]
 98%|█████████▊| 364495/371472 [6:50:33<30:42,  3.79it/s]
 98%|█████████▊| 364496/371472 [6:50:34<31:33,  3.68it/s]
 98%|█████████▊| 364497/371472 [6:50:34<33:28,  3.47it/s]
 98%|█████████▊| 364498/371472 [6:50:34<35:59,  3.23it/s]
 98%|█████████▊| 364499/371472 [6:50:35<34:25,  3.38it/s]
 98%|█████████▊| 364500/371472 [6:50:35<33:39,  3.45it/s]
                                                         
{'loss': 2.6811, 'learning_rate': 1.1690081665194247e-07, 'epoch': 15.7}

 98%|█████████▊| 364500/371472 [6:50:35<33:39,  3.45it/s]
 98%|█████████▊| 364501/371472 [6:50:35<32:36,  3.56it/s]
 98%|█████████▊| 364502/371472 [6:50:35<32:17,  3.60it/s]
 98%|█████████▊| 364503/371472 [6:50:36<30:50,  3.77it/s]
 98%|█████████▊| 364504/371472 [6:50:36<30:21,  3.83it/s]
 98%|█████████▊| 364505/371472 [6:50:36<29:57,  3.88it/s]
 98%|█████████▊| 364506/371472 [6:50:36<30:40,  3.78it/s]
 98%|█████████▊| 364507/371472 [6:50:37<30:06,  3.86it/s]
 98%|█████████▊| 364508/371472 [6:50:37<31:14,  3.72it/s]
 98%|█████████▊| 364509/371472 [6:50:37<30:49,  3.76it/s]
 98%|█████████▊| 364510/371472 [6:50:37<32:18,  3.59it/s]
 98%|█████████▊| 364511/371472 [6:50:38<32:34,  3.56it/s]
 98%|█████████▊| 364512/371472 [6:50:38<32:23,  3.58it/s]
 98%|█████████▊| 364513/371472 [6:50:38<32:43,  3.54it/s]
 98%|█████████▊| 364514/371472 [6:50:39<30:52,  3.76it/s]
 98%|█████████▊| 364515/371472 [6:50:39<32:14,  3.60it/s]
 98%|█████████▊| 364516/371472 [6:50:39<31:38,  3.66it/s]
 98%|█████████▊| 364517/371472 [6:50:39<32:58,  3.51it/s]
 98%|█████████▊| 364518/371472 [6:50:40<32:31,  3.56it/s]
 98%|█████████▊| 364519/371472 [6:50:40<31:10,  3.72it/s]
 98%|█████████▊| 364520/371472 [6:50:41<42:28,  2.73it/s]
                                                         
{'loss': 2.6283, 'learning_rate': 1.1685233467646363e-07, 'epoch': 15.7}

 98%|█████████▊| 364520/371472 [6:50:41<42:28,  2.73it/s]
 98%|█████████▊| 364521/371472 [6:50:41<39:18,  2.95it/s]
 98%|█████████▊| 364522/371472 [6:50:41<37:55,  3.05it/s]
 98%|█████████▊| 364523/371472 [6:50:41<35:34,  3.25it/s]
 98%|█████████▊| 364524/371472 [6:50:42<33:17,  3.48it/s]
 98%|█████████▊| 364525/371472 [6:50:42<32:00,  3.62it/s]
 98%|█████████▊| 364526/371472 [6:50:42<32:31,  3.56it/s]
 98%|█████████▊| 364527/371472 [6:50:42<32:30,  3.56it/s]
 98%|█████████▊| 364528/371472 [6:50:43<32:35,  3.55it/s]
 98%|█████████▊| 364529/371472 [6:50:43<31:19,  3.69it/s]
 98%|█████████▊| 364530/371472 [6:50:43<30:59,  3.73it/s]
 98%|█████████▊| 364531/371472 [6:50:43<30:20,  3.81it/s]
 98%|█████████▊| 364532/371472 [6:50:44<31:07,  3.72it/s]
 98%|█████████▊| 364533/371472 [6:50:44<31:29,  3.67it/s]
 98%|█████████▊| 364534/371472 [6:50:44<30:48,  3.75it/s]
 98%|█████████▊| 364535/371472 [6:50:45<30:07,  3.84it/s]
 98%|█████████▊| 364536/371472 [6:50:45<30:51,  3.75it/s]
 98%|█████████▊| 364537/371472 [6:50:45<30:13,  3.82it/s]
 98%|█████████▊| 364538/371472 [6:50:45<30:59,  3.73it/s]
 98%|█████████▊| 364539/371472 [6:50:46<30:51,  3.74it/s]
 98%|█████████▊| 364540/371472 [6:50:46<32:56,  3.51it/s]
                                                         
{'loss': 2.5899, 'learning_rate': 1.1680385270098468e-07, 'epoch': 15.7}

 98%|█████████▊| 364540/371472 [6:50:46<32:56,  3.51it/s]
 98%|█████████▊| 364541/371472 [6:50:46<33:49,  3.42it/s]
 98%|█████████▊| 364542/371472 [6:50:47<33:39,  3.43it/s]
 98%|█████████▊| 364543/371472 [6:50:47<34:29,  3.35it/s]
 98%|█████████▊| 364544/371472 [6:50:47<34:50,  3.31it/s]
 98%|█████████▊| 364545/371472 [6:50:47<33:30,  3.45it/s]
 98%|█████████▊| 364546/371472 [6:50:48<32:36,  3.54it/s]
 98%|█████████▊| 364547/371472 [6:50:48<36:29,  3.16it/s]
 98%|█████████▊| 364548/371472 [6:50:48<35:51,  3.22it/s]
 98%|█████████▊| 364549/371472 [6:50:49<36:16,  3.18it/s]
 98%|█████████▊| 364550/371472 [6:50:49<35:10,  3.28it/s]
 98%|█████████▊| 364551/371472 [6:50:49<33:40,  3.43it/s]
 98%|█████████▊| 364552/371472 [6:50:50<33:24,  3.45it/s]
 98%|█████████▊| 364553/371472 [6:50:50<32:14,  3.58it/s]
 98%|█████████▊| 364554/371472 [6:50:50<32:04,  3.60it/s]
 98%|█████████▊| 364555/371472 [6:50:50<31:28,  3.66it/s]
 98%|█████████▊| 364556/371472 [6:50:51<31:41,  3.64it/s]
 98%|█████████▊| 364557/371472 [6:50:51<31:01,  3.71it/s]
 98%|█████████▊| 364558/371472 [6:50:51<30:13,  3.81it/s]
 98%|█████████▊| 364559/371472 [6:50:51<32:14,  3.57it/s]
 98%|█████████▊| 364560/371472 [6:50:52<34:31,  3.34it/s]
                                                         
{'loss': 2.6301, 'learning_rate': 1.1675537072550584e-07, 'epoch': 15.7}

 98%|█████████▊| 364560/371472 [6:50:52<34:31,  3.34it/s]
 98%|█████████▊| 364561/371472 [6:50:52<33:38,  3.42it/s]
 98%|█████████▊| 364562/371472 [6:50:52<32:50,  3.51it/s]
 98%|█████████▊| 364563/371472 [6:50:53<35:30,  3.24it/s]
 98%|█████████▊| 364564/371472 [6:50:53<32:50,  3.51it/s]
 98%|█████████▊| 364565/371472 [6:50:53<33:10,  3.47it/s]
 98%|█████████▊| 364566/371472 [6:50:53<31:29,  3.65it/s]
 98%|█████████▊| 364567/371472 [6:50:54<30:44,  3.74it/s]
 98%|█████████▊| 364568/371472 [6:50:54<30:06,  3.82it/s]
 98%|█████████▊| 364569/371472 [6:50:54<29:54,  3.85it/s]
 98%|█████████▊| 364570/371472 [6:50:54<30:42,  3.75it/s]
 98%|█████████▊| 364571/371472 [6:50:55<30:32,  3.77it/s]
 98%|█████████▊| 364572/371472 [6:50:55<29:53,  3.85it/s]
 98%|█████████▊| 364573/371472 [6:50:55<30:09,  3.81it/s]
 98%|█████████▊| 364574/371472 [6:50:55<29:55,  3.84it/s]
 98%|█████████▊| 364575/371472 [6:50:56<31:16,  3.67it/s]
 98%|█████████▊| 364576/371472 [6:50:56<32:07,  3.58it/s]
 98%|█████████▊| 364577/371472 [6:50:56<34:25,  3.34it/s]
 98%|█████████▊| 364578/371472 [6:50:57<34:14,  3.36it/s]
 98%|█████████▊| 364579/371472 [6:50:57<32:25,  3.54it/s]
 98%|█████████▊| 364580/371472 [6:50:57<33:54,  3.39it/s]
                                                         
{'loss': 2.6389, 'learning_rate': 1.167068887500269e-07, 'epoch': 15.7}

 98%|█████████▊| 364580/371472 [6:50:57<33:54,  3.39it/s]
 98%|█████████▊| 364581/371472 [6:50:58<34:38,  3.32it/s]
 98%|█████████▊| 364582/371472 [6:50:58<34:29,  3.33it/s]
 98%|█████████▊| 364583/371472 [6:50:58<35:17,  3.25it/s]
 98%|█████████▊| 364584/371472 [6:50:59<33:45,  3.40it/s]
 98%|█████████▊| 364585/371472 [6:50:59<34:04,  3.37it/s]
 98%|█████████▊| 364586/371472 [6:50:59<33:38,  3.41it/s]
 98%|█████████▊| 364587/371472 [6:50:59<33:56,  3.38it/s]
 98%|█████████▊| 364588/371472 [6:51:00<33:33,  3.42it/s]
 98%|█████████▊| 364589/371472 [6:51:00<33:17,  3.45it/s]
 98%|█████████▊| 364590/371472 [6:51:00<31:15,  3.67it/s]
 98%|█████████▊| 364591/371472 [6:51:01<32:59,  3.48it/s]
 98%|█████████▊| 364592/371472 [6:51:01<33:55,  3.38it/s]
 98%|█████████▊| 364593/371472 [6:51:01<33:06,  3.46it/s]
 98%|█████████▊| 364594/371472 [6:51:01<32:56,  3.48it/s]
 98%|█████████▊| 364595/371472 [6:51:02<31:02,  3.69it/s]
 98%|█████████▊| 364596/371472 [6:51:02<30:43,  3.73it/s]
 98%|█████████▊| 364597/371472 [6:51:02<29:52,  3.83it/s]
 98%|█████████▊| 364598/371472 [6:51:02<30:19,  3.78it/s]
 98%|█████████▊| 364599/371472 [6:51:03<31:30,  3.64it/s]
 98%|█████████▊| 364600/371472 [6:51:03<31:27,  3.64it/s]
                                                         
{'loss': 2.6371, 'learning_rate': 1.1665840677454805e-07, 'epoch': 15.7}

 98%|█████████▊| 364600/371472 [6:51:03<31:27,  3.64it/s]
 98%|█████████▊| 364601/371472 [6:51:03<30:33,  3.75it/s]
 98%|█████████▊| 364602/371472 [6:51:03<30:57,  3.70it/s]
 98%|█████████▊| 364603/371472 [6:51:04<33:44,  3.39it/s]
 98%|█████████▊| 364604/371472 [6:51:04<33:58,  3.37it/s]
 98%|█████████▊| 364605/371472 [6:51:04<32:14,  3.55it/s]
 98%|█████████▊| 364606/371472 [6:51:05<32:15,  3.55it/s]
 98%|█████████▊| 364607/371472 [6:51:05<32:41,  3.50it/s]
 98%|█████████▊| 364608/371472 [6:51:05<31:08,  3.67it/s]
 98%|█████████▊| 364609/371472 [6:51:05<30:16,  3.78it/s]
 98%|█████████▊| 364610/371472 [6:51:06<31:13,  3.66it/s]
 98%|█████████▊| 364611/371472 [6:51:06<31:39,  3.61it/s]
 98%|█████████▊| 364612/371472 [6:51:06<30:54,  3.70it/s]
 98%|█████████▊| 364613/371472 [6:51:07<30:11,  3.79it/s]
 98%|█████████▊| 364614/371472 [6:51:07<30:43,  3.72it/s]
 98%|█████████▊| 364615/371472 [6:51:07<29:39,  3.85it/s]
 98%|█████████▊| 364616/371472 [6:51:07<30:18,  3.77it/s]
 98%|█████████▊| 364617/371472 [6:51:08<30:52,  3.70it/s]
 98%|█████████▊| 364618/371472 [6:51:08<30:58,  3.69it/s]
 98%|█████████▊| 364619/371472 [6:51:08<30:39,  3.73it/s]
 98%|█████████▊| 364620/371472 [6:51:08<29:50,  3.83it/s]
                                                         
{'loss': 2.6628, 'learning_rate': 1.1660992479906911e-07, 'epoch': 15.7}

 98%|█████████▊| 364620/371472 [6:51:08<29:50,  3.83it/s]
 98%|█████████▊| 364621/371472 [6:51:09<29:18,  3.90it/s]
 98%|█████████▊| 364622/371472 [6:51:09<29:33,  3.86it/s]
 98%|█████████▊| 364623/371472 [6:51:09<30:27,  3.75it/s]
 98%|█████████▊| 364624/371472 [6:51:10<31:56,  3.57it/s]
 98%|█████████▊| 364625/371472 [6:51:10<30:40,  3.72it/s]
 98%|█████████▊| 364626/371472 [6:51:10<30:21,  3.76it/s]
 98%|█████████▊| 364627/371472 [6:51:10<31:21,  3.64it/s]
 98%|█████████▊| 364628/371472 [6:51:11<31:39,  3.60it/s]
 98%|█████████▊| 364629/371472 [6:51:11<31:44,  3.59it/s]
 98%|█████████▊| 364630/371472 [6:51:11<31:51,  3.58it/s]
 98%|█████████▊| 364631/371472 [6:51:11<31:15,  3.65it/s]
 98%|█████████▊| 364632/371472 [6:51:12<31:10,  3.66it/s]
 98%|█████████▊| 364633/371472 [6:51:12<31:16,  3.64it/s]
 98%|█████████▊| 364634/371472 [6:51:12<31:00,  3.67it/s]
 98%|█████████▊| 364635/371472 [6:51:13<30:59,  3.68it/s]
 98%|█████████▊| 364636/371472 [6:51:13<31:09,  3.66it/s]
 98%|█████████▊| 364637/371472 [6:51:13<31:06,  3.66it/s]
 98%|█████████▊| 364638/371472 [6:51:13<30:27,  3.74it/s]
 98%|█████████▊| 364639/371472 [6:51:14<29:05,  3.91it/s]
 98%|█████████▊| 364640/371472 [6:51:14<30:43,  3.71it/s]
                                                         
{'loss': 2.6313, 'learning_rate': 1.1656144282359027e-07, 'epoch': 15.71}

 98%|█████████▊| 364640/371472 [6:51:14<30:43,  3.71it/s]
 98%|█████████▊| 364641/371472 [6:51:14<32:07,  3.54it/s]
 98%|█████████▊| 364642/371472 [6:51:14<32:26,  3.51it/s]
 98%|█████████▊| 364643/371472 [6:51:15<36:13,  3.14it/s]
 98%|█████████▊| 364644/371472 [6:51:15<34:48,  3.27it/s]
 98%|█████████▊| 364645/371472 [6:51:15<32:58,  3.45it/s]
 98%|█████████▊| 364646/371472 [6:51:16<31:40,  3.59it/s]
 98%|█████████▊| 364647/371472 [6:51:16<30:57,  3.67it/s]
 98%|█████████▊| 364648/371472 [6:51:16<33:48,  3.36it/s]
 98%|█████████▊| 364649/371472 [6:51:16<32:01,  3.55it/s]
 98%|█████████▊| 364650/371472 [6:51:17<32:28,  3.50it/s]
 98%|█████████▊| 364651/371472 [6:51:17<34:20,  3.31it/s]
 98%|█████████▊| 364652/371472 [6:51:17<34:20,  3.31it/s]
 98%|█████████▊| 364653/371472 [6:51:18<33:20,  3.41it/s]
 98%|█████████▊| 364654/371472 [6:51:18<32:26,  3.50it/s]
 98%|█████████▊| 364655/371472 [6:51:18<31:25,  3.61it/s]
 98%|█████████▊| 364656/371472 [6:51:18<31:01,  3.66it/s]
 98%|█████████▊| 364657/371472 [6:51:19<30:10,  3.76it/s]
 98%|█████████▊| 364658/371472 [6:51:19<29:54,  3.80it/s]
 98%|█████████▊| 364659/371472 [6:51:19<29:56,  3.79it/s]
 98%|█████████▊| 364660/371472 [6:51:19<29:39,  3.83it/s]
                                                         
{'loss': 2.5691, 'learning_rate': 1.1651296084811133e-07, 'epoch': 15.71}

 98%|█████████▊| 364660/371472 [6:51:20<29:39,  3.83it/s]
 98%|█████████▊| 364661/371472 [6:51:20<31:52,  3.56it/s]
 98%|█████████▊| 364662/371472 [6:51:20<32:28,  3.50it/s]
 98%|█████████▊| 364663/371472 [6:51:20<32:59,  3.44it/s]
 98%|█████████▊| 364664/371472 [6:51:21<35:24,  3.21it/s]
 98%|█████████▊| 364665/371472 [6:51:21<33:23,  3.40it/s]
 98%|█████████▊| 364666/371472 [6:51:21<32:08,  3.53it/s]
 98%|█████████▊| 364667/371472 [6:51:22<30:40,  3.70it/s]
 98%|█████████▊| 364668/371472 [6:51:22<31:36,  3.59it/s]
 98%|█████████▊| 364669/371472 [6:51:22<34:08,  3.32it/s]
 98%|█████████▊| 364670/371472 [6:51:22<32:13,  3.52it/s]
 98%|█████████▊| 364671/371472 [6:51:23<31:10,  3.64it/s]
 98%|█████████▊| 364672/371472 [6:51:23<31:11,  3.63it/s]
 98%|█████████▊| 364673/371472 [6:51:23<34:01,  3.33it/s]
 98%|█████████▊| 364674/371472 [6:51:24<32:20,  3.50it/s]
 98%|█████████▊| 364675/371472 [6:51:24<31:48,  3.56it/s]
 98%|█████████▊| 364676/371472 [6:51:24<31:59,  3.54it/s]
 98%|█████████▊| 364677/371472 [6:51:24<32:38,  3.47it/s]
 98%|█████████▊| 364678/371472 [6:51:25<31:43,  3.57it/s]
 98%|█████████▊| 364679/371472 [6:51:25<31:32,  3.59it/s]
 98%|█████████▊| 364680/371472 [6:51:25<32:25,  3.49it/s]
                                                         
{'loss': 2.723, 'learning_rate': 1.1646447887263248e-07, 'epoch': 15.71}

 98%|█████████▊| 364680/371472 [6:51:25<32:25,  3.49it/s]
 98%|█████████▊| 364681/371472 [6:51:26<32:00,  3.54it/s]
 98%|█████████▊| 364682/371472 [6:51:26<31:19,  3.61it/s]
 98%|█████████▊| 364683/371472 [6:51:26<31:31,  3.59it/s]
 98%|█████████▊| 364684/371472 [6:51:26<30:44,  3.68it/s]
 98%|█████████▊| 364685/371472 [6:51:27<32:54,  3.44it/s]
 98%|█████████▊| 364686/371472 [6:51:27<31:53,  3.55it/s]
 98%|█████████▊| 364687/371472 [6:51:27<32:34,  3.47it/s]
 98%|█████████▊| 364688/371472 [6:51:28<32:33,  3.47it/s]
 98%|█████████▊| 364689/371472 [6:51:28<32:41,  3.46it/s]
 98%|█████████▊| 364690/371472 [6:51:28<34:45,  3.25it/s]
 98%|█████████▊| 364691/371472 [6:51:28<33:11,  3.40it/s]
 98%|█████████▊| 364692/371472 [6:51:29<32:14,  3.50it/s]
 98%|█████████▊| 364693/371472 [6:51:29<32:00,  3.53it/s]
 98%|█████████▊| 364694/371472 [6:51:29<31:39,  3.57it/s]
 98%|█████████▊| 364695/371472 [6:51:30<32:15,  3.50it/s]
 98%|█████████▊| 364696/371472 [6:51:30<32:16,  3.50it/s]
 98%|█████████▊| 364697/371472 [6:51:30<32:04,  3.52it/s]
 98%|█████████▊| 364698/371472 [6:51:30<30:31,  3.70it/s]
 98%|█████████▊| 364699/371472 [6:51:31<29:43,  3.80it/s]
 98%|█████████▊| 364700/371472 [6:51:31<29:48,  3.79it/s]
                                                         
{'loss': 2.6446, 'learning_rate': 1.1641599689715355e-07, 'epoch': 15.71}

 98%|█████████▊| 364700/371472 [6:51:31<29:48,  3.79it/s]
 98%|█████████▊| 364701/371472 [6:51:31<30:44,  3.67it/s]
 98%|█████████▊| 364702/371472 [6:51:31<31:01,  3.64it/s]
 98%|█████████▊| 364703/371472 [6:51:32<31:47,  3.55it/s]
 98%|█████████▊| 364704/371472 [6:51:32<30:26,  3.71it/s]
 98%|█████████▊| 364705/371472 [6:51:32<31:35,  3.57it/s]
 98%|█████████▊| 364706/371472 [6:51:33<30:14,  3.73it/s]
 98%|█████████▊| 364707/371472 [6:51:33<30:53,  3.65it/s]
 98%|█████████▊| 364708/371472 [6:51:33<30:58,  3.64it/s]
 98%|█████████▊| 364709/371472 [6:51:33<30:58,  3.64it/s]
 98%|█████████▊| 364710/371472 [6:51:34<30:28,  3.70it/s]
 98%|█████████▊| 364711/371472 [6:51:34<30:28,  3.70it/s]
 98%|█████████▊| 364712/371472 [6:51:34<34:39,  3.25it/s]
 98%|█████████▊| 364713/371472 [6:51:35<33:13,  3.39it/s]
 98%|█████████▊| 364714/371472 [6:51:35<31:40,  3.56it/s]
 98%|█████████▊| 364715/371472 [6:51:35<33:18,  3.38it/s]
 98%|█████████▊| 364716/371472 [6:51:35<31:41,  3.55it/s]
 98%|█████████▊| 364717/371472 [6:51:36<30:54,  3.64it/s]
 98%|█████████▊| 364718/371472 [6:51:36<31:31,  3.57it/s]
 98%|█████████▊| 364719/371472 [6:51:36<32:34,  3.46it/s]
 98%|█████████▊| 364720/371472 [6:51:37<31:36,  3.56it/s]
                                                         
{'loss': 2.4994, 'learning_rate': 1.163675149216747e-07, 'epoch': 15.71}

 98%|█████████▊| 364720/371472 [6:51:37<31:36,  3.56it/s]
 98%|█████████▊| 364721/371472 [6:51:37<32:13,  3.49it/s]
 98%|█████████▊| 364722/371472 [6:51:37<31:18,  3.59it/s]
 98%|█████████▊| 364723/371472 [6:51:37<33:20,  3.37it/s]
 98%|█████████▊| 364724/371472 [6:51:38<36:45,  3.06it/s]
 98%|█████████▊| 364725/371472 [6:51:38<36:44,  3.06it/s]
 98%|█████████▊| 364726/371472 [6:51:38<36:05,  3.11it/s]
 98%|█████████▊| 364727/371472 [6:51:39<33:39,  3.34it/s]
 98%|█████████▊| 364728/371472 [6:51:39<36:54,  3.05it/s]
 98%|█████████▊| 364729/371472 [6:51:39<35:09,  3.20it/s]
 98%|█████████▊| 364730/371472 [6:51:40<33:49,  3.32it/s]
 98%|█████████▊| 364731/371472 [6:51:40<34:51,  3.22it/s]
 98%|█████████▊| 364732/371472 [6:51:40<34:51,  3.22it/s]
 98%|█████████▊| 364733/371472 [6:51:41<33:11,  3.38it/s]
 98%|█████████▊| 364734/371472 [6:51:41<32:08,  3.49it/s]
 98%|█████████▊| 364735/371472 [6:51:41<34:52,  3.22it/s]
 98%|█████████▊| 364736/371472 [6:51:42<36:52,  3.05it/s]
 98%|█████████▊| 364737/371472 [6:51:42<35:23,  3.17it/s]
 98%|█████████▊| 364738/371472 [6:51:42<33:33,  3.34it/s]
 98%|█████████▊| 364739/371472 [6:51:42<33:29,  3.35it/s]
 98%|█████████▊| 364740/371472 [6:51:43<31:50,  3.52it/s]
                                                         
{'loss': 2.4673, 'learning_rate': 1.1631903294619576e-07, 'epoch': 15.71}

 98%|█████████▊| 364740/371472 [6:51:43<31:50,  3.52it/s]
 98%|█████████▊| 364741/371472 [6:51:43<31:51,  3.52it/s]
 98%|█████████▊| 364742/371472 [6:51:43<30:51,  3.63it/s]
 98%|█████████▊| 364743/371472 [6:51:43<30:44,  3.65it/s]
 98%|█████████▊| 364744/371472 [6:51:44<29:29,  3.80it/s]
 98%|█████████▊| 364745/371472 [6:51:44<31:55,  3.51it/s]
 98%|█████████▊| 364746/371472 [6:51:44<32:07,  3.49it/s]
 98%|█████████▊| 364747/371472 [6:51:45<31:41,  3.54it/s]
 98%|█████████▊| 364748/371472 [6:51:45<32:04,  3.49it/s]
 98%|█████████▊| 364749/371472 [6:51:45<31:44,  3.53it/s]
 98%|█████████▊| 364750/371472 [6:51:45<31:11,  3.59it/s]
 98%|█████████▊| 364751/371472 [6:51:46<32:20,  3.46it/s]
 98%|█████████▊| 364752/371472 [6:51:46<31:12,  3.59it/s]
 98%|█████████▊| 364753/371472 [6:51:46<32:21,  3.46it/s]
 98%|█████████▊| 364754/371472 [6:51:47<31:48,  3.52it/s]
 98%|█████████▊| 364755/371472 [6:51:47<30:37,  3.66it/s]
 98%|█████████▊| 364756/371472 [6:51:47<30:10,  3.71it/s]
 98%|█████████▊| 364757/371472 [6:51:47<32:16,  3.47it/s]
 98%|█████████▊| 364758/371472 [6:51:48<31:45,  3.52it/s]
 98%|█████████▊| 364759/371472 [6:51:48<30:22,  3.68it/s]
 98%|█████████▊| 364760/371472 [6:51:48<30:12,  3.70it/s]
                                                         
{'loss': 2.5598, 'learning_rate': 1.1627055097071691e-07, 'epoch': 15.71}

 98%|█████████▊| 364760/371472 [6:51:48<30:12,  3.70it/s]
 98%|█████████▊| 364761/371472 [6:51:48<29:49,  3.75it/s]
 98%|█████████▊| 364762/371472 [6:51:49<30:13,  3.70it/s]
 98%|█████████▊| 364763/371472 [6:51:49<29:48,  3.75it/s]
 98%|█████████▊| 364764/371472 [6:51:49<29:25,  3.80it/s]
 98%|█████████▊| 364765/371472 [6:51:50<29:57,  3.73it/s]
 98%|█████████▊| 364766/371472 [6:51:50<29:31,  3.79it/s]
 98%|█████████▊| 364767/371472 [6:51:50<32:38,  3.42it/s]
 98%|█████████▊| 364768/371472 [6:51:50<30:59,  3.60it/s]
 98%|█████████▊| 364769/371472 [6:51:51<31:04,  3.60it/s]
 98%|█████████▊| 364770/371472 [6:51:51<30:05,  3.71it/s]
 98%|█████████▊| 364771/371472 [6:51:51<30:52,  3.62it/s]
 98%|█████████▊| 364772/371472 [6:51:51<30:27,  3.67it/s]
 98%|█████████▊| 364773/371472 [6:51:52<30:17,  3.69it/s]
 98%|█████████▊| 364774/371472 [6:51:52<31:20,  3.56it/s]
 98%|█████████▊| 364775/371472 [6:51:52<31:10,  3.58it/s]
 98%|█████████▊| 364776/371472 [6:51:53<30:48,  3.62it/s]
 98%|█████████▊| 364777/371472 [6:51:53<31:08,  3.58it/s]
 98%|█████████▊| 364778/371472 [6:51:53<32:51,  3.39it/s]
 98%|█████████▊| 364779/371472 [6:51:53<32:47,  3.40it/s]
 98%|█████████▊| 364780/371472 [6:51:54<31:15,  3.57it/s]
                                                         
{'loss': 2.6043, 'learning_rate': 1.1622206899523797e-07, 'epoch': 15.71}

 98%|█████████▊| 364780/371472 [6:51:54<31:15,  3.57it/s]
 98%|█████████▊| 364781/371472 [6:51:54<30:08,  3.70it/s]
 98%|█████████▊| 364782/371472 [6:51:54<29:30,  3.78it/s]
 98%|█████████▊| 364783/371472 [6:51:54<29:03,  3.84it/s]
 98%|█████████▊| 364784/371472 [6:51:55<28:44,  3.88it/s]
 98%|█████████▊| 364785/371472 [6:51:55<28:03,  3.97it/s]
 98%|█████████▊| 364786/371472 [6:51:55<30:10,  3.69it/s]
 98%|█████████▊| 364787/371472 [6:51:56<33:13,  3.35it/s]
 98%|█████████▊| 364788/371472 [6:51:56<31:31,  3.53it/s]
 98%|█████████▊| 364789/371472 [6:51:56<33:54,  3.29it/s]
 98%|█████████▊| 364790/371472 [6:51:57<32:39,  3.41it/s]
 98%|█████████▊| 364791/371472 [6:51:57<32:31,  3.42it/s]
 98%|█████████▊| 364792/371472 [6:51:57<31:21,  3.55it/s]
 98%|█████████▊| 364793/371472 [6:51:57<31:03,  3.58it/s]
 98%|█████████▊| 364794/371472 [6:51:58<30:41,  3.63it/s]
 98%|█████████▊| 364795/371472 [6:51:58<30:36,  3.63it/s]
 98%|█████████▊| 364796/371472 [6:51:58<30:08,  3.69it/s]
 98%|█████████▊| 364797/371472 [6:51:58<29:31,  3.77it/s]
 98%|█████████▊| 364798/371472 [6:51:59<32:14,  3.45it/s]
 98%|█████████▊| 364799/371472 [6:51:59<31:11,  3.57it/s]
 98%|█████████▊| 364800/371472 [6:51:59<34:28,  3.23it/s]
                                                         
{'loss': 2.6243, 'learning_rate': 1.1617358701975914e-07, 'epoch': 15.71}

 98%|█████████▊| 364800/371472 [6:51:59<34:28,  3.23it/s]
 98%|█████████▊| 364801/371472 [6:52:00<33:43,  3.30it/s]
 98%|█████████▊| 364802/371472 [6:52:00<32:35,  3.41it/s]
 98%|█████████▊| 364803/371472 [6:52:00<31:20,  3.55it/s]
 98%|█████████▊| 364804/371472 [6:52:00<30:16,  3.67it/s]
 98%|█████████▊| 364805/371472 [6:52:01<29:27,  3.77it/s]
 98%|█████████▊| 364806/371472 [6:52:01<28:56,  3.84it/s]
 98%|█████████▊| 364807/371472 [6:52:01<28:11,  3.94it/s]
 98%|█████████▊| 364808/371472 [6:52:01<29:43,  3.74it/s]
 98%|█████████▊| 364809/371472 [6:52:02<29:52,  3.72it/s]
 98%|█████████▊| 364810/371472 [6:52:02<29:03,  3.82it/s]
 98%|█████████▊| 364811/371472 [6:52:02<29:06,  3.81it/s]
 98%|█████████▊| 364812/371472 [6:52:03<31:02,  3.58it/s]
 98%|█████████▊| 364813/371472 [6:52:03<30:19,  3.66it/s]
 98%|█████████▊| 364814/371472 [6:52:03<29:30,  3.76it/s]
 98%|█████████▊| 364815/371472 [6:52:03<29:04,  3.82it/s]
 98%|█████████▊| 364816/371472 [6:52:04<30:02,  3.69it/s]
 98%|█████████▊| 364817/371472 [6:52:04<30:10,  3.68it/s]
 98%|█████████▊| 364818/371472 [6:52:04<29:55,  3.71it/s]
 98%|█████████▊| 364819/371472 [6:52:04<29:56,  3.70it/s]
 98%|█████████▊| 364820/371472 [6:52:05<29:22,  3.77it/s]
                                                         
{'loss': 2.5401, 'learning_rate': 1.161251050442802e-07, 'epoch': 15.71}

 98%|█████████▊| 364820/371472 [6:52:05<29:22,  3.77it/s]
 98%|█████████▊| 364821/371472 [6:52:05<29:10,  3.80it/s]
 98%|█████████▊| 364822/371472 [6:52:05<30:08,  3.68it/s]
 98%|█████████▊| 364823/371472 [6:52:06<31:23,  3.53it/s]
 98%|█████████▊| 364824/371472 [6:52:06<30:23,  3.65it/s]
 98%|█████████▊| 364825/371472 [6:52:06<29:38,  3.74it/s]
 98%|█████████▊| 364826/371472 [6:52:06<33:14,  3.33it/s]
 98%|█████████▊| 364827/371472 [6:52:07<32:18,  3.43it/s]
 98%|█████████▊| 364828/371472 [6:52:07<31:22,  3.53it/s]
 98%|█████████▊| 364829/371472 [6:52:07<30:34,  3.62it/s]
 98%|█████████▊| 364830/371472 [6:52:08<31:53,  3.47it/s]
 98%|█████████▊| 364831/371472 [6:52:08<30:40,  3.61it/s]
 98%|█████████▊| 364832/371472 [6:52:08<29:52,  3.70it/s]
 98%|█████████▊| 364833/371472 [6:52:08<30:36,  3.61it/s]
 98%|█████████▊| 364834/371472 [6:52:09<31:29,  3.51it/s]
 98%|█████████▊| 364835/371472 [6:52:09<32:15,  3.43it/s]
 98%|█████████▊| 364836/371472 [6:52:09<32:03,  3.45it/s]
 98%|█████████▊| 364837/371472 [6:52:10<31:26,  3.52it/s]
 98%|█████████▊| 364838/371472 [6:52:10<32:29,  3.40it/s]
 98%|█████████▊| 364839/371472 [6:52:10<31:02,  3.56it/s]
 98%|█████████▊| 364840/371472 [6:52:10<30:21,  3.64it/s]
                                                         
{'loss': 2.627, 'learning_rate': 1.1607662306880135e-07, 'epoch': 15.71}

 98%|█████████▊| 364840/371472 [6:52:10<30:21,  3.64it/s]
 98%|█████████▊| 364841/371472 [6:52:11<30:28,  3.63it/s]
 98%|█████████▊| 364842/371472 [6:52:11<29:39,  3.73it/s]
 98%|█████████▊| 364843/371472 [6:52:11<28:54,  3.82it/s]
 98%|█████████▊| 364844/371472 [6:52:11<28:36,  3.86it/s]
 98%|█████████▊| 364845/371472 [6:52:12<28:15,  3.91it/s]
 98%|█████████▊| 364846/371472 [6:52:12<31:15,  3.53it/s]
 98%|█████████▊| 364847/371472 [6:52:12<30:33,  3.61it/s]
 98%|█████████▊| 364848/371472 [6:52:12<29:34,  3.73it/s]
 98%|█████████▊| 364849/371472 [6:52:13<30:11,  3.66it/s]
 98%|█████████▊| 364850/371472 [6:52:13<32:47,  3.37it/s]
 98%|█████████▊| 364851/371472 [6:52:13<32:52,  3.36it/s]
 98%|█████████▊| 364852/371472 [6:52:14<33:51,  3.26it/s]
 98%|█████████▊| 364853/371472 [6:52:14<31:51,  3.46it/s]
 98%|█████████▊| 364854/371472 [6:52:14<31:28,  3.50it/s]
 98%|█████████▊| 364855/371472 [6:52:15<30:48,  3.58it/s]
 98%|█████████▊| 364856/371472 [6:52:15<32:29,  3.39it/s]
 98%|█████████▊| 364857/371472 [6:52:15<32:25,  3.40it/s]
 98%|█████████▊| 364858/371472 [6:52:15<32:26,  3.40it/s]
 98%|█████████▊| 364859/371472 [6:52:16<30:21,  3.63it/s]
 98%|█████████▊| 364860/371472 [6:52:16<32:08,  3.43it/s]
                                                         
{'loss': 2.5466, 'learning_rate': 1.160281410933224e-07, 'epoch': 15.72}

 98%|█████████▊| 364860/371472 [6:52:16<32:08,  3.43it/s]
 98%|█████████▊| 364861/371472 [6:52:16<33:04,  3.33it/s]
 98%|█████████▊| 364862/371472 [6:52:17<30:59,  3.55it/s]
 98%|█████████▊| 364863/371472 [6:52:17<30:28,  3.61it/s]
 98%|█████████▊| 364864/371472 [6:52:17<35:44,  3.08it/s]
 98%|█████████▊| 364865/371472 [6:52:18<34:13,  3.22it/s]
 98%|█████████▊| 364866/371472 [6:52:18<33:46,  3.26it/s]
 98%|█████████▊| 364867/371472 [6:52:18<32:07,  3.43it/s]
 98%|█████████▊| 364868/371472 [6:52:18<31:49,  3.46it/s]
 98%|█████████▊| 364869/371472 [6:52:19<30:43,  3.58it/s]
 98%|█████████▊| 364870/371472 [6:52:19<30:31,  3.61it/s]
 98%|█████████▊| 364871/371472 [6:52:19<31:24,  3.50it/s]
 98%|█████████▊| 364872/371472 [6:52:20<32:51,  3.35it/s]
 98%|█████████▊| 364873/371472 [6:52:20<32:25,  3.39it/s]
 98%|█████████▊| 364874/371472 [6:52:20<32:28,  3.39it/s]
 98%|█████████▊| 364875/371472 [6:52:20<31:37,  3.48it/s]
 98%|█████████▊| 364876/371472 [6:52:21<30:34,  3.60it/s]
 98%|█████████▊| 364877/371472 [6:52:21<29:46,  3.69it/s]
 98%|█████████▊| 364878/371472 [6:52:21<30:17,  3.63it/s]
 98%|█████████▊| 364879/371472 [6:52:21<30:23,  3.61it/s]
 98%|█████████▊| 364880/371472 [6:52:22<30:55,  3.55it/s]
                                                         
{'loss': 2.5927, 'learning_rate': 1.1597965911784356e-07, 'epoch': 15.72}

 98%|█████████▊| 364880/371472 [6:52:22<30:55,  3.55it/s]
 98%|█████████▊| 364881/371472 [6:52:22<31:02,  3.54it/s]
 98%|█████████▊| 364882/371472 [6:52:22<30:19,  3.62it/s]
 98%|█████████▊| 364883/371472 [6:52:23<29:58,  3.66it/s]
 98%|█████████▊| 364884/371472 [6:52:23<30:42,  3.57it/s]
 98%|█████████▊| 364885/371472 [6:52:23<30:13,  3.63it/s]
 98%|█████████▊| 364886/371472 [6:52:23<32:48,  3.35it/s]
 98%|█████████▊| 364887/371472 [6:52:24<31:39,  3.47it/s]
 98%|█████████▊| 364888/371472 [6:52:24<30:23,  3.61it/s]
 98%|█████████▊| 364889/371472 [6:52:24<29:23,  3.73it/s]
 98%|█████████▊| 364890/371472 [6:52:25<31:04,  3.53it/s]
 98%|█████████▊| 364891/371472 [6:52:25<30:47,  3.56it/s]
 98%|█████████▊| 364892/371472 [6:52:25<33:41,  3.25it/s]
 98%|█████████▊| 364893/371472 [6:52:26<32:57,  3.33it/s]
 98%|█████████▊| 364894/371472 [6:52:26<31:08,  3.52it/s]
 98%|█████████▊| 364895/371472 [6:52:26<30:08,  3.64it/s]
 98%|█████████▊| 364896/371472 [6:52:26<30:23,  3.61it/s]
 98%|█████████▊| 364897/371472 [6:52:27<30:55,  3.54it/s]
 98%|█████████▊| 364898/371472 [6:52:27<31:42,  3.45it/s]
 98%|█████████▊| 364899/371472 [6:52:27<31:19,  3.50it/s]
 98%|█████████▊| 364900/371472 [6:52:27<31:57,  3.43it/s]
                                                         
{'loss': 2.628, 'learning_rate': 1.1593117714236463e-07, 'epoch': 15.72}

 98%|█████████▊| 364900/371472 [6:52:27<31:57,  3.43it/s]
 98%|█████████▊| 364901/371472 [6:52:28<31:06,  3.52it/s]
 98%|█████████▊| 364902/371472 [6:52:28<30:46,  3.56it/s]
 98%|█████████▊| 364903/371472 [6:52:28<31:24,  3.49it/s]
 98%|█████████▊| 364904/371472 [6:52:29<33:55,  3.23it/s]
 98%|█████████▊| 364905/371472 [6:52:29<32:35,  3.36it/s]
 98%|█████████▊| 364906/371472 [6:52:29<31:01,  3.53it/s]
 98%|█████████▊| 364907/371472 [6:52:29<30:26,  3.59it/s]
 98%|█████████▊| 364908/371472 [6:52:30<32:38,  3.35it/s]
 98%|█████████▊| 364909/371472 [6:52:30<32:08,  3.40it/s]
 98%|█████████▊| 364910/371472 [6:52:30<31:51,  3.43it/s]
 98%|█████████▊| 364911/371472 [6:52:31<32:08,  3.40it/s]
 98%|█████████▊| 364912/371472 [6:52:31<32:41,  3.34it/s]
 98%|█████████▊| 364913/371472 [6:52:31<36:52,  2.96it/s]
 98%|█████████▊| 364914/371472 [6:52:32<33:28,  3.26it/s]
 98%|█████████▊| 364915/371472 [6:52:32<31:56,  3.42it/s]
 98%|█████████▊| 364916/371472 [6:52:32<31:03,  3.52it/s]
 98%|█████████▊| 364917/371472 [6:52:32<31:43,  3.44it/s]
 98%|█████████▊| 364918/371472 [6:52:33<31:28,  3.47it/s]
 98%|█████████▊| 364919/371472 [6:52:33<30:33,  3.57it/s]
 98%|█████████▊| 364920/371472 [6:52:33<29:12,  3.74it/s]
                                                         
{'loss': 2.6255, 'learning_rate': 1.1588269516688567e-07, 'epoch': 15.72}

 98%|█████████▊| 364920/371472 [6:52:33<29:12,  3.74it/s]
 98%|█████████▊| 364921/371472 [6:52:34<30:02,  3.63it/s]
 98%|█████████▊| 364922/371472 [6:52:34<30:02,  3.63it/s]
 98%|█████████▊| 364923/371472 [6:52:34<29:32,  3.70it/s]
 98%|█████████▊| 364924/371472 [6:52:34<30:40,  3.56it/s]
 98%|█████████▊| 364925/371472 [6:52:35<29:28,  3.70it/s]
 98%|█████████▊| 364926/371472 [6:52:35<28:55,  3.77it/s]
 98%|█████████▊| 364927/371472 [6:52:35<31:20,  3.48it/s]
 98%|█████████▊| 364928/371472 [6:52:36<30:50,  3.54it/s]
 98%|█████████▊| 364929/371472 [6:52:36<30:33,  3.57it/s]
 98%|█████████▊| 364930/371472 [6:52:36<29:57,  3.64it/s]
 98%|█████████▊| 364931/371472 [6:52:36<30:24,  3.59it/s]
 98%|█████████▊| 364932/371472 [6:52:37<33:58,  3.21it/s]
 98%|█████████▊| 364933/371472 [6:52:37<32:31,  3.35it/s]
 98%|█████████▊| 364934/371472 [6:52:37<31:18,  3.48it/s]
 98%|█████████▊| 364935/371472 [6:52:38<30:36,  3.56it/s]
 98%|█████████▊| 364936/371472 [6:52:38<29:34,  3.68it/s]
 98%|█████████▊| 364937/371472 [6:52:38<31:37,  3.44it/s]
 98%|█████████▊| 364938/371472 [6:52:38<30:44,  3.54it/s]
 98%|█████████▊| 364939/371472 [6:52:39<33:23,  3.26it/s]
 98%|█████████▊| 364940/371472 [6:52:39<31:16,  3.48it/s]
                                                         
{'loss': 2.6177, 'learning_rate': 1.1583421319140684e-07, 'epoch': 15.72}

 98%|█████████▊| 364940/371472 [6:52:39<31:16,  3.48it/s]
 98%|█████████▊| 364941/371472 [6:52:39<32:19,  3.37it/s]
 98%|█████████▊| 364942/371472 [6:52:40<31:56,  3.41it/s]
 98%|█████████▊| 364943/371472 [6:52:40<30:52,  3.52it/s]
 98%|█████████▊| 364944/371472 [6:52:40<30:12,  3.60it/s]
 98%|█████████▊| 364945/371472 [6:52:40<29:47,  3.65it/s]
 98%|█████████▊| 364946/371472 [6:52:41<29:56,  3.63it/s]
 98%|█████████▊| 364947/371472 [6:52:41<29:29,  3.69it/s]
 98%|█████████▊| 364948/371472 [6:52:41<29:29,  3.69it/s]
 98%|█████████▊| 364949/371472 [6:52:41<30:01,  3.62it/s]
 98%|█████████▊| 364950/371472 [6:52:42<29:26,  3.69it/s]
 98%|█████████▊| 364951/371472 [6:52:42<29:41,  3.66it/s]
 98%|█████████▊| 364952/371472 [6:52:42<28:24,  3.83it/s]
 98%|█████████▊| 364953/371472 [6:52:43<29:13,  3.72it/s]
 98%|█████████▊| 364954/371472 [6:52:43<28:44,  3.78it/s]
 98%|█████████▊| 364955/371472 [6:52:43<29:27,  3.69it/s]
 98%|█████████▊| 364956/371472 [6:52:43<30:24,  3.57it/s]
 98%|█████████▊| 364957/371472 [6:52:44<33:42,  3.22it/s]
 98%|█████████▊| 364958/371472 [6:52:44<32:52,  3.30it/s]
 98%|█████████▊| 364959/371472 [6:52:44<33:31,  3.24it/s]
 98%|█████████▊| 364960/371472 [6:52:45<31:21,  3.46it/s]
                                                         
{'loss': 2.7174, 'learning_rate': 1.157857312159279e-07, 'epoch': 15.72}

 98%|█████████▊| 364960/371472 [6:52:45<31:21,  3.46it/s]
 98%|█████████▊| 364961/371472 [6:52:45<29:49,  3.64it/s]
 98%|█████████▊| 364962/371472 [6:52:45<28:47,  3.77it/s]
 98%|█████████▊| 364963/371472 [6:52:45<28:41,  3.78it/s]
 98%|█████████▊| 364964/371472 [6:52:46<30:35,  3.54it/s]
 98%|█████████▊| 364965/371472 [6:52:46<30:17,  3.58it/s]
 98%|█████████▊| 364966/371472 [6:52:46<31:13,  3.47it/s]
 98%|█████████▊| 364967/371472 [6:52:47<31:14,  3.47it/s]
 98%|█████████▊| 364968/371472 [6:52:47<30:20,  3.57it/s]
 98%|█████████▊| 364969/371472 [6:52:47<29:44,  3.65it/s]
 98%|█████████▊| 364970/371472 [6:52:47<29:16,  3.70it/s]
 98%|█████████▊| 364971/371472 [6:52:48<28:31,  3.80it/s]
 98%|█████████▊| 364972/371472 [6:52:48<30:01,  3.61it/s]
 98%|█████████▊| 364973/371472 [6:52:48<33:52,  3.20it/s]
 98%|█████████▊| 364974/371472 [6:52:49<32:42,  3.31it/s]
 98%|█████████▊| 364975/371472 [6:52:49<31:39,  3.42it/s]
 98%|█████████▊| 364976/371472 [6:52:49<30:36,  3.54it/s]
 98%|█████████▊| 364977/371472 [6:52:49<29:36,  3.66it/s]
 98%|█████████▊| 364978/371472 [6:52:50<28:26,  3.81it/s]
 98%|█████████▊| 364979/371472 [6:52:50<28:11,  3.84it/s]
 98%|█████████▊| 364980/371472 [6:52:50<28:53,  3.74it/s]
                                                         
{'loss': 2.5315, 'learning_rate': 1.1573724924044905e-07, 'epoch': 15.72}

 98%|█████████▊| 364980/371472 [6:52:50<28:53,  3.74it/s]
 98%|█████████▊| 364981/371472 [6:52:50<31:52,  3.39it/s]
 98%|█████████▊| 364982/371472 [6:52:51<32:04,  3.37it/s]
 98%|█████████▊| 364983/371472 [6:52:51<32:33,  3.32it/s]
 98%|█████████▊| 364984/371472 [6:52:51<30:59,  3.49it/s]
 98%|█████████▊| 364985/371472 [6:52:52<31:16,  3.46it/s]
 98%|█████████▊| 364986/371472 [6:52:52<30:21,  3.56it/s]
 98%|█████████▊| 364987/371472 [6:52:52<30:07,  3.59it/s]
 98%|█████████▊| 364988/371472 [6:52:52<31:36,  3.42it/s]
 98%|█████████▊| 364989/371472 [6:52:53<32:50,  3.29it/s]
 98%|█████████▊| 364990/371472 [6:52:53<33:45,  3.20it/s]
 98%|█████████▊| 364991/371472 [6:52:54<36:03,  3.00it/s]
 98%|█████████▊| 364992/371472 [6:52:54<34:05,  3.17it/s]
 98%|█████████▊| 364993/371472 [6:52:54<31:37,  3.41it/s]
 98%|█████████▊| 364994/371472 [6:52:54<33:21,  3.24it/s]
 98%|█████████▊| 364995/371472 [6:52:55<32:37,  3.31it/s]
 98%|█████████▊| 364996/371472 [6:52:55<32:10,  3.35it/s]
 98%|█████████▊| 364997/371472 [6:52:55<30:34,  3.53it/s]
 98%|█████████▊| 364998/371472 [6:52:56<31:03,  3.47it/s]
 98%|█████████▊| 364999/371472 [6:52:56<32:19,  3.34it/s]
 98%|█████████▊| 365000/371472 [6:52:56<31:36,  3.41it/s]
                                                         
{'loss': 2.5428, 'learning_rate': 1.1568876726497012e-07, 'epoch': 15.72}

 98%|█████████▊| 365000/371472 [6:52:56<31:36,  3.41it/s]
 98%|█████████▊| 365001/371472 [6:52:56<30:14,  3.57it/s]
 98%|█████████▊| 365002/371472 [6:52:57<28:53,  3.73it/s]
 98%|█████████▊| 365003/371472 [6:52:57<31:18,  3.44it/s]
 98%|█████████▊| 365004/371472 [6:52:57<30:31,  3.53it/s]
 98%|█████████▊| 365005/371472 [6:52:57<28:58,  3.72it/s]
 98%|█████████▊| 365006/371472 [6:52:58<29:00,  3.72it/s]
 98%|█████████▊| 365007/371472 [6:52:58<29:37,  3.64it/s]
 98%|█████████▊| 365008/371472 [6:52:58<28:48,  3.74it/s]
 98%|█████████▊| 365009/371472 [6:52:59<30:58,  3.48it/s]
 98%|█████████▊| 365010/371472 [6:52:59<30:20,  3.55it/s]
 98%|█████████▊| 365011/371472 [6:52:59<29:48,  3.61it/s]
 98%|█████████▊| 365012/371472 [6:52:59<30:50,  3.49it/s]
 98%|█████████▊| 365013/371472 [6:53:00<29:53,  3.60it/s]
 98%|█████████▊| 365014/371472 [6:53:00<29:49,  3.61it/s]
 98%|█████████▊| 365015/371472 [6:53:00<28:49,  3.73it/s]
 98%|█████████▊| 365016/371472 [6:53:00<28:38,  3.76it/s]
 98%|█████████▊| 365017/371472 [6:53:01<28:27,  3.78it/s]
 98%|█████████▊| 365018/371472 [6:53:01<27:59,  3.84it/s]
 98%|█████████▊| 365019/371472 [6:53:01<27:38,  3.89it/s]
 98%|█████████▊| 365020/371472 [6:53:02<28:19,  3.80it/s]
                                                         
{'loss': 2.5803, 'learning_rate': 1.1564028528949127e-07, 'epoch': 15.72}

 98%|█████████▊| 365020/371472 [6:53:02<28:19,  3.80it/s]
 98%|█████████▊| 365021/371472 [6:53:02<29:07,  3.69it/s]
 98%|█████████▊| 365022/371472 [6:53:02<31:18,  3.43it/s]
 98%|█████████▊| 365023/371472 [6:53:02<30:57,  3.47it/s]
 98%|█████████▊| 365024/371472 [6:53:03<31:29,  3.41it/s]
 98%|█████████▊| 365025/371472 [6:53:03<31:17,  3.43it/s]
 98%|█████████▊| 365026/371472 [6:53:03<32:53,  3.27it/s]
 98%|█████████▊| 365027/371472 [6:53:04<33:02,  3.25it/s]
 98%|█████████▊| 365028/371472 [6:53:04<32:30,  3.30it/s]
 98%|█████████▊| 365029/371472 [6:53:04<30:33,  3.51it/s]
 98%|█████████▊| 365030/371472 [6:53:04<31:10,  3.44it/s]
 98%|█████████▊| 365031/371472 [6:53:05<32:09,  3.34it/s]
 98%|█████████▊| 365032/371472 [6:53:05<33:05,  3.24it/s]
 98%|█████████▊| 365033/371472 [6:53:05<32:31,  3.30it/s]
 98%|█████████▊| 365034/371472 [6:53:06<32:36,  3.29it/s]
 98%|█████████▊| 365035/371472 [6:53:06<31:42,  3.38it/s]
 98%|█████████▊| 365036/371472 [6:53:06<30:41,  3.50it/s]
 98%|█████████▊| 365037/371472 [6:53:07<31:03,  3.45it/s]
 98%|█████████▊| 365038/371472 [6:53:07<31:03,  3.45it/s]
 98%|█████████▊| 365039/371472 [6:53:07<35:07,  3.05it/s]
 98%|█████████▊| 365040/371472 [6:53:08<34:05,  3.15it/s]
                                                         
{'loss': 2.5011, 'learning_rate': 1.1559180331401233e-07, 'epoch': 15.72}

 98%|█████████▊| 365040/371472 [6:53:08<34:05,  3.15it/s]
 98%|█████████▊| 365041/371472 [6:53:08<32:35,  3.29it/s]
 98%|█████████▊| 365042/371472 [6:53:08<31:52,  3.36it/s]
 98%|█████████▊| 365043/371472 [6:53:08<33:39,  3.18it/s]
 98%|█████████▊| 365044/371472 [6:53:09<33:13,  3.23it/s]
 98%|█████████▊| 365045/371472 [6:53:09<32:02,  3.34it/s]
 98%|█████████▊| 365046/371472 [6:53:09<33:05,  3.24it/s]
 98%|█████████▊| 365047/371472 [6:53:10<32:46,  3.27it/s]
 98%|█████████▊| 365048/371472 [6:53:10<31:57,  3.35it/s]
 98%|█████████▊| 365049/371472 [6:53:10<29:52,  3.58it/s]
 98%|█████████▊| 365050/371472 [6:53:10<29:59,  3.57it/s]
 98%|█████████▊| 365051/371472 [6:53:11<28:56,  3.70it/s]
 98%|█████████▊| 365052/371472 [6:53:11<29:17,  3.65it/s]
 98%|█████████▊| 365053/371472 [6:53:11<30:54,  3.46it/s]
 98%|█████████▊| 365054/371472 [6:53:12<31:10,  3.43it/s]
 98%|█████████▊| 365055/371472 [6:53:12<31:18,  3.42it/s]
 98%|█████████▊| 365056/371472 [6:53:12<30:34,  3.50it/s]
 98%|█████████▊| 365057/371472 [6:53:13<33:04,  3.23it/s]
 98%|█████████▊| 365058/371472 [6:53:13<31:40,  3.37it/s]
 98%|█████████▊| 365059/371472 [6:53:13<31:04,  3.44it/s]
 98%|█████████▊| 365060/371472 [6:53:13<30:55,  3.46it/s]
                                                         
{'loss': 2.5331, 'learning_rate': 1.1554332133853349e-07, 'epoch': 15.72}

 98%|█████████▊| 365060/371472 [6:53:13<30:55,  3.46it/s]
 98%|█████████▊| 365061/371472 [6:53:14<29:59,  3.56it/s]
 98%|█████████▊| 365062/371472 [6:53:14<31:09,  3.43it/s]
 98%|█████████▊| 365063/371472 [6:53:14<29:37,  3.61it/s]
 98%|█████████▊| 365064/371472 [6:53:14<28:46,  3.71it/s]
 98%|█████████▊| 365065/371472 [6:53:15<28:32,  3.74it/s]
 98%|█████████▊| 365066/371472 [6:53:15<28:47,  3.71it/s]
 98%|█████████▊| 365067/371472 [6:53:15<28:34,  3.74it/s]
 98%|█████████▊| 365068/371472 [6:53:16<28:19,  3.77it/s]
 98%|█████████▊| 365069/371472 [6:53:16<28:18,  3.77it/s]
 98%|█████████▊| 365070/371472 [6:53:16<29:14,  3.65it/s]
 98%|█████████▊| 365071/371472 [6:53:16<28:46,  3.71it/s]
 98%|█████████▊| 365072/371472 [6:53:17<28:19,  3.77it/s]
 98%|█████████▊| 365073/371472 [6:53:17<27:40,  3.85it/s]
 98%|█████████▊| 365074/371472 [6:53:17<27:36,  3.86it/s]
 98%|█████████▊| 365075/371472 [6:53:17<27:41,  3.85it/s]
 98%|█████████▊| 365076/371472 [6:53:18<29:04,  3.67it/s]
 98%|█████████▊| 365077/371472 [6:53:18<30:35,  3.48it/s]
 98%|█████████▊| 365078/371472 [6:53:18<30:12,  3.53it/s]
 98%|█████████▊| 365079/371472 [6:53:19<29:29,  3.61it/s]
 98%|█████████▊| 365080/371472 [6:53:19<32:43,  3.26it/s]
                                                         
{'loss': 2.5868, 'learning_rate': 1.1549483936305454e-07, 'epoch': 15.72}

 98%|█████████▊| 365080/371472 [6:53:19<32:43,  3.26it/s]
 98%|█████████▊| 365081/371472 [6:53:19<31:42,  3.36it/s]
 98%|█████████▊| 365082/371472 [6:53:19<29:50,  3.57it/s]
 98%|█████████▊| 365083/371472 [6:53:20<30:33,  3.48it/s]
 98%|█████████▊| 365084/371472 [6:53:20<30:10,  3.53it/s]
 98%|█████████▊| 365085/371472 [6:53:20<29:03,  3.66it/s]
 98%|█████████▊| 365086/371472 [6:53:21<32:02,  3.32it/s]
 98%|█████████▊| 365087/371472 [6:53:21<30:30,  3.49it/s]
 98%|█████████▊| 365088/371472 [6:53:21<33:14,  3.20it/s]
 98%|█████████▊| 365089/371472 [6:53:22<32:09,  3.31it/s]
 98%|█████████▊| 365090/371472 [6:53:22<30:54,  3.44it/s]
 98%|█████████▊| 365091/371472 [6:53:22<30:49,  3.45it/s]
 98%|█████████▊| 365092/371472 [6:53:22<30:25,  3.49it/s]
 98%|█████████▊| 365093/371472 [6:53:23<29:57,  3.55it/s]
 98%|█████████▊| 365094/371472 [6:53:23<29:38,  3.59it/s]
 98%|█████████▊| 365095/371472 [6:53:23<29:26,  3.61it/s]
 98%|█████████▊| 365096/371472 [6:53:23<30:46,  3.45it/s]
 98%|█████████▊| 365097/371472 [6:53:24<30:25,  3.49it/s]
 98%|█████████▊| 365098/371472 [6:53:24<32:08,  3.30it/s]
 98%|█████████▊| 365099/371472 [6:53:24<31:03,  3.42it/s]
 98%|█████████▊| 365100/371472 [6:53:25<30:47,  3.45it/s]
                                                         
{'loss': 2.7841, 'learning_rate': 1.154463573875757e-07, 'epoch': 15.73}

 98%|█████████▊| 365100/371472 [6:53:25<30:47,  3.45it/s]
 98%|█████████▊| 365101/371472 [6:53:25<32:06,  3.31it/s]
 98%|█████████▊| 365102/371472 [6:53:25<32:47,  3.24it/s]
 98%|█████████▊| 365103/371472 [6:53:26<33:02,  3.21it/s]
 98%|█████████▊| 365104/371472 [6:53:26<31:41,  3.35it/s]
 98%|█████████▊| 365105/371472 [6:53:26<31:11,  3.40it/s]
 98%|█████████▊| 365106/371472 [6:53:26<30:26,  3.49it/s]
 98%|█████████▊| 365107/371472 [6:53:27<32:23,  3.27it/s]
 98%|█████████▊| 365108/371472 [6:53:27<31:05,  3.41it/s]
 98%|█████████▊| 365109/371472 [6:53:27<30:52,  3.43it/s]
 98%|█████████▊| 365110/371472 [6:53:28<30:44,  3.45it/s]
 98%|█████████▊| 365111/371472 [6:53:28<31:20,  3.38it/s]
 98%|█████████▊| 365112/371472 [6:53:28<30:13,  3.51it/s]
 98%|█████████▊| 365113/371472 [6:53:29<32:03,  3.31it/s]
 98%|█████████▊| 365114/371472 [6:53:29<30:21,  3.49it/s]
 98%|█████████▊| 365115/371472 [6:53:29<31:32,  3.36it/s]
 98%|█████████▊| 365116/371472 [6:53:29<31:28,  3.37it/s]
 98%|█████████▊| 365117/371472 [6:53:30<31:25,  3.37it/s]
 98%|█████████▊| 365118/371472 [6:53:30<29:49,  3.55it/s]
 98%|█████████▊| 365119/371472 [6:53:30<31:22,  3.37it/s]
 98%|█████████▊| 365120/371472 [6:53:31<30:05,  3.52it/s]
                                                         
{'loss': 2.6285, 'learning_rate': 1.1539787541209676e-07, 'epoch': 15.73}

 98%|█████████▊| 365120/371472 [6:53:31<30:05,  3.52it/s]
 98%|█████████▊| 365121/371472 [6:53:31<29:31,  3.58it/s]
 98%|█████████▊| 365122/371472 [6:53:31<28:34,  3.70it/s]
 98%|█████████▊| 365123/371472 [6:53:31<28:30,  3.71it/s]
 98%|█████████▊| 365124/371472 [6:53:32<28:09,  3.76it/s]
 98%|█████████▊| 365125/371472 [6:53:32<27:58,  3.78it/s]
 98%|█████████▊| 365126/371472 [6:53:32<27:18,  3.87it/s]
 98%|█████████▊| 365127/371472 [6:53:32<28:36,  3.70it/s]
 98%|█████████▊| 365128/371472 [6:53:33<29:58,  3.53it/s]
 98%|█████████▊| 365129/371472 [6:53:33<29:15,  3.61it/s]
 98%|█████████▊| 365130/371472 [6:53:33<29:43,  3.55it/s]
 98%|█████████▊| 365131/371472 [6:53:34<35:45,  2.96it/s]
 98%|█████████▊| 365132/371472 [6:53:34<33:55,  3.11it/s]
 98%|█████████▊| 365133/371472 [6:53:34<32:53,  3.21it/s]
 98%|█████████▊| 365134/371472 [6:53:35<31:08,  3.39it/s]
 98%|█████████▊| 365135/371472 [6:53:35<31:28,  3.36it/s]
 98%|█████████▊| 365136/371472 [6:53:35<30:30,  3.46it/s]
 98%|█████████▊| 365137/371472 [6:53:35<29:47,  3.54it/s]
 98%|█████████▊| 365138/371472 [6:53:36<28:50,  3.66it/s]
 98%|█████████▊| 365139/371472 [6:53:36<28:34,  3.69it/s]
 98%|█████████▊| 365140/371472 [6:53:36<29:33,  3.57it/s]
                                                         
{'loss': 2.5816, 'learning_rate': 1.1534939343661791e-07, 'epoch': 15.73}

 98%|█████████▊| 365140/371472 [6:53:36<29:33,  3.57it/s]
 98%|█████████▊| 365141/371472 [6:53:37<38:21,  2.75it/s]
 98%|█████████▊| 365142/371472 [6:53:37<35:06,  3.00it/s]
 98%|█████████▊| 365143/371472 [6:53:37<33:20,  3.16it/s]
 98%|█████████▊| 365144/371472 [6:53:38<31:53,  3.31it/s]
 98%|█████████▊| 365145/371472 [6:53:38<31:45,  3.32it/s]
 98%|█████████▊| 365146/371472 [6:53:38<32:28,  3.25it/s]
 98%|█████████▊| 365147/371472 [6:53:38<31:48,  3.31it/s]
 98%|█████████▊| 365148/371472 [6:53:39<31:26,  3.35it/s]
 98%|█████████▊| 365149/371472 [6:53:39<31:22,  3.36it/s]
 98%|█████████▊| 365150/371472 [6:53:39<31:49,  3.31it/s]
 98%|█████████▊| 365151/371472 [6:53:40<30:53,  3.41it/s]
 98%|█████████▊| 365152/371472 [6:53:40<31:18,  3.36it/s]
 98%|█████████▊| 365153/371472 [6:53:40<30:32,  3.45it/s]
 98%|█████████▊| 365154/371472 [6:53:41<29:54,  3.52it/s]
 98%|█████████▊| 365155/371472 [6:53:41<30:17,  3.48it/s]
 98%|█████████▊| 365156/371472 [6:53:41<29:58,  3.51it/s]
 98%|█████████▊| 365157/371472 [6:53:41<30:50,  3.41it/s]
 98%|█████████▊| 365158/371472 [6:53:42<30:10,  3.49it/s]
 98%|█████████▊| 365159/371472 [6:53:42<31:37,  3.33it/s]
 98%|█████████▊| 365160/371472 [6:53:42<30:25,  3.46it/s]
                                                         
{'loss': 2.4902, 'learning_rate': 1.1530091146113898e-07, 'epoch': 15.73}

 98%|█████████▊| 365160/371472 [6:53:42<30:25,  3.46it/s]
 98%|█████████▊| 365161/371472 [6:53:43<33:08,  3.17it/s]
 98%|█████████▊| 365162/371472 [6:53:43<32:03,  3.28it/s]
 98%|█████████▊| 365163/371472 [6:53:43<31:02,  3.39it/s]
 98%|█████████▊| 365164/371472 [6:53:43<30:00,  3.50it/s]
 98%|█████████▊| 365165/371472 [6:53:44<28:34,  3.68it/s]
 98%|█████████▊| 365166/371472 [6:53:44<29:01,  3.62it/s]
 98%|█████████▊| 365167/371472 [6:53:44<28:24,  3.70it/s]
 98%|█████████▊| 365168/371472 [6:53:45<29:15,  3.59it/s]
 98%|█████████▊| 365169/371472 [6:53:45<31:00,  3.39it/s]
 98%|█████████▊| 365170/371472 [6:53:45<29:17,  3.59it/s]
 98%|█████████▊| 365171/371472 [6:53:45<29:44,  3.53it/s]
 98%|█████████▊| 365172/371472 [6:53:46<29:10,  3.60it/s]
 98%|█████████▊| 365173/371472 [6:53:46<29:00,  3.62it/s]
 98%|█████████▊| 365174/371472 [6:53:46<29:15,  3.59it/s]
 98%|█████████▊| 365175/371472 [6:53:46<28:35,  3.67it/s]
 98%|█████████▊| 365176/371472 [6:53:47<27:58,  3.75it/s]
 98%|█████████▊| 365177/371472 [6:53:47<27:51,  3.77it/s]
 98%|█████████▊| 365178/371472 [6:53:47<28:37,  3.66it/s]
 98%|█████████▊| 365179/371472 [6:53:48<29:55,  3.51it/s]
 98%|█████████▊| 365180/371472 [6:53:48<30:30,  3.44it/s]
                                                         
{'loss': 2.5158, 'learning_rate': 1.1525242948566013e-07, 'epoch': 15.73}

 98%|█████████▊| 365180/371472 [6:53:48<30:30,  3.44it/s]
 98%|█████████▊| 365181/371472 [6:53:48<30:52,  3.40it/s]
 98%|█████████▊| 365182/371472 [6:53:49<31:34,  3.32it/s]
 98%|█████████▊| 365183/371472 [6:53:49<32:36,  3.21it/s]
 98%|█████████▊| 365184/371472 [6:53:49<30:46,  3.41it/s]
 98%|█████████▊| 365185/371472 [6:53:49<32:24,  3.23it/s]
 98%|█████████▊| 365186/371472 [6:53:50<31:05,  3.37it/s]
 98%|█████████▊| 365187/371472 [6:53:50<31:28,  3.33it/s]
 98%|█████████▊| 365188/371472 [6:53:50<31:27,  3.33it/s]
 98%|█████████▊| 365189/371472 [6:53:51<31:15,  3.35it/s]
 98%|█████████▊| 365190/371472 [6:53:51<30:41,  3.41it/s]
 98%|█████████▊| 365191/371472 [6:53:51<31:36,  3.31it/s]
 98%|█████████▊| 365192/371472 [6:53:52<31:53,  3.28it/s]
 98%|█████████▊| 365193/371472 [6:53:52<30:03,  3.48it/s]
 98%|█████████▊| 365194/371472 [6:53:52<29:30,  3.55it/s]
 98%|█████████▊| 365195/371472 [6:53:52<28:28,  3.67it/s]
 98%|█████████▊| 365196/371472 [6:53:53<29:01,  3.60it/s]
 98%|█████████▊| 365197/371472 [6:53:53<29:09,  3.59it/s]
 98%|█████████▊| 365198/371472 [6:53:53<29:15,  3.57it/s]
 98%|█████████▊| 365199/371472 [6:53:53<30:36,  3.42it/s]
 98%|█████████▊| 365200/371472 [6:53:54<29:54,  3.50it/s]
                                                         
{'loss': 2.5828, 'learning_rate': 1.1520394751018119e-07, 'epoch': 15.73}

 98%|█████████▊| 365200/371472 [6:53:54<29:54,  3.50it/s]
 98%|█████████▊| 365201/371472 [6:53:54<29:25,  3.55it/s]
 98%|█████████▊| 365202/371472 [6:53:54<29:15,  3.57it/s]
 98%|█████████▊| 365203/371472 [6:53:55<28:21,  3.68it/s]
 98%|█████████▊| 365204/371472 [6:53:55<32:02,  3.26it/s]
 98%|█████████▊| 365205/371472 [6:53:55<32:37,  3.20it/s]
 98%|█████████▊| 365206/371472 [6:53:56<30:54,  3.38it/s]
 98%|█████████▊| 365207/371472 [6:53:56<30:29,  3.42it/s]
 98%|█████████▊| 365208/371472 [6:53:56<29:33,  3.53it/s]
 98%|█████████▊| 365209/371472 [6:53:56<29:11,  3.58it/s]
 98%|█████████▊| 365210/371472 [6:53:57<29:09,  3.58it/s]
 98%|█████████▊| 365211/371472 [6:53:57<29:00,  3.60it/s]
 98%|█████████▊| 365212/371472 [6:53:57<30:41,  3.40it/s]
 98%|█████████▊| 365213/371472 [6:53:58<30:14,  3.45it/s]
 98%|█████████▊| 365214/371472 [6:53:58<32:00,  3.26it/s]
 98%|█████████▊| 365215/371472 [6:53:58<32:12,  3.24it/s]
 98%|█████████▊| 365216/371472 [6:53:58<30:42,  3.40it/s]
 98%|█████████▊| 365217/371472 [6:53:59<29:25,  3.54it/s]
 98%|█████████▊| 365218/371472 [6:53:59<28:17,  3.68it/s]
 98%|█████████▊| 365219/371472 [6:53:59<30:28,  3.42it/s]
 98%|█████████▊| 365220/371472 [6:54:00<30:45,  3.39it/s]
                                                         
{'loss': 2.6135, 'learning_rate': 1.1515546553470235e-07, 'epoch': 15.73}

 98%|█████████▊| 365220/371472 [6:54:00<30:45,  3.39it/s]
 98%|█████████▊| 365221/371472 [6:54:00<30:32,  3.41it/s]
 98%|█████████▊| 365222/371472 [6:54:00<29:16,  3.56it/s]
 98%|█████████▊| 365223/371472 [6:54:00<29:07,  3.58it/s]
 98%|█████████▊| 365224/371472 [6:54:01<30:38,  3.40it/s]
 98%|█████████▊| 365225/371472 [6:54:01<30:38,  3.40it/s]
 98%|█████████▊| 365226/371472 [6:54:01<30:26,  3.42it/s]
 98%|█████████▊| 365227/371472 [6:54:02<30:11,  3.45it/s]
 98%|█████████▊| 365228/371472 [6:54:02<28:41,  3.63it/s]
 98%|█████████▊| 365229/371472 [6:54:02<28:45,  3.62it/s]
 98%|█████████▊| 365230/371472 [6:54:02<29:59,  3.47it/s]
 98%|█████████▊| 365231/371472 [6:54:03<29:11,  3.56it/s]
 98%|█████████▊| 365232/371472 [6:54:03<29:00,  3.59it/s]
 98%|█████████▊| 365233/371472 [6:54:03<29:32,  3.52it/s]
 98%|█████████▊| 365234/371472 [6:54:04<29:14,  3.56it/s]
 98%|█████████▊| 365235/371472 [6:54:04<30:51,  3.37it/s]
 98%|█████████▊| 365236/371472 [6:54:04<29:24,  3.53it/s]
 98%|█████████▊| 365237/371472 [6:54:04<28:42,  3.62it/s]
 98%|█████████▊| 365238/371472 [6:54:05<28:10,  3.69it/s]
 98%|█████████▊| 365239/371472 [6:54:05<27:59,  3.71it/s]
 98%|█████████▊| 365240/371472 [6:54:05<29:05,  3.57it/s]
                                                         
{'loss': 2.6731, 'learning_rate': 1.151069835592234e-07, 'epoch': 15.73}

 98%|█████████▊| 365240/371472 [6:54:05<29:05,  3.57it/s]
 98%|█████████▊| 365241/371472 [6:54:05<28:00,  3.71it/s]
 98%|█████████▊| 365242/371472 [6:54:06<27:23,  3.79it/s]
 98%|█████████▊| 365243/371472 [6:54:06<26:35,  3.91it/s]
 98%|█████████▊| 365244/371472 [6:54:06<27:44,  3.74it/s]
 98%|█████████▊| 365245/371472 [6:54:06<27:14,  3.81it/s]
 98%|█████████▊| 365246/371472 [6:54:07<27:33,  3.76it/s]
 98%|█████████▊| 365247/371472 [6:54:07<29:41,  3.49it/s]
 98%|█████████▊| 365248/371472 [6:54:07<29:05,  3.57it/s]
 98%|█████████▊| 365249/371472 [6:54:08<29:33,  3.51it/s]
 98%|█████████▊| 365250/371472 [6:54:08<30:08,  3.44it/s]
 98%|█████████▊| 365251/371472 [6:54:08<29:22,  3.53it/s]
 98%|█████████▊| 365252/371472 [6:54:08<28:18,  3.66it/s]
 98%|█████████▊| 365253/371472 [6:54:09<28:27,  3.64it/s]
 98%|█████████▊| 365254/371472 [6:54:09<29:17,  3.54it/s]
 98%|█████████▊| 365255/371472 [6:54:09<28:51,  3.59it/s]
 98%|█████████▊| 365256/371472 [6:54:10<29:55,  3.46it/s]
 98%|█████████▊| 365257/371472 [6:54:10<29:38,  3.49it/s]
 98%|█████████▊| 365258/371472 [6:54:10<28:37,  3.62it/s]
 98%|█████████▊| 365259/371472 [6:54:10<29:05,  3.56it/s]
 98%|█████████▊| 365260/371472 [6:54:11<28:49,  3.59it/s]
                                                         
{'loss': 2.5777, 'learning_rate': 1.1505850158374456e-07, 'epoch': 15.73}

 98%|█████████▊| 365260/371472 [6:54:11<28:49,  3.59it/s]
 98%|█████████▊| 365261/371472 [6:54:11<28:24,  3.64it/s]
 98%|█████████▊| 365262/371472 [6:54:11<27:41,  3.74it/s]
 98%|█████████▊| 365263/371472 [6:54:12<27:47,  3.72it/s]
 98%|█████████▊| 365264/371472 [6:54:12<29:01,  3.57it/s]
 98%|█████████▊| 365265/371472 [6:54:12<28:35,  3.62it/s]
 98%|█████████▊| 365266/371472 [6:54:12<27:26,  3.77it/s]
 98%|█████████▊| 365267/371472 [6:54:13<29:11,  3.54it/s]
 98%|█████████▊| 365268/371472 [6:54:13<28:23,  3.64it/s]
 98%|█████████▊| 365269/371472 [6:54:13<28:32,  3.62it/s]
 98%|█████████▊| 365270/371472 [6:54:13<28:58,  3.57it/s]
 98%|█████████▊| 365271/371472 [6:54:14<28:25,  3.64it/s]
 98%|█████████▊| 365272/371472 [6:54:14<28:18,  3.65it/s]
 98%|█████████▊| 365273/371472 [6:54:14<28:03,  3.68it/s]
 98%|█████████▊| 365274/371472 [6:54:15<28:08,  3.67it/s]
 98%|█████████▊| 365275/371472 [6:54:15<28:25,  3.63it/s]
 98%|█████████▊| 365276/371472 [6:54:15<28:10,  3.66it/s]
 98%|█████████▊| 365277/371472 [6:54:15<27:52,  3.70it/s]
 98%|█████████▊| 365278/371472 [6:54:16<27:21,  3.77it/s]
 98%|█████████▊| 365279/371472 [6:54:16<31:07,  3.32it/s]
 98%|█████████▊| 365280/371472 [6:54:16<30:35,  3.37it/s]
                                                         
{'loss': 2.5594, 'learning_rate': 1.1501001960826562e-07, 'epoch': 15.73}

 98%|█████████▊| 365280/371472 [6:54:16<30:35,  3.37it/s]
 98%|█████████▊| 365281/371472 [6:54:17<30:46,  3.35it/s]
 98%|█████████▊| 365282/371472 [6:54:17<28:51,  3.57it/s]
 98%|█████████▊| 365283/371472 [6:54:17<27:37,  3.73it/s]
 98%|█████████▊| 365284/371472 [6:54:17<27:02,  3.81it/s]
 98%|█████████▊| 365285/371472 [6:54:18<26:33,  3.88it/s]
 98%|█████████▊| 365286/371472 [6:54:18<27:42,  3.72it/s]
 98%|█████████▊| 365287/371472 [6:54:18<27:53,  3.70it/s]
 98%|█████████▊| 365288/371472 [6:54:18<28:44,  3.59it/s]
 98%|█████████▊| 365289/371472 [6:54:19<27:57,  3.69it/s]
 98%|█████████▊| 365290/371472 [6:54:19<27:23,  3.76it/s]
 98%|█████████▊| 365291/371472 [6:54:19<29:34,  3.48it/s]
 98%|█████████▊| 365292/371472 [6:54:20<29:34,  3.48it/s]
 98%|█████████▊| 365293/371472 [6:54:20<30:09,  3.41it/s]
 98%|█████████▊| 365294/371472 [6:54:20<28:14,  3.65it/s]
 98%|█████████▊| 365295/371472 [6:54:20<28:24,  3.62it/s]
 98%|█████████▊| 365296/371472 [6:54:21<28:07,  3.66it/s]
 98%|█████████▊| 365297/371472 [6:54:21<27:13,  3.78it/s]
 98%|█████████▊| 365298/371472 [6:54:21<27:27,  3.75it/s]
 98%|█████████▊| 365299/371472 [6:54:21<27:10,  3.79it/s]
 98%|█████████▊| 365300/371472 [6:54:22<28:28,  3.61it/s]
                                                         
{'loss': 2.6255, 'learning_rate': 1.1496153763278676e-07, 'epoch': 15.73}

 98%|█████████▊| 365300/371472 [6:54:22<28:28,  3.61it/s]
 98%|█████████▊| 365301/371472 [6:54:22<27:33,  3.73it/s]
 98%|█████████▊| 365302/371472 [6:54:22<27:40,  3.72it/s]
 98%|█████████▊| 365303/371472 [6:54:23<27:23,  3.75it/s]
 98%|█████████▊| 365304/371472 [6:54:23<30:06,  3.42it/s]
 98%|█████████▊| 365305/371472 [6:54:23<28:37,  3.59it/s]
 98%|█████████▊| 365306/371472 [6:54:23<30:58,  3.32it/s]
 98%|█████████▊| 365307/371472 [6:54:24<29:11,  3.52it/s]
 98%|█████████▊| 365308/371472 [6:54:24<28:11,  3.64it/s]
 98%|█████████▊| 365309/371472 [6:54:24<29:01,  3.54it/s]
 98%|█████████▊| 365310/371472 [6:54:25<28:22,  3.62it/s]
 98%|█████████▊| 365311/371472 [6:54:25<28:54,  3.55it/s]
 98%|█████████▊| 365312/371472 [6:54:25<28:29,  3.60it/s]
 98%|█████████▊| 365313/371472 [6:54:25<28:52,  3.55it/s]
 98%|█████████▊| 365314/371472 [6:54:26<29:13,  3.51it/s]
 98%|█████████▊| 365315/371472 [6:54:26<28:28,  3.60it/s]
 98%|█████████▊| 365316/371472 [6:54:26<29:10,  3.52it/s]
 98%|█████████▊| 365317/371472 [6:54:27<29:03,  3.53it/s]
 98%|█████████▊| 365318/371472 [6:54:27<28:40,  3.58it/s]
 98%|█████████▊| 365319/371472 [6:54:27<27:57,  3.67it/s]
 98%|█████████▊| 365320/371472 [6:54:27<28:34,  3.59it/s]
                                                         
{'loss': 2.5444, 'learning_rate': 1.1491305565730783e-07, 'epoch': 15.74}

 98%|█████████▊| 365320/371472 [6:54:27<28:34,  3.59it/s]
 98%|█████████▊| 365321/371472 [6:54:28<31:00,  3.31it/s]
 98%|█████████▊| 365322/371472 [6:54:28<30:20,  3.38it/s]
 98%|█████████▊| 365323/371472 [6:54:28<29:34,  3.47it/s]
 98%|█████████▊| 365324/371472 [6:54:29<28:54,  3.54it/s]
 98%|█████████▊| 365325/371472 [6:54:29<28:57,  3.54it/s]
 98%|█████████▊| 365326/371472 [6:54:29<29:02,  3.53it/s]
 98%|█████████▊| 365327/371472 [6:54:29<29:42,  3.45it/s]
 98%|█████████▊| 365328/371472 [6:54:30<31:18,  3.27it/s]
 98%|█████████▊| 365329/371472 [6:54:30<29:32,  3.47it/s]
 98%|█████████▊| 365330/371472 [6:54:30<28:54,  3.54it/s]
 98%|█████████▊| 365331/371472 [6:54:31<28:46,  3.56it/s]
 98%|█████████▊| 365332/371472 [6:54:31<28:27,  3.60it/s]
 98%|█████████▊| 365333/371472 [6:54:31<28:30,  3.59it/s]
 98%|█████████▊| 365334/371472 [6:54:31<27:56,  3.66it/s]
 98%|█████████▊| 365335/371472 [6:54:32<27:17,  3.75it/s]
 98%|█████████▊| 365336/371472 [6:54:32<27:24,  3.73it/s]
 98%|█████████▊| 365337/371472 [6:54:32<26:58,  3.79it/s]
 98%|█████████▊| 365338/371472 [6:54:32<26:39,  3.84it/s]
 98%|█████████▊| 365339/371472 [6:54:33<31:04,  3.29it/s]
 98%|█████████▊| 365340/371472 [6:54:33<30:39,  3.33it/s]
                                                         
{'loss': 2.4617, 'learning_rate': 1.14864573681829e-07, 'epoch': 15.74}

 98%|█████████▊| 365340/371472 [6:54:33<30:39,  3.33it/s]
 98%|█████████▊| 365341/371472 [6:54:33<29:27,  3.47it/s]
 98%|█████████▊| 365342/371472 [6:54:34<28:31,  3.58it/s]
 98%|█████████▊| 365343/371472 [6:54:34<27:54,  3.66it/s]
 98%|█████████▊| 365344/371472 [6:54:34<27:21,  3.73it/s]
 98%|█████████▊| 365345/371472 [6:54:34<27:30,  3.71it/s]
 98%|█████████▊| 365346/371472 [6:54:35<28:31,  3.58it/s]
 98%|█████████▊| 365347/371472 [6:54:35<27:34,  3.70it/s]
 98%|█████████▊| 365348/371472 [6:54:35<28:11,  3.62it/s]
 98%|█████████▊| 365349/371472 [6:54:35<27:21,  3.73it/s]
 98%|█████████▊| 365350/371472 [6:54:36<27:44,  3.68it/s]
 98%|█████████▊| 365351/371472 [6:54:36<28:26,  3.59it/s]
 98%|█████████▊| 365352/371472 [6:54:36<29:24,  3.47it/s]
 98%|█████████▊| 365353/371472 [6:54:37<31:16,  3.26it/s]
 98%|█████████▊| 365354/371472 [6:54:37<29:42,  3.43it/s]
 98%|█████████▊| 365355/371472 [6:54:37<28:33,  3.57it/s]
 98%|█████████▊| 365356/371472 [6:54:37<27:49,  3.66it/s]
 98%|█████████▊| 365357/371472 [6:54:38<27:42,  3.68it/s]
 98%|█████████▊| 365358/371472 [6:54:38<27:36,  3.69it/s]
 98%|█████████▊| 365359/371472 [6:54:38<30:30,  3.34it/s]
 98%|█████████▊| 365360/371472 [6:54:39<28:42,  3.55it/s]
                                                         
{'loss': 2.6617, 'learning_rate': 1.1481609170635005e-07, 'epoch': 15.74}

 98%|█████████▊| 365360/371472 [6:54:39<28:42,  3.55it/s]
 98%|█████████▊| 365361/371472 [6:54:39<29:34,  3.44it/s]
 98%|█████████▊| 365362/371472 [6:54:39<28:20,  3.59it/s]
 98%|█████████▊| 365363/371472 [6:54:39<27:44,  3.67it/s]
 98%|█████████▊| 365364/371472 [6:54:40<27:28,  3.71it/s]
 98%|█████████▊| 365365/371472 [6:54:40<27:37,  3.68it/s]
 98%|█████████▊| 365366/371472 [6:54:40<28:39,  3.55it/s]
 98%|█████████▊| 365367/371472 [6:54:41<27:23,  3.71it/s]
 98%|█████████▊| 365368/371472 [6:54:41<26:40,  3.81it/s]
 98%|█████████▊| 365369/371472 [6:54:41<26:13,  3.88it/s]
 98%|█████████▊| 365370/371472 [6:54:41<26:04,  3.90it/s]
 98%|█████████▊| 365371/371472 [6:54:42<28:31,  3.57it/s]
 98%|█████████▊| 365372/371472 [6:54:42<28:56,  3.51it/s]
 98%|█████████▊| 365373/371472 [6:54:42<29:17,  3.47it/s]
 98%|█████████▊| 365374/371472 [6:54:42<28:13,  3.60it/s]
 98%|█████████▊| 365375/371472 [6:54:43<28:00,  3.63it/s]
 98%|█████████▊| 365376/371472 [6:54:43<27:09,  3.74it/s]
 98%|█████████▊| 365377/371472 [6:54:43<27:25,  3.70it/s]
 98%|█████████▊| 365378/371472 [6:54:44<27:37,  3.68it/s]
 98%|█████████▊| 365379/371472 [6:54:44<27:47,  3.65it/s]
 98%|█████████▊| 365380/371472 [6:54:44<27:07,  3.74it/s]
                                                         
{'loss': 2.5663, 'learning_rate': 1.147676097308712e-07, 'epoch': 15.74}

 98%|█████████▊| 365380/371472 [6:54:44<27:07,  3.74it/s]
 98%|█████████▊| 365381/371472 [6:54:44<26:34,  3.82it/s]
 98%|█████████▊| 365382/371472 [6:54:45<27:18,  3.72it/s]
 98%|█████████▊| 365383/371472 [6:54:45<29:21,  3.46it/s]
 98%|█████████▊| 365384/371472 [6:54:45<28:03,  3.62it/s]
 98%|█████████▊| 365385/371472 [6:54:45<28:23,  3.57it/s]
 98%|█████████▊| 365386/371472 [6:54:46<27:33,  3.68it/s]
 98%|█████████▊| 365387/371472 [6:54:46<27:56,  3.63it/s]
 98%|█████████▊| 365388/371472 [6:54:46<30:49,  3.29it/s]
 98%|█████████▊| 365389/371472 [6:54:47<30:02,  3.38it/s]
 98%|█████████▊| 365390/371472 [6:54:47<29:30,  3.44it/s]
 98%|█████████▊| 365391/371472 [6:54:47<28:36,  3.54it/s]
 98%|█████████▊| 365392/371472 [6:54:47<27:30,  3.68it/s]
 98%|█████████▊| 365393/371472 [6:54:48<26:51,  3.77it/s]
 98%|█████████▊| 365394/371472 [6:54:48<26:52,  3.77it/s]
 98%|█████████▊| 365395/371472 [6:54:48<26:44,  3.79it/s]
 98%|█████████▊| 365396/371472 [6:54:48<26:49,  3.78it/s]
 98%|█████████▊| 365397/371472 [6:54:49<28:29,  3.55it/s]
 98%|█████████▊| 365398/371472 [6:54:49<29:41,  3.41it/s]
 98%|█████████▊| 365399/371472 [6:54:50<35:10,  2.88it/s]
 98%|█████████▊| 365400/371472 [6:54:50<35:42,  2.83it/s]
                                                         
{'loss': 2.527, 'learning_rate': 1.1471912775539226e-07, 'epoch': 15.74}

 98%|█████████▊| 365400/371472 [6:54:50<35:42,  2.83it/s]
 98%|█████████▊| 365401/371472 [6:54:50<33:02,  3.06it/s]
 98%|█████████▊| 365402/371472 [6:54:50<30:47,  3.29it/s]
 98%|█████████▊| 365403/371472 [6:54:51<29:15,  3.46it/s]
 98%|█████████▊| 365404/371472 [6:54:51<28:40,  3.53it/s]
 98%|█████████▊| 365405/371472 [6:54:51<27:35,  3.66it/s]
 98%|█████████▊| 365406/371472 [6:54:52<27:48,  3.64it/s]
 98%|█████████▊| 365407/371472 [6:54:52<27:46,  3.64it/s]
 98%|█████████▊| 365408/371472 [6:54:52<29:17,  3.45it/s]
 98%|█████████▊| 365409/371472 [6:54:52<31:23,  3.22it/s]
 98%|█████████▊| 365410/371472 [6:54:53<28:58,  3.49it/s]
 98%|█████████▊| 365411/371472 [6:54:53<28:20,  3.56it/s]
 98%|█████████▊| 365412/371472 [6:54:53<26:42,  3.78it/s]
 98%|█████████▊| 365413/371472 [6:54:54<28:54,  3.49it/s]
 98%|█████████▊| 365414/371472 [6:54:54<27:17,  3.70it/s]
 98%|█████████▊| 365415/371472 [6:54:54<28:00,  3.60it/s]
 98%|█████████▊| 365416/371472 [6:54:54<30:57,  3.26it/s]
 98%|█████████▊| 365417/371472 [6:54:55<29:38,  3.40it/s]
 98%|█████████▊| 365418/371472 [6:54:55<30:10,  3.34it/s]
 98%|█████████▊| 365419/371472 [6:54:55<28:54,  3.49it/s]
 98%|█████████▊| 365420/371472 [6:54:56<27:35,  3.66it/s]
                                                         
{'loss': 2.7046, 'learning_rate': 1.1467064577991343e-07, 'epoch': 15.74}

 98%|█████████▊| 365420/371472 [6:54:56<27:35,  3.66it/s]
 98%|█████████▊| 365421/371472 [6:54:56<28:43,  3.51it/s]
 98%|█████████▊| 365422/371472 [6:54:56<29:33,  3.41it/s]
 98%|█████████▊| 365423/371472 [6:54:56<29:26,  3.42it/s]
 98%|█████████▊| 365424/371472 [6:54:57<28:44,  3.51it/s]
 98%|█████████▊| 365425/371472 [6:54:57<29:38,  3.40it/s]
 98%|█████████▊| 365426/371472 [6:54:57<29:33,  3.41it/s]
 98%|█████████▊| 365427/371472 [6:54:58<29:46,  3.38it/s]
 98%|█████████▊| 365428/371472 [6:54:58<28:03,  3.59it/s]
 98%|█████████▊| 365429/371472 [6:54:58<27:56,  3.60it/s]
 98%|█████████▊| 365430/371472 [6:54:58<26:42,  3.77it/s]
 98%|█████████▊| 365431/371472 [6:54:59<26:36,  3.78it/s]
 98%|█████████▊| 365432/371472 [6:54:59<26:52,  3.75it/s]
 98%|█████████▊| 365433/371472 [6:54:59<26:23,  3.81it/s]
 98%|█████████▊| 365434/371472 [6:54:59<28:09,  3.57it/s]
 98%|█████████▊| 365435/371472 [6:55:00<28:04,  3.58it/s]
 98%|█████████▊| 365436/371472 [6:55:00<28:02,  3.59it/s]
 98%|█████████▊| 365437/371472 [6:55:00<28:59,  3.47it/s]
 98%|█████████▊| 365438/371472 [6:55:01<30:02,  3.35it/s]
 98%|█████████▊| 365439/371472 [6:55:01<29:31,  3.41it/s]
 98%|█████████▊| 365440/371472 [6:55:01<29:53,  3.36it/s]
                                                         
{'loss': 2.535, 'learning_rate': 1.1462216380443448e-07, 'epoch': 15.74}

 98%|█████████▊| 365440/371472 [6:55:01<29:53,  3.36it/s]
 98%|█████████▊| 365441/371472 [6:55:02<30:37,  3.28it/s]
 98%|█████████▊| 365442/371472 [6:55:02<31:08,  3.23it/s]
 98%|█████████▊| 365443/371472 [6:55:02<29:32,  3.40it/s]
 98%|█████████▊| 365444/371472 [6:55:02<29:32,  3.40it/s]
 98%|█████████▊| 365445/371472 [6:55:03<29:12,  3.44it/s]
 98%|█████████▊| 365446/371472 [6:55:03<27:56,  3.59it/s]
 98%|█████████▊| 365447/371472 [6:55:03<29:14,  3.43it/s]
 98%|█████████▊| 365448/371472 [6:55:04<29:43,  3.38it/s]
 98%|█████████▊| 365449/371472 [6:55:04<33:03,  3.04it/s]
 98%|█████████▊| 365450/371472 [6:55:04<30:34,  3.28it/s]
 98%|█████████▊| 365451/371472 [6:55:04<28:34,  3.51it/s]
 98%|█████████▊| 365452/371472 [6:55:05<27:36,  3.63it/s]
 98%|█████████▊| 365453/371472 [6:55:05<28:51,  3.48it/s]
 98%|█████████▊| 365454/371472 [6:55:05<29:17,  3.42it/s]
 98%|█████████▊| 365455/371472 [6:55:06<28:08,  3.56it/s]
 98%|█████████▊| 365456/371472 [6:55:06<27:53,  3.59it/s]
 98%|█████████▊| 365457/371472 [6:55:06<28:53,  3.47it/s]
 98%|█████████▊| 365458/371472 [6:55:06<27:58,  3.58it/s]
 98%|█████████▊| 365459/371472 [6:55:07<28:23,  3.53it/s]
 98%|█████████▊| 365460/371472 [6:55:07<28:56,  3.46it/s]
                                                         
{'loss': 2.5005, 'learning_rate': 1.1457368182895554e-07, 'epoch': 15.74}

 98%|█████████▊| 365460/371472 [6:55:07<28:56,  3.46it/s]
 98%|█████████▊| 365461/371472 [6:55:07<28:51,  3.47it/s]
 98%|█████████▊| 365462/371472 [6:55:08<28:04,  3.57it/s]
 98%|█████████▊| 365463/371472 [6:55:08<27:00,  3.71it/s]
 98%|█████████▊| 365464/371472 [6:55:08<26:59,  3.71it/s]
 98%|█████████▊| 365465/371472 [6:55:08<26:34,  3.77it/s]
 98%|█████████▊| 365466/371472 [6:55:09<25:40,  3.90it/s]
 98%|█████████▊| 365467/371472 [6:55:09<25:25,  3.94it/s]
 98%|█████████▊| 365468/371472 [6:55:09<25:34,  3.91it/s]
 98%|█████████▊| 365469/371472 [6:55:10<30:08,  3.32it/s]
 98%|█████████▊| 365470/371472 [6:55:10<28:39,  3.49it/s]
 98%|█████████▊| 365471/371472 [6:55:10<27:38,  3.62it/s]
 98%|█████████▊| 365472/371472 [6:55:10<30:24,  3.29it/s]
 98%|█████████▊| 365473/371472 [6:55:11<28:58,  3.45it/s]
 98%|█████████▊| 365474/371472 [6:55:11<29:19,  3.41it/s]
 98%|█████████▊| 365475/371472 [6:55:11<28:15,  3.54it/s]
 98%|█████████▊| 365476/371472 [6:55:12<29:09,  3.43it/s]
 98%|█████████▊| 365477/371472 [6:55:12<30:24,  3.29it/s]
 98%|█████████▊| 365478/371472 [6:55:12<30:16,  3.30it/s]
 98%|█████████▊| 365479/371472 [6:55:12<28:59,  3.45it/s]
 98%|█████████▊| 365480/371472 [6:55:13<29:28,  3.39it/s]
                                                         
{'loss': 2.4425, 'learning_rate': 1.1452519985347669e-07, 'epoch': 15.74}

 98%|█████████▊| 365480/371472 [6:55:13<29:28,  3.39it/s]
 98%|█████████▊| 365481/371472 [6:55:13<28:05,  3.55it/s]
 98%|█████████▊| 365482/371472 [6:55:13<26:52,  3.72it/s]
 98%|█████████▊| 365483/371472 [6:55:14<27:34,  3.62it/s]
 98%|█████████▊| 365484/371472 [6:55:14<27:41,  3.60it/s]
 98%|█████████▊| 365485/371472 [6:55:14<26:44,  3.73it/s]
 98%|█████████▊| 365486/371472 [6:55:14<27:00,  3.69it/s]
 98%|█████████▊| 365487/371472 [6:55:15<30:13,  3.30it/s]
 98%|█████████▊| 365488/371472 [6:55:15<28:58,  3.44it/s]
 98%|█████████▊| 365489/371472 [6:55:15<28:20,  3.52it/s]
 98%|█████████▊| 365490/371472 [6:55:15<27:29,  3.63it/s]
 98%|█████████▊| 365491/371472 [6:55:16<28:00,  3.56it/s]
 98%|█████████▊| 365492/371472 [6:55:16<29:45,  3.35it/s]
 98%|█████████▊| 365493/371472 [6:55:16<28:35,  3.48it/s]
 98%|█████████▊| 365494/371472 [6:55:17<28:39,  3.48it/s]
 98%|█████████▊| 365495/371472 [6:55:17<26:59,  3.69it/s]
 98%|█████████▊| 365496/371472 [6:55:17<26:59,  3.69it/s]
 98%|█████████▊| 365497/371472 [6:55:17<25:58,  3.83it/s]
 98%|█████████▊| 365498/371472 [6:55:18<26:19,  3.78it/s]
 98%|█████████▊| 365499/371472 [6:55:18<26:15,  3.79it/s]
 98%|█████████▊| 365500/371472 [6:55:18<27:09,  3.66it/s]
                                                         
{'loss': 2.5398, 'learning_rate': 1.1447671787799774e-07, 'epoch': 15.74}

 98%|█████████▊| 365500/371472 [6:55:18<27:09,  3.66it/s]
 98%|█████████▊| 365501/371472 [6:55:18<27:01,  3.68it/s]
 98%|█████████▊| 365502/371472 [6:55:19<26:05,  3.81it/s]
 98%|█████████▊| 365503/371472 [6:55:19<25:45,  3.86it/s]
 98%|█████████▊| 365504/371472 [6:55:19<28:30,  3.49it/s]
 98%|█████████▊| 365505/371472 [6:55:20<27:37,  3.60it/s]
 98%|█████████▊| 365506/371472 [6:55:20<27:21,  3.63it/s]
 98%|█████████▊| 365507/371472 [6:55:20<30:09,  3.30it/s]
 98%|█████████▊| 365508/371472 [6:55:21<32:26,  3.06it/s]
 98%|█████████▊| 365509/371472 [6:55:21<31:08,  3.19it/s]
 98%|█████████▊| 365510/371472 [6:55:21<30:05,  3.30it/s]
 98%|█████████▊| 365511/371472 [6:55:21<28:43,  3.46it/s]
 98%|█████████▊| 365512/371472 [6:55:22<29:00,  3.42it/s]
 98%|█████████▊| 365513/371472 [6:55:22<27:57,  3.55it/s]
 98%|█████████▊| 365514/371472 [6:55:22<27:17,  3.64it/s]
 98%|█████████▊| 365515/371472 [6:55:23<27:27,  3.62it/s]
 98%|█████████▊| 365516/371472 [6:55:23<27:38,  3.59it/s]
 98%|█████████▊| 365517/371472 [6:55:23<26:51,  3.69it/s]
 98%|█████████▊| 365518/371472 [6:55:23<27:19,  3.63it/s]
 98%|█████████▊| 365519/371472 [6:55:24<28:44,  3.45it/s]
 98%|█████████▊| 365520/371472 [6:55:24<27:44,  3.58it/s]
                                                         
{'loss': 2.5763, 'learning_rate': 1.1442823590251892e-07, 'epoch': 15.74}

 98%|█████████▊| 365520/371472 [6:55:24<27:44,  3.58it/s]
 98%|█████████▊| 365521/371472 [6:55:24<26:47,  3.70it/s]
 98%|█████████▊| 365522/371472 [6:55:24<26:34,  3.73it/s]
 98%|█████████▊| 365523/371472 [6:55:25<25:49,  3.84it/s]
 98%|█████████▊| 365524/371472 [6:55:25<25:49,  3.84it/s]
 98%|█████████▊| 365525/371472 [6:55:25<26:17,  3.77it/s]
 98%|█████████▊| 365526/371472 [6:55:25<25:59,  3.81it/s]
 98%|█████████▊| 365527/371472 [6:55:26<30:00,  3.30it/s]
 98%|█████████▊| 365528/371472 [6:55:26<31:28,  3.15it/s]
 98%|█████████▊| 365529/371472 [6:55:27<31:36,  3.13it/s]
 98%|█████████▊| 365530/371472 [6:55:27<29:24,  3.37it/s]
 98%|█████████▊| 365531/371472 [6:55:27<28:27,  3.48it/s]
 98%|█████████▊| 365532/371472 [6:55:27<27:32,  3.59it/s]
 98%|█████████▊| 365533/371472 [6:55:28<27:35,  3.59it/s]
 98%|█████████▊| 365534/371472 [6:55:28<27:10,  3.64it/s]
 98%|█████████▊| 365535/371472 [6:55:28<27:30,  3.60it/s]
 98%|█████████▊| 365536/371472 [6:55:28<26:43,  3.70it/s]
 98%|█████████▊| 365537/371472 [6:55:29<26:34,  3.72it/s]
 98%|█████████▊| 365538/371472 [6:55:29<26:00,  3.80it/s]
 98%|█████████▊| 365539/371472 [6:55:29<26:23,  3.75it/s]
 98%|█████████▊| 365540/371472 [6:55:29<25:43,  3.84it/s]
                                                         
{'loss': 2.4945, 'learning_rate': 1.1437975392703997e-07, 'epoch': 15.74}

 98%|█████████▊| 365540/371472 [6:55:29<25:43,  3.84it/s]
 98%|█████████▊| 365541/371472 [6:55:30<26:45,  3.69it/s]
 98%|█████████▊| 365542/371472 [6:55:30<27:03,  3.65it/s]
 98%|█████████▊| 365543/371472 [6:55:30<27:34,  3.58it/s]
 98%|█████████▊| 365544/371472 [6:55:31<28:30,  3.46it/s]
 98%|█████████▊| 365545/371472 [6:55:31<27:13,  3.63it/s]
 98%|█████████▊| 365546/371472 [6:55:31<26:41,  3.70it/s]
 98%|█████████▊| 365547/371472 [6:55:31<27:51,  3.54it/s]
 98%|█████████▊| 365548/371472 [6:55:32<29:37,  3.33it/s]
 98%|█████████▊| 365549/371472 [6:55:32<30:23,  3.25it/s]
 98%|█████████▊| 365550/371472 [6:55:32<28:29,  3.46it/s]
 98%|█████████▊| 365551/371472 [6:55:33<28:45,  3.43it/s]
 98%|█████████▊| 365552/371472 [6:55:33<29:19,  3.37it/s]
 98%|█████████▊| 365553/371472 [6:55:33<29:59,  3.29it/s]
 98%|█████████▊| 365554/371472 [6:55:34<29:04,  3.39it/s]
 98%|█████████▊| 365555/371472 [6:55:34<28:37,  3.45it/s]
 98%|█████████▊| 365556/371472 [6:55:34<28:01,  3.52it/s]
 98%|█████████▊| 365557/371472 [6:55:34<28:02,  3.51it/s]
 98%|█████████▊| 365558/371472 [6:55:35<27:48,  3.54it/s]
 98%|█████████▊| 365559/371472 [6:55:35<30:14,  3.26it/s]
 98%|█████████▊| 365560/371472 [6:55:35<30:05,  3.27it/s]
                                                         
{'loss': 2.5516, 'learning_rate': 1.1433127195156112e-07, 'epoch': 15.75}

 98%|█████████▊| 365560/371472 [6:55:35<30:05,  3.27it/s]
 98%|█████████▊| 365561/371472 [6:55:36<30:00,  3.28it/s]
 98%|█████████▊| 365562/371472 [6:55:36<28:36,  3.44it/s]
 98%|█████████▊| 365563/371472 [6:55:36<27:57,  3.52it/s]
 98%|█████████▊| 365564/371472 [6:55:36<27:45,  3.55it/s]
 98%|█████████▊| 365565/371472 [6:55:37<29:04,  3.39it/s]
 98%|█████████▊| 365566/371472 [6:55:37<29:14,  3.37it/s]
 98%|█████████▊| 365567/371472 [6:55:37<27:35,  3.57it/s]
 98%|█████████▊| 365568/371472 [6:55:38<26:50,  3.67it/s]
 98%|█████████▊| 365569/371472 [6:55:38<27:22,  3.59it/s]
 98%|█████████▊| 365570/371472 [6:55:38<27:01,  3.64it/s]
 98%|█████████▊| 365571/371472 [6:55:38<27:53,  3.53it/s]
 98%|█████████▊| 365572/371472 [6:55:39<27:52,  3.53it/s]
 98%|█████████▊| 365573/371472 [6:55:39<27:34,  3.57it/s]
 98%|█████████▊| 365574/371472 [6:55:39<28:24,  3.46it/s]
 98%|█████████▊| 365575/371472 [6:55:40<27:31,  3.57it/s]
 98%|█████████▊| 365576/371472 [6:55:40<26:41,  3.68it/s]
 98%|█████████▊| 365577/371472 [6:55:40<28:43,  3.42it/s]
 98%|█████████▊| 365578/371472 [6:55:40<27:18,  3.60it/s]
 98%|█████████▊| 365579/371472 [6:55:41<29:12,  3.36it/s]
 98%|█████████▊| 365580/371472 [6:55:41<28:03,  3.50it/s]
                                                         
{'loss': 2.5732, 'learning_rate': 1.1428278997608218e-07, 'epoch': 15.75}

 98%|█████████▊| 365580/371472 [6:55:41<28:03,  3.50it/s]
 98%|█████████▊| 365581/371472 [6:55:41<26:46,  3.67it/s]
 98%|█████████▊| 365582/371472 [6:55:41<25:47,  3.81it/s]
 98%|█████████▊| 365583/371472 [6:55:42<26:26,  3.71it/s]
 98%|█████████▊| 365584/371472 [6:55:42<26:59,  3.63it/s]
 98%|█████████▊| 365585/371472 [6:55:42<26:41,  3.67it/s]
 98%|█████████▊| 365586/371472 [6:55:43<27:30,  3.57it/s]
 98%|█████████▊| 365587/371472 [6:55:43<27:50,  3.52it/s]
 98%|█████████▊| 365588/371472 [6:55:43<29:18,  3.35it/s]
 98%|█████████▊| 365589/371472 [6:55:43<28:23,  3.45it/s]
 98%|█████████▊| 365590/371472 [6:55:44<28:09,  3.48it/s]
 98%|█████████▊| 365591/371472 [6:55:44<27:10,  3.61it/s]
 98%|█████████▊| 365592/371472 [6:55:44<26:35,  3.69it/s]
 98%|█████████▊| 365593/371472 [6:55:45<26:27,  3.70it/s]
 98%|█████████▊| 365594/371472 [6:55:45<26:11,  3.74it/s]
 98%|█████████▊| 365595/371472 [6:55:45<27:37,  3.54it/s]
 98%|█████████▊| 365596/371472 [6:55:45<28:16,  3.46it/s]
 98%|█████████▊| 365597/371472 [6:55:46<27:52,  3.51it/s]
 98%|█████████▊| 365598/371472 [6:55:46<27:10,  3.60it/s]
 98%|█████████▊| 365599/371472 [6:55:46<27:51,  3.51it/s]
 98%|█████████▊| 365600/371472 [6:55:47<26:44,  3.66it/s]
                                                         
{'loss': 2.6329, 'learning_rate': 1.1423430800060335e-07, 'epoch': 15.75}

 98%|█████████▊| 365600/371472 [6:55:47<26:44,  3.66it/s]
 98%|█████████▊| 365601/371472 [6:55:47<26:27,  3.70it/s]
 98%|█████████▊| 365602/371472 [6:55:47<26:36,  3.68it/s]
 98%|█████████▊| 365603/371472 [6:55:47<28:13,  3.47it/s]
 98%|█████████▊| 365604/371472 [6:55:48<29:48,  3.28it/s]
 98%|█████████▊| 365605/371472 [6:55:48<29:09,  3.35it/s]
 98%|█████████▊| 365606/371472 [6:55:48<27:56,  3.50it/s]
 98%|█████████▊| 365607/371472 [6:55:49<27:35,  3.54it/s]
 98%|█████████▊| 365608/371472 [6:55:49<27:20,  3.57it/s]
 98%|█████████▊| 365609/371472 [6:55:49<28:20,  3.45it/s]
 98%|█████████▊| 365610/371472 [6:55:49<27:01,  3.61it/s]
 98%|█████████▊| 365611/371472 [6:55:50<27:41,  3.53it/s]
 98%|█████████▊| 365612/371472 [6:55:50<27:30,  3.55it/s]
 98%|█████████▊| 365613/371472 [6:55:50<26:55,  3.63it/s]
 98%|█████████▊| 365614/371472 [6:55:50<26:45,  3.65it/s]
 98%|█████████▊| 365615/371472 [6:55:51<28:23,  3.44it/s]
 98%|█████████▊| 365616/371472 [6:55:51<26:55,  3.63it/s]
 98%|█████████▊| 365617/371472 [6:55:51<27:04,  3.60it/s]
 98%|█████████▊| 365618/371472 [6:55:52<25:58,  3.76it/s]
 98%|█████████▊| 365619/371472 [6:55:52<25:22,  3.84it/s]
 98%|█████████▊| 365620/371472 [6:55:52<25:04,  3.89it/s]
                                                         
{'loss': 2.6287, 'learning_rate': 1.1418582602512439e-07, 'epoch': 15.75}

 98%|█████████▊| 365620/371472 [6:55:52<25:04,  3.89it/s]
 98%|█████████▊| 365621/371472 [6:55:52<25:47,  3.78it/s]
 98%|█████████▊| 365622/371472 [6:55:53<25:07,  3.88it/s]
 98%|█████████▊| 365623/371472 [6:55:53<25:54,  3.76it/s]
 98%|█████████▊| 365624/371472 [6:55:53<26:35,  3.66it/s]
 98%|█████████▊| 365625/371472 [6:55:53<27:41,  3.52it/s]
 98%|█████████▊| 365626/371472 [6:55:54<27:10,  3.59it/s]
 98%|█████████▊| 365627/371472 [6:55:54<27:23,  3.56it/s]
 98%|█████████▊| 365628/371472 [6:55:54<27:01,  3.60it/s]
 98%|█████████▊| 365629/371472 [6:55:55<27:32,  3.54it/s]
 98%|█████████▊| 365630/371472 [6:55:55<27:16,  3.57it/s]
 98%|█████████▊| 365631/371472 [6:55:55<27:16,  3.57it/s]
 98%|█████████▊| 365632/371472 [6:55:55<27:22,  3.56it/s]
 98%|█████████▊| 365633/371472 [6:55:56<26:27,  3.68it/s]
 98%|█████████▊| 365634/371472 [6:55:56<26:01,  3.74it/s]
 98%|█████████▊| 365635/371472 [6:55:56<27:25,  3.55it/s]
 98%|█████████▊| 365636/371472 [6:55:56<26:14,  3.71it/s]
 98%|█████████▊| 365637/371472 [6:55:57<26:11,  3.71it/s]
 98%|█████████▊| 365638/371472 [6:55:57<25:52,  3.76it/s]
 98%|█████████▊| 365639/371472 [6:55:57<27:39,  3.51it/s]
 98%|█████████▊| 365640/371472 [6:55:58<30:02,  3.24it/s]
                                                         
{'loss': 2.4966, 'learning_rate': 1.1413734404964556e-07, 'epoch': 15.75}

 98%|█████████▊| 365640/371472 [6:55:58<30:02,  3.24it/s]
 98%|█████████▊| 365641/371472 [6:55:58<30:09,  3.22it/s]
 98%|█████████▊| 365642/371472 [6:55:58<28:20,  3.43it/s]
 98%|█████████▊| 365643/371472 [6:55:59<27:02,  3.59it/s]
 98%|█████████▊| 365644/371472 [6:55:59<28:42,  3.38it/s]
 98%|█████████▊| 365645/371472 [6:55:59<28:29,  3.41it/s]
 98%|█████████▊| 365646/371472 [6:55:59<28:25,  3.42it/s]
 98%|█████████▊| 365647/371472 [6:56:00<28:04,  3.46it/s]
 98%|█████████▊| 365648/371472 [6:56:00<28:33,  3.40it/s]
 98%|█████████▊| 365649/371472 [6:56:00<28:55,  3.36it/s]
 98%|█████████▊| 365650/371472 [6:56:01<28:18,  3.43it/s]
 98%|█████████▊| 365651/371472 [6:56:01<27:15,  3.56it/s]
 98%|█████████▊| 365652/371472 [6:56:01<26:22,  3.68it/s]
 98%|█████████▊| 365653/371472 [6:56:01<25:27,  3.81it/s]
 98%|█████████▊| 365654/371472 [6:56:02<26:16,  3.69it/s]
 98%|█████████▊| 365655/371472 [6:56:02<28:56,  3.35it/s]
 98%|█████████▊| 365656/371472 [6:56:02<28:20,  3.42it/s]
 98%|█████████▊| 365657/371472 [6:56:03<27:53,  3.47it/s]
 98%|█████████▊| 365658/371472 [6:56:03<28:28,  3.40it/s]
 98%|█████████▊| 365659/371472 [6:56:03<27:35,  3.51it/s]
 98%|█████████▊| 365660/371472 [6:56:03<28:07,  3.44it/s]
                                                         
{'loss': 2.7287, 'learning_rate': 1.1408886207416661e-07, 'epoch': 15.75}

 98%|█████████▊| 365660/371472 [6:56:03<28:07,  3.44it/s]
 98%|█████████▊| 365661/371472 [6:56:04<28:51,  3.36it/s]
 98%|█████████▊| 365662/371472 [6:56:04<28:31,  3.39it/s]
 98%|█████████▊| 365663/371472 [6:56:04<26:44,  3.62it/s]
 98%|█████████▊| 365664/371472 [6:56:05<26:53,  3.60it/s]
 98%|█████████▊| 365665/371472 [6:56:05<26:55,  3.60it/s]
 98%|█████████▊| 365666/371472 [6:56:05<26:43,  3.62it/s]
 98%|█████████▊| 365667/371472 [6:56:05<26:16,  3.68it/s]
 98%|█████████▊| 365668/371472 [6:56:06<27:46,  3.48it/s]
 98%|█████████▊| 365669/371472 [6:56:06<27:45,  3.49it/s]
 98%|█████████▊| 365670/371472 [6:56:06<27:50,  3.47it/s]
 98%|█████████▊| 365671/371472 [6:56:07<27:53,  3.47it/s]
 98%|█████████▊| 365672/371472 [6:56:07<26:54,  3.59it/s]
 98%|█████████▊| 365673/371472 [6:56:07<26:25,  3.66it/s]
 98%|█████████▊| 365674/371472 [6:56:07<25:26,  3.80it/s]
 98%|█████████▊| 365675/371472 [6:56:08<26:45,  3.61it/s]
 98%|█████████▊| 365676/371472 [6:56:08<25:56,  3.72it/s]
 98%|█████████▊| 365677/371472 [6:56:08<25:41,  3.76it/s]
 98%|█████████▊| 365678/371472 [6:56:08<28:36,  3.38it/s]
 98%|█████████▊| 365679/371472 [6:56:09<28:00,  3.45it/s]
 98%|█████████▊| 365680/371472 [6:56:09<27:29,  3.51it/s]
                                                         
{'loss': 2.565, 'learning_rate': 1.1404038009868778e-07, 'epoch': 15.75}

 98%|█████████▊| 365680/371472 [6:56:09<27:29,  3.51it/s]
 98%|█████████▊| 365681/371472 [6:56:09<27:07,  3.56it/s]
 98%|█████████▊| 365682/371472 [6:56:10<26:08,  3.69it/s]
 98%|█████████▊| 365683/371472 [6:56:10<28:20,  3.40it/s]
 98%|█████████▊| 365684/371472 [6:56:10<27:46,  3.47it/s]
 98%|█████████▊| 365685/371472 [6:56:11<31:17,  3.08it/s]
 98%|█████████▊| 365686/371472 [6:56:11<29:55,  3.22it/s]
 98%|█████████▊| 365687/371472 [6:56:11<28:37,  3.37it/s]
 98%|█████████▊| 365688/371472 [6:56:11<29:44,  3.24it/s]
 98%|█████████▊| 365689/371472 [6:56:12<30:08,  3.20it/s]
 98%|█████████▊| 365690/371472 [6:56:12<27:54,  3.45it/s]
 98%|█████████▊| 365691/371472 [6:56:12<28:46,  3.35it/s]
 98%|█████████▊| 365692/371472 [6:56:13<28:05,  3.43it/s]
 98%|█████████▊| 365693/371472 [6:56:13<27:21,  3.52it/s]
 98%|█████████▊| 365694/371472 [6:56:13<26:41,  3.61it/s]
 98%|█████████▊| 365695/371472 [6:56:13<27:32,  3.50it/s]
 98%|█████████▊| 365696/371472 [6:56:14<26:19,  3.66it/s]
 98%|█████████▊| 365697/371472 [6:56:14<26:38,  3.61it/s]
 98%|█████████▊| 365698/371472 [6:56:14<26:56,  3.57it/s]
 98%|█████████▊| 365699/371472 [6:56:15<26:09,  3.68it/s]
 98%|█████████▊| 365700/371472 [6:56:15<27:09,  3.54it/s]
                                                         
{'loss': 2.6777, 'learning_rate': 1.1399189812320884e-07, 'epoch': 15.75}

 98%|█████████▊| 365700/371472 [6:56:15<27:09,  3.54it/s]
 98%|█████████▊| 365701/371472 [6:56:15<26:33,  3.62it/s]
 98%|█████████▊| 365702/371472 [6:56:15<27:24,  3.51it/s]
 98%|█████████▊| 365703/371472 [6:56:16<27:16,  3.52it/s]
 98%|█████████▊| 365704/371472 [6:56:16<27:57,  3.44it/s]
 98%|█████████▊| 365705/371472 [6:56:16<27:26,  3.50it/s]
 98%|█████████▊| 365706/371472 [6:56:17<26:57,  3.56it/s]
 98%|█████████▊| 365707/371472 [6:56:17<27:23,  3.51it/s]
 98%|█████████▊| 365708/371472 [6:56:17<27:58,  3.43it/s]
 98%|█████████▊| 365709/371472 [6:56:17<28:08,  3.41it/s]
 98%|█████████▊| 365710/371472 [6:56:18<27:20,  3.51it/s]
 98%|█████████▊| 365711/371472 [6:56:18<26:26,  3.63it/s]
 98%|█████████▊| 365712/371472 [6:56:18<26:44,  3.59it/s]
 98%|█████████▊| 365713/371472 [6:56:19<26:32,  3.62it/s]
 98%|█████████▊| 365714/371472 [6:56:19<26:35,  3.61it/s]
 98%|█████████▊| 365715/371472 [6:56:19<26:35,  3.61it/s]
 98%|█████████▊| 365716/371472 [6:56:19<26:12,  3.66it/s]
 98%|█████████▊| 365717/371472 [6:56:20<27:17,  3.52it/s]
 98%|█████████▊| 365718/371472 [6:56:20<26:12,  3.66it/s]
 98%|█████████▊| 365719/371472 [6:56:20<26:00,  3.69it/s]
 98%|█████████▊| 365720/371472 [6:56:20<25:42,  3.73it/s]
                                                         
{'loss': 2.6527, 'learning_rate': 1.1394341614772999e-07, 'epoch': 15.75}

 98%|█████████▊| 365720/371472 [6:56:20<25:42,  3.73it/s]
 98%|█████████▊| 365721/371472 [6:56:21<27:33,  3.48it/s]
 98%|█████████▊| 365722/371472 [6:56:21<26:14,  3.65it/s]
 98%|█████████▊| 365723/371472 [6:56:21<26:06,  3.67it/s]
 98%|█████████▊| 365724/371472 [6:56:22<26:49,  3.57it/s]
 98%|█████████▊| 365725/371472 [6:56:22<28:35,  3.35it/s]
 98%|█████████▊| 365726/371472 [6:56:22<27:12,  3.52it/s]
 98%|█████████▊| 365727/371472 [6:56:22<27:30,  3.48it/s]
 98%|█████████▊| 365728/371472 [6:56:23<28:09,  3.40it/s]
 98%|█████████▊| 365729/371472 [6:56:23<27:48,  3.44it/s]
 98%|█████████▊| 365730/371472 [6:56:23<27:26,  3.49it/s]
 98%|█████████▊| 365731/371472 [6:56:24<26:04,  3.67it/s]
 98%|█████████▊| 365732/371472 [6:56:24<25:28,  3.76it/s]
 98%|█████████▊| 365733/371472 [6:56:24<26:25,  3.62it/s]
 98%|█████████▊| 365734/371472 [6:56:24<27:28,  3.48it/s]
 98%|█████████▊| 365735/371472 [6:56:25<27:32,  3.47it/s]
 98%|█████████▊| 365736/371472 [6:56:25<27:22,  3.49it/s]
 98%|█████████▊| 365737/371472 [6:56:25<26:29,  3.61it/s]
 98%|█████████▊| 365738/371472 [6:56:26<26:09,  3.65it/s]
 98%|█████████▊| 365739/371472 [6:56:26<25:35,  3.73it/s]
 98%|█████████▊| 365740/371472 [6:56:26<25:59,  3.68it/s]
                                                         
{'loss': 2.6014, 'learning_rate': 1.1389493417225105e-07, 'epoch': 15.75}

 98%|█████████▊| 365740/371472 [6:56:26<25:59,  3.68it/s]
 98%|█████████▊| 365741/371472 [6:56:26<25:55,  3.68it/s]
 98%|█████████▊| 365742/371472 [6:56:27<25:29,  3.75it/s]
 98%|█████████▊| 365743/371472 [6:56:27<25:40,  3.72it/s]
 98%|█████████▊| 365744/371472 [6:56:27<25:03,  3.81it/s]
 98%|█████████▊| 365745/371472 [6:56:27<25:23,  3.76it/s]
 98%|█████████▊| 365746/371472 [6:56:28<25:15,  3.78it/s]
 98%|█████████▊| 365747/371472 [6:56:28<25:38,  3.72it/s]
 98%|█████████▊| 365748/371472 [6:56:28<26:41,  3.57it/s]
 98%|█████████▊| 365749/371472 [6:56:29<26:58,  3.54it/s]
 98%|█████████▊| 365750/371472 [6:56:29<26:29,  3.60it/s]
 98%|█████████▊| 365751/371472 [6:56:29<27:17,  3.49it/s]
 98%|█████████▊| 365752/371472 [6:56:29<27:20,  3.49it/s]
 98%|█████████▊| 365753/371472 [6:56:30<27:30,  3.47it/s]
 98%|█████████▊| 365754/371472 [6:56:30<26:01,  3.66it/s]
 98%|█████████▊| 365755/371472 [6:56:30<26:21,  3.61it/s]
 98%|█████████▊| 365756/371472 [6:56:30<27:36,  3.45it/s]
 98%|█████████▊| 365757/371472 [6:56:31<27:59,  3.40it/s]
 98%|█████████▊| 365758/371472 [6:56:31<27:33,  3.46it/s]
 98%|█████████▊| 365759/371472 [6:56:31<27:42,  3.44it/s]
 98%|█████████▊| 365760/371472 [6:56:32<26:33,  3.58it/s]
                                                         
{'loss': 2.5452, 'learning_rate': 1.138464521967722e-07, 'epoch': 15.75}

 98%|█████████▊| 365760/371472 [6:56:32<26:33,  3.58it/s]
 98%|█████████▊| 365761/371472 [6:56:32<26:07,  3.64it/s]
 98%|█████████▊| 365762/371472 [6:56:32<27:12,  3.50it/s]
 98%|█████████▊| 365763/371472 [6:56:32<26:48,  3.55it/s]
 98%|█████████▊| 365764/371472 [6:56:33<27:05,  3.51it/s]
 98%|█████████▊| 365765/371472 [6:56:33<26:03,  3.65it/s]
 98%|█████████▊| 365766/371472 [6:56:33<27:25,  3.47it/s]
 98%|█████████▊| 365767/371472 [6:56:34<26:43,  3.56it/s]
 98%|█████████▊| 365768/371472 [6:56:34<26:03,  3.65it/s]
 98%|█████████▊| 365769/371472 [6:56:34<25:38,  3.71it/s]
 98%|█████████▊| 365770/371472 [6:56:34<25:30,  3.73it/s]
 98%|█████████▊| 365771/371472 [6:56:35<26:29,  3.59it/s]
 98%|█████████▊| 365772/371472 [6:56:35<25:25,  3.74it/s]
 98%|█████████▊| 365773/371472 [6:56:35<26:18,  3.61it/s]
 98%|█████████▊| 365774/371472 [6:56:35<25:04,  3.79it/s]
 98%|█████████▊| 365775/371472 [6:56:36<24:27,  3.88it/s]
 98%|█████████▊| 365776/371472 [6:56:36<25:33,  3.71it/s]
 98%|█████████▊| 365777/371472 [6:56:36<28:47,  3.30it/s]
 98%|█████████▊| 365778/371472 [6:56:37<27:57,  3.39it/s]
 98%|█████████▊| 365779/371472 [6:56:37<29:46,  3.19it/s]
 98%|█████████▊| 365780/371472 [6:56:37<28:11,  3.37it/s]
                                                         
{'loss': 2.581, 'learning_rate': 1.1379797022129325e-07, 'epoch': 15.75}

 98%|█████████▊| 365780/371472 [6:56:37<28:11,  3.37it/s]
 98%|█████████▊| 365781/371472 [6:56:38<26:45,  3.54it/s]
 98%|█████████▊| 365782/371472 [6:56:38<26:01,  3.64it/s]
 98%|█████████▊| 365783/371472 [6:56:38<25:06,  3.78it/s]
 98%|█████████▊| 365784/371472 [6:56:38<25:12,  3.76it/s]
 98%|█████████▊| 365785/371472 [6:56:39<26:31,  3.57it/s]
 98%|█████████▊| 365786/371472 [6:56:39<25:51,  3.66it/s]
 98%|█████████▊| 365787/371472 [6:56:39<25:33,  3.71it/s]
 98%|█████████▊| 365788/371472 [6:56:39<26:00,  3.64it/s]
 98%|█████████▊| 365789/371472 [6:56:40<26:08,  3.62it/s]
 98%|█████████▊| 365790/371472 [6:56:40<27:25,  3.45it/s]
 98%|█████████▊| 365791/371472 [6:56:40<26:31,  3.57it/s]
 98%|█████████▊| 365792/371472 [6:56:41<26:50,  3.53it/s]
 98%|█████████▊| 365793/371472 [6:56:41<26:00,  3.64it/s]
 98%|█████████▊| 365794/371472 [6:56:41<29:57,  3.16it/s]
 98%|█████████▊| 365795/371472 [6:56:42<29:39,  3.19it/s]
 98%|█████████▊| 365796/371472 [6:56:42<33:59,  2.78it/s]
 98%|█████████▊| 365797/371472 [6:56:42<32:44,  2.89it/s]
 98%|█████████▊| 365798/371472 [6:56:43<29:58,  3.16it/s]
 98%|█████████▊| 365799/371472 [6:56:43<27:24,  3.45it/s]
 98%|█████████▊| 365800/371472 [6:56:43<26:28,  3.57it/s]
                                                         
{'loss': 2.6662, 'learning_rate': 1.1374948824581442e-07, 'epoch': 15.76}

 98%|█████████▊| 365800/371472 [6:56:43<26:28,  3.57it/s]
 98%|█████████▊| 365801/371472 [6:56:43<26:07,  3.62it/s]
 98%|█████████▊| 365802/371472 [6:56:44<27:33,  3.43it/s]
 98%|█████████▊| 365803/371472 [6:56:44<27:21,  3.45it/s]
 98%|█████████▊| 365804/371472 [6:56:44<26:39,  3.54it/s]
 98%|█████████▊| 365805/371472 [6:56:44<26:18,  3.59it/s]
 98%|█████████▊| 365806/371472 [6:56:45<25:46,  3.66it/s]
 98%|█████████▊| 365807/371472 [6:56:45<26:34,  3.55it/s]
 98%|█████████▊| 365808/371472 [6:56:45<25:31,  3.70it/s]
 98%|█████████▊| 365809/371472 [6:56:46<25:41,  3.67it/s]
 98%|█████████▊| 365810/371472 [6:56:46<24:46,  3.81it/s]
 98%|█████████▊| 365811/371472 [6:56:46<25:50,  3.65it/s]
 98%|█████████▊| 365812/371472 [6:56:46<26:05,  3.62it/s]
 98%|█████████▊| 365813/371472 [6:56:47<25:27,  3.70it/s]
 98%|█████████▊| 365814/371472 [6:56:47<24:54,  3.79it/s]
 98%|█████████▊| 365815/371472 [6:56:47<26:55,  3.50it/s]
 98%|█████████▊| 365816/371472 [6:56:48<27:59,  3.37it/s]
 98%|█████████▊| 365817/371472 [6:56:48<27:37,  3.41it/s]
 98%|█████████▊| 365818/371472 [6:56:48<26:31,  3.55it/s]
 98%|█████████▊| 365819/371472 [6:56:48<26:35,  3.54it/s]
 98%|█████████▊| 365820/371472 [6:56:49<27:39,  3.40it/s]
                                                         
{'loss': 2.5288, 'learning_rate': 1.1370100627033548e-07, 'epoch': 15.76}

 98%|█████████▊| 365820/371472 [6:56:49<27:39,  3.40it/s]
 98%|█████████▊| 365821/371472 [6:56:49<28:19,  3.32it/s]
 98%|█████████▊| 365822/371472 [6:56:49<27:30,  3.42it/s]
 98%|█████████▊| 365823/371472 [6:56:50<26:35,  3.54it/s]
 98%|█████████▊| 365824/371472 [6:56:50<27:15,  3.45it/s]
 98%|█████████▊| 365825/371472 [6:56:50<29:16,  3.22it/s]
 98%|█████████▊| 365826/371472 [6:56:50<28:24,  3.31it/s]
 98%|█████████▊| 365827/371472 [6:56:51<27:59,  3.36it/s]
 98%|█████████▊| 365828/371472 [6:56:51<28:05,  3.35it/s]
 98%|█████████▊| 365829/371472 [6:56:51<26:44,  3.52it/s]
 98%|█████████▊| 365830/371472 [6:56:52<25:46,  3.65it/s]
 98%|█████████▊| 365831/371472 [6:56:52<27:26,  3.43it/s]
 98%|█████████▊| 365832/371472 [6:56:52<26:44,  3.51it/s]
 98%|█████████▊| 365833/371472 [6:56:52<26:36,  3.53it/s]
 98%|█████████▊| 365834/371472 [6:56:53<25:31,  3.68it/s]
 98%|█████████▊| 365835/371472 [6:56:53<24:45,  3.79it/s]
 98%|█████████▊| 365836/371472 [6:56:53<24:35,  3.82it/s]
 98%|█████████▊| 365837/371472 [6:56:53<24:54,  3.77it/s]
 98%|█████████▊| 365838/371472 [6:56:54<24:31,  3.83it/s]
 98%|█████████▊| 365839/371472 [6:56:54<24:14,  3.87it/s]
 98%|█████████▊| 365840/371472 [6:56:54<24:12,  3.88it/s]
                                                         
{'loss': 2.6536, 'learning_rate': 1.1365252429485663e-07, 'epoch': 15.76}

 98%|█████████▊| 365840/371472 [6:56:54<24:12,  3.88it/s]
 98%|█████████▊| 365841/371472 [6:56:54<24:25,  3.84it/s]
 98%|█████████▊| 365842/371472 [6:56:55<24:26,  3.84it/s]
 98%|█████████▊| 365843/371472 [6:56:55<24:24,  3.84it/s]
 98%|█████████▊| 365844/371472 [6:56:55<24:36,  3.81it/s]
 98%|█████████▊| 365845/371472 [6:56:56<25:40,  3.65it/s]
 98%|█████████▊| 365846/371472 [6:56:56<24:34,  3.82it/s]
 98%|█████████▊| 365847/371472 [6:56:56<26:28,  3.54it/s]
 98%|█████████▊| 365848/371472 [6:56:56<25:44,  3.64it/s]
 98%|█████████▊| 365849/371472 [6:56:57<25:12,  3.72it/s]
 98%|█████████▊| 365850/371472 [6:56:57<25:57,  3.61it/s]
 98%|█████████▊| 365851/371472 [6:56:57<25:57,  3.61it/s]
 98%|█████████▊| 365852/371472 [6:56:57<25:40,  3.65it/s]
 98%|█████████▊| 365853/371472 [6:56:58<26:02,  3.60it/s]
 98%|█████████▊| 365854/371472 [6:56:58<28:51,  3.25it/s]
 98%|█████████▊| 365855/371472 [6:56:58<27:40,  3.38it/s]
 98%|█████████▊| 365856/371472 [6:56:59<28:16,  3.31it/s]
 98%|█████████▊| 365857/371472 [6:56:59<27:27,  3.41it/s]
 98%|█████████▊| 365858/371472 [6:56:59<28:39,  3.26it/s]
 98%|█████████▊| 365859/371472 [6:57:00<26:57,  3.47it/s]
 98%|█████████▊| 365860/371472 [6:57:00<26:06,  3.58it/s]
                                                         
{'loss': 2.7102, 'learning_rate': 1.1360404231937769e-07, 'epoch': 15.76}

 98%|█████████▊| 365860/371472 [6:57:00<26:06,  3.58it/s]
 98%|█████████▊| 365861/371472 [6:57:00<25:31,  3.66it/s]
 98%|█████████▊| 365862/371472 [6:57:00<26:01,  3.59it/s]
 98%|█████████▊| 365863/371472 [6:57:01<26:02,  3.59it/s]
 98%|█████████▊| 365864/371472 [6:57:01<25:15,  3.70it/s]
 98%|█████████▊| 365865/371472 [6:57:01<25:28,  3.67it/s]
 98%|█████████▊| 365866/371472 [6:57:02<26:32,  3.52it/s]
 98%|█████████▊| 365867/371472 [6:57:02<27:25,  3.41it/s]
 98%|█████████▊| 365868/371472 [6:57:02<28:37,  3.26it/s]
 98%|█████████▊| 365869/371472 [6:57:03<29:08,  3.20it/s]
 98%|█████████▊| 365870/371472 [6:57:03<28:21,  3.29it/s]
 98%|█████████▊| 365871/371472 [6:57:03<32:02,  2.91it/s]
 98%|█████████▊| 365872/371472 [6:57:03<30:02,  3.11it/s]
 98%|█████████▊| 365873/371472 [6:57:04<31:13,  2.99it/s]
 98%|█████████▊| 365874/371472 [6:57:04<28:50,  3.23it/s]
 98%|█████████▊| 365875/371472 [6:57:04<27:38,  3.38it/s]
 98%|█████████▊| 365876/371472 [6:57:05<27:16,  3.42it/s]
 98%|█████████▊| 365877/371472 [6:57:05<26:22,  3.54it/s]
 98%|█████████▊| 365878/371472 [6:57:05<28:05,  3.32it/s]
 98%|█████████▊| 365879/371472 [6:57:06<27:25,  3.40it/s]
 98%|█████████▊| 365880/371472 [6:57:06<26:10,  3.56it/s]
                                                         
{'loss': 2.5644, 'learning_rate': 1.1355556034389885e-07, 'epoch': 15.76}

 98%|█████████▊| 365880/371472 [6:57:06<26:10,  3.56it/s]
 98%|█████████▊| 365881/371472 [6:57:06<26:07,  3.57it/s]
 98%|█████████▊| 365882/371472 [6:57:06<25:52,  3.60it/s]
 98%|█████████▊| 365883/371472 [6:57:07<24:51,  3.75it/s]
 98%|█████████▊| 365884/371472 [6:57:07<25:31,  3.65it/s]
 98%|█████████▊| 365885/371472 [6:57:07<24:27,  3.81it/s]
 98%|█████████▊| 365886/371472 [6:57:07<24:02,  3.87it/s]
 98%|█████████▊| 365887/371472 [6:57:08<24:00,  3.88it/s]
 98%|█████████▊| 365888/371472 [6:57:08<23:59,  3.88it/s]
 98%|█████████▊| 365889/371472 [6:57:08<26:11,  3.55it/s]
 98%|█████████▊| 365890/371472 [6:57:08<25:20,  3.67it/s]
 98%|█████████▊| 365891/371472 [6:57:09<24:41,  3.77it/s]
 98%|█████████▊| 365892/371472 [6:57:09<25:12,  3.69it/s]
 98%|█████████▊| 365893/371472 [6:57:09<24:32,  3.79it/s]
 98%|█████████▊| 365894/371472 [6:57:09<24:12,  3.84it/s]
 98%|█████████▊| 365895/371472 [6:57:10<24:30,  3.79it/s]
 98%|█████████▊| 365896/371472 [6:57:10<24:39,  3.77it/s]
 98%|█████████▊| 365897/371472 [6:57:10<26:52,  3.46it/s]
 98%|█████████▊| 365898/371472 [6:57:11<27:03,  3.43it/s]
 98%|█████████▊| 365899/371472 [6:57:11<29:28,  3.15it/s]
 99%|█████████▊| 365900/371472 [6:57:11<27:53,  3.33it/s]
                                                         
{'loss': 2.6228, 'learning_rate': 1.1350707836841991e-07, 'epoch': 15.76}

 99%|█████████▊| 365900/371472 [6:57:11<27:53,  3.33it/s]
 99%|█████████▊| 365901/371472 [6:57:12<28:50,  3.22it/s]
 99%|█████████▊| 365902/371472 [6:57:12<26:57,  3.44it/s]
 99%|█████████▊| 365903/371472 [6:57:12<28:06,  3.30it/s]
 99%|█████████▊| 365904/371472 [6:57:12<26:53,  3.45it/s]
 99%|█████████▊| 365905/371472 [6:57:13<26:30,  3.50it/s]
 99%|█████████▊| 365906/371472 [6:57:13<25:51,  3.59it/s]
 99%|█████████▊| 365907/371472 [6:57:13<26:26,  3.51it/s]
 99%|█████████▊| 365908/371472 [6:57:14<26:33,  3.49it/s]
 99%|█████████▊| 365909/371472 [6:57:14<25:09,  3.69it/s]
 99%|█████████▊| 365910/371472 [6:57:14<25:00,  3.71it/s]
 99%|█████████▊| 365911/371472 [6:57:14<24:34,  3.77it/s]
 99%|█████████▊| 365912/371472 [6:57:15<24:47,  3.74it/s]
 99%|█████████▊| 365913/371472 [6:57:15<24:26,  3.79it/s]
 99%|█████████▊| 365914/371472 [6:57:15<24:52,  3.72it/s]
 99%|█████████▊| 365915/371472 [6:57:15<24:27,  3.79it/s]
 99%|█████████▊| 365916/371472 [6:57:16<24:42,  3.75it/s]
 99%|█████████▊| 365917/371472 [6:57:16<24:40,  3.75it/s]
 99%|█████████▊| 365918/371472 [6:57:16<25:08,  3.68it/s]
 99%|█████████▊| 365919/371472 [6:57:16<24:32,  3.77it/s]
 99%|█████████▊| 365920/371472 [6:57:17<24:09,  3.83it/s]
                                                         
{'loss': 2.6566, 'learning_rate': 1.1345859639294106e-07, 'epoch': 15.76}

 99%|█████████▊| 365920/371472 [6:57:17<24:09,  3.83it/s]
 99%|█████████▊| 365921/371472 [6:57:17<24:03,  3.85it/s]
 99%|█████████▊| 365922/371472 [6:57:17<24:32,  3.77it/s]
 99%|█████████▊| 365923/371472 [6:57:18<25:12,  3.67it/s]
 99%|█████████▊| 365924/371472 [6:57:18<24:55,  3.71it/s]
 99%|█████████▊| 365925/371472 [6:57:18<26:11,  3.53it/s]
 99%|█████████▊| 365926/371472 [6:57:18<26:47,  3.45it/s]
 99%|█████████▊| 365927/371472 [6:57:19<26:03,  3.55it/s]
 99%|█████████▊| 365928/371472 [6:57:19<26:28,  3.49it/s]
 99%|█████████▊| 365929/371472 [6:57:19<26:27,  3.49it/s]
 99%|█████████▊| 365930/371472 [6:57:20<26:01,  3.55it/s]
 99%|█████████▊| 365931/371472 [6:57:20<25:45,  3.58it/s]
 99%|█████████▊| 365932/371472 [6:57:20<25:47,  3.58it/s]
 99%|█████████▊| 365933/371472 [6:57:20<26:04,  3.54it/s]
 99%|█████████▊| 365934/371472 [6:57:21<25:57,  3.55it/s]
 99%|█████████▊| 365935/371472 [6:57:21<26:16,  3.51it/s]
 99%|█████████▊| 365936/371472 [6:57:21<27:06,  3.40it/s]
 99%|█████████▊| 365937/371472 [6:57:22<26:57,  3.42it/s]
 99%|█████████▊| 365938/371472 [6:57:22<27:07,  3.40it/s]
 99%|█████████▊| 365939/371472 [6:57:22<25:37,  3.60it/s]
 99%|█████████▊| 365940/371472 [6:57:23<29:42,  3.10it/s]
                                                         
{'loss': 2.5764, 'learning_rate': 1.1341011441746212e-07, 'epoch': 15.76}

 99%|█████████▊| 365940/371472 [6:57:23<29:42,  3.10it/s]
 99%|█████████▊| 365941/371472 [6:57:23<27:37,  3.34it/s]
 99%|█████████▊| 365942/371472 [6:57:23<26:31,  3.48it/s]
 99%|█████████▊| 365943/371472 [6:57:23<25:39,  3.59it/s]
 99%|█████████▊| 365944/371472 [6:57:24<24:53,  3.70it/s]
 99%|█████████▊| 365945/371472 [6:57:24<28:12,  3.27it/s]
 99%|█████████▊| 365946/371472 [6:57:24<26:51,  3.43it/s]
 99%|█████████▊| 365947/371472 [6:57:24<25:47,  3.57it/s]
 99%|█████████▊| 365948/371472 [6:57:25<26:12,  3.51it/s]
 99%|█████████▊| 365949/371472 [6:57:25<25:10,  3.66it/s]
 99%|█████████▊| 365950/371472 [6:57:25<24:07,  3.81it/s]
 99%|█████████▊| 365951/371472 [6:57:26<23:57,  3.84it/s]
 99%|█████████▊| 365952/371472 [6:57:26<25:33,  3.60it/s]
 99%|█████████▊| 365953/371472 [6:57:26<26:49,  3.43it/s]
 99%|█████████▊| 365954/371472 [6:57:26<26:10,  3.51it/s]
 99%|█████████▊| 365955/371472 [6:57:27<25:11,  3.65it/s]
 99%|█████████▊| 365956/371472 [6:57:27<25:19,  3.63it/s]
 99%|█████████▊| 365957/371472 [6:57:27<24:27,  3.76it/s]
 99%|█████████▊| 365958/371472 [6:57:27<24:30,  3.75it/s]
 99%|█████████▊| 365959/371472 [6:57:28<24:45,  3.71it/s]
 99%|█████████▊| 365960/371472 [6:57:28<24:44,  3.71it/s]
                                                         
{'loss': 2.6615, 'learning_rate': 1.1336163244198328e-07, 'epoch': 15.76}

 99%|█████████▊| 365960/371472 [6:57:28<24:44,  3.71it/s]
 99%|█████████▊| 365961/371472 [6:57:28<24:03,  3.82it/s]
 99%|█████████▊| 365962/371472 [6:57:29<26:31,  3.46it/s]
 99%|█████████▊| 365963/371472 [6:57:29<26:38,  3.45it/s]
 99%|█████████▊| 365964/371472 [6:57:29<27:16,  3.37it/s]
 99%|█████████▊| 365965/371472 [6:57:30<27:57,  3.28it/s]
 99%|█████████▊| 365966/371472 [6:57:30<28:35,  3.21it/s]
 99%|█████████▊| 365967/371472 [6:57:30<27:37,  3.32it/s]
 99%|█████████▊| 365968/371472 [6:57:30<27:06,  3.38it/s]
 99%|█████████▊| 365969/371472 [6:57:31<26:31,  3.46it/s]
 99%|█████████▊| 365970/371472 [6:57:31<25:47,  3.56it/s]
 99%|█████████▊| 365971/371472 [6:57:31<24:53,  3.68it/s]
 99%|█████████▊| 365972/371472 [6:57:31<24:50,  3.69it/s]
 99%|█████████▊| 365973/371472 [6:57:32<24:31,  3.74it/s]
 99%|█████████▊| 365974/371472 [6:57:32<26:44,  3.43it/s]
 99%|█████████▊| 365975/371472 [6:57:32<26:38,  3.44it/s]
 99%|█████████▊| 365976/371472 [6:57:33<25:23,  3.61it/s]
 99%|█████████▊| 365977/371472 [6:57:33<25:31,  3.59it/s]
 99%|█████████▊| 365978/371472 [6:57:33<25:40,  3.57it/s]
 99%|█████████▊| 365979/371472 [6:57:34<28:53,  3.17it/s]
 99%|█████████▊| 365980/371472 [6:57:34<29:49,  3.07it/s]
                                                         
{'loss': 2.6155, 'learning_rate': 1.1331315046650434e-07, 'epoch': 15.76}

 99%|█████████▊| 365980/371472 [6:57:34<29:49,  3.07it/s]
 99%|█████████▊| 365981/371472 [6:57:34<28:06,  3.26it/s]
 99%|█████████▊| 365982/371472 [6:57:34<26:06,  3.50it/s]
 99%|█████████▊| 365983/371472 [6:57:35<29:13,  3.13it/s]
 99%|█████████▊| 365984/371472 [6:57:35<28:14,  3.24it/s]
 99%|█████████▊| 365985/371472 [6:57:35<27:24,  3.34it/s]
 99%|█████████▊| 365986/371472 [6:57:36<26:52,  3.40it/s]
 99%|█████████▊| 365987/371472 [6:57:36<27:01,  3.38it/s]
 99%|█████████▊| 365988/371472 [6:57:36<26:33,  3.44it/s]
 99%|█████████▊| 365989/371472 [6:57:37<25:56,  3.52it/s]
 99%|█████████▊| 365990/371472 [6:57:37<25:48,  3.54it/s]
 99%|█████████▊| 365991/371472 [6:57:37<25:27,  3.59it/s]
 99%|█████████▊| 365992/371472 [6:57:37<24:59,  3.66it/s]
 99%|█████████▊| 365993/371472 [6:57:38<28:12,  3.24it/s]
 99%|█████████▊| 365994/371472 [6:57:38<26:31,  3.44it/s]
 99%|█████████▊| 365995/371472 [6:57:38<25:33,  3.57it/s]
 99%|█████████▊| 365996/371472 [6:57:39<25:36,  3.56it/s]
 99%|█████████▊| 365997/371472 [6:57:39<25:32,  3.57it/s]
 99%|█████████▊| 365998/371472 [6:57:39<25:03,  3.64it/s]
 99%|█████████▊| 365999/371472 [6:57:39<24:25,  3.74it/s]
 99%|█████████▊| 366000/371472 [6:57:40<25:07,  3.63it/s]
                                                         
{'loss': 2.6458, 'learning_rate': 1.132646684910254e-07, 'epoch': 15.76}

 99%|█████████▊| 366000/371472 [6:57:40<25:07,  3.63it/s]
 99%|█████████▊| 366001/371472 [6:57:40<25:13,  3.62it/s]
 99%|█████████▊| 366002/371472 [6:57:40<25:04,  3.64it/s]
 99%|█████████▊| 366003/371472 [6:57:41<28:16,  3.22it/s]
 99%|█████████▊| 366004/371472 [6:57:41<28:56,  3.15it/s]
 99%|█████████▊| 366005/371472 [6:57:41<28:59,  3.14it/s]
 99%|█████████▊| 366006/371472 [6:57:42<30:17,  3.01it/s]
 99%|█████████▊| 366007/371472 [6:57:42<28:38,  3.18it/s]
 99%|█████████▊| 366008/371472 [6:57:42<29:27,  3.09it/s]
 99%|█████████▊| 366009/371472 [6:57:42<27:46,  3.28it/s]
 99%|█████████▊| 366010/371472 [6:57:43<26:07,  3.48it/s]
 99%|█████████▊| 366011/371472 [6:57:43<28:48,  3.16it/s]
 99%|█████████▊| 366012/371472 [6:57:43<26:26,  3.44it/s]
 99%|█████████▊| 366013/371472 [6:57:44<25:47,  3.53it/s]
 99%|█████████▊| 366014/371472 [6:57:44<24:24,  3.73it/s]
 99%|█████████▊| 366015/371472 [6:57:44<24:23,  3.73it/s]
 99%|█████████▊| 366016/371472 [6:57:44<24:01,  3.79it/s]
 99%|█████████▊| 366017/371472 [6:57:45<25:37,  3.55it/s]
 99%|█████████▊| 366018/371472 [6:57:45<25:22,  3.58it/s]
 99%|█████████▊| 366019/371472 [6:57:45<24:23,  3.73it/s]
 99%|█████████▊| 366020/371472 [6:57:45<24:47,  3.66it/s]
                                                         
{'loss': 2.4817, 'learning_rate': 1.1321618651554655e-07, 'epoch': 15.77}

 99%|█████████▊| 366020/371472 [6:57:45<24:47,  3.66it/s]
 99%|█████████▊| 366021/371472 [6:57:46<24:41,  3.68it/s]
 99%|█████████▊| 366022/371472 [6:57:46<28:00,  3.24it/s]
 99%|█████████▊| 366023/371472 [6:57:46<27:43,  3.28it/s]
 99%|█████████▊| 366024/371472 [6:57:47<26:22,  3.44it/s]
 99%|█████████▊| 366025/371472 [6:57:47<25:45,  3.52it/s]
 99%|█████████▊| 366026/371472 [6:57:47<26:01,  3.49it/s]
 99%|█████████▊| 366027/371472 [6:57:47<25:21,  3.58it/s]
 99%|█████████▊| 366028/371472 [6:57:48<24:43,  3.67it/s]
 99%|█████████▊| 366029/371472 [6:57:48<24:43,  3.67it/s]
 99%|█████████▊| 366030/371472 [6:57:48<23:53,  3.80it/s]
 99%|█████████▊| 366031/371472 [6:57:49<23:54,  3.79it/s]
 99%|█████████▊| 366032/371472 [6:57:49<23:34,  3.85it/s]
 99%|█████████▊| 366033/371472 [6:57:49<23:08,  3.92it/s]
 99%|█████████▊| 366034/371472 [6:57:49<23:37,  3.84it/s]
 99%|█████████▊| 366035/371472 [6:57:50<23:52,  3.80it/s]
 99%|█████████▊| 366036/371472 [6:57:50<25:34,  3.54it/s]
 99%|█████████▊| 366037/371472 [6:57:50<26:09,  3.46it/s]
 99%|█████████▊| 366038/371472 [6:57:50<25:33,  3.54it/s]
 99%|█████████▊| 366039/371472 [6:57:51<24:53,  3.64it/s]
 99%|█████████▊| 366040/371472 [6:57:51<26:19,  3.44it/s]
                                                         
{'loss': 2.577, 'learning_rate': 1.1316770454006761e-07, 'epoch': 15.77}

 99%|█████████▊| 366040/371472 [6:57:51<26:19,  3.44it/s]
 99%|█████████▊| 366041/371472 [6:57:51<25:39,  3.53it/s]
 99%|█████████▊| 366042/371472 [6:57:52<24:56,  3.63it/s]
 99%|█████████▊| 366043/371472 [6:57:52<24:28,  3.70it/s]
 99%|█████████▊| 366044/371472 [6:57:52<25:00,  3.62it/s]
 99%|█████████▊| 366045/371472 [6:57:52<24:56,  3.63it/s]
 99%|█████████▊| 366046/371472 [6:57:53<25:20,  3.57it/s]
 99%|█████████▊| 366047/371472 [6:57:53<26:01,  3.47it/s]
 99%|█████████▊| 366048/371472 [6:57:53<24:55,  3.63it/s]
 99%|█████████▊| 366049/371472 [6:57:53<23:54,  3.78it/s]
 99%|█████████▊| 366050/371472 [6:57:54<25:30,  3.54it/s]
 99%|█████████▊| 366051/371472 [6:57:54<27:11,  3.32it/s]
 99%|█████████▊| 366052/371472 [6:57:54<26:23,  3.42it/s]
 99%|█████████▊| 366053/371472 [6:57:55<25:47,  3.50it/s]
 99%|█████████▊| 366054/371472 [6:57:55<25:03,  3.60it/s]
 99%|█████████▊| 366055/371472 [6:57:55<27:33,  3.28it/s]
 99%|█████████▊| 366056/371472 [6:57:56<26:51,  3.36it/s]
 99%|█████████▊| 366057/371472 [6:57:56<27:33,  3.28it/s]
 99%|█████████▊| 366058/371472 [6:57:56<26:53,  3.36it/s]
 99%|█████████▊| 366059/371472 [6:57:57<28:36,  3.15it/s]
 99%|█████████▊| 366060/371472 [6:57:57<27:05,  3.33it/s]
                                                         
{'loss': 2.5593, 'learning_rate': 1.1311922256458879e-07, 'epoch': 15.77}

 99%|█████████▊| 366060/371472 [6:57:57<27:05,  3.33it/s]
 99%|█████████▊| 366061/371472 [6:57:57<25:39,  3.52it/s]
 99%|█████████▊| 366062/371472 [6:57:57<25:09,  3.58it/s]
 99%|█████████▊| 366063/371472 [6:57:58<25:55,  3.48it/s]
 99%|█████████▊| 366064/371472 [6:57:58<26:20,  3.42it/s]
 99%|█████████▊| 366065/371472 [6:57:58<25:04,  3.59it/s]
 99%|█████████▊| 366066/371472 [6:57:58<25:22,  3.55it/s]
 99%|█████████▊| 366067/371472 [6:57:59<25:32,  3.53it/s]
 99%|█████████▊| 366068/371472 [6:57:59<24:34,  3.66it/s]
 99%|█████████▊| 366069/371472 [6:57:59<25:10,  3.58it/s]
 99%|█████████▊| 366070/371472 [6:58:00<25:29,  3.53it/s]
 99%|█████████▊| 366071/371472 [6:58:00<25:44,  3.50it/s]
 99%|█████████▊| 366072/371472 [6:58:00<26:04,  3.45it/s]
 99%|█████████▊| 366073/371472 [6:58:00<25:09,  3.58it/s]
 99%|█████████▊| 366074/371472 [6:58:01<25:05,  3.58it/s]
 99%|█████████▊| 366075/371472 [6:58:01<24:15,  3.71it/s]
 99%|█████████▊| 366076/371472 [6:58:01<26:08,  3.44it/s]
 99%|█████████▊| 366077/371472 [6:58:02<25:08,  3.58it/s]
 99%|█████████▊| 366078/371472 [6:58:02<26:43,  3.36it/s]
 99%|█████████▊| 366079/371472 [6:58:02<25:46,  3.49it/s]
 99%|█████████▊| 366080/371472 [6:58:02<27:00,  3.33it/s]
                                                         
{'loss': 2.4783, 'learning_rate': 1.1307074058910983e-07, 'epoch': 15.77}

 99%|█████████▊| 366080/371472 [6:58:02<27:00,  3.33it/s]
 99%|█████████▊| 366081/371472 [6:58:03<26:58,  3.33it/s]
 99%|█████████▊| 366082/371472 [6:58:03<27:37,  3.25it/s]
 99%|█████████▊| 366083/371472 [6:58:03<28:11,  3.19it/s]
 99%|█████████▊| 366084/371472 [6:58:04<27:17,  3.29it/s]
 99%|█████████▊| 366085/371472 [6:58:04<28:04,  3.20it/s]
 99%|█████████▊| 366086/371472 [6:58:04<28:06,  3.19it/s]
 99%|█████████▊| 366087/371472 [6:58:05<27:37,  3.25it/s]
 99%|█████████▊| 366088/371472 [6:58:05<27:05,  3.31it/s]
 99%|█████████▊| 366089/371472 [6:58:05<25:43,  3.49it/s]
 99%|█████████▊| 366090/371472 [6:58:05<25:27,  3.52it/s]
 99%|█████████▊| 366091/371472 [6:58:06<28:05,  3.19it/s]
 99%|█████████▊| 366092/371472 [6:58:06<27:26,  3.27it/s]
 99%|█████████▊| 366093/371472 [6:58:06<26:19,  3.41it/s]
 99%|█████████▊| 366094/371472 [6:58:07<25:30,  3.51it/s]
 99%|█████████▊| 366095/371472 [6:58:07<25:55,  3.46it/s]
 99%|█████████▊| 366096/371472 [6:58:07<27:00,  3.32it/s]
 99%|█████████▊| 366097/371472 [6:58:08<28:30,  3.14it/s]
 99%|█████████▊| 366098/371472 [6:58:08<26:59,  3.32it/s]
 99%|█████████▊| 366099/371472 [6:58:08<27:23,  3.27it/s]
 99%|█████████▊| 366100/371472 [6:58:09<26:31,  3.38it/s]
                                                         
{'loss': 2.6307, 'learning_rate': 1.1302225861363098e-07, 'epoch': 15.77}

 99%|█████████▊| 366100/371472 [6:58:09<26:31,  3.38it/s]
 99%|█████████▊| 366101/371472 [6:58:09<25:51,  3.46it/s]
 99%|█████████▊| 366102/371472 [6:58:09<25:26,  3.52it/s]
 99%|█████████▊| 366103/371472 [6:58:09<25:17,  3.54it/s]
 99%|█████████▊| 366104/371472 [6:58:10<27:16,  3.28it/s]
 99%|█████████▊| 366105/371472 [6:58:10<26:01,  3.44it/s]
 99%|█████████▊| 366106/371472 [6:58:10<25:36,  3.49it/s]
 99%|█████████▊| 366107/371472 [6:58:10<24:47,  3.61it/s]
 99%|█████████▊| 366108/371472 [6:58:11<25:16,  3.54it/s]
 99%|█████████▊| 366109/371472 [6:58:11<24:20,  3.67it/s]
 99%|█████████▊| 366110/371472 [6:58:11<24:02,  3.72it/s]
 99%|█████████▊| 366111/371472 [6:58:12<23:20,  3.83it/s]
 99%|█████████▊| 366112/371472 [6:58:12<23:34,  3.79it/s]
 99%|█████████▊| 366113/371472 [6:58:12<26:33,  3.36it/s]
 99%|█████████▊| 366114/371472 [6:58:12<26:00,  3.43it/s]
 99%|█████████▊| 366115/371472 [6:58:13<25:55,  3.44it/s]
 99%|█████████▊| 366116/371472 [6:58:13<26:25,  3.38it/s]
 99%|█████████▊| 366117/371472 [6:58:13<25:00,  3.57it/s]
 99%|█████████▊| 366118/371472 [6:58:14<25:21,  3.52it/s]
 99%|█████████▊| 366119/371472 [6:58:14<25:55,  3.44it/s]
 99%|█████████▊| 366120/371472 [6:58:14<24:59,  3.57it/s]
                                                         
{'loss': 2.5246, 'learning_rate': 1.1297377663815204e-07, 'epoch': 15.77}

 99%|█████████▊| 366120/371472 [6:58:14<24:59,  3.57it/s]
 99%|█████████▊| 366121/371472 [6:58:14<24:33,  3.63it/s]
 99%|█████████▊| 366122/371472 [6:58:15<23:38,  3.77it/s]
 99%|█████████▊| 366123/371472 [6:58:15<22:56,  3.89it/s]
 99%|█████████▊| 366124/371472 [6:58:15<24:29,  3.64it/s]
 99%|█████████▊| 366125/371472 [6:58:15<24:40,  3.61it/s]
 99%|█████████▊| 366126/371472 [6:58:16<24:20,  3.66it/s]
 99%|█████████▊| 366127/371472 [6:58:16<24:12,  3.68it/s]
 99%|█████████▊| 366128/371472 [6:58:16<25:18,  3.52it/s]
 99%|█████████▊| 366129/371472 [6:58:17<24:50,  3.59it/s]
 99%|█████████▊| 366130/371472 [6:58:17<24:22,  3.65it/s]
 99%|█████████▊| 366131/371472 [6:58:17<23:40,  3.76it/s]
 99%|█████████▊| 366132/371472 [6:58:17<23:50,  3.73it/s]
 99%|█████████▊| 366133/371472 [6:58:18<23:50,  3.73it/s]
 99%|█████████▊| 366134/371472 [6:58:18<24:37,  3.61it/s]
 99%|█████████▊| 366135/371472 [6:58:18<23:50,  3.73it/s]
 99%|█████████▊| 366136/371472 [6:58:19<26:02,  3.42it/s]
 99%|█████████▊| 366137/371472 [6:58:19<25:22,  3.50it/s]
 99%|█████████▊| 366138/371472 [6:58:19<26:44,  3.32it/s]
 99%|█████████▊| 366139/371472 [6:58:19<27:41,  3.21it/s]
 99%|█████████▊| 366140/371472 [6:58:20<29:24,  3.02it/s]
                                                         
{'loss': 2.4044, 'learning_rate': 1.129252946626732e-07, 'epoch': 15.77}

 99%|█████████▊| 366140/371472 [6:58:20<29:24,  3.02it/s]
 99%|█████████▊| 366141/371472 [6:58:20<27:28,  3.23it/s]
 99%|█████████▊| 366142/371472 [6:58:20<26:22,  3.37it/s]
 99%|█████████▊| 366143/371472 [6:58:21<25:21,  3.50it/s]
 99%|█████████▊| 366144/371472 [6:58:21<24:20,  3.65it/s]
 99%|█████████▊| 366145/371472 [6:58:21<23:39,  3.75it/s]
 99%|█████████▊| 366146/371472 [6:58:21<23:40,  3.75it/s]
 99%|█████████▊| 366147/371472 [6:58:22<24:28,  3.63it/s]
 99%|█████████▊| 366148/371472 [6:58:22<25:12,  3.52it/s]
 99%|█████████▊| 366149/371472 [6:58:22<24:04,  3.69it/s]
 99%|█████████▊| 366150/371472 [6:58:23<23:32,  3.77it/s]
 99%|█████████▊| 366151/371472 [6:58:23<23:23,  3.79it/s]
 99%|█████████▊| 366152/371472 [6:58:23<22:39,  3.91it/s]
 99%|█████████▊| 366153/371472 [6:58:23<22:58,  3.86it/s]
 99%|█████████▊| 366154/371472 [6:58:24<23:42,  3.74it/s]
 99%|█████████▊| 366155/371472 [6:58:24<23:41,  3.74it/s]
 99%|█████████▊| 366156/371472 [6:58:24<25:02,  3.54it/s]
 99%|█████████▊| 366157/371472 [6:58:24<24:36,  3.60it/s]
 99%|█████████▊| 366158/371472 [6:58:25<24:00,  3.69it/s]
 99%|█████████▊| 366159/371472 [6:58:25<22:58,  3.85it/s]
 99%|█████████▊| 366160/371472 [6:58:25<23:00,  3.85it/s]
                                                         
{'loss': 2.6969, 'learning_rate': 1.1287681268719426e-07, 'epoch': 15.77}

 99%|█████████▊| 366160/371472 [6:58:25<23:00,  3.85it/s]
 99%|█████████▊| 366161/371472 [6:58:26<25:10,  3.52it/s]
 99%|█████████▊| 366162/371472 [6:58:26<27:32,  3.21it/s]
 99%|█████████▊| 366163/371472 [6:58:26<27:55,  3.17it/s]
 99%|█████████▊| 366164/371472 [6:58:26<26:42,  3.31it/s]
 99%|█████████▊| 366165/371472 [6:58:27<25:51,  3.42it/s]
 99%|█████████▊| 366166/371472 [6:58:27<26:07,  3.38it/s]
 99%|█████████▊| 366167/371472 [6:58:27<24:57,  3.54it/s]
 99%|█████████▊| 366168/371472 [6:58:28<24:11,  3.65it/s]
 99%|█████████▊| 366169/371472 [6:58:28<25:03,  3.53it/s]
 99%|█████████▊| 366170/371472 [6:58:28<23:51,  3.70it/s]
 99%|█████████▊| 366171/371472 [6:58:28<23:08,  3.82it/s]
 99%|█████████▊| 366172/371472 [6:58:29<23:28,  3.76it/s]
 99%|█████████▊| 366173/371472 [6:58:29<23:13,  3.80it/s]
 99%|█████████▊| 366174/371472 [6:58:29<23:43,  3.72it/s]
 99%|█████████▊| 366175/371472 [6:58:29<22:59,  3.84it/s]
 99%|█████████▊| 366176/371472 [6:58:30<23:13,  3.80it/s]
 99%|█████████▊| 366177/371472 [6:58:30<24:09,  3.65it/s]
 99%|█████████▊| 366178/371472 [6:58:30<24:02,  3.67it/s]
 99%|█████████▊| 366179/371472 [6:58:30<23:12,  3.80it/s]
 99%|█████████▊| 366180/371472 [6:58:31<23:22,  3.77it/s]
                                                         
{'loss': 2.5123, 'learning_rate': 1.1282833071171541e-07, 'epoch': 15.77}

 99%|█████████▊| 366180/371472 [6:58:31<23:22,  3.77it/s]
 99%|█████████▊| 366181/371472 [6:58:31<23:16,  3.79it/s]
 99%|█████████▊| 366182/371472 [6:58:31<23:51,  3.70it/s]
 99%|█████████▊| 366183/371472 [6:58:32<23:06,  3.82it/s]
 99%|█████████▊| 366184/371472 [6:58:32<23:54,  3.69it/s]
 99%|█████████▊| 366185/371472 [6:58:32<24:27,  3.60it/s]
 99%|█████████▊| 366186/371472 [6:58:32<23:38,  3.73it/s]
 99%|█████████▊| 366187/371472 [6:58:33<25:08,  3.50it/s]
 99%|█████████▊| 366188/371472 [6:58:33<24:14,  3.63it/s]
 99%|█████████▊| 366189/371472 [6:58:33<23:44,  3.71it/s]
 99%|█████████▊| 366190/371472 [6:58:33<23:29,  3.75it/s]
 99%|█████████▊| 366191/371472 [6:58:34<22:58,  3.83it/s]
 99%|█████████▊| 366192/371472 [6:58:34<26:17,  3.35it/s]
 99%|█████████▊| 366193/371472 [6:58:34<24:52,  3.54it/s]
 99%|█████████▊| 366194/371472 [6:58:35<26:30,  3.32it/s]
 99%|█████████▊| 366195/371472 [6:58:35<24:53,  3.53it/s]
 99%|█████████▊| 366196/371472 [6:58:35<24:38,  3.57it/s]
 99%|█████████▊| 366197/371472 [6:58:36<26:09,  3.36it/s]
 99%|█████████▊| 366198/371472 [6:58:36<28:31,  3.08it/s]
 99%|█████████▊| 366199/371472 [6:58:36<28:36,  3.07it/s]
 99%|█████████▊| 366200/371472 [6:58:37<27:06,  3.24it/s]
                                                         
{'loss': 2.6823, 'learning_rate': 1.1277984873623647e-07, 'epoch': 15.77}

 99%|█████████▊| 366200/371472 [6:58:37<27:06,  3.24it/s]
 99%|█████████▊| 366201/371472 [6:58:37<26:03,  3.37it/s]
 99%|█████████▊| 366202/371472 [6:58:37<25:31,  3.44it/s]
 99%|█████████▊| 366203/371472 [6:58:37<24:22,  3.60it/s]
 99%|█████████▊| 366204/371472 [6:58:38<25:14,  3.48it/s]
 99%|█████████▊| 366205/371472 [6:58:38<27:41,  3.17it/s]
 99%|█████████▊| 366206/371472 [6:58:38<27:06,  3.24it/s]
 99%|█████████▊| 366207/371472 [6:58:39<25:11,  3.48it/s]
 99%|█████████▊| 366208/371472 [6:58:39<25:13,  3.48it/s]
 99%|█████████▊| 366209/371472 [6:58:39<25:45,  3.40it/s]
 99%|█████████▊| 366210/371472 [6:58:39<26:05,  3.36it/s]
 99%|█████████▊| 366211/371472 [6:58:40<26:30,  3.31it/s]
 99%|█████████▊| 366212/371472 [6:58:40<26:59,  3.25it/s]
 99%|█████████▊| 366213/371472 [6:58:40<25:39,  3.42it/s]
 99%|█████████▊| 366214/371472 [6:58:41<26:15,  3.34it/s]
 99%|█████████▊| 366215/371472 [6:58:41<24:43,  3.54it/s]
 99%|█████████▊| 366216/371472 [6:58:41<24:43,  3.54it/s]
 99%|█████████▊| 366217/371472 [6:58:41<24:20,  3.60it/s]
 99%|█████████▊| 366218/371472 [6:58:42<24:40,  3.55it/s]
 99%|█████████▊| 366219/371472 [6:58:42<23:28,  3.73it/s]
 99%|█████████▊| 366220/371472 [6:58:42<25:28,  3.44it/s]
                                                         
{'loss': 2.4755, 'learning_rate': 1.1273136676075762e-07, 'epoch': 15.77}

 99%|█████████▊| 366220/371472 [6:58:42<25:28,  3.44it/s]
 99%|█████████▊| 366221/371472 [6:58:43<26:04,  3.36it/s]
 99%|█████████▊| 366222/371472 [6:58:43<25:00,  3.50it/s]
 99%|█████████▊| 366223/371472 [6:58:43<23:44,  3.68it/s]
 99%|█████████▊| 366224/371472 [6:58:43<23:06,  3.78it/s]
 99%|█████████▊| 366225/371472 [6:58:44<23:48,  3.67it/s]
 99%|█████████▊| 366226/371472 [6:58:44<26:17,  3.32it/s]
 99%|█████████▊| 366227/371472 [6:58:44<25:01,  3.49it/s]
 99%|█████████▊| 366228/371472 [6:58:45<24:28,  3.57it/s]
 99%|█████████▊| 366229/371472 [6:58:45<24:40,  3.54it/s]
 99%|█████████▊| 366230/371472 [6:58:45<23:48,  3.67it/s]
 99%|█████████▊| 366231/371472 [6:58:45<25:18,  3.45it/s]
 99%|█████████▊| 366232/371472 [6:58:46<24:12,  3.61it/s]
 99%|█████████▊| 366233/371472 [6:58:46<23:45,  3.67it/s]
 99%|█████████▊| 366234/371472 [6:58:46<23:46,  3.67it/s]
 99%|█████████▊| 366235/371472 [6:58:46<23:07,  3.77it/s]
 99%|█████████▊| 366236/371472 [6:58:47<23:59,  3.64it/s]
 99%|█████████▊| 366237/371472 [6:58:47<22:49,  3.82it/s]
 99%|█████████▊| 366238/371472 [6:58:47<22:45,  3.83it/s]
 99%|█████████▊| 366239/371472 [6:58:48<23:08,  3.77it/s]
 99%|█████████▊| 366240/371472 [6:58:48<23:17,  3.74it/s]
                                                         
{'loss': 2.5581, 'learning_rate': 1.1268288478527869e-07, 'epoch': 15.77}

 99%|█████████▊| 366240/371472 [6:58:48<23:17,  3.74it/s]
 99%|█████████▊| 366241/371472 [6:58:48<25:12,  3.46it/s]
 99%|█████████▊| 366242/371472 [6:58:48<24:35,  3.54it/s]
 99%|█████████▊| 366243/371472 [6:58:49<24:35,  3.54it/s]
 99%|█████████▊| 366244/371472 [6:58:49<23:48,  3.66it/s]
 99%|█████████▊| 366245/371472 [6:58:49<22:54,  3.80it/s]
 99%|█████████▊| 366246/371472 [6:58:49<24:01,  3.63it/s]
 99%|█████████▊| 366247/371472 [6:58:50<23:21,  3.73it/s]
 99%|█████████▊| 366248/371472 [6:58:50<23:29,  3.71it/s]
 99%|█████████▊| 366249/371472 [6:58:50<24:27,  3.56it/s]
 99%|█████████▊| 366250/371472 [6:58:51<23:50,  3.65it/s]
 99%|█████████▊| 366251/371472 [6:58:51<23:18,  3.73it/s]
 99%|█████████▊| 366252/371472 [6:58:51<24:06,  3.61it/s]
 99%|█████████▊| 366253/371472 [6:58:51<24:34,  3.54it/s]
 99%|█████████▊| 366254/371472 [6:58:52<26:30,  3.28it/s]
 99%|█████████▊| 366255/371472 [6:58:52<25:52,  3.36it/s]
 99%|█████████▊| 366256/371472 [6:58:52<24:34,  3.54it/s]
 99%|█████████▊| 366257/371472 [6:58:53<24:26,  3.56it/s]
 99%|█████████▊| 366258/371472 [6:58:53<24:28,  3.55it/s]
 99%|█████████▊| 366259/371472 [6:58:53<25:24,  3.42it/s]
 99%|█████████▊| 366260/371472 [6:58:54<27:48,  3.12it/s]
                                                         
{'loss': 2.546, 'learning_rate': 1.1263440280979984e-07, 'epoch': 15.78}

 99%|█████████▊| 366260/371472 [6:58:54<27:48,  3.12it/s]
 99%|█████████▊| 366261/371472 [6:58:54<29:08,  2.98it/s]
 99%|█████████▊| 366262/371472 [6:58:54<27:18,  3.18it/s]
 99%|█████████▊| 366263/371472 [6:58:54<26:35,  3.26it/s]
 99%|█████████▊| 366264/371472 [6:58:55<25:23,  3.42it/s]
 99%|█████████▊| 366265/371472 [6:58:55<25:29,  3.40it/s]
 99%|█████████▊| 366266/371472 [6:58:55<24:28,  3.55it/s]
 99%|█████████▊| 366267/371472 [6:58:56<23:49,  3.64it/s]
 99%|█████████▊| 366268/371472 [6:58:56<22:46,  3.81it/s]
 99%|█████████▊| 366269/371472 [6:58:56<24:06,  3.60it/s]
 99%|█████████▊| 366270/371472 [6:58:56<23:33,  3.68it/s]
 99%|█████████▊| 366271/371472 [6:58:57<25:04,  3.46it/s]
 99%|█████████▊| 366272/371472 [6:58:57<24:38,  3.52it/s]
 99%|█████████▊| 366273/371472 [6:58:57<25:26,  3.40it/s]
 99%|█████████▊| 366274/371472 [6:58:58<25:14,  3.43it/s]
 99%|█████████▊| 366275/371472 [6:58:58<25:04,  3.45it/s]
 99%|█████████▊| 366276/371472 [6:58:58<23:58,  3.61it/s]
 99%|█████████▊| 366277/371472 [6:58:58<23:31,  3.68it/s]
 99%|█████████▊| 366278/371472 [6:58:59<23:09,  3.74it/s]
 99%|█████████▊| 366279/371472 [6:58:59<23:28,  3.69it/s]
 99%|█████████▊| 366280/371472 [6:58:59<23:32,  3.67it/s]
                                                         
{'loss': 2.7965, 'learning_rate': 1.125859208343209e-07, 'epoch': 15.78}

 99%|█████████▊| 366280/371472 [6:58:59<23:32,  3.67it/s]
 99%|█████████▊| 366281/371472 [6:58:59<23:31,  3.68it/s]
 99%|█████████▊| 366282/371472 [6:59:00<24:02,  3.60it/s]
 99%|█████████▊| 366283/371472 [6:59:00<24:02,  3.60it/s]
 99%|█████████▊| 366284/371472 [6:59:00<23:51,  3.62it/s]
 99%|█████████▊| 366285/371472 [6:59:01<28:01,  3.08it/s]
 99%|█████████▊| 366286/371472 [6:59:01<26:20,  3.28it/s]
 99%|█████████▊| 366287/371472 [6:59:01<26:29,  3.26it/s]
 99%|█████████▊| 366288/371472 [6:59:02<26:12,  3.30it/s]
 99%|█████████▊| 366289/371472 [6:59:02<26:36,  3.25it/s]
 99%|█████████▊| 366290/371472 [6:59:02<26:10,  3.30it/s]
 99%|█████████▊| 366291/371472 [6:59:03<27:06,  3.19it/s]
 99%|█████████▊| 366292/371472 [6:59:03<26:19,  3.28it/s]
 99%|█████████▊| 366293/371472 [6:59:03<24:53,  3.47it/s]
 99%|█████████▊| 366294/371472 [6:59:03<24:36,  3.51it/s]
 99%|█████████▊| 366295/371472 [6:59:04<25:55,  3.33it/s]
 99%|█████████▊| 366296/371472 [6:59:04<25:24,  3.39it/s]
 99%|█████████▊| 366297/371472 [6:59:04<24:46,  3.48it/s]
 99%|█████████▊| 366298/371472 [6:59:05<25:12,  3.42it/s]
 99%|█████████▊| 366299/371472 [6:59:05<24:41,  3.49it/s]
 99%|█████████▊| 366300/371472 [6:59:05<24:13,  3.56it/s]
                                                         
{'loss': 2.5936, 'learning_rate': 1.1253743885884207e-07, 'epoch': 15.78}

 99%|█████████▊| 366300/371472 [6:59:05<24:13,  3.56it/s]
 99%|█████████▊| 366301/371472 [6:59:05<23:53,  3.61it/s]
 99%|█████████▊| 366302/371472 [6:59:06<23:41,  3.64it/s]
 99%|█████████▊| 366303/371472 [6:59:06<24:35,  3.50it/s]
 99%|█████████▊| 366304/371472 [6:59:06<24:19,  3.54it/s]
 99%|█████████▊| 366305/371472 [6:59:06<23:23,  3.68it/s]
 99%|█████████▊| 366306/371472 [6:59:07<24:29,  3.51it/s]
 99%|█████████▊| 366307/371472 [6:59:07<24:17,  3.54it/s]
 99%|█████████▊| 366308/371472 [6:59:07<24:24,  3.53it/s]
 99%|█████████▊| 366309/371472 [6:59:08<25:46,  3.34it/s]
 99%|█████████▊| 366310/371472 [6:59:08<26:16,  3.27it/s]
 99%|█████████▊| 366311/371472 [6:59:08<25:40,  3.35it/s]
 99%|█████████▊| 366312/371472 [6:59:09<26:00,  3.31it/s]
 99%|█████████▊| 366313/371472 [6:59:09<24:57,  3.45it/s]
 99%|█████████▊| 366314/371472 [6:59:09<24:27,  3.51it/s]
 99%|█████████▊| 366315/371472 [6:59:09<24:49,  3.46it/s]
 99%|█████████▊| 366316/371472 [6:59:10<24:01,  3.58it/s]
 99%|█████████▊| 366317/371472 [6:59:10<22:55,  3.75it/s]
 99%|█████████▊| 366318/371472 [6:59:10<23:53,  3.60it/s]
 99%|█████████▊| 366319/371472 [6:59:10<23:17,  3.69it/s]
 99%|█████████▊| 366320/371472 [6:59:11<25:32,  3.36it/s]
                                                         
{'loss': 2.6067, 'learning_rate': 1.1248895688336311e-07, 'epoch': 15.78}

 99%|█████████▊| 366320/371472 [6:59:11<25:32,  3.36it/s]
 99%|█████████▊| 366321/371472 [6:59:11<26:47,  3.21it/s]
 99%|█████████▊| 366322/371472 [6:59:11<25:42,  3.34it/s]
 99%|█████████▊| 366323/371472 [6:59:12<25:23,  3.38it/s]
 99%|█████████▊| 366324/371472 [6:59:12<24:37,  3.48it/s]
 99%|█████████▊| 366325/371472 [6:59:12<23:42,  3.62it/s]
 99%|█████████▊| 366326/371472 [6:59:12<23:23,  3.67it/s]
 99%|█████████▊| 366327/371472 [6:59:13<24:02,  3.57it/s]
 99%|█████████▊| 366328/371472 [6:59:13<23:29,  3.65it/s]
 99%|█████████▊| 366329/371472 [6:59:13<23:15,  3.68it/s]
 99%|█████████▊| 366330/371472 [6:59:14<22:47,  3.76it/s]
 99%|█████████▊| 366331/371472 [6:59:14<24:39,  3.48it/s]
 99%|█████████▊| 366332/371472 [6:59:14<24:25,  3.51it/s]
 99%|█████████▊| 366333/371472 [6:59:14<24:34,  3.49it/s]
 99%|█████████▊| 366334/371472 [6:59:15<23:52,  3.59it/s]
 99%|█████████▊| 366335/371472 [6:59:15<23:01,  3.72it/s]
 99%|█████████▊| 366336/371472 [6:59:15<22:55,  3.73it/s]
 99%|█████████▊| 366337/371472 [6:59:16<24:16,  3.52it/s]
 99%|█████████▊| 366338/371472 [6:59:16<23:10,  3.69it/s]
 99%|█████████▊| 366339/371472 [6:59:16<23:34,  3.63it/s]
 99%|█████████▊| 366340/371472 [6:59:16<24:41,  3.46it/s]
                                                         
{'loss': 2.7544, 'learning_rate': 1.1244047490788428e-07, 'epoch': 15.78}

 99%|█████████▊| 366340/371472 [6:59:16<24:41,  3.46it/s]
 99%|█████████▊| 366341/371472 [6:59:17<25:50,  3.31it/s]
 99%|█████████▊| 366342/371472 [6:59:17<25:13,  3.39it/s]
 99%|█████████▊| 366343/371472 [6:59:17<24:59,  3.42it/s]
 99%|█████████▊| 366344/371472 [6:59:18<25:04,  3.41it/s]
 99%|█████████▊| 366345/371472 [6:59:18<24:00,  3.56it/s]
 99%|█████████▊| 366346/371472 [6:59:18<23:13,  3.68it/s]
 99%|█████████▊| 366347/371472 [6:59:18<24:34,  3.48it/s]
 99%|█████████▊| 366348/371472 [6:59:19<24:24,  3.50it/s]
 99%|█████████▊| 366349/371472 [6:59:19<24:46,  3.45it/s]
 99%|█████████▊| 366350/371472 [6:59:19<23:59,  3.56it/s]
 99%|█████████▊| 366351/371472 [6:59:20<23:33,  3.62it/s]
 99%|█████████▊| 366352/371472 [6:59:20<24:15,  3.52it/s]
 99%|█████████▊| 366353/371472 [6:59:20<24:35,  3.47it/s]
 99%|█████████▊| 366354/371472 [6:59:20<24:16,  3.51it/s]
 99%|█████████▊| 366355/371472 [6:59:21<24:06,  3.54it/s]
 99%|█████████▊| 366356/371472 [6:59:21<24:07,  3.53it/s]
 99%|█████████▊| 366357/371472 [6:59:21<23:44,  3.59it/s]
 99%|█████████▊| 366358/371472 [6:59:22<24:14,  3.52it/s]
 99%|█████████▊| 366359/371472 [6:59:22<24:10,  3.52it/s]
 99%|█████████▊| 366360/371472 [6:59:22<24:12,  3.52it/s]
                                                         
{'loss': 2.5254, 'learning_rate': 1.1239199293240533e-07, 'epoch': 15.78}

 99%|█████████▊| 366360/371472 [6:59:22<24:12,  3.52it/s]
 99%|█████████▊| 366361/371472 [6:59:22<23:39,  3.60it/s]
 99%|█████████▊| 366362/371472 [6:59:23<23:39,  3.60it/s]
 99%|█████████▊| 366363/371472 [6:59:23<23:12,  3.67it/s]
 99%|█████████▊| 366364/371472 [6:59:23<23:58,  3.55it/s]
 99%|█████████▊| 366365/371472 [6:59:23<22:40,  3.75it/s]
 99%|█████████▊| 366366/371472 [6:59:24<22:56,  3.71it/s]
 99%|█████████▊| 366367/371472 [6:59:24<22:35,  3.77it/s]
 99%|█████████▊| 366368/371472 [6:59:24<22:34,  3.77it/s]
 99%|█████████▊| 366369/371472 [6:59:25<22:41,  3.75it/s]
 99%|█████████▊| 366370/371472 [6:59:25<22:56,  3.71it/s]
 99%|█████████▊| 366371/371472 [6:59:25<22:55,  3.71it/s]
 99%|█████████▊| 366372/371472 [6:59:25<23:17,  3.65it/s]
 99%|█████████▊| 366373/371472 [6:59:26<22:21,  3.80it/s]
 99%|█████████▊| 366374/371472 [6:59:26<22:54,  3.71it/s]
 99%|█████████▊| 366375/371472 [6:59:26<24:01,  3.54it/s]
 99%|█████████▊| 366376/371472 [6:59:27<24:59,  3.40it/s]
 99%|█████████▊| 366377/371472 [6:59:27<27:21,  3.10it/s]
 99%|█████████▊| 366378/371472 [6:59:27<26:09,  3.25it/s]
 99%|█████████▊| 366379/371472 [6:59:27<25:53,  3.28it/s]
 99%|█████████▊| 366380/371472 [6:59:28<26:02,  3.26it/s]
                                                         
{'loss': 2.6236, 'learning_rate': 1.1234351095692648e-07, 'epoch': 15.78}

 99%|█████████▊| 366380/371472 [6:59:28<26:02,  3.26it/s]
 99%|█████████▊| 366381/371472 [6:59:28<25:35,  3.31it/s]
 99%|█████████▊| 366382/371472 [6:59:28<24:36,  3.45it/s]
 99%|█████████▊| 366383/371472 [6:59:29<25:21,  3.34it/s]
 99%|█████████▊| 366384/371472 [6:59:29<24:12,  3.50it/s]
 99%|█████████▊| 366385/371472 [6:59:29<23:28,  3.61it/s]
 99%|█████████▊| 366386/371472 [6:59:29<23:21,  3.63it/s]
 99%|█████████▊| 366387/371472 [6:59:30<22:33,  3.76it/s]
 99%|█████████▊| 366388/371472 [6:59:30<25:11,  3.36it/s]
 99%|█████████▊| 366389/371472 [6:59:30<24:16,  3.49it/s]
 99%|█████████▊| 366390/371472 [6:59:31<23:12,  3.65it/s]
 99%|█████████▊| 366391/371472 [6:59:31<22:38,  3.74it/s]
 99%|█████████▊| 366392/371472 [6:59:31<23:17,  3.64it/s]
 99%|█████████▊| 366393/371472 [6:59:31<24:32,  3.45it/s]
 99%|█████████▊| 366394/371472 [6:59:32<23:48,  3.55it/s]
 99%|█████████▊| 366395/371472 [6:59:32<23:00,  3.68it/s]
 99%|█████████▊| 366396/371472 [6:59:32<22:49,  3.71it/s]
 99%|█████████▊| 366397/371472 [6:59:32<22:33,  3.75it/s]
 99%|█████████▊| 366398/371472 [6:59:33<21:36,  3.91it/s]
 99%|█████████▊| 366399/371472 [6:59:33<21:45,  3.89it/s]
 99%|█████████▊| 366400/371472 [6:59:33<22:43,  3.72it/s]
                                                         
{'loss': 2.5303, 'learning_rate': 1.1229502898144754e-07, 'epoch': 15.78}

 99%|█████████▊| 366400/371472 [6:59:33<22:43,  3.72it/s]
 99%|█████████▊| 366401/371472 [6:59:33<22:01,  3.84it/s]
 99%|█████████▊| 366402/371472 [6:59:34<21:39,  3.90it/s]
 99%|█████████▊| 366403/371472 [6:59:34<21:27,  3.94it/s]
 99%|█████████▊| 366404/371472 [6:59:34<21:53,  3.86it/s]
 99%|█████████▊| 366405/371472 [6:59:35<21:48,  3.87it/s]
 99%|█████████▊| 366406/371472 [6:59:35<21:56,  3.85it/s]
 99%|█████████▊| 366407/371472 [6:59:35<22:41,  3.72it/s]
 99%|█████████▊| 366408/371472 [6:59:35<22:26,  3.76it/s]
 99%|█████████▊| 366409/371472 [6:59:36<22:04,  3.82it/s]
 99%|█████████▊| 366410/371472 [6:59:36<21:51,  3.86it/s]
 99%|█████████▊| 366411/371472 [6:59:36<21:59,  3.83it/s]
 99%|█████████▊| 366412/371472 [6:59:36<22:39,  3.72it/s]
 99%|█████████▊| 366413/371472 [6:59:37<22:39,  3.72it/s]
 99%|█████████▊| 366414/371472 [6:59:37<22:33,  3.74it/s]
 99%|█████████▊| 366415/371472 [6:59:37<22:38,  3.72it/s]
 99%|█████████▊| 366416/371472 [6:59:37<23:18,  3.62it/s]
 99%|█████████▊| 366417/371472 [6:59:38<23:48,  3.54it/s]
 99%|█████████▊| 366418/371472 [6:59:38<24:29,  3.44it/s]
 99%|█████████▊| 366419/371472 [6:59:38<24:20,  3.46it/s]
 99%|█████████▊| 366420/371472 [6:59:39<25:22,  3.32it/s]
                                                         
{'loss': 2.5965, 'learning_rate': 1.1224654700596871e-07, 'epoch': 15.78}

 99%|█████████▊| 366420/371472 [6:59:39<25:22,  3.32it/s]
 99%|█████████▊| 366421/371472 [6:59:39<25:14,  3.34it/s]
 99%|█████████▊| 366422/371472 [6:59:39<25:35,  3.29it/s]
 99%|█████████▊| 366423/371472 [6:59:40<24:42,  3.41it/s]
 99%|█████████▊| 366424/371472 [6:59:40<24:11,  3.48it/s]
 99%|█████████▊| 366425/371472 [6:59:40<23:53,  3.52it/s]
 99%|█████████▊| 366426/371472 [6:59:40<22:48,  3.69it/s]
 99%|█████████▊| 366427/371472 [6:59:41<22:48,  3.69it/s]
 99%|█████████▊| 366428/371472 [6:59:41<23:19,  3.61it/s]
 99%|█████████▊| 366429/371472 [6:59:41<23:08,  3.63it/s]
 99%|█████████▊| 366430/371472 [6:59:42<24:21,  3.45it/s]
 99%|█████████▊| 366431/371472 [6:59:42<23:23,  3.59it/s]
 99%|█████████▊| 366432/371472 [6:59:42<22:32,  3.73it/s]
 99%|█████████▊| 366433/371472 [6:59:42<22:04,  3.80it/s]
 99%|█████████▊| 366434/371472 [6:59:43<22:38,  3.71it/s]
 99%|█████████▊| 366435/371472 [6:59:43<22:34,  3.72it/s]
 99%|█████████▊| 366436/371472 [6:59:43<22:24,  3.75it/s]
 99%|█████████▊| 366437/371472 [6:59:43<22:01,  3.81it/s]
 99%|█████████▊| 366438/371472 [6:59:44<22:08,  3.79it/s]
 99%|█████████▊| 366439/371472 [6:59:44<21:53,  3.83it/s]
 99%|█████████▊| 366440/371472 [6:59:44<24:11,  3.47it/s]
                                                         
{'loss': 2.6287, 'learning_rate': 1.1219806503048977e-07, 'epoch': 15.78}

 99%|█████████▊| 366440/371472 [6:59:44<24:11,  3.47it/s]
 99%|█████████▊| 366441/371472 [6:59:44<22:55,  3.66it/s]
 99%|█████████▊| 366442/371472 [6:59:45<22:31,  3.72it/s]
 99%|█████████▊| 366443/371472 [6:59:45<23:03,  3.63it/s]
 99%|█████████▊| 366444/371472 [6:59:45<22:47,  3.68it/s]
 99%|█████████▊| 366445/371472 [6:59:46<22:46,  3.68it/s]
 99%|█████████▊| 366446/371472 [6:59:46<22:54,  3.66it/s]
 99%|█████████▊| 366447/371472 [6:59:46<23:40,  3.54it/s]
 99%|█████████▊| 366448/371472 [6:59:46<23:05,  3.62it/s]
 99%|█████████▊| 366449/371472 [6:59:47<24:13,  3.46it/s]
 99%|█████████▊| 366450/371472 [6:59:47<23:26,  3.57it/s]
 99%|█████████▊| 366451/371472 [6:59:47<23:01,  3.63it/s]
 99%|█████████▊| 366452/371472 [6:59:48<24:33,  3.41it/s]
 99%|█████████▊| 366453/371472 [6:59:48<23:33,  3.55it/s]
 99%|█████████▊| 366454/371472 [6:59:48<22:44,  3.68it/s]
 99%|█████████▊| 366455/371472 [6:59:48<22:53,  3.65it/s]
 99%|█████████▊| 366456/371472 [6:59:49<22:45,  3.67it/s]
 99%|█████████▊| 366457/371472 [6:59:49<22:26,  3.72it/s]
 99%|█████████▊| 366458/371472 [6:59:49<23:10,  3.61it/s]
 99%|█████████▊| 366459/371472 [6:59:49<22:26,  3.72it/s]
 99%|█████████▊| 366460/371472 [6:59:50<22:48,  3.66it/s]
                                                         
{'loss': 2.7425, 'learning_rate': 1.1214958305501092e-07, 'epoch': 15.78}

 99%|█████████▊| 366460/371472 [6:59:50<22:48,  3.66it/s]
 99%|█████████▊| 366461/371472 [6:59:50<22:52,  3.65it/s]
 99%|█████████▊| 366462/371472 [6:59:50<23:00,  3.63it/s]
 99%|█████████▊| 366463/371472 [6:59:51<24:36,  3.39it/s]
 99%|█████████▊| 366464/371472 [6:59:51<24:41,  3.38it/s]
 99%|█████████▊| 366465/371472 [6:59:51<23:31,  3.55it/s]
 99%|█████████▊| 366466/371472 [6:59:51<22:34,  3.69it/s]
 99%|█████████▊| 366467/371472 [6:59:52<22:29,  3.71it/s]
 99%|█████████▊| 366468/371472 [6:59:52<22:51,  3.65it/s]
 99%|█████████▊| 366469/371472 [6:59:52<23:06,  3.61it/s]
 99%|█████████▊| 366470/371472 [6:59:52<22:31,  3.70it/s]
 99%|█████████▊| 366471/371472 [6:59:53<22:32,  3.70it/s]
 99%|█████████▊| 366472/371472 [6:59:53<23:13,  3.59it/s]
 99%|█████████▊| 366473/371472 [6:59:53<22:37,  3.68it/s]
 99%|█████████▊| 366474/371472 [6:59:54<22:40,  3.67it/s]
 99%|█████████▊| 366475/371472 [6:59:54<22:20,  3.73it/s]
 99%|█████████▊| 366476/371472 [6:59:54<24:13,  3.44it/s]
 99%|█████████▊| 366477/371472 [6:59:54<22:57,  3.63it/s]
 99%|█████████▊| 366478/371472 [6:59:55<24:43,  3.37it/s]
 99%|█████████▊| 366479/371472 [6:59:55<23:59,  3.47it/s]
 99%|█████████▊| 366480/371472 [6:59:55<23:32,  3.54it/s]
                                                         
{'loss': 2.7305, 'learning_rate': 1.1210110107953199e-07, 'epoch': 15.78}

 99%|█████████▊| 366480/371472 [6:59:55<23:32,  3.54it/s]
 99%|█████████▊| 366481/371472 [6:59:56<23:01,  3.61it/s]
 99%|█████████▊| 366482/371472 [6:59:56<23:13,  3.58it/s]
 99%|█████████▊| 366483/371472 [6:59:56<23:20,  3.56it/s]
 99%|█████████▊| 366484/371472 [6:59:56<25:15,  3.29it/s]
 99%|█████████▊| 366485/371472 [6:59:57<25:09,  3.30it/s]
 99%|█████████▊| 366486/371472 [6:59:57<23:58,  3.47it/s]
 99%|█████████▊| 366487/371472 [6:59:57<23:23,  3.55it/s]
 99%|█████████▊| 366488/371472 [6:59:58<23:25,  3.55it/s]
 99%|█████████▊| 366489/371472 [6:59:58<23:02,  3.60it/s]
 99%|█████████▊| 366490/371472 [6:59:58<22:25,  3.70it/s]
 99%|█████████▊| 366491/371472 [6:59:58<21:52,  3.79it/s]
 99%|█████████▊| 366492/371472 [6:59:59<21:30,  3.86it/s]
 99%|█████████▊| 366493/371472 [6:59:59<22:40,  3.66it/s]
 99%|█████████▊| 366494/371472 [6:59:59<22:13,  3.73it/s]
 99%|█████████▊| 366495/371472 [6:59:59<23:09,  3.58it/s]
 99%|█████████▊| 366496/371472 [7:00:00<22:44,  3.65it/s]
 99%|█████████▊| 366497/371472 [7:00:00<22:20,  3.71it/s]
 99%|█████████▊| 366498/371472 [7:00:00<22:59,  3.61it/s]
 99%|█████████▊| 366499/371472 [7:00:01<22:31,  3.68it/s]
 99%|█████████▊| 366500/371472 [7:00:01<23:05,  3.59it/s]
                                                         
{'loss': 2.6572, 'learning_rate': 1.1205261910405314e-07, 'epoch': 15.79}

 99%|█████████▊| 366500/371472 [7:00:01<23:05,  3.59it/s]
 99%|█████████▊| 366501/371472 [7:00:01<22:37,  3.66it/s]
 99%|█████████▊| 366502/371472 [7:00:01<22:44,  3.64it/s]
 99%|█████████▊| 366503/371472 [7:00:02<22:10,  3.73it/s]
 99%|█████████▊| 366504/371472 [7:00:02<23:15,  3.56it/s]
 99%|█████████▊| 366505/371472 [7:00:02<23:06,  3.58it/s]
 99%|█████████▊| 366506/371472 [7:00:03<24:08,  3.43it/s]
 99%|█████████▊| 366507/371472 [7:00:03<24:27,  3.38it/s]
 99%|█████████▊| 366508/371472 [7:00:03<23:49,  3.47it/s]
 99%|█████████▊| 366509/371472 [7:00:03<23:08,  3.57it/s]
 99%|█████████▊| 366510/371472 [7:00:04<23:33,  3.51it/s]
 99%|█████████▊| 366511/371472 [7:00:04<22:56,  3.60it/s]
 99%|█████████▊| 366512/371472 [7:00:04<22:10,  3.73it/s]
 99%|█████████▊| 366513/371472 [7:00:04<22:03,  3.75it/s]
 99%|█████████▊| 366514/371472 [7:00:05<21:54,  3.77it/s]
 99%|█████████▊| 366515/371472 [7:00:05<23:06,  3.58it/s]
 99%|█████████▊| 366516/371472 [7:00:05<22:23,  3.69it/s]
 99%|█████████▊| 366517/371472 [7:00:06<23:12,  3.56it/s]
 99%|█████████▊| 366518/371472 [7:00:06<22:30,  3.67it/s]
 99%|█████████▊| 366519/371472 [7:00:06<24:53,  3.32it/s]
 99%|█████████▊| 366520/371472 [7:00:06<23:30,  3.51it/s]
                                                         
{'loss': 2.6309, 'learning_rate': 1.120041371285742e-07, 'epoch': 15.79}

 99%|█████████▊| 366520/371472 [7:00:06<23:30,  3.51it/s]
 99%|█████████▊| 366521/371472 [7:00:07<22:52,  3.61it/s]
 99%|█████████▊| 366522/371472 [7:00:07<22:23,  3.69it/s]
 99%|█████████▊| 366523/371472 [7:00:07<21:55,  3.76it/s]
 99%|█████████▊| 366524/371472 [7:00:07<21:49,  3.78it/s]
 99%|█████████▊| 366525/371472 [7:00:08<22:20,  3.69it/s]
 99%|█████████▊| 366526/371472 [7:00:08<21:33,  3.82it/s]
 99%|█████████▊| 366527/371472 [7:00:08<21:50,  3.77it/s]
 99%|█████████▊| 366528/371472 [7:00:09<23:19,  3.53it/s]
 99%|█████████▊| 366529/371472 [7:00:09<22:51,  3.60it/s]
 99%|█████████▊| 366530/371472 [7:00:09<21:59,  3.74it/s]
 99%|█████████▊| 366531/371472 [7:00:09<22:00,  3.74it/s]
 99%|█████████▊| 366532/371472 [7:00:10<23:38,  3.48it/s]
 99%|█████████▊| 366533/371472 [7:00:10<23:35,  3.49it/s]
 99%|█████████▊| 366534/371472 [7:00:10<24:31,  3.36it/s]
 99%|█████████▊| 366535/371472 [7:00:11<24:10,  3.40it/s]
 99%|█████████▊| 366536/371472 [7:00:11<23:43,  3.47it/s]
 99%|█████████▊| 366537/371472 [7:00:11<22:46,  3.61it/s]
 99%|█████████▊| 366538/371472 [7:00:11<23:07,  3.56it/s]
 99%|█████████▊| 366539/371472 [7:00:12<24:50,  3.31it/s]
 99%|█████████▊| 366540/371472 [7:00:12<24:00,  3.42it/s]
                                                         
{'loss': 2.5205, 'learning_rate': 1.1195565515309526e-07, 'epoch': 15.79}

 99%|█████████▊| 366540/371472 [7:00:12<24:00,  3.42it/s]
 99%|█████████▊| 366541/371472 [7:00:12<27:57,  2.94it/s]
 99%|█████████▊| 366542/371472 [7:00:13<26:01,  3.16it/s]
 99%|█████████▊| 366543/371472 [7:00:13<24:23,  3.37it/s]
 99%|█████████▊| 366544/371472 [7:00:13<23:50,  3.45it/s]
 99%|█████████▊| 366545/371472 [7:00:14<23:32,  3.49it/s]
 99%|█████████▊| 366546/371472 [7:00:14<23:30,  3.49it/s]
 99%|█████████▊| 366547/371472 [7:00:14<23:24,  3.51it/s]
 99%|█████████▊| 366548/371472 [7:00:14<23:05,  3.55it/s]
 99%|█████████▊| 366549/371472 [7:00:15<23:09,  3.54it/s]
 99%|█████████▊| 366550/371472 [7:00:15<23:09,  3.54it/s]
 99%|█████████▊| 366551/371472 [7:00:15<22:44,  3.61it/s]
 99%|█████████▊| 366552/371472 [7:00:16<23:00,  3.56it/s]
 99%|█████████▊| 366553/371472 [7:00:16<24:59,  3.28it/s]
 99%|█████████▊| 366554/371472 [7:00:16<25:05,  3.27it/s]
 99%|█████████▊| 366555/371472 [7:00:16<23:30,  3.49it/s]
 99%|█████████▊| 366556/371472 [7:00:17<22:58,  3.57it/s]
 99%|█████████▊| 366557/371472 [7:00:17<22:35,  3.62it/s]
 99%|█████████▊| 366558/371472 [7:00:17<24:15,  3.38it/s]
 99%|█████████▊| 366559/371472 [7:00:18<22:41,  3.61it/s]
 99%|█████████▊| 366560/371472 [7:00:18<22:17,  3.67it/s]
                                                         
{'loss': 2.6014, 'learning_rate': 1.119071731776164e-07, 'epoch': 15.79}

 99%|█████████▊| 366560/371472 [7:00:18<22:17,  3.67it/s]
 99%|█████████▊| 366561/371472 [7:00:18<23:59,  3.41it/s]
 99%|█████████▊| 366562/371472 [7:00:18<23:05,  3.54it/s]
 99%|█████████▊| 366563/371472 [7:00:19<24:55,  3.28it/s]
 99%|█████████▊| 366564/371472 [7:00:19<25:23,  3.22it/s]
 99%|█████████▊| 366565/371472 [7:00:19<24:45,  3.30it/s]
 99%|█████████▊| 366566/371472 [7:00:20<23:21,  3.50it/s]
 99%|█████████▊| 366567/371472 [7:00:20<23:59,  3.41it/s]
 99%|█████████▊| 366568/371472 [7:00:20<23:35,  3.46it/s]
 99%|█████████▊| 366569/371472 [7:00:20<23:14,  3.52it/s]
 99%|█████████▊| 366570/371472 [7:00:21<24:44,  3.30it/s]
 99%|█████████▊| 366571/371472 [7:00:21<23:51,  3.42it/s]
 99%|█████████▊| 366572/371472 [7:00:21<22:52,  3.57it/s]
 99%|█████████▊| 366573/371472 [7:00:22<23:51,  3.42it/s]
 99%|█████████▊| 366574/371472 [7:00:22<24:09,  3.38it/s]
 99%|█████████▊| 366575/371472 [7:00:22<23:25,  3.48it/s]
 99%|█████████▊| 366576/371472 [7:00:22<22:57,  3.55it/s]
 99%|█████████▊| 366577/371472 [7:00:23<22:27,  3.63it/s]
 99%|█████████▊| 366578/371472 [7:00:23<23:56,  3.41it/s]
 99%|█████████▊| 366579/371472 [7:00:23<23:12,  3.51it/s]
 99%|█████████▊| 366580/371472 [7:00:24<22:42,  3.59it/s]
                                                         
{'loss': 2.6644, 'learning_rate': 1.1185869120213746e-07, 'epoch': 15.79}

 99%|█████████▊| 366580/371472 [7:00:24<22:42,  3.59it/s]
 99%|█████████▊| 366581/371472 [7:00:24<22:12,  3.67it/s]
 99%|█████████▊| 366582/371472 [7:00:24<22:40,  3.60it/s]
 99%|█████████▊| 366583/371472 [7:00:24<21:58,  3.71it/s]
 99%|█████████▊| 366584/371472 [7:00:25<22:08,  3.68it/s]
 99%|█████████▊| 366585/371472 [7:00:25<22:39,  3.59it/s]
 99%|█████████▊| 366586/371472 [7:00:25<22:09,  3.68it/s]
 99%|█████████▊| 366587/371472 [7:00:26<22:43,  3.58it/s]
 99%|█████████▊| 366588/371472 [7:00:26<22:45,  3.58it/s]
 99%|█████████▊| 366589/371472 [7:00:26<22:28,  3.62it/s]
 99%|█████████▊| 366590/371472 [7:00:26<23:10,  3.51it/s]
 99%|█████████▊| 366591/371472 [7:00:27<23:19,  3.49it/s]
 99%|█████████▊| 366592/371472 [7:00:27<23:30,  3.46it/s]
 99%|█████████▊| 366593/371472 [7:00:27<23:28,  3.46it/s]
 99%|█████████▊| 366594/371472 [7:00:28<22:39,  3.59it/s]
 99%|█████████▊| 366595/371472 [7:00:28<22:10,  3.67it/s]
 99%|█████████▊| 366596/371472 [7:00:28<22:42,  3.58it/s]
 99%|█████████▊| 366597/371472 [7:00:28<23:41,  3.43it/s]
 99%|█████████▊| 366598/371472 [7:00:29<22:53,  3.55it/s]
 99%|█████████▊| 366599/371472 [7:00:29<22:32,  3.60it/s]
 99%|█████████▊| 366600/371472 [7:00:29<21:50,  3.72it/s]
                                                         
{'loss': 2.4946, 'learning_rate': 1.1181020922665863e-07, 'epoch': 15.79}

 99%|█████████▊| 366600/371472 [7:00:29<21:50,  3.72it/s]
 99%|█████████▊| 366601/371472 [7:00:30<25:41,  3.16it/s]
 99%|█████████▊| 366602/371472 [7:00:30<25:09,  3.23it/s]
 99%|█████████▊| 366603/371472 [7:00:30<23:59,  3.38it/s]
 99%|█████████▊| 366604/371472 [7:00:30<22:55,  3.54it/s]
 99%|█████████▊| 366605/371472 [7:00:31<22:12,  3.65it/s]
 99%|█████████▊| 366606/371472 [7:00:31<22:34,  3.59it/s]
 99%|█████████▊| 366607/371472 [7:00:31<22:23,  3.62it/s]
 99%|█████████▊| 366608/371472 [7:00:31<22:05,  3.67it/s]
 99%|█████████▊| 366609/371472 [7:00:32<21:31,  3.77it/s]
 99%|█████████▊| 366610/371472 [7:00:32<22:40,  3.57it/s]
 99%|█████████▊| 366611/371472 [7:00:32<21:48,  3.72it/s]
 99%|█████████▊| 366612/371472 [7:00:33<21:16,  3.81it/s]
 99%|█████████▊| 366613/371472 [7:00:33<21:35,  3.75it/s]
 99%|█████████▊| 366614/371472 [7:00:33<21:48,  3.71it/s]
 99%|█████████▊| 366615/371472 [7:00:33<21:37,  3.74it/s]
 99%|█████████▊| 366616/371472 [7:00:34<20:51,  3.88it/s]
 99%|█████████▊| 366617/371472 [7:00:34<21:16,  3.80it/s]
 99%|█████████▊| 366618/371472 [7:00:34<21:01,  3.85it/s]
 99%|█████████▊| 366619/371472 [7:00:34<20:48,  3.89it/s]
 99%|█████████▊| 366620/371472 [7:00:35<21:55,  3.69it/s]
                                                         
{'loss': 2.5698, 'learning_rate': 1.1176172725117969e-07, 'epoch': 15.79}

 99%|█████████▊| 366620/371472 [7:00:35<21:55,  3.69it/s]
 99%|█████████▊| 366621/371472 [7:00:35<21:23,  3.78it/s]
 99%|█████████▊| 366622/371472 [7:00:35<20:57,  3.86it/s]
 99%|█████████▊| 366623/371472 [7:00:35<20:32,  3.93it/s]
 99%|█████████▊| 366624/371472 [7:00:36<20:26,  3.95it/s]
 99%|█████████▊| 366625/371472 [7:00:36<22:11,  3.64it/s]
 99%|█████████▊| 366626/371472 [7:00:36<22:13,  3.63it/s]
 99%|█████████▊| 366627/371472 [7:00:37<22:22,  3.61it/s]
 99%|█████████▊| 366628/371472 [7:00:37<21:38,  3.73it/s]
 99%|█████████▊| 366629/371472 [7:00:37<22:59,  3.51it/s]
 99%|█████████▊| 366630/371472 [7:00:37<22:52,  3.53it/s]
 99%|█████████▊| 366631/371472 [7:00:38<22:12,  3.63it/s]
 99%|█████████▊| 366632/371472 [7:00:38<22:12,  3.63it/s]
 99%|█████████▊| 366633/371472 [7:00:38<22:03,  3.66it/s]
 99%|█████████▊| 366634/371472 [7:00:39<22:43,  3.55it/s]
 99%|█████████▊| 366635/371472 [7:00:39<22:35,  3.57it/s]
 99%|█████████▊| 366636/371472 [7:00:39<21:53,  3.68it/s]
 99%|█████████▊| 366637/371472 [7:00:39<22:20,  3.61it/s]
 99%|█████████▊| 366638/371472 [7:00:40<21:21,  3.77it/s]
 99%|█████████▊| 366639/371472 [7:00:40<21:49,  3.69it/s]
 99%|█████████▊| 366640/371472 [7:00:40<21:55,  3.67it/s]
                                                         
{'loss': 2.7821, 'learning_rate': 1.1171324527570084e-07, 'epoch': 15.79}

 99%|█████████▊| 366640/371472 [7:00:40<21:55,  3.67it/s]
 99%|█████████▊| 366641/371472 [7:00:40<22:44,  3.54it/s]
 99%|█████████▊| 366642/371472 [7:00:41<22:26,  3.59it/s]
 99%|█████████▊| 366643/371472 [7:00:41<22:44,  3.54it/s]
 99%|█████████▊| 366644/371472 [7:00:41<22:25,  3.59it/s]
 99%|█████████▊| 366645/371472 [7:00:42<22:43,  3.54it/s]
 99%|█████████▊| 366646/371472 [7:00:42<23:25,  3.43it/s]
 99%|█████████▊| 366647/371472 [7:00:42<22:47,  3.53it/s]
 99%|█████████▊| 366648/371472 [7:00:42<23:13,  3.46it/s]
 99%|█████████▊| 366649/371472 [7:00:43<22:23,  3.59it/s]
 99%|█████████▊| 366650/371472 [7:00:43<23:08,  3.47it/s]
 99%|█████████▊| 366651/371472 [7:00:43<22:36,  3.55it/s]
 99%|█████████▊| 366652/371472 [7:00:44<22:33,  3.56it/s]
 99%|█████████▊| 366653/371472 [7:00:44<22:00,  3.65it/s]
 99%|█████████▊| 366654/371472 [7:00:44<21:59,  3.65it/s]
 99%|█████████▊| 366655/371472 [7:00:44<21:28,  3.74it/s]
 99%|█████████▊| 366656/371472 [7:00:45<21:15,  3.77it/s]
 99%|█████████▊| 366657/371472 [7:00:45<21:36,  3.71it/s]
 99%|█████████▊| 366658/371472 [7:00:45<21:38,  3.71it/s]
 99%|█████████▊| 366659/371472 [7:00:45<21:11,  3.79it/s]
 99%|█████████▊| 366660/371472 [7:00:46<20:34,  3.90it/s]
                                                         
{'loss': 2.5324, 'learning_rate': 1.116647633002219e-07, 'epoch': 15.79}

 99%|█████████▊| 366660/371472 [7:00:46<20:34,  3.90it/s]
 99%|█████████▊| 366661/371472 [7:00:46<20:40,  3.88it/s]
 99%|█████████▊| 366662/371472 [7:00:46<21:36,  3.71it/s]
 99%|█████████▊| 366663/371472 [7:00:46<22:13,  3.61it/s]
 99%|█████████▊| 366664/371472 [7:00:47<21:55,  3.65it/s]
 99%|█████████▊| 366665/371472 [7:00:47<22:19,  3.59it/s]
 99%|█████████▊| 366666/371472 [7:00:47<21:59,  3.64it/s]
 99%|█████████▊| 366667/371472 [7:00:48<22:07,  3.62it/s]
 99%|█████████▊| 366668/371472 [7:00:48<23:09,  3.46it/s]
 99%|█████████▊| 366669/371472 [7:00:48<22:39,  3.53it/s]
 99%|█████████▊| 366670/371472 [7:00:48<21:53,  3.66it/s]
 99%|█████████▊| 366671/371472 [7:00:49<21:36,  3.70it/s]
 99%|█████████▊| 366672/371472 [7:00:49<21:22,  3.74it/s]
 99%|█████████▊| 366673/371472 [7:00:49<22:02,  3.63it/s]
 99%|█████████▊| 366674/371472 [7:00:49<21:39,  3.69it/s]
 99%|█████████▊| 366675/371472 [7:00:50<21:42,  3.68it/s]
 99%|█████████▊| 366676/371472 [7:00:50<21:13,  3.77it/s]
 99%|█████████▊| 366677/371472 [7:00:50<21:23,  3.74it/s]
 99%|█████████▊| 366678/371472 [7:00:51<21:29,  3.72it/s]
 99%|█████████▊| 366679/371472 [7:00:51<23:49,  3.35it/s]
 99%|█████████▊| 366680/371472 [7:00:51<22:48,  3.50it/s]
                                                         
{'loss': 2.6013, 'learning_rate': 1.1161628132474306e-07, 'epoch': 15.79}

 99%|█████████▊| 366680/371472 [7:00:51<22:48,  3.50it/s]
 99%|█████████▊| 366681/371472 [7:00:51<22:42,  3.52it/s]
 99%|█████████▊| 366682/371472 [7:00:52<21:44,  3.67it/s]
 99%|█████████▊| 366683/371472 [7:00:52<22:10,  3.60it/s]
 99%|█████████▊| 366684/371472 [7:00:52<21:32,  3.70it/s]
 99%|█████████▊| 366685/371472 [7:00:53<21:51,  3.65it/s]
 99%|█████████▊| 366686/371472 [7:00:53<21:52,  3.65it/s]
 99%|█████████▊| 366687/371472 [7:00:53<23:07,  3.45it/s]
 99%|█████████▊| 366688/371472 [7:00:53<22:11,  3.59it/s]
 99%|█████████▊| 366689/371472 [7:00:54<24:17,  3.28it/s]
 99%|█████████▊| 366690/371472 [7:00:54<23:33,  3.38it/s]
 99%|█████████▊| 366691/371472 [7:00:54<23:03,  3.45it/s]
 99%|█████████▊| 366692/371472 [7:00:55<23:13,  3.43it/s]
 99%|█████████▊| 366693/371472 [7:00:55<22:18,  3.57it/s]
 99%|█████████▊| 366694/371472 [7:00:55<21:40,  3.67it/s]
 99%|█████████▊| 366695/371472 [7:00:55<23:05,  3.45it/s]
 99%|█████████▊| 366696/371472 [7:00:56<23:41,  3.36it/s]
 99%|█████████▊| 366697/371472 [7:00:56<22:26,  3.55it/s]
 99%|█████████▊| 366698/371472 [7:00:56<23:07,  3.44it/s]
 99%|█████████▊| 366699/371472 [7:00:57<23:03,  3.45it/s]
 99%|█████████▊| 366700/371472 [7:00:57<22:44,  3.50it/s]
                                                         
{'loss': 2.5211, 'learning_rate': 1.1156779934926412e-07, 'epoch': 15.79}

 99%|█████████▊| 366700/371472 [7:00:57<22:44,  3.50it/s]
 99%|█████████▊| 366701/371472 [7:00:57<22:38,  3.51it/s]
 99%|█████████▊| 366702/371472 [7:00:57<22:40,  3.51it/s]
 99%|█████████▊| 366703/371472 [7:00:58<21:57,  3.62it/s]
 99%|█████████▊| 366704/371472 [7:00:58<24:39,  3.22it/s]
 99%|█████████▊| 366705/371472 [7:00:58<25:28,  3.12it/s]
 99%|█████████▊| 366706/371472 [7:00:59<25:25,  3.12it/s]
 99%|█████████▊| 366707/371472 [7:00:59<23:48,  3.34it/s]
 99%|█████████▊| 366708/371472 [7:00:59<22:48,  3.48it/s]
 99%|█████████▊| 366709/371472 [7:01:00<22:33,  3.52it/s]
 99%|█████████▊| 366710/371472 [7:01:00<23:15,  3.41it/s]
 99%|█████████▊| 366711/371472 [7:01:00<23:34,  3.36it/s]
 99%|█████████▊| 366712/371472 [7:01:00<22:04,  3.59it/s]
 99%|█████████▊| 366713/371472 [7:01:01<21:10,  3.74it/s]
 99%|█████████▊| 366714/371472 [7:01:01<21:06,  3.76it/s]
 99%|█████████▊| 366715/371472 [7:01:01<20:28,  3.87it/s]
 99%|█████████▊| 366716/371472 [7:01:01<21:01,  3.77it/s]
 99%|█████████▊| 366717/371472 [7:01:02<22:13,  3.57it/s]
 99%|█████████▊| 366718/371472 [7:01:02<22:22,  3.54it/s]
 99%|█████████▊| 366719/371472 [7:01:02<22:20,  3.55it/s]
 99%|█████████▊| 366720/371472 [7:01:03<21:14,  3.73it/s]
                                                         
{'loss': 2.741, 'learning_rate': 1.1151931737378527e-07, 'epoch': 15.8}

 99%|█████████▊| 366720/371472 [7:01:03<21:14,  3.73it/s]
 99%|█████████▊| 366721/371472 [7:01:03<24:25,  3.24it/s]
 99%|█████████▊| 366722/371472 [7:01:03<23:09,  3.42it/s]
 99%|█████████▊| 366723/371472 [7:01:03<22:12,  3.56it/s]
 99%|█████████▊| 366724/371472 [7:01:04<21:49,  3.63it/s]
 99%|█████████▊| 366725/371472 [7:01:04<22:08,  3.57it/s]
 99%|█████████▊| 366726/371472 [7:01:04<21:39,  3.65it/s]
 99%|█████████▊| 366727/371472 [7:01:05<22:18,  3.54it/s]
 99%|█████████▊| 366728/371472 [7:01:05<22:22,  3.53it/s]
 99%|█████████▊| 366729/371472 [7:01:05<22:25,  3.52it/s]
 99%|█████████▊| 366730/371472 [7:01:05<23:18,  3.39it/s]
 99%|█████████▊| 366731/371472 [7:01:06<22:10,  3.56it/s]
 99%|█████████▊| 366732/371472 [7:01:06<21:59,  3.59it/s]
 99%|█████████▊| 366733/371472 [7:01:06<21:40,  3.64it/s]
 99%|█████████▊| 366734/371472 [7:01:06<20:57,  3.77it/s]
 99%|█████████▊| 366735/371472 [7:01:07<22:25,  3.52it/s]
 99%|█████████▊| 366736/371472 [7:01:07<22:08,  3.57it/s]
 99%|█████████▊| 366737/371472 [7:01:07<21:49,  3.62it/s]
 99%|█████████▊| 366738/371472 [7:01:08<21:12,  3.72it/s]
 99%|█████████▊| 366739/371472 [7:01:08<20:48,  3.79it/s]
 99%|█████████▊| 366740/371472 [7:01:08<20:44,  3.80it/s]
                                                         
{'loss': 2.6795, 'learning_rate': 1.1147083539830633e-07, 'epoch': 15.8}

 99%|█████████▊| 366740/371472 [7:01:08<20:44,  3.80it/s]
 99%|█████████▊| 366741/371472 [7:01:08<21:51,  3.61it/s]
 99%|█████████▊| 366742/371472 [7:01:09<20:50,  3.78it/s]
 99%|█████████▊| 366743/371472 [7:01:09<20:17,  3.88it/s]
 99%|█████████▊| 366744/371472 [7:01:09<20:12,  3.90it/s]
 99%|█████████▊| 366745/371472 [7:01:09<21:09,  3.72it/s]
 99%|█████████▊| 366746/371472 [7:01:10<22:04,  3.57it/s]
 99%|█████████▊| 366747/371472 [7:01:10<23:59,  3.28it/s]
 99%|█████████▊| 366748/371472 [7:01:10<23:03,  3.41it/s]
 99%|█████████▊| 366749/371472 [7:01:11<22:30,  3.50it/s]
 99%|█████████▊| 366750/371472 [7:01:11<21:21,  3.68it/s]
 99%|█████████▊| 366751/371472 [7:01:11<21:23,  3.68it/s]
 99%|█████████▊| 366752/371472 [7:01:11<20:57,  3.75it/s]
 99%|█████████▊| 366753/371472 [7:01:12<20:46,  3.78it/s]
 99%|█████████▊| 366754/371472 [7:01:12<20:18,  3.87it/s]
 99%|█████████▊| 366755/371472 [7:01:12<21:46,  3.61it/s]
 99%|█████████▊| 366756/371472 [7:01:13<22:04,  3.56it/s]
 99%|█████████▊| 366757/371472 [7:01:13<21:50,  3.60it/s]
 99%|█████████▊| 366758/371472 [7:01:13<22:18,  3.52it/s]
 99%|█████████▊| 366759/371472 [7:01:13<22:54,  3.43it/s]
 99%|█████████▊| 366760/371472 [7:01:14<24:08,  3.25it/s]
                                                         
{'loss': 2.4631, 'learning_rate': 1.1142235342282749e-07, 'epoch': 15.8}

 99%|█████████▊| 366760/371472 [7:01:14<24:08,  3.25it/s]
 99%|█████████▊| 366761/371472 [7:01:14<23:45,  3.30it/s]
 99%|█████████▊| 366762/371472 [7:01:14<23:50,  3.29it/s]
 99%|█████████▊| 366763/371472 [7:01:15<23:33,  3.33it/s]
 99%|█████████▊| 366764/371472 [7:01:15<22:10,  3.54it/s]
 99%|█████████▊| 366765/371472 [7:01:15<22:25,  3.50it/s]
 99%|█████████▊| 366766/371472 [7:01:16<23:58,  3.27it/s]
 99%|█████████▊| 366767/371472 [7:01:16<24:39,  3.18it/s]
 99%|█████████▊| 366768/371472 [7:01:16<24:06,  3.25it/s]
 99%|█████████▊| 366769/371472 [7:01:16<22:21,  3.51it/s]
 99%|█████████▊| 366770/371472 [7:01:17<22:01,  3.56it/s]
 99%|█████████▊| 366771/371472 [7:01:17<21:50,  3.59it/s]
 99%|█████████▊| 366772/371472 [7:01:17<22:26,  3.49it/s]
 99%|█████████▊| 366773/371472 [7:01:18<22:21,  3.50it/s]
 99%|█████████▊| 366774/371472 [7:01:18<23:02,  3.40it/s]
 99%|█████████▊| 366775/371472 [7:01:18<22:25,  3.49it/s]
 99%|█████████▊| 366776/371472 [7:01:18<23:52,  3.28it/s]
 99%|█████████▊| 366777/371472 [7:01:19<22:59,  3.40it/s]
 99%|█████████▊| 366778/371472 [7:01:19<22:28,  3.48it/s]
 99%|█████████▊| 366779/371472 [7:01:19<23:05,  3.39it/s]
 99%|█████████▊| 366780/371472 [7:01:20<21:44,  3.60it/s]
                                                         
{'loss': 2.5864, 'learning_rate': 1.1137387144734855e-07, 'epoch': 15.8}

 99%|█████████▊| 366780/371472 [7:01:20<21:44,  3.60it/s]
 99%|█████████▊| 366781/371472 [7:01:20<21:41,  3.61it/s]
 99%|█████████▊| 366782/371472 [7:01:20<22:15,  3.51it/s]
 99%|█████████▊| 366783/371472 [7:01:20<22:06,  3.53it/s]
 99%|█████████▊| 366784/371472 [7:01:21<22:32,  3.47it/s]
 99%|█████████▊| 366785/371472 [7:01:21<23:12,  3.37it/s]
 99%|█████████▊| 366786/371472 [7:01:21<23:00,  3.39it/s]
 99%|█████████▊| 366787/371472 [7:01:22<22:44,  3.43it/s]
 99%|█████████▊| 366788/371472 [7:01:22<22:34,  3.46it/s]
 99%|█████████▊| 366789/371472 [7:01:22<21:14,  3.68it/s]
 99%|█████████▊| 366790/371472 [7:01:22<20:59,  3.72it/s]
 99%|█████████▊| 366791/371472 [7:01:23<21:49,  3.57it/s]
 99%|█████████▊| 366792/371472 [7:01:23<21:56,  3.55it/s]
 99%|█████████▊| 366793/371472 [7:01:23<21:32,  3.62it/s]
 99%|█████████▊| 366794/371472 [7:01:23<21:10,  3.68it/s]
 99%|█████████▊| 366795/371472 [7:01:24<20:53,  3.73it/s]
 99%|█████████▊| 366796/371472 [7:01:24<21:10,  3.68it/s]
 99%|█████████▊| 366797/371472 [7:01:24<21:08,  3.68it/s]
 99%|█████████▊| 366798/371472 [7:01:25<21:01,  3.71it/s]
 99%|█████████▊| 366799/371472 [7:01:25<22:15,  3.50it/s]
 99%|█████████▊| 366800/371472 [7:01:25<22:02,  3.53it/s]
                                                         
{'loss': 2.6844, 'learning_rate': 1.113253894718697e-07, 'epoch': 15.8}

 99%|█████████▊| 366800/371472 [7:01:25<22:02,  3.53it/s]
 99%|█████████▊| 366801/371472 [7:01:25<21:10,  3.68it/s]
 99%|█████████▊| 366802/371472 [7:01:26<20:43,  3.76it/s]
 99%|█████████▊| 366803/371472 [7:01:26<20:25,  3.81it/s]
 99%|█████████▊| 366804/371472 [7:01:26<20:41,  3.76it/s]
 99%|█████████▊| 366805/371472 [7:01:27<26:05,  2.98it/s]
 99%|█████████▊| 366806/371472 [7:01:27<24:32,  3.17it/s]
 99%|█████████▊| 366807/371472 [7:01:27<24:01,  3.24it/s]
 99%|█████████▊| 366808/371472 [7:01:27<22:31,  3.45it/s]
 99%|█████████▊| 366809/371472 [7:01:28<21:09,  3.67it/s]
 99%|█████████▊| 366810/371472 [7:01:28<21:15,  3.66it/s]
 99%|█████████▊| 366811/371472 [7:01:28<22:26,  3.46it/s]
 99%|█████████▊| 366812/371472 [7:01:29<22:43,  3.42it/s]
 99%|█████████▊| 366813/371472 [7:01:29<21:47,  3.56it/s]
 99%|█████████▊| 366814/371472 [7:01:29<22:05,  3.51it/s]
 99%|█████████▊| 366815/371472 [7:01:29<21:59,  3.53it/s]
 99%|█████████▊| 366816/371472 [7:01:30<21:45,  3.57it/s]
 99%|█████████▊| 366817/371472 [7:01:30<24:42,  3.14it/s]
 99%|█████████▊| 366818/371472 [7:01:30<23:28,  3.30it/s]
 99%|█████████▊| 366819/371472 [7:01:31<25:06,  3.09it/s]
 99%|█████████▊| 366820/371472 [7:01:31<23:49,  3.25it/s]
                                                         
{'loss': 2.6174, 'learning_rate': 1.1127690749639076e-07, 'epoch': 15.8}

 99%|█████████▊| 366820/371472 [7:01:31<23:49,  3.25it/s]
 99%|█████████▊| 366821/371472 [7:01:31<22:26,  3.45it/s]
 99%|█████████▊| 366822/371472 [7:01:32<23:25,  3.31it/s]
 99%|█████████▊| 366823/371472 [7:01:32<22:50,  3.39it/s]
 99%|█████████▊| 366824/371472 [7:01:32<22:29,  3.44it/s]
 99%|█████████▊| 366825/371472 [7:01:32<21:53,  3.54it/s]
 99%|█████████▊| 366826/371472 [7:01:33<21:12,  3.65it/s]
 99%|█████████▊| 366827/371472 [7:01:33<20:41,  3.74it/s]
 99%|█████████▊| 366828/371472 [7:01:33<22:07,  3.50it/s]
 99%|█████████▉| 366829/371472 [7:01:34<21:36,  3.58it/s]
 99%|█████████▉| 366830/371472 [7:01:34<24:23,  3.17it/s]
 99%|█████████▉| 366831/371472 [7:01:34<23:10,  3.34it/s]
 99%|█████████▉| 366832/371472 [7:01:35<26:12,  2.95it/s]
 99%|█████████▉| 366833/371472 [7:01:35<25:05,  3.08it/s]
 99%|█████████▉| 366834/371472 [7:01:35<24:40,  3.13it/s]
 99%|█████████▉| 366835/371472 [7:01:35<23:15,  3.32it/s]
 99%|█████████▉| 366836/371472 [7:01:36<22:30,  3.43it/s]
 99%|█████████▉| 366837/371472 [7:01:36<22:17,  3.46it/s]
 99%|█████████▉| 366838/371472 [7:01:36<21:54,  3.52it/s]
 99%|█████████▉| 366839/371472 [7:01:37<22:07,  3.49it/s]
 99%|█████████▉| 366840/371472 [7:01:37<22:41,  3.40it/s]
                                                         
{'loss': 2.6589, 'learning_rate': 1.1122842552091192e-07, 'epoch': 15.8}

 99%|█████████▉| 366840/371472 [7:01:37<22:41,  3.40it/s]
 99%|█████████▉| 366841/371472 [7:01:37<22:36,  3.41it/s]
 99%|█████████▉| 366842/371472 [7:01:37<21:51,  3.53it/s]
 99%|█████████▉| 366843/371472 [7:01:38<21:11,  3.64it/s]
 99%|█████████▉| 366844/371472 [7:01:38<21:26,  3.60it/s]
 99%|█████████▉| 366845/371472 [7:01:38<20:42,  3.72it/s]
 99%|█████████▉| 366846/371472 [7:01:39<20:37,  3.74it/s]
 99%|█████████▉| 366847/371472 [7:01:39<26:56,  2.86it/s]
 99%|█████████▉| 366848/371472 [7:01:39<24:19,  3.17it/s]
 99%|█████████▉| 366849/371472 [7:01:40<22:59,  3.35it/s]
 99%|█████████▉| 366850/371472 [7:01:40<24:28,  3.15it/s]
 99%|█████████▉| 366851/371472 [7:01:40<25:07,  3.06it/s]
 99%|█████████▉| 366852/371472 [7:01:41<23:54,  3.22it/s]
 99%|█████████▉| 366853/371472 [7:01:41<22:45,  3.38it/s]
 99%|█████████▉| 366854/371472 [7:01:41<21:50,  3.52it/s]
 99%|█████████▉| 366855/371472 [7:01:41<21:12,  3.63it/s]
 99%|█████████▉| 366856/371472 [7:01:42<22:15,  3.46it/s]
 99%|█████████▉| 366857/371472 [7:01:42<22:33,  3.41it/s]
 99%|█████████▉| 366858/371472 [7:01:42<21:39,  3.55it/s]
 99%|█████████▉| 366859/371472 [7:01:42<20:53,  3.68it/s]
 99%|█████████▉| 366860/371472 [7:01:43<20:30,  3.75it/s]
                                                         
{'loss': 2.6067, 'learning_rate': 1.1117994354543297e-07, 'epoch': 15.8}

 99%|█████████▉| 366860/371472 [7:01:43<20:30,  3.75it/s]
 99%|█████████▉| 366861/371472 [7:01:43<20:16,  3.79it/s]
 99%|█████████▉| 366862/371472 [7:01:43<20:40,  3.72it/s]
 99%|█████████▉| 366863/371472 [7:01:43<19:55,  3.86it/s]
 99%|█████████▉| 366864/371472 [7:01:44<20:09,  3.81it/s]
 99%|█████████▉| 366865/371472 [7:01:44<20:59,  3.66it/s]
 99%|█████████▉| 366866/371472 [7:01:44<22:32,  3.40it/s]
 99%|█████████▉| 366867/371472 [7:01:45<22:20,  3.44it/s]
 99%|█████████▉| 366868/371472 [7:01:45<21:33,  3.56it/s]
 99%|█████████▉| 366869/371472 [7:01:45<22:36,  3.39it/s]
 99%|█████████▉| 366870/371472 [7:01:46<21:51,  3.51it/s]
 99%|█████████▉| 366871/371472 [7:01:46<21:59,  3.49it/s]
 99%|█████████▉| 366872/371472 [7:01:46<23:50,  3.22it/s]
 99%|█████████▉| 366873/371472 [7:01:46<22:52,  3.35it/s]
 99%|█████████▉| 366874/371472 [7:01:47<22:19,  3.43it/s]
 99%|█████████▉| 366875/371472 [7:01:47<22:16,  3.44it/s]
 99%|█████████▉| 366876/371472 [7:01:47<21:27,  3.57it/s]
 99%|█████████▉| 366877/371472 [7:01:48<21:55,  3.49it/s]
 99%|█████████▉| 366878/371472 [7:01:48<21:35,  3.55it/s]
 99%|█████████▉| 366879/371472 [7:01:48<20:51,  3.67it/s]
 99%|█████████▉| 366880/371472 [7:01:48<20:58,  3.65it/s]
                                                         
{'loss': 2.4082, 'learning_rate': 1.1113146156995413e-07, 'epoch': 15.8}

 99%|█████████▉| 366880/371472 [7:01:48<20:58,  3.65it/s]
 99%|█████████▉| 366881/371472 [7:01:49<20:28,  3.74it/s]
 99%|█████████▉| 366882/371472 [7:01:49<20:13,  3.78it/s]
 99%|█████████▉| 366883/371472 [7:01:49<21:03,  3.63it/s]
 99%|█████████▉| 366884/371472 [7:01:49<20:13,  3.78it/s]
 99%|█████████▉| 366885/371472 [7:01:50<20:05,  3.81it/s]
 99%|█████████▉| 366886/371472 [7:01:50<20:09,  3.79it/s]
 99%|█████████▉| 366887/371472 [7:01:50<21:16,  3.59it/s]
 99%|█████████▉| 366888/371472 [7:01:51<21:27,  3.56it/s]
 99%|█████████▉| 366889/371472 [7:01:51<20:56,  3.65it/s]
 99%|█████████▉| 366890/371472 [7:01:51<22:41,  3.37it/s]
 99%|█████████▉| 366891/371472 [7:01:51<22:20,  3.42it/s]
 99%|█████████▉| 366892/371472 [7:01:52<21:56,  3.48it/s]
 99%|█████████▉| 366893/371472 [7:01:52<22:36,  3.38it/s]
 99%|█████████▉| 366894/371472 [7:01:52<22:34,  3.38it/s]
 99%|█████████▉| 366895/371472 [7:01:53<22:04,  3.46it/s]
 99%|█████████▉| 366896/371472 [7:01:53<21:44,  3.51it/s]
 99%|█████████▉| 366897/371472 [7:01:53<22:00,  3.47it/s]
 99%|█████████▉| 366898/371472 [7:01:53<21:47,  3.50it/s]
 99%|█████████▉| 366899/371472 [7:01:54<23:20,  3.27it/s]
 99%|█████████▉| 366900/371472 [7:01:54<22:32,  3.38it/s]
                                                         
{'loss': 2.5794, 'learning_rate': 1.1108297959447519e-07, 'epoch': 15.8}

 99%|█████████▉| 366900/371472 [7:01:54<22:32,  3.38it/s]
 99%|█████████▉| 366901/371472 [7:01:54<21:45,  3.50it/s]
 99%|█████████▉| 366902/371472 [7:01:55<22:46,  3.34it/s]
 99%|█████████▉| 366903/371472 [7:01:55<22:00,  3.46it/s]
 99%|█████████▉| 366904/371472 [7:01:55<21:03,  3.62it/s]
 99%|█████████▉| 366905/371472 [7:01:55<20:21,  3.74it/s]
 99%|█████████▉| 366906/371472 [7:01:56<19:38,  3.88it/s]
 99%|█████████▉| 366907/371472 [7:01:56<21:21,  3.56it/s]
 99%|█████████▉| 366908/371472 [7:01:56<21:43,  3.50it/s]
 99%|█████████▉| 366909/371472 [7:01:57<21:22,  3.56it/s]
 99%|█████████▉| 366910/371472 [7:01:57<21:12,  3.58it/s]
 99%|█████████▉| 366911/371472 [7:01:57<21:35,  3.52it/s]
 99%|█████████▉| 366912/371472 [7:01:57<21:58,  3.46it/s]
 99%|█████████▉| 366913/371472 [7:01:58<21:17,  3.57it/s]
 99%|█████████▉| 366914/371472 [7:01:58<20:58,  3.62it/s]
 99%|█████████▉| 366915/371472 [7:01:58<21:12,  3.58it/s]
 99%|█████████▉| 366916/371472 [7:01:59<20:51,  3.64it/s]
 99%|█████████▉| 366917/371472 [7:01:59<21:07,  3.59it/s]
 99%|█████████▉| 366918/371472 [7:01:59<20:30,  3.70it/s]
 99%|█████████▉| 366919/371472 [7:01:59<19:47,  3.83it/s]
 99%|█████████▉| 366920/371472 [7:02:00<23:06,  3.28it/s]
                                                         
{'loss': 2.5175, 'learning_rate': 1.1103449761899634e-07, 'epoch': 15.8}

 99%|█████████▉| 366920/371472 [7:02:00<23:06,  3.28it/s]
 99%|█████████▉| 366921/371472 [7:02:00<22:04,  3.44it/s]
 99%|█████████▉| 366922/371472 [7:02:00<21:30,  3.53it/s]
 99%|█████████▉| 366923/371472 [7:02:00<20:47,  3.65it/s]
 99%|█████████▉| 366924/371472 [7:02:01<21:21,  3.55it/s]
 99%|█████████▉| 366925/371472 [7:02:01<21:43,  3.49it/s]
 99%|█████████▉| 366926/371472 [7:02:01<21:23,  3.54it/s]
 99%|█████████▉| 366927/371472 [7:02:02<22:34,  3.36it/s]
 99%|█████████▉| 366928/371472 [7:02:02<24:17,  3.12it/s]
 99%|█████████▉| 366929/371472 [7:02:02<23:31,  3.22it/s]
 99%|█████████▉| 366930/371472 [7:02:03<23:20,  3.24it/s]
 99%|█████████▉| 366931/371472 [7:02:03<22:15,  3.40it/s]
 99%|█████████▉| 366932/371472 [7:02:03<24:05,  3.14it/s]
 99%|█████████▉| 366933/371472 [7:02:04<22:24,  3.38it/s]
 99%|█████████▉| 366934/371472 [7:02:04<21:16,  3.56it/s]
 99%|█████████▉| 366935/371472 [7:02:04<21:09,  3.57it/s]
 99%|█████████▉| 366936/371472 [7:02:04<20:55,  3.61it/s]
 99%|█████████▉| 366937/371472 [7:02:05<20:02,  3.77it/s]
 99%|█████████▉| 366938/371472 [7:02:05<19:58,  3.78it/s]
 99%|█████████▉| 366939/371472 [7:02:05<19:50,  3.81it/s]
 99%|█████████▉| 366940/371472 [7:02:05<19:16,  3.92it/s]
                                                         
{'loss': 2.5756, 'learning_rate': 1.109860156435174e-07, 'epoch': 15.8}

 99%|█████████▉| 366940/371472 [7:02:05<19:16,  3.92it/s]
 99%|█████████▉| 366941/371472 [7:02:06<19:35,  3.85it/s]
 99%|█████████▉| 366942/371472 [7:02:06<19:20,  3.90it/s]
 99%|█████████▉| 366943/371472 [7:02:06<20:13,  3.73it/s]
 99%|█████████▉| 366944/371472 [7:02:06<19:50,  3.80it/s]
 99%|█████████▉| 366945/371472 [7:02:07<19:27,  3.88it/s]
 99%|█████████▉| 366946/371472 [7:02:07<19:38,  3.84it/s]
 99%|█████████▉| 366947/371472 [7:02:07<20:10,  3.74it/s]
 99%|█████████▉| 366948/371472 [7:02:07<20:00,  3.77it/s]
 99%|█████████▉| 366949/371472 [7:02:08<20:25,  3.69it/s]
 99%|█████████▉| 366950/371472 [7:02:08<19:50,  3.80it/s]
 99%|█████████▉| 366951/371472 [7:02:08<20:27,  3.68it/s]
 99%|█████████▉| 366952/371472 [7:02:09<20:33,  3.66it/s]
 99%|█████████▉| 366953/371472 [7:02:09<19:36,  3.84it/s]
 99%|█████████▉| 366954/371472 [7:02:09<20:49,  3.62it/s]
 99%|█████████▉| 366955/371472 [7:02:09<20:08,  3.74it/s]
 99%|█████████▉| 366956/371472 [7:02:10<19:57,  3.77it/s]
 99%|█████████▉| 366957/371472 [7:02:10<20:44,  3.63it/s]
 99%|█████████▉| 366958/371472 [7:02:10<20:53,  3.60it/s]
 99%|█████████▉| 366959/371472 [7:02:10<20:16,  3.71it/s]
 99%|█████████▉| 366960/371472 [7:02:11<20:03,  3.75it/s]
                                                         
{'loss': 2.5556, 'learning_rate': 1.1093753366803856e-07, 'epoch': 15.81}

 99%|█████████▉| 366960/371472 [7:02:11<20:03,  3.75it/s]
 99%|█████████▉| 366961/371472 [7:02:11<20:20,  3.69it/s]
 99%|█████████▉| 366962/371472 [7:02:11<20:53,  3.60it/s]
 99%|█████████▉| 366963/371472 [7:02:12<20:47,  3.61it/s]
 99%|█████████▉| 366964/371472 [7:02:12<20:24,  3.68it/s]
 99%|█████████▉| 366965/371472 [7:02:12<20:37,  3.64it/s]
 99%|█████████▉| 366966/371472 [7:02:12<21:47,  3.45it/s]
 99%|█████████▉| 366967/371472 [7:02:13<21:28,  3.50it/s]
 99%|█████████▉| 366968/371472 [7:02:13<22:40,  3.31it/s]
 99%|█████████▉| 366969/371472 [7:02:13<22:58,  3.27it/s]
 99%|█████████▉| 366970/371472 [7:02:14<22:51,  3.28it/s]
 99%|█████████▉| 366971/371472 [7:02:14<22:01,  3.41it/s]
 99%|█████████▉| 366972/371472 [7:02:14<22:09,  3.39it/s]
 99%|█████████▉| 366973/371472 [7:02:14<21:32,  3.48it/s]
 99%|█████████▉| 366974/371472 [7:02:15<20:44,  3.61it/s]
 99%|█████████▉| 366975/371472 [7:02:15<20:04,  3.73it/s]
 99%|█████████▉| 366976/371472 [7:02:15<20:39,  3.63it/s]
 99%|█████████▉| 366977/371472 [7:02:16<20:54,  3.58it/s]
 99%|█████████▉| 366978/371472 [7:02:16<21:33,  3.48it/s]
 99%|█████████▉| 366979/371472 [7:02:16<21:51,  3.42it/s]
 99%|█████████▉| 366980/371472 [7:02:16<21:49,  3.43it/s]
                                                         
{'loss': 2.442, 'learning_rate': 1.1088905169255962e-07, 'epoch': 15.81}

 99%|█████████▉| 366980/371472 [7:02:16<21:49,  3.43it/s]
 99%|█████████▉| 366981/371472 [7:02:17<21:45,  3.44it/s]
 99%|█████████▉| 366982/371472 [7:02:17<21:06,  3.54it/s]
 99%|█████████▉| 366983/371472 [7:02:17<20:58,  3.57it/s]
 99%|█████████▉| 366984/371472 [7:02:18<21:00,  3.56it/s]
 99%|█████████▉| 366985/371472 [7:02:18<21:07,  3.54it/s]
 99%|█████████▉| 366986/371472 [7:02:18<20:12,  3.70it/s]
 99%|█████████▉| 366987/371472 [7:02:18<19:49,  3.77it/s]
 99%|█████████▉| 366988/371472 [7:02:19<19:13,  3.89it/s]
 99%|█████████▉| 366989/371472 [7:02:19<20:09,  3.71it/s]
 99%|█████████▉| 366990/371472 [7:02:19<20:35,  3.63it/s]
 99%|█████████▉| 366991/371472 [7:02:19<20:28,  3.65it/s]
 99%|█████████▉| 366992/371472 [7:02:20<20:17,  3.68it/s]
 99%|█████████▉| 366993/371472 [7:02:20<20:03,  3.72it/s]
 99%|█████████▉| 366994/371472 [7:02:20<20:00,  3.73it/s]
 99%|█████████▉| 366995/371472 [7:02:20<19:31,  3.82it/s]
 99%|█████████▉| 366996/371472 [7:02:21<19:09,  3.89it/s]
 99%|█████████▉| 366997/371472 [7:02:21<19:18,  3.86it/s]
 99%|█████████▉| 366998/371472 [7:02:21<20:04,  3.71it/s]
 99%|█████████▉| 366999/371472 [7:02:22<20:16,  3.68it/s]
 99%|█████████▉| 367000/371472 [7:02:22<20:13,  3.69it/s]
                                                         
{'loss': 2.5211, 'learning_rate': 1.1084056971708077e-07, 'epoch': 15.81}

 99%|█████████▉| 367000/371472 [7:02:22<20:13,  3.69it/s]
 99%|█████████▉| 367001/371472 [7:02:22<21:04,  3.54it/s]
 99%|█████████▉| 367002/371472 [7:02:22<21:25,  3.48it/s]
 99%|█████████▉| 367003/371472 [7:02:23<20:50,  3.58it/s]
 99%|█████████▉| 367004/371472 [7:02:23<21:16,  3.50it/s]
 99%|█████████▉| 367005/371472 [7:02:23<20:53,  3.56it/s]
 99%|█████████▉| 367006/371472 [7:02:24<20:45,  3.59it/s]
 99%|█████████▉| 367007/371472 [7:02:24<20:11,  3.69it/s]
 99%|█████████▉| 367008/371472 [7:02:24<20:03,  3.71it/s]
 99%|█████████▉| 367009/371472 [7:02:24<20:27,  3.64it/s]
 99%|█████████▉| 367010/371472 [7:02:25<21:03,  3.53it/s]
 99%|█████████▉| 367011/371472 [7:02:25<20:11,  3.68it/s]
 99%|█████████▉| 367012/371472 [7:02:25<20:24,  3.64it/s]
 99%|█████████▉| 367013/371472 [7:02:25<20:14,  3.67it/s]
 99%|█████████▉| 367014/371472 [7:02:26<20:24,  3.64it/s]
 99%|█████████▉| 367015/371472 [7:02:26<19:38,  3.78it/s]
 99%|█████████▉| 367016/371472 [7:02:26<20:19,  3.65it/s]
 99%|█████████▉| 367017/371472 [7:02:27<20:03,  3.70it/s]
 99%|█████████▉| 367018/371472 [7:02:27<20:44,  3.58it/s]
 99%|█████████▉| 367019/371472 [7:02:27<20:36,  3.60it/s]
 99%|█████████▉| 367020/371472 [7:02:27<20:25,  3.63it/s]
                                                         
{'loss': 2.5588, 'learning_rate': 1.1079208774160183e-07, 'epoch': 15.81}

 99%|█████████▉| 367020/371472 [7:02:27<20:25,  3.63it/s]
 99%|█████████▉| 367021/371472 [7:02:28<20:16,  3.66it/s]
 99%|█████████▉| 367022/371472 [7:02:28<20:03,  3.70it/s]
 99%|█████████▉| 367023/371472 [7:02:28<19:46,  3.75it/s]
 99%|█████████▉| 367024/371472 [7:02:28<20:21,  3.64it/s]
 99%|█████████▉| 367025/371472 [7:02:29<20:05,  3.69it/s]
 99%|█████████▉| 367026/371472 [7:02:29<19:57,  3.71it/s]
 99%|█████████▉| 367027/371472 [7:02:29<21:40,  3.42it/s]
 99%|█████████▉| 367028/371472 [7:02:30<21:33,  3.44it/s]
 99%|█████████▉| 367029/371472 [7:02:30<21:07,  3.51it/s]
 99%|█████████▉| 367030/371472 [7:02:30<23:02,  3.21it/s]
 99%|█████████▉| 367031/371472 [7:02:30<21:56,  3.37it/s]
 99%|█████████▉| 367032/371472 [7:02:31<22:35,  3.27it/s]
 99%|█████████▉| 367033/371472 [7:02:31<22:19,  3.31it/s]
 99%|█████████▉| 367034/371472 [7:02:31<20:56,  3.53it/s]
 99%|█████████▉| 367035/371472 [7:02:32<21:14,  3.48it/s]
 99%|█████████▉| 367036/371472 [7:02:32<20:28,  3.61it/s]
 99%|█████████▉| 367037/371472 [7:02:32<20:30,  3.61it/s]
 99%|█████████▉| 367038/371472 [7:02:32<20:08,  3.67it/s]
 99%|█████████▉| 367039/371472 [7:02:33<20:10,  3.66it/s]
 99%|█████████▉| 367040/371472 [7:02:33<21:12,  3.48it/s]
                                                         
{'loss': 2.6073, 'learning_rate': 1.10743605766123e-07, 'epoch': 15.81}

 99%|█████████▉| 367040/371472 [7:02:33<21:12,  3.48it/s]
 99%|█████████▉| 367041/371472 [7:02:33<20:33,  3.59it/s]
 99%|█████████▉| 367042/371472 [7:02:34<21:06,  3.50it/s]
 99%|█████████▉| 367043/371472 [7:02:34<21:11,  3.48it/s]
 99%|█████████▉| 367044/371472 [7:02:34<21:11,  3.48it/s]
 99%|█████████▉| 367045/371472 [7:02:34<21:23,  3.45it/s]
 99%|█████████▉| 367046/371472 [7:02:35<20:44,  3.56it/s]
 99%|█████████▉| 367047/371472 [7:02:35<21:08,  3.49it/s]
 99%|█████████▉| 367048/371472 [7:02:35<20:30,  3.59it/s]
 99%|█████████▉| 367049/371472 [7:02:36<20:14,  3.64it/s]
 99%|█████████▉| 367050/371472 [7:02:36<20:38,  3.57it/s]
 99%|█████████▉| 367051/371472 [7:02:36<21:03,  3.50it/s]
 99%|█████████▉| 367052/371472 [7:02:36<20:19,  3.62it/s]
 99%|█████████▉| 367053/371472 [7:02:37<23:33,  3.13it/s]
 99%|█████████▉| 367054/371472 [7:02:37<22:31,  3.27it/s]
 99%|█████████▉| 367055/371472 [7:02:37<21:18,  3.46it/s]
 99%|█████████▉| 367056/371472 [7:02:38<22:29,  3.27it/s]
 99%|█████████▉| 367057/371472 [7:02:38<21:34,  3.41it/s]
 99%|█████████▉| 367058/371472 [7:02:38<21:53,  3.36it/s]
 99%|█████████▉| 367059/371472 [7:02:39<20:54,  3.52it/s]
 99%|█████████▉| 367060/371472 [7:02:39<21:28,  3.42it/s]
                                                         
{'loss': 2.5385, 'learning_rate': 1.1069512379064405e-07, 'epoch': 15.81}

 99%|█████████▉| 367060/371472 [7:02:39<21:28,  3.42it/s]
 99%|█████████▉| 367061/371472 [7:02:39<21:27,  3.43it/s]
 99%|█████████▉| 367062/371472 [7:02:39<21:01,  3.50it/s]
 99%|█████████▉| 367063/371472 [7:02:40<20:11,  3.64it/s]
 99%|█████████▉| 367064/371472 [7:02:40<19:46,  3.72it/s]
 99%|█████████▉| 367065/371472 [7:02:40<20:42,  3.55it/s]
 99%|█████████▉| 367066/371472 [7:02:40<20:12,  3.63it/s]
 99%|█████████▉| 367067/371472 [7:02:41<19:43,  3.72it/s]
 99%|█████████▉| 367068/371472 [7:02:41<19:22,  3.79it/s]
 99%|█████████▉| 367069/371472 [7:02:41<20:34,  3.57it/s]
 99%|█████████▉| 367070/371472 [7:02:42<20:44,  3.54it/s]
 99%|█████████▉| 367071/371472 [7:02:42<20:06,  3.65it/s]
 99%|█████████▉| 367072/371472 [7:02:42<20:00,  3.66it/s]
 99%|█████████▉| 367073/371472 [7:02:42<19:36,  3.74it/s]
 99%|█████████▉| 367074/371472 [7:02:43<19:35,  3.74it/s]
 99%|█████████▉| 367075/371472 [7:02:43<20:20,  3.60it/s]
 99%|█████████▉| 367076/371472 [7:02:43<21:27,  3.41it/s]
 99%|█████████▉| 367077/371472 [7:02:44<21:03,  3.48it/s]
 99%|█████████▉| 367078/371472 [7:02:44<20:59,  3.49it/s]
 99%|█████████▉| 367079/371472 [7:02:44<22:04,  3.32it/s]
 99%|█████████▉| 367080/371472 [7:02:44<20:59,  3.49it/s]
                                                         
{'loss': 2.7344, 'learning_rate': 1.1064664181516511e-07, 'epoch': 15.81}

 99%|█████████▉| 367080/371472 [7:02:44<20:59,  3.49it/s]
 99%|█████████▉| 367081/371472 [7:02:45<20:47,  3.52it/s]
 99%|█████████▉| 367082/371472 [7:02:45<20:20,  3.60it/s]
 99%|█████████▉| 367083/371472 [7:02:45<20:21,  3.59it/s]
 99%|█████████▉| 367084/371472 [7:02:45<20:07,  3.64it/s]
 99%|█████████▉| 367085/371472 [7:02:46<21:04,  3.47it/s]
 99%|█████████▉| 367086/371472 [7:02:46<21:42,  3.37it/s]
 99%|█████████▉| 367087/371472 [7:02:46<21:50,  3.35it/s]
 99%|█████████▉| 367088/371472 [7:02:47<21:34,  3.39it/s]
 99%|█████████▉| 367089/371472 [7:02:47<21:28,  3.40it/s]
 99%|█████████▉| 367090/371472 [7:02:47<21:29,  3.40it/s]
 99%|█████████▉| 367091/371472 [7:02:48<21:04,  3.47it/s]
 99%|█████████▉| 367092/371472 [7:02:48<20:16,  3.60it/s]
 99%|█████████▉| 367093/371472 [7:02:48<20:05,  3.63it/s]
 99%|█████████▉| 367094/371472 [7:02:48<20:57,  3.48it/s]
 99%|█████████▉| 367095/371472 [7:02:49<20:16,  3.60it/s]
 99%|█████████▉| 367096/371472 [7:02:49<20:41,  3.52it/s]
 99%|█████████▉| 367097/371472 [7:02:49<20:48,  3.50it/s]
 99%|█████████▉| 367098/371472 [7:02:50<21:26,  3.40it/s]
 99%|█████████▉| 367099/371472 [7:02:50<21:10,  3.44it/s]
 99%|█████████▉| 367100/371472 [7:02:50<20:33,  3.55it/s]
                                                         
{'loss': 2.6858, 'learning_rate': 1.1059815983968626e-07, 'epoch': 15.81}

 99%|█████████▉| 367100/371472 [7:02:50<20:33,  3.55it/s]
 99%|█████████▉| 367101/371472 [7:02:50<21:53,  3.33it/s]
 99%|█████████▉| 367102/371472 [7:02:51<21:50,  3.33it/s]
 99%|█████████▉| 367103/371472 [7:02:51<21:49,  3.34it/s]
 99%|█████████▉| 367104/371472 [7:02:51<21:39,  3.36it/s]
 99%|█████████▉| 367105/371472 [7:02:52<21:00,  3.46it/s]
 99%|█████████▉| 367106/371472 [7:02:52<20:15,  3.59it/s]
 99%|█████████▉| 367107/371472 [7:02:52<19:36,  3.71it/s]
 99%|█████████▉| 367108/371472 [7:02:52<19:56,  3.65it/s]
 99%|█████████▉| 367109/371472 [7:02:53<19:36,  3.71it/s]
 99%|█████████▉| 367110/371472 [7:02:53<19:41,  3.69it/s]
 99%|█████████▉| 367111/371472 [7:02:53<19:27,  3.73it/s]
 99%|█████████▉| 367112/371472 [7:02:53<19:55,  3.65it/s]
 99%|█████████▉| 367113/371472 [7:02:54<19:55,  3.65it/s]
 99%|█████████▉| 367114/371472 [7:02:54<20:06,  3.61it/s]
 99%|█████████▉| 367115/371472 [7:02:54<22:05,  3.29it/s]
 99%|█████████▉| 367116/371472 [7:02:55<21:22,  3.40it/s]
 99%|█████████▉| 367117/371472 [7:02:55<20:32,  3.53it/s]
 99%|█████████▉| 367118/371472 [7:02:55<21:58,  3.30it/s]
 99%|█████████▉| 367119/371472 [7:02:56<22:30,  3.22it/s]
 99%|█████████▉| 367120/371472 [7:02:56<21:03,  3.45it/s]
                                                         
{'loss': 2.5419, 'learning_rate': 1.1054967786420732e-07, 'epoch': 15.81}

 99%|█████████▉| 367120/371472 [7:02:56<21:03,  3.45it/s]
 99%|█████████▉| 367121/371472 [7:02:56<21:31,  3.37it/s]
 99%|█████████▉| 367122/371472 [7:02:56<21:14,  3.41it/s]
 99%|█████████▉| 367123/371472 [7:02:57<20:33,  3.53it/s]
 99%|█████████▉| 367124/371472 [7:02:57<20:05,  3.61it/s]
 99%|█████████▉| 367125/371472 [7:02:57<21:19,  3.40it/s]
 99%|█████████▉| 367126/371472 [7:02:58<21:23,  3.39it/s]
 99%|█████████▉| 367127/371472 [7:02:58<21:42,  3.33it/s]
 99%|█████████▉| 367128/371472 [7:02:58<21:40,  3.34it/s]
 99%|█████████▉| 367129/371472 [7:02:59<21:57,  3.30it/s]
 99%|█████████▉| 367130/371472 [7:02:59<21:57,  3.29it/s]
 99%|█████████▉| 367131/371472 [7:02:59<22:39,  3.19it/s]
 99%|█████████▉| 367132/371472 [7:02:59<21:18,  3.39it/s]
 99%|█████████▉| 367133/371472 [7:03:00<20:19,  3.56it/s]
 99%|█████████▉| 367134/371472 [7:03:00<19:57,  3.62it/s]
 99%|█████████▉| 367135/371472 [7:03:00<20:46,  3.48it/s]
 99%|█████████▉| 367136/371472 [7:03:01<20:03,  3.60it/s]
 99%|█████████▉| 367137/371472 [7:03:01<20:16,  3.56it/s]
 99%|█████████▉| 367138/371472 [7:03:01<20:08,  3.59it/s]
 99%|█████████▉| 367139/371472 [7:03:01<21:01,  3.43it/s]
 99%|█████████▉| 367140/371472 [7:03:02<20:14,  3.57it/s]
                                                         
{'loss': 2.7576, 'learning_rate': 1.1050119588872849e-07, 'epoch': 15.81}

 99%|█████████▉| 367140/371472 [7:03:02<20:14,  3.57it/s]
 99%|█████████▉| 367141/371472 [7:03:02<21:03,  3.43it/s]
 99%|█████████▉| 367142/371472 [7:03:02<22:16,  3.24it/s]
 99%|█████████▉| 367143/371472 [7:03:03<21:48,  3.31it/s]
 99%|█████████▉| 367144/371472 [7:03:03<20:51,  3.46it/s]
 99%|█████████▉| 367145/371472 [7:03:03<20:44,  3.48it/s]
 99%|█████████▉| 367146/371472 [7:03:03<20:13,  3.56it/s]
 99%|█████████▉| 367147/371472 [7:03:04<19:46,  3.65it/s]
 99%|█████████▉| 367148/371472 [7:03:04<19:56,  3.62it/s]
 99%|█████████▉| 367149/371472 [7:03:04<19:57,  3.61it/s]
 99%|█████████▉| 367150/371472 [7:03:05<19:57,  3.61it/s]
 99%|█████████▉| 367151/371472 [7:03:05<19:34,  3.68it/s]
 99%|█████████▉| 367152/371472 [7:03:05<19:37,  3.67it/s]
 99%|█████████▉| 367153/371472 [7:03:05<19:10,  3.75it/s]
 99%|█████████▉| 367154/371472 [7:03:06<19:59,  3.60it/s]
 99%|█████████▉| 367155/371472 [7:03:06<19:52,  3.62it/s]
 99%|█████████▉| 367156/371472 [7:03:06<20:30,  3.51it/s]
 99%|█████████▉| 367157/371472 [7:03:06<19:55,  3.61it/s]
 99%|█████████▉| 367158/371472 [7:03:07<19:18,  3.72it/s]
 99%|█████████▉| 367159/371472 [7:03:07<19:29,  3.69it/s]
 99%|█████████▉| 367160/371472 [7:03:07<19:01,  3.78it/s]
                                                         
{'loss': 2.5102, 'learning_rate': 1.1045271391324954e-07, 'epoch': 15.81}

 99%|█████████▉| 367160/371472 [7:03:07<19:01,  3.78it/s]
 99%|█████████▉| 367161/371472 [7:03:08<20:28,  3.51it/s]
 99%|█████████▉| 367162/371472 [7:03:08<20:42,  3.47it/s]
 99%|█████████▉| 367163/371472 [7:03:08<19:46,  3.63it/s]
 99%|█████████▉| 367164/371472 [7:03:08<19:38,  3.66it/s]
 99%|█████████▉| 367165/371472 [7:03:09<19:22,  3.70it/s]
 99%|█████████▉| 367166/371472 [7:03:09<19:31,  3.68it/s]
 99%|█████████▉| 367167/371472 [7:03:09<20:03,  3.58it/s]
 99%|█████████▉| 367168/371472 [7:03:10<23:04,  3.11it/s]
 99%|█████████▉| 367169/371472 [7:03:10<24:14,  2.96it/s]
 99%|█████████▉| 367170/371472 [7:03:10<26:22,  2.72it/s]
 99%|█████████▉| 367171/371472 [7:03:11<24:46,  2.89it/s]
 99%|█████████▉| 367172/371472 [7:03:11<22:35,  3.17it/s]
 99%|█████████▉| 367173/371472 [7:03:11<21:13,  3.38it/s]
 99%|█████████▉| 367174/371472 [7:03:11<20:43,  3.46it/s]
 99%|█████████▉| 367175/371472 [7:03:12<19:49,  3.61it/s]
 99%|█████████▉| 367176/371472 [7:03:12<20:22,  3.51it/s]
 99%|█████████▉| 367177/371472 [7:03:12<20:50,  3.44it/s]
 99%|█████████▉| 367178/371472 [7:03:13<20:30,  3.49it/s]
 99%|█████████▉| 367179/371472 [7:03:13<19:49,  3.61it/s]
 99%|█████████▉| 367180/371472 [7:03:13<21:02,  3.40it/s]
                                                         
{'loss': 2.4908, 'learning_rate': 1.104042319377707e-07, 'epoch': 15.82}

 99%|█████████▉| 367180/371472 [7:03:13<21:02,  3.40it/s]
 99%|█████████▉| 367181/371472 [7:03:13<20:35,  3.47it/s]
 99%|█████████▉| 367182/371472 [7:03:14<20:07,  3.55it/s]
 99%|█████████▉| 367183/371472 [7:03:14<19:46,  3.61it/s]
 99%|█████████▉| 367184/371472 [7:03:14<19:35,  3.65it/s]
 99%|█████████▉| 367185/371472 [7:03:15<19:04,  3.75it/s]
 99%|█████████▉| 367186/371472 [7:03:15<19:55,  3.58it/s]
 99%|█████████▉| 367187/371472 [7:03:15<21:27,  3.33it/s]
 99%|█████████▉| 367188/371472 [7:03:15<20:35,  3.47it/s]
 99%|█████████▉| 367189/371472 [7:03:16<19:30,  3.66it/s]
 99%|█████████▉| 367190/371472 [7:03:16<20:35,  3.47it/s]
 99%|█████████▉| 367191/371472 [7:03:16<21:10,  3.37it/s]
 99%|█████████▉| 367192/371472 [7:03:17<21:22,  3.34it/s]
 99%|█████████▉| 367193/371472 [7:03:17<20:49,  3.43it/s]
 99%|█████████▉| 367194/371472 [7:03:17<21:09,  3.37it/s]
 99%|█████████▉| 367195/371472 [7:03:17<20:28,  3.48it/s]
 99%|█████████▉| 367196/371472 [7:03:18<22:01,  3.23it/s]
 99%|█████████▉| 367197/371472 [7:03:18<23:22,  3.05it/s]
 99%|█████████▉| 367198/371472 [7:03:18<21:53,  3.25it/s]
 99%|█████████▉| 367199/371472 [7:03:19<21:14,  3.35it/s]
 99%|█████████▉| 367200/371472 [7:03:19<20:22,  3.49it/s]
                                                         
{'loss': 2.5595, 'learning_rate': 1.1035574996229175e-07, 'epoch': 15.82}

 99%|█████████▉| 367200/371472 [7:03:19<20:22,  3.49it/s]
 99%|█████████▉| 367201/371472 [7:03:19<20:06,  3.54it/s]
 99%|█████████▉| 367202/371472 [7:03:20<20:29,  3.47it/s]
 99%|█████████▉| 367203/371472 [7:03:20<20:04,  3.55it/s]
 99%|█████████▉| 367204/371472 [7:03:20<21:00,  3.39it/s]
 99%|█████████▉| 367205/371472 [7:03:20<20:20,  3.50it/s]
 99%|█████████▉| 367206/371472 [7:03:21<20:10,  3.52it/s]
 99%|█████████▉| 367207/371472 [7:03:21<19:13,  3.70it/s]
 99%|█████████▉| 367208/371472 [7:03:21<19:14,  3.69it/s]
 99%|█████████▉| 367209/371472 [7:03:22<19:20,  3.67it/s]
 99%|█████████▉| 367210/371472 [7:03:22<19:44,  3.60it/s]
 99%|█████████▉| 367211/371472 [7:03:22<20:36,  3.45it/s]
 99%|█████████▉| 367212/371472 [7:03:22<20:54,  3.40it/s]
 99%|█████████▉| 367213/371472 [7:03:23<20:10,  3.52it/s]
 99%|█████████▉| 367214/371472 [7:03:23<19:52,  3.57it/s]
 99%|█████████▉| 367215/371472 [7:03:23<20:44,  3.42it/s]
 99%|█████████▉| 367216/371472 [7:03:24<21:40,  3.27it/s]
 99%|█████████▉| 367217/371472 [7:03:24<21:15,  3.34it/s]
 99%|█████████▉| 367218/371472 [7:03:24<21:15,  3.33it/s]
 99%|█████████▉| 367219/371472 [7:03:24<20:23,  3.48it/s]
 99%|█████████▉| 367220/371472 [7:03:25<20:20,  3.48it/s]
                                                         
{'loss': 2.6025, 'learning_rate': 1.1030726798681292e-07, 'epoch': 15.82}

 99%|█████████▉| 367220/371472 [7:03:25<20:20,  3.48it/s]
 99%|█████████▉| 367221/371472 [7:03:25<20:38,  3.43it/s]
 99%|█████████▉| 367222/371472 [7:03:25<20:16,  3.49it/s]
 99%|█████████▉| 367223/371472 [7:03:26<20:22,  3.47it/s]
 99%|█████████▉| 367224/371472 [7:03:26<20:19,  3.48it/s]
 99%|█████████▉| 367225/371472 [7:03:26<21:05,  3.36it/s]
 99%|█████████▉| 367226/371472 [7:03:27<20:49,  3.40it/s]
 99%|█████████▉| 367227/371472 [7:03:27<20:59,  3.37it/s]
 99%|█████████▉| 367228/371472 [7:03:27<20:13,  3.50it/s]
 99%|█████████▉| 367229/371472 [7:03:27<19:48,  3.57it/s]
 99%|█████████▉| 367230/371472 [7:03:28<20:07,  3.51it/s]
 99%|█████████▉| 367231/371472 [7:03:28<19:53,  3.55it/s]
 99%|█████████▉| 367232/371472 [7:03:28<19:24,  3.64it/s]
 99%|█████████▉| 367233/371472 [7:03:28<20:38,  3.42it/s]
 99%|█████████▉| 367234/371472 [7:03:29<20:28,  3.45it/s]
 99%|█████████▉| 367235/371472 [7:03:29<20:01,  3.53it/s]
 99%|█████████▉| 367236/371472 [7:03:29<19:27,  3.63it/s]
 99%|█████████▉| 367237/371472 [7:03:30<19:01,  3.71it/s]
 99%|█████████▉| 367238/371472 [7:03:30<19:03,  3.70it/s]
 99%|█████████▉| 367239/371472 [7:03:30<19:29,  3.62it/s]
 99%|█████████▉| 367240/371472 [7:03:30<19:53,  3.55it/s]
                                                         
{'loss': 2.7819, 'learning_rate': 1.1025878601133398e-07, 'epoch': 15.82}

 99%|█████████▉| 367240/371472 [7:03:30<19:53,  3.55it/s]
 99%|█████████▉| 367241/371472 [7:03:31<19:31,  3.61it/s]
 99%|█████████▉| 367242/371472 [7:03:31<19:32,  3.61it/s]
 99%|█████████▉| 367243/371472 [7:03:31<19:32,  3.61it/s]
 99%|█████████▉| 367244/371472 [7:03:32<19:26,  3.62it/s]
 99%|█████████▉| 367245/371472 [7:03:32<20:58,  3.36it/s]
 99%|█████████▉| 367246/371472 [7:03:32<20:19,  3.47it/s]
 99%|█████████▉| 367247/371472 [7:03:32<20:16,  3.47it/s]
 99%|█████████▉| 367248/371472 [7:03:33<19:55,  3.53it/s]
 99%|█████████▉| 367249/371472 [7:03:33<19:31,  3.60it/s]
 99%|█████████▉| 367250/371472 [7:03:33<19:26,  3.62it/s]
 99%|█████████▉| 367251/371472 [7:03:33<19:01,  3.70it/s]
 99%|█████████▉| 367252/371472 [7:03:34<18:32,  3.79it/s]
 99%|█████████▉| 367253/371472 [7:03:34<19:41,  3.57it/s]
 99%|█████████▉| 367254/371472 [7:03:34<19:26,  3.62it/s]
 99%|█████████▉| 367255/371472 [7:03:35<19:00,  3.70it/s]
 99%|█████████▉| 367256/371472 [7:03:35<19:29,  3.60it/s]
 99%|█████████▉| 367257/371472 [7:03:35<19:11,  3.66it/s]
 99%|█████████▉| 367258/371472 [7:03:35<19:15,  3.65it/s]
 99%|█████████▉| 367259/371472 [7:03:36<18:45,  3.74it/s]
 99%|█████████▉| 367260/371472 [7:03:36<18:51,  3.72it/s]
                                                         
{'loss': 2.6057, 'learning_rate': 1.1021030403585513e-07, 'epoch': 15.82}

 99%|█████████▉| 367260/371472 [7:03:36<18:51,  3.72it/s]
 99%|█████████▉| 367261/371472 [7:03:36<19:28,  3.60it/s]
 99%|█████████▉| 367262/371472 [7:03:36<19:20,  3.63it/s]
 99%|█████████▉| 367263/371472 [7:03:37<19:18,  3.63it/s]
 99%|█████████▉| 367264/371472 [7:03:37<20:04,  3.49it/s]
 99%|█████████▉| 367265/371472 [7:03:37<20:46,  3.38it/s]
 99%|█████████▉| 367266/371472 [7:03:38<20:55,  3.35it/s]
 99%|█████████▉| 367267/371472 [7:03:38<20:56,  3.35it/s]
 99%|█████████▉| 367268/371472 [7:03:38<20:20,  3.44it/s]
 99%|█████████▉| 367269/371472 [7:03:39<19:45,  3.55it/s]
 99%|█████████▉| 367270/371472 [7:03:39<22:46,  3.08it/s]
 99%|█████████▉| 367271/371472 [7:03:39<23:10,  3.02it/s]
 99%|█████████▉| 367272/371472 [7:03:40<21:57,  3.19it/s]
 99%|█████████▉| 367273/371472 [7:03:40<21:00,  3.33it/s]
 99%|█████████▉| 367274/371472 [7:03:40<20:35,  3.40it/s]
 99%|█████████▉| 367275/371472 [7:03:40<21:43,  3.22it/s]
 99%|█████████▉| 367276/371472 [7:03:41<20:47,  3.36it/s]
 99%|█████████▉| 367277/371472 [7:03:41<20:15,  3.45it/s]
 99%|█████████▉| 367278/371472 [7:03:41<20:22,  3.43it/s]
 99%|█████████▉| 367279/371472 [7:03:42<19:59,  3.50it/s]
 99%|█████████▉| 367280/371472 [7:03:42<19:44,  3.54it/s]
                                                         
{'loss': 2.5239, 'learning_rate': 1.1016182206037617e-07, 'epoch': 15.82}

 99%|█████████▉| 367280/371472 [7:03:42<19:44,  3.54it/s]
 99%|█████████▉| 367281/371472 [7:03:42<20:34,  3.40it/s]
 99%|█████████▉| 367282/371472 [7:03:43<25:30,  2.74it/s]
 99%|█████████▉| 367283/371472 [7:03:43<23:26,  2.98it/s]
 99%|█████████▉| 367284/371472 [7:03:43<22:54,  3.05it/s]
 99%|█████████▉| 367285/371472 [7:03:44<21:53,  3.19it/s]
 99%|█████████▉| 367286/371472 [7:03:44<21:00,  3.32it/s]
 99%|█████████▉| 367287/371472 [7:03:44<20:38,  3.38it/s]
 99%|█████████▉| 367288/371472 [7:03:44<20:51,  3.34it/s]
 99%|█████████▉| 367289/371472 [7:03:45<20:23,  3.42it/s]
 99%|█████████▉| 367290/371472 [7:03:45<20:46,  3.35it/s]
 99%|█████████▉| 367291/371472 [7:03:45<20:37,  3.38it/s]
 99%|█████████▉| 367292/371472 [7:03:46<22:26,  3.10it/s]
 99%|█████████▉| 367293/371472 [7:03:46<21:27,  3.24it/s]
 99%|█████████▉| 367294/371472 [7:03:46<21:30,  3.24it/s]
 99%|█████████▉| 367295/371472 [7:03:47<20:39,  3.37it/s]
 99%|█████████▉| 367296/371472 [7:03:47<19:39,  3.54it/s]
 99%|█████████▉| 367297/371472 [7:03:47<19:44,  3.52it/s]
 99%|█████████▉| 367298/371472 [7:03:47<19:48,  3.51it/s]
 99%|█████████▉| 367299/371472 [7:03:48<19:30,  3.57it/s]
 99%|█████████▉| 367300/371472 [7:03:48<19:39,  3.54it/s]
                                                         
{'loss': 2.5051, 'learning_rate': 1.1011334008489735e-07, 'epoch': 15.82}

 99%|█████████▉| 367300/371472 [7:03:48<19:39,  3.54it/s]
 99%|█████████▉| 367301/371472 [7:03:48<20:05,  3.46it/s]
 99%|█████████▉| 367302/371472 [7:03:49<20:35,  3.38it/s]
 99%|█████████▉| 367303/371472 [7:03:49<20:37,  3.37it/s]
 99%|█████████▉| 367304/371472 [7:03:49<20:12,  3.44it/s]
 99%|█████████▉| 367305/371472 [7:03:49<20:20,  3.41it/s]
 99%|█████████▉| 367306/371472 [7:03:50<20:56,  3.32it/s]
 99%|█████████▉| 367307/371472 [7:03:50<21:52,  3.17it/s]
 99%|█████████▉| 367308/371472 [7:03:50<23:05,  3.00it/s]
 99%|█████████▉| 367309/371472 [7:03:51<22:15,  3.12it/s]
 99%|█████████▉| 367310/371472 [7:03:51<22:10,  3.13it/s]
 99%|█████████▉| 367311/371472 [7:03:51<21:10,  3.27it/s]
 99%|█████████▉| 367312/371472 [7:03:52<20:37,  3.36it/s]
 99%|█████████▉| 367313/371472 [7:03:52<20:01,  3.46it/s]
 99%|█████████▉| 367314/371472 [7:03:52<20:15,  3.42it/s]
 99%|█████████▉| 367315/371472 [7:03:52<19:38,  3.53it/s]
 99%|█████████▉| 367316/371472 [7:03:53<19:03,  3.63it/s]
 99%|█████████▉| 367317/371472 [7:03:53<19:05,  3.63it/s]
 99%|█████████▉| 367318/371472 [7:03:53<19:03,  3.63it/s]
 99%|█████████▉| 367319/371472 [7:03:54<19:42,  3.51it/s]
 99%|█████████▉| 367320/371472 [7:03:54<19:03,  3.63it/s]
                                                         
{'loss': 2.8137, 'learning_rate': 1.1006485810941841e-07, 'epoch': 15.82}

 99%|█████████▉| 367320/371472 [7:03:54<19:03,  3.63it/s]
 99%|█████████▉| 367321/371472 [7:03:54<19:02,  3.63it/s]
 99%|█████████▉| 367322/371472 [7:03:54<20:33,  3.36it/s]
 99%|█████████▉| 367323/371472 [7:03:55<20:04,  3.44it/s]
 99%|█████████▉| 367324/371472 [7:03:55<19:18,  3.58it/s]
 99%|█████████▉| 367325/371472 [7:03:55<19:11,  3.60it/s]
 99%|█████████▉| 367326/371472 [7:03:56<21:05,  3.28it/s]
 99%|█████████▉| 367327/371472 [7:03:56<20:07,  3.43it/s]
 99%|█████████▉| 367328/371472 [7:03:56<19:53,  3.47it/s]
 99%|█████████▉| 367329/371472 [7:03:56<19:25,  3.56it/s]
 99%|█████████▉| 367330/371472 [7:03:57<19:19,  3.57it/s]
 99%|█████████▉| 367331/371472 [7:03:57<19:00,  3.63it/s]
 99%|█████████▉| 367332/371472 [7:03:57<19:30,  3.54it/s]
 99%|█████████▉| 367333/371472 [7:03:58<20:42,  3.33it/s]
 99%|█████████▉| 367334/371472 [7:03:58<20:46,  3.32it/s]
 99%|█████████▉| 367335/371472 [7:03:58<20:23,  3.38it/s]
 99%|█████████▉| 367336/371472 [7:03:58<20:14,  3.41it/s]
 99%|█████████▉| 367337/371472 [7:03:59<19:32,  3.53it/s]
 99%|█████████▉| 367338/371472 [7:03:59<20:17,  3.40it/s]
 99%|█████████▉| 367339/371472 [7:03:59<20:15,  3.40it/s]
 99%|█████████▉| 367340/371472 [7:04:00<20:40,  3.33it/s]
                                                         
{'loss': 2.769, 'learning_rate': 1.1001637613393956e-07, 'epoch': 15.82}

 99%|█████████▉| 367340/371472 [7:04:00<20:40,  3.33it/s]
 99%|█████████▉| 367341/371472 [7:04:00<20:26,  3.37it/s]
 99%|█████████▉| 367342/371472 [7:04:00<19:50,  3.47it/s]
 99%|█████████▉| 367343/371472 [7:04:00<19:19,  3.56it/s]
 99%|█████████▉| 367344/371472 [7:04:01<18:43,  3.67it/s]
 99%|█████████▉| 367345/371472 [7:04:01<18:29,  3.72it/s]
 99%|█████████▉| 367346/371472 [7:04:01<20:35,  3.34it/s]
 99%|█████████▉| 367347/371472 [7:04:02<20:13,  3.40it/s]
 99%|█████████▉| 367348/371472 [7:04:02<19:32,  3.52it/s]
 99%|█████████▉| 367349/371472 [7:04:02<19:15,  3.57it/s]
 99%|█████████▉| 367350/371472 [7:04:03<22:09,  3.10it/s]
 99%|█████████▉| 367351/371472 [7:04:03<22:15,  3.09it/s]
 99%|█████████▉| 367352/371472 [7:04:03<21:12,  3.24it/s]
 99%|█████████▉| 367353/371472 [7:04:03<20:27,  3.36it/s]
 99%|█████████▉| 367354/371472 [7:04:04<20:54,  3.28it/s]
 99%|█████████▉| 367355/371472 [7:04:04<20:00,  3.43it/s]
 99%|█████████▉| 367356/371472 [7:04:04<20:04,  3.42it/s]
 99%|█████████▉| 367357/371472 [7:04:05<19:20,  3.55it/s]
 99%|█████████▉| 367358/371472 [7:04:05<19:00,  3.61it/s]
 99%|█████████▉| 367359/371472 [7:04:05<18:56,  3.62it/s]
 99%|█████████▉| 367360/371472 [7:04:06<20:29,  3.35it/s]
                                                         
{'loss': 2.5455, 'learning_rate': 1.0996789415846062e-07, 'epoch': 15.82}

 99%|█████████▉| 367360/371472 [7:04:06<20:29,  3.35it/s]
 99%|█████████▉| 367361/371472 [7:04:06<20:39,  3.32it/s]
 99%|█████████▉| 367362/371472 [7:04:06<21:23,  3.20it/s]
 99%|█████████▉| 367363/371472 [7:04:06<20:36,  3.32it/s]
 99%|█████████▉| 367364/371472 [7:04:07<20:16,  3.38it/s]
 99%|█████████▉| 367365/371472 [7:04:07<20:04,  3.41it/s]
 99%|█████████▉| 367366/371472 [7:04:07<19:22,  3.53it/s]
 99%|█████████▉| 367367/371472 [7:04:08<20:48,  3.29it/s]
 99%|█████████▉| 367368/371472 [7:04:08<20:09,  3.39it/s]
 99%|█████████▉| 367369/371472 [7:04:08<20:50,  3.28it/s]
 99%|█████████▉| 367370/371472 [7:04:08<20:13,  3.38it/s]
 99%|█████████▉| 367371/371472 [7:04:09<22:31,  3.03it/s]
 99%|█████████▉| 367372/371472 [7:04:09<21:12,  3.22it/s]
 99%|█████████▉| 367373/371472 [7:04:09<20:38,  3.31it/s]
 99%|█████████▉| 367374/371472 [7:04:10<20:26,  3.34it/s]
 99%|█████████▉| 367375/371472 [7:04:10<20:00,  3.41it/s]
 99%|█████████▉| 367376/371472 [7:04:10<19:33,  3.49it/s]
 99%|█████████▉| 367377/371472 [7:04:11<18:52,  3.62it/s]
 99%|█████████▉| 367378/371472 [7:04:11<18:28,  3.69it/s]
 99%|█████████▉| 367379/371472 [7:04:11<17:58,  3.79it/s]
 99%|█████████▉| 367380/371472 [7:04:11<18:14,  3.74it/s]
                                                         
{'loss': 2.5242, 'learning_rate': 1.0991941218298178e-07, 'epoch': 15.82}

 99%|█████████▉| 367380/371472 [7:04:11<18:14,  3.74it/s]
 99%|█████████▉| 367381/371472 [7:04:12<19:13,  3.55it/s]
 99%|█████████▉| 367382/371472 [7:04:12<19:28,  3.50it/s]
 99%|█████████▉| 367383/371472 [7:04:12<18:50,  3.62it/s]
 99%|█████████▉| 367384/371472 [7:04:13<19:58,  3.41it/s]
 99%|█████████▉| 367385/371472 [7:04:13<19:23,  3.51it/s]
 99%|█████████▉| 367386/371472 [7:04:13<19:43,  3.45it/s]
 99%|█████████▉| 367387/371472 [7:04:13<19:03,  3.57it/s]
 99%|█████████▉| 367388/371472 [7:04:14<18:59,  3.58it/s]
 99%|█████████▉| 367389/371472 [7:04:14<18:20,  3.71it/s]
 99%|█████████▉| 367390/371472 [7:04:14<17:59,  3.78it/s]
 99%|█████████▉| 367391/371472 [7:04:14<18:22,  3.70it/s]
 99%|█████████▉| 367392/371472 [7:04:15<18:20,  3.71it/s]
 99%|█████████▉| 367393/371472 [7:04:15<18:36,  3.65it/s]
 99%|█████████▉| 367394/371472 [7:04:15<18:32,  3.67it/s]
 99%|█████████▉| 367395/371472 [7:04:15<18:35,  3.66it/s]
 99%|█████████▉| 367396/371472 [7:04:16<18:12,  3.73it/s]
 99%|█████████▉| 367397/371472 [7:04:16<19:03,  3.56it/s]
 99%|█████████▉| 367398/371472 [7:04:16<20:49,  3.26it/s]
 99%|█████████▉| 367399/371472 [7:04:17<19:34,  3.47it/s]
 99%|█████████▉| 367400/371472 [7:04:17<21:45,  3.12it/s]
                                                         
{'loss': 2.668, 'learning_rate': 1.0987093020750283e-07, 'epoch': 15.82}

 99%|█████████▉| 367400/371472 [7:04:17<21:45,  3.12it/s]
 99%|█████████▉| 367401/371472 [7:04:17<21:08,  3.21it/s]
 99%|█████████▉| 367402/371472 [7:04:18<20:29,  3.31it/s]
 99%|█████████▉| 367403/371472 [7:04:18<19:50,  3.42it/s]
 99%|█████████▉| 367404/371472 [7:04:18<19:07,  3.54it/s]
 99%|█████████▉| 367405/371472 [7:04:18<18:32,  3.66it/s]
 99%|█████████▉| 367406/371472 [7:04:19<20:45,  3.26it/s]
 99%|█████████▉| 367407/371472 [7:04:19<19:39,  3.45it/s]
 99%|█████████▉| 367408/371472 [7:04:19<19:39,  3.45it/s]
 99%|█████████▉| 367409/371472 [7:04:20<20:53,  3.24it/s]
 99%|█████████▉| 367410/371472 [7:04:20<20:06,  3.37it/s]
 99%|█████████▉| 367411/371472 [7:04:20<19:37,  3.45it/s]
 99%|█████████▉| 367412/371472 [7:04:21<19:39,  3.44it/s]
 99%|█████████▉| 367413/371472 [7:04:21<19:03,  3.55it/s]
 99%|█████████▉| 367414/371472 [7:04:21<19:14,  3.51it/s]
 99%|█████████▉| 367415/371472 [7:04:21<19:20,  3.50it/s]
 99%|█████████▉| 367416/371472 [7:04:22<19:11,  3.52it/s]
 99%|█████████▉| 367417/371472 [7:04:22<18:41,  3.62it/s]
 99%|█████████▉| 367418/371472 [7:04:22<18:53,  3.58it/s]
 99%|█████████▉| 367419/371472 [7:04:22<18:39,  3.62it/s]
 99%|█████████▉| 367420/371472 [7:04:23<18:22,  3.68it/s]
                                                         
{'loss': 2.5615, 'learning_rate': 1.0982244823202399e-07, 'epoch': 15.83}

 99%|█████████▉| 367420/371472 [7:04:23<18:22,  3.68it/s]
 99%|█████████▉| 367421/371472 [7:04:23<18:19,  3.68it/s]
 99%|█████████▉| 367422/371472 [7:04:23<18:29,  3.65it/s]
 99%|█████████▉| 367423/371472 [7:04:24<18:19,  3.68it/s]
 99%|█████████▉| 367424/371472 [7:04:24<17:56,  3.76it/s]
 99%|█████████▉| 367425/371472 [7:04:24<17:59,  3.75it/s]
 99%|█████████▉| 367426/371472 [7:04:24<18:41,  3.61it/s]
 99%|█████████▉| 367427/371472 [7:04:25<18:35,  3.63it/s]
 99%|█████████▉| 367428/371472 [7:04:25<18:37,  3.62it/s]
 99%|█████████▉| 367429/371472 [7:04:25<18:57,  3.55it/s]
 99%|█████████▉| 367430/371472 [7:04:25<18:51,  3.57it/s]
 99%|█████████▉| 367431/371472 [7:04:26<19:19,  3.49it/s]
 99%|█████████▉| 367432/371472 [7:04:26<19:46,  3.41it/s]
 99%|█████████▉| 367433/371472 [7:04:26<19:22,  3.47it/s]
 99%|█████████▉| 367434/371472 [7:04:27<19:54,  3.38it/s]
 99%|█████████▉| 367435/371472 [7:04:27<19:22,  3.47it/s]
 99%|█████████▉| 367436/371472 [7:04:27<19:07,  3.52it/s]
 99%|█████████▉| 367437/371472 [7:04:28<20:18,  3.31it/s]
 99%|█████████▉| 367438/371472 [7:04:28<19:40,  3.42it/s]
 99%|█████████▉| 367439/371472 [7:04:28<19:07,  3.51it/s]
 99%|█████████▉| 367440/371472 [7:04:28<19:44,  3.40it/s]
                                                         
{'loss': 2.492, 'learning_rate': 1.0977396625654505e-07, 'epoch': 15.83}

 99%|█████████▉| 367440/371472 [7:04:28<19:44,  3.40it/s]
 99%|█████████▉| 367441/371472 [7:04:29<19:21,  3.47it/s]
 99%|█████████▉| 367442/371472 [7:04:29<18:39,  3.60it/s]
 99%|█████████▉| 367443/371472 [7:04:29<19:09,  3.51it/s]
 99%|█████████▉| 367444/371472 [7:04:30<18:47,  3.57it/s]
 99%|█████████▉| 367445/371472 [7:04:30<18:33,  3.62it/s]
 99%|█████████▉| 367446/371472 [7:04:30<19:43,  3.40it/s]
 99%|█████████▉| 367447/371472 [7:04:30<18:58,  3.53it/s]
 99%|█████████▉| 367448/371472 [7:04:31<19:33,  3.43it/s]
 99%|█████████▉| 367449/371472 [7:04:31<19:03,  3.52it/s]
 99%|█████████▉| 367450/371472 [7:04:31<19:06,  3.51it/s]
 99%|█████████▉| 367451/371472 [7:04:32<18:19,  3.66it/s]
 99%|█████████▉| 367452/371472 [7:04:32<19:54,  3.37it/s]
 99%|█████████▉| 367453/371472 [7:04:32<19:05,  3.51it/s]
 99%|█████████▉| 367454/371472 [7:04:32<18:30,  3.62it/s]
 99%|█████████▉| 367455/371472 [7:04:33<19:17,  3.47it/s]
 99%|█████████▉| 367456/371472 [7:04:33<18:49,  3.56it/s]
 99%|█████████▉| 367457/371472 [7:04:33<19:02,  3.51it/s]
 99%|█████████▉| 367458/371472 [7:04:34<19:25,  3.44it/s]
 99%|█████████▉| 367459/371472 [7:04:34<19:20,  3.46it/s]
 99%|█████████▉| 367460/371472 [7:04:34<20:08,  3.32it/s]
                                                         
{'loss': 2.5693, 'learning_rate': 1.0972548428106621e-07, 'epoch': 15.83}

 99%|█████████▉| 367460/371472 [7:04:34<20:08,  3.32it/s]
 99%|█████████▉| 367461/371472 [7:04:34<19:25,  3.44it/s]
 99%|█████████▉| 367462/371472 [7:04:35<21:22,  3.13it/s]
 99%|█████████▉| 367463/371472 [7:04:35<20:15,  3.30it/s]
 99%|█████████▉| 367464/371472 [7:04:35<20:26,  3.27it/s]
 99%|█████████▉| 367465/371472 [7:04:36<19:38,  3.40it/s]
 99%|█████████▉| 367466/371472 [7:04:36<19:38,  3.40it/s]
 99%|█████████▉| 367467/371472 [7:04:36<19:36,  3.40it/s]
 99%|█████████▉| 367468/371472 [7:04:37<19:02,  3.50it/s]
 99%|█████████▉| 367469/371472 [7:04:37<19:36,  3.40it/s]
 99%|█████████▉| 367470/371472 [7:04:37<19:13,  3.47it/s]
 99%|█████████▉| 367471/371472 [7:04:37<19:26,  3.43it/s]
 99%|█████████▉| 367472/371472 [7:04:38<18:34,  3.59it/s]
 99%|█████████▉| 367473/371472 [7:04:38<23:03,  2.89it/s]
 99%|█████████▉| 367474/371472 [7:04:38<21:02,  3.17it/s]
 99%|█████████▉| 367475/371472 [7:04:39<20:53,  3.19it/s]
 99%|█████████▉| 367476/371472 [7:04:39<19:39,  3.39it/s]
 99%|█████████▉| 367477/371472 [7:04:39<19:15,  3.46it/s]
 99%|█████████▉| 367478/371472 [7:04:40<18:50,  3.53it/s]
 99%|█████████▉| 367479/371472 [7:04:40<19:22,  3.44it/s]
 99%|█████████▉| 367480/371472 [7:04:40<18:57,  3.51it/s]
                                                         
{'loss': 2.5658, 'learning_rate': 1.0967700230558727e-07, 'epoch': 15.83}

 99%|█████████▉| 367480/371472 [7:04:40<18:57,  3.51it/s]
 99%|█████████▉| 367481/371472 [7:04:40<19:09,  3.47it/s]
 99%|█████████▉| 367482/371472 [7:04:41<20:36,  3.23it/s]
 99%|█████████▉| 367483/371472 [7:04:41<19:26,  3.42it/s]
 99%|█████████▉| 367484/371472 [7:04:41<19:17,  3.45it/s]
 99%|█████████▉| 367485/371472 [7:04:42<18:40,  3.56it/s]
 99%|█████████▉| 367486/371472 [7:04:42<18:03,  3.68it/s]
 99%|█████████▉| 367487/371472 [7:04:42<17:33,  3.78it/s]
 99%|█████████▉| 367488/371472 [7:04:42<18:09,  3.66it/s]
 99%|█████████▉| 367489/371472 [7:04:43<17:59,  3.69it/s]
 99%|█████████▉| 367490/371472 [7:04:43<17:37,  3.77it/s]
 99%|█████████▉| 367491/371472 [7:04:43<17:19,  3.83it/s]
 99%|█████████▉| 367492/371472 [7:04:43<17:20,  3.83it/s]
 99%|█████████▉| 367493/371472 [7:04:44<17:22,  3.82it/s]
 99%|█████████▉| 367494/371472 [7:04:44<18:24,  3.60it/s]
 99%|█████████▉| 367495/371472 [7:04:44<19:22,  3.42it/s]
 99%|█████████▉| 367496/371472 [7:04:45<19:43,  3.36it/s]
 99%|█████████▉| 367497/371472 [7:04:45<18:51,  3.51it/s]
 99%|█████████▉| 367498/371472 [7:04:45<19:38,  3.37it/s]
 99%|█████████▉| 367499/371472 [7:04:45<19:17,  3.43it/s]
 99%|█████████▉| 367500/371472 [7:04:46<18:57,  3.49it/s]
                                                         
{'loss': 2.6753, 'learning_rate': 1.0962852033010842e-07, 'epoch': 15.83}

 99%|█████████▉| 367500/371472 [7:04:46<18:57,  3.49it/s]
 99%|█████████▉| 367501/371472 [7:04:46<18:43,  3.53it/s]
 99%|█████████▉| 367502/371472 [7:04:46<18:35,  3.56it/s]
 99%|█████████▉| 367503/371472 [7:04:47<19:20,  3.42it/s]
 99%|█████████▉| 367504/371472 [7:04:47<18:41,  3.54it/s]
 99%|█████████▉| 367505/371472 [7:04:47<18:52,  3.50it/s]
 99%|█████████▉| 367506/371472 [7:04:47<18:17,  3.61it/s]
 99%|█████████▉| 367507/371472 [7:04:48<18:03,  3.66it/s]
 99%|█████████▉| 367508/371472 [7:04:48<17:59,  3.67it/s]
 99%|█████████▉| 367509/371472 [7:04:48<18:00,  3.67it/s]
 99%|█████████▉| 367510/371472 [7:04:48<17:43,  3.72it/s]
 99%|█████████▉| 367511/371472 [7:04:49<17:48,  3.71it/s]
 99%|█████████▉| 367512/371472 [7:04:49<17:41,  3.73it/s]
 99%|█████████▉| 367513/371472 [7:04:49<17:42,  3.73it/s]
 99%|█████████▉| 367514/371472 [7:04:50<17:28,  3.77it/s]
 99%|█████████▉| 367515/371472 [7:04:50<17:56,  3.68it/s]
 99%|█████████▉| 367516/371472 [7:04:50<19:02,  3.46it/s]
 99%|█████████▉| 367517/371472 [7:04:50<18:44,  3.52it/s]
 99%|█████████▉| 367518/371472 [7:04:51<18:34,  3.55it/s]
 99%|█████████▉| 367519/371472 [7:04:51<18:18,  3.60it/s]
 99%|█████████▉| 367520/371472 [7:04:51<18:18,  3.60it/s]
                                                         
{'loss': 2.4462, 'learning_rate': 1.0958003835462948e-07, 'epoch': 15.83}

 99%|█████████▉| 367520/371472 [7:04:51<18:18,  3.60it/s]
 99%|█████████▉| 367521/371472 [7:04:52<18:10,  3.62it/s]
 99%|█████████▉| 367522/371472 [7:04:52<17:55,  3.67it/s]
 99%|█████████▉| 367523/371472 [7:04:52<19:07,  3.44it/s]
 99%|█████████▉| 367524/371472 [7:04:52<19:30,  3.37it/s]
 99%|█████████▉| 367525/371472 [7:04:53<19:26,  3.38it/s]
 99%|█████████▉| 367526/371472 [7:04:53<19:28,  3.38it/s]
 99%|█████████▉| 367527/371472 [7:04:53<19:06,  3.44it/s]
 99%|█████████▉| 367528/371472 [7:04:54<18:56,  3.47it/s]
 99%|█████████▉| 367529/371472 [7:04:54<19:13,  3.42it/s]
 99%|█████████▉| 367530/371472 [7:04:54<18:40,  3.52it/s]
 99%|█████████▉| 367531/371472 [7:04:54<18:11,  3.61it/s]
 99%|█████████▉| 367532/371472 [7:04:55<18:06,  3.63it/s]
 99%|█████████▉| 367533/371472 [7:04:55<19:13,  3.41it/s]
 99%|█████████▉| 367534/371472 [7:04:55<19:24,  3.38it/s]
 99%|█████████▉| 367535/371472 [7:04:56<18:37,  3.52it/s]
 99%|█████████▉| 367536/371472 [7:04:56<18:22,  3.57it/s]
 99%|█████████▉| 367537/371472 [7:04:56<18:31,  3.54it/s]
 99%|█████████▉| 367538/371472 [7:04:56<18:16,  3.59it/s]
 99%|█████████▉| 367539/371472 [7:04:57<18:04,  3.63it/s]
 99%|█████████▉| 367540/371472 [7:04:57<17:33,  3.73it/s]
                                                         
{'loss': 2.6037, 'learning_rate': 1.0953155637915064e-07, 'epoch': 15.83}

 99%|█████████▉| 367540/371472 [7:04:57<17:33,  3.73it/s]
 99%|█████████▉| 367541/371472 [7:04:57<18:34,  3.53it/s]
 99%|█████████▉| 367542/371472 [7:04:57<18:08,  3.61it/s]
 99%|█████████▉| 367543/371472 [7:04:58<17:54,  3.66it/s]
 99%|█████████▉| 367544/371472 [7:04:58<18:41,  3.50it/s]
 99%|█████████▉| 367545/371472 [7:04:58<19:57,  3.28it/s]
 99%|█████████▉| 367546/371472 [7:04:59<18:55,  3.46it/s]
 99%|█████████▉| 367547/371472 [7:04:59<19:42,  3.32it/s]
 99%|█████████▉| 367548/371472 [7:04:59<20:10,  3.24it/s]
 99%|█████████▉| 367549/371472 [7:05:00<20:09,  3.24it/s]
 99%|█████████▉| 367550/371472 [7:05:00<20:52,  3.13it/s]
 99%|█████████▉| 367551/371472 [7:05:00<19:25,  3.36it/s]
 99%|█████████▉| 367552/371472 [7:05:00<18:48,  3.47it/s]
 99%|█████████▉| 367553/371472 [7:05:01<19:51,  3.29it/s]
 99%|█████████▉| 367554/371472 [7:05:01<19:18,  3.38it/s]
 99%|█████████▉| 367555/371472 [7:05:01<18:32,  3.52it/s]
 99%|█████████▉| 367556/371472 [7:05:02<18:06,  3.60it/s]
 99%|█████████▉| 367557/371472 [7:05:02<18:13,  3.58it/s]
 99%|█████████▉| 367558/371472 [7:05:02<18:50,  3.46it/s]
 99%|█████████▉| 367559/371472 [7:05:02<18:40,  3.49it/s]
 99%|█████████▉| 367560/371472 [7:05:03<18:08,  3.59it/s]
                                                         
{'loss': 2.7087, 'learning_rate': 1.0948307440367169e-07, 'epoch': 15.83}

 99%|█████████▉| 367560/371472 [7:05:03<18:08,  3.59it/s]
 99%|█████████▉| 367561/371472 [7:05:03<17:56,  3.63it/s]
 99%|█████████▉| 367562/371472 [7:05:03<17:55,  3.64it/s]
 99%|█████████▉| 367563/371472 [7:05:04<17:47,  3.66it/s]
 99%|█████████▉| 367564/371472 [7:05:04<17:45,  3.67it/s]
 99%|█████████▉| 367565/371472 [7:05:04<20:07,  3.24it/s]
 99%|█████████▉| 367566/371472 [7:05:04<18:55,  3.44it/s]
 99%|█████████▉| 367567/371472 [7:05:05<20:14,  3.21it/s]
 99%|█████████▉| 367568/371472 [7:05:05<19:55,  3.26it/s]
 99%|█████████▉| 367569/371472 [7:05:05<19:32,  3.33it/s]
 99%|█████████▉| 367570/371472 [7:05:06<18:42,  3.48it/s]
 99%|█████████▉| 367571/371472 [7:05:06<19:12,  3.38it/s]
 99%|█████████▉| 367572/371472 [7:05:06<20:31,  3.17it/s]
 99%|█████████▉| 367573/371472 [7:05:07<19:27,  3.34it/s]
 99%|█████████▉| 367574/371472 [7:05:07<19:51,  3.27it/s]
 99%|█████████▉| 367575/371472 [7:05:07<19:01,  3.42it/s]
 99%|█████████▉| 367576/371472 [7:05:07<18:58,  3.42it/s]
 99%|█████████▉| 367577/371472 [7:05:08<18:47,  3.46it/s]
 99%|█████████▉| 367578/371472 [7:05:08<19:16,  3.37it/s]
 99%|█████████▉| 367579/371472 [7:05:08<19:03,  3.40it/s]
 99%|█████████▉| 367580/371472 [7:05:09<19:14,  3.37it/s]
                                                         
{'loss': 2.5989, 'learning_rate': 1.0943459242819285e-07, 'epoch': 15.83}

 99%|█████████▉| 367580/371472 [7:05:09<19:14,  3.37it/s]
 99%|█████████▉| 367581/371472 [7:05:09<19:28,  3.33it/s]
 99%|█████████▉| 367582/371472 [7:05:09<18:59,  3.41it/s]
 99%|█████████▉| 367583/371472 [7:05:10<19:54,  3.25it/s]
 99%|█████████▉| 367584/371472 [7:05:10<21:59,  2.95it/s]
 99%|█████████▉| 367585/371472 [7:05:10<20:24,  3.18it/s]
 99%|█████████▉| 367586/371472 [7:05:11<19:23,  3.34it/s]
 99%|█████████▉| 367587/371472 [7:05:11<18:29,  3.50it/s]
 99%|█████████▉| 367588/371472 [7:05:11<18:48,  3.44it/s]
 99%|█████████▉| 367589/371472 [7:05:11<18:41,  3.46it/s]
 99%|█████████▉| 367590/371472 [7:05:12<18:13,  3.55it/s]
 99%|█████████▉| 367591/371472 [7:05:12<17:29,  3.70it/s]
 99%|█████████▉| 367592/371472 [7:05:12<17:12,  3.76it/s]
 99%|█████████▉| 367593/371472 [7:05:12<17:52,  3.62it/s]
 99%|█████████▉| 367594/371472 [7:05:13<17:53,  3.61it/s]
 99%|█████████▉| 367595/371472 [7:05:13<17:39,  3.66it/s]
 99%|█████████▉| 367596/371472 [7:05:13<17:36,  3.67it/s]
 99%|█████████▉| 367597/371472 [7:05:14<18:35,  3.47it/s]
 99%|█████████▉| 367598/371472 [7:05:14<18:06,  3.57it/s]
 99%|█████████▉| 367599/371472 [7:05:14<19:14,  3.36it/s]
 99%|█████████▉| 367600/371472 [7:05:14<18:14,  3.54it/s]
                                                         
{'loss': 2.5077, 'learning_rate': 1.0938611045271391e-07, 'epoch': 15.83}

 99%|█████████▉| 367600/371472 [7:05:14<18:14,  3.54it/s]
 99%|█████████▉| 367601/371472 [7:05:15<18:43,  3.44it/s]
 99%|█████████▉| 367602/371472 [7:05:15<18:14,  3.54it/s]
 99%|█████████▉| 367603/371472 [7:05:15<17:52,  3.61it/s]
 99%|█████████▉| 367604/371472 [7:05:16<18:13,  3.54it/s]
 99%|█████████▉| 367605/371472 [7:05:16<17:35,  3.66it/s]
 99%|█████████▉| 367606/371472 [7:05:16<17:54,  3.60it/s]
 99%|█████████▉| 367607/371472 [7:05:16<17:17,  3.73it/s]
 99%|█████████▉| 367608/371472 [7:05:17<17:02,  3.78it/s]
 99%|█████████▉| 367609/371472 [7:05:17<17:12,  3.74it/s]
 99%|█████████▉| 367610/371472 [7:05:17<17:17,  3.72it/s]
 99%|█████████▉| 367611/371472 [7:05:17<17:48,  3.61it/s]
 99%|█████████▉| 367612/371472 [7:05:18<17:38,  3.65it/s]
 99%|█████████▉| 367613/371472 [7:05:18<17:17,  3.72it/s]
 99%|█████████▉| 367614/371472 [7:05:18<16:45,  3.84it/s]
 99%|█████████▉| 367615/371472 [7:05:18<17:12,  3.74it/s]
 99%|█████████▉| 367616/371472 [7:05:19<17:14,  3.73it/s]
 99%|█████████▉| 367617/371472 [7:05:19<16:54,  3.80it/s]
 99%|█████████▉| 367618/371472 [7:05:19<16:58,  3.79it/s]
 99%|█████████▉| 367619/371472 [7:05:20<18:29,  3.47it/s]
 99%|█████████▉| 367620/371472 [7:05:20<18:44,  3.43it/s]
                                                         
{'loss': 2.6157, 'learning_rate': 1.0933762847723497e-07, 'epoch': 15.83}

 99%|█████████▉| 367620/371472 [7:05:20<18:44,  3.43it/s]
 99%|█████████▉| 367621/371472 [7:05:20<18:25,  3.48it/s]
 99%|█████████▉| 367622/371472 [7:05:20<17:25,  3.68it/s]
 99%|█████████▉| 367623/371472 [7:05:21<17:15,  3.72it/s]
 99%|█████████▉| 367624/371472 [7:05:21<16:42,  3.84it/s]
 99%|█████████▉| 367625/371472 [7:05:21<18:16,  3.51it/s]
 99%|█████████▉| 367626/371472 [7:05:22<17:49,  3.60it/s]
 99%|█████████▉| 367627/371472 [7:05:22<17:26,  3.67it/s]
 99%|█████████▉| 367628/371472 [7:05:22<16:59,  3.77it/s]
 99%|█████████▉| 367629/371472 [7:05:22<17:41,  3.62it/s]
 99%|█████████▉| 367630/371472 [7:05:23<17:31,  3.65it/s]
 99%|█████████▉| 367631/371472 [7:05:23<17:17,  3.70it/s]
 99%|█████████▉| 367632/371472 [7:05:23<17:10,  3.73it/s]
 99%|█████████▉| 367633/371472 [7:05:23<17:17,  3.70it/s]
 99%|█████████▉| 367634/371472 [7:05:24<17:50,  3.59it/s]
 99%|█████████▉| 367635/371472 [7:05:24<17:53,  3.57it/s]
 99%|█████████▉| 367636/371472 [7:05:24<17:22,  3.68it/s]
 99%|█████████▉| 367637/371472 [7:05:25<17:44,  3.60it/s]
 99%|█████████▉| 367638/371472 [7:05:25<17:35,  3.63it/s]
 99%|█████████▉| 367639/371472 [7:05:25<17:03,  3.75it/s]
 99%|█████████▉| 367640/371472 [7:05:25<16:55,  3.77it/s]
                                                         
{'loss': 2.5226, 'learning_rate': 1.0928914650175612e-07, 'epoch': 15.83}

 99%|█████████▉| 367640/371472 [7:05:25<16:55,  3.77it/s]
 99%|█████████▉| 367641/371472 [7:05:26<17:08,  3.72it/s]
 99%|█████████▉| 367642/371472 [7:05:26<17:55,  3.56it/s]
 99%|█████████▉| 367643/371472 [7:05:26<19:53,  3.21it/s]
 99%|█████████▉| 367644/371472 [7:05:27<19:03,  3.35it/s]
 99%|█████████▉| 367645/371472 [7:05:27<18:43,  3.41it/s]
 99%|█████████▉| 367646/371472 [7:05:27<17:59,  3.54it/s]
 99%|█████████▉| 367647/371472 [7:05:27<17:33,  3.63it/s]
 99%|█████████▉| 367648/371472 [7:05:28<17:47,  3.58it/s]
 99%|█████████▉| 367649/371472 [7:05:28<19:13,  3.31it/s]
 99%|█████████▉| 367650/371472 [7:05:28<18:52,  3.38it/s]
 99%|█████████▉| 367651/371472 [7:05:29<18:13,  3.50it/s]
 99%|█████████▉| 367652/371472 [7:05:29<17:51,  3.56it/s]
 99%|█████████▉| 367653/371472 [7:05:29<18:11,  3.50it/s]
 99%|█████████▉| 367654/371472 [7:05:29<19:14,  3.31it/s]
 99%|█████████▉| 367655/371472 [7:05:30<18:38,  3.41it/s]
 99%|█████████▉| 367656/371472 [7:05:30<18:16,  3.48it/s]
 99%|█████████▉| 367657/371472 [7:05:30<17:54,  3.55it/s]
 99%|█████████▉| 367658/371472 [7:05:31<18:36,  3.42it/s]
 99%|█████████▉| 367659/371472 [7:05:31<20:12,  3.15it/s]
 99%|█████████▉| 367660/371472 [7:05:31<18:50,  3.37it/s]
                                                         
{'loss': 2.5803, 'learning_rate': 1.0924066452627719e-07, 'epoch': 15.84}

 99%|█████████▉| 367660/371472 [7:05:31<18:50,  3.37it/s]
 99%|█████████▉| 367661/371472 [7:05:31<18:33,  3.42it/s]
 99%|█████████▉| 367662/371472 [7:05:32<17:53,  3.55it/s]
 99%|█████████▉| 367663/371472 [7:05:32<17:38,  3.60it/s]
 99%|█████████▉| 367664/371472 [7:05:32<19:29,  3.26it/s]
 99%|█████████▉| 367665/371472 [7:05:33<18:42,  3.39it/s]
 99%|█████████▉| 367666/371472 [7:05:33<18:23,  3.45it/s]
 99%|█████████▉| 367667/371472 [7:05:33<18:13,  3.48it/s]
 99%|█████████▉| 367668/371472 [7:05:33<17:57,  3.53it/s]
 99%|█████████▉| 367669/371472 [7:05:34<19:18,  3.28it/s]
 99%|█████████▉| 367670/371472 [7:05:34<22:39,  2.80it/s]
 99%|█████████▉| 367671/371472 [7:05:35<20:53,  3.03it/s]
 99%|█████████▉| 367672/371472 [7:05:35<19:40,  3.22it/s]
 99%|█████████▉| 367673/371472 [7:05:35<18:35,  3.41it/s]
 99%|█████████▉| 367674/371472 [7:05:35<18:09,  3.49it/s]
 99%|█████████▉| 367675/371472 [7:05:36<17:33,  3.60it/s]
 99%|█████████▉| 367676/371472 [7:05:36<17:23,  3.64it/s]
 99%|█████████▉| 367677/371472 [7:05:36<17:41,  3.58it/s]
 99%|█████████▉| 367678/371472 [7:05:36<17:14,  3.67it/s]
 99%|█████████▉| 367679/371472 [7:05:37<16:59,  3.72it/s]
 99%|█████████▉| 367680/371472 [7:05:37<17:26,  3.62it/s]
                                                         
{'loss': 2.5906, 'learning_rate': 1.0919218255079834e-07, 'epoch': 15.84}

 99%|█████████▉| 367680/371472 [7:05:37<17:26,  3.62it/s]
 99%|█████████▉| 367681/371472 [7:05:37<18:59,  3.33it/s]
 99%|█████████▉| 367682/371472 [7:05:38<18:41,  3.38it/s]
 99%|█████████▉| 367683/371472 [7:05:38<18:27,  3.42it/s]
 99%|█████████▉| 367684/371472 [7:05:38<18:46,  3.36it/s]
 99%|█████████▉| 367685/371472 [7:05:38<17:37,  3.58it/s]
 99%|█████████▉| 367686/371472 [7:05:39<16:58,  3.72it/s]
 99%|█████████▉| 367687/371472 [7:05:39<16:31,  3.82it/s]
 99%|█████████▉| 367688/371472 [7:05:39<16:26,  3.84it/s]
 99%|█████████▉| 367689/371472 [7:05:40<16:43,  3.77it/s]
 99%|█████████▉| 367690/371472 [7:05:40<16:50,  3.74it/s]
 99%|█████████▉| 367691/371472 [7:05:40<17:47,  3.54it/s]
 99%|█████████▉| 367692/371472 [7:05:40<17:41,  3.56it/s]
 99%|█████████▉| 367693/371472 [7:05:41<17:29,  3.60it/s]
 99%|█████████▉| 367694/371472 [7:05:41<18:43,  3.36it/s]
 99%|█████████▉| 367695/371472 [7:05:41<18:21,  3.43it/s]
 99%|█████████▉| 367696/371472 [7:05:42<18:31,  3.40it/s]
 99%|█████████▉| 367697/371472 [7:05:42<19:16,  3.26it/s]
 99%|█████████▉| 367698/371472 [7:05:42<18:39,  3.37it/s]
 99%|█████████▉| 367699/371472 [7:05:42<17:46,  3.54it/s]
 99%|█████████▉| 367700/371472 [7:05:43<17:27,  3.60it/s]
                                                         
{'loss': 2.511, 'learning_rate': 1.091437005753194e-07, 'epoch': 15.84}

 99%|█████████▉| 367700/371472 [7:05:43<17:27,  3.60it/s]
 99%|█████████▉| 367701/371472 [7:05:43<18:33,  3.39it/s]
 99%|█████████▉| 367702/371472 [7:05:43<17:45,  3.54it/s]
 99%|█████████▉| 367703/371472 [7:05:44<17:08,  3.67it/s]
 99%|█████████▉| 367704/371472 [7:05:44<18:23,  3.42it/s]
 99%|█████████▉| 367705/371472 [7:05:44<17:47,  3.53it/s]
 99%|█████████▉| 367706/371472 [7:05:44<17:20,  3.62it/s]
 99%|█████████▉| 367707/371472 [7:05:45<17:18,  3.63it/s]
 99%|█████████▉| 367708/371472 [7:05:45<17:27,  3.59it/s]
 99%|█████████▉| 367709/371472 [7:05:45<17:06,  3.66it/s]
 99%|█████████▉| 367710/371472 [7:05:45<16:43,  3.75it/s]
 99%|█████████▉| 367711/371472 [7:05:46<18:46,  3.34it/s]
 99%|█████████▉| 367712/371472 [7:05:46<19:20,  3.24it/s]
 99%|█████████▉| 367713/371472 [7:05:46<19:06,  3.28it/s]
 99%|█████████▉| 367714/371472 [7:05:47<18:31,  3.38it/s]
 99%|█████████▉| 367715/371472 [7:05:47<19:11,  3.26it/s]
 99%|█████████▉| 367716/371472 [7:05:47<18:41,  3.35it/s]
 99%|█████████▉| 367717/371472 [7:05:48<17:30,  3.57it/s]
 99%|█████████▉| 367718/371472 [7:05:48<17:33,  3.56it/s]
 99%|█████████▉| 367719/371472 [7:05:48<17:10,  3.64it/s]
 99%|█████████▉| 367720/371472 [7:05:48<16:30,  3.79it/s]
                                                         
{'loss': 2.359, 'learning_rate': 1.0909521859984055e-07, 'epoch': 15.84}

 99%|█████████▉| 367720/371472 [7:05:48<16:30,  3.79it/s]
 99%|█████████▉| 367721/371472 [7:05:49<17:56,  3.48it/s]
 99%|█████████▉| 367722/371472 [7:05:49<17:06,  3.65it/s]
 99%|█████████▉| 367723/371472 [7:05:49<18:21,  3.40it/s]
 99%|█████████▉| 367724/371472 [7:05:50<18:04,  3.46it/s]
 99%|█████████▉| 367725/371472 [7:05:50<18:19,  3.41it/s]
 99%|█████████▉| 367726/371472 [7:05:50<17:53,  3.49it/s]
 99%|█████████▉| 367727/371472 [7:05:50<17:47,  3.51it/s]
 99%|█████████▉| 367728/371472 [7:05:51<17:11,  3.63it/s]
 99%|█████████▉| 367729/371472 [7:05:51<18:43,  3.33it/s]
 99%|█████████▉| 367730/371472 [7:05:51<19:08,  3.26it/s]
 99%|█████████▉| 367731/371472 [7:05:52<19:30,  3.20it/s]
 99%|█████████▉| 367732/371472 [7:05:52<19:10,  3.25it/s]
 99%|█████████▉| 367733/371472 [7:05:52<19:48,  3.15it/s]
 99%|█████████▉| 367734/371472 [7:05:53<18:44,  3.32it/s]
 99%|█████████▉| 367735/371472 [7:05:53<17:44,  3.51it/s]
 99%|█████████▉| 367736/371472 [7:05:53<17:45,  3.51it/s]
 99%|█████████▉| 367737/371472 [7:05:53<17:36,  3.54it/s]
 99%|█████████▉| 367738/371472 [7:05:54<16:43,  3.72it/s]
 99%|█████████▉| 367739/371472 [7:05:54<16:41,  3.73it/s]
 99%|█████████▉| 367740/371472 [7:05:54<17:52,  3.48it/s]
                                                         
{'loss': 2.4398, 'learning_rate': 1.0904673662436161e-07, 'epoch': 15.84}

 99%|█████████▉| 367740/371472 [7:05:54<17:52,  3.48it/s]
 99%|█████████▉| 367741/371472 [7:05:55<18:29,  3.36it/s]
 99%|█████████▉| 367742/371472 [7:05:55<17:53,  3.48it/s]
 99%|█████████▉| 367743/371472 [7:05:55<18:06,  3.43it/s]
 99%|█████████▉| 367744/371472 [7:05:55<18:10,  3.42it/s]
 99%|█████████▉| 367745/371472 [7:05:56<18:07,  3.43it/s]
 99%|█████████▉| 367746/371472 [7:05:56<17:58,  3.45it/s]
 99%|█████████▉| 367747/371472 [7:05:56<18:10,  3.42it/s]
 99%|█████████▉| 367748/371472 [7:05:57<18:47,  3.30it/s]
 99%|█████████▉| 367749/371472 [7:05:57<18:01,  3.44it/s]
 99%|█████████▉| 367750/371472 [7:05:57<17:21,  3.57it/s]
 99%|█████████▉| 367751/371472 [7:05:57<17:08,  3.62it/s]
 99%|█████████▉| 367752/371472 [7:05:58<16:34,  3.74it/s]
 99%|█████████▉| 367753/371472 [7:05:58<17:05,  3.63it/s]
 99%|█████████▉| 367754/371472 [7:05:58<17:53,  3.46it/s]
 99%|█████████▉| 367755/371472 [7:05:59<17:14,  3.59it/s]
 99%|█████████▉| 367756/371472 [7:05:59<17:39,  3.51it/s]
 99%|█████████▉| 367757/371472 [7:05:59<17:00,  3.64it/s]
 99%|█████████▉| 367758/371472 [7:05:59<16:44,  3.70it/s]
 99%|█████████▉| 367759/371472 [7:06:00<16:45,  3.69it/s]
 99%|█████████▉| 367760/371472 [7:06:00<17:08,  3.61it/s]
                                                         
{'loss': 2.5133, 'learning_rate': 1.0899825464888277e-07, 'epoch': 15.84}

 99%|█████████▉| 367760/371472 [7:06:00<17:08,  3.61it/s]
 99%|█████████▉| 367761/371472 [7:06:00<17:56,  3.45it/s]
 99%|█████████▉| 367762/371472 [7:06:00<17:29,  3.54it/s]
 99%|█████████▉| 367763/371472 [7:06:01<17:23,  3.56it/s]
 99%|█████████▉| 367764/371472 [7:06:01<17:04,  3.62it/s]
 99%|█████████▉| 367765/371472 [7:06:01<17:46,  3.48it/s]
 99%|█████████▉| 367766/371472 [7:06:02<17:25,  3.55it/s]
 99%|█████████▉| 367767/371472 [7:06:02<17:43,  3.48it/s]
 99%|█████████▉| 367768/371472 [7:06:02<17:33,  3.52it/s]
 99%|█████████▉| 367769/371472 [7:06:02<17:29,  3.53it/s]
 99%|█████████▉| 367770/371472 [7:06:03<18:26,  3.35it/s]
 99%|█████████▉| 367771/371472 [7:06:03<17:58,  3.43it/s]
 99%|█████████▉| 367772/371472 [7:06:03<18:58,  3.25it/s]
 99%|█████████▉| 367773/371472 [7:06:04<18:34,  3.32it/s]
 99%|█████████▉| 367774/371472 [7:06:04<18:06,  3.40it/s]
 99%|█████████▉| 367775/371472 [7:06:04<18:18,  3.37it/s]
 99%|█████████▉| 367776/371472 [7:06:05<17:51,  3.45it/s]
 99%|█████████▉| 367777/371472 [7:06:05<17:50,  3.45it/s]
 99%|█████████▉| 367778/371472 [7:06:05<19:14,  3.20it/s]
 99%|█████████▉| 367779/371472 [7:06:06<19:45,  3.12it/s]
 99%|█████████▉| 367780/371472 [7:06:06<18:31,  3.32it/s]
                                                         
{'loss': 2.6249, 'learning_rate': 1.0894977267340383e-07, 'epoch': 15.84}

 99%|█████████▉| 367780/371472 [7:06:06<18:31,  3.32it/s]
 99%|█████████▉| 367781/371472 [7:06:06<19:45,  3.11it/s]
 99%|█████████▉| 367782/371472 [7:06:06<19:10,  3.21it/s]
 99%|█████████▉| 367783/371472 [7:06:07<19:06,  3.22it/s]
 99%|█████████▉| 367784/371472 [7:06:07<19:05,  3.22it/s]
 99%|█████████▉| 367785/371472 [7:06:07<18:23,  3.34it/s]
 99%|█████████▉| 367786/371472 [7:06:08<18:49,  3.26it/s]
 99%|█████████▉| 367787/371472 [7:06:08<18:05,  3.39it/s]
 99%|█████████▉| 367788/371472 [7:06:08<17:58,  3.42it/s]
 99%|█████████▉| 367789/371472 [7:06:09<18:12,  3.37it/s]
 99%|█████████▉| 367790/371472 [7:06:09<17:42,  3.46it/s]
 99%|█████████▉| 367791/371472 [7:06:09<18:50,  3.26it/s]
 99%|█████████▉| 367792/371472 [7:06:09<18:38,  3.29it/s]
 99%|█████████▉| 367793/371472 [7:06:10<18:09,  3.38it/s]
 99%|█████████▉| 367794/371472 [7:06:10<17:38,  3.48it/s]
 99%|█████████▉| 367795/371472 [7:06:10<17:00,  3.60it/s]
 99%|█████████▉| 367796/371472 [7:06:11<16:31,  3.71it/s]
 99%|█████████▉| 367797/371472 [7:06:11<16:25,  3.73it/s]
 99%|█████████▉| 367798/371472 [7:06:11<16:38,  3.68it/s]
 99%|█████████▉| 367799/371472 [7:06:11<16:13,  3.77it/s]
 99%|█████████▉| 367800/371472 [7:06:12<17:11,  3.56it/s]
                                                         
{'loss': 2.6033, 'learning_rate': 1.0890129069792498e-07, 'epoch': 15.84}

 99%|█████████▉| 367800/371472 [7:06:12<17:11,  3.56it/s]
 99%|█████████▉| 367801/371472 [7:06:12<17:02,  3.59it/s]
 99%|█████████▉| 367802/371472 [7:06:12<16:48,  3.64it/s]
 99%|█████████▉| 367803/371472 [7:06:12<16:41,  3.66it/s]
 99%|█████████▉| 367804/371472 [7:06:13<16:32,  3.69it/s]
 99%|█████████▉| 367805/371472 [7:06:13<16:10,  3.78it/s]
 99%|█████████▉| 367806/371472 [7:06:13<16:34,  3.69it/s]
 99%|█████████▉| 367807/371472 [7:06:14<17:09,  3.56it/s]
 99%|█████████▉| 367808/371472 [7:06:14<18:10,  3.36it/s]
 99%|█████████▉| 367809/371472 [7:06:14<18:30,  3.30it/s]
 99%|█████████▉| 367810/371472 [7:06:15<18:51,  3.24it/s]
 99%|█████████▉| 367811/371472 [7:06:15<17:46,  3.43it/s]
 99%|█████████▉| 367812/371472 [7:06:15<18:06,  3.37it/s]
 99%|█████████▉| 367813/371472 [7:06:15<17:46,  3.43it/s]
 99%|█████████▉| 367814/371472 [7:06:16<16:59,  3.59it/s]
 99%|█████████▉| 367815/371472 [7:06:16<16:49,  3.62it/s]
 99%|█████████▉| 367816/371472 [7:06:16<16:46,  3.63it/s]
 99%|█████████▉| 367817/371472 [7:06:16<16:41,  3.65it/s]
 99%|█████████▉| 367818/371472 [7:06:17<17:07,  3.55it/s]
 99%|█████████▉| 367819/371472 [7:06:17<17:03,  3.57it/s]
 99%|█████████▉| 367820/371472 [7:06:17<18:44,  3.25it/s]
                                                         
{'loss': 2.5214, 'learning_rate': 1.0885280872244604e-07, 'epoch': 15.84}

 99%|█████████▉| 367820/371472 [7:06:17<18:44,  3.25it/s]
 99%|█████████▉| 367821/371472 [7:06:18<18:16,  3.33it/s]
 99%|█████████▉| 367822/371472 [7:06:18<19:08,  3.18it/s]
 99%|█████████▉| 367823/371472 [7:06:18<18:53,  3.22it/s]
 99%|█████████▉| 367824/371472 [7:06:19<17:46,  3.42it/s]
 99%|█████████▉| 367825/371472 [7:06:19<17:15,  3.52it/s]
 99%|█████████▉| 367826/371472 [7:06:19<16:59,  3.58it/s]
 99%|█████████▉| 367827/371472 [7:06:19<17:17,  3.51it/s]
 99%|█████████▉| 367828/371472 [7:06:20<17:14,  3.52it/s]
 99%|█████████▉| 367829/371472 [7:06:20<17:40,  3.44it/s]
 99%|█████████▉| 367830/371472 [7:06:20<17:12,  3.53it/s]
 99%|█████████▉| 367831/371472 [7:06:21<17:25,  3.48it/s]
 99%|█████████▉| 367832/371472 [7:06:21<17:46,  3.41it/s]
 99%|█████████▉| 367833/371472 [7:06:21<17:04,  3.55it/s]
 99%|█████████▉| 367834/371472 [7:06:21<16:34,  3.66it/s]
 99%|█████████▉| 367835/371472 [7:06:22<16:39,  3.64it/s]
 99%|█████████▉| 367836/371472 [7:06:22<16:44,  3.62it/s]
 99%|█████████▉| 367837/371472 [7:06:22<16:37,  3.64it/s]
 99%|█████████▉| 367838/371472 [7:06:22<16:23,  3.70it/s]
 99%|█████████▉| 367839/371472 [7:06:23<16:20,  3.71it/s]
 99%|█████████▉| 367840/371472 [7:06:23<16:37,  3.64it/s]
                                                         
{'loss': 2.5907, 'learning_rate': 1.0880432674696722e-07, 'epoch': 15.84}

 99%|█████████▉| 367840/371472 [7:06:23<16:37,  3.64it/s]
 99%|█████████▉| 367841/371472 [7:06:23<16:45,  3.61it/s]
 99%|█████████▉| 367842/371472 [7:06:24<16:52,  3.58it/s]
 99%|█████████▉| 367843/371472 [7:06:24<17:13,  3.51it/s]
 99%|█████████▉| 367844/371472 [7:06:24<17:09,  3.52it/s]
 99%|█████████▉| 367845/371472 [7:06:24<16:39,  3.63it/s]
 99%|█████████▉| 367846/371472 [7:06:25<18:20,  3.30it/s]
 99%|█████████▉| 367847/371472 [7:06:25<18:01,  3.35it/s]
 99%|█████████▉| 367848/371472 [7:06:25<17:54,  3.37it/s]
 99%|█████████▉| 367849/371472 [7:06:26<18:26,  3.28it/s]
 99%|█████████▉| 367850/371472 [7:06:26<17:34,  3.44it/s]
 99%|█████████▉| 367851/371472 [7:06:26<18:05,  3.34it/s]
 99%|█████████▉| 367852/371472 [7:06:27<18:06,  3.33it/s]
 99%|█████████▉| 367853/371472 [7:06:27<18:02,  3.34it/s]
 99%|█████████▉| 367854/371472 [7:06:27<17:29,  3.45it/s]
 99%|█████████▉| 367855/371472 [7:06:27<17:15,  3.49it/s]
 99%|█████████▉| 367856/371472 [7:06:28<16:40,  3.61it/s]
 99%|█████████▉| 367857/371472 [7:06:28<17:40,  3.41it/s]
 99%|█████████▉| 367858/371472 [7:06:28<17:06,  3.52it/s]
 99%|█████████▉| 367859/371472 [7:06:28<16:44,  3.60it/s]
 99%|█████████▉| 367860/371472 [7:06:29<17:04,  3.53it/s]
                                                         
{'loss': 2.4936, 'learning_rate': 1.0875584477148826e-07, 'epoch': 15.84}

 99%|█████████▉| 367860/371472 [7:06:29<17:04,  3.53it/s]
 99%|█████████▉| 367861/371472 [7:06:29<16:33,  3.63it/s]
 99%|█████████▉| 367862/371472 [7:06:29<17:45,  3.39it/s]
 99%|█████████▉| 367863/371472 [7:06:30<17:52,  3.37it/s]
 99%|█████████▉| 367864/371472 [7:06:30<17:30,  3.44it/s]
 99%|█████████▉| 367865/371472 [7:06:30<17:45,  3.39it/s]
 99%|█████████▉| 367866/371472 [7:06:31<17:37,  3.41it/s]
 99%|█████████▉| 367867/371472 [7:06:31<16:51,  3.56it/s]
 99%|█████████▉| 367868/371472 [7:06:31<16:19,  3.68it/s]
 99%|█████████▉| 367869/371472 [7:06:31<16:07,  3.72it/s]
 99%|█████████▉| 367870/371472 [7:06:32<16:07,  3.72it/s]
 99%|█████████▉| 367871/371472 [7:06:32<15:42,  3.82it/s]
 99%|█████████▉| 367872/371472 [7:06:32<16:10,  3.71it/s]
 99%|█████████▉| 367873/371472 [7:06:32<16:06,  3.72it/s]
 99%|█████████▉| 367874/371472 [7:06:33<15:52,  3.78it/s]
 99%|█████████▉| 367875/371472 [7:06:33<15:22,  3.90it/s]
 99%|█████████▉| 367876/371472 [7:06:33<17:30,  3.42it/s]
 99%|█████████▉| 367877/371472 [7:06:34<18:06,  3.31it/s]
 99%|█████████▉| 367878/371472 [7:06:34<17:12,  3.48it/s]
 99%|█████████▉| 367879/371472 [7:06:34<17:06,  3.50it/s]
 99%|█████████▉| 367880/371472 [7:06:34<16:47,  3.57it/s]
                                                         
{'loss': 2.6067, 'learning_rate': 1.0870736279600941e-07, 'epoch': 15.85}

 99%|█████████▉| 367880/371472 [7:06:34<16:47,  3.57it/s]
 99%|█████████▉| 367881/371472 [7:06:35<16:59,  3.52it/s]
 99%|█████████▉| 367882/371472 [7:06:35<17:12,  3.48it/s]
 99%|█████████▉| 367883/371472 [7:06:35<16:54,  3.54it/s]
 99%|█████████▉| 367884/371472 [7:06:36<16:27,  3.63it/s]
 99%|█████████▉| 367885/371472 [7:06:36<16:12,  3.69it/s]
 99%|█████████▉| 367886/371472 [7:06:36<16:15,  3.68it/s]
 99%|█████████▉| 367887/371472 [7:06:36<16:28,  3.63it/s]
 99%|█████████▉| 367888/371472 [7:06:37<16:24,  3.64it/s]
 99%|█████████▉| 367889/371472 [7:06:37<16:46,  3.56it/s]
 99%|█████████▉| 367890/371472 [7:06:37<16:21,  3.65it/s]
 99%|█████████▉| 367891/371472 [7:06:37<15:52,  3.76it/s]
 99%|█████████▉| 367892/371472 [7:06:38<15:58,  3.74it/s]
 99%|█████████▉| 367893/371472 [7:06:38<16:22,  3.64it/s]
 99%|█████████▉| 367894/371472 [7:06:38<16:17,  3.66it/s]
 99%|█████████▉| 367895/371472 [7:06:39<16:42,  3.57it/s]
 99%|█████████▉| 367896/371472 [7:06:39<16:34,  3.60it/s]
 99%|█████████▉| 367897/371472 [7:06:39<16:13,  3.67it/s]
 99%|█████████▉| 367898/371472 [7:06:39<16:59,  3.51it/s]
 99%|█████████▉| 367899/371472 [7:06:40<16:55,  3.52it/s]
 99%|█████████▉| 367900/371472 [7:06:40<16:56,  3.52it/s]
                                                         
{'loss': 2.6242, 'learning_rate': 1.0865888082053047e-07, 'epoch': 15.85}

 99%|█████████▉| 367900/371472 [7:06:40<16:56,  3.52it/s]
 99%|█████████▉| 367901/371472 [7:06:40<16:46,  3.55it/s]
 99%|█████████▉| 367902/371472 [7:06:40<16:38,  3.57it/s]
 99%|█████████▉| 367903/371472 [7:06:41<15:47,  3.77it/s]
 99%|█████████▉| 367904/371472 [7:06:41<15:57,  3.73it/s]
 99%|█████████▉| 367905/371472 [7:06:41<15:44,  3.78it/s]
 99%|█████████▉| 367906/371472 [7:06:42<16:18,  3.64it/s]
 99%|█████████▉| 367907/371472 [7:06:42<15:58,  3.72it/s]
 99%|█████████▉| 367908/371472 [7:06:42<16:11,  3.67it/s]
 99%|█████████▉| 367909/371472 [7:06:42<16:06,  3.69it/s]
 99%|█████████▉| 367910/371472 [7:06:43<15:46,  3.76it/s]
 99%|█████████▉| 367911/371472 [7:06:43<15:53,  3.73it/s]
 99%|█████████▉| 367912/371472 [7:06:43<16:00,  3.70it/s]
 99%|█████████▉| 367913/371472 [7:06:43<16:11,  3.67it/s]
 99%|█████████▉| 367914/371472 [7:06:44<15:39,  3.79it/s]
 99%|█████████▉| 367915/371472 [7:06:44<15:31,  3.82it/s]
 99%|█████████▉| 367916/371472 [7:06:44<15:04,  3.93it/s]
 99%|█████████▉| 367917/371472 [7:06:44<15:24,  3.85it/s]
 99%|█████████▉| 367918/371472 [7:06:45<15:56,  3.71it/s]
 99%|█████████▉| 367919/371472 [7:06:45<17:19,  3.42it/s]
 99%|█████████▉| 367920/371472 [7:06:45<17:33,  3.37it/s]
                                                         
{'loss': 2.833, 'learning_rate': 1.0861039884505164e-07, 'epoch': 15.85}

 99%|█████████▉| 367920/371472 [7:06:45<17:33,  3.37it/s]
 99%|█████████▉| 367921/371472 [7:06:46<16:46,  3.53it/s]
 99%|█████████▉| 367922/371472 [7:06:46<16:27,  3.60it/s]
 99%|█████████▉| 367923/371472 [7:06:46<16:33,  3.57it/s]
 99%|█████████▉| 367924/371472 [7:06:46<16:14,  3.64it/s]
 99%|█████████▉| 367925/371472 [7:06:47<16:21,  3.62it/s]
 99%|█████████▉| 367926/371472 [7:06:47<17:46,  3.33it/s]
 99%|█████████▉| 367927/371472 [7:06:47<17:31,  3.37it/s]
 99%|█████████▉| 367928/371472 [7:06:48<17:03,  3.46it/s]
 99%|█████████▉| 367929/371472 [7:06:48<17:02,  3.47it/s]
 99%|█████████▉| 367930/371472 [7:06:48<17:09,  3.44it/s]
 99%|█████████▉| 367931/371472 [7:06:49<18:11,  3.24it/s]
 99%|█████████▉| 367932/371472 [7:06:49<17:59,  3.28it/s]
 99%|█████████▉| 367933/371472 [7:06:49<17:38,  3.34it/s]
 99%|█████████▉| 367934/371472 [7:06:49<17:31,  3.36it/s]
 99%|█████████▉| 367935/371472 [7:06:50<18:30,  3.18it/s]
 99%|█████████▉| 367936/371472 [7:06:50<18:07,  3.25it/s]
 99%|█████████▉| 367937/371472 [7:06:50<17:23,  3.39it/s]
 99%|█████████▉| 367938/371472 [7:06:51<16:48,  3.50it/s]
 99%|█████████▉| 367939/371472 [7:06:51<16:54,  3.48it/s]
 99%|█████████▉| 367940/371472 [7:06:51<16:30,  3.57it/s]
                                                         
{'loss': 2.4719, 'learning_rate': 1.085619168695727e-07, 'epoch': 15.85}

 99%|█████████▉| 367940/371472 [7:06:51<16:30,  3.57it/s]
 99%|█████████▉| 367941/371472 [7:06:51<16:12,  3.63it/s]
 99%|█████████▉| 367942/371472 [7:06:52<16:04,  3.66it/s]
 99%|█████████▉| 367943/371472 [7:06:52<15:40,  3.75it/s]
 99%|█████████▉| 367944/371472 [7:06:52<17:06,  3.44it/s]
 99%|█████████▉| 367945/371472 [7:06:53<17:56,  3.28it/s]
 99%|█████████▉| 367946/371472 [7:06:53<17:08,  3.43it/s]
 99%|█████████▉| 367947/371472 [7:06:53<18:03,  3.25it/s]
 99%|█████████▉| 367948/371472 [7:06:54<17:24,  3.37it/s]
 99%|█████████▉| 367949/371472 [7:06:54<16:47,  3.50it/s]
 99%|█████████▉| 367950/371472 [7:06:54<16:08,  3.64it/s]
 99%|█████████▉| 367951/371472 [7:06:54<16:00,  3.67it/s]
 99%|█████████▉| 367952/371472 [7:06:55<15:42,  3.74it/s]
 99%|█████████▉| 367953/371472 [7:06:55<15:35,  3.76it/s]
 99%|█████████▉| 367954/371472 [7:06:55<15:56,  3.68it/s]
 99%|█████████▉| 367955/371472 [7:06:55<15:51,  3.70it/s]
 99%|█████████▉| 367956/371472 [7:06:56<16:19,  3.59it/s]
 99%|█████████▉| 367957/371472 [7:06:56<17:03,  3.43it/s]
 99%|█████████▉| 367958/371472 [7:06:56<16:52,  3.47it/s]
 99%|█████████▉| 367959/371472 [7:06:57<17:38,  3.32it/s]
 99%|█████████▉| 367960/371472 [7:06:57<16:59,  3.44it/s]
                                                         
{'loss': 2.8012, 'learning_rate': 1.0851343489409385e-07, 'epoch': 15.85}

 99%|█████████▉| 367960/371472 [7:06:57<16:59,  3.44it/s]
 99%|█████████▉| 367961/371472 [7:06:57<17:04,  3.43it/s]
 99%|█████████▉| 367962/371472 [7:06:57<16:21,  3.58it/s]
 99%|█████████▉| 367963/371472 [7:06:58<17:32,  3.33it/s]
 99%|█████████▉| 367964/371472 [7:06:58<16:58,  3.44it/s]
 99%|█████████▉| 367965/371472 [7:06:58<16:27,  3.55it/s]
 99%|█████████▉| 367966/371472 [7:06:59<16:22,  3.57it/s]
 99%|█████████▉| 367967/371472 [7:06:59<16:27,  3.55it/s]
 99%|█████████▉| 367968/371472 [7:06:59<17:25,  3.35it/s]
 99%|█████████▉| 367969/371472 [7:06:59<16:30,  3.54it/s]
 99%|█████████▉| 367970/371472 [7:07:00<16:57,  3.44it/s]
 99%|█████████▉| 367971/371472 [7:07:00<16:27,  3.55it/s]
 99%|█████████▉| 367972/371472 [7:07:00<16:08,  3.61it/s]
 99%|█████████▉| 367973/371472 [7:07:01<16:24,  3.55it/s]
 99%|█████████▉| 367974/371472 [7:07:01<16:42,  3.49it/s]
 99%|█████████▉| 367975/371472 [7:07:01<16:56,  3.44it/s]
 99%|█████████▉| 367976/371472 [7:07:01<17:09,  3.40it/s]
 99%|█████████▉| 367977/371472 [7:07:02<17:26,  3.34it/s]
 99%|█████████▉| 367978/371472 [7:07:02<18:04,  3.22it/s]
 99%|█████████▉| 367979/371472 [7:07:02<17:31,  3.32it/s]
 99%|█████████▉| 367980/371472 [7:07:03<17:28,  3.33it/s]
                                                         
{'loss': 2.5388, 'learning_rate': 1.084649529186149e-07, 'epoch': 15.85}

 99%|█████████▉| 367980/371472 [7:07:03<17:28,  3.33it/s]
 99%|█████████▉| 367981/371472 [7:07:03<17:25,  3.34it/s]
 99%|█████████▉| 367982/371472 [7:07:03<17:30,  3.32it/s]
 99%|█████████▉| 367983/371472 [7:07:04<16:34,  3.51it/s]
 99%|█████████▉| 367984/371472 [7:07:04<16:43,  3.48it/s]
 99%|█████████▉| 367985/371472 [7:07:04<17:40,  3.29it/s]
 99%|█████████▉| 367986/371472 [7:07:04<17:44,  3.28it/s]
 99%|█████████▉| 367987/371472 [7:07:05<17:45,  3.27it/s]
 99%|█████████▉| 367988/371472 [7:07:05<17:19,  3.35it/s]
 99%|█████████▉| 367989/371472 [7:07:05<16:34,  3.50it/s]
 99%|█████████▉| 367990/371472 [7:07:06<17:20,  3.35it/s]
 99%|█████████▉| 367991/371472 [7:07:06<16:43,  3.47it/s]
 99%|█████████▉| 367992/371472 [7:07:06<16:48,  3.45it/s]
 99%|█████████▉| 367993/371472 [7:07:07<16:53,  3.43it/s]
 99%|█████████▉| 367994/371472 [7:07:07<16:07,  3.59it/s]
 99%|█████████▉| 367995/371472 [7:07:07<16:50,  3.44it/s]
 99%|█████████▉| 367996/371472 [7:07:07<16:03,  3.61it/s]
 99%|█████████▉| 367997/371472 [7:07:08<17:09,  3.38it/s]
 99%|█████████▉| 367998/371472 [7:07:08<17:27,  3.32it/s]
 99%|█████████▉| 367999/371472 [7:07:08<17:25,  3.32it/s]
 99%|█████████▉| 368000/371472 [7:07:09<18:03,  3.20it/s]
                                                         
{'loss': 2.6826, 'learning_rate': 1.0841647094313606e-07, 'epoch': 15.85}

 99%|█████████▉| 368000/371472 [7:07:09<18:03,  3.20it/s]
 99%|█████████▉| 368001/371472 [7:07:09<17:45,  3.26it/s]
 99%|█████████▉| 368002/371472 [7:07:09<17:30,  3.30it/s]
 99%|█████████▉| 368003/371472 [7:07:10<17:38,  3.28it/s]
 99%|█████████▉| 368004/371472 [7:07:10<17:05,  3.38it/s]
 99%|█████████▉| 368005/371472 [7:07:10<16:39,  3.47it/s]
 99%|█████████▉| 368006/371472 [7:07:10<16:02,  3.60it/s]
 99%|█████████▉| 368007/371472 [7:07:11<16:05,  3.59it/s]
 99%|█████████▉| 368008/371472 [7:07:11<15:35,  3.70it/s]
 99%|█████████▉| 368009/371472 [7:07:11<15:57,  3.62it/s]
 99%|█████████▉| 368010/371472 [7:07:11<15:47,  3.65it/s]
 99%|█████████▉| 368011/371472 [7:07:12<15:43,  3.67it/s]
 99%|█████████▉| 368012/371472 [7:07:12<15:52,  3.63it/s]
 99%|█████████▉| 368013/371472 [7:07:12<16:01,  3.60it/s]
 99%|█████████▉| 368014/371472 [7:07:13<16:24,  3.51it/s]
 99%|█████████▉| 368015/371472 [7:07:13<15:55,  3.62it/s]
 99%|█████████▉| 368016/371472 [7:07:13<16:45,  3.44it/s]
 99%|█████████▉| 368017/371472 [7:07:14<19:07,  3.01it/s]
 99%|█████████▉| 368018/371472 [7:07:14<18:11,  3.17it/s]
 99%|█████████▉| 368019/371472 [7:07:14<17:17,  3.33it/s]
 99%|█████████▉| 368020/371472 [7:07:14<16:57,  3.39it/s]
                                                         
{'loss': 2.5899, 'learning_rate': 1.0836798896765713e-07, 'epoch': 15.85}

 99%|█████████▉| 368020/371472 [7:07:14<16:57,  3.39it/s]
 99%|█████████▉| 368021/371472 [7:07:15<16:53,  3.40it/s]
 99%|█████████▉| 368022/371472 [7:07:15<19:12,  2.99it/s]
 99%|█████████▉| 368023/371472 [7:07:15<18:10,  3.16it/s]
 99%|█████████▉| 368024/371472 [7:07:16<17:23,  3.30it/s]
 99%|█████████▉| 368025/371472 [7:07:16<16:53,  3.40it/s]
 99%|█████████▉| 368026/371472 [7:07:16<16:47,  3.42it/s]
 99%|█████████▉| 368027/371472 [7:07:16<16:05,  3.57it/s]
 99%|█████████▉| 368028/371472 [7:07:17<16:12,  3.54it/s]
 99%|█████████▉| 368029/371472 [7:07:17<16:34,  3.46it/s]
 99%|█████████▉| 368030/371472 [7:07:17<15:44,  3.65it/s]
 99%|█████████▉| 368031/371472 [7:07:18<15:39,  3.66it/s]
 99%|█████████▉| 368032/371472 [7:07:18<15:35,  3.68it/s]
 99%|█████████▉| 368033/371472 [7:07:18<15:05,  3.80it/s]
 99%|█████████▉| 368034/371472 [7:07:18<15:00,  3.82it/s]
 99%|█████████▉| 368035/371472 [7:07:19<15:31,  3.69it/s]
 99%|█████████▉| 368036/371472 [7:07:19<14:54,  3.84it/s]
 99%|█████████▉| 368037/371472 [7:07:19<15:42,  3.64it/s]
 99%|█████████▉| 368038/371472 [7:07:20<17:04,  3.35it/s]
 99%|█████████▉| 368039/371472 [7:07:20<17:23,  3.29it/s]
 99%|█████████▉| 368040/371472 [7:07:20<17:10,  3.33it/s]
                                                         
{'loss': 2.6208, 'learning_rate': 1.0831950699217828e-07, 'epoch': 15.85}

 99%|█████████▉| 368040/371472 [7:07:20<17:10,  3.33it/s]
 99%|█████████▉| 368041/371472 [7:07:20<16:17,  3.51it/s]
 99%|█████████▉| 368042/371472 [7:07:21<15:52,  3.60it/s]
 99%|█████████▉| 368043/371472 [7:07:21<15:55,  3.59it/s]
 99%|█████████▉| 368044/371472 [7:07:21<16:13,  3.52it/s]
 99%|█████████▉| 368045/371472 [7:07:22<16:42,  3.42it/s]
 99%|█████████▉| 368046/371472 [7:07:22<16:55,  3.37it/s]
 99%|█████████▉| 368047/371472 [7:07:22<15:51,  3.60it/s]
 99%|█████████▉| 368048/371472 [7:07:22<15:49,  3.61it/s]
 99%|█████████▉| 368049/371472 [7:07:23<15:35,  3.66it/s]
 99%|█████████▉| 368050/371472 [7:07:23<16:27,  3.47it/s]
 99%|█████████▉| 368051/371472 [7:07:23<16:02,  3.56it/s]
 99%|█████████▉| 368052/371472 [7:07:24<16:25,  3.47it/s]
 99%|█████████▉| 368053/371472 [7:07:24<16:23,  3.48it/s]
 99%|█████████▉| 368054/371472 [7:07:24<15:37,  3.65it/s]
 99%|█████████▉| 368055/371472 [7:07:24<16:00,  3.56it/s]
 99%|█████████▉| 368056/371472 [7:07:25<15:32,  3.66it/s]
 99%|█████████▉| 368057/371472 [7:07:25<15:56,  3.57it/s]
 99%|█████████▉| 368058/371472 [7:07:25<16:04,  3.54it/s]
 99%|█████████▉| 368059/371472 [7:07:26<17:01,  3.34it/s]
 99%|█████████▉| 368060/371472 [7:07:26<17:06,  3.32it/s]
                                                         
{'loss': 2.7296, 'learning_rate': 1.0827102501669934e-07, 'epoch': 15.85}

 99%|█████████▉| 368060/371472 [7:07:26<17:06,  3.32it/s]
 99%|█████████▉| 368061/371472 [7:07:26<17:46,  3.20it/s]
 99%|█████████▉| 368062/371472 [7:07:26<18:21,  3.09it/s]
 99%|█████████▉| 368063/371472 [7:07:27<16:56,  3.36it/s]
 99%|█████████▉| 368064/371472 [7:07:27<16:26,  3.46it/s]
 99%|█████████▉| 368065/371472 [7:07:27<16:05,  3.53it/s]
 99%|█████████▉| 368066/371472 [7:07:28<16:22,  3.47it/s]
 99%|█████████▉| 368067/371472 [7:07:28<16:05,  3.53it/s]
 99%|█████████▉| 368068/371472 [7:07:28<16:33,  3.43it/s]
 99%|█████████▉| 368069/371472 [7:07:28<15:48,  3.59it/s]
 99%|█████████▉| 368070/371472 [7:07:29<15:26,  3.67it/s]
 99%|█████████▉| 368071/371472 [7:07:29<15:33,  3.64it/s]
 99%|█████████▉| 368072/371472 [7:07:29<16:35,  3.42it/s]
 99%|█████████▉| 368073/371472 [7:07:30<15:55,  3.56it/s]
 99%|█████████▉| 368074/371472 [7:07:30<15:30,  3.65it/s]
 99%|█████████▉| 368075/371472 [7:07:30<15:27,  3.66it/s]
 99%|█████████▉| 368076/371472 [7:07:30<15:21,  3.69it/s]
 99%|█████████▉| 368077/371472 [7:07:31<15:10,  3.73it/s]
 99%|█████████▉| 368078/371472 [7:07:31<15:15,  3.71it/s]
 99%|█████████▉| 368079/371472 [7:07:31<15:22,  3.68it/s]
 99%|█████████▉| 368080/371472 [7:07:31<15:10,  3.73it/s]
                                                         
{'loss': 2.5957, 'learning_rate': 1.082225430412205e-07, 'epoch': 15.85}

 99%|█████████▉| 368080/371472 [7:07:31<15:10,  3.73it/s]
 99%|█████████▉| 368081/371472 [7:07:32<15:14,  3.71it/s]
 99%|█████████▉| 368082/371472 [7:07:32<15:21,  3.68it/s]
 99%|█████████▉| 368083/371472 [7:07:32<15:56,  3.54it/s]
 99%|█████████▉| 368084/371472 [7:07:33<17:01,  3.32it/s]
 99%|█████████▉| 368085/371472 [7:07:33<16:19,  3.46it/s]
 99%|█████████▉| 368086/371472 [7:07:33<16:06,  3.50it/s]
 99%|█████████▉| 368087/371472 [7:07:33<16:52,  3.34it/s]
 99%|█████████▉| 368088/371472 [7:07:34<16:27,  3.43it/s]
 99%|█████████▉| 368089/371472 [7:07:34<15:53,  3.55it/s]
 99%|█████████▉| 368090/371472 [7:07:34<15:59,  3.53it/s]
 99%|█████████▉| 368091/371472 [7:07:35<16:55,  3.33it/s]
 99%|█████████▉| 368092/371472 [7:07:35<16:41,  3.38it/s]
 99%|█████████▉| 368093/371472 [7:07:35<16:48,  3.35it/s]
 99%|█████████▉| 368094/371472 [7:07:35<16:08,  3.49it/s]
 99%|█████████▉| 368095/371472 [7:07:36<17:00,  3.31it/s]
 99%|█████████▉| 368096/371472 [7:07:36<17:07,  3.29it/s]
 99%|█████████▉| 368097/371472 [7:07:36<16:29,  3.41it/s]
 99%|█████████▉| 368098/371472 [7:07:37<16:47,  3.35it/s]
 99%|█████████▉| 368099/371472 [7:07:37<17:31,  3.21it/s]
 99%|█████████▉| 368100/371472 [7:07:37<16:32,  3.40it/s]
                                                         
{'loss': 2.471, 'learning_rate': 1.0817406106574154e-07, 'epoch': 15.85}

 99%|█████████▉| 368100/371472 [7:07:37<16:32,  3.40it/s]
 99%|█████████▉| 368101/371472 [7:07:38<16:34,  3.39it/s]
 99%|█████████▉| 368102/371472 [7:07:38<17:03,  3.29it/s]
 99%|█████████▉| 368103/371472 [7:07:38<16:47,  3.34it/s]
 99%|█████████▉| 368104/371472 [7:07:38<16:12,  3.46it/s]
 99%|█████████▉| 368105/371472 [7:07:39<15:46,  3.56it/s]
 99%|█████████▉| 368106/371472 [7:07:39<16:22,  3.43it/s]
 99%|█████████▉| 368107/371472 [7:07:39<16:37,  3.37it/s]
 99%|█████████▉| 368108/371472 [7:07:40<18:09,  3.09it/s]
 99%|█████████▉| 368109/371472 [7:07:40<16:50,  3.33it/s]
 99%|█████████▉| 368110/371472 [7:07:40<15:44,  3.56it/s]
 99%|█████████▉| 368111/371472 [7:07:41<15:37,  3.58it/s]
 99%|█████████▉| 368112/371472 [7:07:41<15:55,  3.52it/s]
 99%|█████████▉| 368113/371472 [7:07:41<15:45,  3.55it/s]
 99%|█████████▉| 368114/371472 [7:07:41<16:18,  3.43it/s]
 99%|█████████▉| 368115/371472 [7:07:42<15:40,  3.57it/s]
 99%|█████████▉| 368116/371472 [7:07:42<15:25,  3.63it/s]
 99%|█████████▉| 368117/371472 [7:07:42<15:38,  3.58it/s]
 99%|█████████▉| 368118/371472 [7:07:42<15:10,  3.68it/s]
 99%|█████████▉| 368119/371472 [7:07:43<15:02,  3.71it/s]
 99%|█████████▉| 368120/371472 [7:07:43<14:48,  3.77it/s]
                                                         
{'loss': 2.8156, 'learning_rate': 1.0812557909026271e-07, 'epoch': 15.86}

 99%|█████████▉| 368120/371472 [7:07:43<14:48,  3.77it/s]
 99%|█████████▉| 368121/371472 [7:07:43<14:59,  3.73it/s]
 99%|█████████▉| 368122/371472 [7:07:44<15:32,  3.59it/s]
 99%|█████████▉| 368123/371472 [7:07:44<15:09,  3.68it/s]
 99%|█████████▉| 368124/371472 [7:07:44<15:07,  3.69it/s]
 99%|█████████▉| 368125/371472 [7:07:44<15:40,  3.56it/s]
 99%|█████████▉| 368126/371472 [7:07:45<15:20,  3.63it/s]
 99%|█████████▉| 368127/371472 [7:07:45<15:09,  3.68it/s]
 99%|█████████▉| 368128/371472 [7:07:45<14:56,  3.73it/s]
 99%|█████████▉| 368129/371472 [7:07:45<15:26,  3.61it/s]
 99%|█████████▉| 368130/371472 [7:07:46<15:12,  3.66it/s]
 99%|█████████▉| 368131/371472 [7:07:46<15:42,  3.55it/s]
 99%|█████████▉| 368132/371472 [7:07:46<16:15,  3.42it/s]
 99%|█████████▉| 368133/371472 [7:07:47<15:39,  3.55it/s]
 99%|█████████▉| 368134/371472 [7:07:47<15:20,  3.63it/s]
 99%|█████████▉| 368135/371472 [7:07:47<14:47,  3.76it/s]
 99%|█████████▉| 368136/371472 [7:07:47<15:01,  3.70it/s]
 99%|█████████▉| 368137/371472 [7:07:48<14:45,  3.76it/s]
 99%|█████████▉| 368138/371472 [7:07:48<16:18,  3.41it/s]
 99%|█████████▉| 368139/371472 [7:07:48<15:54,  3.49it/s]
 99%|█████████▉| 368140/371472 [7:07:49<16:05,  3.45it/s]
                                                         
{'loss': 2.5233, 'learning_rate': 1.0807709711478377e-07, 'epoch': 15.86}

 99%|█████████▉| 368140/371472 [7:07:49<16:05,  3.45it/s]
 99%|█████████▉| 368141/371472 [7:07:49<16:05,  3.45it/s]
 99%|█████████▉| 368142/371472 [7:07:49<16:19,  3.40it/s]
 99%|█████████▉| 368143/371472 [7:07:49<16:48,  3.30it/s]
 99%|█████████▉| 368144/371472 [7:07:50<17:21,  3.20it/s]
 99%|█████████▉| 368145/371472 [7:07:50<16:23,  3.38it/s]
 99%|█████████▉| 368146/371472 [7:07:50<16:20,  3.39it/s]
 99%|█████████▉| 368147/371472 [7:07:51<15:52,  3.49it/s]
 99%|█████████▉| 368148/371472 [7:07:51<15:45,  3.52it/s]
 99%|█████████▉| 368149/371472 [7:07:51<15:08,  3.66it/s]
 99%|█████████▉| 368150/371472 [7:07:51<14:54,  3.71it/s]
 99%|█████████▉| 368151/371472 [7:07:52<15:08,  3.66it/s]
 99%|█████████▉| 368152/371472 [7:07:52<15:36,  3.55it/s]
 99%|█████████▉| 368153/371472 [7:07:52<16:10,  3.42it/s]
 99%|█████████▉| 368154/371472 [7:07:53<15:22,  3.60it/s]
 99%|█████████▉| 368155/371472 [7:07:53<14:49,  3.73it/s]
 99%|█████████▉| 368156/371472 [7:07:53<14:59,  3.69it/s]
 99%|█████████▉| 368157/371472 [7:07:53<14:54,  3.70it/s]
 99%|█████████▉| 368158/371472 [7:07:54<15:07,  3.65it/s]
 99%|█████████▉| 368159/371472 [7:07:54<14:50,  3.72it/s]
 99%|█████████▉| 368160/371472 [7:07:54<15:24,  3.58it/s]
                                                         
{'loss': 2.5476, 'learning_rate': 1.0802861513930483e-07, 'epoch': 15.86}

 99%|█████████▉| 368160/371472 [7:07:54<15:24,  3.58it/s]
 99%|█████████▉| 368161/371472 [7:07:54<14:56,  3.69it/s]
 99%|█████████▉| 368162/371472 [7:07:55<14:52,  3.71it/s]
 99%|█████████▉| 368163/371472 [7:07:55<15:19,  3.60it/s]
 99%|█████████▉| 368164/371472 [7:07:55<15:30,  3.55it/s]
 99%|█████████▉| 368165/371472 [7:07:56<15:13,  3.62it/s]
 99%|█████████▉| 368166/371472 [7:07:56<15:28,  3.56it/s]
 99%|█████████▉| 368167/371472 [7:07:56<15:57,  3.45it/s]
 99%|█████████▉| 368168/371472 [7:07:56<15:59,  3.44it/s]
 99%|█████████▉| 368169/371472 [7:07:57<15:32,  3.54it/s]
 99%|█████████▉| 368170/371472 [7:07:57<15:01,  3.66it/s]
 99%|█████████▉| 368171/371472 [7:07:57<15:37,  3.52it/s]
 99%|█████████▉| 368172/371472 [7:07:58<15:47,  3.48it/s]
 99%|█████████▉| 368173/371472 [7:07:58<15:13,  3.61it/s]
 99%|█████████▉| 368174/371472 [7:07:58<15:07,  3.63it/s]
 99%|█████████▉| 368175/371472 [7:07:58<15:37,  3.52it/s]
 99%|█████████▉| 368176/371472 [7:07:59<15:17,  3.59it/s]
 99%|█████████▉| 368177/371472 [7:07:59<15:21,  3.58it/s]
 99%|█████████▉| 368178/371472 [7:07:59<16:07,  3.41it/s]
 99%|█████████▉| 368179/371472 [7:08:00<15:21,  3.57it/s]
 99%|█████████▉| 368180/371472 [7:08:00<15:22,  3.57it/s]
                                                         
{'loss': 2.5079, 'learning_rate': 1.0798013316382598e-07, 'epoch': 15.86}

 99%|█████████▉| 368180/371472 [7:08:00<15:22,  3.57it/s]
 99%|█████████▉| 368181/371472 [7:08:00<15:13,  3.60it/s]
 99%|█████████▉| 368182/371472 [7:08:00<15:13,  3.60it/s]
 99%|█████████▉| 368183/371472 [7:08:01<15:33,  3.53it/s]
 99%|█████████▉| 368184/371472 [7:08:01<15:07,  3.62it/s]
 99%|█████████▉| 368185/371472 [7:08:01<16:32,  3.31it/s]
 99%|█████████▉| 368186/371472 [7:08:02<15:53,  3.45it/s]
 99%|█████████▉| 368187/371472 [7:08:02<15:40,  3.49it/s]
 99%|█████████▉| 368188/371472 [7:08:02<15:27,  3.54it/s]
 99%|█████████▉| 368189/371472 [7:08:02<16:05,  3.40it/s]
 99%|█████████▉| 368190/371472 [7:08:03<16:09,  3.39it/s]
 99%|█████████▉| 368191/371472 [7:08:03<15:39,  3.49it/s]
 99%|█████████▉| 368192/371472 [7:08:03<15:24,  3.55it/s]
 99%|█████████▉| 368193/371472 [7:08:04<15:37,  3.50it/s]
 99%|█████████▉| 368194/371472 [7:08:04<15:05,  3.62it/s]
 99%|█████████▉| 368195/371472 [7:08:04<14:32,  3.75it/s]
 99%|█████████▉| 368196/371472 [7:08:04<14:35,  3.74it/s]
 99%|█████████▉| 368197/371472 [7:08:05<14:15,  3.83it/s]
 99%|█████████▉| 368198/371472 [7:08:05<14:17,  3.82it/s]
 99%|█████████▉| 368199/371472 [7:08:05<14:13,  3.83it/s]
 99%|█████████▉| 368200/371472 [7:08:05<14:56,  3.65it/s]
                                                         
{'loss': 2.3992, 'learning_rate': 1.0793165118834703e-07, 'epoch': 15.86}

 99%|█████████▉| 368200/371472 [7:08:05<14:56,  3.65it/s]
 99%|█████████▉| 368201/371472 [7:08:06<14:42,  3.71it/s]
 99%|█████████▉| 368202/371472 [7:08:06<14:54,  3.66it/s]
 99%|█████████▉| 368203/371472 [7:08:06<15:39,  3.48it/s]
 99%|█████████▉| 368204/371472 [7:08:07<15:22,  3.54it/s]
 99%|█████████▉| 368205/371472 [7:08:07<14:57,  3.64it/s]
 99%|█████████▉| 368206/371472 [7:08:07<15:42,  3.47it/s]
 99%|█████████▉| 368207/371472 [7:08:07<16:02,  3.39it/s]
 99%|█████████▉| 368208/371472 [7:08:08<15:59,  3.40it/s]
 99%|█████████▉| 368209/371472 [7:08:08<15:13,  3.57it/s]
 99%|█████████▉| 368210/371472 [7:08:08<16:22,  3.32it/s]
 99%|█████████▉| 368211/371472 [7:08:09<16:22,  3.32it/s]
 99%|█████████▉| 368212/371472 [7:08:09<16:29,  3.29it/s]
 99%|█████████▉| 368213/371472 [7:08:09<15:52,  3.42it/s]
 99%|█████████▉| 368214/371472 [7:08:09<15:56,  3.41it/s]
 99%|█████████▉| 368215/371472 [7:08:10<20:35,  2.64it/s]
 99%|█████████▉| 368216/371472 [7:08:10<19:04,  2.84it/s]
 99%|█████████▉| 368217/371472 [7:08:11<17:19,  3.13it/s]
 99%|█████████▉| 368218/371472 [7:08:11<16:25,  3.30it/s]
 99%|█████████▉| 368219/371472 [7:08:11<15:26,  3.51it/s]
 99%|█████████▉| 368220/371472 [7:08:11<15:33,  3.48it/s]
                                                         
{'loss': 2.5286, 'learning_rate': 1.078831692128682e-07, 'epoch': 15.86}

 99%|█████████▉| 368220/371472 [7:08:11<15:33,  3.48it/s]
 99%|█████████▉| 368221/371472 [7:08:12<15:30,  3.49it/s]
 99%|█████████▉| 368222/371472 [7:08:12<15:08,  3.58it/s]
 99%|█████████▉| 368223/371472 [7:08:12<15:13,  3.56it/s]
 99%|█████████▉| 368224/371472 [7:08:13<15:54,  3.40it/s]
 99%|█████████▉| 368225/371472 [7:08:13<16:07,  3.36it/s]
 99%|█████████▉| 368226/371472 [7:08:13<16:05,  3.36it/s]
 99%|█████████▉| 368227/371472 [7:08:14<17:16,  3.13it/s]
 99%|█████████▉| 368228/371472 [7:08:14<17:11,  3.14it/s]
 99%|█████████▉| 368229/371472 [7:08:14<16:14,  3.33it/s]
 99%|█████████▉| 368230/371472 [7:08:14<15:18,  3.53it/s]
 99%|█████████▉| 368231/371472 [7:08:15<15:32,  3.48it/s]
 99%|█████████▉| 368232/371472 [7:08:15<14:55,  3.62it/s]
 99%|█████████▉| 368233/371472 [7:08:15<14:51,  3.63it/s]
 99%|█████████▉| 368234/371472 [7:08:15<14:48,  3.64it/s]
 99%|█████████▉| 368235/371472 [7:08:16<14:54,  3.62it/s]
 99%|█████████▉| 368236/371472 [7:08:16<15:36,  3.45it/s]
 99%|█████████▉| 368237/371472 [7:08:16<15:25,  3.50it/s]
 99%|█████████▉| 368238/371472 [7:08:17<14:47,  3.65it/s]
 99%|█████████▉| 368239/371472 [7:08:17<15:30,  3.47it/s]
 99%|█████████▉| 368240/371472 [7:08:17<15:08,  3.56it/s]
                                                         
{'loss': 2.484, 'learning_rate': 1.0783468723738926e-07, 'epoch': 15.86}

 99%|█████████▉| 368240/371472 [7:08:17<15:08,  3.56it/s]
 99%|█████████▉| 368241/371472 [7:08:17<14:58,  3.59it/s]
 99%|█████████▉| 368242/371472 [7:08:18<14:43,  3.65it/s]
 99%|█████████▉| 368243/371472 [7:08:18<14:32,  3.70it/s]
 99%|█████████▉| 368244/371472 [7:08:18<14:51,  3.62it/s]
 99%|█████████▉| 368245/371472 [7:08:18<14:39,  3.67it/s]
 99%|█████████▉| 368246/371472 [7:08:19<14:52,  3.61it/s]
 99%|█████████▉| 368247/371472 [7:08:19<15:05,  3.56it/s]
 99%|█████████▉| 368248/371472 [7:08:19<16:07,  3.33it/s]
 99%|█████████▉| 368249/371472 [7:08:20<15:28,  3.47it/s]
 99%|█████████▉| 368250/371472 [7:08:20<15:08,  3.55it/s]
 99%|█████████▉| 368251/371472 [7:08:20<14:39,  3.66it/s]
 99%|█████████▉| 368252/371472 [7:08:20<15:07,  3.55it/s]
 99%|█████████▉| 368253/371472 [7:08:21<15:34,  3.44it/s]
 99%|█████████▉| 368254/371472 [7:08:21<15:23,  3.48it/s]
 99%|█████████▉| 368255/371472 [7:08:21<14:49,  3.62it/s]
 99%|█████████▉| 368256/371472 [7:08:22<14:55,  3.59it/s]
 99%|█████████▉| 368257/371472 [7:08:22<14:54,  3.59it/s]
 99%|█████████▉| 368258/371472 [7:08:22<17:17,  3.10it/s]
 99%|█████████▉| 368259/371472 [7:08:23<17:36,  3.04it/s]
 99%|█████████▉| 368260/371472 [7:08:23<16:53,  3.17it/s]
                                                         
{'loss': 2.5445, 'learning_rate': 1.077862052619104e-07, 'epoch': 15.86}

 99%|█████████▉| 368260/371472 [7:08:23<16:53,  3.17it/s]
 99%|█████████▉| 368261/371472 [7:08:23<16:33,  3.23it/s]
 99%|█████████▉| 368262/371472 [7:08:24<16:48,  3.18it/s]
 99%|█████████▉| 368263/371472 [7:08:24<16:32,  3.23it/s]
 99%|█████████▉| 368264/371472 [7:08:24<16:15,  3.29it/s]
 99%|█████████▉| 368265/371472 [7:08:24<15:43,  3.40it/s]
 99%|█████████▉| 368266/371472 [7:08:25<15:45,  3.39it/s]
 99%|█████████▉| 368267/371472 [7:08:25<15:36,  3.42it/s]
 99%|█████████▉| 368268/371472 [7:08:25<15:33,  3.43it/s]
 99%|█████████▉| 368269/371472 [7:08:26<15:19,  3.48it/s]
 99%|█████████▉| 368270/371472 [7:08:26<15:44,  3.39it/s]
 99%|█████████▉| 368271/371472 [7:08:26<15:36,  3.42it/s]
 99%|█████████▉| 368272/371472 [7:08:26<14:59,  3.56it/s]
 99%|█████████▉| 368273/371472 [7:08:27<15:05,  3.53it/s]
 99%|█████████▉| 368274/371472 [7:08:27<14:50,  3.59it/s]
 99%|█████████▉| 368275/371472 [7:08:27<14:21,  3.71it/s]
 99%|█████████▉| 368276/371472 [7:08:27<14:11,  3.75it/s]
 99%|█████████▉| 368277/371472 [7:08:28<15:46,  3.38it/s]
 99%|█████████▉| 368278/371472 [7:08:28<15:32,  3.43it/s]
 99%|█████████▉| 368279/371472 [7:08:28<15:27,  3.44it/s]
 99%|█████████▉| 368280/371472 [7:08:29<16:03,  3.31it/s]
                                                         
{'loss': 2.6825, 'learning_rate': 1.0773772328643147e-07, 'epoch': 15.86}

 99%|█████████▉| 368280/371472 [7:08:29<16:03,  3.31it/s]
 99%|█████████▉| 368281/371472 [7:08:29<15:31,  3.43it/s]
 99%|█████████▉| 368282/371472 [7:08:29<15:54,  3.34it/s]
 99%|█████████▉| 368283/371472 [7:08:30<16:14,  3.27it/s]
 99%|█████████▉| 368284/371472 [7:08:30<15:33,  3.41it/s]
 99%|█████████▉| 368285/371472 [7:08:30<15:04,  3.52it/s]
 99%|█████████▉| 368286/371472 [7:08:30<15:04,  3.52it/s]
 99%|█████████▉| 368287/371472 [7:08:31<15:32,  3.42it/s]
 99%|█████████▉| 368288/371472 [7:08:31<15:15,  3.48it/s]
 99%|█████████▉| 368289/371472 [7:08:31<14:56,  3.55it/s]
 99%|█████████▉| 368290/371472 [7:08:32<14:35,  3.63it/s]
 99%|█████████▉| 368291/371472 [7:08:32<14:51,  3.57it/s]
 99%|█████████▉| 368292/371472 [7:08:32<15:11,  3.49it/s]
 99%|█████████▉| 368293/371472 [7:08:33<16:05,  3.29it/s]
 99%|█████████▉| 368294/371472 [7:08:33<15:19,  3.46it/s]
 99%|█████████▉| 368295/371472 [7:08:33<15:42,  3.37it/s]
 99%|█████████▉| 368296/371472 [7:08:33<15:45,  3.36it/s]
 99%|█████████▉| 368297/371472 [7:08:34<15:31,  3.41it/s]
 99%|█████████▉| 368298/371472 [7:08:34<15:29,  3.42it/s]
 99%|█████████▉| 368299/371472 [7:08:34<14:58,  3.53it/s]
 99%|█████████▉| 368300/371472 [7:08:35<14:48,  3.57it/s]
                                                         
{'loss': 2.5596, 'learning_rate': 1.0768924131095263e-07, 'epoch': 15.86}

 99%|█████████▉| 368300/371472 [7:08:35<14:48,  3.57it/s]
 99%|█████████▉| 368301/371472 [7:08:35<15:14,  3.47it/s]
 99%|█████████▉| 368302/371472 [7:08:35<15:10,  3.48it/s]
 99%|█████████▉| 368303/371472 [7:08:35<15:00,  3.52it/s]
 99%|█████████▉| 368304/371472 [7:08:36<14:23,  3.67it/s]
 99%|█████████▉| 368305/371472 [7:08:36<13:57,  3.78it/s]
 99%|█████████▉| 368306/371472 [7:08:36<14:12,  3.71it/s]
 99%|█████████▉| 368307/371472 [7:08:36<14:01,  3.76it/s]
 99%|█████████▉| 368308/371472 [7:08:37<14:02,  3.76it/s]
 99%|█████████▉| 368309/371472 [7:08:37<13:59,  3.77it/s]
 99%|█████████▉| 368310/371472 [7:08:37<13:39,  3.86it/s]
 99%|█████████▉| 368311/371472 [7:08:37<13:42,  3.84it/s]
 99%|█████████▉| 368312/371472 [7:08:38<13:43,  3.84it/s]
 99%|█████████▉| 368313/371472 [7:08:38<13:44,  3.83it/s]
 99%|█████████▉| 368314/371472 [7:08:38<13:23,  3.93it/s]
 99%|█████████▉| 368315/371472 [7:08:38<13:27,  3.91it/s]
 99%|█████████▉| 368316/371472 [7:08:39<13:34,  3.87it/s]
 99%|█████████▉| 368317/371472 [7:08:39<14:38,  3.59it/s]
 99%|█████████▉| 368318/371472 [7:08:39<16:39,  3.16it/s]
 99%|█████████▉| 368319/371472 [7:08:40<15:42,  3.34it/s]
 99%|█████████▉| 368320/371472 [7:08:40<15:32,  3.38it/s]
                                                         
{'loss': 2.6674, 'learning_rate': 1.0764075933547369e-07, 'epoch': 15.86}

 99%|█████████▉| 368320/371472 [7:08:40<15:32,  3.38it/s]
 99%|█████████▉| 368321/371472 [7:08:40<16:16,  3.23it/s]
 99%|█████████▉| 368322/371472 [7:08:41<15:20,  3.42it/s]
 99%|█████████▉| 368323/371472 [7:08:41<15:30,  3.39it/s]
 99%|█████████▉| 368324/371472 [7:08:41<15:05,  3.48it/s]
 99%|█████████▉| 368325/371472 [7:08:42<15:42,  3.34it/s]
 99%|█████████▉| 368326/371472 [7:08:42<16:37,  3.15it/s]
 99%|█████████▉| 368327/371472 [7:08:42<15:48,  3.32it/s]
 99%|█████████▉| 368328/371472 [7:08:42<16:53,  3.10it/s]
 99%|█████████▉| 368329/371472 [7:08:43<16:01,  3.27it/s]
 99%|█████████▉| 368330/371472 [7:08:43<15:46,  3.32it/s]
 99%|█████████▉| 368331/371472 [7:08:43<15:16,  3.43it/s]
 99%|█████████▉| 368332/371472 [7:08:44<15:13,  3.44it/s]
 99%|█████████▉| 368333/371472 [7:08:44<14:44,  3.55it/s]
 99%|█████████▉| 368334/371472 [7:08:44<14:35,  3.58it/s]
 99%|█████████▉| 368335/371472 [7:08:44<14:52,  3.52it/s]
 99%|█████████▉| 368336/371472 [7:08:45<15:15,  3.43it/s]
 99%|█████████▉| 368337/371472 [7:08:45<16:10,  3.23it/s]
 99%|█████████▉| 368338/371472 [7:08:45<16:28,  3.17it/s]
 99%|█████████▉| 368339/371472 [7:08:46<15:36,  3.34it/s]
 99%|█████████▉| 368340/371472 [7:08:46<15:19,  3.41it/s]
                                                         
{'loss': 2.4682, 'learning_rate': 1.0759227735999484e-07, 'epoch': 15.87}

 99%|█████████▉| 368340/371472 [7:08:46<15:19,  3.41it/s]
 99%|█████████▉| 368341/371472 [7:08:46<15:39,  3.33it/s]
 99%|█████████▉| 368342/371472 [7:08:47<15:38,  3.34it/s]
 99%|█████████▉| 368343/371472 [7:08:47<14:42,  3.55it/s]
 99%|█████████▉| 368344/371472 [7:08:47<14:06,  3.69it/s]
 99%|█████████▉| 368345/371472 [7:08:47<13:58,  3.73it/s]
 99%|█████████▉| 368346/371472 [7:08:48<15:17,  3.41it/s]
 99%|█████████▉| 368347/371472 [7:08:48<14:56,  3.48it/s]
 99%|█████████▉| 368348/371472 [7:08:48<15:02,  3.46it/s]
 99%|█████████▉| 368349/371472 [7:08:48<14:18,  3.64it/s]
 99%|█████████▉| 368350/371472 [7:08:49<14:02,  3.71it/s]
 99%|█████████▉| 368351/371472 [7:08:49<14:27,  3.60it/s]
 99%|█████████▉| 368352/371472 [7:08:49<13:56,  3.73it/s]
 99%|█████████▉| 368353/371472 [7:08:50<13:38,  3.81it/s]
 99%|█████████▉| 368354/371472 [7:08:50<13:18,  3.91it/s]
 99%|█████████▉| 368355/371472 [7:08:50<14:23,  3.61it/s]
 99%|█████████▉| 368356/371472 [7:08:50<14:26,  3.60it/s]
 99%|█████████▉| 368357/371472 [7:08:51<14:47,  3.51it/s]
 99%|█████████▉| 368358/371472 [7:08:51<15:08,  3.43it/s]
 99%|█████████▉| 368359/371472 [7:08:51<15:33,  3.33it/s]
 99%|█████████▉| 368360/371472 [7:08:52<15:10,  3.42it/s]
                                                         
{'loss': 2.7336, 'learning_rate': 1.075437953845159e-07, 'epoch': 15.87}

 99%|█████████▉| 368360/371472 [7:08:52<15:10,  3.42it/s]
 99%|█████████▉| 368361/371472 [7:08:52<14:44,  3.52it/s]
 99%|█████████▉| 368362/371472 [7:08:52<15:26,  3.36it/s]
 99%|█████████▉| 368363/371472 [7:08:52<15:02,  3.45it/s]
 99%|█████████▉| 368364/371472 [7:08:53<14:12,  3.64it/s]
 99%|█████████▉| 368365/371472 [7:08:53<14:39,  3.53it/s]
 99%|█████████▉| 368366/371472 [7:08:53<14:28,  3.58it/s]
 99%|█████████▉| 368367/371472 [7:08:54<15:16,  3.39it/s]
 99%|█████████▉| 368368/371472 [7:08:54<14:42,  3.52it/s]
 99%|█████████▉| 368369/371472 [7:08:54<14:48,  3.49it/s]
 99%|█████████▉| 368370/371472 [7:08:54<14:27,  3.58it/s]
 99%|█████████▉| 368371/371472 [7:08:55<14:24,  3.59it/s]
 99%|█████████▉| 368372/371472 [7:08:55<14:51,  3.48it/s]
 99%|█████████▉| 368373/371472 [7:08:55<14:51,  3.48it/s]
 99%|█████████▉| 368374/371472 [7:08:56<14:33,  3.55it/s]
 99%|█████████▉| 368375/371472 [7:08:56<15:07,  3.41it/s]
 99%|█████████▉| 368376/371472 [7:08:56<15:36,  3.31it/s]
 99%|█████████▉| 368377/371472 [7:08:57<15:52,  3.25it/s]
 99%|█████████▉| 368378/371472 [7:08:57<15:34,  3.31it/s]
 99%|█████████▉| 368379/371472 [7:08:57<15:53,  3.24it/s]
 99%|█████████▉| 368380/371472 [7:08:57<16:18,  3.16it/s]
                                                         
{'loss': 2.5975, 'learning_rate': 1.0749531340903706e-07, 'epoch': 15.87}

 99%|█████████▉| 368380/371472 [7:08:57<16:18,  3.16it/s]
 99%|█████████▉| 368381/371472 [7:08:58<16:12,  3.18it/s]
 99%|█████████▉| 368382/371472 [7:08:58<15:22,  3.35it/s]
 99%|█████████▉| 368383/371472 [7:08:58<14:43,  3.50it/s]
 99%|█████████▉| 368384/371472 [7:08:59<15:08,  3.40it/s]
 99%|█████████▉| 368385/371472 [7:08:59<16:13,  3.17it/s]
 99%|█████████▉| 368386/371472 [7:08:59<15:45,  3.26it/s]
 99%|█████████▉| 368387/371472 [7:09:00<15:17,  3.36it/s]
 99%|█████████▉| 368388/371472 [7:09:00<15:21,  3.35it/s]
 99%|█████████▉| 368389/371472 [7:09:00<15:13,  3.38it/s]
 99%|█████████▉| 368390/371472 [7:09:00<14:58,  3.43it/s]
 99%|█████████▉| 368391/371472 [7:09:01<14:31,  3.54it/s]
 99%|█████████▉| 368392/371472 [7:09:01<13:52,  3.70it/s]
 99%|█████████▉| 368393/371472 [7:09:01<13:59,  3.67it/s]
 99%|█████████▉| 368394/371472 [7:09:02<14:29,  3.54it/s]
 99%|█████████▉| 368395/371472 [7:09:02<14:41,  3.49it/s]
 99%|█████████▉| 368396/371472 [7:09:02<14:20,  3.58it/s]
 99%|█████████▉| 368397/371472 [7:09:02<14:26,  3.55it/s]
 99%|█████████▉| 368398/371472 [7:09:03<14:41,  3.49it/s]
 99%|█████████▉| 368399/371472 [7:09:03<14:50,  3.45it/s]
 99%|█████████▉| 368400/371472 [7:09:03<15:02,  3.41it/s]
                                                         
{'loss': 2.6667, 'learning_rate': 1.0744683143355812e-07, 'epoch': 15.87}

 99%|█████████▉| 368400/371472 [7:09:03<15:02,  3.41it/s]
 99%|█████████▉| 368401/371472 [7:09:04<15:38,  3.27it/s]
 99%|█████████▉| 368402/371472 [7:09:04<14:58,  3.42it/s]
 99%|█████████▉| 368403/371472 [7:09:04<14:33,  3.51it/s]
 99%|█████████▉| 368404/371472 [7:09:04<14:18,  3.57it/s]
 99%|█████████▉| 368405/371472 [7:09:05<15:10,  3.37it/s]
 99%|█████████▉| 368406/371472 [7:09:05<14:33,  3.51it/s]
 99%|█████████▉| 368407/371472 [7:09:05<14:10,  3.61it/s]
 99%|█████████▉| 368408/371472 [7:09:05<13:40,  3.73it/s]
 99%|█████████▉| 368409/371472 [7:09:06<13:23,  3.81it/s]
 99%|█████████▉| 368410/371472 [7:09:06<13:51,  3.68it/s]
 99%|█████████▉| 368411/371472 [7:09:06<16:05,  3.17it/s]
 99%|█████████▉| 368412/371472 [7:09:07<15:41,  3.25it/s]
 99%|█████████▉| 368413/371472 [7:09:07<15:25,  3.30it/s]
 99%|█████████▉| 368414/371472 [7:09:07<15:00,  3.40it/s]
 99%|█████████▉| 368415/371472 [7:09:08<15:08,  3.37it/s]
 99%|█████████▉| 368416/371472 [7:09:08<14:28,  3.52it/s]
 99%|█████████▉| 368417/371472 [7:09:08<14:12,  3.58it/s]
 99%|█████████▉| 368418/371472 [7:09:08<14:04,  3.62it/s]
 99%|█████████▉| 368419/371472 [7:09:09<14:44,  3.45it/s]
 99%|█████████▉| 368420/371472 [7:09:09<14:31,  3.50it/s]
                                                         
{'loss': 2.514, 'learning_rate': 1.0739834945807927e-07, 'epoch': 15.87}

 99%|█████████▉| 368420/371472 [7:09:09<14:31,  3.50it/s]
 99%|█████████▉| 368421/371472 [7:09:09<14:16,  3.56it/s]
 99%|█████████▉| 368422/371472 [7:09:10<14:06,  3.60it/s]
 99%|█████████▉| 368423/371472 [7:09:10<14:03,  3.61it/s]
 99%|█████████▉| 368424/371472 [7:09:10<14:09,  3.59it/s]
 99%|█████████▉| 368425/371472 [7:09:10<13:50,  3.67it/s]
 99%|█████████▉| 368426/371472 [7:09:11<13:15,  3.83it/s]
 99%|█████████▉| 368427/371472 [7:09:11<12:52,  3.94it/s]
 99%|█████████▉| 368428/371472 [7:09:11<13:27,  3.77it/s]
 99%|█████████▉| 368429/371472 [7:09:11<14:15,  3.56it/s]
 99%|█████████▉| 368430/371472 [7:09:12<15:12,  3.33it/s]
 99%|█████████▉| 368431/371472 [7:09:12<14:55,  3.39it/s]
 99%|█████████▉| 368432/371472 [7:09:12<14:34,  3.48it/s]
 99%|█████████▉| 368433/371472 [7:09:13<13:50,  3.66it/s]
 99%|█████████▉| 368434/371472 [7:09:13<13:18,  3.80it/s]
 99%|█████████▉| 368435/371472 [7:09:13<13:23,  3.78it/s]
 99%|█████████▉| 368436/371472 [7:09:13<13:08,  3.85it/s]
 99%|█████████▉| 368437/371472 [7:09:14<13:26,  3.76it/s]
 99%|█████████▉| 368438/371472 [7:09:14<13:28,  3.75it/s]
 99%|█████████▉| 368439/371472 [7:09:14<13:54,  3.64it/s]
 99%|█████████▉| 368440/371472 [7:09:14<13:37,  3.71it/s]
                                                         
{'loss': 2.6543, 'learning_rate': 1.0734986748260033e-07, 'epoch': 15.87}

 99%|█████████▉| 368440/371472 [7:09:14<13:37,  3.71it/s]
 99%|█████████▉| 368441/371472 [7:09:15<13:43,  3.68it/s]
 99%|█████████▉| 368442/371472 [7:09:15<13:22,  3.78it/s]
 99%|█████████▉| 368443/371472 [7:09:15<15:07,  3.34it/s]
 99%|█████████▉| 368444/371472 [7:09:16<15:15,  3.31it/s]
 99%|█████████▉| 368445/371472 [7:09:16<14:35,  3.46it/s]
 99%|█████████▉| 368446/371472 [7:09:16<14:56,  3.38it/s]
 99%|█████████▉| 368447/371472 [7:09:17<15:05,  3.34it/s]
 99%|█████████▉| 368448/371472 [7:09:17<14:29,  3.48it/s]
 99%|█████████▉| 368449/371472 [7:09:17<14:21,  3.51it/s]
 99%|█████████▉| 368450/371472 [7:09:17<13:58,  3.60it/s]
 99%|█████████▉| 368451/371472 [7:09:18<13:25,  3.75it/s]
 99%|█████████▉| 368452/371472 [7:09:18<13:20,  3.77it/s]
 99%|█████████▉| 368453/371472 [7:09:18<15:08,  3.32it/s]
 99%|█████████▉| 368454/371472 [7:09:18<15:01,  3.35it/s]
 99%|█████████▉| 368455/371472 [7:09:19<14:47,  3.40it/s]
 99%|█████████▉| 368456/371472 [7:09:19<14:22,  3.49it/s]
 99%|█████████▉| 368457/371472 [7:09:19<14:37,  3.44it/s]
 99%|█████████▉| 368458/371472 [7:09:20<14:08,  3.55it/s]
 99%|█████████▉| 368459/371472 [7:09:20<13:52,  3.62it/s]
 99%|█████████▉| 368460/371472 [7:09:20<14:13,  3.53it/s]
                                                         
{'loss': 2.5126, 'learning_rate': 1.073013855071215e-07, 'epoch': 15.87}

 99%|█████████▉| 368460/371472 [7:09:20<14:13,  3.53it/s]
 99%|█████████▉| 368461/371472 [7:09:20<13:54,  3.61it/s]
 99%|█████████▉| 368462/371472 [7:09:21<15:36,  3.21it/s]
 99%|█████████▉| 368463/371472 [7:09:21<15:02,  3.33it/s]
 99%|█████████▉| 368464/371472 [7:09:21<14:46,  3.39it/s]
 99%|█████████▉| 368465/371472 [7:09:22<14:10,  3.54it/s]
 99%|█████████▉| 368466/371472 [7:09:22<14:05,  3.55it/s]
 99%|█████████▉| 368467/371472 [7:09:22<14:07,  3.55it/s]
 99%|█████████▉| 368468/371472 [7:09:22<13:37,  3.67it/s]
 99%|█████████▉| 368469/371472 [7:09:23<13:22,  3.74it/s]
 99%|█████████▉| 368470/371472 [7:09:23<13:47,  3.63it/s]
 99%|█████████▉| 368471/371472 [7:09:23<13:31,  3.70it/s]
 99%|█████████▉| 368472/371472 [7:09:24<13:55,  3.59it/s]
 99%|█████████▉| 368473/371472 [7:09:24<15:22,  3.25it/s]
 99%|█████████▉| 368474/371472 [7:09:24<15:38,  3.19it/s]
 99%|█████████▉| 368475/371472 [7:09:25<15:17,  3.27it/s]
 99%|█████████▉| 368476/371472 [7:09:25<14:44,  3.39it/s]
 99%|█████████▉| 368477/371472 [7:09:25<14:36,  3.42it/s]
 99%|█████████▉| 368478/371472 [7:09:25<15:55,  3.13it/s]
 99%|█████████▉| 368479/371472 [7:09:26<14:49,  3.37it/s]
 99%|█████████▉| 368480/371472 [7:09:26<14:45,  3.38it/s]
                                                         
{'loss': 2.5822, 'learning_rate': 1.0725290353164255e-07, 'epoch': 15.87}

 99%|█████████▉| 368480/371472 [7:09:26<14:45,  3.38it/s]
 99%|█████████▉| 368481/371472 [7:09:26<14:52,  3.35it/s]
 99%|█████████▉| 368482/371472 [7:09:27<14:59,  3.32it/s]
 99%|█████████▉| 368483/371472 [7:09:27<14:21,  3.47it/s]
 99%|█████████▉| 368484/371472 [7:09:27<13:58,  3.56it/s]
 99%|█████████▉| 368485/371472 [7:09:27<13:51,  3.59it/s]
 99%|█████████▉| 368486/371472 [7:09:28<14:17,  3.48it/s]
 99%|█████████▉| 368487/371472 [7:09:28<13:55,  3.57it/s]
 99%|█████████▉| 368488/371472 [7:09:28<13:54,  3.58it/s]
 99%|█████████▉| 368489/371472 [7:09:29<14:44,  3.37it/s]
 99%|█████████▉| 368490/371472 [7:09:29<14:13,  3.49it/s]
 99%|█████████▉| 368491/371472 [7:09:29<14:24,  3.45it/s]
 99%|█████████▉| 368492/371472 [7:09:29<13:58,  3.55it/s]
 99%|█████████▉| 368493/371472 [7:09:30<13:36,  3.65it/s]
 99%|█████████▉| 368494/371472 [7:09:30<14:00,  3.54it/s]
 99%|█████████▉| 368495/371472 [7:09:30<13:25,  3.69it/s]
 99%|█████████▉| 368496/371472 [7:09:31<13:40,  3.63it/s]
 99%|█████████▉| 368497/371472 [7:09:31<14:24,  3.44it/s]
 99%|█████████▉| 368498/371472 [7:09:31<14:39,  3.38it/s]
 99%|█████████▉| 368499/371472 [7:09:31<14:34,  3.40it/s]
 99%|█████████▉| 368500/371472 [7:09:32<13:54,  3.56it/s]
                                                         
{'loss': 2.5354, 'learning_rate': 1.072044215561637e-07, 'epoch': 15.87}

 99%|█████████▉| 368500/371472 [7:09:32<13:54,  3.56it/s]
 99%|█████████▉| 368501/371472 [7:09:32<14:00,  3.53it/s]
 99%|█████████▉| 368502/371472 [7:09:32<14:07,  3.50it/s]
 99%|█████████▉| 368503/371472 [7:09:33<14:07,  3.50it/s]
 99%|█████████▉| 368504/371472 [7:09:33<13:55,  3.55it/s]
 99%|█████████▉| 368505/371472 [7:09:33<13:25,  3.68it/s]
 99%|█████████▉| 368506/371472 [7:09:33<13:05,  3.78it/s]
 99%|█████████▉| 368507/371472 [7:09:34<12:45,  3.87it/s]
 99%|█████████▉| 368508/371472 [7:09:34<14:08,  3.49it/s]
 99%|█████████▉| 368509/371472 [7:09:34<13:31,  3.65it/s]
 99%|█████████▉| 368510/371472 [7:09:34<13:43,  3.60it/s]
 99%|█████████▉| 368511/371472 [7:09:35<14:05,  3.50it/s]
 99%|█████████▉| 368512/371472 [7:09:35<14:01,  3.52it/s]
 99%|█████████▉| 368513/371472 [7:09:35<13:58,  3.53it/s]
 99%|█████████▉| 368514/371472 [7:09:36<13:46,  3.58it/s]
 99%|█████████▉| 368515/371472 [7:09:36<14:15,  3.45it/s]
 99%|█████████▉| 368516/371472 [7:09:36<14:07,  3.49it/s]
 99%|█████████▉| 368517/371472 [7:09:36<13:41,  3.60it/s]
 99%|█████████▉| 368518/371472 [7:09:37<13:48,  3.56it/s]
 99%|█████████▉| 368519/371472 [7:09:37<14:02,  3.50it/s]
 99%|█████████▉| 368520/371472 [7:09:37<14:15,  3.45it/s]
                                                         
{'loss': 2.6308, 'learning_rate': 1.0715593958068476e-07, 'epoch': 15.87}

 99%|█████████▉| 368520/371472 [7:09:37<14:15,  3.45it/s]
 99%|█████████▉| 368521/371472 [7:09:38<14:23,  3.42it/s]
 99%|█████████▉| 368522/371472 [7:09:38<14:27,  3.40it/s]
 99%|█████████▉| 368523/371472 [7:09:38<15:22,  3.20it/s]
 99%|█████████▉| 368524/371472 [7:09:39<14:48,  3.32it/s]
 99%|█████████▉| 368525/371472 [7:09:39<14:02,  3.50it/s]
 99%|█████████▉| 368526/371472 [7:09:39<13:39,  3.59it/s]
 99%|█████████▉| 368527/371472 [7:09:39<13:23,  3.67it/s]
 99%|█████████▉| 368528/371472 [7:09:40<14:09,  3.46it/s]
 99%|█████████▉| 368529/371472 [7:09:40<14:26,  3.40it/s]
 99%|█████████▉| 368530/371472 [7:09:40<13:42,  3.58it/s]
 99%|█████████▉| 368531/371472 [7:09:41<14:20,  3.42it/s]
 99%|█████████▉| 368532/371472 [7:09:41<15:17,  3.20it/s]
 99%|█████████▉| 368533/371472 [7:09:41<15:30,  3.16it/s]
 99%|█████████▉| 368534/371472 [7:09:41<14:44,  3.32it/s]
 99%|█████████▉| 368535/371472 [7:09:42<14:07,  3.46it/s]
 99%|█████████▉| 368536/371472 [7:09:42<13:44,  3.56it/s]
 99%|█████████▉| 368537/371472 [7:09:42<15:08,  3.23it/s]
 99%|█████████▉| 368538/371472 [7:09:43<14:43,  3.32it/s]
 99%|█████████▉| 368539/371472 [7:09:43<13:50,  3.53it/s]
 99%|█████████▉| 368540/371472 [7:09:43<13:40,  3.57it/s]
                                                         
{'loss': 2.6684, 'learning_rate': 1.0710745760520593e-07, 'epoch': 15.87}

 99%|█████████▉| 368540/371472 [7:09:43<13:40,  3.57it/s]
 99%|█████████▉| 368541/371472 [7:09:43<13:23,  3.65it/s]
 99%|█████████▉| 368542/371472 [7:09:44<13:44,  3.55it/s]
 99%|█████████▉| 368543/371472 [7:09:44<14:25,  3.38it/s]
 99%|█████████▉| 368544/371472 [7:09:44<14:04,  3.47it/s]
 99%|█████████▉| 368545/371472 [7:09:45<14:46,  3.30it/s]
 99%|█████████▉| 368546/371472 [7:09:45<14:51,  3.28it/s]
 99%|█████████▉| 368547/371472 [7:09:45<14:47,  3.30it/s]
 99%|█████████▉| 368548/371472 [7:09:46<14:40,  3.32it/s]
 99%|█████████▉| 368549/371472 [7:09:46<13:53,  3.51it/s]
 99%|█████████▉| 368550/371472 [7:09:46<13:47,  3.53it/s]
 99%|█████████▉| 368551/371472 [7:09:46<13:58,  3.48it/s]
 99%|█████████▉| 368552/371472 [7:09:47<13:46,  3.53it/s]
 99%|█████████▉| 368553/371472 [7:09:47<14:03,  3.46it/s]
 99%|█████████▉| 368554/371472 [7:09:47<13:50,  3.51it/s]
 99%|█████████▉| 368555/371472 [7:09:48<13:57,  3.48it/s]
 99%|█████████▉| 368556/371472 [7:09:48<14:15,  3.41it/s]
 99%|█████████▉| 368557/371472 [7:09:48<14:50,  3.27it/s]
 99%|█████████▉| 368558/371472 [7:09:48<13:50,  3.51it/s]
 99%|█████████▉| 368559/371472 [7:09:49<13:28,  3.60it/s]
 99%|█████████▉| 368560/371472 [7:09:49<13:12,  3.67it/s]
                                                         
{'loss': 2.7047, 'learning_rate': 1.0705897562972698e-07, 'epoch': 15.87}

 99%|█████████▉| 368560/371472 [7:09:49<13:12,  3.67it/s]
 99%|█████████▉| 368561/371472 [7:09:49<13:48,  3.51it/s]
 99%|█████████▉| 368562/371472 [7:09:50<14:37,  3.32it/s]
 99%|█████████▉| 368563/371472 [7:09:50<14:09,  3.42it/s]
 99%|█████████▉| 368564/371472 [7:09:50<14:05,  3.44it/s]
 99%|█████████▉| 368565/371472 [7:09:50<13:59,  3.46it/s]
 99%|█████████▉| 368566/371472 [7:09:51<14:27,  3.35it/s]
 99%|█████████▉| 368567/371472 [7:09:51<13:53,  3.49it/s]
 99%|█████████▉| 368568/371472 [7:09:51<13:56,  3.47it/s]
 99%|█████████▉| 368569/371472 [7:09:52<13:44,  3.52it/s]
 99%|█████████▉| 368570/371472 [7:09:52<13:29,  3.58it/s]
 99%|█████████▉| 368571/371472 [7:09:52<13:51,  3.49it/s]
 99%|█████████▉| 368572/371472 [7:09:52<13:26,  3.60it/s]
 99%|█████████▉| 368573/371472 [7:09:53<13:08,  3.68it/s]
 99%|█████████▉| 368574/371472 [7:09:53<14:03,  3.44it/s]
 99%|█████████▉| 368575/371472 [7:09:53<14:14,  3.39it/s]
 99%|█████████▉| 368576/371472 [7:09:54<13:34,  3.55it/s]
 99%|█████████▉| 368577/371472 [7:09:54<14:08,  3.41it/s]
 99%|█████████▉| 368578/371472 [7:09:54<13:40,  3.53it/s]
 99%|█████████▉| 368579/371472 [7:09:54<13:45,  3.51it/s]
 99%|█████████▉| 368580/371472 [7:09:55<13:31,  3.56it/s]
                                                         
{'loss': 2.5319, 'learning_rate': 1.0701049365424813e-07, 'epoch': 15.88}

 99%|█████████▉| 368580/371472 [7:09:55<13:31,  3.56it/s]
 99%|█████████▉| 368581/371472 [7:09:55<13:22,  3.60it/s]
 99%|█████████▉| 368582/371472 [7:09:55<14:16,  3.37it/s]
 99%|█████████▉| 368583/371472 [7:09:56<13:44,  3.51it/s]
 99%|█████████▉| 368584/371472 [7:09:56<14:59,  3.21it/s]
 99%|█████████▉| 368585/371472 [7:09:56<14:38,  3.29it/s]
 99%|█████████▉| 368586/371472 [7:09:57<15:23,  3.13it/s]
 99%|█████████▉| 368587/371472 [7:09:57<14:59,  3.21it/s]
 99%|█████████▉| 368588/371472 [7:09:57<14:13,  3.38it/s]
 99%|█████████▉| 368589/371472 [7:09:57<13:57,  3.44it/s]
 99%|█████████▉| 368590/371472 [7:09:58<14:44,  3.26it/s]
 99%|█████████▉| 368591/371472 [7:09:58<13:53,  3.46it/s]
 99%|█████████▉| 368592/371472 [7:09:58<13:49,  3.47it/s]
 99%|█████████▉| 368593/371472 [7:09:59<13:37,  3.52it/s]
 99%|█████████▉| 368594/371472 [7:09:59<13:57,  3.43it/s]
 99%|█████████▉| 368595/371472 [7:09:59<14:48,  3.24it/s]
 99%|█████████▉| 368596/371472 [7:09:59<13:57,  3.43it/s]
 99%|█████████▉| 368597/371472 [7:10:00<13:36,  3.52it/s]
 99%|█████████▉| 368598/371472 [7:10:00<14:21,  3.33it/s]
 99%|█████████▉| 368599/371472 [7:10:00<14:01,  3.41it/s]
 99%|█████████▉| 368600/371472 [7:10:01<13:10,  3.63it/s]
                                                         
{'loss': 2.4935, 'learning_rate': 1.0696201167876919e-07, 'epoch': 15.88}

 99%|█████████▉| 368600/371472 [7:10:01<13:10,  3.63it/s]
 99%|█████████▉| 368601/371472 [7:10:01<13:13,  3.62it/s]
 99%|█████████▉| 368602/371472 [7:10:01<14:01,  3.41it/s]
 99%|█████████▉| 368603/371472 [7:10:01<14:08,  3.38it/s]
 99%|█████████▉| 368604/371472 [7:10:02<14:22,  3.32it/s]
 99%|█████████▉| 368605/371472 [7:10:02<13:48,  3.46it/s]
 99%|█████████▉| 368606/371472 [7:10:02<13:33,  3.52it/s]
 99%|█████████▉| 368607/371472 [7:10:03<13:32,  3.52it/s]
 99%|█████████▉| 368608/371472 [7:10:03<13:27,  3.55it/s]
 99%|█████████▉| 368609/371472 [7:10:03<13:10,  3.62it/s]
 99%|█████████▉| 368610/371472 [7:10:03<12:51,  3.71it/s]
 99%|█████████▉| 368611/371472 [7:10:04<13:07,  3.63it/s]
 99%|█████████▉| 368612/371472 [7:10:04<13:25,  3.55it/s]
 99%|█████████▉| 368613/371472 [7:10:04<13:02,  3.65it/s]
 99%|█████████▉| 368614/371472 [7:10:05<12:47,  3.72it/s]
 99%|█████████▉| 368615/371472 [7:10:05<12:28,  3.82it/s]
 99%|█████████▉| 368616/371472 [7:10:05<13:30,  3.53it/s]
 99%|█████████▉| 368617/371472 [7:10:05<12:57,  3.67it/s]
 99%|█████████▉| 368618/371472 [7:10:06<13:50,  3.44it/s]
 99%|█████████▉| 368619/371472 [7:10:06<15:37,  3.04it/s]
 99%|█████████▉| 368620/371472 [7:10:06<14:59,  3.17it/s]
                                                         
{'loss': 2.5373, 'learning_rate': 1.0691352970329036e-07, 'epoch': 15.88}

 99%|█████████▉| 368620/371472 [7:10:06<14:59,  3.17it/s]
 99%|█████████▉| 368621/371472 [7:10:07<14:08,  3.36it/s]
 99%|█████████▉| 368622/371472 [7:10:07<13:42,  3.46it/s]
 99%|█████████▉| 368623/371472 [7:10:07<13:32,  3.51it/s]
 99%|█████████▉| 368624/371472 [7:10:07<13:25,  3.54it/s]
 99%|█████████▉| 368625/371472 [7:10:08<12:58,  3.66it/s]
 99%|█████████▉| 368626/371472 [7:10:08<12:50,  3.70it/s]
 99%|█████████▉| 368627/371472 [7:10:08<13:03,  3.63it/s]
 99%|█████████▉| 368628/371472 [7:10:09<14:04,  3.37it/s]
 99%|█████████▉| 368629/371472 [7:10:09<13:43,  3.45it/s]
 99%|█████████▉| 368630/371472 [7:10:09<13:29,  3.51it/s]
 99%|█████████▉| 368631/371472 [7:10:09<13:04,  3.62it/s]
 99%|█████████▉| 368632/371472 [7:10:10<13:11,  3.59it/s]
 99%|█████████▉| 368633/371472 [7:10:10<13:16,  3.56it/s]
 99%|█████████▉| 368634/371472 [7:10:10<13:07,  3.60it/s]
 99%|█████████▉| 368635/371472 [7:10:10<12:40,  3.73it/s]
 99%|█████████▉| 368636/371472 [7:10:11<12:19,  3.83it/s]
 99%|█████████▉| 368637/371472 [7:10:11<12:47,  3.70it/s]
 99%|█████████▉| 368638/371472 [7:10:11<13:03,  3.62it/s]
 99%|█████████▉| 368639/371472 [7:10:12<12:58,  3.64it/s]
 99%|█████████▉| 368640/371472 [7:10:12<12:30,  3.77it/s]
                                                         
{'loss': 2.4797, 'learning_rate': 1.068650477278114e-07, 'epoch': 15.88}

 99%|█████████▉| 368640/371472 [7:10:12<12:30,  3.77it/s]
 99%|█████████▉| 368641/371472 [7:10:12<12:21,  3.82it/s]
 99%|█████████▉| 368642/371472 [7:10:12<12:50,  3.67it/s]
 99%|█████████▉| 368643/371472 [7:10:13<12:53,  3.66it/s]
 99%|█████████▉| 368644/371472 [7:10:13<12:31,  3.76it/s]
 99%|█████████▉| 368645/371472 [7:10:13<12:28,  3.77it/s]
 99%|█████████▉| 368646/371472 [7:10:13<12:36,  3.74it/s]
 99%|█████████▉| 368647/371472 [7:10:14<12:59,  3.62it/s]
 99%|█████████▉| 368648/371472 [7:10:14<12:57,  3.63it/s]
 99%|█████████▉| 368649/371472 [7:10:14<12:36,  3.73it/s]
 99%|█████████▉| 368650/371472 [7:10:15<12:15,  3.84it/s]
 99%|█████████▉| 368651/371472 [7:10:15<12:28,  3.77it/s]
 99%|█████████▉| 368652/371472 [7:10:15<12:27,  3.77it/s]
 99%|█████████▉| 368653/371472 [7:10:15<12:24,  3.79it/s]
 99%|█████████▉| 368654/371472 [7:10:16<12:23,  3.79it/s]
 99%|█████████▉| 368655/371472 [7:10:16<12:18,  3.82it/s]
 99%|█████████▉| 368656/371472 [7:10:16<12:15,  3.83it/s]
 99%|█████████▉| 368657/371472 [7:10:16<12:05,  3.88it/s]
 99%|█████████▉| 368658/371472 [7:10:17<13:00,  3.60it/s]
 99%|█████████▉| 368659/371472 [7:10:17<12:44,  3.68it/s]
 99%|█████████▉| 368660/371472 [7:10:17<12:56,  3.62it/s]
                                                         
{'loss': 2.7023, 'learning_rate': 1.0681656575233257e-07, 'epoch': 15.88}

 99%|█████████▉| 368660/371472 [7:10:17<12:56,  3.62it/s]
 99%|█████████▉| 368661/371472 [7:10:17<12:43,  3.68it/s]
 99%|█████████▉| 368662/371472 [7:10:18<13:18,  3.52it/s]
 99%|█████████▉| 368663/371472 [7:10:18<13:05,  3.58it/s]
 99%|█████████▉| 368664/371472 [7:10:18<13:59,  3.34it/s]
 99%|█████████▉| 368665/371472 [7:10:19<13:27,  3.48it/s]
 99%|█████████▉| 368666/371472 [7:10:19<14:17,  3.27it/s]
 99%|█████████▉| 368667/371472 [7:10:19<13:42,  3.41it/s]
 99%|█████████▉| 368668/371472 [7:10:20<12:56,  3.61it/s]
 99%|█████████▉| 368669/371472 [7:10:20<14:00,  3.34it/s]
 99%|█████████▉| 368670/371472 [7:10:20<13:45,  3.40it/s]
 99%|█████████▉| 368671/371472 [7:10:20<13:38,  3.42it/s]
 99%|█████████▉| 368672/371472 [7:10:21<13:13,  3.53it/s]
 99%|█████████▉| 368673/371472 [7:10:21<13:49,  3.38it/s]
 99%|█████████▉| 368674/371472 [7:10:21<13:32,  3.44it/s]
 99%|█████████▉| 368675/371472 [7:10:22<13:31,  3.45it/s]
 99%|█████████▉| 368676/371472 [7:10:22<13:00,  3.58it/s]
 99%|█████████▉| 368677/371472 [7:10:22<12:53,  3.61it/s]
 99%|█████████▉| 368678/371472 [7:10:22<13:02,  3.57it/s]
 99%|█████████▉| 368679/371472 [7:10:23<13:29,  3.45it/s]
 99%|█████████▉| 368680/371472 [7:10:23<13:06,  3.55it/s]
                                                         
{'loss': 2.559, 'learning_rate': 1.0676808377685362e-07, 'epoch': 15.88}

 99%|█████████▉| 368680/371472 [7:10:23<13:06,  3.55it/s]
 99%|█████████▉| 368681/371472 [7:10:23<14:14,  3.26it/s]
 99%|█████████▉| 368682/371472 [7:10:24<14:25,  3.23it/s]
 99%|█████████▉| 368683/371472 [7:10:24<14:32,  3.20it/s]
 99%|█████████▉| 368684/371472 [7:10:24<14:58,  3.10it/s]
 99%|█████████▉| 368685/371472 [7:10:25<14:17,  3.25it/s]
 99%|█████████▉| 368686/371472 [7:10:25<14:33,  3.19it/s]
 99%|█████████▉| 368687/371472 [7:10:25<13:38,  3.40it/s]
 99%|█████████▉| 368688/371472 [7:10:25<13:56,  3.33it/s]
 99%|█████████▉| 368689/371472 [7:10:26<14:39,  3.17it/s]
 99%|█████████▉| 368690/371472 [7:10:26<13:42,  3.38it/s]
 99%|█████████▉| 368691/371472 [7:10:26<14:36,  3.17it/s]
 99%|█████████▉| 368692/371472 [7:10:27<14:14,  3.25it/s]
 99%|█████████▉| 368693/371472 [7:10:27<13:32,  3.42it/s]
 99%|█████████▉| 368694/371472 [7:10:27<14:20,  3.23it/s]
 99%|█████████▉| 368695/371472 [7:10:28<13:37,  3.40it/s]
 99%|█████████▉| 368696/371472 [7:10:28<13:06,  3.53it/s]
 99%|█████████▉| 368697/371472 [7:10:28<12:56,  3.57it/s]
 99%|█████████▉| 368698/371472 [7:10:28<13:54,  3.33it/s]
 99%|█████████▉| 368699/371472 [7:10:29<14:09,  3.26it/s]
 99%|█████████▉| 368700/371472 [7:10:29<13:17,  3.48it/s]
                                                         
{'loss': 2.5607, 'learning_rate': 1.0671960180137468e-07, 'epoch': 15.88}

 99%|█████████▉| 368700/371472 [7:10:29<13:17,  3.48it/s]
 99%|█████████▉| 368701/371472 [7:10:29<13:00,  3.55it/s]
 99%|█████████▉| 368702/371472 [7:10:30<12:42,  3.63it/s]
 99%|█████████▉| 368703/371472 [7:10:30<12:20,  3.74it/s]
 99%|█████████▉| 368704/371472 [7:10:30<12:10,  3.79it/s]
 99%|█████████▉| 368705/371472 [7:10:30<12:20,  3.74it/s]
 99%|█████████▉| 368706/371472 [7:10:31<13:01,  3.54it/s]
 99%|█████████▉| 368707/371472 [7:10:31<13:07,  3.51it/s]
 99%|█████████▉| 368708/371472 [7:10:31<12:29,  3.69it/s]
 99%|█████████▉| 368709/371472 [7:10:32<13:37,  3.38it/s]
 99%|█████████▉| 368710/371472 [7:10:32<13:11,  3.49it/s]
 99%|█████████▉| 368711/371472 [7:10:32<13:33,  3.40it/s]
 99%|█████████▉| 368712/371472 [7:10:32<13:20,  3.45it/s]
 99%|█████████▉| 368713/371472 [7:10:33<13:18,  3.46it/s]
 99%|█████████▉| 368714/371472 [7:10:33<13:33,  3.39it/s]
 99%|█████████▉| 368715/371472 [7:10:33<13:43,  3.35it/s]
 99%|█████████▉| 368716/371472 [7:10:34<13:07,  3.50it/s]
 99%|█████████▉| 368717/371472 [7:10:34<13:28,  3.41it/s]
 99%|█████████▉| 368718/371472 [7:10:34<13:03,  3.51it/s]
 99%|█████████▉| 368719/371472 [7:10:35<14:13,  3.23it/s]
 99%|█████████▉| 368720/371472 [7:10:35<13:43,  3.34it/s]
                                                         
{'loss': 2.5345, 'learning_rate': 1.0667111982589583e-07, 'epoch': 15.88}

 99%|█████████▉| 368720/371472 [7:10:35<13:43,  3.34it/s]
 99%|█████████▉| 368721/371472 [7:10:35<14:03,  3.26it/s]
 99%|█████████▉| 368722/371472 [7:10:35<13:54,  3.29it/s]
 99%|█████████▉| 368723/371472 [7:10:36<14:07,  3.24it/s]
 99%|█████████▉| 368724/371472 [7:10:36<14:13,  3.22it/s]
 99%|█████████▉| 368725/371472 [7:10:36<14:03,  3.26it/s]
 99%|█████████▉| 368726/371472 [7:10:37<13:14,  3.46it/s]
 99%|█████████▉| 368727/371472 [7:10:37<13:39,  3.35it/s]
 99%|█████████▉| 368728/371472 [7:10:37<13:34,  3.37it/s]
 99%|█████████▉| 368729/371472 [7:10:37<13:06,  3.49it/s]
 99%|█████████▉| 368730/371472 [7:10:38<14:34,  3.13it/s]
 99%|█████████▉| 368731/371472 [7:10:38<14:29,  3.15it/s]
 99%|█████████▉| 368732/371472 [7:10:39<15:06,  3.02it/s]
 99%|█████████▉| 368733/371472 [7:10:39<14:57,  3.05it/s]
 99%|█████████▉| 368734/371472 [7:10:39<14:01,  3.26it/s]
 99%|█████████▉| 368735/371472 [7:10:39<13:06,  3.48it/s]
 99%|█████████▉| 368736/371472 [7:10:40<13:31,  3.37it/s]
 99%|█████████▉| 368737/371472 [7:10:40<13:28,  3.38it/s]
 99%|█████████▉| 368738/371472 [7:10:40<12:57,  3.52it/s]
 99%|█████████▉| 368739/371472 [7:10:41<12:57,  3.51it/s]
 99%|█████████▉| 368740/371472 [7:10:41<12:36,  3.61it/s]
                                                         
{'loss': 2.5494, 'learning_rate': 1.0662263785041689e-07, 'epoch': 15.88}

 99%|█████████▉| 368740/371472 [7:10:41<12:36,  3.61it/s]
 99%|█████████▉| 368741/371472 [7:10:41<12:17,  3.70it/s]
 99%|█████████▉| 368742/371472 [7:10:41<12:59,  3.50it/s]
 99%|█████████▉| 368743/371472 [7:10:42<12:38,  3.60it/s]
 99%|█████████▉| 368744/371472 [7:10:42<12:35,  3.61it/s]
 99%|█████████▉| 368745/371472 [7:10:42<12:59,  3.50it/s]
 99%|█████████▉| 368746/371472 [7:10:42<12:49,  3.54it/s]
 99%|█████████▉| 368747/371472 [7:10:43<12:59,  3.50it/s]
 99%|█████████▉| 368748/371472 [7:10:43<12:28,  3.64it/s]
 99%|█████████▉| 368749/371472 [7:10:43<12:17,  3.69it/s]
 99%|█████████▉| 368750/371472 [7:10:44<11:58,  3.79it/s]
 99%|█████████▉| 368751/371472 [7:10:44<11:42,  3.87it/s]
 99%|█████████▉| 368752/371472 [7:10:44<12:03,  3.76it/s]
 99%|█████████▉| 368753/371472 [7:10:44<11:40,  3.88it/s]
 99%|█████████▉| 368754/371472 [7:10:45<11:50,  3.82it/s]
 99%|█████████▉| 368755/371472 [7:10:45<11:52,  3.82it/s]
 99%|█████████▉| 368756/371472 [7:10:45<12:01,  3.77it/s]
 99%|█████████▉| 368757/371472 [7:10:45<11:55,  3.79it/s]
 99%|█████████▉| 368758/371472 [7:10:46<12:46,  3.54it/s]
 99%|█████████▉| 368759/371472 [7:10:46<12:40,  3.57it/s]
 99%|█████████▉| 368760/371472 [7:10:46<12:40,  3.56it/s]
                                                         
{'loss': 2.5712, 'learning_rate': 1.0657415587493806e-07, 'epoch': 15.88}

 99%|█████████▉| 368760/371472 [7:10:46<12:40,  3.56it/s]
 99%|█████████▉| 368761/371472 [7:10:47<12:54,  3.50it/s]
 99%|█████████▉| 368762/371472 [7:10:47<12:21,  3.65it/s]
 99%|█████████▉| 368763/371472 [7:10:47<13:18,  3.39it/s]
 99%|█████████▉| 368764/371472 [7:10:47<13:18,  3.39it/s]
 99%|█████████▉| 368765/371472 [7:10:48<13:10,  3.42it/s]
 99%|█████████▉| 368766/371472 [7:10:48<12:36,  3.58it/s]
 99%|█████████▉| 368767/371472 [7:10:48<12:30,  3.60it/s]
 99%|█████████▉| 368768/371472 [7:10:49<12:54,  3.49it/s]
 99%|█████████▉| 368769/371472 [7:10:49<12:26,  3.62it/s]
 99%|█████████▉| 368770/371472 [7:10:49<12:20,  3.65it/s]
 99%|█████████▉| 368771/371472 [7:10:49<12:11,  3.69it/s]
 99%|█████████▉| 368772/371472 [7:10:50<12:02,  3.73it/s]
 99%|█████████▉| 368773/371472 [7:10:50<12:07,  3.71it/s]
 99%|█████████▉| 368774/371472 [7:10:50<11:59,  3.75it/s]
 99%|█████████▉| 368775/371472 [7:10:50<12:34,  3.57it/s]
 99%|█████████▉| 368776/371472 [7:10:51<12:39,  3.55it/s]
 99%|█████████▉| 368777/371472 [7:10:51<14:08,  3.18it/s]
 99%|█████████▉| 368778/371472 [7:10:51<14:50,  3.02it/s]
 99%|█████████▉| 368779/371472 [7:10:52<14:00,  3.20it/s]
 99%|█████████▉| 368780/371472 [7:10:52<14:16,  3.14it/s]
                                                         
{'loss': 2.5638, 'learning_rate': 1.0652567389945911e-07, 'epoch': 15.88}

 99%|█████████▉| 368780/371472 [7:10:52<14:16,  3.14it/s]
 99%|█████████▉| 368781/371472 [7:10:52<13:34,  3.30it/s]
 99%|█████████▉| 368782/371472 [7:10:53<13:10,  3.40it/s]
 99%|█████████▉| 368783/371472 [7:10:53<12:26,  3.60it/s]
 99%|█████████▉| 368784/371472 [7:10:53<12:05,  3.71it/s]
 99%|█████████▉| 368785/371472 [7:10:53<13:21,  3.35it/s]
 99%|█████████▉| 368786/371472 [7:10:54<13:05,  3.42it/s]
 99%|█████████▉| 368787/371472 [7:10:54<12:50,  3.48it/s]
 99%|█████████▉| 368788/371472 [7:10:54<13:50,  3.23it/s]
 99%|█████████▉| 368789/371472 [7:10:55<13:35,  3.29it/s]
 99%|█████████▉| 368790/371472 [7:10:55<12:58,  3.45it/s]
 99%|█████████▉| 368791/371472 [7:10:55<12:47,  3.49it/s]
 99%|█████████▉| 368792/371472 [7:10:55<12:34,  3.55it/s]
 99%|█████████▉| 368793/371472 [7:10:56<13:01,  3.43it/s]
 99%|█████████▉| 368794/371472 [7:10:56<13:11,  3.38it/s]
 99%|█████████▉| 368795/371472 [7:10:56<12:53,  3.46it/s]
 99%|█████████▉| 368796/371472 [7:10:57<14:09,  3.15it/s]
 99%|█████████▉| 368797/371472 [7:10:57<13:47,  3.23it/s]
 99%|█████████▉| 368798/371472 [7:10:57<13:42,  3.25it/s]
 99%|█████████▉| 368799/371472 [7:10:58<14:15,  3.13it/s]
 99%|█████████▉| 368800/371472 [7:10:58<14:01,  3.17it/s]
                                                         
{'loss': 2.5413, 'learning_rate': 1.0647719192398026e-07, 'epoch': 15.88}

 99%|█████████▉| 368800/371472 [7:10:58<14:01,  3.17it/s]
 99%|█████████▉| 368801/371472 [7:10:58<14:46,  3.01it/s]
 99%|█████████▉| 368802/371472 [7:10:59<14:11,  3.14it/s]
 99%|█████████▉| 368803/371472 [7:10:59<13:24,  3.32it/s]
 99%|█████████▉| 368804/371472 [7:10:59<13:35,  3.27it/s]
 99%|█████████▉| 368805/371472 [7:11:00<13:16,  3.35it/s]
 99%|█████████▉| 368806/371472 [7:11:00<13:07,  3.39it/s]
 99%|█████████▉| 368807/371472 [7:11:00<12:26,  3.57it/s]
 99%|█████████▉| 368808/371472 [7:11:00<12:05,  3.67it/s]
 99%|█████████▉| 368809/371472 [7:11:01<11:49,  3.75it/s]
 99%|█████████▉| 368810/371472 [7:11:01<12:04,  3.68it/s]
 99%|█████████▉| 368811/371472 [7:11:01<12:11,  3.64it/s]
 99%|█████████▉| 368812/371472 [7:11:01<12:00,  3.69it/s]
 99%|█████████▉| 368813/371472 [7:11:02<12:07,  3.66it/s]
 99%|█████████▉| 368814/371472 [7:11:02<11:49,  3.74it/s]
 99%|█████████▉| 368815/371472 [7:11:02<11:31,  3.84it/s]
 99%|█████████▉| 368816/371472 [7:11:02<12:09,  3.64it/s]
 99%|█████████▉| 368817/371472 [7:11:03<11:55,  3.71it/s]
 99%|█████████▉| 368818/371472 [7:11:03<12:03,  3.67it/s]
 99%|█████████▉| 368819/371472 [7:11:03<12:00,  3.68it/s]
 99%|█████████▉| 368820/371472 [7:11:04<11:43,  3.77it/s]
                                                         
{'loss': 2.5894, 'learning_rate': 1.0642870994850132e-07, 'epoch': 15.89}

 99%|█████████▉| 368820/371472 [7:11:04<11:43,  3.77it/s]
 99%|█████████▉| 368821/371472 [7:11:04<11:29,  3.84it/s]
 99%|█████████▉| 368822/371472 [7:11:04<11:31,  3.83it/s]
 99%|█████████▉| 368823/371472 [7:11:04<11:43,  3.76it/s]
 99%|█████████▉| 368824/371472 [7:11:05<11:34,  3.81it/s]
 99%|█████████▉| 368825/371472 [7:11:05<11:45,  3.75it/s]
 99%|█████████▉| 368826/371472 [7:11:05<11:41,  3.77it/s]
 99%|█████████▉| 368827/371472 [7:11:05<12:30,  3.52it/s]
 99%|█████████▉| 368828/371472 [7:11:06<12:12,  3.61it/s]
 99%|█████████▉| 368829/371472 [7:11:06<11:47,  3.73it/s]
 99%|█████████▉| 368830/371472 [7:11:06<11:49,  3.72it/s]
 99%|█████████▉| 368831/371472 [7:11:06<11:48,  3.73it/s]
 99%|█████████▉| 368832/371472 [7:11:07<12:13,  3.60it/s]
 99%|█████████▉| 368833/371472 [7:11:07<12:16,  3.59it/s]
 99%|█████████▉| 368834/371472 [7:11:07<12:59,  3.38it/s]
 99%|█████████▉| 368835/371472 [7:11:08<12:42,  3.46it/s]
 99%|█████████▉| 368836/371472 [7:11:08<13:01,  3.37it/s]
 99%|█████████▉| 368837/371472 [7:11:08<12:40,  3.47it/s]
 99%|█████████▉| 368838/371472 [7:11:09<12:14,  3.59it/s]
 99%|█████████▉| 368839/371472 [7:11:09<12:03,  3.64it/s]
 99%|█████████▉| 368840/371472 [7:11:09<12:35,  3.48it/s]
                                                         
{'loss': 2.7263, 'learning_rate': 1.0638022797302249e-07, 'epoch': 15.89}

 99%|█████████▉| 368840/371472 [7:11:09<12:35,  3.48it/s]
 99%|█████████▉| 368841/371472 [7:11:09<12:51,  3.41it/s]
 99%|█████████▉| 368842/371472 [7:11:10<12:36,  3.48it/s]
 99%|█████████▉| 368843/371472 [7:11:10<13:11,  3.32it/s]
 99%|█████████▉| 368844/371472 [7:11:10<12:30,  3.50it/s]
 99%|█████████▉| 368845/371472 [7:11:11<12:29,  3.51it/s]
 99%|█████████▉| 368846/371472 [7:11:11<13:02,  3.36it/s]
 99%|█████████▉| 368847/371472 [7:11:11<12:55,  3.38it/s]
 99%|█████████▉| 368848/371472 [7:11:11<12:39,  3.45it/s]
 99%|█████████▉| 368849/371472 [7:11:12<12:18,  3.55it/s]
 99%|█████████▉| 368850/371472 [7:11:12<12:15,  3.57it/s]
 99%|█████████▉| 368851/371472 [7:11:12<12:43,  3.43it/s]
 99%|█████████▉| 368852/371472 [7:11:13<12:07,  3.60it/s]
 99%|█████████▉| 368853/371472 [7:11:13<11:57,  3.65it/s]
 99%|█████████▉| 368854/371472 [7:11:13<11:58,  3.64it/s]
 99%|█████████▉| 368855/371472 [7:11:13<11:55,  3.66it/s]
 99%|█████████▉| 368856/371472 [7:11:14<11:36,  3.76it/s]
 99%|█████████▉| 368857/371472 [7:11:14<11:40,  3.73it/s]
 99%|█████████▉| 368858/371472 [7:11:14<11:41,  3.73it/s]
 99%|█████████▉| 368859/371472 [7:11:14<12:09,  3.58it/s]
 99%|█████████▉| 368860/371472 [7:11:15<11:51,  3.67it/s]
                                                         
{'loss': 2.5099, 'learning_rate': 1.0633174599754355e-07, 'epoch': 15.89}

 99%|█████████▉| 368860/371472 [7:11:15<11:51,  3.67it/s]
 99%|█████████▉| 368861/371472 [7:11:15<12:03,  3.61it/s]
 99%|█████████▉| 368862/371472 [7:11:15<12:00,  3.62it/s]
 99%|█████████▉| 368863/371472 [7:11:16<11:55,  3.65it/s]
 99%|█████████▉| 368864/371472 [7:11:16<12:09,  3.57it/s]
 99%|█████████▉| 368865/371472 [7:11:16<12:28,  3.48it/s]
 99%|█████████▉| 368866/371472 [7:11:16<12:47,  3.40it/s]
 99%|█████████▉| 368867/371472 [7:11:17<12:42,  3.42it/s]
 99%|█████████▉| 368868/371472 [7:11:17<12:09,  3.57it/s]
 99%|█████████▉| 368869/371472 [7:11:17<11:48,  3.67it/s]
 99%|█████████▉| 368870/371472 [7:11:18<12:06,  3.58it/s]
 99%|█████████▉| 368871/371472 [7:11:18<11:48,  3.67it/s]
 99%|█████████▉| 368872/371472 [7:11:18<11:39,  3.72it/s]
 99%|█████████▉| 368873/371472 [7:11:18<12:03,  3.59it/s]
 99%|█████████▉| 368874/371472 [7:11:19<13:23,  3.23it/s]
 99%|█████████▉| 368875/371472 [7:11:19<12:30,  3.46it/s]
 99%|█████████▉| 368876/371472 [7:11:19<12:32,  3.45it/s]
 99%|█████████▉| 368877/371472 [7:11:20<12:56,  3.34it/s]
 99%|█████████▉| 368878/371472 [7:11:20<13:29,  3.20it/s]
 99%|█████████▉| 368879/371472 [7:11:20<13:11,  3.27it/s]
 99%|█████████▉| 368880/371472 [7:11:20<12:51,  3.36it/s]
                                                         
{'loss': 2.5344, 'learning_rate': 1.062832640220647e-07, 'epoch': 15.89}

 99%|█████████▉| 368880/371472 [7:11:20<12:51,  3.36it/s]
 99%|█████████▉| 368881/371472 [7:11:21<12:50,  3.36it/s]
 99%|█████████▉| 368882/371472 [7:11:21<13:00,  3.32it/s]
 99%|█████████▉| 368883/371472 [7:11:21<13:00,  3.32it/s]
 99%|█████████▉| 368884/371472 [7:11:22<12:24,  3.47it/s]
 99%|█████████▉| 368885/371472 [7:11:22<12:51,  3.35it/s]
 99%|█████████▉| 368886/371472 [7:11:22<12:16,  3.51it/s]
 99%|█████████▉| 368887/371472 [7:11:23<12:23,  3.48it/s]
 99%|█████████▉| 368888/371472 [7:11:23<12:06,  3.56it/s]
 99%|█████████▉| 368889/371472 [7:11:23<11:52,  3.63it/s]
 99%|█████████▉| 368890/371472 [7:11:23<11:49,  3.64it/s]
 99%|█████████▉| 368891/371472 [7:11:24<11:42,  3.68it/s]
 99%|█████████▉| 368892/371472 [7:11:24<11:53,  3.62it/s]
 99%|█████████▉| 368893/371472 [7:11:24<11:49,  3.64it/s]
 99%|█████████▉| 368894/371472 [7:11:24<12:16,  3.50it/s]
 99%|█████████▉| 368895/371472 [7:11:25<12:02,  3.57it/s]
 99%|█████████▉| 368896/371472 [7:11:25<11:33,  3.71it/s]
 99%|█████████▉| 368897/371472 [7:11:25<12:25,  3.45it/s]
 99%|█████████▉| 368898/371472 [7:11:26<13:15,  3.24it/s]
 99%|█████████▉| 368899/371472 [7:11:26<12:29,  3.43it/s]
 99%|█████████▉| 368900/371472 [7:11:26<12:49,  3.34it/s]
                                                         
{'loss': 2.5552, 'learning_rate': 1.0623478204658575e-07, 'epoch': 15.89}

 99%|█████████▉| 368900/371472 [7:11:26<12:49,  3.34it/s]
 99%|█████████▉| 368901/371472 [7:11:26<12:13,  3.50it/s]
 99%|█████████▉| 368902/371472 [7:11:27<11:33,  3.70it/s]
 99%|█████████▉| 368903/371472 [7:11:27<11:29,  3.72it/s]
 99%|█████████▉| 368904/371472 [7:11:27<11:39,  3.67it/s]
 99%|█████████▉| 368905/371472 [7:11:28<11:43,  3.65it/s]
 99%|█████████▉| 368906/371472 [7:11:28<11:59,  3.57it/s]
 99%|█████████▉| 368907/371472 [7:11:28<11:47,  3.63it/s]
 99%|█████████▉| 368908/371472 [7:11:28<12:05,  3.53it/s]
 99%|█████████▉| 368909/371472 [7:11:29<12:15,  3.49it/s]
 99%|█████████▉| 368910/371472 [7:11:29<12:44,  3.35it/s]
 99%|█████████▉| 368911/371472 [7:11:29<12:13,  3.49it/s]
 99%|█████████▉| 368912/371472 [7:11:30<12:20,  3.46it/s]
 99%|█████████▉| 368913/371472 [7:11:30<12:40,  3.36it/s]
 99%|█████████▉| 368914/371472 [7:11:30<12:09,  3.51it/s]
 99%|█████████▉| 368915/371472 [7:11:30<11:49,  3.60it/s]
 99%|█████████▉| 368916/371472 [7:11:31<11:49,  3.60it/s]
 99%|█████████▉| 368917/371472 [7:11:31<11:46,  3.62it/s]
 99%|█████████▉| 368918/371472 [7:11:31<11:32,  3.69it/s]
 99%|█████████▉| 368919/371472 [7:11:31<11:26,  3.72it/s]
 99%|█████████▉| 368920/371472 [7:11:32<11:46,  3.61it/s]
                                                         
{'loss': 2.5136, 'learning_rate': 1.0618630007110692e-07, 'epoch': 15.89}

 99%|█████████▉| 368920/371472 [7:11:32<11:46,  3.61it/s]
 99%|█████████▉| 368921/371472 [7:11:32<12:36,  3.37it/s]
 99%|█████████▉| 368922/371472 [7:11:32<12:00,  3.54it/s]
 99%|█████████▉| 368923/371472 [7:11:33<12:17,  3.45it/s]
 99%|█████████▉| 368924/371472 [7:11:33<12:45,  3.33it/s]
 99%|█████████▉| 368925/371472 [7:11:33<13:10,  3.22it/s]
 99%|█████████▉| 368926/371472 [7:11:34<12:23,  3.42it/s]
 99%|█████████▉| 368927/371472 [7:11:34<12:04,  3.51it/s]
 99%|█████████▉| 368928/371472 [7:11:34<11:49,  3.58it/s]
 99%|█████████▉| 368929/371472 [7:11:34<11:20,  3.74it/s]
 99%|█████████▉| 368930/371472 [7:11:35<11:49,  3.59it/s]
 99%|█████████▉| 368931/371472 [7:11:35<11:34,  3.66it/s]
 99%|█████████▉| 368932/371472 [7:11:35<11:52,  3.57it/s]
 99%|█████████▉| 368933/371472 [7:11:35<11:47,  3.59it/s]
 99%|█████████▉| 368934/371472 [7:11:36<11:58,  3.53it/s]
 99%|█████████▉| 368935/371472 [7:11:36<11:38,  3.63it/s]
 99%|█████████▉| 368936/371472 [7:11:36<11:29,  3.68it/s]
 99%|█████████▉| 368937/371472 [7:11:37<12:04,  3.50it/s]
 99%|█████████▉| 368938/371472 [7:11:37<11:39,  3.62it/s]
 99%|█████████▉| 368939/371472 [7:11:37<11:19,  3.73it/s]
 99%|█████████▉| 368940/371472 [7:11:37<11:09,  3.78it/s]
                                                         
{'loss': 2.4577, 'learning_rate': 1.0613781809562798e-07, 'epoch': 15.89}

 99%|█████████▉| 368940/371472 [7:11:37<11:09,  3.78it/s]
 99%|█████████▉| 368941/371472 [7:11:38<10:58,  3.84it/s]
 99%|█████████▉| 368942/371472 [7:11:38<11:08,  3.79it/s]
 99%|█████████▉| 368943/371472 [7:11:38<11:05,  3.80it/s]
 99%|█████████▉| 368944/371472 [7:11:38<10:50,  3.89it/s]
 99%|█████████▉| 368945/371472 [7:11:39<11:40,  3.60it/s]
 99%|█████████▉| 368946/371472 [7:11:39<12:06,  3.48it/s]
 99%|█████████▉| 368947/371472 [7:11:39<12:04,  3.49it/s]
 99%|█████████▉| 368948/371472 [7:11:40<12:14,  3.44it/s]
 99%|█████████▉| 368949/371472 [7:11:40<11:53,  3.53it/s]
 99%|█████████▉| 368950/371472 [7:11:40<11:21,  3.70it/s]
 99%|█████████▉| 368951/371472 [7:11:40<11:31,  3.65it/s]
 99%|█████████▉| 368952/371472 [7:11:41<12:59,  3.23it/s]
 99%|█████████▉| 368953/371472 [7:11:41<12:44,  3.29it/s]
 99%|█████████▉| 368954/371472 [7:11:41<12:14,  3.43it/s]
 99%|█████████▉| 368955/371472 [7:11:42<12:10,  3.45it/s]
 99%|█████████▉| 368956/371472 [7:11:42<11:53,  3.53it/s]
 99%|█████████▉| 368957/371472 [7:11:42<12:08,  3.45it/s]
 99%|█████████▉| 368958/371472 [7:11:43<11:55,  3.51it/s]
 99%|█████████▉| 368959/371472 [7:11:43<12:27,  3.36it/s]
 99%|█████████▉| 368960/371472 [7:11:43<12:11,  3.43it/s]
                                                         
{'loss': 2.3523, 'learning_rate': 1.0608933612014913e-07, 'epoch': 15.89}

 99%|█████████▉| 368960/371472 [7:11:43<12:11,  3.43it/s]
 99%|█████████▉| 368961/371472 [7:11:43<12:47,  3.27it/s]
 99%|█████████▉| 368962/371472 [7:11:44<12:31,  3.34it/s]
 99%|█████████▉| 368963/371472 [7:11:44<12:32,  3.33it/s]
 99%|█████████▉| 368964/371472 [7:11:44<12:21,  3.38it/s]
 99%|█████████▉| 368965/371472 [7:11:45<11:56,  3.50it/s]
 99%|█████████▉| 368966/371472 [7:11:45<12:35,  3.32it/s]
 99%|█████████▉| 368967/371472 [7:11:45<12:05,  3.45it/s]
 99%|█████████▉| 368968/371472 [7:11:45<11:35,  3.60it/s]
 99%|█████████▉| 368969/371472 [7:11:46<11:16,  3.70it/s]
 99%|█████████▉| 368970/371472 [7:11:46<11:14,  3.71it/s]
 99%|█████████▉| 368971/371472 [7:11:46<12:02,  3.46it/s]
 99%|█████████▉| 368972/371472 [7:11:47<12:02,  3.46it/s]
 99%|█████████▉| 368973/371472 [7:11:47<12:26,  3.35it/s]
 99%|█████████▉| 368974/371472 [7:11:47<11:58,  3.48it/s]
 99%|█████████▉| 368975/371472 [7:11:47<11:26,  3.64it/s]
 99%|█████████▉| 368976/371472 [7:11:48<11:34,  3.59it/s]
 99%|█████████▉| 368977/371472 [7:11:48<11:35,  3.59it/s]
 99%|█████████▉| 368978/371472 [7:11:48<11:28,  3.62it/s]
 99%|█████████▉| 368979/371472 [7:11:49<11:16,  3.69it/s]
 99%|█████████▉| 368980/371472 [7:11:49<11:11,  3.71it/s]
                                                         
{'loss': 2.7452, 'learning_rate': 1.0604085414467019e-07, 'epoch': 15.89}

 99%|█████████▉| 368980/371472 [7:11:49<11:11,  3.71it/s]
 99%|█████████▉| 368981/371472 [7:11:49<12:17,  3.38it/s]
 99%|█████████▉| 368982/371472 [7:11:49<12:05,  3.43it/s]
 99%|█████████▉| 368983/371472 [7:11:50<12:03,  3.44it/s]
 99%|█████████▉| 368984/371472 [7:11:50<12:53,  3.22it/s]
 99%|█████████▉| 368985/371472 [7:11:50<12:04,  3.43it/s]
 99%|█████████▉| 368986/371472 [7:11:51<11:41,  3.55it/s]
 99%|█████████▉| 368987/371472 [7:11:51<11:45,  3.52it/s]
 99%|█████████▉| 368988/371472 [7:11:51<12:04,  3.43it/s]
 99%|█████████▉| 368989/371472 [7:11:51<11:40,  3.55it/s]
 99%|█████████▉| 368990/371472 [7:11:52<11:15,  3.67it/s]
 99%|█████████▉| 368991/371472 [7:11:52<12:40,  3.26it/s]
 99%|█████████▉| 368992/371472 [7:11:52<12:32,  3.29it/s]
 99%|█████████▉| 368993/371472 [7:11:53<12:32,  3.30it/s]
 99%|█████████▉| 368994/371472 [7:11:53<12:22,  3.34it/s]
 99%|█████████▉| 368995/371472 [7:11:53<12:12,  3.38it/s]
 99%|█████████▉| 368996/371472 [7:11:54<12:39,  3.26it/s]
 99%|█████████▉| 368997/371472 [7:11:54<12:24,  3.32it/s]
 99%|█████████▉| 368998/371472 [7:11:54<12:04,  3.42it/s]
 99%|█████████▉| 368999/371472 [7:11:54<11:41,  3.53it/s]
 99%|█████████▉| 369000/371472 [7:11:55<11:47,  3.49it/s]
                                                         
{'loss': 2.559, 'learning_rate': 1.0599237216919135e-07, 'epoch': 15.89}

 99%|█████████▉| 369000/371472 [7:11:55<11:47,  3.49it/s]
 99%|█████████▉| 369001/371472 [7:11:55<11:48,  3.49it/s]
 99%|█████████▉| 369002/371472 [7:11:55<11:28,  3.59it/s]
 99%|█████████▉| 369003/371472 [7:11:55<11:13,  3.67it/s]
 99%|█████████▉| 369004/371472 [7:11:56<12:37,  3.26it/s]
 99%|█████████▉| 369005/371472 [7:11:56<12:30,  3.29it/s]
 99%|█████████▉| 369006/371472 [7:11:56<11:53,  3.46it/s]
 99%|█████████▉| 369007/371472 [7:11:57<12:08,  3.38it/s]
 99%|█████████▉| 369008/371472 [7:11:57<12:18,  3.34it/s]
 99%|█████████▉| 369009/371472 [7:11:57<11:44,  3.50it/s]
 99%|█████████▉| 369010/371472 [7:11:58<12:30,  3.28it/s]
 99%|█████████▉| 369011/371472 [7:11:58<12:27,  3.29it/s]
 99%|█████████▉| 369012/371472 [7:11:58<12:32,  3.27it/s]
 99%|█████████▉| 369013/371472 [7:11:59<12:01,  3.41it/s]
 99%|█████████▉| 369014/371472 [7:11:59<11:52,  3.45it/s]
 99%|█████████▉| 369015/371472 [7:11:59<11:27,  3.57it/s]
 99%|█████████▉| 369016/371472 [7:11:59<11:20,  3.61it/s]
 99%|█████████▉| 369017/371472 [7:12:00<11:09,  3.67it/s]
 99%|█████████▉| 369018/371472 [7:12:00<11:04,  3.70it/s]
 99%|█████████▉| 369019/371472 [7:12:00<11:16,  3.62it/s]
 99%|█████████▉| 369020/371472 [7:12:00<11:15,  3.63it/s]
                                                         
{'loss': 2.497, 'learning_rate': 1.0594389019371241e-07, 'epoch': 15.89}

 99%|█████████▉| 369020/371472 [7:12:00<11:15,  3.63it/s]
 99%|█████████▉| 369021/371472 [7:12:01<11:24,  3.58it/s]
 99%|█████████▉| 369022/371472 [7:12:01<11:10,  3.66it/s]
 99%|█████████▉| 369023/371472 [7:12:01<12:01,  3.39it/s]
 99%|█████████▉| 369024/371472 [7:12:02<12:20,  3.31it/s]
 99%|█████████▉| 369025/371472 [7:12:02<12:27,  3.28it/s]
 99%|█████████▉| 369026/371472 [7:12:02<13:04,  3.12it/s]
 99%|█████████▉| 369027/371472 [7:12:03<12:47,  3.19it/s]
 99%|█████████▉| 369028/371472 [7:12:03<12:13,  3.33it/s]
 99%|█████████▉| 369029/371472 [7:12:03<12:10,  3.34it/s]
 99%|█████████▉| 369030/371472 [7:12:03<11:47,  3.45it/s]
 99%|█████████▉| 369031/371472 [7:12:04<11:21,  3.58it/s]
 99%|█████████▉| 369032/371472 [7:12:04<10:56,  3.72it/s]
 99%|█████████▉| 369033/371472 [7:12:04<10:46,  3.77it/s]
 99%|█████████▉| 369034/371472 [7:12:04<11:18,  3.59it/s]
 99%|█████████▉| 369035/371472 [7:12:05<10:57,  3.71it/s]
 99%|█████████▉| 369036/371472 [7:12:05<10:55,  3.72it/s]
 99%|█████████▉| 369037/371472 [7:12:05<10:45,  3.77it/s]
 99%|█████████▉| 369038/371472 [7:12:06<11:16,  3.60it/s]
 99%|█████████▉| 369039/371472 [7:12:06<11:06,  3.65it/s]
 99%|█████████▉| 369040/371472 [7:12:06<11:04,  3.66it/s]
                                                         
{'loss': 2.5806, 'learning_rate': 1.0589540821823356e-07, 'epoch': 15.9}

 99%|█████████▉| 369040/371472 [7:12:06<11:04,  3.66it/s]
 99%|█████████▉| 369041/371472 [7:12:06<11:20,  3.57it/s]
 99%|█████████▉| 369042/371472 [7:12:07<10:57,  3.70it/s]
 99%|█████████▉| 369043/371472 [7:12:07<10:53,  3.72it/s]
 99%|█████████▉| 369044/371472 [7:12:07<11:18,  3.58it/s]
 99%|█████████▉| 369045/371472 [7:12:08<11:48,  3.43it/s]
 99%|█████████▉| 369046/371472 [7:12:08<11:32,  3.51it/s]
 99%|█████████▉| 369047/371472 [7:12:08<11:00,  3.67it/s]
 99%|█████████▉| 369048/371472 [7:12:08<10:40,  3.79it/s]
 99%|█████████▉| 369049/371472 [7:12:09<12:05,  3.34it/s]
 99%|█████████▉| 369050/371472 [7:12:09<11:51,  3.41it/s]
 99%|█████████▉| 369051/371472 [7:12:09<11:13,  3.60it/s]
 99%|█████████▉| 369052/371472 [7:12:09<11:09,  3.62it/s]
 99%|█████████▉| 369053/371472 [7:12:10<11:03,  3.65it/s]
 99%|█████████▉| 369054/371472 [7:12:10<10:53,  3.70it/s]
 99%|█████████▉| 369055/371472 [7:12:10<10:55,  3.69it/s]
 99%|█████████▉| 369056/371472 [7:12:11<11:06,  3.62it/s]
 99%|█████████▉| 369057/371472 [7:12:11<11:37,  3.46it/s]
 99%|█████████▉| 369058/371472 [7:12:11<11:07,  3.62it/s]
 99%|█████████▉| 369059/371472 [7:12:11<11:36,  3.47it/s]
 99%|█████████▉| 369060/371472 [7:12:12<12:03,  3.33it/s]
                                                         
{'loss': 2.5489, 'learning_rate': 1.058469262427546e-07, 'epoch': 15.9}

 99%|█████████▉| 369060/371472 [7:12:12<12:03,  3.33it/s]
 99%|█████████▉| 369061/371472 [7:12:12<11:58,  3.36it/s]
 99%|█████████▉| 369062/371472 [7:12:12<11:43,  3.42it/s]
 99%|█████████▉| 369063/371472 [7:12:13<11:57,  3.36it/s]
 99%|█████████▉| 369064/371472 [7:12:13<11:53,  3.38it/s]
 99%|█████████▉| 369065/371472 [7:12:13<11:54,  3.37it/s]
 99%|█████████▉| 369066/371472 [7:12:14<11:16,  3.56it/s]
 99%|█████████▉| 369067/371472 [7:12:14<10:42,  3.74it/s]
 99%|█████████▉| 369068/371472 [7:12:14<11:43,  3.42it/s]
 99%|█████████▉| 369069/371472 [7:12:14<11:28,  3.49it/s]
 99%|█████████▉| 369070/371472 [7:12:15<12:41,  3.15it/s]
 99%|█████████▉| 369071/371472 [7:12:15<12:06,  3.31it/s]
 99%|█████████▉| 369072/371472 [7:12:15<12:10,  3.28it/s]
 99%|█████████▉| 369073/371472 [7:12:16<11:35,  3.45it/s]
 99%|█████████▉| 369074/371472 [7:12:16<12:10,  3.28it/s]
 99%|█████████▉| 369075/371472 [7:12:16<12:10,  3.28it/s]
 99%|█████████▉| 369076/371472 [7:12:17<11:50,  3.37it/s]
 99%|█████████▉| 369077/371472 [7:12:17<11:39,  3.42it/s]
 99%|█████████▉| 369078/371472 [7:12:17<11:53,  3.36it/s]
 99%|█████████▉| 369079/371472 [7:12:17<11:58,  3.33it/s]
 99%|█████████▉| 369080/371472 [7:12:18<11:56,  3.34it/s]
                                                         
{'loss': 2.6366, 'learning_rate': 1.0579844426727578e-07, 'epoch': 15.9}

 99%|█████████▉| 369080/371472 [7:12:18<11:56,  3.34it/s]
 99%|█████████▉| 369081/371472 [7:12:18<12:55,  3.08it/s]
 99%|█████████▉| 369082/371472 [7:12:18<12:34,  3.17it/s]
 99%|█████████▉| 369083/371472 [7:12:19<11:50,  3.36it/s]
 99%|█████████▉| 369084/371472 [7:12:19<11:32,  3.45it/s]
 99%|█████████▉| 369085/371472 [7:12:19<11:14,  3.54it/s]
 99%|█████████▉| 369086/371472 [7:12:19<10:54,  3.65it/s]
 99%|█████████▉| 369087/371472 [7:12:20<11:26,  3.47it/s]
 99%|█████████▉| 369088/371472 [7:12:20<11:03,  3.59it/s]
 99%|█████████▉| 369089/371472 [7:12:20<10:50,  3.66it/s]
 99%|█████████▉| 369090/371472 [7:12:21<10:32,  3.77it/s]
 99%|█████████▉| 369091/371472 [7:12:21<10:51,  3.66it/s]
 99%|█████████▉| 369092/371472 [7:12:21<11:01,  3.60it/s]
 99%|█████████▉| 369093/371472 [7:12:21<10:56,  3.62it/s]
 99%|█████████▉| 369094/371472 [7:12:22<11:18,  3.50it/s]
 99%|█████████▉| 369095/371472 [7:12:22<11:06,  3.56it/s]
 99%|█████████▉| 369096/371472 [7:12:22<11:15,  3.52it/s]
 99%|█████████▉| 369097/371472 [7:12:22<10:42,  3.70it/s]
 99%|█████████▉| 369098/371472 [7:12:23<11:01,  3.59it/s]
 99%|█████████▉| 369099/371472 [7:12:23<10:35,  3.74it/s]
 99%|█████████▉| 369100/371472 [7:12:23<10:57,  3.61it/s]
                                                         
{'loss': 2.6813, 'learning_rate': 1.0574996229179684e-07, 'epoch': 15.9}

 99%|█████████▉| 369100/371472 [7:12:23<10:57,  3.61it/s]
 99%|█████████▉| 369101/371472 [7:12:24<11:25,  3.46it/s]
 99%|█████████▉| 369102/371472 [7:12:24<11:27,  3.45it/s]
 99%|█████████▉| 369103/371472 [7:12:24<11:13,  3.52it/s]
 99%|█████████▉| 369104/371472 [7:12:24<10:51,  3.64it/s]
 99%|█████████▉| 369105/371472 [7:12:25<11:00,  3.59it/s]
 99%|█████████▉| 369106/371472 [7:12:25<11:37,  3.39it/s]
 99%|█████████▉| 369107/371472 [7:12:25<11:44,  3.36it/s]
 99%|█████████▉| 369108/371472 [7:12:26<11:01,  3.58it/s]
 99%|█████████▉| 369109/371472 [7:12:26<10:58,  3.59it/s]
 99%|█████████▉| 369110/371472 [7:12:26<11:14,  3.50it/s]
 99%|█████████▉| 369111/371472 [7:12:26<11:25,  3.44it/s]
 99%|█████████▉| 369112/371472 [7:12:27<11:33,  3.40it/s]
 99%|█████████▉| 369113/371472 [7:12:27<11:23,  3.45it/s]
 99%|█████████▉| 369114/371472 [7:12:27<11:21,  3.46it/s]
 99%|█████████▉| 369115/371472 [7:12:28<12:32,  3.13it/s]
 99%|█████████▉| 369116/371472 [7:12:28<11:44,  3.35it/s]
 99%|█████████▉| 369117/371472 [7:12:28<11:00,  3.57it/s]
 99%|█████████▉| 369118/371472 [7:12:28<10:38,  3.69it/s]
 99%|█████████▉| 369119/371472 [7:12:29<10:51,  3.61it/s]
 99%|█████████▉| 369120/371472 [7:12:29<11:13,  3.49it/s]
                                                         
{'loss': 2.533, 'learning_rate': 1.0570148031631799e-07, 'epoch': 15.9}

 99%|█████████▉| 369120/371472 [7:12:29<11:13,  3.49it/s]
 99%|█████████▉| 369121/371472 [7:12:29<11:02,  3.55it/s]
 99%|█████████▉| 369122/371472 [7:12:30<10:52,  3.60it/s]
 99%|█████████▉| 369123/371472 [7:12:30<10:42,  3.66it/s]
 99%|█████████▉| 369124/371472 [7:12:30<10:59,  3.56it/s]
 99%|█████████▉| 369125/371472 [7:12:30<10:38,  3.68it/s]
 99%|█████████▉| 369126/371472 [7:12:31<10:20,  3.78it/s]
 99%|█████████▉| 369127/371472 [7:12:31<10:51,  3.60it/s]
 99%|█████████▉| 369128/371472 [7:12:31<10:46,  3.63it/s]
 99%|█████████▉| 369129/371472 [7:12:32<11:03,  3.53it/s]
 99%|█████████▉| 369130/371472 [7:12:32<10:38,  3.67it/s]
 99%|█████████▉| 369131/371472 [7:12:32<10:32,  3.70it/s]
 99%|█████████▉| 369132/371472 [7:12:32<11:21,  3.44it/s]
 99%|█████████▉| 369133/371472 [7:12:33<10:52,  3.58it/s]
 99%|█████████▉| 369134/371472 [7:12:33<10:18,  3.78it/s]
 99%|█████████▉| 369135/371472 [7:12:33<11:20,  3.43it/s]
 99%|█████████▉| 369136/371472 [7:12:34<11:30,  3.38it/s]
 99%|█████████▉| 369137/371472 [7:12:34<10:58,  3.54it/s]
 99%|█████████▉| 369138/371472 [7:12:34<11:27,  3.40it/s]
 99%|█████████▉| 369139/371472 [7:12:34<11:29,  3.38it/s]
 99%|█████████▉| 369140/371472 [7:12:35<11:03,  3.51it/s]
                                                         
{'loss': 2.5997, 'learning_rate': 1.0565299834083905e-07, 'epoch': 15.9}

 99%|█████████▉| 369140/371472 [7:12:35<11:03,  3.51it/s]
 99%|█████████▉| 369141/371472 [7:12:35<11:09,  3.48it/s]
 99%|█████████▉| 369142/371472 [7:12:35<11:17,  3.44it/s]
 99%|█████████▉| 369143/371472 [7:12:36<10:36,  3.66it/s]
 99%|█████████▉| 369144/371472 [7:12:36<10:43,  3.62it/s]
 99%|█████████▉| 369145/371472 [7:12:36<10:31,  3.69it/s]
 99%|█████████▉| 369146/371472 [7:12:36<10:28,  3.70it/s]
 99%|█████████▉| 369147/371472 [7:12:37<10:57,  3.54it/s]
 99%|█████████▉| 369148/371472 [7:12:37<10:34,  3.66it/s]
 99%|█████████▉| 369149/371472 [7:12:37<11:31,  3.36it/s]
 99%|█████████▉| 369150/371472 [7:12:38<11:58,  3.23it/s]
 99%|█████████▉| 369151/371472 [7:12:38<11:14,  3.44it/s]
 99%|█████████▉| 369152/371472 [7:12:38<11:05,  3.49it/s]
 99%|█████████▉| 369153/371472 [7:12:38<11:02,  3.50it/s]
 99%|█████████▉| 369154/371472 [7:12:39<12:44,  3.03it/s]
 99%|█████████▉| 369155/371472 [7:12:39<12:42,  3.04it/s]
 99%|█████████▉| 369156/371472 [7:12:39<11:56,  3.23it/s]
 99%|█████████▉| 369157/371472 [7:12:40<11:43,  3.29it/s]
 99%|█████████▉| 369158/371472 [7:12:40<11:50,  3.26it/s]
 99%|█████████▉| 369159/371472 [7:12:40<11:42,  3.29it/s]
 99%|█████████▉| 369160/371472 [7:12:41<11:00,  3.50it/s]
                                                         
{'loss': 2.4482, 'learning_rate': 1.0560451636536021e-07, 'epoch': 15.9}

 99%|█████████▉| 369160/371472 [7:12:41<11:00,  3.50it/s]
 99%|█████████▉| 369161/371472 [7:12:41<10:32,  3.65it/s]
 99%|█████████▉| 369162/371472 [7:12:41<10:37,  3.62it/s]
 99%|█████████▉| 369163/371472 [7:12:41<10:44,  3.58it/s]
 99%|█████████▉| 369164/371472 [7:12:42<10:39,  3.61it/s]
 99%|█████████▉| 369165/371472 [7:12:42<10:52,  3.53it/s]
 99%|█████████▉| 369166/371472 [7:12:42<10:55,  3.52it/s]
 99%|█████████▉| 369167/371472 [7:12:43<11:22,  3.38it/s]
 99%|█████████▉| 369168/371472 [7:12:43<10:39,  3.60it/s]
 99%|█████████▉| 369169/371472 [7:12:43<10:37,  3.61it/s]
 99%|█████████▉| 369170/371472 [7:12:43<10:40,  3.60it/s]
 99%|█████████▉| 369171/371472 [7:12:44<10:48,  3.55it/s]
 99%|█████████▉| 369172/371472 [7:12:44<10:30,  3.65it/s]
 99%|█████████▉| 369173/371472 [7:12:44<10:54,  3.51it/s]
 99%|█████████▉| 369174/371472 [7:12:44<10:33,  3.63it/s]
 99%|█████████▉| 369175/371472 [7:12:45<10:21,  3.70it/s]
 99%|█████████▉| 369176/371472 [7:12:45<10:12,  3.75it/s]
 99%|█████████▉| 369177/371472 [7:12:45<09:59,  3.83it/s]
 99%|█████████▉| 369178/371472 [7:12:46<10:43,  3.56it/s]
 99%|█████████▉| 369179/371472 [7:12:46<10:35,  3.61it/s]
 99%|█████████▉| 369180/371472 [7:12:46<10:51,  3.52it/s]
                                                         
{'loss': 2.5604, 'learning_rate': 1.0555603438988127e-07, 'epoch': 15.9}

 99%|█████████▉| 369180/371472 [7:12:46<10:51,  3.52it/s]
 99%|█████████▉| 369181/371472 [7:12:47<12:06,  3.16it/s]
 99%|█████████▉| 369182/371472 [7:12:47<12:19,  3.10it/s]
 99%|█████████▉| 369183/371472 [7:12:47<11:26,  3.33it/s]
 99%|█████████▉| 369184/371472 [7:12:47<11:04,  3.44it/s]
 99%|█████████▉| 369185/371472 [7:12:48<11:11,  3.41it/s]
 99%|█████████▉| 369186/371472 [7:12:48<11:25,  3.34it/s]
 99%|█████████▉| 369187/371472 [7:12:48<10:53,  3.50it/s]
 99%|█████████▉| 369188/371472 [7:12:49<11:13,  3.39it/s]
 99%|█████████▉| 369189/371472 [7:12:49<12:06,  3.14it/s]
 99%|█████████▉| 369190/371472 [7:12:49<11:24,  3.33it/s]
 99%|█████████▉| 369191/371472 [7:12:49<11:15,  3.38it/s]
 99%|█████████▉| 369192/371472 [7:12:50<11:03,  3.44it/s]
 99%|█████████▉| 369193/371472 [7:12:50<10:56,  3.47it/s]
 99%|█████████▉| 369194/371472 [7:12:50<10:38,  3.57it/s]
 99%|█████████▉| 369195/371472 [7:12:51<10:35,  3.59it/s]
 99%|█████████▉| 369196/371472 [7:12:51<10:21,  3.66it/s]
 99%|█████████▉| 369197/371472 [7:12:51<10:08,  3.74it/s]
 99%|█████████▉| 369198/371472 [7:12:51<10:38,  3.56it/s]
 99%|█████████▉| 369199/371472 [7:12:52<10:25,  3.63it/s]
 99%|█████████▉| 369200/371472 [7:12:52<10:46,  3.51it/s]
                                                         
{'loss': 2.5789, 'learning_rate': 1.0550755241440242e-07, 'epoch': 15.9}

 99%|█████████▉| 369200/371472 [7:12:52<10:46,  3.51it/s]
 99%|█████████▉| 369201/371472 [7:12:52<11:03,  3.42it/s]
 99%|█████████▉| 369202/371472 [7:12:53<10:53,  3.48it/s]
 99%|█████████▉| 369203/371472 [7:12:53<10:26,  3.62it/s]
 99%|█████████▉| 369204/371472 [7:12:53<10:25,  3.62it/s]
 99%|█████████▉| 369205/371472 [7:12:53<10:20,  3.65it/s]
 99%|█████████▉| 369206/371472 [7:12:54<10:39,  3.55it/s]
 99%|█████████▉| 369207/371472 [7:12:54<10:26,  3.61it/s]
 99%|█████████▉| 369208/371472 [7:12:54<10:14,  3.68it/s]
 99%|█████████▉| 369209/371472 [7:12:54<10:27,  3.61it/s]
 99%|█████████▉| 369210/371472 [7:12:55<10:48,  3.49it/s]
 99%|█████████▉| 369211/371472 [7:12:55<11:35,  3.25it/s]
 99%|█████████▉| 369212/371472 [7:12:55<12:05,  3.11it/s]
 99%|█████████▉| 369213/371472 [7:12:56<11:20,  3.32it/s]
 99%|█████████▉| 369214/371472 [7:12:56<11:30,  3.27it/s]
 99%|█████████▉| 369215/371472 [7:12:56<11:18,  3.33it/s]
 99%|█████████▉| 369216/371472 [7:12:57<11:22,  3.30it/s]
 99%|█████████▉| 369217/371472 [7:12:57<12:32,  3.00it/s]
 99%|█████████▉| 369218/371472 [7:12:57<11:59,  3.13it/s]
 99%|█████████▉| 369219/371472 [7:12:58<11:45,  3.19it/s]
 99%|█████████▉| 369220/371472 [7:12:58<11:08,  3.37it/s]
                                                         
{'loss': 2.6682, 'learning_rate': 1.0545907043892348e-07, 'epoch': 15.9}

 99%|█████████▉| 369220/371472 [7:12:58<11:08,  3.37it/s]
 99%|█████████▉| 369221/371472 [7:12:58<14:20,  2.62it/s]
 99%|█████████▉| 369222/371472 [7:12:59<12:53,  2.91it/s]
 99%|█████████▉| 369223/371472 [7:12:59<12:38,  2.96it/s]
 99%|█████████▉| 369224/371472 [7:12:59<11:38,  3.22it/s]
 99%|█████████▉| 369225/371472 [7:13:00<11:42,  3.20it/s]
 99%|█████████▉| 369226/371472 [7:13:00<11:01,  3.40it/s]
 99%|█████████▉| 369227/371472 [7:13:00<10:46,  3.47it/s]
 99%|█████████▉| 369228/371472 [7:13:00<10:26,  3.58it/s]
 99%|█████████▉| 369229/371472 [7:13:01<10:22,  3.60it/s]
 99%|█████████▉| 369230/371472 [7:13:01<10:15,  3.64it/s]
 99%|█████████▉| 369231/371472 [7:13:01<10:38,  3.51it/s]
 99%|█████████▉| 369232/371472 [7:13:02<10:33,  3.54it/s]
 99%|█████████▉| 369233/371472 [7:13:02<10:36,  3.52it/s]
 99%|█████████▉| 369234/371472 [7:13:02<10:31,  3.54it/s]
 99%|█████████▉| 369235/371472 [7:13:02<11:08,  3.35it/s]
 99%|█████████▉| 369236/371472 [7:13:03<10:55,  3.41it/s]
 99%|█████████▉| 369237/371472 [7:13:03<10:24,  3.58it/s]
 99%|█████████▉| 369238/371472 [7:13:03<10:12,  3.65it/s]
 99%|█████████▉| 369239/371472 [7:13:03<10:12,  3.65it/s]
 99%|█████████▉| 369240/371472 [7:13:04<10:41,  3.48it/s]
                                                         
{'loss': 2.453, 'learning_rate': 1.0541058846344454e-07, 'epoch': 15.9}

 99%|█████████▉| 369240/371472 [7:13:04<10:41,  3.48it/s]
 99%|█████████▉| 369241/371472 [7:13:04<11:31,  3.22it/s]
 99%|█████████▉| 369242/371472 [7:13:04<11:04,  3.36it/s]
 99%|█████████▉| 369243/371472 [7:13:05<11:09,  3.33it/s]
 99%|█████████▉| 369244/371472 [7:13:05<11:14,  3.30it/s]
 99%|█████████▉| 369245/371472 [7:13:05<10:31,  3.52it/s]
 99%|█████████▉| 369246/371472 [7:13:06<10:27,  3.55it/s]
 99%|█████████▉| 369247/371472 [7:13:06<10:18,  3.60it/s]
 99%|█████████▉| 369248/371472 [7:13:06<10:32,  3.52it/s]
 99%|█████████▉| 369249/371472 [7:13:06<11:01,  3.36it/s]
 99%|█████████▉| 369250/371472 [7:13:07<10:44,  3.45it/s]
 99%|█████████▉| 369251/371472 [7:13:07<10:20,  3.58it/s]
 99%|█████████▉| 369252/371472 [7:13:07<10:04,  3.67it/s]
 99%|█████████▉| 369253/371472 [7:13:07<09:41,  3.81it/s]
 99%|█████████▉| 369254/371472 [7:13:08<10:17,  3.59it/s]
 99%|█████████▉| 369255/371472 [7:13:08<10:25,  3.54it/s]
 99%|█████████▉| 369256/371472 [7:13:08<10:19,  3.58it/s]
 99%|█████████▉| 369257/371472 [7:13:09<10:09,  3.64it/s]
 99%|█████████▉| 369258/371472 [7:13:09<10:54,  3.38it/s]
 99%|█████████▉| 369259/371472 [7:13:09<10:49,  3.41it/s]
 99%|█████████▉| 369260/371472 [7:13:10<10:21,  3.56it/s]
                                                         
{'loss': 2.4837, 'learning_rate': 1.053621064879657e-07, 'epoch': 15.9}

 99%|█████████▉| 369260/371472 [7:13:10<10:21,  3.56it/s]
 99%|█████████▉| 369261/371472 [7:13:10<10:56,  3.37it/s]
 99%|█████████▉| 369262/371472 [7:13:10<10:57,  3.36it/s]
 99%|█████████▉| 369263/371472 [7:13:10<11:10,  3.30it/s]
 99%|█████████▉| 369264/371472 [7:13:11<10:38,  3.46it/s]
 99%|█████████▉| 369265/371472 [7:13:11<10:21,  3.55it/s]
 99%|█████████▉| 369266/371472 [7:13:11<10:47,  3.41it/s]
 99%|█████████▉| 369267/371472 [7:13:12<10:15,  3.58it/s]
 99%|█████████▉| 369268/371472 [7:13:12<10:52,  3.38it/s]
 99%|█████████▉| 369269/371472 [7:13:12<10:22,  3.54it/s]
 99%|█████████▉| 369270/371472 [7:13:12<09:56,  3.69it/s]
 99%|█████████▉| 369271/371472 [7:13:13<10:05,  3.63it/s]
 99%|█████████▉| 369272/371472 [7:13:13<10:42,  3.43it/s]
 99%|█████████▉| 369273/371472 [7:13:13<10:55,  3.36it/s]
 99%|█████████▉| 369274/371472 [7:13:14<10:33,  3.47it/s]
 99%|█████████▉| 369275/371472 [7:13:14<10:55,  3.35it/s]
 99%|█████████▉| 369276/371472 [7:13:14<10:28,  3.50it/s]
 99%|█████████▉| 369277/371472 [7:13:14<10:15,  3.56it/s]
 99%|█████████▉| 369278/371472 [7:13:15<11:23,  3.21it/s]
 99%|█████████▉| 369279/371472 [7:13:15<11:23,  3.21it/s]
 99%|█████████▉| 369280/371472 [7:13:15<10:48,  3.38it/s]
                                                         
{'loss': 2.5853, 'learning_rate': 1.0531362451248675e-07, 'epoch': 15.91}

 99%|█████████▉| 369280/371472 [7:13:15<10:48,  3.38it/s]
 99%|█████████▉| 369281/371472 [7:13:16<11:06,  3.29it/s]
 99%|█████████▉| 369282/371472 [7:13:16<10:32,  3.46it/s]
 99%|█████████▉| 369283/371472 [7:13:16<10:28,  3.48it/s]
 99%|█████████▉| 369284/371472 [7:13:17<10:29,  3.48it/s]
 99%|█████████▉| 369285/371472 [7:13:17<10:28,  3.48it/s]
 99%|█████████▉| 369286/371472 [7:13:17<10:14,  3.55it/s]
 99%|█████████▉| 369287/371472 [7:13:17<09:52,  3.69it/s]
 99%|█████████▉| 369288/371472 [7:13:18<11:07,  3.27it/s]
 99%|█████████▉| 369289/371472 [7:13:18<10:45,  3.38it/s]
 99%|█████████▉| 369290/371472 [7:13:18<10:11,  3.57it/s]
 99%|█████████▉| 369291/371472 [7:13:19<11:08,  3.26it/s]
 99%|█████████▉| 369292/371472 [7:13:19<10:55,  3.33it/s]
 99%|█████████▉| 369293/371472 [7:13:19<10:28,  3.47it/s]
 99%|█████████▉| 369294/371472 [7:13:19<10:43,  3.38it/s]
 99%|█████████▉| 369295/371472 [7:13:20<10:28,  3.47it/s]
 99%|█████████▉| 369296/371472 [7:13:20<10:26,  3.47it/s]
 99%|█████████▉| 369297/371472 [7:13:20<10:19,  3.51it/s]
 99%|█████████▉| 369298/371472 [7:13:21<10:21,  3.50it/s]
 99%|█████████▉| 369299/371472 [7:13:21<10:02,  3.61it/s]
 99%|█████████▉| 369300/371472 [7:13:21<09:51,  3.67it/s]
                                                         
{'loss': 2.6337, 'learning_rate': 1.0526514253700791e-07, 'epoch': 15.91}

 99%|█████████▉| 369300/371472 [7:13:21<09:51,  3.67it/s]
 99%|█████████▉| 369301/371472 [7:13:21<09:40,  3.74it/s]
 99%|█████████▉| 369302/371472 [7:13:22<09:35,  3.77it/s]
 99%|█████████▉| 369303/371472 [7:13:22<09:45,  3.70it/s]
 99%|█████████▉| 369304/371472 [7:13:22<09:31,  3.79it/s]
 99%|█████████▉| 369305/371472 [7:13:22<09:43,  3.71it/s]
 99%|█████████▉| 369306/371472 [7:13:23<09:43,  3.71it/s]
 99%|█████████▉| 369307/371472 [7:13:23<09:42,  3.72it/s]
 99%|█████████▉| 369308/371472 [7:13:23<10:53,  3.31it/s]
 99%|█████████▉| 369309/371472 [7:13:24<11:14,  3.21it/s]
 99%|█████████▉| 369310/371472 [7:13:24<10:32,  3.42it/s]
 99%|█████████▉| 369311/371472 [7:13:24<10:11,  3.53it/s]
 99%|█████████▉| 369312/371472 [7:13:24<10:02,  3.58it/s]
 99%|█████████▉| 369313/371472 [7:13:25<10:03,  3.58it/s]
 99%|█████████▉| 369314/371472 [7:13:25<10:06,  3.56it/s]
 99%|█████████▉| 369315/371472 [7:13:25<10:36,  3.39it/s]
 99%|█████████▉| 369316/371472 [7:13:26<11:07,  3.23it/s]
 99%|█████████▉| 369317/371472 [7:13:26<11:17,  3.18it/s]
 99%|█████████▉| 369318/371472 [7:13:27<14:04,  2.55it/s]
 99%|█████████▉| 369319/371472 [7:13:27<12:41,  2.83it/s]
 99%|█████████▉| 369320/371472 [7:13:27<11:48,  3.04it/s]
                                                         
{'loss': 2.6394, 'learning_rate': 1.0521666056152897e-07, 'epoch': 15.91}

 99%|█████████▉| 369320/371472 [7:13:27<11:48,  3.04it/s]
 99%|█████████▉| 369321/371472 [7:13:27<11:16,  3.18it/s]
 99%|█████████▉| 369322/371472 [7:13:28<11:12,  3.20it/s]
 99%|█████████▉| 369323/371472 [7:13:28<11:02,  3.24it/s]
 99%|█████████▉| 369324/371472 [7:13:28<10:43,  3.34it/s]
 99%|█████████▉| 369325/371472 [7:13:29<10:30,  3.41it/s]
 99%|█████████▉| 369326/371472 [7:13:29<10:37,  3.37it/s]
 99%|█████████▉| 369327/371472 [7:13:29<10:15,  3.48it/s]
 99%|█████████▉| 369328/371472 [7:13:29<10:07,  3.53it/s]
 99%|█████████▉| 369329/371472 [7:13:30<09:54,  3.61it/s]
 99%|█████████▉| 369330/371472 [7:13:30<10:11,  3.50it/s]
 99%|█████████▉| 369331/371472 [7:13:30<09:46,  3.65it/s]
 99%|█████████▉| 369332/371472 [7:13:31<09:48,  3.64it/s]
 99%|█████████▉| 369333/371472 [7:13:31<09:37,  3.70it/s]
 99%|█████████▉| 369334/371472 [7:13:31<09:37,  3.70it/s]
 99%|█████████▉| 369335/371472 [7:13:31<09:26,  3.77it/s]
 99%|█████████▉| 369336/371472 [7:13:32<10:09,  3.51it/s]
 99%|█████████▉| 369337/371472 [7:13:32<09:52,  3.60it/s]
 99%|█████████▉| 369338/371472 [7:13:32<10:33,  3.37it/s]
 99%|█████████▉| 369339/371472 [7:13:33<10:41,  3.33it/s]
 99%|█████████▉| 369340/371472 [7:13:33<10:13,  3.48it/s]
                                                         
{'loss': 2.3991, 'learning_rate': 1.0516817858605012e-07, 'epoch': 15.91}

 99%|█████████▉| 369340/371472 [7:13:33<10:13,  3.48it/s]
 99%|█████████▉| 369341/371472 [7:13:33<10:07,  3.50it/s]
 99%|█████████▉| 369342/371472 [7:13:33<09:38,  3.68it/s]
 99%|█████████▉| 369343/371472 [7:13:34<09:47,  3.62it/s]
 99%|█████████▉| 369344/371472 [7:13:34<09:57,  3.56it/s]
 99%|█████████▉| 369345/371472 [7:13:34<09:34,  3.70it/s]
 99%|█████████▉| 369346/371472 [7:13:34<10:15,  3.45it/s]
 99%|█████████▉| 369347/371472 [7:13:35<10:41,  3.31it/s]
 99%|█████████▉| 369348/371472 [7:13:35<10:17,  3.44it/s]
 99%|█████████▉| 369349/371472 [7:13:35<10:07,  3.49it/s]
 99%|█████████▉| 369350/371472 [7:13:36<09:48,  3.60it/s]
 99%|█████████▉| 369351/371472 [7:13:36<10:12,  3.47it/s]
 99%|█████████▉| 369352/371472 [7:13:36<10:13,  3.45it/s]
 99%|█████████▉| 369353/371472 [7:13:37<10:43,  3.29it/s]
 99%|█████████▉| 369354/371472 [7:13:37<10:13,  3.45it/s]
 99%|█████████▉| 369355/371472 [7:13:37<10:05,  3.50it/s]
 99%|█████████▉| 369356/371472 [7:13:37<09:57,  3.54it/s]
 99%|█████████▉| 369357/371472 [7:13:38<09:46,  3.60it/s]
 99%|█████████▉| 369358/371472 [7:13:38<09:41,  3.63it/s]
 99%|█████████▉| 369359/371472 [7:13:38<09:55,  3.55it/s]
 99%|█████████▉| 369360/371472 [7:13:38<09:41,  3.63it/s]
                                                         
{'loss': 2.6143, 'learning_rate': 1.0511969661057118e-07, 'epoch': 15.91}

 99%|█████████▉| 369360/371472 [7:13:38<09:41,  3.63it/s]
 99%|█████████▉| 369361/371472 [7:13:39<09:35,  3.66it/s]
 99%|█████████▉| 369362/371472 [7:13:39<09:43,  3.61it/s]
 99%|█████████▉| 369363/371472 [7:13:39<09:29,  3.70it/s]
 99%|█████████▉| 369364/371472 [7:13:40<09:34,  3.67it/s]
 99%|█████████▉| 369365/371472 [7:13:40<09:49,  3.58it/s]
 99%|█████████▉| 369366/371472 [7:13:40<09:33,  3.67it/s]
 99%|█████████▉| 369367/371472 [7:13:40<10:00,  3.50it/s]
 99%|█████████▉| 369368/371472 [7:13:41<09:55,  3.53it/s]
 99%|█████████▉| 369369/371472 [7:13:41<09:34,  3.66it/s]
 99%|█████████▉| 369370/371472 [7:13:41<09:45,  3.59it/s]
 99%|█████████▉| 369371/371472 [7:13:42<10:09,  3.45it/s]
 99%|█████████▉| 369372/371472 [7:13:42<10:07,  3.45it/s]
 99%|█████████▉| 369373/371472 [7:13:42<10:16,  3.40it/s]
 99%|█████████▉| 369374/371472 [7:13:42<09:52,  3.54it/s]
 99%|█████████▉| 369375/371472 [7:13:43<10:07,  3.45it/s]
 99%|█████████▉| 369376/371472 [7:13:43<09:52,  3.54it/s]
 99%|█████████▉| 369377/371472 [7:13:43<09:39,  3.62it/s]
 99%|█████████▉| 369378/371472 [7:13:44<10:07,  3.45it/s]
 99%|█████████▉| 369379/371472 [7:13:44<10:33,  3.30it/s]
 99%|█████████▉| 369380/371472 [7:13:44<10:24,  3.35it/s]
                                                         
{'loss': 2.6166, 'learning_rate': 1.0507121463509234e-07, 'epoch': 15.91}

 99%|█████████▉| 369380/371472 [7:13:44<10:24,  3.35it/s]
 99%|█████████▉| 369381/371472 [7:13:44<09:57,  3.50it/s]
 99%|█████████▉| 369382/371472 [7:13:45<09:52,  3.53it/s]
 99%|█████████▉| 369383/371472 [7:13:45<09:37,  3.62it/s]
 99%|█████████▉| 369384/371472 [7:13:45<09:34,  3.63it/s]
 99%|█████████▉| 369385/371472 [7:13:45<09:16,  3.75it/s]
 99%|█████████▉| 369386/371472 [7:13:46<09:05,  3.83it/s]
 99%|█████████▉| 369387/371472 [7:13:46<09:33,  3.64it/s]
 99%|█████████▉| 369388/371472 [7:13:46<09:56,  3.49it/s]
 99%|█████████▉| 369389/371472 [7:13:47<09:43,  3.57it/s]
 99%|█████████▉| 369390/371472 [7:13:47<10:04,  3.45it/s]
 99%|█████████▉| 369391/371472 [7:13:47<09:44,  3.56it/s]
 99%|█████████▉| 369392/371472 [7:13:47<09:46,  3.55it/s]
 99%|█████████▉| 369393/371472 [7:13:48<09:36,  3.61it/s]
 99%|█████████▉| 369394/371472 [7:13:48<10:04,  3.44it/s]
 99%|█████████▉| 369395/371472 [7:13:48<09:55,  3.49it/s]
 99%|█████████▉| 369396/371472 [7:13:49<09:46,  3.54it/s]
 99%|█████████▉| 369397/371472 [7:13:49<09:45,  3.55it/s]
 99%|█████████▉| 369398/371472 [7:13:49<09:35,  3.61it/s]
 99%|█████████▉| 369399/371472 [7:13:49<09:28,  3.64it/s]
 99%|█████████▉| 369400/371472 [7:13:50<09:38,  3.58it/s]
                                                         
{'loss': 2.6362, 'learning_rate': 1.050227326596134e-07, 'epoch': 15.91}

 99%|█████████▉| 369400/371472 [7:13:50<09:38,  3.58it/s]
 99%|█████████▉| 369401/371472 [7:13:50<09:22,  3.68it/s]
 99%|█████████▉| 369402/371472 [7:13:50<09:24,  3.67it/s]
 99%|█████████▉| 369403/371472 [7:13:51<09:32,  3.62it/s]
 99%|█████████▉| 369404/371472 [7:13:51<09:18,  3.70it/s]
 99%|█████████▉| 369405/371472 [7:13:51<08:56,  3.85it/s]
 99%|█████████▉| 369406/371472 [7:13:51<10:20,  3.33it/s]
 99%|█████████▉| 369407/371472 [7:13:52<10:06,  3.41it/s]
 99%|█████████▉| 369408/371472 [7:13:52<09:32,  3.60it/s]
 99%|█████████▉| 369409/371472 [7:13:52<09:24,  3.66it/s]
 99%|█████████▉| 369410/371472 [7:13:52<09:18,  3.69it/s]
 99%|█████████▉| 369411/371472 [7:13:53<09:06,  3.77it/s]
 99%|█████████▉| 369412/371472 [7:13:53<09:06,  3.77it/s]
 99%|█████████▉| 369413/371472 [7:13:53<09:05,  3.78it/s]
 99%|█████████▉| 369414/371472 [7:13:53<08:56,  3.83it/s]
 99%|█████████▉| 369415/371472 [7:13:54<09:33,  3.59it/s]
 99%|█████████▉| 369416/371472 [7:13:54<09:54,  3.46it/s]
 99%|█████████▉| 369417/371472 [7:13:54<09:49,  3.49it/s]
 99%|█████████▉| 369418/371472 [7:13:55<09:52,  3.47it/s]
 99%|█████████▉| 369419/371472 [7:13:55<10:36,  3.23it/s]
 99%|█████████▉| 369420/371472 [7:13:55<10:08,  3.37it/s]
                                                         
{'loss': 2.644, 'learning_rate': 1.0497425068413455e-07, 'epoch': 15.91}

 99%|█████████▉| 369420/371472 [7:13:55<10:08,  3.37it/s]
 99%|█████████▉| 369421/371472 [7:13:56<10:41,  3.20it/s]
 99%|█████████▉| 369422/371472 [7:13:56<10:15,  3.33it/s]
 99%|█████████▉| 369423/371472 [7:13:56<09:46,  3.49it/s]
 99%|█████████▉| 369424/371472 [7:13:56<09:50,  3.47it/s]
 99%|█████████▉| 369425/371472 [7:13:57<09:21,  3.65it/s]
 99%|█████████▉| 369426/371472 [7:13:57<09:41,  3.52it/s]
 99%|█████████▉| 369427/371472 [7:13:57<09:52,  3.45it/s]
 99%|█████████▉| 369428/371472 [7:13:58<10:20,  3.29it/s]
 99%|█████████▉| 369429/371472 [7:13:58<09:38,  3.53it/s]
 99%|█████████▉| 369430/371472 [7:13:58<09:25,  3.61it/s]
 99%|█████████▉| 369431/371472 [7:13:58<09:31,  3.57it/s]
 99%|█████████▉| 369432/371472 [7:13:59<09:37,  3.53it/s]
 99%|█████████▉| 369433/371472 [7:13:59<09:32,  3.56it/s]
 99%|█████████▉| 369434/371472 [7:13:59<09:11,  3.70it/s]
 99%|█████████▉| 369435/371472 [7:14:00<09:16,  3.66it/s]
 99%|█████████▉| 369436/371472 [7:14:00<09:05,  3.73it/s]
 99%|█████████▉| 369437/371472 [7:14:00<09:06,  3.72it/s]
 99%|█████████▉| 369438/371472 [7:14:00<09:03,  3.75it/s]
 99%|█████████▉| 369439/371472 [7:14:01<09:00,  3.76it/s]
 99%|█████████▉| 369440/371472 [7:14:01<08:58,  3.77it/s]
                                                         
{'loss': 2.7068, 'learning_rate': 1.0492576870865562e-07, 'epoch': 15.91}

 99%|█████████▉| 369440/371472 [7:14:01<08:58,  3.77it/s]
 99%|█████████▉| 369441/371472 [7:14:01<09:11,  3.68it/s]
 99%|█████████▉| 369442/371472 [7:14:01<09:53,  3.42it/s]
 99%|█████████▉| 369443/371472 [7:14:02<10:07,  3.34it/s]
 99%|█████████▉| 369444/371472 [7:14:02<09:48,  3.45it/s]
 99%|█████████▉| 369445/371472 [7:14:02<09:47,  3.45it/s]
 99%|█████████▉| 369446/371472 [7:14:03<09:45,  3.46it/s]
 99%|█████████▉| 369447/371472 [7:14:03<09:43,  3.47it/s]
 99%|█████████▉| 369448/371472 [7:14:03<09:37,  3.51it/s]
 99%|█████████▉| 369449/371472 [7:14:03<09:38,  3.50it/s]
 99%|█████████▉| 369450/371472 [7:14:04<09:46,  3.45it/s]
 99%|█████████▉| 369451/371472 [7:14:04<09:26,  3.57it/s]
 99%|█████████▉| 369452/371472 [7:14:04<09:26,  3.56it/s]
 99%|█████████▉| 369453/371472 [7:14:05<09:59,  3.37it/s]
 99%|█████████▉| 369454/371472 [7:14:05<09:34,  3.51it/s]
 99%|█████████▉| 369455/371472 [7:14:05<09:07,  3.68it/s]
 99%|█████████▉| 369456/371472 [7:14:05<08:56,  3.76it/s]
 99%|█████████▉| 369457/371472 [7:14:06<08:54,  3.77it/s]
 99%|█████████▉| 369458/371472 [7:14:06<09:31,  3.52it/s]
 99%|█████████▉| 369459/371472 [7:14:06<09:34,  3.50it/s]
 99%|█████████▉| 369460/371472 [7:14:07<09:25,  3.56it/s]
                                                         
{'loss': 2.6062, 'learning_rate': 1.0487728673317678e-07, 'epoch': 15.91}

 99%|█████████▉| 369460/371472 [7:14:07<09:25,  3.56it/s]
 99%|█████████▉| 369461/371472 [7:14:07<09:13,  3.63it/s]
 99%|█████████▉| 369462/371472 [7:14:07<09:10,  3.65it/s]
 99%|█████████▉| 369463/371472 [7:14:07<09:01,  3.71it/s]
 99%|█████████▉| 369464/371472 [7:14:08<09:02,  3.70it/s]
 99%|█████████▉| 369465/371472 [7:14:08<09:01,  3.71it/s]
 99%|█████████▉| 369466/371472 [7:14:08<09:00,  3.71it/s]
 99%|█████████▉| 369467/371472 [7:14:09<09:37,  3.47it/s]
 99%|█████████▉| 369468/371472 [7:14:09<09:19,  3.58it/s]
 99%|█████████▉| 369469/371472 [7:14:09<09:40,  3.45it/s]
 99%|█████████▉| 369470/371472 [7:14:09<09:07,  3.66it/s]
 99%|█████████▉| 369471/371472 [7:14:10<10:40,  3.12it/s]
 99%|█████████▉| 369472/371472 [7:14:10<10:10,  3.28it/s]
 99%|█████████▉| 369473/371472 [7:14:10<09:54,  3.36it/s]
 99%|█████████▉| 369474/371472 [7:14:11<10:08,  3.28it/s]
 99%|█████████▉| 369475/371472 [7:14:11<09:46,  3.40it/s]
 99%|█████████▉| 369476/371472 [7:14:11<09:38,  3.45it/s]
 99%|█████████▉| 369477/371472 [7:14:11<09:24,  3.53it/s]
 99%|█████████▉| 369478/371472 [7:14:12<09:29,  3.50it/s]
 99%|█████████▉| 369479/371472 [7:14:12<09:30,  3.49it/s]
 99%|█████████▉| 369480/371472 [7:14:12<09:18,  3.56it/s]
                                                         
{'loss': 2.8025, 'learning_rate': 1.0482880475769783e-07, 'epoch': 15.91}

 99%|█████████▉| 369480/371472 [7:14:12<09:18,  3.56it/s]
 99%|█████████▉| 369481/371472 [7:14:13<09:11,  3.61it/s]
 99%|█████████▉| 369482/371472 [7:14:13<09:45,  3.40it/s]
 99%|█████████▉| 369483/371472 [7:14:13<09:17,  3.57it/s]
 99%|█████████▉| 369484/371472 [7:14:13<09:20,  3.54it/s]
 99%|█████████▉| 369485/371472 [7:14:14<09:09,  3.62it/s]
 99%|█████████▉| 369486/371472 [7:14:14<08:52,  3.73it/s]
 99%|█████████▉| 369487/371472 [7:14:14<08:57,  3.69it/s]
 99%|█████████▉| 369488/371472 [7:14:15<09:28,  3.49it/s]
 99%|█████████▉| 369489/371472 [7:14:15<09:08,  3.62it/s]
 99%|█████████▉| 369490/371472 [7:14:15<09:05,  3.64it/s]
 99%|█████████▉| 369491/371472 [7:14:15<09:27,  3.49it/s]
 99%|█████████▉| 369492/371472 [7:14:16<09:57,  3.32it/s]
 99%|█████████▉| 369493/371472 [7:14:16<09:36,  3.43it/s]
 99%|█████████▉| 369494/371472 [7:14:16<09:31,  3.46it/s]
 99%|█████████▉| 369495/371472 [7:14:17<09:17,  3.54it/s]
 99%|█████████▉| 369496/371472 [7:14:17<09:33,  3.45it/s]
 99%|█████████▉| 369497/371472 [7:14:17<10:00,  3.29it/s]
 99%|█████████▉| 369498/371472 [7:14:17<09:49,  3.35it/s]
 99%|█████████▉| 369499/371472 [7:14:18<09:40,  3.40it/s]
 99%|█████████▉| 369500/371472 [7:14:18<09:58,  3.30it/s]
                                                         
{'loss': 2.4199, 'learning_rate': 1.0478032278221898e-07, 'epoch': 15.92}

 99%|█████████▉| 369500/371472 [7:14:18<09:58,  3.30it/s]
 99%|█████████▉| 369501/371472 [7:14:18<09:38,  3.41it/s]
 99%|█████████▉| 369502/371472 [7:14:19<09:24,  3.49it/s]
 99%|█████████▉| 369503/371472 [7:14:19<09:32,  3.44it/s]
 99%|█████████▉| 369504/371472 [7:14:19<09:17,  3.53it/s]
 99%|█████████▉| 369505/371472 [7:14:19<09:10,  3.58it/s]
 99%|█████████▉| 369506/371472 [7:14:20<09:03,  3.61it/s]
 99%|█████████▉| 369507/371472 [7:14:20<08:46,  3.74it/s]
 99%|█████████▉| 369508/371472 [7:14:20<08:30,  3.84it/s]
 99%|█████████▉| 369509/371472 [7:14:20<08:32,  3.83it/s]
 99%|█████████▉| 369510/371472 [7:14:21<08:43,  3.75it/s]
 99%|█████████▉| 369511/371472 [7:14:21<08:43,  3.74it/s]
 99%|█████████▉| 369512/371472 [7:14:21<09:01,  3.62it/s]
 99%|█████████▉| 369513/371472 [7:14:22<09:11,  3.55it/s]
 99%|█████████▉| 369514/371472 [7:14:22<09:01,  3.62it/s]
 99%|█████████▉| 369515/371472 [7:14:22<08:37,  3.78it/s]
 99%|█████████▉| 369516/371472 [7:14:22<08:43,  3.74it/s]
 99%|█████████▉| 369517/371472 [7:14:23<08:33,  3.81it/s]
 99%|█████████▉| 369518/371472 [7:14:23<09:02,  3.60it/s]
 99%|█████████▉| 369519/371472 [7:14:23<08:58,  3.63it/s]
 99%|█████████▉| 369520/371472 [7:14:24<09:42,  3.35it/s]
                                                         
{'loss': 2.5001, 'learning_rate': 1.0473184080674004e-07, 'epoch': 15.92}

 99%|█████████▉| 369520/371472 [7:14:24<09:42,  3.35it/s]
 99%|█████████▉| 369521/371472 [7:14:24<09:31,  3.41it/s]
 99%|█████████▉| 369522/371472 [7:14:24<09:54,  3.28it/s]
 99%|█████████▉| 369523/371472 [7:14:24<09:51,  3.29it/s]
 99%|█████████▉| 369524/371472 [7:14:25<09:30,  3.41it/s]
 99%|█████████▉| 369525/371472 [7:14:25<09:05,  3.57it/s]
 99%|█████████▉| 369526/371472 [7:14:25<08:58,  3.61it/s]
 99%|█████████▉| 369527/371472 [7:14:26<09:01,  3.59it/s]
 99%|█████████▉| 369528/371472 [7:14:26<08:50,  3.66it/s]
 99%|█████████▉| 369529/371472 [7:14:26<09:05,  3.56it/s]
 99%|█████████▉| 369530/371472 [7:14:26<09:37,  3.36it/s]
 99%|█████████▉| 369531/371472 [7:14:27<09:15,  3.49it/s]
 99%|█████████▉| 369532/371472 [7:14:27<09:06,  3.55it/s]
 99%|█████████▉| 369533/371472 [7:14:27<09:07,  3.54it/s]
 99%|█████████▉| 369534/371472 [7:14:28<09:53,  3.27it/s]
 99%|█████████▉| 369535/371472 [7:14:28<09:33,  3.38it/s]
 99%|█████████▉| 369536/371472 [7:14:28<09:05,  3.55it/s]
 99%|█████████▉| 369537/371472 [7:14:28<09:37,  3.35it/s]
 99%|█████████▉| 369538/371472 [7:14:29<09:14,  3.49it/s]
 99%|█████████▉| 369539/371472 [7:14:29<09:07,  3.53it/s]
 99%|█████████▉| 369540/371472 [7:14:29<09:03,  3.55it/s]
                                                         
{'loss': 2.6826, 'learning_rate': 1.0468335883126121e-07, 'epoch': 15.92}

 99%|█████████▉| 369540/371472 [7:14:29<09:03,  3.55it/s]
 99%|█████████▉| 369541/371472 [7:14:30<09:28,  3.39it/s]
 99%|█████████▉| 369542/371472 [7:14:30<09:33,  3.37it/s]
 99%|█████████▉| 369543/371472 [7:14:30<09:28,  3.39it/s]
 99%|█████████▉| 369544/371472 [7:14:30<09:07,  3.52it/s]
 99%|█████████▉| 369545/371472 [7:14:31<08:43,  3.68it/s]
 99%|█████████▉| 369546/371472 [7:14:31<08:47,  3.65it/s]
 99%|█████████▉| 369547/371472 [7:14:31<08:30,  3.77it/s]
 99%|█████████▉| 369548/371472 [7:14:31<08:29,  3.78it/s]
 99%|█████████▉| 369549/371472 [7:14:32<08:21,  3.84it/s]
 99%|█████████▉| 369550/371472 [7:14:32<08:41,  3.69it/s]
 99%|█████████▉| 369551/371472 [7:14:32<08:30,  3.77it/s]
 99%|█████████▉| 369552/371472 [7:14:33<08:40,  3.69it/s]
 99%|█████████▉| 369553/371472 [7:14:33<08:31,  3.75it/s]
 99%|█████████▉| 369554/371472 [7:14:33<08:44,  3.65it/s]
 99%|█████████▉| 369555/371472 [7:14:33<09:15,  3.45it/s]
 99%|█████████▉| 369556/371472 [7:14:34<08:54,  3.59it/s]
 99%|█████████▉| 369557/371472 [7:14:34<08:32,  3.74it/s]
 99%|█████████▉| 369558/371472 [7:14:34<08:48,  3.62it/s]
 99%|█████████▉| 369559/371472 [7:14:35<09:24,  3.39it/s]
 99%|█████████▉| 369560/371472 [7:14:35<09:07,  3.49it/s]
                                                         
{'loss': 2.6841, 'learning_rate': 1.0463487685578227e-07, 'epoch': 15.92}

 99%|█████████▉| 369560/371472 [7:14:35<09:07,  3.49it/s]
 99%|█████████▉| 369561/371472 [7:14:35<09:02,  3.52it/s]
 99%|█████████▉| 369562/371472 [7:14:35<08:45,  3.64it/s]
 99%|█████████▉| 369563/371472 [7:14:36<08:22,  3.80it/s]
 99%|█████████▉| 369564/371472 [7:14:36<08:21,  3.80it/s]
 99%|█████████▉| 369565/371472 [7:14:36<08:39,  3.67it/s]
 99%|█████████▉| 369566/371472 [7:14:37<09:12,  3.45it/s]
 99%|█████████▉| 369567/371472 [7:14:37<09:20,  3.40it/s]
 99%|█████████▉| 369568/371472 [7:14:37<09:39,  3.29it/s]
 99%|█████████▉| 369569/371472 [7:14:37<09:45,  3.25it/s]
 99%|█████████▉| 369570/371472 [7:14:38<09:08,  3.47it/s]
 99%|█████████▉| 369571/371472 [7:14:38<09:20,  3.39it/s]
 99%|█████████▉| 369572/371472 [7:14:38<09:22,  3.38it/s]
 99%|█████████▉| 369573/371472 [7:14:39<09:27,  3.35it/s]
 99%|█████████▉| 369574/371472 [7:14:39<09:13,  3.43it/s]
 99%|█████████▉| 369575/371472 [7:14:39<08:55,  3.54it/s]
 99%|█████████▉| 369576/371472 [7:14:39<09:23,  3.36it/s]
 99%|█████████▉| 369577/371472 [7:14:40<09:01,  3.50it/s]
 99%|█████████▉| 369578/371472 [7:14:40<08:56,  3.53it/s]
 99%|█████████▉| 369579/371472 [7:14:40<08:54,  3.54it/s]
 99%|█████████▉| 369580/371472 [7:14:41<09:03,  3.48it/s]
                                                         
{'loss': 2.6618, 'learning_rate': 1.0458639488030342e-07, 'epoch': 15.92}

 99%|█████████▉| 369580/371472 [7:14:41<09:03,  3.48it/s]
 99%|█████████▉| 369581/371472 [7:14:41<09:10,  3.44it/s]
 99%|█████████▉| 369582/371472 [7:14:41<08:41,  3.62it/s]
 99%|█████████▉| 369583/371472 [7:14:41<08:35,  3.66it/s]
 99%|█████████▉| 369584/371472 [7:14:42<08:27,  3.72it/s]
 99%|█████████▉| 369585/371472 [7:14:42<08:39,  3.64it/s]
 99%|█████████▉| 369586/371472 [7:14:42<08:53,  3.54it/s]
 99%|█████████▉| 369587/371472 [7:14:43<08:52,  3.54it/s]
 99%|█████████▉| 369588/371472 [7:14:43<08:44,  3.59it/s]
 99%|█████████▉| 369589/371472 [7:14:43<08:30,  3.69it/s]
 99%|█████████▉| 369590/371472 [7:14:43<08:08,  3.85it/s]
 99%|█████████▉| 369591/371472 [7:14:44<08:41,  3.61it/s]
 99%|█████████▉| 369592/371472 [7:14:44<08:13,  3.81it/s]
 99%|█████████▉| 369593/371472 [7:14:44<08:10,  3.83it/s]
 99%|█████████▉| 369594/371472 [7:14:44<08:15,  3.79it/s]
 99%|█████████▉| 369595/371472 [7:14:45<08:43,  3.59it/s]
 99%|█████████▉| 369596/371472 [7:14:45<08:56,  3.49it/s]
 99%|█████████▉| 369597/371472 [7:14:45<08:44,  3.58it/s]
 99%|█████████▉| 369598/371472 [7:14:46<08:38,  3.61it/s]
 99%|█████████▉| 369599/371472 [7:14:46<08:39,  3.60it/s]
 99%|█████████▉| 369600/371472 [7:14:46<08:38,  3.61it/s]
                                                         
{'loss': 2.4794, 'learning_rate': 1.0453791290482447e-07, 'epoch': 15.92}

 99%|█████████▉| 369600/371472 [7:14:46<08:38,  3.61it/s]
 99%|█████████▉| 369601/371472 [7:14:46<08:29,  3.67it/s]
 99%|█████████▉| 369602/371472 [7:14:47<08:29,  3.67it/s]
 99%|█████████▉| 369603/371472 [7:14:47<08:32,  3.65it/s]
 99%|█████████▉| 369604/371472 [7:14:47<08:36,  3.62it/s]
 99%|█████████▉| 369605/371472 [7:14:47<09:09,  3.40it/s]
 99%|█████████▉| 369606/371472 [7:14:48<08:50,  3.52it/s]
 99%|█████████▉| 369607/371472 [7:14:48<09:23,  3.31it/s]
 99%|█████████▉| 369608/371472 [7:14:48<09:20,  3.33it/s]
 99%|█████████▉| 369609/371472 [7:14:49<09:35,  3.24it/s]
 99%|█████████▉| 369610/371472 [7:14:49<09:20,  3.32it/s]
 99%|█████████▉| 369611/371472 [7:14:49<09:22,  3.31it/s]
 99%|█████████▉| 369612/371472 [7:14:50<08:57,  3.46it/s]
 99%|█████████▉| 369613/371472 [7:14:50<08:59,  3.45it/s]
 99%|█████████▉| 369614/371472 [7:14:50<08:46,  3.53it/s]
100%|█████████▉| 369615/371472 [7:14:50<08:39,  3.57it/s]
100%|█████████▉| 369616/371472 [7:14:51<09:22,  3.30it/s]
100%|█████████▉| 369617/371472 [7:14:51<08:58,  3.45it/s]
100%|█████████▉| 369618/371472 [7:14:51<09:28,  3.26it/s]
100%|█████████▉| 369619/371472 [7:14:52<09:05,  3.39it/s]
100%|█████████▉| 369620/371472 [7:14:52<10:02,  3.07it/s]
                                                         
{'loss': 2.5479, 'learning_rate': 1.0448943092934565e-07, 'epoch': 15.92}

100%|█████████▉| 369620/371472 [7:14:52<10:02,  3.07it/s]
100%|█████████▉| 369621/371472 [7:14:52<09:39,  3.20it/s]
100%|█████████▉| 369622/371472 [7:14:53<09:05,  3.39it/s]
100%|█████████▉| 369623/371472 [7:14:53<09:04,  3.40it/s]
100%|█████████▉| 369624/371472 [7:14:53<08:41,  3.55it/s]
100%|█████████▉| 369625/371472 [7:14:53<08:48,  3.49it/s]
100%|█████████▉| 369626/371472 [7:14:54<08:48,  3.49it/s]
100%|█████████▉| 369627/371472 [7:14:54<08:34,  3.59it/s]
100%|█████████▉| 369628/371472 [7:14:54<09:15,  3.32it/s]
100%|█████████▉| 369629/371472 [7:14:55<08:53,  3.45it/s]
100%|█████████▉| 369630/371472 [7:14:55<08:34,  3.58it/s]
100%|█████████▉| 369631/371472 [7:14:55<09:18,  3.29it/s]
100%|█████████▉| 369632/371472 [7:14:55<09:05,  3.38it/s]
100%|█████████▉| 369633/371472 [7:14:56<09:13,  3.32it/s]
100%|█████████▉| 369634/371472 [7:14:56<09:02,  3.39it/s]
100%|█████████▉| 369635/371472 [7:14:56<08:48,  3.48it/s]
100%|█████████▉| 369636/371472 [7:14:57<08:38,  3.54it/s]
100%|█████████▉| 369637/371472 [7:14:57<08:38,  3.54it/s]
100%|█████████▉| 369638/371472 [7:14:57<08:30,  3.59it/s]
100%|█████████▉| 369639/371472 [7:14:57<08:30,  3.59it/s]
100%|█████████▉| 369640/371472 [7:14:58<08:43,  3.50it/s]
                                                         
{'loss': 2.5421, 'learning_rate': 1.044409489538667e-07, 'epoch': 15.92}

100%|█████████▉| 369640/371472 [7:14:58<08:43,  3.50it/s]
100%|█████████▉| 369641/371472 [7:14:58<08:32,  3.57it/s]
100%|█████████▉| 369642/371472 [7:14:58<08:32,  3.57it/s]
100%|█████████▉| 369643/371472 [7:14:59<08:20,  3.66it/s]
100%|█████████▉| 369644/371472 [7:14:59<08:41,  3.51it/s]
100%|█████████▉| 369645/371472 [7:14:59<08:28,  3.59it/s]
100%|█████████▉| 369646/371472 [7:14:59<08:04,  3.77it/s]
100%|█████████▉| 369647/371472 [7:15:00<08:04,  3.76it/s]
100%|█████████▉| 369648/371472 [7:15:00<07:49,  3.89it/s]
100%|█████████▉| 369649/371472 [7:15:00<08:15,  3.68it/s]
100%|█████████▉| 369650/371472 [7:15:01<09:01,  3.36it/s]
100%|█████████▉| 369651/371472 [7:15:01<08:39,  3.50it/s]
100%|█████████▉| 369652/371472 [7:15:01<08:37,  3.52it/s]
100%|█████████▉| 369653/371472 [7:15:01<08:29,  3.57it/s]
100%|█████████▉| 369654/371472 [7:15:02<08:34,  3.54it/s]
100%|█████████▉| 369655/371472 [7:15:02<08:12,  3.69it/s]
100%|█████████▉| 369656/371472 [7:15:02<08:07,  3.73it/s]
100%|█████████▉| 369657/371472 [7:15:02<08:06,  3.73it/s]
100%|█████████▉| 369658/371472 [7:15:03<08:04,  3.75it/s]
100%|█████████▉| 369659/371472 [7:15:03<07:47,  3.88it/s]
100%|█████████▉| 369660/371472 [7:15:03<07:58,  3.78it/s]
                                                         
{'loss': 2.6306, 'learning_rate': 1.0439246697838785e-07, 'epoch': 15.92}

100%|█████████▉| 369660/371472 [7:15:03<07:58,  3.78it/s]
100%|█████████▉| 369661/371472 [7:15:03<08:03,  3.75it/s]
100%|█████████▉| 369662/371472 [7:15:04<08:06,  3.72it/s]
100%|█████████▉| 369663/371472 [7:15:04<08:24,  3.59it/s]
100%|█████████▉| 369664/371472 [7:15:04<08:16,  3.64it/s]
100%|█████████▉| 369665/371472 [7:15:05<08:55,  3.37it/s]
100%|█████████▉| 369666/371472 [7:15:05<08:47,  3.42it/s]
100%|█████████▉| 369667/371472 [7:15:05<08:29,  3.54it/s]
100%|█████████▉| 369668/371472 [7:15:06<09:14,  3.25it/s]
100%|█████████▉| 369669/371472 [7:15:06<09:14,  3.25it/s]
100%|█████████▉| 369670/371472 [7:15:06<08:56,  3.36it/s]
100%|█████████▉| 369671/371472 [7:15:06<08:46,  3.42it/s]
100%|█████████▉| 369672/371472 [7:15:07<08:15,  3.63it/s]
100%|█████████▉| 369673/371472 [7:15:07<09:00,  3.33it/s]
100%|█████████▉| 369674/371472 [7:15:07<08:37,  3.48it/s]
100%|█████████▉| 369675/371472 [7:15:08<08:54,  3.36it/s]
100%|█████████▉| 369676/371472 [7:15:08<09:05,  3.30it/s]
100%|█████████▉| 369677/371472 [7:15:08<08:40,  3.45it/s]
100%|█████████▉| 369678/371472 [7:15:08<08:23,  3.56it/s]
100%|█████████▉| 369679/371472 [7:15:09<08:10,  3.66it/s]
100%|█████████▉| 369680/371472 [7:15:09<08:08,  3.67it/s]
                                                         
{'loss': 2.5146, 'learning_rate': 1.043439850029089e-07, 'epoch': 15.92}

100%|█████████▉| 369680/371472 [7:15:09<08:08,  3.67it/s]
100%|█████████▉| 369681/371472 [7:15:09<08:02,  3.71it/s]
100%|█████████▉| 369682/371472 [7:15:10<08:37,  3.46it/s]
100%|█████████▉| 369683/371472 [7:15:10<08:36,  3.47it/s]
100%|█████████▉| 369684/371472 [7:15:10<08:14,  3.62it/s]
100%|█████████▉| 369685/371472 [7:15:10<08:37,  3.46it/s]
100%|█████████▉| 369686/371472 [7:15:11<08:31,  3.49it/s]
100%|█████████▉| 369687/371472 [7:15:11<08:39,  3.44it/s]
100%|█████████▉| 369688/371472 [7:15:11<08:59,  3.30it/s]
100%|█████████▉| 369689/371472 [7:15:12<08:38,  3.44it/s]
100%|█████████▉| 369690/371472 [7:15:12<08:35,  3.45it/s]
100%|█████████▉| 369691/371472 [7:15:12<08:21,  3.55it/s]
100%|█████████▉| 369692/371472 [7:15:12<08:05,  3.66it/s]
100%|█████████▉| 369693/371472 [7:15:13<08:13,  3.60it/s]
100%|█████████▉| 369694/371472 [7:15:13<08:27,  3.51it/s]
100%|█████████▉| 369695/371472 [7:15:13<08:41,  3.41it/s]
100%|█████████▉| 369696/371472 [7:15:14<08:18,  3.56it/s]
100%|█████████▉| 369697/371472 [7:15:14<08:18,  3.56it/s]
100%|█████████▉| 369698/371472 [7:15:14<08:27,  3.49it/s]
100%|█████████▉| 369699/371472 [7:15:14<08:24,  3.51it/s]
100%|█████████▉| 369700/371472 [7:15:15<08:11,  3.61it/s]
                                                         
{'loss': 2.7233, 'learning_rate': 1.0429550302743007e-07, 'epoch': 15.92}

100%|█████████▉| 369700/371472 [7:15:15<08:11,  3.61it/s]
100%|█████████▉| 369701/371472 [7:15:15<08:20,  3.54it/s]
100%|█████████▉| 369702/371472 [7:15:15<08:47,  3.35it/s]
100%|█████████▉| 369703/371472 [7:15:16<08:32,  3.45it/s]
100%|█████████▉| 369704/371472 [7:15:16<08:12,  3.59it/s]
100%|█████████▉| 369705/371472 [7:15:16<08:13,  3.58it/s]
100%|█████████▉| 369706/371472 [7:15:16<08:08,  3.62it/s]
100%|█████████▉| 369707/371472 [7:15:17<08:05,  3.63it/s]
100%|█████████▉| 369708/371472 [7:15:17<08:03,  3.65it/s]
100%|█████████▉| 369709/371472 [7:15:17<07:54,  3.72it/s]
100%|█████████▉| 369710/371472 [7:15:17<08:01,  3.66it/s]
100%|█████████▉| 369711/371472 [7:15:18<08:03,  3.64it/s]
100%|█████████▉| 369712/371472 [7:15:18<08:03,  3.64it/s]
100%|█████████▉| 369713/371472 [7:15:18<07:54,  3.71it/s]
100%|█████████▉| 369714/371472 [7:15:19<08:03,  3.64it/s]
100%|█████████▉| 369715/371472 [7:15:19<08:38,  3.39it/s]
100%|█████████▉| 369716/371472 [7:15:19<08:22,  3.50it/s]
100%|█████████▉| 369717/371472 [7:15:19<08:18,  3.52it/s]
100%|█████████▉| 369718/371472 [7:15:20<08:28,  3.45it/s]
100%|█████████▉| 369719/371472 [7:15:20<08:38,  3.38it/s]
100%|█████████▉| 369720/371472 [7:15:20<08:35,  3.40it/s]
                                                         
{'loss': 2.497, 'learning_rate': 1.0424702105195113e-07, 'epoch': 15.92}

100%|█████████▉| 369720/371472 [7:15:20<08:35,  3.40it/s]
100%|█████████▉| 369721/371472 [7:15:21<08:27,  3.45it/s]
100%|█████████▉| 369722/371472 [7:15:21<08:14,  3.54it/s]
100%|█████████▉| 369723/371472 [7:15:21<08:15,  3.53it/s]
100%|█████████▉| 369724/371472 [7:15:21<08:12,  3.55it/s]
100%|█████████▉| 369725/371472 [7:15:22<08:04,  3.61it/s]
100%|█████████▉| 369726/371472 [7:15:22<07:59,  3.64it/s]
100%|█████████▉| 369727/371472 [7:15:22<08:00,  3.63it/s]
100%|█████████▉| 369728/371472 [7:15:22<07:45,  3.74it/s]
100%|█████████▉| 369729/371472 [7:15:23<07:35,  3.83it/s]
100%|█████████▉| 369730/371472 [7:15:23<07:25,  3.91it/s]
100%|█████████▉| 369731/371472 [7:15:23<07:37,  3.81it/s]
100%|█████████▉| 369732/371472 [7:15:24<07:40,  3.78it/s]
100%|█████████▉| 369733/371472 [7:15:24<07:46,  3.72it/s]
100%|█████████▉| 369734/371472 [7:15:24<07:47,  3.72it/s]
100%|█████████▉| 369735/371472 [7:15:24<08:06,  3.57it/s]
100%|█████████▉| 369736/371472 [7:15:25<08:04,  3.58it/s]
100%|█████████▉| 369737/371472 [7:15:25<08:45,  3.30it/s]
100%|█████████▉| 369738/371472 [7:15:25<08:42,  3.32it/s]
100%|█████████▉| 369739/371472 [7:15:26<08:38,  3.34it/s]
100%|█████████▉| 369740/371472 [7:15:26<08:52,  3.25it/s]
                                                         
{'loss': 2.4305, 'learning_rate': 1.0419853907647228e-07, 'epoch': 15.93}

100%|█████████▉| 369740/371472 [7:15:26<08:52,  3.25it/s]
100%|█████████▉| 369741/371472 [7:15:26<09:25,  3.06it/s]
100%|█████████▉| 369742/371472 [7:15:27<09:09,  3.15it/s]
100%|█████████▉| 369743/371472 [7:15:27<08:49,  3.26it/s]
100%|█████████▉| 369744/371472 [7:15:27<08:26,  3.41it/s]
100%|█████████▉| 369745/371472 [7:15:27<08:13,  3.50it/s]
100%|█████████▉| 369746/371472 [7:15:28<08:07,  3.54it/s]
100%|█████████▉| 369747/371472 [7:15:28<08:25,  3.41it/s]
100%|█████████▉| 369748/371472 [7:15:28<08:09,  3.52it/s]
100%|█████████▉| 369749/371472 [7:15:29<08:14,  3.49it/s]
100%|█████████▉| 369750/371472 [7:15:29<08:06,  3.54it/s]
100%|█████████▉| 369751/371472 [7:15:29<07:49,  3.67it/s]
100%|█████████▉| 369752/371472 [7:15:29<08:11,  3.50it/s]
100%|█████████▉| 369753/371472 [7:15:30<08:11,  3.49it/s]
100%|█████████▉| 369754/371472 [7:15:30<08:23,  3.41it/s]
100%|█████████▉| 369755/371472 [7:15:30<08:11,  3.49it/s]
100%|█████████▉| 369756/371472 [7:15:31<08:11,  3.49it/s]
100%|█████████▉| 369757/371472 [7:15:31<08:05,  3.53it/s]
100%|█████████▉| 369758/371472 [7:15:31<08:31,  3.35it/s]
100%|█████████▉| 369759/371472 [7:15:31<08:37,  3.31it/s]
100%|█████████▉| 369760/371472 [7:15:32<09:11,  3.10it/s]
                                                         
{'loss': 2.5312, 'learning_rate': 1.0415005710099334e-07, 'epoch': 15.93}

100%|█████████▉| 369760/371472 [7:15:32<09:11,  3.10it/s]
100%|█████████▉| 369761/371472 [7:15:32<09:02,  3.15it/s]
100%|█████████▉| 369762/371472 [7:15:32<08:34,  3.32it/s]
100%|█████████▉| 369763/371472 [7:15:33<08:14,  3.46it/s]
100%|█████████▉| 369764/371472 [7:15:33<07:52,  3.61it/s]
100%|█████████▉| 369765/371472 [7:15:33<07:36,  3.74it/s]
100%|█████████▉| 369766/371472 [7:15:33<07:26,  3.82it/s]
100%|█████████▉| 369767/371472 [7:15:34<07:56,  3.58it/s]
100%|█████████▉| 369768/371472 [7:15:34<07:55,  3.58it/s]
100%|█████████▉| 369769/371472 [7:15:34<07:47,  3.64it/s]
100%|█████████▉| 369770/371472 [7:15:35<07:59,  3.55it/s]
100%|█████████▉| 369771/371472 [7:15:35<08:17,  3.42it/s]
100%|█████████▉| 369772/371472 [7:15:35<08:21,  3.39it/s]
100%|█████████▉| 369773/371472 [7:15:35<07:57,  3.55it/s]
100%|█████████▉| 369774/371472 [7:15:36<07:52,  3.59it/s]
100%|█████████▉| 369775/371472 [7:15:36<07:55,  3.57it/s]
100%|█████████▉| 369776/371472 [7:15:36<08:15,  3.42it/s]
100%|█████████▉| 369777/371472 [7:15:37<08:07,  3.48it/s]
100%|█████████▉| 369778/371472 [7:15:37<07:44,  3.65it/s]
100%|█████████▉| 369779/371472 [7:15:37<07:38,  3.69it/s]
100%|█████████▉| 369780/371472 [7:15:37<07:28,  3.77it/s]
                                                         
{'loss': 2.6119, 'learning_rate': 1.041015751255144e-07, 'epoch': 15.93}

100%|█████████▉| 369780/371472 [7:15:37<07:28,  3.77it/s]
100%|█████████▉| 369781/371472 [7:15:38<07:20,  3.84it/s]
100%|█████████▉| 369782/371472 [7:15:38<07:13,  3.90it/s]
100%|█████████▉| 369783/371472 [7:15:38<07:09,  3.93it/s]
100%|█████████▉| 369784/371472 [7:15:38<07:02,  3.99it/s]
100%|█████████▉| 369785/371472 [7:15:39<07:15,  3.87it/s]
100%|█████████▉| 369786/371472 [7:15:39<08:23,  3.35it/s]
100%|█████████▉| 369787/371472 [7:15:39<07:56,  3.54it/s]
100%|█████████▉| 369788/371472 [7:15:40<08:36,  3.26it/s]
100%|█████████▉| 369789/371472 [7:15:40<08:13,  3.41it/s]
100%|█████████▉| 369790/371472 [7:15:40<08:08,  3.44it/s]
100%|█████████▉| 369791/371472 [7:15:41<08:38,  3.24it/s]
100%|█████████▉| 369792/371472 [7:15:41<08:03,  3.47it/s]
100%|█████████▉| 369793/371472 [7:15:41<07:56,  3.53it/s]
100%|█████████▉| 369794/371472 [7:15:41<07:49,  3.58it/s]
100%|█████████▉| 369795/371472 [7:15:42<07:39,  3.65it/s]
100%|█████████▉| 369796/371472 [7:15:42<07:23,  3.78it/s]
100%|█████████▉| 369797/371472 [7:15:42<07:25,  3.76it/s]
100%|█████████▉| 369798/371472 [7:15:42<08:06,  3.44it/s]
100%|█████████▉| 369799/371472 [7:15:43<08:15,  3.38it/s]
100%|█████████▉| 369800/371472 [7:15:43<07:56,  3.51it/s]
                                                         
{'loss': 2.5815, 'learning_rate': 1.0405309315003556e-07, 'epoch': 15.93}

100%|█████████▉| 369800/371472 [7:15:43<07:56,  3.51it/s]
100%|█████████▉| 369801/371472 [7:15:43<07:56,  3.51it/s]
100%|█████████▉| 369802/371472 [7:15:44<08:06,  3.43it/s]
100%|█████████▉| 369803/371472 [7:15:44<08:37,  3.23it/s]
100%|█████████▉| 369804/371472 [7:15:44<08:31,  3.26it/s]
100%|█████████▉| 369805/371472 [7:15:44<08:08,  3.41it/s]
100%|█████████▉| 369806/371472 [7:15:45<07:58,  3.48it/s]
100%|█████████▉| 369807/371472 [7:15:45<08:02,  3.45it/s]
100%|█████████▉| 369808/371472 [7:15:45<07:45,  3.57it/s]
100%|█████████▉| 369809/371472 [7:15:46<07:42,  3.59it/s]
100%|█████████▉| 369810/371472 [7:15:46<07:43,  3.58it/s]
100%|█████████▉| 369811/371472 [7:15:46<07:39,  3.61it/s]
100%|█████████▉| 369812/371472 [7:15:46<07:48,  3.54it/s]
100%|█████████▉| 369813/371472 [7:15:47<08:07,  3.40it/s]
100%|█████████▉| 369814/371472 [7:15:47<07:45,  3.56it/s]
100%|█████████▉| 369815/371472 [7:15:47<07:41,  3.59it/s]
100%|█████████▉| 369816/371472 [7:15:48<08:11,  3.37it/s]
100%|█████████▉| 369817/371472 [7:15:48<08:10,  3.38it/s]
100%|█████████▉| 369818/371472 [7:15:48<07:57,  3.46it/s]
100%|█████████▉| 369819/371472 [7:15:48<08:04,  3.41it/s]
100%|█████████▉| 369820/371472 [7:15:49<07:41,  3.58it/s]
                                                         
{'loss': 2.6251, 'learning_rate': 1.040046111745566e-07, 'epoch': 15.93}

100%|█████████▉| 369820/371472 [7:15:49<07:41,  3.58it/s]
100%|█████████▉| 369821/371472 [7:15:49<08:05,  3.40it/s]
100%|█████████▉| 369822/371472 [7:15:49<07:48,  3.52it/s]
100%|█████████▉| 369823/371472 [7:15:50<07:58,  3.45it/s]
100%|█████████▉| 369824/371472 [7:15:50<09:11,  2.99it/s]
100%|█████████▉| 369825/371472 [7:15:50<08:35,  3.19it/s]
100%|█████████▉| 369826/371472 [7:15:51<08:11,  3.35it/s]
100%|█████████▉| 369827/371472 [7:15:51<07:57,  3.44it/s]
100%|█████████▉| 369828/371472 [7:15:51<07:41,  3.56it/s]
100%|█████████▉| 369829/371472 [7:15:51<07:41,  3.56it/s]
100%|█████████▉| 369830/371472 [7:15:52<08:09,  3.35it/s]
100%|█████████▉| 369831/371472 [7:15:52<08:09,  3.35it/s]
100%|█████████▉| 369832/371472 [7:15:52<08:07,  3.37it/s]
100%|█████████▉| 369833/371472 [7:15:53<07:46,  3.51it/s]
100%|█████████▉| 369834/371472 [7:15:53<07:38,  3.57it/s]
100%|█████████▉| 369835/371472 [7:15:53<07:25,  3.67it/s]
100%|█████████▉| 369836/371472 [7:15:53<07:36,  3.58it/s]
100%|█████████▉| 369837/371472 [7:15:54<08:09,  3.34it/s]
100%|█████████▉| 369838/371472 [7:15:54<07:45,  3.51it/s]
100%|█████████▉| 369839/371472 [7:15:54<07:42,  3.53it/s]
100%|█████████▉| 369840/371472 [7:15:55<07:27,  3.65it/s]
                                                         
{'loss': 2.6105, 'learning_rate': 1.0395612919907777e-07, 'epoch': 15.93}

100%|█████████▉| 369840/371472 [7:15:55<07:27,  3.65it/s]
100%|█████████▉| 369841/371472 [7:15:55<07:38,  3.56it/s]
100%|█████████▉| 369842/371472 [7:15:55<07:41,  3.53it/s]
100%|█████████▉| 369843/371472 [7:15:55<07:29,  3.63it/s]
100%|█████████▉| 369844/371472 [7:15:56<07:35,  3.58it/s]
100%|█████████▉| 369845/371472 [7:15:56<07:42,  3.52it/s]
100%|█████████▉| 369846/371472 [7:15:56<07:47,  3.47it/s]
100%|█████████▉| 369847/371472 [7:15:57<07:46,  3.49it/s]
100%|█████████▉| 369848/371472 [7:15:57<07:39,  3.53it/s]
100%|█████████▉| 369849/371472 [7:15:57<07:17,  3.71it/s]
100%|█████████▉| 369850/371472 [7:15:57<07:48,  3.46it/s]
100%|█████████▉| 369851/371472 [7:15:58<07:36,  3.55it/s]
100%|█████████▉| 369852/371472 [7:15:58<07:34,  3.56it/s]
100%|█████████▉| 369853/371472 [7:15:58<07:57,  3.39it/s]
100%|█████████▉| 369854/371472 [7:15:59<07:38,  3.53it/s]
100%|█████████▉| 369855/371472 [7:15:59<07:30,  3.59it/s]
100%|█████████▉| 369856/371472 [7:15:59<07:30,  3.58it/s]
100%|█████████▉| 369857/371472 [7:15:59<07:23,  3.64it/s]
100%|█████████▉| 369858/371472 [7:16:00<07:29,  3.59it/s]
100%|█████████▉| 369859/371472 [7:16:00<07:15,  3.71it/s]
100%|█████████▉| 369860/371472 [7:16:00<07:49,  3.44it/s]
                                                         
{'loss': 2.556, 'learning_rate': 1.0390764722359883e-07, 'epoch': 15.93}

100%|█████████▉| 369860/371472 [7:16:00<07:49,  3.44it/s]
100%|█████████▉| 369861/371472 [7:16:01<07:56,  3.38it/s]
100%|█████████▉| 369862/371472 [7:16:01<07:40,  3.49it/s]
100%|█████████▉| 369863/371472 [7:16:01<07:18,  3.67it/s]
100%|█████████▉| 369864/371472 [7:16:01<08:26,  3.18it/s]
100%|█████████▉| 369865/371472 [7:16:02<08:07,  3.30it/s]
100%|█████████▉| 369866/371472 [7:16:02<07:51,  3.40it/s]
100%|█████████▉| 369867/371472 [7:16:02<07:38,  3.50it/s]
100%|█████████▉| 369868/371472 [7:16:03<07:35,  3.52it/s]
100%|█████████▉| 369869/371472 [7:16:03<07:26,  3.59it/s]
100%|█████████▉| 369870/371472 [7:16:03<07:15,  3.68it/s]
100%|█████████▉| 369871/371472 [7:16:03<07:13,  3.69it/s]
100%|█████████▉| 369872/371472 [7:16:04<07:28,  3.57it/s]
100%|█████████▉| 369873/371472 [7:16:04<07:14,  3.68it/s]
100%|█████████▉| 369874/371472 [7:16:04<08:02,  3.31it/s]
100%|█████████▉| 369875/371472 [7:16:05<07:52,  3.38it/s]
100%|█████████▉| 369876/371472 [7:16:05<07:54,  3.37it/s]
100%|█████████▉| 369877/371472 [7:16:05<08:12,  3.24it/s]
100%|█████████▉| 369878/371472 [7:16:05<07:53,  3.36it/s]
100%|█████████▉| 369879/371472 [7:16:06<07:23,  3.59it/s]
100%|█████████▉| 369880/371472 [7:16:06<07:16,  3.65it/s]
                                                         
{'loss': 2.6763, 'learning_rate': 1.0385916524811998e-07, 'epoch': 15.93}

100%|█████████▉| 369880/371472 [7:16:06<07:16,  3.65it/s]
100%|█████████▉| 369881/371472 [7:16:06<07:25,  3.57it/s]
100%|█████████▉| 369882/371472 [7:16:06<07:07,  3.72it/s]
100%|█████████▉| 369883/371472 [7:16:07<07:40,  3.45it/s]
100%|█████████▉| 369884/371472 [7:16:07<07:27,  3.55it/s]
100%|█████████▉| 369885/371472 [7:16:07<08:05,  3.27it/s]
100%|█████████▉| 369886/371472 [7:16:08<07:38,  3.46it/s]
100%|█████████▉| 369887/371472 [7:16:08<07:29,  3.52it/s]
100%|█████████▉| 369888/371472 [7:16:08<07:17,  3.62it/s]
100%|█████████▉| 369889/371472 [7:16:08<07:09,  3.68it/s]
100%|█████████▉| 369890/371472 [7:16:09<07:42,  3.42it/s]
100%|█████████▉| 369891/371472 [7:16:09<07:32,  3.49it/s]
100%|█████████▉| 369892/371472 [7:16:09<07:19,  3.60it/s]
100%|█████████▉| 369893/371472 [7:16:10<07:34,  3.47it/s]
100%|█████████▉| 369894/371472 [7:16:10<07:22,  3.57it/s]
100%|█████████▉| 369895/371472 [7:16:10<07:44,  3.39it/s]
100%|█████████▉| 369896/371472 [7:16:11<07:26,  3.53it/s]
100%|█████████▉| 369897/371472 [7:16:11<07:26,  3.53it/s]
100%|█████████▉| 369898/371472 [7:16:11<07:20,  3.57it/s]
100%|█████████▉| 369899/371472 [7:16:11<07:20,  3.57it/s]
100%|█████████▉| 369900/371472 [7:16:12<07:08,  3.67it/s]
                                                         
{'loss': 2.7512, 'learning_rate': 1.0381068327264104e-07, 'epoch': 15.93}

100%|█████████▉| 369900/371472 [7:16:12<07:08,  3.67it/s]
100%|█████████▉| 369901/371472 [7:16:12<06:55,  3.78it/s]
100%|█████████▉| 369902/371472 [7:16:12<06:55,  3.78it/s]
100%|█████████▉| 369903/371472 [7:16:12<06:57,  3.76it/s]
100%|█████████▉| 369904/371472 [7:16:13<07:03,  3.70it/s]
100%|█████████▉| 369905/371472 [7:16:13<07:03,  3.70it/s]
100%|█████████▉| 369906/371472 [7:16:13<07:03,  3.70it/s]
100%|█████████▉| 369907/371472 [7:16:13<06:50,  3.81it/s]
100%|█████████▉| 369908/371472 [7:16:14<07:11,  3.62it/s]
100%|█████████▉| 369909/371472 [7:16:14<06:55,  3.76it/s]
100%|█████████▉| 369910/371472 [7:16:14<06:53,  3.78it/s]
100%|█████████▉| 369911/371472 [7:16:15<06:55,  3.76it/s]
100%|█████████▉| 369912/371472 [7:16:15<06:52,  3.78it/s]
100%|█████████▉| 369913/371472 [7:16:15<06:59,  3.72it/s]
100%|█████████▉| 369914/371472 [7:16:15<07:12,  3.60it/s]
100%|█████████▉| 369915/371472 [7:16:16<07:13,  3.59it/s]
100%|█████████▉| 369916/371472 [7:16:16<06:57,  3.73it/s]
100%|█████████▉| 369917/371472 [7:16:16<07:17,  3.56it/s]
100%|█████████▉| 369918/371472 [7:16:16<07:08,  3.63it/s]
100%|█████████▉| 369919/371472 [7:16:17<07:08,  3.62it/s]
100%|█████████▉| 369920/371472 [7:16:17<07:36,  3.40it/s]
                                                         
{'loss': 2.5968, 'learning_rate': 1.037622012971622e-07, 'epoch': 15.93}

100%|█████████▉| 369920/371472 [7:16:17<07:36,  3.40it/s]
100%|█████████▉| 369921/371472 [7:16:17<08:12,  3.15it/s]
100%|█████████▉| 369922/371472 [7:16:18<08:03,  3.21it/s]
100%|█████████▉| 369923/371472 [7:16:18<07:32,  3.43it/s]
100%|█████████▉| 369924/371472 [7:16:18<07:11,  3.58it/s]
100%|█████████▉| 369925/371472 [7:16:19<07:14,  3.56it/s]
100%|█████████▉| 369926/371472 [7:16:19<07:14,  3.55it/s]
100%|█████████▉| 369927/371472 [7:16:19<06:56,  3.71it/s]
100%|█████████▉| 369928/371472 [7:16:19<07:22,  3.49it/s]
100%|█████████▉| 369929/371472 [7:16:20<07:28,  3.44it/s]
100%|█████████▉| 369930/371472 [7:16:20<07:56,  3.23it/s]
100%|█████████▉| 369931/371472 [7:16:20<07:52,  3.26it/s]
100%|█████████▉| 369932/371472 [7:16:21<07:44,  3.32it/s]
100%|█████████▉| 369933/371472 [7:16:21<07:34,  3.39it/s]
100%|█████████▉| 369934/371472 [7:16:21<07:20,  3.49it/s]
100%|█████████▉| 369935/371472 [7:16:21<07:21,  3.48it/s]
100%|█████████▉| 369936/371472 [7:16:22<07:16,  3.52it/s]
100%|█████████▉| 369937/371472 [7:16:22<07:09,  3.57it/s]
100%|█████████▉| 369938/371472 [7:16:22<07:10,  3.56it/s]
100%|█████████▉| 369939/371472 [7:16:23<08:17,  3.08it/s]
100%|█████████▉| 369940/371472 [7:16:23<08:00,  3.19it/s]
                                                         
{'loss': 2.6362, 'learning_rate': 1.0371371932168326e-07, 'epoch': 15.93}

100%|█████████▉| 369940/371472 [7:16:23<08:00,  3.19it/s]
100%|█████████▉| 369941/371472 [7:16:23<08:00,  3.18it/s]
100%|█████████▉| 369942/371472 [7:16:24<07:38,  3.34it/s]
100%|█████████▉| 369943/371472 [7:16:24<07:10,  3.55it/s]
100%|█████████▉| 369944/371472 [7:16:24<07:03,  3.61it/s]
100%|█████████▉| 369945/371472 [7:16:24<06:51,  3.71it/s]
100%|█████████▉| 369946/371472 [7:16:25<06:39,  3.82it/s]
100%|█████████▉| 369947/371472 [7:16:25<06:54,  3.68it/s]
100%|█████████▉| 369948/371472 [7:16:25<07:00,  3.62it/s]
100%|█████████▉| 369949/371472 [7:16:25<07:13,  3.52it/s]
100%|█████████▉| 369950/371472 [7:16:26<07:03,  3.60it/s]
100%|█████████▉| 369951/371472 [7:16:26<06:51,  3.70it/s]
100%|█████████▉| 369952/371472 [7:16:26<06:54,  3.67it/s]
100%|█████████▉| 369953/371472 [7:16:27<07:01,  3.61it/s]
100%|█████████▉| 369954/371472 [7:16:27<06:56,  3.65it/s]
100%|█████████▉| 369955/371472 [7:16:27<07:22,  3.43it/s]
100%|█████████▉| 369956/371472 [7:16:28<07:59,  3.16it/s]
100%|█████████▉| 369957/371472 [7:16:28<07:46,  3.25it/s]
100%|█████████▉| 369958/371472 [7:16:28<07:35,  3.32it/s]
100%|█████████▉| 369959/371472 [7:16:28<07:18,  3.45it/s]
100%|█████████▉| 369960/371472 [7:16:29<07:13,  3.49it/s]
                                                         
{'loss': 2.6194, 'learning_rate': 1.0366523734620441e-07, 'epoch': 15.93}

100%|█████████▉| 369960/371472 [7:16:29<07:13,  3.49it/s]
100%|█████████▉| 369961/371472 [7:16:29<07:18,  3.44it/s]
100%|█████████▉| 369962/371472 [7:16:29<07:27,  3.37it/s]
100%|█████████▉| 369963/371472 [7:16:30<07:12,  3.49it/s]
100%|█████████▉| 369964/371472 [7:16:30<07:03,  3.57it/s]
100%|█████████▉| 369965/371472 [7:16:30<07:01,  3.58it/s]
100%|█████████▉| 369966/371472 [7:16:30<06:55,  3.62it/s]
100%|█████████▉| 369967/371472 [7:16:31<07:02,  3.57it/s]
100%|█████████▉| 369968/371472 [7:16:31<06:56,  3.61it/s]
100%|█████████▉| 369969/371472 [7:16:31<06:54,  3.62it/s]
100%|█████████▉| 369970/371472 [7:16:31<06:57,  3.60it/s]
100%|█████████▉| 369971/371472 [7:16:32<06:50,  3.65it/s]
100%|█████████▉| 369972/371472 [7:16:32<06:45,  3.70it/s]
100%|█████████▉| 369973/371472 [7:16:32<06:58,  3.58it/s]
100%|█████████▉| 369974/371472 [7:16:33<06:57,  3.59it/s]
100%|█████████▉| 369975/371472 [7:16:33<06:54,  3.61it/s]
100%|█████████▉| 369976/371472 [7:16:33<06:42,  3.72it/s]
100%|█████████▉| 369977/371472 [7:16:33<07:31,  3.31it/s]
100%|█████████▉| 369978/371472 [7:16:34<07:08,  3.49it/s]
100%|█████████▉| 369979/371472 [7:16:34<06:57,  3.57it/s]
100%|█████████▉| 369980/371472 [7:16:34<07:20,  3.39it/s]
                                                         
{'loss': 2.6984, 'learning_rate': 1.0361675537072547e-07, 'epoch': 15.94}

100%|█████████▉| 369980/371472 [7:16:34<07:20,  3.39it/s]
100%|█████████▉| 369981/371472 [7:16:35<07:25,  3.35it/s]
100%|█████████▉| 369982/371472 [7:16:35<07:27,  3.33it/s]
100%|█████████▉| 369983/371472 [7:16:35<07:17,  3.40it/s]
100%|█████████▉| 369984/371472 [7:16:35<07:29,  3.31it/s]
100%|█████████▉| 369985/371472 [7:16:36<07:18,  3.39it/s]
100%|█████████▉| 369986/371472 [7:16:36<08:10,  3.03it/s]
100%|█████████▉| 369987/371472 [7:16:36<07:56,  3.12it/s]
100%|█████████▉| 369988/371472 [7:16:37<07:28,  3.31it/s]
100%|█████████▉| 369989/371472 [7:16:37<07:19,  3.38it/s]
100%|█████████▉| 369990/371472 [7:16:37<07:05,  3.48it/s]
100%|█████████▉| 369991/371472 [7:16:38<07:10,  3.44it/s]
100%|█████████▉| 369992/371472 [7:16:38<07:10,  3.44it/s]
100%|█████████▉| 369993/371472 [7:16:38<07:06,  3.47it/s]
100%|█████████▉| 369994/371472 [7:16:38<07:16,  3.39it/s]
100%|█████████▉| 369995/371472 [7:16:39<07:12,  3.41it/s]
100%|█████████▉| 369996/371472 [7:16:39<07:03,  3.49it/s]
100%|█████████▉| 369997/371472 [7:16:39<07:04,  3.47it/s]
100%|█████████▉| 369998/371472 [7:16:40<06:46,  3.62it/s]
100%|█████████▉| 369999/371472 [7:16:40<06:31,  3.76it/s]
100%|█████████▉| 370000/371472 [7:16:40<06:35,  3.72it/s]
                                                         
{'loss': 2.5292, 'learning_rate': 1.0356827339524663e-07, 'epoch': 15.94}

100%|█████████▉| 370000/371472 [7:16:40<06:35,  3.72it/s]
100%|█████████▉| 370001/371472 [7:16:40<06:47,  3.61it/s]
100%|█████████▉| 370002/371472 [7:16:41<07:36,  3.22it/s]
100%|█████████▉| 370003/371472 [7:16:41<07:14,  3.38it/s]
100%|█████████▉| 370004/371472 [7:16:41<06:54,  3.54it/s]
100%|█████████▉| 370005/371472 [7:16:42<06:37,  3.69it/s]
100%|█████████▉| 370006/371472 [7:16:42<06:36,  3.69it/s]
100%|█████████▉| 370007/371472 [7:16:42<06:32,  3.74it/s]
100%|█████████▉| 370008/371472 [7:16:42<06:36,  3.70it/s]
100%|█████████▉| 370009/371472 [7:16:43<06:23,  3.82it/s]
100%|█████████▉| 370010/371472 [7:16:43<06:20,  3.84it/s]
100%|█████████▉| 370011/371472 [7:16:43<06:42,  3.63it/s]
100%|█████████▉| 370012/371472 [7:16:43<06:39,  3.66it/s]
100%|█████████▉| 370013/371472 [7:16:44<06:37,  3.67it/s]
100%|█████████▉| 370014/371472 [7:16:44<06:30,  3.73it/s]
100%|█████████▉| 370015/371472 [7:16:44<06:30,  3.73it/s]
100%|█████████▉| 370016/371472 [7:16:44<06:28,  3.74it/s]
100%|█████████▉| 370017/371472 [7:16:45<06:30,  3.73it/s]
100%|█████████▉| 370018/371472 [7:16:45<07:00,  3.46it/s]
100%|█████████▉| 370019/371472 [7:16:45<07:11,  3.37it/s]
100%|█████████▉| 370020/371472 [7:16:46<07:06,  3.40it/s]
                                                         
{'loss': 2.7151, 'learning_rate': 1.0351979141976769e-07, 'epoch': 15.94}

100%|█████████▉| 370020/371472 [7:16:46<07:06,  3.40it/s]
100%|█████████▉| 370021/371472 [7:16:46<07:17,  3.32it/s]
100%|█████████▉| 370022/371472 [7:16:46<07:08,  3.38it/s]
100%|█████████▉| 370023/371472 [7:16:47<07:11,  3.36it/s]
100%|█████████▉| 370024/371472 [7:16:47<06:47,  3.55it/s]
100%|█████████▉| 370025/371472 [7:16:47<06:37,  3.64it/s]
100%|█████████▉| 370026/371472 [7:16:47<07:08,  3.37it/s]
100%|█████████▉| 370027/371472 [7:16:48<06:40,  3.60it/s]
100%|█████████▉| 370028/371472 [7:16:48<06:23,  3.77it/s]
100%|█████████▉| 370029/371472 [7:16:48<06:23,  3.77it/s]
100%|█████████▉| 370030/371472 [7:16:48<06:25,  3.74it/s]
100%|█████████▉| 370031/371472 [7:16:49<06:22,  3.76it/s]
100%|█████████▉| 370032/371472 [7:16:49<06:45,  3.55it/s]
100%|█████████▉| 370033/371472 [7:16:49<06:57,  3.45it/s]
100%|█████████▉| 370034/371472 [7:16:50<07:06,  3.37it/s]
100%|█████████▉| 370035/371472 [7:16:50<06:44,  3.55it/s]
100%|█████████▉| 370036/371472 [7:16:50<07:03,  3.39it/s]
100%|█████████▉| 370037/371472 [7:16:51<06:53,  3.47it/s]
100%|█████████▉| 370038/371472 [7:16:51<06:44,  3.54it/s]
100%|█████████▉| 370039/371472 [7:16:51<06:33,  3.64it/s]
100%|█████████▉| 370040/371472 [7:16:51<06:32,  3.65it/s]
                                                         
{'loss': 2.5154, 'learning_rate': 1.0347130944428883e-07, 'epoch': 15.94}

100%|█████████▉| 370040/371472 [7:16:51<06:32,  3.65it/s]
100%|█████████▉| 370041/371472 [7:16:52<06:35,  3.62it/s]
100%|█████████▉| 370042/371472 [7:16:52<06:41,  3.56it/s]
100%|█████████▉| 370043/371472 [7:16:52<08:31,  2.79it/s]
100%|█████████▉| 370044/371472 [7:16:53<07:46,  3.06it/s]
100%|█████████▉| 370045/371472 [7:16:53<07:39,  3.10it/s]
100%|█████████▉| 370046/371472 [7:16:53<07:09,  3.32it/s]
100%|█████████▉| 370047/371472 [7:16:53<06:53,  3.45it/s]
100%|█████████▉| 370048/371472 [7:16:54<06:37,  3.58it/s]
100%|█████████▉| 370049/371472 [7:16:54<06:51,  3.45it/s]
100%|█████████▉| 370050/371472 [7:16:54<07:03,  3.36it/s]
100%|█████████▉| 370051/371472 [7:16:55<06:49,  3.47it/s]
100%|█████████▉| 370052/371472 [7:16:55<07:20,  3.22it/s]
100%|█████████▉| 370053/371472 [7:16:55<07:00,  3.38it/s]
100%|█████████▉| 370054/371472 [7:16:56<07:06,  3.32it/s]
100%|█████████▉| 370055/371472 [7:16:56<06:51,  3.44it/s]
100%|█████████▉| 370056/371472 [7:16:56<06:41,  3.52it/s]
100%|█████████▉| 370057/371472 [7:16:56<07:00,  3.37it/s]
100%|█████████▉| 370058/371472 [7:16:57<06:40,  3.53it/s]
100%|█████████▉| 370059/371472 [7:16:57<06:30,  3.62it/s]
100%|█████████▉| 370060/371472 [7:16:57<06:24,  3.67it/s]
                                                         
{'loss': 2.5904, 'learning_rate': 1.034228274688099e-07, 'epoch': 15.94}

100%|█████████▉| 370060/371472 [7:16:57<06:24,  3.67it/s]
100%|█████████▉| 370061/371472 [7:16:58<06:29,  3.63it/s]
100%|█████████▉| 370062/371472 [7:16:58<06:16,  3.75it/s]
100%|█████████▉| 370063/371472 [7:16:58<06:19,  3.71it/s]
100%|█████████▉| 370064/371472 [7:16:58<06:16,  3.74it/s]
100%|█████████▉| 370065/371472 [7:16:59<06:17,  3.73it/s]
100%|█████████▉| 370066/371472 [7:16:59<06:14,  3.75it/s]
100%|█████████▉| 370067/371472 [7:16:59<06:10,  3.79it/s]
100%|█████████▉| 370068/371472 [7:16:59<06:20,  3.69it/s]
100%|█████████▉| 370069/371472 [7:17:00<06:29,  3.60it/s]
100%|█████████▉| 370070/371472 [7:17:00<06:17,  3.71it/s]
100%|█████████▉| 370071/371472 [7:17:00<06:30,  3.59it/s]
100%|█████████▉| 370072/371472 [7:17:00<06:28,  3.60it/s]
100%|█████████▉| 370073/371472 [7:17:01<06:22,  3.66it/s]
100%|█████████▉| 370074/371472 [7:17:01<06:25,  3.62it/s]
100%|█████████▉| 370075/371472 [7:17:01<06:26,  3.62it/s]
100%|█████████▉| 370076/371472 [7:17:02<06:53,  3.37it/s]
100%|█████████▉| 370077/371472 [7:17:02<06:45,  3.44it/s]
100%|█████████▉| 370078/371472 [7:17:02<06:34,  3.54it/s]
100%|█████████▉| 370079/371472 [7:17:02<06:32,  3.55it/s]
100%|█████████▉| 370080/371472 [7:17:03<06:51,  3.38it/s]
                                                         
{'loss': 2.6093, 'learning_rate': 1.0337434549333106e-07, 'epoch': 15.94}

100%|█████████▉| 370080/371472 [7:17:03<06:51,  3.38it/s]
100%|█████████▉| 370081/371472 [7:17:03<06:25,  3.61it/s]
100%|█████████▉| 370082/371472 [7:17:03<06:30,  3.56it/s]
100%|█████████▉| 370083/371472 [7:17:04<06:39,  3.48it/s]
100%|█████████▉| 370084/371472 [7:17:04<06:24,  3.61it/s]
100%|█████████▉| 370085/371472 [7:17:04<07:04,  3.26it/s]
100%|█████████▉| 370086/371472 [7:17:05<07:21,  3.14it/s]
100%|█████████▉| 370087/371472 [7:17:05<06:56,  3.32it/s]
100%|█████████▉| 370088/371472 [7:17:05<07:24,  3.12it/s]
100%|█████████▉| 370089/371472 [7:17:05<07:02,  3.27it/s]
100%|█████████▉| 370090/371472 [7:17:06<06:48,  3.38it/s]
100%|█████████▉| 370091/371472 [7:17:06<06:40,  3.45it/s]
100%|█████████▉| 370092/371472 [7:17:06<06:52,  3.35it/s]
100%|█████████▉| 370093/371472 [7:17:07<06:46,  3.39it/s]
100%|█████████▉| 370094/371472 [7:17:07<06:43,  3.42it/s]
100%|█████████▉| 370095/371472 [7:17:07<06:30,  3.53it/s]
100%|█████████▉| 370096/371472 [7:17:07<06:27,  3.55it/s]
100%|█████████▉| 370097/371472 [7:17:08<06:38,  3.45it/s]
100%|█████████▉| 370098/371472 [7:17:08<06:26,  3.55it/s]
100%|█████████▉| 370099/371472 [7:17:08<06:38,  3.45it/s]
100%|█████████▉| 370100/371472 [7:17:09<06:24,  3.57it/s]
                                                         
{'loss': 2.531, 'learning_rate': 1.0332586351785212e-07, 'epoch': 15.94}

100%|█████████▉| 370100/371472 [7:17:09<06:24,  3.57it/s]
100%|█████████▉| 370101/371472 [7:17:09<06:15,  3.65it/s]
100%|█████████▉| 370102/371472 [7:17:09<06:05,  3.75it/s]
100%|█████████▉| 370103/371472 [7:17:09<06:04,  3.75it/s]
100%|█████████▉| 370104/371472 [7:17:10<06:04,  3.75it/s]
100%|█████████▉| 370105/371472 [7:17:10<06:11,  3.68it/s]
100%|█████████▉| 370106/371472 [7:17:10<06:27,  3.53it/s]
100%|█████████▉| 370107/371472 [7:17:11<06:26,  3.53it/s]
100%|█████████▉| 370108/371472 [7:17:11<06:18,  3.60it/s]
100%|█████████▉| 370109/371472 [7:17:11<06:22,  3.56it/s]
100%|█████████▉| 370110/371472 [7:17:11<06:23,  3.55it/s]
100%|█████████▉| 370111/371472 [7:17:12<06:31,  3.48it/s]
100%|█████████▉| 370112/371472 [7:17:12<06:35,  3.44it/s]
100%|█████████▉| 370113/371472 [7:17:12<06:13,  3.63it/s]
100%|█████████▉| 370114/371472 [7:17:12<06:02,  3.74it/s]
100%|█████████▉| 370115/371472 [7:17:13<06:03,  3.73it/s]
100%|█████████▉| 370116/371472 [7:17:13<05:52,  3.85it/s]
100%|█████████▉| 370117/371472 [7:17:13<06:01,  3.74it/s]
100%|█████████▉| 370118/371472 [7:17:14<06:13,  3.63it/s]
100%|█████████▉| 370119/371472 [7:17:14<06:03,  3.72it/s]
100%|█████████▉| 370120/371472 [7:17:14<06:36,  3.41it/s]
                                                         
{'loss': 2.5033, 'learning_rate': 1.0327738154237327e-07, 'epoch': 15.94}

100%|█████████▉| 370120/371472 [7:17:14<06:36,  3.41it/s]
100%|█████████▉| 370121/371472 [7:17:14<06:24,  3.51it/s]
100%|█████████▉| 370122/371472 [7:17:15<08:05,  2.78it/s]
100%|█████████▉| 370123/371472 [7:17:15<07:12,  3.12it/s]
100%|█████████▉| 370124/371472 [7:17:15<06:39,  3.37it/s]
100%|█████████▉| 370125/371472 [7:17:16<06:27,  3.48it/s]
100%|█████████▉| 370126/371472 [7:17:16<06:29,  3.45it/s]
100%|█████████▉| 370127/371472 [7:17:16<06:21,  3.53it/s]
100%|█████████▉| 370128/371472 [7:17:17<06:24,  3.49it/s]
100%|█████████▉| 370129/371472 [7:17:17<06:29,  3.45it/s]
100%|█████████▉| 370130/371472 [7:17:17<06:50,  3.27it/s]
100%|█████████▉| 370131/371472 [7:17:17<06:39,  3.35it/s]
100%|█████████▉| 370132/371472 [7:17:18<06:51,  3.26it/s]
100%|█████████▉| 370133/371472 [7:17:18<06:37,  3.37it/s]
100%|█████████▉| 370134/371472 [7:17:18<06:35,  3.38it/s]
100%|█████████▉| 370135/371472 [7:17:19<06:19,  3.52it/s]
100%|█████████▉| 370136/371472 [7:17:19<06:21,  3.50it/s]
100%|█████████▉| 370137/371472 [7:17:19<06:16,  3.55it/s]
100%|█████████▉| 370138/371472 [7:17:19<06:04,  3.66it/s]
100%|█████████▉| 370139/371472 [7:17:20<06:08,  3.61it/s]
100%|█████████▉| 370140/371472 [7:17:20<06:03,  3.66it/s]
                                                         
{'loss': 2.5202, 'learning_rate': 1.0322889956689433e-07, 'epoch': 15.94}

100%|█████████▉| 370140/371472 [7:17:20<06:03,  3.66it/s]
100%|█████████▉| 370141/371472 [7:17:20<06:06,  3.63it/s]
100%|█████████▉| 370142/371472 [7:17:21<06:06,  3.63it/s]
100%|█████████▉| 370143/371472 [7:17:21<06:04,  3.64it/s]
100%|█████████▉| 370144/371472 [7:17:21<05:52,  3.77it/s]
100%|█████████▉| 370145/371472 [7:17:21<06:02,  3.66it/s]
100%|█████████▉| 370146/371472 [7:17:22<06:33,  3.37it/s]
100%|█████████▉| 370147/371472 [7:17:22<07:05,  3.11it/s]
100%|█████████▉| 370148/371472 [7:17:22<06:48,  3.24it/s]
100%|█████████▉| 370149/371472 [7:17:23<06:33,  3.36it/s]
100%|█████████▉| 370150/371472 [7:17:23<06:49,  3.23it/s]
100%|█████████▉| 370151/371472 [7:17:23<06:33,  3.35it/s]
100%|█████████▉| 370152/371472 [7:17:24<06:26,  3.41it/s]
100%|█████████▉| 370153/371472 [7:17:24<06:38,  3.31it/s]
100%|█████████▉| 370154/371472 [7:17:24<07:09,  3.07it/s]
100%|█████████▉| 370155/371472 [7:17:24<06:49,  3.22it/s]
100%|█████████▉| 370156/371472 [7:17:25<06:33,  3.35it/s]
100%|█████████▉| 370157/371472 [7:17:25<06:29,  3.38it/s]
100%|█████████▉| 370158/371472 [7:17:25<06:55,  3.16it/s]
100%|█████████▉| 370159/371472 [7:17:26<07:07,  3.07it/s]
100%|█████████▉| 370160/371472 [7:17:26<07:14,  3.02it/s]
                                                         
{'loss': 2.6734, 'learning_rate': 1.031804175914155e-07, 'epoch': 15.94}

100%|█████████▉| 370160/371472 [7:17:26<07:14,  3.02it/s]
100%|█████████▉| 370161/371472 [7:17:26<07:18,  2.99it/s]
100%|█████████▉| 370162/371472 [7:17:27<07:05,  3.08it/s]
100%|█████████▉| 370163/371472 [7:17:27<06:37,  3.30it/s]
100%|█████████▉| 370164/371472 [7:17:27<06:18,  3.45it/s]
100%|█████████▉| 370165/371472 [7:17:28<06:01,  3.61it/s]
100%|█████████▉| 370166/371472 [7:17:28<05:52,  3.70it/s]
100%|█████████▉| 370167/371472 [7:17:28<05:38,  3.85it/s]
100%|█████████▉| 370168/371472 [7:17:28<05:57,  3.65it/s]
100%|█████████▉| 370169/371472 [7:17:29<05:51,  3.71it/s]
100%|█████████▉| 370170/371472 [7:17:29<05:57,  3.64it/s]
100%|█████████▉| 370171/371472 [7:17:29<06:16,  3.45it/s]
100%|█████████▉| 370172/371472 [7:17:29<06:22,  3.40it/s]
100%|█████████▉| 370173/371472 [7:17:30<06:31,  3.32it/s]
100%|█████████▉| 370174/371472 [7:17:30<06:52,  3.14it/s]
100%|█████████▉| 370175/371472 [7:17:30<06:42,  3.22it/s]
100%|█████████▉| 370176/371472 [7:17:31<06:31,  3.31it/s]
100%|█████████▉| 370177/371472 [7:17:31<06:12,  3.48it/s]
100%|█████████▉| 370178/371472 [7:17:31<06:15,  3.45it/s]
100%|█████████▉| 370179/371472 [7:17:32<06:29,  3.32it/s]
100%|█████████▉| 370180/371472 [7:17:32<06:15,  3.44it/s]
                                                         
{'loss': 2.4675, 'learning_rate': 1.0313193561593655e-07, 'epoch': 15.94}

100%|█████████▉| 370180/371472 [7:17:32<06:15,  3.44it/s]
100%|█████████▉| 370181/371472 [7:17:32<06:03,  3.55it/s]
100%|█████████▉| 370182/371472 [7:17:32<05:52,  3.66it/s]
100%|█████████▉| 370183/371472 [7:17:33<05:53,  3.64it/s]
100%|█████████▉| 370184/371472 [7:17:33<05:44,  3.74it/s]
100%|█████████▉| 370185/371472 [7:17:33<05:36,  3.83it/s]
100%|█████████▉| 370186/371472 [7:17:33<05:53,  3.64it/s]
100%|█████████▉| 370187/371472 [7:17:34<05:55,  3.61it/s]
100%|█████████▉| 370188/371472 [7:17:34<05:46,  3.70it/s]
100%|█████████▉| 370189/371472 [7:17:34<05:37,  3.80it/s]
100%|█████████▉| 370190/371472 [7:17:35<05:38,  3.79it/s]
100%|█████████▉| 370191/371472 [7:17:35<06:11,  3.45it/s]
100%|█████████▉| 370192/371472 [7:17:35<06:15,  3.41it/s]
100%|█████████▉| 370193/371472 [7:17:35<06:04,  3.50it/s]
100%|█████████▉| 370194/371472 [7:17:36<07:06,  3.00it/s]
100%|█████████▉| 370195/371472 [7:17:36<06:57,  3.06it/s]
100%|█████████▉| 370196/371472 [7:17:36<06:24,  3.32it/s]
100%|█████████▉| 370197/371472 [7:17:37<06:02,  3.52it/s]
100%|█████████▉| 370198/371472 [7:17:37<05:55,  3.58it/s]
100%|█████████▉| 370199/371472 [7:17:37<05:53,  3.60it/s]
100%|█████████▉| 370200/371472 [7:17:38<05:52,  3.61it/s]
                                                         
{'loss': 2.4743, 'learning_rate': 1.030834536404577e-07, 'epoch': 15.95}

100%|█████████▉| 370200/371472 [7:17:38<05:52,  3.61it/s]
100%|█████████▉| 370201/371472 [7:17:38<06:04,  3.49it/s]
100%|█████████▉| 370202/371472 [7:17:38<06:10,  3.43it/s]
100%|█████████▉| 370203/371472 [7:17:38<06:15,  3.38it/s]
100%|█████████▉| 370204/371472 [7:17:39<06:14,  3.38it/s]
100%|█████████▉| 370205/371472 [7:17:39<06:13,  3.39it/s]
100%|█████████▉| 370206/371472 [7:17:39<06:03,  3.49it/s]
100%|█████████▉| 370207/371472 [7:17:40<05:57,  3.54it/s]
100%|█████████▉| 370208/371472 [7:17:40<05:44,  3.67it/s]
100%|█████████▉| 370209/371472 [7:17:40<05:44,  3.66it/s]
100%|█████████▉| 370210/371472 [7:17:40<06:01,  3.49it/s]
100%|█████████▉| 370211/371472 [7:17:41<05:53,  3.57it/s]
100%|█████████▉| 370212/371472 [7:17:41<05:43,  3.67it/s]
100%|█████████▉| 370213/371472 [7:17:41<06:04,  3.46it/s]
100%|█████████▉| 370214/371472 [7:17:42<05:56,  3.53it/s]
100%|█████████▉| 370215/371472 [7:17:42<05:47,  3.61it/s]
100%|█████████▉| 370216/371472 [7:17:42<05:52,  3.56it/s]
100%|█████████▉| 370217/371472 [7:17:42<06:28,  3.23it/s]
100%|█████████▉| 370218/371472 [7:17:43<06:07,  3.41it/s]
100%|█████████▉| 370219/371472 [7:17:43<05:47,  3.60it/s]
100%|█████████▉| 370220/371472 [7:17:43<05:39,  3.69it/s]
                                                         
{'loss': 2.5568, 'learning_rate': 1.0303497166497876e-07, 'epoch': 15.95}

100%|█████████▉| 370220/371472 [7:17:43<05:39,  3.69it/s]
100%|█████████▉| 370221/371472 [7:17:44<06:04,  3.43it/s]
100%|█████████▉| 370222/371472 [7:17:44<06:07,  3.40it/s]
100%|█████████▉| 370223/371472 [7:17:44<05:52,  3.54it/s]
100%|█████████▉| 370224/371472 [7:17:44<05:58,  3.48it/s]
100%|█████████▉| 370225/371472 [7:17:45<05:58,  3.48it/s]
100%|█████████▉| 370226/371472 [7:17:45<05:59,  3.47it/s]
100%|█████████▉| 370227/371472 [7:17:45<06:04,  3.42it/s]
100%|█████████▉| 370228/371472 [7:17:46<05:59,  3.46it/s]
100%|█████████▉| 370229/371472 [7:17:46<05:46,  3.59it/s]
100%|█████████▉| 370230/371472 [7:17:46<06:20,  3.26it/s]
100%|█████████▉| 370231/371472 [7:17:46<06:24,  3.22it/s]
100%|█████████▉| 370232/371472 [7:17:47<06:19,  3.27it/s]
100%|█████████▉| 370233/371472 [7:17:47<06:19,  3.27it/s]
100%|█████████▉| 370234/371472 [7:17:47<06:08,  3.36it/s]
100%|█████████▉| 370235/371472 [7:17:48<06:00,  3.43it/s]
100%|█████████▉| 370236/371472 [7:17:48<06:01,  3.42it/s]
100%|█████████▉| 370237/371472 [7:17:48<05:54,  3.48it/s]
100%|█████████▉| 370238/371472 [7:17:49<06:19,  3.25it/s]
100%|█████████▉| 370239/371472 [7:17:49<06:10,  3.33it/s]
100%|█████████▉| 370240/371472 [7:17:49<05:59,  3.42it/s]
                                                         
{'loss': 2.5494, 'learning_rate': 1.0298648968949993e-07, 'epoch': 15.95}

100%|█████████▉| 370240/371472 [7:17:49<05:59,  3.42it/s]
100%|█████████▉| 370241/371472 [7:17:49<05:54,  3.47it/s]
100%|█████████▉| 370242/371472 [7:17:50<05:47,  3.54it/s]
100%|█████████▉| 370243/371472 [7:17:50<05:42,  3.59it/s]
100%|█████████▉| 370244/371472 [7:17:50<05:30,  3.71it/s]
100%|█████████▉| 370245/371472 [7:17:50<05:19,  3.84it/s]
100%|█████████▉| 370246/371472 [7:17:51<05:25,  3.76it/s]
100%|█████████▉| 370247/371472 [7:17:51<05:32,  3.69it/s]
100%|█████████▉| 370248/371472 [7:17:51<05:39,  3.61it/s]
100%|█████████▉| 370249/371472 [7:17:52<05:32,  3.68it/s]
100%|█████████▉| 370250/371472 [7:17:52<05:35,  3.64it/s]
100%|█████████▉| 370251/371472 [7:17:52<05:43,  3.56it/s]
100%|█████████▉| 370252/371472 [7:17:52<05:38,  3.61it/s]
100%|█████████▉| 370253/371472 [7:17:53<05:31,  3.67it/s]
100%|█████████▉| 370254/371472 [7:17:53<05:25,  3.74it/s]
100%|█████████▉| 370255/371472 [7:17:53<05:15,  3.85it/s]
100%|█████████▉| 370256/371472 [7:17:53<05:26,  3.72it/s]
100%|█████████▉| 370257/371472 [7:17:54<05:33,  3.64it/s]
100%|█████████▉| 370258/371472 [7:17:54<05:23,  3.75it/s]
100%|█████████▉| 370259/371472 [7:17:54<05:39,  3.58it/s]
100%|█████████▉| 370260/371472 [7:17:55<05:55,  3.41it/s]
                                                         
{'loss': 2.5455, 'learning_rate': 1.0293800771402099e-07, 'epoch': 15.95}

100%|█████████▉| 370260/371472 [7:17:55<05:55,  3.41it/s]
100%|█████████▉| 370261/371472 [7:17:55<05:59,  3.37it/s]
100%|█████████▉| 370262/371472 [7:17:55<05:51,  3.45it/s]
100%|█████████▉| 370263/371472 [7:17:55<05:45,  3.50it/s]
100%|█████████▉| 370264/371472 [7:17:56<05:33,  3.62it/s]
100%|█████████▉| 370265/371472 [7:17:56<06:02,  3.33it/s]
100%|█████████▉| 370266/371472 [7:17:56<05:51,  3.43it/s]
100%|█████████▉| 370267/371472 [7:17:57<05:54,  3.40it/s]
100%|█████████▉| 370268/371472 [7:17:57<05:43,  3.51it/s]
100%|█████████▉| 370269/371472 [7:17:57<05:38,  3.55it/s]
100%|█████████▉| 370270/371472 [7:17:57<05:44,  3.49it/s]
100%|█████████▉| 370271/371472 [7:17:58<05:49,  3.43it/s]
100%|█████████▉| 370272/371472 [7:17:58<05:39,  3.54it/s]
100%|█████████▉| 370273/371472 [7:17:58<05:28,  3.65it/s]
100%|█████████▉| 370274/371472 [7:17:59<05:37,  3.55it/s]
100%|█████████▉| 370275/371472 [7:17:59<05:24,  3.69it/s]
100%|█████████▉| 370276/371472 [7:17:59<05:20,  3.73it/s]
100%|█████████▉| 370277/371472 [7:17:59<05:13,  3.81it/s]
100%|█████████▉| 370278/371472 [7:18:00<05:13,  3.81it/s]
100%|█████████▉| 370279/371472 [7:18:00<05:12,  3.82it/s]
100%|█████████▉| 370280/371472 [7:18:00<05:22,  3.69it/s]
                                                         
{'loss': 2.5731, 'learning_rate': 1.0288952573854214e-07, 'epoch': 15.95}

100%|█████████▉| 370280/371472 [7:18:00<05:22,  3.69it/s]
100%|█████████▉| 370281/371472 [7:18:01<05:53,  3.37it/s]
100%|█████████▉| 370282/371472 [7:18:01<05:57,  3.33it/s]
100%|█████████▉| 370283/371472 [7:18:01<06:11,  3.20it/s]
100%|█████████▉| 370284/371472 [7:18:01<05:53,  3.36it/s]
100%|█████████▉| 370285/371472 [7:18:02<05:46,  3.42it/s]
100%|█████████▉| 370286/371472 [7:18:02<05:36,  3.53it/s]
100%|█████████▉| 370287/371472 [7:18:02<05:32,  3.56it/s]
100%|█████████▉| 370288/371472 [7:18:03<05:25,  3.63it/s]
100%|█████████▉| 370289/371472 [7:18:03<05:17,  3.72it/s]
100%|█████████▉| 370290/371472 [7:18:03<05:34,  3.53it/s]
100%|█████████▉| 370291/371472 [7:18:03<05:27,  3.61it/s]
100%|█████████▉| 370292/371472 [7:18:04<05:30,  3.57it/s]
100%|█████████▉| 370293/371472 [7:18:04<05:48,  3.39it/s]
100%|█████████▉| 370294/371472 [7:18:04<05:37,  3.49it/s]
100%|█████████▉| 370295/371472 [7:18:05<05:30,  3.56it/s]
100%|█████████▉| 370296/371472 [7:18:05<05:25,  3.61it/s]
100%|█████████▉| 370297/371472 [7:18:05<05:24,  3.63it/s]
100%|█████████▉| 370298/371472 [7:18:05<05:30,  3.55it/s]
100%|█████████▉| 370299/371472 [7:18:06<05:27,  3.58it/s]
100%|█████████▉| 370300/371472 [7:18:06<05:40,  3.45it/s]
                                                         
{'loss': 2.4017, 'learning_rate': 1.028410437630632e-07, 'epoch': 15.95}

100%|█████████▉| 370300/371472 [7:18:06<05:40,  3.45it/s]
100%|█████████▉| 370301/371472 [7:18:06<05:39,  3.45it/s]
100%|█████████▉| 370302/371472 [7:18:06<05:24,  3.60it/s]
100%|█████████▉| 370303/371472 [7:18:07<05:15,  3.71it/s]
100%|█████████▉| 370304/371472 [7:18:07<05:15,  3.71it/s]
100%|█████████▉| 370305/371472 [7:18:07<05:04,  3.83it/s]
100%|█████████▉| 370306/371472 [7:18:07<05:05,  3.82it/s]
100%|█████████▉| 370307/371472 [7:18:08<05:06,  3.80it/s]
100%|█████████▉| 370308/371472 [7:18:08<05:02,  3.85it/s]
100%|█████████▉| 370309/371472 [7:18:08<05:13,  3.71it/s]
100%|█████████▉| 370310/371472 [7:18:09<05:14,  3.69it/s]
100%|█████████▉| 370311/371472 [7:18:09<05:16,  3.66it/s]
100%|█████████▉| 370312/371472 [7:18:09<05:13,  3.70it/s]
100%|█████████▉| 370313/371472 [7:18:09<05:11,  3.72it/s]
100%|█████████▉| 370314/371472 [7:18:10<05:08,  3.75it/s]
100%|█████████▉| 370315/371472 [7:18:10<05:00,  3.84it/s]
100%|█████████▉| 370316/371472 [7:18:10<05:05,  3.78it/s]
100%|█████████▉| 370317/371472 [7:18:10<05:11,  3.71it/s]
100%|█████████▉| 370318/371472 [7:18:11<05:11,  3.71it/s]
100%|█████████▉| 370319/371472 [7:18:11<05:16,  3.64it/s]
100%|█████████▉| 370320/371472 [7:18:11<05:28,  3.51it/s]
                                                         
{'loss': 2.6731, 'learning_rate': 1.0279256178758425e-07, 'epoch': 15.95}

100%|█████████▉| 370320/371472 [7:18:11<05:28,  3.51it/s]
100%|█████████▉| 370321/371472 [7:18:12<05:30,  3.49it/s]
100%|█████████▉| 370322/371472 [7:18:12<05:25,  3.53it/s]
100%|█████████▉| 370323/371472 [7:18:12<05:09,  3.71it/s]
100%|█████████▉| 370324/371472 [7:18:12<05:28,  3.50it/s]
100%|█████████▉| 370325/371472 [7:18:13<05:30,  3.47it/s]
100%|█████████▉| 370326/371472 [7:18:13<05:42,  3.35it/s]
100%|█████████▉| 370327/371472 [7:18:13<05:28,  3.49it/s]
100%|█████████▉| 370328/371472 [7:18:14<05:25,  3.52it/s]
100%|█████████▉| 370329/371472 [7:18:14<05:18,  3.59it/s]
100%|█████████▉| 370330/371472 [7:18:14<05:11,  3.67it/s]
100%|█████████▉| 370331/371472 [7:18:15<06:00,  3.17it/s]
100%|█████████▉| 370332/371472 [7:18:15<05:55,  3.20it/s]
100%|█████████▉| 370333/371472 [7:18:15<05:38,  3.37it/s]
100%|█████████▉| 370334/371472 [7:18:15<05:26,  3.48it/s]
100%|█████████▉| 370335/371472 [7:18:16<05:34,  3.40it/s]
100%|█████████▉| 370336/371472 [7:18:16<05:44,  3.30it/s]
100%|█████████▉| 370337/371472 [7:18:16<05:50,  3.23it/s]
100%|█████████▉| 370338/371472 [7:18:17<05:30,  3.43it/s]
100%|█████████▉| 370339/371472 [7:18:17<05:23,  3.50it/s]
100%|█████████▉| 370340/371472 [7:18:17<05:14,  3.60it/s]
                                                         
{'loss': 2.6703, 'learning_rate': 1.0274407981210542e-07, 'epoch': 15.95}

100%|█████████▉| 370340/371472 [7:18:17<05:14,  3.60it/s]
100%|█████████▉| 370341/371472 [7:18:17<05:27,  3.45it/s]
100%|█████████▉| 370342/371472 [7:18:18<05:18,  3.55it/s]
100%|█████████▉| 370343/371472 [7:18:18<05:10,  3.63it/s]
100%|█████████▉| 370344/371472 [7:18:18<05:25,  3.47it/s]
100%|█████████▉| 370345/371472 [7:18:19<05:14,  3.59it/s]
100%|█████████▉| 370346/371472 [7:18:19<05:11,  3.61it/s]
100%|█████████▉| 370347/371472 [7:18:19<05:04,  3.70it/s]
100%|█████████▉| 370348/371472 [7:18:19<05:13,  3.58it/s]
100%|█████████▉| 370349/371472 [7:18:20<05:12,  3.60it/s]
100%|█████████▉| 370350/371472 [7:18:20<05:01,  3.72it/s]
100%|█████████▉| 370351/371472 [7:18:20<04:59,  3.74it/s]
100%|█████████▉| 370352/371472 [7:18:21<05:46,  3.24it/s]
100%|█████████▉| 370353/371472 [7:18:21<05:33,  3.35it/s]
100%|█████████▉| 370354/371472 [7:18:21<05:30,  3.38it/s]
100%|█████████▉| 370355/371472 [7:18:21<05:25,  3.44it/s]
100%|█████████▉| 370356/371472 [7:18:22<05:22,  3.46it/s]
100%|█████████▉| 370357/371472 [7:18:22<05:13,  3.56it/s]
100%|█████████▉| 370358/371472 [7:18:22<05:37,  3.30it/s]
100%|█████████▉| 370359/371472 [7:18:23<05:37,  3.30it/s]
100%|█████████▉| 370360/371472 [7:18:23<05:43,  3.23it/s]
                                                         
{'loss': 2.5806, 'learning_rate': 1.0269559783662647e-07, 'epoch': 15.95}

100%|█████████▉| 370360/371472 [7:18:23<05:43,  3.23it/s]
100%|█████████▉| 370361/371472 [7:18:23<05:28,  3.38it/s]
100%|█████████▉| 370362/371472 [7:18:23<05:28,  3.38it/s]
100%|█████████▉| 370363/371472 [7:18:24<05:20,  3.47it/s]
100%|█████████▉| 370364/371472 [7:18:24<05:11,  3.55it/s]
100%|█████████▉| 370365/371472 [7:18:24<05:01,  3.68it/s]
100%|█████████▉| 370366/371472 [7:18:25<04:58,  3.70it/s]
100%|█████████▉| 370367/371472 [7:18:25<05:11,  3.55it/s]
100%|█████████▉| 370368/371472 [7:18:25<05:03,  3.63it/s]
100%|█████████▉| 370369/371472 [7:18:25<05:10,  3.55it/s]
100%|█████████▉| 370370/371472 [7:18:26<05:01,  3.66it/s]
100%|█████████▉| 370371/371472 [7:18:26<04:51,  3.78it/s]
100%|█████████▉| 370372/371472 [7:18:26<05:20,  3.44it/s]
100%|█████████▉| 370373/371472 [7:18:27<05:57,  3.08it/s]
100%|█████████▉| 370374/371472 [7:18:27<05:40,  3.22it/s]
100%|█████████▉| 370375/371472 [7:18:27<05:23,  3.39it/s]
100%|█████████▉| 370376/371472 [7:18:27<05:12,  3.51it/s]
100%|█████████▉| 370377/371472 [7:18:28<05:03,  3.61it/s]
100%|█████████▉| 370378/371472 [7:18:28<04:58,  3.67it/s]
100%|█████████▉| 370379/371472 [7:18:28<05:10,  3.52it/s]
100%|█████████▉| 370380/371472 [7:18:29<05:12,  3.49it/s]
                                                         
{'loss': 2.567, 'learning_rate': 1.0264711586114763e-07, 'epoch': 15.95}

100%|█████████▉| 370380/371472 [7:18:29<05:12,  3.49it/s]
100%|█████████▉| 370381/371472 [7:18:29<05:05,  3.57it/s]
100%|█████████▉| 370382/371472 [7:18:29<05:08,  3.53it/s]
100%|█████████▉| 370383/371472 [7:18:29<05:00,  3.63it/s]
100%|█████████▉| 370384/371472 [7:18:30<05:03,  3.59it/s]
100%|█████████▉| 370385/371472 [7:18:30<05:03,  3.58it/s]
100%|█████████▉| 370386/371472 [7:18:30<05:01,  3.60it/s]
100%|█████████▉| 370387/371472 [7:18:30<04:54,  3.68it/s]
100%|█████████▉| 370388/371472 [7:18:31<05:00,  3.61it/s]
100%|█████████▉| 370389/371472 [7:18:31<05:08,  3.51it/s]
100%|█████████▉| 370390/371472 [7:18:31<05:24,  3.33it/s]
100%|█████████▉| 370391/371472 [7:18:32<05:23,  3.35it/s]
100%|█████████▉| 370392/371472 [7:18:32<05:35,  3.22it/s]
100%|█████████▉| 370393/371472 [7:18:32<05:22,  3.35it/s]
100%|█████████▉| 370394/371472 [7:18:33<05:11,  3.46it/s]
100%|█████████▉| 370395/371472 [7:18:33<05:25,  3.31it/s]
100%|█████████▉| 370396/371472 [7:18:33<05:21,  3.35it/s]
100%|█████████▉| 370397/371472 [7:18:34<05:21,  3.34it/s]
100%|█████████▉| 370398/371472 [7:18:34<05:15,  3.40it/s]
100%|█████████▉| 370399/371472 [7:18:34<05:20,  3.34it/s]
100%|█████████▉| 370400/371472 [7:18:34<05:14,  3.41it/s]
                                                         
{'loss': 2.6239, 'learning_rate': 1.0259863388566868e-07, 'epoch': 15.95}

100%|█████████▉| 370400/371472 [7:18:34<05:14,  3.41it/s]
100%|█████████▉| 370401/371472 [7:18:35<05:05,  3.50it/s]
100%|█████████▉| 370402/371472 [7:18:35<04:58,  3.59it/s]
100%|█████████▉| 370403/371472 [7:18:35<05:02,  3.54it/s]
100%|█████████▉| 370404/371472 [7:18:35<05:08,  3.46it/s]
100%|█████████▉| 370405/371472 [7:18:36<05:01,  3.54it/s]
100%|█████████▉| 370406/371472 [7:18:36<05:11,  3.43it/s]
100%|█████████▉| 370407/371472 [7:18:36<05:08,  3.45it/s]
100%|█████████▉| 370408/371472 [7:18:37<05:08,  3.45it/s]
100%|█████████▉| 370409/371472 [7:18:37<05:04,  3.49it/s]
100%|█████████▉| 370410/371472 [7:18:37<05:01,  3.52it/s]
100%|█████████▉| 370411/371472 [7:18:38<05:16,  3.36it/s]
100%|█████████▉| 370412/371472 [7:18:38<05:09,  3.43it/s]
100%|█████████▉| 370413/371472 [7:18:38<05:55,  2.98it/s]
100%|█████████▉| 370414/371472 [7:18:39<05:44,  3.07it/s]
100%|█████████▉| 370415/371472 [7:18:39<05:24,  3.25it/s]
100%|█████████▉| 370416/371472 [7:18:39<05:24,  3.25it/s]
100%|█████████▉| 370417/371472 [7:18:39<05:26,  3.23it/s]
100%|█████████▉| 370418/371472 [7:18:40<05:12,  3.37it/s]
100%|█████████▉| 370419/371472 [7:18:40<04:57,  3.54it/s]
100%|█████████▉| 370420/371472 [7:18:40<04:51,  3.61it/s]
                                                         
{'loss': 2.5695, 'learning_rate': 1.0255015191018984e-07, 'epoch': 15.95}

100%|█████████▉| 370420/371472 [7:18:40<04:51,  3.61it/s]
100%|█████████▉| 370421/371472 [7:18:41<04:57,  3.53it/s]
100%|█████████▉| 370422/371472 [7:18:41<04:53,  3.58it/s]
100%|█████████▉| 370423/371472 [7:18:41<05:04,  3.45it/s]
100%|█████████▉| 370424/371472 [7:18:41<05:32,  3.16it/s]
100%|█████████▉| 370425/371472 [7:18:42<05:22,  3.25it/s]
100%|█████████▉| 370426/371472 [7:18:42<04:57,  3.52it/s]
100%|█████████▉| 370427/371472 [7:18:42<05:22,  3.25it/s]
100%|█████████▉| 370428/371472 [7:18:43<05:21,  3.25it/s]
100%|█████████▉| 370429/371472 [7:18:43<05:09,  3.37it/s]
100%|█████████▉| 370430/371472 [7:18:43<05:03,  3.44it/s]
100%|█████████▉| 370431/371472 [7:18:43<04:52,  3.56it/s]
100%|█████████▉| 370432/371472 [7:18:44<04:43,  3.67it/s]
100%|█████████▉| 370433/371472 [7:18:44<04:47,  3.62it/s]
100%|█████████▉| 370434/371472 [7:18:44<04:48,  3.59it/s]
100%|█████████▉| 370435/371472 [7:18:45<04:40,  3.69it/s]
100%|█████████▉| 370436/371472 [7:18:45<04:40,  3.70it/s]
100%|█████████▉| 370437/371472 [7:18:45<04:37,  3.73it/s]
100%|█████████▉| 370438/371472 [7:18:45<04:35,  3.75it/s]
100%|█████████▉| 370439/371472 [7:18:46<04:43,  3.65it/s]
100%|█████████▉| 370440/371472 [7:18:46<04:50,  3.55it/s]
                                                         
{'loss': 2.5061, 'learning_rate': 1.0250166993471089e-07, 'epoch': 15.96}

100%|█████████▉| 370440/371472 [7:18:46<04:50,  3.55it/s]
100%|█████████▉| 370441/371472 [7:18:46<04:49,  3.56it/s]
100%|█████████▉| 370442/371472 [7:18:46<04:42,  3.65it/s]
100%|█████████▉| 370443/371472 [7:18:47<04:42,  3.65it/s]
100%|█████████▉| 370444/371472 [7:18:47<05:01,  3.41it/s]
100%|█████████▉| 370445/371472 [7:18:47<04:49,  3.55it/s]
100%|█████████▉| 370446/371472 [7:18:48<04:41,  3.64it/s]
100%|█████████▉| 370447/371472 [7:18:48<05:00,  3.41it/s]
100%|█████████▉| 370448/371472 [7:18:48<04:55,  3.47it/s]
100%|█████████▉| 370449/371472 [7:18:48<04:46,  3.57it/s]
100%|█████████▉| 370450/371472 [7:18:49<05:40,  3.00it/s]
100%|█████████▉| 370451/371472 [7:18:49<05:15,  3.23it/s]
100%|█████████▉| 370452/371472 [7:18:49<05:11,  3.28it/s]
100%|█████████▉| 370453/371472 [7:18:50<04:52,  3.49it/s]
100%|█████████▉| 370454/371472 [7:18:50<05:10,  3.28it/s]
100%|█████████▉| 370455/371472 [7:18:50<05:14,  3.24it/s]
100%|█████████▉| 370456/371472 [7:18:51<05:01,  3.37it/s]
100%|█████████▉| 370457/371472 [7:18:51<04:47,  3.53it/s]
100%|█████████▉| 370458/371472 [7:18:51<04:51,  3.48it/s]
100%|█████████▉| 370459/371472 [7:18:52<04:54,  3.44it/s]
100%|█████████▉| 370460/371472 [7:18:52<04:42,  3.59it/s]
                                                         
{'loss': 2.6981, 'learning_rate': 1.0245318795923206e-07, 'epoch': 15.96}

100%|█████████▉| 370460/371472 [7:18:52<04:42,  3.59it/s]
100%|█████████▉| 370461/371472 [7:18:52<04:56,  3.41it/s]
100%|█████████▉| 370462/371472 [7:18:52<04:54,  3.43it/s]
100%|█████████▉| 370463/371472 [7:18:53<04:49,  3.48it/s]
100%|█████████▉| 370464/371472 [7:18:53<04:49,  3.48it/s]
100%|█████████▉| 370465/371472 [7:18:53<04:41,  3.57it/s]
100%|█████████▉| 370466/371472 [7:18:53<04:36,  3.64it/s]
100%|█████████▉| 370467/371472 [7:18:54<04:54,  3.41it/s]
100%|█████████▉| 370468/371472 [7:18:54<05:02,  3.32it/s]
100%|█████████▉| 370469/371472 [7:18:54<05:12,  3.21it/s]
100%|█████████▉| 370470/371472 [7:18:55<05:00,  3.34it/s]
100%|█████████▉| 370471/371472 [7:18:55<04:57,  3.36it/s]
100%|█████████▉| 370472/371472 [7:18:55<04:53,  3.41it/s]
100%|█████████▉| 370473/371472 [7:18:56<04:50,  3.44it/s]
100%|█████████▉| 370474/371472 [7:18:56<04:37,  3.60it/s]
100%|█████████▉| 370475/371472 [7:18:56<04:40,  3.56it/s]
100%|█████████▉| 370476/371472 [7:18:56<04:34,  3.63it/s]
100%|█████████▉| 370477/371472 [7:18:57<04:30,  3.68it/s]
100%|█████████▉| 370478/371472 [7:18:57<04:23,  3.78it/s]
100%|█████████▉| 370479/371472 [7:18:57<04:44,  3.49it/s]
100%|█████████▉| 370480/371472 [7:18:58<04:56,  3.34it/s]
                                                         
{'loss': 2.5289, 'learning_rate': 1.0240470598375312e-07, 'epoch': 15.96}

100%|█████████▉| 370480/371472 [7:18:58<04:56,  3.34it/s]
100%|█████████▉| 370481/371472 [7:18:58<04:42,  3.51it/s]
100%|█████████▉| 370482/371472 [7:18:58<04:32,  3.63it/s]
100%|█████████▉| 370483/371472 [7:18:58<04:38,  3.55it/s]
100%|█████████▉| 370484/371472 [7:18:59<05:06,  3.22it/s]
100%|█████████▉| 370485/371472 [7:18:59<04:59,  3.30it/s]
100%|█████████▉| 370486/371472 [7:18:59<04:48,  3.42it/s]
100%|█████████▉| 370487/371472 [7:19:00<04:54,  3.34it/s]
100%|█████████▉| 370488/371472 [7:19:00<04:51,  3.38it/s]
100%|█████████▉| 370489/371472 [7:19:00<04:42,  3.48it/s]
100%|█████████▉| 370490/371472 [7:19:00<04:39,  3.52it/s]
100%|█████████▉| 370491/371472 [7:19:01<04:41,  3.49it/s]
100%|█████████▉| 370492/371472 [7:19:01<04:32,  3.60it/s]
100%|█████████▉| 370493/371472 [7:19:01<04:33,  3.58it/s]
100%|█████████▉| 370494/371472 [7:19:02<04:58,  3.27it/s]
100%|█████████▉| 370495/371472 [7:19:02<05:13,  3.12it/s]
100%|█████████▉| 370496/371472 [7:19:02<04:57,  3.28it/s]
100%|█████████▉| 370497/371472 [7:19:03<04:45,  3.41it/s]
100%|█████████▉| 370498/371472 [7:19:03<04:39,  3.49it/s]
100%|█████████▉| 370499/371472 [7:19:03<04:45,  3.41it/s]
100%|█████████▉| 370500/371472 [7:19:04<06:26,  2.52it/s]
                                                         
{'loss': 2.4728, 'learning_rate': 1.0235622400827427e-07, 'epoch': 15.96}

100%|█████████▉| 370500/371472 [7:19:04<06:26,  2.52it/s]
100%|█████████▉| 370501/371472 [7:19:04<06:05,  2.66it/s]
100%|█████████▉| 370502/371472 [7:19:04<05:33,  2.91it/s]
100%|█████████▉| 370503/371472 [7:19:05<05:04,  3.18it/s]
100%|█████████▉| 370504/371472 [7:19:05<05:01,  3.21it/s]
100%|█████████▉| 370505/371472 [7:19:05<05:10,  3.12it/s]
100%|█████████▉| 370506/371472 [7:19:06<04:54,  3.28it/s]
100%|█████████▉| 370507/371472 [7:19:06<04:58,  3.23it/s]
100%|█████████▉| 370508/371472 [7:19:06<05:09,  3.12it/s]
100%|█████████▉| 370509/371472 [7:19:06<04:57,  3.24it/s]
100%|█████████▉| 370510/371472 [7:19:07<05:04,  3.16it/s]
100%|█████████▉| 370511/371472 [7:19:07<05:11,  3.08it/s]
100%|█████████▉| 370512/371472 [7:19:07<04:59,  3.21it/s]
100%|█████████▉| 370513/371472 [7:19:08<04:48,  3.33it/s]
100%|█████████▉| 370514/371472 [7:19:08<04:35,  3.48it/s]
100%|█████████▉| 370515/371472 [7:19:08<04:26,  3.59it/s]
100%|█████████▉| 370516/371472 [7:19:08<04:22,  3.65it/s]
100%|█████████▉| 370517/371472 [7:19:09<04:23,  3.63it/s]
100%|█████████▉| 370518/371472 [7:19:09<04:15,  3.74it/s]
100%|█████████▉| 370519/371472 [7:19:09<04:20,  3.66it/s]
100%|█████████▉| 370520/371472 [7:19:10<04:16,  3.71it/s]
                                                         
{'loss': 2.468, 'learning_rate': 1.0230774203279532e-07, 'epoch': 15.96}

100%|█████████▉| 370520/371472 [7:19:10<04:16,  3.71it/s]
100%|█████████▉| 370521/371472 [7:19:10<04:16,  3.70it/s]
100%|█████████▉| 370522/371472 [7:19:10<04:05,  3.88it/s]
100%|█████████▉| 370523/371472 [7:19:10<04:02,  3.92it/s]
100%|█████████▉| 370524/371472 [7:19:11<04:11,  3.77it/s]
100%|█████████▉| 370525/371472 [7:19:11<04:13,  3.73it/s]
100%|█████████▉| 370526/371472 [7:19:11<04:10,  3.78it/s]
100%|█████████▉| 370527/371472 [7:19:11<04:14,  3.71it/s]
100%|█████████▉| 370528/371472 [7:19:12<04:19,  3.64it/s]
100%|█████████▉| 370529/371472 [7:19:12<04:11,  3.74it/s]
100%|█████████▉| 370530/371472 [7:19:12<04:18,  3.64it/s]
100%|█████████▉| 370531/371472 [7:19:13<04:25,  3.55it/s]
100%|█████████▉| 370532/371472 [7:19:13<04:30,  3.48it/s]
100%|█████████▉| 370533/371472 [7:19:13<04:18,  3.63it/s]
100%|█████████▉| 370534/371472 [7:19:13<04:15,  3.67it/s]
100%|█████████▉| 370535/371472 [7:19:14<04:25,  3.53it/s]
100%|█████████▉| 370536/371472 [7:19:14<04:36,  3.38it/s]
100%|█████████▉| 370537/371472 [7:19:14<04:22,  3.57it/s]
100%|█████████▉| 370538/371472 [7:19:15<04:25,  3.52it/s]
100%|█████████▉| 370539/371472 [7:19:15<04:18,  3.60it/s]
100%|█████████▉| 370540/371472 [7:19:15<04:16,  3.63it/s]
                                                         
{'loss': 2.5743, 'learning_rate': 1.0225926005731649e-07, 'epoch': 15.96}

100%|█████████▉| 370540/371472 [7:19:15<04:16,  3.63it/s]
100%|█████████▉| 370541/371472 [7:19:15<04:13,  3.68it/s]
100%|█████████▉| 370542/371472 [7:19:16<04:30,  3.43it/s]
100%|█████████▉| 370543/371472 [7:19:16<04:28,  3.46it/s]
100%|█████████▉| 370544/371472 [7:19:16<04:32,  3.40it/s]
100%|█████████▉| 370545/371472 [7:19:16<04:22,  3.54it/s]
100%|█████████▉| 370546/371472 [7:19:17<04:22,  3.53it/s]
100%|█████████▉| 370547/371472 [7:19:17<04:13,  3.65it/s]
100%|█████████▉| 370548/371472 [7:19:17<04:07,  3.73it/s]
100%|█████████▉| 370549/371472 [7:19:18<04:09,  3.70it/s]
100%|█████████▉| 370550/371472 [7:19:18<04:02,  3.80it/s]
100%|█████████▉| 370551/371472 [7:19:18<04:15,  3.61it/s]
100%|█████████▉| 370552/371472 [7:19:18<04:19,  3.54it/s]
100%|█████████▉| 370553/371472 [7:19:19<04:06,  3.73it/s]
100%|█████████▉| 370554/371472 [7:19:19<04:06,  3.72it/s]
100%|█████████▉| 370555/371472 [7:19:19<04:19,  3.53it/s]
100%|█████████▉| 370556/371472 [7:19:20<04:17,  3.56it/s]
100%|█████████▉| 370557/371472 [7:19:20<04:12,  3.62it/s]
100%|█████████▉| 370558/371472 [7:19:20<04:19,  3.52it/s]
100%|█████████▉| 370559/371472 [7:19:20<04:17,  3.54it/s]
100%|█████████▉| 370560/371472 [7:19:21<04:13,  3.60it/s]
                                                         
{'loss': 2.6394, 'learning_rate': 1.0221077808183755e-07, 'epoch': 15.96}

100%|█████████▉| 370560/371472 [7:19:21<04:13,  3.60it/s]
100%|█████████▉| 370561/371472 [7:19:21<04:09,  3.65it/s]
100%|█████████▉| 370562/371472 [7:19:21<04:26,  3.41it/s]
100%|█████████▉| 370563/371472 [7:19:22<04:31,  3.35it/s]
100%|█████████▉| 370564/371472 [7:19:22<04:22,  3.46it/s]
100%|█████████▉| 370565/371472 [7:19:22<04:21,  3.46it/s]
100%|█████████▉| 370566/371472 [7:19:22<04:13,  3.58it/s]
100%|█████████▉| 370567/371472 [7:19:23<04:07,  3.65it/s]
100%|█████████▉| 370568/371472 [7:19:23<04:08,  3.63it/s]
100%|█████████▉| 370569/371472 [7:19:23<04:06,  3.66it/s]
100%|█████████▉| 370570/371472 [7:19:23<04:00,  3.75it/s]
100%|█████████▉| 370571/371472 [7:19:24<04:22,  3.43it/s]
100%|█████████▉| 370572/371472 [7:19:24<04:17,  3.49it/s]
100%|█████████▉| 370573/371472 [7:19:24<04:06,  3.65it/s]
100%|█████████▉| 370574/371472 [7:19:25<04:12,  3.56it/s]
100%|█████████▉| 370575/371472 [7:19:25<04:09,  3.59it/s]
100%|█████████▉| 370576/371472 [7:19:25<04:10,  3.58it/s]
100%|█████████▉| 370577/371472 [7:19:25<04:29,  3.33it/s]
100%|█████████▉| 370578/371472 [7:19:26<04:44,  3.15it/s]
100%|█████████▉| 370579/371472 [7:19:26<04:33,  3.27it/s]
100%|█████████▉| 370580/371472 [7:19:26<04:40,  3.19it/s]
                                                         
{'loss': 2.6088, 'learning_rate': 1.021622961063587e-07, 'epoch': 15.96}

100%|█████████▉| 370580/371472 [7:19:26<04:40,  3.19it/s]
100%|█████████▉| 370581/371472 [7:19:27<04:26,  3.34it/s]
100%|█████████▉| 370582/371472 [7:19:27<04:18,  3.45it/s]
100%|█████████▉| 370583/371472 [7:19:27<04:11,  3.54it/s]
100%|█████████▉| 370584/371472 [7:19:28<04:06,  3.60it/s]
100%|█████████▉| 370585/371472 [7:19:28<04:00,  3.69it/s]
100%|█████████▉| 370586/371472 [7:19:28<03:57,  3.73it/s]
100%|█████████▉| 370587/371472 [7:19:28<04:02,  3.66it/s]
100%|█████████▉| 370588/371472 [7:19:29<03:59,  3.70it/s]
100%|█████████▉| 370589/371472 [7:19:29<04:07,  3.57it/s]
100%|█████████▉| 370590/371472 [7:19:29<04:01,  3.65it/s]
100%|█████████▉| 370591/371472 [7:19:29<04:08,  3.54it/s]
100%|█████████▉| 370592/371472 [7:19:30<04:08,  3.55it/s]
100%|█████████▉| 370593/371472 [7:19:30<04:03,  3.61it/s]
100%|█████████▉| 370594/371472 [7:19:30<04:01,  3.63it/s]
100%|█████████▉| 370595/371472 [7:19:31<03:58,  3.68it/s]
100%|█████████▉| 370596/371472 [7:19:31<04:04,  3.58it/s]
100%|█████████▉| 370597/371472 [7:19:31<04:17,  3.39it/s]
100%|█████████▉| 370598/371472 [7:19:31<04:10,  3.49it/s]
100%|█████████▉| 370599/371472 [7:19:32<04:11,  3.47it/s]
100%|█████████▉| 370600/371472 [7:19:32<04:16,  3.40it/s]
                                                         
{'loss': 2.6182, 'learning_rate': 1.0211381413087976e-07, 'epoch': 15.96}

100%|█████████▉| 370600/371472 [7:19:32<04:16,  3.40it/s]
100%|█████████▉| 370601/371472 [7:19:32<04:21,  3.33it/s]
100%|█████████▉| 370602/371472 [7:19:33<04:16,  3.39it/s]
100%|█████████▉| 370603/371472 [7:19:33<04:09,  3.49it/s]
100%|█████████▉| 370604/371472 [7:19:33<04:17,  3.37it/s]
100%|█████████▉| 370605/371472 [7:19:33<04:09,  3.47it/s]
100%|█████████▉| 370606/371472 [7:19:34<04:18,  3.35it/s]
100%|█████████▉| 370607/371472 [7:19:34<04:10,  3.46it/s]
100%|█████████▉| 370608/371472 [7:19:34<04:07,  3.49it/s]
100%|█████████▉| 370609/371472 [7:19:35<04:08,  3.47it/s]
100%|█████████▉| 370610/371472 [7:19:35<04:01,  3.57it/s]
100%|█████████▉| 370611/371472 [7:19:35<04:25,  3.24it/s]
100%|█████████▉| 370612/371472 [7:19:36<04:19,  3.32it/s]
100%|█████████▉| 370613/371472 [7:19:36<04:05,  3.49it/s]
100%|█████████▉| 370614/371472 [7:19:36<04:06,  3.48it/s]
100%|█████████▉| 370615/371472 [7:19:36<03:58,  3.59it/s]
100%|█████████▉| 370616/371472 [7:19:37<03:59,  3.58it/s]
100%|█████████▉| 370617/371472 [7:19:37<03:54,  3.64it/s]
100%|█████████▉| 370618/371472 [7:19:37<04:05,  3.47it/s]
100%|█████████▉| 370619/371472 [7:19:37<03:54,  3.63it/s]
100%|█████████▉| 370620/371472 [7:19:38<03:45,  3.78it/s]
                                                         
{'loss': 2.6647, 'learning_rate': 1.0206533215540092e-07, 'epoch': 15.96}

100%|█████████▉| 370620/371472 [7:19:38<03:45,  3.78it/s]
100%|█████████▉| 370621/371472 [7:19:38<03:55,  3.61it/s]
100%|█████████▉| 370622/371472 [7:19:38<03:51,  3.68it/s]
100%|█████████▉| 370623/371472 [7:19:39<03:49,  3.70it/s]
100%|█████████▉| 370624/371472 [7:19:39<04:02,  3.50it/s]
100%|█████████▉| 370625/371472 [7:19:39<04:00,  3.52it/s]
100%|█████████▉| 370626/371472 [7:19:39<04:08,  3.40it/s]
100%|█████████▉| 370627/371472 [7:19:40<04:10,  3.38it/s]
100%|█████████▉| 370628/371472 [7:19:40<04:19,  3.25it/s]
100%|█████████▉| 370629/371472 [7:19:40<04:01,  3.49it/s]
100%|█████████▉| 370630/371472 [7:19:41<03:57,  3.55it/s]
100%|█████████▉| 370631/371472 [7:19:41<03:49,  3.66it/s]
100%|█████████▉| 370632/371472 [7:19:41<03:46,  3.70it/s]
100%|█████████▉| 370633/371472 [7:19:41<03:46,  3.70it/s]
100%|█████████▉| 370634/371472 [7:19:42<03:41,  3.78it/s]
100%|█████████▉| 370635/371472 [7:19:42<03:37,  3.86it/s]
100%|█████████▉| 370636/371472 [7:19:42<03:52,  3.59it/s]
100%|█████████▉| 370637/371472 [7:19:43<03:58,  3.50it/s]
100%|█████████▉| 370638/371472 [7:19:43<03:56,  3.52it/s]
100%|█████████▉| 370639/371472 [7:19:43<03:57,  3.51it/s]
100%|█████████▉| 370640/371472 [7:19:43<03:53,  3.57it/s]
                                                         
{'loss': 2.633, 'learning_rate': 1.0201685017992198e-07, 'epoch': 15.96}

100%|█████████▉| 370640/371472 [7:19:43<03:53,  3.57it/s]
100%|█████████▉| 370641/371472 [7:19:44<03:44,  3.70it/s]
100%|█████████▉| 370642/371472 [7:19:44<03:44,  3.70it/s]
100%|█████████▉| 370643/371472 [7:19:44<03:41,  3.75it/s]
100%|█████████▉| 370644/371472 [7:19:44<03:39,  3.78it/s]
100%|█████████▉| 370645/371472 [7:19:45<03:38,  3.79it/s]
100%|█████████▉| 370646/371472 [7:19:45<03:56,  3.50it/s]
100%|█████████▉| 370647/371472 [7:19:45<04:00,  3.43it/s]
100%|█████████▉| 370648/371472 [7:19:46<04:01,  3.41it/s]
100%|█████████▉| 370649/371472 [7:19:46<03:51,  3.55it/s]
100%|█████████▉| 370650/371472 [7:19:46<03:43,  3.68it/s]
100%|█████████▉| 370651/371472 [7:19:46<03:43,  3.68it/s]
100%|█████████▉| 370652/371472 [7:19:47<04:01,  3.39it/s]
100%|█████████▉| 370653/371472 [7:19:47<04:02,  3.37it/s]
100%|█████████▉| 370654/371472 [7:19:47<03:58,  3.43it/s]
100%|█████████▉| 370655/371472 [7:19:48<03:56,  3.45it/s]
100%|█████████▉| 370656/371472 [7:19:48<03:45,  3.62it/s]
100%|█████████▉| 370657/371472 [7:19:48<03:39,  3.72it/s]
100%|█████████▉| 370658/371472 [7:19:48<03:42,  3.65it/s]
100%|█████████▉| 370659/371472 [7:19:49<03:40,  3.69it/s]
100%|█████████▉| 370660/371472 [7:19:49<03:58,  3.40it/s]
                                                         
{'loss': 2.5665, 'learning_rate': 1.0196836820444313e-07, 'epoch': 15.97}

100%|█████████▉| 370660/371472 [7:19:49<03:58,  3.40it/s]
100%|█████████▉| 370661/371472 [7:19:49<03:45,  3.60it/s]
100%|█████████▉| 370662/371472 [7:19:49<03:42,  3.65it/s]
100%|█████████▉| 370663/371472 [7:19:50<03:36,  3.74it/s]
100%|█████████▉| 370664/371472 [7:19:50<03:53,  3.46it/s]
100%|█████████▉| 370665/371472 [7:19:50<04:05,  3.29it/s]
100%|█████████▉| 370666/371472 [7:19:51<03:56,  3.41it/s]
100%|█████████▉| 370667/371472 [7:19:51<03:47,  3.53it/s]
100%|█████████▉| 370668/371472 [7:19:51<03:51,  3.47it/s]
100%|█████████▉| 370669/371472 [7:19:51<03:40,  3.64it/s]
100%|█████████▉| 370670/371472 [7:19:52<03:56,  3.39it/s]
100%|█████████▉| 370671/371472 [7:19:52<03:48,  3.51it/s]
100%|█████████▉| 370672/371472 [7:19:52<03:46,  3.53it/s]
100%|█████████▉| 370673/371472 [7:19:53<03:42,  3.60it/s]
100%|█████████▉| 370674/371472 [7:19:53<03:35,  3.70it/s]
100%|█████████▉| 370675/371472 [7:19:53<03:37,  3.66it/s]
100%|█████████▉| 370676/371472 [7:19:53<03:49,  3.46it/s]
100%|█████████▉| 370677/371472 [7:19:54<03:41,  3.60it/s]
100%|█████████▉| 370678/371472 [7:19:54<03:41,  3.59it/s]
100%|█████████▉| 370679/371472 [7:19:54<03:34,  3.70it/s]
100%|█████████▉| 370680/371472 [7:19:55<03:44,  3.53it/s]
                                                         
{'loss': 2.7128, 'learning_rate': 1.0191988622896419e-07, 'epoch': 15.97}

100%|█████████▉| 370680/371472 [7:19:55<03:44,  3.53it/s]
100%|█████████▉| 370681/371472 [7:19:55<03:36,  3.66it/s]
100%|█████████▉| 370682/371472 [7:19:55<03:29,  3.77it/s]
100%|█████████▉| 370683/371472 [7:19:55<03:43,  3.53it/s]
100%|█████████▉| 370684/371472 [7:19:56<03:48,  3.45it/s]
100%|█████████▉| 370685/371472 [7:19:56<03:44,  3.51it/s]
100%|█████████▉| 370686/371472 [7:19:56<03:50,  3.40it/s]
100%|█████████▉| 370687/371472 [7:19:57<03:49,  3.41it/s]
100%|█████████▉| 370688/371472 [7:19:57<03:49,  3.42it/s]
100%|█████████▉| 370689/371472 [7:19:57<03:48,  3.43it/s]
100%|█████████▉| 370690/371472 [7:19:57<03:51,  3.38it/s]
100%|█████████▉| 370691/371472 [7:19:58<03:45,  3.46it/s]
100%|█████████▉| 370692/371472 [7:19:58<04:02,  3.22it/s]
100%|█████████▉| 370693/371472 [7:19:58<04:02,  3.21it/s]
100%|█████████▉| 370694/371472 [7:19:59<04:06,  3.15it/s]
100%|█████████▉| 370695/371472 [7:19:59<03:49,  3.38it/s]
100%|█████████▉| 370696/371472 [7:19:59<03:38,  3.55it/s]
100%|█████████▉| 370697/371472 [7:20:00<03:40,  3.51it/s]
100%|█████████▉| 370698/371472 [7:20:00<03:43,  3.46it/s]
100%|█████████▉| 370699/371472 [7:20:00<03:44,  3.44it/s]
100%|█████████▉| 370700/371472 [7:20:00<03:42,  3.48it/s]
                                                         
{'loss': 2.3996, 'learning_rate': 1.0187140425348535e-07, 'epoch': 15.97}

100%|█████████▉| 370700/371472 [7:20:00<03:42,  3.48it/s]
100%|█████████▉| 370701/371472 [7:20:01<03:41,  3.48it/s]
100%|█████████▉| 370702/371472 [7:20:01<03:51,  3.33it/s]
100%|█████████▉| 370703/371472 [7:20:01<04:04,  3.15it/s]
100%|█████████▉| 370704/371472 [7:20:02<03:49,  3.34it/s]
100%|█████████▉| 370705/371472 [7:20:02<03:42,  3.45it/s]
100%|█████████▉| 370706/371472 [7:20:02<03:39,  3.49it/s]
100%|█████████▉| 370707/371472 [7:20:02<03:33,  3.59it/s]
100%|█████████▉| 370708/371472 [7:20:03<03:32,  3.60it/s]
100%|█████████▉| 370709/371472 [7:20:03<03:30,  3.63it/s]
100%|█████████▉| 370710/371472 [7:20:03<03:22,  3.77it/s]
100%|█████████▉| 370711/371472 [7:20:03<03:21,  3.79it/s]
100%|█████████▉| 370712/371472 [7:20:04<03:21,  3.77it/s]
100%|█████████▉| 370713/371472 [7:20:04<03:19,  3.80it/s]
100%|█████████▉| 370714/371472 [7:20:04<03:16,  3.85it/s]
100%|█████████▉| 370715/371472 [7:20:05<03:26,  3.67it/s]
100%|█████████▉| 370716/371472 [7:20:05<03:44,  3.37it/s]
100%|█████████▉| 370717/371472 [7:20:05<03:50,  3.27it/s]
100%|█████████▉| 370718/371472 [7:20:06<03:43,  3.38it/s]
100%|█████████▉| 370719/371472 [7:20:06<03:53,  3.23it/s]
100%|█████████▉| 370720/371472 [7:20:06<03:55,  3.20it/s]
                                                         
{'loss': 2.4959, 'learning_rate': 1.0182292227800641e-07, 'epoch': 15.97}

100%|█████████▉| 370720/371472 [7:20:06<03:55,  3.20it/s]
100%|█████████▉| 370721/371472 [7:20:06<03:41,  3.38it/s]
100%|█████████▉| 370722/371472 [7:20:07<03:35,  3.48it/s]
100%|█████████▉| 370723/371472 [7:20:07<03:45,  3.31it/s]
100%|█████████▉| 370724/371472 [7:20:07<03:41,  3.38it/s]
100%|█████████▉| 370725/371472 [7:20:08<03:36,  3.44it/s]
100%|█████████▉| 370726/371472 [7:20:08<03:34,  3.48it/s]
100%|█████████▉| 370727/371472 [7:20:08<03:27,  3.60it/s]
100%|█████████▉| 370728/371472 [7:20:08<03:30,  3.53it/s]
100%|█████████▉| 370729/371472 [7:20:09<03:32,  3.50it/s]
100%|█████████▉| 370730/371472 [7:20:09<03:29,  3.54it/s]
100%|█████████▉| 370731/371472 [7:20:09<03:22,  3.66it/s]
100%|█████████▉| 370732/371472 [7:20:10<03:22,  3.66it/s]
100%|█████████▉| 370733/371472 [7:20:10<03:27,  3.57it/s]
100%|█████████▉| 370734/371472 [7:20:10<03:20,  3.68it/s]
100%|█████████▉| 370735/371472 [7:20:10<03:19,  3.70it/s]
100%|█████████▉| 370736/371472 [7:20:11<03:11,  3.84it/s]
100%|█████████▉| 370737/371472 [7:20:11<03:15,  3.76it/s]
100%|█████████▉| 370738/371472 [7:20:11<03:12,  3.81it/s]
100%|█████████▉| 370739/371472 [7:20:11<03:30,  3.48it/s]
100%|█████████▉| 370740/371472 [7:20:12<03:24,  3.59it/s]
                                                         
{'loss': 2.5477, 'learning_rate': 1.0177444030252756e-07, 'epoch': 15.97}

100%|█████████▉| 370740/371472 [7:20:12<03:24,  3.59it/s]
100%|█████████▉| 370741/371472 [7:20:12<03:38,  3.34it/s]
100%|█████████▉| 370742/371472 [7:20:12<03:35,  3.39it/s]
100%|█████████▉| 370743/371472 [7:20:13<03:28,  3.50it/s]
100%|█████████▉| 370744/371472 [7:20:13<03:28,  3.49it/s]
100%|█████████▉| 370745/371472 [7:20:13<03:28,  3.48it/s]
100%|█████████▉| 370746/371472 [7:20:13<03:24,  3.56it/s]
100%|█████████▉| 370747/371472 [7:20:14<03:19,  3.63it/s]
100%|█████████▉| 370748/371472 [7:20:14<03:16,  3.69it/s]
100%|█████████▉| 370749/371472 [7:20:14<03:17,  3.67it/s]
100%|█████████▉| 370750/371472 [7:20:15<03:22,  3.57it/s]
100%|█████████▉| 370751/371472 [7:20:15<03:21,  3.58it/s]
100%|█████████▉| 370752/371472 [7:20:15<03:17,  3.64it/s]
100%|█████████▉| 370753/371472 [7:20:15<03:17,  3.64it/s]
100%|█████████▉| 370754/371472 [7:20:16<03:21,  3.56it/s]
100%|█████████▉| 370755/371472 [7:20:16<03:14,  3.69it/s]
100%|█████████▉| 370756/371472 [7:20:16<03:23,  3.51it/s]
100%|█████████▉| 370757/371472 [7:20:16<03:18,  3.61it/s]
100%|█████████▉| 370758/371472 [7:20:17<03:15,  3.65it/s]
100%|█████████▉| 370759/371472 [7:20:17<03:12,  3.70it/s]
100%|█████████▉| 370760/371472 [7:20:17<03:33,  3.33it/s]
                                                         
{'loss': 2.6031, 'learning_rate': 1.0172595832704862e-07, 'epoch': 15.97}

100%|█████████▉| 370760/371472 [7:20:17<03:33,  3.33it/s]
100%|█████████▉| 370761/371472 [7:20:18<03:20,  3.55it/s]
100%|█████████▉| 370762/371472 [7:20:18<03:18,  3.57it/s]
100%|█████████▉| 370763/371472 [7:20:18<03:11,  3.70it/s]
100%|█████████▉| 370764/371472 [7:20:18<03:09,  3.73it/s]
100%|█████████▉| 370765/371472 [7:20:19<03:14,  3.64it/s]
100%|█████████▉| 370766/371472 [7:20:19<03:10,  3.71it/s]
100%|█████████▉| 370767/371472 [7:20:19<03:18,  3.56it/s]
100%|█████████▉| 370768/371472 [7:20:20<03:10,  3.70it/s]
100%|█████████▉| 370769/371472 [7:20:20<03:05,  3.79it/s]
100%|█████████▉| 370770/371472 [7:20:20<03:07,  3.75it/s]
100%|█████████▉| 370771/371472 [7:20:20<03:20,  3.50it/s]
100%|█████████▉| 370772/371472 [7:20:21<03:17,  3.55it/s]
100%|█████████▉| 370773/371472 [7:20:21<03:13,  3.61it/s]
100%|█████████▉| 370774/371472 [7:20:21<03:20,  3.49it/s]
100%|█████████▉| 370775/371472 [7:20:21<03:16,  3.55it/s]
100%|█████████▉| 370776/371472 [7:20:22<03:16,  3.54it/s]
100%|█████████▉| 370777/371472 [7:20:22<03:18,  3.51it/s]
100%|█████████▉| 370778/371472 [7:20:22<03:14,  3.56it/s]
100%|█████████▉| 370779/371472 [7:20:23<03:10,  3.64it/s]
100%|█████████▉| 370780/371472 [7:20:23<03:12,  3.60it/s]
                                                         
{'loss': 2.7387, 'learning_rate': 1.0167747635156978e-07, 'epoch': 15.97}

100%|█████████▉| 370780/371472 [7:20:23<03:12,  3.60it/s]
100%|█████████▉| 370781/371472 [7:20:23<03:10,  3.63it/s]
100%|█████████▉| 370782/371472 [7:20:23<03:17,  3.50it/s]
100%|█████████▉| 370783/371472 [7:20:24<03:12,  3.58it/s]
100%|█████████▉| 370784/371472 [7:20:24<03:12,  3.58it/s]
100%|█████████▉| 370785/371472 [7:20:24<03:06,  3.68it/s]
100%|█████████▉| 370786/371472 [7:20:25<03:12,  3.57it/s]
100%|█████████▉| 370787/371472 [7:20:25<03:11,  3.58it/s]
100%|█████████▉| 370788/371472 [7:20:25<03:06,  3.67it/s]
100%|█████████▉| 370789/371472 [7:20:25<03:21,  3.39it/s]
100%|█████████▉| 370790/371472 [7:20:26<03:14,  3.50it/s]
100%|█████████▉| 370791/371472 [7:20:26<03:08,  3.60it/s]
100%|█████████▉| 370792/371472 [7:20:26<03:12,  3.53it/s]
100%|█████████▉| 370793/371472 [7:20:27<03:19,  3.40it/s]
100%|█████████▉| 370794/371472 [7:20:27<03:17,  3.44it/s]
100%|█████████▉| 370795/371472 [7:20:27<03:26,  3.28it/s]
100%|█████████▉| 370796/371472 [7:20:28<03:31,  3.20it/s]
100%|█████████▉| 370797/371472 [7:20:28<03:39,  3.07it/s]
100%|█████████▉| 370798/371472 [7:20:28<03:28,  3.24it/s]
100%|█████████▉| 370799/371472 [7:20:28<03:33,  3.15it/s]
100%|█████████▉| 370800/371472 [7:20:29<03:37,  3.10it/s]
                                                         
{'loss': 2.502, 'learning_rate': 1.0162899437609086e-07, 'epoch': 15.97}

100%|█████████▉| 370800/371472 [7:20:29<03:37,  3.10it/s]
100%|█████████▉| 370801/371472 [7:20:29<03:47,  2.95it/s]
100%|█████████▉| 370802/371472 [7:20:29<03:34,  3.12it/s]
100%|█████████▉| 370803/371472 [7:20:30<03:21,  3.32it/s]
100%|█████████▉| 370804/371472 [7:20:30<03:14,  3.43it/s]
100%|█████████▉| 370805/371472 [7:20:30<03:20,  3.32it/s]
100%|█████████▉| 370806/371472 [7:20:31<03:11,  3.48it/s]
100%|█████████▉| 370807/371472 [7:20:31<03:15,  3.41it/s]
100%|█████████▉| 370808/371472 [7:20:31<03:19,  3.33it/s]
100%|█████████▉| 370809/371472 [7:20:32<03:22,  3.27it/s]
100%|█████████▉| 370810/371472 [7:20:32<03:15,  3.38it/s]
100%|█████████▉| 370811/371472 [7:20:32<03:18,  3.33it/s]
100%|█████████▉| 370812/371472 [7:20:32<03:06,  3.53it/s]
100%|█████████▉| 370813/371472 [7:20:33<03:09,  3.48it/s]
100%|█████████▉| 370814/371472 [7:20:33<03:17,  3.33it/s]
100%|█████████▉| 370815/371472 [7:20:33<03:08,  3.49it/s]
100%|█████████▉| 370816/371472 [7:20:33<03:02,  3.59it/s]
100%|█████████▉| 370817/371472 [7:20:34<03:17,  3.32it/s]
100%|█████████▉| 370818/371472 [7:20:34<03:11,  3.41it/s]
100%|█████████▉| 370819/371472 [7:20:34<03:14,  3.36it/s]
100%|█████████▉| 370820/371472 [7:20:35<03:07,  3.48it/s]
                                                         
{'loss': 2.5374, 'learning_rate': 1.0158051240061199e-07, 'epoch': 15.97}

100%|█████████▉| 370820/371472 [7:20:35<03:07,  3.48it/s]
100%|█████████▉| 370821/371472 [7:20:35<03:00,  3.60it/s]
100%|█████████▉| 370822/371472 [7:20:35<02:57,  3.66it/s]
100%|█████████▉| 370823/371472 [7:20:35<02:59,  3.62it/s]
100%|█████████▉| 370824/371472 [7:20:36<02:58,  3.63it/s]
100%|█████████▉| 370825/371472 [7:20:36<02:56,  3.67it/s]
100%|█████████▉| 370826/371472 [7:20:36<02:52,  3.74it/s]
100%|█████████▉| 370827/371472 [7:20:37<02:47,  3.84it/s]
100%|█████████▉| 370828/371472 [7:20:37<02:46,  3.87it/s]
100%|█████████▉| 370829/371472 [7:20:37<02:48,  3.83it/s]
100%|█████████▉| 370830/371472 [7:20:37<02:44,  3.91it/s]
100%|█████████▉| 370831/371472 [7:20:38<02:50,  3.77it/s]
100%|█████████▉| 370832/371472 [7:20:38<02:49,  3.78it/s]
100%|█████████▉| 370833/371472 [7:20:38<02:45,  3.87it/s]
100%|█████████▉| 370834/371472 [7:20:38<03:00,  3.53it/s]
100%|█████████▉| 370835/371472 [7:20:39<02:55,  3.64it/s]
100%|█████████▉| 370836/371472 [7:20:39<03:03,  3.47it/s]
100%|█████████▉| 370837/371472 [7:20:39<03:16,  3.23it/s]
100%|█████████▉| 370838/371472 [7:20:40<03:14,  3.27it/s]
100%|█████████▉| 370839/371472 [7:20:40<03:44,  2.82it/s]
100%|█████████▉| 370840/371472 [7:20:40<03:42,  2.84it/s]
                                                         
{'loss': 2.6133, 'learning_rate': 1.0153203042513305e-07, 'epoch': 15.97}

100%|█████████▉| 370840/371472 [7:20:40<03:42,  2.84it/s]
100%|█████████▉| 370841/371472 [7:20:41<03:24,  3.08it/s]
100%|█████████▉| 370842/371472 [7:20:41<03:15,  3.22it/s]
100%|█████████▉| 370843/371472 [7:20:41<03:21,  3.12it/s]
100%|█████████▉| 370844/371472 [7:20:42<03:14,  3.22it/s]
100%|█████████▉| 370845/371472 [7:20:42<03:09,  3.31it/s]
100%|█████████▉| 370846/371472 [7:20:42<03:15,  3.19it/s]
100%|█████████▉| 370847/371472 [7:20:43<03:27,  3.01it/s]
100%|█████████▉| 370848/371472 [7:20:43<03:25,  3.04it/s]
100%|█████████▉| 370849/371472 [7:20:43<03:18,  3.14it/s]
100%|█████████▉| 370850/371472 [7:20:44<03:07,  3.31it/s]
100%|█████████▉| 370851/371472 [7:20:44<03:14,  3.20it/s]
100%|█████████▉| 370852/371472 [7:20:44<03:01,  3.42it/s]
100%|█████████▉| 370853/371472 [7:20:44<03:00,  3.43it/s]
100%|█████████▉| 370854/371472 [7:20:45<03:06,  3.31it/s]
100%|█████████▉| 370855/371472 [7:20:45<02:58,  3.45it/s]
100%|█████████▉| 370856/371472 [7:20:45<02:54,  3.53it/s]
100%|█████████▉| 370857/371472 [7:20:45<02:45,  3.73it/s]
100%|█████████▉| 370858/371472 [7:20:46<02:52,  3.57it/s]
100%|█████████▉| 370859/371472 [7:20:46<03:06,  3.28it/s]
100%|█████████▉| 370860/371472 [7:20:46<03:01,  3.37it/s]
                                                         
{'loss': 2.4041, 'learning_rate': 1.0148354844965411e-07, 'epoch': 15.97}

100%|█████████▉| 370860/371472 [7:20:46<03:01,  3.37it/s]
100%|█████████▉| 370861/371472 [7:20:47<02:55,  3.48it/s]
100%|█████████▉| 370862/371472 [7:20:47<03:07,  3.26it/s]
100%|█████████▉| 370863/371472 [7:20:47<02:56,  3.46it/s]
100%|█████████▉| 370864/371472 [7:20:48<02:46,  3.66it/s]
100%|█████████▉| 370865/371472 [7:20:48<02:45,  3.68it/s]
100%|█████████▉| 370866/371472 [7:20:48<02:44,  3.69it/s]
100%|█████████▉| 370867/371472 [7:20:48<02:50,  3.55it/s]
100%|█████████▉| 370868/371472 [7:20:49<02:46,  3.62it/s]
100%|█████████▉| 370869/371472 [7:20:49<02:49,  3.56it/s]
100%|█████████▉| 370870/371472 [7:20:49<02:43,  3.69it/s]
100%|█████████▉| 370871/371472 [7:20:49<02:43,  3.67it/s]
100%|█████████▉| 370872/371472 [7:20:50<02:57,  3.39it/s]
100%|█████████▉| 370873/371472 [7:20:50<02:52,  3.47it/s]
100%|█████████▉| 370874/371472 [7:20:50<02:57,  3.36it/s]
100%|█████████▉| 370875/371472 [7:20:51<02:51,  3.48it/s]
100%|█████████▉| 370876/371472 [7:20:51<02:57,  3.35it/s]
100%|█████████▉| 370877/371472 [7:20:51<02:54,  3.40it/s]
100%|█████████▉| 370878/371472 [7:20:52<02:59,  3.31it/s]
100%|█████████▉| 370879/371472 [7:20:52<02:59,  3.31it/s]
100%|█████████▉| 370880/371472 [7:20:52<02:57,  3.34it/s]
                                                         
{'loss': 2.5459, 'learning_rate': 1.0143506647417527e-07, 'epoch': 15.97}

100%|█████████▉| 370880/371472 [7:20:52<02:57,  3.34it/s]
100%|█████████▉| 370881/371472 [7:20:52<02:48,  3.51it/s]
100%|█████████▉| 370882/371472 [7:20:53<02:43,  3.62it/s]
100%|█████████▉| 370883/371472 [7:20:53<02:39,  3.69it/s]
100%|█████████▉| 370884/371472 [7:20:53<02:57,  3.30it/s]
100%|█████████▉| 370885/371472 [7:20:54<02:55,  3.35it/s]
100%|█████████▉| 370886/371472 [7:20:54<03:08,  3.10it/s]
100%|█████████▉| 370887/371472 [7:20:54<03:15,  3.00it/s]
100%|█████████▉| 370888/371472 [7:20:55<03:07,  3.11it/s]
100%|█████████▉| 370889/371472 [7:20:55<03:00,  3.23it/s]
100%|█████████▉| 370890/371472 [7:20:55<02:56,  3.30it/s]
100%|█████████▉| 370891/371472 [7:20:55<02:45,  3.50it/s]
100%|█████████▉| 370892/371472 [7:20:56<02:41,  3.59it/s]
100%|█████████▉| 370893/371472 [7:20:56<02:51,  3.38it/s]
100%|█████████▉| 370894/371472 [7:20:56<02:47,  3.45it/s]
100%|█████████▉| 370895/371472 [7:20:57<02:44,  3.51it/s]
100%|█████████▉| 370896/371472 [7:20:57<02:43,  3.52it/s]
100%|█████████▉| 370897/371472 [7:20:57<02:41,  3.55it/s]
100%|█████████▉| 370898/371472 [7:20:57<02:40,  3.58it/s]
100%|█████████▉| 370899/371472 [7:20:58<02:41,  3.54it/s]
100%|█████████▉| 370900/371472 [7:20:58<02:40,  3.57it/s]
                                                         
{'loss': 2.5954, 'learning_rate': 1.0138658449869633e-07, 'epoch': 15.98}

100%|█████████▉| 370900/371472 [7:20:58<02:40,  3.57it/s]
100%|█████████▉| 370901/371472 [7:20:58<02:40,  3.57it/s]
100%|█████████▉| 370902/371472 [7:20:59<02:35,  3.66it/s]
100%|█████████▉| 370903/371472 [7:20:59<02:47,  3.40it/s]
100%|█████████▉| 370904/371472 [7:20:59<02:40,  3.53it/s]
100%|█████████▉| 370905/371472 [7:20:59<02:34,  3.67it/s]
100%|█████████▉| 370906/371472 [7:21:00<02:34,  3.66it/s]
100%|█████████▉| 370907/371472 [7:21:00<02:34,  3.67it/s]
100%|█████████▉| 370908/371472 [7:21:00<02:28,  3.80it/s]
100%|█████████▉| 370909/371472 [7:21:01<02:38,  3.54it/s]
100%|█████████▉| 370910/371472 [7:21:01<02:37,  3.58it/s]
100%|█████████▉| 370911/371472 [7:21:01<02:30,  3.73it/s]
100%|█████████▉| 370912/371472 [7:21:01<02:37,  3.55it/s]
100%|█████████▉| 370913/371472 [7:21:02<02:35,  3.59it/s]
100%|█████████▉| 370914/371472 [7:21:02<02:29,  3.74it/s]
100%|█████████▉| 370915/371472 [7:21:02<02:33,  3.62it/s]
100%|█████████▉| 370916/371472 [7:21:02<02:34,  3.61it/s]
100%|█████████▉| 370917/371472 [7:21:03<02:30,  3.69it/s]
100%|█████████▉| 370918/371472 [7:21:03<02:36,  3.53it/s]
100%|█████████▉| 370919/371472 [7:21:03<02:30,  3.68it/s]
100%|█████████▉| 370920/371472 [7:21:03<02:26,  3.77it/s]
                                                         
{'loss': 2.5845, 'learning_rate': 1.0133810252321748e-07, 'epoch': 15.98}

100%|█████████▉| 370920/371472 [7:21:03<02:26,  3.77it/s]
100%|█████████▉| 370921/371472 [7:21:04<02:26,  3.77it/s]
100%|█████████▉| 370922/371472 [7:21:04<02:24,  3.81it/s]
100%|█████████▉| 370923/371472 [7:21:04<02:20,  3.91it/s]
100%|█████████▉| 370924/371472 [7:21:05<02:33,  3.57it/s]
100%|█████████▉| 370925/371472 [7:21:05<02:31,  3.61it/s]
100%|█████████▉| 370926/371472 [7:21:05<02:36,  3.49it/s]
100%|█████████▉| 370927/371472 [7:21:06<02:44,  3.31it/s]
100%|█████████▉| 370928/371472 [7:21:06<02:46,  3.26it/s]
100%|█████████▉| 370929/371472 [7:21:06<02:47,  3.24it/s]
100%|█████████▉| 370930/371472 [7:21:06<02:42,  3.33it/s]
100%|█████████▉| 370931/371472 [7:21:07<02:48,  3.22it/s]
100%|█████████▉| 370932/371472 [7:21:07<02:40,  3.37it/s]
100%|█████████▉| 370933/371472 [7:21:07<02:55,  3.06it/s]
100%|█████████▉| 370934/371472 [7:21:08<02:44,  3.28it/s]
100%|█████████▉| 370935/371472 [7:21:08<02:36,  3.42it/s]
100%|█████████▉| 370936/371472 [7:21:08<02:31,  3.53it/s]
100%|█████████▉| 370937/371472 [7:21:08<02:29,  3.58it/s]
100%|█████████▉| 370938/371472 [7:21:09<02:34,  3.46it/s]
100%|█████████▉| 370939/371472 [7:21:09<02:25,  3.66it/s]
100%|█████████▉| 370940/371472 [7:21:09<02:25,  3.65it/s]
                                                         
{'loss': 2.4867, 'learning_rate': 1.0128962054773854e-07, 'epoch': 15.98}

100%|█████████▉| 370940/371472 [7:21:09<02:25,  3.65it/s]
100%|█████████▉| 370941/371472 [7:21:10<02:23,  3.70it/s]
100%|█████████▉| 370942/371472 [7:21:10<02:22,  3.73it/s]
100%|█████████▉| 370943/371472 [7:21:10<02:21,  3.75it/s]
100%|█████████▉| 370944/371472 [7:21:10<02:21,  3.73it/s]
100%|█████████▉| 370945/371472 [7:21:11<02:25,  3.62it/s]
100%|█████████▉| 370946/371472 [7:21:11<02:25,  3.63it/s]
100%|█████████▉| 370947/371472 [7:21:11<02:20,  3.73it/s]
100%|█████████▉| 370948/371472 [7:21:11<02:20,  3.73it/s]
100%|█████████▉| 370949/371472 [7:21:12<02:22,  3.66it/s]
100%|█████████▉| 370950/371472 [7:21:12<02:43,  3.20it/s]
100%|█████████▉| 370951/371472 [7:21:12<02:42,  3.22it/s]
100%|█████████▉| 370952/371472 [7:21:13<02:37,  3.30it/s]
100%|█████████▉| 370953/371472 [7:21:13<02:31,  3.43it/s]
100%|█████████▉| 370954/371472 [7:21:13<02:29,  3.47it/s]
100%|█████████▉| 370955/371472 [7:21:14<02:35,  3.33it/s]
100%|█████████▉| 370956/371472 [7:21:14<02:31,  3.40it/s]
100%|█████████▉| 370957/371472 [7:21:14<02:39,  3.23it/s]
100%|█████████▉| 370958/371472 [7:21:14<02:31,  3.39it/s]
100%|█████████▉| 370959/371472 [7:21:15<02:29,  3.43it/s]
100%|█████████▉| 370960/371472 [7:21:15<02:24,  3.56it/s]
                                                         
{'loss': 2.4833, 'learning_rate': 1.012411385722597e-07, 'epoch': 15.98}

100%|█████████▉| 370960/371472 [7:21:15<02:24,  3.56it/s]
100%|█████████▉| 370961/371472 [7:21:15<02:25,  3.50it/s]
100%|█████████▉| 370962/371472 [7:21:16<02:21,  3.60it/s]
100%|█████████▉| 370963/371472 [7:21:16<02:15,  3.74it/s]
100%|█████████▉| 370964/371472 [7:21:16<02:18,  3.66it/s]
100%|█████████▉| 370965/371472 [7:21:16<02:26,  3.46it/s]
100%|█████████▉| 370966/371472 [7:21:17<02:47,  3.01it/s]
100%|█████████▉| 370967/371472 [7:21:17<02:43,  3.08it/s]
100%|█████████▉| 370968/371472 [7:21:17<02:32,  3.30it/s]
100%|█████████▉| 370969/371472 [7:21:18<02:29,  3.37it/s]
100%|█████████▉| 370970/371472 [7:21:18<02:29,  3.36it/s]
100%|█████████▉| 370971/371472 [7:21:18<02:24,  3.46it/s]
100%|█████████▉| 370972/371472 [7:21:19<02:21,  3.52it/s]
100%|█████████▉| 370973/371472 [7:21:19<02:17,  3.62it/s]
100%|█████████▉| 370974/371472 [7:21:19<02:13,  3.73it/s]
100%|█████████▉| 370975/371472 [7:21:19<02:19,  3.56it/s]
100%|█████████▉| 370976/371472 [7:21:20<02:17,  3.61it/s]
100%|█████████▉| 370977/371472 [7:21:20<02:21,  3.49it/s]
100%|█████████▉| 370978/371472 [7:21:20<02:24,  3.41it/s]
100%|█████████▉| 370979/371472 [7:21:21<02:19,  3.54it/s]
100%|█████████▉| 370980/371472 [7:21:21<02:14,  3.66it/s]
                                                         
{'loss': 2.4574, 'learning_rate': 1.0119265659678076e-07, 'epoch': 15.98}

100%|█████████▉| 370980/371472 [7:21:21<02:14,  3.66it/s]
100%|█████████▉| 370981/371472 [7:21:21<02:35,  3.16it/s]
100%|█████████▉| 370982/371472 [7:21:21<02:33,  3.19it/s]
100%|█████████▉| 370983/371472 [7:21:22<02:23,  3.40it/s]
100%|█████████▉| 370984/371472 [7:21:22<02:16,  3.57it/s]
100%|█████████▉| 370985/371472 [7:21:22<02:17,  3.53it/s]
100%|█████████▉| 370986/371472 [7:21:23<02:14,  3.62it/s]
100%|█████████▉| 370987/371472 [7:21:23<02:15,  3.57it/s]
100%|█████████▉| 370988/371472 [7:21:23<02:12,  3.66it/s]
100%|█████████▉| 370989/371472 [7:21:23<02:24,  3.34it/s]
100%|█████████▉| 370990/371472 [7:21:24<02:17,  3.51it/s]
100%|█████████▉| 370991/371472 [7:21:24<02:26,  3.27it/s]
100%|█████████▉| 370992/371472 [7:21:24<02:22,  3.36it/s]
100%|█████████▉| 370993/371472 [7:21:25<02:21,  3.38it/s]
100%|█████████▉| 370994/371472 [7:21:25<02:20,  3.41it/s]
100%|█████████▉| 370995/371472 [7:21:25<02:14,  3.54it/s]
100%|█████████▉| 370996/371472 [7:21:25<02:12,  3.60it/s]
100%|█████████▉| 370997/371472 [7:21:26<02:13,  3.56it/s]
100%|█████████▉| 370998/371472 [7:21:26<02:11,  3.61it/s]
100%|█████████▉| 370999/371472 [7:21:26<02:12,  3.58it/s]
100%|█████████▉| 371000/371472 [7:21:27<02:10,  3.62it/s]
                                                         
{'loss': 2.5831, 'learning_rate': 1.0114417462130191e-07, 'epoch': 15.98}

100%|█████████▉| 371000/371472 [7:21:27<02:10,  3.62it/s]
100%|█████████▉| 371001/371472 [7:21:27<02:10,  3.60it/s]
100%|█████████▉| 371002/371472 [7:21:27<02:12,  3.54it/s]
100%|█████████▉| 371003/371472 [7:21:27<02:15,  3.45it/s]
100%|█████████▉| 371004/371472 [7:21:28<02:20,  3.34it/s]
100%|█████████▉| 371005/371472 [7:21:28<02:15,  3.44it/s]
100%|█████████▉| 371006/371472 [7:21:28<02:12,  3.51it/s]
100%|█████████▉| 371007/371472 [7:21:29<02:07,  3.65it/s]
100%|█████████▉| 371008/371472 [7:21:29<02:13,  3.48it/s]
100%|█████████▉| 371009/371472 [7:21:29<02:10,  3.54it/s]
100%|█████████▉| 371010/371472 [7:21:29<02:12,  3.49it/s]
100%|█████████▉| 371011/371472 [7:21:30<02:14,  3.44it/s]
100%|█████████▉| 371012/371472 [7:21:30<02:09,  3.56it/s]
100%|█████████▉| 371013/371472 [7:21:30<02:07,  3.61it/s]
100%|█████████▉| 371014/371472 [7:21:31<02:05,  3.64it/s]
100%|█████████▉| 371015/371472 [7:21:31<02:08,  3.55it/s]
100%|█████████▉| 371016/371472 [7:21:31<02:05,  3.64it/s]
100%|█████████▉| 371017/371472 [7:21:31<02:11,  3.45it/s]
100%|█████████▉| 371018/371472 [7:21:32<02:21,  3.20it/s]
100%|█████████▉| 371019/371472 [7:21:32<02:13,  3.39it/s]
100%|█████████▉| 371020/371472 [7:21:32<02:14,  3.37it/s]
                                                         
{'loss': 2.6038, 'learning_rate': 1.0109569264582297e-07, 'epoch': 15.98}

100%|█████████▉| 371020/371472 [7:21:32<02:14,  3.37it/s]
100%|█████████▉| 371021/371472 [7:21:33<02:05,  3.58it/s]
100%|█████████▉| 371022/371472 [7:21:33<02:13,  3.38it/s]
100%|█████████▉| 371023/371472 [7:21:33<02:10,  3.43it/s]
100%|█████████▉| 371024/371472 [7:21:33<02:03,  3.63it/s]
100%|█████████▉| 371025/371472 [7:21:34<02:11,  3.39it/s]
100%|█████████▉| 371026/371472 [7:21:34<02:10,  3.42it/s]
100%|█████████▉| 371027/371472 [7:21:34<02:08,  3.45it/s]
100%|█████████▉| 371028/371472 [7:21:35<02:05,  3.55it/s]
100%|█████████▉| 371029/371472 [7:21:35<02:14,  3.28it/s]
100%|█████████▉| 371030/371472 [7:21:35<02:13,  3.32it/s]
100%|█████████▉| 371031/371472 [7:21:35<02:05,  3.52it/s]
100%|█████████▉| 371032/371472 [7:21:36<02:00,  3.66it/s]
100%|█████████▉| 371033/371472 [7:21:36<01:56,  3.77it/s]
100%|█████████▉| 371034/371472 [7:21:36<02:07,  3.42it/s]
100%|█████████▉| 371035/371472 [7:21:37<02:03,  3.54it/s]
100%|█████████▉| 371036/371472 [7:21:37<02:00,  3.62it/s]
100%|█████████▉| 371037/371472 [7:21:37<01:56,  3.74it/s]
100%|█████████▉| 371038/371472 [7:21:37<01:58,  3.68it/s]
100%|█████████▉| 371039/371472 [7:21:38<01:54,  3.77it/s]
100%|█████████▉| 371040/371472 [7:21:38<01:54,  3.77it/s]
                                                         
{'loss': 2.6344, 'learning_rate': 1.0104721067034412e-07, 'epoch': 15.98}

100%|█████████▉| 371040/371472 [7:21:38<01:54,  3.77it/s]
100%|█████████▉| 371041/371472 [7:21:38<01:58,  3.64it/s]
100%|█████████▉| 371042/371472 [7:21:38<01:55,  3.71it/s]
100%|█████████▉| 371043/371472 [7:21:39<01:55,  3.73it/s]
100%|█████████▉| 371044/371472 [7:21:39<01:54,  3.73it/s]
100%|█████████▉| 371045/371472 [7:21:39<01:57,  3.64it/s]
100%|█████████▉| 371046/371472 [7:21:40<01:58,  3.59it/s]
100%|█████████▉| 371047/371472 [7:21:40<02:02,  3.47it/s]
100%|█████████▉| 371048/371472 [7:21:40<02:08,  3.30it/s]
100%|█████████▉| 371049/371472 [7:21:40<02:04,  3.40it/s]
100%|█████████▉| 371050/371472 [7:21:41<02:02,  3.44it/s]
100%|█████████▉| 371051/371472 [7:21:41<02:07,  3.30it/s]
100%|█████████▉| 371052/371472 [7:21:41<02:02,  3.43it/s]
100%|█████████▉| 371053/371472 [7:21:42<01:57,  3.58it/s]
100%|█████████▉| 371054/371472 [7:21:42<01:55,  3.63it/s]
100%|█████████▉| 371055/371472 [7:21:42<01:54,  3.65it/s]
100%|█████████▉| 371056/371472 [7:21:42<01:51,  3.73it/s]
100%|█████████▉| 371057/371472 [7:21:43<01:59,  3.46it/s]
100%|█████████▉| 371058/371472 [7:21:43<02:00,  3.43it/s]
100%|█████████▉| 371059/371472 [7:21:43<01:59,  3.46it/s]
100%|█████████▉| 371060/371472 [7:21:44<01:56,  3.54it/s]
                                                         
{'loss': 2.6479, 'learning_rate': 1.0099872869486518e-07, 'epoch': 15.98}

100%|█████████▉| 371060/371472 [7:21:44<01:56,  3.54it/s]
100%|█████████▉| 371061/371472 [7:21:44<01:54,  3.60it/s]
100%|█████████▉| 371062/371472 [7:21:44<01:49,  3.73it/s]
100%|█████████▉| 371063/371472 [7:21:44<01:49,  3.74it/s]
100%|█████████▉| 371064/371472 [7:21:45<01:50,  3.69it/s]
100%|█████████▉| 371065/371472 [7:21:45<01:48,  3.75it/s]
100%|█████████▉| 371066/371472 [7:21:45<01:49,  3.72it/s]
100%|█████████▉| 371067/371472 [7:21:45<01:47,  3.77it/s]
100%|█████████▉| 371068/371472 [7:21:46<01:47,  3.76it/s]
100%|█████████▉| 371069/371472 [7:21:46<01:48,  3.71it/s]
100%|█████████▉| 371070/371472 [7:21:46<01:53,  3.54it/s]
100%|█████████▉| 371071/371472 [7:21:47<02:02,  3.28it/s]
100%|█████████▉| 371072/371472 [7:21:47<02:01,  3.29it/s]
100%|█████████▉| 371073/371472 [7:21:47<02:04,  3.21it/s]
100%|█████████▉| 371074/371472 [7:21:48<01:56,  3.42it/s]
100%|█████████▉| 371075/371472 [7:21:48<01:51,  3.57it/s]
100%|█████████▉| 371076/371472 [7:21:48<01:51,  3.55it/s]
100%|█████████▉| 371077/371472 [7:21:48<01:51,  3.55it/s]
100%|█████████▉| 371078/371472 [7:21:49<01:48,  3.63it/s]
100%|█████████▉| 371079/371472 [7:21:49<01:46,  3.70it/s]
100%|█████████▉| 371080/371472 [7:21:49<01:43,  3.80it/s]
                                                         
{'loss': 2.6846, 'learning_rate': 1.0095024671938635e-07, 'epoch': 15.98}

100%|█████████▉| 371080/371472 [7:21:49<01:43,  3.80it/s]
100%|█████████▉| 371081/371472 [7:21:49<01:43,  3.77it/s]
100%|█████████▉| 371082/371472 [7:21:50<01:56,  3.33it/s]
100%|█████████▉| 371083/371472 [7:21:50<02:05,  3.10it/s]
100%|█████████▉| 371084/371472 [7:21:50<02:03,  3.14it/s]
100%|█████████▉| 371085/371472 [7:21:51<02:01,  3.18it/s]
100%|█████████▉| 371086/371472 [7:21:51<01:59,  3.24it/s]
100%|█████████▉| 371087/371472 [7:21:51<01:54,  3.35it/s]
100%|█████████▉| 371088/371472 [7:21:52<01:52,  3.41it/s]
100%|█████████▉| 371089/371472 [7:21:52<01:55,  3.32it/s]
100%|█████████▉| 371090/371472 [7:21:52<01:53,  3.36it/s]
100%|█████████▉| 371091/371472 [7:21:52<01:49,  3.49it/s]
100%|█████████▉| 371092/371472 [7:21:53<01:48,  3.51it/s]
100%|█████████▉| 371093/371472 [7:21:53<01:45,  3.59it/s]
100%|█████████▉| 371094/371472 [7:21:53<01:49,  3.45it/s]
100%|█████████▉| 371095/371472 [7:21:54<01:50,  3.42it/s]
100%|█████████▉| 371096/371472 [7:21:54<01:52,  3.35it/s]
100%|█████████▉| 371097/371472 [7:21:54<01:52,  3.34it/s]
100%|█████████▉| 371098/371472 [7:21:55<01:48,  3.43it/s]
100%|█████████▉| 371099/371472 [7:21:55<01:46,  3.51it/s]
100%|█████████▉| 371100/371472 [7:21:55<01:46,  3.49it/s]
                                                         
{'loss': 2.5628, 'learning_rate': 1.009017647439074e-07, 'epoch': 15.98}

100%|█████████▉| 371100/371472 [7:21:55<01:46,  3.49it/s]
100%|█████████▉| 371101/371472 [7:21:55<01:51,  3.34it/s]
100%|█████████▉| 371102/371472 [7:21:56<01:45,  3.50it/s]
100%|█████████▉| 371103/371472 [7:21:56<01:40,  3.67it/s]
100%|█████████▉| 371104/371472 [7:21:56<01:47,  3.44it/s]
100%|█████████▉| 371105/371472 [7:21:57<01:46,  3.44it/s]
100%|█████████▉| 371106/371472 [7:21:57<01:50,  3.31it/s]
100%|█████████▉| 371107/371472 [7:21:57<01:49,  3.33it/s]
100%|█████████▉| 371108/371472 [7:21:57<01:46,  3.43it/s]
100%|█████████▉| 371109/371472 [7:21:58<01:42,  3.54it/s]
100%|█████████▉| 371110/371472 [7:21:58<01:42,  3.53it/s]
100%|█████████▉| 371111/371472 [7:21:58<01:41,  3.54it/s]
100%|█████████▉| 371112/371472 [7:21:59<01:42,  3.53it/s]
100%|█████████▉| 371113/371472 [7:21:59<01:39,  3.61it/s]
100%|█████████▉| 371114/371472 [7:21:59<01:39,  3.61it/s]
100%|█████████▉| 371115/371472 [7:21:59<01:39,  3.58it/s]
100%|█████████▉| 371116/371472 [7:22:00<01:47,  3.31it/s]
100%|█████████▉| 371117/371472 [7:22:00<01:43,  3.43it/s]
100%|█████████▉| 371118/371472 [7:22:00<01:44,  3.40it/s]
100%|█████████▉| 371119/371472 [7:22:01<01:39,  3.54it/s]
100%|█████████▉| 371120/371472 [7:22:01<01:38,  3.57it/s]
                                                         
{'loss': 2.5493, 'learning_rate': 1.0085328276842855e-07, 'epoch': 15.98}

100%|█████████▉| 371120/371472 [7:22:01<01:38,  3.57it/s]
100%|█████████▉| 371121/371472 [7:22:01<01:41,  3.47it/s]
100%|█████████▉| 371122/371472 [7:22:01<01:38,  3.54it/s]
100%|█████████▉| 371123/371472 [7:22:02<01:36,  3.61it/s]
100%|█████████▉| 371124/371472 [7:22:02<01:34,  3.67it/s]
100%|█████████▉| 371125/371472 [7:22:02<01:32,  3.77it/s]
100%|█████████▉| 371126/371472 [7:22:02<01:31,  3.76it/s]
100%|█████████▉| 371127/371472 [7:22:03<01:31,  3.75it/s]
100%|█████████▉| 371128/371472 [7:22:03<01:36,  3.55it/s]
100%|█████████▉| 371129/371472 [7:22:03<01:36,  3.55it/s]
100%|█████████▉| 371130/371472 [7:22:04<01:38,  3.47it/s]
100%|█████████▉| 371131/371472 [7:22:04<01:37,  3.50it/s]
100%|█████████▉| 371132/371472 [7:22:04<01:34,  3.60it/s]
100%|█████████▉| 371133/371472 [7:22:04<01:41,  3.35it/s]
100%|█████████▉| 371134/371472 [7:22:05<01:45,  3.20it/s]
100%|█████████▉| 371135/371472 [7:22:05<01:41,  3.33it/s]
100%|█████████▉| 371136/371472 [7:22:05<01:46,  3.17it/s]
100%|█████████▉| 371137/371472 [7:22:06<01:39,  3.36it/s]
100%|█████████▉| 371138/371472 [7:22:06<01:38,  3.39it/s]
100%|█████████▉| 371139/371472 [7:22:06<01:38,  3.39it/s]
100%|█████████▉| 371140/371472 [7:22:07<01:42,  3.23it/s]
                                                         
{'loss': 2.4884, 'learning_rate': 1.0080480079294961e-07, 'epoch': 15.99}

100%|█████████▉| 371140/371472 [7:22:07<01:42,  3.23it/s]
100%|█████████▉| 371141/371472 [7:22:07<01:40,  3.28it/s]
100%|█████████▉| 371142/371472 [7:22:07<01:36,  3.43it/s]
100%|█████████▉| 371143/371472 [7:22:07<01:34,  3.49it/s]
100%|█████████▉| 371144/371472 [7:22:08<01:31,  3.58it/s]
100%|█████████▉| 371145/371472 [7:22:08<01:29,  3.67it/s]
100%|█████████▉| 371146/371472 [7:22:08<01:28,  3.69it/s]
100%|█████████▉| 371147/371472 [7:22:09<01:30,  3.59it/s]
100%|█████████▉| 371148/371472 [7:22:09<01:29,  3.60it/s]
100%|█████████▉| 371149/371472 [7:22:09<01:29,  3.62it/s]
100%|█████████▉| 371150/371472 [7:22:09<01:28,  3.63it/s]
100%|█████████▉| 371151/371472 [7:22:10<01:27,  3.67it/s]
100%|█████████▉| 371152/371472 [7:22:10<01:30,  3.52it/s]
100%|█████████▉| 371153/371472 [7:22:10<01:37,  3.29it/s]
100%|█████████▉| 371154/371472 [7:22:11<01:33,  3.42it/s]
100%|█████████▉| 371155/371472 [7:22:11<01:53,  2.80it/s]
100%|█████████▉| 371156/371472 [7:22:11<01:46,  2.97it/s]
100%|█████████▉| 371157/371472 [7:22:12<01:40,  3.12it/s]
100%|█████████▉| 371158/371472 [7:22:12<01:34,  3.31it/s]
100%|█████████▉| 371159/371472 [7:22:12<01:36,  3.23it/s]
100%|█████████▉| 371160/371472 [7:22:12<01:30,  3.44it/s]
                                                         
{'loss': 2.6734, 'learning_rate': 1.0075631881747078e-07, 'epoch': 15.99}

100%|█████████▉| 371160/371472 [7:22:12<01:30,  3.44it/s]
100%|█████████▉| 371161/371472 [7:22:13<01:28,  3.53it/s]
100%|█████████▉| 371162/371472 [7:22:13<01:23,  3.69it/s]
100%|█████████▉| 371163/371472 [7:22:13<01:23,  3.72it/s]
100%|█████████▉| 371164/371472 [7:22:14<01:23,  3.70it/s]
100%|█████████▉| 371165/371472 [7:22:14<01:22,  3.70it/s]
100%|█████████▉| 371166/371472 [7:22:14<01:25,  3.58it/s]
100%|█████████▉| 371167/371472 [7:22:14<01:24,  3.60it/s]
100%|█████████▉| 371168/371472 [7:22:15<01:23,  3.64it/s]
100%|█████████▉| 371169/371472 [7:22:15<01:23,  3.61it/s]
100%|█████████▉| 371170/371472 [7:22:15<01:22,  3.68it/s]
100%|█████████▉| 371171/371472 [7:22:15<01:22,  3.66it/s]
100%|█████████▉| 371172/371472 [7:22:16<01:22,  3.62it/s]
100%|█████████▉| 371173/371472 [7:22:16<01:20,  3.69it/s]
100%|█████████▉| 371174/371472 [7:22:16<01:25,  3.49it/s]
100%|█████████▉| 371175/371472 [7:22:17<01:23,  3.55it/s]
100%|█████████▉| 371176/371472 [7:22:17<01:19,  3.73it/s]
100%|█████████▉| 371177/371472 [7:22:17<01:27,  3.39it/s]
100%|█████████▉| 371178/371472 [7:22:17<01:22,  3.58it/s]
100%|█████████▉| 371179/371472 [7:22:18<01:19,  3.69it/s]
100%|█████████▉| 371180/371472 [7:22:18<01:17,  3.76it/s]
                                                         
{'loss': 2.6717, 'learning_rate': 1.0070783684199184e-07, 'epoch': 15.99}

100%|█████████▉| 371180/371472 [7:22:18<01:17,  3.76it/s]
100%|█████████▉| 371181/371472 [7:22:18<01:16,  3.80it/s]
100%|█████████▉| 371182/371472 [7:22:18<01:17,  3.76it/s]
100%|█████████▉| 371183/371472 [7:22:19<01:17,  3.74it/s]
100%|█████████▉| 371184/371472 [7:22:19<01:17,  3.70it/s]
100%|█████████▉| 371185/371472 [7:22:19<01:14,  3.84it/s]
100%|█████████▉| 371186/371472 [7:22:19<01:15,  3.80it/s]
100%|█████████▉| 371187/371472 [7:22:20<01:17,  3.66it/s]
100%|█████████▉| 371188/371472 [7:22:20<01:19,  3.59it/s]
100%|█████████▉| 371189/371472 [7:22:20<01:23,  3.38it/s]
100%|█████████▉| 371190/371472 [7:22:21<01:31,  3.08it/s]
100%|█████████▉| 371191/371472 [7:22:21<01:31,  3.07it/s]
100%|█████████▉| 371192/371472 [7:22:21<01:26,  3.25it/s]
100%|█████████▉| 371193/371472 [7:22:22<01:21,  3.44it/s]
100%|█████████▉| 371194/371472 [7:22:22<01:20,  3.46it/s]
100%|█████████▉| 371195/371472 [7:22:22<01:18,  3.54it/s]
100%|█████████▉| 371196/371472 [7:22:22<01:15,  3.64it/s]
100%|█████████▉| 371197/371472 [7:22:23<01:13,  3.75it/s]
100%|█████████▉| 371198/371472 [7:22:23<01:12,  3.80it/s]
100%|█████████▉| 371199/371472 [7:22:23<01:10,  3.90it/s]
100%|█████████▉| 371200/371472 [7:22:23<01:11,  3.78it/s]
                                                         
{'loss': 2.4994, 'learning_rate': 1.0065935486651299e-07, 'epoch': 15.99}

100%|█████████▉| 371200/371472 [7:22:23<01:11,  3.78it/s]
100%|█████████▉| 371201/371472 [7:22:24<01:11,  3.77it/s]
100%|█████████▉| 371202/371472 [7:22:24<01:11,  3.79it/s]
100%|█████████▉| 371203/371472 [7:22:24<01:14,  3.63it/s]
100%|█████████▉| 371204/371472 [7:22:25<01:13,  3.65it/s]
100%|█████████▉| 371205/371472 [7:22:25<01:13,  3.63it/s]
100%|█████████▉| 371206/371472 [7:22:25<01:14,  3.55it/s]
100%|█████████▉| 371207/371472 [7:22:25<01:17,  3.43it/s]
100%|█████████▉| 371208/371472 [7:22:26<01:15,  3.50it/s]
100%|█████████▉| 371209/371472 [7:22:26<01:15,  3.49it/s]
100%|█████████▉| 371210/371472 [7:22:26<01:14,  3.53it/s]
100%|█████████▉| 371211/371472 [7:22:27<01:13,  3.54it/s]
100%|█████████▉| 371212/371472 [7:22:27<01:11,  3.64it/s]
100%|█████████▉| 371213/371472 [7:22:27<01:08,  3.75it/s]
100%|█████████▉| 371214/371472 [7:22:27<01:07,  3.84it/s]
100%|█████████▉| 371215/371472 [7:22:28<01:07,  3.78it/s]
100%|█████████▉| 371216/371472 [7:22:28<01:11,  3.57it/s]
100%|█████████▉| 371217/371472 [7:22:28<01:15,  3.40it/s]
100%|█████████▉| 371218/371472 [7:22:29<01:20,  3.16it/s]
100%|█████████▉| 371219/371472 [7:22:29<01:16,  3.31it/s]
100%|█████████▉| 371220/371472 [7:22:29<01:11,  3.51it/s]
                                                         
{'loss': 2.572, 'learning_rate': 1.0061087289103406e-07, 'epoch': 15.99}

100%|█████████▉| 371220/371472 [7:22:29<01:11,  3.51it/s]
100%|█████████▉| 371221/371472 [7:22:29<01:13,  3.41it/s]
100%|█████████▉| 371222/371472 [7:22:30<01:11,  3.51it/s]
100%|█████████▉| 371223/371472 [7:22:30<01:12,  3.44it/s]
100%|█████████▉| 371224/371472 [7:22:30<01:10,  3.52it/s]
100%|█████████▉| 371225/371472 [7:22:31<01:08,  3.62it/s]
100%|█████████▉| 371226/371472 [7:22:31<01:09,  3.54it/s]
100%|█████████▉| 371227/371472 [7:22:31<01:12,  3.36it/s]
100%|█████████▉| 371228/371472 [7:22:31<01:09,  3.52it/s]
100%|█████████▉| 371229/371472 [7:22:32<01:11,  3.39it/s]
100%|█████████▉| 371230/371472 [7:22:32<01:09,  3.49it/s]
100%|█████████▉| 371231/371472 [7:22:32<01:13,  3.26it/s]
100%|█████████▉| 371232/371472 [7:22:33<01:10,  3.40it/s]
100%|█████████▉| 371233/371472 [7:22:33<01:10,  3.40it/s]
100%|█████████▉| 371234/371472 [7:22:33<01:13,  3.24it/s]
100%|█████████▉| 371235/371472 [7:22:34<01:10,  3.38it/s]
100%|█████████▉| 371236/371472 [7:22:34<01:07,  3.47it/s]
100%|█████████▉| 371237/371472 [7:22:34<01:10,  3.35it/s]
100%|█████████▉| 371238/371472 [7:22:34<01:09,  3.35it/s]
100%|█████████▉| 371239/371472 [7:22:35<01:05,  3.55it/s]
100%|█████████▉| 371240/371472 [7:22:35<01:02,  3.69it/s]
                                                         
{'loss': 2.6734, 'learning_rate': 1.0056239091555521e-07, 'epoch': 15.99}

100%|█████████▉| 371240/371472 [7:22:35<01:02,  3.69it/s]
100%|█████████▉| 371241/371472 [7:22:35<01:06,  3.49it/s]
100%|█████████▉| 371242/371472 [7:22:36<01:07,  3.39it/s]
100%|█████████▉| 371243/371472 [7:22:36<01:04,  3.56it/s]
100%|█████████▉| 371244/371472 [7:22:36<01:02,  3.63it/s]
100%|█████████▉| 371245/371472 [7:22:36<01:03,  3.60it/s]
100%|█████████▉| 371246/371472 [7:22:37<01:03,  3.58it/s]
100%|█████████▉| 371247/371472 [7:22:37<01:00,  3.72it/s]
100%|█████████▉| 371248/371472 [7:22:37<01:00,  3.68it/s]
100%|█████████▉| 371249/371472 [7:22:37<01:00,  3.66it/s]
100%|█████████▉| 371250/371472 [7:22:38<01:05,  3.37it/s]
100%|█████████▉| 371251/371472 [7:22:38<01:01,  3.59it/s]
100%|█████████▉| 371252/371472 [7:22:38<00:59,  3.69it/s]
100%|█████████▉| 371253/371472 [7:22:39<00:59,  3.68it/s]
100%|█████████▉| 371254/371472 [7:22:39<01:01,  3.57it/s]
100%|█████████▉| 371255/371472 [7:22:39<01:01,  3.54it/s]
100%|█████████▉| 371256/371472 [7:22:39<01:01,  3.52it/s]
100%|█████████▉| 371257/371472 [7:22:40<00:58,  3.66it/s]
100%|█████████▉| 371258/371472 [7:22:40<00:57,  3.75it/s]
100%|█████████▉| 371259/371472 [7:22:40<00:56,  3.74it/s]
100%|█████████▉| 371260/371472 [7:22:40<00:58,  3.64it/s]
                                                         
{'loss': 2.573, 'learning_rate': 1.0051390894007627e-07, 'epoch': 15.99}

100%|█████████▉| 371260/371472 [7:22:41<00:58,  3.64it/s]
100%|█████████▉| 371261/371472 [7:22:41<00:57,  3.65it/s]
100%|█████████▉| 371262/371472 [7:22:41<01:00,  3.44it/s]
100%|█████████▉| 371263/371472 [7:22:41<01:00,  3.46it/s]
100%|█████████▉| 371264/371472 [7:22:42<01:05,  3.18it/s]
100%|█████████▉| 371265/371472 [7:22:42<01:01,  3.36it/s]
100%|█████████▉| 371266/371472 [7:22:42<00:59,  3.48it/s]
100%|█████████▉| 371267/371472 [7:22:43<00:58,  3.51it/s]
100%|█████████▉| 371268/371472 [7:22:43<00:56,  3.62it/s]
100%|█████████▉| 371269/371472 [7:22:43<00:56,  3.58it/s]
100%|█████████▉| 371270/371472 [7:22:43<00:59,  3.41it/s]
100%|█████████▉| 371271/371472 [7:22:44<00:56,  3.55it/s]
100%|█████████▉| 371272/371472 [7:22:44<00:54,  3.69it/s]
100%|█████████▉| 371273/371472 [7:22:44<00:57,  3.47it/s]
100%|█████████▉| 371274/371472 [7:22:44<00:54,  3.66it/s]
100%|█████████▉| 371275/371472 [7:22:45<00:55,  3.54it/s]
100%|█████████▉| 371276/371472 [7:22:45<00:54,  3.62it/s]
100%|█████████▉| 371277/371472 [7:22:45<00:53,  3.66it/s]
100%|█████████▉| 371278/371472 [7:22:46<01:02,  3.10it/s]
100%|█████████▉| 371279/371472 [7:22:46<00:58,  3.31it/s]
100%|█████████▉| 371280/371472 [7:22:46<00:57,  3.34it/s]
                                                         
{'loss': 2.5661, 'learning_rate': 1.0046542696459742e-07, 'epoch': 15.99}

100%|█████████▉| 371280/371472 [7:22:46<00:57,  3.34it/s]
100%|█████████▉| 371281/371472 [7:22:47<00:55,  3.44it/s]
100%|█████████▉| 371282/371472 [7:22:47<00:52,  3.61it/s]
100%|█████████▉| 371283/371472 [7:22:47<00:53,  3.51it/s]
100%|█████████▉| 371284/371472 [7:22:47<00:52,  3.57it/s]
100%|█████████▉| 371285/371472 [7:22:48<00:49,  3.76it/s]
100%|█████████▉| 371286/371472 [7:22:48<00:51,  3.62it/s]
100%|█████████▉| 371287/371472 [7:22:48<00:50,  3.66it/s]
100%|█████████▉| 371288/371472 [7:22:49<00:53,  3.47it/s]
100%|█████████▉| 371289/371472 [7:22:49<00:50,  3.62it/s]
100%|█████████▉| 371290/371472 [7:22:49<00:56,  3.22it/s]
100%|█████████▉| 371291/371472 [7:22:49<00:54,  3.33it/s]
100%|█████████▉| 371292/371472 [7:22:50<00:51,  3.52it/s]
100%|█████████▉| 371293/371472 [7:22:50<00:50,  3.52it/s]
100%|█████████▉| 371294/371472 [7:22:50<00:49,  3.61it/s]
100%|█████████▉| 371295/371472 [7:22:51<00:50,  3.48it/s]
100%|█████████▉| 371296/371472 [7:22:51<00:52,  3.34it/s]
100%|█████████▉| 371297/371472 [7:22:51<00:52,  3.34it/s]
100%|█████████▉| 371298/371472 [7:22:51<00:52,  3.34it/s]
100%|█████████▉| 371299/371472 [7:22:52<00:50,  3.45it/s]
100%|█████████▉| 371300/371472 [7:22:52<00:48,  3.53it/s]
                                                         
{'loss': 2.5232, 'learning_rate': 1.0041694498911848e-07, 'epoch': 15.99}

100%|█████████▉| 371300/371472 [7:22:52<00:48,  3.53it/s]
100%|█████████▉| 371301/371472 [7:22:52<00:49,  3.42it/s]
100%|█████████▉| 371302/371472 [7:22:53<00:51,  3.29it/s]
100%|█████████▉| 371303/371472 [7:22:53<00:50,  3.36it/s]
100%|█████████▉| 371304/371472 [7:22:53<00:49,  3.42it/s]
100%|█████████▉| 371305/371472 [7:22:53<00:47,  3.52it/s]
100%|█████████▉| 371306/371472 [7:22:54<00:47,  3.53it/s]
100%|█████████▉| 371307/371472 [7:22:54<00:46,  3.52it/s]
100%|█████████▉| 371308/371472 [7:22:54<00:47,  3.48it/s]
100%|█████████▉| 371309/371472 [7:22:55<00:45,  3.61it/s]
100%|█████████▉| 371310/371472 [7:22:55<00:45,  3.57it/s]
100%|█████████▉| 371311/371472 [7:22:55<00:43,  3.69it/s]
100%|█████████▉| 371312/371472 [7:22:55<00:43,  3.69it/s]
100%|█████████▉| 371313/371472 [7:22:56<00:42,  3.74it/s]
100%|█████████▉| 371314/371472 [7:22:56<00:45,  3.49it/s]
100%|█████████▉| 371315/371472 [7:22:56<00:47,  3.33it/s]
100%|█████████▉| 371316/371472 [7:22:57<00:44,  3.50it/s]
100%|█████████▉| 371317/371472 [7:22:57<00:43,  3.57it/s]
100%|█████████▉| 371318/371472 [7:22:57<00:44,  3.50it/s]
100%|█████████▉| 371319/371472 [7:22:57<00:47,  3.25it/s]
100%|█████████▉| 371320/371472 [7:22:58<00:45,  3.34it/s]
                                                         
{'loss': 2.5395, 'learning_rate': 1.0036846301363964e-07, 'epoch': 15.99}

100%|█████████▉| 371320/371472 [7:22:58<00:45,  3.34it/s]
100%|█████████▉| 371321/371472 [7:22:58<00:44,  3.39it/s]
100%|█████████▉| 371322/371472 [7:22:58<00:43,  3.45it/s]
100%|█████████▉| 371323/371472 [7:22:59<00:42,  3.51it/s]
100%|█████████▉| 371324/371472 [7:22:59<00:43,  3.40it/s]
100%|█████████▉| 371325/371472 [7:22:59<00:40,  3.60it/s]
100%|█████████▉| 371326/371472 [7:22:59<00:40,  3.59it/s]
100%|█████████▉| 371327/371472 [7:23:00<00:39,  3.71it/s]
100%|█████████▉| 371328/371472 [7:23:00<00:39,  3.61it/s]
100%|█████████▉| 371329/371472 [7:23:00<00:38,  3.72it/s]
100%|█████████▉| 371330/371472 [7:23:01<00:38,  3.71it/s]
100%|█████████▉| 371331/371472 [7:23:01<00:38,  3.62it/s]
100%|█████████▉| 371332/371472 [7:23:01<00:39,  3.55it/s]
100%|█████████▉| 371333/371472 [7:23:01<00:39,  3.55it/s]
100%|█████████▉| 371334/371472 [7:23:02<00:37,  3.70it/s]
100%|█████████▉| 371335/371472 [7:23:02<00:35,  3.83it/s]
100%|█████████▉| 371336/371472 [7:23:02<00:36,  3.78it/s]
100%|█████████▉| 371337/371472 [7:23:02<00:36,  3.67it/s]
100%|█████████▉| 371338/371472 [7:23:03<00:36,  3.68it/s]
100%|█████████▉| 371339/371472 [7:23:03<00:36,  3.67it/s]
100%|█████████▉| 371340/371472 [7:23:03<00:34,  3.80it/s]
                                                         
{'loss': 2.5615, 'learning_rate': 1.003199810381607e-07, 'epoch': 15.99}

100%|█████████▉| 371340/371472 [7:23:03<00:34,  3.80it/s]
100%|█████████▉| 371341/371472 [7:23:03<00:34,  3.80it/s]
100%|█████████▉| 371342/371472 [7:23:04<00:34,  3.72it/s]
100%|█████████▉| 371343/371472 [7:23:04<00:34,  3.77it/s]
100%|█████████▉| 371344/371472 [7:23:04<00:34,  3.75it/s]
100%|█████████▉| 371345/371472 [7:23:05<00:35,  3.61it/s]
100%|█████████▉| 371346/371472 [7:23:05<00:34,  3.69it/s]
100%|█████████▉| 371347/371472 [7:23:05<00:33,  3.75it/s]
100%|█████████▉| 371348/371472 [7:23:05<00:34,  3.59it/s]
100%|█████████▉| 371349/371472 [7:23:06<00:35,  3.44it/s]
100%|█████████▉| 371350/371472 [7:23:06<00:36,  3.39it/s]
100%|█████████▉| 371351/371472 [7:23:06<00:35,  3.41it/s]
100%|█████████▉| 371352/371472 [7:23:07<00:33,  3.57it/s]
100%|█████████▉| 371353/371472 [7:23:07<00:33,  3.56it/s]
100%|█████████▉| 371354/371472 [7:23:07<00:32,  3.64it/s]
100%|█████████▉| 371355/371472 [7:23:07<00:31,  3.71it/s]
100%|█████████▉| 371356/371472 [7:23:08<00:31,  3.69it/s]
100%|█████████▉| 371357/371472 [7:23:08<00:33,  3.40it/s]
100%|█████████▉| 371358/371472 [7:23:08<00:33,  3.42it/s]
100%|█████████▉| 371359/371472 [7:23:09<00:32,  3.42it/s]
100%|█████████▉| 371360/371472 [7:23:09<00:35,  3.17it/s]
                                                         
{'loss': 2.5744, 'learning_rate': 1.0027149906268185e-07, 'epoch': 16.0}

100%|█████████▉| 371360/371472 [7:23:09<00:35,  3.17it/s]
100%|█████████▉| 371361/371472 [7:23:09<00:35,  3.08it/s]
100%|█████████▉| 371362/371472 [7:23:10<00:34,  3.23it/s]
100%|█████████▉| 371363/371472 [7:23:10<00:32,  3.37it/s]
100%|█████████▉| 371364/371472 [7:23:10<00:33,  3.25it/s]
100%|█████████▉| 371365/371472 [7:23:11<00:36,  2.95it/s]
100%|█████████▉| 371366/371472 [7:23:11<00:35,  3.01it/s]
100%|█████████▉| 371367/371472 [7:23:11<00:34,  3.04it/s]
100%|█████████▉| 371368/371472 [7:23:12<00:33,  3.12it/s]
100%|█████████▉| 371369/371472 [7:23:12<00:32,  3.20it/s]
100%|█████████▉| 371370/371472 [7:23:12<00:30,  3.36it/s]
100%|█████████▉| 371371/371472 [7:23:12<00:30,  3.26it/s]
100%|█████████▉| 371372/371472 [7:23:13<00:30,  3.26it/s]
100%|█████████▉| 371373/371472 [7:23:13<00:29,  3.34it/s]
100%|█████████▉| 371374/371472 [7:23:13<00:29,  3.37it/s]
100%|█████████▉| 371375/371472 [7:23:14<00:31,  3.13it/s]
100%|█████████▉| 371376/371472 [7:23:14<00:29,  3.28it/s]
100%|█████████▉| 371377/371472 [7:23:14<00:26,  3.52it/s]
100%|█████████▉| 371378/371472 [7:23:14<00:27,  3.39it/s]
100%|█████████▉| 371379/371472 [7:23:15<00:26,  3.45it/s]
100%|█████████▉| 371380/371472 [7:23:15<00:26,  3.51it/s]
                                                         
{'loss': 2.602, 'learning_rate': 1.0022301708720291e-07, 'epoch': 16.0}

100%|█████████▉| 371380/371472 [7:23:15<00:26,  3.51it/s]
100%|█████████▉| 371381/371472 [7:23:15<00:27,  3.33it/s]
100%|█████████▉| 371382/371472 [7:23:16<00:27,  3.27it/s]
100%|█████████▉| 371383/371472 [7:23:16<00:26,  3.34it/s]
100%|█████████▉| 371384/371472 [7:23:16<00:25,  3.39it/s]
100%|█████████▉| 371385/371472 [7:23:17<00:25,  3.46it/s]
100%|█████████▉| 371386/371472 [7:23:17<00:24,  3.46it/s]
100%|█████████▉| 371387/371472 [7:23:17<00:24,  3.50it/s]
100%|█████████▉| 371388/371472 [7:23:17<00:24,  3.42it/s]
100%|█████████▉| 371389/371472 [7:23:18<00:24,  3.43it/s]
100%|█████████▉| 371390/371472 [7:23:18<00:24,  3.40it/s]
100%|█████████▉| 371391/371472 [7:23:18<00:23,  3.49it/s]
100%|█████████▉| 371392/371472 [7:23:19<00:24,  3.32it/s]
100%|█████████▉| 371393/371472 [7:23:19<00:23,  3.41it/s]
100%|█████████▉| 371394/371472 [7:23:19<00:22,  3.47it/s]
100%|█████████▉| 371395/371472 [7:23:19<00:22,  3.47it/s]
100%|█████████▉| 371396/371472 [7:23:20<00:21,  3.53it/s]
100%|█████████▉| 371397/371472 [7:23:20<00:20,  3.70it/s]
100%|█████████▉| 371398/371472 [7:23:20<00:19,  3.73it/s]
100%|█████████▉| 371399/371472 [7:23:20<00:19,  3.70it/s]
100%|█████████▉| 371400/371472 [7:23:21<00:21,  3.40it/s]
                                                         
{'loss': 2.7026, 'learning_rate': 1.0017453511172397e-07, 'epoch': 16.0}

100%|█████████▉| 371400/371472 [7:23:21<00:21,  3.40it/s]
100%|█████████▉| 371401/371472 [7:23:21<00:21,  3.26it/s]
100%|█████████▉| 371402/371472 [7:23:21<00:21,  3.30it/s]
100%|█████████▉| 371403/371472 [7:23:22<00:20,  3.34it/s]
100%|█████████▉| 371404/371472 [7:23:22<00:21,  3.13it/s]
100%|█████████▉| 371405/371472 [7:23:22<00:20,  3.33it/s]
100%|█████████▉| 371406/371472 [7:23:23<00:18,  3.51it/s]
100%|█████████▉| 371407/371472 [7:23:23<00:17,  3.64it/s]
100%|█████████▉| 371408/371472 [7:23:23<00:17,  3.71it/s]
100%|█████████▉| 371409/371472 [7:23:23<00:17,  3.55it/s]
100%|█████████▉| 371410/371472 [7:23:24<00:16,  3.68it/s]
100%|█████████▉| 371411/371472 [7:23:24<00:18,  3.25it/s]
100%|█████████▉| 371412/371472 [7:23:24<00:18,  3.16it/s]
100%|█████████▉| 371413/371472 [7:23:25<00:18,  3.14it/s]
100%|█████████▉| 371414/371472 [7:23:25<00:19,  2.96it/s]
100%|█████████▉| 371415/371472 [7:23:25<00:18,  3.13it/s]
100%|█████████▉| 371416/371472 [7:23:26<00:16,  3.31it/s]
100%|█████████▉| 371417/371472 [7:23:26<00:16,  3.39it/s]
100%|█████████▉| 371418/371472 [7:23:26<00:15,  3.40it/s]
100%|█████████▉| 371419/371472 [7:23:27<00:15,  3.37it/s]
100%|█████████▉| 371420/371472 [7:23:27<00:14,  3.51it/s]
                                                         
{'loss': 2.564, 'learning_rate': 1.0012605313624513e-07, 'epoch': 16.0}

100%|█████████▉| 371420/371472 [7:23:27<00:14,  3.51it/s]
100%|█████████▉| 371421/371472 [7:23:27<00:14,  3.61it/s]
100%|█████████▉| 371422/371472 [7:23:27<00:13,  3.75it/s]
100%|█████████▉| 371423/371472 [7:23:28<00:13,  3.70it/s]
100%|█████████▉| 371424/371472 [7:23:28<00:13,  3.47it/s]
100%|█████████▉| 371425/371472 [7:23:28<00:13,  3.38it/s]
100%|█████████▉| 371426/371472 [7:23:29<00:13,  3.29it/s]
100%|█████████▉| 371427/371472 [7:23:29<00:12,  3.48it/s]
100%|█████████▉| 371428/371472 [7:23:29<00:12,  3.51it/s]
100%|█████████▉| 371429/371472 [7:23:29<00:11,  3.70it/s]
100%|█████████▉| 371430/371472 [7:23:30<00:10,  3.86it/s]
100%|█████████▉| 371431/371472 [7:23:30<00:10,  3.86it/s]
100%|█████████▉| 371432/371472 [7:23:30<00:10,  3.82it/s]
100%|█████████▉| 371433/371472 [7:23:30<00:11,  3.50it/s]
100%|█████████▉| 371434/371472 [7:23:31<00:10,  3.50it/s]
100%|█████████▉| 371435/371472 [7:23:31<00:10,  3.49it/s]
100%|█████████▉| 371436/371472 [7:23:31<00:10,  3.50it/s]
100%|█████████▉| 371437/371472 [7:23:32<00:09,  3.65it/s]
100%|█████████▉| 371438/371472 [7:23:32<00:10,  3.23it/s]
100%|█████████▉| 371439/371472 [7:23:32<00:09,  3.36it/s]
100%|█████████▉| 371440/371472 [7:23:33<00:09,  3.24it/s]
                                                         
{'loss': 2.6131, 'learning_rate': 1.0007757116076619e-07, 'epoch': 16.0}

100%|█████████▉| 371440/371472 [7:23:33<00:09,  3.24it/s]
100%|█████████▉| 371441/371472 [7:23:33<00:09,  3.38it/s]
100%|█████████▉| 371442/371472 [7:23:33<00:08,  3.60it/s]
100%|█████████▉| 371443/371472 [7:23:33<00:08,  3.62it/s]
100%|█████████▉| 371444/371472 [7:23:34<00:07,  3.73it/s]
100%|█████████▉| 371445/371472 [7:23:34<00:07,  3.54it/s]
100%|█████████▉| 371446/371472 [7:23:34<00:07,  3.36it/s]
100%|█████████▉| 371447/371472 [7:23:34<00:06,  3.58it/s]
100%|█████████▉| 371448/371472 [7:23:35<00:06,  3.66it/s]
100%|█████████▉| 371449/371472 [7:23:35<00:06,  3.59it/s]
100%|█████████▉| 371450/371472 [7:23:35<00:05,  3.76it/s]
100%|█████████▉| 371451/371472 [7:23:35<00:05,  3.81it/s]
100%|█████████▉| 371452/371472 [7:23:36<00:05,  3.66it/s]
100%|█████████▉| 371453/371472 [7:23:36<00:05,  3.70it/s]
100%|█████████▉| 371454/371472 [7:23:36<00:04,  3.61it/s]
100%|█████████▉| 371455/371472 [7:23:37<00:04,  3.58it/s]
100%|█████████▉| 371456/371472 [7:23:37<00:04,  3.73it/s]
100%|█████████▉| 371457/371472 [7:23:37<00:04,  3.73it/s]
100%|█████████▉| 371458/371472 [7:23:37<00:03,  3.75it/s]
100%|█████████▉| 371459/371472 [7:23:38<00:03,  3.79it/s]
100%|█████████▉| 371460/371472 [7:23:38<00:03,  3.69it/s]
                                                         
{'loss': 2.4045, 'learning_rate': 1.0002908918528734e-07, 'epoch': 16.0}

100%|█████████▉| 371460/371472 [7:23:38<00:03,  3.69it/s]
100%|█████████▉| 371461/371472 [7:23:38<00:02,  3.70it/s]
100%|█████████▉| 371462/371472 [7:23:38<00:02,  3.69it/s]
100%|█████████▉| 371463/371472 [7:23:39<00:02,  3.57it/s]
100%|█████████▉| 371464/371472 [7:23:39<00:02,  3.59it/s]
100%|█████████▉| 371465/371472 [7:23:39<00:02,  3.41it/s]
100%|█████████▉| 371466/371472 [7:23:40<00:01,  3.57it/s]
100%|█████████▉| 371467/371472 [7:23:40<00:01,  3.65it/s]
100%|█████████▉| 371468/371472 [7:23:40<00:01,  3.71it/s]
100%|█████████▉| 371469/371472 [7:23:40<00:00,  3.70it/s]
100%|█████████▉| 371470/371472 [7:23:41<00:00,  3.55it/s]
100%|█████████▉| 371471/371472 [7:23:41<00:00,  3.65it/s]
100%|██████████| 371472/371472 [7:23:41<00:00,  3.48it/s]Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
Non-default generation parameters: {'max_length': 200, 'early_stopping': True, 'num_beams': 5, 'forced_eos_token_id': 2}

                                                         
{'train_runtime': 26664.9079, 'train_samples_per_second': 55.724, 'train_steps_per_second': 13.931, 'train_loss': 0.6528488995518832, 'epoch': 16.0}

100%|██████████| 371472/371472 [7:24:08<00:00,  3.48it/s]
100%|██████████| 371472/371472 [7:24:08<00:00, 13.94it/s]
Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
Non-default generation parameters: {'max_length': 200, 'early_stopping': True, 'num_beams': 5, 'forced_eos_token_id': 2}
Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
Non-default generation parameters: {'max_length': 200, 'early_stopping': True, 'num_beams': 5, 'forced_eos_token_id': 2}